2024-04-25T09:47:06.716 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T09:47:06.716 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673038 --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/forward-scrub} --owner scheduled_neesingh@teuthology --verbose --name neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi -- /home/teuthworker/archive/neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673038/orig.config.yaml 2024-04-25T09:47:06.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T09:47:06.846 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673038 branch: wip-neesingh-testing-240416 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/forward-scrub} email: neesingh@redhat.com first_in_suite: false job_id: '7673038' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-neesingh-testing-240416 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - inode wrongly marked free - bad backtrace on inode - inode table repaired for inode - Scrub error on inode - Scrub error on dir - Metadata damage detected sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec kclient: syntax: v1 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-62537 sha1: a3b7a189d278a9762c1acb7de36790ef0ed7b448 owner: scheduled_neesingh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1124 sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-62537 suite_path: /home/teuthworker/src/github.com_neesingh-rh_ceph_a3b7a189d278a9762c1acb7de36790ef0ed7b448/qa suite_relpath: qa suite_repo: https://github.com/neesingh-rh/ceph suite_sha1: a3b7a189d278a9762c1acb7de36790ef0ed7b448 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi007.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEfSF5Sphybv9x4whDjjx0cWREmR6RpKP4Ym3Ps/K+nSTpN/V15sllWUYXB5HjVaRCb3o81XuRaMk1FrlQXTON4= smithi055.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMvjcI3EAhFetE/fxskgi6DsYEKUy4hc69tS14FyfOQku5rWeA1ZhPPVyKtnvEfd/ByiijoMrPLUWIu70lSbpWM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_forward_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_09:36:50 tube: smithi user: neesingh verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T09:47:06.847 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_neesingh-rh_ceph_a3b7a189d278a9762c1acb7de36790ef0ed7b448/qa; will attempt to use it 2024-04-25T09:47:06.847 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_neesingh-rh_ceph_a3b7a189d278a9762c1acb7de36790ef0ed7b448/qa/tasks 2024-04-25T09:47:06.847 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T09:47:06.849 INFO:teuthology.task.internal:Checking packages... 2024-04-25T09:47:06.874 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec' 2024-04-25T09:47:06.874 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T09:47:06.874 INFO:teuthology.packaging:ref: None 2024-04-25T09:47:06.874 INFO:teuthology.packaging:tag: None 2024-04-25T09:47:06.874 INFO:teuthology.packaging:branch: wip-neesingh-testing-240416 2024-04-25T09:47:06.874 INFO:teuthology.packaging:sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T09:47:06.875 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-neesingh-testing-240416 2024-04-25T09:47:07.017 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1628.g97ae6cc9 2024-04-25T09:47:07.018 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T09:47:07.025 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T09:47:07.025 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T09:47:07.075 INFO:teuthology.task.internal:Saving configuration 2024-04-25T09:47:07.091 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T09:47:07.108 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T09:47:07.135 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673038', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 09:42:31.017081', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEfSF5Sphybv9x4whDjjx0cWREmR6RpKP4Ym3Ps/K+nSTpN/V15sllWUYXB5HjVaRCb3o81XuRaMk1FrlQXTON4='} 2024-04-25T09:47:07.160 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673038', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 09:42:31.018419', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMvjcI3EAhFetE/fxskgi6DsYEKUy4hc69tS14FyfOQku5rWeA1ZhPPVyKtnvEfd/ByiijoMrPLUWIu70lSbpWM='} 2024-04-25T09:47:07.160 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T09:47:07.167 INFO:teuthology.task.internal:roles: ubuntu@smithi007.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-25T09:47:07.167 INFO:teuthology.task.internal:roles: ubuntu@smithi055.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-25T09:47:07.167 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T09:47:07.265 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fab82fdd160>, signals=[15]) 2024-04-25T09:47:07.265 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T09:47:07.272 INFO:teuthology.task.internal:Opening connections... 2024-04-25T09:47:07.272 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi007.front.sepia.ceph.com 2024-04-25T09:47:07.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T09:47:07.354 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T09:47:07.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T09:47:07.433 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T09:47:07.440 DEBUG:teuthology.orchestra.run.smithi007:> uname -m 2024-04-25T09:47:07.458 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2024-04-25T09:47:07.458 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2024-04-25T09:47:07.516 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="CentOS Stream" 2024-04-25T09:47:07.516 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="9" 2024-04-25T09:47:07.516 INFO:teuthology.orchestra.run.smithi007.stdout:ID="centos" 2024-04-25T09:47:07.516 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="rhel fedora" 2024-04-25T09:47:07.516 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="9" 2024-04-25T09:47:07.516 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el9" 2024-04-25T09:47:07.516 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T09:47:07.517 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2024-04-25T09:47:07.517 INFO:teuthology.orchestra.run.smithi007.stdout:LOGO="fedora-logo-icon" 2024-04-25T09:47:07.517 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T09:47:07.517 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://centos.org/" 2024-04-25T09:47:07.517 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T09:47:07.517 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T09:47:07.517 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T09:47:07.517 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2024-04-25T09:47:07.536 DEBUG:teuthology.orchestra.run.smithi055:> uname -m 2024-04-25T09:47:07.554 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2024-04-25T09:47:07.554 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2024-04-25T09:47:07.611 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream" 2024-04-25T09:47:07.611 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="9" 2024-04-25T09:47:07.611 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos" 2024-04-25T09:47:07.611 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora" 2024-04-25T09:47:07.611 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="9" 2024-04-25T09:47:07.611 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el9" 2024-04-25T09:47:07.612 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T09:47:07.612 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2024-04-25T09:47:07.612 INFO:teuthology.orchestra.run.smithi055.stdout:LOGO="fedora-logo-icon" 2024-04-25T09:47:07.612 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T09:47:07.612 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/" 2024-04-25T09:47:07.612 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T09:47:07.612 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T09:47:07.612 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T09:47:07.612 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2024-04-25T09:47:07.636 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T09:47:07.645 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T09:47:07.683 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T09:47:07.683 DEBUG:teuthology.orchestra.run.smithi007:> test '!' -e /home/ubuntu/cephtest 2024-04-25T09:47:07.686 DEBUG:teuthology.orchestra.run.smithi055:> test '!' -e /home/ubuntu/cephtest 2024-04-25T09:47:07.702 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T09:47:07.717 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T09:47:07.717 DEBUG:teuthology.orchestra.run.smithi007:> test -z $(ls -A /var/lib/ceph) 2024-04-25T09:47:07.744 DEBUG:teuthology.orchestra.run.smithi055:> test -z $(ls -A /var/lib/ceph) 2024-04-25T09:47:07.772 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T09:47:07.826 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T09:47:07.843 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-04-25T09:47:07.843 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-04-25T09:47:07.843 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-04-25T09:47:07.844 DEBUG:teuthology.orchestra.run.smithi007:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T09:47:07.844 DEBUG:teuthology.orchestra.run.smithi055:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T09:47:07.860 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:47:07.860 DEBUG:teuthology.orchestra.run.smithi055:> uname -r 2024-04-25T09:47:07.861 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:47:07.861 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2024-04-25T09:47:07.917 INFO:teuthology.orchestra.run.smithi055.stdout:5.14.0-437.el9.x86_64 2024-04-25T09:47:07.918 INFO:teuthology.task.kernel:Running kernel on smithi055: 5.14.0-437.el9.x86_64 2024-04-25T09:47:07.918 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum install -y kernel 2024-04-25T09:47:07.919 INFO:teuthology.orchestra.run.smithi007.stdout:5.14.0-437.el9.x86_64 2024-04-25T09:47:07.919 INFO:teuthology.task.kernel:Running kernel on smithi007: 5.14.0-437.el9.x86_64 2024-04-25T09:47:07.919 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum install -y kernel 2024-04-25T09:47:10.114 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-04-25T09:47:10.319 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-04-25T09:47:12.362 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - AppStream 20 MB/s | 19 MB 00:00 2024-04-25T09:47:13.590 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - AppStream 8.0 MB/s | 19 MB 00:02 2024-04-25T09:47:16.580 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-25T09:47:17.799 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-25T09:47:18.147 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 16 kB 00:00 2024-04-25T09:47:19.325 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - Extras packages 49 kB/s | 16 kB 00:00 2024-04-25T09:47:19.609 INFO:teuthology.orchestra.run.smithi007.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-25T09:47:24.932 INFO:teuthology.orchestra.run.smithi007.stdout:lab-extras 46 kB/s | 1.7 kB 00:00 2024-04-25T09:47:26.880 INFO:teuthology.orchestra.run.smithi007.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T09:47:26.880 INFO:teuthology.orchestra.run.smithi007.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T09:47:26.970 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2024-04-25T09:47:26.971 INFO:teuthology.orchestra.run.smithi007.stdout:Nothing to do. 2024-04-25T09:47:26.972 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2024-04-25T09:47:27.083 DEBUG:teuthology.orchestra.run.smithi007:> echo no | sudo yum reinstall kernel || true 2024-04-25T09:47:27.604 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 09:47:24 AM UTC. 2024-04-25T09:47:27.728 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2024-04-25T09:47:27.743 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2024-04-25T09:47:27.743 INFO:teuthology.orchestra.run.smithi007.stdout: Package Architecture Version Repository Size 2024-04-25T09:47:27.743 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2024-04-25T09:47:27.743 INFO:teuthology.orchestra.run.smithi007.stdout:Reinstalling: 2024-04-25T09:47:27.744 INFO:teuthology.orchestra.run.smithi007.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T09:47:27.744 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:47:27.744 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2024-04-25T09:47:27.744 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2024-04-25T09:47:27.744 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:47:27.744 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 255 k 2024-04-25T09:47:27.744 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 0 2024-04-25T09:47:27.744 INFO:teuthology.orchestra.run.smithi007.stderr:Operation aborted. 2024-04-25T09:47:27.799 INFO:teuthology.orchestra.run.smithi007.stdout:Is this ok [y/N]: 2024-04-25T09:47:27.799 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum reinstall -y kernel || true 2024-04-25T09:47:28.317 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:00:04 ago on Thu 25 Apr 2024 09:47:24 AM UTC. 2024-04-25T09:47:28.438 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2024-04-25T09:47:28.439 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2024-04-25T09:47:28.439 INFO:teuthology.orchestra.run.smithi007.stdout: Package Architecture Version Repository Size 2024-04-25T09:47:28.439 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2024-04-25T09:47:28.439 INFO:teuthology.orchestra.run.smithi007.stdout:Reinstalling: 2024-04-25T09:47:28.439 INFO:teuthology.orchestra.run.smithi007.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T09:47:28.439 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:47:28.439 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2024-04-25T09:47:28.439 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2024-04-25T09:47:28.440 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:47:28.440 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 255 k 2024-04-25T09:47:28.440 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 0 2024-04-25T09:47:28.440 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2024-04-25T09:47:28.784 INFO:teuthology.orchestra.run.smithi007.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.2 MB/s | 255 kB 00:00 2024-04-25T09:47:28.784 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:47:28.784 INFO:teuthology.orchestra.run.smithi007.stdout:Total 740 kB/s | 255 kB 00:00 2024-04-25T09:47:28.807 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2024-04-25T09:47:29.000 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2024-04-25T09:47:29.000 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2024-04-25T09:47:29.005 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2024-04-25T09:47:29.005 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2024-04-25T09:47:29.160 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2024-04-25T09:47:29.235 INFO:teuthology.orchestra.run.smithi007.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T09:47:29.235 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T09:47:29.900 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T09:47:29.901 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T09:47:30.647 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T09:47:30.647 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:47:30.647 INFO:teuthology.orchestra.run.smithi007.stdout:Reinstalled: 2024-04-25T09:47:30.647 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T09:47:30.647 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:47:30.648 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2024-04-25T09:47:30.800 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T09:47:30.848 INFO:teuthology.orchestra.run.smithi007.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T09:47:30.849 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T09:47:30.849 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T09:47:30.849 DEBUG:teuthology.parallel:result is None 2024-04-25T09:47:38.686 INFO:teuthology.orchestra.run.smithi055.stdout:Extra Packages for Enterprise Linux 1.1 MB/s | 21 MB 00:19 2024-04-25T09:47:43.958 INFO:teuthology.orchestra.run.smithi055.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-04-25T09:47:45.956 INFO:teuthology.orchestra.run.smithi055.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T09:47:45.956 INFO:teuthology.orchestra.run.smithi055.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T09:47:46.051 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-25T09:47:46.052 INFO:teuthology.orchestra.run.smithi055.stdout:Nothing to do. 2024-04-25T09:47:46.052 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-04-25T09:47:46.164 DEBUG:teuthology.orchestra.run.smithi055:> echo no | sudo yum reinstall kernel || true 2024-04-25T09:47:46.687 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 09:47:43 AM UTC. 2024-04-25T09:47:46.823 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-25T09:47:46.834 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-25T09:47:46.835 INFO:teuthology.orchestra.run.smithi055.stdout: Package Architecture Version Repository Size 2024-04-25T09:47:46.835 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-25T09:47:46.835 INFO:teuthology.orchestra.run.smithi055.stdout:Reinstalling: 2024-04-25T09:47:46.835 INFO:teuthology.orchestra.run.smithi055.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T09:47:46.835 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:47:46.835 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction Summary 2024-04-25T09:47:46.835 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-25T09:47:46.835 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:47:46.836 INFO:teuthology.orchestra.run.smithi055.stdout:Total download size: 255 k 2024-04-25T09:47:46.836 INFO:teuthology.orchestra.run.smithi055.stdout:Installed size: 0 2024-04-25T09:47:46.836 INFO:teuthology.orchestra.run.smithi055.stderr:Operation aborted. 2024-04-25T09:47:46.892 INFO:teuthology.orchestra.run.smithi055.stdout:Is this ok [y/N]: 2024-04-25T09:47:46.892 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum reinstall -y kernel || true 2024-04-25T09:47:47.411 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:00:04 ago on Thu 25 Apr 2024 09:47:43 AM UTC. 2024-04-25T09:47:47.532 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-25T09:47:47.533 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-25T09:47:47.533 INFO:teuthology.orchestra.run.smithi055.stdout: Package Architecture Version Repository Size 2024-04-25T09:47:47.533 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-25T09:47:47.533 INFO:teuthology.orchestra.run.smithi055.stdout:Reinstalling: 2024-04-25T09:47:47.533 INFO:teuthology.orchestra.run.smithi055.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T09:47:47.533 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:47:47.533 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction Summary 2024-04-25T09:47:47.533 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-25T09:47:47.533 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:47:47.533 INFO:teuthology.orchestra.run.smithi055.stdout:Total download size: 255 k 2024-04-25T09:47:47.533 INFO:teuthology.orchestra.run.smithi055.stdout:Installed size: 0 2024-04-25T09:47:47.534 INFO:teuthology.orchestra.run.smithi055.stdout:Downloading Packages: 2024-04-25T09:47:47.860 INFO:teuthology.orchestra.run.smithi055.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.3 MB/s | 255 kB 00:00 2024-04-25T09:47:47.861 INFO:teuthology.orchestra.run.smithi055.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:47:47.861 INFO:teuthology.orchestra.run.smithi055.stdout:Total 778 kB/s | 255 kB 00:00 2024-04-25T09:47:47.879 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction check 2024-04-25T09:47:48.068 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction check succeeded. 2024-04-25T09:47:48.068 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction test 2024-04-25T09:47:48.073 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction test succeeded. 2024-04-25T09:47:48.074 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction 2024-04-25T09:47:48.213 INFO:teuthology.orchestra.run.smithi055.stdout: Preparing : 1/1 2024-04-25T09:47:48.295 INFO:teuthology.orchestra.run.smithi055.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T09:47:48.295 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T09:47:48.985 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T09:47:48.986 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T09:47:49.651 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T09:47:49.651 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:47:49.651 INFO:teuthology.orchestra.run.smithi055.stdout:Reinstalled: 2024-04-25T09:47:49.651 INFO:teuthology.orchestra.run.smithi055.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T09:47:49.651 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:47:49.652 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-04-25T09:47:49.818 DEBUG:teuthology.orchestra.run.smithi055:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T09:47:49.867 INFO:teuthology.orchestra.run.smithi055.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T09:47:49.867 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T09:47:49.867 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T09:47:49.867 DEBUG:teuthology.parallel:result is None 2024-04-25T09:47:49.868 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T09:47:49.880 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T09:47:49.880 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T09:47:49.883 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T09:47:49.899 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T09:47:49.917 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T09:47:49.964 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T09:47:49.965 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T09:47:49.967 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T09:47:49.998 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T09:47:50.006 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T09:47:50.006 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T09:47:50.034 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T09:47:50.066 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T09:47:50.068 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T09:47:50.082 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T09:47:50.082 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T09:47:50.084 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T09:47:50.091 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T09:47:50.092 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T09:47:50.128 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T09:47:50.154 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T09:47:50.165 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T09:47:50.165 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T09:47:50.197 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T09:47:50.213 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T09:47:50.298 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T09:47:50.349 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T09:47:50.432 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T09:47:50.475 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:47:50.475 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T09:47:50.542 DEBUG:teuthology.orchestra.run.smithi055:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T09:47:50.584 DEBUG:teuthology.orchestra.run.smithi055:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T09:47:50.633 DEBUG:teuthology.orchestra.run.smithi055:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T09:47:50.716 DEBUG:teuthology.orchestra.run.smithi055:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T09:47:50.756 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:47:50.757 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T09:47:50.822 DEBUG:teuthology.orchestra.run.smithi007:> sudo service rsyslog restart 2024-04-25T09:47:50.825 DEBUG:teuthology.orchestra.run.smithi055:> sudo service rsyslog restart 2024-04-25T09:47:50.860 INFO:teuthology.orchestra.run.smithi007.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T09:47:50.895 INFO:teuthology.orchestra.run.smithi055.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T09:47:51.285 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T09:47:51.293 INFO:teuthology.task.internal:Starting timer... 2024-04-25T09:47:51.293 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T09:47:51.328 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T09:47:51.369 DEBUG:teuthology.orchestra.run.smithi007:> sudo service auditd rotate 2024-04-25T09:47:51.431 INFO:teuthology.orchestra.run.smithi007.stdout:Rotating logs: 2024-04-25T09:47:51.434 DEBUG:teuthology.orchestra.run.smithi055:> sudo service auditd rotate 2024-04-25T09:47:51.486 INFO:teuthology.orchestra.run.smithi055.stdout:Rotating logs: 2024-04-25T09:47:51.488 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T09:47:51.488 DEBUG:teuthology.orchestra.run.smithi007:> /usr/sbin/getenforce 2024-04-25T09:47:51.513 INFO:teuthology.orchestra.run.smithi007.stdout:Permissive 2024-04-25T09:47:51.513 DEBUG:teuthology.orchestra.run.smithi055:> /usr/sbin/getenforce 2024-04-25T09:47:51.543 INFO:teuthology.orchestra.run.smithi055.stdout:Permissive 2024-04-25T09:47:51.543 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi007.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi055.front.sepia.ceph.com': 'permissive'} 2024-04-25T09:47:51.543 DEBUG:teuthology.orchestra.run.smithi007:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-25T09:47:51.578 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:47:51.579 DEBUG:teuthology.orchestra.run.smithi055:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-25T09:47:51.608 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:47:51.608 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T09:47:51.608 DEBUG:teuthology.orchestra.run.smithi007:> sudo /usr/sbin/setenforce permissive 2024-04-25T09:47:51.657 DEBUG:teuthology.orchestra.run.smithi055:> sudo /usr/sbin/setenforce permissive 2024-04-25T09:47:51.684 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T09:47:51.694 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-25T09:47:51.700 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-25T09:47:51.835 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T09:47:51.850 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T09:47:51.852 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi007.front.sepia.ceph.com,smithi055.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T09:51:26.787 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi007.front.sepia.ceph.com'), Remote(name='ubuntu@smithi055.front.sepia.ceph.com')] 2024-04-25T09:51:26.789 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-04-25T09:51:26.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T09:51:26.868 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-04-25T09:51:26.958 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-04-25T09:51:26.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-04-25T09:51:26.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T09:51:27.036 DEBUG:teuthology.orchestra.run.smithi055:> true 2024-04-25T09:51:27.118 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-04-25T09:51:27.118 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T09:51:27.128 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T09:51:27.129 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T09:51:27.129 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T09:51:27.132 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T09:51:27.132 DEBUG:teuthology.orchestra.run.smithi055:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T09:51:27.163 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T09:51:27.179 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T09:51:27.189 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T09:51:27.204 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T09:51:27.204 INFO:teuthology.orchestra.run.smithi007.stderr:sudo: ntpd: command not found 2024-04-25T09:51:27.216 INFO:teuthology.orchestra.run.smithi007.stdout:506 Cannot talk to daemon 2024-04-25T09:51:27.229 INFO:teuthology.orchestra.run.smithi055.stderr:sudo: ntpd: command not found 2024-04-25T09:51:27.230 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T09:51:27.240 INFO:teuthology.orchestra.run.smithi055.stdout:506 Cannot talk to daemon 2024-04-25T09:51:27.244 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T09:51:27.254 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T09:51:27.267 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T09:51:27.303 INFO:teuthology.orchestra.run.smithi007.stderr:bash: line 1: ntpq: command not found 2024-04-25T09:51:27.306 INFO:teuthology.orchestra.run.smithi007.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T09:51:27.306 INFO:teuthology.orchestra.run.smithi007.stdout:=============================================================================== 2024-04-25T09:51:27.306 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:51:27.306 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:51:27.306 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:51:27.306 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:51:27.321 INFO:teuthology.orchestra.run.smithi055.stderr:bash: line 1: ntpq: command not found 2024-04-25T09:51:27.324 INFO:teuthology.orchestra.run.smithi055.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T09:51:27.324 INFO:teuthology.orchestra.run.smithi055.stdout:=============================================================================== 2024-04-25T09:51:27.324 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:51:27.324 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:51:27.324 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:51:27.324 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:51:27.325 INFO:teuthology.run_tasks:Running task install... 2024-04-25T09:51:27.333 DEBUG:teuthology.task.install:project ceph 2024-04-25T09:51:27.334 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}} 2024-04-25T09:51:27.334 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'} 2024-04-25T09:51:27.334 INFO:teuthology.task.install:Using flavor: default 2024-04-25T09:51:27.339 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T09:51:27.340 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T09:51:27.340 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec', 'tag': None, 'wait_for_package': False} 2024-04-25T09:51:27.340 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T09:51:27.342 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec', 'tag': None, 'wait_for_package': False} 2024-04-25T09:51:27.343 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T09:51:27.480 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/ 2024-04-25T09:51:27.481 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1628.g97ae6cc9 2024-04-25T09:51:27.499 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/ 2024-04-25T09:51:27.500 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1628.g97ae6cc9 2024-04-25T09:51:27.602 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T09:51:27.603 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:51:27.603 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T09:51:27.630 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T09:51:27.630 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:51:27.630 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T09:51:27.631 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T09:51:27.632 DEBUG:teuthology.orchestra.run.smithi007:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T09:51:27.657 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T09:51:27.657 DEBUG:teuthology.orchestra.run.smithi055:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T09:51:27.699 DEBUG:teuthology.orchestra.run.smithi007:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T09:51:27.723 DEBUG:teuthology.orchestra.run.smithi055:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T09:51:27.775 DEBUG:teuthology.orchestra.run.smithi007:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T09:51:27.799 DEBUG:teuthology.orchestra.run.smithi055:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T09:51:27.839 INFO:teuthology.orchestra.run.smithi007.stdout:check_obsoletes = 1 2024-04-25T09:51:27.841 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum clean all 2024-04-25T09:51:27.863 INFO:teuthology.orchestra.run.smithi055.stdout:check_obsoletes = 1 2024-04-25T09:51:27.865 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum clean all 2024-04-25T09:51:28.074 INFO:teuthology.orchestra.run.smithi007.stdout:48 files removed 2024-04-25T09:51:28.098 INFO:teuthology.orchestra.run.smithi055.stdout:48 files removed 2024-04-25T09:51:28.101 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T09:51:28.126 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T09:51:28.688 INFO:teuthology.orchestra.run.smithi007.stdout:ceph packages for x86_64 262 kB/s | 82 kB 00:00 2024-04-25T09:51:28.725 INFO:teuthology.orchestra.run.smithi055.stdout:ceph packages for x86_64 251 kB/s | 82 kB 00:00 2024-04-25T09:51:29.058 INFO:teuthology.orchestra.run.smithi007.stdout:ceph noarch packages 31 kB/s | 10 kB 00:00 2024-04-25T09:51:29.100 INFO:teuthology.orchestra.run.smithi055.stdout:ceph noarch packages 30 kB/s | 10 kB 00:00 2024-04-25T09:51:29.400 INFO:teuthology.orchestra.run.smithi007.stdout:ceph source packages 6.2 kB/s | 1.9 kB 00:00 2024-04-25T09:51:29.468 INFO:teuthology.orchestra.run.smithi055.stdout:ceph source packages 5.7 kB/s | 1.9 kB 00:00 2024-04-25T09:51:30.234 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-04-25T09:51:30.750 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - BaseOS 6.1 MB/s | 8.0 MB 00:01 2024-04-25T09:51:32.627 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - AppStream 15 MB/s | 19 MB 00:01 2024-04-25T09:51:32.860 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:01 2024-04-25T09:51:36.953 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-25T09:51:38.144 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.2 MB 00:01 2024-04-25T09:51:38.513 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 16 kB 00:00 2024-04-25T09:51:39.622 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 16 kB 00:00 2024-04-25T09:51:41.239 INFO:teuthology.orchestra.run.smithi055.stdout:Extra Packages for Enterprise Linux 8.0 MB/s | 21 MB 00:02 2024-04-25T09:51:43.654 INFO:teuthology.orchestra.run.smithi007.stdout:Extra Packages for Enterprise Linux 5.4 MB/s | 21 MB 00:03 2024-04-25T09:51:46.514 INFO:teuthology.orchestra.run.smithi055.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-04-25T09:51:48.758 INFO:teuthology.orchestra.run.smithi055.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T09:51:48.759 INFO:teuthology.orchestra.run.smithi055.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T09:51:48.771 INFO:teuthology.orchestra.run.smithi055.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T09:51:48.772 INFO:teuthology.orchestra.run.smithi055.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T09:51:48.773 INFO:teuthology.orchestra.run.smithi055.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T09:51:48.774 INFO:teuthology.orchestra.run.smithi055.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T09:51:48.775 INFO:teuthology.orchestra.run.smithi055.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T09:51:48.778 INFO:teuthology.orchestra.run.smithi055.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T09:51:48.779 INFO:teuthology.orchestra.run.smithi055.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T09:51:48.843 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-25T09:51:48.852 INFO:teuthology.orchestra.run.smithi055.stdout:======================================================================================= 2024-04-25T09:51:48.852 INFO:teuthology.orchestra.run.smithi055.stdout: Package Arch Version Repository Size 2024-04-25T09:51:48.853 INFO:teuthology.orchestra.run.smithi055.stdout:======================================================================================= 2024-04-25T09:51:48.853 INFO:teuthology.orchestra.run.smithi055.stdout:Installing: 2024-04-25T09:51:48.853 INFO:teuthology.orchestra.run.smithi055.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T09:51:48.853 INFO:teuthology.orchestra.run.smithi055.stdout: ceph x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 6.6 k 2024-04-25T09:51:48.853 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-base x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 5.3 M 2024-04-25T09:51:48.854 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-fuse x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 887 k 2024-04-25T09:51:48.854 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 145 k 2024-04-25T09:51:48.854 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 1.5 M 2024-04-25T09:51:48.854 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 138 k 2024-04-25T09:51:48.855 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 1.8 M 2024-04-25T09:51:48.855 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 7.4 M 2024-04-25T09:51:48.855 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-rook noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 49 k 2024-04-25T09:51:48.855 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-radosgw x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 9.8 M 2024-04-25T09:51:48.855 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-test x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 47 M 2024-04-25T09:51:48.855 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-volume noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 264 k 2024-04-25T09:51:48.855 INFO:teuthology.orchestra.run.smithi055.stdout: cephadm noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 748 k 2024-04-25T09:51:48.855 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-mirror x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 220 k 2024-04-25T09:51:48.856 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-shell x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 27 k 2024-04-25T09:51:48.856 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-top noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 18 k 2024-04-25T09:51:48.856 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T09:51:48.856 INFO:teuthology.orchestra.run.smithi055.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T09:51:48.856 INFO:teuthology.orchestra.run.smithi055.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T09:51:48.856 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs-devel x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 31 k 2024-04-25T09:51:48.856 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs2 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 744 k 2024-04-25T09:51:48.857 INFO:teuthology.orchestra.run.smithi055.stdout: librados-devel x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 127 k 2024-04-25T09:51:48.857 INFO:teuthology.orchestra.run.smithi055.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T09:51:48.857 INFO:teuthology.orchestra.run.smithi055.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T09:51:48.857 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T09:51:48.857 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T09:51:48.857 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T09:51:48.857 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T09:51:48.857 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cephfs x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 162 k 2024-04-25T09:51:48.857 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rados x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 321 k 2024-04-25T09:51:48.857 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rbd x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 298 k 2024-04-25T09:51:48.857 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rgw x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 99 k 2024-04-25T09:51:48.857 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-fuse x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 85 k 2024-04-25T09:51:48.858 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-mirror x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 3.1 M 2024-04-25T09:51:48.858 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-nbd x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 170 k 2024-04-25T09:51:48.858 INFO:teuthology.orchestra.run.smithi055.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T09:51:48.858 INFO:teuthology.orchestra.run.smithi055.stdout:Upgrading: 2024-04-25T09:51:48.858 INFO:teuthology.orchestra.run.smithi055.stdout: librados2 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 3.4 M 2024-04-25T09:51:48.858 INFO:teuthology.orchestra.run.smithi055.stdout: librbd1 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 3.1 M 2024-04-25T09:51:48.858 INFO:teuthology.orchestra.run.smithi055.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T09:51:48.858 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T09:51:48.858 INFO:teuthology.orchestra.run.smithi055.stdout:Installing dependencies: 2024-04-25T09:51:48.858 INFO:teuthology.orchestra.run.smithi055.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T09:51:48.858 INFO:teuthology.orchestra.run.smithi055.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T09:51:48.858 INFO:teuthology.orchestra.run.smithi055.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T09:51:48.859 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-common x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 20 M 2024-04-25T09:51:48.859 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 31 k 2024-04-25T09:51:48.859 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mds x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 2.1 M 2024-04-25T09:51:48.859 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 248 k 2024-04-25T09:51:48.859 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mon x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 4.7 M 2024-04-25T09:51:48.859 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-osd x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 17 M 2024-04-25T09:51:48.859 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 15 k 2024-04-25T09:51:48.859 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-selinux x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 25 k 2024-04-25T09:51:48.859 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T09:51:48.859 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T09:51:48.859 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T09:51:48.859 INFO:teuthology.orchestra.run.smithi055.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T09:51:48.859 INFO:teuthology.orchestra.run.smithi055.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T09:51:48.860 INFO:teuthology.orchestra.run.smithi055.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T09:51:48.860 INFO:teuthology.orchestra.run.smithi055.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T09:51:48.860 INFO:teuthology.orchestra.run.smithi055.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T09:51:48.860 INFO:teuthology.orchestra.run.smithi055.stdout: libcephsqlite x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 163 k 2024-04-25T09:51:48.860 INFO:teuthology.orchestra.run.smithi055.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T09:51:48.860 INFO:teuthology.orchestra.run.smithi055.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T09:51:48.860 INFO:teuthology.orchestra.run.smithi055.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T09:51:48.860 INFO:teuthology.orchestra.run.smithi055.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T09:51:48.860 INFO:teuthology.orchestra.run.smithi055.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T09:51:48.860 INFO:teuthology.orchestra.run.smithi055.stdout: libradosstriper1 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 501 k 2024-04-25T09:51:48.860 INFO:teuthology.orchestra.run.smithi055.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T09:51:48.860 INFO:teuthology.orchestra.run.smithi055.stdout: librgw2 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 5.1 M 2024-04-25T09:51:48.861 INFO:teuthology.orchestra.run.smithi055.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T09:51:48.861 INFO:teuthology.orchestra.run.smithi055.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T09:51:48.861 INFO:teuthology.orchestra.run.smithi055.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T09:51:48.861 INFO:teuthology.orchestra.run.smithi055.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T09:51:48.861 INFO:teuthology.orchestra.run.smithi055.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T09:51:48.861 INFO:teuthology.orchestra.run.smithi055.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T09:51:48.861 INFO:teuthology.orchestra.run.smithi055.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T09:51:48.861 INFO:teuthology.orchestra.run.smithi055.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T09:51:48.861 INFO:teuthology.orchestra.run.smithi055.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T09:51:48.861 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T09:51:48.861 INFO:teuthology.orchestra.run.smithi055.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T09:51:48.861 INFO:teuthology.orchestra.run.smithi055.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T09:51:48.861 INFO:teuthology.orchestra.run.smithi055.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T09:51:48.862 INFO:teuthology.orchestra.run.smithi055.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T09:51:48.862 INFO:teuthology.orchestra.run.smithi055.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T09:51:48.862 INFO:teuthology.orchestra.run.smithi055.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T09:51:48.862 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T09:51:48.862 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-argparse x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 45 k 2024-04-25T09:51:48.862 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-common x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 131 k 2024-04-25T09:51:48.862 INFO:teuthology.orchestra.run.smithi055.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T09:51:48.862 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T09:51:48.862 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T09:51:48.862 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T09:51:48.862 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T09:51:48.862 INFO:teuthology.orchestra.run.smithi055.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T09:51:48.863 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T09:51:48.863 INFO:teuthology.orchestra.run.smithi055.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T09:51:48.863 INFO:teuthology.orchestra.run.smithi055.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T09:51:48.863 INFO:teuthology.orchestra.run.smithi055.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T09:51:48.863 INFO:teuthology.orchestra.run.smithi055.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T09:51:48.863 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T09:51:48.863 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T09:51:48.863 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T09:51:48.863 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T09:51:48.863 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T09:51:48.863 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T09:51:48.863 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T09:51:48.863 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T09:51:48.863 INFO:teuthology.orchestra.run.smithi055.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T09:51:48.864 INFO:teuthology.orchestra.run.smithi055.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T09:51:48.864 INFO:teuthology.orchestra.run.smithi055.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T09:51:48.864 INFO:teuthology.orchestra.run.smithi055.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T09:51:48.864 INFO:teuthology.orchestra.run.smithi055.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T09:51:48.864 INFO:teuthology.orchestra.run.smithi055.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T09:51:48.864 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T09:51:48.864 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T09:51:48.864 INFO:teuthology.orchestra.run.smithi055.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T09:51:48.864 INFO:teuthology.orchestra.run.smithi055.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T09:51:48.864 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T09:51:48.864 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T09:51:48.864 INFO:teuthology.orchestra.run.smithi055.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T09:51:48.864 INFO:teuthology.orchestra.run.smithi055.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T09:51:48.864 INFO:teuthology.orchestra.run.smithi055.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T09:51:48.865 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T09:51:48.865 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T09:51:48.865 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T09:51:48.865 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T09:51:48.865 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T09:51:48.865 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T09:51:48.866 INFO:teuthology.orchestra.run.smithi055.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T09:51:48.866 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T09:51:48.866 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T09:51:48.866 INFO:teuthology.orchestra.run.smithi055.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T09:51:48.866 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T09:51:48.866 INFO:teuthology.orchestra.run.smithi055.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T09:51:48.867 INFO:teuthology.orchestra.run.smithi055.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T09:51:48.867 INFO:teuthology.orchestra.run.smithi055.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T09:51:48.867 INFO:teuthology.orchestra.run.smithi055.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T09:51:48.867 INFO:teuthology.orchestra.run.smithi055.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T09:51:48.867 INFO:teuthology.orchestra.run.smithi055.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T09:51:48.867 INFO:teuthology.orchestra.run.smithi055.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T09:51:48.868 INFO:teuthology.orchestra.run.smithi055.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T09:51:48.868 INFO:teuthology.orchestra.run.smithi055.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T09:51:48.868 INFO:teuthology.orchestra.run.smithi055.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T09:51:48.868 INFO:teuthology.orchestra.run.smithi055.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T09:51:48.869 INFO:teuthology.orchestra.run.smithi055.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T09:51:48.869 INFO:teuthology.orchestra.run.smithi055.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T09:51:48.869 INFO:teuthology.orchestra.run.smithi055.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T09:51:48.869 INFO:teuthology.orchestra.run.smithi055.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T09:51:48.869 INFO:teuthology.orchestra.run.smithi055.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T09:51:48.869 INFO:teuthology.orchestra.run.smithi055.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T09:51:48.870 INFO:teuthology.orchestra.run.smithi055.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T09:51:48.870 INFO:teuthology.orchestra.run.smithi055.stdout:Installing weak dependencies: 2024-04-25T09:51:48.870 INFO:teuthology.orchestra.run.smithi055.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T09:51:48.870 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:51:48.870 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction Summary 2024-04-25T09:51:48.871 INFO:teuthology.orchestra.run.smithi055.stdout:======================================================================================= 2024-04-25T09:51:48.871 INFO:teuthology.orchestra.run.smithi055.stdout:Install 148 Packages 2024-04-25T09:51:48.871 INFO:teuthology.orchestra.run.smithi055.stdout:Upgrade 4 Packages 2024-04-25T09:51:48.871 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:51:48.872 INFO:teuthology.orchestra.run.smithi055.stdout:Total download size: 215 M 2024-04-25T09:51:48.873 INFO:teuthology.orchestra.run.smithi055.stdout:Downloading Packages: 2024-04-25T09:51:49.054 INFO:teuthology.orchestra.run.smithi007.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-04-25T09:51:49.882 INFO:teuthology.orchestra.run.smithi055.stdout:(1/152): ceph-19.0.0-1628.g97ae6cc9.el9.x86_64. 29 kB/s | 6.6 kB 00:00 2024-04-25T09:51:50.266 INFO:teuthology.orchestra.run.smithi055.stdout:(2/152): ceph-fuse-19.0.0-1628.g97ae6cc9.el9.x8 2.3 MB/s | 887 kB 00:00 2024-04-25T09:51:50.341 INFO:teuthology.orchestra.run.smithi055.stdout:(3/152): ceph-immutable-object-cache-19.0.0-162 1.9 MB/s | 145 kB 00:00 2024-04-25T09:51:50.783 INFO:teuthology.orchestra.run.smithi055.stdout:(4/152): ceph-mds-19.0.0-1628.g97ae6cc9.el9.x86 4.8 MB/s | 2.1 MB 00:00 2024-04-25T09:51:51.042 INFO:teuthology.orchestra.run.smithi055.stdout:(5/152): ceph-mgr-19.0.0-1628.g97ae6cc9.el9.x86 5.8 MB/s | 1.5 MB 00:00 2024-04-25T09:51:51.272 INFO:teuthology.orchestra.run.smithi007.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T09:51:51.273 INFO:teuthology.orchestra.run.smithi007.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T09:51:51.284 INFO:teuthology.orchestra.run.smithi007.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T09:51:51.285 INFO:teuthology.orchestra.run.smithi007.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T09:51:51.286 INFO:teuthology.orchestra.run.smithi007.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T09:51:51.286 INFO:teuthology.orchestra.run.smithi007.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T09:51:51.288 INFO:teuthology.orchestra.run.smithi007.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T09:51:51.290 INFO:teuthology.orchestra.run.smithi007.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T09:51:51.291 INFO:teuthology.orchestra.run.smithi007.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T09:51:51.355 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2024-04-25T09:51:51.364 INFO:teuthology.orchestra.run.smithi007.stdout:======================================================================================= 2024-04-25T09:51:51.364 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2024-04-25T09:51:51.364 INFO:teuthology.orchestra.run.smithi007.stdout:======================================================================================= 2024-04-25T09:51:51.365 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2024-04-25T09:51:51.365 INFO:teuthology.orchestra.run.smithi007.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T09:51:51.365 INFO:teuthology.orchestra.run.smithi007.stdout: ceph x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 6.6 k 2024-04-25T09:51:51.365 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 5.3 M 2024-04-25T09:51:51.365 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-fuse x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 887 k 2024-04-25T09:51:51.365 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 145 k 2024-04-25T09:51:51.365 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 1.5 M 2024-04-25T09:51:51.365 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 138 k 2024-04-25T09:51:51.365 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 1.8 M 2024-04-25T09:51:51.365 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 7.4 M 2024-04-25T09:51:51.365 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 49 k 2024-04-25T09:51:51.365 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-radosgw x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 9.8 M 2024-04-25T09:51:51.365 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-test x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 47 M 2024-04-25T09:51:51.365 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-volume noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 264 k 2024-04-25T09:51:51.366 INFO:teuthology.orchestra.run.smithi007.stdout: cephadm noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 748 k 2024-04-25T09:51:51.366 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-mirror x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 220 k 2024-04-25T09:51:51.366 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-shell x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 27 k 2024-04-25T09:51:51.366 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-top noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 18 k 2024-04-25T09:51:51.366 INFO:teuthology.orchestra.run.smithi007.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T09:51:51.366 INFO:teuthology.orchestra.run.smithi007.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T09:51:51.366 INFO:teuthology.orchestra.run.smithi007.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T09:51:51.366 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-devel x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 31 k 2024-04-25T09:51:51.366 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs2 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 744 k 2024-04-25T09:51:51.366 INFO:teuthology.orchestra.run.smithi007.stdout: librados-devel x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 127 k 2024-04-25T09:51:51.366 INFO:teuthology.orchestra.run.smithi007.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T09:51:51.366 INFO:teuthology.orchestra.run.smithi007.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T09:51:51.367 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T09:51:51.367 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T09:51:51.367 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T09:51:51.367 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T09:51:51.367 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cephfs x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 162 k 2024-04-25T09:51:51.367 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 321 k 2024-04-25T09:51:51.367 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rbd x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 298 k 2024-04-25T09:51:51.367 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rgw x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 99 k 2024-04-25T09:51:51.368 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-fuse x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 85 k 2024-04-25T09:51:51.368 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-mirror x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 3.1 M 2024-04-25T09:51:51.368 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-nbd x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 170 k 2024-04-25T09:51:51.368 INFO:teuthology.orchestra.run.smithi007.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T09:51:51.368 INFO:teuthology.orchestra.run.smithi007.stdout:Upgrading: 2024-04-25T09:51:51.368 INFO:teuthology.orchestra.run.smithi007.stdout: librados2 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 3.4 M 2024-04-25T09:51:51.368 INFO:teuthology.orchestra.run.smithi007.stdout: librbd1 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 3.1 M 2024-04-25T09:51:51.368 INFO:teuthology.orchestra.run.smithi007.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T09:51:51.368 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T09:51:51.368 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2024-04-25T09:51:51.368 INFO:teuthology.orchestra.run.smithi007.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T09:51:51.368 INFO:teuthology.orchestra.run.smithi007.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T09:51:51.368 INFO:teuthology.orchestra.run.smithi007.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T09:51:51.369 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-common x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 20 M 2024-04-25T09:51:51.369 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 31 k 2024-04-25T09:51:51.369 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mds x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 2.1 M 2024-04-25T09:51:51.369 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 248 k 2024-04-25T09:51:51.369 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mon x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 4.7 M 2024-04-25T09:51:51.369 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-osd x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 17 M 2024-04-25T09:51:51.369 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 15 k 2024-04-25T09:51:51.369 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-selinux x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 25 k 2024-04-25T09:51:51.370 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T09:51:51.370 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T09:51:51.370 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T09:51:51.370 INFO:teuthology.orchestra.run.smithi007.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T09:51:51.370 INFO:teuthology.orchestra.run.smithi007.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T09:51:51.370 INFO:teuthology.orchestra.run.smithi007.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T09:51:51.370 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T09:51:51.370 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T09:51:51.370 INFO:teuthology.orchestra.run.smithi007.stdout: libcephsqlite x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 163 k 2024-04-25T09:51:51.370 INFO:teuthology.orchestra.run.smithi007.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T09:51:51.370 INFO:teuthology.orchestra.run.smithi007.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T09:51:51.370 INFO:teuthology.orchestra.run.smithi007.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T09:51:51.370 INFO:teuthology.orchestra.run.smithi007.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T09:51:51.370 INFO:teuthology.orchestra.run.smithi007.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T09:51:51.371 INFO:teuthology.orchestra.run.smithi007.stdout: libradosstriper1 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 501 k 2024-04-25T09:51:51.371 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T09:51:51.371 INFO:teuthology.orchestra.run.smithi007.stdout: librgw2 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 5.1 M 2024-04-25T09:51:51.371 INFO:teuthology.orchestra.run.smithi007.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T09:51:51.371 INFO:teuthology.orchestra.run.smithi007.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T09:51:51.371 INFO:teuthology.orchestra.run.smithi007.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T09:51:51.371 INFO:teuthology.orchestra.run.smithi007.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T09:51:51.371 INFO:teuthology.orchestra.run.smithi007.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T09:51:51.371 INFO:teuthology.orchestra.run.smithi007.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T09:51:51.372 INFO:teuthology.orchestra.run.smithi007.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T09:51:51.372 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T09:51:51.372 INFO:teuthology.orchestra.run.smithi007.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T09:51:51.372 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T09:51:51.372 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T09:51:51.372 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T09:51:51.372 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T09:51:51.373 INFO:teuthology.orchestra.run.smithi007.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T09:51:51.373 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T09:51:51.373 INFO:teuthology.orchestra.run.smithi007.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T09:51:51.373 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T09:51:51.373 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 45 k 2024-04-25T09:51:51.373 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 131 k 2024-04-25T09:51:51.374 INFO:teuthology.orchestra.run.smithi007.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T09:51:51.374 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T09:51:51.374 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T09:51:51.374 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T09:51:51.374 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T09:51:51.374 INFO:teuthology.orchestra.run.smithi007.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T09:51:51.374 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T09:51:51.374 INFO:teuthology.orchestra.run.smithi007.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T09:51:51.375 INFO:teuthology.orchestra.run.smithi007.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T09:51:51.375 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T09:51:51.375 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T09:51:51.375 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T09:51:51.375 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T09:51:51.375 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T09:51:51.375 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T09:51:51.375 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T09:51:51.375 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T09:51:51.376 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T09:51:51.376 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T09:51:51.376 INFO:teuthology.orchestra.run.smithi007.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T09:51:51.376 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T09:51:51.376 INFO:teuthology.orchestra.run.smithi007.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T09:51:51.376 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T09:51:51.376 INFO:teuthology.orchestra.run.smithi007.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T09:51:51.376 INFO:teuthology.orchestra.run.smithi007.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T09:51:51.376 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T09:51:51.377 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T09:51:51.377 INFO:teuthology.orchestra.run.smithi007.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T09:51:51.377 INFO:teuthology.orchestra.run.smithi007.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T09:51:51.377 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T09:51:51.377 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T09:51:51.377 INFO:teuthology.orchestra.run.smithi007.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T09:51:51.377 INFO:teuthology.orchestra.run.smithi007.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T09:51:51.377 INFO:teuthology.orchestra.run.smithi007.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T09:51:51.378 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T09:51:51.378 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T09:51:51.378 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T09:51:51.378 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T09:51:51.378 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T09:51:51.378 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T09:51:51.378 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T09:51:51.378 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T09:51:51.379 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T09:51:51.379 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T09:51:51.379 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T09:51:51.379 INFO:teuthology.orchestra.run.smithi007.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T09:51:51.379 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T09:51:51.379 INFO:teuthology.orchestra.run.smithi007.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T09:51:51.379 INFO:teuthology.orchestra.run.smithi007.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T09:51:51.379 INFO:teuthology.orchestra.run.smithi007.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T09:51:51.379 INFO:teuthology.orchestra.run.smithi007.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T09:51:51.380 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T09:51:51.380 INFO:teuthology.orchestra.run.smithi007.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T09:51:51.380 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T09:51:51.380 INFO:teuthology.orchestra.run.smithi007.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T09:51:51.380 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T09:51:51.380 INFO:teuthology.orchestra.run.smithi007.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T09:51:51.380 INFO:teuthology.orchestra.run.smithi007.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T09:51:51.381 INFO:teuthology.orchestra.run.smithi007.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T09:51:51.381 INFO:teuthology.orchestra.run.smithi007.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T09:51:51.381 INFO:teuthology.orchestra.run.smithi007.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T09:51:51.381 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T09:51:51.381 INFO:teuthology.orchestra.run.smithi007.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T09:51:51.381 INFO:teuthology.orchestra.run.smithi007.stdout:Installing weak dependencies: 2024-04-25T09:51:51.381 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T09:51:51.381 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:51:51.381 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2024-04-25T09:51:51.381 INFO:teuthology.orchestra.run.smithi007.stdout:======================================================================================= 2024-04-25T09:51:51.381 INFO:teuthology.orchestra.run.smithi007.stdout:Install 148 Packages 2024-04-25T09:51:51.381 INFO:teuthology.orchestra.run.smithi007.stdout:Upgrade 4 Packages 2024-04-25T09:51:51.381 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:51:51.382 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 215 M 2024-04-25T09:51:51.382 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2024-04-25T09:51:51.442 INFO:teuthology.orchestra.run.smithi055.stdout:(6/152): ceph-base-19.0.0-1628.g97ae6cc9.el9.x8 3.0 MB/s | 5.3 MB 00:01 2024-04-25T09:51:51.734 INFO:teuthology.orchestra.run.smithi055.stdout:(7/152): ceph-common-19.0.0-1628.g97ae6cc9.el9. 9.6 MB/s | 20 MB 00:02 2024-04-25T09:51:51.809 INFO:teuthology.orchestra.run.smithi055.stdout:(8/152): ceph-mon-19.0.0-1628.g97ae6cc9.el9.x86 6.1 MB/s | 4.7 MB 00:00 2024-04-25T09:51:51.892 INFO:teuthology.orchestra.run.smithi055.stdout:(9/152): ceph-selinux-19.0.0-1628.g97ae6cc9.el9 303 kB/s | 25 kB 00:00 2024-04-25T09:51:52.372 INFO:teuthology.orchestra.run.smithi007.stdout:(1/152): ceph-19.0.0-1628.g97ae6cc9.el9.x86_64. 21 kB/s | 6.6 kB 00:00 2024-04-25T09:51:52.409 INFO:teuthology.orchestra.run.smithi055.stdout:(10/152): ceph-radosgw-19.0.0-1628.g97ae6cc9.el 14 MB/s | 9.8 MB 00:00 2024-04-25T09:51:52.493 INFO:teuthology.orchestra.run.smithi055.stdout:(11/152): cephfs-mirror-19.0.0-1628.g97ae6cc9.e 2.6 MB/s | 220 kB 00:00 2024-04-25T09:51:52.568 INFO:teuthology.orchestra.run.smithi055.stdout:(12/152): cephfs-shell-19.0.0-1628.g97ae6cc9.el 362 kB/s | 27 kB 00:00 2024-04-25T09:51:52.646 INFO:teuthology.orchestra.run.smithi055.stdout:(13/152): libcephfs-devel-19.0.0-1628.g97ae6cc9 404 kB/s | 31 kB 00:00 2024-04-25T09:51:53.072 INFO:teuthology.orchestra.run.smithi007.stdout:(2/152): ceph-fuse-19.0.0-1628.g97ae6cc9.el9.x8 1.2 MB/s | 887 kB 00:00 2024-04-25T09:51:53.154 INFO:teuthology.orchestra.run.smithi055.stdout:(14/152): libcephfs2-19.0.0-1628.g97ae6cc9.el9. 1.4 MB/s | 744 kB 00:00 2024-04-25T09:51:53.173 INFO:teuthology.orchestra.run.smithi007.stdout:(3/152): ceph-immutable-object-cache-19.0.0-162 1.4 MB/s | 145 kB 00:00 2024-04-25T09:51:53.229 INFO:teuthology.orchestra.run.smithi055.stdout:(15/152): libcephsqlite-19.0.0-1628.g97ae6cc9.e 2.1 MB/s | 163 kB 00:00 2024-04-25T09:51:53.296 INFO:teuthology.orchestra.run.smithi055.stdout:(16/152): librados-devel-19.0.0-1628.g97ae6cc9. 1.9 MB/s | 127 kB 00:00 2024-04-25T09:51:53.388 INFO:teuthology.orchestra.run.smithi055.stdout:(17/152): libradosstriper1-19.0.0-1628.g97ae6cc 5.3 MB/s | 501 kB 00:00 2024-04-25T09:51:53.639 INFO:teuthology.orchestra.run.smithi055.stdout:(18/152): ceph-osd-19.0.0-1628.g97ae6cc9.el9.x8 7.6 MB/s | 17 MB 00:02 2024-04-25T09:51:53.739 INFO:teuthology.orchestra.run.smithi055.stdout:(19/152): python3-ceph-argparse-19.0.0-1628.g97 452 kB/s | 45 kB 00:00 2024-04-25T09:51:53.831 INFO:teuthology.orchestra.run.smithi055.stdout:(20/152): python3-ceph-common-19.0.0-1628.g97ae 1.4 MB/s | 131 kB 00:00 2024-04-25T09:51:53.966 INFO:teuthology.orchestra.run.smithi055.stdout:(21/152): librgw2-19.0.0-1628.g97ae6cc9.el9.x86 8.9 MB/s | 5.1 MB 00:00 2024-04-25T09:51:53.990 INFO:teuthology.orchestra.run.smithi055.stdout:(22/152): python3-cephfs-19.0.0-1628.g97ae6cc9. 1.0 MB/s | 162 kB 00:00 2024-04-25T09:51:54.032 INFO:teuthology.orchestra.run.smithi055.stdout:(23/152): python3-rados-19.0.0-1628.g97ae6cc9.e 4.7 MB/s | 321 kB 00:00 2024-04-25T09:51:54.066 INFO:teuthology.orchestra.run.smithi055.stdout:(24/152): python3-rbd-19.0.0-1628.g97ae6cc9.el9 3.9 MB/s | 298 kB 00:00 2024-04-25T09:51:54.099 INFO:teuthology.orchestra.run.smithi055.stdout:(25/152): python3-rgw-19.0.0-1628.g97ae6cc9.el9 1.4 MB/s | 99 kB 00:00 2024-04-25T09:51:54.133 INFO:teuthology.orchestra.run.smithi055.stdout:(26/152): rbd-fuse-19.0.0-1628.g97ae6cc9.el9.x8 1.3 MB/s | 85 kB 00:00 2024-04-25T09:51:54.225 INFO:teuthology.orchestra.run.smithi055.stdout:(27/152): rbd-nbd-19.0.0-1628.g97ae6cc9.el9.x86 1.8 MB/s | 170 kB 00:00 2024-04-25T09:51:54.317 INFO:teuthology.orchestra.run.smithi055.stdout:(28/152): ceph-grafana-dashboards-19.0.0-1628.g 344 kB/s | 31 kB 00:00 2024-04-25T09:51:54.389 INFO:teuthology.orchestra.run.smithi007.stdout:(4/152): ceph-mds-19.0.0-1628.g97ae6cc9.el9.x86 1.7 MB/s | 2.1 MB 00:01 2024-04-25T09:51:54.409 INFO:teuthology.orchestra.run.smithi055.stdout:(29/152): ceph-mgr-cephadm-19.0.0-1628.g97ae6cc 1.5 MB/s | 138 kB 00:00 2024-04-25T09:51:54.459 INFO:teuthology.orchestra.run.smithi055.stdout:(30/152): rbd-mirror-19.0.0-1628.g97ae6cc9.el9. 8.6 MB/s | 3.1 MB 00:00 2024-04-25T09:51:54.701 INFO:teuthology.orchestra.run.smithi055.stdout:(31/152): ceph-mgr-dashboard-19.0.0-1628.g97ae6 6.1 MB/s | 1.8 MB 00:00 2024-04-25T09:51:54.810 INFO:teuthology.orchestra.run.smithi055.stdout:(32/152): ceph-mgr-modules-core-19.0.0-1628.g97 2.2 MB/s | 248 kB 00:00 2024-04-25T09:51:54.894 INFO:teuthology.orchestra.run.smithi055.stdout:(33/152): ceph-mgr-rook-19.0.0-1628.g97ae6cc9.e 592 kB/s | 49 kB 00:00 2024-04-25T09:51:54.977 INFO:teuthology.orchestra.run.smithi055.stdout:(34/152): ceph-prometheus-alerts-19.0.0-1628.g9 184 kB/s | 15 kB 00:00 2024-04-25T09:51:55.077 INFO:teuthology.orchestra.run.smithi055.stdout:(35/152): ceph-volume-19.0.0-1628.g97ae6cc9.el9 2.6 MB/s | 264 kB 00:00 2024-04-25T09:51:55.286 INFO:teuthology.orchestra.run.smithi055.stdout:(36/152): ceph-mgr-diskprediction-local-19.0.0- 8.9 MB/s | 7.4 MB 00:00 2024-04-25T09:51:55.319 INFO:teuthology.orchestra.run.smithi055.stdout:(37/152): cephadm-19.0.0-1628.g97ae6cc9.el9.noa 3.0 MB/s | 748 kB 00:00 2024-04-25T09:51:55.345 INFO:teuthology.orchestra.run.smithi055.stdout:(38/152): cephfs-top-19.0.0-1628.g97ae6cc9.el9. 312 kB/s | 18 kB 00:00 2024-04-25T09:51:55.479 INFO:teuthology.orchestra.run.smithi055.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 506 kB/s | 80 kB 00:00 2024-04-25T09:51:55.481 INFO:teuthology.orchestra.run.smithi007.stdout:(5/152): ceph-mgr-19.0.0-1628.g97ae6cc9.el9.x86 1.4 MB/s | 1.5 MB 00:01 2024-04-25T09:51:55.571 INFO:teuthology.orchestra.run.smithi055.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-04-25T09:51:55.621 INFO:teuthology.orchestra.run.smithi055.stdout:(41/152): libgfortran-11.4.1-3.el9.x86_64.rpm 2.8 MB/s | 803 kB 00:00 2024-04-25T09:51:55.655 INFO:teuthology.orchestra.run.smithi055.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-04-25T09:51:55.940 INFO:teuthology.orchestra.run.smithi007.stdout:(6/152): ceph-base-19.0.0-1628.g97ae6cc9.el9.x8 1.4 MB/s | 5.3 MB 00:03 2024-04-25T09:51:56.105 INFO:teuthology.orchestra.run.smithi055.stdout:(43/152): ceph-test-19.0.0-1628.g97ae6cc9.el9.x 11 MB/s | 47 MB 00:04 2024-04-25T09:51:56.130 INFO:teuthology.orchestra.run.smithi055.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 224 kB/s | 106 kB 00:00 2024-04-25T09:51:56.191 INFO:teuthology.orchestra.run.smithi055.stdout:(45/152): python3-cryptography-36.0.1-4.el9.x86 2.2 MB/s | 1.2 MB 00:00 2024-04-25T09:51:56.222 INFO:teuthology.orchestra.run.smithi055.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-04-25T09:51:56.247 INFO:teuthology.orchestra.run.smithi055.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 3.7 MB/s | 215 kB 00:00 2024-04-25T09:51:56.273 INFO:teuthology.orchestra.run.smithi055.stdout:(48/152): python3-pycparser-2.20-6.el9.noarch.r 807 kB/s | 135 kB 00:00 2024-04-25T09:51:56.506 INFO:teuthology.orchestra.run.smithi055.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 458 kB/s | 107 kB 00:00 2024-04-25T09:51:56.565 INFO:teuthology.orchestra.run.smithi055.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 369 kB/s | 21 kB 00:00 2024-04-25T09:51:56.740 INFO:teuthology.orchestra.run.smithi007.stdout:(7/152): ceph-mon-19.0.0-1628.g97ae6cc9.el9.x86 3.7 MB/s | 4.7 MB 00:01 2024-04-25T09:51:56.741 INFO:teuthology.orchestra.run.smithi055.stdout:(51/152): automake-1.16.2-8.el9.noarch.rpm 1.3 MB/s | 689 kB 00:00 2024-04-25T09:51:56.799 INFO:teuthology.orchestra.run.smithi055.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 562 kB/s | 33 kB 00:00 2024-04-25T09:51:56.834 INFO:teuthology.orchestra.run.smithi055.stdout:(53/152): flex-2.6.4-9.el9.x86_64.rpm 1.1 MB/s | 313 kB 00:00 2024-04-25T09:51:56.891 INFO:teuthology.orchestra.run.smithi055.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 312 kB/s | 18 kB 00:00 2024-04-25T09:51:56.925 INFO:teuthology.orchestra.run.smithi055.stdout:(55/152): bison-3.7.4-5.el9.x86_64.rpm 1.4 MB/s | 943 kB 00:00 2024-04-25T09:51:56.950 INFO:teuthology.orchestra.run.smithi055.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 190 kB/s | 11 kB 00:00 2024-04-25T09:51:57.009 INFO:teuthology.orchestra.run.smithi055.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 777 kB/s | 45 kB 00:00 2024-04-25T09:51:57.034 INFO:teuthology.orchestra.run.smithi055.stdout:(58/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-04-25T09:51:57.242 INFO:teuthology.orchestra.run.smithi055.stdout:(59/152): libtool-2.4.6-45.el9.x86_64.rpm 2.7 MB/s | 582 kB 00:00 2024-04-25T09:51:57.301 INFO:teuthology.orchestra.run.smithi055.stdout:(60/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 436 kB/s | 25 kB 00:00 2024-04-25T09:51:57.335 INFO:teuthology.orchestra.run.smithi055.stdout:(61/152): librdkafka-1.6.1-102.el9.x86_64.rpm 2.0 MB/s | 662 kB 00:00 2024-04-25T09:51:57.360 INFO:teuthology.orchestra.run.smithi055.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 810 kB/s | 47 kB 00:00 2024-04-25T09:51:57.460 INFO:teuthology.orchestra.run.smithi055.stdout:(63/152): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-04-25T09:51:57.486 INFO:teuthology.orchestra.run.smithi055.stdout:(64/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.9 MB/s | 292 kB 00:00 2024-04-25T09:51:57.511 INFO:teuthology.orchestra.run.smithi055.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 701 kB/s | 35 kB 00:00 2024-04-25T09:51:57.645 INFO:teuthology.orchestra.run.smithi055.stdout:(66/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.5 MB/s | 3.0 MB 00:00 2024-04-25T09:51:57.903 INFO:teuthology.orchestra.run.smithi055.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 6.2 MB/s | 1.6 MB 00:00 2024-04-25T09:51:58.028 INFO:teuthology.orchestra.run.smithi055.stdout:(68/152): postgresql-contrib-13.14-1.el9.x86_64 7.1 MB/s | 911 kB 00:00 2024-04-25T09:51:58.087 INFO:teuthology.orchestra.run.smithi055.stdout:(69/152): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-04-25T09:51:58.296 INFO:teuthology.orchestra.run.smithi055.stdout:(70/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 5.6 MB/s | 4.4 MB 00:00 2024-04-25T09:51:58.404 INFO:teuthology.orchestra.run.smithi055.stdout:(71/152): openblas-openmp-0.3.21-2.el9.x86_64.r 5.2 MB/s | 4.7 MB 00:00 2024-04-25T09:51:58.463 INFO:teuthology.orchestra.run.smithi055.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-04-25T09:51:58.496 INFO:teuthology.orchestra.run.smithi055.stdout:(73/152): protobuf-3.14.0-13.el9.x86_64.rpm 5.0 MB/s | 1.0 MB 00:00 2024-04-25T09:51:58.582 INFO:teuthology.orchestra.run.smithi007.stdout:(8/152): ceph-common-19.0.0-1628.g97ae6cc9.el9. 3.1 MB/s | 20 MB 00:06 2024-04-25T09:51:58.589 INFO:teuthology.orchestra.run.smithi055.stdout:(74/152): postgresql-server-13.14-1.el9.x86_64. 12 MB/s | 5.8 MB 00:00 2024-04-25T09:51:58.614 INFO:teuthology.orchestra.run.smithi055.stdout:(75/152): python3-devel-3.9.18-3.el9.x86_64.rpm 2.0 MB/s | 244 kB 00:00 2024-04-25T09:51:58.647 INFO:teuthology.orchestra.run.smithi055.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-04-25T09:51:58.665 INFO:teuthology.orchestra.run.smithi007.stdout:(9/152): ceph-selinux-19.0.0-1628.g97ae6cc9.el9 303 kB/s | 25 kB 00:00 2024-04-25T09:51:58.672 INFO:teuthology.orchestra.run.smithi055.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 437 kB/s | 26 kB 00:00 2024-04-25T09:51:58.706 INFO:teuthology.orchestra.run.smithi055.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 328 kB/s | 19 kB 00:00 2024-04-25T09:51:58.737 INFO:teuthology.orchestra.run.smithi055.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.6 MB/s | 172 kB 00:00 2024-04-25T09:51:58.765 INFO:teuthology.orchestra.run.smithi055.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 591 kB/s | 35 kB 00:00 2024-04-25T09:51:58.824 INFO:teuthology.orchestra.run.smithi055.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-04-25T09:51:58.890 INFO:teuthology.orchestra.run.smithi055.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-04-25T09:51:58.949 INFO:teuthology.orchestra.run.smithi055.stdout:(83/152): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-04-25T09:51:59.008 INFO:teuthology.orchestra.run.smithi055.stdout:(84/152): python3-prettytable-0.7.2-27.el9.noar 727 kB/s | 42 kB 00:00 2024-04-25T09:51:59.116 INFO:teuthology.orchestra.run.smithi055.stdout:(85/152): python3-babel-2.9.1-2.el9.noarch.rpm 9.1 MB/s | 6.0 MB 00:00 2024-04-25T09:51:59.142 INFO:teuthology.orchestra.run.smithi055.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 2.0 MB/s | 269 kB 00:00 2024-04-25T09:51:59.209 INFO:teuthology.orchestra.run.smithi055.stdout:(87/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-04-25T09:51:59.234 INFO:teuthology.orchestra.run.smithi055.stdout:(88/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-04-25T09:51:59.259 INFO:teuthology.orchestra.run.smithi055.stdout:(89/152): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-04-25T09:51:59.284 INFO:teuthology.orchestra.run.smithi055.stdout:(90/152): python3-pytz-2021.1-5.el9.noarch.rpm 676 kB/s | 51 kB 00:00 2024-04-25T09:51:59.310 INFO:teuthology.orchestra.run.smithi055.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 709 kB/s | 54 kB 00:00 2024-04-25T09:51:59.343 INFO:teuthology.orchestra.run.smithi055.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 713 kB/s | 42 kB 00:00 2024-04-25T09:51:59.369 INFO:teuthology.orchestra.run.smithi055.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 756 kB/s | 44 kB 00:00 2024-04-25T09:51:59.402 INFO:teuthology.orchestra.run.smithi055.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-04-25T09:51:59.427 INFO:teuthology.orchestra.run.smithi055.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 612 kB/s | 36 kB 00:00 2024-04-25T09:51:59.461 INFO:teuthology.orchestra.run.smithi055.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 811 kB/s | 47 kB 00:00 2024-04-25T09:51:59.487 INFO:teuthology.orchestra.run.smithi055.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 305 kB 00:00 2024-04-25T09:51:59.520 INFO:teuthology.orchestra.run.smithi055.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 989 kB/s | 58 kB 00:00 2024-04-25T09:51:59.554 INFO:teuthology.orchestra.run.smithi055.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.4 MB/s | 94 kB 00:00 2024-04-25T09:51:59.579 INFO:teuthology.orchestra.run.smithi055.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-04-25T09:51:59.613 INFO:teuthology.orchestra.run.smithi055.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 767 kB/s | 45 kB 00:00 2024-04-25T09:51:59.638 INFO:teuthology.orchestra.run.smithi055.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 381 kB/s | 22 kB 00:00 2024-04-25T09:51:59.730 INFO:teuthology.orchestra.run.smithi055.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 7.2 MB/s | 863 kB 00:00 2024-04-25T09:51:59.915 INFO:teuthology.orchestra.run.smithi055.stdout:(104/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.9 MB/s | 548 kB 00:00 2024-04-25T09:51:59.939 INFO:teuthology.orchestra.run.smithi055.stdout:(105/152): gperftools-libs-2.9.1-2.el9.x86_64.r 1.5 MB/s | 309 kB 00:00 2024-04-25T09:52:00.106 INFO:teuthology.orchestra.run.smithi055.stdout:(106/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-04-25T09:52:00.131 INFO:teuthology.orchestra.run.smithi055.stdout:(107/152): grpc-data-1.46.7-10.el9.noarch.rpm 90 kB/s | 19 kB 00:00 2024-04-25T09:52:00.232 INFO:teuthology.orchestra.run.smithi007.stdout:(10/152): ceph-radosgw-19.0.0-1628.g97ae6cc9.el 2.8 MB/s | 9.8 MB 00:03 2024-04-25T09:52:00.240 INFO:teuthology.orchestra.run.smithi055.stdout:(108/152): libarrow-9.0.0-10.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-04-25T09:52:00.286 INFO:teuthology.orchestra.run.smithi055.stdout:(109/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 146 kB/s | 26 kB 00:00 2024-04-25T09:52:00.332 INFO:teuthology.orchestra.run.smithi055.stdout:(110/152): liboath-2.6.7-2.el9.x86_64.rpm 245 kB/s | 49 kB 00:00 2024-04-25T09:52:00.382 INFO:teuthology.orchestra.run.smithi055.stdout:(111/152): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-04-25T09:52:00.424 INFO:teuthology.orchestra.run.smithi055.stdout:(112/152): luarocks-3.9.2-1.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-04-25T09:52:00.458 INFO:teuthology.orchestra.run.smithi055.stdout:(113/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 6.5 MB/s | 838 kB 00:00 2024-04-25T09:52:00.482 INFO:teuthology.orchestra.run.smithi007.stdout:(11/152): cephfs-mirror-19.0.0-1628.g97ae6cc9.e 880 kB/s | 220 kB 00:00 2024-04-25T09:52:00.483 INFO:teuthology.orchestra.run.smithi055.stdout:(114/152): python3-asyncssh-2.13.2-5.el9.noarch 5.3 MB/s | 548 kB 00:00 2024-04-25T09:52:00.508 INFO:teuthology.orchestra.run.smithi055.stdout:(115/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 531 kB/s | 43 kB 00:00 2024-04-25T09:52:00.533 INFO:teuthology.orchestra.run.smithi055.stdout:(116/152): python3-cachetools-4.2.4-1.el9.noarc 435 kB/s | 32 kB 00:00 2024-04-25T09:52:00.582 INFO:teuthology.orchestra.run.smithi007.stdout:(12/152): cephfs-shell-19.0.0-1628.g97ae6cc9.el 270 kB/s | 27 kB 00:00 2024-04-25T09:52:00.583 INFO:teuthology.orchestra.run.smithi055.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 200 kB/s | 15 kB 00:00 2024-04-25T09:52:00.617 INFO:teuthology.orchestra.run.smithi055.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2024-04-25T09:52:00.642 INFO:teuthology.orchestra.run.smithi055.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-04-25T09:52:00.674 INFO:teuthology.orchestra.run.smithi007.stdout:(13/152): libcephfs-devel-19.0.0-1628.g97ae6cc9 340 kB/s | 31 kB 00:00 2024-04-25T09:52:00.676 INFO:teuthology.orchestra.run.smithi055.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.2 MB/s | 303 kB 00:00 2024-04-25T09:52:00.709 INFO:teuthology.orchestra.run.smithi055.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 386 kB/s | 35 kB 00:00 2024-04-25T09:52:00.735 INFO:teuthology.orchestra.run.smithi055.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 2.2 MB/s | 206 kB 00:00 2024-04-25T09:52:00.852 INFO:teuthology.orchestra.run.smithi055.stdout:(123/152): python3-grpcio-1.46.7-10.el9.x86_64. 12 MB/s | 2.0 MB 00:00 2024-04-25T09:52:00.877 INFO:teuthology.orchestra.run.smithi055.stdout:(124/152): python3-grpcio-tools-1.46.7-10.el9.x 866 kB/s | 144 kB 00:00 2024-04-25T09:52:00.902 INFO:teuthology.orchestra.run.smithi055.stdout:(125/152): python3-jaraco-8.2.1-3.el9.noarch.rp 64 kB/s | 11 kB 00:00 2024-04-25T09:52:00.928 INFO:teuthology.orchestra.run.smithi055.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 236 kB/s | 18 kB 00:00 2024-04-25T09:52:00.961 INFO:teuthology.orchestra.run.smithi055.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 398 kB/s | 23 kB 00:00 2024-04-25T09:52:00.986 INFO:teuthology.orchestra.run.smithi055.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 233 kB/s | 19 kB 00:00 2024-04-25T09:52:01.011 INFO:teuthology.orchestra.run.smithi055.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 235 kB/s | 20 kB 00:00 2024-04-25T09:52:01.046 INFO:teuthology.orchestra.run.smithi055.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 12 MB/s | 1.0 MB 00:00 2024-04-25T09:52:01.071 INFO:teuthology.orchestra.run.smithi055.stdout:(131/152): python3-logutils-0.3.5-21.el9.noarch 554 kB/s | 46 kB 00:00 2024-04-25T09:52:01.104 INFO:teuthology.orchestra.run.smithi055.stdout:(132/152): python3-more-itertools-8.12.0-2.el9. 875 kB/s | 79 kB 00:00 2024-04-25T09:52:01.129 INFO:teuthology.orchestra.run.smithi055.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 991 kB/s | 58 kB 00:00 2024-04-25T09:52:01.150 INFO:teuthology.orchestra.run.smithi007.stdout:(14/152): libcephfs2-19.0.0-1628.g97ae6cc9.el9. 1.5 MB/s | 744 kB 00:00 2024-04-25T09:52:01.155 INFO:teuthology.orchestra.run.smithi055.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-04-25T09:52:01.180 INFO:teuthology.orchestra.run.smithi055.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 219 kB/s | 16 kB 00:00 2024-04-25T09:52:01.239 INFO:teuthology.orchestra.run.smithi055.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 832 kB/s | 90 kB 00:00 2024-04-25T09:52:01.281 INFO:teuthology.orchestra.run.smithi055.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 282 kB/s | 28 kB 00:00 2024-04-25T09:52:01.283 INFO:teuthology.orchestra.run.smithi007.stdout:(15/152): libcephsqlite-19.0.0-1628.g97ae6cc9.e 1.2 MB/s | 163 kB 00:00 2024-04-25T09:52:01.305 INFO:teuthology.orchestra.run.smithi055.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 245 kB/s | 31 kB 00:00 2024-04-25T09:52:01.331 INFO:teuthology.orchestra.run.smithi055.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-04-25T09:52:01.356 INFO:teuthology.orchestra.run.smithi055.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 792 kB/s | 59 kB 00:00 2024-04-25T09:52:01.381 INFO:teuthology.orchestra.run.smithi055.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 720 kB/s | 36 kB 00:00 2024-04-25T09:52:01.407 INFO:teuthology.orchestra.run.smithi055.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 680 kB/s | 51 kB 00:00 2024-04-25T09:52:01.432 INFO:teuthology.orchestra.run.smithi055.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-25T09:52:01.457 INFO:teuthology.orchestra.run.smithi055.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-04-25T09:52:01.459 INFO:teuthology.orchestra.run.smithi007.stdout:(16/152): librados-devel-19.0.0-1628.g97ae6cc9. 722 kB/s | 127 kB 00:00 2024-04-25T09:52:01.482 INFO:teuthology.orchestra.run.smithi055.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 8.4 MB/s | 427 kB 00:00 2024-04-25T09:52:01.508 INFO:teuthology.orchestra.run.smithi055.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 266 kB/s | 20 kB 00:00 2024-04-25T09:52:01.600 INFO:teuthology.orchestra.run.smithi055.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.3 MB/s | 192 kB 00:00 2024-04-25T09:52:01.641 INFO:teuthology.orchestra.run.smithi055.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-04-25T09:52:01.710 INFO:teuthology.orchestra.run.smithi007.stdout:(17/152): ceph-osd-19.0.0-1628.g97ae6cc9.el9.x8 2.9 MB/s | 17 MB 00:05 2024-04-25T09:52:01.794 INFO:teuthology.orchestra.run.smithi007.stdout:(18/152): libradosstriper1-19.0.0-1628.g97ae6cc 1.5 MB/s | 501 kB 00:00 2024-04-25T09:52:01.858 INFO:teuthology.orchestra.run.smithi055.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 6.2 MB/s | 1.3 MB 00:00 2024-04-25T09:52:01.894 INFO:teuthology.orchestra.run.smithi007.stdout:(19/152): python3-ceph-argparse-19.0.0-1628.g97 452 kB/s | 45 kB 00:00 2024-04-25T09:52:01.967 INFO:teuthology.orchestra.run.smithi055.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 22 MB/s | 2.4 MB 00:00 2024-04-25T09:52:02.060 INFO:teuthology.orchestra.run.smithi007.stdout:(20/152): python3-ceph-common-19.0.0-1628.g97ae 788 kB/s | 131 kB 00:00 2024-04-25T09:52:02.219 INFO:teuthology.orchestra.run.smithi007.stdout:(21/152): python3-cephfs-19.0.0-1628.g97ae6cc9. 1.0 MB/s | 162 kB 00:00 2024-04-25T09:52:02.442 INFO:teuthology.orchestra.run.smithi055.stdout:(151/152): librados2-19.0.0-1628.g97ae6cc9.el9. 3.6 MB/s | 3.4 MB 00:00 2024-04-25T09:52:02.444 INFO:teuthology.orchestra.run.smithi007.stdout:(22/152): python3-rados-19.0.0-1628.g97ae6cc9.e 1.4 MB/s | 321 kB 00:00 2024-04-25T09:52:02.620 INFO:teuthology.orchestra.run.smithi007.stdout:(23/152): python3-rbd-19.0.0-1628.g97ae6cc9.el9 1.7 MB/s | 298 kB 00:00 2024-04-25T09:52:02.678 INFO:teuthology.orchestra.run.smithi007.stdout:(24/152): python3-rgw-19.0.0-1628.g97ae6cc9.el9 1.7 MB/s | 99 kB 00:00 2024-04-25T09:52:02.762 INFO:teuthology.orchestra.run.smithi007.stdout:(25/152): rbd-fuse-19.0.0-1628.g97ae6cc9.el9.x8 1.0 MB/s | 85 kB 00:00 2024-04-25T09:52:02.892 INFO:teuthology.orchestra.run.smithi055.stdout:(152/152): librbd1-19.0.0-1628.g97ae6cc9.el9.x8 2.4 MB/s | 3.1 MB 00:01 2024-04-25T09:52:02.896 INFO:teuthology.orchestra.run.smithi055.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:52:02.896 INFO:teuthology.orchestra.run.smithi055.stdout:Total 15 MB/s | 215 MB 00:14 2024-04-25T09:52:04.028 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction check 2024-04-25T09:52:04.162 INFO:teuthology.orchestra.run.smithi007.stdout:(26/152): rbd-mirror-19.0.0-1628.g97ae6cc9.el9. 2.2 MB/s | 3.1 MB 00:01 2024-04-25T09:52:04.185 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction check succeeded. 2024-04-25T09:52:04.185 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction test 2024-04-25T09:52:04.304 INFO:teuthology.orchestra.run.smithi007.stdout:(27/152): rbd-nbd-19.0.0-1628.g97ae6cc9.el9.x86 1.2 MB/s | 170 kB 00:00 2024-04-25T09:52:04.371 INFO:teuthology.orchestra.run.smithi007.stdout:(28/152): ceph-grafana-dashboards-19.0.0-1628.g 470 kB/s | 31 kB 00:00 2024-04-25T09:52:04.471 INFO:teuthology.orchestra.run.smithi007.stdout:(29/152): ceph-mgr-cephadm-19.0.0-1628.g97ae6cc 1.3 MB/s | 138 kB 00:00 2024-04-25T09:52:04.546 INFO:teuthology.orchestra.run.smithi007.stdout:(30/152): librgw2-19.0.0-1628.g97ae6cc9.el9.x86 1.8 MB/s | 5.1 MB 00:02 2024-04-25T09:52:05.113 INFO:teuthology.orchestra.run.smithi007.stdout:(31/152): ceph-mgr-dashboard-19.0.0-1628.g97ae6 2.8 MB/s | 1.8 MB 00:00 2024-04-25T09:52:05.214 INFO:teuthology.orchestra.run.smithi007.stdout:(32/152): ceph-mgr-modules-core-19.0.0-1628.g97 2.4 MB/s | 248 kB 00:00 2024-04-25T09:52:05.256 INFO:teuthology.orchestra.run.smithi007.stdout:(33/152): ceph-mgr-rook-19.0.0-1628.g97ae6cc9.e 1.2 MB/s | 49 kB 00:00 2024-04-25T09:52:05.306 INFO:teuthology.orchestra.run.smithi007.stdout:(34/152): ceph-prometheus-alerts-19.0.0-1628.g9 307 kB/s | 15 kB 00:00 2024-04-25T09:52:05.390 INFO:teuthology.orchestra.run.smithi007.stdout:(35/152): ceph-volume-19.0.0-1628.g97ae6cc9.el9 3.1 MB/s | 264 kB 00:00 2024-04-25T09:52:05.582 INFO:teuthology.orchestra.run.smithi007.stdout:(36/152): cephadm-19.0.0-1628.g97ae6cc9.el9.noa 3.8 MB/s | 748 kB 00:00 2024-04-25T09:52:05.623 INFO:teuthology.orchestra.run.smithi007.stdout:(37/152): cephfs-top-19.0.0-1628.g97ae6cc9.el9. 441 kB/s | 18 kB 00:00 2024-04-25T09:52:05.774 INFO:teuthology.orchestra.run.smithi007.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 536 kB/s | 80 kB 00:00 2024-04-25T09:52:05.874 INFO:teuthology.orchestra.run.smithi007.stdout:(39/152): libgfortran-11.4.1-3.el9.x86_64.rpm 7.8 MB/s | 803 kB 00:00 2024-04-25T09:52:05.941 INFO:teuthology.orchestra.run.smithi007.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 195 kB 00:00 2024-04-25T09:52:06.015 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction test succeeded. 2024-04-25T09:52:06.015 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction 2024-04-25T09:52:06.025 INFO:teuthology.orchestra.run.smithi007.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-04-25T09:52:06.142 INFO:teuthology.orchestra.run.smithi007.stdout:(42/152): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-04-25T09:52:06.208 INFO:teuthology.orchestra.run.smithi007.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-04-25T09:52:06.276 INFO:teuthology.orchestra.run.smithi007.stdout:(44/152): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-04-25T09:52:06.343 INFO:teuthology.orchestra.run.smithi007.stdout:(45/152): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-04-25T09:52:06.418 INFO:teuthology.orchestra.run.smithi007.stdout:(46/152): python3-urllib3-1.26.5-5.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-04-25T09:52:06.635 INFO:teuthology.orchestra.run.smithi007.stdout:(47/152): ceph-mgr-diskprediction-local-19.0.0- 3.5 MB/s | 7.4 MB 00:02 2024-04-25T09:52:06.860 INFO:teuthology.orchestra.run.smithi007.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 1.5 MB/s | 689 kB 00:00 2024-04-25T09:52:06.911 INFO:teuthology.orchestra.run.smithi007.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-04-25T09:52:06.969 INFO:teuthology.orchestra.run.smithi007.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 370 kB/s | 21 kB 00:00 2024-04-25T09:52:07.110 INFO:teuthology.orchestra.run.smithi007.stdout:(51/152): flex-2.6.4-9.el9.x86_64.rpm 2.2 MB/s | 313 kB 00:00 2024-04-25T09:52:07.170 INFO:teuthology.orchestra.run.smithi007.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 550 kB/s | 33 kB 00:00 2024-04-25T09:52:07.237 INFO:teuthology.orchestra.run.smithi007.stdout:(53/152): bison-3.7.4-5.el9.x86_64.rpm 1.5 MB/s | 943 kB 00:00 2024-04-25T09:52:07.295 INFO:teuthology.orchestra.run.smithi007.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 312 kB/s | 18 kB 00:00 2024-04-25T09:52:07.346 INFO:teuthology.orchestra.run.smithi007.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-04-25T09:52:07.454 INFO:teuthology.orchestra.run.smithi007.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-04-25T09:52:07.513 INFO:teuthology.orchestra.run.smithi007.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 776 kB/s | 45 kB 00:00 2024-04-25T09:52:07.663 INFO:teuthology.orchestra.run.smithi007.stdout:(58/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.1 MB/s | 3.0 MB 00:00 2024-04-25T09:52:07.780 INFO:teuthology.orchestra.run.smithi007.stdout:(59/152): libtool-2.4.6-45.el9.x86_64.rpm 4.9 MB/s | 582 kB 00:00 2024-04-25T09:52:07.814 INFO:teuthology.orchestra.run.smithi007.stdout:(60/152): librdkafka-1.6.1-102.el9.x86_64.rpm 2.2 MB/s | 662 kB 00:00 2024-04-25T09:52:07.839 INFO:teuthology.orchestra.run.smithi007.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 434 kB/s | 25 kB 00:00 2024-04-25T09:52:07.873 INFO:teuthology.orchestra.run.smithi007.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 809 kB/s | 47 kB 00:00 2024-04-25T09:52:07.907 INFO:teuthology.orchestra.run.smithi007.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-04-25T09:52:07.965 INFO:teuthology.orchestra.run.smithi007.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-04-25T09:52:07.990 INFO:teuthology.orchestra.run.smithi007.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 421 kB/s | 35 kB 00:00 2024-04-25T09:52:08.366 INFO:teuthology.orchestra.run.smithi007.stdout:(66/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-04-25T09:52:08.508 INFO:teuthology.orchestra.run.smithi007.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-04-25T09:52:08.608 INFO:teuthology.orchestra.run.smithi007.stdout:(68/152): postgresql-contrib-13.14-1.el9.x86_64 8.9 MB/s | 911 kB 00:00 2024-04-25T09:52:08.667 INFO:teuthology.orchestra.run.smithi007.stdout:(69/152): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-04-25T09:52:08.734 INFO:teuthology.orchestra.run.smithi007.stdout:(70/152): openblas-openmp-0.3.21-2.el9.x86_64.r 6.2 MB/s | 4.7 MB 00:00 2024-04-25T09:52:08.867 INFO:teuthology.orchestra.run.smithi007.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 7.6 MB/s | 1.0 MB 00:00 2024-04-25T09:52:08.926 INFO:teuthology.orchestra.run.smithi007.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-04-25T09:52:09.068 INFO:teuthology.orchestra.run.smithi007.stdout:(73/152): postgresql-server-13.14-1.el9.x86_64. 14 MB/s | 5.8 MB 00:00 2024-04-25T09:52:09.135 INFO:teuthology.orchestra.run.smithi007.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 3.6 MB/s | 244 kB 00:00 2024-04-25T09:52:09.193 INFO:teuthology.orchestra.run.smithi007.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-04-25T09:52:09.260 INFO:teuthology.orchestra.run.smithi007.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 385 kB/s | 26 kB 00:00 2024-04-25T09:52:09.319 INFO:teuthology.orchestra.run.smithi007.stdout:(77/152): python3-jsonpointer-2.0-4.el9.noarch. 328 kB/s | 19 kB 00:00 2024-04-25T09:52:09.378 INFO:teuthology.orchestra.run.smithi007.stdout:(78/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-04-25T09:52:09.436 INFO:teuthology.orchestra.run.smithi007.stdout:(79/152): python3-markupsafe-1.1.1-12.el9.x86_6 598 kB/s | 35 kB 00:00 2024-04-25T09:52:09.520 INFO:teuthology.orchestra.run.smithi007.stdout:(80/152): python3-babel-2.9.1-2.el9.noarch.rpm 10 MB/s | 6.0 MB 00:00 2024-04-25T09:52:09.595 INFO:teuthology.orchestra.run.smithi007.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-04-25T09:52:09.662 INFO:teuthology.orchestra.run.smithi007.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-04-25T09:52:09.729 INFO:teuthology.orchestra.run.smithi007.stdout:(83/152): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-04-25T09:52:09.796 INFO:teuthology.orchestra.run.smithi007.stdout:(84/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-04-25T09:52:09.813 INFO:teuthology.orchestra.run.smithi007.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 506 kB/s | 42 kB 00:00 2024-04-25T09:52:09.880 INFO:teuthology.orchestra.run.smithi007.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 3.2 MB/s | 269 kB 00:00 2024-04-25T09:52:09.905 INFO:teuthology.orchestra.run.smithi007.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-04-25T09:52:09.939 INFO:teuthology.orchestra.run.smithi007.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-04-25T09:52:09.956 INFO:teuthology.orchestra.run.smithi007.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-25T09:52:10.023 INFO:teuthology.orchestra.run.smithi007.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 642 kB/s | 54 kB 00:00 2024-04-25T09:52:10.073 INFO:teuthology.orchestra.run.smithi007.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 834 kB/s | 42 kB 00:00 2024-04-25T09:52:10.132 INFO:teuthology.orchestra.run.smithi007.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 760 kB/s | 44 kB 00:00 2024-04-25T09:52:10.191 INFO:teuthology.orchestra.run.smithi007.stdout:(93/152): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-04-25T09:52:10.249 INFO:teuthology.orchestra.run.smithi007.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 615 kB/s | 36 kB 00:00 2024-04-25T09:52:10.316 INFO:teuthology.orchestra.run.smithi007.stdout:(95/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 713 kB/s | 47 kB 00:00 2024-04-25T09:52:10.375 INFO:teuthology.orchestra.run.smithi007.stdout:(96/152): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 305 kB 00:00 2024-04-25T09:52:10.433 INFO:teuthology.orchestra.run.smithi007.stdout:(97/152): uuid-1.6.2-55.el9.x86_64.rpm 993 kB/s | 58 kB 00:00 2024-04-25T09:52:10.517 INFO:teuthology.orchestra.run.smithi007.stdout:(98/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.1 MB/s | 94 kB 00:00 2024-04-25T09:52:10.623 INFO:teuthology.orchestra.run.smithi007.stdout:(99/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 605 kB/s | 64 kB 00:00 2024-04-25T09:52:10.710 INFO:teuthology.orchestra.run.smithi007.stdout:(100/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 518 kB/s | 45 kB 00:00 2024-04-25T09:52:11.035 INFO:teuthology.orchestra.run.smithi007.stdout:(101/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 15 MB/s | 16 MB 00:01 2024-04-25T09:52:11.119 INFO:teuthology.orchestra.run.smithi007.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 54 kB/s | 22 kB 00:00 2024-04-25T09:52:11.169 INFO:teuthology.orchestra.run.smithi007.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 6.3 MB/s | 863 kB 00:00 2024-04-25T09:52:11.653 INFO:teuthology.orchestra.run.smithi007.stdout:(104/152): ceph-test-19.0.0-1628.g97ae6cc9.el9. 3.6 MB/s | 47 MB 00:12 2024-04-25T09:52:12.111 INFO:teuthology.orchestra.run.smithi055.stdout: Preparing : 1/1 2024-04-25T09:52:12.213 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T09:52:12.252 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T09:52:12.306 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T09:52:12.357 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T09:52:12.381 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T09:52:12.425 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T09:52:12.822 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T09:52:13.016 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 8/156 2024-04-25T09:52:13.125 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 8/156 2024-04-25T09:52:13.150 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 9/156 2024-04-25T09:52:13.226 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 9/156 2024-04-25T09:52:13.255 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rados-2:19.0.0-1628.g97ae6cc9.el9.x86_64 10/156 2024-04-25T09:52:13.412 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T09:52:13.469 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T09:52:13.496 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 13/156 2024-04-25T09:52:13.602 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 13/156 2024-04-25T09:52:13.622 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86 14/156 2024-04-25T09:52:13.676 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86 14/156 2024-04-25T09:52:13.698 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T09:52:13.723 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T09:52:13.908 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T09:52:13.948 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T09:52:14.059 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T09:52:14.163 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T09:52:14.197 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T09:52:14.269 INFO:teuthology.orchestra.run.smithi007.stdout:(105/152): gperftools-libs-2.9.1-2.el9.x86_64.r 100 kB/s | 309 kB 00:03 2024-04-25T09:52:14.303 INFO:teuthology.orchestra.run.smithi007.stdout:(106/152): abseil-cpp-20211102.0-3.el9.x86_64.r 172 kB/s | 548 kB 00:03 2024-04-25T09:52:14.358 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T09:52:14.433 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T09:52:14.482 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T09:52:14.526 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T09:52:14.558 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T09:52:14.586 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T09:52:14.657 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T09:52:14.709 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T09:52:14.739 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T09:52:14.745 INFO:teuthology.orchestra.run.smithi007.stdout:(107/152): grpc-data-1.46.7-10.el9.noarch.rpm 6.3 kB/s | 19 kB 00:03 2024-04-25T09:52:14.782 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T09:52:14.860 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T09:52:14.893 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-ceph-common-2:19.0.0-1628.g97ae6cc9.el9. 31/156 2024-04-25T09:52:14.911 INFO:teuthology.orchestra.run.smithi007.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 292 kB/s | 49 kB 00:00 2024-04-25T09:52:14.937 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-ceph-argparse-2:19.0.0-1628.g97ae6cc9.el 32/156 2024-04-25T09:52:14.965 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cephfs-2:19.0.0-1628.g97ae6cc9.el9.x86_6 33/156 2024-04-25T09:52:15.039 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T09:52:15.089 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T09:52:15.167 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T09:52:15.318 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T09:52:15.375 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T09:52:15.930 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T09:52:16.022 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T09:52:16.057 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T09:52:16.062 INFO:teuthology.orchestra.run.smithi007.stdout:(109/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 15 kB/s | 26 kB 00:01 2024-04-25T09:52:16.087 INFO:teuthology.orchestra.run.smithi007.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 57 kB/s | 67 kB 00:01 2024-04-25T09:52:16.100 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T09:52:16.138 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librados-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_6 43/156 2024-04-25T09:52:16.180 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T09:52:16.345 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T09:52:16.399 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T09:52:16.455 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T09:52:16.529 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T09:52:16.566 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T09:52:16.603 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T09:52:16.650 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T09:52:16.694 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T09:52:16.738 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T09:52:16.779 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T09:52:16.924 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T09:52:16.968 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T09:52:16.998 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T09:52:17.040 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T09:52:17.138 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T09:52:17.181 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T09:52:17.222 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T09:52:17.246 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T09:52:17.271 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T09:52:17.348 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T09:52:17.487 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T09:52:17.521 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T09:52:17.549 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T09:52:17.583 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T09:52:17.612 INFO:teuthology.orchestra.run.smithi007.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 97 kB/s | 151 kB 00:01 2024-04-25T09:52:17.622 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T09:52:17.654 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T09:52:17.852 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T09:52:17.921 INFO:teuthology.orchestra.run.smithi007.stdout:(112/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 457 kB/s | 838 kB 00:01 2024-04-25T09:52:17.977 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T09:52:18.011 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T09:52:18.054 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T09:52:18.087 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T09:52:18.182 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T09:52:18.243 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T09:52:18.282 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T09:52:18.330 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T09:52:18.396 INFO:teuthology.orchestra.run.smithi007.stdout:(113/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 91 kB/s | 43 kB 00:00 2024-04-25T09:52:18.441 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T09:52:18.491 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T09:52:19.071 INFO:teuthology.orchestra.run.smithi007.stdout:(114/152): python3-cachetools-4.2.4-1.el9.noarc 48 kB/s | 32 kB 00:00 2024-04-25T09:52:19.255 INFO:teuthology.orchestra.run.smithi007.stdout:(115/152): python3-asyncssh-2.13.2-5.el9.noarch 334 kB/s | 548 kB 00:01 2024-04-25T09:52:19.257 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T09:52:19.305 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T09:52:19.330 INFO:teuthology.orchestra.run.smithi007.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 58 kB/s | 15 kB 00:00 2024-04-25T09:52:19.338 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T09:52:19.440 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T09:52:19.488 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T09:52:19.578 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T09:52:19.615 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T09:52:19.800 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T09:52:19.829 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T09:52:19.909 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T09:52:20.585 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T09:52:20.638 INFO:teuthology.orchestra.run.smithi007.stdout:(117/152): libarrow-9.0.0-10.el9.x86_64.rpm 710 kB/s | 4.4 MB 00:06 2024-04-25T09:52:20.697 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T09:52:21.055 INFO:teuthology.orchestra.run.smithi007.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 95 kB/s | 172 kB 00:01 2024-04-25T09:52:21.080 INFO:teuthology.orchestra.run.smithi007.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 205 kB/s | 358 kB 00:01 2024-04-25T09:52:21.547 INFO:teuthology.orchestra.run.smithi007.stdout:(120/152): python3-google-auth-2.29.0-1.el9.noa 441 kB/s | 206 kB 00:00 2024-04-25T09:52:21.779 INFO:teuthology.orchestra.run.smithi007.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 49 kB/s | 35 kB 00:00 2024-04-25T09:52:21.823 INFO:teuthology.orchestra.run.smithi007.stdout:(122/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 256 kB/s | 303 kB 00:01 2024-04-25T09:52:21.988 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T09:52:22.067 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T09:52:22.096 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T09:52:22.128 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T09:52:22.456 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T09:52:22.491 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 99/156 2024-04-25T09:52:22.574 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 99/156 2024-04-25T09:52:22.604 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 100/156 2024-04-25T09:52:22.641 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T09:52:23.119 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T09:52:23.144 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 103/156 2024-04-25T09:52:23.215 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 103/156 2024-04-25T09:52:23.237 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 104/156 2024-04-25T09:52:23.323 INFO:teuthology.orchestra.run.smithi007.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 94 kB/s | 144 kB 00:01 2024-04-25T09:52:23.340 INFO:teuthology.orchestra.run.smithi007.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 7.0 kB/s | 11 kB 00:01 2024-04-25T09:52:23.790 INFO:teuthology.orchestra.run.smithi007.stdout:(125/152): python3-grpcio-1.46.7-10.el9.x86_64. 930 kB/s | 2.0 MB 00:02 2024-04-25T09:52:23.816 INFO:teuthology.orchestra.run.smithi007.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 36 kB/s | 18 kB 00:00 2024-04-25T09:52:23.916 INFO:teuthology.orchestra.run.smithi007.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 40 kB/s | 23 kB 00:00 2024-04-25T09:52:24.033 INFO:teuthology.orchestra.run.smithi007.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 80 kB/s | 19 kB 00:00 2024-04-25T09:52:24.058 INFO:teuthology.orchestra.run.smithi007.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 81 kB/s | 20 kB 00:00 2024-04-25T09:52:25.242 INFO:teuthology.orchestra.run.smithi007.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 38 kB/s | 46 kB 00:01 2024-04-25T09:52:25.275 INFO:teuthology.orchestra.run.smithi007.stdout:(131/152): python3-kubernetes-26.1.0-2.el9.noar 769 kB/s | 1.0 MB 00:01 2024-04-25T09:52:25.309 INFO:teuthology.orchestra.run.smithi007.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 864 kB/s | 58 kB 00:00 2024-04-25T09:52:25.384 INFO:teuthology.orchestra.run.smithi007.stdout:(133/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-04-25T09:52:25.409 INFO:teuthology.orchestra.run.smithi007.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 164 kB/s | 16 kB 00:00 2024-04-25T09:52:25.482 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 105/156 2024-04-25T09:52:25.501 INFO:teuthology.orchestra.run.smithi007.stdout:(135/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 769 kB/s | 90 kB 00:00 2024-04-25T09:52:25.517 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 105/156 2024-04-25T09:52:25.527 INFO:teuthology.orchestra.run.smithi007.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 241 kB/s | 28 kB 00:00 2024-04-25T09:52:25.560 INFO:teuthology.orchestra.run.smithi007.stdout:(137/152): python3-repoze-lru-0.7-16.el9.noarch 525 kB/s | 31 kB 00:00 2024-04-25T09:52:25.669 INFO:teuthology.orchestra.run.smithi007.stdout:(138/152): python3-rsa-4.9-2.el9.noarch.rpm 545 kB/s | 59 kB 00:00 2024-04-25T09:52:25.694 INFO:teuthology.orchestra.run.smithi007.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 1.1 MB/s | 188 kB 00:00 2024-04-25T09:52:25.936 INFO:teuthology.orchestra.run.smithi007.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 134 kB/s | 36 kB 00:00 2024-04-25T09:52:25.961 INFO:teuthology.orchestra.run.smithi007.stdout:(141/152): python3-typing-extensions-4.4.0-2.el 191 kB/s | 51 kB 00:00 2024-04-25T09:52:26.003 INFO:teuthology.orchestra.run.smithi007.stdout:(142/152): python3-webob-1.8.7-6.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-04-25T09:52:26.020 INFO:teuthology.orchestra.run.smithi007.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-04-25T09:52:26.085 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 105/156 2024-04-25T09:52:26.120 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 106/156 2024-04-25T09:52:26.162 INFO:teuthology.orchestra.run.smithi007.stdout:(144/152): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2024-04-25T09:52:26.179 INFO:teuthology.orchestra.run.smithi007.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 126 kB/s | 20 kB 00:00 2024-04-25T09:52:26.219 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 106/156 2024-04-25T09:52:26.219 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T09:52:26.219 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T09:52:26.219 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:52:26.247 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 107/156 2024-04-25T09:52:26.263 INFO:teuthology.orchestra.run.smithi007.stdout:(146/152): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-04-25T09:52:26.371 INFO:teuthology.orchestra.run.smithi007.stdout:(147/152): thrift-0.15.0-2.el9.x86_64.rpm 8.2 MB/s | 1.6 MB 00:00 2024-04-25T09:52:26.588 INFO:teuthology.orchestra.run.smithi007.stdout:(148/152): python3-more-itertools-8.12.0-2.el9. 31 kB/s | 79 kB 00:02 2024-04-25T09:52:26.697 INFO:teuthology.orchestra.run.smithi007.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 12 MB/s | 1.3 MB 00:00 2024-04-25T09:52:26.847 INFO:teuthology.orchestra.run.smithi007.stdout:(150/152): librados2-19.0.0-1628.g97ae6cc9.el9. 5.8 MB/s | 3.4 MB 00:00 2024-04-25T09:52:26.889 INFO:teuthology.orchestra.run.smithi007.stdout:(151/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 12 MB/s | 2.4 MB 00:00 2024-04-25T09:52:26.981 INFO:teuthology.orchestra.run.smithi007.stdout:(152/152): librbd1-19.0.0-1628.g97ae6cc9.el9.x8 5.2 MB/s | 3.1 MB 00:00 2024-04-25T09:52:26.983 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:52:26.984 INFO:teuthology.orchestra.run.smithi007.stdout:Total 6.1 MB/s | 215 MB 00:35 2024-04-25T09:52:28.100 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2024-04-25T09:52:28.260 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2024-04-25T09:52:28.260 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2024-04-25T09:52:30.111 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2024-04-25T09:52:30.112 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2024-04-25T09:52:36.232 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2024-04-25T09:52:36.326 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T09:52:36.366 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T09:52:36.428 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T09:52:36.461 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T09:52:36.486 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T09:52:36.530 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T09:52:36.872 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T09:52:36.982 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 8/156 2024-04-25T09:52:37.104 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 8/156 2024-04-25T09:52:37.130 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 9/156 2024-04-25T09:52:37.214 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 9/156 2024-04-25T09:52:37.243 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rados-2:19.0.0-1628.g97ae6cc9.el9.x86_64 10/156 2024-04-25T09:52:37.408 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T09:52:37.457 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T09:52:37.484 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 13/156 2024-04-25T09:52:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 13/156 2024-04-25T09:52:37.602 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86 14/156 2024-04-25T09:52:37.657 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86 14/156 2024-04-25T09:52:37.678 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T09:52:37.704 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T09:52:37.879 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T09:52:37.911 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T09:52:38.052 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T09:52:38.152 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T09:52:38.194 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T09:52:38.230 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T09:52:38.304 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T09:52:38.316 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 107/156 2024-04-25T09:52:38.316 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /sys 2024-04-25T09:52:38.316 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /proc 2024-04-25T09:52:38.316 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /mnt 2024-04-25T09:52:38.316 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /var/tmp 2024-04-25T09:52:38.316 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /home 2024-04-25T09:52:38.316 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /root 2024-04-25T09:52:38.316 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /tmp 2024-04-25T09:52:38.316 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:52:38.345 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T09:52:38.389 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T09:52:38.421 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T09:52:38.449 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T09:52:38.485 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 108/156 2024-04-25T09:52:38.501 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 108/156 2024-04-25T09:52:38.501 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:52:38.501 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T09:52:38.501 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:52:38.521 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T09:52:38.573 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T09:52:38.602 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T09:52:38.646 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T09:52:38.724 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T09:52:38.756 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ceph-common-2:19.0.0-1628.g97ae6cc9.el9. 31/156 2024-04-25T09:52:38.822 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ceph-argparse-2:19.0.0-1628.g97ae6cc9.el 32/156 2024-04-25T09:52:38.862 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cephfs-2:19.0.0-1628.g97ae6cc9.el9.x86_6 33/156 2024-04-25T09:52:38.935 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T09:52:38.977 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T09:52:39.056 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T09:52:39.198 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T09:52:39.264 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T09:52:39.815 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T09:52:39.895 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T09:52:39.937 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T09:52:39.980 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T09:52:40.019 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librados-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_6 43/156 2024-04-25T09:52:40.030 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 109/156 2024-04-25T09:52:40.059 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 109/156 2024-04-25T09:52:40.059 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:52:40.059 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T09:52:40.059 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T09:52:40.059 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T09:52:40.059 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:52:40.061 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T09:52:40.220 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T09:52:40.272 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 110/156 2024-04-25T09:52:40.280 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T09:52:40.296 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 110/156 2024-04-25T09:52:40.296 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:52:40.297 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T09:52:40.297 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T09:52:40.297 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T09:52:40.297 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:52:40.336 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T09:52:40.411 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T09:52:40.447 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T09:52:40.476 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T09:52:40.524 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T09:52:40.559 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T09:52:40.602 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T09:52:40.644 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T09:52:40.756 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 111/156 2024-04-25T09:52:40.780 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 111/156 2024-04-25T09:52:40.780 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:52:40.780 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T09:52:40.780 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T09:52:40.780 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T09:52:40.780 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:52:40.787 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T09:52:40.833 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T09:52:40.863 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T09:52:40.878 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T09:52:40.905 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T09:52:40.937 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T09:52:41.001 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T09:52:41.003 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T09:52:41.046 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T09:52:41.087 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T09:52:41.112 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T09:52:41.137 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T09:52:41.195 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T09:52:41.216 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T09:52:41.241 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T09:52:41.321 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T09:52:41.345 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T09:52:41.378 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T09:52:41.406 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T09:52:41.420 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T09:52:41.440 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T09:52:41.480 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T09:52:41.521 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T09:52:41.560 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T09:52:41.599 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T09:52:41.631 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T09:52:41.659 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T09:52:41.691 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T09:52:41.809 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T09:52:41.842 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T09:52:41.885 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T09:52:41.918 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T09:52:42.010 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T09:52:42.058 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T09:52:42.097 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T09:52:42.145 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T09:52:42.153 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 123/156 2024-04-25T09:52:42.190 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 123/156 2024-04-25T09:52:42.222 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1628.g97ae6cc9.e 124/156 2024-04-25T09:52:42.255 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T09:52:42.285 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1628.g97ae6cc9. 125/156 2024-04-25T09:52:42.308 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T09:52:42.314 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noa 126/156 2024-04-25T09:52:42.553 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noa 126/156 2024-04-25T09:52:42.589 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.n 127/156 2024-04-25T09:52:43.073 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T09:52:43.121 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T09:52:43.154 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T09:52:43.256 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T09:52:43.313 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T09:52:43.403 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T09:52:43.440 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T09:52:43.603 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.n 127/156 2024-04-25T09:52:43.624 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T09:52:43.632 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1628.g97a 128/156 2024-04-25T09:52:43.654 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T09:52:43.726 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T09:52:43.739 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1628.g97a 128/156 2024-04-25T09:52:43.910 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1628.g97ae6cc9.el 129/156 2024-04-25T09:52:43.942 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 130/156 2024-04-25T09:52:43.966 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 130/156 2024-04-25T09:52:43.967 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:52:43.967 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T09:52:43.967 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T09:52:43.967 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T09:52:43.967 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:52:44.017 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 131/156 2024-04-25T09:52:44.029 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 131/156 2024-04-25T09:52:44.130 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-2:19.0.0-1628.g97ae6cc9.el9.x86_64 132/156 2024-04-25T09:52:44.175 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 133/156 2024-04-25T09:52:44.412 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T09:52:44.532 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T09:52:45.076 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T09:52:45.111 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 135/156 2024-04-25T09:52:45.136 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 135/156 2024-04-25T09:52:45.136 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:52:45.136 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T09:52:45.136 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T09:52:45.136 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T09:52:45.136 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:52:45.180 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1628.g97ae6 136/156 2024-04-25T09:52:45.203 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1628.g97ae6 136/156 2024-04-25T09:52:45.203 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:52:45.203 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T09:52:45.203 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:52:45.255 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 137/156 2024-04-25T09:52:45.279 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 137/156 2024-04-25T09:52:45.279 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:52:45.279 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T09:52:45.279 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T09:52:45.279 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T09:52:45.279 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:52:45.597 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 138/156 2024-04-25T09:52:45.622 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 138/156 2024-04-25T09:52:45.622 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:52:45.622 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T09:52:45.622 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T09:52:45.622 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T09:52:45.622 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:52:45.834 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T09:52:45.909 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T09:52:45.937 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T09:52:45.970 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T09:52:46.298 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T09:52:46.342 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 99/156 2024-04-25T09:52:46.434 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 99/156 2024-04-25T09:52:46.463 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 100/156 2024-04-25T09:52:46.500 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T09:52:46.978 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T09:52:47.003 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 103/156 2024-04-25T09:52:47.074 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 103/156 2024-04-25T09:52:47.105 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 104/156 2024-04-25T09:52:49.364 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 105/156 2024-04-25T09:52:49.393 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 105/156 2024-04-25T09:52:49.958 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 105/156 2024-04-25T09:52:49.997 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 106/156 2024-04-25T09:52:50.089 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 106/156 2024-04-25T09:52:50.089 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T09:52:50.089 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T09:52:50.089 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:52:50.123 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 107/156 2024-04-25T09:52:50.284 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-test-2:19.0.0-1628.g97ae6cc9.el9.x86_64 139/156 2024-04-25T09:52:50.326 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : rbd-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 140/156 2024-04-25T09:52:50.367 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : rbd-nbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 141/156 2024-04-25T09:52:50.398 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T09:52:50.426 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T09:52:50.626 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephfs-shell-2:19.0.0-1628.g97ae6cc9.el9.x86_64 144/156 2024-04-25T09:52:50.681 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T09:52:50.710 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcephfs-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_ 146/156 2024-04-25T09:52:51.400 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T09:52:51.441 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T09:52:51.462 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T09:52:52.356 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephfs-top-2:19.0.0-1628.g97ae6cc9.el9.noarch 148/156 2024-04-25T09:52:52.454 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T09:52:52.488 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T09:52:52.572 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T09:52:52.617 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T09:52:52.617 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T09:52:52.701 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T09:52:52.734 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T09:52:52.734 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T09:52:52.825 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T09:52:52.894 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T09:52:58.002 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T09:52:58.003 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-2:19.0.0-1628.g97ae6cc9.el9.x86_64 1/156 2024-04-25T09:52:58.003 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2/156 2024-04-25T09:52:58.003 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 3/156 2024-04-25T09:52:58.003 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 4/156 2024-04-25T09:52:58.003 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1628.g97ae6 5/156 2024-04-25T09:52:58.003 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 6/156 2024-04-25T09:52:58.003 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 7/156 2024-04-25T09:52:58.003 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 8/156 2024-04-25T09:52:58.003 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 9/156 2024-04-25T09:52:58.003 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 10/156 2024-04-25T09:52:58.004 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 11/156 2024-04-25T09:52:58.004 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-test-2:19.0.0-1628.g97ae6cc9.el9.x86_64 12/156 2024-04-25T09:52:58.004 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 13/156 2024-04-25T09:52:58.004 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephfs-shell-2:19.0.0-1628.g97ae6cc9.el9.x86_64 14/156 2024-04-25T09:52:58.004 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcephfs-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_ 15/156 2024-04-25T09:52:58.004 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 16/156 2024-04-25T09:52:58.004 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 17/156 2024-04-25T09:52:58.004 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librados-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_6 18/156 2024-04-25T09:52:58.004 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86 19/156 2024-04-25T09:52:58.004 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 20/156 2024-04-25T09:52:58.004 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1628.g97ae6cc9.el 21/156 2024-04-25T09:52:58.004 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-ceph-common-2:19.0.0-1628.g97ae6cc9.el9. 22/156 2024-04-25T09:52:58.004 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cephfs-2:19.0.0-1628.g97ae6cc9.el9.x86_6 23/156 2024-04-25T09:52:58.004 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rados-2:19.0.0-1628.g97ae6cc9.el9.x86_64 24/156 2024-04-25T09:52:58.005 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 25/156 2024-04-25T09:52:58.005 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 26/156 2024-04-25T09:52:58.005 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : rbd-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 27/156 2024-04-25T09:52:58.005 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 28/156 2024-04-25T09:52:58.005 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : rbd-nbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 29/156 2024-04-25T09:52:58.005 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1628.g97ae6cc9. 30/156 2024-04-25T09:52:58.005 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noa 31/156 2024-04-25T09:52:58.005 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.n 32/156 2024-04-25T09:52:58.005 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1628.g97a 33/156 2024-04-25T09:52:58.005 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1628.g97ae6cc9.el 34/156 2024-04-25T09:52:58.005 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 35/156 2024-04-25T09:52:58.005 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1628.g97ae6cc9.e 36/156 2024-04-25T09:52:58.005 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 37/156 2024-04-25T09:52:58.006 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 38/156 2024-04-25T09:52:58.006 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephfs-top-2:19.0.0-1628.g97ae6cc9.el9.noarch 39/156 2024-04-25T09:52:58.006 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T09:52:58.006 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T09:52:58.006 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T09:52:58.006 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T09:52:58.006 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T09:52:58.006 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T09:52:58.006 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T09:52:58.006 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T09:52:58.006 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T09:52:58.006 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T09:52:58.007 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T09:52:58.007 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T09:52:58.007 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T09:52:58.007 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T09:52:58.007 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T09:52:58.007 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T09:52:58.007 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T09:52:58.007 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T09:52:58.007 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T09:52:58.007 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T09:52:58.007 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T09:52:58.007 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T09:52:58.007 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T09:52:58.007 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T09:52:58.007 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T09:52:58.008 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T09:52:58.008 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T09:52:58.008 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T09:52:58.008 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T09:52:58.008 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T09:52:58.008 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T09:52:58.008 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T09:52:58.008 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T09:52:58.008 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T09:52:58.008 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T09:52:58.008 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T09:52:58.008 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T09:52:58.008 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T09:52:58.008 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T09:52:58.008 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T09:52:58.009 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T09:52:58.009 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T09:52:58.009 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T09:52:58.009 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T09:52:58.009 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T09:52:58.009 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T09:52:58.009 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T09:52:58.009 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T09:52:58.009 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T09:52:58.009 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T09:52:58.009 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T09:52:58.009 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T09:52:58.009 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T09:52:58.009 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T09:52:58.009 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T09:52:58.009 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T09:52:58.010 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T09:52:58.010 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T09:52:58.010 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T09:52:58.010 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T09:52:58.010 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T09:52:58.010 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T09:52:58.010 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T09:52:58.010 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T09:52:58.010 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T09:52:58.010 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T09:52:58.010 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T09:52:58.010 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T09:52:58.010 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T09:52:58.010 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T09:52:58.011 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T09:52:58.011 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T09:52:58.011 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T09:52:58.011 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T09:52:58.011 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T09:52:58.011 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T09:52:58.011 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T09:52:58.011 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T09:52:58.011 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T09:52:58.011 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T09:52:58.011 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T09:52:58.011 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T09:52:58.011 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T09:52:58.011 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T09:52:58.012 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T09:52:58.012 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T09:52:58.012 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T09:52:58.012 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T09:52:58.012 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T09:52:58.012 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T09:52:58.012 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T09:52:58.012 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T09:52:58.012 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T09:52:58.012 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T09:52:58.012 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T09:52:58.012 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T09:52:58.012 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T09:52:58.013 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T09:52:58.013 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T09:52:58.013 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T09:52:58.013 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T09:52:58.013 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T09:52:58.013 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T09:52:58.013 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T09:52:58.013 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T09:52:58.013 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T09:52:58.013 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T09:52:58.013 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T09:52:58.013 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T09:52:58.013 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 149/156 2024-04-25T09:52:58.013 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T09:52:58.014 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 151/156 2024-04-25T09:52:58.014 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T09:52:58.014 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T09:52:58.014 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T09:52:58.014 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T09:53:00.034 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T09:53:00.034 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:53:00.034 INFO:teuthology.orchestra.run.smithi055.stdout:Upgraded: 2024-04-25T09:53:00.034 INFO:teuthology.orchestra.run.smithi055.stdout: librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:00.035 INFO:teuthology.orchestra.run.smithi055.stdout: librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:00.035 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T09:53:00.035 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T09:53:00.035 INFO:teuthology.orchestra.run.smithi055.stdout:Installed: 2024-04-25T09:53:00.035 INFO:teuthology.orchestra.run.smithi055.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T09:53:00.035 INFO:teuthology.orchestra.run.smithi055.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T09:53:00.035 INFO:teuthology.orchestra.run.smithi055.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T09:53:00.035 INFO:teuthology.orchestra.run.smithi055.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T09:53:00.035 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:00.035 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:00.035 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:00.035 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:00.035 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-grafana-dashboards-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T09:53:00.036 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-immutable-object-cache-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:00.036 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:00.036 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:00.036 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T09:53:00.036 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T09:53:00.036 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T09:53:00.036 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-modules-core-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T09:53:00.036 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T09:53:00.036 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:00.036 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:00.036 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-prometheus-alerts-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T09:53:00.036 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:00.036 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:00.036 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-test-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:00.037 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T09:53:00.037 INFO:teuthology.orchestra.run.smithi055.stdout: cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T09:53:00.037 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:00.037 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-shell-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:00.037 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-top-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T09:53:00.037 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T09:53:00.037 INFO:teuthology.orchestra.run.smithi055.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T09:53:00.037 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T09:53:00.037 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T09:53:00.037 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T09:53:00.037 INFO:teuthology.orchestra.run.smithi055.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T09:53:00.037 INFO:teuthology.orchestra.run.smithi055.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T09:53:00.037 INFO:teuthology.orchestra.run.smithi055.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T09:53:00.037 INFO:teuthology.orchestra.run.smithi055.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T09:53:00.037 INFO:teuthology.orchestra.run.smithi055.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T09:53:00.038 INFO:teuthology.orchestra.run.smithi055.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T09:53:00.038 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:00.038 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:00.038 INFO:teuthology.orchestra.run.smithi055.stdout: libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:00.038 INFO:teuthology.orchestra.run.smithi055.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T09:53:00.038 INFO:teuthology.orchestra.run.smithi055.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T09:53:00.038 INFO:teuthology.orchestra.run.smithi055.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T09:53:00.038 INFO:teuthology.orchestra.run.smithi055.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T09:53:00.038 INFO:teuthology.orchestra.run.smithi055.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T09:53:00.038 INFO:teuthology.orchestra.run.smithi055.stdout: librados-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:00.039 INFO:teuthology.orchestra.run.smithi055.stdout: libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:00.039 INFO:teuthology.orchestra.run.smithi055.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T09:53:00.039 INFO:teuthology.orchestra.run.smithi055.stdout: librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:00.039 INFO:teuthology.orchestra.run.smithi055.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T09:53:00.039 INFO:teuthology.orchestra.run.smithi055.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T09:53:00.039 INFO:teuthology.orchestra.run.smithi055.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T09:53:00.039 INFO:teuthology.orchestra.run.smithi055.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T09:53:00.039 INFO:teuthology.orchestra.run.smithi055.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T09:53:00.039 INFO:teuthology.orchestra.run.smithi055.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T09:53:00.039 INFO:teuthology.orchestra.run.smithi055.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T09:53:00.039 INFO:teuthology.orchestra.run.smithi055.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T09:53:00.039 INFO:teuthology.orchestra.run.smithi055.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T09:53:00.039 INFO:teuthology.orchestra.run.smithi055.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T09:53:00.040 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T09:53:00.040 INFO:teuthology.orchestra.run.smithi055.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T09:53:00.040 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T09:53:00.040 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T09:53:00.040 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T09:53:00.040 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T09:53:00.040 INFO:teuthology.orchestra.run.smithi055.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T09:53:00.040 INFO:teuthology.orchestra.run.smithi055.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T09:53:00.040 INFO:teuthology.orchestra.run.smithi055.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T09:53:00.041 INFO:teuthology.orchestra.run.smithi055.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T09:53:00.041 INFO:teuthology.orchestra.run.smithi055.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T09:53:00.041 INFO:teuthology.orchestra.run.smithi055.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T09:53:00.041 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T09:53:00.042 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-argparse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:00.042 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:00.042 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cephfs-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:00.042 INFO:teuthology.orchestra.run.smithi055.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T09:53:00.042 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T09:53:00.042 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T09:53:00.042 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T09:53:00.042 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T09:53:00.042 INFO:teuthology.orchestra.run.smithi055.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T09:53:00.042 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T09:53:00.042 INFO:teuthology.orchestra.run.smithi055.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T09:53:00.042 INFO:teuthology.orchestra.run.smithi055.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T09:53:00.042 INFO:teuthology.orchestra.run.smithi055.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T09:53:00.043 INFO:teuthology.orchestra.run.smithi055.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T09:53:00.043 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T09:53:00.043 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T09:53:00.043 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T09:53:00.043 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T09:53:00.043 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T09:53:00.043 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T09:53:00.043 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T09:53:00.043 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T09:53:00.043 INFO:teuthology.orchestra.run.smithi055.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T09:53:00.043 INFO:teuthology.orchestra.run.smithi055.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T09:53:00.043 INFO:teuthology.orchestra.run.smithi055.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T09:53:00.043 INFO:teuthology.orchestra.run.smithi055.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T09:53:00.043 INFO:teuthology.orchestra.run.smithi055.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T09:53:00.044 INFO:teuthology.orchestra.run.smithi055.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T09:53:00.044 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T09:53:00.044 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T09:53:00.044 INFO:teuthology.orchestra.run.smithi055.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T09:53:00.044 INFO:teuthology.orchestra.run.smithi055.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T09:53:00.044 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T09:53:00.044 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T09:53:00.044 INFO:teuthology.orchestra.run.smithi055.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T09:53:00.044 INFO:teuthology.orchestra.run.smithi055.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T09:53:00.044 INFO:teuthology.orchestra.run.smithi055.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T09:53:00.044 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T09:53:00.044 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T09:53:00.044 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T09:53:00.044 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T09:53:00.045 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T09:53:00.045 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T09:53:00.045 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rados-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:00.045 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:00.045 INFO:teuthology.orchestra.run.smithi055.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T09:53:00.045 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T09:53:00.045 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T09:53:00.045 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:00.045 INFO:teuthology.orchestra.run.smithi055.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T09:53:00.045 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T09:53:00.045 INFO:teuthology.orchestra.run.smithi055.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T09:53:00.045 INFO:teuthology.orchestra.run.smithi055.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T09:53:00.045 INFO:teuthology.orchestra.run.smithi055.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T09:53:00.045 INFO:teuthology.orchestra.run.smithi055.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T09:53:00.046 INFO:teuthology.orchestra.run.smithi055.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T09:53:00.046 INFO:teuthology.orchestra.run.smithi055.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T09:53:00.046 INFO:teuthology.orchestra.run.smithi055.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T09:53:00.046 INFO:teuthology.orchestra.run.smithi055.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T09:53:00.046 INFO:teuthology.orchestra.run.smithi055.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T09:53:00.046 INFO:teuthology.orchestra.run.smithi055.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T09:53:00.046 INFO:teuthology.orchestra.run.smithi055.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T09:53:00.046 INFO:teuthology.orchestra.run.smithi055.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T09:53:00.046 INFO:teuthology.orchestra.run.smithi055.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T09:53:00.046 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:00.046 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:00.046 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-nbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:00.046 INFO:teuthology.orchestra.run.smithi055.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T09:53:00.046 INFO:teuthology.orchestra.run.smithi055.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T09:53:00.047 INFO:teuthology.orchestra.run.smithi055.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T09:53:00.047 INFO:teuthology.orchestra.run.smithi055.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T09:53:00.047 INFO:teuthology.orchestra.run.smithi055.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T09:53:00.047 INFO:teuthology.orchestra.run.smithi055.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T09:53:00.047 INFO:teuthology.orchestra.run.smithi055.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T09:53:00.047 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:53:00.047 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-04-25T09:53:00.448 DEBUG:teuthology.parallel:result is None 2024-04-25T09:53:02.146 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 107/156 2024-04-25T09:53:02.146 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /sys 2024-04-25T09:53:02.146 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /proc 2024-04-25T09:53:02.147 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /mnt 2024-04-25T09:53:02.147 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /var/tmp 2024-04-25T09:53:02.147 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /home 2024-04-25T09:53:02.147 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /root 2024-04-25T09:53:02.147 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /tmp 2024-04-25T09:53:02.147 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:02.313 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 108/156 2024-04-25T09:53:02.329 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 108/156 2024-04-25T09:53:02.329 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:53:02.329 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T09:53:02.329 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:03.849 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 109/156 2024-04-25T09:53:03.876 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 109/156 2024-04-25T09:53:03.877 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:53:03.877 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T09:53:03.877 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T09:53:03.877 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T09:53:03.877 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:04.092 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 110/156 2024-04-25T09:53:04.115 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 110/156 2024-04-25T09:53:04.115 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:53:04.115 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T09:53:04.115 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T09:53:04.115 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T09:53:04.115 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:04.584 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 111/156 2024-04-25T09:53:04.608 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 111/156 2024-04-25T09:53:04.608 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:53:04.608 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T09:53:04.608 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T09:53:04.608 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T09:53:04.608 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:04.715 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T09:53:04.773 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T09:53:04.837 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T09:53:05.031 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T09:53:05.086 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T09:53:05.166 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T09:53:05.264 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T09:53:05.406 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T09:53:05.455 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T09:53:05.484 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T09:53:05.511 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T09:53:05.923 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 123/156 2024-04-25T09:53:05.961 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 123/156 2024-04-25T09:53:05.993 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1628.g97ae6cc9.e 124/156 2024-04-25T09:53:06.066 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1628.g97ae6cc9. 125/156 2024-04-25T09:53:06.092 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noa 126/156 2024-04-25T09:53:06.332 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noa 126/156 2024-04-25T09:53:06.368 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.n 127/156 2024-04-25T09:53:07.381 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.n 127/156 2024-04-25T09:53:07.418 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1628.g97a 128/156 2024-04-25T09:53:07.525 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1628.g97a 128/156 2024-04-25T09:53:07.689 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1628.g97ae6cc9.el 129/156 2024-04-25T09:53:07.720 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 130/156 2024-04-25T09:53:07.745 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 130/156 2024-04-25T09:53:07.745 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:53:07.745 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T09:53:07.745 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T09:53:07.745 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T09:53:07.745 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:07.796 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 131/156 2024-04-25T09:53:07.807 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 131/156 2024-04-25T09:53:07.909 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-2:19.0.0-1628.g97ae6cc9.el9.x86_64 132/156 2024-04-25T09:53:07.962 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 133/156 2024-04-25T09:53:08.875 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T09:53:08.899 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 135/156 2024-04-25T09:53:08.922 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 135/156 2024-04-25T09:53:08.922 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:53:08.923 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T09:53:08.923 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T09:53:08.923 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T09:53:08.923 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:08.975 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1628.g97ae6 136/156 2024-04-25T09:53:08.997 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1628.g97ae6 136/156 2024-04-25T09:53:08.997 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:53:08.997 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T09:53:08.998 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:09.042 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 137/156 2024-04-25T09:53:09.065 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 137/156 2024-04-25T09:53:09.065 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:53:09.065 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T09:53:09.065 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T09:53:09.065 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T09:53:09.065 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:09.384 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 138/156 2024-04-25T09:53:09.407 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 138/156 2024-04-25T09:53:09.407 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:53:09.407 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T09:53:09.408 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T09:53:09.408 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T09:53:09.408 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:14.071 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-test-2:19.0.0-1628.g97ae6cc9.el9.x86_64 139/156 2024-04-25T09:53:14.113 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 140/156 2024-04-25T09:53:14.154 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-nbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 141/156 2024-04-25T09:53:14.186 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T09:53:14.213 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T09:53:14.407 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephfs-shell-2:19.0.0-1628.g97ae6cc9.el9.x86_64 144/156 2024-04-25T09:53:14.450 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T09:53:14.480 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephfs-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_ 146/156 2024-04-25T09:53:15.116 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T09:53:15.162 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T09:53:15.182 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T09:53:16.084 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephfs-top-2:19.0.0-1628.g97ae6cc9.el9.noarch 148/156 2024-04-25T09:53:16.169 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T09:53:16.211 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T09:53:16.295 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T09:53:16.331 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T09:53:16.331 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T09:53:16.407 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T09:53:16.448 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T09:53:16.448 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T09:53:16.539 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T09:53:16.608 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T09:53:21.788 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T09:53:21.788 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-2:19.0.0-1628.g97ae6cc9.el9.x86_64 1/156 2024-04-25T09:53:21.788 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2/156 2024-04-25T09:53:21.789 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 3/156 2024-04-25T09:53:21.789 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 4/156 2024-04-25T09:53:21.789 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1628.g97ae6 5/156 2024-04-25T09:53:21.789 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 6/156 2024-04-25T09:53:21.789 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 7/156 2024-04-25T09:53:21.790 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 8/156 2024-04-25T09:53:21.790 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 9/156 2024-04-25T09:53:21.790 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 10/156 2024-04-25T09:53:21.790 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 11/156 2024-04-25T09:53:21.790 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-test-2:19.0.0-1628.g97ae6cc9.el9.x86_64 12/156 2024-04-25T09:53:21.790 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 13/156 2024-04-25T09:53:21.791 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephfs-shell-2:19.0.0-1628.g97ae6cc9.el9.x86_64 14/156 2024-04-25T09:53:21.791 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephfs-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_ 15/156 2024-04-25T09:53:21.791 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 16/156 2024-04-25T09:53:21.791 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 17/156 2024-04-25T09:53:21.791 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_6 18/156 2024-04-25T09:53:21.792 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86 19/156 2024-04-25T09:53:21.792 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 20/156 2024-04-25T09:53:21.792 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1628.g97ae6cc9.el 21/156 2024-04-25T09:53:21.792 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ceph-common-2:19.0.0-1628.g97ae6cc9.el9. 22/156 2024-04-25T09:53:21.792 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cephfs-2:19.0.0-1628.g97ae6cc9.el9.x86_6 23/156 2024-04-25T09:53:21.792 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rados-2:19.0.0-1628.g97ae6cc9.el9.x86_64 24/156 2024-04-25T09:53:21.792 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 25/156 2024-04-25T09:53:21.792 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 26/156 2024-04-25T09:53:21.792 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 27/156 2024-04-25T09:53:21.793 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 28/156 2024-04-25T09:53:21.793 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-nbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 29/156 2024-04-25T09:53:21.793 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1628.g97ae6cc9. 30/156 2024-04-25T09:53:21.793 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noa 31/156 2024-04-25T09:53:21.793 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.n 32/156 2024-04-25T09:53:21.793 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1628.g97a 33/156 2024-04-25T09:53:21.794 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1628.g97ae6cc9.el 34/156 2024-04-25T09:53:21.794 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 35/156 2024-04-25T09:53:21.794 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1628.g97ae6cc9.e 36/156 2024-04-25T09:53:21.794 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 37/156 2024-04-25T09:53:21.794 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 38/156 2024-04-25T09:53:21.794 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephfs-top-2:19.0.0-1628.g97ae6cc9.el9.noarch 39/156 2024-04-25T09:53:21.795 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T09:53:21.795 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T09:53:21.795 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T09:53:21.795 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T09:53:21.795 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T09:53:21.795 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T09:53:21.796 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T09:53:21.796 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T09:53:21.796 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T09:53:21.796 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T09:53:21.796 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T09:53:21.796 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T09:53:21.796 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T09:53:21.796 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T09:53:21.796 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T09:53:21.797 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T09:53:21.797 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T09:53:21.797 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T09:53:21.797 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T09:53:21.797 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T09:53:21.797 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T09:53:21.797 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T09:53:21.797 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T09:53:21.797 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T09:53:21.797 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T09:53:21.797 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T09:53:21.797 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T09:53:21.798 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T09:53:21.798 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T09:53:21.798 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T09:53:21.798 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T09:53:21.798 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T09:53:21.798 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T09:53:21.798 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T09:53:21.798 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T09:53:21.798 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T09:53:21.798 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T09:53:21.798 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T09:53:21.798 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T09:53:21.799 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T09:53:21.799 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T09:53:21.799 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T09:53:21.799 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T09:53:21.799 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T09:53:21.799 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T09:53:21.799 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T09:53:21.799 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T09:53:21.799 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T09:53:21.799 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T09:53:21.799 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T09:53:21.799 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T09:53:21.800 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T09:53:21.800 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T09:53:21.800 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T09:53:21.800 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T09:53:21.800 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T09:53:21.800 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T09:53:21.800 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T09:53:21.800 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T09:53:21.800 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T09:53:21.800 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T09:53:21.800 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T09:53:21.800 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T09:53:21.800 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T09:53:21.801 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T09:53:21.801 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T09:53:21.801 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T09:53:21.801 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T09:53:21.801 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T09:53:21.801 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T09:53:21.801 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T09:53:21.801 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T09:53:21.801 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T09:53:21.801 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T09:53:21.801 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T09:53:21.801 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T09:53:21.801 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T09:53:21.802 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T09:53:21.802 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T09:53:21.802 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T09:53:21.802 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T09:53:21.802 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T09:53:21.802 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T09:53:21.802 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T09:53:21.802 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T09:53:21.802 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T09:53:21.802 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T09:53:21.802 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T09:53:21.803 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T09:53:21.803 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T09:53:21.803 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T09:53:21.803 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T09:53:21.803 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T09:53:21.803 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T09:53:21.803 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T09:53:21.803 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T09:53:21.803 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T09:53:21.803 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T09:53:21.803 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T09:53:21.803 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T09:53:21.803 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T09:53:21.804 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T09:53:21.804 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T09:53:21.804 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T09:53:21.804 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T09:53:21.804 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T09:53:21.804 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T09:53:21.804 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T09:53:21.804 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T09:53:21.805 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 149/156 2024-04-25T09:53:21.805 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T09:53:21.805 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 151/156 2024-04-25T09:53:21.805 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T09:53:21.805 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T09:53:21.805 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T09:53:21.805 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T09:53:24.041 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T09:53:24.041 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:24.041 INFO:teuthology.orchestra.run.smithi007.stdout:Upgraded: 2024-04-25T09:53:24.041 INFO:teuthology.orchestra.run.smithi007.stdout: librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:24.041 INFO:teuthology.orchestra.run.smithi007.stdout: librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:24.041 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T09:53:24.041 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T09:53:24.041 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2024-04-25T09:53:24.042 INFO:teuthology.orchestra.run.smithi007.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T09:53:24.042 INFO:teuthology.orchestra.run.smithi007.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T09:53:24.042 INFO:teuthology.orchestra.run.smithi007.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T09:53:24.042 INFO:teuthology.orchestra.run.smithi007.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T09:53:24.042 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:24.042 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:24.042 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:24.042 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:24.042 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-grafana-dashboards-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T09:53:24.042 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-immutable-object-cache-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:24.042 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:24.042 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:24.042 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T09:53:24.043 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T09:53:24.043 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T09:53:24.043 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T09:53:24.043 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T09:53:24.043 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:24.043 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:24.043 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-prometheus-alerts-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T09:53:24.043 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:24.043 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:24.043 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-test-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:24.044 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T09:53:24.044 INFO:teuthology.orchestra.run.smithi007.stdout: cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T09:53:24.044 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:24.044 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-shell-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:24.044 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-top-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T09:53:24.044 INFO:teuthology.orchestra.run.smithi007.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T09:53:24.044 INFO:teuthology.orchestra.run.smithi007.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T09:53:24.044 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T09:53:24.044 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T09:53:24.044 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T09:53:24.044 INFO:teuthology.orchestra.run.smithi007.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T09:53:24.044 INFO:teuthology.orchestra.run.smithi007.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T09:53:24.045 INFO:teuthology.orchestra.run.smithi007.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T09:53:24.045 INFO:teuthology.orchestra.run.smithi007.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T09:53:24.045 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T09:53:24.045 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T09:53:24.045 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:24.045 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:24.045 INFO:teuthology.orchestra.run.smithi007.stdout: libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:24.045 INFO:teuthology.orchestra.run.smithi007.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T09:53:24.045 INFO:teuthology.orchestra.run.smithi007.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T09:53:24.045 INFO:teuthology.orchestra.run.smithi007.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T09:53:24.045 INFO:teuthology.orchestra.run.smithi007.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T09:53:24.045 INFO:teuthology.orchestra.run.smithi007.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T09:53:24.046 INFO:teuthology.orchestra.run.smithi007.stdout: librados-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:24.046 INFO:teuthology.orchestra.run.smithi007.stdout: libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:24.046 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T09:53:24.046 INFO:teuthology.orchestra.run.smithi007.stdout: librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:24.046 INFO:teuthology.orchestra.run.smithi007.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T09:53:24.046 INFO:teuthology.orchestra.run.smithi007.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T09:53:24.046 INFO:teuthology.orchestra.run.smithi007.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T09:53:24.046 INFO:teuthology.orchestra.run.smithi007.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T09:53:24.046 INFO:teuthology.orchestra.run.smithi007.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T09:53:24.046 INFO:teuthology.orchestra.run.smithi007.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T09:53:24.047 INFO:teuthology.orchestra.run.smithi007.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T09:53:24.047 INFO:teuthology.orchestra.run.smithi007.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T09:53:24.047 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T09:53:24.047 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T09:53:24.047 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T09:53:24.047 INFO:teuthology.orchestra.run.smithi007.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T09:53:24.047 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T09:53:24.047 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T09:53:24.047 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T09:53:24.047 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T09:53:24.047 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T09:53:24.047 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T09:53:24.048 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T09:53:24.048 INFO:teuthology.orchestra.run.smithi007.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T09:53:24.048 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T09:53:24.048 INFO:teuthology.orchestra.run.smithi007.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T09:53:24.048 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T09:53:24.048 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:24.048 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:24.048 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cephfs-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:24.048 INFO:teuthology.orchestra.run.smithi007.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T09:53:24.048 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T09:53:24.048 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T09:53:24.049 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T09:53:24.049 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T09:53:24.049 INFO:teuthology.orchestra.run.smithi007.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T09:53:24.049 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T09:53:24.049 INFO:teuthology.orchestra.run.smithi007.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T09:53:24.049 INFO:teuthology.orchestra.run.smithi007.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T09:53:24.049 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T09:53:24.049 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T09:53:24.049 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T09:53:24.049 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T09:53:24.049 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T09:53:24.049 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T09:53:24.049 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T09:53:24.050 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T09:53:24.050 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T09:53:24.050 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T09:53:24.050 INFO:teuthology.orchestra.run.smithi007.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T09:53:24.050 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T09:53:24.050 INFO:teuthology.orchestra.run.smithi007.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T09:53:24.050 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T09:53:24.050 INFO:teuthology.orchestra.run.smithi007.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T09:53:24.050 INFO:teuthology.orchestra.run.smithi007.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T09:53:24.050 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T09:53:24.050 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T09:53:24.050 INFO:teuthology.orchestra.run.smithi007.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T09:53:24.051 INFO:teuthology.orchestra.run.smithi007.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T09:53:24.051 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T09:53:24.051 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T09:53:24.051 INFO:teuthology.orchestra.run.smithi007.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T09:53:24.051 INFO:teuthology.orchestra.run.smithi007.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T09:53:24.051 INFO:teuthology.orchestra.run.smithi007.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T09:53:24.051 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T09:53:24.051 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T09:53:24.051 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T09:53:24.051 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T09:53:24.051 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T09:53:24.051 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T09:53:24.051 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:24.051 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:24.052 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T09:53:24.052 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T09:53:24.052 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T09:53:24.052 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:24.052 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T09:53:24.052 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T09:53:24.052 INFO:teuthology.orchestra.run.smithi007.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T09:53:24.052 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T09:53:24.052 INFO:teuthology.orchestra.run.smithi007.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T09:53:24.053 INFO:teuthology.orchestra.run.smithi007.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T09:53:24.053 INFO:teuthology.orchestra.run.smithi007.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T09:53:24.053 INFO:teuthology.orchestra.run.smithi007.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T09:53:24.053 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T09:53:24.053 INFO:teuthology.orchestra.run.smithi007.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T09:53:24.053 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T09:53:24.053 INFO:teuthology.orchestra.run.smithi007.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T09:53:24.053 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T09:53:24.053 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T09:53:24.053 INFO:teuthology.orchestra.run.smithi007.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T09:53:24.053 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:24.053 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:24.054 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-nbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T09:53:24.054 INFO:teuthology.orchestra.run.smithi007.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T09:53:24.054 INFO:teuthology.orchestra.run.smithi007.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T09:53:24.054 INFO:teuthology.orchestra.run.smithi007.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T09:53:24.054 INFO:teuthology.orchestra.run.smithi007.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T09:53:24.054 INFO:teuthology.orchestra.run.smithi007.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T09:53:24.054 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T09:53:24.055 INFO:teuthology.orchestra.run.smithi007.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T09:53:24.055 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:24.055 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2024-04-25T09:53:24.404 DEBUG:teuthology.parallel:result is None 2024-04-25T09:53:24.404 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T09:53:24.547 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T09:53:24.568 INFO:teuthology.orchestra.run.smithi007.stdout:19.0.0-1628.g97ae6cc9.el9 2024-04-25T09:53:24.569 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1628.g97ae6cc9.el9 2024-04-25T09:53:24.569 INFO:teuthology.task.install:The correct ceph version 19.0.0-1628.g97ae6cc9 is installed. 2024-04-25T09:53:24.571 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T09:53:24.716 DEBUG:teuthology.orchestra.run.smithi055:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T09:53:24.744 INFO:teuthology.orchestra.run.smithi055.stdout:19.0.0-1628.g97ae6cc9.el9 2024-04-25T09:53:24.744 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1628.g97ae6cc9.el9 2024-04-25T09:53:24.744 INFO:teuthology.task.install:The correct ceph version 19.0.0-1628.g97ae6cc9 is installed. 2024-04-25T09:53:24.746 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T09:53:24.746 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:53:24.746 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T09:53:24.773 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:53:24.773 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T09:53:24.816 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T09:53:24.817 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:53:24.817 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T09:53:24.842 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T09:53:24.907 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:53:24.907 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T09:53:24.938 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T09:53:25.005 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T09:53:25.005 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:53:25.005 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T09:53:25.032 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T09:53:25.097 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:53:25.097 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T09:53:25.121 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T09:53:25.186 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T09:53:25.187 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:53:25.187 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T09:53:25.213 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T09:53:25.278 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:53:25.278 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T09:53:25.302 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T09:53:25.368 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T09:53:25.465 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T09:53:25.466 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 777 /var/log/ceph 2024-04-25T09:53:25.468 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 777 /var/log/ceph 2024-04-25T09:53:25.492 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T09:53:25.493 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T09:53:25.533 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T09:53:25.557 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T09:53:25.558 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T09:53:25.598 DEBUG:teuthology.orchestra.run.smithi055:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T09:53:25.630 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-25T09:53:25.630 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-25T09:53:25.631 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-25T09:53:25.631 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:53:25.631 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T09:53:25.677 DEBUG:teuthology.orchestra.run.smithi007:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T09:53:25.789 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T09:53:25.813 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:53:25.813 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T09:53:25.829 DEBUG:teuthology.orchestra.run.smithi055:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T09:53:25.939 DEBUG:teuthology.orchestra.run.smithi055:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T09:53:25.969 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T09:53:25.970 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T09:53:25.970 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673038', 'branch': 'wip-neesingh-testing-240416', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/forward-scrub}', 'email': 'neesingh@redhat.com', 'first_in_suite': False, 'job_id': '7673038', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-neesingh-testing-240416'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}}, 'kclient': {'syntax': 'v1'}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-62537', 'sha1': 'a3b7a189d278a9762c1acb7de36790ef0ed7b448'}}, 'owner': 'scheduled_neesingh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1124, 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-62537', 'suite_path': '/home/teuthworker/src/github.com_neesingh-rh_ceph_a3b7a189d278a9762c1acb7de36790ef0ed7b448/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/neesingh-rh/ceph', 'suite_sha1': 'a3b7a189d278a9762c1acb7de36790ef0ed7b448', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi007.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEfSF5Sphybv9x4whDjjx0cWREmR6RpKP4Ym3Ps/K+nSTpN/V15sllWUYXB5HjVaRCb3o81XuRaMk1FrlQXTON4=', 'smithi055.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMvjcI3EAhFetE/fxskgi6DsYEKUy4hc69tS14FyfOQku5rWeA1ZhPPVyKtnvEfd/ByiijoMrPLUWIu70lSbpWM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_forward_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_09:36:50', 'tube': 'smithi', 'user': 'neesingh', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T09:53:25.970 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T09:53:25.974 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T09:53:26.019 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T09:53:26.029 DEBUG:teuthology.orchestra.run.smithi055:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T09:53:26.084 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:53:26.084 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T09:53:26.108 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T09:53:26.108 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_1 2024-04-25T09:53:26.163 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T09:53:26.163 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:53:26.163 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-25T09:53:26.163 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:53:26.164 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T09:53:26.164 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-04-25 09:53:16.970044757 +0000 2024-04-25T09:53:26.164 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-04-25 09:51:07.497955314 +0000 2024-04-25T09:53:26.164 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-04-25 09:51:07.497955314 +0000 2024-04-25T09:53:26.164 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-04-25 09:51:07.497955314 +0000 2024-04-25T09:53:26.164 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T09:53:26.227 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-04-25T09:53:26.227 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-04-25T09:53:26.227 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 9.441e-05 s, 5.4 MB/s 2024-04-25T09:53:26.229 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T09:53:26.285 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_2 2024-04-25T09:53:26.340 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T09:53:26.340 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:53:26.340 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-25T09:53:26.341 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:53:26.341 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T09:53:26.341 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-04-25 09:53:16.970044757 +0000 2024-04-25T09:53:26.341 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-04-25 09:51:07.831950061 +0000 2024-04-25T09:53:26.341 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-04-25 09:51:07.831950061 +0000 2024-04-25T09:53:26.341 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-04-25 09:51:07.831950061 +0000 2024-04-25T09:53:26.341 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T09:53:26.403 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-04-25T09:53:26.403 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-04-25T09:53:26.404 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000102569 s, 5.0 MB/s 2024-04-25T09:53:26.405 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T09:53:26.461 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_3 2024-04-25T09:53:26.516 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T09:53:26.516 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:53:26.516 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-25T09:53:26.516 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:53:26.516 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T09:53:26.516 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-04-25 09:53:16.970044757 +0000 2024-04-25T09:53:26.516 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-04-25 09:51:08.167944776 +0000 2024-04-25T09:53:26.516 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-04-25 09:51:08.167944776 +0000 2024-04-25T09:53:26.517 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-04-25 09:51:08.167944776 +0000 2024-04-25T09:53:26.517 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T09:53:26.578 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-04-25T09:53:26.579 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-04-25T09:53:26.579 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000106144 s, 4.8 MB/s 2024-04-25T09:53:26.580 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T09:53:26.636 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_4 2024-04-25T09:53:26.691 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T09:53:26.691 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:53:26.691 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-25T09:53:26.691 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:53:26.691 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T09:53:26.691 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-04-25 09:53:16.971044741 +0000 2024-04-25T09:53:26.691 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-04-25 09:51:08.510939381 +0000 2024-04-25T09:53:26.691 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-04-25 09:51:08.510939381 +0000 2024-04-25T09:53:26.691 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-04-25 09:51:08.510939381 +0000 2024-04-25T09:53:26.692 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T09:53:26.754 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-04-25T09:53:26.754 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-04-25T09:53:26.754 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 9.794e-05 s, 5.2 MB/s 2024-04-25T09:53:26.755 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T09:53:26.811 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T09:53:26.811 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:53:26.811 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T09:53:26.829 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T09:53:26.829 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_1 2024-04-25T09:53:26.886 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T09:53:26.886 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:53:26.886 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-04-25T09:53:26.886 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:53:26.886 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T09:53:26.886 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-04-25 09:52:53.275876051 +0000 2024-04-25T09:53:26.886 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-04-25 09:51:07.511989743 +0000 2024-04-25T09:53:26.887 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-04-25 09:51:07.511989743 +0000 2024-04-25T09:53:26.887 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-04-25 09:51:07.511989743 +0000 2024-04-25T09:53:26.887 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T09:53:26.951 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-04-25T09:53:26.951 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-04-25T09:53:26.951 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000403869 s, 1.3 MB/s 2024-04-25T09:53:26.953 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T09:53:27.011 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_2 2024-04-25T09:53:27.068 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T09:53:27.068 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:53:27.068 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-04-25T09:53:27.068 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:53:27.068 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T09:53:27.069 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-04-25 09:52:53.275876051 +0000 2024-04-25T09:53:27.069 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-04-25 09:51:07.866982246 +0000 2024-04-25T09:53:27.069 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-04-25 09:51:07.866982246 +0000 2024-04-25T09:53:27.069 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-04-25 09:51:07.866982246 +0000 2024-04-25T09:53:27.069 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T09:53:27.133 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-04-25T09:53:27.134 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-04-25T09:53:27.134 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.00025399 s, 2.0 MB/s 2024-04-25T09:53:27.135 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T09:53:27.193 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_3 2024-04-25T09:53:27.249 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T09:53:27.250 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:53:27.250 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-04-25T09:53:27.250 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:53:27.250 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T09:53:27.250 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-04-25 09:52:53.276876031 +0000 2024-04-25T09:53:27.250 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-04-25 09:51:08.202975151 +0000 2024-04-25T09:53:27.250 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-04-25 09:51:08.202975151 +0000 2024-04-25T09:53:27.250 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-04-25 09:51:08.202975151 +0000 2024-04-25T09:53:27.251 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T09:53:27.314 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-04-25T09:53:27.314 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-04-25T09:53:27.314 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000286803 s, 1.8 MB/s 2024-04-25T09:53:27.315 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T09:53:27.372 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_4 2024-04-25T09:53:27.428 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T09:53:27.429 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:53:27.430 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-25T09:53:27.430 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:53:27.430 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T09:53:27.430 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-04-25 09:52:53.276876031 +0000 2024-04-25T09:53:27.430 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-04-25 09:51:08.560967590 +0000 2024-04-25T09:53:27.430 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-04-25 09:51:08.560967590 +0000 2024-04-25T09:53:27.430 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-04-25 09:51:08.560967590 +0000 2024-04-25T09:53:27.431 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T09:53:27.491 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-04-25T09:53:27.492 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-04-25T09:53:27.492 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000279524 s, 1.8 MB/s 2024-04-25T09:53:27.493 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T09:53:27.550 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T09:53:27.550 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi007.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi055.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T09:53:27.550 INFO:tasks.ceph:Generating config... 2024-04-25T09:53:27.551 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T09:53:27.551 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T09:53:27.552 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T09:53:27.552 INFO:tasks.ceph:[client] pid file = 2024-04-25T09:53:27.552 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T09:53:27.552 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T09:53:27.552 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-25T09:53:27.552 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T09:53:27.552 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T09:53:27.552 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T09:53:27.552 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T09:53:27.552 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T09:53:27.552 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T09:53:27.552 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T09:53:27.552 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T09:53:27.552 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T09:53:27.552 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T09:53:27.553 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T09:53:27.553 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T09:53:27.553 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T09:53:27.553 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T09:53:27.553 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T09:53:27.553 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T09:53:27.553 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T09:53:27.553 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T09:53:27.553 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-25T09:53:27.553 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-25T09:53:27.553 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T09:53:27.553 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T09:53:27.553 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-25T09:53:27.553 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T09:53:27.554 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T09:53:27.554 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T09:53:27.554 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T09:53:27.554 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T09:53:27.554 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T09:53:27.554 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T09:53:27.554 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T09:53:27.632 INFO:teuthology.orchestra.run.smithi007.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T09:53:27.635 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T09:53:27.679 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T09:53:27.744 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.7'), ('mon.b', '172.21.15.55'), ('mon.c', '[v2:172.21.15.55:3301,v1:172.21.15.55:6790]')] 2024-04-25T09:53:27.745 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.7,172.21.15.55,[v2:172.21.15.55:3301,v1:172.21.15.55:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T09:53:27.745 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:53:27.745 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T09:53:27.800 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.7 --add b 172.21.15.55 --addv c '[v2:172.21.15.55:3301,v1:172.21.15.55:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:53:27.888 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:53:27.888 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: generated fsid c03d0745-5946-49c3-ad88-1165c5b68b4e 2024-04-25T09:53:27.889 INFO:teuthology.orchestra.run.smithi007.stdout:setting min_mon_release = quincy 2024-04-25T09:53:27.889 INFO:teuthology.orchestra.run.smithi007.stdout:epoch 0 2024-04-25T09:53:27.889 INFO:teuthology.orchestra.run.smithi007.stdout:fsid c03d0745-5946-49c3-ad88-1165c5b68b4e 2024-04-25T09:53:27.889 INFO:teuthology.orchestra.run.smithi007.stdout:last_changed 2024-04-25T09:53:27.887737+0000 2024-04-25T09:53:27.889 INFO:teuthology.orchestra.run.smithi007.stdout:created 2024-04-25T09:53:27.887737+0000 2024-04-25T09:53:27.889 INFO:teuthology.orchestra.run.smithi007.stdout:min_mon_release 17 (quincy) 2024-04-25T09:53:27.889 INFO:teuthology.orchestra.run.smithi007.stdout:election_strategy: 1 2024-04-25T09:53:27.889 INFO:teuthology.orchestra.run.smithi007.stdout:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-04-25T09:53:27.889 INFO:teuthology.orchestra.run.smithi007.stdout:1: [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] mon.b 2024-04-25T09:53:27.889 INFO:teuthology.orchestra.run.smithi007.stdout:2: [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] mon.c 2024-04-25T09:53:27.889 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T09:53:27.890 DEBUG:teuthology.orchestra.run.smithi007:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T09:53:27.905 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c03d0745-5946-49c3-ad88-1165c5b68b4e... 2024-04-25T09:53:27.906 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:53:27.948 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:53:27.988 INFO:teuthology.orchestra.run.smithi007.stdout:[global] 2024-04-25T09:53:27.988 INFO:teuthology.orchestra.run.smithi007.stdout: chdir = "" 2024-04-25T09:53:27.988 INFO:teuthology.orchestra.run.smithi007.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:53:27.988 INFO:teuthology.orchestra.run.smithi007.stdout: auth supported = cephx 2024-04-25T09:53:27.988 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:27.988 INFO:teuthology.orchestra.run.smithi007.stdout: filestore xattr use omap = true 2024-04-25T09:53:27.988 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:27.988 INFO:teuthology.orchestra.run.smithi007.stdout: mon clock drift allowed = 1.000 2024-04-25T09:53:27.988 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:27.988 INFO:teuthology.orchestra.run.smithi007.stdout: osd crush chooseleaf type = 0 2024-04-25T09:53:27.989 INFO:teuthology.orchestra.run.smithi007.stdout: auth debug = true 2024-04-25T09:53:27.989 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:27.989 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on old message = true 2024-04-25T09:53:27.989 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on bug = true 2024-04-25T09:53:27.989 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:27.989 INFO:teuthology.orchestra.run.smithi007.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:53:27.989 INFO:teuthology.orchestra.run.smithi007.stdout: mon pg warn max object skew = 0 2024-04-25T09:53:27.989 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:27.989 INFO:teuthology.orchestra.run.smithi007.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:53:27.989 INFO:teuthology.orchestra.run.smithi007.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:53:27.989 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:27.989 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default size = 2 2024-04-25T09:53:27.989 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:27.989 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow primary affinity = true 2024-04-25T09:53:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow pg remap = true 2024-04-25T09:53:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:53:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:53:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on no sortbitwise = false 2024-04-25T09:53:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:53:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on too few osds = false 2024-04-25T09:53:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:53:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:53:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: mon_allow_pool_size_one = true 2024-04-25T09:53:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:53:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: osd default data pool replay window = 5 2024-04-25T09:53:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:27.991 INFO:teuthology.orchestra.run.smithi007.stdout: mon allow pool delete = true 2024-04-25T09:53:27.991 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:27.991 INFO:teuthology.orchestra.run.smithi007.stdout: mon cluster log file level = debug 2024-04-25T09:53:27.991 INFO:teuthology.orchestra.run.smithi007.stdout: debug asserts on shutdown = true 2024-04-25T09:53:27.991 INFO:teuthology.orchestra.run.smithi007.stdout: mon health detail to clog = false 2024-04-25T09:53:27.991 INFO:teuthology.orchestra.run.smithi007.stdout: mon host = "172.21.15.7,172.21.15.55,[v2:172.21.15.55:3301,v1:172.21.15.55:6790]" 2024-04-25T09:53:27.991 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on skipped message = False 2024-04-25T09:53:27.991 INFO:teuthology.orchestra.run.smithi007.stdout: fsid = c03d0745-5946-49c3-ad88-1165c5b68b4e 2024-04-25T09:53:27.991 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:27.991 INFO:teuthology.orchestra.run.smithi007.stdout:[osd] 2024-04-25T09:53:27.991 INFO:teuthology.orchestra.run.smithi007.stdout: osd journal size = 100 2024-04-25T09:53:27.991 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:27.991 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub load threshold = 5.0 2024-04-25T09:53:27.991 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub max interval = 600 2024-04-25T09:53:27.991 INFO:teuthology.orchestra.run.smithi007.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:53:27.992 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:27.992 INFO:teuthology.orchestra.run.smithi007.stdout: osd recover clone overlap = true 2024-04-25T09:53:27.992 INFO:teuthology.orchestra.run.smithi007.stdout: osd recovery max chunk = 1048576 2024-04-25T09:53:27.992 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:27.992 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug shutdown = true 2024-04-25T09:53:27.992 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug op order = true 2024-04-25T09:53:27.992 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug verify stray on activate = true 2024-04-25T09:53:27.992 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug trim objects = true 2024-04-25T09:53:27.992 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:27.992 INFO:teuthology.orchestra.run.smithi007.stdout: osd open classes on start = true 2024-04-25T09:53:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug pg log writeout = true 2024-04-25T09:53:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:53:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: osd map max advance = 10 2024-04-25T09:53:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: journal zero on create = true 2024-04-25T09:53:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:53:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: filestore apply finisher threads = 3 2024-04-25T09:53:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: bdev debug aio = true 2024-04-25T09:53:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug misdirected ops = true 2024-04-25T09:53:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore block size = 96636764160 2024-04-25T09:53:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore fsck on mount = True 2024-04-25T09:53:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluefs = 20 2024-04-25T09:53:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluestore = 20 2024-04-25T09:53:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-04-25T09:53:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: debug osd = 20 2024-04-25T09:53:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: debug rocksdb = 10 2024-04-25T09:53:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:53:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd full ratio = 0.9 2024-04-25T09:53:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:53:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:53:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: osd objectstore = bluestore 2024-04-25T09:53:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: osd op complaint time = 180 2024-04-25T09:53:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:27.994 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr] 2024-04-25T09:53:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-04-25T09:53:27.995 INFO:teuthology.orchestra.run.smithi007.stdout: debug mgr = 20 2024-04-25T09:53:27.995 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2024-04-25T09:53:27.995 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2024-04-25T09:53:27.995 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:53:27.995 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:53:27.995 INFO:teuthology.orchestra.run.smithi007.stdout: mgr/telemetry/nag = false 2024-04-25T09:53:27.995 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:27.995 INFO:teuthology.orchestra.run.smithi007.stdout:[mon] 2024-04-25T09:53:27.995 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-04-25T09:53:27.995 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2024-04-25T09:53:27.995 INFO:teuthology.orchestra.run.smithi007.stdout: debug paxos = 20 2024-04-25T09:53:27.995 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2024-04-25T09:53:27.995 INFO:teuthology.orchestra.run.smithi007.stdout: mon data avail warn = 5 2024-04-25T09:53:27.995 INFO:teuthology.orchestra.run.smithi007.stdout: mon mgr mkfs grace = 240 2024-04-25T09:53:27.995 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:53:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd reporter subtree level = osd 2024-04-25T09:53:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd prime pg temp = true 2024-04-25T09:53:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:53:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:53:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:53:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:53:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:53:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:53:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:53:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: # 1m isn't quite enough 2024-04-25T09:53:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:53:27.997 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:27.997 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:53:27.997 INFO:teuthology.orchestra.run.smithi007.stdout: mon op complaint time = 120 2024-04-25T09:53:27.997 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:53:27.997 INFO:teuthology.orchestra.run.smithi007.stdout:[client] 2024-04-25T09:53:27.997 INFO:teuthology.orchestra.run.smithi007.stdout: rgw cache enabled = true 2024-04-25T09:53:27.997 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable ops log = true 2024-04-25T09:53:27.997 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable usage log = true 2024-04-25T09:53:27.997 INFO:teuthology.orchestra.run.smithi007.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:53:27.997 INFO:teuthology.orchestra.run.smithi007.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:53:27.997 INFO:teuthology.orchestra.run.smithi007.stdout: client mount timeout = 600 2024-04-25T09:53:27.997 INFO:teuthology.orchestra.run.smithi007.stdout: debug client = 20 2024-04-25T09:53:27.997 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-04-25T09:53:27.997 INFO:teuthology.orchestra.run.smithi007.stdout: pid file = "" 2024-04-25T09:53:27.997 INFO:teuthology.orchestra.run.smithi007.stdout: rados mon op timeout = 900 2024-04-25T09:53:27.998 INFO:teuthology.orchestra.run.smithi007.stdout: rados osd op timeout = 900 2024-04-25T09:53:27.998 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.a] 2024-04-25T09:53:27.998 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.b] 2024-04-25T09:53:27.998 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.c] 2024-04-25T09:53:27.998 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.a] 2024-04-25T09:53:27.998 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.c] 2024-04-25T09:53:27.998 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.b] 2024-04-25T09:53:27.998 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.d] 2024-04-25T09:53:27.998 INFO:teuthology.orchestra.run.smithi007.stdout:[mds] 2024-04-25T09:53:27.998 INFO:teuthology.orchestra.run.smithi007.stdout: debug mds = 20 2024-04-25T09:53:27.998 INFO:teuthology.orchestra.run.smithi007.stdout: debug mds balancer = 20 2024-04-25T09:53:27.998 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-04-25T09:53:27.999 INFO:teuthology.orchestra.run.smithi007.stdout: mds debug frag = True 2024-04-25T09:53:27.999 INFO:teuthology.orchestra.run.smithi007.stdout: mds debug scatterstat = True 2024-04-25T09:53:27.999 INFO:teuthology.orchestra.run.smithi007.stdout: mds op complaint time = 180 2024-04-25T09:53:27.999 INFO:teuthology.orchestra.run.smithi007.stdout: mds verify scatter = True 2024-04-25T09:53:27.999 INFO:teuthology.orchestra.run.smithi007.stdout: osd op complaint time = 180 2024-04-25T09:53:27.999 INFO:teuthology.orchestra.run.smithi007.stdout: rados mon op timeout = 900 2024-04-25T09:53:27.999 INFO:teuthology.orchestra.run.smithi007.stdout: rados osd op timeout = 900 2024-04-25T09:53:28.000 INFO:teuthology.orchestra.run.smithi055.stdout:[global] 2024-04-25T09:53:28.000 INFO:teuthology.orchestra.run.smithi055.stdout: chdir = "" 2024-04-25T09:53:28.000 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:53:28.000 INFO:teuthology.orchestra.run.smithi055.stdout: auth supported = cephx 2024-04-25T09:53:28.000 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:53:28.000 INFO:teuthology.orchestra.run.smithi055.stdout: filestore xattr use omap = true 2024-04-25T09:53:28.000 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:53:28.000 INFO:teuthology.orchestra.run.smithi055.stdout: mon clock drift allowed = 1.000 2024-04-25T09:53:28.000 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:53:28.000 INFO:teuthology.orchestra.run.smithi055.stdout: osd crush chooseleaf type = 0 2024-04-25T09:53:28.000 INFO:teuthology.orchestra.run.smithi055.stdout: auth debug = true 2024-04-25T09:53:28.001 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:53:28.001 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on old message = true 2024-04-25T09:53:28.001 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on bug = true 2024-04-25T09:53:28.001 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:53:28.001 INFO:teuthology.orchestra.run.smithi055.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:53:28.001 INFO:teuthology.orchestra.run.smithi055.stdout: mon pg warn max object skew = 0 2024-04-25T09:53:28.001 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:53:28.001 INFO:teuthology.orchestra.run.smithi055.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:53:28.001 INFO:teuthology.orchestra.run.smithi055.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:53:28.002 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:53:28.002 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default size = 2 2024-04-25T09:53:28.002 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:53:28.002 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow primary affinity = true 2024-04-25T09:53:28.002 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow pg remap = true 2024-04-25T09:53:28.002 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:53:28.002 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:53:28.002 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on no sortbitwise = false 2024-04-25T09:53:28.002 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:53:28.002 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on too few osds = false 2024-04-25T09:53:28.002 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:53:28.003 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:53:28.003 INFO:teuthology.orchestra.run.smithi055.stdout: mon_allow_pool_size_one = true 2024-04-25T09:53:28.003 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:53:28.003 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:53:28.003 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:53:28.003 INFO:teuthology.orchestra.run.smithi055.stdout: osd default data pool replay window = 5 2024-04-25T09:53:28.003 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:53:28.003 INFO:teuthology.orchestra.run.smithi055.stdout: mon allow pool delete = true 2024-04-25T09:53:28.003 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:53:28.003 INFO:teuthology.orchestra.run.smithi055.stdout: mon cluster log file level = debug 2024-04-25T09:53:28.003 INFO:teuthology.orchestra.run.smithi055.stdout: debug asserts on shutdown = true 2024-04-25T09:53:28.003 INFO:teuthology.orchestra.run.smithi055.stdout: mon health detail to clog = false 2024-04-25T09:53:28.003 INFO:teuthology.orchestra.run.smithi055.stdout: mon host = "172.21.15.7,172.21.15.55,[v2:172.21.15.55:3301,v1:172.21.15.55:6790]" 2024-04-25T09:53:28.004 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on skipped message = False 2024-04-25T09:53:28.004 INFO:teuthology.orchestra.run.smithi055.stdout: fsid = c03d0745-5946-49c3-ad88-1165c5b68b4e 2024-04-25T09:53:28.004 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:53:28.004 INFO:teuthology.orchestra.run.smithi055.stdout:[osd] 2024-04-25T09:53:28.004 INFO:teuthology.orchestra.run.smithi055.stdout: osd journal size = 100 2024-04-25T09:53:28.004 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:53:28.004 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub load threshold = 5.0 2024-04-25T09:53:28.004 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub max interval = 600 2024-04-25T09:53:28.004 INFO:teuthology.orchestra.run.smithi055.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:53:28.004 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:53:28.004 INFO:teuthology.orchestra.run.smithi055.stdout: osd recover clone overlap = true 2024-04-25T09:53:28.004 INFO:teuthology.orchestra.run.smithi055.stdout: osd recovery max chunk = 1048576 2024-04-25T09:53:28.004 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:53:28.004 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug shutdown = true 2024-04-25T09:53:28.004 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug op order = true 2024-04-25T09:53:28.005 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug verify stray on activate = true 2024-04-25T09:53:28.005 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug trim objects = true 2024-04-25T09:53:28.005 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:53:28.005 INFO:teuthology.orchestra.run.smithi055.stdout: osd open classes on start = true 2024-04-25T09:53:28.005 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug pg log writeout = true 2024-04-25T09:53:28.005 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:53:28.005 INFO:teuthology.orchestra.run.smithi055.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:53:28.005 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:53:28.005 INFO:teuthology.orchestra.run.smithi055.stdout: osd map max advance = 10 2024-04-25T09:53:28.005 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:53:28.005 INFO:teuthology.orchestra.run.smithi055.stdout: journal zero on create = true 2024-04-25T09:53:28.005 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:53:28.005 INFO:teuthology.orchestra.run.smithi055.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:53:28.005 INFO:teuthology.orchestra.run.smithi055.stdout: filestore apply finisher threads = 3 2024-04-25T09:53:28.005 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:53:28.006 INFO:teuthology.orchestra.run.smithi055.stdout: bdev debug aio = true 2024-04-25T09:53:28.006 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug misdirected ops = true 2024-04-25T09:53:28.006 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore block size = 96636764160 2024-04-25T09:53:28.006 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore fsck on mount = True 2024-04-25T09:53:28.006 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluefs = 20 2024-04-25T09:53:28.006 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluestore = 20 2024-04-25T09:53:28.006 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T09:53:28.006 INFO:teuthology.orchestra.run.smithi055.stdout: debug osd = 20 2024-04-25T09:53:28.006 INFO:teuthology.orchestra.run.smithi055.stdout: debug rocksdb = 10 2024-04-25T09:53:28.006 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:53:28.006 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd full ratio = 0.9 2024-04-25T09:53:28.006 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:53:28.006 INFO:teuthology.orchestra.run.smithi055.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:53:28.006 INFO:teuthology.orchestra.run.smithi055.stdout: osd objectstore = bluestore 2024-04-25T09:53:28.007 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-04-25T09:53:28.007 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:53:28.007 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr] 2024-04-25T09:53:28.007 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T09:53:28.007 INFO:teuthology.orchestra.run.smithi055.stdout: debug mgr = 20 2024-04-25T09:53:28.007 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-04-25T09:53:28.007 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-04-25T09:53:28.007 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:53:28.007 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:53:28.007 INFO:teuthology.orchestra.run.smithi055.stdout: mgr/telemetry/nag = false 2024-04-25T09:53:28.007 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:53:28.007 INFO:teuthology.orchestra.run.smithi055.stdout:[mon] 2024-04-25T09:53:28.007 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T09:53:28.007 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-04-25T09:53:28.007 INFO:teuthology.orchestra.run.smithi055.stdout: debug paxos = 20 2024-04-25T09:53:28.008 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-04-25T09:53:28.008 INFO:teuthology.orchestra.run.smithi055.stdout: mon data avail warn = 5 2024-04-25T09:53:28.008 INFO:teuthology.orchestra.run.smithi055.stdout: mon mgr mkfs grace = 240 2024-04-25T09:53:28.008 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:53:28.008 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd reporter subtree level = osd 2024-04-25T09:53:28.008 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd prime pg temp = true 2024-04-25T09:53:28.008 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:53:28.008 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:53:28.008 INFO:teuthology.orchestra.run.smithi055.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:53:28.008 INFO:teuthology.orchestra.run.smithi055.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:53:28.008 INFO:teuthology.orchestra.run.smithi055.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:53:28.008 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:53:28.008 INFO:teuthology.orchestra.run.smithi055.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:53:28.008 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:53:28.009 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:53:28.009 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:53:28.009 INFO:teuthology.orchestra.run.smithi055.stdout: # 1m isn't quite enough 2024-04-25T09:53:28.009 INFO:teuthology.orchestra.run.smithi055.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:53:28.009 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:53:28.009 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:53:28.009 INFO:teuthology.orchestra.run.smithi055.stdout: mon op complaint time = 120 2024-04-25T09:53:28.009 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T09:53:28.009 INFO:teuthology.orchestra.run.smithi055.stdout:[client] 2024-04-25T09:53:28.010 INFO:teuthology.orchestra.run.smithi055.stdout: rgw cache enabled = true 2024-04-25T09:53:28.010 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable ops log = true 2024-04-25T09:53:28.010 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable usage log = true 2024-04-25T09:53:28.010 INFO:teuthology.orchestra.run.smithi055.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:53:28.010 INFO:teuthology.orchestra.run.smithi055.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:53:28.010 INFO:teuthology.orchestra.run.smithi055.stdout: client mount timeout = 600 2024-04-25T09:53:28.010 INFO:teuthology.orchestra.run.smithi055.stdout: debug client = 20 2024-04-25T09:53:28.010 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T09:53:28.010 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = "" 2024-04-25T09:53:28.010 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-04-25T09:53:28.010 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-04-25T09:53:28.010 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.a] 2024-04-25T09:53:28.010 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.b] 2024-04-25T09:53:28.010 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.c] 2024-04-25T09:53:28.010 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2024-04-25T09:53:28.011 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2024-04-25T09:53:28.011 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2024-04-25T09:53:28.011 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2024-04-25T09:53:28.011 INFO:teuthology.orchestra.run.smithi055.stdout:[mds] 2024-04-25T09:53:28.011 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds = 20 2024-04-25T09:53:28.011 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds balancer = 20 2024-04-25T09:53:28.011 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T09:53:28.011 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug frag = True 2024-04-25T09:53:28.011 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug scatterstat = True 2024-04-25T09:53:28.011 INFO:teuthology.orchestra.run.smithi055.stdout: mds op complaint time = 180 2024-04-25T09:53:28.011 INFO:teuthology.orchestra.run.smithi055.stdout: mds verify scatter = True 2024-04-25T09:53:28.011 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-04-25T09:53:28.011 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-04-25T09:53:28.011 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-04-25T09:53:28.013 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T09:53:28.013 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T09:53:28.106 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T09:53:28.107 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:53:28.107 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T09:53:28.122 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:53:28.122 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T09:53:28.180 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi007.front.sepia.ceph.com 2024-04-25T09:53:28.180 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:53:28.180 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T09:53:28.180 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T09:53:28.253 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:53:28.254 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:53:28.309 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T09:53:28.309 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:53:28.309 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T09:53:28.309 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T09:53:28.350 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:53:28.350 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:53:28.408 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T09:53:28.408 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T09:53:28.409 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T09:53:28.458 INFO:teuthology.orchestra.run.smithi007.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T09:53:28.460 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T09:53:28.526 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T09:53:28.528 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T09:53:28.529 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T09:53:28.579 INFO:teuthology.orchestra.run.smithi007.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T09:53:28.581 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T09:53:28.606 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T09:53:28.695 INFO:teuthology.orchestra.run.smithi007.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T09:53:28.699 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-25T09:53:28.723 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T09:53:28.778 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T09:53:28.781 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-25T09:53:28.807 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T09:53:28.899 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T09:53:28.902 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-25T09:53:28.926 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T09:53:28.926 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T09:53:28.967 INFO:teuthology.orchestra.run.smithi007.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T09:53:28.980 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-25T09:53:29.060 INFO:teuthology.orchestra.run.smithi007.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-25T09:53:29.072 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-25T09:53:29.113 INFO:teuthology.orchestra.run.smithi055.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-25T09:53:29.126 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-25T09:53:29.206 INFO:teuthology.orchestra.run.smithi055.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-25T09:53:29.218 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T09:53:29.218 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi007.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi055.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T09:53:29.218 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T09:53:29.243 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T09:53:29.243 INFO:tasks.ceph:role: osd.0 2024-04-25T09:53:29.243 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi007.front.sepia.ceph.com 2024-04-25T09:53:29.243 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T09:53:29.307 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:53:29.307 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:53:29.307 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:53:29.307 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T09:53:29.307 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:53:29.307 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:53:29.307 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:53:29.307 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T09:53:29.307 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:53:29.307 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:53:29.338 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2024-04-25T09:53:29.340 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2024-04-25T09:53:29.340 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T09:53:29.411 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T09:53:29.480 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T09:53:29.545 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T09:53:29.545 INFO:tasks.ceph:role: osd.1 2024-04-25T09:53:29.545 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi007.front.sepia.ceph.com 2024-04-25T09:53:29.545 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T09:53:29.609 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:53:29.609 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:53:29.609 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:53:29.609 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T09:53:29.609 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:53:29.609 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:53:29.609 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:53:29.609 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T09:53:29.610 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:53:29.610 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:53:29.642 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2024-04-25T09:53:29.643 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2024-04-25T09:53:29.643 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T09:53:29.713 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T09:53:29.781 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T09:53:29.850 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T09:53:29.850 INFO:tasks.ceph:role: osd.2 2024-04-25T09:53:29.850 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi007.front.sepia.ceph.com 2024-04-25T09:53:29.851 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T09:53:29.915 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:53:29.915 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:53:29.915 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:53:29.915 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T09:53:29.916 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:53:29.916 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:53:29.916 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:53:29.916 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T09:53:29.916 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:53:29.916 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:53:29.948 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2024-04-25T09:53:29.949 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2024-04-25T09:53:29.950 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T09:53:30.018 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T09:53:30.086 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T09:53:30.151 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T09:53:30.151 INFO:tasks.ceph:role: osd.3 2024-04-25T09:53:30.151 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi007.front.sepia.ceph.com 2024-04-25T09:53:30.151 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T09:53:30.215 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:53:30.215 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:53:30.215 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:53:30.215 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T09:53:30.215 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:53:30.215 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:53:30.215 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:53:30.215 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T09:53:30.215 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:53:30.215 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:53:30.247 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2024-04-25T09:53:30.249 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2024-04-25T09:53:30.249 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T09:53:30.317 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T09:53:30.385 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:53:30.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:53:30.476+0000 7ff35e02d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T09:53:30.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:53:30.477+0000 7ff35e02d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T09:53:30.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:53:30.477+0000 7ff35e02d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T09:53:30.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:53:30.477+0000 7ff35e02d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T09:53:30.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:53:30.477+0000 7ff35e02d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T09:53:30.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:53:30.477+0000 7ff35e02d640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T09:53:33.327 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T09:53:33.356 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:53:33.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:53:33.445+0000 7f097f61c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T09:53:33.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:53:33.445+0000 7f097f61c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T09:53:33.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:53:33.445+0000 7f097f61c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T09:53:33.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:53:33.445+0000 7f097f61c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T09:53:33.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:53:33.445+0000 7f097f61c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T09:53:33.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:53:33.446+0000 7f097f61c640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T09:53:36.293 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T09:53:36.323 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:53:36.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:53:36.411+0000 7fe7ec5cb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T09:53:36.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:53:36.411+0000 7fe7ec5cb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T09:53:36.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:53:36.411+0000 7fe7ec5cb640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T09:53:36.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:53:36.411+0000 7fe7ec5cb640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T09:53:36.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:53:36.411+0000 7fe7ec5cb640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T09:53:36.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:53:36.412+0000 7fe7ec5cb640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T09:53:39.262 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T09:53:39.292 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:53:39.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:53:39.382+0000 7fe13774e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T09:53:39.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:53:39.382+0000 7fe13774e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T09:53:39.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:53:39.382+0000 7fe13774e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T09:53:39.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:53:39.382+0000 7fe13774e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T09:53:39.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:53:39.382+0000 7fe13774e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T09:53:39.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:53:39.382+0000 7fe13774e640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T09:53:42.240 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T09:53:42.270 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-25T09:53:42.300 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T09:53:42.300 INFO:tasks.ceph:role: osd.4 2024-04-25T09:53:42.300 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T09:53:42.300 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T09:53:42.397 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:53:42.397 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:53:42.397 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:53:42.398 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T09:53:42.398 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:53:42.398 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:53:42.398 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:53:42.398 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T09:53:42.398 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:53:42.398 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:53:43.719 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2024-04-25T09:53:43.721 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2024-04-25T09:53:43.721 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-25T09:53:43.755 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-25T09:53:43.826 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-25T09:53:43.893 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T09:53:43.893 INFO:tasks.ceph:role: osd.5 2024-04-25T09:53:43.893 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T09:53:43.893 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T09:53:43.987 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:53:43.987 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:53:43.987 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:53:43.987 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T09:53:43.987 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:53:43.987 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:53:43.987 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:53:43.988 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T09:53:43.988 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:53:43.988 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:53:45.307 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2024-04-25T09:53:45.309 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2024-04-25T09:53:45.309 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-25T09:53:45.345 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-25T09:53:45.419 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-25T09:53:45.488 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T09:53:45.488 INFO:tasks.ceph:role: osd.6 2024-04-25T09:53:45.488 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T09:53:45.488 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T09:53:45.583 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:53:45.583 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:53:45.583 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:53:45.583 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T09:53:45.583 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:53:45.583 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:53:45.583 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:53:45.583 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T09:53:45.583 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:53:45.583 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:53:46.903 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2024-04-25T09:53:46.906 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2024-04-25T09:53:46.906 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-25T09:53:46.943 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-25T09:53:47.018 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-25T09:53:47.087 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T09:53:47.087 INFO:tasks.ceph:role: osd.7 2024-04-25T09:53:47.087 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T09:53:47.087 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T09:53:47.183 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:53:47.184 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:53:47.184 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:53:47.184 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T09:53:47.184 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:53:47.184 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:53:47.184 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:53:47.184 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T09:53:47.184 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:53:47.184 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:53:48.525 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2024-04-25T09:53:48.527 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2024-04-25T09:53:48.527 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-25T09:53:48.566 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-25T09:53:48.638 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:53:48.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:53:48.735+0000 7f781031a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-25T09:53:48.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:53:48.737+0000 7f781031a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-25T09:53:48.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:53:48.737+0000 7f781031a640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T09:53:48.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:53:48.737+0000 7f781031a640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T09:53:48.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:53:48.737+0000 7f781031a640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T09:53:48.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:53:48.738+0000 7f781031a640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-25T09:53:51.614 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T09:53:51.643 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:53:51.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:53:51.731+0000 7f27f8933640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-25T09:53:51.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:53:51.732+0000 7f27f8933640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-25T09:53:51.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:53:51.732+0000 7f27f8933640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T09:53:51.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:53:51.732+0000 7f27f8933640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T09:53:51.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:53:51.732+0000 7f27f8933640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T09:53:51.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:53:51.733+0000 7f27f8933640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-25T09:53:54.603 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T09:53:54.632 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:53:54.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:53:54.722+0000 7f5a21b40640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-25T09:53:54.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:53:54.723+0000 7f5a21b40640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-25T09:53:54.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:53:54.723+0000 7f5a21b40640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T09:53:54.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:53:54.723+0000 7f5a21b40640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T09:53:54.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:53:54.723+0000 7f5a21b40640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T09:53:54.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:53:54.724+0000 7f5a21b40640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-25T09:53:55.973 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:53:55.976 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:53:57.600 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-25T09:53:57.629 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:53:57.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:53:57.717+0000 7f10ef415640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-25T09:53:57.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:53:57.717+0000 7f10ef415640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-25T09:53:57.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:53:57.717+0000 7f10ef415640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T09:53:57.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:53:57.717+0000 7f10ef415640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T09:53:57.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:53:57.717+0000 7f10ef415640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T09:53:57.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:53:57.719+0000 7f10ef415640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-25T09:54:00.599 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-25T09:54:00.628 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T09:54:00.628 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:54:00.629 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T09:54:00.659 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:54:00.659 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T09:54:00.727 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:54:00.727 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-25T09:54:00.794 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:54:00.794 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T09:54:00.862 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:54:00.862 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T09:54:00.928 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:54:00.929 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T09:54:00.996 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:54:00.996 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T09:54:01.062 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:54:01.062 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T09:54:01.091 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:54:01.091 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-25T09:54:01.160 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:54:01.160 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-25T09:54:01.228 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:54:01.228 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-25T09:54:01.294 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:54:01.294 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-25T09:54:01.360 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:54:01.360 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-25T09:54:01.426 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:54:01.426 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-25T09:54:01.492 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:54:01.493 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T09:54:01.512 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:54:01.512 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-25T09:54:01.570 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:54:01.571 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-25T09:54:01.587 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:54:01.587 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-25T09:54:01.644 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T09:54:01.644 DEBUG:teuthology.orchestra.run.smithi007:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T09:54:01.646 DEBUG:teuthology.orchestra.run.smithi055:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T09:54:01.687 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr.y] 2024-04-25T09:54:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAYKCpmCvpDGxAAYsxd6zUjxUgY0sYwR4VvAQ== 2024-04-25T09:54:01.687 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.a] 2024-04-25T09:54:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAYKCpmDER5IhAA2ih+YNPXKaTRN6KeMKiDaA== 2024-04-25T09:54:01.687 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.c] 2024-04-25T09:54:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAYKCpm8jBtKRAAiDZo8S/z1fE588t8tiuX8Q== 2024-04-25T09:54:01.687 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.0] 2024-04-25T09:54:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAaKCpmfHZ9HBAA9FYBJbc1QdNt1a9qtFhgBw== 2024-04-25T09:54:01.687 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.1] 2024-04-25T09:54:01.687 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAdKCpmtYOgGhAAbM8XXG5fT+UNSvzvijeJ9Q== 2024-04-25T09:54:01.687 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.2] 2024-04-25T09:54:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAgKCpmz4uZGBAA6JD3UWZ/8l12y4lJg0kH0A== 2024-04-25T09:54:01.688 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.3] 2024-04-25T09:54:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAjKCpmcbXXFhAAsK64H4YqdiD1VJKQtn46OQ== 2024-04-25T09:54:01.688 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr.x] 2024-04-25T09:54:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAYKCpmqIdPHxAACc5SoI1y74ickl2cPjfGIg== 2024-04-25T09:54:01.688 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.b] 2024-04-25T09:54:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAYKCpmp55aLhAAD3pB8YjSzrpU6DfjQTVHPw== 2024-04-25T09:54:01.688 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.d] 2024-04-25T09:54:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAYKCpmZWyRNRAA6tdquR+Hh8Lhx7LATegX6g== 2024-04-25T09:54:01.688 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.4] 2024-04-25T09:54:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAsKCpmzEDuKxAAmzxdcdVZIq2bGfG0rYcBBg== 2024-04-25T09:54:01.688 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.5] 2024-04-25T09:54:01.688 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAvKCpmfyC4KxAAl6QUtdlRRaRNZpECSoHLJQ== 2024-04-25T09:54:01.688 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.6] 2024-04-25T09:54:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAyKCpmBrUsKxAAH5IlxYRXUtPKYWDdTqBp3w== 2024-04-25T09:54:01.689 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.7] 2024-04-25T09:54:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQA1KCpmmwTSKhAAdzw/c0Xc6KCQHssqUI910g== 2024-04-25T09:54:01.689 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2024-04-25T09:54:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAYKCpmaJKeORAALxC5ZqLLEu0zJFG+SOGukQ== 2024-04-25T09:54:01.689 INFO:teuthology.orchestra.run.smithi007.stdout:[client.2] 2024-04-25T09:54:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAZKCpmytCIAxAAhP2UjagzGbz1ySErw1cw3Q== 2024-04-25T09:54:01.689 INFO:teuthology.orchestra.run.smithi007.stdout:[client.1] 2024-04-25T09:54:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAZKCpmC2i6BhAAtKmpTNs/Tga7NtOkm7jSOg== 2024-04-25T09:54:01.689 INFO:teuthology.orchestra.run.smithi007.stdout:[client.3] 2024-04-25T09:54:01.689 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAZKCpmSj88DBAAg+N3XDyc3H6fUBqkScD/9Q== 2024-04-25T09:54:01.708 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr.y] 2024-04-25T09:54:01.708 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAYKCpmCvpDGxAAYsxd6zUjxUgY0sYwR4VvAQ== 2024-04-25T09:54:01.708 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2024-04-25T09:54:01.708 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAYKCpmDER5IhAA2ih+YNPXKaTRN6KeMKiDaA== 2024-04-25T09:54:01.708 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2024-04-25T09:54:01.708 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAYKCpm8jBtKRAAiDZo8S/z1fE588t8tiuX8Q== 2024-04-25T09:54:01.708 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.0] 2024-04-25T09:54:01.708 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAaKCpmfHZ9HBAA9FYBJbc1QdNt1a9qtFhgBw== 2024-04-25T09:54:01.708 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.1] 2024-04-25T09:54:01.708 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAdKCpmtYOgGhAAbM8XXG5fT+UNSvzvijeJ9Q== 2024-04-25T09:54:01.708 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.2] 2024-04-25T09:54:01.708 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAgKCpmz4uZGBAA6JD3UWZ/8l12y4lJg0kH0A== 2024-04-25T09:54:01.709 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.3] 2024-04-25T09:54:01.709 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAjKCpmcbXXFhAAsK64H4YqdiD1VJKQtn46OQ== 2024-04-25T09:54:01.709 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr.x] 2024-04-25T09:54:01.709 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAYKCpmqIdPHxAACc5SoI1y74ickl2cPjfGIg== 2024-04-25T09:54:01.709 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2024-04-25T09:54:01.709 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAYKCpmp55aLhAAD3pB8YjSzrpU6DfjQTVHPw== 2024-04-25T09:54:01.709 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2024-04-25T09:54:01.709 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAYKCpmZWyRNRAA6tdquR+Hh8Lhx7LATegX6g== 2024-04-25T09:54:01.709 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.4] 2024-04-25T09:54:01.709 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAsKCpmzEDuKxAAmzxdcdVZIq2bGfG0rYcBBg== 2024-04-25T09:54:01.709 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.5] 2024-04-25T09:54:01.709 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAvKCpmfyC4KxAAl6QUtdlRRaRNZpECSoHLJQ== 2024-04-25T09:54:01.709 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.6] 2024-04-25T09:54:01.709 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAyKCpmBrUsKxAAH5IlxYRXUtPKYWDdTqBp3w== 2024-04-25T09:54:01.709 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.7] 2024-04-25T09:54:01.710 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQA1KCpmmwTSKhAAdzw/c0Xc6KCQHssqUI910g== 2024-04-25T09:54:01.710 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2024-04-25T09:54:01.710 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAYKCpmaJKeORAALxC5ZqLLEu0zJFG+SOGukQ== 2024-04-25T09:54:01.710 INFO:teuthology.orchestra.run.smithi055.stdout:[client.2] 2024-04-25T09:54:01.710 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAZKCpmytCIAxAAhP2UjagzGbz1ySErw1cw3Q== 2024-04-25T09:54:01.710 INFO:teuthology.orchestra.run.smithi055.stdout:[client.1] 2024-04-25T09:54:01.710 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAZKCpmC2i6BhAAtKmpTNs/Tga7NtOkm7jSOg== 2024-04-25T09:54:01.710 INFO:teuthology.orchestra.run.smithi055.stdout:[client.3] 2024-04-25T09:54:01.710 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAZKCpmSj88DBAAg+N3XDyc3H6fUBqkScD/9Q== 2024-04-25T09:54:01.711 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T09:54:01.733 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T09:54:01.803 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:54:01.805 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:54:01.859 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:54:01.861 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:54:01.914 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:54:01.917 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:54:01.966 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:54:01.968 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:54:02.019 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:54:02.021 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:54:02.071 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:54:02.073 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:54:02.123 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T09:54:02.126 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T09:54:02.175 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:54:02.177 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:54:02.230 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:54:02.232 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:54:02.285 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:54:02.287 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:54:02.337 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:54:02.339 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:54:02.389 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:54:02.391 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:54:02.441 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:54:02.443 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:54:02.493 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:54:02.496 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:54:02.548 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:54:02.551 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:54:02.604 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:54:02.606 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:54:02.659 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:54:02.661 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:54:02.714 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T09:54:02.715 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T09:54:02.739 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T09:54:02.834 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T09:54:02.859 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T09:54:02.883 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T09:54:02.989 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T09:54:03.013 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T09:54:03.077 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T09:54:03.179 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T09:54:03.204 DEBUG:teuthology.orchestra.run.smithi007:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:54:03.207 DEBUG:teuthology.orchestra.run.smithi055:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:54:03.260 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T09:54:03.260 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T09:54:03.260 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T09:54:03.263 INFO:tasks.ceph.mon.a:Started 2024-04-25T09:54:03.263 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T09:54:03.263 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T09:54:03.302 INFO:tasks.ceph.mon.b:Started 2024-04-25T09:54:03.302 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T09:54:03.302 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T09:54:03.304 INFO:tasks.ceph.mon.c:Started 2024-04-25T09:54:03.304 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T09:54:03.305 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T09:54:03.305 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T09:54:03.307 INFO:tasks.ceph.mgr.y:Started 2024-04-25T09:54:03.307 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T09:54:03.307 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T09:54:03.309 INFO:tasks.ceph.mgr.x:Started 2024-04-25T09:54:03.309 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T09:54:03.309 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T09:54:03.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.408+0000 7ff2e2a1f640 1 Processor -- start 2024-04-25T09:54:03.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.408+0000 7ff2e2a1f640 1 -- start start 2024-04-25T09:54:03.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.408+0000 7ff2e2a1f640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff2dc0ccf50 0x7ff2dc0cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:03.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.408+0000 7ff2e2a1f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff2dc0cafb0 0x7ff2dc0cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:03.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.408+0000 7ff2e2a1f640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2dc15ac30 con 0x7ff2dc15a850 2024-04-25T09:54:03.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.408+0000 7ff2e2a1f640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2dc0cd900 con 0x7ff2dc0ccf50 2024-04-25T09:54:03.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.408+0000 7ff2e2a1f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2dc15bd80 con 0x7ff2dc0cafb0 2024-04-25T09:54:03.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.408+0000 7ff2db7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff2dc0ccf50 0x7ff2dc0cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:03.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.408+0000 7ff2dbfff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff2dc15a850 0x7ff2dc0b2800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42236/0 (socket says 172.21.15.7:42236) 2024-04-25T09:54:03.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.408+0000 7ff2dbfff640 1 -- 172.21.15.7:0/1555631184 learned_addr learned my addr 172.21.15.7:0/1555631184 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:03.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.409+0000 7ff2db7fe640 1 -- 172.21.15.7:0/1555631184 >> v2:172.21.15.7:3300/0 conn(0x7ff2dc0ccf50 msgr2=0x7ff2dc0cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T09:54:03.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.409+0000 7ff2db7fe640 1 -- 172.21.15.7:0/1555631184 >> v2:172.21.15.7:3300/0 conn(0x7ff2dc0ccf50 msgr2=0x7ff2dc0cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T09:54:03.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.409+0000 7ff2e0fbc640 1 --2- 172.21.15.7:0/1555631184 >> v2:172.21.15.55:3300/0 conn(0x7ff2dc0cafb0 0x7ff2dc0cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:03.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.409+0000 7ff2db7fe640 1 --2- 172.21.15.7:0/1555631184 >> v2:172.21.15.7:3300/0 conn(0x7ff2dc0ccf50 0x7ff2dc0cd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T09:54:03.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.409+0000 7ff2db7fe640 1 --2- 172.21.15.7:0/1555631184 >> v2:172.21.15.7:3300/0 conn(0x7ff2dc0ccf50 0x7ff2dc0cd3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T09:54:03.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.409+0000 7ff2e0fbc640 1 -- 172.21.15.7:0/1555631184 >> v2:172.21.15.55:3300/0 conn(0x7ff2dc0cafb0 msgr2=0x7ff2dc0cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T09:54:03.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.409+0000 7ff2e0fbc640 1 -- 172.21.15.7:0/1555631184 >> v2:172.21.15.55:3300/0 conn(0x7ff2dc0cafb0 msgr2=0x7ff2dc0cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T09:54:03.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.409+0000 7ff2e0fbc640 1 --2- 172.21.15.7:0/1555631184 >> v2:172.21.15.55:3300/0 conn(0x7ff2dc0cafb0 0x7ff2dc0cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T09:54:03.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.409+0000 7ff2e0fbc640 1 --2- 172.21.15.7:0/1555631184 >> v2:172.21.15.55:3300/0 conn(0x7ff2dc0cafb0 0x7ff2dc0cb3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T09:54:03.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.601+0000 7ff2daffd640 1 -- 172.21.15.7:0/1555631184 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1290569141 0 0) 0x7ff2dc15ac30 con 0x7ff2dc15a850 2024-04-25T09:54:03.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.601+0000 7ff2daffd640 1 -- 172.21.15.7:0/1555631184 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2c4003520 con 0x7ff2dc15a850 2024-04-25T09:54:03.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.602+0000 7ff2daffd640 1 -- 172.21.15.7:0/1555631184 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2625002152 0 0) 0x7ff2c4003520 con 0x7ff2dc15a850 2024-04-25T09:54:03.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.602+0000 7ff2daffd640 1 -- 172.21.15.7:0/1555631184 >> v2:172.21.15.55:3300/0 conn(0x7ff2dc0cafb0 msgr2=0x7ff2dc0cb3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T09:54:03.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.602+0000 7ff2daffd640 1 --2- 172.21.15.7:0/1555631184 >> v2:172.21.15.55:3300/0 conn(0x7ff2dc0cafb0 0x7ff2dc0cb3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:03.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.602+0000 7ff2daffd640 1 -- 172.21.15.7:0/1555631184 >> v2:172.21.15.7:3300/0 conn(0x7ff2dc0ccf50 msgr2=0x7ff2dc0cd3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T09:54:03.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.602+0000 7ff2daffd640 1 --2- 172.21.15.7:0/1555631184 >> v2:172.21.15.7:3300/0 conn(0x7ff2dc0ccf50 0x7ff2dc0cd3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:03.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.602+0000 7ff2daffd640 1 -- 172.21.15.7:0/1555631184 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2dc0ce290 con 0x7ff2dc15a850 2024-04-25T09:54:03.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.602+0000 7ff2daffd640 1 -- 172.21.15.7:0/1555631184 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7ff2d0001670 con 0x7ff2dc15a850 2024-04-25T09:54:03.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.602+0000 7ff2daffd640 1 -- 172.21.15.7:0/1555631184 >> v1:172.21.15.7:6789/0 conn(0x7ff2dc15a850 legacy=0x7ff2dc0b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:03.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.602+0000 7ff2daffd640 1 --2- 172.21.15.7:0/1555631184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2c4003a00 0x7ff2c4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:03.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.602+0000 7ff2daffd640 1 --2- 172.21.15.7:0/1555631184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2c4004800 0x7ff2c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:03.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.602+0000 7ff2daffd640 1 --2- 172.21.15.7:0/1555631184 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff2c40051c0 0x7ff2c400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:03.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.602+0000 7ff2daffd640 1 -- 172.21.15.7:0/1555631184 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc0cd900 con 0x7ff2c4004800 2024-04-25T09:54:03.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.602+0000 7ff2daffd640 1 -- 172.21.15.7:0/1555631184 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c400c090 con 0x7ff2c4003a00 2024-04-25T09:54:03.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.602+0000 7ff2daffd640 1 -- 172.21.15.7:0/1555631184 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c400c290 con 0x7ff2c40051c0 2024-04-25T09:54:03.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.602+0000 7ff2dbfff640 1 --2- 172.21.15.7:0/1555631184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2c4003a00 0x7ff2c4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:03.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.602+0000 7ff2e0fbc640 1 --2- 172.21.15.7:0/1555631184 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff2c40051c0 0x7ff2c400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:03.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.602+0000 7ff2db7fe640 1 --2- 172.21.15.7:0/1555631184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2c4004800 0x7ff2c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:03.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.602+0000 7ff2db7fe640 1 -- 172.21.15.7:0/1555631184 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff2c40051c0 msgr2=0x7ff2c400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:03.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.602+0000 7ff2db7fe640 1 --2- 172.21.15.7:0/1555631184 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff2c40051c0 0x7ff2c400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:03.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.603+0000 7ff2db7fe640 1 -- 172.21.15.7:0/1555631184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2c4003a00 msgr2=0x7ff2c4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:03.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.603+0000 7ff2db7fe640 1 --2- 172.21.15.7:0/1555631184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2c4003a00 0x7ff2c4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:03.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.603+0000 7ff2db7fe640 1 -- 172.21.15.7:0/1555631184 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c4003520 con 0x7ff2c4004800 2024-04-25T09:54:03.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.603+0000 7ff2e0fbc640 1 -- 172.21.15.7:0/1555631184 reap_dead start 2024-04-25T09:54:03.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.603+0000 7ff2db7fe640 1 --2- 172.21.15.7:0/1555631184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2c4004800 0x7ff2c4004c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00b9e0 tx=0x7ff2c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f562d3e081c6e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:03.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.604+0000 7ff2daffd640 1 -- 172.21.15.7:0/1555631184 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc030070 con 0x7ff2c4004800 2024-04-25T09:54:03.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.604+0000 7ff2daffd640 1 -- 172.21.15.7:0/1555631184 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2cc02ada0 con 0x7ff2c4004800 2024-04-25T09:54:03.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.604+0000 7ff2daffd640 1 -- 172.21.15.7:0/1555631184 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc00b5e0 con 0x7ff2c4004800 2024-04-25T09:54:03.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.605+0000 7ff2e2a1f640 1 -- 172.21.15.7:0/1555631184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2c4004800 msgr2=0x7ff2c4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:03.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.605+0000 7ff2e2a1f640 1 --2- 172.21.15.7:0/1555631184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2c4004800 0x7ff2c4004c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00b9e0 tx=0x7ff2c4005830 comp rx=0 tx=0).stop 2024-04-25T09:54:03.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.605+0000 7ff2e2a1f640 1 -- 172.21.15.7:0/1555631184 shutdown_connections 2024-04-25T09:54:03.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.605+0000 7ff2e2a1f640 1 --2- 172.21.15.7:0/1555631184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2c4004800 0x7ff2c4004c80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:03.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.605+0000 7ff2e2a1f640 1 -- 172.21.15.7:0/1555631184 >> 172.21.15.7:0/1555631184 conn(0x7ff2dc0999f0 msgr2=0x7ff2dc0b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:03.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.605+0000 7ff2e2a1f640 1 -- 172.21.15.7:0/1555631184 shutdown_connections 2024-04-25T09:54:03.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.605+0000 7ff2e2a1f640 1 -- 172.21.15.7:0/1555631184 wait complete. 2024-04-25T09:54:03.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.607+0000 7ff2e2a1f640 1 Processor -- start 2024-04-25T09:54:03.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.607+0000 7ff2e2a1f640 1 -- start start 2024-04-25T09:54:03.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.608+0000 7ff2e2a1f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2c4004800 0x7ff2dc154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:03.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.608+0000 7ff2e2a1f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2dc1f3d20 0x7ff2dc0b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:03.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.608+0000 7ff2e2a1f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff2dc0b20d0 0x7ff2dc0cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:03.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.608+0000 7ff2e2a1f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc0ceb30 con 0x7ff2c4004800 2024-04-25T09:54:03.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.608+0000 7ff2e2a1f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc0ce850 con 0x7ff2dc1f3d20 2024-04-25T09:54:03.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.608+0000 7ff2e2a1f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc0cee10 con 0x7ff2dc0b20d0 2024-04-25T09:54:03.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.608+0000 7ff2dbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2c4004800 0x7ff2dc154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:03.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.608+0000 7ff2db7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2dc1f3d20 0x7ff2dc0b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:03.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.608+0000 7ff2dbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2c4004800 0x7ff2dc154bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51194/0 (socket says 172.21.15.7:51194) 2024-04-25T09:54:03.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.608+0000 7ff2dbfff640 1 -- 172.21.15.7:0/1532710116 learned_addr learned my addr 172.21.15.7:0/1532710116 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:03.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.608+0000 7ff2e0fbc640 1 --2- 172.21.15.7:0/1532710116 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff2dc0b20d0 0x7ff2dc0cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:03.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.609+0000 7ff2dbfff640 1 -- 172.21.15.7:0/1532710116 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff2dc0b20d0 msgr2=0x7ff2dc0cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:03.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.609+0000 7ff2dbfff640 1 --2- 172.21.15.7:0/1532710116 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff2dc0b20d0 0x7ff2dc0cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:03.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.609+0000 7ff2dbfff640 1 -- 172.21.15.7:0/1532710116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2dc1f3d20 msgr2=0x7ff2dc0b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:03.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.609+0000 7ff2dbfff640 1 --2- 172.21.15.7:0/1532710116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2dc1f3d20 0x7ff2dc0b37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:03.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.609+0000 7ff2dbfff640 1 -- 172.21.15.7:0/1532710116 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2dc0b3d20 con 0x7ff2c4004800 2024-04-25T09:54:03.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.609+0000 7ff2dbfff640 1 --2- 172.21.15.7:0/1532710116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2c4004800 0x7ff2dc154bb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0004ef0 tx=0x7ff2d0007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:03.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.609+0000 7ff2d8ff9640 1 -- 172.21.15.7:0/1532710116 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d000f750 con 0x7ff2c4004800 2024-04-25T09:54:03.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.609+0000 7ff2d8ff9640 1 -- 172.21.15.7:0/1532710116 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d0018070 con 0x7ff2c4004800 2024-04-25T09:54:03.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.609+0000 7ff2e2a1f640 1 -- 172.21.15.7:0/1532710116 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2dc1f4220 con 0x7ff2c4004800 2024-04-25T09:54:03.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.609+0000 7ff2d8ff9640 1 -- 172.21.15.7:0/1532710116 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d000fb10 con 0x7ff2c4004800 2024-04-25T09:54:03.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.609+0000 7ff2e2a1f640 1 -- 172.21.15.7:0/1532710116 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2dc1f47e0 con 0x7ff2c4004800 2024-04-25T09:54:03.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.609+0000 7ff2d8ff9640 1 -- 172.21.15.7:0/1532710116 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7ff2d000fcb0 con 0x7ff2c4004800 2024-04-25T09:54:03.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.609+0000 7ff2d8ff9640 1 -- 172.21.15.7:0/1532710116 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff2d00135b0 con 0x7ff2c4004800 2024-04-25T09:54:03.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.610+0000 7ff2e2a1f640 1 -- 172.21.15.7:0/1532710116 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2dc068f60 con 0x7ff2c4004800 2024-04-25T09:54:03.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.612+0000 7ff2d8ff9640 1 -- 172.21.15.7:0/1532710116 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7ff2dc0b3d20 con 0x7ff2c4004800 2024-04-25T09:54:03.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.710+0000 7ff2e2a1f640 1 -- 172.21.15.7:0/1532710116 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff2dc070260 con 0x7ff2c4004800 2024-04-25T09:54:03.713 INFO:tasks.ceph.mgr.x.smithi055.stderr:2024-04-25T09:54:03.712+0000 7f434b920040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T09:54:03.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.712+0000 7ff2d8ff9640 1 -- 172.21.15.7:0/1532710116 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff2d00137b0 con 0x7ff2c4004800 2024-04-25T09:54:03.714 INFO:teuthology.orchestra.run.smithi007.stderr:adjusted tunables profile to default 2024-04-25T09:54:03.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.713+0000 7ff2e2a1f640 1 -- 172.21.15.7:0/1532710116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2c4004800 msgr2=0x7ff2dc154bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:03.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.713+0000 7ff2e2a1f640 1 --2- 172.21.15.7:0/1532710116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2c4004800 0x7ff2dc154bb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0004ef0 tx=0x7ff2d0007430 comp rx=0 tx=0).stop 2024-04-25T09:54:03.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.713+0000 7ff2e2a1f640 1 -- 172.21.15.7:0/1532710116 shutdown_connections 2024-04-25T09:54:03.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.713+0000 7ff2e2a1f640 1 --2- 172.21.15.7:0/1532710116 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff2dc0b20d0 0x7ff2dc0cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:03.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.713+0000 7ff2e2a1f640 1 --2- 172.21.15.7:0/1532710116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2dc1f3d20 0x7ff2dc0b37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:03.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.713+0000 7ff2e2a1f640 1 --2- 172.21.15.7:0/1532710116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2c4004800 0x7ff2dc154bb0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:03.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.713+0000 7ff2e2a1f640 1 -- 172.21.15.7:0/1532710116 >> 172.21.15.7:0/1532710116 conn(0x7ff2dc0999f0 msgr2=0x7ff2dc159870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:03.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.713+0000 7ff2e2a1f640 1 -- 172.21.15.7:0/1532710116 shutdown_connections 2024-04-25T09:54:03.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:03.713+0000 7ff2e2a1f640 1 -- 172.21.15.7:0/1532710116 wait complete. 2024-04-25T09:54:03.727 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T09:54:03.727 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T09:54:03.727 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:54:03.727 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T09:54:03.745 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-25T09:54:03.743+0000 7f3dc0730040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T09:54:03.751 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:54:03.751 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T09:54:03.815 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:54:03.815 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T09:54:03.879 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:54:03.879 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T09:54:03.880 INFO:tasks.ceph.mgr.x.smithi055.stderr:2024-04-25T09:54:03.878+0000 7f434b920040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T09:54:03.906 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-25T09:54:03.903+0000 7f3dc0730040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T09:54:03.929 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:54:03.930 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-25T09:54:03.935 INFO:tasks.ceph.mgr.x.smithi055.stderr:2024-04-25T09:54:03.934+0000 7f434b920040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T09:54:03.955 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:54:03.956 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-25T09:54:03.963 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-25T09:54:03.961+0000 7f3dc0730040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T09:54:04.020 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:54:04.020 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-25T09:54:04.084 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:54:04.084 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-25T09:54:04.149 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd new cdf742e0-3579-40a3-a004-584c4b36507a 0 2024-04-25T09:54:04.193 INFO:tasks.ceph.mgr.x.smithi055.stderr:2024-04-25T09:54:04.192+0000 7f434b920040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T09:54:04.210 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-25T09:54:04.208+0000 7f3dc0730040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T09:54:04.242 INFO:tasks.ceph.mgr.x.smithi055.stderr:2024-04-25T09:54:04.241+0000 7f434b920040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T09:54:04.257 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-25T09:54:04.255+0000 7f3dc0730040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T09:54:04.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.287+0000 7fd327709640 1 Processor -- start 2024-04-25T09:54:04.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.287+0000 7fd327709640 1 -- start start 2024-04-25T09:54:04.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.288+0000 7fd327709640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd32006bb70 0x7fd32006bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:04.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.288+0000 7fd327709640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd320066980 0x7fd32006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:04.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.288+0000 7fd327709640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd32006c490 con 0x7fd32015dcc0 2024-04-25T09:54:04.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.288+0000 7fd327709640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd32006de10 con 0x7fd32006bb70 2024-04-25T09:54:04.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.288+0000 7fd327709640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32006e0f0 con 0x7fd320066980 2024-04-25T09:54:04.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.288+0000 7fd325ca6640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd320066980 0x7fd32006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:04.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.288+0000 7fd324ca4640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd32015dcc0 0x7fd3200ace10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35544/0 (socket says 172.21.15.55:35544) 2024-04-25T09:54:04.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.288+0000 7fd324ca4640 1 -- 172.21.15.55:0/3146977670 learned_addr learned my addr 172.21.15.55:0/3146977670 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:54:04.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.288+0000 7fd3254a5640 1 --2- 172.21.15.55:0/3146977670 >> v2:172.21.15.7:3300/0 conn(0x7fd32006bb70 0x7fd32006bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:04.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.288+0000 7fd325ca6640 1 -- 172.21.15.55:0/3146977670 >> v2:172.21.15.7:3300/0 conn(0x7fd32006bb70 msgr2=0x7fd32006bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:04.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.288+0000 7fd325ca6640 1 --2- 172.21.15.55:0/3146977670 >> v2:172.21.15.7:3300/0 conn(0x7fd32006bb70 0x7fd32006bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:04.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.288+0000 7fd325ca6640 1 -- 172.21.15.55:0/3146977670 >> v1:172.21.15.55:6789/0 conn(0x7fd32015dcc0 legacy=0x7fd3200ace10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:04.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.288+0000 7fd317fff640 1 -- 172.21.15.55:0/3146977670 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3145654041 0 0) 0x7fd32006c490 con 0x7fd32015dcc0 2024-04-25T09:54:04.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.288+0000 7fd325ca6640 1 -- 172.21.15.55:0/3146977670 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32006e3d0 con 0x7fd320066980 2024-04-25T09:54:04.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.289+0000 7fd325ca6640 1 --2- 172.21.15.55:0/3146977670 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd320066980 0x7fd32006eeb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd318009d90 tx=0x7fd31802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa6514aa7acdf4c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:04.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.289+0000 7fd317fff640 1 -- 172.21.15.55:0/3146977670 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd318007740 con 0x7fd320066980 2024-04-25T09:54:04.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.289+0000 7fd317fff640 1 -- 172.21.15.55:0/3146977670 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3180078e0 con 0x7fd320066980 2024-04-25T09:54:04.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.289+0000 7fd317fff640 1 -- 172.21.15.55:0/3146977670 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd318007cb0 con 0x7fd320066980 2024-04-25T09:54:04.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.290+0000 7fd327709640 1 -- 172.21.15.55:0/3146977670 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd320066980 msgr2=0x7fd32006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:04.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.290+0000 7fd327709640 1 --2- 172.21.15.55:0/3146977670 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd320066980 0x7fd32006eeb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd318009d90 tx=0x7fd31802a660 comp rx=0 tx=0).stop 2024-04-25T09:54:04.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.290+0000 7fd327709640 1 -- 172.21.15.55:0/3146977670 shutdown_connections 2024-04-25T09:54:04.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.290+0000 7fd327709640 1 --2- 172.21.15.55:0/3146977670 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd320066980 0x7fd32006eeb0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:04.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.290+0000 7fd327709640 1 --2- 172.21.15.55:0/3146977670 >> v2:172.21.15.7:3300/0 conn(0x7fd32006bb70 0x7fd32006bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:04.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.290+0000 7fd327709640 1 -- 172.21.15.55:0/3146977670 >> 172.21.15.55:0/3146977670 conn(0x7fd3200718e0 msgr2=0x7fd320071cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:04.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.290+0000 7fd327709640 1 -- 172.21.15.55:0/3146977670 shutdown_connections 2024-04-25T09:54:04.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.290+0000 7fd327709640 1 -- 172.21.15.55:0/3146977670 wait complete. 2024-04-25T09:54:04.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.291+0000 7fd327709640 1 Processor -- start 2024-04-25T09:54:04.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.291+0000 7fd327709640 1 -- start start 2024-04-25T09:54:04.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.292+0000 7fd327709640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd320066980 0x7fd3200cf190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:04.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.292+0000 7fd327709640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd32006bb70 0x7fd3201f2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:04.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.292+0000 7fd327709640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd32015d100 0x7fd3201f3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:04.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.292+0000 7fd327709640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3200ad520 con 0x7fd32015d100 2024-04-25T09:54:04.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.292+0000 7fd327709640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32006e990 con 0x7fd32006bb70 2024-04-25T09:54:04.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.292+0000 7fd327709640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32006d910 con 0x7fd320066980 2024-04-25T09:54:04.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.292+0000 7fd3254a5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd320066980 0x7fd3200cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:04.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.292+0000 7fd3254a5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd320066980 0x7fd3200cf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:43504/0 (socket says 172.21.15.55:43504) 2024-04-25T09:54:04.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.292+0000 7fd3254a5640 1 -- 172.21.15.55:0/2033334414 learned_addr learned my addr 172.21.15.55:0/2033334414 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:54:04.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.292+0000 7fd324ca4640 1 --2- 172.21.15.55:0/2033334414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd32006bb70 0x7fd3201f2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:04.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.292+0000 7fd325ca6640 1 --2- 172.21.15.55:0/2033334414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd32015d100 0x7fd3201f3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:04.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.292+0000 7fd3254a5640 1 -- 172.21.15.55:0/2033334414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd32006bb70 msgr2=0x7fd3201f2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:04.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.292+0000 7fd3254a5640 1 --2- 172.21.15.55:0/2033334414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd32006bb70 0x7fd3201f2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:04.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.292+0000 7fd3254a5640 1 -- 172.21.15.55:0/2033334414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd32015d100 msgr2=0x7fd3201f3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:04.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.292+0000 7fd3254a5640 1 --2- 172.21.15.55:0/2033334414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd32015d100 0x7fd3201f3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:04.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.293+0000 7fd3254a5640 1 -- 172.21.15.55:0/2033334414 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3200cf6d0 con 0x7fd320066980 2024-04-25T09:54:04.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.293+0000 7fd3254a5640 1 --2- 172.21.15.55:0/2033334414 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd320066980 0x7fd3200cf190 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd31000e9b0 tx=0x7fd31000ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:04.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.293+0000 7fd315ffb640 1 -- 172.21.15.55:0/2033334414 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd310017070 con 0x7fd320066980 2024-04-25T09:54:04.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.293+0000 7fd315ffb640 1 -- 172.21.15.55:0/2033334414 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31000c9a0 con 0x7fd320066980 2024-04-25T09:54:04.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.293+0000 7fd315ffb640 1 -- 172.21.15.55:0/2033334414 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31000cd90 con 0x7fd320066980 2024-04-25T09:54:04.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.293+0000 7fd327709640 1 -- 172.21.15.55:0/2033334414 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3201f3600 con 0x7fd320066980 2024-04-25T09:54:04.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.293+0000 7fd327709640 1 -- 172.21.15.55:0/2033334414 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3201f3bc0 con 0x7fd320066980 2024-04-25T09:54:04.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.293+0000 7fd315ffb640 1 -- 172.21.15.55:0/2033334414 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fd31001a070 con 0x7fd320066980 2024-04-25T09:54:04.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.293+0000 7fd315ffb640 1 -- 172.21.15.55:0/2033334414 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd310013470 con 0x7fd320066980 2024-04-25T09:54:04.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.294+0000 7fd327709640 1 -- 172.21.15.55:0/2033334414 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd320068f60 con 0x7fd320066980 2024-04-25T09:54:04.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.296+0000 7fd315ffb640 1 -- 172.21.15.55:0/2033334414 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fd3200cf6d0 con 0x7fd320066980 2024-04-25T09:54:04.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.370+0000 7fd327709640 1 -- 172.21.15.55:0/2033334414 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd new", "uuid": "cdf742e0-3579-40a3-a004-584c4b36507a", "id": 0} v 0) v1 -- 0x7fd3200b0f40 con 0x7fd320066980 2024-04-25T09:54:04.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.375+0000 7fd315ffb640 1 -- 172.21.15.55:0/2033334414 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cdf742e0-3579-40a3-a004-584c4b36507a", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd3100137a0 con 0x7fd320066980 2024-04-25T09:54:04.377 INFO:teuthology.orchestra.run.smithi055.stdout:0 2024-04-25T09:54:04.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.376+0000 7fd327709640 1 -- 172.21.15.55:0/2033334414 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd320066980 msgr2=0x7fd3200cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:04.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.376+0000 7fd327709640 1 --2- 172.21.15.55:0/2033334414 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd320066980 0x7fd3200cf190 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd31000e9b0 tx=0x7fd31000ee70 comp rx=0 tx=0).stop 2024-04-25T09:54:04.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.376+0000 7fd327709640 1 -- 172.21.15.55:0/2033334414 shutdown_connections 2024-04-25T09:54:04.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.376+0000 7fd327709640 1 --2- 172.21.15.55:0/2033334414 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd32015d100 0x7fd3201f3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:04.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.376+0000 7fd327709640 1 --2- 172.21.15.55:0/2033334414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd32006bb70 0x7fd3201f2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:04.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.376+0000 7fd327709640 1 --2- 172.21.15.55:0/2033334414 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd320066980 0x7fd3200cf190 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:04.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.376+0000 7fd327709640 1 -- 172.21.15.55:0/2033334414 >> 172.21.15.55:0/2033334414 conn(0x7fd3200718e0 msgr2=0x7fd3200afb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:04.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.376+0000 7fd327709640 1 -- 172.21.15.55:0/2033334414 shutdown_connections 2024-04-25T09:54:04.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.376+0000 7fd327709640 1 -- 172.21.15.55:0/2033334414 wait complete. 2024-04-25T09:54:04.388 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd new 35cae772-31a0-46e7-a4e1-934bb9fdedf5 1 2024-04-25T09:54:04.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.526+0000 7f5a6b43f640 1 Processor -- start 2024-04-25T09:54:04.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.527+0000 7f5a6b43f640 1 -- start start 2024-04-25T09:54:04.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.527+0000 7f5a6b43f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5a64162230 0x7f5a6406fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:04.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.527+0000 7f5a6b43f640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a640b3460 con 0x7f5a64158290 2024-04-25T09:54:04.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.528+0000 7f5a6b43f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a640b4d50 con 0x7f5a64161620 2024-04-25T09:54:04.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.528+0000 7f5a6b43f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a640b5030 con 0x7f5a64162230 2024-04-25T09:54:04.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.528+0000 7f5a689da640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5a64162230 0x7f5a6406fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:04.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.528+0000 7f5a699dc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5a64161620 0x7f5a6406b8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35560/0 (socket says 172.21.15.55:35560) 2024-04-25T09:54:04.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.528+0000 7f5a699dc640 1 -- 172.21.15.55:0/2198499209 learned_addr learned my addr 172.21.15.55:0/2198499209 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:54:04.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.528+0000 7f5a689da640 1 -- 172.21.15.55:0/2198499209 >> v1:172.21.15.55:6789/0 conn(0x7f5a64161620 legacy=0x7f5a6406b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:04.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.528+0000 7f5a689da640 1 -- 172.21.15.55:0/2198499209 >> v1:172.21.15.7:6789/0 conn(0x7f5a64158290 legacy=0x7f5a6406d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:04.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.528+0000 7f5a689da640 1 -- 172.21.15.55:0/2198499209 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a640b2e10 con 0x7f5a64162230 2024-04-25T09:54:04.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.529+0000 7f5a689da640 1 --2- 172.21.15.55:0/2198499209 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a64162230 0x7f5a6406fe20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5a600097a0 tx=0x7f5a6002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6014c531e6eaff9b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:04.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.529+0000 7f5a57fff640 1 -- 172.21.15.55:0/2198499209 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a60037070 con 0x7f5a64162230 2024-04-25T09:54:04.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.529+0000 7f5a57fff640 1 -- 172.21.15.55:0/2198499209 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a60032440 con 0x7f5a64162230 2024-04-25T09:54:04.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.529+0000 7f5a57fff640 1 -- 172.21.15.55:0/2198499209 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6002ae60 con 0x7f5a64162230 2024-04-25T09:54:04.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.530+0000 7f5a6b43f640 1 -- 172.21.15.55:0/2198499209 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a64162230 msgr2=0x7f5a6406fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:04.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.530+0000 7f5a6b43f640 1 --2- 172.21.15.55:0/2198499209 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a64162230 0x7f5a6406fe20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5a600097a0 tx=0x7f5a6002a110 comp rx=0 tx=0).stop 2024-04-25T09:54:04.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.530+0000 7f5a6b43f640 1 -- 172.21.15.55:0/2198499209 shutdown_connections 2024-04-25T09:54:04.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.530+0000 7f5a6b43f640 1 --2- 172.21.15.55:0/2198499209 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a64162230 0x7f5a6406fe20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:04.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.530+0000 7f5a6b43f640 1 -- 172.21.15.55:0/2198499209 >> 172.21.15.55:0/2198499209 conn(0x7f5a640cc7f0 msgr2=0x7f5a640ccc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:04.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.530+0000 7f5a6b43f640 1 -- 172.21.15.55:0/2198499209 shutdown_connections 2024-04-25T09:54:04.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.530+0000 7f5a6b43f640 1 -- 172.21.15.55:0/2198499209 wait complete. 2024-04-25T09:54:04.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.531+0000 7f5a6b43f640 1 Processor -- start 2024-04-25T09:54:04.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.531+0000 7f5a6b43f640 1 -- start start 2024-04-25T09:54:04.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.532+0000 7f5a6b43f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a64158290 0x7f5a64155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:04.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.532+0000 7f5a6b43f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5a64161620 0x7f5a641e7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:04.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.532+0000 7f5a6b43f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a64162230 0x7f5a64071870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:04.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.532+0000 7f5a6b43f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a640b4a80 con 0x7f5a64162230 2024-04-25T09:54:04.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.532+0000 7f5a6b43f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a640b4900 con 0x7f5a64158290 2024-04-25T09:54:04.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.532+0000 7f5a6b43f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6406bff0 con 0x7f5a64161620 2024-04-25T09:54:04.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.532+0000 7f5a691db640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a64158290 0x7f5a64155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:04.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.532+0000 7f5a691db640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a64158290 0x7f5a64155370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50672/0 (socket says 172.21.15.55:50672) 2024-04-25T09:54:04.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.532+0000 7f5a689da640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5a64161620 0x7f5a641e7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:04.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.532+0000 7f5a691db640 1 -- 172.21.15.55:0/1349347223 learned_addr learned my addr 172.21.15.55:0/1349347223 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:54:04.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.532+0000 7f5a699dc640 1 --2- 172.21.15.55:0/1349347223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a64162230 0x7f5a64071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:04.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.532+0000 7f5a689da640 1 -- 172.21.15.55:0/1349347223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a64158290 msgr2=0x7f5a64155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:04.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.532+0000 7f5a689da640 1 --2- 172.21.15.55:0/1349347223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a64158290 0x7f5a64155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:04.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.532+0000 7f5a689da640 1 -- 172.21.15.55:0/1349347223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a64162230 msgr2=0x7f5a64071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:04.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.532+0000 7f5a689da640 1 --2- 172.21.15.55:0/1349347223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a64162230 0x7f5a64071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:04.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.532+0000 7f5a689da640 1 -- 172.21.15.55:0/1349347223 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a641558b0 con 0x7f5a64161620 2024-04-25T09:54:04.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.532+0000 7f5a691db640 1 --2- 172.21.15.55:0/1349347223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a64158290 0x7f5a64155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:54:04.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.533+0000 7f5a689da640 1 --2- 172.21.15.55:0/1349347223 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5a64161620 0x7f5a641e7e40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5a60031000 tx=0x7f5a600046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:04.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.533+0000 7f5a55ffb640 1 -- 172.21.15.55:0/1349347223 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a60041020 con 0x7f5a64161620 2024-04-25T09:54:04.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.533+0000 7f5a55ffb640 1 -- 172.21.15.55:0/1349347223 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a600309d0 con 0x7f5a64161620 2024-04-25T09:54:04.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.533+0000 7f5a55ffb640 1 -- 172.21.15.55:0/1349347223 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a60032e60 con 0x7f5a64161620 2024-04-25T09:54:04.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.533+0000 7f5a6b43f640 1 -- 172.21.15.55:0/1349347223 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a641e86c0 con 0x7f5a64161620 2024-04-25T09:54:04.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.533+0000 7f5a6b43f640 1 -- 172.21.15.55:0/1349347223 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a641e8c80 con 0x7f5a64161620 2024-04-25T09:54:04.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.533+0000 7f5a55ffb640 1 -- 172.21.15.55:0/1349347223 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f5a60044070 con 0x7f5a64161620 2024-04-25T09:54:04.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.533+0000 7f5a55ffb640 1 -- 172.21.15.55:0/1349347223 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f5a6003d440 con 0x7f5a64161620 2024-04-25T09:54:04.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.534+0000 7f5a6b43f640 1 -- 172.21.15.55:0/1349347223 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a64068f60 con 0x7f5a64161620 2024-04-25T09:54:04.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.536+0000 7f5a55ffb640 1 -- 172.21.15.55:0/1349347223 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f5a6004b070 con 0x7f5a64161620 2024-04-25T09:54:04.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.612+0000 7f5a6b43f640 1 -- 172.21.15.55:0/1349347223 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd new", "uuid": "35cae772-31a0-46e7-a4e1-934bb9fdedf5", "id": 1} v 0) v1 -- 0x7f5a640ccf50 con 0x7f5a64161620 2024-04-25T09:54:04.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.616+0000 7f5a55ffb640 1 -- 172.21.15.55:0/1349347223 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "35cae772-31a0-46e7-a4e1-934bb9fdedf5", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5a60030dc0 con 0x7f5a64161620 2024-04-25T09:54:04.619 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-25T09:54:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.617+0000 7f5a6b43f640 1 -- 172.21.15.55:0/1349347223 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5a64161620 msgr2=0x7f5a641e7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.617+0000 7f5a6b43f640 1 --2- 172.21.15.55:0/1349347223 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5a64161620 0x7f5a641e7e40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5a60031000 tx=0x7f5a600046c0 comp rx=0 tx=0).stop 2024-04-25T09:54:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.617+0000 7f5a6b43f640 1 -- 172.21.15.55:0/1349347223 shutdown_connections 2024-04-25T09:54:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.617+0000 7f5a6b43f640 1 --2- 172.21.15.55:0/1349347223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a64162230 0x7f5a64071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.617+0000 7f5a6b43f640 1 --2- 172.21.15.55:0/1349347223 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5a64161620 0x7f5a641e7e40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.617+0000 7f5a6b43f640 1 --2- 172.21.15.55:0/1349347223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a64158290 0x7f5a64155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.617+0000 7f5a6b43f640 1 -- 172.21.15.55:0/1349347223 >> 172.21.15.55:0/1349347223 conn(0x7f5a640cc7f0 msgr2=0x7f5a640ada60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.618+0000 7f5a6b43f640 1 -- 172.21.15.55:0/1349347223 shutdown_connections 2024-04-25T09:54:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.618+0000 7f5a6b43f640 1 -- 172.21.15.55:0/1349347223 wait complete. 2024-04-25T09:54:04.630 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd new 4f289501-a92d-4eb1-9796-d367603ab9fa 2 2024-04-25T09:54:04.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.727+0000 7fe122b6a640 1 Processor -- start 2024-04-25T09:54:04.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.728+0000 7fe122b6a640 1 -- start start 2024-04-25T09:54:04.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.728+0000 7fe122b6a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe11c0af710 0x7fe11c0cd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:04.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.728+0000 7fe122b6a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11c0ccac0 con 0x7fe11c0b2800 2024-04-25T09:54:04.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.728+0000 7fe122b6a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11c0cc7e0 con 0x7fe11c15dc40 2024-04-25T09:54:04.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.728+0000 7fe122b6a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11c15e020 con 0x7fe11c0af710 2024-04-25T09:54:04.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.728+0000 7fe120906640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe11c15dc40 0x7fe11c0cf7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35568/0 (socket says 172.21.15.55:35568) 2024-04-25T09:54:04.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.728+0000 7fe120906640 1 -- 172.21.15.55:0/2184788786 learned_addr learned my addr 172.21.15.55:0/2184788786 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:54:04.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.729+0000 7fe11b7fe640 1 -- 172.21.15.55:0/2184788786 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3911207268 0 0) 0x7fe11c0cc7e0 con 0x7fe11c15dc40 2024-04-25T09:54:04.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.729+0000 7fe121107640 1 --2- 172.21.15.55:0/2184788786 >> v2:172.21.15.7:3300/0 conn(0x7fe11c0af710 0x7fe11c0cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:04.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.729+0000 7fe11b7fe640 1 -- 172.21.15.55:0/2184788786 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe104003520 con 0x7fe11c15dc40 2024-04-25T09:54:04.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.729+0000 7fe11b7fe640 1 -- 172.21.15.55:0/2184788786 <== mon.1 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3001749778 0 0) 0x7fe104003520 con 0x7fe11c15dc40 2024-04-25T09:54:04.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.729+0000 7fe11b7fe640 1 -- 172.21.15.55:0/2184788786 >> v2:172.21.15.7:3300/0 conn(0x7fe11c0af710 msgr2=0x7fe11c0cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:04.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.729+0000 7fe11b7fe640 1 --2- 172.21.15.55:0/2184788786 >> v2:172.21.15.7:3300/0 conn(0x7fe11c0af710 0x7fe11c0cd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:04.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.729+0000 7fe11b7fe640 1 -- 172.21.15.55:0/2184788786 >> v1:172.21.15.7:6789/0 conn(0x7fe11c0b2800 legacy=0x7fe11c0ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:04.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.729+0000 7fe11b7fe640 1 -- 172.21.15.55:0/2184788786 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c06f840 con 0x7fe11c15dc40 2024-04-25T09:54:04.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.729+0000 7fe11b7fe640 1 -- 172.21.15.55:0/2184788786 <== mon.1 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fe10c001670 con 0x7fe11c15dc40 2024-04-25T09:54:04.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.729+0000 7fe11b7fe640 1 -- 172.21.15.55:0/2184788786 >> v1:172.21.15.55:6789/0 conn(0x7fe11c15dc40 legacy=0x7fe11c0cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:04.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.729+0000 7fe11b7fe640 1 --2- 172.21.15.55:0/2184788786 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe1040039b0 0x7fe104003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:04.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.729+0000 7fe11b7fe640 1 --2- 172.21.15.55:0/2184788786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe104004800 0x7fe104004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:04.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.729+0000 7fe11b7fe640 1 --2- 172.21.15.55:0/2184788786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1040052e0 0x7fe10400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:04.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.729+0000 7fe11b7fe640 1 -- 172.21.15.55:0/2184788786 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c15e020 con 0x7fe1040052e0 2024-04-25T09:54:04.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.729+0000 7fe11b7fe640 1 -- 172.21.15.55:0/2184788786 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10400c1b0 con 0x7fe104004800 2024-04-25T09:54:04.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.729+0000 7fe11b7fe640 1 -- 172.21.15.55:0/2184788786 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe10400c3b0 con 0x7fe1040039b0 2024-04-25T09:54:04.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.729+0000 7fe120906640 1 --2- 172.21.15.55:0/2184788786 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe1040039b0 0x7fe104003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:04.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.729+0000 7fe11bfff640 1 --2- 172.21.15.55:0/2184788786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe104004800 0x7fe104004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:04.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.729+0000 7fe121107640 1 --2- 172.21.15.55:0/2184788786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1040052e0 0x7fe10400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:04.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.729+0000 7fe11bfff640 1 -- 172.21.15.55:0/2184788786 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe1040039b0 msgr2=0x7fe104003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:04.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.729+0000 7fe11bfff640 1 --2- 172.21.15.55:0/2184788786 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe1040039b0 0x7fe104003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:04.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.729+0000 7fe11bfff640 1 -- 172.21.15.55:0/2184788786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1040052e0 msgr2=0x7fe10400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:04.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.729+0000 7fe11bfff640 1 --2- 172.21.15.55:0/2184788786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1040052e0 0x7fe10400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:04.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.729+0000 7fe11bfff640 1 -- 172.21.15.55:0/2184788786 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe104003520 con 0x7fe104004800 2024-04-25T09:54:04.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.729+0000 7fe120906640 1 --2- 172.21.15.55:0/2184788786 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe1040039b0 0x7fe104003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:54:04.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.729+0000 7fe121107640 1 --2- 172.21.15.55:0/2184788786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1040052e0 0x7fe10400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:54:04.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.729+0000 7fe121107640 1 -- 172.21.15.55:0/2184788786 reap_dead start 2024-04-25T09:54:04.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.730+0000 7fe11bfff640 1 --2- 172.21.15.55:0/2184788786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe104004800 0x7fe104004c80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe11c072150 tx=0x7fe104005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fbe8e396fdd4dce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:04.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.730+0000 7fe11b7fe640 1 -- 172.21.15.55:0/2184788786 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe110001370 con 0x7fe104004800 2024-04-25T09:54:04.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.730+0000 7fe11b7fe640 1 -- 172.21.15.55:0/2184788786 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1100052d0 con 0x7fe104004800 2024-04-25T09:54:04.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.730+0000 7fe11b7fe640 1 -- 172.21.15.55:0/2184788786 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11002ab40 con 0x7fe104004800 2024-04-25T09:54:04.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.731+0000 7fe122b6a640 1 -- 172.21.15.55:0/2184788786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe104004800 msgr2=0x7fe104004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:04.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.731+0000 7fe122b6a640 1 --2- 172.21.15.55:0/2184788786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe104004800 0x7fe104004c80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe11c072150 tx=0x7fe104005830 comp rx=0 tx=0).stop 2024-04-25T09:54:04.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.731+0000 7fe122b6a640 1 -- 172.21.15.55:0/2184788786 shutdown_connections 2024-04-25T09:54:04.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.731+0000 7fe122b6a640 1 --2- 172.21.15.55:0/2184788786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe104004800 0x7fe104004c80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:04.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.731+0000 7fe122b6a640 1 -- 172.21.15.55:0/2184788786 >> 172.21.15.55:0/2184788786 conn(0x7fe11c0999f0 msgr2=0x7fe11c0b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:04.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.731+0000 7fe122b6a640 1 -- 172.21.15.55:0/2184788786 shutdown_connections 2024-04-25T09:54:04.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.731+0000 7fe122b6a640 1 -- 172.21.15.55:0/2184788786 wait complete. 2024-04-25T09:54:04.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.732+0000 7fe122b6a640 1 Processor -- start 2024-04-25T09:54:04.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.732+0000 7fe122b6a640 1 -- start start 2024-04-25T09:54:04.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.733+0000 7fe122b6a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe104004800 0x7fe11c148270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:04.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.733+0000 7fe122b6a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe11c0b5b10 0x7fe11c15aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:04.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.733+0000 7fe122b6a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe11c147690 0x7fe11c147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:04.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.733+0000 7fe122b6a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c0afcd0 con 0x7fe11c147690 2024-04-25T09:54:04.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.733+0000 7fe122b6a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c06fe00 con 0x7fe11c0b5b10 2024-04-25T09:54:04.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.733+0000 7fe122b6a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c0afe50 con 0x7fe104004800 2024-04-25T09:54:04.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.733+0000 7fe120906640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe104004800 0x7fe11c148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:04.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.733+0000 7fe11bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe11c0b5b10 0x7fe11c15aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:04.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.733+0000 7fe120906640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe104004800 0x7fe11c148270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:43534/0 (socket says 172.21.15.55:43534) 2024-04-25T09:54:04.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.733+0000 7fe120906640 1 -- 172.21.15.55:0/2661904052 learned_addr learned my addr 172.21.15.55:0/2661904052 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:54:04.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.733+0000 7fe121107640 1 --2- 172.21.15.55:0/2661904052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe11c147690 0x7fe11c147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:04.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.733+0000 7fe120906640 1 -- 172.21.15.55:0/2661904052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe11c0b5b10 msgr2=0x7fe11c15aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:04.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.733+0000 7fe120906640 1 --2- 172.21.15.55:0/2661904052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe11c0b5b10 0x7fe11c15aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:04.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.733+0000 7fe120906640 1 -- 172.21.15.55:0/2661904052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe11c147690 msgr2=0x7fe11c147b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:04.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.733+0000 7fe120906640 1 --2- 172.21.15.55:0/2661904052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe11c147690 0x7fe11c147b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:04.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.733+0000 7fe120906640 1 -- 172.21.15.55:0/2661904052 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c0b5f70 con 0x7fe104004800 2024-04-25T09:54:04.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.733+0000 7fe120906640 1 --2- 172.21.15.55:0/2661904052 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe104004800 0x7fe11c148270 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe10c001b60 tx=0x7fe10c007720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:04.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.734+0000 7fe1197fa640 1 -- 172.21.15.55:0/2661904052 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c007cf0 con 0x7fe104004800 2024-04-25T09:54:04.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.734+0000 7fe1197fa640 1 -- 172.21.15.55:0/2661904052 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10c018070 con 0x7fe104004800 2024-04-25T09:54:04.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.734+0000 7fe122b6a640 1 -- 172.21.15.55:0/2661904052 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe11c09a680 con 0x7fe104004800 2024-04-25T09:54:04.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.734+0000 7fe1197fa640 1 -- 172.21.15.55:0/2661904052 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c00fb50 con 0x7fe104004800 2024-04-25T09:54:04.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.734+0000 7fe122b6a640 1 -- 172.21.15.55:0/2661904052 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11c1459c0 con 0x7fe104004800 2024-04-25T09:54:04.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.734+0000 7fe1197fa640 1 -- 172.21.15.55:0/2661904052 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fe10c00fcf0 con 0x7fe104004800 2024-04-25T09:54:04.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.734+0000 7fe1197fa640 1 -- 172.21.15.55:0/2661904052 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fe10c013860 con 0x7fe104004800 2024-04-25T09:54:04.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.735+0000 7fe122b6a640 1 -- 172.21.15.55:0/2661904052 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe11c068f60 con 0x7fe104004800 2024-04-25T09:54:04.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.737+0000 7fe1197fa640 1 -- 172.21.15.55:0/2661904052 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fe11c0b5f70 con 0x7fe104004800 2024-04-25T09:54:04.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.855+0000 7fe122b6a640 1 -- 172.21.15.55:0/2661904052 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4f289501-a92d-4eb1-9796-d367603ab9fa", "id": 2} v 0) v1 -- 0x7fe11c06d160 con 0x7fe104004800 2024-04-25T09:54:04.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.860+0000 7fe1197fa640 1 -- 172.21.15.55:0/2661904052 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4f289501-a92d-4eb1-9796-d367603ab9fa", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe10c0135b0 con 0x7fe104004800 2024-04-25T09:54:04.862 INFO:teuthology.orchestra.run.smithi055.stdout:2 2024-04-25T09:54:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.861+0000 7fe122b6a640 1 -- 172.21.15.55:0/2661904052 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe104004800 msgr2=0x7fe11c148270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.861+0000 7fe122b6a640 1 --2- 172.21.15.55:0/2661904052 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe104004800 0x7fe11c148270 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe10c001b60 tx=0x7fe10c007720 comp rx=0 tx=0).stop 2024-04-25T09:54:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.861+0000 7fe122b6a640 1 -- 172.21.15.55:0/2661904052 shutdown_connections 2024-04-25T09:54:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.861+0000 7fe122b6a640 1 --2- 172.21.15.55:0/2661904052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe11c147690 0x7fe11c147b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.861+0000 7fe122b6a640 1 --2- 172.21.15.55:0/2661904052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe11c0b5b10 0x7fe11c15aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.861+0000 7fe122b6a640 1 --2- 172.21.15.55:0/2661904052 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe104004800 0x7fe11c148270 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:04.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.861+0000 7fe122b6a640 1 -- 172.21.15.55:0/2661904052 >> 172.21.15.55:0/2661904052 conn(0x7fe11c0999f0 msgr2=0x7fe11c0ae0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:04.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.861+0000 7fe122b6a640 1 -- 172.21.15.55:0/2661904052 shutdown_connections 2024-04-25T09:54:04.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.861+0000 7fe122b6a640 1 -- 172.21.15.55:0/2661904052 wait complete. 2024-04-25T09:54:04.874 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd new f4e81a25-c57b-4ebd-a6ef-94a584380d96 3 2024-04-25T09:54:04.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.973+0000 7fb817170640 1 Processor -- start 2024-04-25T09:54:04.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.973+0000 7fb817170640 1 -- start start 2024-04-25T09:54:04.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.973+0000 7fb817170640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb81006ab60 0x7fb8100cc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:04.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.973+0000 7fb817170640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb81015c850 0x7fb81006af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:04.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.973+0000 7fb817170640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb81006b480 con 0x7fb8100ccfd0 2024-04-25T09:54:04.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.973+0000 7fb817170640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8100cc6f0 con 0x7fb81006ab60 2024-04-25T09:54:04.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.973+0000 7fb817170640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8100cc9d0 con 0x7fb81015c850 2024-04-25T09:54:04.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.974+0000 7fb80ffff640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb81015c850 0x7fb81006af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:04.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.974+0000 7fb814f0c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb81006ab60 0x7fb8100cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:04.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.974+0000 7fb80ffff640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb81015c850 0x7fb81006af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:43542/0 (socket says 172.21.15.55:43542) 2024-04-25T09:54:04.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.974+0000 7fb814f0c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb81006ab60 0x7fb8100cc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50708/0 (socket says 172.21.15.55:50708) 2024-04-25T09:54:04.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.974+0000 7fb80ffff640 1 -- 172.21.15.55:0/3360211042 learned_addr learned my addr 172.21.15.55:0/3360211042 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:54:04.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.974+0000 7fb814f0c640 1 -- 172.21.15.55:0/3360211042 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb81015c850 msgr2=0x7fb81006af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:04.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.974+0000 7fb814f0c640 1 --2- 172.21.15.55:0/3360211042 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb81015c850 0x7fb81006af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:04.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.974+0000 7fb814f0c640 1 -- 172.21.15.55:0/3360211042 >> v1:172.21.15.55:6789/0 conn(0x7fb8100ccfd0 legacy=0x7fb8100cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:04.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.974+0000 7fb80f7fe640 1 -- 172.21.15.55:0/3360211042 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3774811278 0 0) 0x7fb81006b480 con 0x7fb8100ccfd0 2024-04-25T09:54:04.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.974+0000 7fb814f0c640 1 -- 172.21.15.55:0/3360211042 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8100cccb0 con 0x7fb81006ab60 2024-04-25T09:54:04.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.974+0000 7fb80ffff640 1 --2- 172.21.15.55:0/3360211042 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb81015c850 0x7fb81006af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:54:04.978 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-25T09:54:04.973+0000 7f3dc0730040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T09:54:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.975+0000 7fb814f0c640 1 --2- 172.21.15.55:0/3360211042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb81006ab60 0x7fb8100cc010 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb8000097a0 tx=0x7fb80002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a93d71dcdd09bbac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.975+0000 7fb80f7fe640 1 -- 172.21.15.55:0/3360211042 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800037070 con 0x7fb81006ab60 2024-04-25T09:54:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.975+0000 7fb80f7fe640 1 -- 172.21.15.55:0/3360211042 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80002ae50 con 0x7fb81006ab60 2024-04-25T09:54:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.975+0000 7fb80f7fe640 1 -- 172.21.15.55:0/3360211042 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800032660 con 0x7fb81006ab60 2024-04-25T09:54:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.975+0000 7fb817170640 1 -- 172.21.15.55:0/3360211042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb81006ab60 msgr2=0x7fb8100cc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.975+0000 7fb817170640 1 --2- 172.21.15.55:0/3360211042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb81006ab60 0x7fb8100cc010 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb8000097a0 tx=0x7fb80002a100 comp rx=0 tx=0).stop 2024-04-25T09:54:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.975+0000 7fb817170640 1 -- 172.21.15.55:0/3360211042 shutdown_connections 2024-04-25T09:54:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.975+0000 7fb817170640 1 --2- 172.21.15.55:0/3360211042 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb81015c850 0x7fb81006af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.975+0000 7fb817170640 1 --2- 172.21.15.55:0/3360211042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb81006ab60 0x7fb8100cc010 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.975+0000 7fb817170640 1 -- 172.21.15.55:0/3360211042 >> 172.21.15.55:0/3360211042 conn(0x7fb8100999f0 msgr2=0x7fb8100b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:04.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.976+0000 7fb817170640 1 -- 172.21.15.55:0/3360211042 shutdown_connections 2024-04-25T09:54:04.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.976+0000 7fb817170640 1 -- 172.21.15.55:0/3360211042 wait complete. 2024-04-25T09:54:04.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.977+0000 7fb817170640 1 Processor -- start 2024-04-25T09:54:04.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.977+0000 7fb817170640 1 -- start start 2024-04-25T09:54:04.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.978+0000 7fb817170640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb81006ab60 0x7fb810149980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:04.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.978+0000 7fb817170640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8100ccfd0 0x7fb8100cad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:04.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.978+0000 7fb817170640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb81015c850 0x7fb8100c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:04.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.978+0000 7fb817170640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81015ccd0 con 0x7fb8100ccfd0 2024-04-25T09:54:04.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.978+0000 7fb817170640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8100ce470 con 0x7fb81015c850 2024-04-25T09:54:04.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.978+0000 7fb817170640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8100cdb70 con 0x7fb81006ab60 2024-04-25T09:54:04.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.978+0000 7fb814f0c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb81006ab60 0x7fb810149980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:04.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.978+0000 7fb814f0c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb81006ab60 0x7fb810149980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:43550/0 (socket says 172.21.15.55:43550) 2024-04-25T09:54:04.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.978+0000 7fb814f0c640 1 -- 172.21.15.55:0/2171743859 learned_addr learned my addr 172.21.15.55:0/2171743859 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:54:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.978+0000 7fb81570d640 1 --2- 172.21.15.55:0/2171743859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb81015c850 0x7fb8100c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.978+0000 7fb80ffff640 1 --2- 172.21.15.55:0/2171743859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8100ccfd0 0x7fb8100cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.978+0000 7fb814f0c640 1 -- 172.21.15.55:0/2171743859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb81015c850 msgr2=0x7fb8100c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.978+0000 7fb814f0c640 1 --2- 172.21.15.55:0/2171743859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb81015c850 0x7fb8100c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.978+0000 7fb814f0c640 1 -- 172.21.15.55:0/2171743859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8100ccfd0 msgr2=0x7fb8100cad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.978+0000 7fb814f0c640 1 --2- 172.21.15.55:0/2171743859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8100ccfd0 0x7fb8100cad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.978+0000 7fb814f0c640 1 -- 172.21.15.55:0/2171743859 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8100c9c80 con 0x7fb81006ab60 2024-04-25T09:54:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.978+0000 7fb814f0c640 1 --2- 172.21.15.55:0/2171743859 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb81006ab60 0x7fb810149980 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb8000097a0 tx=0x7fb8000046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.978+0000 7fb80d7fa640 1 -- 172.21.15.55:0/2171743859 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800037040 con 0x7fb81006ab60 2024-04-25T09:54:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.978+0000 7fb80d7fa640 1 -- 172.21.15.55:0/2171743859 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb800004030 con 0x7fb81006ab60 2024-04-25T09:54:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.978+0000 7fb817170640 1 -- 172.21.15.55:0/2171743859 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8100c9f60 con 0x7fb81006ab60 2024-04-25T09:54:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.978+0000 7fb80d7fa640 1 -- 172.21.15.55:0/2171743859 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800004420 con 0x7fb81006ab60 2024-04-25T09:54:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.978+0000 7fb817170640 1 -- 172.21.15.55:0/2171743859 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8100ca520 con 0x7fb81006ab60 2024-04-25T09:54:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.979+0000 7fb80d7fa640 1 -- 172.21.15.55:0/2171743859 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fb8000039a0 con 0x7fb81006ab60 2024-04-25T09:54:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.979+0000 7fb80d7fa640 1 -- 172.21.15.55:0/2171743859 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fb80003dba0 con 0x7fb81006ab60 2024-04-25T09:54:04.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.979+0000 7fb817170640 1 -- 172.21.15.55:0/2171743859 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb810068f60 con 0x7fb81006ab60 2024-04-25T09:54:04.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:04.981+0000 7fb80d7fa640 1 -- 172.21.15.55:0/2171743859 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fb800003e20 con 0x7fb81006ab60 2024-04-25T09:54:05.024 INFO:tasks.ceph.mgr.x.smithi055.stderr:2024-04-25T09:54:05.022+0000 7f434b920040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T09:54:05.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.055+0000 7fb817170640 1 -- 172.21.15.55:0/2171743859 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f4e81a25-c57b-4ebd-a6ef-94a584380d96", "id": 3} v 0) v1 -- 0x7fb8100cd740 con 0x7fb81006ab60 2024-04-25T09:54:05.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.060+0000 7fb80d7fa640 1 -- 172.21.15.55:0/2171743859 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f4e81a25-c57b-4ebd-a6ef-94a584380d96", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb80003d470 con 0x7fb81006ab60 2024-04-25T09:54:05.062 INFO:teuthology.orchestra.run.smithi055.stdout:3 2024-04-25T09:54:05.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.061+0000 7fb817170640 1 -- 172.21.15.55:0/2171743859 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb81006ab60 msgr2=0x7fb810149980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:05.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.061+0000 7fb817170640 1 --2- 172.21.15.55:0/2171743859 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb81006ab60 0x7fb810149980 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb8000097a0 tx=0x7fb8000046c0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.061+0000 7fb817170640 1 -- 172.21.15.55:0/2171743859 shutdown_connections 2024-04-25T09:54:05.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.061+0000 7fb817170640 1 --2- 172.21.15.55:0/2171743859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb81015c850 0x7fb8100c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.061+0000 7fb817170640 1 --2- 172.21.15.55:0/2171743859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8100ccfd0 0x7fb8100cad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.061+0000 7fb817170640 1 --2- 172.21.15.55:0/2171743859 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb81006ab60 0x7fb810149980 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.061+0000 7fb817170640 1 -- 172.21.15.55:0/2171743859 >> 172.21.15.55:0/2171743859 conn(0x7fb8100999f0 msgr2=0x7fb8100ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:05.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.061+0000 7fb817170640 1 -- 172.21.15.55:0/2171743859 shutdown_connections 2024-04-25T09:54:05.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.061+0000 7fb817170640 1 -- 172.21.15.55:0/2171743859 wait complete. 2024-04-25T09:54:05.066 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-25T09:54:05.064+0000 7f3dc0730040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T09:54:05.073 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd new bce9c9a3-5a5a-47c0-a81e-58811b026611 4 2024-04-25T09:54:05.111 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-25T09:54:05.109+0000 7f3dc0730040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T09:54:05.117 INFO:tasks.ceph.mgr.x.smithi055.stderr:2024-04-25T09:54:05.116+0000 7f434b920040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T09:54:05.163 INFO:tasks.ceph.mgr.x.smithi055.stderr:2024-04-25T09:54:05.161+0000 7f434b920040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T09:54:05.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.172+0000 7ff44e49e640 1 Processor -- start 2024-04-25T09:54:05.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.172+0000 7ff44e49e640 1 -- start start 2024-04-25T09:54:05.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.173+0000 7ff44e49e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4480af490 0x7ff4480cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:05.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.173+0000 7ff44e49e640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff44806b9b0 con 0x7ff44806b300 2024-04-25T09:54:05.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.173+0000 7ff44e49e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff44806bc90 con 0x7ff4480cdf00 2024-04-25T09:54:05.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.173+0000 7ff44e49e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4480af870 con 0x7ff4480af490 2024-04-25T09:54:05.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.173+0000 7ff4477fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff4480cdf00 0x7ff44806abf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35594/0 (socket says 172.21.15.55:35594) 2024-04-25T09:54:05.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.173+0000 7ff447fff640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4480af490 0x7ff4480cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:05.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.173+0000 7ff4477fe640 1 -- 172.21.15.55:0/2157138800 learned_addr learned my addr 172.21.15.55:0/2157138800 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:54:05.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.173+0000 7ff446ffd640 1 -- 172.21.15.55:0/2157138800 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 616547741 0 0) 0x7ff44806bc90 con 0x7ff4480cdf00 2024-04-25T09:54:05.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.173+0000 7ff446ffd640 1 -- 172.21.15.55:0/2157138800 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff430003520 con 0x7ff4480cdf00 2024-04-25T09:54:05.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.173+0000 7ff447fff640 1 -- 172.21.15.55:0/2157138800 >> v1:172.21.15.55:6789/0 conn(0x7ff4480cdf00 legacy=0x7ff44806abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:05.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.173+0000 7ff447fff640 1 -- 172.21.15.55:0/2157138800 >> v1:172.21.15.7:6789/0 conn(0x7ff44806b300 legacy=0x7ff44806db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:05.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.173+0000 7ff447fff640 1 -- 172.21.15.55:0/2157138800 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44806bf70 con 0x7ff4480af490 2024-04-25T09:54:05.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.174+0000 7ff447fff640 1 --2- 172.21.15.55:0/2157138800 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4480af490 0x7ff4480cd9c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff43c0097d0 tx=0x7ff43c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7c581c9b085b2ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:05.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.174+0000 7ff446ffd640 1 -- 172.21.15.55:0/2157138800 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c037070 con 0x7ff4480af490 2024-04-25T09:54:05.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.174+0000 7ff446ffd640 1 -- 172.21.15.55:0/2157138800 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43c032440 con 0x7ff4480af490 2024-04-25T09:54:05.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.174+0000 7ff446ffd640 1 -- 172.21.15.55:0/2157138800 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c032810 con 0x7ff4480af490 2024-04-25T09:54:05.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.175+0000 7ff44e49e640 1 -- 172.21.15.55:0/2157138800 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4480af490 msgr2=0x7ff4480cd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:05.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.175+0000 7ff44e49e640 1 --2- 172.21.15.55:0/2157138800 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4480af490 0x7ff4480cd9c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff43c0097d0 tx=0x7ff43c02a210 comp rx=0 tx=0).stop 2024-04-25T09:54:05.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.175+0000 7ff44e49e640 1 -- 172.21.15.55:0/2157138800 shutdown_connections 2024-04-25T09:54:05.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.175+0000 7ff44e49e640 1 --2- 172.21.15.55:0/2157138800 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4480af490 0x7ff4480cd9c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.175+0000 7ff44e49e640 1 -- 172.21.15.55:0/2157138800 >> 172.21.15.55:0/2157138800 conn(0x7ff4480cc870 msgr2=0x7ff4480ccc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:05.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.175+0000 7ff44e49e640 1 -- 172.21.15.55:0/2157138800 shutdown_connections 2024-04-25T09:54:05.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.175+0000 7ff44e49e640 1 -- 172.21.15.55:0/2157138800 wait complete. 2024-04-25T09:54:05.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.176+0000 7ff44e49e640 1 Processor -- start 2024-04-25T09:54:05.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.176+0000 7ff44e49e640 1 -- start start 2024-04-25T09:54:05.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.177+0000 7ff44e49e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff44806b300 0x7ff4480b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:05.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.177+0000 7ff44e49e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4480af490 0x7ff44815f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:05.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.177+0000 7ff44e49e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4480cdf00 0x7ff448153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:05.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.177+0000 7ff44e49e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44806e250 con 0x7ff44806b300 2024-04-25T09:54:05.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.177+0000 7ff44e49e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44806b750 con 0x7ff4480cdf00 2024-04-25T09:54:05.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.177+0000 7ff44e49e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44806e3d0 con 0x7ff4480af490 2024-04-25T09:54:05.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.177+0000 7ff4477fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4480af490 0x7ff44815f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:05.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.177+0000 7ff44ca3b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4480cdf00 0x7ff448153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:05.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.177+0000 7ff4477fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4480af490 0x7ff44815f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:43562/0 (socket says 172.21.15.55:43562) 2024-04-25T09:54:05.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.177+0000 7ff4477fe640 1 -- 172.21.15.55:0/3707826759 learned_addr learned my addr 172.21.15.55:0/3707826759 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:54:05.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.177+0000 7ff447fff640 1 --2- 172.21.15.55:0/3707826759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff44806b300 0x7ff4480b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:05.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.177+0000 7ff4477fe640 1 -- 172.21.15.55:0/3707826759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4480cdf00 msgr2=0x7ff448153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:05.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.177+0000 7ff4477fe640 1 --2- 172.21.15.55:0/3707826759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4480cdf00 0x7ff448153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.177+0000 7ff4477fe640 1 -- 172.21.15.55:0/3707826759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff44806b300 msgr2=0x7ff4480b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:05.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.177+0000 7ff4477fe640 1 --2- 172.21.15.55:0/3707826759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff44806b300 0x7ff4480b57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.177+0000 7ff4477fe640 1 -- 172.21.15.55:0/3707826759 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44815fb60 con 0x7ff4480af490 2024-04-25T09:54:05.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.178+0000 7ff4477fe640 1 --2- 172.21.15.55:0/3707826759 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4480af490 0x7ff44815f180 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff43800c410 tx=0x7ff43800c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:05.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.178+0000 7ff444ff9640 1 -- 172.21.15.55:0/3707826759 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff438017070 con 0x7ff4480af490 2024-04-25T09:54:05.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.178+0000 7ff444ff9640 1 -- 172.21.15.55:0/3707826759 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff438005ce0 con 0x7ff4480af490 2024-04-25T09:54:05.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.178+0000 7ff44e49e640 1 -- 172.21.15.55:0/3707826759 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff44815fe40 con 0x7ff4480af490 2024-04-25T09:54:05.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.178+0000 7ff444ff9640 1 -- 172.21.15.55:0/3707826759 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4380072f0 con 0x7ff4480af490 2024-04-25T09:54:05.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.178+0000 7ff44e49e640 1 -- 172.21.15.55:0/3707826759 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff448160400 con 0x7ff4480af490 2024-04-25T09:54:05.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.178+0000 7ff444ff9640 1 -- 172.21.15.55:0/3707826759 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7ff43801a070 con 0x7ff4480af490 2024-04-25T09:54:05.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.178+0000 7ff444ff9640 1 -- 172.21.15.55:0/3707826759 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7ff438012910 con 0x7ff4480af490 2024-04-25T09:54:05.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.179+0000 7ff44e49e640 1 -- 172.21.15.55:0/3707826759 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff448068f60 con 0x7ff4480af490 2024-04-25T09:54:05.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.181+0000 7ff444ff9640 1 -- 172.21.15.55:0/3707826759 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7ff438021070 con 0x7ff4480af490 2024-04-25T09:54:05.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.254+0000 7ff44e49e640 1 -- 172.21.15.55:0/3707826759 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd new", "uuid": "bce9c9a3-5a5a-47c0-a81e-58811b026611", "id": 4} v 0) v1 -- 0x7ff4480669c0 con 0x7ff4480af490 2024-04-25T09:54:05.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.261+0000 7ff444ff9640 1 -- 172.21.15.55:0/3707826759 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bce9c9a3-5a5a-47c0-a81e-58811b026611", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff438007710 con 0x7ff4480af490 2024-04-25T09:54:05.263 INFO:teuthology.orchestra.run.smithi055.stdout:4 2024-04-25T09:54:05.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.261+0000 7ff44e49e640 1 -- 172.21.15.55:0/3707826759 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4480af490 msgr2=0x7ff44815f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:05.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.262+0000 7ff44e49e640 1 --2- 172.21.15.55:0/3707826759 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4480af490 0x7ff44815f180 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff43800c410 tx=0x7ff43800c8d0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.262+0000 7ff44e49e640 1 -- 172.21.15.55:0/3707826759 shutdown_connections 2024-04-25T09:54:05.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.262+0000 7ff44e49e640 1 --2- 172.21.15.55:0/3707826759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4480cdf00 0x7ff448153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.262+0000 7ff44e49e640 1 --2- 172.21.15.55:0/3707826759 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4480af490 0x7ff44815f180 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.262+0000 7ff44e49e640 1 --2- 172.21.15.55:0/3707826759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff44806b300 0x7ff4480b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.262+0000 7ff44e49e640 1 -- 172.21.15.55:0/3707826759 >> 172.21.15.55:0/3707826759 conn(0x7ff4480cc870 msgr2=0x7ff4480b0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:05.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.262+0000 7ff44e49e640 1 -- 172.21.15.55:0/3707826759 shutdown_connections 2024-04-25T09:54:05.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.262+0000 7ff44e49e640 1 -- 172.21.15.55:0/3707826759 wait complete. 2024-04-25T09:54:05.274 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd new 7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b 5 2024-04-25T09:54:05.283 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-25T09:54:05.281+0000 7f3dc0730040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T09:54:05.332 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-25T09:54:05.330+0000 7f3dc0730040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T09:54:05.340 INFO:tasks.ceph.mgr.x.smithi055.stderr:2024-04-25T09:54:05.339+0000 7f434b920040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T09:54:05.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.372+0000 7f6191c1f640 1 Processor -- start 2024-04-25T09:54:05.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.372+0000 7f6191c1f640 1 -- start start 2024-04-25T09:54:05.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.373+0000 7f6191c1f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f618c06b270 0x7f618c0cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:05.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.373+0000 7f6191c1f640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f618c0cc760 0x7f618c0cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:05.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.373+0000 7f6191c1f640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f618c0caf00 con 0x7f618c15dc60 2024-04-25T09:54:05.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.373+0000 7f6191c1f640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f618c0cb1e0 con 0x7f618c0cc760 2024-04-25T09:54:05.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.373+0000 7f6191c1f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f618c0cb4c0 con 0x7f618c06b270 2024-04-25T09:54:05.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.373+0000 7f618affd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f618c06b270 0x7f618c0cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:05.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.373+0000 7f618affd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f618c06b270 0x7f618c0cbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50744/0 (socket says 172.21.15.55:50744) 2024-04-25T09:54:05.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.373+0000 7f618affd640 1 -- 172.21.15.55:0/978133237 learned_addr learned my addr 172.21.15.55:0/978133237 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:54:05.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.373+0000 7f618bfff640 1 --2- 172.21.15.55:0/978133237 >> v2:172.21.15.7:3300/0 conn(0x7f618c0cc760 0x7f618c0cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:05.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.373+0000 7f618affd640 1 -- 172.21.15.55:0/978133237 >> v2:172.21.15.7:3300/0 conn(0x7f618c0cc760 msgr2=0x7f618c0cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:05.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.373+0000 7f618affd640 1 --2- 172.21.15.55:0/978133237 >> v2:172.21.15.7:3300/0 conn(0x7f618c0cc760 0x7f618c0cf8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.373+0000 7f618affd640 1 -- 172.21.15.55:0/978133237 >> v1:172.21.15.7:6789/0 conn(0x7f618c15dc60 legacy=0x7f618c06ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:05.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.373+0000 7f618affd640 1 -- 172.21.15.55:0/978133237 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618c0cb7a0 con 0x7f618c06b270 2024-04-25T09:54:05.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.374+0000 7f618affd640 1 --2- 172.21.15.55:0/978133237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f618c06b270 0x7f618c0cbfa0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f618c0b64b0 tx=0x7f617402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23f8a42a21e19a56 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:05.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.374+0000 7f618a7fc640 1 -- 172.21.15.55:0/978133237 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6174037070 con 0x7f618c06b270 2024-04-25T09:54:05.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.374+0000 7f618a7fc640 1 -- 172.21.15.55:0/978133237 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6174032440 con 0x7f618c06b270 2024-04-25T09:54:05.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.374+0000 7f618a7fc640 1 -- 172.21.15.55:0/978133237 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6174032810 con 0x7f618c06b270 2024-04-25T09:54:05.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.375+0000 7f6191c1f640 1 -- 172.21.15.55:0/978133237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f618c06b270 msgr2=0x7f618c0cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:05.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.375+0000 7f6191c1f640 1 --2- 172.21.15.55:0/978133237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f618c06b270 0x7f618c0cbfa0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f618c0b64b0 tx=0x7f617402a270 comp rx=0 tx=0).stop 2024-04-25T09:54:05.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.375+0000 7f6191c1f640 1 -- 172.21.15.55:0/978133237 shutdown_connections 2024-04-25T09:54:05.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.375+0000 7f6191c1f640 1 --2- 172.21.15.55:0/978133237 >> v2:172.21.15.7:3300/0 conn(0x7f618c0cc760 0x7f618c0cf8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.375+0000 7f6191c1f640 1 --2- 172.21.15.55:0/978133237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f618c06b270 0x7f618c0cbfa0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.375+0000 7f6191c1f640 1 -- 172.21.15.55:0/978133237 >> 172.21.15.55:0/978133237 conn(0x7f618c0725e0 msgr2=0x7f618c0999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:05.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.375+0000 7f6191c1f640 1 -- 172.21.15.55:0/978133237 shutdown_connections 2024-04-25T09:54:05.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.375+0000 7f6191c1f640 1 -- 172.21.15.55:0/978133237 wait complete. 2024-04-25T09:54:05.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.376+0000 7f6191c1f640 1 Processor -- start 2024-04-25T09:54:05.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.376+0000 7f6191c1f640 1 -- start start 2024-04-25T09:54:05.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.377+0000 7f6191c1f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f618c06b270 0x7f618c0c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:05.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.377+0000 7f6191c1f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f618c0cc760 0x7f618c158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:05.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.377+0000 7f6191c1f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f618c15dc60 0x7f618c0b5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:05.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.377+0000 7f6191c1f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618c0ce150 con 0x7f618c15dc60 2024-04-25T09:54:05.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.377+0000 7f6191c1f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618c0cabd0 con 0x7f618c06b270 2024-04-25T09:54:05.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.377+0000 7f6191c1f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f618c0ce2d0 con 0x7f618c0cc760 2024-04-25T09:54:05.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.377+0000 7f618b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f618c06b270 0x7f618c0c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:05.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.377+0000 7f618affd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f618c0cc760 0x7f618c158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:05.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.377+0000 7f618b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f618c06b270 0x7f618c0c5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50760/0 (socket says 172.21.15.55:50760) 2024-04-25T09:54:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.377+0000 7f618b7fe640 1 -- 172.21.15.55:0/2489843799 learned_addr learned my addr 172.21.15.55:0/2489843799 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:54:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.377+0000 7f618bfff640 1 --2- 172.21.15.55:0/2489843799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f618c15dc60 0x7f618c0b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.378+0000 7f618b7fe640 1 -- 172.21.15.55:0/2489843799 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f618c0cc760 msgr2=0x7f618c158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.378+0000 7f618b7fe640 1 --2- 172.21.15.55:0/2489843799 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f618c0cc760 0x7f618c158530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.378+0000 7f618b7fe640 1 -- 172.21.15.55:0/2489843799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f618c15dc60 msgr2=0x7f618c0b5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.378+0000 7f618b7fe640 1 --2- 172.21.15.55:0/2489843799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f618c15dc60 0x7f618c0b5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.378+0000 7f618b7fe640 1 -- 172.21.15.55:0/2489843799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618c0c6720 con 0x7f618c06b270 2024-04-25T09:54:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.378+0000 7f618affd640 1 --2- 172.21.15.55:0/2489843799 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f618c0cc760 0x7f618c158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:54:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.378+0000 7f618b7fe640 1 --2- 172.21.15.55:0/2489843799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f618c06b270 0x7f618c0c5ff0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f617c00c430 tx=0x7f617c00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.378+0000 7f6183fff640 1 -- 172.21.15.55:0/2489843799 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617c017070 con 0x7f618c06b270 2024-04-25T09:54:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.378+0000 7f6183fff640 1 -- 172.21.15.55:0/2489843799 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617c0052d0 con 0x7f618c06b270 2024-04-25T09:54:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.378+0000 7f6191c1f640 1 -- 172.21.15.55:0/2489843799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f618c0c6a00 con 0x7f618c06b270 2024-04-25T09:54:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.378+0000 7f6183fff640 1 -- 172.21.15.55:0/2489843799 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617c003850 con 0x7f618c06b270 2024-04-25T09:54:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.378+0000 7f6191c1f640 1 -- 172.21.15.55:0/2489843799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f618c0c88d0 con 0x7f618c06b270 2024-04-25T09:54:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.378+0000 7f6183fff640 1 -- 172.21.15.55:0/2489843799 <== mon.1 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f617c01a070 con 0x7f618c06b270 2024-04-25T09:54:05.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.378+0000 7f6183fff640 1 -- 172.21.15.55:0/2489843799 <== mon.1 v2:172.21.15.55:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f617c011b30 con 0x7f618c06b270 2024-04-25T09:54:05.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.379+0000 7f6191c1f640 1 -- 172.21.15.55:0/2489843799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f618c068f60 con 0x7f618c06b270 2024-04-25T09:54:05.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.382+0000 7f6183fff640 1 -- 172.21.15.55:0/2489843799 <== mon.1 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f617c021020 con 0x7f618c06b270 2024-04-25T09:54:05.387 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-25T09:54:05.385+0000 7f3dc0730040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T09:54:05.392 INFO:tasks.ceph.mgr.x.smithi055.stderr:2024-04-25T09:54:05.390+0000 7f434b920040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T09:54:05.447 INFO:tasks.ceph.mgr.x.smithi055.stderr:2024-04-25T09:54:05.445+0000 7f434b920040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T09:54:05.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.455+0000 7f6191c1f640 1 -- 172.21.15.55:0/2489843799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b", "id": 5} v 0) v1 -- 0x7f618c0b6500 con 0x7f618c06b270 2024-04-25T09:54:05.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.460+0000 7f6183fff640 1 -- 172.21.15.55:0/2489843799 <== mon.1 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f617c011e10 con 0x7f618c06b270 2024-04-25T09:54:05.462 INFO:teuthology.orchestra.run.smithi055.stdout:5 2024-04-25T09:54:05.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.462+0000 7f6191c1f640 1 -- 172.21.15.55:0/2489843799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f618c06b270 msgr2=0x7f618c0c5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:05.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.462+0000 7f6191c1f640 1 --2- 172.21.15.55:0/2489843799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f618c06b270 0x7f618c0c5ff0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f617c00c430 tx=0x7f617c00c8f0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.462+0000 7f6191c1f640 1 -- 172.21.15.55:0/2489843799 shutdown_connections 2024-04-25T09:54:05.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.462+0000 7f6191c1f640 1 --2- 172.21.15.55:0/2489843799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f618c15dc60 0x7f618c0b5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.462+0000 7f6191c1f640 1 --2- 172.21.15.55:0/2489843799 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f618c0cc760 0x7f618c158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.462+0000 7f6191c1f640 1 --2- 172.21.15.55:0/2489843799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f618c06b270 0x7f618c0c5ff0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.462+0000 7f6191c1f640 1 -- 172.21.15.55:0/2489843799 >> 172.21.15.55:0/2489843799 conn(0x7f618c0725e0 msgr2=0x7f618c06ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:05.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.462+0000 7f6191c1f640 1 -- 172.21.15.55:0/2489843799 shutdown_connections 2024-04-25T09:54:05.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.462+0000 7f6191c1f640 1 -- 172.21.15.55:0/2489843799 wait complete. 2024-04-25T09:54:05.478 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd new ffe46b85-843e-45bb-a3d8-01ac64d7e3ce 6 2024-04-25T09:54:05.504 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-25T09:54:05.502+0000 7f3dc0730040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T09:54:05.574 INFO:tasks.ceph.mgr.x.smithi055.stderr:2024-04-25T09:54:05.572+0000 7f434b920040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T09:54:05.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.577+0000 7efd7de74640 1 Processor -- start 2024-04-25T09:54:05.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.577+0000 7efd7de74640 1 -- start start 2024-04-25T09:54:05.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.578+0000 7efd7de74640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efd7806bb70 0x7efd7806bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:05.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.578+0000 7efd7de74640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7806c490 con 0x7efd78066980 2024-04-25T09:54:05.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.578+0000 7efd7de74640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7806de10 con 0x7efd7815dcc0 2024-04-25T09:54:05.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.578+0000 7efd7de74640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7806e0f0 con 0x7efd7806bb70 2024-04-25T09:54:05.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.578+0000 7efd777fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efd7806bb70 0x7efd7806bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:05.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.578+0000 7efd76ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7efd7815dcc0 0x7efd780ace10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35610/0 (socket says 172.21.15.55:35610) 2024-04-25T09:54:05.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.578+0000 7efd777fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efd7806bb70 0x7efd7806bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:43578/0 (socket says 172.21.15.55:43578) 2024-04-25T09:54:05.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.578+0000 7efd76ffd640 1 -- 172.21.15.55:0/2872652589 learned_addr learned my addr 172.21.15.55:0/2872652589 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:54:05.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.578+0000 7efd767fc640 1 -- 172.21.15.55:0/2872652589 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2268588451 0 0) 0x7efd7806de10 con 0x7efd7815dcc0 2024-04-25T09:54:05.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.578+0000 7efd777fe640 1 -- 172.21.15.55:0/2872652589 >> v1:172.21.15.55:6789/0 conn(0x7efd7815dcc0 legacy=0x7efd780ace10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:05.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.578+0000 7efd777fe640 1 -- 172.21.15.55:0/2872652589 >> v1:172.21.15.7:6789/0 conn(0x7efd78066980 legacy=0x7efd7806eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:05.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.578+0000 7efd777fe640 1 -- 172.21.15.55:0/2872652589 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7806e3d0 con 0x7efd7806bb70 2024-04-25T09:54:05.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.579+0000 7efd777fe640 1 --2- 172.21.15.55:0/2872652589 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efd7806bb70 0x7efd7806bf50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7efd600097d0 tx=0x7efd6002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a38ddcd45f05063c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:05.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.580+0000 7efd767fc640 1 -- 172.21.15.55:0/2872652589 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60037070 con 0x7efd7806bb70 2024-04-25T09:54:05.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.580+0000 7efd767fc640 1 -- 172.21.15.55:0/2872652589 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6002ad90 con 0x7efd7806bb70 2024-04-25T09:54:05.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.580+0000 7efd767fc640 1 -- 172.21.15.55:0/2872652589 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60032660 con 0x7efd7806bb70 2024-04-25T09:54:05.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.580+0000 7efd7de74640 1 -- 172.21.15.55:0/2872652589 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efd7806bb70 msgr2=0x7efd7806bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:05.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.580+0000 7efd7de74640 1 --2- 172.21.15.55:0/2872652589 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efd7806bb70 0x7efd7806bf50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7efd600097d0 tx=0x7efd6002a100 comp rx=0 tx=0).stop 2024-04-25T09:54:05.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.580+0000 7efd7de74640 1 -- 172.21.15.55:0/2872652589 shutdown_connections 2024-04-25T09:54:05.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.580+0000 7efd7de74640 1 --2- 172.21.15.55:0/2872652589 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efd7806bb70 0x7efd7806bf50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.580+0000 7efd7de74640 1 -- 172.21.15.55:0/2872652589 >> 172.21.15.55:0/2872652589 conn(0x7efd780718e0 msgr2=0x7efd78071cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:05.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.580+0000 7efd7de74640 1 -- 172.21.15.55:0/2872652589 shutdown_connections 2024-04-25T09:54:05.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.580+0000 7efd7de74640 1 -- 172.21.15.55:0/2872652589 wait complete. 2024-04-25T09:54:05.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.581+0000 7efd7de74640 1 Processor -- start 2024-04-25T09:54:05.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.582+0000 7efd7de74640 1 -- start start 2024-04-25T09:54:05.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.582+0000 7efd7de74640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd78066980 0x7efd7814ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:05.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.582+0000 7efd7de74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd7806bb70 0x7efd7814d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:05.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.582+0000 7efd7de74640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efd78160280 0x7efd78160710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:05.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.582+0000 7efd7de74640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd780ad520 con 0x7efd78066980 2024-04-25T09:54:05.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.582+0000 7efd7de74640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7806e990 con 0x7efd7806bb70 2024-04-25T09:54:05.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.582+0000 7efd7de74640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7806f5c0 con 0x7efd78160280 2024-04-25T09:54:05.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.582+0000 7efd76ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd7806bb70 0x7efd7814d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:05.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.582+0000 7efd77fff640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efd78160280 0x7efd78160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:05.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.583+0000 7efd76ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd7806bb70 0x7efd7814d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50776/0 (socket says 172.21.15.55:50776) 2024-04-25T09:54:05.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.583+0000 7efd76ffd640 1 -- 172.21.15.55:0/3766864180 learned_addr learned my addr 172.21.15.55:0/3766864180 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:54:05.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.583+0000 7efd777fe640 1 --2- 172.21.15.55:0/3766864180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd78066980 0x7efd7814ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:05.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.583+0000 7efd77fff640 1 -- 172.21.15.55:0/3766864180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd7806bb70 msgr2=0x7efd7814d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:05.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.583+0000 7efd77fff640 1 --2- 172.21.15.55:0/3766864180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd7806bb70 0x7efd7814d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.583+0000 7efd77fff640 1 -- 172.21.15.55:0/3766864180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd78066980 msgr2=0x7efd7814ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:05.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.583+0000 7efd77fff640 1 --2- 172.21.15.55:0/3766864180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd78066980 0x7efd7814ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.583+0000 7efd77fff640 1 -- 172.21.15.55:0/3766864180 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd781f7ab0 con 0x7efd78160280 2024-04-25T09:54:05.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.583+0000 7efd76ffd640 1 --2- 172.21.15.55:0/3766864180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd7806bb70 0x7efd7814d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:54:05.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.583+0000 7efd77fff640 1 --2- 172.21.15.55:0/3766864180 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efd78160280 0x7efd78160710 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efd70002230 tx=0x7efd7000cc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:05.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.583+0000 7efd6ffff640 1 -- 172.21.15.55:0/3766864180 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd70017070 con 0x7efd78160280 2024-04-25T09:54:05.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.583+0000 7efd6ffff640 1 -- 172.21.15.55:0/3766864180 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd70003da0 con 0x7efd78160280 2024-04-25T09:54:05.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.583+0000 7efd7de74640 1 -- 172.21.15.55:0/3766864180 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd7814f3a0 con 0x7efd78160280 2024-04-25T09:54:05.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.583+0000 7efd6ffff640 1 -- 172.21.15.55:0/3766864180 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd700052b0 con 0x7efd78160280 2024-04-25T09:54:05.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.583+0000 7efd7de74640 1 -- 172.21.15.55:0/3766864180 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd781f7210 con 0x7efd78160280 2024-04-25T09:54:05.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.583+0000 7efd6ffff640 1 -- 172.21.15.55:0/3766864180 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7efd7001a070 con 0x7efd78160280 2024-04-25T09:54:05.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.583+0000 7efd6ffff640 1 -- 172.21.15.55:0/3766864180 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7efd7000acd0 con 0x7efd78160280 2024-04-25T09:54:05.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.585+0000 7efd7de74640 1 -- 172.21.15.55:0/3766864180 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd78068f60 con 0x7efd78160280 2024-04-25T09:54:05.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.587+0000 7efd6ffff640 1 -- 172.21.15.55:0/3766864180 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7efd70021020 con 0x7efd78160280 2024-04-25T09:54:05.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.747+0000 7efd7de74640 1 -- 172.21.15.55:0/3766864180 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ffe46b85-843e-45bb-a3d8-01ac64d7e3ce", "id": 6} v 0) v1 -- 0x7efd780cc6b0 con 0x7efd78160280 2024-04-25T09:54:05.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.755+0000 7efd6ffff640 1 -- 172.21.15.55:0/3766864180 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ffe46b85-843e-45bb-a3d8-01ac64d7e3ce", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7efd7000a770 con 0x7efd78160280 2024-04-25T09:54:05.758 INFO:teuthology.orchestra.run.smithi055.stdout:6 2024-04-25T09:54:05.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.757+0000 7efd7de74640 1 -- 172.21.15.55:0/3766864180 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efd78160280 msgr2=0x7efd78160710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:05.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.757+0000 7efd7de74640 1 --2- 172.21.15.55:0/3766864180 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efd78160280 0x7efd78160710 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efd70002230 tx=0x7efd7000cc50 comp rx=0 tx=0).stop 2024-04-25T09:54:05.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.757+0000 7efd7de74640 1 -- 172.21.15.55:0/3766864180 shutdown_connections 2024-04-25T09:54:05.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.757+0000 7efd7de74640 1 --2- 172.21.15.55:0/3766864180 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efd78160280 0x7efd78160710 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.757+0000 7efd7de74640 1 --2- 172.21.15.55:0/3766864180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd7806bb70 0x7efd7814d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.757+0000 7efd7de74640 1 --2- 172.21.15.55:0/3766864180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd78066980 0x7efd7814ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.757+0000 7efd7de74640 1 -- 172.21.15.55:0/3766864180 >> 172.21.15.55:0/3766864180 conn(0x7efd780718e0 msgr2=0x7efd780ace10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:05.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.757+0000 7efd7de74640 1 -- 172.21.15.55:0/3766864180 shutdown_connections 2024-04-25T09:54:05.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.757+0000 7efd7de74640 1 -- 172.21.15.55:0/3766864180 wait complete. 2024-04-25T09:54:05.773 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd new bdb33bf1-7862-49d3-8cfd-1a74417fb8c1 7 2024-04-25T09:54:05.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.871+0000 7f02a6031640 1 Processor -- start 2024-04-25T09:54:05.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.871+0000 7f02a6031640 1 -- start start 2024-04-25T09:54:05.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.872+0000 7f02a6031640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f02a015a940 0x7f02a00cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:05.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.872+0000 7f02a6031640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f02a015f040 0x7f02a00b2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:05.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.872+0000 7f02a6031640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a015ad20 con 0x7f02a00ccfd0 2024-04-25T09:54:05.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.872+0000 7f02a6031640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a00cb0d0 con 0x7f02a015f040 2024-04-25T09:54:05.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.872+0000 7f02a6031640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a00b3030 con 0x7f02a015a940 2024-04-25T09:54:05.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.872+0000 7f029f7fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f02a015a940 0x7f02a00cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:05.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.872+0000 7f029ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f02a00ccfd0 0x7f02a006e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44780/0 (socket says 172.21.15.55:44780) 2024-04-25T09:54:05.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.872+0000 7f029ffff640 1 -- 172.21.15.55:0/3178199456 learned_addr learned my addr 172.21.15.55:0/3178199456 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-25T09:54:05.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.872+0000 7f029effd640 1 --2- 172.21.15.55:0/3178199456 >> v2:172.21.15.7:3300/0 conn(0x7f02a015f040 0x7f02a00b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:05.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.873+0000 7f029e7fc640 1 -- 172.21.15.55:0/3178199456 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2372547997 0 0) 0x7f02a015ad20 con 0x7f02a00ccfd0 2024-04-25T09:54:05.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.873+0000 7f029e7fc640 1 -- 172.21.15.55:0/3178199456 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f028c003520 con 0x7f02a00ccfd0 2024-04-25T09:54:05.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.873+0000 7f029f7fe640 1 -- 172.21.15.55:0/3178199456 >> v2:172.21.15.7:3300/0 conn(0x7f02a015f040 msgr2=0x7f02a00b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:05.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.873+0000 7f029f7fe640 1 --2- 172.21.15.55:0/3178199456 >> v2:172.21.15.7:3300/0 conn(0x7f02a015f040 0x7f02a00b2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.873+0000 7f029f7fe640 1 -- 172.21.15.55:0/3178199456 >> v1:172.21.15.55:6789/0 conn(0x7f02a00ccfd0 legacy=0x7f02a006e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:05.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.873+0000 7f029f7fe640 1 -- 172.21.15.55:0/3178199456 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a00cb300 con 0x7f02a015a940 2024-04-25T09:54:05.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.873+0000 7f029f7fe640 1 --2- 172.21.15.55:0/3178199456 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f02a015a940 0x7f02a00cc0c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f02880097a0 tx=0x7f028802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=821ad73b57e7b90d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:05.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.874+0000 7f029e7fc640 1 -- 172.21.15.55:0/3178199456 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0288037070 con 0x7f02a015a940 2024-04-25T09:54:05.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.874+0000 7f029e7fc640 1 -- 172.21.15.55:0/3178199456 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028802ae50 con 0x7f02a015a940 2024-04-25T09:54:05.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.874+0000 7f029e7fc640 1 -- 172.21.15.55:0/3178199456 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0288032660 con 0x7f02a015a940 2024-04-25T09:54:05.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.874+0000 7f02a6031640 1 -- 172.21.15.55:0/3178199456 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f02a015a940 msgr2=0x7f02a00cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:05.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.874+0000 7f02a6031640 1 --2- 172.21.15.55:0/3178199456 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f02a015a940 0x7f02a00cc0c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f02880097a0 tx=0x7f028802a100 comp rx=0 tx=0).stop 2024-04-25T09:54:05.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.874+0000 7f02a6031640 1 -- 172.21.15.55:0/3178199456 shutdown_connections 2024-04-25T09:54:05.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.874+0000 7f02a6031640 1 --2- 172.21.15.55:0/3178199456 >> v2:172.21.15.7:3300/0 conn(0x7f02a015f040 0x7f02a00b2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.874+0000 7f02a6031640 1 --2- 172.21.15.55:0/3178199456 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f02a015a940 0x7f02a00cc0c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.874+0000 7f02a6031640 1 -- 172.21.15.55:0/3178199456 >> 172.21.15.55:0/3178199456 conn(0x7f02a00999f0 msgr2=0x7f02a00b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:05.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.874+0000 7f02a6031640 1 -- 172.21.15.55:0/3178199456 shutdown_connections 2024-04-25T09:54:05.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.874+0000 7f02a6031640 1 -- 172.21.15.55:0/3178199456 wait complete. 2024-04-25T09:54:05.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.875+0000 7f02a6031640 1 Processor -- start 2024-04-25T09:54:05.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.876+0000 7f02a6031640 1 -- start start 2024-04-25T09:54:05.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.876+0000 7f02a6031640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02a00ccfd0 0x7f02a015c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:05.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.876+0000 7f02a6031640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02a015a940 0x7f02a00c3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:05.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.876+0000 7f02a6031640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f02a015f040 0x7f02a00c7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:05.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.876+0000 7f02a6031640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a00cbba0 con 0x7f02a015a940 2024-04-25T09:54:05.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.876+0000 7f02a6031640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a00cb8c0 con 0x7f02a00ccfd0 2024-04-25T09:54:05.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.876+0000 7f02a6031640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a00b2d40 con 0x7f02a015f040 2024-04-25T09:54:05.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.877+0000 7f029f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02a00ccfd0 0x7f02a015c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:05.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.877+0000 7f029ffff640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f02a015f040 0x7f02a00c7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:05.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.877+0000 7f029f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02a00ccfd0 0x7f02a015c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44436/0 (socket says 172.21.15.55:44436) 2024-04-25T09:54:05.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.877+0000 7f029f7fe640 1 -- 172.21.15.55:0/3472222288 learned_addr learned my addr 172.21.15.55:0/3472222288 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-25T09:54:05.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.877+0000 7f029effd640 1 --2- 172.21.15.55:0/3472222288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02a015a940 0x7f02a00c3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:05.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.877+0000 7f029ffff640 1 -- 172.21.15.55:0/3472222288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02a00ccfd0 msgr2=0x7f02a015c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:05.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.877+0000 7f029ffff640 1 --2- 172.21.15.55:0/3472222288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02a00ccfd0 0x7f02a015c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.877+0000 7f029ffff640 1 -- 172.21.15.55:0/3472222288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02a015a940 msgr2=0x7f02a00c3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:05.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.877+0000 7f029ffff640 1 --2- 172.21.15.55:0/3472222288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02a015a940 0x7f02a00c3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.877+0000 7f029ffff640 1 -- 172.21.15.55:0/3472222288 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a00c7bd0 con 0x7f02a015f040 2024-04-25T09:54:05.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.877+0000 7f029ffff640 1 --2- 172.21.15.55:0/3472222288 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f02a015f040 0x7f02a00c7690 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f029800cad0 tx=0x7f029800ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:05.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.877+0000 7f0297fff640 1 -- 172.21.15.55:0/3472222288 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0298017070 con 0x7f02a015f040 2024-04-25T09:54:05.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.877+0000 7f0297fff640 1 -- 172.21.15.55:0/3472222288 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029800ab70 con 0x7f02a015f040 2024-04-25T09:54:05.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.877+0000 7f02a6031640 1 -- 172.21.15.55:0/3472222288 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a0158120 con 0x7f02a015f040 2024-04-25T09:54:05.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.877+0000 7f0297fff640 1 -- 172.21.15.55:0/3472222288 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0298012400 con 0x7f02a015f040 2024-04-25T09:54:05.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.877+0000 7f02a6031640 1 -- 172.21.15.55:0/3472222288 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a00ad900 con 0x7f02a015f040 2024-04-25T09:54:05.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.877+0000 7f0297fff640 1 -- 172.21.15.55:0/3472222288 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f029801a070 con 0x7f02a015f040 2024-04-25T09:54:05.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.877+0000 7f0297fff640 1 -- 172.21.15.55:0/3472222288 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f029801cdc0 con 0x7f02a015f040 2024-04-25T09:54:05.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.878+0000 7f02a6031640 1 -- 172.21.15.55:0/3472222288 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a0068f60 con 0x7f02a015f040 2024-04-25T09:54:05.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.882+0000 7f0297fff640 1 -- 172.21.15.55:0/3472222288 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f029801c760 con 0x7f02a015f040 2024-04-25T09:54:05.902 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-25T09:54:05.900+0000 7f3dc0730040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T09:54:05.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.956+0000 7f02a6031640 1 -- 172.21.15.55:0/3472222288 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd new", "uuid": "bdb33bf1-7862-49d3-8cfd-1a74417fb8c1", "id": 7} v 0) v1 -- 0x7f02a00ccb40 con 0x7f02a015f040 2024-04-25T09:54:05.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.964+0000 7f0297fff640 1 -- 172.21.15.55:0/3472222288 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bdb33bf1-7862-49d3-8cfd-1a74417fb8c1", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f029801ca10 con 0x7f02a015f040 2024-04-25T09:54:05.966 INFO:teuthology.orchestra.run.smithi055.stdout:7 2024-04-25T09:54:05.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.965+0000 7f02a6031640 1 -- 172.21.15.55:0/3472222288 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f02a015f040 msgr2=0x7f02a00c7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:05.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.965+0000 7f02a6031640 1 --2- 172.21.15.55:0/3472222288 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f02a015f040 0x7f02a00c7690 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f029800cad0 tx=0x7f029800ced0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.965+0000 7f02a6031640 1 -- 172.21.15.55:0/3472222288 shutdown_connections 2024-04-25T09:54:05.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.965+0000 7f02a6031640 1 --2- 172.21.15.55:0/3472222288 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f02a015f040 0x7f02a00c7690 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.965+0000 7f02a6031640 1 --2- 172.21.15.55:0/3472222288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02a015a940 0x7f02a00c3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.965+0000 7f02a6031640 1 --2- 172.21.15.55:0/3472222288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02a00ccfd0 0x7f02a015c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:05.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.965+0000 7f02a6031640 1 -- 172.21.15.55:0/3472222288 >> 172.21.15.55:0/3472222288 conn(0x7f02a00999f0 msgr2=0x7f02a00af7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:05.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.965+0000 7f02a6031640 1 -- 172.21.15.55:0/3472222288 shutdown_connections 2024-04-25T09:54:05.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-25T09:54:05.965+0000 7f02a6031640 1 -- 172.21.15.55:0/3472222288 wait complete. 2024-04-25T09:54:05.977 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T09:54:05.978 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T09:54:05.980 INFO:tasks.ceph.osd.0:Started 2024-04-25T09:54:05.980 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T09:54:05.980 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T09:54:05.982 INFO:tasks.ceph.osd.1:Started 2024-04-25T09:54:05.982 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T09:54:05.983 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T09:54:05.985 INFO:tasks.ceph.osd.2:Started 2024-04-25T09:54:05.985 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T09:54:05.985 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-25T09:54:05.987 INFO:tasks.ceph.osd.3:Started 2024-04-25T09:54:05.987 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-25T09:54:05.987 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-25T09:54:05.989 INFO:tasks.ceph.osd.4:Started 2024-04-25T09:54:05.990 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-25T09:54:05.990 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-25T09:54:05.992 INFO:tasks.ceph.osd.5:Started 2024-04-25T09:54:05.992 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-25T09:54:05.992 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-25T09:54:05.994 INFO:tasks.ceph.osd.6:Started 2024-04-25T09:54:05.994 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-25T09:54:05.994 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-25T09:54:05.996 INFO:tasks.ceph.osd.7:Started 2024-04-25T09:54:05.997 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:54:06.088 INFO:tasks.ceph.mgr.x.smithi055.stderr:2024-04-25T09:54:06.086+0000 7f434b920040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T09:54:06.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.131+0000 7f7a2a2f5640 1 Processor -- start 2024-04-25T09:54:06.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.131+0000 7f7a2a2f5640 1 -- start start 2024-04-25T09:54:06.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.132+0000 7f7a2a2f5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7a24066ee0 0x7f7a240ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:06.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.132+0000 7f7a2a2f5640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a2406c510 con 0x7f7a2406c130 2024-04-25T09:54:06.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.132+0000 7f7a2a2f5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a2415e170 con 0x7f7a240ce910 2024-04-25T09:54:06.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.132+0000 7f7a2a2f5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a240ce0d0 con 0x7f7a24066ee0 2024-04-25T09:54:06.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.132+0000 7f7a23fff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7a2406c130 0x7f7a240cd9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42260/0 (socket says 172.21.15.7:42260) 2024-04-25T09:54:06.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.132+0000 7f7a23fff640 1 -- 172.21.15.7:0/320321890 learned_addr learned my addr 172.21.15.7:0/320321890 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:06.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.133+0000 7f7a237fe640 1 --2- 172.21.15.7:0/320321890 >> v2:172.21.15.55:3300/0 conn(0x7f7a24066ee0 0x7f7a240ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:06.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.133+0000 7f7a22ffd640 1 -- 172.21.15.7:0/320321890 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188566640 0 0) 0x7f7a2406c510 con 0x7f7a2406c130 2024-04-25T09:54:06.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.133+0000 7f7a22ffd640 1 -- 172.21.15.7:0/320321890 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a10003520 con 0x7f7a2406c130 2024-04-25T09:54:06.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.133+0000 7f7a237fe640 1 -- 172.21.15.7:0/320321890 >> v1:172.21.15.55:6789/0 conn(0x7f7a240ce910 legacy=0x7f7a240ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:06.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.133+0000 7f7a237fe640 1 -- 172.21.15.7:0/320321890 >> v1:172.21.15.7:6789/0 conn(0x7f7a2406c130 legacy=0x7f7a240cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:06.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.133+0000 7f7a237fe640 1 -- 172.21.15.7:0/320321890 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2415e450 con 0x7f7a24066ee0 2024-04-25T09:54:06.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.134+0000 7f7a237fe640 1 --2- 172.21.15.7:0/320321890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a24066ee0 0x7f7a240ce3d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7a140097a0 tx=0x7f7a1402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4231d0be2038db6b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:06.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.134+0000 7f7a22ffd640 1 -- 172.21.15.7:0/320321890 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14037070 con 0x7f7a24066ee0 2024-04-25T09:54:06.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.134+0000 7f7a22ffd640 1 -- 172.21.15.7:0/320321890 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a14032440 con 0x7f7a24066ee0 2024-04-25T09:54:06.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.134+0000 7f7a22ffd640 1 -- 172.21.15.7:0/320321890 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a140327f0 con 0x7f7a24066ee0 2024-04-25T09:54:06.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.134+0000 7f7a2a2f5640 1 -- 172.21.15.7:0/320321890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a24066ee0 msgr2=0x7f7a240ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:06.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.134+0000 7f7a2a2f5640 1 --2- 172.21.15.7:0/320321890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a24066ee0 0x7f7a240ce3d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7a140097a0 tx=0x7f7a1402a1a0 comp rx=0 tx=0).stop 2024-04-25T09:54:06.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.134+0000 7f7a2a2f5640 1 -- 172.21.15.7:0/320321890 shutdown_connections 2024-04-25T09:54:06.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.134+0000 7f7a2a2f5640 1 --2- 172.21.15.7:0/320321890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a24066ee0 0x7f7a240ce3d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:06.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.134+0000 7f7a2a2f5640 1 -- 172.21.15.7:0/320321890 >> 172.21.15.7:0/320321890 conn(0x7f7a24071ac0 msgr2=0x7f7a24071ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:06.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.134+0000 7f7a2a2f5640 1 -- 172.21.15.7:0/320321890 shutdown_connections 2024-04-25T09:54:06.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.134+0000 7f7a2a2f5640 1 -- 172.21.15.7:0/320321890 wait complete. 2024-04-25T09:54:06.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.136+0000 7f7a2a2f5640 1 Processor -- start 2024-04-25T09:54:06.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.136+0000 7f7a2a2f5640 1 -- start start 2024-04-25T09:54:06.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.136+0000 7f7a2a2f5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a24066ee0 0x7f7a24154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:06.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.136+0000 7f7a2a2f5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7a2406c130 0x7f7a240b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:06.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.136+0000 7f7a2a2f5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a240ce910 0x7f7a241f47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:06.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.136+0000 7f7a2a2f5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a240cac50 con 0x7f7a240ce910 2024-04-25T09:54:06.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.136+0000 7f7a2a2f5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2415ea10 con 0x7f7a24066ee0 2024-04-25T09:54:06.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.136+0000 7f7a2a2f5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a240cadd0 con 0x7f7a2406c130 2024-04-25T09:54:06.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.137+0000 7f7a28892640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a240ce910 0x7f7a241f47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:06.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.137+0000 7f7a28892640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a240ce910 0x7f7a241f47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51238/0 (socket says 172.21.15.7:51238) 2024-04-25T09:54:06.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.137+0000 7f7a28892640 1 -- 172.21.15.7:0/164718022 learned_addr learned my addr 172.21.15.7:0/164718022 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:06.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.137+0000 7f7a23fff640 1 --2- 172.21.15.7:0/164718022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a24066ee0 0x7f7a24154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.137+0000 7f7a237fe640 1 --2- 172.21.15.7:0/164718022 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7a2406c130 0x7f7a240b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.137+0000 7f7a28892640 1 -- 172.21.15.7:0/164718022 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7a2406c130 msgr2=0x7f7a240b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.137+0000 7f7a28892640 1 --2- 172.21.15.7:0/164718022 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7a2406c130 0x7f7a240b4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.137+0000 7f7a28892640 1 -- 172.21.15.7:0/164718022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a24066ee0 msgr2=0x7f7a24154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.137+0000 7f7a28892640 1 --2- 172.21.15.7:0/164718022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a24066ee0 0x7f7a24154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.137+0000 7f7a28892640 1 -- 172.21.15.7:0/164718022 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a24155220 con 0x7f7a240ce910 2024-04-25T09:54:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.137+0000 7f7a23fff640 1 --2- 172.21.15.7:0/164718022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a24066ee0 0x7f7a24154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:54:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.137+0000 7f7a28892640 1 --2- 172.21.15.7:0/164718022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a240ce910 0x7f7a241f47a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c00c6b0 tx=0x7f7a1c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.137+0000 7f7a20ff9640 1 -- 172.21.15.7:0/164718022 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c003b70 con 0x7f7a240ce910 2024-04-25T09:54:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.137+0000 7f7a20ff9640 1 -- 172.21.15.7:0/164718022 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1c003d30 con 0x7f7a240ce910 2024-04-25T09:54:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.137+0000 7f7a2a2f5640 1 -- 172.21.15.7:0/164718022 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a24155500 con 0x7f7a240ce910 2024-04-25T09:54:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.137+0000 7f7a20ff9640 1 -- 172.21.15.7:0/164718022 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c005310 con 0x7f7a240ce910 2024-04-25T09:54:06.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.137+0000 7f7a2a2f5640 1 -- 172.21.15.7:0/164718022 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a24155ac0 con 0x7f7a240ce910 2024-04-25T09:54:06.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.138+0000 7f7a20ff9640 1 -- 172.21.15.7:0/164718022 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f7a1c0054b0 con 0x7f7a240ce910 2024-04-25T09:54:06.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.138+0000 7f7a20ff9640 1 -- 172.21.15.7:0/164718022 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f7a1c012be0 con 0x7f7a240ce910 2024-04-25T09:54:06.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.138+0000 7f7a2a2f5640 1 -- 172.21.15.7:0/164718022 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a240cfb40 con 0x7f7a240ce910 2024-04-25T09:54:06.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.141+0000 7f7a20ff9640 1 -- 172.21.15.7:0/164718022 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f7a240cfb40 con 0x7f7a240ce910 2024-04-25T09:54:06.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.203+0000 7f7a2a2f5640 1 -- 172.21.15.7:0/164718022 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a24068fd0 con 0x7f7a240ce910 2024-04-25T09:54:06.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.203+0000 7f7a20ff9640 1 -- 172.21.15.7:0/164718022 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f7a1c012510 con 0x7f7a240ce910 2024-04-25T09:54:06.206 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:06.206 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":10,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:54:05.957440+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:54:06.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.204+0000 7f7a2a2f5640 1 -- 172.21.15.7:0/164718022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a240ce910 msgr2=0x7f7a241f47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:06.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.204+0000 7f7a2a2f5640 1 --2- 172.21.15.7:0/164718022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a240ce910 0x7f7a241f47a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c00c6b0 tx=0x7f7a1c00cb70 comp rx=0 tx=0).stop 2024-04-25T09:54:06.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.204+0000 7f7a2a2f5640 1 -- 172.21.15.7:0/164718022 shutdown_connections 2024-04-25T09:54:06.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.204+0000 7f7a2a2f5640 1 --2- 172.21.15.7:0/164718022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a240ce910 0x7f7a241f47a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:06.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.204+0000 7f7a2a2f5640 1 --2- 172.21.15.7:0/164718022 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7a2406c130 0x7f7a240b4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:06.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.204+0000 7f7a2a2f5640 1 --2- 172.21.15.7:0/164718022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a24066ee0 0x7f7a24154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:06.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.204+0000 7f7a2a2f5640 1 -- 172.21.15.7:0/164718022 >> 172.21.15.7:0/164718022 conn(0x7f7a24071ac0 msgr2=0x7f7a24160270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:06.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.204+0000 7f7a2a2f5640 1 -- 172.21.15.7:0/164718022 shutdown_connections 2024-04-25T09:54:06.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:06.204+0000 7f7a2a2f5640 1 -- 172.21.15.7:0/164718022 wait complete. 2024-04-25T09:54:06.217 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T09:54:06.217 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T09:54:06.220 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-25T09:54:06.218+0000 7f3dc0730040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T09:54:06.276 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-25T09:54:06.273+0000 7f3dc0730040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T09:54:06.357 INFO:tasks.ceph.mgr.x.smithi055.stderr:2024-04-25T09:54:06.355+0000 7f434b920040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T09:54:06.396 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-25T09:54:06.394+0000 7f3dc0730040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T09:54:06.411 INFO:tasks.ceph.mgr.x.smithi055.stderr:2024-04-25T09:54:06.409+0000 7f434b920040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T09:54:06.531 INFO:tasks.ceph.mgr.x.smithi055.stderr:2024-04-25T09:54:06.530+0000 7f434b920040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T09:54:06.594 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-04-25T09:54:06.591+0000 7f3869430640 -1 Falling back to public interface 2024-04-25T09:54:06.594 INFO:tasks.ceph.osd.5.smithi055.stderr:2024-04-25T09:54:06.592+0000 7f1c16c0f640 -1 Falling back to public interface 2024-04-25T09:54:06.595 INFO:tasks.ceph.osd.4.smithi055.stderr:2024-04-25T09:54:06.593+0000 7f075f216640 -1 Falling back to public interface 2024-04-25T09:54:06.602 INFO:tasks.ceph.osd.7.smithi055.stderr:2024-04-25T09:54:06.600+0000 7f709d02c640 -1 Falling back to public interface 2024-04-25T09:54:06.604 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-04-25T09:54:06.602+0000 7f991ba82640 -1 Falling back to public interface 2024-04-25T09:54:06.613 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-04-25T09:54:06.611+0000 7fc215a63640 -1 Falling back to public interface 2024-04-25T09:54:06.616 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-04-25T09:54:06.614+0000 7f4b94b40640 -1 Falling back to public interface 2024-04-25T09:54:06.619 INFO:tasks.ceph.osd.6.smithi055.stderr:2024-04-25T09:54:06.617+0000 7f63171c0640 -1 Falling back to public interface 2024-04-25T09:54:06.692 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-25T09:54:06.690+0000 7f3dc0730040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T09:54:06.742 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-25T09:54:06.739+0000 7f3dc0730040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T09:54:06.824 INFO:tasks.ceph.mgr.x.smithi055.stderr:2024-04-25T09:54:06.822+0000 7f434b920040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T09:54:06.874 INFO:tasks.ceph.mgr.x.smithi055.stderr:2024-04-25T09:54:06.872+0000 7f434b920040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T09:54:06.905 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-25T09:54:06.903+0000 7f3dc0730040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T09:54:07.023 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T09:54:07.036 INFO:tasks.ceph.mgr.x.smithi055.stderr:2024-04-25T09:54:07.035+0000 7f434b920040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T09:54:07.049 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-25T09:54:07.047+0000 7f3dc0730040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T09:54:07.101 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-25T09:54:07.099+0000 7f3dc0730040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T09:54:07.116 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.114+0000 7f385ef6a640 1 Processor -- start 2024-04-25T09:54:07.116 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.114+0000 7f385ef6a640 1 -- start start 2024-04-25T09:54:07.117 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.114+0000 7f385ef6a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f38580b2c80 0x7f385806c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:07.117 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.114+0000 7f385ef6a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f385809a0b0 0x7f38580cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:07.118 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.114+0000 7f385ef6a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38580b3060 con 0x7f385806cbc0 2024-04-25T09:54:07.118 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.114+0000 7f385ef6a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38581617e0 con 0x7f385809a0b0 2024-04-25T09:54:07.118 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.114+0000 7f385ef6a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38580cfb30 con 0x7f38580b2c80 2024-04-25T09:54:07.118 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.115+0000 7f385cd06640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f38580b2c80 0x7f385806c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:07.118 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.115+0000 7f385cd06640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f38580b2c80 0x7f385806c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:49272/0 (socket says 172.21.15.7:49272) 2024-04-25T09:54:07.118 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.115+0000 7f385cd06640 1 -- 172.21.15.7:0/38941326 learned_addr learned my addr 172.21.15.7:0/38941326 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:07.118 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.115+0000 7f385d507640 1 --2- 172.21.15.7:0/38941326 >> v2:172.21.15.55:3300/0 conn(0x7f385809a0b0 0x7f38580cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:07.118 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.115+0000 7f385cd06640 1 -- 172.21.15.7:0/38941326 >> v2:172.21.15.55:3300/0 conn(0x7f385809a0b0 msgr2=0x7f38580cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:07.118 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.115+0000 7f385cd06640 1 --2- 172.21.15.7:0/38941326 >> v2:172.21.15.55:3300/0 conn(0x7f385809a0b0 0x7f38580cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:07.118 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.115+0000 7f385cd06640 1 -- 172.21.15.7:0/38941326 >> v1:172.21.15.55:6789/0 conn(0x7f385806cbc0 legacy=0x7f38580999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:07.118 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.115+0000 7f385cd06640 1 -- 172.21.15.7:0/38941326 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38580cfe10 con 0x7f38580b2c80 2024-04-25T09:54:07.118 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.115+0000 7f385d507640 1 --2- 172.21.15.7:0/38941326 >> v2:172.21.15.55:3300/0 conn(0x7f385809a0b0 0x7f38580cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:54:07.120 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.116+0000 7f385cd06640 1 --2- 172.21.15.7:0/38941326 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f38580b2c80 0x7f385806c680 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f384c009870 tx=0x7f384c02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47dad12bbe4b0960 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:07.120 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.116+0000 7f38577fe640 1 -- 172.21.15.7:0/38941326 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384c037070 con 0x7f38580b2c80 2024-04-25T09:54:07.120 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.116+0000 7f38577fe640 1 -- 172.21.15.7:0/38941326 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384c032440 con 0x7f38580b2c80 2024-04-25T09:54:07.120 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.116+0000 7f38577fe640 1 -- 172.21.15.7:0/38941326 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384c032810 con 0x7f38580b2c80 2024-04-25T09:54:07.120 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.117+0000 7f385ef6a640 1 -- 172.21.15.7:0/38941326 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f38580b2c80 msgr2=0x7f385806c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:07.120 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.117+0000 7f385ef6a640 1 --2- 172.21.15.7:0/38941326 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f38580b2c80 0x7f385806c680 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f384c009870 tx=0x7f384c02a270 comp rx=0 tx=0).stop 2024-04-25T09:54:07.120 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.117+0000 7f385ef6a640 1 -- 172.21.15.7:0/38941326 shutdown_connections 2024-04-25T09:54:07.120 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.117+0000 7f385ef6a640 1 --2- 172.21.15.7:0/38941326 >> v2:172.21.15.55:3300/0 conn(0x7f385809a0b0 0x7f38580cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:07.120 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.117+0000 7f385ef6a640 1 --2- 172.21.15.7:0/38941326 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f38580b2c80 0x7f385806c680 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:07.120 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.117+0000 7f385ef6a640 1 -- 172.21.15.7:0/38941326 >> 172.21.15.7:0/38941326 conn(0x7f38580b3260 msgr2=0x7f38580b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:07.121 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.117+0000 7f385ef6a640 1 -- 172.21.15.7:0/38941326 shutdown_connections 2024-04-25T09:54:07.121 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.117+0000 7f385ef6a640 1 -- 172.21.15.7:0/38941326 wait complete. 2024-04-25T09:54:07.123 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.118+0000 7f385ef6a640 1 Processor -- start 2024-04-25T09:54:07.123 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.118+0000 7f385ef6a640 1 -- start start 2024-04-25T09:54:07.123 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.119+0000 7f385ef6a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f385806cbc0 0x7f38580c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:07.123 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.119+0000 7f385ef6a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f385809a0b0 0x7f385815afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:07.123 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.119+0000 7f385ef6a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f38580b2c80 0x7f38580c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:07.124 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.119+0000 7f385ef6a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38580d06b0 con 0x7f385806cbc0 2024-04-25T09:54:07.124 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.119+0000 7f385ef6a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38580d03d0 con 0x7f385809a0b0 2024-04-25T09:54:07.124 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.119+0000 7f385ef6a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f385809a9a0 con 0x7f38580b2c80 2024-04-25T09:54:07.124 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.119+0000 7f385cd06640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f385806cbc0 0x7f38580c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:07.124 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.119+0000 7f385cd06640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f385806cbc0 0x7f38580c9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51246/0 (socket says 172.21.15.7:51246) 2024-04-25T09:54:07.124 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.119+0000 7f385cd06640 1 -- 172.21.15.7:0/1433920318 learned_addr learned my addr 172.21.15.7:0/1433920318 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:07.124 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.119+0000 7f385d507640 1 --2- 172.21.15.7:0/1433920318 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f38580b2c80 0x7f38580c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:07.124 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.119+0000 7f3857fff640 1 --2- 172.21.15.7:0/1433920318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f385809a0b0 0x7f385815afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:07.124 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.119+0000 7f385cd06640 1 -- 172.21.15.7:0/1433920318 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f38580b2c80 msgr2=0x7f38580c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:07.124 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.119+0000 7f385cd06640 1 --2- 172.21.15.7:0/1433920318 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f38580b2c80 0x7f38580c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:07.124 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.119+0000 7f385cd06640 1 -- 172.21.15.7:0/1433920318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f385809a0b0 msgr2=0x7f385815afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:07.124 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.119+0000 7f385cd06640 1 --2- 172.21.15.7:0/1433920318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f385809a0b0 0x7f385815afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:07.124 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.119+0000 7f385cd06640 1 -- 172.21.15.7:0/1433920318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38580ca100 con 0x7f385806cbc0 2024-04-25T09:54:07.124 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.119+0000 7f385d507640 1 --2- 172.21.15.7:0/1433920318 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f38580b2c80 0x7f38580c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:54:07.124 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.120+0000 7f385cd06640 1 --2- 172.21.15.7:0/1433920318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f385806cbc0 0x7f38580c9bc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f384c0090b0 tx=0x7f384c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:07.125 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.120+0000 7f38557fa640 1 -- 172.21.15.7:0/1433920318 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384c041030 con 0x7f385806cbc0 2024-04-25T09:54:07.125 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.120+0000 7f38557fa640 1 -- 172.21.15.7:0/1433920318 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384c030440 con 0x7f385806cbc0 2024-04-25T09:54:07.125 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.120+0000 7f385ef6a640 1 -- 172.21.15.7:0/1433920318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38580c8840 con 0x7f385806cbc0 2024-04-25T09:54:07.125 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.120+0000 7f38557fa640 1 -- 172.21.15.7:0/1433920318 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384c037040 con 0x7f385806cbc0 2024-04-25T09:54:07.125 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.120+0000 7f385ef6a640 1 -- 172.21.15.7:0/1433920318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38580c8e00 con 0x7f385806cbc0 2024-04-25T09:54:07.125 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.120+0000 7f38557fa640 1 -- 172.21.15.7:0/1433920318 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f384c044070 con 0x7f385806cbc0 2024-04-25T09:54:07.125 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.120+0000 7f38557fa640 1 -- 172.21.15.7:0/1433920318 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f384c03dcd0 con 0x7f385806cbc0 2024-04-25T09:54:07.125 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.121+0000 7f385ef6a640 1 -- 172.21.15.7:0/1433920318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f385804ef20 con 0x7f385806cbc0 2024-04-25T09:54:07.126 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.123+0000 7f38557fa640 1 -- 172.21.15.7:0/1433920318 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f384c04b070 con 0x7f385806cbc0 2024-04-25T09:54:07.177 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-25T09:54:07.175+0000 7f3dc0730040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T09:54:07.180 INFO:tasks.ceph.mgr.x.smithi055.stderr:2024-04-25T09:54:07.178+0000 7f434b920040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T09:54:07.187 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.185+0000 7f385ef6a640 1 -- 172.21.15.7:0/1433920318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38580b3f60 con 0x7f385806cbc0 2024-04-25T09:54:07.188 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.186+0000 7f38557fa640 1 -- 172.21.15.7:0/1433920318 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f384c03d600 con 0x7f385806cbc0 2024-04-25T09:54:07.188 INFO:teuthology.misc.health.smithi007.stdout: 2024-04-25T09:54:07.188 INFO:teuthology.misc.health.smithi007.stdout:{"epoch":10,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:54:05.957440+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:54:07.189 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.187+0000 7f385ef6a640 1 -- 172.21.15.7:0/1433920318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f385806cbc0 msgr2=0x7f38580c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:07.189 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.187+0000 7f385ef6a640 1 --2- 172.21.15.7:0/1433920318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f385806cbc0 0x7f38580c9bc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f384c0090b0 tx=0x7f384c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:54:07.189 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.187+0000 7f385ef6a640 1 -- 172.21.15.7:0/1433920318 shutdown_connections 2024-04-25T09:54:07.189 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.187+0000 7f385ef6a640 1 --2- 172.21.15.7:0/1433920318 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f38580b2c80 0x7f38580c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:07.190 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.187+0000 7f385ef6a640 1 --2- 172.21.15.7:0/1433920318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f385809a0b0 0x7f385815afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:07.190 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.187+0000 7f385ef6a640 1 --2- 172.21.15.7:0/1433920318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f385806cbc0 0x7f38580c9bc0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:07.190 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.187+0000 7f385ef6a640 1 -- 172.21.15.7:0/1433920318 >> 172.21.15.7:0/1433920318 conn(0x7f38580b3260 msgr2=0x7f38580737a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:07.190 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.187+0000 7f385ef6a640 1 -- 172.21.15.7:0/1433920318 shutdown_connections 2024-04-25T09:54:07.190 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:07.187+0000 7f385ef6a640 1 -- 172.21.15.7:0/1433920318 wait complete. 2024-04-25T09:54:07.198 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T09:54:07.226 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-25T09:54:07.224+0000 7f3dc0730040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T09:54:07.233 INFO:tasks.ceph.mgr.x.smithi055.stderr:2024-04-25T09:54:07.230+0000 7f434b920040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T09:54:07.306 INFO:tasks.ceph.mgr.x.smithi055.stderr:2024-04-25T09:54:07.304+0000 7f434b920040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T09:54:07.353 INFO:tasks.ceph.mgr.x.smithi055.stderr:2024-04-25T09:54:07.351+0000 7f434b920040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T09:54:07.725 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-25T09:54:07.723+0000 7f3dc0730040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T09:54:07.844 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-25T09:54:07.842+0000 7f3dc0730040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T09:54:07.850 INFO:tasks.ceph.mgr.x.smithi055.stderr:2024-04-25T09:54:07.848+0000 7f434b920040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T09:54:07.972 INFO:tasks.ceph.mgr.x.smithi055.stderr:2024-04-25T09:54:07.970+0000 7f434b920040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T09:54:08.861 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-25T09:54:08.858+0000 7f3d61bb3640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T09:54:08.861 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-04-25T09:54:08.859+0000 7f3d61bb3640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T09:54:10.043 INFO:tasks.ceph.osd.5.smithi055.stderr:2024-04-25T09:54:10.041+0000 7f1c16c0f640 -1 osd.5 0 log_to_monitors true 2024-04-25T09:54:10.048 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-04-25T09:54:10.046+0000 7f3869430640 -1 osd.0 0 log_to_monitors true 2024-04-25T09:54:10.103 INFO:tasks.ceph.osd.4.smithi055.stderr:2024-04-25T09:54:10.101+0000 7f075f216640 -1 osd.4 0 log_to_monitors true 2024-04-25T09:54:10.108 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-04-25T09:54:10.106+0000 7f991ba82640 -1 osd.2 0 log_to_monitors true 2024-04-25T09:54:10.109 INFO:tasks.ceph.osd.6.smithi055.stderr:2024-04-25T09:54:10.108+0000 7f63171c0640 -1 osd.6 0 log_to_monitors true 2024-04-25T09:54:10.121 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-04-25T09:54:10.118+0000 7fc215a63640 -1 osd.1 0 log_to_monitors true 2024-04-25T09:54:10.121 INFO:tasks.ceph.osd.7.smithi055.stderr:2024-04-25T09:54:10.119+0000 7f709d02c640 -1 osd.7 0 log_to_monitors true 2024-04-25T09:54:10.125 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-04-25T09:54:10.123+0000 7f4b94b40640 -1 osd.3 0 log_to_monitors true 2024-04-25T09:54:13.303 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-04-25T09:54:13.301+0000 7f4b912ea640 -1 osd.3 0 waiting for initial osdmap 2024-04-25T09:54:13.314 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-04-25T09:54:13.311+0000 7f9917a18640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T09:54:13.318 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-04-25T09:54:13.316+0000 7f4b888f6640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:54:13.335 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-04-25T09:54:13.333+0000 7f990f838640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:54:13.336 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-04-25T09:54:13.333+0000 7fc2119f9640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T09:54:13.347 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-04-25T09:54:13.345+0000 7f3864978640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T09:54:13.348 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-04-25T09:54:13.346+0000 7fc209819640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:54:13.365 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-04-25T09:54:13.363+0000 7f385c798640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:54:14.005 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T09:54:14.108 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.106+0000 7f03cfa38640 1 Processor -- start 2024-04-25T09:54:14.109 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.106+0000 7f03cfa38640 1 -- start start 2024-04-25T09:54:14.110 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.107+0000 7f03cfa38640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f03c80b5480 0x7f03c80b5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:14.110 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.107+0000 7f03cfa38640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f03c80cea60 0x7f03c815e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:14.110 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.107+0000 7f03cfa38640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c80cf270 con 0x7f03c806c250 2024-04-25T09:54:14.111 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.107+0000 7f03cfa38640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c8162610 con 0x7f03c80b5480 2024-04-25T09:54:14.111 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.107+0000 7f03cfa38640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c80b5da0 con 0x7f03c80cea60 2024-04-25T09:54:14.111 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.107+0000 7f03ccfd3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f03c80cea60 0x7f03c815e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:14.111 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.107+0000 7f03ccfd3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f03c80cea60 0x7f03c815e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:58604/0 (socket says 172.21.15.7:58604) 2024-04-25T09:54:14.111 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.107+0000 7f03ccfd3640 1 -- 172.21.15.7:0/446091163 learned_addr learned my addr 172.21.15.7:0/446091163 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:14.111 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.107+0000 7f03cd7d4640 1 --2- 172.21.15.7:0/446091163 >> v2:172.21.15.55:3300/0 conn(0x7f03c80b5480 0x7f03c80b5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:14.111 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.108+0000 7f03cd7d4640 1 -- 172.21.15.7:0/446091163 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f03c80cea60 msgr2=0x7f03c815e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:14.111 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.108+0000 7f03cd7d4640 1 --2- 172.21.15.7:0/446091163 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f03c80cea60 0x7f03c815e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:14.111 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.108+0000 7f03cd7d4640 1 -- 172.21.15.7:0/446091163 >> v1:172.21.15.55:6789/0 conn(0x7f03c806c250 legacy=0x7f03c806c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:14.111 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.108+0000 7f03cd7d4640 1 -- 172.21.15.7:0/446091163 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c8161850 con 0x7f03c80b5480 2024-04-25T09:54:14.113 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.109+0000 7f03cd7d4640 1 --2- 172.21.15.7:0/446091163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03c80b5480 0x7f03c80b5860 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f03c40097a0 tx=0x7f03c402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c007fe0f998de5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:14.113 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.109+0000 7f03bffff640 1 -- 172.21.15.7:0/446091163 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c4037070 con 0x7f03c80b5480 2024-04-25T09:54:14.113 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.109+0000 7f03bffff640 1 -- 172.21.15.7:0/446091163 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c4032440 con 0x7f03c80b5480 2024-04-25T09:54:14.113 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.109+0000 7f03bffff640 1 -- 172.21.15.7:0/446091163 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c4032810 con 0x7f03c80b5480 2024-04-25T09:54:14.113 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.109+0000 7f03cfa38640 1 -- 172.21.15.7:0/446091163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03c80b5480 msgr2=0x7f03c80b5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:14.113 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.109+0000 7f03cfa38640 1 --2- 172.21.15.7:0/446091163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03c80b5480 0x7f03c80b5860 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f03c40097a0 tx=0x7f03c402a180 comp rx=0 tx=0).stop 2024-04-25T09:54:14.113 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.109+0000 7f03cfa38640 1 -- 172.21.15.7:0/446091163 shutdown_connections 2024-04-25T09:54:14.113 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.109+0000 7f03cfa38640 1 --2- 172.21.15.7:0/446091163 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f03c80cea60 0x7f03c815e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:14.113 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.109+0000 7f03cfa38640 1 --2- 172.21.15.7:0/446091163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03c80b5480 0x7f03c80b5860 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:14.113 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.109+0000 7f03cfa38640 1 -- 172.21.15.7:0/446091163 >> 172.21.15.7:0/446091163 conn(0x7f03c80d0480 msgr2=0x7f03c80d0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:14.113 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.110+0000 7f03cfa38640 1 -- 172.21.15.7:0/446091163 shutdown_connections 2024-04-25T09:54:14.113 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.110+0000 7f03cfa38640 1 -- 172.21.15.7:0/446091163 wait complete. 2024-04-25T09:54:14.115 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.111+0000 7f03cfa38640 1 Processor -- start 2024-04-25T09:54:14.115 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.111+0000 7f03cfa38640 1 -- start start 2024-04-25T09:54:14.116 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.111+0000 7f03cfa38640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f03c806c250 0x7f03c8151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:14.116 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.111+0000 7f03cfa38640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03c80b5480 0x7f03c80cc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:14.116 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.111+0000 7f03cfa38640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03c80cea60 0x7f03c815c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:14.116 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.111+0000 7f03cfa38640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c81620f0 con 0x7f03c80cea60 2024-04-25T09:54:14.116 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.111+0000 7f03cfa38640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c8161e10 con 0x7f03c80b5480 2024-04-25T09:54:14.116 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.111+0000 7f03cfa38640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c80d2be0 con 0x7f03c806c250 2024-04-25T09:54:14.116 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.112+0000 7f03cdfd5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03c80cea60 0x7f03c815c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:14.116 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.112+0000 7f03ccfd3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03c80b5480 0x7f03c80cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:14.116 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.112+0000 7f03ccfd3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03c80b5480 0x7f03c80cc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:41008/0 (socket says 172.21.15.7:41008) 2024-04-25T09:54:14.116 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.112+0000 7f03ccfd3640 1 -- 172.21.15.7:0/266508942 learned_addr learned my addr 172.21.15.7:0/266508942 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:14.116 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.112+0000 7f03cd7d4640 1 --2- 172.21.15.7:0/266508942 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f03c806c250 0x7f03c8151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:14.116 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.112+0000 7f03cdfd5640 1 -- 172.21.15.7:0/266508942 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f03c806c250 msgr2=0x7f03c8151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:14.116 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.112+0000 7f03cdfd5640 1 --2- 172.21.15.7:0/266508942 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f03c806c250 0x7f03c8151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:14.116 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.112+0000 7f03cdfd5640 1 -- 172.21.15.7:0/266508942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03c80b5480 msgr2=0x7f03c80cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:14.116 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.112+0000 7f03cdfd5640 1 --2- 172.21.15.7:0/266508942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03c80b5480 0x7f03c80cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:14.117 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.112+0000 7f03cdfd5640 1 -- 172.21.15.7:0/266508942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c80cc960 con 0x7f03c80cea60 2024-04-25T09:54:14.117 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.112+0000 7f03cdfd5640 1 --2- 172.21.15.7:0/266508942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03c80cea60 0x7f03c815c780 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f03c000c690 tx=0x7f03c000cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:14.117 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.112+0000 7f03bdffb640 1 -- 172.21.15.7:0/266508942 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c0003b70 con 0x7f03c80cea60 2024-04-25T09:54:14.117 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.112+0000 7f03bdffb640 1 -- 172.21.15.7:0/266508942 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c0003d10 con 0x7f03c80cea60 2024-04-25T09:54:14.117 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.112+0000 7f03cfa38640 1 -- 172.21.15.7:0/266508942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c80ccc40 con 0x7f03c80cea60 2024-04-25T09:54:14.117 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.112+0000 7f03bdffb640 1 -- 172.21.15.7:0/266508942 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c0005310 con 0x7f03c80cea60 2024-04-25T09:54:14.117 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.113+0000 7f03cfa38640 1 -- 172.21.15.7:0/266508942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c80cd200 con 0x7f03c80cea60 2024-04-25T09:54:14.118 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.114+0000 7f03cfa38640 1 -- 172.21.15.7:0/266508942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c804ef20 con 0x7f03c80cea60 2024-04-25T09:54:14.118 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.114+0000 7f03bdffb640 1 -- 172.21.15.7:0/266508942 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7f03c00054b0 con 0x7f03c80cea60 2024-04-25T09:54:14.118 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.114+0000 7f03bdffb640 1 --2- 172.21.15.7:0/266508942 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f03ac06b440 0x7f03ac06d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:14.118 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.114+0000 7f03cd7d4640 1 --2- 172.21.15.7:0/266508942 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f03ac06b440 0x7f03ac06d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:14.118 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.114+0000 7f03bdffb640 1 -- 172.21.15.7:0/266508942 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3351+0+0 (secure 0 0 0) 0x7f03c0089420 con 0x7f03c80cea60 2024-04-25T09:54:14.118 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.115+0000 7f03cd7d4640 1 --2- 172.21.15.7:0/266508942 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f03ac06b440 0x7f03ac06d900 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f03c4034000 tx=0x7f03c402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:14.121 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.119+0000 7f03bdffb640 1 -- 172.21.15.7:0/266508942 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f03c80cf270 con 0x7f03c80cea60 2024-04-25T09:54:14.257 INFO:tasks.ceph.osd.7.smithi055.stderr:2024-04-25T09:54:14.254+0000 7f7098638640 -1 osd.7 0 waiting for initial osdmap 2024-04-25T09:54:14.262 INFO:tasks.ceph.osd.4.smithi055.stderr:2024-04-25T09:54:14.261+0000 7f075ac2a640 -1 osd.4 0 waiting for initial osdmap 2024-04-25T09:54:14.267 INFO:tasks.ceph.osd.7.smithi055.stderr:2024-04-25T09:54:14.266+0000 7f7090458640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:54:14.275 INFO:tasks.ceph.osd.4.smithi055.stderr:2024-04-25T09:54:14.274+0000 7f0752a4a640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:54:14.276 INFO:tasks.ceph.osd.6.smithi055.stderr:2024-04-25T09:54:14.274+0000 7f6313156640 -1 osd.6 0 waiting for initial osdmap 2024-04-25T09:54:14.286 INFO:tasks.ceph.osd.6.smithi055.stderr:2024-04-25T09:54:14.285+0000 7f630af76640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:54:14.303 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.301+0000 7f03cfa38640 1 -- 172.21.15.7:0/266508942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03c80ce840 con 0x7f03c80cea60 2024-04-25T09:54:14.304 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.301+0000 7f03bdffb640 1 -- 172.21.15.7:0/266508942 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+8917 (secure 0 0 0) 0x7f03c00586f0 con 0x7f03c80cea60 2024-04-25T09:54:14.304 INFO:teuthology.misc.health.smithi007.stdout: 2024-04-25T09:54:14.304 INFO:teuthology.misc.health.smithi007.stdout:{"epoch":13,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:54:14.034290+0000","last_up_change":"2024-04-25T09:54:14.034290+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:54:14.306 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.303+0000 7f03cfa38640 1 -- 172.21.15.7:0/266508942 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f03ac06b440 msgr2=0x7f03ac06d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:14.306 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.303+0000 7f03cfa38640 1 --2- 172.21.15.7:0/266508942 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f03ac06b440 0x7f03ac06d900 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f03c4034000 tx=0x7f03c402e000 comp rx=0 tx=0).stop 2024-04-25T09:54:14.306 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.303+0000 7f03cfa38640 1 -- 172.21.15.7:0/266508942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03c80cea60 msgr2=0x7f03c815c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:14.306 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.303+0000 7f03cfa38640 1 --2- 172.21.15.7:0/266508942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03c80cea60 0x7f03c815c780 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f03c000c690 tx=0x7f03c000cb50 comp rx=0 tx=0).stop 2024-04-25T09:54:14.306 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.303+0000 7f03cfa38640 1 -- 172.21.15.7:0/266508942 shutdown_connections 2024-04-25T09:54:14.306 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.303+0000 7f03cfa38640 1 --2- 172.21.15.7:0/266508942 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f03ac06b440 0x7f03ac06d900 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:14.306 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.303+0000 7f03cfa38640 1 --2- 172.21.15.7:0/266508942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03c80cea60 0x7f03c815c780 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:14.306 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.303+0000 7f03cfa38640 1 --2- 172.21.15.7:0/266508942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03c80b5480 0x7f03c80cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:14.307 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.303+0000 7f03cfa38640 1 --2- 172.21.15.7:0/266508942 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f03c806c250 0x7f03c8151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:14.307 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.303+0000 7f03cfa38640 1 -- 172.21.15.7:0/266508942 >> 172.21.15.7:0/266508942 conn(0x7f03c80d0480 msgr2=0x7f03c80b6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:14.307 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.303+0000 7f03cfa38640 1 -- 172.21.15.7:0/266508942 shutdown_connections 2024-04-25T09:54:14.307 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:14.303+0000 7f03cfa38640 1 -- 172.21.15.7:0/266508942 wait complete. 2024-04-25T09:54:14.315 DEBUG:teuthology.misc:4 of 8 OSDs are up 2024-04-25T09:54:14.362 INFO:tasks.ceph.osd.5.smithi055.stderr:2024-04-25T09:54:14.360+0000 7f1c125ff640 -1 osd.5 0 waiting for initial osdmap 2024-04-25T09:54:14.380 INFO:tasks.ceph.osd.5.smithi055.stderr:2024-04-25T09:54:14.379+0000 7f1c0a41f640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:54:21.121 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T09:54:21.226 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.224+0000 7feec8f6a640 1 Processor -- start 2024-04-25T09:54:21.226 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.224+0000 7feec8f6a640 1 -- start start 2024-04-25T09:54:21.229 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.224+0000 7feec8f6a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feec415a8f0 0x7feec40cee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:21.229 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.224+0000 7feec8f6a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec415acd0 con 0x7feec415e3e0 2024-04-25T09:54:21.229 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.224+0000 7feec8f6a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec40cddb0 con 0x7feec406e380 2024-04-25T09:54:21.229 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.224+0000 7feec8f6a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec40cf390 con 0x7feec415a8f0 2024-04-25T09:54:21.229 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.225+0000 7feec1d9b640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7feec415e3e0 0x7feec40cd540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46524/0 (socket says 172.21.15.7:46524) 2024-04-25T09:54:21.229 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.225+0000 7feec1d9b640 1 -- 172.21.15.7:0/2389716490 learned_addr learned my addr 172.21.15.7:0/2389716490 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:21.229 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.225+0000 7feec259c640 1 --2- 172.21.15.7:0/2389716490 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feec415a8f0 0x7feec40cee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:21.230 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.225+0000 7feec159a640 1 -- 172.21.15.7:0/2389716490 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3439146363 0 0) 0x7feec415acd0 con 0x7feec415e3e0 2024-04-25T09:54:21.230 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.225+0000 7feec159a640 1 -- 172.21.15.7:0/2389716490 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feeac003520 con 0x7feec415e3e0 2024-04-25T09:54:21.230 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.225+0000 7feec159a640 1 -- 172.21.15.7:0/2389716490 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2696527847 0 0) 0x7feeac003520 con 0x7feec415e3e0 2024-04-25T09:54:21.230 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.225+0000 7feec159a640 1 -- 172.21.15.7:0/2389716490 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feec415a8f0 msgr2=0x7feec40cee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:21.230 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.225+0000 7feec159a640 1 --2- 172.21.15.7:0/2389716490 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feec415a8f0 0x7feec40cee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:21.230 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.225+0000 7feec159a640 1 -- 172.21.15.7:0/2389716490 >> v1:172.21.15.55:6789/0 conn(0x7feec406e380 legacy=0x7feec40b25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:21.230 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.225+0000 7feec159a640 1 -- 172.21.15.7:0/2389716490 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec40ce090 con 0x7feec415e3e0 2024-04-25T09:54:21.230 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.225+0000 7feec159a640 1 -- 172.21.15.7:0/2389716490 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7feeb8001670 con 0x7feec415e3e0 2024-04-25T09:54:21.230 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.225+0000 7feec159a640 1 -- 172.21.15.7:0/2389716490 >> v1:172.21.15.7:6789/0 conn(0x7feec415e3e0 legacy=0x7feec40cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:21.230 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.225+0000 7feec159a640 1 --2- 172.21.15.7:0/2389716490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feeac0039e0 0x7feeac003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:21.230 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.225+0000 7feec159a640 1 --2- 172.21.15.7:0/2389716490 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feec415a8f0 0x7feeac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:21.230 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.225+0000 7feec159a640 1 --2- 172.21.15.7:0/2389716490 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feeac004d40 0x7feeac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:21.230 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.225+0000 7feec159a640 1 -- 172.21.15.7:0/2389716490 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec40cf390 con 0x7feeac0039e0 2024-04-25T09:54:21.231 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.225+0000 7feec159a640 1 -- 172.21.15.7:0/2389716490 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeac00b9c0 con 0x7feeac004d40 2024-04-25T09:54:21.231 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.225+0000 7feec159a640 1 -- 172.21.15.7:0/2389716490 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeac00bbc0 con 0x7feec415a8f0 2024-04-25T09:54:21.231 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.225+0000 7feec259c640 1 --2- 172.21.15.7:0/2389716490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feeac0039e0 0x7feeac003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:21.231 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.225+0000 7feec1d9b640 1 --2- 172.21.15.7:0/2389716490 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feec415a8f0 0x7feeac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:21.231 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.225+0000 7feec2d9d640 1 --2- 172.21.15.7:0/2389716490 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feeac004d40 0x7feeac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:21.231 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.226+0000 7feec259c640 1 -- 172.21.15.7:0/2389716490 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feec415a8f0 msgr2=0x7feeac004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:21.231 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.226+0000 7feec259c640 1 --2- 172.21.15.7:0/2389716490 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feec415a8f0 0x7feeac004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:21.231 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.226+0000 7feec259c640 1 -- 172.21.15.7:0/2389716490 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feeac004d40 msgr2=0x7feeac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:21.231 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.226+0000 7feec259c640 1 --2- 172.21.15.7:0/2389716490 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feeac004d40 0x7feeac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:21.232 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.226+0000 7feec259c640 1 -- 172.21.15.7:0/2389716490 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeac003520 con 0x7feeac0039e0 2024-04-25T09:54:21.232 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.226+0000 7feec259c640 1 --2- 172.21.15.7:0/2389716490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feeac0039e0 0x7feeac003dc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feeb4009ac0 tx=0x7feeac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b12f16d5504e9d27 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:21.232 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.227+0000 7feec159a640 1 -- 172.21.15.7:0/2389716490 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb4036070 con 0x7feeac0039e0 2024-04-25T09:54:21.232 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.227+0000 7feec159a640 1 -- 172.21.15.7:0/2389716490 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb4031400 con 0x7feeac0039e0 2024-04-25T09:54:21.232 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.227+0000 7feec159a640 1 -- 172.21.15.7:0/2389716490 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb4009690 con 0x7feeac0039e0 2024-04-25T09:54:21.235 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.227+0000 7feec8f6a640 1 -- 172.21.15.7:0/2389716490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feeac0039e0 msgr2=0x7feeac003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:21.235 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.227+0000 7feec8f6a640 1 --2- 172.21.15.7:0/2389716490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feeac0039e0 0x7feeac003dc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feeb4009ac0 tx=0x7feeac005830 comp rx=0 tx=0).stop 2024-04-25T09:54:21.235 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.227+0000 7feec2d9d640 1 -- 172.21.15.7:0/2389716490 reap_dead start 2024-04-25T09:54:21.235 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.227+0000 7feec8f6a640 1 -- 172.21.15.7:0/2389716490 shutdown_connections 2024-04-25T09:54:21.236 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.227+0000 7feec8f6a640 1 -- 172.21.15.7:0/2389716490 >> 172.21.15.7:0/2389716490 conn(0x7feec40b12b0 msgr2=0x7feec40b16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:21.236 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.227+0000 7feec8f6a640 1 -- 172.21.15.7:0/2389716490 shutdown_connections 2024-04-25T09:54:21.236 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.227+0000 7feec8f6a640 1 -- 172.21.15.7:0/2389716490 wait complete. 2024-04-25T09:54:21.236 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.229+0000 7feec8f6a640 1 Processor -- start 2024-04-25T09:54:21.236 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.229+0000 7feec8f6a640 1 -- start start 2024-04-25T09:54:21.236 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.229+0000 7feec8f6a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feeac0039e0 0x7feec414dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:21.236 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.229+0000 7feec8f6a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feec40adb50 0x7feec4158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:21.236 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.229+0000 7feec8f6a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feec4158d50 0x7feec40ae250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:21.236 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.229+0000 7feec8f6a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec40ce930 con 0x7feeac0039e0 2024-04-25T09:54:21.236 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.229+0000 7feec8f6a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec40ce650 con 0x7feec4158d50 2024-04-25T09:54:21.236 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.229+0000 7feec8f6a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec40cee50 con 0x7feec40adb50 2024-04-25T09:54:21.236 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.230+0000 7feec259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feeac0039e0 0x7feec414dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:21.236 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.230+0000 7feec259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feeac0039e0 0x7feec414dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50416/0 (socket says 172.21.15.7:50416) 2024-04-25T09:54:21.236 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.230+0000 7feec259c640 1 -- 172.21.15.7:0/3871396322 learned_addr learned my addr 172.21.15.7:0/3871396322 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:21.237 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.230+0000 7feec2d9d640 1 --2- 172.21.15.7:0/3871396322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feec4158d50 0x7feec40ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:21.237 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.230+0000 7feec1d9b640 1 --2- 172.21.15.7:0/3871396322 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feec40adb50 0x7feec4158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:21.237 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.230+0000 7feec259c640 1 -- 172.21.15.7:0/3871396322 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feec40adb50 msgr2=0x7feec4158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:21.237 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.230+0000 7feec259c640 1 --2- 172.21.15.7:0/3871396322 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feec40adb50 0x7feec4158810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:21.237 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.230+0000 7feec259c640 1 -- 172.21.15.7:0/3871396322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feec4158d50 msgr2=0x7feec40ae250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:21.237 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.230+0000 7feec259c640 1 --2- 172.21.15.7:0/3871396322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feec4158d50 0x7feec40ae250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:21.237 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.230+0000 7feec259c640 1 -- 172.21.15.7:0/3871396322 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec40ac810 con 0x7feeac0039e0 2024-04-25T09:54:21.237 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.230+0000 7feec1d9b640 1 --2- 172.21.15.7:0/3871396322 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feec40adb50 0x7feec4158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:21.237 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.230+0000 7feec259c640 1 --2- 172.21.15.7:0/3871396322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feeac0039e0 0x7feec414dfc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feeb4009ac0 tx=0x7feeb4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:21.237 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.230+0000 7feeb2ffd640 1 -- 172.21.15.7:0/3871396322 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb4040020 con 0x7feeac0039e0 2024-04-25T09:54:21.237 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.230+0000 7feeb2ffd640 1 -- 172.21.15.7:0/3871396322 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb4003bc0 con 0x7feeac0039e0 2024-04-25T09:54:21.237 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.230+0000 7feeb2ffd640 1 -- 172.21.15.7:0/3871396322 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb4036040 con 0x7feeac0039e0 2024-04-25T09:54:21.237 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.230+0000 7feec8f6a640 1 -- 172.21.15.7:0/3871396322 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec40acab0 con 0x7feeac0039e0 2024-04-25T09:54:21.237 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.230+0000 7feec8f6a640 1 -- 172.21.15.7:0/3871396322 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec40ad070 con 0x7feeac0039e0 2024-04-25T09:54:21.237 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.231+0000 7feec8f6a640 1 -- 172.21.15.7:0/3871396322 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec404ef20 con 0x7feeac0039e0 2024-04-25T09:54:21.238 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.232+0000 7feeb2ffd640 1 -- 172.21.15.7:0/3871396322 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7feeb4043020 con 0x7feeac0039e0 2024-04-25T09:54:21.238 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.232+0000 7feeb2ffd640 1 --2- 172.21.15.7:0/3871396322 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7feea406b500 0x7feea406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:21.238 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.232+0000 7feeb2ffd640 1 -- 172.21.15.7:0/3871396322 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7feeb40a9f80 con 0x7feeac0039e0 2024-04-25T09:54:21.238 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.232+0000 7feec1d9b640 1 --2- 172.21.15.7:0/3871396322 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7feea406b500 0x7feea406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:21.238 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.233+0000 7feec1d9b640 1 --2- 172.21.15.7:0/3871396322 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7feea406b500 0x7feea406d9c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7feec41563f0 tx=0x7feeb8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:21.239 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.238+0000 7feeb2ffd640 1 -- 172.21.15.7:0/3871396322 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7feeb404a070 con 0x7feeac0039e0 2024-04-25T09:54:21.420 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.418+0000 7feec8f6a640 1 -- 172.21.15.7:0/3871396322 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feec40cbd70 con 0x7feeac0039e0 2024-04-25T09:54:21.421 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.419+0000 7feeb2ffd640 1 -- 172.21.15.7:0/3871396322 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12788 (secure 0 0 0) 0x7feeb40044e0 con 0x7feeac0039e0 2024-04-25T09:54:21.422 INFO:teuthology.misc.health.smithi007.stdout: 2024-04-25T09:54:21.422 INFO:teuthology.misc.health.smithi007.stdout:{"epoch":17,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:54:18.071830+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:54:21.424 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.421+0000 7feec8f6a640 1 -- 172.21.15.7:0/3871396322 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7feea406b500 msgr2=0x7feea406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:21.424 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.421+0000 7feec8f6a640 1 --2- 172.21.15.7:0/3871396322 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7feea406b500 0x7feea406d9c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7feec41563f0 tx=0x7feeb8009040 comp rx=0 tx=0).stop 2024-04-25T09:54:21.424 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.421+0000 7feec8f6a640 1 -- 172.21.15.7:0/3871396322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feeac0039e0 msgr2=0x7feec414dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:21.425 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.421+0000 7feec8f6a640 1 --2- 172.21.15.7:0/3871396322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feeac0039e0 0x7feec414dfc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feeb4009ac0 tx=0x7feeb4004730 comp rx=0 tx=0).stop 2024-04-25T09:54:21.425 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.421+0000 7feec8f6a640 1 -- 172.21.15.7:0/3871396322 shutdown_connections 2024-04-25T09:54:21.425 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.421+0000 7feec8f6a640 1 --2- 172.21.15.7:0/3871396322 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7feea406b500 0x7feea406d9c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:21.425 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.421+0000 7feec8f6a640 1 --2- 172.21.15.7:0/3871396322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feec4158d50 0x7feec40ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:21.425 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.421+0000 7feec8f6a640 1 --2- 172.21.15.7:0/3871396322 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feec40adb50 0x7feec4158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:21.425 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.421+0000 7feec8f6a640 1 --2- 172.21.15.7:0/3871396322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feeac0039e0 0x7feec414dfc0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:21.425 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.421+0000 7feec8f6a640 1 -- 172.21.15.7:0/3871396322 >> 172.21.15.7:0/3871396322 conn(0x7feec40b12b0 msgr2=0x7feec415d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:21.426 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.421+0000 7feec8f6a640 1 -- 172.21.15.7:0/3871396322 shutdown_connections 2024-04-25T09:54:21.426 INFO:teuthology.misc.health.smithi007.stderr:2024-04-25T09:54:21.421+0000 7feec8f6a640 1 -- 172.21.15.7:0/3871396322 wait complete. 2024-04-25T09:54:21.433 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-25T09:54:21.433 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T09:54:21.433 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:54:21.433 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:54:21.436 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:54:21.436 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:54:21.436 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:54:21.438 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:54:21.438 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:54:21.438 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:54:21.441 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:54:21.441 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:54:21.441 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:54:21.443 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:54:21.443 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T09:54:21.444 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:54:21.511 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-04-25T09:54:21.511 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-04-25T09:54:21.528 INFO:tasks.ceph.mds.b.smithi055.stdout:starting mds.b at 2024-04-25T09:54:21.528 INFO:tasks.ceph.mds.d.smithi055.stdout:starting mds.d at 2024-04-25T09:54:21.529 INFO:tasks.ceph.mds.b.smithi055.stderr:2024-04-25T09:54:21.527+0000 7ff800bfe640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-04-25T09:54:21.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.546+0000 7f98f0510640 1 Processor -- start 2024-04-25T09:54:21.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.547+0000 7f98f0510640 1 -- start start 2024-04-25T09:54:21.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.547+0000 7f98f0510640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f98e80cbab0 0x7f98e80ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:21.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.548+0000 7f98f0510640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e815f200 con 0x7f98e815ed70 2024-04-25T09:54:21.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.548+0000 7f98f0510640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e80cbfa0 con 0x7f98e815a6f0 2024-04-25T09:54:21.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.548+0000 7f98f0510640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98e80aef60 con 0x7f98e80cbab0 2024-04-25T09:54:21.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.548+0000 7f98edaab640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f98e815ed70 0x7f98e806bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46548/0 (socket says 172.21.15.7:46548) 2024-04-25T09:54:21.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.548+0000 7f98edaab640 1 -- 172.21.15.7:0/3300229646 learned_addr learned my addr 172.21.15.7:0/3300229646 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:21.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.548+0000 7f98eeaad640 1 --2- 172.21.15.7:0/3300229646 >> v2:172.21.15.7:3300/0 conn(0x7f98e80cbab0 0x7f98e80ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:21.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.548+0000 7f98eeaad640 1 -- 172.21.15.7:0/3300229646 >> v1:172.21.15.55:6789/0 conn(0x7f98e815a6f0 legacy=0x7f98e80ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:21.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.548+0000 7f98eeaad640 1 -- 172.21.15.7:0/3300229646 >> v1:172.21.15.7:6789/0 conn(0x7f98e815ed70 legacy=0x7f98e806bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:21.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.548+0000 7f98eeaad640 1 -- 172.21.15.7:0/3300229646 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e80cc280 con 0x7f98e80cbab0 2024-04-25T09:54:21.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.548+0000 7f98ed2aa640 1 -- 172.21.15.7:0/3300229646 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 352393359 0 0) 0x7f98e815f200 con 0x7f98e815ed70 2024-04-25T09:54:21.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.549+0000 7f98eeaad640 1 --2- 172.21.15.7:0/3300229646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98e80cbab0 0x7f98e80ceff0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f98e0009d90 tx=0x7f98e002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb51320752156c10 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:21.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.549+0000 7f98ed2aa640 1 -- 172.21.15.7:0/3300229646 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e0007740 con 0x7f98e80cbab0 2024-04-25T09:54:21.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.549+0000 7f98ed2aa640 1 -- 172.21.15.7:0/3300229646 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e00078e0 con 0x7f98e80cbab0 2024-04-25T09:54:21.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.549+0000 7f98ed2aa640 1 -- 172.21.15.7:0/3300229646 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e0007cb0 con 0x7f98e80cbab0 2024-04-25T09:54:21.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.549+0000 7f98f0510640 1 -- 172.21.15.7:0/3300229646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98e80cbab0 msgr2=0x7f98e80ceff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:21.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.549+0000 7f98f0510640 1 --2- 172.21.15.7:0/3300229646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98e80cbab0 0x7f98e80ceff0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f98e0009d90 tx=0x7f98e002a6f0 comp rx=0 tx=0).stop 2024-04-25T09:54:21.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.549+0000 7f98f0510640 1 -- 172.21.15.7:0/3300229646 shutdown_connections 2024-04-25T09:54:21.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.549+0000 7f98f0510640 1 --2- 172.21.15.7:0/3300229646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98e80cbab0 0x7f98e80ceff0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:21.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.549+0000 7f98f0510640 1 -- 172.21.15.7:0/3300229646 >> 172.21.15.7:0/3300229646 conn(0x7f98e8071ac0 msgr2=0x7f98e8071ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:21.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.549+0000 7f98f0510640 1 -- 172.21.15.7:0/3300229646 shutdown_connections 2024-04-25T09:54:21.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.550+0000 7f98f0510640 1 -- 172.21.15.7:0/3300229646 wait complete. 2024-04-25T09:54:21.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.551+0000 7f98f0510640 1 Processor -- start 2024-04-25T09:54:21.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.551+0000 7f98f0510640 1 -- start start 2024-04-25T09:54:21.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.551+0000 7f98f0510640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98e80cbab0 0x7f98e81499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:21.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.551+0000 7f98f0510640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98e815a6f0 0x7f98e80999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:21.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.551+0000 7f98f0510640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98e8099f30 0x7f98e809ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:21.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.551+0000 7f98f0510640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e815aad0 con 0x7f98e8099f30 2024-04-25T09:54:21.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.551+0000 7f98f0510640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e80cead0 con 0x7f98e815a6f0 2024-04-25T09:54:21.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.551+0000 7f98f0510640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e8156330 con 0x7f98e80cbab0 2024-04-25T09:54:21.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.552+0000 7f98eeaad640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98e8099f30 0x7f98e809ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:21.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.552+0000 7f98eeaad640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98e8099f30 0x7f98e809ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50440/0 (socket says 172.21.15.7:50440) 2024-04-25T09:54:21.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.552+0000 7f98eeaad640 1 -- 172.21.15.7:0/1538917887 learned_addr learned my addr 172.21.15.7:0/1538917887 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:21.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.552+0000 7f98edaab640 1 --2- 172.21.15.7:0/1538917887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98e815a6f0 0x7f98e80999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:21.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.552+0000 7f98ee2ac640 1 --2- 172.21.15.7:0/1538917887 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98e80cbab0 0x7f98e81499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:21.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.552+0000 7f98eeaad640 1 -- 172.21.15.7:0/1538917887 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98e80cbab0 msgr2=0x7f98e81499a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:21.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.552+0000 7f98eeaad640 1 --2- 172.21.15.7:0/1538917887 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98e80cbab0 0x7f98e81499a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:21.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.552+0000 7f98eeaad640 1 -- 172.21.15.7:0/1538917887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98e815a6f0 msgr2=0x7f98e80999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:21.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.552+0000 7f98eeaad640 1 --2- 172.21.15.7:0/1538917887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98e815a6f0 0x7f98e80999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:21.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.552+0000 7f98eeaad640 1 -- 172.21.15.7:0/1538917887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e8149ee0 con 0x7f98e8099f30 2024-04-25T09:54:21.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.552+0000 7f98ee2ac640 1 --2- 172.21.15.7:0/1538917887 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98e80cbab0 0x7f98e81499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:21.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.552+0000 7f98edaab640 1 --2- 172.21.15.7:0/1538917887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98e815a6f0 0x7f98e80999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:21.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.552+0000 7f98eeaad640 1 --2- 172.21.15.7:0/1538917887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98e8099f30 0x7f98e809ba90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f98e0009d90 tx=0x7f98e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:21.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.552+0000 7f98deffd640 1 -- 172.21.15.7:0/1538917887 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e0040070 con 0x7f98e8099f30 2024-04-25T09:54:21.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.552+0000 7f98deffd640 1 -- 172.21.15.7:0/1538917887 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e0031c90 con 0x7f98e8099f30 2024-04-25T09:54:21.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.552+0000 7f98f0510640 1 -- 172.21.15.7:0/1538917887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e809c730 con 0x7f98e8099f30 2024-04-25T09:54:21.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.552+0000 7f98deffd640 1 -- 172.21.15.7:0/1538917887 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e003c640 con 0x7f98e8099f30 2024-04-25T09:54:21.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.552+0000 7f98f0510640 1 -- 172.21.15.7:0/1538917887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e809ccf0 con 0x7f98e8099f30 2024-04-25T09:54:21.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.553+0000 7f98f0510640 1 -- 172.21.15.7:0/1538917887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e8068fd0 con 0x7f98e8099f30 2024-04-25T09:54:21.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.554+0000 7f98deffd640 1 -- 172.21.15.7:0/1538917887 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f98e0039040 con 0x7f98e8099f30 2024-04-25T09:54:21.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.554+0000 7f98deffd640 1 --2- 172.21.15.7:0/1538917887 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f98cc06b4d0 0x7f98cc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:21.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.554+0000 7f98deffd640 1 -- 172.21.15.7:0/1538917887 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f98e00ab4d0 con 0x7f98e8099f30 2024-04-25T09:54:21.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.554+0000 7f98ee2ac640 1 --2- 172.21.15.7:0/1538917887 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f98cc06b4d0 0x7f98cc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:21.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.555+0000 7f98ee2ac640 1 --2- 172.21.15.7:0/1538917887 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f98cc06b4d0 0x7f98cc06d990 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f98d8007fd0 tx=0x7f98d8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:21.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.559+0000 7f98deffd640 1 -- 172.21.15.7:0/1538917887 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f98e007a760 con 0x7f98e8099f30 2024-04-25T09:54:21.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.739+0000 7f98f0510640 1 -- 172.21.15.7:0/1538917887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98e8159d80 con 0x7f98e8099f30 2024-04-25T09:54:21.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.740+0000 7f98deffd640 1 -- 172.21.15.7:0/1538917887 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12788 (secure 0 0 0) 0x7f98e007a060 con 0x7f98e8099f30 2024-04-25T09:54:21.742 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:21.743 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":17,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:54:18.071830+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:54:21.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.742+0000 7f98f0510640 1 -- 172.21.15.7:0/1538917887 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f98cc06b4d0 msgr2=0x7f98cc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:21.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.742+0000 7f98f0510640 1 --2- 172.21.15.7:0/1538917887 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f98cc06b4d0 0x7f98cc06d990 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f98d8007fd0 tx=0x7f98d8009040 comp rx=0 tx=0).stop 2024-04-25T09:54:21.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.742+0000 7f98f0510640 1 -- 172.21.15.7:0/1538917887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98e8099f30 msgr2=0x7f98e809ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:21.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.742+0000 7f98f0510640 1 --2- 172.21.15.7:0/1538917887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98e8099f30 0x7f98e809ba90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f98e0009d90 tx=0x7f98e0004a40 comp rx=0 tx=0).stop 2024-04-25T09:54:21.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.742+0000 7f98f0510640 1 -- 172.21.15.7:0/1538917887 shutdown_connections 2024-04-25T09:54:21.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.742+0000 7f98f0510640 1 --2- 172.21.15.7:0/1538917887 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f98cc06b4d0 0x7f98cc06d990 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:21.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.742+0000 7f98f0510640 1 --2- 172.21.15.7:0/1538917887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98e8099f30 0x7f98e809ba90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:21.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.742+0000 7f98f0510640 1 --2- 172.21.15.7:0/1538917887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98e815a6f0 0x7f98e80999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:21.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.742+0000 7f98f0510640 1 --2- 172.21.15.7:0/1538917887 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98e80cbab0 0x7f98e81499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:21.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.742+0000 7f98f0510640 1 -- 172.21.15.7:0/1538917887 >> 172.21.15.7:0/1538917887 conn(0x7f98e8071ac0 msgr2=0x7f98e8071ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:21.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.742+0000 7f98f0510640 1 -- 172.21.15.7:0/1538917887 shutdown_connections 2024-04-25T09:54:21.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.742+0000 7f98f0510640 1 -- 172.21.15.7:0/1538917887 wait complete. 2024-04-25T09:54:21.755 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:54:21.755 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:54:21.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.857+0000 7fba3f9ab640 1 Processor -- start 2024-04-25T09:54:21.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.857+0000 7fba3f9ab640 1 -- start start 2024-04-25T09:54:21.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.857+0000 7fba3f9ab640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fba3815dcb0 0x7fba380999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:21.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.857+0000 7fba3f9ab640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fba380cf9a0 0x7fba38099f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:21.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.857+0000 7fba3f9ab640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba3806bf50 con 0x7fba3815d8d0 2024-04-25T09:54:21.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.857+0000 7fba3f9ab640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba380cfe60 con 0x7fba3815dcb0 2024-04-25T09:54:21.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.857+0000 7fba3f9ab640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba380d0140 con 0x7fba380cf9a0 2024-04-25T09:54:21.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.857+0000 7fba3cf46640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fba3815dcb0 0x7fba380999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:21.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.857+0000 7fba3d747640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fba3815d8d0 0x7fba3806cb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46552/0 (socket says 172.21.15.7:46552) 2024-04-25T09:54:21.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.857+0000 7fba3d747640 1 -- 172.21.15.7:0/2880560205 learned_addr learned my addr 172.21.15.7:0/2880560205 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:21.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.857+0000 7fba3cf46640 1 -- 172.21.15.7:0/2880560205 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fba380cf9a0 msgr2=0x7fba38099f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:21.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.857+0000 7fba3cf46640 1 --2- 172.21.15.7:0/2880560205 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fba380cf9a0 0x7fba38099f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:21.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.857+0000 7fba3cf46640 1 -- 172.21.15.7:0/2880560205 >> v1:172.21.15.7:6789/0 conn(0x7fba3815d8d0 legacy=0x7fba3806cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:21.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.857+0000 7fba2ffff640 1 -- 172.21.15.7:0/2880560205 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1951225751 0 0) 0x7fba3806bf50 con 0x7fba3815d8d0 2024-04-25T09:54:21.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.857+0000 7fba3cf46640 1 -- 172.21.15.7:0/2880560205 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba380d0420 con 0x7fba3815dcb0 2024-04-25T09:54:21.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.858+0000 7fba3cf46640 1 --2- 172.21.15.7:0/2880560205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba3815dcb0 0x7fba380999f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fba280097a0 tx=0x7fba2802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a96fc9e22ea1bc51 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:21.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.858+0000 7fba2ffff640 1 -- 172.21.15.7:0/2880560205 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba28037070 con 0x7fba3815dcb0 2024-04-25T09:54:21.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.858+0000 7fba2ffff640 1 -- 172.21.15.7:0/2880560205 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba28032440 con 0x7fba3815dcb0 2024-04-25T09:54:21.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.858+0000 7fba2ffff640 1 -- 172.21.15.7:0/2880560205 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba28032810 con 0x7fba3815dcb0 2024-04-25T09:54:21.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.859+0000 7fba3f9ab640 1 -- 172.21.15.7:0/2880560205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba3815dcb0 msgr2=0x7fba380999f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:21.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.859+0000 7fba3f9ab640 1 --2- 172.21.15.7:0/2880560205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba3815dcb0 0x7fba380999f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fba280097a0 tx=0x7fba2802a1a0 comp rx=0 tx=0).stop 2024-04-25T09:54:21.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.859+0000 7fba3f9ab640 1 -- 172.21.15.7:0/2880560205 shutdown_connections 2024-04-25T09:54:21.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.859+0000 7fba3f9ab640 1 --2- 172.21.15.7:0/2880560205 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fba380cf9a0 0x7fba38099f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:21.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.859+0000 7fba3f9ab640 1 --2- 172.21.15.7:0/2880560205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba3815dcb0 0x7fba380999f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:21.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.859+0000 7fba3f9ab640 1 -- 172.21.15.7:0/2880560205 >> 172.21.15.7:0/2880560205 conn(0x7fba380b3120 msgr2=0x7fba380b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:21.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.859+0000 7fba3f9ab640 1 -- 172.21.15.7:0/2880560205 shutdown_connections 2024-04-25T09:54:21.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.859+0000 7fba3f9ab640 1 -- 172.21.15.7:0/2880560205 wait complete. 2024-04-25T09:54:21.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.860+0000 7fba3f9ab640 1 Processor -- start 2024-04-25T09:54:21.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.860+0000 7fba3f9ab640 1 -- start start 2024-04-25T09:54:21.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.861+0000 7fba3f9ab640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba380cf9a0 0x7fba38159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:21.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.861+0000 7fba3f9ab640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba3815d8d0 0x7fba3809e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:21.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.861+0000 7fba3f9ab640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fba3815dcb0 0x7fba3809ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:21.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.861+0000 7fba3f9ab640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba380d0f00 con 0x7fba3815d8d0 2024-04-25T09:54:21.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.861+0000 7fba3f9ab640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba380d09e0 con 0x7fba380cf9a0 2024-04-25T09:54:21.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.861+0000 7fba3f9ab640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba3815fac0 con 0x7fba3815dcb0 2024-04-25T09:54:21.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.861+0000 7fba3cf46640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba3815d8d0 0x7fba3809e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:21.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.861+0000 7fba3cf46640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba3815d8d0 0x7fba3809e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50462/0 (socket says 172.21.15.7:50462) 2024-04-25T09:54:21.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.861+0000 7fba3cf46640 1 -- 172.21.15.7:0/3771783138 learned_addr learned my addr 172.21.15.7:0/3771783138 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:21.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.861+0000 7fba3d747640 1 --2- 172.21.15.7:0/3771783138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba380cf9a0 0x7fba38159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:21.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.861+0000 7fba3df48640 1 --2- 172.21.15.7:0/3771783138 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fba3815dcb0 0x7fba3809ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:21.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.861+0000 7fba3cf46640 1 -- 172.21.15.7:0/3771783138 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fba3815dcb0 msgr2=0x7fba3809ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:21.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.861+0000 7fba3cf46640 1 --2- 172.21.15.7:0/3771783138 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fba3815dcb0 0x7fba3809ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:21.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.861+0000 7fba3cf46640 1 -- 172.21.15.7:0/3771783138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba380cf9a0 msgr2=0x7fba38159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:21.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.861+0000 7fba3cf46640 1 --2- 172.21.15.7:0/3771783138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba380cf9a0 0x7fba38159bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:21.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.861+0000 7fba3cf46640 1 -- 172.21.15.7:0/3771783138 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba3815fd60 con 0x7fba3815d8d0 2024-04-25T09:54:21.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.861+0000 7fba3df48640 1 --2- 172.21.15.7:0/3771783138 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fba3815dcb0 0x7fba3809ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:21.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.861+0000 7fba3d747640 1 --2- 172.21.15.7:0/3771783138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba380cf9a0 0x7fba38159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:21.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.861+0000 7fba3cf46640 1 --2- 172.21.15.7:0/3771783138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba3815d8d0 0x7fba3809e7a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fba280097a0 tx=0x7fba280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:21.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.861+0000 7fba2dffb640 1 -- 172.21.15.7:0/3771783138 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba28042020 con 0x7fba3815d8d0 2024-04-25T09:54:21.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.861+0000 7fba2dffb640 1 -- 172.21.15.7:0/3771783138 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba28030970 con 0x7fba3815d8d0 2024-04-25T09:54:21.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.861+0000 7fba3f9ab640 1 -- 172.21.15.7:0/3771783138 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba38160040 con 0x7fba3815d8d0 2024-04-25T09:54:21.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.861+0000 7fba2dffb640 1 -- 172.21.15.7:0/3771783138 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba28037040 con 0x7fba3815d8d0 2024-04-25T09:54:21.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.862+0000 7fba3f9ab640 1 -- 172.21.15.7:0/3771783138 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba38160600 con 0x7fba3815d8d0 2024-04-25T09:54:21.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.863+0000 7fba3f9ab640 1 -- 172.21.15.7:0/3771783138 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba38068f60 con 0x7fba3815d8d0 2024-04-25T09:54:21.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.863+0000 7fba2dffb640 1 -- 172.21.15.7:0/3771783138 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fba28045020 con 0x7fba3815d8d0 2024-04-25T09:54:21.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.863+0000 7fba2dffb640 1 --2- 172.21.15.7:0/3771783138 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fba1c06b4d0 0x7fba1c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:21.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.864+0000 7fba2dffb640 1 -- 172.21.15.7:0/3771783138 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fba280aab10 con 0x7fba3815d8d0 2024-04-25T09:54:21.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.864+0000 7fba3d747640 1 --2- 172.21.15.7:0/3771783138 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fba1c06b4d0 0x7fba1c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:21.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.864+0000 7fba3d747640 1 --2- 172.21.15.7:0/3771783138 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fba1c06b4d0 0x7fba1c06d990 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fba34000f60 tx=0x7fba34009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:21.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:21.868+0000 7fba2dffb640 1 -- 172.21.15.7:0/3771783138 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fba2804c030 con 0x7fba3815d8d0 2024-04-25T09:54:22.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.046+0000 7fba3f9ab640 1 -- 172.21.15.7:0/3771783138 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fba380b3f50 con 0x7fba3815d8d0 2024-04-25T09:54:22.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.046+0000 7fba2dffb640 1 -- 172.21.15.7:0/3771783138 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fba28032e20 con 0x7fba3815d8d0 2024-04-25T09:54:22.049 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T09:54:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.048+0000 7fba3f9ab640 1 -- 172.21.15.7:0/3771783138 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fba1c06b4d0 msgr2=0x7fba1c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.048+0000 7fba3f9ab640 1 --2- 172.21.15.7:0/3771783138 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fba1c06b4d0 0x7fba1c06d990 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fba34000f60 tx=0x7fba34009040 comp rx=0 tx=0).stop 2024-04-25T09:54:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.048+0000 7fba3f9ab640 1 -- 172.21.15.7:0/3771783138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba3815d8d0 msgr2=0x7fba3809e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.048+0000 7fba3f9ab640 1 --2- 172.21.15.7:0/3771783138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba3815d8d0 0x7fba3809e7a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fba280097a0 tx=0x7fba280046c0 comp rx=0 tx=0).stop 2024-04-25T09:54:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.048+0000 7fba3f9ab640 1 -- 172.21.15.7:0/3771783138 shutdown_connections 2024-04-25T09:54:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.048+0000 7fba3f9ab640 1 --2- 172.21.15.7:0/3771783138 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fba1c06b4d0 0x7fba1c06d990 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.048+0000 7fba3f9ab640 1 --2- 172.21.15.7:0/3771783138 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fba3815dcb0 0x7fba3809ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.048+0000 7fba3f9ab640 1 --2- 172.21.15.7:0/3771783138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba3815d8d0 0x7fba3809e7a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:22.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.048+0000 7fba3f9ab640 1 --2- 172.21.15.7:0/3771783138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba380cf9a0 0x7fba38159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:22.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.048+0000 7fba3f9ab640 1 -- 172.21.15.7:0/3771783138 >> 172.21.15.7:0/3771783138 conn(0x7fba380b3120 msgr2=0x7fba380b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:22.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.048+0000 7fba3f9ab640 1 -- 172.21.15.7:0/3771783138 shutdown_connections 2024-04-25T09:54:22.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.048+0000 7fba3f9ab640 1 -- 172.21.15.7:0/3771783138 wait complete. 2024-04-25T09:54:22.062 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:54:22.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.159+0000 7f5e875e7640 1 Processor -- start 2024-04-25T09:54:22.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.159+0000 7f5e875e7640 1 -- start start 2024-04-25T09:54:22.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.160+0000 7f5e875e7640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e8015db00 0x7f5e800d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:22.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.160+0000 7f5e875e7640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5e800ce2b0 0x7f5e800d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:22.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.160+0000 7f5e875e7640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e800d1e80 con 0x7f5e800b53b0 2024-04-25T09:54:22.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.160+0000 7f5e875e7640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e800b5930 con 0x7f5e800ce2b0 2024-04-25T09:54:22.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.160+0000 7f5e875e7640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e800b5c10 con 0x7f5e8015db00 2024-04-25T09:54:22.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.160+0000 7f5e85b84640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5e800ce2b0 0x7f5e800d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:22.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.160+0000 7f5e84b82640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5e800b53b0 0x7f5e80161670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46560/0 (socket says 172.21.15.7:46560) 2024-04-25T09:54:22.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.160+0000 7f5e84b82640 1 -- 172.21.15.7:0/3919681976 learned_addr learned my addr 172.21.15.7:0/3919681976 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:22.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.161+0000 7f5e85383640 1 --2- 172.21.15.7:0/3919681976 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e8015db00 0x7f5e800d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:22.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.161+0000 7f5e85b84640 1 -- 172.21.15.7:0/3919681976 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e8015db00 msgr2=0x7f5e800d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:22.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.161+0000 7f5e85b84640 1 --2- 172.21.15.7:0/3919681976 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e8015db00 0x7f5e800d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:22.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.161+0000 7f5e85b84640 1 -- 172.21.15.7:0/3919681976 >> v1:172.21.15.7:6789/0 conn(0x7f5e800b53b0 legacy=0x7f5e80161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:22.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.161+0000 7f5e85b84640 1 -- 172.21.15.7:0/3919681976 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e800b5ef0 con 0x7f5e800ce2b0 2024-04-25T09:54:22.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.161+0000 7f5e77fff640 1 -- 172.21.15.7:0/3919681976 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304623168 0 0) 0x7f5e800d1e80 con 0x7f5e800b53b0 2024-04-25T09:54:22.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.161+0000 7f5e85383640 1 --2- 172.21.15.7:0/3919681976 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e8015db00 0x7f5e800d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:22.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.161+0000 7f5e85b84640 1 --2- 172.21.15.7:0/3919681976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e800ce2b0 0x7f5e800d0880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c009d90 tx=0x7f5e7c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c1d2c0f6e36fad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:22.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.161+0000 7f5e77fff640 1 -- 172.21.15.7:0/3919681976 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c007740 con 0x7f5e800ce2b0 2024-04-25T09:54:22.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.162+0000 7f5e77fff640 1 -- 172.21.15.7:0/3919681976 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7c0078e0 con 0x7f5e800ce2b0 2024-04-25T09:54:22.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.162+0000 7f5e77fff640 1 -- 172.21.15.7:0/3919681976 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c007cb0 con 0x7f5e800ce2b0 2024-04-25T09:54:22.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.162+0000 7f5e875e7640 1 -- 172.21.15.7:0/3919681976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e800ce2b0 msgr2=0x7f5e800d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:22.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.162+0000 7f5e875e7640 1 --2- 172.21.15.7:0/3919681976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e800ce2b0 0x7f5e800d0880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c009d90 tx=0x7f5e7c02a660 comp rx=0 tx=0).stop 2024-04-25T09:54:22.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.162+0000 7f5e875e7640 1 -- 172.21.15.7:0/3919681976 shutdown_connections 2024-04-25T09:54:22.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.162+0000 7f5e875e7640 1 --2- 172.21.15.7:0/3919681976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e800ce2b0 0x7f5e800d0880 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:22.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.162+0000 7f5e875e7640 1 --2- 172.21.15.7:0/3919681976 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e8015db00 0x7f5e800d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:22.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.162+0000 7f5e875e7640 1 -- 172.21.15.7:0/3919681976 >> 172.21.15.7:0/3919681976 conn(0x7f5e80072290 msgr2=0x7f5e800726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:22.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.162+0000 7f5e875e7640 1 -- 172.21.15.7:0/3919681976 shutdown_connections 2024-04-25T09:54:22.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.162+0000 7f5e875e7640 1 -- 172.21.15.7:0/3919681976 wait complete. 2024-04-25T09:54:22.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.163+0000 7f5e875e7640 1 Processor -- start 2024-04-25T09:54:22.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.163+0000 7f5e875e7640 1 -- start start 2024-04-25T09:54:22.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.164+0000 7f5e875e7640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e800b53b0 0x7f5e80157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:22.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.164+0000 7f5e875e7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e800ce2b0 0x7f5e801598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:22.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.164+0000 7f5e875e7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e8015db00 0x7f5e80148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:22.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.164+0000 7f5e875e7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e800d3660 con 0x7f5e8015db00 2024-04-25T09:54:22.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.164+0000 7f5e875e7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e800b61d0 con 0x7f5e800ce2b0 2024-04-25T09:54:22.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.164+0000 7f5e875e7640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e800b6c10 con 0x7f5e800b53b0 2024-04-25T09:54:22.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.164+0000 7f5e85b84640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e8015db00 0x7f5e80148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:22.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.164+0000 7f5e85b84640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e8015db00 0x7f5e80148910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50468/0 (socket says 172.21.15.7:50468) 2024-04-25T09:54:22.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.164+0000 7f5e85b84640 1 -- 172.21.15.7:0/1062114769 learned_addr learned my addr 172.21.15.7:0/1062114769 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:22.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.164+0000 7f5e85383640 1 --2- 172.21.15.7:0/1062114769 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e800b53b0 0x7f5e80157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:22.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.164+0000 7f5e84b82640 1 --2- 172.21.15.7:0/1062114769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e800ce2b0 0x7f5e801598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:22.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.164+0000 7f5e85b84640 1 -- 172.21.15.7:0/1062114769 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e800b53b0 msgr2=0x7f5e80157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:22.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.164+0000 7f5e85b84640 1 --2- 172.21.15.7:0/1062114769 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e800b53b0 0x7f5e80157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:22.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.164+0000 7f5e85b84640 1 -- 172.21.15.7:0/1062114769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e800ce2b0 msgr2=0x7f5e801598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:22.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.164+0000 7f5e85b84640 1 --2- 172.21.15.7:0/1062114769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e800ce2b0 0x7f5e801598b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:22.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.164+0000 7f5e85b84640 1 -- 172.21.15.7:0/1062114769 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e801580b0 con 0x7f5e8015db00 2024-04-25T09:54:22.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.164+0000 7f5e85383640 1 --2- 172.21.15.7:0/1062114769 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e800b53b0 0x7f5e80157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:22.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.165+0000 7f5e85b84640 1 --2- 172.21.15.7:0/1062114769 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e8015db00 0x7f5e80148910 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c009eb0 tx=0x7f5e7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:22.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.165+0000 7f5e75ffb640 1 -- 172.21.15.7:0/1062114769 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c040070 con 0x7f5e8015db00 2024-04-25T09:54:22.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.165+0000 7f5e75ffb640 1 -- 172.21.15.7:0/1062114769 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7c031c90 con 0x7f5e8015db00 2024-04-25T09:54:22.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.165+0000 7f5e875e7640 1 -- 172.21.15.7:0/1062114769 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e80160ed0 con 0x7f5e8015db00 2024-04-25T09:54:22.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.165+0000 7f5e75ffb640 1 -- 172.21.15.7:0/1062114769 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c045680 con 0x7f5e8015db00 2024-04-25T09:54:22.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.165+0000 7f5e875e7640 1 -- 172.21.15.7:0/1062114769 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e801569d0 con 0x7f5e8015db00 2024-04-25T09:54:22.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.166+0000 7f5e875e7640 1 -- 172.21.15.7:0/1062114769 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e80068fd0 con 0x7f5e8015db00 2024-04-25T09:54:22.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.166+0000 7f5e75ffb640 1 -- 172.21.15.7:0/1062114769 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5e7c039040 con 0x7f5e8015db00 2024-04-25T09:54:22.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.167+0000 7f5e75ffb640 1 --2- 172.21.15.7:0/1062114769 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5e6406b4d0 0x7f5e6406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:22.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.167+0000 7f5e75ffb640 1 -- 172.21.15.7:0/1062114769 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5e7c0ab9f0 con 0x7f5e8015db00 2024-04-25T09:54:22.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.167+0000 7f5e85383640 1 --2- 172.21.15.7:0/1062114769 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5e6406b4d0 0x7f5e6406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:22.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.167+0000 7f5e85383640 1 --2- 172.21.15.7:0/1062114769 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5e6406b4d0 0x7f5e6406d990 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5e78006fd0 tx=0x7f5e78008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:22.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.172+0000 7f5e75ffb640 1 -- 172.21.15.7:0/1062114769 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5e7c043360 con 0x7f5e8015db00 2024-04-25T09:54:22.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.390+0000 7f5e875e7640 1 -- 172.21.15.7:0/1062114769 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e800d16b0 con 0x7f5e8015db00 2024-04-25T09:54:22.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.391+0000 7f5e75ffb640 1 -- 172.21.15.7:0/1062114769 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1321 (secure 0 0 0) 0x7f5e7c07ab50 con 0x7f5e8015db00 2024-04-25T09:54:22.392 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:22.393 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/2289657027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2289657027},{"type":"v1","addr":"172.21.15.7:6836","nonce":2289657027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-04-25T09:54:22.393 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 2 2024-04-25T09:54:22.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.393+0000 7f5e875e7640 1 -- 172.21.15.7:0/1062114769 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5e6406b4d0 msgr2=0x7f5e6406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:22.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.393+0000 7f5e875e7640 1 --2- 172.21.15.7:0/1062114769 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5e6406b4d0 0x7f5e6406d990 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5e78006fd0 tx=0x7f5e78008040 comp rx=0 tx=0).stop 2024-04-25T09:54:22.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.393+0000 7f5e875e7640 1 -- 172.21.15.7:0/1062114769 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e8015db00 msgr2=0x7f5e80148910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:22.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.393+0000 7f5e875e7640 1 --2- 172.21.15.7:0/1062114769 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e8015db00 0x7f5e80148910 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c009eb0 tx=0x7f5e7c004a40 comp rx=0 tx=0).stop 2024-04-25T09:54:22.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.393+0000 7f5e875e7640 1 -- 172.21.15.7:0/1062114769 shutdown_connections 2024-04-25T09:54:22.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.393+0000 7f5e875e7640 1 --2- 172.21.15.7:0/1062114769 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5e6406b4d0 0x7f5e6406d990 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:22.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.393+0000 7f5e875e7640 1 --2- 172.21.15.7:0/1062114769 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e8015db00 0x7f5e80148910 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:22.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.393+0000 7f5e875e7640 1 --2- 172.21.15.7:0/1062114769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e800ce2b0 0x7f5e801598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:22.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.393+0000 7f5e875e7640 1 --2- 172.21.15.7:0/1062114769 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e800b53b0 0x7f5e80157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:22.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.393+0000 7f5e875e7640 1 -- 172.21.15.7:0/1062114769 >> 172.21.15.7:0/1062114769 conn(0x7f5e80072290 msgr2=0x7f5e800b81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:22.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.393+0000 7f5e875e7640 1 -- 172.21.15.7:0/1062114769 shutdown_connections 2024-04-25T09:54:22.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:22.393+0000 7f5e875e7640 1 -- 172.21.15.7:0/1062114769 wait complete. 2024-04-25T09:54:24.405 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:54:24.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.517+0000 7f08537d5640 1 Processor -- start 2024-04-25T09:54:24.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.517+0000 7f08537d5640 1 -- start start 2024-04-25T09:54:24.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.518+0000 7f08537d5640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f084c0d0a50 0x7f084c0d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:24.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.518+0000 7f08537d5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f084c0b53b0 0x7f084c0d2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:24.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.518+0000 7f08537d5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f084c0d1e80 con 0x7f084c15db00 2024-04-25T09:54:24.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.518+0000 7f08537d5640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f084c0b5930 con 0x7f084c0d0a50 2024-04-25T09:54:24.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.518+0000 7f08537d5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f084c0b5c10 con 0x7f084c0b53b0 2024-04-25T09:54:24.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.518+0000 7f0850d70640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f084c0d0a50 0x7f084c0d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:24.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.518+0000 7f0850d70640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f084c0d0a50 0x7f084c0d2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50474/0 (socket says 172.21.15.7:50474) 2024-04-25T09:54:24.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.518+0000 7f0850d70640 1 -- 172.21.15.7:0/3433711884 learned_addr learned my addr 172.21.15.7:0/3433711884 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:24.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.518+0000 7f0851d72640 1 --2- 172.21.15.7:0/3433711884 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f084c0b53b0 0x7f084c0d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:24.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.518+0000 7f0850d70640 1 -- 172.21.15.7:0/3433711884 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f084c0b53b0 msgr2=0x7f084c0d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:24.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.518+0000 7f0850d70640 1 --2- 172.21.15.7:0/3433711884 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f084c0b53b0 0x7f084c0d2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:24.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.518+0000 7f0850d70640 1 -- 172.21.15.7:0/3433711884 >> v1:172.21.15.55:6789/0 conn(0x7f084c15db00 legacy=0x7f084c0d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:24.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.518+0000 7f0850d70640 1 -- 172.21.15.7:0/3433711884 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f084c0b5ef0 con 0x7f084c0d0a50 2024-04-25T09:54:24.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.519+0000 7f0850d70640 1 --2- 172.21.15.7:0/3433711884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f084c0d0a50 0x7f084c0d2330 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f083c009870 tx=0x7f083c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d302bb8164c0e0de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:24.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.519+0000 7f0843fff640 1 -- 172.21.15.7:0/3433711884 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c037070 con 0x7f084c0d0a50 2024-04-25T09:54:24.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.519+0000 7f0843fff640 1 -- 172.21.15.7:0/3433711884 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083c032440 con 0x7f084c0d0a50 2024-04-25T09:54:24.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.519+0000 7f0843fff640 1 -- 172.21.15.7:0/3433711884 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c032810 con 0x7f084c0d0a50 2024-04-25T09:54:24.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.520+0000 7f08537d5640 1 -- 172.21.15.7:0/3433711884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f084c0d0a50 msgr2=0x7f084c0d2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:24.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.520+0000 7f08537d5640 1 --2- 172.21.15.7:0/3433711884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f084c0d0a50 0x7f084c0d2330 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f083c009870 tx=0x7f083c02a270 comp rx=0 tx=0).stop 2024-04-25T09:54:24.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.520+0000 7f08537d5640 1 -- 172.21.15.7:0/3433711884 shutdown_connections 2024-04-25T09:54:24.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.520+0000 7f08537d5640 1 --2- 172.21.15.7:0/3433711884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f084c0d0a50 0x7f084c0d2330 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:24.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.520+0000 7f08537d5640 1 --2- 172.21.15.7:0/3433711884 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f084c0b53b0 0x7f084c0d2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:24.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.520+0000 7f08537d5640 1 -- 172.21.15.7:0/3433711884 >> 172.21.15.7:0/3433711884 conn(0x7f084c072290 msgr2=0x7f084c0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:24.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.520+0000 7f08537d5640 1 -- 172.21.15.7:0/3433711884 shutdown_connections 2024-04-25T09:54:24.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.520+0000 7f08537d5640 1 -- 172.21.15.7:0/3433711884 wait complete. 2024-04-25T09:54:24.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.521+0000 7f08537d5640 1 Processor -- start 2024-04-25T09:54:24.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.521+0000 7f08537d5640 1 -- start start 2024-04-25T09:54:24.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.522+0000 7f08537d5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f084c0b53b0 0x7f084c1563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:24.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.522+0000 7f08537d5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f084c0d0a50 0x7f084c156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:24.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.522+0000 7f08537d5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f084c15db00 0x7f084c1f73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:24.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.522+0000 7f08537d5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084c0d3660 con 0x7f084c0d0a50 2024-04-25T09:54:24.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.522+0000 7f08537d5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084c0b61d0 con 0x7f084c0b53b0 2024-04-25T09:54:24.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.522+0000 7f08537d5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f084c0ce2b0 con 0x7f084c15db00 2024-04-25T09:54:24.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.522+0000 7f0850d70640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f084c0d0a50 0x7f084c156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:24.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.522+0000 7f0850d70640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f084c0d0a50 0x7f084c156930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50488/0 (socket says 172.21.15.7:50488) 2024-04-25T09:54:24.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.522+0000 7f0850d70640 1 -- 172.21.15.7:0/3032919662 learned_addr learned my addr 172.21.15.7:0/3032919662 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:24.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.522+0000 7f0850d70640 1 -- 172.21.15.7:0/3032919662 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f084c15db00 msgr2=0x7f084c1f73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:24.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.522+0000 7f0850d70640 1 --2- 172.21.15.7:0/3032919662 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f084c15db00 0x7f084c1f73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:24.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.522+0000 7f0850d70640 1 -- 172.21.15.7:0/3032919662 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f084c0b53b0 msgr2=0x7f084c1563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:24.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.522+0000 7f0850d70640 1 --2- 172.21.15.7:0/3032919662 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f084c0b53b0 0x7f084c1563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:24.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.522+0000 7f0850d70640 1 -- 172.21.15.7:0/3032919662 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f084c0c7c60 con 0x7f084c0d0a50 2024-04-25T09:54:24.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.522+0000 7f0850d70640 1 --2- 172.21.15.7:0/3032919662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f084c0d0a50 0x7f084c156930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f083c000c00 tx=0x7f083c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:24.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.522+0000 7f0841ffb640 1 -- 172.21.15.7:0/3032919662 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c041020 con 0x7f084c0d0a50 2024-04-25T09:54:24.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.522+0000 7f0841ffb640 1 -- 172.21.15.7:0/3032919662 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083c0306c0 con 0x7f084c0d0a50 2024-04-25T09:54:24.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.522+0000 7f08537d5640 1 -- 172.21.15.7:0/3032919662 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f084c156fb0 con 0x7f084c0d0a50 2024-04-25T09:54:24.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.522+0000 7f0841ffb640 1 -- 172.21.15.7:0/3032919662 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c037040 con 0x7f084c0d0a50 2024-04-25T09:54:24.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.523+0000 7f08537d5640 1 -- 172.21.15.7:0/3032919662 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f084c0c7ed0 con 0x7f084c0d0a50 2024-04-25T09:54:24.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.524+0000 7f08537d5640 1 -- 172.21.15.7:0/3032919662 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f084c068fd0 con 0x7f084c0d0a50 2024-04-25T09:54:24.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.524+0000 7f0841ffb640 1 -- 172.21.15.7:0/3032919662 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f083c044020 con 0x7f084c0d0a50 2024-04-25T09:54:24.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.525+0000 7f0841ffb640 1 --2- 172.21.15.7:0/3032919662 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f083006b4d0 0x7f083006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:24.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.525+0000 7f0841ffb640 1 -- 172.21.15.7:0/3032919662 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f083c0aa660 con 0x7f084c0d0a50 2024-04-25T09:54:24.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.525+0000 7f0851571640 1 --2- 172.21.15.7:0/3032919662 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f083006b4d0 0x7f083006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:24.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.525+0000 7f0851571640 1 --2- 172.21.15.7:0/3032919662 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f083006b4d0 0x7f083006d990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0848000f60 tx=0x7f08480079d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:24.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.529+0000 7f0841ffb640 1 -- 172.21.15.7:0/3032919662 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f083c04b030 con 0x7f084c0d0a50 2024-04-25T09:54:24.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.748+0000 7f08537d5640 1 -- 172.21.15.7:0/3032919662 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f084c0d16b0 con 0x7f084c0d0a50 2024-04-25T09:54:24.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.749+0000 7f0841ffb640 1 -- 172.21.15.7:0/3032919662 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3688 (secure 0 0 0) 0x7f083c079830 con 0x7f084c0d0a50 2024-04-25T09:54:24.750 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:24.750 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1968579214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1968579214},{"type":"v1","addr":"172.21.15.7:6837","nonce":1968579214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3479570567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3479570567},{"type":"v1","addr":"172.21.15.55:6834","nonce":3479570567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/2289657027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2289657027},{"type":"v1","addr":"172.21.15.7:6836","nonce":2289657027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3779228372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3779228372},{"type":"v1","addr":"172.21.15.55:6835","nonce":3779228372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-04-25T09:54:24.751 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 3 2024-04-25T09:54:24.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.751+0000 7f08537d5640 1 -- 172.21.15.7:0/3032919662 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f083006b4d0 msgr2=0x7f083006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:24.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.751+0000 7f08537d5640 1 --2- 172.21.15.7:0/3032919662 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f083006b4d0 0x7f083006d990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0848000f60 tx=0x7f08480079d0 comp rx=0 tx=0).stop 2024-04-25T09:54:24.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.751+0000 7f08537d5640 1 -- 172.21.15.7:0/3032919662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f084c0d0a50 msgr2=0x7f084c156930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:24.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.751+0000 7f08537d5640 1 --2- 172.21.15.7:0/3032919662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f084c0d0a50 0x7f084c156930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f083c000c00 tx=0x7f083c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:54:24.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.751+0000 7f08537d5640 1 -- 172.21.15.7:0/3032919662 shutdown_connections 2024-04-25T09:54:24.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.751+0000 7f08537d5640 1 --2- 172.21.15.7:0/3032919662 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f083006b4d0 0x7f083006d990 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:24.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.751+0000 7f08537d5640 1 --2- 172.21.15.7:0/3032919662 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f084c15db00 0x7f084c1f73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:24.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.751+0000 7f08537d5640 1 --2- 172.21.15.7:0/3032919662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f084c0d0a50 0x7f084c156930 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:24.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.751+0000 7f08537d5640 1 --2- 172.21.15.7:0/3032919662 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f084c0b53b0 0x7f084c1563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:24.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.751+0000 7f08537d5640 1 -- 172.21.15.7:0/3032919662 >> 172.21.15.7:0/3032919662 conn(0x7f084c072290 msgr2=0x7f084c15ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:24.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.751+0000 7f08537d5640 1 -- 172.21.15.7:0/3032919662 shutdown_connections 2024-04-25T09:54:24.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.751+0000 7f08537d5640 1 -- 172.21.15.7:0/3032919662 wait complete. 2024-04-25T09:54:24.763 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:54:24.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.862+0000 7f19f2f17640 1 Processor -- start 2024-04-25T09:54:24.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.862+0000 7f19f2f17640 1 -- start start 2024-04-25T09:54:24.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.863+0000 7f19f2f17640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f19ec15db00 0x7f19ec0d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:24.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.863+0000 7f19f2f17640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19ec0ce2b0 0x7f19ec0d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:24.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.863+0000 7f19f2f17640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19ec0d1e80 con 0x7f19ec0b53b0 2024-04-25T09:54:24.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.863+0000 7f19f2f17640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19ec0b5930 con 0x7f19ec15db00 2024-04-25T09:54:24.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.863+0000 7f19f2f17640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec0b5c10 con 0x7f19ec0ce2b0 2024-04-25T09:54:24.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.863+0000 7f19f0cb3640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f19ec15db00 0x7f19ec0d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:24.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.863+0000 7f19f0cb3640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f19ec15db00 0x7f19ec0d0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50504/0 (socket says 172.21.15.7:50504) 2024-04-25T09:54:24.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.863+0000 7f19f0cb3640 1 -- 172.21.15.7:0/4012628052 learned_addr learned my addr 172.21.15.7:0/4012628052 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:24.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.863+0000 7f19f14b4640 1 --2- 172.21.15.7:0/4012628052 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19ec0ce2b0 0x7f19ec0d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:24.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.863+0000 7f19f0cb3640 1 -- 172.21.15.7:0/4012628052 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19ec0ce2b0 msgr2=0x7f19ec0d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:24.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.863+0000 7f19f0cb3640 1 --2- 172.21.15.7:0/4012628052 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19ec0ce2b0 0x7f19ec0d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:24.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.863+0000 7f19f0cb3640 1 -- 172.21.15.7:0/4012628052 >> v1:172.21.15.55:6789/0 conn(0x7f19ec0b53b0 legacy=0x7f19ec161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:24.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.863+0000 7f19f0cb3640 1 -- 172.21.15.7:0/4012628052 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ec0b5ef0 con 0x7f19ec15db00 2024-04-25T09:54:24.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.864+0000 7f19f0cb3640 1 --2- 172.21.15.7:0/4012628052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19ec15db00 0x7f19ec0d0340 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009870 tx=0x7f19e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea79c526174381a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:24.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.864+0000 7f19eb7fe640 1 -- 172.21.15.7:0/4012628052 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e0037070 con 0x7f19ec15db00 2024-04-25T09:54:24.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.864+0000 7f19eb7fe640 1 -- 172.21.15.7:0/4012628052 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e0032440 con 0x7f19ec15db00 2024-04-25T09:54:24.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.864+0000 7f19eb7fe640 1 -- 172.21.15.7:0/4012628052 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e0032810 con 0x7f19ec15db00 2024-04-25T09:54:24.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.864+0000 7f19f2f17640 1 -- 172.21.15.7:0/4012628052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19ec15db00 msgr2=0x7f19ec0d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:24.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.864+0000 7f19f2f17640 1 --2- 172.21.15.7:0/4012628052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19ec15db00 0x7f19ec0d0340 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009870 tx=0x7f19e002a270 comp rx=0 tx=0).stop 2024-04-25T09:54:24.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.865+0000 7f19f2f17640 1 -- 172.21.15.7:0/4012628052 shutdown_connections 2024-04-25T09:54:24.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.865+0000 7f19f2f17640 1 --2- 172.21.15.7:0/4012628052 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19ec0ce2b0 0x7f19ec0d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:24.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.865+0000 7f19f2f17640 1 --2- 172.21.15.7:0/4012628052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19ec15db00 0x7f19ec0d0340 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:24.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.865+0000 7f19f2f17640 1 -- 172.21.15.7:0/4012628052 >> 172.21.15.7:0/4012628052 conn(0x7f19ec072290 msgr2=0x7f19ec0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:24.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.865+0000 7f19f2f17640 1 -- 172.21.15.7:0/4012628052 shutdown_connections 2024-04-25T09:54:24.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.865+0000 7f19f2f17640 1 -- 172.21.15.7:0/4012628052 wait complete. 2024-04-25T09:54:24.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.866+0000 7f19f2f17640 1 Processor -- start 2024-04-25T09:54:24.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.866+0000 7f19f2f17640 1 -- start start 2024-04-25T09:54:24.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.867+0000 7f19f2f17640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19ec0b53b0 0x7f19ec0cd590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:24.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.867+0000 7f19f2f17640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19ec0ce2b0 0x7f19ec15a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:24.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.867+0000 7f19f2f17640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19ec15db00 0x7f19ec1f3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:24.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.867+0000 7f19f2f17640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec0d3660 con 0x7f19ec0ce2b0 2024-04-25T09:54:24.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.867+0000 7f19f2f17640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec0b61d0 con 0x7f19ec0b53b0 2024-04-25T09:54:24.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.867+0000 7f19f2f17640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec0b6c10 con 0x7f19ec15db00 2024-04-25T09:54:24.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.867+0000 7f19ebfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19ec0ce2b0 0x7f19ec15a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:24.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.867+0000 7f19ebfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19ec0ce2b0 0x7f19ec15a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50520/0 (socket says 172.21.15.7:50520) 2024-04-25T09:54:24.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.867+0000 7f19ebfff640 1 -- 172.21.15.7:0/3749954660 learned_addr learned my addr 172.21.15.7:0/3749954660 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:24.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.867+0000 7f19f0cb3640 1 --2- 172.21.15.7:0/3749954660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19ec0b53b0 0x7f19ec0cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:24.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.867+0000 7f19ebfff640 1 -- 172.21.15.7:0/3749954660 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19ec15db00 msgr2=0x7f19ec1f3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:24.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.867+0000 7f19f14b4640 1 --2- 172.21.15.7:0/3749954660 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19ec15db00 0x7f19ec1f3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:24.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.867+0000 7f19ebfff640 1 --2- 172.21.15.7:0/3749954660 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19ec15db00 0x7f19ec1f3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:24.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.867+0000 7f19ebfff640 1 -- 172.21.15.7:0/3749954660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19ec0b53b0 msgr2=0x7f19ec0cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:24.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.867+0000 7f19ebfff640 1 --2- 172.21.15.7:0/3749954660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19ec0b53b0 0x7f19ec0cd590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:24.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.867+0000 7f19ebfff640 1 -- 172.21.15.7:0/3749954660 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ec15a940 con 0x7f19ec0ce2b0 2024-04-25T09:54:24.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.867+0000 7f19ebfff640 1 --2- 172.21.15.7:0/3749954660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19ec0ce2b0 0x7f19ec15a400 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f19d800c400 tx=0x7f19d800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:24.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.867+0000 7f19e97fa640 1 -- 172.21.15.7:0/3749954660 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d80052d0 con 0x7f19ec0ce2b0 2024-04-25T09:54:24.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.867+0000 7f19e97fa640 1 -- 172.21.15.7:0/3749954660 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d8005490 con 0x7f19ec0ce2b0 2024-04-25T09:54:24.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.867+0000 7f19f2f17640 1 -- 172.21.15.7:0/3749954660 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19ec15ac10 con 0x7f19ec0ce2b0 2024-04-25T09:54:24.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.867+0000 7f19e97fa640 1 -- 172.21.15.7:0/3749954660 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d8007260 con 0x7f19ec0ce2b0 2024-04-25T09:54:24.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.867+0000 7f19f2f17640 1 -- 172.21.15.7:0/3749954660 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19ec15b1d0 con 0x7f19ec0ce2b0 2024-04-25T09:54:24.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.869+0000 7f19f2f17640 1 -- 172.21.15.7:0/3749954660 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19ec0cff20 con 0x7f19ec0ce2b0 2024-04-25T09:54:24.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.869+0000 7f19e97fa640 1 -- 172.21.15.7:0/3749954660 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f19d8007400 con 0x7f19ec0ce2b0 2024-04-25T09:54:24.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.869+0000 7f19e97fa640 1 --2- 172.21.15.7:0/3749954660 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f19d006b4d0 0x7f19d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:24.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.869+0000 7f19f0cb3640 1 --2- 172.21.15.7:0/3749954660 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f19d006b4d0 0x7f19d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:24.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.869+0000 7f19e97fa640 1 -- 172.21.15.7:0/3749954660 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f19d8089430 con 0x7f19ec0ce2b0 2024-04-25T09:54:24.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.870+0000 7f19f0cb3640 1 --2- 172.21.15.7:0/3749954660 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f19d006b4d0 0x7f19d006d990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f19e0034000 tx=0x7f19e002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:24.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:24.873+0000 7f19e97fa640 1 -- 172.21.15.7:0/3749954660 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f19ec0cff20 con 0x7f19ec0ce2b0 2024-04-25T09:54:25.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.052+0000 7f19f2f17640 1 -- 172.21.15.7:0/3749954660 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19ec068fd0 con 0x7f19ec0ce2b0 2024-04-25T09:54:25.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.053+0000 7f19e97fa640 1 -- 172.21.15.7:0/3749954660 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12788 (secure 0 0 0) 0x7f19d8058600 con 0x7f19ec0ce2b0 2024-04-25T09:54:25.055 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:25.055 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":17,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:54:18.071830+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:54:25.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.055+0000 7f19f2f17640 1 -- 172.21.15.7:0/3749954660 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f19d006b4d0 msgr2=0x7f19d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:25.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.055+0000 7f19f2f17640 1 --2- 172.21.15.7:0/3749954660 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f19d006b4d0 0x7f19d006d990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f19e0034000 tx=0x7f19e002e000 comp rx=0 tx=0).stop 2024-04-25T09:54:25.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.055+0000 7f19f2f17640 1 -- 172.21.15.7:0/3749954660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19ec0ce2b0 msgr2=0x7f19ec15a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:25.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.055+0000 7f19f2f17640 1 --2- 172.21.15.7:0/3749954660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19ec0ce2b0 0x7f19ec15a400 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f19d800c400 tx=0x7f19d800c8c0 comp rx=0 tx=0).stop 2024-04-25T09:54:25.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.055+0000 7f19f2f17640 1 -- 172.21.15.7:0/3749954660 shutdown_connections 2024-04-25T09:54:25.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.055+0000 7f19f2f17640 1 --2- 172.21.15.7:0/3749954660 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f19d006b4d0 0x7f19d006d990 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:25.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.055+0000 7f19f2f17640 1 --2- 172.21.15.7:0/3749954660 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19ec15db00 0x7f19ec1f3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:25.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.055+0000 7f19f2f17640 1 --2- 172.21.15.7:0/3749954660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19ec0ce2b0 0x7f19ec15a400 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:25.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.055+0000 7f19f2f17640 1 --2- 172.21.15.7:0/3749954660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19ec0b53b0 0x7f19ec0cd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:25.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.055+0000 7f19f2f17640 1 -- 172.21.15.7:0/3749954660 >> 172.21.15.7:0/3749954660 conn(0x7f19ec072290 msgr2=0x7f19ec0c7460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:25.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.055+0000 7f19f2f17640 1 -- 172.21.15.7:0/3749954660 shutdown_connections 2024-04-25T09:54:25.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.055+0000 7f19f2f17640 1 -- 172.21.15.7:0/3749954660 wait complete. 2024-04-25T09:54:25.067 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:54:25.068 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:54:25.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.170+0000 7f21ae2fc640 1 Processor -- start 2024-04-25T09:54:25.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.170+0000 7f21ae2fc640 1 -- start start 2024-04-25T09:54:25.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.171+0000 7f21ae2fc640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f21a80ce680 0x7f21a80ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:25.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.171+0000 7f21ae2fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f21a80b6a70 0x7f21a80b6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:25.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.171+0000 7f21ae2fc640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a80cf050 con 0x7f21a815db30 2024-04-25T09:54:25.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.171+0000 7f21ae2fc640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a815df10 con 0x7f21a80ce680 2024-04-25T09:54:25.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.171+0000 7f21ae2fc640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a80d1780 con 0x7f21a80b6a70 2024-04-25T09:54:25.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.171+0000 7f21a77fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f21a80ce680 0x7f21a80ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:25.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.171+0000 7f21a7fff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f21a815db30 0x7f21a80d0440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46576/0 (socket says 172.21.15.7:46576) 2024-04-25T09:54:25.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.171+0000 7f21a7fff640 1 -- 172.21.15.7:0/2441977854 learned_addr learned my addr 172.21.15.7:0/2441977854 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:25.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.171+0000 7f21ac899640 1 --2- 172.21.15.7:0/2441977854 >> v2:172.21.15.55:3300/0 conn(0x7f21a80b6a70 0x7f21a80b6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:25.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.172+0000 7f21a77fe640 1 -- 172.21.15.7:0/2441977854 >> v2:172.21.15.55:3300/0 conn(0x7f21a80b6a70 msgr2=0x7f21a80b6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:25.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.172+0000 7f21a77fe640 1 --2- 172.21.15.7:0/2441977854 >> v2:172.21.15.55:3300/0 conn(0x7f21a80b6a70 0x7f21a80b6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:25.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.172+0000 7f21a77fe640 1 -- 172.21.15.7:0/2441977854 >> v1:172.21.15.7:6789/0 conn(0x7f21a815db30 legacy=0x7f21a80d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:25.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.172+0000 7f21a77fe640 1 -- 172.21.15.7:0/2441977854 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a80d1a60 con 0x7f21a80ce680 2024-04-25T09:54:25.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.172+0000 7f21a77fe640 1 --2- 172.21.15.7:0/2441977854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21a80ce680 0x7f21a80ceb10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f21a80c7320 tx=0x7f219c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed267c9b3ee71b32 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:25.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.172+0000 7f21a6ffd640 1 -- 172.21.15.7:0/2441977854 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c037070 con 0x7f21a80ce680 2024-04-25T09:54:25.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.172+0000 7f21a6ffd640 1 -- 172.21.15.7:0/2441977854 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219c032440 con 0x7f21a80ce680 2024-04-25T09:54:25.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.172+0000 7f21a6ffd640 1 -- 172.21.15.7:0/2441977854 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c032810 con 0x7f21a80ce680 2024-04-25T09:54:25.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.173+0000 7f21ae2fc640 1 -- 172.21.15.7:0/2441977854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21a80ce680 msgr2=0x7f21a80ceb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:25.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.173+0000 7f21ae2fc640 1 --2- 172.21.15.7:0/2441977854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21a80ce680 0x7f21a80ceb10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f21a80c7320 tx=0x7f219c02a1a0 comp rx=0 tx=0).stop 2024-04-25T09:54:25.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.173+0000 7f21ae2fc640 1 -- 172.21.15.7:0/2441977854 shutdown_connections 2024-04-25T09:54:25.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.173+0000 7f21ae2fc640 1 --2- 172.21.15.7:0/2441977854 >> v2:172.21.15.55:3300/0 conn(0x7f21a80b6a70 0x7f21a80b6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:25.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.173+0000 7f21ae2fc640 1 --2- 172.21.15.7:0/2441977854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21a80ce680 0x7f21a80ceb10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:25.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.173+0000 7f21ae2fc640 1 -- 172.21.15.7:0/2441977854 >> 172.21.15.7:0/2441977854 conn(0x7f21a80728c0 msgr2=0x7f21a806bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:25.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.173+0000 7f21ae2fc640 1 -- 172.21.15.7:0/2441977854 shutdown_connections 2024-04-25T09:54:25.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.173+0000 7f21ae2fc640 1 -- 172.21.15.7:0/2441977854 wait complete. 2024-04-25T09:54:25.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.174+0000 7f21ae2fc640 1 Processor -- start 2024-04-25T09:54:25.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.174+0000 7f21ae2fc640 1 -- start start 2024-04-25T09:54:25.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.175+0000 7f21ae2fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21a80b6a70 0x7f21a81f3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:25.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.175+0000 7f21ae2fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21a80ce680 0x7f21a813b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:25.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.175+0000 7f21ae2fc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f21a815db30 0x7f21a813b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:25.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.175+0000 7f21ae2fc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a80d1410 con 0x7f21a80ce680 2024-04-25T09:54:25.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.175+0000 7f21ae2fc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a80d2020 con 0x7f21a80b6a70 2024-04-25T09:54:25.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.175+0000 7f21ae2fc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a80d0b50 con 0x7f21a815db30 2024-04-25T09:54:25.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.175+0000 7f21a77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21a80ce680 0x7f21a813b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:25.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.175+0000 7f21a77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21a80ce680 0x7f21a813b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50540/0 (socket says 172.21.15.7:50540) 2024-04-25T09:54:25.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.175+0000 7f21a77fe640 1 -- 172.21.15.7:0/1832119808 learned_addr learned my addr 172.21.15.7:0/1832119808 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:25.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.175+0000 7f21a7fff640 1 --2- 172.21.15.7:0/1832119808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21a80b6a70 0x7f21a81f3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:25.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.175+0000 7f21ac899640 1 --2- 172.21.15.7:0/1832119808 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f21a815db30 0x7f21a813b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:25.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.176+0000 7f21a77fe640 1 -- 172.21.15.7:0/1832119808 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f21a815db30 msgr2=0x7f21a813b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:25.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.176+0000 7f21a77fe640 1 --2- 172.21.15.7:0/1832119808 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f21a815db30 0x7f21a813b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:25.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.176+0000 7f21a77fe640 1 -- 172.21.15.7:0/1832119808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21a80b6a70 msgr2=0x7f21a81f3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:25.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.176+0000 7f21a77fe640 1 --2- 172.21.15.7:0/1832119808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21a80b6a70 0x7f21a81f3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:25.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.176+0000 7f21a77fe640 1 -- 172.21.15.7:0/1832119808 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a80c9410 con 0x7f21a80ce680 2024-04-25T09:54:25.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.176+0000 7f21a77fe640 1 --2- 172.21.15.7:0/1832119808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21a80ce680 0x7f21a813b270 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f219c000c00 tx=0x7f219c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:25.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.176+0000 7f21a4ff9640 1 -- 172.21.15.7:0/1832119808 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c037040 con 0x7f21a80ce680 2024-04-25T09:54:25.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.176+0000 7f21a4ff9640 1 -- 172.21.15.7:0/1832119808 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219c042070 con 0x7f21a80ce680 2024-04-25T09:54:25.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.176+0000 7f21ae2fc640 1 -- 172.21.15.7:0/1832119808 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a80c96f0 con 0x7f21a80ce680 2024-04-25T09:54:25.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.176+0000 7f21a4ff9640 1 -- 172.21.15.7:0/1832119808 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c030920 con 0x7f21a80ce680 2024-04-25T09:54:25.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.176+0000 7f21ae2fc640 1 -- 172.21.15.7:0/1832119808 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a80c9cb0 con 0x7f21a80ce680 2024-04-25T09:54:25.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.177+0000 7f21ae2fc640 1 -- 172.21.15.7:0/1832119808 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a8068f60 con 0x7f21a80ce680 2024-04-25T09:54:25.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.177+0000 7f21a4ff9640 1 -- 172.21.15.7:0/1832119808 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f219c030ac0 con 0x7f21a80ce680 2024-04-25T09:54:25.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.178+0000 7f21a4ff9640 1 --2- 172.21.15.7:0/1832119808 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f219406b4d0 0x7f219406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:25.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.178+0000 7f21a4ff9640 1 -- 172.21.15.7:0/1832119808 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f219c0aa7d0 con 0x7f21a80ce680 2024-04-25T09:54:25.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.178+0000 7f21a7fff640 1 --2- 172.21.15.7:0/1832119808 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f219406b4d0 0x7f219406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:25.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.178+0000 7f21a7fff640 1 --2- 172.21.15.7:0/1832119808 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f219406b4d0 0x7f219406d990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2198000f60 tx=0x7f2198009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:25.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.184+0000 7f21a4ff9640 1 -- 172.21.15.7:0/1832119808 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f219c079350 con 0x7f21a80ce680 2024-04-25T09:54:25.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.362+0000 7f21ae2fc640 1 -- 172.21.15.7:0/1832119808 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f21a80b76f0 con 0x7f21a80ce680 2024-04-25T09:54:25.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.363+0000 7f21a4ff9640 1 -- 172.21.15.7:0/1832119808 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f219c07d3f0 con 0x7f21a80ce680 2024-04-25T09:54:25.364 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T09:54:25.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.365+0000 7f21ae2fc640 1 -- 172.21.15.7:0/1832119808 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f219406b4d0 msgr2=0x7f219406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:25.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.365+0000 7f21ae2fc640 1 --2- 172.21.15.7:0/1832119808 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f219406b4d0 0x7f219406d990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2198000f60 tx=0x7f2198009040 comp rx=0 tx=0).stop 2024-04-25T09:54:25.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.365+0000 7f21ae2fc640 1 -- 172.21.15.7:0/1832119808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21a80ce680 msgr2=0x7f21a813b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:25.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.365+0000 7f21ae2fc640 1 --2- 172.21.15.7:0/1832119808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21a80ce680 0x7f21a813b270 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f219c000c00 tx=0x7f219c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:54:25.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.365+0000 7f21ae2fc640 1 -- 172.21.15.7:0/1832119808 shutdown_connections 2024-04-25T09:54:25.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.365+0000 7f21ae2fc640 1 --2- 172.21.15.7:0/1832119808 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f219406b4d0 0x7f219406d990 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:25.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.365+0000 7f21ae2fc640 1 --2- 172.21.15.7:0/1832119808 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f21a815db30 0x7f21a813b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:25.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.365+0000 7f21ae2fc640 1 --2- 172.21.15.7:0/1832119808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21a80ce680 0x7f21a813b270 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:25.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.365+0000 7f21ae2fc640 1 --2- 172.21.15.7:0/1832119808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21a80b6a70 0x7f21a81f3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:25.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.365+0000 7f21ae2fc640 1 -- 172.21.15.7:0/1832119808 >> 172.21.15.7:0/1832119808 conn(0x7f21a80728c0 msgr2=0x7f21a8159dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:25.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.365+0000 7f21ae2fc640 1 -- 172.21.15.7:0/1832119808 shutdown_connections 2024-04-25T09:54:25.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.365+0000 7f21ae2fc640 1 -- 172.21.15.7:0/1832119808 wait complete. 2024-04-25T09:54:25.377 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:54:25.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.475+0000 7f8d6c5b0640 1 Processor -- start 2024-04-25T09:54:25.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.475+0000 7f8d6c5b0640 1 -- start start 2024-04-25T09:54:25.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.476+0000 7f8d6c5b0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8d6415db00 0x7f8d640d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:25.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.476+0000 7f8d6c5b0640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d640d1e80 con 0x7f8d640ce2b0 2024-04-25T09:54:25.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.476+0000 7f8d6c5b0640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d64162490 con 0x7f8d640b53b0 2024-04-25T09:54:25.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.476+0000 7f8d6c5b0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d640b5930 con 0x7f8d6415db00 2024-04-25T09:54:25.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.476+0000 7f8d6ab4d640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f8d640ce2b0 0x7f8d64161d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46584/0 (socket says 172.21.15.7:46584) 2024-04-25T09:54:25.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.476+0000 7f8d6ab4d640 1 -- 172.21.15.7:0/4146449820 learned_addr learned my addr 172.21.15.7:0/4146449820 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:25.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.476+0000 7f8d6a34c640 1 --2- 172.21.15.7:0/4146449820 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8d6415db00 0x7f8d640d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:25.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.476+0000 7f8d6934a640 1 -- 172.21.15.7:0/4146449820 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898078729 0 0) 0x7f8d640d1e80 con 0x7f8d640ce2b0 2024-04-25T09:54:25.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.476+0000 7f8d6934a640 1 -- 172.21.15.7:0/4146449820 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d50003520 con 0x7f8d640ce2b0 2024-04-25T09:54:25.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.477+0000 7f8d6934a640 1 -- 172.21.15.7:0/4146449820 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3933733004 0 0) 0x7f8d64162490 con 0x7f8d640b53b0 2024-04-25T09:54:25.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.477+0000 7f8d6934a640 1 -- 172.21.15.7:0/4146449820 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d640d1e80 con 0x7f8d640b53b0 2024-04-25T09:54:25.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.477+0000 7f8d6934a640 1 -- 172.21.15.7:0/4146449820 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2042873723 0 0) 0x7f8d50003520 con 0x7f8d640ce2b0 2024-04-25T09:54:25.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.477+0000 7f8d6934a640 1 -- 172.21.15.7:0/4146449820 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8d6415db00 msgr2=0x7f8d640d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:25.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.477+0000 7f8d6934a640 1 --2- 172.21.15.7:0/4146449820 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8d6415db00 0x7f8d640d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:25.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.477+0000 7f8d6934a640 1 -- 172.21.15.7:0/4146449820 >> v1:172.21.15.55:6789/0 conn(0x7f8d640b53b0 legacy=0x7f8d64161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:25.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.477+0000 7f8d6934a640 1 -- 172.21.15.7:0/4146449820 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d640b5c10 con 0x7f8d640ce2b0 2024-04-25T09:54:25.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.477+0000 7f8d6934a640 1 -- 172.21.15.7:0/4146449820 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f8d5c0019f0 con 0x7f8d640ce2b0 2024-04-25T09:54:25.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.477+0000 7f8d6934a640 1 -- 172.21.15.7:0/4146449820 >> v1:172.21.15.7:6789/0 conn(0x7f8d640ce2b0 legacy=0x7f8d64161d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:25.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.477+0000 7f8d6934a640 1 --2- 172.21.15.7:0/4146449820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d50003b70 0x7f8d50003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:25.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.477+0000 7f8d6934a640 1 --2- 172.21.15.7:0/4146449820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d50004800 0x7f8d50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:25.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.477+0000 7f8d6934a640 1 --2- 172.21.15.7:0/4146449820 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8d500051c0 0x7f8d5000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:25.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.477+0000 7f8d6934a640 1 -- 172.21.15.7:0/4146449820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d640b5930 con 0x7f8d50004800 2024-04-25T09:54:25.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.477+0000 7f8d6934a640 1 -- 172.21.15.7:0/4146449820 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5000bfb0 con 0x7f8d50003b70 2024-04-25T09:54:25.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.477+0000 7f8d6934a640 1 -- 172.21.15.7:0/4146449820 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5000c1b0 con 0x7f8d500051c0 2024-04-25T09:54:25.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.477+0000 7f8d6a34c640 1 --2- 172.21.15.7:0/4146449820 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8d6415db00 0x7f8d640d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:54:25.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.477+0000 7f8d69b4b640 1 --2- 172.21.15.7:0/4146449820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d50004800 0x7f8d50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:25.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.477+0000 7f8d6ab4d640 1 --2- 172.21.15.7:0/4146449820 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8d500051c0 0x7f8d5000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:25.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.477+0000 7f8d6a34c640 1 --2- 172.21.15.7:0/4146449820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d50003b70 0x7f8d50003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:25.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.477+0000 7f8d69b4b640 1 -- 172.21.15.7:0/4146449820 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8d500051c0 msgr2=0x7f8d5000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:25.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.477+0000 7f8d69b4b640 1 --2- 172.21.15.7:0/4146449820 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8d500051c0 0x7f8d5000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:25.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.477+0000 7f8d69b4b640 1 -- 172.21.15.7:0/4146449820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d50003b70 msgr2=0x7f8d50003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:25.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.477+0000 7f8d69b4b640 1 --2- 172.21.15.7:0/4146449820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d50003b70 0x7f8d50003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:25.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.477+0000 7f8d69b4b640 1 -- 172.21.15.7:0/4146449820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d50003520 con 0x7f8d50004800 2024-04-25T09:54:25.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.477+0000 7f8d6ab4d640 1 --2- 172.21.15.7:0/4146449820 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8d500051c0 0x7f8d5000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:25.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.478+0000 7f8d69b4b640 1 --2- 172.21.15.7:0/4146449820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d50004800 0x7f8d50004c80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8d540018c0 tx=0x7f8d50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f586309ca3b20b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:25.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.478+0000 7f8d6934a640 1 -- 172.21.15.7:0/4146449820 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d540014e0 con 0x7f8d50004800 2024-04-25T09:54:25.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.478+0000 7f8d6934a640 1 -- 172.21.15.7:0/4146449820 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d540052f0 con 0x7f8d50004800 2024-04-25T09:54:25.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.478+0000 7f8d6934a640 1 -- 172.21.15.7:0/4146449820 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5402ac90 con 0x7f8d50004800 2024-04-25T09:54:25.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.478+0000 7f8d6c5b0640 1 -- 172.21.15.7:0/4146449820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d50004800 msgr2=0x7f8d50004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:25.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.478+0000 7f8d6c5b0640 1 --2- 172.21.15.7:0/4146449820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d50004800 0x7f8d50004c80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8d540018c0 tx=0x7f8d50005830 comp rx=0 tx=0).stop 2024-04-25T09:54:25.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.479+0000 7f8d6ab4d640 1 -- 172.21.15.7:0/4146449820 reap_dead start 2024-04-25T09:54:25.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.479+0000 7f8d6c5b0640 1 -- 172.21.15.7:0/4146449820 shutdown_connections 2024-04-25T09:54:25.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.479+0000 7f8d6c5b0640 1 -- 172.21.15.7:0/4146449820 >> 172.21.15.7:0/4146449820 conn(0x7f8d64072290 msgr2=0x7f8d640726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:25.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.479+0000 7f8d6c5b0640 1 -- 172.21.15.7:0/4146449820 shutdown_connections 2024-04-25T09:54:25.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.479+0000 7f8d6c5b0640 1 -- 172.21.15.7:0/4146449820 wait complete. 2024-04-25T09:54:25.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.480+0000 7f8d6c5b0640 1 Processor -- start 2024-04-25T09:54:25.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.480+0000 7f8d6c5b0640 1 -- start start 2024-04-25T09:54:25.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.481+0000 7f8d6c5b0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d50004800 0x7f8d64146680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:25.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.481+0000 7f8d6c5b0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d640cba50 0x7f8d6415e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:25.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.481+0000 7f8d6c5b0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8d640cbed0 0x7f8d6415e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:25.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.481+0000 7f8d6c5b0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d640b61d0 con 0x7f8d640cba50 2024-04-25T09:54:25.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.481+0000 7f8d6c5b0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6415dee0 con 0x7f8d50004800 2024-04-25T09:54:25.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.481+0000 7f8d6c5b0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d640d3660 con 0x7f8d640cbed0 2024-04-25T09:54:25.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.481+0000 7f8d69b4b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d640cba50 0x7f8d6415e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:25.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.481+0000 7f8d69b4b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d640cba50 0x7f8d6415e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50554/0 (socket says 172.21.15.7:50554) 2024-04-25T09:54:25.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.481+0000 7f8d69b4b640 1 -- 172.21.15.7:0/2398636961 learned_addr learned my addr 172.21.15.7:0/2398636961 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:25.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.481+0000 7f8d69b4b640 1 -- 172.21.15.7:0/2398636961 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8d640cbed0 msgr2=0x7f8d6415e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:25.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.481+0000 7f8d69b4b640 1 --2- 172.21.15.7:0/2398636961 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8d640cbed0 0x7f8d6415e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:25.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.481+0000 7f8d6a34c640 1 --2- 172.21.15.7:0/2398636961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d50004800 0x7f8d64146680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:25.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.481+0000 7f8d69b4b640 1 -- 172.21.15.7:0/2398636961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d50004800 msgr2=0x7f8d64146680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:25.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.481+0000 7f8d69b4b640 1 --2- 172.21.15.7:0/2398636961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d50004800 0x7f8d64146680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:25.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.481+0000 7f8d69b4b640 1 -- 172.21.15.7:0/2398636961 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d640cc410 con 0x7f8d640cba50 2024-04-25T09:54:25.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.481+0000 7f8d6a34c640 1 --2- 172.21.15.7:0/2398636961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d50004800 0x7f8d64146680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:25.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.481+0000 7f8d69b4b640 1 --2- 172.21.15.7:0/2398636961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d640cba50 0x7f8d6415e060 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8d54008fd0 tx=0x7f8d540012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:25.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.481+0000 7f8d5affd640 1 -- 172.21.15.7:0/2398636961 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d54040020 con 0x7f8d640cba50 2024-04-25T09:54:25.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.481+0000 7f8d5affd640 1 -- 172.21.15.7:0/2398636961 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d540054a0 con 0x7f8d640cba50 2024-04-25T09:54:25.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.481+0000 7f8d6c5b0640 1 -- 172.21.15.7:0/2398636961 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d640cc6f0 con 0x7f8d640cba50 2024-04-25T09:54:25.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.481+0000 7f8d5affd640 1 -- 172.21.15.7:0/2398636961 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d54007470 con 0x7f8d640cba50 2024-04-25T09:54:25.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.481+0000 7f8d6c5b0640 1 -- 172.21.15.7:0/2398636961 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d640cccb0 con 0x7f8d640cba50 2024-04-25T09:54:25.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.482+0000 7f8d6c5b0640 1 -- 172.21.15.7:0/2398636961 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d64068fd0 con 0x7f8d640cba50 2024-04-25T09:54:25.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.483+0000 7f8d5affd640 1 -- 172.21.15.7:0/2398636961 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8d54043020 con 0x7f8d640cba50 2024-04-25T09:54:25.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.483+0000 7f8d5affd640 1 --2- 172.21.15.7:0/2398636961 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8d4806b500 0x7f8d4806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:25.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.483+0000 7f8d6a34c640 1 --2- 172.21.15.7:0/2398636961 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8d4806b500 0x7f8d4806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:25.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.483+0000 7f8d5affd640 1 -- 172.21.15.7:0/2398636961 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8d540a9fe0 con 0x7f8d640cba50 2024-04-25T09:54:25.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.484+0000 7f8d6a34c640 1 --2- 172.21.15.7:0/2398636961 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8d4806b500 0x7f8d4806d9c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8d641569a0 tx=0x7f8d60008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:25.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.487+0000 7f8d5affd640 1 -- 172.21.15.7:0/2398636961 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8d5404a030 con 0x7f8d640cba50 2024-04-25T09:54:25.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.669+0000 7f8d6c5b0640 1 -- 172.21.15.7:0/2398636961 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8d640d16b0 con 0x7f8d640cba50 2024-04-25T09:54:25.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.670+0000 7f8d5affd640 1 -- 172.21.15.7:0/2398636961 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f8d540792d0 con 0x7f8d640cba50 2024-04-25T09:54:25.673 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:25.673 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2024-04-25T09:54:25.673 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:54:25.673 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2024-04-25T09:54:25.673 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2024-04-25T09:54:25.673 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:54:25.673 INFO:teuthology.orchestra.run.smithi007.stdout:] 2024-04-25T09:54:25.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.672+0000 7f8d6c5b0640 1 -- 172.21.15.7:0/2398636961 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8d4806b500 msgr2=0x7f8d4806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:25.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.672+0000 7f8d6c5b0640 1 --2- 172.21.15.7:0/2398636961 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8d4806b500 0x7f8d4806d9c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8d641569a0 tx=0x7f8d60008040 comp rx=0 tx=0).stop 2024-04-25T09:54:25.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.672+0000 7f8d6c5b0640 1 -- 172.21.15.7:0/2398636961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d640cba50 msgr2=0x7f8d6415e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:25.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.672+0000 7f8d6c5b0640 1 --2- 172.21.15.7:0/2398636961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d640cba50 0x7f8d6415e060 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8d54008fd0 tx=0x7f8d540012d0 comp rx=0 tx=0).stop 2024-04-25T09:54:25.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.672+0000 7f8d6c5b0640 1 -- 172.21.15.7:0/2398636961 shutdown_connections 2024-04-25T09:54:25.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.672+0000 7f8d6c5b0640 1 --2- 172.21.15.7:0/2398636961 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8d4806b500 0x7f8d4806d9c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:25.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.672+0000 7f8d6c5b0640 1 --2- 172.21.15.7:0/2398636961 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8d640cbed0 0x7f8d6415e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:25.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.672+0000 7f8d6c5b0640 1 --2- 172.21.15.7:0/2398636961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d640cba50 0x7f8d6415e060 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:25.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.672+0000 7f8d6c5b0640 1 --2- 172.21.15.7:0/2398636961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d50004800 0x7f8d64146680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:25.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.672+0000 7f8d6c5b0640 1 -- 172.21.15.7:0/2398636961 >> 172.21.15.7:0/2398636961 conn(0x7f8d64072290 msgr2=0x7f8d640b8040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:25.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.672+0000 7f8d6c5b0640 1 -- 172.21.15.7:0/2398636961 shutdown_connections 2024-04-25T09:54:25.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.672+0000 7f8d6c5b0640 1 -- 172.21.15.7:0/2398636961 wait complete. 2024-04-25T09:54:25.685 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:54:25.685 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:54:25.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.788+0000 7f3cc6bf5640 1 Processor -- start 2024-04-25T09:54:25.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.788+0000 7f3cc6bf5640 1 -- start start 2024-04-25T09:54:25.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.788+0000 7f3cc6bf5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3cc015de70 0x7f3cc00d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.788+0000 7f3cc6bf5640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cc00d2290 con 0x7f3cc00d3330 2024-04-25T09:54:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.788+0000 7f3cc6bf5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cc00d2570 con 0x7f3cc00d3f10 2024-04-25T09:54:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.788+0000 7f3cc6bf5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc00d2850 con 0x7f3cc015de70 2024-04-25T09:54:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.789+0000 7f3cbffff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3cc00d3330 0x7f3cc00d3800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46588/0 (socket says 172.21.15.7:46588) 2024-04-25T09:54:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.789+0000 7f3cbffff640 1 -- 172.21.15.7:0/2086174814 learned_addr learned my addr 172.21.15.7:0/2086174814 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.789+0000 7f3cc4991640 1 --2- 172.21.15.7:0/2086174814 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3cc015de70 0x7f3cc00d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.789+0000 7f3cbf7fe640 1 -- 172.21.15.7:0/2086174814 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3553346726 0 0) 0x7f3cc00d2290 con 0x7f3cc00d3330 2024-04-25T09:54:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.789+0000 7f3cbf7fe640 1 -- 172.21.15.7:0/2086174814 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cac003520 con 0x7f3cc00d3330 2024-04-25T09:54:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.789+0000 7f3cbf7fe640 1 -- 172.21.15.7:0/2086174814 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1563409245 0 0) 0x7f3cac003520 con 0x7f3cc00d3330 2024-04-25T09:54:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.789+0000 7f3cbf7fe640 1 -- 172.21.15.7:0/2086174814 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3cc015de70 msgr2=0x7f3cc00d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.789+0000 7f3cbf7fe640 1 --2- 172.21.15.7:0/2086174814 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3cc015de70 0x7f3cc00d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.789+0000 7f3cbf7fe640 1 -- 172.21.15.7:0/2086174814 >> v1:172.21.15.55:6789/0 conn(0x7f3cc00d3f10 legacy=0x7f3cc00b6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.789+0000 7f3cbf7fe640 1 -- 172.21.15.7:0/2086174814 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc00d2b30 con 0x7f3cc00d3330 2024-04-25T09:54:25.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.789+0000 7f3cbf7fe640 1 -- 172.21.15.7:0/2086174814 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f3ca8001670 con 0x7f3cc00d3330 2024-04-25T09:54:25.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.789+0000 7f3cbf7fe640 1 -- 172.21.15.7:0/2086174814 >> v1:172.21.15.7:6789/0 conn(0x7f3cc00d3330 legacy=0x7f3cc00d3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:25.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.789+0000 7f3cbf7fe640 1 --2- 172.21.15.7:0/2086174814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cac0039e0 0x7f3cac003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:25.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.789+0000 7f3cbf7fe640 1 --2- 172.21.15.7:0/2086174814 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cac004800 0x7f3cac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:25.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.789+0000 7f3cbf7fe640 1 --2- 172.21.15.7:0/2086174814 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3cc015de70 0x7f3cac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:25.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.789+0000 7f3cbf7fe640 1 -- 172.21.15.7:0/2086174814 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc00d2850 con 0x7f3cac004800 2024-04-25T09:54:25.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.789+0000 7f3cbf7fe640 1 -- 172.21.15.7:0/2086174814 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac00ba70 con 0x7f3cac0039e0 2024-04-25T09:54:25.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.789+0000 7f3cbf7fe640 1 -- 172.21.15.7:0/2086174814 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac00bc70 con 0x7f3cc015de70 2024-04-25T09:54:25.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.789+0000 7f3cbffff640 1 --2- 172.21.15.7:0/2086174814 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cac004800 0x7f3cac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:25.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.789+0000 7f3cc4991640 1 --2- 172.21.15.7:0/2086174814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cac0039e0 0x7f3cac003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:25.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.789+0000 7f3cc5192640 1 --2- 172.21.15.7:0/2086174814 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3cc015de70 0x7f3cac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:25.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.790+0000 7f3cbffff640 1 -- 172.21.15.7:0/2086174814 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3cc015de70 msgr2=0x7f3cac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:25.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.790+0000 7f3cbffff640 1 --2- 172.21.15.7:0/2086174814 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3cc015de70 0x7f3cac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:25.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.790+0000 7f3cbffff640 1 -- 172.21.15.7:0/2086174814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cac0039e0 msgr2=0x7f3cac003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:25.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.790+0000 7f3cbffff640 1 --2- 172.21.15.7:0/2086174814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cac0039e0 0x7f3cac003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:25.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.790+0000 7f3cbffff640 1 -- 172.21.15.7:0/2086174814 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cac003520 con 0x7f3cac004800 2024-04-25T09:54:25.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.790+0000 7f3cbffff640 1 --2- 172.21.15.7:0/2086174814 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cac004800 0x7f3cac004c80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3cc00d0b20 tx=0x7f3cac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d435910cc0bc12c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:25.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.790+0000 7f3cbf7fe640 1 -- 172.21.15.7:0/2086174814 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8007cf0 con 0x7f3cac004800 2024-04-25T09:54:25.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.790+0000 7f3cbf7fe640 1 -- 172.21.15.7:0/2086174814 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca8005af0 con 0x7f3cac004800 2024-04-25T09:54:25.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.790+0000 7f3cbf7fe640 1 -- 172.21.15.7:0/2086174814 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8007070 con 0x7f3cac004800 2024-04-25T09:54:25.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.791+0000 7f3cc6bf5640 1 -- 172.21.15.7:0/2086174814 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cac004800 msgr2=0x7f3cac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:25.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.791+0000 7f3cc6bf5640 1 --2- 172.21.15.7:0/2086174814 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cac004800 0x7f3cac004c80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3cc00d0b20 tx=0x7f3cac005830 comp rx=0 tx=0).stop 2024-04-25T09:54:25.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.791+0000 7f3cc5192640 1 -- 172.21.15.7:0/2086174814 reap_dead start 2024-04-25T09:54:25.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.791+0000 7f3cc6bf5640 1 -- 172.21.15.7:0/2086174814 shutdown_connections 2024-04-25T09:54:25.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.791+0000 7f3cc6bf5640 1 -- 172.21.15.7:0/2086174814 >> 172.21.15.7:0/2086174814 conn(0x7f3cc00726b0 msgr2=0x7f3cc0072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:25.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.791+0000 7f3cc6bf5640 1 -- 172.21.15.7:0/2086174814 shutdown_connections 2024-04-25T09:54:25.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.791+0000 7f3cc6bf5640 1 -- 172.21.15.7:0/2086174814 wait complete. 2024-04-25T09:54:25.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.792+0000 7f3cc6bf5640 1 Processor -- start 2024-04-25T09:54:25.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.792+0000 7f3cc6bf5640 1 -- start start 2024-04-25T09:54:25.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.793+0000 7f3cc6bf5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cac004800 0x7f3cc00c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:25.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.793+0000 7f3cc6bf5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cc0145ba0 0x7f3cc0155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:25.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.793+0000 7f3cc6bf5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3cc0155cb0 0x7f3cc00cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:25.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.793+0000 7f3cc6bf5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc00b9410 con 0x7f3cc0145ba0 2024-04-25T09:54:25.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.793+0000 7f3cc6bf5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc00b9290 con 0x7f3cac004800 2024-04-25T09:54:25.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.793+0000 7f3cc6bf5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc00d1920 con 0x7f3cc0155cb0 2024-04-25T09:54:25.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.793+0000 7f3cbffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cc0145ba0 0x7f3cc0155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:25.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.793+0000 7f3cbffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cc0145ba0 0x7f3cc0155770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50566/0 (socket says 172.21.15.7:50566) 2024-04-25T09:54:25.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.793+0000 7f3cbffff640 1 -- 172.21.15.7:0/3616910732 learned_addr learned my addr 172.21.15.7:0/3616910732 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:25.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.793+0000 7f3cc4991640 1 --2- 172.21.15.7:0/3616910732 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cac004800 0x7f3cc00c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:25.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.793+0000 7f3cc5192640 1 --2- 172.21.15.7:0/3616910732 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3cc0155cb0 0x7f3cc00cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:25.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.793+0000 7f3cbffff640 1 -- 172.21.15.7:0/3616910732 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3cc0155cb0 msgr2=0x7f3cc00cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:25.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.793+0000 7f3cbffff640 1 --2- 172.21.15.7:0/3616910732 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3cc0155cb0 0x7f3cc00cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:25.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.793+0000 7f3cbffff640 1 -- 172.21.15.7:0/3616910732 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cac004800 msgr2=0x7f3cc00c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:25.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.793+0000 7f3cbffff640 1 --2- 172.21.15.7:0/3616910732 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cac004800 0x7f3cc00c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:25.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.793+0000 7f3cbffff640 1 -- 172.21.15.7:0/3616910732 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc0146060 con 0x7f3cc0145ba0 2024-04-25T09:54:25.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.794+0000 7f3cbffff640 1 --2- 172.21.15.7:0/3616910732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cc0145ba0 0x7f3cc0155770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3ca800c300 tx=0x7f3cc00d2740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:25.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.794+0000 7f3cbd7fa640 1 -- 172.21.15.7:0/3616910732 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8041030 con 0x7f3cc0145ba0 2024-04-25T09:54:25.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.794+0000 7f3cbd7fa640 1 -- 172.21.15.7:0/3616910732 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca8038040 con 0x7f3cc0145ba0 2024-04-25T09:54:25.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.794+0000 7f3cc6bf5640 1 -- 172.21.15.7:0/3616910732 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc0146340 con 0x7f3cc0145ba0 2024-04-25T09:54:25.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.794+0000 7f3cbd7fa640 1 -- 172.21.15.7:0/3616910732 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8000ed0 con 0x7f3cc0145ba0 2024-04-25T09:54:25.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.794+0000 7f3cc6bf5640 1 -- 172.21.15.7:0/3616910732 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc0146900 con 0x7f3cc0145ba0 2024-04-25T09:54:25.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.795+0000 7f3cc6bf5640 1 -- 172.21.15.7:0/3616910732 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cc0069040 con 0x7f3cc0145ba0 2024-04-25T09:54:25.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.795+0000 7f3cbd7fa640 1 -- 172.21.15.7:0/3616910732 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3ca8044070 con 0x7f3cc0145ba0 2024-04-25T09:54:25.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.796+0000 7f3cbd7fa640 1 --2- 172.21.15.7:0/3616910732 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3ca006b670 0x7f3ca006db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:25.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.796+0000 7f3cbd7fa640 1 -- 172.21.15.7:0/3616910732 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3ca80a97b0 con 0x7f3cc0145ba0 2024-04-25T09:54:25.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.796+0000 7f3cc4991640 1 --2- 172.21.15.7:0/3616910732 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3ca006b670 0x7f3ca006db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:25.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.796+0000 7f3cc4991640 1 --2- 172.21.15.7:0/3616910732 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3ca006b670 0x7f3ca006db30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8014510 tx=0x7f3cb800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:25.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.800+0000 7f3cbd7fa640 1 -- 172.21.15.7:0/3616910732 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3ca804b020 con 0x7f3cc0145ba0 2024-04-25T09:54:25.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:25.980+0000 7f3cc6bf5640 1 -- 172.21.15.7:0/3616910732 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3cc00b9590 con 0x7f3cc0145ba0 2024-04-25T09:54:26.045 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:54:26.048 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:54:26.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.185+0000 7f3cbd7fa640 1 -- 172.21.15.7:0/3616910732 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3ca8005ac0 con 0x7f3cc0145ba0 2024-04-25T09:54:26.188 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2024-04-25T09:54:26.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.188+0000 7f3cc6bf5640 1 -- 172.21.15.7:0/3616910732 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3ca006b670 msgr2=0x7f3ca006db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:26.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.188+0000 7f3cc6bf5640 1 --2- 172.21.15.7:0/3616910732 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3ca006b670 0x7f3ca006db30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8014510 tx=0x7f3cb800b040 comp rx=0 tx=0).stop 2024-04-25T09:54:26.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.188+0000 7f3cc6bf5640 1 -- 172.21.15.7:0/3616910732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cc0145ba0 msgr2=0x7f3cc0155770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:26.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.188+0000 7f3cc6bf5640 1 --2- 172.21.15.7:0/3616910732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cc0145ba0 0x7f3cc0155770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3ca800c300 tx=0x7f3cc00d2740 comp rx=0 tx=0).stop 2024-04-25T09:54:26.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.189+0000 7f3cc6bf5640 1 -- 172.21.15.7:0/3616910732 shutdown_connections 2024-04-25T09:54:26.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.189+0000 7f3cc6bf5640 1 --2- 172.21.15.7:0/3616910732 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3ca006b670 0x7f3ca006db30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:26.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.189+0000 7f3cc6bf5640 1 --2- 172.21.15.7:0/3616910732 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3cc0155cb0 0x7f3cc00cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:26.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.189+0000 7f3cc6bf5640 1 --2- 172.21.15.7:0/3616910732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3cc0145ba0 0x7f3cc0155770 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:26.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.189+0000 7f3cc6bf5640 1 --2- 172.21.15.7:0/3616910732 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cac004800 0x7f3cc00c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:26.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.189+0000 7f3cc6bf5640 1 -- 172.21.15.7:0/3616910732 >> 172.21.15.7:0/3616910732 conn(0x7f3cc00726b0 msgr2=0x7f3cc0160260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:26.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.189+0000 7f3cc6bf5640 1 -- 172.21.15.7:0/3616910732 shutdown_connections 2024-04-25T09:54:26.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.190+0000 7f3cc6bf5640 1 -- 172.21.15.7:0/3616910732 wait complete. 2024-04-25T09:54:26.206 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-25T09:54:26.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.311+0000 7f4e1e45d640 1 Processor -- start 2024-04-25T09:54:26.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.311+0000 7f4e1e45d640 1 -- start start 2024-04-25T09:54:26.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.312+0000 7f4e1e45d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4e1815db70 0x7f4e180ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:26.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.312+0000 7f4e1e45d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e180d2380 0x7f4e180b7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:26.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.312+0000 7f4e1e45d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e180d29c0 con 0x7f4e180cede0 2024-04-25T09:54:26.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.312+0000 7f4e1e45d640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e180cf250 con 0x7f4e1815db70 2024-04-25T09:54:26.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.312+0000 7f4e1e45d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e180b6ce0 con 0x7f4e180d2380 2024-04-25T09:54:26.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.312+0000 7f4e17fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4e1815db70 0x7f4e180ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:26.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.312+0000 7f4e17fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4e1815db70 0x7f4e180ce8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50582/0 (socket says 172.21.15.7:50582) 2024-04-25T09:54:26.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.312+0000 7f4e17fff640 1 -- 172.21.15.7:0/758251883 learned_addr learned my addr 172.21.15.7:0/758251883 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:26.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.312+0000 7f4e1c9fa640 1 --2- 172.21.15.7:0/758251883 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e180d2380 0x7f4e180b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:26.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.312+0000 7f4e17fff640 1 -- 172.21.15.7:0/758251883 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e180d2380 msgr2=0x7f4e180b7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:26.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.312+0000 7f4e17fff640 1 --2- 172.21.15.7:0/758251883 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e180d2380 0x7f4e180b7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:26.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.312+0000 7f4e17fff640 1 -- 172.21.15.7:0/758251883 >> v1:172.21.15.55:6789/0 conn(0x7f4e180cede0 legacy=0x7f4e180d1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:26.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.312+0000 7f4e17fff640 1 -- 172.21.15.7:0/758251883 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e180d2ca0 con 0x7f4e1815db70 2024-04-25T09:54:26.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.313+0000 7f4e17fff640 1 --2- 172.21.15.7:0/758251883 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e1815db70 0x7f4e180ce8a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c009870 tx=0x7f4e0c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b536da5f739f141 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:26.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.313+0000 7f4e16ffd640 1 -- 172.21.15.7:0/758251883 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c037070 con 0x7f4e1815db70 2024-04-25T09:54:26.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.313+0000 7f4e16ffd640 1 -- 172.21.15.7:0/758251883 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0c032440 con 0x7f4e1815db70 2024-04-25T09:54:26.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.313+0000 7f4e16ffd640 1 -- 172.21.15.7:0/758251883 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c032810 con 0x7f4e1815db70 2024-04-25T09:54:26.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.314+0000 7f4e1e45d640 1 -- 172.21.15.7:0/758251883 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e1815db70 msgr2=0x7f4e180ce8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:26.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.314+0000 7f4e1e45d640 1 --2- 172.21.15.7:0/758251883 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e1815db70 0x7f4e180ce8a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c009870 tx=0x7f4e0c02a210 comp rx=0 tx=0).stop 2024-04-25T09:54:26.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.314+0000 7f4e1e45d640 1 -- 172.21.15.7:0/758251883 shutdown_connections 2024-04-25T09:54:26.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.314+0000 7f4e1e45d640 1 --2- 172.21.15.7:0/758251883 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e180d2380 0x7f4e180b7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:26.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.314+0000 7f4e1e45d640 1 --2- 172.21.15.7:0/758251883 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e1815db70 0x7f4e180ce8a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:26.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.314+0000 7f4e1e45d640 1 -- 172.21.15.7:0/758251883 >> 172.21.15.7:0/758251883 conn(0x7f4e180b5370 msgr2=0x7f4e180b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:26.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.314+0000 7f4e1e45d640 1 -- 172.21.15.7:0/758251883 shutdown_connections 2024-04-25T09:54:26.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.314+0000 7f4e1e45d640 1 -- 172.21.15.7:0/758251883 wait complete. 2024-04-25T09:54:26.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.315+0000 7f4e1e45d640 1 Processor -- start 2024-04-25T09:54:26.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.315+0000 7f4e1e45d640 1 -- start start 2024-04-25T09:54:26.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.316+0000 7f4e1e45d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e180cede0 0x7f4e180c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:26.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.316+0000 7f4e1e45d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e180d2380 0x7f4e180ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:26.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.316+0000 7f4e1e45d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e1815db70 0x7f4e180cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:26.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.316+0000 7f4e1e45d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e180b7280 con 0x7f4e1815db70 2024-04-25T09:54:26.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.316+0000 7f4e1e45d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e180d2f80 con 0x7f4e180d2380 2024-04-25T09:54:26.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.316+0000 7f4e1e45d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1815df50 con 0x7f4e180cede0 2024-04-25T09:54:26.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.316+0000 7f4e1c9fa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e1815db70 0x7f4e180cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:26.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.316+0000 7f4e1c9fa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e1815db70 0x7f4e180cbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50596/0 (socket says 172.21.15.7:50596) 2024-04-25T09:54:26.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.316+0000 7f4e1c9fa640 1 -- 172.21.15.7:0/3299257413 learned_addr learned my addr 172.21.15.7:0/3299257413 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:26.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.316+0000 7f4e17fff640 1 --2- 172.21.15.7:0/3299257413 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e180cede0 0x7f4e180c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:26.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.316+0000 7f4e177fe640 1 --2- 172.21.15.7:0/3299257413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e180d2380 0x7f4e180ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:26.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.316+0000 7f4e1c9fa640 1 -- 172.21.15.7:0/3299257413 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e180cede0 msgr2=0x7f4e180c7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:26.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.316+0000 7f4e1c9fa640 1 --2- 172.21.15.7:0/3299257413 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e180cede0 0x7f4e180c7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:26.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.316+0000 7f4e1c9fa640 1 -- 172.21.15.7:0/3299257413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e180d2380 msgr2=0x7f4e180ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:26.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.316+0000 7f4e1c9fa640 1 --2- 172.21.15.7:0/3299257413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e180d2380 0x7f4e180ccc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.316+0000 7f4e1c9fa640 1 -- 172.21.15.7:0/3299257413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e181f4360 con 0x7f4e1815db70 2024-04-25T09:54:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.316+0000 7f4e177fe640 1 --2- 172.21.15.7:0/3299257413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e180d2380 0x7f4e180ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.317+0000 7f4e1c9fa640 1 --2- 172.21.15.7:0/3299257413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e1815db70 0x7f4e180cbf20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4e10007e40 tx=0x7f4e1000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.317+0000 7f4e14ff9640 1 -- 172.21.15.7:0/3299257413 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e10014620 con 0x7f4e1815db70 2024-04-25T09:54:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.317+0000 7f4e14ff9640 1 -- 172.21.15.7:0/3299257413 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e10019070 con 0x7f4e1815db70 2024-04-25T09:54:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.317+0000 7f4e1e45d640 1 -- 172.21.15.7:0/3299257413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e181f4640 con 0x7f4e1815db70 2024-04-25T09:54:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.317+0000 7f4e14ff9640 1 -- 172.21.15.7:0/3299257413 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e10014a20 con 0x7f4e1815db70 2024-04-25T09:54:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.317+0000 7f4e1e45d640 1 -- 172.21.15.7:0/3299257413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e181f4c00 con 0x7f4e1815db70 2024-04-25T09:54:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.318+0000 7f4e1e45d640 1 -- 172.21.15.7:0/3299257413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e18068f60 con 0x7f4e1815db70 2024-04-25T09:54:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.318+0000 7f4e14ff9640 1 -- 172.21.15.7:0/3299257413 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4e10014bc0 con 0x7f4e1815db70 2024-04-25T09:54:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.319+0000 7f4e14ff9640 1 --2- 172.21.15.7:0/3299257413 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4e0406b4d0 0x7f4e0406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.319+0000 7f4e14ff9640 1 -- 172.21.15.7:0/3299257413 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f4e1008a8b0 con 0x7f4e1815db70 2024-04-25T09:54:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.319+0000 7f4e17fff640 1 --2- 172.21.15.7:0/3299257413 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4e0406b4d0 0x7f4e0406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.319+0000 7f4e17fff640 1 --2- 172.21.15.7:0/3299257413 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4e0406b4d0 0x7f4e0406d990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c034000 tx=0x7f4e0c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:26.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.323+0000 7f4e14ff9640 1 -- 172.21.15.7:0/3299257413 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4e10059910 con 0x7f4e1815db70 2024-04-25T09:54:26.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:26.504+0000 7f4e1e45d640 1 -- 172.21.15.7:0/3299257413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f4e180d0ea0 con 0x7f4e1815db70 2024-04-25T09:54:27.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.187+0000 7f4e14ff9640 1 -- 172.21.15.7:0/3299257413 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7f4e10059210 con 0x7f4e1815db70 2024-04-25T09:54:27.191 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2024-04-25T09:54:27.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.191+0000 7f4e1e45d640 1 -- 172.21.15.7:0/3299257413 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4e0406b4d0 msgr2=0x7f4e0406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:27.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.191+0000 7f4e1e45d640 1 --2- 172.21.15.7:0/3299257413 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4e0406b4d0 0x7f4e0406d990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c034000 tx=0x7f4e0c02e000 comp rx=0 tx=0).stop 2024-04-25T09:54:27.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.191+0000 7f4e1e45d640 1 -- 172.21.15.7:0/3299257413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e1815db70 msgr2=0x7f4e180cbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:27.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.191+0000 7f4e1e45d640 1 --2- 172.21.15.7:0/3299257413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e1815db70 0x7f4e180cbf20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4e10007e40 tx=0x7f4e1000e4b0 comp rx=0 tx=0).stop 2024-04-25T09:54:27.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.191+0000 7f4e1e45d640 1 -- 172.21.15.7:0/3299257413 shutdown_connections 2024-04-25T09:54:27.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.191+0000 7f4e1e45d640 1 --2- 172.21.15.7:0/3299257413 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4e0406b4d0 0x7f4e0406d990 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:27.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.191+0000 7f4e1e45d640 1 --2- 172.21.15.7:0/3299257413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e1815db70 0x7f4e180cbf20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:27.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.191+0000 7f4e1e45d640 1 --2- 172.21.15.7:0/3299257413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e180d2380 0x7f4e180ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:27.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.191+0000 7f4e1e45d640 1 --2- 172.21.15.7:0/3299257413 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e180cede0 0x7f4e180c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:27.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.191+0000 7f4e1e45d640 1 -- 172.21.15.7:0/3299257413 >> 172.21.15.7:0/3299257413 conn(0x7f4e180b5370 msgr2=0x7f4e180d1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:27.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.191+0000 7f4e1e45d640 1 -- 172.21.15.7:0/3299257413 shutdown_connections 2024-04-25T09:54:27.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.192+0000 7f4e1e45d640 1 -- 172.21.15.7:0/3299257413 wait complete. 2024-04-25T09:54:27.219 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:54:27.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.322+0000 7f5c4b1c8640 1 Processor -- start 2024-04-25T09:54:27.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.322+0000 7f5c4b1c8640 1 -- start start 2024-04-25T09:54:27.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.323+0000 7f5c4b1c8640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5c4415f1c0 0x7f5c4415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:27.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.323+0000 7f5c4b1c8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5c440ce830 0x7f5c440b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:27.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.323+0000 7f5c4b1c8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c440ced10 con 0x7f5c440d3760 2024-04-25T09:54:27.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.323+0000 7f5c4b1c8640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c440ce380 con 0x7f5c4415f1c0 2024-04-25T09:54:27.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.323+0000 7f5c4b1c8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c4415f000 con 0x7f5c440ce830 2024-04-25T09:54:27.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.323+0000 7f5c43fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5c4415f1c0 0x7f5c4415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:27.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.323+0000 7f5c43fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5c4415f1c0 0x7f5c4415eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50600/0 (socket says 172.21.15.7:50600) 2024-04-25T09:54:27.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.323+0000 7f5c43fff640 1 -- 172.21.15.7:0/618054714 learned_addr learned my addr 172.21.15.7:0/618054714 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:27.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.323+0000 7f5c49765640 1 --2- 172.21.15.7:0/618054714 >> v2:172.21.15.55:3300/0 conn(0x7f5c440ce830 0x7f5c440b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:27.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.323+0000 7f5c43fff640 1 -- 172.21.15.7:0/618054714 >> v2:172.21.15.55:3300/0 conn(0x7f5c440ce830 msgr2=0x7f5c440b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:27.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.323+0000 7f5c43fff640 1 --2- 172.21.15.7:0/618054714 >> v2:172.21.15.55:3300/0 conn(0x7f5c440ce830 0x7f5c440b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:27.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.323+0000 7f5c43fff640 1 -- 172.21.15.7:0/618054714 >> v1:172.21.15.55:6789/0 conn(0x7f5c440d3760 legacy=0x7f5c440d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:27.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.323+0000 7f5c43fff640 1 -- 172.21.15.7:0/618054714 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c440d1b40 con 0x7f5c4415f1c0 2024-04-25T09:54:27.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.324+0000 7f5c43fff640 1 --2- 172.21.15.7:0/618054714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c4415f1c0 0x7f5c4415eac0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5c440cf180 tx=0x7f5c3802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20b31b529ac1c230 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:27.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.324+0000 7f5c437fe640 1 -- 172.21.15.7:0/618054714 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c38037070 con 0x7f5c4415f1c0 2024-04-25T09:54:27.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.324+0000 7f5c437fe640 1 -- 172.21.15.7:0/618054714 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c38032440 con 0x7f5c4415f1c0 2024-04-25T09:54:27.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.324+0000 7f5c437fe640 1 -- 172.21.15.7:0/618054714 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c38032810 con 0x7f5c4415f1c0 2024-04-25T09:54:27.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.325+0000 7f5c4b1c8640 1 -- 172.21.15.7:0/618054714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c4415f1c0 msgr2=0x7f5c4415eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:27.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.325+0000 7f5c4b1c8640 1 --2- 172.21.15.7:0/618054714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c4415f1c0 0x7f5c4415eac0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5c440cf180 tx=0x7f5c3802a270 comp rx=0 tx=0).stop 2024-04-25T09:54:27.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.325+0000 7f5c4b1c8640 1 -- 172.21.15.7:0/618054714 shutdown_connections 2024-04-25T09:54:27.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.325+0000 7f5c4b1c8640 1 --2- 172.21.15.7:0/618054714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c4415f1c0 0x7f5c4415eac0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:27.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.325+0000 7f5c4b1c8640 1 --2- 172.21.15.7:0/618054714 >> v2:172.21.15.55:3300/0 conn(0x7f5c440ce830 0x7f5c440b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:27.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.325+0000 7f5c4b1c8640 1 -- 172.21.15.7:0/618054714 >> 172.21.15.7:0/618054714 conn(0x7f5c44072680 msgr2=0x7f5c44072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:27.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.325+0000 7f5c4b1c8640 1 -- 172.21.15.7:0/618054714 shutdown_connections 2024-04-25T09:54:27.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.325+0000 7f5c4b1c8640 1 -- 172.21.15.7:0/618054714 wait complete. 2024-04-25T09:54:27.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.326+0000 7f5c4b1c8640 1 Processor -- start 2024-04-25T09:54:27.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.326+0000 7f5c4b1c8640 1 -- start start 2024-04-25T09:54:27.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.327+0000 7f5c4b1c8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c440ce830 0x7f5c440cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:27.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.327+0000 7f5c4b1c8640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5c440d3760 0x7f5c440cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:27.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.327+0000 7f5c4b1c8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c4415f1c0 0x7f5c44152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:27.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.327+0000 7f5c4b1c8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4415de10 con 0x7f5c440ce830 2024-04-25T09:54:27.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.327+0000 7f5c4b1c8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c440d2190 con 0x7f5c4415f1c0 2024-04-25T09:54:27.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.327+0000 7f5c4b1c8640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c440b2780 con 0x7f5c440d3760 2024-04-25T09:54:27.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.327+0000 7f5c48f64640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c440ce830 0x7f5c440cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:27.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.327+0000 7f5c48f64640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c440ce830 0x7f5c440cba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50608/0 (socket says 172.21.15.7:50608) 2024-04-25T09:54:27.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.327+0000 7f5c48f64640 1 -- 172.21.15.7:0/3854558076 learned_addr learned my addr 172.21.15.7:0/3854558076 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:27.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.327+0000 7f5c49765640 1 --2- 172.21.15.7:0/3854558076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c4415f1c0 0x7f5c44152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:27.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.327+0000 7f5c43fff640 1 --2- 172.21.15.7:0/3854558076 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5c440d3760 0x7f5c440cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:27.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.327+0000 7f5c48f64640 1 -- 172.21.15.7:0/3854558076 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5c440d3760 msgr2=0x7f5c440cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:27.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.327+0000 7f5c48f64640 1 --2- 172.21.15.7:0/3854558076 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5c440d3760 0x7f5c440cd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:27.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.327+0000 7f5c48f64640 1 -- 172.21.15.7:0/3854558076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c4415f1c0 msgr2=0x7f5c44152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:27.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.327+0000 7f5c48f64640 1 --2- 172.21.15.7:0/3854558076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c4415f1c0 0x7f5c44152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:27.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.327+0000 7f5c48f64640 1 -- 172.21.15.7:0/3854558076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c440cc090 con 0x7f5c440ce830 2024-04-25T09:54:27.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.328+0000 7f5c48f64640 1 --2- 172.21.15.7:0/3854558076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c440ce830 0x7f5c440cba20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5c3400c400 tx=0x7f5c3400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:27.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.328+0000 7f5c417fa640 1 -- 172.21.15.7:0/3854558076 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c340052d0 con 0x7f5c440ce830 2024-04-25T09:54:27.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.328+0000 7f5c417fa640 1 -- 172.21.15.7:0/3854558076 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c34005490 con 0x7f5c440ce830 2024-04-25T09:54:27.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.328+0000 7f5c417fa640 1 -- 172.21.15.7:0/3854558076 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c34007260 con 0x7f5c440ce830 2024-04-25T09:54:27.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.328+0000 7f5c4b1c8640 1 -- 172.21.15.7:0/3854558076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c440cc370 con 0x7f5c440ce830 2024-04-25T09:54:27.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.328+0000 7f5c4b1c8640 1 -- 172.21.15.7:0/3854558076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c440cc930 con 0x7f5c440ce830 2024-04-25T09:54:27.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.329+0000 7f5c4b1c8640 1 -- 172.21.15.7:0/3854558076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c44068f60 con 0x7f5c440ce830 2024-04-25T09:54:27.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.329+0000 7f5c417fa640 1 -- 172.21.15.7:0/3854558076 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5c34007400 con 0x7f5c440ce830 2024-04-25T09:54:27.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.330+0000 7f5c417fa640 1 --2- 172.21.15.7:0/3854558076 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5c3006b4d0 0x7f5c3006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:27.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.330+0000 7f5c417fa640 1 -- 172.21.15.7:0/3854558076 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f5c340895b0 con 0x7f5c440ce830 2024-04-25T09:54:27.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.330+0000 7f5c43fff640 1 --2- 172.21.15.7:0/3854558076 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5c3006b4d0 0x7f5c3006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:27.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.330+0000 7f5c43fff640 1 --2- 172.21.15.7:0/3854558076 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5c3006b4d0 0x7f5c3006d990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5c38034000 tx=0x7f5c3802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:27.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.334+0000 7f5c417fa640 1 -- 172.21.15.7:0/3854558076 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5c34057ed0 con 0x7f5c440ce830 2024-04-25T09:54:27.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:27.556+0000 7f5c4b1c8640 1 -- 172.21.15.7:0/3854558076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5c440b2560 con 0x7f5c440ce830 2024-04-25T09:54:28.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.221+0000 7f5c417fa640 1 -- 172.21.15.7:0/3854558076 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5c3405bf70 con 0x7f5c440ce830 2024-04-25T09:54:28.224 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T09:54:28.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.225+0000 7f5c4b1c8640 1 -- 172.21.15.7:0/3854558076 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5c3006b4d0 msgr2=0x7f5c3006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:28.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.225+0000 7f5c4b1c8640 1 --2- 172.21.15.7:0/3854558076 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5c3006b4d0 0x7f5c3006d990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5c38034000 tx=0x7f5c3802e000 comp rx=0 tx=0).stop 2024-04-25T09:54:28.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.225+0000 7f5c4b1c8640 1 -- 172.21.15.7:0/3854558076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c440ce830 msgr2=0x7f5c440cba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:28.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.225+0000 7f5c4b1c8640 1 --2- 172.21.15.7:0/3854558076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c440ce830 0x7f5c440cba20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5c3400c400 tx=0x7f5c3400c8c0 comp rx=0 tx=0).stop 2024-04-25T09:54:28.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.226+0000 7f5c4b1c8640 1 -- 172.21.15.7:0/3854558076 shutdown_connections 2024-04-25T09:54:28.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.226+0000 7f5c4b1c8640 1 --2- 172.21.15.7:0/3854558076 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5c3006b4d0 0x7f5c3006d990 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:28.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.226+0000 7f5c4b1c8640 1 --2- 172.21.15.7:0/3854558076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c4415f1c0 0x7f5c44152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:28.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.226+0000 7f5c4b1c8640 1 --2- 172.21.15.7:0/3854558076 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5c440d3760 0x7f5c440cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:28.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.226+0000 7f5c4b1c8640 1 --2- 172.21.15.7:0/3854558076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c440ce830 0x7f5c440cba20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:28.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.226+0000 7f5c4b1c8640 1 -- 172.21.15.7:0/3854558076 >> 172.21.15.7:0/3854558076 conn(0x7f5c44072680 msgr2=0x7f5c4415ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:28.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.226+0000 7f5c4b1c8640 1 -- 172.21.15.7:0/3854558076 shutdown_connections 2024-04-25T09:54:28.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.226+0000 7f5c4b1c8640 1 -- 172.21.15.7:0/3854558076 wait complete. 2024-04-25T09:54:28.249 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-25T09:54:28.249 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-25T09:54:28.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.359+0000 7f16e283f640 1 Processor -- start 2024-04-25T09:54:28.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.359+0000 7f16e283f640 1 -- start start 2024-04-25T09:54:28.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.359+0000 7f16e283f640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f16dc15de70 0x7f16dc0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:28.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.359+0000 7f16e283f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f16dc0d3330 0x7f16dc0d3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:28.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.359+0000 7f16e283f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16dc0d2290 con 0x7f16dc0b9290 2024-04-25T09:54:28.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.359+0000 7f16e283f640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16dc0d2570 con 0x7f16dc15de70 2024-04-25T09:54:28.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.359+0000 7f16e283f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16dc0d2850 con 0x7f16dc0d3330 2024-04-25T09:54:28.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.360+0000 7f16dbfff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f16dc15de70 0x7f16dc0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:28.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.360+0000 7f16dbfff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f16dc15de70 0x7f16dc0d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50612/0 (socket says 172.21.15.7:50612) 2024-04-25T09:54:28.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.360+0000 7f16dbfff640 1 -- 172.21.15.7:0/261883202 learned_addr learned my addr 172.21.15.7:0/261883202 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:28.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.360+0000 7f16db7fe640 1 --2- 172.21.15.7:0/261883202 >> v2:172.21.15.55:3300/0 conn(0x7f16dc0d3330 0x7f16dc0d3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:28.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.360+0000 7f16dbfff640 1 -- 172.21.15.7:0/261883202 >> v2:172.21.15.55:3300/0 conn(0x7f16dc0d3330 msgr2=0x7f16dc0d3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:28.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.360+0000 7f16dbfff640 1 --2- 172.21.15.7:0/261883202 >> v2:172.21.15.55:3300/0 conn(0x7f16dc0d3330 0x7f16dc0d3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:28.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.360+0000 7f16dbfff640 1 -- 172.21.15.7:0/261883202 >> v1:172.21.15.55:6789/0 conn(0x7f16dc0b9290 legacy=0x7f16dc0b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:28.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.360+0000 7f16dbfff640 1 -- 172.21.15.7:0/261883202 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16dc0d2b30 con 0x7f16dc15de70 2024-04-25T09:54:28.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.361+0000 7f16dbfff640 1 --2- 172.21.15.7:0/261883202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16dc15de70 0x7f16dc0d1920 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f16dc0d0860 tx=0x7f16cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e743d4468f47640 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:28.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.361+0000 7f16daffd640 1 -- 172.21.15.7:0/261883202 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc037070 con 0x7f16dc15de70 2024-04-25T09:54:28.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.361+0000 7f16daffd640 1 -- 172.21.15.7:0/261883202 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16cc032440 con 0x7f16dc15de70 2024-04-25T09:54:28.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.361+0000 7f16daffd640 1 -- 172.21.15.7:0/261883202 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc032810 con 0x7f16dc15de70 2024-04-25T09:54:28.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.361+0000 7f16e283f640 1 -- 172.21.15.7:0/261883202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16dc15de70 msgr2=0x7f16dc0d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:28.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.361+0000 7f16e283f640 1 --2- 172.21.15.7:0/261883202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16dc15de70 0x7f16dc0d1920 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f16dc0d0860 tx=0x7f16cc02a270 comp rx=0 tx=0).stop 2024-04-25T09:54:28.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.361+0000 7f16e283f640 1 -- 172.21.15.7:0/261883202 shutdown_connections 2024-04-25T09:54:28.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.361+0000 7f16e283f640 1 --2- 172.21.15.7:0/261883202 >> v2:172.21.15.55:3300/0 conn(0x7f16dc0d3330 0x7f16dc0d3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:28.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.361+0000 7f16e283f640 1 --2- 172.21.15.7:0/261883202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16dc15de70 0x7f16dc0d1920 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:28.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.361+0000 7f16e283f640 1 -- 172.21.15.7:0/261883202 >> 172.21.15.7:0/261883202 conn(0x7f16dc0726b0 msgr2=0x7f16dc072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:28.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.361+0000 7f16e283f640 1 -- 172.21.15.7:0/261883202 shutdown_connections 2024-04-25T09:54:28.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.361+0000 7f16e283f640 1 -- 172.21.15.7:0/261883202 wait complete. 2024-04-25T09:54:28.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.363+0000 7f16e283f640 1 Processor -- start 2024-04-25T09:54:28.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.363+0000 7f16e283f640 1 -- start start 2024-04-25T09:54:28.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.363+0000 7f16e283f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f16dc0b9290 0x7f16dc0c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:28.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.363+0000 7f16e283f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16dc0d3330 0x7f16dc0cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:28.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.363+0000 7f16e283f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16dc15de70 0x7f16dc15fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:28.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.363+0000 7f16e283f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc0d1fe0 con 0x7f16dc15de70 2024-04-25T09:54:28.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.363+0000 7f16e283f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc0d1e60 con 0x7f16dc0d3330 2024-04-25T09:54:28.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.363+0000 7f16e283f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc0d3d40 con 0x7f16dc0b9290 2024-04-25T09:54:28.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.364+0000 7f16e0ddc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16dc15de70 0x7f16dc15fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:28.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.364+0000 7f16e0ddc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16dc15de70 0x7f16dc15fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50618/0 (socket says 172.21.15.7:50618) 2024-04-25T09:54:28.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.364+0000 7f16e0ddc640 1 -- 172.21.15.7:0/959174352 learned_addr learned my addr 172.21.15.7:0/959174352 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:28.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.364+0000 7f16dbfff640 1 --2- 172.21.15.7:0/959174352 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f16dc0b9290 0x7f16dc0c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:28.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.364+0000 7f16db7fe640 1 --2- 172.21.15.7:0/959174352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16dc0d3330 0x7f16dc0cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:28.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.364+0000 7f16e0ddc640 1 -- 172.21.15.7:0/959174352 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f16dc0b9290 msgr2=0x7f16dc0c63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:28.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.364+0000 7f16e0ddc640 1 --2- 172.21.15.7:0/959174352 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f16dc0b9290 0x7f16dc0c63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:28.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.364+0000 7f16e0ddc640 1 -- 172.21.15.7:0/959174352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16dc0d3330 msgr2=0x7f16dc0cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:28.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.364+0000 7f16e0ddc640 1 --2- 172.21.15.7:0/959174352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16dc0d3330 0x7f16dc0cb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:28.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.364+0000 7f16e0ddc640 1 -- 172.21.15.7:0/959174352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16dc0c6900 con 0x7f16dc15de70 2024-04-25T09:54:28.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.364+0000 7f16e0ddc640 1 --2- 172.21.15.7:0/959174352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16dc15de70 0x7f16dc15fff0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f16d400c7a0 tx=0x7f16d400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:28.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.364+0000 7f16d8ff9640 1 -- 172.21.15.7:0/959174352 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d4003b70 con 0x7f16dc15de70 2024-04-25T09:54:28.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.364+0000 7f16d8ff9640 1 -- 172.21.15.7:0/959174352 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d4003d30 con 0x7f16dc15de70 2024-04-25T09:54:28.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.364+0000 7f16d8ff9640 1 -- 172.21.15.7:0/959174352 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d400aa90 con 0x7f16dc15de70 2024-04-25T09:54:28.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.364+0000 7f16e283f640 1 -- 172.21.15.7:0/959174352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16dc0c74b0 con 0x7f16dc15de70 2024-04-25T09:54:28.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.364+0000 7f16e283f640 1 -- 172.21.15.7:0/959174352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16dc0c7d50 con 0x7f16dc15de70 2024-04-25T09:54:28.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.365+0000 7f16e283f640 1 -- 172.21.15.7:0/959174352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16dc069040 con 0x7f16dc15de70 2024-04-25T09:54:28.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.366+0000 7f16d8ff9640 1 -- 172.21.15.7:0/959174352 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f16d400ac30 con 0x7f16dc15de70 2024-04-25T09:54:28.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.366+0000 7f16d8ff9640 1 --2- 172.21.15.7:0/959174352 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f16c806b4d0 0x7f16c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:28.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.366+0000 7f16d8ff9640 1 -- 172.21.15.7:0/959174352 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16d4089f70 con 0x7f16dc15de70 2024-04-25T09:54:28.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.366+0000 7f16dbfff640 1 --2- 172.21.15.7:0/959174352 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f16c806b4d0 0x7f16c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:28.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.367+0000 7f16dbfff640 1 --2- 172.21.15.7:0/959174352 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f16c806b4d0 0x7f16c806d990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f16cc034000 tx=0x7f16cc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:28.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.370+0000 7f16d8ff9640 1 -- 172.21.15.7:0/959174352 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f16dc0c6900 con 0x7f16dc15de70 2024-04-25T09:54:28.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:28.558+0000 7f16e283f640 1 -- 172.21.15.7:0/959174352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f16dc150880 con 0x7f16dc15de70 2024-04-25T09:54:29.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.202+0000 7f16d8ff9640 1 -- 172.21.15.7:0/959174352 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7f16d4058830 con 0x7f16dc15de70 2024-04-25T09:54:29.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.206+0000 7f16e283f640 1 -- 172.21.15.7:0/959174352 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f16c806b4d0 msgr2=0x7f16c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:29.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.206+0000 7f16e283f640 1 --2- 172.21.15.7:0/959174352 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f16c806b4d0 0x7f16c806d990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f16cc034000 tx=0x7f16cc02e000 comp rx=0 tx=0).stop 2024-04-25T09:54:29.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.206+0000 7f16e283f640 1 -- 172.21.15.7:0/959174352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16dc15de70 msgr2=0x7f16dc15fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:29.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.206+0000 7f16e283f640 1 --2- 172.21.15.7:0/959174352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16dc15de70 0x7f16dc15fff0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f16d400c7a0 tx=0x7f16d400cc60 comp rx=0 tx=0).stop 2024-04-25T09:54:29.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.206+0000 7f16e283f640 1 -- 172.21.15.7:0/959174352 shutdown_connections 2024-04-25T09:54:29.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.206+0000 7f16e283f640 1 --2- 172.21.15.7:0/959174352 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f16c806b4d0 0x7f16c806d990 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:29.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.206+0000 7f16e283f640 1 --2- 172.21.15.7:0/959174352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16dc15de70 0x7f16dc15fff0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:29.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.206+0000 7f16e283f640 1 --2- 172.21.15.7:0/959174352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16dc0d3330 0x7f16dc0cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:29.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.206+0000 7f16e283f640 1 --2- 172.21.15.7:0/959174352 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f16dc0b9290 0x7f16dc0c63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:29.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.206+0000 7f16e283f640 1 -- 172.21.15.7:0/959174352 >> 172.21.15.7:0/959174352 conn(0x7f16dc0726b0 msgr2=0x7f16dc155200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:29.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.206+0000 7f16e283f640 1 -- 172.21.15.7:0/959174352 shutdown_connections 2024-04-25T09:54:29.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.206+0000 7f16e283f640 1 -- 172.21.15.7:0/959174352 wait complete. 2024-04-25T09:54:29.221 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:54:29.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.334+0000 7f154f334640 1 Processor -- start 2024-04-25T09:54:29.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.334+0000 7f154f334640 1 -- start start 2024-04-25T09:54:29.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.335+0000 7f154f334640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f154815da10 0x7f15480b9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:29.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.335+0000 7f154f334640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15480b2f30 con 0x7f154815ddf0 2024-04-25T09:54:29.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.335+0000 7f154f334640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f154815e2d0 con 0x7f15480cebe0 2024-04-25T09:54:29.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.335+0000 7f154f334640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f154815e920 con 0x7f154815da10 2024-04-25T09:54:29.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.335+0000 7f154c8cf640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f154815ddf0 0x7f15480ce4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46602/0 (socket says 172.21.15.7:46602) 2024-04-25T09:54:29.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.335+0000 7f154d0d0640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f154815da10 0x7f15480b9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:29.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.335+0000 7f154c8cf640 1 -- 172.21.15.7:0/488239900 learned_addr learned my addr 172.21.15.7:0/488239900 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:29.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.335+0000 7f154d0d0640 1 -- 172.21.15.7:0/488239900 >> v1:172.21.15.55:6789/0 conn(0x7f15480cebe0 legacy=0x7f15480d1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:29.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.335+0000 7f154d0d0640 1 -- 172.21.15.7:0/488239900 >> v1:172.21.15.7:6789/0 conn(0x7f154815ddf0 legacy=0x7f15480ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:29.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.335+0000 7f154d0d0640 1 -- 172.21.15.7:0/488239900 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f154815e5b0 con 0x7f154815da10 2024-04-25T09:54:29.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.335+0000 7f1547fff640 1 -- 172.21.15.7:0/488239900 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2081077827 0 0) 0x7f15480b2f30 con 0x7f154815ddf0 2024-04-25T09:54:29.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.336+0000 7f154d0d0640 1 --2- 172.21.15.7:0/488239900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f154815da10 0x7f15480b9190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f154815eaa0 tx=0x7f154002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b1f7557d0260c0a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:29.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.336+0000 7f1547fff640 1 -- 172.21.15.7:0/488239900 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1540037070 con 0x7f154815da10 2024-04-25T09:54:29.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.336+0000 7f1547fff640 1 -- 172.21.15.7:0/488239900 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1540032440 con 0x7f154815da10 2024-04-25T09:54:29.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.336+0000 7f1547fff640 1 -- 172.21.15.7:0/488239900 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1540032810 con 0x7f154815da10 2024-04-25T09:54:29.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.337+0000 7f154f334640 1 -- 172.21.15.7:0/488239900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f154815da10 msgr2=0x7f15480b9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:29.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.337+0000 7f154f334640 1 --2- 172.21.15.7:0/488239900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f154815da10 0x7f15480b9190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f154815eaa0 tx=0x7f154002a1c0 comp rx=0 tx=0).stop 2024-04-25T09:54:29.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.337+0000 7f154f334640 1 -- 172.21.15.7:0/488239900 shutdown_connections 2024-04-25T09:54:29.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.337+0000 7f154f334640 1 --2- 172.21.15.7:0/488239900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f154815da10 0x7f15480b9190 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:29.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.337+0000 7f154f334640 1 -- 172.21.15.7:0/488239900 >> 172.21.15.7:0/488239900 conn(0x7f15480728c0 msgr2=0x7f154806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:29.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.337+0000 7f154f334640 1 -- 172.21.15.7:0/488239900 shutdown_connections 2024-04-25T09:54:29.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.337+0000 7f154f334640 1 -- 172.21.15.7:0/488239900 wait complete. 2024-04-25T09:54:29.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.338+0000 7f154f334640 1 Processor -- start 2024-04-25T09:54:29.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.338+0000 7f154f334640 1 -- start start 2024-04-25T09:54:29.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.339+0000 7f154f334640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15480cebe0 0x7f15480b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:29.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.339+0000 7f154f334640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f154815da10 0x7f154814aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:29.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.339+0000 7f154f334640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f154815ddf0 0x7f15481589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:29.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.339+0000 7f154f334640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154815ef30 con 0x7f154815da10 2024-04-25T09:54:29.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.339+0000 7f154f334640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154815edb0 con 0x7f154815ddf0 2024-04-25T09:54:29.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.339+0000 7f154f334640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15480b2960 con 0x7f15480cebe0 2024-04-25T09:54:29.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.339+0000 7f154c8cf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f154815da10 0x7f154814aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:29.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.339+0000 7f154c8cf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f154815da10 0x7f154814aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50632/0 (socket says 172.21.15.7:50632) 2024-04-25T09:54:29.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.339+0000 7f154c8cf640 1 -- 172.21.15.7:0/2702935534 learned_addr learned my addr 172.21.15.7:0/2702935534 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:29.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.339+0000 7f154d8d1640 1 --2- 172.21.15.7:0/2702935534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f154815ddf0 0x7f15481589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:29.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.339+0000 7f154d0d0640 1 --2- 172.21.15.7:0/2702935534 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15480cebe0 0x7f15480b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:29.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.339+0000 7f154c8cf640 1 -- 172.21.15.7:0/2702935534 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15480cebe0 msgr2=0x7f15480b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:29.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.339+0000 7f154c8cf640 1 --2- 172.21.15.7:0/2702935534 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15480cebe0 0x7f15480b47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:29.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.339+0000 7f154c8cf640 1 -- 172.21.15.7:0/2702935534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f154815ddf0 msgr2=0x7f15481589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:29.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.339+0000 7f154c8cf640 1 --2- 172.21.15.7:0/2702935534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f154815ddf0 0x7f15481589a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:29.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.339+0000 7f154c8cf640 1 -- 172.21.15.7:0/2702935534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15480b3710 con 0x7f154815da10 2024-04-25T09:54:29.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.340+0000 7f154c8cf640 1 --2- 172.21.15.7:0/2702935534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f154815da10 0x7f154814aba0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f153c00c440 tx=0x7f153c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:29.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.340+0000 7f1545ffb640 1 -- 172.21.15.7:0/2702935534 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c018070 con 0x7f154815da10 2024-04-25T09:54:29.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.340+0000 7f1545ffb640 1 -- 172.21.15.7:0/2702935534 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153c0074e0 con 0x7f154815da10 2024-04-25T09:54:29.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.340+0000 7f1545ffb640 1 -- 172.21.15.7:0/2702935534 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c004a20 con 0x7f154815da10 2024-04-25T09:54:29.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.340+0000 7f154f334640 1 -- 172.21.15.7:0/2702935534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15480b39f0 con 0x7f154815da10 2024-04-25T09:54:29.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.340+0000 7f154f334640 1 -- 172.21.15.7:0/2702935534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15480b3fb0 con 0x7f154815da10 2024-04-25T09:54:29.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.341+0000 7f154f334640 1 -- 172.21.15.7:0/2702935534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1548068fd0 con 0x7f154815da10 2024-04-25T09:54:29.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.341+0000 7f1545ffb640 1 -- 172.21.15.7:0/2702935534 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f153c01b070 con 0x7f154815da10 2024-04-25T09:54:29.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.342+0000 7f1545ffb640 1 --2- 172.21.15.7:0/2702935534 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f153406b4d0 0x7f153406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:29.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.342+0000 7f154d0d0640 1 --2- 172.21.15.7:0/2702935534 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f153406b4d0 0x7f153406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:29.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.342+0000 7f1545ffb640 1 -- 172.21.15.7:0/2702935534 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6007+0+0 (secure 0 0 0) 0x7f153c089580 con 0x7f154815da10 2024-04-25T09:54:29.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.342+0000 7f154d0d0640 1 --2- 172.21.15.7:0/2702935534 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f153406b4d0 0x7f153406d990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1540034000 tx=0x7f154002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:29.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.346+0000 7f1545ffb640 1 -- 172.21.15.7:0/2702935534 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f153c0582d0 con 0x7f154815da10 2024-04-25T09:54:29.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:29.527+0000 7f154f334640 1 -- 172.21.15.7:0/2702935534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f154815d0c0 con 0x7f154815da10 2024-04-25T09:54:31.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.229+0000 7f1545ffb640 1 -- 172.21.15.7:0/2702935534 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7f153c057bd0 con 0x7f154815da10 2024-04-25T09:54:31.232 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data_ec' created 2024-04-25T09:54:31.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.233+0000 7f154f334640 1 -- 172.21.15.7:0/2702935534 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f153406b4d0 msgr2=0x7f153406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:31.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.233+0000 7f154f334640 1 --2- 172.21.15.7:0/2702935534 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f153406b4d0 0x7f153406d990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1540034000 tx=0x7f154002e000 comp rx=0 tx=0).stop 2024-04-25T09:54:31.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.233+0000 7f154f334640 1 -- 172.21.15.7:0/2702935534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f154815da10 msgr2=0x7f154814aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:31.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.233+0000 7f154f334640 1 --2- 172.21.15.7:0/2702935534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f154815da10 0x7f154814aba0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f153c00c440 tx=0x7f153c00c900 comp rx=0 tx=0).stop 2024-04-25T09:54:31.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.233+0000 7f154f334640 1 -- 172.21.15.7:0/2702935534 shutdown_connections 2024-04-25T09:54:31.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.233+0000 7f154f334640 1 --2- 172.21.15.7:0/2702935534 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f153406b4d0 0x7f153406d990 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:31.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.233+0000 7f154f334640 1 --2- 172.21.15.7:0/2702935534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f154815ddf0 0x7f15481589a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:31.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.233+0000 7f154f334640 1 --2- 172.21.15.7:0/2702935534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f154815da10 0x7f154814aba0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:31.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.233+0000 7f154f334640 1 --2- 172.21.15.7:0/2702935534 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15480cebe0 0x7f15480b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:31.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.233+0000 7f154f334640 1 -- 172.21.15.7:0/2702935534 >> 172.21.15.7:0/2702935534 conn(0x7f15480728c0 msgr2=0x7f15480b68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:31.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.233+0000 7f154f334640 1 -- 172.21.15.7:0/2702935534 shutdown_connections 2024-04-25T09:54:31.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.233+0000 7f154f334640 1 -- 172.21.15.7:0/2702935534 wait complete. 2024-04-25T09:54:31.254 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-25T09:54:31.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.359+0000 7fa30caac640 1 Processor -- start 2024-04-25T09:54:31.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.359+0000 7fa30caac640 1 -- start start 2024-04-25T09:54:31.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.360+0000 7fa30caac640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa3080d3330 0x7fa3080d3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:31.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.360+0000 7fa30caac640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3080d2290 con 0x7fa30815de70 2024-04-25T09:54:31.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.360+0000 7fa30caac640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3080d2570 con 0x7fa3080b9290 2024-04-25T09:54:31.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.360+0000 7fa30caac640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3080d2030 con 0x7fa3080d3330 2024-04-25T09:54:31.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.360+0000 7fa30659c640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa30815de70 0x7fa3080d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54754/0 (socket says 172.21.15.7:54754) 2024-04-25T09:54:31.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.360+0000 7fa30659c640 1 -- 172.21.15.7:0/213994175 learned_addr learned my addr 172.21.15.7:0/213994175 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:31.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.360+0000 7fa305d9b640 1 --2- 172.21.15.7:0/213994175 >> v2:172.21.15.7:3300/0 conn(0x7fa3080d3330 0x7fa3080d3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:31.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.360+0000 7fa30559a640 1 -- 172.21.15.7:0/213994175 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3066789451 0 0) 0x7fa3080d2290 con 0x7fa30815de70 2024-04-25T09:54:31.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.360+0000 7fa30559a640 1 -- 172.21.15.7:0/213994175 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2f0003520 con 0x7fa30815de70 2024-04-25T09:54:31.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.360+0000 7fa305d9b640 1 -- 172.21.15.7:0/213994175 >> v1:172.21.15.55:6789/0 conn(0x7fa3080b9290 legacy=0x7fa3080b6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:31.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.360+0000 7fa305d9b640 1 -- 172.21.15.7:0/213994175 >> v1:172.21.15.7:6789/0 conn(0x7fa30815de70 legacy=0x7fa3080d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:31.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.360+0000 7fa305d9b640 1 -- 172.21.15.7:0/213994175 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3080d2850 con 0x7fa3080d3330 2024-04-25T09:54:31.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.361+0000 7fa305d9b640 1 --2- 172.21.15.7:0/213994175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3080d3330 0x7fa3080d3800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc0097a0 tx=0x7fa2fc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8e08f939a8b1c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:31.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.361+0000 7fa30559a640 1 -- 172.21.15.7:0/213994175 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc037070 con 0x7fa3080d3330 2024-04-25T09:54:31.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.361+0000 7fa30559a640 1 -- 172.21.15.7:0/213994175 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2fc032440 con 0x7fa3080d3330 2024-04-25T09:54:31.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.361+0000 7fa30559a640 1 -- 172.21.15.7:0/213994175 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc032810 con 0x7fa3080d3330 2024-04-25T09:54:31.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.362+0000 7fa30caac640 1 -- 172.21.15.7:0/213994175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3080d3330 msgr2=0x7fa3080d3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:31.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.362+0000 7fa30caac640 1 --2- 172.21.15.7:0/213994175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3080d3330 0x7fa3080d3800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc0097a0 tx=0x7fa2fc02a1e0 comp rx=0 tx=0).stop 2024-04-25T09:54:31.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.362+0000 7fa30caac640 1 -- 172.21.15.7:0/213994175 shutdown_connections 2024-04-25T09:54:31.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.362+0000 7fa30caac640 1 --2- 172.21.15.7:0/213994175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3080d3330 0x7fa3080d3800 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:31.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.362+0000 7fa30caac640 1 -- 172.21.15.7:0/213994175 >> 172.21.15.7:0/213994175 conn(0x7fa3080726b0 msgr2=0x7fa308072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:31.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.362+0000 7fa30caac640 1 -- 172.21.15.7:0/213994175 shutdown_connections 2024-04-25T09:54:31.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.362+0000 7fa30caac640 1 -- 172.21.15.7:0/213994175 wait complete. 2024-04-25T09:54:31.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.363+0000 7fa30caac640 1 Processor -- start 2024-04-25T09:54:31.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.363+0000 7fa30caac640 1 -- start start 2024-04-25T09:54:31.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.364+0000 7fa30caac640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3080b9290 0x7fa3081600b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:31.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.364+0000 7fa30caac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3080d3330 0x7fa3080c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:31.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.364+0000 7fa30caac640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa30815de70 0x7fa308157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:31.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.364+0000 7fa30caac640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3080d3d40 con 0x7fa3080b9290 2024-04-25T09:54:31.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.364+0000 7fa30caac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3080d2e10 con 0x7fa3080d3330 2024-04-25T09:54:31.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.364+0000 7fa30caac640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3080d3ec0 con 0x7fa30815de70 2024-04-25T09:54:31.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.364+0000 7fa30659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3080b9290 0x7fa3081600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:31.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.364+0000 7fa30659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3080b9290 0x7fa3081600b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51556/0 (socket says 172.21.15.7:51556) 2024-04-25T09:54:31.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.364+0000 7fa30659c640 1 -- 172.21.15.7:0/2131768584 learned_addr learned my addr 172.21.15.7:0/2131768584 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:31.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.364+0000 7fa305d9b640 1 --2- 172.21.15.7:0/2131768584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3080d3330 0x7fa3080c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:31.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.364+0000 7fa306d9d640 1 --2- 172.21.15.7:0/2131768584 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa30815de70 0x7fa308157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:31.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.364+0000 7fa30659c640 1 -- 172.21.15.7:0/2131768584 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa30815de70 msgr2=0x7fa308157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:31.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.364+0000 7fa30659c640 1 --2- 172.21.15.7:0/2131768584 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa30815de70 0x7fa308157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:31.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.364+0000 7fa30659c640 1 -- 172.21.15.7:0/2131768584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3080d3330 msgr2=0x7fa3080c9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:31.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.364+0000 7fa30659c640 1 --2- 172.21.15.7:0/2131768584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3080d3330 0x7fa3080c9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:31.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.364+0000 7fa30659c640 1 -- 172.21.15.7:0/2131768584 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30814b080 con 0x7fa3080b9290 2024-04-25T09:54:31.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.364+0000 7fa306d9d640 1 --2- 172.21.15.7:0/2131768584 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa30815de70 0x7fa308157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:31.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.365+0000 7fa30659c640 1 --2- 172.21.15.7:0/2131768584 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3080b9290 0x7fa3081600b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa30000c390 tx=0x7fa30000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:31.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.365+0000 7fa2f6ffd640 1 -- 172.21.15.7:0/2131768584 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa300017070 con 0x7fa3080b9290 2024-04-25T09:54:31.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.365+0000 7fa2f6ffd640 1 -- 172.21.15.7:0/2131768584 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa300005ce0 con 0x7fa3080b9290 2024-04-25T09:54:31.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.365+0000 7fa30caac640 1 -- 172.21.15.7:0/2131768584 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa30814b360 con 0x7fa3080b9290 2024-04-25T09:54:31.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.365+0000 7fa2f6ffd640 1 -- 172.21.15.7:0/2131768584 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3000072f0 con 0x7fa3080b9290 2024-04-25T09:54:31.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.365+0000 7fa30caac640 1 -- 172.21.15.7:0/2131768584 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3080c7320 con 0x7fa3080b9290 2024-04-25T09:54:31.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.366+0000 7fa30caac640 1 -- 172.21.15.7:0/2131768584 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa308069040 con 0x7fa3080b9290 2024-04-25T09:54:31.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.366+0000 7fa2f6ffd640 1 -- 172.21.15.7:0/2131768584 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa30001a070 con 0x7fa3080b9290 2024-04-25T09:54:31.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.367+0000 7fa2f6ffd640 1 --2- 172.21.15.7:0/2131768584 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa2e806b4d0 0x7fa2e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:31.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.367+0000 7fa2f6ffd640 1 -- 172.21.15.7:0/2131768584 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fa3000898b0 con 0x7fa3080b9290 2024-04-25T09:54:31.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.367+0000 7fa305d9b640 1 --2- 172.21.15.7:0/2131768584 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa2e806b4d0 0x7fa2e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:31.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.367+0000 7fa305d9b640 1 --2- 172.21.15.7:0/2131768584 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa2e806b4d0 0x7fa2e806d990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc034000 tx=0x7fa2fc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:31.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.371+0000 7fa2f6ffd640 1 -- 172.21.15.7:0/2131768584 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa3000584a0 con 0x7fa3080b9290 2024-04-25T09:54:31.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:31.554+0000 7fa30caac640 1 -- 172.21.15.7:0/2131768584 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fa3080b6c90 con 0x7fa3080b9290 2024-04-25T09:54:32.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.234+0000 7fa2f6ffd640 1 -- 172.21.15.7:0/2131768584 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa300057da0 con 0x7fa3080b9290 2024-04-25T09:54:32.237 INFO:teuthology.orchestra.run.smithi007.stderr:set pool 4 allow_ec_overwrites to true 2024-04-25T09:54:32.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.239+0000 7fa30caac640 1 -- 172.21.15.7:0/2131768584 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa2e806b4d0 msgr2=0x7fa2e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:32.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.239+0000 7fa30caac640 1 --2- 172.21.15.7:0/2131768584 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa2e806b4d0 0x7fa2e806d990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc034000 tx=0x7fa2fc02e000 comp rx=0 tx=0).stop 2024-04-25T09:54:32.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.239+0000 7fa30caac640 1 -- 172.21.15.7:0/2131768584 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3080b9290 msgr2=0x7fa3081600b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:32.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.239+0000 7fa30caac640 1 --2- 172.21.15.7:0/2131768584 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3080b9290 0x7fa3081600b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa30000c390 tx=0x7fa30000c850 comp rx=0 tx=0).stop 2024-04-25T09:54:32.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.239+0000 7fa30caac640 1 -- 172.21.15.7:0/2131768584 shutdown_connections 2024-04-25T09:54:32.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.239+0000 7fa30caac640 1 --2- 172.21.15.7:0/2131768584 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa2e806b4d0 0x7fa2e806d990 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:32.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.239+0000 7fa30caac640 1 --2- 172.21.15.7:0/2131768584 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa30815de70 0x7fa308157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:32.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.239+0000 7fa30caac640 1 --2- 172.21.15.7:0/2131768584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3080d3330 0x7fa3080c9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:32.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.239+0000 7fa30caac640 1 --2- 172.21.15.7:0/2131768584 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3080b9290 0x7fa3081600b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:32.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.239+0000 7fa30caac640 1 -- 172.21.15.7:0/2131768584 >> 172.21.15.7:0/2131768584 conn(0x7fa3080726b0 msgr2=0x7fa30815c470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:32.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.240+0000 7fa30caac640 1 -- 172.21.15.7:0/2131768584 shutdown_connections 2024-04-25T09:54:32.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.240+0000 7fa30caac640 1 -- 172.21.15.7:0/2131768584 wait complete. 2024-04-25T09:54:32.268 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-25T09:54:32.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.376+0000 7fe9fa012640 1 Processor -- start 2024-04-25T09:54:32.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.376+0000 7fe9fa012640 1 -- start start 2024-04-25T09:54:32.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.376+0000 7fe9fa012640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe9f415de30 0x7fe9f415e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:32.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.376+0000 7fe9fa012640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe9f40d0280 0x7fe9f40d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:32.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.376+0000 7fe9fa012640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f40d0bf0 con 0x7fe9f415da50 2024-04-25T09:54:32.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.376+0000 7fe9fa012640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f40cf1a0 con 0x7fe9f40d0280 2024-04-25T09:54:32.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.376+0000 7fe9fa012640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f40ce2b0 con 0x7fe9f415de30 2024-04-25T09:54:32.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.377+0000 7fe9f3fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe9f40d0280 0x7fe9f40d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:32.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.377+0000 7fe9f37fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe9f415da50 0x7fe9f40cea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54760/0 (socket says 172.21.15.7:54760) 2024-04-25T09:54:32.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.377+0000 7fe9f37fe640 1 -- 172.21.15.7:0/3184959625 learned_addr learned my addr 172.21.15.7:0/3184959625 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:32.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.377+0000 7fe9f2ffd640 1 --2- 172.21.15.7:0/3184959625 >> v2:172.21.15.55:3300/0 conn(0x7fe9f415de30 0x7fe9f415e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:32.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.377+0000 7fe9f3fff640 1 -- 172.21.15.7:0/3184959625 >> v2:172.21.15.55:3300/0 conn(0x7fe9f415de30 msgr2=0x7fe9f415e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:32.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.377+0000 7fe9f3fff640 1 --2- 172.21.15.7:0/3184959625 >> v2:172.21.15.55:3300/0 conn(0x7fe9f415de30 0x7fe9f415e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:32.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.377+0000 7fe9f3fff640 1 -- 172.21.15.7:0/3184959625 >> v1:172.21.15.7:6789/0 conn(0x7fe9f415da50 legacy=0x7fe9f40cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:32.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.377+0000 7fe9f3fff640 1 -- 172.21.15.7:0/3184959625 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f415e960 con 0x7fe9f40d0280 2024-04-25T09:54:32.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.378+0000 7fe9f3fff640 1 --2- 172.21.15.7:0/3184959625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9f40d0280 0x7fe9f40d06b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe9f408b9a0 tx=0x7fe9ec02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8390513461476786 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:32.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.378+0000 7fe9f27fc640 1 -- 172.21.15.7:0/3184959625 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec007740 con 0x7fe9f40d0280 2024-04-25T09:54:32.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.378+0000 7fe9f27fc640 1 -- 172.21.15.7:0/3184959625 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ec0078e0 con 0x7fe9f40d0280 2024-04-25T09:54:32.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.378+0000 7fe9f27fc640 1 -- 172.21.15.7:0/3184959625 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec007cb0 con 0x7fe9f40d0280 2024-04-25T09:54:32.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.378+0000 7fe9fa012640 1 -- 172.21.15.7:0/3184959625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9f40d0280 msgr2=0x7fe9f40d06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:32.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.378+0000 7fe9fa012640 1 --2- 172.21.15.7:0/3184959625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9f40d0280 0x7fe9f40d06b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe9f408b9a0 tx=0x7fe9ec02a680 comp rx=0 tx=0).stop 2024-04-25T09:54:32.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.378+0000 7fe9fa012640 1 -- 172.21.15.7:0/3184959625 shutdown_connections 2024-04-25T09:54:32.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.378+0000 7fe9fa012640 1 --2- 172.21.15.7:0/3184959625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9f40d0280 0x7fe9f40d06b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:32.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.378+0000 7fe9fa012640 1 --2- 172.21.15.7:0/3184959625 >> v2:172.21.15.55:3300/0 conn(0x7fe9f415de30 0x7fe9f415e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:32.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.378+0000 7fe9fa012640 1 -- 172.21.15.7:0/3184959625 >> 172.21.15.7:0/3184959625 conn(0x7fe9f4072290 msgr2=0x7fe9f4072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:32.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.378+0000 7fe9fa012640 1 -- 172.21.15.7:0/3184959625 shutdown_connections 2024-04-25T09:54:32.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.378+0000 7fe9fa012640 1 -- 172.21.15.7:0/3184959625 wait complete. 2024-04-25T09:54:32.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.379+0000 7fe9fa012640 1 Processor -- start 2024-04-25T09:54:32.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.380+0000 7fe9fa012640 1 -- start start 2024-04-25T09:54:32.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.380+0000 7fe9fa012640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9f40d0280 0x7fe9f40cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:32.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.380+0000 7fe9fa012640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe9f415da50 0x7fe9f40ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:32.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.380+0000 7fe9fa012640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9f415de30 0x7fe9f4154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:32.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.380+0000 7fe9fa012640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f4161640 con 0x7fe9f415de30 2024-04-25T09:54:32.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.380+0000 7fe9fa012640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f40ce570 con 0x7fe9f40d0280 2024-04-25T09:54:32.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.380+0000 7fe9fa012640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f41617c0 con 0x7fe9f415da50 2024-04-25T09:54:32.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.380+0000 7fe9f3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9f415de30 0x7fe9f4154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:32.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.380+0000 7fe9f3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9f415de30 0x7fe9f4154c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51576/0 (socket says 172.21.15.7:51576) 2024-04-25T09:54:32.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.380+0000 7fe9f3fff640 1 -- 172.21.15.7:0/3046013480 learned_addr learned my addr 172.21.15.7:0/3046013480 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:32.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.381+0000 7fe9f37fe640 1 --2- 172.21.15.7:0/3046013480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9f40d0280 0x7fe9f40cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:32.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.381+0000 7fe9f2ffd640 1 --2- 172.21.15.7:0/3046013480 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe9f415da50 0x7fe9f40ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:32.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.381+0000 7fe9f3fff640 1 -- 172.21.15.7:0/3046013480 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe9f415da50 msgr2=0x7fe9f40ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:32.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.381+0000 7fe9f3fff640 1 --2- 172.21.15.7:0/3046013480 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe9f415da50 0x7fe9f40ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:32.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.381+0000 7fe9f3fff640 1 -- 172.21.15.7:0/3046013480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9f40d0280 msgr2=0x7fe9f40cb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:32.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.381+0000 7fe9f3fff640 1 --2- 172.21.15.7:0/3046013480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9f40d0280 0x7fe9f40cb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:32.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.381+0000 7fe9f3fff640 1 -- 172.21.15.7:0/3046013480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f40cc480 con 0x7fe9f415de30 2024-04-25T09:54:32.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.381+0000 7fe9f3fff640 1 --2- 172.21.15.7:0/3046013480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9f415de30 0x7fe9f4154c10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec009e50 tx=0x7fe9ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:32.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.381+0000 7fe9dbfff640 1 -- 172.21.15.7:0/3046013480 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec040070 con 0x7fe9f415de30 2024-04-25T09:54:32.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.381+0000 7fe9dbfff640 1 -- 172.21.15.7:0/3046013480 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ec031bf0 con 0x7fe9f415de30 2024-04-25T09:54:32.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.381+0000 7fe9fa012640 1 -- 172.21.15.7:0/3046013480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f40cbbe0 con 0x7fe9f415de30 2024-04-25T09:54:32.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.381+0000 7fe9dbfff640 1 -- 172.21.15.7:0/3046013480 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec045460 con 0x7fe9f415de30 2024-04-25T09:54:32.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.381+0000 7fe9fa012640 1 -- 172.21.15.7:0/3046013480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f4155970 con 0x7fe9f415de30 2024-04-25T09:54:32.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.382+0000 7fe9fa012640 1 -- 172.21.15.7:0/3046013480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f4068fd0 con 0x7fe9f415de30 2024-04-25T09:54:32.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.383+0000 7fe9dbfff640 1 -- 172.21.15.7:0/3046013480 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe9ec039040 con 0x7fe9f415de30 2024-04-25T09:54:32.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.383+0000 7fe9dbfff640 1 --2- 172.21.15.7:0/3046013480 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe9e006b4d0 0x7fe9e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:32.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.383+0000 7fe9dbfff640 1 -- 172.21.15.7:0/3046013480 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fe9ec0abc80 con 0x7fe9f415de30 2024-04-25T09:54:32.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.383+0000 7fe9f37fe640 1 --2- 172.21.15.7:0/3046013480 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe9e006b4d0 0x7fe9e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:32.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.383+0000 7fe9f37fe640 1 --2- 172.21.15.7:0/3046013480 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe9e006b4d0 0x7fe9e006d990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4007fd0 tx=0x7fe9e4007e80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:32.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.387+0000 7fe9dbfff640 1 -- 172.21.15.7:0/3046013480 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe9ec07a2b0 con 0x7fe9f415de30 2024-04-25T09:54:32.527 INFO:tasks.ceph.mds.b.smithi055.stderr:2024-04-25T09:54:32.524+0000 7ff7fabf2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:54:32.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:32.605+0000 7fe9fa012640 1 -- 172.21.15.7:0/3046013480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fe9f40d1610 con 0x7fe9f415de30 2024-04-25T09:54:33.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.249+0000 7fe9dbfff640 1 -- 172.21.15.7:0/3046013480 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) v1 ==== 137+0+0 (secure 0 0 0) 0x7fe9ec07e350 con 0x7fe9f415de30 2024-04-25T09:54:33.252 INFO:teuthology.orchestra.run.smithi007.stderr:added data pool 4 to fsmap 2024-04-25T09:54:33.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.252+0000 7fe9fa012640 1 -- 172.21.15.7:0/3046013480 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe9e006b4d0 msgr2=0x7fe9e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:33.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.252+0000 7fe9fa012640 1 --2- 172.21.15.7:0/3046013480 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe9e006b4d0 0x7fe9e006d990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4007fd0 tx=0x7fe9e4007e80 comp rx=0 tx=0).stop 2024-04-25T09:54:33.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.252+0000 7fe9fa012640 1 -- 172.21.15.7:0/3046013480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9f415de30 msgr2=0x7fe9f4154c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:33.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.252+0000 7fe9fa012640 1 --2- 172.21.15.7:0/3046013480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9f415de30 0x7fe9f4154c10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec009e50 tx=0x7fe9ec004a40 comp rx=0 tx=0).stop 2024-04-25T09:54:33.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.252+0000 7fe9fa012640 1 -- 172.21.15.7:0/3046013480 shutdown_connections 2024-04-25T09:54:33.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.252+0000 7fe9fa012640 1 --2- 172.21.15.7:0/3046013480 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe9e006b4d0 0x7fe9e006d990 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:33.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.252+0000 7fe9fa012640 1 --2- 172.21.15.7:0/3046013480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9f415de30 0x7fe9f4154c10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:33.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.252+0000 7fe9fa012640 1 --2- 172.21.15.7:0/3046013480 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe9f415da50 0x7fe9f40ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:33.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.252+0000 7fe9fa012640 1 --2- 172.21.15.7:0/3046013480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9f40d0280 0x7fe9f40cb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:33.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.252+0000 7fe9fa012640 1 -- 172.21.15.7:0/3046013480 >> 172.21.15.7:0/3046013480 conn(0x7fe9f4072290 msgr2=0x7fe9f4072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:33.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.253+0000 7fe9fa012640 1 -- 172.21.15.7:0/3046013480 shutdown_connections 2024-04-25T09:54:33.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.253+0000 7fe9fa012640 1 -- 172.21.15.7:0/3046013480 wait complete. 2024-04-25T09:54:33.268 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:54:33.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.372+0000 7fd923af7640 1 Processor -- start 2024-04-25T09:54:33.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.372+0000 7fd923af7640 1 -- start start 2024-04-25T09:54:33.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.373+0000 7fd923af7640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd91c15db00 0x7fd91c0d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:33.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.373+0000 7fd923af7640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd91c0d1e80 con 0x7fd91c0ce2b0 2024-04-25T09:54:33.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.373+0000 7fd923af7640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd91c162490 con 0x7fd91c0b53b0 2024-04-25T09:54:33.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.373+0000 7fd923af7640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c0b5930 con 0x7fd91c15db00 2024-04-25T09:54:33.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.373+0000 7fd922094640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd91c0ce2b0 0x7fd91c161d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54772/0 (socket says 172.21.15.7:54772) 2024-04-25T09:54:33.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.373+0000 7fd922094640 1 -- 172.21.15.7:0/1351268911 learned_addr learned my addr 172.21.15.7:0/1351268911 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:33.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.373+0000 7fd921893640 1 --2- 172.21.15.7:0/1351268911 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd91c15db00 0x7fd91c0d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:33.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.373+0000 7fd920891640 1 -- 172.21.15.7:0/1351268911 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221074834 0 0) 0x7fd91c0d1e80 con 0x7fd91c0ce2b0 2024-04-25T09:54:33.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.373+0000 7fd920891640 1 -- 172.21.15.7:0/1351268911 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd908003520 con 0x7fd91c0ce2b0 2024-04-25T09:54:33.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.374+0000 7fd920891640 1 -- 172.21.15.7:0/1351268911 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2969611744 0 0) 0x7fd91c162490 con 0x7fd91c0b53b0 2024-04-25T09:54:33.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.374+0000 7fd920891640 1 -- 172.21.15.7:0/1351268911 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd91c0d1e80 con 0x7fd91c0b53b0 2024-04-25T09:54:33.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.374+0000 7fd920891640 1 -- 172.21.15.7:0/1351268911 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3955799631 0 0) 0x7fd908003520 con 0x7fd91c0ce2b0 2024-04-25T09:54:33.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.374+0000 7fd920891640 1 -- 172.21.15.7:0/1351268911 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd91c15db00 msgr2=0x7fd91c0d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:33.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.374+0000 7fd920891640 1 --2- 172.21.15.7:0/1351268911 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd91c15db00 0x7fd91c0d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:33.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.374+0000 7fd920891640 1 -- 172.21.15.7:0/1351268911 >> v1:172.21.15.55:6789/0 conn(0x7fd91c0b53b0 legacy=0x7fd91c161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:33.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.374+0000 7fd920891640 1 -- 172.21.15.7:0/1351268911 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91c0b5c10 con 0x7fd91c0ce2b0 2024-04-25T09:54:33.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.374+0000 7fd920891640 1 -- 172.21.15.7:0/1351268911 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fd9140019f0 con 0x7fd91c0ce2b0 2024-04-25T09:54:33.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.374+0000 7fd921893640 1 --2- 172.21.15.7:0/1351268911 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd91c15db00 0x7fd91c0d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:54:33.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.374+0000 7fd920891640 1 -- 172.21.15.7:0/1351268911 >> v1:172.21.15.7:6789/0 conn(0x7fd91c0ce2b0 legacy=0x7fd91c161d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:33.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.374+0000 7fd920891640 1 --2- 172.21.15.7:0/1351268911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd908003b70 0x7fd908003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:33.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.374+0000 7fd920891640 1 --2- 172.21.15.7:0/1351268911 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd91c15db00 0x7fd908004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:33.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.374+0000 7fd920891640 1 --2- 172.21.15.7:0/1351268911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd908004d40 0x7fd9080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:33.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.374+0000 7fd920891640 1 -- 172.21.15.7:0/1351268911 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c0b5930 con 0x7fd908004d40 2024-04-25T09:54:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.374+0000 7fd920891640 1 -- 172.21.15.7:0/1351268911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90800ba70 con 0x7fd908003b70 2024-04-25T09:54:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.374+0000 7fd920891640 1 -- 172.21.15.7:0/1351268911 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90800bbf0 con 0x7fd91c15db00 2024-04-25T09:54:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.374+0000 7fd922094640 1 --2- 172.21.15.7:0/1351268911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd908004d40 0x7fd9080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.374+0000 7fd921893640 1 --2- 172.21.15.7:0/1351268911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd908003b70 0x7fd908003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.374+0000 7fd921092640 1 --2- 172.21.15.7:0/1351268911 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd91c15db00 0x7fd908004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.374+0000 7fd922094640 1 -- 172.21.15.7:0/1351268911 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd91c15db00 msgr2=0x7fd908004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.374+0000 7fd922094640 1 --2- 172.21.15.7:0/1351268911 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd91c15db00 0x7fd908004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.374+0000 7fd922094640 1 -- 172.21.15.7:0/1351268911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd908003b70 msgr2=0x7fd908003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.374+0000 7fd922094640 1 --2- 172.21.15.7:0/1351268911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd908003b70 0x7fd908003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.374+0000 7fd922094640 1 -- 172.21.15.7:0/1351268911 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd908003520 con 0x7fd908004d40 2024-04-25T09:54:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.375+0000 7fd922094640 1 --2- 172.21.15.7:0/1351268911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd908004d40 0x7fd9080051c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd91400a850 tx=0x7fd908005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=429d4098b9840082 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.375+0000 7fd920891640 1 -- 172.21.15.7:0/1351268911 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91400a450 con 0x7fd908004d40 2024-04-25T09:54:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.375+0000 7fd920891640 1 -- 172.21.15.7:0/1351268911 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91402f070 con 0x7fd908004d40 2024-04-25T09:54:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.375+0000 7fd920891640 1 -- 172.21.15.7:0/1351268911 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91402bc70 con 0x7fd908004d40 2024-04-25T09:54:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.376+0000 7fd923af7640 1 -- 172.21.15.7:0/1351268911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd908004d40 msgr2=0x7fd9080051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.376+0000 7fd923af7640 1 --2- 172.21.15.7:0/1351268911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd908004d40 0x7fd9080051c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd91400a850 tx=0x7fd908005830 comp rx=0 tx=0).stop 2024-04-25T09:54:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.376+0000 7fd922094640 1 -- 172.21.15.7:0/1351268911 reap_dead start 2024-04-25T09:54:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.376+0000 7fd923af7640 1 -- 172.21.15.7:0/1351268911 shutdown_connections 2024-04-25T09:54:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.376+0000 7fd923af7640 1 -- 172.21.15.7:0/1351268911 >> 172.21.15.7:0/1351268911 conn(0x7fd91c072290 msgr2=0x7fd91c0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.376+0000 7fd923af7640 1 -- 172.21.15.7:0/1351268911 shutdown_connections 2024-04-25T09:54:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.376+0000 7fd923af7640 1 -- 172.21.15.7:0/1351268911 wait complete. 2024-04-25T09:54:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.377+0000 7fd923af7640 1 Processor -- start 2024-04-25T09:54:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.377+0000 7fd923af7640 1 -- start start 2024-04-25T09:54:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.378+0000 7fd923af7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd908004d40 0x7fd91c1597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.378+0000 7fd923af7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd91c152c10 0x7fd91c152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.378+0000 7fd923af7640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd91c15b420 0x7fd91c15b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.378+0000 7fd923af7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c0b61d0 con 0x7fd91c152c10 2024-04-25T09:54:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.378+0000 7fd923af7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c15dee0 con 0x7fd908004d40 2024-04-25T09:54:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.378+0000 7fd923af7640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c0d3660 con 0x7fd91c15b420 2024-04-25T09:54:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.378+0000 7fd921092640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd91c152c10 0x7fd91c152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.378+0000 7fd921092640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd91c152c10 0x7fd91c152300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51606/0 (socket says 172.21.15.7:51606) 2024-04-25T09:54:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.378+0000 7fd921092640 1 -- 172.21.15.7:0/2914298602 learned_addr learned my addr 172.21.15.7:0/2914298602 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.378+0000 7fd922094640 1 --2- 172.21.15.7:0/2914298602 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd91c15b420 0x7fd91c15b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.378+0000 7fd921893640 1 --2- 172.21.15.7:0/2914298602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd908004d40 0x7fd91c1597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.378+0000 7fd921092640 1 -- 172.21.15.7:0/2914298602 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd91c15b420 msgr2=0x7fd91c15b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.378+0000 7fd921092640 1 --2- 172.21.15.7:0/2914298602 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd91c15b420 0x7fd91c15b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.378+0000 7fd921092640 1 -- 172.21.15.7:0/2914298602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd908004d40 msgr2=0x7fd91c1597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.378+0000 7fd921092640 1 --2- 172.21.15.7:0/2914298602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd908004d40 0x7fd91c1597b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.378+0000 7fd921092640 1 -- 172.21.15.7:0/2914298602 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91c15c2a0 con 0x7fd91c152c10 2024-04-25T09:54:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.378+0000 7fd921893640 1 --2- 172.21.15.7:0/2914298602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd908004d40 0x7fd91c1597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.378+0000 7fd921092640 1 --2- 172.21.15.7:0/2914298602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd91c152c10 0x7fd91c152300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00f7a0 tx=0x7fd90c00fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.378+0000 7fd9127fc640 1 -- 172.21.15.7:0/2914298602 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c00fe50 con 0x7fd91c152c10 2024-04-25T09:54:33.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.378+0000 7fd9127fc640 1 -- 172.21.15.7:0/2914298602 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c018070 con 0x7fd91c152c10 2024-04-25T09:54:33.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.378+0000 7fd923af7640 1 -- 172.21.15.7:0/2914298602 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91c15c580 con 0x7fd91c152c10 2024-04-25T09:54:33.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.378+0000 7fd9127fc640 1 -- 172.21.15.7:0/2914298602 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c00d730 con 0x7fd91c152c10 2024-04-25T09:54:33.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.378+0000 7fd923af7640 1 -- 172.21.15.7:0/2914298602 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd91c159cf0 con 0x7fd91c152c10 2024-04-25T09:54:33.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.379+0000 7fd923af7640 1 -- 172.21.15.7:0/2914298602 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd91c068fd0 con 0x7fd91c152c10 2024-04-25T09:54:33.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.380+0000 7fd9127fc640 1 -- 172.21.15.7:0/2914298602 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd90c00d8d0 con 0x7fd91c152c10 2024-04-25T09:54:33.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.380+0000 7fd9127fc640 1 --2- 172.21.15.7:0/2914298602 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd90006b4d0 0x7fd90006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:33.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.380+0000 7fd9127fc640 1 -- 172.21.15.7:0/2914298602 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd90c08a5b0 con 0x7fd91c152c10 2024-04-25T09:54:33.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.380+0000 7fd921893640 1 --2- 172.21.15.7:0/2914298602 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd90006b4d0 0x7fd90006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:33.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.381+0000 7fd921893640 1 --2- 172.21.15.7:0/2914298602 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd90006b4d0 0x7fd90006d990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd918009ab0 tx=0x7fd918008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:33.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.385+0000 7fd9127fc640 1 -- 172.21.15.7:0/2914298602 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd90c059060 con 0x7fd91c152c10 2024-04-25T09:54:33.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.609+0000 7fd923af7640 1 -- 172.21.15.7:0/2914298602 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd91c0c9c60 con 0x7fd91c152c10 2024-04-25T09:54:33.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.609+0000 7fd9127fc640 1 -- 172.21.15.7:0/2914298602 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4928 (secure 0 0 0) 0x7fd90c058960 con 0x7fd91c152c10 2024-04-25T09:54:33.612 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:33.612 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1968579214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1968579214},{"type":"v1","addr":"172.21.15.7:6837","nonce":1968579214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3479570567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3479570567},{"type":"v1","addr":"172.21.15.55:6834","nonce":3479570567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/2289657027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2289657027},{"type":"v1","addr":"172.21.15.7:6836","nonce":2289657027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:54:27.558601+0000","modified":"2024-04-25T09:54:32.606974+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/3779228372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3779228372},{"type":"v1","addr":"172.21.15.55:6835","nonce":3779228372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-25T09:54:33.613 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 6 2024-04-25T09:54:33.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.612+0000 7fd923af7640 1 -- 172.21.15.7:0/2914298602 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd90006b4d0 msgr2=0x7fd90006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:33.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.612+0000 7fd923af7640 1 --2- 172.21.15.7:0/2914298602 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd90006b4d0 0x7fd90006d990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd918009ab0 tx=0x7fd918008040 comp rx=0 tx=0).stop 2024-04-25T09:54:33.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.612+0000 7fd923af7640 1 -- 172.21.15.7:0/2914298602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd91c152c10 msgr2=0x7fd91c152300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:33.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.612+0000 7fd923af7640 1 --2- 172.21.15.7:0/2914298602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd91c152c10 0x7fd91c152300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00f7a0 tx=0x7fd90c00fc60 comp rx=0 tx=0).stop 2024-04-25T09:54:33.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.612+0000 7fd923af7640 1 -- 172.21.15.7:0/2914298602 shutdown_connections 2024-04-25T09:54:33.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.612+0000 7fd923af7640 1 --2- 172.21.15.7:0/2914298602 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd90006b4d0 0x7fd90006d990 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:33.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.612+0000 7fd923af7640 1 --2- 172.21.15.7:0/2914298602 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd91c15b420 0x7fd91c15b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:33.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.612+0000 7fd923af7640 1 --2- 172.21.15.7:0/2914298602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd91c152c10 0x7fd91c152300 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:33.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.612+0000 7fd923af7640 1 --2- 172.21.15.7:0/2914298602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd908004d40 0x7fd91c1597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:33.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.612+0000 7fd923af7640 1 -- 172.21.15.7:0/2914298602 >> 172.21.15.7:0/2914298602 conn(0x7fd91c072290 msgr2=0x7fd91c0c7460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:33.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.612+0000 7fd923af7640 1 -- 172.21.15.7:0/2914298602 shutdown_connections 2024-04-25T09:54:33.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.612+0000 7fd923af7640 1 -- 172.21.15.7:0/2914298602 wait complete. 2024-04-25T09:54:33.625 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:54:33.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.723+0000 7f19f2bd5640 1 Processor -- start 2024-04-25T09:54:33.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.723+0000 7f19f2bd5640 1 -- start start 2024-04-25T09:54:33.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.723+0000 7f19f2bd5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19ec15dd00 0x7f19ec0b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:33.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.723+0000 7f19f2bd5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f19ec06c6c0 0x7f19ec0b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:33.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.723+0000 7f19f2bd5640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19ec06cd00 con 0x7f19ec0b6a40 2024-04-25T09:54:33.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.723+0000 7f19f2bd5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19ec15e0e0 con 0x7f19ec06c6c0 2024-04-25T09:54:33.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.723+0000 7f19f2bd5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec06cfe0 con 0x7f19ec15dd00 2024-04-25T09:54:33.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.724+0000 7f19ebfff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f19ec0b6a40 0x7f19ec06bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54788/0 (socket says 172.21.15.7:54788) 2024-04-25T09:54:33.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.724+0000 7f19ebfff640 1 -- 172.21.15.7:0/1634461726 learned_addr learned my addr 172.21.15.7:0/1634461726 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:33.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.724+0000 7f19eb7fe640 1 -- 172.21.15.7:0/1634461726 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2178477905 0 0) 0x7f19ec06cd00 con 0x7f19ec0b6a40 2024-04-25T09:54:33.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.724+0000 7f19f0971640 1 --2- 172.21.15.7:0/1634461726 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19ec15dd00 0x7f19ec0b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:33.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.724+0000 7f19f1172640 1 --2- 172.21.15.7:0/1634461726 >> v2:172.21.15.55:3300/0 conn(0x7f19ec06c6c0 0x7f19ec0b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:33.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.724+0000 7f19eb7fe640 1 -- 172.21.15.7:0/1634461726 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19d8003520 con 0x7f19ec0b6a40 2024-04-25T09:54:33.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.724+0000 7f19eb7fe640 1 -- 172.21.15.7:0/1634461726 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 406205851 0 0) 0x7f19d8003520 con 0x7f19ec0b6a40 2024-04-25T09:54:33.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.724+0000 7f19eb7fe640 1 -- 172.21.15.7:0/1634461726 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19ec15dd00 msgr2=0x7f19ec0b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:33.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.724+0000 7f19eb7fe640 1 --2- 172.21.15.7:0/1634461726 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19ec15dd00 0x7f19ec0b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:33.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.724+0000 7f19eb7fe640 1 -- 172.21.15.7:0/1634461726 >> v2:172.21.15.55:3300/0 conn(0x7f19ec06c6c0 msgr2=0x7f19ec0b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:33.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.724+0000 7f19eb7fe640 1 --2- 172.21.15.7:0/1634461726 >> v2:172.21.15.55:3300/0 conn(0x7f19ec06c6c0 0x7f19ec0b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:33.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.724+0000 7f19eb7fe640 1 -- 172.21.15.7:0/1634461726 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ec0d1ca0 con 0x7f19ec0b6a40 2024-04-25T09:54:33.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.724+0000 7f19eb7fe640 1 -- 172.21.15.7:0/1634461726 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f19d4001670 con 0x7f19ec0b6a40 2024-04-25T09:54:33.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.724+0000 7f19eb7fe640 1 -- 172.21.15.7:0/1634461726 >> v1:172.21.15.7:6789/0 conn(0x7f19ec0b6a40 legacy=0x7f19ec06bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:33.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.724+0000 7f19eb7fe640 1 --2- 172.21.15.7:0/1634461726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19d80039b0 0x7f19d8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:33.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.724+0000 7f19eb7fe640 1 --2- 172.21.15.7:0/1634461726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19d8004800 0x7f19d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:33.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.724+0000 7f19eb7fe640 1 --2- 172.21.15.7:0/1634461726 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19ec15dd00 0x7f19d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:33.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.724+0000 7f19eb7fe640 1 -- 172.21.15.7:0/1634461726 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec15e0e0 con 0x7f19d80039b0 2024-04-25T09:54:33.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.724+0000 7f19eb7fe640 1 -- 172.21.15.7:0/1634461726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec06cfe0 con 0x7f19d8004800 2024-04-25T09:54:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.724+0000 7f19eb7fe640 1 -- 172.21.15.7:0/1634461726 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d800b9c0 con 0x7f19ec15dd00 2024-04-25T09:54:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.724+0000 7f19f0971640 1 --2- 172.21.15.7:0/1634461726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19d80039b0 0x7f19d8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.724+0000 7f19ebfff640 1 --2- 172.21.15.7:0/1634461726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19d8004800 0x7f19d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.724+0000 7f19f1172640 1 --2- 172.21.15.7:0/1634461726 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19ec15dd00 0x7f19d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.725+0000 7f19f0971640 1 -- 172.21.15.7:0/1634461726 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19ec15dd00 msgr2=0x7f19d80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.725+0000 7f19f0971640 1 --2- 172.21.15.7:0/1634461726 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19ec15dd00 0x7f19d80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.725+0000 7f19f0971640 1 -- 172.21.15.7:0/1634461726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19d8004800 msgr2=0x7f19d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.725+0000 7f19f0971640 1 --2- 172.21.15.7:0/1634461726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19d8004800 0x7f19d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.725+0000 7f19f0971640 1 -- 172.21.15.7:0/1634461726 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d8003520 con 0x7f19d80039b0 2024-04-25T09:54:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.725+0000 7f19f0971640 1 --2- 172.21.15.7:0/1634461726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19d80039b0 0x7f19d8003dd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f19e4009fc0 tx=0x7f19d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=698ec5061218ba41 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.725+0000 7f19eb7fe640 1 -- 172.21.15.7:0/1634461726 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e4009c10 con 0x7f19d80039b0 2024-04-25T09:54:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.725+0000 7f19eb7fe640 1 -- 172.21.15.7:0/1634461726 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e4036070 con 0x7f19d80039b0 2024-04-25T09:54:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.725+0000 7f19eb7fe640 1 -- 172.21.15.7:0/1634461726 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e4031880 con 0x7f19d80039b0 2024-04-25T09:54:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.726+0000 7f19f2bd5640 1 -- 172.21.15.7:0/1634461726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19d80039b0 msgr2=0x7f19d8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:33.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.726+0000 7f19f2bd5640 1 --2- 172.21.15.7:0/1634461726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19d80039b0 0x7f19d8003dd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f19e4009fc0 tx=0x7f19d8005830 comp rx=0 tx=0).stop 2024-04-25T09:54:33.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.726+0000 7f19f1172640 1 -- 172.21.15.7:0/1634461726 reap_dead start 2024-04-25T09:54:33.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.726+0000 7f19f2bd5640 1 -- 172.21.15.7:0/1634461726 shutdown_connections 2024-04-25T09:54:33.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.726+0000 7f19f2bd5640 1 -- 172.21.15.7:0/1634461726 >> 172.21.15.7:0/1634461726 conn(0x7f19ec0d07b0 msgr2=0x7f19ec0d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:33.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.726+0000 7f19f2bd5640 1 -- 172.21.15.7:0/1634461726 shutdown_connections 2024-04-25T09:54:33.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.726+0000 7f19f2bd5640 1 -- 172.21.15.7:0/1634461726 wait complete. 2024-04-25T09:54:33.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.727+0000 7f19f2bd5640 1 Processor -- start 2024-04-25T09:54:33.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.727+0000 7f19f2bd5640 1 -- start start 2024-04-25T09:54:33.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.728+0000 7f19f2bd5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19d80039b0 0x7f19ec1f7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:33.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.728+0000 7f19f2bd5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19ec0cd2b0 0x7f19ec160240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:33.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.728+0000 7f19f2bd5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19ec0cd710 0x7f19ec160780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:33.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.728+0000 7f19f2bd5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec0b5750 con 0x7f19d80039b0 2024-04-25T09:54:33.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.728+0000 7f19f2bd5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec0d2260 con 0x7f19ec0cd710 2024-04-25T09:54:33.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.728+0000 7f19f2bd5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec0b58d0 con 0x7f19ec0cd2b0 2024-04-25T09:54:33.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.728+0000 7f19f0971640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19d80039b0 0x7f19ec1f7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:33.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.728+0000 7f19f0971640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19d80039b0 0x7f19ec1f7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51610/0 (socket says 172.21.15.7:51610) 2024-04-25T09:54:33.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.728+0000 7f19f0971640 1 -- 172.21.15.7:0/2902133904 learned_addr learned my addr 172.21.15.7:0/2902133904 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:33.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.728+0000 7f19ebfff640 1 --2- 172.21.15.7:0/2902133904 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19ec0cd2b0 0x7f19ec160240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:33.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.728+0000 7f19f1172640 1 --2- 172.21.15.7:0/2902133904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19ec0cd710 0x7f19ec160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:33.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.729+0000 7f19f0971640 1 -- 172.21.15.7:0/2902133904 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19ec0cd2b0 msgr2=0x7f19ec160240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:33.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.729+0000 7f19f0971640 1 --2- 172.21.15.7:0/2902133904 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19ec0cd2b0 0x7f19ec160240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:33.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.729+0000 7f19f0971640 1 -- 172.21.15.7:0/2902133904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19ec0cd710 msgr2=0x7f19ec160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:33.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.729+0000 7f19f0971640 1 --2- 172.21.15.7:0/2902133904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19ec0cd710 0x7f19ec160780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:33.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.729+0000 7f19f0971640 1 -- 172.21.15.7:0/2902133904 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ec1f4430 con 0x7f19d80039b0 2024-04-25T09:54:33.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.729+0000 7f19f0971640 1 --2- 172.21.15.7:0/2902133904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19d80039b0 0x7f19ec1f7970 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f19e4033040 tx=0x7f19e4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:33.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.729+0000 7f19e97fa640 1 -- 172.21.15.7:0/2902133904 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e4031e50 con 0x7f19d80039b0 2024-04-25T09:54:33.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.729+0000 7f19e97fa640 1 -- 172.21.15.7:0/2902133904 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e4003990 con 0x7f19d80039b0 2024-04-25T09:54:33.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.729+0000 7f19f2bd5640 1 -- 172.21.15.7:0/2902133904 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19ec1f4710 con 0x7f19d80039b0 2024-04-25T09:54:33.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.729+0000 7f19e97fa640 1 -- 172.21.15.7:0/2902133904 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e4003d60 con 0x7f19d80039b0 2024-04-25T09:54:33.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.729+0000 7f19f2bd5640 1 -- 172.21.15.7:0/2902133904 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19ec1f7170 con 0x7f19d80039b0 2024-04-25T09:54:33.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.730+0000 7f19f2bd5640 1 -- 172.21.15.7:0/2902133904 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19ec068fd0 con 0x7f19d80039b0 2024-04-25T09:54:33.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.731+0000 7f19e97fa640 1 -- 172.21.15.7:0/2902133904 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f19e4005d10 con 0x7f19d80039b0 2024-04-25T09:54:33.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.731+0000 7f19e97fa640 1 --2- 172.21.15.7:0/2902133904 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f19cc06b670 0x7f19cc06db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:33.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.731+0000 7f19e97fa640 1 -- 172.21.15.7:0/2902133904 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f19e40ab890 con 0x7f19d80039b0 2024-04-25T09:54:33.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.731+0000 7f19ebfff640 1 --2- 172.21.15.7:0/2902133904 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f19cc06b670 0x7f19cc06db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:33.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.731+0000 7f19ebfff640 1 --2- 172.21.15.7:0/2902133904 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f19cc06b670 0x7f19cc06db30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f19ec0d41e0 tx=0x7f19d4007970 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:33.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.735+0000 7f19e97fa640 1 -- 172.21.15.7:0/2902133904 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f19e4079ea0 con 0x7f19d80039b0 2024-04-25T09:54:33.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.917+0000 7f19f2bd5640 1 -- 172.21.15.7:0/2902133904 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19ec0d1620 con 0x7f19d80039b0 2024-04-25T09:54:33.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.918+0000 7f19e97fa640 1 -- 172.21.15.7:0/2902133904 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18418 (secure 0 0 0) 0x7f19e407df40 con 0x7f19d80039b0 2024-04-25T09:54:33.921 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:33.921 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:54:32.606761+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:54:26.011833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:54:26.535536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:54:30.264996+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:54:33.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.920+0000 7f19f2bd5640 1 -- 172.21.15.7:0/2902133904 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f19cc06b670 msgr2=0x7f19cc06db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:33.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.920+0000 7f19f2bd5640 1 --2- 172.21.15.7:0/2902133904 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f19cc06b670 0x7f19cc06db30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f19ec0d41e0 tx=0x7f19d4007970 comp rx=0 tx=0).stop 2024-04-25T09:54:33.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.920+0000 7f19f2bd5640 1 -- 172.21.15.7:0/2902133904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19d80039b0 msgr2=0x7f19ec1f7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:33.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.920+0000 7f19f2bd5640 1 --2- 172.21.15.7:0/2902133904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19d80039b0 0x7f19ec1f7970 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f19e4033040 tx=0x7f19e4009750 comp rx=0 tx=0).stop 2024-04-25T09:54:33.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.920+0000 7f19f2bd5640 1 -- 172.21.15.7:0/2902133904 shutdown_connections 2024-04-25T09:54:33.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.920+0000 7f19f2bd5640 1 --2- 172.21.15.7:0/2902133904 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f19cc06b670 0x7f19cc06db30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:33.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.920+0000 7f19f2bd5640 1 --2- 172.21.15.7:0/2902133904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19ec0cd710 0x7f19ec160780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:33.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.920+0000 7f19f2bd5640 1 --2- 172.21.15.7:0/2902133904 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19ec0cd2b0 0x7f19ec160240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:33.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.920+0000 7f19f2bd5640 1 --2- 172.21.15.7:0/2902133904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19d80039b0 0x7f19ec1f7970 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:33.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.920+0000 7f19f2bd5640 1 -- 172.21.15.7:0/2902133904 >> 172.21.15.7:0/2902133904 conn(0x7f19ec0d07b0 msgr2=0x7f19ec0b6e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:33.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.920+0000 7f19f2bd5640 1 -- 172.21.15.7:0/2902133904 shutdown_connections 2024-04-25T09:54:33.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:33.920+0000 7f19f2bd5640 1 -- 172.21.15.7:0/2902133904 wait complete. 2024-04-25T09:54:33.934 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:54:34.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.032+0000 7f2826170640 1 Processor -- start 2024-04-25T09:54:34.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.032+0000 7f2826170640 1 -- start start 2024-04-25T09:54:34.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.032+0000 7f2826170640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f282006ab60 0x7f28200b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:34.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.032+0000 7f2826170640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f282015dc60 0x7f282006af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:34.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.032+0000 7f2826170640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28200b5a20 con 0x7f28200afc00 2024-04-25T09:54:34.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.032+0000 7f2826170640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28200b0160 con 0x7f282015dc60 2024-04-25T09:54:34.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.032+0000 7f2826170640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282006b480 con 0x7f282006ab60 2024-04-25T09:54:34.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.033+0000 7f281effd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f282015dc60 0x7f282006af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:34.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.033+0000 7f281effd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f282015dc60 0x7f282006af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51624/0 (socket says 172.21.15.7:51624) 2024-04-25T09:54:34.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.033+0000 7f281ffff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f28200afc00 0x7f28200b0c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54790/0 (socket says 172.21.15.7:54790) 2024-04-25T09:54:34.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.033+0000 7f281effd640 1 -- 172.21.15.7:0/456313059 learned_addr learned my addr 172.21.15.7:0/456313059 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:34.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.033+0000 7f281f7fe640 1 --2- 172.21.15.7:0/456313059 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f282006ab60 0x7f28200b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:34.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.033+0000 7f281effd640 1 -- 172.21.15.7:0/456313059 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f282006ab60 msgr2=0x7f28200b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:34.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.033+0000 7f281effd640 1 --2- 172.21.15.7:0/456313059 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f282006ab60 0x7f28200b1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:34.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.033+0000 7f281effd640 1 -- 172.21.15.7:0/456313059 >> v1:172.21.15.7:6789/0 conn(0x7f28200afc00 legacy=0x7f28200b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:34.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.033+0000 7f281effd640 1 -- 172.21.15.7:0/456313059 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28200b1310 con 0x7f282015dc60 2024-04-25T09:54:34.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.033+0000 7f281e7fc640 1 -- 172.21.15.7:0/456313059 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 919651525 0 0) 0x7f28200b5a20 con 0x7f28200afc00 2024-04-25T09:54:34.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.033+0000 7f281f7fe640 1 --2- 172.21.15.7:0/456313059 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f282006ab60 0x7f28200b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:34.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.034+0000 7f281effd640 1 --2- 172.21.15.7:0/456313059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f282015dc60 0x7f282006af40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2810009870 tx=0x7f281002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0fc5de22d007ba6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:34.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.034+0000 7f281e7fc640 1 -- 172.21.15.7:0/456313059 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2810037070 con 0x7f282015dc60 2024-04-25T09:54:34.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.034+0000 7f281e7fc640 1 -- 172.21.15.7:0/456313059 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2810032440 con 0x7f282015dc60 2024-04-25T09:54:34.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.034+0000 7f281e7fc640 1 -- 172.21.15.7:0/456313059 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2810032810 con 0x7f282015dc60 2024-04-25T09:54:34.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.034+0000 7f2826170640 1 -- 172.21.15.7:0/456313059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f282015dc60 msgr2=0x7f282006af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:34.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.034+0000 7f2826170640 1 --2- 172.21.15.7:0/456313059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f282015dc60 0x7f282006af40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2810009870 tx=0x7f281002a130 comp rx=0 tx=0).stop 2024-04-25T09:54:34.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.034+0000 7f2826170640 1 -- 172.21.15.7:0/456313059 shutdown_connections 2024-04-25T09:54:34.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.034+0000 7f2826170640 1 --2- 172.21.15.7:0/456313059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f282015dc60 0x7f282006af40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:34.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.034+0000 7f2826170640 1 --2- 172.21.15.7:0/456313059 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f282006ab60 0x7f28200b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:34.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.034+0000 7f2826170640 1 -- 172.21.15.7:0/456313059 >> 172.21.15.7:0/456313059 conn(0x7f28200b5c30 msgr2=0x7f28200999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:34.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.034+0000 7f2826170640 1 -- 172.21.15.7:0/456313059 shutdown_connections 2024-04-25T09:54:34.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.034+0000 7f2826170640 1 -- 172.21.15.7:0/456313059 wait complete. 2024-04-25T09:54:34.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.036+0000 7f2826170640 1 Processor -- start 2024-04-25T09:54:34.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.036+0000 7f2826170640 1 -- start start 2024-04-25T09:54:34.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.036+0000 7f2826170640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f282006ab60 0x7f28201f8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:34.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.036+0000 7f2826170640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28200afc00 0x7f282014c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:34.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.036+0000 7f2826170640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f282015dc60 0x7f282014da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:34.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.036+0000 7f2826170640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28200b5260 con 0x7f282015dc60 2024-04-25T09:54:34.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.036+0000 7f2826170640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28200b0400 con 0x7f282006ab60 2024-04-25T09:54:34.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.036+0000 7f2826170640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28200b53e0 con 0x7f28200afc00 2024-04-25T09:54:34.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.037+0000 7f281ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f282015dc60 0x7f282014da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:34.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.037+0000 7f281ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f282015dc60 0x7f282014da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51640/0 (socket says 172.21.15.7:51640) 2024-04-25T09:54:34.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.037+0000 7f281ffff640 1 -- 172.21.15.7:0/835417740 learned_addr learned my addr 172.21.15.7:0/835417740 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:34.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.037+0000 7f281effd640 1 --2- 172.21.15.7:0/835417740 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28200afc00 0x7f282014c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:34.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.037+0000 7f281f7fe640 1 --2- 172.21.15.7:0/835417740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f282006ab60 0x7f28201f8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:34.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.037+0000 7f281ffff640 1 -- 172.21.15.7:0/835417740 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28200afc00 msgr2=0x7f282014c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:34.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.037+0000 7f281ffff640 1 --2- 172.21.15.7:0/835417740 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28200afc00 0x7f282014c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:34.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.037+0000 7f281ffff640 1 -- 172.21.15.7:0/835417740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f282006ab60 msgr2=0x7f28201f8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:34.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.037+0000 7f281ffff640 1 --2- 172.21.15.7:0/835417740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f282006ab60 0x7f28201f8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:34.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.037+0000 7f281ffff640 1 -- 172.21.15.7:0/835417740 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282014c6f0 con 0x7f282015dc60 2024-04-25T09:54:34.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.037+0000 7f281f7fe640 1 --2- 172.21.15.7:0/835417740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f282006ab60 0x7f28201f8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:34.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.037+0000 7f281ffff640 1 --2- 172.21.15.7:0/835417740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f282015dc60 0x7f282014da30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f281800c7d0 tx=0x7f281800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:34.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.037+0000 7f2807fff640 1 -- 172.21.15.7:0/835417740 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2818018070 con 0x7f282015dc60 2024-04-25T09:54:34.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.037+0000 7f2807fff640 1 -- 172.21.15.7:0/835417740 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281800a640 con 0x7f282015dc60 2024-04-25T09:54:34.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.037+0000 7f2826170640 1 -- 172.21.15.7:0/835417740 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f282014df70 con 0x7f282015dc60 2024-04-25T09:54:34.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.037+0000 7f2807fff640 1 -- 172.21.15.7:0/835417740 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281800aa70 con 0x7f282015dc60 2024-04-25T09:54:34.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.037+0000 7f2826170640 1 -- 172.21.15.7:0/835417740 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f282014e4f0 con 0x7f282015dc60 2024-04-25T09:54:34.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.038+0000 7f2826170640 1 -- 172.21.15.7:0/835417740 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2820068fd0 con 0x7f282015dc60 2024-04-25T09:54:34.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.039+0000 7f2807fff640 1 -- 172.21.15.7:0/835417740 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f281801b070 con 0x7f282015dc60 2024-04-25T09:54:34.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.039+0000 7f2807fff640 1 --2- 172.21.15.7:0/835417740 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f280c06b4d0 0x7f280c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:34.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.039+0000 7f2807fff640 1 -- 172.21.15.7:0/835417740 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2818089ad0 con 0x7f282015dc60 2024-04-25T09:54:34.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.039+0000 7f281f7fe640 1 --2- 172.21.15.7:0/835417740 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f280c06b4d0 0x7f280c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:34.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.039+0000 7f281f7fe640 1 --2- 172.21.15.7:0/835417740 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f280c06b4d0 0x7f280c06d990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2814006fd0 tx=0x7f2814008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:34.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.043+0000 7f2807fff640 1 -- 172.21.15.7:0/835417740 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f282014c6f0 con 0x7f282015dc60 2024-04-25T09:54:34.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.223+0000 7f2826170640 1 -- 172.21.15.7:0/835417740 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2820070a20 con 0x7f282015dc60 2024-04-25T09:54:34.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.224+0000 7f2807fff640 1 -- 172.21.15.7:0/835417740 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18418 (secure 0 0 0) 0x7f28180586a0 con 0x7f282015dc60 2024-04-25T09:54:34.227 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:34.227 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:54:32.606761+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:54:26.011833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:54:26.535536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:54:30.264996+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:54:34.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.227+0000 7f2826170640 1 -- 172.21.15.7:0/835417740 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f280c06b4d0 msgr2=0x7f280c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:34.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.227+0000 7f2826170640 1 --2- 172.21.15.7:0/835417740 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f280c06b4d0 0x7f280c06d990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2814006fd0 tx=0x7f2814008040 comp rx=0 tx=0).stop 2024-04-25T09:54:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.227+0000 7f2826170640 1 -- 172.21.15.7:0/835417740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f282015dc60 msgr2=0x7f282014da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.227+0000 7f2826170640 1 --2- 172.21.15.7:0/835417740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f282015dc60 0x7f282014da30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f281800c7d0 tx=0x7f281800cc90 comp rx=0 tx=0).stop 2024-04-25T09:54:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.227+0000 7f2826170640 1 -- 172.21.15.7:0/835417740 shutdown_connections 2024-04-25T09:54:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.227+0000 7f2826170640 1 --2- 172.21.15.7:0/835417740 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f280c06b4d0 0x7f280c06d990 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.227+0000 7f2826170640 1 --2- 172.21.15.7:0/835417740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f282015dc60 0x7f282014da30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.227+0000 7f2826170640 1 --2- 172.21.15.7:0/835417740 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28200afc00 0x7f282014c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.227+0000 7f2826170640 1 --2- 172.21.15.7:0/835417740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f282006ab60 0x7f28201f8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.227+0000 7f2826170640 1 -- 172.21.15.7:0/835417740 >> 172.21.15.7:0/835417740 conn(0x7f28200b5c30 msgr2=0x7f282015b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.227+0000 7f2826170640 1 -- 172.21.15.7:0/835417740 shutdown_connections 2024-04-25T09:54:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.227+0000 7f2826170640 1 -- 172.21.15.7:0/835417740 wait complete. 2024-04-25T09:54:34.257 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:54:34.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.354+0000 7f621537e640 1 Processor -- start 2024-04-25T09:54:34.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.355+0000 7f621537e640 1 -- start start 2024-04-25T09:54:34.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.355+0000 7f621537e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f62100d0a50 0x7f62100d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:34.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.355+0000 7f621537e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f62100b53b0 0x7f62100d2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:34.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.355+0000 7f621537e640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62100d1e80 con 0x7f621015db00 2024-04-25T09:54:34.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.355+0000 7f621537e640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62100b5930 con 0x7f62100b53b0 2024-04-25T09:54:34.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.355+0000 7f621537e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62100b5c10 con 0x7f62100d0a50 2024-04-25T09:54:34.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.355+0000 7f620f7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f62100b53b0 0x7f62100d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:34.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.355+0000 7f620effd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f621015db00 0x7f62100d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54806/0 (socket says 172.21.15.7:54806) 2024-04-25T09:54:34.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.355+0000 7f620f7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f62100b53b0 0x7f62100d2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51656/0 (socket says 172.21.15.7:51656) 2024-04-25T09:54:34.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.355+0000 7f620effd640 1 -- 172.21.15.7:0/3000656760 learned_addr learned my addr 172.21.15.7:0/3000656760 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:34.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.356+0000 7f620e7fc640 1 --2- 172.21.15.7:0/3000656760 >> v2:172.21.15.55:3300/0 conn(0x7f62100d0a50 0x7f62100d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:34.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.356+0000 7f620f7fe640 1 -- 172.21.15.7:0/3000656760 >> v2:172.21.15.55:3300/0 conn(0x7f62100d0a50 msgr2=0x7f62100d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:34.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.356+0000 7f620f7fe640 1 --2- 172.21.15.7:0/3000656760 >> v2:172.21.15.55:3300/0 conn(0x7f62100d0a50 0x7f62100d2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:34.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.356+0000 7f620f7fe640 1 -- 172.21.15.7:0/3000656760 >> v1:172.21.15.7:6789/0 conn(0x7f621015db00 legacy=0x7f62100d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:34.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.356+0000 7f620f7fe640 1 -- 172.21.15.7:0/3000656760 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62100b5ef0 con 0x7f62100b53b0 2024-04-25T09:54:34.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.356+0000 7f620e7fc640 1 --2- 172.21.15.7:0/3000656760 >> v2:172.21.15.55:3300/0 conn(0x7f62100d0a50 0x7f62100d2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:34.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.356+0000 7f620f7fe640 1 --2- 172.21.15.7:0/3000656760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62100b53b0 0x7f62100d2870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f62100d4a00 tx=0x7f620002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e95c7657c61440 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:34.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.357+0000 7f620dffb640 1 -- 172.21.15.7:0/3000656760 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6200007740 con 0x7f62100b53b0 2024-04-25T09:54:34.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.357+0000 7f620dffb640 1 -- 172.21.15.7:0/3000656760 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62000078e0 con 0x7f62100b53b0 2024-04-25T09:54:34.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.357+0000 7f620dffb640 1 -- 172.21.15.7:0/3000656760 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6200007cb0 con 0x7f62100b53b0 2024-04-25T09:54:34.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.357+0000 7f621537e640 1 -- 172.21.15.7:0/3000656760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62100b53b0 msgr2=0x7f62100d2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:34.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.357+0000 7f621537e640 1 --2- 172.21.15.7:0/3000656760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62100b53b0 0x7f62100d2870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f62100d4a00 tx=0x7f620002a680 comp rx=0 tx=0).stop 2024-04-25T09:54:34.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.357+0000 7f621537e640 1 -- 172.21.15.7:0/3000656760 shutdown_connections 2024-04-25T09:54:34.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.357+0000 7f621537e640 1 --2- 172.21.15.7:0/3000656760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62100b53b0 0x7f62100d2870 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:34.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.357+0000 7f621537e640 1 --2- 172.21.15.7:0/3000656760 >> v2:172.21.15.55:3300/0 conn(0x7f62100d0a50 0x7f62100d2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:34.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.357+0000 7f621537e640 1 -- 172.21.15.7:0/3000656760 >> 172.21.15.7:0/3000656760 conn(0x7f6210072290 msgr2=0x7f62100726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:34.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.357+0000 7f621537e640 1 -- 172.21.15.7:0/3000656760 shutdown_connections 2024-04-25T09:54:34.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.357+0000 7f621537e640 1 -- 172.21.15.7:0/3000656760 wait complete. 2024-04-25T09:54:34.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.358+0000 7f621537e640 1 Processor -- start 2024-04-25T09:54:34.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.358+0000 7f621537e640 1 -- start start 2024-04-25T09:54:34.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.359+0000 7f621537e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f62100b53b0 0x7f62100c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:34.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.359+0000 7f621537e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62100d0a50 0x7f62100c9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:34.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.359+0000 7f621537e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f621015db00 0x7f62100c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:34.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.359+0000 7f621537e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62100d3660 con 0x7f621015db00 2024-04-25T09:54:34.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.359+0000 7f621537e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62100b61d0 con 0x7f62100d0a50 2024-04-25T09:54:34.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.359+0000 7f621537e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62100ce2b0 con 0x7f62100b53b0 2024-04-25T09:54:34.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.359+0000 7f620f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f621015db00 0x7f62100c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:34.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.359+0000 7f620f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f621015db00 0x7f62100c9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51670/0 (socket says 172.21.15.7:51670) 2024-04-25T09:54:34.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.359+0000 7f620f7fe640 1 -- 172.21.15.7:0/3273773442 learned_addr learned my addr 172.21.15.7:0/3273773442 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:34.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.359+0000 7f620effd640 1 --2- 172.21.15.7:0/3273773442 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f62100b53b0 0x7f62100c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:34.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.359+0000 7f620e7fc640 1 --2- 172.21.15.7:0/3273773442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62100d0a50 0x7f62100c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:34.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.360+0000 7f620f7fe640 1 -- 172.21.15.7:0/3273773442 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f62100b53b0 msgr2=0x7f62100c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:34.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.360+0000 7f620f7fe640 1 --2- 172.21.15.7:0/3273773442 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f62100b53b0 0x7f62100c91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:34.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.360+0000 7f620f7fe640 1 -- 172.21.15.7:0/3273773442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62100d0a50 msgr2=0x7f62100c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:34.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.360+0000 7f620f7fe640 1 --2- 172.21.15.7:0/3273773442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62100d0a50 0x7f62100c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:34.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.360+0000 7f620f7fe640 1 -- 172.21.15.7:0/3273773442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62100c7e70 con 0x7f621015db00 2024-04-25T09:54:34.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.360+0000 7f620f7fe640 1 --2- 172.21.15.7:0/3273773442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f621015db00 0x7f62100c9c70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f620002ac70 tx=0x7f6200004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:34.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.360+0000 7f62077fe640 1 -- 172.21.15.7:0/3273773442 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6200040070 con 0x7f621015db00 2024-04-25T09:54:34.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.360+0000 7f62077fe640 1 -- 172.21.15.7:0/3273773442 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6200031c90 con 0x7f621015db00 2024-04-25T09:54:34.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.360+0000 7f621537e640 1 -- 172.21.15.7:0/3273773442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62100c8150 con 0x7f621015db00 2024-04-25T09:54:34.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.360+0000 7f62077fe640 1 -- 172.21.15.7:0/3273773442 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6200045680 con 0x7f621015db00 2024-04-25T09:54:34.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.360+0000 7f621537e640 1 -- 172.21.15.7:0/3273773442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62100c8710 con 0x7f621015db00 2024-04-25T09:54:34.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.361+0000 7f621537e640 1 -- 172.21.15.7:0/3273773442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6210068fd0 con 0x7f621015db00 2024-04-25T09:54:34.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.361+0000 7f62077fe640 1 -- 172.21.15.7:0/3273773442 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6200039040 con 0x7f621015db00 2024-04-25T09:54:34.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.362+0000 7f62077fe640 1 --2- 172.21.15.7:0/3273773442 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f61f006b4d0 0x7f61f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:34.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.362+0000 7f62077fe640 1 -- 172.21.15.7:0/3273773442 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f62000abf80 con 0x7f621015db00 2024-04-25T09:54:34.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.362+0000 7f620effd640 1 --2- 172.21.15.7:0/3273773442 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f61f006b4d0 0x7f61f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:34.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.362+0000 7f620effd640 1 --2- 172.21.15.7:0/3273773442 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f61f006b4d0 0x7f61f006d990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6208000f60 tx=0x7f6208009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:34.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.366+0000 7f62077fe640 1 -- 172.21.15.7:0/3273773442 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6200043360 con 0x7f621015db00 2024-04-25T09:54:34.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.582+0000 7f621537e640 1 -- 172.21.15.7:0/3273773442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62100d16b0 con 0x7f621015db00 2024-04-25T09:54:34.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.582+0000 7f62077fe640 1 -- 172.21.15.7:0/3273773442 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4928 (secure 0 0 0) 0x7f620007ab80 con 0x7f621015db00 2024-04-25T09:54:34.585 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:34.585 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1968579214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1968579214},{"type":"v1","addr":"172.21.15.7:6837","nonce":1968579214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3479570567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3479570567},{"type":"v1","addr":"172.21.15.55:6834","nonce":3479570567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/2289657027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2289657027},{"type":"v1","addr":"172.21.15.7:6836","nonce":2289657027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:54:27.558601+0000","modified":"2024-04-25T09:54:32.606974+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/3779228372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3779228372},{"type":"v1","addr":"172.21.15.55:6835","nonce":3779228372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-25T09:54:34.585 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 6 2024-04-25T09:54:34.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.584+0000 7f621537e640 1 -- 172.21.15.7:0/3273773442 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f61f006b4d0 msgr2=0x7f61f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:34.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.584+0000 7f621537e640 1 --2- 172.21.15.7:0/3273773442 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f61f006b4d0 0x7f61f006d990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6208000f60 tx=0x7f6208009040 comp rx=0 tx=0).stop 2024-04-25T09:54:34.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.584+0000 7f621537e640 1 -- 172.21.15.7:0/3273773442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f621015db00 msgr2=0x7f62100c9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:34.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.584+0000 7f621537e640 1 --2- 172.21.15.7:0/3273773442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f621015db00 0x7f62100c9c70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f620002ac70 tx=0x7f6200004a40 comp rx=0 tx=0).stop 2024-04-25T09:54:34.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.584+0000 7f621537e640 1 -- 172.21.15.7:0/3273773442 shutdown_connections 2024-04-25T09:54:34.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.584+0000 7f621537e640 1 --2- 172.21.15.7:0/3273773442 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f61f006b4d0 0x7f61f006d990 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:34.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.584+0000 7f621537e640 1 --2- 172.21.15.7:0/3273773442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f621015db00 0x7f62100c9c70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:34.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.584+0000 7f621537e640 1 --2- 172.21.15.7:0/3273773442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62100d0a50 0x7f62100c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:34.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.584+0000 7f621537e640 1 --2- 172.21.15.7:0/3273773442 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f62100b53b0 0x7f62100c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:34.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.584+0000 7f621537e640 1 -- 172.21.15.7:0/3273773442 >> 172.21.15.7:0/3273773442 conn(0x7f6210072290 msgr2=0x7f6210072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:34.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.584+0000 7f621537e640 1 -- 172.21.15.7:0/3273773442 shutdown_connections 2024-04-25T09:54:34.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.584+0000 7f621537e640 1 -- 172.21.15.7:0/3273773442 wait complete. 2024-04-25T09:54:34.597 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:54:34.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.695+0000 7fe5ca713640 1 Processor -- start 2024-04-25T09:54:34.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.695+0000 7fe5ca713640 1 -- start start 2024-04-25T09:54:34.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.695+0000 7fe5ca713640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe5c415db00 0x7fe5c40d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:34.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.696+0000 7fe5ca713640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe5c40ce2b0 0x7fe5c40d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:34.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.696+0000 7fe5ca713640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c40d1e80 con 0x7fe5c40b53b0 2024-04-25T09:54:34.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.696+0000 7fe5ca713640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c40b5930 con 0x7fe5c415db00 2024-04-25T09:54:34.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.696+0000 7fe5ca713640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c40b5c10 con 0x7fe5c40ce2b0 2024-04-25T09:54:34.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.696+0000 7fe5c3fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe5c415db00 0x7fe5c40d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:34.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.696+0000 7fe5c3fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe5c415db00 0x7fe5c40d0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51682/0 (socket says 172.21.15.7:51682) 2024-04-25T09:54:34.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.696+0000 7fe5c3fff640 1 -- 172.21.15.7:0/2784454973 learned_addr learned my addr 172.21.15.7:0/2784454973 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:34.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.696+0000 7fe5c8cb0640 1 --2- 172.21.15.7:0/2784454973 >> v2:172.21.15.55:3300/0 conn(0x7fe5c40ce2b0 0x7fe5c40d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:34.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.696+0000 7fe5c3fff640 1 -- 172.21.15.7:0/2784454973 >> v2:172.21.15.55:3300/0 conn(0x7fe5c40ce2b0 msgr2=0x7fe5c40d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:34.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.696+0000 7fe5c3fff640 1 --2- 172.21.15.7:0/2784454973 >> v2:172.21.15.55:3300/0 conn(0x7fe5c40ce2b0 0x7fe5c40d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:34.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.696+0000 7fe5c3fff640 1 -- 172.21.15.7:0/2784454973 >> v1:172.21.15.55:6789/0 conn(0x7fe5c40b53b0 legacy=0x7fe5c4161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:34.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.696+0000 7fe5c3fff640 1 -- 172.21.15.7:0/2784454973 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c40b5ef0 con 0x7fe5c415db00 2024-04-25T09:54:34.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.697+0000 7fe5c3fff640 1 --2- 172.21.15.7:0/2784454973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c415db00 0x7fe5c40d0340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe5c40cdf10 tx=0x7fe5ac02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c85bddeced3b706 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:34.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.697+0000 7fe5c2ffd640 1 -- 172.21.15.7:0/2784454973 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac037070 con 0x7fe5c415db00 2024-04-25T09:54:34.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.697+0000 7fe5c2ffd640 1 -- 172.21.15.7:0/2784454973 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ac032440 con 0x7fe5c415db00 2024-04-25T09:54:34.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.697+0000 7fe5c2ffd640 1 -- 172.21.15.7:0/2784454973 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac032810 con 0x7fe5c415db00 2024-04-25T09:54:34.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.697+0000 7fe5ca713640 1 -- 172.21.15.7:0/2784454973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c415db00 msgr2=0x7fe5c40d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:34.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.697+0000 7fe5ca713640 1 --2- 172.21.15.7:0/2784454973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c415db00 0x7fe5c40d0340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe5c40cdf10 tx=0x7fe5ac02a230 comp rx=0 tx=0).stop 2024-04-25T09:54:34.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.697+0000 7fe5ca713640 1 -- 172.21.15.7:0/2784454973 shutdown_connections 2024-04-25T09:54:34.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.697+0000 7fe5ca713640 1 --2- 172.21.15.7:0/2784454973 >> v2:172.21.15.55:3300/0 conn(0x7fe5c40ce2b0 0x7fe5c40d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:34.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.697+0000 7fe5ca713640 1 --2- 172.21.15.7:0/2784454973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c415db00 0x7fe5c40d0340 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:34.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.697+0000 7fe5ca713640 1 -- 172.21.15.7:0/2784454973 >> 172.21.15.7:0/2784454973 conn(0x7fe5c4072290 msgr2=0x7fe5c40726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:34.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.698+0000 7fe5ca713640 1 -- 172.21.15.7:0/2784454973 shutdown_connections 2024-04-25T09:54:34.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.698+0000 7fe5ca713640 1 -- 172.21.15.7:0/2784454973 wait complete. 2024-04-25T09:54:34.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.699+0000 7fe5ca713640 1 Processor -- start 2024-04-25T09:54:34.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.699+0000 7fe5ca713640 1 -- start start 2024-04-25T09:54:34.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.700+0000 7fe5ca713640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5c40b53b0 0x7fe5c40cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:34.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.700+0000 7fe5ca713640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe5c40ce2b0 0x7fe5c415cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:34.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.700+0000 7fe5ca713640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c415db00 0x7fe5c41e62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:34.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.700+0000 7fe5ca713640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c40d3660 con 0x7fe5c415db00 2024-04-25T09:54:34.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.700+0000 7fe5ca713640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c40b61d0 con 0x7fe5c40b53b0 2024-04-25T09:54:34.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.700+0000 7fe5ca713640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c40b6c10 con 0x7fe5c40ce2b0 2024-04-25T09:54:34.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.700+0000 7fe5c8cb0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c415db00 0x7fe5c41e62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:34.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.700+0000 7fe5c8cb0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c415db00 0x7fe5c41e62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51684/0 (socket says 172.21.15.7:51684) 2024-04-25T09:54:34.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.700+0000 7fe5c8cb0640 1 -- 172.21.15.7:0/1454163654 learned_addr learned my addr 172.21.15.7:0/1454163654 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:34.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.700+0000 7fe5c3fff640 1 --2- 172.21.15.7:0/1454163654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5c40b53b0 0x7fe5c40cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:34.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.700+0000 7fe5c37fe640 1 --2- 172.21.15.7:0/1454163654 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe5c40ce2b0 0x7fe5c415cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:34.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.700+0000 7fe5c8cb0640 1 -- 172.21.15.7:0/1454163654 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe5c40ce2b0 msgr2=0x7fe5c415cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:34.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.700+0000 7fe5c8cb0640 1 --2- 172.21.15.7:0/1454163654 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe5c40ce2b0 0x7fe5c415cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:34.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.700+0000 7fe5c8cb0640 1 -- 172.21.15.7:0/1454163654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5c40b53b0 msgr2=0x7fe5c40cb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:34.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.700+0000 7fe5c8cb0640 1 --2- 172.21.15.7:0/1454163654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5c40b53b0 0x7fe5c40cb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:34.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.700+0000 7fe5c8cb0640 1 -- 172.21.15.7:0/1454163654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c4160110 con 0x7fe5c415db00 2024-04-25T09:54:34.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.700+0000 7fe5c8cb0640 1 --2- 172.21.15.7:0/1454163654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c415db00 0x7fe5c41e62e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc007e70 tx=0x7fe5bc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:34.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.700+0000 7fe5c0ff9640 1 -- 172.21.15.7:0/1454163654 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc014620 con 0x7fe5c415db00 2024-04-25T09:54:34.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.700+0000 7fe5c0ff9640 1 -- 172.21.15.7:0/1454163654 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5bc019070 con 0x7fe5c415db00 2024-04-25T09:54:34.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.700+0000 7fe5ca713640 1 -- 172.21.15.7:0/1454163654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c41603f0 con 0x7fe5c415db00 2024-04-25T09:54:34.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.700+0000 7fe5c0ff9640 1 -- 172.21.15.7:0/1454163654 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc014a20 con 0x7fe5c415db00 2024-04-25T09:54:34.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.701+0000 7fe5ca713640 1 -- 172.21.15.7:0/1454163654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c41609b0 con 0x7fe5c415db00 2024-04-25T09:54:34.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.701+0000 7fe5ca713640 1 -- 172.21.15.7:0/1454163654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c4068fd0 con 0x7fe5c415db00 2024-04-25T09:54:34.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.702+0000 7fe5c0ff9640 1 -- 172.21.15.7:0/1454163654 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe5bc014bc0 con 0x7fe5c415db00 2024-04-25T09:54:34.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.702+0000 7fe5c0ff9640 1 --2- 172.21.15.7:0/1454163654 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe5a406b4d0 0x7fe5a406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:34.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.702+0000 7fe5c0ff9640 1 -- 172.21.15.7:0/1454163654 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe5bc08aca0 con 0x7fe5c415db00 2024-04-25T09:54:34.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.702+0000 7fe5c3fff640 1 --2- 172.21.15.7:0/1454163654 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe5a406b4d0 0x7fe5a406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:34.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.703+0000 7fe5c3fff640 1 --2- 172.21.15.7:0/1454163654 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe5a406b4d0 0x7fe5a406d990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac034000 tx=0x7fe5ac02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:34.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.707+0000 7fe5c0ff9640 1 -- 172.21.15.7:0/1454163654 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe5bc059180 con 0x7fe5c415db00 2024-04-25T09:54:34.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.888+0000 7fe5ca713640 1 -- 172.21.15.7:0/1454163654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5c40cb8f0 con 0x7fe5c415db00 2024-04-25T09:54:34.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.889+0000 7fe5c0ff9640 1 -- 172.21.15.7:0/1454163654 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18418 (secure 0 0 0) 0x7fe5bc05d220 con 0x7fe5c415db00 2024-04-25T09:54:34.892 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:34.892 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:54:32.606761+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:54:26.011833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:54:26.535536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:54:30.264996+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:54:34.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.892+0000 7fe5ca713640 1 -- 172.21.15.7:0/1454163654 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe5a406b4d0 msgr2=0x7fe5a406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:34.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.892+0000 7fe5ca713640 1 --2- 172.21.15.7:0/1454163654 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe5a406b4d0 0x7fe5a406d990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac034000 tx=0x7fe5ac02e000 comp rx=0 tx=0).stop 2024-04-25T09:54:34.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.892+0000 7fe5ca713640 1 -- 172.21.15.7:0/1454163654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c415db00 msgr2=0x7fe5c41e62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:34.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.892+0000 7fe5ca713640 1 --2- 172.21.15.7:0/1454163654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c415db00 0x7fe5c41e62e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc007e70 tx=0x7fe5bc00e4b0 comp rx=0 tx=0).stop 2024-04-25T09:54:34.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.892+0000 7fe5ca713640 1 -- 172.21.15.7:0/1454163654 shutdown_connections 2024-04-25T09:54:34.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.892+0000 7fe5ca713640 1 --2- 172.21.15.7:0/1454163654 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe5a406b4d0 0x7fe5a406d990 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:34.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.892+0000 7fe5ca713640 1 --2- 172.21.15.7:0/1454163654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5c415db00 0x7fe5c41e62e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:34.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.892+0000 7fe5ca713640 1 --2- 172.21.15.7:0/1454163654 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe5c40ce2b0 0x7fe5c415cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:34.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.892+0000 7fe5ca713640 1 --2- 172.21.15.7:0/1454163654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5c40b53b0 0x7fe5c40cb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:34.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.892+0000 7fe5ca713640 1 -- 172.21.15.7:0/1454163654 >> 172.21.15.7:0/1454163654 conn(0x7fe5c4072290 msgr2=0x7fe5c40b6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:34.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.892+0000 7fe5ca713640 1 -- 172.21.15.7:0/1454163654 shutdown_connections 2024-04-25T09:54:34.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:34.892+0000 7fe5ca713640 1 -- 172.21.15.7:0/1454163654 wait complete. 2024-04-25T09:54:35.308 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:54:27.558601+0000', 'modified': '2024-04-25T09:54:32.606974+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4293}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4293': {'gid': 4293, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6835/3779228372', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6833', 'nonce': 3779228372}, {'type': 'v1', 'addr': '172.21.15.55:6835', 'nonce': 3779228372}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-04-25T09:54:35.308 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:54:35.308 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T09:54:35.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.411+0000 7f2ce16fc640 1 Processor -- start 2024-04-25T09:54:35.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.411+0000 7f2ce16fc640 1 -- start start 2024-04-25T09:54:35.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.412+0000 7f2ce16fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2cdc15dc30 0x7f2cdc070c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:35.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.412+0000 7f2ce16fc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2cdc0b4f60 0x7f2cdc06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:35.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.412+0000 7f2ce16fc640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cdc0b55a0 con 0x7f2cdc0711b0 2024-04-25T09:54:35.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.412+0000 7f2ce16fc640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cdc071610 con 0x7f2cdc15dc30 2024-04-25T09:54:35.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.412+0000 7f2ce16fc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc06bc70 con 0x7f2cdc0b4f60 2024-04-25T09:54:35.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.412+0000 7f2cda7fc640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2cdc0711b0 0x7f2cdc0b4850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54822/0 (socket says 172.21.15.7:54822) 2024-04-25T09:54:35.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.412+0000 7f2cda7fc640 1 -- 172.21.15.7:0/2504255790 learned_addr learned my addr 172.21.15.7:0/2504255790 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:35.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.413+0000 7f2cd9ffb640 1 -- 172.21.15.7:0/2504255790 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2823649186 0 0) 0x7f2cdc0b55a0 con 0x7f2cdc0711b0 2024-04-25T09:54:35.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.413+0000 7f2cdaffd640 1 --2- 172.21.15.7:0/2504255790 >> v2:172.21.15.55:3300/0 conn(0x7f2cdc15dc30 0x7f2cdc070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:35.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.413+0000 7f2cd9ffb640 1 -- 172.21.15.7:0/2504255790 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cc8003520 con 0x7f2cdc0711b0 2024-04-25T09:54:35.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.413+0000 7f2cdb7fe640 1 --2- 172.21.15.7:0/2504255790 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2cdc0b4f60 0x7f2cdc06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:35.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.413+0000 7f2cd9ffb640 1 -- 172.21.15.7:0/2504255790 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4170827590 0 0) 0x7f2cc8003520 con 0x7f2cdc0711b0 2024-04-25T09:54:35.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.413+0000 7f2cd9ffb640 1 -- 172.21.15.7:0/2504255790 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2cdc0b4f60 msgr2=0x7f2cdc06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:35.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.413+0000 7f2cd9ffb640 1 --2- 172.21.15.7:0/2504255790 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2cdc0b4f60 0x7f2cdc06c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.413+0000 7f2cd9ffb640 1 -- 172.21.15.7:0/2504255790 >> v2:172.21.15.55:3300/0 conn(0x7f2cdc15dc30 msgr2=0x7f2cdc070c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:35.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.413+0000 7f2cd9ffb640 1 --2- 172.21.15.7:0/2504255790 >> v2:172.21.15.55:3300/0 conn(0x7f2cdc15dc30 0x7f2cdc070c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.413+0000 7f2cd9ffb640 1 -- 172.21.15.7:0/2504255790 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cdc0b5880 con 0x7f2cdc0711b0 2024-04-25T09:54:35.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.413+0000 7f2cd9ffb640 1 -- 172.21.15.7:0/2504255790 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f2cc4001670 con 0x7f2cdc0711b0 2024-04-25T09:54:35.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.413+0000 7f2cd9ffb640 1 -- 172.21.15.7:0/2504255790 >> v1:172.21.15.7:6789/0 conn(0x7f2cdc0711b0 legacy=0x7f2cdc0b4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:35.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.413+0000 7f2cd9ffb640 1 --2- 172.21.15.7:0/2504255790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cc80039b0 0x7f2cc8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:35.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.413+0000 7f2cd9ffb640 1 --2- 172.21.15.7:0/2504255790 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2cdc0b4f60 0x7f2cc8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:35.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.413+0000 7f2cd9ffb640 1 --2- 172.21.15.7:0/2504255790 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cc8004d40 0x7f2cc80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:35.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.413+0000 7f2cd9ffb640 1 -- 172.21.15.7:0/2504255790 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc06bc70 con 0x7f2cc80039b0 2024-04-25T09:54:35.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.413+0000 7f2cd9ffb640 1 -- 172.21.15.7:0/2504255790 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc800b9c0 con 0x7f2cc8004d40 2024-04-25T09:54:35.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.413+0000 7f2cd9ffb640 1 -- 172.21.15.7:0/2504255790 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc800bb70 con 0x7f2cdc0b4f60 2024-04-25T09:54:35.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.413+0000 7f2cdaffd640 1 --2- 172.21.15.7:0/2504255790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cc80039b0 0x7f2cc8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:35.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.413+0000 7f2cda7fc640 1 --2- 172.21.15.7:0/2504255790 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2cdc0b4f60 0x7f2cc8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:35.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.413+0000 7f2cdb7fe640 1 --2- 172.21.15.7:0/2504255790 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cc8004d40 0x7f2cc80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:35.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.413+0000 7f2cdaffd640 1 -- 172.21.15.7:0/2504255790 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2cdc0b4f60 msgr2=0x7f2cc8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:35.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.413+0000 7f2cdaffd640 1 --2- 172.21.15.7:0/2504255790 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2cdc0b4f60 0x7f2cc8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.413+0000 7f2cdaffd640 1 -- 172.21.15.7:0/2504255790 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cc8004d40 msgr2=0x7f2cc80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:35.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.413+0000 7f2cdaffd640 1 --2- 172.21.15.7:0/2504255790 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cc8004d40 0x7f2cc80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.413+0000 7f2cdaffd640 1 -- 172.21.15.7:0/2504255790 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc8003520 con 0x7f2cc80039b0 2024-04-25T09:54:35.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.413+0000 7f2cdb7fe640 1 --2- 172.21.15.7:0/2504255790 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cc8004d40 0x7f2cc80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:35.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.414+0000 7f2cdaffd640 1 --2- 172.21.15.7:0/2504255790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cc80039b0 0x7f2cc8003dd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc009fc0 tx=0x7f2cc8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af18b54141e76895 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:35.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.414+0000 7f2cd9ffb640 1 -- 172.21.15.7:0/2504255790 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc009c10 con 0x7f2cc80039b0 2024-04-25T09:54:35.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.414+0000 7f2cd9ffb640 1 -- 172.21.15.7:0/2504255790 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ccc036070 con 0x7f2cc80039b0 2024-04-25T09:54:35.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.414+0000 7f2cd9ffb640 1 -- 172.21.15.7:0/2504255790 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc02d070 con 0x7f2cc80039b0 2024-04-25T09:54:35.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.415+0000 7f2ce16fc640 1 -- 172.21.15.7:0/2504255790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cc80039b0 msgr2=0x7f2cc8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:35.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.415+0000 7f2ce16fc640 1 --2- 172.21.15.7:0/2504255790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cc80039b0 0x7f2cc8003dd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc009fc0 tx=0x7f2cc8005830 comp rx=0 tx=0).stop 2024-04-25T09:54:35.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.415+0000 7f2cdb7fe640 1 -- 172.21.15.7:0/2504255790 reap_dead start 2024-04-25T09:54:35.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.415+0000 7f2ce16fc640 1 -- 172.21.15.7:0/2504255790 shutdown_connections 2024-04-25T09:54:35.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.415+0000 7f2ce16fc640 1 -- 172.21.15.7:0/2504255790 >> 172.21.15.7:0/2504255790 conn(0x7f2cdc0b3390 msgr2=0x7f2cdc0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:35.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.415+0000 7f2ce16fc640 1 -- 172.21.15.7:0/2504255790 shutdown_connections 2024-04-25T09:54:35.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.415+0000 7f2ce16fc640 1 -- 172.21.15.7:0/2504255790 wait complete. 2024-04-25T09:54:35.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.416+0000 7f2ce16fc640 1 Processor -- start 2024-04-25T09:54:35.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.416+0000 7f2ce16fc640 1 -- start start 2024-04-25T09:54:35.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.417+0000 7f2ce16fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cc80039b0 0x7f2cdc1f7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:35.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.417+0000 7f2ce16fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cdc156570 0x7f2cdc157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:35.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.417+0000 7f2ce16fc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2cdc1531b0 0x7f2cdc159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:35.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.417+0000 7f2ce16fc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc06c840 con 0x7f2cc80039b0 2024-04-25T09:54:35.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.417+0000 7f2ce16fc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc06c6c0 con 0x7f2cdc156570 2024-04-25T09:54:35.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.417+0000 7f2ce16fc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc06c9c0 con 0x7f2cdc1531b0 2024-04-25T09:54:35.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.417+0000 7f2cdaffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cc80039b0 0x7f2cdc1f7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:35.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.417+0000 7f2cdaffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cc80039b0 0x7f2cdc1f7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51698/0 (socket says 172.21.15.7:51698) 2024-04-25T09:54:35.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.417+0000 7f2cdaffd640 1 -- 172.21.15.7:0/3185261473 learned_addr learned my addr 172.21.15.7:0/3185261473 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:35.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.417+0000 7f2cda7fc640 1 --2- 172.21.15.7:0/3185261473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cdc156570 0x7f2cdc157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:35.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.417+0000 7f2cdb7fe640 1 --2- 172.21.15.7:0/3185261473 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2cdc1531b0 0x7f2cdc159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:35.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.417+0000 7f2cdaffd640 1 -- 172.21.15.7:0/3185261473 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2cdc1531b0 msgr2=0x7f2cdc159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:35.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.417+0000 7f2cdaffd640 1 --2- 172.21.15.7:0/3185261473 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2cdc1531b0 0x7f2cdc159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.417+0000 7f2cdaffd640 1 -- 172.21.15.7:0/3185261473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cdc156570 msgr2=0x7f2cdc157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:35.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.417+0000 7f2cdaffd640 1 --2- 172.21.15.7:0/3185261473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cdc156570 0x7f2cdc157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.417+0000 7f2cdaffd640 1 -- 172.21.15.7:0/3185261473 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cdc156b10 con 0x7f2cc80039b0 2024-04-25T09:54:35.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.417+0000 7f2cda7fc640 1 --2- 172.21.15.7:0/3185261473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cdc156570 0x7f2cdc157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:35.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.417+0000 7f2cdaffd640 1 --2- 172.21.15.7:0/3185261473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cc80039b0 0x7f2cdc1f7eb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc02af10 tx=0x7f2ccc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:35.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.418+0000 7f2cd37fe640 1 -- 172.21.15.7:0/3185261473 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc009c10 con 0x7f2cc80039b0 2024-04-25T09:54:35.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.418+0000 7f2cd37fe640 1 -- 172.21.15.7:0/3185261473 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ccc003b90 con 0x7f2cc80039b0 2024-04-25T09:54:35.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.418+0000 7f2ce16fc640 1 -- 172.21.15.7:0/3185261473 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cdc153c70 con 0x7f2cc80039b0 2024-04-25T09:54:35.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.418+0000 7f2cd37fe640 1 -- 172.21.15.7:0/3185261473 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc004030 con 0x7f2cc80039b0 2024-04-25T09:54:35.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.418+0000 7f2ce16fc640 1 -- 172.21.15.7:0/3185261473 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cdc154230 con 0x7f2cc80039b0 2024-04-25T09:54:35.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.419+0000 7f2cd37fe640 1 -- 172.21.15.7:0/3185261473 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2ccc005d10 con 0x7f2cc80039b0 2024-04-25T09:54:35.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.420+0000 7f2cd37fe640 1 --2- 172.21.15.7:0/3185261473 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2cbc06b4d0 0x7f2cbc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:35.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.420+0000 7f2cda7fc640 1 --2- 172.21.15.7:0/3185261473 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2cbc06b4d0 0x7f2cbc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:35.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.420+0000 7f2cd37fe640 1 -- 172.21.15.7:0/3185261473 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2ccc0aba00 con 0x7f2cc80039b0 2024-04-25T09:54:35.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.420+0000 7f2cda7fc640 1 --2- 172.21.15.7:0/3185261473 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2cbc06b4d0 0x7f2cbc06d990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4000fb0 tx=0x7f2cc4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:35.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.421+0000 7f2ce4402740 1 Processor -- start 2024-04-25T09:54:35.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.421+0000 7f2ce4402740 1 -- start start 2024-04-25T09:54:35.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.422+0000 7f2ce4402740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fbcb0bf230 0x55fbcb0bf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:35.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.422+0000 7f2ce4402740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbcb0dcad0 0x55fbcb0dd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:35.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.422+0000 7f2ce4402740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbcb094f10 0x55fbcb0db190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:35.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.422+0000 7f2ce4402740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbcaff7a10 con 0x55fbcb0dcad0 2024-04-25T09:54:35.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.422+0000 7f2ce4402740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbcafa0b30 con 0x55fbcb094f10 2024-04-25T09:54:35.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.422+0000 7f2ce4402740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fbcaff3c50 con 0x55fbcb0bf230 2024-04-25T09:54:35.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.422+0000 7f2cda7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbcb0dcad0 0x55fbcb0dd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:35.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.422+0000 7f2cda7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbcb0dcad0 0x55fbcb0dd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51710/0 (socket says 172.21.15.7:51710) 2024-04-25T09:54:35.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.422+0000 7f2cda7fc640 1 -- 172.21.15.7:0/2756229065 learned_addr learned my addr 172.21.15.7:0/2756229065 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:35.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.422+0000 7f2cda7fc640 1 -- 172.21.15.7:0/2756229065 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fbcb0bf230 msgr2=0x55fbcb0bf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:35.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.422+0000 7f2cda7fc640 1 --2- 172.21.15.7:0/2756229065 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fbcb0bf230 0x55fbcb0bf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.422+0000 7f2cda7fc640 1 -- 172.21.15.7:0/2756229065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbcb094f10 msgr2=0x55fbcb0db190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:35.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.422+0000 7f2cda7fc640 1 --2- 172.21.15.7:0/2756229065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbcb094f10 0x55fbcb0db190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.422+0000 7f2cda7fc640 1 -- 172.21.15.7:0/2756229065 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbcafb5e10 con 0x55fbcb0dcad0 2024-04-25T09:54:35.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.422+0000 7f2cda7fc640 1 --2- 172.21.15.7:0/2756229065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbcb0dcad0 0x55fbcb0dd020 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4007fa0 tx=0x7f2cc4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7b72ca4f6ceb40b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:35.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.422+0000 7f2cd0ff9640 1 -- 172.21.15.7:0/2756229065 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc4021450 con 0x55fbcb0dcad0 2024-04-25T09:54:35.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.422+0000 7f2cd0ff9640 1 -- 172.21.15.7:0/2756229065 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc4026070 con 0x55fbcb0dcad0 2024-04-25T09:54:35.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.422+0000 7f2cd0ff9640 1 -- 172.21.15.7:0/2756229065 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc40217f0 con 0x55fbcb0dcad0 2024-04-25T09:54:35.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.423+0000 7f2ce4402740 1 -- 172.21.15.7:0/2756229065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbcb0dcad0 msgr2=0x55fbcb0dd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:35.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.423+0000 7f2ce4402740 1 --2- 172.21.15.7:0/2756229065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbcb0dcad0 0x55fbcb0dd020 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4007fa0 tx=0x7f2cc4014000 comp rx=0 tx=0).stop 2024-04-25T09:54:35.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.423+0000 7f2ce4402740 1 -- 172.21.15.7:0/2756229065 shutdown_connections 2024-04-25T09:54:35.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.423+0000 7f2ce4402740 1 --2- 172.21.15.7:0/2756229065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbcb094f10 0x55fbcb0db190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.423+0000 7f2ce4402740 1 --2- 172.21.15.7:0/2756229065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbcb0dcad0 0x55fbcb0dd020 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.423+0000 7f2ce4402740 1 --2- 172.21.15.7:0/2756229065 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fbcb0bf230 0x55fbcb0bf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.423+0000 7f2ce4402740 1 -- 172.21.15.7:0/2756229065 >> 172.21.15.7:0/2756229065 conn(0x55fbcb091840 msgr2=0x55fbcb0da040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:35.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.423+0000 7f2ce4402740 1 -- 172.21.15.7:0/2756229065 shutdown_connections 2024-04-25T09:54:35.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.423+0000 7f2ce4402740 1 -- 172.21.15.7:0/2756229065 wait complete. 2024-04-25T09:54:35.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.424+0000 7f2ce4402740 1 -- start start 2024-04-25T09:54:35.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.424+0000 7f2ce4402740 1 Processor -- start 2024-04-25T09:54:35.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.425+0000 7f2ce4402740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fbcb0bf230 0x55fbcb0d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:35.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.425+0000 7f2ce4402740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbcb0dcad0 0x55fbcb0d3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:35.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.425+0000 7f2ce4402740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbcb0d3170 0x55fbcb0d3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:35.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.425+0000 7f2ce4402740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbcb095cb0 con 0x55fbcb0dcad0 2024-04-25T09:54:35.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.425+0000 7f2ce4402740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbcafb40c0 con 0x55fbcb0d3170 2024-04-25T09:54:35.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.425+0000 7f2ce4402740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fbcb08f770 con 0x55fbcb0bf230 2024-04-25T09:54:35.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.425+0000 7f2ce4402740 10 client.0 _ll_register_callbacks cb 0x55fbcafa7ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:54:35.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.425+0000 7f2cda7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbcb0dcad0 0x55fbcb0d3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:35.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.425+0000 7f2cda7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbcb0dcad0 0x55fbcb0d3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51714/0 (socket says 172.21.15.7:51714) 2024-04-25T09:54:35.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.425+0000 7f2cda7fc640 1 -- 172.21.15.7:0/1316310904 learned_addr learned my addr 172.21.15.7:0/1316310904 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:35.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.425+0000 7f2cdb7fe640 1 --2- 172.21.15.7:0/1316310904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbcb0d3170 0x55fbcb0d3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:35.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.425+0000 7f2cdaffd640 1 --2- 172.21.15.7:0/1316310904 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fbcb0bf230 0x55fbcb0d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:35.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.425+0000 7f2cda7fc640 1 -- 172.21.15.7:0/1316310904 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fbcb0bf230 msgr2=0x55fbcb0d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:35.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.425+0000 7f2cda7fc640 1 --2- 172.21.15.7:0/1316310904 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fbcb0bf230 0x55fbcb0d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.425+0000 7f2cda7fc640 1 -- 172.21.15.7:0/1316310904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbcb0d3170 msgr2=0x55fbcb0d3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:35.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.425+0000 7f2cda7fc640 1 --2- 172.21.15.7:0/1316310904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbcb0d3170 0x55fbcb0d3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.425+0000 7f2cda7fc640 1 -- 172.21.15.7:0/1316310904 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fbcad0c2d0 con 0x55fbcb0dcad0 2024-04-25T09:54:35.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.425+0000 7f2cda7fc640 1 --2- 172.21.15.7:0/1316310904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbcb0dcad0 0x55fbcb0d3aa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4001050 tx=0x7f2cdc0b5770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff6b9fb1e7de80d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:35.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.425+0000 7f2cb9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:54:35.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.425+0000 7f2cb9ffb640 1 -- 172.21.15.7:0/1316310904 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc4007650 con 0x55fbcb0dcad0 2024-04-25T09:54:35.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.425+0000 7f2cb9ffb640 1 -- 172.21.15.7:0/1316310904 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2cc402a420 con 0x55fbcb0dcad0 2024-04-25T09:54:35.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.425+0000 7f2ce4402740 1 -- 172.21.15.7:0/1316310904 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2cc4026070 con 0x55fbcb0dcad0 2024-04-25T09:54:35.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.426+0000 7f2cb9ffb640 1 -- 172.21.15.7:0/1316310904 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cc403b050 con 0x55fbcb0dcad0 2024-04-25T09:54:35.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.426+0000 7f2ce4402740 10 client.4446 fetch_fsmap learned FSMap version 6 2024-04-25T09:54:35.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.426+0000 7f2ce4402740 1 -- 172.21.15.7:0/1316310904 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55fbcadd66b0 con 0x55fbcb0dcad0 2024-04-25T09:54:35.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.426+0000 7f2cb9ffb640 1 -- 172.21.15.7:0/1316310904 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc4026070 con 0x55fbcb0dcad0 2024-04-25T09:54:35.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.426+0000 7f2cb9ffb640 1 -- 172.21.15.7:0/1316310904 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 6) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f2cc403e020 con 0x55fbcb0dcad0 2024-04-25T09:54:35.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.426+0000 7f2ce4402740 10 client.4446 fetch_fsmap finished waiting for FSMap version 6 2024-04-25T09:54:35.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.426+0000 7f2ce4402740 10 client.4446 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T09:54:35.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.426+0000 7f2ce4402740 20 client.4446 populate_metadata read hostname 'smithi007' 2024-04-25T09:54:35.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.426+0000 7f2ce4402740 1 --2- 172.21.15.7:0/1316310904 >> [v2:172.21.15.55:6833/3779228372,v1:172.21.15.55:6835/3779228372] conn(0x55fbcb0d2070 0x55fbcb0d2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:35.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.426+0000 7f2ce4402740 4 client.4446 mds_command: new command op to 4293 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:54:35.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.426+0000 7f2ce4402740 1 -- 172.21.15.7:0/1316310904 --> [v2:172.21.15.55:6833/3779228372,v1:172.21.15.55:6835/3779228372] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fbcb056920 con 0x55fbcb0d2070 2024-04-25T09:54:35.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.426+0000 7f2cdaffd640 1 --2- 172.21.15.7:0/1316310904 >> [v2:172.21.15.55:6833/3779228372,v1:172.21.15.55:6835/3779228372] conn(0x55fbcb0d2070 0x55fbcb0d2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:35.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.426+0000 7f2cb9ffb640 10 client.4446 ms_handle_connect on v2:172.21.15.55:6833/3779228372 2024-04-25T09:54:35.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.426+0000 7f2cdaffd640 1 --2- 172.21.15.7:0/1316310904 >> [v2:172.21.15.55:6833/3779228372,v1:172.21.15.55:6835/3779228372] conn(0x55fbcb0d2070 0x55fbcb0d2450 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae60f754069a3a57 server_cookie=179e0904b24c8453 in_seq=0 out_seq=0 2024-04-25T09:54:35.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.427+0000 7f2cb9ffb640 1 -- 172.21.15.7:0/1316310904 <== mds.0 v2:172.21.15.55:6833/3779228372 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fbcb056920 con 0x55fbcb0d2070 2024-04-25T09:54:35.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.427+0000 7f2cb9ffb640 10 client.4446 handle_command_reply: tid=0 2024-04-25T09:54:35.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.427+0000 7f2ce4402740 1 client.4446 shutdown 2024-04-25T09:54:35.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.427+0000 7f2ce4402740 1 -- 172.21.15.7:0/1316310904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbcb0dcad0 msgr2=0x55fbcb0d3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:35.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.427+0000 7f2ce4402740 1 --2- 172.21.15.7:0/1316310904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbcb0dcad0 0x55fbcb0d3aa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4001050 tx=0x7f2cdc0b5770 comp rx=0 tx=0).stop 2024-04-25T09:54:35.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.427+0000 7f2ce4402740 1 -- 172.21.15.7:0/1316310904 shutdown_connections 2024-04-25T09:54:35.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.427+0000 7f2ce4402740 1 --2- 172.21.15.7:0/1316310904 >> [v2:172.21.15.55:6833/3779228372,v1:172.21.15.55:6835/3779228372] conn(0x55fbcb0d2070 0x55fbcb0d2450 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.427+0000 7f2ce4402740 1 --2- 172.21.15.7:0/1316310904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbcb0d3170 0x55fbcb0d3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.427+0000 7f2cb9ffb640 0 client.4446 ms_handle_reset on v2:172.21.15.55:6833/3779228372 2024-04-25T09:54:35.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.427+0000 7f2ce4402740 1 --2- 172.21.15.7:0/1316310904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbcb0dcad0 0x55fbcb0d3aa0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.427+0000 7f2ce4402740 1 --2- 172.21.15.7:0/1316310904 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fbcb0bf230 0x55fbcb0d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.427+0000 7f2ce4402740 1 -- 172.21.15.7:0/1316310904 >> 172.21.15.7:0/1316310904 conn(0x55fbcb094f10 msgr2=0x55fbcb0dd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:35.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.427+0000 7f2ce4402740 1 -- 172.21.15.7:0/1316310904 shutdown_connections 2024-04-25T09:54:35.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.427+0000 7f2ce4402740 1 -- 172.21.15.7:0/1316310904 wait complete. 2024-04-25T09:54:35.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.428+0000 7f2ce4402740 20 client.4446 trim_cache size 0 max 16384 2024-04-25T09:54:35.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.443+0000 7f2ce4402740 1 Processor -- start 2024-04-25T09:54:35.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.443+0000 7f2ce4402740 1 -- start start 2024-04-25T09:54:35.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.444+0000 7f2ce4402740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbcb0bf230 0x55fbcb0e9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:35.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.444+0000 7f2ce4402740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbcb0d3170 0x55fbcb13ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:35.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.444+0000 7f2ce4402740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fbcb0dcad0 0x55fbcb0d3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:35.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.444+0000 7f2ce4402740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc2008b0 con 0x55fbcb0d3170 2024-04-25T09:54:35.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.444+0000 7f2ce4402740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc1f4b80 con 0x55fbcb0bf230 2024-04-25T09:54:35.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.444+0000 7f2ce4402740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc2002e0 con 0x55fbcb0dcad0 2024-04-25T09:54:35.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.444+0000 7f2cda7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbcb0d3170 0x55fbcb13ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:35.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.444+0000 7f2cda7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbcb0d3170 0x55fbcb13ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51726/0 (socket says 172.21.15.7:51726) 2024-04-25T09:54:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.444+0000 7f2cda7fc640 1 -- 172.21.15.7:0/4086417143 learned_addr learned my addr 172.21.15.7:0/4086417143 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.444+0000 7f2cdaffd640 1 --2- 172.21.15.7:0/4086417143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbcb0bf230 0x55fbcb0e9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.444+0000 7f2cda7fc640 1 -- 172.21.15.7:0/4086417143 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fbcb0dcad0 msgr2=0x55fbcb0d3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.444+0000 7f2cda7fc640 1 --2- 172.21.15.7:0/4086417143 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fbcb0dcad0 0x55fbcb0d3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.444+0000 7f2cda7fc640 1 -- 172.21.15.7:0/4086417143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbcb0bf230 msgr2=0x55fbcb0e9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.444+0000 7f2cda7fc640 1 --2- 172.21.15.7:0/4086417143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbcb0bf230 0x55fbcb0e9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.444+0000 7f2cda7fc640 1 -- 172.21.15.7:0/4086417143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbcafaee40 con 0x55fbcb0d3170 2024-04-25T09:54:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.444+0000 7f2cdaffd640 1 --2- 172.21.15.7:0/4086417143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbcb0bf230 0x55fbcb0e9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.444+0000 7f2cda7fc640 1 --2- 172.21.15.7:0/4086417143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbcb0d3170 0x55fbcb13ed60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4007480 tx=0x7f2cc402e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=898a6f1698def8a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.444+0000 7f2cbbfff640 1 -- 172.21.15.7:0/4086417143 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc4044070 con 0x55fbcb0d3170 2024-04-25T09:54:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.444+0000 7f2cbbfff640 1 -- 172.21.15.7:0/4086417143 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc4026040 con 0x55fbcb0d3170 2024-04-25T09:54:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.444+0000 7f2cbbfff640 1 -- 172.21.15.7:0/4086417143 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc402a420 con 0x55fbcb0d3170 2024-04-25T09:54:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.445+0000 7f2ce4402740 1 -- 172.21.15.7:0/4086417143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbcb0d3170 msgr2=0x55fbcb13ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.445+0000 7f2ce4402740 1 --2- 172.21.15.7:0/4086417143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbcb0d3170 0x55fbcb13ed60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4007480 tx=0x7f2cc402e040 comp rx=0 tx=0).stop 2024-04-25T09:54:35.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.445+0000 7f2ce4402740 1 -- 172.21.15.7:0/4086417143 shutdown_connections 2024-04-25T09:54:35.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.445+0000 7f2ce4402740 1 --2- 172.21.15.7:0/4086417143 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fbcb0dcad0 0x55fbcb0d3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.445+0000 7f2ce4402740 1 --2- 172.21.15.7:0/4086417143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbcb0d3170 0x55fbcb13ed60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.445+0000 7f2ce4402740 1 --2- 172.21.15.7:0/4086417143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbcb0bf230 0x55fbcb0e9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.445+0000 7f2ce4402740 1 -- 172.21.15.7:0/4086417143 >> 172.21.15.7:0/4086417143 conn(0x55fbcb094f10 msgr2=0x55fbcb0bafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:35.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.445+0000 7f2ce4402740 1 -- 172.21.15.7:0/4086417143 shutdown_connections 2024-04-25T09:54:35.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.445+0000 7f2ce4402740 1 -- 172.21.15.7:0/4086417143 wait complete. 2024-04-25T09:54:35.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.445+0000 7f2ce4402740 1 -- start start 2024-04-25T09:54:35.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.446+0000 7f2ce4402740 1 Processor -- start 2024-04-25T09:54:35.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.446+0000 7f2ce4402740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fbcb0bf230 0x55fbcb13e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:35.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.446+0000 7f2ce4402740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbcb0d3170 0x55fbcb0d3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:35.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.446+0000 7f2ce4402740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbcb0dcad0 0x55fbcb0d3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:35.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.446+0000 7f2ce4402740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbcb0eb120 con 0x55fbcb0d3170 2024-04-25T09:54:35.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.446+0000 7f2ce4402740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbcb095cb0 con 0x55fbcb0dcad0 2024-04-25T09:54:35.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.446+0000 7f2ce4402740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fbcb0ea990 con 0x55fbcb0bf230 2024-04-25T09:54:35.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.446+0000 7f2ce4402740 10 client.0 _ll_register_callbacks cb 0x55fbcb08fc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:54:35.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.446+0000 7f2cda7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbcb0d3170 0x55fbcb0d3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:35.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.446+0000 7f2cda7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbcb0d3170 0x55fbcb0d3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51730/0 (socket says 172.21.15.7:51730) 2024-04-25T09:54:35.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.446+0000 7f2cda7fc640 1 -- 172.21.15.7:0/3539404439 learned_addr learned my addr 172.21.15.7:0/3539404439 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:35.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.447+0000 7f2cdb7fe640 1 --2- 172.21.15.7:0/3539404439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbcb0dcad0 0x55fbcb0d3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:35.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.447+0000 7f2cdaffd640 1 --2- 172.21.15.7:0/3539404439 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fbcb0bf230 0x55fbcb13e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:35.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.447+0000 7f2cda7fc640 1 -- 172.21.15.7:0/3539404439 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fbcb0bf230 msgr2=0x55fbcb13e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:35.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.447+0000 7f2cda7fc640 1 --2- 172.21.15.7:0/3539404439 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fbcb0bf230 0x55fbcb13e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.447+0000 7f2cda7fc640 1 -- 172.21.15.7:0/3539404439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbcb0dcad0 msgr2=0x55fbcb0d3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:35.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.447+0000 7f2cda7fc640 1 --2- 172.21.15.7:0/3539404439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbcb0dcad0 0x55fbcb0d3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.447+0000 7f2cda7fc640 1 -- 172.21.15.7:0/3539404439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fbcb0d9ac0 con 0x55fbcb0d3170 2024-04-25T09:54:35.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.447+0000 7f2cdb7fe640 1 --2- 172.21.15.7:0/3539404439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbcb0dcad0 0x55fbcb0d3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:35.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.447+0000 7f2cda7fc640 1 --2- 172.21.15.7:0/3539404439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbcb0d3170 0x55fbcb0d3aa0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4015d90 tx=0x7f2cc400c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=277c9630aadee752 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:35.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.447+0000 7f2cb9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:54:35.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.447+0000 7f2cb9ffb640 1 -- 172.21.15.7:0/3539404439 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc404f060 con 0x55fbcb0d3170 2024-04-25T09:54:35.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.447+0000 7f2cb9ffb640 1 -- 172.21.15.7:0/3539404439 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2cc402ab80 con 0x55fbcb0d3170 2024-04-25T09:54:35.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.447+0000 7f2ce4402740 1 -- 172.21.15.7:0/3539404439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2cc4026040 con 0x55fbcb0d3170 2024-04-25T09:54:35.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.447+0000 7f2cb9ffb640 1 -- 172.21.15.7:0/3539404439 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cc4055050 con 0x55fbcb0d3170 2024-04-25T09:54:35.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.447+0000 7f2ce4402740 10 client.4452 fetch_fsmap learned FSMap version 6 2024-04-25T09:54:35.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.447+0000 7f2ce4402740 1 -- 172.21.15.7:0/3539404439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55fbcb0d9d60 con 0x55fbcb0d3170 2024-04-25T09:54:35.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.447+0000 7f2cb9ffb640 1 -- 172.21.15.7:0/3539404439 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc4026040 con 0x55fbcb0d3170 2024-04-25T09:54:35.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.447+0000 7f2cb9ffb640 1 -- 172.21.15.7:0/3539404439 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 6) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f2cc4058020 con 0x55fbcb0d3170 2024-04-25T09:54:35.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.447+0000 7f2ce4402740 10 client.4452 fetch_fsmap finished waiting for FSMap version 6 2024-04-25T09:54:35.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.447+0000 7f2ce4402740 10 client.4452 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T09:54:35.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.447+0000 7f2ce4402740 20 client.4452 populate_metadata read hostname 'smithi007' 2024-04-25T09:54:35.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.447+0000 7f2ce4402740 1 --2- 172.21.15.7:0/3539404439 >> [v2:172.21.15.55:6833/3779228372,v1:172.21.15.55:6835/3779228372] conn(0x55fbcb0cfd00 0x55fbcb0d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:35.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.447+0000 7f2ce4402740 4 client.4452 mds_command: new command op to 4293 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:54:35.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.447+0000 7f2ce4402740 1 -- 172.21.15.7:0/3539404439 --> [v2:172.21.15.55:6833/3779228372,v1:172.21.15.55:6835/3779228372] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fbcb004f50 con 0x55fbcb0cfd00 2024-04-25T09:54:35.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.448+0000 7f2cdaffd640 1 --2- 172.21.15.7:0/3539404439 >> [v2:172.21.15.55:6833/3779228372,v1:172.21.15.55:6835/3779228372] conn(0x55fbcb0cfd00 0x55fbcb0d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:35.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.448+0000 7f2cdaffd640 1 --2- 172.21.15.7:0/3539404439 >> [v2:172.21.15.55:6833/3779228372,v1:172.21.15.55:6835/3779228372] conn(0x55fbcb0cfd00 0x55fbcb0d00e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32ccc134760e6e15 server_cookie=c7cc423cc6f3786b in_seq=0 out_seq=0 2024-04-25T09:54:35.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.448+0000 7f2cb9ffb640 10 client.4452 ms_handle_connect on v2:172.21.15.55:6833/3779228372 2024-04-25T09:54:35.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.448+0000 7f2cb9ffb640 1 -- 172.21.15.7:0/3539404439 <== mds.0 v2:172.21.15.55:6833/3779228372 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+317 (crc 0 0 0) 0x55fbcb004f50 con 0x55fbcb0cfd00 2024-04-25T09:54:35.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.448+0000 7f2cb9ffb640 10 client.4452 handle_command_reply: tid=0 2024-04-25T09:54:35.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.448+0000 7f2ce4402740 1 client.4452 shutdown 2024-04-25T09:54:35.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.448+0000 7f2ce4402740 1 -- 172.21.15.7:0/3539404439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbcb0d3170 msgr2=0x55fbcb0d3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:35.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.448+0000 7f2ce4402740 1 --2- 172.21.15.7:0/3539404439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbcb0d3170 0x55fbcb0d3aa0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4015d90 tx=0x7f2cc400c000 comp rx=0 tx=0).stop 2024-04-25T09:54:35.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.448+0000 7f2ce4402740 1 -- 172.21.15.7:0/3539404439 shutdown_connections 2024-04-25T09:54:35.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.448+0000 7f2ce4402740 1 --2- 172.21.15.7:0/3539404439 >> [v2:172.21.15.55:6833/3779228372,v1:172.21.15.55:6835/3779228372] conn(0x55fbcb0cfd00 0x55fbcb0d00e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.448+0000 7f2ce4402740 1 --2- 172.21.15.7:0/3539404439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbcb0dcad0 0x55fbcb0d3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.448+0000 7f2ce4402740 1 --2- 172.21.15.7:0/3539404439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbcb0d3170 0x55fbcb0d3aa0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.448+0000 7f2cb9ffb640 0 client.4452 ms_handle_reset on v2:172.21.15.55:6833/3779228372 2024-04-25T09:54:35.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.448+0000 7f2ce4402740 1 --2- 172.21.15.7:0/3539404439 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fbcb0bf230 0x55fbcb13e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.448+0000 7f2ce4402740 1 -- 172.21.15.7:0/3539404439 >> 172.21.15.7:0/3539404439 conn(0x55fbcb094f10 msgr2=0x55fbcb0be5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:35.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.448+0000 7f2ce4402740 1 -- 172.21.15.7:0/3539404439 shutdown_connections 2024-04-25T09:54:35.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.448+0000 7f2ce4402740 1 -- 172.21.15.7:0/3539404439 wait complete. 2024-04-25T09:54:35.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.449+0000 7f2ce4402740 20 client.4452 trim_cache size 0 max 16384 2024-04-25T09:54:35.461 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T09:54:35.461 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "c03d0745-5946-49c3-ad88-1165c5b68b4e", 2024-04-25T09:54:35.461 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-04-25T09:54:35.461 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 4293, 2024-04-25T09:54:35.461 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-04-25T09:54:35.461 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-04-25T09:54:35.461 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-04-25T09:54:35.461 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 7.226603227, 2024-04-25T09:54:35.461 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 6, 2024-04-25T09:54:35.461 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 25, 2024-04-25T09:54:35.462 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 25, 2024-04-25T09:54:35.462 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 13.920886397 2024-04-25T09:54:35.462 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T09:54:35.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.449+0000 7f2ce16fc640 1 -- 172.21.15.7:0/3185261473 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2cbc06b4d0 msgr2=0x7f2cbc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:35.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.449+0000 7f2ce16fc640 1 --2- 172.21.15.7:0/3185261473 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2cbc06b4d0 0x7f2cbc06d990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4000fb0 tx=0x7f2cc4009040 comp rx=0 tx=0).stop 2024-04-25T09:54:35.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.449+0000 7f2ce16fc640 1 -- 172.21.15.7:0/3185261473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cc80039b0 msgr2=0x7f2cdc1f7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:35.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.449+0000 7f2ce16fc640 1 --2- 172.21.15.7:0/3185261473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cc80039b0 0x7f2cdc1f7eb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc02af10 tx=0x7f2ccc009750 comp rx=0 tx=0).stop 2024-04-25T09:54:35.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.449+0000 7f2ce16fc640 1 -- 172.21.15.7:0/3185261473 shutdown_connections 2024-04-25T09:54:35.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.449+0000 7f2ce16fc640 1 --2- 172.21.15.7:0/3185261473 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2cbc06b4d0 0x7f2cbc06d990 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.449+0000 7f2ce16fc640 1 --2- 172.21.15.7:0/3185261473 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2cdc1531b0 0x7f2cdc159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.449+0000 7f2ce16fc640 1 --2- 172.21.15.7:0/3185261473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cdc156570 0x7f2cdc157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.449+0000 7f2ce16fc640 1 --2- 172.21.15.7:0/3185261473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cc80039b0 0x7f2cdc1f7eb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.449+0000 7f2ce16fc640 1 -- 172.21.15.7:0/3185261473 >> 172.21.15.7:0/3185261473 conn(0x7f2cdc0b3390 msgr2=0x7f2cdc0cf190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:35.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.449+0000 7f2ce16fc640 1 -- 172.21.15.7:0/3185261473 shutdown_connections 2024-04-25T09:54:35.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.449+0000 7f2ce16fc640 1 -- 172.21.15.7:0/3185261473 wait complete. 2024-04-25T09:54:35.464 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T09:54:35.464 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-25T09:54:35.464 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:54:35.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.562+0000 7f88c726b640 1 Processor -- start 2024-04-25T09:54:35.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.562+0000 7f88c726b640 1 -- start start 2024-04-25T09:54:35.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.563+0000 7f88c726b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88c0145270 0x7f88c00ced00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:35.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.563+0000 7f88c726b640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c0144dc0 con 0x7f88c0071380 2024-04-25T09:54:35.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.563+0000 7f88c726b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c00ce220 con 0x7f88c0144610 2024-04-25T09:54:35.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.563+0000 7f88c726b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c00cf240 con 0x7f88c0145270 2024-04-25T09:54:35.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.563+0000 7f88c4806640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f88c0071380 0x7f88c00b4690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54826/0 (socket says 172.21.15.7:54826) 2024-04-25T09:54:35.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.563+0000 7f88c4806640 1 -- 172.21.15.7:0/1044286052 learned_addr learned my addr 172.21.15.7:0/1044286052 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:35.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.563+0000 7f88bffff640 1 -- 172.21.15.7:0/1044286052 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103024112 0 0) 0x7f88c0144dc0 con 0x7f88c0071380 2024-04-25T09:54:35.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.564+0000 7f88c5808640 1 --2- 172.21.15.7:0/1044286052 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88c0145270 0x7f88c00ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:35.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.564+0000 7f88bffff640 1 -- 172.21.15.7:0/1044286052 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88a8003520 con 0x7f88c0071380 2024-04-25T09:54:35.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.564+0000 7f88bffff640 1 -- 172.21.15.7:0/1044286052 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3654371007 0 0) 0x7f88a8003520 con 0x7f88c0071380 2024-04-25T09:54:35.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.564+0000 7f88bffff640 1 -- 172.21.15.7:0/1044286052 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88c0145270 msgr2=0x7f88c00ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:35.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.564+0000 7f88bffff640 1 --2- 172.21.15.7:0/1044286052 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88c0145270 0x7f88c00ced00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.564+0000 7f88bffff640 1 -- 172.21.15.7:0/1044286052 >> v1:172.21.15.55:6789/0 conn(0x7f88c0144610 legacy=0x7f88c0070c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:35.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.564+0000 7f88bffff640 1 -- 172.21.15.7:0/1044286052 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c00ce500 con 0x7f88c0071380 2024-04-25T09:54:35.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.564+0000 7f88bffff640 1 -- 172.21.15.7:0/1044286052 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f88b4001670 con 0x7f88c0071380 2024-04-25T09:54:35.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.564+0000 7f88bffff640 1 -- 172.21.15.7:0/1044286052 >> v1:172.21.15.7:6789/0 conn(0x7f88c0071380 legacy=0x7f88c00b4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:35.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.564+0000 7f88bffff640 1 --2- 172.21.15.7:0/1044286052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88a80039e0 0x7f88a8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:35.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.564+0000 7f88bffff640 1 --2- 172.21.15.7:0/1044286052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88a8004800 0x7f88a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:35.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.564+0000 7f88bffff640 1 --2- 172.21.15.7:0/1044286052 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88c0145270 0x7f88a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:35.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.564+0000 7f88bffff640 1 -- 172.21.15.7:0/1044286052 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c00cf240 con 0x7f88a8004800 2024-04-25T09:54:35.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.564+0000 7f88bffff640 1 -- 172.21.15.7:0/1044286052 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a800ba70 con 0x7f88a80039e0 2024-04-25T09:54:35.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.564+0000 7f88bffff640 1 -- 172.21.15.7:0/1044286052 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a800bc20 con 0x7f88c0145270 2024-04-25T09:54:35.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.564+0000 7f88c4806640 1 --2- 172.21.15.7:0/1044286052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88a8004800 0x7f88a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:35.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.564+0000 7f88c5007640 1 --2- 172.21.15.7:0/1044286052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88a80039e0 0x7f88a8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:35.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.564+0000 7f88c5808640 1 --2- 172.21.15.7:0/1044286052 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88c0145270 0x7f88a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:35.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.564+0000 7f88c4806640 1 -- 172.21.15.7:0/1044286052 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88c0145270 msgr2=0x7f88a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:35.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.564+0000 7f88c4806640 1 --2- 172.21.15.7:0/1044286052 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88c0145270 0x7f88a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.564+0000 7f88c4806640 1 -- 172.21.15.7:0/1044286052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88a80039e0 msgr2=0x7f88a8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:35.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.564+0000 7f88c4806640 1 --2- 172.21.15.7:0/1044286052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88a80039e0 0x7f88a8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.564+0000 7f88c4806640 1 -- 172.21.15.7:0/1044286052 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a8003520 con 0x7f88a8004800 2024-04-25T09:54:35.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.565+0000 7f88c4806640 1 --2- 172.21.15.7:0/1044286052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88a8004800 0x7f88a8004c80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f88b4001eb0 tx=0x7f88a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6a019d757b829b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:35.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.565+0000 7f88bffff640 1 -- 172.21.15.7:0/1044286052 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b4007c80 con 0x7f88a8004800 2024-04-25T09:54:35.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.565+0000 7f88bffff640 1 -- 172.21.15.7:0/1044286052 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b4005af0 con 0x7f88a8004800 2024-04-25T09:54:35.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.565+0000 7f88bffff640 1 -- 172.21.15.7:0/1044286052 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b4007070 con 0x7f88a8004800 2024-04-25T09:54:35.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.566+0000 7f88c726b640 1 -- 172.21.15.7:0/1044286052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88a8004800 msgr2=0x7f88a8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:35.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.566+0000 7f88c726b640 1 --2- 172.21.15.7:0/1044286052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88a8004800 0x7f88a8004c80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f88b4001eb0 tx=0x7f88a8005830 comp rx=0 tx=0).stop 2024-04-25T09:54:35.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.566+0000 7f88c5808640 1 -- 172.21.15.7:0/1044286052 reap_dead start 2024-04-25T09:54:35.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.566+0000 7f88c726b640 1 -- 172.21.15.7:0/1044286052 shutdown_connections 2024-04-25T09:54:35.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.566+0000 7f88c726b640 1 -- 172.21.15.7:0/1044286052 >> 172.21.15.7:0/1044286052 conn(0x7f88c00b3390 msgr2=0x7f88c00b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:35.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.566+0000 7f88c726b640 1 -- 172.21.15.7:0/1044286052 shutdown_connections 2024-04-25T09:54:35.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.566+0000 7f88c726b640 1 -- 172.21.15.7:0/1044286052 wait complete. 2024-04-25T09:54:35.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.567+0000 7f88c726b640 1 Processor -- start 2024-04-25T09:54:35.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.567+0000 7f88c726b640 1 -- start start 2024-04-25T09:54:35.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.568+0000 7f88c726b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88a8004800 0x7f88c015bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:35.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.568+0000 7f88c726b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88c0159680 0x7f88c015c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:35.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.568+0000 7f88c726b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88c0142ef0 0x7f88c0143370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:35.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.568+0000 7f88c726b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c00ce870 con 0x7f88c0142ef0 2024-04-25T09:54:35.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.568+0000 7f88c726b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c01450a0 con 0x7f88c0159680 2024-04-25T09:54:35.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.568+0000 7f88c726b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c01449f0 con 0x7f88a8004800 2024-04-25T09:54:35.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.568+0000 7f88c5808640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88c0142ef0 0x7f88c0143370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:35.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.568+0000 7f88c5808640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88c0142ef0 0x7f88c0143370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51748/0 (socket says 172.21.15.7:51748) 2024-04-25T09:54:35.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.568+0000 7f88c5808640 1 -- 172.21.15.7:0/1989786240 learned_addr learned my addr 172.21.15.7:0/1989786240 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:35.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.568+0000 7f88c4806640 1 --2- 172.21.15.7:0/1989786240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88c0159680 0x7f88c015c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:35.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.568+0000 7f88c5808640 1 -- 172.21.15.7:0/1989786240 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88a8004800 msgr2=0x7f88c015bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:35.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.568+0000 7f88c5007640 1 --2- 172.21.15.7:0/1989786240 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88a8004800 0x7f88c015bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:35.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.568+0000 7f88c5808640 1 --2- 172.21.15.7:0/1989786240 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88a8004800 0x7f88c015bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.568+0000 7f88c5808640 1 -- 172.21.15.7:0/1989786240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88c0159680 msgr2=0x7f88c015c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:35.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.568+0000 7f88c5808640 1 --2- 172.21.15.7:0/1989786240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88c0159680 0x7f88c015c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.568+0000 7f88c5808640 1 -- 172.21.15.7:0/1989786240 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c00c83e0 con 0x7f88c0142ef0 2024-04-25T09:54:35.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.568+0000 7f88c4806640 1 --2- 172.21.15.7:0/1989786240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88c0159680 0x7f88c015c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:35.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.568+0000 7f88c5007640 1 --2- 172.21.15.7:0/1989786240 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88a8004800 0x7f88c015bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:35.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.568+0000 7f88c5808640 1 --2- 172.21.15.7:0/1989786240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88c0142ef0 0x7f88c0143370 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f88c0145770 tx=0x7f88b000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:35.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.568+0000 7f88bdffb640 1 -- 172.21.15.7:0/1989786240 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b0003990 con 0x7f88c0142ef0 2024-04-25T09:54:35.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.569+0000 7f88bdffb640 1 -- 172.21.15.7:0/1989786240 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b001c070 con 0x7f88c0142ef0 2024-04-25T09:54:35.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.569+0000 7f88c726b640 1 -- 172.21.15.7:0/1989786240 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c00c7340 con 0x7f88c0142ef0 2024-04-25T09:54:35.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.569+0000 7f88bdffb640 1 -- 172.21.15.7:0/1989786240 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b0003d70 con 0x7f88c0142ef0 2024-04-25T09:54:35.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.569+0000 7f88c726b640 1 -- 172.21.15.7:0/1989786240 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c00c7900 con 0x7f88c0142ef0 2024-04-25T09:54:35.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.570+0000 7f88c726b640 1 -- 172.21.15.7:0/1989786240 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c0068fd0 con 0x7f88c0142ef0 2024-04-25T09:54:35.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.570+0000 7f88bdffb640 1 -- 172.21.15.7:0/1989786240 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f88b0004030 con 0x7f88c0142ef0 2024-04-25T09:54:35.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.571+0000 7f88bdffb640 1 --2- 172.21.15.7:0/1989786240 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f88ac06b500 0x7f88ac06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:35.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.571+0000 7f88bdffb640 1 -- 172.21.15.7:0/1989786240 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f88b008ae60 con 0x7f88c0142ef0 2024-04-25T09:54:35.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.571+0000 7f88c5007640 1 --2- 172.21.15.7:0/1989786240 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f88ac06b500 0x7f88ac06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:35.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.571+0000 7f88c5007640 1 --2- 172.21.15.7:0/1989786240 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f88ac06b500 0x7f88ac06d9c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f88b8000c00 tx=0x7f88b8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:35.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.575+0000 7f88bdffb640 1 -- 172.21.15.7:0/1989786240 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f88b0010040 con 0x7f88c0142ef0 2024-04-25T09:54:35.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.797+0000 7f88c726b640 1 -- 172.21.15.7:0/1989786240 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f88c00b4060 con 0x7f88c0142ef0 2024-04-25T09:54:35.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.798+0000 7f88bdffb640 1 -- 172.21.15.7:0/1989786240 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+88 (secure 0 0 0) 0x7f88b00599a0 con 0x7f88c0142ef0 2024-04-25T09:54:35.801 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T09:54:35.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.800+0000 7f88c726b640 1 -- 172.21.15.7:0/1989786240 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f88ac06b500 msgr2=0x7f88ac06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:35.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.800+0000 7f88c726b640 1 --2- 172.21.15.7:0/1989786240 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f88ac06b500 0x7f88ac06d9c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f88b8000c00 tx=0x7f88b8009040 comp rx=0 tx=0).stop 2024-04-25T09:54:35.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.800+0000 7f88c726b640 1 -- 172.21.15.7:0/1989786240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88c0142ef0 msgr2=0x7f88c0143370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:35.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.800+0000 7f88c726b640 1 --2- 172.21.15.7:0/1989786240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88c0142ef0 0x7f88c0143370 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f88c0145770 tx=0x7f88b000f580 comp rx=0 tx=0).stop 2024-04-25T09:54:35.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.800+0000 7f88c726b640 1 -- 172.21.15.7:0/1989786240 shutdown_connections 2024-04-25T09:54:35.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.800+0000 7f88c726b640 1 --2- 172.21.15.7:0/1989786240 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f88ac06b500 0x7f88ac06d9c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.800+0000 7f88c726b640 1 --2- 172.21.15.7:0/1989786240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88c0142ef0 0x7f88c0143370 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.800+0000 7f88c726b640 1 --2- 172.21.15.7:0/1989786240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88c0159680 0x7f88c015c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.800+0000 7f88c726b640 1 --2- 172.21.15.7:0/1989786240 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88a8004800 0x7f88c015bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:35.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.800+0000 7f88c726b640 1 -- 172.21.15.7:0/1989786240 >> 172.21.15.7:0/1989786240 conn(0x7f88c00b3390 msgr2=0x7f88c00b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:35.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.800+0000 7f88c726b640 1 -- 172.21.15.7:0/1989786240 shutdown_connections 2024-04-25T09:54:35.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:35.800+0000 7f88c726b640 1 -- 172.21.15.7:0/1989786240 wait complete. 2024-04-25T09:54:35.813 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:54:35.813 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:54:35.813 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-04-25T09:54:35.813 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-25T09:54:35.813 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-25T09:54:35.813 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:54:35.813 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T09:54:35.813 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:54:35.813 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-25T09:54:35.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:35.814 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-04-25T09:54:35.829 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:54:35.829 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:54:35.829 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:54:35.829 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:54:35.829 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-04-25T09:54:35.830 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:54:35.830 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:54:35.830 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-04-25T09:54:35.830 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-04-25T09:54:35.830 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:54:35.830 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-04-25T09:54:35.830 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-04-25T09:54:35.830 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:54:35.830 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-04-25T09:54:35.830 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-04-25T09:54:35.830 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T09:54:35.830 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42723sec preferred_lft 42723sec 2024-04-25T09:54:35.830 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link noprefixroute 2024-04-25T09:54:35.830 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:54:35.831 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:54:35.831 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-04-25T09:54:35.831 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-04-25T09:54:35.831 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T09:54:35.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:35.832 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-04-25T09:54:35.832 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-25T09:54:35.832 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add name ceph-brx type bridge 2024-04-25T09:54:35.832 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr flush dev ceph-brx 2024-04-25T09:54:35.832 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set ceph-brx up 2024-04-25T09:54:35.832 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T09:54:35.832 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-25T09:54:35.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:35.973 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:54:35.997 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-04-25T09:54:35.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:35.999 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-04-25T09:54:36.059 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-04-25T09:54:36.059 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:54:36.059 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T09:54:36.059 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T09:54:36.059 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:54:36.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:36.060 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-04-25T09:54:36.060 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-25T09:54:36.060 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:54:36.060 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:54:36.060 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:54:36.060 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-25T09:54:36.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:36.308 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-04-25T09:54:36.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:36.324 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list-id 2024-04-25T09:54:36.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:36.379 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-04-25T09:54:36.379 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-25T09:54:36.379 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T09:54:36.379 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-25T09:54:36.379 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-25T09:54:36.458 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-25T09:54:36.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:36.459 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-04-25T09:54:36.459 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-25T09:54:36.459 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-25T09:54:36.459 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T09:54:36.459 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-25T09:54:36.459 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-25T09:54:36.459 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-25T09:54:36.459 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-25T09:54:36.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:36.598 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-04-25T09:54:36.598 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-25T09:54:36.598 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-04-25T09:54:36.598 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T09:54:36.599 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-25T09:54:36.635 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-25T09:54:36.635 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:54:36.635 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-25T09:54:36.690 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-25T09:54:36.691 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:54:36.691 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-25T09:54:36.748 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2024-04-25T09:54:36.814 DEBUG:teuthology.orchestra.run.smithi007:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T09:54:36.870 INFO:teuthology.orchestra.run.smithi007.stdout:/proc 2024-04-25T09:54:36.871 INFO:teuthology.orchestra.run.smithi007.stdout:/sys 2024-04-25T09:54:36.871 INFO:teuthology.orchestra.run.smithi007.stdout:/dev 2024-04-25T09:54:36.871 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/security 2024-04-25T09:54:36.871 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/shm 2024-04-25T09:54:36.871 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/pts 2024-04-25T09:54:36.871 INFO:teuthology.orchestra.run.smithi007.stdout:/run 2024-04-25T09:54:36.871 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup 2024-04-25T09:54:36.871 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/pstore 2024-04-25T09:54:36.871 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/bpf 2024-04-25T09:54:36.871 INFO:teuthology.orchestra.run.smithi007.stdout:/ 2024-04-25T09:54:36.871 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/selinux 2024-04-25T09:54:36.871 INFO:teuthology.orchestra.run.smithi007.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T09:54:36.871 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/mqueue 2024-04-25T09:54:36.872 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/hugepages 2024-04-25T09:54:36.872 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/debug 2024-04-25T09:54:36.872 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/tracing 2024-04-25T09:54:36.872 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T09:54:36.872 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/config 2024-04-25T09:54:36.872 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/fuse/connections 2024-04-25T09:54:36.872 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T09:54:36.872 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T09:54:36.872 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T09:54:36.872 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T09:54:36.872 INFO:teuthology.orchestra.run.smithi007.stdout:/run/user/1000 2024-04-25T09:54:36.872 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/ceph 2024-04-25T09:54:36.872 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T09:54:36.872 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T09:54:36.872 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T09:54:36.873 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T09:54:36.873 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns 2024-04-25T09:54:36.873 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T09:54:36.873 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T09:54:36.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:36.873 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2024-04-25T09:54:36.927 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T09:54:36.927 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-25T09:54:36.970 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2024-04-25T09:54:36.994 DEBUG:teuthology.orchestra.run.smithi007:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T09:54:37.050 INFO:teuthology.orchestra.run.smithi007.stdout:/proc 2024-04-25T09:54:37.050 INFO:teuthology.orchestra.run.smithi007.stdout:/sys 2024-04-25T09:54:37.050 INFO:teuthology.orchestra.run.smithi007.stdout:/dev 2024-04-25T09:54:37.050 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/security 2024-04-25T09:54:37.050 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/shm 2024-04-25T09:54:37.050 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/pts 2024-04-25T09:54:37.050 INFO:teuthology.orchestra.run.smithi007.stdout:/run 2024-04-25T09:54:37.050 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup 2024-04-25T09:54:37.050 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/pstore 2024-04-25T09:54:37.051 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/bpf 2024-04-25T09:54:37.051 INFO:teuthology.orchestra.run.smithi007.stdout:/ 2024-04-25T09:54:37.051 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/selinux 2024-04-25T09:54:37.051 INFO:teuthology.orchestra.run.smithi007.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T09:54:37.051 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/mqueue 2024-04-25T09:54:37.051 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/hugepages 2024-04-25T09:54:37.051 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/debug 2024-04-25T09:54:37.051 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/tracing 2024-04-25T09:54:37.051 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T09:54:37.051 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/config 2024-04-25T09:54:37.051 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/fuse/connections 2024-04-25T09:54:37.051 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T09:54:37.052 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T09:54:37.052 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T09:54:37.052 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T09:54:37.052 INFO:teuthology.orchestra.run.smithi007.stdout:/run/user/1000 2024-04-25T09:54:37.052 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/ceph 2024-04-25T09:54:37.052 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T09:54:37.052 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T09:54:37.052 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T09:54:37.052 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T09:54:37.052 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns 2024-04-25T09:54:37.052 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T09:54:37.052 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T09:54:37.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:37.053 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2024-04-25T09:54:37.082 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi007.stderr:2024-04-25T09:54:37.080+0000 7f2e61120480 -1 init, newargv = 0x56115f71b080 newargc=15 2024-04-25T09:54:37.083 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi007.stderr:ceph-fuse[41363]: starting ceph client 2024-04-25T09:54:37.090 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi007.stderr:ceph-fuse[41363]: starting fuse 2024-04-25T09:54:37.099 INFO:teuthology.orchestra.run.smithi007.stdout:43 2024-04-25T09:54:37.099 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-25T09:54:37.099 DEBUG:teuthology.orchestra.run.smithi007:> sudo stdin-killer -- python3 -c ' 2024-04-25T09:54:37.099 DEBUG:teuthology.orchestra.run.smithi007:> import glob 2024-04-25T09:54:37.099 DEBUG:teuthology.orchestra.run.smithi007:> import re 2024-04-25T09:54:37.100 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T09:54:37.100 DEBUG:teuthology.orchestra.run.smithi007:> import subprocess 2024-04-25T09:54:37.100 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T09:54:37.100 DEBUG:teuthology.orchestra.run.smithi007:> def _find_admin_socket(client_name): 2024-04-25T09:54:37.100 DEBUG:teuthology.orchestra.run.smithi007:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-25T09:54:37.100 DEBUG:teuthology.orchestra.run.smithi007:> files = glob.glob(asok_path) 2024-04-25T09:54:37.100 DEBUG:teuthology.orchestra.run.smithi007:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-25T09:54:37.100 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T09:54:37.100 DEBUG:teuthology.orchestra.run.smithi007:> # Given a non-glob path, it better be there 2024-04-25T09:54:37.100 DEBUG:teuthology.orchestra.run.smithi007:> if "*" not in asok_path: 2024-04-25T09:54:37.100 DEBUG:teuthology.orchestra.run.smithi007:> assert(len(files) == 1) 2024-04-25T09:54:37.100 DEBUG:teuthology.orchestra.run.smithi007:> return files[0] 2024-04-25T09:54:37.100 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T09:54:37.100 DEBUG:teuthology.orchestra.run.smithi007:> for f in files: 2024-04-25T09:54:37.101 DEBUG:teuthology.orchestra.run.smithi007:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T09:54:37.101 DEBUG:teuthology.orchestra.run.smithi007:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T09:54:37.101 DEBUG:teuthology.orchestra.run.smithi007:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T09:54:37.101 DEBUG:teuthology.orchestra.run.smithi007:> contents = proc_f.read() 2024-04-25T09:54:37.101 DEBUG:teuthology.orchestra.run.smithi007:> if mountpoint in contents: 2024-04-25T09:54:37.101 DEBUG:teuthology.orchestra.run.smithi007:> return f 2024-04-25T09:54:37.101 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T09:54:37.101 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T09:54:37.101 DEBUG:teuthology.orchestra.run.smithi007:> print(_find_admin_socket("client.admin")) 2024-04-25T09:54:37.101 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T09:54:37.220 INFO:teuthology.orchestra.run.smithi007.stdout:/var/run/ceph/ceph-client.admin.41363.asok 2024-04-25T09:54:37.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:54:37.230 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.41363.asok 2024-04-25T09:54:37.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:37.231 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.41363.asok status 2024-04-25T09:54:37.367 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T09:54:37.367 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": { 2024-04-25T09:54:37.367 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_sha1": "97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec", 2024-04-25T09:54:37.367 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 19.0.0-1628-g97ae6cc9 (97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec) squid (dev)", 2024-04-25T09:54:37.368 INFO:teuthology.orchestra.run.smithi007.stdout: "entity_id": "admin", 2024-04-25T09:54:37.368 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": "smithi007", 2024-04-25T09:54:37.368 INFO:teuthology.orchestra.run.smithi007.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-25T09:54:37.368 INFO:teuthology.orchestra.run.smithi007.stdout: "pid": "41363", 2024-04-25T09:54:37.368 INFO:teuthology.orchestra.run.smithi007.stdout: "root": "/" 2024-04-25T09:54:37.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:54:37.368 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_count": 0, 2024-04-25T09:54:37.368 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_pinned_count": 0, 2024-04-25T09:54:37.368 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 4467, 2024-04-25T09:54:37.368 INFO:teuthology.orchestra.run.smithi007.stdout: "inst": { 2024-04-25T09:54:37.368 INFO:teuthology.orchestra.run.smithi007.stdout: "name": { 2024-04-25T09:54:37.368 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "client", 2024-04-25T09:54:37.368 INFO:teuthology.orchestra.run.smithi007.stdout: "num": 4467 2024-04-25T09:54:37.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:54:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2024-04-25T09:54:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2024-04-25T09:54:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "192.168.0.1:0", 2024-04-25T09:54:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2006395413 2024-04-25T09:54:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:54:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:54:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2024-04-25T09:54:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2024-04-25T09:54:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "192.168.0.1:0", 2024-04-25T09:54:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2006395413 2024-04-25T09:54:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:54:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: "inst_str": "client.4467 192.168.0.1:0/2006395413", 2024-04-25T09:54:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: "addr_str": "192.168.0.1:0/2006395413", 2024-04-25T09:54:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: "inode_count": 1, 2024-04-25T09:54:37.370 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_epoch": 6, 2024-04-25T09:54:37.370 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch": 25, 2024-04-25T09:54:37.370 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch_barrier": 0, 2024-04-25T09:54:37.370 INFO:teuthology.orchestra.run.smithi007.stdout: "blocklisted": false, 2024-04-25T09:54:37.370 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs" 2024-04-25T09:54:37.370 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T09:54:37.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:37.376 DEBUG:teuthology.orchestra.run.smithi007:> stat --file-system '--printf=%T 2024-04-25T09:54:37.376 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-25T09:54:37.391 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2024-04-25T09:54:37.392 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-25T09:54:37.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:37.392 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-25T09:54:37.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:37.459 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-25T09:54:37.533 INFO:teuthology.orchestra.run.smithi007.stdout:# file: . 2024-04-25T09:54:37.533 INFO:teuthology.orchestra.run.smithi007.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-25T09:54:37.533 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:37.534 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:54:37.534 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:54:37.589 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:54:37.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.727+0000 7f4b40afc640 1 Processor -- start 2024-04-25T09:54:37.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.727+0000 7f4b40afc640 1 -- start start 2024-04-25T09:54:37.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.728+0000 7f4b40afc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4b3c0ce710 0x7f4b3c144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:37.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.728+0000 7f4b40afc640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4b3c0ceaf0 0x7f4b3c070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:37.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.728+0000 7f4b40afc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4b3c0cdc80 0x7f4b3c15bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:37.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.728+0000 7f4b40afc640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b3c0c57a0 con 0x7f4b3c0ceaf0 2024-04-25T09:54:37.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.728+0000 7f4b40afc640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b3c145390 con 0x7f4b3c0ce710 2024-04-25T09:54:37.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.728+0000 7f4b40afc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c144870 con 0x7f4b3c0cdc80 2024-04-25T09:54:37.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.728+0000 7f4b31d9b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4b3c0ceaf0 0x7f4b3c070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:37.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.728+0000 7f4b31d9b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4b3c0ceaf0 0x7f4b3c070640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51752/0 (socket says 172.21.15.7:51752) 2024-04-25T09:54:37.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.728+0000 7f4b31d9b640 1 -- 172.21.15.7:0/191565359 learned_addr learned my addr 172.21.15.7:0/191565359 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:37.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.728+0000 7f4b3ad9d640 1 --2- 172.21.15.7:0/191565359 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4b3c0cdc80 0x7f4b3c15bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:37.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.728+0000 7f4b3a59c640 1 --2- 172.21.15.7:0/191565359 >> v2:172.21.15.55:3300/0 conn(0x7f4b3c0ce710 0x7f4b3c144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:37.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.728+0000 7f4b31d9b640 1 -- 172.21.15.7:0/191565359 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4b3c0cdc80 msgr2=0x7f4b3c15bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:37.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.728+0000 7f4b31d9b640 1 --2- 172.21.15.7:0/191565359 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4b3c0cdc80 0x7f4b3c15bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:37.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.728+0000 7f4b31d9b640 1 -- 172.21.15.7:0/191565359 >> v2:172.21.15.55:3300/0 conn(0x7f4b3c0ce710 msgr2=0x7f4b3c144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:37.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.728+0000 7f4b31d9b640 1 --2- 172.21.15.7:0/191565359 >> v2:172.21.15.55:3300/0 conn(0x7f4b3c0ce710 0x7f4b3c144ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:37.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.728+0000 7f4b31d9b640 1 -- 172.21.15.7:0/191565359 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3c1450b0 con 0x7f4b3c0ceaf0 2024-04-25T09:54:37.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.728+0000 7f4b3a59c640 1 --2- 172.21.15.7:0/191565359 >> v2:172.21.15.55:3300/0 conn(0x7f4b3c0ce710 0x7f4b3c144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:37.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.729+0000 7f4b31d9b640 1 --2- 172.21.15.7:0/191565359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b3c0ceaf0 0x7f4b3c070640 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c06dd80 tx=0x7f4b2402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9811cb2b104b037 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:37.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.729+0000 7f4b39d9b640 1 -- 172.21.15.7:0/191565359 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b24037070 con 0x7f4b3c0ceaf0 2024-04-25T09:54:37.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.729+0000 7f4b39d9b640 1 -- 172.21.15.7:0/191565359 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b24032440 con 0x7f4b3c0ceaf0 2024-04-25T09:54:37.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.729+0000 7f4b39d9b640 1 -- 172.21.15.7:0/191565359 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b24032810 con 0x7f4b3c0ceaf0 2024-04-25T09:54:37.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.730+0000 7f4b40afc640 1 -- 172.21.15.7:0/191565359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b3c0ceaf0 msgr2=0x7f4b3c070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:37.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.730+0000 7f4b40afc640 1 --2- 172.21.15.7:0/191565359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b3c0ceaf0 0x7f4b3c070640 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c06dd80 tx=0x7f4b2402a210 comp rx=0 tx=0).stop 2024-04-25T09:54:37.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.730+0000 7f4b40afc640 1 -- 172.21.15.7:0/191565359 shutdown_connections 2024-04-25T09:54:37.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.730+0000 7f4b40afc640 1 --2- 172.21.15.7:0/191565359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b3c0ceaf0 0x7f4b3c070640 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:37.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.730+0000 7f4b40afc640 1 --2- 172.21.15.7:0/191565359 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4b3c0cdc80 0x7f4b3c15bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:37.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.730+0000 7f4b40afc640 1 --2- 172.21.15.7:0/191565359 >> v2:172.21.15.55:3300/0 conn(0x7f4b3c0ce710 0x7f4b3c144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:37.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.730+0000 7f4b40afc640 1 -- 172.21.15.7:0/191565359 >> 172.21.15.7:0/191565359 conn(0x7f4b3c0b2390 msgr2=0x7f4b3c0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:37.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.730+0000 7f4b40afc640 1 -- 172.21.15.7:0/191565359 shutdown_connections 2024-04-25T09:54:37.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.730+0000 7f4b40afc640 1 -- 172.21.15.7:0/191565359 wait complete. 2024-04-25T09:54:37.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.731+0000 7f4b40afc640 1 Processor -- start 2024-04-25T09:54:37.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.731+0000 7f4b40afc640 1 -- start start 2024-04-25T09:54:37.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.732+0000 7f4b40afc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b3c0cdc80 0x7f4b3c1e6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:37.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.732+0000 7f4b40afc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b3c0ce710 0x7f4b3c13afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:37.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.732+0000 7f4b40afc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4b3c0ceaf0 0x7f4b3c06fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:37.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.732+0000 7f4b40afc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c070b80 con 0x7f4b3c0ce710 2024-04-25T09:54:37.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.732+0000 7f4b40afc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c0cd480 con 0x7f4b3c0cdc80 2024-04-25T09:54:37.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.732+0000 7f4b40afc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c0cef50 con 0x7f4b3c0ceaf0 2024-04-25T09:54:37.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.732+0000 7f4b31d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b3c0ce710 0x7f4b3c13afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:37.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.732+0000 7f4b31d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b3c0ce710 0x7f4b3c13afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51756/0 (socket says 172.21.15.7:51756) 2024-04-25T09:54:37.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.732+0000 7f4b31d9b640 1 -- 172.21.15.7:0/2261293603 learned_addr learned my addr 172.21.15.7:0/2261293603 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:37.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.732+0000 7f4b3a59c640 1 --2- 172.21.15.7:0/2261293603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b3c0cdc80 0x7f4b3c1e6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:37.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.732+0000 7f4b3ad9d640 1 --2- 172.21.15.7:0/2261293603 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4b3c0ceaf0 0x7f4b3c06fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:37.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.732+0000 7f4b31d9b640 1 -- 172.21.15.7:0/2261293603 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4b3c0ceaf0 msgr2=0x7f4b3c06fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:37.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.732+0000 7f4b31d9b640 1 --2- 172.21.15.7:0/2261293603 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4b3c0ceaf0 0x7f4b3c06fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:37.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.732+0000 7f4b31d9b640 1 -- 172.21.15.7:0/2261293603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b3c0cdc80 msgr2=0x7f4b3c1e6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:37.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.732+0000 7f4b31d9b640 1 --2- 172.21.15.7:0/2261293603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b3c0cdc80 0x7f4b3c1e6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:37.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.732+0000 7f4b31d9b640 1 -- 172.21.15.7:0/2261293603 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3c13b510 con 0x7f4b3c0ce710 2024-04-25T09:54:37.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.733+0000 7f4b31d9b640 1 --2- 172.21.15.7:0/2261293603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b3c0ce710 0x7f4b3c13afd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4b24000c00 tx=0x7f4b240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:37.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.733+0000 7f4b337fe640 1 -- 172.21.15.7:0/2261293603 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b24037040 con 0x7f4b3c0ce710 2024-04-25T09:54:37.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.733+0000 7f4b337fe640 1 -- 172.21.15.7:0/2261293603 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b24042070 con 0x7f4b3c0ce710 2024-04-25T09:54:37.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.733+0000 7f4b40afc640 1 -- 172.21.15.7:0/2261293603 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b3c1e5160 con 0x7f4b3c0ce710 2024-04-25T09:54:37.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.733+0000 7f4b337fe640 1 -- 172.21.15.7:0/2261293603 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b24030880 con 0x7f4b3c0ce710 2024-04-25T09:54:37.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.733+0000 7f4b40afc640 1 -- 172.21.15.7:0/2261293603 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b3c1e5720 con 0x7f4b3c0ce710 2024-04-25T09:54:37.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.734+0000 7f4b40afc640 1 -- 172.21.15.7:0/2261293603 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b3c071780 con 0x7f4b3c0ce710 2024-04-25T09:54:37.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.734+0000 7f4b337fe640 1 -- 172.21.15.7:0/2261293603 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4b24030a20 con 0x7f4b3c0ce710 2024-04-25T09:54:37.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.735+0000 7f4b337fe640 1 --2- 172.21.15.7:0/2261293603 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4b1c06b4d0 0x7f4b1c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:37.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.735+0000 7f4b337fe640 1 -- 172.21.15.7:0/2261293603 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f4b240aab00 con 0x7f4b3c0ce710 2024-04-25T09:54:37.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.735+0000 7f4b3a59c640 1 --2- 172.21.15.7:0/2261293603 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4b1c06b4d0 0x7f4b1c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:37.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.735+0000 7f4b3a59c640 1 --2- 172.21.15.7:0/2261293603 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4b1c06b4d0 0x7f4b1c06d990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c006fd0 tx=0x7f4b2c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:37.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.739+0000 7f4b337fe640 1 -- 172.21.15.7:0/2261293603 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4b3c071780 con 0x7f4b3c0ce710 2024-04-25T09:54:37.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.919+0000 7f4b40afc640 1 -- 172.21.15.7:0/2261293603 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b3c0ce4f0 con 0x7f4b3c0ce710 2024-04-25T09:54:37.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.921+0000 7f4b337fe640 1 -- 172.21.15.7:0/2261293603 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18418 (secure 0 0 0) 0x7f4b24079080 con 0x7f4b3c0ce710 2024-04-25T09:54:37.923 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:37.924 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:54:32.606761+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:54:26.011833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:54:26.535536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:54:30.264996+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:54:37.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.922+0000 7f4b40afc640 1 -- 172.21.15.7:0/2261293603 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4b1c06b4d0 msgr2=0x7f4b1c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:37.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.922+0000 7f4b40afc640 1 --2- 172.21.15.7:0/2261293603 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4b1c06b4d0 0x7f4b1c06d990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c006fd0 tx=0x7f4b2c008040 comp rx=0 tx=0).stop 2024-04-25T09:54:37.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.922+0000 7f4b40afc640 1 -- 172.21.15.7:0/2261293603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b3c0ce710 msgr2=0x7f4b3c13afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:37.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.922+0000 7f4b40afc640 1 --2- 172.21.15.7:0/2261293603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b3c0ce710 0x7f4b3c13afd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4b24000c00 tx=0x7f4b240046c0 comp rx=0 tx=0).stop 2024-04-25T09:54:37.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.922+0000 7f4b40afc640 1 -- 172.21.15.7:0/2261293603 shutdown_connections 2024-04-25T09:54:37.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.922+0000 7f4b40afc640 1 --2- 172.21.15.7:0/2261293603 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4b1c06b4d0 0x7f4b1c06d990 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:37.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.922+0000 7f4b40afc640 1 --2- 172.21.15.7:0/2261293603 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4b3c0ceaf0 0x7f4b3c06fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:37.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.922+0000 7f4b40afc640 1 --2- 172.21.15.7:0/2261293603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b3c0ce710 0x7f4b3c13afd0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:37.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.922+0000 7f4b40afc640 1 --2- 172.21.15.7:0/2261293603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b3c0cdc80 0x7f4b3c1e6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:37.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.922+0000 7f4b40afc640 1 -- 172.21.15.7:0/2261293603 >> 172.21.15.7:0/2261293603 conn(0x7f4b3c0b2390 msgr2=0x7f4b3c0c5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:37.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.923+0000 7f4b40afc640 1 -- 172.21.15.7:0/2261293603 shutdown_connections 2024-04-25T09:54:37.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:37.923+0000 7f4b40afc640 1 -- 172.21.15.7:0/2261293603 wait complete. 2024-04-25T09:54:37.936 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:54:26.011833+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:54:26.535536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:54:30.264996+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:54:37.937 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:54:38.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.038+0000 7f2b8475c640 1 Processor -- start 2024-04-25T09:54:38.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.038+0000 7f2b8475c640 1 -- start start 2024-04-25T09:54:38.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.039+0000 7f2b8475c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b7c15f1c0 0x7f2b7c15eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:38.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.039+0000 7f2b8475c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2b7c0ce830 0x7f2b7c0b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:38.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.039+0000 7f2b8475c640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b7c0ced10 con 0x7f2b7c0d3760 2024-04-25T09:54:38.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.039+0000 7f2b8475c640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b7c0ce380 con 0x7f2b7c0ce830 2024-04-25T09:54:38.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.039+0000 7f2b8475c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c15f000 con 0x7f2b7c15f1c0 2024-04-25T09:54:38.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.039+0000 7f2b82cf9640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2b7c0ce830 0x7f2b7c0b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:38.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.039+0000 7f2b824f8640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2b7c0d3760 0x7f2b7c0d3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54842/0 (socket says 172.21.15.7:54842) 2024-04-25T09:54:38.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.039+0000 7f2b824f8640 1 -- 172.21.15.7:0/3144750895 learned_addr learned my addr 172.21.15.7:0/3144750895 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:38.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.040+0000 7f2b81cf7640 1 --2- 172.21.15.7:0/3144750895 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b7c15f1c0 0x7f2b7c15eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:38.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.040+0000 7f2b82cf9640 1 -- 172.21.15.7:0/3144750895 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b7c15f1c0 msgr2=0x7f2b7c15eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:38.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.040+0000 7f2b82cf9640 1 --2- 172.21.15.7:0/3144750895 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b7c15f1c0 0x7f2b7c15eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.040+0000 7f2b82cf9640 1 -- 172.21.15.7:0/3144750895 >> v1:172.21.15.7:6789/0 conn(0x7f2b7c0d3760 legacy=0x7f2b7c0d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:38.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.040+0000 7f2b814f6640 1 -- 172.21.15.7:0/3144750895 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1626773090 0 0) 0x7f2b7c0ced10 con 0x7f2b7c0d3760 2024-04-25T09:54:38.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.040+0000 7f2b82cf9640 1 -- 172.21.15.7:0/3144750895 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c0d1b40 con 0x7f2b7c0ce830 2024-04-25T09:54:38.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.040+0000 7f2b81cf7640 1 --2- 172.21.15.7:0/3144750895 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b7c15f1c0 0x7f2b7c15eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:38.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.040+0000 7f2b82cf9640 1 --2- 172.21.15.7:0/3144750895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b7c0ce830 0x7f2b7c0b2240 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2b740097a0 tx=0x7f2b7402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57987d9eda5e0d69 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:38.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.040+0000 7f2b814f6640 1 -- 172.21.15.7:0/3144750895 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b74037070 con 0x7f2b7c0ce830 2024-04-25T09:54:38.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.041+0000 7f2b814f6640 1 -- 172.21.15.7:0/3144750895 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b74032440 con 0x7f2b7c0ce830 2024-04-25T09:54:38.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.041+0000 7f2b814f6640 1 -- 172.21.15.7:0/3144750895 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b74032810 con 0x7f2b7c0ce830 2024-04-25T09:54:38.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.041+0000 7f2b8475c640 1 -- 172.21.15.7:0/3144750895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b7c0ce830 msgr2=0x7f2b7c0b2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:38.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.041+0000 7f2b8475c640 1 --2- 172.21.15.7:0/3144750895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b7c0ce830 0x7f2b7c0b2240 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2b740097a0 tx=0x7f2b7402a180 comp rx=0 tx=0).stop 2024-04-25T09:54:38.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.041+0000 7f2b8475c640 1 -- 172.21.15.7:0/3144750895 shutdown_connections 2024-04-25T09:54:38.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.041+0000 7f2b8475c640 1 --2- 172.21.15.7:0/3144750895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b7c0ce830 0x7f2b7c0b2240 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.041+0000 7f2b8475c640 1 --2- 172.21.15.7:0/3144750895 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b7c15f1c0 0x7f2b7c15eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.041+0000 7f2b8475c640 1 -- 172.21.15.7:0/3144750895 >> 172.21.15.7:0/3144750895 conn(0x7f2b7c072680 msgr2=0x7f2b7c072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:38.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.041+0000 7f2b8475c640 1 -- 172.21.15.7:0/3144750895 shutdown_connections 2024-04-25T09:54:38.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.041+0000 7f2b8475c640 1 -- 172.21.15.7:0/3144750895 wait complete. 2024-04-25T09:54:38.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.042+0000 7f2b8475c640 1 Processor -- start 2024-04-25T09:54:38.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.042+0000 7f2b8475c640 1 -- start start 2024-04-25T09:54:38.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.043+0000 7f2b8475c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b7c0ce830 0x7f2b7c14ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:38.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.043+0000 7f2b8475c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b7c0d3760 0x7f2b7c0b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:38.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.043+0000 7f2b8475c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b7c15f1c0 0x7f2b7c15ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:38.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.043+0000 7f2b8475c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c15de10 con 0x7f2b7c15f1c0 2024-04-25T09:54:38.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.043+0000 7f2b8475c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c0d2190 con 0x7f2b7c0ce830 2024-04-25T09:54:38.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.043+0000 7f2b8475c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c0b2780 con 0x7f2b7c0d3760 2024-04-25T09:54:38.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.043+0000 7f2b82cf9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b7c15f1c0 0x7f2b7c15ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:38.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.043+0000 7f2b82cf9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b7c15f1c0 0x7f2b7c15ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51782/0 (socket says 172.21.15.7:51782) 2024-04-25T09:54:38.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.043+0000 7f2b82cf9640 1 -- 172.21.15.7:0/2089025157 learned_addr learned my addr 172.21.15.7:0/2089025157 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:38.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.043+0000 7f2b81cf7640 1 --2- 172.21.15.7:0/2089025157 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b7c0d3760 0x7f2b7c0b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:38.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.043+0000 7f2b824f8640 1 --2- 172.21.15.7:0/2089025157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b7c0ce830 0x7f2b7c14ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:38.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.043+0000 7f2b82cf9640 1 -- 172.21.15.7:0/2089025157 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b7c0d3760 msgr2=0x7f2b7c0b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:38.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.043+0000 7f2b82cf9640 1 --2- 172.21.15.7:0/2089025157 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b7c0d3760 0x7f2b7c0b3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.043+0000 7f2b82cf9640 1 -- 172.21.15.7:0/2089025157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b7c0ce830 msgr2=0x7f2b7c14ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:38.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.043+0000 7f2b82cf9640 1 --2- 172.21.15.7:0/2089025157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b7c0ce830 0x7f2b7c14ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.043+0000 7f2b82cf9640 1 -- 172.21.15.7:0/2089025157 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c0b4080 con 0x7f2b7c15f1c0 2024-04-25T09:54:38.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.044+0000 7f2b81cf7640 1 --2- 172.21.15.7:0/2089025157 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b7c0d3760 0x7f2b7c0b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:38.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.044+0000 7f2b824f8640 1 --2- 172.21.15.7:0/2089025157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b7c0ce830 0x7f2b7c14ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:38.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.044+0000 7f2b82cf9640 1 --2- 172.21.15.7:0/2089025157 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b7c15f1c0 0x7f2b7c15ac60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2b740098c0 tx=0x7f2b740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:38.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.044+0000 7f2b7affd640 1 -- 172.21.15.7:0/2089025157 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b74037040 con 0x7f2b7c15f1c0 2024-04-25T09:54:38.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.044+0000 7f2b7affd640 1 -- 172.21.15.7:0/2089025157 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b74042070 con 0x7f2b7c15f1c0 2024-04-25T09:54:38.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.044+0000 7f2b8475c640 1 -- 172.21.15.7:0/2089025157 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7c0b4360 con 0x7f2b7c15f1c0 2024-04-25T09:54:38.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.044+0000 7f2b7affd640 1 -- 172.21.15.7:0/2089025157 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b74030b30 con 0x7f2b7c15f1c0 2024-04-25T09:54:38.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.044+0000 7f2b8475c640 1 -- 172.21.15.7:0/2089025157 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b7c14f660 con 0x7f2b7c15f1c0 2024-04-25T09:54:38.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.045+0000 7f2b8475c640 1 -- 172.21.15.7:0/2089025157 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b7c068f60 con 0x7f2b7c15f1c0 2024-04-25T09:54:38.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.045+0000 7f2b7affd640 1 -- 172.21.15.7:0/2089025157 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2b74030cd0 con 0x7f2b7c15f1c0 2024-04-25T09:54:38.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.046+0000 7f2b7affd640 1 --2- 172.21.15.7:0/2089025157 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2b6806b4d0 0x7f2b6806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:38.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.046+0000 7f2b7affd640 1 -- 172.21.15.7:0/2089025157 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2b740ab180 con 0x7f2b7c15f1c0 2024-04-25T09:54:38.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.046+0000 7f2b824f8640 1 --2- 172.21.15.7:0/2089025157 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2b6806b4d0 0x7f2b6806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:38.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.046+0000 7f2b824f8640 1 --2- 172.21.15.7:0/2089025157 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2b6806b4d0 0x7f2b6806d990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c0012e0 tx=0x7f2b6c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:38.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.050+0000 7f2b7affd640 1 -- 172.21.15.7:0/2089025157 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2b74079c30 con 0x7f2b7c15f1c0 2024-04-25T09:54:38.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.233+0000 7f2b8475c640 1 -- 172.21.15.7:0/2089025157 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2b7c0ce140 con 0x7f2b7c15f1c0 2024-04-25T09:54:38.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.233+0000 7f2b7affd640 1 -- 172.21.15.7:0/2089025157 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2b74079530 con 0x7f2b7c15f1c0 2024-04-25T09:54:38.236 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T09:54:38.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.236+0000 7f2b8475c640 1 -- 172.21.15.7:0/2089025157 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2b6806b4d0 msgr2=0x7f2b6806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:38.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.236+0000 7f2b8475c640 1 --2- 172.21.15.7:0/2089025157 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2b6806b4d0 0x7f2b6806d990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c0012e0 tx=0x7f2b6c009040 comp rx=0 tx=0).stop 2024-04-25T09:54:38.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.236+0000 7f2b8475c640 1 -- 172.21.15.7:0/2089025157 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b7c15f1c0 msgr2=0x7f2b7c15ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:38.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.236+0000 7f2b8475c640 1 --2- 172.21.15.7:0/2089025157 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b7c15f1c0 0x7f2b7c15ac60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2b740098c0 tx=0x7f2b740046c0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.236+0000 7f2b8475c640 1 -- 172.21.15.7:0/2089025157 shutdown_connections 2024-04-25T09:54:38.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.236+0000 7f2b8475c640 1 --2- 172.21.15.7:0/2089025157 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2b6806b4d0 0x7f2b6806d990 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.236+0000 7f2b8475c640 1 --2- 172.21.15.7:0/2089025157 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b7c15f1c0 0x7f2b7c15ac60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.236+0000 7f2b8475c640 1 --2- 172.21.15.7:0/2089025157 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b7c0d3760 0x7f2b7c0b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.236+0000 7f2b8475c640 1 --2- 172.21.15.7:0/2089025157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b7c0ce830 0x7f2b7c14ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.236+0000 7f2b8475c640 1 -- 172.21.15.7:0/2089025157 >> 172.21.15.7:0/2089025157 conn(0x7f2b7c072680 msgr2=0x7f2b7c0d2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:38.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.236+0000 7f2b8475c640 1 -- 172.21.15.7:0/2089025157 shutdown_connections 2024-04-25T09:54:38.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.236+0000 7f2b8475c640 1 -- 172.21.15.7:0/2089025157 wait complete. 2024-04-25T09:54:38.249 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:54:38.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.350+0000 7fe8a8963640 1 Processor -- start 2024-04-25T09:54:38.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.350+0000 7fe8a8963640 1 -- start start 2024-04-25T09:54:38.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.351+0000 7fe8a8963640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe8a415f1c0 0x7fe8a415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:38.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.351+0000 7fe8a8963640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe8a40ce830 0x7fe8a40b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:38.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.351+0000 7fe8a8963640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a40ced10 con 0x7fe8a40d3760 2024-04-25T09:54:38.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.351+0000 7fe8a8963640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a40ce380 con 0x7fe8a415f1c0 2024-04-25T09:54:38.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.351+0000 7fe8a8963640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a415f000 con 0x7fe8a40ce830 2024-04-25T09:54:38.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.351+0000 7fe8a1d9b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe8a415f1c0 0x7fe8a415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:38.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.351+0000 7fe8a1d9b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe8a415f1c0 0x7fe8a415eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51788/0 (socket says 172.21.15.7:51788) 2024-04-25T09:54:38.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.351+0000 7fe8a1d9b640 1 -- 172.21.15.7:0/147792277 learned_addr learned my addr 172.21.15.7:0/147792277 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:38.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.352+0000 7fe8a2d9d640 1 --2- 172.21.15.7:0/147792277 >> v2:172.21.15.55:3300/0 conn(0x7fe8a40ce830 0x7fe8a40b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:38.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.352+0000 7fe8a1d9b640 1 -- 172.21.15.7:0/147792277 >> v2:172.21.15.55:3300/0 conn(0x7fe8a40ce830 msgr2=0x7fe8a40b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:38.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.352+0000 7fe8a1d9b640 1 --2- 172.21.15.7:0/147792277 >> v2:172.21.15.55:3300/0 conn(0x7fe8a40ce830 0x7fe8a40b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.352+0000 7fe8a1d9b640 1 -- 172.21.15.7:0/147792277 >> v1:172.21.15.55:6789/0 conn(0x7fe8a40d3760 legacy=0x7fe8a40d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:38.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.352+0000 7fe8a1d9b640 1 -- 172.21.15.7:0/147792277 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a40d1b40 con 0x7fe8a415f1c0 2024-04-25T09:54:38.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.352+0000 7fe8a2d9d640 1 --2- 172.21.15.7:0/147792277 >> v2:172.21.15.55:3300/0 conn(0x7fe8a40ce830 0x7fe8a40b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:38.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.352+0000 7fe8a1d9b640 1 --2- 172.21.15.7:0/147792277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8a415f1c0 0x7fe8a415eac0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe8a40cf180 tx=0x7fe88c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d92f8a881f0b6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:38.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.352+0000 7fe8a159a640 1 -- 172.21.15.7:0/147792277 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c037070 con 0x7fe8a415f1c0 2024-04-25T09:54:38.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.353+0000 7fe8a159a640 1 -- 172.21.15.7:0/147792277 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88c032440 con 0x7fe8a415f1c0 2024-04-25T09:54:38.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.353+0000 7fe8a159a640 1 -- 172.21.15.7:0/147792277 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c032810 con 0x7fe8a415f1c0 2024-04-25T09:54:38.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.353+0000 7fe8a8963640 1 -- 172.21.15.7:0/147792277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8a415f1c0 msgr2=0x7fe8a415eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:38.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.353+0000 7fe8a8963640 1 --2- 172.21.15.7:0/147792277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8a415f1c0 0x7fe8a415eac0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe8a40cf180 tx=0x7fe88c02a230 comp rx=0 tx=0).stop 2024-04-25T09:54:38.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.353+0000 7fe8a8963640 1 -- 172.21.15.7:0/147792277 shutdown_connections 2024-04-25T09:54:38.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.353+0000 7fe8a8963640 1 --2- 172.21.15.7:0/147792277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8a415f1c0 0x7fe8a415eac0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.353+0000 7fe8a8963640 1 --2- 172.21.15.7:0/147792277 >> v2:172.21.15.55:3300/0 conn(0x7fe8a40ce830 0x7fe8a40b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.353+0000 7fe8a8963640 1 -- 172.21.15.7:0/147792277 >> 172.21.15.7:0/147792277 conn(0x7fe8a4072680 msgr2=0x7fe8a4072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:38.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.353+0000 7fe8a8963640 1 -- 172.21.15.7:0/147792277 shutdown_connections 2024-04-25T09:54:38.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.353+0000 7fe8a8963640 1 -- 172.21.15.7:0/147792277 wait complete. 2024-04-25T09:54:38.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.354+0000 7fe8a8963640 1 Processor -- start 2024-04-25T09:54:38.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.355+0000 7fe8a8963640 1 -- start start 2024-04-25T09:54:38.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.355+0000 7fe8a8963640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8a40ce830 0x7fe8a40b5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:38.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.355+0000 7fe8a8963640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe8a40d3760 0x7fe8a40b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:38.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.355+0000 7fe8a8963640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8a415f1c0 0x7fe8a40b8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:38.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.355+0000 7fe8a8963640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a415de10 con 0x7fe8a415f1c0 2024-04-25T09:54:38.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.355+0000 7fe8a8963640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a40d2190 con 0x7fe8a40ce830 2024-04-25T09:54:38.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.355+0000 7fe8a8963640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a40b2780 con 0x7fe8a40d3760 2024-04-25T09:54:38.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.355+0000 7fe8a2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8a415f1c0 0x7fe8a40b8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:38.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.355+0000 7fe8a2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8a415f1c0 0x7fe8a40b8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51798/0 (socket says 172.21.15.7:51798) 2024-04-25T09:54:38.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.355+0000 7fe8a2d9d640 1 -- 172.21.15.7:0/3225623710 learned_addr learned my addr 172.21.15.7:0/3225623710 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:38.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.355+0000 7fe8a259c640 1 --2- 172.21.15.7:0/3225623710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8a40ce830 0x7fe8a40b5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:38.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.355+0000 7fe8a1d9b640 1 --2- 172.21.15.7:0/3225623710 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe8a40d3760 0x7fe8a40b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:38.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.356+0000 7fe8a2d9d640 1 -- 172.21.15.7:0/3225623710 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe8a40d3760 msgr2=0x7fe8a40b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:38.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.356+0000 7fe8a2d9d640 1 --2- 172.21.15.7:0/3225623710 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe8a40d3760 0x7fe8a40b37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.356+0000 7fe8a2d9d640 1 -- 172.21.15.7:0/3225623710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8a40ce830 msgr2=0x7fe8a40b5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:38.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.356+0000 7fe8a2d9d640 1 --2- 172.21.15.7:0/3225623710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8a40ce830 0x7fe8a40b5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.356+0000 7fe8a2d9d640 1 -- 172.21.15.7:0/3225623710 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a40b3d00 con 0x7fe8a415f1c0 2024-04-25T09:54:38.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.356+0000 7fe8a2d9d640 1 --2- 172.21.15.7:0/3225623710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8a415f1c0 0x7fe8a40b8560 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe89400cef0 tx=0x7fe89400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:38.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.356+0000 7fe89affd640 1 -- 172.21.15.7:0/3225623710 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89401a070 con 0x7fe8a415f1c0 2024-04-25T09:54:38.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.356+0000 7fe89affd640 1 -- 172.21.15.7:0/3225623710 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89400d860 con 0x7fe8a415f1c0 2024-04-25T09:54:38.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.356+0000 7fe8a8963640 1 -- 172.21.15.7:0/3225623710 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a40b3f80 con 0x7fe8a415f1c0 2024-04-25T09:54:38.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.356+0000 7fe89affd640 1 -- 172.21.15.7:0/3225623710 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89400dc50 con 0x7fe8a415f1c0 2024-04-25T09:54:38.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.356+0000 7fe8a8963640 1 -- 172.21.15.7:0/3225623710 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a40b4540 con 0x7fe8a415f1c0 2024-04-25T09:54:38.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.357+0000 7fe8a8963640 1 -- 172.21.15.7:0/3225623710 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a4068f60 con 0x7fe8a415f1c0 2024-04-25T09:54:38.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.358+0000 7fe89affd640 1 -- 172.21.15.7:0/3225623710 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe89401d070 con 0x7fe8a415f1c0 2024-04-25T09:54:38.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.358+0000 7fe89affd640 1 --2- 172.21.15.7:0/3225623710 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe88406b4d0 0x7fe88406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:38.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.358+0000 7fe89affd640 1 -- 172.21.15.7:0/3225623710 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe89408adb0 con 0x7fe8a415f1c0 2024-04-25T09:54:38.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.358+0000 7fe8a259c640 1 --2- 172.21.15.7:0/3225623710 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe88406b4d0 0x7fe88406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:38.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.358+0000 7fe8a259c640 1 --2- 172.21.15.7:0/3225623710 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe88406b4d0 0x7fe88406d990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe89c004f60 tx=0x7fe89c007e30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:38.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.362+0000 7fe89affd640 1 -- 172.21.15.7:0/3225623710 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe8a40b3d00 con 0x7fe8a415f1c0 2024-04-25T09:54:38.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.539+0000 7fe8a8963640 1 -- 172.21.15.7:0/3225623710 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe8a40ce610 con 0x7fe8a415f1c0 2024-04-25T09:54:38.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.540+0000 7fe89affd640 1 -- 172.21.15.7:0/3225623710 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe894059210 con 0x7fe8a415f1c0 2024-04-25T09:54:38.542 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:54:38.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.541+0000 7fe8a8963640 1 -- 172.21.15.7:0/3225623710 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe88406b4d0 msgr2=0x7fe88406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:38.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.541+0000 7fe8a8963640 1 --2- 172.21.15.7:0/3225623710 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe88406b4d0 0x7fe88406d990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe89c004f60 tx=0x7fe89c007e30 comp rx=0 tx=0).stop 2024-04-25T09:54:38.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.541+0000 7fe8a8963640 1 -- 172.21.15.7:0/3225623710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8a415f1c0 msgr2=0x7fe8a40b8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:38.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.541+0000 7fe8a8963640 1 --2- 172.21.15.7:0/3225623710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8a415f1c0 0x7fe8a40b8560 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe89400cef0 tx=0x7fe89400a710 comp rx=0 tx=0).stop 2024-04-25T09:54:38.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.541+0000 7fe8a8963640 1 -- 172.21.15.7:0/3225623710 shutdown_connections 2024-04-25T09:54:38.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.541+0000 7fe8a8963640 1 --2- 172.21.15.7:0/3225623710 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe88406b4d0 0x7fe88406d990 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.541+0000 7fe8a8963640 1 --2- 172.21.15.7:0/3225623710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8a415f1c0 0x7fe8a40b8560 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.541+0000 7fe8a8963640 1 --2- 172.21.15.7:0/3225623710 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe8a40d3760 0x7fe8a40b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.541+0000 7fe8a8963640 1 --2- 172.21.15.7:0/3225623710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8a40ce830 0x7fe8a40b5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.542+0000 7fe8a8963640 1 -- 172.21.15.7:0/3225623710 >> 172.21.15.7:0/3225623710 conn(0x7fe8a4072680 msgr2=0x7fe8a4072a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:38.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.542+0000 7fe8a8963640 1 -- 172.21.15.7:0/3225623710 shutdown_connections 2024-04-25T09:54:38.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.542+0000 7fe8a8963640 1 -- 172.21.15.7:0/3225623710 wait complete. 2024-04-25T09:54:38.555 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:54:38.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.656+0000 7f3b52510640 1 Processor -- start 2024-04-25T09:54:38.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.656+0000 7f3b52510640 1 -- start start 2024-04-25T09:54:38.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.656+0000 7f3b52510640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3b4c15dc60 0x7f3b4c0cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:38.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.656+0000 7f3b52510640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3b4c0cc760 0x7f3b4c06ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:38.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.656+0000 7f3b52510640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b4c0caf00 con 0x7f3b4c0ce150 2024-04-25T09:54:38.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.656+0000 7f3b52510640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b4c0cb1e0 con 0x7f3b4c15dc60 2024-04-25T09:54:38.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.656+0000 7f3b52510640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b4c0cb4c0 con 0x7f3b4c0cc760 2024-04-25T09:54:38.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.657+0000 7f3b4bfff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3b4c15dc60 0x7f3b4c0cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:38.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.657+0000 7f3b50aad640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3b4c0ce150 0x7f3b4c161650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54848/0 (socket says 172.21.15.7:54848) 2024-04-25T09:54:38.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.657+0000 7f3b50aad640 1 -- 172.21.15.7:0/1258257314 learned_addr learned my addr 172.21.15.7:0/1258257314 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:38.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.657+0000 7f3b4b7fe640 1 --2- 172.21.15.7:0/1258257314 >> v2:172.21.15.55:3300/0 conn(0x7f3b4c0cc760 0x7f3b4c06ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:38.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.657+0000 7f3b4bfff640 1 -- 172.21.15.7:0/1258257314 >> v2:172.21.15.55:3300/0 conn(0x7f3b4c0cc760 msgr2=0x7f3b4c06ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:38.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.657+0000 7f3b4bfff640 1 --2- 172.21.15.7:0/1258257314 >> v2:172.21.15.55:3300/0 conn(0x7f3b4c0cc760 0x7f3b4c06ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.657+0000 7f3b4bfff640 1 -- 172.21.15.7:0/1258257314 >> v1:172.21.15.7:6789/0 conn(0x7f3b4c0ce150 legacy=0x7f3b4c161650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:38.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.657+0000 7f3b4bfff640 1 -- 172.21.15.7:0/1258257314 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4c0cb7a0 con 0x7f3b4c15dc60 2024-04-25T09:54:38.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.657+0000 7f3b4affd640 1 -- 172.21.15.7:0/1258257314 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 283404512 0 0) 0x7f3b4c0caf00 con 0x7f3b4c0ce150 2024-04-25T09:54:38.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.657+0000 7f3b4b7fe640 1 --2- 172.21.15.7:0/1258257314 >> v2:172.21.15.55:3300/0 conn(0x7f3b4c0cc760 0x7f3b4c06ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:38.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.658+0000 7f3b4bfff640 1 --2- 172.21.15.7:0/1258257314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b4c15dc60 0x7f3b4c0cbfa0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c1626f0 tx=0x7f3b3c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1865b7331a59f3d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:38.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.658+0000 7f3b4affd640 1 -- 172.21.15.7:0/1258257314 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c037070 con 0x7f3b4c15dc60 2024-04-25T09:54:38.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.658+0000 7f3b4affd640 1 -- 172.21.15.7:0/1258257314 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3c032440 con 0x7f3b4c15dc60 2024-04-25T09:54:38.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.658+0000 7f3b4affd640 1 -- 172.21.15.7:0/1258257314 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c032810 con 0x7f3b4c15dc60 2024-04-25T09:54:38.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.658+0000 7f3b52510640 1 -- 172.21.15.7:0/1258257314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b4c15dc60 msgr2=0x7f3b4c0cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:38.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.658+0000 7f3b52510640 1 --2- 172.21.15.7:0/1258257314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b4c15dc60 0x7f3b4c0cbfa0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c1626f0 tx=0x7f3b3c02a1a0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.658+0000 7f3b52510640 1 -- 172.21.15.7:0/1258257314 shutdown_connections 2024-04-25T09:54:38.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.658+0000 7f3b52510640 1 --2- 172.21.15.7:0/1258257314 >> v2:172.21.15.55:3300/0 conn(0x7f3b4c0cc760 0x7f3b4c06ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.658+0000 7f3b52510640 1 --2- 172.21.15.7:0/1258257314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b4c15dc60 0x7f3b4c0cbfa0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.658+0000 7f3b52510640 1 -- 172.21.15.7:0/1258257314 >> 172.21.15.7:0/1258257314 conn(0x7f3b4c0725e0 msgr2=0x7f3b4c0999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:38.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.658+0000 7f3b52510640 1 -- 172.21.15.7:0/1258257314 shutdown_connections 2024-04-25T09:54:38.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.658+0000 7f3b52510640 1 -- 172.21.15.7:0/1258257314 wait complete. 2024-04-25T09:54:38.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.660+0000 7f3b52510640 1 Processor -- start 2024-04-25T09:54:38.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.660+0000 7f3b52510640 1 -- start start 2024-04-25T09:54:38.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.660+0000 7f3b52510640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b4c0cc760 0x7f3b4c147540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:38.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.660+0000 7f3b52510640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3b4c0ce150 0x7f3b4c149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:38.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.661+0000 7f3b52510640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b4c15dc60 0x7f3b4c14a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:38.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.661+0000 7f3b52510640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c06b0a0 con 0x7f3b4c0cc760 2024-04-25T09:54:38.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.661+0000 7f3b52510640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c0cabd0 con 0x7f3b4c15dc60 2024-04-25T09:54:38.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.661+0000 7f3b52510640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c06b220 con 0x7f3b4c0ce150 2024-04-25T09:54:38.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.661+0000 7f3b4bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b4c0cc760 0x7f3b4c147540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:38.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.661+0000 7f3b4bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b4c0cc760 0x7f3b4c147540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51820/0 (socket says 172.21.15.7:51820) 2024-04-25T09:54:38.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.661+0000 7f3b4bfff640 1 -- 172.21.15.7:0/2848331912 learned_addr learned my addr 172.21.15.7:0/2848331912 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:38.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.661+0000 7f3b4bfff640 1 -- 172.21.15.7:0/2848331912 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3b4c0ce150 msgr2=0x7f3b4c149d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:38.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.661+0000 7f3b4bfff640 1 --2- 172.21.15.7:0/2848331912 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3b4c0ce150 0x7f3b4c149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.661+0000 7f3b4bfff640 1 -- 172.21.15.7:0/2848331912 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b4c15dc60 msgr2=0x7f3b4c14a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:38.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.661+0000 7f3b4bfff640 1 --2- 172.21.15.7:0/2848331912 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b4c15dc60 0x7f3b4c14a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.661+0000 7f3b4bfff640 1 -- 172.21.15.7:0/2848331912 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4c14a810 con 0x7f3b4c0cc760 2024-04-25T09:54:38.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.661+0000 7f3b4bfff640 1 --2- 172.21.15.7:0/2848331912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b4c0cc760 0x7f3b4c147540 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c000c00 tx=0x7f3b3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:38.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.661+0000 7f3b48ff9640 1 -- 172.21.15.7:0/2848331912 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c037040 con 0x7f3b4c0cc760 2024-04-25T09:54:38.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.661+0000 7f3b48ff9640 1 -- 172.21.15.7:0/2848331912 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3c042070 con 0x7f3b4c0cc760 2024-04-25T09:54:38.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.661+0000 7f3b52510640 1 -- 172.21.15.7:0/2848331912 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b4c0ca210 con 0x7f3b4c0cc760 2024-04-25T09:54:38.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.661+0000 7f3b48ff9640 1 -- 172.21.15.7:0/2848331912 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c030bb0 con 0x7f3b4c0cc760 2024-04-25T09:54:38.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.661+0000 7f3b52510640 1 -- 172.21.15.7:0/2848331912 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b4c0b43f0 con 0x7f3b4c0cc760 2024-04-25T09:54:38.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.662+0000 7f3b52510640 1 -- 172.21.15.7:0/2848331912 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b4c068f60 con 0x7f3b4c0cc760 2024-04-25T09:54:38.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.663+0000 7f3b48ff9640 1 -- 172.21.15.7:0/2848331912 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3b3c047460 con 0x7f3b4c0cc760 2024-04-25T09:54:38.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.663+0000 7f3b48ff9640 1 --2- 172.21.15.7:0/2848331912 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3b3806b4d0 0x7f3b3806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:38.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.663+0000 7f3b48ff9640 1 -- 172.21.15.7:0/2848331912 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f3b3c0ab0c0 con 0x7f3b4c0cc760 2024-04-25T09:54:38.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.663+0000 7f3b4b7fe640 1 --2- 172.21.15.7:0/2848331912 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3b3806b4d0 0x7f3b3806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:38.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.664+0000 7f3b4b7fe640 1 --2- 172.21.15.7:0/2848331912 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3b3806b4d0 0x7f3b3806d990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3b40006fd0 tx=0x7f3b40008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:38.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.667+0000 7f3b48ff9640 1 -- 172.21.15.7:0/2848331912 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3b3c032e20 con 0x7f3b4c0cc760 2024-04-25T09:54:38.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.848+0000 7f3b52510640 1 -- 172.21.15.7:0/2848331912 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3b4c06fc10 con 0x7f3b4c0cc760 2024-04-25T09:54:38.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.848+0000 7f3b48ff9640 1 -- 172.21.15.7:0/2848331912 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3b3c045360 con 0x7f3b4c0cc760 2024-04-25T09:54:38.851 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T09:54:38.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.850+0000 7f3b52510640 1 -- 172.21.15.7:0/2848331912 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3b3806b4d0 msgr2=0x7f3b3806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:38.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.850+0000 7f3b52510640 1 --2- 172.21.15.7:0/2848331912 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3b3806b4d0 0x7f3b3806d990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3b40006fd0 tx=0x7f3b40008040 comp rx=0 tx=0).stop 2024-04-25T09:54:38.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.850+0000 7f3b52510640 1 -- 172.21.15.7:0/2848331912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b4c0cc760 msgr2=0x7f3b4c147540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:38.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.850+0000 7f3b52510640 1 --2- 172.21.15.7:0/2848331912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b4c0cc760 0x7f3b4c147540 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c000c00 tx=0x7f3b3c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.850+0000 7f3b52510640 1 -- 172.21.15.7:0/2848331912 shutdown_connections 2024-04-25T09:54:38.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.850+0000 7f3b52510640 1 --2- 172.21.15.7:0/2848331912 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3b3806b4d0 0x7f3b3806d990 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.850+0000 7f3b52510640 1 --2- 172.21.15.7:0/2848331912 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b4c15dc60 0x7f3b4c14a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.850+0000 7f3b52510640 1 --2- 172.21.15.7:0/2848331912 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3b4c0ce150 0x7f3b4c149d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.850+0000 7f3b52510640 1 --2- 172.21.15.7:0/2848331912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b4c0cc760 0x7f3b4c147540 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.850+0000 7f3b52510640 1 -- 172.21.15.7:0/2848331912 >> 172.21.15.7:0/2848331912 conn(0x7f3b4c0725e0 msgr2=0x7f3b4c0999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:38.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.851+0000 7f3b52510640 1 -- 172.21.15.7:0/2848331912 shutdown_connections 2024-04-25T09:54:38.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.851+0000 7f3b52510640 1 -- 172.21.15.7:0/2848331912 wait complete. 2024-04-25T09:54:38.864 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:54:38.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.965+0000 7fa09312b640 1 Processor -- start 2024-04-25T09:54:38.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.965+0000 7fa09312b640 1 -- start start 2024-04-25T09:54:38.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.966+0000 7fa09312b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa08c0d3760 0x7fa08c15eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:38.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.966+0000 7fa09312b640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa08c0ced10 con 0x7fa08c0ce830 2024-04-25T09:54:38.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.966+0000 7fa09312b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa08c0d1b40 con 0x7fa08c15f1c0 2024-04-25T09:54:38.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.966+0000 7fa09312b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa08c0ce380 con 0x7fa08c0d3760 2024-04-25T09:54:38.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.966+0000 7fa0916c8640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa08c0ce830 0x7fa08c0b2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54862/0 (socket says 172.21.15.7:54862) 2024-04-25T09:54:38.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.966+0000 7fa0916c8640 1 -- 172.21.15.7:0/1681293388 learned_addr learned my addr 172.21.15.7:0/1681293388 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:38.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.966+0000 7fa090ec7640 1 --2- 172.21.15.7:0/1681293388 >> v2:172.21.15.55:3300/0 conn(0x7fa08c0d3760 0x7fa08c15eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:38.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.966+0000 7fa0837fe640 1 -- 172.21.15.7:0/1681293388 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3564163750 0 0) 0x7fa08c0ced10 con 0x7fa08c0ce830 2024-04-25T09:54:38.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.966+0000 7fa0837fe640 1 -- 172.21.15.7:0/1681293388 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa074003520 con 0x7fa08c0ce830 2024-04-25T09:54:38.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.966+0000 7fa0837fe640 1 -- 172.21.15.7:0/1681293388 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 66579358 0 0) 0x7fa08c0d1b40 con 0x7fa08c15f1c0 2024-04-25T09:54:38.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.966+0000 7fa0837fe640 1 -- 172.21.15.7:0/1681293388 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa08c0ced10 con 0x7fa08c15f1c0 2024-04-25T09:54:38.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.966+0000 7fa0837fe640 1 -- 172.21.15.7:0/1681293388 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2289884635 0 0) 0x7fa074003520 con 0x7fa08c0ce830 2024-04-25T09:54:38.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.966+0000 7fa0837fe640 1 -- 172.21.15.7:0/1681293388 >> v2:172.21.15.55:3300/0 conn(0x7fa08c0d3760 msgr2=0x7fa08c15eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:38.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.966+0000 7fa0837fe640 1 --2- 172.21.15.7:0/1681293388 >> v2:172.21.15.55:3300/0 conn(0x7fa08c0d3760 0x7fa08c15eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.966+0000 7fa0837fe640 1 -- 172.21.15.7:0/1681293388 >> v1:172.21.15.55:6789/0 conn(0x7fa08c15f1c0 legacy=0x7fa08c0d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:38.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.966+0000 7fa0837fe640 1 -- 172.21.15.7:0/1681293388 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08c0d1e20 con 0x7fa08c0ce830 2024-04-25T09:54:38.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.966+0000 7fa090ec7640 1 --2- 172.21.15.7:0/1681293388 >> v2:172.21.15.55:3300/0 conn(0x7fa08c0d3760 0x7fa08c15eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:54:38.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.966+0000 7fa0837fe640 1 -- 172.21.15.7:0/1681293388 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fa0840019f0 con 0x7fa08c0ce830 2024-04-25T09:54:38.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.967+0000 7fa0837fe640 1 -- 172.21.15.7:0/1681293388 >> v1:172.21.15.7:6789/0 conn(0x7fa08c0ce830 legacy=0x7fa08c0b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:38.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.967+0000 7fa0837fe640 1 --2- 172.21.15.7:0/1681293388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa074003b40 0x7fa074003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:38.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.967+0000 7fa0837fe640 1 --2- 172.21.15.7:0/1681293388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa074004800 0x7fa074004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:38.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.967+0000 7fa0837fe640 1 --2- 172.21.15.7:0/1681293388 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0740051c0 0x7fa07400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:38.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.967+0000 7fa0837fe640 1 -- 172.21.15.7:0/1681293388 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07400c010 con 0x7fa074003b40 2024-04-25T09:54:38.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.967+0000 7fa0837fe640 1 -- 172.21.15.7:0/1681293388 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07400c1c0 con 0x7fa074004800 2024-04-25T09:54:38.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.967+0000 7fa0837fe640 1 -- 172.21.15.7:0/1681293388 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07400c3c0 con 0x7fa0740051c0 2024-04-25T09:54:38.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.967+0000 7fa090ec7640 1 --2- 172.21.15.7:0/1681293388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa074003b40 0x7fa074003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:38.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.967+0000 7fa083fff640 1 --2- 172.21.15.7:0/1681293388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa074004800 0x7fa074004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:38.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.967+0000 7fa0916c8640 1 --2- 172.21.15.7:0/1681293388 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0740051c0 0x7fa07400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:38.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.967+0000 7fa090ec7640 1 -- 172.21.15.7:0/1681293388 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0740051c0 msgr2=0x7fa07400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:38.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.967+0000 7fa090ec7640 1 --2- 172.21.15.7:0/1681293388 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0740051c0 0x7fa07400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.967+0000 7fa090ec7640 1 -- 172.21.15.7:0/1681293388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa074004800 msgr2=0x7fa074004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:38.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.967+0000 7fa090ec7640 1 --2- 172.21.15.7:0/1681293388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa074004800 0x7fa074004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.967+0000 7fa090ec7640 1 -- 172.21.15.7:0/1681293388 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa074003520 con 0x7fa074003b40 2024-04-25T09:54:38.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.967+0000 7fa0916c8640 1 --2- 172.21.15.7:0/1681293388 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0740051c0 0x7fa07400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:38.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.967+0000 7fa0916c8640 1 -- 172.21.15.7:0/1681293388 reap_dead start 2024-04-25T09:54:38.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.968+0000 7fa090ec7640 1 --2- 172.21.15.7:0/1681293388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa074003b40 0x7fa074003f40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa088009c90 tx=0x7fa074005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc60bc02942f025a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:38.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.968+0000 7fa0837fe640 1 -- 172.21.15.7:0/1681293388 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa088036070 con 0x7fa074003b40 2024-04-25T09:54:38.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.968+0000 7fa0837fe640 1 -- 172.21.15.7:0/1681293388 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa088031400 con 0x7fa074003b40 2024-04-25T09:54:38.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.968+0000 7fa0837fe640 1 -- 172.21.15.7:0/1681293388 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa088009860 con 0x7fa074003b40 2024-04-25T09:54:38.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.968+0000 7fa09312b640 1 -- 172.21.15.7:0/1681293388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa074003b40 msgr2=0x7fa074003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:38.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.968+0000 7fa09312b640 1 --2- 172.21.15.7:0/1681293388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa074003b40 0x7fa074003f40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa088009c90 tx=0x7fa074005830 comp rx=0 tx=0).stop 2024-04-25T09:54:38.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.968+0000 7fa09312b640 1 -- 172.21.15.7:0/1681293388 shutdown_connections 2024-04-25T09:54:38.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.968+0000 7fa09312b640 1 --2- 172.21.15.7:0/1681293388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa074003b40 0x7fa074003f40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.968+0000 7fa09312b640 1 -- 172.21.15.7:0/1681293388 >> 172.21.15.7:0/1681293388 conn(0x7fa08c072680 msgr2=0x7fa08c072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:38.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.968+0000 7fa09312b640 1 -- 172.21.15.7:0/1681293388 shutdown_connections 2024-04-25T09:54:38.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.968+0000 7fa09312b640 1 -- 172.21.15.7:0/1681293388 wait complete. 2024-04-25T09:54:38.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.970+0000 7fa09312b640 1 Processor -- start 2024-04-25T09:54:38.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.970+0000 7fa09312b640 1 -- start start 2024-04-25T09:54:38.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.970+0000 7fa09312b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa074003b40 0x7fa08c0cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:38.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.970+0000 7fa09312b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa08c1f3f70 0x7fa08c159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:38.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.970+0000 7fa09312b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa08c0c92f0 0x7fa08c0c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:38.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.970+0000 7fa09312b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c15eac0 con 0x7fa08c0c92f0 2024-04-25T09:54:38.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.970+0000 7fa09312b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c0d2190 con 0x7fa08c1f3f70 2024-04-25T09:54:38.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.970+0000 7fa09312b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c15ec40 con 0x7fa074003b40 2024-04-25T09:54:38.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.971+0000 7fa0916c8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa08c0c92f0 0x7fa08c0c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:38.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.971+0000 7fa0916c8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa08c0c92f0 0x7fa08c0c9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51836/0 (socket says 172.21.15.7:51836) 2024-04-25T09:54:38.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.971+0000 7fa0916c8640 1 -- 172.21.15.7:0/593637437 learned_addr learned my addr 172.21.15.7:0/593637437 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:38.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.971+0000 7fa083fff640 1 --2- 172.21.15.7:0/593637437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa08c1f3f70 0x7fa08c159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:38.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.971+0000 7fa090ec7640 1 --2- 172.21.15.7:0/593637437 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa074003b40 0x7fa08c0cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:38.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.971+0000 7fa0916c8640 1 -- 172.21.15.7:0/593637437 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa074003b40 msgr2=0x7fa08c0cb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:38.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.971+0000 7fa0916c8640 1 --2- 172.21.15.7:0/593637437 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa074003b40 0x7fa08c0cb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.971+0000 7fa0916c8640 1 -- 172.21.15.7:0/593637437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa08c1f3f70 msgr2=0x7fa08c159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:38.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.971+0000 7fa0916c8640 1 --2- 172.21.15.7:0/593637437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa08c1f3f70 0x7fa08c159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:38.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.971+0000 7fa0916c8640 1 -- 172.21.15.7:0/593637437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08c1f43f0 con 0x7fa08c0c92f0 2024-04-25T09:54:38.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.971+0000 7fa0916c8640 1 --2- 172.21.15.7:0/593637437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa08c0c92f0 0x7fa08c0c9780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa084001370 tx=0x7fa084007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:38.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.971+0000 7fa0817fa640 1 -- 172.21.15.7:0/593637437 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08400e9c0 con 0x7fa08c0c92f0 2024-04-25T09:54:38.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.971+0000 7fa0817fa640 1 -- 172.21.15.7:0/593637437 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa084018070 con 0x7fa08c0c92f0 2024-04-25T09:54:38.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.971+0000 7fa09312b640 1 -- 172.21.15.7:0/593637437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa08c0cc020 con 0x7fa08c0c92f0 2024-04-25T09:54:38.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.971+0000 7fa0817fa640 1 -- 172.21.15.7:0/593637437 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08400ed80 con 0x7fa08c0c92f0 2024-04-25T09:54:38.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.971+0000 7fa09312b640 1 -- 172.21.15.7:0/593637437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa08c0cc5e0 con 0x7fa08c0c92f0 2024-04-25T09:54:38.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.972+0000 7fa09312b640 1 -- 172.21.15.7:0/593637437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa08c068f60 con 0x7fa08c0c92f0 2024-04-25T09:54:38.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.973+0000 7fa0817fa640 1 -- 172.21.15.7:0/593637437 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa08401d460 con 0x7fa08c0c92f0 2024-04-25T09:54:38.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.973+0000 7fa0817fa640 1 --2- 172.21.15.7:0/593637437 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa07806b4d0 0x7fa07806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:38.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.973+0000 7fa0817fa640 1 -- 172.21.15.7:0/593637437 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa08408a5d0 con 0x7fa08c0c92f0 2024-04-25T09:54:38.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.973+0000 7fa090ec7640 1 --2- 172.21.15.7:0/593637437 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa07806b4d0 0x7fa07806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:38.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.974+0000 7fa090ec7640 1 --2- 172.21.15.7:0/593637437 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa07806b4d0 0x7fa07806d990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa088033000 tx=0x7fa088008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:38.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:38.977+0000 7fa0817fa640 1 -- 172.21.15.7:0/593637437 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa084059100 con 0x7fa08c0c92f0 2024-04-25T09:54:39.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.155+0000 7fa09312b640 1 -- 172.21.15.7:0/593637437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa08c0ce610 con 0x7fa08c0c92f0 2024-04-25T09:54:39.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.156+0000 7fa0817fa640 1 -- 172.21.15.7:0/593637437 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa084058a00 con 0x7fa08c0c92f0 2024-04-25T09:54:39.158 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:54:39.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.157+0000 7fa09312b640 1 -- 172.21.15.7:0/593637437 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa07806b4d0 msgr2=0x7fa07806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:39.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.157+0000 7fa09312b640 1 --2- 172.21.15.7:0/593637437 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa07806b4d0 0x7fa07806d990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa088033000 tx=0x7fa088008030 comp rx=0 tx=0).stop 2024-04-25T09:54:39.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.157+0000 7fa09312b640 1 -- 172.21.15.7:0/593637437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa08c0c92f0 msgr2=0x7fa08c0c9780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:39.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.157+0000 7fa09312b640 1 --2- 172.21.15.7:0/593637437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa08c0c92f0 0x7fa08c0c9780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa084001370 tx=0x7fa084007b00 comp rx=0 tx=0).stop 2024-04-25T09:54:39.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.158+0000 7fa09312b640 1 -- 172.21.15.7:0/593637437 shutdown_connections 2024-04-25T09:54:39.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.158+0000 7fa09312b640 1 --2- 172.21.15.7:0/593637437 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa07806b4d0 0x7fa07806d990 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.158+0000 7fa09312b640 1 --2- 172.21.15.7:0/593637437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa08c0c92f0 0x7fa08c0c9780 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.158+0000 7fa09312b640 1 --2- 172.21.15.7:0/593637437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa08c1f3f70 0x7fa08c159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.158+0000 7fa09312b640 1 --2- 172.21.15.7:0/593637437 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa074003b40 0x7fa08c0cb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.158+0000 7fa09312b640 1 -- 172.21.15.7:0/593637437 >> 172.21.15.7:0/593637437 conn(0x7fa08c072680 msgr2=0x7fa08c0b7080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:39.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.158+0000 7fa09312b640 1 -- 172.21.15.7:0/593637437 shutdown_connections 2024-04-25T09:54:39.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.158+0000 7fa09312b640 1 -- 172.21.15.7:0/593637437 wait complete. 2024-04-25T09:54:39.172 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:54:39.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.271+0000 7febf21f5640 1 Processor -- start 2024-04-25T09:54:39.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.271+0000 7febf21f5640 1 -- start start 2024-04-25T09:54:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.272+0000 7febf21f5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7febec0d0a50 0x7febec0d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.272+0000 7febf21f5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7febec0b53b0 0x7febec0d2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.272+0000 7febf21f5640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febec0d1e80 con 0x7febec15db00 2024-04-25T09:54:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.272+0000 7febf21f5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febec0b5930 con 0x7febec0b53b0 2024-04-25T09:54:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.272+0000 7febf21f5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febec0b5c10 con 0x7febec0d0a50 2024-04-25T09:54:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.272+0000 7febeb7fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7febec15db00 0x7febec0d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54878/0 (socket says 172.21.15.7:54878) 2024-04-25T09:54:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.272+0000 7febeb7fe640 1 -- 172.21.15.7:0/2512000383 learned_addr learned my addr 172.21.15.7:0/2512000383 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.272+0000 7febea7fc640 1 -- 172.21.15.7:0/2512000383 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 914664046 0 0) 0x7febec0d1e80 con 0x7febec15db00 2024-04-25T09:54:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.272+0000 7febebfff640 1 --2- 172.21.15.7:0/2512000383 >> v2:172.21.15.55:3300/0 conn(0x7febec0b53b0 0x7febec0d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.272+0000 7febea7fc640 1 -- 172.21.15.7:0/2512000383 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febd4003520 con 0x7febec15db00 2024-04-25T09:54:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.272+0000 7febeaffd640 1 --2- 172.21.15.7:0/2512000383 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7febec0d0a50 0x7febec0d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.273+0000 7febea7fc640 1 -- 172.21.15.7:0/2512000383 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1065348786 0 0) 0x7febd4003520 con 0x7febec15db00 2024-04-25T09:54:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.273+0000 7febea7fc640 1 -- 172.21.15.7:0/2512000383 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7febec0d0a50 msgr2=0x7febec0d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.273+0000 7febea7fc640 1 --2- 172.21.15.7:0/2512000383 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7febec0d0a50 0x7febec0d2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.273+0000 7febea7fc640 1 -- 172.21.15.7:0/2512000383 >> v2:172.21.15.55:3300/0 conn(0x7febec0b53b0 msgr2=0x7febec0d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.273+0000 7febea7fc640 1 --2- 172.21.15.7:0/2512000383 >> v2:172.21.15.55:3300/0 conn(0x7febec0b53b0 0x7febec0d2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.273+0000 7febea7fc640 1 -- 172.21.15.7:0/2512000383 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec0b5ef0 con 0x7febec15db00 2024-04-25T09:54:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.273+0000 7febea7fc640 1 -- 172.21.15.7:0/2512000383 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7febdc001670 con 0x7febec15db00 2024-04-25T09:54:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.273+0000 7febea7fc640 1 -- 172.21.15.7:0/2512000383 >> v1:172.21.15.7:6789/0 conn(0x7febec15db00 legacy=0x7febec0d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.273+0000 7febea7fc640 1 --2- 172.21.15.7:0/2512000383 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febd40039b0 0x7febd4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.273+0000 7febea7fc640 1 --2- 172.21.15.7:0/2512000383 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7febec0d0a50 0x7febd4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.273+0000 7febea7fc640 1 --2- 172.21.15.7:0/2512000383 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febd4004d40 0x7febd40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.273+0000 7febea7fc640 1 -- 172.21.15.7:0/2512000383 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec0b5930 con 0x7febd40039b0 2024-04-25T09:54:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.273+0000 7febea7fc640 1 -- 172.21.15.7:0/2512000383 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec0b5c10 con 0x7febd4004d40 2024-04-25T09:54:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.273+0000 7febea7fc640 1 -- 172.21.15.7:0/2512000383 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd400b9c0 con 0x7febec0d0a50 2024-04-25T09:54:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.273+0000 7febeb7fe640 1 --2- 172.21.15.7:0/2512000383 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febd40039b0 0x7febd4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.273+0000 7febeaffd640 1 --2- 172.21.15.7:0/2512000383 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7febec0d0a50 0x7febd4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.273+0000 7febebfff640 1 --2- 172.21.15.7:0/2512000383 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febd4004d40 0x7febd40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.273+0000 7febeb7fe640 1 -- 172.21.15.7:0/2512000383 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7febec0d0a50 msgr2=0x7febd4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.273+0000 7febeb7fe640 1 --2- 172.21.15.7:0/2512000383 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7febec0d0a50 0x7febd4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.273+0000 7febeb7fe640 1 -- 172.21.15.7:0/2512000383 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febd4004d40 msgr2=0x7febd40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:39.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.273+0000 7febeb7fe640 1 --2- 172.21.15.7:0/2512000383 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febd4004d40 0x7febd40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.273+0000 7febeb7fe640 1 -- 172.21.15.7:0/2512000383 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd4003520 con 0x7febd40039b0 2024-04-25T09:54:39.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.274+0000 7febeb7fe640 1 --2- 172.21.15.7:0/2512000383 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febd40039b0 0x7febd4003dd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7febdc001050 tx=0x7febd4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cebd6a56b02e650e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:39.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.274+0000 7febea7fc640 1 -- 172.21.15.7:0/2512000383 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc02e070 con 0x7febd40039b0 2024-04-25T09:54:39.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.274+0000 7febea7fc640 1 -- 172.21.15.7:0/2512000383 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febdc005af0 con 0x7febd40039b0 2024-04-25T09:54:39.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.274+0000 7febea7fc640 1 -- 172.21.15.7:0/2512000383 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc007d70 con 0x7febd40039b0 2024-04-25T09:54:39.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.275+0000 7febf21f5640 1 -- 172.21.15.7:0/2512000383 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febd40039b0 msgr2=0x7febd4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:39.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.275+0000 7febf21f5640 1 --2- 172.21.15.7:0/2512000383 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febd40039b0 0x7febd4003dd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7febdc001050 tx=0x7febd4005830 comp rx=0 tx=0).stop 2024-04-25T09:54:39.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.275+0000 7febebfff640 1 -- 172.21.15.7:0/2512000383 reap_dead start 2024-04-25T09:54:39.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.275+0000 7febf21f5640 1 -- 172.21.15.7:0/2512000383 shutdown_connections 2024-04-25T09:54:39.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.275+0000 7febf21f5640 1 -- 172.21.15.7:0/2512000383 >> 172.21.15.7:0/2512000383 conn(0x7febec072290 msgr2=0x7febec0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:39.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.275+0000 7febf21f5640 1 -- 172.21.15.7:0/2512000383 shutdown_connections 2024-04-25T09:54:39.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.275+0000 7febf21f5640 1 -- 172.21.15.7:0/2512000383 wait complete. 2024-04-25T09:54:39.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.276+0000 7febf21f5640 1 Processor -- start 2024-04-25T09:54:39.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.276+0000 7febf21f5640 1 -- start start 2024-04-25T09:54:39.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.277+0000 7febf21f5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febd40039b0 0x7febec152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:39.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.277+0000 7febf21f5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7febec160100 0x7febec160560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:39.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.277+0000 7febf21f5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febec0cc810 0x7febec0ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:39.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.277+0000 7febf21f5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec0d3660 con 0x7febd40039b0 2024-04-25T09:54:39.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.277+0000 7febf21f5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec0b61d0 con 0x7febec0cc810 2024-04-25T09:54:39.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.277+0000 7febf21f5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febec0ce2b0 con 0x7febec160100 2024-04-25T09:54:39.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.277+0000 7febeb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febd40039b0 0x7febec152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:39.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.277+0000 7febeb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febd40039b0 0x7febec152d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51860/0 (socket says 172.21.15.7:51860) 2024-04-25T09:54:39.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.277+0000 7febeb7fe640 1 -- 172.21.15.7:0/2517467935 learned_addr learned my addr 172.21.15.7:0/2517467935 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:39.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.277+0000 7febeb7fe640 1 -- 172.21.15.7:0/2517467935 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7febec160100 msgr2=0x7febec160560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:39.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.277+0000 7febeb7fe640 1 --2- 172.21.15.7:0/2517467935 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7febec160100 0x7febec160560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.277+0000 7febeb7fe640 1 -- 172.21.15.7:0/2517467935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febec0cc810 msgr2=0x7febec0ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:39.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.277+0000 7febebfff640 1 --2- 172.21.15.7:0/2517467935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febec0cc810 0x7febec0ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:39.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.277+0000 7febeb7fe640 1 --2- 172.21.15.7:0/2517467935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febec0cc810 0x7febec0ccc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.277+0000 7febeb7fe640 1 -- 172.21.15.7:0/2517467935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec0cd4d0 con 0x7febd40039b0 2024-04-25T09:54:39.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.277+0000 7febeb7fe640 1 --2- 172.21.15.7:0/2517467935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febd40039b0 0x7febec152d30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7febdc02ae30 tx=0x7febdc000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:39.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.278+0000 7febd3fff640 1 -- 172.21.15.7:0/2517467935 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc042070 con 0x7febd40039b0 2024-04-25T09:54:39.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.278+0000 7febd3fff640 1 -- 172.21.15.7:0/2517467935 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febdc007480 con 0x7febd40039b0 2024-04-25T09:54:39.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.278+0000 7febf21f5640 1 -- 172.21.15.7:0/2517467935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febec0cd7b0 con 0x7febd40039b0 2024-04-25T09:54:39.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.278+0000 7febd3fff640 1 -- 172.21.15.7:0/2517467935 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc007d50 con 0x7febd40039b0 2024-04-25T09:54:39.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.278+0000 7febf21f5640 1 -- 172.21.15.7:0/2517467935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febec159d70 con 0x7febd40039b0 2024-04-25T09:54:39.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.279+0000 7febf21f5640 1 -- 172.21.15.7:0/2517467935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febec068fd0 con 0x7febd40039b0 2024-04-25T09:54:39.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.279+0000 7febd3fff640 1 -- 172.21.15.7:0/2517467935 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7febdc045070 con 0x7febd40039b0 2024-04-25T09:54:39.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.280+0000 7febd3fff640 1 --2- 172.21.15.7:0/2517467935 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7febd806b4d0 0x7febd806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:39.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.280+0000 7febd3fff640 1 -- 172.21.15.7:0/2517467935 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7febdc0ab010 con 0x7febd40039b0 2024-04-25T09:54:39.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.280+0000 7febeaffd640 1 --2- 172.21.15.7:0/2517467935 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7febd806b4d0 0x7febd806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:39.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.280+0000 7febeaffd640 1 --2- 172.21.15.7:0/2517467935 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7febd806b4d0 0x7febd806d990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7febec159780 tx=0x7febe00095d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:39.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.284+0000 7febd3fff640 1 -- 172.21.15.7:0/2517467935 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7febdc005ac0 con 0x7febd40039b0 2024-04-25T09:54:39.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.476+0000 7febf21f5640 1 -- 172.21.15.7:0/2517467935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7febec0d16b0 con 0x7febd40039b0 2024-04-25T09:54:39.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.477+0000 7febd3fff640 1 -- 172.21.15.7:0/2517467935 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7febdc079ab0 con 0x7febd40039b0 2024-04-25T09:54:39.479 INFO:teuthology.orchestra.run.smithi007.stderr:listed 0 entries 2024-04-25T09:54:39.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.479+0000 7febf21f5640 1 -- 172.21.15.7:0/2517467935 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7febd806b4d0 msgr2=0x7febd806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:39.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.479+0000 7febf21f5640 1 --2- 172.21.15.7:0/2517467935 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7febd806b4d0 0x7febd806d990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7febec159780 tx=0x7febe00095d0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.479+0000 7febf21f5640 1 -- 172.21.15.7:0/2517467935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febd40039b0 msgr2=0x7febec152d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:39.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.479+0000 7febf21f5640 1 --2- 172.21.15.7:0/2517467935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febd40039b0 0x7febec152d30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7febdc02ae30 tx=0x7febdc000fe0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.479+0000 7febf21f5640 1 -- 172.21.15.7:0/2517467935 shutdown_connections 2024-04-25T09:54:39.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.479+0000 7febf21f5640 1 --2- 172.21.15.7:0/2517467935 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7febd806b4d0 0x7febd806d990 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.479+0000 7febf21f5640 1 --2- 172.21.15.7:0/2517467935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febec0cc810 0x7febec0ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.479+0000 7febf21f5640 1 --2- 172.21.15.7:0/2517467935 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7febec160100 0x7febec160560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.479+0000 7febf21f5640 1 --2- 172.21.15.7:0/2517467935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febd40039b0 0x7febec152d30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.479+0000 7febf21f5640 1 -- 172.21.15.7:0/2517467935 >> 172.21.15.7:0/2517467935 conn(0x7febec072290 msgr2=0x7febec153e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:39.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.479+0000 7febf21f5640 1 -- 172.21.15.7:0/2517467935 shutdown_connections 2024-04-25T09:54:39.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.479+0000 7febf21f5640 1 -- 172.21.15.7:0/2517467935 wait complete. 2024-04-25T09:54:39.492 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:54:39.492 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:54:39.508 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:54:39.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.646+0000 7fd22485d640 1 Processor -- start 2024-04-25T09:54:39.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.646+0000 7fd22485d640 1 -- start start 2024-04-25T09:54:39.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.647+0000 7fd22485d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd2200b5e60 0x7fd22006bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:39.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.647+0000 7fd22485d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2200b6a40 0x7fd22006c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:39.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.647+0000 7fd22485d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd22006ca30 con 0x7fd22015dd00 2024-04-25T09:54:39.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.647+0000 7fd22485d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd22015e0e0 con 0x7fd2200b5e60 2024-04-25T09:54:39.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.647+0000 7fd22485d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22006cfe0 con 0x7fd2200b6a40 2024-04-25T09:54:39.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.647+0000 7fd21ed9d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2200b6a40 0x7fd22006c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:39.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.647+0000 7fd21dd9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd2200b5e60 0x7fd22006bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:39.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.647+0000 7fd21e59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd22015dd00 0x7fd2200b5750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:55296/0 (socket says 172.21.15.7:55296) 2024-04-25T09:54:39.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.647+0000 7fd21dd9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd2200b5e60 0x7fd22006bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:43182/0 (socket says 172.21.15.7:43182) 2024-04-25T09:54:39.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.647+0000 7fd21ed9d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2200b6a40 0x7fd22006c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:39114/0 (socket says 172.21.15.7:39114) 2024-04-25T09:54:39.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.647+0000 7fd21e59c640 1 -- 172.21.15.7:0/2355916131 learned_addr learned my addr 172.21.15.7:0/2355916131 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:39.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.648+0000 7fd21dd9b640 1 -- 172.21.15.7:0/2355916131 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2200b6a40 msgr2=0x7fd22006c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:39.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.648+0000 7fd21dd9b640 1 --2- 172.21.15.7:0/2355916131 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2200b6a40 0x7fd22006c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.648+0000 7fd21dd9b640 1 -- 172.21.15.7:0/2355916131 >> v1:172.21.15.55:6789/0 conn(0x7fd22015dd00 legacy=0x7fd2200b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:39.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.648+0000 7fd21dd9b640 1 -- 172.21.15.7:0/2355916131 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22006cd00 con 0x7fd2200b5e60 2024-04-25T09:54:39.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.648+0000 7fd21ed9d640 1 --2- 172.21.15.7:0/2355916131 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2200b6a40 0x7fd22006c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:54:39.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.648+0000 7fd21dd9b640 1 --2- 172.21.15.7:0/2355916131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2200b5e60 0x7fd22006bfb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd2140097a0 tx=0x7fd21402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b36c758e5d8884b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:39.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.649+0000 7fd21d59a640 1 -- 172.21.15.7:0/2355916131 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd214037070 con 0x7fd2200b5e60 2024-04-25T09:54:39.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.649+0000 7fd21d59a640 1 -- 172.21.15.7:0/2355916131 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd214032440 con 0x7fd2200b5e60 2024-04-25T09:54:39.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.649+0000 7fd21d59a640 1 -- 172.21.15.7:0/2355916131 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd214032810 con 0x7fd2200b5e60 2024-04-25T09:54:39.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.649+0000 7fd22485d640 1 -- 172.21.15.7:0/2355916131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2200b5e60 msgr2=0x7fd22006bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:39.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.649+0000 7fd22485d640 1 --2- 172.21.15.7:0/2355916131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2200b5e60 0x7fd22006bfb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd2140097a0 tx=0x7fd21402a210 comp rx=0 tx=0).stop 2024-04-25T09:54:39.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.649+0000 7fd22485d640 1 -- 172.21.15.7:0/2355916131 shutdown_connections 2024-04-25T09:54:39.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.649+0000 7fd22485d640 1 --2- 172.21.15.7:0/2355916131 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2200b6a40 0x7fd22006c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.649+0000 7fd22485d640 1 --2- 172.21.15.7:0/2355916131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2200b5e60 0x7fd22006bfb0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.649+0000 7fd22485d640 1 -- 172.21.15.7:0/2355916131 >> 172.21.15.7:0/2355916131 conn(0x7fd2200d07b0 msgr2=0x7fd2200d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:39.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.649+0000 7fd22485d640 1 -- 172.21.15.7:0/2355916131 shutdown_connections 2024-04-25T09:54:39.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.649+0000 7fd22485d640 1 -- 172.21.15.7:0/2355916131 wait complete. 2024-04-25T09:54:39.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.651+0000 7fd22485d640 1 Processor -- start 2024-04-25T09:54:39.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.651+0000 7fd22485d640 1 -- start start 2024-04-25T09:54:39.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.652+0000 7fd22485d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2200b5e60 0x7fd220152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:39.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.652+0000 7fd22485d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2200b6a40 0x7fd22014cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:39.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.652+0000 7fd22485d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd22015dd00 0x7fd22014d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:39.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.652+0000 7fd22485d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2200d2260 con 0x7fd2200b5e60 2024-04-25T09:54:39.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.652+0000 7fd22485d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2200d1f80 con 0x7fd2200b6a40 2024-04-25T09:54:39.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.652+0000 7fd22485d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2200d2780 con 0x7fd22015dd00 2024-04-25T09:54:39.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.652+0000 7fd21e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2200b5e60 0x7fd220152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:39.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.652+0000 7fd21e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2200b5e60 0x7fd220152e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51870/0 (socket says 172.21.15.7:51870) 2024-04-25T09:54:39.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.652+0000 7fd21e59c640 1 -- 172.21.15.7:0/4116881997 learned_addr learned my addr 172.21.15.7:0/4116881997 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:39.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.652+0000 7fd21dd9b640 1 --2- 172.21.15.7:0/4116881997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2200b6a40 0x7fd22014cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:39.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.652+0000 7fd21ed9d640 1 --2- 172.21.15.7:0/4116881997 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd22015dd00 0x7fd22014d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:39.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.652+0000 7fd21dd9b640 1 -- 172.21.15.7:0/4116881997 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd22015dd00 msgr2=0x7fd22014d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:39.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.652+0000 7fd21dd9b640 1 --2- 172.21.15.7:0/4116881997 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd22015dd00 0x7fd22014d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.652+0000 7fd21dd9b640 1 -- 172.21.15.7:0/4116881997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2200b5e60 msgr2=0x7fd220152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:39.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.652+0000 7fd21dd9b640 1 --2- 172.21.15.7:0/4116881997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2200b5e60 0x7fd220152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.652+0000 7fd21dd9b640 1 -- 172.21.15.7:0/4116881997 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2201547f0 con 0x7fd2200b6a40 2024-04-25T09:54:39.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.652+0000 7fd21e59c640 1 --2- 172.21.15.7:0/4116881997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2200b5e60 0x7fd220152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:54:39.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.652+0000 7fd21dd9b640 1 --2- 172.21.15.7:0/4116881997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2200b6a40 0x7fd22014cef0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd214031000 tx=0x7fd2140046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.652+0000 7fd20effd640 1 -- 172.21.15.7:0/4116881997 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd214041030 con 0x7fd2200b6a40 2024-04-25T09:54:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.653+0000 7fd20effd640 1 -- 172.21.15.7:0/4116881997 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd214030440 con 0x7fd2200b6a40 2024-04-25T09:54:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.653+0000 7fd22485d640 1 -- 172.21.15.7:0/4116881997 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd220156500 con 0x7fd2200b6a40 2024-04-25T09:54:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.653+0000 7fd20effd640 1 -- 172.21.15.7:0/4116881997 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd214037040 con 0x7fd2200b6a40 2024-04-25T09:54:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.653+0000 7fd22485d640 1 -- 172.21.15.7:0/4116881997 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd220156a80 con 0x7fd2200b6a40 2024-04-25T09:54:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.653+0000 7fd22485d640 1 -- 172.21.15.7:0/4116881997 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd220068fd0 con 0x7fd2200b6a40 2024-04-25T09:54:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.654+0000 7fd20effd640 1 -- 172.21.15.7:0/4116881997 <== mon.1 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd214044070 con 0x7fd2200b6a40 2024-04-25T09:54:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.655+0000 7fd20effd640 1 --2- 172.21.15.7:0/4116881997 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd20006b4d0 0x7fd20006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.655+0000 7fd20effd640 1 -- 172.21.15.7:0/4116881997 <== mon.1 v2:172.21.15.55:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd2140aa6a0 con 0x7fd2200b6a40 2024-04-25T09:54:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.655+0000 7fd21e59c640 1 --2- 172.21.15.7:0/4116881997 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd20006b4d0 0x7fd20006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.655+0000 7fd21e59c640 1 --2- 172.21.15.7:0/4116881997 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd20006b4d0 0x7fd20006d990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd210007060 tx=0x7fd210001a20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:39.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.660+0000 7fd20effd640 1 -- 172.21.15.7:0/4116881997 <== mon.1 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd2201547f0 con 0x7fd2200b6a40 2024-04-25T09:54:39.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.840+0000 7fd22485d640 1 -- 172.21.15.7:0/4116881997 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2200d1620 con 0x7fd2200b6a40 2024-04-25T09:54:39.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.841+0000 7fd20effd640 1 -- 172.21.15.7:0/4116881997 <== mon.1 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18418 (secure 0 0 0) 0x7fd214079150 con 0x7fd2200b6a40 2024-04-25T09:54:39.844 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:39.844 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:54:32.606761+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:54:26.011833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:54:26.535536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:54:30.264996+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:54:39.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.843+0000 7fd22485d640 1 -- 172.21.15.7:0/4116881997 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd20006b4d0 msgr2=0x7fd20006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:39.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.843+0000 7fd22485d640 1 --2- 172.21.15.7:0/4116881997 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd20006b4d0 0x7fd20006d990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd210007060 tx=0x7fd210001a20 comp rx=0 tx=0).stop 2024-04-25T09:54:39.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.843+0000 7fd22485d640 1 -- 172.21.15.7:0/4116881997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2200b6a40 msgr2=0x7fd22014cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:39.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.843+0000 7fd22485d640 1 --2- 172.21.15.7:0/4116881997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2200b6a40 0x7fd22014cef0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd214031000 tx=0x7fd2140046c0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.844+0000 7fd22485d640 1 -- 172.21.15.7:0/4116881997 shutdown_connections 2024-04-25T09:54:39.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.844+0000 7fd22485d640 1 --2- 172.21.15.7:0/4116881997 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd20006b4d0 0x7fd20006d990 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.844+0000 7fd22485d640 1 --2- 172.21.15.7:0/4116881997 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd22015dd00 0x7fd22014d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.844+0000 7fd22485d640 1 --2- 172.21.15.7:0/4116881997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2200b6a40 0x7fd22014cef0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.844+0000 7fd22485d640 1 --2- 172.21.15.7:0/4116881997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2200b5e60 0x7fd220152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.844+0000 7fd22485d640 1 -- 172.21.15.7:0/4116881997 >> 172.21.15.7:0/4116881997 conn(0x7fd2200d07b0 msgr2=0x7fd2200d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:39.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.844+0000 7fd22485d640 1 -- 172.21.15.7:0/4116881997 shutdown_connections 2024-04-25T09:54:39.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.844+0000 7fd22485d640 1 -- 172.21.15.7:0/4116881997 wait complete. 2024-04-25T09:54:39.857 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:54:26.011833+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:54:26.535536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:54:30.264996+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:54:39.858 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:54:39.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.959+0000 7f0f79b42640 1 Processor -- start 2024-04-25T09:54:39.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.959+0000 7f0f79b42640 1 -- start start 2024-04-25T09:54:39.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.960+0000 7f0f79b42640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f740d3760 0x7f0f7415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:39.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.960+0000 7f0f79b42640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0f7415f1c0 0x7f0f740d3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:39.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.960+0000 7f0f79b42640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f740d4080 con 0x7f0f740ce830 2024-04-25T09:54:39.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.960+0000 7f0f79b42640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f740ce380 con 0x7f0f7415f1c0 2024-04-25T09:54:39.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.960+0000 7f0f79b42640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7415f000 con 0x7f0f740d3760 2024-04-25T09:54:39.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.960+0000 7f0f72ffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0f7415f1c0 0x7f0f740d3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:39.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.960+0000 7f0f73fff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0f740ce830 0x7f0f740b2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35448/0 (socket says 172.21.15.7:35448) 2024-04-25T09:54:39.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.960+0000 7f0f73fff640 1 -- 172.21.15.7:0/4048185638 learned_addr learned my addr 172.21.15.7:0/4048185638 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:39.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.960+0000 7f0f737fe640 1 --2- 172.21.15.7:0/4048185638 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f740d3760 0x7f0f7415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:39.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.960+0000 7f0f727fc640 1 -- 172.21.15.7:0/4048185638 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1974272283 0 0) 0x7f0f740d4080 con 0x7f0f740ce830 2024-04-25T09:54:39.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.960+0000 7f0f727fc640 1 -- 172.21.15.7:0/4048185638 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f5c003520 con 0x7f0f740ce830 2024-04-25T09:54:39.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.960+0000 7f0f72ffd640 1 -- 172.21.15.7:0/4048185638 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f740d3760 msgr2=0x7f0f7415eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:39.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.960+0000 7f0f72ffd640 1 --2- 172.21.15.7:0/4048185638 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f740d3760 0x7f0f7415eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.960+0000 7f0f72ffd640 1 -- 172.21.15.7:0/4048185638 >> v1:172.21.15.7:6789/0 conn(0x7f0f740ce830 legacy=0x7f0f740b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:39.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.960+0000 7f0f72ffd640 1 -- 172.21.15.7:0/4048185638 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f740ced10 con 0x7f0f7415f1c0 2024-04-25T09:54:39.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.961+0000 7f0f72ffd640 1 --2- 172.21.15.7:0/4048185638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f7415f1c0 0x7f0f740d3b40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0f680097d0 tx=0x7f0f6802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e90105bce42a10 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:39.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.961+0000 7f0f727fc640 1 -- 172.21.15.7:0/4048185638 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f68037070 con 0x7f0f7415f1c0 2024-04-25T09:54:39.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.961+0000 7f0f727fc640 1 -- 172.21.15.7:0/4048185638 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f68032440 con 0x7f0f7415f1c0 2024-04-25T09:54:39.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.961+0000 7f0f727fc640 1 -- 172.21.15.7:0/4048185638 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f68032810 con 0x7f0f7415f1c0 2024-04-25T09:54:39.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.962+0000 7f0f79b42640 1 -- 172.21.15.7:0/4048185638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f7415f1c0 msgr2=0x7f0f740d3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:39.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.962+0000 7f0f79b42640 1 --2- 172.21.15.7:0/4048185638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f7415f1c0 0x7f0f740d3b40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0f680097d0 tx=0x7f0f6802a1c0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.962+0000 7f0f79b42640 1 -- 172.21.15.7:0/4048185638 shutdown_connections 2024-04-25T09:54:39.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.962+0000 7f0f79b42640 1 --2- 172.21.15.7:0/4048185638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f7415f1c0 0x7f0f740d3b40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.962+0000 7f0f79b42640 1 --2- 172.21.15.7:0/4048185638 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f740d3760 0x7f0f7415eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.962+0000 7f0f79b42640 1 -- 172.21.15.7:0/4048185638 >> 172.21.15.7:0/4048185638 conn(0x7f0f74072680 msgr2=0x7f0f74072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:39.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.962+0000 7f0f79b42640 1 -- 172.21.15.7:0/4048185638 shutdown_connections 2024-04-25T09:54:39.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.962+0000 7f0f79b42640 1 -- 172.21.15.7:0/4048185638 wait complete. 2024-04-25T09:54:39.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.963+0000 7f0f79b42640 1 Processor -- start 2024-04-25T09:54:39.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.963+0000 7f0f79b42640 1 -- start start 2024-04-25T09:54:39.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.964+0000 7f0f79b42640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f740ce830 0x7f0f74159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:39.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.964+0000 7f0f79b42640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f740d3760 0x7f0f74159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:39.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.964+0000 7f0f79b42640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f7415f1c0 0x7f0f740ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:39.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.964+0000 7f0f79b42640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f740d1e20 con 0x7f0f740d3760 2024-04-25T09:54:39.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.964+0000 7f0f79b42640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f740d2190 con 0x7f0f740ce830 2024-04-25T09:54:39.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.964+0000 7f0f79b42640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7415de10 con 0x7f0f7415f1c0 2024-04-25T09:54:39.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.964+0000 7f0f72ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f740d3760 0x7f0f74159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:39.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.964+0000 7f0f72ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f740d3760 0x7f0f74159650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42606/0 (socket says 172.21.15.7:42606) 2024-04-25T09:54:39.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.964+0000 7f0f72ffd640 1 -- 172.21.15.7:0/2660801560 learned_addr learned my addr 172.21.15.7:0/2660801560 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:39.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.964+0000 7f0f73fff640 1 --2- 172.21.15.7:0/2660801560 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f7415f1c0 0x7f0f740ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:39.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.964+0000 7f0f737fe640 1 --2- 172.21.15.7:0/2660801560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f740ce830 0x7f0f74159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:39.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.964+0000 7f0f72ffd640 1 -- 172.21.15.7:0/2660801560 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f7415f1c0 msgr2=0x7f0f740ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:39.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.964+0000 7f0f72ffd640 1 --2- 172.21.15.7:0/2660801560 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f7415f1c0 0x7f0f740ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.964+0000 7f0f72ffd640 1 -- 172.21.15.7:0/2660801560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f740ce830 msgr2=0x7f0f74159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:39.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.964+0000 7f0f72ffd640 1 --2- 172.21.15.7:0/2660801560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f740ce830 0x7f0f74159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:39.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.965+0000 7f0f72ffd640 1 -- 172.21.15.7:0/2660801560 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f740aa1c0 con 0x7f0f740d3760 2024-04-25T09:54:39.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.965+0000 7f0f72ffd640 1 --2- 172.21.15.7:0/2660801560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f740d3760 0x7f0f74159650 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0f68035040 tx=0x7f0f680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:39.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.965+0000 7f0f5bfff640 1 -- 172.21.15.7:0/2660801560 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f68037040 con 0x7f0f740d3760 2024-04-25T09:54:39.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.965+0000 7f0f5bfff640 1 -- 172.21.15.7:0/2660801560 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f68030500 con 0x7f0f740d3760 2024-04-25T09:54:39.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.965+0000 7f0f79b42640 1 -- 172.21.15.7:0/2660801560 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f740aa4a0 con 0x7f0f740d3760 2024-04-25T09:54:39.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.965+0000 7f0f5bfff640 1 -- 172.21.15.7:0/2660801560 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f680308f0 con 0x7f0f740d3760 2024-04-25T09:54:39.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.965+0000 7f0f79b42640 1 -- 172.21.15.7:0/2660801560 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f740aaa60 con 0x7f0f740d3760 2024-04-25T09:54:39.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.966+0000 7f0f79b42640 1 -- 172.21.15.7:0/2660801560 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f74068f60 con 0x7f0f740d3760 2024-04-25T09:54:39.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.966+0000 7f0f5bfff640 1 -- 172.21.15.7:0/2660801560 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0f68044020 con 0x7f0f740d3760 2024-04-25T09:54:39.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.967+0000 7f0f5bfff640 1 --2- 172.21.15.7:0/2660801560 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0f6006b4d0 0x7f0f6006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:39.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.967+0000 7f0f5bfff640 1 -- 172.21.15.7:0/2660801560 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0f680aa6c0 con 0x7f0f740d3760 2024-04-25T09:54:39.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.967+0000 7f0f737fe640 1 --2- 172.21.15.7:0/2660801560 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0f6006b4d0 0x7f0f6006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:39.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.967+0000 7f0f737fe640 1 --2- 172.21.15.7:0/2660801560 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0f6006b4d0 0x7f0f6006d990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0f64006fd0 tx=0x7f0f64008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:39.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:39.971+0000 7f0f5bfff640 1 -- 172.21.15.7:0/2660801560 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0f68078bb0 con 0x7f0f740d3760 2024-04-25T09:54:40.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.149+0000 7f0f79b42640 1 -- 172.21.15.7:0/2660801560 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0f7406ad60 con 0x7f0f740d3760 2024-04-25T09:54:40.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.150+0000 7f0f5bfff640 1 -- 172.21.15.7:0/2660801560 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0f6807cc50 con 0x7f0f740d3760 2024-04-25T09:54:40.153 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T09:54:40.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.152+0000 7f0f79b42640 1 -- 172.21.15.7:0/2660801560 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0f6006b4d0 msgr2=0x7f0f6006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:40.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.152+0000 7f0f79b42640 1 --2- 172.21.15.7:0/2660801560 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0f6006b4d0 0x7f0f6006d990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0f64006fd0 tx=0x7f0f64008040 comp rx=0 tx=0).stop 2024-04-25T09:54:40.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.152+0000 7f0f79b42640 1 -- 172.21.15.7:0/2660801560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f740d3760 msgr2=0x7f0f74159650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:40.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.152+0000 7f0f79b42640 1 --2- 172.21.15.7:0/2660801560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f740d3760 0x7f0f74159650 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0f68035040 tx=0x7f0f680046c0 comp rx=0 tx=0).stop 2024-04-25T09:54:40.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.152+0000 7f0f79b42640 1 -- 172.21.15.7:0/2660801560 shutdown_connections 2024-04-25T09:54:40.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.152+0000 7f0f79b42640 1 --2- 172.21.15.7:0/2660801560 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0f6006b4d0 0x7f0f6006d990 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:40.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.152+0000 7f0f79b42640 1 --2- 172.21.15.7:0/2660801560 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f7415f1c0 0x7f0f740ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:40.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.152+0000 7f0f79b42640 1 --2- 172.21.15.7:0/2660801560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f740d3760 0x7f0f74159650 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:40.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.152+0000 7f0f79b42640 1 --2- 172.21.15.7:0/2660801560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f740ce830 0x7f0f74159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:40.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.152+0000 7f0f79b42640 1 -- 172.21.15.7:0/2660801560 >> 172.21.15.7:0/2660801560 conn(0x7f0f74072680 msgr2=0x7f0f740d3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:40.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.152+0000 7f0f79b42640 1 -- 172.21.15.7:0/2660801560 shutdown_connections 2024-04-25T09:54:40.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.152+0000 7f0f79b42640 1 -- 172.21.15.7:0/2660801560 wait complete. 2024-04-25T09:54:40.166 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:54:40.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.270+0000 7f4dad815640 1 Processor -- start 2024-04-25T09:54:40.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.270+0000 7f4dad815640 1 -- start start 2024-04-25T09:54:40.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.271+0000 7f4dad815640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4da80d3760 0x7f4da815eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:40.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.271+0000 7f4dad815640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da80ced10 con 0x7f4da80ce830 2024-04-25T09:54:40.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.271+0000 7f4dad815640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da80d1b40 con 0x7f4da815f1c0 2024-04-25T09:54:40.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.271+0000 7f4dad815640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da80ce380 con 0x7f4da80d3760 2024-04-25T09:54:40.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.271+0000 7f4da6ffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4da80d3760 0x7f4da815eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:40.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.271+0000 7f4da77fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f4da80ce830 0x7f4da80b2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35450/0 (socket says 172.21.15.7:35450) 2024-04-25T09:54:40.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.271+0000 7f4da77fe640 1 -- 172.21.15.7:0/1560089053 learned_addr learned my addr 172.21.15.7:0/1560089053 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:40.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.271+0000 7f4da6ffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4da80d3760 0x7f4da815eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42616/0 (socket says 172.21.15.7:42616) 2024-04-25T09:54:40.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.271+0000 7f4da6ffd640 1 -- 172.21.15.7:0/1560089053 >> v1:172.21.15.55:6789/0 conn(0x7f4da815f1c0 legacy=0x7f4da80d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:40.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.271+0000 7f4da6ffd640 1 -- 172.21.15.7:0/1560089053 >> v1:172.21.15.7:6789/0 conn(0x7f4da80ce830 legacy=0x7f4da80b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:40.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.271+0000 7f4da6ffd640 1 -- 172.21.15.7:0/1560089053 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da80d1e20 con 0x7f4da80d3760 2024-04-25T09:54:40.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.272+0000 7f4da6ffd640 1 --2- 172.21.15.7:0/1560089053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4da80d3760 0x7f4da815eac0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4d980097a0 tx=0x7f4d9802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ecff820b42aac6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:40.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.272+0000 7f4da5ffb640 1 -- 172.21.15.7:0/1560089053 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d98037070 con 0x7f4da80d3760 2024-04-25T09:54:40.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.272+0000 7f4da5ffb640 1 -- 172.21.15.7:0/1560089053 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d98032440 con 0x7f4da80d3760 2024-04-25T09:54:40.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.272+0000 7f4da5ffb640 1 -- 172.21.15.7:0/1560089053 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d98032810 con 0x7f4da80d3760 2024-04-25T09:54:40.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.273+0000 7f4dad815640 1 -- 172.21.15.7:0/1560089053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4da80d3760 msgr2=0x7f4da815eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:40.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.273+0000 7f4dad815640 1 --2- 172.21.15.7:0/1560089053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4da80d3760 0x7f4da815eac0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4d980097a0 tx=0x7f4d9802a230 comp rx=0 tx=0).stop 2024-04-25T09:54:40.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.273+0000 7f4dad815640 1 -- 172.21.15.7:0/1560089053 shutdown_connections 2024-04-25T09:54:40.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.273+0000 7f4dad815640 1 --2- 172.21.15.7:0/1560089053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4da80d3760 0x7f4da815eac0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:40.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.273+0000 7f4dad815640 1 -- 172.21.15.7:0/1560089053 >> 172.21.15.7:0/1560089053 conn(0x7f4da8072680 msgr2=0x7f4da8072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:40.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.273+0000 7f4dad815640 1 -- 172.21.15.7:0/1560089053 shutdown_connections 2024-04-25T09:54:40.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.273+0000 7f4dad815640 1 -- 172.21.15.7:0/1560089053 wait complete. 2024-04-25T09:54:40.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.274+0000 7f4dad815640 1 Processor -- start 2024-04-25T09:54:40.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.274+0000 7f4dad815640 1 -- start start 2024-04-25T09:54:40.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.275+0000 7f4dad815640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4da80ce830 0x7f4da81f6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:40.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.275+0000 7f4dad815640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4da80d3760 0x7f4da80b3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:40.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.275+0000 7f4dad815640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4da815f1c0 0x7f4da81f3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:40.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.275+0000 7f4dad815640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da80d2190 con 0x7f4da80d3760 2024-04-25T09:54:40.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.275+0000 7f4dad815640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da815f000 con 0x7f4da80ce830 2024-04-25T09:54:40.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.275+0000 7f4dad815640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da80b2950 con 0x7f4da815f1c0 2024-04-25T09:54:40.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.275+0000 7f4da67fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4da80d3760 0x7f4da80b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:40.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.275+0000 7f4da67fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4da80d3760 0x7f4da80b3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42624/0 (socket says 172.21.15.7:42624) 2024-04-25T09:54:40.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.275+0000 7f4da67fc640 1 -- 172.21.15.7:0/24432652 learned_addr learned my addr 172.21.15.7:0/24432652 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:40.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.275+0000 7f4da6ffd640 1 --2- 172.21.15.7:0/24432652 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4da80ce830 0x7f4da81f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:40.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.275+0000 7f4da67fc640 1 -- 172.21.15.7:0/24432652 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4da815f1c0 msgr2=0x7f4da81f3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:40.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.275+0000 7f4da77fe640 1 --2- 172.21.15.7:0/24432652 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4da815f1c0 0x7f4da81f3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:40.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.275+0000 7f4da67fc640 1 --2- 172.21.15.7:0/24432652 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4da815f1c0 0x7f4da81f3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:40.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.275+0000 7f4da67fc640 1 -- 172.21.15.7:0/24432652 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4da80ce830 msgr2=0x7f4da81f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:40.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.275+0000 7f4da67fc640 1 --2- 172.21.15.7:0/24432652 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4da80ce830 0x7f4da81f6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:40.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.275+0000 7f4da67fc640 1 -- 172.21.15.7:0/24432652 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da80b42e0 con 0x7f4da80d3760 2024-04-25T09:54:40.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.275+0000 7f4da6ffd640 1 --2- 172.21.15.7:0/24432652 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4da80ce830 0x7f4da81f6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:40.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.276+0000 7f4da67fc640 1 --2- 172.21.15.7:0/24432652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4da80d3760 0x7f4da80b3900 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00c440 tx=0x7f4d9c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:40.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.276+0000 7f4d8ffff640 1 -- 172.21.15.7:0/24432652 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c0052d0 con 0x7f4da80d3760 2024-04-25T09:54:40.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.276+0000 7f4d8ffff640 1 -- 172.21.15.7:0/24432652 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9c005470 con 0x7f4da80d3760 2024-04-25T09:54:40.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.276+0000 7f4dad815640 1 -- 172.21.15.7:0/24432652 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da80b45c0 con 0x7f4da80d3760 2024-04-25T09:54:40.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.276+0000 7f4d8ffff640 1 -- 172.21.15.7:0/24432652 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c007260 con 0x7f4da80d3760 2024-04-25T09:54:40.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.276+0000 7f4dad815640 1 -- 172.21.15.7:0/24432652 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da80b4b80 con 0x7f4da80d3760 2024-04-25T09:54:40.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.277+0000 7f4dad815640 1 -- 172.21.15.7:0/24432652 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da8068f60 con 0x7f4da80d3760 2024-04-25T09:54:40.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.277+0000 7f4d8ffff640 1 -- 172.21.15.7:0/24432652 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4d9c007400 con 0x7f4da80d3760 2024-04-25T09:54:40.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.277+0000 7f4d8ffff640 1 --2- 172.21.15.7:0/24432652 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4d9406b4d0 0x7f4d9406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:40.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.278+0000 7f4d8ffff640 1 -- 172.21.15.7:0/24432652 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f4d9c089a40 con 0x7f4da80d3760 2024-04-25T09:54:40.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.278+0000 7f4da6ffd640 1 --2- 172.21.15.7:0/24432652 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4d9406b4d0 0x7f4d9406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:40.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.278+0000 7f4da6ffd640 1 --2- 172.21.15.7:0/24432652 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4d9406b4d0 0x7f4d9406d990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4d98034000 tx=0x7f4d9802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:40.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.282+0000 7f4d8ffff640 1 -- 172.21.15.7:0/24432652 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4d9c0584f0 con 0x7f4da80d3760 2024-04-25T09:54:40.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.463+0000 7f4dad815640 1 -- 172.21.15.7:0/24432652 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4da806ad60 con 0x7f4da80d3760 2024-04-25T09:54:40.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.463+0000 7f4d8ffff640 1 -- 172.21.15.7:0/24432652 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4d9c089e20 con 0x7f4da80d3760 2024-04-25T09:54:40.466 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:54:40.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.465+0000 7f4dad815640 1 -- 172.21.15.7:0/24432652 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4d9406b4d0 msgr2=0x7f4d9406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:40.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.465+0000 7f4dad815640 1 --2- 172.21.15.7:0/24432652 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4d9406b4d0 0x7f4d9406d990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4d98034000 tx=0x7f4d9802e000 comp rx=0 tx=0).stop 2024-04-25T09:54:40.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.465+0000 7f4dad815640 1 -- 172.21.15.7:0/24432652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4da80d3760 msgr2=0x7f4da80b3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:40.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.465+0000 7f4dad815640 1 --2- 172.21.15.7:0/24432652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4da80d3760 0x7f4da80b3900 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00c440 tx=0x7f4d9c00c900 comp rx=0 tx=0).stop 2024-04-25T09:54:40.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.465+0000 7f4dad815640 1 -- 172.21.15.7:0/24432652 shutdown_connections 2024-04-25T09:54:40.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.465+0000 7f4dad815640 1 --2- 172.21.15.7:0/24432652 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4d9406b4d0 0x7f4d9406d990 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:40.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.465+0000 7f4dad815640 1 --2- 172.21.15.7:0/24432652 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4da815f1c0 0x7f4da81f3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:40.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.465+0000 7f4dad815640 1 --2- 172.21.15.7:0/24432652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4da80d3760 0x7f4da80b3900 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:40.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.465+0000 7f4dad815640 1 --2- 172.21.15.7:0/24432652 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4da80ce830 0x7f4da81f6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:40.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.465+0000 7f4dad815640 1 -- 172.21.15.7:0/24432652 >> 172.21.15.7:0/24432652 conn(0x7f4da8072680 msgr2=0x7f4da806bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:40.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.465+0000 7f4dad815640 1 -- 172.21.15.7:0/24432652 shutdown_connections 2024-04-25T09:54:40.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.465+0000 7f4dad815640 1 -- 172.21.15.7:0/24432652 wait complete. 2024-04-25T09:54:40.479 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:54:40.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.579+0000 7fb5dd83a640 1 Processor -- start 2024-04-25T09:54:40.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.579+0000 7fb5dd83a640 1 -- start start 2024-04-25T09:54:40.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.580+0000 7fb5dd83a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5d815b930 0x7fb5d80cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:40.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.580+0000 7fb5dd83a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb5d806c280 0x7fb5d806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:40.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.580+0000 7fb5dd83a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5d815bd10 con 0x7fb5d80af180 2024-04-25T09:54:40.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.580+0000 7fb5dd83a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5d806da90 con 0x7fb5d806c280 2024-04-25T09:54:40.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.580+0000 7fb5dd83a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d806dd70 con 0x7fb5d815b930 2024-04-25T09:54:40.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.580+0000 7fb5d77fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb5d806c280 0x7fb5d806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:40.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.580+0000 7fb5d67fc640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb5d80af180 0x7fb5d806bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35458/0 (socket says 172.21.15.7:35458) 2024-04-25T09:54:40.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.580+0000 7fb5d67fc640 1 -- 172.21.15.7:0/2133284586 learned_addr learned my addr 172.21.15.7:0/2133284586 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:40.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.581+0000 7fb5d6ffd640 1 --2- 172.21.15.7:0/2133284586 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5d815b930 0x7fb5d80cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:40.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.581+0000 7fb5d77fe640 1 -- 172.21.15.7:0/2133284586 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5d815b930 msgr2=0x7fb5d80cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:40.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.581+0000 7fb5d77fe640 1 --2- 172.21.15.7:0/2133284586 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5d815b930 0x7fb5d80cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:40.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.581+0000 7fb5d77fe640 1 -- 172.21.15.7:0/2133284586 >> v1:172.21.15.7:6789/0 conn(0x7fb5d80af180 legacy=0x7fb5d806bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:40.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.581+0000 7fb5d5ffb640 1 -- 172.21.15.7:0/2133284586 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3069814314 0 0) 0x7fb5d815bd10 con 0x7fb5d80af180 2024-04-25T09:54:40.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.581+0000 7fb5d77fe640 1 -- 172.21.15.7:0/2133284586 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d806e050 con 0x7fb5d806c280 2024-04-25T09:54:40.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.581+0000 7fb5d6ffd640 1 --2- 172.21.15.7:0/2133284586 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5d815b930 0x7fb5d80cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:40.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.581+0000 7fb5d77fe640 1 --2- 172.21.15.7:0/2133284586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d806c280 0x7fb5d806eb30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8009d90 tx=0x7fb5c802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=127b2fcee1131372 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:40.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.582+0000 7fb5d5ffb640 1 -- 172.21.15.7:0/2133284586 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c8007740 con 0x7fb5d806c280 2024-04-25T09:54:40.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.582+0000 7fb5d5ffb640 1 -- 172.21.15.7:0/2133284586 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c80078e0 con 0x7fb5d806c280 2024-04-25T09:54:40.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.582+0000 7fb5d5ffb640 1 -- 172.21.15.7:0/2133284586 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c8007cb0 con 0x7fb5d806c280 2024-04-25T09:54:40.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.582+0000 7fb5dd83a640 1 -- 172.21.15.7:0/2133284586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d806c280 msgr2=0x7fb5d806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:40.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.582+0000 7fb5dd83a640 1 --2- 172.21.15.7:0/2133284586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d806c280 0x7fb5d806eb30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8009d90 tx=0x7fb5c802a660 comp rx=0 tx=0).stop 2024-04-25T09:54:40.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.582+0000 7fb5dd83a640 1 -- 172.21.15.7:0/2133284586 shutdown_connections 2024-04-25T09:54:40.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.582+0000 7fb5dd83a640 1 --2- 172.21.15.7:0/2133284586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d806c280 0x7fb5d806eb30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:40.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.582+0000 7fb5dd83a640 1 --2- 172.21.15.7:0/2133284586 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5d815b930 0x7fb5d80cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:40.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.582+0000 7fb5dd83a640 1 -- 172.21.15.7:0/2133284586 >> 172.21.15.7:0/2133284586 conn(0x7fb5d80718e0 msgr2=0x7fb5d8071cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:40.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.582+0000 7fb5dd83a640 1 -- 172.21.15.7:0/2133284586 shutdown_connections 2024-04-25T09:54:40.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.582+0000 7fb5dd83a640 1 -- 172.21.15.7:0/2133284586 wait complete. 2024-04-25T09:54:40.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.583+0000 7fb5dd83a640 1 Processor -- start 2024-04-25T09:54:40.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.584+0000 7fb5dd83a640 1 -- start start 2024-04-25T09:54:40.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.584+0000 7fb5dd83a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d806c280 0x7fb5d815d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:40.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.584+0000 7fb5dd83a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5d80af180 0x7fb5d80b4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:40.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.584+0000 7fb5dd83a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5d815b930 0x7fb5d814a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:40.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.584+0000 7fb5dd83a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d8072ab0 con 0x7fb5d806c280 2024-04-25T09:54:40.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.584+0000 7fb5dd83a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d806e610 con 0x7fb5d815b930 2024-04-25T09:54:40.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.584+0000 7fb5dd83a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d8072c30 con 0x7fb5d80af180 2024-04-25T09:54:40.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.584+0000 7fb5d6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d806c280 0x7fb5d815d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:40.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.584+0000 7fb5d6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d806c280 0x7fb5d815d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42646/0 (socket says 172.21.15.7:42646) 2024-04-25T09:54:40.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.584+0000 7fb5d6ffd640 1 -- 172.21.15.7:0/772564890 learned_addr learned my addr 172.21.15.7:0/772564890 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:40.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.585+0000 7fb5d67fc640 1 --2- 172.21.15.7:0/772564890 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5d80af180 0x7fb5d80b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:40.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.585+0000 7fb5d77fe640 1 --2- 172.21.15.7:0/772564890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5d815b930 0x7fb5d814a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:40.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.585+0000 7fb5d6ffd640 1 -- 172.21.15.7:0/772564890 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5d80af180 msgr2=0x7fb5d80b4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:40.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.585+0000 7fb5d6ffd640 1 --2- 172.21.15.7:0/772564890 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5d80af180 0x7fb5d80b4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:40.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.585+0000 7fb5d6ffd640 1 -- 172.21.15.7:0/772564890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5d815b930 msgr2=0x7fb5d814a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:40.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.585+0000 7fb5d6ffd640 1 --2- 172.21.15.7:0/772564890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5d815b930 0x7fb5d814a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:40.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.585+0000 7fb5d6ffd640 1 -- 172.21.15.7:0/772564890 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d80cb5e0 con 0x7fb5d806c280 2024-04-25T09:54:40.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.585+0000 7fb5d67fc640 1 --2- 172.21.15.7:0/772564890 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5d80af180 0x7fb5d80b4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:40.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.585+0000 7fb5d6ffd640 1 --2- 172.21.15.7:0/772564890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d806c280 0x7fb5d815d790 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb5d000c7f0 tx=0x7fb5d000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:40.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.585+0000 7fb5cffff640 1 -- 172.21.15.7:0/772564890 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d0015070 con 0x7fb5d806c280 2024-04-25T09:54:40.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.585+0000 7fb5cffff640 1 -- 172.21.15.7:0/772564890 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d0007820 con 0x7fb5d806c280 2024-04-25T09:54:40.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.585+0000 7fb5dd83a640 1 -- 172.21.15.7:0/772564890 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d80ca820 con 0x7fb5d806c280 2024-04-25T09:54:40.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.585+0000 7fb5cffff640 1 -- 172.21.15.7:0/772564890 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d0007bd0 con 0x7fb5d806c280 2024-04-25T09:54:40.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.585+0000 7fb5dd83a640 1 -- 172.21.15.7:0/772564890 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d80cb0c0 con 0x7fb5d806c280 2024-04-25T09:54:40.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.586+0000 7fb5dd83a640 1 -- 172.21.15.7:0/772564890 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5d80ca9f0 con 0x7fb5d806c280 2024-04-25T09:54:40.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.587+0000 7fb5cffff640 1 -- 172.21.15.7:0/772564890 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb5d0018070 con 0x7fb5d806c280 2024-04-25T09:54:40.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.587+0000 7fb5cffff640 1 --2- 172.21.15.7:0/772564890 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb5b806b4d0 0x7fb5b806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:40.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.587+0000 7fb5cffff640 1 -- 172.21.15.7:0/772564890 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb5d008a640 con 0x7fb5d806c280 2024-04-25T09:54:40.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.587+0000 7fb5d67fc640 1 --2- 172.21.15.7:0/772564890 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb5b806b4d0 0x7fb5b806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:40.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.588+0000 7fb5d67fc640 1 --2- 172.21.15.7:0/772564890 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb5b806b4d0 0x7fb5b806d990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb5d809db70 tx=0x7fb5c0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:40.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.591+0000 7fb5cffff640 1 -- 172.21.15.7:0/772564890 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb5d0059180 con 0x7fb5d806c280 2024-04-25T09:54:40.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.771+0000 7fb5dd83a640 1 -- 172.21.15.7:0/772564890 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb5d8068f60 con 0x7fb5d806c280 2024-04-25T09:54:40.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.771+0000 7fb5cffff640 1 -- 172.21.15.7:0/772564890 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb5d0058a80 con 0x7fb5d806c280 2024-04-25T09:54:40.774 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T09:54:40.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.773+0000 7fb5dd83a640 1 -- 172.21.15.7:0/772564890 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb5b806b4d0 msgr2=0x7fb5b806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:40.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.773+0000 7fb5dd83a640 1 --2- 172.21.15.7:0/772564890 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb5b806b4d0 0x7fb5b806d990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb5d809db70 tx=0x7fb5c0009040 comp rx=0 tx=0).stop 2024-04-25T09:54:40.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.773+0000 7fb5dd83a640 1 -- 172.21.15.7:0/772564890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d806c280 msgr2=0x7fb5d815d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:40.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.773+0000 7fb5dd83a640 1 --2- 172.21.15.7:0/772564890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d806c280 0x7fb5d815d790 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb5d000c7f0 tx=0x7fb5d000ccb0 comp rx=0 tx=0).stop 2024-04-25T09:54:40.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.773+0000 7fb5dd83a640 1 -- 172.21.15.7:0/772564890 shutdown_connections 2024-04-25T09:54:40.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.773+0000 7fb5dd83a640 1 --2- 172.21.15.7:0/772564890 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb5b806b4d0 0x7fb5b806d990 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:40.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.773+0000 7fb5dd83a640 1 --2- 172.21.15.7:0/772564890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5d815b930 0x7fb5d814a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:40.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.773+0000 7fb5dd83a640 1 --2- 172.21.15.7:0/772564890 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5d80af180 0x7fb5d80b4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:40.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.773+0000 7fb5dd83a640 1 --2- 172.21.15.7:0/772564890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d806c280 0x7fb5d815d790 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:40.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.773+0000 7fb5dd83a640 1 -- 172.21.15.7:0/772564890 >> 172.21.15.7:0/772564890 conn(0x7fb5d80718e0 msgr2=0x7fb5d80b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:40.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.773+0000 7fb5dd83a640 1 -- 172.21.15.7:0/772564890 shutdown_connections 2024-04-25T09:54:40.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.773+0000 7fb5dd83a640 1 -- 172.21.15.7:0/772564890 wait complete. 2024-04-25T09:54:40.787 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:54:40.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.887+0000 7faa5f02a640 1 Processor -- start 2024-04-25T09:54:40.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.887+0000 7faa5f02a640 1 -- start start 2024-04-25T09:54:40.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.888+0000 7faa5f02a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faa580d2c40 0x7faa580b9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:40.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.888+0000 7faa5f02a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa580b7ef0 con 0x7faa580d0780 2024-04-25T09:54:40.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.888+0000 7faa5f02a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa580b81d0 con 0x7faa580b68b0 2024-04-25T09:54:40.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.888+0000 7faa5f02a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa580b84b0 con 0x7faa580d2c40 2024-04-25T09:54:40.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.888+0000 7faa5cdc6640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7faa580d0780 0x7faa580d0b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35464/0 (socket says 172.21.15.7:35464) 2024-04-25T09:54:40.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.888+0000 7faa5cdc6640 1 -- 172.21.15.7:0/650949734 learned_addr learned my addr 172.21.15.7:0/650949734 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:40.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.888+0000 7faa57fff640 1 --2- 172.21.15.7:0/650949734 >> v2:172.21.15.7:3300/0 conn(0x7faa580d2c40 0x7faa580b9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:40.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.888+0000 7faa577fe640 1 -- 172.21.15.7:0/650949734 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1275642521 0 0) 0x7faa580b7ef0 con 0x7faa580d0780 2024-04-25T09:54:40.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.888+0000 7faa577fe640 1 -- 172.21.15.7:0/650949734 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa40003520 con 0x7faa580d0780 2024-04-25T09:54:40.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.888+0000 7faa57fff640 1 -- 172.21.15.7:0/650949734 >> v1:172.21.15.55:6789/0 conn(0x7faa580b68b0 legacy=0x7faa580b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:40.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.888+0000 7faa57fff640 1 -- 172.21.15.7:0/650949734 >> v1:172.21.15.7:6789/0 conn(0x7faa580d0780 legacy=0x7faa580d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:40.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.888+0000 7faa57fff640 1 -- 172.21.15.7:0/650949734 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa580b8790 con 0x7faa580d2c40 2024-04-25T09:54:40.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.889+0000 7faa57fff640 1 --2- 172.21.15.7:0/650949734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa580d2c40 0x7faa580b9130 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faa4c0097a0 tx=0x7faa4c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cdc4aabf1e5f5c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:40.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.889+0000 7faa577fe640 1 -- 172.21.15.7:0/650949734 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c037070 con 0x7faa580d2c40 2024-04-25T09:54:40.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.889+0000 7faa577fe640 1 -- 172.21.15.7:0/650949734 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4c032440 con 0x7faa580d2c40 2024-04-25T09:54:40.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.889+0000 7faa577fe640 1 -- 172.21.15.7:0/650949734 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c032810 con 0x7faa580d2c40 2024-04-25T09:54:40.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.890+0000 7faa5f02a640 1 -- 172.21.15.7:0/650949734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa580d2c40 msgr2=0x7faa580b9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:40.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.890+0000 7faa5f02a640 1 --2- 172.21.15.7:0/650949734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa580d2c40 0x7faa580b9130 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faa4c0097a0 tx=0x7faa4c02a230 comp rx=0 tx=0).stop 2024-04-25T09:54:40.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.890+0000 7faa5f02a640 1 -- 172.21.15.7:0/650949734 shutdown_connections 2024-04-25T09:54:40.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.890+0000 7faa5f02a640 1 --2- 172.21.15.7:0/650949734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa580d2c40 0x7faa580b9130 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:40.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.890+0000 7faa5f02a640 1 -- 172.21.15.7:0/650949734 >> 172.21.15.7:0/650949734 conn(0x7faa580726b0 msgr2=0x7faa58072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:40.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.890+0000 7faa5f02a640 1 -- 172.21.15.7:0/650949734 shutdown_connections 2024-04-25T09:54:40.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.890+0000 7faa5f02a640 1 -- 172.21.15.7:0/650949734 wait complete. 2024-04-25T09:54:40.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.891+0000 7faa5f02a640 1 Processor -- start 2024-04-25T09:54:40.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.891+0000 7faa5f02a640 1 -- start start 2024-04-25T09:54:40.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.892+0000 7faa5f02a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa580b68b0 0x7faa5814fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:40.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.892+0000 7faa5f02a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa580d0780 0x7faa5815c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:40.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.892+0000 7faa5f02a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faa580d2c40 0x7faa580cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:40.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.892+0000 7faa5f02a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa580b97f0 con 0x7faa580b68b0 2024-04-25T09:54:40.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.892+0000 7faa5f02a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa580b9670 con 0x7faa580d0780 2024-04-25T09:54:40.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.892+0000 7faa5f02a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa581611b0 con 0x7faa580d2c40 2024-04-25T09:54:40.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.892+0000 7faa5cdc6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa580b68b0 0x7faa5814fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:40.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.892+0000 7faa5cdc6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa580b68b0 0x7faa5814fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42662/0 (socket says 172.21.15.7:42662) 2024-04-25T09:54:40.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.892+0000 7faa5cdc6640 1 -- 172.21.15.7:0/2582572267 learned_addr learned my addr 172.21.15.7:0/2582572267 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:40.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.892+0000 7faa57fff640 1 --2- 172.21.15.7:0/2582572267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa580d0780 0x7faa5815c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:40.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.892+0000 7faa5d5c7640 1 --2- 172.21.15.7:0/2582572267 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faa580d2c40 0x7faa580cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:40.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.893+0000 7faa5cdc6640 1 -- 172.21.15.7:0/2582572267 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faa580d2c40 msgr2=0x7faa580cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:40.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.893+0000 7faa5cdc6640 1 --2- 172.21.15.7:0/2582572267 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faa580d2c40 0x7faa580cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:40.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.893+0000 7faa5cdc6640 1 -- 172.21.15.7:0/2582572267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa580d0780 msgr2=0x7faa5815c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:40.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.893+0000 7faa5cdc6640 1 --2- 172.21.15.7:0/2582572267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa580d0780 0x7faa5815c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:40.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.893+0000 7faa5cdc6640 1 -- 172.21.15.7:0/2582572267 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5815b950 con 0x7faa580b68b0 2024-04-25T09:54:40.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.893+0000 7faa5cdc6640 1 --2- 172.21.15.7:0/2582572267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa580b68b0 0x7faa5814fd80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faa4800c500 tx=0x7faa4800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:40.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.893+0000 7faa557fa640 1 -- 172.21.15.7:0/2582572267 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa48017070 con 0x7faa580b68b0 2024-04-25T09:54:40.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.893+0000 7faa557fa640 1 -- 172.21.15.7:0/2582572267 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa48005ce0 con 0x7faa580b68b0 2024-04-25T09:54:40.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.893+0000 7faa557fa640 1 -- 172.21.15.7:0/2582572267 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa48007330 con 0x7faa580b68b0 2024-04-25T09:54:40.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.893+0000 7faa5f02a640 1 -- 172.21.15.7:0/2582572267 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa5815bc30 con 0x7faa580b68b0 2024-04-25T09:54:40.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.893+0000 7faa5f02a640 1 -- 172.21.15.7:0/2582572267 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa5815c1f0 con 0x7faa580b68b0 2024-04-25T09:54:40.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.894+0000 7faa5f02a640 1 -- 172.21.15.7:0/2582572267 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa580685d0 con 0x7faa580b68b0 2024-04-25T09:54:40.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.895+0000 7faa557fa640 1 -- 172.21.15.7:0/2582572267 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faa4801a070 con 0x7faa580b68b0 2024-04-25T09:54:40.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.895+0000 7faa557fa640 1 --2- 172.21.15.7:0/2582572267 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faa4406b4d0 0x7faa4406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:40.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.895+0000 7faa557fa640 1 -- 172.21.15.7:0/2582572267 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7faa48089870 con 0x7faa580b68b0 2024-04-25T09:54:40.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.895+0000 7faa57fff640 1 --2- 172.21.15.7:0/2582572267 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faa4406b4d0 0x7faa4406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:40.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.896+0000 7faa57fff640 1 --2- 172.21.15.7:0/2582572267 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faa4406b4d0 0x7faa4406d990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faa4c034000 tx=0x7faa4c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:40.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:40.900+0000 7faa557fa640 1 -- 172.21.15.7:0/2582572267 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faa48057eb0 con 0x7faa580b68b0 2024-04-25T09:54:41.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.078+0000 7faa5f02a640 1 -- 172.21.15.7:0/2582572267 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7faa580d4070 con 0x7faa580b68b0 2024-04-25T09:54:41.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.079+0000 7faa557fa640 1 -- 172.21.15.7:0/2582572267 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7faa4805bf50 con 0x7faa580b68b0 2024-04-25T09:54:41.081 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:54:41.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.081+0000 7faa5f02a640 1 -- 172.21.15.7:0/2582572267 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faa4406b4d0 msgr2=0x7faa4406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:41.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.081+0000 7faa5f02a640 1 --2- 172.21.15.7:0/2582572267 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faa4406b4d0 0x7faa4406d990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faa4c034000 tx=0x7faa4c02e000 comp rx=0 tx=0).stop 2024-04-25T09:54:41.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.081+0000 7faa5f02a640 1 -- 172.21.15.7:0/2582572267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa580b68b0 msgr2=0x7faa5814fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:41.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.081+0000 7faa5f02a640 1 --2- 172.21.15.7:0/2582572267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa580b68b0 0x7faa5814fd80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faa4800c500 tx=0x7faa4800c9c0 comp rx=0 tx=0).stop 2024-04-25T09:54:41.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.081+0000 7faa5f02a640 1 -- 172.21.15.7:0/2582572267 shutdown_connections 2024-04-25T09:54:41.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.081+0000 7faa5f02a640 1 --2- 172.21.15.7:0/2582572267 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faa4406b4d0 0x7faa4406d990 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:41.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.081+0000 7faa5f02a640 1 --2- 172.21.15.7:0/2582572267 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faa580d2c40 0x7faa580cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:41.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.081+0000 7faa5f02a640 1 --2- 172.21.15.7:0/2582572267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa580d0780 0x7faa5815c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:41.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.081+0000 7faa5f02a640 1 --2- 172.21.15.7:0/2582572267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa580b68b0 0x7faa5814fd80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:41.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.081+0000 7faa5f02a640 1 -- 172.21.15.7:0/2582572267 >> 172.21.15.7:0/2582572267 conn(0x7faa580726b0 msgr2=0x7faa5815fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:41.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.081+0000 7faa5f02a640 1 -- 172.21.15.7:0/2582572267 shutdown_connections 2024-04-25T09:54:41.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.081+0000 7faa5f02a640 1 -- 172.21.15.7:0/2582572267 wait complete. 2024-04-25T09:54:41.094 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:54:41.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.193+0000 7fdab03ce640 1 Processor -- start 2024-04-25T09:54:41.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.193+0000 7fdab03ce640 1 -- start start 2024-04-25T09:54:41.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.194+0000 7fdab03ce640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdaa815db00 0x7fdaa80d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:41.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.194+0000 7fdab03ce640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaa80d1e80 con 0x7fdaa80b53b0 2024-04-25T09:54:41.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.194+0000 7fdab03ce640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaa8162490 con 0x7fdaa80ce2b0 2024-04-25T09:54:41.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.194+0000 7fdab03ce640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa80b5930 con 0x7fdaa815db00 2024-04-25T09:54:41.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.194+0000 7fdaad969640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fdaa80b53b0 0x7fdaa8161670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35466/0 (socket says 172.21.15.7:35466) 2024-04-25T09:54:41.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.194+0000 7fdaad969640 1 -- 172.21.15.7:0/2656945724 learned_addr learned my addr 172.21.15.7:0/2656945724 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:41.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.194+0000 7fdaae16a640 1 --2- 172.21.15.7:0/2656945724 >> v2:172.21.15.55:3300/0 conn(0x7fdaa815db00 0x7fdaa80d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:41.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.194+0000 7fdaad168640 1 -- 172.21.15.7:0/2656945724 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2318390185 0 0) 0x7fdaa80d1e80 con 0x7fdaa80b53b0 2024-04-25T09:54:41.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.194+0000 7fdaad168640 1 -- 172.21.15.7:0/2656945724 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda94003520 con 0x7fdaa80b53b0 2024-04-25T09:54:41.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.195+0000 7fdaae16a640 1 -- 172.21.15.7:0/2656945724 >> v1:172.21.15.55:6789/0 conn(0x7fdaa80ce2b0 legacy=0x7fdaa8161d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:41.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.195+0000 7fdaae16a640 1 -- 172.21.15.7:0/2656945724 >> v1:172.21.15.7:6789/0 conn(0x7fdaa80b53b0 legacy=0x7fdaa8161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:41.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.195+0000 7fdaad168640 1 -- 172.21.15.7:0/2656945724 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 231446692 0 0) 0x7fda94003520 con 0x7fdaa80b53b0 2024-04-25T09:54:41.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.195+0000 7fdaae16a640 1 -- 172.21.15.7:0/2656945724 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa80b5c10 con 0x7fdaa815db00 2024-04-25T09:54:41.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.195+0000 7fdaae16a640 1 --2- 172.21.15.7:0/2656945724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdaa815db00 0x7fdaa80d0340 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40097a0 tx=0x7fdaa402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd64c58ef03cab82 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:41.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.196+0000 7fdaad168640 1 -- 172.21.15.7:0/2656945724 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4037070 con 0x7fdaa815db00 2024-04-25T09:54:41.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.196+0000 7fdaad168640 1 -- 172.21.15.7:0/2656945724 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa402ac50 con 0x7fdaa815db00 2024-04-25T09:54:41.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.196+0000 7fdaad168640 1 -- 172.21.15.7:0/2656945724 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda98001670 con 0x7fdaa815db00 2024-04-25T09:54:41.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.196+0000 7fdab03ce640 1 -- 172.21.15.7:0/2656945724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdaa815db00 msgr2=0x7fdaa80d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:41.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.196+0000 7fdab03ce640 1 --2- 172.21.15.7:0/2656945724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdaa815db00 0x7fdaa80d0340 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40097a0 tx=0x7fdaa402a1c0 comp rx=0 tx=0).stop 2024-04-25T09:54:41.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.196+0000 7fdab03ce640 1 -- 172.21.15.7:0/2656945724 shutdown_connections 2024-04-25T09:54:41.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.196+0000 7fdab03ce640 1 --2- 172.21.15.7:0/2656945724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdaa815db00 0x7fdaa80d0340 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:41.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.196+0000 7fdab03ce640 1 -- 172.21.15.7:0/2656945724 >> 172.21.15.7:0/2656945724 conn(0x7fdaa8072290 msgr2=0x7fdaa80726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:41.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.196+0000 7fdab03ce640 1 -- 172.21.15.7:0/2656945724 shutdown_connections 2024-04-25T09:54:41.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.196+0000 7fdab03ce640 1 -- 172.21.15.7:0/2656945724 wait complete. 2024-04-25T09:54:41.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.197+0000 7fdab03ce640 1 Processor -- start 2024-04-25T09:54:41.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.197+0000 7fdab03ce640 1 -- start start 2024-04-25T09:54:41.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.198+0000 7fdab03ce640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdaa80b53b0 0x7fdaa80c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:41.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.198+0000 7fdab03ce640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdaa80ce2b0 0x7fdaa81e9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:41.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.198+0000 7fdab03ce640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdaa815db00 0x7fdaa8147550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:41.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.198+0000 7fdab03ce640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa80b61d0 con 0x7fdaa80b53b0 2024-04-25T09:54:41.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.198+0000 7fdab03ce640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa815dee0 con 0x7fdaa815db00 2024-04-25T09:54:41.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.198+0000 7fdab03ce640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa80d3660 con 0x7fdaa80ce2b0 2024-04-25T09:54:41.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.198+0000 7fdaae16a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdaa80b53b0 0x7fdaa80c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:41.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.198+0000 7fdaae16a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdaa80b53b0 0x7fdaa80c6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42670/0 (socket says 172.21.15.7:42670) 2024-04-25T09:54:41.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.198+0000 7fdaae16a640 1 -- 172.21.15.7:0/3154903080 learned_addr learned my addr 172.21.15.7:0/3154903080 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:41.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.198+0000 7fdaae96b640 1 --2- 172.21.15.7:0/3154903080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdaa815db00 0x7fdaa8147550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:41.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.198+0000 7fdaad969640 1 --2- 172.21.15.7:0/3154903080 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdaa80ce2b0 0x7fdaa81e9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:41.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.199+0000 7fdaae16a640 1 -- 172.21.15.7:0/3154903080 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdaa80ce2b0 msgr2=0x7fdaa81e9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:41.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.199+0000 7fdaae16a640 1 --2- 172.21.15.7:0/3154903080 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdaa80ce2b0 0x7fdaa81e9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:41.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.199+0000 7fdaae16a640 1 -- 172.21.15.7:0/3154903080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdaa815db00 msgr2=0x7fdaa8147550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:41.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.199+0000 7fdaae16a640 1 --2- 172.21.15.7:0/3154903080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdaa815db00 0x7fdaa8147550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:41.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.199+0000 7fdaae16a640 1 -- 172.21.15.7:0/3154903080 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa81455a0 con 0x7fdaa80b53b0 2024-04-25T09:54:41.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.199+0000 7fdaae96b640 1 --2- 172.21.15.7:0/3154903080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdaa815db00 0x7fdaa8147550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:41.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.199+0000 7fdaae16a640 1 --2- 172.21.15.7:0/3154903080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdaa80b53b0 0x7fdaa80c6440 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40098c0 tx=0x7fdaa40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:41.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.199+0000 7fda9effd640 1 -- 172.21.15.7:0/3154903080 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4040020 con 0x7fdaa80b53b0 2024-04-25T09:54:41.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.199+0000 7fda9effd640 1 -- 172.21.15.7:0/3154903080 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa4038040 con 0x7fdaa80b53b0 2024-04-25T09:54:41.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.199+0000 7fda9effd640 1 -- 172.21.15.7:0/3154903080 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4037070 con 0x7fdaa80b53b0 2024-04-25T09:54:41.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.199+0000 7fdab03ce640 1 -- 172.21.15.7:0/3154903080 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa80c6980 con 0x7fdaa80b53b0 2024-04-25T09:54:41.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.199+0000 7fdab03ce640 1 -- 172.21.15.7:0/3154903080 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa81e94d0 con 0x7fdaa80b53b0 2024-04-25T09:54:41.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.200+0000 7fdab03ce640 1 -- 172.21.15.7:0/3154903080 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa8068fd0 con 0x7fdaa80b53b0 2024-04-25T09:54:41.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.200+0000 7fda9effd640 1 -- 172.21.15.7:0/3154903080 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdaa4043020 con 0x7fdaa80b53b0 2024-04-25T09:54:41.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.201+0000 7fda9effd640 1 --2- 172.21.15.7:0/3154903080 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fda8c06b4d0 0x7fda8c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:41.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.201+0000 7fda9effd640 1 -- 172.21.15.7:0/3154903080 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fdaa40aa550 con 0x7fdaa80b53b0 2024-04-25T09:54:41.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.201+0000 7fdaad969640 1 --2- 172.21.15.7:0/3154903080 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fda8c06b4d0 0x7fda8c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:41.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.201+0000 7fdaad969640 1 --2- 172.21.15.7:0/3154903080 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fda8c06b4d0 0x7fda8c06d990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8159910 tx=0x7fda98009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:41.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.205+0000 7fda9effd640 1 -- 172.21.15.7:0/3154903080 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdaa404a030 con 0x7fdaa80b53b0 2024-04-25T09:54:41.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.398+0000 7fdab03ce640 1 -- 172.21.15.7:0/3154903080 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdaa80d16b0 con 0x7fdaa80b53b0 2024-04-25T09:54:41.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.398+0000 7fda9effd640 1 -- 172.21.15.7:0/3154903080 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdaa80c6980 con 0x7fdaa80b53b0 2024-04-25T09:54:41.401 INFO:teuthology.orchestra.run.smithi007.stderr:listed 0 entries 2024-04-25T09:54:41.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.400+0000 7fdab03ce640 1 -- 172.21.15.7:0/3154903080 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fda8c06b4d0 msgr2=0x7fda8c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:41.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.400+0000 7fdab03ce640 1 --2- 172.21.15.7:0/3154903080 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fda8c06b4d0 0x7fda8c06d990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8159910 tx=0x7fda98009040 comp rx=0 tx=0).stop 2024-04-25T09:54:41.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.400+0000 7fdab03ce640 1 -- 172.21.15.7:0/3154903080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdaa80b53b0 msgr2=0x7fdaa80c6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:41.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.400+0000 7fdab03ce640 1 --2- 172.21.15.7:0/3154903080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdaa80b53b0 0x7fdaa80c6440 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40098c0 tx=0x7fdaa40046c0 comp rx=0 tx=0).stop 2024-04-25T09:54:41.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.400+0000 7fdab03ce640 1 -- 172.21.15.7:0/3154903080 shutdown_connections 2024-04-25T09:54:41.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.400+0000 7fdab03ce640 1 --2- 172.21.15.7:0/3154903080 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fda8c06b4d0 0x7fda8c06d990 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:41.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.400+0000 7fdab03ce640 1 --2- 172.21.15.7:0/3154903080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdaa815db00 0x7fdaa8147550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:41.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.400+0000 7fdab03ce640 1 --2- 172.21.15.7:0/3154903080 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdaa80ce2b0 0x7fdaa81e9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:41.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.400+0000 7fdab03ce640 1 --2- 172.21.15.7:0/3154903080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdaa80b53b0 0x7fdaa80c6440 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:41.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.400+0000 7fdab03ce640 1 -- 172.21.15.7:0/3154903080 >> 172.21.15.7:0/3154903080 conn(0x7fdaa8072290 msgr2=0x7fdaa80d2330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:41.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.400+0000 7fdab03ce640 1 -- 172.21.15.7:0/3154903080 shutdown_connections 2024-04-25T09:54:41.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.400+0000 7fdab03ce640 1 -- 172.21.15.7:0/3154903080 wait complete. 2024-04-25T09:54:41.413 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi007.front.sepia.ceph.com... 2024-04-25T09:54:41.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:41.413 DEBUG:teuthology.orchestra.run.smithi007:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-25T09:54:41.436 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi007.stderr:ceph-fuse[41363]: fuse finished with error 0 and tester_r 0 2024-04-25T09:54:41.437 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:54:41.474 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-04-25T09:54:41.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:41.474 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-25T09:54:41.536 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:54:41.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.674+0000 7ffa7115c640 1 Processor -- start 2024-04-25T09:54:41.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.675+0000 7ffa7115c640 1 -- start start 2024-04-25T09:54:41.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.675+0000 7ffa7115c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffa6c15dd00 0x7ffa6c0b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:41.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.675+0000 7ffa7115c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffa6c0b6a40 0x7ffa6c0b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:41.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.675+0000 7ffa7115c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa6c06cd00 con 0x7ffa6c06bfb0 2024-04-25T09:54:41.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.675+0000 7ffa7115c640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa6c15e0e0 con 0x7ffa6c15dd00 2024-04-25T09:54:41.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.675+0000 7ffa7115c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c06cfe0 con 0x7ffa6c0b6a40 2024-04-25T09:54:41.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.675+0000 7ffa6ad9d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffa6c15dd00 0x7ffa6c0b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:41.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.676+0000 7ffa6ad9d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffa6c15dd00 0x7ffa6c0b5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42680/0 (socket says 172.21.15.7:42680) 2024-04-25T09:54:41.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.676+0000 7ffa6ad9d640 1 -- 172.21.15.7:0/3783923527 learned_addr learned my addr 172.21.15.7:0/3783923527 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:41.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.676+0000 7ffa6a59c640 1 --2- 172.21.15.7:0/3783923527 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffa6c0b6a40 0x7ffa6c0b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:41.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.676+0000 7ffa6ad9d640 1 -- 172.21.15.7:0/3783923527 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffa6c0b6a40 msgr2=0x7ffa6c0b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:41.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.676+0000 7ffa6ad9d640 1 --2- 172.21.15.7:0/3783923527 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffa6c0b6a40 0x7ffa6c0b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:41.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.676+0000 7ffa6ad9d640 1 -- 172.21.15.7:0/3783923527 >> v1:172.21.15.55:6789/0 conn(0x7ffa6c06bfb0 legacy=0x7ffa6c06c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:41.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.676+0000 7ffa6ad9d640 1 -- 172.21.15.7:0/3783923527 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6c0d1ca0 con 0x7ffa6c15dd00 2024-04-25T09:54:41.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.677+0000 7ffa6ad9d640 1 --2- 172.21.15.7:0/3783923527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa6c15dd00 0x7ffa6c0b5750 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c009e50 tx=0x7ffa5c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e292aae60bdcd307 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:41.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.677+0000 7ffa69d9b640 1 -- 172.21.15.7:0/3783923527 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c036070 con 0x7ffa6c15dd00 2024-04-25T09:54:41.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.677+0000 7ffa69d9b640 1 -- 172.21.15.7:0/3783923527 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5c031600 con 0x7ffa6c15dd00 2024-04-25T09:54:41.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.677+0000 7ffa69d9b640 1 -- 172.21.15.7:0/3783923527 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c0319d0 con 0x7ffa6c15dd00 2024-04-25T09:54:41.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.677+0000 7ffa7115c640 1 -- 172.21.15.7:0/3783923527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa6c15dd00 msgr2=0x7ffa6c0b5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:41.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.677+0000 7ffa7115c640 1 --2- 172.21.15.7:0/3783923527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa6c15dd00 0x7ffa6c0b5750 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c009e50 tx=0x7ffa5c02a7a0 comp rx=0 tx=0).stop 2024-04-25T09:54:41.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.677+0000 7ffa7115c640 1 -- 172.21.15.7:0/3783923527 shutdown_connections 2024-04-25T09:54:41.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.677+0000 7ffa7115c640 1 --2- 172.21.15.7:0/3783923527 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffa6c0b6a40 0x7ffa6c0b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:41.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.677+0000 7ffa7115c640 1 --2- 172.21.15.7:0/3783923527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa6c15dd00 0x7ffa6c0b5750 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:41.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.677+0000 7ffa7115c640 1 -- 172.21.15.7:0/3783923527 >> 172.21.15.7:0/3783923527 conn(0x7ffa6c0d07b0 msgr2=0x7ffa6c0d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:41.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.677+0000 7ffa7115c640 1 -- 172.21.15.7:0/3783923527 shutdown_connections 2024-04-25T09:54:41.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.677+0000 7ffa7115c640 1 -- 172.21.15.7:0/3783923527 wait complete. 2024-04-25T09:54:41.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.679+0000 7ffa7115c640 1 Processor -- start 2024-04-25T09:54:41.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.679+0000 7ffa7115c640 1 -- start start 2024-04-25T09:54:41.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.679+0000 7ffa7115c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa6c06bfb0 0x7ffa6c15f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:41.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.679+0000 7ffa7115c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa6c0b6a40 0x7ffa6c14ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:41.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.679+0000 7ffa7115c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffa6c15dd00 0x7ffa6c0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:41.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.679+0000 7ffa7115c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c0d2780 con 0x7ffa6c0b6a40 2024-04-25T09:54:41.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.679+0000 7ffa7115c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c0d2260 con 0x7ffa6c06bfb0 2024-04-25T09:54:41.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.679+0000 7ffa7115c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c0d2900 con 0x7ffa6c15dd00 2024-04-25T09:54:41.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.680+0000 7ffa6a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa6c0b6a40 0x7ffa6c14ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:41.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.680+0000 7ffa6a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa6c0b6a40 0x7ffa6c14ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42686/0 (socket says 172.21.15.7:42686) 2024-04-25T09:54:41.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.680+0000 7ffa6a59c640 1 -- 172.21.15.7:0/1102487075 learned_addr learned my addr 172.21.15.7:0/1102487075 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:41.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.680+0000 7ffa6ad9d640 1 --2- 172.21.15.7:0/1102487075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa6c06bfb0 0x7ffa6c15f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:41.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.680+0000 7ffa6b59e640 1 --2- 172.21.15.7:0/1102487075 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffa6c15dd00 0x7ffa6c0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:41.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.680+0000 7ffa6a59c640 1 -- 172.21.15.7:0/1102487075 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffa6c15dd00 msgr2=0x7ffa6c0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:41.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.680+0000 7ffa6a59c640 1 --2- 172.21.15.7:0/1102487075 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffa6c15dd00 0x7ffa6c0c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:41.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.680+0000 7ffa6a59c640 1 -- 172.21.15.7:0/1102487075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa6c06bfb0 msgr2=0x7ffa6c15f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:41.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.680+0000 7ffa6a59c640 1 --2- 172.21.15.7:0/1102487075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa6c06bfb0 0x7ffa6c15f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:41.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.680+0000 7ffa6a59c640 1 -- 172.21.15.7:0/1102487075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6c14ff00 con 0x7ffa6c0b6a40 2024-04-25T09:54:41.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.680+0000 7ffa6ad9d640 1 --2- 172.21.15.7:0/1102487075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa6c06bfb0 0x7ffa6c15f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:41.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.680+0000 7ffa6a59c640 1 --2- 172.21.15.7:0/1102487075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa6c0b6a40 0x7ffa6c14ee80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400d800 tx=0x7ffa5400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:41.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.680+0000 7ffa637fe640 1 -- 172.21.15.7:0/1102487075 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5400b6c0 con 0x7ffa6c0b6a40 2024-04-25T09:54:41.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.680+0000 7ffa637fe640 1 -- 172.21.15.7:0/1102487075 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa54019070 con 0x7ffa6c0b6a40 2024-04-25T09:54:41.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.680+0000 7ffa637fe640 1 -- 172.21.15.7:0/1102487075 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5400bac0 con 0x7ffa6c0b6a40 2024-04-25T09:54:41.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.680+0000 7ffa7115c640 1 -- 172.21.15.7:0/1102487075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa6c14f940 con 0x7ffa6c0b6a40 2024-04-25T09:54:41.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.680+0000 7ffa7115c640 1 -- 172.21.15.7:0/1102487075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6c1501e0 con 0x7ffa6c0b6a40 2024-04-25T09:54:41.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.681+0000 7ffa7115c640 1 -- 172.21.15.7:0/1102487075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa6c068fd0 con 0x7ffa6c0b6a40 2024-04-25T09:54:41.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.682+0000 7ffa637fe640 1 -- 172.21.15.7:0/1102487075 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffa5400bc60 con 0x7ffa6c0b6a40 2024-04-25T09:54:41.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.682+0000 7ffa637fe640 1 --2- 172.21.15.7:0/1102487075 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ffa4c06b4d0 0x7ffa4c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:41.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.682+0000 7ffa637fe640 1 -- 172.21.15.7:0/1102487075 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ffa5408aa00 con 0x7ffa6c0b6a40 2024-04-25T09:54:41.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.682+0000 7ffa6ad9d640 1 --2- 172.21.15.7:0/1102487075 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ffa4c06b4d0 0x7ffa4c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:41.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.683+0000 7ffa6ad9d640 1 --2- 172.21.15.7:0/1102487075 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ffa4c06b4d0 0x7ffa4c06d990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c033000 tx=0x7ffa5c009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:41.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.686+0000 7ffa637fe640 1 -- 172.21.15.7:0/1102487075 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffa54059540 con 0x7ffa6c0b6a40 2024-04-25T09:54:41.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.870+0000 7ffa7115c640 1 -- 172.21.15.7:0/1102487075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa6c0d1620 con 0x7ffa6c0b6a40 2024-04-25T09:54:41.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.871+0000 7ffa637fe640 1 -- 172.21.15.7:0/1102487075 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18418 (secure 0 0 0) 0x7ffa54058e40 con 0x7ffa6c0b6a40 2024-04-25T09:54:41.875 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:41.875 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:54:32.606761+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:54:26.011833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:54:26.535536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:54:30.264996+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:54:41.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.873+0000 7ffa7115c640 1 -- 172.21.15.7:0/1102487075 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ffa4c06b4d0 msgr2=0x7ffa4c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:41.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.873+0000 7ffa7115c640 1 --2- 172.21.15.7:0/1102487075 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ffa4c06b4d0 0x7ffa4c06d990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c033000 tx=0x7ffa5c009000 comp rx=0 tx=0).stop 2024-04-25T09:54:41.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.873+0000 7ffa7115c640 1 -- 172.21.15.7:0/1102487075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa6c0b6a40 msgr2=0x7ffa6c14ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:41.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.873+0000 7ffa7115c640 1 --2- 172.21.15.7:0/1102487075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa6c0b6a40 0x7ffa6c14ee80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400d800 tx=0x7ffa5400dcc0 comp rx=0 tx=0).stop 2024-04-25T09:54:41.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.873+0000 7ffa7115c640 1 -- 172.21.15.7:0/1102487075 shutdown_connections 2024-04-25T09:54:41.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.873+0000 7ffa7115c640 1 --2- 172.21.15.7:0/1102487075 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ffa4c06b4d0 0x7ffa4c06d990 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:41.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.874+0000 7ffa7115c640 1 --2- 172.21.15.7:0/1102487075 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffa6c15dd00 0x7ffa6c0c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:41.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.874+0000 7ffa7115c640 1 --2- 172.21.15.7:0/1102487075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa6c0b6a40 0x7ffa6c14ee80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:41.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.874+0000 7ffa7115c640 1 --2- 172.21.15.7:0/1102487075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa6c06bfb0 0x7ffa6c15f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:41.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.874+0000 7ffa7115c640 1 -- 172.21.15.7:0/1102487075 >> 172.21.15.7:0/1102487075 conn(0x7ffa6c0d07b0 msgr2=0x7ffa6c0d2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:41.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.874+0000 7ffa7115c640 1 -- 172.21.15.7:0/1102487075 shutdown_connections 2024-04-25T09:54:41.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.874+0000 7ffa7115c640 1 -- 172.21.15.7:0/1102487075 wait complete. 2024-04-25T09:54:41.887 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:54:41.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.985+0000 7f8c648f5640 1 Processor -- start 2024-04-25T09:54:41.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.985+0000 7f8c648f5640 1 -- start start 2024-04-25T09:54:41.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.986+0000 7f8c648f5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c6015db00 0x7f8c600d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:41.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.986+0000 7f8c648f5640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8c600b53b0 0x7f8c600d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:41.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.986+0000 7f8c648f5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c600d1e80 con 0x7f8c600ce2b0 2024-04-25T09:54:41.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.986+0000 7f8c648f5640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c600b5930 con 0x7f8c600b53b0 2024-04-25T09:54:41.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.986+0000 7f8c648f5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c600b5c10 con 0x7f8c6015db00 2024-04-25T09:54:41.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.986+0000 7f8c57fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8c600b53b0 0x7f8c600d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:41.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.986+0000 7f8c57fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8c600b53b0 0x7f8c600d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42696/0 (socket says 172.21.15.7:42696) 2024-04-25T09:54:41.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.986+0000 7f8c57fff640 1 -- 172.21.15.7:0/3576876666 learned_addr learned my addr 172.21.15.7:0/3576876666 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:41.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.986+0000 7f8c5e59c640 1 --2- 172.21.15.7:0/3576876666 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c6015db00 0x7f8c600d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:41.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.986+0000 7f8c57fff640 1 -- 172.21.15.7:0/3576876666 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c6015db00 msgr2=0x7f8c600d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:41.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.986+0000 7f8c57fff640 1 --2- 172.21.15.7:0/3576876666 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c6015db00 0x7f8c600d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:41.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.986+0000 7f8c57fff640 1 -- 172.21.15.7:0/3576876666 >> v1:172.21.15.55:6789/0 conn(0x7f8c600ce2b0 legacy=0x7f8c60161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:41.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.986+0000 7f8c57fff640 1 -- 172.21.15.7:0/3576876666 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c600b5ef0 con 0x7f8c600b53b0 2024-04-25T09:54:41.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.987+0000 7f8c57fff640 1 --2- 172.21.15.7:0/3576876666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c600b53b0 0x7f8c600d0880 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8c48009870 tx=0x7f8c4802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=376553bcdd24a7c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:41.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.987+0000 7f8c5dd9b640 1 -- 172.21.15.7:0/3576876666 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c48037070 con 0x7f8c600b53b0 2024-04-25T09:54:41.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.987+0000 7f8c5dd9b640 1 -- 172.21.15.7:0/3576876666 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c48032440 con 0x7f8c600b53b0 2024-04-25T09:54:41.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.987+0000 7f8c5dd9b640 1 -- 172.21.15.7:0/3576876666 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c48032810 con 0x7f8c600b53b0 2024-04-25T09:54:41.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.988+0000 7f8c648f5640 1 -- 172.21.15.7:0/3576876666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c600b53b0 msgr2=0x7f8c600d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:41.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.988+0000 7f8c648f5640 1 --2- 172.21.15.7:0/3576876666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c600b53b0 0x7f8c600d0880 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8c48009870 tx=0x7f8c4802a210 comp rx=0 tx=0).stop 2024-04-25T09:54:41.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.988+0000 7f8c648f5640 1 -- 172.21.15.7:0/3576876666 shutdown_connections 2024-04-25T09:54:41.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.988+0000 7f8c648f5640 1 --2- 172.21.15.7:0/3576876666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c600b53b0 0x7f8c600d0880 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:41.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.988+0000 7f8c648f5640 1 --2- 172.21.15.7:0/3576876666 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c6015db00 0x7f8c600d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:41.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.988+0000 7f8c648f5640 1 -- 172.21.15.7:0/3576876666 >> 172.21.15.7:0/3576876666 conn(0x7f8c60072290 msgr2=0x7f8c600726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:41.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.988+0000 7f8c648f5640 1 -- 172.21.15.7:0/3576876666 shutdown_connections 2024-04-25T09:54:41.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.988+0000 7f8c648f5640 1 -- 172.21.15.7:0/3576876666 wait complete. 2024-04-25T09:54:41.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.989+0000 7f8c648f5640 1 Processor -- start 2024-04-25T09:54:41.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.989+0000 7f8c648f5640 1 -- start start 2024-04-25T09:54:41.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.990+0000 7f8c648f5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c600b53b0 0x7f8c6014e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:41.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.990+0000 7f8c648f5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c600ce2b0 0x7f8c60155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:41.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.990+0000 7f8c648f5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c6015db00 0x7f8c600c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:41.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.990+0000 7f8c648f5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c600d3660 con 0x7f8c600b53b0 2024-04-25T09:54:41.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.990+0000 7f8c648f5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c600b61d0 con 0x7f8c6015db00 2024-04-25T09:54:41.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.990+0000 7f8c648f5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c600b6c10 con 0x7f8c600ce2b0 2024-04-25T09:54:41.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.990+0000 7f8c5e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c600b53b0 0x7f8c6014e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:41.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.990+0000 7f8c5e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c600b53b0 0x7f8c6014e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42698/0 (socket says 172.21.15.7:42698) 2024-04-25T09:54:41.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.990+0000 7f8c5e59c640 1 -- 172.21.15.7:0/1970019356 learned_addr learned my addr 172.21.15.7:0/1970019356 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:41.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.990+0000 7f8c5e59c640 1 -- 172.21.15.7:0/1970019356 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c600ce2b0 msgr2=0x7f8c60155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:41.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.990+0000 7f8c5e59c640 1 --2- 172.21.15.7:0/1970019356 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c600ce2b0 0x7f8c60155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:41.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.990+0000 7f8c5e59c640 1 -- 172.21.15.7:0/1970019356 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c6015db00 msgr2=0x7f8c600c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:41.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.990+0000 7f8c5e59c640 1 --2- 172.21.15.7:0/1970019356 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c6015db00 0x7f8c600c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:41.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.990+0000 7f8c5e59c640 1 -- 172.21.15.7:0/1970019356 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c60155410 con 0x7f8c600b53b0 2024-04-25T09:54:41.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.990+0000 7f8c5e59c640 1 --2- 172.21.15.7:0/1970019356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c600b53b0 0x7f8c6014e670 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000d5f0 tx=0x7f8c5000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:41.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.990+0000 7f8c56ffd640 1 -- 172.21.15.7:0/1970019356 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c500125f0 con 0x7f8c600b53b0 2024-04-25T09:54:41.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.990+0000 7f8c56ffd640 1 -- 172.21.15.7:0/1970019356 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c50019070 con 0x7f8c600b53b0 2024-04-25T09:54:41.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.990+0000 7f8c648f5640 1 -- 172.21.15.7:0/1970019356 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c600c98f0 con 0x7f8c600b53b0 2024-04-25T09:54:41.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.990+0000 7f8c56ffd640 1 -- 172.21.15.7:0/1970019356 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c500129d0 con 0x7f8c600b53b0 2024-04-25T09:54:41.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.991+0000 7f8c648f5640 1 -- 172.21.15.7:0/1970019356 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c60155990 con 0x7f8c600b53b0 2024-04-25T09:54:41.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.991+0000 7f8c648f5640 1 -- 172.21.15.7:0/1970019356 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c60068fd0 con 0x7f8c600b53b0 2024-04-25T09:54:41.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.992+0000 7f8c56ffd640 1 -- 172.21.15.7:0/1970019356 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8c50012b70 con 0x7f8c600b53b0 2024-04-25T09:54:41.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.992+0000 7f8c56ffd640 1 --2- 172.21.15.7:0/1970019356 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8c4006b500 0x7f8c4006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:41.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.992+0000 7f8c56ffd640 1 -- 172.21.15.7:0/1970019356 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8c5008a920 con 0x7f8c600b53b0 2024-04-25T09:54:41.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.992+0000 7f8c57fff640 1 --2- 172.21.15.7:0/1970019356 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8c4006b500 0x7f8c4006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:41.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.993+0000 7f8c57fff640 1 --2- 172.21.15.7:0/1970019356 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8c4006b500 0x7f8c4006d9c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8c48034000 tx=0x7f8c4802c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:41.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:41.996+0000 7f8c56ffd640 1 -- 172.21.15.7:0/1970019356 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8c50059450 con 0x7f8c600b53b0 2024-04-25T09:54:42.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.177+0000 7f8c648f5640 1 -- 172.21.15.7:0/1970019356 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c600d16b0 con 0x7f8c600b53b0 2024-04-25T09:54:42.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.179+0000 7f8c56ffd640 1 -- 172.21.15.7:0/1970019356 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18418 (secure 0 0 0) 0x7f8c50058d50 con 0x7f8c600b53b0 2024-04-25T09:54:42.181 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:42.182 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:54:32.606761+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:54:26.011833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:54:26.535536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:54:30.264996+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:54:42.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.180+0000 7f8c648f5640 1 -- 172.21.15.7:0/1970019356 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8c4006b500 msgr2=0x7f8c4006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:42.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.180+0000 7f8c648f5640 1 --2- 172.21.15.7:0/1970019356 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8c4006b500 0x7f8c4006d9c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8c48034000 tx=0x7f8c4802c000 comp rx=0 tx=0).stop 2024-04-25T09:54:42.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.180+0000 7f8c648f5640 1 -- 172.21.15.7:0/1970019356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c600b53b0 msgr2=0x7f8c6014e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:42.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.180+0000 7f8c648f5640 1 --2- 172.21.15.7:0/1970019356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c600b53b0 0x7f8c6014e670 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000d5f0 tx=0x7f8c5000dab0 comp rx=0 tx=0).stop 2024-04-25T09:54:42.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.180+0000 7f8c648f5640 1 -- 172.21.15.7:0/1970019356 shutdown_connections 2024-04-25T09:54:42.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.180+0000 7f8c648f5640 1 --2- 172.21.15.7:0/1970019356 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8c4006b500 0x7f8c4006d9c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:42.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.180+0000 7f8c648f5640 1 --2- 172.21.15.7:0/1970019356 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c6015db00 0x7f8c600c8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:42.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.180+0000 7f8c648f5640 1 --2- 172.21.15.7:0/1970019356 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c600ce2b0 0x7f8c60155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:42.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.180+0000 7f8c648f5640 1 --2- 172.21.15.7:0/1970019356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c600b53b0 0x7f8c6014e670 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:42.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.180+0000 7f8c648f5640 1 -- 172.21.15.7:0/1970019356 >> 172.21.15.7:0/1970019356 conn(0x7f8c60072290 msgr2=0x7f8c6015c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:42.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.181+0000 7f8c648f5640 1 -- 172.21.15.7:0/1970019356 shutdown_connections 2024-04-25T09:54:42.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.181+0000 7f8c648f5640 1 -- 172.21.15.7:0/1970019356 wait complete. 2024-04-25T09:54:42.194 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:54:42.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.296+0000 7fc66624a640 1 Processor -- start 2024-04-25T09:54:42.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.296+0000 7fc66624a640 1 -- start start 2024-04-25T09:54:42.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.297+0000 7fc66624a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc6600d3760 0x7fc66015eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:42.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.297+0000 7fc66624a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc6600ce830 0x7fc6600b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:42.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.297+0000 7fc66624a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6600ced10 con 0x7fc66015f1c0 2024-04-25T09:54:42.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.297+0000 7fc66624a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6600ce380 con 0x7fc6600d3760 2024-04-25T09:54:42.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.297+0000 7fc66624a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc66015f000 con 0x7fc6600ce830 2024-04-25T09:54:42.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.297+0000 7fc65f7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc6600d3760 0x7fc66015eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:42.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.297+0000 7fc65f7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc6600d3760 0x7fc66015eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42700/0 (socket says 172.21.15.7:42700) 2024-04-25T09:54:42.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.297+0000 7fc65effd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc66015f1c0 0x7fc6600d3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35474/0 (socket says 172.21.15.7:35474) 2024-04-25T09:54:42.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.297+0000 7fc65f7fe640 1 -- 172.21.15.7:0/3421575747 learned_addr learned my addr 172.21.15.7:0/3421575747 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:42.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.297+0000 7fc65ffff640 1 --2- 172.21.15.7:0/3421575747 >> v2:172.21.15.55:3300/0 conn(0x7fc6600ce830 0x7fc6600b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:42.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.297+0000 7fc65f7fe640 1 -- 172.21.15.7:0/3421575747 >> v2:172.21.15.55:3300/0 conn(0x7fc6600ce830 msgr2=0x7fc6600b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:42.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.297+0000 7fc65f7fe640 1 --2- 172.21.15.7:0/3421575747 >> v2:172.21.15.55:3300/0 conn(0x7fc6600ce830 0x7fc6600b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:42.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.297+0000 7fc65f7fe640 1 -- 172.21.15.7:0/3421575747 >> v1:172.21.15.7:6789/0 conn(0x7fc66015f1c0 legacy=0x7fc6600d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:42.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.297+0000 7fc65f7fe640 1 -- 172.21.15.7:0/3421575747 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6600d1b40 con 0x7fc6600d3760 2024-04-25T09:54:42.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.297+0000 7fc65e7fc640 1 -- 172.21.15.7:0/3421575747 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3024231997 0 0) 0x7fc6600ced10 con 0x7fc66015f1c0 2024-04-25T09:54:42.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.298+0000 7fc65f7fe640 1 --2- 172.21.15.7:0/3421575747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6600d3760 0x7fc66015eac0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc6600cf180 tx=0x7fc65002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d269a4a2e1d1897 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:42.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.298+0000 7fc65e7fc640 1 -- 172.21.15.7:0/3421575747 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc650037070 con 0x7fc6600d3760 2024-04-25T09:54:42.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.298+0000 7fc65e7fc640 1 -- 172.21.15.7:0/3421575747 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc650032440 con 0x7fc6600d3760 2024-04-25T09:54:42.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.298+0000 7fc65e7fc640 1 -- 172.21.15.7:0/3421575747 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc650032810 con 0x7fc6600d3760 2024-04-25T09:54:42.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.299+0000 7fc66624a640 1 -- 172.21.15.7:0/3421575747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6600d3760 msgr2=0x7fc66015eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:42.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.299+0000 7fc66624a640 1 --2- 172.21.15.7:0/3421575747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6600d3760 0x7fc66015eac0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc6600cf180 tx=0x7fc65002a270 comp rx=0 tx=0).stop 2024-04-25T09:54:42.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.299+0000 7fc66624a640 1 -- 172.21.15.7:0/3421575747 shutdown_connections 2024-04-25T09:54:42.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.299+0000 7fc66624a640 1 --2- 172.21.15.7:0/3421575747 >> v2:172.21.15.55:3300/0 conn(0x7fc6600ce830 0x7fc6600b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:42.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.299+0000 7fc66624a640 1 --2- 172.21.15.7:0/3421575747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6600d3760 0x7fc66015eac0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:42.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.299+0000 7fc66624a640 1 -- 172.21.15.7:0/3421575747 >> 172.21.15.7:0/3421575747 conn(0x7fc660072680 msgr2=0x7fc660072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:42.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.299+0000 7fc66624a640 1 -- 172.21.15.7:0/3421575747 shutdown_connections 2024-04-25T09:54:42.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.299+0000 7fc66624a640 1 -- 172.21.15.7:0/3421575747 wait complete. 2024-04-25T09:54:42.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.300+0000 7fc66624a640 1 Processor -- start 2024-04-25T09:54:42.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.300+0000 7fc66624a640 1 -- start start 2024-04-25T09:54:42.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.301+0000 7fc66624a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6600ce830 0x7fc66014bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:42.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.301+0000 7fc66624a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6600d3760 0x7fc6600cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:42.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.301+0000 7fc66624a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc66015f1c0 0x7fc6600ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:42.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.301+0000 7fc66624a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66015de10 con 0x7fc6600d3760 2024-04-25T09:54:42.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.301+0000 7fc66624a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6600d2190 con 0x7fc66015f1c0 2024-04-25T09:54:42.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.301+0000 7fc66624a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6600b2780 con 0x7fc6600ce830 2024-04-25T09:54:42.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.301+0000 7fc65effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6600d3760 0x7fc6600cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:42.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.301+0000 7fc65effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6600d3760 0x7fc6600cc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42702/0 (socket says 172.21.15.7:42702) 2024-04-25T09:54:42.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.301+0000 7fc65effd640 1 -- 172.21.15.7:0/462644969 learned_addr learned my addr 172.21.15.7:0/462644969 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:42.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.301+0000 7fc65ffff640 1 --2- 172.21.15.7:0/462644969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc66015f1c0 0x7fc6600ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:42.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.301+0000 7fc65f7fe640 1 --2- 172.21.15.7:0/462644969 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6600ce830 0x7fc66014bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:42.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.301+0000 7fc65effd640 1 -- 172.21.15.7:0/462644969 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6600ce830 msgr2=0x7fc66014bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:42.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.301+0000 7fc65effd640 1 --2- 172.21.15.7:0/462644969 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6600ce830 0x7fc66014bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:42.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.301+0000 7fc65effd640 1 -- 172.21.15.7:0/462644969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc66015f1c0 msgr2=0x7fc6600ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:42.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.301+0000 7fc65effd640 1 --2- 172.21.15.7:0/462644969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc66015f1c0 0x7fc6600ccbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:42.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.301+0000 7fc65effd640 1 -- 172.21.15.7:0/462644969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66014c130 con 0x7fc6600d3760 2024-04-25T09:54:42.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.301+0000 7fc65effd640 1 --2- 172.21.15.7:0/462644969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6600d3760 0x7fc6600cc6a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc65400c440 tx=0x7fc65400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:42.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.301+0000 7fc647fff640 1 -- 172.21.15.7:0/462644969 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc654018070 con 0x7fc6600d3760 2024-04-25T09:54:42.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.301+0000 7fc647fff640 1 -- 172.21.15.7:0/462644969 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6540074e0 con 0x7fc6600d3760 2024-04-25T09:54:42.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.301+0000 7fc647fff640 1 -- 172.21.15.7:0/462644969 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc654004a20 con 0x7fc6600d3760 2024-04-25T09:54:42.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.301+0000 7fc66624a640 1 -- 172.21.15.7:0/462644969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6600cd460 con 0x7fc6600d3760 2024-04-25T09:54:42.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.302+0000 7fc66624a640 1 -- 172.21.15.7:0/462644969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc660158d00 con 0x7fc6600d3760 2024-04-25T09:54:42.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.302+0000 7fc66624a640 1 -- 172.21.15.7:0/462644969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc660068f60 con 0x7fc6600d3760 2024-04-25T09:54:42.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.303+0000 7fc647fff640 1 -- 172.21.15.7:0/462644969 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc65401b070 con 0x7fc6600d3760 2024-04-25T09:54:42.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.303+0000 7fc647fff640 1 --2- 172.21.15.7:0/462644969 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc64c06b4d0 0x7fc64c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:42.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.303+0000 7fc647fff640 1 -- 172.21.15.7:0/462644969 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc654089850 con 0x7fc6600d3760 2024-04-25T09:54:42.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.303+0000 7fc65f7fe640 1 --2- 172.21.15.7:0/462644969 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc64c06b4d0 0x7fc64c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:42.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.304+0000 7fc65f7fe640 1 --2- 172.21.15.7:0/462644969 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc64c06b4d0 0x7fc64c06d990 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc650034000 tx=0x7fc65002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:42.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.308+0000 7fc647fff640 1 -- 172.21.15.7:0/462644969 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc66014c130 con 0x7fc6600d3760 2024-04-25T09:54:42.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:42.526+0000 7fc66624a640 1 -- 172.21.15.7:0/462644969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc6600ce610 con 0x7fc6600d3760 2024-04-25T09:54:43.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.275+0000 7fc647fff640 1 -- 172.21.15.7:0/462644969 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc6540582f0 con 0x7fc6600d3760 2024-04-25T09:54:43.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.278+0000 7fc66624a640 1 -- 172.21.15.7:0/462644969 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc64c06b4d0 msgr2=0x7fc64c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:43.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.278+0000 7fc66624a640 1 --2- 172.21.15.7:0/462644969 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc64c06b4d0 0x7fc64c06d990 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc650034000 tx=0x7fc65002e000 comp rx=0 tx=0).stop 2024-04-25T09:54:43.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.278+0000 7fc66624a640 1 -- 172.21.15.7:0/462644969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6600d3760 msgr2=0x7fc6600cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:43.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.278+0000 7fc66624a640 1 --2- 172.21.15.7:0/462644969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6600d3760 0x7fc6600cc6a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc65400c440 tx=0x7fc65400c900 comp rx=0 tx=0).stop 2024-04-25T09:54:43.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.278+0000 7fc66624a640 1 -- 172.21.15.7:0/462644969 shutdown_connections 2024-04-25T09:54:43.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.278+0000 7fc66624a640 1 --2- 172.21.15.7:0/462644969 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc64c06b4d0 0x7fc64c06d990 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:43.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.278+0000 7fc66624a640 1 --2- 172.21.15.7:0/462644969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc66015f1c0 0x7fc6600ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:43.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.278+0000 7fc66624a640 1 --2- 172.21.15.7:0/462644969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6600d3760 0x7fc6600cc6a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:43.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.278+0000 7fc66624a640 1 --2- 172.21.15.7:0/462644969 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6600ce830 0x7fc66014bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:43.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.278+0000 7fc66624a640 1 -- 172.21.15.7:0/462644969 >> 172.21.15.7:0/462644969 conn(0x7fc660072680 msgr2=0x7fc6600c92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:43.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.278+0000 7fc66624a640 1 -- 172.21.15.7:0/462644969 shutdown_connections 2024-04-25T09:54:43.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.278+0000 7fc66624a640 1 -- 172.21.15.7:0/462644969 wait complete. 2024-04-25T09:54:43.294 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-04-25T09:54:43.295 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:54:43.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.403+0000 7fc6f07ce640 1 Processor -- start 2024-04-25T09:54:43.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.403+0000 7fc6f07ce640 1 -- start start 2024-04-25T09:54:43.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.403+0000 7fc6f07ce640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc6e80cfc40 0x7fc6e80d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:43.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.403+0000 7fc6f07ce640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6e80cc580 0x7fc6e80cca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:43.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.404+0000 7fc6f07ce640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e80b25e0 con 0x7fc6e80b1480 2024-04-25T09:54:43.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.404+0000 7fc6f07ce640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e815bec0 con 0x7fc6e80cfc40 2024-04-25T09:54:43.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.404+0000 7fc6f07ce640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e80d0560 con 0x7fc6e80cc580 2024-04-25T09:54:43.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.404+0000 7fc6ee56a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc6e80cfc40 0x7fc6e80d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:43.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.404+0000 7fc6ee56a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc6e80cfc40 0x7fc6e80d0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42714/0 (socket says 172.21.15.7:42714) 2024-04-25T09:54:43.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.404+0000 7fc6ee56a640 1 -- 172.21.15.7:0/2223874671 learned_addr learned my addr 172.21.15.7:0/2223874671 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:43.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.404+0000 7fc6eed6b640 1 --2- 172.21.15.7:0/2223874671 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6e80cc580 0x7fc6e80cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:43.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.404+0000 7fc6ee56a640 1 -- 172.21.15.7:0/2223874671 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6e80cc580 msgr2=0x7fc6e80cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:43.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.404+0000 7fc6ee56a640 1 --2- 172.21.15.7:0/2223874671 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6e80cc580 0x7fc6e80cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:43.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.404+0000 7fc6ee56a640 1 -- 172.21.15.7:0/2223874671 >> v1:172.21.15.55:6789/0 conn(0x7fc6e80b1480 legacy=0x7fc6e80b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:43.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.404+0000 7fc6ee56a640 1 -- 172.21.15.7:0/2223874671 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e80b19d0 con 0x7fc6e80cfc40 2024-04-25T09:54:43.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.404+0000 7fc6eed6b640 1 --2- 172.21.15.7:0/2223874671 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6e80cc580 0x7fc6e80cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:43.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.405+0000 7fc6ee56a640 1 --2- 172.21.15.7:0/2223874671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6e80cfc40 0x7fc6e80d0020 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4009870 tx=0x7fc6e402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c7557cf25dcaa74 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:43.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.405+0000 7fc6ed568640 1 -- 172.21.15.7:0/2223874671 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4037070 con 0x7fc6e80cfc40 2024-04-25T09:54:43.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.405+0000 7fc6ed568640 1 -- 172.21.15.7:0/2223874671 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e4032440 con 0x7fc6e80cfc40 2024-04-25T09:54:43.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.405+0000 7fc6ed568640 1 -- 172.21.15.7:0/2223874671 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4032810 con 0x7fc6e80cfc40 2024-04-25T09:54:43.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.405+0000 7fc6f07ce640 1 -- 172.21.15.7:0/2223874671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6e80cfc40 msgr2=0x7fc6e80d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:43.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.405+0000 7fc6f07ce640 1 --2- 172.21.15.7:0/2223874671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6e80cfc40 0x7fc6e80d0020 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4009870 tx=0x7fc6e402a1c0 comp rx=0 tx=0).stop 2024-04-25T09:54:43.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.406+0000 7fc6f07ce640 1 -- 172.21.15.7:0/2223874671 shutdown_connections 2024-04-25T09:54:43.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.406+0000 7fc6f07ce640 1 --2- 172.21.15.7:0/2223874671 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6e80cc580 0x7fc6e80cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:43.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.406+0000 7fc6f07ce640 1 --2- 172.21.15.7:0/2223874671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6e80cfc40 0x7fc6e80d0020 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:43.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.406+0000 7fc6f07ce640 1 -- 172.21.15.7:0/2223874671 >> 172.21.15.7:0/2223874671 conn(0x7fc6e808af80 msgr2=0x7fc6e808b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:43.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.406+0000 7fc6f07ce640 1 -- 172.21.15.7:0/2223874671 shutdown_connections 2024-04-25T09:54:43.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.406+0000 7fc6f07ce640 1 -- 172.21.15.7:0/2223874671 wait complete. 2024-04-25T09:54:43.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.407+0000 7fc6f07ce640 1 Processor -- start 2024-04-25T09:54:43.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.407+0000 7fc6f07ce640 1 -- start start 2024-04-25T09:54:43.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.408+0000 7fc6f07ce640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6e80b1480 0x7fc6e8070460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:43.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.408+0000 7fc6f07ce640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6e80cc580 0x7fc6e80709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:43.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.408+0000 7fc6f07ce640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6e80cfc40 0x7fc6e806c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:43.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.408+0000 7fc6f07ce640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e80b2270 con 0x7fc6e80cc580 2024-04-25T09:54:43.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.408+0000 7fc6f07ce640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e80b1f90 con 0x7fc6e80cfc40 2024-04-25T09:54:43.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.408+0000 7fc6f07ce640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e80ccf50 con 0x7fc6e80b1480 2024-04-25T09:54:43.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.408+0000 7fc6edd69640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6e80cc580 0x7fc6e80709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:43.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.408+0000 7fc6edd69640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6e80cc580 0x7fc6e80709a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42730/0 (socket says 172.21.15.7:42730) 2024-04-25T09:54:43.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.408+0000 7fc6edd69640 1 -- 172.21.15.7:0/2079298223 learned_addr learned my addr 172.21.15.7:0/2079298223 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:43.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.408+0000 7fc6eed6b640 1 --2- 172.21.15.7:0/2079298223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6e80cfc40 0x7fc6e806c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:43.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.408+0000 7fc6ee56a640 1 --2- 172.21.15.7:0/2079298223 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6e80b1480 0x7fc6e8070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:43.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.408+0000 7fc6edd69640 1 -- 172.21.15.7:0/2079298223 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6e80b1480 msgr2=0x7fc6e8070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:43.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.408+0000 7fc6edd69640 1 --2- 172.21.15.7:0/2079298223 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6e80b1480 0x7fc6e8070460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:43.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.408+0000 7fc6edd69640 1 -- 172.21.15.7:0/2079298223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6e80cfc40 msgr2=0x7fc6e806c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:43.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.408+0000 7fc6edd69640 1 --2- 172.21.15.7:0/2079298223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6e80cfc40 0x7fc6e806c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:43.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.408+0000 7fc6edd69640 1 -- 172.21.15.7:0/2079298223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e806d2d0 con 0x7fc6e80cc580 2024-04-25T09:54:43.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.408+0000 7fc6edd69640 1 --2- 172.21.15.7:0/2079298223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6e80cc580 0x7fc6e80709a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc6d800c430 tx=0x7fc6d800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:43.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.408+0000 7fc6deffd640 1 -- 172.21.15.7:0/2079298223 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d80052d0 con 0x7fc6e80cc580 2024-04-25T09:54:43.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.408+0000 7fc6deffd640 1 -- 172.21.15.7:0/2079298223 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d8005490 con 0x7fc6e80cc580 2024-04-25T09:54:43.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.408+0000 7fc6deffd640 1 -- 172.21.15.7:0/2079298223 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8007260 con 0x7fc6e80cc580 2024-04-25T09:54:43.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.408+0000 7fc6f07ce640 1 -- 172.21.15.7:0/2079298223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e806d5b0 con 0x7fc6e80cc580 2024-04-25T09:54:43.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.409+0000 7fc6f07ce640 1 -- 172.21.15.7:0/2079298223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e806db70 con 0x7fc6e80cc580 2024-04-25T09:54:43.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.409+0000 7fc6f07ce640 1 -- 172.21.15.7:0/2079298223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e8068f60 con 0x7fc6e80cc580 2024-04-25T09:54:43.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.410+0000 7fc6deffd640 1 -- 172.21.15.7:0/2079298223 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc6d8007400 con 0x7fc6e80cc580 2024-04-25T09:54:43.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.410+0000 7fc6deffd640 1 --2- 172.21.15.7:0/2079298223 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc6cc06b4d0 0x7fc6cc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:43.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.410+0000 7fc6deffd640 1 -- 172.21.15.7:0/2079298223 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc6d8089a30 con 0x7fc6e80cc580 2024-04-25T09:54:43.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.410+0000 7fc6ee56a640 1 --2- 172.21.15.7:0/2079298223 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc6cc06b4d0 0x7fc6cc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:43.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.411+0000 7fc6ee56a640 1 --2- 172.21.15.7:0/2079298223 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc6cc06b4d0 0x7fc6cc06d990 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4034000 tx=0x7fc6e402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:43.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.415+0000 7fc6deffd640 1 -- 172.21.15.7:0/2079298223 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc6d8058570 con 0x7fc6e80cc580 2024-04-25T09:54:43.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:43.634+0000 7fc6f07ce640 1 -- 172.21.15.7:0/2079298223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc6e80b0fc0 con 0x7fc6e80cc580 2024-04-25T09:54:44.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.283+0000 7fc6deffd640 1 -- 172.21.15.7:0/2079298223 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc6d8057e70 con 0x7fc6e80cc580 2024-04-25T09:54:44.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.285+0000 7fc6f07ce640 1 -- 172.21.15.7:0/2079298223 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc6cc06b4d0 msgr2=0x7fc6cc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:44.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.285+0000 7fc6f07ce640 1 --2- 172.21.15.7:0/2079298223 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc6cc06b4d0 0x7fc6cc06d990 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4034000 tx=0x7fc6e402e000 comp rx=0 tx=0).stop 2024-04-25T09:54:44.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.285+0000 7fc6f07ce640 1 -- 172.21.15.7:0/2079298223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6e80cc580 msgr2=0x7fc6e80709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:44.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.285+0000 7fc6f07ce640 1 --2- 172.21.15.7:0/2079298223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6e80cc580 0x7fc6e80709a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc6d800c430 tx=0x7fc6d800c8f0 comp rx=0 tx=0).stop 2024-04-25T09:54:44.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.285+0000 7fc6f07ce640 1 -- 172.21.15.7:0/2079298223 shutdown_connections 2024-04-25T09:54:44.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.285+0000 7fc6f07ce640 1 --2- 172.21.15.7:0/2079298223 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc6cc06b4d0 0x7fc6cc06d990 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:44.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.285+0000 7fc6f07ce640 1 --2- 172.21.15.7:0/2079298223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6e80cfc40 0x7fc6e806c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:44.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.285+0000 7fc6f07ce640 1 --2- 172.21.15.7:0/2079298223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6e80cc580 0x7fc6e80709a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:44.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.285+0000 7fc6f07ce640 1 --2- 172.21.15.7:0/2079298223 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6e80b1480 0x7fc6e8070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:44.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.285+0000 7fc6f07ce640 1 -- 172.21.15.7:0/2079298223 >> 172.21.15.7:0/2079298223 conn(0x7fc6e808af80 msgr2=0x7fc6e80c7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:44.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.286+0000 7fc6f07ce640 1 -- 172.21.15.7:0/2079298223 shutdown_connections 2024-04-25T09:54:44.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.286+0000 7fc6f07ce640 1 -- 172.21.15.7:0/2079298223 wait complete. 2024-04-25T09:54:44.301 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:54:44.301 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:54:44.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.405+0000 7fcb73b89640 1 Processor -- start 2024-04-25T09:54:44.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.405+0000 7fcb73b89640 1 -- start start 2024-04-25T09:54:44.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.406+0000 7fcb73b89640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcb6c0d0950 0x7fcb6c168980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:44.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.406+0000 7fcb73b89640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb6c162040 con 0x7fcb6c15dc10 2024-04-25T09:54:44.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.406+0000 7fcb73b89640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb6c162320 con 0x7fcb6c0b6b90 2024-04-25T09:54:44.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.406+0000 7fcb73b89640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb6c0d1d90 con 0x7fcb6c0d0950 2024-04-25T09:54:44.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.406+0000 7fcb71925640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fcb6c15dc10 0x7fcb6c1615f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35476/0 (socket says 172.21.15.7:35476) 2024-04-25T09:54:44.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.406+0000 7fcb71925640 1 -- 172.21.15.7:0/197416206 learned_addr learned my addr 172.21.15.7:0/197416206 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:44.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.406+0000 7fcb72126640 1 --2- 172.21.15.7:0/197416206 >> v2:172.21.15.55:3300/0 conn(0x7fcb6c0d0950 0x7fcb6c168980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:44.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.406+0000 7fcb70923640 1 -- 172.21.15.7:0/197416206 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1189763310 0 0) 0x7fcb6c162040 con 0x7fcb6c15dc10 2024-04-25T09:54:44.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.406+0000 7fcb70923640 1 -- 172.21.15.7:0/197416206 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb58003520 con 0x7fcb6c15dc10 2024-04-25T09:54:44.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.407+0000 7fcb70923640 1 -- 172.21.15.7:0/197416206 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2606885456 0 0) 0x7fcb6c162320 con 0x7fcb6c0b6b90 2024-04-25T09:54:44.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.407+0000 7fcb70923640 1 -- 172.21.15.7:0/197416206 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb6c162040 con 0x7fcb6c0b6b90 2024-04-25T09:54:44.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.407+0000 7fcb70923640 1 -- 172.21.15.7:0/197416206 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3585056495 0 0) 0x7fcb58003520 con 0x7fcb6c15dc10 2024-04-25T09:54:44.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.407+0000 7fcb70923640 1 -- 172.21.15.7:0/197416206 >> v2:172.21.15.55:3300/0 conn(0x7fcb6c0d0950 msgr2=0x7fcb6c168980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:44.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.407+0000 7fcb70923640 1 --2- 172.21.15.7:0/197416206 >> v2:172.21.15.55:3300/0 conn(0x7fcb6c0d0950 0x7fcb6c168980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:44.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.407+0000 7fcb70923640 1 -- 172.21.15.7:0/197416206 >> v1:172.21.15.55:6789/0 conn(0x7fcb6c0b6b90 legacy=0x7fcb6c0d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:44.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.407+0000 7fcb70923640 1 -- 172.21.15.7:0/197416206 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb6c0d1fe0 con 0x7fcb6c15dc10 2024-04-25T09:54:44.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.407+0000 7fcb70923640 1 -- 172.21.15.7:0/197416206 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fcb68001670 con 0x7fcb6c15dc10 2024-04-25T09:54:44.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.407+0000 7fcb70923640 1 -- 172.21.15.7:0/197416206 >> v1:172.21.15.7:6789/0 conn(0x7fcb6c15dc10 legacy=0x7fcb6c1615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:44.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.407+0000 7fcb70923640 1 --2- 172.21.15.7:0/197416206 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcb58003b40 0x7fcb58003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:44.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.407+0000 7fcb70923640 1 --2- 172.21.15.7:0/197416206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb58004800 0x7fcb58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:44.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.407+0000 7fcb70923640 1 --2- 172.21.15.7:0/197416206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb58005230 0x7fcb5800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:44.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.407+0000 7fcb70923640 1 -- 172.21.15.7:0/197416206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c0d1d90 con 0x7fcb58004800 2024-04-25T09:54:44.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.407+0000 7fcb70923640 1 -- 172.21.15.7:0/197416206 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5800c190 con 0x7fcb58005230 2024-04-25T09:54:44.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.407+0000 7fcb70923640 1 -- 172.21.15.7:0/197416206 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5800c390 con 0x7fcb58003b40 2024-04-25T09:54:44.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.407+0000 7fcb71124640 1 --2- 172.21.15.7:0/197416206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb58004800 0x7fcb58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:44.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.407+0000 7fcb72126640 1 --2- 172.21.15.7:0/197416206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb58005230 0x7fcb5800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:44.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.407+0000 7fcb71925640 1 --2- 172.21.15.7:0/197416206 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcb58003b40 0x7fcb58003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:44.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.407+0000 7fcb71124640 1 -- 172.21.15.7:0/197416206 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcb58003b40 msgr2=0x7fcb58003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:44.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.407+0000 7fcb71124640 1 --2- 172.21.15.7:0/197416206 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcb58003b40 0x7fcb58003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:44.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.407+0000 7fcb71124640 1 -- 172.21.15.7:0/197416206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb58005230 msgr2=0x7fcb5800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:44.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.407+0000 7fcb71124640 1 --2- 172.21.15.7:0/197416206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb58005230 0x7fcb5800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:44.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.407+0000 7fcb71124640 1 -- 172.21.15.7:0/197416206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb58003520 con 0x7fcb58004800 2024-04-25T09:54:44.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.407+0000 7fcb72126640 1 -- 172.21.15.7:0/197416206 reap_dead start 2024-04-25T09:54:44.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.407+0000 7fcb71925640 1 --2- 172.21.15.7:0/197416206 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcb58003b40 0x7fcb58003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:44.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.408+0000 7fcb71124640 1 --2- 172.21.15.7:0/197416206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb58004800 0x7fcb58004c80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c0018a0 tx=0x7fcb58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f5aa30fb1daf12 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:44.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.408+0000 7fcb70923640 1 -- 172.21.15.7:0/197416206 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c0014f0 con 0x7fcb58004800 2024-04-25T09:54:44.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.408+0000 7fcb70923640 1 -- 172.21.15.7:0/197416206 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5c0052d0 con 0x7fcb58004800 2024-04-25T09:54:44.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.408+0000 7fcb70923640 1 -- 172.21.15.7:0/197416206 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c02ac00 con 0x7fcb58004800 2024-04-25T09:54:44.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.409+0000 7fcb73b89640 1 -- 172.21.15.7:0/197416206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb58004800 msgr2=0x7fcb58004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:44.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.409+0000 7fcb73b89640 1 --2- 172.21.15.7:0/197416206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb58004800 0x7fcb58004c80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c0018a0 tx=0x7fcb58005830 comp rx=0 tx=0).stop 2024-04-25T09:54:44.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.409+0000 7fcb73b89640 1 -- 172.21.15.7:0/197416206 shutdown_connections 2024-04-25T09:54:44.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.409+0000 7fcb73b89640 1 --2- 172.21.15.7:0/197416206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb58004800 0x7fcb58004c80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:44.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.409+0000 7fcb73b89640 1 -- 172.21.15.7:0/197416206 >> 172.21.15.7:0/197416206 conn(0x7fcb6c072290 msgr2=0x7fcb6c0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:44.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.409+0000 7fcb73b89640 1 -- 172.21.15.7:0/197416206 shutdown_connections 2024-04-25T09:54:44.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.409+0000 7fcb73b89640 1 -- 172.21.15.7:0/197416206 wait complete. 2024-04-25T09:54:44.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.410+0000 7fcb73b89640 1 Processor -- start 2024-04-25T09:54:44.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.410+0000 7fcb73b89640 1 -- start start 2024-04-25T09:54:44.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.411+0000 7fcb73b89640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcb58004800 0x7fcb6c0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:44.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.411+0000 7fcb73b89640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb6c0c5ad0 0x7fcb6c0c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:44.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.411+0000 7fcb73b89640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb6c0cb740 0x7fcb6c0cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:44.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.411+0000 7fcb73b89640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c0d03c0 con 0x7fcb6c0cb740 2024-04-25T09:54:44.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.411+0000 7fcb73b89640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c0d0240 con 0x7fcb6c0c5ad0 2024-04-25T09:54:44.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.411+0000 7fcb73b89640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c0d0540 con 0x7fcb58004800 2024-04-25T09:54:44.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.411+0000 7fcb72126640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb6c0cb740 0x7fcb6c0cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:44.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.411+0000 7fcb72126640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb6c0cb740 0x7fcb6c0cbbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42748/0 (socket says 172.21.15.7:42748) 2024-04-25T09:54:44.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.411+0000 7fcb72126640 1 -- 172.21.15.7:0/254008376 learned_addr learned my addr 172.21.15.7:0/254008376 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:44.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.411+0000 7fcb71124640 1 --2- 172.21.15.7:0/254008376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb6c0c5ad0 0x7fcb6c0c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:44.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.411+0000 7fcb71925640 1 --2- 172.21.15.7:0/254008376 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcb58004800 0x7fcb6c0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:44.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.411+0000 7fcb72126640 1 -- 172.21.15.7:0/254008376 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcb58004800 msgr2=0x7fcb6c0b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:44.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.411+0000 7fcb72126640 1 --2- 172.21.15.7:0/254008376 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcb58004800 0x7fcb6c0b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:44.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.411+0000 7fcb72126640 1 -- 172.21.15.7:0/254008376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb6c0c5ad0 msgr2=0x7fcb6c0c5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:44.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.411+0000 7fcb72126640 1 --2- 172.21.15.7:0/254008376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb6c0c5ad0 0x7fcb6c0c5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:44.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.411+0000 7fcb72126640 1 -- 172.21.15.7:0/254008376 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb6c0c6490 con 0x7fcb6c0cb740 2024-04-25T09:54:44.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.411+0000 7fcb71124640 1 --2- 172.21.15.7:0/254008376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb6c0c5ad0 0x7fcb6c0c5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:44.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.411+0000 7fcb71925640 1 --2- 172.21.15.7:0/254008376 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcb58004800 0x7fcb6c0b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:44.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.411+0000 7fcb72126640 1 --2- 172.21.15.7:0/254008376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb6c0cb740 0x7fcb6c0cbbc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c08bec0 tx=0x7fcb6400f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:44.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.412+0000 7fcb627fc640 1 -- 172.21.15.7:0/254008376 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6400fce0 con 0x7fcb6c0cb740 2024-04-25T09:54:44.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.412+0000 7fcb627fc640 1 -- 172.21.15.7:0/254008376 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6400fe80 con 0x7fcb6c0cb740 2024-04-25T09:54:44.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.412+0000 7fcb73b89640 1 -- 172.21.15.7:0/254008376 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb6c0c8d90 con 0x7fcb6c0cb740 2024-04-25T09:54:44.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.412+0000 7fcb627fc640 1 -- 172.21.15.7:0/254008376 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb64015670 con 0x7fcb6c0cb740 2024-04-25T09:54:44.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.412+0000 7fcb73b89640 1 -- 172.21.15.7:0/254008376 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb6c0cac60 con 0x7fcb6c0cb740 2024-04-25T09:54:44.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.413+0000 7fcb73b89640 1 -- 172.21.15.7:0/254008376 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb6c0d4660 con 0x7fcb6c0cb740 2024-04-25T09:54:44.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.413+0000 7fcb627fc640 1 -- 172.21.15.7:0/254008376 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcb64015810 con 0x7fcb6c0cb740 2024-04-25T09:54:44.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.414+0000 7fcb627fc640 1 --2- 172.21.15.7:0/254008376 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcb5006b4d0 0x7fcb5006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:44.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.414+0000 7fcb627fc640 1 -- 172.21.15.7:0/254008376 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fcb6408b3b0 con 0x7fcb6c0cb740 2024-04-25T09:54:44.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.414+0000 7fcb71925640 1 --2- 172.21.15.7:0/254008376 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcb5006b4d0 0x7fcb5006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:44.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.414+0000 7fcb71925640 1 --2- 172.21.15.7:0/254008376 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcb5006b4d0 0x7fcb5006d990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcb68000fd0 tx=0x7fcb68009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:44.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.418+0000 7fcb627fc640 1 -- 172.21.15.7:0/254008376 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcb6c0d4660 con 0x7fcb6c0cb740 2024-04-25T09:54:44.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.641+0000 7fcb73b89640 1 -- 172.21.15.7:0/254008376 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb6c0d3480 con 0x7fcb6c0cb740 2024-04-25T09:54:44.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.642+0000 7fcb627fc640 1 -- 172.21.15.7:0/254008376 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4928 (secure 0 0 0) 0x7fcb64019030 con 0x7fcb6c0cb740 2024-04-25T09:54:44.645 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:44.645 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1968579214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1968579214},{"type":"v1","addr":"172.21.15.7:6837","nonce":1968579214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3479570567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3479570567},{"type":"v1","addr":"172.21.15.55:6834","nonce":3479570567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/2289657027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2289657027},{"type":"v1","addr":"172.21.15.7:6836","nonce":2289657027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:54:27.558601+0000","modified":"2024-04-25T09:54:43.635854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/3779228372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3779228372},{"type":"v1","addr":"172.21.15.55:6835","nonce":3779228372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:54:44.645 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 8 2024-04-25T09:54:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.644+0000 7fcb73b89640 1 -- 172.21.15.7:0/254008376 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcb5006b4d0 msgr2=0x7fcb5006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.644+0000 7fcb73b89640 1 --2- 172.21.15.7:0/254008376 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcb5006b4d0 0x7fcb5006d990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcb68000fd0 tx=0x7fcb68009040 comp rx=0 tx=0).stop 2024-04-25T09:54:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.644+0000 7fcb73b89640 1 -- 172.21.15.7:0/254008376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb6c0cb740 msgr2=0x7fcb6c0cbbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.644+0000 7fcb73b89640 1 --2- 172.21.15.7:0/254008376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb6c0cb740 0x7fcb6c0cbbc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c08bec0 tx=0x7fcb6400f1b0 comp rx=0 tx=0).stop 2024-04-25T09:54:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.644+0000 7fcb73b89640 1 -- 172.21.15.7:0/254008376 shutdown_connections 2024-04-25T09:54:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.644+0000 7fcb73b89640 1 --2- 172.21.15.7:0/254008376 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcb5006b4d0 0x7fcb5006d990 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.644+0000 7fcb73b89640 1 --2- 172.21.15.7:0/254008376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb6c0cb740 0x7fcb6c0cbbc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.644+0000 7fcb73b89640 1 --2- 172.21.15.7:0/254008376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb6c0c5ad0 0x7fcb6c0c5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.644+0000 7fcb73b89640 1 --2- 172.21.15.7:0/254008376 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcb58004800 0x7fcb6c0b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.644+0000 7fcb73b89640 1 -- 172.21.15.7:0/254008376 >> 172.21.15.7:0/254008376 conn(0x7fcb6c072290 msgr2=0x7fcb6c0d39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.644+0000 7fcb73b89640 1 -- 172.21.15.7:0/254008376 shutdown_connections 2024-04-25T09:54:44.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.644+0000 7fcb73b89640 1 -- 172.21.15.7:0/254008376 wait complete. 2024-04-25T09:54:44.658 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:54:44.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.755+0000 7fc37ecb3640 1 Processor -- start 2024-04-25T09:54:44.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.755+0000 7fc37ecb3640 1 -- start start 2024-04-25T09:54:44.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.756+0000 7fc37ecb3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc37815db00 0x7fc3780d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:44.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.756+0000 7fc37ecb3640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc3780b53b0 0x7fc3780d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:44.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.756+0000 7fc37ecb3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3780ce2b0 0x7fc378161670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:44.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.756+0000 7fc37ecb3640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3780d1e80 con 0x7fc3780b53b0 2024-04-25T09:54:44.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.756+0000 7fc37ecb3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3780b5930 con 0x7fc37815db00 2024-04-25T09:54:44.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.756+0000 7fc37ecb3640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3780b5c10 con 0x7fc3780ce2b0 2024-04-25T09:54:44.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.756+0000 7fc377fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc3780b53b0 0x7fc3780d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:44.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.756+0000 7fc377fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc3780b53b0 0x7fc3780d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42764/0 (socket says 172.21.15.7:42764) 2024-04-25T09:54:44.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.756+0000 7fc377fff640 1 -- 172.21.15.7:0/17210378 learned_addr learned my addr 172.21.15.7:0/17210378 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:44.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.756+0000 7fc37d250640 1 --2- 172.21.15.7:0/17210378 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3780ce2b0 0x7fc378161670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:44.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.756+0000 7fc37ca4f640 1 --2- 172.21.15.7:0/17210378 >> v2:172.21.15.55:3300/0 conn(0x7fc37815db00 0x7fc3780d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:44.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.757+0000 7fc377fff640 1 -- 172.21.15.7:0/17210378 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3780ce2b0 msgr2=0x7fc378161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:44.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.757+0000 7fc377fff640 1 --2- 172.21.15.7:0/17210378 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3780ce2b0 0x7fc378161670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:44.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.757+0000 7fc377fff640 1 -- 172.21.15.7:0/17210378 >> v2:172.21.15.55:3300/0 conn(0x7fc37815db00 msgr2=0x7fc3780d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:44.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.757+0000 7fc377fff640 1 --2- 172.21.15.7:0/17210378 >> v2:172.21.15.55:3300/0 conn(0x7fc37815db00 0x7fc3780d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:44.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.757+0000 7fc377fff640 1 -- 172.21.15.7:0/17210378 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3780b5ef0 con 0x7fc3780b53b0 2024-04-25T09:54:44.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.757+0000 7fc377fff640 1 --2- 172.21.15.7:0/17210378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3780b53b0 0x7fc3780d0880 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc3780d4940 tx=0x7fc36802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62845b4d34fc788e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:44.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.757+0000 7fc3777fe640 1 -- 172.21.15.7:0/17210378 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc368036070 con 0x7fc3780b53b0 2024-04-25T09:54:44.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.758+0000 7fc3777fe640 1 -- 172.21.15.7:0/17210378 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc368031600 con 0x7fc3780b53b0 2024-04-25T09:54:44.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.758+0000 7fc3777fe640 1 -- 172.21.15.7:0/17210378 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3680319d0 con 0x7fc3780b53b0 2024-04-25T09:54:44.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.758+0000 7fc37ecb3640 1 -- 172.21.15.7:0/17210378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3780b53b0 msgr2=0x7fc3780d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:44.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.758+0000 7fc37ecb3640 1 --2- 172.21.15.7:0/17210378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3780b53b0 0x7fc3780d0880 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc3780d4940 tx=0x7fc36802a6a0 comp rx=0 tx=0).stop 2024-04-25T09:54:44.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.758+0000 7fc37ecb3640 1 -- 172.21.15.7:0/17210378 shutdown_connections 2024-04-25T09:54:44.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.758+0000 7fc37ecb3640 1 --2- 172.21.15.7:0/17210378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3780b53b0 0x7fc3780d0880 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:44.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.758+0000 7fc37ecb3640 1 --2- 172.21.15.7:0/17210378 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3780ce2b0 0x7fc378161670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:44.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.758+0000 7fc37ecb3640 1 --2- 172.21.15.7:0/17210378 >> v2:172.21.15.55:3300/0 conn(0x7fc37815db00 0x7fc3780d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:44.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.758+0000 7fc37ecb3640 1 -- 172.21.15.7:0/17210378 >> 172.21.15.7:0/17210378 conn(0x7fc378072290 msgr2=0x7fc3780726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:44.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.758+0000 7fc37ecb3640 1 -- 172.21.15.7:0/17210378 shutdown_connections 2024-04-25T09:54:44.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.758+0000 7fc37ecb3640 1 -- 172.21.15.7:0/17210378 wait complete. 2024-04-25T09:54:44.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.759+0000 7fc37ecb3640 1 Processor -- start 2024-04-25T09:54:44.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.759+0000 7fc37ecb3640 1 -- start start 2024-04-25T09:54:44.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.760+0000 7fc37ecb3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3780b53b0 0x7fc378149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:44.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.760+0000 7fc37ecb3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3780ce2b0 0x7fc378159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:44.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.760+0000 7fc37ecb3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc37815db00 0x7fc3781596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:44.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.760+0000 7fc37ecb3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3780d3660 con 0x7fc37815db00 2024-04-25T09:54:44.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.760+0000 7fc37ecb3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3780b61d0 con 0x7fc3780ce2b0 2024-04-25T09:54:44.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.760+0000 7fc37ecb3640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3780b6c10 con 0x7fc3780b53b0 2024-04-25T09:54:44.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.760+0000 7fc37d250640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc37815db00 0x7fc3781596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:44.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.760+0000 7fc37d250640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc37815db00 0x7fc3781596a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42778/0 (socket says 172.21.15.7:42778) 2024-04-25T09:54:44.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.760+0000 7fc37d250640 1 -- 172.21.15.7:0/1412475352 learned_addr learned my addr 172.21.15.7:0/1412475352 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:44.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.760+0000 7fc377fff640 1 --2- 172.21.15.7:0/1412475352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3780ce2b0 0x7fc378159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:44.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.760+0000 7fc37ca4f640 1 --2- 172.21.15.7:0/1412475352 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3780b53b0 0x7fc378149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:44.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.761+0000 7fc37d250640 1 -- 172.21.15.7:0/1412475352 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3780b53b0 msgr2=0x7fc378149690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:44.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.761+0000 7fc37d250640 1 --2- 172.21.15.7:0/1412475352 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3780b53b0 0x7fc378149690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:44.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.761+0000 7fc37d250640 1 -- 172.21.15.7:0/1412475352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3780ce2b0 msgr2=0x7fc378159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:44.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.761+0000 7fc37d250640 1 --2- 172.21.15.7:0/1412475352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3780ce2b0 0x7fc378159160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:44.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.761+0000 7fc37d250640 1 -- 172.21.15.7:0/1412475352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3780d41d0 con 0x7fc37815db00 2024-04-25T09:54:44.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.761+0000 7fc377fff640 1 --2- 172.21.15.7:0/1412475352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3780ce2b0 0x7fc378159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:44.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.761+0000 7fc37ca4f640 1 --2- 172.21.15.7:0/1412475352 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3780b53b0 0x7fc378149690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:44.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.761+0000 7fc37d250640 1 --2- 172.21.15.7:0/1412475352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc37815db00 0x7fc3781596a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc36000e930 tx=0x7fc36000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:44.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.761+0000 7fc3757fa640 1 -- 172.21.15.7:0/1412475352 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc360017070 con 0x7fc37815db00 2024-04-25T09:54:44.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.761+0000 7fc3757fa640 1 -- 172.21.15.7:0/1412475352 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36000c980 con 0x7fc37815db00 2024-04-25T09:54:44.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.761+0000 7fc37ecb3640 1 -- 172.21.15.7:0/1412475352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc37815e290 con 0x7fc37815db00 2024-04-25T09:54:44.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.761+0000 7fc3757fa640 1 -- 172.21.15.7:0/1412475352 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36000cd70 con 0x7fc37815db00 2024-04-25T09:54:44.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.761+0000 7fc37ecb3640 1 -- 172.21.15.7:0/1412475352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc37815e810 con 0x7fc37815db00 2024-04-25T09:54:44.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.762+0000 7fc37ecb3640 1 -- 172.21.15.7:0/1412475352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc378068fd0 con 0x7fc37815db00 2024-04-25T09:54:44.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.762+0000 7fc3757fa640 1 -- 172.21.15.7:0/1412475352 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc36001a070 con 0x7fc37815db00 2024-04-25T09:54:44.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.763+0000 7fc3757fa640 1 --2- 172.21.15.7:0/1412475352 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc35806b4d0 0x7fc35806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:44.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.763+0000 7fc3757fa640 1 -- 172.21.15.7:0/1412475352 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc36008a580 con 0x7fc37815db00 2024-04-25T09:54:44.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.763+0000 7fc37ca4f640 1 --2- 172.21.15.7:0/1412475352 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc35806b4d0 0x7fc35806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:44.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.763+0000 7fc37ca4f640 1 --2- 172.21.15.7:0/1412475352 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc35806b4d0 0x7fc35806d990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc370009a70 tx=0x7fc370008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:44.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.767+0000 7fc3757fa640 1 -- 172.21.15.7:0/1412475352 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc3600590f0 con 0x7fc37815db00 2024-04-25T09:54:44.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.950+0000 7fc37ecb3640 1 -- 172.21.15.7:0/1412475352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3780d16b0 con 0x7fc37815db00 2024-04-25T09:54:44.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.951+0000 7fc3757fa640 1 -- 172.21.15.7:0/1412475352 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18418 (secure 0 0 0) 0x7fc3600589f0 con 0x7fc37815db00 2024-04-25T09:54:44.954 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:44.954 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:54:32.606761+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:54:26.011833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:54:26.535536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:54:30.264996+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:54:44.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.953+0000 7fc37ecb3640 1 -- 172.21.15.7:0/1412475352 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc35806b4d0 msgr2=0x7fc35806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:44.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.953+0000 7fc37ecb3640 1 --2- 172.21.15.7:0/1412475352 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc35806b4d0 0x7fc35806d990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc370009a70 tx=0x7fc370008040 comp rx=0 tx=0).stop 2024-04-25T09:54:44.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.953+0000 7fc37ecb3640 1 -- 172.21.15.7:0/1412475352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc37815db00 msgr2=0x7fc3781596a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:44.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.953+0000 7fc37ecb3640 1 --2- 172.21.15.7:0/1412475352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc37815db00 0x7fc3781596a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc36000e930 tx=0x7fc36000edf0 comp rx=0 tx=0).stop 2024-04-25T09:54:44.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.953+0000 7fc37ecb3640 1 -- 172.21.15.7:0/1412475352 shutdown_connections 2024-04-25T09:54:44.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.953+0000 7fc37ecb3640 1 --2- 172.21.15.7:0/1412475352 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc35806b4d0 0x7fc35806d990 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:44.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.953+0000 7fc37ecb3640 1 --2- 172.21.15.7:0/1412475352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc37815db00 0x7fc3781596a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:44.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.953+0000 7fc37ecb3640 1 --2- 172.21.15.7:0/1412475352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3780ce2b0 0x7fc378159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:44.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.953+0000 7fc37ecb3640 1 --2- 172.21.15.7:0/1412475352 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3780b53b0 0x7fc378149690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:44.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.953+0000 7fc37ecb3640 1 -- 172.21.15.7:0/1412475352 >> 172.21.15.7:0/1412475352 conn(0x7fc378072290 msgr2=0x7fc3780d37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:44.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.953+0000 7fc37ecb3640 1 -- 172.21.15.7:0/1412475352 shutdown_connections 2024-04-25T09:54:44.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:44.953+0000 7fc37ecb3640 1 -- 172.21.15.7:0/1412475352 wait complete. 2024-04-25T09:54:44.967 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:54:44.967 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:54:45.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.065+0000 7fc18ca7c640 1 Processor -- start 2024-04-25T09:54:45.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.065+0000 7fc18ca7c640 1 -- start start 2024-04-25T09:54:45.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.066+0000 7fc18ca7c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc18815da20 0x7fc18809a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:45.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.066+0000 7fc18ca7c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc18806bc70 0x7fc1880d0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:45.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.066+0000 7fc18ca7c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1880cfad0 con 0x7fc1880d10b0 2024-04-25T09:54:45.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.066+0000 7fc18ca7c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1880d06e0 con 0x7fc18806bc70 2024-04-25T09:54:45.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.066+0000 7fc18ca7c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18809a940 con 0x7fc18815da20 2024-04-25T09:54:45.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.067+0000 7fc18659c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc18815da20 0x7fc18809a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:45.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.067+0000 7fc185d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc18806bc70 0x7fc1880d0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:45.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.067+0000 7fc18659c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc18815da20 0x7fc18809a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:43874/0 (socket says 172.21.15.7:43874) 2024-04-25T09:54:45.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.067+0000 7fc18659c640 1 -- 172.21.15.7:0/3456964082 learned_addr learned my addr 172.21.15.7:0/3456964082 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:45.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.067+0000 7fc18659c640 1 -- 172.21.15.7:0/3456964082 >> v2:172.21.15.55:3300/0 conn(0x7fc18806bc70 msgr2=0x7fc1880d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:45.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.067+0000 7fc18659c640 1 --2- 172.21.15.7:0/3456964082 >> v2:172.21.15.55:3300/0 conn(0x7fc18806bc70 0x7fc1880d0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:45.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.067+0000 7fc18659c640 1 -- 172.21.15.7:0/3456964082 >> v1:172.21.15.55:6789/0 conn(0x7fc1880d10b0 legacy=0x7fc18806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:45.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.067+0000 7fc18659c640 1 -- 172.21.15.7:0/3456964082 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1880cfdb0 con 0x7fc18815da20 2024-04-25T09:54:45.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.067+0000 7fc185d9b640 1 --2- 172.21.15.7:0/3456964082 >> v2:172.21.15.55:3300/0 conn(0x7fc18806bc70 0x7fc1880d0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:54:45.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.068+0000 7fc18659c640 1 --2- 172.21.15.7:0/3456964082 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc18815da20 0x7fc18809a400 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc178009e50 tx=0x7fc17802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a746ca61942b38c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:45.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.068+0000 7fc18559a640 1 -- 172.21.15.7:0/3456964082 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc178036070 con 0x7fc18815da20 2024-04-25T09:54:45.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.068+0000 7fc18559a640 1 -- 172.21.15.7:0/3456964082 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc178031600 con 0x7fc18815da20 2024-04-25T09:54:45.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.068+0000 7fc18559a640 1 -- 172.21.15.7:0/3456964082 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1780319d0 con 0x7fc18815da20 2024-04-25T09:54:45.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.069+0000 7fc18ca7c640 1 -- 172.21.15.7:0/3456964082 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc18815da20 msgr2=0x7fc18809a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:45.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.069+0000 7fc18ca7c640 1 --2- 172.21.15.7:0/3456964082 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc18815da20 0x7fc18809a400 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc178009e50 tx=0x7fc17802a710 comp rx=0 tx=0).stop 2024-04-25T09:54:45.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.069+0000 7fc18ca7c640 1 -- 172.21.15.7:0/3456964082 shutdown_connections 2024-04-25T09:54:45.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.069+0000 7fc18ca7c640 1 --2- 172.21.15.7:0/3456964082 >> v2:172.21.15.55:3300/0 conn(0x7fc18806bc70 0x7fc1880d0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:45.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.069+0000 7fc18ca7c640 1 --2- 172.21.15.7:0/3456964082 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc18815da20 0x7fc18809a400 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:45.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.069+0000 7fc18ca7c640 1 -- 172.21.15.7:0/3456964082 >> 172.21.15.7:0/3456964082 conn(0x7fc1880d16f0 msgr2=0x7fc1880d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:45.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.069+0000 7fc18ca7c640 1 -- 172.21.15.7:0/3456964082 shutdown_connections 2024-04-25T09:54:45.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.069+0000 7fc18ca7c640 1 -- 172.21.15.7:0/3456964082 wait complete. 2024-04-25T09:54:45.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.070+0000 7fc18ca7c640 1 Processor -- start 2024-04-25T09:54:45.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.070+0000 7fc18ca7c640 1 -- start start 2024-04-25T09:54:45.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.071+0000 7fc18ca7c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc18806bc70 0x7fc1880b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:45.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.071+0000 7fc18ca7c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1880d10b0 0x7fc1880b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:45.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.071+0000 7fc18ca7c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18815da20 0x7fc1880b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:45.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.071+0000 7fc18ca7c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18815de00 con 0x7fc1880d10b0 2024-04-25T09:54:45.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.071+0000 7fc18ca7c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1880d0370 con 0x7fc18815da20 2024-04-25T09:54:45.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.071+0000 7fc18ca7c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18815df80 con 0x7fc18806bc70 2024-04-25T09:54:45.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.071+0000 7fc185d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1880d10b0 0x7fc1880b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:45.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.071+0000 7fc185d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1880d10b0 0x7fc1880b41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42786/0 (socket says 172.21.15.7:42786) 2024-04-25T09:54:45.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.071+0000 7fc185d9b640 1 -- 172.21.15.7:0/1518335398 learned_addr learned my addr 172.21.15.7:0/1518335398 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:45.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.071+0000 7fc18659c640 1 --2- 172.21.15.7:0/1518335398 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc18806bc70 0x7fc1880b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:45.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.071+0000 7fc186d9d640 1 --2- 172.21.15.7:0/1518335398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18815da20 0x7fc1880b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:45.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.071+0000 7fc185d9b640 1 -- 172.21.15.7:0/1518335398 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc18806bc70 msgr2=0x7fc1880b6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:45.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.071+0000 7fc185d9b640 1 --2- 172.21.15.7:0/1518335398 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc18806bc70 0x7fc1880b6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:45.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.071+0000 7fc185d9b640 1 -- 172.21.15.7:0/1518335398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18815da20 msgr2=0x7fc1880b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:45.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.071+0000 7fc185d9b640 1 --2- 172.21.15.7:0/1518335398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18815da20 0x7fc1880b46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:45.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.071+0000 7fc185d9b640 1 -- 172.21.15.7:0/1518335398 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1880c9e60 con 0x7fc1880d10b0 2024-04-25T09:54:45.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.071+0000 7fc18659c640 1 --2- 172.21.15.7:0/1518335398 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc18806bc70 0x7fc1880b6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:45.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.071+0000 7fc185d9b640 1 --2- 172.21.15.7:0/1518335398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1880d10b0 0x7fc1880b41a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc17000e960 tx=0x7fc17000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:45.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.072+0000 7fc17effd640 1 -- 172.21.15.7:0/1518335398 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc170017070 con 0x7fc1880d10b0 2024-04-25T09:54:45.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.072+0000 7fc17effd640 1 -- 172.21.15.7:0/1518335398 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17000ca00 con 0x7fc1880d10b0 2024-04-25T09:54:45.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.072+0000 7fc18ca7c640 1 -- 172.21.15.7:0/1518335398 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1880ca140 con 0x7fc1880d10b0 2024-04-25T09:54:45.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.072+0000 7fc17effd640 1 -- 172.21.15.7:0/1518335398 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17000cdd0 con 0x7fc1880d10b0 2024-04-25T09:54:45.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.072+0000 7fc18ca7c640 1 -- 172.21.15.7:0/1518335398 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1880ca700 con 0x7fc1880d10b0 2024-04-25T09:54:45.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.073+0000 7fc18ca7c640 1 -- 172.21.15.7:0/1518335398 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc188068fd0 con 0x7fc1880d10b0 2024-04-25T09:54:45.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.073+0000 7fc17effd640 1 -- 172.21.15.7:0/1518335398 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc17001a070 con 0x7fc1880d10b0 2024-04-25T09:54:45.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.074+0000 7fc17effd640 1 --2- 172.21.15.7:0/1518335398 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc16806b4d0 0x7fc16806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:45.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.074+0000 7fc17effd640 1 -- 172.21.15.7:0/1518335398 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc17008a4b0 con 0x7fc1880d10b0 2024-04-25T09:54:45.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.074+0000 7fc18659c640 1 --2- 172.21.15.7:0/1518335398 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc16806b4d0 0x7fc16806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:45.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.074+0000 7fc18659c640 1 --2- 172.21.15.7:0/1518335398 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc16806b4d0 0x7fc16806d990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc178033000 tx=0x7fc178009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:45.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.078+0000 7fc17effd640 1 -- 172.21.15.7:0/1518335398 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc170058f50 con 0x7fc1880d10b0 2024-04-25T09:54:45.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.255+0000 7fc18ca7c640 1 -- 172.21.15.7:0/1518335398 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc1880d2500 con 0x7fc16806b4d0 2024-04-25T09:54:45.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.264+0000 7fc17effd640 1 -- 172.21.15.7:0/1518335398 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332534 (secure 0 0 0) 0x7fc1880d2500 con 0x7fc16806b4d0 2024-04-25T09:54:45.271 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:45.273 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T09:54:45.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.267+0000 7fc18ca7c640 1 -- 172.21.15.7:0/1518335398 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc16806b4d0 msgr2=0x7fc16806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:45.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.267+0000 7fc18ca7c640 1 --2- 172.21.15.7:0/1518335398 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc16806b4d0 0x7fc16806d990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc178033000 tx=0x7fc178009000 comp rx=0 tx=0).stop 2024-04-25T09:54:45.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.267+0000 7fc18ca7c640 1 -- 172.21.15.7:0/1518335398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1880d10b0 msgr2=0x7fc1880b41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:45.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.267+0000 7fc18ca7c640 1 --2- 172.21.15.7:0/1518335398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1880d10b0 0x7fc1880b41a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc17000e960 tx=0x7fc17000ee20 comp rx=0 tx=0).stop 2024-04-25T09:54:45.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.267+0000 7fc18ca7c640 1 -- 172.21.15.7:0/1518335398 shutdown_connections 2024-04-25T09:54:45.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.267+0000 7fc18ca7c640 1 --2- 172.21.15.7:0/1518335398 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc16806b4d0 0x7fc16806d990 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:45.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.267+0000 7fc18ca7c640 1 --2- 172.21.15.7:0/1518335398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18815da20 0x7fc1880b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:45.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.267+0000 7fc18ca7c640 1 --2- 172.21.15.7:0/1518335398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1880d10b0 0x7fc1880b41a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:45.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.267+0000 7fc18ca7c640 1 --2- 172.21.15.7:0/1518335398 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc18806bc70 0x7fc1880b6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:45.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.267+0000 7fc18ca7c640 1 -- 172.21.15.7:0/1518335398 >> 172.21.15.7:0/1518335398 conn(0x7fc1880d16f0 msgr2=0x7fc1880ccd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:45.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.267+0000 7fc18ca7c640 1 -- 172.21.15.7:0/1518335398 shutdown_connections 2024-04-25T09:54:45.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.267+0000 7fc18ca7c640 1 -- 172.21.15.7:0/1518335398 wait complete. 2024-04-25T09:54:45.281 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-04-25T09:54:43.856660+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236096,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738624,"statfs":{"total":773094113280,"available":772852350976,"internally_reserved":0,"allocated":3350528,"data_stored":2020190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.619393"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431103+0000","last_change":"2024-04-25T09:54:27.205212+0000","last_active":"2024-04-25T09:54:33.431103+0000","last_peered":"2024-04-25T09:54:33.431103+0000","last_clean":"2024-04-25T09:54:33.431103+0000","last_became_active":"2024-04-25T09:54:27.204920+0000","last_became_peered":"2024-04-25T09:54:27.204920+0000","last_unstale":"2024-04-25T09:54:33.431103+0000","last_undegraded":"2024-04-25T09:54:33.431103+0000","last_fullsized":"2024-04-25T09:54:33.431103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:44.480619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239768+0000","last_change":"2024-04-25T09:54:28.228470+0000","last_active":"2024-04-25T09:54:33.239768+0000","last_peered":"2024-04-25T09:54:33.239768+0000","last_clean":"2024-04-25T09:54:33.239768+0000","last_became_active":"2024-04-25T09:54:28.228117+0000","last_became_peered":"2024-04-25T09:54:28.228117+0000","last_unstale":"2024-04-25T09:54:33.239768+0000","last_undegraded":"2024-04-25T09:54:33.239768+0000","last_fullsized":"2024-04-25T09:54:33.239768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:23.525779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239020+0000","last_change":"2024-04-25T09:54:32.301225+0000","last_active":"2024-04-25T09:54:33.239020+0000","last_peered":"2024-04-25T09:54:33.239020+0000","last_clean":"2024-04-25T09:54:33.239020+0000","last_became_active":"2024-04-25T09:54:32.300826+0000","last_became_peered":"2024-04-25T09:54:32.300826+0000","last_unstale":"2024-04-25T09:54:33.239020+0000","last_undegraded":"2024-04-25T09:54:33.239020+0000","last_fullsized":"2024-04-25T09:54:33.239020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:06.418222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239954+0000","last_change":"2024-04-25T09:54:27.209621+0000","last_active":"2024-04-25T09:54:33.239954+0000","last_peered":"2024-04-25T09:54:33.239954+0000","last_clean":"2024-04-25T09:54:33.239954+0000","last_became_active":"2024-04-25T09:54:27.209078+0000","last_became_peered":"2024-04-25T09:54:27.209078+0000","last_unstale":"2024-04-25T09:54:33.239954+0000","last_undegraded":"2024-04-25T09:54:33.239954+0000","last_fullsized":"2024-04-25T09:54:33.239954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:02.804762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430762+0000","last_change":"2024-04-25T09:54:28.230594+0000","last_active":"2024-04-25T09:54:33.430762+0000","last_peered":"2024-04-25T09:54:33.430762+0000","last_clean":"2024-04-25T09:54:33.430762+0000","last_became_active":"2024-04-25T09:54:28.230265+0000","last_became_peered":"2024-04-25T09:54:28.230265+0000","last_unstale":"2024-04-25T09:54:33.430762+0000","last_undegraded":"2024-04-25T09:54:33.430762+0000","last_fullsized":"2024-04-25T09:54:33.430762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:33.543144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.248999+0000","last_change":"2024-04-25T09:54:32.265543+0000","last_active":"2024-04-25T09:54:33.248999+0000","last_peered":"2024-04-25T09:54:33.248999+0000","last_clean":"2024-04-25T09:54:33.248999+0000","last_became_active":"2024-04-25T09:54:32.264147+0000","last_became_peered":"2024-04-25T09:54:32.264147+0000","last_unstale":"2024-04-25T09:54:33.248999+0000","last_undegraded":"2024-04-25T09:54:33.248999+0000","last_fullsized":"2024-04-25T09:54:33.248999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:19.875090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427980+0000","last_change":"2024-04-25T09:54:27.215105+0000","last_active":"2024-04-25T09:54:33.427980+0000","last_peered":"2024-04-25T09:54:33.427980+0000","last_clean":"2024-04-25T09:54:33.427980+0000","last_became_active":"2024-04-25T09:54:27.214820+0000","last_became_peered":"2024-04-25T09:54:27.214820+0000","last_unstale":"2024-04-25T09:54:33.427980+0000","last_undegraded":"2024-04-25T09:54:33.427980+0000","last_fullsized":"2024-04-25T09:54:33.427980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:39.794974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432058+0000","last_change":"2024-04-25T09:54:28.232586+0000","last_active":"2024-04-25T09:54:33.432058+0000","last_peered":"2024-04-25T09:54:33.432058+0000","last_clean":"2024-04-25T09:54:33.432058+0000","last_became_active":"2024-04-25T09:54:28.231544+0000","last_became_peered":"2024-04-25T09:54:28.231544+0000","last_unstale":"2024-04-25T09:54:33.432058+0000","last_undegraded":"2024-04-25T09:54:33.432058+0000","last_fullsized":"2024-04-25T09:54:33.432058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:52.698521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249218+0000","last_change":"2024-04-25T09:54:32.265350+0000","last_active":"2024-04-25T09:54:33.249218+0000","last_peered":"2024-04-25T09:54:33.249218+0000","last_clean":"2024-04-25T09:54:33.249218+0000","last_became_active":"2024-04-25T09:54:32.264913+0000","last_became_peered":"2024-04-25T09:54:32.264913+0000","last_unstale":"2024-04-25T09:54:33.249218+0000","last_undegraded":"2024-04-25T09:54:33.249218+0000","last_fullsized":"2024-04-25T09:54:33.249218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:08:46.808252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427640+0000","last_change":"2024-04-25T09:54:27.212359+0000","last_active":"2024-04-25T09:54:33.427640+0000","last_peered":"2024-04-25T09:54:33.427640+0000","last_clean":"2024-04-25T09:54:33.427640+0000","last_became_active":"2024-04-25T09:54:27.212058+0000","last_became_peered":"2024-04-25T09:54:27.212058+0000","last_unstale":"2024-04-25T09:54:33.427640+0000","last_undegraded":"2024-04-25T09:54:33.427640+0000","last_fullsized":"2024-04-25T09:54:33.427640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:04.425728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432088+0000","last_change":"2024-04-25T09:54:28.230562+0000","last_active":"2024-04-25T09:54:33.432088+0000","last_peered":"2024-04-25T09:54:33.432088+0000","last_clean":"2024-04-25T09:54:33.432088+0000","last_became_active":"2024-04-25T09:54:28.230276+0000","last_became_peered":"2024-04-25T09:54:28.230276+0000","last_unstale":"2024-04-25T09:54:33.432088+0000","last_undegraded":"2024-04-25T09:54:33.432088+0000","last_fullsized":"2024-04-25T09:54:33.432088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:36.448046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.248804+0000","last_change":"2024-04-25T09:54:32.256284+0000","last_active":"2024-04-25T09:54:33.248804+0000","last_peered":"2024-04-25T09:54:33.248804+0000","last_clean":"2024-04-25T09:54:33.248804+0000","last_became_active":"2024-04-25T09:54:32.255895+0000","last_became_peered":"2024-04-25T09:54:32.255895+0000","last_unstale":"2024-04-25T09:54:33.248804+0000","last_undegraded":"2024-04-25T09:54:33.248804+0000","last_fullsized":"2024-04-25T09:54:33.248804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:54.048907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430965+0000","last_change":"2024-04-25T09:54:28.228430+0000","last_active":"2024-04-25T09:54:33.430965+0000","last_peered":"2024-04-25T09:54:33.430965+0000","last_clean":"2024-04-25T09:54:33.430965+0000","last_became_active":"2024-04-25T09:54:28.228142+0000","last_became_peered":"2024-04-25T09:54:28.228142+0000","last_unstale":"2024-04-25T09:54:33.430965+0000","last_undegraded":"2024-04-25T09:54:33.430965+0000","last_fullsized":"2024-04-25T09:54:33.430965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:35.167250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427810+0000","last_change":"2024-04-25T09:54:27.209265+0000","last_active":"2024-04-25T09:54:33.427810+0000","last_peered":"2024-04-25T09:54:33.427810+0000","last_clean":"2024-04-25T09:54:33.427810+0000","last_became_active":"2024-04-25T09:54:27.209017+0000","last_became_peered":"2024-04-25T09:54:27.209017+0000","last_unstale":"2024-04-25T09:54:33.427810+0000","last_undegraded":"2024-04-25T09:54:33.427810+0000","last_fullsized":"2024-04-25T09:54:33.427810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:53.735742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249574+0000","last_change":"2024-04-25T09:54:32.265153+0000","last_active":"2024-04-25T09:54:33.249574+0000","last_peered":"2024-04-25T09:54:33.249574+0000","last_clean":"2024-04-25T09:54:33.249574+0000","last_became_active":"2024-04-25T09:54:32.264252+0000","last_became_peered":"2024-04-25T09:54:32.264252+0000","last_unstale":"2024-04-25T09:54:33.249574+0000","last_undegraded":"2024-04-25T09:54:33.249574+0000","last_fullsized":"2024-04-25T09:54:33.249574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:08.992474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239443+0000","last_change":"2024-04-25T09:54:28.217914+0000","last_active":"2024-04-25T09:54:33.239443+0000","last_peered":"2024-04-25T09:54:33.239443+0000","last_clean":"2024-04-25T09:54:33.239443+0000","last_became_active":"2024-04-25T09:54:28.217591+0000","last_became_peered":"2024-04-25T09:54:28.217591+0000","last_unstale":"2024-04-25T09:54:33.239443+0000","last_undegraded":"2024-04-25T09:54:33.239443+0000","last_fullsized":"2024-04-25T09:54:33.239443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:50.006460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431887+0000","last_change":"2024-04-25T09:54:27.204310+0000","last_active":"2024-04-25T09:54:33.431887+0000","last_peered":"2024-04-25T09:54:33.431887+0000","last_clean":"2024-04-25T09:54:33.431887+0000","last_became_active":"2024-04-25T09:54:27.203973+0000","last_became_peered":"2024-04-25T09:54:27.203973+0000","last_unstale":"2024-04-25T09:54:33.431887+0000","last_undegraded":"2024-04-25T09:54:33.431887+0000","last_fullsized":"2024-04-25T09:54:33.431887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:25.329710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249452+0000","last_change":"2024-04-25T09:54:32.265896+0000","last_active":"2024-04-25T09:54:33.249452+0000","last_peered":"2024-04-25T09:54:33.249452+0000","last_clean":"2024-04-25T09:54:33.249452+0000","last_became_active":"2024-04-25T09:54:32.265185+0000","last_became_peered":"2024-04-25T09:54:32.265185+0000","last_unstale":"2024-04-25T09:54:33.249452+0000","last_undegraded":"2024-04-25T09:54:33.249452+0000","last_fullsized":"2024-04-25T09:54:33.249452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:10.694250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239224+0000","last_change":"2024-04-25T09:54:28.211914+0000","last_active":"2024-04-25T09:54:33.239224+0000","last_peered":"2024-04-25T09:54:33.239224+0000","last_clean":"2024-04-25T09:54:33.239224+0000","last_became_active":"2024-04-25T09:54:28.211506+0000","last_became_peered":"2024-04-25T09:54:28.211506+0000","last_unstale":"2024-04-25T09:54:33.239224+0000","last_undegraded":"2024-04-25T09:54:33.239224+0000","last_fullsized":"2024-04-25T09:54:33.239224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:47.076023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430746+0000","last_change":"2024-04-25T09:54:27.204816+0000","last_active":"2024-04-25T09:54:33.430746+0000","last_peered":"2024-04-25T09:54:33.430746+0000","last_clean":"2024-04-25T09:54:33.430746+0000","last_became_active":"2024-04-25T09:54:27.204539+0000","last_became_peered":"2024-04-25T09:54:27.204539+0000","last_unstale":"2024-04-25T09:54:33.430746+0000","last_undegraded":"2024-04-25T09:54:33.430746+0000","last_fullsized":"2024-04-25T09:54:33.430746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:04.425728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432270+0000","last_change":"2024-04-25T09:54:32.302487+0000","last_active":"2024-04-25T09:54:33.432270+0000","last_peered":"2024-04-25T09:54:33.432270+0000","last_clean":"2024-04-25T09:54:33.432270+0000","last_became_active":"2024-04-25T09:54:32.302085+0000","last_became_peered":"2024-04-25T09:54:32.302085+0000","last_unstale":"2024-04-25T09:54:33.432270+0000","last_undegraded":"2024-04-25T09:54:33.432270+0000","last_fullsized":"2024-04-25T09:54:33.432270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:00:29.792006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249025+0000","last_change":"2024-04-25T09:54:28.220488+0000","last_active":"2024-04-25T09:54:33.249025+0000","last_peered":"2024-04-25T09:54:33.249025+0000","last_clean":"2024-04-25T09:54:33.249025+0000","last_became_active":"2024-04-25T09:54:28.220151+0000","last_became_peered":"2024-04-25T09:54:28.220151+0000","last_unstale":"2024-04-25T09:54:33.249025+0000","last_undegraded":"2024-04-25T09:54:33.249025+0000","last_fullsized":"2024-04-25T09:54:33.249025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:35.664298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427200+0000","last_change":"2024-04-25T09:54:27.208900+0000","last_active":"2024-04-25T09:54:33.427200+0000","last_peered":"2024-04-25T09:54:33.427200+0000","last_clean":"2024-04-25T09:54:33.427200+0000","last_became_active":"2024-04-25T09:54:27.208616+0000","last_became_peered":"2024-04-25T09:54:27.208616+0000","last_unstale":"2024-04-25T09:54:33.427200+0000","last_undegraded":"2024-04-25T09:54:33.427200+0000","last_fullsized":"2024-04-25T09:54:33.427200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:25.329710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249752+0000","last_change":"2024-04-25T09:54:32.265564+0000","last_active":"2024-04-25T09:54:33.249752+0000","last_peered":"2024-04-25T09:54:33.249752+0000","last_clean":"2024-04-25T09:54:33.249752+0000","last_became_active":"2024-04-25T09:54:32.264127+0000","last_became_peered":"2024-04-25T09:54:32.264127+0000","last_unstale":"2024-04-25T09:54:33.249752+0000","last_undegraded":"2024-04-25T09:54:33.249752+0000","last_fullsized":"2024-04-25T09:54:33.249752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:40.490493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431796+0000","last_change":"2024-04-25T09:54:28.215357+0000","last_active":"2024-04-25T09:54:33.431796+0000","last_peered":"2024-04-25T09:54:33.431796+0000","last_clean":"2024-04-25T09:54:33.431796+0000","last_became_active":"2024-04-25T09:54:28.215024+0000","last_became_peered":"2024-04-25T09:54:28.215024+0000","last_unstale":"2024-04-25T09:54:33.431796+0000","last_undegraded":"2024-04-25T09:54:33.431796+0000","last_fullsized":"2024-04-25T09:54:33.431796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:04.526578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431920+0000","last_change":"2024-04-25T09:54:27.209041+0000","last_active":"2024-04-25T09:54:33.431920+0000","last_peered":"2024-04-25T09:54:33.431920+0000","last_clean":"2024-04-25T09:54:33.431920+0000","last_became_active":"2024-04-25T09:54:27.208815+0000","last_became_peered":"2024-04-25T09:54:27.208815+0000","last_unstale":"2024-04-25T09:54:33.431920+0000","last_undegraded":"2024-04-25T09:54:33.431920+0000","last_fullsized":"2024-04-25T09:54:33.431920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:04.425728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.248776+0000","last_change":"2024-04-25T09:54:32.302174+0000","last_active":"2024-04-25T09:54:33.248776+0000","last_peered":"2024-04-25T09:54:33.248776+0000","last_clean":"2024-04-25T09:54:33.248776+0000","last_became_active":"2024-04-25T09:54:32.301220+0000","last_became_peered":"2024-04-25T09:54:32.301220+0000","last_unstale":"2024-04-25T09:54:33.248776+0000","last_undegraded":"2024-04-25T09:54:33.248776+0000","last_fullsized":"2024-04-25T09:54:33.248776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:27.568226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.240028+0000","last_change":"2024-04-25T09:54:28.231766+0000","last_active":"2024-04-25T09:54:33.240028+0000","last_peered":"2024-04-25T09:54:33.240028+0000","last_clean":"2024-04-25T09:54:33.240028+0000","last_became_active":"2024-04-25T09:54:28.231150+0000","last_became_peered":"2024-04-25T09:54:28.231150+0000","last_unstale":"2024-04-25T09:54:33.240028+0000","last_undegraded":"2024-04-25T09:54:33.240028+0000","last_fullsized":"2024-04-25T09:54:33.240028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:52.698521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431983+0000","last_change":"2024-04-25T09:54:27.208806+0000","last_active":"2024-04-25T09:54:33.431983+0000","last_peered":"2024-04-25T09:54:33.431983+0000","last_clean":"2024-04-25T09:54:33.431983+0000","last_became_active":"2024-04-25T09:54:27.208458+0000","last_became_peered":"2024-04-25T09:54:27.208458+0000","last_unstale":"2024-04-25T09:54:33.431983+0000","last_undegraded":"2024-04-25T09:54:33.431983+0000","last_fullsized":"2024-04-25T09:54:33.431983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:04.423088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.238922+0000","last_change":"2024-04-25T09:54:32.297590+0000","last_active":"2024-04-25T09:54:33.238922+0000","last_peered":"2024-04-25T09:54:33.238922+0000","last_clean":"2024-04-25T09:54:33.238922+0000","last_became_active":"2024-04-25T09:54:32.297082+0000","last_became_peered":"2024-04-25T09:54:32.297082+0000","last_unstale":"2024-04-25T09:54:33.238922+0000","last_undegraded":"2024-04-25T09:54:33.238922+0000","last_fullsized":"2024-04-25T09:54:33.238922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:47.143113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431792+0000","last_change":"2024-04-25T09:54:28.219353+0000","last_active":"2024-04-25T09:54:33.431792+0000","last_peered":"2024-04-25T09:54:33.431792+0000","last_clean":"2024-04-25T09:54:33.431792+0000","last_became_active":"2024-04-25T09:54:28.219020+0000","last_became_peered":"2024-04-25T09:54:28.219020+0000","last_unstale":"2024-04-25T09:54:33.431792+0000","last_undegraded":"2024-04-25T09:54:33.431792+0000","last_fullsized":"2024-04-25T09:54:33.431792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:33.543144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.428072+0000","last_change":"2024-04-25T09:54:27.211097+0000","last_active":"2024-04-25T09:54:33.428072+0000","last_peered":"2024-04-25T09:54:33.428072+0000","last_clean":"2024-04-25T09:54:33.428072+0000","last_became_active":"2024-04-25T09:54:27.210827+0000","last_became_peered":"2024-04-25T09:54:27.210827+0000","last_unstale":"2024-04-25T09:54:33.428072+0000","last_undegraded":"2024-04-25T09:54:33.428072+0000","last_fullsized":"2024-04-25T09:54:33.428072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:04.423088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432136+0000","last_change":"2024-04-25T09:54:32.298586+0000","last_active":"2024-04-25T09:54:33.432136+0000","last_peered":"2024-04-25T09:54:33.432136+0000","last_clean":"2024-04-25T09:54:33.432136+0000","last_became_active":"2024-04-25T09:54:32.298232+0000","last_became_peered":"2024-04-25T09:54:32.298232+0000","last_unstale":"2024-04-25T09:54:33.432136+0000","last_undegraded":"2024-04-25T09:54:33.432136+0000","last_fullsized":"2024-04-25T09:54:33.432136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:00:29.792006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432216+0000","last_change":"2024-04-25T09:54:28.233937+0000","last_active":"2024-04-25T09:54:33.432216+0000","last_peered":"2024-04-25T09:54:33.432216+0000","last_clean":"2024-04-25T09:54:33.432216+0000","last_became_active":"2024-04-25T09:54:28.233380+0000","last_became_peered":"2024-04-25T09:54:28.233380+0000","last_unstale":"2024-04-25T09:54:33.432216+0000","last_undegraded":"2024-04-25T09:54:33.432216+0000","last_fullsized":"2024-04-25T09:54:33.432216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:26.253699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431881+0000","last_change":"2024-04-25T09:54:27.205411+0000","last_active":"2024-04-25T09:54:33.431881+0000","last_peered":"2024-04-25T09:54:33.431881+0000","last_clean":"2024-04-25T09:54:33.431881+0000","last_became_active":"2024-04-25T09:54:27.205101+0000","last_became_peered":"2024-04-25T09:54:27.205101+0000","last_unstale":"2024-04-25T09:54:33.431881+0000","last_undegraded":"2024-04-25T09:54:33.431881+0000","last_fullsized":"2024-04-25T09:54:33.431881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:34.656261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431521+0000","last_change":"2024-04-25T09:54:32.265789+0000","last_active":"2024-04-25T09:54:33.431521+0000","last_peered":"2024-04-25T09:54:33.431521+0000","last_clean":"2024-04-25T09:54:33.431521+0000","last_became_active":"2024-04-25T09:54:32.265413+0000","last_became_peered":"2024-04-25T09:54:32.265413+0000","last_unstale":"2024-04-25T09:54:33.431521+0000","last_undegraded":"2024-04-25T09:54:33.431521+0000","last_fullsized":"2024-04-25T09:54:33.431521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:40.490493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249457+0000","last_change":"2024-04-25T09:54:28.219660+0000","last_active":"2024-04-25T09:54:33.249457+0000","last_peered":"2024-04-25T09:54:33.249457+0000","last_clean":"2024-04-25T09:54:33.249457+0000","last_became_active":"2024-04-25T09:54:28.219368+0000","last_became_peered":"2024-04-25T09:54:28.219368+0000","last_unstale":"2024-04-25T09:54:33.249457+0000","last_undegraded":"2024-04-25T09:54:33.249457+0000","last_fullsized":"2024-04-25T09:54:33.249457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:54.743779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431901+0000","last_change":"2024-04-25T09:54:27.211603+0000","last_active":"2024-04-25T09:54:33.431901+0000","last_peered":"2024-04-25T09:54:33.431901+0000","last_clean":"2024-04-25T09:54:33.431901+0000","last_became_active":"2024-04-25T09:54:27.211196+0000","last_became_peered":"2024-04-25T09:54:27.211196+0000","last_unstale":"2024-04-25T09:54:33.431901+0000","last_undegraded":"2024-04-25T09:54:33.431901+0000","last_fullsized":"2024-04-25T09:54:33.431901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:04.425728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431739+0000","last_change":"2024-04-25T09:54:32.260167+0000","last_active":"2024-04-25T09:54:33.431739+0000","last_peered":"2024-04-25T09:54:33.431739+0000","last_clean":"2024-04-25T09:54:33.431739+0000","last_became_active":"2024-04-25T09:54:32.259801+0000","last_became_peered":"2024-04-25T09:54:32.259801+0000","last_unstale":"2024-04-25T09:54:33.431739+0000","last_undegraded":"2024-04-25T09:54:33.431739+0000","last_fullsized":"2024-04-25T09:54:33.431739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:30.296146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431154+0000","last_change":"2024-04-25T09:54:28.220347+0000","last_active":"2024-04-25T09:54:33.431154+0000","last_peered":"2024-04-25T09:54:33.431154+0000","last_clean":"2024-04-25T09:54:33.431154+0000","last_became_active":"2024-04-25T09:54:28.219921+0000","last_became_peered":"2024-04-25T09:54:28.219921+0000","last_unstale":"2024-04-25T09:54:33.431154+0000","last_undegraded":"2024-04-25T09:54:33.431154+0000","last_fullsized":"2024-04-25T09:54:33.431154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:04.526578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431058+0000","last_change":"2024-04-25T09:54:27.207799+0000","last_active":"2024-04-25T09:54:33.431058+0000","last_peered":"2024-04-25T09:54:33.431058+0000","last_clean":"2024-04-25T09:54:33.431058+0000","last_became_active":"2024-04-25T09:54:27.207502+0000","last_became_peered":"2024-04-25T09:54:27.207502+0000","last_unstale":"2024-04-25T09:54:33.431058+0000","last_undegraded":"2024-04-25T09:54:33.431058+0000","last_fullsized":"2024-04-25T09:54:33.431058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:02.804762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432415+0000","last_change":"2024-04-25T09:54:32.259101+0000","last_active":"2024-04-25T09:54:33.432415+0000","last_peered":"2024-04-25T09:54:33.432415+0000","last_clean":"2024-04-25T09:54:33.432415+0000","last_became_active":"2024-04-25T09:54:32.258688+0000","last_became_peered":"2024-04-25T09:54:32.258688+0000","last_unstale":"2024-04-25T09:54:33.432415+0000","last_undegraded":"2024-04-25T09:54:33.432415+0000","last_fullsized":"2024-04-25T09:54:33.432415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:14.029429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430481+0000","last_change":"2024-04-25T09:54:28.225496+0000","last_active":"2024-04-25T09:54:33.430481+0000","last_peered":"2024-04-25T09:54:33.430481+0000","last_clean":"2024-04-25T09:54:33.430481+0000","last_became_active":"2024-04-25T09:54:28.224696+0000","last_became_peered":"2024-04-25T09:54:28.224696+0000","last_unstale":"2024-04-25T09:54:33.430481+0000","last_undegraded":"2024-04-25T09:54:33.430481+0000","last_fullsized":"2024-04-25T09:54:33.430481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:04.396335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427226+0000","last_change":"2024-04-25T09:54:27.209821+0000","last_active":"2024-04-25T09:54:33.427226+0000","last_peered":"2024-04-25T09:54:33.427226+0000","last_clean":"2024-04-25T09:54:33.427226+0000","last_became_active":"2024-04-25T09:54:27.209548+0000","last_became_peered":"2024-04-25T09:54:27.209548+0000","last_unstale":"2024-04-25T09:54:33.427226+0000","last_undegraded":"2024-04-25T09:54:33.427226+0000","last_fullsized":"2024-04-25T09:54:33.427226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:34.656261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431635+0000","last_change":"2024-04-25T09:54:32.300518+0000","last_active":"2024-04-25T09:54:33.431635+0000","last_peered":"2024-04-25T09:54:33.431635+0000","last_clean":"2024-04-25T09:54:33.431635+0000","last_became_active":"2024-04-25T09:54:32.299847+0000","last_became_peered":"2024-04-25T09:54:32.299847+0000","last_unstale":"2024-04-25T09:54:33.431635+0000","last_undegraded":"2024-04-25T09:54:33.431635+0000","last_fullsized":"2024-04-25T09:54:33.431635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:30.296146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239165+0000","last_change":"2024-04-25T09:54:28.236433+0000","last_active":"2024-04-25T09:54:33.239165+0000","last_peered":"2024-04-25T09:54:33.239165+0000","last_clean":"2024-04-25T09:54:33.239165+0000","last_became_active":"2024-04-25T09:54:28.236130+0000","last_became_peered":"2024-04-25T09:54:28.236130+0000","last_unstale":"2024-04-25T09:54:33.239165+0000","last_undegraded":"2024-04-25T09:54:33.239165+0000","last_fullsized":"2024-04-25T09:54:33.239165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:33.543144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431705+0000","last_change":"2024-04-25T09:54:27.211760+0000","last_active":"2024-04-25T09:54:33.431705+0000","last_peered":"2024-04-25T09:54:33.431705+0000","last_clean":"2024-04-25T09:54:33.431705+0000","last_became_active":"2024-04-25T09:54:27.211452+0000","last_became_peered":"2024-04-25T09:54:27.211452+0000","last_unstale":"2024-04-25T09:54:33.431705+0000","last_undegraded":"2024-04-25T09:54:33.431705+0000","last_fullsized":"2024-04-25T09:54:33.431705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:02.804762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427371+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T09:54:33.427371+0000","last_peered":"2024-04-25T09:54:33.427371+0000","last_clean":"2024-04-25T09:54:33.427371+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T09:54:33.427371+0000","last_undegraded":"2024-04-25T09:54:33.427371+0000","last_fullsized":"2024-04-25T09:54:33.427371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431481+0000","last_change":"2024-04-25T09:54:32.299780+0000","last_active":"2024-04-25T09:54:33.431481+0000","last_peered":"2024-04-25T09:54:33.431481+0000","last_clean":"2024-04-25T09:54:33.431481+0000","last_became_active":"2024-04-25T09:54:32.299351+0000","last_became_peered":"2024-04-25T09:54:32.299351+0000","last_unstale":"2024-04-25T09:54:33.431481+0000","last_undegraded":"2024-04-25T09:54:33.431481+0000","last_fullsized":"2024-04-25T09:54:33.431481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:08.992474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427622+0000","last_change":"2024-04-25T09:54:28.235625+0000","last_active":"2024-04-25T09:54:33.427622+0000","last_peered":"2024-04-25T09:54:33.427622+0000","last_clean":"2024-04-25T09:54:33.427622+0000","last_became_active":"2024-04-25T09:54:28.235034+0000","last_became_peered":"2024-04-25T09:54:28.235034+0000","last_unstale":"2024-04-25T09:54:33.427622+0000","last_undegraded":"2024-04-25T09:54:33.427622+0000","last_fullsized":"2024-04-25T09:54:33.427622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:04.950026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432393+0000","last_change":"2024-04-25T09:54:27.212307+0000","last_active":"2024-04-25T09:54:33.432393+0000","last_peered":"2024-04-25T09:54:33.432393+0000","last_clean":"2024-04-25T09:54:33.432393+0000","last_became_active":"2024-04-25T09:54:27.211984+0000","last_became_peered":"2024-04-25T09:54:27.211984+0000","last_unstale":"2024-04-25T09:54:33.432393+0000","last_undegraded":"2024-04-25T09:54:33.432393+0000","last_fullsized":"2024-04-25T09:54:33.432393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:34.656261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431021+0000","last_change":"2024-04-25T09:54:32.297686+0000","last_active":"2024-04-25T09:54:33.431021+0000","last_peered":"2024-04-25T09:54:33.431021+0000","last_clean":"2024-04-25T09:54:33.431021+0000","last_became_active":"2024-04-25T09:54:32.297151+0000","last_became_peered":"2024-04-25T09:54:32.297151+0000","last_unstale":"2024-04-25T09:54:33.431021+0000","last_undegraded":"2024-04-25T09:54:33.431021+0000","last_fullsized":"2024-04-25T09:54:33.431021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:10.694250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432122+0000","last_change":"2024-04-25T09:54:28.230960+0000","last_active":"2024-04-25T09:54:33.432122+0000","last_peered":"2024-04-25T09:54:33.432122+0000","last_clean":"2024-04-25T09:54:33.432122+0000","last_became_active":"2024-04-25T09:54:28.230684+0000","last_became_peered":"2024-04-25T09:54:28.230684+0000","last_unstale":"2024-04-25T09:54:33.432122+0000","last_undegraded":"2024-04-25T09:54:33.432122+0000","last_fullsized":"2024-04-25T09:54:33.432122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:06.651802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431464+0000","last_change":"2024-04-25T09:54:27.205085+0000","last_active":"2024-04-25T09:54:33.431464+0000","last_peered":"2024-04-25T09:54:33.431464+0000","last_clean":"2024-04-25T09:54:33.431464+0000","last_became_active":"2024-04-25T09:54:27.204801+0000","last_became_peered":"2024-04-25T09:54:27.204801+0000","last_unstale":"2024-04-25T09:54:33.431464+0000","last_undegraded":"2024-04-25T09:54:33.431464+0000","last_fullsized":"2024-04-25T09:54:33.431464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:53.735742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432256+0000","last_change":"2024-04-25T09:54:32.262455+0000","last_active":"2024-04-25T09:54:33.432256+0000","last_peered":"2024-04-25T09:54:33.432256+0000","last_clean":"2024-04-25T09:54:33.432256+0000","last_became_active":"2024-04-25T09:54:32.261864+0000","last_became_peered":"2024-04-25T09:54:32.261864+0000","last_unstale":"2024-04-25T09:54:33.432256+0000","last_undegraded":"2024-04-25T09:54:33.432256+0000","last_fullsized":"2024-04-25T09:54:33.432256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:14.029429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.428064+0000","last_change":"2024-04-25T09:54:28.231074+0000","last_active":"2024-04-25T09:54:33.428064+0000","last_peered":"2024-04-25T09:54:33.428064+0000","last_clean":"2024-04-25T09:54:33.428064+0000","last_became_active":"2024-04-25T09:54:28.230535+0000","last_became_peered":"2024-04-25T09:54:28.230535+0000","last_unstale":"2024-04-25T09:54:33.428064+0000","last_undegraded":"2024-04-25T09:54:33.428064+0000","last_fullsized":"2024-04-25T09:54:33.428064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:09.986981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430862+0000","last_change":"2024-04-25T09:54:27.204630+0000","last_active":"2024-04-25T09:54:33.430862+0000","last_peered":"2024-04-25T09:54:33.430862+0000","last_clean":"2024-04-25T09:54:33.430862+0000","last_became_active":"2024-04-25T09:54:27.204321+0000","last_became_peered":"2024-04-25T09:54:27.204321+0000","last_unstale":"2024-04-25T09:54:33.430862+0000","last_undegraded":"2024-04-25T09:54:33.430862+0000","last_fullsized":"2024-04-25T09:54:33.430862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:25.329710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430615+0000","last_change":"2024-04-25T09:54:32.299684+0000","last_active":"2024-04-25T09:54:33.430615+0000","last_peered":"2024-04-25T09:54:33.430615+0000","last_clean":"2024-04-25T09:54:33.430615+0000","last_became_active":"2024-04-25T09:54:32.299058+0000","last_became_peered":"2024-04-25T09:54:32.299058+0000","last_unstale":"2024-04-25T09:54:33.430615+0000","last_undegraded":"2024-04-25T09:54:33.430615+0000","last_fullsized":"2024-04-25T09:54:33.430615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:44.665406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427809+0000","last_change":"2024-04-25T09:54:28.222738+0000","last_active":"2024-04-25T09:54:33.427809+0000","last_peered":"2024-04-25T09:54:33.427809+0000","last_clean":"2024-04-25T09:54:33.427809+0000","last_became_active":"2024-04-25T09:54:28.222468+0000","last_became_peered":"2024-04-25T09:54:28.222468+0000","last_unstale":"2024-04-25T09:54:33.427809+0000","last_undegraded":"2024-04-25T09:54:33.427809+0000","last_fullsized":"2024-04-25T09:54:33.427809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:36.448046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249841+0000","last_change":"2024-04-25T09:54:27.194471+0000","last_active":"2024-04-25T09:54:33.249841+0000","last_peered":"2024-04-25T09:54:33.249841+0000","last_clean":"2024-04-25T09:54:33.249841+0000","last_became_active":"2024-04-25T09:54:27.194172+0000","last_became_peered":"2024-04-25T09:54:27.194172+0000","last_unstale":"2024-04-25T09:54:33.249841+0000","last_undegraded":"2024-04-25T09:54:33.249841+0000","last_fullsized":"2024-04-25T09:54:33.249841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:47.482218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.248742+0000","last_change":"2024-04-25T09:54:32.266552+0000","last_active":"2024-04-25T09:54:33.248742+0000","last_peered":"2024-04-25T09:54:33.248742+0000","last_clean":"2024-04-25T09:54:33.248742+0000","last_became_active":"2024-04-25T09:54:32.266152+0000","last_became_peered":"2024-04-25T09:54:32.266152+0000","last_unstale":"2024-04-25T09:54:33.248742+0000","last_undegraded":"2024-04-25T09:54:33.248742+0000","last_fullsized":"2024-04-25T09:54:33.248742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:12.761675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427450+0000","last_change":"2024-04-25T09:54:28.225409+0000","last_active":"2024-04-25T09:54:33.427450+0000","last_peered":"2024-04-25T09:54:33.427450+0000","last_clean":"2024-04-25T09:54:33.427450+0000","last_became_active":"2024-04-25T09:54:28.225105+0000","last_became_peered":"2024-04-25T09:54:28.225105+0000","last_unstale":"2024-04-25T09:54:33.427450+0000","last_undegraded":"2024-04-25T09:54:33.427450+0000","last_fullsized":"2024-04-25T09:54:33.427450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:15.832642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430867+0000","last_change":"2024-04-25T09:54:27.207980+0000","last_active":"2024-04-25T09:54:33.430867+0000","last_peered":"2024-04-25T09:54:33.430867+0000","last_clean":"2024-04-25T09:54:33.430867+0000","last_became_active":"2024-04-25T09:54:27.205322+0000","last_became_peered":"2024-04-25T09:54:27.205322+0000","last_unstale":"2024-04-25T09:54:33.430867+0000","last_undegraded":"2024-04-25T09:54:33.430867+0000","last_fullsized":"2024-04-25T09:54:33.430867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:43.025512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431489+0000","last_change":"2024-04-25T09:54:32.252925+0000","last_active":"2024-04-25T09:54:33.431489+0000","last_peered":"2024-04-25T09:54:33.431489+0000","last_clean":"2024-04-25T09:54:33.431489+0000","last_became_active":"2024-04-25T09:54:32.252483+0000","last_became_peered":"2024-04-25T09:54:32.252483+0000","last_unstale":"2024-04-25T09:54:33.431489+0000","last_undegraded":"2024-04-25T09:54:33.431489+0000","last_fullsized":"2024-04-25T09:54:33.431489+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:55.727375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430685+0000","last_change":"2024-04-25T09:54:28.227852+0000","last_active":"2024-04-25T09:54:33.430685+0000","last_peered":"2024-04-25T09:54:33.430685+0000","last_clean":"2024-04-25T09:54:33.430685+0000","last_became_active":"2024-04-25T09:54:28.227552+0000","last_became_peered":"2024-04-25T09:54:28.227552+0000","last_unstale":"2024-04-25T09:54:33.430685+0000","last_undegraded":"2024-04-25T09:54:33.430685+0000","last_fullsized":"2024-04-25T09:54:33.430685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:29.799078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430794+0000","last_change":"2024-04-25T09:54:27.203990+0000","last_active":"2024-04-25T09:54:33.430794+0000","last_peered":"2024-04-25T09:54:33.430794+0000","last_clean":"2024-04-25T09:54:33.430794+0000","last_became_active":"2024-04-25T09:54:27.203714+0000","last_became_peered":"2024-04-25T09:54:27.203714+0000","last_unstale":"2024-04-25T09:54:33.430794+0000","last_undegraded":"2024-04-25T09:54:33.430794+0000","last_fullsized":"2024-04-25T09:54:33.430794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:02.804762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.240156+0000","last_change":"2024-04-25T09:54:32.300515+0000","last_active":"2024-04-25T09:54:33.240156+0000","last_peered":"2024-04-25T09:54:33.240156+0000","last_clean":"2024-04-25T09:54:33.240156+0000","last_became_active":"2024-04-25T09:54:32.300114+0000","last_became_peered":"2024-04-25T09:54:32.300114+0000","last_unstale":"2024-04-25T09:54:33.240156+0000","last_undegraded":"2024-04-25T09:54:33.240156+0000","last_fullsized":"2024-04-25T09:54:33.240156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:33.865351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427679+0000","last_change":"2024-04-25T09:54:28.231995+0000","last_active":"2024-04-25T09:54:33.427679+0000","last_peered":"2024-04-25T09:54:33.427679+0000","last_clean":"2024-04-25T09:54:33.427679+0000","last_became_active":"2024-04-25T09:54:28.231448+0000","last_became_peered":"2024-04-25T09:54:28.231448+0000","last_unstale":"2024-04-25T09:54:33.427679+0000","last_undegraded":"2024-04-25T09:54:33.427679+0000","last_fullsized":"2024-04-25T09:54:33.427679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:52.698521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431789+0000","last_change":"2024-04-25T09:54:27.211810+0000","last_active":"2024-04-25T09:54:33.431789+0000","last_peered":"2024-04-25T09:54:33.431789+0000","last_clean":"2024-04-25T09:54:33.431789+0000","last_became_active":"2024-04-25T09:54:27.211460+0000","last_became_peered":"2024-04-25T09:54:27.211460+0000","last_unstale":"2024-04-25T09:54:33.431789+0000","last_undegraded":"2024-04-25T09:54:33.431789+0000","last_fullsized":"2024-04-25T09:54:33.431789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:39.794974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239769+0000","last_change":"2024-04-25T09:54:32.297745+0000","last_active":"2024-04-25T09:54:33.239769+0000","last_peered":"2024-04-25T09:54:33.239769+0000","last_clean":"2024-04-25T09:54:33.239769+0000","last_became_active":"2024-04-25T09:54:32.297173+0000","last_became_peered":"2024-04-25T09:54:32.297173+0000","last_unstale":"2024-04-25T09:54:33.239769+0000","last_undegraded":"2024-04-25T09:54:33.239769+0000","last_fullsized":"2024-04-25T09:54:33.239769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:44.665406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431853+0000","last_change":"2024-04-25T09:54:28.235736+0000","last_active":"2024-04-25T09:54:33.431853+0000","last_peered":"2024-04-25T09:54:33.431853+0000","last_clean":"2024-04-25T09:54:33.431853+0000","last_became_active":"2024-04-25T09:54:28.235437+0000","last_became_peered":"2024-04-25T09:54:28.235437+0000","last_unstale":"2024-04-25T09:54:33.431853+0000","last_undegraded":"2024-04-25T09:54:33.431853+0000","last_fullsized":"2024-04-25T09:54:33.431853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:16.438954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432306+0000","last_change":"2024-04-25T09:54:27.194948+0000","last_active":"2024-04-25T09:54:33.432306+0000","last_peered":"2024-04-25T09:54:33.432306+0000","last_clean":"2024-04-25T09:54:33.432306+0000","last_became_active":"2024-04-25T09:54:27.194622+0000","last_became_peered":"2024-04-25T09:54:27.194622+0000","last_unstale":"2024-04-25T09:54:33.432306+0000","last_undegraded":"2024-04-25T09:54:33.432306+0000","last_fullsized":"2024-04-25T09:54:33.432306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:15.480038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432224+0000","last_change":"2024-04-25T09:54:32.298286+0000","last_active":"2024-04-25T09:54:33.432224+0000","last_peered":"2024-04-25T09:54:33.432224+0000","last_clean":"2024-04-25T09:54:33.432224+0000","last_became_active":"2024-04-25T09:54:32.297524+0000","last_became_peered":"2024-04-25T09:54:32.297524+0000","last_unstale":"2024-04-25T09:54:33.432224+0000","last_undegraded":"2024-04-25T09:54:33.432224+0000","last_fullsized":"2024-04-25T09:54:33.432224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:26.797002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427520+0000","last_change":"2024-04-25T09:54:28.225357+0000","last_active":"2024-04-25T09:54:33.427520+0000","last_peered":"2024-04-25T09:54:33.427520+0000","last_clean":"2024-04-25T09:54:33.427520+0000","last_became_active":"2024-04-25T09:54:28.225069+0000","last_became_peered":"2024-04-25T09:54:28.225069+0000","last_unstale":"2024-04-25T09:54:33.427520+0000","last_undegraded":"2024-04-25T09:54:33.427520+0000","last_fullsized":"2024-04-25T09:54:33.427520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:06.651802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:37.087126+0000","last_change":"2024-04-25T09:54:27.203341+0000","last_active":"2024-04-25T09:54:37.087126+0000","last_peered":"2024-04-25T09:54:37.087126+0000","last_clean":"2024-04-25T09:54:37.087126+0000","last_became_active":"2024-04-25T09:54:27.203044+0000","last_became_peered":"2024-04-25T09:54:27.203044+0000","last_unstale":"2024-04-25T09:54:37.087126+0000","last_undegraded":"2024-04-25T09:54:37.087126+0000","last_fullsized":"2024-04-25T09:54:37.087126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:34.656261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431728+0000","last_change":"2024-04-25T09:54:32.264939+0000","last_active":"2024-04-25T09:54:33.431728+0000","last_peered":"2024-04-25T09:54:33.431728+0000","last_clean":"2024-04-25T09:54:33.431728+0000","last_became_active":"2024-04-25T09:54:32.263237+0000","last_became_peered":"2024-04-25T09:54:32.263237+0000","last_unstale":"2024-04-25T09:54:33.431728+0000","last_undegraded":"2024-04-25T09:54:33.431728+0000","last_fullsized":"2024-04-25T09:54:33.431728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:55.727375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249518+0000","last_change":"2024-04-25T09:54:28.228347+0000","last_active":"2024-04-25T09:54:33.249518+0000","last_peered":"2024-04-25T09:54:33.249518+0000","last_clean":"2024-04-25T09:54:33.249518+0000","last_became_active":"2024-04-25T09:54:28.228054+0000","last_became_peered":"2024-04-25T09:54:28.228054+0000","last_unstale":"2024-04-25T09:54:33.249518+0000","last_undegraded":"2024-04-25T09:54:33.249518+0000","last_fullsized":"2024-04-25T09:54:33.249518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:05.431124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431354+0000","last_change":"2024-04-25T09:54:27.213081+0000","last_active":"2024-04-25T09:54:33.431354+0000","last_peered":"2024-04-25T09:54:33.431354+0000","last_clean":"2024-04-25T09:54:33.431354+0000","last_became_active":"2024-04-25T09:54:27.212717+0000","last_became_peered":"2024-04-25T09:54:27.212717+0000","last_unstale":"2024-04-25T09:54:33.431354+0000","last_undegraded":"2024-04-25T09:54:33.431354+0000","last_fullsized":"2024-04-25T09:54:33.431354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:39.794974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249368+0000","last_change":"2024-04-25T09:54:32.265709+0000","last_active":"2024-04-25T09:54:33.249368+0000","last_peered":"2024-04-25T09:54:33.249368+0000","last_clean":"2024-04-25T09:54:33.249368+0000","last_became_active":"2024-04-25T09:54:32.264564+0000","last_became_peered":"2024-04-25T09:54:32.264564+0000","last_unstale":"2024-04-25T09:54:33.249368+0000","last_undegraded":"2024-04-25T09:54:33.249368+0000","last_fullsized":"2024-04-25T09:54:33.249368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:56.740969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430940+0000","last_change":"2024-04-25T09:54:28.230395+0000","last_active":"2024-04-25T09:54:33.430940+0000","last_peered":"2024-04-25T09:54:33.430940+0000","last_clean":"2024-04-25T09:54:33.430940+0000","last_became_active":"2024-04-25T09:54:28.230094+0000","last_became_peered":"2024-04-25T09:54:28.230094+0000","last_unstale":"2024-04-25T09:54:33.430940+0000","last_undegraded":"2024-04-25T09:54:33.430940+0000","last_fullsized":"2024-04-25T09:54:33.430940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:08.719227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431892+0000","last_change":"2024-04-25T09:54:27.215296+0000","last_active":"2024-04-25T09:54:33.431892+0000","last_peered":"2024-04-25T09:54:33.431892+0000","last_clean":"2024-04-25T09:54:33.431892+0000","last_became_active":"2024-04-25T09:54:27.215029+0000","last_became_peered":"2024-04-25T09:54:27.215029+0000","last_unstale":"2024-04-25T09:54:33.431892+0000","last_undegraded":"2024-04-25T09:54:33.431892+0000","last_fullsized":"2024-04-25T09:54:33.431892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:34.656261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239377+0000","last_change":"2024-04-25T09:54:32.259386+0000","last_active":"2024-04-25T09:54:33.239377+0000","last_peered":"2024-04-25T09:54:33.239377+0000","last_clean":"2024-04-25T09:54:33.239377+0000","last_became_active":"2024-04-25T09:54:32.258463+0000","last_became_peered":"2024-04-25T09:54:32.258463+0000","last_unstale":"2024-04-25T09:54:33.239377+0000","last_undegraded":"2024-04-25T09:54:33.239377+0000","last_fullsized":"2024-04-25T09:54:33.239377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:55.620829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431885+0000","last_change":"2024-04-25T09:54:28.232092+0000","last_active":"2024-04-25T09:54:33.431885+0000","last_peered":"2024-04-25T09:54:33.431885+0000","last_clean":"2024-04-25T09:54:33.431885+0000","last_became_active":"2024-04-25T09:54:28.230521+0000","last_became_peered":"2024-04-25T09:54:28.230521+0000","last_unstale":"2024-04-25T09:54:33.431885+0000","last_undegraded":"2024-04-25T09:54:33.431885+0000","last_fullsized":"2024-04-25T09:54:33.431885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:51.684928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431720+0000","last_change":"2024-04-25T09:54:27.212262+0000","last_active":"2024-04-25T09:54:33.431720+0000","last_peered":"2024-04-25T09:54:33.431720+0000","last_clean":"2024-04-25T09:54:33.431720+0000","last_became_active":"2024-04-25T09:54:27.212009+0000","last_became_peered":"2024-04-25T09:54:27.212009+0000","last_unstale":"2024-04-25T09:54:33.431720+0000","last_undegraded":"2024-04-25T09:54:33.431720+0000","last_fullsized":"2024-04-25T09:54:33.431720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:25.329710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239235+0000","last_change":"2024-04-25T09:54:32.300659+0000","last_active":"2024-04-25T09:54:33.239235+0000","last_peered":"2024-04-25T09:54:33.239235+0000","last_clean":"2024-04-25T09:54:33.239235+0000","last_became_active":"2024-04-25T09:54:32.300214+0000","last_became_peered":"2024-04-25T09:54:32.300214+0000","last_unstale":"2024-04-25T09:54:33.239235+0000","last_undegraded":"2024-04-25T09:54:33.239235+0000","last_fullsized":"2024-04-25T09:54:33.239235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:13.180594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431335+0000","last_change":"2024-04-25T09:54:32.300216+0000","last_active":"2024-04-25T09:54:33.431335+0000","last_peered":"2024-04-25T09:54:33.431335+0000","last_clean":"2024-04-25T09:54:33.431335+0000","last_became_active":"2024-04-25T09:54:32.299316+0000","last_became_peered":"2024-04-25T09:54:32.299316+0000","last_unstale":"2024-04-25T09:54:33.431335+0000","last_undegraded":"2024-04-25T09:54:33.431335+0000","last_fullsized":"2024-04-25T09:54:33.431335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:40.490493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430556+0000","last_change":"2024-04-25T09:54:28.214303+0000","last_active":"2024-04-25T09:54:33.430556+0000","last_peered":"2024-04-25T09:54:33.430556+0000","last_clean":"2024-04-25T09:54:33.430556+0000","last_became_active":"2024-04-25T09:54:28.213973+0000","last_became_peered":"2024-04-25T09:54:28.213973+0000","last_unstale":"2024-04-25T09:54:33.430556+0000","last_undegraded":"2024-04-25T09:54:33.430556+0000","last_fullsized":"2024-04-25T09:54:33.430556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:23.525779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430800+0000","last_change":"2024-04-25T09:54:27.210642+0000","last_active":"2024-04-25T09:54:33.430800+0000","last_peered":"2024-04-25T09:54:33.430800+0000","last_clean":"2024-04-25T09:54:33.430800+0000","last_became_active":"2024-04-25T09:54:27.210345+0000","last_became_peered":"2024-04-25T09:54:27.210345+0000","last_unstale":"2024-04-25T09:54:33.430800+0000","last_undegraded":"2024-04-25T09:54:33.430800+0000","last_fullsized":"2024-04-25T09:54:33.430800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:25.329710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432201+0000","last_change":"2024-04-25T09:54:32.262209+0000","last_active":"2024-04-25T09:54:33.432201+0000","last_peered":"2024-04-25T09:54:33.432201+0000","last_clean":"2024-04-25T09:54:33.432201+0000","last_became_active":"2024-04-25T09:54:32.261761+0000","last_became_peered":"2024-04-25T09:54:32.261761+0000","last_unstale":"2024-04-25T09:54:33.432201+0000","last_undegraded":"2024-04-25T09:54:33.432201+0000","last_fullsized":"2024-04-25T09:54:33.432201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:40.490493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239107+0000","last_change":"2024-04-25T09:54:28.216779+0000","last_active":"2024-04-25T09:54:33.239107+0000","last_peered":"2024-04-25T09:54:33.239107+0000","last_clean":"2024-04-25T09:54:33.239107+0000","last_became_active":"2024-04-25T09:54:28.216470+0000","last_became_peered":"2024-04-25T09:54:28.216470+0000","last_unstale":"2024-04-25T09:54:33.239107+0000","last_undegraded":"2024-04-25T09:54:33.239107+0000","last_fullsized":"2024-04-25T09:54:33.239107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:04.526578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239393+0000","last_change":"2024-04-25T09:54:27.206958+0000","last_active":"2024-04-25T09:54:33.239393+0000","last_peered":"2024-04-25T09:54:33.239393+0000","last_clean":"2024-04-25T09:54:33.239393+0000","last_became_active":"2024-04-25T09:54:27.206664+0000","last_became_peered":"2024-04-25T09:54:27.206664+0000","last_unstale":"2024-04-25T09:54:33.239393+0000","last_undegraded":"2024-04-25T09:54:33.239393+0000","last_fullsized":"2024-04-25T09:54:33.239393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:44.480619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431165+0000","last_change":"2024-04-25T09:54:27.204005+0000","last_active":"2024-04-25T09:54:33.431165+0000","last_peered":"2024-04-25T09:54:33.431165+0000","last_clean":"2024-04-25T09:54:33.431165+0000","last_became_active":"2024-04-25T09:54:27.203754+0000","last_became_peered":"2024-04-25T09:54:27.203754+0000","last_unstale":"2024-04-25T09:54:33.431165+0000","last_undegraded":"2024-04-25T09:54:33.431165+0000","last_fullsized":"2024-04-25T09:54:33.431165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:39.794974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432276+0000","last_change":"2024-04-25T09:54:28.224588+0000","last_active":"2024-04-25T09:54:33.432276+0000","last_peered":"2024-04-25T09:54:33.432276+0000","last_clean":"2024-04-25T09:54:33.432276+0000","last_became_active":"2024-04-25T09:54:28.224085+0000","last_became_peered":"2024-04-25T09:54:28.224085+0000","last_unstale":"2024-04-25T09:54:33.432276+0000","last_undegraded":"2024-04-25T09:54:33.432276+0000","last_fullsized":"2024-04-25T09:54:33.432276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:23.525779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432222+0000","last_change":"2024-04-25T09:54:32.258902+0000","last_active":"2024-04-25T09:54:33.432222+0000","last_peered":"2024-04-25T09:54:33.432222+0000","last_clean":"2024-04-25T09:54:33.432222+0000","last_became_active":"2024-04-25T09:54:32.258520+0000","last_became_peered":"2024-04-25T09:54:32.258520+0000","last_unstale":"2024-04-25T09:54:33.432222+0000","last_undegraded":"2024-04-25T09:54:33.432222+0000","last_fullsized":"2024-04-25T09:54:33.432222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:31.442262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239580+0000","last_change":"2024-04-25T09:54:27.210481+0000","last_active":"2024-04-25T09:54:33.239580+0000","last_peered":"2024-04-25T09:54:33.239580+0000","last_clean":"2024-04-25T09:54:33.239580+0000","last_became_active":"2024-04-25T09:54:27.210234+0000","last_became_peered":"2024-04-25T09:54:27.210234+0000","last_unstale":"2024-04-25T09:54:33.239580+0000","last_undegraded":"2024-04-25T09:54:33.239580+0000","last_fullsized":"2024-04-25T09:54:33.239580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:43.025512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249024+0000","last_change":"2024-04-25T09:54:28.217905+0000","last_active":"2024-04-25T09:54:33.249024+0000","last_peered":"2024-04-25T09:54:33.249024+0000","last_clean":"2024-04-25T09:54:33.249024+0000","last_became_active":"2024-04-25T09:54:28.216955+0000","last_became_peered":"2024-04-25T09:54:28.216955+0000","last_unstale":"2024-04-25T09:54:33.249024+0000","last_undegraded":"2024-04-25T09:54:33.249024+0000","last_fullsized":"2024-04-25T09:54:33.249024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:05.433765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239944+0000","last_change":"2024-04-25T09:54:32.258140+0000","last_active":"2024-04-25T09:54:33.239944+0000","last_peered":"2024-04-25T09:54:33.239944+0000","last_clean":"2024-04-25T09:54:33.239944+0000","last_became_active":"2024-04-25T09:54:32.257702+0000","last_became_peered":"2024-04-25T09:54:32.257702+0000","last_unstale":"2024-04-25T09:54:33.239944+0000","last_undegraded":"2024-04-25T09:54:33.239944+0000","last_fullsized":"2024-04-25T09:54:33.239944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:26.797002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430559+0000","last_change":"2024-04-25T09:54:28.228362+0000","last_active":"2024-04-25T09:54:33.430559+0000","last_peered":"2024-04-25T09:54:33.430559+0000","last_clean":"2024-04-25T09:54:33.430559+0000","last_became_active":"2024-04-25T09:54:28.228109+0000","last_became_peered":"2024-04-25T09:54:28.228109+0000","last_unstale":"2024-04-25T09:54:33.430559+0000","last_undegraded":"2024-04-25T09:54:33.430559+0000","last_fullsized":"2024-04-25T09:54:33.430559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:04.526578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431200+0000","last_change":"2024-04-25T09:54:28.231028+0000","last_active":"2024-04-25T09:54:33.431200+0000","last_peered":"2024-04-25T09:54:33.431200+0000","last_clean":"2024-04-25T09:54:33.431200+0000","last_became_active":"2024-04-25T09:54:28.230707+0000","last_became_peered":"2024-04-25T09:54:28.230707+0000","last_unstale":"2024-04-25T09:54:33.431200+0000","last_undegraded":"2024-04-25T09:54:33.431200+0000","last_fullsized":"2024-04-25T09:54:33.431200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:54.743779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431645+0000","last_change":"2024-04-25T09:54:28.233501+0000","last_active":"2024-04-25T09:54:33.431645+0000","last_peered":"2024-04-25T09:54:33.431645+0000","last_clean":"2024-04-25T09:54:33.431645+0000","last_became_active":"2024-04-25T09:54:28.232806+0000","last_became_peered":"2024-04-25T09:54:28.232806+0000","last_unstale":"2024-04-25T09:54:33.431645+0000","last_undegraded":"2024-04-25T09:54:33.431645+0000","last_fullsized":"2024-04-25T09:54:33.431645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:04.950026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432189+0000","last_change":"2024-04-25T09:54:28.215003+0000","last_active":"2024-04-25T09:54:33.432189+0000","last_peered":"2024-04-25T09:54:33.432189+0000","last_clean":"2024-04-25T09:54:33.432189+0000","last_became_active":"2024-04-25T09:54:28.214700+0000","last_became_peered":"2024-04-25T09:54:28.214700+0000","last_unstale":"2024-04-25T09:54:33.432189+0000","last_undegraded":"2024-04-25T09:54:33.432189+0000","last_fullsized":"2024-04-25T09:54:33.432189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:47.076023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239981+0000","last_change":"2024-04-25T09:54:28.221725+0000","last_active":"2024-04-25T09:54:33.239981+0000","last_peered":"2024-04-25T09:54:33.239981+0000","last_clean":"2024-04-25T09:54:33.239981+0000","last_became_active":"2024-04-25T09:54:28.221436+0000","last_became_peered":"2024-04-25T09:54:28.221436+0000","last_unstale":"2024-04-25T09:54:33.239981+0000","last_undegraded":"2024-04-25T09:54:33.239981+0000","last_fullsized":"2024-04-25T09:54:33.239981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:08:42.765805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431173+0000","last_change":"2024-04-25T09:54:28.214081+0000","last_active":"2024-04-25T09:54:33.431173+0000","last_peered":"2024-04-25T09:54:33.431173+0000","last_clean":"2024-04-25T09:54:33.431173+0000","last_became_active":"2024-04-25T09:54:28.213740+0000","last_became_peered":"2024-04-25T09:54:28.213740+0000","last_unstale":"2024-04-25T09:54:33.431173+0000","last_undegraded":"2024-04-25T09:54:33.431173+0000","last_fullsized":"2024-04-25T09:54:33.431173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:47.076023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431566+0000","last_change":"2024-04-25T09:54:28.233804+0000","last_active":"2024-04-25T09:54:33.431566+0000","last_peered":"2024-04-25T09:54:33.431566+0000","last_clean":"2024-04-25T09:54:33.431566+0000","last_became_active":"2024-04-25T09:54:28.233532+0000","last_became_peered":"2024-04-25T09:54:28.233532+0000","last_unstale":"2024-04-25T09:54:33.431566+0000","last_undegraded":"2024-04-25T09:54:33.431566+0000","last_fullsized":"2024-04-25T09:54:33.431566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:23.525779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239898+0000","last_change":"2024-04-25T09:54:28.220983+0000","last_active":"2024-04-25T09:54:33.239898+0000","last_peered":"2024-04-25T09:54:33.239898+0000","last_clean":"2024-04-25T09:54:33.239898+0000","last_became_active":"2024-04-25T09:54:28.220569+0000","last_became_peered":"2024-04-25T09:54:28.220569+0000","last_unstale":"2024-04-25T09:54:33.239898+0000","last_undegraded":"2024-04-25T09:54:33.239898+0000","last_fullsized":"2024-04-25T09:54:33.239898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:15.832642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430742+0000","last_change":"2024-04-25T09:54:28.234837+0000","last_active":"2024-04-25T09:54:33.430742+0000","last_peered":"2024-04-25T09:54:33.430742+0000","last_clean":"2024-04-25T09:54:33.430742+0000","last_became_active":"2024-04-25T09:54:28.234316+0000","last_became_peered":"2024-04-25T09:54:28.234316+0000","last_unstale":"2024-04-25T09:54:33.430742+0000","last_undegraded":"2024-04-25T09:54:33.430742+0000","last_fullsized":"2024-04-25T09:54:33.430742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:23.525779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239213+0000","last_change":"2024-04-25T09:54:28.222528+0000","last_active":"2024-04-25T09:54:33.239213+0000","last_peered":"2024-04-25T09:54:33.239213+0000","last_clean":"2024-04-25T09:54:33.239213+0000","last_became_active":"2024-04-25T09:54:28.222211+0000","last_became_peered":"2024-04-25T09:54:28.222211+0000","last_unstale":"2024-04-25T09:54:33.239213+0000","last_undegraded":"2024-04-25T09:54:33.239213+0000","last_fullsized":"2024-04-25T09:54:33.239213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:29.799078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431509+0000","last_change":"2024-04-25T09:54:28.233715+0000","last_active":"2024-04-25T09:54:33.431509+0000","last_peered":"2024-04-25T09:54:33.431509+0000","last_clean":"2024-04-25T09:54:33.431509+0000","last_became_active":"2024-04-25T09:54:28.233426+0000","last_became_peered":"2024-04-25T09:54:28.233426+0000","last_unstale":"2024-04-25T09:54:33.431509+0000","last_undegraded":"2024-04-25T09:54:33.431509+0000","last_fullsized":"2024-04-25T09:54:33.431509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:08:42.765805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432061+0000","last_change":"2024-04-25T09:54:28.238380+0000","last_active":"2024-04-25T09:54:33.432061+0000","last_peered":"2024-04-25T09:54:33.432061+0000","last_clean":"2024-04-25T09:54:33.432061+0000","last_became_active":"2024-04-25T09:54:28.237240+0000","last_became_peered":"2024-04-25T09:54:28.237240+0000","last_unstale":"2024-04-25T09:54:33.432061+0000","last_undegraded":"2024-04-25T09:54:33.432061+0000","last_fullsized":"2024-04-25T09:54:33.432061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:35.167250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431164+0000","last_change":"2024-04-25T09:54:28.224401+0000","last_active":"2024-04-25T09:54:33.431164+0000","last_peered":"2024-04-25T09:54:33.431164+0000","last_clean":"2024-04-25T09:54:33.431164+0000","last_became_active":"2024-04-25T09:54:28.224093+0000","last_became_peered":"2024-04-25T09:54:28.224093+0000","last_unstale":"2024-04-25T09:54:33.431164+0000","last_undegraded":"2024-04-25T09:54:33.431164+0000","last_fullsized":"2024-04-25T09:54:33.431164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:47.076023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427994+0000","last_change":"2024-04-25T09:54:28.225887+0000","last_active":"2024-04-25T09:54:33.427994+0000","last_peered":"2024-04-25T09:54:33.427994+0000","last_clean":"2024-04-25T09:54:33.427994+0000","last_became_active":"2024-04-25T09:54:28.225650+0000","last_became_peered":"2024-04-25T09:54:28.225650+0000","last_unstale":"2024-04-25T09:54:33.427994+0000","last_undegraded":"2024-04-25T09:54:33.427994+0000","last_fullsized":"2024-04-25T09:54:33.427994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:51.684928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430756+0000","last_change":"2024-04-25T09:54:28.229389+0000","last_active":"2024-04-25T09:54:33.430756+0000","last_peered":"2024-04-25T09:54:33.430756+0000","last_clean":"2024-04-25T09:54:33.430756+0000","last_became_active":"2024-04-25T09:54:28.229001+0000","last_became_peered":"2024-04-25T09:54:28.229001+0000","last_unstale":"2024-04-25T09:54:33.430756+0000","last_undegraded":"2024-04-25T09:54:33.430756+0000","last_fullsized":"2024-04-25T09:54:33.430756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:05.431124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432079+0000","last_change":"2024-04-25T09:54:28.232625+0000","last_active":"2024-04-25T09:54:33.432079+0000","last_peered":"2024-04-25T09:54:33.432079+0000","last_clean":"2024-04-25T09:54:33.432079+0000","last_became_active":"2024-04-25T09:54:28.232336+0000","last_became_peered":"2024-04-25T09:54:28.232336+0000","last_unstale":"2024-04-25T09:54:33.432079+0000","last_undegraded":"2024-04-25T09:54:33.432079+0000","last_fullsized":"2024-04-25T09:54:33.432079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:00:25.749559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430564+0000","last_change":"2024-04-25T09:54:28.234614+0000","last_active":"2024-04-25T09:54:33.430564+0000","last_peered":"2024-04-25T09:54:33.430564+0000","last_clean":"2024-04-25T09:54:33.430564+0000","last_became_active":"2024-04-25T09:54:28.229921+0000","last_became_peered":"2024-04-25T09:54:28.229921+0000","last_unstale":"2024-04-25T09:54:33.430564+0000","last_undegraded":"2024-04-25T09:54:33.430564+0000","last_fullsized":"2024-04-25T09:54:33.430564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:08.719227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430653+0000","last_change":"2024-04-25T09:54:28.222801+0000","last_active":"2024-04-25T09:54:33.430653+0000","last_peered":"2024-04-25T09:54:33.430653+0000","last_clean":"2024-04-25T09:54:33.430653+0000","last_became_active":"2024-04-25T09:54:28.222496+0000","last_became_peered":"2024-04-25T09:54:28.222496+0000","last_unstale":"2024-04-25T09:54:33.430653+0000","last_undegraded":"2024-04-25T09:54:33.430653+0000","last_fullsized":"2024-04-25T09:54:33.430653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:35.167250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431763+0000","last_change":"2024-04-25T09:54:28.219741+0000","last_active":"2024-04-25T09:54:33.431763+0000","last_peered":"2024-04-25T09:54:33.431763+0000","last_clean":"2024-04-25T09:54:33.431763+0000","last_became_active":"2024-04-25T09:54:28.218538+0000","last_became_peered":"2024-04-25T09:54:28.218538+0000","last_unstale":"2024-04-25T09:54:33.431763+0000","last_undegraded":"2024-04-25T09:54:33.431763+0000","last_fullsized":"2024-04-25T09:54:33.431763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:27.399815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239440+0000","last_change":"2024-04-25T09:54:28.225395+0000","last_active":"2024-04-25T09:54:33.239440+0000","last_peered":"2024-04-25T09:54:33.239440+0000","last_clean":"2024-04-25T09:54:33.239440+0000","last_became_active":"2024-04-25T09:54:28.225087+0000","last_became_peered":"2024-04-25T09:54:28.225087+0000","last_unstale":"2024-04-25T09:54:33.239440+0000","last_undegraded":"2024-04-25T09:54:33.239440+0000","last_fullsized":"2024-04-25T09:54:33.239440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:08.719227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249339+0000","last_change":"2024-04-25T09:54:28.230175+0000","last_active":"2024-04-25T09:54:33.249339+0000","last_peered":"2024-04-25T09:54:33.249339+0000","last_clean":"2024-04-25T09:54:33.249339+0000","last_became_active":"2024-04-25T09:54:28.229811+0000","last_became_peered":"2024-04-25T09:54:28.229811+0000","last_unstale":"2024-04-25T09:54:33.249339+0000","last_undegraded":"2024-04-25T09:54:33.249339+0000","last_fullsized":"2024-04-25T09:54:33.249339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:40.803011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431341+0000","last_change":"2024-04-25T09:54:28.236127+0000","last_active":"2024-04-25T09:54:33.431341+0000","last_peered":"2024-04-25T09:54:33.431341+0000","last_clean":"2024-04-25T09:54:33.431341+0000","last_became_active":"2024-04-25T09:54:28.235849+0000","last_became_peered":"2024-04-25T09:54:28.235849+0000","last_unstale":"2024-04-25T09:54:33.431341+0000","last_undegraded":"2024-04-25T09:54:33.431341+0000","last_fullsized":"2024-04-25T09:54:33.431341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:33.543144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431499+0000","last_change":"2024-04-25T09:54:28.233050+0000","last_active":"2024-04-25T09:54:33.431499+0000","last_peered":"2024-04-25T09:54:33.431499+0000","last_clean":"2024-04-25T09:54:33.431499+0000","last_became_active":"2024-04-25T09:54:28.232758+0000","last_became_peered":"2024-04-25T09:54:28.232758+0000","last_unstale":"2024-04-25T09:54:33.431499+0000","last_undegraded":"2024-04-25T09:54:33.431499+0000","last_fullsized":"2024-04-25T09:54:33.431499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:08.719227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.428033+0000","last_change":"2024-04-25T09:54:28.237315+0000","last_active":"2024-04-25T09:54:33.428033+0000","last_peered":"2024-04-25T09:54:33.428033+0000","last_clean":"2024-04-25T09:54:33.428033+0000","last_became_active":"2024-04-25T09:54:28.235994+0000","last_became_peered":"2024-04-25T09:54:28.235994+0000","last_unstale":"2024-04-25T09:54:33.428033+0000","last_undegraded":"2024-04-25T09:54:33.428033+0000","last_fullsized":"2024-04-25T09:54:33.428033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:26.253699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.238952+0000","last_change":"2024-04-25T09:54:28.239527+0000","last_active":"2024-04-25T09:54:33.238952+0000","last_peered":"2024-04-25T09:54:33.238952+0000","last_clean":"2024-04-25T09:54:33.238952+0000","last_became_active":"2024-04-25T09:54:28.239231+0000","last_became_peered":"2024-04-25T09:54:28.239231+0000","last_unstale":"2024-04-25T09:54:33.238952+0000","last_undegraded":"2024-04-25T09:54:33.238952+0000","last_fullsized":"2024-04-25T09:54:33.238952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:35.167250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427536+0000","last_change":"2024-04-25T09:54:28.226800+0000","last_active":"2024-04-25T09:54:33.427536+0000","last_peered":"2024-04-25T09:54:33.427536+0000","last_clean":"2024-04-25T09:54:33.427536+0000","last_became_active":"2024-04-25T09:54:28.226516+0000","last_became_peered":"2024-04-25T09:54:28.226516+0000","last_unstale":"2024-04-25T09:54:33.427536+0000","last_undegraded":"2024-04-25T09:54:33.427536+0000","last_fullsized":"2024-04-25T09:54:33.427536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:50.006460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431400+0000","last_change":"2024-04-25T09:54:28.233084+0000","last_active":"2024-04-25T09:54:33.431400+0000","last_peered":"2024-04-25T09:54:33.431400+0000","last_clean":"2024-04-25T09:54:33.431400+0000","last_became_active":"2024-04-25T09:54:28.232546+0000","last_became_peered":"2024-04-25T09:54:28.232546+0000","last_unstale":"2024-04-25T09:54:33.431400+0000","last_undegraded":"2024-04-25T09:54:33.431400+0000","last_fullsized":"2024-04-25T09:54:33.431400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:50.006460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427429+0000","last_change":"2024-04-25T09:54:28.231761+0000","last_active":"2024-04-25T09:54:33.427429+0000","last_peered":"2024-04-25T09:54:33.427429+0000","last_clean":"2024-04-25T09:54:33.427429+0000","last_became_active":"2024-04-25T09:54:28.231159+0000","last_became_peered":"2024-04-25T09:54:28.231159+0000","last_unstale":"2024-04-25T09:54:33.427429+0000","last_undegraded":"2024-04-25T09:54:33.427429+0000","last_fullsized":"2024-04-25T09:54:33.427429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:08:42.765805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431892+0000","last_change":"2024-04-25T09:54:28.233126+0000","last_active":"2024-04-25T09:54:33.431892+0000","last_peered":"2024-04-25T09:54:33.431892+0000","last_clean":"2024-04-25T09:54:33.431892+0000","last_became_active":"2024-04-25T09:54:28.231248+0000","last_became_peered":"2024-04-25T09:54:28.231248+0000","last_unstale":"2024-04-25T09:54:33.431892+0000","last_undegraded":"2024-04-25T09:54:33.431892+0000","last_fullsized":"2024-04-25T09:54:33.431892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:15.832642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431295+0000","last_change":"2024-04-25T09:54:28.219491+0000","last_active":"2024-04-25T09:54:33.431295+0000","last_peered":"2024-04-25T09:54:33.431295+0000","last_clean":"2024-04-25T09:54:33.431295+0000","last_became_active":"2024-04-25T09:54:28.219177+0000","last_became_peered":"2024-04-25T09:54:28.219177+0000","last_unstale":"2024-04-25T09:54:33.431295+0000","last_undegraded":"2024-04-25T09:54:33.431295+0000","last_fullsized":"2024-04-25T09:54:33.431295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:29.799078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431885+0000","last_change":"2024-04-25T09:54:28.212159+0000","last_active":"2024-04-25T09:54:33.431885+0000","last_peered":"2024-04-25T09:54:33.431885+0000","last_clean":"2024-04-25T09:54:33.431885+0000","last_became_active":"2024-04-25T09:54:28.211850+0000","last_became_peered":"2024-04-25T09:54:28.211850+0000","last_unstale":"2024-04-25T09:54:33.431885+0000","last_undegraded":"2024-04-25T09:54:33.431885+0000","last_fullsized":"2024-04-25T09:54:33.431885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:08.719227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427873+0000","last_change":"2024-04-25T09:54:28.232766+0000","last_active":"2024-04-25T09:54:33.427873+0000","last_peered":"2024-04-25T09:54:33.427873+0000","last_clean":"2024-04-25T09:54:33.427873+0000","last_became_active":"2024-04-25T09:54:28.232333+0000","last_became_peered":"2024-04-25T09:54:28.232333+0000","last_unstale":"2024-04-25T09:54:33.427873+0000","last_undegraded":"2024-04-25T09:54:33.427873+0000","last_fullsized":"2024-04-25T09:54:33.427873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:00:25.749559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":860160,"data_stored":694757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":107508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":103897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":103933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":107508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":103807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":270336,"data_stored":103967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":868352,"data_stored":694813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:54:45.287 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:54:45.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.419+0000 7f5f3ea09640 1 Processor -- start 2024-04-25T09:54:45.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.420+0000 7f5f3ea09640 1 -- start start 2024-04-25T09:54:45.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.420+0000 7f5f3ea09640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5f3815dc60 0x7f5f380b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:45.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.420+0000 7f5f3ea09640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f380b5a20 con 0x7f5f380afc00 2024-04-25T09:54:45.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.420+0000 7f5f3ea09640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f380b0160 con 0x7f5f3806ab60 2024-04-25T09:54:45.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.420+0000 7f5f3ea09640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f380b1310 con 0x7f5f3815dc60 2024-04-25T09:54:45.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.421+0000 7f5f377fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5f3815dc60 0x7f5f380b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:45.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.421+0000 7f5f3cfa6640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5f380afc00 0x7f5f380b0c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35482/0 (socket says 172.21.15.7:35482) 2024-04-25T09:54:45.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.421+0000 7f5f3cfa6640 1 -- 172.21.15.7:0/3884849617 learned_addr learned my addr 172.21.15.7:0/3884849617 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:45.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.421+0000 7f5f377fe640 1 -- 172.21.15.7:0/3884849617 >> v1:172.21.15.55:6789/0 conn(0x7f5f3806ab60 legacy=0x7f5f3806af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:45.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.421+0000 7f5f377fe640 1 -- 172.21.15.7:0/3884849617 >> v1:172.21.15.7:6789/0 conn(0x7f5f380afc00 legacy=0x7f5f380b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:45.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.421+0000 7f5f377fe640 1 -- 172.21.15.7:0/3884849617 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f380b5740 con 0x7f5f3815dc60 2024-04-25T09:54:45.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.421+0000 7f5f36ffd640 1 -- 172.21.15.7:0/3884849617 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 355969211 0 0) 0x7f5f380b5a20 con 0x7f5f380afc00 2024-04-25T09:54:45.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.422+0000 7f5f377fe640 1 --2- 172.21.15.7:0/3884849617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f3815dc60 0x7f5f380b1ba0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5f280097a0 tx=0x7f5f2802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8ed2e5753a8e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:45.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.422+0000 7f5f36ffd640 1 -- 172.21.15.7:0/3884849617 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f28037070 con 0x7f5f3815dc60 2024-04-25T09:54:45.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.422+0000 7f5f36ffd640 1 -- 172.21.15.7:0/3884849617 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f28032440 con 0x7f5f3815dc60 2024-04-25T09:54:45.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.422+0000 7f5f36ffd640 1 -- 172.21.15.7:0/3884849617 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2802ae60 con 0x7f5f3815dc60 2024-04-25T09:54:45.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.422+0000 7f5f3ea09640 1 -- 172.21.15.7:0/3884849617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f3815dc60 msgr2=0x7f5f380b1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:45.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.422+0000 7f5f3ea09640 1 --2- 172.21.15.7:0/3884849617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f3815dc60 0x7f5f380b1ba0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5f280097a0 tx=0x7f5f2802a110 comp rx=0 tx=0).stop 2024-04-25T09:54:45.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.422+0000 7f5f3ea09640 1 -- 172.21.15.7:0/3884849617 shutdown_connections 2024-04-25T09:54:45.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.422+0000 7f5f3ea09640 1 --2- 172.21.15.7:0/3884849617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f3815dc60 0x7f5f380b1ba0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:45.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.422+0000 7f5f3ea09640 1 -- 172.21.15.7:0/3884849617 >> 172.21.15.7:0/3884849617 conn(0x7f5f380b5c30 msgr2=0x7f5f380999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:45.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.422+0000 7f5f3ea09640 1 -- 172.21.15.7:0/3884849617 shutdown_connections 2024-04-25T09:54:45.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.422+0000 7f5f3ea09640 1 -- 172.21.15.7:0/3884849617 wait complete. 2024-04-25T09:54:45.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.423+0000 7f5f3ea09640 1 Processor -- start 2024-04-25T09:54:45.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.424+0000 7f5f3ea09640 1 -- start start 2024-04-25T09:54:45.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.424+0000 7f5f3ea09640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f3806ab60 0x7f5f381f4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:45.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.424+0000 7f5f3ea09640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f380afc00 0x7f5f381588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:45.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.424+0000 7f5f3ea09640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5f3815dc60 0x7f5f38141ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:45.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.424+0000 7f5f3ea09640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f380b53e0 con 0x7f5f3806ab60 2024-04-25T09:54:45.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.424+0000 7f5f3ea09640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f380b5260 con 0x7f5f380afc00 2024-04-25T09:54:45.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.424+0000 7f5f3ea09640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f380ad460 con 0x7f5f3815dc60 2024-04-25T09:54:45.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.424+0000 7f5f37fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f3806ab60 0x7f5f381f4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:45.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.424+0000 7f5f37fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f3806ab60 0x7f5f381f4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42806/0 (socket says 172.21.15.7:42806) 2024-04-25T09:54:45.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.424+0000 7f5f37fff640 1 -- 172.21.15.7:0/3098499536 learned_addr learned my addr 172.21.15.7:0/3098499536 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:45.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.425+0000 7f5f377fe640 1 --2- 172.21.15.7:0/3098499536 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f380afc00 0x7f5f381588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:45.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.425+0000 7f5f3cfa6640 1 --2- 172.21.15.7:0/3098499536 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5f3815dc60 0x7f5f38141ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:45.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.425+0000 7f5f37fff640 1 -- 172.21.15.7:0/3098499536 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5f3815dc60 msgr2=0x7f5f38141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:45.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.425+0000 7f5f37fff640 1 --2- 172.21.15.7:0/3098499536 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5f3815dc60 0x7f5f38141ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:45.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.425+0000 7f5f37fff640 1 -- 172.21.15.7:0/3098499536 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f380afc00 msgr2=0x7f5f381588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:45.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.425+0000 7f5f37fff640 1 --2- 172.21.15.7:0/3098499536 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f380afc00 0x7f5f381588f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:45.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.425+0000 7f5f37fff640 1 -- 172.21.15.7:0/3098499536 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3815eff0 con 0x7f5f3806ab60 2024-04-25T09:54:45.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.425+0000 7f5f37fff640 1 --2- 172.21.15.7:0/3098499536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f3806ab60 0x7f5f381f4540 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5f2000c450 tx=0x7f5f2000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:45.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.425+0000 7f5f34ff9640 1 -- 172.21.15.7:0/3098499536 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f200052d0 con 0x7f5f3806ab60 2024-04-25T09:54:45.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.425+0000 7f5f34ff9640 1 -- 172.21.15.7:0/3098499536 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f20005470 con 0x7f5f3806ab60 2024-04-25T09:54:45.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.425+0000 7f5f3ea09640 1 -- 172.21.15.7:0/3098499536 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f38160a30 con 0x7f5f3806ab60 2024-04-25T09:54:45.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.425+0000 7f5f34ff9640 1 -- 172.21.15.7:0/3098499536 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f20012870 con 0x7f5f3806ab60 2024-04-25T09:54:45.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.425+0000 7f5f3ea09640 1 -- 172.21.15.7:0/3098499536 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f38158e30 con 0x7f5f3806ab60 2024-04-25T09:54:45.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.426+0000 7f5f3ea09640 1 -- 172.21.15.7:0/3098499536 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f38068fd0 con 0x7f5f3806ab60 2024-04-25T09:54:45.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.427+0000 7f5f34ff9640 1 -- 172.21.15.7:0/3098499536 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5f20012a10 con 0x7f5f3806ab60 2024-04-25T09:54:45.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.427+0000 7f5f34ff9640 1 --2- 172.21.15.7:0/3098499536 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5f1806b4d0 0x7f5f1806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:45.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.427+0000 7f5f34ff9640 1 -- 172.21.15.7:0/3098499536 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f5f2008a080 con 0x7f5f3806ab60 2024-04-25T09:54:45.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.427+0000 7f5f377fe640 1 --2- 172.21.15.7:0/3098499536 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5f1806b4d0 0x7f5f1806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:45.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.428+0000 7f5f377fe640 1 --2- 172.21.15.7:0/3098499536 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5f1806b4d0 0x7f5f1806d990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5f28034000 tx=0x7f5f2802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:45.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.431+0000 7f5f34ff9640 1 -- 172.21.15.7:0/3098499536 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5f200584f0 con 0x7f5f3806ab60 2024-04-25T09:54:45.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.608+0000 7f5f3ea09640 1 -- 172.21.15.7:0/3098499536 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5f3815e400 con 0x7f5f1806b4d0 2024-04-25T09:54:45.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.615+0000 7f5f34ff9640 1 -- 172.21.15.7:0/3098499536 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332534 (secure 0 0 0) 0x7f5f3815e400 con 0x7f5f1806b4d0 2024-04-25T09:54:45.622 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:45.623 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T09:54:45.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.618+0000 7f5f3ea09640 1 -- 172.21.15.7:0/3098499536 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5f1806b4d0 msgr2=0x7f5f1806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:45.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.618+0000 7f5f3ea09640 1 --2- 172.21.15.7:0/3098499536 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5f1806b4d0 0x7f5f1806d990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5f28034000 tx=0x7f5f2802e000 comp rx=0 tx=0).stop 2024-04-25T09:54:45.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.618+0000 7f5f3ea09640 1 -- 172.21.15.7:0/3098499536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f3806ab60 msgr2=0x7f5f381f4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:45.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.618+0000 7f5f3ea09640 1 --2- 172.21.15.7:0/3098499536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f3806ab60 0x7f5f381f4540 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5f2000c450 tx=0x7f5f2000c910 comp rx=0 tx=0).stop 2024-04-25T09:54:45.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.619+0000 7f5f3ea09640 1 -- 172.21.15.7:0/3098499536 shutdown_connections 2024-04-25T09:54:45.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.619+0000 7f5f3ea09640 1 --2- 172.21.15.7:0/3098499536 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5f1806b4d0 0x7f5f1806d990 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:45.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.619+0000 7f5f3ea09640 1 --2- 172.21.15.7:0/3098499536 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5f3815dc60 0x7f5f38141ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:45.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.619+0000 7f5f3ea09640 1 --2- 172.21.15.7:0/3098499536 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f380afc00 0x7f5f381588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:45.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.619+0000 7f5f3ea09640 1 --2- 172.21.15.7:0/3098499536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f3806ab60 0x7f5f381f4540 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:45.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.619+0000 7f5f3ea09640 1 -- 172.21.15.7:0/3098499536 >> 172.21.15.7:0/3098499536 conn(0x7f5f380b5c30 msgr2=0x7f5f38156300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:45.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.619+0000 7f5f3ea09640 1 -- 172.21.15.7:0/3098499536 shutdown_connections 2024-04-25T09:54:45.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.619+0000 7f5f3ea09640 1 -- 172.21.15.7:0/3098499536 wait complete. 2024-04-25T09:54:45.632 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-04-25T09:54:43.856660+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236096,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738624,"statfs":{"total":773094113280,"available":772852350976,"internally_reserved":0,"allocated":3350528,"data_stored":2020190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.619393"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431103+0000","last_change":"2024-04-25T09:54:27.205212+0000","last_active":"2024-04-25T09:54:33.431103+0000","last_peered":"2024-04-25T09:54:33.431103+0000","last_clean":"2024-04-25T09:54:33.431103+0000","last_became_active":"2024-04-25T09:54:27.204920+0000","last_became_peered":"2024-04-25T09:54:27.204920+0000","last_unstale":"2024-04-25T09:54:33.431103+0000","last_undegraded":"2024-04-25T09:54:33.431103+0000","last_fullsized":"2024-04-25T09:54:33.431103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:44.480619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239768+0000","last_change":"2024-04-25T09:54:28.228470+0000","last_active":"2024-04-25T09:54:33.239768+0000","last_peered":"2024-04-25T09:54:33.239768+0000","last_clean":"2024-04-25T09:54:33.239768+0000","last_became_active":"2024-04-25T09:54:28.228117+0000","last_became_peered":"2024-04-25T09:54:28.228117+0000","last_unstale":"2024-04-25T09:54:33.239768+0000","last_undegraded":"2024-04-25T09:54:33.239768+0000","last_fullsized":"2024-04-25T09:54:33.239768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:23.525779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239020+0000","last_change":"2024-04-25T09:54:32.301225+0000","last_active":"2024-04-25T09:54:33.239020+0000","last_peered":"2024-04-25T09:54:33.239020+0000","last_clean":"2024-04-25T09:54:33.239020+0000","last_became_active":"2024-04-25T09:54:32.300826+0000","last_became_peered":"2024-04-25T09:54:32.300826+0000","last_unstale":"2024-04-25T09:54:33.239020+0000","last_undegraded":"2024-04-25T09:54:33.239020+0000","last_fullsized":"2024-04-25T09:54:33.239020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:06.418222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239954+0000","last_change":"2024-04-25T09:54:27.209621+0000","last_active":"2024-04-25T09:54:33.239954+0000","last_peered":"2024-04-25T09:54:33.239954+0000","last_clean":"2024-04-25T09:54:33.239954+0000","last_became_active":"2024-04-25T09:54:27.209078+0000","last_became_peered":"2024-04-25T09:54:27.209078+0000","last_unstale":"2024-04-25T09:54:33.239954+0000","last_undegraded":"2024-04-25T09:54:33.239954+0000","last_fullsized":"2024-04-25T09:54:33.239954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:02.804762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430762+0000","last_change":"2024-04-25T09:54:28.230594+0000","last_active":"2024-04-25T09:54:33.430762+0000","last_peered":"2024-04-25T09:54:33.430762+0000","last_clean":"2024-04-25T09:54:33.430762+0000","last_became_active":"2024-04-25T09:54:28.230265+0000","last_became_peered":"2024-04-25T09:54:28.230265+0000","last_unstale":"2024-04-25T09:54:33.430762+0000","last_undegraded":"2024-04-25T09:54:33.430762+0000","last_fullsized":"2024-04-25T09:54:33.430762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:33.543144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.248999+0000","last_change":"2024-04-25T09:54:32.265543+0000","last_active":"2024-04-25T09:54:33.248999+0000","last_peered":"2024-04-25T09:54:33.248999+0000","last_clean":"2024-04-25T09:54:33.248999+0000","last_became_active":"2024-04-25T09:54:32.264147+0000","last_became_peered":"2024-04-25T09:54:32.264147+0000","last_unstale":"2024-04-25T09:54:33.248999+0000","last_undegraded":"2024-04-25T09:54:33.248999+0000","last_fullsized":"2024-04-25T09:54:33.248999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:19.875090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427980+0000","last_change":"2024-04-25T09:54:27.215105+0000","last_active":"2024-04-25T09:54:33.427980+0000","last_peered":"2024-04-25T09:54:33.427980+0000","last_clean":"2024-04-25T09:54:33.427980+0000","last_became_active":"2024-04-25T09:54:27.214820+0000","last_became_peered":"2024-04-25T09:54:27.214820+0000","last_unstale":"2024-04-25T09:54:33.427980+0000","last_undegraded":"2024-04-25T09:54:33.427980+0000","last_fullsized":"2024-04-25T09:54:33.427980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:39.794974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432058+0000","last_change":"2024-04-25T09:54:28.232586+0000","last_active":"2024-04-25T09:54:33.432058+0000","last_peered":"2024-04-25T09:54:33.432058+0000","last_clean":"2024-04-25T09:54:33.432058+0000","last_became_active":"2024-04-25T09:54:28.231544+0000","last_became_peered":"2024-04-25T09:54:28.231544+0000","last_unstale":"2024-04-25T09:54:33.432058+0000","last_undegraded":"2024-04-25T09:54:33.432058+0000","last_fullsized":"2024-04-25T09:54:33.432058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:52.698521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249218+0000","last_change":"2024-04-25T09:54:32.265350+0000","last_active":"2024-04-25T09:54:33.249218+0000","last_peered":"2024-04-25T09:54:33.249218+0000","last_clean":"2024-04-25T09:54:33.249218+0000","last_became_active":"2024-04-25T09:54:32.264913+0000","last_became_peered":"2024-04-25T09:54:32.264913+0000","last_unstale":"2024-04-25T09:54:33.249218+0000","last_undegraded":"2024-04-25T09:54:33.249218+0000","last_fullsized":"2024-04-25T09:54:33.249218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:08:46.808252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427640+0000","last_change":"2024-04-25T09:54:27.212359+0000","last_active":"2024-04-25T09:54:33.427640+0000","last_peered":"2024-04-25T09:54:33.427640+0000","last_clean":"2024-04-25T09:54:33.427640+0000","last_became_active":"2024-04-25T09:54:27.212058+0000","last_became_peered":"2024-04-25T09:54:27.212058+0000","last_unstale":"2024-04-25T09:54:33.427640+0000","last_undegraded":"2024-04-25T09:54:33.427640+0000","last_fullsized":"2024-04-25T09:54:33.427640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:04.425728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432088+0000","last_change":"2024-04-25T09:54:28.230562+0000","last_active":"2024-04-25T09:54:33.432088+0000","last_peered":"2024-04-25T09:54:33.432088+0000","last_clean":"2024-04-25T09:54:33.432088+0000","last_became_active":"2024-04-25T09:54:28.230276+0000","last_became_peered":"2024-04-25T09:54:28.230276+0000","last_unstale":"2024-04-25T09:54:33.432088+0000","last_undegraded":"2024-04-25T09:54:33.432088+0000","last_fullsized":"2024-04-25T09:54:33.432088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:36.448046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.248804+0000","last_change":"2024-04-25T09:54:32.256284+0000","last_active":"2024-04-25T09:54:33.248804+0000","last_peered":"2024-04-25T09:54:33.248804+0000","last_clean":"2024-04-25T09:54:33.248804+0000","last_became_active":"2024-04-25T09:54:32.255895+0000","last_became_peered":"2024-04-25T09:54:32.255895+0000","last_unstale":"2024-04-25T09:54:33.248804+0000","last_undegraded":"2024-04-25T09:54:33.248804+0000","last_fullsized":"2024-04-25T09:54:33.248804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:54.048907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430965+0000","last_change":"2024-04-25T09:54:28.228430+0000","last_active":"2024-04-25T09:54:33.430965+0000","last_peered":"2024-04-25T09:54:33.430965+0000","last_clean":"2024-04-25T09:54:33.430965+0000","last_became_active":"2024-04-25T09:54:28.228142+0000","last_became_peered":"2024-04-25T09:54:28.228142+0000","last_unstale":"2024-04-25T09:54:33.430965+0000","last_undegraded":"2024-04-25T09:54:33.430965+0000","last_fullsized":"2024-04-25T09:54:33.430965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:35.167250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427810+0000","last_change":"2024-04-25T09:54:27.209265+0000","last_active":"2024-04-25T09:54:33.427810+0000","last_peered":"2024-04-25T09:54:33.427810+0000","last_clean":"2024-04-25T09:54:33.427810+0000","last_became_active":"2024-04-25T09:54:27.209017+0000","last_became_peered":"2024-04-25T09:54:27.209017+0000","last_unstale":"2024-04-25T09:54:33.427810+0000","last_undegraded":"2024-04-25T09:54:33.427810+0000","last_fullsized":"2024-04-25T09:54:33.427810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:53.735742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249574+0000","last_change":"2024-04-25T09:54:32.265153+0000","last_active":"2024-04-25T09:54:33.249574+0000","last_peered":"2024-04-25T09:54:33.249574+0000","last_clean":"2024-04-25T09:54:33.249574+0000","last_became_active":"2024-04-25T09:54:32.264252+0000","last_became_peered":"2024-04-25T09:54:32.264252+0000","last_unstale":"2024-04-25T09:54:33.249574+0000","last_undegraded":"2024-04-25T09:54:33.249574+0000","last_fullsized":"2024-04-25T09:54:33.249574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:08.992474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239443+0000","last_change":"2024-04-25T09:54:28.217914+0000","last_active":"2024-04-25T09:54:33.239443+0000","last_peered":"2024-04-25T09:54:33.239443+0000","last_clean":"2024-04-25T09:54:33.239443+0000","last_became_active":"2024-04-25T09:54:28.217591+0000","last_became_peered":"2024-04-25T09:54:28.217591+0000","last_unstale":"2024-04-25T09:54:33.239443+0000","last_undegraded":"2024-04-25T09:54:33.239443+0000","last_fullsized":"2024-04-25T09:54:33.239443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:50.006460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431887+0000","last_change":"2024-04-25T09:54:27.204310+0000","last_active":"2024-04-25T09:54:33.431887+0000","last_peered":"2024-04-25T09:54:33.431887+0000","last_clean":"2024-04-25T09:54:33.431887+0000","last_became_active":"2024-04-25T09:54:27.203973+0000","last_became_peered":"2024-04-25T09:54:27.203973+0000","last_unstale":"2024-04-25T09:54:33.431887+0000","last_undegraded":"2024-04-25T09:54:33.431887+0000","last_fullsized":"2024-04-25T09:54:33.431887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:25.329710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249452+0000","last_change":"2024-04-25T09:54:32.265896+0000","last_active":"2024-04-25T09:54:33.249452+0000","last_peered":"2024-04-25T09:54:33.249452+0000","last_clean":"2024-04-25T09:54:33.249452+0000","last_became_active":"2024-04-25T09:54:32.265185+0000","last_became_peered":"2024-04-25T09:54:32.265185+0000","last_unstale":"2024-04-25T09:54:33.249452+0000","last_undegraded":"2024-04-25T09:54:33.249452+0000","last_fullsized":"2024-04-25T09:54:33.249452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:10.694250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239224+0000","last_change":"2024-04-25T09:54:28.211914+0000","last_active":"2024-04-25T09:54:33.239224+0000","last_peered":"2024-04-25T09:54:33.239224+0000","last_clean":"2024-04-25T09:54:33.239224+0000","last_became_active":"2024-04-25T09:54:28.211506+0000","last_became_peered":"2024-04-25T09:54:28.211506+0000","last_unstale":"2024-04-25T09:54:33.239224+0000","last_undegraded":"2024-04-25T09:54:33.239224+0000","last_fullsized":"2024-04-25T09:54:33.239224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:47.076023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430746+0000","last_change":"2024-04-25T09:54:27.204816+0000","last_active":"2024-04-25T09:54:33.430746+0000","last_peered":"2024-04-25T09:54:33.430746+0000","last_clean":"2024-04-25T09:54:33.430746+0000","last_became_active":"2024-04-25T09:54:27.204539+0000","last_became_peered":"2024-04-25T09:54:27.204539+0000","last_unstale":"2024-04-25T09:54:33.430746+0000","last_undegraded":"2024-04-25T09:54:33.430746+0000","last_fullsized":"2024-04-25T09:54:33.430746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:04.425728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432270+0000","last_change":"2024-04-25T09:54:32.302487+0000","last_active":"2024-04-25T09:54:33.432270+0000","last_peered":"2024-04-25T09:54:33.432270+0000","last_clean":"2024-04-25T09:54:33.432270+0000","last_became_active":"2024-04-25T09:54:32.302085+0000","last_became_peered":"2024-04-25T09:54:32.302085+0000","last_unstale":"2024-04-25T09:54:33.432270+0000","last_undegraded":"2024-04-25T09:54:33.432270+0000","last_fullsized":"2024-04-25T09:54:33.432270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:00:29.792006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249025+0000","last_change":"2024-04-25T09:54:28.220488+0000","last_active":"2024-04-25T09:54:33.249025+0000","last_peered":"2024-04-25T09:54:33.249025+0000","last_clean":"2024-04-25T09:54:33.249025+0000","last_became_active":"2024-04-25T09:54:28.220151+0000","last_became_peered":"2024-04-25T09:54:28.220151+0000","last_unstale":"2024-04-25T09:54:33.249025+0000","last_undegraded":"2024-04-25T09:54:33.249025+0000","last_fullsized":"2024-04-25T09:54:33.249025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:35.664298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427200+0000","last_change":"2024-04-25T09:54:27.208900+0000","last_active":"2024-04-25T09:54:33.427200+0000","last_peered":"2024-04-25T09:54:33.427200+0000","last_clean":"2024-04-25T09:54:33.427200+0000","last_became_active":"2024-04-25T09:54:27.208616+0000","last_became_peered":"2024-04-25T09:54:27.208616+0000","last_unstale":"2024-04-25T09:54:33.427200+0000","last_undegraded":"2024-04-25T09:54:33.427200+0000","last_fullsized":"2024-04-25T09:54:33.427200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:25.329710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249752+0000","last_change":"2024-04-25T09:54:32.265564+0000","last_active":"2024-04-25T09:54:33.249752+0000","last_peered":"2024-04-25T09:54:33.249752+0000","last_clean":"2024-04-25T09:54:33.249752+0000","last_became_active":"2024-04-25T09:54:32.264127+0000","last_became_peered":"2024-04-25T09:54:32.264127+0000","last_unstale":"2024-04-25T09:54:33.249752+0000","last_undegraded":"2024-04-25T09:54:33.249752+0000","last_fullsized":"2024-04-25T09:54:33.249752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:40.490493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431796+0000","last_change":"2024-04-25T09:54:28.215357+0000","last_active":"2024-04-25T09:54:33.431796+0000","last_peered":"2024-04-25T09:54:33.431796+0000","last_clean":"2024-04-25T09:54:33.431796+0000","last_became_active":"2024-04-25T09:54:28.215024+0000","last_became_peered":"2024-04-25T09:54:28.215024+0000","last_unstale":"2024-04-25T09:54:33.431796+0000","last_undegraded":"2024-04-25T09:54:33.431796+0000","last_fullsized":"2024-04-25T09:54:33.431796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:04.526578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431920+0000","last_change":"2024-04-25T09:54:27.209041+0000","last_active":"2024-04-25T09:54:33.431920+0000","last_peered":"2024-04-25T09:54:33.431920+0000","last_clean":"2024-04-25T09:54:33.431920+0000","last_became_active":"2024-04-25T09:54:27.208815+0000","last_became_peered":"2024-04-25T09:54:27.208815+0000","last_unstale":"2024-04-25T09:54:33.431920+0000","last_undegraded":"2024-04-25T09:54:33.431920+0000","last_fullsized":"2024-04-25T09:54:33.431920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:04.425728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.248776+0000","last_change":"2024-04-25T09:54:32.302174+0000","last_active":"2024-04-25T09:54:33.248776+0000","last_peered":"2024-04-25T09:54:33.248776+0000","last_clean":"2024-04-25T09:54:33.248776+0000","last_became_active":"2024-04-25T09:54:32.301220+0000","last_became_peered":"2024-04-25T09:54:32.301220+0000","last_unstale":"2024-04-25T09:54:33.248776+0000","last_undegraded":"2024-04-25T09:54:33.248776+0000","last_fullsized":"2024-04-25T09:54:33.248776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:27.568226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.240028+0000","last_change":"2024-04-25T09:54:28.231766+0000","last_active":"2024-04-25T09:54:33.240028+0000","last_peered":"2024-04-25T09:54:33.240028+0000","last_clean":"2024-04-25T09:54:33.240028+0000","last_became_active":"2024-04-25T09:54:28.231150+0000","last_became_peered":"2024-04-25T09:54:28.231150+0000","last_unstale":"2024-04-25T09:54:33.240028+0000","last_undegraded":"2024-04-25T09:54:33.240028+0000","last_fullsized":"2024-04-25T09:54:33.240028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:52.698521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431983+0000","last_change":"2024-04-25T09:54:27.208806+0000","last_active":"2024-04-25T09:54:33.431983+0000","last_peered":"2024-04-25T09:54:33.431983+0000","last_clean":"2024-04-25T09:54:33.431983+0000","last_became_active":"2024-04-25T09:54:27.208458+0000","last_became_peered":"2024-04-25T09:54:27.208458+0000","last_unstale":"2024-04-25T09:54:33.431983+0000","last_undegraded":"2024-04-25T09:54:33.431983+0000","last_fullsized":"2024-04-25T09:54:33.431983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:04.423088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.238922+0000","last_change":"2024-04-25T09:54:32.297590+0000","last_active":"2024-04-25T09:54:33.238922+0000","last_peered":"2024-04-25T09:54:33.238922+0000","last_clean":"2024-04-25T09:54:33.238922+0000","last_became_active":"2024-04-25T09:54:32.297082+0000","last_became_peered":"2024-04-25T09:54:32.297082+0000","last_unstale":"2024-04-25T09:54:33.238922+0000","last_undegraded":"2024-04-25T09:54:33.238922+0000","last_fullsized":"2024-04-25T09:54:33.238922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:47.143113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431792+0000","last_change":"2024-04-25T09:54:28.219353+0000","last_active":"2024-04-25T09:54:33.431792+0000","last_peered":"2024-04-25T09:54:33.431792+0000","last_clean":"2024-04-25T09:54:33.431792+0000","last_became_active":"2024-04-25T09:54:28.219020+0000","last_became_peered":"2024-04-25T09:54:28.219020+0000","last_unstale":"2024-04-25T09:54:33.431792+0000","last_undegraded":"2024-04-25T09:54:33.431792+0000","last_fullsized":"2024-04-25T09:54:33.431792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:33.543144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.428072+0000","last_change":"2024-04-25T09:54:27.211097+0000","last_active":"2024-04-25T09:54:33.428072+0000","last_peered":"2024-04-25T09:54:33.428072+0000","last_clean":"2024-04-25T09:54:33.428072+0000","last_became_active":"2024-04-25T09:54:27.210827+0000","last_became_peered":"2024-04-25T09:54:27.210827+0000","last_unstale":"2024-04-25T09:54:33.428072+0000","last_undegraded":"2024-04-25T09:54:33.428072+0000","last_fullsized":"2024-04-25T09:54:33.428072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:04.423088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432136+0000","last_change":"2024-04-25T09:54:32.298586+0000","last_active":"2024-04-25T09:54:33.432136+0000","last_peered":"2024-04-25T09:54:33.432136+0000","last_clean":"2024-04-25T09:54:33.432136+0000","last_became_active":"2024-04-25T09:54:32.298232+0000","last_became_peered":"2024-04-25T09:54:32.298232+0000","last_unstale":"2024-04-25T09:54:33.432136+0000","last_undegraded":"2024-04-25T09:54:33.432136+0000","last_fullsized":"2024-04-25T09:54:33.432136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:00:29.792006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432216+0000","last_change":"2024-04-25T09:54:28.233937+0000","last_active":"2024-04-25T09:54:33.432216+0000","last_peered":"2024-04-25T09:54:33.432216+0000","last_clean":"2024-04-25T09:54:33.432216+0000","last_became_active":"2024-04-25T09:54:28.233380+0000","last_became_peered":"2024-04-25T09:54:28.233380+0000","last_unstale":"2024-04-25T09:54:33.432216+0000","last_undegraded":"2024-04-25T09:54:33.432216+0000","last_fullsized":"2024-04-25T09:54:33.432216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:26.253699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431881+0000","last_change":"2024-04-25T09:54:27.205411+0000","last_active":"2024-04-25T09:54:33.431881+0000","last_peered":"2024-04-25T09:54:33.431881+0000","last_clean":"2024-04-25T09:54:33.431881+0000","last_became_active":"2024-04-25T09:54:27.205101+0000","last_became_peered":"2024-04-25T09:54:27.205101+0000","last_unstale":"2024-04-25T09:54:33.431881+0000","last_undegraded":"2024-04-25T09:54:33.431881+0000","last_fullsized":"2024-04-25T09:54:33.431881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:34.656261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431521+0000","last_change":"2024-04-25T09:54:32.265789+0000","last_active":"2024-04-25T09:54:33.431521+0000","last_peered":"2024-04-25T09:54:33.431521+0000","last_clean":"2024-04-25T09:54:33.431521+0000","last_became_active":"2024-04-25T09:54:32.265413+0000","last_became_peered":"2024-04-25T09:54:32.265413+0000","last_unstale":"2024-04-25T09:54:33.431521+0000","last_undegraded":"2024-04-25T09:54:33.431521+0000","last_fullsized":"2024-04-25T09:54:33.431521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:40.490493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249457+0000","last_change":"2024-04-25T09:54:28.219660+0000","last_active":"2024-04-25T09:54:33.249457+0000","last_peered":"2024-04-25T09:54:33.249457+0000","last_clean":"2024-04-25T09:54:33.249457+0000","last_became_active":"2024-04-25T09:54:28.219368+0000","last_became_peered":"2024-04-25T09:54:28.219368+0000","last_unstale":"2024-04-25T09:54:33.249457+0000","last_undegraded":"2024-04-25T09:54:33.249457+0000","last_fullsized":"2024-04-25T09:54:33.249457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:54.743779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431901+0000","last_change":"2024-04-25T09:54:27.211603+0000","last_active":"2024-04-25T09:54:33.431901+0000","last_peered":"2024-04-25T09:54:33.431901+0000","last_clean":"2024-04-25T09:54:33.431901+0000","last_became_active":"2024-04-25T09:54:27.211196+0000","last_became_peered":"2024-04-25T09:54:27.211196+0000","last_unstale":"2024-04-25T09:54:33.431901+0000","last_undegraded":"2024-04-25T09:54:33.431901+0000","last_fullsized":"2024-04-25T09:54:33.431901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:04.425728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431739+0000","last_change":"2024-04-25T09:54:32.260167+0000","last_active":"2024-04-25T09:54:33.431739+0000","last_peered":"2024-04-25T09:54:33.431739+0000","last_clean":"2024-04-25T09:54:33.431739+0000","last_became_active":"2024-04-25T09:54:32.259801+0000","last_became_peered":"2024-04-25T09:54:32.259801+0000","last_unstale":"2024-04-25T09:54:33.431739+0000","last_undegraded":"2024-04-25T09:54:33.431739+0000","last_fullsized":"2024-04-25T09:54:33.431739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:30.296146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431154+0000","last_change":"2024-04-25T09:54:28.220347+0000","last_active":"2024-04-25T09:54:33.431154+0000","last_peered":"2024-04-25T09:54:33.431154+0000","last_clean":"2024-04-25T09:54:33.431154+0000","last_became_active":"2024-04-25T09:54:28.219921+0000","last_became_peered":"2024-04-25T09:54:28.219921+0000","last_unstale":"2024-04-25T09:54:33.431154+0000","last_undegraded":"2024-04-25T09:54:33.431154+0000","last_fullsized":"2024-04-25T09:54:33.431154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:04.526578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431058+0000","last_change":"2024-04-25T09:54:27.207799+0000","last_active":"2024-04-25T09:54:33.431058+0000","last_peered":"2024-04-25T09:54:33.431058+0000","last_clean":"2024-04-25T09:54:33.431058+0000","last_became_active":"2024-04-25T09:54:27.207502+0000","last_became_peered":"2024-04-25T09:54:27.207502+0000","last_unstale":"2024-04-25T09:54:33.431058+0000","last_undegraded":"2024-04-25T09:54:33.431058+0000","last_fullsized":"2024-04-25T09:54:33.431058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:02.804762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432415+0000","last_change":"2024-04-25T09:54:32.259101+0000","last_active":"2024-04-25T09:54:33.432415+0000","last_peered":"2024-04-25T09:54:33.432415+0000","last_clean":"2024-04-25T09:54:33.432415+0000","last_became_active":"2024-04-25T09:54:32.258688+0000","last_became_peered":"2024-04-25T09:54:32.258688+0000","last_unstale":"2024-04-25T09:54:33.432415+0000","last_undegraded":"2024-04-25T09:54:33.432415+0000","last_fullsized":"2024-04-25T09:54:33.432415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:14.029429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430481+0000","last_change":"2024-04-25T09:54:28.225496+0000","last_active":"2024-04-25T09:54:33.430481+0000","last_peered":"2024-04-25T09:54:33.430481+0000","last_clean":"2024-04-25T09:54:33.430481+0000","last_became_active":"2024-04-25T09:54:28.224696+0000","last_became_peered":"2024-04-25T09:54:28.224696+0000","last_unstale":"2024-04-25T09:54:33.430481+0000","last_undegraded":"2024-04-25T09:54:33.430481+0000","last_fullsized":"2024-04-25T09:54:33.430481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:04.396335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427226+0000","last_change":"2024-04-25T09:54:27.209821+0000","last_active":"2024-04-25T09:54:33.427226+0000","last_peered":"2024-04-25T09:54:33.427226+0000","last_clean":"2024-04-25T09:54:33.427226+0000","last_became_active":"2024-04-25T09:54:27.209548+0000","last_became_peered":"2024-04-25T09:54:27.209548+0000","last_unstale":"2024-04-25T09:54:33.427226+0000","last_undegraded":"2024-04-25T09:54:33.427226+0000","last_fullsized":"2024-04-25T09:54:33.427226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:34.656261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431635+0000","last_change":"2024-04-25T09:54:32.300518+0000","last_active":"2024-04-25T09:54:33.431635+0000","last_peered":"2024-04-25T09:54:33.431635+0000","last_clean":"2024-04-25T09:54:33.431635+0000","last_became_active":"2024-04-25T09:54:32.299847+0000","last_became_peered":"2024-04-25T09:54:32.299847+0000","last_unstale":"2024-04-25T09:54:33.431635+0000","last_undegraded":"2024-04-25T09:54:33.431635+0000","last_fullsized":"2024-04-25T09:54:33.431635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:30.296146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239165+0000","last_change":"2024-04-25T09:54:28.236433+0000","last_active":"2024-04-25T09:54:33.239165+0000","last_peered":"2024-04-25T09:54:33.239165+0000","last_clean":"2024-04-25T09:54:33.239165+0000","last_became_active":"2024-04-25T09:54:28.236130+0000","last_became_peered":"2024-04-25T09:54:28.236130+0000","last_unstale":"2024-04-25T09:54:33.239165+0000","last_undegraded":"2024-04-25T09:54:33.239165+0000","last_fullsized":"2024-04-25T09:54:33.239165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:33.543144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431705+0000","last_change":"2024-04-25T09:54:27.211760+0000","last_active":"2024-04-25T09:54:33.431705+0000","last_peered":"2024-04-25T09:54:33.431705+0000","last_clean":"2024-04-25T09:54:33.431705+0000","last_became_active":"2024-04-25T09:54:27.211452+0000","last_became_peered":"2024-04-25T09:54:27.211452+0000","last_unstale":"2024-04-25T09:54:33.431705+0000","last_undegraded":"2024-04-25T09:54:33.431705+0000","last_fullsized":"2024-04-25T09:54:33.431705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:02.804762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427371+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T09:54:33.427371+0000","last_peered":"2024-04-25T09:54:33.427371+0000","last_clean":"2024-04-25T09:54:33.427371+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T09:54:33.427371+0000","last_undegraded":"2024-04-25T09:54:33.427371+0000","last_fullsized":"2024-04-25T09:54:33.427371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431481+0000","last_change":"2024-04-25T09:54:32.299780+0000","last_active":"2024-04-25T09:54:33.431481+0000","last_peered":"2024-04-25T09:54:33.431481+0000","last_clean":"2024-04-25T09:54:33.431481+0000","last_became_active":"2024-04-25T09:54:32.299351+0000","last_became_peered":"2024-04-25T09:54:32.299351+0000","last_unstale":"2024-04-25T09:54:33.431481+0000","last_undegraded":"2024-04-25T09:54:33.431481+0000","last_fullsized":"2024-04-25T09:54:33.431481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:08.992474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427622+0000","last_change":"2024-04-25T09:54:28.235625+0000","last_active":"2024-04-25T09:54:33.427622+0000","last_peered":"2024-04-25T09:54:33.427622+0000","last_clean":"2024-04-25T09:54:33.427622+0000","last_became_active":"2024-04-25T09:54:28.235034+0000","last_became_peered":"2024-04-25T09:54:28.235034+0000","last_unstale":"2024-04-25T09:54:33.427622+0000","last_undegraded":"2024-04-25T09:54:33.427622+0000","last_fullsized":"2024-04-25T09:54:33.427622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:04.950026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432393+0000","last_change":"2024-04-25T09:54:27.212307+0000","last_active":"2024-04-25T09:54:33.432393+0000","last_peered":"2024-04-25T09:54:33.432393+0000","last_clean":"2024-04-25T09:54:33.432393+0000","last_became_active":"2024-04-25T09:54:27.211984+0000","last_became_peered":"2024-04-25T09:54:27.211984+0000","last_unstale":"2024-04-25T09:54:33.432393+0000","last_undegraded":"2024-04-25T09:54:33.432393+0000","last_fullsized":"2024-04-25T09:54:33.432393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:34.656261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431021+0000","last_change":"2024-04-25T09:54:32.297686+0000","last_active":"2024-04-25T09:54:33.431021+0000","last_peered":"2024-04-25T09:54:33.431021+0000","last_clean":"2024-04-25T09:54:33.431021+0000","last_became_active":"2024-04-25T09:54:32.297151+0000","last_became_peered":"2024-04-25T09:54:32.297151+0000","last_unstale":"2024-04-25T09:54:33.431021+0000","last_undegraded":"2024-04-25T09:54:33.431021+0000","last_fullsized":"2024-04-25T09:54:33.431021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:10.694250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432122+0000","last_change":"2024-04-25T09:54:28.230960+0000","last_active":"2024-04-25T09:54:33.432122+0000","last_peered":"2024-04-25T09:54:33.432122+0000","last_clean":"2024-04-25T09:54:33.432122+0000","last_became_active":"2024-04-25T09:54:28.230684+0000","last_became_peered":"2024-04-25T09:54:28.230684+0000","last_unstale":"2024-04-25T09:54:33.432122+0000","last_undegraded":"2024-04-25T09:54:33.432122+0000","last_fullsized":"2024-04-25T09:54:33.432122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:06.651802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431464+0000","last_change":"2024-04-25T09:54:27.205085+0000","last_active":"2024-04-25T09:54:33.431464+0000","last_peered":"2024-04-25T09:54:33.431464+0000","last_clean":"2024-04-25T09:54:33.431464+0000","last_became_active":"2024-04-25T09:54:27.204801+0000","last_became_peered":"2024-04-25T09:54:27.204801+0000","last_unstale":"2024-04-25T09:54:33.431464+0000","last_undegraded":"2024-04-25T09:54:33.431464+0000","last_fullsized":"2024-04-25T09:54:33.431464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:53.735742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432256+0000","last_change":"2024-04-25T09:54:32.262455+0000","last_active":"2024-04-25T09:54:33.432256+0000","last_peered":"2024-04-25T09:54:33.432256+0000","last_clean":"2024-04-25T09:54:33.432256+0000","last_became_active":"2024-04-25T09:54:32.261864+0000","last_became_peered":"2024-04-25T09:54:32.261864+0000","last_unstale":"2024-04-25T09:54:33.432256+0000","last_undegraded":"2024-04-25T09:54:33.432256+0000","last_fullsized":"2024-04-25T09:54:33.432256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:14.029429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.428064+0000","last_change":"2024-04-25T09:54:28.231074+0000","last_active":"2024-04-25T09:54:33.428064+0000","last_peered":"2024-04-25T09:54:33.428064+0000","last_clean":"2024-04-25T09:54:33.428064+0000","last_became_active":"2024-04-25T09:54:28.230535+0000","last_became_peered":"2024-04-25T09:54:28.230535+0000","last_unstale":"2024-04-25T09:54:33.428064+0000","last_undegraded":"2024-04-25T09:54:33.428064+0000","last_fullsized":"2024-04-25T09:54:33.428064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:09.986981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430862+0000","last_change":"2024-04-25T09:54:27.204630+0000","last_active":"2024-04-25T09:54:33.430862+0000","last_peered":"2024-04-25T09:54:33.430862+0000","last_clean":"2024-04-25T09:54:33.430862+0000","last_became_active":"2024-04-25T09:54:27.204321+0000","last_became_peered":"2024-04-25T09:54:27.204321+0000","last_unstale":"2024-04-25T09:54:33.430862+0000","last_undegraded":"2024-04-25T09:54:33.430862+0000","last_fullsized":"2024-04-25T09:54:33.430862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:25.329710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430615+0000","last_change":"2024-04-25T09:54:32.299684+0000","last_active":"2024-04-25T09:54:33.430615+0000","last_peered":"2024-04-25T09:54:33.430615+0000","last_clean":"2024-04-25T09:54:33.430615+0000","last_became_active":"2024-04-25T09:54:32.299058+0000","last_became_peered":"2024-04-25T09:54:32.299058+0000","last_unstale":"2024-04-25T09:54:33.430615+0000","last_undegraded":"2024-04-25T09:54:33.430615+0000","last_fullsized":"2024-04-25T09:54:33.430615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:44.665406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427809+0000","last_change":"2024-04-25T09:54:28.222738+0000","last_active":"2024-04-25T09:54:33.427809+0000","last_peered":"2024-04-25T09:54:33.427809+0000","last_clean":"2024-04-25T09:54:33.427809+0000","last_became_active":"2024-04-25T09:54:28.222468+0000","last_became_peered":"2024-04-25T09:54:28.222468+0000","last_unstale":"2024-04-25T09:54:33.427809+0000","last_undegraded":"2024-04-25T09:54:33.427809+0000","last_fullsized":"2024-04-25T09:54:33.427809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:36.448046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249841+0000","last_change":"2024-04-25T09:54:27.194471+0000","last_active":"2024-04-25T09:54:33.249841+0000","last_peered":"2024-04-25T09:54:33.249841+0000","last_clean":"2024-04-25T09:54:33.249841+0000","last_became_active":"2024-04-25T09:54:27.194172+0000","last_became_peered":"2024-04-25T09:54:27.194172+0000","last_unstale":"2024-04-25T09:54:33.249841+0000","last_undegraded":"2024-04-25T09:54:33.249841+0000","last_fullsized":"2024-04-25T09:54:33.249841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:47.482218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.248742+0000","last_change":"2024-04-25T09:54:32.266552+0000","last_active":"2024-04-25T09:54:33.248742+0000","last_peered":"2024-04-25T09:54:33.248742+0000","last_clean":"2024-04-25T09:54:33.248742+0000","last_became_active":"2024-04-25T09:54:32.266152+0000","last_became_peered":"2024-04-25T09:54:32.266152+0000","last_unstale":"2024-04-25T09:54:33.248742+0000","last_undegraded":"2024-04-25T09:54:33.248742+0000","last_fullsized":"2024-04-25T09:54:33.248742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:12.761675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427450+0000","last_change":"2024-04-25T09:54:28.225409+0000","last_active":"2024-04-25T09:54:33.427450+0000","last_peered":"2024-04-25T09:54:33.427450+0000","last_clean":"2024-04-25T09:54:33.427450+0000","last_became_active":"2024-04-25T09:54:28.225105+0000","last_became_peered":"2024-04-25T09:54:28.225105+0000","last_unstale":"2024-04-25T09:54:33.427450+0000","last_undegraded":"2024-04-25T09:54:33.427450+0000","last_fullsized":"2024-04-25T09:54:33.427450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:15.832642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430867+0000","last_change":"2024-04-25T09:54:27.207980+0000","last_active":"2024-04-25T09:54:33.430867+0000","last_peered":"2024-04-25T09:54:33.430867+0000","last_clean":"2024-04-25T09:54:33.430867+0000","last_became_active":"2024-04-25T09:54:27.205322+0000","last_became_peered":"2024-04-25T09:54:27.205322+0000","last_unstale":"2024-04-25T09:54:33.430867+0000","last_undegraded":"2024-04-25T09:54:33.430867+0000","last_fullsized":"2024-04-25T09:54:33.430867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:43.025512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431489+0000","last_change":"2024-04-25T09:54:32.252925+0000","last_active":"2024-04-25T09:54:33.431489+0000","last_peered":"2024-04-25T09:54:33.431489+0000","last_clean":"2024-04-25T09:54:33.431489+0000","last_became_active":"2024-04-25T09:54:32.252483+0000","last_became_peered":"2024-04-25T09:54:32.252483+0000","last_unstale":"2024-04-25T09:54:33.431489+0000","last_undegraded":"2024-04-25T09:54:33.431489+0000","last_fullsized":"2024-04-25T09:54:33.431489+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:55.727375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430685+0000","last_change":"2024-04-25T09:54:28.227852+0000","last_active":"2024-04-25T09:54:33.430685+0000","last_peered":"2024-04-25T09:54:33.430685+0000","last_clean":"2024-04-25T09:54:33.430685+0000","last_became_active":"2024-04-25T09:54:28.227552+0000","last_became_peered":"2024-04-25T09:54:28.227552+0000","last_unstale":"2024-04-25T09:54:33.430685+0000","last_undegraded":"2024-04-25T09:54:33.430685+0000","last_fullsized":"2024-04-25T09:54:33.430685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:29.799078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430794+0000","last_change":"2024-04-25T09:54:27.203990+0000","last_active":"2024-04-25T09:54:33.430794+0000","last_peered":"2024-04-25T09:54:33.430794+0000","last_clean":"2024-04-25T09:54:33.430794+0000","last_became_active":"2024-04-25T09:54:27.203714+0000","last_became_peered":"2024-04-25T09:54:27.203714+0000","last_unstale":"2024-04-25T09:54:33.430794+0000","last_undegraded":"2024-04-25T09:54:33.430794+0000","last_fullsized":"2024-04-25T09:54:33.430794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:02.804762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.240156+0000","last_change":"2024-04-25T09:54:32.300515+0000","last_active":"2024-04-25T09:54:33.240156+0000","last_peered":"2024-04-25T09:54:33.240156+0000","last_clean":"2024-04-25T09:54:33.240156+0000","last_became_active":"2024-04-25T09:54:32.300114+0000","last_became_peered":"2024-04-25T09:54:32.300114+0000","last_unstale":"2024-04-25T09:54:33.240156+0000","last_undegraded":"2024-04-25T09:54:33.240156+0000","last_fullsized":"2024-04-25T09:54:33.240156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:33.865351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427679+0000","last_change":"2024-04-25T09:54:28.231995+0000","last_active":"2024-04-25T09:54:33.427679+0000","last_peered":"2024-04-25T09:54:33.427679+0000","last_clean":"2024-04-25T09:54:33.427679+0000","last_became_active":"2024-04-25T09:54:28.231448+0000","last_became_peered":"2024-04-25T09:54:28.231448+0000","last_unstale":"2024-04-25T09:54:33.427679+0000","last_undegraded":"2024-04-25T09:54:33.427679+0000","last_fullsized":"2024-04-25T09:54:33.427679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:52.698521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431789+0000","last_change":"2024-04-25T09:54:27.211810+0000","last_active":"2024-04-25T09:54:33.431789+0000","last_peered":"2024-04-25T09:54:33.431789+0000","last_clean":"2024-04-25T09:54:33.431789+0000","last_became_active":"2024-04-25T09:54:27.211460+0000","last_became_peered":"2024-04-25T09:54:27.211460+0000","last_unstale":"2024-04-25T09:54:33.431789+0000","last_undegraded":"2024-04-25T09:54:33.431789+0000","last_fullsized":"2024-04-25T09:54:33.431789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:39.794974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239769+0000","last_change":"2024-04-25T09:54:32.297745+0000","last_active":"2024-04-25T09:54:33.239769+0000","last_peered":"2024-04-25T09:54:33.239769+0000","last_clean":"2024-04-25T09:54:33.239769+0000","last_became_active":"2024-04-25T09:54:32.297173+0000","last_became_peered":"2024-04-25T09:54:32.297173+0000","last_unstale":"2024-04-25T09:54:33.239769+0000","last_undegraded":"2024-04-25T09:54:33.239769+0000","last_fullsized":"2024-04-25T09:54:33.239769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:44.665406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431853+0000","last_change":"2024-04-25T09:54:28.235736+0000","last_active":"2024-04-25T09:54:33.431853+0000","last_peered":"2024-04-25T09:54:33.431853+0000","last_clean":"2024-04-25T09:54:33.431853+0000","last_became_active":"2024-04-25T09:54:28.235437+0000","last_became_peered":"2024-04-25T09:54:28.235437+0000","last_unstale":"2024-04-25T09:54:33.431853+0000","last_undegraded":"2024-04-25T09:54:33.431853+0000","last_fullsized":"2024-04-25T09:54:33.431853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:16.438954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432306+0000","last_change":"2024-04-25T09:54:27.194948+0000","last_active":"2024-04-25T09:54:33.432306+0000","last_peered":"2024-04-25T09:54:33.432306+0000","last_clean":"2024-04-25T09:54:33.432306+0000","last_became_active":"2024-04-25T09:54:27.194622+0000","last_became_peered":"2024-04-25T09:54:27.194622+0000","last_unstale":"2024-04-25T09:54:33.432306+0000","last_undegraded":"2024-04-25T09:54:33.432306+0000","last_fullsized":"2024-04-25T09:54:33.432306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:15.480038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432224+0000","last_change":"2024-04-25T09:54:32.298286+0000","last_active":"2024-04-25T09:54:33.432224+0000","last_peered":"2024-04-25T09:54:33.432224+0000","last_clean":"2024-04-25T09:54:33.432224+0000","last_became_active":"2024-04-25T09:54:32.297524+0000","last_became_peered":"2024-04-25T09:54:32.297524+0000","last_unstale":"2024-04-25T09:54:33.432224+0000","last_undegraded":"2024-04-25T09:54:33.432224+0000","last_fullsized":"2024-04-25T09:54:33.432224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:26.797002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427520+0000","last_change":"2024-04-25T09:54:28.225357+0000","last_active":"2024-04-25T09:54:33.427520+0000","last_peered":"2024-04-25T09:54:33.427520+0000","last_clean":"2024-04-25T09:54:33.427520+0000","last_became_active":"2024-04-25T09:54:28.225069+0000","last_became_peered":"2024-04-25T09:54:28.225069+0000","last_unstale":"2024-04-25T09:54:33.427520+0000","last_undegraded":"2024-04-25T09:54:33.427520+0000","last_fullsized":"2024-04-25T09:54:33.427520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:06.651802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:37.087126+0000","last_change":"2024-04-25T09:54:27.203341+0000","last_active":"2024-04-25T09:54:37.087126+0000","last_peered":"2024-04-25T09:54:37.087126+0000","last_clean":"2024-04-25T09:54:37.087126+0000","last_became_active":"2024-04-25T09:54:27.203044+0000","last_became_peered":"2024-04-25T09:54:27.203044+0000","last_unstale":"2024-04-25T09:54:37.087126+0000","last_undegraded":"2024-04-25T09:54:37.087126+0000","last_fullsized":"2024-04-25T09:54:37.087126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:34.656261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431728+0000","last_change":"2024-04-25T09:54:32.264939+0000","last_active":"2024-04-25T09:54:33.431728+0000","last_peered":"2024-04-25T09:54:33.431728+0000","last_clean":"2024-04-25T09:54:33.431728+0000","last_became_active":"2024-04-25T09:54:32.263237+0000","last_became_peered":"2024-04-25T09:54:32.263237+0000","last_unstale":"2024-04-25T09:54:33.431728+0000","last_undegraded":"2024-04-25T09:54:33.431728+0000","last_fullsized":"2024-04-25T09:54:33.431728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:55.727375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249518+0000","last_change":"2024-04-25T09:54:28.228347+0000","last_active":"2024-04-25T09:54:33.249518+0000","last_peered":"2024-04-25T09:54:33.249518+0000","last_clean":"2024-04-25T09:54:33.249518+0000","last_became_active":"2024-04-25T09:54:28.228054+0000","last_became_peered":"2024-04-25T09:54:28.228054+0000","last_unstale":"2024-04-25T09:54:33.249518+0000","last_undegraded":"2024-04-25T09:54:33.249518+0000","last_fullsized":"2024-04-25T09:54:33.249518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:05.431124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431354+0000","last_change":"2024-04-25T09:54:27.213081+0000","last_active":"2024-04-25T09:54:33.431354+0000","last_peered":"2024-04-25T09:54:33.431354+0000","last_clean":"2024-04-25T09:54:33.431354+0000","last_became_active":"2024-04-25T09:54:27.212717+0000","last_became_peered":"2024-04-25T09:54:27.212717+0000","last_unstale":"2024-04-25T09:54:33.431354+0000","last_undegraded":"2024-04-25T09:54:33.431354+0000","last_fullsized":"2024-04-25T09:54:33.431354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:39.794974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249368+0000","last_change":"2024-04-25T09:54:32.265709+0000","last_active":"2024-04-25T09:54:33.249368+0000","last_peered":"2024-04-25T09:54:33.249368+0000","last_clean":"2024-04-25T09:54:33.249368+0000","last_became_active":"2024-04-25T09:54:32.264564+0000","last_became_peered":"2024-04-25T09:54:32.264564+0000","last_unstale":"2024-04-25T09:54:33.249368+0000","last_undegraded":"2024-04-25T09:54:33.249368+0000","last_fullsized":"2024-04-25T09:54:33.249368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:56.740969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430940+0000","last_change":"2024-04-25T09:54:28.230395+0000","last_active":"2024-04-25T09:54:33.430940+0000","last_peered":"2024-04-25T09:54:33.430940+0000","last_clean":"2024-04-25T09:54:33.430940+0000","last_became_active":"2024-04-25T09:54:28.230094+0000","last_became_peered":"2024-04-25T09:54:28.230094+0000","last_unstale":"2024-04-25T09:54:33.430940+0000","last_undegraded":"2024-04-25T09:54:33.430940+0000","last_fullsized":"2024-04-25T09:54:33.430940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:08.719227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431892+0000","last_change":"2024-04-25T09:54:27.215296+0000","last_active":"2024-04-25T09:54:33.431892+0000","last_peered":"2024-04-25T09:54:33.431892+0000","last_clean":"2024-04-25T09:54:33.431892+0000","last_became_active":"2024-04-25T09:54:27.215029+0000","last_became_peered":"2024-04-25T09:54:27.215029+0000","last_unstale":"2024-04-25T09:54:33.431892+0000","last_undegraded":"2024-04-25T09:54:33.431892+0000","last_fullsized":"2024-04-25T09:54:33.431892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:34.656261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239377+0000","last_change":"2024-04-25T09:54:32.259386+0000","last_active":"2024-04-25T09:54:33.239377+0000","last_peered":"2024-04-25T09:54:33.239377+0000","last_clean":"2024-04-25T09:54:33.239377+0000","last_became_active":"2024-04-25T09:54:32.258463+0000","last_became_peered":"2024-04-25T09:54:32.258463+0000","last_unstale":"2024-04-25T09:54:33.239377+0000","last_undegraded":"2024-04-25T09:54:33.239377+0000","last_fullsized":"2024-04-25T09:54:33.239377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:55.620829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431885+0000","last_change":"2024-04-25T09:54:28.232092+0000","last_active":"2024-04-25T09:54:33.431885+0000","last_peered":"2024-04-25T09:54:33.431885+0000","last_clean":"2024-04-25T09:54:33.431885+0000","last_became_active":"2024-04-25T09:54:28.230521+0000","last_became_peered":"2024-04-25T09:54:28.230521+0000","last_unstale":"2024-04-25T09:54:33.431885+0000","last_undegraded":"2024-04-25T09:54:33.431885+0000","last_fullsized":"2024-04-25T09:54:33.431885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:51.684928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431720+0000","last_change":"2024-04-25T09:54:27.212262+0000","last_active":"2024-04-25T09:54:33.431720+0000","last_peered":"2024-04-25T09:54:33.431720+0000","last_clean":"2024-04-25T09:54:33.431720+0000","last_became_active":"2024-04-25T09:54:27.212009+0000","last_became_peered":"2024-04-25T09:54:27.212009+0000","last_unstale":"2024-04-25T09:54:33.431720+0000","last_undegraded":"2024-04-25T09:54:33.431720+0000","last_fullsized":"2024-04-25T09:54:33.431720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:25.329710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239235+0000","last_change":"2024-04-25T09:54:32.300659+0000","last_active":"2024-04-25T09:54:33.239235+0000","last_peered":"2024-04-25T09:54:33.239235+0000","last_clean":"2024-04-25T09:54:33.239235+0000","last_became_active":"2024-04-25T09:54:32.300214+0000","last_became_peered":"2024-04-25T09:54:32.300214+0000","last_unstale":"2024-04-25T09:54:33.239235+0000","last_undegraded":"2024-04-25T09:54:33.239235+0000","last_fullsized":"2024-04-25T09:54:33.239235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:13.180594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431335+0000","last_change":"2024-04-25T09:54:32.300216+0000","last_active":"2024-04-25T09:54:33.431335+0000","last_peered":"2024-04-25T09:54:33.431335+0000","last_clean":"2024-04-25T09:54:33.431335+0000","last_became_active":"2024-04-25T09:54:32.299316+0000","last_became_peered":"2024-04-25T09:54:32.299316+0000","last_unstale":"2024-04-25T09:54:33.431335+0000","last_undegraded":"2024-04-25T09:54:33.431335+0000","last_fullsized":"2024-04-25T09:54:33.431335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:40.490493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430556+0000","last_change":"2024-04-25T09:54:28.214303+0000","last_active":"2024-04-25T09:54:33.430556+0000","last_peered":"2024-04-25T09:54:33.430556+0000","last_clean":"2024-04-25T09:54:33.430556+0000","last_became_active":"2024-04-25T09:54:28.213973+0000","last_became_peered":"2024-04-25T09:54:28.213973+0000","last_unstale":"2024-04-25T09:54:33.430556+0000","last_undegraded":"2024-04-25T09:54:33.430556+0000","last_fullsized":"2024-04-25T09:54:33.430556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:23.525779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430800+0000","last_change":"2024-04-25T09:54:27.210642+0000","last_active":"2024-04-25T09:54:33.430800+0000","last_peered":"2024-04-25T09:54:33.430800+0000","last_clean":"2024-04-25T09:54:33.430800+0000","last_became_active":"2024-04-25T09:54:27.210345+0000","last_became_peered":"2024-04-25T09:54:27.210345+0000","last_unstale":"2024-04-25T09:54:33.430800+0000","last_undegraded":"2024-04-25T09:54:33.430800+0000","last_fullsized":"2024-04-25T09:54:33.430800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:25.329710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432201+0000","last_change":"2024-04-25T09:54:32.262209+0000","last_active":"2024-04-25T09:54:33.432201+0000","last_peered":"2024-04-25T09:54:33.432201+0000","last_clean":"2024-04-25T09:54:33.432201+0000","last_became_active":"2024-04-25T09:54:32.261761+0000","last_became_peered":"2024-04-25T09:54:32.261761+0000","last_unstale":"2024-04-25T09:54:33.432201+0000","last_undegraded":"2024-04-25T09:54:33.432201+0000","last_fullsized":"2024-04-25T09:54:33.432201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:40.490493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239107+0000","last_change":"2024-04-25T09:54:28.216779+0000","last_active":"2024-04-25T09:54:33.239107+0000","last_peered":"2024-04-25T09:54:33.239107+0000","last_clean":"2024-04-25T09:54:33.239107+0000","last_became_active":"2024-04-25T09:54:28.216470+0000","last_became_peered":"2024-04-25T09:54:28.216470+0000","last_unstale":"2024-04-25T09:54:33.239107+0000","last_undegraded":"2024-04-25T09:54:33.239107+0000","last_fullsized":"2024-04-25T09:54:33.239107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:04.526578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239393+0000","last_change":"2024-04-25T09:54:27.206958+0000","last_active":"2024-04-25T09:54:33.239393+0000","last_peered":"2024-04-25T09:54:33.239393+0000","last_clean":"2024-04-25T09:54:33.239393+0000","last_became_active":"2024-04-25T09:54:27.206664+0000","last_became_peered":"2024-04-25T09:54:27.206664+0000","last_unstale":"2024-04-25T09:54:33.239393+0000","last_undegraded":"2024-04-25T09:54:33.239393+0000","last_fullsized":"2024-04-25T09:54:33.239393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:44.480619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431165+0000","last_change":"2024-04-25T09:54:27.204005+0000","last_active":"2024-04-25T09:54:33.431165+0000","last_peered":"2024-04-25T09:54:33.431165+0000","last_clean":"2024-04-25T09:54:33.431165+0000","last_became_active":"2024-04-25T09:54:27.203754+0000","last_became_peered":"2024-04-25T09:54:27.203754+0000","last_unstale":"2024-04-25T09:54:33.431165+0000","last_undegraded":"2024-04-25T09:54:33.431165+0000","last_fullsized":"2024-04-25T09:54:33.431165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:39.794974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432276+0000","last_change":"2024-04-25T09:54:28.224588+0000","last_active":"2024-04-25T09:54:33.432276+0000","last_peered":"2024-04-25T09:54:33.432276+0000","last_clean":"2024-04-25T09:54:33.432276+0000","last_became_active":"2024-04-25T09:54:28.224085+0000","last_became_peered":"2024-04-25T09:54:28.224085+0000","last_unstale":"2024-04-25T09:54:33.432276+0000","last_undegraded":"2024-04-25T09:54:33.432276+0000","last_fullsized":"2024-04-25T09:54:33.432276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:23.525779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432222+0000","last_change":"2024-04-25T09:54:32.258902+0000","last_active":"2024-04-25T09:54:33.432222+0000","last_peered":"2024-04-25T09:54:33.432222+0000","last_clean":"2024-04-25T09:54:33.432222+0000","last_became_active":"2024-04-25T09:54:32.258520+0000","last_became_peered":"2024-04-25T09:54:32.258520+0000","last_unstale":"2024-04-25T09:54:33.432222+0000","last_undegraded":"2024-04-25T09:54:33.432222+0000","last_fullsized":"2024-04-25T09:54:33.432222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:31.442262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239580+0000","last_change":"2024-04-25T09:54:27.210481+0000","last_active":"2024-04-25T09:54:33.239580+0000","last_peered":"2024-04-25T09:54:33.239580+0000","last_clean":"2024-04-25T09:54:33.239580+0000","last_became_active":"2024-04-25T09:54:27.210234+0000","last_became_peered":"2024-04-25T09:54:27.210234+0000","last_unstale":"2024-04-25T09:54:33.239580+0000","last_undegraded":"2024-04-25T09:54:33.239580+0000","last_fullsized":"2024-04-25T09:54:33.239580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:43.025512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249024+0000","last_change":"2024-04-25T09:54:28.217905+0000","last_active":"2024-04-25T09:54:33.249024+0000","last_peered":"2024-04-25T09:54:33.249024+0000","last_clean":"2024-04-25T09:54:33.249024+0000","last_became_active":"2024-04-25T09:54:28.216955+0000","last_became_peered":"2024-04-25T09:54:28.216955+0000","last_unstale":"2024-04-25T09:54:33.249024+0000","last_undegraded":"2024-04-25T09:54:33.249024+0000","last_fullsized":"2024-04-25T09:54:33.249024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:05.433765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239944+0000","last_change":"2024-04-25T09:54:32.258140+0000","last_active":"2024-04-25T09:54:33.239944+0000","last_peered":"2024-04-25T09:54:33.239944+0000","last_clean":"2024-04-25T09:54:33.239944+0000","last_became_active":"2024-04-25T09:54:32.257702+0000","last_became_peered":"2024-04-25T09:54:32.257702+0000","last_unstale":"2024-04-25T09:54:33.239944+0000","last_undegraded":"2024-04-25T09:54:33.239944+0000","last_fullsized":"2024-04-25T09:54:33.239944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:26.797002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430559+0000","last_change":"2024-04-25T09:54:28.228362+0000","last_active":"2024-04-25T09:54:33.430559+0000","last_peered":"2024-04-25T09:54:33.430559+0000","last_clean":"2024-04-25T09:54:33.430559+0000","last_became_active":"2024-04-25T09:54:28.228109+0000","last_became_peered":"2024-04-25T09:54:28.228109+0000","last_unstale":"2024-04-25T09:54:33.430559+0000","last_undegraded":"2024-04-25T09:54:33.430559+0000","last_fullsized":"2024-04-25T09:54:33.430559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:04.526578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431200+0000","last_change":"2024-04-25T09:54:28.231028+0000","last_active":"2024-04-25T09:54:33.431200+0000","last_peered":"2024-04-25T09:54:33.431200+0000","last_clean":"2024-04-25T09:54:33.431200+0000","last_became_active":"2024-04-25T09:54:28.230707+0000","last_became_peered":"2024-04-25T09:54:28.230707+0000","last_unstale":"2024-04-25T09:54:33.431200+0000","last_undegraded":"2024-04-25T09:54:33.431200+0000","last_fullsized":"2024-04-25T09:54:33.431200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:54.743779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431645+0000","last_change":"2024-04-25T09:54:28.233501+0000","last_active":"2024-04-25T09:54:33.431645+0000","last_peered":"2024-04-25T09:54:33.431645+0000","last_clean":"2024-04-25T09:54:33.431645+0000","last_became_active":"2024-04-25T09:54:28.232806+0000","last_became_peered":"2024-04-25T09:54:28.232806+0000","last_unstale":"2024-04-25T09:54:33.431645+0000","last_undegraded":"2024-04-25T09:54:33.431645+0000","last_fullsized":"2024-04-25T09:54:33.431645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:04.950026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432189+0000","last_change":"2024-04-25T09:54:28.215003+0000","last_active":"2024-04-25T09:54:33.432189+0000","last_peered":"2024-04-25T09:54:33.432189+0000","last_clean":"2024-04-25T09:54:33.432189+0000","last_became_active":"2024-04-25T09:54:28.214700+0000","last_became_peered":"2024-04-25T09:54:28.214700+0000","last_unstale":"2024-04-25T09:54:33.432189+0000","last_undegraded":"2024-04-25T09:54:33.432189+0000","last_fullsized":"2024-04-25T09:54:33.432189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:47.076023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239981+0000","last_change":"2024-04-25T09:54:28.221725+0000","last_active":"2024-04-25T09:54:33.239981+0000","last_peered":"2024-04-25T09:54:33.239981+0000","last_clean":"2024-04-25T09:54:33.239981+0000","last_became_active":"2024-04-25T09:54:28.221436+0000","last_became_peered":"2024-04-25T09:54:28.221436+0000","last_unstale":"2024-04-25T09:54:33.239981+0000","last_undegraded":"2024-04-25T09:54:33.239981+0000","last_fullsized":"2024-04-25T09:54:33.239981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:08:42.765805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431173+0000","last_change":"2024-04-25T09:54:28.214081+0000","last_active":"2024-04-25T09:54:33.431173+0000","last_peered":"2024-04-25T09:54:33.431173+0000","last_clean":"2024-04-25T09:54:33.431173+0000","last_became_active":"2024-04-25T09:54:28.213740+0000","last_became_peered":"2024-04-25T09:54:28.213740+0000","last_unstale":"2024-04-25T09:54:33.431173+0000","last_undegraded":"2024-04-25T09:54:33.431173+0000","last_fullsized":"2024-04-25T09:54:33.431173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:47.076023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431566+0000","last_change":"2024-04-25T09:54:28.233804+0000","last_active":"2024-04-25T09:54:33.431566+0000","last_peered":"2024-04-25T09:54:33.431566+0000","last_clean":"2024-04-25T09:54:33.431566+0000","last_became_active":"2024-04-25T09:54:28.233532+0000","last_became_peered":"2024-04-25T09:54:28.233532+0000","last_unstale":"2024-04-25T09:54:33.431566+0000","last_undegraded":"2024-04-25T09:54:33.431566+0000","last_fullsized":"2024-04-25T09:54:33.431566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:23.525779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239898+0000","last_change":"2024-04-25T09:54:28.220983+0000","last_active":"2024-04-25T09:54:33.239898+0000","last_peered":"2024-04-25T09:54:33.239898+0000","last_clean":"2024-04-25T09:54:33.239898+0000","last_became_active":"2024-04-25T09:54:28.220569+0000","last_became_peered":"2024-04-25T09:54:28.220569+0000","last_unstale":"2024-04-25T09:54:33.239898+0000","last_undegraded":"2024-04-25T09:54:33.239898+0000","last_fullsized":"2024-04-25T09:54:33.239898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:15.832642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430742+0000","last_change":"2024-04-25T09:54:28.234837+0000","last_active":"2024-04-25T09:54:33.430742+0000","last_peered":"2024-04-25T09:54:33.430742+0000","last_clean":"2024-04-25T09:54:33.430742+0000","last_became_active":"2024-04-25T09:54:28.234316+0000","last_became_peered":"2024-04-25T09:54:28.234316+0000","last_unstale":"2024-04-25T09:54:33.430742+0000","last_undegraded":"2024-04-25T09:54:33.430742+0000","last_fullsized":"2024-04-25T09:54:33.430742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:23.525779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239213+0000","last_change":"2024-04-25T09:54:28.222528+0000","last_active":"2024-04-25T09:54:33.239213+0000","last_peered":"2024-04-25T09:54:33.239213+0000","last_clean":"2024-04-25T09:54:33.239213+0000","last_became_active":"2024-04-25T09:54:28.222211+0000","last_became_peered":"2024-04-25T09:54:28.222211+0000","last_unstale":"2024-04-25T09:54:33.239213+0000","last_undegraded":"2024-04-25T09:54:33.239213+0000","last_fullsized":"2024-04-25T09:54:33.239213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:29.799078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431509+0000","last_change":"2024-04-25T09:54:28.233715+0000","last_active":"2024-04-25T09:54:33.431509+0000","last_peered":"2024-04-25T09:54:33.431509+0000","last_clean":"2024-04-25T09:54:33.431509+0000","last_became_active":"2024-04-25T09:54:28.233426+0000","last_became_peered":"2024-04-25T09:54:28.233426+0000","last_unstale":"2024-04-25T09:54:33.431509+0000","last_undegraded":"2024-04-25T09:54:33.431509+0000","last_fullsized":"2024-04-25T09:54:33.431509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:08:42.765805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432061+0000","last_change":"2024-04-25T09:54:28.238380+0000","last_active":"2024-04-25T09:54:33.432061+0000","last_peered":"2024-04-25T09:54:33.432061+0000","last_clean":"2024-04-25T09:54:33.432061+0000","last_became_active":"2024-04-25T09:54:28.237240+0000","last_became_peered":"2024-04-25T09:54:28.237240+0000","last_unstale":"2024-04-25T09:54:33.432061+0000","last_undegraded":"2024-04-25T09:54:33.432061+0000","last_fullsized":"2024-04-25T09:54:33.432061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:35.167250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431164+0000","last_change":"2024-04-25T09:54:28.224401+0000","last_active":"2024-04-25T09:54:33.431164+0000","last_peered":"2024-04-25T09:54:33.431164+0000","last_clean":"2024-04-25T09:54:33.431164+0000","last_became_active":"2024-04-25T09:54:28.224093+0000","last_became_peered":"2024-04-25T09:54:28.224093+0000","last_unstale":"2024-04-25T09:54:33.431164+0000","last_undegraded":"2024-04-25T09:54:33.431164+0000","last_fullsized":"2024-04-25T09:54:33.431164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:47.076023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427994+0000","last_change":"2024-04-25T09:54:28.225887+0000","last_active":"2024-04-25T09:54:33.427994+0000","last_peered":"2024-04-25T09:54:33.427994+0000","last_clean":"2024-04-25T09:54:33.427994+0000","last_became_active":"2024-04-25T09:54:28.225650+0000","last_became_peered":"2024-04-25T09:54:28.225650+0000","last_unstale":"2024-04-25T09:54:33.427994+0000","last_undegraded":"2024-04-25T09:54:33.427994+0000","last_fullsized":"2024-04-25T09:54:33.427994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:51.684928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430756+0000","last_change":"2024-04-25T09:54:28.229389+0000","last_active":"2024-04-25T09:54:33.430756+0000","last_peered":"2024-04-25T09:54:33.430756+0000","last_clean":"2024-04-25T09:54:33.430756+0000","last_became_active":"2024-04-25T09:54:28.229001+0000","last_became_peered":"2024-04-25T09:54:28.229001+0000","last_unstale":"2024-04-25T09:54:33.430756+0000","last_undegraded":"2024-04-25T09:54:33.430756+0000","last_fullsized":"2024-04-25T09:54:33.430756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:05.431124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432079+0000","last_change":"2024-04-25T09:54:28.232625+0000","last_active":"2024-04-25T09:54:33.432079+0000","last_peered":"2024-04-25T09:54:33.432079+0000","last_clean":"2024-04-25T09:54:33.432079+0000","last_became_active":"2024-04-25T09:54:28.232336+0000","last_became_peered":"2024-04-25T09:54:28.232336+0000","last_unstale":"2024-04-25T09:54:33.432079+0000","last_undegraded":"2024-04-25T09:54:33.432079+0000","last_fullsized":"2024-04-25T09:54:33.432079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:00:25.749559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430564+0000","last_change":"2024-04-25T09:54:28.234614+0000","last_active":"2024-04-25T09:54:33.430564+0000","last_peered":"2024-04-25T09:54:33.430564+0000","last_clean":"2024-04-25T09:54:33.430564+0000","last_became_active":"2024-04-25T09:54:28.229921+0000","last_became_peered":"2024-04-25T09:54:28.229921+0000","last_unstale":"2024-04-25T09:54:33.430564+0000","last_undegraded":"2024-04-25T09:54:33.430564+0000","last_fullsized":"2024-04-25T09:54:33.430564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:08.719227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430653+0000","last_change":"2024-04-25T09:54:28.222801+0000","last_active":"2024-04-25T09:54:33.430653+0000","last_peered":"2024-04-25T09:54:33.430653+0000","last_clean":"2024-04-25T09:54:33.430653+0000","last_became_active":"2024-04-25T09:54:28.222496+0000","last_became_peered":"2024-04-25T09:54:28.222496+0000","last_unstale":"2024-04-25T09:54:33.430653+0000","last_undegraded":"2024-04-25T09:54:33.430653+0000","last_fullsized":"2024-04-25T09:54:33.430653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:35.167250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431763+0000","last_change":"2024-04-25T09:54:28.219741+0000","last_active":"2024-04-25T09:54:33.431763+0000","last_peered":"2024-04-25T09:54:33.431763+0000","last_clean":"2024-04-25T09:54:33.431763+0000","last_became_active":"2024-04-25T09:54:28.218538+0000","last_became_peered":"2024-04-25T09:54:28.218538+0000","last_unstale":"2024-04-25T09:54:33.431763+0000","last_undegraded":"2024-04-25T09:54:33.431763+0000","last_fullsized":"2024-04-25T09:54:33.431763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:27.399815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239440+0000","last_change":"2024-04-25T09:54:28.225395+0000","last_active":"2024-04-25T09:54:33.239440+0000","last_peered":"2024-04-25T09:54:33.239440+0000","last_clean":"2024-04-25T09:54:33.239440+0000","last_became_active":"2024-04-25T09:54:28.225087+0000","last_became_peered":"2024-04-25T09:54:28.225087+0000","last_unstale":"2024-04-25T09:54:33.239440+0000","last_undegraded":"2024-04-25T09:54:33.239440+0000","last_fullsized":"2024-04-25T09:54:33.239440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:08.719227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249339+0000","last_change":"2024-04-25T09:54:28.230175+0000","last_active":"2024-04-25T09:54:33.249339+0000","last_peered":"2024-04-25T09:54:33.249339+0000","last_clean":"2024-04-25T09:54:33.249339+0000","last_became_active":"2024-04-25T09:54:28.229811+0000","last_became_peered":"2024-04-25T09:54:28.229811+0000","last_unstale":"2024-04-25T09:54:33.249339+0000","last_undegraded":"2024-04-25T09:54:33.249339+0000","last_fullsized":"2024-04-25T09:54:33.249339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:40.803011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431341+0000","last_change":"2024-04-25T09:54:28.236127+0000","last_active":"2024-04-25T09:54:33.431341+0000","last_peered":"2024-04-25T09:54:33.431341+0000","last_clean":"2024-04-25T09:54:33.431341+0000","last_became_active":"2024-04-25T09:54:28.235849+0000","last_became_peered":"2024-04-25T09:54:28.235849+0000","last_unstale":"2024-04-25T09:54:33.431341+0000","last_undegraded":"2024-04-25T09:54:33.431341+0000","last_fullsized":"2024-04-25T09:54:33.431341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:33.543144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431499+0000","last_change":"2024-04-25T09:54:28.233050+0000","last_active":"2024-04-25T09:54:33.431499+0000","last_peered":"2024-04-25T09:54:33.431499+0000","last_clean":"2024-04-25T09:54:33.431499+0000","last_became_active":"2024-04-25T09:54:28.232758+0000","last_became_peered":"2024-04-25T09:54:28.232758+0000","last_unstale":"2024-04-25T09:54:33.431499+0000","last_undegraded":"2024-04-25T09:54:33.431499+0000","last_fullsized":"2024-04-25T09:54:33.431499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:08.719227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.428033+0000","last_change":"2024-04-25T09:54:28.237315+0000","last_active":"2024-04-25T09:54:33.428033+0000","last_peered":"2024-04-25T09:54:33.428033+0000","last_clean":"2024-04-25T09:54:33.428033+0000","last_became_active":"2024-04-25T09:54:28.235994+0000","last_became_peered":"2024-04-25T09:54:28.235994+0000","last_unstale":"2024-04-25T09:54:33.428033+0000","last_undegraded":"2024-04-25T09:54:33.428033+0000","last_fullsized":"2024-04-25T09:54:33.428033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:26.253699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.238952+0000","last_change":"2024-04-25T09:54:28.239527+0000","last_active":"2024-04-25T09:54:33.238952+0000","last_peered":"2024-04-25T09:54:33.238952+0000","last_clean":"2024-04-25T09:54:33.238952+0000","last_became_active":"2024-04-25T09:54:28.239231+0000","last_became_peered":"2024-04-25T09:54:28.239231+0000","last_unstale":"2024-04-25T09:54:33.238952+0000","last_undegraded":"2024-04-25T09:54:33.238952+0000","last_fullsized":"2024-04-25T09:54:33.238952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:35.167250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427536+0000","last_change":"2024-04-25T09:54:28.226800+0000","last_active":"2024-04-25T09:54:33.427536+0000","last_peered":"2024-04-25T09:54:33.427536+0000","last_clean":"2024-04-25T09:54:33.427536+0000","last_became_active":"2024-04-25T09:54:28.226516+0000","last_became_peered":"2024-04-25T09:54:28.226516+0000","last_unstale":"2024-04-25T09:54:33.427536+0000","last_undegraded":"2024-04-25T09:54:33.427536+0000","last_fullsized":"2024-04-25T09:54:33.427536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:50.006460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431400+0000","last_change":"2024-04-25T09:54:28.233084+0000","last_active":"2024-04-25T09:54:33.431400+0000","last_peered":"2024-04-25T09:54:33.431400+0000","last_clean":"2024-04-25T09:54:33.431400+0000","last_became_active":"2024-04-25T09:54:28.232546+0000","last_became_peered":"2024-04-25T09:54:28.232546+0000","last_unstale":"2024-04-25T09:54:33.431400+0000","last_undegraded":"2024-04-25T09:54:33.431400+0000","last_fullsized":"2024-04-25T09:54:33.431400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:50.006460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427429+0000","last_change":"2024-04-25T09:54:28.231761+0000","last_active":"2024-04-25T09:54:33.427429+0000","last_peered":"2024-04-25T09:54:33.427429+0000","last_clean":"2024-04-25T09:54:33.427429+0000","last_became_active":"2024-04-25T09:54:28.231159+0000","last_became_peered":"2024-04-25T09:54:28.231159+0000","last_unstale":"2024-04-25T09:54:33.427429+0000","last_undegraded":"2024-04-25T09:54:33.427429+0000","last_fullsized":"2024-04-25T09:54:33.427429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:08:42.765805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431892+0000","last_change":"2024-04-25T09:54:28.233126+0000","last_active":"2024-04-25T09:54:33.431892+0000","last_peered":"2024-04-25T09:54:33.431892+0000","last_clean":"2024-04-25T09:54:33.431892+0000","last_became_active":"2024-04-25T09:54:28.231248+0000","last_became_peered":"2024-04-25T09:54:28.231248+0000","last_unstale":"2024-04-25T09:54:33.431892+0000","last_undegraded":"2024-04-25T09:54:33.431892+0000","last_fullsized":"2024-04-25T09:54:33.431892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:15.832642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431295+0000","last_change":"2024-04-25T09:54:28.219491+0000","last_active":"2024-04-25T09:54:33.431295+0000","last_peered":"2024-04-25T09:54:33.431295+0000","last_clean":"2024-04-25T09:54:33.431295+0000","last_became_active":"2024-04-25T09:54:28.219177+0000","last_became_peered":"2024-04-25T09:54:28.219177+0000","last_unstale":"2024-04-25T09:54:33.431295+0000","last_undegraded":"2024-04-25T09:54:33.431295+0000","last_fullsized":"2024-04-25T09:54:33.431295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:29.799078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431885+0000","last_change":"2024-04-25T09:54:28.212159+0000","last_active":"2024-04-25T09:54:33.431885+0000","last_peered":"2024-04-25T09:54:33.431885+0000","last_clean":"2024-04-25T09:54:33.431885+0000","last_became_active":"2024-04-25T09:54:28.211850+0000","last_became_peered":"2024-04-25T09:54:28.211850+0000","last_unstale":"2024-04-25T09:54:33.431885+0000","last_undegraded":"2024-04-25T09:54:33.431885+0000","last_fullsized":"2024-04-25T09:54:33.431885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:08.719227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427873+0000","last_change":"2024-04-25T09:54:28.232766+0000","last_active":"2024-04-25T09:54:33.427873+0000","last_peered":"2024-04-25T09:54:33.427873+0000","last_clean":"2024-04-25T09:54:33.427873+0000","last_became_active":"2024-04-25T09:54:28.232333+0000","last_became_peered":"2024-04-25T09:54:28.232333+0000","last_unstale":"2024-04-25T09:54:33.427873+0000","last_undegraded":"2024-04-25T09:54:33.427873+0000","last_fullsized":"2024-04-25T09:54:33.427873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:00:25.749559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":860160,"data_stored":694757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":107508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":103897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":103933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":107508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":103807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":270336,"data_stored":103967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":868352,"data_stored":694813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:54:45.637 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:54:45.637 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T09:54:45.638 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T09:54:45.638 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T09:54:45.638 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T09:54:45.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.772+0000 7fb81506b640 1 Processor -- start 2024-04-25T09:54:45.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.772+0000 7fb81506b640 1 -- start start 2024-04-25T09:54:45.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.773+0000 7fb81506b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb8100b53b0 0x7fb8100d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:45.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.773+0000 7fb81506b640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8100d1e80 con 0x7fb81015db00 2024-04-25T09:54:45.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.773+0000 7fb81506b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8100b5930 con 0x7fb8100d0a50 2024-04-25T09:54:45.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.773+0000 7fb81506b640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8100b5c10 con 0x7fb8100b53b0 2024-04-25T09:54:45.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.773+0000 7fb80ed9d640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb81015db00 0x7fb8100d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35498/0 (socket says 172.21.15.7:35498) 2024-04-25T09:54:45.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.773+0000 7fb80ed9d640 1 -- 172.21.15.7:0/3334920415 learned_addr learned my addr 172.21.15.7:0/3334920415 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:45.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.773+0000 7fb80f59e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb8100b53b0 0x7fb8100d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:45.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.773+0000 7fb80f59e640 1 -- 172.21.15.7:0/3334920415 >> v1:172.21.15.55:6789/0 conn(0x7fb8100d0a50 legacy=0x7fb8100d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:45.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.773+0000 7fb80f59e640 1 -- 172.21.15.7:0/3334920415 >> v1:172.21.15.7:6789/0 conn(0x7fb81015db00 legacy=0x7fb8100d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:45.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.773+0000 7fb80f59e640 1 -- 172.21.15.7:0/3334920415 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8100b5ef0 con 0x7fb8100b53b0 2024-04-25T09:54:45.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.774+0000 7fb80f59e640 1 --2- 172.21.15.7:0/3334920415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8100b53b0 0x7fb8100d2a40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb808009d90 tx=0x7fb80802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b30a82f8247a04 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:45.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.774+0000 7fb80dd9b640 1 -- 172.21.15.7:0/3334920415 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb808007740 con 0x7fb8100b53b0 2024-04-25T09:54:45.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.774+0000 7fb80dd9b640 1 -- 172.21.15.7:0/3334920415 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8080078e0 con 0x7fb8100b53b0 2024-04-25T09:54:45.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.774+0000 7fb80dd9b640 1 -- 172.21.15.7:0/3334920415 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb808007cb0 con 0x7fb8100b53b0 2024-04-25T09:54:45.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.775+0000 7fb81506b640 1 -- 172.21.15.7:0/3334920415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8100b53b0 msgr2=0x7fb8100d2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:45.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.775+0000 7fb81506b640 1 --2- 172.21.15.7:0/3334920415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8100b53b0 0x7fb8100d2a40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb808009d90 tx=0x7fb80802a6f0 comp rx=0 tx=0).stop 2024-04-25T09:54:45.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.775+0000 7fb81506b640 1 -- 172.21.15.7:0/3334920415 shutdown_connections 2024-04-25T09:54:45.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.775+0000 7fb81506b640 1 --2- 172.21.15.7:0/3334920415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8100b53b0 0x7fb8100d2a40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:45.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.775+0000 7fb81506b640 1 -- 172.21.15.7:0/3334920415 >> 172.21.15.7:0/3334920415 conn(0x7fb810072290 msgr2=0x7fb8100726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:45.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.775+0000 7fb81506b640 1 -- 172.21.15.7:0/3334920415 shutdown_connections 2024-04-25T09:54:45.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.775+0000 7fb81506b640 1 -- 172.21.15.7:0/3334920415 wait complete. 2024-04-25T09:54:45.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.776+0000 7fb81506b640 1 Processor -- start 2024-04-25T09:54:45.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.776+0000 7fb81506b640 1 -- start start 2024-04-25T09:54:45.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.777+0000 7fb81506b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8100b53b0 0x7fb81014acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:45.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.777+0000 7fb81506b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8100d0a50 0x7fb8100c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:45.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.777+0000 7fb81506b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb81015db00 0x7fb8100cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:45.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.777+0000 7fb81506b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8100d3660 con 0x7fb8100b53b0 2024-04-25T09:54:45.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.777+0000 7fb81506b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8100b61d0 con 0x7fb81015db00 2024-04-25T09:54:45.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.777+0000 7fb81506b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8100d2f80 con 0x7fb8100d0a50 2024-04-25T09:54:45.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.777+0000 7fb80ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8100b53b0 0x7fb81014acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:45.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.777+0000 7fb80ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8100b53b0 0x7fb81014acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42838/0 (socket says 172.21.15.7:42838) 2024-04-25T09:54:45.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.777+0000 7fb80ed9d640 1 -- 172.21.15.7:0/1296231989 learned_addr learned my addr 172.21.15.7:0/1296231989 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:45.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.777+0000 7fb80f59e640 1 --2- 172.21.15.7:0/1296231989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb81015db00 0x7fb8100cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:45.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.777+0000 7fb80e59c640 1 --2- 172.21.15.7:0/1296231989 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8100d0a50 0x7fb8100c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:45.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.777+0000 7fb80ed9d640 1 -- 172.21.15.7:0/1296231989 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8100d0a50 msgr2=0x7fb8100c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:45.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.777+0000 7fb80ed9d640 1 --2- 172.21.15.7:0/1296231989 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8100d0a50 0x7fb8100c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:45.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.777+0000 7fb80ed9d640 1 -- 172.21.15.7:0/1296231989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb81015db00 msgr2=0x7fb8100cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:45.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.777+0000 7fb80ed9d640 1 --2- 172.21.15.7:0/1296231989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb81015db00 0x7fb8100cb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:45.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.777+0000 7fb80ed9d640 1 -- 172.21.15.7:0/1296231989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8100c8e20 con 0x7fb8100b53b0 2024-04-25T09:54:45.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.777+0000 7fb80e59c640 1 --2- 172.21.15.7:0/1296231989 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8100d0a50 0x7fb8100c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:45.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.778+0000 7fb80ed9d640 1 --2- 172.21.15.7:0/1296231989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8100b53b0 0x7fb81014acd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb80000c480 tx=0x7fb80000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:45.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.778+0000 7fb7f77fe640 1 -- 172.21.15.7:0/1296231989 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800017070 con 0x7fb8100b53b0 2024-04-25T09:54:45.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.778+0000 7fb7f77fe640 1 -- 172.21.15.7:0/1296231989 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb800005ce0 con 0x7fb8100b53b0 2024-04-25T09:54:45.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.778+0000 7fb7f77fe640 1 -- 172.21.15.7:0/1296231989 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8000072f0 con 0x7fb8100b53b0 2024-04-25T09:54:45.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.778+0000 7fb81506b640 1 -- 172.21.15.7:0/1296231989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8100c9100 con 0x7fb8100b53b0 2024-04-25T09:54:45.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.778+0000 7fb81506b640 1 -- 172.21.15.7:0/1296231989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8100c96c0 con 0x7fb8100b53b0 2024-04-25T09:54:45.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.779+0000 7fb81506b640 1 -- 172.21.15.7:0/1296231989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb81015c100 con 0x7fb8100b53b0 2024-04-25T09:54:45.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.779+0000 7fb7f77fe640 1 -- 172.21.15.7:0/1296231989 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb80001a070 con 0x7fb8100b53b0 2024-04-25T09:54:45.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.780+0000 7fb7f77fe640 1 --2- 172.21.15.7:0/1296231989 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb7fc06b4d0 0x7fb7fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:45.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.780+0000 7fb7f77fe640 1 -- 172.21.15.7:0/1296231989 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb800089810 con 0x7fb8100b53b0 2024-04-25T09:54:45.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.780+0000 7fb80e59c640 1 --2- 172.21.15.7:0/1296231989 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb7fc06b4d0 0x7fb7fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:45.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.780+0000 7fb80e59c640 1 --2- 172.21.15.7:0/1296231989 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb7fc06b4d0 0x7fb7fc06d990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb8100cdc10 tx=0x7fb804009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:45.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:45.784+0000 7fb7f77fe640 1 -- 172.21.15.7:0/1296231989 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb81015c100 con 0x7fb8100b53b0 2024-04-25T09:54:46.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.013+0000 7fb81506b640 1 -- 172.21.15.7:0/1296231989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fb810067420 con 0x7fb8100b53b0 2024-04-25T09:54:46.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.016+0000 7fb7f77fe640 1 -- 172.21.15.7:0/1296231989 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171772 (secure 0 0 0) 0x7fb810067420 con 0x7fb8100b53b0 2024-04-25T09:54:46.021 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:46.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.019+0000 7fb81506b640 1 -- 172.21.15.7:0/1296231989 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb7fc06b4d0 msgr2=0x7fb7fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.019+0000 7fb81506b640 1 --2- 172.21.15.7:0/1296231989 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb7fc06b4d0 0x7fb7fc06d990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb8100cdc10 tx=0x7fb804009040 comp rx=0 tx=0).stop 2024-04-25T09:54:46.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.019+0000 7fb81506b640 1 -- 172.21.15.7:0/1296231989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8100b53b0 msgr2=0x7fb81014acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.019+0000 7fb81506b640 1 --2- 172.21.15.7:0/1296231989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8100b53b0 0x7fb81014acd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb80000c480 tx=0x7fb80000c940 comp rx=0 tx=0).stop 2024-04-25T09:54:46.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.019+0000 7fb81506b640 1 -- 172.21.15.7:0/1296231989 shutdown_connections 2024-04-25T09:54:46.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.019+0000 7fb81506b640 1 --2- 172.21.15.7:0/1296231989 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb7fc06b4d0 0x7fb7fc06d990 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.019+0000 7fb81506b640 1 --2- 172.21.15.7:0/1296231989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb81015db00 0x7fb8100cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.019+0000 7fb81506b640 1 --2- 172.21.15.7:0/1296231989 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8100d0a50 0x7fb8100c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.019+0000 7fb81506b640 1 --2- 172.21.15.7:0/1296231989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8100b53b0 0x7fb81014acd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.019+0000 7fb81506b640 1 -- 172.21.15.7:0/1296231989 >> 172.21.15.7:0/1296231989 conn(0x7fb810072290 msgr2=0x7fb8100d37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:46.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.019+0000 7fb81506b640 1 -- 172.21.15.7:0/1296231989 shutdown_connections 2024-04-25T09:54:46.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.019+0000 7fb81506b640 1 -- 172.21.15.7:0/1296231989 wait complete. 2024-04-25T09:54:46.032 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":5,"flags":0,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":457172722},{"type":"v1","addr":"172.21.15.7:6833","nonce":457172722}]},"active_addr":"172.21.15.7:6833/457172722","active_change":"2024-04-25T09:54:07.844686+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4102,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":2374860056}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":2213897567}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":1136884940}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":5387536}]}]} 2024-04-25T09:54:46.036 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T09:54:46.036 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T09:54:46.036 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:54:46.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.135+0000 7f0fa1e88640 1 Processor -- start 2024-04-25T09:54:46.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.135+0000 7f0fa1e88640 1 -- start start 2024-04-25T09:54:46.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.136+0000 7f0fa1e88640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f9c15db00 0x7f0f9c0d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.136+0000 7f0fa1e88640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0f9c0ce2b0 0x7f0f9c0d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.136+0000 7f0fa1e88640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f9c0d1e80 con 0x7f0f9c0b53b0 2024-04-25T09:54:46.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.136+0000 7f0fa1e88640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f9c0b5930 con 0x7f0f9c0ce2b0 2024-04-25T09:54:46.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.136+0000 7f0fa1e88640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c0b5c10 con 0x7f0f9c15db00 2024-04-25T09:54:46.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.136+0000 7f0f9bfff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0f9c0ce2b0 0x7f0f9c0d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.136+0000 7f0f9affd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0f9c0b53b0 0x7f0f9c161670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35512/0 (socket says 172.21.15.7:35512) 2024-04-25T09:54:46.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.136+0000 7f0f9affd640 1 -- 172.21.15.7:0/986311013 learned_addr learned my addr 172.21.15.7:0/986311013 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:46.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.136+0000 7f0f9b7fe640 1 --2- 172.21.15.7:0/986311013 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f9c15db00 0x7f0f9c0d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.136+0000 7f0f9bfff640 1 -- 172.21.15.7:0/986311013 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f9c15db00 msgr2=0x7f0f9c0d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:46.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.136+0000 7f0f9bfff640 1 --2- 172.21.15.7:0/986311013 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f9c15db00 0x7f0f9c0d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.136+0000 7f0f9bfff640 1 -- 172.21.15.7:0/986311013 >> v1:172.21.15.7:6789/0 conn(0x7f0f9c0b53b0 legacy=0x7f0f9c161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.136+0000 7f0f9bfff640 1 -- 172.21.15.7:0/986311013 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9c0b5ef0 con 0x7f0f9c0ce2b0 2024-04-25T09:54:46.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.136+0000 7f0f9b7fe640 1 --2- 172.21.15.7:0/986311013 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f9c15db00 0x7f0f9c0d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:46.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.137+0000 7f0f9bfff640 1 --2- 172.21.15.7:0/986311013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f9c0ce2b0 0x7f0f9c0d0880 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0f94009d90 tx=0x7f0f9402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cadee6a4b47839a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.137+0000 7f0f9a7fc640 1 -- 172.21.15.7:0/986311013 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f94007740 con 0x7f0f9c0ce2b0 2024-04-25T09:54:46.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.137+0000 7f0f9a7fc640 1 -- 172.21.15.7:0/986311013 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f940078e0 con 0x7f0f9c0ce2b0 2024-04-25T09:54:46.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.137+0000 7f0f9a7fc640 1 -- 172.21.15.7:0/986311013 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f94007cb0 con 0x7f0f9c0ce2b0 2024-04-25T09:54:46.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.138+0000 7f0fa1e88640 1 -- 172.21.15.7:0/986311013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f9c0ce2b0 msgr2=0x7f0f9c0d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.138+0000 7f0fa1e88640 1 --2- 172.21.15.7:0/986311013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f9c0ce2b0 0x7f0f9c0d0880 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0f94009d90 tx=0x7f0f9402a660 comp rx=0 tx=0).stop 2024-04-25T09:54:46.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.138+0000 7f0fa1e88640 1 -- 172.21.15.7:0/986311013 shutdown_connections 2024-04-25T09:54:46.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.138+0000 7f0fa1e88640 1 --2- 172.21.15.7:0/986311013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f9c0ce2b0 0x7f0f9c0d0880 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.138+0000 7f0fa1e88640 1 --2- 172.21.15.7:0/986311013 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f9c15db00 0x7f0f9c0d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.138+0000 7f0fa1e88640 1 -- 172.21.15.7:0/986311013 >> 172.21.15.7:0/986311013 conn(0x7f0f9c072290 msgr2=0x7f0f9c0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:46.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.138+0000 7f0fa1e88640 1 -- 172.21.15.7:0/986311013 shutdown_connections 2024-04-25T09:54:46.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.138+0000 7f0fa1e88640 1 -- 172.21.15.7:0/986311013 wait complete. 2024-04-25T09:54:46.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.139+0000 7f0fa1e88640 1 Processor -- start 2024-04-25T09:54:46.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.139+0000 7f0fa1e88640 1 -- start start 2024-04-25T09:54:46.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.140+0000 7f0fa1e88640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f9c0b53b0 0x7f0f9c14acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.140+0000 7f0fa1e88640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f9c0ce2b0 0x7f0f9c0cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.140+0000 7f0fa1e88640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f9c15db00 0x7f0f9c15ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.140+0000 7f0fa1e88640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c0d3660 con 0x7f0f9c0ce2b0 2024-04-25T09:54:46.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.140+0000 7f0fa1e88640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c0b61d0 con 0x7f0f9c0b53b0 2024-04-25T09:54:46.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.140+0000 7f0fa1e88640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c0b6c10 con 0x7f0f9c15db00 2024-04-25T09:54:46.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.140+0000 7f0f9affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f9c0ce2b0 0x7f0f9c0cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.140+0000 7f0f9affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f9c0ce2b0 0x7f0f9c0cbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42858/0 (socket says 172.21.15.7:42858) 2024-04-25T09:54:46.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.140+0000 7f0f9affd640 1 -- 172.21.15.7:0/2113871237 learned_addr learned my addr 172.21.15.7:0/2113871237 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:46.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.140+0000 7f0f9b7fe640 1 --2- 172.21.15.7:0/2113871237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f9c0b53b0 0x7f0f9c14acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.140+0000 7f0f9bfff640 1 --2- 172.21.15.7:0/2113871237 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f9c15db00 0x7f0f9c15ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.140+0000 7f0f9affd640 1 -- 172.21.15.7:0/2113871237 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f9c15db00 msgr2=0x7f0f9c15ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.140+0000 7f0f9affd640 1 --2- 172.21.15.7:0/2113871237 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f9c15db00 0x7f0f9c15ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.140+0000 7f0f9affd640 1 -- 172.21.15.7:0/2113871237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f9c0b53b0 msgr2=0x7f0f9c14acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.140+0000 7f0f9affd640 1 --2- 172.21.15.7:0/2113871237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f9c0b53b0 0x7f0f9c14acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.140+0000 7f0f9affd640 1 -- 172.21.15.7:0/2113871237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9c14b210 con 0x7f0f9c0ce2b0 2024-04-25T09:54:46.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.140+0000 7f0f9b7fe640 1 --2- 172.21.15.7:0/2113871237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f9c0b53b0 0x7f0f9c14acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:46.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.140+0000 7f0f9bfff640 1 --2- 172.21.15.7:0/2113871237 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f9c15db00 0x7f0f9c15ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:46.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.140+0000 7f0f9affd640 1 --2- 172.21.15.7:0/2113871237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f9c0ce2b0 0x7f0f9c0cbdb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0f9000c400 tx=0x7f0f9000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.141+0000 7f0f83fff640 1 -- 172.21.15.7:0/2113871237 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f90017070 con 0x7f0f9c0ce2b0 2024-04-25T09:54:46.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.141+0000 7f0f83fff640 1 -- 172.21.15.7:0/2113871237 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f90005ce0 con 0x7f0f9c0ce2b0 2024-04-25T09:54:46.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.141+0000 7f0fa1e88640 1 -- 172.21.15.7:0/2113871237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f9c0cc720 con 0x7f0f9c0ce2b0 2024-04-25T09:54:46.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.141+0000 7f0f83fff640 1 -- 172.21.15.7:0/2113871237 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f900072f0 con 0x7f0f9c0ce2b0 2024-04-25T09:54:46.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.141+0000 7f0fa1e88640 1 -- 172.21.15.7:0/2113871237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f9c0ccce0 con 0x7f0f9c0ce2b0 2024-04-25T09:54:46.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.142+0000 7f0fa1e88640 1 -- 172.21.15.7:0/2113871237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f9c068fd0 con 0x7f0f9c0ce2b0 2024-04-25T09:54:46.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.142+0000 7f0f83fff640 1 -- 172.21.15.7:0/2113871237 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0f9001a070 con 0x7f0f9c0ce2b0 2024-04-25T09:54:46.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.142+0000 7f0f83fff640 1 --2- 172.21.15.7:0/2113871237 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0f8806b4d0 0x7f0f8806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.143+0000 7f0f83fff640 1 -- 172.21.15.7:0/2113871237 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0f900899f0 con 0x7f0f9c0ce2b0 2024-04-25T09:54:46.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.143+0000 7f0f9b7fe640 1 --2- 172.21.15.7:0/2113871237 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0f8806b4d0 0x7f0f8806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.143+0000 7f0f9b7fe640 1 --2- 172.21.15.7:0/2113871237 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0f8806b4d0 0x7f0f8806d990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c00a990 tx=0x7f0f8c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.147+0000 7f0f83fff640 1 -- 172.21.15.7:0/2113871237 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0f900584a0 con 0x7f0f9c0ce2b0 2024-04-25T09:54:46.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.328+0000 7f0fa1e88640 1 -- 172.21.15.7:0/2113871237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f9c159b80 con 0x7f0f9c0ce2b0 2024-04-25T09:54:46.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.329+0000 7f0f83fff640 1 -- 172.21.15.7:0/2113871237 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18418 (secure 0 0 0) 0x7f0f90057da0 con 0x7f0f9c0ce2b0 2024-04-25T09:54:46.332 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:46.332 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:54:32.606761+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:54:26.011833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:54:26.535536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:54:30.264996+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:54:46.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.331+0000 7f0fa1e88640 1 -- 172.21.15.7:0/2113871237 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0f8806b4d0 msgr2=0x7f0f8806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.331+0000 7f0fa1e88640 1 --2- 172.21.15.7:0/2113871237 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0f8806b4d0 0x7f0f8806d990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c00a990 tx=0x7f0f8c008040 comp rx=0 tx=0).stop 2024-04-25T09:54:46.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.331+0000 7f0fa1e88640 1 -- 172.21.15.7:0/2113871237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f9c0ce2b0 msgr2=0x7f0f9c0cbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.331+0000 7f0fa1e88640 1 --2- 172.21.15.7:0/2113871237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f9c0ce2b0 0x7f0f9c0cbdb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0f9000c400 tx=0x7f0f9000c8c0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.331+0000 7f0fa1e88640 1 -- 172.21.15.7:0/2113871237 shutdown_connections 2024-04-25T09:54:46.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.331+0000 7f0fa1e88640 1 --2- 172.21.15.7:0/2113871237 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0f8806b4d0 0x7f0f8806d990 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.331+0000 7f0fa1e88640 1 --2- 172.21.15.7:0/2113871237 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f9c15db00 0x7f0f9c15ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.331+0000 7f0fa1e88640 1 --2- 172.21.15.7:0/2113871237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f9c0ce2b0 0x7f0f9c0cbdb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.331+0000 7f0fa1e88640 1 --2- 172.21.15.7:0/2113871237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f9c0b53b0 0x7f0f9c14acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.331+0000 7f0fa1e88640 1 -- 172.21.15.7:0/2113871237 >> 172.21.15.7:0/2113871237 conn(0x7f0f9c072290 msgr2=0x7f0f9c0cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:46.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.331+0000 7f0fa1e88640 1 -- 172.21.15.7:0/2113871237 shutdown_connections 2024-04-25T09:54:46.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.331+0000 7f0fa1e88640 1 -- 172.21.15.7:0/2113871237 wait complete. 2024-04-25T09:54:46.345 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T09:54:46.345 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:54:46.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.443+0000 7f3617f5c640 1 Processor -- start 2024-04-25T09:54:46.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.444+0000 7f3617f5c640 1 -- start start 2024-04-25T09:54:46.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.444+0000 7f3617f5c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f36100cd800 0x7f361015ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.444+0000 7f3617f5c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f36100999f0 0x7f361006c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.444+0000 7f3617f5c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f361009a190 con 0x7f361006c870 2024-04-25T09:54:46.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.444+0000 7f3617f5c640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36100cdbe0 con 0x7f36100999f0 2024-04-25T09:54:46.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.444+0000 7f3617f5c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f361009a470 con 0x7f36100cd800 2024-04-25T09:54:46.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.444+0000 7f36154f7640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f36100999f0 0x7f361006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.444+0000 7f36154f7640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f36100999f0 0x7f361006c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42872/0 (socket says 172.21.15.7:42872) 2024-04-25T09:54:46.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.445+0000 7f36154f7640 1 -- 172.21.15.7:0/2027688206 learned_addr learned my addr 172.21.15.7:0/2027688206 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:46.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.445+0000 7f3615cf8640 1 --2- 172.21.15.7:0/2027688206 >> v2:172.21.15.55:3300/0 conn(0x7f36100cd800 0x7f361015ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.445+0000 7f36154f7640 1 -- 172.21.15.7:0/2027688206 >> v2:172.21.15.55:3300/0 conn(0x7f36100cd800 msgr2=0x7f361015ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:46.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.445+0000 7f36154f7640 1 --2- 172.21.15.7:0/2027688206 >> v2:172.21.15.55:3300/0 conn(0x7f36100cd800 0x7f361015ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.445+0000 7f36154f7640 1 -- 172.21.15.7:0/2027688206 >> v1:172.21.15.55:6789/0 conn(0x7f361006c870 legacy=0x7f361015d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.445+0000 7f36154f7640 1 -- 172.21.15.7:0/2027688206 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361009a750 con 0x7f36100999f0 2024-04-25T09:54:46.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.445+0000 7f36154f7640 1 --2- 172.21.15.7:0/2027688206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36100999f0 0x7f361006c330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3610072640 tx=0x7f360002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a54ec2cf9677353c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.446+0000 7f3614cf6640 1 -- 172.21.15.7:0/2027688206 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3600037070 con 0x7f36100999f0 2024-04-25T09:54:46.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.446+0000 7f3614cf6640 1 -- 172.21.15.7:0/2027688206 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3600032440 con 0x7f36100999f0 2024-04-25T09:54:46.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.446+0000 7f3614cf6640 1 -- 172.21.15.7:0/2027688206 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3600032810 con 0x7f36100999f0 2024-04-25T09:54:46.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.446+0000 7f3617f5c640 1 -- 172.21.15.7:0/2027688206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36100999f0 msgr2=0x7f361006c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.446+0000 7f3617f5c640 1 --2- 172.21.15.7:0/2027688206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36100999f0 0x7f361006c330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3610072640 tx=0x7f360002a270 comp rx=0 tx=0).stop 2024-04-25T09:54:46.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.446+0000 7f3617f5c640 1 -- 172.21.15.7:0/2027688206 shutdown_connections 2024-04-25T09:54:46.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.446+0000 7f3617f5c640 1 --2- 172.21.15.7:0/2027688206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36100999f0 0x7f361006c330 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.446+0000 7f3617f5c640 1 --2- 172.21.15.7:0/2027688206 >> v2:172.21.15.55:3300/0 conn(0x7f36100cd800 0x7f361015ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.446+0000 7f3617f5c640 1 -- 172.21.15.7:0/2027688206 >> 172.21.15.7:0/2027688206 conn(0x7f36100d16f0 msgr2=0x7f36100d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:46.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.446+0000 7f3617f5c640 1 -- 172.21.15.7:0/2027688206 shutdown_connections 2024-04-25T09:54:46.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.446+0000 7f3617f5c640 1 -- 172.21.15.7:0/2027688206 wait complete. 2024-04-25T09:54:46.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.447+0000 7f3617f5c640 1 Processor -- start 2024-04-25T09:54:46.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.447+0000 7f3617f5c640 1 -- start start 2024-04-25T09:54:46.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.448+0000 7f3617f5c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f361006c870 0x7f361015c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.448+0000 7f3617f5c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36100999f0 0x7f36100c51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.448+0000 7f3617f5c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36100cd800 0x7f36100b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.448+0000 7f3617f5c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3610099e80 con 0x7f36100999f0 2024-04-25T09:54:46.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.448+0000 7f3617f5c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36100cf930 con 0x7f361006c870 2024-04-25T09:54:46.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.448+0000 7f3617f5c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361015da70 con 0x7f36100cd800 2024-04-25T09:54:46.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.448+0000 7f36154f7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36100999f0 0x7f36100c51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.448+0000 7f36154f7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36100999f0 0x7f36100c51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42884/0 (socket says 172.21.15.7:42884) 2024-04-25T09:54:46.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.448+0000 7f36154f7640 1 -- 172.21.15.7:0/1871787708 learned_addr learned my addr 172.21.15.7:0/1871787708 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:46.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.448+0000 7f3615cf8640 1 --2- 172.21.15.7:0/1871787708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f361006c870 0x7f361015c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.448+0000 7f36164f9640 1 --2- 172.21.15.7:0/1871787708 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36100cd800 0x7f36100b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.449+0000 7f36154f7640 1 -- 172.21.15.7:0/1871787708 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36100cd800 msgr2=0x7f36100b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.449+0000 7f36154f7640 1 --2- 172.21.15.7:0/1871787708 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36100cd800 0x7f36100b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.449+0000 7f36154f7640 1 -- 172.21.15.7:0/1871787708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f361006c870 msgr2=0x7f361015c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.449+0000 7f36154f7640 1 --2- 172.21.15.7:0/1871787708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f361006c870 0x7f361015c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.449+0000 7f36154f7640 1 -- 172.21.15.7:0/1871787708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36100c5720 con 0x7f36100999f0 2024-04-25T09:54:46.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.449+0000 7f3615cf8640 1 --2- 172.21.15.7:0/1871787708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f361006c870 0x7f361015c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:46.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.449+0000 7f36154f7640 1 --2- 172.21.15.7:0/1871787708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36100999f0 0x7f36100c51e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f360002a2b0 tx=0x7f36000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.449+0000 7f36067fc640 1 -- 172.21.15.7:0/1871787708 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3600037040 con 0x7f36100999f0 2024-04-25T09:54:46.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.449+0000 7f36067fc640 1 -- 172.21.15.7:0/1871787708 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3600042070 con 0x7f36100999f0 2024-04-25T09:54:46.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.449+0000 7f3617f5c640 1 -- 172.21.15.7:0/1871787708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36100b5220 con 0x7f36100999f0 2024-04-25T09:54:46.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.449+0000 7f36067fc640 1 -- 172.21.15.7:0/1871787708 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3600030880 con 0x7f36100999f0 2024-04-25T09:54:46.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.449+0000 7f3617f5c640 1 -- 172.21.15.7:0/1871787708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36100b5fa0 con 0x7f36100999f0 2024-04-25T09:54:46.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.450+0000 7f3617f5c640 1 -- 172.21.15.7:0/1871787708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3610068fd0 con 0x7f36100999f0 2024-04-25T09:54:46.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.450+0000 7f36067fc640 1 -- 172.21.15.7:0/1871787708 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3600030a20 con 0x7f36100999f0 2024-04-25T09:54:46.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.451+0000 7f36067fc640 1 --2- 172.21.15.7:0/1871787708 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f35f406b4d0 0x7f35f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.451+0000 7f36067fc640 1 -- 172.21.15.7:0/1871787708 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f36000aad20 con 0x7f36100999f0 2024-04-25T09:54:46.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.451+0000 7f3615cf8640 1 --2- 172.21.15.7:0/1871787708 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f35f406b4d0 0x7f35f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.451+0000 7f3615cf8640 1 --2- 172.21.15.7:0/1871787708 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f35f406b4d0 0x7f35f406d990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3608009af0 tx=0x7f3608008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.455+0000 7f36067fc640 1 -- 172.21.15.7:0/1871787708 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f36000798f0 con 0x7f36100999f0 2024-04-25T09:54:46.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.637+0000 7f3617f5c640 1 -- 172.21.15.7:0/1871787708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f361009f4e0 con 0x7f36100999f0 2024-04-25T09:54:46.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.638+0000 7f36067fc640 1 -- 172.21.15.7:0/1871787708 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18418 (secure 0 0 0) 0x7f36000791f0 con 0x7f36100999f0 2024-04-25T09:54:46.641 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:46.641 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:54:32.606761+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:54:26.011833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:54:26.535536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:54:30.264996+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:54:46.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.640+0000 7f3617f5c640 1 -- 172.21.15.7:0/1871787708 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f35f406b4d0 msgr2=0x7f35f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.640+0000 7f3617f5c640 1 --2- 172.21.15.7:0/1871787708 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f35f406b4d0 0x7f35f406d990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3608009af0 tx=0x7f3608008040 comp rx=0 tx=0).stop 2024-04-25T09:54:46.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.640+0000 7f3617f5c640 1 -- 172.21.15.7:0/1871787708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36100999f0 msgr2=0x7f36100c51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.640+0000 7f3617f5c640 1 --2- 172.21.15.7:0/1871787708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36100999f0 0x7f36100c51e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f360002a2b0 tx=0x7f36000046c0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.640+0000 7f3617f5c640 1 -- 172.21.15.7:0/1871787708 shutdown_connections 2024-04-25T09:54:46.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.640+0000 7f3617f5c640 1 --2- 172.21.15.7:0/1871787708 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f35f406b4d0 0x7f35f406d990 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.640+0000 7f3617f5c640 1 --2- 172.21.15.7:0/1871787708 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36100cd800 0x7f36100b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.640+0000 7f3617f5c640 1 --2- 172.21.15.7:0/1871787708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36100999f0 0x7f36100c51e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.640+0000 7f3617f5c640 1 --2- 172.21.15.7:0/1871787708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f361006c870 0x7f361015c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.640+0000 7f3617f5c640 1 -- 172.21.15.7:0/1871787708 >> 172.21.15.7:0/1871787708 conn(0x7f36100d16f0 msgr2=0x7f361015de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:46.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.640+0000 7f3617f5c640 1 -- 172.21.15.7:0/1871787708 shutdown_connections 2024-04-25T09:54:46.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.640+0000 7f3617f5c640 1 -- 172.21.15.7:0/1871787708 wait complete. 2024-04-25T09:54:46.654 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T09:54:46.654 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T09:54:46.655 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T09:54:46.655 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T09:54:46.655 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-25T09:54:46.656 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-25T09:54:46.656 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-25T09:54:46.657 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-25T09:54:46.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.828+0000 7f2dad4a0640 1 Processor -- start 2024-04-25T09:54:46.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.829+0000 7f2dad4a0640 1 -- start start 2024-04-25T09:54:46.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.829+0000 7ff40cf34640 1 Processor -- start 2024-04-25T09:54:46.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.829+0000 7ff40cf34640 1 -- start start 2024-04-25T09:54:46.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.830+0000 7f4a53acd640 1 Processor -- start 2024-04-25T09:54:46.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.830+0000 7f490c5d5640 1 Processor -- start 2024-04-25T09:54:46.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.830+0000 7f490c5d5640 1 -- start start 2024-04-25T09:54:46.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.830+0000 7f2dad4a0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2da81652f0 0x7f2da80cc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.830+0000 7f2dad4a0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2da806e980 0x7f2da8070f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.830+0000 7f2dad4a0640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2da80cd2a0 con 0x7f2da80714d0 2024-04-25T09:54:46.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.830+0000 7f2dad4a0640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da80ce340 con 0x7f2da81652f0 2024-04-25T09:54:46.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.830+0000 7f2dad4a0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da80cdeb0 con 0x7f2da806e980 2024-04-25T09:54:46.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.830+0000 7fa1b5cbb640 1 Processor -- start 2024-04-25T09:54:46.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.830+0000 7fa1b5cbb640 1 -- start start 2024-04-25T09:54:46.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.830+0000 7f2da7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2da81652f0 0x7f2da80cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.831+0000 7f2da7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2da81652f0 0x7f2da80cc390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:59336/0 (socket says 172.21.15.7:59336) 2024-04-25T09:54:46.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.831+0000 7f2da7fff640 1 -- 172.21.15.7:0/1240831486 learned_addr learned my addr 172.21.15.7:0/1240831486 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:46.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.831+0000 7ff40cf34640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4080af9d0 0x7ff4080afe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7ff40cf34640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff4080b36f0 0x7ff4080b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7fa1b5cbb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa1a800c0a0 0x7fa1a8038080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7fa1b5cbb640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa1a8053c70 0x7fa1a80defb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7f490c5d5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f49041426c0 0x7f490406e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7ff40cf34640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4080cdb20 con 0x7ff408153cc0 2024-04-25T09:54:46.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7ff40cf34640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4080cebc0 con 0x7ff4080b36f0 2024-04-25T09:54:46.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7fa1b5cbb640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1a80541e0 con 0x7fa1a80df4f0 2024-04-25T09:54:46.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7fa1b5cbb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1a8005f80 con 0x7fa1a800c0a0 2024-04-25T09:54:46.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7fa1b5cbb640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a8006260 con 0x7fa1a8053c70 2024-04-25T09:54:46.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7fa1affff640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa1a8053c70 0x7fa1a80defb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7fa1affff640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa1a8053c70 0x7fa1a80defb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:43954/0 (socket says 172.21.15.7:43954) 2024-04-25T09:54:46.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7fa1affff640 1 -- 172.21.15.7:0/1142197734 learned_addr learned my addr 172.21.15.7:0/1142197734 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:46.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7f490c5d5640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f490415a9a0 0x7f49040ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7f490c5d5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f49040ced10 0x7f490415b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.831+0000 7f2da7fff640 1 -- 172.21.15.7:0/1240831486 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2da806e980 msgr2=0x7f2da8070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:46.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.831+0000 7f2da7fff640 1 --2- 172.21.15.7:0/1240831486 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2da806e980 0x7f2da8070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.831+0000 7f2da7fff640 1 -- 172.21.15.7:0/1240831486 >> v1:172.21.15.55:6789/0 conn(0x7f2da80714d0 legacy=0x7f2da8165850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:46.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.831+0000 7f2da7fff640 1 -- 172.21.15.7:0/1240831486 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da80cd580 con 0x7f2da81652f0 2024-04-25T09:54:46.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7f5f38bd6640 1 Processor -- start 2024-04-25T09:54:46.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7f5f38bd6640 1 -- start start 2024-04-25T09:54:46.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7ff40cf34640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4080b0370 con 0x7ff4080af9d0 2024-04-25T09:54:46.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7ff405d9b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4080af9d0 0x7ff4080afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7f490c5d5640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f490406d5a0 con 0x7f490415a9a0 2024-04-25T09:54:46.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7ff405d9b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4080af9d0 0x7ff4080afe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:43944/0 (socket says 172.21.15.7:43944) 2024-04-25T09:54:46.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7ff405d9b640 1 -- 172.21.15.7:0/3253183910 learned_addr learned my addr 172.21.15.7:0/3253183910 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:46.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7f490a371640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f49041426c0 0x7f490406e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7f490a371640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f49041426c0 0x7f490406e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:59352/0 (socket says 172.21.15.7:59352) 2024-04-25T09:54:46.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7f490a371640 1 -- 172.21.15.7:0/1808111814 learned_addr learned my addr 172.21.15.7:0/1808111814 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:46.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7f2da7fff640 1 --2- 172.21.15.7:0/1240831486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2da81652f0 0x7f2da80cc390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c009870 tx=0x7f2d9c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=971b36a11ad49414 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7f490c5d5640 1 -- 172.21.15.7:0/1808111814 --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f490406d880 con 0x7f49041426c0 2024-04-25T09:54:46.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.830+0000 7f4a53acd640 1 -- start start 2024-04-25T09:54:46.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7f4a53acd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4a4c0b16e0 0x7f4a4c0ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7f4a53acd640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a4c165af0 con 0x7f4a4c0cd240 2024-04-25T09:54:46.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7f490ab72640 1 --2- 172.21.15.7:0/1808111814 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f49040ced10 0x7f490415b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7f490c5d5640 1 -- 172.21.15.7:0/1808111814 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490406db60 con 0x7f49040ced10 2024-04-25T09:54:46.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.833+0000 7fa1affff640 1 -- 172.21.15.7:0/1142197734 >> v2:172.21.15.55:3300/0 conn(0x7fa1a800c0a0 msgr2=0x7fa1a8038080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:46.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7fa1b4cb9640 1 --2- 172.21.15.7:0/1142197734 >> v2:172.21.15.55:3300/0 conn(0x7fa1a800c0a0 0x7fa1a8038080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.833+0000 7fa1affff640 1 --2- 172.21.15.7:0/1142197734 >> v2:172.21.15.55:3300/0 conn(0x7fa1a800c0a0 0x7fa1a8038080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.833+0000 7fa1affff640 1 -- 172.21.15.7:0/1142197734 >> v1:172.21.15.7:6789/0 conn(0x7fa1a80df4f0 legacy=0x7fa1a804fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:46.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.833+0000 7fa1affff640 1 -- 172.21.15.7:0/1142197734 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a8006540 con 0x7fa1a8053c70 2024-04-25T09:54:46.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.834+0000 7fa1b4cb9640 1 --2- 172.21.15.7:0/1142197734 >> v2:172.21.15.55:3300/0 conn(0x7fa1a800c0a0 0x7fa1a8038080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:46.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.834+0000 7fa1affff640 1 --2- 172.21.15.7:0/1142197734 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa1a8053c70 0x7fa1a80defb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009870 tx=0x7fa1a402a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d40d633825a94a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7f2a25226640 1 Processor -- start 2024-04-25T09:54:46.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7f2a25226640 1 -- start start 2024-04-25T09:54:46.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7f4a53acd640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a4c165dd0 con 0x7f4a4c15c380 2024-04-25T09:54:46.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.832+0000 7f4a53acd640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a4c15c760 con 0x7f4a4c0b16e0 2024-04-25T09:54:46.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.833+0000 7f4a51068640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4a4c0b16e0 0x7f4a4c0ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.833+0000 7f4a5206a640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f4a4c0cd240 0x7f4a4c1622b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35532/0 (socket says 172.21.15.7:35532) 2024-04-25T09:54:46.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.833+0000 7f4a5206a640 1 -- 172.21.15.7:0/2495779631 learned_addr learned my addr 172.21.15.7:0/2495779631 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:46.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.833+0000 7f4a50867640 1 -- 172.21.15.7:0/2495779631 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3853436673 0 0) 0x7f4a4c165af0 con 0x7f4a4c0cd240 2024-04-25T09:54:46.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.833+0000 7f4a51068640 1 -- 172.21.15.7:0/2495779631 >> v1:172.21.15.55:6789/0 conn(0x7f4a4c15c380 legacy=0x7f4a4c06e730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T09:54:46.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.833+0000 7f4a51068640 1 -- 172.21.15.7:0/2495779631 >> v1:172.21.15.7:6789/0 conn(0x7f4a4c0cd240 legacy=0x7f4a4c1622b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.833+0000 7f4a51068640 1 -- 172.21.15.7:0/2495779631 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4c1660b0 con 0x7f4a4c0b16e0 2024-04-25T09:54:46.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.833+0000 7f490a371640 1 -- 172.21.15.7:0/1808111814 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f49040ced10 msgr2=0x7f490415b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:46.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.833+0000 7f490a371640 1 --2- 172.21.15.7:0/1808111814 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f49040ced10 0x7f490415b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.833+0000 7f490a371640 1 -- 172.21.15.7:0/1808111814 >> v2:172.21.15.7:3300/0 conn(0x7f490415a9a0 msgr2=0x7f49040ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:46.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.833+0000 7f490a371640 1 --2- 172.21.15.7:0/1808111814 >> v2:172.21.15.7:3300/0 conn(0x7f490415a9a0 0x7f49040ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.833+0000 7f490a371640 1 -- 172.21.15.7:0/1808111814 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f490406de40 con 0x7f49041426c0 2024-04-25T09:54:46.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.834+0000 7f490a371640 1 --2- 172.21.15.7:0/1808111814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49041426c0 0x7f490406e640 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f490415d4d0 tx=0x7f48f402e540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3764d45f9bd2fe39 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.833+0000 7f2da6ffd640 1 -- 172.21.15.7:0/1240831486 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c037070 con 0x7f2da81652f0 2024-04-25T09:54:46.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.833+0000 7f2da6ffd640 1 -- 172.21.15.7:0/1240831486 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9c032440 con 0x7f2da81652f0 2024-04-25T09:54:46.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.833+0000 7f2da6ffd640 1 -- 172.21.15.7:0/1240831486 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c032810 con 0x7f2da81652f0 2024-04-25T09:54:46.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.834+0000 7f2dad4a0640 1 -- 172.21.15.7:0/1240831486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2da81652f0 msgr2=0x7f2da80cc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.834+0000 7f2dad4a0640 1 --2- 172.21.15.7:0/1240831486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2da81652f0 0x7f2da80cc390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c009870 tx=0x7f2d9c02a230 comp rx=0 tx=0).stop 2024-04-25T09:54:46.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.834+0000 7f2a25226640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2a20071710 0x7f2a200b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.834+0000 7f2a25226640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a200b44c0 con 0x7f2a200b3740 2024-04-25T09:54:46.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.834+0000 7f2a25226640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a200b47a0 con 0x7f2a2006f0f0 2024-04-25T09:54:46.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.834+0000 7f2a25226640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a200cd8a0 con 0x7f2a20071710 2024-04-25T09:54:46.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.834+0000 7f490936f640 1 -- 172.21.15.7:0/1808111814 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f403a070 con 0x7f49041426c0 2024-04-25T09:54:46.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.834+0000 7f490936f640 1 -- 172.21.15.7:0/1808111814 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f4008df0 con 0x7f49041426c0 2024-04-25T09:54:46.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.834+0000 7f490936f640 1 -- 172.21.15.7:0/1808111814 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f400a2d0 con 0x7f49041426c0 2024-04-25T09:54:46.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.833+0000 7f5f38bd6640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5f34161c50 0x7f5f340b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.833+0000 7f5f38bd6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5f34071000 0x7f5f34071460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.833+0000 7f5f38bd6640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3406dd70 con 0x7f5f3406d060 2024-04-25T09:54:46.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.833+0000 7f5f38bd6640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f340719a0 con 0x7f5f34071000 2024-04-25T09:54:46.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.833+0000 7f5f38bd6640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f340b37e0 con 0x7f5f34161c50 2024-04-25T09:54:46.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.833+0000 7f5f32ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5f34071000 0x7f5f34071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.833+0000 7f5f32ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5f34071000 0x7f5f34071460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:59358/0 (socket says 172.21.15.7:59358) 2024-04-25T09:54:46.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.833+0000 7f5f32ffd640 1 -- 172.21.15.7:0/3216890994 learned_addr learned my addr 172.21.15.7:0/3216890994 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:46.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.833+0000 7f5f337fe640 1 --2- 172.21.15.7:0/3216890994 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5f34161c50 0x7f5f340b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.834+0000 7f5f32ffd640 1 -- 172.21.15.7:0/3216890994 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5f34161c50 msgr2=0x7f5f340b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:46.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.834+0000 7f5f32ffd640 1 --2- 172.21.15.7:0/3216890994 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5f34161c50 0x7f5f340b42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.834+0000 7f5f32ffd640 1 -- 172.21.15.7:0/3216890994 >> v1:172.21.15.55:6789/0 conn(0x7f5f3406d060 legacy=0x7f5f3406d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.834+0000 7f5f32ffd640 1 -- 172.21.15.7:0/3216890994 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f340b3ac0 con 0x7f5f34071000 2024-04-25T09:54:46.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.834+0000 7f2a1ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2a2006f0f0 0x7f2a20159590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:42688/0 (socket says 172.21.15.7:42688) 2024-04-25T09:54:46.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.834+0000 7f8c2a009640 1 Processor -- start 2024-04-25T09:54:46.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.835+0000 7f8c2a009640 1 -- start start 2024-04-25T09:54:46.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.834+0000 7f2a1ffff640 1 -- 172.21.15.7:0/2716398095 learned_addr learned my addr 172.21.15.7:0/2716398095 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:46.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.835+0000 7ff405d9b640 1 -- 172.21.15.7:0/3253183910 >> v2:172.21.15.7:3300/0 conn(0x7ff4080b36f0 msgr2=0x7ff4080b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:46.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.835+0000 7ff405d9b640 1 --2- 172.21.15.7:0/3253183910 >> v2:172.21.15.7:3300/0 conn(0x7ff4080b36f0 0x7ff4080b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.835+0000 7ff405d9b640 1 -- 172.21.15.7:0/3253183910 >> v1:172.21.15.7:6789/0 conn(0x7ff408153cc0 legacy=0x7ff40815a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:46.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.835+0000 7ff405d9b640 1 -- 172.21.15.7:0/3253183910 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4080cde00 con 0x7ff4080af9d0 2024-04-25T09:54:46.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.835+0000 7f2a24a25640 1 --2- 172.21.15.7:0/2716398095 >> v2:172.21.15.55:3300/0 conn(0x7f2a20071710 0x7f2a200b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.835+0000 7f2dad4a0640 1 -- 172.21.15.7:0/1240831486 shutdown_connections 2024-04-25T09:54:46.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.835+0000 7f2dad4a0640 1 --2- 172.21.15.7:0/1240831486 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2da806e980 0x7f2da8070f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.835+0000 7f2dad4a0640 1 --2- 172.21.15.7:0/1240831486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2da81652f0 0x7f2da80cc390 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.835+0000 7f2dad4a0640 1 -- 172.21.15.7:0/1240831486 >> 172.21.15.7:0/1240831486 conn(0x7f2da8066f20 msgr2=0x7f2da806ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:46.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.835+0000 7f5f32ffd640 1 --2- 172.21.15.7:0/3216890994 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f34071000 0x7f5f34071460 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5f28009870 tx=0x7f5f2802a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=934cc2ee5bf2c714 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.835+0000 7f2dad4a0640 1 -- 172.21.15.7:0/1240831486 shutdown_connections 2024-04-25T09:54:46.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.837+0000 7ff405d9b640 1 --2- 172.21.15.7:0/3253183910 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4080af9d0 0x7ff4080afe30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8009870 tx=0x7ff3f802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20b09579cf890673 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7fa1af7fe640 1 -- 172.21.15.7:0/1142197734 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4037070 con 0x7fa1a8053c70 2024-04-25T09:54:46.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7fa1af7fe640 1 -- 172.21.15.7:0/1142197734 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a4032440 con 0x7fa1a8053c70 2024-04-25T09:54:46.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.835+0000 7f2a1effd640 1 -- 172.21.15.7:0/2716398095 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 224462419 0 0) 0x7f2a200b47a0 con 0x7f2a2006f0f0 2024-04-25T09:54:46.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.835+0000 7f2a1effd640 1 -- 172.21.15.7:0/2716398095 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a08003520 con 0x7f2a2006f0f0 2024-04-25T09:54:46.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.835+0000 7f2a1effd640 1 -- 172.21.15.7:0/2716398095 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2079811760 0 0) 0x7f2a200b44c0 con 0x7f2a200b3740 2024-04-25T09:54:46.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.835+0000 7f2a1effd640 1 -- 172.21.15.7:0/2716398095 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a200b47a0 con 0x7f2a200b3740 2024-04-25T09:54:46.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.835+0000 7f2a1effd640 1 -- 172.21.15.7:0/2716398095 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3519280074 0 0) 0x7f2a200b47a0 con 0x7f2a200b3740 2024-04-25T09:54:46.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.835+0000 7f2a1effd640 1 -- 172.21.15.7:0/2716398095 >> v2:172.21.15.55:3300/0 conn(0x7f2a20071710 msgr2=0x7f2a200b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:46.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.835+0000 7f2a1effd640 1 --2- 172.21.15.7:0/2716398095 >> v2:172.21.15.55:3300/0 conn(0x7f2a20071710 0x7f2a200b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.835+0000 7f2a1effd640 1 -- 172.21.15.7:0/2716398095 >> v1:172.21.15.55:6789/0 conn(0x7f2a2006f0f0 legacy=0x7f2a20159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f2a1effd640 1 -- 172.21.15.7:0/2716398095 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a20159ca0 con 0x7f2a200b3740 2024-04-25T09:54:46.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f2a1effd640 1 -- 172.21.15.7:0/2716398095 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f2a180019f0 con 0x7f2a200b3740 2024-04-25T09:54:46.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f2a1effd640 1 -- 172.21.15.7:0/2716398095 >> v1:172.21.15.7:6789/0 conn(0x7f2a200b3740 legacy=0x7f2a20071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f2a1effd640 1 --2- 172.21.15.7:0/2716398095 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2a08003b40 0x7f2a08003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f2a1effd640 1 --2- 172.21.15.7:0/2716398095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a08004800 0x7f2a08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f2a1effd640 1 --2- 172.21.15.7:0/2716398095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a080051c0 0x7f2a0800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f2a1effd640 1 -- 172.21.15.7:0/2716398095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a200cd8a0 con 0x7f2a080051c0 2024-04-25T09:54:46.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f2a1effd640 1 -- 172.21.15.7:0/2716398095 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0800c0e0 con 0x7f2a08004800 2024-04-25T09:54:46.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f2a1effd640 1 -- 172.21.15.7:0/2716398095 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0800c2e0 con 0x7f2a08003b40 2024-04-25T09:54:46.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f2a1f7fe640 1 --2- 172.21.15.7:0/2716398095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a08004800 0x7f2a08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f4a51068640 1 --2- 172.21.15.7:0/2495779631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a4c0b16e0 0x7f4a4c0ccd00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4a440097a0 tx=0x7f4a4402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3940b57eab5da8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.835+0000 7f490c5d5640 1 -- 172.21.15.7:0/1808111814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49041426c0 msgr2=0x7f490406e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.835+0000 7f490c5d5640 1 --2- 172.21.15.7:0/1808111814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49041426c0 0x7f490406e640 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f490415d4d0 tx=0x7f48f402e540 comp rx=0 tx=0).stop 2024-04-25T09:54:46.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f490c5d5640 1 -- 172.21.15.7:0/1808111814 shutdown_connections 2024-04-25T09:54:46.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f490c5d5640 1 --2- 172.21.15.7:0/1808111814 >> v2:172.21.15.7:3300/0 conn(0x7f490415a9a0 0x7f49040ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f490c5d5640 1 --2- 172.21.15.7:0/1808111814 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f49040ced10 0x7f490415b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f490c5d5640 1 --2- 172.21.15.7:0/1808111814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49041426c0 0x7f490406e640 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f490c5d5640 1 -- 172.21.15.7:0/1808111814 >> 172.21.15.7:0/1808111814 conn(0x7f4904071150 msgr2=0x7f4904071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:46.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f490c5d5640 1 -- 172.21.15.7:0/1808111814 shutdown_connections 2024-04-25T09:54:46.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f490c5d5640 1 -- 172.21.15.7:0/1808111814 wait complete. 2024-04-25T09:54:46.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f8c2a009640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8c1c0e1090 0x7f8c1c038630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f8c2a009640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c1c050dd0 0x7f8c1c039ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f8c2a009640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8c1c03a400 0x7f8c1c0e4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f8c2a009640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c1c04f540 con 0x7f8c1c0e1090 2024-04-25T09:54:46.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f8c2a009640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c1c04f820 con 0x7f8c1c03a400 2024-04-25T09:54:46.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f8c2a009640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c04fb00 con 0x7f8c1c050dd0 2024-04-25T09:54:46.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f8c29808640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8c1c03a400 0x7f8c1c0e4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f8c29808640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8c1c03a400 0x7f8c1c0e4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:59386/0 (socket says 172.21.15.7:59386) 2024-04-25T09:54:46.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f8c29808640 1 -- 172.21.15.7:0/3558155382 learned_addr learned my addr 172.21.15.7:0/3558155382 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:46.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f8c28806640 1 --2- 172.21.15.7:0/3558155382 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c1c050dd0 0x7f8c1c039ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f8c29007640 1 --2- 172.21.15.7:0/3558155382 >> v2:172.21.15.7:3300/0 conn(0x7f8c1c0e1090 0x7f8c1c038630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.835+0000 7f5f327fc640 1 -- 172.21.15.7:0/3216890994 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f28037070 con 0x7f5f34071000 2024-04-25T09:54:46.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.835+0000 7f5f327fc640 1 -- 172.21.15.7:0/3216890994 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f28032440 con 0x7f5f34071000 2024-04-25T09:54:46.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.835+0000 7f5f327fc640 1 -- 172.21.15.7:0/3216890994 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f28032810 con 0x7f5f34071000 2024-04-25T09:54:46.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f5f38bd6640 1 -- 172.21.15.7:0/3216890994 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f34071000 msgr2=0x7f5f34071460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f5f38bd6640 1 --2- 172.21.15.7:0/3216890994 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f34071000 0x7f5f34071460 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5f28009870 tx=0x7f5f2802a250 comp rx=0 tx=0).stop 2024-04-25T09:54:46.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f8c29808640 1 -- 172.21.15.7:0/3558155382 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c1c050dd0 msgr2=0x7f8c1c039ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:46.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f8c29808640 1 --2- 172.21.15.7:0/3558155382 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c1c050dd0 0x7f8c1c039ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f8c29808640 1 -- 172.21.15.7:0/3558155382 >> v2:172.21.15.7:3300/0 conn(0x7f8c1c0e1090 msgr2=0x7f8c1c038630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:46.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f8c29808640 1 --2- 172.21.15.7:0/3558155382 >> v2:172.21.15.7:3300/0 conn(0x7f8c1c0e1090 0x7f8c1c038630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.836+0000 7f8c29808640 1 -- 172.21.15.7:0/3558155382 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c04fde0 con 0x7f8c1c03a400 2024-04-25T09:54:46.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.837+0000 7f2a1ffff640 1 --2- 172.21.15.7:0/2716398095 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2a08003b40 0x7f2a08003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.837+0000 7fa1af7fe640 1 -- 172.21.15.7:0/1142197734 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a40327f0 con 0x7fa1a8053c70 2024-04-25T09:54:46.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.837+0000 7fa1b5cbb640 1 -- 172.21.15.7:0/1142197734 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa1a8053c70 msgr2=0x7fa1a80defb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.837+0000 7f2a24a25640 1 --2- 172.21.15.7:0/2716398095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a080051c0 0x7f2a0800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.837+0000 7f4a50867640 1 -- 172.21.15.7:0/2495779631 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a44037070 con 0x7f4a4c0b16e0 2024-04-25T09:54:46.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.837+0000 7f4a50867640 1 -- 172.21.15.7:0/2495779631 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4402adc0 con 0x7f4a4c0b16e0 2024-04-25T09:54:46.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.837+0000 7f4a50867640 1 -- 172.21.15.7:0/2495779631 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a44032660 con 0x7f4a4c0b16e0 2024-04-25T09:54:46.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.837+0000 7fa1b5cbb640 1 --2- 172.21.15.7:0/1142197734 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa1a8053c70 0x7fa1a80defb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009870 tx=0x7fa1a402a230 comp rx=0 tx=0).stop 2024-04-25T09:54:46.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.837+0000 7fa1b5cbb640 1 -- 172.21.15.7:0/1142197734 shutdown_connections 2024-04-25T09:54:46.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.837+0000 7fa1b5cbb640 1 --2- 172.21.15.7:0/1142197734 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa1a8053c70 0x7fa1a80defb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.837+0000 7fa1b5cbb640 1 --2- 172.21.15.7:0/1142197734 >> v2:172.21.15.55:3300/0 conn(0x7fa1a800c0a0 0x7fa1a8038080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.837+0000 7fa1b5cbb640 1 -- 172.21.15.7:0/1142197734 >> 172.21.15.7:0/1142197734 conn(0x7fa1a8009fb0 msgr2=0x7fa1a800a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:46.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.837+0000 7f8c29808640 1 --2- 172.21.15.7:0/3558155382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c1c03a400 0x7f8c1c0e4a30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8c2404f440 tx=0x7f8c240a5160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8337a58ce7cf1240 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.837+0000 7f2a1ffff640 1 -- 172.21.15.7:0/2716398095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a08004800 msgr2=0x7f2a08004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:46.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.837+0000 7f2a1ffff640 1 --2- 172.21.15.7:0/2716398095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a08004800 0x7f2a08004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.837+0000 7f2a1ffff640 1 -- 172.21.15.7:0/2716398095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a080051c0 msgr2=0x7f2a0800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:46.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.837+0000 7f2a1ffff640 1 --2- 172.21.15.7:0/2716398095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a080051c0 0x7f2a0800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.837+0000 7f2a1ffff640 1 -- 172.21.15.7:0/2716398095 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a20159ca0 con 0x7f2a08003b40 2024-04-25T09:54:46.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.838+0000 7f2a24a25640 1 -- 172.21.15.7:0/2716398095 reap_dead start 2024-04-25T09:54:46.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.838+0000 7f8c1bfff640 1 -- 172.21.15.7:0/3558155382 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c240b2070 con 0x7f8c1c03a400 2024-04-25T09:54:46.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.838+0000 7f8c1bfff640 1 -- 172.21.15.7:0/3558155382 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c240ad440 con 0x7f8c1c03a400 2024-04-25T09:54:46.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.838+0000 7ff40559a640 1 -- 172.21.15.7:0/3253183910 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f8037070 con 0x7ff4080af9d0 2024-04-25T09:54:46.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.838+0000 7f8c1bfff640 1 -- 172.21.15.7:0/3558155382 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c240ad8b0 con 0x7f8c1c03a400 2024-04-25T09:54:46.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.838+0000 7ff40559a640 1 -- 172.21.15.7:0/3253183910 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f8032440 con 0x7ff4080af9d0 2024-04-25T09:54:46.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.835+0000 7f2dad4a0640 1 -- 172.21.15.7:0/1240831486 wait complete. 2024-04-25T09:54:46.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.837+0000 7f2dad4a0640 1 Processor -- start 2024-04-25T09:54:46.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.837+0000 7f2dad4a0640 1 -- start start 2024-04-25T09:54:46.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.837+0000 7fa1b5cbb640 1 -- 172.21.15.7:0/1142197734 shutdown_connections 2024-04-25T09:54:46.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.838+0000 7fa1b5cbb640 1 -- 172.21.15.7:0/1142197734 wait complete. 2024-04-25T09:54:46.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.838+0000 7f4a53acd640 1 -- 172.21.15.7:0/2495779631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a4c0b16e0 msgr2=0x7f4a4c0ccd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.838+0000 7f4a53acd640 1 --2- 172.21.15.7:0/2495779631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a4c0b16e0 0x7f4a4c0ccd00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4a440097a0 tx=0x7f4a4402a0b0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.838+0000 7f4a53acd640 1 -- 172.21.15.7:0/2495779631 shutdown_connections 2024-04-25T09:54:46.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.838+0000 7f4a53acd640 1 --2- 172.21.15.7:0/2495779631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a4c0b16e0 0x7f4a4c0ccd00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.838+0000 7f4a53acd640 1 -- 172.21.15.7:0/2495779631 >> 172.21.15.7:0/2495779631 conn(0x7f4a4c071150 msgr2=0x7f4a4c071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:46.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.838+0000 7f2dad4a0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2da806e980 0x7f2da8143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.838+0000 7f2dad4a0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2da80714d0 0x7f2da815cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.838+0000 7f2dad4a0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2da81652f0 0x7f2da8155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7f490c5d5640 1 Processor -- start 2024-04-25T09:54:46.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7f2a1ffff640 1 --2- 172.21.15.7:0/2716398095 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2a08003b40 0x7f2a08003f40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2a100019c0 tx=0x7f2a08005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31949d43e16ff7d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7f4a53acd640 1 -- 172.21.15.7:0/2495779631 shutdown_connections 2024-04-25T09:54:46.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7ff40559a640 1 -- 172.21.15.7:0/3253183910 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f8037070 con 0x7ff4080af9d0 2024-04-25T09:54:46.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7ff40cf34640 1 -- 172.21.15.7:0/3253183910 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4080af9d0 msgr2=0x7ff4080afe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7ff40cf34640 1 --2- 172.21.15.7:0/3253183910 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4080af9d0 0x7ff4080afe30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8009870 tx=0x7ff3f802a1a0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7f4a53acd640 1 -- 172.21.15.7:0/2495779631 wait complete. 2024-04-25T09:54:46.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7f490c5d5640 1 -- start start 2024-04-25T09:54:46.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7f2da7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2da806e980 0x7f2da8143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7f2dad4a0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da80cc8d0 con 0x7f2da81652f0 2024-04-25T09:54:46.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7f2dad4a0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da80cdb40 con 0x7f2da806e980 2024-04-25T09:54:46.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7f2dad4a0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da806e000 con 0x7f2da80714d0 2024-04-25T09:54:46.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7f2da7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2da806e980 0x7f2da8143ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:59398/0 (socket says 172.21.15.7:59398) 2024-04-25T09:54:46.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7f2da7fff640 1 -- 172.21.15.7:0/4226943522 learned_addr learned my addr 172.21.15.7:0/4226943522 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:46.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7f2dacc9f640 1 --2- 172.21.15.7:0/4226943522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2da81652f0 0x7f2da8155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7f5f38bd6640 1 -- 172.21.15.7:0/3216890994 shutdown_connections 2024-04-25T09:54:46.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7f5f38bd6640 1 --2- 172.21.15.7:0/3216890994 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f34071000 0x7f5f34071460 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7f5f38bd6640 1 --2- 172.21.15.7:0/3216890994 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5f34161c50 0x7f5f340b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7f5f38bd6640 1 -- 172.21.15.7:0/3216890994 >> 172.21.15.7:0/3216890994 conn(0x7f5f34066f50 msgr2=0x7f5f3406ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:46.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7f5f38bd6640 1 -- 172.21.15.7:0/3216890994 shutdown_connections 2024-04-25T09:54:46.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7f5f38bd6640 1 -- 172.21.15.7:0/3216890994 wait complete. 2024-04-25T09:54:46.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7ff40cf34640 1 -- 172.21.15.7:0/3253183910 shutdown_connections 2024-04-25T09:54:46.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7ff40cf34640 1 --2- 172.21.15.7:0/3253183910 >> v2:172.21.15.7:3300/0 conn(0x7ff4080b36f0 0x7ff4080b3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7ff40cf34640 1 --2- 172.21.15.7:0/3253183910 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4080af9d0 0x7ff4080afe30 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.840+0000 7ff40cf34640 1 -- 172.21.15.7:0/3253183910 >> 172.21.15.7:0/3253183910 conn(0x7ff408066d10 msgr2=0x7ff40806ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:46.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7f2da77fe640 1 --2- 172.21.15.7:0/4226943522 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2da80714d0 0x7f2da815cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7f8c2a009640 1 -- 172.21.15.7:0/3558155382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c1c03a400 msgr2=0x7f8c1c0e4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7f8c2a009640 1 --2- 172.21.15.7:0/3558155382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c1c03a400 0x7f8c1c0e4a30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8c2404f440 tx=0x7f8c240a5160 comp rx=0 tx=0).stop 2024-04-25T09:54:46.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7f8c2a009640 1 -- 172.21.15.7:0/3558155382 shutdown_connections 2024-04-25T09:54:46.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7f8c2a009640 1 --2- 172.21.15.7:0/3558155382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c1c03a400 0x7f8c1c0e4a30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7f8c2a009640 1 --2- 172.21.15.7:0/3558155382 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c1c050dd0 0x7f8c1c039ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7f8c2a009640 1 --2- 172.21.15.7:0/3558155382 >> v2:172.21.15.7:3300/0 conn(0x7f8c1c0e1090 0x7f8c1c038630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7f8c2a009640 1 -- 172.21.15.7:0/3558155382 >> 172.21.15.7:0/3558155382 conn(0x7f8c1c009fb0 msgr2=0x7f8c1c00a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:46.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7f2da7fff640 1 -- 172.21.15.7:0/4226943522 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2da80714d0 msgr2=0x7f2da815cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7f2da7fff640 1 --2- 172.21.15.7:0/4226943522 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2da80714d0 0x7f2da815cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7f2da7fff640 1 -- 172.21.15.7:0/4226943522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2da81652f0 msgr2=0x7f2da8155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7f2da7fff640 1 --2- 172.21.15.7:0/4226943522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2da81652f0 0x7f2da8155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.839+0000 7f2da7fff640 1 -- 172.21.15.7:0/4226943522 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da8159d80 con 0x7f2da806e980 2024-04-25T09:54:46.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.840+0000 7ff40cf34640 1 -- 172.21.15.7:0/3253183910 shutdown_connections 2024-04-25T09:54:46.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.840+0000 7ff40cf34640 1 -- 172.21.15.7:0/3253183910 wait complete. 2024-04-25T09:54:46.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.840+0000 7fa1b5cbb640 1 Processor -- start 2024-04-25T09:54:46.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.840+0000 7f490c5d5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49040ced10 0x7f490413d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.840+0000 7f490c5d5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f49041426c0 0x7f490415d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.840+0000 7fa1b5cbb640 1 -- start start 2024-04-25T09:54:46.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.840+0000 7f490a371640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49040ced10 0x7f490413d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.840+0000 7f490a371640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49040ced10 0x7f490413d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:59404/0 (socket says 172.21.15.7:59404) 2024-04-25T09:54:46.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.840+0000 7f490a371640 1 -- 172.21.15.7:0/2681099098 learned_addr learned my addr 172.21.15.7:0/2681099098 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:46.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.840+0000 7f490c5d5640 1 --2- 172.21.15.7:0/2681099098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f490415a9a0 0x7f490415d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.840+0000 7f4909b70640 1 --2- 172.21.15.7:0/2681099098 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f49041426c0 0x7f490415d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.840+0000 7f2a1effd640 1 -- 172.21.15.7:0/2716398095 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a10001610 con 0x7f2a08003b40 2024-04-25T09:54:46.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.840+0000 7f2a1effd640 1 -- 172.21.15.7:0/2716398095 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1002e070 con 0x7f2a08003b40 2024-04-25T09:54:46.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.840+0000 7f2a1effd640 1 -- 172.21.15.7:0/2716398095 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a100048a0 con 0x7f2a08003b40 2024-04-25T09:54:46.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.841+0000 7f8c2a009640 1 -- 172.21.15.7:0/3558155382 shutdown_connections 2024-04-25T09:54:46.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.841+0000 7f4a53acd640 1 Processor -- start 2024-04-25T09:54:46.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.841+0000 7f4a53acd640 1 -- start start 2024-04-25T09:54:46.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.841+0000 7f5f38bd6640 1 Processor -- start 2024-04-25T09:54:46.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.841+0000 7f5f38bd6640 1 -- start start 2024-04-25T09:54:46.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.842+0000 7f2a25226640 1 -- 172.21.15.7:0/2716398095 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2a08003b40 msgr2=0x7f2a08003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.842+0000 7f2a25226640 1 --2- 172.21.15.7:0/2716398095 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2a08003b40 0x7f2a08003f40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2a100019c0 tx=0x7f2a08005830 comp rx=0 tx=0).stop 2024-04-25T09:54:46.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.842+0000 7ff40cf34640 1 Processor -- start 2024-04-25T09:54:46.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.842+0000 7ff40cf34640 1 -- start start 2024-04-25T09:54:46.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.842+0000 7f4a53acd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a4c0b16e0 0x7f4a4c1f8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.840+0000 7f2da7fff640 1 --2- 172.21.15.7:0/4226943522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2da806e980 0x7f2da8143ba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c009870 tx=0x7f2d9c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.840+0000 7f2da4ff9640 1 -- 172.21.15.7:0/4226943522 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c041070 con 0x7f2da806e980 2024-04-25T09:54:46.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.840+0000 7f2dad4a0640 1 -- 172.21.15.7:0/4226943522 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da81597c0 con 0x7f2da806e980 2024-04-25T09:54:46.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.840+0000 7f2dad4a0640 1 -- 172.21.15.7:0/4226943522 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da8162ef0 con 0x7f2da806e980 2024-04-25T09:54:46.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.841+0000 7f2da4ff9640 1 -- 172.21.15.7:0/4226943522 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9c03c870 con 0x7f2da806e980 2024-04-25T09:54:46.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.841+0000 7f2da4ff9640 1 -- 172.21.15.7:0/4226943522 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c037040 con 0x7f2da806e980 2024-04-25T09:54:46.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.842+0000 7f4a53acd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4a4c0cd240 0x7f4a4c14ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.842+0000 7f4a53acd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a4c15c380 0x7f4a4c164440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.841+0000 7f490c5d5640 1 -- 172.21.15.7:0/2681099098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490415ae20 con 0x7f490415a9a0 2024-04-25T09:54:46.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.841+0000 7f490c5d5640 1 -- 172.21.15.7:0/2681099098 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49041433f0 con 0x7f49040ced10 2024-04-25T09:54:46.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.841+0000 7f490c5d5640 1 -- 172.21.15.7:0/2681099098 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490415afa0 con 0x7f49041426c0 2024-04-25T09:54:46.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.841+0000 7f490ab72640 1 --2- 172.21.15.7:0/2681099098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f490415a9a0 0x7f490415d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.842+0000 7f4a53acd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c1629c0 con 0x7f4a4c0b16e0 2024-04-25T09:54:46.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.842+0000 7f5f38bd6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f3406d060 0x7f5f341f2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.842+0000 7f4a53acd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c1658a0 con 0x7f4a4c15c380 2024-04-25T09:54:46.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.843+0000 7f2da4ff9640 1 -- 172.21.15.7:0/4226943522 <== mon.1 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2d9c044070 con 0x7f2da806e980 2024-04-25T09:54:46.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.843+0000 7f4a5206a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a4c15c380 0x7f4a4c164440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.843+0000 7f4a5206a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a4c15c380 0x7f4a4c164440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:59408/0 (socket says 172.21.15.7:59408) 2024-04-25T09:54:46.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.843+0000 7f4a5206a640 1 -- 172.21.15.7:0/1928220406 learned_addr learned my addr 172.21.15.7:0/1928220406 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:46.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.843+0000 7f4a53acd640 1 -- 172.21.15.7:0/1928220406 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c162b40 con 0x7f4a4c0cd240 2024-04-25T09:54:46.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.842+0000 7f490a371640 1 -- 172.21.15.7:0/2681099098 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f49041426c0 msgr2=0x7f490415d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.842+0000 7f490a371640 1 --2- 172.21.15.7:0/2681099098 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f49041426c0 0x7f490415d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.843+0000 7f490a371640 1 -- 172.21.15.7:0/2681099098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f490415a9a0 msgr2=0x7f490415d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.843+0000 7f5f38bd6640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5f34071000 0x7f5f340cd660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.843+0000 7f5f337fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f3406d060 0x7f5f341f2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.843+0000 7f5f337fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f3406d060 0x7f5f341f2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42960/0 (socket says 172.21.15.7:42960) 2024-04-25T09:54:46.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.843+0000 7f5f337fe640 1 -- 172.21.15.7:0/2014250479 learned_addr learned my addr 172.21.15.7:0/2014250479 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:46.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.843+0000 7f490a371640 1 --2- 172.21.15.7:0/2681099098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f490415a9a0 0x7f490415d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.843+0000 7f490a371640 1 -- 172.21.15.7:0/2681099098 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49040c6000 con 0x7f49040ced10 2024-04-25T09:54:46.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.843+0000 7f5f38bd6640 1 --2- 172.21.15.7:0/2014250479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f34161c50 0x7f5f341645a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.843+0000 7f5f32ffd640 1 --2- 172.21.15.7:0/2014250479 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5f34071000 0x7f5f340cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.843+0000 7f490ab72640 1 --2- 172.21.15.7:0/2681099098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f490415a9a0 0x7f490415d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:46.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.843+0000 7f5f38bd6640 1 -- 172.21.15.7:0/2014250479 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3406e050 con 0x7f5f3406d060 2024-04-25T09:54:46.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.843+0000 7f5f38bd6640 1 -- 172.21.15.7:0/2014250479 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f34162030 con 0x7f5f34161c50 2024-04-25T09:54:46.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.843+0000 7f5f38bd6640 1 -- 172.21.15.7:0/2014250479 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f340b4800 con 0x7f5f34071000 2024-04-25T09:54:46.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.843+0000 7fa1b5cbb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1a800c0a0 0x7fa1a804bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.843+0000 7f4a5206a640 1 -- 172.21.15.7:0/1928220406 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4a4c0cd240 msgr2=0x7f4a4c14ee60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T09:54:46.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.843+0000 7f4a5206a640 1 --2- 172.21.15.7:0/1928220406 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4a4c0cd240 0x7f4a4c14ee60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.843+0000 7f4a5206a640 1 -- 172.21.15.7:0/1928220406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a4c0b16e0 msgr2=0x7f4a4c1f8370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T09:54:46.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.841+0000 7f8c2a009640 1 -- 172.21.15.7:0/3558155382 wait complete. 2024-04-25T09:54:46.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.843+0000 7f5f33fff640 1 --2- 172.21.15.7:0/2014250479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f34161c50 0x7f5f341645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.843+0000 7fa1b5cbb640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa1a8053c70 0x7fa1a80485f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.843+0000 7f2a25226640 1 -- 172.21.15.7:0/2716398095 shutdown_connections 2024-04-25T09:54:46.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.843+0000 7f2a25226640 1 --2- 172.21.15.7:0/2716398095 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2a08003b40 0x7f2a08003f40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.843+0000 7f2a25226640 1 -- 172.21.15.7:0/2716398095 >> 172.21.15.7:0/2716398095 conn(0x7f2a20066f50 msgr2=0x7f2a2006ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:46.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.843+0000 7fa1b4cb9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1a800c0a0 0x7fa1a804bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.843+0000 7f490a371640 1 --2- 172.21.15.7:0/2681099098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49040ced10 0x7f490413d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f48f402eb30 tx=0x7f48f40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7fa1b4cb9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1a800c0a0 0x7fa1a804bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42980/0 (socket says 172.21.15.7:42980) 2024-04-25T09:54:46.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7f8c2a009640 1 Processor -- start 2024-04-25T09:54:46.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7f48faffd640 1 -- 172.21.15.7:0/2681099098 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f4045070 con 0x7f49040ced10 2024-04-25T09:54:46.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7ff40cf34640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4080af9d0 0x7ff4080ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7f8c2a009640 1 -- start start 2024-04-25T09:54:46.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7f490c5d5640 1 -- 172.21.15.7:0/2681099098 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49040c62e0 con 0x7f49040ced10 2024-04-25T09:54:46.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7f48faffd640 1 -- 172.21.15.7:0/2681099098 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f4013460 con 0x7f49040ced10 2024-04-25T09:54:46.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7ff40cf34640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4080b36f0 0x7ff4081f51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7f48faffd640 1 -- 172.21.15.7:0/2681099098 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f403a040 con 0x7f49040ced10 2024-04-25T09:54:46.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7ff40cf34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff408153cc0 0x7ff408144080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7f2a25226640 1 -- 172.21.15.7:0/2716398095 shutdown_connections 2024-04-25T09:54:46.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7f490c5d5640 1 -- 172.21.15.7:0/2681099098 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f490413d6d0 con 0x7f49040ced10 2024-04-25T09:54:46.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7f5f337fe640 1 -- 172.21.15.7:0/2014250479 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5f34071000 msgr2=0x7f5f340cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7f5f337fe640 1 --2- 172.21.15.7:0/2014250479 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5f34071000 0x7f5f340cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7f5f337fe640 1 -- 172.21.15.7:0/2014250479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f34161c50 msgr2=0x7f5f341645a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7f5f337fe640 1 --2- 172.21.15.7:0/2014250479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f34161c50 0x7f5f341645a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7f5f337fe640 1 -- 172.21.15.7:0/2014250479 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f34156960 con 0x7f5f3406d060 2024-04-25T09:54:46.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7ff40cf34640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4080cd780 con 0x7ff4080af9d0 2024-04-25T09:54:46.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7ff40659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4080af9d0 0x7ff4080ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7ff40659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4080af9d0 0x7ff4080ad1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42996/0 (socket says 172.21.15.7:42996) 2024-04-25T09:54:46.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7ff40659c640 1 -- 172.21.15.7:0/4136305271 learned_addr learned my addr 172.21.15.7:0/4136305271 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:46.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7ff40cf34640 1 -- 172.21.15.7:0/4136305271 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4080ce3c0 con 0x7ff408153cc0 2024-04-25T09:54:46.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7ff40cf34640 1 -- 172.21.15.7:0/4136305271 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4080cd900 con 0x7ff4080b36f0 2024-04-25T09:54:46.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.845+0000 7ff405d9b640 1 --2- 172.21.15.7:0/4136305271 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4080b36f0 0x7ff4081f51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.845+0000 7f5f337fe640 1 --2- 172.21.15.7:0/2014250479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f3406d060 0x7f5f341f2f80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5f2401f5a0 tx=0x7f5f2401fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.843+0000 7f2d8e7fc640 1 -- 172.21.15.7:0/4226943522 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2da8162d40 con 0x7f2da806e980 2024-04-25T09:54:46.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7f2da4ff9640 1 --2- 172.21.15.7:0/4226943522 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d9406b5a0 0x7f2d9406da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7f2da77fe640 1 --2- 172.21.15.7:0/4226943522 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d9406b5a0 0x7f2d9406da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.845+0000 7f2da77fe640 1 --2- 172.21.15.7:0/4226943522 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d9406b5a0 0x7f2d9406da60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2da815a150 tx=0x7f2d98009110 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.845+0000 7f2da4ff9640 1 -- 172.21.15.7:0/4226943522 <== mon.1 v2:172.21.15.55:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2d9c0aaf80 con 0x7f2da806e980 2024-04-25T09:54:46.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.845+0000 7f8c2a009640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c1c03a400 0x7f8c1c1853d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7fa1b5cbb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1a80df4f0 0x7fa1a817a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7fa1affff640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa1a8053c70 0x7fa1a80485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7fa1affff640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa1a8053c70 0x7fa1a80485f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:44074/0 (socket says 172.21.15.7:44074) 2024-04-25T09:54:46.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7fa1affff640 1 -- 172.21.15.7:0/544287541 learned_addr learned my addr 172.21.15.7:0/544287541 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:46.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7fa1b5cbb640 1 -- 172.21.15.7:0/544287541 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a8050320 con 0x7fa1a800c0a0 2024-04-25T09:54:46.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7fa1b5cbb640 1 -- 172.21.15.7:0/544287541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a80501a0 con 0x7fa1a80df4f0 2024-04-25T09:54:46.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7fa1b5cbb640 1 -- 172.21.15.7:0/544287541 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a8033ef0 con 0x7fa1a8053c70 2024-04-25T09:54:46.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.844+0000 7fa1b54ba640 1 --2- 172.21.15.7:0/544287541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1a80df4f0 0x7fa1a817a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.845+0000 7fa1b54ba640 1 -- 172.21.15.7:0/544287541 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa1a8053c70 msgr2=0x7fa1a80485f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.845+0000 7fa1b54ba640 1 --2- 172.21.15.7:0/544287541 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa1a8053c70 0x7fa1a80485f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.845+0000 7fa1b54ba640 1 -- 172.21.15.7:0/544287541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1a800c0a0 msgr2=0x7fa1a804bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.845+0000 7fa1b54ba640 1 --2- 172.21.15.7:0/544287541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1a800c0a0 0x7fa1a804bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.845+0000 7fa1b54ba640 1 -- 172.21.15.7:0/544287541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a80e3da0 con 0x7fa1a80df4f0 2024-04-25T09:54:46.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.845+0000 7fa1b4cb9640 1 --2- 172.21.15.7:0/544287541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1a800c0a0 0x7fa1a804bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-04-25T09:54:46.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.845+0000 7fa1b54ba640 1 --2- 172.21.15.7:0/544287541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1a80df4f0 0x7fa1a817a690 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa1b00734b0 tx=0x7fa1b0068680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.845+0000 7f4a51869640 1 --2- 172.21.15.7:0/1928220406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a4c0b16e0 0x7f4a4c1f8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.845+0000 7f2da4ff9640 1 --2- 172.21.15.7:0/4226943522 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x7f2d94074c10 0x7f2d94077050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.845+0000 7f2da4ff9640 1 -- 172.21.15.7:0/4226943522 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2d9c00af30 con 0x7f2d94074c10 2024-04-25T09:54:46.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.846+0000 7f490c5d5640 1 -- 172.21.15.7:0/2681099098 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f49040c69a0 con 0x7f49040ced10 2024-04-25T09:54:46.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.846+0000 7f2da4ff9640 1 -- 172.21.15.7:0/4226943522 <== mon.1 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d9c04b020 con 0x7f2da806e980 2024-04-25T09:54:46.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.846+0000 7fa1ad7fa640 1 -- 172.21.15.7:0/544287541 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0073b40 con 0x7fa1a80df4f0 2024-04-25T09:54:46.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.846+0000 7f4a5206a640 1 --2- 172.21.15.7:0/1928220406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a4c0b16e0 0x7f4a4c1f8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.846+0000 7f4a5206a640 1 -- 172.21.15.7:0/1928220406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4c14f3a0 con 0x7f4a4c15c380 2024-04-25T09:54:46.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.846+0000 7f2dacc9f640 1 --2- 172.21.15.7:0/4226943522 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x7f2d94074c10 0x7f2d94077050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.846+0000 7ff406d9d640 1 --2- 172.21.15.7:0/4136305271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff408153cc0 0x7ff408144080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.846+0000 7ff405d9b640 1 -- 172.21.15.7:0/4136305271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff408153cc0 msgr2=0x7ff408144080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.846+0000 7ff405d9b640 1 --2- 172.21.15.7:0/4136305271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff408153cc0 0x7ff408144080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.845+0000 7f5f1bfff640 1 -- 172.21.15.7:0/2014250479 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f24028070 con 0x7f5f3406d060 2024-04-25T09:54:46.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.845+0000 7f5f1bfff640 1 -- 172.21.15.7:0/2014250479 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f24024890 con 0x7f5f3406d060 2024-04-25T09:54:46.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.845+0000 7f5f1bfff640 1 -- 172.21.15.7:0/2014250479 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f24024c80 con 0x7f5f3406d060 2024-04-25T09:54:46.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.846+0000 7ff405d9b640 1 -- 172.21.15.7:0/4136305271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4080af9d0 msgr2=0x7ff4080ad1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.846+0000 7ff405d9b640 1 --2- 172.21.15.7:0/4136305271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4080af9d0 0x7ff4080ad1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.846+0000 7fa1b5cbb640 1 -- 172.21.15.7:0/544287541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a80cffc0 con 0x7fa1a80df4f0 2024-04-25T09:54:46.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.846+0000 7fa1b5cbb640 1 -- 172.21.15.7:0/544287541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a804c0d0 con 0x7fa1a80df4f0 2024-04-25T09:54:46.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.846+0000 7f5f38bd6640 1 -- 172.21.15.7:0/2014250479 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f34156c40 con 0x7f5f3406d060 2024-04-25T09:54:46.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.846+0000 7fa1ad7fa640 1 -- 172.21.15.7:0/544287541 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b0073ce0 con 0x7fa1a80df4f0 2024-04-25T09:54:46.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.846+0000 7ff405d9b640 1 -- 172.21.15.7:0/4136305271 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4081f5730 con 0x7ff4080b36f0 2024-04-25T09:54:46.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.846+0000 7f5f38bd6640 1 -- 172.21.15.7:0/2014250479 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f34163da0 con 0x7f5f3406d060 2024-04-25T09:54:46.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.846+0000 7ff406d9d640 1 --2- 172.21.15.7:0/4136305271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff408153cc0 0x7ff408144080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:46.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.846+0000 7ff40659c640 1 --2- 172.21.15.7:0/4136305271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4080af9d0 0x7ff4080ad1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:46.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.846+0000 7f8c2a009640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c1c050dd0 0x7f8c1c0e3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.846+0000 7f8c2a009640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c1c0e1090 0x7f8c1c0e38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.846+0000 7f8c2a009640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c03a870 con 0x7f8c1c0e1090 2024-04-25T09:54:46.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.846+0000 7f8c2a009640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c0503a0 con 0x7f8c1c03a400 2024-04-25T09:54:46.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.846+0000 7f8c2a009640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c0e4f70 con 0x7f8c1c050dd0 2024-04-25T09:54:46.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.846+0000 7f4a5206a640 1 --2- 172.21.15.7:0/1928220406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a4c15c380 0x7f4a4c164440 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4a4800c7d0 tx=0x7f4a4800cc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.845+0000 7f2a25226640 1 -- 172.21.15.7:0/2716398095 wait complete. 2024-04-25T09:54:46.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.846+0000 7f4a427fc640 1 -- 172.21.15.7:0/1928220406 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a48018070 con 0x7f4a4c15c380 2024-04-25T09:54:46.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.846+0000 7f8c29007640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c1c03a400 0x7f8c1c1853d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.847+0000 7ff405d9b640 1 --2- 172.21.15.7:0/4136305271 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4080b36f0 0x7ff4081f51f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff4080b49f0 tx=0x7ff3f80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.846+0000 7f8c28806640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c1c050dd0 0x7f8c1c0e3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.847+0000 7f8c29007640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c1c03a400 0x7f8c1c1853d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:59438/0 (socket says 172.21.15.7:59438) 2024-04-25T09:54:46.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.847+0000 7f8c29007640 1 -- 172.21.15.7:0/906261729 learned_addr learned my addr 172.21.15.7:0/906261729 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:46.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.847+0000 7fa1ad7fa640 1 -- 172.21.15.7:0/544287541 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0092640 con 0x7fa1a80df4f0 2024-04-25T09:54:46.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.847+0000 7f2dacc9f640 1 --2- 172.21.15.7:0/4226943522 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x7f2d94074c10 0x7f2d94077050 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.847+0000 7ff3f6ffd640 1 -- 172.21.15.7:0/4136305271 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f8041030 con 0x7ff4080b36f0 2024-04-25T09:54:46.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.847+0000 7ff3f6ffd640 1 -- 172.21.15.7:0/4136305271 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f8003d40 con 0x7ff4080b36f0 2024-04-25T09:54:46.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.847+0000 7ff40cf34640 1 -- 172.21.15.7:0/4136305271 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4080ad880 con 0x7ff4080b36f0 2024-04-25T09:54:46.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.847+0000 7f8c28806640 1 -- 172.21.15.7:0/906261729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c1c03a400 msgr2=0x7f8c1c1853d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.847+0000 7f8c28806640 1 --2- 172.21.15.7:0/906261729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c1c03a400 0x7f8c1c1853d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.847+0000 7f8c28806640 1 -- 172.21.15.7:0/906261729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c1c0e1090 msgr2=0x7f8c1c0e38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.847+0000 7f8c28806640 1 --2- 172.21.15.7:0/906261729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c1c0e1090 0x7f8c1c0e38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.847+0000 7f8c28806640 1 -- 172.21.15.7:0/906261729 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c04c200 con 0x7f8c1c050dd0 2024-04-25T09:54:46.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.847+0000 7ff3f6ffd640 1 -- 172.21.15.7:0/4136305271 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f8041030 con 0x7ff4080b36f0 2024-04-25T09:54:46.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.847+0000 7ff40cf34640 1 -- 172.21.15.7:0/4136305271 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4080ade40 con 0x7ff4080b36f0 2024-04-25T09:54:46.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.847+0000 7f8c28806640 1 --2- 172.21.15.7:0/906261729 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c1c050dd0 0x7f8c1c0e3380 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8c1400e870 tx=0x7f8c1400ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.847+0000 7f4a53acd640 1 -- 172.21.15.7:0/1928220406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a4c1fb040 con 0x7f4a4c15c380 2024-04-25T09:54:46.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.847+0000 7f4a53acd640 1 -- 172.21.15.7:0/1928220406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a4c1fb600 con 0x7f4a4c15c380 2024-04-25T09:54:46.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.848+0000 7f4a427fc640 1 -- 172.21.15.7:0/1928220406 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4800a640 con 0x7f4a4c15c380 2024-04-25T09:54:46.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.848+0000 7f2a25226640 1 Processor -- start 2024-04-25T09:54:46.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.848+0000 7f8c19ffb640 1 -- 172.21.15.7:0/906261729 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c14017070 con 0x7f8c1c050dd0 2024-04-25T09:54:46.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.848+0000 7f8c19ffb640 1 -- 172.21.15.7:0/906261729 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1400c940 con 0x7f8c1c050dd0 2024-04-25T09:54:46.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.848+0000 7f8c2a009640 1 -- 172.21.15.7:0/906261729 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c1c0e2410 con 0x7f8c1c050dd0 2024-04-25T09:54:46.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.848+0000 7f2a25226640 1 -- start start 2024-04-25T09:54:46.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.848+0000 7fa1ad7fa640 1 -- 172.21.15.7:0/544287541 <== mon.1 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa1b00927e0 con 0x7fa1a80df4f0 2024-04-25T09:54:46.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.848+0000 7f8c19ffb640 1 -- 172.21.15.7:0/906261729 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1400ccf0 con 0x7f8c1c050dd0 2024-04-25T09:54:46.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.848+0000 7f8c2a009640 1 -- 172.21.15.7:0/906261729 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1c0e29d0 con 0x7f8c1c050dd0 2024-04-25T09:54:46.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.849+0000 7fa1ad7fa640 1 --2- 172.21.15.7:0/544287541 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa19406b550 0x7fa19406da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.849+0000 7f2a25226640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a08003b40 0x7f2a20150090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.848+0000 7f4a53acd640 1 -- 172.21.15.7:0/1928220406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4a4c068fd0 con 0x7f4a4c15c380 2024-04-25T09:54:46.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.849+0000 7f2a25226640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2a20151d80 0x7f2a20150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.849+0000 7f2a25226640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a20146cd0 0x7f2a2006d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.850+0000 7fa1ad7fa640 1 -- 172.21.15.7:0/544287541 <== mon.1 v2:172.21.15.55:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa1b0104960 con 0x7fa1a80df4f0 2024-04-25T09:54:46.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.850+0000 7f2a1ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a08003b40 0x7f2a20150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.850+0000 7f2a1ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a08003b40 0x7f2a20150090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43008/0 (socket says 172.21.15.7:43008) 2024-04-25T09:54:46.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.849+0000 7f5f1bfff640 1 -- 172.21.15.7:0/2014250479 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5f2402b070 con 0x7f5f3406d060 2024-04-25T09:54:46.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.850+0000 7f4a427fc640 1 -- 172.21.15.7:0/1928220406 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4800aa70 con 0x7f4a4c15c380 2024-04-25T09:54:46.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.850+0000 7fa1b4cb9640 1 --2- 172.21.15.7:0/544287541 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa19406b550 0x7fa19406da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.849+0000 7ff3f6ffd640 1 -- 172.21.15.7:0/4136305271 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff3f8044070 con 0x7ff4080b36f0 2024-04-25T09:54:46.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.850+0000 7ff3f6ffd640 1 --2- 172.21.15.7:0/4136305271 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff3e806b6d0 0x7ff3e806db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.850+0000 7f2a1f7fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2a20151d80 0x7f2a20150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.850+0000 7f2da4ff9640 1 -- 172.21.15.7:0/4226943522 <== osd.5 v2:172.21.15.55:6800/2514169616 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2d9c00af30 con 0x7f2d94074c10 2024-04-25T09:54:46.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.850+0000 7f8c0f7fe640 1 -- 172.21.15.7:0/906261729 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8c1c0052c0 con 0x7f8c1c050dd0 2024-04-25T09:54:46.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.850+0000 7ff3f6ffd640 1 -- 172.21.15.7:0/4136305271 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff3f80aa680 con 0x7ff4080b36f0 2024-04-25T09:54:46.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.851+0000 7f2a1f7fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2a20151d80 0x7f2a20150610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:44104/0 (socket says 172.21.15.7:44104) 2024-04-25T09:54:46.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.850+0000 7f8c19ffb640 1 -- 172.21.15.7:0/906261729 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8c1401a070 con 0x7f8c1c050dd0 2024-04-25T09:54:46.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.851+0000 7f2a24a25640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a20146cd0 0x7f2a2006d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.851+0000 7f4a427fc640 1 -- 172.21.15.7:0/1928220406 <== mon.1 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4a4801b070 con 0x7f4a4c15c380 2024-04-25T09:54:46.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.851+0000 7f2a1ffff640 1 -- 172.21.15.7:0/1011015835 learned_addr learned my addr 172.21.15.7:0/1011015835 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:46.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.851+0000 7ff40659c640 1 --2- 172.21.15.7:0/4136305271 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff3e806b6d0 0x7ff3e806db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.851+0000 7f2a25226640 1 -- 172.21.15.7:0/1011015835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a200b3ba0 con 0x7f2a08003b40 2024-04-25T09:54:46.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.851+0000 7f2a25226640 1 -- 172.21.15.7:0/1011015835 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2006e500 con 0x7f2a20146cd0 2024-04-25T09:54:46.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.851+0000 7f2a25226640 1 -- 172.21.15.7:0/1011015835 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a200b3d20 con 0x7f2a20151d80 2024-04-25T09:54:46.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.850+0000 7f5f1bfff640 1 --2- 172.21.15.7:0/2014250479 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5f2006b5d0 0x7f5f2006da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.850+0000 7f5f1bfff640 1 -- 172.21.15.7:0/2014250479 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f5f2409b240 con 0x7f5f3406d060 2024-04-25T09:54:46.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.851+0000 7f5f32ffd640 1 --2- 172.21.15.7:0/2014250479 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5f2006b5d0 0x7f5f2006da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.851+0000 7f4a427fc640 1 --2- 172.21.15.7:0/1928220406 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4a3006b5a0 0x7f4a3006da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.851+0000 7f5f38bd6640 1 --2- 172.21.15.7:0/2014250479 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x7f5f34150bd0 0x7f5f341621b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.852+0000 7f5f38bd6640 1 -- 172.21.15.7:0/2014250479 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5f34157160 con 0x7f5f34150bd0 2024-04-25T09:54:46.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.851+0000 7f8c19ffb640 1 --2- 172.21.15.7:0/906261729 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8c0806b5a0 0x7f8c0806da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.852+0000 7ff40659c640 1 --2- 172.21.15.7:0/4136305271 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff3e806b6d0 0x7ff3e806db90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc0099f0 tx=0x7ff3fc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.852+0000 7f4a51869640 1 --2- 172.21.15.7:0/1928220406 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4a3006b5a0 0x7f4a3006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.852+0000 7f4a427fc640 1 -- 172.21.15.7:0/1928220406 <== mon.1 v2:172.21.15.55:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f4a4808a3c0 con 0x7f4a4c15c380 2024-04-25T09:54:46.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.852+0000 7f4a427fc640 1 --2- 172.21.15.7:0/1928220406 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x7f4a30074d20 0x7f4a30077160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.852+0000 7f4a427fc640 1 -- 172.21.15.7:0/1928220406 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4a4800a640 con 0x7f4a30074d20 2024-04-25T09:54:46.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.852+0000 7f4a427fc640 1 -- 172.21.15.7:0/1928220406 <== mon.1 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a4808a7b0 con 0x7f4a4c15c380 2024-04-25T09:54:46.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.852+0000 7f8c29007640 1 --2- 172.21.15.7:0/906261729 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8c0806b5a0 0x7f8c0806da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.852+0000 7fa1b4cb9640 1 --2- 172.21.15.7:0/544287541 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa19406b550 0x7fa19406da10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa19c006fd0 tx=0x7fa19c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.852+0000 7f8c19ffb640 1 -- 172.21.15.7:0/906261729 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8c1408a3d0 con 0x7f8c1c050dd0 2024-04-25T09:54:46.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.852+0000 7f2a1f7fe640 1 -- 172.21.15.7:0/1011015835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a20146cd0 msgr2=0x7f2a2006d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.852+0000 7f2a1f7fe640 1 --2- 172.21.15.7:0/1011015835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a20146cd0 0x7f2a2006d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.852+0000 7f2a1f7fe640 1 -- 172.21.15.7:0/1011015835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a08003b40 msgr2=0x7f2a20150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.852+0000 7f2a1f7fe640 1 --2- 172.21.15.7:0/1011015835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a08003b40 0x7f2a20150090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.852+0000 7f2a1f7fe640 1 -- 172.21.15.7:0/1011015835 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2014fe80 con 0x7f2a20151d80 2024-04-25T09:54:46.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.852+0000 7f8c19ffb640 1 --2- 172.21.15.7:0/906261729 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x7f8c08074c90 0x7f8c080770d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.852+0000 7f8c19ffb640 1 -- 172.21.15.7:0/906261729 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8c14020e50 con 0x7f8c08074c90 2024-04-25T09:54:46.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.852+0000 7f8c19ffb640 1 -- 172.21.15.7:0/906261729 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c14091050 con 0x7f8c1c050dd0 2024-04-25T09:54:46.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.852+0000 7f2a1f7fe640 1 --2- 172.21.15.7:0/1011015835 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2a20151d80 0x7f2a20150610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2a20075960 tx=0x7f2a1800ef80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.852+0000 7f48faffd640 1 -- 172.21.15.7:0/2681099098 <== mon.1 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f48f4048070 con 0x7f49040ced10 2024-04-25T09:54:46.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.852+0000 7f5f33fff640 1 --2- 172.21.15.7:0/2014250479 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x7f5f34150bd0 0x7f5f341621b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.853+0000 7f8c29808640 1 --2- 172.21.15.7:0/906261729 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x7f8c08074c90 0x7f8c080770d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.853+0000 7f4a51068640 1 --2- 172.21.15.7:0/1928220406 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x7f4a30074d20 0x7f4a30077160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.853+0000 7f48faffd640 1 --2- 172.21.15.7:0/2681099098 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f48e806b5a0 0x7f48e806da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.853+0000 7f48faffd640 1 -- 172.21.15.7:0/2681099098 <== mon.1 v2:172.21.15.55:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f48f40aae00 con 0x7f49040ced10 2024-04-25T09:54:46.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.853+0000 7f5f33fff640 1 --2- 172.21.15.7:0/2014250479 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x7f5f34150bd0 0x7f5f341621b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.853+0000 7f4a51869640 1 --2- 172.21.15.7:0/1928220406 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4a3006b5a0 0x7f4a3006da60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c00a730 tx=0x7f4a3c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.853+0000 7f48faffd640 1 --2- 172.21.15.7:0/2681099098 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x7f48e8074ca0 0x7f48e80770e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.853+0000 7f8c29808640 1 --2- 172.21.15.7:0/906261729 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x7f8c08074c90 0x7f8c080770d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.853+0000 7f5f32ffd640 1 --2- 172.21.15.7:0/2014250479 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5f2006b5d0 0x7f5f2006da90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5f28034000 tx=0x7f5f2802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.853+0000 7f4a51068640 1 --2- 172.21.15.7:0/1928220406 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x7f4a30074d20 0x7f4a30077160 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.853+0000 7f4909b70640 1 --2- 172.21.15.7:0/2681099098 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f48e806b5a0 0x7f48e806da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.853+0000 7f48faffd640 1 -- 172.21.15.7:0/2681099098 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f48f403ee50 con 0x7f48e8074ca0 2024-04-25T09:54:46.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.853+0000 7f48faffd640 1 -- 172.21.15.7:0/2681099098 <== mon.1 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f48f40754c0 con 0x7f49040ced10 2024-04-25T09:54:46.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.854+0000 7f4909b70640 1 --2- 172.21.15.7:0/2681099098 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f48e806b5a0 0x7f48e806da60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f490415cd70 tx=0x7f4900013040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.854+0000 7f8c29007640 1 --2- 172.21.15.7:0/906261729 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8c0806b5a0 0x7f8c0806da60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8c20007a60 tx=0x7f8c20008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.854+0000 7f2a1cff9640 1 -- 172.21.15.7:0/1011015835 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a18003b80 con 0x7f2a20151d80 2024-04-25T09:54:46.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.854+0000 7f490ab72640 1 --2- 172.21.15.7:0/2681099098 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x7f48e8074ca0 0x7f48e80770e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.854+0000 7f2a1cff9640 1 -- 172.21.15.7:0/1011015835 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a18018070 con 0x7f2a20151d80 2024-04-25T09:54:46.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.854+0000 7f2a25226640 1 -- 172.21.15.7:0/1011015835 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a20150ce0 con 0x7f2a20151d80 2024-04-25T09:54:46.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.854+0000 7f2a25226640 1 -- 172.21.15.7:0/1011015835 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a201512a0 con 0x7f2a20151d80 2024-04-25T09:54:46.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.854+0000 7fa1b5cbb640 1 --2- 172.21.15.7:0/544287541 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x7fa190001650 0x7fa190003b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.854+0000 7fa1b5cbb640 1 -- 172.21.15.7:0/544287541 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa190006bb0 con 0x7fa190001650 2024-04-25T09:54:46.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.854+0000 7f8c19ffb640 1 -- 172.21.15.7:0/906261729 <== osd.6 v2:172.21.15.55:6824/4293769515 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f8c14020e50 con 0x7f8c08074c90 2024-04-25T09:54:46.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.854+0000 7f5f1bfff640 1 -- 172.21.15.7:0/2014250479 <== osd.7 v2:172.21.15.55:6816/2960381217 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5f34157160 con 0x7f5f34150bd0 2024-04-25T09:54:46.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.855+0000 7f4a427fc640 1 -- 172.21.15.7:0/1928220406 <== osd.3 v2:172.21.15.7:6824/3045538953 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4a4800a640 con 0x7f4a30074d20 2024-04-25T09:54:46.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.854+0000 7ff40cf34640 1 --2- 172.21.15.7:0/4136305271 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x7ff4080ab130 0x7ff4080ab510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.855+0000 7ff406d9d640 1 --2- 172.21.15.7:0/4136305271 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x7ff4080ab130 0x7ff4080ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.855+0000 7ff40cf34640 1 -- 172.21.15.7:0/4136305271 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff408068f60 con 0x7ff4080ab130 2024-04-25T09:54:46.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.855+0000 7f2a1cff9640 1 -- 172.21.15.7:0/1011015835 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1800c7b0 con 0x7f2a20151d80 2024-04-25T09:54:46.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.856+0000 7f2a1cff9640 1 -- 172.21.15.7:0/1011015835 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2a1800c990 con 0x7f2a20151d80 2024-04-25T09:54:46.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.855+0000 7ff406d9d640 1 --2- 172.21.15.7:0/4136305271 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x7ff4080ab130 0x7ff4080ab510 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.857+0000 7ff3f6ffd640 1 -- 172.21.15.7:0/4136305271 <== osd.0 v2:172.21.15.7:6800/4167741236 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff408068f60 con 0x7ff4080ab130 2024-04-25T09:54:46.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.857+0000 7f490ab72640 1 --2- 172.21.15.7:0/2681099098 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x7f48e8074ca0 0x7f48e80770e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.857+0000 7fa1affff640 1 --2- 172.21.15.7:0/544287541 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x7fa190001650 0x7fa190003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.857+0000 7f2a1cff9640 1 --2- 172.21.15.7:0/1011015835 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2a0c06b5d0 0x7f2a0c06da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.857+0000 7f2a25226640 1 -- 172.21.15.7:0/1011015835 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2a00001030 con 0x7f2a20151d80 2024-04-25T09:54:46.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.857+0000 7f2a1ffff640 1 --2- 172.21.15.7:0/1011015835 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2a0c06b5d0 0x7f2a0c06da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.858+0000 7f2a1ffff640 1 --2- 172.21.15.7:0/1011015835 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2a0c06b5d0 0x7f2a0c06da90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2a10001860 tx=0x7f2a10007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.858+0000 7f2a1cff9640 1 -- 172.21.15.7:0/1011015835 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2a1808a540 con 0x7f2a20151d80 2024-04-25T09:54:46.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.858+0000 7f2a1cff9640 1 --2- 172.21.15.7:0/1011015835 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x7f2a0c074c50 0x7f2a0c077090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:46.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.859+0000 7f2a1cff9640 1 -- 172.21.15.7:0/1011015835 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2a1800bf30 con 0x7f2a0c074c50 2024-04-25T09:54:46.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.859+0000 7f2a1cff9640 1 -- 172.21.15.7:0/1011015835 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a18091050 con 0x7f2a20151d80 2024-04-25T09:54:46.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.857+0000 7f48faffd640 1 -- 172.21.15.7:0/2681099098 <== osd.4 v2:172.21.15.55:6808/2248155105 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f48f403ee50 con 0x7f48e8074ca0 2024-04-25T09:54:46.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.859+0000 7f2a24a25640 1 --2- 172.21.15.7:0/1011015835 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x7f2a0c074c50 0x7f2a0c077090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:46.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.859+0000 7fa1affff640 1 --2- 172.21.15.7:0/544287541 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x7fa190001650 0x7fa190003b10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.859+0000 7f2a24a25640 1 --2- 172.21.15.7:0/1011015835 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x7f2a0c074c50 0x7f2a0c077090 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:46.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.860+0000 7fa1ad7fa640 1 -- 172.21.15.7:0/544287541 <== osd.1 v2:172.21.15.7:6816/434435857 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa190006bb0 con 0x7fa190001650 2024-04-25T09:54:46.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.861+0000 7f2a1cff9640 1 -- 172.21.15.7:0/1011015835 <== osd.2 v2:172.21.15.7:6808/1173474863 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2a1800bf30 con 0x7f2a0c074c50 2024-04-25T09:54:46.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.883+0000 7f2d8e7fc640 1 -- 172.21.15.7:0/4226943522 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2da8068f60 con 0x7f2d94074c10 2024-04-25T09:54:46.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.885+0000 7f2da4ff9640 1 -- 172.21.15.7:0/4226943522 <== osd.5 v2:172.21.15.55:6800/2514169616 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2da8068f60 con 0x7f2d94074c10 2024-04-25T09:54:46.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.886+0000 7f2dad4a0640 1 -- 172.21.15.7:0/4226943522 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x7f2d94074c10 msgr2=0x7f2d94077050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.886+0000 7f2dad4a0640 1 --2- 172.21.15.7:0/4226943522 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x7f2d94074c10 0x7f2d94077050 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.886+0000 7f2dad4a0640 1 -- 172.21.15.7:0/4226943522 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d9406b5a0 msgr2=0x7f2d9406da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.886+0000 7f2dad4a0640 1 --2- 172.21.15.7:0/4226943522 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d9406b5a0 0x7f2d9406da60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2da815a150 tx=0x7f2d98009110 comp rx=0 tx=0).stop 2024-04-25T09:54:46.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.886+0000 7f2dad4a0640 1 -- 172.21.15.7:0/4226943522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2da806e980 msgr2=0x7f2da8143ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.887+0000 7f2dad4a0640 1 --2- 172.21.15.7:0/4226943522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2da806e980 0x7f2da8143ba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c009870 tx=0x7f2d9c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.887+0000 7f2dacc9f640 1 -- 172.21.15.7:0/4226943522 reap_dead start 2024-04-25T09:54:46.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.887+0000 7f2dad4a0640 1 -- 172.21.15.7:0/4226943522 shutdown_connections 2024-04-25T09:54:46.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.887+0000 7f2dad4a0640 1 -- 172.21.15.7:0/4226943522 >> 172.21.15.7:0/4226943522 conn(0x7f2da8066f20 msgr2=0x7f2da80b01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:46.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.887+0000 7f8c0f7fe640 1 -- 172.21.15.7:0/906261729 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8c1c0e02f0 con 0x7f8c08074c90 2024-04-25T09:54:46.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.888+0000 7f2dad4a0640 1 -- 172.21.15.7:0/4226943522 shutdown_connections 2024-04-25T09:54:46.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.888+0000 7f2dad4a0640 1 -- 172.21.15.7:0/4226943522 wait complete. 2024-04-25T09:54:46.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.888+0000 7f8c19ffb640 1 -- 172.21.15.7:0/906261729 <== osd.6 v2:172.21.15.55:6824/4293769515 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8c1c0e02f0 con 0x7f8c08074c90 2024-04-25T09:54:46.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.889+0000 7f8c0f7fe640 1 -- 172.21.15.7:0/906261729 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x7f8c08074c90 msgr2=0x7f8c080770d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.889+0000 7f490c5d5640 1 -- 172.21.15.7:0/2681099098 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f49040b1a90 con 0x7f48e8074ca0 2024-04-25T09:54:46.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.889+0000 7f8c0f7fe640 1 --2- 172.21.15.7:0/906261729 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x7f8c08074c90 0x7f8c080770d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.889+0000 7f8c0f7fe640 1 -- 172.21.15.7:0/906261729 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8c0806b5a0 msgr2=0x7f8c0806da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.889+0000 7f8c0f7fe640 1 --2- 172.21.15.7:0/906261729 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8c0806b5a0 0x7f8c0806da60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8c20007a60 tx=0x7f8c20008040 comp rx=0 tx=0).stop 2024-04-25T09:54:46.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.889+0000 7f8c0f7fe640 1 -- 172.21.15.7:0/906261729 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c1c050dd0 msgr2=0x7f8c1c0e3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.889+0000 7f8c0f7fe640 1 --2- 172.21.15.7:0/906261729 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c1c050dd0 0x7f8c1c0e3380 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8c1400e870 tx=0x7f8c1400ed30 comp rx=0 tx=0).stop 2024-04-25T09:54:46.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.889+0000 7f48faffd640 1 -- 172.21.15.7:0/2681099098 <== osd.4 v2:172.21.15.55:6808/2248155105 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f49040b1a90 con 0x7f48e8074ca0 2024-04-25T09:54:46.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.889+0000 7f8c29808640 1 -- 172.21.15.7:0/906261729 reap_dead start 2024-04-25T09:54:46.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.890+0000 7f48f8ff9640 1 -- 172.21.15.7:0/2681099098 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x7f48e8074ca0 msgr2=0x7f48e80770e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.890+0000 7f48f8ff9640 1 --2- 172.21.15.7:0/2681099098 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x7f48e8074ca0 0x7f48e80770e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.890+0000 7f8c0f7fe640 1 -- 172.21.15.7:0/906261729 shutdown_connections 2024-04-25T09:54:46.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.890+0000 7f8c0f7fe640 1 -- 172.21.15.7:0/906261729 >> 172.21.15.7:0/906261729 conn(0x7f8c1c009fb0 msgr2=0x7f8c1c034db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:46.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.890+0000 7f8c0f7fe640 1 -- 172.21.15.7:0/906261729 shutdown_connections 2024-04-25T09:54:46.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.890+0000 7f8c0f7fe640 1 -- 172.21.15.7:0/906261729 wait complete. 2024-04-25T09:54:46.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.890+0000 7ff40cf34640 1 -- 172.21.15.7:0/4136305271 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff4080cbdb0 con 0x7ff4080ab130 2024-04-25T09:54:46.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.890+0000 7f4a53acd640 1 -- 172.21.15.7:0/1928220406 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4a4c068fd0 con 0x7f4a30074d20 2024-04-25T09:54:46.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.891+0000 7ff3f6ffd640 1 -- 172.21.15.7:0/4136305271 <== osd.0 v2:172.21.15.7:6800/4167741236 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff4080cbdb0 con 0x7ff4080ab130 2024-04-25T09:54:46.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.891+0000 7f2a25226640 1 -- 172.21.15.7:0/1011015835 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2a00002d50 con 0x7f2a0c074c50 2024-04-25T09:54:46.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.891+0000 7f48f8ff9640 1 -- 172.21.15.7:0/2681099098 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f48e806b5a0 msgr2=0x7f48e806da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.891+0000 7f48f8ff9640 1 --2- 172.21.15.7:0/2681099098 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f48e806b5a0 0x7f48e806da60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f490415cd70 tx=0x7f4900013040 comp rx=0 tx=0).stop 2024-04-25T09:54:46.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.891+0000 7f48f8ff9640 1 -- 172.21.15.7:0/2681099098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49040ced10 msgr2=0x7f490413d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.891+0000 7f48f8ff9640 1 --2- 172.21.15.7:0/2681099098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49040ced10 0x7f490413d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f48f402eb30 tx=0x7f48f40046c0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.891+0000 7f4a427fc640 1 -- 172.21.15.7:0/1928220406 <== osd.3 v2:172.21.15.7:6824/3045538953 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4a4c068fd0 con 0x7f4a30074d20 2024-04-25T09:54:46.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.891+0000 7f490ab72640 1 -- 172.21.15.7:0/2681099098 reap_dead start 2024-04-25T09:54:46.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.891+0000 7ff40cf34640 1 -- 172.21.15.7:0/4136305271 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x7ff4080ab130 msgr2=0x7ff4080ab510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.891+0000 7ff40cf34640 1 --2- 172.21.15.7:0/4136305271 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x7ff4080ab130 0x7ff4080ab510 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.892+0000 7ff40cf34640 1 -- 172.21.15.7:0/4136305271 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff3e806b6d0 msgr2=0x7ff3e806db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.891+0000 7f48f8ff9640 1 -- 172.21.15.7:0/2681099098 shutdown_connections 2024-04-25T09:54:46.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.891+0000 7f48f8ff9640 1 -- 172.21.15.7:0/2681099098 >> 172.21.15.7:0/2681099098 conn(0x7f4904071150 msgr2=0x7f490413fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:46.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.892+0000 7f48f8ff9640 1 -- 172.21.15.7:0/2681099098 shutdown_connections 2024-04-25T09:54:46.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.892+0000 7ff40cf34640 1 --2- 172.21.15.7:0/4136305271 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff3e806b6d0 0x7ff3e806db90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc0099f0 tx=0x7ff3fc008040 comp rx=0 tx=0).stop 2024-04-25T09:54:46.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.892+0000 7f48f8ff9640 1 -- 172.21.15.7:0/2681099098 wait complete. 2024-04-25T09:54:46.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.892+0000 7ff40cf34640 1 -- 172.21.15.7:0/4136305271 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4080b36f0 msgr2=0x7ff4081f51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.892+0000 7f2a1cff9640 1 -- 172.21.15.7:0/1011015835 <== osd.2 v2:172.21.15.7:6808/1173474863 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2a00002d50 con 0x7f2a0c074c50 2024-04-25T09:54:46.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.892+0000 7ff40cf34640 1 --2- 172.21.15.7:0/4136305271 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4080b36f0 0x7ff4081f51f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff4080b49f0 tx=0x7ff3f80046c0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.892+0000 7ff406d9d640 1 -- 172.21.15.7:0/4136305271 reap_dead start 2024-04-25T09:54:46.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.892+0000 7f4a53acd640 1 -- 172.21.15.7:0/1928220406 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x7f4a30074d20 msgr2=0x7f4a30077160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.892+0000 7f4a53acd640 1 --2- 172.21.15.7:0/1928220406 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x7f4a30074d20 0x7f4a30077160 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.892+0000 7ff40cf34640 1 -- 172.21.15.7:0/4136305271 shutdown_connections 2024-04-25T09:54:46.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.892+0000 7ff40cf34640 1 -- 172.21.15.7:0/4136305271 >> 172.21.15.7:0/4136305271 conn(0x7ff408066d10 msgr2=0x7ff408152ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:46.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.892+0000 7f4a53acd640 1 -- 172.21.15.7:0/1928220406 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4a3006b5a0 msgr2=0x7f4a3006da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.892+0000 7f4a53acd640 1 --2- 172.21.15.7:0/1928220406 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4a3006b5a0 0x7f4a3006da60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c00a730 tx=0x7f4a3c008040 comp rx=0 tx=0).stop 2024-04-25T09:54:46.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.892+0000 7f2a25226640 1 -- 172.21.15.7:0/1011015835 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x7f2a0c074c50 msgr2=0x7f2a0c077090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.892+0000 7f2a25226640 1 --2- 172.21.15.7:0/1011015835 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x7f2a0c074c50 0x7f2a0c077090 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.892+0000 7f4a53acd640 1 -- 172.21.15.7:0/1928220406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a4c15c380 msgr2=0x7f4a4c164440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.892+0000 7f4a53acd640 1 --2- 172.21.15.7:0/1928220406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a4c15c380 0x7f4a4c164440 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4a4800c7d0 tx=0x7f4a4800cc90 comp rx=0 tx=0).stop 2024-04-25T09:54:46.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.892+0000 7f4a5206a640 1 -- 172.21.15.7:0/1928220406 reap_dead start 2024-04-25T09:54:46.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.892+0000 7f4a53acd640 1 -- 172.21.15.7:0/1928220406 shutdown_connections 2024-04-25T09:54:46.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.892+0000 7f4a53acd640 1 -- 172.21.15.7:0/1928220406 >> 172.21.15.7:0/1928220406 conn(0x7f4a4c071150 msgr2=0x7f4a4c0737e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:46.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.893+0000 7ff40cf34640 1 -- 172.21.15.7:0/4136305271 shutdown_connections 2024-04-25T09:54:46.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.893+0000 7ff40cf34640 1 -- 172.21.15.7:0/4136305271 wait complete. 2024-04-25T09:54:46.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.893+0000 7f2a25226640 1 -- 172.21.15.7:0/1011015835 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2a0c06b5d0 msgr2=0x7f2a0c06da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.893+0000 7f2a25226640 1 --2- 172.21.15.7:0/1011015835 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2a0c06b5d0 0x7f2a0c06da90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2a10001860 tx=0x7f2a10007000 comp rx=0 tx=0).stop 2024-04-25T09:54:46.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.893+0000 7f2a25226640 1 -- 172.21.15.7:0/1011015835 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2a20151d80 msgr2=0x7f2a20150610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.893+0000 7f2a25226640 1 --2- 172.21.15.7:0/1011015835 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2a20151d80 0x7f2a20150610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2a20075960 tx=0x7f2a1800ef80 comp rx=0 tx=0).stop 2024-04-25T09:54:46.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.893+0000 7f2a24a25640 1 -- 172.21.15.7:0/1011015835 reap_dead start 2024-04-25T09:54:46.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.893+0000 7f4a53acd640 1 -- 172.21.15.7:0/1928220406 shutdown_connections 2024-04-25T09:54:46.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.893+0000 7f4a53acd640 1 -- 172.21.15.7:0/1928220406 wait complete. 2024-04-25T09:54:46.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.893+0000 7f2a25226640 1 -- 172.21.15.7:0/1011015835 shutdown_connections 2024-04-25T09:54:46.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.893+0000 7f2a25226640 1 -- 172.21.15.7:0/1011015835 >> 172.21.15.7:0/1011015835 conn(0x7f2a20066f50 msgr2=0x7f2a20157e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:46.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.893+0000 7f2a25226640 1 -- 172.21.15.7:0/1011015835 shutdown_connections 2024-04-25T09:54:46.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.893+0000 7f2a25226640 1 -- 172.21.15.7:0/1011015835 wait complete. 2024-04-25T09:54:46.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.897+0000 7f5f38bd6640 1 -- 172.21.15.7:0/2014250479 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5f34068f60 con 0x7f5f34150bd0 2024-04-25T09:54:46.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.898+0000 7f5f1bfff640 1 -- 172.21.15.7:0/2014250479 <== osd.7 v2:172.21.15.55:6816/2960381217 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5f34068f60 con 0x7f5f34150bd0 2024-04-25T09:54:46.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.899+0000 7f5f19ffb640 1 -- 172.21.15.7:0/2014250479 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x7f5f34150bd0 msgr2=0x7f5f341621b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.899+0000 7f5f19ffb640 1 --2- 172.21.15.7:0/2014250479 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x7f5f34150bd0 0x7f5f341621b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.900+0000 7f5f19ffb640 1 -- 172.21.15.7:0/2014250479 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5f2006b5d0 msgr2=0x7f5f2006da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.900+0000 7f5f19ffb640 1 --2- 172.21.15.7:0/2014250479 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5f2006b5d0 0x7f5f2006da90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5f28034000 tx=0x7f5f2802e000 comp rx=0 tx=0).stop 2024-04-25T09:54:46.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.900+0000 7f5f19ffb640 1 -- 172.21.15.7:0/2014250479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f3406d060 msgr2=0x7f5f341f2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.900+0000 7f5f19ffb640 1 --2- 172.21.15.7:0/2014250479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f3406d060 0x7f5f341f2f80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5f2401f5a0 tx=0x7f5f2401fa60 comp rx=0 tx=0).stop 2024-04-25T09:54:46.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.900+0000 7f5f33fff640 1 -- 172.21.15.7:0/2014250479 reap_dead start 2024-04-25T09:54:46.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.900+0000 7f5f19ffb640 1 -- 172.21.15.7:0/2014250479 shutdown_connections 2024-04-25T09:54:46.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.900+0000 7f5f19ffb640 1 -- 172.21.15.7:0/2014250479 >> 172.21.15.7:0/2014250479 conn(0x7f5f34066f50 msgr2=0x7f5f340b0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:46.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.901+0000 7f5f19ffb640 1 -- 172.21.15.7:0/2014250479 shutdown_connections 2024-04-25T09:54:46.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.901+0000 7f5f19ffb640 1 -- 172.21.15.7:0/2014250479 wait complete. 2024-04-25T09:54:46.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.906+0000 7fa1b5cbb640 1 -- 172.21.15.7:0/544287541 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa190005c40 con 0x7fa190001650 2024-04-25T09:54:46.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.906+0000 7fa1ad7fa640 1 -- 172.21.15.7:0/544287541 <== osd.1 v2:172.21.15.7:6816/434435857 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa190005c40 con 0x7fa190001650 2024-04-25T09:54:46.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.908+0000 7fa1b5cbb640 1 -- 172.21.15.7:0/544287541 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x7fa190001650 msgr2=0x7fa190003b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.908+0000 7fa1b5cbb640 1 --2- 172.21.15.7:0/544287541 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x7fa190001650 0x7fa190003b10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:46.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.908+0000 7fa1b5cbb640 1 -- 172.21.15.7:0/544287541 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa19406b550 msgr2=0x7fa19406da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.908+0000 7fa1b5cbb640 1 --2- 172.21.15.7:0/544287541 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa19406b550 0x7fa19406da10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa19c006fd0 tx=0x7fa19c008040 comp rx=0 tx=0).stop 2024-04-25T09:54:46.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.908+0000 7fa1b5cbb640 1 -- 172.21.15.7:0/544287541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1a80df4f0 msgr2=0x7fa1a817a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:46.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.908+0000 7fa1b5cbb640 1 --2- 172.21.15.7:0/544287541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1a80df4f0 0x7fa1a817a690 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa1b00734b0 tx=0x7fa1b0068680 comp rx=0 tx=0).stop 2024-04-25T09:54:46.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.908+0000 7fa1b54ba640 1 -- 172.21.15.7:0/544287541 reap_dead start 2024-04-25T09:54:46.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.908+0000 7fa1b5cbb640 1 -- 172.21.15.7:0/544287541 shutdown_connections 2024-04-25T09:54:46.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.908+0000 7fa1b5cbb640 1 -- 172.21.15.7:0/544287541 >> 172.21.15.7:0/544287541 conn(0x7fa1a8009fb0 msgr2=0x7fa1a80d96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:46.947 INFO:teuthology.orchestra.run.smithi007.stdout:60129542155 2024-04-25T09:54:46.948 INFO:teuthology.orchestra.run.smithi007.stdout:60129542153 2024-04-25T09:54:46.948 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T09:54:46.949 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T09:54:46.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.909+0000 7fa1b5cbb640 1 -- 172.21.15.7:0/544287541 shutdown_connections 2024-04-25T09:54:46.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:46.909+0000 7fa1b5cbb640 1 -- 172.21.15.7:0/544287541 wait complete. 2024-04-25T09:54:46.950 INFO:teuthology.orchestra.run.smithi007.stdout:60129542152 2024-04-25T09:54:46.950 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T09:54:46.951 INFO:teuthology.orchestra.run.smithi007.stdout:55834574857 2024-04-25T09:54:46.952 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T09:54:46.953 INFO:teuthology.orchestra.run.smithi007.stdout:55834574857 2024-04-25T09:54:46.953 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T09:54:46.954 INFO:teuthology.orchestra.run.smithi007.stdout:55834574857 2024-04-25T09:54:46.954 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T09:54:46.955 INFO:teuthology.orchestra.run.smithi007.stdout:60129542153 2024-04-25T09:54:46.955 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T09:54:46.956 INFO:teuthology.orchestra.run.smithi007.stdout:55834574857 2024-04-25T09:54:46.956 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T09:54:47.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.161+0000 7fee219d5640 1 Processor -- start 2024-04-25T09:54:47.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.161+0000 7f13809f3640 1 Processor -- start 2024-04-25T09:54:47.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.161+0000 7f13809f3640 1 -- start start 2024-04-25T09:54:47.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.161+0000 7fee219d5640 1 -- start start 2024-04-25T09:54:47.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.162+0000 7f84fabea640 1 Processor -- start 2024-04-25T09:54:47.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.162+0000 7fee219d5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fee1404a310 0x7fee14039b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.162+0000 7fee219d5640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fee140361a0 0x7fee1403c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.162+0000 7fee219d5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee1403b330 con 0x7fee140529e0 2024-04-25T09:54:47.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.162+0000 7fee219d5640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee1403b5d0 con 0x7fee140361a0 2024-04-25T09:54:47.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.162+0000 7fee219d5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1403b8b0 con 0x7fee1404a310 2024-04-25T09:54:47.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.162+0000 7f13809f3640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f137c070f90 0x7f137c0cd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.162+0000 7f13809f3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f137c0aeaf0 0x7f137c071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.162+0000 7f13809f3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f137c16b420 con 0x7f137c06ea60 2024-04-25T09:54:47.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.162+0000 7f13809f3640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f137c16b9a0 con 0x7f137c070f90 2024-04-25T09:54:47.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.162+0000 7f13809f3640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137c0b2970 con 0x7f137c0aeaf0 2024-04-25T09:54:47.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.162+0000 7fee1affd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fee1404a310 0x7fee14039b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.162+0000 7fee1affd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fee1404a310 0x7fee14039b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:44112/0 (socket says 172.21.15.7:44112) 2024-04-25T09:54:47.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.162+0000 7fee1affd640 1 -- 172.21.15.7:0/143944353 learned_addr learned my addr 172.21.15.7:0/143944353 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:47.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.163+0000 7f956d51b640 1 Processor -- start 2024-04-25T09:54:47.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.162+0000 7f84fabea640 1 -- start start 2024-04-25T09:54:47.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.163+0000 7f137a59c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f137c0aeaf0 0x7f137c071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.163+0000 7f137a59c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f137c0aeaf0 0x7f137c071370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:44114/0 (socket says 172.21.15.7:44114) 2024-04-25T09:54:47.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.163+0000 7f137a59c640 1 -- 172.21.15.7:0/4187058500 learned_addr learned my addr 172.21.15.7:0/4187058500 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:47.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.163+0000 7f137ad9d640 1 --2- 172.21.15.7:0/4187058500 >> v2:172.21.15.7:3300/0 conn(0x7f137c070f90 0x7f137c0cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.163+0000 7f137a59c640 1 -- 172.21.15.7:0/4187058500 >> v2:172.21.15.7:3300/0 conn(0x7f137c070f90 msgr2=0x7f137c0cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:47.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.163+0000 7f137a59c640 1 --2- 172.21.15.7:0/4187058500 >> v2:172.21.15.7:3300/0 conn(0x7f137c070f90 0x7f137c0cd200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.163+0000 7f137a59c640 1 -- 172.21.15.7:0/4187058500 >> v1:172.21.15.55:6789/0 conn(0x7f137c06ea60 legacy=0x7f137c16dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.163+0000 7f137a59c640 1 -- 172.21.15.7:0/4187058500 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137c0718b0 con 0x7f137c0aeaf0 2024-04-25T09:54:47.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.163+0000 7f137ad9d640 1 --2- 172.21.15.7:0/4187058500 >> v2:172.21.15.7:3300/0 conn(0x7f137c070f90 0x7f137c0cd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:47.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.163+0000 7fee1a7fc640 1 --2- 172.21.15.7:0/143944353 >> v2:172.21.15.7:3300/0 conn(0x7fee140361a0 0x7fee1403c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.163+0000 7fee1affd640 1 -- 172.21.15.7:0/143944353 >> v2:172.21.15.7:3300/0 conn(0x7fee140361a0 msgr2=0x7fee1403c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:47.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.163+0000 7fee1affd640 1 --2- 172.21.15.7:0/143944353 >> v2:172.21.15.7:3300/0 conn(0x7fee140361a0 0x7fee1403c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.163+0000 7fee1affd640 1 -- 172.21.15.7:0/143944353 >> v1:172.21.15.55:6789/0 conn(0x7fee140529e0 legacy=0x7fee14054860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.163+0000 7fee19ffb640 1 -- 172.21.15.7:0/143944353 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195015639 0 0) 0x7fee1403b330 con 0x7fee140529e0 2024-04-25T09:54:47.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.163+0000 7fee1affd640 1 -- 172.21.15.7:0/143944353 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1403bb90 con 0x7fee1404a310 2024-04-25T09:54:47.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.163+0000 7fee1a7fc640 1 --2- 172.21.15.7:0/143944353 >> v2:172.21.15.7:3300/0 conn(0x7fee140361a0 0x7fee1403c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:47.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.164+0000 7f63d077e640 1 Processor -- start 2024-04-25T09:54:47.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.164+0000 7f63d077e640 1 -- start start 2024-04-25T09:54:47.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.164+0000 7f84f9be8640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f84ec0537a0 0x7f84ec053b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:42712/0 (socket says 172.21.15.7:42712) 2024-04-25T09:54:47.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.164+0000 7f84f9be8640 1 -- 172.21.15.7:0/1679608748 learned_addr learned my addr 172.21.15.7:0/1679608748 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:47.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.164+0000 7f84fabea640 1 --2- 172.21.15.7:0/1679608748 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f84ec006690 0x7f84ec03c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.163+0000 7f956d51b640 1 -- start start 2024-04-25T09:54:47.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.164+0000 7f956d51b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f95600df5a0 0x7f95600e3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.164+0000 7fa382730640 1 Processor -- start 2024-04-25T09:54:47.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.164+0000 7fa382730640 1 -- start start 2024-04-25T09:54:47.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.164+0000 7f84fa3e9640 1 --2- 172.21.15.7:0/1679608748 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f84ec006690 0x7f84ec03c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.164+0000 7f137a59c640 1 --2- 172.21.15.7:0/4187058500 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f137c0aeaf0 0x7f137c071370 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1374009e50 tx=0x7f137402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6b8228feaed6c6c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:47.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.164+0000 7f84fabea640 1 -- 172.21.15.7:0/1679608748 --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84ec006c80 con 0x7f84ec006200 2024-04-25T09:54:47.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.164+0000 7f9566ffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f95600df5a0 0x7f95600e3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.164+0000 7f9566ffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f95600df5a0 0x7f95600e3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43026/0 (socket says 172.21.15.7:43026) 2024-04-25T09:54:47.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.165+0000 7f84fabea640 1 -- 172.21.15.7:0/1679608748 --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84ec006f60 con 0x7f84ec0537a0 2024-04-25T09:54:47.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.165+0000 7f84fabea640 1 -- 172.21.15.7:0/1679608748 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec007890 con 0x7f84ec006690 2024-04-25T09:54:47.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.165+0000 7f9566ffd640 1 -- 172.21.15.7:0/1976758515 learned_addr learned my addr 172.21.15.7:0/1976758515 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:47.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.165+0000 7f84f8be6640 1 -- 172.21.15.7:0/1679608748 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2178025467 0 0) 0x7f84ec006f60 con 0x7f84ec0537a0 2024-04-25T09:54:47.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.165+0000 7f84f8be6640 1 -- 172.21.15.7:0/1679608748 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84e0003520 con 0x7f84ec0537a0 2024-04-25T09:54:47.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.165+0000 7f84fa3e9640 1 -- 172.21.15.7:0/1679608748 >> v1:172.21.15.55:6789/0 conn(0x7f84ec0537a0 legacy=0x7f84ec053b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.165+0000 7f84fa3e9640 1 -- 172.21.15.7:0/1679608748 >> v1:172.21.15.7:6789/0 conn(0x7f84ec006200 legacy=0x7f84ec03c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:47.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.165+0000 7f84fa3e9640 1 -- 172.21.15.7:0/1679608748 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ec007240 con 0x7f84ec006690 2024-04-25T09:54:47.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.165+0000 7fa382730640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa37c165410 0x7fa37c0cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.165+0000 7f63d077e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f63c8071ed0 0x7f63c80ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.165+0000 7f63d077e640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c815bdc0 con 0x7f63c80ce890 2024-04-25T09:54:47.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.165+0000 7f63d077e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c815c060 con 0x7f63c81529e0 2024-04-25T09:54:47.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.165+0000 7f63d077e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c80b2340 con 0x7f63c8071ed0 2024-04-25T09:54:47.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.165+0000 7f956d51b640 1 -- 172.21.15.7:0/1976758515 --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9560054d30 con 0x7f95600500d0 2024-04-25T09:54:47.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.165+0000 7f956d51b640 1 -- 172.21.15.7:0/1976758515 --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9560055010 con 0x7f95600385c0 2024-04-25T09:54:47.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.166+0000 7f956d51b640 1 -- 172.21.15.7:0/1976758515 --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9560007150 con 0x7f95600df5a0 2024-04-25T09:54:47.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.166+0000 7f63ce51a640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f63c81529e0 0x7f63c80c5ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:42728/0 (socket says 172.21.15.7:42728) 2024-04-25T09:54:47.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.166+0000 7f63ce51a640 1 -- 172.21.15.7:0/3803439166 learned_addr learned my addr 172.21.15.7:0/3803439166 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:47.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.165+0000 7fee1affd640 1 --2- 172.21.15.7:0/143944353 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fee1404a310 0x7fee14039b70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fee1c074ab0 tx=0x7fee1c0a51b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9eeb7005ea63e24a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:47.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.165+0000 7fee19ffb640 1 -- 172.21.15.7:0/143944353 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c0b2070 con 0x7fee1404a310 2024-04-25T09:54:47.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.165+0000 7fee19ffb640 1 -- 172.21.15.7:0/143944353 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1c0ad440 con 0x7fee1404a310 2024-04-25T09:54:47.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.165+0000 7fee19ffb640 1 -- 172.21.15.7:0/143944353 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c0ad7f0 con 0x7fee1404a310 2024-04-25T09:54:47.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.166+0000 7fa37bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa37c165410 0x7fa37c0cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.166+0000 7fa37bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa37c165410 0x7fa37c0cebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:59454/0 (socket says 172.21.15.7:59454) 2024-04-25T09:54:47.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.166+0000 7f63cdd19640 1 --2- 172.21.15.7:0/3803439166 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f63c8071ed0 0x7f63c80ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.165+0000 7f1379d9b640 1 -- 172.21.15.7:0/4187058500 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1374036070 con 0x7f137c0aeaf0 2024-04-25T09:54:47.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.165+0000 7f1379d9b640 1 -- 172.21.15.7:0/4187058500 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1374031600 con 0x7f137c0aeaf0 2024-04-25T09:54:47.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.165+0000 7f1379d9b640 1 -- 172.21.15.7:0/4187058500 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1374036070 con 0x7f137c0aeaf0 2024-04-25T09:54:47.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.166+0000 7f13809f3640 1 -- 172.21.15.7:0/4187058500 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f137c0aeaf0 msgr2=0x7f137c071370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.166+0000 7f13809f3640 1 --2- 172.21.15.7:0/4187058500 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f137c0aeaf0 0x7f137c071370 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1374009e50 tx=0x7f137402a710 comp rx=0 tx=0).stop 2024-04-25T09:54:47.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.166+0000 7ff80f59e640 1 Processor -- start 2024-04-25T09:54:47.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.166+0000 7ff80f59e640 1 -- start start 2024-04-25T09:54:47.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.166+0000 7f9565ffb640 1 -- 172.21.15.7:0/1976758515 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3515115915 0 0) 0x7f9560055010 con 0x7f95600385c0 2024-04-25T09:54:47.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.166+0000 7f9565ffb640 1 -- 172.21.15.7:0/1976758515 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9550003520 con 0x7f95600385c0 2024-04-25T09:54:47.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.166+0000 7fb7a10ac640 1 Processor -- start 2024-04-25T09:54:47.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.166+0000 7f63cd518640 1 -- 172.21.15.7:0/3803439166 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969425557 0 0) 0x7f63c815bdc0 con 0x7f63c80ce890 2024-04-25T09:54:47.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.166+0000 7f63cd518640 1 -- 172.21.15.7:0/3803439166 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63b4003520 con 0x7f63c80ce890 2024-04-25T09:54:47.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.166+0000 7f9565ffb640 1 -- 172.21.15.7:0/1976758515 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3035301289 0 0) 0x7f9560054d30 con 0x7f95600500d0 2024-04-25T09:54:47.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.166+0000 7f9565ffb640 1 -- 172.21.15.7:0/1976758515 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9560055010 con 0x7f95600500d0 2024-04-25T09:54:47.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.166+0000 7fee219d5640 1 -- 172.21.15.7:0/143944353 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fee1404a310 msgr2=0x7fee14039b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.166+0000 7fee219d5640 1 --2- 172.21.15.7:0/143944353 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fee1404a310 0x7fee14039b70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fee1c074ab0 tx=0x7fee1c0a51b0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.166+0000 7f63cd518640 1 -- 172.21.15.7:0/3803439166 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4213938872 0 0) 0x7f63c815c060 con 0x7f63c81529e0 2024-04-25T09:54:47.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.166+0000 7f63cd518640 1 -- 172.21.15.7:0/3803439166 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63c815bdc0 con 0x7f63c81529e0 2024-04-25T09:54:47.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.166+0000 7fee219d5640 1 -- 172.21.15.7:0/143944353 shutdown_connections 2024-04-25T09:54:47.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.166+0000 7fee219d5640 1 --2- 172.21.15.7:0/143944353 >> v2:172.21.15.7:3300/0 conn(0x7fee140361a0 0x7fee1403c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.166+0000 7fee219d5640 1 --2- 172.21.15.7:0/143944353 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fee1404a310 0x7fee14039b70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.166+0000 7fee219d5640 1 -- 172.21.15.7:0/143944353 >> 172.21.15.7:0/143944353 conn(0x7fee140537a0 msgr2=0x7fee14053b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:47.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.166+0000 7f84fa3e9640 1 --2- 172.21.15.7:0/1679608748 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f84ec006690 0x7f84ec03c7f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f84f4075960 tx=0x7f84f40a5100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec578342197a7ba4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:47.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.166+0000 7fa37b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa37c0b04d0 0x7fa37c0c33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:42730/0 (socket says 172.21.15.7:42730) 2024-04-25T09:54:47.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.166+0000 7fa37bfff640 1 -- 172.21.15.7:0/57415253 learned_addr learned my addr 172.21.15.7:0/57415253 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:47.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.166+0000 7fa382730640 1 -- 172.21.15.7:0/57415253 --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa37c0cf100 con 0x7fa37c0c3ae0 2024-04-25T09:54:47.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.167+0000 7fee219d5640 1 -- 172.21.15.7:0/143944353 shutdown_connections 2024-04-25T09:54:47.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.167+0000 7fa382730640 1 -- 172.21.15.7:0/57415253 --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa37c0cf3c0 con 0x7fa37c0b04d0 2024-04-25T09:54:47.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.167+0000 7fa382730640 1 -- 172.21.15.7:0/57415253 --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa37c1657f0 con 0x7fa37c165410 2024-04-25T09:54:47.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.167+0000 7f63cdd19640 1 -- 172.21.15.7:0/3803439166 >> v1:172.21.15.55:6789/0 conn(0x7f63c81529e0 legacy=0x7f63c80c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.167+0000 7f63cdd19640 1 -- 172.21.15.7:0/3803439166 >> v1:172.21.15.7:6789/0 conn(0x7f63c80ce890 legacy=0x7f63c806d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.167+0000 7f63cdd19640 1 -- 172.21.15.7:0/3803439166 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c815c340 con 0x7f63c8071ed0 2024-04-25T09:54:47.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.167+0000 7f84f8be6640 1 -- 172.21.15.7:0/1679608748 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f40b2070 con 0x7f84ec006690 2024-04-25T09:54:47.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.167+0000 7f84f8be6640 1 -- 172.21.15.7:0/1679608748 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f40ad440 con 0x7f84ec006690 2024-04-25T09:54:47.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.167+0000 7f84f8be6640 1 -- 172.21.15.7:0/1679608748 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f40ad870 con 0x7f84ec006690 2024-04-25T09:54:47.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.167+0000 7fee219d5640 1 -- 172.21.15.7:0/143944353 wait complete. 2024-04-25T09:54:47.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7ff80f59e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff8100acf40 0x7ff810162cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7ff80e59c640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff8100b4810 0x7ff81006bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35602/0 (socket says 172.21.15.7:35602) 2024-04-25T09:54:47.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7f63cdd19640 1 --2- 172.21.15.7:0/3803439166 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f63c8071ed0 0x7f63c80ce350 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f63c0009dc0 tx=0x7f63c002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c057686353b22b66 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:47.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7ff80f59e640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8100ad350 con 0x7ff8100b4810 2024-04-25T09:54:47.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7ff80dd9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff81006c280 0x7ff8100b2c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:42740/0 (socket says 172.21.15.7:42740) 2024-04-25T09:54:47.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7ff80ed9d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff8100acf40 0x7ff810162cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7ff80dd9b640 1 -- 172.21.15.7:0/2848633532 learned_addr learned my addr 172.21.15.7:0/2848633532 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:47.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.166+0000 7fb7a10ac640 1 -- start start 2024-04-25T09:54:47.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7ff80f59e640 1 -- 172.21.15.7:0/2848633532 --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8100ad600 con 0x7ff81006c280 2024-04-25T09:54:47.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7f84fabea640 1 -- 172.21.15.7:0/1679608748 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f84ec006690 msgr2=0x7f84ec03c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7f84fabea640 1 --2- 172.21.15.7:0/1679608748 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f84ec006690 0x7f84ec03c7f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f84f4075960 tx=0x7f84f40a5100 comp rx=0 tx=0).stop 2024-04-25T09:54:47.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7f13809f3640 1 -- 172.21.15.7:0/4187058500 shutdown_connections 2024-04-25T09:54:47.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7f13809f3640 1 --2- 172.21.15.7:0/4187058500 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f137c0aeaf0 0x7f137c071370 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7f13809f3640 1 --2- 172.21.15.7:0/4187058500 >> v2:172.21.15.7:3300/0 conn(0x7f137c070f90 0x7f137c0cd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7f13809f3640 1 -- 172.21.15.7:0/4187058500 >> 172.21.15.7:0/4187058500 conn(0x7f137c066ad0 msgr2=0x7f137c06ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:47.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7ff80f59e640 1 -- 172.21.15.7:0/2848633532 --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8100ad8e0 con 0x7ff8100acf40 2024-04-25T09:54:47.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7f63cd518640 1 -- 172.21.15.7:0/3803439166 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c0007740 con 0x7f63c8071ed0 2024-04-25T09:54:47.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.167+0000 7f9565ffb640 1 -- 172.21.15.7:0/1976758515 <== mon.1 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3919542151 0 0) 0x7f9550003520 con 0x7f95600385c0 2024-04-25T09:54:47.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.167+0000 7f9565ffb640 1 -- 172.21.15.7:0/1976758515 >> v2:172.21.15.7:3300/0 conn(0x7f95600df5a0 msgr2=0x7f95600e3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:47.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.167+0000 7f9565ffb640 1 --2- 172.21.15.7:0/1976758515 >> v2:172.21.15.7:3300/0 conn(0x7f95600df5a0 0x7f95600e3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.167+0000 7f9565ffb640 1 -- 172.21.15.7:0/1976758515 >> v1:172.21.15.7:6789/0 conn(0x7f95600500d0 legacy=0x7f95600075e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.167+0000 7f9565ffb640 1 -- 172.21.15.7:0/1976758515 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9560006de0 con 0x7f95600385c0 2024-04-25T09:54:47.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.167+0000 7f9565ffb640 1 -- 172.21.15.7:0/1976758515 <== mon.1 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f9558001670 con 0x7f95600385c0 2024-04-25T09:54:47.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.167+0000 7f9565ffb640 1 -- 172.21.15.7:0/1976758515 >> v1:172.21.15.55:6789/0 conn(0x7f95600385c0 legacy=0x7f9560054570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.167+0000 7f9565ffb640 1 --2- 172.21.15.7:0/1976758515 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9550003b40 0x7f9550003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7f84fabea640 1 -- 172.21.15.7:0/1679608748 shutdown_connections 2024-04-25T09:54:47.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7f84fabea640 1 --2- 172.21.15.7:0/1679608748 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f84ec006690 0x7f84ec03c7f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7f84fabea640 1 -- 172.21.15.7:0/1679608748 >> 172.21.15.7:0/1679608748 conn(0x7f84ec03aa30 msgr2=0x7f84ec03ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:47.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.167+0000 7fa37bfff640 1 -- 172.21.15.7:0/57415253 >> v1:172.21.15.55:6789/0 conn(0x7fa37c0b04d0 legacy=0x7fa37c0c33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7fa37bfff640 1 -- 172.21.15.7:0/57415253 >> v1:172.21.15.7:6789/0 conn(0x7fa37c0c3ae0 legacy=0x7fa37c0ad5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7fa37bfff640 1 -- 172.21.15.7:0/57415253 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37c0cf6a0 con 0x7fa37c165410 2024-04-25T09:54:47.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.167+0000 7f9565ffb640 1 --2- 172.21.15.7:0/1976758515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9550004800 0x7f9550004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.167+0000 7f9565ffb640 1 --2- 172.21.15.7:0/1976758515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95500099b0 0x7f95500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.167+0000 7f9565ffb640 1 -- 172.21.15.7:0/1976758515 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9560007150 con 0x7f95500099b0 2024-04-25T09:54:47.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.167+0000 7f9565ffb640 1 -- 172.21.15.7:0/1976758515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95500147b0 con 0x7f9550004800 2024-04-25T09:54:47.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.167+0000 7f9565ffb640 1 -- 172.21.15.7:0/1976758515 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95500149b0 con 0x7f9550003b40 2024-04-25T09:54:47.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.167+0000 7f95677fe640 1 --2- 172.21.15.7:0/1976758515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95500099b0 0x7f95500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7f9566ffd640 1 --2- 172.21.15.7:0/1976758515 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9550003b40 0x7f9550003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7f63cd518640 1 -- 172.21.15.7:0/3803439166 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c00078e0 con 0x7f63c8071ed0 2024-04-25T09:54:47.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7ff80d59a640 1 -- 172.21.15.7:0/2848633532 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3183704413 0 0) 0x7ff8100ad600 con 0x7ff81006c280 2024-04-25T09:54:47.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7ff80d59a640 1 -- 172.21.15.7:0/2848633532 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7f8003520 con 0x7ff81006c280 2024-04-25T09:54:47.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7f95677fe640 1 -- 172.21.15.7:0/1976758515 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9550003b40 msgr2=0x7f9550003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:47.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7f95677fe640 1 --2- 172.21.15.7:0/1976758515 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9550003b40 0x7f9550003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7f95677fe640 1 -- 172.21.15.7:0/1976758515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9550004800 msgr2=0x7f9550004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:47.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7f95677fe640 1 --2- 172.21.15.7:0/1976758515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9550004800 0x7f9550004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7f95677fe640 1 -- 172.21.15.7:0/1976758515 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9550003520 con 0x7f95500099b0 2024-04-25T09:54:47.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7f84fabea640 1 -- 172.21.15.7:0/1679608748 shutdown_connections 2024-04-25T09:54:47.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7f63cd518640 1 -- 172.21.15.7:0/3803439166 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c0007cb0 con 0x7f63c8071ed0 2024-04-25T09:54:47.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.169+0000 7fee219d5640 1 Processor -- start 2024-04-25T09:54:47.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.169+0000 7ff80ed9d640 1 -- 172.21.15.7:0/2848633532 >> v1:172.21.15.55:6789/0 conn(0x7ff81006c280 legacy=0x7ff8100b2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.169+0000 7ff80ed9d640 1 -- 172.21.15.7:0/2848633532 >> v1:172.21.15.7:6789/0 conn(0x7ff8100b4810 legacy=0x7ff81006bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.169+0000 7fee219d5640 1 -- start start 2024-04-25T09:54:47.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.169+0000 7fb79ad9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb7940e32f0 0x7fb7940572e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:42746/0 (socket says 172.21.15.7:42746) 2024-04-25T09:54:47.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.169+0000 7fb79ad9d640 1 -- 172.21.15.7:0/825322312 learned_addr learned my addr 172.21.15.7:0/825322312 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:47.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.169+0000 7fb7a10ac640 1 --2- 172.21.15.7:0/825322312 >> v2:172.21.15.7:3300/0 conn(0x7fb794006da0 0x7fb7940ede00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.169+0000 7ff80ed9d640 1 -- 172.21.15.7:0/2848633532 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8100adbc0 con 0x7ff8100acf40 2024-04-25T09:54:47.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.169+0000 7f63d077e640 1 -- 172.21.15.7:0/3803439166 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f63c8071ed0 msgr2=0x7f63c80ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.169+0000 7f63d077e640 1 --2- 172.21.15.7:0/3803439166 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f63c8071ed0 0x7f63c80ce350 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f63c0009dc0 tx=0x7f63c002a6d0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.169+0000 7fb79b59e640 1 --2- 172.21.15.7:0/825322312 >> v2:172.21.15.7:3300/0 conn(0x7fb794006da0 0x7fb7940ede00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.170+0000 7fa37bfff640 1 --2- 172.21.15.7:0/57415253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa37c165410 0x7fa37c0cebc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa374009e50 tx=0x7fa37402a560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4a4d2416f3f0182 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:47.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.170+0000 7f63d077e640 1 -- 172.21.15.7:0/3803439166 shutdown_connections 2024-04-25T09:54:47.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.170+0000 7f63d077e640 1 --2- 172.21.15.7:0/3803439166 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f63c8071ed0 0x7f63c80ce350 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.170+0000 7f63d077e640 1 -- 172.21.15.7:0/3803439166 >> 172.21.15.7:0/3803439166 conn(0x7f63c8071150 msgr2=0x7f63c8071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:47.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7f84fabea640 1 -- 172.21.15.7:0/1679608748 wait complete. 2024-04-25T09:54:47.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.170+0000 7fb7a10ac640 1 -- 172.21.15.7:0/825322312 --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7940e36d0 con 0x7fb7940061e0 2024-04-25T09:54:47.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.170+0000 7f63d077e640 1 -- 172.21.15.7:0/3803439166 shutdown_connections 2024-04-25T09:54:47.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.170+0000 7fb7a10ac640 1 -- 172.21.15.7:0/825322312 --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb794057b30 con 0x7fb7940e32f0 2024-04-25T09:54:47.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.170+0000 7f84fabea640 1 Processor -- start 2024-04-25T09:54:47.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.170+0000 7f84fabea640 1 -- start start 2024-04-25T09:54:47.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.170+0000 7f63d077e640 1 -- 172.21.15.7:0/3803439166 wait complete. 2024-04-25T09:54:47.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7f13809f3640 1 -- 172.21.15.7:0/4187058500 shutdown_connections 2024-04-25T09:54:47.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.168+0000 7f13809f3640 1 -- 172.21.15.7:0/4187058500 wait complete. 2024-04-25T09:54:47.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.171+0000 7f13809f3640 1 Processor -- start 2024-04-25T09:54:47.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.170+0000 7fee219d5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee140361a0 0x7fee1400a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.171+0000 7fee1affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee140361a0 0x7fee1400a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.171+0000 7fee1affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee140361a0 0x7fee1400a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43062/0 (socket says 172.21.15.7:43062) 2024-04-25T09:54:47.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.171+0000 7fee1affd640 1 -- 172.21.15.7:0/3635880235 learned_addr learned my addr 172.21.15.7:0/3635880235 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:47.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.171+0000 7fee219d5640 1 --2- 172.21.15.7:0/3635880235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee1404a310 0x7fee140e0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.171+0000 7fee219d5640 1 --2- 172.21.15.7:0/3635880235 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fee140529e0 0x7fee14171140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.171+0000 7fee219d5640 1 -- 172.21.15.7:0/3635880235 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee140eb340 con 0x7fee140361a0 2024-04-25T09:54:47.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.171+0000 7fee219d5640 1 -- 172.21.15.7:0/3635880235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1403c8d0 con 0x7fee1404a310 2024-04-25T09:54:47.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.171+0000 7fee219d5640 1 -- 172.21.15.7:0/3635880235 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee140eb4c0 con 0x7fee140529e0 2024-04-25T09:54:47.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.171+0000 7fee1a7fc640 1 --2- 172.21.15.7:0/3635880235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee1404a310 0x7fee140e0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.170+0000 7ff80ed9d640 1 --2- 172.21.15.7:0/2848633532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8100acf40 0x7ff810162cc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff808009d90 tx=0x7ff80802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb91e2c11f754c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:47.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.170+0000 7ff80d59a640 1 -- 172.21.15.7:0/2848633532 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff808007740 con 0x7ff8100acf40 2024-04-25T09:54:47.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.170+0000 7ff80d59a640 1 -- 172.21.15.7:0/2848633532 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8080078e0 con 0x7ff8100acf40 2024-04-25T09:54:47.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.170+0000 7ff80d59a640 1 -- 172.21.15.7:0/2848633532 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff808007cb0 con 0x7ff8100acf40 2024-04-25T09:54:47.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.170+0000 7fa37affd640 1 -- 172.21.15.7:0/57415253 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa374031600 con 0x7fa37c165410 2024-04-25T09:54:47.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.170+0000 7fa37affd640 1 -- 172.21.15.7:0/57415253 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3740317a0 con 0x7fa37c165410 2024-04-25T09:54:47.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.170+0000 7fa37affd640 1 -- 172.21.15.7:0/57415253 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa374031b70 con 0x7fa37c165410 2024-04-25T09:54:47.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.171+0000 7fee1b7fe640 1 --2- 172.21.15.7:0/3635880235 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fee140529e0 0x7fee14171140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.171+0000 7ff80f59e640 1 -- 172.21.15.7:0/2848633532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8100acf40 msgr2=0x7ff810162cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.171+0000 7ff80f59e640 1 --2- 172.21.15.7:0/2848633532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8100acf40 0x7ff810162cc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff808009d90 tx=0x7ff80802a610 comp rx=0 tx=0).stop 2024-04-25T09:54:47.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.171+0000 7f84fabea640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f84ec006200 0x7f84ec04e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.171+0000 7ff80f59e640 1 -- 172.21.15.7:0/2848633532 shutdown_connections 2024-04-25T09:54:47.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.171+0000 7ff80f59e640 1 --2- 172.21.15.7:0/2848633532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8100acf40 0x7ff810162cc0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.171+0000 7ff80f59e640 1 -- 172.21.15.7:0/2848633532 >> 172.21.15.7:0/2848633532 conn(0x7ff810071850 msgr2=0x7ff810071c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:47.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.171+0000 7fb7a10ac640 1 -- 172.21.15.7:0/825322312 --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb794057e10 con 0x7fb794006da0 2024-04-25T09:54:47.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.171+0000 7fee1a7fc640 1 -- 172.21.15.7:0/3635880235 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fee140529e0 msgr2=0x7fee14171140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.171+0000 7fee1a7fc640 1 --2- 172.21.15.7:0/3635880235 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fee140529e0 0x7fee14171140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.171+0000 7fee1a7fc640 1 -- 172.21.15.7:0/3635880235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee140361a0 msgr2=0x7fee1400a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.171+0000 7f84fabea640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84ec006690 0x7f84ec04ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7f84f9be8640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f84ec006200 0x7f84ec04e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.169+0000 7f95677fe640 1 -- 172.21.15.7:0/1976758515 reap_dead start 2024-04-25T09:54:47.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.169+0000 7f95677fe640 1 --2- 172.21.15.7:0/1976758515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95500099b0 0x7f95500051c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f95680734b0 tx=0x7f9550005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee6748c9c45af5c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:47.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.170+0000 7f9565ffb640 1 -- 172.21.15.7:0/1976758515 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95680c3070 con 0x7f95500099b0 2024-04-25T09:54:47.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.170+0000 7f9565ffb640 1 -- 172.21.15.7:0/1976758515 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95680b6c60 con 0x7f95500099b0 2024-04-25T09:54:47.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.170+0000 7f9565ffb640 1 -- 172.21.15.7:0/1976758515 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95680746d0 con 0x7f95500099b0 2024-04-25T09:54:47.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.171+0000 7f956d51b640 1 -- 172.21.15.7:0/1976758515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95500099b0 msgr2=0x7f95500051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.171+0000 7f956d51b640 1 --2- 172.21.15.7:0/1976758515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95500099b0 0x7f95500051c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f95680734b0 tx=0x7f9550005830 comp rx=0 tx=0).stop 2024-04-25T09:54:47.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.171+0000 7f956d51b640 1 -- 172.21.15.7:0/1976758515 shutdown_connections 2024-04-25T09:54:47.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7f956d51b640 1 --2- 172.21.15.7:0/1976758515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95500099b0 0x7f95500051c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7f956d51b640 1 -- 172.21.15.7:0/1976758515 >> 172.21.15.7:0/1976758515 conn(0x7f9560055390 msgr2=0x7f95600557a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:47.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7fee1a7fc640 1 --2- 172.21.15.7:0/3635880235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee140361a0 0x7fee1400a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7f956d51b640 1 -- 172.21.15.7:0/1976758515 shutdown_connections 2024-04-25T09:54:47.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7f956d51b640 1 -- 172.21.15.7:0/1976758515 wait complete. 2024-04-25T09:54:47.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7fee1a7fc640 1 -- 172.21.15.7:0/3635880235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee14008630 con 0x7fee1404a310 2024-04-25T09:54:47.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7fee1affd640 1 --2- 172.21.15.7:0/3635880235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee140361a0 0x7fee1400a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:54:47.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7ff80f59e640 1 -- 172.21.15.7:0/2848633532 shutdown_connections 2024-04-25T09:54:47.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7ff80f59e640 1 -- 172.21.15.7:0/2848633532 wait complete. 2024-04-25T09:54:47.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7f84f9be8640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f84ec006200 0x7f84ec04e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:44174/0 (socket says 172.21.15.7:44174) 2024-04-25T09:54:47.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7fb799d9b640 1 -- 172.21.15.7:0/825322312 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676684187 0 0) 0x7fb794057b30 con 0x7fb7940e32f0 2024-04-25T09:54:47.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7fb799d9b640 1 -- 172.21.15.7:0/825322312 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb784003520 con 0x7fb7940e32f0 2024-04-25T09:54:47.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7f84f93e7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84ec006690 0x7f84ec04ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7f84fabea640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84ec0537a0 0x7f84ec17ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7f84f93e7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84ec006690 0x7f84ec04ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43074/0 (socket says 172.21.15.7:43074) 2024-04-25T09:54:47.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7f84f9be8640 1 -- 172.21.15.7:0/3565906128 learned_addr learned my addr 172.21.15.7:0/3565906128 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:47.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7f84fabea640 1 -- 172.21.15.7:0/3565906128 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec0e34f0 con 0x7f84ec006690 2024-04-25T09:54:47.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.171+0000 7f13809f3640 1 -- start start 2024-04-25T09:54:47.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7f13809f3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f137c06ea60 0x7f137c182d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7f13809f3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f137c070f90 0x7f137c16ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7f13809f3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f137c0aeaf0 0x7f137c1854b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7f13809f3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137c0ce050 con 0x7f137c06ea60 2024-04-25T09:54:47.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7f13809f3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137c0cdd70 con 0x7f137c070f90 2024-04-25T09:54:47.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7f13809f3640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137c071d30 con 0x7f137c0aeaf0 2024-04-25T09:54:47.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.171+0000 7fa382730640 1 -- 172.21.15.7:0/57415253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa37c165410 msgr2=0x7fa37c0cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.171+0000 7fa382730640 1 --2- 172.21.15.7:0/57415253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa37c165410 0x7fa37c0cebc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa374009e50 tx=0x7fa37402a560 comp rx=0 tx=0).stop 2024-04-25T09:54:47.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.171+0000 7fa382730640 1 -- 172.21.15.7:0/57415253 shutdown_connections 2024-04-25T09:54:47.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.171+0000 7fa382730640 1 --2- 172.21.15.7:0/57415253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa37c165410 0x7fa37c0cebc0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.171+0000 7fa382730640 1 -- 172.21.15.7:0/57415253 >> 172.21.15.7:0/57415253 conn(0x7fa37c0b1f70 msgr2=0x7fa37c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:47.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7fa382730640 1 -- 172.21.15.7:0/57415253 shutdown_connections 2024-04-25T09:54:47.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7fa382730640 1 -- 172.21.15.7:0/57415253 wait complete. 2024-04-25T09:54:47.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7f84fabea640 1 -- 172.21.15.7:0/3565906128 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec0544f0 con 0x7f84ec0537a0 2024-04-25T09:54:47.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7f137b59e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f137c0aeaf0 0x7f137c1854b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7f137b59e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f137c0aeaf0 0x7f137c1854b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:44180/0 (socket says 172.21.15.7:44180) 2024-04-25T09:54:47.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7f137b59e640 1 -- 172.21.15.7:0/1878379607 learned_addr learned my addr 172.21.15.7:0/1878379607 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:47.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7fee1a7fc640 1 --2- 172.21.15.7:0/3635880235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee1404a310 0x7fee140e0df0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fee1000c7f0 tx=0x7fee1000ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:47.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7f137a59c640 1 --2- 172.21.15.7:0/1878379607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f137c070f90 0x7f137c16ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7f84fabea640 1 -- 172.21.15.7:0/3565906128 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec0e3670 con 0x7f84ec006200 2024-04-25T09:54:47.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7f63d077e640 1 Processor -- start 2024-04-25T09:54:47.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.172+0000 7f84fa3e9640 1 --2- 172.21.15.7:0/3565906128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84ec0537a0 0x7f84ec17ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7f63d077e640 1 -- start start 2024-04-25T09:54:47.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7f84fa3e9640 1 -- 172.21.15.7:0/3565906128 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f84ec006200 msgr2=0x7f84ec04e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7f84fa3e9640 1 --2- 172.21.15.7:0/3565906128 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f84ec006200 0x7f84ec04e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7f84fa3e9640 1 -- 172.21.15.7:0/3565906128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84ec006690 msgr2=0x7f84ec04ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7f84fa3e9640 1 --2- 172.21.15.7:0/3565906128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84ec006690 0x7f84ec04ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7f84fa3e9640 1 -- 172.21.15.7:0/3565906128 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ec04d370 con 0x7f84ec0537a0 2024-04-25T09:54:47.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7f84fa3e9640 1 --2- 172.21.15.7:0/3565906128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84ec0537a0 0x7f84ec17ba10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f84f406a4d0 tx=0x7f84f406aa10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:47.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7f137ad9d640 1 --2- 172.21.15.7:0/1878379607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f137c06ea60 0x7f137c182d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7f137b59e640 1 -- 172.21.15.7:0/1878379607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f137c070f90 msgr2=0x7f137c16ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7f137b59e640 1 --2- 172.21.15.7:0/1878379607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f137c070f90 0x7f137c16ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7f137b59e640 1 -- 172.21.15.7:0/1878379607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f137c06ea60 msgr2=0x7f137c182d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7f137b59e640 1 --2- 172.21.15.7:0/1878379607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f137c06ea60 0x7f137c182d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7f137b59e640 1 -- 172.21.15.7:0/1878379607 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137c16e8f0 con 0x7f137c0aeaf0 2024-04-25T09:54:47.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7f137a59c640 1 --2- 172.21.15.7:0/1878379607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f137c070f90 0x7f137c16ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:47.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7fb799d9b640 1 -- 172.21.15.7:0/825322312 <== mon.1 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2912790265 0 0) 0x7fb784003520 con 0x7fb7940e32f0 2024-04-25T09:54:47.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7fb799d9b640 1 -- 172.21.15.7:0/825322312 >> v2:172.21.15.7:3300/0 conn(0x7fb794006da0 msgr2=0x7fb7940ede00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:47.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7fb799d9b640 1 --2- 172.21.15.7:0/825322312 >> v2:172.21.15.7:3300/0 conn(0x7fb794006da0 0x7fb7940ede00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7fb799d9b640 1 -- 172.21.15.7:0/825322312 >> v1:172.21.15.7:6789/0 conn(0x7fb7940061e0 legacy=0x7fb794006690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7fb799d9b640 1 -- 172.21.15.7:0/825322312 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7940580f0 con 0x7fb7940e32f0 2024-04-25T09:54:47.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7fb799d9b640 1 -- 172.21.15.7:0/825322312 <== mon.1 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fb78c001670 con 0x7fb7940e32f0 2024-04-25T09:54:47.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7fb799d9b640 1 -- 172.21.15.7:0/825322312 >> v1:172.21.15.55:6789/0 conn(0x7fb7940e32f0 legacy=0x7fb7940572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7fb799d9b640 1 --2- 172.21.15.7:0/825322312 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb784003a00 0x7fb784003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7fb799d9b640 1 --2- 172.21.15.7:0/825322312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb784004800 0x7fb784004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7fb799d9b640 1 --2- 172.21.15.7:0/825322312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb784005210 0x7fb7840141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7fb799d9b640 1 -- 172.21.15.7:0/825322312 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb794057e10 con 0x7fb784005210 2024-04-25T09:54:47.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7fb799d9b640 1 -- 172.21.15.7:0/825322312 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb784014970 con 0x7fb784004800 2024-04-25T09:54:47.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7fb799d9b640 1 -- 172.21.15.7:0/825322312 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb784014b70 con 0x7fb784003a00 2024-04-25T09:54:47.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7fb79ad9d640 1 --2- 172.21.15.7:0/825322312 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb784003a00 0x7fb784003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7fb79a59c640 1 --2- 172.21.15.7:0/825322312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb784004800 0x7fb784004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7f84ea7fc640 1 -- 172.21.15.7:0/3565906128 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f40b2050 con 0x7f84ec0537a0 2024-04-25T09:54:47.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7f84ea7fc640 1 -- 172.21.15.7:0/3565906128 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f40b3040 con 0x7f84ec0537a0 2024-04-25T09:54:47.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7f84ea7fc640 1 -- 172.21.15.7:0/3565906128 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f40ac9b0 con 0x7f84ec0537a0 2024-04-25T09:54:47.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.173+0000 7f84fabea640 1 -- 172.21.15.7:0/3565906128 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84ec04d650 con 0x7f84ec0537a0 2024-04-25T09:54:47.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.174+0000 7f84fabea640 1 -- 172.21.15.7:0/3565906128 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84ec04dc10 con 0x7f84ec0537a0 2024-04-25T09:54:47.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.174+0000 7fee03fff640 1 -- 172.21.15.7:0/3635880235 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee10015070 con 0x7fee1404a310 2024-04-25T09:54:47.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.174+0000 7fb79b59e640 1 --2- 172.21.15.7:0/825322312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb784005210 0x7fb7840141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.174+0000 7fee219d5640 1 -- 172.21.15.7:0/3635880235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee14008910 con 0x7fee1404a310 2024-04-25T09:54:47.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.174+0000 7fee219d5640 1 -- 172.21.15.7:0/3635880235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee14008ed0 con 0x7fee1404a310 2024-04-25T09:54:47.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.174+0000 7fa382730640 1 Processor -- start 2024-04-25T09:54:47.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.174+0000 7f63d077e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63c8071ed0 0x7f63c80b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.174+0000 7fb79b59e640 1 -- 172.21.15.7:0/825322312 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb784003a00 msgr2=0x7fb784003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:47.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.174+0000 7fb79b59e640 1 --2- 172.21.15.7:0/825322312 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb784003a00 0x7fb784003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.174+0000 7fb79b59e640 1 -- 172.21.15.7:0/825322312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb784004800 msgr2=0x7fb784004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:47.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.174+0000 7fb79b59e640 1 --2- 172.21.15.7:0/825322312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb784004800 0x7fb784004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.174+0000 7fb79b59e640 1 -- 172.21.15.7:0/825322312 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb784003520 con 0x7fb784005210 2024-04-25T09:54:47.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.174+0000 7f63d077e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63c80ce890 0x7f63c81579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.174+0000 7ff80f59e640 1 Processor -- start 2024-04-25T09:54:47.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.174+0000 7ff80f59e640 1 -- start start 2024-04-25T09:54:47.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.175+0000 7ff80f59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff81006c280 0x7ff81014d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.175+0000 7fb79b59e640 1 -- 172.21.15.7:0/825322312 reap_dead start 2024-04-25T09:54:47.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.174+0000 7fee03fff640 1 -- 172.21.15.7:0/3635880235 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee10004220 con 0x7fee1404a310 2024-04-25T09:54:47.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.175+0000 7ff80f59e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8100acf40 0x7ff810158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.175+0000 7ff80f59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8100b4810 0x7ff810159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.175+0000 7ff80f59e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8100b3380 con 0x7ff8100b4810 2024-04-25T09:54:47.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.175+0000 7ff80f59e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8100ae180 con 0x7ff81006c280 2024-04-25T09:54:47.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.175+0000 7ff80f59e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8100b3500 con 0x7ff8100acf40 2024-04-25T09:54:47.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.175+0000 7ff80dd9b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8100acf40 0x7ff810158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.175+0000 7ff80e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff81006c280 0x7ff81014d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.175+0000 7f137b59e640 1 --2- 172.21.15.7:0/1878379607 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f137c0aeaf0 0x7f137c1854b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f137000c3f0 tx=0x7f137000c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:47.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.175+0000 7ff80dd9b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8100acf40 0x7ff810158be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:44194/0 (socket says 172.21.15.7:44194) 2024-04-25T09:54:47.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.175+0000 7ff80dd9b640 1 -- 172.21.15.7:0/539501271 learned_addr learned my addr 172.21.15.7:0/539501271 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:47.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.175+0000 7ff80e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff81006c280 0x7ff81014d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:59520/0 (socket says 172.21.15.7:59520) 2024-04-25T09:54:47.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.175+0000 7ff80ed9d640 1 --2- 172.21.15.7:0/539501271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8100b4810 0x7ff810159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.174+0000 7fa382730640 1 -- start start 2024-04-25T09:54:47.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.175+0000 7fa382730640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa37c0b04d0 0x7fa37c0cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.175+0000 7fa382730640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa37c0c3ae0 0x7fa37c15e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.175+0000 7fa382730640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa37c165410 0x7fa37c163b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.175+0000 7fa382730640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c0adcd0 con 0x7fa37c0b04d0 2024-04-25T09:54:47.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.175+0000 7fa382730640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c0cfc60 con 0x7fa37c165410 2024-04-25T09:54:47.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.175+0000 7fa382730640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c0ade50 con 0x7fa37c0c3ae0 2024-04-25T09:54:47.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.175+0000 7fb79b59e640 1 --2- 172.21.15.7:0/825322312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb784005210 0x7fb7840141d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb79c02d370 tx=0x7fb784005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f3a62134712b299 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:47.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.176+0000 7fa380ccd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa37c165410 0x7fa37c163b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.176+0000 7fee219d5640 1 -- 172.21.15.7:0/3635880235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedfc005290 con 0x7fee1404a310 2024-04-25T09:54:47.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.176+0000 7ff80dd9b640 1 -- 172.21.15.7:0/539501271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff81006c280 msgr2=0x7ff81014d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.176+0000 7ff80dd9b640 1 --2- 172.21.15.7:0/539501271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff81006c280 0x7ff81014d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.176+0000 7ff80dd9b640 1 -- 172.21.15.7:0/539501271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8100b4810 msgr2=0x7ff810159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.176+0000 7ff80dd9b640 1 --2- 172.21.15.7:0/539501271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8100b4810 0x7ff810159120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.176+0000 7ff80dd9b640 1 -- 172.21.15.7:0/539501271 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff81006da90 con 0x7ff8100acf40 2024-04-25T09:54:47.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.176+0000 7f84fabea640 1 -- 172.21.15.7:0/3565906128 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84ec0052b0 con 0x7f84ec0537a0 2024-04-25T09:54:47.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.175+0000 7f63d077e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f63c81570b0 0x7f63c814f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.175+0000 7f63d077e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c80c65e0 con 0x7f63c80ce890 2024-04-25T09:54:47.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.175+0000 7f63d077e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c815c900 con 0x7f63c8071ed0 2024-04-25T09:54:47.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.175+0000 7f63d077e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c806d860 con 0x7f63c81570b0 2024-04-25T09:54:47.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.175+0000 7f63cdd19640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63c80ce890 0x7f63c81579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.175+0000 7f63cdd19640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63c80ce890 0x7f63c81579f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43116/0 (socket says 172.21.15.7:43116) 2024-04-25T09:54:47.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.175+0000 7f63cdd19640 1 -- 172.21.15.7:0/1311659610 learned_addr learned my addr 172.21.15.7:0/1311659610 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:47.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.176+0000 7f63cdd19640 1 -- 172.21.15.7:0/1311659610 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f63c81570b0 msgr2=0x7f63c814f9b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T09:54:47.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.176+0000 7f63cdd19640 1 --2- 172.21.15.7:0/1311659610 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f63c81570b0 0x7f63c814f9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.176+0000 7fa380ccd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa37c165410 0x7fa37c163b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:59536/0 (socket says 172.21.15.7:59536) 2024-04-25T09:54:47.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.176+0000 7fa380ccd640 1 -- 172.21.15.7:0/415245019 learned_addr learned my addr 172.21.15.7:0/415245019 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:47.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.176+0000 7fa37b7fe640 1 --2- 172.21.15.7:0/415245019 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa37c0c3ae0 0x7fa37c15e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.176+0000 7fa37bfff640 1 --2- 172.21.15.7:0/415245019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa37c0b04d0 0x7fa37c0cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.176+0000 7f63cdd19640 1 -- 172.21.15.7:0/1311659610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63c8071ed0 msgr2=0x7f63c80b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.176+0000 7f63cdd19640 1 --2- 172.21.15.7:0/1311659610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63c8071ed0 0x7f63c80b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.176+0000 7f63cdd19640 1 -- 172.21.15.7:0/1311659610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c81582b0 con 0x7f63c80ce890 2024-04-25T09:54:47.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.176+0000 7fb799d9b640 1 -- 172.21.15.7:0/825322312 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79c0ab070 con 0x7fb784005210 2024-04-25T09:54:47.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.176+0000 7fb799d9b640 1 -- 172.21.15.7:0/825322312 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79c0a5e10 con 0x7fb784005210 2024-04-25T09:54:47.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.176+0000 7fb799d9b640 1 -- 172.21.15.7:0/825322312 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79c04fe10 con 0x7fb784005210 2024-04-25T09:54:47.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.176+0000 7fee03fff640 1 -- 172.21.15.7:0/3635880235 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee10015070 con 0x7fee1404a310 2024-04-25T09:54:47.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.176+0000 7f13637fe640 1 -- 172.21.15.7:0/1878379607 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13700052d0 con 0x7f137c0aeaf0 2024-04-25T09:54:47.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.176+0000 7f956d51b640 1 Processor -- start 2024-04-25T09:54:47.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.176+0000 7f63cdd19640 1 --2- 172.21.15.7:0/1311659610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63c80ce890 0x7f63c81579f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f63c0000f80 tx=0x7f63c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:47.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.176+0000 7f956d51b640 1 -- start start 2024-04-25T09:54:47.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.177+0000 7fa37bfff640 1 -- 172.21.15.7:0/415245019 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa37c0c3ae0 msgr2=0x7fa37c15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.176+0000 7f84ea7fc640 1 -- 172.21.15.7:0/3565906128 <== mon.1 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f84f40c0030 con 0x7f84ec0537a0 2024-04-25T09:54:47.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.177+0000 7fa37bfff640 1 --2- 172.21.15.7:0/415245019 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa37c0c3ae0 0x7fa37c15e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.177+0000 7f63beffd640 1 -- 172.21.15.7:0/1311659610 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c0040070 con 0x7f63c80ce890 2024-04-25T09:54:47.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.177+0000 7f63beffd640 1 -- 172.21.15.7:0/1311659610 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c0031bc0 con 0x7f63c80ce890 2024-04-25T09:54:47.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.177+0000 7fa37bfff640 1 -- 172.21.15.7:0/415245019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa37c165410 msgr2=0x7fa37c163b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.177+0000 7fa37bfff640 1 --2- 172.21.15.7:0/415245019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa37c165410 0x7fa37c163b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.177+0000 7fa37bfff640 1 -- 172.21.15.7:0/415245019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37c0cb8e0 con 0x7fa37c0b04d0 2024-04-25T09:54:47.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.177+0000 7f63beffd640 1 -- 172.21.15.7:0/1311659610 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c0045460 con 0x7f63c80ce890 2024-04-25T09:54:47.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.177+0000 7f63d077e640 1 -- 172.21.15.7:0/1311659610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c815cd20 con 0x7f63c80ce890 2024-04-25T09:54:47.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.177+0000 7f63d077e640 1 -- 172.21.15.7:0/1311659610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c815d2e0 con 0x7f63c80ce890 2024-04-25T09:54:47.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.177+0000 7fa37bfff640 1 --2- 172.21.15.7:0/415245019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa37c0b04d0 0x7fa37c0cc660 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa374030000 tx=0x7fa374004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:47.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.177+0000 7fb7a10ac640 1 -- 172.21.15.7:0/825322312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb784005210 msgr2=0x7fb7840141d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.177+0000 7fb7a10ac640 1 --2- 172.21.15.7:0/825322312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb784005210 0x7fb7840141d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb79c02d370 tx=0x7fb784005830 comp rx=0 tx=0).stop 2024-04-25T09:54:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.177+0000 7fb7a10ac640 1 -- 172.21.15.7:0/825322312 shutdown_connections 2024-04-25T09:54:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.177+0000 7fb7a10ac640 1 --2- 172.21.15.7:0/825322312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb784005210 0x7fb7840141d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.177+0000 7fb7a10ac640 1 -- 172.21.15.7:0/825322312 >> 172.21.15.7:0/825322312 conn(0x7fb794058ee0 msgr2=0x7fb7940592f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.177+0000 7f84ea7fc640 1 --2- 172.21.15.7:0/3565906128 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f84d806b5a0 0x7f84d806da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.177+0000 7f84ea7fc640 1 -- 172.21.15.7:0/3565906128 <== mon.1 v2:172.21.15.55:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f84f4125730 con 0x7f84ec0537a0 2024-04-25T09:54:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.177+0000 7f84f9be8640 1 --2- 172.21.15.7:0/3565906128 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f84d806b5a0 0x7f84d806da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.176+0000 7f13809f3640 1 -- 172.21.15.7:0/1878379607 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f137c16d850 con 0x7f137c0aeaf0 2024-04-25T09:54:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.176+0000 7f13809f3640 1 -- 172.21.15.7:0/1878379607 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f137c16de10 con 0x7f137c0aeaf0 2024-04-25T09:54:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.177+0000 7fa378ff9640 1 -- 172.21.15.7:0/415245019 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa374003b90 con 0x7fa37c0b04d0 2024-04-25T09:54:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.177+0000 7fa378ff9640 1 -- 172.21.15.7:0/415245019 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa374003d30 con 0x7fa37c0b04d0 2024-04-25T09:54:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.178+0000 7fa378ff9640 1 -- 172.21.15.7:0/415245019 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa374007af0 con 0x7fa37c0b04d0 2024-04-25T09:54:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.178+0000 7fa382730640 1 -- 172.21.15.7:0/415245019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa37c0ccba0 con 0x7fa37c0b04d0 2024-04-25T09:54:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.178+0000 7fa382730640 1 -- 172.21.15.7:0/415245019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa37c0cbe60 con 0x7fa37c0b04d0 2024-04-25T09:54:47.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.178+0000 7f956d51b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9560048600 0x7f9560035800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.178+0000 7f956d51b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f95600dfb90 0x7f956004ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.178+0000 7f9566ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9560048600 0x7f9560035800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.178+0000 7f9566ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9560048600 0x7f9560035800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:59550/0 (socket says 172.21.15.7:59550) 2024-04-25T09:54:47.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.178+0000 7f84f9be8640 1 --2- 172.21.15.7:0/3565906128 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f84d806b5a0 0x7f84d806da60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f84f0007fd0 tx=0x7f84f0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:47.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.178+0000 7f13617fa640 1 -- 172.21.15.7:0/1878379607 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f137c068f60 con 0x7f137c0aeaf0 2024-04-25T09:54:47.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.178+0000 7f13637fe640 1 -- 172.21.15.7:0/1878379607 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1370005470 con 0x7f137c0aeaf0 2024-04-25T09:54:47.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.178+0000 7ff80dd9b640 1 --2- 172.21.15.7:0/539501271 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8100acf40 0x7ff810158be0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff80400c420 tx=0x7ff80400c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:47.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.178+0000 7fa37b7fe640 1 --2- 172.21.15.7:0/415245019 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa37c0c3ae0 0x7fa37c15e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:47.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.178+0000 7f9566ffd640 1 -- 172.21.15.7:0/3319491463 learned_addr learned my addr 172.21.15.7:0/3319491463 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:47.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.178+0000 7f13637fe640 1 -- 172.21.15.7:0/1878379607 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1370007260 con 0x7f137c0aeaf0 2024-04-25T09:54:47.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.178+0000 7f956d51b640 1 --2- 172.21.15.7:0/3319491463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95600489e0 0x7f95600370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.178+0000 7f95667fc640 1 --2- 172.21.15.7:0/3319491463 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f95600dfb90 0x7f956004ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.178+0000 7fa380ccd640 1 --2- 172.21.15.7:0/415245019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa37c165410 0x7fa37c163b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:54:47.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.178+0000 7f956d51b640 1 -- 172.21.15.7:0/3319491463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95600e3db0 con 0x7f95600489e0 2024-04-25T09:54:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.179+0000 7f956d51b640 1 -- 172.21.15.7:0/3319491463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95600e3c30 con 0x7f9560048600 2024-04-25T09:54:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.179+0000 7f956d51b640 1 -- 172.21.15.7:0/3319491463 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95600e3f30 con 0x7f95600dfb90 2024-04-25T09:54:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.179+0000 7f95677fe640 1 --2- 172.21.15.7:0/3319491463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95600489e0 0x7f95600370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.179+0000 7f9566ffd640 1 -- 172.21.15.7:0/3319491463 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f95600dfb90 msgr2=0x7f956004ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.179+0000 7f9566ffd640 1 --2- 172.21.15.7:0/3319491463 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f95600dfb90 0x7f956004ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.179+0000 7f9566ffd640 1 -- 172.21.15.7:0/3319491463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95600489e0 msgr2=0x7f95600370c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.179+0000 7f9566ffd640 1 --2- 172.21.15.7:0/3319491463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95600489e0 0x7f95600370c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.179+0000 7f9566ffd640 1 -- 172.21.15.7:0/3319491463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f956004d0b0 con 0x7f9560048600 2024-04-25T09:54:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.179+0000 7f95677fe640 1 --2- 172.21.15.7:0/3319491463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95600489e0 0x7f95600370c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:54:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.179+0000 7fa382730640 1 -- 172.21.15.7:0/415245019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa37c068f60 con 0x7fa37c0b04d0 2024-04-25T09:54:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.180+0000 7f63beffd640 1 -- 172.21.15.7:0/1311659610 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f63c0039040 con 0x7f63c80ce890 2024-04-25T09:54:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.180+0000 7ff7feffd640 1 -- 172.21.15.7:0/539501271 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff804017070 con 0x7ff8100acf40 2024-04-25T09:54:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.180+0000 7f9566ffd640 1 --2- 172.21.15.7:0/3319491463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9560048600 0x7f9560035800 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f955c011930 tx=0x7f955c011df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:47.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.180+0000 7ff80f59e640 1 -- 172.21.15.7:0/539501271 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff81014d800 con 0x7ff8100acf40 2024-04-25T09:54:47.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.180+0000 7fb7a10ac640 1 -- 172.21.15.7:0/825322312 shutdown_connections 2024-04-25T09:54:47.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.180+0000 7ff80f59e640 1 -- 172.21.15.7:0/539501271 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff81006dfe0 con 0x7ff8100acf40 2024-04-25T09:54:47.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.180+0000 7fb7a10ac640 1 -- 172.21.15.7:0/825322312 wait complete. 2024-04-25T09:54:47.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.180+0000 7f63d077e640 1 -- 172.21.15.7:0/1311659610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c8068fd0 con 0x7f63c80ce890 2024-04-25T09:54:47.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.180+0000 7f13637fe640 1 -- 172.21.15.7:0/1878379607 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1370007400 con 0x7f137c0aeaf0 2024-04-25T09:54:47.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.180+0000 7fa378ff9640 1 -- 172.21.15.7:0/415245019 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa374007c90 con 0x7fa37c0b04d0 2024-04-25T09:54:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.179+0000 7fee03fff640 1 -- 172.21.15.7:0/3635880235 <== mon.1 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fee10007620 con 0x7fee1404a310 2024-04-25T09:54:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.180+0000 7fee03fff640 1 --2- 172.21.15.7:0/3635880235 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fee0806b700 0x7fee0806dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.180+0000 7fee03fff640 1 -- 172.21.15.7:0/3635880235 <== mon.1 v2:172.21.15.55:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fee1008a370 con 0x7fee1404a310 2024-04-25T09:54:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.180+0000 7f63beffd640 1 --2- 172.21.15.7:0/1311659610 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f63ac06b520 0x7f63ac06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.180+0000 7fee1affd640 1 --2- 172.21.15.7:0/3635880235 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fee0806b700 0x7fee0806dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.181+0000 7f63ce51a640 1 --2- 172.21.15.7:0/1311659610 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f63ac06b520 0x7f63ac06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.181+0000 7f13637fe640 1 --2- 172.21.15.7:0/1878379607 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f136806b5a0 0x7f136806da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.181+0000 7fa378ff9640 1 --2- 172.21.15.7:0/415245019 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa35c06b520 0x7fa35c06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.181+0000 7f63beffd640 1 -- 172.21.15.7:0/1311659610 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f63c00abd40 con 0x7f63c80ce890 2024-04-25T09:54:47.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.181+0000 7f13637fe640 1 -- 172.21.15.7:0/1878379607 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f1370089d70 con 0x7f137c0aeaf0 2024-04-25T09:54:47.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.181+0000 7fa378ff9640 1 -- 172.21.15.7:0/415245019 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa3740abaa0 con 0x7fa37c0b04d0 2024-04-25T09:54:47.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.181+0000 7fa37b7fe640 1 --2- 172.21.15.7:0/415245019 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa35c06b520 0x7fa35c06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.181+0000 7fee1affd640 1 --2- 172.21.15.7:0/3635880235 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fee0806b700 0x7fee0806dbc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fee1c050190 tx=0x7fee1c0a9000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:47.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.181+0000 7f137ad9d640 1 --2- 172.21.15.7:0/1878379607 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f136806b5a0 0x7f136806da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.181+0000 7f63ce51a640 1 --2- 172.21.15.7:0/1311659610 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f63ac06b520 0x7f63ac06d9e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f63c81514d0 tx=0x7f63b8007930 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:47.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.182+0000 7fa37b7fe640 1 --2- 172.21.15.7:0/415245019 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa35c06b520 0x7fa35c06d9e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa37c0c9850 tx=0x7fa36c007d20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:47.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.182+0000 7f137ad9d640 1 --2- 172.21.15.7:0/1878379607 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f136806b5a0 0x7f136806da60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f136c006fd0 tx=0x7f136c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:47.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.182+0000 7fee03fff640 1 -- 172.21.15.7:0/3635880235 <== mon.1 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fee100587c0 con 0x7fee1404a310 2024-04-25T09:54:47.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.182+0000 7ff80f59e640 1 -- 172.21.15.7:0/539501271 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff810068f60 con 0x7ff8100acf40 2024-04-25T09:54:47.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.182+0000 7fb7a10ac640 1 Processor -- start 2024-04-25T09:54:47.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.183+0000 7fb7a10ac640 1 -- start start 2024-04-25T09:54:47.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.183+0000 7ff7feffd640 1 -- 172.21.15.7:0/539501271 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff804005ce0 con 0x7ff8100acf40 2024-04-25T09:54:47.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.183+0000 7ff7feffd640 1 -- 172.21.15.7:0/539501271 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff804021060 con 0x7ff8100acf40 2024-04-25T09:54:47.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.184+0000 7f13637fe640 1 -- 172.21.15.7:0/1878379607 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1370058920 con 0x7f137c0aeaf0 2024-04-25T09:54:47.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.184+0000 7fb7a10ac640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb784005210 0x7fb7940d0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.184+0000 7fb7a10ac640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb794051cc0 0x7fb7940e5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.184+0000 7fb7a10ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb794052140 0x7fb794053cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.184+0000 7fb7a10ac640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb794058bd0 con 0x7fb784005210 2024-04-25T09:54:47.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.184+0000 7fb7a10ac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb794006690 con 0x7fb794052140 2024-04-25T09:54:47.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.184+0000 7fb79ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb784005210 0x7fb7940d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.184+0000 7fb79ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb784005210 0x7fb7940d0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43154/0 (socket says 172.21.15.7:43154) 2024-04-25T09:54:47.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.184+0000 7fb79ad9d640 1 -- 172.21.15.7:0/3544723601 learned_addr learned my addr 172.21.15.7:0/3544723601 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:47.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.184+0000 7fb79b59e640 1 --2- 172.21.15.7:0/3544723601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb794052140 0x7fb794053cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.184+0000 7fb79a59c640 1 --2- 172.21.15.7:0/3544723601 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb794051cc0 0x7fb7940e5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.185+0000 7ff7feffd640 1 -- 172.21.15.7:0/539501271 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff80401a070 con 0x7ff8100acf40 2024-04-25T09:54:47.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.185+0000 7fb7a10ac640 1 -- 172.21.15.7:0/3544723601 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7940e6100 con 0x7fb794051cc0 2024-04-25T09:54:47.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.186+0000 7f954f7fe640 1 -- 172.21.15.7:0/3319491463 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955c00faf0 con 0x7f9560048600 2024-04-25T09:54:47.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.186+0000 7f954f7fe640 1 -- 172.21.15.7:0/3319491463 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955c00fc90 con 0x7f9560048600 2024-04-25T09:54:47.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.186+0000 7f954f7fe640 1 -- 172.21.15.7:0/3319491463 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955c004020 con 0x7f9560048600 2024-04-25T09:54:47.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.186+0000 7ff7feffd640 1 --2- 172.21.15.7:0/539501271 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff7f006b4d0 0x7ff7f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.186+0000 7fb79ad9d640 1 -- 172.21.15.7:0/3544723601 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb794051cc0 msgr2=0x7fb7940e5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.186+0000 7fb79ad9d640 1 --2- 172.21.15.7:0/3544723601 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb794051cc0 0x7fb7940e5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.186+0000 7fb79ad9d640 1 -- 172.21.15.7:0/3544723601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb794052140 msgr2=0x7fb794053cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.186+0000 7fb79ad9d640 1 --2- 172.21.15.7:0/3544723601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb794052140 0x7fb794053cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.186+0000 7fb79ad9d640 1 -- 172.21.15.7:0/3544723601 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb794050f00 con 0x7fb784005210 2024-04-25T09:54:47.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.186+0000 7f956d51b640 1 -- 172.21.15.7:0/3319491463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f956004d390 con 0x7f9560048600 2024-04-25T09:54:47.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.186+0000 7f956d51b640 1 -- 172.21.15.7:0/3319491463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f956004d950 con 0x7f9560048600 2024-04-25T09:54:47.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.187+0000 7ff7feffd640 1 -- 172.21.15.7:0/539501271 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff804089ce0 con 0x7ff8100acf40 2024-04-25T09:54:47.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.187+0000 7ff80e59c640 1 --2- 172.21.15.7:0/539501271 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff7f006b4d0 0x7ff7f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.187+0000 7fb79ad9d640 1 --2- 172.21.15.7:0/3544723601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb784005210 0x7fb7940d0820 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb78c006270 tx=0x7fb78c006730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:47.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.187+0000 7fb79a59c640 1 --2- 172.21.15.7:0/3544723601 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb794051cc0 0x7fb7940e5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:47.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.187+0000 7ff80e59c640 1 --2- 172.21.15.7:0/539501271 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff7f006b4d0 0x7ff7f006d990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff8100b0e20 tx=0x7ff800007e80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:47.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.187+0000 7f84ea7fc640 1 -- 172.21.15.7:0/3565906128 <== mon.1 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f84f40c7020 con 0x7f84ec0537a0 2024-04-25T09:54:47.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.188+0000 7f956d51b640 1 -- 172.21.15.7:0/3319491463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95600052b0 con 0x7f9560048600 2024-04-25T09:54:47.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.187+0000 7f63beffd640 1 -- 172.21.15.7:0/1311659610 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f63c007ab10 con 0x7f63c80ce890 2024-04-25T09:54:47.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.189+0000 7ff7feffd640 1 -- 172.21.15.7:0/539501271 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff81014d800 con 0x7ff8100acf40 2024-04-25T09:54:47.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.189+0000 7f954f7fe640 1 -- 172.21.15.7:0/3319491463 <== mon.1 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f955c012040 con 0x7f9560048600 2024-04-25T09:54:47.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.189+0000 7f954f7fe640 1 --2- 172.21.15.7:0/3319491463 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f955406b5a0 0x7f955406da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.190+0000 7f954f7fe640 1 -- 172.21.15.7:0/3319491463 <== mon.1 v2:172.21.15.55:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f955c08a8d0 con 0x7f9560048600 2024-04-25T09:54:47.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.190+0000 7f95667fc640 1 --2- 172.21.15.7:0/3319491463 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f955406b5a0 0x7f955406da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.191+0000 7f95667fc640 1 --2- 172.21.15.7:0/3319491463 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f955406b5a0 0x7f955406da60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f95600d5ed0 tx=0x7f9558009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:47.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.192+0000 7fa378ff9640 1 -- 172.21.15.7:0/415245019 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa37407a5c0 con 0x7fa37c0b04d0 2024-04-25T09:54:47.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.192+0000 7fb7837fe640 1 -- 172.21.15.7:0/3544723601 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c028020 con 0x7fb784005210 2024-04-25T09:54:47.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.192+0000 7fb7837fe640 1 -- 172.21.15.7:0/3544723601 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78c0208e0 con 0x7fb784005210 2024-04-25T09:54:47.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.192+0000 7fb7837fe640 1 -- 172.21.15.7:0/3544723601 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c020cb0 con 0x7fb784005210 2024-04-25T09:54:47.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.192+0000 7fb7a10ac640 1 -- 172.21.15.7:0/3544723601 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7940511e0 con 0x7fb784005210 2024-04-25T09:54:47.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.192+0000 7fb7a10ac640 1 -- 172.21.15.7:0/3544723601 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7940d0d60 con 0x7fb784005210 2024-04-25T09:54:47.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.193+0000 7fb781ffb640 1 -- 172.21.15.7:0/3544723601 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb774005290 con 0x7fb784005210 2024-04-25T09:54:47.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.194+0000 7f954f7fe640 1 -- 172.21.15.7:0/3319491463 <== mon.1 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f955c019030 con 0x7f9560048600 2024-04-25T09:54:47.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.205+0000 7fb7837fe640 1 -- 172.21.15.7:0/3544723601 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb78c02b020 con 0x7fb784005210 2024-04-25T09:54:47.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.206+0000 7fb7837fe640 1 --2- 172.21.15.7:0/3544723601 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb78806b5d0 0x7fb78806da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:47.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.206+0000 7fb7837fe640 1 -- 172.21.15.7:0/3544723601 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb78c09bd00 con 0x7fb784005210 2024-04-25T09:54:47.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.206+0000 7fb7837fe640 1 -- 172.21.15.7:0/3544723601 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb78c032020 con 0x7fb784005210 2024-04-25T09:54:47.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.207+0000 7fb79a59c640 1 --2- 172.21.15.7:0/3544723601 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb78806b5d0 0x7fb78806da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:47.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.207+0000 7fb79a59c640 1 --2- 172.21.15.7:0/3544723601 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb78806b5d0 0x7fb78806da90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb79403efb0 tx=0x7fb790009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:47.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.604+0000 7f13617fa640 1 -- 172.21.15.7:0/1878379607 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f137c06d750 con 0x7f137c0aeaf0 2024-04-25T09:54:47.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.605+0000 7f13637fe640 1 -- 172.21.15.7:0/1878379607 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1370058220 con 0x7f137c0aeaf0 2024-04-25T09:54:47.607 INFO:teuthology.orchestra.run.smithi007.stdout:55834574856 2024-04-25T09:54:47.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.608+0000 7f13809f3640 1 -- 172.21.15.7:0/1878379607 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f136806b5a0 msgr2=0x7f136806da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.608+0000 7f13809f3640 1 --2- 172.21.15.7:0/1878379607 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f136806b5a0 0x7f136806da60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f136c006fd0 tx=0x7f136c008040 comp rx=0 tx=0).stop 2024-04-25T09:54:47.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.608+0000 7f13809f3640 1 -- 172.21.15.7:0/1878379607 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f137c0aeaf0 msgr2=0x7f137c1854b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.608+0000 7f13809f3640 1 --2- 172.21.15.7:0/1878379607 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f137c0aeaf0 0x7f137c1854b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f137000c3f0 tx=0x7f137000c8b0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.608+0000 7f13809f3640 1 -- 172.21.15.7:0/1878379607 shutdown_connections 2024-04-25T09:54:47.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.608+0000 7f13809f3640 1 --2- 172.21.15.7:0/1878379607 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f136806b5a0 0x7f136806da60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.608+0000 7f13809f3640 1 --2- 172.21.15.7:0/1878379607 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f137c0aeaf0 0x7f137c1854b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.608+0000 7f13809f3640 1 --2- 172.21.15.7:0/1878379607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f137c070f90 0x7f137c16ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.608+0000 7f13809f3640 1 --2- 172.21.15.7:0/1878379607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f137c06ea60 0x7f137c182d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.609+0000 7f13809f3640 1 -- 172.21.15.7:0/1878379607 >> 172.21.15.7:0/1878379607 conn(0x7f137c066ad0 msgr2=0x7f137c15b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:47.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.609+0000 7f13809f3640 1 -- 172.21.15.7:0/1878379607 shutdown_connections 2024-04-25T09:54:47.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.609+0000 7f13809f3640 1 -- 172.21.15.7:0/1878379607 wait complete. 2024-04-25T09:54:47.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.613+0000 7fee219d5640 1 -- 172.21.15.7:0/3635880235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fedfc005850 con 0x7fee1404a310 2024-04-25T09:54:47.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.613+0000 7fee03fff640 1 -- 172.21.15.7:0/3635880235 <== mon.1 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fee1005c860 con 0x7fee1404a310 2024-04-25T09:54:47.616 INFO:teuthology.orchestra.run.smithi007.stdout:55834574856 2024-04-25T09:54:47.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.614+0000 7f84fabea640 1 -- 172.21.15.7:0/3565906128 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f84ec03e2d0 con 0x7f84ec0537a0 2024-04-25T09:54:47.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.615+0000 7f84ea7fc640 1 -- 172.21.15.7:0/3565906128 <== mon.1 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f84f40f4250 con 0x7f84ec0537a0 2024-04-25T09:54:47.617 INFO:teuthology.orchestra.run.smithi007.stdout:60129542151 2024-04-25T09:54:47.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.617+0000 7fee219d5640 1 -- 172.21.15.7:0/3635880235 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fee0806b700 msgr2=0x7fee0806dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.617+0000 7fee219d5640 1 --2- 172.21.15.7:0/3635880235 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fee0806b700 0x7fee0806dbc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fee1c050190 tx=0x7fee1c0a9000 comp rx=0 tx=0).stop 2024-04-25T09:54:47.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.617+0000 7fee219d5640 1 -- 172.21.15.7:0/3635880235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee1404a310 msgr2=0x7fee140e0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.617+0000 7fee219d5640 1 --2- 172.21.15.7:0/3635880235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee1404a310 0x7fee140e0df0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fee1000c7f0 tx=0x7fee1000ccb0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.617+0000 7fee219d5640 1 -- 172.21.15.7:0/3635880235 shutdown_connections 2024-04-25T09:54:47.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.618+0000 7fee219d5640 1 --2- 172.21.15.7:0/3635880235 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fee0806b700 0x7fee0806dbc0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.618+0000 7fee219d5640 1 --2- 172.21.15.7:0/3635880235 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fee140529e0 0x7fee14171140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.618+0000 7fee219d5640 1 --2- 172.21.15.7:0/3635880235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee1404a310 0x7fee140e0df0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.618+0000 7fee219d5640 1 --2- 172.21.15.7:0/3635880235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee140361a0 0x7fee1400a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.618+0000 7fee219d5640 1 -- 172.21.15.7:0/3635880235 >> 172.21.15.7:0/3635880235 conn(0x7fee140537a0 msgr2=0x7fee14035910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:47.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.618+0000 7fee219d5640 1 -- 172.21.15.7:0/3635880235 shutdown_connections 2024-04-25T09:54:47.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.618+0000 7ff80f59e640 1 -- 172.21.15.7:0/539501271 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff810072690 con 0x7ff8100acf40 2024-04-25T09:54:47.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.618+0000 7fee219d5640 1 -- 172.21.15.7:0/3635880235 wait complete. 2024-04-25T09:54:47.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.618+0000 7f84d7fff640 1 -- 172.21.15.7:0/3565906128 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f84d806b5a0 msgr2=0x7f84d806da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.618+0000 7f84d7fff640 1 --2- 172.21.15.7:0/3565906128 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f84d806b5a0 0x7f84d806da60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f84f0007fd0 tx=0x7f84f0009040 comp rx=0 tx=0).stop 2024-04-25T09:54:47.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.618+0000 7f84d7fff640 1 -- 172.21.15.7:0/3565906128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84ec0537a0 msgr2=0x7f84ec17ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.619+0000 7f84d7fff640 1 --2- 172.21.15.7:0/3565906128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84ec0537a0 0x7f84ec17ba10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f84f406a4d0 tx=0x7f84f406aa10 comp rx=0 tx=0).stop 2024-04-25T09:54:47.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.619+0000 7f84d7fff640 1 -- 172.21.15.7:0/3565906128 shutdown_connections 2024-04-25T09:54:47.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.619+0000 7f84d7fff640 1 --2- 172.21.15.7:0/3565906128 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f84d806b5a0 0x7f84d806da60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.619+0000 7f84d7fff640 1 --2- 172.21.15.7:0/3565906128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84ec0537a0 0x7f84ec17ba10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.619+0000 7f84d7fff640 1 --2- 172.21.15.7:0/3565906128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84ec006690 0x7f84ec04ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.619+0000 7f84d7fff640 1 --2- 172.21.15.7:0/3565906128 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f84ec006200 0x7f84ec04e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.619+0000 7f84d7fff640 1 -- 172.21.15.7:0/3565906128 >> 172.21.15.7:0/3565906128 conn(0x7f84ec03aa30 msgr2=0x7f84ec0388a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:47.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.619+0000 7f84d7fff640 1 -- 172.21.15.7:0/3565906128 shutdown_connections 2024-04-25T09:54:47.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.619+0000 7f84d7fff640 1 -- 172.21.15.7:0/3565906128 wait complete. 2024-04-25T09:54:47.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.619+0000 7ff7feffd640 1 -- 172.21.15.7:0/539501271 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff8040582b0 con 0x7ff8100acf40 2024-04-25T09:54:47.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.622+0000 7f63d077e640 1 -- 172.21.15.7:0/1311659610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f63c815a460 con 0x7f63c80ce890 2024-04-25T09:54:47.625 INFO:teuthology.orchestra.run.smithi007.stdout:55834574856 2024-04-25T09:54:47.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.623+0000 7ff80f59e640 1 -- 172.21.15.7:0/539501271 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff7f006b4d0 msgr2=0x7ff7f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.623+0000 7ff80f59e640 1 --2- 172.21.15.7:0/539501271 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff7f006b4d0 0x7ff7f006d990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff8100b0e20 tx=0x7ff800007e80 comp rx=0 tx=0).stop 2024-04-25T09:54:47.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.623+0000 7ff80f59e640 1 -- 172.21.15.7:0/539501271 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8100acf40 msgr2=0x7ff810158be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.623+0000 7ff80f59e640 1 --2- 172.21.15.7:0/539501271 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8100acf40 0x7ff810158be0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff80400c420 tx=0x7ff80400c8e0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.623+0000 7f63beffd640 1 -- 172.21.15.7:0/1311659610 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f63c007a410 con 0x7f63c80ce890 2024-04-25T09:54:47.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.624+0000 7ff80f59e640 1 -- 172.21.15.7:0/539501271 shutdown_connections 2024-04-25T09:54:47.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.624+0000 7ff80f59e640 1 --2- 172.21.15.7:0/539501271 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff7f006b4d0 0x7ff7f006d990 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.624+0000 7ff80f59e640 1 --2- 172.21.15.7:0/539501271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8100b4810 0x7ff810159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.624+0000 7ff80f59e640 1 --2- 172.21.15.7:0/539501271 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8100acf40 0x7ff810158be0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.624+0000 7ff80f59e640 1 --2- 172.21.15.7:0/539501271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff81006c280 0x7ff81014d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.624+0000 7ff80f59e640 1 -- 172.21.15.7:0/539501271 >> 172.21.15.7:0/539501271 conn(0x7ff810071850 msgr2=0x7ff8100b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:47.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.624+0000 7ff80f59e640 1 -- 172.21.15.7:0/539501271 shutdown_connections 2024-04-25T09:54:47.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.624+0000 7ff80f59e640 1 -- 172.21.15.7:0/539501271 wait complete. 2024-04-25T09:54:47.628 INFO:teuthology.orchestra.run.smithi007.stdout:60129542150 2024-04-25T09:54:47.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.627+0000 7fb781ffb640 1 -- 172.21.15.7:0/3544723601 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb774005850 con 0x7fb784005210 2024-04-25T09:54:47.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.627+0000 7f63d077e640 1 -- 172.21.15.7:0/1311659610 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f63ac06b520 msgr2=0x7f63ac06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.627+0000 7f63d077e640 1 --2- 172.21.15.7:0/1311659610 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f63ac06b520 0x7f63ac06d9e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f63c81514d0 tx=0x7f63b8007930 comp rx=0 tx=0).stop 2024-04-25T09:54:47.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.627+0000 7f63d077e640 1 -- 172.21.15.7:0/1311659610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63c80ce890 msgr2=0x7f63c81579f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.628+0000 7f63d077e640 1 --2- 172.21.15.7:0/1311659610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63c80ce890 0x7f63c81579f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f63c0000f80 tx=0x7f63c0004a40 comp rx=0 tx=0).stop 2024-04-25T09:54:47.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.628+0000 7f63d077e640 1 -- 172.21.15.7:0/1311659610 shutdown_connections 2024-04-25T09:54:47.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.628+0000 7f63d077e640 1 --2- 172.21.15.7:0/1311659610 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f63ac06b520 0x7f63ac06d9e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.628+0000 7f63d077e640 1 --2- 172.21.15.7:0/1311659610 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f63c81570b0 0x7f63c814f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.628+0000 7f63d077e640 1 --2- 172.21.15.7:0/1311659610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63c80ce890 0x7f63c81579f0 secure :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f63c0000f80 tx=0x7f63c0004a40 comp rx=0 tx=0).stop 2024-04-25T09:54:47.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.628+0000 7f63d077e640 1 --2- 172.21.15.7:0/1311659610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63c8071ed0 0x7f63c80b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2024-04-25T09:54:47.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.628+0000 7f63d077e640 1 -- 172.21.15.7:0/1311659610 >> 172.21.15.7:0/1311659610 conn(0x7f63c8071150 msgr2=0x7f63c8159ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:47.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.628+0000 7fb7837fe640 1 -- 172.21.15.7:0/3544723601 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb78c06a8b0 con 0x7fb784005210 2024-04-25T09:54:47.633 INFO:teuthology.orchestra.run.smithi007.stdout:55834574856 2024-04-25T09:54:47.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.629+0000 7f63d077e640 1 -- 172.21.15.7:0/1311659610 shutdown_connections 2024-04-25T09:54:47.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.629+0000 7f63d077e640 1 -- 172.21.15.7:0/1311659610 wait complete. 2024-04-25T09:54:47.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.631+0000 7fb781ffb640 1 -- 172.21.15.7:0/3544723601 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb78806b5d0 msgr2=0x7fb78806da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.632+0000 7fb781ffb640 1 --2- 172.21.15.7:0/3544723601 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb78806b5d0 0x7fb78806da90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb79403efb0 tx=0x7fb790009040 comp rx=0 tx=0).stop 2024-04-25T09:54:47.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.632+0000 7fb781ffb640 1 -- 172.21.15.7:0/3544723601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb784005210 msgr2=0x7fb7940d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.632+0000 7fb781ffb640 1 --2- 172.21.15.7:0/3544723601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb784005210 0x7fb7940d0820 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb78c006270 tx=0x7fb78c006730 comp rx=0 tx=0).stop 2024-04-25T09:54:47.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.632+0000 7fb781ffb640 1 -- 172.21.15.7:0/3544723601 shutdown_connections 2024-04-25T09:54:47.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.632+0000 7fb781ffb640 1 --2- 172.21.15.7:0/3544723601 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb78806b5d0 0x7fb78806da90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.632+0000 7fb781ffb640 1 --2- 172.21.15.7:0/3544723601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb794052140 0x7fb794053cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.632+0000 7fb781ffb640 1 --2- 172.21.15.7:0/3544723601 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb794051cc0 0x7fb7940e5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.633+0000 7fb781ffb640 1 --2- 172.21.15.7:0/3544723601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb784005210 0x7fb7940d0820 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.633+0000 7fb781ffb640 1 -- 172.21.15.7:0/3544723601 >> 172.21.15.7:0/3544723601 conn(0x7fb794058ee0 msgr2=0x7fb7940d4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:47.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.633+0000 7fb781ffb640 1 -- 172.21.15.7:0/3544723601 shutdown_connections 2024-04-25T09:54:47.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.633+0000 7fb781ffb640 1 -- 172.21.15.7:0/3544723601 wait complete. 2024-04-25T09:54:47.642 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2024-04-25T09:54:47.643 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542151 for osd.6 2024-04-25T09:54:47.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.3 2024-04-25T09:54:47.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542150 for osd.4 2024-04-25T09:54:47.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.647+0000 7f956d51b640 1 -- 172.21.15.7:0/3319491463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f9560054290 con 0x7f9560048600 2024-04-25T09:54:47.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.647+0000 7f954f7fe640 1 -- 172.21.15.7:0/3319491463 <== mon.1 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f955c058d10 con 0x7f9560048600 2024-04-25T09:54:47.650 INFO:teuthology.orchestra.run.smithi007.stdout:60129542153 2024-04-25T09:54:47.651 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.1 2024-04-25T09:54:47.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.650+0000 7f956d51b640 1 -- 172.21.15.7:0/3319491463 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f955406b5a0 msgr2=0x7f955406da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.650+0000 7f956d51b640 1 --2- 172.21.15.7:0/3319491463 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f955406b5a0 0x7f955406da60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f95600d5ed0 tx=0x7f9558009040 comp rx=0 tx=0).stop 2024-04-25T09:54:47.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.650+0000 7f956d51b640 1 -- 172.21.15.7:0/3319491463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9560048600 msgr2=0x7f9560035800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.650+0000 7f956d51b640 1 --2- 172.21.15.7:0/3319491463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9560048600 0x7f9560035800 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f955c011930 tx=0x7f955c011df0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.650+0000 7f956d51b640 1 -- 172.21.15.7:0/3319491463 shutdown_connections 2024-04-25T09:54:47.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.650+0000 7f956d51b640 1 --2- 172.21.15.7:0/3319491463 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f955406b5a0 0x7f955406da60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.650+0000 7f956d51b640 1 --2- 172.21.15.7:0/3319491463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95600489e0 0x7f95600370c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.650+0000 7f956d51b640 1 --2- 172.21.15.7:0/3319491463 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f95600dfb90 0x7f956004ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.650+0000 7f956d51b640 1 --2- 172.21.15.7:0/3319491463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9560048600 0x7f9560035800 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.650+0000 7f956d51b640 1 -- 172.21.15.7:0/3319491463 >> 172.21.15.7:0/3319491463 conn(0x7f9560055390 msgr2=0x7f95600dde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:47.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.650+0000 7f956d51b640 1 -- 172.21.15.7:0/3319491463 shutdown_connections 2024-04-25T09:54:47.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.650+0000 7f956d51b640 1 -- 172.21.15.7:0/3319491463 wait complete. 2024-04-25T09:54:47.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.653+0000 7fa382730640 1 -- 172.21.15.7:0/415245019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa37c068f60 con 0x7fa37c0b04d0 2024-04-25T09:54:47.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.653+0000 7fa378ff9640 1 -- 172.21.15.7:0/415245019 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa374079ec0 con 0x7fa37c0b04d0 2024-04-25T09:54:47.656 INFO:teuthology.orchestra.run.smithi007.stdout:60129542151 2024-04-25T09:54:47.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.655+0000 7fa382730640 1 -- 172.21.15.7:0/415245019 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa35c06b520 msgr2=0x7fa35c06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.655+0000 7fa382730640 1 --2- 172.21.15.7:0/415245019 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa35c06b520 0x7fa35c06d9e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa37c0c9850 tx=0x7fa36c007d20 comp rx=0 tx=0).stop 2024-04-25T09:54:47.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.655+0000 7fa382730640 1 -- 172.21.15.7:0/415245019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa37c0b04d0 msgr2=0x7fa37c0cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.655+0000 7fa382730640 1 --2- 172.21.15.7:0/415245019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa37c0b04d0 0x7fa37c0cc660 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa374030000 tx=0x7fa374004a40 comp rx=0 tx=0).stop 2024-04-25T09:54:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.655+0000 7fa382730640 1 -- 172.21.15.7:0/415245019 shutdown_connections 2024-04-25T09:54:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.655+0000 7fa382730640 1 --2- 172.21.15.7:0/415245019 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa35c06b520 0x7fa35c06d9e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.655+0000 7fa382730640 1 --2- 172.21.15.7:0/415245019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa37c165410 0x7fa37c163b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.655+0000 7fa382730640 1 --2- 172.21.15.7:0/415245019 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa37c0c3ae0 0x7fa37c15e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.655+0000 7fa382730640 1 --2- 172.21.15.7:0/415245019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa37c0b04d0 0x7fa37c0cc660 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.655+0000 7fa382730640 1 -- 172.21.15.7:0/415245019 >> 172.21.15.7:0/415245019 conn(0x7fa37c0b1f70 msgr2=0x7fa37c0af550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.655+0000 7fa382730640 1 -- 172.21.15.7:0/415245019 shutdown_connections 2024-04-25T09:54:47.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:47.655+0000 7fa382730640 1 -- 172.21.15.7:0/415245019 wait complete. 2024-04-25T09:54:47.667 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542153 for osd.5 2024-04-25T09:54:47.670 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542151 for osd.7 2024-04-25T09:54:48.634 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T09:54:48.643 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T09:54:48.643 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T09:54:48.646 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T09:54:48.647 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T09:54:48.651 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T09:54:48.668 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T09:54:48.671 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T09:54:48.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.799+0000 7f6e22cd0640 1 Processor -- start 2024-04-25T09:54:48.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.799+0000 7f6e22cd0640 1 -- start start 2024-04-25T09:54:48.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.800+0000 7f6e22cd0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e1c0c4bc0 0x7f6e1c0cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.800+0000 7f6e22cd0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6e1c06bc70 0x7f6e1c06d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.800+0000 7f6e22cd0640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e1c162510 con 0x7f6e1c15c140 2024-04-25T09:54:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.800+0000 7f6e22cd0640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e1c1627f0 con 0x7f6e1c06bc70 2024-04-25T09:54:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.800+0000 7f6e22cd0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c162ad0 con 0x7f6e1c0c4bc0 2024-04-25T09:54:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.801+0000 7f6e224cf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6e1c06bc70 0x7f6e1c06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.801+0000 7f6e224cf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6e1c06bc70 0x7f6e1c06d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:59564/0 (socket says 172.21.15.7:59564) 2024-04-25T09:54:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.801+0000 7f6e224cf640 1 -- 172.21.15.7:0/2030375564 learned_addr learned my addr 172.21.15.7:0/2030375564 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.801+0000 7f6e214cd640 1 --2- 172.21.15.7:0/2030375564 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e1c0c4bc0 0x7f6e1c0cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.802+0000 7f6e224cf640 1 -- 172.21.15.7:0/2030375564 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e1c0c4bc0 msgr2=0x7f6e1c0cbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.802+0000 7f6e224cf640 1 --2- 172.21.15.7:0/2030375564 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e1c0c4bc0 0x7f6e1c0cbb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.802+0000 7f6e224cf640 1 -- 172.21.15.7:0/2030375564 >> v1:172.21.15.7:6789/0 conn(0x7f6e1c15c140 legacy=0x7f6e1c0c44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.802+0000 7f6e224cf640 1 -- 172.21.15.7:0/2030375564 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1c162db0 con 0x7f6e1c06bc70 2024-04-25T09:54:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.803+0000 7f6e224cf640 1 --2- 172.21.15.7:0/2030375564 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e1c06bc70 0x7f6e1c06d870 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6e14009e50 tx=0x7f6e1402a6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fbeb6238457a2b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:48.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.804+0000 7f6e20ccc640 1 -- 172.21.15.7:0/2030375564 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e14036070 con 0x7f6e1c06bc70 2024-04-25T09:54:48.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.804+0000 7f6e20ccc640 1 -- 172.21.15.7:0/2030375564 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e14031600 con 0x7f6e1c06bc70 2024-04-25T09:54:48.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.804+0000 7f6e20ccc640 1 -- 172.21.15.7:0/2030375564 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e140319d0 con 0x7f6e1c06bc70 2024-04-25T09:54:48.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.805+0000 7f6e22cd0640 1 -- 172.21.15.7:0/2030375564 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e1c06bc70 msgr2=0x7f6e1c06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:48.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.805+0000 7f6e22cd0640 1 --2- 172.21.15.7:0/2030375564 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e1c06bc70 0x7f6e1c06d870 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6e14009e50 tx=0x7f6e1402a6c0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.805+0000 7f6e22cd0640 1 -- 172.21.15.7:0/2030375564 shutdown_connections 2024-04-25T09:54:48.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.805+0000 7f6e22cd0640 1 --2- 172.21.15.7:0/2030375564 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e1c06bc70 0x7f6e1c06d870 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.805+0000 7f6e22cd0640 1 --2- 172.21.15.7:0/2030375564 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e1c0c4bc0 0x7f6e1c0cbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.805+0000 7f6e22cd0640 1 -- 172.21.15.7:0/2030375564 >> 172.21.15.7:0/2030375564 conn(0x7f6e1c0d14e0 msgr2=0x7f6e1c0d18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:48.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.805+0000 7f6e22cd0640 1 -- 172.21.15.7:0/2030375564 shutdown_connections 2024-04-25T09:54:48.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.805+0000 7f6e22cd0640 1 -- 172.21.15.7:0/2030375564 wait complete. 2024-04-25T09:54:48.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.808+0000 7f6e22cd0640 1 Processor -- start 2024-04-25T09:54:48.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.808+0000 7f6e22cd0640 1 -- start start 2024-04-25T09:54:48.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.809+0000 7f6e22cd0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e1c06bc70 0x7f6e1c0cae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.810+0000 7f6e22cd0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e1c0c4bc0 0x7f6e1c08a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.810+0000 7f6e22cd0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e1c15c140 0x7f6e1c087f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.810+0000 7f6e22cd0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c15c520 con 0x7f6e1c06bc70 2024-04-25T09:54:48.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.810+0000 7f6e22cd0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c1621c0 con 0x7f6e1c15c140 2024-04-25T09:54:48.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.810+0000 7f6e22cd0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c15c6a0 con 0x7f6e1c0c4bc0 2024-04-25T09:54:48.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.810+0000 7f6e21cce640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e1c06bc70 0x7f6e1c0cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.810+0000 7f6e214cd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e1c0c4bc0 0x7f6e1c08a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.810+0000 7f6e214cd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e1c0c4bc0 0x7f6e1c08a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:44242/0 (socket says 172.21.15.7:44242) 2024-04-25T09:54:48.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.810+0000 7f6e214cd640 1 -- 172.21.15.7:0/3606721077 learned_addr learned my addr 172.21.15.7:0/3606721077 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:48.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.810+0000 7f6e224cf640 1 --2- 172.21.15.7:0/3606721077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e1c15c140 0x7f6e1c087f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.811+0000 7f6e214cd640 1 -- 172.21.15.7:0/3606721077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e1c15c140 msgr2=0x7f6e1c087f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:48.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.811+0000 7f6e214cd640 1 --2- 172.21.15.7:0/3606721077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e1c15c140 0x7f6e1c087f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.811+0000 7f6e214cd640 1 -- 172.21.15.7:0/3606721077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e1c06bc70 msgr2=0x7f6e1c0cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:48.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.811+0000 7f6e214cd640 1 --2- 172.21.15.7:0/3606721077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e1c06bc70 0x7f6e1c0cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.811+0000 7f6e214cd640 1 -- 172.21.15.7:0/3606721077 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1c0c85b0 con 0x7f6e1c0c4bc0 2024-04-25T09:54:48.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.811+0000 7f6e21cce640 1 --2- 172.21.15.7:0/3606721077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e1c06bc70 0x7f6e1c0cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:48.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.812+0000 7f6e214cd640 1 --2- 172.21.15.7:0/3606721077 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e1c0c4bc0 0x7f6e1c08a960 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6e1800e9e0 tx=0x7f6e1800eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:48.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.814+0000 7f6e127fc640 1 -- 172.21.15.7:0/3606721077 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e18017070 con 0x7f6e1c0c4bc0 2024-04-25T09:54:48.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.814+0000 7f6e22cd0640 1 -- 172.21.15.7:0/3606721077 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1c0c8890 con 0x7f6e1c0c4bc0 2024-04-25T09:54:48.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.814+0000 7f6e22cd0640 1 -- 172.21.15.7:0/3606721077 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e1c0c8e50 con 0x7f6e1c0c4bc0 2024-04-25T09:54:48.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.814+0000 7f6e127fc640 1 -- 172.21.15.7:0/3606721077 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1800c9d0 con 0x7f6e1c0c4bc0 2024-04-25T09:54:48.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.814+0000 7f6e127fc640 1 -- 172.21.15.7:0/3606721077 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1800cdc0 con 0x7f6e1c0c4bc0 2024-04-25T09:54:48.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.818+0000 7f6e127fc640 1 -- 172.21.15.7:0/3606721077 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6e1801a070 con 0x7f6e1c0c4bc0 2024-04-25T09:54:48.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.819+0000 7f6e127fc640 1 --2- 172.21.15.7:0/3606721077 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6e0006b5a0 0x7f6e0006da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.819+0000 7f6e127fc640 1 -- 172.21.15.7:0/3606721077 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f6e1808a830 con 0x7f6e1c0c4bc0 2024-04-25T09:54:48.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.819+0000 7f6e21cce640 1 --2- 172.21.15.7:0/3606721077 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6e0006b5a0 0x7f6e0006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.820+0000 7f6e21cce640 1 --2- 172.21.15.7:0/3606721077 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6e0006b5a0 0x7f6e0006da60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c006fd0 tx=0x7f6e0c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:48.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.820+0000 7f6e22cd0640 1 -- 172.21.15.7:0/3606721077 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e04005290 con 0x7f6e1c0c4bc0 2024-04-25T09:54:48.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.826+0000 7f6e127fc640 1 -- 172.21.15.7:0/3606721077 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6e18058d40 con 0x7f6e1c0c4bc0 2024-04-25T09:54:48.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.854+0000 7f0091d6d640 1 Processor -- start 2024-04-25T09:54:48.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.855+0000 7f0091d6d640 1 -- start start 2024-04-25T09:54:48.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.856+0000 7f0091d6d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f008c159660 0x7f008c0cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.856+0000 7f0091d6d640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f008c0b28b0 con 0x7f008c0b2420 2024-04-25T09:54:48.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.856+0000 7f0091d6d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f008c0b2b90 con 0x7f008c0cbe70 2024-04-25T09:54:48.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.856+0000 7f0091d6d640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f008c0b2e70 con 0x7f008c159660 2024-04-25T09:54:48.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.856+0000 7f008bfff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f008c0b2420 0x7f008c071000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35632/0 (socket says 172.21.15.7:35632) 2024-04-25T09:54:48.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.857+0000 7f008bfff640 1 -- 172.21.15.7:0/2423509824 learned_addr learned my addr 172.21.15.7:0/2423509824 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:48.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.857+0000 7f0090d6b640 1 --2- 172.21.15.7:0/2423509824 >> v2:172.21.15.7:3300/0 conn(0x7f008c159660 0x7f008c0cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.857+0000 7f3a35638640 1 Processor -- start 2024-04-25T09:54:48.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.857+0000 7f3a35638640 1 -- start start 2024-04-25T09:54:48.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.857+0000 7f0090d6b640 1 -- 172.21.15.7:0/2423509824 >> v1:172.21.15.55:6789/0 conn(0x7f008c0cbe70 legacy=0x7f008c15d7c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T09:54:48.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.857+0000 7f0090d6b640 1 -- 172.21.15.7:0/2423509824 >> v1:172.21.15.7:6789/0 conn(0x7f008c0b2420 legacy=0x7f008c071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:48.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.857+0000 7f0090d6b640 1 -- 172.21.15.7:0/2423509824 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008c0b3150 con 0x7f008c159660 2024-04-25T09:54:48.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.859+0000 7f0090d6b640 1 --2- 172.21.15.7:0/2423509824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f008c159660 0x7f008c0cd5e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f007c0097d0 tx=0x7f007c02b320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=774a9cfca9e89abe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:48.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.858+0000 7f3865efa640 1 Processor -- start 2024-04-25T09:54:48.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.858+0000 7f3865efa640 1 -- start start 2024-04-25T09:54:48.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.859+0000 7f3865efa640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f38580510f0 0x7f38580eaac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.859+0000 7f3865efa640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38580545e0 con 0x7f3858055680 2024-04-25T09:54:48.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.859+0000 7f3865efa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38580548c0 con 0x7f38580e0000 2024-04-25T09:54:48.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.859+0000 7f3865efa640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38580e03e0 con 0x7f38580510f0 2024-04-25T09:54:48.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.859+0000 7f008b7fe640 1 -- 172.21.15.7:0/2423509824 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007c038070 con 0x7f008c159660 2024-04-25T09:54:48.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.859+0000 7f3a35638640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3a300b43c0 0x7f3a3006ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.859+0000 7f3a35638640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3a3006b0a0 0x7f3a300af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.859+0000 7f3a35638640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a300b59f0 con 0x7f3a3015c4e0 2024-04-25T09:54:48.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.859+0000 7f3a35638640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a300cf580 con 0x7f3a300b43c0 2024-04-25T09:54:48.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.859+0000 7f3a35638640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a300b3690 con 0x7f3a3006b0a0 2024-04-25T09:54:48.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.859+0000 7f3864ef8640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f38580e0000 0x7f3858053ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:42778/0 (socket says 172.21.15.7:42778) 2024-04-25T09:54:48.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.860+0000 7f008b7fe640 1 -- 172.21.15.7:0/2423509824 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007c033440 con 0x7f008c159660 2024-04-25T09:54:48.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.859+0000 7f3864ef8640 1 -- 172.21.15.7:0/1254186450 learned_addr learned my addr 172.21.15.7:0/1254186450 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:48.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.860+0000 7f3a2effd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3a3015c4e0 0x7f3a300b4f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:42772/0 (socket says 172.21.15.7:42772) 2024-04-25T09:54:48.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.860+0000 7f3a2effd640 1 -- 172.21.15.7:0/3667701171 learned_addr learned my addr 172.21.15.7:0/3667701171 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:48.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.860+0000 7f4ebd71b640 1 Processor -- start 2024-04-25T09:54:48.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.859+0000 7f3a2e7fc640 1 --2- 172.21.15.7:0/3667701171 >> v2:172.21.15.7:3300/0 conn(0x7f3a300b43c0 0x7f3a3006ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.860+0000 7f3a2f7fe640 1 --2- 172.21.15.7:0/3667701171 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3a3006b0a0 0x7f3a300af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.860+0000 7f4ebd71b640 1 -- start start 2024-04-25T09:54:48.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.860+0000 7f385f7fe640 1 -- 172.21.15.7:0/1254186450 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3388867209 0 0) 0x7f38580548c0 con 0x7f38580e0000 2024-04-25T09:54:48.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.860+0000 7f385f7fe640 1 -- 172.21.15.7:0/1254186450 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3850003520 con 0x7f38580e0000 2024-04-25T09:54:48.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.860+0000 7f008b7fe640 1 -- 172.21.15.7:0/2423509824 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007c033810 con 0x7f008c159660 2024-04-25T09:54:48.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.859+0000 7f883293b640 1 Processor -- start 2024-04-25T09:54:48.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.859+0000 7f883293b640 1 -- start start 2024-04-25T09:54:48.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f883293b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f882c1426c0 0x7f882c06e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f0091d6d640 1 -- 172.21.15.7:0/2423509824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f008c159660 msgr2=0x7f008c0cd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:48.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f0091d6d640 1 --2- 172.21.15.7:0/2423509824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f008c159660 0x7f008c0cd5e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f007c0097d0 tx=0x7f007c02b320 comp rx=0 tx=0).stop 2024-04-25T09:54:48.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f883293b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f882c0ceee0 0x7f882c15b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f883293b640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f882c06d5a0 con 0x7f882c15a9a0 2024-04-25T09:54:48.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f883293b640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f882c06d880 con 0x7f882c1426c0 2024-04-25T09:54:48.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f883293b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f882c06db60 con 0x7f882c0ceee0 2024-04-25T09:54:48.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f8830ed8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f882c0ceee0 0x7f882c15b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f882bfff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f882c1426c0 0x7f882c06e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f882bfff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f882c1426c0 0x7f882c06e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43174/0 (socket says 172.21.15.7:43174) 2024-04-25T09:54:48.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f882bfff640 1 -- 172.21.15.7:0/482686584 learned_addr learned my addr 172.21.15.7:0/482686584 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:48.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f3a2e7fc640 1 -- 172.21.15.7:0/3667701171 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3a3006b0a0 msgr2=0x7f3a300af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:48.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f3a2e7fc640 1 --2- 172.21.15.7:0/3667701171 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3a3006b0a0 0x7f3a300af4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f3a2e7fc640 1 -- 172.21.15.7:0/3667701171 >> v1:172.21.15.55:6789/0 conn(0x7f3a3015c4e0 legacy=0x7f3a300b4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:48.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f3a2e7fc640 1 -- 172.21.15.7:0/3667701171 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a300b38e0 con 0x7f3a300b43c0 2024-04-25T09:54:48.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f0091d6d640 1 -- 172.21.15.7:0/2423509824 shutdown_connections 2024-04-25T09:54:48.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f0091d6d640 1 --2- 172.21.15.7:0/2423509824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f008c159660 0x7f008c0cd5e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.862+0000 7f4ebd71b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4eb8143400 0x7f4eb815b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.862+0000 7f4ebd71b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4eb815b9a0 0x7f4eb80cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.862+0000 7f4ebd71b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4eb8071c40 0x7f4eb80cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f0091d6d640 1 -- 172.21.15.7:0/2423509824 >> 172.21.15.7:0/2423509824 conn(0x7f008c066b00 msgr2=0x7f008c06ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:48.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.862+0000 7f4ebd71b640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eb806d1f0 con 0x7f4eb815b9a0 2024-04-25T09:54:48.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.862+0000 7f0091d6d640 1 -- 172.21.15.7:0/2423509824 shutdown_connections 2024-04-25T09:54:48.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.862+0000 7f4ebd71b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eb806d4d0 con 0x7f4eb8071c40 2024-04-25T09:54:48.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.862+0000 7f4ebd71b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb806d7b0 con 0x7f4eb8143400 2024-04-25T09:54:48.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.860+0000 7f38656f9640 1 --2- 172.21.15.7:0/1254186450 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f38580510f0 0x7f38580eaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f385f7fe640 1 -- 172.21.15.7:0/1254186450 <== mon.1 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3834948017 0 0) 0x7f3850003520 con 0x7f38580e0000 2024-04-25T09:54:48.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f385f7fe640 1 -- 172.21.15.7:0/1254186450 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f38580510f0 msgr2=0x7f38580eaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:48.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f385f7fe640 1 --2- 172.21.15.7:0/1254186450 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f38580510f0 0x7f38580eaac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f385f7fe640 1 -- 172.21.15.7:0/1254186450 >> v1:172.21.15.7:6789/0 conn(0x7f3858055680 legacy=0x7f38580509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:48.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f385f7fe640 1 -- 172.21.15.7:0/1254186450 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3858054ba0 con 0x7f38580e0000 2024-04-25T09:54:48.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.862+0000 7f8830ed8640 1 -- 172.21.15.7:0/482686584 >> v2:172.21.15.7:3300/0 conn(0x7f882c1426c0 msgr2=0x7f882c06e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:48.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.862+0000 7f8830ed8640 1 --2- 172.21.15.7:0/482686584 >> v2:172.21.15.7:3300/0 conn(0x7f882c1426c0 0x7f882c06e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.862+0000 7f8830ed8640 1 -- 172.21.15.7:0/482686584 >> v1:172.21.15.7:6789/0 conn(0x7f882c15a9a0 legacy=0x7f882c0ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:48.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.862+0000 7f8830ed8640 1 -- 172.21.15.7:0/482686584 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882c06de40 con 0x7f882c0ceee0 2024-04-25T09:54:48.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f385f7fe640 1 -- 172.21.15.7:0/1254186450 <== mon.1 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f384c001670 con 0x7f38580e0000 2024-04-25T09:54:48.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f385f7fe640 1 -- 172.21.15.7:0/1254186450 >> v1:172.21.15.55:6789/0 conn(0x7f38580e0000 legacy=0x7f3858053ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:48.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f385f7fe640 1 --2- 172.21.15.7:0/1254186450 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f38580510f0 0x7f3850003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f385f7fe640 1 --2- 172.21.15.7:0/1254186450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3850004160 0x7f3850004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f385f7fe640 1 --2- 172.21.15.7:0/1254186450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3850004d40 0x7f38500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f385f7fe640 1 -- 172.21.15.7:0/1254186450 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38580e03e0 con 0x7f3850004d40 2024-04-25T09:54:48.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f385f7fe640 1 -- 172.21.15.7:0/1254186450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38500145c0 con 0x7f3850004160 2024-04-25T09:54:48.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f385f7fe640 1 -- 172.21.15.7:0/1254186450 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3850014740 con 0x7f38580510f0 2024-04-25T09:54:48.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f385ffff640 1 --2- 172.21.15.7:0/1254186450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3850004160 0x7f3850004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.861+0000 7f3864ef8640 1 --2- 172.21.15.7:0/1254186450 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f38580510f0 0x7f3850003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.862+0000 7f38656f9640 1 --2- 172.21.15.7:0/1254186450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3850004d40 0x7f38500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.862+0000 7f4eb77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4eb8071c40 0x7f4eb80cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.862+0000 7f4eb77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4eb8071c40 0x7f4eb80cef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:59582/0 (socket says 172.21.15.7:59582) 2024-04-25T09:54:48.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.862+0000 7f4eb77fe640 1 -- 172.21.15.7:0/2181720301 learned_addr learned my addr 172.21.15.7:0/2181720301 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:48.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.862+0000 7f0091d6d640 1 -- 172.21.15.7:0/2423509824 wait complete. 2024-04-25T09:54:48.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.862+0000 7f385ffff640 1 -- 172.21.15.7:0/1254186450 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f38580510f0 msgr2=0x7f3850003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:48.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.862+0000 7f385ffff640 1 --2- 172.21.15.7:0/1254186450 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f38580510f0 0x7f3850003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.862+0000 7f385ffff640 1 -- 172.21.15.7:0/1254186450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3850004d40 msgr2=0x7f38500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:48.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.862+0000 7f385ffff640 1 --2- 172.21.15.7:0/1254186450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3850004d40 0x7f38500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.862+0000 7f385ffff640 1 -- 172.21.15.7:0/1254186450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3850003520 con 0x7f3850004160 2024-04-25T09:54:48.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.862+0000 7f4eb6ffd640 1 --2- 172.21.15.7:0/2181720301 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4eb8143400 0x7f4eb815b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.862+0000 7f4eaffff640 1 --2- 172.21.15.7:0/2181720301 >> v2:172.21.15.7:3300/0 conn(0x7f4eb815b9a0 0x7f4eb80cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.862+0000 7f4eb77fe640 1 -- 172.21.15.7:0/2181720301 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4eb8143400 msgr2=0x7f4eb815b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:48.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.862+0000 7f4eb77fe640 1 --2- 172.21.15.7:0/2181720301 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4eb8143400 0x7f4eb815b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.862+0000 7f4eb77fe640 1 -- 172.21.15.7:0/2181720301 >> v2:172.21.15.7:3300/0 conn(0x7f4eb815b9a0 msgr2=0x7f4eb80cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:48.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.862+0000 7f4eb77fe640 1 --2- 172.21.15.7:0/2181720301 >> v2:172.21.15.7:3300/0 conn(0x7f4eb815b9a0 0x7f4eb80cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.862+0000 7f4eb77fe640 1 -- 172.21.15.7:0/2181720301 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb806da90 con 0x7f4eb8071c40 2024-04-25T09:54:48.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.863+0000 7f25133a5640 1 Processor -- start 2024-04-25T09:54:48.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.863+0000 7f3a2e7fc640 1 --2- 172.21.15.7:0/3667701171 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a300b43c0 0x7f3a3006ab60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3a20009a00 tx=0x7f3a2002a3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f6529d3b7a6a9ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:48.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.863+0000 7f4eaffff640 1 --2- 172.21.15.7:0/2181720301 >> v2:172.21.15.7:3300/0 conn(0x7f4eb815b9a0 0x7f4eb80cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:48.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.863+0000 7f3a2dffb640 1 -- 172.21.15.7:0/3667701171 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a20037070 con 0x7f3a300b43c0 2024-04-25T09:54:48.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.863+0000 7f8830ed8640 1 --2- 172.21.15.7:0/482686584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f882c0ceee0 0x7f882c15b140 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f882400f370 tx=0x7f882402eab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf4ea0e3a9125165 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:48.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.863+0000 7f4eb77fe640 1 --2- 172.21.15.7:0/2181720301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4eb8071c40 0x7f4eb80cef90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4eb80b2780 tx=0x7f4eb002a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f216cfeda71c95c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:48.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.863+0000 7f25133a5640 1 -- start start 2024-04-25T09:54:48.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.864+0000 7f3a2dffb640 1 -- 172.21.15.7:0/3667701171 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a20032440 con 0x7f3a300b43c0 2024-04-25T09:54:48.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.864+0000 7f4eb67fc640 1 -- 172.21.15.7:0/2181720301 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0036070 con 0x7f4eb8071c40 2024-04-25T09:54:48.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.864+0000 7f4eb67fc640 1 -- 172.21.15.7:0/2181720301 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb0031600 con 0x7f4eb8071c40 2024-04-25T09:54:48.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.864+0000 7f4eb67fc640 1 -- 172.21.15.7:0/2181720301 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb00319d0 con 0x7f4eb8071c40 2024-04-25T09:54:48.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.864+0000 7f882affd640 1 -- 172.21.15.7:0/482686584 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8824036070 con 0x7f882c0ceee0 2024-04-25T09:54:48.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.864+0000 7f0091d6d640 1 Processor -- start 2024-04-25T09:54:48.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.864+0000 7f0091d6d640 1 -- start start 2024-04-25T09:54:48.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.864+0000 7f882affd640 1 -- 172.21.15.7:0/482686584 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882400d4e0 con 0x7f882c0ceee0 2024-04-25T09:54:48.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.863+0000 7f3659730640 1 Processor -- start 2024-04-25T09:54:48.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.863+0000 7f3659730640 1 -- start start 2024-04-25T09:54:48.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.864+0000 7f3a2dffb640 1 -- 172.21.15.7:0/3667701171 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a20037070 con 0x7f3a300b43c0 2024-04-25T09:54:48.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.864+0000 7f3a35638640 1 -- 172.21.15.7:0/3667701171 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a300b43c0 msgr2=0x7f3a3006ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:48.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f3a35638640 1 --2- 172.21.15.7:0/3667701171 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a300b43c0 0x7f3a3006ab60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3a20009a00 tx=0x7f3a2002a3a0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.864+0000 7f25133a5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25040e3620 0x7f2504058940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.864+0000 7f25133a5640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f250403c0c0 con 0x7f2504054030 2024-04-25T09:54:48.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.864+0000 7f25133a5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2504007540 con 0x7f25040e3240 2024-04-25T09:54:48.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.864+0000 7f25133a5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2504007820 con 0x7f25040e3620 2024-04-25T09:54:48.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f3a35638640 1 -- 172.21.15.7:0/3667701171 shutdown_connections 2024-04-25T09:54:48.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f3a35638640 1 --2- 172.21.15.7:0/3667701171 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a300b43c0 0x7f3a3006ab60 secure :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3a20009a00 tx=0x7f3a2002a3a0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f3a35638640 1 --2- 172.21.15.7:0/3667701171 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3a3006b0a0 0x7f3a300af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f3a35638640 1 -- 172.21.15.7:0/3667701171 >> 172.21.15.7:0/3667701171 conn(0x7f3a300b2390 msgr2=0x7f3a300b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:48.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.864+0000 7f25123a3640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f25040e3240 0x7f2504053920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:42788/0 (socket says 172.21.15.7:42788) 2024-04-25T09:54:48.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.864+0000 7f25123a3640 1 -- 172.21.15.7:0/1664871785 learned_addr learned my addr 172.21.15.7:0/1664871785 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:48.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f882affd640 1 -- 172.21.15.7:0/482686584 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882400b960 con 0x7f882c0ceee0 2024-04-25T09:54:48.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f3659730640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f36540b2ef0 0x7f3654162d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f3a35638640 1 -- 172.21.15.7:0/3667701171 shutdown_connections 2024-04-25T09:54:48.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f4ebd71b640 1 -- 172.21.15.7:0/2181720301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4eb8071c40 msgr2=0x7f4eb80cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:48.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f4ebd71b640 1 --2- 172.21.15.7:0/2181720301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4eb8071c40 0x7f4eb80cef90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4eb80b2780 tx=0x7f4eb002a6a0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f3a35638640 1 -- 172.21.15.7:0/3667701171 wait complete. 2024-04-25T09:54:48.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f3659730640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3654166330 con 0x7f365415fb00 2024-04-25T09:54:48.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f883293b640 1 -- 172.21.15.7:0/482686584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f882c0ceee0 msgr2=0x7f882c15b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:48.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f883293b640 1 --2- 172.21.15.7:0/482686584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f882c0ceee0 0x7f882c15b140 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f882400f370 tx=0x7f882402eab0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f385ffff640 1 --2- 172.21.15.7:0/1254186450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3850004160 0x7f3850004800 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3854001680 tx=0x7f3850005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64fecd9914de6911 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:48.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f25113a1640 1 -- 172.21.15.7:0/1664871785 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 681031950 0 0) 0x7f2504007540 con 0x7f25040e3240 2024-04-25T09:54:48.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f25113a1640 1 -- 172.21.15.7:0/1664871785 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24f8003520 con 0x7f25040e3240 2024-04-25T09:54:48.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f2511ba2640 1 --2- 172.21.15.7:0/1664871785 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25040e3620 0x7f2504058940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f3659730640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3654166610 con 0x7f36540b5350 2024-04-25T09:54:48.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f3659730640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f365415fee0 con 0x7f36540b2ef0 2024-04-25T09:54:48.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f36527fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f36540b2ef0 0x7f3654162d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f36537fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f36540b5350 0x7f36540d14a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:42792/0 (socket says 172.21.15.7:42792) 2024-04-25T09:54:48.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f36537fe640 1 -- 172.21.15.7:0/921508527 learned_addr learned my addr 172.21.15.7:0/921508527 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:48.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f883293b640 1 -- 172.21.15.7:0/482686584 shutdown_connections 2024-04-25T09:54:48.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f883293b640 1 --2- 172.21.15.7:0/482686584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f882c0ceee0 0x7f882c15b140 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f883293b640 1 --2- 172.21.15.7:0/482686584 >> v2:172.21.15.7:3300/0 conn(0x7f882c1426c0 0x7f882c06e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f883293b640 1 -- 172.21.15.7:0/482686584 >> 172.21.15.7:0/482686584 conn(0x7f882c071150 msgr2=0x7f882c071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:48.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f4ebd71b640 1 -- 172.21.15.7:0/2181720301 shutdown_connections 2024-04-25T09:54:48.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f4ebd71b640 1 --2- 172.21.15.7:0/2181720301 >> v2:172.21.15.7:3300/0 conn(0x7f4eb815b9a0 0x7f4eb80cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f4ebd71b640 1 --2- 172.21.15.7:0/2181720301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4eb8071c40 0x7f4eb80cef90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f385f7fe640 1 -- 172.21.15.7:0/1254186450 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38540012a0 con 0x7f3850004160 2024-04-25T09:54:48.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f4ebd71b640 1 --2- 172.21.15.7:0/2181720301 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4eb8143400 0x7f4eb815b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.865+0000 7f4ebd71b640 1 -- 172.21.15.7:0/2181720301 >> 172.21.15.7:0/2181720301 conn(0x7f4eb8071150 msgr2=0x7f4eb8071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:48.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.866+0000 7f0091d6d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f008c0cbe70 0x7f008c150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.866+0000 7f2511ba2640 1 -- 172.21.15.7:0/1664871785 >> v1:172.21.15.55:6789/0 conn(0x7f25040e3240 legacy=0x7f2504053920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:48.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.866+0000 7f2511ba2640 1 -- 172.21.15.7:0/1664871785 >> v1:172.21.15.7:6789/0 conn(0x7f2504054030 legacy=0x7f250403c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:48.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.866+0000 7f4ebd71b640 1 -- 172.21.15.7:0/2181720301 shutdown_connections 2024-04-25T09:54:48.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.866+0000 7f4ebd71b640 1 -- 172.21.15.7:0/2181720301 wait complete. 2024-04-25T09:54:48.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.866+0000 7f883293b640 1 -- 172.21.15.7:0/482686584 shutdown_connections 2024-04-25T09:54:48.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.866+0000 7f0090d6b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f008c0cbe70 0x7f008c150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.866+0000 7f0090d6b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f008c0cbe70 0x7f008c150a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43198/0 (socket says 172.21.15.7:43198) 2024-04-25T09:54:48.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.866+0000 7f0090d6b640 1 -- 172.21.15.7:0/4108765084 learned_addr learned my addr 172.21.15.7:0/4108765084 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:48.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.866+0000 7f0091d6d640 1 --2- 172.21.15.7:0/4108765084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f008c159660 0x7f008c0cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.866+0000 7f385f7fe640 1 -- 172.21.15.7:0/1254186450 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38540052d0 con 0x7f3850004160 2024-04-25T09:54:48.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.866+0000 7f0091d6d640 1 --2- 172.21.15.7:0/4108765084 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f008c15c0a0 0x7f008c15c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.867+0000 7f385f7fe640 1 -- 172.21.15.7:0/1254186450 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385402aaf0 con 0x7f3850004160 2024-04-25T09:54:48.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.867+0000 7f008bfff640 1 --2- 172.21.15.7:0/4108765084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f008c159660 0x7f008c0cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.867+0000 7f0091d6d640 1 -- 172.21.15.7:0/4108765084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008c071890 con 0x7f008c0cbe70 2024-04-25T09:54:48.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.867+0000 7f0091d6d640 1 -- 172.21.15.7:0/4108765084 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008c071710 con 0x7f008c159660 2024-04-25T09:54:48.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.867+0000 7f0091d6d640 1 -- 172.21.15.7:0/4108765084 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008c159a40 con 0x7f008c15c0a0 2024-04-25T09:54:48.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.866+0000 7f883293b640 1 -- 172.21.15.7:0/482686584 wait complete. 2024-04-25T09:54:48.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.867+0000 7f3a35638640 1 Processor -- start 2024-04-25T09:54:48.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.867+0000 7f009156c640 1 --2- 172.21.15.7:0/4108765084 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f008c15c0a0 0x7f008c15c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.866+0000 7f36527fc640 1 -- 172.21.15.7:0/921508527 >> v1:172.21.15.55:6789/0 conn(0x7f36540b5350 legacy=0x7f36540d14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:48.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.866+0000 7f36527fc640 1 -- 172.21.15.7:0/921508527 >> v1:172.21.15.7:6789/0 conn(0x7f365415fb00 legacy=0x7f3654165a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:48.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.866+0000 7f36527fc640 1 -- 172.21.15.7:0/921508527 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36541668f0 con 0x7f36540b2ef0 2024-04-25T09:54:48.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.867+0000 7f3a35638640 1 -- start start 2024-04-25T09:54:48.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.867+0000 7f3865efa640 1 -- 172.21.15.7:0/1254186450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3850004160 msgr2=0x7f3850004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:48.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.867+0000 7f3865efa640 1 --2- 172.21.15.7:0/1254186450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3850004160 0x7f3850004800 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3854001680 tx=0x7f3850005830 comp rx=0 tx=0).stop 2024-04-25T09:54:48.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.867+0000 7f36527fc640 1 --2- 172.21.15.7:0/921508527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36540b2ef0 0x7f3654162d50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3648009750 tx=0x7f364802a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44ac87f8237482ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:48.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.867+0000 7f38656f9640 1 -- 172.21.15.7:0/1254186450 reap_dead start 2024-04-25T09:54:48.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.867+0000 7f3865efa640 1 -- 172.21.15.7:0/1254186450 shutdown_connections 2024-04-25T09:54:48.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.867+0000 7f3865efa640 1 -- 172.21.15.7:0/1254186450 >> 172.21.15.7:0/1254186450 conn(0x7f3858055c10 msgr2=0x7f3858056020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:48.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.867+0000 7f3865efa640 1 -- 172.21.15.7:0/1254186450 shutdown_connections 2024-04-25T09:54:48.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.867+0000 7f3865efa640 1 -- 172.21.15.7:0/1254186450 wait complete. 2024-04-25T09:54:48.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.867+0000 7f009156c640 1 -- 172.21.15.7:0/4108765084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f008c159660 msgr2=0x7f008c0cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:48.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.867+0000 7f009156c640 1 --2- 172.21.15.7:0/4108765084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f008c159660 0x7f008c0cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.867+0000 7f009156c640 1 -- 172.21.15.7:0/4108765084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f008c0cbe70 msgr2=0x7f008c150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:48.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.867+0000 7f009156c640 1 --2- 172.21.15.7:0/4108765084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f008c0cbe70 0x7f008c150a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.867+0000 7f009156c640 1 -- 172.21.15.7:0/4108765084 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008c0afbd0 con 0x7f008c15c0a0 2024-04-25T09:54:48.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.867+0000 7f2511ba2640 1 -- 172.21.15.7:0/1664871785 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2504007b00 con 0x7f25040e3620 2024-04-25T09:54:48.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.868+0000 7f3651ffb640 1 -- 172.21.15.7:0/921508527 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3648037070 con 0x7f36540b2ef0 2024-04-25T09:54:48.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.868+0000 7f3651ffb640 1 -- 172.21.15.7:0/921508527 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364802ad70 con 0x7f36540b2ef0 2024-04-25T09:54:48.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.868+0000 7f3651ffb640 1 -- 172.21.15.7:0/921508527 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3648032660 con 0x7f36540b2ef0 2024-04-25T09:54:48.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.868+0000 7f3a35638640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a3006b0a0 0x7f3a30150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.868+0000 7f3a35638640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3a3015c4e0 0x7f3a301fb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.868+0000 7f3a35638640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a30153900 0x7f3a30070120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.868+0000 7f3a35638640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a300b3ea0 con 0x7f3a30153900 2024-04-25T09:54:48.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.868+0000 7f009156c640 1 --2- 172.21.15.7:0/4108765084 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f008c15c0a0 0x7f008c15c530 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f008000b410 tx=0x7f008000b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:48.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.868+0000 7f3a35638640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3006b4e0 con 0x7f3a3006b0a0 2024-04-25T09:54:48.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.868+0000 7f3a35638640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a300b5640 con 0x7f3a3015c4e0 2024-04-25T09:54:48.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.868+0000 7f3a2e7fc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3a3015c4e0 0x7f3a301fb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.868+0000 7f3a2e7fc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3a3015c4e0 0x7f3a301fb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:44294/0 (socket says 172.21.15.7:44294) 2024-04-25T09:54:48.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.868+0000 7f3a2e7fc640 1 -- 172.21.15.7:0/3579014396 learned_addr learned my addr 172.21.15.7:0/3579014396 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:48.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.868+0000 7f3a2f7fe640 1 --2- 172.21.15.7:0/3579014396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a30153900 0x7f3a30070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.869+0000 7f2511ba2640 1 --2- 172.21.15.7:0/1664871785 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25040e3620 0x7f2504058940 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f25080097d0 tx=0x7f250802a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14b2c35775a294ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:48.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.869+0000 7f00897fa640 1 -- 172.21.15.7:0/4108765084 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0080015020 con 0x7f008c15c0a0 2024-04-25T09:54:48.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.869+0000 7f00897fa640 1 -- 172.21.15.7:0/4108765084 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0080011830 con 0x7f008c15c0a0 2024-04-25T09:54:48.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.869+0000 7f00897fa640 1 -- 172.21.15.7:0/4108765084 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0080015020 con 0x7f008c15c0a0 2024-04-25T09:54:48.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.869+0000 7f0091d6d640 1 -- 172.21.15.7:0/4108765084 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f008c0afeb0 con 0x7f008c15c0a0 2024-04-25T09:54:48.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.869+0000 7f3659730640 1 -- 172.21.15.7:0/921508527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36540b2ef0 msgr2=0x7f3654162d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:48.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.869+0000 7f3659730640 1 --2- 172.21.15.7:0/921508527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36540b2ef0 0x7f3654162d50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3648009750 tx=0x7f364802a060 comp rx=0 tx=0).stop 2024-04-25T09:54:48.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.869+0000 7f3659730640 1 -- 172.21.15.7:0/921508527 shutdown_connections 2024-04-25T09:54:48.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.869+0000 7f3659730640 1 --2- 172.21.15.7:0/921508527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36540b2ef0 0x7f3654162d50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.869+0000 7f3659730640 1 -- 172.21.15.7:0/921508527 >> 172.21.15.7:0/921508527 conn(0x7f3654072290 msgr2=0x7f3654072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:48.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.869+0000 7f3a2e7fc640 1 -- 172.21.15.7:0/3579014396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a3006b0a0 msgr2=0x7f3a30150590 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T09:54:48.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.869+0000 7f3a2e7fc640 1 --2- 172.21.15.7:0/3579014396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a3006b0a0 0x7f3a30150590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.869+0000 7f3a2e7fc640 1 -- 172.21.15.7:0/3579014396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a30153900 msgr2=0x7f3a30070120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:48.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.869+0000 7f3a2e7fc640 1 --2- 172.21.15.7:0/3579014396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a30153900 0x7f3a30070120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.869+0000 7f3a2e7fc640 1 -- 172.21.15.7:0/3579014396 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a301fba00 con 0x7f3a3015c4e0 2024-04-25T09:54:48.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.869+0000 7f3865efa640 1 Processor -- start 2024-04-25T09:54:48.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.869+0000 7f0091d6d640 1 -- 172.21.15.7:0/4108765084 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f008c0b0470 con 0x7f008c15c0a0 2024-04-25T09:54:48.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.869+0000 7f3a2e7fc640 1 --2- 172.21.15.7:0/3579014396 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3a3015c4e0 0x7f3a301fb100 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3a20009b20 tx=0x7f3a200046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:48.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.868+0000 7f4ebd71b640 1 Processor -- start 2024-04-25T09:54:48.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.868+0000 7f4ebd71b640 1 -- start start 2024-04-25T09:54:48.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.869+0000 7f4ebd71b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4eb8071c40 0x7f4eb8200140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.869+0000 7f4ebd71b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4eb8143400 0x7f4eb80b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.869+0000 7f4ebd71b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eb815b9a0 0x7f4eb81ed9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.869+0000 7f4ebd71b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb815af90 con 0x7f4eb815b9a0 2024-04-25T09:54:48.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.869+0000 7f4ebd71b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb815ae10 con 0x7f4eb8143400 2024-04-25T09:54:48.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.869+0000 7f4ebd71b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb80cb560 con 0x7f4eb8071c40 2024-04-25T09:54:48.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.869+0000 7f4eb6ffd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4eb8071c40 0x7f4eb8200140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.869+0000 7f3a177fe640 1 -- 172.21.15.7:0/3579014396 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a20037040 con 0x7f3a3015c4e0 2024-04-25T09:54:48.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.870+0000 7f3a177fe640 1 -- 172.21.15.7:0/3579014396 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a200325f0 con 0x7f3a3015c4e0 2024-04-25T09:54:48.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.870+0000 7f25113a1640 1 -- 172.21.15.7:0/1664871785 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2508037070 con 0x7f25040e3620 2024-04-25T09:54:48.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.870+0000 7f25113a1640 1 -- 172.21.15.7:0/1664871785 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2508032440 con 0x7f25040e3620 2024-04-25T09:54:48.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.870+0000 7f25113a1640 1 -- 172.21.15.7:0/1664871785 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25080327f0 con 0x7f25040e3620 2024-04-25T09:54:48.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.869+0000 7f3865efa640 1 -- start start 2024-04-25T09:54:48.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.871+0000 7f3865efa640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3850004160 0x7f38580cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.871+0000 7f3865efa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f385804f7e0 0x7f385804e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.871+0000 7f3865efa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f385804e950 0x7f385804edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.871+0000 7f3865efa640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385803b8d0 con 0x7f385804f7e0 2024-04-25T09:54:48.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.871+0000 7f3865efa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3858055160 con 0x7f385804e950 2024-04-25T09:54:48.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.871+0000 7f3865efa640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f385803ba50 con 0x7f3850004160 2024-04-25T09:54:48.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.871+0000 7f385ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f385804f7e0 0x7f385804e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.869+0000 7f4eaffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4eb8143400 0x7f4eb80b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.869+0000 7f4eaffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4eb8143400 0x7f4eb80b35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:59602/0 (socket says 172.21.15.7:59602) 2024-04-25T09:54:48.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.869+0000 7f4eaffff640 1 -- 172.21.15.7:0/3412938911 learned_addr learned my addr 172.21.15.7:0/3412938911 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:48.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.869+0000 7f4eb77fe640 1 --2- 172.21.15.7:0/3412938911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eb815b9a0 0x7f4eb81ed9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.870+0000 7f4eb77fe640 1 -- 172.21.15.7:0/3412938911 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4eb8071c40 msgr2=0x7f4eb8200140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:48.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.870+0000 7f4eb77fe640 1 --2- 172.21.15.7:0/3412938911 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4eb8071c40 0x7f4eb8200140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.870+0000 7f4eb77fe640 1 -- 172.21.15.7:0/3412938911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4eb8143400 msgr2=0x7f4eb80b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:48.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.870+0000 7f4eb77fe640 1 --2- 172.21.15.7:0/3412938911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4eb8143400 0x7f4eb80b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.870+0000 7f4eb77fe640 1 -- 172.21.15.7:0/3412938911 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb82016e0 con 0x7f4eb815b9a0 2024-04-25T09:54:48.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.870+0000 7f4eb77fe640 1 --2- 172.21.15.7:0/3412938911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eb815b9a0 0x7f4eb81ed9a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0030000 tx=0x7f4eb0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:48.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.871+0000 7f25133a5640 1 -- 172.21.15.7:0/1664871785 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25040e3620 msgr2=0x7f2504058940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:48.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.871+0000 7f25133a5640 1 --2- 172.21.15.7:0/1664871785 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25040e3620 0x7f2504058940 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f25080097d0 tx=0x7f250802a290 comp rx=0 tx=0).stop 2024-04-25T09:54:48.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.870+0000 7f3659730640 1 -- 172.21.15.7:0/921508527 shutdown_connections 2024-04-25T09:54:48.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.870+0000 7f3a177fe640 1 -- 172.21.15.7:0/3579014396 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a20006e10 con 0x7f3a3015c4e0 2024-04-25T09:54:48.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.870+0000 7f3a35638640 1 -- 172.21.15.7:0/3579014396 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a301fbce0 con 0x7f3a3015c4e0 2024-04-25T09:54:48.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.870+0000 7f3a35638640 1 -- 172.21.15.7:0/3579014396 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a301ea600 con 0x7f3a3015c4e0 2024-04-25T09:54:48.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.871+0000 7f38656f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f385804e950 0x7f385804edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.871+0000 7f38656f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f385804e950 0x7f385804edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:59608/0 (socket says 172.21.15.7:59608) 2024-04-25T09:54:48.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.871+0000 7f38656f9640 1 -- 172.21.15.7:0/3960919853 learned_addr learned my addr 172.21.15.7:0/3960919853 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:48.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.870+0000 7f3659730640 1 -- 172.21.15.7:0/921508527 wait complete. 2024-04-25T09:54:48.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.871+0000 7f00897fa640 1 -- 172.21.15.7:0/4108765084 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0080018020 con 0x7f008c15c0a0 2024-04-25T09:54:48.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.871+0000 7f3864ef8640 1 --2- 172.21.15.7:0/3960919853 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3850004160 0x7f38580cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.872+0000 7f25133a5640 1 -- 172.21.15.7:0/1664871785 shutdown_connections 2024-04-25T09:54:48.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.872+0000 7f25133a5640 1 --2- 172.21.15.7:0/1664871785 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25040e3620 0x7f2504058940 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.872+0000 7f25133a5640 1 -- 172.21.15.7:0/1664871785 >> 172.21.15.7:0/1664871785 conn(0x7f25040590c0 msgr2=0x7f25040594d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:48.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.872+0000 7f4eaf7fe640 1 -- 172.21.15.7:0/3412938911 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0036050 con 0x7f4eb815b9a0 2024-04-25T09:54:48.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.872+0000 7f4eaf7fe640 1 -- 172.21.15.7:0/3412938911 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb0042070 con 0x7f4eb815b9a0 2024-04-25T09:54:48.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.872+0000 7f4eaf7fe640 1 -- 172.21.15.7:0/3412938911 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0009510 con 0x7f4eb815b9a0 2024-04-25T09:54:48.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.872+0000 7f00897fa640 1 --2- 172.21.15.7:0/4108765084 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f007806b8d0 0x7f007806dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.872+0000 7f4ebd71b640 1 -- 172.21.15.7:0/3412938911 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb82019c0 con 0x7f4eb815b9a0 2024-04-25T09:54:48.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.871+0000 7f38656f9640 1 -- 172.21.15.7:0/3960919853 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3850004160 msgr2=0x7f38580cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:48.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.871+0000 7f38656f9640 1 --2- 172.21.15.7:0/3960919853 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3850004160 0x7f38580cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.871+0000 7f38656f9640 1 -- 172.21.15.7:0/3960919853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f385804f7e0 msgr2=0x7f385804e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:48.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.872+0000 7f4ebd71b640 1 -- 172.21.15.7:0/3412938911 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb8201f80 con 0x7f4eb815b9a0 2024-04-25T09:54:48.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.872+0000 7f883293b640 1 Processor -- start 2024-04-25T09:54:48.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.872+0000 7f883293b640 1 -- start start 2024-04-25T09:54:48.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.873+0000 7f25133a5640 1 -- 172.21.15.7:0/1664871785 shutdown_connections 2024-04-25T09:54:48.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.873+0000 7f25133a5640 1 -- 172.21.15.7:0/1664871785 wait complete. 2024-04-25T09:54:48.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.873+0000 7f3659730640 1 Processor -- start 2024-04-25T09:54:48.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.873+0000 7f38656f9640 1 --2- 172.21.15.7:0/3960919853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f385804f7e0 0x7f385804e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.872+0000 7f3a157fa640 1 -- 172.21.15.7:0/3579014396 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a08005290 con 0x7f3a3015c4e0 2024-04-25T09:54:48.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.873+0000 7f38656f9640 1 -- 172.21.15.7:0/3960919853 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385804fc60 con 0x7f385804e950 2024-04-25T09:54:48.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.873+0000 7f3864ef8640 1 --2- 172.21.15.7:0/3960919853 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3850004160 0x7f38580cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:48.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.873+0000 7f385ffff640 1 --2- 172.21.15.7:0/3960919853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f385804f7e0 0x7f385804e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:54:48.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.873+0000 7f883293b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f882c0ceee0 0x7f882c140d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.873+0000 7f883293b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f882c1426c0 0x7f882c0cc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.873+0000 7f883293b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f882c15a9a0 0x7f882c1583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.873+0000 7f883293b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882c15ae20 con 0x7f882c1426c0 2024-04-25T09:54:48.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.873+0000 7f883293b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882c1433f0 con 0x7f882c0ceee0 2024-04-25T09:54:48.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.873+0000 7f883293b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f882c15afa0 con 0x7f882c15a9a0 2024-04-25T09:54:48.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.873+0000 7f4ebd71b640 1 -- 172.21.15.7:0/3412938911 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e9c005290 con 0x7f4eb815b9a0 2024-04-25T09:54:48.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.872+0000 7f0091d6d640 1 -- 172.21.15.7:0/4108765084 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f008c073ce0 con 0x7f008c15c0a0 2024-04-25T09:54:48.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.873+0000 7f0090d6b640 1 --2- 172.21.15.7:0/4108765084 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f007806b8d0 0x7f007806dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.873+0000 7f3a177fe640 1 -- 172.21.15.7:0/3579014396 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3a200329e0 con 0x7f3a3015c4e0 2024-04-25T09:54:48.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.874+0000 7f882bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f882c0ceee0 0x7f882c140d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.874+0000 7f882bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f882c0ceee0 0x7f882c140d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:59616/0 (socket says 172.21.15.7:59616) 2024-04-25T09:54:48.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.874+0000 7f882bfff640 1 -- 172.21.15.7:0/2146776663 learned_addr learned my addr 172.21.15.7:0/2146776663 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:48.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.874+0000 7f00897fa640 1 -- 172.21.15.7:0/4108765084 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0080011630 con 0x7f008c15c0a0 2024-04-25T09:54:48.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.874+0000 7f8830ed8640 1 --2- 172.21.15.7:0/2146776663 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f882c15a9a0 0x7f882c1583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.874+0000 7f3659730640 1 -- start start 2024-04-25T09:54:48.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.874+0000 7f882bfff640 1 -- 172.21.15.7:0/2146776663 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f882c15a9a0 msgr2=0x7f882c1583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:48.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.874+0000 7f882bfff640 1 --2- 172.21.15.7:0/2146776663 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f882c15a9a0 0x7f882c1583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.874+0000 7f882bfff640 1 -- 172.21.15.7:0/2146776663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f882c1426c0 msgr2=0x7f882c0cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:48.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.874+0000 7f882bfff640 1 --2- 172.21.15.7:0/2146776663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f882c1426c0 0x7f882c0cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.874+0000 7f882bfff640 1 -- 172.21.15.7:0/2146776663 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882c0ccc70 con 0x7f882c0ceee0 2024-04-25T09:54:48.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.874+0000 7f8830ed8640 1 --2- 172.21.15.7:0/2146776663 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f882c15a9a0 0x7f882c1583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:48.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.874+0000 7f3a177fe640 1 --2- 172.21.15.7:0/3579014396 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3a1c06b4d0 0x7f3a1c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.874+0000 7f3a177fe640 1 -- 172.21.15.7:0/3579014396 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f3a200aad10 con 0x7f3a3015c4e0 2024-04-25T09:54:48.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.874+0000 7f3a2effd640 1 --2- 172.21.15.7:0/3579014396 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3a1c06b4d0 0x7f3a1c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.874+0000 7f0090d6b640 1 --2- 172.21.15.7:0/4108765084 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f007806b8d0 0x7f007806dd90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f007c0335c0 tx=0x7f007c02f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:48.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.875+0000 7f4eaf7fe640 1 -- 172.21.15.7:0/3412938911 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4eb0007bb0 con 0x7f4eb815b9a0 2024-04-25T09:54:48.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.875+0000 7f25133a5640 1 Processor -- start 2024-04-25T09:54:48.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.875+0000 7f882bfff640 1 --2- 172.21.15.7:0/2146776663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f882c0ceee0 0x7f882c140d10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f881c007810 tx=0x7f881c007cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:48.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.875+0000 7f3a2effd640 1 --2- 172.21.15.7:0/3579014396 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3a1c06b4d0 0x7f3a1c06d990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3a2800ab90 tx=0x7f3a28009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:48.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.875+0000 7f25133a5640 1 -- start start 2024-04-25T09:54:48.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.875+0000 7f3659730640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36540b2ef0 0x7f36540d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.875+0000 7f3659730640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36540b5350 0x7f36540ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.875+0000 7f3659730640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f365415fb00 0x7f3654154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.875+0000 7f4eaf7fe640 1 --2- 172.21.15.7:0/3412938911 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4e9806b520 0x7f4e9806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.875+0000 7f3659730640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3654163410 con 0x7f36540b2ef0 2024-04-25T09:54:48.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.875+0000 7f3659730640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3654163290 con 0x7f36540b5350 2024-04-25T09:54:48.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.875+0000 7f3659730640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36540d1bb0 con 0x7f365415fb00 2024-04-25T09:54:48.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.875+0000 7f38656f9640 1 --2- 172.21.15.7:0/3960919853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f385804e950 0x7f385804edd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3860067990 tx=0x7f3860067f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:48.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.875+0000 7f8828ff9640 1 -- 172.21.15.7:0/2146776663 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c01c070 con 0x7f882c0ceee0 2024-04-25T09:54:48.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.875+0000 7f883293b640 1 -- 172.21.15.7:0/2146776663 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f882c0ccf50 con 0x7f882c0ceee0 2024-04-25T09:54:48.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.875+0000 7f883293b640 1 -- 172.21.15.7:0/2146776663 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f882c0cd510 con 0x7f882c0ceee0 2024-04-25T09:54:48.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.875+0000 7f4eaf7fe640 1 -- 172.21.15.7:0/3412938911 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f4eb00ab3a0 con 0x7f4eb815b9a0 2024-04-25T09:54:48.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.875+0000 7f4eb6ffd640 1 --2- 172.21.15.7:0/3412938911 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4e9806b520 0x7f4e9806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.875+0000 7f8828ff9640 1 -- 172.21.15.7:0/2146776663 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881c009de0 con 0x7f882c0ceee0 2024-04-25T09:54:48.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.876+0000 7f8828ff9640 1 -- 172.21.15.7:0/2146776663 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c0176a0 con 0x7f882c0ceee0 2024-04-25T09:54:48.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.876+0000 7f4eb6ffd640 1 --2- 172.21.15.7:0/3412938911 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4e9806b520 0x7f4e9806d9e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8006fd0 tx=0x7f4ea8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:48.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.876+0000 7f36537fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f365415fb00 0x7f3654154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.876+0000 7f3652ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36540b2ef0 0x7f36540d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.876+0000 7f3652ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36540b2ef0 0x7f36540d09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43250/0 (socket says 172.21.15.7:43250) 2024-04-25T09:54:48.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.876+0000 7f3652ffd640 1 -- 172.21.15.7:0/3540894696 learned_addr learned my addr 172.21.15.7:0/3540894696 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:48.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.876+0000 7f385d7fa640 1 -- 172.21.15.7:0/3960919853 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3860073a60 con 0x7f385804e950 2024-04-25T09:54:48.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.876+0000 7f385d7fa640 1 -- 172.21.15.7:0/3960919853 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3860073c00 con 0x7f385804e950 2024-04-25T09:54:48.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.877+0000 7f25133a5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2504054030 0x7f250404f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.877+0000 7f25133a5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25040e3240 0x7f25040dd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.877+0000 7f25123a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2504054030 0x7f250404f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.877+0000 7f25123a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2504054030 0x7f250404f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:59634/0 (socket says 172.21.15.7:59634) 2024-04-25T09:54:48.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.877+0000 7f25123a3640 1 -- 172.21.15.7:0/3552283015 learned_addr learned my addr 172.21.15.7:0/3552283015 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:48.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.877+0000 7f25133a5640 1 --2- 172.21.15.7:0/3552283015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25040e3620 0x7f25040ded90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.877+0000 7f2511ba2640 1 --2- 172.21.15.7:0/3552283015 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25040e3240 0x7f25040dd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.877+0000 7f883293b640 1 -- 172.21.15.7:0/2146776663 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f882c068fd0 con 0x7f882c0ceee0 2024-04-25T09:54:48.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.877+0000 7f25133a5640 1 -- 172.21.15.7:0/3552283015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2504006f50 con 0x7f25040e3620 2024-04-25T09:54:48.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.877+0000 7f25133a5640 1 -- 172.21.15.7:0/3552283015 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2504006dd0 con 0x7f2504054030 2024-04-25T09:54:48.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.877+0000 7f25133a5640 1 -- 172.21.15.7:0/3552283015 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25040070d0 con 0x7f25040e3240 2024-04-25T09:54:48.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.877+0000 7f3865efa640 1 -- 172.21.15.7:0/3960919853 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f385804dff0 con 0x7f385804e950 2024-04-25T09:54:48.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.877+0000 7f3865efa640 1 -- 172.21.15.7:0/3960919853 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38580d1a20 con 0x7f385804e950 2024-04-25T09:54:48.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.877+0000 7f3652ffd640 1 -- 172.21.15.7:0/3540894696 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f365415fb00 msgr2=0x7f3654154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:48.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.877+0000 7f3652ffd640 1 --2- 172.21.15.7:0/3540894696 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f365415fb00 0x7f3654154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.877+0000 7f3652ffd640 1 -- 172.21.15.7:0/3540894696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36540b5350 msgr2=0x7f36540ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:48.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.877+0000 7f3652ffd640 1 --2- 172.21.15.7:0/3540894696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36540b5350 0x7f36540ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.877+0000 7f3652ffd640 1 -- 172.21.15.7:0/3540894696 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36540cd440 con 0x7f36540b2ef0 2024-04-25T09:54:48.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.877+0000 7f36537fe640 1 --2- 172.21.15.7:0/3540894696 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f365415fb00 0x7f3654154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:48.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.877+0000 7f3652ffd640 1 --2- 172.21.15.7:0/3540894696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36540b2ef0 0x7f36540d09f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f364400c400 tx=0x7f364400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:48.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.878+0000 7f385d7fa640 1 -- 172.21.15.7:0/3960919853 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3860095630 con 0x7f385804e950 2024-04-25T09:54:48.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.878+0000 7f2514607640 1 --2- 172.21.15.7:0/3552283015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25040e3620 0x7f25040ded90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.878+0000 7f8828ff9640 1 -- 172.21.15.7:0/2146776663 <== mon.1 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f881c01f070 con 0x7f882c0ceee0 2024-04-25T09:54:48.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.878+0000 7f8828ff9640 1 --2- 172.21.15.7:0/2146776663 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f881806b4d0 0x7f881806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.878+0000 7f00897fa640 1 -- 172.21.15.7:0/4108765084 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f008c073ce0 con 0x7f008c15c0a0 2024-04-25T09:54:48.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.878+0000 7f2514607640 1 -- 172.21.15.7:0/3552283015 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25040e3240 msgr2=0x7f25040dd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:48.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.878+0000 7f2514607640 1 --2- 172.21.15.7:0/3552283015 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25040e3240 0x7f25040dd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.878+0000 7f2514607640 1 -- 172.21.15.7:0/3552283015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2504054030 msgr2=0x7f250404f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:48.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.878+0000 7f2514607640 1 --2- 172.21.15.7:0/3552283015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2504054030 0x7f250404f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:48.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.878+0000 7f2514607640 1 -- 172.21.15.7:0/3552283015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250404fe00 con 0x7f25040e3620 2024-04-25T09:54:48.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.878+0000 7f8828ff9640 1 -- 172.21.15.7:0/2146776663 <== mon.1 v2:172.21.15.55:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f881c08a6f0 con 0x7f882c0ceee0 2024-04-25T09:54:48.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.878+0000 7f882b7fe640 1 --2- 172.21.15.7:0/2146776663 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f881806b4d0 0x7f881806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.878+0000 7f3865efa640 1 -- 172.21.15.7:0/3960919853 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3858005700 con 0x7f385804e950 2024-04-25T09:54:48.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.879+0000 7f2514607640 1 --2- 172.21.15.7:0/3552283015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25040e3620 0x7f25040ded90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f250405a190 tx=0x7f24fc00c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:48.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.879+0000 7f882b7fe640 1 --2- 172.21.15.7:0/2146776663 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f881806b4d0 0x7f881806d990 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8820000f60 tx=0x7f88200079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:48.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.880+0000 7f385d7fa640 1 -- 172.21.15.7:0/3960919853 <== mon.1 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f386009c060 con 0x7f385804e950 2024-04-25T09:54:48.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.880+0000 7f385d7fa640 1 --2- 172.21.15.7:0/3960919853 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f384406b5d0 0x7f384406da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.880+0000 7f3864ef8640 1 --2- 172.21.15.7:0/3960919853 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f384406b5d0 0x7f384406da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.880+0000 7f385d7fa640 1 -- 172.21.15.7:0/3960919853 <== mon.1 v2:172.21.15.55:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f3860104990 con 0x7f385804e950 2024-04-25T09:54:48.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.881+0000 7f3864ef8640 1 --2- 172.21.15.7:0/3960919853 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f384406b5d0 0x7f384406da90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f384c0017e0 tx=0x7f384c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:48.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.882+0000 7f363b7fe640 1 -- 172.21.15.7:0/3540894696 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3644017070 con 0x7f36540b2ef0 2024-04-25T09:54:48.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.882+0000 7f4eaf7fe640 1 -- 172.21.15.7:0/3412938911 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4eb0045360 con 0x7f4eb815b9a0 2024-04-25T09:54:48.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.882+0000 7f2502ffd640 1 -- 172.21.15.7:0/3552283015 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc017070 con 0x7f25040e3620 2024-04-25T09:54:48.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.883+0000 7f25133a5640 1 -- 172.21.15.7:0/3552283015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25040dca70 con 0x7f25040e3620 2024-04-25T09:54:48.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.882+0000 7f3659730640 1 -- 172.21.15.7:0/3540894696 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36540cd720 con 0x7f36540b2ef0 2024-04-25T09:54:48.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.882+0000 7f3659730640 1 -- 172.21.15.7:0/3540894696 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36540b4bd0 con 0x7f36540b2ef0 2024-04-25T09:54:48.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.883+0000 7f25133a5640 1 -- 172.21.15.7:0/3552283015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2504051550 con 0x7f25040e3620 2024-04-25T09:54:48.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.883+0000 7f2502ffd640 1 -- 172.21.15.7:0/3552283015 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24fc0052d0 con 0x7f25040e3620 2024-04-25T09:54:48.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.883+0000 7f2502ffd640 1 -- 172.21.15.7:0/3552283015 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc017070 con 0x7f25040e3620 2024-04-25T09:54:48.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.884+0000 7f8828ff9640 1 -- 172.21.15.7:0/2146776663 <== mon.1 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f881c058bd0 con 0x7f882c0ceee0 2024-04-25T09:54:48.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.883+0000 7f3a177fe640 1 -- 172.21.15.7:0/3579014396 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3a200797b0 con 0x7f3a3015c4e0 2024-04-25T09:54:48.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.883+0000 7f363b7fe640 1 -- 172.21.15.7:0/3540894696 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36440052d0 con 0x7f36540b2ef0 2024-04-25T09:54:48.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.884+0000 7f363b7fe640 1 -- 172.21.15.7:0/3540894696 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3644003830 con 0x7f36540b2ef0 2024-04-25T09:54:48.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.884+0000 7f3659730640 1 -- 172.21.15.7:0/3540894696 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3634005290 con 0x7f36540b2ef0 2024-04-25T09:54:48.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.885+0000 7f25133a5640 1 -- 172.21.15.7:0/3552283015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f4005290 con 0x7f25040e3620 2024-04-25T09:54:48.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.886+0000 7f2502ffd640 1 -- 172.21.15.7:0/3552283015 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f24fc01a070 con 0x7f25040e3620 2024-04-25T09:54:48.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.886+0000 7f2502ffd640 1 --2- 172.21.15.7:0/3552283015 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f24f006b8d0 0x7f24f006dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.887+0000 7f25123a3640 1 --2- 172.21.15.7:0/3552283015 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f24f006b8d0 0x7f24f006dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.888+0000 7f385d7fa640 1 -- 172.21.15.7:0/3960919853 <== mon.1 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3860090070 con 0x7f385804e950 2024-04-25T09:54:48.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.887+0000 7f363b7fe640 1 -- 172.21.15.7:0/3540894696 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f364401a070 con 0x7f36540b2ef0 2024-04-25T09:54:48.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.888+0000 7f363b7fe640 1 --2- 172.21.15.7:0/3540894696 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f364006b500 0x7f364006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:48.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.888+0000 7f363b7fe640 1 -- 172.21.15.7:0/3540894696 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f3644089c40 con 0x7f36540b2ef0 2024-04-25T09:54:48.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.889+0000 7f25123a3640 1 --2- 172.21.15.7:0/3552283015 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f24f006b8d0 0x7f24f006dd90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f250c062780 tx=0x7f250c08bf90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:48.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.889+0000 7f2502ffd640 1 -- 172.21.15.7:0/3552283015 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f24fc0050d0 con 0x7f25040e3620 2024-04-25T09:54:48.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.890+0000 7f36527fc640 1 --2- 172.21.15.7:0/3540894696 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f364006b500 0x7f364006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:48.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.890+0000 7f36527fc640 1 --2- 172.21.15.7:0/3540894696 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f364006b500 0x7f364006d9c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3648034000 tx=0x7f364802c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:48.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.892+0000 7f363b7fe640 1 -- 172.21.15.7:0/3540894696 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3644021020 con 0x7f36540b2ef0 2024-04-25T09:54:48.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:48.901+0000 7f2502ffd640 1 -- 172.21.15.7:0/3552283015 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f250404fe00 con 0x7f25040e3620 2024-04-25T09:54:49.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.235+0000 7f6e22cd0640 1 -- 172.21.15.7:0/3606721077 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6e04005580 con 0x7f6e1c0c4bc0 2024-04-25T09:54:49.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.236+0000 7f6e127fc640 1 -- 172.21.15.7:0/3606721077 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6e1805cde0 con 0x7f6e1c0c4bc0 2024-04-25T09:54:49.238 INFO:teuthology.orchestra.run.smithi007.stdout:55834574857 2024-04-25T09:54:49.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.239+0000 7f6dfffff640 1 -- 172.21.15.7:0/3606721077 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6e0006b5a0 msgr2=0x7f6e0006da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:49.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.239+0000 7f6dfffff640 1 --2- 172.21.15.7:0/3606721077 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6e0006b5a0 0x7f6e0006da60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c006fd0 tx=0x7f6e0c008040 comp rx=0 tx=0).stop 2024-04-25T09:54:49.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.239+0000 7f6dfffff640 1 -- 172.21.15.7:0/3606721077 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e1c0c4bc0 msgr2=0x7f6e1c08a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:49.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.239+0000 7f6dfffff640 1 --2- 172.21.15.7:0/3606721077 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e1c0c4bc0 0x7f6e1c08a960 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6e1800e9e0 tx=0x7f6e1800eea0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.239+0000 7f6dfffff640 1 -- 172.21.15.7:0/3606721077 shutdown_connections 2024-04-25T09:54:49.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.240+0000 7f6dfffff640 1 --2- 172.21.15.7:0/3606721077 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6e0006b5a0 0x7f6e0006da60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.240+0000 7f6dfffff640 1 --2- 172.21.15.7:0/3606721077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e1c15c140 0x7f6e1c087f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.240+0000 7f6dfffff640 1 --2- 172.21.15.7:0/3606721077 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e1c0c4bc0 0x7f6e1c08a960 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.240+0000 7f6dfffff640 1 --2- 172.21.15.7:0/3606721077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e1c06bc70 0x7f6e1c0cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.240+0000 7f6dfffff640 1 -- 172.21.15.7:0/3606721077 >> 172.21.15.7:0/3606721077 conn(0x7f6e1c0d14e0 msgr2=0x7f6e1c070850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:49.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.240+0000 7f6dfffff640 1 -- 172.21.15.7:0/3606721077 shutdown_connections 2024-04-25T09:54:49.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.240+0000 7f6dfffff640 1 -- 172.21.15.7:0/3606721077 wait complete. 2024-04-25T09:54:49.259 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2024-04-25T09:54:49.260 DEBUG:teuthology.parallel:result is None 2024-04-25T09:54:49.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.273+0000 7f0091d6d640 1 -- 172.21.15.7:0/4108765084 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f008c068f60 con 0x7f008c15c0a0 2024-04-25T09:54:49.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.274+0000 7f00897fa640 1 -- 172.21.15.7:0/4108765084 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f008001f020 con 0x7f008c15c0a0 2024-04-25T09:54:49.276 INFO:teuthology.orchestra.run.smithi007.stdout:60129542153 2024-04-25T09:54:49.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.276+0000 7f0091d6d640 1 -- 172.21.15.7:0/4108765084 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f007806b8d0 msgr2=0x7f007806dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:49.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.276+0000 7f0091d6d640 1 --2- 172.21.15.7:0/4108765084 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f007806b8d0 0x7f007806dd90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f007c0335c0 tx=0x7f007c02f000 comp rx=0 tx=0).stop 2024-04-25T09:54:49.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.276+0000 7f0091d6d640 1 -- 172.21.15.7:0/4108765084 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f008c15c0a0 msgr2=0x7f008c15c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:49.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.276+0000 7f0091d6d640 1 --2- 172.21.15.7:0/4108765084 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f008c15c0a0 0x7f008c15c530 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f008000b410 tx=0x7f008000b8d0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.276+0000 7f0091d6d640 1 -- 172.21.15.7:0/4108765084 shutdown_connections 2024-04-25T09:54:49.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.276+0000 7f0091d6d640 1 --2- 172.21.15.7:0/4108765084 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f007806b8d0 0x7f007806dd90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.276+0000 7f0091d6d640 1 --2- 172.21.15.7:0/4108765084 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f008c15c0a0 0x7f008c15c530 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.276+0000 7f0091d6d640 1 --2- 172.21.15.7:0/4108765084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f008c159660 0x7f008c0cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.276+0000 7f0091d6d640 1 --2- 172.21.15.7:0/4108765084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f008c0cbe70 0x7f008c150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.276+0000 7f0091d6d640 1 -- 172.21.15.7:0/4108765084 >> 172.21.15.7:0/4108765084 conn(0x7f008c066b00 msgr2=0x7f008c0ac860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:49.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.276+0000 7f0091d6d640 1 -- 172.21.15.7:0/4108765084 shutdown_connections 2024-04-25T09:54:49.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.277+0000 7f0091d6d640 1 -- 172.21.15.7:0/4108765084 wait complete. 2024-04-25T09:54:49.291 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.6 2024-04-25T09:54:49.291 DEBUG:teuthology.parallel:result is None 2024-04-25T09:54:49.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.307+0000 7f4ebd71b640 1 -- 172.21.15.7:0/3412938911 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4e9c005850 con 0x7f4eb815b9a0 2024-04-25T09:54:49.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.307+0000 7f4eaf7fe640 1 -- 172.21.15.7:0/3412938911 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4eb0079fc0 con 0x7f4eb815b9a0 2024-04-25T09:54:49.310 INFO:teuthology.orchestra.run.smithi007.stdout:55834574857 2024-04-25T09:54:49.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.308+0000 7f3a157fa640 1 -- 172.21.15.7:0/3579014396 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3a08005580 con 0x7f3a3015c4e0 2024-04-25T09:54:49.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.309+0000 7f3a177fe640 1 -- 172.21.15.7:0/3579014396 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3a200790b0 con 0x7f3a3015c4e0 2024-04-25T09:54:49.312 INFO:teuthology.orchestra.run.smithi007.stdout:60129542153 2024-04-25T09:54:49.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.310+0000 7f4ebd71b640 1 -- 172.21.15.7:0/3412938911 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4e9806b520 msgr2=0x7f4e9806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:49.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.310+0000 7f4ebd71b640 1 --2- 172.21.15.7:0/3412938911 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4e9806b520 0x7f4e9806d9e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8006fd0 tx=0x7f4ea8008040 comp rx=0 tx=0).stop 2024-04-25T09:54:49.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.310+0000 7f4ebd71b640 1 -- 172.21.15.7:0/3412938911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eb815b9a0 msgr2=0x7f4eb81ed9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:49.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.310+0000 7f4ebd71b640 1 --2- 172.21.15.7:0/3412938911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eb815b9a0 0x7f4eb81ed9a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0030000 tx=0x7f4eb0004a40 comp rx=0 tx=0).stop 2024-04-25T09:54:49.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.310+0000 7f4ebd71b640 1 -- 172.21.15.7:0/3412938911 shutdown_connections 2024-04-25T09:54:49.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.310+0000 7f4ebd71b640 1 --2- 172.21.15.7:0/3412938911 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4e9806b520 0x7f4e9806d9e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.310+0000 7f4ebd71b640 1 --2- 172.21.15.7:0/3412938911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eb815b9a0 0x7f4eb81ed9a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.310+0000 7f4ebd71b640 1 --2- 172.21.15.7:0/3412938911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4eb8143400 0x7f4eb80b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.310+0000 7f4ebd71b640 1 --2- 172.21.15.7:0/3412938911 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4eb8071c40 0x7f4eb8200140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.310+0000 7f4ebd71b640 1 -- 172.21.15.7:0/3412938911 >> 172.21.15.7:0/3412938911 conn(0x7f4eb8071150 msgr2=0x7f4eb8142490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:49.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.310+0000 7f4ebd71b640 1 -- 172.21.15.7:0/3412938911 shutdown_connections 2024-04-25T09:54:49.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.310+0000 7f4ebd71b640 1 -- 172.21.15.7:0/3412938911 wait complete. 2024-04-25T09:54:49.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.310+0000 7f883293b640 1 -- 172.21.15.7:0/2146776663 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f882c15c3e0 con 0x7f882c0ceee0 2024-04-25T09:54:49.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.311+0000 7f8828ff9640 1 -- 172.21.15.7:0/2146776663 <== mon.1 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f881c05cc70 con 0x7f882c0ceee0 2024-04-25T09:54:49.314 INFO:teuthology.orchestra.run.smithi007.stdout:55834574857 2024-04-25T09:54:49.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.312+0000 7f3a157fa640 1 -- 172.21.15.7:0/3579014396 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3a1c06b4d0 msgr2=0x7f3a1c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:49.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.312+0000 7f3a157fa640 1 --2- 172.21.15.7:0/3579014396 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3a1c06b4d0 0x7f3a1c06d990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3a2800ab90 tx=0x7f3a28009210 comp rx=0 tx=0).stop 2024-04-25T09:54:49.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.312+0000 7f3a157fa640 1 -- 172.21.15.7:0/3579014396 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3a3015c4e0 msgr2=0x7f3a301fb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:49.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.312+0000 7f3a157fa640 1 --2- 172.21.15.7:0/3579014396 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3a3015c4e0 0x7f3a301fb100 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3a20009b20 tx=0x7f3a200046c0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.312+0000 7f3865efa640 1 -- 172.21.15.7:0/3960919853 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3858008880 con 0x7f385804e950 2024-04-25T09:54:49.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.312+0000 7f3a157fa640 1 -- 172.21.15.7:0/3579014396 shutdown_connections 2024-04-25T09:54:49.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.312+0000 7f3a157fa640 1 --2- 172.21.15.7:0/3579014396 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3a1c06b4d0 0x7f3a1c06d990 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.312+0000 7f3a157fa640 1 --2- 172.21.15.7:0/3579014396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a30153900 0x7f3a30070120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.312+0000 7f3a157fa640 1 --2- 172.21.15.7:0/3579014396 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3a3015c4e0 0x7f3a301fb100 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.312+0000 7f3a157fa640 1 --2- 172.21.15.7:0/3579014396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a3006b0a0 0x7f3a30150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.312+0000 7f3a157fa640 1 -- 172.21.15.7:0/3579014396 >> 172.21.15.7:0/3579014396 conn(0x7f3a300b2390 msgr2=0x7f3a30164d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:49.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.312+0000 7f3a157fa640 1 -- 172.21.15.7:0/3579014396 shutdown_connections 2024-04-25T09:54:49.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.312+0000 7f3a157fa640 1 -- 172.21.15.7:0/3579014396 wait complete. 2024-04-25T09:54:49.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.313+0000 7f385d7fa640 1 -- 172.21.15.7:0/3960919853 <== mon.1 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f38600d3540 con 0x7f385804e950 2024-04-25T09:54:49.318 INFO:teuthology.orchestra.run.smithi007.stdout:55834574857 2024-04-25T09:54:49.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.314+0000 7f883293b640 1 -- 172.21.15.7:0/2146776663 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f881806b4d0 msgr2=0x7f881806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:49.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.314+0000 7f883293b640 1 --2- 172.21.15.7:0/2146776663 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f881806b4d0 0x7f881806d990 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8820000f60 tx=0x7f88200079b0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.314+0000 7f883293b640 1 -- 172.21.15.7:0/2146776663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f882c0ceee0 msgr2=0x7f882c140d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:49.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.314+0000 7f883293b640 1 --2- 172.21.15.7:0/2146776663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f882c0ceee0 0x7f882c140d10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f881c007810 tx=0x7f881c007cd0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.314+0000 7f883293b640 1 -- 172.21.15.7:0/2146776663 shutdown_connections 2024-04-25T09:54:49.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.314+0000 7f883293b640 1 --2- 172.21.15.7:0/2146776663 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f881806b4d0 0x7f881806d990 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.314+0000 7f883293b640 1 --2- 172.21.15.7:0/2146776663 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f882c15a9a0 0x7f882c1583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.314+0000 7f883293b640 1 --2- 172.21.15.7:0/2146776663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f882c1426c0 0x7f882c0cc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.314+0000 7f883293b640 1 --2- 172.21.15.7:0/2146776663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f882c0ceee0 0x7f882c140d10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.314+0000 7f883293b640 1 -- 172.21.15.7:0/2146776663 >> 172.21.15.7:0/2146776663 conn(0x7f882c071150 msgr2=0x7f882c159310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:49.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.314+0000 7f883293b640 1 -- 172.21.15.7:0/2146776663 shutdown_connections 2024-04-25T09:54:49.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.314+0000 7f883293b640 1 -- 172.21.15.7:0/2146776663 wait complete. 2024-04-25T09:54:49.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.315+0000 7f3865efa640 1 -- 172.21.15.7:0/3960919853 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f384406b5d0 msgr2=0x7f384406da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:49.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.315+0000 7f3865efa640 1 --2- 172.21.15.7:0/3960919853 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f384406b5d0 0x7f384406da90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f384c0017e0 tx=0x7f384c009040 comp rx=0 tx=0).stop 2024-04-25T09:54:49.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.315+0000 7f3865efa640 1 -- 172.21.15.7:0/3960919853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f385804e950 msgr2=0x7f385804edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:49.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.315+0000 7f3865efa640 1 --2- 172.21.15.7:0/3960919853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f385804e950 0x7f385804edd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3860067990 tx=0x7f3860067f70 comp rx=0 tx=0).stop 2024-04-25T09:54:49.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.316+0000 7f3865efa640 1 -- 172.21.15.7:0/3960919853 shutdown_connections 2024-04-25T09:54:49.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.316+0000 7f3865efa640 1 --2- 172.21.15.7:0/3960919853 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f384406b5d0 0x7f384406da90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.316+0000 7f3865efa640 1 --2- 172.21.15.7:0/3960919853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f385804e950 0x7f385804edd0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.316+0000 7f3865efa640 1 --2- 172.21.15.7:0/3960919853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f385804f7e0 0x7f385804e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.316+0000 7f3865efa640 1 --2- 172.21.15.7:0/3960919853 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3850004160 0x7f38580cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.316+0000 7f3865efa640 1 -- 172.21.15.7:0/3960919853 >> 172.21.15.7:0/3960919853 conn(0x7f3858055c10 msgr2=0x7f3858008da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:49.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.316+0000 7f3865efa640 1 -- 172.21.15.7:0/3960919853 shutdown_connections 2024-04-25T09:54:49.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.316+0000 7f3865efa640 1 -- 172.21.15.7:0/3960919853 wait complete. 2024-04-25T09:54:49.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.323+0000 7f3659730640 1 -- 172.21.15.7:0/3540894696 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3634005850 con 0x7f36540b2ef0 2024-04-25T09:54:49.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.323+0000 7f363b7fe640 1 -- 172.21.15.7:0/3540894696 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f36440587f0 con 0x7f36540b2ef0 2024-04-25T09:54:49.326 INFO:teuthology.orchestra.run.smithi007.stdout:60129542155 2024-04-25T09:54:49.330 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.3 2024-04-25T09:54:49.330 DEBUG:teuthology.parallel:result is None 2024-04-25T09:54:49.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.326+0000 7f3659730640 1 -- 172.21.15.7:0/3540894696 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f364006b500 msgr2=0x7f364006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:49.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.326+0000 7f3659730640 1 --2- 172.21.15.7:0/3540894696 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f364006b500 0x7f364006d9c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3648034000 tx=0x7f364802c000 comp rx=0 tx=0).stop 2024-04-25T09:54:49.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.327+0000 7f3659730640 1 -- 172.21.15.7:0/3540894696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36540b2ef0 msgr2=0x7f36540d09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:49.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.327+0000 7f3659730640 1 --2- 172.21.15.7:0/3540894696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36540b2ef0 0x7f36540d09f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f364400c400 tx=0x7f364400c8c0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.327+0000 7f3659730640 1 -- 172.21.15.7:0/3540894696 shutdown_connections 2024-04-25T09:54:49.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.327+0000 7f3659730640 1 --2- 172.21.15.7:0/3540894696 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f364006b500 0x7f364006d9c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.327+0000 7f3659730640 1 --2- 172.21.15.7:0/3540894696 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f365415fb00 0x7f3654154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.327+0000 7f3659730640 1 --2- 172.21.15.7:0/3540894696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36540b5350 0x7f36540ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.327+0000 7f3659730640 1 --2- 172.21.15.7:0/3540894696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36540b2ef0 0x7f36540d09f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.327+0000 7f3659730640 1 -- 172.21.15.7:0/3540894696 >> 172.21.15.7:0/3540894696 conn(0x7f3654072290 msgr2=0x7f3654160fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:49.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.327+0000 7f3659730640 1 -- 172.21.15.7:0/3540894696 shutdown_connections 2024-04-25T09:54:49.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.327+0000 7f3659730640 1 -- 172.21.15.7:0/3540894696 wait complete. 2024-04-25T09:54:49.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.329+0000 7f25133a5640 1 -- 172.21.15.7:0/3552283015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f24f4005850 con 0x7f25040e3620 2024-04-25T09:54:49.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2024-04-25T09:54:49.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.330+0000 7f2502ffd640 1 -- 172.21.15.7:0/3552283015 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f250404fe00 con 0x7f25040e3620 2024-04-25T09:54:49.333 INFO:teuthology.orchestra.run.smithi007.stdout:60129542152 2024-04-25T09:54:49.333 DEBUG:teuthology.parallel:result is None 2024-04-25T09:54:49.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.332+0000 7f25133a5640 1 -- 172.21.15.7:0/3552283015 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f24f006b8d0 msgr2=0x7f24f006dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:49.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.332+0000 7f25133a5640 1 --2- 172.21.15.7:0/3552283015 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f24f006b8d0 0x7f24f006dd90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f250c062780 tx=0x7f250c08bf90 comp rx=0 tx=0).stop 2024-04-25T09:54:49.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.332+0000 7f25133a5640 1 -- 172.21.15.7:0/3552283015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25040e3620 msgr2=0x7f25040ded90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:49.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.332+0000 7f25133a5640 1 --2- 172.21.15.7:0/3552283015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25040e3620 0x7f25040ded90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f250405a190 tx=0x7f24fc00c7a0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.332+0000 7f25133a5640 1 -- 172.21.15.7:0/3552283015 shutdown_connections 2024-04-25T09:54:49.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.332+0000 7f25133a5640 1 --2- 172.21.15.7:0/3552283015 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f24f006b8d0 0x7f24f006dd90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.332+0000 7f25133a5640 1 --2- 172.21.15.7:0/3552283015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25040e3620 0x7f25040ded90 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.332+0000 7f25133a5640 1 --2- 172.21.15.7:0/3552283015 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25040e3240 0x7f25040dd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.332+0000 7f25133a5640 1 --2- 172.21.15.7:0/3552283015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2504054030 0x7f250404f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.332+0000 7f25133a5640 1 -- 172.21.15.7:0/3552283015 >> 172.21.15.7:0/3552283015 conn(0x7f25040590c0 msgr2=0x7f25040e3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:49.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.332+0000 7f25133a5640 1 -- 172.21.15.7:0/3552283015 shutdown_connections 2024-04-25T09:54:49.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.332+0000 7f25133a5640 1 -- 172.21.15.7:0/3552283015 wait complete. 2024-04-25T09:54:49.337 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.7 2024-04-25T09:54:49.337 DEBUG:teuthology.parallel:result is None 2024-04-25T09:54:49.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2024-04-25T09:54:49.338 DEBUG:teuthology.parallel:result is None 2024-04-25T09:54:49.343 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.5 2024-04-25T09:54:49.344 DEBUG:teuthology.parallel:result is None 2024-04-25T09:54:49.346 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.4 2024-04-25T09:54:49.346 DEBUG:teuthology.parallel:result is None 2024-04-25T09:54:49.346 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T09:54:49.347 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:54:49.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.484+0000 7f38a4d63640 1 Processor -- start 2024-04-25T09:54:49.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.484+0000 7f38a4d63640 1 -- start start 2024-04-25T09:54:49.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.485+0000 7f38a4d63640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f38a015b8e0 0x7f38a00d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:49.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.485+0000 7f38a4d63640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f38a00cc300 0x7f38a00999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:49.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.485+0000 7f38a4d63640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f38a0099f30 0x7f38a015f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:49.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.485+0000 7f38a4d63640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a00cd7d0 con 0x7f38a0099f30 2024-04-25T09:54:49.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.485+0000 7f38a4d63640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a009a340 con 0x7f38a015b8e0 2024-04-25T09:54:49.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.485+0000 7f38a4d63640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a00ccbc0 con 0x7f38a00cc300 2024-04-25T09:54:49.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.485+0000 7f389ed9d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f38a0099f30 0x7f38a015f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:49.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.485+0000 7f389ed9d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f38a0099f30 0x7f38a015f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43260/0 (socket says 172.21.15.7:43260) 2024-04-25T09:54:49.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.486+0000 7f389ed9d640 1 -- 172.21.15.7:0/884496611 learned_addr learned my addr 172.21.15.7:0/884496611 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:49.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.486+0000 7f389e59c640 1 --2- 172.21.15.7:0/884496611 >> v2:172.21.15.55:3300/0 conn(0x7f38a015b8e0 0x7f38a00d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:49.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.486+0000 7f389dd9b640 1 --2- 172.21.15.7:0/884496611 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f38a00cc300 0x7f38a00999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:49.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.486+0000 7f389ed9d640 1 -- 172.21.15.7:0/884496611 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f38a00cc300 msgr2=0x7f38a00999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:49.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.486+0000 7f389ed9d640 1 --2- 172.21.15.7:0/884496611 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f38a00cc300 0x7f38a00999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.486+0000 7f389ed9d640 1 -- 172.21.15.7:0/884496611 >> v2:172.21.15.55:3300/0 conn(0x7f38a015b8e0 msgr2=0x7f38a00d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:49.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.486+0000 7f389ed9d640 1 --2- 172.21.15.7:0/884496611 >> v2:172.21.15.55:3300/0 conn(0x7f38a015b8e0 0x7f38a00d0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.486+0000 7f389ed9d640 1 -- 172.21.15.7:0/884496611 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a00ccea0 con 0x7f38a0099f30 2024-04-25T09:54:49.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.486+0000 7f389ed9d640 1 --2- 172.21.15.7:0/884496611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38a0099f30 0x7f38a015f520 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f38a00b4230 tx=0x7f389002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a652f9bc8b4bcc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:49.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.487+0000 7f389d59a640 1 -- 172.21.15.7:0/884496611 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3890036070 con 0x7f38a0099f30 2024-04-25T09:54:49.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.487+0000 7f389d59a640 1 -- 172.21.15.7:0/884496611 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3890031600 con 0x7f38a0099f30 2024-04-25T09:54:49.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.487+0000 7f389d59a640 1 -- 172.21.15.7:0/884496611 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38900319d0 con 0x7f38a0099f30 2024-04-25T09:54:49.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.487+0000 7f38a4d63640 1 -- 172.21.15.7:0/884496611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38a0099f30 msgr2=0x7f38a015f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:49.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.487+0000 7f38a4d63640 1 --2- 172.21.15.7:0/884496611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38a0099f30 0x7f38a015f520 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f38a00b4230 tx=0x7f389002a6a0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.487+0000 7f38a4d63640 1 -- 172.21.15.7:0/884496611 shutdown_connections 2024-04-25T09:54:49.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.487+0000 7f38a4d63640 1 --2- 172.21.15.7:0/884496611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38a0099f30 0x7f38a015f520 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.487+0000 7f38a4d63640 1 --2- 172.21.15.7:0/884496611 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f38a00cc300 0x7f38a00999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.487+0000 7f38a4d63640 1 --2- 172.21.15.7:0/884496611 >> v2:172.21.15.55:3300/0 conn(0x7f38a015b8e0 0x7f38a00d0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.487+0000 7f38a4d63640 1 -- 172.21.15.7:0/884496611 >> 172.21.15.7:0/884496611 conn(0x7f38a00b3130 msgr2=0x7f38a00b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:49.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.487+0000 7f38a4d63640 1 -- 172.21.15.7:0/884496611 shutdown_connections 2024-04-25T09:54:49.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.487+0000 7f38a4d63640 1 -- 172.21.15.7:0/884496611 wait complete. 2024-04-25T09:54:49.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.489+0000 7f38a4d63640 1 Processor -- start 2024-04-25T09:54:49.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.489+0000 7f38a4d63640 1 -- start start 2024-04-25T09:54:49.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.489+0000 7f38a4d63640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38a0099f30 0x7f38a014bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:49.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.489+0000 7f38a4d63640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38a00cc300 0x7f38a014dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:49.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.489+0000 7f38a4d63640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f38a015b8e0 0x7f38a014e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:49.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.489+0000 7f38a4d63640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a015bcc0 con 0x7f38a0099f30 2024-04-25T09:54:49.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.489+0000 7f38a4d63640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a00cd460 con 0x7f38a00cc300 2024-04-25T09:54:49.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.489+0000 7f38a4d63640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a015be40 con 0x7f38a015b8e0 2024-04-25T09:54:49.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.490+0000 7f389e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38a0099f30 0x7f38a014bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:49.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.490+0000 7f389e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38a0099f30 0x7f38a014bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43270/0 (socket says 172.21.15.7:43270) 2024-04-25T09:54:49.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.490+0000 7f389e59c640 1 -- 172.21.15.7:0/480734244 learned_addr learned my addr 172.21.15.7:0/480734244 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:49.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.490+0000 7f389dd9b640 1 --2- 172.21.15.7:0/480734244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38a00cc300 0x7f38a014dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:49.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.490+0000 7f389ed9d640 1 --2- 172.21.15.7:0/480734244 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f38a015b8e0 0x7f38a014e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:49.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.490+0000 7f389e59c640 1 -- 172.21.15.7:0/480734244 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f38a015b8e0 msgr2=0x7f38a014e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:49.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.490+0000 7f389e59c640 1 --2- 172.21.15.7:0/480734244 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f38a015b8e0 0x7f38a014e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.490+0000 7f389e59c640 1 -- 172.21.15.7:0/480734244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38a00cc300 msgr2=0x7f38a014dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:49.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.490+0000 7f389e59c640 1 --2- 172.21.15.7:0/480734244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38a00cc300 0x7f38a014dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.490+0000 7f389e59c640 1 -- 172.21.15.7:0/480734244 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a015c6c0 con 0x7f38a0099f30 2024-04-25T09:54:49.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.490+0000 7f389dd9b640 1 --2- 172.21.15.7:0/480734244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38a00cc300 0x7f38a014dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:49.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.490+0000 7f389e59c640 1 --2- 172.21.15.7:0/480734244 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38a0099f30 0x7f38a014bc50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f389800e8a0 tx=0x7f389800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:49.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.490+0000 7f3896ffd640 1 -- 172.21.15.7:0/480734244 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3898017070 con 0x7f38a0099f30 2024-04-25T09:54:49.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.490+0000 7f3896ffd640 1 -- 172.21.15.7:0/480734244 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389800c940 con 0x7f38a0099f30 2024-04-25T09:54:49.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.490+0000 7f38a4d63640 1 -- 172.21.15.7:0/480734244 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a015c9a0 con 0x7f38a0099f30 2024-04-25T09:54:49.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.490+0000 7f3896ffd640 1 -- 172.21.15.7:0/480734244 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389800cd30 con 0x7f38a0099f30 2024-04-25T09:54:49.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.490+0000 7f38a4d63640 1 -- 172.21.15.7:0/480734244 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a015cf60 con 0x7f38a0099f30 2024-04-25T09:54:49.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.491+0000 7f38a4d63640 1 -- 172.21.15.7:0/480734244 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a0068fd0 con 0x7f38a0099f30 2024-04-25T09:54:49.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.492+0000 7f3896ffd640 1 -- 172.21.15.7:0/480734244 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f389801a070 con 0x7f38a0099f30 2024-04-25T09:54:49.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.492+0000 7f3896ffd640 1 --2- 172.21.15.7:0/480734244 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f388006b4d0 0x7f388006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:49.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.492+0000 7f3896ffd640 1 -- 172.21.15.7:0/480734244 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f389808a6e0 con 0x7f38a0099f30 2024-04-25T09:54:49.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.492+0000 7f389dd9b640 1 --2- 172.21.15.7:0/480734244 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f388006b4d0 0x7f388006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:49.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.492+0000 7f389dd9b640 1 --2- 172.21.15.7:0/480734244 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f388006b4d0 0x7f388006d990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f38a00d0600 tx=0x7f3888008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:49.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.496+0000 7f3896ffd640 1 -- 172.21.15.7:0/480734244 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f38980592b0 con 0x7f38a0099f30 2024-04-25T09:54:49.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.673+0000 7f38a4d63640 1 -- 172.21.15.7:0/480734244 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f38a015c470 con 0x7f388006b4d0 2024-04-25T09:54:49.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.681+0000 7f3896ffd640 1 -- 172.21.15.7:0/480734244 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332534 (secure 0 0 0) 0x7f38a015c470 con 0x7f388006b4d0 2024-04-25T09:54:49.692 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:49.695 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T09:54:49.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.684+0000 7f38a4d63640 1 -- 172.21.15.7:0/480734244 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f388006b4d0 msgr2=0x7f388006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:49.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.684+0000 7f38a4d63640 1 --2- 172.21.15.7:0/480734244 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f388006b4d0 0x7f388006d990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f38a00d0600 tx=0x7f3888008040 comp rx=0 tx=0).stop 2024-04-25T09:54:49.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.684+0000 7f38a4d63640 1 -- 172.21.15.7:0/480734244 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38a0099f30 msgr2=0x7f38a014bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:49.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.684+0000 7f38a4d63640 1 --2- 172.21.15.7:0/480734244 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38a0099f30 0x7f38a014bc50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f389800e8a0 tx=0x7f389800ed60 comp rx=0 tx=0).stop 2024-04-25T09:54:49.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.684+0000 7f38a4d63640 1 -- 172.21.15.7:0/480734244 shutdown_connections 2024-04-25T09:54:49.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.684+0000 7f38a4d63640 1 --2- 172.21.15.7:0/480734244 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f388006b4d0 0x7f388006d990 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.684+0000 7f38a4d63640 1 --2- 172.21.15.7:0/480734244 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f38a015b8e0 0x7f38a014e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.684+0000 7f38a4d63640 1 --2- 172.21.15.7:0/480734244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38a00cc300 0x7f38a014dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.684+0000 7f38a4d63640 1 --2- 172.21.15.7:0/480734244 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38a0099f30 0x7f38a014bc50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.684+0000 7f38a4d63640 1 -- 172.21.15.7:0/480734244 >> 172.21.15.7:0/480734244 conn(0x7f38a00b3130 msgr2=0x7f38a00cfa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:49.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.684+0000 7f38a4d63640 1 -- 172.21.15.7:0/480734244 shutdown_connections 2024-04-25T09:54:49.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.684+0000 7f38a4d63640 1 -- 172.21.15.7:0/480734244 wait complete. 2024-04-25T09:54:49.701 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-04-25T09:54:47.857671+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236096,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738624,"statfs":{"total":773094113280,"available":772852350976,"internally_reserved":0,"allocated":3350528,"data_stored":2020472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002914"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431103+0000","last_change":"2024-04-25T09:54:27.205212+0000","last_active":"2024-04-25T09:54:33.431103+0000","last_peered":"2024-04-25T09:54:33.431103+0000","last_clean":"2024-04-25T09:54:33.431103+0000","last_became_active":"2024-04-25T09:54:27.204920+0000","last_became_peered":"2024-04-25T09:54:27.204920+0000","last_unstale":"2024-04-25T09:54:33.431103+0000","last_undegraded":"2024-04-25T09:54:33.431103+0000","last_fullsized":"2024-04-25T09:54:33.431103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:44.480619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239768+0000","last_change":"2024-04-25T09:54:28.228470+0000","last_active":"2024-04-25T09:54:33.239768+0000","last_peered":"2024-04-25T09:54:33.239768+0000","last_clean":"2024-04-25T09:54:33.239768+0000","last_became_active":"2024-04-25T09:54:28.228117+0000","last_became_peered":"2024-04-25T09:54:28.228117+0000","last_unstale":"2024-04-25T09:54:33.239768+0000","last_undegraded":"2024-04-25T09:54:33.239768+0000","last_fullsized":"2024-04-25T09:54:33.239768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:23.525779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239020+0000","last_change":"2024-04-25T09:54:32.301225+0000","last_active":"2024-04-25T09:54:33.239020+0000","last_peered":"2024-04-25T09:54:33.239020+0000","last_clean":"2024-04-25T09:54:33.239020+0000","last_became_active":"2024-04-25T09:54:32.300826+0000","last_became_peered":"2024-04-25T09:54:32.300826+0000","last_unstale":"2024-04-25T09:54:33.239020+0000","last_undegraded":"2024-04-25T09:54:33.239020+0000","last_fullsized":"2024-04-25T09:54:33.239020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:06.418222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239954+0000","last_change":"2024-04-25T09:54:27.209621+0000","last_active":"2024-04-25T09:54:33.239954+0000","last_peered":"2024-04-25T09:54:33.239954+0000","last_clean":"2024-04-25T09:54:33.239954+0000","last_became_active":"2024-04-25T09:54:27.209078+0000","last_became_peered":"2024-04-25T09:54:27.209078+0000","last_unstale":"2024-04-25T09:54:33.239954+0000","last_undegraded":"2024-04-25T09:54:33.239954+0000","last_fullsized":"2024-04-25T09:54:33.239954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:02.804762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430762+0000","last_change":"2024-04-25T09:54:28.230594+0000","last_active":"2024-04-25T09:54:33.430762+0000","last_peered":"2024-04-25T09:54:33.430762+0000","last_clean":"2024-04-25T09:54:33.430762+0000","last_became_active":"2024-04-25T09:54:28.230265+0000","last_became_peered":"2024-04-25T09:54:28.230265+0000","last_unstale":"2024-04-25T09:54:33.430762+0000","last_undegraded":"2024-04-25T09:54:33.430762+0000","last_fullsized":"2024-04-25T09:54:33.430762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:33.543144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.248999+0000","last_change":"2024-04-25T09:54:32.265543+0000","last_active":"2024-04-25T09:54:33.248999+0000","last_peered":"2024-04-25T09:54:33.248999+0000","last_clean":"2024-04-25T09:54:33.248999+0000","last_became_active":"2024-04-25T09:54:32.264147+0000","last_became_peered":"2024-04-25T09:54:32.264147+0000","last_unstale":"2024-04-25T09:54:33.248999+0000","last_undegraded":"2024-04-25T09:54:33.248999+0000","last_fullsized":"2024-04-25T09:54:33.248999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:19.875090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427980+0000","last_change":"2024-04-25T09:54:27.215105+0000","last_active":"2024-04-25T09:54:33.427980+0000","last_peered":"2024-04-25T09:54:33.427980+0000","last_clean":"2024-04-25T09:54:33.427980+0000","last_became_active":"2024-04-25T09:54:27.214820+0000","last_became_peered":"2024-04-25T09:54:27.214820+0000","last_unstale":"2024-04-25T09:54:33.427980+0000","last_undegraded":"2024-04-25T09:54:33.427980+0000","last_fullsized":"2024-04-25T09:54:33.427980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:39.794974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432058+0000","last_change":"2024-04-25T09:54:28.232586+0000","last_active":"2024-04-25T09:54:33.432058+0000","last_peered":"2024-04-25T09:54:33.432058+0000","last_clean":"2024-04-25T09:54:33.432058+0000","last_became_active":"2024-04-25T09:54:28.231544+0000","last_became_peered":"2024-04-25T09:54:28.231544+0000","last_unstale":"2024-04-25T09:54:33.432058+0000","last_undegraded":"2024-04-25T09:54:33.432058+0000","last_fullsized":"2024-04-25T09:54:33.432058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:52.698521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249218+0000","last_change":"2024-04-25T09:54:32.265350+0000","last_active":"2024-04-25T09:54:33.249218+0000","last_peered":"2024-04-25T09:54:33.249218+0000","last_clean":"2024-04-25T09:54:33.249218+0000","last_became_active":"2024-04-25T09:54:32.264913+0000","last_became_peered":"2024-04-25T09:54:32.264913+0000","last_unstale":"2024-04-25T09:54:33.249218+0000","last_undegraded":"2024-04-25T09:54:33.249218+0000","last_fullsized":"2024-04-25T09:54:33.249218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:08:46.808252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427640+0000","last_change":"2024-04-25T09:54:27.212359+0000","last_active":"2024-04-25T09:54:33.427640+0000","last_peered":"2024-04-25T09:54:33.427640+0000","last_clean":"2024-04-25T09:54:33.427640+0000","last_became_active":"2024-04-25T09:54:27.212058+0000","last_became_peered":"2024-04-25T09:54:27.212058+0000","last_unstale":"2024-04-25T09:54:33.427640+0000","last_undegraded":"2024-04-25T09:54:33.427640+0000","last_fullsized":"2024-04-25T09:54:33.427640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:04.425728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432088+0000","last_change":"2024-04-25T09:54:28.230562+0000","last_active":"2024-04-25T09:54:33.432088+0000","last_peered":"2024-04-25T09:54:33.432088+0000","last_clean":"2024-04-25T09:54:33.432088+0000","last_became_active":"2024-04-25T09:54:28.230276+0000","last_became_peered":"2024-04-25T09:54:28.230276+0000","last_unstale":"2024-04-25T09:54:33.432088+0000","last_undegraded":"2024-04-25T09:54:33.432088+0000","last_fullsized":"2024-04-25T09:54:33.432088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:36.448046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.248804+0000","last_change":"2024-04-25T09:54:32.256284+0000","last_active":"2024-04-25T09:54:33.248804+0000","last_peered":"2024-04-25T09:54:33.248804+0000","last_clean":"2024-04-25T09:54:33.248804+0000","last_became_active":"2024-04-25T09:54:32.255895+0000","last_became_peered":"2024-04-25T09:54:32.255895+0000","last_unstale":"2024-04-25T09:54:33.248804+0000","last_undegraded":"2024-04-25T09:54:33.248804+0000","last_fullsized":"2024-04-25T09:54:33.248804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:54.048907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430965+0000","last_change":"2024-04-25T09:54:28.228430+0000","last_active":"2024-04-25T09:54:33.430965+0000","last_peered":"2024-04-25T09:54:33.430965+0000","last_clean":"2024-04-25T09:54:33.430965+0000","last_became_active":"2024-04-25T09:54:28.228142+0000","last_became_peered":"2024-04-25T09:54:28.228142+0000","last_unstale":"2024-04-25T09:54:33.430965+0000","last_undegraded":"2024-04-25T09:54:33.430965+0000","last_fullsized":"2024-04-25T09:54:33.430965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:35.167250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427810+0000","last_change":"2024-04-25T09:54:27.209265+0000","last_active":"2024-04-25T09:54:33.427810+0000","last_peered":"2024-04-25T09:54:33.427810+0000","last_clean":"2024-04-25T09:54:33.427810+0000","last_became_active":"2024-04-25T09:54:27.209017+0000","last_became_peered":"2024-04-25T09:54:27.209017+0000","last_unstale":"2024-04-25T09:54:33.427810+0000","last_undegraded":"2024-04-25T09:54:33.427810+0000","last_fullsized":"2024-04-25T09:54:33.427810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:53.735742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249574+0000","last_change":"2024-04-25T09:54:32.265153+0000","last_active":"2024-04-25T09:54:33.249574+0000","last_peered":"2024-04-25T09:54:33.249574+0000","last_clean":"2024-04-25T09:54:33.249574+0000","last_became_active":"2024-04-25T09:54:32.264252+0000","last_became_peered":"2024-04-25T09:54:32.264252+0000","last_unstale":"2024-04-25T09:54:33.249574+0000","last_undegraded":"2024-04-25T09:54:33.249574+0000","last_fullsized":"2024-04-25T09:54:33.249574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:08.992474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239443+0000","last_change":"2024-04-25T09:54:28.217914+0000","last_active":"2024-04-25T09:54:33.239443+0000","last_peered":"2024-04-25T09:54:33.239443+0000","last_clean":"2024-04-25T09:54:33.239443+0000","last_became_active":"2024-04-25T09:54:28.217591+0000","last_became_peered":"2024-04-25T09:54:28.217591+0000","last_unstale":"2024-04-25T09:54:33.239443+0000","last_undegraded":"2024-04-25T09:54:33.239443+0000","last_fullsized":"2024-04-25T09:54:33.239443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:50.006460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431887+0000","last_change":"2024-04-25T09:54:27.204310+0000","last_active":"2024-04-25T09:54:33.431887+0000","last_peered":"2024-04-25T09:54:33.431887+0000","last_clean":"2024-04-25T09:54:33.431887+0000","last_became_active":"2024-04-25T09:54:27.203973+0000","last_became_peered":"2024-04-25T09:54:27.203973+0000","last_unstale":"2024-04-25T09:54:33.431887+0000","last_undegraded":"2024-04-25T09:54:33.431887+0000","last_fullsized":"2024-04-25T09:54:33.431887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:25.329710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249452+0000","last_change":"2024-04-25T09:54:32.265896+0000","last_active":"2024-04-25T09:54:33.249452+0000","last_peered":"2024-04-25T09:54:33.249452+0000","last_clean":"2024-04-25T09:54:33.249452+0000","last_became_active":"2024-04-25T09:54:32.265185+0000","last_became_peered":"2024-04-25T09:54:32.265185+0000","last_unstale":"2024-04-25T09:54:33.249452+0000","last_undegraded":"2024-04-25T09:54:33.249452+0000","last_fullsized":"2024-04-25T09:54:33.249452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:10.694250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239224+0000","last_change":"2024-04-25T09:54:28.211914+0000","last_active":"2024-04-25T09:54:33.239224+0000","last_peered":"2024-04-25T09:54:33.239224+0000","last_clean":"2024-04-25T09:54:33.239224+0000","last_became_active":"2024-04-25T09:54:28.211506+0000","last_became_peered":"2024-04-25T09:54:28.211506+0000","last_unstale":"2024-04-25T09:54:33.239224+0000","last_undegraded":"2024-04-25T09:54:33.239224+0000","last_fullsized":"2024-04-25T09:54:33.239224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:47.076023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430746+0000","last_change":"2024-04-25T09:54:27.204816+0000","last_active":"2024-04-25T09:54:33.430746+0000","last_peered":"2024-04-25T09:54:33.430746+0000","last_clean":"2024-04-25T09:54:33.430746+0000","last_became_active":"2024-04-25T09:54:27.204539+0000","last_became_peered":"2024-04-25T09:54:27.204539+0000","last_unstale":"2024-04-25T09:54:33.430746+0000","last_undegraded":"2024-04-25T09:54:33.430746+0000","last_fullsized":"2024-04-25T09:54:33.430746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:04.425728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432270+0000","last_change":"2024-04-25T09:54:32.302487+0000","last_active":"2024-04-25T09:54:33.432270+0000","last_peered":"2024-04-25T09:54:33.432270+0000","last_clean":"2024-04-25T09:54:33.432270+0000","last_became_active":"2024-04-25T09:54:32.302085+0000","last_became_peered":"2024-04-25T09:54:32.302085+0000","last_unstale":"2024-04-25T09:54:33.432270+0000","last_undegraded":"2024-04-25T09:54:33.432270+0000","last_fullsized":"2024-04-25T09:54:33.432270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:00:29.792006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249025+0000","last_change":"2024-04-25T09:54:28.220488+0000","last_active":"2024-04-25T09:54:33.249025+0000","last_peered":"2024-04-25T09:54:33.249025+0000","last_clean":"2024-04-25T09:54:33.249025+0000","last_became_active":"2024-04-25T09:54:28.220151+0000","last_became_peered":"2024-04-25T09:54:28.220151+0000","last_unstale":"2024-04-25T09:54:33.249025+0000","last_undegraded":"2024-04-25T09:54:33.249025+0000","last_fullsized":"2024-04-25T09:54:33.249025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:35.664298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427200+0000","last_change":"2024-04-25T09:54:27.208900+0000","last_active":"2024-04-25T09:54:33.427200+0000","last_peered":"2024-04-25T09:54:33.427200+0000","last_clean":"2024-04-25T09:54:33.427200+0000","last_became_active":"2024-04-25T09:54:27.208616+0000","last_became_peered":"2024-04-25T09:54:27.208616+0000","last_unstale":"2024-04-25T09:54:33.427200+0000","last_undegraded":"2024-04-25T09:54:33.427200+0000","last_fullsized":"2024-04-25T09:54:33.427200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:25.329710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249752+0000","last_change":"2024-04-25T09:54:32.265564+0000","last_active":"2024-04-25T09:54:33.249752+0000","last_peered":"2024-04-25T09:54:33.249752+0000","last_clean":"2024-04-25T09:54:33.249752+0000","last_became_active":"2024-04-25T09:54:32.264127+0000","last_became_peered":"2024-04-25T09:54:32.264127+0000","last_unstale":"2024-04-25T09:54:33.249752+0000","last_undegraded":"2024-04-25T09:54:33.249752+0000","last_fullsized":"2024-04-25T09:54:33.249752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:40.490493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431796+0000","last_change":"2024-04-25T09:54:28.215357+0000","last_active":"2024-04-25T09:54:33.431796+0000","last_peered":"2024-04-25T09:54:33.431796+0000","last_clean":"2024-04-25T09:54:33.431796+0000","last_became_active":"2024-04-25T09:54:28.215024+0000","last_became_peered":"2024-04-25T09:54:28.215024+0000","last_unstale":"2024-04-25T09:54:33.431796+0000","last_undegraded":"2024-04-25T09:54:33.431796+0000","last_fullsized":"2024-04-25T09:54:33.431796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:04.526578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431920+0000","last_change":"2024-04-25T09:54:27.209041+0000","last_active":"2024-04-25T09:54:33.431920+0000","last_peered":"2024-04-25T09:54:33.431920+0000","last_clean":"2024-04-25T09:54:33.431920+0000","last_became_active":"2024-04-25T09:54:27.208815+0000","last_became_peered":"2024-04-25T09:54:27.208815+0000","last_unstale":"2024-04-25T09:54:33.431920+0000","last_undegraded":"2024-04-25T09:54:33.431920+0000","last_fullsized":"2024-04-25T09:54:33.431920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:04.425728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.248776+0000","last_change":"2024-04-25T09:54:32.302174+0000","last_active":"2024-04-25T09:54:33.248776+0000","last_peered":"2024-04-25T09:54:33.248776+0000","last_clean":"2024-04-25T09:54:33.248776+0000","last_became_active":"2024-04-25T09:54:32.301220+0000","last_became_peered":"2024-04-25T09:54:32.301220+0000","last_unstale":"2024-04-25T09:54:33.248776+0000","last_undegraded":"2024-04-25T09:54:33.248776+0000","last_fullsized":"2024-04-25T09:54:33.248776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:27.568226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.240028+0000","last_change":"2024-04-25T09:54:28.231766+0000","last_active":"2024-04-25T09:54:33.240028+0000","last_peered":"2024-04-25T09:54:33.240028+0000","last_clean":"2024-04-25T09:54:33.240028+0000","last_became_active":"2024-04-25T09:54:28.231150+0000","last_became_peered":"2024-04-25T09:54:28.231150+0000","last_unstale":"2024-04-25T09:54:33.240028+0000","last_undegraded":"2024-04-25T09:54:33.240028+0000","last_fullsized":"2024-04-25T09:54:33.240028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:52.698521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431983+0000","last_change":"2024-04-25T09:54:27.208806+0000","last_active":"2024-04-25T09:54:33.431983+0000","last_peered":"2024-04-25T09:54:33.431983+0000","last_clean":"2024-04-25T09:54:33.431983+0000","last_became_active":"2024-04-25T09:54:27.208458+0000","last_became_peered":"2024-04-25T09:54:27.208458+0000","last_unstale":"2024-04-25T09:54:33.431983+0000","last_undegraded":"2024-04-25T09:54:33.431983+0000","last_fullsized":"2024-04-25T09:54:33.431983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:04.423088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.238922+0000","last_change":"2024-04-25T09:54:32.297590+0000","last_active":"2024-04-25T09:54:33.238922+0000","last_peered":"2024-04-25T09:54:33.238922+0000","last_clean":"2024-04-25T09:54:33.238922+0000","last_became_active":"2024-04-25T09:54:32.297082+0000","last_became_peered":"2024-04-25T09:54:32.297082+0000","last_unstale":"2024-04-25T09:54:33.238922+0000","last_undegraded":"2024-04-25T09:54:33.238922+0000","last_fullsized":"2024-04-25T09:54:33.238922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:47.143113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431792+0000","last_change":"2024-04-25T09:54:28.219353+0000","last_active":"2024-04-25T09:54:33.431792+0000","last_peered":"2024-04-25T09:54:33.431792+0000","last_clean":"2024-04-25T09:54:33.431792+0000","last_became_active":"2024-04-25T09:54:28.219020+0000","last_became_peered":"2024-04-25T09:54:28.219020+0000","last_unstale":"2024-04-25T09:54:33.431792+0000","last_undegraded":"2024-04-25T09:54:33.431792+0000","last_fullsized":"2024-04-25T09:54:33.431792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:33.543144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.428072+0000","last_change":"2024-04-25T09:54:27.211097+0000","last_active":"2024-04-25T09:54:33.428072+0000","last_peered":"2024-04-25T09:54:33.428072+0000","last_clean":"2024-04-25T09:54:33.428072+0000","last_became_active":"2024-04-25T09:54:27.210827+0000","last_became_peered":"2024-04-25T09:54:27.210827+0000","last_unstale":"2024-04-25T09:54:33.428072+0000","last_undegraded":"2024-04-25T09:54:33.428072+0000","last_fullsized":"2024-04-25T09:54:33.428072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:04.423088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432136+0000","last_change":"2024-04-25T09:54:32.298586+0000","last_active":"2024-04-25T09:54:33.432136+0000","last_peered":"2024-04-25T09:54:33.432136+0000","last_clean":"2024-04-25T09:54:33.432136+0000","last_became_active":"2024-04-25T09:54:32.298232+0000","last_became_peered":"2024-04-25T09:54:32.298232+0000","last_unstale":"2024-04-25T09:54:33.432136+0000","last_undegraded":"2024-04-25T09:54:33.432136+0000","last_fullsized":"2024-04-25T09:54:33.432136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:00:29.792006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432216+0000","last_change":"2024-04-25T09:54:28.233937+0000","last_active":"2024-04-25T09:54:33.432216+0000","last_peered":"2024-04-25T09:54:33.432216+0000","last_clean":"2024-04-25T09:54:33.432216+0000","last_became_active":"2024-04-25T09:54:28.233380+0000","last_became_peered":"2024-04-25T09:54:28.233380+0000","last_unstale":"2024-04-25T09:54:33.432216+0000","last_undegraded":"2024-04-25T09:54:33.432216+0000","last_fullsized":"2024-04-25T09:54:33.432216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:26.253699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431881+0000","last_change":"2024-04-25T09:54:27.205411+0000","last_active":"2024-04-25T09:54:33.431881+0000","last_peered":"2024-04-25T09:54:33.431881+0000","last_clean":"2024-04-25T09:54:33.431881+0000","last_became_active":"2024-04-25T09:54:27.205101+0000","last_became_peered":"2024-04-25T09:54:27.205101+0000","last_unstale":"2024-04-25T09:54:33.431881+0000","last_undegraded":"2024-04-25T09:54:33.431881+0000","last_fullsized":"2024-04-25T09:54:33.431881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:34.656261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431521+0000","last_change":"2024-04-25T09:54:32.265789+0000","last_active":"2024-04-25T09:54:33.431521+0000","last_peered":"2024-04-25T09:54:33.431521+0000","last_clean":"2024-04-25T09:54:33.431521+0000","last_became_active":"2024-04-25T09:54:32.265413+0000","last_became_peered":"2024-04-25T09:54:32.265413+0000","last_unstale":"2024-04-25T09:54:33.431521+0000","last_undegraded":"2024-04-25T09:54:33.431521+0000","last_fullsized":"2024-04-25T09:54:33.431521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:40.490493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249457+0000","last_change":"2024-04-25T09:54:28.219660+0000","last_active":"2024-04-25T09:54:33.249457+0000","last_peered":"2024-04-25T09:54:33.249457+0000","last_clean":"2024-04-25T09:54:33.249457+0000","last_became_active":"2024-04-25T09:54:28.219368+0000","last_became_peered":"2024-04-25T09:54:28.219368+0000","last_unstale":"2024-04-25T09:54:33.249457+0000","last_undegraded":"2024-04-25T09:54:33.249457+0000","last_fullsized":"2024-04-25T09:54:33.249457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:54.743779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431901+0000","last_change":"2024-04-25T09:54:27.211603+0000","last_active":"2024-04-25T09:54:33.431901+0000","last_peered":"2024-04-25T09:54:33.431901+0000","last_clean":"2024-04-25T09:54:33.431901+0000","last_became_active":"2024-04-25T09:54:27.211196+0000","last_became_peered":"2024-04-25T09:54:27.211196+0000","last_unstale":"2024-04-25T09:54:33.431901+0000","last_undegraded":"2024-04-25T09:54:33.431901+0000","last_fullsized":"2024-04-25T09:54:33.431901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:04.425728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431739+0000","last_change":"2024-04-25T09:54:32.260167+0000","last_active":"2024-04-25T09:54:33.431739+0000","last_peered":"2024-04-25T09:54:33.431739+0000","last_clean":"2024-04-25T09:54:33.431739+0000","last_became_active":"2024-04-25T09:54:32.259801+0000","last_became_peered":"2024-04-25T09:54:32.259801+0000","last_unstale":"2024-04-25T09:54:33.431739+0000","last_undegraded":"2024-04-25T09:54:33.431739+0000","last_fullsized":"2024-04-25T09:54:33.431739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:30.296146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431154+0000","last_change":"2024-04-25T09:54:28.220347+0000","last_active":"2024-04-25T09:54:33.431154+0000","last_peered":"2024-04-25T09:54:33.431154+0000","last_clean":"2024-04-25T09:54:33.431154+0000","last_became_active":"2024-04-25T09:54:28.219921+0000","last_became_peered":"2024-04-25T09:54:28.219921+0000","last_unstale":"2024-04-25T09:54:33.431154+0000","last_undegraded":"2024-04-25T09:54:33.431154+0000","last_fullsized":"2024-04-25T09:54:33.431154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:04.526578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431058+0000","last_change":"2024-04-25T09:54:27.207799+0000","last_active":"2024-04-25T09:54:33.431058+0000","last_peered":"2024-04-25T09:54:33.431058+0000","last_clean":"2024-04-25T09:54:33.431058+0000","last_became_active":"2024-04-25T09:54:27.207502+0000","last_became_peered":"2024-04-25T09:54:27.207502+0000","last_unstale":"2024-04-25T09:54:33.431058+0000","last_undegraded":"2024-04-25T09:54:33.431058+0000","last_fullsized":"2024-04-25T09:54:33.431058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:02.804762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432415+0000","last_change":"2024-04-25T09:54:32.259101+0000","last_active":"2024-04-25T09:54:33.432415+0000","last_peered":"2024-04-25T09:54:33.432415+0000","last_clean":"2024-04-25T09:54:33.432415+0000","last_became_active":"2024-04-25T09:54:32.258688+0000","last_became_peered":"2024-04-25T09:54:32.258688+0000","last_unstale":"2024-04-25T09:54:33.432415+0000","last_undegraded":"2024-04-25T09:54:33.432415+0000","last_fullsized":"2024-04-25T09:54:33.432415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:14.029429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430481+0000","last_change":"2024-04-25T09:54:28.225496+0000","last_active":"2024-04-25T09:54:33.430481+0000","last_peered":"2024-04-25T09:54:33.430481+0000","last_clean":"2024-04-25T09:54:33.430481+0000","last_became_active":"2024-04-25T09:54:28.224696+0000","last_became_peered":"2024-04-25T09:54:28.224696+0000","last_unstale":"2024-04-25T09:54:33.430481+0000","last_undegraded":"2024-04-25T09:54:33.430481+0000","last_fullsized":"2024-04-25T09:54:33.430481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:04.396335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427226+0000","last_change":"2024-04-25T09:54:27.209821+0000","last_active":"2024-04-25T09:54:33.427226+0000","last_peered":"2024-04-25T09:54:33.427226+0000","last_clean":"2024-04-25T09:54:33.427226+0000","last_became_active":"2024-04-25T09:54:27.209548+0000","last_became_peered":"2024-04-25T09:54:27.209548+0000","last_unstale":"2024-04-25T09:54:33.427226+0000","last_undegraded":"2024-04-25T09:54:33.427226+0000","last_fullsized":"2024-04-25T09:54:33.427226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:34.656261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431635+0000","last_change":"2024-04-25T09:54:32.300518+0000","last_active":"2024-04-25T09:54:33.431635+0000","last_peered":"2024-04-25T09:54:33.431635+0000","last_clean":"2024-04-25T09:54:33.431635+0000","last_became_active":"2024-04-25T09:54:32.299847+0000","last_became_peered":"2024-04-25T09:54:32.299847+0000","last_unstale":"2024-04-25T09:54:33.431635+0000","last_undegraded":"2024-04-25T09:54:33.431635+0000","last_fullsized":"2024-04-25T09:54:33.431635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:30.296146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239165+0000","last_change":"2024-04-25T09:54:28.236433+0000","last_active":"2024-04-25T09:54:33.239165+0000","last_peered":"2024-04-25T09:54:33.239165+0000","last_clean":"2024-04-25T09:54:33.239165+0000","last_became_active":"2024-04-25T09:54:28.236130+0000","last_became_peered":"2024-04-25T09:54:28.236130+0000","last_unstale":"2024-04-25T09:54:33.239165+0000","last_undegraded":"2024-04-25T09:54:33.239165+0000","last_fullsized":"2024-04-25T09:54:33.239165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:33.543144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431705+0000","last_change":"2024-04-25T09:54:27.211760+0000","last_active":"2024-04-25T09:54:33.431705+0000","last_peered":"2024-04-25T09:54:33.431705+0000","last_clean":"2024-04-25T09:54:33.431705+0000","last_became_active":"2024-04-25T09:54:27.211452+0000","last_became_peered":"2024-04-25T09:54:27.211452+0000","last_unstale":"2024-04-25T09:54:33.431705+0000","last_undegraded":"2024-04-25T09:54:33.431705+0000","last_fullsized":"2024-04-25T09:54:33.431705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:02.804762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427371+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T09:54:33.427371+0000","last_peered":"2024-04-25T09:54:33.427371+0000","last_clean":"2024-04-25T09:54:33.427371+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T09:54:33.427371+0000","last_undegraded":"2024-04-25T09:54:33.427371+0000","last_fullsized":"2024-04-25T09:54:33.427371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431481+0000","last_change":"2024-04-25T09:54:32.299780+0000","last_active":"2024-04-25T09:54:33.431481+0000","last_peered":"2024-04-25T09:54:33.431481+0000","last_clean":"2024-04-25T09:54:33.431481+0000","last_became_active":"2024-04-25T09:54:32.299351+0000","last_became_peered":"2024-04-25T09:54:32.299351+0000","last_unstale":"2024-04-25T09:54:33.431481+0000","last_undegraded":"2024-04-25T09:54:33.431481+0000","last_fullsized":"2024-04-25T09:54:33.431481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:08.992474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427622+0000","last_change":"2024-04-25T09:54:28.235625+0000","last_active":"2024-04-25T09:54:33.427622+0000","last_peered":"2024-04-25T09:54:33.427622+0000","last_clean":"2024-04-25T09:54:33.427622+0000","last_became_active":"2024-04-25T09:54:28.235034+0000","last_became_peered":"2024-04-25T09:54:28.235034+0000","last_unstale":"2024-04-25T09:54:33.427622+0000","last_undegraded":"2024-04-25T09:54:33.427622+0000","last_fullsized":"2024-04-25T09:54:33.427622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:04.950026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432393+0000","last_change":"2024-04-25T09:54:27.212307+0000","last_active":"2024-04-25T09:54:33.432393+0000","last_peered":"2024-04-25T09:54:33.432393+0000","last_clean":"2024-04-25T09:54:33.432393+0000","last_became_active":"2024-04-25T09:54:27.211984+0000","last_became_peered":"2024-04-25T09:54:27.211984+0000","last_unstale":"2024-04-25T09:54:33.432393+0000","last_undegraded":"2024-04-25T09:54:33.432393+0000","last_fullsized":"2024-04-25T09:54:33.432393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:34.656261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431021+0000","last_change":"2024-04-25T09:54:32.297686+0000","last_active":"2024-04-25T09:54:33.431021+0000","last_peered":"2024-04-25T09:54:33.431021+0000","last_clean":"2024-04-25T09:54:33.431021+0000","last_became_active":"2024-04-25T09:54:32.297151+0000","last_became_peered":"2024-04-25T09:54:32.297151+0000","last_unstale":"2024-04-25T09:54:33.431021+0000","last_undegraded":"2024-04-25T09:54:33.431021+0000","last_fullsized":"2024-04-25T09:54:33.431021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:10.694250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432122+0000","last_change":"2024-04-25T09:54:28.230960+0000","last_active":"2024-04-25T09:54:33.432122+0000","last_peered":"2024-04-25T09:54:33.432122+0000","last_clean":"2024-04-25T09:54:33.432122+0000","last_became_active":"2024-04-25T09:54:28.230684+0000","last_became_peered":"2024-04-25T09:54:28.230684+0000","last_unstale":"2024-04-25T09:54:33.432122+0000","last_undegraded":"2024-04-25T09:54:33.432122+0000","last_fullsized":"2024-04-25T09:54:33.432122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:06.651802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431464+0000","last_change":"2024-04-25T09:54:27.205085+0000","last_active":"2024-04-25T09:54:33.431464+0000","last_peered":"2024-04-25T09:54:33.431464+0000","last_clean":"2024-04-25T09:54:33.431464+0000","last_became_active":"2024-04-25T09:54:27.204801+0000","last_became_peered":"2024-04-25T09:54:27.204801+0000","last_unstale":"2024-04-25T09:54:33.431464+0000","last_undegraded":"2024-04-25T09:54:33.431464+0000","last_fullsized":"2024-04-25T09:54:33.431464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:53.735742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432256+0000","last_change":"2024-04-25T09:54:32.262455+0000","last_active":"2024-04-25T09:54:33.432256+0000","last_peered":"2024-04-25T09:54:33.432256+0000","last_clean":"2024-04-25T09:54:33.432256+0000","last_became_active":"2024-04-25T09:54:32.261864+0000","last_became_peered":"2024-04-25T09:54:32.261864+0000","last_unstale":"2024-04-25T09:54:33.432256+0000","last_undegraded":"2024-04-25T09:54:33.432256+0000","last_fullsized":"2024-04-25T09:54:33.432256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:14.029429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.428064+0000","last_change":"2024-04-25T09:54:28.231074+0000","last_active":"2024-04-25T09:54:33.428064+0000","last_peered":"2024-04-25T09:54:33.428064+0000","last_clean":"2024-04-25T09:54:33.428064+0000","last_became_active":"2024-04-25T09:54:28.230535+0000","last_became_peered":"2024-04-25T09:54:28.230535+0000","last_unstale":"2024-04-25T09:54:33.428064+0000","last_undegraded":"2024-04-25T09:54:33.428064+0000","last_fullsized":"2024-04-25T09:54:33.428064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:09.986981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430862+0000","last_change":"2024-04-25T09:54:27.204630+0000","last_active":"2024-04-25T09:54:33.430862+0000","last_peered":"2024-04-25T09:54:33.430862+0000","last_clean":"2024-04-25T09:54:33.430862+0000","last_became_active":"2024-04-25T09:54:27.204321+0000","last_became_peered":"2024-04-25T09:54:27.204321+0000","last_unstale":"2024-04-25T09:54:33.430862+0000","last_undegraded":"2024-04-25T09:54:33.430862+0000","last_fullsized":"2024-04-25T09:54:33.430862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:25.329710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430615+0000","last_change":"2024-04-25T09:54:32.299684+0000","last_active":"2024-04-25T09:54:33.430615+0000","last_peered":"2024-04-25T09:54:33.430615+0000","last_clean":"2024-04-25T09:54:33.430615+0000","last_became_active":"2024-04-25T09:54:32.299058+0000","last_became_peered":"2024-04-25T09:54:32.299058+0000","last_unstale":"2024-04-25T09:54:33.430615+0000","last_undegraded":"2024-04-25T09:54:33.430615+0000","last_fullsized":"2024-04-25T09:54:33.430615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:44.665406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427809+0000","last_change":"2024-04-25T09:54:28.222738+0000","last_active":"2024-04-25T09:54:33.427809+0000","last_peered":"2024-04-25T09:54:33.427809+0000","last_clean":"2024-04-25T09:54:33.427809+0000","last_became_active":"2024-04-25T09:54:28.222468+0000","last_became_peered":"2024-04-25T09:54:28.222468+0000","last_unstale":"2024-04-25T09:54:33.427809+0000","last_undegraded":"2024-04-25T09:54:33.427809+0000","last_fullsized":"2024-04-25T09:54:33.427809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:36.448046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249841+0000","last_change":"2024-04-25T09:54:27.194471+0000","last_active":"2024-04-25T09:54:33.249841+0000","last_peered":"2024-04-25T09:54:33.249841+0000","last_clean":"2024-04-25T09:54:33.249841+0000","last_became_active":"2024-04-25T09:54:27.194172+0000","last_became_peered":"2024-04-25T09:54:27.194172+0000","last_unstale":"2024-04-25T09:54:33.249841+0000","last_undegraded":"2024-04-25T09:54:33.249841+0000","last_fullsized":"2024-04-25T09:54:33.249841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:47.482218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.248742+0000","last_change":"2024-04-25T09:54:32.266552+0000","last_active":"2024-04-25T09:54:33.248742+0000","last_peered":"2024-04-25T09:54:33.248742+0000","last_clean":"2024-04-25T09:54:33.248742+0000","last_became_active":"2024-04-25T09:54:32.266152+0000","last_became_peered":"2024-04-25T09:54:32.266152+0000","last_unstale":"2024-04-25T09:54:33.248742+0000","last_undegraded":"2024-04-25T09:54:33.248742+0000","last_fullsized":"2024-04-25T09:54:33.248742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:12.761675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427450+0000","last_change":"2024-04-25T09:54:28.225409+0000","last_active":"2024-04-25T09:54:33.427450+0000","last_peered":"2024-04-25T09:54:33.427450+0000","last_clean":"2024-04-25T09:54:33.427450+0000","last_became_active":"2024-04-25T09:54:28.225105+0000","last_became_peered":"2024-04-25T09:54:28.225105+0000","last_unstale":"2024-04-25T09:54:33.427450+0000","last_undegraded":"2024-04-25T09:54:33.427450+0000","last_fullsized":"2024-04-25T09:54:33.427450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:15.832642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430867+0000","last_change":"2024-04-25T09:54:27.207980+0000","last_active":"2024-04-25T09:54:33.430867+0000","last_peered":"2024-04-25T09:54:33.430867+0000","last_clean":"2024-04-25T09:54:33.430867+0000","last_became_active":"2024-04-25T09:54:27.205322+0000","last_became_peered":"2024-04-25T09:54:27.205322+0000","last_unstale":"2024-04-25T09:54:33.430867+0000","last_undegraded":"2024-04-25T09:54:33.430867+0000","last_fullsized":"2024-04-25T09:54:33.430867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:43.025512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431489+0000","last_change":"2024-04-25T09:54:32.252925+0000","last_active":"2024-04-25T09:54:33.431489+0000","last_peered":"2024-04-25T09:54:33.431489+0000","last_clean":"2024-04-25T09:54:33.431489+0000","last_became_active":"2024-04-25T09:54:32.252483+0000","last_became_peered":"2024-04-25T09:54:32.252483+0000","last_unstale":"2024-04-25T09:54:33.431489+0000","last_undegraded":"2024-04-25T09:54:33.431489+0000","last_fullsized":"2024-04-25T09:54:33.431489+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:55.727375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430685+0000","last_change":"2024-04-25T09:54:28.227852+0000","last_active":"2024-04-25T09:54:33.430685+0000","last_peered":"2024-04-25T09:54:33.430685+0000","last_clean":"2024-04-25T09:54:33.430685+0000","last_became_active":"2024-04-25T09:54:28.227552+0000","last_became_peered":"2024-04-25T09:54:28.227552+0000","last_unstale":"2024-04-25T09:54:33.430685+0000","last_undegraded":"2024-04-25T09:54:33.430685+0000","last_fullsized":"2024-04-25T09:54:33.430685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:29.799078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430794+0000","last_change":"2024-04-25T09:54:27.203990+0000","last_active":"2024-04-25T09:54:33.430794+0000","last_peered":"2024-04-25T09:54:33.430794+0000","last_clean":"2024-04-25T09:54:33.430794+0000","last_became_active":"2024-04-25T09:54:27.203714+0000","last_became_peered":"2024-04-25T09:54:27.203714+0000","last_unstale":"2024-04-25T09:54:33.430794+0000","last_undegraded":"2024-04-25T09:54:33.430794+0000","last_fullsized":"2024-04-25T09:54:33.430794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:02.804762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.240156+0000","last_change":"2024-04-25T09:54:32.300515+0000","last_active":"2024-04-25T09:54:33.240156+0000","last_peered":"2024-04-25T09:54:33.240156+0000","last_clean":"2024-04-25T09:54:33.240156+0000","last_became_active":"2024-04-25T09:54:32.300114+0000","last_became_peered":"2024-04-25T09:54:32.300114+0000","last_unstale":"2024-04-25T09:54:33.240156+0000","last_undegraded":"2024-04-25T09:54:33.240156+0000","last_fullsized":"2024-04-25T09:54:33.240156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:33.865351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427679+0000","last_change":"2024-04-25T09:54:28.231995+0000","last_active":"2024-04-25T09:54:33.427679+0000","last_peered":"2024-04-25T09:54:33.427679+0000","last_clean":"2024-04-25T09:54:33.427679+0000","last_became_active":"2024-04-25T09:54:28.231448+0000","last_became_peered":"2024-04-25T09:54:28.231448+0000","last_unstale":"2024-04-25T09:54:33.427679+0000","last_undegraded":"2024-04-25T09:54:33.427679+0000","last_fullsized":"2024-04-25T09:54:33.427679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:52.698521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431789+0000","last_change":"2024-04-25T09:54:27.211810+0000","last_active":"2024-04-25T09:54:33.431789+0000","last_peered":"2024-04-25T09:54:33.431789+0000","last_clean":"2024-04-25T09:54:33.431789+0000","last_became_active":"2024-04-25T09:54:27.211460+0000","last_became_peered":"2024-04-25T09:54:27.211460+0000","last_unstale":"2024-04-25T09:54:33.431789+0000","last_undegraded":"2024-04-25T09:54:33.431789+0000","last_fullsized":"2024-04-25T09:54:33.431789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:39.794974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239769+0000","last_change":"2024-04-25T09:54:32.297745+0000","last_active":"2024-04-25T09:54:33.239769+0000","last_peered":"2024-04-25T09:54:33.239769+0000","last_clean":"2024-04-25T09:54:33.239769+0000","last_became_active":"2024-04-25T09:54:32.297173+0000","last_became_peered":"2024-04-25T09:54:32.297173+0000","last_unstale":"2024-04-25T09:54:33.239769+0000","last_undegraded":"2024-04-25T09:54:33.239769+0000","last_fullsized":"2024-04-25T09:54:33.239769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:44.665406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431853+0000","last_change":"2024-04-25T09:54:28.235736+0000","last_active":"2024-04-25T09:54:33.431853+0000","last_peered":"2024-04-25T09:54:33.431853+0000","last_clean":"2024-04-25T09:54:33.431853+0000","last_became_active":"2024-04-25T09:54:28.235437+0000","last_became_peered":"2024-04-25T09:54:28.235437+0000","last_unstale":"2024-04-25T09:54:33.431853+0000","last_undegraded":"2024-04-25T09:54:33.431853+0000","last_fullsized":"2024-04-25T09:54:33.431853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:16.438954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432306+0000","last_change":"2024-04-25T09:54:27.194948+0000","last_active":"2024-04-25T09:54:33.432306+0000","last_peered":"2024-04-25T09:54:33.432306+0000","last_clean":"2024-04-25T09:54:33.432306+0000","last_became_active":"2024-04-25T09:54:27.194622+0000","last_became_peered":"2024-04-25T09:54:27.194622+0000","last_unstale":"2024-04-25T09:54:33.432306+0000","last_undegraded":"2024-04-25T09:54:33.432306+0000","last_fullsized":"2024-04-25T09:54:33.432306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:15.480038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432224+0000","last_change":"2024-04-25T09:54:32.298286+0000","last_active":"2024-04-25T09:54:33.432224+0000","last_peered":"2024-04-25T09:54:33.432224+0000","last_clean":"2024-04-25T09:54:33.432224+0000","last_became_active":"2024-04-25T09:54:32.297524+0000","last_became_peered":"2024-04-25T09:54:32.297524+0000","last_unstale":"2024-04-25T09:54:33.432224+0000","last_undegraded":"2024-04-25T09:54:33.432224+0000","last_fullsized":"2024-04-25T09:54:33.432224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:26.797002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427520+0000","last_change":"2024-04-25T09:54:28.225357+0000","last_active":"2024-04-25T09:54:33.427520+0000","last_peered":"2024-04-25T09:54:33.427520+0000","last_clean":"2024-04-25T09:54:33.427520+0000","last_became_active":"2024-04-25T09:54:28.225069+0000","last_became_peered":"2024-04-25T09:54:28.225069+0000","last_unstale":"2024-04-25T09:54:33.427520+0000","last_undegraded":"2024-04-25T09:54:33.427520+0000","last_fullsized":"2024-04-25T09:54:33.427520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:06.651802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:37.528828+0000","last_change":"2024-04-25T09:54:27.203341+0000","last_active":"2024-04-25T09:54:37.528828+0000","last_peered":"2024-04-25T09:54:37.528828+0000","last_clean":"2024-04-25T09:54:37.528828+0000","last_became_active":"2024-04-25T09:54:27.203044+0000","last_became_peered":"2024-04-25T09:54:27.203044+0000","last_unstale":"2024-04-25T09:54:37.528828+0000","last_undegraded":"2024-04-25T09:54:37.528828+0000","last_fullsized":"2024-04-25T09:54:37.528828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:34.656261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431728+0000","last_change":"2024-04-25T09:54:32.264939+0000","last_active":"2024-04-25T09:54:33.431728+0000","last_peered":"2024-04-25T09:54:33.431728+0000","last_clean":"2024-04-25T09:54:33.431728+0000","last_became_active":"2024-04-25T09:54:32.263237+0000","last_became_peered":"2024-04-25T09:54:32.263237+0000","last_unstale":"2024-04-25T09:54:33.431728+0000","last_undegraded":"2024-04-25T09:54:33.431728+0000","last_fullsized":"2024-04-25T09:54:33.431728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:55.727375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249518+0000","last_change":"2024-04-25T09:54:28.228347+0000","last_active":"2024-04-25T09:54:33.249518+0000","last_peered":"2024-04-25T09:54:33.249518+0000","last_clean":"2024-04-25T09:54:33.249518+0000","last_became_active":"2024-04-25T09:54:28.228054+0000","last_became_peered":"2024-04-25T09:54:28.228054+0000","last_unstale":"2024-04-25T09:54:33.249518+0000","last_undegraded":"2024-04-25T09:54:33.249518+0000","last_fullsized":"2024-04-25T09:54:33.249518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:05.431124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431354+0000","last_change":"2024-04-25T09:54:27.213081+0000","last_active":"2024-04-25T09:54:33.431354+0000","last_peered":"2024-04-25T09:54:33.431354+0000","last_clean":"2024-04-25T09:54:33.431354+0000","last_became_active":"2024-04-25T09:54:27.212717+0000","last_became_peered":"2024-04-25T09:54:27.212717+0000","last_unstale":"2024-04-25T09:54:33.431354+0000","last_undegraded":"2024-04-25T09:54:33.431354+0000","last_fullsized":"2024-04-25T09:54:33.431354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:39.794974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249368+0000","last_change":"2024-04-25T09:54:32.265709+0000","last_active":"2024-04-25T09:54:33.249368+0000","last_peered":"2024-04-25T09:54:33.249368+0000","last_clean":"2024-04-25T09:54:33.249368+0000","last_became_active":"2024-04-25T09:54:32.264564+0000","last_became_peered":"2024-04-25T09:54:32.264564+0000","last_unstale":"2024-04-25T09:54:33.249368+0000","last_undegraded":"2024-04-25T09:54:33.249368+0000","last_fullsized":"2024-04-25T09:54:33.249368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:56.740969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430940+0000","last_change":"2024-04-25T09:54:28.230395+0000","last_active":"2024-04-25T09:54:33.430940+0000","last_peered":"2024-04-25T09:54:33.430940+0000","last_clean":"2024-04-25T09:54:33.430940+0000","last_became_active":"2024-04-25T09:54:28.230094+0000","last_became_peered":"2024-04-25T09:54:28.230094+0000","last_unstale":"2024-04-25T09:54:33.430940+0000","last_undegraded":"2024-04-25T09:54:33.430940+0000","last_fullsized":"2024-04-25T09:54:33.430940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:08.719227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431892+0000","last_change":"2024-04-25T09:54:27.215296+0000","last_active":"2024-04-25T09:54:33.431892+0000","last_peered":"2024-04-25T09:54:33.431892+0000","last_clean":"2024-04-25T09:54:33.431892+0000","last_became_active":"2024-04-25T09:54:27.215029+0000","last_became_peered":"2024-04-25T09:54:27.215029+0000","last_unstale":"2024-04-25T09:54:33.431892+0000","last_undegraded":"2024-04-25T09:54:33.431892+0000","last_fullsized":"2024-04-25T09:54:33.431892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:34.656261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239377+0000","last_change":"2024-04-25T09:54:32.259386+0000","last_active":"2024-04-25T09:54:33.239377+0000","last_peered":"2024-04-25T09:54:33.239377+0000","last_clean":"2024-04-25T09:54:33.239377+0000","last_became_active":"2024-04-25T09:54:32.258463+0000","last_became_peered":"2024-04-25T09:54:32.258463+0000","last_unstale":"2024-04-25T09:54:33.239377+0000","last_undegraded":"2024-04-25T09:54:33.239377+0000","last_fullsized":"2024-04-25T09:54:33.239377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:55.620829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431885+0000","last_change":"2024-04-25T09:54:28.232092+0000","last_active":"2024-04-25T09:54:33.431885+0000","last_peered":"2024-04-25T09:54:33.431885+0000","last_clean":"2024-04-25T09:54:33.431885+0000","last_became_active":"2024-04-25T09:54:28.230521+0000","last_became_peered":"2024-04-25T09:54:28.230521+0000","last_unstale":"2024-04-25T09:54:33.431885+0000","last_undegraded":"2024-04-25T09:54:33.431885+0000","last_fullsized":"2024-04-25T09:54:33.431885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:51.684928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431720+0000","last_change":"2024-04-25T09:54:27.212262+0000","last_active":"2024-04-25T09:54:33.431720+0000","last_peered":"2024-04-25T09:54:33.431720+0000","last_clean":"2024-04-25T09:54:33.431720+0000","last_became_active":"2024-04-25T09:54:27.212009+0000","last_became_peered":"2024-04-25T09:54:27.212009+0000","last_unstale":"2024-04-25T09:54:33.431720+0000","last_undegraded":"2024-04-25T09:54:33.431720+0000","last_fullsized":"2024-04-25T09:54:33.431720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:25.329710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239235+0000","last_change":"2024-04-25T09:54:32.300659+0000","last_active":"2024-04-25T09:54:33.239235+0000","last_peered":"2024-04-25T09:54:33.239235+0000","last_clean":"2024-04-25T09:54:33.239235+0000","last_became_active":"2024-04-25T09:54:32.300214+0000","last_became_peered":"2024-04-25T09:54:32.300214+0000","last_unstale":"2024-04-25T09:54:33.239235+0000","last_undegraded":"2024-04-25T09:54:33.239235+0000","last_fullsized":"2024-04-25T09:54:33.239235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:13.180594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431335+0000","last_change":"2024-04-25T09:54:32.300216+0000","last_active":"2024-04-25T09:54:33.431335+0000","last_peered":"2024-04-25T09:54:33.431335+0000","last_clean":"2024-04-25T09:54:33.431335+0000","last_became_active":"2024-04-25T09:54:32.299316+0000","last_became_peered":"2024-04-25T09:54:32.299316+0000","last_unstale":"2024-04-25T09:54:33.431335+0000","last_undegraded":"2024-04-25T09:54:33.431335+0000","last_fullsized":"2024-04-25T09:54:33.431335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:40.490493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430556+0000","last_change":"2024-04-25T09:54:28.214303+0000","last_active":"2024-04-25T09:54:33.430556+0000","last_peered":"2024-04-25T09:54:33.430556+0000","last_clean":"2024-04-25T09:54:33.430556+0000","last_became_active":"2024-04-25T09:54:28.213973+0000","last_became_peered":"2024-04-25T09:54:28.213973+0000","last_unstale":"2024-04-25T09:54:33.430556+0000","last_undegraded":"2024-04-25T09:54:33.430556+0000","last_fullsized":"2024-04-25T09:54:33.430556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:23.525779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430800+0000","last_change":"2024-04-25T09:54:27.210642+0000","last_active":"2024-04-25T09:54:33.430800+0000","last_peered":"2024-04-25T09:54:33.430800+0000","last_clean":"2024-04-25T09:54:33.430800+0000","last_became_active":"2024-04-25T09:54:27.210345+0000","last_became_peered":"2024-04-25T09:54:27.210345+0000","last_unstale":"2024-04-25T09:54:33.430800+0000","last_undegraded":"2024-04-25T09:54:33.430800+0000","last_fullsized":"2024-04-25T09:54:33.430800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:25.329710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432201+0000","last_change":"2024-04-25T09:54:32.262209+0000","last_active":"2024-04-25T09:54:33.432201+0000","last_peered":"2024-04-25T09:54:33.432201+0000","last_clean":"2024-04-25T09:54:33.432201+0000","last_became_active":"2024-04-25T09:54:32.261761+0000","last_became_peered":"2024-04-25T09:54:32.261761+0000","last_unstale":"2024-04-25T09:54:33.432201+0000","last_undegraded":"2024-04-25T09:54:33.432201+0000","last_fullsized":"2024-04-25T09:54:33.432201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:40.490493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239107+0000","last_change":"2024-04-25T09:54:28.216779+0000","last_active":"2024-04-25T09:54:33.239107+0000","last_peered":"2024-04-25T09:54:33.239107+0000","last_clean":"2024-04-25T09:54:33.239107+0000","last_became_active":"2024-04-25T09:54:28.216470+0000","last_became_peered":"2024-04-25T09:54:28.216470+0000","last_unstale":"2024-04-25T09:54:33.239107+0000","last_undegraded":"2024-04-25T09:54:33.239107+0000","last_fullsized":"2024-04-25T09:54:33.239107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:04.526578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239393+0000","last_change":"2024-04-25T09:54:27.206958+0000","last_active":"2024-04-25T09:54:33.239393+0000","last_peered":"2024-04-25T09:54:33.239393+0000","last_clean":"2024-04-25T09:54:33.239393+0000","last_became_active":"2024-04-25T09:54:27.206664+0000","last_became_peered":"2024-04-25T09:54:27.206664+0000","last_unstale":"2024-04-25T09:54:33.239393+0000","last_undegraded":"2024-04-25T09:54:33.239393+0000","last_fullsized":"2024-04-25T09:54:33.239393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:44.480619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431165+0000","last_change":"2024-04-25T09:54:27.204005+0000","last_active":"2024-04-25T09:54:33.431165+0000","last_peered":"2024-04-25T09:54:33.431165+0000","last_clean":"2024-04-25T09:54:33.431165+0000","last_became_active":"2024-04-25T09:54:27.203754+0000","last_became_peered":"2024-04-25T09:54:27.203754+0000","last_unstale":"2024-04-25T09:54:33.431165+0000","last_undegraded":"2024-04-25T09:54:33.431165+0000","last_fullsized":"2024-04-25T09:54:33.431165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:39.794974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432276+0000","last_change":"2024-04-25T09:54:28.224588+0000","last_active":"2024-04-25T09:54:33.432276+0000","last_peered":"2024-04-25T09:54:33.432276+0000","last_clean":"2024-04-25T09:54:33.432276+0000","last_became_active":"2024-04-25T09:54:28.224085+0000","last_became_peered":"2024-04-25T09:54:28.224085+0000","last_unstale":"2024-04-25T09:54:33.432276+0000","last_undegraded":"2024-04-25T09:54:33.432276+0000","last_fullsized":"2024-04-25T09:54:33.432276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:23.525779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432222+0000","last_change":"2024-04-25T09:54:32.258902+0000","last_active":"2024-04-25T09:54:33.432222+0000","last_peered":"2024-04-25T09:54:33.432222+0000","last_clean":"2024-04-25T09:54:33.432222+0000","last_became_active":"2024-04-25T09:54:32.258520+0000","last_became_peered":"2024-04-25T09:54:32.258520+0000","last_unstale":"2024-04-25T09:54:33.432222+0000","last_undegraded":"2024-04-25T09:54:33.432222+0000","last_fullsized":"2024-04-25T09:54:33.432222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:31.442262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239580+0000","last_change":"2024-04-25T09:54:27.210481+0000","last_active":"2024-04-25T09:54:33.239580+0000","last_peered":"2024-04-25T09:54:33.239580+0000","last_clean":"2024-04-25T09:54:33.239580+0000","last_became_active":"2024-04-25T09:54:27.210234+0000","last_became_peered":"2024-04-25T09:54:27.210234+0000","last_unstale":"2024-04-25T09:54:33.239580+0000","last_undegraded":"2024-04-25T09:54:33.239580+0000","last_fullsized":"2024-04-25T09:54:33.239580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:43.025512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249024+0000","last_change":"2024-04-25T09:54:28.217905+0000","last_active":"2024-04-25T09:54:33.249024+0000","last_peered":"2024-04-25T09:54:33.249024+0000","last_clean":"2024-04-25T09:54:33.249024+0000","last_became_active":"2024-04-25T09:54:28.216955+0000","last_became_peered":"2024-04-25T09:54:28.216955+0000","last_unstale":"2024-04-25T09:54:33.249024+0000","last_undegraded":"2024-04-25T09:54:33.249024+0000","last_fullsized":"2024-04-25T09:54:33.249024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:05.433765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239944+0000","last_change":"2024-04-25T09:54:32.258140+0000","last_active":"2024-04-25T09:54:33.239944+0000","last_peered":"2024-04-25T09:54:33.239944+0000","last_clean":"2024-04-25T09:54:33.239944+0000","last_became_active":"2024-04-25T09:54:32.257702+0000","last_became_peered":"2024-04-25T09:54:32.257702+0000","last_unstale":"2024-04-25T09:54:33.239944+0000","last_undegraded":"2024-04-25T09:54:33.239944+0000","last_fullsized":"2024-04-25T09:54:33.239944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:26.797002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430559+0000","last_change":"2024-04-25T09:54:28.228362+0000","last_active":"2024-04-25T09:54:33.430559+0000","last_peered":"2024-04-25T09:54:33.430559+0000","last_clean":"2024-04-25T09:54:33.430559+0000","last_became_active":"2024-04-25T09:54:28.228109+0000","last_became_peered":"2024-04-25T09:54:28.228109+0000","last_unstale":"2024-04-25T09:54:33.430559+0000","last_undegraded":"2024-04-25T09:54:33.430559+0000","last_fullsized":"2024-04-25T09:54:33.430559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:04.526578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431200+0000","last_change":"2024-04-25T09:54:28.231028+0000","last_active":"2024-04-25T09:54:33.431200+0000","last_peered":"2024-04-25T09:54:33.431200+0000","last_clean":"2024-04-25T09:54:33.431200+0000","last_became_active":"2024-04-25T09:54:28.230707+0000","last_became_peered":"2024-04-25T09:54:28.230707+0000","last_unstale":"2024-04-25T09:54:33.431200+0000","last_undegraded":"2024-04-25T09:54:33.431200+0000","last_fullsized":"2024-04-25T09:54:33.431200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:54.743779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431645+0000","last_change":"2024-04-25T09:54:28.233501+0000","last_active":"2024-04-25T09:54:33.431645+0000","last_peered":"2024-04-25T09:54:33.431645+0000","last_clean":"2024-04-25T09:54:33.431645+0000","last_became_active":"2024-04-25T09:54:28.232806+0000","last_became_peered":"2024-04-25T09:54:28.232806+0000","last_unstale":"2024-04-25T09:54:33.431645+0000","last_undegraded":"2024-04-25T09:54:33.431645+0000","last_fullsized":"2024-04-25T09:54:33.431645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:04.950026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432189+0000","last_change":"2024-04-25T09:54:28.215003+0000","last_active":"2024-04-25T09:54:33.432189+0000","last_peered":"2024-04-25T09:54:33.432189+0000","last_clean":"2024-04-25T09:54:33.432189+0000","last_became_active":"2024-04-25T09:54:28.214700+0000","last_became_peered":"2024-04-25T09:54:28.214700+0000","last_unstale":"2024-04-25T09:54:33.432189+0000","last_undegraded":"2024-04-25T09:54:33.432189+0000","last_fullsized":"2024-04-25T09:54:33.432189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:47.076023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239981+0000","last_change":"2024-04-25T09:54:28.221725+0000","last_active":"2024-04-25T09:54:33.239981+0000","last_peered":"2024-04-25T09:54:33.239981+0000","last_clean":"2024-04-25T09:54:33.239981+0000","last_became_active":"2024-04-25T09:54:28.221436+0000","last_became_peered":"2024-04-25T09:54:28.221436+0000","last_unstale":"2024-04-25T09:54:33.239981+0000","last_undegraded":"2024-04-25T09:54:33.239981+0000","last_fullsized":"2024-04-25T09:54:33.239981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:08:42.765805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431173+0000","last_change":"2024-04-25T09:54:28.214081+0000","last_active":"2024-04-25T09:54:33.431173+0000","last_peered":"2024-04-25T09:54:33.431173+0000","last_clean":"2024-04-25T09:54:33.431173+0000","last_became_active":"2024-04-25T09:54:28.213740+0000","last_became_peered":"2024-04-25T09:54:28.213740+0000","last_unstale":"2024-04-25T09:54:33.431173+0000","last_undegraded":"2024-04-25T09:54:33.431173+0000","last_fullsized":"2024-04-25T09:54:33.431173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:47.076023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431566+0000","last_change":"2024-04-25T09:54:28.233804+0000","last_active":"2024-04-25T09:54:33.431566+0000","last_peered":"2024-04-25T09:54:33.431566+0000","last_clean":"2024-04-25T09:54:33.431566+0000","last_became_active":"2024-04-25T09:54:28.233532+0000","last_became_peered":"2024-04-25T09:54:28.233532+0000","last_unstale":"2024-04-25T09:54:33.431566+0000","last_undegraded":"2024-04-25T09:54:33.431566+0000","last_fullsized":"2024-04-25T09:54:33.431566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:23.525779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239898+0000","last_change":"2024-04-25T09:54:28.220983+0000","last_active":"2024-04-25T09:54:33.239898+0000","last_peered":"2024-04-25T09:54:33.239898+0000","last_clean":"2024-04-25T09:54:33.239898+0000","last_became_active":"2024-04-25T09:54:28.220569+0000","last_became_peered":"2024-04-25T09:54:28.220569+0000","last_unstale":"2024-04-25T09:54:33.239898+0000","last_undegraded":"2024-04-25T09:54:33.239898+0000","last_fullsized":"2024-04-25T09:54:33.239898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:15.832642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430742+0000","last_change":"2024-04-25T09:54:28.234837+0000","last_active":"2024-04-25T09:54:33.430742+0000","last_peered":"2024-04-25T09:54:33.430742+0000","last_clean":"2024-04-25T09:54:33.430742+0000","last_became_active":"2024-04-25T09:54:28.234316+0000","last_became_peered":"2024-04-25T09:54:28.234316+0000","last_unstale":"2024-04-25T09:54:33.430742+0000","last_undegraded":"2024-04-25T09:54:33.430742+0000","last_fullsized":"2024-04-25T09:54:33.430742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:23.525779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239213+0000","last_change":"2024-04-25T09:54:28.222528+0000","last_active":"2024-04-25T09:54:33.239213+0000","last_peered":"2024-04-25T09:54:33.239213+0000","last_clean":"2024-04-25T09:54:33.239213+0000","last_became_active":"2024-04-25T09:54:28.222211+0000","last_became_peered":"2024-04-25T09:54:28.222211+0000","last_unstale":"2024-04-25T09:54:33.239213+0000","last_undegraded":"2024-04-25T09:54:33.239213+0000","last_fullsized":"2024-04-25T09:54:33.239213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:29.799078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431509+0000","last_change":"2024-04-25T09:54:28.233715+0000","last_active":"2024-04-25T09:54:33.431509+0000","last_peered":"2024-04-25T09:54:33.431509+0000","last_clean":"2024-04-25T09:54:33.431509+0000","last_became_active":"2024-04-25T09:54:28.233426+0000","last_became_peered":"2024-04-25T09:54:28.233426+0000","last_unstale":"2024-04-25T09:54:33.431509+0000","last_undegraded":"2024-04-25T09:54:33.431509+0000","last_fullsized":"2024-04-25T09:54:33.431509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:08:42.765805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432061+0000","last_change":"2024-04-25T09:54:28.238380+0000","last_active":"2024-04-25T09:54:33.432061+0000","last_peered":"2024-04-25T09:54:33.432061+0000","last_clean":"2024-04-25T09:54:33.432061+0000","last_became_active":"2024-04-25T09:54:28.237240+0000","last_became_peered":"2024-04-25T09:54:28.237240+0000","last_unstale":"2024-04-25T09:54:33.432061+0000","last_undegraded":"2024-04-25T09:54:33.432061+0000","last_fullsized":"2024-04-25T09:54:33.432061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:35.167250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431164+0000","last_change":"2024-04-25T09:54:28.224401+0000","last_active":"2024-04-25T09:54:33.431164+0000","last_peered":"2024-04-25T09:54:33.431164+0000","last_clean":"2024-04-25T09:54:33.431164+0000","last_became_active":"2024-04-25T09:54:28.224093+0000","last_became_peered":"2024-04-25T09:54:28.224093+0000","last_unstale":"2024-04-25T09:54:33.431164+0000","last_undegraded":"2024-04-25T09:54:33.431164+0000","last_fullsized":"2024-04-25T09:54:33.431164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:47.076023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427994+0000","last_change":"2024-04-25T09:54:28.225887+0000","last_active":"2024-04-25T09:54:33.427994+0000","last_peered":"2024-04-25T09:54:33.427994+0000","last_clean":"2024-04-25T09:54:33.427994+0000","last_became_active":"2024-04-25T09:54:28.225650+0000","last_became_peered":"2024-04-25T09:54:28.225650+0000","last_unstale":"2024-04-25T09:54:33.427994+0000","last_undegraded":"2024-04-25T09:54:33.427994+0000","last_fullsized":"2024-04-25T09:54:33.427994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:51.684928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430756+0000","last_change":"2024-04-25T09:54:28.229389+0000","last_active":"2024-04-25T09:54:33.430756+0000","last_peered":"2024-04-25T09:54:33.430756+0000","last_clean":"2024-04-25T09:54:33.430756+0000","last_became_active":"2024-04-25T09:54:28.229001+0000","last_became_peered":"2024-04-25T09:54:28.229001+0000","last_unstale":"2024-04-25T09:54:33.430756+0000","last_undegraded":"2024-04-25T09:54:33.430756+0000","last_fullsized":"2024-04-25T09:54:33.430756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:05.431124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432079+0000","last_change":"2024-04-25T09:54:28.232625+0000","last_active":"2024-04-25T09:54:33.432079+0000","last_peered":"2024-04-25T09:54:33.432079+0000","last_clean":"2024-04-25T09:54:33.432079+0000","last_became_active":"2024-04-25T09:54:28.232336+0000","last_became_peered":"2024-04-25T09:54:28.232336+0000","last_unstale":"2024-04-25T09:54:33.432079+0000","last_undegraded":"2024-04-25T09:54:33.432079+0000","last_fullsized":"2024-04-25T09:54:33.432079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:00:25.749559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430564+0000","last_change":"2024-04-25T09:54:28.234614+0000","last_active":"2024-04-25T09:54:33.430564+0000","last_peered":"2024-04-25T09:54:33.430564+0000","last_clean":"2024-04-25T09:54:33.430564+0000","last_became_active":"2024-04-25T09:54:28.229921+0000","last_became_peered":"2024-04-25T09:54:28.229921+0000","last_unstale":"2024-04-25T09:54:33.430564+0000","last_undegraded":"2024-04-25T09:54:33.430564+0000","last_fullsized":"2024-04-25T09:54:33.430564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:08.719227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430653+0000","last_change":"2024-04-25T09:54:28.222801+0000","last_active":"2024-04-25T09:54:33.430653+0000","last_peered":"2024-04-25T09:54:33.430653+0000","last_clean":"2024-04-25T09:54:33.430653+0000","last_became_active":"2024-04-25T09:54:28.222496+0000","last_became_peered":"2024-04-25T09:54:28.222496+0000","last_unstale":"2024-04-25T09:54:33.430653+0000","last_undegraded":"2024-04-25T09:54:33.430653+0000","last_fullsized":"2024-04-25T09:54:33.430653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:35.167250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431763+0000","last_change":"2024-04-25T09:54:28.219741+0000","last_active":"2024-04-25T09:54:33.431763+0000","last_peered":"2024-04-25T09:54:33.431763+0000","last_clean":"2024-04-25T09:54:33.431763+0000","last_became_active":"2024-04-25T09:54:28.218538+0000","last_became_peered":"2024-04-25T09:54:28.218538+0000","last_unstale":"2024-04-25T09:54:33.431763+0000","last_undegraded":"2024-04-25T09:54:33.431763+0000","last_fullsized":"2024-04-25T09:54:33.431763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:27.399815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239440+0000","last_change":"2024-04-25T09:54:28.225395+0000","last_active":"2024-04-25T09:54:33.239440+0000","last_peered":"2024-04-25T09:54:33.239440+0000","last_clean":"2024-04-25T09:54:33.239440+0000","last_became_active":"2024-04-25T09:54:28.225087+0000","last_became_peered":"2024-04-25T09:54:28.225087+0000","last_unstale":"2024-04-25T09:54:33.239440+0000","last_undegraded":"2024-04-25T09:54:33.239440+0000","last_fullsized":"2024-04-25T09:54:33.239440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:08.719227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249339+0000","last_change":"2024-04-25T09:54:28.230175+0000","last_active":"2024-04-25T09:54:33.249339+0000","last_peered":"2024-04-25T09:54:33.249339+0000","last_clean":"2024-04-25T09:54:33.249339+0000","last_became_active":"2024-04-25T09:54:28.229811+0000","last_became_peered":"2024-04-25T09:54:28.229811+0000","last_unstale":"2024-04-25T09:54:33.249339+0000","last_undegraded":"2024-04-25T09:54:33.249339+0000","last_fullsized":"2024-04-25T09:54:33.249339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:40.803011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431341+0000","last_change":"2024-04-25T09:54:28.236127+0000","last_active":"2024-04-25T09:54:33.431341+0000","last_peered":"2024-04-25T09:54:33.431341+0000","last_clean":"2024-04-25T09:54:33.431341+0000","last_became_active":"2024-04-25T09:54:28.235849+0000","last_became_peered":"2024-04-25T09:54:28.235849+0000","last_unstale":"2024-04-25T09:54:33.431341+0000","last_undegraded":"2024-04-25T09:54:33.431341+0000","last_fullsized":"2024-04-25T09:54:33.431341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:33.543144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431499+0000","last_change":"2024-04-25T09:54:28.233050+0000","last_active":"2024-04-25T09:54:33.431499+0000","last_peered":"2024-04-25T09:54:33.431499+0000","last_clean":"2024-04-25T09:54:33.431499+0000","last_became_active":"2024-04-25T09:54:28.232758+0000","last_became_peered":"2024-04-25T09:54:28.232758+0000","last_unstale":"2024-04-25T09:54:33.431499+0000","last_undegraded":"2024-04-25T09:54:33.431499+0000","last_fullsized":"2024-04-25T09:54:33.431499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:08.719227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.428033+0000","last_change":"2024-04-25T09:54:28.237315+0000","last_active":"2024-04-25T09:54:33.428033+0000","last_peered":"2024-04-25T09:54:33.428033+0000","last_clean":"2024-04-25T09:54:33.428033+0000","last_became_active":"2024-04-25T09:54:28.235994+0000","last_became_peered":"2024-04-25T09:54:28.235994+0000","last_unstale":"2024-04-25T09:54:33.428033+0000","last_undegraded":"2024-04-25T09:54:33.428033+0000","last_fullsized":"2024-04-25T09:54:33.428033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:26.253699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.238952+0000","last_change":"2024-04-25T09:54:28.239527+0000","last_active":"2024-04-25T09:54:33.238952+0000","last_peered":"2024-04-25T09:54:33.238952+0000","last_clean":"2024-04-25T09:54:33.238952+0000","last_became_active":"2024-04-25T09:54:28.239231+0000","last_became_peered":"2024-04-25T09:54:28.239231+0000","last_unstale":"2024-04-25T09:54:33.238952+0000","last_undegraded":"2024-04-25T09:54:33.238952+0000","last_fullsized":"2024-04-25T09:54:33.238952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:35.167250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427536+0000","last_change":"2024-04-25T09:54:28.226800+0000","last_active":"2024-04-25T09:54:33.427536+0000","last_peered":"2024-04-25T09:54:33.427536+0000","last_clean":"2024-04-25T09:54:33.427536+0000","last_became_active":"2024-04-25T09:54:28.226516+0000","last_became_peered":"2024-04-25T09:54:28.226516+0000","last_unstale":"2024-04-25T09:54:33.427536+0000","last_undegraded":"2024-04-25T09:54:33.427536+0000","last_fullsized":"2024-04-25T09:54:33.427536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:50.006460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431400+0000","last_change":"2024-04-25T09:54:28.233084+0000","last_active":"2024-04-25T09:54:33.431400+0000","last_peered":"2024-04-25T09:54:33.431400+0000","last_clean":"2024-04-25T09:54:33.431400+0000","last_became_active":"2024-04-25T09:54:28.232546+0000","last_became_peered":"2024-04-25T09:54:28.232546+0000","last_unstale":"2024-04-25T09:54:33.431400+0000","last_undegraded":"2024-04-25T09:54:33.431400+0000","last_fullsized":"2024-04-25T09:54:33.431400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:50.006460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427429+0000","last_change":"2024-04-25T09:54:28.231761+0000","last_active":"2024-04-25T09:54:33.427429+0000","last_peered":"2024-04-25T09:54:33.427429+0000","last_clean":"2024-04-25T09:54:33.427429+0000","last_became_active":"2024-04-25T09:54:28.231159+0000","last_became_peered":"2024-04-25T09:54:28.231159+0000","last_unstale":"2024-04-25T09:54:33.427429+0000","last_undegraded":"2024-04-25T09:54:33.427429+0000","last_fullsized":"2024-04-25T09:54:33.427429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:08:42.765805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431892+0000","last_change":"2024-04-25T09:54:28.233126+0000","last_active":"2024-04-25T09:54:33.431892+0000","last_peered":"2024-04-25T09:54:33.431892+0000","last_clean":"2024-04-25T09:54:33.431892+0000","last_became_active":"2024-04-25T09:54:28.231248+0000","last_became_peered":"2024-04-25T09:54:28.231248+0000","last_unstale":"2024-04-25T09:54:33.431892+0000","last_undegraded":"2024-04-25T09:54:33.431892+0000","last_fullsized":"2024-04-25T09:54:33.431892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:15.832642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431295+0000","last_change":"2024-04-25T09:54:28.219491+0000","last_active":"2024-04-25T09:54:33.431295+0000","last_peered":"2024-04-25T09:54:33.431295+0000","last_clean":"2024-04-25T09:54:33.431295+0000","last_became_active":"2024-04-25T09:54:28.219177+0000","last_became_peered":"2024-04-25T09:54:28.219177+0000","last_unstale":"2024-04-25T09:54:33.431295+0000","last_undegraded":"2024-04-25T09:54:33.431295+0000","last_fullsized":"2024-04-25T09:54:33.431295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:29.799078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431885+0000","last_change":"2024-04-25T09:54:28.212159+0000","last_active":"2024-04-25T09:54:33.431885+0000","last_peered":"2024-04-25T09:54:33.431885+0000","last_clean":"2024-04-25T09:54:33.431885+0000","last_became_active":"2024-04-25T09:54:28.211850+0000","last_became_peered":"2024-04-25T09:54:28.211850+0000","last_unstale":"2024-04-25T09:54:33.431885+0000","last_undegraded":"2024-04-25T09:54:33.431885+0000","last_fullsized":"2024-04-25T09:54:33.431885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:08.719227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427873+0000","last_change":"2024-04-25T09:54:28.232766+0000","last_active":"2024-04-25T09:54:33.427873+0000","last_peered":"2024-04-25T09:54:33.427873+0000","last_clean":"2024-04-25T09:54:33.427873+0000","last_became_active":"2024-04-25T09:54:28.232333+0000","last_became_peered":"2024-04-25T09:54:28.232333+0000","last_unstale":"2024-04-25T09:54:33.427873+0000","last_undegraded":"2024-04-25T09:54:33.427873+0000","last_fullsized":"2024-04-25T09:54:33.427873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:00:25.749559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":860160,"data_stored":694757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":107649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":103897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":103933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":107649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":103807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":270336,"data_stored":103967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":868352,"data_stored":694813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:54:49.710 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:54:49.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.838+0000 7f3c1ed89640 1 Processor -- start 2024-04-25T09:54:49.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.838+0000 7f3c1ed89640 1 -- start start 2024-04-25T09:54:49.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.839+0000 7f3c1ed89640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3c1815dd00 0x7f3c180b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:49.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.839+0000 7f3c1ed89640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c180b6a40 0x7f3c180b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:49.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.839+0000 7f3c1ed89640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c1806cd00 con 0x7f3c1806bfb0 2024-04-25T09:54:49.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.839+0000 7f3c1ed89640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c1815e0e0 con 0x7f3c1815dd00 2024-04-25T09:54:49.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.839+0000 7f3c1ed89640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1806cfe0 con 0x7f3c180b6a40 2024-04-25T09:54:49.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.839+0000 7f3c1d326640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3c1806bfb0 0x7f3c1806c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42018/0 (socket says 172.21.15.7:42018) 2024-04-25T09:54:49.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.839+0000 7f3c1d326640 1 -- 172.21.15.7:0/2893187832 learned_addr learned my addr 172.21.15.7:0/2893187832 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:49.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.839+0000 7f3c1cb25640 1 --2- 172.21.15.7:0/2893187832 >> v2:172.21.15.55:3300/0 conn(0x7f3c1815dd00 0x7f3c180b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:49.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.839+0000 7f3c17fff640 1 --2- 172.21.15.7:0/2893187832 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c180b6a40 0x7f3c180b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:49.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.839+0000 7f3c177fe640 1 -- 172.21.15.7:0/2893187832 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1068439091 0 0) 0x7f3c1806cd00 con 0x7f3c1806bfb0 2024-04-25T09:54:49.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.839+0000 7f3c177fe640 1 -- 172.21.15.7:0/2893187832 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c08003520 con 0x7f3c1806bfb0 2024-04-25T09:54:49.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.839+0000 7f3c177fe640 1 -- 172.21.15.7:0/2893187832 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2682855693 0 0) 0x7f3c08003520 con 0x7f3c1806bfb0 2024-04-25T09:54:49.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.839+0000 7f3c177fe640 1 -- 172.21.15.7:0/2893187832 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c180b6a40 msgr2=0x7f3c180b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:49.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.839+0000 7f3c177fe640 1 --2- 172.21.15.7:0/2893187832 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c180b6a40 0x7f3c180b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.839+0000 7f3c177fe640 1 -- 172.21.15.7:0/2893187832 >> v2:172.21.15.55:3300/0 conn(0x7f3c1815dd00 msgr2=0x7f3c180b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:49.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.839+0000 7f3c177fe640 1 --2- 172.21.15.7:0/2893187832 >> v2:172.21.15.55:3300/0 conn(0x7f3c1815dd00 0x7f3c180b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.839+0000 7f3c177fe640 1 -- 172.21.15.7:0/2893187832 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c180d1ca0 con 0x7f3c1806bfb0 2024-04-25T09:54:49.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.839+0000 7f3c177fe640 1 -- 172.21.15.7:0/2893187832 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f3c100019f0 con 0x7f3c1806bfb0 2024-04-25T09:54:49.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.839+0000 7f3c177fe640 1 -- 172.21.15.7:0/2893187832 >> v1:172.21.15.7:6789/0 conn(0x7f3c1806bfb0 legacy=0x7f3c1806c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:49.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.839+0000 7f3c177fe640 1 --2- 172.21.15.7:0/2893187832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c080039b0 0x7f3c08003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:49.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.839+0000 7f3c177fe640 1 --2- 172.21.15.7:0/2893187832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c08004800 0x7f3c08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:49.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.839+0000 7f3c177fe640 1 --2- 172.21.15.7:0/2893187832 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c180b6a40 0x7f3c080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:49.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.839+0000 7f3c177fe640 1 -- 172.21.15.7:0/2893187832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1815e0e0 con 0x7f3c080039b0 2024-04-25T09:54:49.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.839+0000 7f3c177fe640 1 -- 172.21.15.7:0/2893187832 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1806cfe0 con 0x7f3c08004800 2024-04-25T09:54:49.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.839+0000 7f3c177fe640 1 -- 172.21.15.7:0/2893187832 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0800b9c0 con 0x7f3c180b6a40 2024-04-25T09:54:49.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.840+0000 7f3c1cb25640 1 --2- 172.21.15.7:0/2893187832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c080039b0 0x7f3c08003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:49.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.840+0000 7f3c1d326640 1 --2- 172.21.15.7:0/2893187832 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c180b6a40 0x7f3c080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:49.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.840+0000 7f3c17fff640 1 --2- 172.21.15.7:0/2893187832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c08004800 0x7f3c08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:49.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.840+0000 7f3c1cb25640 1 -- 172.21.15.7:0/2893187832 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c180b6a40 msgr2=0x7f3c080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:49.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.840+0000 7f3c1cb25640 1 --2- 172.21.15.7:0/2893187832 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c180b6a40 0x7f3c080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.840+0000 7f3c1cb25640 1 -- 172.21.15.7:0/2893187832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c08004800 msgr2=0x7f3c08004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:49.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.840+0000 7f3c1cb25640 1 --2- 172.21.15.7:0/2893187832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c08004800 0x7f3c08004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.840+0000 7f3c1cb25640 1 -- 172.21.15.7:0/2893187832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c08003520 con 0x7f3c080039b0 2024-04-25T09:54:49.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.840+0000 7f3c1d326640 1 --2- 172.21.15.7:0/2893187832 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c180b6a40 0x7f3c080051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:49.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.840+0000 7f3c1cb25640 1 --2- 172.21.15.7:0/2893187832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c080039b0 0x7f3c08003dd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c009ac0 tx=0x7f3c08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af16a11b310f107 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:49.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.841+0000 7f3c177fe640 1 -- 172.21.15.7:0/2893187832 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c036070 con 0x7f3c080039b0 2024-04-25T09:54:49.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.841+0000 7f3c177fe640 1 -- 172.21.15.7:0/2893187832 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0c031400 con 0x7f3c080039b0 2024-04-25T09:54:49.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.841+0000 7f3c177fe640 1 -- 172.21.15.7:0/2893187832 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c009690 con 0x7f3c080039b0 2024-04-25T09:54:49.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.841+0000 7f3c1ed89640 1 -- 172.21.15.7:0/2893187832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c080039b0 msgr2=0x7f3c08003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:49.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.841+0000 7f3c1ed89640 1 --2- 172.21.15.7:0/2893187832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c080039b0 0x7f3c08003dd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c009ac0 tx=0x7f3c08005830 comp rx=0 tx=0).stop 2024-04-25T09:54:49.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.841+0000 7f3c1d326640 1 -- 172.21.15.7:0/2893187832 reap_dead start 2024-04-25T09:54:49.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.841+0000 7f3c1ed89640 1 -- 172.21.15.7:0/2893187832 shutdown_connections 2024-04-25T09:54:49.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.841+0000 7f3c1ed89640 1 -- 172.21.15.7:0/2893187832 >> 172.21.15.7:0/2893187832 conn(0x7f3c180d07b0 msgr2=0x7f3c180d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:49.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.841+0000 7f3c1ed89640 1 -- 172.21.15.7:0/2893187832 shutdown_connections 2024-04-25T09:54:49.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.841+0000 7f3c1ed89640 1 -- 172.21.15.7:0/2893187832 wait complete. 2024-04-25T09:54:49.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.842+0000 7f3c1ed89640 1 Processor -- start 2024-04-25T09:54:49.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.842+0000 7f3c1ed89640 1 -- start start 2024-04-25T09:54:49.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.843+0000 7f3c1ed89640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c080039b0 0x7f3c18154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:49.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.843+0000 7f3c1ed89640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c18153e80 0x7f3c181f3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:49.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.843+0000 7f3c1ed89640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c181562b0 0x7f3c18156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:49.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.843+0000 7f3c1ed89640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c180b5c90 con 0x7f3c18153e80 2024-04-25T09:54:49.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.843+0000 7f3c1ed89640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c180d2260 con 0x7f3c181562b0 2024-04-25T09:54:49.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.843+0000 7f3c1ed89640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c180b5e10 con 0x7f3c080039b0 2024-04-25T09:54:49.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.843+0000 7f3c17fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c18153e80 0x7f3c181f3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:49.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.843+0000 7f3c17fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c18153e80 0x7f3c181f3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52358/0 (socket says 172.21.15.7:52358) 2024-04-25T09:54:49.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.843+0000 7f3c17fff640 1 -- 172.21.15.7:0/3607498534 learned_addr learned my addr 172.21.15.7:0/3607498534 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:49.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.844+0000 7f3c1cb25640 1 --2- 172.21.15.7:0/3607498534 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c080039b0 0x7f3c18154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:49.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.844+0000 7f3c1d326640 1 --2- 172.21.15.7:0/3607498534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c181562b0 0x7f3c18156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:49.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.844+0000 7f3c17fff640 1 -- 172.21.15.7:0/3607498534 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c080039b0 msgr2=0x7f3c18154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:49.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.844+0000 7f3c17fff640 1 --2- 172.21.15.7:0/3607498534 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c080039b0 0x7f3c18154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.844+0000 7f3c17fff640 1 -- 172.21.15.7:0/3607498534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c181562b0 msgr2=0x7f3c18156730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:49.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.844+0000 7f3c17fff640 1 --2- 172.21.15.7:0/3607498534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c181562b0 0x7f3c18156730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:49.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.844+0000 7f3c17fff640 1 -- 172.21.15.7:0/3607498534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c180cca20 con 0x7f3c18153e80 2024-04-25T09:54:49.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.844+0000 7f3c1d326640 1 --2- 172.21.15.7:0/3607498534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c181562b0 0x7f3c18156730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:49.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.844+0000 7f3c17fff640 1 --2- 172.21.15.7:0/3607498534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c18153e80 0x7f3c181f3860 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3c04011600 tx=0x7f3c04011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:49.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.844+0000 7f3c157fa640 1 -- 172.21.15.7:0/3607498534 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0400f920 con 0x7f3c18153e80 2024-04-25T09:54:49.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.844+0000 7f3c157fa640 1 -- 172.21.15.7:0/3607498534 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0400fac0 con 0x7f3c18153e80 2024-04-25T09:54:49.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.844+0000 7f3c157fa640 1 -- 172.21.15.7:0/3607498534 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0400fe70 con 0x7f3c18153e80 2024-04-25T09:54:49.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.844+0000 7f3c1ed89640 1 -- 172.21.15.7:0/3607498534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c180ccd00 con 0x7f3c18153e80 2024-04-25T09:54:49.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.844+0000 7f3c1ed89640 1 -- 172.21.15.7:0/3607498534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c180cd2c0 con 0x7f3c18153e80 2024-04-25T09:54:49.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.845+0000 7f3c1ed89640 1 -- 172.21.15.7:0/3607498534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c18068fd0 con 0x7f3c18153e80 2024-04-25T09:54:49.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.846+0000 7f3c157fa640 1 -- 172.21.15.7:0/3607498534 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3c04015460 con 0x7f3c18153e80 2024-04-25T09:54:49.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.846+0000 7f3c157fa640 1 --2- 172.21.15.7:0/3607498534 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3bfc06b4d0 0x7f3bfc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:49.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.846+0000 7f3c157fa640 1 -- 172.21.15.7:0/3607498534 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f3c0408ae70 con 0x7f3c18153e80 2024-04-25T09:54:49.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.846+0000 7f3c1cb25640 1 --2- 172.21.15.7:0/3607498534 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3bfc06b4d0 0x7f3bfc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:49.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.847+0000 7f3c1cb25640 1 --2- 172.21.15.7:0/3607498534 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3bfc06b4d0 0x7f3bfc06d990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c033000 tx=0x7f3c0c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:49.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:49.850+0000 7f3c157fa640 1 -- 172.21.15.7:0/3607498534 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3c04019030 con 0x7f3c18153e80 2024-04-25T09:54:50.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.031+0000 7f3c1ed89640 1 -- 172.21.15.7:0/3607498534 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3c180680c0 con 0x7f3bfc06b4d0 2024-04-25T09:54:50.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.039+0000 7f3c157fa640 1 -- 172.21.15.7:0/3607498534 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332534 (secure 0 0 0) 0x7f3c0c004040 con 0x7f3bfc06b4d0 2024-04-25T09:54:50.045 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:50.047 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T09:54:50.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.042+0000 7f3c1ed89640 1 -- 172.21.15.7:0/3607498534 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3bfc06b4d0 msgr2=0x7f3bfc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:50.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.042+0000 7f3c1ed89640 1 --2- 172.21.15.7:0/3607498534 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3bfc06b4d0 0x7f3bfc06d990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c033000 tx=0x7f3c0c008030 comp rx=0 tx=0).stop 2024-04-25T09:54:50.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.042+0000 7f3c1ed89640 1 -- 172.21.15.7:0/3607498534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c18153e80 msgr2=0x7f3c181f3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:50.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.042+0000 7f3c1ed89640 1 --2- 172.21.15.7:0/3607498534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c18153e80 0x7f3c181f3860 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3c04011600 tx=0x7f3c04011ac0 comp rx=0 tx=0).stop 2024-04-25T09:54:50.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.042+0000 7f3c1ed89640 1 -- 172.21.15.7:0/3607498534 shutdown_connections 2024-04-25T09:54:50.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.042+0000 7f3c1ed89640 1 --2- 172.21.15.7:0/3607498534 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3bfc06b4d0 0x7f3bfc06d990 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:50.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.042+0000 7f3c1ed89640 1 --2- 172.21.15.7:0/3607498534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c181562b0 0x7f3c18156730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:50.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.042+0000 7f3c1ed89640 1 --2- 172.21.15.7:0/3607498534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c18153e80 0x7f3c181f3860 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:50.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.042+0000 7f3c1ed89640 1 --2- 172.21.15.7:0/3607498534 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c080039b0 0x7f3c18154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:50.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.042+0000 7f3c1ed89640 1 -- 172.21.15.7:0/3607498534 >> 172.21.15.7:0/3607498534 conn(0x7f3c180d07b0 msgr2=0x7f3c180d2680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:50.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.042+0000 7f3c1ed89640 1 -- 172.21.15.7:0/3607498534 shutdown_connections 2024-04-25T09:54:50.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.042+0000 7f3c1ed89640 1 -- 172.21.15.7:0/3607498534 wait complete. 2024-04-25T09:54:50.056 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-04-25T09:54:49.858236+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236096,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738624,"statfs":{"total":773094113280,"available":772852350976,"internally_reserved":0,"allocated":3350528,"data_stored":2020472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002933"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431103+0000","last_change":"2024-04-25T09:54:27.205212+0000","last_active":"2024-04-25T09:54:33.431103+0000","last_peered":"2024-04-25T09:54:33.431103+0000","last_clean":"2024-04-25T09:54:33.431103+0000","last_became_active":"2024-04-25T09:54:27.204920+0000","last_became_peered":"2024-04-25T09:54:27.204920+0000","last_unstale":"2024-04-25T09:54:33.431103+0000","last_undegraded":"2024-04-25T09:54:33.431103+0000","last_fullsized":"2024-04-25T09:54:33.431103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:44.480619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239768+0000","last_change":"2024-04-25T09:54:28.228470+0000","last_active":"2024-04-25T09:54:33.239768+0000","last_peered":"2024-04-25T09:54:33.239768+0000","last_clean":"2024-04-25T09:54:33.239768+0000","last_became_active":"2024-04-25T09:54:28.228117+0000","last_became_peered":"2024-04-25T09:54:28.228117+0000","last_unstale":"2024-04-25T09:54:33.239768+0000","last_undegraded":"2024-04-25T09:54:33.239768+0000","last_fullsized":"2024-04-25T09:54:33.239768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:23.525779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239020+0000","last_change":"2024-04-25T09:54:32.301225+0000","last_active":"2024-04-25T09:54:33.239020+0000","last_peered":"2024-04-25T09:54:33.239020+0000","last_clean":"2024-04-25T09:54:33.239020+0000","last_became_active":"2024-04-25T09:54:32.300826+0000","last_became_peered":"2024-04-25T09:54:32.300826+0000","last_unstale":"2024-04-25T09:54:33.239020+0000","last_undegraded":"2024-04-25T09:54:33.239020+0000","last_fullsized":"2024-04-25T09:54:33.239020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:06.418222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239954+0000","last_change":"2024-04-25T09:54:27.209621+0000","last_active":"2024-04-25T09:54:33.239954+0000","last_peered":"2024-04-25T09:54:33.239954+0000","last_clean":"2024-04-25T09:54:33.239954+0000","last_became_active":"2024-04-25T09:54:27.209078+0000","last_became_peered":"2024-04-25T09:54:27.209078+0000","last_unstale":"2024-04-25T09:54:33.239954+0000","last_undegraded":"2024-04-25T09:54:33.239954+0000","last_fullsized":"2024-04-25T09:54:33.239954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:02.804762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430762+0000","last_change":"2024-04-25T09:54:28.230594+0000","last_active":"2024-04-25T09:54:33.430762+0000","last_peered":"2024-04-25T09:54:33.430762+0000","last_clean":"2024-04-25T09:54:33.430762+0000","last_became_active":"2024-04-25T09:54:28.230265+0000","last_became_peered":"2024-04-25T09:54:28.230265+0000","last_unstale":"2024-04-25T09:54:33.430762+0000","last_undegraded":"2024-04-25T09:54:33.430762+0000","last_fullsized":"2024-04-25T09:54:33.430762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:33.543144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.248999+0000","last_change":"2024-04-25T09:54:32.265543+0000","last_active":"2024-04-25T09:54:33.248999+0000","last_peered":"2024-04-25T09:54:33.248999+0000","last_clean":"2024-04-25T09:54:33.248999+0000","last_became_active":"2024-04-25T09:54:32.264147+0000","last_became_peered":"2024-04-25T09:54:32.264147+0000","last_unstale":"2024-04-25T09:54:33.248999+0000","last_undegraded":"2024-04-25T09:54:33.248999+0000","last_fullsized":"2024-04-25T09:54:33.248999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:19.875090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427980+0000","last_change":"2024-04-25T09:54:27.215105+0000","last_active":"2024-04-25T09:54:33.427980+0000","last_peered":"2024-04-25T09:54:33.427980+0000","last_clean":"2024-04-25T09:54:33.427980+0000","last_became_active":"2024-04-25T09:54:27.214820+0000","last_became_peered":"2024-04-25T09:54:27.214820+0000","last_unstale":"2024-04-25T09:54:33.427980+0000","last_undegraded":"2024-04-25T09:54:33.427980+0000","last_fullsized":"2024-04-25T09:54:33.427980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:39.794974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432058+0000","last_change":"2024-04-25T09:54:28.232586+0000","last_active":"2024-04-25T09:54:33.432058+0000","last_peered":"2024-04-25T09:54:33.432058+0000","last_clean":"2024-04-25T09:54:33.432058+0000","last_became_active":"2024-04-25T09:54:28.231544+0000","last_became_peered":"2024-04-25T09:54:28.231544+0000","last_unstale":"2024-04-25T09:54:33.432058+0000","last_undegraded":"2024-04-25T09:54:33.432058+0000","last_fullsized":"2024-04-25T09:54:33.432058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:52.698521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249218+0000","last_change":"2024-04-25T09:54:32.265350+0000","last_active":"2024-04-25T09:54:33.249218+0000","last_peered":"2024-04-25T09:54:33.249218+0000","last_clean":"2024-04-25T09:54:33.249218+0000","last_became_active":"2024-04-25T09:54:32.264913+0000","last_became_peered":"2024-04-25T09:54:32.264913+0000","last_unstale":"2024-04-25T09:54:33.249218+0000","last_undegraded":"2024-04-25T09:54:33.249218+0000","last_fullsized":"2024-04-25T09:54:33.249218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:08:46.808252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427640+0000","last_change":"2024-04-25T09:54:27.212359+0000","last_active":"2024-04-25T09:54:33.427640+0000","last_peered":"2024-04-25T09:54:33.427640+0000","last_clean":"2024-04-25T09:54:33.427640+0000","last_became_active":"2024-04-25T09:54:27.212058+0000","last_became_peered":"2024-04-25T09:54:27.212058+0000","last_unstale":"2024-04-25T09:54:33.427640+0000","last_undegraded":"2024-04-25T09:54:33.427640+0000","last_fullsized":"2024-04-25T09:54:33.427640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:04.425728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432088+0000","last_change":"2024-04-25T09:54:28.230562+0000","last_active":"2024-04-25T09:54:33.432088+0000","last_peered":"2024-04-25T09:54:33.432088+0000","last_clean":"2024-04-25T09:54:33.432088+0000","last_became_active":"2024-04-25T09:54:28.230276+0000","last_became_peered":"2024-04-25T09:54:28.230276+0000","last_unstale":"2024-04-25T09:54:33.432088+0000","last_undegraded":"2024-04-25T09:54:33.432088+0000","last_fullsized":"2024-04-25T09:54:33.432088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:36.448046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.248804+0000","last_change":"2024-04-25T09:54:32.256284+0000","last_active":"2024-04-25T09:54:33.248804+0000","last_peered":"2024-04-25T09:54:33.248804+0000","last_clean":"2024-04-25T09:54:33.248804+0000","last_became_active":"2024-04-25T09:54:32.255895+0000","last_became_peered":"2024-04-25T09:54:32.255895+0000","last_unstale":"2024-04-25T09:54:33.248804+0000","last_undegraded":"2024-04-25T09:54:33.248804+0000","last_fullsized":"2024-04-25T09:54:33.248804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:54.048907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430965+0000","last_change":"2024-04-25T09:54:28.228430+0000","last_active":"2024-04-25T09:54:33.430965+0000","last_peered":"2024-04-25T09:54:33.430965+0000","last_clean":"2024-04-25T09:54:33.430965+0000","last_became_active":"2024-04-25T09:54:28.228142+0000","last_became_peered":"2024-04-25T09:54:28.228142+0000","last_unstale":"2024-04-25T09:54:33.430965+0000","last_undegraded":"2024-04-25T09:54:33.430965+0000","last_fullsized":"2024-04-25T09:54:33.430965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:35.167250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427810+0000","last_change":"2024-04-25T09:54:27.209265+0000","last_active":"2024-04-25T09:54:33.427810+0000","last_peered":"2024-04-25T09:54:33.427810+0000","last_clean":"2024-04-25T09:54:33.427810+0000","last_became_active":"2024-04-25T09:54:27.209017+0000","last_became_peered":"2024-04-25T09:54:27.209017+0000","last_unstale":"2024-04-25T09:54:33.427810+0000","last_undegraded":"2024-04-25T09:54:33.427810+0000","last_fullsized":"2024-04-25T09:54:33.427810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:53.735742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249574+0000","last_change":"2024-04-25T09:54:32.265153+0000","last_active":"2024-04-25T09:54:33.249574+0000","last_peered":"2024-04-25T09:54:33.249574+0000","last_clean":"2024-04-25T09:54:33.249574+0000","last_became_active":"2024-04-25T09:54:32.264252+0000","last_became_peered":"2024-04-25T09:54:32.264252+0000","last_unstale":"2024-04-25T09:54:33.249574+0000","last_undegraded":"2024-04-25T09:54:33.249574+0000","last_fullsized":"2024-04-25T09:54:33.249574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:08.992474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239443+0000","last_change":"2024-04-25T09:54:28.217914+0000","last_active":"2024-04-25T09:54:33.239443+0000","last_peered":"2024-04-25T09:54:33.239443+0000","last_clean":"2024-04-25T09:54:33.239443+0000","last_became_active":"2024-04-25T09:54:28.217591+0000","last_became_peered":"2024-04-25T09:54:28.217591+0000","last_unstale":"2024-04-25T09:54:33.239443+0000","last_undegraded":"2024-04-25T09:54:33.239443+0000","last_fullsized":"2024-04-25T09:54:33.239443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:50.006460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431887+0000","last_change":"2024-04-25T09:54:27.204310+0000","last_active":"2024-04-25T09:54:33.431887+0000","last_peered":"2024-04-25T09:54:33.431887+0000","last_clean":"2024-04-25T09:54:33.431887+0000","last_became_active":"2024-04-25T09:54:27.203973+0000","last_became_peered":"2024-04-25T09:54:27.203973+0000","last_unstale":"2024-04-25T09:54:33.431887+0000","last_undegraded":"2024-04-25T09:54:33.431887+0000","last_fullsized":"2024-04-25T09:54:33.431887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:25.329710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249452+0000","last_change":"2024-04-25T09:54:32.265896+0000","last_active":"2024-04-25T09:54:33.249452+0000","last_peered":"2024-04-25T09:54:33.249452+0000","last_clean":"2024-04-25T09:54:33.249452+0000","last_became_active":"2024-04-25T09:54:32.265185+0000","last_became_peered":"2024-04-25T09:54:32.265185+0000","last_unstale":"2024-04-25T09:54:33.249452+0000","last_undegraded":"2024-04-25T09:54:33.249452+0000","last_fullsized":"2024-04-25T09:54:33.249452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:10.694250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239224+0000","last_change":"2024-04-25T09:54:28.211914+0000","last_active":"2024-04-25T09:54:33.239224+0000","last_peered":"2024-04-25T09:54:33.239224+0000","last_clean":"2024-04-25T09:54:33.239224+0000","last_became_active":"2024-04-25T09:54:28.211506+0000","last_became_peered":"2024-04-25T09:54:28.211506+0000","last_unstale":"2024-04-25T09:54:33.239224+0000","last_undegraded":"2024-04-25T09:54:33.239224+0000","last_fullsized":"2024-04-25T09:54:33.239224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:47.076023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430746+0000","last_change":"2024-04-25T09:54:27.204816+0000","last_active":"2024-04-25T09:54:33.430746+0000","last_peered":"2024-04-25T09:54:33.430746+0000","last_clean":"2024-04-25T09:54:33.430746+0000","last_became_active":"2024-04-25T09:54:27.204539+0000","last_became_peered":"2024-04-25T09:54:27.204539+0000","last_unstale":"2024-04-25T09:54:33.430746+0000","last_undegraded":"2024-04-25T09:54:33.430746+0000","last_fullsized":"2024-04-25T09:54:33.430746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:04.425728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432270+0000","last_change":"2024-04-25T09:54:32.302487+0000","last_active":"2024-04-25T09:54:33.432270+0000","last_peered":"2024-04-25T09:54:33.432270+0000","last_clean":"2024-04-25T09:54:33.432270+0000","last_became_active":"2024-04-25T09:54:32.302085+0000","last_became_peered":"2024-04-25T09:54:32.302085+0000","last_unstale":"2024-04-25T09:54:33.432270+0000","last_undegraded":"2024-04-25T09:54:33.432270+0000","last_fullsized":"2024-04-25T09:54:33.432270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:00:29.792006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249025+0000","last_change":"2024-04-25T09:54:28.220488+0000","last_active":"2024-04-25T09:54:33.249025+0000","last_peered":"2024-04-25T09:54:33.249025+0000","last_clean":"2024-04-25T09:54:33.249025+0000","last_became_active":"2024-04-25T09:54:28.220151+0000","last_became_peered":"2024-04-25T09:54:28.220151+0000","last_unstale":"2024-04-25T09:54:33.249025+0000","last_undegraded":"2024-04-25T09:54:33.249025+0000","last_fullsized":"2024-04-25T09:54:33.249025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:35.664298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427200+0000","last_change":"2024-04-25T09:54:27.208900+0000","last_active":"2024-04-25T09:54:33.427200+0000","last_peered":"2024-04-25T09:54:33.427200+0000","last_clean":"2024-04-25T09:54:33.427200+0000","last_became_active":"2024-04-25T09:54:27.208616+0000","last_became_peered":"2024-04-25T09:54:27.208616+0000","last_unstale":"2024-04-25T09:54:33.427200+0000","last_undegraded":"2024-04-25T09:54:33.427200+0000","last_fullsized":"2024-04-25T09:54:33.427200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:25.329710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249752+0000","last_change":"2024-04-25T09:54:32.265564+0000","last_active":"2024-04-25T09:54:33.249752+0000","last_peered":"2024-04-25T09:54:33.249752+0000","last_clean":"2024-04-25T09:54:33.249752+0000","last_became_active":"2024-04-25T09:54:32.264127+0000","last_became_peered":"2024-04-25T09:54:32.264127+0000","last_unstale":"2024-04-25T09:54:33.249752+0000","last_undegraded":"2024-04-25T09:54:33.249752+0000","last_fullsized":"2024-04-25T09:54:33.249752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:40.490493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431796+0000","last_change":"2024-04-25T09:54:28.215357+0000","last_active":"2024-04-25T09:54:33.431796+0000","last_peered":"2024-04-25T09:54:33.431796+0000","last_clean":"2024-04-25T09:54:33.431796+0000","last_became_active":"2024-04-25T09:54:28.215024+0000","last_became_peered":"2024-04-25T09:54:28.215024+0000","last_unstale":"2024-04-25T09:54:33.431796+0000","last_undegraded":"2024-04-25T09:54:33.431796+0000","last_fullsized":"2024-04-25T09:54:33.431796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:04.526578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431920+0000","last_change":"2024-04-25T09:54:27.209041+0000","last_active":"2024-04-25T09:54:33.431920+0000","last_peered":"2024-04-25T09:54:33.431920+0000","last_clean":"2024-04-25T09:54:33.431920+0000","last_became_active":"2024-04-25T09:54:27.208815+0000","last_became_peered":"2024-04-25T09:54:27.208815+0000","last_unstale":"2024-04-25T09:54:33.431920+0000","last_undegraded":"2024-04-25T09:54:33.431920+0000","last_fullsized":"2024-04-25T09:54:33.431920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:04.425728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.248776+0000","last_change":"2024-04-25T09:54:32.302174+0000","last_active":"2024-04-25T09:54:33.248776+0000","last_peered":"2024-04-25T09:54:33.248776+0000","last_clean":"2024-04-25T09:54:33.248776+0000","last_became_active":"2024-04-25T09:54:32.301220+0000","last_became_peered":"2024-04-25T09:54:32.301220+0000","last_unstale":"2024-04-25T09:54:33.248776+0000","last_undegraded":"2024-04-25T09:54:33.248776+0000","last_fullsized":"2024-04-25T09:54:33.248776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:27.568226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.240028+0000","last_change":"2024-04-25T09:54:28.231766+0000","last_active":"2024-04-25T09:54:33.240028+0000","last_peered":"2024-04-25T09:54:33.240028+0000","last_clean":"2024-04-25T09:54:33.240028+0000","last_became_active":"2024-04-25T09:54:28.231150+0000","last_became_peered":"2024-04-25T09:54:28.231150+0000","last_unstale":"2024-04-25T09:54:33.240028+0000","last_undegraded":"2024-04-25T09:54:33.240028+0000","last_fullsized":"2024-04-25T09:54:33.240028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:52.698521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431983+0000","last_change":"2024-04-25T09:54:27.208806+0000","last_active":"2024-04-25T09:54:33.431983+0000","last_peered":"2024-04-25T09:54:33.431983+0000","last_clean":"2024-04-25T09:54:33.431983+0000","last_became_active":"2024-04-25T09:54:27.208458+0000","last_became_peered":"2024-04-25T09:54:27.208458+0000","last_unstale":"2024-04-25T09:54:33.431983+0000","last_undegraded":"2024-04-25T09:54:33.431983+0000","last_fullsized":"2024-04-25T09:54:33.431983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:04.423088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.238922+0000","last_change":"2024-04-25T09:54:32.297590+0000","last_active":"2024-04-25T09:54:33.238922+0000","last_peered":"2024-04-25T09:54:33.238922+0000","last_clean":"2024-04-25T09:54:33.238922+0000","last_became_active":"2024-04-25T09:54:32.297082+0000","last_became_peered":"2024-04-25T09:54:32.297082+0000","last_unstale":"2024-04-25T09:54:33.238922+0000","last_undegraded":"2024-04-25T09:54:33.238922+0000","last_fullsized":"2024-04-25T09:54:33.238922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:47.143113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431792+0000","last_change":"2024-04-25T09:54:28.219353+0000","last_active":"2024-04-25T09:54:33.431792+0000","last_peered":"2024-04-25T09:54:33.431792+0000","last_clean":"2024-04-25T09:54:33.431792+0000","last_became_active":"2024-04-25T09:54:28.219020+0000","last_became_peered":"2024-04-25T09:54:28.219020+0000","last_unstale":"2024-04-25T09:54:33.431792+0000","last_undegraded":"2024-04-25T09:54:33.431792+0000","last_fullsized":"2024-04-25T09:54:33.431792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:33.543144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.428072+0000","last_change":"2024-04-25T09:54:27.211097+0000","last_active":"2024-04-25T09:54:33.428072+0000","last_peered":"2024-04-25T09:54:33.428072+0000","last_clean":"2024-04-25T09:54:33.428072+0000","last_became_active":"2024-04-25T09:54:27.210827+0000","last_became_peered":"2024-04-25T09:54:27.210827+0000","last_unstale":"2024-04-25T09:54:33.428072+0000","last_undegraded":"2024-04-25T09:54:33.428072+0000","last_fullsized":"2024-04-25T09:54:33.428072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:04.423088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432136+0000","last_change":"2024-04-25T09:54:32.298586+0000","last_active":"2024-04-25T09:54:33.432136+0000","last_peered":"2024-04-25T09:54:33.432136+0000","last_clean":"2024-04-25T09:54:33.432136+0000","last_became_active":"2024-04-25T09:54:32.298232+0000","last_became_peered":"2024-04-25T09:54:32.298232+0000","last_unstale":"2024-04-25T09:54:33.432136+0000","last_undegraded":"2024-04-25T09:54:33.432136+0000","last_fullsized":"2024-04-25T09:54:33.432136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:00:29.792006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432216+0000","last_change":"2024-04-25T09:54:28.233937+0000","last_active":"2024-04-25T09:54:33.432216+0000","last_peered":"2024-04-25T09:54:33.432216+0000","last_clean":"2024-04-25T09:54:33.432216+0000","last_became_active":"2024-04-25T09:54:28.233380+0000","last_became_peered":"2024-04-25T09:54:28.233380+0000","last_unstale":"2024-04-25T09:54:33.432216+0000","last_undegraded":"2024-04-25T09:54:33.432216+0000","last_fullsized":"2024-04-25T09:54:33.432216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:26.253699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431881+0000","last_change":"2024-04-25T09:54:27.205411+0000","last_active":"2024-04-25T09:54:33.431881+0000","last_peered":"2024-04-25T09:54:33.431881+0000","last_clean":"2024-04-25T09:54:33.431881+0000","last_became_active":"2024-04-25T09:54:27.205101+0000","last_became_peered":"2024-04-25T09:54:27.205101+0000","last_unstale":"2024-04-25T09:54:33.431881+0000","last_undegraded":"2024-04-25T09:54:33.431881+0000","last_fullsized":"2024-04-25T09:54:33.431881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:34.656261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431521+0000","last_change":"2024-04-25T09:54:32.265789+0000","last_active":"2024-04-25T09:54:33.431521+0000","last_peered":"2024-04-25T09:54:33.431521+0000","last_clean":"2024-04-25T09:54:33.431521+0000","last_became_active":"2024-04-25T09:54:32.265413+0000","last_became_peered":"2024-04-25T09:54:32.265413+0000","last_unstale":"2024-04-25T09:54:33.431521+0000","last_undegraded":"2024-04-25T09:54:33.431521+0000","last_fullsized":"2024-04-25T09:54:33.431521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:40.490493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249457+0000","last_change":"2024-04-25T09:54:28.219660+0000","last_active":"2024-04-25T09:54:33.249457+0000","last_peered":"2024-04-25T09:54:33.249457+0000","last_clean":"2024-04-25T09:54:33.249457+0000","last_became_active":"2024-04-25T09:54:28.219368+0000","last_became_peered":"2024-04-25T09:54:28.219368+0000","last_unstale":"2024-04-25T09:54:33.249457+0000","last_undegraded":"2024-04-25T09:54:33.249457+0000","last_fullsized":"2024-04-25T09:54:33.249457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:54.743779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431901+0000","last_change":"2024-04-25T09:54:27.211603+0000","last_active":"2024-04-25T09:54:33.431901+0000","last_peered":"2024-04-25T09:54:33.431901+0000","last_clean":"2024-04-25T09:54:33.431901+0000","last_became_active":"2024-04-25T09:54:27.211196+0000","last_became_peered":"2024-04-25T09:54:27.211196+0000","last_unstale":"2024-04-25T09:54:33.431901+0000","last_undegraded":"2024-04-25T09:54:33.431901+0000","last_fullsized":"2024-04-25T09:54:33.431901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:04.425728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431739+0000","last_change":"2024-04-25T09:54:32.260167+0000","last_active":"2024-04-25T09:54:33.431739+0000","last_peered":"2024-04-25T09:54:33.431739+0000","last_clean":"2024-04-25T09:54:33.431739+0000","last_became_active":"2024-04-25T09:54:32.259801+0000","last_became_peered":"2024-04-25T09:54:32.259801+0000","last_unstale":"2024-04-25T09:54:33.431739+0000","last_undegraded":"2024-04-25T09:54:33.431739+0000","last_fullsized":"2024-04-25T09:54:33.431739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:30.296146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431154+0000","last_change":"2024-04-25T09:54:28.220347+0000","last_active":"2024-04-25T09:54:33.431154+0000","last_peered":"2024-04-25T09:54:33.431154+0000","last_clean":"2024-04-25T09:54:33.431154+0000","last_became_active":"2024-04-25T09:54:28.219921+0000","last_became_peered":"2024-04-25T09:54:28.219921+0000","last_unstale":"2024-04-25T09:54:33.431154+0000","last_undegraded":"2024-04-25T09:54:33.431154+0000","last_fullsized":"2024-04-25T09:54:33.431154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:04.526578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431058+0000","last_change":"2024-04-25T09:54:27.207799+0000","last_active":"2024-04-25T09:54:33.431058+0000","last_peered":"2024-04-25T09:54:33.431058+0000","last_clean":"2024-04-25T09:54:33.431058+0000","last_became_active":"2024-04-25T09:54:27.207502+0000","last_became_peered":"2024-04-25T09:54:27.207502+0000","last_unstale":"2024-04-25T09:54:33.431058+0000","last_undegraded":"2024-04-25T09:54:33.431058+0000","last_fullsized":"2024-04-25T09:54:33.431058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:02.804762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432415+0000","last_change":"2024-04-25T09:54:32.259101+0000","last_active":"2024-04-25T09:54:33.432415+0000","last_peered":"2024-04-25T09:54:33.432415+0000","last_clean":"2024-04-25T09:54:33.432415+0000","last_became_active":"2024-04-25T09:54:32.258688+0000","last_became_peered":"2024-04-25T09:54:32.258688+0000","last_unstale":"2024-04-25T09:54:33.432415+0000","last_undegraded":"2024-04-25T09:54:33.432415+0000","last_fullsized":"2024-04-25T09:54:33.432415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:14.029429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430481+0000","last_change":"2024-04-25T09:54:28.225496+0000","last_active":"2024-04-25T09:54:33.430481+0000","last_peered":"2024-04-25T09:54:33.430481+0000","last_clean":"2024-04-25T09:54:33.430481+0000","last_became_active":"2024-04-25T09:54:28.224696+0000","last_became_peered":"2024-04-25T09:54:28.224696+0000","last_unstale":"2024-04-25T09:54:33.430481+0000","last_undegraded":"2024-04-25T09:54:33.430481+0000","last_fullsized":"2024-04-25T09:54:33.430481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:04.396335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427226+0000","last_change":"2024-04-25T09:54:27.209821+0000","last_active":"2024-04-25T09:54:33.427226+0000","last_peered":"2024-04-25T09:54:33.427226+0000","last_clean":"2024-04-25T09:54:33.427226+0000","last_became_active":"2024-04-25T09:54:27.209548+0000","last_became_peered":"2024-04-25T09:54:27.209548+0000","last_unstale":"2024-04-25T09:54:33.427226+0000","last_undegraded":"2024-04-25T09:54:33.427226+0000","last_fullsized":"2024-04-25T09:54:33.427226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:34.656261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431635+0000","last_change":"2024-04-25T09:54:32.300518+0000","last_active":"2024-04-25T09:54:33.431635+0000","last_peered":"2024-04-25T09:54:33.431635+0000","last_clean":"2024-04-25T09:54:33.431635+0000","last_became_active":"2024-04-25T09:54:32.299847+0000","last_became_peered":"2024-04-25T09:54:32.299847+0000","last_unstale":"2024-04-25T09:54:33.431635+0000","last_undegraded":"2024-04-25T09:54:33.431635+0000","last_fullsized":"2024-04-25T09:54:33.431635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:30.296146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239165+0000","last_change":"2024-04-25T09:54:28.236433+0000","last_active":"2024-04-25T09:54:33.239165+0000","last_peered":"2024-04-25T09:54:33.239165+0000","last_clean":"2024-04-25T09:54:33.239165+0000","last_became_active":"2024-04-25T09:54:28.236130+0000","last_became_peered":"2024-04-25T09:54:28.236130+0000","last_unstale":"2024-04-25T09:54:33.239165+0000","last_undegraded":"2024-04-25T09:54:33.239165+0000","last_fullsized":"2024-04-25T09:54:33.239165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:33.543144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431705+0000","last_change":"2024-04-25T09:54:27.211760+0000","last_active":"2024-04-25T09:54:33.431705+0000","last_peered":"2024-04-25T09:54:33.431705+0000","last_clean":"2024-04-25T09:54:33.431705+0000","last_became_active":"2024-04-25T09:54:27.211452+0000","last_became_peered":"2024-04-25T09:54:27.211452+0000","last_unstale":"2024-04-25T09:54:33.431705+0000","last_undegraded":"2024-04-25T09:54:33.431705+0000","last_fullsized":"2024-04-25T09:54:33.431705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:02.804762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427371+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T09:54:33.427371+0000","last_peered":"2024-04-25T09:54:33.427371+0000","last_clean":"2024-04-25T09:54:33.427371+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T09:54:33.427371+0000","last_undegraded":"2024-04-25T09:54:33.427371+0000","last_fullsized":"2024-04-25T09:54:33.427371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431481+0000","last_change":"2024-04-25T09:54:32.299780+0000","last_active":"2024-04-25T09:54:33.431481+0000","last_peered":"2024-04-25T09:54:33.431481+0000","last_clean":"2024-04-25T09:54:33.431481+0000","last_became_active":"2024-04-25T09:54:32.299351+0000","last_became_peered":"2024-04-25T09:54:32.299351+0000","last_unstale":"2024-04-25T09:54:33.431481+0000","last_undegraded":"2024-04-25T09:54:33.431481+0000","last_fullsized":"2024-04-25T09:54:33.431481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:08.992474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427622+0000","last_change":"2024-04-25T09:54:28.235625+0000","last_active":"2024-04-25T09:54:33.427622+0000","last_peered":"2024-04-25T09:54:33.427622+0000","last_clean":"2024-04-25T09:54:33.427622+0000","last_became_active":"2024-04-25T09:54:28.235034+0000","last_became_peered":"2024-04-25T09:54:28.235034+0000","last_unstale":"2024-04-25T09:54:33.427622+0000","last_undegraded":"2024-04-25T09:54:33.427622+0000","last_fullsized":"2024-04-25T09:54:33.427622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:04.950026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432393+0000","last_change":"2024-04-25T09:54:27.212307+0000","last_active":"2024-04-25T09:54:33.432393+0000","last_peered":"2024-04-25T09:54:33.432393+0000","last_clean":"2024-04-25T09:54:33.432393+0000","last_became_active":"2024-04-25T09:54:27.211984+0000","last_became_peered":"2024-04-25T09:54:27.211984+0000","last_unstale":"2024-04-25T09:54:33.432393+0000","last_undegraded":"2024-04-25T09:54:33.432393+0000","last_fullsized":"2024-04-25T09:54:33.432393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:34.656261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431021+0000","last_change":"2024-04-25T09:54:32.297686+0000","last_active":"2024-04-25T09:54:33.431021+0000","last_peered":"2024-04-25T09:54:33.431021+0000","last_clean":"2024-04-25T09:54:33.431021+0000","last_became_active":"2024-04-25T09:54:32.297151+0000","last_became_peered":"2024-04-25T09:54:32.297151+0000","last_unstale":"2024-04-25T09:54:33.431021+0000","last_undegraded":"2024-04-25T09:54:33.431021+0000","last_fullsized":"2024-04-25T09:54:33.431021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:10.694250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432122+0000","last_change":"2024-04-25T09:54:28.230960+0000","last_active":"2024-04-25T09:54:33.432122+0000","last_peered":"2024-04-25T09:54:33.432122+0000","last_clean":"2024-04-25T09:54:33.432122+0000","last_became_active":"2024-04-25T09:54:28.230684+0000","last_became_peered":"2024-04-25T09:54:28.230684+0000","last_unstale":"2024-04-25T09:54:33.432122+0000","last_undegraded":"2024-04-25T09:54:33.432122+0000","last_fullsized":"2024-04-25T09:54:33.432122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:06.651802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431464+0000","last_change":"2024-04-25T09:54:27.205085+0000","last_active":"2024-04-25T09:54:33.431464+0000","last_peered":"2024-04-25T09:54:33.431464+0000","last_clean":"2024-04-25T09:54:33.431464+0000","last_became_active":"2024-04-25T09:54:27.204801+0000","last_became_peered":"2024-04-25T09:54:27.204801+0000","last_unstale":"2024-04-25T09:54:33.431464+0000","last_undegraded":"2024-04-25T09:54:33.431464+0000","last_fullsized":"2024-04-25T09:54:33.431464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:53.735742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432256+0000","last_change":"2024-04-25T09:54:32.262455+0000","last_active":"2024-04-25T09:54:33.432256+0000","last_peered":"2024-04-25T09:54:33.432256+0000","last_clean":"2024-04-25T09:54:33.432256+0000","last_became_active":"2024-04-25T09:54:32.261864+0000","last_became_peered":"2024-04-25T09:54:32.261864+0000","last_unstale":"2024-04-25T09:54:33.432256+0000","last_undegraded":"2024-04-25T09:54:33.432256+0000","last_fullsized":"2024-04-25T09:54:33.432256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:14.029429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.428064+0000","last_change":"2024-04-25T09:54:28.231074+0000","last_active":"2024-04-25T09:54:33.428064+0000","last_peered":"2024-04-25T09:54:33.428064+0000","last_clean":"2024-04-25T09:54:33.428064+0000","last_became_active":"2024-04-25T09:54:28.230535+0000","last_became_peered":"2024-04-25T09:54:28.230535+0000","last_unstale":"2024-04-25T09:54:33.428064+0000","last_undegraded":"2024-04-25T09:54:33.428064+0000","last_fullsized":"2024-04-25T09:54:33.428064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:09.986981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430862+0000","last_change":"2024-04-25T09:54:27.204630+0000","last_active":"2024-04-25T09:54:33.430862+0000","last_peered":"2024-04-25T09:54:33.430862+0000","last_clean":"2024-04-25T09:54:33.430862+0000","last_became_active":"2024-04-25T09:54:27.204321+0000","last_became_peered":"2024-04-25T09:54:27.204321+0000","last_unstale":"2024-04-25T09:54:33.430862+0000","last_undegraded":"2024-04-25T09:54:33.430862+0000","last_fullsized":"2024-04-25T09:54:33.430862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:25.329710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430615+0000","last_change":"2024-04-25T09:54:32.299684+0000","last_active":"2024-04-25T09:54:33.430615+0000","last_peered":"2024-04-25T09:54:33.430615+0000","last_clean":"2024-04-25T09:54:33.430615+0000","last_became_active":"2024-04-25T09:54:32.299058+0000","last_became_peered":"2024-04-25T09:54:32.299058+0000","last_unstale":"2024-04-25T09:54:33.430615+0000","last_undegraded":"2024-04-25T09:54:33.430615+0000","last_fullsized":"2024-04-25T09:54:33.430615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:44.665406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427809+0000","last_change":"2024-04-25T09:54:28.222738+0000","last_active":"2024-04-25T09:54:33.427809+0000","last_peered":"2024-04-25T09:54:33.427809+0000","last_clean":"2024-04-25T09:54:33.427809+0000","last_became_active":"2024-04-25T09:54:28.222468+0000","last_became_peered":"2024-04-25T09:54:28.222468+0000","last_unstale":"2024-04-25T09:54:33.427809+0000","last_undegraded":"2024-04-25T09:54:33.427809+0000","last_fullsized":"2024-04-25T09:54:33.427809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:36.448046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249841+0000","last_change":"2024-04-25T09:54:27.194471+0000","last_active":"2024-04-25T09:54:33.249841+0000","last_peered":"2024-04-25T09:54:33.249841+0000","last_clean":"2024-04-25T09:54:33.249841+0000","last_became_active":"2024-04-25T09:54:27.194172+0000","last_became_peered":"2024-04-25T09:54:27.194172+0000","last_unstale":"2024-04-25T09:54:33.249841+0000","last_undegraded":"2024-04-25T09:54:33.249841+0000","last_fullsized":"2024-04-25T09:54:33.249841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:47.482218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.248742+0000","last_change":"2024-04-25T09:54:32.266552+0000","last_active":"2024-04-25T09:54:33.248742+0000","last_peered":"2024-04-25T09:54:33.248742+0000","last_clean":"2024-04-25T09:54:33.248742+0000","last_became_active":"2024-04-25T09:54:32.266152+0000","last_became_peered":"2024-04-25T09:54:32.266152+0000","last_unstale":"2024-04-25T09:54:33.248742+0000","last_undegraded":"2024-04-25T09:54:33.248742+0000","last_fullsized":"2024-04-25T09:54:33.248742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:12.761675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427450+0000","last_change":"2024-04-25T09:54:28.225409+0000","last_active":"2024-04-25T09:54:33.427450+0000","last_peered":"2024-04-25T09:54:33.427450+0000","last_clean":"2024-04-25T09:54:33.427450+0000","last_became_active":"2024-04-25T09:54:28.225105+0000","last_became_peered":"2024-04-25T09:54:28.225105+0000","last_unstale":"2024-04-25T09:54:33.427450+0000","last_undegraded":"2024-04-25T09:54:33.427450+0000","last_fullsized":"2024-04-25T09:54:33.427450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:15.832642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430867+0000","last_change":"2024-04-25T09:54:27.207980+0000","last_active":"2024-04-25T09:54:33.430867+0000","last_peered":"2024-04-25T09:54:33.430867+0000","last_clean":"2024-04-25T09:54:33.430867+0000","last_became_active":"2024-04-25T09:54:27.205322+0000","last_became_peered":"2024-04-25T09:54:27.205322+0000","last_unstale":"2024-04-25T09:54:33.430867+0000","last_undegraded":"2024-04-25T09:54:33.430867+0000","last_fullsized":"2024-04-25T09:54:33.430867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:43.025512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431489+0000","last_change":"2024-04-25T09:54:32.252925+0000","last_active":"2024-04-25T09:54:33.431489+0000","last_peered":"2024-04-25T09:54:33.431489+0000","last_clean":"2024-04-25T09:54:33.431489+0000","last_became_active":"2024-04-25T09:54:32.252483+0000","last_became_peered":"2024-04-25T09:54:32.252483+0000","last_unstale":"2024-04-25T09:54:33.431489+0000","last_undegraded":"2024-04-25T09:54:33.431489+0000","last_fullsized":"2024-04-25T09:54:33.431489+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:55.727375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430685+0000","last_change":"2024-04-25T09:54:28.227852+0000","last_active":"2024-04-25T09:54:33.430685+0000","last_peered":"2024-04-25T09:54:33.430685+0000","last_clean":"2024-04-25T09:54:33.430685+0000","last_became_active":"2024-04-25T09:54:28.227552+0000","last_became_peered":"2024-04-25T09:54:28.227552+0000","last_unstale":"2024-04-25T09:54:33.430685+0000","last_undegraded":"2024-04-25T09:54:33.430685+0000","last_fullsized":"2024-04-25T09:54:33.430685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:29.799078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430794+0000","last_change":"2024-04-25T09:54:27.203990+0000","last_active":"2024-04-25T09:54:33.430794+0000","last_peered":"2024-04-25T09:54:33.430794+0000","last_clean":"2024-04-25T09:54:33.430794+0000","last_became_active":"2024-04-25T09:54:27.203714+0000","last_became_peered":"2024-04-25T09:54:27.203714+0000","last_unstale":"2024-04-25T09:54:33.430794+0000","last_undegraded":"2024-04-25T09:54:33.430794+0000","last_fullsized":"2024-04-25T09:54:33.430794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:02.804762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.240156+0000","last_change":"2024-04-25T09:54:32.300515+0000","last_active":"2024-04-25T09:54:33.240156+0000","last_peered":"2024-04-25T09:54:33.240156+0000","last_clean":"2024-04-25T09:54:33.240156+0000","last_became_active":"2024-04-25T09:54:32.300114+0000","last_became_peered":"2024-04-25T09:54:32.300114+0000","last_unstale":"2024-04-25T09:54:33.240156+0000","last_undegraded":"2024-04-25T09:54:33.240156+0000","last_fullsized":"2024-04-25T09:54:33.240156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:33.865351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427679+0000","last_change":"2024-04-25T09:54:28.231995+0000","last_active":"2024-04-25T09:54:33.427679+0000","last_peered":"2024-04-25T09:54:33.427679+0000","last_clean":"2024-04-25T09:54:33.427679+0000","last_became_active":"2024-04-25T09:54:28.231448+0000","last_became_peered":"2024-04-25T09:54:28.231448+0000","last_unstale":"2024-04-25T09:54:33.427679+0000","last_undegraded":"2024-04-25T09:54:33.427679+0000","last_fullsized":"2024-04-25T09:54:33.427679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:52.698521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431789+0000","last_change":"2024-04-25T09:54:27.211810+0000","last_active":"2024-04-25T09:54:33.431789+0000","last_peered":"2024-04-25T09:54:33.431789+0000","last_clean":"2024-04-25T09:54:33.431789+0000","last_became_active":"2024-04-25T09:54:27.211460+0000","last_became_peered":"2024-04-25T09:54:27.211460+0000","last_unstale":"2024-04-25T09:54:33.431789+0000","last_undegraded":"2024-04-25T09:54:33.431789+0000","last_fullsized":"2024-04-25T09:54:33.431789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:39.794974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239769+0000","last_change":"2024-04-25T09:54:32.297745+0000","last_active":"2024-04-25T09:54:33.239769+0000","last_peered":"2024-04-25T09:54:33.239769+0000","last_clean":"2024-04-25T09:54:33.239769+0000","last_became_active":"2024-04-25T09:54:32.297173+0000","last_became_peered":"2024-04-25T09:54:32.297173+0000","last_unstale":"2024-04-25T09:54:33.239769+0000","last_undegraded":"2024-04-25T09:54:33.239769+0000","last_fullsized":"2024-04-25T09:54:33.239769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:44.665406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431853+0000","last_change":"2024-04-25T09:54:28.235736+0000","last_active":"2024-04-25T09:54:33.431853+0000","last_peered":"2024-04-25T09:54:33.431853+0000","last_clean":"2024-04-25T09:54:33.431853+0000","last_became_active":"2024-04-25T09:54:28.235437+0000","last_became_peered":"2024-04-25T09:54:28.235437+0000","last_unstale":"2024-04-25T09:54:33.431853+0000","last_undegraded":"2024-04-25T09:54:33.431853+0000","last_fullsized":"2024-04-25T09:54:33.431853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:16.438954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432306+0000","last_change":"2024-04-25T09:54:27.194948+0000","last_active":"2024-04-25T09:54:33.432306+0000","last_peered":"2024-04-25T09:54:33.432306+0000","last_clean":"2024-04-25T09:54:33.432306+0000","last_became_active":"2024-04-25T09:54:27.194622+0000","last_became_peered":"2024-04-25T09:54:27.194622+0000","last_unstale":"2024-04-25T09:54:33.432306+0000","last_undegraded":"2024-04-25T09:54:33.432306+0000","last_fullsized":"2024-04-25T09:54:33.432306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:15.480038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432224+0000","last_change":"2024-04-25T09:54:32.298286+0000","last_active":"2024-04-25T09:54:33.432224+0000","last_peered":"2024-04-25T09:54:33.432224+0000","last_clean":"2024-04-25T09:54:33.432224+0000","last_became_active":"2024-04-25T09:54:32.297524+0000","last_became_peered":"2024-04-25T09:54:32.297524+0000","last_unstale":"2024-04-25T09:54:33.432224+0000","last_undegraded":"2024-04-25T09:54:33.432224+0000","last_fullsized":"2024-04-25T09:54:33.432224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:26.797002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427520+0000","last_change":"2024-04-25T09:54:28.225357+0000","last_active":"2024-04-25T09:54:33.427520+0000","last_peered":"2024-04-25T09:54:33.427520+0000","last_clean":"2024-04-25T09:54:33.427520+0000","last_became_active":"2024-04-25T09:54:28.225069+0000","last_became_peered":"2024-04-25T09:54:28.225069+0000","last_unstale":"2024-04-25T09:54:33.427520+0000","last_undegraded":"2024-04-25T09:54:33.427520+0000","last_fullsized":"2024-04-25T09:54:33.427520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:06.651802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:37.528828+0000","last_change":"2024-04-25T09:54:27.203341+0000","last_active":"2024-04-25T09:54:37.528828+0000","last_peered":"2024-04-25T09:54:37.528828+0000","last_clean":"2024-04-25T09:54:37.528828+0000","last_became_active":"2024-04-25T09:54:27.203044+0000","last_became_peered":"2024-04-25T09:54:27.203044+0000","last_unstale":"2024-04-25T09:54:37.528828+0000","last_undegraded":"2024-04-25T09:54:37.528828+0000","last_fullsized":"2024-04-25T09:54:37.528828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:34.656261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431728+0000","last_change":"2024-04-25T09:54:32.264939+0000","last_active":"2024-04-25T09:54:33.431728+0000","last_peered":"2024-04-25T09:54:33.431728+0000","last_clean":"2024-04-25T09:54:33.431728+0000","last_became_active":"2024-04-25T09:54:32.263237+0000","last_became_peered":"2024-04-25T09:54:32.263237+0000","last_unstale":"2024-04-25T09:54:33.431728+0000","last_undegraded":"2024-04-25T09:54:33.431728+0000","last_fullsized":"2024-04-25T09:54:33.431728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:55.727375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249518+0000","last_change":"2024-04-25T09:54:28.228347+0000","last_active":"2024-04-25T09:54:33.249518+0000","last_peered":"2024-04-25T09:54:33.249518+0000","last_clean":"2024-04-25T09:54:33.249518+0000","last_became_active":"2024-04-25T09:54:28.228054+0000","last_became_peered":"2024-04-25T09:54:28.228054+0000","last_unstale":"2024-04-25T09:54:33.249518+0000","last_undegraded":"2024-04-25T09:54:33.249518+0000","last_fullsized":"2024-04-25T09:54:33.249518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:05.431124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431354+0000","last_change":"2024-04-25T09:54:27.213081+0000","last_active":"2024-04-25T09:54:33.431354+0000","last_peered":"2024-04-25T09:54:33.431354+0000","last_clean":"2024-04-25T09:54:33.431354+0000","last_became_active":"2024-04-25T09:54:27.212717+0000","last_became_peered":"2024-04-25T09:54:27.212717+0000","last_unstale":"2024-04-25T09:54:33.431354+0000","last_undegraded":"2024-04-25T09:54:33.431354+0000","last_fullsized":"2024-04-25T09:54:33.431354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:39.794974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249368+0000","last_change":"2024-04-25T09:54:32.265709+0000","last_active":"2024-04-25T09:54:33.249368+0000","last_peered":"2024-04-25T09:54:33.249368+0000","last_clean":"2024-04-25T09:54:33.249368+0000","last_became_active":"2024-04-25T09:54:32.264564+0000","last_became_peered":"2024-04-25T09:54:32.264564+0000","last_unstale":"2024-04-25T09:54:33.249368+0000","last_undegraded":"2024-04-25T09:54:33.249368+0000","last_fullsized":"2024-04-25T09:54:33.249368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:56.740969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430940+0000","last_change":"2024-04-25T09:54:28.230395+0000","last_active":"2024-04-25T09:54:33.430940+0000","last_peered":"2024-04-25T09:54:33.430940+0000","last_clean":"2024-04-25T09:54:33.430940+0000","last_became_active":"2024-04-25T09:54:28.230094+0000","last_became_peered":"2024-04-25T09:54:28.230094+0000","last_unstale":"2024-04-25T09:54:33.430940+0000","last_undegraded":"2024-04-25T09:54:33.430940+0000","last_fullsized":"2024-04-25T09:54:33.430940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:08.719227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431892+0000","last_change":"2024-04-25T09:54:27.215296+0000","last_active":"2024-04-25T09:54:33.431892+0000","last_peered":"2024-04-25T09:54:33.431892+0000","last_clean":"2024-04-25T09:54:33.431892+0000","last_became_active":"2024-04-25T09:54:27.215029+0000","last_became_peered":"2024-04-25T09:54:27.215029+0000","last_unstale":"2024-04-25T09:54:33.431892+0000","last_undegraded":"2024-04-25T09:54:33.431892+0000","last_fullsized":"2024-04-25T09:54:33.431892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:34.656261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239377+0000","last_change":"2024-04-25T09:54:32.259386+0000","last_active":"2024-04-25T09:54:33.239377+0000","last_peered":"2024-04-25T09:54:33.239377+0000","last_clean":"2024-04-25T09:54:33.239377+0000","last_became_active":"2024-04-25T09:54:32.258463+0000","last_became_peered":"2024-04-25T09:54:32.258463+0000","last_unstale":"2024-04-25T09:54:33.239377+0000","last_undegraded":"2024-04-25T09:54:33.239377+0000","last_fullsized":"2024-04-25T09:54:33.239377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:55.620829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431885+0000","last_change":"2024-04-25T09:54:28.232092+0000","last_active":"2024-04-25T09:54:33.431885+0000","last_peered":"2024-04-25T09:54:33.431885+0000","last_clean":"2024-04-25T09:54:33.431885+0000","last_became_active":"2024-04-25T09:54:28.230521+0000","last_became_peered":"2024-04-25T09:54:28.230521+0000","last_unstale":"2024-04-25T09:54:33.431885+0000","last_undegraded":"2024-04-25T09:54:33.431885+0000","last_fullsized":"2024-04-25T09:54:33.431885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:51.684928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431720+0000","last_change":"2024-04-25T09:54:27.212262+0000","last_active":"2024-04-25T09:54:33.431720+0000","last_peered":"2024-04-25T09:54:33.431720+0000","last_clean":"2024-04-25T09:54:33.431720+0000","last_became_active":"2024-04-25T09:54:27.212009+0000","last_became_peered":"2024-04-25T09:54:27.212009+0000","last_unstale":"2024-04-25T09:54:33.431720+0000","last_undegraded":"2024-04-25T09:54:33.431720+0000","last_fullsized":"2024-04-25T09:54:33.431720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:25.329710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239235+0000","last_change":"2024-04-25T09:54:32.300659+0000","last_active":"2024-04-25T09:54:33.239235+0000","last_peered":"2024-04-25T09:54:33.239235+0000","last_clean":"2024-04-25T09:54:33.239235+0000","last_became_active":"2024-04-25T09:54:32.300214+0000","last_became_peered":"2024-04-25T09:54:32.300214+0000","last_unstale":"2024-04-25T09:54:33.239235+0000","last_undegraded":"2024-04-25T09:54:33.239235+0000","last_fullsized":"2024-04-25T09:54:33.239235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:13.180594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431335+0000","last_change":"2024-04-25T09:54:32.300216+0000","last_active":"2024-04-25T09:54:33.431335+0000","last_peered":"2024-04-25T09:54:33.431335+0000","last_clean":"2024-04-25T09:54:33.431335+0000","last_became_active":"2024-04-25T09:54:32.299316+0000","last_became_peered":"2024-04-25T09:54:32.299316+0000","last_unstale":"2024-04-25T09:54:33.431335+0000","last_undegraded":"2024-04-25T09:54:33.431335+0000","last_fullsized":"2024-04-25T09:54:33.431335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:40.490493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430556+0000","last_change":"2024-04-25T09:54:28.214303+0000","last_active":"2024-04-25T09:54:33.430556+0000","last_peered":"2024-04-25T09:54:33.430556+0000","last_clean":"2024-04-25T09:54:33.430556+0000","last_became_active":"2024-04-25T09:54:28.213973+0000","last_became_peered":"2024-04-25T09:54:28.213973+0000","last_unstale":"2024-04-25T09:54:33.430556+0000","last_undegraded":"2024-04-25T09:54:33.430556+0000","last_fullsized":"2024-04-25T09:54:33.430556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:23.525779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430800+0000","last_change":"2024-04-25T09:54:27.210642+0000","last_active":"2024-04-25T09:54:33.430800+0000","last_peered":"2024-04-25T09:54:33.430800+0000","last_clean":"2024-04-25T09:54:33.430800+0000","last_became_active":"2024-04-25T09:54:27.210345+0000","last_became_peered":"2024-04-25T09:54:27.210345+0000","last_unstale":"2024-04-25T09:54:33.430800+0000","last_undegraded":"2024-04-25T09:54:33.430800+0000","last_fullsized":"2024-04-25T09:54:33.430800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:25.329710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432201+0000","last_change":"2024-04-25T09:54:32.262209+0000","last_active":"2024-04-25T09:54:33.432201+0000","last_peered":"2024-04-25T09:54:33.432201+0000","last_clean":"2024-04-25T09:54:33.432201+0000","last_became_active":"2024-04-25T09:54:32.261761+0000","last_became_peered":"2024-04-25T09:54:32.261761+0000","last_unstale":"2024-04-25T09:54:33.432201+0000","last_undegraded":"2024-04-25T09:54:33.432201+0000","last_fullsized":"2024-04-25T09:54:33.432201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:40.490493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239107+0000","last_change":"2024-04-25T09:54:28.216779+0000","last_active":"2024-04-25T09:54:33.239107+0000","last_peered":"2024-04-25T09:54:33.239107+0000","last_clean":"2024-04-25T09:54:33.239107+0000","last_became_active":"2024-04-25T09:54:28.216470+0000","last_became_peered":"2024-04-25T09:54:28.216470+0000","last_unstale":"2024-04-25T09:54:33.239107+0000","last_undegraded":"2024-04-25T09:54:33.239107+0000","last_fullsized":"2024-04-25T09:54:33.239107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:04.526578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239393+0000","last_change":"2024-04-25T09:54:27.206958+0000","last_active":"2024-04-25T09:54:33.239393+0000","last_peered":"2024-04-25T09:54:33.239393+0000","last_clean":"2024-04-25T09:54:33.239393+0000","last_became_active":"2024-04-25T09:54:27.206664+0000","last_became_peered":"2024-04-25T09:54:27.206664+0000","last_unstale":"2024-04-25T09:54:33.239393+0000","last_undegraded":"2024-04-25T09:54:33.239393+0000","last_fullsized":"2024-04-25T09:54:33.239393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:44.480619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431165+0000","last_change":"2024-04-25T09:54:27.204005+0000","last_active":"2024-04-25T09:54:33.431165+0000","last_peered":"2024-04-25T09:54:33.431165+0000","last_clean":"2024-04-25T09:54:33.431165+0000","last_became_active":"2024-04-25T09:54:27.203754+0000","last_became_peered":"2024-04-25T09:54:27.203754+0000","last_unstale":"2024-04-25T09:54:33.431165+0000","last_undegraded":"2024-04-25T09:54:33.431165+0000","last_fullsized":"2024-04-25T09:54:33.431165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:39.794974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432276+0000","last_change":"2024-04-25T09:54:28.224588+0000","last_active":"2024-04-25T09:54:33.432276+0000","last_peered":"2024-04-25T09:54:33.432276+0000","last_clean":"2024-04-25T09:54:33.432276+0000","last_became_active":"2024-04-25T09:54:28.224085+0000","last_became_peered":"2024-04-25T09:54:28.224085+0000","last_unstale":"2024-04-25T09:54:33.432276+0000","last_undegraded":"2024-04-25T09:54:33.432276+0000","last_fullsized":"2024-04-25T09:54:33.432276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:23.525779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432222+0000","last_change":"2024-04-25T09:54:32.258902+0000","last_active":"2024-04-25T09:54:33.432222+0000","last_peered":"2024-04-25T09:54:33.432222+0000","last_clean":"2024-04-25T09:54:33.432222+0000","last_became_active":"2024-04-25T09:54:32.258520+0000","last_became_peered":"2024-04-25T09:54:32.258520+0000","last_unstale":"2024-04-25T09:54:33.432222+0000","last_undegraded":"2024-04-25T09:54:33.432222+0000","last_fullsized":"2024-04-25T09:54:33.432222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:31.442262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239580+0000","last_change":"2024-04-25T09:54:27.210481+0000","last_active":"2024-04-25T09:54:33.239580+0000","last_peered":"2024-04-25T09:54:33.239580+0000","last_clean":"2024-04-25T09:54:33.239580+0000","last_became_active":"2024-04-25T09:54:27.210234+0000","last_became_peered":"2024-04-25T09:54:27.210234+0000","last_unstale":"2024-04-25T09:54:33.239580+0000","last_undegraded":"2024-04-25T09:54:33.239580+0000","last_fullsized":"2024-04-25T09:54:33.239580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:26.178545+0000","last_clean_scrub_stamp":"2024-04-25T09:54:26.178545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:43.025512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249024+0000","last_change":"2024-04-25T09:54:28.217905+0000","last_active":"2024-04-25T09:54:33.249024+0000","last_peered":"2024-04-25T09:54:33.249024+0000","last_clean":"2024-04-25T09:54:33.249024+0000","last_became_active":"2024-04-25T09:54:28.216955+0000","last_became_peered":"2024-04-25T09:54:28.216955+0000","last_unstale":"2024-04-25T09:54:33.249024+0000","last_undegraded":"2024-04-25T09:54:33.249024+0000","last_fullsized":"2024-04-25T09:54:33.249024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:05.433765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239944+0000","last_change":"2024-04-25T09:54:32.258140+0000","last_active":"2024-04-25T09:54:33.239944+0000","last_peered":"2024-04-25T09:54:33.239944+0000","last_clean":"2024-04-25T09:54:33.239944+0000","last_became_active":"2024-04-25T09:54:32.257702+0000","last_became_peered":"2024-04-25T09:54:32.257702+0000","last_unstale":"2024-04-25T09:54:33.239944+0000","last_undegraded":"2024-04-25T09:54:33.239944+0000","last_fullsized":"2024-04-25T09:54:33.239944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:31.229029+0000","last_clean_scrub_stamp":"2024-04-25T09:54:31.229029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:26.797002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430559+0000","last_change":"2024-04-25T09:54:28.228362+0000","last_active":"2024-04-25T09:54:33.430559+0000","last_peered":"2024-04-25T09:54:33.430559+0000","last_clean":"2024-04-25T09:54:33.430559+0000","last_became_active":"2024-04-25T09:54:28.228109+0000","last_became_peered":"2024-04-25T09:54:28.228109+0000","last_unstale":"2024-04-25T09:54:33.430559+0000","last_undegraded":"2024-04-25T09:54:33.430559+0000","last_fullsized":"2024-04-25T09:54:33.430559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:04.526578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431200+0000","last_change":"2024-04-25T09:54:28.231028+0000","last_active":"2024-04-25T09:54:33.431200+0000","last_peered":"2024-04-25T09:54:33.431200+0000","last_clean":"2024-04-25T09:54:33.431200+0000","last_became_active":"2024-04-25T09:54:28.230707+0000","last_became_peered":"2024-04-25T09:54:28.230707+0000","last_unstale":"2024-04-25T09:54:33.431200+0000","last_undegraded":"2024-04-25T09:54:33.431200+0000","last_fullsized":"2024-04-25T09:54:33.431200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:54.743779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431645+0000","last_change":"2024-04-25T09:54:28.233501+0000","last_active":"2024-04-25T09:54:33.431645+0000","last_peered":"2024-04-25T09:54:33.431645+0000","last_clean":"2024-04-25T09:54:33.431645+0000","last_became_active":"2024-04-25T09:54:28.232806+0000","last_became_peered":"2024-04-25T09:54:28.232806+0000","last_unstale":"2024-04-25T09:54:33.431645+0000","last_undegraded":"2024-04-25T09:54:33.431645+0000","last_fullsized":"2024-04-25T09:54:33.431645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:04.950026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432189+0000","last_change":"2024-04-25T09:54:28.215003+0000","last_active":"2024-04-25T09:54:33.432189+0000","last_peered":"2024-04-25T09:54:33.432189+0000","last_clean":"2024-04-25T09:54:33.432189+0000","last_became_active":"2024-04-25T09:54:28.214700+0000","last_became_peered":"2024-04-25T09:54:28.214700+0000","last_unstale":"2024-04-25T09:54:33.432189+0000","last_undegraded":"2024-04-25T09:54:33.432189+0000","last_fullsized":"2024-04-25T09:54:33.432189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:47.076023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239981+0000","last_change":"2024-04-25T09:54:28.221725+0000","last_active":"2024-04-25T09:54:33.239981+0000","last_peered":"2024-04-25T09:54:33.239981+0000","last_clean":"2024-04-25T09:54:33.239981+0000","last_became_active":"2024-04-25T09:54:28.221436+0000","last_became_peered":"2024-04-25T09:54:28.221436+0000","last_unstale":"2024-04-25T09:54:33.239981+0000","last_undegraded":"2024-04-25T09:54:33.239981+0000","last_fullsized":"2024-04-25T09:54:33.239981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:08:42.765805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431173+0000","last_change":"2024-04-25T09:54:28.214081+0000","last_active":"2024-04-25T09:54:33.431173+0000","last_peered":"2024-04-25T09:54:33.431173+0000","last_clean":"2024-04-25T09:54:33.431173+0000","last_became_active":"2024-04-25T09:54:28.213740+0000","last_became_peered":"2024-04-25T09:54:28.213740+0000","last_unstale":"2024-04-25T09:54:33.431173+0000","last_undegraded":"2024-04-25T09:54:33.431173+0000","last_fullsized":"2024-04-25T09:54:33.431173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:47.076023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431566+0000","last_change":"2024-04-25T09:54:28.233804+0000","last_active":"2024-04-25T09:54:33.431566+0000","last_peered":"2024-04-25T09:54:33.431566+0000","last_clean":"2024-04-25T09:54:33.431566+0000","last_became_active":"2024-04-25T09:54:28.233532+0000","last_became_peered":"2024-04-25T09:54:28.233532+0000","last_unstale":"2024-04-25T09:54:33.431566+0000","last_undegraded":"2024-04-25T09:54:33.431566+0000","last_fullsized":"2024-04-25T09:54:33.431566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:23.525779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239898+0000","last_change":"2024-04-25T09:54:28.220983+0000","last_active":"2024-04-25T09:54:33.239898+0000","last_peered":"2024-04-25T09:54:33.239898+0000","last_clean":"2024-04-25T09:54:33.239898+0000","last_became_active":"2024-04-25T09:54:28.220569+0000","last_became_peered":"2024-04-25T09:54:28.220569+0000","last_unstale":"2024-04-25T09:54:33.239898+0000","last_undegraded":"2024-04-25T09:54:33.239898+0000","last_fullsized":"2024-04-25T09:54:33.239898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:15.832642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430742+0000","last_change":"2024-04-25T09:54:28.234837+0000","last_active":"2024-04-25T09:54:33.430742+0000","last_peered":"2024-04-25T09:54:33.430742+0000","last_clean":"2024-04-25T09:54:33.430742+0000","last_became_active":"2024-04-25T09:54:28.234316+0000","last_became_peered":"2024-04-25T09:54:28.234316+0000","last_unstale":"2024-04-25T09:54:33.430742+0000","last_undegraded":"2024-04-25T09:54:33.430742+0000","last_fullsized":"2024-04-25T09:54:33.430742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:23.525779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239213+0000","last_change":"2024-04-25T09:54:28.222528+0000","last_active":"2024-04-25T09:54:33.239213+0000","last_peered":"2024-04-25T09:54:33.239213+0000","last_clean":"2024-04-25T09:54:33.239213+0000","last_became_active":"2024-04-25T09:54:28.222211+0000","last_became_peered":"2024-04-25T09:54:28.222211+0000","last_unstale":"2024-04-25T09:54:33.239213+0000","last_undegraded":"2024-04-25T09:54:33.239213+0000","last_fullsized":"2024-04-25T09:54:33.239213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:29.799078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431509+0000","last_change":"2024-04-25T09:54:28.233715+0000","last_active":"2024-04-25T09:54:33.431509+0000","last_peered":"2024-04-25T09:54:33.431509+0000","last_clean":"2024-04-25T09:54:33.431509+0000","last_became_active":"2024-04-25T09:54:28.233426+0000","last_became_peered":"2024-04-25T09:54:28.233426+0000","last_unstale":"2024-04-25T09:54:33.431509+0000","last_undegraded":"2024-04-25T09:54:33.431509+0000","last_fullsized":"2024-04-25T09:54:33.431509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:08:42.765805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432061+0000","last_change":"2024-04-25T09:54:28.238380+0000","last_active":"2024-04-25T09:54:33.432061+0000","last_peered":"2024-04-25T09:54:33.432061+0000","last_clean":"2024-04-25T09:54:33.432061+0000","last_became_active":"2024-04-25T09:54:28.237240+0000","last_became_peered":"2024-04-25T09:54:28.237240+0000","last_unstale":"2024-04-25T09:54:33.432061+0000","last_undegraded":"2024-04-25T09:54:33.432061+0000","last_fullsized":"2024-04-25T09:54:33.432061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:35.167250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431164+0000","last_change":"2024-04-25T09:54:28.224401+0000","last_active":"2024-04-25T09:54:33.431164+0000","last_peered":"2024-04-25T09:54:33.431164+0000","last_clean":"2024-04-25T09:54:33.431164+0000","last_became_active":"2024-04-25T09:54:28.224093+0000","last_became_peered":"2024-04-25T09:54:28.224093+0000","last_unstale":"2024-04-25T09:54:33.431164+0000","last_undegraded":"2024-04-25T09:54:33.431164+0000","last_fullsized":"2024-04-25T09:54:33.431164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:47.076023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427994+0000","last_change":"2024-04-25T09:54:28.225887+0000","last_active":"2024-04-25T09:54:33.427994+0000","last_peered":"2024-04-25T09:54:33.427994+0000","last_clean":"2024-04-25T09:54:33.427994+0000","last_became_active":"2024-04-25T09:54:28.225650+0000","last_became_peered":"2024-04-25T09:54:28.225650+0000","last_unstale":"2024-04-25T09:54:33.427994+0000","last_undegraded":"2024-04-25T09:54:33.427994+0000","last_fullsized":"2024-04-25T09:54:33.427994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:51.684928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430756+0000","last_change":"2024-04-25T09:54:28.229389+0000","last_active":"2024-04-25T09:54:33.430756+0000","last_peered":"2024-04-25T09:54:33.430756+0000","last_clean":"2024-04-25T09:54:33.430756+0000","last_became_active":"2024-04-25T09:54:28.229001+0000","last_became_peered":"2024-04-25T09:54:28.229001+0000","last_unstale":"2024-04-25T09:54:33.430756+0000","last_undegraded":"2024-04-25T09:54:33.430756+0000","last_fullsized":"2024-04-25T09:54:33.430756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:05.431124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.432079+0000","last_change":"2024-04-25T09:54:28.232625+0000","last_active":"2024-04-25T09:54:33.432079+0000","last_peered":"2024-04-25T09:54:33.432079+0000","last_clean":"2024-04-25T09:54:33.432079+0000","last_became_active":"2024-04-25T09:54:28.232336+0000","last_became_peered":"2024-04-25T09:54:28.232336+0000","last_unstale":"2024-04-25T09:54:33.432079+0000","last_undegraded":"2024-04-25T09:54:33.432079+0000","last_fullsized":"2024-04-25T09:54:33.432079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:00:25.749559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430564+0000","last_change":"2024-04-25T09:54:28.234614+0000","last_active":"2024-04-25T09:54:33.430564+0000","last_peered":"2024-04-25T09:54:33.430564+0000","last_clean":"2024-04-25T09:54:33.430564+0000","last_became_active":"2024-04-25T09:54:28.229921+0000","last_became_peered":"2024-04-25T09:54:28.229921+0000","last_unstale":"2024-04-25T09:54:33.430564+0000","last_undegraded":"2024-04-25T09:54:33.430564+0000","last_fullsized":"2024-04-25T09:54:33.430564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:08.719227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.430653+0000","last_change":"2024-04-25T09:54:28.222801+0000","last_active":"2024-04-25T09:54:33.430653+0000","last_peered":"2024-04-25T09:54:33.430653+0000","last_clean":"2024-04-25T09:54:33.430653+0000","last_became_active":"2024-04-25T09:54:28.222496+0000","last_became_peered":"2024-04-25T09:54:28.222496+0000","last_unstale":"2024-04-25T09:54:33.430653+0000","last_undegraded":"2024-04-25T09:54:33.430653+0000","last_fullsized":"2024-04-25T09:54:33.430653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:35.167250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431763+0000","last_change":"2024-04-25T09:54:28.219741+0000","last_active":"2024-04-25T09:54:33.431763+0000","last_peered":"2024-04-25T09:54:33.431763+0000","last_clean":"2024-04-25T09:54:33.431763+0000","last_became_active":"2024-04-25T09:54:28.218538+0000","last_became_peered":"2024-04-25T09:54:28.218538+0000","last_unstale":"2024-04-25T09:54:33.431763+0000","last_undegraded":"2024-04-25T09:54:33.431763+0000","last_fullsized":"2024-04-25T09:54:33.431763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:27.399815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.239440+0000","last_change":"2024-04-25T09:54:28.225395+0000","last_active":"2024-04-25T09:54:33.239440+0000","last_peered":"2024-04-25T09:54:33.239440+0000","last_clean":"2024-04-25T09:54:33.239440+0000","last_became_active":"2024-04-25T09:54:28.225087+0000","last_became_peered":"2024-04-25T09:54:28.225087+0000","last_unstale":"2024-04-25T09:54:33.239440+0000","last_undegraded":"2024-04-25T09:54:33.239440+0000","last_fullsized":"2024-04-25T09:54:33.239440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:08.719227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.249339+0000","last_change":"2024-04-25T09:54:28.230175+0000","last_active":"2024-04-25T09:54:33.249339+0000","last_peered":"2024-04-25T09:54:33.249339+0000","last_clean":"2024-04-25T09:54:33.249339+0000","last_became_active":"2024-04-25T09:54:28.229811+0000","last_became_peered":"2024-04-25T09:54:28.229811+0000","last_unstale":"2024-04-25T09:54:33.249339+0000","last_undegraded":"2024-04-25T09:54:33.249339+0000","last_fullsized":"2024-04-25T09:54:33.249339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:40.803011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431341+0000","last_change":"2024-04-25T09:54:28.236127+0000","last_active":"2024-04-25T09:54:33.431341+0000","last_peered":"2024-04-25T09:54:33.431341+0000","last_clean":"2024-04-25T09:54:33.431341+0000","last_became_active":"2024-04-25T09:54:28.235849+0000","last_became_peered":"2024-04-25T09:54:28.235849+0000","last_unstale":"2024-04-25T09:54:33.431341+0000","last_undegraded":"2024-04-25T09:54:33.431341+0000","last_fullsized":"2024-04-25T09:54:33.431341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:33.543144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431499+0000","last_change":"2024-04-25T09:54:28.233050+0000","last_active":"2024-04-25T09:54:33.431499+0000","last_peered":"2024-04-25T09:54:33.431499+0000","last_clean":"2024-04-25T09:54:33.431499+0000","last_became_active":"2024-04-25T09:54:28.232758+0000","last_became_peered":"2024-04-25T09:54:28.232758+0000","last_unstale":"2024-04-25T09:54:33.431499+0000","last_undegraded":"2024-04-25T09:54:33.431499+0000","last_fullsized":"2024-04-25T09:54:33.431499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:08.719227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.428033+0000","last_change":"2024-04-25T09:54:28.237315+0000","last_active":"2024-04-25T09:54:33.428033+0000","last_peered":"2024-04-25T09:54:33.428033+0000","last_clean":"2024-04-25T09:54:33.428033+0000","last_became_active":"2024-04-25T09:54:28.235994+0000","last_became_peered":"2024-04-25T09:54:28.235994+0000","last_unstale":"2024-04-25T09:54:33.428033+0000","last_undegraded":"2024-04-25T09:54:33.428033+0000","last_fullsized":"2024-04-25T09:54:33.428033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:26.253699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.238952+0000","last_change":"2024-04-25T09:54:28.239527+0000","last_active":"2024-04-25T09:54:33.238952+0000","last_peered":"2024-04-25T09:54:33.238952+0000","last_clean":"2024-04-25T09:54:33.238952+0000","last_became_active":"2024-04-25T09:54:28.239231+0000","last_became_peered":"2024-04-25T09:54:28.239231+0000","last_unstale":"2024-04-25T09:54:33.238952+0000","last_undegraded":"2024-04-25T09:54:33.238952+0000","last_fullsized":"2024-04-25T09:54:33.238952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:35.167250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427536+0000","last_change":"2024-04-25T09:54:28.226800+0000","last_active":"2024-04-25T09:54:33.427536+0000","last_peered":"2024-04-25T09:54:33.427536+0000","last_clean":"2024-04-25T09:54:33.427536+0000","last_became_active":"2024-04-25T09:54:28.226516+0000","last_became_peered":"2024-04-25T09:54:28.226516+0000","last_unstale":"2024-04-25T09:54:33.427536+0000","last_undegraded":"2024-04-25T09:54:33.427536+0000","last_fullsized":"2024-04-25T09:54:33.427536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:50.006460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431400+0000","last_change":"2024-04-25T09:54:28.233084+0000","last_active":"2024-04-25T09:54:33.431400+0000","last_peered":"2024-04-25T09:54:33.431400+0000","last_clean":"2024-04-25T09:54:33.431400+0000","last_became_active":"2024-04-25T09:54:28.232546+0000","last_became_peered":"2024-04-25T09:54:28.232546+0000","last_unstale":"2024-04-25T09:54:33.431400+0000","last_undegraded":"2024-04-25T09:54:33.431400+0000","last_fullsized":"2024-04-25T09:54:33.431400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:50.006460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427429+0000","last_change":"2024-04-25T09:54:28.231761+0000","last_active":"2024-04-25T09:54:33.427429+0000","last_peered":"2024-04-25T09:54:33.427429+0000","last_clean":"2024-04-25T09:54:33.427429+0000","last_became_active":"2024-04-25T09:54:28.231159+0000","last_became_peered":"2024-04-25T09:54:28.231159+0000","last_unstale":"2024-04-25T09:54:33.427429+0000","last_undegraded":"2024-04-25T09:54:33.427429+0000","last_fullsized":"2024-04-25T09:54:33.427429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:08:42.765805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431892+0000","last_change":"2024-04-25T09:54:28.233126+0000","last_active":"2024-04-25T09:54:33.431892+0000","last_peered":"2024-04-25T09:54:33.431892+0000","last_clean":"2024-04-25T09:54:33.431892+0000","last_became_active":"2024-04-25T09:54:28.231248+0000","last_became_peered":"2024-04-25T09:54:28.231248+0000","last_unstale":"2024-04-25T09:54:33.431892+0000","last_undegraded":"2024-04-25T09:54:33.431892+0000","last_fullsized":"2024-04-25T09:54:33.431892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:15.832642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431295+0000","last_change":"2024-04-25T09:54:28.219491+0000","last_active":"2024-04-25T09:54:33.431295+0000","last_peered":"2024-04-25T09:54:33.431295+0000","last_clean":"2024-04-25T09:54:33.431295+0000","last_became_active":"2024-04-25T09:54:28.219177+0000","last_became_peered":"2024-04-25T09:54:28.219177+0000","last_unstale":"2024-04-25T09:54:33.431295+0000","last_undegraded":"2024-04-25T09:54:33.431295+0000","last_fullsized":"2024-04-25T09:54:33.431295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:29.799078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.431885+0000","last_change":"2024-04-25T09:54:28.212159+0000","last_active":"2024-04-25T09:54:33.431885+0000","last_peered":"2024-04-25T09:54:33.431885+0000","last_clean":"2024-04-25T09:54:33.431885+0000","last_became_active":"2024-04-25T09:54:28.211850+0000","last_became_peered":"2024-04-25T09:54:28.211850+0000","last_unstale":"2024-04-25T09:54:33.431885+0000","last_undegraded":"2024-04-25T09:54:33.431885+0000","last_fullsized":"2024-04-25T09:54:33.431885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:08.719227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T09:54:33.427873+0000","last_change":"2024-04-25T09:54:28.232766+0000","last_active":"2024-04-25T09:54:33.427873+0000","last_peered":"2024-04-25T09:54:33.427873+0000","last_clean":"2024-04-25T09:54:33.427873+0000","last_became_active":"2024-04-25T09:54:28.232333+0000","last_became_peered":"2024-04-25T09:54:28.232333+0000","last_unstale":"2024-04-25T09:54:33.427873+0000","last_undegraded":"2024-04-25T09:54:33.427873+0000","last_fullsized":"2024-04-25T09:54:33.427873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:27.186582+0000","last_clean_scrub_stamp":"2024-04-25T09:54:27.186582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:00:25.749559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":860160,"data_stored":694757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":107649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":103897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":103933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":107649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":103807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":270336,"data_stored":103967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":868352,"data_stored":694813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:54:50.061 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T09:54:50.061 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T09:54:50.061 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T09:54:50.061 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T09:54:50.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.194+0000 7fc365749640 1 Processor -- start 2024-04-25T09:54:50.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.194+0000 7fc365749640 1 -- start start 2024-04-25T09:54:50.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.195+0000 7fc365749640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc3600b4fd0 0x7fc36015b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:50.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.195+0000 7fc365749640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3600b5460 con 0x7fc3600afd40 2024-04-25T09:54:50.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.195+0000 7fc365749640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3600b5700 con 0x7fc3600b2240 2024-04-25T09:54:50.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.195+0000 7fc365749640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3600d02a0 con 0x7fc3600b4fd0 2024-04-25T09:54:50.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.195+0000 7fc35e7fc640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc3600b4fd0 0x7fc36015b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:50.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.195+0000 7fc35effd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc3600afd40 0x7fc3600d0d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42028/0 (socket says 172.21.15.7:42028) 2024-04-25T09:54:50.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.195+0000 7fc35effd640 1 -- 172.21.15.7:0/2596307885 learned_addr learned my addr 172.21.15.7:0/2596307885 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:50.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.195+0000 7fc35e7fc640 1 -- 172.21.15.7:0/2596307885 >> v1:172.21.15.55:6789/0 conn(0x7fc3600b2240 legacy=0x7fc3600b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:50.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.195+0000 7fc35e7fc640 1 -- 172.21.15.7:0/2596307885 >> v1:172.21.15.7:6789/0 conn(0x7fc3600afd40 legacy=0x7fc3600d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:50.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.195+0000 7fc35dffb640 1 -- 172.21.15.7:0/2596307885 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1798494627 0 0) 0x7fc3600b5460 con 0x7fc3600afd40 2024-04-25T09:54:50.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.195+0000 7fc35e7fc640 1 -- 172.21.15.7:0/2596307885 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3600d0580 con 0x7fc3600b4fd0 2024-04-25T09:54:50.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.196+0000 7fc35e7fc640 1 --2- 172.21.15.7:0/2596307885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3600b4fd0 0x7fc36015b7c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc3480097a0 tx=0x7fc34802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6891c9c6d4669a62 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:50.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.196+0000 7fc35dffb640 1 -- 172.21.15.7:0/2596307885 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc348037070 con 0x7fc3600b4fd0 2024-04-25T09:54:50.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.196+0000 7fc35dffb640 1 -- 172.21.15.7:0/2596307885 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc348032440 con 0x7fc3600b4fd0 2024-04-25T09:54:50.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.196+0000 7fc35dffb640 1 -- 172.21.15.7:0/2596307885 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc348032810 con 0x7fc3600b4fd0 2024-04-25T09:54:50.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.197+0000 7fc365749640 1 -- 172.21.15.7:0/2596307885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3600b4fd0 msgr2=0x7fc36015b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:50.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.197+0000 7fc365749640 1 --2- 172.21.15.7:0/2596307885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3600b4fd0 0x7fc36015b7c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc3480097a0 tx=0x7fc34802a230 comp rx=0 tx=0).stop 2024-04-25T09:54:50.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.197+0000 7fc365749640 1 -- 172.21.15.7:0/2596307885 shutdown_connections 2024-04-25T09:54:50.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.197+0000 7fc365749640 1 --2- 172.21.15.7:0/2596307885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3600b4fd0 0x7fc36015b7c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:50.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.197+0000 7fc365749640 1 -- 172.21.15.7:0/2596307885 >> 172.21.15.7:0/2596307885 conn(0x7fc360066ad0 msgr2=0x7fc36006bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:50.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.197+0000 7fc365749640 1 -- 172.21.15.7:0/2596307885 shutdown_connections 2024-04-25T09:54:50.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.197+0000 7fc365749640 1 -- 172.21.15.7:0/2596307885 wait complete. 2024-04-25T09:54:50.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.198+0000 7fc365749640 1 Processor -- start 2024-04-25T09:54:50.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.198+0000 7fc365749640 1 -- start start 2024-04-25T09:54:50.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.199+0000 7fc365749640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3600afd40 0x7fc360149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:50.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.199+0000 7fc365749640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3600b2240 0x7fc3601f0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:50.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.199+0000 7fc365749640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3600b4fd0 0x7fc3600c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:50.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.199+0000 7fc365749640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3600ce460 con 0x7fc3600b4fd0 2024-04-25T09:54:50.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.199+0000 7fc365749640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3600b59e0 con 0x7fc3600afd40 2024-04-25T09:54:50.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.199+0000 7fc365749640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3600ce5e0 con 0x7fc3600b2240 2024-04-25T09:54:50.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.199+0000 7fc35f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3600b4fd0 0x7fc3600c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:50.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.199+0000 7fc35f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3600b4fd0 0x7fc3600c5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52386/0 (socket says 172.21.15.7:52386) 2024-04-25T09:54:50.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.199+0000 7fc35f7fe640 1 -- 172.21.15.7:0/2786032478 learned_addr learned my addr 172.21.15.7:0/2786032478 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:50.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.199+0000 7fc35f7fe640 1 -- 172.21.15.7:0/2786032478 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3600b2240 msgr2=0x7fc3601f0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:50.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.199+0000 7fc35f7fe640 1 --2- 172.21.15.7:0/2786032478 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3600b2240 0x7fc3601f0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:50.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.199+0000 7fc35f7fe640 1 -- 172.21.15.7:0/2786032478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3600afd40 msgr2=0x7fc360149ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:50.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.199+0000 7fc35effd640 1 --2- 172.21.15.7:0/2786032478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3600afd40 0x7fc360149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:50.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.199+0000 7fc35f7fe640 1 --2- 172.21.15.7:0/2786032478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3600afd40 0x7fc360149ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:50.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.199+0000 7fc35f7fe640 1 -- 172.21.15.7:0/2786032478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3600b0370 con 0x7fc3600b4fd0 2024-04-25T09:54:50.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.199+0000 7fc35effd640 1 --2- 172.21.15.7:0/2786032478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3600afd40 0x7fc360149ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:50.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.199+0000 7fc35f7fe640 1 --2- 172.21.15.7:0/2786032478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3600b4fd0 0x7fc3600c5520 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc35000c7a0 tx=0x7fc35000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:50.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.200+0000 7fc3577fe640 1 -- 172.21.15.7:0/2786032478 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc350003b70 con 0x7fc3600b4fd0 2024-04-25T09:54:50.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.200+0000 7fc3577fe640 1 -- 172.21.15.7:0/2786032478 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc350003d30 con 0x7fc3600b4fd0 2024-04-25T09:54:50.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.200+0000 7fc365749640 1 -- 172.21.15.7:0/2786032478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3600b0650 con 0x7fc3600b4fd0 2024-04-25T09:54:50.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.200+0000 7fc3577fe640 1 -- 172.21.15.7:0/2786032478 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35000aa90 con 0x7fc3600b4fd0 2024-04-25T09:54:50.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.200+0000 7fc365749640 1 -- 172.21.15.7:0/2786032478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc36014a410 con 0x7fc3600b4fd0 2024-04-25T09:54:50.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.201+0000 7fc365749640 1 -- 172.21.15.7:0/2786032478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3600b4a30 con 0x7fc3600b4fd0 2024-04-25T09:54:50.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.201+0000 7fc3577fe640 1 -- 172.21.15.7:0/2786032478 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc35000ac30 con 0x7fc3600b4fd0 2024-04-25T09:54:50.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.201+0000 7fc3577fe640 1 --2- 172.21.15.7:0/2786032478 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc34006b4d0 0x7fc34006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:50.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.202+0000 7fc3577fe640 1 -- 172.21.15.7:0/2786032478 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc35008a3e0 con 0x7fc3600b4fd0 2024-04-25T09:54:50.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.202+0000 7fc35effd640 1 --2- 172.21.15.7:0/2786032478 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc34006b4d0 0x7fc34006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:50.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.202+0000 7fc35effd640 1 --2- 172.21.15.7:0/2786032478 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc34006b4d0 0x7fc34006d990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc358000f60 tx=0x7fc358009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:50.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.206+0000 7fc3577fe640 1 -- 172.21.15.7:0/2786032478 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc350058fb0 con 0x7fc3600b4fd0 2024-04-25T09:54:50.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.428+0000 7fc365749640 1 -- 172.21.15.7:0/2786032478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc36006d2b0 con 0x7fc3600b4fd0 2024-04-25T09:54:50.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.428+0000 7fc3577fe640 1 -- 172.21.15.7:0/2786032478 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fc3500588b0 con 0x7fc3600b4fd0 2024-04-25T09:54:50.431 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:50.431 INFO:teuthology.orchestra.run.smithi007.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T09:54:50.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.430+0000 7fc365749640 1 -- 172.21.15.7:0/2786032478 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc34006b4d0 msgr2=0x7fc34006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:50.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.430+0000 7fc365749640 1 --2- 172.21.15.7:0/2786032478 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc34006b4d0 0x7fc34006d990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc358000f60 tx=0x7fc358009040 comp rx=0 tx=0).stop 2024-04-25T09:54:50.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.430+0000 7fc365749640 1 -- 172.21.15.7:0/2786032478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3600b4fd0 msgr2=0x7fc3600c5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:50.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.430+0000 7fc365749640 1 --2- 172.21.15.7:0/2786032478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3600b4fd0 0x7fc3600c5520 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc35000c7a0 tx=0x7fc35000cc60 comp rx=0 tx=0).stop 2024-04-25T09:54:50.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.430+0000 7fc365749640 1 -- 172.21.15.7:0/2786032478 shutdown_connections 2024-04-25T09:54:50.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.430+0000 7fc365749640 1 --2- 172.21.15.7:0/2786032478 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc34006b4d0 0x7fc34006d990 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:50.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.430+0000 7fc365749640 1 --2- 172.21.15.7:0/2786032478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3600b4fd0 0x7fc3600c5520 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:50.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.430+0000 7fc365749640 1 --2- 172.21.15.7:0/2786032478 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3600b2240 0x7fc3601f0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:50.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.430+0000 7fc365749640 1 --2- 172.21.15.7:0/2786032478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3600afd40 0x7fc360149ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:50.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.430+0000 7fc365749640 1 -- 172.21.15.7:0/2786032478 >> 172.21.15.7:0/2786032478 conn(0x7fc360066ad0 msgr2=0x7fc36006ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:50.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.430+0000 7fc365749640 1 -- 172.21.15.7:0/2786032478 shutdown_connections 2024-04-25T09:54:50.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.431+0000 7fc365749640 1 -- 172.21.15.7:0/2786032478 wait complete. 2024-04-25T09:54:50.444 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T09:54:50.444 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:54:50.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.542+0000 7f1d3ee76640 1 Processor -- start 2024-04-25T09:54:50.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.543+0000 7f1d3ee76640 1 -- start start 2024-04-25T09:54:50.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.543+0000 7f1d3ee76640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1d3806ab60 0x7f1d380b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:50.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.543+0000 7f1d3ee76640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1d380afc00 0x7f1d380b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:50.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.543+0000 7f1d3ee76640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d380b5a20 con 0x7f1d3815dc60 2024-04-25T09:54:50.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.543+0000 7f1d3ee76640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d380b0160 con 0x7f1d3806ab60 2024-04-25T09:54:50.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.543+0000 7f1d3ee76640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d380b5740 con 0x7f1d380afc00 2024-04-25T09:54:50.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.543+0000 7f1d3cc12640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1d3806ab60 0x7f1d380b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:50.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.544+0000 7f1d3cc12640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1d3806ab60 0x7f1d380b1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52390/0 (socket says 172.21.15.7:52390) 2024-04-25T09:54:50.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.544+0000 7f1d37fff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1d3815dc60 0x7f1d3806af40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42036/0 (socket says 172.21.15.7:42036) 2024-04-25T09:54:50.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.544+0000 7f1d3cc12640 1 -- 172.21.15.7:0/3139480137 learned_addr learned my addr 172.21.15.7:0/3139480137 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:50.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.544+0000 7f1d3d413640 1 --2- 172.21.15.7:0/3139480137 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1d380afc00 0x7f1d380b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:50.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.544+0000 7f1d3cc12640 1 -- 172.21.15.7:0/3139480137 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1d380afc00 msgr2=0x7f1d380b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:50.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.544+0000 7f1d3cc12640 1 --2- 172.21.15.7:0/3139480137 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1d380afc00 0x7f1d380b0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:50.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.544+0000 7f1d3cc12640 1 -- 172.21.15.7:0/3139480137 >> v1:172.21.15.7:6789/0 conn(0x7f1d3815dc60 legacy=0x7f1d3806af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:50.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.544+0000 7f1d3cc12640 1 -- 172.21.15.7:0/3139480137 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d380b0400 con 0x7f1d3806ab60 2024-04-25T09:54:50.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.544+0000 7f1d377fe640 1 -- 172.21.15.7:0/3139480137 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134415139 0 0) 0x7f1d380b5a20 con 0x7f1d3815dc60 2024-04-25T09:54:50.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.544+0000 7f1d3d413640 1 --2- 172.21.15.7:0/3139480137 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1d380afc00 0x7f1d380b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:50.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.544+0000 7f1d3cc12640 1 --2- 172.21.15.7:0/3139480137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d3806ab60 0x7f1d380b1ba0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1d30009e50 tx=0x7f1d3002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad6f28a583f12f6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:50.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.545+0000 7f1d377fe640 1 -- 172.21.15.7:0/3139480137 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d30036070 con 0x7f1d3806ab60 2024-04-25T09:54:50.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.545+0000 7f1d377fe640 1 -- 172.21.15.7:0/3139480137 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d30031600 con 0x7f1d3806ab60 2024-04-25T09:54:50.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.545+0000 7f1d377fe640 1 -- 172.21.15.7:0/3139480137 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d300319d0 con 0x7f1d3806ab60 2024-04-25T09:54:50.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.545+0000 7f1d3ee76640 1 -- 172.21.15.7:0/3139480137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d3806ab60 msgr2=0x7f1d380b1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:50.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.545+0000 7f1d3ee76640 1 --2- 172.21.15.7:0/3139480137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d3806ab60 0x7f1d380b1ba0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1d30009e50 tx=0x7f1d3002a610 comp rx=0 tx=0).stop 2024-04-25T09:54:50.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.545+0000 7f1d3ee76640 1 -- 172.21.15.7:0/3139480137 shutdown_connections 2024-04-25T09:54:50.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.545+0000 7f1d3ee76640 1 --2- 172.21.15.7:0/3139480137 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1d380afc00 0x7f1d380b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:50.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.545+0000 7f1d3ee76640 1 --2- 172.21.15.7:0/3139480137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d3806ab60 0x7f1d380b1ba0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:50.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.545+0000 7f1d3ee76640 1 -- 172.21.15.7:0/3139480137 >> 172.21.15.7:0/3139480137 conn(0x7f1d380b5c30 msgr2=0x7f1d380999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:50.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.545+0000 7f1d3ee76640 1 -- 172.21.15.7:0/3139480137 shutdown_connections 2024-04-25T09:54:50.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.545+0000 7f1d3ee76640 1 -- 172.21.15.7:0/3139480137 wait complete. 2024-04-25T09:54:50.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.546+0000 7f1d3ee76640 1 Processor -- start 2024-04-25T09:54:50.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.546+0000 7f1d3ee76640 1 -- start start 2024-04-25T09:54:50.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.547+0000 7f1d3ee76640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d3806ab60 0x7f1d38144130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:50.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.547+0000 7f1d3ee76640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d380afc00 0x7f1d38157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:50.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.547+0000 7f1d3ee76640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1d3815dc60 0x7f1d38146900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:50.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.547+0000 7f1d3ee76640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d380b53e0 con 0x7f1d380afc00 2024-04-25T09:54:50.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.547+0000 7f1d3ee76640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d380b5260 con 0x7f1d3806ab60 2024-04-25T09:54:50.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.547+0000 7f1d3ee76640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d380ad460 con 0x7f1d3815dc60 2024-04-25T09:54:50.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.547+0000 7f1d37fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d380afc00 0x7f1d38157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:50.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.547+0000 7f1d37fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d380afc00 0x7f1d38157b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52400/0 (socket says 172.21.15.7:52400) 2024-04-25T09:54:50.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.547+0000 7f1d37fff640 1 -- 172.21.15.7:0/2905774946 learned_addr learned my addr 172.21.15.7:0/2905774946 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:50.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.548+0000 7f1d3cc12640 1 --2- 172.21.15.7:0/2905774946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d3806ab60 0x7f1d38144130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:50.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.548+0000 7f1d3d413640 1 --2- 172.21.15.7:0/2905774946 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1d3815dc60 0x7f1d38146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:50.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.548+0000 7f1d37fff640 1 -- 172.21.15.7:0/2905774946 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1d3815dc60 msgr2=0x7f1d38146900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:50.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.548+0000 7f1d37fff640 1 --2- 172.21.15.7:0/2905774946 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1d3815dc60 0x7f1d38146900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:50.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.548+0000 7f1d37fff640 1 -- 172.21.15.7:0/2905774946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d3806ab60 msgr2=0x7f1d38144130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:50.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.548+0000 7f1d37fff640 1 --2- 172.21.15.7:0/2905774946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d3806ab60 0x7f1d38144130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:50.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.548+0000 7f1d37fff640 1 -- 172.21.15.7:0/2905774946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d38158520 con 0x7f1d380afc00 2024-04-25T09:54:50.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.548+0000 7f1d37fff640 1 --2- 172.21.15.7:0/2905774946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d380afc00 0x7f1d38157b20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1d2000c430 tx=0x7f1d2000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:50.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.548+0000 7f1d357fa640 1 -- 172.21.15.7:0/2905774946 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d200074e0 con 0x7f1d380afc00 2024-04-25T09:54:50.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.548+0000 7f1d357fa640 1 -- 172.21.15.7:0/2905774946 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d200047e0 con 0x7f1d380afc00 2024-04-25T09:54:50.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.548+0000 7f1d3ee76640 1 -- 172.21.15.7:0/2905774946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d38158800 con 0x7f1d380afc00 2024-04-25T09:54:50.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.548+0000 7f1d357fa640 1 -- 172.21.15.7:0/2905774946 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d20004bd0 con 0x7f1d380afc00 2024-04-25T09:54:50.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.548+0000 7f1d3ee76640 1 -- 172.21.15.7:0/2905774946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d38158dc0 con 0x7f1d380afc00 2024-04-25T09:54:50.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.549+0000 7f1d3ee76640 1 -- 172.21.15.7:0/2905774946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d380b4220 con 0x7f1d380afc00 2024-04-25T09:54:50.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.550+0000 7f1d357fa640 1 -- 172.21.15.7:0/2905774946 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1d20011070 con 0x7f1d380afc00 2024-04-25T09:54:50.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.550+0000 7f1d357fa640 1 --2- 172.21.15.7:0/2905774946 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1d1806b4d0 0x7f1d1806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:50.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.550+0000 7f1d357fa640 1 -- 172.21.15.7:0/2905774946 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f1d20089fe0 con 0x7f1d380afc00 2024-04-25T09:54:50.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.550+0000 7f1d3cc12640 1 --2- 172.21.15.7:0/2905774946 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1d1806b4d0 0x7f1d1806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:50.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.551+0000 7f1d3cc12640 1 --2- 172.21.15.7:0/2905774946 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1d1806b4d0 0x7f1d1806d990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1d30033000 tx=0x7f1d30009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:50.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.555+0000 7f1d357fa640 1 -- 172.21.15.7:0/2905774946 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1d380b4220 con 0x7f1d380afc00 2024-04-25T09:54:50.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.735+0000 7f1d3ee76640 1 -- 172.21.15.7:0/2905774946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d38070a20 con 0x7f1d380afc00 2024-04-25T09:54:50.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.736+0000 7f1d357fa640 1 -- 172.21.15.7:0/2905774946 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18418 (secure 0 0 0) 0x7f1d20058560 con 0x7f1d380afc00 2024-04-25T09:54:50.739 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:50.739 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:54:32.606761+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:54:26.011833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:54:26.535536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:54:30.264996+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:54:50.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.738+0000 7f1d3ee76640 1 -- 172.21.15.7:0/2905774946 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1d1806b4d0 msgr2=0x7f1d1806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:50.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.738+0000 7f1d3ee76640 1 --2- 172.21.15.7:0/2905774946 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1d1806b4d0 0x7f1d1806d990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1d30033000 tx=0x7f1d30009000 comp rx=0 tx=0).stop 2024-04-25T09:54:50.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.738+0000 7f1d3ee76640 1 -- 172.21.15.7:0/2905774946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d380afc00 msgr2=0x7f1d38157b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:50.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.738+0000 7f1d3ee76640 1 --2- 172.21.15.7:0/2905774946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d380afc00 0x7f1d38157b20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1d2000c430 tx=0x7f1d2000c8f0 comp rx=0 tx=0).stop 2024-04-25T09:54:50.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.738+0000 7f1d3ee76640 1 -- 172.21.15.7:0/2905774946 shutdown_connections 2024-04-25T09:54:50.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.738+0000 7f1d3ee76640 1 --2- 172.21.15.7:0/2905774946 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1d1806b4d0 0x7f1d1806d990 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:50.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.738+0000 7f1d3ee76640 1 --2- 172.21.15.7:0/2905774946 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1d3815dc60 0x7f1d38146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:50.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.738+0000 7f1d3ee76640 1 --2- 172.21.15.7:0/2905774946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d380afc00 0x7f1d38157b20 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:50.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.738+0000 7f1d3ee76640 1 --2- 172.21.15.7:0/2905774946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d3806ab60 0x7f1d38144130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:50.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.738+0000 7f1d3ee76640 1 -- 172.21.15.7:0/2905774946 >> 172.21.15.7:0/2905774946 conn(0x7f1d380b5c30 msgr2=0x7f1d380b1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:50.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.738+0000 7f1d3ee76640 1 -- 172.21.15.7:0/2905774946 shutdown_connections 2024-04-25T09:54:50.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.738+0000 7f1d3ee76640 1 -- 172.21.15.7:0/2905774946 wait complete. 2024-04-25T09:54:50.753 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:54:26.011833+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:54:26.535536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:54:30.264996+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:54:50.753 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:54:50.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.854+0000 7fcf31212640 1 Processor -- start 2024-04-25T09:54:50.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.854+0000 7fcf31212640 1 -- start start 2024-04-25T09:54:50.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.855+0000 7fcf31212640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcf2c15db70 0x7fcf2c0ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:50.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.855+0000 7fcf31212640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcf2c0d2380 0x7fcf2c0b7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:50.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.855+0000 7fcf31212640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf2c0d29c0 con 0x7fcf2c0cede0 2024-04-25T09:54:50.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.855+0000 7fcf31212640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2c0cf250 con 0x7fcf2c15db70 2024-04-25T09:54:50.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.855+0000 7fcf31212640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c0b6ce0 con 0x7fcf2c0d2380 2024-04-25T09:54:50.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.855+0000 7fcf2ad9d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcf2c15db70 0x7fcf2c0ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:50.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.855+0000 7fcf2a59c640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fcf2c0cede0 0x7fcf2c0d1c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42044/0 (socket says 172.21.15.7:42044) 2024-04-25T09:54:50.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.855+0000 7fcf2a59c640 1 -- 172.21.15.7:0/742263637 learned_addr learned my addr 172.21.15.7:0/742263637 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:50.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.856+0000 7fcf2ad9d640 1 -- 172.21.15.7:0/742263637 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcf2c0d2380 msgr2=0x7fcf2c0b7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:50.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.856+0000 7fcf2b59e640 1 --2- 172.21.15.7:0/742263637 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcf2c0d2380 0x7fcf2c0b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:50.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.856+0000 7fcf29d9b640 1 -- 172.21.15.7:0/742263637 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215048271 0 0) 0x7fcf2c0d29c0 con 0x7fcf2c0cede0 2024-04-25T09:54:50.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.856+0000 7fcf2ad9d640 1 --2- 172.21.15.7:0/742263637 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcf2c0d2380 0x7fcf2c0b7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:50.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.856+0000 7fcf2ad9d640 1 -- 172.21.15.7:0/742263637 >> v1:172.21.15.7:6789/0 conn(0x7fcf2c0cede0 legacy=0x7fcf2c0d1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:50.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.856+0000 7fcf2ad9d640 1 -- 172.21.15.7:0/742263637 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2c0d2ca0 con 0x7fcf2c15db70 2024-04-25T09:54:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.856+0000 7fcf2ad9d640 1 --2- 172.21.15.7:0/742263637 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf2c15db70 0x7fcf2c0ce8a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcf240097a0 tx=0x7fcf2402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6583670d95e57e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.856+0000 7fcf29d9b640 1 -- 172.21.15.7:0/742263637 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf24037070 con 0x7fcf2c15db70 2024-04-25T09:54:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.856+0000 7fcf29d9b640 1 -- 172.21.15.7:0/742263637 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf24032440 con 0x7fcf2c15db70 2024-04-25T09:54:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.856+0000 7fcf29d9b640 1 -- 172.21.15.7:0/742263637 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf24032810 con 0x7fcf2c15db70 2024-04-25T09:54:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.857+0000 7fcf31212640 1 -- 172.21.15.7:0/742263637 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf2c15db70 msgr2=0x7fcf2c0ce8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.857+0000 7fcf31212640 1 --2- 172.21.15.7:0/742263637 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf2c15db70 0x7fcf2c0ce8a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcf240097a0 tx=0x7fcf2402a180 comp rx=0 tx=0).stop 2024-04-25T09:54:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.857+0000 7fcf31212640 1 -- 172.21.15.7:0/742263637 shutdown_connections 2024-04-25T09:54:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.857+0000 7fcf31212640 1 --2- 172.21.15.7:0/742263637 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcf2c0d2380 0x7fcf2c0b7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.857+0000 7fcf31212640 1 --2- 172.21.15.7:0/742263637 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf2c15db70 0x7fcf2c0ce8a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.857+0000 7fcf31212640 1 -- 172.21.15.7:0/742263637 >> 172.21.15.7:0/742263637 conn(0x7fcf2c0b5370 msgr2=0x7fcf2c0b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.857+0000 7fcf31212640 1 -- 172.21.15.7:0/742263637 shutdown_connections 2024-04-25T09:54:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.857+0000 7fcf31212640 1 -- 172.21.15.7:0/742263637 wait complete. 2024-04-25T09:54:50.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.858+0000 7fcf31212640 1 Processor -- start 2024-04-25T09:54:50.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.859+0000 7fcf31212640 1 -- start start 2024-04-25T09:54:50.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.859+0000 7fcf31212640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcf2c0cede0 0x7fcf2c147560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:50.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.859+0000 7fcf31212640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf2c0d2380 0x7fcf2c0cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:50.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.859+0000 7fcf31212640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf2c15db70 0x7fcf2c0c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:50.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.859+0000 7fcf31212640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c0b7280 con 0x7fcf2c15db70 2024-04-25T09:54:50.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.859+0000 7fcf31212640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c0d2f80 con 0x7fcf2c0d2380 2024-04-25T09:54:50.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.859+0000 7fcf31212640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c15df50 con 0x7fcf2c0cede0 2024-04-25T09:54:50.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.859+0000 7fcf2b59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf2c15db70 0x7fcf2c0c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:50.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.859+0000 7fcf2b59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf2c15db70 0x7fcf2c0c8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52420/0 (socket says 172.21.15.7:52420) 2024-04-25T09:54:50.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.859+0000 7fcf2b59e640 1 -- 172.21.15.7:0/1741642701 learned_addr learned my addr 172.21.15.7:0/1741642701 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:50.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.859+0000 7fcf2a59c640 1 --2- 172.21.15.7:0/1741642701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf2c0d2380 0x7fcf2c0cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:50.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.859+0000 7fcf2ad9d640 1 --2- 172.21.15.7:0/1741642701 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcf2c0cede0 0x7fcf2c147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:50.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.860+0000 7fcf2b59e640 1 -- 172.21.15.7:0/1741642701 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcf2c0cede0 msgr2=0x7fcf2c147560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:50.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.860+0000 7fcf2b59e640 1 --2- 172.21.15.7:0/1741642701 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcf2c0cede0 0x7fcf2c147560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:50.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.860+0000 7fcf2b59e640 1 -- 172.21.15.7:0/1741642701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf2c0d2380 msgr2=0x7fcf2c0cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:50.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.860+0000 7fcf2b59e640 1 --2- 172.21.15.7:0/1741642701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf2c0d2380 0x7fcf2c0cbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:50.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.860+0000 7fcf2b59e640 1 -- 172.21.15.7:0/1741642701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2c15fa00 con 0x7fcf2c15db70 2024-04-25T09:54:50.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.860+0000 7fcf2b59e640 1 --2- 172.21.15.7:0/1741642701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf2c15db70 0x7fcf2c0c8250 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00cd70 tx=0x7fcf1c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:50.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.860+0000 7fcf237fe640 1 -- 172.21.15.7:0/1741642701 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c003b90 con 0x7fcf2c15db70 2024-04-25T09:54:50.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.860+0000 7fcf237fe640 1 -- 172.21.15.7:0/1741642701 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1c003d30 con 0x7fcf2c15db70 2024-04-25T09:54:50.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.860+0000 7fcf237fe640 1 -- 172.21.15.7:0/1741642701 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c004240 con 0x7fcf2c15db70 2024-04-25T09:54:50.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.860+0000 7fcf31212640 1 -- 172.21.15.7:0/1741642701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf2c15fce0 con 0x7fcf2c15db70 2024-04-25T09:54:50.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.860+0000 7fcf31212640 1 -- 172.21.15.7:0/1741642701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf2c147aa0 con 0x7fcf2c15db70 2024-04-25T09:54:50.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.861+0000 7fcf31212640 1 -- 172.21.15.7:0/1741642701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf2c068f60 con 0x7fcf2c15db70 2024-04-25T09:54:50.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.862+0000 7fcf237fe640 1 -- 172.21.15.7:0/1741642701 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcf1c0043e0 con 0x7fcf2c15db70 2024-04-25T09:54:50.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.862+0000 7fcf237fe640 1 --2- 172.21.15.7:0/1741642701 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcf0c06b4d0 0x7fcf0c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:50.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.862+0000 7fcf237fe640 1 -- 172.21.15.7:0/1741642701 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fcf1c08afd0 con 0x7fcf2c15db70 2024-04-25T09:54:50.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.862+0000 7fcf2ad9d640 1 --2- 172.21.15.7:0/1741642701 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcf0c06b4d0 0x7fcf0c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:50.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.863+0000 7fcf2ad9d640 1 --2- 172.21.15.7:0/1741642701 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcf0c06b4d0 0x7fcf0c06d990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcf24034000 tx=0x7fcf2402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:50.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:50.866+0000 7fcf237fe640 1 -- 172.21.15.7:0/1741642701 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcf1c059420 con 0x7fcf2c15db70 2024-04-25T09:54:51.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.048+0000 7fcf31212640 1 -- 172.21.15.7:0/1741642701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf2c0d0ea0 con 0x7fcf2c15db70 2024-04-25T09:54:51.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.048+0000 7fcf237fe640 1 -- 172.21.15.7:0/1741642701 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf1c05d4c0 con 0x7fcf2c15db70 2024-04-25T09:54:51.051 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T09:54:51.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.050+0000 7fcf31212640 1 -- 172.21.15.7:0/1741642701 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcf0c06b4d0 msgr2=0x7fcf0c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:51.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.050+0000 7fcf31212640 1 --2- 172.21.15.7:0/1741642701 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcf0c06b4d0 0x7fcf0c06d990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcf24034000 tx=0x7fcf2402e000 comp rx=0 tx=0).stop 2024-04-25T09:54:51.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.050+0000 7fcf31212640 1 -- 172.21.15.7:0/1741642701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf2c15db70 msgr2=0x7fcf2c0c8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:51.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.050+0000 7fcf31212640 1 --2- 172.21.15.7:0/1741642701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf2c15db70 0x7fcf2c0c8250 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00cd70 tx=0x7fcf1c00a660 comp rx=0 tx=0).stop 2024-04-25T09:54:51.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.050+0000 7fcf31212640 1 -- 172.21.15.7:0/1741642701 shutdown_connections 2024-04-25T09:54:51.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.050+0000 7fcf31212640 1 --2- 172.21.15.7:0/1741642701 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcf0c06b4d0 0x7fcf0c06d990 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.050+0000 7fcf31212640 1 --2- 172.21.15.7:0/1741642701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf2c15db70 0x7fcf2c0c8250 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.050+0000 7fcf31212640 1 --2- 172.21.15.7:0/1741642701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf2c0d2380 0x7fcf2c0cbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.050+0000 7fcf31212640 1 --2- 172.21.15.7:0/1741642701 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcf2c0cede0 0x7fcf2c147560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.050+0000 7fcf31212640 1 -- 172.21.15.7:0/1741642701 >> 172.21.15.7:0/1741642701 conn(0x7fcf2c0b5370 msgr2=0x7fcf2c0b3910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:51.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.051+0000 7fcf31212640 1 -- 172.21.15.7:0/1741642701 shutdown_connections 2024-04-25T09:54:51.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.051+0000 7fcf31212640 1 -- 172.21.15.7:0/1741642701 wait complete. 2024-04-25T09:54:51.064 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:54:51.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.165+0000 7faad804d640 1 Processor -- start 2024-04-25T09:54:51.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.165+0000 7faad804d640 1 -- start start 2024-04-25T09:54:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.166+0000 7faad804d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faad006bf10 0x7faad00999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.166+0000 7faad804d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faad0099f30 0x7faad015d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.166+0000 7faad804d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad00d02f0 con 0x7faad00cda20 2024-04-25T09:54:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.166+0000 7faad804d640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faad00cde00 con 0x7faad006bf10 2024-04-25T09:54:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.166+0000 7faad804d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faad009a360 con 0x7faad0099f30 2024-04-25T09:54:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.166+0000 7faad55e8640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faad006bf10 0x7faad00999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.166+0000 7faad55e8640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faad006bf10 0x7faad00999f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52422/0 (socket says 172.21.15.7:52422) 2024-04-25T09:54:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.166+0000 7faad55e8640 1 -- 172.21.15.7:0/915442800 learned_addr learned my addr 172.21.15.7:0/915442800 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.166+0000 7faad65ea640 1 --2- 172.21.15.7:0/915442800 >> v2:172.21.15.55:3300/0 conn(0x7faad0099f30 0x7faad015d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.166+0000 7faad55e8640 1 -- 172.21.15.7:0/915442800 >> v2:172.21.15.55:3300/0 conn(0x7faad0099f30 msgr2=0x7faad015d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.166+0000 7faad55e8640 1 --2- 172.21.15.7:0/915442800 >> v2:172.21.15.55:3300/0 conn(0x7faad0099f30 0x7faad015d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.166+0000 7faad55e8640 1 -- 172.21.15.7:0/915442800 >> v1:172.21.15.55:6789/0 conn(0x7faad00cda20 legacy=0x7faad00cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:51.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.166+0000 7faad55e8640 1 -- 172.21.15.7:0/915442800 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad00d05d0 con 0x7faad006bf10 2024-04-25T09:54:51.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.167+0000 7faad55e8640 1 --2- 172.21.15.7:0/915442800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faad006bf10 0x7faad00999f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faad00cbc00 tx=0x7faac002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a52905a3bd4f43 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:51.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.167+0000 7faad4de7640 1 -- 172.21.15.7:0/915442800 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac0037070 con 0x7faad006bf10 2024-04-25T09:54:51.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.167+0000 7faad4de7640 1 -- 172.21.15.7:0/915442800 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac0032440 con 0x7faad006bf10 2024-04-25T09:54:51.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.167+0000 7faad4de7640 1 -- 172.21.15.7:0/915442800 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac0032810 con 0x7faad006bf10 2024-04-25T09:54:51.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.168+0000 7faad804d640 1 -- 172.21.15.7:0/915442800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faad006bf10 msgr2=0x7faad00999f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:51.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.168+0000 7faad804d640 1 --2- 172.21.15.7:0/915442800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faad006bf10 0x7faad00999f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faad00cbc00 tx=0x7faac002a230 comp rx=0 tx=0).stop 2024-04-25T09:54:51.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.168+0000 7faad804d640 1 -- 172.21.15.7:0/915442800 shutdown_connections 2024-04-25T09:54:51.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.168+0000 7faad804d640 1 --2- 172.21.15.7:0/915442800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faad006bf10 0x7faad00999f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.168+0000 7faad804d640 1 --2- 172.21.15.7:0/915442800 >> v2:172.21.15.55:3300/0 conn(0x7faad0099f30 0x7faad015d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.168+0000 7faad804d640 1 -- 172.21.15.7:0/915442800 >> 172.21.15.7:0/915442800 conn(0x7faad00b3110 msgr2=0x7faad00b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:51.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.168+0000 7faad804d640 1 -- 172.21.15.7:0/915442800 shutdown_connections 2024-04-25T09:54:51.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.168+0000 7faad804d640 1 -- 172.21.15.7:0/915442800 wait complete. 2024-04-25T09:54:51.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.169+0000 7faad804d640 1 Processor -- start 2024-04-25T09:54:51.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.169+0000 7faad804d640 1 -- start start 2024-04-25T09:54:51.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.170+0000 7faad804d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faad006bf10 0x7faad0160460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:51.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.170+0000 7faad804d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faad0099f30 0x7faad0156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:51.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.170+0000 7faad804d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faad00cda20 0x7faad0161670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:51.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.170+0000 7faad804d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad00d0e70 con 0x7faad006bf10 2024-04-25T09:54:51.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.170+0000 7faad804d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad00d0b90 con 0x7faad00cda20 2024-04-25T09:54:51.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.170+0000 7faad804d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad015d7d0 con 0x7faad0099f30 2024-04-25T09:54:51.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.170+0000 7faad5de9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faad006bf10 0x7faad0160460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:51.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.170+0000 7faad5de9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faad006bf10 0x7faad0160460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52432/0 (socket says 172.21.15.7:52432) 2024-04-25T09:54:51.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.170+0000 7faad5de9640 1 -- 172.21.15.7:0/2864555755 learned_addr learned my addr 172.21.15.7:0/2864555755 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:51.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.170+0000 7faad65ea640 1 --2- 172.21.15.7:0/2864555755 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faad00cda20 0x7faad0161670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:51.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.170+0000 7faad5de9640 1 -- 172.21.15.7:0/2864555755 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faad0099f30 msgr2=0x7faad0156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:51.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.170+0000 7faad5de9640 1 --2- 172.21.15.7:0/2864555755 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faad0099f30 0x7faad0156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.170+0000 7faad5de9640 1 -- 172.21.15.7:0/2864555755 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faad00cda20 msgr2=0x7faad0161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:51.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.170+0000 7faad5de9640 1 --2- 172.21.15.7:0/2864555755 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faad00cda20 0x7faad0161670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.170+0000 7faad5de9640 1 -- 172.21.15.7:0/2864555755 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad01f6bf0 con 0x7faad006bf10 2024-04-25T09:54:51.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.170+0000 7faad65ea640 1 --2- 172.21.15.7:0/2864555755 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faad00cda20 0x7faad0161670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:51.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.170+0000 7faad5de9640 1 --2- 172.21.15.7:0/2864555755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faad006bf10 0x7faad0160460 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faacc00b3f0 tx=0x7faacc00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:51.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.170+0000 7faac67fc640 1 -- 172.21.15.7:0/2864555755 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc015020 con 0x7faad006bf10 2024-04-25T09:54:51.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.170+0000 7faac67fc640 1 -- 172.21.15.7:0/2864555755 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faacc011830 con 0x7faad006bf10 2024-04-25T09:54:51.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.170+0000 7faac67fc640 1 -- 172.21.15.7:0/2864555755 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc011c20 con 0x7faad006bf10 2024-04-25T09:54:51.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.170+0000 7faad804d640 1 -- 172.21.15.7:0/2864555755 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faad01f6ed0 con 0x7faad006bf10 2024-04-25T09:54:51.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.170+0000 7faad804d640 1 -- 172.21.15.7:0/2864555755 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad01f7490 con 0x7faad006bf10 2024-04-25T09:54:51.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.172+0000 7faad804d640 1 -- 172.21.15.7:0/2864555755 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad0068f60 con 0x7faad006bf10 2024-04-25T09:54:51.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.172+0000 7faac67fc640 1 -- 172.21.15.7:0/2864555755 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faacc018020 con 0x7faad006bf10 2024-04-25T09:54:51.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.172+0000 7faac67fc640 1 --2- 172.21.15.7:0/2864555755 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faab406b4d0 0x7faab406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:51.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.172+0000 7faac67fc640 1 -- 172.21.15.7:0/2864555755 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7faacc08a200 con 0x7faad006bf10 2024-04-25T09:54:51.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.173+0000 7faad55e8640 1 --2- 172.21.15.7:0/2864555755 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faab406b4d0 0x7faab406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:51.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.173+0000 7faad55e8640 1 --2- 172.21.15.7:0/2864555755 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faab406b4d0 0x7faab406d990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7faac0034000 tx=0x7faac002c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:51.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.177+0000 7faac67fc640 1 -- 172.21.15.7:0/2864555755 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faacc01f030 con 0x7faad006bf10 2024-04-25T09:54:51.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.356+0000 7faad804d640 1 -- 172.21.15.7:0/2864555755 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faad006e280 con 0x7faad006bf10 2024-04-25T09:54:51.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.357+0000 7faac67fc640 1 -- 172.21.15.7:0/2864555755 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7faacc0172c0 con 0x7faad006bf10 2024-04-25T09:54:51.360 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:54:51.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.359+0000 7faad804d640 1 -- 172.21.15.7:0/2864555755 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faab406b4d0 msgr2=0x7faab406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:51.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.359+0000 7faad804d640 1 --2- 172.21.15.7:0/2864555755 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faab406b4d0 0x7faab406d990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7faac0034000 tx=0x7faac002c000 comp rx=0 tx=0).stop 2024-04-25T09:54:51.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.359+0000 7faad804d640 1 -- 172.21.15.7:0/2864555755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faad006bf10 msgr2=0x7faad0160460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:51.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.359+0000 7faad804d640 1 --2- 172.21.15.7:0/2864555755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faad006bf10 0x7faad0160460 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faacc00b3f0 tx=0x7faacc00b8b0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.359+0000 7faad804d640 1 -- 172.21.15.7:0/2864555755 shutdown_connections 2024-04-25T09:54:51.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.359+0000 7faad804d640 1 --2- 172.21.15.7:0/2864555755 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faab406b4d0 0x7faab406d990 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.359+0000 7faad804d640 1 --2- 172.21.15.7:0/2864555755 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faad00cda20 0x7faad0161670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.359+0000 7faad804d640 1 --2- 172.21.15.7:0/2864555755 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faad0099f30 0x7faad0156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.359+0000 7faad804d640 1 --2- 172.21.15.7:0/2864555755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faad006bf10 0x7faad0160460 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.359+0000 7faad804d640 1 -- 172.21.15.7:0/2864555755 >> 172.21.15.7:0/2864555755 conn(0x7faad00b3110 msgr2=0x7faad00cf840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:51.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.359+0000 7faad804d640 1 -- 172.21.15.7:0/2864555755 shutdown_connections 2024-04-25T09:54:51.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.359+0000 7faad804d640 1 -- 172.21.15.7:0/2864555755 wait complete. 2024-04-25T09:54:51.372 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:54:51.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.473+0000 7fabe598b640 1 Processor -- start 2024-04-25T09:54:51.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.473+0000 7fabe598b640 1 -- start start 2024-04-25T09:54:51.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.474+0000 7fabe598b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fabe00ce830 0x7fabe015eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:51.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.474+0000 7fabe598b640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe00ced10 con 0x7fabe00d3760 2024-04-25T09:54:51.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.474+0000 7fabe598b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe00d1b40 con 0x7fabe015f1c0 2024-04-25T09:54:51.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.474+0000 7fabe598b640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe00ce380 con 0x7fabe00ce830 2024-04-25T09:54:51.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.474+0000 7fabdeffd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fabe00d3760 0x7fabe00d3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42060/0 (socket says 172.21.15.7:42060) 2024-04-25T09:54:51.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.474+0000 7fabdf7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fabe00ce830 0x7fabe015eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:51.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.474+0000 7fabdeffd640 1 -- 172.21.15.7:0/780894397 learned_addr learned my addr 172.21.15.7:0/780894397 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:51.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.474+0000 7fabdf7fe640 1 -- 172.21.15.7:0/780894397 >> v1:172.21.15.55:6789/0 conn(0x7fabe015f1c0 legacy=0x7fabe00b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:51.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.474+0000 7fabdf7fe640 1 -- 172.21.15.7:0/780894397 >> v1:172.21.15.7:6789/0 conn(0x7fabe00d3760 legacy=0x7fabe00d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:51.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.474+0000 7fabddffb640 1 -- 172.21.15.7:0/780894397 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1093071391 0 0) 0x7fabe00ced10 con 0x7fabe00d3760 2024-04-25T09:54:51.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.474+0000 7fabdf7fe640 1 -- 172.21.15.7:0/780894397 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe00d1e20 con 0x7fabe00ce830 2024-04-25T09:54:51.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.475+0000 7fabdf7fe640 1 --2- 172.21.15.7:0/780894397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabe00ce830 0x7fabe015eac0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fabd0009d90 tx=0x7fabd002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4dfa00b57c8be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:51.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.475+0000 7fabddffb640 1 -- 172.21.15.7:0/780894397 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd0007740 con 0x7fabe00ce830 2024-04-25T09:54:51.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.475+0000 7fabddffb640 1 -- 172.21.15.7:0/780894397 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd00078e0 con 0x7fabe00ce830 2024-04-25T09:54:51.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.475+0000 7fabddffb640 1 -- 172.21.15.7:0/780894397 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd0007cb0 con 0x7fabe00ce830 2024-04-25T09:54:51.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.476+0000 7fabe598b640 1 -- 172.21.15.7:0/780894397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabe00ce830 msgr2=0x7fabe015eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:51.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.476+0000 7fabe598b640 1 --2- 172.21.15.7:0/780894397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabe00ce830 0x7fabe015eac0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fabd0009d90 tx=0x7fabd002a6a0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.476+0000 7fabe598b640 1 -- 172.21.15.7:0/780894397 shutdown_connections 2024-04-25T09:54:51.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.476+0000 7fabe598b640 1 --2- 172.21.15.7:0/780894397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabe00ce830 0x7fabe015eac0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.476+0000 7fabe598b640 1 -- 172.21.15.7:0/780894397 >> 172.21.15.7:0/780894397 conn(0x7fabe0072680 msgr2=0x7fabe0072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:51.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.476+0000 7fabe598b640 1 -- 172.21.15.7:0/780894397 shutdown_connections 2024-04-25T09:54:51.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.476+0000 7fabe598b640 1 -- 172.21.15.7:0/780894397 wait complete. 2024-04-25T09:54:51.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.477+0000 7fabe598b640 1 Processor -- start 2024-04-25T09:54:51.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.477+0000 7fabe598b640 1 -- start start 2024-04-25T09:54:51.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.478+0000 7fabe598b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fabe00ce830 0x7fabe00c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:51.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.478+0000 7fabe598b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabe00d3760 0x7fabe015b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:51.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.478+0000 7fabe598b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabe015f1c0 0x7fabe01f68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:51.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.478+0000 7fabe598b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe00d2190 con 0x7fabe015f1c0 2024-04-25T09:54:51.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.478+0000 7fabe598b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe015f000 con 0x7fabe00d3760 2024-04-25T09:54:51.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.478+0000 7fabe598b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe00b2950 con 0x7fabe00ce830 2024-04-25T09:54:51.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.478+0000 7fabdf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabe015f1c0 0x7fabe01f68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:51.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.478+0000 7fabdf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabe015f1c0 0x7fabe01f68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52442/0 (socket says 172.21.15.7:52442) 2024-04-25T09:54:51.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.478+0000 7fabdf7fe640 1 -- 172.21.15.7:0/2151843075 learned_addr learned my addr 172.21.15.7:0/2151843075 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:51.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.478+0000 7fabde7fc640 1 --2- 172.21.15.7:0/2151843075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabe00d3760 0x7fabe015b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:51.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.478+0000 7fabdf7fe640 1 -- 172.21.15.7:0/2151843075 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fabe00ce830 msgr2=0x7fabe00c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:51.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.478+0000 7fabdeffd640 1 --2- 172.21.15.7:0/2151843075 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fabe00ce830 0x7fabe00c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:51.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.478+0000 7fabdf7fe640 1 --2- 172.21.15.7:0/2151843075 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fabe00ce830 0x7fabe00c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.478+0000 7fabdf7fe640 1 -- 172.21.15.7:0/2151843075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabe00d3760 msgr2=0x7fabe015b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:51.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.478+0000 7fabdf7fe640 1 --2- 172.21.15.7:0/2151843075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabe00d3760 0x7fabe015b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.478+0000 7fabdf7fe640 1 -- 172.21.15.7:0/2151843075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe00c8540 con 0x7fabe015f1c0 2024-04-25T09:54:51.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.478+0000 7fabde7fc640 1 --2- 172.21.15.7:0/2151843075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabe00d3760 0x7fabe015b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:51.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.479+0000 7fabdf7fe640 1 --2- 172.21.15.7:0/2151843075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabe015f1c0 0x7fabe01f68e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fabd0009d90 tx=0x7fabd0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:51.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.479+0000 7fabc7fff640 1 -- 172.21.15.7:0/2151843075 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd0040070 con 0x7fabe015f1c0 2024-04-25T09:54:51.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.479+0000 7fabc7fff640 1 -- 172.21.15.7:0/2151843075 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd0031c90 con 0x7fabe015f1c0 2024-04-25T09:54:51.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.479+0000 7fabe598b640 1 -- 172.21.15.7:0/2151843075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe00c8820 con 0x7fabe015f1c0 2024-04-25T09:54:51.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.479+0000 7fabc7fff640 1 -- 172.21.15.7:0/2151843075 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd003c640 con 0x7fabe015f1c0 2024-04-25T09:54:51.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.479+0000 7fabe598b640 1 -- 172.21.15.7:0/2151843075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe01f45c0 con 0x7fabe015f1c0 2024-04-25T09:54:51.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.480+0000 7fabe598b640 1 -- 172.21.15.7:0/2151843075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe00c8d40 con 0x7fabe015f1c0 2024-04-25T09:54:51.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.480+0000 7fabc7fff640 1 -- 172.21.15.7:0/2151843075 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fabd0039040 con 0x7fabe015f1c0 2024-04-25T09:54:51.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.481+0000 7fabc7fff640 1 --2- 172.21.15.7:0/2151843075 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fabcc06b4d0 0x7fabcc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:51.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.481+0000 7fabc7fff640 1 -- 172.21.15.7:0/2151843075 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fabd00abbe0 con 0x7fabe015f1c0 2024-04-25T09:54:51.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.481+0000 7fabdeffd640 1 --2- 172.21.15.7:0/2151843075 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fabcc06b4d0 0x7fabcc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:51.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.481+0000 7fabdeffd640 1 --2- 172.21.15.7:0/2151843075 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fabcc06b4d0 0x7fabcc06d990 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fabd8007fd0 tx=0x7fabd8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:51.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.485+0000 7fabc7fff640 1 -- 172.21.15.7:0/2151843075 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fabe00c8d40 con 0x7fabe015f1c0 2024-04-25T09:54:51.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.663+0000 7fabe598b640 1 -- 172.21.15.7:0/2151843075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fabe0068f60 con 0x7fabe015f1c0 2024-04-25T09:54:51.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.663+0000 7fabc7fff640 1 -- 172.21.15.7:0/2151843075 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fabd007a7e0 con 0x7fabe015f1c0 2024-04-25T09:54:51.666 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T09:54:51.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.665+0000 7fabe598b640 1 -- 172.21.15.7:0/2151843075 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fabcc06b4d0 msgr2=0x7fabcc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:51.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.665+0000 7fabe598b640 1 --2- 172.21.15.7:0/2151843075 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fabcc06b4d0 0x7fabcc06d990 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fabd8007fd0 tx=0x7fabd8009040 comp rx=0 tx=0).stop 2024-04-25T09:54:51.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.665+0000 7fabe598b640 1 -- 172.21.15.7:0/2151843075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabe015f1c0 msgr2=0x7fabe01f68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:51.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.665+0000 7fabe598b640 1 --2- 172.21.15.7:0/2151843075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabe015f1c0 0x7fabe01f68e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fabd0009d90 tx=0x7fabd0004a40 comp rx=0 tx=0).stop 2024-04-25T09:54:51.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.665+0000 7fabe598b640 1 -- 172.21.15.7:0/2151843075 shutdown_connections 2024-04-25T09:54:51.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.665+0000 7fabe598b640 1 --2- 172.21.15.7:0/2151843075 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fabcc06b4d0 0x7fabcc06d990 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.665+0000 7fabe598b640 1 --2- 172.21.15.7:0/2151843075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabe015f1c0 0x7fabe01f68e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.665+0000 7fabe598b640 1 --2- 172.21.15.7:0/2151843075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabe00d3760 0x7fabe015b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.665+0000 7fabe598b640 1 --2- 172.21.15.7:0/2151843075 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fabe00ce830 0x7fabe00c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.665+0000 7fabe598b640 1 -- 172.21.15.7:0/2151843075 >> 172.21.15.7:0/2151843075 conn(0x7fabe0072680 msgr2=0x7fabe0073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:51.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.665+0000 7fabe598b640 1 -- 172.21.15.7:0/2151843075 shutdown_connections 2024-04-25T09:54:51.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.665+0000 7fabe598b640 1 -- 172.21.15.7:0/2151843075 wait complete. 2024-04-25T09:54:51.679 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:54:51.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.780+0000 7fede7742640 1 Processor -- start 2024-04-25T09:54:51.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.780+0000 7fede7742640 1 -- start start 2024-04-25T09:54:51.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.781+0000 7fede7742640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fede00d3760 0x7fede015eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:51.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.781+0000 7fede7742640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fede00ce830 0x7fede00b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:51.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.781+0000 7fede7742640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fede00ced10 con 0x7fede015f1c0 2024-04-25T09:54:51.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.781+0000 7fede7742640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fede00ce380 con 0x7fede00d3760 2024-04-25T09:54:51.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.781+0000 7fede7742640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fede015f000 con 0x7fede00ce830 2024-04-25T09:54:51.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.781+0000 7fede54de640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fede00d3760 0x7fede015eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:51.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.781+0000 7fede4cdd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fede015f1c0 0x7fede00d3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42062/0 (socket says 172.21.15.7:42062) 2024-04-25T09:54:51.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.781+0000 7fede4cdd640 1 -- 172.21.15.7:0/1833539852 learned_addr learned my addr 172.21.15.7:0/1833539852 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:51.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.781+0000 7fede5cdf640 1 --2- 172.21.15.7:0/1833539852 >> v2:172.21.15.55:3300/0 conn(0x7fede00ce830 0x7fede00b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:51.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.781+0000 7fedd7fff640 1 -- 172.21.15.7:0/1833539852 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 661217345 0 0) 0x7fede00ced10 con 0x7fede015f1c0 2024-04-25T09:54:51.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.781+0000 7fedd7fff640 1 -- 172.21.15.7:0/1833539852 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedcc003520 con 0x7fede015f1c0 2024-04-25T09:54:51.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.781+0000 7fede54de640 1 -- 172.21.15.7:0/1833539852 >> v2:172.21.15.55:3300/0 conn(0x7fede00ce830 msgr2=0x7fede00b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:51.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.781+0000 7fede54de640 1 --2- 172.21.15.7:0/1833539852 >> v2:172.21.15.55:3300/0 conn(0x7fede00ce830 0x7fede00b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.781+0000 7fede54de640 1 -- 172.21.15.7:0/1833539852 >> v1:172.21.15.7:6789/0 conn(0x7fede015f1c0 legacy=0x7fede00d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:51.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.781+0000 7fede54de640 1 -- 172.21.15.7:0/1833539852 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede00d1b40 con 0x7fede00d3760 2024-04-25T09:54:51.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.782+0000 7fede54de640 1 --2- 172.21.15.7:0/1833539852 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fede00d3760 0x7fede015eac0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fede00cf180 tx=0x7feddc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45192fe3dd033c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:51.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.782+0000 7fedd7fff640 1 -- 172.21.15.7:0/1833539852 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc037070 con 0x7fede00d3760 2024-04-25T09:54:51.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.782+0000 7fedd7fff640 1 -- 172.21.15.7:0/1833539852 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feddc032440 con 0x7fede00d3760 2024-04-25T09:54:51.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.782+0000 7fedd7fff640 1 -- 172.21.15.7:0/1833539852 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc032810 con 0x7fede00d3760 2024-04-25T09:54:51.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.783+0000 7fede7742640 1 -- 172.21.15.7:0/1833539852 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fede00d3760 msgr2=0x7fede015eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:51.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.783+0000 7fede7742640 1 --2- 172.21.15.7:0/1833539852 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fede00d3760 0x7fede015eac0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fede00cf180 tx=0x7feddc02a1a0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.783+0000 7fede7742640 1 -- 172.21.15.7:0/1833539852 shutdown_connections 2024-04-25T09:54:51.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.783+0000 7fede7742640 1 --2- 172.21.15.7:0/1833539852 >> v2:172.21.15.55:3300/0 conn(0x7fede00ce830 0x7fede00b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.783+0000 7fede7742640 1 --2- 172.21.15.7:0/1833539852 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fede00d3760 0x7fede015eac0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.783+0000 7fede7742640 1 -- 172.21.15.7:0/1833539852 >> 172.21.15.7:0/1833539852 conn(0x7fede0072680 msgr2=0x7fede0072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:51.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.783+0000 7fede7742640 1 -- 172.21.15.7:0/1833539852 shutdown_connections 2024-04-25T09:54:51.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.783+0000 7fede7742640 1 -- 172.21.15.7:0/1833539852 wait complete. 2024-04-25T09:54:51.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.784+0000 7fede7742640 1 Processor -- start 2024-04-25T09:54:51.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.784+0000 7fede7742640 1 -- start start 2024-04-25T09:54:51.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.785+0000 7fede7742640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fede00ce830 0x7fede014edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:51.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.785+0000 7fede7742640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fede00d3760 0x7fede00b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:51.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.785+0000 7fede7742640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fede015f1c0 0x7fede015a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:51.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.785+0000 7fede7742640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede015de10 con 0x7fede00d3760 2024-04-25T09:54:51.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.785+0000 7fede7742640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede00d2190 con 0x7fede015f1c0 2024-04-25T09:54:51.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.785+0000 7fede7742640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede00b2780 con 0x7fede00ce830 2024-04-25T09:54:51.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.785+0000 7fede4cdd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fede00d3760 0x7fede00b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:51.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.785+0000 7fede4cdd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fede00d3760 0x7fede00b3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52462/0 (socket says 172.21.15.7:52462) 2024-04-25T09:54:51.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.785+0000 7fede4cdd640 1 -- 172.21.15.7:0/775408188 learned_addr learned my addr 172.21.15.7:0/775408188 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:51.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.785+0000 7fede5cdf640 1 --2- 172.21.15.7:0/775408188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fede015f1c0 0x7fede015a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:51.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.785+0000 7fede4cdd640 1 -- 172.21.15.7:0/775408188 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fede00ce830 msgr2=0x7fede014edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:51.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.785+0000 7fede4cdd640 1 --2- 172.21.15.7:0/775408188 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fede00ce830 0x7fede014edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.785+0000 7fede4cdd640 1 -- 172.21.15.7:0/775408188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fede015f1c0 msgr2=0x7fede015a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:51.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.785+0000 7fede4cdd640 1 --2- 172.21.15.7:0/775408188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fede015f1c0 0x7fede015a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.785+0000 7fede4cdd640 1 -- 172.21.15.7:0/775408188 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede0159000 con 0x7fede00d3760 2024-04-25T09:54:51.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.785+0000 7fede4cdd640 1 --2- 172.21.15.7:0/775408188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fede00d3760 0x7fede00b3c40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fedd0001eb0 tx=0x7fedd000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:51.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.785+0000 7fedd5ffb640 1 -- 172.21.15.7:0/775408188 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd0017070 con 0x7fede00d3760 2024-04-25T09:54:51.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.785+0000 7fedd5ffb640 1 -- 172.21.15.7:0/775408188 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd0005d00 con 0x7fede00d3760 2024-04-25T09:54:51.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.786+0000 7fede7742640 1 -- 172.21.15.7:0/775408188 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede01592e0 con 0x7fede00d3760 2024-04-25T09:54:51.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.786+0000 7fedd5ffb640 1 -- 172.21.15.7:0/775408188 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd0007310 con 0x7fede00d3760 2024-04-25T09:54:51.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.786+0000 7fede7742640 1 -- 172.21.15.7:0/775408188 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede01598a0 con 0x7fede00d3760 2024-04-25T09:54:51.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.787+0000 7fede7742640 1 -- 172.21.15.7:0/775408188 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede0068f60 con 0x7fede00d3760 2024-04-25T09:54:51.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.787+0000 7fedd5ffb640 1 -- 172.21.15.7:0/775408188 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fedd001a070 con 0x7fede00d3760 2024-04-25T09:54:51.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.788+0000 7fedd5ffb640 1 --2- 172.21.15.7:0/775408188 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fedc406b4d0 0x7fedc406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:51.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.788+0000 7fedd5ffb640 1 -- 172.21.15.7:0/775408188 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fedd0089880 con 0x7fede00d3760 2024-04-25T09:54:51.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.788+0000 7fede54de640 1 --2- 172.21.15.7:0/775408188 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fedc406b4d0 0x7fedc406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:51.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.788+0000 7fede54de640 1 --2- 172.21.15.7:0/775408188 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fedc406b4d0 0x7fedc406d990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7feddc034000 tx=0x7feddc02c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:51.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.792+0000 7fedd5ffb640 1 -- 172.21.15.7:0/775408188 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fedd0058450 con 0x7fede00d3760 2024-04-25T09:54:51.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.970+0000 7fede7742640 1 -- 172.21.15.7:0/775408188 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fede00ce610 con 0x7fede00d3760 2024-04-25T09:54:51.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.971+0000 7fedd5ffb640 1 -- 172.21.15.7:0/775408188 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fedd0057d50 con 0x7fede00d3760 2024-04-25T09:54:51.974 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:54:51.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.973+0000 7fede7742640 1 -- 172.21.15.7:0/775408188 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fedc406b4d0 msgr2=0x7fedc406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:51.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.973+0000 7fede7742640 1 --2- 172.21.15.7:0/775408188 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fedc406b4d0 0x7fedc406d990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7feddc034000 tx=0x7feddc02c000 comp rx=0 tx=0).stop 2024-04-25T09:54:51.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.973+0000 7fede7742640 1 -- 172.21.15.7:0/775408188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fede00d3760 msgr2=0x7fede00b3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:51.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.973+0000 7fede7742640 1 --2- 172.21.15.7:0/775408188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fede00d3760 0x7fede00b3c40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fedd0001eb0 tx=0x7fedd000c820 comp rx=0 tx=0).stop 2024-04-25T09:54:51.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.973+0000 7fede7742640 1 -- 172.21.15.7:0/775408188 shutdown_connections 2024-04-25T09:54:51.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.973+0000 7fede7742640 1 --2- 172.21.15.7:0/775408188 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fedc406b4d0 0x7fedc406d990 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.973+0000 7fede7742640 1 --2- 172.21.15.7:0/775408188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fede015f1c0 0x7fede015a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.973+0000 7fede7742640 1 --2- 172.21.15.7:0/775408188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fede00d3760 0x7fede00b3c40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.973+0000 7fede7742640 1 --2- 172.21.15.7:0/775408188 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fede00ce830 0x7fede014edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:51.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.973+0000 7fede7742640 1 -- 172.21.15.7:0/775408188 >> 172.21.15.7:0/775408188 conn(0x7fede0072680 msgr2=0x7fede00c92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:51.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.973+0000 7fede7742640 1 -- 172.21.15.7:0/775408188 shutdown_connections 2024-04-25T09:54:51.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:51.973+0000 7fede7742640 1 -- 172.21.15.7:0/775408188 wait complete. 2024-04-25T09:54:51.986 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:54:52.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.084+0000 7f19df6b3640 1 Processor -- start 2024-04-25T09:54:52.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.084+0000 7f19df6b3640 1 -- start start 2024-04-25T09:54:52.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.085+0000 7f19df6b3640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f19d815dd00 0x7f19d80b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:52.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.085+0000 7f19df6b3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f19d806c6c0 0x7f19d80b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:52.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.085+0000 7f19df6b3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19d806cd00 con 0x7f19d80b6a40 2024-04-25T09:54:52.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.085+0000 7f19df6b3640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d815e0e0 con 0x7f19d815dd00 2024-04-25T09:54:52.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.085+0000 7f19df6b3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d806cfe0 con 0x7f19d806c6c0 2024-04-25T09:54:52.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.085+0000 7f19dd44f640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f19d815dd00 0x7f19d80b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:52.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.085+0000 7f19dd44f640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f19d815dd00 0x7f19d80b5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52478/0 (socket says 172.21.15.7:52478) 2024-04-25T09:54:52.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.085+0000 7f19dd44f640 1 -- 172.21.15.7:0/3920719354 learned_addr learned my addr 172.21.15.7:0/3920719354 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:52.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.085+0000 7f19ddc50640 1 --2- 172.21.15.7:0/3920719354 >> v2:172.21.15.55:3300/0 conn(0x7f19d806c6c0 0x7f19d80b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:52.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.085+0000 7f19dd44f640 1 -- 172.21.15.7:0/3920719354 >> v2:172.21.15.55:3300/0 conn(0x7f19d806c6c0 msgr2=0x7f19d80b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:52.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.085+0000 7f19dd44f640 1 --2- 172.21.15.7:0/3920719354 >> v2:172.21.15.55:3300/0 conn(0x7f19d806c6c0 0x7f19d80b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:52.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.085+0000 7f19dd44f640 1 -- 172.21.15.7:0/3920719354 >> v1:172.21.15.55:6789/0 conn(0x7f19d80b6a40 legacy=0x7f19d806bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:52.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.085+0000 7f19dd44f640 1 -- 172.21.15.7:0/3920719354 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d80d1ca0 con 0x7f19d815dd00 2024-04-25T09:54:52.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.086+0000 7f19dd44f640 1 --2- 172.21.15.7:0/3920719354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19d815dd00 0x7f19d80b5750 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f19d80d0270 tx=0x7f19d402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7be97e204d34695 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:52.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.086+0000 7f19cffff640 1 -- 172.21.15.7:0/3920719354 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d4037070 con 0x7f19d815dd00 2024-04-25T09:54:52.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.086+0000 7f19cffff640 1 -- 172.21.15.7:0/3920719354 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d4032440 con 0x7f19d815dd00 2024-04-25T09:54:52.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.086+0000 7f19cffff640 1 -- 172.21.15.7:0/3920719354 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d4032810 con 0x7f19d815dd00 2024-04-25T09:54:52.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.087+0000 7f19df6b3640 1 -- 172.21.15.7:0/3920719354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19d815dd00 msgr2=0x7f19d80b5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:52.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.087+0000 7f19df6b3640 1 --2- 172.21.15.7:0/3920719354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19d815dd00 0x7f19d80b5750 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f19d80d0270 tx=0x7f19d402a2c0 comp rx=0 tx=0).stop 2024-04-25T09:54:52.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.087+0000 7f19df6b3640 1 -- 172.21.15.7:0/3920719354 shutdown_connections 2024-04-25T09:54:52.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.087+0000 7f19df6b3640 1 --2- 172.21.15.7:0/3920719354 >> v2:172.21.15.55:3300/0 conn(0x7f19d806c6c0 0x7f19d80b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:52.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.087+0000 7f19df6b3640 1 --2- 172.21.15.7:0/3920719354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19d815dd00 0x7f19d80b5750 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:52.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.087+0000 7f19df6b3640 1 -- 172.21.15.7:0/3920719354 >> 172.21.15.7:0/3920719354 conn(0x7f19d80d07b0 msgr2=0x7f19d80d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:52.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.087+0000 7f19df6b3640 1 -- 172.21.15.7:0/3920719354 shutdown_connections 2024-04-25T09:54:52.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.087+0000 7f19df6b3640 1 -- 172.21.15.7:0/3920719354 wait complete. 2024-04-25T09:54:52.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.088+0000 7f19df6b3640 1 Processor -- start 2024-04-25T09:54:52.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.088+0000 7f19df6b3640 1 -- start start 2024-04-25T09:54:52.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.089+0000 7f19df6b3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19d806c6c0 0x7f19d80c9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:52.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.089+0000 7f19df6b3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19d80b6a40 0x7f19d80cd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:52.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.089+0000 7f19df6b3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19d815dd00 0x7f19d80ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:52.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.089+0000 7f19df6b3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d80d2780 con 0x7f19d80b6a40 2024-04-25T09:54:52.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.089+0000 7f19df6b3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d80d2260 con 0x7f19d806c6c0 2024-04-25T09:54:52.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.089+0000 7f19df6b3640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d80d2900 con 0x7f19d815dd00 2024-04-25T09:54:52.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.089+0000 7f19dcc4e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19d80b6a40 0x7f19d80cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:52.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.089+0000 7f19dcc4e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19d80b6a40 0x7f19d80cd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52484/0 (socket says 172.21.15.7:52484) 2024-04-25T09:54:52.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.089+0000 7f19dcc4e640 1 -- 172.21.15.7:0/963482649 learned_addr learned my addr 172.21.15.7:0/963482649 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:52.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.089+0000 7f19dd44f640 1 --2- 172.21.15.7:0/963482649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19d806c6c0 0x7f19d80c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:52.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.089+0000 7f19ddc50640 1 --2- 172.21.15.7:0/963482649 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19d815dd00 0x7f19d80ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:52.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.089+0000 7f19dcc4e640 1 -- 172.21.15.7:0/963482649 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19d815dd00 msgr2=0x7f19d80ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:52.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.089+0000 7f19dcc4e640 1 --2- 172.21.15.7:0/963482649 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19d815dd00 0x7f19d80ca9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:52.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.089+0000 7f19dcc4e640 1 -- 172.21.15.7:0/963482649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19d806c6c0 msgr2=0x7f19d80c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:52.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.089+0000 7f19dcc4e640 1 --2- 172.21.15.7:0/963482649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19d806c6c0 0x7f19d80c9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:52.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.089+0000 7f19dcc4e640 1 -- 172.21.15.7:0/963482649 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d814d7e0 con 0x7f19d80b6a40 2024-04-25T09:54:52.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.089+0000 7f19dcc4e640 1 --2- 172.21.15.7:0/963482649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19d80b6a40 0x7f19d80cd170 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f19c800c430 tx=0x7f19c800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:52.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.089+0000 7f19cdffb640 1 -- 172.21.15.7:0/963482649 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c8011790 con 0x7f19d80b6a40 2024-04-25T09:54:52.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.089+0000 7f19cdffb640 1 -- 172.21.15.7:0/963482649 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c8017070 con 0x7f19d80b6a40 2024-04-25T09:54:52.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.089+0000 7f19df6b3640 1 -- 172.21.15.7:0/963482649 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d814cc60 con 0x7f19d80b6a40 2024-04-25T09:54:52.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.089+0000 7f19cdffb640 1 -- 172.21.15.7:0/963482649 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c8011bb0 con 0x7f19d80b6a40 2024-04-25T09:54:52.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.090+0000 7f19df6b3640 1 -- 172.21.15.7:0/963482649 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d814d220 con 0x7f19d80b6a40 2024-04-25T09:54:52.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.091+0000 7f19df6b3640 1 -- 172.21.15.7:0/963482649 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d8068fd0 con 0x7f19d80b6a40 2024-04-25T09:54:52.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.091+0000 7f19cdffb640 1 -- 172.21.15.7:0/963482649 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f19c801c460 con 0x7f19d80b6a40 2024-04-25T09:54:52.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.091+0000 7f19cdffb640 1 --2- 172.21.15.7:0/963482649 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f19bc06b4d0 0x7f19bc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:52.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.091+0000 7f19cdffb640 1 -- 172.21.15.7:0/963482649 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f19c808a370 con 0x7f19d80b6a40 2024-04-25T09:54:52.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.092+0000 7f19dd44f640 1 --2- 172.21.15.7:0/963482649 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f19bc06b4d0 0x7f19bc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:52.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.092+0000 7f19dd44f640 1 --2- 172.21.15.7:0/963482649 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f19bc06b4d0 0x7f19bc06d990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f19d4034000 tx=0x7f19d402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:52.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.096+0000 7f19cdffb640 1 -- 172.21.15.7:0/963482649 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f19c8058f40 con 0x7f19d80b6a40 2024-04-25T09:54:52.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.314+0000 7f19df6b3640 1 -- 172.21.15.7:0/963482649 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19d815eae0 con 0x7f19d80b6a40 2024-04-25T09:54:52.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.315+0000 7f19cdffb640 1 -- 172.21.15.7:0/963482649 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4928 (secure 0 0 0) 0x7f19c8058840 con 0x7f19d80b6a40 2024-04-25T09:54:52.317 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:52.318 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1968579214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1968579214},{"type":"v1","addr":"172.21.15.7:6837","nonce":1968579214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3479570567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3479570567},{"type":"v1","addr":"172.21.15.55:6834","nonce":3479570567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/2289657027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2289657027},{"type":"v1","addr":"172.21.15.7:6836","nonce":2289657027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:54:27.558601+0000","modified":"2024-04-25T09:54:43.635854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/3779228372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3779228372},{"type":"v1","addr":"172.21.15.55:6835","nonce":3779228372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:54:52.318 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 8 2024-04-25T09:54:52.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.317+0000 7f19df6b3640 1 -- 172.21.15.7:0/963482649 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f19bc06b4d0 msgr2=0x7f19bc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:52.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.317+0000 7f19df6b3640 1 --2- 172.21.15.7:0/963482649 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f19bc06b4d0 0x7f19bc06d990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f19d4034000 tx=0x7f19d402e000 comp rx=0 tx=0).stop 2024-04-25T09:54:52.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.317+0000 7f19df6b3640 1 -- 172.21.15.7:0/963482649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19d80b6a40 msgr2=0x7f19d80cd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:52.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.317+0000 7f19df6b3640 1 --2- 172.21.15.7:0/963482649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19d80b6a40 0x7f19d80cd170 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f19c800c430 tx=0x7f19c800c8f0 comp rx=0 tx=0).stop 2024-04-25T09:54:52.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.317+0000 7f19df6b3640 1 -- 172.21.15.7:0/963482649 shutdown_connections 2024-04-25T09:54:52.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.317+0000 7f19df6b3640 1 --2- 172.21.15.7:0/963482649 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f19bc06b4d0 0x7f19bc06d990 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:52.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.317+0000 7f19df6b3640 1 --2- 172.21.15.7:0/963482649 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19d815dd00 0x7f19d80ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:52.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.317+0000 7f19df6b3640 1 --2- 172.21.15.7:0/963482649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19d80b6a40 0x7f19d80cd170 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:52.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.317+0000 7f19df6b3640 1 --2- 172.21.15.7:0/963482649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19d806c6c0 0x7f19d80c9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:52.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.317+0000 7f19df6b3640 1 -- 172.21.15.7:0/963482649 >> 172.21.15.7:0/963482649 conn(0x7f19d80d07b0 msgr2=0x7f19d80b7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:52.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.317+0000 7f19df6b3640 1 -- 172.21.15.7:0/963482649 shutdown_connections 2024-04-25T09:54:52.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.317+0000 7f19df6b3640 1 -- 172.21.15.7:0/963482649 wait complete. 2024-04-25T09:54:52.331 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:54:52.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.428+0000 7f81198cb640 1 Processor -- start 2024-04-25T09:54:52.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.428+0000 7f81198cb640 1 -- start start 2024-04-25T09:54:52.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.429+0000 7f81198cb640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f81140ceae0 0x7f8114168950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:52.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.429+0000 7f81198cb640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f811406c510 con 0x7f811406c130 2024-04-25T09:54:52.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.429+0000 7f81198cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f811415e170 con 0x7f8114066ee0 2024-04-25T09:54:52.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.429+0000 7f81198cb640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81140ce0d0 con 0x7f81140ceae0 2024-04-25T09:54:52.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.429+0000 7f81137fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f81140ceae0 0x7f8114168950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:52.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.429+0000 7f8112ffd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f811406c130 0x7f81140cd9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42066/0 (socket says 172.21.15.7:42066) 2024-04-25T09:54:52.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.429+0000 7f8112ffd640 1 -- 172.21.15.7:0/1474533484 learned_addr learned my addr 172.21.15.7:0/1474533484 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:52.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.430+0000 7f81137fe640 1 -- 172.21.15.7:0/1474533484 >> v1:172.21.15.55:6789/0 conn(0x7f8114066ee0 legacy=0x7f81140ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:52.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.430+0000 7f81137fe640 1 -- 172.21.15.7:0/1474533484 >> v1:172.21.15.7:6789/0 conn(0x7f811406c130 legacy=0x7f81140cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:52.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.430+0000 7f81137fe640 1 -- 172.21.15.7:0/1474533484 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811415e450 con 0x7f81140ceae0 2024-04-25T09:54:52.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.430+0000 7f8111ffb640 1 -- 172.21.15.7:0/1474533484 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 443276414 0 0) 0x7f811406c510 con 0x7f811406c130 2024-04-25T09:54:52.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.430+0000 7f81137fe640 1 --2- 172.21.15.7:0/1474533484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81140ceae0 0x7f8114168950 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8104009d90 tx=0x7f810402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed60f37e3aa3a20c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:52.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.430+0000 7f8111ffb640 1 -- 172.21.15.7:0/1474533484 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8104031600 con 0x7f81140ceae0 2024-04-25T09:54:52.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.430+0000 7f8111ffb640 1 -- 172.21.15.7:0/1474533484 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81040317a0 con 0x7f81140ceae0 2024-04-25T09:54:52.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.430+0000 7f8111ffb640 1 -- 172.21.15.7:0/1474533484 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8104031b70 con 0x7f81140ceae0 2024-04-25T09:54:52.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.431+0000 7f81198cb640 1 -- 172.21.15.7:0/1474533484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81140ceae0 msgr2=0x7f8114168950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:52.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.431+0000 7f81198cb640 1 --2- 172.21.15.7:0/1474533484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81140ceae0 0x7f8114168950 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8104009d90 tx=0x7f810402a610 comp rx=0 tx=0).stop 2024-04-25T09:54:52.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.431+0000 7f81198cb640 1 -- 172.21.15.7:0/1474533484 shutdown_connections 2024-04-25T09:54:52.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.431+0000 7f81198cb640 1 --2- 172.21.15.7:0/1474533484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81140ceae0 0x7f8114168950 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:52.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.431+0000 7f81198cb640 1 -- 172.21.15.7:0/1474533484 >> 172.21.15.7:0/1474533484 conn(0x7f8114071ac0 msgr2=0x7f8114071ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:52.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.431+0000 7f81198cb640 1 -- 172.21.15.7:0/1474533484 shutdown_connections 2024-04-25T09:54:52.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.431+0000 7f81198cb640 1 -- 172.21.15.7:0/1474533484 wait complete. 2024-04-25T09:54:52.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.432+0000 7f81198cb640 1 Processor -- start 2024-04-25T09:54:52.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.432+0000 7f81198cb640 1 -- start start 2024-04-25T09:54:52.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.433+0000 7f81198cb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8114066ee0 0x7f8114150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:52.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.433+0000 7f81198cb640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f811406c130 0x7f81141f3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:52.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.433+0000 7f81198cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81140ceae0 0x7f81140b5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:52.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.433+0000 7f81198cb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81140cb550 con 0x7f8114066ee0 2024-04-25T09:54:52.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.433+0000 7f81198cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811415ea10 con 0x7f81140ceae0 2024-04-25T09:54:52.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.433+0000 7f81198cb640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81140cb6d0 con 0x7f811406c130 2024-04-25T09:54:52.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.433+0000 7f8112ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8114066ee0 0x7f8114150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:52.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.433+0000 7f8112ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8114066ee0 0x7f8114150aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52490/0 (socket says 172.21.15.7:52490) 2024-04-25T09:54:52.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.433+0000 7f8112ffd640 1 -- 172.21.15.7:0/1570997982 learned_addr learned my addr 172.21.15.7:0/1570997982 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:52.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.433+0000 7f81137fe640 1 --2- 172.21.15.7:0/1570997982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81140ceae0 0x7f81140b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:52.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.433+0000 7f81127fc640 1 --2- 172.21.15.7:0/1570997982 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f811406c130 0x7f81141f3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:52.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.433+0000 7f8112ffd640 1 -- 172.21.15.7:0/1570997982 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f811406c130 msgr2=0x7f81141f3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:52.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.433+0000 7f8112ffd640 1 --2- 172.21.15.7:0/1570997982 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f811406c130 0x7f81141f3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:52.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.433+0000 7f8112ffd640 1 -- 172.21.15.7:0/1570997982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81140ceae0 msgr2=0x7f81140b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:52.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.433+0000 7f8112ffd640 1 --2- 172.21.15.7:0/1570997982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81140ceae0 0x7f81140b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:52.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.433+0000 7f8112ffd640 1 -- 172.21.15.7:0/1570997982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81140b34d0 con 0x7f8114066ee0 2024-04-25T09:54:52.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.433+0000 7f81137fe640 1 --2- 172.21.15.7:0/1570997982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81140ceae0 0x7f81140b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:52.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.434+0000 7f8112ffd640 1 --2- 172.21.15.7:0/1570997982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8114066ee0 0x7f8114150aa0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f810c00c4d0 tx=0x7f810c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:52.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.434+0000 7f80fbfff640 1 -- 172.21.15.7:0/1570997982 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c018070 con 0x7f8114066ee0 2024-04-25T09:54:52.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.434+0000 7f80fbfff640 1 -- 172.21.15.7:0/1570997982 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810c007500 con 0x7f8114066ee0 2024-04-25T09:54:52.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.434+0000 7f81198cb640 1 -- 172.21.15.7:0/1570997982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81140b37b0 con 0x7f8114066ee0 2024-04-25T09:54:52.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.434+0000 7f80fbfff640 1 -- 172.21.15.7:0/1570997982 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c004a20 con 0x7f8114066ee0 2024-04-25T09:54:52.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.434+0000 7f81198cb640 1 -- 172.21.15.7:0/1570997982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811406dce0 con 0x7f8114066ee0 2024-04-25T09:54:52.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.435+0000 7f81198cb640 1 -- 172.21.15.7:0/1570997982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8114068fd0 con 0x7f8114066ee0 2024-04-25T09:54:52.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.435+0000 7f80fbfff640 1 -- 172.21.15.7:0/1570997982 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f810c01b070 con 0x7f8114066ee0 2024-04-25T09:54:52.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.436+0000 7f80fbfff640 1 --2- 172.21.15.7:0/1570997982 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f810006b4d0 0x7f810006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:52.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.436+0000 7f80fbfff640 1 -- 172.21.15.7:0/1570997982 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f810c089940 con 0x7f8114066ee0 2024-04-25T09:54:52.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.436+0000 7f81127fc640 1 --2- 172.21.15.7:0/1570997982 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f810006b4d0 0x7f810006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:52.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.436+0000 7f81127fc640 1 --2- 172.21.15.7:0/1570997982 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f810006b4d0 0x7f810006d990 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f81140c92c0 tx=0x7f8108009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:52.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.440+0000 7f80fbfff640 1 -- 172.21.15.7:0/1570997982 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f810c0583e0 con 0x7f8114066ee0 2024-04-25T09:54:52.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.621+0000 7f81198cb640 1 -- 172.21.15.7:0/1570997982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8114072d10 con 0x7f8114066ee0 2024-04-25T09:54:52.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.622+0000 7f80fbfff640 1 -- 172.21.15.7:0/1570997982 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18418 (secure 0 0 0) 0x7f810c057ce0 con 0x7f8114066ee0 2024-04-25T09:54:52.625 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:52.625 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:54:32.606761+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:54:26.011833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:54:26.535536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:54:30.264996+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:54:52.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.624+0000 7f81198cb640 1 -- 172.21.15.7:0/1570997982 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f810006b4d0 msgr2=0x7f810006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:52.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.624+0000 7f81198cb640 1 --2- 172.21.15.7:0/1570997982 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f810006b4d0 0x7f810006d990 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f81140c92c0 tx=0x7f8108009040 comp rx=0 tx=0).stop 2024-04-25T09:54:52.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.624+0000 7f81198cb640 1 -- 172.21.15.7:0/1570997982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8114066ee0 msgr2=0x7f8114150aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:52.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.624+0000 7f81198cb640 1 --2- 172.21.15.7:0/1570997982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8114066ee0 0x7f8114150aa0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f810c00c4d0 tx=0x7f810c00c990 comp rx=0 tx=0).stop 2024-04-25T09:54:52.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.624+0000 7f81198cb640 1 -- 172.21.15.7:0/1570997982 shutdown_connections 2024-04-25T09:54:52.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.624+0000 7f81198cb640 1 --2- 172.21.15.7:0/1570997982 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f810006b4d0 0x7f810006d990 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:52.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.624+0000 7f81198cb640 1 --2- 172.21.15.7:0/1570997982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81140ceae0 0x7f81140b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:52.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.624+0000 7f81198cb640 1 --2- 172.21.15.7:0/1570997982 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f811406c130 0x7f81141f3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:52.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.624+0000 7f81198cb640 1 --2- 172.21.15.7:0/1570997982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8114066ee0 0x7f8114150aa0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:52.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.624+0000 7f81198cb640 1 -- 172.21.15.7:0/1570997982 >> 172.21.15.7:0/1570997982 conn(0x7f8114071ac0 msgr2=0x7f8114153ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:52.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.624+0000 7f81198cb640 1 -- 172.21.15.7:0/1570997982 shutdown_connections 2024-04-25T09:54:52.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.624+0000 7f81198cb640 1 -- 172.21.15.7:0/1570997982 wait complete. 2024-04-25T09:54:52.638 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:54:26.011833+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:54:26.535536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:54:30.264996+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:54:52.639 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:54:52.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.739+0000 7f0d53cee640 1 Processor -- start 2024-04-25T09:54:52.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.739+0000 7f0d53cee640 1 -- start start 2024-04-25T09:54:52.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.740+0000 7f0d53cee640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0d4c15f1c0 0x7f0d4c15eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:52.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.740+0000 7f0d53cee640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d4c0ced10 con 0x7f0d4c0d3760 2024-04-25T09:54:52.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.740+0000 7f0d53cee640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d4c0d1b40 con 0x7f0d4c0ce830 2024-04-25T09:54:52.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.740+0000 7f0d53cee640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4c0ce380 con 0x7f0d4c15f1c0 2024-04-25T09:54:52.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.740+0000 7f0d51a8a640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0d4c0d3760 0x7f0d4c0d3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42076/0 (socket says 172.21.15.7:42076) 2024-04-25T09:54:52.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.740+0000 7f0d51a8a640 1 -- 172.21.15.7:0/690860545 learned_addr learned my addr 172.21.15.7:0/690860545 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:52.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.740+0000 7f0d51289640 1 --2- 172.21.15.7:0/690860545 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0d4c15f1c0 0x7f0d4c15eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:52.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.741+0000 7f0d50a88640 1 -- 172.21.15.7:0/690860545 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 607372600 0 0) 0x7f0d4c0ced10 con 0x7f0d4c0d3760 2024-04-25T09:54:52.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.741+0000 7f0d50a88640 1 -- 172.21.15.7:0/690860545 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d34003520 con 0x7f0d4c0d3760 2024-04-25T09:54:52.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.741+0000 7f0d50a88640 1 -- 172.21.15.7:0/690860545 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3283629235 0 0) 0x7f0d4c0d1b40 con 0x7f0d4c0ce830 2024-04-25T09:54:52.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.741+0000 7f0d50a88640 1 -- 172.21.15.7:0/690860545 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d4c0ced10 con 0x7f0d4c0ce830 2024-04-25T09:54:52.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.741+0000 7f0d50a88640 1 -- 172.21.15.7:0/690860545 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2045741147 0 0) 0x7f0d34003520 con 0x7f0d4c0d3760 2024-04-25T09:54:52.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.741+0000 7f0d50a88640 1 -- 172.21.15.7:0/690860545 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0d4c15f1c0 msgr2=0x7f0d4c15eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:52.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.741+0000 7f0d50a88640 1 --2- 172.21.15.7:0/690860545 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0d4c15f1c0 0x7f0d4c15eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:52.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.741+0000 7f0d50a88640 1 -- 172.21.15.7:0/690860545 >> v1:172.21.15.55:6789/0 conn(0x7f0d4c0ce830 legacy=0x7f0d4c0b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:52.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.741+0000 7f0d50a88640 1 -- 172.21.15.7:0/690860545 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4c0d1e20 con 0x7f0d4c0d3760 2024-04-25T09:54:52.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.741+0000 7f0d50a88640 1 -- 172.21.15.7:0/690860545 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f0d44001670 con 0x7f0d4c0d3760 2024-04-25T09:54:52.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.741+0000 7f0d50a88640 1 -- 172.21.15.7:0/690860545 >> v1:172.21.15.7:6789/0 conn(0x7f0d4c0d3760 legacy=0x7f0d4c0d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:52.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.741+0000 7f0d50a88640 1 --2- 172.21.15.7:0/690860545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d34003b70 0x7f0d34003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:52.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.741+0000 7f0d50a88640 1 --2- 172.21.15.7:0/690860545 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0d34004800 0x7f0d34004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:52.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.741+0000 7f0d50a88640 1 --2- 172.21.15.7:0/690860545 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d340051c0 0x7f0d3400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:52.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.741+0000 7f0d50a88640 1 -- 172.21.15.7:0/690860545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3400bfb0 con 0x7f0d34003b70 2024-04-25T09:54:52.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.741+0000 7f0d50a88640 1 -- 172.21.15.7:0/690860545 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3400c130 con 0x7f0d340051c0 2024-04-25T09:54:52.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.741+0000 7f0d50a88640 1 -- 172.21.15.7:0/690860545 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3400c330 con 0x7f0d34004800 2024-04-25T09:54:52.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.741+0000 7f0d51289640 1 --2- 172.21.15.7:0/690860545 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0d4c15f1c0 0x7f0d4c15eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:54:52.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.741+0000 7f0d51a8a640 1 --2- 172.21.15.7:0/690860545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d34003b70 0x7f0d34003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:52.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.741+0000 7f0d5228b640 1 --2- 172.21.15.7:0/690860545 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d340051c0 0x7f0d3400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:52.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.741+0000 7f0d51289640 1 --2- 172.21.15.7:0/690860545 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0d34004800 0x7f0d34004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:52.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.741+0000 7f0d51a8a640 1 -- 172.21.15.7:0/690860545 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0d34004800 msgr2=0x7f0d34004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:52.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.741+0000 7f0d51a8a640 1 --2- 172.21.15.7:0/690860545 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0d34004800 0x7f0d34004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:52.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.741+0000 7f0d51a8a640 1 -- 172.21.15.7:0/690860545 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d340051c0 msgr2=0x7f0d3400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:52.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.741+0000 7f0d51a8a640 1 --2- 172.21.15.7:0/690860545 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d340051c0 0x7f0d3400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:52.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.741+0000 7f0d51a8a640 1 -- 172.21.15.7:0/690860545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d34003520 con 0x7f0d34003b70 2024-04-25T09:54:52.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.742+0000 7f0d51a8a640 1 --2- 172.21.15.7:0/690860545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d34003b70 0x7f0d34003f70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0d4400c210 tx=0x7f0d34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c53b227145bb2276 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:52.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.742+0000 7f0d50a88640 1 -- 172.21.15.7:0/690860545 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d44007ce0 con 0x7f0d34003b70 2024-04-25T09:54:52.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.742+0000 7f0d50a88640 1 -- 172.21.15.7:0/690860545 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d44005ad0 con 0x7f0d34003b70 2024-04-25T09:54:52.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.742+0000 7f0d50a88640 1 -- 172.21.15.7:0/690860545 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d44007070 con 0x7f0d34003b70 2024-04-25T09:54:52.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.743+0000 7f0d53cee640 1 -- 172.21.15.7:0/690860545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d34003b70 msgr2=0x7f0d34003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:52.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.743+0000 7f0d53cee640 1 --2- 172.21.15.7:0/690860545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d34003b70 0x7f0d34003f70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0d4400c210 tx=0x7f0d34005830 comp rx=0 tx=0).stop 2024-04-25T09:54:52.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.743+0000 7f0d5228b640 1 -- 172.21.15.7:0/690860545 reap_dead start 2024-04-25T09:54:52.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.743+0000 7f0d53cee640 1 -- 172.21.15.7:0/690860545 shutdown_connections 2024-04-25T09:54:52.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.743+0000 7f0d53cee640 1 -- 172.21.15.7:0/690860545 >> 172.21.15.7:0/690860545 conn(0x7f0d4c072680 msgr2=0x7f0d4c072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:52.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.743+0000 7f0d53cee640 1 -- 172.21.15.7:0/690860545 shutdown_connections 2024-04-25T09:54:52.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.743+0000 7f0d53cee640 1 -- 172.21.15.7:0/690860545 wait complete. 2024-04-25T09:54:52.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.744+0000 7f0d53cee640 1 Processor -- start 2024-04-25T09:54:52.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.744+0000 7f0d53cee640 1 -- start start 2024-04-25T09:54:52.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.745+0000 7f0d53cee640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d34003b70 0x7f0d4c1e9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:52.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.745+0000 7f0d53cee640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0d4c1f64c0 0x7f0d4c0b7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:52.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.745+0000 7f0d53cee640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d4c0b7a40 0x7f0d4c1f3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:52.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.745+0000 7f0d53cee640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4c15eac0 con 0x7f0d34003b70 2024-04-25T09:54:52.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.745+0000 7f0d53cee640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4c0d2190 con 0x7f0d4c0b7a40 2024-04-25T09:54:52.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.745+0000 7f0d53cee640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4c15ec40 con 0x7f0d4c1f64c0 2024-04-25T09:54:52.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.745+0000 7f0d51a8a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d34003b70 0x7f0d4c1e9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:52.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.745+0000 7f0d51a8a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d34003b70 0x7f0d4c1e9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52522/0 (socket says 172.21.15.7:52522) 2024-04-25T09:54:52.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.745+0000 7f0d51a8a640 1 -- 172.21.15.7:0/1972538123 learned_addr learned my addr 172.21.15.7:0/1972538123 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:52.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.745+0000 7f0d51289640 1 --2- 172.21.15.7:0/1972538123 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0d4c1f64c0 0x7f0d4c0b7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:52.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.745+0000 7f0d5228b640 1 --2- 172.21.15.7:0/1972538123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d4c0b7a40 0x7f0d4c1f3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:52.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.745+0000 7f0d51a8a640 1 -- 172.21.15.7:0/1972538123 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0d4c1f64c0 msgr2=0x7f0d4c0b7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:52.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.745+0000 7f0d51a8a640 1 --2- 172.21.15.7:0/1972538123 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0d4c1f64c0 0x7f0d4c0b7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:52.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.745+0000 7f0d51a8a640 1 -- 172.21.15.7:0/1972538123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d4c0b7a40 msgr2=0x7f0d4c1f3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:52.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.745+0000 7f0d51a8a640 1 --2- 172.21.15.7:0/1972538123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d4c0b7a40 0x7f0d4c1f3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:52.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.745+0000 7f0d51a8a640 1 -- 172.21.15.7:0/1972538123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4c1f6940 con 0x7f0d34003b70 2024-04-25T09:54:52.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.745+0000 7f0d51289640 1 --2- 172.21.15.7:0/1972538123 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0d4c1f64c0 0x7f0d4c0b7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:52.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.745+0000 7f0d5228b640 1 --2- 172.21.15.7:0/1972538123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d4c0b7a40 0x7f0d4c1f3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:52.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.745+0000 7f0d51a8a640 1 --2- 172.21.15.7:0/1972538123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d34003b70 0x7f0d4c1e9aa0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0d4400c330 tx=0x7f0d4c0ceee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:52.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.746+0000 7f0d4a7fc640 1 -- 172.21.15.7:0/1972538123 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d44001470 con 0x7f0d34003b70 2024-04-25T09:54:52.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.746+0000 7f0d4a7fc640 1 -- 172.21.15.7:0/1972538123 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d44038040 con 0x7f0d34003b70 2024-04-25T09:54:52.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.746+0000 7f0d53cee640 1 -- 172.21.15.7:0/1972538123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d4c1e79f0 con 0x7f0d34003b70 2024-04-25T09:54:52.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.746+0000 7f0d4a7fc640 1 -- 172.21.15.7:0/1972538123 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d44007070 con 0x7f0d34003b70 2024-04-25T09:54:52.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.746+0000 7f0d53cee640 1 -- 172.21.15.7:0/1972538123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d4c1e7fb0 con 0x7f0d34003b70 2024-04-25T09:54:52.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.747+0000 7f0d53cee640 1 -- 172.21.15.7:0/1972538123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d4c068f60 con 0x7f0d34003b70 2024-04-25T09:54:52.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.747+0000 7f0d4a7fc640 1 -- 172.21.15.7:0/1972538123 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0d44044030 con 0x7f0d34003b70 2024-04-25T09:54:52.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.747+0000 7f0d4a7fc640 1 --2- 172.21.15.7:0/1972538123 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0d3806b500 0x7f0d3806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:52.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.748+0000 7f0d4a7fc640 1 -- 172.21.15.7:0/1972538123 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0d440a9fe0 con 0x7f0d34003b70 2024-04-25T09:54:52.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.748+0000 7f0d51289640 1 --2- 172.21.15.7:0/1972538123 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0d3806b500 0x7f0d3806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:52.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.748+0000 7f0d51289640 1 --2- 172.21.15.7:0/1972538123 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0d3806b500 0x7f0d3806d9c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0cd880 tx=0x7f0d40008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:52.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.752+0000 7f0d4a7fc640 1 -- 172.21.15.7:0/1972538123 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0d4404b020 con 0x7f0d34003b70 2024-04-25T09:54:52.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.931+0000 7f0d53cee640 1 -- 172.21.15.7:0/1972538123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0d4c072f30 con 0x7f0d34003b70 2024-04-25T09:54:52.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.932+0000 7f0d4a7fc640 1 -- 172.21.15.7:0/1972538123 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0d44005aa0 con 0x7f0d34003b70 2024-04-25T09:54:52.935 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T09:54:52.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.934+0000 7f0d53cee640 1 -- 172.21.15.7:0/1972538123 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0d3806b500 msgr2=0x7f0d3806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:52.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.934+0000 7f0d53cee640 1 --2- 172.21.15.7:0/1972538123 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0d3806b500 0x7f0d3806d9c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0cd880 tx=0x7f0d40008040 comp rx=0 tx=0).stop 2024-04-25T09:54:52.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.934+0000 7f0d53cee640 1 -- 172.21.15.7:0/1972538123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d34003b70 msgr2=0x7f0d4c1e9aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:52.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.934+0000 7f0d53cee640 1 --2- 172.21.15.7:0/1972538123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d34003b70 0x7f0d4c1e9aa0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0d4400c330 tx=0x7f0d4c0ceee0 comp rx=0 tx=0).stop 2024-04-25T09:54:52.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.934+0000 7f0d53cee640 1 -- 172.21.15.7:0/1972538123 shutdown_connections 2024-04-25T09:54:52.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.934+0000 7f0d53cee640 1 --2- 172.21.15.7:0/1972538123 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0d3806b500 0x7f0d3806d9c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:52.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.934+0000 7f0d53cee640 1 --2- 172.21.15.7:0/1972538123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d4c0b7a40 0x7f0d4c1f3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:52.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.934+0000 7f0d53cee640 1 --2- 172.21.15.7:0/1972538123 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0d4c1f64c0 0x7f0d4c0b7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:52.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.934+0000 7f0d53cee640 1 --2- 172.21.15.7:0/1972538123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d34003b70 0x7f0d4c1e9aa0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:52.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.934+0000 7f0d53cee640 1 -- 172.21.15.7:0/1972538123 >> 172.21.15.7:0/1972538123 conn(0x7f0d4c072680 msgr2=0x7f0d4c15e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:52.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.934+0000 7f0d53cee640 1 -- 172.21.15.7:0/1972538123 shutdown_connections 2024-04-25T09:54:52.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:52.934+0000 7f0d53cee640 1 -- 172.21.15.7:0/1972538123 wait complete. 2024-04-25T09:54:52.947 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:54:53.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.049+0000 7f43babf9640 1 Processor -- start 2024-04-25T09:54:53.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.049+0000 7f43babf9640 1 -- start start 2024-04-25T09:54:53.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.050+0000 7f43babf9640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f43b415f1c0 0x7f43b415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:53.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.050+0000 7f43babf9640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b40ced10 con 0x7f43b40d3760 2024-04-25T09:54:53.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.050+0000 7f43babf9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b40d1b40 con 0x7f43b40ce830 2024-04-25T09:54:53.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.050+0000 7f43babf9640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b40ce380 con 0x7f43b415f1c0 2024-04-25T09:54:53.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.050+0000 7f43b8995640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f43b40d3760 0x7f43b40d3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42086/0 (socket says 172.21.15.7:42086) 2024-04-25T09:54:53.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.050+0000 7f43b8995640 1 -- 172.21.15.7:0/3718632514 learned_addr learned my addr 172.21.15.7:0/3718632514 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:53.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.050+0000 7f43b3fff640 1 --2- 172.21.15.7:0/3718632514 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f43b415f1c0 0x7f43b415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:53.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.050+0000 7f43b37fe640 1 -- 172.21.15.7:0/3718632514 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991286437 0 0) 0x7f43b40ced10 con 0x7f43b40d3760 2024-04-25T09:54:53.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.050+0000 7f43b37fe640 1 -- 172.21.15.7:0/3718632514 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43a4003520 con 0x7f43b40d3760 2024-04-25T09:54:53.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.050+0000 7f43b37fe640 1 -- 172.21.15.7:0/3718632514 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2965604685 0 0) 0x7f43b40d1b40 con 0x7f43b40ce830 2024-04-25T09:54:53.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.050+0000 7f43b37fe640 1 -- 172.21.15.7:0/3718632514 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43b40ced10 con 0x7f43b40ce830 2024-04-25T09:54:53.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.050+0000 7f43b37fe640 1 -- 172.21.15.7:0/3718632514 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4053247762 0 0) 0x7f43a4003520 con 0x7f43b40d3760 2024-04-25T09:54:53.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.050+0000 7f43b37fe640 1 -- 172.21.15.7:0/3718632514 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f43b415f1c0 msgr2=0x7f43b415eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:53.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.050+0000 7f43b37fe640 1 --2- 172.21.15.7:0/3718632514 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f43b415f1c0 0x7f43b415eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.050+0000 7f43b37fe640 1 -- 172.21.15.7:0/3718632514 >> v1:172.21.15.55:6789/0 conn(0x7f43b40ce830 legacy=0x7f43b40b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:53.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.050+0000 7f43b37fe640 1 -- 172.21.15.7:0/3718632514 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b40d1e20 con 0x7f43b40d3760 2024-04-25T09:54:53.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.050+0000 7f43b37fe640 1 -- 172.21.15.7:0/3718632514 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f43a8001670 con 0x7f43b40d3760 2024-04-25T09:54:53.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.050+0000 7f43b37fe640 1 -- 172.21.15.7:0/3718632514 >> v1:172.21.15.7:6789/0 conn(0x7f43b40d3760 legacy=0x7f43b40d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:53.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.050+0000 7f43b37fe640 1 --2- 172.21.15.7:0/3718632514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43a4003b70 0x7f43a4003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:53.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.050+0000 7f43b37fe640 1 --2- 172.21.15.7:0/3718632514 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f43b415f1c0 0x7f43a4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:53.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.050+0000 7f43b37fe640 1 --2- 172.21.15.7:0/3718632514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43a4004d40 0x7f43a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:53.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.051+0000 7f43b37fe640 1 -- 172.21.15.7:0/3718632514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a400ba70 con 0x7f43a4003b70 2024-04-25T09:54:53.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.051+0000 7f43b37fe640 1 -- 172.21.15.7:0/3718632514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a400bbf0 con 0x7f43a4004d40 2024-04-25T09:54:53.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.051+0000 7f43b37fe640 1 -- 172.21.15.7:0/3718632514 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a400bdf0 con 0x7f43b415f1c0 2024-04-25T09:54:53.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.051+0000 7f43b8995640 1 --2- 172.21.15.7:0/3718632514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43a4003b70 0x7f43a4003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:53.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.051+0000 7f43b3fff640 1 --2- 172.21.15.7:0/3718632514 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f43b415f1c0 0x7f43a4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:53.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.051+0000 7f43b9196640 1 --2- 172.21.15.7:0/3718632514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43a4004d40 0x7f43a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:53.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.051+0000 7f43b8995640 1 -- 172.21.15.7:0/3718632514 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f43b415f1c0 msgr2=0x7f43a4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:53.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.051+0000 7f43b8995640 1 --2- 172.21.15.7:0/3718632514 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f43b415f1c0 0x7f43a4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.051+0000 7f43b8995640 1 -- 172.21.15.7:0/3718632514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43a4004d40 msgr2=0x7f43a40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:53.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.051+0000 7f43b8995640 1 --2- 172.21.15.7:0/3718632514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43a4004d40 0x7f43a40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.051+0000 7f43b8995640 1 -- 172.21.15.7:0/3718632514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a4003520 con 0x7f43a4003b70 2024-04-25T09:54:53.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.052+0000 7f43b8995640 1 --2- 172.21.15.7:0/3718632514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43a4003b70 0x7f43a4003f70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f43a8007fa0 tx=0x7f43a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6b3fbb149d612f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:53.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.052+0000 7f43b37fe640 1 -- 172.21.15.7:0/3718632514 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a8007bc0 con 0x7f43a4003b70 2024-04-25T09:54:53.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.052+0000 7f43b37fe640 1 -- 172.21.15.7:0/3718632514 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a8005af0 con 0x7f43a4003b70 2024-04-25T09:54:53.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.052+0000 7f43b37fe640 1 -- 172.21.15.7:0/3718632514 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a8007070 con 0x7f43a4003b70 2024-04-25T09:54:53.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.052+0000 7f43babf9640 1 -- 172.21.15.7:0/3718632514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43a4003b70 msgr2=0x7f43a4003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:53.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.052+0000 7f43babf9640 1 --2- 172.21.15.7:0/3718632514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43a4003b70 0x7f43a4003f70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f43a8007fa0 tx=0x7f43a4005830 comp rx=0 tx=0).stop 2024-04-25T09:54:53.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.052+0000 7f43b9196640 1 -- 172.21.15.7:0/3718632514 reap_dead start 2024-04-25T09:54:53.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.052+0000 7f43babf9640 1 -- 172.21.15.7:0/3718632514 shutdown_connections 2024-04-25T09:54:53.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.052+0000 7f43babf9640 1 -- 172.21.15.7:0/3718632514 >> 172.21.15.7:0/3718632514 conn(0x7f43b4072680 msgr2=0x7f43b4072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:53.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.052+0000 7f43babf9640 1 -- 172.21.15.7:0/3718632514 shutdown_connections 2024-04-25T09:54:53.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.052+0000 7f43babf9640 1 -- 172.21.15.7:0/3718632514 wait complete. 2024-04-25T09:54:53.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.054+0000 7f43babf9640 1 Processor -- start 2024-04-25T09:54:53.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.054+0000 7f43babf9640 1 -- start start 2024-04-25T09:54:53.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.054+0000 7f43babf9640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f43a4003b70 0x7f43b40c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:53.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.054+0000 7f43babf9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43b4149100 0x7f43b4155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:53.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.054+0000 7f43babf9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b41f37e0 0x7f43b4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:53.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.054+0000 7f43babf9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b415eac0 con 0x7f43b41f37e0 2024-04-25T09:54:53.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.054+0000 7f43babf9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b40d2190 con 0x7f43b4149100 2024-04-25T09:54:53.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.054+0000 7f43babf9640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b415ec40 con 0x7f43a4003b70 2024-04-25T09:54:53.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.055+0000 7f43b9196640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b41f37e0 0x7f43b4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:53.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.055+0000 7f43b9196640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b41f37e0 0x7f43b4155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52544/0 (socket says 172.21.15.7:52544) 2024-04-25T09:54:53.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.055+0000 7f43b9196640 1 -- 172.21.15.7:0/1763199685 learned_addr learned my addr 172.21.15.7:0/1763199685 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:53.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.055+0000 7f43b3fff640 1 --2- 172.21.15.7:0/1763199685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43b4149100 0x7f43b4155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:53.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.055+0000 7f43b8995640 1 --2- 172.21.15.7:0/1763199685 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f43a4003b70 0x7f43b40c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:53.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.055+0000 7f43b9196640 1 -- 172.21.15.7:0/1763199685 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f43a4003b70 msgr2=0x7f43b40c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:53.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.055+0000 7f43b9196640 1 --2- 172.21.15.7:0/1763199685 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f43a4003b70 0x7f43b40c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.055+0000 7f43b9196640 1 -- 172.21.15.7:0/1763199685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43b4149100 msgr2=0x7f43b4155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:53.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.055+0000 7f43b9196640 1 --2- 172.21.15.7:0/1763199685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43b4149100 0x7f43b4155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.055+0000 7f43b9196640 1 -- 172.21.15.7:0/1763199685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b40c94b0 con 0x7f43b41f37e0 2024-04-25T09:54:53.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.055+0000 7f43b3fff640 1 --2- 172.21.15.7:0/1763199685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43b4149100 0x7f43b4155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:53.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.055+0000 7f43b8995640 1 --2- 172.21.15.7:0/1763199685 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f43a4003b70 0x7f43b40c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:53.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.055+0000 7f43b9196640 1 --2- 172.21.15.7:0/1763199685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b41f37e0 0x7f43b4155fe0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f43b40b92e0 tx=0x7f43ac00ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:53.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.055+0000 7f43b17fa640 1 -- 172.21.15.7:0/1763199685 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac019070 con 0x7f43b41f37e0 2024-04-25T09:54:53.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.055+0000 7f43b17fa640 1 -- 172.21.15.7:0/1763199685 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ac006e20 con 0x7f43b41f37e0 2024-04-25T09:54:53.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.055+0000 7f43babf9640 1 -- 172.21.15.7:0/1763199685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b40c9790 con 0x7f43b41f37e0 2024-04-25T09:54:53.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.055+0000 7f43b17fa640 1 -- 172.21.15.7:0/1763199685 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac003b70 con 0x7f43b41f37e0 2024-04-25T09:54:53.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.055+0000 7f43babf9640 1 -- 172.21.15.7:0/1763199685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b40cb130 con 0x7f43b41f37e0 2024-04-25T09:54:53.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.056+0000 7f43babf9640 1 -- 172.21.15.7:0/1763199685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b4068f60 con 0x7f43b41f37e0 2024-04-25T09:54:53.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.057+0000 7f43b17fa640 1 -- 172.21.15.7:0/1763199685 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f43ac01c070 con 0x7f43b41f37e0 2024-04-25T09:54:53.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.057+0000 7f43b17fa640 1 --2- 172.21.15.7:0/1763199685 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f439806b4d0 0x7f439806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:53.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.057+0000 7f43b17fa640 1 -- 172.21.15.7:0/1763199685 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f43ac089aa0 con 0x7f43b41f37e0 2024-04-25T09:54:53.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.057+0000 7f43b8995640 1 --2- 172.21.15.7:0/1763199685 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f439806b4d0 0x7f439806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:53.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.058+0000 7f43b8995640 1 --2- 172.21.15.7:0/1763199685 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f439806b4d0 0x7f439806d990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f43a8032000 tx=0x7f43a8009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:53.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.061+0000 7f43b17fa640 1 -- 172.21.15.7:0/1763199685 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f43ac0585e0 con 0x7f43b41f37e0 2024-04-25T09:54:53.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.243+0000 7f43babf9640 1 -- 172.21.15.7:0/1763199685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f43b415e810 con 0x7f43b41f37e0 2024-04-25T09:54:53.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.243+0000 7f43b17fa640 1 -- 172.21.15.7:0/1763199685 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f43ac057ee0 con 0x7f43b41f37e0 2024-04-25T09:54:53.246 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:54:53.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.245+0000 7f43babf9640 1 -- 172.21.15.7:0/1763199685 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f439806b4d0 msgr2=0x7f439806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:53.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.245+0000 7f43babf9640 1 --2- 172.21.15.7:0/1763199685 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f439806b4d0 0x7f439806d990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f43a8032000 tx=0x7f43a8009030 comp rx=0 tx=0).stop 2024-04-25T09:54:53.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.245+0000 7f43babf9640 1 -- 172.21.15.7:0/1763199685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b41f37e0 msgr2=0x7f43b4155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:53.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.245+0000 7f43babf9640 1 --2- 172.21.15.7:0/1763199685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b41f37e0 0x7f43b4155fe0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f43b40b92e0 tx=0x7f43ac00ff70 comp rx=0 tx=0).stop 2024-04-25T09:54:53.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.246+0000 7f43babf9640 1 -- 172.21.15.7:0/1763199685 shutdown_connections 2024-04-25T09:54:53.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.246+0000 7f43babf9640 1 --2- 172.21.15.7:0/1763199685 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f439806b4d0 0x7f439806d990 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.246+0000 7f43babf9640 1 --2- 172.21.15.7:0/1763199685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43b41f37e0 0x7f43b4155fe0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.246+0000 7f43babf9640 1 --2- 172.21.15.7:0/1763199685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43b4149100 0x7f43b4155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.246+0000 7f43babf9640 1 --2- 172.21.15.7:0/1763199685 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f43a4003b70 0x7f43b40c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.246+0000 7f43babf9640 1 -- 172.21.15.7:0/1763199685 >> 172.21.15.7:0/1763199685 conn(0x7f43b4072680 msgr2=0x7f43b40b7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:53.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.246+0000 7f43babf9640 1 -- 172.21.15.7:0/1763199685 shutdown_connections 2024-04-25T09:54:53.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.246+0000 7f43babf9640 1 -- 172.21.15.7:0/1763199685 wait complete. 2024-04-25T09:54:53.260 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:54:53.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.362+0000 7f93721e0640 1 Processor -- start 2024-04-25T09:54:53.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.362+0000 7f93721e0640 1 -- start start 2024-04-25T09:54:53.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.363+0000 7f93721e0640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f936c15f1c0 0x7f936c15eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:53.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.363+0000 7f93721e0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f936c0ce830 0x7f936c0b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:53.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.363+0000 7f93721e0640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f936c0ced10 con 0x7f936c0d3760 2024-04-25T09:54:53.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.363+0000 7f93721e0640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f936c0ce380 con 0x7f936c15f1c0 2024-04-25T09:54:53.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.363+0000 7f93721e0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936c15f000 con 0x7f936c0ce830 2024-04-25T09:54:53.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.363+0000 7f936affd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f936c15f1c0 0x7f936c15eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:53.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.363+0000 7f936b7fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f936c0d3760 0x7f936c0d3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42094/0 (socket says 172.21.15.7:42094) 2024-04-25T09:54:53.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.363+0000 7f936b7fe640 1 -- 172.21.15.7:0/196944667 learned_addr learned my addr 172.21.15.7:0/196944667 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:53.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.363+0000 7f936bfff640 1 --2- 172.21.15.7:0/196944667 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f936c0ce830 0x7f936c0b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:53.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.363+0000 7f936affd640 1 -- 172.21.15.7:0/196944667 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f936c0ce830 msgr2=0x7f936c0b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:53.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.363+0000 7f936affd640 1 --2- 172.21.15.7:0/196944667 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f936c0ce830 0x7f936c0b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.363+0000 7f936affd640 1 -- 172.21.15.7:0/196944667 >> v1:172.21.15.7:6789/0 conn(0x7f936c0d3760 legacy=0x7f936c0d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:53.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.363+0000 7f936affd640 1 -- 172.21.15.7:0/196944667 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936c0d1b40 con 0x7f936c15f1c0 2024-04-25T09:54:53.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.363+0000 7f936a7fc640 1 -- 172.21.15.7:0/196944667 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2693737606 0 0) 0x7f936c0ced10 con 0x7f936c0d3760 2024-04-25T09:54:53.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.364+0000 7f936affd640 1 --2- 172.21.15.7:0/196944667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f936c15f1c0 0x7f936c15eac0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f93600097a0 tx=0x7f936002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d565c74dc46bf1ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:53.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.364+0000 7f936a7fc640 1 -- 172.21.15.7:0/196944667 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9360037070 con 0x7f936c15f1c0 2024-04-25T09:54:53.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.364+0000 7f936a7fc640 1 -- 172.21.15.7:0/196944667 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9360032440 con 0x7f936c15f1c0 2024-04-25T09:54:53.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.364+0000 7f936a7fc640 1 -- 172.21.15.7:0/196944667 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9360032810 con 0x7f936c15f1c0 2024-04-25T09:54:53.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.365+0000 7f93721e0640 1 -- 172.21.15.7:0/196944667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f936c15f1c0 msgr2=0x7f936c15eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:53.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.365+0000 7f93721e0640 1 --2- 172.21.15.7:0/196944667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f936c15f1c0 0x7f936c15eac0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f93600097a0 tx=0x7f936002a180 comp rx=0 tx=0).stop 2024-04-25T09:54:53.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.365+0000 7f93721e0640 1 -- 172.21.15.7:0/196944667 shutdown_connections 2024-04-25T09:54:53.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.365+0000 7f93721e0640 1 --2- 172.21.15.7:0/196944667 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f936c0ce830 0x7f936c0b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.365+0000 7f93721e0640 1 --2- 172.21.15.7:0/196944667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f936c15f1c0 0x7f936c15eac0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.365+0000 7f93721e0640 1 -- 172.21.15.7:0/196944667 >> 172.21.15.7:0/196944667 conn(0x7f936c072680 msgr2=0x7f936c072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:53.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.365+0000 7f93721e0640 1 -- 172.21.15.7:0/196944667 shutdown_connections 2024-04-25T09:54:53.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.365+0000 7f93721e0640 1 -- 172.21.15.7:0/196944667 wait complete. 2024-04-25T09:54:53.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.366+0000 7f93721e0640 1 Processor -- start 2024-04-25T09:54:53.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.366+0000 7f93721e0640 1 -- start start 2024-04-25T09:54:53.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.367+0000 7f93721e0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f936c0ce830 0x7f936c0b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:53.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.367+0000 7f93721e0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f936c0d3760 0x7f936c14edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:53.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.367+0000 7f93721e0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f936c15f1c0 0x7f936c15b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:53.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.367+0000 7f93721e0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936c15de10 con 0x7f936c0ce830 2024-04-25T09:54:53.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.367+0000 7f93721e0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936c0d2190 con 0x7f936c15f1c0 2024-04-25T09:54:53.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.367+0000 7f93721e0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936c0b2780 con 0x7f936c0d3760 2024-04-25T09:54:53.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.367+0000 7f936b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f936c0ce830 0x7f936c0b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:53.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.367+0000 7f936b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f936c0ce830 0x7f936c0b2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52570/0 (socket says 172.21.15.7:52570) 2024-04-25T09:54:53.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.367+0000 7f936b7fe640 1 -- 172.21.15.7:0/1734142882 learned_addr learned my addr 172.21.15.7:0/1734142882 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:53.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.367+0000 7f936affd640 1 --2- 172.21.15.7:0/1734142882 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f936c0d3760 0x7f936c14edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:53.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.367+0000 7f936bfff640 1 --2- 172.21.15.7:0/1734142882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f936c15f1c0 0x7f936c15b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:53.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.367+0000 7f936b7fe640 1 -- 172.21.15.7:0/1734142882 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f936c0d3760 msgr2=0x7f936c14edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:53.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.367+0000 7f936b7fe640 1 --2- 172.21.15.7:0/1734142882 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f936c0d3760 0x7f936c14edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.367+0000 7f936b7fe640 1 -- 172.21.15.7:0/1734142882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f936c15f1c0 msgr2=0x7f936c15b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:53.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.367+0000 7f936b7fe640 1 --2- 172.21.15.7:0/1734142882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f936c15f1c0 0x7f936c15b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.367+0000 7f936b7fe640 1 -- 172.21.15.7:0/1734142882 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936c0b3240 con 0x7f936c0ce830 2024-04-25T09:54:53.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.368+0000 7f936b7fe640 1 --2- 172.21.15.7:0/1734142882 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f936c0ce830 0x7f936c0b2bb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f935c00c4d0 tx=0x7f935c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:53.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.368+0000 7f9353fff640 1 -- 172.21.15.7:0/1734142882 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c018070 con 0x7f936c0ce830 2024-04-25T09:54:53.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.368+0000 7f9353fff640 1 -- 172.21.15.7:0/1734142882 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935c007500 con 0x7f936c0ce830 2024-04-25T09:54:53.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.368+0000 7f9353fff640 1 -- 172.21.15.7:0/1734142882 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c004a20 con 0x7f936c0ce830 2024-04-25T09:54:53.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.368+0000 7f93721e0640 1 -- 172.21.15.7:0/1734142882 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f936c0b3520 con 0x7f936c0ce830 2024-04-25T09:54:53.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.368+0000 7f93721e0640 1 -- 172.21.15.7:0/1734142882 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f936c0b3ae0 con 0x7f936c0ce830 2024-04-25T09:54:53.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.369+0000 7f93721e0640 1 -- 172.21.15.7:0/1734142882 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f936c068f60 con 0x7f936c0ce830 2024-04-25T09:54:53.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.369+0000 7f9353fff640 1 -- 172.21.15.7:0/1734142882 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f935c004bc0 con 0x7f936c0ce830 2024-04-25T09:54:53.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.370+0000 7f9353fff640 1 --2- 172.21.15.7:0/1734142882 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f935806b4d0 0x7f935806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:53.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.370+0000 7f9353fff640 1 -- 172.21.15.7:0/1734142882 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f935c089980 con 0x7f936c0ce830 2024-04-25T09:54:53.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.370+0000 7f936affd640 1 --2- 172.21.15.7:0/1734142882 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f935806b4d0 0x7f935806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:53.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.370+0000 7f936affd640 1 --2- 172.21.15.7:0/1734142882 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f935806b4d0 0x7f935806d990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9360034000 tx=0x7f936002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:53.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.374+0000 7f9353fff640 1 -- 172.21.15.7:0/1734142882 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f935c058390 con 0x7f936c0ce830 2024-04-25T09:54:53.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.555+0000 7f93721e0640 1 -- 172.21.15.7:0/1734142882 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f936c0ce610 con 0x7f936c0ce830 2024-04-25T09:54:53.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.555+0000 7f9353fff640 1 -- 172.21.15.7:0/1734142882 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f935c057c90 con 0x7f936c0ce830 2024-04-25T09:54:53.558 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T09:54:53.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.557+0000 7f93721e0640 1 -- 172.21.15.7:0/1734142882 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f935806b4d0 msgr2=0x7f935806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:53.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.557+0000 7f93721e0640 1 --2- 172.21.15.7:0/1734142882 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f935806b4d0 0x7f935806d990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9360034000 tx=0x7f936002e000 comp rx=0 tx=0).stop 2024-04-25T09:54:53.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.557+0000 7f93721e0640 1 -- 172.21.15.7:0/1734142882 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f936c0ce830 msgr2=0x7f936c0b2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:53.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.557+0000 7f93721e0640 1 --2- 172.21.15.7:0/1734142882 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f936c0ce830 0x7f936c0b2bb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f935c00c4d0 tx=0x7f935c00c990 comp rx=0 tx=0).stop 2024-04-25T09:54:53.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.557+0000 7f93721e0640 1 -- 172.21.15.7:0/1734142882 shutdown_connections 2024-04-25T09:54:53.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.557+0000 7f93721e0640 1 --2- 172.21.15.7:0/1734142882 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f935806b4d0 0x7f935806d990 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.557+0000 7f93721e0640 1 --2- 172.21.15.7:0/1734142882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f936c15f1c0 0x7f936c15b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.557+0000 7f93721e0640 1 --2- 172.21.15.7:0/1734142882 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f936c0d3760 0x7f936c14edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.557+0000 7f93721e0640 1 --2- 172.21.15.7:0/1734142882 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f936c0ce830 0x7f936c0b2bb0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.557+0000 7f93721e0640 1 -- 172.21.15.7:0/1734142882 >> 172.21.15.7:0/1734142882 conn(0x7f936c072680 msgr2=0x7f936c0b6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:53.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.557+0000 7f93721e0640 1 -- 172.21.15.7:0/1734142882 shutdown_connections 2024-04-25T09:54:53.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.557+0000 7f93721e0640 1 -- 172.21.15.7:0/1734142882 wait complete. 2024-04-25T09:54:53.571 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:54:53.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.671+0000 7f8c29200640 1 Processor -- start 2024-04-25T09:54:53.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.671+0000 7f8c29200640 1 -- start start 2024-04-25T09:54:53.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.672+0000 7f8c29200640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c2415efc0 0x7f8c240cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:53.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.672+0000 7f8c29200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8c240b3b50 0x7f8c240999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:53.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.672+0000 7f8c29200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c240cce10 con 0x7f8c24099f30 2024-04-25T09:54:53.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.672+0000 7f8c29200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c240cd0f0 con 0x7f8c240b3b50 2024-04-25T09:54:53.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.672+0000 7f8c29200640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c240cd3d0 con 0x7f8c2415efc0 2024-04-25T09:54:53.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.672+0000 7f8c2259c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8c240b3b50 0x7f8c240999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:53.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.672+0000 7f8c2259c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8c240b3b50 0x7f8c240999f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52584/0 (socket says 172.21.15.7:52584) 2024-04-25T09:54:53.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.672+0000 7f8c2259c640 1 -- 172.21.15.7:0/2216837338 learned_addr learned my addr 172.21.15.7:0/2216837338 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:53.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.673+0000 7f8c22d9d640 1 --2- 172.21.15.7:0/2216837338 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c2415efc0 0x7f8c240cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:53.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.673+0000 7f8c2259c640 1 -- 172.21.15.7:0/2216837338 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c2415efc0 msgr2=0x7f8c240cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:53.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.673+0000 7f8c2259c640 1 --2- 172.21.15.7:0/2216837338 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c2415efc0 0x7f8c240cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.673+0000 7f8c2259c640 1 -- 172.21.15.7:0/2216837338 >> v1:172.21.15.55:6789/0 conn(0x7f8c24099f30 legacy=0x7f8c240cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:53.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.673+0000 7f8c2259c640 1 -- 172.21.15.7:0/2216837338 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2415f3a0 con 0x7f8c240b3b50 2024-04-25T09:54:53.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.673+0000 7f8c2259c640 1 --2- 172.21.15.7:0/2216837338 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c240b3b50 0x7f8c240999f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c009870 tx=0x7f8c0c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8408010442d7aa21 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:53.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.674+0000 7f8c21d9b640 1 -- 172.21.15.7:0/2216837338 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c037070 con 0x7f8c240b3b50 2024-04-25T09:54:53.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.674+0000 7f8c21d9b640 1 -- 172.21.15.7:0/2216837338 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0c032440 con 0x7f8c240b3b50 2024-04-25T09:54:53.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.674+0000 7f8c21d9b640 1 -- 172.21.15.7:0/2216837338 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c032810 con 0x7f8c240b3b50 2024-04-25T09:54:53.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.674+0000 7f8c29200640 1 -- 172.21.15.7:0/2216837338 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c240b3b50 msgr2=0x7f8c240999f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:53.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.674+0000 7f8c29200640 1 --2- 172.21.15.7:0/2216837338 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c240b3b50 0x7f8c240999f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c009870 tx=0x7f8c0c02a270 comp rx=0 tx=0).stop 2024-04-25T09:54:53.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.674+0000 7f8c29200640 1 -- 172.21.15.7:0/2216837338 shutdown_connections 2024-04-25T09:54:53.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.674+0000 7f8c29200640 1 --2- 172.21.15.7:0/2216837338 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c240b3b50 0x7f8c240999f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.674+0000 7f8c29200640 1 --2- 172.21.15.7:0/2216837338 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c2415efc0 0x7f8c240cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.674+0000 7f8c29200640 1 -- 172.21.15.7:0/2216837338 >> 172.21.15.7:0/2216837338 conn(0x7f8c240b3060 msgr2=0x7f8c240b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:53.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.674+0000 7f8c29200640 1 -- 172.21.15.7:0/2216837338 shutdown_connections 2024-04-25T09:54:53.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.674+0000 7f8c29200640 1 -- 172.21.15.7:0/2216837338 wait complete. 2024-04-25T09:54:53.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.676+0000 7f8c29200640 1 Processor -- start 2024-04-25T09:54:53.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.676+0000 7f8c29200640 1 -- start start 2024-04-25T09:54:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.676+0000 7f8c29200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c24099f30 0x7f8c241f1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.676+0000 7f8c29200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c240b3b50 0x7f8c24148a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.677+0000 7f8c29200640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c2415efc0 0x7f8c24070370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.677+0000 7f8c29200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c240b2380 con 0x7f8c240b3b50 2024-04-25T09:54:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.677+0000 7f8c29200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c240b2200 con 0x7f8c24099f30 2024-04-25T09:54:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.677+0000 7f8c29200640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c240b2500 con 0x7f8c2415efc0 2024-04-25T09:54:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.677+0000 7f8c2259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c240b3b50 0x7f8c24148a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.677+0000 7f8c2259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c240b3b50 0x7f8c24148a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52592/0 (socket says 172.21.15.7:52592) 2024-04-25T09:54:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.677+0000 7f8c2259c640 1 -- 172.21.15.7:0/1025244257 learned_addr learned my addr 172.21.15.7:0/1025244257 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.677+0000 7f8c22d9d640 1 --2- 172.21.15.7:0/1025244257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c24099f30 0x7f8c241f1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.677+0000 7f8c2359e640 1 --2- 172.21.15.7:0/1025244257 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c2415efc0 0x7f8c24070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.677+0000 7f8c2259c640 1 -- 172.21.15.7:0/1025244257 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c2415efc0 msgr2=0x7f8c24070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.677+0000 7f8c2259c640 1 --2- 172.21.15.7:0/1025244257 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c2415efc0 0x7f8c24070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.677+0000 7f8c2259c640 1 -- 172.21.15.7:0/1025244257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c24099f30 msgr2=0x7f8c241f1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.677+0000 7f8c2259c640 1 --2- 172.21.15.7:0/1025244257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c24099f30 0x7f8c241f1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.677+0000 7f8c2259c640 1 -- 172.21.15.7:0/1025244257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2415dae0 con 0x7f8c240b3b50 2024-04-25T09:54:53.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.677+0000 7f8c2259c640 1 --2- 172.21.15.7:0/1025244257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c240b3b50 0x7f8c24148a30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c000c00 tx=0x7f8c0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:53.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.677+0000 7f8c1b7fe640 1 -- 172.21.15.7:0/1025244257 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c037040 con 0x7f8c240b3b50 2024-04-25T09:54:53.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.677+0000 7f8c1b7fe640 1 -- 172.21.15.7:0/1025244257 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0c042070 con 0x7f8c240b3b50 2024-04-25T09:54:53.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.677+0000 7f8c29200640 1 -- 172.21.15.7:0/1025244257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c240ca100 con 0x7f8c240b3b50 2024-04-25T09:54:53.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.677+0000 7f8c1b7fe640 1 -- 172.21.15.7:0/1025244257 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c030860 con 0x7f8c240b3b50 2024-04-25T09:54:53.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.677+0000 7f8c29200640 1 -- 172.21.15.7:0/1025244257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c240ca6c0 con 0x7f8c240b3b50 2024-04-25T09:54:53.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.679+0000 7f8c29200640 1 -- 172.21.15.7:0/1025244257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c24068f60 con 0x7f8c240b3b50 2024-04-25T09:54:53.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.679+0000 7f8c1b7fe640 1 -- 172.21.15.7:0/1025244257 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8c0c030a00 con 0x7f8c240b3b50 2024-04-25T09:54:53.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.679+0000 7f8c1b7fe640 1 --2- 172.21.15.7:0/1025244257 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8c0406b4d0 0x7f8c0406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:53.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.679+0000 7f8c1b7fe640 1 -- 172.21.15.7:0/1025244257 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8c0c0aac40 con 0x7f8c240b3b50 2024-04-25T09:54:53.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.680+0000 7f8c22d9d640 1 --2- 172.21.15.7:0/1025244257 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8c0406b4d0 0x7f8c0406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:53.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.680+0000 7f8c22d9d640 1 --2- 172.21.15.7:0/1025244257 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8c0406b4d0 0x7f8c0406d990 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c009b40 tx=0x7f8c1c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:53.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.684+0000 7f8c1b7fe640 1 -- 172.21.15.7:0/1025244257 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8c0c079120 con 0x7f8c240b3b50 2024-04-25T09:54:53.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.862+0000 7f8c29200640 1 -- 172.21.15.7:0/1025244257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8c241f2160 con 0x7f8c240b3b50 2024-04-25T09:54:53.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.862+0000 7f8c1b7fe640 1 -- 172.21.15.7:0/1025244257 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8c0c0aa070 con 0x7f8c240b3b50 2024-04-25T09:54:53.865 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:54:53.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.864+0000 7f8c29200640 1 -- 172.21.15.7:0/1025244257 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8c0406b4d0 msgr2=0x7f8c0406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:53.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.864+0000 7f8c29200640 1 --2- 172.21.15.7:0/1025244257 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8c0406b4d0 0x7f8c0406d990 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c009b40 tx=0x7f8c1c009190 comp rx=0 tx=0).stop 2024-04-25T09:54:53.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.864+0000 7f8c29200640 1 -- 172.21.15.7:0/1025244257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c240b3b50 msgr2=0x7f8c24148a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:53.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.864+0000 7f8c29200640 1 --2- 172.21.15.7:0/1025244257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c240b3b50 0x7f8c24148a30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c000c00 tx=0x7f8c0c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.864+0000 7f8c29200640 1 -- 172.21.15.7:0/1025244257 shutdown_connections 2024-04-25T09:54:53.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.864+0000 7f8c29200640 1 --2- 172.21.15.7:0/1025244257 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8c0406b4d0 0x7f8c0406d990 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.864+0000 7f8c29200640 1 --2- 172.21.15.7:0/1025244257 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c2415efc0 0x7f8c24070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.864+0000 7f8c29200640 1 --2- 172.21.15.7:0/1025244257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c240b3b50 0x7f8c24148a30 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.864+0000 7f8c29200640 1 --2- 172.21.15.7:0/1025244257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c24099f30 0x7f8c241f1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.864+0000 7f8c29200640 1 -- 172.21.15.7:0/1025244257 >> 172.21.15.7:0/1025244257 conn(0x7f8c240b3060 msgr2=0x7f8c240cd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:53.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.864+0000 7f8c29200640 1 -- 172.21.15.7:0/1025244257 shutdown_connections 2024-04-25T09:54:53.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.865+0000 7f8c29200640 1 -- 172.21.15.7:0/1025244257 wait complete. 2024-04-25T09:54:53.878 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:54:53.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.976+0000 7f5b12ff4640 1 Processor -- start 2024-04-25T09:54:53.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.976+0000 7f5b12ff4640 1 -- start start 2024-04-25T09:54:53.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.977+0000 7f5b12ff4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5b0c06c250 0x7f5b0c09a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:53.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.977+0000 7f5b12ff4640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5b0c0d0360 0x7f5b0c0cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:53.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.977+0000 7f5b12ff4640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0c099b20 con 0x7f5b0c06bce0 2024-04-25T09:54:53.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.977+0000 7f5b12ff4640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b0c09ae20 con 0x7f5b0c0d0360 2024-04-25T09:54:53.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.977+0000 7f5b12ff4640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b0c09a450 con 0x7f5b0c06c250 2024-04-25T09:54:53.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.977+0000 7f5b11591640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5b0c0d0360 0x7f5b0c0cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:53.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.977+0000 7f5b11591640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5b0c0d0360 0x7f5b0c0cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52602/0 (socket says 172.21.15.7:52602) 2024-04-25T09:54:53.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.977+0000 7f5b11591640 1 -- 172.21.15.7:0/2626142824 learned_addr learned my addr 172.21.15.7:0/2626142824 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:53.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.977+0000 7f5b10d90640 1 --2- 172.21.15.7:0/2626142824 >> v2:172.21.15.55:3300/0 conn(0x7f5b0c06c250 0x7f5b0c09a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:53.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.977+0000 7f5b11591640 1 -- 172.21.15.7:0/2626142824 >> v2:172.21.15.55:3300/0 conn(0x7f5b0c06c250 msgr2=0x7f5b0c09a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:53.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.977+0000 7f5b11591640 1 --2- 172.21.15.7:0/2626142824 >> v2:172.21.15.55:3300/0 conn(0x7f5b0c06c250 0x7f5b0c09a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.977+0000 7f5b11591640 1 -- 172.21.15.7:0/2626142824 >> v1:172.21.15.55:6789/0 conn(0x7f5b0c06bce0 legacy=0x7f5b0c06c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:53.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.977+0000 7f5b11591640 1 -- 172.21.15.7:0/2626142824 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c099e00 con 0x7f5b0c0d0360 2024-04-25T09:54:53.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.978+0000 7f5b11591640 1 --2- 172.21.15.7:0/2626142824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b0c0d0360 0x7f5b0c0cbd30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c0d27e0 tx=0x7f5afc02a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd0ad84351d070d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:53.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.978+0000 7f5b0b7fe640 1 -- 172.21.15.7:0/2626142824 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc037070 con 0x7f5b0c0d0360 2024-04-25T09:54:53.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.978+0000 7f5b0b7fe640 1 -- 172.21.15.7:0/2626142824 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc032440 con 0x7f5b0c0d0360 2024-04-25T09:54:53.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.978+0000 7f5b0b7fe640 1 -- 172.21.15.7:0/2626142824 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc032810 con 0x7f5b0c0d0360 2024-04-25T09:54:53.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.979+0000 7f5b12ff4640 1 -- 172.21.15.7:0/2626142824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b0c0d0360 msgr2=0x7f5b0c0cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:53.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.979+0000 7f5b12ff4640 1 --2- 172.21.15.7:0/2626142824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b0c0d0360 0x7f5b0c0cbd30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c0d27e0 tx=0x7f5afc02a150 comp rx=0 tx=0).stop 2024-04-25T09:54:53.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.979+0000 7f5b12ff4640 1 -- 172.21.15.7:0/2626142824 shutdown_connections 2024-04-25T09:54:53.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.979+0000 7f5b12ff4640 1 --2- 172.21.15.7:0/2626142824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b0c0d0360 0x7f5b0c0cbd30 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.979+0000 7f5b12ff4640 1 --2- 172.21.15.7:0/2626142824 >> v2:172.21.15.55:3300/0 conn(0x7f5b0c06c250 0x7f5b0c09a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.979+0000 7f5b12ff4640 1 -- 172.21.15.7:0/2626142824 >> 172.21.15.7:0/2626142824 conn(0x7f5b0c0d16e0 msgr2=0x7f5b0c0d1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:53.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.979+0000 7f5b12ff4640 1 -- 172.21.15.7:0/2626142824 shutdown_connections 2024-04-25T09:54:53.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.979+0000 7f5b12ff4640 1 -- 172.21.15.7:0/2626142824 wait complete. 2024-04-25T09:54:53.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.980+0000 7f5b12ff4640 1 Processor -- start 2024-04-25T09:54:53.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.980+0000 7f5b12ff4640 1 -- start start 2024-04-25T09:54:53.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.981+0000 7f5b12ff4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b0c06bce0 0x7f5b0c159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:53.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.981+0000 7f5b12ff4640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5b0c06c250 0x7f5b0c0b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:53.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.981+0000 7f5b12ff4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b0c0d0360 0x7f5b0c0b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:53.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.981+0000 7f5b12ff4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c15f000 con 0x7f5b0c0d0360 2024-04-25T09:54:53.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.981+0000 7f5b12ff4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c0d0c60 con 0x7f5b0c06bce0 2024-04-25T09:54:53.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.981+0000 7f5b12ff4640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c15f180 con 0x7f5b0c06c250 2024-04-25T09:54:53.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.981+0000 7f5b11591640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b0c0d0360 0x7f5b0c0b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:53.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.981+0000 7f5b11591640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b0c0d0360 0x7f5b0c0b59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52606/0 (socket says 172.21.15.7:52606) 2024-04-25T09:54:53.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.981+0000 7f5b11591640 1 -- 172.21.15.7:0/3783900571 learned_addr learned my addr 172.21.15.7:0/3783900571 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:53.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.981+0000 7f5b10d90640 1 --2- 172.21.15.7:0/3783900571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b0c06bce0 0x7f5b0c159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:53.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.981+0000 7f5b0bfff640 1 --2- 172.21.15.7:0/3783900571 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5b0c06c250 0x7f5b0c0b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:53.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.981+0000 7f5b11591640 1 -- 172.21.15.7:0/3783900571 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5b0c06c250 msgr2=0x7f5b0c0b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:53.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.981+0000 7f5b11591640 1 --2- 172.21.15.7:0/3783900571 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5b0c06c250 0x7f5b0c0b54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.981+0000 7f5b11591640 1 -- 172.21.15.7:0/3783900571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b0c06bce0 msgr2=0x7f5b0c159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:53.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.981+0000 7f5b11591640 1 --2- 172.21.15.7:0/3783900571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b0c06bce0 0x7f5b0c159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:53.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.981+0000 7f5b11591640 1 -- 172.21.15.7:0/3783900571 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c15b610 con 0x7f5b0c0d0360 2024-04-25T09:54:53.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.982+0000 7f5b11591640 1 --2- 172.21.15.7:0/3783900571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b0c0d0360 0x7f5b0c0b59f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0090b0 tx=0x7f5afc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:53.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.982+0000 7f5b097fa640 1 -- 172.21.15.7:0/3783900571 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc037040 con 0x7f5b0c0d0360 2024-04-25T09:54:53.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.982+0000 7f5b097fa640 1 -- 172.21.15.7:0/3783900571 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc042070 con 0x7f5b0c0d0360 2024-04-25T09:54:53.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.982+0000 7f5b12ff4640 1 -- 172.21.15.7:0/3783900571 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b0c15b8f0 con 0x7f5b0c0d0360 2024-04-25T09:54:53.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.982+0000 7f5b097fa640 1 -- 172.21.15.7:0/3783900571 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc030900 con 0x7f5b0c0d0360 2024-04-25T09:54:53.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.982+0000 7f5b12ff4640 1 -- 172.21.15.7:0/3783900571 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b0c15beb0 con 0x7f5b0c0d0360 2024-04-25T09:54:53.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.983+0000 7f5b12ff4640 1 -- 172.21.15.7:0/3783900571 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b0c068fd0 con 0x7f5b0c0d0360 2024-04-25T09:54:53.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.983+0000 7f5b097fa640 1 -- 172.21.15.7:0/3783900571 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5afc030aa0 con 0x7f5b0c0d0360 2024-04-25T09:54:53.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.984+0000 7f5b097fa640 1 --2- 172.21.15.7:0/3783900571 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5af806b4d0 0x7f5af806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:53.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.984+0000 7f5b097fa640 1 -- 172.21.15.7:0/3783900571 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f5afc0aad90 con 0x7f5b0c0d0360 2024-04-25T09:54:53.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.984+0000 7f5b10d90640 1 --2- 172.21.15.7:0/3783900571 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5af806b4d0 0x7f5af806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:53.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.984+0000 7f5b10d90640 1 --2- 172.21.15.7:0/3783900571 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5af806b4d0 0x7f5af806d990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c0b7630 tx=0x7f5b0400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:53.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:53.988+0000 7f5b097fa640 1 -- 172.21.15.7:0/3783900571 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5afc045360 con 0x7f5b0c0d0360 2024-04-25T09:54:54.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.209+0000 7f5b12ff4640 1 -- 172.21.15.7:0/3783900571 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b0c0c8240 con 0x7f5b0c0d0360 2024-04-25T09:54:54.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.209+0000 7f5b097fa640 1 -- 172.21.15.7:0/3783900571 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4928 (secure 0 0 0) 0x7f5afc079960 con 0x7f5b0c0d0360 2024-04-25T09:54:54.212 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:54.212 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1968579214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1968579214},{"type":"v1","addr":"172.21.15.7:6837","nonce":1968579214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3479570567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3479570567},{"type":"v1","addr":"172.21.15.55:6834","nonce":3479570567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/2289657027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2289657027},{"type":"v1","addr":"172.21.15.7:6836","nonce":2289657027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:54:27.558601+0000","modified":"2024-04-25T09:54:43.635854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/3779228372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3779228372},{"type":"v1","addr":"172.21.15.55:6835","nonce":3779228372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:54:54.213 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 8 2024-04-25T09:54:54.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.211+0000 7f5b12ff4640 1 -- 172.21.15.7:0/3783900571 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5af806b4d0 msgr2=0x7f5af806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:54.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.211+0000 7f5b12ff4640 1 --2- 172.21.15.7:0/3783900571 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5af806b4d0 0x7f5af806d990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c0b7630 tx=0x7f5b0400b040 comp rx=0 tx=0).stop 2024-04-25T09:54:54.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.211+0000 7f5b12ff4640 1 -- 172.21.15.7:0/3783900571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b0c0d0360 msgr2=0x7f5b0c0b59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:54.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.211+0000 7f5b12ff4640 1 --2- 172.21.15.7:0/3783900571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b0c0d0360 0x7f5b0c0b59f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0090b0 tx=0x7f5afc0046c0 comp rx=0 tx=0).stop 2024-04-25T09:54:54.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.211+0000 7f5b12ff4640 1 -- 172.21.15.7:0/3783900571 shutdown_connections 2024-04-25T09:54:54.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.211+0000 7f5b12ff4640 1 --2- 172.21.15.7:0/3783900571 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5af806b4d0 0x7f5af806d990 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:54.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.211+0000 7f5b12ff4640 1 --2- 172.21.15.7:0/3783900571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b0c0d0360 0x7f5b0c0b59f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:54.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.211+0000 7f5b12ff4640 1 --2- 172.21.15.7:0/3783900571 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5b0c06c250 0x7f5b0c0b54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:54.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.211+0000 7f5b12ff4640 1 --2- 172.21.15.7:0/3783900571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b0c06bce0 0x7f5b0c159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:54.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.211+0000 7f5b12ff4640 1 -- 172.21.15.7:0/3783900571 >> 172.21.15.7:0/3783900571 conn(0x7f5b0c0d16e0 msgr2=0x7f5b0c15ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:54.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.211+0000 7f5b12ff4640 1 -- 172.21.15.7:0/3783900571 shutdown_connections 2024-04-25T09:54:54.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.211+0000 7f5b12ff4640 1 -- 172.21.15.7:0/3783900571 wait complete. 2024-04-25T09:54:54.225 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:54:54.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.323+0000 7f93728e2640 1 Processor -- start 2024-04-25T09:54:54.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.323+0000 7f93728e2640 1 -- start start 2024-04-25T09:54:54.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.324+0000 7f93728e2640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f936c15da60 0x7f936c0d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:54.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.324+0000 7f93728e2640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f936c15e8a0 con 0x7f936c15de40 2024-04-25T09:54:54.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.324+0000 7f93728e2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f936c15eb80 con 0x7f936c15e2d0 2024-04-25T09:54:54.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.324+0000 7f93728e2640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f936c15ee60 con 0x7f936c15da60 2024-04-25T09:54:54.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.324+0000 7f936bfff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f936c15da60 0x7f936c0d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:54.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.324+0000 7f936b7fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f936c15de40 0x7f936c161d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42098/0 (socket says 172.21.15.7:42098) 2024-04-25T09:54:54.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.324+0000 7f936b7fe640 1 -- 172.21.15.7:0/3982294348 learned_addr learned my addr 172.21.15.7:0/3982294348 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:54.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.325+0000 7f936bfff640 1 -- 172.21.15.7:0/3982294348 >> v1:172.21.15.55:6789/0 conn(0x7f936c15e2d0 legacy=0x7f936c0ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:54.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.325+0000 7f936bfff640 1 -- 172.21.15.7:0/3982294348 >> v1:172.21.15.7:6789/0 conn(0x7f936c15de40 legacy=0x7f936c161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:54.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.325+0000 7f936bfff640 1 -- 172.21.15.7:0/3982294348 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936c161850 con 0x7f936c15da60 2024-04-25T09:54:54.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.326+0000 7f936bfff640 1 --2- 172.21.15.7:0/3982294348 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f936c15da60 0x7f936c0d0aa0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f93540097a0 tx=0x7f935402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=247acdcbe2cf480a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:54.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.327+0000 7f936affd640 1 -- 172.21.15.7:0/3982294348 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9354037070 con 0x7f936c15da60 2024-04-25T09:54:54.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.327+0000 7f936affd640 1 -- 172.21.15.7:0/3982294348 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9354032440 con 0x7f936c15da60 2024-04-25T09:54:54.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.327+0000 7f936affd640 1 -- 172.21.15.7:0/3982294348 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9354032810 con 0x7f936c15da60 2024-04-25T09:54:54.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.327+0000 7f93728e2640 1 -- 172.21.15.7:0/3982294348 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f936c15da60 msgr2=0x7f936c0d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:54.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.327+0000 7f93728e2640 1 --2- 172.21.15.7:0/3982294348 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f936c15da60 0x7f936c0d0aa0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f93540097a0 tx=0x7f935402a1a0 comp rx=0 tx=0).stop 2024-04-25T09:54:54.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.327+0000 7f93728e2640 1 -- 172.21.15.7:0/3982294348 shutdown_connections 2024-04-25T09:54:54.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.327+0000 7f93728e2640 1 --2- 172.21.15.7:0/3982294348 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f936c15da60 0x7f936c0d0aa0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:54.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.327+0000 7f93728e2640 1 -- 172.21.15.7:0/3982294348 >> 172.21.15.7:0/3982294348 conn(0x7f936c06bfe0 msgr2=0x7f936c06c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:54.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.327+0000 7f93728e2640 1 -- 172.21.15.7:0/3982294348 shutdown_connections 2024-04-25T09:54:54.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.327+0000 7f93728e2640 1 -- 172.21.15.7:0/3982294348 wait complete. 2024-04-25T09:54:54.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.328+0000 7f93728e2640 1 Processor -- start 2024-04-25T09:54:54.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.329+0000 7f93728e2640 1 -- start start 2024-04-25T09:54:54.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.329+0000 7f93728e2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f936c15da60 0x7f936c1e73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:54.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.329+0000 7f93728e2640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f936c15de40 0x7f936c149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:54.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.329+0000 7f93728e2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f936c15e2d0 0x7f936c1e8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:54.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.329+0000 7f93728e2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936c0cedb0 con 0x7f936c15da60 2024-04-25T09:54:54.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.329+0000 7f93728e2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936c0cec30 con 0x7f936c15e2d0 2024-04-25T09:54:54.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.329+0000 7f93728e2640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936c0d2ca0 con 0x7f936c15de40 2024-04-25T09:54:54.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.329+0000 7f936bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f936c15da60 0x7f936c1e73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:54.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.329+0000 7f936bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f936c15da60 0x7f936c1e73a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52636/0 (socket says 172.21.15.7:52636) 2024-04-25T09:54:54.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.329+0000 7f936bfff640 1 -- 172.21.15.7:0/1206713895 learned_addr learned my addr 172.21.15.7:0/1206713895 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:54.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.329+0000 7f9370e7f640 1 --2- 172.21.15.7:0/1206713895 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f936c15e2d0 0x7f936c1e8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:54.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.330+0000 7f936b7fe640 1 --2- 172.21.15.7:0/1206713895 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f936c15de40 0x7f936c149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:54.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.330+0000 7f936bfff640 1 -- 172.21.15.7:0/1206713895 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f936c15de40 msgr2=0x7f936c149ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:54.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.330+0000 7f936bfff640 1 --2- 172.21.15.7:0/1206713895 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f936c15de40 0x7f936c149ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:54.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.330+0000 7f936bfff640 1 -- 172.21.15.7:0/1206713895 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f936c15e2d0 msgr2=0x7f936c1e8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:54.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.330+0000 7f936bfff640 1 --2- 172.21.15.7:0/1206713895 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f936c15e2d0 0x7f936c1e8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:54.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.330+0000 7f936bfff640 1 -- 172.21.15.7:0/1206713895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936c1f7d40 con 0x7f936c15da60 2024-04-25T09:54:54.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.330+0000 7f936bfff640 1 --2- 172.21.15.7:0/1206713895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f936c15da60 0x7f936c1e73a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9354035040 tx=0x7f93540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:54.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.330+0000 7f9368ff9640 1 -- 172.21.15.7:0/1206713895 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9354037040 con 0x7f936c15da60 2024-04-25T09:54:54.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.330+0000 7f9368ff9640 1 -- 172.21.15.7:0/1206713895 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9354030770 con 0x7f936c15da60 2024-04-25T09:54:54.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.330+0000 7f93728e2640 1 -- 172.21.15.7:0/1206713895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f936c1e7bd0 con 0x7f936c15da60 2024-04-25T09:54:54.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.330+0000 7f9368ff9640 1 -- 172.21.15.7:0/1206713895 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9354030b80 con 0x7f936c15da60 2024-04-25T09:54:54.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.330+0000 7f93728e2640 1 -- 172.21.15.7:0/1206713895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f936c1e8190 con 0x7f936c15da60 2024-04-25T09:54:54.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.331+0000 7f93728e2640 1 -- 172.21.15.7:0/1206713895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f936c068fd0 con 0x7f936c15da60 2024-04-25T09:54:54.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.332+0000 7f9368ff9640 1 -- 172.21.15.7:0/1206713895 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9354044020 con 0x7f936c15da60 2024-04-25T09:54:54.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.332+0000 7f9368ff9640 1 --2- 172.21.15.7:0/1206713895 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f934c06b500 0x7f934c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:54.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.332+0000 7f9368ff9640 1 -- 172.21.15.7:0/1206713895 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f93540aa9b0 con 0x7f936c15da60 2024-04-25T09:54:54.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.332+0000 7f936b7fe640 1 --2- 172.21.15.7:0/1206713895 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f934c06b500 0x7f934c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:54.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.333+0000 7f936b7fe640 1 --2- 172.21.15.7:0/1206713895 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f934c06b500 0x7f934c06d9c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f936c0d3100 tx=0x7f935c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:54.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.336+0000 7f9368ff9640 1 -- 172.21.15.7:0/1206713895 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9354032e20 con 0x7f936c15da60 2024-04-25T09:54:54.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.518+0000 7f93728e2640 1 -- 172.21.15.7:0/1206713895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f936c0d1560 con 0x7f936c15da60 2024-04-25T09:54:54.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.519+0000 7f9368ff9640 1 -- 172.21.15.7:0/1206713895 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18418 (secure 0 0 0) 0x7f9354078ea0 con 0x7f936c15da60 2024-04-25T09:54:54.523 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:54.523 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:54:32.606761+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:54:26.011833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:54:26.535536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:54:30.264996+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:54:54.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.521+0000 7f93728e2640 1 -- 172.21.15.7:0/1206713895 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f934c06b500 msgr2=0x7f934c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:54.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.521+0000 7f93728e2640 1 --2- 172.21.15.7:0/1206713895 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f934c06b500 0x7f934c06d9c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f936c0d3100 tx=0x7f935c009040 comp rx=0 tx=0).stop 2024-04-25T09:54:54.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.521+0000 7f93728e2640 1 -- 172.21.15.7:0/1206713895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f936c15da60 msgr2=0x7f936c1e73a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:54.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.521+0000 7f93728e2640 1 --2- 172.21.15.7:0/1206713895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f936c15da60 0x7f936c1e73a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9354035040 tx=0x7f93540046c0 comp rx=0 tx=0).stop 2024-04-25T09:54:54.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.521+0000 7f93728e2640 1 -- 172.21.15.7:0/1206713895 shutdown_connections 2024-04-25T09:54:54.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.521+0000 7f93728e2640 1 --2- 172.21.15.7:0/1206713895 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f934c06b500 0x7f934c06d9c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:54.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.521+0000 7f93728e2640 1 --2- 172.21.15.7:0/1206713895 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f936c15e2d0 0x7f936c1e8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:54.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.521+0000 7f93728e2640 1 --2- 172.21.15.7:0/1206713895 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f936c15de40 0x7f936c149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:54.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.522+0000 7f93728e2640 1 --2- 172.21.15.7:0/1206713895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f936c15da60 0x7f936c1e73a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:54.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.522+0000 7f93728e2640 1 -- 172.21.15.7:0/1206713895 >> 172.21.15.7:0/1206713895 conn(0x7f936c06bfe0 msgr2=0x7f936c073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:54.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.522+0000 7f93728e2640 1 -- 172.21.15.7:0/1206713895 shutdown_connections 2024-04-25T09:54:54.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.522+0000 7f93728e2640 1 -- 172.21.15.7:0/1206713895 wait complete. 2024-04-25T09:54:54.536 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:54:54.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.634+0000 7f101348f640 1 Processor -- start 2024-04-25T09:54:54.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.634+0000 7f101348f640 1 -- start start 2024-04-25T09:54:54.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.635+0000 7f101348f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f100c15db00 0x7f100c0d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:54.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.635+0000 7f101348f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f100c0ce2b0 0x7f100c0d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:54.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.635+0000 7f101348f640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f100c0d1e80 con 0x7f100c0b53b0 2024-04-25T09:54:54.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.635+0000 7f101348f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f100c0b5930 con 0x7f100c0ce2b0 2024-04-25T09:54:54.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.635+0000 7f101348f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100c0b5c10 con 0x7f100c15db00 2024-04-25T09:54:54.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.635+0000 7f1010a2a640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f100c0b53b0 0x7f100c161670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42108/0 (socket says 172.21.15.7:42108) 2024-04-25T09:54:54.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.635+0000 7f1010a2a640 1 -- 172.21.15.7:0/2193517502 learned_addr learned my addr 172.21.15.7:0/2193517502 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:54.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.635+0000 7f101122b640 1 --2- 172.21.15.7:0/2193517502 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f100c15db00 0x7f100c0d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:54.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.635+0000 7f1011a2c640 1 --2- 172.21.15.7:0/2193517502 >> v2:172.21.15.55:3300/0 conn(0x7f100c0ce2b0 0x7f100c0d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:54.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.635+0000 7f1003fff640 1 -- 172.21.15.7:0/2193517502 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 298084617 0 0) 0x7f100c0d1e80 con 0x7f100c0b53b0 2024-04-25T09:54:54.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.635+0000 7f1003fff640 1 -- 172.21.15.7:0/2193517502 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ff8003520 con 0x7f100c0b53b0 2024-04-25T09:54:54.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.635+0000 7f101122b640 1 -- 172.21.15.7:0/2193517502 >> v2:172.21.15.55:3300/0 conn(0x7f100c0ce2b0 msgr2=0x7f100c0d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:54.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.635+0000 7f101122b640 1 --2- 172.21.15.7:0/2193517502 >> v2:172.21.15.55:3300/0 conn(0x7f100c0ce2b0 0x7f100c0d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:54.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.635+0000 7f101122b640 1 -- 172.21.15.7:0/2193517502 >> v1:172.21.15.7:6789/0 conn(0x7f100c0b53b0 legacy=0x7f100c161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:54.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.635+0000 7f101122b640 1 -- 172.21.15.7:0/2193517502 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100c0b5ef0 con 0x7f100c15db00 2024-04-25T09:54:54.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.635+0000 7f1011a2c640 1 --2- 172.21.15.7:0/2193517502 >> v2:172.21.15.55:3300/0 conn(0x7f100c0ce2b0 0x7f100c0d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:54:54.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.636+0000 7f101122b640 1 --2- 172.21.15.7:0/2193517502 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f100c15db00 0x7f100c0d0340 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f10080097a0 tx=0x7f100802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a576b5e19365ae99 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:54.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.636+0000 7f1003fff640 1 -- 172.21.15.7:0/2193517502 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1008037070 con 0x7f100c15db00 2024-04-25T09:54:54.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.636+0000 7f1003fff640 1 -- 172.21.15.7:0/2193517502 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1008032440 con 0x7f100c15db00 2024-04-25T09:54:54.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.636+0000 7f1003fff640 1 -- 172.21.15.7:0/2193517502 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10080327f0 con 0x7f100c15db00 2024-04-25T09:54:54.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.637+0000 7f101348f640 1 -- 172.21.15.7:0/2193517502 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f100c15db00 msgr2=0x7f100c0d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:54.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.637+0000 7f101348f640 1 --2- 172.21.15.7:0/2193517502 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f100c15db00 0x7f100c0d0340 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f10080097a0 tx=0x7f100802a180 comp rx=0 tx=0).stop 2024-04-25T09:54:54.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.637+0000 7f101348f640 1 -- 172.21.15.7:0/2193517502 shutdown_connections 2024-04-25T09:54:54.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.637+0000 7f101348f640 1 --2- 172.21.15.7:0/2193517502 >> v2:172.21.15.55:3300/0 conn(0x7f100c0ce2b0 0x7f100c0d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:54.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.637+0000 7f101348f640 1 --2- 172.21.15.7:0/2193517502 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f100c15db00 0x7f100c0d0340 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:54.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.637+0000 7f101348f640 1 -- 172.21.15.7:0/2193517502 >> 172.21.15.7:0/2193517502 conn(0x7f100c072290 msgr2=0x7f100c0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:54.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.637+0000 7f101348f640 1 -- 172.21.15.7:0/2193517502 shutdown_connections 2024-04-25T09:54:54.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.637+0000 7f101348f640 1 -- 172.21.15.7:0/2193517502 wait complete. 2024-04-25T09:54:54.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.638+0000 7f101348f640 1 Processor -- start 2024-04-25T09:54:54.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.638+0000 7f101348f640 1 -- start start 2024-04-25T09:54:54.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.639+0000 7f101348f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f100c0b53b0 0x7f100c1606c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:54.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.639+0000 7f101348f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f100c0ce2b0 0x7f100c1f46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:54.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.639+0000 7f101348f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f100c15db00 0x7f100c14e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:54.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.639+0000 7f101348f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100c0d3660 con 0x7f100c0b53b0 2024-04-25T09:54:54.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.639+0000 7f101348f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100c0b61d0 con 0x7f100c15db00 2024-04-25T09:54:54.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.639+0000 7f101348f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100c0b6c10 con 0x7f100c0ce2b0 2024-04-25T09:54:54.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.639+0000 7f101122b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f100c0b53b0 0x7f100c1606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:54.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.639+0000 7f101122b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f100c0b53b0 0x7f100c1606c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52642/0 (socket says 172.21.15.7:52642) 2024-04-25T09:54:54.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.639+0000 7f101122b640 1 -- 172.21.15.7:0/2851737596 learned_addr learned my addr 172.21.15.7:0/2851737596 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:54.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.639+0000 7f101122b640 1 -- 172.21.15.7:0/2851737596 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f100c0ce2b0 msgr2=0x7f100c1f46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:54.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.639+0000 7f101122b640 1 --2- 172.21.15.7:0/2851737596 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f100c0ce2b0 0x7f100c1f46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:54.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.639+0000 7f101122b640 1 -- 172.21.15.7:0/2851737596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f100c15db00 msgr2=0x7f100c14e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:54.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.639+0000 7f101122b640 1 --2- 172.21.15.7:0/2851737596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f100c15db00 0x7f100c14e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:54.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.639+0000 7f101122b640 1 -- 172.21.15.7:0/2851737596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100c15f920 con 0x7f100c0b53b0 2024-04-25T09:54:54.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.639+0000 7f101122b640 1 --2- 172.21.15.7:0/2851737596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f100c0b53b0 0x7f100c1606c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1008035040 tx=0x7f10080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:54.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.639+0000 7f1001ffb640 1 -- 172.21.15.7:0/2851737596 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1008037040 con 0x7f100c0b53b0 2024-04-25T09:54:54.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.640+0000 7f1001ffb640 1 -- 172.21.15.7:0/2851737596 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10080044c0 con 0x7f100c0b53b0 2024-04-25T09:54:54.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.640+0000 7f101348f640 1 -- 172.21.15.7:0/2851737596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f100c15fc00 con 0x7f100c0b53b0 2024-04-25T09:54:54.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.640+0000 7f1001ffb640 1 -- 172.21.15.7:0/2851737596 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1008003e10 con 0x7f100c0b53b0 2024-04-25T09:54:54.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.640+0000 7f101348f640 1 -- 172.21.15.7:0/2851737596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f100c1601c0 con 0x7f100c0b53b0 2024-04-25T09:54:54.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.641+0000 7f101348f640 1 -- 172.21.15.7:0/2851737596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f100c068fd0 con 0x7f100c0b53b0 2024-04-25T09:54:54.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.641+0000 7f1001ffb640 1 -- 172.21.15.7:0/2851737596 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1008044020 con 0x7f100c0b53b0 2024-04-25T09:54:54.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.642+0000 7f1001ffb640 1 --2- 172.21.15.7:0/2851737596 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0ff006b4d0 0x7f0ff006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:54.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.642+0000 7f1001ffb640 1 -- 172.21.15.7:0/2851737596 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f10080aa7a0 con 0x7f100c0b53b0 2024-04-25T09:54:54.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.642+0000 7f1010a2a640 1 --2- 172.21.15.7:0/2851737596 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0ff006b4d0 0x7f0ff006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:54.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.642+0000 7f1010a2a640 1 --2- 172.21.15.7:0/2851737596 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0ff006b4d0 0x7f0ff006d990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc000f60 tx=0x7f0ffc0078f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:54.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.646+0000 7f1001ffb640 1 -- 172.21.15.7:0/2851737596 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1008079360 con 0x7f100c0b53b0 2024-04-25T09:54:54.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.869+0000 7f101348f640 1 -- 172.21.15.7:0/2851737596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f100c0d3130 con 0x7f100c0b53b0 2024-04-25T09:54:54.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.869+0000 7f1001ffb640 1 -- 172.21.15.7:0/2851737596 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4928 (secure 0 0 0) 0x7f1008078c60 con 0x7f100c0b53b0 2024-04-25T09:54:54.872 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:54:54.872 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1968579214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1968579214},{"type":"v1","addr":"172.21.15.7:6837","nonce":1968579214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3479570567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3479570567},{"type":"v1","addr":"172.21.15.55:6834","nonce":3479570567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/2289657027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2289657027},{"type":"v1","addr":"172.21.15.7:6836","nonce":2289657027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:54:27.558601+0000","modified":"2024-04-25T09:54:43.635854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/3779228372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3779228372},{"type":"v1","addr":"172.21.15.55:6835","nonce":3779228372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:54:54.872 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 8 2024-04-25T09:54:54.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.871+0000 7f101348f640 1 -- 172.21.15.7:0/2851737596 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0ff006b4d0 msgr2=0x7f0ff006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:54.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.871+0000 7f101348f640 1 --2- 172.21.15.7:0/2851737596 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0ff006b4d0 0x7f0ff006d990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc000f60 tx=0x7f0ffc0078f0 comp rx=0 tx=0).stop 2024-04-25T09:54:54.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.871+0000 7f101348f640 1 -- 172.21.15.7:0/2851737596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f100c0b53b0 msgr2=0x7f100c1606c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:54.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.871+0000 7f101348f640 1 --2- 172.21.15.7:0/2851737596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f100c0b53b0 0x7f100c1606c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1008035040 tx=0x7f10080046c0 comp rx=0 tx=0).stop 2024-04-25T09:54:54.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.871+0000 7f101348f640 1 -- 172.21.15.7:0/2851737596 shutdown_connections 2024-04-25T09:54:54.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.871+0000 7f101348f640 1 --2- 172.21.15.7:0/2851737596 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0ff006b4d0 0x7f0ff006d990 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:54.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.871+0000 7f101348f640 1 --2- 172.21.15.7:0/2851737596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f100c15db00 0x7f100c14e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:54.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.871+0000 7f101348f640 1 --2- 172.21.15.7:0/2851737596 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f100c0ce2b0 0x7f100c1f46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:54.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.871+0000 7f101348f640 1 --2- 172.21.15.7:0/2851737596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f100c0b53b0 0x7f100c1606c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:54.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.871+0000 7f101348f640 1 -- 172.21.15.7:0/2851737596 >> 172.21.15.7:0/2851737596 conn(0x7f100c072290 msgr2=0x7f100c0c8330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:54.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.871+0000 7f101348f640 1 -- 172.21.15.7:0/2851737596 shutdown_connections 2024-04-25T09:54:54.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:54.871+0000 7f101348f640 1 -- 172.21.15.7:0/2851737596 wait complete. 2024-04-25T09:54:55.288 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:54:27.558601+0000', 'modified': '2024-04-25T09:54:43.635854+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4293}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4293': {'gid': 4293, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6835/3779228372', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6833', 'nonce': 3779228372}, {'type': 'v1', 'addr': '172.21.15.55:6835', 'nonce': 3779228372}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:54:55.288 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:54:55.288 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T09:54:55.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.391+0000 7f29d3d7e640 1 Processor -- start 2024-04-25T09:54:55.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.391+0000 7f29d3d7e640 1 -- start start 2024-04-25T09:54:55.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.392+0000 7f29d3d7e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f29cc15db00 0x7f29cc0d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:55.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.392+0000 7f29d3d7e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f29cc0b53b0 0x7f29cc0d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:55.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.392+0000 7f29d3d7e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f29cc0ce2b0 0x7f29cc161670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:55.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.392+0000 7f29d3d7e640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29cc0d1e80 con 0x7f29cc15db00 2024-04-25T09:54:55.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.392+0000 7f29d3d7e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29cc0b5930 con 0x7f29cc0b53b0 2024-04-25T09:54:55.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.392+0000 7f29d3d7e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc0b5c10 con 0x7f29cc0ce2b0 2024-04-25T09:54:55.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.392+0000 7f29d1b1a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f29cc15db00 0x7f29cc0d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:55.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.392+0000 7f29d1b1a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f29cc15db00 0x7f29cc0d0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52652/0 (socket says 172.21.15.7:52652) 2024-04-25T09:54:55.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.392+0000 7f29d1b1a640 1 -- 172.21.15.7:0/1686404906 learned_addr learned my addr 172.21.15.7:0/1686404906 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:55.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.392+0000 7f29d1319640 1 --2- 172.21.15.7:0/1686404906 >> v2:172.21.15.55:3300/0 conn(0x7f29cc0b53b0 0x7f29cc0d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:55.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.392+0000 7f29d231b640 1 --2- 172.21.15.7:0/1686404906 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f29cc0ce2b0 0x7f29cc161670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:55.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.392+0000 7f29d1b1a640 1 -- 172.21.15.7:0/1686404906 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f29cc0ce2b0 msgr2=0x7f29cc161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:55.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.392+0000 7f29d1b1a640 1 --2- 172.21.15.7:0/1686404906 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f29cc0ce2b0 0x7f29cc161670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.392+0000 7f29d1b1a640 1 -- 172.21.15.7:0/1686404906 >> v2:172.21.15.55:3300/0 conn(0x7f29cc0b53b0 msgr2=0x7f29cc0d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:55.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.392+0000 7f29d1b1a640 1 --2- 172.21.15.7:0/1686404906 >> v2:172.21.15.55:3300/0 conn(0x7f29cc0b53b0 0x7f29cc0d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.392+0000 7f29d1b1a640 1 -- 172.21.15.7:0/1686404906 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29cc0b5ef0 con 0x7f29cc15db00 2024-04-25T09:54:55.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.393+0000 7f29d1b1a640 1 --2- 172.21.15.7:0/1686404906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29cc15db00 0x7f29cc0d0340 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0d4a00 tx=0x7f29c802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e198046400342a72 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:55.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.393+0000 7f29d0b18640 1 -- 172.21.15.7:0/1686404906 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c8037070 con 0x7f29cc15db00 2024-04-25T09:54:55.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.393+0000 7f29d0b18640 1 -- 172.21.15.7:0/1686404906 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c8032440 con 0x7f29cc15db00 2024-04-25T09:54:55.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.393+0000 7f29d0b18640 1 -- 172.21.15.7:0/1686404906 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c8032810 con 0x7f29cc15db00 2024-04-25T09:54:55.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.394+0000 7f29d3d7e640 1 -- 172.21.15.7:0/1686404906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29cc15db00 msgr2=0x7f29cc0d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:55.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.394+0000 7f29d3d7e640 1 --2- 172.21.15.7:0/1686404906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29cc15db00 0x7f29cc0d0340 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0d4a00 tx=0x7f29c802a1e0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.394+0000 7f29d3d7e640 1 -- 172.21.15.7:0/1686404906 shutdown_connections 2024-04-25T09:54:55.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.394+0000 7f29d3d7e640 1 --2- 172.21.15.7:0/1686404906 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f29cc0ce2b0 0x7f29cc161670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.394+0000 7f29d3d7e640 1 --2- 172.21.15.7:0/1686404906 >> v2:172.21.15.55:3300/0 conn(0x7f29cc0b53b0 0x7f29cc0d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.394+0000 7f29d3d7e640 1 --2- 172.21.15.7:0/1686404906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29cc15db00 0x7f29cc0d0340 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.394+0000 7f29d3d7e640 1 -- 172.21.15.7:0/1686404906 >> 172.21.15.7:0/1686404906 conn(0x7f29cc072290 msgr2=0x7f29cc0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:55.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.394+0000 7f29d3d7e640 1 -- 172.21.15.7:0/1686404906 shutdown_connections 2024-04-25T09:54:55.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.394+0000 7f29d3d7e640 1 -- 172.21.15.7:0/1686404906 wait complete. 2024-04-25T09:54:55.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.395+0000 7f29d3d7e640 1 Processor -- start 2024-04-25T09:54:55.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.395+0000 7f29d3d7e640 1 -- start start 2024-04-25T09:54:55.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.396+0000 7f29d3d7e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29cc0b53b0 0x7f29cc14e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:55.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.396+0000 7f29d3d7e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f29cc0ce2b0 0x7f29cc15f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:55.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.396+0000 7f29d3d7e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29cc15db00 0x7f29cc14e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:55.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.396+0000 7f29d3d7e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc0d3660 con 0x7f29cc15db00 2024-04-25T09:54:55.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.396+0000 7f29d3d7e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc0b61d0 con 0x7f29cc0b53b0 2024-04-25T09:54:55.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.396+0000 7f29d3d7e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc0b6c10 con 0x7f29cc0ce2b0 2024-04-25T09:54:55.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.396+0000 7f29d231b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29cc15db00 0x7f29cc14e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:55.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.396+0000 7f29d231b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29cc15db00 0x7f29cc14e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52658/0 (socket says 172.21.15.7:52658) 2024-04-25T09:54:55.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.396+0000 7f29d231b640 1 -- 172.21.15.7:0/3899363856 learned_addr learned my addr 172.21.15.7:0/3899363856 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:55.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.396+0000 7f29d1b1a640 1 --2- 172.21.15.7:0/3899363856 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29cc0b53b0 0x7f29cc14e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:55.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.396+0000 7f29d1319640 1 --2- 172.21.15.7:0/3899363856 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f29cc0ce2b0 0x7f29cc15f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:55.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.396+0000 7f29d231b640 1 -- 172.21.15.7:0/3899363856 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f29cc0ce2b0 msgr2=0x7f29cc15f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:55.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.396+0000 7f29d231b640 1 --2- 172.21.15.7:0/3899363856 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f29cc0ce2b0 0x7f29cc15f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.396+0000 7f29d231b640 1 -- 172.21.15.7:0/3899363856 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29cc0b53b0 msgr2=0x7f29cc14e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:55.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.396+0000 7f29d231b640 1 --2- 172.21.15.7:0/3899363856 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29cc0b53b0 0x7f29cc14e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.396+0000 7f29d231b640 1 -- 172.21.15.7:0/3899363856 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29cc15fb90 con 0x7f29cc15db00 2024-04-25T09:54:55.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.396+0000 7f29d231b640 1 --2- 172.21.15.7:0/3899363856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29cc15db00 0x7f29cc14e7b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f29c400efc0 tx=0x7f29c400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:55.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.396+0000 7f29c27fc640 1 -- 172.21.15.7:0/3899363856 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c4018020 con 0x7f29cc15db00 2024-04-25T09:54:55.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.396+0000 7f29c27fc640 1 -- 172.21.15.7:0/3899363856 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c4014480 con 0x7f29cc15db00 2024-04-25T09:54:55.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.396+0000 7f29d3d7e640 1 -- 172.21.15.7:0/3899363856 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29cc15fe70 con 0x7f29cc15db00 2024-04-25T09:54:55.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.396+0000 7f29c27fc640 1 -- 172.21.15.7:0/3899363856 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c4014870 con 0x7f29cc15db00 2024-04-25T09:54:55.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.397+0000 7f29d3d7e640 1 -- 172.21.15.7:0/3899363856 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29cc160430 con 0x7f29cc15db00 2024-04-25T09:54:55.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.398+0000 7f29c27fc640 1 -- 172.21.15.7:0/3899363856 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f29c4005d10 con 0x7f29cc15db00 2024-04-25T09:54:55.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.399+0000 7f29c27fc640 1 --2- 172.21.15.7:0/3899363856 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f29b006b4d0 0x7f29b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:55.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.399+0000 7f29d1b1a640 1 --2- 172.21.15.7:0/3899363856 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f29b006b4d0 0x7f29b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:55.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.399+0000 7f29c27fc640 1 -- 172.21.15.7:0/3899363856 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f29c408aea0 con 0x7f29cc15db00 2024-04-25T09:54:55.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.399+0000 7f29d1b1a640 1 --2- 172.21.15.7:0/3899363856 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f29b006b4d0 0x7f29b006d990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f29c8034000 tx=0x7f29c802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:55.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.400+0000 7f29d6722740 1 Processor -- start 2024-04-25T09:54:55.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.400+0000 7f29d6722740 1 -- start start 2024-04-25T09:54:55.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.400+0000 7f29d6722740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b718a92230 0x55b718a92610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:55.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.401+0000 7f29d6722740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b718aafad0 0x55b718ab0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:55.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.401+0000 7f29d6722740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b718a67f10 0x55b718aae190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:55.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.401+0000 7f29d6722740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7189caa10 con 0x55b718a92230 2024-04-25T09:54:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.401+0000 7f29d6722740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b718973b30 con 0x55b718a67f10 2024-04-25T09:54:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.401+0000 7f29d6722740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b7189c6c50 con 0x55b718aafad0 2024-04-25T09:54:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.401+0000 7f29d1b1a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b718a92230 0x55b718a92610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.401+0000 7f29d1b1a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b718a92230 0x55b718a92610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52668/0 (socket says 172.21.15.7:52668) 2024-04-25T09:54:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.401+0000 7f29d1b1a640 1 -- 172.21.15.7:0/3380643806 learned_addr learned my addr 172.21.15.7:0/3380643806 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.401+0000 7f29d231b640 1 --2- 172.21.15.7:0/3380643806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b718a67f10 0x55b718aae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.401+0000 7f29d1319640 1 --2- 172.21.15.7:0/3380643806 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b718aafad0 0x55b718ab0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.401+0000 7f29d1b1a640 1 -- 172.21.15.7:0/3380643806 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b718aafad0 msgr2=0x55b718ab0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.401+0000 7f29d1b1a640 1 --2- 172.21.15.7:0/3380643806 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b718aafad0 0x55b718ab0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.401+0000 7f29d1b1a640 1 -- 172.21.15.7:0/3380643806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b718a67f10 msgr2=0x55b718aae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.401+0000 7f29d1b1a640 1 --2- 172.21.15.7:0/3380643806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b718a67f10 0x55b718aae190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.401+0000 7f29d1b1a640 1 -- 172.21.15.7:0/3380643806 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b718988e10 con 0x55b718a92230 2024-04-25T09:54:55.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.401+0000 7f29d231b640 1 --2- 172.21.15.7:0/3380643806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b718a67f10 0x55b718aae190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:54:55.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.401+0000 7f29d1b1a640 1 --2- 172.21.15.7:0/3380643806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b718a92230 0x55b718a92610 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f29c802a220 tx=0x7f29c802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf6475f2fb9f446 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:55.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.401+0000 7f29af7fe640 1 -- 172.21.15.7:0/3380643806 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c804e070 con 0x55b718a92230 2024-04-25T09:54:55.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.401+0000 7f29af7fe640 1 -- 172.21.15.7:0/3380643806 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c8032a90 con 0x55b718a92230 2024-04-25T09:54:55.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.401+0000 7f29af7fe640 1 -- 172.21.15.7:0/3380643806 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c8037040 con 0x55b718a92230 2024-04-25T09:54:55.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.402+0000 7f29d6722740 1 -- 172.21.15.7:0/3380643806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b718a92230 msgr2=0x55b718a92610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:55.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.402+0000 7f29d6722740 1 --2- 172.21.15.7:0/3380643806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b718a92230 0x55b718a92610 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f29c802a220 tx=0x7f29c802c000 comp rx=0 tx=0).stop 2024-04-25T09:54:55.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.402+0000 7f29d6722740 1 -- 172.21.15.7:0/3380643806 shutdown_connections 2024-04-25T09:54:55.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.402+0000 7f29d6722740 1 --2- 172.21.15.7:0/3380643806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b718a67f10 0x55b718aae190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.402+0000 7f29d6722740 1 --2- 172.21.15.7:0/3380643806 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b718aafad0 0x55b718ab0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.402+0000 7f29d6722740 1 --2- 172.21.15.7:0/3380643806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b718a92230 0x55b718a92610 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.402+0000 7f29d6722740 1 -- 172.21.15.7:0/3380643806 >> 172.21.15.7:0/3380643806 conn(0x55b718a64840 msgr2=0x55b718aad040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.402+0000 7f29d6722740 1 -- 172.21.15.7:0/3380643806 shutdown_connections 2024-04-25T09:54:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.402+0000 7f29d6722740 1 -- 172.21.15.7:0/3380643806 wait complete. 2024-04-25T09:54:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.403+0000 7f29d6722740 1 -- start start 2024-04-25T09:54:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.403+0000 7f29d6722740 1 Processor -- start 2024-04-25T09:54:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.403+0000 7f29d6722740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b718a92230 0x55b718a94f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.403+0000 7f29d6722740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b718aafad0 0x55b718aa8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.404+0000 7f29d6722740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b718a85a30 0x55b718ab05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.404+0000 7f29d6722740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b718a68cb0 con 0x55b718aafad0 2024-04-25T09:54:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.404+0000 7f29d6722740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7189870c0 con 0x55b718a85a30 2024-04-25T09:54:55.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.404+0000 7f29d6722740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b718a62770 con 0x55b718a92230 2024-04-25T09:54:55.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.404+0000 7f29d1319640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b718aafad0 0x55b718aa8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:55.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.404+0000 7f29d6722740 10 client.0 _ll_register_callbacks cb 0x55b71897aec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:54:55.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.404+0000 7f29d1319640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b718aafad0 0x55b718aa8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52680/0 (socket says 172.21.15.7:52680) 2024-04-25T09:54:55.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.404+0000 7f29d1319640 1 -- 172.21.15.7:0/4134321722 learned_addr learned my addr 172.21.15.7:0/4134321722 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:55.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.404+0000 7f29d1b1a640 1 --2- 172.21.15.7:0/4134321722 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b718a92230 0x55b718a94f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:55.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.404+0000 7f29d231b640 1 --2- 172.21.15.7:0/4134321722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b718a85a30 0x55b718ab05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:55.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.404+0000 7f29d1319640 1 -- 172.21.15.7:0/4134321722 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b718a92230 msgr2=0x55b718a94f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:55.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.404+0000 7f29d1319640 1 --2- 172.21.15.7:0/4134321722 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b718a92230 0x55b718a94f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.404+0000 7f29d1319640 1 -- 172.21.15.7:0/4134321722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b718a85a30 msgr2=0x55b718ab05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:55.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.404+0000 7f29d1319640 1 --2- 172.21.15.7:0/4134321722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b718a85a30 0x55b718ab05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.404+0000 7f29d1319640 1 -- 172.21.15.7:0/4134321722 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b7186df2d0 con 0x55b718aafad0 2024-04-25T09:54:55.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.404+0000 7f29d1319640 1 --2- 172.21.15.7:0/4134321722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b718aafad0 0x55b718aa8120 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0cdee0 tx=0x7f29bc013970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b482a05909620e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:55.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.404+0000 7f29acff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:54:55.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.404+0000 7f29acff9640 1 -- 172.21.15.7:0/4134321722 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc004300 con 0x55b718aafad0 2024-04-25T09:54:55.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.404+0000 7f29acff9640 1 -- 172.21.15.7:0/4134321722 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f29bc003610 con 0x55b718aafad0 2024-04-25T09:54:55.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.404+0000 7f29d6722740 1 -- 172.21.15.7:0/4134321722 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f29c8032a90 con 0x55b718aafad0 2024-04-25T09:54:55.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.404+0000 7f29acff9640 1 -- 172.21.15.7:0/4134321722 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29bc027050 con 0x55b718aafad0 2024-04-25T09:54:55.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.404+0000 7f29d6722740 10 client.4887 fetch_fsmap learned FSMap version 8 2024-04-25T09:54:55.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.404+0000 7f29d6722740 1 -- 172.21.15.7:0/4134321722 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55b7187a96b0 con 0x55b718aafad0 2024-04-25T09:54:55.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.405+0000 7f29acff9640 1 -- 172.21.15.7:0/4134321722 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c8032a90 con 0x55b718aafad0 2024-04-25T09:54:55.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.405+0000 7f29acff9640 1 -- 172.21.15.7:0/4134321722 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 8) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f29bc02a020 con 0x55b718aafad0 2024-04-25T09:54:55.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.405+0000 7f29d6722740 10 client.4887 fetch_fsmap finished waiting for FSMap version 8 2024-04-25T09:54:55.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.405+0000 7f29d6722740 10 client.4887 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T09:54:55.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.405+0000 7f29d6722740 20 client.4887 populate_metadata read hostname 'smithi007' 2024-04-25T09:54:55.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.405+0000 7f29d6722740 1 --2- 172.21.15.7:0/4134321722 >> [v2:172.21.15.55:6833/3779228372,v1:172.21.15.55:6835/3779228372] conn(0x55b718aa5bb0 0x55b718aa5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:55.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.405+0000 7f29d6722740 4 client.4887 mds_command: new command op to 4293 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:54:55.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.405+0000 7f29d6722740 1 -- 172.21.15.7:0/4134321722 --> [v2:172.21.15.55:6833/3779228372,v1:172.21.15.55:6835/3779228372] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b718a29920 con 0x55b718aa5bb0 2024-04-25T09:54:55.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.405+0000 7f29d1b1a640 1 --2- 172.21.15.7:0/4134321722 >> [v2:172.21.15.55:6833/3779228372,v1:172.21.15.55:6835/3779228372] conn(0x55b718aa5bb0 0x55b718aa5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:55.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.405+0000 7f29acff9640 10 client.4887 ms_handle_connect on v2:172.21.15.55:6833/3779228372 2024-04-25T09:54:55.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.405+0000 7f29d1b1a640 1 --2- 172.21.15.7:0/4134321722 >> [v2:172.21.15.55:6833/3779228372,v1:172.21.15.55:6835/3779228372] conn(0x55b718aa5bb0 0x55b718aa5f90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c281e0c6afadcb6 server_cookie=d8da97f00af32a4d in_seq=0 out_seq=0 2024-04-25T09:54:55.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.406+0000 7f29acff9640 1 -- 172.21.15.7:0/4134321722 <== mds.0 v2:172.21.15.55:6833/3779228372 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b718a29920 con 0x55b718aa5bb0 2024-04-25T09:54:55.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.406+0000 7f29acff9640 10 client.4887 handle_command_reply: tid=0 2024-04-25T09:54:55.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.406+0000 7f29d6722740 1 client.4887 shutdown 2024-04-25T09:54:55.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.406+0000 7f29d6722740 1 -- 172.21.15.7:0/4134321722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b718aafad0 msgr2=0x55b718aa8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:55.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.406+0000 7f29d6722740 1 --2- 172.21.15.7:0/4134321722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b718aafad0 0x55b718aa8120 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0cdee0 tx=0x7f29bc013970 comp rx=0 tx=0).stop 2024-04-25T09:54:55.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.406+0000 7f29d6722740 1 -- 172.21.15.7:0/4134321722 shutdown_connections 2024-04-25T09:54:55.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.406+0000 7f29d6722740 1 --2- 172.21.15.7:0/4134321722 >> [v2:172.21.15.55:6833/3779228372,v1:172.21.15.55:6835/3779228372] conn(0x55b718aa5bb0 0x55b718aa5f90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.406+0000 7f29d6722740 1 --2- 172.21.15.7:0/4134321722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b718a85a30 0x55b718ab05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.406+0000 7f29d6722740 1 --2- 172.21.15.7:0/4134321722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b718aafad0 0x55b718aa8120 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.406+0000 7f29acff9640 0 client.4887 ms_handle_reset on v2:172.21.15.55:6833/3779228372 2024-04-25T09:54:55.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.406+0000 7f29d6722740 1 --2- 172.21.15.7:0/4134321722 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b718a92230 0x55b718a94f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.406+0000 7f29d6722740 1 -- 172.21.15.7:0/4134321722 >> 172.21.15.7:0/4134321722 conn(0x55b718a67f10 msgr2=0x55b718a667f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:55.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.406+0000 7f29d6722740 1 -- 172.21.15.7:0/4134321722 shutdown_connections 2024-04-25T09:54:55.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.406+0000 7f29d6722740 1 -- 172.21.15.7:0/4134321722 wait complete. 2024-04-25T09:54:55.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.406+0000 7f29d6722740 20 client.4887 trim_cache size 0 max 16384 2024-04-25T09:54:55.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.422+0000 7f29d6722740 1 Processor -- start 2024-04-25T09:54:55.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.422+0000 7f29d6722740 1 -- start start 2024-04-25T09:54:55.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.423+0000 7f29d6722740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b718a85a30 0x55b718aa44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:55.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.423+0000 7f29d6722740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b718a92230 0x55b718aa49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:55.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.423+0000 7f29d6722740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b718aafad0 0x55b718abc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:55.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.423+0000 7f29d6722740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc2003a0 con 0x55b718a92230 2024-04-25T09:54:55.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.423+0000 7f29d6722740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc1ff7a0 con 0x55b718a85a30 2024-04-25T09:54:55.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.423+0000 7f29d6722740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc1ffda0 con 0x55b718aafad0 2024-04-25T09:54:55.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.423+0000 7f29d1319640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b718a92230 0x55b718aa49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:55.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.423+0000 7f29d1319640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b718a92230 0x55b718aa49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52682/0 (socket says 172.21.15.7:52682) 2024-04-25T09:54:55.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.423+0000 7f29d1319640 1 -- 172.21.15.7:0/21164378 learned_addr learned my addr 172.21.15.7:0/21164378 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:55.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.423+0000 7f29d1b1a640 1 --2- 172.21.15.7:0/21164378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b718a85a30 0x55b718aa44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:55.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.423+0000 7f29d231b640 1 --2- 172.21.15.7:0/21164378 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b718aafad0 0x55b718abc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:55.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.423+0000 7f29d1319640 1 -- 172.21.15.7:0/21164378 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b718aafad0 msgr2=0x55b718abc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:55.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.423+0000 7f29d1319640 1 --2- 172.21.15.7:0/21164378 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b718aafad0 0x55b718abc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.423+0000 7f29d1319640 1 -- 172.21.15.7:0/21164378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b718a85a30 msgr2=0x55b718aa44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:55.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.423+0000 7f29d1319640 1 --2- 172.21.15.7:0/21164378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b718a85a30 0x55b718aa44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.423+0000 7f29d1319640 1 -- 172.21.15.7:0/21164378 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b718aa3f20 con 0x55b718a92230 2024-04-25T09:54:55.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.424+0000 7f29d1319640 1 --2- 172.21.15.7:0/21164378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b718a92230 0x55b718aa49e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f29bc006f30 tx=0x7f29bc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9208d480bb4dd1a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:55.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.424+0000 7f29aeffd640 1 -- 172.21.15.7:0/21164378 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc02f070 con 0x55b718a92230 2024-04-25T09:54:55.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.424+0000 7f29aeffd640 1 -- 172.21.15.7:0/21164378 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29bc003610 con 0x55b718a92230 2024-04-25T09:54:55.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.424+0000 7f29aeffd640 1 -- 172.21.15.7:0/21164378 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc0037c0 con 0x55b718a92230 2024-04-25T09:54:55.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.424+0000 7f29d6722740 1 -- 172.21.15.7:0/21164378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b718a92230 msgr2=0x55b718aa49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:55.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.424+0000 7f29d6722740 1 --2- 172.21.15.7:0/21164378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b718a92230 0x55b718aa49e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f29bc006f30 tx=0x7f29bc01a000 comp rx=0 tx=0).stop 2024-04-25T09:54:55.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.424+0000 7f29d6722740 1 -- 172.21.15.7:0/21164378 shutdown_connections 2024-04-25T09:54:55.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.424+0000 7f29d6722740 1 --2- 172.21.15.7:0/21164378 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b718aafad0 0x55b718abc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.424+0000 7f29d6722740 1 --2- 172.21.15.7:0/21164378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b718a92230 0x55b718aa49e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.424+0000 7f29d6722740 1 --2- 172.21.15.7:0/21164378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b718a85a30 0x55b718aa44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.424+0000 7f29d6722740 1 -- 172.21.15.7:0/21164378 >> 172.21.15.7:0/21164378 conn(0x55b718a67f10 msgr2=0x55b718ad0010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:55.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.424+0000 7f29d6722740 1 -- 172.21.15.7:0/21164378 shutdown_connections 2024-04-25T09:54:55.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.424+0000 7f29d6722740 1 -- 172.21.15.7:0/21164378 wait complete. 2024-04-25T09:54:55.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.425+0000 7f29d6722740 1 -- start start 2024-04-25T09:54:55.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.425+0000 7f29d6722740 1 Processor -- start 2024-04-25T09:54:55.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.426+0000 7f29d6722740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b718a85a30 0x55b718a90520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:55.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.426+0000 7f29d6722740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b718a92230 0x55b718a90a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:55.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.426+0000 7f29d6722740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b718aafad0 0x55b718a83ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:55.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.426+0000 7f29d6722740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b718aa6900 con 0x55b718a85a30 2024-04-25T09:54:55.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.426+0000 7f29d6722740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b718a95da0 con 0x55b718a92230 2024-04-25T09:54:55.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.426+0000 7f29d6722740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b718ac1350 con 0x55b718aafad0 2024-04-25T09:54:55.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.426+0000 7f29d6722740 10 client.0 _ll_register_callbacks cb 0x55b718a62c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:54:55.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.426+0000 7f29d1b1a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b718a85a30 0x55b718a90520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:55.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.426+0000 7f29d1b1a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b718a85a30 0x55b718a90520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52694/0 (socket says 172.21.15.7:52694) 2024-04-25T09:54:55.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.426+0000 7f29d1b1a640 1 -- 172.21.15.7:0/2365870403 learned_addr learned my addr 172.21.15.7:0/2365870403 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:55.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.426+0000 7f29d1319640 1 --2- 172.21.15.7:0/2365870403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b718a92230 0x55b718a90a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:55.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.426+0000 7f29d231b640 1 --2- 172.21.15.7:0/2365870403 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b718aafad0 0x55b718a83ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:55.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.426+0000 7f29d1b1a640 1 -- 172.21.15.7:0/2365870403 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b718aafad0 msgr2=0x55b718a83ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:55.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.426+0000 7f29d1b1a640 1 --2- 172.21.15.7:0/2365870403 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b718aafad0 0x55b718a83ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.426+0000 7f29d1b1a640 1 -- 172.21.15.7:0/2365870403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b718a92230 msgr2=0x55b718a90a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:55.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.426+0000 7f29d1b1a640 1 --2- 172.21.15.7:0/2365870403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b718a92230 0x55b718a90a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.426+0000 7f29d1b1a640 1 -- 172.21.15.7:0/2365870403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b718aa8010 con 0x55b718a85a30 2024-04-25T09:54:55.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.426+0000 7f29d1b1a640 1 --2- 172.21.15.7:0/2365870403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b718a85a30 0x55b718a90520 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f29c802a7d0 tx=0x7f29c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40abfe3a34d073b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:55.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.426+0000 7f29acff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:54:55.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.427+0000 7f29acff9640 1 -- 172.21.15.7:0/2365870403 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c804e040 con 0x55b718a85a30 2024-04-25T09:54:55.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.427+0000 7f29acff9640 1 -- 172.21.15.7:0/2365870403 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f29c80570e0 con 0x55b718a85a30 2024-04-25T09:54:55.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.427+0000 7f29d6722740 1 -- 172.21.15.7:0/2365870403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f29bc003610 con 0x55b718a85a30 2024-04-25T09:54:55.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.427+0000 7f29acff9640 1 -- 172.21.15.7:0/2365870403 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29c8037040 con 0x55b718a85a30 2024-04-25T09:54:55.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.427+0000 7f29d6722740 10 client.4893 fetch_fsmap learned FSMap version 8 2024-04-25T09:54:55.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.427+0000 7f29d6722740 1 -- 172.21.15.7:0/2365870403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55b718aa4bf0 con 0x55b718a85a30 2024-04-25T09:54:55.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.427+0000 7f29acff9640 1 -- 172.21.15.7:0/2365870403 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29bc003610 con 0x55b718a85a30 2024-04-25T09:54:55.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.427+0000 7f29acff9640 1 -- 172.21.15.7:0/2365870403 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 8) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f29c80572e0 con 0x55b718a85a30 2024-04-25T09:54:55.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.427+0000 7f29d6722740 10 client.4893 fetch_fsmap finished waiting for FSMap version 8 2024-04-25T09:54:55.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.427+0000 7f29d6722740 10 client.4893 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T09:54:55.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.427+0000 7f29d6722740 20 client.4893 populate_metadata read hostname 'smithi007' 2024-04-25T09:54:55.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.427+0000 7f29d6722740 1 --2- 172.21.15.7:0/2365870403 >> [v2:172.21.15.55:6833/3779228372,v1:172.21.15.55:6835/3779228372] conn(0x55b718a84aa0 0x55b718abc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:55.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.427+0000 7f29d6722740 4 client.4893 mds_command: new command op to 4293 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:54:55.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.427+0000 7f29d6722740 1 -- 172.21.15.7:0/2365870403 --> [v2:172.21.15.55:6833/3779228372,v1:172.21.15.55:6835/3779228372] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b7189d7f50 con 0x55b718a84aa0 2024-04-25T09:54:55.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.427+0000 7f29d1319640 1 --2- 172.21.15.7:0/2365870403 >> [v2:172.21.15.55:6833/3779228372,v1:172.21.15.55:6835/3779228372] conn(0x55b718a84aa0 0x55b718abc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:55.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.428+0000 7f29d1319640 1 --2- 172.21.15.7:0/2365870403 >> [v2:172.21.15.55:6833/3779228372,v1:172.21.15.55:6835/3779228372] conn(0x55b718a84aa0 0x55b718abc040 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4e541ee1b049f8a server_cookie=936189fc03d03990 in_seq=0 out_seq=0 2024-04-25T09:54:55.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.428+0000 7f29acff9640 10 client.4893 ms_handle_connect on v2:172.21.15.55:6833/3779228372 2024-04-25T09:54:55.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.428+0000 7f29acff9640 1 -- 172.21.15.7:0/2365870403 <== mds.0 v2:172.21.15.55:6833/3779228372 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55b7189d7f50 con 0x55b718a84aa0 2024-04-25T09:54:55.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.428+0000 7f29acff9640 10 client.4893 handle_command_reply: tid=0 2024-04-25T09:54:55.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.428+0000 7f29d6722740 1 client.4893 shutdown 2024-04-25T09:54:55.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.428+0000 7f29d6722740 1 -- 172.21.15.7:0/2365870403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b718a85a30 msgr2=0x55b718a90520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:55.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.428+0000 7f29d6722740 1 --2- 172.21.15.7:0/2365870403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b718a85a30 0x55b718a90520 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f29c802a7d0 tx=0x7f29c8004730 comp rx=0 tx=0).stop 2024-04-25T09:54:55.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.428+0000 7f29d6722740 1 -- 172.21.15.7:0/2365870403 shutdown_connections 2024-04-25T09:54:55.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.428+0000 7f29d6722740 1 --2- 172.21.15.7:0/2365870403 >> [v2:172.21.15.55:6833/3779228372,v1:172.21.15.55:6835/3779228372] conn(0x55b718a84aa0 0x55b718abc040 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.428+0000 7f29acff9640 0 client.4893 ms_handle_reset on v2:172.21.15.55:6833/3779228372 2024-04-25T09:54:55.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.428+0000 7f29d6722740 1 --2- 172.21.15.7:0/2365870403 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b718aafad0 0x55b718a83ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.428+0000 7f29d6722740 1 --2- 172.21.15.7:0/2365870403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b718a92230 0x55b718a90a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.428+0000 7f29d6722740 1 --2- 172.21.15.7:0/2365870403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b718a85a30 0x55b718a90520 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.428+0000 7f29d6722740 1 -- 172.21.15.7:0/2365870403 >> 172.21.15.7:0/2365870403 conn(0x55b718a67f10 msgr2=0x55b718ad0010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:55.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.428+0000 7f29d6722740 1 -- 172.21.15.7:0/2365870403 shutdown_connections 2024-04-25T09:54:55.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.428+0000 7f29d6722740 1 -- 172.21.15.7:0/2365870403 wait complete. 2024-04-25T09:54:55.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.428+0000 7f29d6722740 20 client.4893 trim_cache size 0 max 16384 2024-04-25T09:54:55.440 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T09:54:55.440 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "c03d0745-5946-49c3-ad88-1165c5b68b4e", 2024-04-25T09:54:55.440 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-04-25T09:54:55.440 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 4293, 2024-04-25T09:54:55.440 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-04-25T09:54:55.440 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-04-25T09:54:55.440 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-04-25T09:54:55.441 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 27.206309403999999, 2024-04-25T09:54:55.441 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 8, 2024-04-25T09:54:55.441 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 25, 2024-04-25T09:54:55.441 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 25, 2024-04-25T09:54:55.441 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 33.900594038999998 2024-04-25T09:54:55.441 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T09:54:55.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.429+0000 7f29d3d7e640 1 -- 172.21.15.7:0/3899363856 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f29b006b4d0 msgr2=0x7f29b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:55.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.429+0000 7f29d3d7e640 1 --2- 172.21.15.7:0/3899363856 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f29b006b4d0 0x7f29b006d990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f29c8034000 tx=0x7f29c802e000 comp rx=0 tx=0).stop 2024-04-25T09:54:55.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.429+0000 7f29d3d7e640 1 -- 172.21.15.7:0/3899363856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29cc15db00 msgr2=0x7f29cc14e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:55.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.429+0000 7f29d3d7e640 1 --2- 172.21.15.7:0/3899363856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29cc15db00 0x7f29cc14e7b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f29c400efc0 tx=0x7f29c400c490 comp rx=0 tx=0).stop 2024-04-25T09:54:55.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.429+0000 7f29d3d7e640 1 -- 172.21.15.7:0/3899363856 shutdown_connections 2024-04-25T09:54:55.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.429+0000 7f29d3d7e640 1 --2- 172.21.15.7:0/3899363856 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f29b006b4d0 0x7f29b006d990 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.429+0000 7f29d3d7e640 1 --2- 172.21.15.7:0/3899363856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29cc15db00 0x7f29cc14e7b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.429+0000 7f29d3d7e640 1 --2- 172.21.15.7:0/3899363856 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f29cc0ce2b0 0x7f29cc15f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.429+0000 7f29d3d7e640 1 --2- 172.21.15.7:0/3899363856 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29cc0b53b0 0x7f29cc14e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:55.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.429+0000 7f29d3d7e640 1 -- 172.21.15.7:0/3899363856 >> 172.21.15.7:0/3899363856 conn(0x7f29cc072290 msgr2=0x7f29cc0b7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:55.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.429+0000 7f29d3d7e640 1 -- 172.21.15.7:0/3899363856 shutdown_connections 2024-04-25T09:54:55.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:55.429+0000 7f29d3d7e640 1 -- 172.21.15.7:0/3899363856 wait complete. 2024-04-25T09:54:55.445 INFO:teuthology.run_tasks:Running task kclient... 2024-04-25T09:54:55.484 INFO:tasks.kclient:Mounting kernel clients... 2024-04-25T09:54:55.485 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-25T09:54:55.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:55.485 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-04-25T09:54:55.501 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-25T09:54:55.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:55.502 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T09:54:55.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:55.567 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link delete ceph-brx 2024-04-25T09:54:55.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:55.659 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-04-25T09:54:55.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:55.674 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link delete ceph-brx 2024-04-25T09:54:55.741 INFO:teuthology.orchestra.run.smithi007.stderr:Cannot find device "ceph-brx" 2024-04-25T09:54:55.742 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:54:55.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:55.743 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-25T09:54:55.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:55.763 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link delete ceph-brx 2024-04-25T09:54:55.836 INFO:teuthology.orchestra.run.smithi055.stderr:Cannot find device "ceph-brx" 2024-04-25T09:54:55.837 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:54:55.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:55.838 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-25T09:54:55.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:55.896 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link delete ceph-brx 2024-04-25T09:54:55.964 INFO:teuthology.orchestra.run.smithi055.stderr:Cannot find device "ceph-brx" 2024-04-25T09:54:55.965 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:54:55.965 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-04-25T09:54:55.966 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T09:54:55.966 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:54:55.966 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:54:56.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.065+0000 7f1c22c46640 1 Processor -- start 2024-04-25T09:54:56.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.065+0000 7f1c22c46640 1 -- start start 2024-04-25T09:54:56.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.066+0000 7f1c22c46640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1c1c071ed0 0x7f1c1c0ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:56.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.066+0000 7f1c22c46640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c1c15bdc0 con 0x7f1c1c0ce890 2024-04-25T09:54:56.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.066+0000 7f1c22c46640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c1c15c060 con 0x7f1c1c1529e0 2024-04-25T09:54:56.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.066+0000 7f1c22c46640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1c0b2340 con 0x7f1c1c071ed0 2024-04-25T09:54:56.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.066+0000 7f1c13fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1c1c071ed0 0x7f1c1c0ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:56.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.066+0000 7f1c211e3640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1c1c0ce890 0x7f1c1c06d150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42118/0 (socket says 172.21.15.7:42118) 2024-04-25T09:54:56.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.066+0000 7f1c211e3640 1 -- 172.21.15.7:0/375252527 learned_addr learned my addr 172.21.15.7:0/375252527 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:56.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.066+0000 7f1c13fff640 1 -- 172.21.15.7:0/375252527 >> v1:172.21.15.55:6789/0 conn(0x7f1c1c1529e0 legacy=0x7f1c1c0c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:56.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.066+0000 7f1c13fff640 1 -- 172.21.15.7:0/375252527 >> v1:172.21.15.7:6789/0 conn(0x7f1c1c0ce890 legacy=0x7f1c1c06d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:56.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.066+0000 7f1c13fff640 1 -- 172.21.15.7:0/375252527 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1c15c340 con 0x7f1c1c071ed0 2024-04-25T09:54:56.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.066+0000 7f1c137fe640 1 -- 172.21.15.7:0/375252527 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3447991666 0 0) 0x7f1c1c15bdc0 con 0x7f1c1c0ce890 2024-04-25T09:54:56.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.067+0000 7f1c13fff640 1 --2- 172.21.15.7:0/375252527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c1c071ed0 0x7f1c1c0ce350 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0097a0 tx=0x7f1c0c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86581e8ded1dd465 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:56.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.067+0000 7f1c137fe640 1 -- 172.21.15.7:0/375252527 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c037070 con 0x7f1c1c071ed0 2024-04-25T09:54:56.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.067+0000 7f1c137fe640 1 -- 172.21.15.7:0/375252527 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0c032440 con 0x7f1c1c071ed0 2024-04-25T09:54:56.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.067+0000 7f1c137fe640 1 -- 172.21.15.7:0/375252527 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c032810 con 0x7f1c1c071ed0 2024-04-25T09:54:56.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.068+0000 7f1c22c46640 1 -- 172.21.15.7:0/375252527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c1c071ed0 msgr2=0x7f1c1c0ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:56.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.068+0000 7f1c22c46640 1 --2- 172.21.15.7:0/375252527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c1c071ed0 0x7f1c1c0ce350 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0097a0 tx=0x7f1c0c02a230 comp rx=0 tx=0).stop 2024-04-25T09:54:56.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.068+0000 7f1c22c46640 1 -- 172.21.15.7:0/375252527 shutdown_connections 2024-04-25T09:54:56.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.068+0000 7f1c22c46640 1 --2- 172.21.15.7:0/375252527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c1c071ed0 0x7f1c1c0ce350 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:56.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.068+0000 7f1c22c46640 1 -- 172.21.15.7:0/375252527 >> 172.21.15.7:0/375252527 conn(0x7f1c1c071150 msgr2=0x7f1c1c071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:56.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.068+0000 7f1c22c46640 1 -- 172.21.15.7:0/375252527 shutdown_connections 2024-04-25T09:54:56.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.068+0000 7f1c22c46640 1 -- 172.21.15.7:0/375252527 wait complete. 2024-04-25T09:54:56.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.069+0000 7f1c22c46640 1 Processor -- start 2024-04-25T09:54:56.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.069+0000 7f1c22c46640 1 -- start start 2024-04-25T09:54:56.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.070+0000 7f1c22c46640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c1c071ed0 0x7f1c1c14a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:56.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.070+0000 7f1c22c46640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c1c0ce890 0x7f1c1c14ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:56.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.070+0000 7f1c22c46640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c1c1501c0 0x7f1c1c0b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:56.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.070+0000 7f1c22c46640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c15c900 con 0x7f1c1c1501c0 2024-04-25T09:54:56.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.070+0000 7f1c22c46640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c0cecc0 con 0x7f1c1c071ed0 2024-04-25T09:54:56.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.070+0000 7f1c22c46640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c0c65e0 con 0x7f1c1c0ce890 2024-04-25T09:54:56.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.070+0000 7f1c211e3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c1c1501c0 0x7f1c1c0b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:56.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.070+0000 7f1c211e3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c1c1501c0 0x7f1c1c0b4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52712/0 (socket says 172.21.15.7:52712) 2024-04-25T09:54:56.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.070+0000 7f1c211e3640 1 -- 172.21.15.7:0/2173859442 learned_addr learned my addr 172.21.15.7:0/2173859442 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:56.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.070+0000 7f1c209e2640 1 --2- 172.21.15.7:0/2173859442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c1c071ed0 0x7f1c1c14a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:56.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.070+0000 7f1c211e3640 1 -- 172.21.15.7:0/2173859442 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c1c0ce890 msgr2=0x7f1c1c14ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:56.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.070+0000 7f1c211e3640 1 --2- 172.21.15.7:0/2173859442 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c1c0ce890 0x7f1c1c14ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:56.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.070+0000 7f1c211e3640 1 -- 172.21.15.7:0/2173859442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c1c071ed0 msgr2=0x7f1c1c14a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:56.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.070+0000 7f1c211e3640 1 --2- 172.21.15.7:0/2173859442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c1c071ed0 0x7f1c1c14a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:56.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.070+0000 7f1c211e3640 1 -- 172.21.15.7:0/2173859442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1c14c700 con 0x7f1c1c1501c0 2024-04-25T09:54:56.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.070+0000 7f1c209e2640 1 --2- 172.21.15.7:0/2173859442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c1c071ed0 0x7f1c1c14a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:56.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.070+0000 7f1c211e3640 1 --2- 172.21.15.7:0/2173859442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c1c1501c0 0x7f1c1c0b4b70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400cb20 tx=0x7f1c1400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:56.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.071+0000 7f1c117fa640 1 -- 172.21.15.7:0/2173859442 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1400aca0 con 0x7f1c1c1501c0 2024-04-25T09:54:56.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.071+0000 7f1c117fa640 1 -- 172.21.15.7:0/2173859442 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c14012400 con 0x7f1c1c1501c0 2024-04-25T09:54:56.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.071+0000 7f1c117fa640 1 -- 172.21.15.7:0/2173859442 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1400ae60 con 0x7f1c1c1501c0 2024-04-25T09:54:56.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.071+0000 7f1c22c46640 1 -- 172.21.15.7:0/2173859442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c1c14b660 con 0x7f1c1c1501c0 2024-04-25T09:54:56.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.071+0000 7f1c22c46640 1 -- 172.21.15.7:0/2173859442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1c14bc20 con 0x7f1c1c1501c0 2024-04-25T09:54:56.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.072+0000 7f1c22c46640 1 -- 172.21.15.7:0/2173859442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c1c068fd0 con 0x7f1c1c1501c0 2024-04-25T09:54:56.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.072+0000 7f1c117fa640 1 -- 172.21.15.7:0/2173859442 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1c140127f0 con 0x7f1c1c1501c0 2024-04-25T09:54:56.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.073+0000 7f1c117fa640 1 --2- 172.21.15.7:0/2173859442 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1c0806b4d0 0x7f1c0806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:56.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.073+0000 7f1c117fa640 1 -- 172.21.15.7:0/2173859442 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f1c1408ac20 con 0x7f1c1c1501c0 2024-04-25T09:54:56.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.073+0000 7f1c209e2640 1 --2- 172.21.15.7:0/2173859442 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1c0806b4d0 0x7f1c0806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:56.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.073+0000 7f1c209e2640 1 --2- 172.21.15.7:0/2173859442 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1c0806b4d0 0x7f1c0806d990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1c18000f60 tx=0x7f1c18009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:56.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.077+0000 7f1c117fa640 1 -- 172.21.15.7:0/2173859442 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1c140596d0 con 0x7f1c1c1501c0 2024-04-25T09:54:56.108 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:54:56.110 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:54:56.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.299+0000 7f1c22c46640 1 -- 172.21.15.7:0/2173859442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1c1c0c71b0 con 0x7f1c1c1501c0 2024-04-25T09:54:56.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.299+0000 7f1c117fa640 1 -- 172.21.15.7:0/2173859442 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f1c14058fd0 con 0x7f1c1c1501c0 2024-04-25T09:54:56.303 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T09:54:56.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.301+0000 7f1c22c46640 1 -- 172.21.15.7:0/2173859442 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1c0806b4d0 msgr2=0x7f1c0806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:56.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.301+0000 7f1c22c46640 1 --2- 172.21.15.7:0/2173859442 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1c0806b4d0 0x7f1c0806d990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1c18000f60 tx=0x7f1c18009040 comp rx=0 tx=0).stop 2024-04-25T09:54:56.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.301+0000 7f1c22c46640 1 -- 172.21.15.7:0/2173859442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c1c1501c0 msgr2=0x7f1c1c0b4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:56.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.301+0000 7f1c22c46640 1 --2- 172.21.15.7:0/2173859442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c1c1501c0 0x7f1c1c0b4b70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400cb20 tx=0x7f1c1400a060 comp rx=0 tx=0).stop 2024-04-25T09:54:56.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.302+0000 7f1c22c46640 1 -- 172.21.15.7:0/2173859442 shutdown_connections 2024-04-25T09:54:56.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.302+0000 7f1c22c46640 1 --2- 172.21.15.7:0/2173859442 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1c0806b4d0 0x7f1c0806d990 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:56.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.302+0000 7f1c22c46640 1 --2- 172.21.15.7:0/2173859442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c1c1501c0 0x7f1c1c0b4b70 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:56.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.302+0000 7f1c22c46640 1 --2- 172.21.15.7:0/2173859442 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c1c0ce890 0x7f1c1c14ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:56.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.302+0000 7f1c22c46640 1 --2- 172.21.15.7:0/2173859442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c1c071ed0 0x7f1c1c14a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:56.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.302+0000 7f1c22c46640 1 -- 172.21.15.7:0/2173859442 >> 172.21.15.7:0/2173859442 conn(0x7f1c1c071150 msgr2=0x7f1c1c156300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:56.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.302+0000 7f1c22c46640 1 -- 172.21.15.7:0/2173859442 shutdown_connections 2024-04-25T09:54:56.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:56.302+0000 7f1c22c46640 1 -- 172.21.15.7:0/2173859442 wait complete. 2024-04-25T09:54:56.315 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T09:54:56.315 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:54:56.315 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-04-25T09:54:56.315 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:54:56.315 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:54:56.315 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T09:54:56.315 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T09:54:56.315 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:54:56.316 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:54:56.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:56.316 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-04-25T09:54:56.331 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:54:56.332 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:54:56.332 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:54:56.332 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:54:56.332 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-04-25T09:54:56.332 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:54:56.332 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:54:56.332 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-04-25T09:54:56.332 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-04-25T09:54:56.332 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:54:56.332 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-04-25T09:54:56.332 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-04-25T09:54:56.332 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:54:56.332 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-04-25T09:54:56.333 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-04-25T09:54:56.333 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T09:54:56.333 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42703sec preferred_lft 42703sec 2024-04-25T09:54:56.333 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link noprefixroute 2024-04-25T09:54:56.333 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:54:56.333 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:54:56.333 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-04-25T09:54:56.334 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-04-25T09:54:56.334 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T09:54:56.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:56.334 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-04-25T09:54:56.334 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-25T09:54:56.334 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add name ceph-brx type bridge 2024-04-25T09:54:56.334 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr flush dev ceph-brx 2024-04-25T09:54:56.334 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set ceph-brx up 2024-04-25T09:54:56.334 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T09:54:56.334 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-25T09:54:56.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:56.429 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:54:56.452 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-04-25T09:54:56.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:56.453 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-04-25T09:54:56.510 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-04-25T09:54:56.510 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:54:56.510 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T09:54:56.510 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T09:54:56.510 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:54:56.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:56.510 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-04-25T09:54:56.511 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-25T09:54:56.511 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:54:56.511 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:54:56.511 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:54:56.511 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-25T09:54:56.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:56.597 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-04-25T09:54:56.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:56.613 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list-id 2024-04-25T09:54:56.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:56.668 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-04-25T09:54:56.668 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-25T09:54:56.668 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:54:56.668 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T09:54:56.668 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-25T09:54:56.744 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T09:54:56.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:56.745 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-04-25T09:54:56.745 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-25T09:54:56.745 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T09:54:56.745 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T09:54:56.745 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T09:54:56.745 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T09:54:56.746 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T09:54:56.746 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-25T09:54:56.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:56.856 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-04-25T09:54:56.856 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-25T09:54:56.856 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-04-25T09:54:56.856 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T09:54:56.856 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-25T09:54:56.891 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:54:56.892 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:54:56.947 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:54:56.948 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:54:56.948 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:54:57.003 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:54:57.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:57.003 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:54:57.086 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:54:57.086 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:54:57.086 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T09:54:57.274 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:54:57.274 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:54:57.274 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T09:54:57.275 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T09:54:57.275 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:54:57.280 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:54:57.280 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:54:57.280 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T09:54:57.280 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T09:54:57.280 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:54:57.280 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790" 2024-04-25T09:54:57.280 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790:/ 2024-04-25T09:54:57.280 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c03d0745-5946-49c3-ad88-1165c5b68b4e" will pass to kernel 2024-04-25T09:54:57.281 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T09:54:57.281 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-04-25T09:54:57.281 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T09:54:57.281 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T09:54:57.281 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T09:54:57.282 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:54:57.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:57.283 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:54:57.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:57.347 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:54:57.404 INFO:teuthology.orchestra.run.smithi007.stdout:client4702 2024-04-25T09:54:57.405 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:54:57.405 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:54:57.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:57.460 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:54:57.517 INFO:teuthology.orchestra.run.smithi007.stdout:client4702 2024-04-25T09:54:57.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:57.517 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:54:57.575 INFO:teuthology.orchestra.run.smithi007.stdout:client4702 2024-04-25T09:54:57.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:57.575 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c03d0745-5946-49c3-ad88-1165c5b68b4e.client4702/status') 2024-04-25T09:54:57.639 INFO:teuthology.orchestra.run.smithi007.stdout:instance: client.4702 (3)172.21.15.7:0/3542077000 2024-04-25T09:54:57.639 INFO:teuthology.orchestra.run.smithi007.stdout:blocklisted: false 2024-04-25T09:54:57.640 INFO:teuthology.orchestra.run.smithi007.stderr:0+1 records in 2024-04-25T09:54:57.640 INFO:teuthology.orchestra.run.smithi007.stderr:0+1 records out 2024-04-25T09:54:57.640 INFO:teuthology.orchestra.run.smithi007.stderr:69 bytes copied, 3.3417e-05 s, 2.1 MB/s 2024-04-25T09:54:57.641 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-04-25T09:54:57.641 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T09:54:57.641 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-25T09:54:57.641 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:54:57.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.779+0000 7fbf46e5d640 1 Processor -- start 2024-04-25T09:54:57.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.779+0000 7fbf46e5d640 1 -- start start 2024-04-25T09:54:57.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.780+0000 7fbf46e5d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf400b5e60 0x7fbf4006bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:57.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.780+0000 7fbf46e5d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbf400b6a40 0x7fbf4006c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:57.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.780+0000 7fbf46e5d640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf4006ca30 con 0x7fbf4015dd00 2024-04-25T09:54:57.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.780+0000 7fbf46e5d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf4015e0e0 con 0x7fbf400b6a40 2024-04-25T09:54:57.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.780+0000 7fbf46e5d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4006cfe0 con 0x7fbf400b5e60 2024-04-25T09:54:57.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.780+0000 7fbf44bf9640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbf4015dd00 0x7fbf400b5750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42134/0 (socket says 172.21.15.7:42134) 2024-04-25T09:54:57.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.780+0000 7fbf44bf9640 1 -- 172.21.15.7:0/1953294333 learned_addr learned my addr 172.21.15.7:0/1953294333 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:54:57.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.780+0000 7fbf3ffff640 1 --2- 172.21.15.7:0/1953294333 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf400b5e60 0x7fbf4006bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:57.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.780+0000 7fbf453fa640 1 --2- 172.21.15.7:0/1953294333 >> v2:172.21.15.55:3300/0 conn(0x7fbf400b6a40 0x7fbf4006c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:57.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.780+0000 7fbf3f7fe640 1 -- 172.21.15.7:0/1953294333 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267785875 0 0) 0x7fbf4006ca30 con 0x7fbf4015dd00 2024-04-25T09:54:57.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.780+0000 7fbf3f7fe640 1 -- 172.21.15.7:0/1953294333 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf28003520 con 0x7fbf4015dd00 2024-04-25T09:54:57.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.781+0000 7fbf3f7fe640 1 -- 172.21.15.7:0/1953294333 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3038691012 0 0) 0x7fbf28003520 con 0x7fbf4015dd00 2024-04-25T09:54:57.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.781+0000 7fbf3f7fe640 1 -- 172.21.15.7:0/1953294333 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf400b5e60 msgr2=0x7fbf4006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:57.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.781+0000 7fbf3f7fe640 1 --2- 172.21.15.7:0/1953294333 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf400b5e60 0x7fbf4006bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:57.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.781+0000 7fbf3f7fe640 1 -- 172.21.15.7:0/1953294333 >> v2:172.21.15.55:3300/0 conn(0x7fbf400b6a40 msgr2=0x7fbf4006c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:57.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.781+0000 7fbf3f7fe640 1 --2- 172.21.15.7:0/1953294333 >> v2:172.21.15.55:3300/0 conn(0x7fbf400b6a40 0x7fbf4006c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:57.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.781+0000 7fbf3f7fe640 1 -- 172.21.15.7:0/1953294333 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4006cd00 con 0x7fbf4015dd00 2024-04-25T09:54:57.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.781+0000 7fbf3f7fe640 1 -- 172.21.15.7:0/1953294333 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fbf30001670 con 0x7fbf4015dd00 2024-04-25T09:54:57.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.781+0000 7fbf3f7fe640 1 -- 172.21.15.7:0/1953294333 >> v1:172.21.15.7:6789/0 conn(0x7fbf4015dd00 legacy=0x7fbf400b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:57.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.781+0000 7fbf3f7fe640 1 --2- 172.21.15.7:0/1953294333 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf400b5e60 0x7fbf280039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:57.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.781+0000 7fbf3f7fe640 1 --2- 172.21.15.7:0/1953294333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf28003f80 0x7fbf28004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:57.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.781+0000 7fbf3f7fe640 1 --2- 172.21.15.7:0/1953294333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf28004d40 0x7fbf280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:57.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.781+0000 7fbf3f7fe640 1 -- 172.21.15.7:0/1953294333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4015e0e0 con 0x7fbf28004d40 2024-04-25T09:54:57.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.781+0000 7fbf3f7fe640 1 -- 172.21.15.7:0/1953294333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4006cfe0 con 0x7fbf28003f80 2024-04-25T09:54:57.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.781+0000 7fbf3f7fe640 1 -- 172.21.15.7:0/1953294333 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2800ba40 con 0x7fbf400b5e60 2024-04-25T09:54:57.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.781+0000 7fbf453fa640 1 --2- 172.21.15.7:0/1953294333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf28004d40 0x7fbf280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:57.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.781+0000 7fbf44bf9640 1 --2- 172.21.15.7:0/1953294333 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf400b5e60 0x7fbf280039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:57.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.781+0000 7fbf3ffff640 1 --2- 172.21.15.7:0/1953294333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf28003f80 0x7fbf28004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:57.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.781+0000 7fbf453fa640 1 -- 172.21.15.7:0/1953294333 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf400b5e60 msgr2=0x7fbf280039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:57.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.781+0000 7fbf453fa640 1 --2- 172.21.15.7:0/1953294333 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf400b5e60 0x7fbf280039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:57.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.781+0000 7fbf453fa640 1 -- 172.21.15.7:0/1953294333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf28003f80 msgr2=0x7fbf28004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:57.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.781+0000 7fbf453fa640 1 --2- 172.21.15.7:0/1953294333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf28003f80 0x7fbf28004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:57.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.781+0000 7fbf453fa640 1 -- 172.21.15.7:0/1953294333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf28003520 con 0x7fbf28004d40 2024-04-25T09:54:57.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.782+0000 7fbf453fa640 1 --2- 172.21.15.7:0/1953294333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf28004d40 0x7fbf280051c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbf38009fc0 tx=0x7fbf28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80366fa06add734e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:57.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.782+0000 7fbf3f7fe640 1 -- 172.21.15.7:0/1953294333 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf38009c10 con 0x7fbf28004d40 2024-04-25T09:54:57.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.782+0000 7fbf3f7fe640 1 -- 172.21.15.7:0/1953294333 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf38036070 con 0x7fbf28004d40 2024-04-25T09:54:57.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.782+0000 7fbf3f7fe640 1 -- 172.21.15.7:0/1953294333 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3802d070 con 0x7fbf28004d40 2024-04-25T09:54:57.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.783+0000 7fbf46e5d640 1 -- 172.21.15.7:0/1953294333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf28004d40 msgr2=0x7fbf280051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:57.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.783+0000 7fbf46e5d640 1 --2- 172.21.15.7:0/1953294333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf28004d40 0x7fbf280051c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbf38009fc0 tx=0x7fbf28005830 comp rx=0 tx=0).stop 2024-04-25T09:54:57.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.783+0000 7fbf453fa640 1 -- 172.21.15.7:0/1953294333 reap_dead start 2024-04-25T09:54:57.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.783+0000 7fbf46e5d640 1 -- 172.21.15.7:0/1953294333 shutdown_connections 2024-04-25T09:54:57.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.783+0000 7fbf46e5d640 1 -- 172.21.15.7:0/1953294333 >> 172.21.15.7:0/1953294333 conn(0x7fbf400d07b0 msgr2=0x7fbf400d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:57.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.783+0000 7fbf46e5d640 1 -- 172.21.15.7:0/1953294333 shutdown_connections 2024-04-25T09:54:57.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.783+0000 7fbf46e5d640 1 -- 172.21.15.7:0/1953294333 wait complete. 2024-04-25T09:54:57.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.784+0000 7fbf46e5d640 1 Processor -- start 2024-04-25T09:54:57.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.784+0000 7fbf46e5d640 1 -- start start 2024-04-25T09:54:57.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.785+0000 7fbf46e5d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf28004d40 0x7fbf400ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:57.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.785+0000 7fbf46e5d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf4015e2d0 0x7fbf400c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:57.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.785+0000 7fbf46e5d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf4015f150 0x7fbf400ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:57.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.785+0000 7fbf46e5d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf400d2260 con 0x7fbf4015e2d0 2024-04-25T09:54:57.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.785+0000 7fbf46e5d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf400d1f80 con 0x7fbf28004d40 2024-04-25T09:54:57.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.785+0000 7fbf46e5d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4006bfb0 con 0x7fbf4015f150 2024-04-25T09:54:57.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.785+0000 7fbf3ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf4015e2d0 0x7fbf400c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:57.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.785+0000 7fbf3ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf4015e2d0 0x7fbf400c9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52724/0 (socket says 172.21.15.7:52724) 2024-04-25T09:54:57.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.785+0000 7fbf3ffff640 1 -- 172.21.15.7:0/4114331851 learned_addr learned my addr 172.21.15.7:0/4114331851 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:57.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.785+0000 7fbf453fa640 1 --2- 172.21.15.7:0/4114331851 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf4015f150 0x7fbf400ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:57.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.785+0000 7fbf44bf9640 1 --2- 172.21.15.7:0/4114331851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf28004d40 0x7fbf400ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:57.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.785+0000 7fbf3ffff640 1 -- 172.21.15.7:0/4114331851 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf4015f150 msgr2=0x7fbf400ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:57.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.785+0000 7fbf3ffff640 1 --2- 172.21.15.7:0/4114331851 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf4015f150 0x7fbf400ccc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:57.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.785+0000 7fbf3ffff640 1 -- 172.21.15.7:0/4114331851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf28004d40 msgr2=0x7fbf400ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:57.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.785+0000 7fbf3ffff640 1 --2- 172.21.15.7:0/4114331851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf28004d40 0x7fbf400ca9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:57.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.785+0000 7fbf3ffff640 1 -- 172.21.15.7:0/4114331851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4015fa80 con 0x7fbf4015e2d0 2024-04-25T09:54:57.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.785+0000 7fbf3ffff640 1 --2- 172.21.15.7:0/4114331851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf4015e2d0 0x7fbf400c9500 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbf34011940 tx=0x7fbf34011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:57.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.786+0000 7fbf3d7fa640 1 -- 172.21.15.7:0/4114331851 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3400fa90 con 0x7fbf4015e2d0 2024-04-25T09:54:57.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.786+0000 7fbf3d7fa640 1 -- 172.21.15.7:0/4114331851 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3400fc30 con 0x7fbf4015e2d0 2024-04-25T09:54:57.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.786+0000 7fbf46e5d640 1 -- 172.21.15.7:0/4114331851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf4014c580 con 0x7fbf4015e2d0 2024-04-25T09:54:57.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.786+0000 7fbf3d7fa640 1 -- 172.21.15.7:0/4114331851 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf34014440 con 0x7fbf4015e2d0 2024-04-25T09:54:57.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.786+0000 7fbf46e5d640 1 -- 172.21.15.7:0/4114331851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf4014cb40 con 0x7fbf4015e2d0 2024-04-25T09:54:57.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.787+0000 7fbf46e5d640 1 -- 172.21.15.7:0/4114331851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf40068fd0 con 0x7fbf4015e2d0 2024-04-25T09:54:57.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.787+0000 7fbf3d7fa640 1 -- 172.21.15.7:0/4114331851 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbf34012040 con 0x7fbf4015e2d0 2024-04-25T09:54:57.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.788+0000 7fbf3d7fa640 1 --2- 172.21.15.7:0/4114331851 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbf2c06b4d0 0x7fbf2c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:57.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.788+0000 7fbf44bf9640 1 --2- 172.21.15.7:0/4114331851 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbf2c06b4d0 0x7fbf2c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:57.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.788+0000 7fbf3d7fa640 1 -- 172.21.15.7:0/4114331851 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fbf3408a9c0 con 0x7fbf4015e2d0 2024-04-25T09:54:57.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.788+0000 7fbf44bf9640 1 --2- 172.21.15.7:0/4114331851 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbf2c06b4d0 0x7fbf2c06d990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbf30000c00 tx=0x7fbf30001e10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:57.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:57.792+0000 7fbf3d7fa640 1 -- 172.21.15.7:0/4114331851 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbf3408ce20 con 0x7fbf4015e2d0 2024-04-25T09:54:58.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:58.010+0000 7fbf46e5d640 1 -- 172.21.15.7:0/4114331851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbf400d1620 con 0x7fbf4015e2d0 2024-04-25T09:54:58.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:58.010+0000 7fbf3d7fa640 1 -- 172.21.15.7:0/4114331851 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7fbf34019030 con 0x7fbf4015e2d0 2024-04-25T09:54:58.013 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T09:54:58.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:58.012+0000 7fbf46e5d640 1 -- 172.21.15.7:0/4114331851 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbf2c06b4d0 msgr2=0x7fbf2c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:58.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:58.012+0000 7fbf46e5d640 1 --2- 172.21.15.7:0/4114331851 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbf2c06b4d0 0x7fbf2c06d990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbf30000c00 tx=0x7fbf30001e10 comp rx=0 tx=0).stop 2024-04-25T09:54:58.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:58.012+0000 7fbf46e5d640 1 -- 172.21.15.7:0/4114331851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf4015e2d0 msgr2=0x7fbf400c9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:58.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:58.012+0000 7fbf46e5d640 1 --2- 172.21.15.7:0/4114331851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf4015e2d0 0x7fbf400c9500 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbf34011940 tx=0x7fbf34011e00 comp rx=0 tx=0).stop 2024-04-25T09:54:58.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:58.012+0000 7fbf46e5d640 1 -- 172.21.15.7:0/4114331851 shutdown_connections 2024-04-25T09:54:58.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:58.012+0000 7fbf46e5d640 1 --2- 172.21.15.7:0/4114331851 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbf2c06b4d0 0x7fbf2c06d990 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:58.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:58.012+0000 7fbf46e5d640 1 --2- 172.21.15.7:0/4114331851 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf4015f150 0x7fbf400ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:58.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:58.012+0000 7fbf46e5d640 1 --2- 172.21.15.7:0/4114331851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf4015e2d0 0x7fbf400c9500 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:58.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:58.012+0000 7fbf46e5d640 1 --2- 172.21.15.7:0/4114331851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf28004d40 0x7fbf400ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:58.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:58.012+0000 7fbf46e5d640 1 -- 172.21.15.7:0/4114331851 >> 172.21.15.7:0/4114331851 conn(0x7fbf400d07b0 msgr2=0x7fbf400cef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:58.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:58.012+0000 7fbf46e5d640 1 -- 172.21.15.7:0/4114331851 shutdown_connections 2024-04-25T09:54:58.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:58.012+0000 7fbf46e5d640 1 -- 172.21.15.7:0/4114331851 wait complete. 2024-04-25T09:54:58.026 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T09:54:58.026 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:54:58.026 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-04-25T09:54:58.026 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-25T09:54:58.027 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-25T09:54:58.027 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T09:54:58.027 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T09:54:58.027 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:54:58.027 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-25T09:54:58.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:58.028 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-04-25T09:54:58.044 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:54:58.044 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:54:58.044 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:54:58.044 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:54:58.045 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-04-25T09:54:58.045 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:54:58.045 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:54:58.045 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-04-25T09:54:58.045 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-04-25T09:54:58.045 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:54:58.045 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-04-25T09:54:58.045 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-04-25T09:54:58.045 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:54:58.045 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-04-25T09:54:58.045 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-04-25T09:54:58.046 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T09:54:58.046 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42701sec preferred_lft 42701sec 2024-04-25T09:54:58.046 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link noprefixroute 2024-04-25T09:54:58.046 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:54:58.046 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:54:58.046 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-04-25T09:54:58.046 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-04-25T09:54:58.046 INFO:teuthology.orchestra.run.smithi007.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:54:58.046 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 6e:99:f1:00:a9:5e brd ff:ff:ff:ff:ff:ff 2024-04-25T09:54:58.046 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:54:58.046 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:54:58.046 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::50aa:55ff:febc:5f67/64 scope link 2024-04-25T09:54:58.046 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:54:58.047 INFO:teuthology.orchestra.run.smithi007.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:54:58.047 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 6e:99:f1:00:a9:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:54:58.047 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6c99:f1ff:fe00:a95e/64 scope link tentative 2024-04-25T09:54:58.047 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:54:58.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:58.047 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:54:58.107 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-04-25T09:54:58.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:58.109 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-04-25T09:54:58.165 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-04-25T09:54:58.166 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:54:58.166 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T09:54:58.166 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T09:54:58.166 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:54:58.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:58.166 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-04-25T09:54:58.167 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-25T09:54:58.167 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:54:58.167 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:54:58.167 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:54:58.167 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-25T09:54:58.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:58.252 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-04-25T09:54:58.267 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:54:58.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:58.268 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list-id 2024-04-25T09:54:58.323 INFO:teuthology.orchestra.run.smithi007.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-25T09:54:58.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:58.323 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-04-25T09:54:58.323 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-25T09:54:58.323 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:54:58.323 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-25T09:54:58.323 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-25T09:54:58.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:58.401 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-25T09:54:58.465 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:54:58.465 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:54:58.465 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:54:58.465 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:54:58.465 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-04-25T09:54:58.465 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:54:58.465 INFO:teuthology.orchestra.run.smithi007.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:54:58.465 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 2a:92:ed:34:3d:3e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T09:54:58.465 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T09:54:58.465 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:54:58.466 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::2892:edff:fe34:3d3e/64 scope link 2024-04-25T09:54:58.466 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:54:58.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:58.467 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-25T09:54:58.530 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:54:58.531 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:54:58.531 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:54:58.531 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:54:58.531 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-04-25T09:54:58.531 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:54:58.531 INFO:teuthology.orchestra.run.smithi007.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:54:58.531 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 2a:92:ed:34:3d:3e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T09:54:58.531 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T09:54:58.531 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:54:58.531 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::2892:edff:fe34:3d3e/64 scope link 2024-04-25T09:54:58.531 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:54:58.532 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-25T09:54:58.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:58.533 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-04-25T09:54:58.533 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-25T09:54:58.533 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-25T09:54:58.533 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-25T09:54:58.533 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-25T09:54:58.533 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-25T09:54:58.533 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-25T09:54:58.533 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-25T09:54:58.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:58.644 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-04-25T09:54:58.644 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-25T09:54:58.644 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.1 up 2024-04-25T09:54:58.644 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set dev brx.1 master ceph-brx 2024-04-25T09:54:58.644 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-25T09:54:58.680 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:54:58.680 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-25T09:54:58.734 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-25T09:54:58.735 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:54:58.735 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-25T09:54:58.789 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:54:58.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:58.790 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T09:54:58.872 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T09:54:58.872 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-25T09:54:58.872 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T09:54:58.881 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T09:54:58.881 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-25T09:54:58.881 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T09:54:58.881 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T09:54:58.881 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:54:58.886 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T09:54:58.886 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-25T09:54:58.886 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T09:54:58.886 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T09:54:58.886 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:54:58.886 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790" 2024-04-25T09:54:58.886 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790:/ 2024-04-25T09:54:58.886 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=c03d0745-5946-49c3-ad88-1165c5b68b4e" will pass to kernel 2024-04-25T09:54:58.887 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-04-25T09:54:58.887 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-04-25T09:54:58.887 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T09:54:58.887 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T09:54:58.887 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T09:54:58.889 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:54:58.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:58.889 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-25T09:54:58.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:58.956 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:54:59.012 INFO:teuthology.orchestra.run.smithi007.stdout:client4556 2024-04-25T09:54:59.012 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:54:59.012 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:54:59.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:59.071 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:54:59.127 INFO:teuthology.orchestra.run.smithi007.stdout:client4556 2024-04-25T09:54:59.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:59.127 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:54:59.184 INFO:teuthology.orchestra.run.smithi007.stdout:client4556 2024-04-25T09:54:59.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:59.185 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c03d0745-5946-49c3-ad88-1165c5b68b4e.client4556/status') 2024-04-25T09:54:59.248 INFO:teuthology.orchestra.run.smithi007.stdout:instance: client.4556 (3)172.21.15.7:0/314515073 2024-04-25T09:54:59.249 INFO:teuthology.orchestra.run.smithi007.stdout:blocklisted: false 2024-04-25T09:54:59.249 INFO:teuthology.orchestra.run.smithi007.stderr:0+1 records in 2024-04-25T09:54:59.249 INFO:teuthology.orchestra.run.smithi007.stderr:0+1 records out 2024-04-25T09:54:59.249 INFO:teuthology.orchestra.run.smithi007.stderr:68 bytes copied, 2.3713e-05 s, 2.9 MB/s 2024-04-25T09:54:59.250 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-04-25T09:54:59.250 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T09:54:59.250 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T09:54:59.250 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:54:59.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.389+0000 7f8f21db6640 1 Processor -- start 2024-04-25T09:54:59.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.389+0000 7f8f21db6640 1 -- start start 2024-04-25T09:54:59.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.390+0000 7f8f21db6640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8f1c0d0aa0 0x7f8f1c161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:59.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.390+0000 7f8f21db6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8f1c1622b0 0x7f8f1c0ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:59.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.390+0000 7f8f21db6640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f1c15e8a0 con 0x7f8f1c15da60 2024-04-25T09:54:59.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.390+0000 7f8f21db6640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f1c15eb80 con 0x7f8f1c0d0aa0 2024-04-25T09:54:59.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.390+0000 7f8f21db6640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f1c15ee60 con 0x7f8f1c1622b0 2024-04-25T09:54:59.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.390+0000 7f8f1affd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8f1c0d0aa0 0x7f8f1c161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:59.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.390+0000 7f8f1affd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8f1c0d0aa0 0x7f8f1c161d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52732/0 (socket says 172.21.15.7:52732) 2024-04-25T09:54:59.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.390+0000 7f8f1affd640 1 -- 172.21.15.7:0/3096595111 learned_addr learned my addr 172.21.15.7:0/3096595111 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:59.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.390+0000 7f8f1bfff640 1 --2- 172.21.15.7:0/3096595111 >> v2:172.21.15.55:3300/0 conn(0x7f8f1c1622b0 0x7f8f1c0ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:59.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.390+0000 7f8f1affd640 1 -- 172.21.15.7:0/3096595111 >> v2:172.21.15.55:3300/0 conn(0x7f8f1c1622b0 msgr2=0x7f8f1c0ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:54:59.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.390+0000 7f8f1affd640 1 --2- 172.21.15.7:0/3096595111 >> v2:172.21.15.55:3300/0 conn(0x7f8f1c1622b0 0x7f8f1c0ce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:59.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.390+0000 7f8f1affd640 1 -- 172.21.15.7:0/3096595111 >> v1:172.21.15.55:6789/0 conn(0x7f8f1c15da60 legacy=0x7f8f1c15de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:59.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.390+0000 7f8f1affd640 1 -- 172.21.15.7:0/3096595111 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1c161850 con 0x7f8f1c0d0aa0 2024-04-25T09:54:59.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.391+0000 7f8f1affd640 1 --2- 172.21.15.7:0/3096595111 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f1c0d0aa0 0x7f8f1c161d70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c161580 tx=0x7f8f1002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ac5970e997fdc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:59.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.391+0000 7f8f1a7fc640 1 -- 172.21.15.7:0/3096595111 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f10037070 con 0x7f8f1c0d0aa0 2024-04-25T09:54:59.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.391+0000 7f8f1a7fc640 1 -- 172.21.15.7:0/3096595111 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f10032440 con 0x7f8f1c0d0aa0 2024-04-25T09:54:59.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.391+0000 7f8f1a7fc640 1 -- 172.21.15.7:0/3096595111 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f10032810 con 0x7f8f1c0d0aa0 2024-04-25T09:54:59.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.391+0000 7f8f21db6640 1 -- 172.21.15.7:0/3096595111 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f1c0d0aa0 msgr2=0x7f8f1c161d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:59.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.391+0000 7f8f21db6640 1 --2- 172.21.15.7:0/3096595111 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f1c0d0aa0 0x7f8f1c161d70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c161580 tx=0x7f8f1002a1e0 comp rx=0 tx=0).stop 2024-04-25T09:54:59.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.392+0000 7f8f21db6640 1 -- 172.21.15.7:0/3096595111 shutdown_connections 2024-04-25T09:54:59.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.392+0000 7f8f21db6640 1 --2- 172.21.15.7:0/3096595111 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f1c0d0aa0 0x7f8f1c161d70 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:59.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.392+0000 7f8f21db6640 1 --2- 172.21.15.7:0/3096595111 >> v2:172.21.15.55:3300/0 conn(0x7f8f1c1622b0 0x7f8f1c0ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:59.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.392+0000 7f8f21db6640 1 -- 172.21.15.7:0/3096595111 >> 172.21.15.7:0/3096595111 conn(0x7f8f1c06bfe0 msgr2=0x7f8f1c06c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:59.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.392+0000 7f8f21db6640 1 -- 172.21.15.7:0/3096595111 shutdown_connections 2024-04-25T09:54:59.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.392+0000 7f8f21db6640 1 -- 172.21.15.7:0/3096595111 wait complete. 2024-04-25T09:54:59.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.393+0000 7f8f21db6640 1 Processor -- start 2024-04-25T09:54:59.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.393+0000 7f8f21db6640 1 -- start start 2024-04-25T09:54:59.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.394+0000 7f8f21db6640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8f1c0d0aa0 0x7f8f1c15cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:59.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.394+0000 7f8f21db6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f1c15da60 0x7f8f1c0b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:59.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.394+0000 7f8f21db6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f1c1622b0 0x7f8f1c1e93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:59.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.394+0000 7f8f21db6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c0cebe0 con 0x7f8f1c1622b0 2024-04-25T09:54:59.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.394+0000 7f8f21db6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c0cea60 con 0x7f8f1c15da60 2024-04-25T09:54:59.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.394+0000 7f8f21db6640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c0ced60 con 0x7f8f1c0d0aa0 2024-04-25T09:54:59.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.394+0000 7f8f1bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f1c1622b0 0x7f8f1c1e93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:59.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.394+0000 7f8f1bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f1c1622b0 0x7f8f1c1e93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52744/0 (socket says 172.21.15.7:52744) 2024-04-25T09:54:59.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.394+0000 7f8f1bfff640 1 -- 172.21.15.7:0/1460269432 learned_addr learned my addr 172.21.15.7:0/1460269432 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:54:59.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.394+0000 7f8f1b7fe640 1 --2- 172.21.15.7:0/1460269432 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8f1c0d0aa0 0x7f8f1c15cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:59.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.394+0000 7f8f1affd640 1 --2- 172.21.15.7:0/1460269432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f1c15da60 0x7f8f1c0b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:59.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.394+0000 7f8f1bfff640 1 -- 172.21.15.7:0/1460269432 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8f1c0d0aa0 msgr2=0x7f8f1c15cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:59.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.394+0000 7f8f1bfff640 1 --2- 172.21.15.7:0/1460269432 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8f1c0d0aa0 0x7f8f1c15cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:59.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.394+0000 7f8f1bfff640 1 -- 172.21.15.7:0/1460269432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f1c15da60 msgr2=0x7f8f1c0b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:59.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.394+0000 7f8f1bfff640 1 --2- 172.21.15.7:0/1460269432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f1c15da60 0x7f8f1c0b3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:59.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.394+0000 7f8f1bfff640 1 -- 172.21.15.7:0/1460269432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1c0b4200 con 0x7f8f1c1622b0 2024-04-25T09:54:59.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.394+0000 7f8f1b7fe640 1 --2- 172.21.15.7:0/1460269432 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8f1c0d0aa0 0x7f8f1c15cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:59.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.394+0000 7f8f1affd640 1 --2- 172.21.15.7:0/1460269432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f1c15da60 0x7f8f1c0b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:54:59.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.394+0000 7f8f1bfff640 1 --2- 172.21.15.7:0/1460269432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f1c1622b0 0x7f8f1c1e93a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8f14007e90 tx=0x7f8f1400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:59.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.394+0000 7f8f03fff640 1 -- 172.21.15.7:0/1460269432 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f14014420 con 0x7f8f1c1622b0 2024-04-25T09:54:59.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.394+0000 7f8f03fff640 1 -- 172.21.15.7:0/1460269432 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f14019070 con 0x7f8f1c1622b0 2024-04-25T09:54:59.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.394+0000 7f8f03fff640 1 -- 172.21.15.7:0/1460269432 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f14014800 con 0x7f8f1c1622b0 2024-04-25T09:54:59.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.394+0000 7f8f21db6640 1 -- 172.21.15.7:0/1460269432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f1c1f3b60 con 0x7f8f1c1622b0 2024-04-25T09:54:59.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.395+0000 7f8f21db6640 1 -- 172.21.15.7:0/1460269432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f1c0b4760 con 0x7f8f1c1622b0 2024-04-25T09:54:59.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.395+0000 7f8f21db6640 1 -- 172.21.15.7:0/1460269432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f1c068fd0 con 0x7f8f1c1622b0 2024-04-25T09:54:59.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.396+0000 7f8f03fff640 1 -- 172.21.15.7:0/1460269432 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8f140149a0 con 0x7f8f1c1622b0 2024-04-25T09:54:59.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.396+0000 7f8f03fff640 1 --2- 172.21.15.7:0/1460269432 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8f0806b4d0 0x7f8f0806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:54:59.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.396+0000 7f8f03fff640 1 -- 172.21.15.7:0/1460269432 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8f1408ae10 con 0x7f8f1c1622b0 2024-04-25T09:54:59.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.396+0000 7f8f1b7fe640 1 --2- 172.21.15.7:0/1460269432 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8f0806b4d0 0x7f8f0806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:54:59.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.397+0000 7f8f1b7fe640 1 --2- 172.21.15.7:0/1460269432 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8f0806b4d0 0x7f8f0806d990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c0015e0 tx=0x7f8f0c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:54:59.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.401+0000 7f8f03fff640 1 -- 172.21.15.7:0/1460269432 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8f1c0b4200 con 0x7f8f1c1622b0 2024-04-25T09:54:59.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.621+0000 7f8f21db6640 1 -- 172.21.15.7:0/1460269432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8f1c0b8d80 con 0x7f8f1c1622b0 2024-04-25T09:54:59.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.621+0000 7f8f03fff640 1 -- 172.21.15.7:0/1460269432 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f8f140598b0 con 0x7f8f1c1622b0 2024-04-25T09:54:59.624 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T09:54:59.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.624+0000 7f8f21db6640 1 -- 172.21.15.7:0/1460269432 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8f0806b4d0 msgr2=0x7f8f0806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:59.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.624+0000 7f8f21db6640 1 --2- 172.21.15.7:0/1460269432 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8f0806b4d0 0x7f8f0806d990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c0015e0 tx=0x7f8f0c009040 comp rx=0 tx=0).stop 2024-04-25T09:54:59.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.624+0000 7f8f21db6640 1 -- 172.21.15.7:0/1460269432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f1c1622b0 msgr2=0x7f8f1c1e93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:54:59.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.624+0000 7f8f21db6640 1 --2- 172.21.15.7:0/1460269432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f1c1622b0 0x7f8f1c1e93a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8f14007e90 tx=0x7f8f1400e4b0 comp rx=0 tx=0).stop 2024-04-25T09:54:59.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.624+0000 7f8f21db6640 1 -- 172.21.15.7:0/1460269432 shutdown_connections 2024-04-25T09:54:59.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.624+0000 7f8f21db6640 1 --2- 172.21.15.7:0/1460269432 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8f0806b4d0 0x7f8f0806d990 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:59.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.624+0000 7f8f21db6640 1 --2- 172.21.15.7:0/1460269432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8f1c1622b0 0x7f8f1c1e93a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:59.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.624+0000 7f8f21db6640 1 --2- 172.21.15.7:0/1460269432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f1c15da60 0x7f8f1c0b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:59.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.624+0000 7f8f21db6640 1 --2- 172.21.15.7:0/1460269432 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8f1c0d0aa0 0x7f8f1c15cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:54:59.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.624+0000 7f8f21db6640 1 -- 172.21.15.7:0/1460269432 >> 172.21.15.7:0/1460269432 conn(0x7f8f1c06bfe0 msgr2=0x7f8f1c160950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:54:59.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.624+0000 7f8f21db6640 1 -- 172.21.15.7:0/1460269432 shutdown_connections 2024-04-25T09:54:59.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:54:59.624+0000 7f8f21db6640 1 -- 172.21.15.7:0/1460269432 wait complete. 2024-04-25T09:54:59.637 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T09:54:59.638 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:54:59.638 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-25T09:54:59.638 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-25T09:54:59.638 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T09:54:59.638 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T09:54:59.638 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T09:54:59.638 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:54:59.638 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T09:54:59.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:59.638 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-25T09:54:59.658 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:54:59.658 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:54:59.658 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:54:59.659 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:54:59.659 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-25T09:54:59.659 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:54:59.659 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:54:59.659 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:54:59.659 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-25T09:54:59.659 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:54:59.659 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:54:59.659 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-25T09:54:59.660 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:54:59.660 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:54:59.660 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-25T09:54:59.660 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T09:54:59.660 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42685sec preferred_lft 42685sec 2024-04-25T09:54:59.660 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link noprefixroute 2024-04-25T09:54:59.660 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:54:59.660 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:54:59.661 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:54:59.661 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-25T09:54:59.661 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T09:54:59.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:59.661 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T09:54:59.661 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T09:54:59.662 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add name ceph-brx type bridge 2024-04-25T09:54:59.662 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip addr flush dev ceph-brx 2024-04-25T09:54:59.662 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set ceph-brx up 2024-04-25T09:54:59.662 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T09:54:59.662 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T09:54:59.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:59.811 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:54:59.836 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-25T09:54:59.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:59.838 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-25T09:54:59.906 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-25T09:54:59.907 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:54:59.907 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T09:54:59.907 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T09:54:59.907 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:54:59.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:54:59.907 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T09:54:59.907 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T09:54:59.907 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:54:59.907 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:54:59.908 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:54:59.908 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T09:55:00.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:00.165 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-25T09:55:00.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:00.181 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list-id 2024-04-25T09:55:00.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:00.238 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T09:55:00.238 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T09:55:00.238 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T09:55:00.238 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-25T09:55:00.238 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T09:55:00.315 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-25T09:55:00.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:00.316 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T09:55:00.316 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T09:55:00.316 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-25T09:55:00.316 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T09:55:00.316 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-25T09:55:00.316 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-25T09:55:00.316 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-25T09:55:00.316 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T09:55:00.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:00.439 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T09:55:00.439 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T09:55:00.439 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-25T09:55:00.439 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T09:55:00.439 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T09:55:00.475 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:55:00.475 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-25T09:55:00.530 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-25T09:55:00.531 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:55:00.531 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-25T09:55:00.587 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:55:00.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:00.587 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T09:55:00.683 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T09:55:00.683 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T09:55:00.683 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T09:55:00.779 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T09:55:00.779 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T09:55:00.779 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T09:55:00.779 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T09:55:00.780 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:55:00.784 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T09:55:00.784 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T09:55:00.784 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T09:55:00.784 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T09:55:00.784 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:55:00.784 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790" 2024-04-25T09:55:00.784 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790:/ 2024-04-25T09:55:00.784 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=c03d0745-5946-49c3-ad88-1165c5b68b4e" will pass to kernel 2024-04-25T09:55:00.785 INFO:teuthology.orchestra.run.smithi055.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-25T09:55:00.785 INFO:teuthology.orchestra.run.smithi055.stdout: You just mounted a file system that supports labels which does not 2024-04-25T09:55:00.785 INFO:teuthology.orchestra.run.smithi055.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T09:55:00.785 INFO:teuthology.orchestra.run.smithi055.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T09:55:00.785 INFO:teuthology.orchestra.run.smithi055.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T09:55:00.787 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:55:00.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:00.787 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-25T09:55:00.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:00.811 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:55:00.868 INFO:teuthology.orchestra.run.smithi055.stdout:client4917 2024-04-25T09:55:00.868 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:55:00.868 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:55:00.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:00.925 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:55:00.981 INFO:teuthology.orchestra.run.smithi055.stdout:client4917 2024-04-25T09:55:00.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:00.981 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:55:01.037 INFO:teuthology.orchestra.run.smithi055.stdout:client4917 2024-04-25T09:55:01.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:01.038 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c03d0745-5946-49c3-ad88-1165c5b68b4e.client4917/status') 2024-04-25T09:55:01.101 INFO:teuthology.orchestra.run.smithi055.stdout:instance: client.4917 (3)172.21.15.55:0/664295738 2024-04-25T09:55:01.101 INFO:teuthology.orchestra.run.smithi055.stdout:blocklisted: false 2024-04-25T09:55:01.102 INFO:teuthology.orchestra.run.smithi055.stderr:0+1 records in 2024-04-25T09:55:01.102 INFO:teuthology.orchestra.run.smithi055.stderr:0+1 records out 2024-04-25T09:55:01.102 INFO:teuthology.orchestra.run.smithi055.stderr:69 bytes copied, 2.3577e-05 s, 2.9 MB/s 2024-04-25T09:55:01.103 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-04-25T09:55:01.103 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T09:55:01.103 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-25T09:55:01.103 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:55:01.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.213+0000 7f36fc334640 1 Processor -- start 2024-04-25T09:55:01.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.213+0000 7f36fc334640 1 -- start start 2024-04-25T09:55:01.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.214+0000 7f36fc334640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36f415b8e0 0x7f36f40d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:01.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.214+0000 7f36fc334640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f36f409a100 0x7f36f40b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:01.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.214+0000 7f36fc334640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f40ccbc0 con 0x7f36f40cc300 2024-04-25T09:55:01.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.214+0000 7f36fc334640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f40cd7d0 con 0x7f36f409a100 2024-04-25T09:55:01.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.214+0000 7f36fc334640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f40ccea0 con 0x7f36f415b8e0 2024-04-25T09:55:01.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.215+0000 7f36fa8d1640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f36f409a100 0x7f36f40b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:01.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.215+0000 7f36fa8d1640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f36f409a100 0x7f36f40b0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55340/0 (socket says 172.21.15.7:55340) 2024-04-25T09:55:01.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.215+0000 7f36fa8d1640 1 -- 172.21.15.7:0/742636378 learned_addr learned my addr 172.21.15.7:0/742636378 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:01.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.215+0000 7f36fa0d0640 1 --2- 172.21.15.7:0/742636378 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36f415b8e0 0x7f36f40d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:01.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.215+0000 7f36fa8d1640 1 -- 172.21.15.7:0/742636378 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36f415b8e0 msgr2=0x7f36f40d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:01.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.215+0000 7f36fa8d1640 1 --2- 172.21.15.7:0/742636378 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36f415b8e0 0x7f36f40d0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:01.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.215+0000 7f36fa8d1640 1 -- 172.21.15.7:0/742636378 >> v1:172.21.15.55:6789/0 conn(0x7f36f40cc300 legacy=0x7f36f40999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:01.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.215+0000 7f36fa8d1640 1 -- 172.21.15.7:0/742636378 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f40cd180 con 0x7f36f409a100 2024-04-25T09:55:01.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.216+0000 7f36fa8d1640 1 --2- 172.21.15.7:0/742636378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36f409a100 0x7f36f40b0a50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f36e4009e50 tx=0x7f36e402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=478b3188e896bc96 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:01.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.216+0000 7f36f90ce640 1 -- 172.21.15.7:0/742636378 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e4036070 con 0x7f36f409a100 2024-04-25T09:55:01.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.216+0000 7f36f90ce640 1 -- 172.21.15.7:0/742636378 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e4031600 con 0x7f36f409a100 2024-04-25T09:55:01.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.216+0000 7f36f90ce640 1 -- 172.21.15.7:0/742636378 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e40319d0 con 0x7f36f409a100 2024-04-25T09:55:01.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.216+0000 7f36fc334640 1 -- 172.21.15.7:0/742636378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36f409a100 msgr2=0x7f36f40b0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:01.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.216+0000 7f36fc334640 1 --2- 172.21.15.7:0/742636378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36f409a100 0x7f36f40b0a50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f36e4009e50 tx=0x7f36e402a6c0 comp rx=0 tx=0).stop 2024-04-25T09:55:01.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.216+0000 7f36fc334640 1 -- 172.21.15.7:0/742636378 shutdown_connections 2024-04-25T09:55:01.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.216+0000 7f36fc334640 1 --2- 172.21.15.7:0/742636378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36f409a100 0x7f36f40b0a50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:01.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.216+0000 7f36fc334640 1 --2- 172.21.15.7:0/742636378 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36f415b8e0 0x7f36f40d0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:01.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.216+0000 7f36fc334640 1 -- 172.21.15.7:0/742636378 >> 172.21.15.7:0/742636378 conn(0x7f36f40b3130 msgr2=0x7f36f40b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:01.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.216+0000 7f36fc334640 1 -- 172.21.15.7:0/742636378 shutdown_connections 2024-04-25T09:55:01.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.216+0000 7f36fc334640 1 -- 172.21.15.7:0/742636378 wait complete. 2024-04-25T09:55:01.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.218+0000 7f36fc334640 1 Processor -- start 2024-04-25T09:55:01.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.218+0000 7f36fc334640 1 -- start start 2024-04-25T09:55:01.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.218+0000 7f36fc334640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36f409a100 0x7f36f415ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:01.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.218+0000 7f36fc334640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36f40cc300 0x7f36f41f14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:01.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.218+0000 7f36fc334640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36f415b8e0 0x7f36f4153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:01.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.218+0000 7f36fc334640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f415be40 con 0x7f36f40cc300 2024-04-25T09:55:01.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.218+0000 7f36fc334640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f415bcc0 con 0x7f36f409a100 2024-04-25T09:55:01.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.218+0000 7f36fc334640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f40cc760 con 0x7f36f415b8e0 2024-04-25T09:55:01.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.218+0000 7f36f98cf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36f40cc300 0x7f36f41f14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:01.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.218+0000 7f36f98cf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36f40cc300 0x7f36f41f14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55342/0 (socket says 172.21.15.7:55342) 2024-04-25T09:55:01.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.219+0000 7f36f98cf640 1 -- 172.21.15.7:0/1872594128 learned_addr learned my addr 172.21.15.7:0/1872594128 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:01.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.219+0000 7f36fa0d0640 1 --2- 172.21.15.7:0/1872594128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36f409a100 0x7f36f415ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:01.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.219+0000 7f36fa8d1640 1 --2- 172.21.15.7:0/1872594128 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36f415b8e0 0x7f36f4153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:01.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.219+0000 7f36f98cf640 1 -- 172.21.15.7:0/1872594128 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36f415b8e0 msgr2=0x7f36f4153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:01.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.219+0000 7f36f98cf640 1 --2- 172.21.15.7:0/1872594128 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36f415b8e0 0x7f36f4153210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:01.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.219+0000 7f36f98cf640 1 -- 172.21.15.7:0/1872594128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36f409a100 msgr2=0x7f36f415ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:01.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.219+0000 7f36f98cf640 1 --2- 172.21.15.7:0/1872594128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36f409a100 0x7f36f415ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:01.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.219+0000 7f36f98cf640 1 -- 172.21.15.7:0/1872594128 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f40cb240 con 0x7f36f40cc300 2024-04-25T09:55:01.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.219+0000 7f36fa0d0640 1 --2- 172.21.15.7:0/1872594128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36f409a100 0x7f36f415ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:01.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.219+0000 7f36f98cf640 1 --2- 172.21.15.7:0/1872594128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36f40cc300 0x7f36f41f14f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f36e800c430 tx=0x7f36e800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:01.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.219+0000 7f36f2ffd640 1 -- 172.21.15.7:0/1872594128 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e8011790 con 0x7f36f40cc300 2024-04-25T09:55:01.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.219+0000 7f36f2ffd640 1 -- 172.21.15.7:0/1872594128 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e8017070 con 0x7f36f40cc300 2024-04-25T09:55:01.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.219+0000 7f36fc334640 1 -- 172.21.15.7:0/1872594128 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f41f1c60 con 0x7f36f40cc300 2024-04-25T09:55:01.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.219+0000 7f36f2ffd640 1 -- 172.21.15.7:0/1872594128 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e8011bb0 con 0x7f36f40cc300 2024-04-25T09:55:01.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.219+0000 7f36fc334640 1 -- 172.21.15.7:0/1872594128 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f41f2220 con 0x7f36f40cc300 2024-04-25T09:55:01.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.220+0000 7f36fc334640 1 -- 172.21.15.7:0/1872594128 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f4068fd0 con 0x7f36f40cc300 2024-04-25T09:55:01.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.221+0000 7f36f2ffd640 1 -- 172.21.15.7:0/1872594128 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f36e801c460 con 0x7f36f40cc300 2024-04-25T09:55:01.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.221+0000 7f36f2ffd640 1 --2- 172.21.15.7:0/1872594128 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f36e006b4d0 0x7f36e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:01.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.221+0000 7f36f2ffd640 1 -- 172.21.15.7:0/1872594128 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f36e808a2f0 con 0x7f36f40cc300 2024-04-25T09:55:01.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.221+0000 7f36fa0d0640 1 --2- 172.21.15.7:0/1872594128 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f36e006b4d0 0x7f36e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:01.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.222+0000 7f36fa0d0640 1 --2- 172.21.15.7:0/1872594128 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f36e006b4d0 0x7f36e006d990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f36ec006fd0 tx=0x7f36ec008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:01.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.225+0000 7f36f2ffd640 1 -- 172.21.15.7:0/1872594128 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f36e8058ec0 con 0x7f36f40cc300 2024-04-25T09:55:01.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.445+0000 7f36fc334640 1 -- 172.21.15.7:0/1872594128 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f36f41f2420 con 0x7f36f40cc300 2024-04-25T09:55:01.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.446+0000 7f36f2ffd640 1 -- 172.21.15.7:0/1872594128 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f36e80587c0 con 0x7f36f40cc300 2024-04-25T09:55:01.449 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T09:55:01.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.447+0000 7f36fc334640 1 -- 172.21.15.7:0/1872594128 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f36e006b4d0 msgr2=0x7f36e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:01.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.447+0000 7f36fc334640 1 --2- 172.21.15.7:0/1872594128 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f36e006b4d0 0x7f36e006d990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f36ec006fd0 tx=0x7f36ec008040 comp rx=0 tx=0).stop 2024-04-25T09:55:01.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.447+0000 7f36fc334640 1 -- 172.21.15.7:0/1872594128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36f40cc300 msgr2=0x7f36f41f14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:01.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.447+0000 7f36fc334640 1 --2- 172.21.15.7:0/1872594128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36f40cc300 0x7f36f41f14f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f36e800c430 tx=0x7f36e800c8f0 comp rx=0 tx=0).stop 2024-04-25T09:55:01.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.447+0000 7f36fc334640 1 -- 172.21.15.7:0/1872594128 shutdown_connections 2024-04-25T09:55:01.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.447+0000 7f36fc334640 1 --2- 172.21.15.7:0/1872594128 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f36e006b4d0 0x7f36e006d990 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:01.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.447+0000 7f36fc334640 1 --2- 172.21.15.7:0/1872594128 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36f415b8e0 0x7f36f4153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:01.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.447+0000 7f36fc334640 1 --2- 172.21.15.7:0/1872594128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36f40cc300 0x7f36f41f14f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:01.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.447+0000 7f36fc334640 1 --2- 172.21.15.7:0/1872594128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36f409a100 0x7f36f415ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:01.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.447+0000 7f36fc334640 1 -- 172.21.15.7:0/1872594128 >> 172.21.15.7:0/1872594128 conn(0x7f36f40b3130 msgr2=0x7f36f40b2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:01.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.448+0000 7f36fc334640 1 -- 172.21.15.7:0/1872594128 shutdown_connections 2024-04-25T09:55:01.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:01.448+0000 7f36fc334640 1 -- 172.21.15.7:0/1872594128 wait complete. 2024-04-25T09:55:01.461 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T09:55:01.461 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:55:01.461 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-25T09:55:01.461 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-25T09:55:01.461 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-25T09:55:01.461 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T09:55:01.461 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T09:55:01.461 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:55:01.461 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-25T09:55:01.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:01.462 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-25T09:55:01.478 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:55:01.478 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:55:01.478 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:55:01.478 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:55:01.478 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-25T09:55:01.478 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:55:01.479 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:55:01.479 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:55:01.479 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-25T09:55:01.479 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:55:01.479 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:55:01.479 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-25T09:55:01.479 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:55:01.479 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:55:01.479 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-25T09:55:01.479 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T09:55:01.479 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42683sec preferred_lft 42683sec 2024-04-25T09:55:01.479 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link noprefixroute 2024-04-25T09:55:01.479 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:55:01.479 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:55:01.479 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:55:01.480 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-25T09:55:01.480 INFO:teuthology.orchestra.run.smithi055.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:55:01.480 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 12:a8:0e:33:ad:47 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:55:01.480 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:55:01.480 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:55:01.480 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::38a8:86ff:fe06:987a/64 scope link 2024-04-25T09:55:01.480 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:55:01.480 INFO:teuthology.orchestra.run.smithi055.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:55:01.480 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 12:a8:0e:33:ad:47 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T09:55:01.480 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::10a8:eff:fe33:ad47/64 scope link tentative 2024-04-25T09:55:01.480 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:55:01.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:01.481 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:55:01.543 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-25T09:55:01.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:01.544 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-25T09:55:01.602 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-25T09:55:01.602 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:55:01.602 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T09:55:01.602 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T09:55:01.602 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:55:01.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:01.603 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T09:55:01.603 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T09:55:01.603 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:55:01.603 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:55:01.603 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:55:01.603 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T09:55:01.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:01.689 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-25T09:55:01.704 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T09:55:01.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:01.705 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list-id 2024-04-25T09:55:01.760 INFO:teuthology.orchestra.run.smithi055.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-25T09:55:01.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:01.761 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T09:55:01.761 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T09:55:01.761 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T09:55:01.761 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-25T09:55:01.761 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T09:55:01.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:01.838 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-25T09:55:01.902 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:55:01.902 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:55:01.902 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:55:01.902 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:55:01.902 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-25T09:55:01.902 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:55:01.902 INFO:teuthology.orchestra.run.smithi055.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:55:01.903 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether d2:a5:3e:7f:d8:36 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T09:55:01.903 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T09:55:01.903 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:55:01.903 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::d0a5:3eff:fe7f:d836/64 scope link tentative 2024-04-25T09:55:01.903 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:55:01.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:01.904 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-25T09:55:01.968 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:55:01.968 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:55:01.968 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:55:01.969 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:55:01.969 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-25T09:55:01.969 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:55:01.969 INFO:teuthology.orchestra.run.smithi055.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:55:01.969 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether d2:a5:3e:7f:d8:36 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T09:55:01.969 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T09:55:01.969 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:55:01.969 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::d0a5:3eff:fe7f:d836/64 scope link tentative 2024-04-25T09:55:01.969 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:55:01.970 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-25T09:55:01.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:01.970 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T09:55:01.970 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T09:55:01.971 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-25T09:55:01.971 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-25T09:55:01.971 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-25T09:55:01.971 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-25T09:55:01.971 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-25T09:55:01.971 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T09:55:02.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:02.081 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-25T09:55:02.081 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-25T09:55:02.081 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.1 up 2024-04-25T09:55:02.081 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set dev brx.1 master ceph-brx 2024-04-25T09:55:02.081 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-25T09:55:02.117 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:55:02.117 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-25T09:55:02.173 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-25T09:55:02.174 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:55:02.174 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-25T09:55:02.229 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:55:02.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:02.230 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T09:55:02.312 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T09:55:02.313 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-25T09:55:02.313 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T09:55:02.321 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T09:55:02.321 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-25T09:55:02.321 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T09:55:02.321 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T09:55:02.321 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:55:02.326 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T09:55:02.327 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-25T09:55:02.327 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-25T09:55:02.327 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T09:55:02.327 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:55:02.327 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790" 2024-04-25T09:55:02.327 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790:/ 2024-04-25T09:55:02.327 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=c03d0745-5946-49c3-ad88-1165c5b68b4e" will pass to kernel 2024-04-25T09:55:02.328 INFO:teuthology.orchestra.run.smithi055.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-04-25T09:55:02.328 INFO:teuthology.orchestra.run.smithi055.stdout: You just mounted a file system that supports labels which does not 2024-04-25T09:55:02.328 INFO:teuthology.orchestra.run.smithi055.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T09:55:02.328 INFO:teuthology.orchestra.run.smithi055.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T09:55:02.328 INFO:teuthology.orchestra.run.smithi055.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T09:55:02.329 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:55:02.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:02.329 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-25T09:55:02.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:02.394 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:55:02.451 INFO:teuthology.orchestra.run.smithi055.stdout:client4562 2024-04-25T09:55:02.452 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:55:02.452 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:55:02.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:02.510 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:55:02.566 INFO:teuthology.orchestra.run.smithi055.stdout:client4562 2024-04-25T09:55:02.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:02.617 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:55:02.634 INFO:teuthology.orchestra.run.smithi055.stdout:client4562 2024-04-25T09:55:02.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:02.634 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c03d0745-5946-49c3-ad88-1165c5b68b4e.client4562/status') 2024-04-25T09:55:02.698 INFO:teuthology.orchestra.run.smithi055.stdout:instance: client.4562 (3)192.168.0.2:0/3624577396 2024-04-25T09:55:02.698 INFO:teuthology.orchestra.run.smithi055.stdout:blocklisted: false 2024-04-25T09:55:02.699 INFO:teuthology.orchestra.run.smithi055.stderr:0+1 records in 2024-04-25T09:55:02.699 INFO:teuthology.orchestra.run.smithi055.stderr:0+1 records out 2024-04-25T09:55:02.699 INFO:teuthology.orchestra.run.smithi055.stderr:69 bytes copied, 2.4548e-05 s, 2.8 MB/s 2024-04-25T09:55:02.700 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-25T09:55:02.716 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:55:02.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.827+0000 7f5b1597e640 1 Processor -- start 2024-04-25T09:55:02.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.827+0000 7f5b1597e640 1 -- start start 2024-04-25T09:55:02.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.828+0000 7f5b1597e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5b100d0a50 0x7f5b100d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:02.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.828+0000 7f5b1597e640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b100d1e80 con 0x7f5b1015db00 2024-04-25T09:55:02.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.828+0000 7f5b1597e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b100b5930 con 0x7f5b100b53b0 2024-04-25T09:55:02.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.828+0000 7f5b1597e640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b100b5c10 con 0x7f5b100d0a50 2024-04-25T09:55:02.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.828+0000 7f5b0e7fc640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5b100d0a50 0x7f5b100d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:02.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.828+0000 7f5b0effd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5b1015db00 0x7f5b100d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:57738/0 (socket says 172.21.15.7:57738) 2024-04-25T09:55:02.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.828+0000 7f5b0effd640 1 -- 172.21.15.7:0/204774852 learned_addr learned my addr 172.21.15.7:0/204774852 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:02.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.828+0000 7f5b0e7fc640 1 -- 172.21.15.7:0/204774852 >> v1:172.21.15.55:6789/0 conn(0x7f5b100b53b0 legacy=0x7f5b100d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:02.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.828+0000 7f5b0e7fc640 1 -- 172.21.15.7:0/204774852 >> v1:172.21.15.7:6789/0 conn(0x7f5b1015db00 legacy=0x7f5b100d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:02.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.828+0000 7f5b0e7fc640 1 -- 172.21.15.7:0/204774852 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b100b5ef0 con 0x7f5b100d0a50 2024-04-25T09:55:02.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.828+0000 7f5b0dffb640 1 -- 172.21.15.7:0/204774852 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3417372651 0 0) 0x7f5b100d1e80 con 0x7f5b1015db00 2024-04-25T09:55:02.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.829+0000 7f5b0e7fc640 1 --2- 172.21.15.7:0/204774852 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b100d0a50 0x7f5b100d2330 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5b040097a0 tx=0x7f5b0402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617fc15f8ee3705c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:02.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.829+0000 7f5b0dffb640 1 -- 172.21.15.7:0/204774852 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b04037070 con 0x7f5b100d0a50 2024-04-25T09:55:02.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.829+0000 7f5b0dffb640 1 -- 172.21.15.7:0/204774852 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b04032440 con 0x7f5b100d0a50 2024-04-25T09:55:02.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.829+0000 7f5b0dffb640 1 -- 172.21.15.7:0/204774852 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b04032810 con 0x7f5b100d0a50 2024-04-25T09:55:02.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.830+0000 7f5b1597e640 1 -- 172.21.15.7:0/204774852 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b100d0a50 msgr2=0x7f5b100d2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:02.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.830+0000 7f5b1597e640 1 --2- 172.21.15.7:0/204774852 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b100d0a50 0x7f5b100d2330 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5b040097a0 tx=0x7f5b0402a230 comp rx=0 tx=0).stop 2024-04-25T09:55:02.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.830+0000 7f5b1597e640 1 -- 172.21.15.7:0/204774852 shutdown_connections 2024-04-25T09:55:02.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.830+0000 7f5b1597e640 1 --2- 172.21.15.7:0/204774852 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b100d0a50 0x7f5b100d2330 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:02.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.830+0000 7f5b1597e640 1 -- 172.21.15.7:0/204774852 >> 172.21.15.7:0/204774852 conn(0x7f5b10072290 msgr2=0x7f5b100726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:02.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.830+0000 7f5b1597e640 1 -- 172.21.15.7:0/204774852 shutdown_connections 2024-04-25T09:55:02.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.830+0000 7f5b1597e640 1 -- 172.21.15.7:0/204774852 wait complete. 2024-04-25T09:55:02.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.831+0000 7f5b1597e640 1 Processor -- start 2024-04-25T09:55:02.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.831+0000 7f5b1597e640 1 -- start start 2024-04-25T09:55:02.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.832+0000 7f5b1597e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5b100b53b0 0x7f5b1014e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:02.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.832+0000 7f5b1597e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b100d0a50 0x7f5b100c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:02.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.832+0000 7f5b1597e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b1015db00 0x7f5b100d2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:02.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.832+0000 7f5b1597e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b100d3660 con 0x7f5b100d0a50 2024-04-25T09:55:02.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.832+0000 7f5b1597e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b100b61d0 con 0x7f5b1015db00 2024-04-25T09:55:02.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.832+0000 7f5b1597e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b100d2f80 con 0x7f5b100b53b0 2024-04-25T09:55:02.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.832+0000 7f5b0e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b100d0a50 0x7f5b100c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:02.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.832+0000 7f5b0e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b100d0a50 0x7f5b100c93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55352/0 (socket says 172.21.15.7:55352) 2024-04-25T09:55:02.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.832+0000 7f5b0e7fc640 1 -- 172.21.15.7:0/3198179359 learned_addr learned my addr 172.21.15.7:0/3198179359 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:02.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.832+0000 7f5b0f7fe640 1 --2- 172.21.15.7:0/3198179359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b1015db00 0x7f5b100d2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:02.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.832+0000 7f5b0effd640 1 --2- 172.21.15.7:0/3198179359 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5b100b53b0 0x7f5b1014e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:02.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.833+0000 7f5b0e7fc640 1 -- 172.21.15.7:0/3198179359 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5b100b53b0 msgr2=0x7f5b1014e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:02.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.833+0000 7f5b0e7fc640 1 --2- 172.21.15.7:0/3198179359 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5b100b53b0 0x7f5b1014e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:02.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.833+0000 7f5b0e7fc640 1 -- 172.21.15.7:0/3198179359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b1015db00 msgr2=0x7f5b100d2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:02.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.833+0000 7f5b0e7fc640 1 --2- 172.21.15.7:0/3198179359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b1015db00 0x7f5b100d2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:02.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.833+0000 7f5b0e7fc640 1 -- 172.21.15.7:0/3198179359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b100caf00 con 0x7f5b100d0a50 2024-04-25T09:55:02.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.833+0000 7f5b0e7fc640 1 --2- 172.21.15.7:0/3198179359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b100d0a50 0x7f5b100c93e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5b04000c00 tx=0x7f5b040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:02.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.833+0000 7f5af7fff640 1 -- 172.21.15.7:0/3198179359 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b04037040 con 0x7f5b100d0a50 2024-04-25T09:55:02.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.833+0000 7f5af7fff640 1 -- 172.21.15.7:0/3198179359 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b04042070 con 0x7f5b100d0a50 2024-04-25T09:55:02.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.833+0000 7f5b1597e640 1 -- 172.21.15.7:0/3198179359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b100cb1e0 con 0x7f5b100d0a50 2024-04-25T09:55:02.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.833+0000 7f5af7fff640 1 -- 172.21.15.7:0/3198179359 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b04030a70 con 0x7f5b100d0a50 2024-04-25T09:55:02.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.833+0000 7f5b1597e640 1 -- 172.21.15.7:0/3198179359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b100cb7a0 con 0x7f5b100d0a50 2024-04-25T09:55:02.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.834+0000 7f5b1597e640 1 -- 172.21.15.7:0/3198179359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b10068fd0 con 0x7f5b100d0a50 2024-04-25T09:55:02.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.835+0000 7f5af7fff640 1 -- 172.21.15.7:0/3198179359 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5b04030c10 con 0x7f5b100d0a50 2024-04-25T09:55:02.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.835+0000 7f5af7fff640 1 --2- 172.21.15.7:0/3198179359 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5afc06b4d0 0x7f5afc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:02.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.835+0000 7f5af7fff640 1 -- 172.21.15.7:0/3198179359 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f5b040aae00 con 0x7f5b100d0a50 2024-04-25T09:55:02.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.835+0000 7f5b0effd640 1 --2- 172.21.15.7:0/3198179359 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5afc06b4d0 0x7f5afc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:02.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.836+0000 7f5b0effd640 1 --2- 172.21.15.7:0/3198179359 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5afc06b4d0 0x7f5afc06d990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5b00000f60 tx=0x7f5b00007e40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:02.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:02.839+0000 7f5af7fff640 1 -- 172.21.15.7:0/3198179359 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5b04079380 con 0x7f5b100d0a50 2024-04-25T09:55:03.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.023+0000 7f5b1597e640 1 -- 172.21.15.7:0/3198179359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b100d16b0 con 0x7f5b100d0a50 2024-04-25T09:55:03.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.024+0000 7f5af7fff640 1 -- 172.21.15.7:0/3198179359 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18418 (secure 0 0 0) 0x7f5b0407d420 con 0x7f5b100d0a50 2024-04-25T09:55:03.027 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:03.027 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:54:32.606761+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:54:26.011833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:54:26.535536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:54:30.264996+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:55:03.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.026+0000 7f5b1597e640 1 -- 172.21.15.7:0/3198179359 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5afc06b4d0 msgr2=0x7f5afc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:03.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.026+0000 7f5b1597e640 1 --2- 172.21.15.7:0/3198179359 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5afc06b4d0 0x7f5afc06d990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5b00000f60 tx=0x7f5b00007e40 comp rx=0 tx=0).stop 2024-04-25T09:55:03.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.026+0000 7f5b1597e640 1 -- 172.21.15.7:0/3198179359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b100d0a50 msgr2=0x7f5b100c93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:03.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.026+0000 7f5b1597e640 1 --2- 172.21.15.7:0/3198179359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b100d0a50 0x7f5b100c93e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5b04000c00 tx=0x7f5b040046c0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.026+0000 7f5b1597e640 1 -- 172.21.15.7:0/3198179359 shutdown_connections 2024-04-25T09:55:03.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.026+0000 7f5b1597e640 1 --2- 172.21.15.7:0/3198179359 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5afc06b4d0 0x7f5afc06d990 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.026+0000 7f5b1597e640 1 --2- 172.21.15.7:0/3198179359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b1015db00 0x7f5b100d2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.026+0000 7f5b1597e640 1 --2- 172.21.15.7:0/3198179359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b100d0a50 0x7f5b100c93e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.026+0000 7f5b1597e640 1 --2- 172.21.15.7:0/3198179359 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5b100b53b0 0x7f5b1014e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.026+0000 7f5b1597e640 1 -- 172.21.15.7:0/3198179359 >> 172.21.15.7:0/3198179359 conn(0x7f5b10072290 msgr2=0x7f5b100d4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:03.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.026+0000 7f5b1597e640 1 -- 172.21.15.7:0/3198179359 shutdown_connections 2024-04-25T09:55:03.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.026+0000 7f5b1597e640 1 -- 172.21.15.7:0/3198179359 wait complete. 2024-04-25T09:55:03.040 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:54:26.011833+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:54:26.535536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:54:30.264996+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:55:03.041 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:55:03.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.142+0000 7f2db71ce640 1 Processor -- start 2024-04-25T09:55:03.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.142+0000 7f2db71ce640 1 -- start start 2024-04-25T09:55:03.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.143+0000 7f2db71ce640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2db009a9a0 0x7f2db0168b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:03.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.143+0000 7f2db71ce640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db01615e0 con 0x7f2db0161200 2024-04-25T09:55:03.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.143+0000 7f2db71ce640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db009add0 con 0x7f2db00d0a00 2024-04-25T09:55:03.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.143+0000 7f2db71ce640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db006c9f0 con 0x7f2db009a9a0 2024-04-25T09:55:03.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.143+0000 7f2db4f6a640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2db0161200 0x7f2db00cbd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:57754/0 (socket says 172.21.15.7:57754) 2024-04-25T09:55:03.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.143+0000 7f2db4f6a640 1 -- 172.21.15.7:0/4125342689 learned_addr learned my addr 172.21.15.7:0/4125342689 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:03.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.143+0000 7f2db576b640 1 --2- 172.21.15.7:0/4125342689 >> v2:172.21.15.55:3300/0 conn(0x7f2db009a9a0 0x7f2db0168b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:03.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.143+0000 7f2daf7fe640 1 -- 172.21.15.7:0/4125342689 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2678800855 0 0) 0x7f2da4001110 con 0x7f2db0161200 2024-04-25T09:55:03.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.143+0000 7f2daf7fe640 1 -- 172.21.15.7:0/4125342689 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2da0003520 con 0x7f2db0161200 2024-04-25T09:55:03.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.143+0000 7f2daf7fe640 1 -- 172.21.15.7:0/4125342689 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2602104728 0 0) 0x7f2da0003520 con 0x7f2db0161200 2024-04-25T09:55:03.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.143+0000 7f2daf7fe640 1 -- 172.21.15.7:0/4125342689 >> v2:172.21.15.55:3300/0 conn(0x7f2db009a9a0 msgr2=0x7f2db0168b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:03.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.143+0000 7f2daf7fe640 1 --2- 172.21.15.7:0/4125342689 >> v2:172.21.15.55:3300/0 conn(0x7f2db009a9a0 0x7f2db0168b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.143+0000 7f2daf7fe640 1 -- 172.21.15.7:0/4125342689 >> v1:172.21.15.55:6789/0 conn(0x7f2db00d0a00 legacy=0x7f2db009a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:03.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.143+0000 7f2daf7fe640 1 -- 172.21.15.7:0/4125342689 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db006ccd0 con 0x7f2db0161200 2024-04-25T09:55:03.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.143+0000 7f2daf7fe640 1 -- 172.21.15.7:0/4125342689 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f2da4001840 con 0x7f2db0161200 2024-04-25T09:55:03.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.143+0000 7f2daf7fe640 1 -- 172.21.15.7:0/4125342689 >> v1:172.21.15.7:6789/0 conn(0x7f2db0161200 legacy=0x7f2db00cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:03.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.144+0000 7f2daf7fe640 1 --2- 172.21.15.7:0/4125342689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2da00039b0 0x7f2da0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:03.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.144+0000 7f2daf7fe640 1 --2- 172.21.15.7:0/4125342689 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2da00043b0 0x7f2da0004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:03.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.144+0000 7f2daf7fe640 1 --2- 172.21.15.7:0/4125342689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2da0005080 0x7f2da000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:03.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.144+0000 7f2daf7fe640 1 -- 172.21.15.7:0/4125342689 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db006c9f0 con 0x7f2da00039b0 2024-04-25T09:55:03.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.144+0000 7f2daf7fe640 1 -- 172.21.15.7:0/4125342689 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da000bfe0 con 0x7f2da0005080 2024-04-25T09:55:03.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.144+0000 7f2daf7fe640 1 -- 172.21.15.7:0/4125342689 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da000c1e0 con 0x7f2da00043b0 2024-04-25T09:55:03.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.144+0000 7f2db576b640 1 --2- 172.21.15.7:0/4125342689 >> v2:172.21.15.55:3300/0 conn(0x7f2db009a9a0 0x7f2db0168b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:55:03.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.144+0000 7f2db4f6a640 1 --2- 172.21.15.7:0/4125342689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2da00039b0 0x7f2da0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:03.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.144+0000 7f2daffff640 1 --2- 172.21.15.7:0/4125342689 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2da00043b0 0x7f2da0004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:03.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.144+0000 7f2db576b640 1 --2- 172.21.15.7:0/4125342689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2da0005080 0x7f2da000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:03.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.144+0000 7f2db4f6a640 1 -- 172.21.15.7:0/4125342689 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2da00043b0 msgr2=0x7f2da0004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:03.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.144+0000 7f2db4f6a640 1 --2- 172.21.15.7:0/4125342689 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2da00043b0 0x7f2da0004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.144+0000 7f2db4f6a640 1 -- 172.21.15.7:0/4125342689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2da0005080 msgr2=0x7f2da000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:03.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.144+0000 7f2db4f6a640 1 --2- 172.21.15.7:0/4125342689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2da0005080 0x7f2da000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.144+0000 7f2db4f6a640 1 -- 172.21.15.7:0/4125342689 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da0003520 con 0x7f2da00039b0 2024-04-25T09:55:03.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.144+0000 7f2db576b640 1 -- 172.21.15.7:0/4125342689 reap_dead start 2024-04-25T09:55:03.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.145+0000 7f2db4f6a640 1 --2- 172.21.15.7:0/4125342689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2da00039b0 0x7f2da0003d90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2da400c3e0 tx=0x7f2da0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857f0bfc19ddbf52 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:03.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.145+0000 7f2daf7fe640 1 -- 172.21.15.7:0/4125342689 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da400c0e0 con 0x7f2da00039b0 2024-04-25T09:55:03.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.145+0000 7f2daf7fe640 1 -- 172.21.15.7:0/4125342689 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da4034070 con 0x7f2da00039b0 2024-04-25T09:55:03.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.145+0000 7f2daf7fe640 1 -- 172.21.15.7:0/4125342689 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da4005d50 con 0x7f2da00039b0 2024-04-25T09:55:03.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.145+0000 7f2db71ce640 1 -- 172.21.15.7:0/4125342689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2da00039b0 msgr2=0x7f2da0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:03.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.145+0000 7f2db71ce640 1 --2- 172.21.15.7:0/4125342689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2da00039b0 0x7f2da0003d90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2da400c3e0 tx=0x7f2da0005830 comp rx=0 tx=0).stop 2024-04-25T09:55:03.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.145+0000 7f2db71ce640 1 -- 172.21.15.7:0/4125342689 shutdown_connections 2024-04-25T09:55:03.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.145+0000 7f2db71ce640 1 --2- 172.21.15.7:0/4125342689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2da00039b0 0x7f2da0003d90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.145+0000 7f2db71ce640 1 -- 172.21.15.7:0/4125342689 >> 172.21.15.7:0/4125342689 conn(0x7f2db00b31a0 msgr2=0x7f2db00b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:03.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.145+0000 7f2db71ce640 1 -- 172.21.15.7:0/4125342689 shutdown_connections 2024-04-25T09:55:03.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.145+0000 7f2db71ce640 1 -- 172.21.15.7:0/4125342689 wait complete. 2024-04-25T09:55:03.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.147+0000 7f2db71ce640 1 Processor -- start 2024-04-25T09:55:03.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.147+0000 7f2db71ce640 1 -- start start 2024-04-25T09:55:03.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.147+0000 7f2db71ce640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2da00039b0 0x7f2db0149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:03.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.147+0000 7f2db71ce640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2db0152d90 0x7f2db00c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:03.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.147+0000 7f2db71ce640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2db0153980 0x7f2db0153e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:03.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.147+0000 7f2db71ce640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db006c680 con 0x7f2db0153980 2024-04-25T09:55:03.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.147+0000 7f2db71ce640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db0099d70 con 0x7f2da00039b0 2024-04-25T09:55:03.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.147+0000 7f2db71ce640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db006cfb0 con 0x7f2db0152d90 2024-04-25T09:55:03.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.148+0000 7f2db576b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2db0153980 0x7f2db0153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:03.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.148+0000 7f2db576b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2db0153980 0x7f2db0153e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55370/0 (socket says 172.21.15.7:55370) 2024-04-25T09:55:03.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.148+0000 7f2db576b640 1 -- 172.21.15.7:0/853694557 learned_addr learned my addr 172.21.15.7:0/853694557 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:03.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.148+0000 7f2daffff640 1 --2- 172.21.15.7:0/853694557 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2db0152d90 0x7f2db00c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:03.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.148+0000 7f2db4f6a640 1 --2- 172.21.15.7:0/853694557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2da00039b0 0x7f2db0149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:03.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.148+0000 7f2db576b640 1 -- 172.21.15.7:0/853694557 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2db0152d90 msgr2=0x7f2db00c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:03.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.148+0000 7f2db576b640 1 --2- 172.21.15.7:0/853694557 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2db0152d90 0x7f2db00c6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.148+0000 7f2db576b640 1 -- 172.21.15.7:0/853694557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2da00039b0 msgr2=0x7f2db0149b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:03.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.148+0000 7f2db576b640 1 --2- 172.21.15.7:0/853694557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2da00039b0 0x7f2db0149b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.148+0000 7f2db576b640 1 -- 172.21.15.7:0/853694557 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db00c76e0 con 0x7f2db0153980 2024-04-25T09:55:03.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.148+0000 7f2db576b640 1 --2- 172.21.15.7:0/853694557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2db0153980 0x7f2db0153e00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2db0072ec0 tx=0x7f2da800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:03.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.148+0000 7f2dad7fa640 1 -- 172.21.15.7:0/853694557 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da800fd90 con 0x7f2db0153980 2024-04-25T09:55:03.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.148+0000 7f2dad7fa640 1 -- 172.21.15.7:0/853694557 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da8003990 con 0x7f2db0153980 2024-04-25T09:55:03.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.148+0000 7f2db71ce640 1 -- 172.21.15.7:0/853694557 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db00c79c0 con 0x7f2db0153980 2024-04-25T09:55:03.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.148+0000 7f2dad7fa640 1 -- 172.21.15.7:0/853694557 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da8003d80 con 0x7f2db0153980 2024-04-25T09:55:03.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.148+0000 7f2db71ce640 1 -- 172.21.15.7:0/853694557 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db00b5020 con 0x7f2db0153980 2024-04-25T09:55:03.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.149+0000 7f2db71ce640 1 -- 172.21.15.7:0/853694557 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db0068f60 con 0x7f2db0153980 2024-04-25T09:55:03.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.150+0000 7f2dad7fa640 1 -- 172.21.15.7:0/853694557 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2da801f020 con 0x7f2db0153980 2024-04-25T09:55:03.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.150+0000 7f2dad7fa640 1 --2- 172.21.15.7:0/853694557 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d9406b500 0x7f2d9406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:03.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.150+0000 7f2dad7fa640 1 -- 172.21.15.7:0/853694557 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2da808a930 con 0x7f2db0153980 2024-04-25T09:55:03.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.150+0000 7f2db4f6a640 1 --2- 172.21.15.7:0/853694557 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d9406b500 0x7f2d9406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:03.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.150+0000 7f2db4f6a640 1 --2- 172.21.15.7:0/853694557 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d9406b500 0x7f2d9406d9c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2da400c3b0 tx=0x7f2da402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:03.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.154+0000 7f2dad7fa640 1 -- 172.21.15.7:0/853694557 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2da8010040 con 0x7f2db0153980 2024-04-25T09:55:03.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.334+0000 7f2db71ce640 1 -- 172.21.15.7:0/853694557 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2db00b4050 con 0x7f2db0153980 2024-04-25T09:55:03.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.334+0000 7f2dad7fa640 1 -- 172.21.15.7:0/853694557 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2da8059470 con 0x7f2db0153980 2024-04-25T09:55:03.337 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T09:55:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.337+0000 7f2db71ce640 1 -- 172.21.15.7:0/853694557 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d9406b500 msgr2=0x7f2d9406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.337+0000 7f2db71ce640 1 --2- 172.21.15.7:0/853694557 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d9406b500 0x7f2d9406d9c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2da400c3b0 tx=0x7f2da402e000 comp rx=0 tx=0).stop 2024-04-25T09:55:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.337+0000 7f2db71ce640 1 -- 172.21.15.7:0/853694557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2db0153980 msgr2=0x7f2db0153e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.337+0000 7f2db71ce640 1 --2- 172.21.15.7:0/853694557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2db0153980 0x7f2db0153e00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2db0072ec0 tx=0x7f2da800f580 comp rx=0 tx=0).stop 2024-04-25T09:55:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.337+0000 7f2db71ce640 1 -- 172.21.15.7:0/853694557 shutdown_connections 2024-04-25T09:55:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.337+0000 7f2db71ce640 1 --2- 172.21.15.7:0/853694557 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d9406b500 0x7f2d9406d9c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.337+0000 7f2db71ce640 1 --2- 172.21.15.7:0/853694557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2db0153980 0x7f2db0153e00 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.337+0000 7f2db71ce640 1 --2- 172.21.15.7:0/853694557 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2db0152d90 0x7f2db00c6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.337+0000 7f2db71ce640 1 --2- 172.21.15.7:0/853694557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2da00039b0 0x7f2db0149b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.337+0000 7f2db71ce640 1 -- 172.21.15.7:0/853694557 >> 172.21.15.7:0/853694557 conn(0x7f2db00b31a0 msgr2=0x7f2db015cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.337+0000 7f2db71ce640 1 -- 172.21.15.7:0/853694557 shutdown_connections 2024-04-25T09:55:03.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.337+0000 7f2db71ce640 1 -- 172.21.15.7:0/853694557 wait complete. 2024-04-25T09:55:03.351 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:55:03.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.452+0000 7f9d2d3db640 1 Processor -- start 2024-04-25T09:55:03.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.452+0000 7f9d2d3db640 1 -- start start 2024-04-25T09:55:03.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.453+0000 7f9d2d3db640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d2815b7a0 0x7f9d280b1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:03.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.453+0000 7f9d2d3db640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9d280cd580 0x7f9d2806afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:03.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.453+0000 7f9d2d3db640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d280b1e40 con 0x7f9d2806ab60 2024-04-25T09:55:03.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.453+0000 7f9d2d3db640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d2806b500 con 0x7f9d280cd580 2024-04-25T09:55:03.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.453+0000 7f9d2d3db640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d280d13e0 con 0x7f9d2815b7a0 2024-04-25T09:55:03.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.453+0000 7f9d267fc640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9d2806ab60 0x7f9d2815f430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:57764/0 (socket says 172.21.15.7:57764) 2024-04-25T09:55:03.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.453+0000 7f9d267fc640 1 -- 172.21.15.7:0/3119159538 learned_addr learned my addr 172.21.15.7:0/3119159538 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:03.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.454+0000 7f9d277fe640 1 --2- 172.21.15.7:0/3119159538 >> v2:172.21.15.55:3300/0 conn(0x7f9d280cd580 0x7f9d2806afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:03.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.454+0000 7f9d26ffd640 1 --2- 172.21.15.7:0/3119159538 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d2815b7a0 0x7f9d280b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:03.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.454+0000 7f9d25ffb640 1 -- 172.21.15.7:0/3119159538 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 750313108 0 0) 0x7f9d10001110 con 0x7f9d2806ab60 2024-04-25T09:55:03.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.454+0000 7f9d25ffb640 1 -- 172.21.15.7:0/3119159538 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d14007930 con 0x7f9d2806ab60 2024-04-25T09:55:03.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.454+0000 7f9d25ffb640 1 -- 172.21.15.7:0/3119159538 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 18419587 0 0) 0x7f9d14007930 con 0x7f9d2806ab60 2024-04-25T09:55:03.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.454+0000 7f9d25ffb640 1 -- 172.21.15.7:0/3119159538 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d2815b7a0 msgr2=0x7f9d280b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:03.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.454+0000 7f9d25ffb640 1 --2- 172.21.15.7:0/3119159538 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d2815b7a0 0x7f9d280b1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.454+0000 7f9d25ffb640 1 -- 172.21.15.7:0/3119159538 >> v2:172.21.15.55:3300/0 conn(0x7f9d280cd580 msgr2=0x7f9d2806afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:03.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.454+0000 7f9d25ffb640 1 --2- 172.21.15.7:0/3119159538 >> v2:172.21.15.55:3300/0 conn(0x7f9d280cd580 0x7f9d2806afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.454+0000 7f9d25ffb640 1 -- 172.21.15.7:0/3119159538 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d280d0860 con 0x7f9d2806ab60 2024-04-25T09:55:03.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.454+0000 7f9d25ffb640 1 -- 172.21.15.7:0/3119159538 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f9d10001840 con 0x7f9d2806ab60 2024-04-25T09:55:03.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.454+0000 7f9d26ffd640 1 --2- 172.21.15.7:0/3119159538 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d2815b7a0 0x7f9d280b1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:55:03.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.454+0000 7f9d25ffb640 1 -- 172.21.15.7:0/3119159538 >> v1:172.21.15.7:6789/0 conn(0x7f9d2806ab60 legacy=0x7f9d2815f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:03.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.454+0000 7f9d25ffb640 1 --2- 172.21.15.7:0/3119159538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d14007dc0 0x7f9d140081e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:03.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.454+0000 7f9d25ffb640 1 --2- 172.21.15.7:0/3119159538 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d2815b7a0 0x7f9d14008c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:03.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.454+0000 7f9d25ffb640 1 --2- 172.21.15.7:0/3119159538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d14009150 0x7f9d140095d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:03.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.454+0000 7f9d25ffb640 1 -- 172.21.15.7:0/3119159538 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d280d13e0 con 0x7f9d14009150 2024-04-25T09:55:03.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.454+0000 7f9d25ffb640 1 -- 172.21.15.7:0/3119159538 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1400fdd0 con 0x7f9d14007dc0 2024-04-25T09:55:03.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.454+0000 7f9d25ffb640 1 -- 172.21.15.7:0/3119159538 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1400ff50 con 0x7f9d2815b7a0 2024-04-25T09:55:03.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.454+0000 7f9d277fe640 1 --2- 172.21.15.7:0/3119159538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d14009150 0x7f9d140095d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:03.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.454+0000 7f9d267fc640 1 --2- 172.21.15.7:0/3119159538 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d2815b7a0 0x7f9d14008c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:03.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.454+0000 7f9d26ffd640 1 --2- 172.21.15.7:0/3119159538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d14007dc0 0x7f9d140081e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:03.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.454+0000 7f9d277fe640 1 -- 172.21.15.7:0/3119159538 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d2815b7a0 msgr2=0x7f9d14008c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:03.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.454+0000 7f9d277fe640 1 --2- 172.21.15.7:0/3119159538 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d2815b7a0 0x7f9d14008c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.454+0000 7f9d277fe640 1 -- 172.21.15.7:0/3119159538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d14007dc0 msgr2=0x7f9d140081e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:03.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.454+0000 7f9d277fe640 1 --2- 172.21.15.7:0/3119159538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d14007dc0 0x7f9d140081e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.454+0000 7f9d277fe640 1 -- 172.21.15.7:0/3119159538 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d14007930 con 0x7f9d14009150 2024-04-25T09:55:03.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.454+0000 7f9d26ffd640 1 --2- 172.21.15.7:0/3119159538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d14007dc0 0x7f9d140081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:03.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.455+0000 7f9d277fe640 1 --2- 172.21.15.7:0/3119159538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d14009150 0x7f9d140095d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009f90 tx=0x7f9d14009c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a616d5e5b23524e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:03.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.455+0000 7f9d25ffb640 1 -- 172.21.15.7:0/3119159538 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d18009c10 con 0x7f9d14009150 2024-04-25T09:55:03.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.455+0000 7f9d25ffb640 1 -- 172.21.15.7:0/3119159538 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d18036070 con 0x7f9d14009150 2024-04-25T09:55:03.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.455+0000 7f9d25ffb640 1 -- 172.21.15.7:0/3119159538 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d18031840 con 0x7f9d14009150 2024-04-25T09:55:03.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.456+0000 7f9d2d3db640 1 -- 172.21.15.7:0/3119159538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d14009150 msgr2=0x7f9d140095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:03.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.456+0000 7f9d2d3db640 1 --2- 172.21.15.7:0/3119159538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d14009150 0x7f9d140095d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009f90 tx=0x7f9d14009c40 comp rx=0 tx=0).stop 2024-04-25T09:55:03.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.456+0000 7f9d277fe640 1 -- 172.21.15.7:0/3119159538 reap_dead start 2024-04-25T09:55:03.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.456+0000 7f9d2d3db640 1 -- 172.21.15.7:0/3119159538 shutdown_connections 2024-04-25T09:55:03.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.456+0000 7f9d2d3db640 1 -- 172.21.15.7:0/3119159538 >> 172.21.15.7:0/3119159538 conn(0x7f9d280725e0 msgr2=0x7f9d280999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:03.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.456+0000 7f9d2d3db640 1 -- 172.21.15.7:0/3119159538 shutdown_connections 2024-04-25T09:55:03.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.456+0000 7f9d2d3db640 1 -- 172.21.15.7:0/3119159538 wait complete. 2024-04-25T09:55:03.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.457+0000 7f9d2d3db640 1 Processor -- start 2024-04-25T09:55:03.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.457+0000 7f9d2d3db640 1 -- start start 2024-04-25T09:55:03.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.458+0000 7f9d2d3db640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d280cc6e0 0x7f9d280b0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:03.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.458+0000 7f9d2d3db640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d280ccac0 0x7f9d280b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:03.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.458+0000 7f9d2d3db640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d28158150 0x7f9d281585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:03.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.458+0000 7f9d2d3db640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d280d1100 con 0x7f9d280ccac0 2024-04-25T09:55:03.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.458+0000 7f9d2d3db640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d280d0e20 con 0x7f9d280cc6e0 2024-04-25T09:55:03.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.458+0000 7f9d2d3db640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d280d04f0 con 0x7f9d28158150 2024-04-25T09:55:03.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.458+0000 7f9d267fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d280ccac0 0x7f9d280b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:03.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.458+0000 7f9d267fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d280ccac0 0x7f9d280b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55376/0 (socket says 172.21.15.7:55376) 2024-04-25T09:55:03.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.458+0000 7f9d267fc640 1 -- 172.21.15.7:0/3529085313 learned_addr learned my addr 172.21.15.7:0/3529085313 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:03.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.458+0000 7f9d277fe640 1 --2- 172.21.15.7:0/3529085313 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d28158150 0x7f9d281585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:03.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.458+0000 7f9d26ffd640 1 --2- 172.21.15.7:0/3529085313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d280cc6e0 0x7f9d280b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:03.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.458+0000 7f9d267fc640 1 -- 172.21.15.7:0/3529085313 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d28158150 msgr2=0x7f9d281585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:03.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.458+0000 7f9d267fc640 1 --2- 172.21.15.7:0/3529085313 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d28158150 0x7f9d281585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.458+0000 7f9d267fc640 1 -- 172.21.15.7:0/3529085313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d280cc6e0 msgr2=0x7f9d280b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:03.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.458+0000 7f9d267fc640 1 --2- 172.21.15.7:0/3529085313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d280cc6e0 0x7f9d280b0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.458+0000 7f9d267fc640 1 -- 172.21.15.7:0/3529085313 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d280b0e00 con 0x7f9d280ccac0 2024-04-25T09:55:03.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.458+0000 7f9d26ffd640 1 --2- 172.21.15.7:0/3529085313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d280cc6e0 0x7f9d280b0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:03.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.459+0000 7f9d267fc640 1 --2- 172.21.15.7:0/3529085313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d280ccac0 0x7f9d280b08c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9d100019b0 tx=0x7f9d10007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:03.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.459+0000 7f9d1f7fe640 1 -- 172.21.15.7:0/3529085313 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1000f960 con 0x7f9d280ccac0 2024-04-25T09:55:03.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.459+0000 7f9d1f7fe640 1 -- 172.21.15.7:0/3529085313 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d10018070 con 0x7f9d280ccac0 2024-04-25T09:55:03.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.459+0000 7f9d2d3db640 1 -- 172.21.15.7:0/3529085313 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d280c8590 con 0x7f9d280ccac0 2024-04-25T09:55:03.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.459+0000 7f9d1f7fe640 1 -- 172.21.15.7:0/3529085313 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1000fd60 con 0x7f9d280ccac0 2024-04-25T09:55:03.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.459+0000 7f9d2d3db640 1 -- 172.21.15.7:0/3529085313 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d280c7ab0 con 0x7f9d280ccac0 2024-04-25T09:55:03.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.460+0000 7f9d2d3db640 1 -- 172.21.15.7:0/3529085313 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d28068f60 con 0x7f9d280ccac0 2024-04-25T09:55:03.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.460+0000 7f9d1f7fe640 1 -- 172.21.15.7:0/3529085313 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9d1001d460 con 0x7f9d280ccac0 2024-04-25T09:55:03.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.461+0000 7f9d1f7fe640 1 --2- 172.21.15.7:0/3529085313 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9d0806b4d0 0x7f9d0806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:03.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.461+0000 7f9d1f7fe640 1 -- 172.21.15.7:0/3529085313 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9d1008a640 con 0x7f9d280ccac0 2024-04-25T09:55:03.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.461+0000 7f9d26ffd640 1 --2- 172.21.15.7:0/3529085313 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9d0806b4d0 0x7f9d0806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:03.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.461+0000 7f9d26ffd640 1 --2- 172.21.15.7:0/3529085313 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9d0806b4d0 0x7f9d0806d990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9d2815c8b0 tx=0x7f9d20008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:03.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.465+0000 7f9d1f7fe640 1 -- 172.21.15.7:0/3529085313 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9d280b1e40 con 0x7f9d280ccac0 2024-04-25T09:55:03.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.643+0000 7f9d2d3db640 1 -- 172.21.15.7:0/3529085313 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9d2815cf70 con 0x7f9d280ccac0 2024-04-25T09:55:03.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.644+0000 7f9d1f7fe640 1 -- 172.21.15.7:0/3529085313 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9d10059180 con 0x7f9d280ccac0 2024-04-25T09:55:03.647 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:55:03.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.646+0000 7f9d2d3db640 1 -- 172.21.15.7:0/3529085313 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9d0806b4d0 msgr2=0x7f9d0806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:03.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.646+0000 7f9d2d3db640 1 --2- 172.21.15.7:0/3529085313 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9d0806b4d0 0x7f9d0806d990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9d2815c8b0 tx=0x7f9d20008040 comp rx=0 tx=0).stop 2024-04-25T09:55:03.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.646+0000 7f9d2d3db640 1 -- 172.21.15.7:0/3529085313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d280ccac0 msgr2=0x7f9d280b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:03.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.646+0000 7f9d2d3db640 1 --2- 172.21.15.7:0/3529085313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d280ccac0 0x7f9d280b08c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9d100019b0 tx=0x7f9d10007720 comp rx=0 tx=0).stop 2024-04-25T09:55:03.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.646+0000 7f9d2d3db640 1 -- 172.21.15.7:0/3529085313 shutdown_connections 2024-04-25T09:55:03.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.646+0000 7f9d2d3db640 1 --2- 172.21.15.7:0/3529085313 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9d0806b4d0 0x7f9d0806d990 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.646+0000 7f9d2d3db640 1 --2- 172.21.15.7:0/3529085313 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d28158150 0x7f9d281585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.646+0000 7f9d2d3db640 1 --2- 172.21.15.7:0/3529085313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d280ccac0 0x7f9d280b08c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.646+0000 7f9d2d3db640 1 --2- 172.21.15.7:0/3529085313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d280cc6e0 0x7f9d280b0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.646+0000 7f9d2d3db640 1 -- 172.21.15.7:0/3529085313 >> 172.21.15.7:0/3529085313 conn(0x7f9d280725e0 msgr2=0x7f9d2806eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:03.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.646+0000 7f9d2d3db640 1 -- 172.21.15.7:0/3529085313 shutdown_connections 2024-04-25T09:55:03.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.646+0000 7f9d2d3db640 1 -- 172.21.15.7:0/3529085313 wait complete. 2024-04-25T09:55:03.660 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:55:03.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.761+0000 7f8e06b53640 1 Processor -- start 2024-04-25T09:55:03.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.761+0000 7f8e06b53640 1 -- start start 2024-04-25T09:55:03.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.762+0000 7f8e06b53640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8e000d3760 0x7f8e0015eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:03.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.762+0000 7f8e06b53640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e000ced10 con 0x7f8e000ce830 2024-04-25T09:55:03.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.762+0000 7f8e06b53640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e000d1b40 con 0x7f8e0015f1c0 2024-04-25T09:55:03.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.762+0000 7f8e06b53640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e000ce380 con 0x7f8e000d3760 2024-04-25T09:55:03.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.762+0000 7f8e050f0640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f8e000ce830 0x7f8e000b2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:57780/0 (socket says 172.21.15.7:57780) 2024-04-25T09:55:03.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.762+0000 7f8e050f0640 1 -- 172.21.15.7:0/1860337405 learned_addr learned my addr 172.21.15.7:0/1860337405 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:03.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.762+0000 7f8e048ef640 1 --2- 172.21.15.7:0/1860337405 >> v2:172.21.15.7:3300/0 conn(0x7f8e000d3760 0x7f8e0015eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:03.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.762+0000 7f8e048ef640 1 -- 172.21.15.7:0/1860337405 >> v1:172.21.15.55:6789/0 conn(0x7f8e0015f1c0 legacy=0x7f8e000d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:03.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.762+0000 7f8e048ef640 1 -- 172.21.15.7:0/1860337405 >> v1:172.21.15.7:6789/0 conn(0x7f8e000ce830 legacy=0x7f8e000b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:03.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.762+0000 7f8e048ef640 1 -- 172.21.15.7:0/1860337405 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e000d1e20 con 0x7f8e000d3760 2024-04-25T09:55:03.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.763+0000 7f8e048ef640 1 --2- 172.21.15.7:0/1860337405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e000d3760 0x7f8e0015eac0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8df8009d90 tx=0x7f8df802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fed13ae8b9cad2d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:03.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.763+0000 7f8dff7fe640 1 -- 172.21.15.7:0/1860337405 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df8007740 con 0x7f8e000d3760 2024-04-25T09:55:03.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.763+0000 7f8dff7fe640 1 -- 172.21.15.7:0/1860337405 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df80078e0 con 0x7f8e000d3760 2024-04-25T09:55:03.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.763+0000 7f8dff7fe640 1 -- 172.21.15.7:0/1860337405 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df8007cb0 con 0x7f8e000d3760 2024-04-25T09:55:03.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.764+0000 7f8e06b53640 1 -- 172.21.15.7:0/1860337405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e000d3760 msgr2=0x7f8e0015eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:03.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.764+0000 7f8e06b53640 1 --2- 172.21.15.7:0/1860337405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e000d3760 0x7f8e0015eac0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8df8009d90 tx=0x7f8df802a6a0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.764+0000 7f8e06b53640 1 -- 172.21.15.7:0/1860337405 shutdown_connections 2024-04-25T09:55:03.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.764+0000 7f8e06b53640 1 --2- 172.21.15.7:0/1860337405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e000d3760 0x7f8e0015eac0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.764+0000 7f8e06b53640 1 -- 172.21.15.7:0/1860337405 >> 172.21.15.7:0/1860337405 conn(0x7f8e00072680 msgr2=0x7f8e00072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:03.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.764+0000 7f8e06b53640 1 -- 172.21.15.7:0/1860337405 shutdown_connections 2024-04-25T09:55:03.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.764+0000 7f8e06b53640 1 -- 172.21.15.7:0/1860337405 wait complete. 2024-04-25T09:55:03.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.765+0000 7f8e06b53640 1 Processor -- start 2024-04-25T09:55:03.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.765+0000 7f8e06b53640 1 -- start start 2024-04-25T09:55:03.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.766+0000 7f8e06b53640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e000ce830 0x7f8e00156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:03.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.766+0000 7f8e06b53640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e000d3760 0x7f8e00156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:03.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.766+0000 7f8e06b53640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8e0015f1c0 0x7f8e000b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:03.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.766+0000 7f8e06b53640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e000d2190 con 0x7f8e000ce830 2024-04-25T09:55:03.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.766+0000 7f8e06b53640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0015f000 con 0x7f8e000d3760 2024-04-25T09:55:03.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.766+0000 7f8e06b53640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e000b2950 con 0x7f8e0015f1c0 2024-04-25T09:55:03.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.766+0000 7f8e048ef640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e000ce830 0x7f8e00156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:03.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.766+0000 7f8e048ef640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e000ce830 0x7f8e00156cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55408/0 (socket says 172.21.15.7:55408) 2024-04-25T09:55:03.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.766+0000 7f8e048ef640 1 -- 172.21.15.7:0/1113406731 learned_addr learned my addr 172.21.15.7:0/1113406731 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:03.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.766+0000 7f8dfffff640 1 --2- 172.21.15.7:0/1113406731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e000d3760 0x7f8e00156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:03.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.766+0000 7f8e050f0640 1 --2- 172.21.15.7:0/1113406731 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8e0015f1c0 0x7f8e000b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:03.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.766+0000 7f8e048ef640 1 -- 172.21.15.7:0/1113406731 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8e0015f1c0 msgr2=0x7f8e000b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:03.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.766+0000 7f8e048ef640 1 --2- 172.21.15.7:0/1113406731 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8e0015f1c0 0x7f8e000b4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.766+0000 7f8e048ef640 1 -- 172.21.15.7:0/1113406731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e000d3760 msgr2=0x7f8e00156600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:03.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.766+0000 7f8e048ef640 1 --2- 172.21.15.7:0/1113406731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e000d3760 0x7f8e00156600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.766+0000 7f8e048ef640 1 -- 172.21.15.7:0/1113406731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e00157370 con 0x7f8e000ce830 2024-04-25T09:55:03.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.766+0000 7f8dfffff640 1 --2- 172.21.15.7:0/1113406731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e000d3760 0x7f8e00156600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:03.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.767+0000 7f8e048ef640 1 --2- 172.21.15.7:0/1113406731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e000ce830 0x7f8e00156cb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8df8009d90 tx=0x7f8df8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:03.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.767+0000 7f8dfd7fa640 1 -- 172.21.15.7:0/1113406731 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df8040070 con 0x7f8e000ce830 2024-04-25T09:55:03.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.767+0000 7f8dfd7fa640 1 -- 172.21.15.7:0/1113406731 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df8031d00 con 0x7f8e000ce830 2024-04-25T09:55:03.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.767+0000 7f8e06b53640 1 -- 172.21.15.7:0/1113406731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e00157650 con 0x7f8e000ce830 2024-04-25T09:55:03.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.767+0000 7f8dfd7fa640 1 -- 172.21.15.7:0/1113406731 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df8045660 con 0x7f8e000ce830 2024-04-25T09:55:03.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.767+0000 7f8e06b53640 1 -- 172.21.15.7:0/1113406731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e00157c10 con 0x7f8e000ce830 2024-04-25T09:55:03.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.768+0000 7f8e06b53640 1 -- 172.21.15.7:0/1113406731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e00068f60 con 0x7f8e000ce830 2024-04-25T09:55:03.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.768+0000 7f8dfd7fa640 1 -- 172.21.15.7:0/1113406731 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8df8039040 con 0x7f8e000ce830 2024-04-25T09:55:03.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.769+0000 7f8dfd7fa640 1 --2- 172.21.15.7:0/1113406731 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8dec06b4d0 0x7f8dec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:03.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.769+0000 7f8dfd7fa640 1 -- 172.21.15.7:0/1113406731 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8df80abff0 con 0x7f8e000ce830 2024-04-25T09:55:03.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.769+0000 7f8dfffff640 1 --2- 172.21.15.7:0/1113406731 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8dec06b4d0 0x7f8dec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:03.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.769+0000 7f8dfffff640 1 --2- 172.21.15.7:0/1113406731 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8dec06b4d0 0x7f8dec06d990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8df4006fd0 tx=0x7f8df4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:03.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.773+0000 7f8dfd7fa640 1 -- 172.21.15.7:0/1113406731 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8df807a4d0 con 0x7f8e000ce830 2024-04-25T09:55:03.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.953+0000 7f8e06b53640 1 -- 172.21.15.7:0/1113406731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8e000ce610 con 0x7f8e000ce830 2024-04-25T09:55:03.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.954+0000 7f8dfd7fa640 1 -- 172.21.15.7:0/1113406731 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8df807e570 con 0x7f8e000ce830 2024-04-25T09:55:03.957 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T09:55:03.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.955+0000 7f8e06b53640 1 -- 172.21.15.7:0/1113406731 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8dec06b4d0 msgr2=0x7f8dec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:03.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.955+0000 7f8e06b53640 1 --2- 172.21.15.7:0/1113406731 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8dec06b4d0 0x7f8dec06d990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8df4006fd0 tx=0x7f8df4008040 comp rx=0 tx=0).stop 2024-04-25T09:55:03.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.955+0000 7f8e06b53640 1 -- 172.21.15.7:0/1113406731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e000ce830 msgr2=0x7f8e00156cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:03.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.955+0000 7f8e06b53640 1 --2- 172.21.15.7:0/1113406731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e000ce830 0x7f8e00156cb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8df8009d90 tx=0x7f8df8004a40 comp rx=0 tx=0).stop 2024-04-25T09:55:03.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.956+0000 7f8e06b53640 1 -- 172.21.15.7:0/1113406731 shutdown_connections 2024-04-25T09:55:03.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.956+0000 7f8e06b53640 1 --2- 172.21.15.7:0/1113406731 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8dec06b4d0 0x7f8dec06d990 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.956+0000 7f8e06b53640 1 --2- 172.21.15.7:0/1113406731 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8e0015f1c0 0x7f8e000b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.956+0000 7f8e06b53640 1 --2- 172.21.15.7:0/1113406731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e000d3760 0x7f8e00156600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.956+0000 7f8e06b53640 1 --2- 172.21.15.7:0/1113406731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e000ce830 0x7f8e00156cb0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:03.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.956+0000 7f8e06b53640 1 -- 172.21.15.7:0/1113406731 >> 172.21.15.7:0/1113406731 conn(0x7f8e00072680 msgr2=0x7f8e000b7510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:03.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.956+0000 7f8e06b53640 1 -- 172.21.15.7:0/1113406731 shutdown_connections 2024-04-25T09:55:03.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:03.956+0000 7f8e06b53640 1 -- 172.21.15.7:0/1113406731 wait complete. 2024-04-25T09:55:03.969 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:55:04.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.070+0000 7f44a3b90640 1 Processor -- start 2024-04-25T09:55:04.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.070+0000 7f44a3b90640 1 -- start start 2024-04-25T09:55:04.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.071+0000 7f44a3b90640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f449c143fb0 0x7f449c0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:04.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.071+0000 7f44a3b90640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f449c06e240 0x7f449c06e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:04.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.071+0000 7f44a3b90640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449c0b2ee0 con 0x7f449c0ce610 2024-04-25T09:55:04.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.071+0000 7f44a3b90640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f449c06ebe0 con 0x7f449c143fb0 2024-04-25T09:55:04.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.071+0000 7f44a3b90640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449c0b3150 con 0x7f449c06e240 2024-04-25T09:55:04.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.072+0000 7f44a112b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f449c06e240 0x7f449c06e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:04.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.072+0000 7f44a192c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f449c143fb0 0x7f449c0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:04.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.072+0000 7f44a112b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f449c06e240 0x7f449c06e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:38358/0 (socket says 172.21.15.7:38358) 2024-04-25T09:55:04.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.072+0000 7f44a112b640 1 -- 172.21.15.7:0/1652847244 learned_addr learned my addr 172.21.15.7:0/1652847244 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:04.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.072+0000 7f44a112b640 1 -- 172.21.15.7:0/1652847244 >> v2:172.21.15.55:3300/0 conn(0x7f449c143fb0 msgr2=0x7f449c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:04.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.072+0000 7f44a112b640 1 --2- 172.21.15.7:0/1652847244 >> v2:172.21.15.55:3300/0 conn(0x7f449c143fb0 0x7f449c0b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:04.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.072+0000 7f44a112b640 1 -- 172.21.15.7:0/1652847244 >> v1:172.21.15.55:6789/0 conn(0x7f449c0ce610 legacy=0x7f449c0cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:04.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.072+0000 7f44a112b640 1 -- 172.21.15.7:0/1652847244 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c0b3430 con 0x7f449c06e240 2024-04-25T09:55:04.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.072+0000 7f44a192c640 1 --2- 172.21.15.7:0/1652847244 >> v2:172.21.15.55:3300/0 conn(0x7f449c143fb0 0x7f449c0b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:55:04.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.073+0000 7f44a112b640 1 --2- 172.21.15.7:0/1652847244 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f449c06e240 0x7f449c06e6a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f449000bb10 tx=0x7f449002c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f6c29230e5287a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:04.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.073+0000 7f44a092a640 1 -- 172.21.15.7:0/1652847244 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4490036020 con 0x7f449c06e240 2024-04-25T09:55:04.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.073+0000 7f44a092a640 1 -- 172.21.15.7:0/1652847244 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4490032820 con 0x7f449c06e240 2024-04-25T09:55:04.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.073+0000 7f44a092a640 1 -- 172.21.15.7:0/1652847244 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4490032bf0 con 0x7f449c06e240 2024-04-25T09:55:04.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.073+0000 7f44a3b90640 1 -- 172.21.15.7:0/1652847244 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f449c06e240 msgr2=0x7f449c06e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:04.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.073+0000 7f44a3b90640 1 --2- 172.21.15.7:0/1652847244 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f449c06e240 0x7f449c06e6a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f449000bb10 tx=0x7f449002c920 comp rx=0 tx=0).stop 2024-04-25T09:55:04.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.074+0000 7f44a3b90640 1 -- 172.21.15.7:0/1652847244 shutdown_connections 2024-04-25T09:55:04.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.074+0000 7f44a3b90640 1 --2- 172.21.15.7:0/1652847244 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f449c06e240 0x7f449c06e6a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:04.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.074+0000 7f44a3b90640 1 --2- 172.21.15.7:0/1652847244 >> v2:172.21.15.55:3300/0 conn(0x7f449c143fb0 0x7f449c0b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:04.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.074+0000 7f44a3b90640 1 -- 172.21.15.7:0/1652847244 >> 172.21.15.7:0/1652847244 conn(0x7f449c06ab60 msgr2=0x7f449c06af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:04.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.074+0000 7f44a3b90640 1 -- 172.21.15.7:0/1652847244 shutdown_connections 2024-04-25T09:55:04.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.074+0000 7f44a3b90640 1 -- 172.21.15.7:0/1652847244 wait complete. 2024-04-25T09:55:04.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.075+0000 7f44a3b90640 1 Processor -- start 2024-04-25T09:55:04.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.075+0000 7f44a3b90640 1 -- start start 2024-04-25T09:55:04.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.076+0000 7f44a3b90640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f449c06e240 0x7f449c13c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:04.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.076+0000 7f44a3b90640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f449c0ce610 0x7f449c13e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:04.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.076+0000 7f44a3b90640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f449c143fb0 0x7f449c13eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:04.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.076+0000 7f44a3b90640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449c0cf2f0 con 0x7f449c0ce610 2024-04-25T09:55:04.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.076+0000 7f44a3b90640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449c144390 con 0x7f449c143fb0 2024-04-25T09:55:04.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.076+0000 7f44a3b90640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449c15ac70 con 0x7f449c06e240 2024-04-25T09:55:04.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.076+0000 7f44a112b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f449c0ce610 0x7f449c13e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:04.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.076+0000 7f44a112b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f449c0ce610 0x7f449c13e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55420/0 (socket says 172.21.15.7:55420) 2024-04-25T09:55:04.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.076+0000 7f44a112b640 1 -- 172.21.15.7:0/2308494963 learned_addr learned my addr 172.21.15.7:0/2308494963 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:04.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.076+0000 7f44a192c640 1 --2- 172.21.15.7:0/2308494963 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f449c06e240 0x7f449c13c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:04.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.076+0000 7f44a212d640 1 --2- 172.21.15.7:0/2308494963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f449c143fb0 0x7f449c13eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:04.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.076+0000 7f44a112b640 1 -- 172.21.15.7:0/2308494963 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f449c06e240 msgr2=0x7f449c13c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:04.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.076+0000 7f44a112b640 1 --2- 172.21.15.7:0/2308494963 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f449c06e240 0x7f449c13c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:04.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.076+0000 7f44a112b640 1 -- 172.21.15.7:0/2308494963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f449c143fb0 msgr2=0x7f449c13eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:04.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.076+0000 7f44a112b640 1 --2- 172.21.15.7:0/2308494963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f449c143fb0 0x7f449c13eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:04.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.076+0000 7f44a112b640 1 -- 172.21.15.7:0/2308494963 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c1e3ba0 con 0x7f449c0ce610 2024-04-25T09:55:04.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.076+0000 7f44a212d640 1 --2- 172.21.15.7:0/2308494963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f449c143fb0 0x7f449c13eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:04.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.076+0000 7f44a112b640 1 --2- 172.21.15.7:0/2308494963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f449c0ce610 0x7f449c13e960 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f449002c960 tx=0x7f44900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:04.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.076+0000 7f449a7fc640 1 -- 172.21.15.7:0/2308494963 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4490036040 con 0x7f449c0ce610 2024-04-25T09:55:04.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.076+0000 7f449a7fc640 1 -- 172.21.15.7:0/2308494963 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449003cd70 con 0x7f449c0ce610 2024-04-25T09:55:04.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.077+0000 7f449a7fc640 1 -- 172.21.15.7:0/2308494963 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4490046610 con 0x7f449c0ce610 2024-04-25T09:55:04.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.077+0000 7f44a3b90640 1 -- 172.21.15.7:0/2308494963 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f449c1e3e80 con 0x7f449c0ce610 2024-04-25T09:55:04.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.077+0000 7f44a3b90640 1 -- 172.21.15.7:0/2308494963 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f449c1e4440 con 0x7f449c0ce610 2024-04-25T09:55:04.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.078+0000 7f44a3b90640 1 -- 172.21.15.7:0/2308494963 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f449c1437e0 con 0x7f449c0ce610 2024-04-25T09:55:04.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.078+0000 7f449a7fc640 1 -- 172.21.15.7:0/2308494963 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f449004d060 con 0x7f449c0ce610 2024-04-25T09:55:04.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.079+0000 7f449a7fc640 1 --2- 172.21.15.7:0/2308494963 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f448806b4d0 0x7f448806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:04.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.079+0000 7f449a7fc640 1 -- 172.21.15.7:0/2308494963 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f44900ad5b0 con 0x7f449c0ce610 2024-04-25T09:55:04.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.079+0000 7f44a192c640 1 --2- 172.21.15.7:0/2308494963 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f448806b4d0 0x7f448806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:04.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.079+0000 7f44a192c640 1 --2- 172.21.15.7:0/2308494963 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f448806b4d0 0x7f448806d990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4494009a30 tx=0x7f4494008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:04.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.083+0000 7f449a7fc640 1 -- 172.21.15.7:0/2308494963 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f449c1437e0 con 0x7f449c0ce610 2024-04-25T09:55:04.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.263+0000 7f44a3b90640 1 -- 172.21.15.7:0/2308494963 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f449c068f60 con 0x7f449c0ce610 2024-04-25T09:55:04.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.263+0000 7f449a7fc640 1 -- 172.21.15.7:0/2308494963 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4490041070 con 0x7f449c0ce610 2024-04-25T09:55:04.266 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:55:04.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.265+0000 7f44a3b90640 1 -- 172.21.15.7:0/2308494963 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f448806b4d0 msgr2=0x7f448806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:04.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.265+0000 7f44a3b90640 1 --2- 172.21.15.7:0/2308494963 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f448806b4d0 0x7f448806d990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4494009a30 tx=0x7f4494008040 comp rx=0 tx=0).stop 2024-04-25T09:55:04.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.265+0000 7f44a3b90640 1 -- 172.21.15.7:0/2308494963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f449c0ce610 msgr2=0x7f449c13e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:04.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.265+0000 7f44a3b90640 1 --2- 172.21.15.7:0/2308494963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f449c0ce610 0x7f449c13e960 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f449002c960 tx=0x7f44900046c0 comp rx=0 tx=0).stop 2024-04-25T09:55:04.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.265+0000 7f44a3b90640 1 -- 172.21.15.7:0/2308494963 shutdown_connections 2024-04-25T09:55:04.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.265+0000 7f44a3b90640 1 --2- 172.21.15.7:0/2308494963 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f448806b4d0 0x7f448806d990 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:04.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.265+0000 7f44a3b90640 1 --2- 172.21.15.7:0/2308494963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f449c143fb0 0x7f449c13eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:04.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.265+0000 7f44a3b90640 1 --2- 172.21.15.7:0/2308494963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f449c0ce610 0x7f449c13e960 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:04.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.265+0000 7f44a3b90640 1 --2- 172.21.15.7:0/2308494963 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f449c06e240 0x7f449c13c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:04.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.265+0000 7f44a3b90640 1 -- 172.21.15.7:0/2308494963 >> 172.21.15.7:0/2308494963 conn(0x7f449c06ab60 msgr2=0x7f449c15c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:04.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.265+0000 7f44a3b90640 1 -- 172.21.15.7:0/2308494963 shutdown_connections 2024-04-25T09:55:04.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.265+0000 7f44a3b90640 1 -- 172.21.15.7:0/2308494963 wait complete. 2024-04-25T09:55:04.279 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:55:04.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.378+0000 7f74786e4640 1 Processor -- start 2024-04-25T09:55:04.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.378+0000 7f74786e4640 1 -- start start 2024-04-25T09:55:04.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.379+0000 7f74786e4640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f74700b53b0 0x7f74700d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:04.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.379+0000 7f74786e4640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74700d1e80 con 0x7f747015db00 2024-04-25T09:55:04.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.379+0000 7f74786e4640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74700b5930 con 0x7f74700d0a50 2024-04-25T09:55:04.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.379+0000 7f74786e4640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74700b5c10 con 0x7f74700b53b0 2024-04-25T09:55:04.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.379+0000 7f7476c81640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f74700b53b0 0x7f74700d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:04.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.379+0000 7f7476480640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f747015db00 0x7f74700d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:57794/0 (socket says 172.21.15.7:57794) 2024-04-25T09:55:04.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.379+0000 7f7476480640 1 -- 172.21.15.7:0/1827303328 learned_addr learned my addr 172.21.15.7:0/1827303328 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:04.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.379+0000 7f7476c81640 1 -- 172.21.15.7:0/1827303328 >> v1:172.21.15.55:6789/0 conn(0x7f74700d0a50 legacy=0x7f74700d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:04.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.379+0000 7f7476c81640 1 -- 172.21.15.7:0/1827303328 >> v1:172.21.15.7:6789/0 conn(0x7f747015db00 legacy=0x7f74700d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:04.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.380+0000 7f7476c81640 1 -- 172.21.15.7:0/1827303328 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74700b5ef0 con 0x7f74700b53b0 2024-04-25T09:55:04.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.379+0000 7f747547e640 1 -- 172.21.15.7:0/1827303328 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 750753605 0 0) 0x7f74700d1e80 con 0x7f747015db00 2024-04-25T09:55:04.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.380+0000 7f7476c81640 1 --2- 172.21.15.7:0/1827303328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74700b53b0 0x7f74700d2a40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7468009d90 tx=0x7f746802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6661270ecf1366f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:04.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.380+0000 7f747547e640 1 -- 172.21.15.7:0/1827303328 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7468007740 con 0x7f74700b53b0 2024-04-25T09:55:04.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.380+0000 7f747547e640 1 -- 172.21.15.7:0/1827303328 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74680078e0 con 0x7f74700b53b0 2024-04-25T09:55:04.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.380+0000 7f747547e640 1 -- 172.21.15.7:0/1827303328 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7468007cb0 con 0x7f74700b53b0 2024-04-25T09:55:04.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.381+0000 7f74786e4640 1 -- 172.21.15.7:0/1827303328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74700b53b0 msgr2=0x7f74700d2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:04.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.381+0000 7f74786e4640 1 --2- 172.21.15.7:0/1827303328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74700b53b0 0x7f74700d2a40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7468009d90 tx=0x7f746802a6a0 comp rx=0 tx=0).stop 2024-04-25T09:55:04.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.381+0000 7f74786e4640 1 -- 172.21.15.7:0/1827303328 shutdown_connections 2024-04-25T09:55:04.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.381+0000 7f74786e4640 1 --2- 172.21.15.7:0/1827303328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74700b53b0 0x7f74700d2a40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:04.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.381+0000 7f74786e4640 1 -- 172.21.15.7:0/1827303328 >> 172.21.15.7:0/1827303328 conn(0x7f7470072290 msgr2=0x7f74700726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:04.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.381+0000 7f74786e4640 1 -- 172.21.15.7:0/1827303328 shutdown_connections 2024-04-25T09:55:04.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.381+0000 7f74786e4640 1 -- 172.21.15.7:0/1827303328 wait complete. 2024-04-25T09:55:04.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.382+0000 7f74786e4640 1 Processor -- start 2024-04-25T09:55:04.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.382+0000 7f74786e4640 1 -- start start 2024-04-25T09:55:04.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.383+0000 7f74786e4640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74700b53b0 0x7f74701f34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:04.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.383+0000 7f74786e4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74700d0a50 0x7f747015c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:04.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.383+0000 7f74786e4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f747015db00 0x7f747015c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:04.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.383+0000 7f74786e4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74700d3660 con 0x7f74700d0a50 2024-04-25T09:55:04.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.383+0000 7f74786e4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74700b61d0 con 0x7f747015db00 2024-04-25T09:55:04.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.383+0000 7f74786e4640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74700d2f80 con 0x7f74700b53b0 2024-04-25T09:55:04.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.383+0000 7f7475c7f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74700d0a50 0x7f747015c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:04.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.383+0000 7f7475c7f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74700d0a50 0x7f747015c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55436/0 (socket says 172.21.15.7:55436) 2024-04-25T09:55:04.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.383+0000 7f7475c7f640 1 -- 172.21.15.7:0/2388395480 learned_addr learned my addr 172.21.15.7:0/2388395480 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:04.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.383+0000 7f7476480640 1 --2- 172.21.15.7:0/2388395480 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74700b53b0 0x7f74701f34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:04.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.383+0000 7f7476c81640 1 --2- 172.21.15.7:0/2388395480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f747015db00 0x7f747015c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:04.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.383+0000 7f7475c7f640 1 -- 172.21.15.7:0/2388395480 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74700b53b0 msgr2=0x7f74701f34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:04.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.383+0000 7f7475c7f640 1 --2- 172.21.15.7:0/2388395480 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74700b53b0 0x7f74701f34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:04.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.383+0000 7f7475c7f640 1 -- 172.21.15.7:0/2388395480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f747015db00 msgr2=0x7f747015c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:04.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.383+0000 7f7475c7f640 1 --2- 172.21.15.7:0/2388395480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f747015db00 0x7f747015c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:04.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.383+0000 7f7475c7f640 1 -- 172.21.15.7:0/2388395480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74700c76b0 con 0x7f74700d0a50 2024-04-25T09:55:04.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.383+0000 7f7476480640 1 --2- 172.21.15.7:0/2388395480 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74700b53b0 0x7f74701f34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:04.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.383+0000 7f7476c81640 1 --2- 172.21.15.7:0/2388395480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f747015db00 0x7f747015c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:04.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.384+0000 7f7475c7f640 1 --2- 172.21.15.7:0/2388395480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74700d0a50 0x7f747015c340 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f746000c440 tx=0x7f746000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:04.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.384+0000 7f7466ffd640 1 -- 172.21.15.7:0/2388395480 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7460017070 con 0x7f74700d0a50 2024-04-25T09:55:04.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.384+0000 7f7466ffd640 1 -- 172.21.15.7:0/2388395480 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74600035f0 con 0x7f74700d0a50 2024-04-25T09:55:04.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.384+0000 7f74786e4640 1 -- 172.21.15.7:0/2388395480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74700c7990 con 0x7f74700d0a50 2024-04-25T09:55:04.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.384+0000 7f7466ffd640 1 -- 172.21.15.7:0/2388395480 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74600039e0 con 0x7f74700d0a50 2024-04-25T09:55:04.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.384+0000 7f74786e4640 1 -- 172.21.15.7:0/2388395480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74700c7f50 con 0x7f74700d0a50 2024-04-25T09:55:04.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.385+0000 7f74786e4640 1 -- 172.21.15.7:0/2388395480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7470068fd0 con 0x7f74700d0a50 2024-04-25T09:55:04.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.385+0000 7f7466ffd640 1 -- 172.21.15.7:0/2388395480 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f746001a070 con 0x7f74700d0a50 2024-04-25T09:55:04.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.386+0000 7f7466ffd640 1 --2- 172.21.15.7:0/2388395480 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f745406b4d0 0x7f745406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:04.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.386+0000 7f7476480640 1 --2- 172.21.15.7:0/2388395480 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f745406b4d0 0x7f745406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:04.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.386+0000 7f7466ffd640 1 -- 172.21.15.7:0/2388395480 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f74600898c0 con 0x7f74700d0a50 2024-04-25T09:55:04.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.386+0000 7f7476480640 1 --2- 172.21.15.7:0/2388395480 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f745406b4d0 0x7f745406d990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f746c000f60 tx=0x7f746c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:04.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.390+0000 7f7466ffd640 1 -- 172.21.15.7:0/2388395480 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7460058400 con 0x7f74700d0a50 2024-04-25T09:55:04.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.572+0000 7f74786e4640 1 -- 172.21.15.7:0/2388395480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74700d16b0 con 0x7f74700d0a50 2024-04-25T09:55:04.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.574+0000 7f7466ffd640 1 -- 172.21.15.7:0/2388395480 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18418 (secure 0 0 0) 0x7f74600010c0 con 0x7f74700d0a50 2024-04-25T09:55:04.577 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:04.577 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:54:32.606761+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:54:26.011833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:54:26.535536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:54:30.264996+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:55:04.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.576+0000 7f74786e4640 1 -- 172.21.15.7:0/2388395480 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f745406b4d0 msgr2=0x7f745406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:04.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.576+0000 7f74786e4640 1 --2- 172.21.15.7:0/2388395480 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f745406b4d0 0x7f745406d990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f746c000f60 tx=0x7f746c009040 comp rx=0 tx=0).stop 2024-04-25T09:55:04.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.576+0000 7f74786e4640 1 -- 172.21.15.7:0/2388395480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74700d0a50 msgr2=0x7f747015c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:04.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.576+0000 7f74786e4640 1 --2- 172.21.15.7:0/2388395480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74700d0a50 0x7f747015c340 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f746000c440 tx=0x7f746000c900 comp rx=0 tx=0).stop 2024-04-25T09:55:04.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.576+0000 7f74786e4640 1 -- 172.21.15.7:0/2388395480 shutdown_connections 2024-04-25T09:55:04.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.576+0000 7f74786e4640 1 --2- 172.21.15.7:0/2388395480 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f745406b4d0 0x7f745406d990 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:04.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.576+0000 7f74786e4640 1 --2- 172.21.15.7:0/2388395480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f747015db00 0x7f747015c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:04.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.576+0000 7f74786e4640 1 --2- 172.21.15.7:0/2388395480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74700d0a50 0x7f747015c340 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:04.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.576+0000 7f74786e4640 1 --2- 172.21.15.7:0/2388395480 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74700b53b0 0x7f74701f34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:04.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.576+0000 7f74786e4640 1 -- 172.21.15.7:0/2388395480 >> 172.21.15.7:0/2388395480 conn(0x7f7470072290 msgr2=0x7f74700d2330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:04.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.576+0000 7f74786e4640 1 -- 172.21.15.7:0/2388395480 shutdown_connections 2024-04-25T09:55:04.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.576+0000 7f74786e4640 1 -- 172.21.15.7:0/2388395480 wait complete. 2024-04-25T09:55:04.590 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:54:26.011833+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:54:26.535536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:54:30.264996+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:55:04.591 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:55:04.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.691+0000 7f07a76fc640 1 Processor -- start 2024-04-25T09:55:04.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.691+0000 7f07a76fc640 1 -- start start 2024-04-25T09:55:04.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.692+0000 7f07a76fc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07a006e950 0x7f07a00b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:04.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.692+0000 7f07a76fc640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f07a00ce610 0x7f07a00cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:04.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.692+0000 7f07a76fc640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a00b2ee0 con 0x7f07a0143fb0 2024-04-25T09:55:04.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.692+0000 7f07a76fc640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07a00b3150 con 0x7f07a00ce610 2024-04-25T09:55:04.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.692+0000 7f07a76fc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a00b3430 con 0x7f07a006e950 2024-04-25T09:55:04.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.692+0000 7f07a5c99640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f07a00ce610 0x7f07a00cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:04.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.692+0000 7f07a5c99640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f07a00ce610 0x7f07a00cea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55450/0 (socket says 172.21.15.7:55450) 2024-04-25T09:55:04.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.692+0000 7f07a5c99640 1 -- 172.21.15.7:0/2960995645 learned_addr learned my addr 172.21.15.7:0/2960995645 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:04.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.692+0000 7f07a5c99640 1 -- 172.21.15.7:0/2960995645 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07a006e950 msgr2=0x7f07a00b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:04.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.692+0000 7f07a4c97640 1 --2- 172.21.15.7:0/2960995645 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07a006e950 0x7f07a00b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:04.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.692+0000 7f07a5c99640 1 --2- 172.21.15.7:0/2960995645 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07a006e950 0x7f07a00b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:04.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.692+0000 7f07a5c99640 1 -- 172.21.15.7:0/2960995645 >> v1:172.21.15.55:6789/0 conn(0x7f07a0143fb0 legacy=0x7f07a006e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:04.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.692+0000 7f07a5c99640 1 -- 172.21.15.7:0/2960995645 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a00b3710 con 0x7f07a00ce610 2024-04-25T09:55:04.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.692+0000 7f07a4c97640 1 --2- 172.21.15.7:0/2960995645 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07a006e950 0x7f07a00b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:04.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.693+0000 7f07a5c99640 1 --2- 172.21.15.7:0/2960995645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07a00ce610 0x7f07a00cea60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f079800d150 tx=0x7f079802c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63892a2b763c216b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:04.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.693+0000 7f0797fff640 1 -- 172.21.15.7:0/2960995645 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079800b2e0 con 0x7f07a00ce610 2024-04-25T09:55:04.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.693+0000 7f0797fff640 1 -- 172.21.15.7:0/2960995645 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0798009600 con 0x7f07a00ce610 2024-04-25T09:55:04.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.693+0000 7f0797fff640 1 -- 172.21.15.7:0/2960995645 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079800b480 con 0x7f07a00ce610 2024-04-25T09:55:04.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.694+0000 7f07a76fc640 1 -- 172.21.15.7:0/2960995645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07a00ce610 msgr2=0x7f07a00cea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:04.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.694+0000 7f07a76fc640 1 --2- 172.21.15.7:0/2960995645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07a00ce610 0x7f07a00cea60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f079800d150 tx=0x7f079802c8e0 comp rx=0 tx=0).stop 2024-04-25T09:55:04.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.694+0000 7f07a76fc640 1 -- 172.21.15.7:0/2960995645 shutdown_connections 2024-04-25T09:55:04.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.694+0000 7f07a76fc640 1 --2- 172.21.15.7:0/2960995645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07a00ce610 0x7f07a00cea60 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:04.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.694+0000 7f07a76fc640 1 --2- 172.21.15.7:0/2960995645 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07a006e950 0x7f07a00b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:04.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.694+0000 7f07a76fc640 1 -- 172.21.15.7:0/2960995645 >> 172.21.15.7:0/2960995645 conn(0x7f07a006ab60 msgr2=0x7f07a006af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:04.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.694+0000 7f07a76fc640 1 -- 172.21.15.7:0/2960995645 shutdown_connections 2024-04-25T09:55:04.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.694+0000 7f07a76fc640 1 -- 172.21.15.7:0/2960995645 wait complete. 2024-04-25T09:55:04.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.695+0000 7f07a76fc640 1 Processor -- start 2024-04-25T09:55:04.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.695+0000 7f07a76fc640 1 -- start start 2024-04-25T09:55:04.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.696+0000 7f07a76fc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07a006e950 0x7f07a0130250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:04.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.696+0000 7f07a76fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07a00ce610 0x7f07a013fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:04.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.696+0000 7f07a76fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07a0143fb0 0x7f07a01401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:04.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.696+0000 7f07a76fc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a00cefa0 con 0x7f07a00ce610 2024-04-25T09:55:04.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.696+0000 7f07a76fc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a00cf2f0 con 0x7f07a0143fb0 2024-04-25T09:55:04.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.696+0000 7f07a76fc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a015ac70 con 0x7f07a006e950 2024-04-25T09:55:04.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.696+0000 7f07a4c97640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07a00ce610 0x7f07a013fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:04.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.696+0000 7f07a4c97640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07a00ce610 0x7f07a013fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55458/0 (socket says 172.21.15.7:55458) 2024-04-25T09:55:04.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.696+0000 7f07a4c97640 1 -- 172.21.15.7:0/1770993888 learned_addr learned my addr 172.21.15.7:0/1770993888 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:04.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.696+0000 7f07a5c99640 1 --2- 172.21.15.7:0/1770993888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07a0143fb0 0x7f07a01401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:04.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.696+0000 7f07a5498640 1 --2- 172.21.15.7:0/1770993888 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07a006e950 0x7f07a0130250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:04.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.696+0000 7f07a4c97640 1 -- 172.21.15.7:0/1770993888 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07a006e950 msgr2=0x7f07a0130250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:04.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.696+0000 7f07a4c97640 1 --2- 172.21.15.7:0/1770993888 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07a006e950 0x7f07a0130250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:04.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.696+0000 7f07a4c97640 1 -- 172.21.15.7:0/1770993888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07a0143fb0 msgr2=0x7f07a01401a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:04.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.696+0000 7f07a4c97640 1 --2- 172.21.15.7:0/1770993888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07a0143fb0 0x7f07a01401a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:04.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.696+0000 7f07a4c97640 1 -- 172.21.15.7:0/1770993888 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a01e3800 con 0x7f07a00ce610 2024-04-25T09:55:04.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.696+0000 7f07a5c99640 1 --2- 172.21.15.7:0/1770993888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07a0143fb0 0x7f07a01401a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:04.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.696+0000 7f07a4c97640 1 --2- 172.21.15.7:0/1770993888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07a00ce610 0x7f07a013fc60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f079000c7f0 tx=0x7f079000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:04.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.697+0000 7f0795ffb640 1 -- 172.21.15.7:0/1770993888 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0790015070 con 0x7f07a00ce610 2024-04-25T09:55:04.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.697+0000 7f0795ffb640 1 -- 172.21.15.7:0/1770993888 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0790007a30 con 0x7f07a00ce610 2024-04-25T09:55:04.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.697+0000 7f07a76fc640 1 -- 172.21.15.7:0/1770993888 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a01e3ae0 con 0x7f07a00ce610 2024-04-25T09:55:04.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.697+0000 7f0795ffb640 1 -- 172.21.15.7:0/1770993888 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0790007e00 con 0x7f07a00ce610 2024-04-25T09:55:04.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.697+0000 7f07a76fc640 1 -- 172.21.15.7:0/1770993888 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a01e40a0 con 0x7f07a00ce610 2024-04-25T09:55:04.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.698+0000 7f07a76fc640 1 -- 172.21.15.7:0/1770993888 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07a0068f60 con 0x7f07a00ce610 2024-04-25T09:55:04.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.698+0000 7f0795ffb640 1 -- 172.21.15.7:0/1770993888 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0790018070 con 0x7f07a00ce610 2024-04-25T09:55:04.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.698+0000 7f0795ffb640 1 --2- 172.21.15.7:0/1770993888 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f078406b4d0 0x7f078406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:04.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.699+0000 7f0795ffb640 1 -- 172.21.15.7:0/1770993888 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f079008a4b0 con 0x7f07a00ce610 2024-04-25T09:55:04.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.699+0000 7f07a5498640 1 --2- 172.21.15.7:0/1770993888 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f078406b4d0 0x7f078406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:04.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.699+0000 7f07a5498640 1 --2- 172.21.15.7:0/1770993888 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f078406b4d0 0x7f078406d990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f079c006fd0 tx=0x7f079c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:04.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.703+0000 7f0795ffb640 1 -- 172.21.15.7:0/1770993888 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0790058ff0 con 0x7f07a00ce610 2024-04-25T09:55:04.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.881+0000 7f07a76fc640 1 -- 172.21.15.7:0/1770993888 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f07a00b3c30 con 0x7f07a00ce610 2024-04-25T09:55:04.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.881+0000 7f0795ffb640 1 -- 172.21.15.7:0/1770993888 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f07900588f0 con 0x7f07a00ce610 2024-04-25T09:55:04.884 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T09:55:04.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.883+0000 7f07a76fc640 1 -- 172.21.15.7:0/1770993888 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f078406b4d0 msgr2=0x7f078406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:04.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.883+0000 7f07a76fc640 1 --2- 172.21.15.7:0/1770993888 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f078406b4d0 0x7f078406d990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f079c006fd0 tx=0x7f079c008040 comp rx=0 tx=0).stop 2024-04-25T09:55:04.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.883+0000 7f07a76fc640 1 -- 172.21.15.7:0/1770993888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07a00ce610 msgr2=0x7f07a013fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:04.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.883+0000 7f07a76fc640 1 --2- 172.21.15.7:0/1770993888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07a00ce610 0x7f07a013fc60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f079000c7f0 tx=0x7f079000cbf0 comp rx=0 tx=0).stop 2024-04-25T09:55:04.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.883+0000 7f07a76fc640 1 -- 172.21.15.7:0/1770993888 shutdown_connections 2024-04-25T09:55:04.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.883+0000 7f07a76fc640 1 --2- 172.21.15.7:0/1770993888 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f078406b4d0 0x7f078406d990 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:04.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.883+0000 7f07a76fc640 1 --2- 172.21.15.7:0/1770993888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07a0143fb0 0x7f07a01401a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:04.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.883+0000 7f07a76fc640 1 --2- 172.21.15.7:0/1770993888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07a00ce610 0x7f07a013fc60 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:04.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.883+0000 7f07a76fc640 1 --2- 172.21.15.7:0/1770993888 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07a006e950 0x7f07a0130250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:04.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.883+0000 7f07a76fc640 1 -- 172.21.15.7:0/1770993888 >> 172.21.15.7:0/1770993888 conn(0x7f07a006ab60 msgr2=0x7f07a006e220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:04.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.884+0000 7f07a76fc640 1 -- 172.21.15.7:0/1770993888 shutdown_connections 2024-04-25T09:55:04.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.884+0000 7f07a76fc640 1 -- 172.21.15.7:0/1770993888 wait complete. 2024-04-25T09:55:04.897 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:55:05.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.999+0000 7f02c8963640 1 Processor -- start 2024-04-25T09:55:05.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:04.999+0000 7f02c8963640 1 -- start start 2024-04-25T09:55:05.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.000+0000 7f02c8963640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f02c40d3760 0x7f02c415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:05.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.000+0000 7f02c8963640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f02c415f1c0 0x7f02c40d3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:05.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.000+0000 7f02c8963640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c40d4080 con 0x7f02c40ce830 2024-04-25T09:55:05.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.000+0000 7f02c8963640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02c40ce380 con 0x7f02c415f1c0 2024-04-25T09:55:05.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.000+0000 7f02c8963640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c415f000 con 0x7f02c40d3760 2024-04-25T09:55:05.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.000+0000 7f02c2d9d640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f02c40ce830 0x7f02c40b2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:57800/0 (socket says 172.21.15.7:57800) 2024-04-25T09:55:05.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.000+0000 7f02c2d9d640 1 -- 172.21.15.7:0/3022295893 learned_addr learned my addr 172.21.15.7:0/3022295893 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:05.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.000+0000 7f02bbfff640 1 --2- 172.21.15.7:0/3022295893 >> v2:172.21.15.55:3300/0 conn(0x7f02c415f1c0 0x7f02c40d3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:05.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.000+0000 7f02c259c640 1 --2- 172.21.15.7:0/3022295893 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f02c40d3760 0x7f02c415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:05.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.000+0000 7f02c1d9b640 1 -- 172.21.15.7:0/3022295893 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1974531427 0 0) 0x7f02c40d4080 con 0x7f02c40ce830 2024-04-25T09:55:05.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.000+0000 7f02c1d9b640 1 -- 172.21.15.7:0/3022295893 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02b0003520 con 0x7f02c40ce830 2024-04-25T09:55:05.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.000+0000 7f02c1d9b640 1 -- 172.21.15.7:0/3022295893 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 626571530 0 0) 0x7f02b0003520 con 0x7f02c40ce830 2024-04-25T09:55:05.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.000+0000 7f02c1d9b640 1 -- 172.21.15.7:0/3022295893 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f02c40d3760 msgr2=0x7f02c415eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:05.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.000+0000 7f02c1d9b640 1 --2- 172.21.15.7:0/3022295893 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f02c40d3760 0x7f02c415eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.000+0000 7f02c1d9b640 1 -- 172.21.15.7:0/3022295893 >> v2:172.21.15.55:3300/0 conn(0x7f02c415f1c0 msgr2=0x7f02c40d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:05.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.000+0000 7f02c1d9b640 1 --2- 172.21.15.7:0/3022295893 >> v2:172.21.15.55:3300/0 conn(0x7f02c415f1c0 0x7f02c40d3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.000+0000 7f02c1d9b640 1 -- 172.21.15.7:0/3022295893 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c40ced10 con 0x7f02c40ce830 2024-04-25T09:55:05.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.000+0000 7f02c1d9b640 1 -- 172.21.15.7:0/3022295893 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f02bc0019f0 con 0x7f02c40ce830 2024-04-25T09:55:05.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.000+0000 7f02c1d9b640 1 -- 172.21.15.7:0/3022295893 >> v1:172.21.15.7:6789/0 conn(0x7f02c40ce830 legacy=0x7f02c40b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:05.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.000+0000 7f02c1d9b640 1 --2- 172.21.15.7:0/3022295893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02b00039e0 0x7f02b0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:05.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.000+0000 7f02c1d9b640 1 --2- 172.21.15.7:0/3022295893 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f02c40d3760 0x7f02b0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:05.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.000+0000 7f02c1d9b640 1 --2- 172.21.15.7:0/3022295893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02b0004d40 0x7f02b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:05.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.000+0000 7f02c1d9b640 1 -- 172.21.15.7:0/3022295893 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c415f000 con 0x7f02b0004d40 2024-04-25T09:55:05.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.000+0000 7f02c1d9b640 1 -- 172.21.15.7:0/3022295893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b000b9c0 con 0x7f02b00039e0 2024-04-25T09:55:05.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.000+0000 7f02c1d9b640 1 -- 172.21.15.7:0/3022295893 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b000bb40 con 0x7f02c40d3760 2024-04-25T09:55:05.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.001+0000 7f02c2d9d640 1 --2- 172.21.15.7:0/3022295893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02b0004d40 0x7f02b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:05.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.001+0000 7f02c259c640 1 --2- 172.21.15.7:0/3022295893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02b00039e0 0x7f02b0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:05.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.001+0000 7f02bbfff640 1 --2- 172.21.15.7:0/3022295893 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f02c40d3760 0x7f02b0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:05.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.001+0000 7f02c2d9d640 1 -- 172.21.15.7:0/3022295893 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f02c40d3760 msgr2=0x7f02b0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:05.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.001+0000 7f02c2d9d640 1 --2- 172.21.15.7:0/3022295893 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f02c40d3760 0x7f02b0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.001+0000 7f02c2d9d640 1 -- 172.21.15.7:0/3022295893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02b00039e0 msgr2=0x7f02b0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:05.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.001+0000 7f02c2d9d640 1 --2- 172.21.15.7:0/3022295893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02b00039e0 0x7f02b0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.001+0000 7f02c2d9d640 1 -- 172.21.15.7:0/3022295893 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b0003520 con 0x7f02b0004d40 2024-04-25T09:55:05.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.001+0000 7f02c2d9d640 1 --2- 172.21.15.7:0/3022295893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02b0004d40 0x7f02b00051c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f02bc00a840 tx=0x7f02b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c7f135ea3a649e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:05.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.002+0000 7f02c1d9b640 1 -- 172.21.15.7:0/3022295893 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02bc00a460 con 0x7f02b0004d40 2024-04-25T09:55:05.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.002+0000 7f02c1d9b640 1 -- 172.21.15.7:0/3022295893 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02bc02f070 con 0x7f02b0004d40 2024-04-25T09:55:05.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.002+0000 7f02c1d9b640 1 -- 172.21.15.7:0/3022295893 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02bc02bc70 con 0x7f02b0004d40 2024-04-25T09:55:05.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.002+0000 7f02c8963640 1 -- 172.21.15.7:0/3022295893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02b0004d40 msgr2=0x7f02b00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:05.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.002+0000 7f02c8963640 1 --2- 172.21.15.7:0/3022295893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02b0004d40 0x7f02b00051c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f02bc00a840 tx=0x7f02b0005830 comp rx=0 tx=0).stop 2024-04-25T09:55:05.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.002+0000 7f02c2d9d640 1 -- 172.21.15.7:0/3022295893 reap_dead start 2024-04-25T09:55:05.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.002+0000 7f02c8963640 1 -- 172.21.15.7:0/3022295893 shutdown_connections 2024-04-25T09:55:05.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.002+0000 7f02c8963640 1 -- 172.21.15.7:0/3022295893 >> 172.21.15.7:0/3022295893 conn(0x7f02c4072680 msgr2=0x7f02c4072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:05.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.002+0000 7f02c8963640 1 -- 172.21.15.7:0/3022295893 shutdown_connections 2024-04-25T09:55:05.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.002+0000 7f02c8963640 1 -- 172.21.15.7:0/3022295893 wait complete. 2024-04-25T09:55:05.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.004+0000 7f02c8963640 1 Processor -- start 2024-04-25T09:55:05.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.004+0000 7f02c8963640 1 -- start start 2024-04-25T09:55:05.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.004+0000 7f02c8963640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f02b0004d40 0x7f02c40cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:05.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.004+0000 7f02c8963640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02c4155980 0x7f02c40ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:05.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.004+0000 7f02c8963640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02c40c92e0 0x7f02c40c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:05.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.004+0000 7f02c8963640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c40d1e20 con 0x7f02c40c92e0 2024-04-25T09:55:05.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.004+0000 7f02c8963640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c40d2190 con 0x7f02c4155980 2024-04-25T09:55:05.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.004+0000 7f02c8963640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c415de10 con 0x7f02b0004d40 2024-04-25T09:55:05.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.004+0000 7f02c2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02c40c92e0 0x7f02c40c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:05.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.004+0000 7f02c2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02c40c92e0 0x7f02c40c9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55476/0 (socket says 172.21.15.7:55476) 2024-04-25T09:55:05.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.004+0000 7f02c2d9d640 1 -- 172.21.15.7:0/2637287324 learned_addr learned my addr 172.21.15.7:0/2637287324 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:05.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.005+0000 7f02c259c640 1 --2- 172.21.15.7:0/2637287324 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f02b0004d40 0x7f02c40cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:05.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.005+0000 7f02bbfff640 1 --2- 172.21.15.7:0/2637287324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02c4155980 0x7f02c40ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:05.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.005+0000 7f02c2d9d640 1 -- 172.21.15.7:0/2637287324 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f02b0004d40 msgr2=0x7f02c40cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:05.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.005+0000 7f02c2d9d640 1 --2- 172.21.15.7:0/2637287324 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f02b0004d40 0x7f02c40cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.005+0000 7f02c2d9d640 1 -- 172.21.15.7:0/2637287324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02c4155980 msgr2=0x7f02c40ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:05.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.005+0000 7f02c2d9d640 1 --2- 172.21.15.7:0/2637287324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02c4155980 0x7f02c40ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.005+0000 7f02c2d9d640 1 -- 172.21.15.7:0/2637287324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c40c8240 con 0x7f02c40c92e0 2024-04-25T09:55:05.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.005+0000 7f02c2d9d640 1 --2- 172.21.15.7:0/2637287324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02c40c92e0 0x7f02c40c9760 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f02bc00a960 tx=0x7f02c40ceee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:05.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.005+0000 7f02baffd640 1 -- 172.21.15.7:0/2637287324 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02bc00a460 con 0x7f02c40c92e0 2024-04-25T09:55:05.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.005+0000 7f02baffd640 1 -- 172.21.15.7:0/2637287324 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02bc004b60 con 0x7f02c40c92e0 2024-04-25T09:55:05.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.005+0000 7f02c8963640 1 -- 172.21.15.7:0/2637287324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c40c8520 con 0x7f02c40c92e0 2024-04-25T09:55:05.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.005+0000 7f02baffd640 1 -- 172.21.15.7:0/2637287324 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02bc001fb0 con 0x7f02c40c92e0 2024-04-25T09:55:05.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.005+0000 7f02c8963640 1 -- 172.21.15.7:0/2637287324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c40c8ae0 con 0x7f02c40c92e0 2024-04-25T09:55:05.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.006+0000 7f02c8963640 1 -- 172.21.15.7:0/2637287324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c4068f60 con 0x7f02c40c92e0 2024-04-25T09:55:05.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.007+0000 7f02baffd640 1 -- 172.21.15.7:0/2637287324 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f02bc046060 con 0x7f02c40c92e0 2024-04-25T09:55:05.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.007+0000 7f02baffd640 1 --2- 172.21.15.7:0/2637287324 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f02a406b500 0x7f02a406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:05.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.007+0000 7f02baffd640 1 -- 172.21.15.7:0/2637287324 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f02bc0aa2f0 con 0x7f02c40c92e0 2024-04-25T09:55:05.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.007+0000 7f02c259c640 1 --2- 172.21.15.7:0/2637287324 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f02a406b500 0x7f02a406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:05.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.008+0000 7f02c259c640 1 --2- 172.21.15.7:0/2637287324 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f02a406b500 0x7f02a406d9c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f02b4009b40 tx=0x7f02b4009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:05.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.011+0000 7f02baffd640 1 -- 172.21.15.7:0/2637287324 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f02bc078e60 con 0x7f02c40c92e0 2024-04-25T09:55:05.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.191+0000 7f02c8963640 1 -- 172.21.15.7:0/2637287324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f02c40d2770 con 0x7f02c40c92e0 2024-04-25T09:55:05.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.191+0000 7f02baffd640 1 -- 172.21.15.7:0/2637287324 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f02bc078760 con 0x7f02c40c92e0 2024-04-25T09:55:05.194 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:55:05.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.193+0000 7f02c8963640 1 -- 172.21.15.7:0/2637287324 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f02a406b500 msgr2=0x7f02a406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:05.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.193+0000 7f02c8963640 1 --2- 172.21.15.7:0/2637287324 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f02a406b500 0x7f02a406d9c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f02b4009b40 tx=0x7f02b4009190 comp rx=0 tx=0).stop 2024-04-25T09:55:05.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.193+0000 7f02c8963640 1 -- 172.21.15.7:0/2637287324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02c40c92e0 msgr2=0x7f02c40c9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:05.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.193+0000 7f02c8963640 1 --2- 172.21.15.7:0/2637287324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02c40c92e0 0x7f02c40c9760 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f02bc00a960 tx=0x7f02c40ceee0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.193+0000 7f02c8963640 1 -- 172.21.15.7:0/2637287324 shutdown_connections 2024-04-25T09:55:05.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.193+0000 7f02c8963640 1 --2- 172.21.15.7:0/2637287324 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f02a406b500 0x7f02a406d9c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.193+0000 7f02c8963640 1 --2- 172.21.15.7:0/2637287324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02c40c92e0 0x7f02c40c9760 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.193+0000 7f02c8963640 1 --2- 172.21.15.7:0/2637287324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02c4155980 0x7f02c40ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.193+0000 7f02c8963640 1 --2- 172.21.15.7:0/2637287324 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f02b0004d40 0x7f02c40cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.193+0000 7f02c8963640 1 -- 172.21.15.7:0/2637287324 >> 172.21.15.7:0/2637287324 conn(0x7f02c4072680 msgr2=0x7f02c40b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:05.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.193+0000 7f02c8963640 1 -- 172.21.15.7:0/2637287324 shutdown_connections 2024-04-25T09:55:05.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.193+0000 7f02c8963640 1 -- 172.21.15.7:0/2637287324 wait complete. 2024-04-25T09:55:05.207 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:55:05.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.307+0000 7f1e38163640 1 Processor -- start 2024-04-25T09:55:05.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.308+0000 7f1e38163640 1 -- start start 2024-04-25T09:55:05.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.308+0000 7f1e38163640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1e3015d990 0x7f1e300b1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:05.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.308+0000 7f1e38163640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1e300b29c0 0x7f1e300d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:05.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.308+0000 7f1e38163640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e300cbcb0 con 0x7f1e300d1ac0 2024-04-25T09:55:05.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.308+0000 7f1e38163640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e300b1df0 con 0x7f1e3015d990 2024-04-25T09:55:05.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.308+0000 7f1e38163640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e300b20d0 con 0x7f1e300b29c0 2024-04-25T09:55:05.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.309+0000 7f1e35eff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1e3015d990 0x7f1e300b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:05.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.309+0000 7f1e356fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1e300b29c0 0x7f1e300d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:05.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.309+0000 7f1e356fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1e300b29c0 0x7f1e300d1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:38438/0 (socket says 172.21.15.7:38438) 2024-04-25T09:55:05.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.309+0000 7f1e35eff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1e3015d990 0x7f1e300b1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:37470/0 (socket says 172.21.15.7:37470) 2024-04-25T09:55:05.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.309+0000 7f1e356fe640 1 -- 172.21.15.7:0/245503869 learned_addr learned my addr 172.21.15.7:0/245503869 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:05.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.309+0000 7f1e36700640 1 --1- 172.21.15.7:0/245503869 >> v1:172.21.15.55:6789/0 conn(0x7f1e300d1ac0 0x7f1e3006c360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:43102/0 (socket says 172.21.15.7:43102) 2024-04-25T09:55:05.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.309+0000 7f1e34efd640 1 -- 172.21.15.7:0/245503869 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1631781169 0 0) 0x7f1e300cbcb0 con 0x7f1e300d1ac0 2024-04-25T09:55:05.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.309+0000 7f1e356fe640 1 -- 172.21.15.7:0/245503869 >> v2:172.21.15.55:3300/0 conn(0x7f1e3015d990 msgr2=0x7f1e300b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:05.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.309+0000 7f1e356fe640 1 --2- 172.21.15.7:0/245503869 >> v2:172.21.15.55:3300/0 conn(0x7f1e3015d990 0x7f1e300b1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.309+0000 7f1e356fe640 1 -- 172.21.15.7:0/245503869 >> v1:172.21.15.55:6789/0 conn(0x7f1e300d1ac0 legacy=0x7f1e3006c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:05.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.309+0000 7f1e356fe640 1 -- 172.21.15.7:0/245503869 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e300b23b0 con 0x7f1e300b29c0 2024-04-25T09:55:05.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.310+0000 7f1e356fe640 1 --2- 172.21.15.7:0/245503869 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1e300b29c0 0x7f1e300d1580 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1e24009870 tx=0x7f1e2402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cacd316d9f9eb2aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:05.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.310+0000 7f1e34efd640 1 -- 172.21.15.7:0/245503869 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e24037070 con 0x7f1e300b29c0 2024-04-25T09:55:05.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.310+0000 7f1e34efd640 1 -- 172.21.15.7:0/245503869 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e24032440 con 0x7f1e300b29c0 2024-04-25T09:55:05.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.310+0000 7f1e34efd640 1 -- 172.21.15.7:0/245503869 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e24032810 con 0x7f1e300b29c0 2024-04-25T09:55:05.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.310+0000 7f1e38163640 1 -- 172.21.15.7:0/245503869 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1e300b29c0 msgr2=0x7f1e300d1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:05.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.310+0000 7f1e38163640 1 --2- 172.21.15.7:0/245503869 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1e300b29c0 0x7f1e300d1580 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1e24009870 tx=0x7f1e2402a1c0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.311+0000 7f1e38163640 1 -- 172.21.15.7:0/245503869 shutdown_connections 2024-04-25T09:55:05.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.311+0000 7f1e38163640 1 --2- 172.21.15.7:0/245503869 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1e300b29c0 0x7f1e300d1580 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.311+0000 7f1e38163640 1 --2- 172.21.15.7:0/245503869 >> v2:172.21.15.55:3300/0 conn(0x7f1e3015d990 0x7f1e300b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.311+0000 7f1e38163640 1 -- 172.21.15.7:0/245503869 >> 172.21.15.7:0/245503869 conn(0x7f1e3008af80 msgr2=0x7f1e3008b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:05.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.311+0000 7f1e38163640 1 -- 172.21.15.7:0/245503869 shutdown_connections 2024-04-25T09:55:05.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.311+0000 7f1e38163640 1 -- 172.21.15.7:0/245503869 wait complete. 2024-04-25T09:55:05.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.312+0000 7f1e38163640 1 Processor -- start 2024-04-25T09:55:05.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.312+0000 7f1e38163640 1 -- start start 2024-04-25T09:55:05.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.313+0000 7f1e38163640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e300b29c0 0x7f1e301f3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:05.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.313+0000 7f1e38163640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e300d1ac0 0x7f1e300afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:05.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.313+0000 7f1e38163640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1e3015d990 0x7f1e300d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:05.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.313+0000 7f1e38163640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e300b19c0 con 0x7f1e300d1ac0 2024-04-25T09:55:05.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.313+0000 7f1e38163640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e300cf9d0 con 0x7f1e300b29c0 2024-04-25T09:55:05.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.313+0000 7f1e38163640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e300b1b40 con 0x7f1e3015d990 2024-04-25T09:55:05.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.313+0000 7f1e356fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e300d1ac0 0x7f1e300afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:05.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.313+0000 7f1e356fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e300d1ac0 0x7f1e300afd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55488/0 (socket says 172.21.15.7:55488) 2024-04-25T09:55:05.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.313+0000 7f1e356fe640 1 -- 172.21.15.7:0/553719264 learned_addr learned my addr 172.21.15.7:0/553719264 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:05.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.313+0000 7f1e36700640 1 --2- 172.21.15.7:0/553719264 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1e3015d990 0x7f1e300d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:05.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.313+0000 7f1e35eff640 1 --2- 172.21.15.7:0/553719264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e300b29c0 0x7f1e301f3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:05.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.313+0000 7f1e356fe640 1 -- 172.21.15.7:0/553719264 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1e3015d990 msgr2=0x7f1e300d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:05.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.313+0000 7f1e356fe640 1 --2- 172.21.15.7:0/553719264 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1e3015d990 0x7f1e300d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.313+0000 7f1e356fe640 1 -- 172.21.15.7:0/553719264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e300b29c0 msgr2=0x7f1e301f3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:05.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.313+0000 7f1e356fe640 1 --2- 172.21.15.7:0/553719264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e300b29c0 0x7f1e301f3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.313+0000 7f1e356fe640 1 -- 172.21.15.7:0/553719264 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e301e2dc0 con 0x7f1e300d1ac0 2024-04-25T09:55:05.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.313+0000 7f1e36700640 1 --2- 172.21.15.7:0/553719264 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1e3015d990 0x7f1e300d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:05.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.313+0000 7f1e35eff640 1 --2- 172.21.15.7:0/553719264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e300b29c0 0x7f1e301f3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:05.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.313+0000 7f1e356fe640 1 --2- 172.21.15.7:0/553719264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e300d1ac0 0x7f1e300afd20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1e24009870 tx=0x7f1e240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:05.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.313+0000 7f1e2e7fc640 1 -- 172.21.15.7:0/553719264 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e24037040 con 0x7f1e300d1ac0 2024-04-25T09:55:05.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.313+0000 7f1e2e7fc640 1 -- 172.21.15.7:0/553719264 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e24004230 con 0x7f1e300d1ac0 2024-04-25T09:55:05.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.313+0000 7f1e38163640 1 -- 172.21.15.7:0/553719264 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e301e30a0 con 0x7f1e300d1ac0 2024-04-25T09:55:05.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.313+0000 7f1e2e7fc640 1 -- 172.21.15.7:0/553719264 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2403c670 con 0x7f1e300d1ac0 2024-04-25T09:55:05.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.314+0000 7f1e38163640 1 -- 172.21.15.7:0/553719264 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e301e3660 con 0x7f1e300d1ac0 2024-04-25T09:55:05.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.314+0000 7f1e38163640 1 -- 172.21.15.7:0/553719264 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e30068f60 con 0x7f1e300d1ac0 2024-04-25T09:55:05.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.315+0000 7f1e2e7fc640 1 -- 172.21.15.7:0/553719264 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1e2403a070 con 0x7f1e300d1ac0 2024-04-25T09:55:05.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.315+0000 7f1e2e7fc640 1 --2- 172.21.15.7:0/553719264 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1e1c06b500 0x7f1e1c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:05.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.315+0000 7f1e2e7fc640 1 -- 172.21.15.7:0/553719264 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f1e240aabc0 con 0x7f1e300d1ac0 2024-04-25T09:55:05.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.315+0000 7f1e35eff640 1 --2- 172.21.15.7:0/553719264 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1e1c06b500 0x7f1e1c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:05.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.316+0000 7f1e35eff640 1 --2- 172.21.15.7:0/553719264 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1e1c06b500 0x7f1e1c06d9c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1e28009a20 tx=0x7f1e28008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:05.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.319+0000 7f1e2e7fc640 1 -- 172.21.15.7:0/553719264 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1e24041020 con 0x7f1e300d1ac0 2024-04-25T09:55:05.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.498+0000 7f1e38163640 1 -- 172.21.15.7:0/553719264 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1e300ce7f0 con 0x7f1e300d1ac0 2024-04-25T09:55:05.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.498+0000 7f1e2e7fc640 1 -- 172.21.15.7:0/553719264 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1e24079790 con 0x7f1e300d1ac0 2024-04-25T09:55:05.501 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T09:55:05.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.500+0000 7f1e38163640 1 -- 172.21.15.7:0/553719264 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1e1c06b500 msgr2=0x7f1e1c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:05.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.500+0000 7f1e38163640 1 --2- 172.21.15.7:0/553719264 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1e1c06b500 0x7f1e1c06d9c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1e28009a20 tx=0x7f1e28008040 comp rx=0 tx=0).stop 2024-04-25T09:55:05.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.500+0000 7f1e38163640 1 -- 172.21.15.7:0/553719264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e300d1ac0 msgr2=0x7f1e300afd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:05.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.500+0000 7f1e38163640 1 --2- 172.21.15.7:0/553719264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e300d1ac0 0x7f1e300afd20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1e24009870 tx=0x7f1e240046c0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.500+0000 7f1e38163640 1 -- 172.21.15.7:0/553719264 shutdown_connections 2024-04-25T09:55:05.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.500+0000 7f1e38163640 1 --2- 172.21.15.7:0/553719264 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1e1c06b500 0x7f1e1c06d9c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.500+0000 7f1e38163640 1 --2- 172.21.15.7:0/553719264 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1e3015d990 0x7f1e300d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.500+0000 7f1e38163640 1 --2- 172.21.15.7:0/553719264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e300d1ac0 0x7f1e300afd20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.500+0000 7f1e38163640 1 --2- 172.21.15.7:0/553719264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e300b29c0 0x7f1e301f3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.500+0000 7f1e38163640 1 -- 172.21.15.7:0/553719264 >> 172.21.15.7:0/553719264 conn(0x7f1e3008af80 msgr2=0x7f1e300cd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:05.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.500+0000 7f1e38163640 1 -- 172.21.15.7:0/553719264 shutdown_connections 2024-04-25T09:55:05.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.500+0000 7f1e38163640 1 -- 172.21.15.7:0/553719264 wait complete. 2024-04-25T09:55:05.513 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:55:05.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.615+0000 7f0bb866f640 1 Processor -- start 2024-04-25T09:55:05.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.615+0000 7f0bb866f640 1 -- start start 2024-04-25T09:55:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.616+0000 7f0bb866f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0bb00d07c0 0x7f0bb00b9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.616+0000 7f0bb866f640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0bb015de50 0x7f0bb00d1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.616+0000 7f0bb866f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0bb00d0ba0 0x7f0bb00d37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.616+0000 7f0bb866f640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb00d2320 con 0x7f0bb015de50 2024-04-25T09:55:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.616+0000 7f0bb866f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb00d2600 con 0x7f0bb00d07c0 2024-04-25T09:55:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.616+0000 7f0bb866f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb00d28e0 con 0x7f0bb00d0ba0 2024-04-25T09:55:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.616+0000 7f0bb5c0a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0bb015de50 0x7f0bb00d1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.616+0000 7f0bb5c0a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0bb015de50 0x7f0bb00d1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55492/0 (socket says 172.21.15.7:55492) 2024-04-25T09:55:05.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.616+0000 7f0bb5c0a640 1 -- 172.21.15.7:0/1204557760 learned_addr learned my addr 172.21.15.7:0/1204557760 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:05.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.616+0000 7f0bb6c0c640 1 --2- 172.21.15.7:0/1204557760 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0bb00d0ba0 0x7f0bb00d37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:05.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.616+0000 7f0bb5c0a640 1 -- 172.21.15.7:0/1204557760 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0bb00d0ba0 msgr2=0x7f0bb00d37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:05.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.616+0000 7f0bb640b640 1 --2- 172.21.15.7:0/1204557760 >> v2:172.21.15.55:3300/0 conn(0x7f0bb00d07c0 0x7f0bb00b9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:05.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.616+0000 7f0bb5c0a640 1 --2- 172.21.15.7:0/1204557760 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0bb00d0ba0 0x7f0bb00d37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.617+0000 7f0bb5c0a640 1 -- 172.21.15.7:0/1204557760 >> v2:172.21.15.55:3300/0 conn(0x7f0bb00d07c0 msgr2=0x7f0bb00b9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:05.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.617+0000 7f0bb5c0a640 1 --2- 172.21.15.7:0/1204557760 >> v2:172.21.15.55:3300/0 conn(0x7f0bb00d07c0 0x7f0bb00b9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.617+0000 7f0bb5c0a640 1 -- 172.21.15.7:0/1204557760 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb00d2bc0 con 0x7f0bb015de50 2024-04-25T09:55:05.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.617+0000 7f0bb6c0c640 1 --2- 172.21.15.7:0/1204557760 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0bb00d0ba0 0x7f0bb00d37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:05.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.617+0000 7f0bb640b640 1 --2- 172.21.15.7:0/1204557760 >> v2:172.21.15.55:3300/0 conn(0x7f0bb00d07c0 0x7f0bb00b9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:05.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.617+0000 7f0bb5c0a640 1 --2- 172.21.15.7:0/1204557760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bb015de50 0x7f0bb00d1bd0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0bb00d2810 tx=0x7f0ba002a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99848e823540623d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:05.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.617+0000 7f0bb5409640 1 -- 172.21.15.7:0/1204557760 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba0037070 con 0x7f0bb015de50 2024-04-25T09:55:05.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.617+0000 7f0bb5409640 1 -- 172.21.15.7:0/1204557760 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba0032440 con 0x7f0bb015de50 2024-04-25T09:55:05.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.617+0000 7f0bb5409640 1 -- 172.21.15.7:0/1204557760 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba0032810 con 0x7f0bb015de50 2024-04-25T09:55:05.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.618+0000 7f0bb866f640 1 -- 172.21.15.7:0/1204557760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bb015de50 msgr2=0x7f0bb00d1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:05.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.618+0000 7f0bb866f640 1 --2- 172.21.15.7:0/1204557760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bb015de50 0x7f0bb00d1bd0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0bb00d2810 tx=0x7f0ba002a200 comp rx=0 tx=0).stop 2024-04-25T09:55:05.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.618+0000 7f0bb866f640 1 -- 172.21.15.7:0/1204557760 shutdown_connections 2024-04-25T09:55:05.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.618+0000 7f0bb866f640 1 --2- 172.21.15.7:0/1204557760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bb015de50 0x7f0bb00d1bd0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.618+0000 7f0bb866f640 1 --2- 172.21.15.7:0/1204557760 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0bb00d0ba0 0x7f0bb00d37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.618+0000 7f0bb866f640 1 --2- 172.21.15.7:0/1204557760 >> v2:172.21.15.55:3300/0 conn(0x7f0bb00d07c0 0x7f0bb00b9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.618+0000 7f0bb866f640 1 -- 172.21.15.7:0/1204557760 >> 172.21.15.7:0/1204557760 conn(0x7f0bb00726b0 msgr2=0x7f0bb0072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:05.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.618+0000 7f0bb866f640 1 -- 172.21.15.7:0/1204557760 shutdown_connections 2024-04-25T09:55:05.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.618+0000 7f0bb866f640 1 -- 172.21.15.7:0/1204557760 wait complete. 2024-04-25T09:55:05.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.619+0000 7f0bb866f640 1 Processor -- start 2024-04-25T09:55:05.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.619+0000 7f0bb866f640 1 -- start start 2024-04-25T09:55:05.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.620+0000 7f0bb866f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bb00d07c0 0x7f0bb0152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:05.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.620+0000 7f0bb866f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bb00d0ba0 0x7f0bb00c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:05.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.620+0000 7f0bb866f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0bb015de50 0x7f0bb00c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:05.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.620+0000 7f0bb866f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb00d33c0 con 0x7f0bb00d07c0 2024-04-25T09:55:05.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.620+0000 7f0bb866f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb00d1050 con 0x7f0bb00d0ba0 2024-04-25T09:55:05.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.620+0000 7f0bb866f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb00c7300 con 0x7f0bb015de50 2024-04-25T09:55:05.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.620+0000 7f0bb640b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bb00d07c0 0x7f0bb0152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:05.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.620+0000 7f0bb640b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bb00d07c0 0x7f0bb0152170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55504/0 (socket says 172.21.15.7:55504) 2024-04-25T09:55:05.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.620+0000 7f0bb640b640 1 -- 172.21.15.7:0/2272231516 learned_addr learned my addr 172.21.15.7:0/2272231516 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:05.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.620+0000 7f0bb640b640 1 -- 172.21.15.7:0/2272231516 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0bb015de50 msgr2=0x7f0bb00c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:05.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.620+0000 7f0bb640b640 1 --2- 172.21.15.7:0/2272231516 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0bb015de50 0x7f0bb00c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.620+0000 7f0bb640b640 1 -- 172.21.15.7:0/2272231516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bb00d0ba0 msgr2=0x7f0bb00c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:05.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.620+0000 7f0bb640b640 1 --2- 172.21.15.7:0/2272231516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bb00d0ba0 0x7f0bb00c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.620+0000 7f0bb640b640 1 -- 172.21.15.7:0/2272231516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb0160170 con 0x7f0bb00d07c0 2024-04-25T09:55:05.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.620+0000 7f0bb640b640 1 --2- 172.21.15.7:0/2272231516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bb00d07c0 0x7f0bb0152170 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0bac00c7c0 tx=0x7f0bac00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:05.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.621+0000 7f0ba6ffd640 1 -- 172.21.15.7:0/2272231516 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac015070 con 0x7f0bb00d07c0 2024-04-25T09:55:05.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.621+0000 7f0ba6ffd640 1 -- 172.21.15.7:0/2272231516 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bac007a30 con 0x7f0bb00d07c0 2024-04-25T09:55:05.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.621+0000 7f0bb866f640 1 -- 172.21.15.7:0/2272231516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb015ee40 con 0x7f0bb00d07c0 2024-04-25T09:55:05.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.621+0000 7f0ba6ffd640 1 -- 172.21.15.7:0/2272231516 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac007e00 con 0x7f0bb00d07c0 2024-04-25T09:55:05.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.621+0000 7f0bb866f640 1 -- 172.21.15.7:0/2272231516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb00c7550 con 0x7f0bb00d07c0 2024-04-25T09:55:05.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.622+0000 7f0bb866f640 1 -- 172.21.15.7:0/2272231516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb0073ce0 con 0x7f0bb00d07c0 2024-04-25T09:55:05.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.622+0000 7f0ba6ffd640 1 -- 172.21.15.7:0/2272231516 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0bac018070 con 0x7f0bb00d07c0 2024-04-25T09:55:05.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.622+0000 7f0ba6ffd640 1 --2- 172.21.15.7:0/2272231516 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0b9406b4d0 0x7f0b9406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:05.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.623+0000 7f0ba6ffd640 1 -- 172.21.15.7:0/2272231516 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0bac08a3c0 con 0x7f0bb00d07c0 2024-04-25T09:55:05.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.623+0000 7f0bb5c0a640 1 --2- 172.21.15.7:0/2272231516 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0b9406b4d0 0x7f0b9406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:05.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.623+0000 7f0bb5c0a640 1 --2- 172.21.15.7:0/2272231516 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0b9406b4d0 0x7f0b9406d990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0034000 tx=0x7f0ba002c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:05.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.627+0000 7f0ba6ffd640 1 -- 172.21.15.7:0/2272231516 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0bb0073ce0 con 0x7f0bb00d07c0 2024-04-25T09:55:05.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.811+0000 7f0bb866f640 1 -- 172.21.15.7:0/2272231516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0bb0068f60 con 0x7f0bb00d07c0 2024-04-25T09:55:05.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.812+0000 7f0ba6ffd640 1 -- 172.21.15.7:0/2272231516 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0bb0160170 con 0x7f0bb00d07c0 2024-04-25T09:55:05.815 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:55:05.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.814+0000 7f0bb866f640 1 -- 172.21.15.7:0/2272231516 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0b9406b4d0 msgr2=0x7f0b9406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:05.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.814+0000 7f0bb866f640 1 --2- 172.21.15.7:0/2272231516 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0b9406b4d0 0x7f0b9406d990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0034000 tx=0x7f0ba002c000 comp rx=0 tx=0).stop 2024-04-25T09:55:05.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.814+0000 7f0bb866f640 1 -- 172.21.15.7:0/2272231516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bb00d07c0 msgr2=0x7f0bb0152170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:05.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.814+0000 7f0bb866f640 1 --2- 172.21.15.7:0/2272231516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bb00d07c0 0x7f0bb0152170 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0bac00c7c0 tx=0x7f0bac00cc80 comp rx=0 tx=0).stop 2024-04-25T09:55:05.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.814+0000 7f0bb866f640 1 -- 172.21.15.7:0/2272231516 shutdown_connections 2024-04-25T09:55:05.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.814+0000 7f0bb866f640 1 --2- 172.21.15.7:0/2272231516 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0b9406b4d0 0x7f0b9406d990 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.814+0000 7f0bb866f640 1 --2- 172.21.15.7:0/2272231516 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0bb015de50 0x7f0bb00c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.814+0000 7f0bb866f640 1 --2- 172.21.15.7:0/2272231516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bb00d0ba0 0x7f0bb00c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.814+0000 7f0bb866f640 1 --2- 172.21.15.7:0/2272231516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bb00d07c0 0x7f0bb0152170 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.814+0000 7f0bb866f640 1 -- 172.21.15.7:0/2272231516 >> 172.21.15.7:0/2272231516 conn(0x7f0bb00726b0 msgr2=0x7f0bb00b6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:05.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.814+0000 7f0bb866f640 1 -- 172.21.15.7:0/2272231516 shutdown_connections 2024-04-25T09:55:05.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.814+0000 7f0bb866f640 1 -- 172.21.15.7:0/2272231516 wait complete. 2024-04-25T09:55:05.828 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:55:05.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.926+0000 7f1f61770640 1 Processor -- start 2024-04-25T09:55:05.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.926+0000 7f1f61770640 1 -- start start 2024-04-25T09:55:05.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.927+0000 7f1f61770640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1f5c0b5e60 0x7f1f5c06bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:05.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.927+0000 7f1f61770640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1f5c0b6a40 0x7f1f5c06c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:05.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.927+0000 7f1f61770640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5c06ca30 con 0x7f1f5c15dd00 2024-04-25T09:55:05.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.927+0000 7f1f61770640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f5c15e0e0 con 0x7f1f5c0b6a40 2024-04-25T09:55:05.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.927+0000 7f1f61770640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c06cfe0 con 0x7f1f5c0b5e60 2024-04-25T09:55:05.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.927+0000 7f1f5affd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1f5c15dd00 0x7f1f5c0b5750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:57804/0 (socket says 172.21.15.7:57804) 2024-04-25T09:55:05.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.927+0000 7f1f5affd640 1 -- 172.21.15.7:0/1502045639 learned_addr learned my addr 172.21.15.7:0/1502045639 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:05.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.927+0000 7f1f5b7fe640 1 --2- 172.21.15.7:0/1502045639 >> v2:172.21.15.7:3300/0 conn(0x7f1f5c0b6a40 0x7f1f5c06c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:05.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.927+0000 7f1f59ffb640 1 -- 172.21.15.7:0/1502045639 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4114579468 0 0) 0x7f1f5c06ca30 con 0x7f1f5c15dd00 2024-04-25T09:55:05.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.927+0000 7f1f59ffb640 1 -- 172.21.15.7:0/1502045639 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f44003520 con 0x7f1f5c15dd00 2024-04-25T09:55:05.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.927+0000 7f1f5a7fc640 1 --2- 172.21.15.7:0/1502045639 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1f5c0b5e60 0x7f1f5c06bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:05.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.927+0000 7f1f5b7fe640 1 -- 172.21.15.7:0/1502045639 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1f5c0b5e60 msgr2=0x7f1f5c06bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:05.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.927+0000 7f1f5b7fe640 1 --2- 172.21.15.7:0/1502045639 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1f5c0b5e60 0x7f1f5c06bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.927+0000 7f1f5b7fe640 1 -- 172.21.15.7:0/1502045639 >> v1:172.21.15.7:6789/0 conn(0x7f1f5c15dd00 legacy=0x7f1f5c0b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:05.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.928+0000 7f1f5b7fe640 1 -- 172.21.15.7:0/1502045639 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5c06cd00 con 0x7f1f5c0b6a40 2024-04-25T09:55:05.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.928+0000 7f1f5a7fc640 1 --2- 172.21.15.7:0/1502045639 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1f5c0b5e60 0x7f1f5c06bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:05.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.928+0000 7f1f5b7fe640 1 --2- 172.21.15.7:0/1502045639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f5c0b6a40 0x7f1f5c06c4f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009d90 tx=0x7f1f4c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ef16504d896910 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:05.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.928+0000 7f1f59ffb640 1 -- 172.21.15.7:0/1502045639 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c007740 con 0x7f1f5c0b6a40 2024-04-25T09:55:05.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.928+0000 7f1f59ffb640 1 -- 172.21.15.7:0/1502045639 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c0078e0 con 0x7f1f5c0b6a40 2024-04-25T09:55:05.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.928+0000 7f1f59ffb640 1 -- 172.21.15.7:0/1502045639 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c007cb0 con 0x7f1f5c0b6a40 2024-04-25T09:55:05.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.929+0000 7f1f61770640 1 -- 172.21.15.7:0/1502045639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f5c0b6a40 msgr2=0x7f1f5c06c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:05.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.929+0000 7f1f61770640 1 --2- 172.21.15.7:0/1502045639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f5c0b6a40 0x7f1f5c06c4f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009d90 tx=0x7f1f4c02a6f0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.929+0000 7f1f61770640 1 -- 172.21.15.7:0/1502045639 shutdown_connections 2024-04-25T09:55:05.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.929+0000 7f1f61770640 1 --2- 172.21.15.7:0/1502045639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f5c0b6a40 0x7f1f5c06c4f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.929+0000 7f1f61770640 1 --2- 172.21.15.7:0/1502045639 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1f5c0b5e60 0x7f1f5c06bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.929+0000 7f1f61770640 1 -- 172.21.15.7:0/1502045639 >> 172.21.15.7:0/1502045639 conn(0x7f1f5c0d07b0 msgr2=0x7f1f5c0d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:05.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.929+0000 7f1f61770640 1 -- 172.21.15.7:0/1502045639 shutdown_connections 2024-04-25T09:55:05.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.929+0000 7f1f61770640 1 -- 172.21.15.7:0/1502045639 wait complete. 2024-04-25T09:55:05.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.930+0000 7f1f61770640 1 Processor -- start 2024-04-25T09:55:05.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.930+0000 7f1f61770640 1 -- start start 2024-04-25T09:55:05.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.931+0000 7f1f61770640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f5c0b5e60 0x7f1f5c0c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:05.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.931+0000 7f1f61770640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1f5c0b6a40 0x7f1f5c0ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:05.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.931+0000 7f1f61770640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f5c15dd00 0x7f1f5c0caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:05.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.931+0000 7f1f61770640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c0d2260 con 0x7f1f5c15dd00 2024-04-25T09:55:05.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.931+0000 7f1f61770640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c0d1f80 con 0x7f1f5c0b5e60 2024-04-25T09:55:05.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.931+0000 7f1f61770640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c0d2780 con 0x7f1f5c0b6a40 2024-04-25T09:55:05.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.931+0000 7f1f5b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f5c15dd00 0x7f1f5c0caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:05.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.931+0000 7f1f5b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f5c15dd00 0x7f1f5c0caf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55522/0 (socket says 172.21.15.7:55522) 2024-04-25T09:55:05.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.931+0000 7f1f5b7fe640 1 -- 172.21.15.7:0/1495896364 learned_addr learned my addr 172.21.15.7:0/1495896364 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:05.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.931+0000 7f1f5a7fc640 1 --2- 172.21.15.7:0/1495896364 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1f5c0b6a40 0x7f1f5c0ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:05.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.931+0000 7f1f5affd640 1 --2- 172.21.15.7:0/1495896364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f5c0b5e60 0x7f1f5c0c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:05.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.931+0000 7f1f5b7fe640 1 -- 172.21.15.7:0/1495896364 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1f5c0b6a40 msgr2=0x7f1f5c0ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:05.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.931+0000 7f1f5b7fe640 1 --2- 172.21.15.7:0/1495896364 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1f5c0b6a40 0x7f1f5c0ca9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.931+0000 7f1f5b7fe640 1 -- 172.21.15.7:0/1495896364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f5c0b5e60 msgr2=0x7f1f5c0c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:05.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.931+0000 7f1f5b7fe640 1 --2- 172.21.15.7:0/1495896364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f5c0b5e60 0x7f1f5c0c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:05.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.931+0000 7f1f5b7fe640 1 -- 172.21.15.7:0/1495896364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5c0c9350 con 0x7f1f5c15dd00 2024-04-25T09:55:05.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.931+0000 7f1f5a7fc640 1 --2- 172.21.15.7:0/1495896364 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1f5c0b6a40 0x7f1f5c0ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:05.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.932+0000 7f1f5b7fe640 1 --2- 172.21.15.7:0/1495896364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f5c15dd00 0x7f1f5c0caf20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009eb0 tx=0x7f1f4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:05.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.932+0000 7f1f437fe640 1 -- 172.21.15.7:0/1495896364 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c040070 con 0x7f1f5c15dd00 2024-04-25T09:55:05.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.932+0000 7f1f437fe640 1 -- 172.21.15.7:0/1495896364 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c031bc0 con 0x7f1f5c15dd00 2024-04-25T09:55:05.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.932+0000 7f1f61770640 1 -- 172.21.15.7:0/1495896364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f5c15e960 con 0x7f1f5c15dd00 2024-04-25T09:55:05.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.932+0000 7f1f437fe640 1 -- 172.21.15.7:0/1495896364 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c009450 con 0x7f1f5c15dd00 2024-04-25T09:55:05.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.932+0000 7f1f61770640 1 -- 172.21.15.7:0/1495896364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f5c15ef20 con 0x7f1f5c15dd00 2024-04-25T09:55:05.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.933+0000 7f1f61770640 1 -- 172.21.15.7:0/1495896364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f5c068fd0 con 0x7f1f5c15dd00 2024-04-25T09:55:05.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.933+0000 7f1f437fe640 1 -- 172.21.15.7:0/1495896364 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1f4c039040 con 0x7f1f5c15dd00 2024-04-25T09:55:05.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.934+0000 7f1f437fe640 1 --2- 172.21.15.7:0/1495896364 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1f4806b4d0 0x7f1f4806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:05.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.934+0000 7f1f437fe640 1 -- 172.21.15.7:0/1495896364 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f1f4c0abd70 con 0x7f1f5c15dd00 2024-04-25T09:55:05.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.934+0000 7f1f5affd640 1 --2- 172.21.15.7:0/1495896364 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1f4806b4d0 0x7f1f4806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:05.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.934+0000 7f1f5affd640 1 --2- 172.21.15.7:0/1495896364 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1f4806b4d0 0x7f1f4806d990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1f54005880 tx=0x7f1f54009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:05.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:05.938+0000 7f1f437fe640 1 -- 172.21.15.7:0/1495896364 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1f4c07a8a0 con 0x7f1f5c15dd00 2024-04-25T09:55:06.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.120+0000 7f1f61770640 1 -- 172.21.15.7:0/1495896364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f5c0d1620 con 0x7f1f5c15dd00 2024-04-25T09:55:06.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.121+0000 7f1f437fe640 1 -- 172.21.15.7:0/1495896364 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18418 (secure 0 0 0) 0x7f1f4c07a1a0 con 0x7f1f5c15dd00 2024-04-25T09:55:06.124 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:06.124 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:54:32.606761+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:54:26.011833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:54:26.535536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:54:30.264996+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:55:06.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.123+0000 7f1f61770640 1 -- 172.21.15.7:0/1495896364 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1f4806b4d0 msgr2=0x7f1f4806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:06.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.123+0000 7f1f61770640 1 --2- 172.21.15.7:0/1495896364 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1f4806b4d0 0x7f1f4806d990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1f54005880 tx=0x7f1f54009040 comp rx=0 tx=0).stop 2024-04-25T09:55:06.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.123+0000 7f1f61770640 1 -- 172.21.15.7:0/1495896364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f5c15dd00 msgr2=0x7f1f5c0caf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:06.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.123+0000 7f1f61770640 1 --2- 172.21.15.7:0/1495896364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f5c15dd00 0x7f1f5c0caf20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009eb0 tx=0x7f1f4c004a40 comp rx=0 tx=0).stop 2024-04-25T09:55:06.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.123+0000 7f1f61770640 1 -- 172.21.15.7:0/1495896364 shutdown_connections 2024-04-25T09:55:06.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.123+0000 7f1f61770640 1 --2- 172.21.15.7:0/1495896364 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1f4806b4d0 0x7f1f4806d990 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:06.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.123+0000 7f1f61770640 1 --2- 172.21.15.7:0/1495896364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f5c15dd00 0x7f1f5c0caf20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:06.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.123+0000 7f1f61770640 1 --2- 172.21.15.7:0/1495896364 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1f5c0b6a40 0x7f1f5c0ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:06.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.123+0000 7f1f61770640 1 --2- 172.21.15.7:0/1495896364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f5c0b5e60 0x7f1f5c0c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:06.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.123+0000 7f1f61770640 1 -- 172.21.15.7:0/1495896364 >> 172.21.15.7:0/1495896364 conn(0x7f1f5c0d07b0 msgr2=0x7f1f5c0c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:06.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.123+0000 7f1f61770640 1 -- 172.21.15.7:0/1495896364 shutdown_connections 2024-04-25T09:55:06.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.123+0000 7f1f61770640 1 -- 172.21.15.7:0/1495896364 wait complete. 2024-04-25T09:55:06.137 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:54:26.011833+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:54:26.535536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:54:30.264996+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:55:06.137 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:55:06.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.238+0000 7f4aa4329640 1 Processor -- start 2024-04-25T09:55:06.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.238+0000 7f4aa4329640 1 -- start start 2024-04-25T09:55:06.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.239+0000 7f4aa4329640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4a9c0d0780 0x7f4a9c0d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:06.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.239+0000 7f4aa4329640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4a9c0b9590 0x7f4a9c0b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:06.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.239+0000 7f4aa4329640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a9c0d10a0 con 0x7f4a9c0b9130 2024-04-25T09:55:06.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.239+0000 7f4aa4329640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a9c0b7ef0 con 0x7f4a9c0b9590 2024-04-25T09:55:06.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.239+0000 7f4aa4329640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c0b81d0 con 0x7f4a9c0d0780 2024-04-25T09:55:06.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.239+0000 7f4aa28c6640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4a9c0b9590 0x7f4a9c0b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:06.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.239+0000 7f4aa28c6640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4a9c0b9590 0x7f4a9c0b78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55526/0 (socket says 172.21.15.7:55526) 2024-04-25T09:55:06.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.239+0000 7f4aa28c6640 1 -- 172.21.15.7:0/1950676365 learned_addr learned my addr 172.21.15.7:0/1950676365 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:06.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.239+0000 7f4aa20c5640 1 --2- 172.21.15.7:0/1950676365 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4a9c0d0780 0x7f4a9c0d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:06.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.239+0000 7f4aa28c6640 1 -- 172.21.15.7:0/1950676365 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4a9c0d0780 msgr2=0x7f4a9c0d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:06.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.239+0000 7f4aa28c6640 1 --2- 172.21.15.7:0/1950676365 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4a9c0d0780 0x7f4a9c0d0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:06.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.239+0000 7f4aa28c6640 1 -- 172.21.15.7:0/1950676365 >> v1:172.21.15.55:6789/0 conn(0x7f4a9c0b9130 legacy=0x7f4a9c0d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:06.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.239+0000 7f4aa28c6640 1 -- 172.21.15.7:0/1950676365 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9c0b84b0 con 0x7f4a9c0b9590 2024-04-25T09:55:06.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.239+0000 7f4aa20c5640 1 --2- 172.21.15.7:0/1950676365 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4a9c0d0780 0x7f4a9c0d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:06.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.240+0000 7f4aa28c6640 1 --2- 172.21.15.7:0/1950676365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a9c0b9590 0x7f4a9c0b78c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4a94009e50 tx=0x7f4a9402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fcc4a807b2e0f62 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:06.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.240+0000 7f4aa10c3640 1 -- 172.21.15.7:0/1950676365 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a94036070 con 0x7f4a9c0b9590 2024-04-25T09:55:06.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.240+0000 7f4aa10c3640 1 -- 172.21.15.7:0/1950676365 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a94031600 con 0x7f4a9c0b9590 2024-04-25T09:55:06.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.240+0000 7f4aa10c3640 1 -- 172.21.15.7:0/1950676365 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a940319d0 con 0x7f4a9c0b9590 2024-04-25T09:55:06.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.241+0000 7f4aa4329640 1 -- 172.21.15.7:0/1950676365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a9c0b9590 msgr2=0x7f4a9c0b78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:06.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.241+0000 7f4aa4329640 1 --2- 172.21.15.7:0/1950676365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a9c0b9590 0x7f4a9c0b78c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4a94009e50 tx=0x7f4a9402a710 comp rx=0 tx=0).stop 2024-04-25T09:55:06.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.241+0000 7f4aa4329640 1 -- 172.21.15.7:0/1950676365 shutdown_connections 2024-04-25T09:55:06.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.241+0000 7f4aa4329640 1 --2- 172.21.15.7:0/1950676365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a9c0b9590 0x7f4a9c0b78c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:06.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.241+0000 7f4aa4329640 1 --2- 172.21.15.7:0/1950676365 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4a9c0d0780 0x7f4a9c0d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:06.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.241+0000 7f4aa4329640 1 -- 172.21.15.7:0/1950676365 >> 172.21.15.7:0/1950676365 conn(0x7f4a9c0726b0 msgr2=0x7f4a9c072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:06.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.241+0000 7f4aa4329640 1 -- 172.21.15.7:0/1950676365 shutdown_connections 2024-04-25T09:55:06.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.241+0000 7f4aa4329640 1 -- 172.21.15.7:0/1950676365 wait complete. 2024-04-25T09:55:06.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.242+0000 7f4aa4329640 1 Processor -- start 2024-04-25T09:55:06.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.242+0000 7f4aa4329640 1 -- start start 2024-04-25T09:55:06.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.243+0000 7f4aa4329640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a9c0b9130 0x7f4a9c157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:06.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.243+0000 7f4aa4329640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a9c0b9590 0x7f4a9c0cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:06.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.243+0000 7f4aa4329640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4a9c0d0780 0x7f4a9c0ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:06.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.243+0000 7f4aa4329640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c1611b0 con 0x7f4a9c0b9130 2024-04-25T09:55:06.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.243+0000 7f4aa4329640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c0b8a70 con 0x7f4a9c0b9590 2024-04-25T09:55:06.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.243+0000 7f4aa4329640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c161330 con 0x7f4a9c0d0780 2024-04-25T09:55:06.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.243+0000 7f4aa20c5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a9c0b9130 0x7f4a9c157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:06.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.243+0000 7f4aa20c5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a9c0b9130 0x7f4a9c157d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55528/0 (socket says 172.21.15.7:55528) 2024-04-25T09:55:06.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.243+0000 7f4aa20c5640 1 -- 172.21.15.7:0/1541910479 learned_addr learned my addr 172.21.15.7:0/1541910479 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:06.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.243+0000 7f4aa20c5640 1 -- 172.21.15.7:0/1541910479 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4a9c0d0780 msgr2=0x7f4a9c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:06.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.243+0000 7f4aa20c5640 1 --2- 172.21.15.7:0/1541910479 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4a9c0d0780 0x7f4a9c0ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:06.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.243+0000 7f4aa20c5640 1 -- 172.21.15.7:0/1541910479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a9c0b9590 msgr2=0x7f4a9c0cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:06.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.243+0000 7f4aa18c4640 1 --2- 172.21.15.7:0/1541910479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a9c0b9590 0x7f4a9c0cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:06.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.243+0000 7f4aa20c5640 1 --2- 172.21.15.7:0/1541910479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a9c0b9590 0x7f4a9c0cc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:06.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.243+0000 7f4aa20c5640 1 -- 172.21.15.7:0/1541910479 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9c0c7e00 con 0x7f4a9c0b9130 2024-04-25T09:55:06.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.243+0000 7f4aa18c4640 1 --2- 172.21.15.7:0/1541910479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a9c0b9590 0x7f4a9c0cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:06.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.244+0000 7f4aa20c5640 1 --2- 172.21.15.7:0/1541910479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a9c0b9130 0x7f4a9c157d70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4a9800d7d0 tx=0x7f4a9800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:06.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.244+0000 7f4a92ffd640 1 -- 172.21.15.7:0/1541910479 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a98004030 con 0x7f4a9c0b9130 2024-04-25T09:55:06.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.244+0000 7f4a92ffd640 1 -- 172.21.15.7:0/1541910479 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a980041d0 con 0x7f4a9c0b9130 2024-04-25T09:55:06.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.244+0000 7f4aa4329640 1 -- 172.21.15.7:0/1541910479 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a9c0c80e0 con 0x7f4a9c0b9130 2024-04-25T09:55:06.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.244+0000 7f4a92ffd640 1 -- 172.21.15.7:0/1541910479 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a980096a0 con 0x7f4a9c0b9130 2024-04-25T09:55:06.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.244+0000 7f4aa4329640 1 -- 172.21.15.7:0/1541910479 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a9c0c86a0 con 0x7f4a9c0b9130 2024-04-25T09:55:06.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.245+0000 7f4aa4329640 1 -- 172.21.15.7:0/1541910479 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a9c0685d0 con 0x7f4a9c0b9130 2024-04-25T09:55:06.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.245+0000 7f4a92ffd640 1 -- 172.21.15.7:0/1541910479 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4a98009840 con 0x7f4a9c0b9130 2024-04-25T09:55:06.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.245+0000 7f4a92ffd640 1 --2- 172.21.15.7:0/1541910479 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4a8006b4d0 0x7f4a8006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:06.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.246+0000 7f4a92ffd640 1 -- 172.21.15.7:0/1541910479 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f4a9808a7c0 con 0x7f4a9c0b9130 2024-04-25T09:55:06.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.246+0000 7f4aa18c4640 1 --2- 172.21.15.7:0/1541910479 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4a8006b4d0 0x7f4a8006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:06.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.246+0000 7f4aa18c4640 1 --2- 172.21.15.7:0/1541910479 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4a8006b4d0 0x7f4a8006d990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c1f7020 tx=0x7f4a8c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:06.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.250+0000 7f4a92ffd640 1 -- 172.21.15.7:0/1541910479 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4a98059390 con 0x7f4a9c0b9130 2024-04-25T09:55:06.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.434+0000 7f4aa4329640 1 -- 172.21.15.7:0/1541910479 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4a9c068f60 con 0x7f4a9c0b9130 2024-04-25T09:55:06.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.435+0000 7f4a92ffd640 1 -- 172.21.15.7:0/1541910479 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4a98058c90 con 0x7f4a9c0b9130 2024-04-25T09:55:06.438 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T09:55:06.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.437+0000 7f4aa4329640 1 -- 172.21.15.7:0/1541910479 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4a8006b4d0 msgr2=0x7f4a8006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:06.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.437+0000 7f4aa4329640 1 --2- 172.21.15.7:0/1541910479 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4a8006b4d0 0x7f4a8006d990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c1f7020 tx=0x7f4a8c009040 comp rx=0 tx=0).stop 2024-04-25T09:55:06.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.437+0000 7f4aa4329640 1 -- 172.21.15.7:0/1541910479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a9c0b9130 msgr2=0x7f4a9c157d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:06.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.437+0000 7f4aa4329640 1 --2- 172.21.15.7:0/1541910479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a9c0b9130 0x7f4a9c157d70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4a9800d7d0 tx=0x7f4a9800dc90 comp rx=0 tx=0).stop 2024-04-25T09:55:06.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.437+0000 7f4aa4329640 1 -- 172.21.15.7:0/1541910479 shutdown_connections 2024-04-25T09:55:06.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.437+0000 7f4aa4329640 1 --2- 172.21.15.7:0/1541910479 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4a8006b4d0 0x7f4a8006d990 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:06.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.437+0000 7f4aa4329640 1 --2- 172.21.15.7:0/1541910479 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4a9c0d0780 0x7f4a9c0ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:06.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.437+0000 7f4aa4329640 1 --2- 172.21.15.7:0/1541910479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a9c0b9590 0x7f4a9c0cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:06.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.437+0000 7f4aa4329640 1 --2- 172.21.15.7:0/1541910479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a9c0b9130 0x7f4a9c157d70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:06.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.437+0000 7f4aa4329640 1 -- 172.21.15.7:0/1541910479 >> 172.21.15.7:0/1541910479 conn(0x7f4a9c0726b0 msgr2=0x7f4a9c0b7250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:06.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.437+0000 7f4aa4329640 1 -- 172.21.15.7:0/1541910479 shutdown_connections 2024-04-25T09:55:06.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.437+0000 7f4aa4329640 1 -- 172.21.15.7:0/1541910479 wait complete. 2024-04-25T09:55:06.450 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:55:06.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.551+0000 7f16bb22a640 1 Processor -- start 2024-04-25T09:55:06.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.551+0000 7f16bb22a640 1 -- start start 2024-04-25T09:55:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.552+0000 7f16bb22a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f16b415db30 0x7f16b40d0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.552+0000 7f16bb22a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f16b40d0980 0x7f16b40ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.552+0000 7f16bb22a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16b415df10 con 0x7f16b40cebc0 2024-04-25T09:55:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.552+0000 7f16bb22a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16b40d1780 con 0x7f16b40d0980 2024-04-25T09:55:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.552+0000 7f16bb22a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16b40d1a60 con 0x7f16b415db30 2024-04-25T09:55:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.552+0000 7f16b3fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f16b40d0980 0x7f16b40ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.552+0000 7f16b3fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f16b40d0980 0x7f16b40ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55538/0 (socket says 172.21.15.7:55538) 2024-04-25T09:55:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.552+0000 7f16b3fff640 1 -- 172.21.15.7:0/2284119239 learned_addr learned my addr 172.21.15.7:0/2284119239 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.552+0000 7f16b8fc6640 1 --2- 172.21.15.7:0/2284119239 >> v2:172.21.15.55:3300/0 conn(0x7f16b415db30 0x7f16b40d0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.552+0000 7f16b3fff640 1 -- 172.21.15.7:0/2284119239 >> v2:172.21.15.55:3300/0 conn(0x7f16b415db30 msgr2=0x7f16b40d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.552+0000 7f16b3fff640 1 --2- 172.21.15.7:0/2284119239 >> v2:172.21.15.55:3300/0 conn(0x7f16b415db30 0x7f16b40d0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.552+0000 7f16b3fff640 1 -- 172.21.15.7:0/2284119239 >> v1:172.21.15.55:6789/0 conn(0x7f16b40cebc0 legacy=0x7f16b40b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:06.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.552+0000 7f16b3fff640 1 -- 172.21.15.7:0/2284119239 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b40d1d40 con 0x7f16b40d0980 2024-04-25T09:55:06.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.552+0000 7f16b8fc6640 1 --2- 172.21.15.7:0/2284119239 >> v2:172.21.15.55:3300/0 conn(0x7f16b415db30 0x7f16b40d0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:06.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.553+0000 7f16b3fff640 1 --2- 172.21.15.7:0/2284119239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16b40d0980 0x7f16b40ce680 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f16b40d0fa0 tx=0x7f16a802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cbd6e0cfe143ef4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:06.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.553+0000 7f16b37fe640 1 -- 172.21.15.7:0/2284119239 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a8037070 con 0x7f16b40d0980 2024-04-25T09:55:06.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.553+0000 7f16b37fe640 1 -- 172.21.15.7:0/2284119239 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a8032440 con 0x7f16b40d0980 2024-04-25T09:55:06.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.553+0000 7f16b37fe640 1 -- 172.21.15.7:0/2284119239 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a8032810 con 0x7f16b40d0980 2024-04-25T09:55:06.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.554+0000 7f16bb22a640 1 -- 172.21.15.7:0/2284119239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16b40d0980 msgr2=0x7f16b40ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:06.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.554+0000 7f16bb22a640 1 --2- 172.21.15.7:0/2284119239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16b40d0980 0x7f16b40ce680 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f16b40d0fa0 tx=0x7f16a802a230 comp rx=0 tx=0).stop 2024-04-25T09:55:06.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.554+0000 7f16bb22a640 1 -- 172.21.15.7:0/2284119239 shutdown_connections 2024-04-25T09:55:06.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.554+0000 7f16bb22a640 1 --2- 172.21.15.7:0/2284119239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16b40d0980 0x7f16b40ce680 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:06.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.554+0000 7f16bb22a640 1 --2- 172.21.15.7:0/2284119239 >> v2:172.21.15.55:3300/0 conn(0x7f16b415db30 0x7f16b40d0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:06.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.554+0000 7f16bb22a640 1 -- 172.21.15.7:0/2284119239 >> 172.21.15.7:0/2284119239 conn(0x7f16b40728c0 msgr2=0x7f16b406bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:06.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.554+0000 7f16bb22a640 1 -- 172.21.15.7:0/2284119239 shutdown_connections 2024-04-25T09:55:06.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.554+0000 7f16bb22a640 1 -- 172.21.15.7:0/2284119239 wait complete. 2024-04-25T09:55:06.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.555+0000 7f16bb22a640 1 Processor -- start 2024-04-25T09:55:06.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.555+0000 7f16bb22a640 1 -- start start 2024-04-25T09:55:06.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.556+0000 7f16bb22a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16b40cebc0 0x7f16b40cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:06.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.556+0000 7f16bb22a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16b40d0980 0x7f16b4149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:06.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.556+0000 7f16bb22a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f16b415db30 0x7f16b4149d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:06.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.556+0000 7f16bb22a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b40d1410 con 0x7f16b40cebc0 2024-04-25T09:55:06.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.556+0000 7f16bb22a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b40cf010 con 0x7f16b40d0980 2024-04-25T09:55:06.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.556+0000 7f16bb22a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b40b7a80 con 0x7f16b415db30 2024-04-25T09:55:06.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.556+0000 7f16b8fc6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16b40cebc0 0x7f16b40cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:06.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.556+0000 7f16b8fc6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16b40cebc0 0x7f16b40cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55552/0 (socket says 172.21.15.7:55552) 2024-04-25T09:55:06.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.556+0000 7f16b8fc6640 1 -- 172.21.15.7:0/439827330 learned_addr learned my addr 172.21.15.7:0/439827330 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:06.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.556+0000 7f16b97c7640 1 --2- 172.21.15.7:0/439827330 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f16b415db30 0x7f16b4149d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:06.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.556+0000 7f16b3fff640 1 --2- 172.21.15.7:0/439827330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16b40d0980 0x7f16b4149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:06.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.556+0000 7f16b8fc6640 1 -- 172.21.15.7:0/439827330 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f16b415db30 msgr2=0x7f16b4149d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:06.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.556+0000 7f16b8fc6640 1 --2- 172.21.15.7:0/439827330 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f16b415db30 0x7f16b4149d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:06.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.556+0000 7f16b8fc6640 1 -- 172.21.15.7:0/439827330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16b40d0980 msgr2=0x7f16b4149810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:06.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.556+0000 7f16b8fc6640 1 --2- 172.21.15.7:0/439827330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16b40d0980 0x7f16b4149810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:06.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.556+0000 7f16b8fc6640 1 -- 172.21.15.7:0/439827330 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b40b5d70 con 0x7f16b40cebc0 2024-04-25T09:55:06.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.556+0000 7f16b97c7640 1 --2- 172.21.15.7:0/439827330 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f16b415db30 0x7f16b4149d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:06.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.556+0000 7f16b3fff640 1 --2- 172.21.15.7:0/439827330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16b40d0980 0x7f16b4149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:06.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.557+0000 7f16b8fc6640 1 --2- 172.21.15.7:0/439827330 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16b40cebc0 0x7f16b40cd0c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f16a400c7f0 tx=0x7f16a400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:06.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.557+0000 7f16b17fa640 1 -- 172.21.15.7:0/439827330 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a4015070 con 0x7f16b40cebc0 2024-04-25T09:55:06.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.557+0000 7f16b17fa640 1 -- 172.21.15.7:0/439827330 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a4007820 con 0x7f16b40cebc0 2024-04-25T09:55:06.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.557+0000 7f16bb22a640 1 -- 172.21.15.7:0/439827330 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16b40b6050 con 0x7f16b40cebc0 2024-04-25T09:55:06.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.557+0000 7f16b17fa640 1 -- 172.21.15.7:0/439827330 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a4007bd0 con 0x7f16b40cebc0 2024-04-25T09:55:06.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.557+0000 7f16bb22a640 1 -- 172.21.15.7:0/439827330 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16b414a9d0 con 0x7f16b40cebc0 2024-04-25T09:55:06.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.558+0000 7f16bb22a640 1 -- 172.21.15.7:0/439827330 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16b4068f60 con 0x7f16b40cebc0 2024-04-25T09:55:06.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.558+0000 7f16b17fa640 1 -- 172.21.15.7:0/439827330 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f16a4018070 con 0x7f16b40cebc0 2024-04-25T09:55:06.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.559+0000 7f16b17fa640 1 --2- 172.21.15.7:0/439827330 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f16a006b500 0x7f16a006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:06.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.559+0000 7f16b17fa640 1 -- 172.21.15.7:0/439827330 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f16a408a5c0 con 0x7f16b40cebc0 2024-04-25T09:55:06.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.559+0000 7f16b3fff640 1 --2- 172.21.15.7:0/439827330 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f16a006b500 0x7f16a006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:06.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.559+0000 7f16b3fff640 1 --2- 172.21.15.7:0/439827330 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f16a006b500 0x7f16a006d9c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f16a8034000 tx=0x7f16a802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:06.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.563+0000 7f16b17fa640 1 -- 172.21.15.7:0/439827330 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f16a4059190 con 0x7f16b40cebc0 2024-04-25T09:55:06.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.745+0000 7f16bb22a640 1 -- 172.21.15.7:0/439827330 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f16b4154460 con 0x7f16b40cebc0 2024-04-25T09:55:06.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.746+0000 7f16b17fa640 1 -- 172.21.15.7:0/439827330 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f16a4058a90 con 0x7f16b40cebc0 2024-04-25T09:55:06.749 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:55:06.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.748+0000 7f16bb22a640 1 -- 172.21.15.7:0/439827330 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f16a006b500 msgr2=0x7f16a006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:06.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.748+0000 7f16bb22a640 1 --2- 172.21.15.7:0/439827330 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f16a006b500 0x7f16a006d9c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f16a8034000 tx=0x7f16a802e000 comp rx=0 tx=0).stop 2024-04-25T09:55:06.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.748+0000 7f16bb22a640 1 -- 172.21.15.7:0/439827330 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16b40cebc0 msgr2=0x7f16b40cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:06.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.748+0000 7f16bb22a640 1 --2- 172.21.15.7:0/439827330 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16b40cebc0 0x7f16b40cd0c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f16a400c7f0 tx=0x7f16a400ccb0 comp rx=0 tx=0).stop 2024-04-25T09:55:06.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.748+0000 7f16bb22a640 1 -- 172.21.15.7:0/439827330 shutdown_connections 2024-04-25T09:55:06.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.748+0000 7f16bb22a640 1 --2- 172.21.15.7:0/439827330 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f16a006b500 0x7f16a006d9c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:06.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.748+0000 7f16bb22a640 1 --2- 172.21.15.7:0/439827330 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f16b415db30 0x7f16b4149d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:06.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.748+0000 7f16bb22a640 1 --2- 172.21.15.7:0/439827330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16b40d0980 0x7f16b4149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:06.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.748+0000 7f16bb22a640 1 --2- 172.21.15.7:0/439827330 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16b40cebc0 0x7f16b40cd0c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:06.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.748+0000 7f16bb22a640 1 -- 172.21.15.7:0/439827330 >> 172.21.15.7:0/439827330 conn(0x7f16b40728c0 msgr2=0x7f16b40d27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:06.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.748+0000 7f16bb22a640 1 -- 172.21.15.7:0/439827330 shutdown_connections 2024-04-25T09:55:06.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.748+0000 7f16bb22a640 1 -- 172.21.15.7:0/439827330 wait complete. 2024-04-25T09:55:06.762 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:55:06.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.863+0000 7f90300e1640 1 Processor -- start 2024-04-25T09:55:06.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.863+0000 7f90300e1640 1 -- start start 2024-04-25T09:55:06.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.864+0000 7f90300e1640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f90280ce680 0x7f90280ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:06.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.864+0000 7f90300e1640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90280b6a70 0x7f90280b6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.864+0000 7f90300e1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90280cf050 con 0x7f902815db30 2024-04-25T09:55:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.864+0000 7f90300e1640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f902815df10 con 0x7f90280ce680 2024-04-25T09:55:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.864+0000 7f90300e1640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90280d1780 con 0x7f90280b6a70 2024-04-25T09:55:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.864+0000 7f902d67c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f90280ce680 0x7f90280ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.864+0000 7f902d67c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f90280ce680 0x7f90280ceb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55562/0 (socket says 172.21.15.7:55562) 2024-04-25T09:55:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.864+0000 7f902d67c640 1 -- 172.21.15.7:0/1033262375 learned_addr learned my addr 172.21.15.7:0/1033262375 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.864+0000 7f902e67e640 1 --2- 172.21.15.7:0/1033262375 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90280b6a70 0x7f90280b6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.864+0000 7f902d67c640 1 -- 172.21.15.7:0/1033262375 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90280b6a70 msgr2=0x7f90280b6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.864+0000 7f902d67c640 1 --2- 172.21.15.7:0/1033262375 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90280b6a70 0x7f90280b6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.864+0000 7f902d67c640 1 -- 172.21.15.7:0/1033262375 >> v1:172.21.15.55:6789/0 conn(0x7f902815db30 legacy=0x7f90280d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.864+0000 7f902d67c640 1 -- 172.21.15.7:0/1033262375 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90280d1a60 con 0x7f90280ce680 2024-04-25T09:55:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.864+0000 7f902e67e640 1 --2- 172.21.15.7:0/1033262375 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90280b6a70 0x7f90280b6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.865+0000 7f902d67c640 1 --2- 172.21.15.7:0/1033262375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90280ce680 0x7f90280ceb10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9018009870 tx=0x7f901802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e5b55c10349f42c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.865+0000 7f902ce7b640 1 -- 172.21.15.7:0/1033262375 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9018037070 con 0x7f90280ce680 2024-04-25T09:55:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.865+0000 7f902ce7b640 1 -- 172.21.15.7:0/1033262375 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9018032440 con 0x7f90280ce680 2024-04-25T09:55:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.865+0000 7f902ce7b640 1 -- 172.21.15.7:0/1033262375 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9018032810 con 0x7f90280ce680 2024-04-25T09:55:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.865+0000 7f90300e1640 1 -- 172.21.15.7:0/1033262375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90280ce680 msgr2=0x7f90280ceb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.865+0000 7f90300e1640 1 --2- 172.21.15.7:0/1033262375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90280ce680 0x7f90280ceb10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9018009870 tx=0x7f901802a210 comp rx=0 tx=0).stop 2024-04-25T09:55:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.866+0000 7f90300e1640 1 -- 172.21.15.7:0/1033262375 shutdown_connections 2024-04-25T09:55:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.866+0000 7f90300e1640 1 --2- 172.21.15.7:0/1033262375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90280ce680 0x7f90280ceb10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.866+0000 7f90300e1640 1 --2- 172.21.15.7:0/1033262375 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90280b6a70 0x7f90280b6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.866+0000 7f90300e1640 1 -- 172.21.15.7:0/1033262375 >> 172.21.15.7:0/1033262375 conn(0x7f90280728c0 msgr2=0x7f902806bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:06.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.866+0000 7f90300e1640 1 -- 172.21.15.7:0/1033262375 shutdown_connections 2024-04-25T09:55:06.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.866+0000 7f90300e1640 1 -- 172.21.15.7:0/1033262375 wait complete. 2024-04-25T09:55:06.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.867+0000 7f90300e1640 1 Processor -- start 2024-04-25T09:55:06.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.867+0000 7f90300e1640 1 -- start start 2024-04-25T09:55:06.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.868+0000 7f90300e1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90280b6a70 0x7f9028157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:06.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.868+0000 7f90300e1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90280ce680 0x7f902815e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:06.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.868+0000 7f90300e1640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f902815db30 0x7f902815eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:06.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.868+0000 7f90300e1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90280d1410 con 0x7f90280b6a70 2024-04-25T09:55:06.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.868+0000 7f90300e1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90280d2020 con 0x7f90280ce680 2024-04-25T09:55:06.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.868+0000 7f90300e1640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90280d0b50 con 0x7f902815db30 2024-04-25T09:55:06.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.868+0000 7f902de7d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90280b6a70 0x7f9028157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:06.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.868+0000 7f902de7d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90280b6a70 0x7f9028157e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55570/0 (socket says 172.21.15.7:55570) 2024-04-25T09:55:06.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.868+0000 7f902de7d640 1 -- 172.21.15.7:0/3981613786 learned_addr learned my addr 172.21.15.7:0/3981613786 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:06.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.868+0000 7f902e67e640 1 --2- 172.21.15.7:0/3981613786 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f902815db30 0x7f902815eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:06.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.868+0000 7f902d67c640 1 --2- 172.21.15.7:0/3981613786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90280ce680 0x7f902815e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:06.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.868+0000 7f902de7d640 1 -- 172.21.15.7:0/3981613786 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f902815db30 msgr2=0x7f902815eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:06.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.868+0000 7f902de7d640 1 --2- 172.21.15.7:0/3981613786 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f902815db30 0x7f902815eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:06.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.868+0000 7f902de7d640 1 -- 172.21.15.7:0/3981613786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90280ce680 msgr2=0x7f902815e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:06.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.868+0000 7f902de7d640 1 --2- 172.21.15.7:0/3981613786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90280ce680 0x7f902815e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:06.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.868+0000 7f902de7d640 1 -- 172.21.15.7:0/3981613786 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f902815f8c0 con 0x7f90280b6a70 2024-04-25T09:55:06.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.868+0000 7f902d67c640 1 --2- 172.21.15.7:0/3981613786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90280ce680 0x7f902815e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:06.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.868+0000 7f902e67e640 1 --2- 172.21.15.7:0/3981613786 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f902815db30 0x7f902815eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:06.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.868+0000 7f902de7d640 1 --2- 172.21.15.7:0/3981613786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90280b6a70 0x7f9028157e50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f902400b3f0 tx=0x7f902400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:06.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.868+0000 7f901e7fc640 1 -- 172.21.15.7:0/3981613786 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9024015020 con 0x7f90280b6a70 2024-04-25T09:55:06.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.868+0000 7f901e7fc640 1 -- 172.21.15.7:0/3981613786 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9024011830 con 0x7f90280b6a70 2024-04-25T09:55:06.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.868+0000 7f90300e1640 1 -- 172.21.15.7:0/3981613786 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f902815fc00 con 0x7f90280b6a70 2024-04-25T09:55:06.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.868+0000 7f901e7fc640 1 -- 172.21.15.7:0/3981613786 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9024011c20 con 0x7f90280b6a70 2024-04-25T09:55:06.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.869+0000 7f90300e1640 1 -- 172.21.15.7:0/3981613786 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90280cbf20 con 0x7f90280b6a70 2024-04-25T09:55:06.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.869+0000 7f90300e1640 1 -- 172.21.15.7:0/3981613786 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9028068f60 con 0x7f90280b6a70 2024-04-25T09:55:06.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.870+0000 7f901e7fc640 1 -- 172.21.15.7:0/3981613786 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9024018020 con 0x7f90280b6a70 2024-04-25T09:55:06.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.870+0000 7f901e7fc640 1 --2- 172.21.15.7:0/3981613786 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f900c06b4d0 0x7f900c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:06.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.870+0000 7f901e7fc640 1 -- 172.21.15.7:0/3981613786 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f902408a140 con 0x7f90280b6a70 2024-04-25T09:55:06.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.870+0000 7f902d67c640 1 --2- 172.21.15.7:0/3981613786 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f900c06b4d0 0x7f900c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:06.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.871+0000 7f902d67c640 1 --2- 172.21.15.7:0/3981613786 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f900c06b4d0 0x7f900c06d990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9018034000 tx=0x7f901802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:06.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:06.875+0000 7f901e7fc640 1 -- 172.21.15.7:0/3981613786 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f902401f030 con 0x7f90280b6a70 2024-04-25T09:55:07.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.054+0000 7f90300e1640 1 -- 172.21.15.7:0/3981613786 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9028159280 con 0x7f90280b6a70 2024-04-25T09:55:07.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.054+0000 7f901e7fc640 1 -- 172.21.15.7:0/3981613786 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f902815fc00 con 0x7f90280b6a70 2024-04-25T09:55:07.057 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T09:55:07.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.056+0000 7f90300e1640 1 -- 172.21.15.7:0/3981613786 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f900c06b4d0 msgr2=0x7f900c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:07.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.056+0000 7f90300e1640 1 --2- 172.21.15.7:0/3981613786 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f900c06b4d0 0x7f900c06d990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9018034000 tx=0x7f901802e000 comp rx=0 tx=0).stop 2024-04-25T09:55:07.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.056+0000 7f90300e1640 1 -- 172.21.15.7:0/3981613786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90280b6a70 msgr2=0x7f9028157e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:07.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.056+0000 7f90300e1640 1 --2- 172.21.15.7:0/3981613786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90280b6a70 0x7f9028157e50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f902400b3f0 tx=0x7f902400b8b0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.056+0000 7f90300e1640 1 -- 172.21.15.7:0/3981613786 shutdown_connections 2024-04-25T09:55:07.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.056+0000 7f90300e1640 1 --2- 172.21.15.7:0/3981613786 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f900c06b4d0 0x7f900c06d990 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.056+0000 7f90300e1640 1 --2- 172.21.15.7:0/3981613786 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f902815db30 0x7f902815eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.056+0000 7f90300e1640 1 --2- 172.21.15.7:0/3981613786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90280ce680 0x7f902815e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.056+0000 7f90300e1640 1 --2- 172.21.15.7:0/3981613786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90280b6a70 0x7f9028157e50 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.056+0000 7f90300e1640 1 -- 172.21.15.7:0/3981613786 >> 172.21.15.7:0/3981613786 conn(0x7f90280728c0 msgr2=0x7f90280b7100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:07.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.056+0000 7f90300e1640 1 -- 172.21.15.7:0/3981613786 shutdown_connections 2024-04-25T09:55:07.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.056+0000 7f90300e1640 1 -- 172.21.15.7:0/3981613786 wait complete. 2024-04-25T09:55:07.069 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:55:07.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.170+0000 7f79adc88640 1 Processor -- start 2024-04-25T09:55:07.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.170+0000 7f79adc88640 1 -- start start 2024-04-25T09:55:07.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.171+0000 7f79adc88640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f79a80d2c40 0x7f79a80b9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:07.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.171+0000 7f79adc88640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a80b7ef0 con 0x7f79a80d0780 2024-04-25T09:55:07.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.171+0000 7f79adc88640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a80b81d0 con 0x7f79a80b68b0 2024-04-25T09:55:07.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.171+0000 7f79adc88640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a80b84b0 con 0x7f79a80d2c40 2024-04-25T09:55:07.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.171+0000 7f79a77fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f79a80d0780 0x7f79a80d0b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:57810/0 (socket says 172.21.15.7:57810) 2024-04-25T09:55:07.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.171+0000 7f79a77fe640 1 -- 172.21.15.7:0/89110039 learned_addr learned my addr 172.21.15.7:0/89110039 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:07.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.171+0000 7f79a67fc640 1 -- 172.21.15.7:0/89110039 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2346062703 0 0) 0x7f79a80b7ef0 con 0x7f79a80d0780 2024-04-25T09:55:07.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.171+0000 7f79a6ffd640 1 --2- 172.21.15.7:0/89110039 >> v2:172.21.15.55:3300/0 conn(0x7f79a80d2c40 0x7f79a80b9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:07.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.171+0000 7f79a67fc640 1 -- 172.21.15.7:0/89110039 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7990003520 con 0x7f79a80d0780 2024-04-25T09:55:07.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.171+0000 7f79a67fc640 1 -- 172.21.15.7:0/89110039 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3859787103 0 0) 0x7f7990003520 con 0x7f79a80d0780 2024-04-25T09:55:07.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.171+0000 7f79a67fc640 1 -- 172.21.15.7:0/89110039 >> v2:172.21.15.55:3300/0 conn(0x7f79a80d2c40 msgr2=0x7f79a80b9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:07.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.171+0000 7f79a67fc640 1 --2- 172.21.15.7:0/89110039 >> v2:172.21.15.55:3300/0 conn(0x7f79a80d2c40 0x7f79a80b9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.171+0000 7f79a67fc640 1 -- 172.21.15.7:0/89110039 >> v1:172.21.15.55:6789/0 conn(0x7f79a80b68b0 legacy=0x7f79a80b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:07.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.171+0000 7f79a67fc640 1 -- 172.21.15.7:0/89110039 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a80b8790 con 0x7f79a80d0780 2024-04-25T09:55:07.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.171+0000 7f79a67fc640 1 -- 172.21.15.7:0/89110039 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f7998001670 con 0x7f79a80d0780 2024-04-25T09:55:07.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.171+0000 7f79a67fc640 1 -- 172.21.15.7:0/89110039 >> v1:172.21.15.7:6789/0 conn(0x7f79a80d0780 legacy=0x7f79a80d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:07.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.171+0000 7f79a67fc640 1 --2- 172.21.15.7:0/89110039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79900039b0 0x7f7990003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:07.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.171+0000 7f79a67fc640 1 --2- 172.21.15.7:0/89110039 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7990004800 0x7f7990004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:07.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.172+0000 7f79a67fc640 1 --2- 172.21.15.7:0/89110039 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f79900051c0 0x7f799000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:07.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.172+0000 7f79a67fc640 1 -- 172.21.15.7:0/89110039 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a80b84b0 con 0x7f7990004800 2024-04-25T09:55:07.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.172+0000 7f79a67fc640 1 -- 172.21.15.7:0/89110039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799000c060 con 0x7f79900039b0 2024-04-25T09:55:07.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.172+0000 7f79a67fc640 1 -- 172.21.15.7:0/89110039 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799000c260 con 0x7f79900051c0 2024-04-25T09:55:07.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.172+0000 7f79a6ffd640 1 --2- 172.21.15.7:0/89110039 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7990004800 0x7f7990004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:07.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.172+0000 7f79a77fe640 1 --2- 172.21.15.7:0/89110039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79900039b0 0x7f7990003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:07.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.172+0000 7f79a7fff640 1 --2- 172.21.15.7:0/89110039 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f79900051c0 0x7f799000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:07.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.172+0000 7f79a6ffd640 1 -- 172.21.15.7:0/89110039 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f79900051c0 msgr2=0x7f799000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:07.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.172+0000 7f79a6ffd640 1 --2- 172.21.15.7:0/89110039 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f79900051c0 0x7f799000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.172+0000 7f79a6ffd640 1 -- 172.21.15.7:0/89110039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79900039b0 msgr2=0x7f7990003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:07.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.172+0000 7f79a6ffd640 1 --2- 172.21.15.7:0/89110039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79900039b0 0x7f7990003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.172+0000 7f79a6ffd640 1 -- 172.21.15.7:0/89110039 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7990003520 con 0x7f7990004800 2024-04-25T09:55:07.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.172+0000 7f79a7fff640 1 -- 172.21.15.7:0/89110039 reap_dead start 2024-04-25T09:55:07.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.172+0000 7f79a77fe640 1 --2- 172.21.15.7:0/89110039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79900039b0 0x7f7990003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:07.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.173+0000 7f79a6ffd640 1 --2- 172.21.15.7:0/89110039 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7990004800 0x7f7990004c80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f799c009ac0 tx=0x7f7990005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c4e8671dd80983c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:07.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.173+0000 7f79a67fc640 1 -- 172.21.15.7:0/89110039 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c036070 con 0x7f7990004800 2024-04-25T09:55:07.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.173+0000 7f79a67fc640 1 -- 172.21.15.7:0/89110039 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799c031400 con 0x7f7990004800 2024-04-25T09:55:07.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.173+0000 7f79a67fc640 1 -- 172.21.15.7:0/89110039 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c009690 con 0x7f7990004800 2024-04-25T09:55:07.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.173+0000 7f79adc88640 1 -- 172.21.15.7:0/89110039 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7990004800 msgr2=0x7f7990004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:07.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.173+0000 7f79adc88640 1 --2- 172.21.15.7:0/89110039 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7990004800 0x7f7990004c80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f799c009ac0 tx=0x7f7990005830 comp rx=0 tx=0).stop 2024-04-25T09:55:07.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.173+0000 7f79adc88640 1 -- 172.21.15.7:0/89110039 shutdown_connections 2024-04-25T09:55:07.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.173+0000 7f79adc88640 1 --2- 172.21.15.7:0/89110039 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7990004800 0x7f7990004c80 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.173+0000 7f79adc88640 1 -- 172.21.15.7:0/89110039 >> 172.21.15.7:0/89110039 conn(0x7f79a80726b0 msgr2=0x7f79a8072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:07.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.173+0000 7f79adc88640 1 -- 172.21.15.7:0/89110039 shutdown_connections 2024-04-25T09:55:07.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.173+0000 7f79adc88640 1 -- 172.21.15.7:0/89110039 wait complete. 2024-04-25T09:55:07.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.174+0000 7f79adc88640 1 Processor -- start 2024-04-25T09:55:07.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.175+0000 7f79adc88640 1 -- start start 2024-04-25T09:55:07.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.175+0000 7f79adc88640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7990004800 0x7f79a8153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:07.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.175+0000 7f79adc88640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f79a81553f0 0x7f79a80c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:07.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.175+0000 7f79adc88640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79a80c6600 0x7f79a80c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:07.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.175+0000 7f79adc88640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a8161330 con 0x7f7990004800 2024-04-25T09:55:07.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.175+0000 7f79adc88640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a81611b0 con 0x7f79a80c6600 2024-04-25T09:55:07.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.175+0000 7f79adc88640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a80d0b60 con 0x7f79a81553f0 2024-04-25T09:55:07.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.175+0000 7f79a77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7990004800 0x7f79a8153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:07.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.175+0000 7f79a77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7990004800 0x7f79a8153750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55590/0 (socket says 172.21.15.7:55590) 2024-04-25T09:55:07.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.176+0000 7f79a77fe640 1 -- 172.21.15.7:0/2091223138 learned_addr learned my addr 172.21.15.7:0/2091223138 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:07.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.176+0000 7f79a7fff640 1 --2- 172.21.15.7:0/2091223138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79a80c6600 0x7f79a80c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:07.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.176+0000 7f79a6ffd640 1 --2- 172.21.15.7:0/2091223138 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f79a81553f0 0x7f79a80c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:07.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.176+0000 7f79a77fe640 1 -- 172.21.15.7:0/2091223138 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f79a81553f0 msgr2=0x7f79a80c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:07.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.176+0000 7f79a77fe640 1 --2- 172.21.15.7:0/2091223138 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f79a81553f0 0x7f79a80c60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.176+0000 7f79a77fe640 1 -- 172.21.15.7:0/2091223138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79a80c6600 msgr2=0x7f79a80c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:07.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.176+0000 7f79a77fe640 1 --2- 172.21.15.7:0/2091223138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79a80c6600 0x7f79a80c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.176+0000 7f79a77fe640 1 -- 172.21.15.7:0/2091223138 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a80c94d0 con 0x7f7990004800 2024-04-25T09:55:07.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.176+0000 7f79a7fff640 1 --2- 172.21.15.7:0/2091223138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79a80c6600 0x7f79a80c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:07.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.176+0000 7f79a77fe640 1 --2- 172.21.15.7:0/2091223138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7990004800 0x7f79a8153750 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f799800e7b0 tx=0x7f799800ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:07.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.176+0000 7f798ffff640 1 -- 172.21.15.7:0/2091223138 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799800c660 con 0x7f7990004800 2024-04-25T09:55:07.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.176+0000 7f798ffff640 1 -- 172.21.15.7:0/2091223138 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7998018070 con 0x7f7990004800 2024-04-25T09:55:07.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.176+0000 7f798ffff640 1 -- 172.21.15.7:0/2091223138 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799800ca40 con 0x7f7990004800 2024-04-25T09:55:07.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.176+0000 7f79adc88640 1 -- 172.21.15.7:0/2091223138 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a80cab40 con 0x7f7990004800 2024-04-25T09:55:07.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.176+0000 7f79adc88640 1 -- 172.21.15.7:0/2091223138 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a8155850 con 0x7f7990004800 2024-04-25T09:55:07.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.177+0000 7f79adc88640 1 -- 172.21.15.7:0/2091223138 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a80685d0 con 0x7f7990004800 2024-04-25T09:55:07.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.178+0000 7f798ffff640 1 -- 172.21.15.7:0/2091223138 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f799800cbe0 con 0x7f7990004800 2024-04-25T09:55:07.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.178+0000 7f798ffff640 1 --2- 172.21.15.7:0/2091223138 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f799406b500 0x7f799406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:07.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.178+0000 7f798ffff640 1 -- 172.21.15.7:0/2091223138 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f7998089f90 con 0x7f7990004800 2024-04-25T09:55:07.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.178+0000 7f79a6ffd640 1 --2- 172.21.15.7:0/2091223138 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f799406b500 0x7f799406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:07.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.178+0000 7f79a6ffd640 1 --2- 172.21.15.7:0/2091223138 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f799406b500 0x7f799406d9c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f799c033000 tx=0x7f799c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:07.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.182+0000 7f798ffff640 1 -- 172.21.15.7:0/2091223138 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7998022250 con 0x7f7990004800 2024-04-25T09:55:07.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.365+0000 7f79adc88640 1 -- 172.21.15.7:0/2091223138 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f79a8068f60 con 0x7f7990004800 2024-04-25T09:55:07.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.366+0000 7f798ffff640 1 -- 172.21.15.7:0/2091223138 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7998058ad0 con 0x7f7990004800 2024-04-25T09:55:07.369 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:55:07.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.367+0000 7f79adc88640 1 -- 172.21.15.7:0/2091223138 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f799406b500 msgr2=0x7f799406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:07.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.367+0000 7f79adc88640 1 --2- 172.21.15.7:0/2091223138 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f799406b500 0x7f799406d9c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f799c033000 tx=0x7f799c008030 comp rx=0 tx=0).stop 2024-04-25T09:55:07.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.367+0000 7f79adc88640 1 -- 172.21.15.7:0/2091223138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7990004800 msgr2=0x7f79a8153750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:07.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.367+0000 7f79adc88640 1 --2- 172.21.15.7:0/2091223138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7990004800 0x7f79a8153750 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f799800e7b0 tx=0x7f799800ebb0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.367+0000 7f79adc88640 1 -- 172.21.15.7:0/2091223138 shutdown_connections 2024-04-25T09:55:07.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.367+0000 7f79adc88640 1 --2- 172.21.15.7:0/2091223138 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f799406b500 0x7f799406d9c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.367+0000 7f79adc88640 1 --2- 172.21.15.7:0/2091223138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79a80c6600 0x7f79a80c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.367+0000 7f79adc88640 1 --2- 172.21.15.7:0/2091223138 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f79a81553f0 0x7f79a80c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.367+0000 7f79adc88640 1 --2- 172.21.15.7:0/2091223138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7990004800 0x7f79a8153750 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.368+0000 7f79adc88640 1 -- 172.21.15.7:0/2091223138 >> 172.21.15.7:0/2091223138 conn(0x7f79a80726b0 msgr2=0x7f79a80cf1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:07.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.368+0000 7f79adc88640 1 -- 172.21.15.7:0/2091223138 shutdown_connections 2024-04-25T09:55:07.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.368+0000 7f79adc88640 1 -- 172.21.15.7:0/2091223138 wait complete. 2024-04-25T09:55:07.382 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:55:07.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.479+0000 7f7e1195c640 1 Processor -- start 2024-04-25T09:55:07.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.479+0000 7f7e1195c640 1 -- start start 2024-04-25T09:55:07.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.480+0000 7f7e1195c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7e0c15db00 0x7f7e0c0d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:07.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.480+0000 7f7e1195c640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e0c0d1e80 con 0x7f7e0c0b53b0 2024-04-25T09:55:07.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.480+0000 7f7e1195c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e0c162490 con 0x7f7e0c0ce2b0 2024-04-25T09:55:07.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.480+0000 7f7e1195c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c0b5930 con 0x7f7e0c15db00 2024-04-25T09:55:07.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.480+0000 7f7e0a7fc640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7e0c0b53b0 0x7f7e0c161670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:57824/0 (socket says 172.21.15.7:57824) 2024-04-25T09:55:07.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.480+0000 7f7e0a7fc640 1 -- 172.21.15.7:0/1960151354 learned_addr learned my addr 172.21.15.7:0/1960151354 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.480+0000 7f7e0affd640 1 --2- 172.21.15.7:0/1960151354 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7e0c15db00 0x7f7e0c0d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.480+0000 7f7e09ffb640 1 -- 172.21.15.7:0/1960151354 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2747891805 0 0) 0x7f7e0c0d1e80 con 0x7f7e0c0b53b0 2024-04-25T09:55:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.480+0000 7f7e09ffb640 1 -- 172.21.15.7:0/1960151354 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7df4003520 con 0x7f7e0c0b53b0 2024-04-25T09:55:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.480+0000 7f7e09ffb640 1 -- 172.21.15.7:0/1960151354 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1636615140 0 0) 0x7f7df4003520 con 0x7f7e0c0b53b0 2024-04-25T09:55:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.480+0000 7f7e0affd640 1 -- 172.21.15.7:0/1960151354 >> v1:172.21.15.55:6789/0 conn(0x7f7e0c0ce2b0 legacy=0x7f7e0c161d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.480+0000 7f7e0affd640 1 -- 172.21.15.7:0/1960151354 >> v1:172.21.15.7:6789/0 conn(0x7f7e0c0b53b0 legacy=0x7f7e0c161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.480+0000 7f7e0affd640 1 -- 172.21.15.7:0/1960151354 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c0b5c10 con 0x7f7e0c15db00 2024-04-25T09:55:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.481+0000 7f7e0affd640 1 --2- 172.21.15.7:0/1960151354 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7e0c15db00 0x7f7e0c0d0340 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc0097d0 tx=0x7f7dfc02a0b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79c3c6ca6152db2e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.481+0000 7f7e09ffb640 1 -- 172.21.15.7:0/1960151354 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc037070 con 0x7f7e0c15db00 2024-04-25T09:55:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.481+0000 7f7e09ffb640 1 -- 172.21.15.7:0/1960151354 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dfc02ab40 con 0x7f7e0c15db00 2024-04-25T09:55:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.481+0000 7f7e09ffb640 1 -- 172.21.15.7:0/1960151354 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00001670 con 0x7f7e0c15db00 2024-04-25T09:55:07.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.482+0000 7f7e1195c640 1 -- 172.21.15.7:0/1960151354 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7e0c15db00 msgr2=0x7f7e0c0d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:07.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.482+0000 7f7e1195c640 1 --2- 172.21.15.7:0/1960151354 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7e0c15db00 0x7f7e0c0d0340 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc0097d0 tx=0x7f7dfc02a0b0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.482+0000 7f7e1195c640 1 -- 172.21.15.7:0/1960151354 shutdown_connections 2024-04-25T09:55:07.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.482+0000 7f7e1195c640 1 --2- 172.21.15.7:0/1960151354 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7e0c15db00 0x7f7e0c0d0340 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.482+0000 7f7e1195c640 1 -- 172.21.15.7:0/1960151354 >> 172.21.15.7:0/1960151354 conn(0x7f7e0c072290 msgr2=0x7f7e0c0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:07.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.482+0000 7f7e1195c640 1 -- 172.21.15.7:0/1960151354 shutdown_connections 2024-04-25T09:55:07.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.482+0000 7f7e1195c640 1 -- 172.21.15.7:0/1960151354 wait complete. 2024-04-25T09:55:07.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.483+0000 7f7e1195c640 1 Processor -- start 2024-04-25T09:55:07.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.483+0000 7f7e1195c640 1 -- start start 2024-04-25T09:55:07.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.484+0000 7f7e1195c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e0c0b53b0 0x7f7e0c15bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:07.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.484+0000 7f7e1195c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e0c0ce2b0 0x7f7e0c15c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:07.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.484+0000 7f7e1195c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7e0c15db00 0x7f7e0c15c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:07.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.484+0000 7f7e1195c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c0b61d0 con 0x7f7e0c0ce2b0 2024-04-25T09:55:07.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.484+0000 7f7e1195c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c15dee0 con 0x7f7e0c0b53b0 2024-04-25T09:55:07.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.484+0000 7f7e1195c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c0d3660 con 0x7f7e0c15db00 2024-04-25T09:55:07.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.484+0000 7f7e0a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e0c0ce2b0 0x7f7e0c15c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:07.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.484+0000 7f7e0a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e0c0ce2b0 0x7f7e0c15c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55592/0 (socket says 172.21.15.7:55592) 2024-04-25T09:55:07.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.484+0000 7f7e0a7fc640 1 -- 172.21.15.7:0/3938801581 learned_addr learned my addr 172.21.15.7:0/3938801581 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:07.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.484+0000 7f7e0affd640 1 --2- 172.21.15.7:0/3938801581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e0c0b53b0 0x7f7e0c15bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:07.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.484+0000 7f7e0b7fe640 1 --2- 172.21.15.7:0/3938801581 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7e0c15db00 0x7f7e0c15c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:07.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.485+0000 7f7e0a7fc640 1 -- 172.21.15.7:0/3938801581 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7e0c15db00 msgr2=0x7f7e0c15c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:07.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.485+0000 7f7e0a7fc640 1 --2- 172.21.15.7:0/3938801581 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7e0c15db00 0x7f7e0c15c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.485+0000 7f7e0a7fc640 1 -- 172.21.15.7:0/3938801581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e0c0b53b0 msgr2=0x7f7e0c15bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:07.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.485+0000 7f7e0a7fc640 1 --2- 172.21.15.7:0/3938801581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e0c0b53b0 0x7f7e0c15bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.485+0000 7f7e0a7fc640 1 -- 172.21.15.7:0/3938801581 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c15aea0 con 0x7f7e0c0ce2b0 2024-04-25T09:55:07.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.485+0000 7f7e0a7fc640 1 --2- 172.21.15.7:0/3938801581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e0c0ce2b0 0x7f7e0c15c440 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000c4b0 tx=0x7f7e0000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:07.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.485+0000 7f7df3fff640 1 -- 172.21.15.7:0/3938801581 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00018070 con 0x7f7e0c0ce2b0 2024-04-25T09:55:07.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.485+0000 7f7df3fff640 1 -- 172.21.15.7:0/3938801581 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e000074e0 con 0x7f7e0c0ce2b0 2024-04-25T09:55:07.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.485+0000 7f7e1195c640 1 -- 172.21.15.7:0/3938801581 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e0c15b140 con 0x7f7e0c0ce2b0 2024-04-25T09:55:07.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.485+0000 7f7df3fff640 1 -- 172.21.15.7:0/3938801581 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00004a20 con 0x7f7e0c0ce2b0 2024-04-25T09:55:07.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.485+0000 7f7e1195c640 1 -- 172.21.15.7:0/3938801581 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e0c15b700 con 0x7f7e0c0ce2b0 2024-04-25T09:55:07.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.486+0000 7f7e1195c640 1 -- 172.21.15.7:0/3938801581 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e0c0ca760 con 0x7f7e0c0ce2b0 2024-04-25T09:55:07.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.486+0000 7f7df3fff640 1 -- 172.21.15.7:0/3938801581 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7e0001b070 con 0x7f7e0c0ce2b0 2024-04-25T09:55:07.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.487+0000 7f7df3fff640 1 --2- 172.21.15.7:0/3938801581 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7df806b4d0 0x7f7df806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:07.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.487+0000 7f7df3fff640 1 -- 172.21.15.7:0/3938801581 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f7e000897d0 con 0x7f7e0c0ce2b0 2024-04-25T09:55:07.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.487+0000 7f7e0affd640 1 --2- 172.21.15.7:0/3938801581 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7df806b4d0 0x7f7df806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:07.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.487+0000 7f7e0affd640 1 --2- 172.21.15.7:0/3938801581 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7df806b4d0 0x7f7df806d990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc034000 tx=0x7f7dfc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:07.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.491+0000 7f7df3fff640 1 -- 172.21.15.7:0/3938801581 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7e0c0ca760 con 0x7f7e0c0ce2b0 2024-04-25T09:55:07.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.677+0000 7f7e1195c640 1 -- 172.21.15.7:0/3938801581 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e0c068fd0 con 0x7f7e0c0ce2b0 2024-04-25T09:55:07.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.678+0000 7f7df3fff640 1 -- 172.21.15.7:0/3938801581 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18418 (secure 0 0 0) 0x7f7e00057cb0 con 0x7f7e0c0ce2b0 2024-04-25T09:55:07.681 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:07.681 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:54:32.606761+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:54:26.011833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:54:26.535536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:54:30.264996+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:55:07.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.680+0000 7f7e1195c640 1 -- 172.21.15.7:0/3938801581 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7df806b4d0 msgr2=0x7f7df806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:07.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.680+0000 7f7e1195c640 1 --2- 172.21.15.7:0/3938801581 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7df806b4d0 0x7f7df806d990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc034000 tx=0x7f7dfc02e000 comp rx=0 tx=0).stop 2024-04-25T09:55:07.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.680+0000 7f7e1195c640 1 -- 172.21.15.7:0/3938801581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e0c0ce2b0 msgr2=0x7f7e0c15c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:07.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.680+0000 7f7e1195c640 1 --2- 172.21.15.7:0/3938801581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e0c0ce2b0 0x7f7e0c15c440 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000c4b0 tx=0x7f7e0000c970 comp rx=0 tx=0).stop 2024-04-25T09:55:07.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.680+0000 7f7e1195c640 1 -- 172.21.15.7:0/3938801581 shutdown_connections 2024-04-25T09:55:07.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.680+0000 7f7e1195c640 1 --2- 172.21.15.7:0/3938801581 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7df806b4d0 0x7f7df806d990 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.680+0000 7f7e1195c640 1 --2- 172.21.15.7:0/3938801581 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7e0c15db00 0x7f7e0c15c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.680+0000 7f7e1195c640 1 --2- 172.21.15.7:0/3938801581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7e0c0ce2b0 0x7f7e0c15c440 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.680+0000 7f7e1195c640 1 --2- 172.21.15.7:0/3938801581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e0c0b53b0 0x7f7e0c15bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.680+0000 7f7e1195c640 1 -- 172.21.15.7:0/3938801581 >> 172.21.15.7:0/3938801581 conn(0x7f7e0c072290 msgr2=0x7f7e0c072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:07.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.680+0000 7f7e1195c640 1 -- 172.21.15.7:0/3938801581 shutdown_connections 2024-04-25T09:55:07.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.680+0000 7f7e1195c640 1 -- 172.21.15.7:0/3938801581 wait complete. 2024-04-25T09:55:07.694 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:54:26.011833+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:54:26.535536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:54:30.264996+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:55:07.695 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:55:07.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.796+0000 7fdaddee1640 1 Processor -- start 2024-04-25T09:55:07.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.796+0000 7fdaddee1640 1 -- start start 2024-04-25T09:55:07.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.797+0000 7fdaddee1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdad80d2c40 0x7fdad80b9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:07.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.797+0000 7fdaddee1640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad80b7ef0 con 0x7fdad80d0780 2024-04-25T09:55:07.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.797+0000 7fdaddee1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad80b81d0 con 0x7fdad80b68b0 2024-04-25T09:55:07.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.797+0000 7fdaddee1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad80b84b0 con 0x7fdad80d2c40 2024-04-25T09:55:07.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.797+0000 7fdad77fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fdad80d0780 0x7fdad80d0b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:57826/0 (socket says 172.21.15.7:57826) 2024-04-25T09:55:07.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.797+0000 7fdad77fe640 1 -- 172.21.15.7:0/2080474783 learned_addr learned my addr 172.21.15.7:0/2080474783 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:07.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.797+0000 7fdad6ffd640 1 --2- 172.21.15.7:0/2080474783 >> v2:172.21.15.55:3300/0 conn(0x7fdad80d2c40 0x7fdad80b9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:07.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.797+0000 7fdad67fc640 1 -- 172.21.15.7:0/2080474783 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1702233865 0 0) 0x7fdad80b7ef0 con 0x7fdad80d0780 2024-04-25T09:55:07.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.797+0000 7fdad67fc640 1 -- 172.21.15.7:0/2080474783 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdac0003520 con 0x7fdad80d0780 2024-04-25T09:55:07.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.797+0000 7fdad67fc640 1 -- 172.21.15.7:0/2080474783 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2835201101 0 0) 0x7fdac0003520 con 0x7fdad80d0780 2024-04-25T09:55:07.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.797+0000 7fdad67fc640 1 -- 172.21.15.7:0/2080474783 >> v2:172.21.15.55:3300/0 conn(0x7fdad80d2c40 msgr2=0x7fdad80b9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:07.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.797+0000 7fdad67fc640 1 --2- 172.21.15.7:0/2080474783 >> v2:172.21.15.55:3300/0 conn(0x7fdad80d2c40 0x7fdad80b9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.797+0000 7fdad67fc640 1 -- 172.21.15.7:0/2080474783 >> v1:172.21.15.55:6789/0 conn(0x7fdad80b68b0 legacy=0x7fdad80b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:07.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.797+0000 7fdad67fc640 1 -- 172.21.15.7:0/2080474783 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad80b8790 con 0x7fdad80d0780 2024-04-25T09:55:07.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.797+0000 7fdad67fc640 1 -- 172.21.15.7:0/2080474783 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fdac8001670 con 0x7fdad80d0780 2024-04-25T09:55:07.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.797+0000 7fdad67fc640 1 -- 172.21.15.7:0/2080474783 >> v1:172.21.15.7:6789/0 conn(0x7fdad80d0780 legacy=0x7fdad80d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:07.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.797+0000 7fdad67fc640 1 --2- 172.21.15.7:0/2080474783 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdac00039b0 0x7fdac0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:07.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.797+0000 7fdad67fc640 1 --2- 172.21.15.7:0/2080474783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdac0004800 0x7fdac0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:07.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.797+0000 7fdad67fc640 1 --2- 172.21.15.7:0/2080474783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdac00051c0 0x7fdac000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:07.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.797+0000 7fdad67fc640 1 -- 172.21.15.7:0/2080474783 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad80b84b0 con 0x7fdac0004800 2024-04-25T09:55:07.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.797+0000 7fdad67fc640 1 -- 172.21.15.7:0/2080474783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac000c060 con 0x7fdac00051c0 2024-04-25T09:55:07.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.797+0000 7fdad67fc640 1 -- 172.21.15.7:0/2080474783 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac000c260 con 0x7fdac00039b0 2024-04-25T09:55:07.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.798+0000 7fdad6ffd640 1 --2- 172.21.15.7:0/2080474783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdac0004800 0x7fdac0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:07.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.798+0000 7fdad77fe640 1 --2- 172.21.15.7:0/2080474783 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdac00039b0 0x7fdac0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:07.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.798+0000 7fdad7fff640 1 --2- 172.21.15.7:0/2080474783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdac00051c0 0x7fdac000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:07.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.798+0000 7fdad6ffd640 1 -- 172.21.15.7:0/2080474783 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdac00039b0 msgr2=0x7fdac0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:07.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.798+0000 7fdad6ffd640 1 --2- 172.21.15.7:0/2080474783 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdac00039b0 0x7fdac0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.798+0000 7fdad6ffd640 1 -- 172.21.15.7:0/2080474783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdac00051c0 msgr2=0x7fdac000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:07.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.798+0000 7fdad6ffd640 1 --2- 172.21.15.7:0/2080474783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdac00051c0 0x7fdac000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.798+0000 7fdad6ffd640 1 -- 172.21.15.7:0/2080474783 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac0003520 con 0x7fdac0004800 2024-04-25T09:55:07.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.798+0000 7fdad7fff640 1 --2- 172.21.15.7:0/2080474783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdac00051c0 0x7fdac000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:07.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.798+0000 7fdad7fff640 1 -- 172.21.15.7:0/2080474783 reap_dead start 2024-04-25T09:55:07.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.799+0000 7fdad6ffd640 1 --2- 172.21.15.7:0/2080474783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdac0004800 0x7fdac0004c80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdacc009ac0 tx=0x7fdac0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=228ca2ef74080cd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:07.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.799+0000 7fdad67fc640 1 -- 172.21.15.7:0/2080474783 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc036070 con 0x7fdac0004800 2024-04-25T09:55:07.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.799+0000 7fdad67fc640 1 -- 172.21.15.7:0/2080474783 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc031400 con 0x7fdac0004800 2024-04-25T09:55:07.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.799+0000 7fdad67fc640 1 -- 172.21.15.7:0/2080474783 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc009690 con 0x7fdac0004800 2024-04-25T09:55:07.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.799+0000 7fdaddee1640 1 -- 172.21.15.7:0/2080474783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdac0004800 msgr2=0x7fdac0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:07.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.799+0000 7fdaddee1640 1 --2- 172.21.15.7:0/2080474783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdac0004800 0x7fdac0004c80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdacc009ac0 tx=0x7fdac0005830 comp rx=0 tx=0).stop 2024-04-25T09:55:07.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.799+0000 7fdaddee1640 1 -- 172.21.15.7:0/2080474783 shutdown_connections 2024-04-25T09:55:07.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.799+0000 7fdaddee1640 1 --2- 172.21.15.7:0/2080474783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdac0004800 0x7fdac0004c80 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.799+0000 7fdaddee1640 1 -- 172.21.15.7:0/2080474783 >> 172.21.15.7:0/2080474783 conn(0x7fdad80726b0 msgr2=0x7fdad8072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:07.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.799+0000 7fdaddee1640 1 -- 172.21.15.7:0/2080474783 shutdown_connections 2024-04-25T09:55:07.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.799+0000 7fdaddee1640 1 -- 172.21.15.7:0/2080474783 wait complete. 2024-04-25T09:55:07.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.800+0000 7fdaddee1640 1 Processor -- start 2024-04-25T09:55:07.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.801+0000 7fdaddee1640 1 -- start start 2024-04-25T09:55:07.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.801+0000 7fdaddee1640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdac0004800 0x7fdad80cd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:07.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.801+0000 7fdaddee1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdad814dbd0 0x7fdad80cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:07.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.801+0000 7fdaddee1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad80cbef0 0x7fdad806c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:07.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.801+0000 7fdaddee1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad8161330 con 0x7fdad814dbd0 2024-04-25T09:55:07.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.801+0000 7fdaddee1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad81611b0 con 0x7fdad80cbef0 2024-04-25T09:55:07.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.801+0000 7fdaddee1640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad80d0b60 con 0x7fdac0004800 2024-04-25T09:55:07.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.801+0000 7fdad6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdad814dbd0 0x7fdad80cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:07.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.801+0000 7fdad6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdad814dbd0 0x7fdad80cb9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55602/0 (socket says 172.21.15.7:55602) 2024-04-25T09:55:07.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.801+0000 7fdad6ffd640 1 -- 172.21.15.7:0/3040188945 learned_addr learned my addr 172.21.15.7:0/3040188945 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:07.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.802+0000 7fdad77fe640 1 --2- 172.21.15.7:0/3040188945 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdac0004800 0x7fdad80cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:07.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.802+0000 7fdad7fff640 1 --2- 172.21.15.7:0/3040188945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad80cbef0 0x7fdad806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:07.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.802+0000 7fdad6ffd640 1 -- 172.21.15.7:0/3040188945 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdac0004800 msgr2=0x7fdad80cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:07.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.802+0000 7fdad6ffd640 1 --2- 172.21.15.7:0/3040188945 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdac0004800 0x7fdad80cd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.802+0000 7fdad6ffd640 1 -- 172.21.15.7:0/3040188945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad80cbef0 msgr2=0x7fdad806c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:07.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.802+0000 7fdad6ffd640 1 --2- 172.21.15.7:0/3040188945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad80cbef0 0x7fdad806c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.802+0000 7fdad6ffd640 1 -- 172.21.15.7:0/3040188945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad80cc3a0 con 0x7fdad814dbd0 2024-04-25T09:55:07.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.802+0000 7fdad7fff640 1 --2- 172.21.15.7:0/3040188945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad80cbef0 0x7fdad806c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:07.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.802+0000 7fdad6ffd640 1 --2- 172.21.15.7:0/3040188945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdad814dbd0 0x7fdad80cb9b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdacc009be0 tx=0x7fdacc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:07.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.802+0000 7fdabffff640 1 -- 172.21.15.7:0/3040188945 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc03f020 con 0x7fdad814dbd0 2024-04-25T09:55:07.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.802+0000 7fdabffff640 1 -- 172.21.15.7:0/3040188945 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc037040 con 0x7fdad814dbd0 2024-04-25T09:55:07.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.802+0000 7fdaddee1640 1 -- 172.21.15.7:0/3040188945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad80cc680 con 0x7fdad814dbd0 2024-04-25T09:55:07.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.802+0000 7fdabffff640 1 -- 172.21.15.7:0/3040188945 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc036070 con 0x7fdad814dbd0 2024-04-25T09:55:07.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.802+0000 7fdaddee1640 1 -- 172.21.15.7:0/3040188945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad80ccc40 con 0x7fdad814dbd0 2024-04-25T09:55:07.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.803+0000 7fdaddee1640 1 -- 172.21.15.7:0/3040188945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad80685d0 con 0x7fdad814dbd0 2024-04-25T09:55:07.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.804+0000 7fdabffff640 1 -- 172.21.15.7:0/3040188945 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdacc042020 con 0x7fdad814dbd0 2024-04-25T09:55:07.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.804+0000 7fdabffff640 1 --2- 172.21.15.7:0/3040188945 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdac406b4d0 0x7fdac406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:07.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.804+0000 7fdabffff640 1 -- 172.21.15.7:0/3040188945 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fdacc0aa510 con 0x7fdad814dbd0 2024-04-25T09:55:07.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.804+0000 7fdad77fe640 1 --2- 172.21.15.7:0/3040188945 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdac406b4d0 0x7fdac406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:07.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.804+0000 7fdad77fe640 1 --2- 172.21.15.7:0/3040188945 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdac406b4d0 0x7fdac406d990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdac8001eb0 tx=0x7fdac8001c30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:07.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.808+0000 7fdabffff640 1 -- 172.21.15.7:0/3040188945 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdacc049030 con 0x7fdad814dbd0 2024-04-25T09:55:07.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.987+0000 7fdaddee1640 1 -- 172.21.15.7:0/3040188945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdad8072a90 con 0x7fdad814dbd0 2024-04-25T09:55:07.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.988+0000 7fdabffff640 1 -- 172.21.15.7:0/3040188945 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdacc078b50 con 0x7fdad814dbd0 2024-04-25T09:55:07.991 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T09:55:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.990+0000 7fdaddee1640 1 -- 172.21.15.7:0/3040188945 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdac406b4d0 msgr2=0x7fdac406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.990+0000 7fdaddee1640 1 --2- 172.21.15.7:0/3040188945 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdac406b4d0 0x7fdac406d990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdac8001eb0 tx=0x7fdac8001c30 comp rx=0 tx=0).stop 2024-04-25T09:55:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.990+0000 7fdaddee1640 1 -- 172.21.15.7:0/3040188945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdad814dbd0 msgr2=0x7fdad80cb9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.990+0000 7fdaddee1640 1 --2- 172.21.15.7:0/3040188945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdad814dbd0 0x7fdad80cb9b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdacc009be0 tx=0x7fdacc004730 comp rx=0 tx=0).stop 2024-04-25T09:55:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.990+0000 7fdaddee1640 1 -- 172.21.15.7:0/3040188945 shutdown_connections 2024-04-25T09:55:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.990+0000 7fdaddee1640 1 --2- 172.21.15.7:0/3040188945 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdac406b4d0 0x7fdac406d990 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.990+0000 7fdaddee1640 1 --2- 172.21.15.7:0/3040188945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad80cbef0 0x7fdad806c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.990+0000 7fdaddee1640 1 --2- 172.21.15.7:0/3040188945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdad814dbd0 0x7fdad80cb9b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.990+0000 7fdaddee1640 1 --2- 172.21.15.7:0/3040188945 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdac0004800 0x7fdad80cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.990+0000 7fdaddee1640 1 -- 172.21.15.7:0/3040188945 >> 172.21.15.7:0/3040188945 conn(0x7fdad80726b0 msgr2=0x7fdad80ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:07.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.990+0000 7fdaddee1640 1 -- 172.21.15.7:0/3040188945 shutdown_connections 2024-04-25T09:55:07.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:07.990+0000 7fdaddee1640 1 -- 172.21.15.7:0/3040188945 wait complete. 2024-04-25T09:55:08.004 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:55:08.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.105+0000 7faa4b4b3640 1 Processor -- start 2024-04-25T09:55:08.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.105+0000 7faa4b4b3640 1 -- start start 2024-04-25T09:55:08.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.106+0000 7faa4b4b3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faa44071550 0x7faa440719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:08.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.106+0000 7faa4b4b3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faa440ad1d0 0x7faa440ad660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:08.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.106+0000 7faa4b4b3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa4406ea60 con 0x7faa441475e0 2024-04-25T09:55:08.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.106+0000 7faa4b4b3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa44071f00 con 0x7faa44071550 2024-04-25T09:55:08.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.106+0000 7faa4b4b3640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa440acd40 con 0x7faa440ad1d0 2024-04-25T09:55:08.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.106+0000 7faa49a50640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faa440ad1d0 0x7faa440ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:08.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.106+0000 7faa48a4e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faa44071550 0x7faa440719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:08.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.106+0000 7faa49a50640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faa440ad1d0 0x7faa440ad660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:38584/0 (socket says 172.21.15.7:38584) 2024-04-25T09:55:08.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.106+0000 7faa49a50640 1 -- 172.21.15.7:0/4154886902 learned_addr learned my addr 172.21.15.7:0/4154886902 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:08.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.106+0000 7faa48a4e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faa44071550 0x7faa440719c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:37648/0 (socket says 172.21.15.7:37648) 2024-04-25T09:55:08.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.107+0000 7faa49a50640 1 -- 172.21.15.7:0/4154886902 >> v2:172.21.15.55:3300/0 conn(0x7faa44071550 msgr2=0x7faa440719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:08.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.107+0000 7faa49a50640 1 --2- 172.21.15.7:0/4154886902 >> v2:172.21.15.55:3300/0 conn(0x7faa44071550 0x7faa440719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.107+0000 7faa49a50640 1 -- 172.21.15.7:0/4154886902 >> v1:172.21.15.55:6789/0 conn(0x7faa441475e0 legacy=0x7faa4406dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:08.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.107+0000 7faa49a50640 1 -- 172.21.15.7:0/4154886902 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4406ed40 con 0x7faa440ad1d0 2024-04-25T09:55:08.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.107+0000 7faa49a50640 1 --2- 172.21.15.7:0/4154886902 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faa440ad1d0 0x7faa440ad660 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faa34009e50 tx=0x7faa3402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82e7b127e6a2bdbc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:08.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.108+0000 7faa43fff640 1 -- 172.21.15.7:0/4154886902 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa34036070 con 0x7faa440ad1d0 2024-04-25T09:55:08.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.108+0000 7faa43fff640 1 -- 172.21.15.7:0/4154886902 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa34031600 con 0x7faa440ad1d0 2024-04-25T09:55:08.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.108+0000 7faa43fff640 1 -- 172.21.15.7:0/4154886902 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa340319d0 con 0x7faa440ad1d0 2024-04-25T09:55:08.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.108+0000 7faa4b4b3640 1 -- 172.21.15.7:0/4154886902 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faa440ad1d0 msgr2=0x7faa440ad660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:08.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.108+0000 7faa4b4b3640 1 --2- 172.21.15.7:0/4154886902 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faa440ad1d0 0x7faa440ad660 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faa34009e50 tx=0x7faa3402a710 comp rx=0 tx=0).stop 2024-04-25T09:55:08.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.108+0000 7faa4b4b3640 1 -- 172.21.15.7:0/4154886902 shutdown_connections 2024-04-25T09:55:08.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.108+0000 7faa4b4b3640 1 --2- 172.21.15.7:0/4154886902 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faa440ad1d0 0x7faa440ad660 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.108+0000 7faa4b4b3640 1 --2- 172.21.15.7:0/4154886902 >> v2:172.21.15.55:3300/0 conn(0x7faa44071550 0x7faa440719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.108+0000 7faa4b4b3640 1 -- 172.21.15.7:0/4154886902 >> 172.21.15.7:0/4154886902 conn(0x7faa440b16d0 msgr2=0x7faa440b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:08.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.108+0000 7faa4b4b3640 1 -- 172.21.15.7:0/4154886902 shutdown_connections 2024-04-25T09:55:08.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.108+0000 7faa4b4b3640 1 -- 172.21.15.7:0/4154886902 wait complete. 2024-04-25T09:55:08.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.109+0000 7faa4b4b3640 1 Processor -- start 2024-04-25T09:55:08.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.109+0000 7faa4b4b3640 1 -- start start 2024-04-25T09:55:08.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.110+0000 7faa4b4b3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faa44071550 0x7faa4415d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:08.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.110+0000 7faa4b4b3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa440ad1d0 0x7faa441e8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:08.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.110+0000 7faa4b4b3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa441475e0 0x7faa441e8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:08.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.110+0000 7faa4b4b3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa440724c0 con 0x7faa440ad1d0 2024-04-25T09:55:08.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.110+0000 7faa4b4b3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4406f300 con 0x7faa441475e0 2024-04-25T09:55:08.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.110+0000 7faa4b4b3640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4406e6d0 con 0x7faa44071550 2024-04-25T09:55:08.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.110+0000 7faa48a4e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa440ad1d0 0x7faa441e8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:08.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.110+0000 7faa48a4e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa440ad1d0 0x7faa441e8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55616/0 (socket says 172.21.15.7:55616) 2024-04-25T09:55:08.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.110+0000 7faa48a4e640 1 -- 172.21.15.7:0/1628700576 learned_addr learned my addr 172.21.15.7:0/1628700576 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:08.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.110+0000 7faa4924f640 1 --2- 172.21.15.7:0/1628700576 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faa44071550 0x7faa4415d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:08.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.110+0000 7faa49a50640 1 --2- 172.21.15.7:0/1628700576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa441475e0 0x7faa441e8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:08.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.111+0000 7faa48a4e640 1 -- 172.21.15.7:0/1628700576 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faa44071550 msgr2=0x7faa4415d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:08.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.111+0000 7faa48a4e640 1 --2- 172.21.15.7:0/1628700576 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faa44071550 0x7faa4415d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.111+0000 7faa48a4e640 1 -- 172.21.15.7:0/1628700576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa441475e0 msgr2=0x7faa441e8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:08.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.111+0000 7faa48a4e640 1 --2- 172.21.15.7:0/1628700576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa441475e0 0x7faa441e8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.111+0000 7faa48a4e640 1 -- 172.21.15.7:0/1628700576 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa441e60a0 con 0x7faa440ad1d0 2024-04-25T09:55:08.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.111+0000 7faa48a4e640 1 --2- 172.21.15.7:0/1628700576 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa440ad1d0 0x7faa441e8970 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7faa3800e9b0 tx=0x7faa3800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:08.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.111+0000 7faa41ffb640 1 -- 172.21.15.7:0/1628700576 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa38017070 con 0x7faa440ad1d0 2024-04-25T09:55:08.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.111+0000 7faa41ffb640 1 -- 172.21.15.7:0/1628700576 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3800c9a0 con 0x7faa440ad1d0 2024-04-25T09:55:08.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.111+0000 7faa4b4b3640 1 -- 172.21.15.7:0/1628700576 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa441e6380 con 0x7faa440ad1d0 2024-04-25T09:55:08.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.111+0000 7faa41ffb640 1 -- 172.21.15.7:0/1628700576 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3800cd90 con 0x7faa440ad1d0 2024-04-25T09:55:08.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.111+0000 7faa4b4b3640 1 -- 172.21.15.7:0/1628700576 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa441e6940 con 0x7faa440ad1d0 2024-04-25T09:55:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.112+0000 7faa4b4b3640 1 -- 172.21.15.7:0/1628700576 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa44068f60 con 0x7faa440ad1d0 2024-04-25T09:55:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.113+0000 7faa41ffb640 1 -- 172.21.15.7:0/1628700576 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faa3801a070 con 0x7faa440ad1d0 2024-04-25T09:55:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.113+0000 7faa41ffb640 1 --2- 172.21.15.7:0/1628700576 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faa3006b4d0 0x7faa3006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.113+0000 7faa41ffb640 1 -- 172.21.15.7:0/1628700576 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7faa3808a870 con 0x7faa440ad1d0 2024-04-25T09:55:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.113+0000 7faa4924f640 1 --2- 172.21.15.7:0/1628700576 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faa3006b4d0 0x7faa3006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.114+0000 7faa4924f640 1 --2- 172.21.15.7:0/1628700576 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faa3006b4d0 0x7faa3006d990 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faa3c0016e0 tx=0x7faa3c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:08.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.117+0000 7faa41ffb640 1 -- 172.21.15.7:0/1628700576 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faa38058d60 con 0x7faa440ad1d0 2024-04-25T09:55:08.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.299+0000 7faa4b4b3640 1 -- 172.21.15.7:0/1628700576 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faa440ae840 con 0x7faa440ad1d0 2024-04-25T09:55:08.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.299+0000 7faa41ffb640 1 -- 172.21.15.7:0/1628700576 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7faa3805ce00 con 0x7faa440ad1d0 2024-04-25T09:55:08.302 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:55:08.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.301+0000 7faa4b4b3640 1 -- 172.21.15.7:0/1628700576 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faa3006b4d0 msgr2=0x7faa3006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:08.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.301+0000 7faa4b4b3640 1 --2- 172.21.15.7:0/1628700576 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faa3006b4d0 0x7faa3006d990 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faa3c0016e0 tx=0x7faa3c009040 comp rx=0 tx=0).stop 2024-04-25T09:55:08.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.301+0000 7faa4b4b3640 1 -- 172.21.15.7:0/1628700576 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa440ad1d0 msgr2=0x7faa441e8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:08.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.301+0000 7faa4b4b3640 1 --2- 172.21.15.7:0/1628700576 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa440ad1d0 0x7faa441e8970 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7faa3800e9b0 tx=0x7faa3800ee70 comp rx=0 tx=0).stop 2024-04-25T09:55:08.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.301+0000 7faa4b4b3640 1 -- 172.21.15.7:0/1628700576 shutdown_connections 2024-04-25T09:55:08.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.301+0000 7faa4b4b3640 1 --2- 172.21.15.7:0/1628700576 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faa3006b4d0 0x7faa3006d990 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.301+0000 7faa4b4b3640 1 --2- 172.21.15.7:0/1628700576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa441475e0 0x7faa441e8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.301+0000 7faa4b4b3640 1 --2- 172.21.15.7:0/1628700576 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa440ad1d0 0x7faa441e8970 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.301+0000 7faa4b4b3640 1 --2- 172.21.15.7:0/1628700576 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faa44071550 0x7faa4415d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.301+0000 7faa4b4b3640 1 -- 172.21.15.7:0/1628700576 >> 172.21.15.7:0/1628700576 conn(0x7faa440b16d0 msgr2=0x7faa440ae130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:08.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.301+0000 7faa4b4b3640 1 -- 172.21.15.7:0/1628700576 shutdown_connections 2024-04-25T09:55:08.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.301+0000 7faa4b4b3640 1 -- 172.21.15.7:0/1628700576 wait complete. 2024-04-25T09:55:08.315 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:55:08.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.416+0000 7fab8bc46640 1 Processor -- start 2024-04-25T09:55:08.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.416+0000 7fab8bc46640 1 -- start start 2024-04-25T09:55:08.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.417+0000 7fab8bc46640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab8415d990 0x7fab840b1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.417+0000 7fab8bc46640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fab840b29c0 0x7fab840d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.417+0000 7fab8bc46640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab840cbcb0 con 0x7fab840d1ac0 2024-04-25T09:55:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.417+0000 7fab8bc46640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab840b1df0 con 0x7fab840b29c0 2024-04-25T09:55:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.417+0000 7fab8bc46640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab840b20d0 con 0x7fab8415d990 2024-04-25T09:55:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.417+0000 7fab891e1640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fab840b29c0 0x7fab840d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.417+0000 7fab891e1640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fab840b29c0 0x7fab840d1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55628/0 (socket says 172.21.15.7:55628) 2024-04-25T09:55:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.417+0000 7fab891e1640 1 -- 172.21.15.7:0/2957134545 learned_addr learned my addr 172.21.15.7:0/2957134545 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.417+0000 7fab899e2640 1 --2- 172.21.15.7:0/2957134545 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab8415d990 0x7fab840b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.417+0000 7fab891e1640 1 -- 172.21.15.7:0/2957134545 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab8415d990 msgr2=0x7fab840b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.417+0000 7fab891e1640 1 --2- 172.21.15.7:0/2957134545 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab8415d990 0x7fab840b1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.417+0000 7fab891e1640 1 -- 172.21.15.7:0/2957134545 >> v1:172.21.15.55:6789/0 conn(0x7fab840d1ac0 legacy=0x7fab8406c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:08.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.417+0000 7fab891e1640 1 -- 172.21.15.7:0/2957134545 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab840b23b0 con 0x7fab840b29c0 2024-04-25T09:55:08.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.417+0000 7fab899e2640 1 --2- 172.21.15.7:0/2957134545 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab8415d990 0x7fab840b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:08.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.418+0000 7fab891e1640 1 --2- 172.21.15.7:0/2957134545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab840b29c0 0x7fab840d1580 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fab74009870 tx=0x7fab7402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157039481fc0be74 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:08.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.418+0000 7fab889e0640 1 -- 172.21.15.7:0/2957134545 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab74037070 con 0x7fab840b29c0 2024-04-25T09:55:08.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.418+0000 7fab889e0640 1 -- 172.21.15.7:0/2957134545 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab74032440 con 0x7fab840b29c0 2024-04-25T09:55:08.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.418+0000 7fab889e0640 1 -- 172.21.15.7:0/2957134545 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab74032810 con 0x7fab840b29c0 2024-04-25T09:55:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.418+0000 7fab8bc46640 1 -- 172.21.15.7:0/2957134545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab840b29c0 msgr2=0x7fab840d1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.418+0000 7fab8bc46640 1 --2- 172.21.15.7:0/2957134545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab840b29c0 0x7fab840d1580 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fab74009870 tx=0x7fab7402a180 comp rx=0 tx=0).stop 2024-04-25T09:55:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.419+0000 7fab8bc46640 1 -- 172.21.15.7:0/2957134545 shutdown_connections 2024-04-25T09:55:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.419+0000 7fab8bc46640 1 --2- 172.21.15.7:0/2957134545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab840b29c0 0x7fab840d1580 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.419+0000 7fab8bc46640 1 --2- 172.21.15.7:0/2957134545 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab8415d990 0x7fab840b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.419+0000 7fab8bc46640 1 -- 172.21.15.7:0/2957134545 >> 172.21.15.7:0/2957134545 conn(0x7fab8408af80 msgr2=0x7fab8408b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.419+0000 7fab8bc46640 1 -- 172.21.15.7:0/2957134545 shutdown_connections 2024-04-25T09:55:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.419+0000 7fab8bc46640 1 -- 172.21.15.7:0/2957134545 wait complete. 2024-04-25T09:55:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.420+0000 7fab8bc46640 1 Processor -- start 2024-04-25T09:55:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.420+0000 7fab8bc46640 1 -- start start 2024-04-25T09:55:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.421+0000 7fab8bc46640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab840b29c0 0x7fab840cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.421+0000 7fab8bc46640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab840d1ac0 0x7fab840b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.421+0000 7fab8bc46640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab8415d990 0x7fab840cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.421+0000 7fab8bc46640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab840b19c0 con 0x7fab840d1ac0 2024-04-25T09:55:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.421+0000 7fab8bc46640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab840cf9d0 con 0x7fab840b29c0 2024-04-25T09:55:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.421+0000 7fab8bc46640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab840b1b40 con 0x7fab8415d990 2024-04-25T09:55:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.421+0000 7fab891e1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab840d1ac0 0x7fab840b69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.421+0000 7fab891e1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab840d1ac0 0x7fab840b69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55642/0 (socket says 172.21.15.7:55642) 2024-04-25T09:55:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.421+0000 7fab891e1640 1 -- 172.21.15.7:0/2980207217 learned_addr learned my addr 172.21.15.7:0/2980207217 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.421+0000 7fab899e2640 1 --2- 172.21.15.7:0/2980207217 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab840b29c0 0x7fab840cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.421+0000 7fab8a1e3640 1 --2- 172.21.15.7:0/2980207217 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab8415d990 0x7fab840cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:08.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.421+0000 7fab891e1640 1 -- 172.21.15.7:0/2980207217 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab8415d990 msgr2=0x7fab840cbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:08.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.421+0000 7fab891e1640 1 --2- 172.21.15.7:0/2980207217 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab8415d990 0x7fab840cbeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.421+0000 7fab891e1640 1 -- 172.21.15.7:0/2980207217 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab840b29c0 msgr2=0x7fab840cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:08.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.421+0000 7fab891e1640 1 --2- 172.21.15.7:0/2980207217 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab840b29c0 0x7fab840cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.421+0000 7fab891e1640 1 -- 172.21.15.7:0/2980207217 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab840b70e0 con 0x7fab840d1ac0 2024-04-25T09:55:08.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.421+0000 7fab899e2640 1 --2- 172.21.15.7:0/2980207217 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab840b29c0 0x7fab840cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:08.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.421+0000 7fab891e1640 1 --2- 172.21.15.7:0/2980207217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab840d1ac0 0x7fab840b69e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fab74009870 tx=0x7fab740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:08.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.421+0000 7fab7a7fc640 1 -- 172.21.15.7:0/2980207217 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab74041070 con 0x7fab840d1ac0 2024-04-25T09:55:08.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.421+0000 7fab7a7fc640 1 -- 172.21.15.7:0/2980207217 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7403c870 con 0x7fab840d1ac0 2024-04-25T09:55:08.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.421+0000 7fab8bc46640 1 -- 172.21.15.7:0/2980207217 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab841f7b60 con 0x7fab840d1ac0 2024-04-25T09:55:08.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.421+0000 7fab7a7fc640 1 -- 172.21.15.7:0/2980207217 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab74037040 con 0x7fab840d1ac0 2024-04-25T09:55:08.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.422+0000 7fab8bc46640 1 -- 172.21.15.7:0/2980207217 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab841f7080 con 0x7fab840d1ac0 2024-04-25T09:55:08.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.422+0000 7fab8bc46640 1 -- 172.21.15.7:0/2980207217 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab84068f60 con 0x7fab840d1ac0 2024-04-25T09:55:08.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.423+0000 7fab7a7fc640 1 -- 172.21.15.7:0/2980207217 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fab74044070 con 0x7fab840d1ac0 2024-04-25T09:55:08.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.423+0000 7fab7a7fc640 1 --2- 172.21.15.7:0/2980207217 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fab6806b4d0 0x7fab6806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:08.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.423+0000 7fab7a7fc640 1 -- 172.21.15.7:0/2980207217 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fab740aaff0 con 0x7fab840d1ac0 2024-04-25T09:55:08.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.423+0000 7fab899e2640 1 --2- 172.21.15.7:0/2980207217 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fab6806b4d0 0x7fab6806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:08.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.424+0000 7fab899e2640 1 --2- 172.21.15.7:0/2980207217 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fab6806b4d0 0x7fab6806d990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fab8000a990 tx=0x7fab80008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:08.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.428+0000 7fab7a7fc640 1 -- 172.21.15.7:0/2980207217 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fab74079b60 con 0x7fab840d1ac0 2024-04-25T09:55:08.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.612+0000 7fab8bc46640 1 -- 172.21.15.7:0/2980207217 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fab840ccdd0 con 0x7fab840d1ac0 2024-04-25T09:55:08.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.612+0000 7fab7a7fc640 1 -- 172.21.15.7:0/2980207217 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fab74079460 con 0x7fab840d1ac0 2024-04-25T09:55:08.615 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T09:55:08.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.614+0000 7fab8bc46640 1 -- 172.21.15.7:0/2980207217 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fab6806b4d0 msgr2=0x7fab6806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:08.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.614+0000 7fab8bc46640 1 --2- 172.21.15.7:0/2980207217 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fab6806b4d0 0x7fab6806d990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fab8000a990 tx=0x7fab80008040 comp rx=0 tx=0).stop 2024-04-25T09:55:08.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.614+0000 7fab8bc46640 1 -- 172.21.15.7:0/2980207217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab840d1ac0 msgr2=0x7fab840b69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:08.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.614+0000 7fab8bc46640 1 --2- 172.21.15.7:0/2980207217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab840d1ac0 0x7fab840b69e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fab74009870 tx=0x7fab740046c0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.614+0000 7fab8bc46640 1 -- 172.21.15.7:0/2980207217 shutdown_connections 2024-04-25T09:55:08.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.614+0000 7fab8bc46640 1 --2- 172.21.15.7:0/2980207217 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fab6806b4d0 0x7fab6806d990 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.614+0000 7fab8bc46640 1 --2- 172.21.15.7:0/2980207217 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab8415d990 0x7fab840cbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.614+0000 7fab8bc46640 1 --2- 172.21.15.7:0/2980207217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab840d1ac0 0x7fab840b69e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.614+0000 7fab8bc46640 1 --2- 172.21.15.7:0/2980207217 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab840b29c0 0x7fab840cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.614+0000 7fab8bc46640 1 -- 172.21.15.7:0/2980207217 >> 172.21.15.7:0/2980207217 conn(0x7fab8408af80 msgr2=0x7fab8406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:08.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.614+0000 7fab8bc46640 1 -- 172.21.15.7:0/2980207217 shutdown_connections 2024-04-25T09:55:08.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.614+0000 7fab8bc46640 1 -- 172.21.15.7:0/2980207217 wait complete. 2024-04-25T09:55:08.628 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:55:08.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.729+0000 7f6feac31640 1 Processor -- start 2024-04-25T09:55:08.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.729+0000 7f6feac31640 1 -- start start 2024-04-25T09:55:08.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.729+0000 7f6feac31640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6fe415deb0 0x7f6fe40b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:08.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.729+0000 7f6feac31640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6fe40ce030 0x7f6fe40b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:08.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.729+0000 7f6feac31640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6fe40b6f20 0x7f6fe40d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:08.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.729+0000 7f6feac31640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe40d1a40 con 0x7f6fe40ce030 2024-04-25T09:55:08.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.729+0000 7f6feac31640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe40d1d20 con 0x7f6fe40b6f20 2024-04-25T09:55:08.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.729+0000 7f6feac31640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe40d2000 con 0x7f6fe415deb0 2024-04-25T09:55:08.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.730+0000 7f6fe3fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6fe40ce030 0x7f6fe40b69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:08.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.730+0000 7f6fe3fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6fe40ce030 0x7f6fe40b69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55656/0 (socket says 172.21.15.7:55656) 2024-04-25T09:55:08.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.730+0000 7f6fe3fff640 1 -- 172.21.15.7:0/755186089 learned_addr learned my addr 172.21.15.7:0/755186089 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:08.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.730+0000 7f6fe91ce640 1 --2- 172.21.15.7:0/755186089 >> v2:172.21.15.55:3300/0 conn(0x7f6fe40b6f20 0x7f6fe40d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:08.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.730+0000 7f6fe89cd640 1 --2- 172.21.15.7:0/755186089 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6fe415deb0 0x7f6fe40b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:08.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.730+0000 7f6fe3fff640 1 -- 172.21.15.7:0/755186089 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6fe415deb0 msgr2=0x7f6fe40b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:08.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.730+0000 7f6fe3fff640 1 --2- 172.21.15.7:0/755186089 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6fe415deb0 0x7f6fe40b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.730+0000 7f6fe3fff640 1 -- 172.21.15.7:0/755186089 >> v2:172.21.15.55:3300/0 conn(0x7f6fe40b6f20 msgr2=0x7f6fe40d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:08.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.730+0000 7f6fe3fff640 1 --2- 172.21.15.7:0/755186089 >> v2:172.21.15.55:3300/0 conn(0x7f6fe40b6f20 0x7f6fe40d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.730+0000 7f6fe3fff640 1 -- 172.21.15.7:0/755186089 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe40d22e0 con 0x7f6fe40ce030 2024-04-25T09:55:08.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.730+0000 7f6fe91ce640 1 --2- 172.21.15.7:0/755186089 >> v2:172.21.15.55:3300/0 conn(0x7f6fe40b6f20 0x7f6fe40d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:08.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.731+0000 7f6fe3fff640 1 --2- 172.21.15.7:0/755186089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fe40ce030 0x7f6fe40b69e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40cddb0 tx=0x7f6fd002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d31d1fb6efde6b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:08.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.731+0000 7f6fe37fe640 1 -- 172.21.15.7:0/755186089 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0037070 con 0x7f6fe40ce030 2024-04-25T09:55:08.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.731+0000 7f6fe37fe640 1 -- 172.21.15.7:0/755186089 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd0032440 con 0x7f6fe40ce030 2024-04-25T09:55:08.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.731+0000 7f6fe37fe640 1 -- 172.21.15.7:0/755186089 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0032810 con 0x7f6fe40ce030 2024-04-25T09:55:08.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.731+0000 7f6feac31640 1 -- 172.21.15.7:0/755186089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fe40ce030 msgr2=0x7f6fe40b69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:08.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.731+0000 7f6feac31640 1 --2- 172.21.15.7:0/755186089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fe40ce030 0x7f6fe40b69e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40cddb0 tx=0x7f6fd002a1e0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.731+0000 7f6feac31640 1 -- 172.21.15.7:0/755186089 shutdown_connections 2024-04-25T09:55:08.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.731+0000 7f6feac31640 1 --2- 172.21.15.7:0/755186089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fe40ce030 0x7f6fe40b69e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.731+0000 7f6feac31640 1 --2- 172.21.15.7:0/755186089 >> v2:172.21.15.55:3300/0 conn(0x7f6fe40b6f20 0x7f6fe40d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.731+0000 7f6feac31640 1 --2- 172.21.15.7:0/755186089 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6fe415deb0 0x7f6fe40b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.731+0000 7f6feac31640 1 -- 172.21.15.7:0/755186089 >> 172.21.15.7:0/755186089 conn(0x7f6fe40726b0 msgr2=0x7f6fe4072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:08.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.731+0000 7f6feac31640 1 -- 172.21.15.7:0/755186089 shutdown_connections 2024-04-25T09:55:08.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.731+0000 7f6feac31640 1 -- 172.21.15.7:0/755186089 wait complete. 2024-04-25T09:55:08.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.732+0000 7f6feac31640 1 Processor -- start 2024-04-25T09:55:08.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.733+0000 7f6feac31640 1 -- start start 2024-04-25T09:55:08.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.733+0000 7f6feac31640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fe40b6f20 0x7f6fe40c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:08.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.733+0000 7f6feac31640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6fe40ce030 0x7f6fe4146a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:08.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.733+0000 7f6feac31640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fe415deb0 0x7f6fe40cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:08.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.733+0000 7f6feac31640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe40d3ca0 con 0x7f6fe415deb0 2024-04-25T09:55:08.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.733+0000 7f6feac31640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe40ce490 con 0x7f6fe40b6f20 2024-04-25T09:55:08.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.733+0000 7f6feac31640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe40d3e20 con 0x7f6fe40ce030 2024-04-25T09:55:08.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.733+0000 7f6fe91ce640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fe415deb0 0x7f6fe40cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:08.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.734+0000 7f6fe91ce640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fe415deb0 0x7f6fe40cd4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55658/0 (socket says 172.21.15.7:55658) 2024-04-25T09:55:08.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.734+0000 7f6fe91ce640 1 -- 172.21.15.7:0/1953972251 learned_addr learned my addr 172.21.15.7:0/1953972251 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:08.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.734+0000 7f6fe89cd640 1 --2- 172.21.15.7:0/1953972251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fe40b6f20 0x7f6fe40c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:08.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.734+0000 7f6fe3fff640 1 --2- 172.21.15.7:0/1953972251 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6fe40ce030 0x7f6fe4146a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:08.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.734+0000 7f6fe91ce640 1 -- 172.21.15.7:0/1953972251 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6fe40ce030 msgr2=0x7f6fe4146a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:08.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.734+0000 7f6fe91ce640 1 --2- 172.21.15.7:0/1953972251 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6fe40ce030 0x7f6fe4146a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.734+0000 7f6fe91ce640 1 -- 172.21.15.7:0/1953972251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fe40b6f20 msgr2=0x7f6fe40c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:08.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.734+0000 7f6fe91ce640 1 --2- 172.21.15.7:0/1953972251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fe40b6f20 0x7f6fe40c9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.734+0000 7f6fe91ce640 1 -- 172.21.15.7:0/1953972251 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe41498d0 con 0x7f6fe415deb0 2024-04-25T09:55:08.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.734+0000 7f6fe91ce640 1 --2- 172.21.15.7:0/1953972251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fe415deb0 0x7f6fe40cd4b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc007e20 tx=0x7f6fdc00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:08.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.734+0000 7f6fe17fa640 1 -- 172.21.15.7:0/1953972251 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc01a070 con 0x7f6fe415deb0 2024-04-25T09:55:08.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.734+0000 7f6fe17fa640 1 -- 172.21.15.7:0/1953972251 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fdc015620 con 0x7f6fe415deb0 2024-04-25T09:55:08.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.734+0000 7f6fe17fa640 1 -- 172.21.15.7:0/1953972251 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc015a10 con 0x7f6fe415deb0 2024-04-25T09:55:08.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.734+0000 7f6feac31640 1 -- 172.21.15.7:0/1953972251 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe40cc9d0 con 0x7f6fe415deb0 2024-04-25T09:55:08.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.734+0000 7f6feac31640 1 -- 172.21.15.7:0/1953972251 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe40cc630 con 0x7f6fe415deb0 2024-04-25T09:55:08.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.735+0000 7f6feac31640 1 -- 172.21.15.7:0/1953972251 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe4068f60 con 0x7f6fe415deb0 2024-04-25T09:55:08.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.736+0000 7f6fe17fa640 1 -- 172.21.15.7:0/1953972251 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6fdc01d070 con 0x7f6fe415deb0 2024-04-25T09:55:08.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.736+0000 7f6fe17fa640 1 --2- 172.21.15.7:0/1953972251 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6fc806b4d0 0x7f6fc806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:08.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.736+0000 7f6fe17fa640 1 -- 172.21.15.7:0/1953972251 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f6fdc08a7f0 con 0x7f6fe415deb0 2024-04-25T09:55:08.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.736+0000 7f6fe89cd640 1 --2- 172.21.15.7:0/1953972251 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6fc806b4d0 0x7f6fc806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:08.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.736+0000 7f6fe89cd640 1 --2- 172.21.15.7:0/1953972251 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6fc806b4d0 0x7f6fc806d990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6fd80079a0 tx=0x7f6fd8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:08.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.740+0000 7f6fe17fa640 1 -- 172.21.15.7:0/1953972251 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6fdc010070 con 0x7f6fe415deb0 2024-04-25T09:55:08.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.918+0000 7f6feac31640 1 -- 172.21.15.7:0/1953972251 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6fe406d530 con 0x7f6fe415deb0 2024-04-25T09:55:08.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.918+0000 7f6fe17fa640 1 -- 172.21.15.7:0/1953972251 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6fdc058c20 con 0x7f6fe415deb0 2024-04-25T09:55:08.921 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:55:08.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.920+0000 7f6feac31640 1 -- 172.21.15.7:0/1953972251 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6fc806b4d0 msgr2=0x7f6fc806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:08.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.920+0000 7f6feac31640 1 --2- 172.21.15.7:0/1953972251 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6fc806b4d0 0x7f6fc806d990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6fd80079a0 tx=0x7f6fd8008040 comp rx=0 tx=0).stop 2024-04-25T09:55:08.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.920+0000 7f6feac31640 1 -- 172.21.15.7:0/1953972251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fe415deb0 msgr2=0x7f6fe40cd4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:08.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.920+0000 7f6feac31640 1 --2- 172.21.15.7:0/1953972251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fe415deb0 0x7f6fe40cd4b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc007e20 tx=0x7f6fdc00d4a0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.920+0000 7f6feac31640 1 -- 172.21.15.7:0/1953972251 shutdown_connections 2024-04-25T09:55:08.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.920+0000 7f6feac31640 1 --2- 172.21.15.7:0/1953972251 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6fc806b4d0 0x7f6fc806d990 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.920+0000 7f6feac31640 1 --2- 172.21.15.7:0/1953972251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fe415deb0 0x7f6fe40cd4b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.920+0000 7f6feac31640 1 --2- 172.21.15.7:0/1953972251 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6fe40ce030 0x7f6fe4146a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.920+0000 7f6feac31640 1 --2- 172.21.15.7:0/1953972251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fe40b6f20 0x7f6fe40c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:08.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.920+0000 7f6feac31640 1 -- 172.21.15.7:0/1953972251 >> 172.21.15.7:0/1953972251 conn(0x7f6fe40726b0 msgr2=0x7f6fe4072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:08.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.920+0000 7f6feac31640 1 -- 172.21.15.7:0/1953972251 shutdown_connections 2024-04-25T09:55:08.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:08.920+0000 7f6feac31640 1 -- 172.21.15.7:0/1953972251 wait complete. 2024-04-25T09:55:08.941 INFO:tasks.cephfs_test_runner:Starting test: test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T09:55:08.942 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:55:09.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.040+0000 7f5e20d7e640 1 Processor -- start 2024-04-25T09:55:09.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.040+0000 7f5e20d7e640 1 -- start start 2024-04-25T09:55:09.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.041+0000 7f5e20d7e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e1c15dd00 0x7f5e1c0b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:09.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.041+0000 7f5e20d7e640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e1c06cd00 con 0x7f5e1c0b6a40 2024-04-25T09:55:09.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.041+0000 7f5e20d7e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e1c0d1ca0 con 0x7f5e1c06c6c0 2024-04-25T09:55:09.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.041+0000 7f5e20d7e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c15e0e0 con 0x7f5e1c15dd00 2024-04-25T09:55:09.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.041+0000 7f5e13fff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5e1c0b6a40 0x7f5e1c06bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:57840/0 (socket says 172.21.15.7:57840) 2024-04-25T09:55:09.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.041+0000 7f5e13fff640 1 -- 172.21.15.7:0/396898682 learned_addr learned my addr 172.21.15.7:0/396898682 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:09.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.041+0000 7f5e19d9b640 1 -- 172.21.15.7:0/396898682 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 808816671 0 0) 0x7f5e1c06cd00 con 0x7f5e1c0b6a40 2024-04-25T09:55:09.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.041+0000 7f5e1a59c640 1 --2- 172.21.15.7:0/396898682 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e1c15dd00 0x7f5e1c0b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:09.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.041+0000 7f5e19d9b640 1 -- 172.21.15.7:0/396898682 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e08003520 con 0x7f5e1c0b6a40 2024-04-25T09:55:09.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.041+0000 7f5e19d9b640 1 -- 172.21.15.7:0/396898682 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4007546557 0 0) 0x7f5e08003520 con 0x7f5e1c0b6a40 2024-04-25T09:55:09.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.041+0000 7f5e19d9b640 1 -- 172.21.15.7:0/396898682 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e1c15dd00 msgr2=0x7f5e1c0b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:09.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.041+0000 7f5e19d9b640 1 --2- 172.21.15.7:0/396898682 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e1c15dd00 0x7f5e1c0b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.041+0000 7f5e19d9b640 1 -- 172.21.15.7:0/396898682 >> v1:172.21.15.55:6789/0 conn(0x7f5e1c06c6c0 legacy=0x7f5e1c0d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:09.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.041+0000 7f5e19d9b640 1 -- 172.21.15.7:0/396898682 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e1c0d1f80 con 0x7f5e1c0b6a40 2024-04-25T09:55:09.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.041+0000 7f5e19d9b640 1 -- 172.21.15.7:0/396898682 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f5e04001670 con 0x7f5e1c0b6a40 2024-04-25T09:55:09.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.041+0000 7f5e19d9b640 1 -- 172.21.15.7:0/396898682 >> v1:172.21.15.7:6789/0 conn(0x7f5e1c0b6a40 legacy=0x7f5e1c06bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:09.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.041+0000 7f5e19d9b640 1 --2- 172.21.15.7:0/396898682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e080039e0 0x7f5e08003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:09.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.041+0000 7f5e19d9b640 1 --2- 172.21.15.7:0/396898682 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e1c15dd00 0x7f5e08004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:09.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.041+0000 7f5e19d9b640 1 --2- 172.21.15.7:0/396898682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e08004d40 0x7f5e080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:09.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.042+0000 7f5e19d9b640 1 -- 172.21.15.7:0/396898682 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c15e0e0 con 0x7f5e080039e0 2024-04-25T09:55:09.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.042+0000 7f5e19d9b640 1 -- 172.21.15.7:0/396898682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0800bb00 con 0x7f5e08004d40 2024-04-25T09:55:09.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.042+0000 7f5e19d9b640 1 -- 172.21.15.7:0/396898682 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0800bd00 con 0x7f5e1c15dd00 2024-04-25T09:55:09.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.042+0000 7f5e1a59c640 1 --2- 172.21.15.7:0/396898682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e080039e0 0x7f5e08003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:09.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.042+0000 7f5e13fff640 1 --2- 172.21.15.7:0/396898682 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e1c15dd00 0x7f5e08004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:09.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.042+0000 7f5e1ad9d640 1 --2- 172.21.15.7:0/396898682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e08004d40 0x7f5e080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:09.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.042+0000 7f5e1a59c640 1 -- 172.21.15.7:0/396898682 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e1c15dd00 msgr2=0x7f5e08004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:09.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.042+0000 7f5e1a59c640 1 --2- 172.21.15.7:0/396898682 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e1c15dd00 0x7f5e08004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.042+0000 7f5e1a59c640 1 -- 172.21.15.7:0/396898682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e08004d40 msgr2=0x7f5e080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:09.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.042+0000 7f5e1a59c640 1 --2- 172.21.15.7:0/396898682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e08004d40 0x7f5e080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.042+0000 7f5e1a59c640 1 -- 172.21.15.7:0/396898682 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e08003520 con 0x7f5e080039e0 2024-04-25T09:55:09.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.042+0000 7f5e1ad9d640 1 --2- 172.21.15.7:0/396898682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e08004d40 0x7f5e080051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:09.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.043+0000 7f5e1a59c640 1 --2- 172.21.15.7:0/396898682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e080039e0 0x7f5e08003e00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c009a90 tx=0x7f5e08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=813129e300a794ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:09.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.043+0000 7f5e19d9b640 1 -- 172.21.15.7:0/396898682 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c036070 con 0x7f5e080039e0 2024-04-25T09:55:09.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.043+0000 7f5e19d9b640 1 -- 172.21.15.7:0/396898682 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e0c031400 con 0x7f5e080039e0 2024-04-25T09:55:09.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.043+0000 7f5e19d9b640 1 -- 172.21.15.7:0/396898682 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c009690 con 0x7f5e080039e0 2024-04-25T09:55:09.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.043+0000 7f5e20d7e640 1 -- 172.21.15.7:0/396898682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e080039e0 msgr2=0x7f5e08003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:09.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.043+0000 7f5e20d7e640 1 --2- 172.21.15.7:0/396898682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e080039e0 0x7f5e08003e00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c009a90 tx=0x7f5e08005830 comp rx=0 tx=0).stop 2024-04-25T09:55:09.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.043+0000 7f5e1ad9d640 1 -- 172.21.15.7:0/396898682 reap_dead start 2024-04-25T09:55:09.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.043+0000 7f5e20d7e640 1 -- 172.21.15.7:0/396898682 shutdown_connections 2024-04-25T09:55:09.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.043+0000 7f5e20d7e640 1 -- 172.21.15.7:0/396898682 >> 172.21.15.7:0/396898682 conn(0x7f5e1c0d07b0 msgr2=0x7f5e1c0d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:09.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.043+0000 7f5e20d7e640 1 -- 172.21.15.7:0/396898682 shutdown_connections 2024-04-25T09:55:09.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.043+0000 7f5e20d7e640 1 -- 172.21.15.7:0/396898682 wait complete. 2024-04-25T09:55:09.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.045+0000 7f5e20d7e640 1 Processor -- start 2024-04-25T09:55:09.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.045+0000 7f5e20d7e640 1 -- start start 2024-04-25T09:55:09.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.045+0000 7f5e20d7e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e080039e0 0x7f5e1c15cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:09.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.045+0000 7f5e20d7e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e1c1562e0 0x7f5e1c1546f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:09.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.045+0000 7f5e20d7e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e1c154c30 0x7f5e1c156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:09.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.045+0000 7f5e20d7e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c0d2e90 con 0x7f5e1c1562e0 2024-04-25T09:55:09.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.045+0000 7f5e20d7e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c06cfe0 con 0x7f5e080039e0 2024-04-25T09:55:09.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.045+0000 7f5e20d7e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c0d3010 con 0x7f5e1c154c30 2024-04-25T09:55:09.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.045+0000 7f5e13fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e1c1562e0 0x7f5e1c1546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:09.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.045+0000 7f5e13fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e1c1562e0 0x7f5e1c1546f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55682/0 (socket says 172.21.15.7:55682) 2024-04-25T09:55:09.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.045+0000 7f5e13fff640 1 -- 172.21.15.7:0/4252411456 learned_addr learned my addr 172.21.15.7:0/4252411456 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:09.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.046+0000 7f5e1ad9d640 1 --2- 172.21.15.7:0/4252411456 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e1c154c30 0x7f5e1c156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:09.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.046+0000 7f5e1a59c640 1 --2- 172.21.15.7:0/4252411456 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e080039e0 0x7f5e1c15cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:09.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.046+0000 7f5e13fff640 1 -- 172.21.15.7:0/4252411456 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e1c154c30 msgr2=0x7f5e1c156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:09.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.046+0000 7f5e13fff640 1 --2- 172.21.15.7:0/4252411456 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e1c154c30 0x7f5e1c156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.046+0000 7f5e13fff640 1 -- 172.21.15.7:0/4252411456 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e080039e0 msgr2=0x7f5e1c15cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:09.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.046+0000 7f5e13fff640 1 --2- 172.21.15.7:0/4252411456 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e080039e0 0x7f5e1c15cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.046+0000 7f5e13fff640 1 -- 172.21.15.7:0/4252411456 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e1c155240 con 0x7f5e1c1562e0 2024-04-25T09:55:09.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.046+0000 7f5e1a59c640 1 --2- 172.21.15.7:0/4252411456 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e080039e0 0x7f5e1c15cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:09.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.046+0000 7f5e13fff640 1 --2- 172.21.15.7:0/4252411456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e1c1562e0 0x7f5e1c1546f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5e040072f0 tx=0x7f5e040076f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:09.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.046+0000 7f5e12ffd640 1 -- 172.21.15.7:0/4252411456 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0400f9c0 con 0x7f5e1c1562e0 2024-04-25T09:55:09.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.046+0000 7f5e12ffd640 1 -- 172.21.15.7:0/4252411456 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e04018070 con 0x7f5e1c1562e0 2024-04-25T09:55:09.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.046+0000 7f5e20d7e640 1 -- 172.21.15.7:0/4252411456 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e1c155520 con 0x7f5e1c1562e0 2024-04-25T09:55:09.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.046+0000 7f5e12ffd640 1 -- 172.21.15.7:0/4252411456 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0400fdc0 con 0x7f5e1c1562e0 2024-04-25T09:55:09.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.046+0000 7f5e20d7e640 1 -- 172.21.15.7:0/4252411456 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e1c155ae0 con 0x7f5e1c1562e0 2024-04-25T09:55:09.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.047+0000 7f5e20d7e640 1 -- 172.21.15.7:0/4252411456 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e1c068fd0 con 0x7f5e1c1562e0 2024-04-25T09:55:09.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.048+0000 7f5e12ffd640 1 -- 172.21.15.7:0/4252411456 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5e0401d460 con 0x7f5e1c1562e0 2024-04-25T09:55:09.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.048+0000 7f5e12ffd640 1 --2- 172.21.15.7:0/4252411456 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5dfc06b4d0 0x7f5dfc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:09.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.048+0000 7f5e12ffd640 1 -- 172.21.15.7:0/4252411456 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f5e0408a6a0 con 0x7f5e1c1562e0 2024-04-25T09:55:09.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.048+0000 7f5e1a59c640 1 --2- 172.21.15.7:0/4252411456 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5dfc06b4d0 0x7f5dfc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:09.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.049+0000 7f5e1a59c640 1 --2- 172.21.15.7:0/4252411456 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5dfc06b4d0 0x7f5dfc06d990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c033000 tx=0x7f5e0c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:09.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.052+0000 7f5e12ffd640 1 -- 172.21.15.7:0/4252411456 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5e04059120 con 0x7f5e1c1562e0 2024-04-25T09:55:09.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.235+0000 7f5e20d7e640 1 -- 172.21.15.7:0/4252411456 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e1c0d1620 con 0x7f5e1c1562e0 2024-04-25T09:55:09.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.236+0000 7f5e12ffd640 1 -- 172.21.15.7:0/4252411456 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18807 (secure 0 0 0) 0x7f5e04058a20 con 0x7f5e1c1562e0 2024-04-25T09:55:09.239 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:09.239 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":26,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:55:08.587401+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:54:26.011833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:54:26.535536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:54:30.264996+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:55:09.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.238+0000 7f5e20d7e640 1 -- 172.21.15.7:0/4252411456 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5dfc06b4d0 msgr2=0x7f5dfc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:09.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.238+0000 7f5e20d7e640 1 --2- 172.21.15.7:0/4252411456 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5dfc06b4d0 0x7f5dfc06d990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c033000 tx=0x7f5e0c008030 comp rx=0 tx=0).stop 2024-04-25T09:55:09.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.238+0000 7f5e20d7e640 1 -- 172.21.15.7:0/4252411456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e1c1562e0 msgr2=0x7f5e1c1546f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:09.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.238+0000 7f5e20d7e640 1 --2- 172.21.15.7:0/4252411456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e1c1562e0 0x7f5e1c1546f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5e040072f0 tx=0x7f5e040076f0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.238+0000 7f5e20d7e640 1 -- 172.21.15.7:0/4252411456 shutdown_connections 2024-04-25T09:55:09.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.238+0000 7f5e20d7e640 1 --2- 172.21.15.7:0/4252411456 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5dfc06b4d0 0x7f5dfc06d990 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.238+0000 7f5e20d7e640 1 --2- 172.21.15.7:0/4252411456 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e1c154c30 0x7f5e1c156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.238+0000 7f5e20d7e640 1 --2- 172.21.15.7:0/4252411456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e1c1562e0 0x7f5e1c1546f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.238+0000 7f5e20d7e640 1 --2- 172.21.15.7:0/4252411456 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e080039e0 0x7f5e1c15cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.238+0000 7f5e20d7e640 1 -- 172.21.15.7:0/4252411456 >> 172.21.15.7:0/4252411456 conn(0x7f5e1c0d07b0 msgr2=0x7f5e1c0b3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:09.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.238+0000 7f5e20d7e640 1 -- 172.21.15.7:0/4252411456 shutdown_connections 2024-04-25T09:55:09.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.238+0000 7f5e20d7e640 1 -- 172.21.15.7:0/4252411456 wait complete. 2024-04-25T09:55:09.252 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:54:26.011833+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:54:26.535536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:54:30.264996+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:55:09.253 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:55:09.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.353+0000 7fef40a1b640 1 Processor -- start 2024-04-25T09:55:09.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.353+0000 7fef40a1b640 1 -- start start 2024-04-25T09:55:09.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.354+0000 7fef40a1b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fef3c162d00 0x7fef3c0cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:09.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.354+0000 7fef40a1b640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef3c0d3680 con 0x7fef3c1630e0 2024-04-25T09:55:09.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.354+0000 7fef40a1b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef3c0d3960 con 0x7fef3c0d0e50 2024-04-25T09:55:09.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.354+0000 7fef40a1b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef3c0d3fb0 con 0x7fef3c162d00 2024-04-25T09:55:09.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.354+0000 7fef39d9b640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fef3c1630e0 0x7fef3c0d0740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:57848/0 (socket says 172.21.15.7:57848) 2024-04-25T09:55:09.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.354+0000 7fef39d9b640 1 -- 172.21.15.7:0/3472268470 learned_addr learned my addr 172.21.15.7:0/3472268470 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:09.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.355+0000 7fef3959a640 1 -- 172.21.15.7:0/3472268470 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3458632376 0 0) 0x7fef3c0d3680 con 0x7fef3c1630e0 2024-04-25T09:55:09.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.355+0000 7fef3959a640 1 -- 172.21.15.7:0/3472268470 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef28003520 con 0x7fef3c1630e0 2024-04-25T09:55:09.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.355+0000 7fef3a59c640 1 --2- 172.21.15.7:0/3472268470 >> v2:172.21.15.55:3300/0 conn(0x7fef3c162d00 0x7fef3c0cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:09.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.355+0000 7fef3959a640 1 -- 172.21.15.7:0/3472268470 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1188466731 0 0) 0x7fef28003520 con 0x7fef3c1630e0 2024-04-25T09:55:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.355+0000 7fef3959a640 1 -- 172.21.15.7:0/3472268470 >> v2:172.21.15.55:3300/0 conn(0x7fef3c162d00 msgr2=0x7fef3c0cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.355+0000 7fef3959a640 1 --2- 172.21.15.7:0/3472268470 >> v2:172.21.15.55:3300/0 conn(0x7fef3c162d00 0x7fef3c0cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.355+0000 7fef3959a640 1 -- 172.21.15.7:0/3472268470 >> v1:172.21.15.55:6789/0 conn(0x7fef3c0d0e50 legacy=0x7fef3c0d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.355+0000 7fef3959a640 1 -- 172.21.15.7:0/3472268470 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3c0d3c40 con 0x7fef3c1630e0 2024-04-25T09:55:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.355+0000 7fef3959a640 1 -- 172.21.15.7:0/3472268470 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fef24001670 con 0x7fef3c1630e0 2024-04-25T09:55:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.355+0000 7fef3959a640 1 -- 172.21.15.7:0/3472268470 >> v1:172.21.15.7:6789/0 conn(0x7fef3c1630e0 legacy=0x7fef3c0d0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.355+0000 7fef3959a640 1 --2- 172.21.15.7:0/3472268470 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fef280039b0 0x7fef28003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.355+0000 7fef3959a640 1 --2- 172.21.15.7:0/3472268470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef28004800 0x7fef28004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.355+0000 7fef3959a640 1 --2- 172.21.15.7:0/3472268470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef280051c0 0x7fef2800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.355+0000 7fef3959a640 1 -- 172.21.15.7:0/3472268470 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c0d3fb0 con 0x7fef28004800 2024-04-25T09:55:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.355+0000 7fef3959a640 1 -- 172.21.15.7:0/3472268470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2800c110 con 0x7fef280051c0 2024-04-25T09:55:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.355+0000 7fef3959a640 1 -- 172.21.15.7:0/3472268470 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef2800c310 con 0x7fef280039b0 2024-04-25T09:55:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.355+0000 7fef39d9b640 1 --2- 172.21.15.7:0/3472268470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef28004800 0x7fef28004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.355+0000 7fef3a59c640 1 --2- 172.21.15.7:0/3472268470 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fef280039b0 0x7fef28003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.355+0000 7fef3ad9d640 1 --2- 172.21.15.7:0/3472268470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef280051c0 0x7fef2800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.355+0000 7fef39d9b640 1 -- 172.21.15.7:0/3472268470 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fef280039b0 msgr2=0x7fef28003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:09.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.355+0000 7fef39d9b640 1 --2- 172.21.15.7:0/3472268470 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fef280039b0 0x7fef28003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.355+0000 7fef39d9b640 1 -- 172.21.15.7:0/3472268470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef280051c0 msgr2=0x7fef2800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:09.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.355+0000 7fef39d9b640 1 --2- 172.21.15.7:0/3472268470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef280051c0 0x7fef2800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.355+0000 7fef39d9b640 1 -- 172.21.15.7:0/3472268470 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef28003520 con 0x7fef28004800 2024-04-25T09:55:09.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.356+0000 7fef3ad9d640 1 --2- 172.21.15.7:0/3472268470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef280051c0 0x7fef2800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:09.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.356+0000 7fef3a59c640 1 --2- 172.21.15.7:0/3472268470 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fef280039b0 0x7fef28003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:09.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.356+0000 7fef3ad9d640 1 -- 172.21.15.7:0/3472268470 reap_dead start 2024-04-25T09:55:09.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.356+0000 7fef39d9b640 1 --2- 172.21.15.7:0/3472268470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef28004800 0x7fef28004c80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fef2400c240 tx=0x7fef28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc5f1933bd8cbe7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:09.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.356+0000 7fef3959a640 1 -- 172.21.15.7:0/3472268470 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef24007d10 con 0x7fef28004800 2024-04-25T09:55:09.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.356+0000 7fef3959a640 1 -- 172.21.15.7:0/3472268470 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef24005ad0 con 0x7fef28004800 2024-04-25T09:55:09.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.356+0000 7fef3959a640 1 -- 172.21.15.7:0/3472268470 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef24007070 con 0x7fef28004800 2024-04-25T09:55:09.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.357+0000 7fef40a1b640 1 -- 172.21.15.7:0/3472268470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef28004800 msgr2=0x7fef28004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:09.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.357+0000 7fef40a1b640 1 --2- 172.21.15.7:0/3472268470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef28004800 0x7fef28004c80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fef2400c240 tx=0x7fef28005830 comp rx=0 tx=0).stop 2024-04-25T09:55:09.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.357+0000 7fef40a1b640 1 -- 172.21.15.7:0/3472268470 shutdown_connections 2024-04-25T09:55:09.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.357+0000 7fef40a1b640 1 --2- 172.21.15.7:0/3472268470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef28004800 0x7fef28004c80 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.357+0000 7fef40a1b640 1 -- 172.21.15.7:0/3472268470 >> 172.21.15.7:0/3472268470 conn(0x7fef3c072680 msgr2=0x7fef3c072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:09.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.357+0000 7fef40a1b640 1 -- 172.21.15.7:0/3472268470 shutdown_connections 2024-04-25T09:55:09.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.357+0000 7fef40a1b640 1 -- 172.21.15.7:0/3472268470 wait complete. 2024-04-25T09:55:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.358+0000 7fef40a1b640 1 Processor -- start 2024-04-25T09:55:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.358+0000 7fef40a1b640 1 -- start start 2024-04-25T09:55:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.359+0000 7fef40a1b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fef28004800 0x7fef3c148b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.359+0000 7fef40a1b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef3c0cbc10 0x7fef3c0b80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:09.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.359+0000 7fef40a1b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef3c0cc090 0x7fef3c0b8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.359+0000 7fef40a1b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c0d08c0 con 0x7fef3c0cbc10 2024-04-25T09:55:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.359+0000 7fef40a1b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c0d0740 con 0x7fef3c0cc090 2024-04-25T09:55:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.359+0000 7fef40a1b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c0d0a40 con 0x7fef28004800 2024-04-25T09:55:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.359+0000 7fef39d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef3c0cbc10 0x7fef3c0b80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.359+0000 7fef39d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef3c0cbc10 0x7fef3c0b80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55698/0 (socket says 172.21.15.7:55698) 2024-04-25T09:55:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.359+0000 7fef39d9b640 1 -- 172.21.15.7:0/3624791840 learned_addr learned my addr 172.21.15.7:0/3624791840 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.359+0000 7fef3a59c640 1 --2- 172.21.15.7:0/3624791840 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fef28004800 0x7fef3c148b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.359+0000 7fef3ad9d640 1 --2- 172.21.15.7:0/3624791840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef3c0cc090 0x7fef3c0b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.359+0000 7fef39d9b640 1 -- 172.21.15.7:0/3624791840 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fef28004800 msgr2=0x7fef3c148b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.359+0000 7fef39d9b640 1 --2- 172.21.15.7:0/3624791840 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fef28004800 0x7fef3c148b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.359+0000 7fef39d9b640 1 -- 172.21.15.7:0/3624791840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef3c0cc090 msgr2=0x7fef3c0b8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.359+0000 7fef39d9b640 1 --2- 172.21.15.7:0/3624791840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef3c0cc090 0x7fef3c0b8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.359+0000 7fef39d9b640 1 -- 172.21.15.7:0/3624791840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3c14b5a0 con 0x7fef3c0cbc10 2024-04-25T09:55:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.359+0000 7fef3a59c640 1 --2- 172.21.15.7:0/3624791840 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fef28004800 0x7fef3c148b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.360+0000 7fef39d9b640 1 --2- 172.21.15.7:0/3624791840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef3c0cbc10 0x7fef3c0b80f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fef2400c360 tx=0x7fef3c0d3f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.360+0000 7fef32ffd640 1 -- 172.21.15.7:0/3624791840 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef24041070 con 0x7fef3c0cbc10 2024-04-25T09:55:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.360+0000 7fef32ffd640 1 -- 172.21.15.7:0/3624791840 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef24004e20 con 0x7fef3c0cbc10 2024-04-25T09:55:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.360+0000 7fef32ffd640 1 -- 172.21.15.7:0/3624791840 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef24007d10 con 0x7fef3c0cbc10 2024-04-25T09:55:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.360+0000 7fef40a1b640 1 -- 172.21.15.7:0/3624791840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef3c14b880 con 0x7fef3c0cbc10 2024-04-25T09:55:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.360+0000 7fef40a1b640 1 -- 172.21.15.7:0/3624791840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef3c14be40 con 0x7fef3c0cbc10 2024-04-25T09:55:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.361+0000 7fef40a1b640 1 -- 172.21.15.7:0/3624791840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef3c068f60 con 0x7fef3c0cbc10 2024-04-25T09:55:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.361+0000 7fef32ffd640 1 -- 172.21.15.7:0/3624791840 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fef24044070 con 0x7fef3c0cbc10 2024-04-25T09:55:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.361+0000 7fef32ffd640 1 --2- 172.21.15.7:0/3624791840 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fef1c06b4d0 0x7fef1c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.362+0000 7fef32ffd640 1 -- 172.21.15.7:0/3624791840 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fef240aaec0 con 0x7fef3c0cbc10 2024-04-25T09:55:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.362+0000 7fef3a59c640 1 --2- 172.21.15.7:0/3624791840 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fef1c06b4d0 0x7fef1c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.362+0000 7fef3a59c640 1 --2- 172.21.15.7:0/3624791840 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fef1c06b4d0 0x7fef1c06d990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fef3c0b8ef0 tx=0x7fef34008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:09.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.366+0000 7fef32ffd640 1 -- 172.21.15.7:0/3624791840 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fef24079b40 con 0x7fef3c0cbc10 2024-04-25T09:55:09.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.545+0000 7fef40a1b640 1 -- 172.21.15.7:0/3624791840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fef3c0b5e60 con 0x7fef3c0cbc10 2024-04-25T09:55:09.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.545+0000 7fef32ffd640 1 -- 172.21.15.7:0/3624791840 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fef24079440 con 0x7fef3c0cbc10 2024-04-25T09:55:09.548 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T09:55:09.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.547+0000 7fef40a1b640 1 -- 172.21.15.7:0/3624791840 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fef1c06b4d0 msgr2=0x7fef1c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:09.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.547+0000 7fef40a1b640 1 --2- 172.21.15.7:0/3624791840 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fef1c06b4d0 0x7fef1c06d990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fef3c0b8ef0 tx=0x7fef34008040 comp rx=0 tx=0).stop 2024-04-25T09:55:09.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.547+0000 7fef40a1b640 1 -- 172.21.15.7:0/3624791840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef3c0cbc10 msgr2=0x7fef3c0b80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:09.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.547+0000 7fef40a1b640 1 --2- 172.21.15.7:0/3624791840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef3c0cbc10 0x7fef3c0b80f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fef2400c360 tx=0x7fef3c0d3f20 comp rx=0 tx=0).stop 2024-04-25T09:55:09.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.547+0000 7fef40a1b640 1 -- 172.21.15.7:0/3624791840 shutdown_connections 2024-04-25T09:55:09.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.547+0000 7fef40a1b640 1 --2- 172.21.15.7:0/3624791840 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fef1c06b4d0 0x7fef1c06d990 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.547+0000 7fef40a1b640 1 --2- 172.21.15.7:0/3624791840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef3c0cc090 0x7fef3c0b8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.547+0000 7fef40a1b640 1 --2- 172.21.15.7:0/3624791840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef3c0cbc10 0x7fef3c0b80f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.547+0000 7fef40a1b640 1 --2- 172.21.15.7:0/3624791840 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fef28004800 0x7fef3c148b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.547+0000 7fef40a1b640 1 -- 172.21.15.7:0/3624791840 >> 172.21.15.7:0/3624791840 conn(0x7fef3c072680 msgr2=0x7fef3c164d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:09.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.547+0000 7fef40a1b640 1 -- 172.21.15.7:0/3624791840 shutdown_connections 2024-04-25T09:55:09.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.547+0000 7fef40a1b640 1 -- 172.21.15.7:0/3624791840 wait complete. 2024-04-25T09:55:09.561 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:55:09.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.666+0000 7f6db72b6640 1 Processor -- start 2024-04-25T09:55:09.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.666+0000 7f6db72b6640 1 -- start start 2024-04-25T09:55:09.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.667+0000 7f6db72b6640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6db0143fb0 0x7f6db00b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:09.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.667+0000 7f6db72b6640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6db00ced20 0x7f6db006e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:09.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.667+0000 7f6db72b6640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db00b2ee0 con 0x7f6db006e240 2024-04-25T09:55:09.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.667+0000 7f6db72b6640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db00b3150 con 0x7f6db0143fb0 2024-04-25T09:55:09.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.667+0000 7f6db72b6640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db00b3430 con 0x7f6db00ced20 2024-04-25T09:55:09.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.667+0000 7f6db5052640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6db0143fb0 0x7f6db00b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:09.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.667+0000 7f6db5052640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6db0143fb0 0x7f6db00b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55702/0 (socket says 172.21.15.7:55702) 2024-04-25T09:55:09.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.667+0000 7f6db5052640 1 -- 172.21.15.7:0/1015259160 learned_addr learned my addr 172.21.15.7:0/1015259160 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:09.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.667+0000 7f6db5853640 1 --2- 172.21.15.7:0/1015259160 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6db00ced20 0x7f6db006e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:09.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.667+0000 7f6db5052640 1 -- 172.21.15.7:0/1015259160 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6db00ced20 msgr2=0x7f6db006e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:09.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.667+0000 7f6db5052640 1 --2- 172.21.15.7:0/1015259160 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6db00ced20 0x7f6db006e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.667+0000 7f6db5052640 1 -- 172.21.15.7:0/1015259160 >> v1:172.21.15.55:6789/0 conn(0x7f6db006e240 legacy=0x7f6db00ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.667+0000 7f6db5052640 1 -- 172.21.15.7:0/1015259160 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db00b3710 con 0x7f6db0143fb0 2024-04-25T09:55:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.668+0000 7f6db5052640 1 --2- 172.21.15.7:0/1015259160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6db0143fb0 0x7f6db00b3c30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6dac009870 tx=0x7f6dac02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f809a312a177d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.668+0000 7f6da7fff640 1 -- 172.21.15.7:0/1015259160 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac037070 con 0x7f6db0143fb0 2024-04-25T09:55:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.668+0000 7f6da7fff640 1 -- 172.21.15.7:0/1015259160 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dac032440 con 0x7f6db0143fb0 2024-04-25T09:55:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.668+0000 7f6da7fff640 1 -- 172.21.15.7:0/1015259160 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac032810 con 0x7f6db0143fb0 2024-04-25T09:55:09.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.669+0000 7f6db72b6640 1 -- 172.21.15.7:0/1015259160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6db0143fb0 msgr2=0x7f6db00b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:09.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.669+0000 7f6db72b6640 1 --2- 172.21.15.7:0/1015259160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6db0143fb0 0x7f6db00b3c30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6dac009870 tx=0x7f6dac02a210 comp rx=0 tx=0).stop 2024-04-25T09:55:09.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.669+0000 7f6db72b6640 1 -- 172.21.15.7:0/1015259160 shutdown_connections 2024-04-25T09:55:09.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.669+0000 7f6db72b6640 1 --2- 172.21.15.7:0/1015259160 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6db00ced20 0x7f6db006e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.669+0000 7f6db72b6640 1 --2- 172.21.15.7:0/1015259160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6db0143fb0 0x7f6db00b3c30 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.669+0000 7f6db72b6640 1 -- 172.21.15.7:0/1015259160 >> 172.21.15.7:0/1015259160 conn(0x7f6db006ab60 msgr2=0x7f6db006af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:09.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.669+0000 7f6db72b6640 1 -- 172.21.15.7:0/1015259160 shutdown_connections 2024-04-25T09:55:09.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.669+0000 7f6db72b6640 1 -- 172.21.15.7:0/1015259160 wait complete. 2024-04-25T09:55:09.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.670+0000 7f6db72b6640 1 Processor -- start 2024-04-25T09:55:09.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.670+0000 7f6db72b6640 1 -- start start 2024-04-25T09:55:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.671+0000 7f6db72b6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6db006e240 0x7f6db0159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.671+0000 7f6db72b6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6db00ced20 0x7f6db00a8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.671+0000 7f6db72b6640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6db0143fb0 0x7f6db0142460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.671+0000 7f6db72b6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db015ac70 con 0x7f6db00ced20 2024-04-25T09:55:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.671+0000 7f6db72b6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db00cf2f0 con 0x7f6db006e240 2024-04-25T09:55:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.671+0000 7f6db72b6640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db015adf0 con 0x7f6db0143fb0 2024-04-25T09:55:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.671+0000 7f6db4851640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6db00ced20 0x7f6db00a8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.671+0000 7f6db4851640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6db00ced20 0x7f6db00a8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55712/0 (socket says 172.21.15.7:55712) 2024-04-25T09:55:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.671+0000 7f6db4851640 1 -- 172.21.15.7:0/267972206 learned_addr learned my addr 172.21.15.7:0/267972206 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.671+0000 7f6db5853640 1 --2- 172.21.15.7:0/267972206 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6db0143fb0 0x7f6db0142460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.671+0000 7f6db5052640 1 --2- 172.21.15.7:0/267972206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6db006e240 0x7f6db0159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.671+0000 7f6db4851640 1 -- 172.21.15.7:0/267972206 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6db0143fb0 msgr2=0x7f6db0142460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.671+0000 7f6db4851640 1 --2- 172.21.15.7:0/267972206 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6db0143fb0 0x7f6db0142460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.671+0000 7f6db4851640 1 -- 172.21.15.7:0/267972206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6db006e240 msgr2=0x7f6db0159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.671+0000 7f6db4851640 1 --2- 172.21.15.7:0/267972206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6db006e240 0x7f6db0159e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.671+0000 7f6db4851640 1 -- 172.21.15.7:0/267972206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db0130650 con 0x7f6db00ced20 2024-04-25T09:55:09.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.671+0000 7f6db4851640 1 --2- 172.21.15.7:0/267972206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6db00ced20 0x7f6db00a8680 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6da000c430 tx=0x7f6da000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:09.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.671+0000 7f6da5ffb640 1 -- 172.21.15.7:0/267972206 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da0011790 con 0x7f6db00ced20 2024-04-25T09:55:09.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.671+0000 7f6da5ffb640 1 -- 172.21.15.7:0/267972206 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da0017070 con 0x7f6db00ced20 2024-04-25T09:55:09.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.671+0000 7f6db72b6640 1 -- 172.21.15.7:0/267972206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db01308f0 con 0x7f6db00ced20 2024-04-25T09:55:09.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.671+0000 7f6da5ffb640 1 -- 172.21.15.7:0/267972206 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da0011bb0 con 0x7f6db00ced20 2024-04-25T09:55:09.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.672+0000 7f6db72b6640 1 -- 172.21.15.7:0/267972206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db0130eb0 con 0x7f6db00ced20 2024-04-25T09:55:09.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.673+0000 7f6db72b6640 1 -- 172.21.15.7:0/267972206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db0068f60 con 0x7f6db00ced20 2024-04-25T09:55:09.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.673+0000 7f6da5ffb640 1 -- 172.21.15.7:0/267972206 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6da001c460 con 0x7f6db00ced20 2024-04-25T09:55:09.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.673+0000 7f6da5ffb640 1 --2- 172.21.15.7:0/267972206 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6d9406b4d0 0x7f6d9406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:09.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.673+0000 7f6da5ffb640 1 -- 172.21.15.7:0/267972206 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f6da008a380 con 0x7f6db00ced20 2024-04-25T09:55:09.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.673+0000 7f6db5052640 1 --2- 172.21.15.7:0/267972206 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6d9406b4d0 0x7f6d9406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:09.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.674+0000 7f6db5052640 1 --2- 172.21.15.7:0/267972206 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6d9406b4d0 0x7f6d9406d990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6dac034000 tx=0x7f6dac02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:09.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.677+0000 7f6da5ffb640 1 -- 172.21.15.7:0/267972206 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6da00587b0 con 0x7f6db00ced20 2024-04-25T09:55:09.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.857+0000 7f6db72b6640 1 -- 172.21.15.7:0/267972206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6db006c1a0 con 0x7f6db00ced20 2024-04-25T09:55:09.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.857+0000 7f6da5ffb640 1 -- 172.21.15.7:0/267972206 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6da005c850 con 0x7f6db00ced20 2024-04-25T09:55:09.860 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:55:09.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.859+0000 7f6db72b6640 1 -- 172.21.15.7:0/267972206 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6d9406b4d0 msgr2=0x7f6d9406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:09.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.859+0000 7f6db72b6640 1 --2- 172.21.15.7:0/267972206 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6d9406b4d0 0x7f6d9406d990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6dac034000 tx=0x7f6dac02e000 comp rx=0 tx=0).stop 2024-04-25T09:55:09.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.859+0000 7f6db72b6640 1 -- 172.21.15.7:0/267972206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6db00ced20 msgr2=0x7f6db00a8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:09.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.859+0000 7f6db72b6640 1 --2- 172.21.15.7:0/267972206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6db00ced20 0x7f6db00a8680 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6da000c430 tx=0x7f6da000c8f0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.859+0000 7f6db72b6640 1 -- 172.21.15.7:0/267972206 shutdown_connections 2024-04-25T09:55:09.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.859+0000 7f6db72b6640 1 --2- 172.21.15.7:0/267972206 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6d9406b4d0 0x7f6d9406d990 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.859+0000 7f6db72b6640 1 --2- 172.21.15.7:0/267972206 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6db0143fb0 0x7f6db0142460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.859+0000 7f6db72b6640 1 --2- 172.21.15.7:0/267972206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6db00ced20 0x7f6db00a8680 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.859+0000 7f6db72b6640 1 --2- 172.21.15.7:0/267972206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6db006e240 0x7f6db0159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.859+0000 7f6db72b6640 1 -- 172.21.15.7:0/267972206 >> 172.21.15.7:0/267972206 conn(0x7f6db006ab60 msgr2=0x7f6db00cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:09.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.859+0000 7f6db72b6640 1 -- 172.21.15.7:0/267972206 shutdown_connections 2024-04-25T09:55:09.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.859+0000 7f6db72b6640 1 -- 172.21.15.7:0/267972206 wait complete. 2024-04-25T09:55:09.873 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:55:09.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.974+0000 7f90873f9640 1 Processor -- start 2024-04-25T09:55:09.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.974+0000 7f90873f9640 1 -- start start 2024-04-25T09:55:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.975+0000 7f90873f9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f90800d07c0 0x7f90800b9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.975+0000 7f90873f9640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f90800d1bd0 0x7f90800b6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.975+0000 7f90873f9640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90800d2060 con 0x7f908015de50 2024-04-25T09:55:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.975+0000 7f90873f9640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90800d2320 con 0x7f90800d1bd0 2024-04-25T09:55:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.975+0000 7f90873f9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90800d2600 con 0x7f90800d07c0 2024-04-25T09:55:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.975+0000 7f9085996640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f90800d1bd0 0x7f90800b6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.975+0000 7f9084994640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f908015de50 0x7f90800d0ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:59178/0 (socket says 172.21.15.7:59178) 2024-04-25T09:55:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.975+0000 7f9084994640 1 -- 172.21.15.7:0/3459092571 learned_addr learned my addr 172.21.15.7:0/3459092571 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.975+0000 7f9085195640 1 --2- 172.21.15.7:0/3459092571 >> v2:172.21.15.55:3300/0 conn(0x7f90800d07c0 0x7f90800b9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.976+0000 7f9085996640 1 -- 172.21.15.7:0/3459092571 >> v2:172.21.15.55:3300/0 conn(0x7f90800d07c0 msgr2=0x7f90800b9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.976+0000 7f9085996640 1 --2- 172.21.15.7:0/3459092571 >> v2:172.21.15.55:3300/0 conn(0x7f90800d07c0 0x7f90800b9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.976+0000 7f907ffff640 1 -- 172.21.15.7:0/3459092571 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3842128409 0 0) 0x7f90800d2060 con 0x7f908015de50 2024-04-25T09:55:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.976+0000 7f9085996640 1 -- 172.21.15.7:0/3459092571 >> v1:172.21.15.7:6789/0 conn(0x7f908015de50 legacy=0x7f90800d0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.976+0000 7f9085996640 1 -- 172.21.15.7:0/3459092571 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90800d28e0 con 0x7f90800d1bd0 2024-04-25T09:55:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.976+0000 7f9085996640 1 --2- 172.21.15.7:0/3459092571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90800d1bd0 0x7f90800b6980 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f90800b5940 tx=0x7f907002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5bf8265e9189ab1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.977+0000 7f907ffff640 1 -- 172.21.15.7:0/3459092571 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9070007740 con 0x7f90800d1bd0 2024-04-25T09:55:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.977+0000 7f907ffff640 1 -- 172.21.15.7:0/3459092571 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90700078e0 con 0x7f90800d1bd0 2024-04-25T09:55:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.977+0000 7f907ffff640 1 -- 172.21.15.7:0/3459092571 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9070007cb0 con 0x7f90800d1bd0 2024-04-25T09:55:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.977+0000 7f90873f9640 1 -- 172.21.15.7:0/3459092571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90800d1bd0 msgr2=0x7f90800b6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.977+0000 7f90873f9640 1 --2- 172.21.15.7:0/3459092571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90800d1bd0 0x7f90800b6980 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f90800b5940 tx=0x7f907002a680 comp rx=0 tx=0).stop 2024-04-25T09:55:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.977+0000 7f90873f9640 1 -- 172.21.15.7:0/3459092571 shutdown_connections 2024-04-25T09:55:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.977+0000 7f90873f9640 1 --2- 172.21.15.7:0/3459092571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90800d1bd0 0x7f90800b6980 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.977+0000 7f90873f9640 1 --2- 172.21.15.7:0/3459092571 >> v2:172.21.15.55:3300/0 conn(0x7f90800d07c0 0x7f90800b9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.977+0000 7f90873f9640 1 -- 172.21.15.7:0/3459092571 >> 172.21.15.7:0/3459092571 conn(0x7f90800726b0 msgr2=0x7f9080072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:09.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.977+0000 7f90873f9640 1 -- 172.21.15.7:0/3459092571 shutdown_connections 2024-04-25T09:55:09.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.977+0000 7f90873f9640 1 -- 172.21.15.7:0/3459092571 wait complete. 2024-04-25T09:55:09.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.978+0000 7f90873f9640 1 Processor -- start 2024-04-25T09:55:09.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.979+0000 7f90873f9640 1 -- start start 2024-04-25T09:55:09.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.979+0000 7f90873f9640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90800d07c0 0x7f90800c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:09.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.979+0000 7f90873f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90800d1bd0 0x7f908015c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:09.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.979+0000 7f90873f9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f908015de50 0x7f908015ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:09.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.979+0000 7f90873f9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90800d33c0 con 0x7f908015de50 2024-04-25T09:55:09.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.979+0000 7f90873f9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90800d2ea0 con 0x7f90800d1bd0 2024-04-25T09:55:09.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.979+0000 7f90873f9640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90801f3670 con 0x7f90800d07c0 2024-04-25T09:55:09.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.979+0000 7f9085996640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f908015de50 0x7f908015ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:09.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.979+0000 7f9085996640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f908015de50 0x7f908015ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38426/0 (socket says 172.21.15.7:38426) 2024-04-25T09:55:09.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.979+0000 7f9085996640 1 -- 172.21.15.7:0/2890695276 learned_addr learned my addr 172.21.15.7:0/2890695276 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:09.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.980+0000 7f9085195640 1 --2- 172.21.15.7:0/2890695276 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90800d07c0 0x7f90800c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:09.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.980+0000 7f9084994640 1 --2- 172.21.15.7:0/2890695276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90800d1bd0 0x7f908015c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:09.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.980+0000 7f9085996640 1 -- 172.21.15.7:0/2890695276 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90800d07c0 msgr2=0x7f90800c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:09.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.980+0000 7f9085996640 1 --2- 172.21.15.7:0/2890695276 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90800d07c0 0x7f90800c7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.980+0000 7f9085996640 1 -- 172.21.15.7:0/2890695276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90800d1bd0 msgr2=0x7f908015c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:09.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.980+0000 7f9085996640 1 --2- 172.21.15.7:0/2890695276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90800d1bd0 0x7f908015c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:09.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.980+0000 7f9085996640 1 -- 172.21.15.7:0/2890695276 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90801f3950 con 0x7f908015de50 2024-04-25T09:55:09.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.980+0000 7f9084994640 1 --2- 172.21.15.7:0/2890695276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90800d1bd0 0x7f908015c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:09.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.980+0000 7f9085996640 1 --2- 172.21.15.7:0/2890695276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f908015de50 0x7f908015ce80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f907002ac70 tx=0x7f9070004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:09.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.980+0000 7f907dffb640 1 -- 172.21.15.7:0/2890695276 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9070040070 con 0x7f908015de50 2024-04-25T09:55:09.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.980+0000 7f907dffb640 1 -- 172.21.15.7:0/2890695276 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9070031bc0 con 0x7f908015de50 2024-04-25T09:55:09.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.980+0000 7f90873f9640 1 -- 172.21.15.7:0/2890695276 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90801f3c30 con 0x7f908015de50 2024-04-25T09:55:09.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.980+0000 7f907dffb640 1 -- 172.21.15.7:0/2890695276 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9070009450 con 0x7f908015de50 2024-04-25T09:55:09.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.980+0000 7f90873f9640 1 -- 172.21.15.7:0/2890695276 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90800c8000 con 0x7f908015de50 2024-04-25T09:55:09.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.981+0000 7f90873f9640 1 -- 172.21.15.7:0/2890695276 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9080068f60 con 0x7f908015de50 2024-04-25T09:55:09.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.982+0000 7f907dffb640 1 -- 172.21.15.7:0/2890695276 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9070039040 con 0x7f908015de50 2024-04-25T09:55:09.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.982+0000 7f907dffb640 1 --2- 172.21.15.7:0/2890695276 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f906c06b4d0 0x7f906c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:09.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.983+0000 7f9085195640 1 --2- 172.21.15.7:0/2890695276 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f906c06b4d0 0x7f906c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:09.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.983+0000 7f907dffb640 1 -- 172.21.15.7:0/2890695276 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f90700abf30 con 0x7f908015de50 2024-04-25T09:55:09.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.983+0000 7f9085195640 1 --2- 172.21.15.7:0/2890695276 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f906c06b4d0 0x7f906c06d990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9078009ad0 tx=0x7f9078008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:09.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:09.987+0000 7f907dffb640 1 -- 172.21.15.7:0/2890695276 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f907007a910 con 0x7f908015de50 2024-04-25T09:55:10.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.165+0000 7f90873f9640 1 -- 172.21.15.7:0/2890695276 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f90800b8100 con 0x7f908015de50 2024-04-25T09:55:10.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.166+0000 7f907dffb640 1 -- 172.21.15.7:0/2890695276 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f907007a210 con 0x7f908015de50 2024-04-25T09:55:10.168 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T09:55:10.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.167+0000 7f90873f9640 1 -- 172.21.15.7:0/2890695276 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f906c06b4d0 msgr2=0x7f906c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:10.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.167+0000 7f90873f9640 1 --2- 172.21.15.7:0/2890695276 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f906c06b4d0 0x7f906c06d990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9078009ad0 tx=0x7f9078008040 comp rx=0 tx=0).stop 2024-04-25T09:55:10.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.167+0000 7f90873f9640 1 -- 172.21.15.7:0/2890695276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f908015de50 msgr2=0x7f908015ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:10.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.167+0000 7f90873f9640 1 --2- 172.21.15.7:0/2890695276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f908015de50 0x7f908015ce80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f907002ac70 tx=0x7f9070004a40 comp rx=0 tx=0).stop 2024-04-25T09:55:10.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.167+0000 7f90873f9640 1 -- 172.21.15.7:0/2890695276 shutdown_connections 2024-04-25T09:55:10.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.167+0000 7f90873f9640 1 --2- 172.21.15.7:0/2890695276 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f906c06b4d0 0x7f906c06d990 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:10.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.167+0000 7f90873f9640 1 --2- 172.21.15.7:0/2890695276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f908015de50 0x7f908015ce80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:10.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.167+0000 7f90873f9640 1 --2- 172.21.15.7:0/2890695276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90800d1bd0 0x7f908015c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:10.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.167+0000 7f90873f9640 1 --2- 172.21.15.7:0/2890695276 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90800d07c0 0x7f90800c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:10.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.167+0000 7f90873f9640 1 -- 172.21.15.7:0/2890695276 >> 172.21.15.7:0/2890695276 conn(0x7f90800726b0 msgr2=0x7f90800b6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:10.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.168+0000 7f90873f9640 1 -- 172.21.15.7:0/2890695276 shutdown_connections 2024-04-25T09:55:10.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.168+0000 7f90873f9640 1 -- 172.21.15.7:0/2890695276 wait complete. 2024-04-25T09:55:10.181 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:55:10.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.281+0000 7fab338a3640 1 Processor -- start 2024-04-25T09:55:10.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.281+0000 7fab338a3640 1 -- start start 2024-04-25T09:55:10.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.282+0000 7fab338a3640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fab2c15d990 0x7fab2c0b1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:10.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.282+0000 7fab338a3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fab2c0d1c90 0x7fab2c06c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:10.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.282+0000 7fab338a3640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab2c0cbcb0 con 0x7fab2c0b29c0 2024-04-25T09:55:10.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.282+0000 7fab338a3640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab2c0b1df0 con 0x7fab2c15d990 2024-04-25T09:55:10.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.282+0000 7fab338a3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab2c0b20d0 con 0x7fab2c0d1c90 2024-04-25T09:55:10.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.282+0000 7fab3163f640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fab2c15d990 0x7fab2c0b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:10.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.282+0000 7fab30e3e640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fab2c0b29c0 0x7fab2c0d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:59190/0 (socket says 172.21.15.7:59190) 2024-04-25T09:55:10.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.282+0000 7fab30e3e640 1 -- 172.21.15.7:0/2147298109 learned_addr learned my addr 172.21.15.7:0/2147298109 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:10.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.283+0000 7fab31e40640 1 --2- 172.21.15.7:0/2147298109 >> v2:172.21.15.55:3300/0 conn(0x7fab2c0d1c90 0x7fab2c06c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:10.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.283+0000 7fab3163f640 1 -- 172.21.15.7:0/2147298109 >> v2:172.21.15.55:3300/0 conn(0x7fab2c0d1c90 msgr2=0x7fab2c06c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:10.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.283+0000 7fab3163f640 1 --2- 172.21.15.7:0/2147298109 >> v2:172.21.15.55:3300/0 conn(0x7fab2c0d1c90 0x7fab2c06c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:10.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.283+0000 7fab3163f640 1 -- 172.21.15.7:0/2147298109 >> v1:172.21.15.7:6789/0 conn(0x7fab2c0b29c0 legacy=0x7fab2c0d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:10.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.283+0000 7fab2bfff640 1 -- 172.21.15.7:0/2147298109 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4036038329 0 0) 0x7fab2c0cbcb0 con 0x7fab2c0b29c0 2024-04-25T09:55:10.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.283+0000 7fab3163f640 1 -- 172.21.15.7:0/2147298109 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab2c0b23b0 con 0x7fab2c15d990 2024-04-25T09:55:10.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.283+0000 7fab3163f640 1 --2- 172.21.15.7:0/2147298109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab2c15d990 0x7fab2c0b1480 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fab2c0cbc40 tx=0x7fab1c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5f32960069bbdd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:10.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.284+0000 7fab2bfff640 1 -- 172.21.15.7:0/2147298109 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c007740 con 0x7fab2c15d990 2024-04-25T09:55:10.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.284+0000 7fab2bfff640 1 -- 172.21.15.7:0/2147298109 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1c0078e0 con 0x7fab2c15d990 2024-04-25T09:55:10.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.284+0000 7fab2bfff640 1 -- 172.21.15.7:0/2147298109 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c007cb0 con 0x7fab2c15d990 2024-04-25T09:55:10.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.284+0000 7fab338a3640 1 -- 172.21.15.7:0/2147298109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab2c15d990 msgr2=0x7fab2c0b1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:10.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.284+0000 7fab338a3640 1 --2- 172.21.15.7:0/2147298109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab2c15d990 0x7fab2c0b1480 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fab2c0cbc40 tx=0x7fab1c02a5f0 comp rx=0 tx=0).stop 2024-04-25T09:55:10.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.284+0000 7fab338a3640 1 -- 172.21.15.7:0/2147298109 shutdown_connections 2024-04-25T09:55:10.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.284+0000 7fab338a3640 1 --2- 172.21.15.7:0/2147298109 >> v2:172.21.15.55:3300/0 conn(0x7fab2c0d1c90 0x7fab2c06c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:10.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.284+0000 7fab338a3640 1 --2- 172.21.15.7:0/2147298109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab2c15d990 0x7fab2c0b1480 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:10.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.284+0000 7fab338a3640 1 -- 172.21.15.7:0/2147298109 >> 172.21.15.7:0/2147298109 conn(0x7fab2c08af80 msgr2=0x7fab2c08b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:10.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.284+0000 7fab338a3640 1 -- 172.21.15.7:0/2147298109 shutdown_connections 2024-04-25T09:55:10.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.284+0000 7fab338a3640 1 -- 172.21.15.7:0/2147298109 wait complete. 2024-04-25T09:55:10.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.285+0000 7fab338a3640 1 Processor -- start 2024-04-25T09:55:10.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.285+0000 7fab338a3640 1 -- start start 2024-04-25T09:55:10.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.286+0000 7fab338a3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab2c0b29c0 0x7fab2c14b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:10.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.286+0000 7fab338a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab2c0d1c90 0x7fab2c14e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:10.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.286+0000 7fab338a3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab2c15d990 0x7fab2c14e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:10.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.286+0000 7fab338a3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2c0b19c0 con 0x7fab2c15d990 2024-04-25T09:55:10.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.286+0000 7fab338a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2c0cf9d0 con 0x7fab2c0d1c90 2024-04-25T09:55:10.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.286+0000 7fab338a3640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab2c0b1b40 con 0x7fab2c0b29c0 2024-04-25T09:55:10.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.286+0000 7fab31e40640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab2c15d990 0x7fab2c14e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:10.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.286+0000 7fab31e40640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab2c15d990 0x7fab2c14e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38454/0 (socket says 172.21.15.7:38454) 2024-04-25T09:55:10.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.286+0000 7fab31e40640 1 -- 172.21.15.7:0/1978382349 learned_addr learned my addr 172.21.15.7:0/1978382349 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:10.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.286+0000 7fab3163f640 1 --2- 172.21.15.7:0/1978382349 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab2c0b29c0 0x7fab2c14b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:10.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.286+0000 7fab30e3e640 1 --2- 172.21.15.7:0/1978382349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab2c0d1c90 0x7fab2c14e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:10.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.287+0000 7fab31e40640 1 -- 172.21.15.7:0/1978382349 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab2c0b29c0 msgr2=0x7fab2c14b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:10.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.287+0000 7fab31e40640 1 --2- 172.21.15.7:0/1978382349 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab2c0b29c0 0x7fab2c14b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:10.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.287+0000 7fab31e40640 1 -- 172.21.15.7:0/1978382349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab2c0d1c90 msgr2=0x7fab2c14e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:10.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.287+0000 7fab31e40640 1 --2- 172.21.15.7:0/1978382349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab2c0d1c90 0x7fab2c14e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:10.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.287+0000 7fab31e40640 1 -- 172.21.15.7:0/1978382349 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab2c15ee70 con 0x7fab2c15d990 2024-04-25T09:55:10.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.287+0000 7fab30e3e640 1 --2- 172.21.15.7:0/1978382349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab2c0d1c90 0x7fab2c14e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:10.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.287+0000 7fab31e40640 1 --2- 172.21.15.7:0/1978382349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab2c15d990 0x7fab2c14e570 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fab2400d5d0 tx=0x7fab2400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:10.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.287+0000 7fab29ffb640 1 -- 172.21.15.7:0/1978382349 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab240125f0 con 0x7fab2c15d990 2024-04-25T09:55:10.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.287+0000 7fab29ffb640 1 -- 172.21.15.7:0/1978382349 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab24019070 con 0x7fab2c15d990 2024-04-25T09:55:10.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.287+0000 7fab29ffb640 1 -- 172.21.15.7:0/1978382349 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab240129d0 con 0x7fab2c15d990 2024-04-25T09:55:10.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.287+0000 7fab338a3640 1 -- 172.21.15.7:0/1978382349 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab2c14bcb0 con 0x7fab2c15d990 2024-04-25T09:55:10.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.287+0000 7fab338a3640 1 -- 172.21.15.7:0/1978382349 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab2c0c9e70 con 0x7fab2c15d990 2024-04-25T09:55:10.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.288+0000 7fab338a3640 1 -- 172.21.15.7:0/1978382349 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab2c0cf5e0 con 0x7fab2c15d990 2024-04-25T09:55:10.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.288+0000 7fab29ffb640 1 -- 172.21.15.7:0/1978382349 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fab24012b70 con 0x7fab2c15d990 2024-04-25T09:55:10.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.289+0000 7fab29ffb640 1 --2- 172.21.15.7:0/1978382349 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fab1806b4d0 0x7fab1806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:10.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.289+0000 7fab29ffb640 1 -- 172.21.15.7:0/1978382349 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fab2408a9c0 con 0x7fab2c15d990 2024-04-25T09:55:10.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.289+0000 7fab3163f640 1 --2- 172.21.15.7:0/1978382349 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fab1806b4d0 0x7fab1806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:10.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.289+0000 7fab3163f640 1 --2- 172.21.15.7:0/1978382349 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fab1806b4d0 0x7fab1806d990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fab1c034000 tx=0x7fab1c02f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:10.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.293+0000 7fab29ffb640 1 -- 172.21.15.7:0/1978382349 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fab2c0cf5e0 con 0x7fab2c15d990 2024-04-25T09:55:10.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.474+0000 7fab338a3640 1 -- 172.21.15.7:0/1978382349 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fab2c068f60 con 0x7fab2c15d990 2024-04-25T09:55:10.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.474+0000 7fab29ffb640 1 -- 172.21.15.7:0/1978382349 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fab2408ce20 con 0x7fab2c15d990 2024-04-25T09:55:10.477 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:55:10.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.476+0000 7fab338a3640 1 -- 172.21.15.7:0/1978382349 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fab1806b4d0 msgr2=0x7fab1806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:10.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.476+0000 7fab338a3640 1 --2- 172.21.15.7:0/1978382349 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fab1806b4d0 0x7fab1806d990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fab1c034000 tx=0x7fab1c02f000 comp rx=0 tx=0).stop 2024-04-25T09:55:10.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.476+0000 7fab338a3640 1 -- 172.21.15.7:0/1978382349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab2c15d990 msgr2=0x7fab2c14e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:10.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.476+0000 7fab338a3640 1 --2- 172.21.15.7:0/1978382349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab2c15d990 0x7fab2c14e570 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fab2400d5d0 tx=0x7fab2400da90 comp rx=0 tx=0).stop 2024-04-25T09:55:10.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.476+0000 7fab338a3640 1 -- 172.21.15.7:0/1978382349 shutdown_connections 2024-04-25T09:55:10.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.476+0000 7fab338a3640 1 --2- 172.21.15.7:0/1978382349 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fab1806b4d0 0x7fab1806d990 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:10.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.476+0000 7fab338a3640 1 --2- 172.21.15.7:0/1978382349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab2c15d990 0x7fab2c14e570 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:10.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.476+0000 7fab338a3640 1 --2- 172.21.15.7:0/1978382349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab2c0d1c90 0x7fab2c14e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:10.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.476+0000 7fab338a3640 1 --2- 172.21.15.7:0/1978382349 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab2c0b29c0 0x7fab2c14b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:10.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.476+0000 7fab338a3640 1 -- 172.21.15.7:0/1978382349 >> 172.21.15.7:0/1978382349 conn(0x7fab2c08af80 msgr2=0x7fab2c06c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:10.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.476+0000 7fab338a3640 1 -- 172.21.15.7:0/1978382349 shutdown_connections 2024-04-25T09:55:10.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.476+0000 7fab338a3640 1 -- 172.21.15.7:0/1978382349 wait complete. 2024-04-25T09:55:10.490 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2024-04-25T09:55:10.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.588+0000 7f3b5a1ce640 1 Processor -- start 2024-04-25T09:55:10.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.588+0000 7f3b5a1ce640 1 -- start start 2024-04-25T09:55:10.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.589+0000 7f3b5a1ce640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3b5415dc10 0x7f3b541615f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:10.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.589+0000 7f3b5a1ce640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3b54161b30 0x7f3b540d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:10.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.589+0000 7f3b5a1ce640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b54162040 con 0x7f3b540b6b90 2024-04-25T09:55:10.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.589+0000 7f3b5a1ce640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b540d1d90 con 0x7f3b5415dc10 2024-04-25T09:55:10.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.589+0000 7f3b5a1ce640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b54162320 con 0x7f3b54161b30 2024-04-25T09:55:10.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.589+0000 7f3b52ffd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3b54161b30 0x7f3b540d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:10.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.589+0000 7f3b537fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3b5415dc10 0x7f3b541615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:10.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.589+0000 7f3b52ffd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3b54161b30 0x7f3b540d0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:55006/0 (socket says 172.21.15.7:55006) 2024-04-25T09:55:10.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.590+0000 7f3b537fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3b5415dc10 0x7f3b541615f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:40896/0 (socket says 172.21.15.7:40896) 2024-04-25T09:55:10.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.590+0000 7f3b52ffd640 1 -- 172.21.15.7:0/116065184 learned_addr learned my addr 172.21.15.7:0/116065184 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:10.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.590+0000 7f3b53fff640 1 --1- 172.21.15.7:0/116065184 >> v1:172.21.15.55:6789/0 conn(0x7f3b540b6b90 0x7f3b540b5330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:41020/0 (socket says 172.21.15.7:41020) 2024-04-25T09:55:10.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.590+0000 7f3b537fe640 1 -- 172.21.15.7:0/116065184 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3b54161b30 msgr2=0x7f3b540d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:10.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.590+0000 7f3b537fe640 1 --2- 172.21.15.7:0/116065184 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3b54161b30 0x7f3b540d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:10.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.590+0000 7f3b537fe640 1 -- 172.21.15.7:0/116065184 >> v1:172.21.15.55:6789/0 conn(0x7f3b540b6b90 legacy=0x7f3b540b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:10.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.590+0000 7f3b537fe640 1 -- 172.21.15.7:0/116065184 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b540d1fe0 con 0x7f3b5415dc10 2024-04-25T09:55:10.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.590+0000 7f3b52ffd640 1 --2- 172.21.15.7:0/116065184 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3b54161b30 0x7f3b540d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:55:10.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.591+0000 7f3b537fe640 1 --2- 172.21.15.7:0/116065184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b5415dc10 0x7f3b541615f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3b440097a0 tx=0x7f3b4402a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5397504397d11a5a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:10.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.591+0000 7f3b527fc640 1 -- 172.21.15.7:0/116065184 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b44037070 con 0x7f3b5415dc10 2024-04-25T09:55:10.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.591+0000 7f3b527fc640 1 -- 172.21.15.7:0/116065184 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4402adb0 con 0x7f3b5415dc10 2024-04-25T09:55:10.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.591+0000 7f3b527fc640 1 -- 172.21.15.7:0/116065184 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b44032660 con 0x7f3b5415dc10 2024-04-25T09:55:10.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.591+0000 7f3b5a1ce640 1 -- 172.21.15.7:0/116065184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b5415dc10 msgr2=0x7f3b541615f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:10.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.591+0000 7f3b5a1ce640 1 --2- 172.21.15.7:0/116065184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b5415dc10 0x7f3b541615f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3b440097a0 tx=0x7f3b4402a060 comp rx=0 tx=0).stop 2024-04-25T09:55:10.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.591+0000 7f3b5a1ce640 1 -- 172.21.15.7:0/116065184 shutdown_connections 2024-04-25T09:55:10.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.591+0000 7f3b5a1ce640 1 --2- 172.21.15.7:0/116065184 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3b54161b30 0x7f3b540d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:10.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.591+0000 7f3b5a1ce640 1 --2- 172.21.15.7:0/116065184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b5415dc10 0x7f3b541615f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:10.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.591+0000 7f3b5a1ce640 1 -- 172.21.15.7:0/116065184 >> 172.21.15.7:0/116065184 conn(0x7f3b54072290 msgr2=0x7f3b540726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:10.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.591+0000 7f3b5a1ce640 1 -- 172.21.15.7:0/116065184 shutdown_connections 2024-04-25T09:55:10.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.591+0000 7f3b5a1ce640 1 -- 172.21.15.7:0/116065184 wait complete. 2024-04-25T09:55:10.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.593+0000 7f3b5a1ce640 1 Processor -- start 2024-04-25T09:55:10.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.593+0000 7f3b5a1ce640 1 -- start start 2024-04-25T09:55:10.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.593+0000 7f3b5a1ce640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3b540b6b90 0x7f3b5415f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:10.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.594+0000 7f3b5a1ce640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b5415dc10 0x7f3b540b58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:10.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.594+0000 7f3b5a1ce640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b54161b30 0x7f3b540ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:10.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.594+0000 7f3b5a1ce640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b540d0900 con 0x7f3b54161b30 2024-04-25T09:55:10.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.594+0000 7f3b5a1ce640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b540d0780 con 0x7f3b5415dc10 2024-04-25T09:55:10.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.594+0000 7f3b5a1ce640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b540d0a80 con 0x7f3b540b6b90 2024-04-25T09:55:10.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.594+0000 7f3b53fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b54161b30 0x7f3b540ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:10.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.594+0000 7f3b53fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b54161b30 0x7f3b540ca980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38466/0 (socket says 172.21.15.7:38466) 2024-04-25T09:55:10.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.594+0000 7f3b53fff640 1 -- 172.21.15.7:0/4287108567 learned_addr learned my addr 172.21.15.7:0/4287108567 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:10.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.594+0000 7f3b537fe640 1 --2- 172.21.15.7:0/4287108567 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3b540b6b90 0x7f3b5415f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:10.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.594+0000 7f3b52ffd640 1 --2- 172.21.15.7:0/4287108567 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b5415dc10 0x7f3b540b58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:10.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.594+0000 7f3b53fff640 1 -- 172.21.15.7:0/4287108567 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3b540b6b90 msgr2=0x7f3b5415f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:10.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.594+0000 7f3b53fff640 1 --2- 172.21.15.7:0/4287108567 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3b540b6b90 0x7f3b5415f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:10.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.594+0000 7f3b53fff640 1 -- 172.21.15.7:0/4287108567 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b5415dc10 msgr2=0x7f3b540b58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:10.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.594+0000 7f3b53fff640 1 --2- 172.21.15.7:0/4287108567 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b5415dc10 0x7f3b540b58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:10.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.594+0000 7f3b53fff640 1 -- 172.21.15.7:0/4287108567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5415e170 con 0x7f3b54161b30 2024-04-25T09:55:10.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.594+0000 7f3b52ffd640 1 --2- 172.21.15.7:0/4287108567 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b5415dc10 0x7f3b540b58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:10.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.594+0000 7f3b53fff640 1 --2- 172.21.15.7:0/4287108567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b54161b30 0x7f3b540ca980 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c00c730 tx=0x7f3b4c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:10.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.594+0000 7f3b3bfff640 1 -- 172.21.15.7:0/4287108567 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c018070 con 0x7f3b54161b30 2024-04-25T09:55:10.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.594+0000 7f3b3bfff640 1 -- 172.21.15.7:0/4287108567 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4c004d60 con 0x7f3b54161b30 2024-04-25T09:55:10.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.594+0000 7f3b5a1ce640 1 -- 172.21.15.7:0/4287108567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b5415e450 con 0x7f3b54161b30 2024-04-25T09:55:10.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.594+0000 7f3b3bfff640 1 -- 172.21.15.7:0/4287108567 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c00a860 con 0x7f3b54161b30 2024-04-25T09:55:10.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.595+0000 7f3b5a1ce640 1 -- 172.21.15.7:0/4287108567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b5415ea10 con 0x7f3b54161b30 2024-04-25T09:55:10.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.595+0000 7f3b5a1ce640 1 -- 172.21.15.7:0/4287108567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b54068fd0 con 0x7f3b54161b30 2024-04-25T09:55:10.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.596+0000 7f3b3bfff640 1 -- 172.21.15.7:0/4287108567 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3b4c01b070 con 0x7f3b54161b30 2024-04-25T09:55:10.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.596+0000 7f3b3bfff640 1 --2- 172.21.15.7:0/4287108567 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3b4006b4d0 0x7f3b4006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:10.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.596+0000 7f3b3bfff640 1 -- 172.21.15.7:0/4287108567 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f3b4c0899b0 con 0x7f3b54161b30 2024-04-25T09:55:10.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.596+0000 7f3b537fe640 1 --2- 172.21.15.7:0/4287108567 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3b4006b4d0 0x7f3b4006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:10.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.597+0000 7f3b537fe640 1 --2- 172.21.15.7:0/4287108567 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3b4006b4d0 0x7f3b4006d990 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3b44034000 tx=0x7f3b4402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:10.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.600+0000 7f3b3bfff640 1 -- 172.21.15.7:0/4287108567 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3b4c058420 con 0x7f3b54161b30 2024-04-25T09:55:10.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:10.852+0000 7f3b5a1ce640 1 -- 172.21.15.7:0/4287108567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) v1 -- 0x7f3b540d1660 con 0x7f3b54161b30 2024-04-25T09:55:11.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.614+0000 7f3b3bfff640 1 -- 172.21.15.7:0/4287108567 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v66) v1 ==== 145+0+0 (secure 0 0 0) 0x7f3b4c057d20 con 0x7f3b54161b30 2024-04-25T09:55:11.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.617+0000 7f3b5a1ce640 1 -- 172.21.15.7:0/4287108567 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3b4006b4d0 msgr2=0x7f3b4006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:11.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.617+0000 7f3b5a1ce640 1 --2- 172.21.15.7:0/4287108567 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3b4006b4d0 0x7f3b4006d990 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3b44034000 tx=0x7f3b4402e000 comp rx=0 tx=0).stop 2024-04-25T09:55:11.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.617+0000 7f3b5a1ce640 1 -- 172.21.15.7:0/4287108567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b54161b30 msgr2=0x7f3b540ca980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:11.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.617+0000 7f3b5a1ce640 1 --2- 172.21.15.7:0/4287108567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b54161b30 0x7f3b540ca980 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c00c730 tx=0x7f3b4c00cbf0 comp rx=0 tx=0).stop 2024-04-25T09:55:11.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.617+0000 7f3b5a1ce640 1 -- 172.21.15.7:0/4287108567 shutdown_connections 2024-04-25T09:55:11.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.617+0000 7f3b5a1ce640 1 --2- 172.21.15.7:0/4287108567 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3b4006b4d0 0x7f3b4006d990 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:11.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.617+0000 7f3b5a1ce640 1 --2- 172.21.15.7:0/4287108567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b54161b30 0x7f3b540ca980 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:11.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.617+0000 7f3b5a1ce640 1 --2- 172.21.15.7:0/4287108567 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b5415dc10 0x7f3b540b58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:11.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.617+0000 7f3b5a1ce640 1 --2- 172.21.15.7:0/4287108567 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3b540b6b90 0x7f3b5415f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:11.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.617+0000 7f3b5a1ce640 1 -- 172.21.15.7:0/4287108567 >> 172.21.15.7:0/4287108567 conn(0x7f3b54072290 msgr2=0x7f3b540c7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:11.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.617+0000 7f3b5a1ce640 1 -- 172.21.15.7:0/4287108567 shutdown_connections 2024-04-25T09:55:11.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.617+0000 7f3b5a1ce640 1 -- 172.21.15.7:0/4287108567 wait complete. 2024-04-25T09:55:11.633 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:55:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.741+0000 7f362a86b640 1 Processor -- start 2024-04-25T09:55:11.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.741+0000 7f362a86b640 1 -- start start 2024-04-25T09:55:11.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.742+0000 7f362a86b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f36240b2c30 0x7f36240ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:11.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.742+0000 7f362a86b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f36240d3760 0x7f36240d3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:11.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.742+0000 7f362a86b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36240d1a40 con 0x7f362415deb0 2024-04-25T09:55:11.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.742+0000 7f362a86b640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36240d4110 con 0x7f36240b2c30 2024-04-25T09:55:11.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.742+0000 7f362a86b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36240d1d20 con 0x7f36240d3760 2024-04-25T09:55:11.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.742+0000 7f36237fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f36240b2c30 0x7f36240ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:11.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.742+0000 7f36237fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f36240b2c30 0x7f36240ce030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38482/0 (socket says 172.21.15.7:38482) 2024-04-25T09:55:11.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.742+0000 7f36237fe640 1 -- 172.21.15.7:0/899535640 learned_addr learned my addr 172.21.15.7:0/899535640 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:11.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.742+0000 7f3628e08640 1 --2- 172.21.15.7:0/899535640 >> v2:172.21.15.55:3300/0 conn(0x7f36240d3760 0x7f36240d3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:11.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.742+0000 7f36237fe640 1 -- 172.21.15.7:0/899535640 >> v2:172.21.15.55:3300/0 conn(0x7f36240d3760 msgr2=0x7f36240d3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:11.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.742+0000 7f36237fe640 1 --2- 172.21.15.7:0/899535640 >> v2:172.21.15.55:3300/0 conn(0x7f36240d3760 0x7f36240d3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:11.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.742+0000 7f36237fe640 1 -- 172.21.15.7:0/899535640 >> v1:172.21.15.55:6789/0 conn(0x7f362415deb0 legacy=0x7f36240b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:11.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.742+0000 7f36237fe640 1 -- 172.21.15.7:0/899535640 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36240d2000 con 0x7f36240b2c30 2024-04-25T09:55:11.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.742+0000 7f3628e08640 1 --2- 172.21.15.7:0/899535640 >> v2:172.21.15.55:3300/0 conn(0x7f36240d3760 0x7f36240d3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:11.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.743+0000 7f36237fe640 1 --2- 172.21.15.7:0/899535640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36240b2c30 0x7f36240ce030 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f36240b67b0 tx=0x7f361802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=287022fa9250f8b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:11.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.743+0000 7f3622ffd640 1 -- 172.21.15.7:0/899535640 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3618037070 con 0x7f36240b2c30 2024-04-25T09:55:11.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.743+0000 7f3622ffd640 1 -- 172.21.15.7:0/899535640 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3618032440 con 0x7f36240b2c30 2024-04-25T09:55:11.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.743+0000 7f3622ffd640 1 -- 172.21.15.7:0/899535640 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3618032810 con 0x7f36240b2c30 2024-04-25T09:55:11.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.743+0000 7f362a86b640 1 -- 172.21.15.7:0/899535640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36240b2c30 msgr2=0x7f36240ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:11.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.743+0000 7f362a86b640 1 --2- 172.21.15.7:0/899535640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36240b2c30 0x7f36240ce030 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f36240b67b0 tx=0x7f361802a230 comp rx=0 tx=0).stop 2024-04-25T09:55:11.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.744+0000 7f362a86b640 1 -- 172.21.15.7:0/899535640 shutdown_connections 2024-04-25T09:55:11.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.744+0000 7f362a86b640 1 --2- 172.21.15.7:0/899535640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36240b2c30 0x7f36240ce030 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:11.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.744+0000 7f362a86b640 1 --2- 172.21.15.7:0/899535640 >> v2:172.21.15.55:3300/0 conn(0x7f36240d3760 0x7f36240d3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:11.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.744+0000 7f362a86b640 1 -- 172.21.15.7:0/899535640 >> 172.21.15.7:0/899535640 conn(0x7f36240726b0 msgr2=0x7f3624072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:11.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.744+0000 7f362a86b640 1 -- 172.21.15.7:0/899535640 shutdown_connections 2024-04-25T09:55:11.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.744+0000 7f362a86b640 1 -- 172.21.15.7:0/899535640 wait complete. 2024-04-25T09:55:11.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.745+0000 7f362a86b640 1 Processor -- start 2024-04-25T09:55:11.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.745+0000 7f362a86b640 1 -- start start 2024-04-25T09:55:11.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.746+0000 7f362a86b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36240b2c30 0x7f36240cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:11.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.746+0000 7f362a86b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36240d3760 0x7f3624071220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:11.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.746+0000 7f362a86b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f362415deb0 0x7f3624071760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:11.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.746+0000 7f362a86b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36240b70f0 con 0x7f36240b2c30 2024-04-25T09:55:11.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.746+0000 7f362a86b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36240d25c0 con 0x7f362415deb0 2024-04-25T09:55:11.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.746+0000 7f362a86b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36240d2ae0 con 0x7f36240d3760 2024-04-25T09:55:11.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.746+0000 7f3623fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36240b2c30 0x7f36240cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:11.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.746+0000 7f3623fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36240b2c30 0x7f36240cdf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38492/0 (socket says 172.21.15.7:38492) 2024-04-25T09:55:11.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.746+0000 7f3623fff640 1 -- 172.21.15.7:0/3338227871 learned_addr learned my addr 172.21.15.7:0/3338227871 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:11.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.746+0000 7f3628e08640 1 --2- 172.21.15.7:0/3338227871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f362415deb0 0x7f3624071760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:11.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.746+0000 7f36237fe640 1 --2- 172.21.15.7:0/3338227871 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36240d3760 0x7f3624071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:11.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.746+0000 7f3623fff640 1 -- 172.21.15.7:0/3338227871 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36240d3760 msgr2=0x7f3624071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:11.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.746+0000 7f3623fff640 1 --2- 172.21.15.7:0/3338227871 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36240d3760 0x7f3624071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:11.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.746+0000 7f3623fff640 1 -- 172.21.15.7:0/3338227871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f362415deb0 msgr2=0x7f3624071760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:11.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.746+0000 7f3623fff640 1 --2- 172.21.15.7:0/3338227871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f362415deb0 0x7f3624071760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:11.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.746+0000 7f3623fff640 1 -- 172.21.15.7:0/3338227871 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36240720c0 con 0x7f36240b2c30 2024-04-25T09:55:11.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.746+0000 7f3628e08640 1 --2- 172.21.15.7:0/3338227871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f362415deb0 0x7f3624071760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:11.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.746+0000 7f3623fff640 1 --2- 172.21.15.7:0/3338227871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36240b2c30 0x7f36240cdf00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f361400b3f0 tx=0x7f361400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:11.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.747+0000 7f3620ff9640 1 -- 172.21.15.7:0/3338227871 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3614015020 con 0x7f36240b2c30 2024-04-25T09:55:11.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.747+0000 7f3620ff9640 1 -- 172.21.15.7:0/3338227871 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3614011830 con 0x7f36240b2c30 2024-04-25T09:55:11.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.747+0000 7f3620ff9640 1 -- 172.21.15.7:0/3338227871 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3614011c20 con 0x7f36240b2c30 2024-04-25T09:55:11.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.747+0000 7f362a86b640 1 -- 172.21.15.7:0/3338227871 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3624071de0 con 0x7f36240b2c30 2024-04-25T09:55:11.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.747+0000 7f362a86b640 1 -- 172.21.15.7:0/3338227871 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36240cac90 con 0x7f36240b2c30 2024-04-25T09:55:11.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.748+0000 7f362a86b640 1 -- 172.21.15.7:0/3338227871 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3624068f60 con 0x7f36240b2c30 2024-04-25T09:55:11.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.748+0000 7f3620ff9640 1 -- 172.21.15.7:0/3338227871 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3614018020 con 0x7f36240b2c30 2024-04-25T09:55:11.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.749+0000 7f3620ff9640 1 --2- 172.21.15.7:0/3338227871 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f361006b4d0 0x7f361006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:11.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.749+0000 7f3620ff9640 1 -- 172.21.15.7:0/3338227871 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f361408a290 con 0x7f36240b2c30 2024-04-25T09:55:11.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.749+0000 7f36237fe640 1 --2- 172.21.15.7:0/3338227871 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f361006b4d0 0x7f361006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:11.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.749+0000 7f36237fe640 1 --2- 172.21.15.7:0/3338227871 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f361006b4d0 0x7f361006d990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3618034000 tx=0x7f361802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:11.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.753+0000 7f3620ff9640 1 -- 172.21.15.7:0/3338227871 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f361401f030 con 0x7f36240b2c30 2024-04-25T09:55:11.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.932+0000 7f362a86b640 1 -- 172.21.15.7:0/3338227871 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f36240d3c90 con 0x7f36240b2c30 2024-04-25T09:55:11.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.935+0000 7f3620ff9640 1 -- 172.21.15.7:0/3338227871 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f36140172c0 con 0x7f36240b2c30 2024-04-25T09:55:11.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.937+0000 7f362a86b640 1 -- 172.21.15.7:0/3338227871 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f361006b4d0 msgr2=0x7f361006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:11.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.937+0000 7f362a86b640 1 --2- 172.21.15.7:0/3338227871 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f361006b4d0 0x7f361006d990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3618034000 tx=0x7f361802e000 comp rx=0 tx=0).stop 2024-04-25T09:55:11.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.937+0000 7f362a86b640 1 -- 172.21.15.7:0/3338227871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36240b2c30 msgr2=0x7f36240cdf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:11.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.937+0000 7f362a86b640 1 --2- 172.21.15.7:0/3338227871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36240b2c30 0x7f36240cdf00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f361400b3f0 tx=0x7f361400b8b0 comp rx=0 tx=0).stop 2024-04-25T09:55:11.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.937+0000 7f362a86b640 1 -- 172.21.15.7:0/3338227871 shutdown_connections 2024-04-25T09:55:11.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.937+0000 7f362a86b640 1 --2- 172.21.15.7:0/3338227871 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f361006b4d0 0x7f361006d990 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:11.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.937+0000 7f362a86b640 1 --2- 172.21.15.7:0/3338227871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f362415deb0 0x7f3624071760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:11.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.937+0000 7f362a86b640 1 --2- 172.21.15.7:0/3338227871 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36240d3760 0x7f3624071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:11.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.937+0000 7f362a86b640 1 --2- 172.21.15.7:0/3338227871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36240b2c30 0x7f36240cdf00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:11.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.937+0000 7f362a86b640 1 -- 172.21.15.7:0/3338227871 >> 172.21.15.7:0/3338227871 conn(0x7f36240726b0 msgr2=0x7f3624072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:11.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.937+0000 7f362a86b640 1 -- 172.21.15.7:0/3338227871 shutdown_connections 2024-04-25T09:55:11.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:11.937+0000 7f362a86b640 1 -- 172.21.15.7:0/3338227871 wait complete. 2024-04-25T09:55:11.951 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:55:11.951 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:55:11.992 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:55:12.038 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:55:12.038 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:55:12.038 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:55:12.054 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:55:12.054 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:55:12.110 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:55:12.110 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:55:12.165 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:55:12.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.305+0000 7ff973f70640 1 Processor -- start 2024-04-25T09:55:12.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.306+0000 7ff973f70640 1 -- start start 2024-04-25T09:55:12.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.306+0000 7ff973f70640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff96c0b53b0 0x7ff96c0d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:12.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.306+0000 7ff973f70640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96c0d1e80 con 0x7ff96c0d0a50 2024-04-25T09:55:12.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.306+0000 7ff973f70640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96c0b5930 con 0x7ff96c15db00 2024-04-25T09:55:12.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.306+0000 7ff973f70640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96c0b5c10 con 0x7ff96c0b53b0 2024-04-25T09:55:12.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.307+0000 7ff97250d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff96c0b53b0 0x7ff96c0d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:12.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.307+0000 7ff97150b640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff96c0d0a50 0x7ff96c0d2330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:59200/0 (socket says 172.21.15.7:59200) 2024-04-25T09:55:12.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.307+0000 7ff97150b640 1 -- 172.21.15.7:0/686421548 learned_addr learned my addr 172.21.15.7:0/686421548 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:12.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.307+0000 7ff97250d640 1 -- 172.21.15.7:0/686421548 >> v1:172.21.15.55:6789/0 conn(0x7ff96c15db00 legacy=0x7ff96c0d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:12.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.307+0000 7ff97250d640 1 -- 172.21.15.7:0/686421548 >> v1:172.21.15.7:6789/0 conn(0x7ff96c0d0a50 legacy=0x7ff96c0d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:12.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.307+0000 7ff970d0a640 1 -- 172.21.15.7:0/686421548 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4241606579 0 0) 0x7ff96c0d1e80 con 0x7ff96c0d0a50 2024-04-25T09:55:12.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.307+0000 7ff97250d640 1 -- 172.21.15.7:0/686421548 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c0b5ef0 con 0x7ff96c0b53b0 2024-04-25T09:55:12.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.308+0000 7ff97250d640 1 --2- 172.21.15.7:0/686421548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff96c0b53b0 0x7ff96c0d2a40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff95c009d90 tx=0x7ff95c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207df91c5ae3fab8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:12.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.308+0000 7ff970d0a640 1 -- 172.21.15.7:0/686421548 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c007740 con 0x7ff96c0b53b0 2024-04-25T09:55:12.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.308+0000 7ff970d0a640 1 -- 172.21.15.7:0/686421548 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95c0078e0 con 0x7ff96c0b53b0 2024-04-25T09:55:12.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.308+0000 7ff970d0a640 1 -- 172.21.15.7:0/686421548 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c007cb0 con 0x7ff96c0b53b0 2024-04-25T09:55:12.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.308+0000 7ff973f70640 1 -- 172.21.15.7:0/686421548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff96c0b53b0 msgr2=0x7ff96c0d2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:12.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.308+0000 7ff973f70640 1 --2- 172.21.15.7:0/686421548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff96c0b53b0 0x7ff96c0d2a40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff95c009d90 tx=0x7ff95c02a6a0 comp rx=0 tx=0).stop 2024-04-25T09:55:12.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.308+0000 7ff973f70640 1 -- 172.21.15.7:0/686421548 shutdown_connections 2024-04-25T09:55:12.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.308+0000 7ff973f70640 1 --2- 172.21.15.7:0/686421548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff96c0b53b0 0x7ff96c0d2a40 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:12.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.308+0000 7ff973f70640 1 -- 172.21.15.7:0/686421548 >> 172.21.15.7:0/686421548 conn(0x7ff96c072290 msgr2=0x7ff96c0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:12.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.308+0000 7ff973f70640 1 -- 172.21.15.7:0/686421548 shutdown_connections 2024-04-25T09:55:12.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.309+0000 7ff973f70640 1 -- 172.21.15.7:0/686421548 wait complete. 2024-04-25T09:55:12.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.310+0000 7ff973f70640 1 Processor -- start 2024-04-25T09:55:12.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.310+0000 7ff973f70640 1 -- start start 2024-04-25T09:55:12.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.310+0000 7ff973f70640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff96c0b53b0 0x7ff96c15c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:12.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.310+0000 7ff973f70640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff96c0d0a50 0x7ff96c0cb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:12.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.310+0000 7ff973f70640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff96c15db00 0x7ff96c148960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:12.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.310+0000 7ff973f70640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c0d3660 con 0x7ff96c15db00 2024-04-25T09:55:12.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.310+0000 7ff973f70640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c0b61d0 con 0x7ff96c0b53b0 2024-04-25T09:55:12.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.310+0000 7ff973f70640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c0d2f80 con 0x7ff96c0d0a50 2024-04-25T09:55:12.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.310+0000 7ff97250d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff96c15db00 0x7ff96c148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:12.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.310+0000 7ff97250d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff96c15db00 0x7ff96c148960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38510/0 (socket says 172.21.15.7:38510) 2024-04-25T09:55:12.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.310+0000 7ff97250d640 1 -- 172.21.15.7:0/2395054753 learned_addr learned my addr 172.21.15.7:0/2395054753 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:12.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.311+0000 7ff97150b640 1 --2- 172.21.15.7:0/2395054753 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff96c0d0a50 0x7ff96c0cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:12.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.311+0000 7ff971d0c640 1 --2- 172.21.15.7:0/2395054753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff96c0b53b0 0x7ff96c15c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:12.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.311+0000 7ff97250d640 1 -- 172.21.15.7:0/2395054753 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff96c0d0a50 msgr2=0x7ff96c0cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:12.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.311+0000 7ff97250d640 1 --2- 172.21.15.7:0/2395054753 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff96c0d0a50 0x7ff96c0cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:12.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.311+0000 7ff97250d640 1 -- 172.21.15.7:0/2395054753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff96c0b53b0 msgr2=0x7ff96c15c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:12.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.311+0000 7ff97250d640 1 --2- 172.21.15.7:0/2395054753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff96c0b53b0 0x7ff96c15c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:12.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.311+0000 7ff97250d640 1 -- 172.21.15.7:0/2395054753 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c0cbed0 con 0x7ff96c15db00 2024-04-25T09:55:12.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.311+0000 7ff971d0c640 1 --2- 172.21.15.7:0/2395054753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff96c0b53b0 0x7ff96c15c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:12.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.311+0000 7ff97250d640 1 --2- 172.21.15.7:0/2395054753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff96c15db00 0x7ff96c148960 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff95c009d90 tx=0x7ff95c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:12.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.311+0000 7ff96a7fc640 1 -- 172.21.15.7:0/2395054753 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c040070 con 0x7ff96c15db00 2024-04-25T09:55:12.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.311+0000 7ff96a7fc640 1 -- 172.21.15.7:0/2395054753 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95c031c90 con 0x7ff96c15db00 2024-04-25T09:55:12.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.311+0000 7ff973f70640 1 -- 172.21.15.7:0/2395054753 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff96c0cc1b0 con 0x7ff96c15db00 2024-04-25T09:55:12.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.311+0000 7ff96a7fc640 1 -- 172.21.15.7:0/2395054753 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c03c640 con 0x7ff96c15db00 2024-04-25T09:55:12.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.311+0000 7ff973f70640 1 -- 172.21.15.7:0/2395054753 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96c0cc770 con 0x7ff96c15db00 2024-04-25T09:55:12.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.312+0000 7ff973f70640 1 -- 172.21.15.7:0/2395054753 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff96c073ce0 con 0x7ff96c15db00 2024-04-25T09:55:12.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.313+0000 7ff96a7fc640 1 -- 172.21.15.7:0/2395054753 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff95c039040 con 0x7ff96c15db00 2024-04-25T09:55:12.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.313+0000 7ff96a7fc640 1 --2- 172.21.15.7:0/2395054753 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff95806b4d0 0x7ff95806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:12.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.313+0000 7ff96a7fc640 1 -- 172.21.15.7:0/2395054753 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7ff95c0abca0 con 0x7ff96c15db00 2024-04-25T09:55:12.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.313+0000 7ff971d0c640 1 --2- 172.21.15.7:0/2395054753 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff95806b4d0 0x7ff95806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:12.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.314+0000 7ff971d0c640 1 --2- 172.21.15.7:0/2395054753 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff95806b4d0 0x7ff95806d990 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff964006fd0 tx=0x7ff964008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:12.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.317+0000 7ff96a7fc640 1 -- 172.21.15.7:0/2395054753 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff96c073ce0 con 0x7ff96c15db00 2024-04-25T09:55:12.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.498+0000 7ff973f70640 1 -- 172.21.15.7:0/2395054753 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff96c068fd0 con 0x7ff96c15db00 2024-04-25T09:55:12.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.499+0000 7ff96a7fc640 1 -- 172.21.15.7:0/2395054753 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18807 (secure 0 0 0) 0x7ff95c07a7e0 con 0x7ff96c15db00 2024-04-25T09:55:12.502 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:12.503 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:55:09.591504+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:54:26.011833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:54:26.535536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:54:30.264996+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:55:12.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.502+0000 7ff973f70640 1 -- 172.21.15.7:0/2395054753 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff95806b4d0 msgr2=0x7ff95806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:12.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.502+0000 7ff973f70640 1 --2- 172.21.15.7:0/2395054753 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff95806b4d0 0x7ff95806d990 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff964006fd0 tx=0x7ff964008040 comp rx=0 tx=0).stop 2024-04-25T09:55:12.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.502+0000 7ff973f70640 1 -- 172.21.15.7:0/2395054753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff96c15db00 msgr2=0x7ff96c148960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:12.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.502+0000 7ff973f70640 1 --2- 172.21.15.7:0/2395054753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff96c15db00 0x7ff96c148960 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff95c009d90 tx=0x7ff95c004a40 comp rx=0 tx=0).stop 2024-04-25T09:55:12.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.502+0000 7ff973f70640 1 -- 172.21.15.7:0/2395054753 shutdown_connections 2024-04-25T09:55:12.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.502+0000 7ff973f70640 1 --2- 172.21.15.7:0/2395054753 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff95806b4d0 0x7ff95806d990 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:12.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.502+0000 7ff973f70640 1 --2- 172.21.15.7:0/2395054753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff96c15db00 0x7ff96c148960 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:12.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.502+0000 7ff973f70640 1 --2- 172.21.15.7:0/2395054753 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff96c0d0a50 0x7ff96c0cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:12.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.502+0000 7ff973f70640 1 --2- 172.21.15.7:0/2395054753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff96c0b53b0 0x7ff96c15c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:12.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.502+0000 7ff973f70640 1 -- 172.21.15.7:0/2395054753 >> 172.21.15.7:0/2395054753 conn(0x7ff96c072290 msgr2=0x7ff96c072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:12.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.502+0000 7ff973f70640 1 -- 172.21.15.7:0/2395054753 shutdown_connections 2024-04-25T09:55:12.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.502+0000 7ff973f70640 1 -- 172.21.15.7:0/2395054753 wait complete. 2024-04-25T09:55:12.515 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:54:26.011833+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:54:26.535536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:54:30.264996+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:55:12.516 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:55:12.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.616+0000 7fd5e3f42640 1 Processor -- start 2024-04-25T09:55:12.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.617+0000 7fd5e3f42640 1 -- start start 2024-04-25T09:55:12.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.617+0000 7fd5e3f42640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd5dc0d3760 0x7fd5dc15eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:12.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.618+0000 7fd5e3f42640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd5dc0ce830 0x7fd5dc0b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:12.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.618+0000 7fd5e3f42640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5dc0ced10 con 0x7fd5dc15f1c0 2024-04-25T09:55:12.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.618+0000 7fd5e3f42640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5dc0ce380 con 0x7fd5dc0ce830 2024-04-25T09:55:12.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.618+0000 7fd5e3f42640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc15f000 con 0x7fd5dc0d3760 2024-04-25T09:55:12.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.618+0000 7fd5e24df640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd5dc0ce830 0x7fd5dc0b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:12.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.618+0000 7fd5e1cde640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd5dc0d3760 0x7fd5dc15eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:12.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.618+0000 7fd5e24df640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd5dc0ce830 0x7fd5dc0b2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:40932/0 (socket says 172.21.15.7:40932) 2024-04-25T09:55:12.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.618+0000 7fd5e24df640 1 -- 172.21.15.7:0/4269906145 learned_addr learned my addr 172.21.15.7:0/4269906145 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:12.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.618+0000 7fd5e24df640 1 -- 172.21.15.7:0/4269906145 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd5dc0d3760 msgr2=0x7fd5dc15eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:12.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.618+0000 7fd5e24df640 1 --2- 172.21.15.7:0/4269906145 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd5dc0d3760 0x7fd5dc15eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:12.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.618+0000 7fd5e24df640 1 -- 172.21.15.7:0/4269906145 >> v1:172.21.15.55:6789/0 conn(0x7fd5dc15f1c0 legacy=0x7fd5dc0d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:12.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.618+0000 7fd5e24df640 1 -- 172.21.15.7:0/4269906145 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5dc0d1b40 con 0x7fd5dc0ce830 2024-04-25T09:55:12.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.618+0000 7fd5e1cde640 1 --2- 172.21.15.7:0/4269906145 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd5dc0d3760 0x7fd5dc15eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:55:12.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.619+0000 7fd5e24df640 1 --2- 172.21.15.7:0/4269906145 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5dc0ce830 0x7fd5dc0b2240 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4009e50 tx=0x7fd5d402a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0b3ff2fafa0db44 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:12.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.629+0000 7fd5e0cdc640 1 -- 172.21.15.7:0/4269906145 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d4036070 con 0x7fd5dc0ce830 2024-04-25T09:55:12.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.629+0000 7fd5e0cdc640 1 -- 172.21.15.7:0/4269906145 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d4031600 con 0x7fd5dc0ce830 2024-04-25T09:55:12.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.629+0000 7fd5e0cdc640 1 -- 172.21.15.7:0/4269906145 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d40319d0 con 0x7fd5dc0ce830 2024-04-25T09:55:12.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.630+0000 7fd5e3f42640 1 -- 172.21.15.7:0/4269906145 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5dc0ce830 msgr2=0x7fd5dc0b2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:12.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.630+0000 7fd5e3f42640 1 --2- 172.21.15.7:0/4269906145 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5dc0ce830 0x7fd5dc0b2240 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4009e50 tx=0x7fd5d402a710 comp rx=0 tx=0).stop 2024-04-25T09:55:12.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.630+0000 7fd5e3f42640 1 -- 172.21.15.7:0/4269906145 shutdown_connections 2024-04-25T09:55:12.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.630+0000 7fd5e3f42640 1 --2- 172.21.15.7:0/4269906145 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5dc0ce830 0x7fd5dc0b2240 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:12.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.630+0000 7fd5e3f42640 1 --2- 172.21.15.7:0/4269906145 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd5dc0d3760 0x7fd5dc15eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:12.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.630+0000 7fd5e3f42640 1 -- 172.21.15.7:0/4269906145 >> 172.21.15.7:0/4269906145 conn(0x7fd5dc072680 msgr2=0x7fd5dc072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:12.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.630+0000 7fd5e3f42640 1 -- 172.21.15.7:0/4269906145 shutdown_connections 2024-04-25T09:55:12.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.630+0000 7fd5e3f42640 1 -- 172.21.15.7:0/4269906145 wait complete. 2024-04-25T09:55:12.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.631+0000 7fd5e3f42640 1 Processor -- start 2024-04-25T09:55:12.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.631+0000 7fd5e3f42640 1 -- start start 2024-04-25T09:55:12.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.632+0000 7fd5e3f42640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5dc0ce830 0x7fd5dc0ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:12.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.632+0000 7fd5e3f42640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd5dc0d3760 0x7fd5dc15e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:12.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.632+0000 7fd5e3f42640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5dc15f1c0 0x7fd5dc0cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:12.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.632+0000 7fd5e3f42640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc15de10 con 0x7fd5dc15f1c0 2024-04-25T09:55:12.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.632+0000 7fd5e3f42640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc0d2190 con 0x7fd5dc0ce830 2024-04-25T09:55:12.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.632+0000 7fd5e3f42640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc0b2780 con 0x7fd5dc0d3760 2024-04-25T09:55:12.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.632+0000 7fd5e24df640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5dc15f1c0 0x7fd5dc0cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:12.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.632+0000 7fd5e24df640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5dc15f1c0 0x7fd5dc0cbfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38516/0 (socket says 172.21.15.7:38516) 2024-04-25T09:55:12.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.632+0000 7fd5e24df640 1 -- 172.21.15.7:0/2412952844 learned_addr learned my addr 172.21.15.7:0/2412952844 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:12.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.632+0000 7fd5e1cde640 1 --2- 172.21.15.7:0/2412952844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5dc0ce830 0x7fd5dc0ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:12.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.632+0000 7fd5e14dd640 1 --2- 172.21.15.7:0/2412952844 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd5dc0d3760 0x7fd5dc15e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:12.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.632+0000 7fd5e24df640 1 -- 172.21.15.7:0/2412952844 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd5dc0d3760 msgr2=0x7fd5dc15e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:12.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.632+0000 7fd5e24df640 1 --2- 172.21.15.7:0/2412952844 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd5dc0d3760 0x7fd5dc15e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:12.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.632+0000 7fd5e24df640 1 -- 172.21.15.7:0/2412952844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5dc0ce830 msgr2=0x7fd5dc0ca8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:12.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.632+0000 7fd5e24df640 1 --2- 172.21.15.7:0/2412952844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5dc0ce830 0x7fd5dc0ca8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:12.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.632+0000 7fd5e24df640 1 -- 172.21.15.7:0/2412952844 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5dc0caf30 con 0x7fd5dc15f1c0 2024-04-25T09:55:12.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.632+0000 7fd5e1cde640 1 --2- 172.21.15.7:0/2412952844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5dc0ce830 0x7fd5dc0ca8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:12.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.632+0000 7fd5e14dd640 1 --2- 172.21.15.7:0/2412952844 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd5dc0d3760 0x7fd5dc15e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:12.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.632+0000 7fd5e24df640 1 --2- 172.21.15.7:0/2412952844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5dc15f1c0 0x7fd5dc0cbfd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4009f70 tx=0x7fd5d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:12.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.633+0000 7fd5d27fc640 1 -- 172.21.15.7:0/2412952844 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d403f020 con 0x7fd5dc15f1c0 2024-04-25T09:55:12.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.633+0000 7fd5d27fc640 1 -- 172.21.15.7:0/2412952844 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d4037040 con 0x7fd5dc15f1c0 2024-04-25T09:55:12.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.633+0000 7fd5e3f42640 1 -- 172.21.15.7:0/2412952844 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5dc0cb210 con 0x7fd5dc15f1c0 2024-04-25T09:55:12.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.633+0000 7fd5d27fc640 1 -- 172.21.15.7:0/2412952844 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d4036070 con 0x7fd5dc15f1c0 2024-04-25T09:55:12.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.633+0000 7fd5e3f42640 1 -- 172.21.15.7:0/2412952844 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5dc0cb7d0 con 0x7fd5dc15f1c0 2024-04-25T09:55:12.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.634+0000 7fd5e3f42640 1 -- 172.21.15.7:0/2412952844 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5dc068f60 con 0x7fd5dc15f1c0 2024-04-25T09:55:12.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.634+0000 7fd5d27fc640 1 -- 172.21.15.7:0/2412952844 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd5d4042020 con 0x7fd5dc15f1c0 2024-04-25T09:55:12.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.635+0000 7fd5d27fc640 1 --2- 172.21.15.7:0/2412952844 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd5c006b4d0 0x7fd5c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:12.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.635+0000 7fd5e1cde640 1 --2- 172.21.15.7:0/2412952844 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd5c006b4d0 0x7fd5c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:12.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.635+0000 7fd5d27fc640 1 -- 172.21.15.7:0/2412952844 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fd5d40aadd0 con 0x7fd5dc15f1c0 2024-04-25T09:55:12.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.635+0000 7fd5e1cde640 1 --2- 172.21.15.7:0/2412952844 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd5c006b4d0 0x7fd5c006d990 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8009ac0 tx=0x7fd5d8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:12.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.639+0000 7fd5d27fc640 1 -- 172.21.15.7:0/2412952844 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd5d4049020 con 0x7fd5dc15f1c0 2024-04-25T09:55:12.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.817+0000 7fd5e3f42640 1 -- 172.21.15.7:0/2412952844 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd5dc067ec0 con 0x7fd5dc15f1c0 2024-04-25T09:55:12.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.818+0000 7fd5d27fc640 1 -- 172.21.15.7:0/2412952844 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd5d4079160 con 0x7fd5dc15f1c0 2024-04-25T09:55:12.821 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T09:55:12.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.820+0000 7fd5e3f42640 1 -- 172.21.15.7:0/2412952844 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd5c006b4d0 msgr2=0x7fd5c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:12.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.820+0000 7fd5e3f42640 1 --2- 172.21.15.7:0/2412952844 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd5c006b4d0 0x7fd5c006d990 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8009ac0 tx=0x7fd5d8008040 comp rx=0 tx=0).stop 2024-04-25T09:55:12.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.820+0000 7fd5e3f42640 1 -- 172.21.15.7:0/2412952844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5dc15f1c0 msgr2=0x7fd5dc0cbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:12.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.820+0000 7fd5e3f42640 1 --2- 172.21.15.7:0/2412952844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5dc15f1c0 0x7fd5dc0cbfd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4009f70 tx=0x7fd5d4004a40 comp rx=0 tx=0).stop 2024-04-25T09:55:12.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.820+0000 7fd5e3f42640 1 -- 172.21.15.7:0/2412952844 shutdown_connections 2024-04-25T09:55:12.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.820+0000 7fd5e3f42640 1 --2- 172.21.15.7:0/2412952844 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd5c006b4d0 0x7fd5c006d990 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:12.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.820+0000 7fd5e3f42640 1 --2- 172.21.15.7:0/2412952844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5dc15f1c0 0x7fd5dc0cbfd0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:12.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.820+0000 7fd5e3f42640 1 --2- 172.21.15.7:0/2412952844 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd5dc0d3760 0x7fd5dc15e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:12.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.820+0000 7fd5e3f42640 1 --2- 172.21.15.7:0/2412952844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5dc0ce830 0x7fd5dc0ca8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:12.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.820+0000 7fd5e3f42640 1 -- 172.21.15.7:0/2412952844 >> 172.21.15.7:0/2412952844 conn(0x7fd5dc072680 msgr2=0x7fd5dc0d2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:12.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.820+0000 7fd5e3f42640 1 -- 172.21.15.7:0/2412952844 shutdown_connections 2024-04-25T09:55:12.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.820+0000 7fd5e3f42640 1 -- 172.21.15.7:0/2412952844 wait complete. 2024-04-25T09:55:12.834 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:55:12.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.934+0000 7f84e0bf4640 1 Processor -- start 2024-04-25T09:55:12.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.934+0000 7f84e0bf4640 1 -- start start 2024-04-25T09:55:12.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.935+0000 7f84e0bf4640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f84dc0cfc40 0x7f84dc0d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:12.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.935+0000 7f84e0bf4640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f84dc0b1480 0x7f84dc0b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:12.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.935+0000 7f84e0bf4640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84dc0b25e0 con 0x7f84dc0ce070 2024-04-25T09:55:12.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.935+0000 7f84e0bf4640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84dc15bec0 con 0x7f84dc0b1480 2024-04-25T09:55:12.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.935+0000 7f84e0bf4640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84dc0d0560 con 0x7f84dc0cfc40 2024-04-25T09:55:12.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.935+0000 7f84d9d9b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f84dc0b1480 0x7f84dc0b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:12.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.935+0000 7f84d9d9b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f84dc0b1480 0x7f84dc0b0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38532/0 (socket says 172.21.15.7:38532) 2024-04-25T09:55:12.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.935+0000 7f84d9d9b640 1 -- 172.21.15.7:0/359291207 learned_addr learned my addr 172.21.15.7:0/359291207 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:12.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.936+0000 7f84da59c640 1 --2- 172.21.15.7:0/359291207 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f84dc0cfc40 0x7f84dc0d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:12.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.936+0000 7f84d9d9b640 1 -- 172.21.15.7:0/359291207 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f84dc0cfc40 msgr2=0x7f84dc0d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:12.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.936+0000 7f84d9d9b640 1 --2- 172.21.15.7:0/359291207 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f84dc0cfc40 0x7f84dc0d0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:12.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.936+0000 7f84d9d9b640 1 -- 172.21.15.7:0/359291207 >> v1:172.21.15.55:6789/0 conn(0x7f84dc0ce070 legacy=0x7f84dc0ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:12.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.936+0000 7f84d9d9b640 1 -- 172.21.15.7:0/359291207 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84dc0b19d0 con 0x7f84dc0b1480 2024-04-25T09:55:12.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.936+0000 7f84d9d9b640 1 --2- 172.21.15.7:0/359291207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84dc0b1480 0x7f84dc0b0ad0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f84c4009870 tx=0x7f84c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=798f4ef678d6bbb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:12.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.937+0000 7f84d959a640 1 -- 172.21.15.7:0/359291207 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c4037070 con 0x7f84dc0b1480 2024-04-25T09:55:12.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.937+0000 7f84d959a640 1 -- 172.21.15.7:0/359291207 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c4032440 con 0x7f84dc0b1480 2024-04-25T09:55:12.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.937+0000 7f84d959a640 1 -- 172.21.15.7:0/359291207 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c4032810 con 0x7f84dc0b1480 2024-04-25T09:55:12.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.937+0000 7f84e0bf4640 1 -- 172.21.15.7:0/359291207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84dc0b1480 msgr2=0x7f84dc0b0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:12.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.937+0000 7f84e0bf4640 1 --2- 172.21.15.7:0/359291207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84dc0b1480 0x7f84dc0b0ad0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f84c4009870 tx=0x7f84c402a270 comp rx=0 tx=0).stop 2024-04-25T09:55:12.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.937+0000 7f84e0bf4640 1 -- 172.21.15.7:0/359291207 shutdown_connections 2024-04-25T09:55:12.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.937+0000 7f84e0bf4640 1 --2- 172.21.15.7:0/359291207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84dc0b1480 0x7f84dc0b0ad0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:12.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.937+0000 7f84e0bf4640 1 --2- 172.21.15.7:0/359291207 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f84dc0cfc40 0x7f84dc0d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:12.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.937+0000 7f84e0bf4640 1 -- 172.21.15.7:0/359291207 >> 172.21.15.7:0/359291207 conn(0x7f84dc08af80 msgr2=0x7f84dc08b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:12.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.937+0000 7f84e0bf4640 1 -- 172.21.15.7:0/359291207 shutdown_connections 2024-04-25T09:55:12.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.937+0000 7f84e0bf4640 1 -- 172.21.15.7:0/359291207 wait complete. 2024-04-25T09:55:12.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.939+0000 7f84e0bf4640 1 Processor -- start 2024-04-25T09:55:12.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.939+0000 7f84e0bf4640 1 -- start start 2024-04-25T09:55:12.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.939+0000 7f84e0bf4640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f84dc0b1480 0x7f84dc154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:12.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.939+0000 7f84e0bf4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84dc0ce070 0x7f84dc0c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:12.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.939+0000 7f84e0bf4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84dc0cfc40 0x7f84dc0c7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:12.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.939+0000 7f84e0bf4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84dc0b2270 con 0x7f84dc0cfc40 2024-04-25T09:55:12.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.939+0000 7f84e0bf4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84dc0b1f90 con 0x7f84dc0ce070 2024-04-25T09:55:12.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.939+0000 7f84e0bf4640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84dc0b1010 con 0x7f84dc0b1480 2024-04-25T09:55:12.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.939+0000 7f84dad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84dc0cfc40 0x7f84dc0c7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:12.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.939+0000 7f84dad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84dc0cfc40 0x7f84dc0c7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38548/0 (socket says 172.21.15.7:38548) 2024-04-25T09:55:12.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.939+0000 7f84dad9d640 1 -- 172.21.15.7:0/1489162766 learned_addr learned my addr 172.21.15.7:0/1489162766 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:12.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.939+0000 7f84da59c640 1 --2- 172.21.15.7:0/1489162766 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f84dc0b1480 0x7f84dc154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:12.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.940+0000 7f84d9d9b640 1 --2- 172.21.15.7:0/1489162766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84dc0ce070 0x7f84dc0c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:12.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.940+0000 7f84dad9d640 1 -- 172.21.15.7:0/1489162766 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f84dc0b1480 msgr2=0x7f84dc154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:12.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.940+0000 7f84dad9d640 1 --2- 172.21.15.7:0/1489162766 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f84dc0b1480 0x7f84dc154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:12.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.940+0000 7f84dad9d640 1 -- 172.21.15.7:0/1489162766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84dc0ce070 msgr2=0x7f84dc0c71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:12.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.940+0000 7f84dad9d640 1 --2- 172.21.15.7:0/1489162766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84dc0ce070 0x7f84dc0c71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:12.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.940+0000 7f84dad9d640 1 -- 172.21.15.7:0/1489162766 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84dc0ca690 con 0x7f84dc0cfc40 2024-04-25T09:55:12.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.940+0000 7f84dad9d640 1 --2- 172.21.15.7:0/1489162766 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84dc0cfc40 0x7f84dc0c7720 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f84cc00c7a0 tx=0x7f84cc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:12.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.940+0000 7f84d2ffd640 1 -- 172.21.15.7:0/1489162766 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc003b70 con 0x7f84dc0cfc40 2024-04-25T09:55:12.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.940+0000 7f84d2ffd640 1 -- 172.21.15.7:0/1489162766 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84cc003d30 con 0x7f84dc0cfc40 2024-04-25T09:55:12.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.940+0000 7f84e0bf4640 1 -- 172.21.15.7:0/1489162766 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84dc0ca970 con 0x7f84dc0cfc40 2024-04-25T09:55:12.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.940+0000 7f84d2ffd640 1 -- 172.21.15.7:0/1489162766 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc00aa90 con 0x7f84dc0cfc40 2024-04-25T09:55:12.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.940+0000 7f84e0bf4640 1 -- 172.21.15.7:0/1489162766 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84dc0caf30 con 0x7f84dc0cfc40 2024-04-25T09:55:12.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.941+0000 7f84e0bf4640 1 -- 172.21.15.7:0/1489162766 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84dc0cf650 con 0x7f84dc0cfc40 2024-04-25T09:55:12.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.942+0000 7f84d2ffd640 1 -- 172.21.15.7:0/1489162766 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f84cc00ac30 con 0x7f84dc0cfc40 2024-04-25T09:55:12.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.942+0000 7f84d2ffd640 1 --2- 172.21.15.7:0/1489162766 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f84bc06b500 0x7f84bc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:12.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.942+0000 7f84da59c640 1 --2- 172.21.15.7:0/1489162766 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f84bc06b500 0x7f84bc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:12.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.942+0000 7f84d2ffd640 1 -- 172.21.15.7:0/1489162766 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f84cc08a3a0 con 0x7f84dc0cfc40 2024-04-25T09:55:12.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.943+0000 7f84da59c640 1 --2- 172.21.15.7:0/1489162766 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f84bc06b500 0x7f84bc06d9c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f84d4006fd0 tx=0x7f84d4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:12.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:12.947+0000 7f84d2ffd640 1 -- 172.21.15.7:0/1489162766 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f84dc0cf650 con 0x7f84dc0cfc40 2024-04-25T09:55:13.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.124+0000 7f84e0bf4640 1 -- 172.21.15.7:0/1489162766 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f84dc068f60 con 0x7f84dc0cfc40 2024-04-25T09:55:13.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.125+0000 7f84d2ffd640 1 -- 172.21.15.7:0/1489162766 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f84cc0587d0 con 0x7f84dc0cfc40 2024-04-25T09:55:13.128 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:55:13.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.126+0000 7f84e0bf4640 1 -- 172.21.15.7:0/1489162766 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f84bc06b500 msgr2=0x7f84bc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:13.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.126+0000 7f84e0bf4640 1 --2- 172.21.15.7:0/1489162766 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f84bc06b500 0x7f84bc06d9c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f84d4006fd0 tx=0x7f84d4008040 comp rx=0 tx=0).stop 2024-04-25T09:55:13.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.126+0000 7f84e0bf4640 1 -- 172.21.15.7:0/1489162766 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84dc0cfc40 msgr2=0x7f84dc0c7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:13.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.126+0000 7f84e0bf4640 1 --2- 172.21.15.7:0/1489162766 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84dc0cfc40 0x7f84dc0c7720 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f84cc00c7a0 tx=0x7f84cc00cc60 comp rx=0 tx=0).stop 2024-04-25T09:55:13.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.127+0000 7f84e0bf4640 1 -- 172.21.15.7:0/1489162766 shutdown_connections 2024-04-25T09:55:13.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.127+0000 7f84e0bf4640 1 --2- 172.21.15.7:0/1489162766 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f84bc06b500 0x7f84bc06d9c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.127+0000 7f84e0bf4640 1 --2- 172.21.15.7:0/1489162766 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84dc0cfc40 0x7f84dc0c7720 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.127+0000 7f84e0bf4640 1 --2- 172.21.15.7:0/1489162766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84dc0ce070 0x7f84dc0c71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.127+0000 7f84e0bf4640 1 --2- 172.21.15.7:0/1489162766 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f84dc0b1480 0x7f84dc154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.127+0000 7f84e0bf4640 1 -- 172.21.15.7:0/1489162766 >> 172.21.15.7:0/1489162766 conn(0x7f84dc08af80 msgr2=0x7f84dc0cd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:13.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.127+0000 7f84e0bf4640 1 -- 172.21.15.7:0/1489162766 shutdown_connections 2024-04-25T09:55:13.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.127+0000 7f84e0bf4640 1 -- 172.21.15.7:0/1489162766 wait complete. 2024-04-25T09:55:13.140 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:55:13.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.241+0000 7f19a0d5c640 1 Processor -- start 2024-04-25T09:55:13.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.241+0000 7f19a0d5c640 1 -- start start 2024-04-25T09:55:13.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.242+0000 7f19a0d5c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f199c0d0a00 0x7f199c09a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:13.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.242+0000 7f19a0d5c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f199c09a7d0 0x7f199c0cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:13.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.242+0000 7f19a0d5c640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199c1615e0 con 0x7f199c161200 2024-04-25T09:55:13.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.242+0000 7f19a0d5c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f199c06c9f0 con 0x7f199c09a7d0 2024-04-25T09:55:13.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.242+0000 7f19a0d5c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199c06ccd0 con 0x7f199c0d0a00 2024-04-25T09:55:13.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.242+0000 7f199a59c640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f199c161200 0x7f199c0cbd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:59214/0 (socket says 172.21.15.7:59214) 2024-04-25T09:55:13.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.242+0000 7f199a59c640 1 -- 172.21.15.7:0/2183915981 learned_addr learned my addr 172.21.15.7:0/2183915981 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:13.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.242+0000 7f1991d9b640 1 --2- 172.21.15.7:0/2183915981 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f199c0d0a00 0x7f199c09a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:13.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.242+0000 7f199ad9d640 1 --2- 172.21.15.7:0/2183915981 >> v2:172.21.15.55:3300/0 conn(0x7f199c09a7d0 0x7f199c0cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:13.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.242+0000 7f1999d9b640 1 -- 172.21.15.7:0/2183915981 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 440118735 0 0) 0x7f198c001110 con 0x7f199c161200 2024-04-25T09:55:13.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.242+0000 7f1999d9b640 1 -- 172.21.15.7:0/2183915981 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1988003520 con 0x7f199c161200 2024-04-25T09:55:13.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.242+0000 7f1991d9b640 1 -- 172.21.15.7:0/2183915981 >> v2:172.21.15.55:3300/0 conn(0x7f199c09a7d0 msgr2=0x7f199c0cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:13.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.242+0000 7f1991d9b640 1 --2- 172.21.15.7:0/2183915981 >> v2:172.21.15.55:3300/0 conn(0x7f199c09a7d0 0x7f199c0cf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.242+0000 7f1991d9b640 1 -- 172.21.15.7:0/2183915981 >> v1:172.21.15.7:6789/0 conn(0x7f199c161200 legacy=0x7f199c0cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:13.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.242+0000 7f1999d9b640 1 -- 172.21.15.7:0/2183915981 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3998211900 0 0) 0x7f1988003520 con 0x7f199c161200 2024-04-25T09:55:13.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.242+0000 7f1991d9b640 1 -- 172.21.15.7:0/2183915981 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c099a90 con 0x7f199c0d0a00 2024-04-25T09:55:13.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.242+0000 7f199ad9d640 1 --2- 172.21.15.7:0/2183915981 >> v2:172.21.15.55:3300/0 conn(0x7f199c09a7d0 0x7f199c0cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:55:13.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.243+0000 7f1991d9b640 1 --2- 172.21.15.7:0/2183915981 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f199c0d0a00 0x7f199c09a290 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f19840097a0 tx=0x7f198402a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fc60ac6e6c5518b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:13.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.243+0000 7f1999d9b640 1 -- 172.21.15.7:0/2183915981 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1984037070 con 0x7f199c0d0a00 2024-04-25T09:55:13.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.243+0000 7f1999d9b640 1 -- 172.21.15.7:0/2183915981 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198402aba0 con 0x7f199c0d0a00 2024-04-25T09:55:13.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.243+0000 7f1999d9b640 1 -- 172.21.15.7:0/2183915981 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c001840 con 0x7f199c0d0a00 2024-04-25T09:55:13.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.244+0000 7f19a0d5c640 1 -- 172.21.15.7:0/2183915981 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f199c0d0a00 msgr2=0x7f199c09a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:13.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.244+0000 7f19a0d5c640 1 --2- 172.21.15.7:0/2183915981 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f199c0d0a00 0x7f199c09a290 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f19840097a0 tx=0x7f198402a110 comp rx=0 tx=0).stop 2024-04-25T09:55:13.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.244+0000 7f19a0d5c640 1 -- 172.21.15.7:0/2183915981 shutdown_connections 2024-04-25T09:55:13.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.244+0000 7f19a0d5c640 1 --2- 172.21.15.7:0/2183915981 >> v2:172.21.15.55:3300/0 conn(0x7f199c09a7d0 0x7f199c0cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.244+0000 7f19a0d5c640 1 --2- 172.21.15.7:0/2183915981 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f199c0d0a00 0x7f199c09a290 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.244+0000 7f19a0d5c640 1 -- 172.21.15.7:0/2183915981 >> 172.21.15.7:0/2183915981 conn(0x7f199c0b31a0 msgr2=0x7f199c0b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:13.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.244+0000 7f19a0d5c640 1 -- 172.21.15.7:0/2183915981 shutdown_connections 2024-04-25T09:55:13.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.244+0000 7f19a0d5c640 1 -- 172.21.15.7:0/2183915981 wait complete. 2024-04-25T09:55:13.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.245+0000 7f19a0d5c640 1 Processor -- start 2024-04-25T09:55:13.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.245+0000 7f19a0d5c640 1 -- start start 2024-04-25T09:55:13.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.246+0000 7f19a0d5c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f199c09a7d0 0x7f199c158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:13.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.246+0000 7f19a0d5c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f199c0d0a00 0x7f199c0b4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:13.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.246+0000 7f19a0d5c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f199c161200 0x7f199c06f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:13.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.246+0000 7f19a0d5c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c06cfb0 con 0x7f199c0d0a00 2024-04-25T09:55:13.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.246+0000 7f19a0d5c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c06c680 con 0x7f199c09a7d0 2024-04-25T09:55:13.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.246+0000 7f19a0d5c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199c06d130 con 0x7f199c161200 2024-04-25T09:55:13.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.246+0000 7f1991d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f199c0d0a00 0x7f199c0b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:13.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.246+0000 7f1991d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f199c0d0a00 0x7f199c0b4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38556/0 (socket says 172.21.15.7:38556) 2024-04-25T09:55:13.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.246+0000 7f1991d9b640 1 -- 172.21.15.7:0/2536499909 learned_addr learned my addr 172.21.15.7:0/2536499909 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:13.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.246+0000 7f199ad9d640 1 --2- 172.21.15.7:0/2536499909 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f199c161200 0x7f199c06f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:13.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.246+0000 7f199a59c640 1 --2- 172.21.15.7:0/2536499909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f199c09a7d0 0x7f199c158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:13.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.247+0000 7f1991d9b640 1 -- 172.21.15.7:0/2536499909 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f199c161200 msgr2=0x7f199c06f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:13.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.247+0000 7f1991d9b640 1 --2- 172.21.15.7:0/2536499909 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f199c161200 0x7f199c06f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.247+0000 7f1991d9b640 1 -- 172.21.15.7:0/2536499909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f199c09a7d0 msgr2=0x7f199c158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:13.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.247+0000 7f1991d9b640 1 --2- 172.21.15.7:0/2536499909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f199c09a7d0 0x7f199c158770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.247+0000 7f1991d9b640 1 -- 172.21.15.7:0/2536499909 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c0b4d30 con 0x7f199c0d0a00 2024-04-25T09:55:13.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.247+0000 7f1991d9b640 1 --2- 172.21.15.7:0/2536499909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f199c0d0a00 0x7f199c0b4270 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f19840098c0 tx=0x7f19840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:13.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.247+0000 7f19937fe640 1 -- 172.21.15.7:0/2536499909 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1984037050 con 0x7f199c0d0a00 2024-04-25T09:55:13.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.247+0000 7f19937fe640 1 -- 172.21.15.7:0/2536499909 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1984043070 con 0x7f199c0d0a00 2024-04-25T09:55:13.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.247+0000 7f19a0d5c640 1 -- 172.21.15.7:0/2536499909 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199c0b5010 con 0x7f199c0d0a00 2024-04-25T09:55:13.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.247+0000 7f19937fe640 1 -- 172.21.15.7:0/2536499909 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1984006e10 con 0x7f199c0d0a00 2024-04-25T09:55:13.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.247+0000 7f19a0d5c640 1 -- 172.21.15.7:0/2536499909 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199c0b55d0 con 0x7f199c0d0a00 2024-04-25T09:55:13.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.248+0000 7f19a0d5c640 1 -- 172.21.15.7:0/2536499909 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199c068f60 con 0x7f199c0d0a00 2024-04-25T09:55:13.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.248+0000 7f19937fe640 1 -- 172.21.15.7:0/2536499909 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1984048460 con 0x7f199c0d0a00 2024-04-25T09:55:13.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.249+0000 7f19937fe640 1 --2- 172.21.15.7:0/2536499909 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f197c06b4d0 0x7f197c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:13.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.249+0000 7f19937fe640 1 -- 172.21.15.7:0/2536499909 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f19840aad70 con 0x7f199c0d0a00 2024-04-25T09:55:13.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.249+0000 7f199a59c640 1 --2- 172.21.15.7:0/2536499909 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f197c06b4d0 0x7f197c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:13.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.249+0000 7f199a59c640 1 --2- 172.21.15.7:0/2536499909 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f197c06b4d0 0x7f197c06d990 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f198c000f60 tx=0x7f198c0016b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:13.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.253+0000 7f19937fe640 1 -- 172.21.15.7:0/2536499909 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1984079810 con 0x7f199c0d0a00 2024-04-25T09:55:13.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.433+0000 7f19a0d5c640 1 -- 172.21.15.7:0/2536499909 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f199c0b4050 con 0x7f199c0d0a00 2024-04-25T09:55:13.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.434+0000 7f19937fe640 1 -- 172.21.15.7:0/2536499909 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1984079110 con 0x7f199c0d0a00 2024-04-25T09:55:13.437 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T09:55:13.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.435+0000 7f19a0d5c640 1 -- 172.21.15.7:0/2536499909 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f197c06b4d0 msgr2=0x7f197c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:13.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.435+0000 7f19a0d5c640 1 --2- 172.21.15.7:0/2536499909 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f197c06b4d0 0x7f197c06d990 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f198c000f60 tx=0x7f198c0016b0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.435+0000 7f19a0d5c640 1 -- 172.21.15.7:0/2536499909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f199c0d0a00 msgr2=0x7f199c0b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:13.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.435+0000 7f19a0d5c640 1 --2- 172.21.15.7:0/2536499909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f199c0d0a00 0x7f199c0b4270 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f19840098c0 tx=0x7f19840046c0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.435+0000 7f19a0d5c640 1 -- 172.21.15.7:0/2536499909 shutdown_connections 2024-04-25T09:55:13.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.435+0000 7f19a0d5c640 1 --2- 172.21.15.7:0/2536499909 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f197c06b4d0 0x7f197c06d990 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.435+0000 7f19a0d5c640 1 --2- 172.21.15.7:0/2536499909 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f199c161200 0x7f199c06f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.435+0000 7f19a0d5c640 1 --2- 172.21.15.7:0/2536499909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f199c0d0a00 0x7f199c0b4270 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.435+0000 7f19a0d5c640 1 --2- 172.21.15.7:0/2536499909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f199c09a7d0 0x7f199c158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.435+0000 7f19a0d5c640 1 -- 172.21.15.7:0/2536499909 >> 172.21.15.7:0/2536499909 conn(0x7f199c0b31a0 msgr2=0x7f199c073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:13.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.435+0000 7f19a0d5c640 1 -- 172.21.15.7:0/2536499909 shutdown_connections 2024-04-25T09:55:13.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.436+0000 7f19a0d5c640 1 -- 172.21.15.7:0/2536499909 wait complete. 2024-04-25T09:55:13.449 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:55:13.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.549+0000 7f43fe01c640 1 Processor -- start 2024-04-25T09:55:13.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.549+0000 7f43fe01c640 1 -- start start 2024-04-25T09:55:13.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.550+0000 7f43fe01c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f43f80d3760 0x7f43f815eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:13.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.550+0000 7f43fe01c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f43f80ce830 0x7f43f80b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:13.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.550+0000 7f43fe01c640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43f80ced10 con 0x7f43f815f1c0 2024-04-25T09:55:13.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.550+0000 7f43fe01c640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43f80ce380 con 0x7f43f80d3760 2024-04-25T09:55:13.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.550+0000 7f43fe01c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43f815f000 con 0x7f43f80ce830 2024-04-25T09:55:13.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.550+0000 7f43f77fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f43f80d3760 0x7f43f815eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:13.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.550+0000 7f43f6ffd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f43f815f1c0 0x7f43f80d3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:59226/0 (socket says 172.21.15.7:59226) 2024-04-25T09:55:13.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.550+0000 7f43f6ffd640 1 -- 172.21.15.7:0/902896409 learned_addr learned my addr 172.21.15.7:0/902896409 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:13.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.551+0000 7f43f77fe640 1 -- 172.21.15.7:0/902896409 >> v2:172.21.15.55:3300/0 conn(0x7f43f80ce830 msgr2=0x7f43f80b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:13.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.551+0000 7f43f77fe640 1 --2- 172.21.15.7:0/902896409 >> v2:172.21.15.55:3300/0 conn(0x7f43f80ce830 0x7f43f80b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.551+0000 7f43f77fe640 1 -- 172.21.15.7:0/902896409 >> v1:172.21.15.7:6789/0 conn(0x7f43f815f1c0 legacy=0x7f43f80d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:13.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.551+0000 7f43f67fc640 1 -- 172.21.15.7:0/902896409 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 861595966 0 0) 0x7f43f80ced10 con 0x7f43f815f1c0 2024-04-25T09:55:13.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.551+0000 7f43f77fe640 1 -- 172.21.15.7:0/902896409 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f80d1b40 con 0x7f43f80d3760 2024-04-25T09:55:13.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.551+0000 7f43f77fe640 1 --2- 172.21.15.7:0/902896409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43f80d3760 0x7f43f815eac0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f43f80cf180 tx=0x7f43e802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15cbcdbb9730c2b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:13.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.551+0000 7f43f67fc640 1 -- 172.21.15.7:0/902896409 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e8037070 con 0x7f43f80d3760 2024-04-25T09:55:13.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.552+0000 7f43f67fc640 1 -- 172.21.15.7:0/902896409 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e8032440 con 0x7f43f80d3760 2024-04-25T09:55:13.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.552+0000 7f43f67fc640 1 -- 172.21.15.7:0/902896409 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e8032810 con 0x7f43f80d3760 2024-04-25T09:55:13.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.552+0000 7f43fe01c640 1 -- 172.21.15.7:0/902896409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43f80d3760 msgr2=0x7f43f815eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:13.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.552+0000 7f43fe01c640 1 --2- 172.21.15.7:0/902896409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43f80d3760 0x7f43f815eac0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f43f80cf180 tx=0x7f43e802a1c0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.552+0000 7f43fe01c640 1 -- 172.21.15.7:0/902896409 shutdown_connections 2024-04-25T09:55:13.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.552+0000 7f43fe01c640 1 --2- 172.21.15.7:0/902896409 >> v2:172.21.15.55:3300/0 conn(0x7f43f80ce830 0x7f43f80b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.552+0000 7f43fe01c640 1 --2- 172.21.15.7:0/902896409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43f80d3760 0x7f43f815eac0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.552+0000 7f43fe01c640 1 -- 172.21.15.7:0/902896409 >> 172.21.15.7:0/902896409 conn(0x7f43f8072680 msgr2=0x7f43f8072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:13.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.552+0000 7f43fe01c640 1 -- 172.21.15.7:0/902896409 shutdown_connections 2024-04-25T09:55:13.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.552+0000 7f43fe01c640 1 -- 172.21.15.7:0/902896409 wait complete. 2024-04-25T09:55:13.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.553+0000 7f43fe01c640 1 Processor -- start 2024-04-25T09:55:13.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.554+0000 7f43fe01c640 1 -- start start 2024-04-25T09:55:13.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.554+0000 7f43fe01c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43f80ce830 0x7f43f814ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:13.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.554+0000 7f43fe01c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f43f80d3760 0x7f43f80cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:13.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.554+0000 7f43fe01c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43f815f1c0 0x7f43f80cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:13.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.554+0000 7f43fe01c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f815de10 con 0x7f43f80ce830 2024-04-25T09:55:13.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.554+0000 7f43fe01c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f80d2190 con 0x7f43f815f1c0 2024-04-25T09:55:13.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.554+0000 7f43fe01c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f80b2780 con 0x7f43f80d3760 2024-04-25T09:55:13.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.554+0000 7f43f77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43f80ce830 0x7f43f814ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:13.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.554+0000 7f43f77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43f80ce830 0x7f43f814ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38580/0 (socket says 172.21.15.7:38580) 2024-04-25T09:55:13.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.554+0000 7f43f77fe640 1 -- 172.21.15.7:0/1020334505 learned_addr learned my addr 172.21.15.7:0/1020334505 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:13.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.555+0000 7f43f6ffd640 1 --2- 172.21.15.7:0/1020334505 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f43f80d3760 0x7f43f80cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:13.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.555+0000 7f43f77fe640 1 -- 172.21.15.7:0/1020334505 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f43f80d3760 msgr2=0x7f43f80cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:13.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.555+0000 7f43f77fe640 1 --2- 172.21.15.7:0/1020334505 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f43f80d3760 0x7f43f80cb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.555+0000 7f43f77fe640 1 -- 172.21.15.7:0/1020334505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43f815f1c0 msgr2=0x7f43f80cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:13.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.555+0000 7f43f7fff640 1 --2- 172.21.15.7:0/1020334505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43f815f1c0 0x7f43f80cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:13.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.555+0000 7f43f77fe640 1 --2- 172.21.15.7:0/1020334505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43f815f1c0 0x7f43f80cbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.555+0000 7f43f77fe640 1 -- 172.21.15.7:0/1020334505 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f81e78c0 con 0x7f43f80ce830 2024-04-25T09:55:13.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.555+0000 7f43f77fe640 1 --2- 172.21.15.7:0/1020334505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43f80ce830 0x7f43f814ea60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f43e8009890 tx=0x7f43e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:13.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.555+0000 7f43dffff640 1 -- 172.21.15.7:0/1020334505 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e8041070 con 0x7f43f80ce830 2024-04-25T09:55:13.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.555+0000 7f43dffff640 1 -- 172.21.15.7:0/1020334505 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e803c870 con 0x7f43f80ce830 2024-04-25T09:55:13.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.555+0000 7f43fe01c640 1 -- 172.21.15.7:0/1020334505 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43f80cc3d0 con 0x7f43f80ce830 2024-04-25T09:55:13.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.555+0000 7f43dffff640 1 -- 172.21.15.7:0/1020334505 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e8037040 con 0x7f43f80ce830 2024-04-25T09:55:13.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.555+0000 7f43fe01c640 1 -- 172.21.15.7:0/1020334505 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f80ccc70 con 0x7f43f80ce830 2024-04-25T09:55:13.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.556+0000 7f43fe01c640 1 -- 172.21.15.7:0/1020334505 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43f80d3b40 con 0x7f43f80ce830 2024-04-25T09:55:13.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.556+0000 7f43dffff640 1 -- 172.21.15.7:0/1020334505 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f43e8044070 con 0x7f43f80ce830 2024-04-25T09:55:13.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.557+0000 7f43dffff640 1 --2- 172.21.15.7:0/1020334505 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f43e406b4d0 0x7f43e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:13.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.557+0000 7f43dffff640 1 -- 172.21.15.7:0/1020334505 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f43e80ab2d0 con 0x7f43f80ce830 2024-04-25T09:55:13.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.557+0000 7f43f6ffd640 1 --2- 172.21.15.7:0/1020334505 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f43e406b4d0 0x7f43e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:13.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.557+0000 7f43f6ffd640 1 --2- 172.21.15.7:0/1020334505 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f43e406b4d0 0x7f43e406d990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f43f81f73b0 tx=0x7f43ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:13.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.561+0000 7f43dffff640 1 -- 172.21.15.7:0/1020334505 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f43f80d3b40 con 0x7f43f80ce830 2024-04-25T09:55:13.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.742+0000 7f43fe01c640 1 -- 172.21.15.7:0/1020334505 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f43f8068f60 con 0x7f43f80ce830 2024-04-25T09:55:13.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.742+0000 7f43dffff640 1 -- 172.21.15.7:0/1020334505 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f43e8079e70 con 0x7f43f80ce830 2024-04-25T09:55:13.745 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:55:13.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.744+0000 7f43fe01c640 1 -- 172.21.15.7:0/1020334505 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f43e406b4d0 msgr2=0x7f43e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:13.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.744+0000 7f43fe01c640 1 --2- 172.21.15.7:0/1020334505 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f43e406b4d0 0x7f43e406d990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f43f81f73b0 tx=0x7f43ec009040 comp rx=0 tx=0).stop 2024-04-25T09:55:13.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.744+0000 7f43fe01c640 1 -- 172.21.15.7:0/1020334505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43f80ce830 msgr2=0x7f43f814ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:13.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.744+0000 7f43fe01c640 1 --2- 172.21.15.7:0/1020334505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43f80ce830 0x7f43f814ea60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f43e8009890 tx=0x7f43e80046c0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.744+0000 7f43fe01c640 1 -- 172.21.15.7:0/1020334505 shutdown_connections 2024-04-25T09:55:13.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.744+0000 7f43fe01c640 1 --2- 172.21.15.7:0/1020334505 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f43e406b4d0 0x7f43e406d990 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.744+0000 7f43fe01c640 1 --2- 172.21.15.7:0/1020334505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43f815f1c0 0x7f43f80cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.744+0000 7f43fe01c640 1 --2- 172.21.15.7:0/1020334505 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f43f80d3760 0x7f43f80cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.744+0000 7f43fe01c640 1 --2- 172.21.15.7:0/1020334505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43f80ce830 0x7f43f814ea60 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.744+0000 7f43fe01c640 1 -- 172.21.15.7:0/1020334505 >> 172.21.15.7:0/1020334505 conn(0x7f43f8072680 msgr2=0x7f43f80b6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:13.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.744+0000 7f43fe01c640 1 -- 172.21.15.7:0/1020334505 shutdown_connections 2024-04-25T09:55:13.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.744+0000 7f43fe01c640 1 -- 172.21.15.7:0/1020334505 wait complete. 2024-04-25T09:55:13.761 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:55:13.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.860+0000 7f6b62488640 1 Processor -- start 2024-04-25T09:55:13.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.860+0000 7f6b62488640 1 -- start start 2024-04-25T09:55:13.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.861+0000 7f6b62488640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6b5c15dd00 0x7f6b5c0b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:13.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.861+0000 7f6b62488640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6b5c06c6c0 0x7f6b5c0b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:13.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.861+0000 7f6b62488640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b5c06cd00 con 0x7f6b5c0b6a40 2024-04-25T09:55:13.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.861+0000 7f6b62488640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b5c15e0e0 con 0x7f6b5c15dd00 2024-04-25T09:55:13.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.861+0000 7f6b62488640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c06cfe0 con 0x7f6b5c06c6c0 2024-04-25T09:55:13.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.861+0000 7f6b5bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6b5c15dd00 0x7f6b5c0b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:13.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.861+0000 7f6b60a25640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6b5c06c6c0 0x7f6b5c0b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:13.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.861+0000 7f6b5bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6b5c15dd00 0x7f6b5c0b5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:40996/0 (socket says 172.21.15.7:40996) 2024-04-25T09:55:13.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.861+0000 7f6b5bfff640 1 -- 172.21.15.7:0/3984195008 learned_addr learned my addr 172.21.15.7:0/3984195008 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:13.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.861+0000 7f6b5b7fe640 1 --1- 172.21.15.7:0/3984195008 >> v1:172.21.15.55:6789/0 conn(0x7f6b5c0b6a40 0x7f6b5c06bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:41070/0 (socket says 172.21.15.7:41070) 2024-04-25T09:55:13.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.862+0000 7f6b60a25640 1 -- 172.21.15.7:0/3984195008 >> v2:172.21.15.55:3300/0 conn(0x7f6b5c15dd00 msgr2=0x7f6b5c0b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:13.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.862+0000 7f6b60a25640 1 --2- 172.21.15.7:0/3984195008 >> v2:172.21.15.55:3300/0 conn(0x7f6b5c15dd00 0x7f6b5c0b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.862+0000 7f6b60a25640 1 -- 172.21.15.7:0/3984195008 >> v1:172.21.15.55:6789/0 conn(0x7f6b5c0b6a40 legacy=0x7f6b5c06bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:13.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.862+0000 7f6b60a25640 1 -- 172.21.15.7:0/3984195008 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b5c0d1ca0 con 0x7f6b5c06c6c0 2024-04-25T09:55:13.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.862+0000 7f6b60a25640 1 --2- 172.21.15.7:0/3984195008 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6b5c06c6c0 0x7f6b5c0b5c90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6b54009d90 tx=0x7f6b5402a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d7ac532d867803a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:13.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.863+0000 7f6b5affd640 1 -- 172.21.15.7:0/3984195008 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b54007740 con 0x7f6b5c06c6c0 2024-04-25T09:55:13.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.863+0000 7f6b5affd640 1 -- 172.21.15.7:0/3984195008 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b540078e0 con 0x7f6b5c06c6c0 2024-04-25T09:55:13.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.863+0000 7f6b5affd640 1 -- 172.21.15.7:0/3984195008 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b54007cb0 con 0x7f6b5c06c6c0 2024-04-25T09:55:13.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.863+0000 7f6b62488640 1 -- 172.21.15.7:0/3984195008 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6b5c06c6c0 msgr2=0x7f6b5c0b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:13.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.863+0000 7f6b62488640 1 --2- 172.21.15.7:0/3984195008 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6b5c06c6c0 0x7f6b5c0b5c90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6b54009d90 tx=0x7f6b5402a6f0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.863+0000 7f6b62488640 1 -- 172.21.15.7:0/3984195008 shutdown_connections 2024-04-25T09:55:13.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.863+0000 7f6b62488640 1 --2- 172.21.15.7:0/3984195008 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6b5c06c6c0 0x7f6b5c0b5c90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.863+0000 7f6b62488640 1 --2- 172.21.15.7:0/3984195008 >> v2:172.21.15.55:3300/0 conn(0x7f6b5c15dd00 0x7f6b5c0b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.863+0000 7f6b62488640 1 -- 172.21.15.7:0/3984195008 >> 172.21.15.7:0/3984195008 conn(0x7f6b5c0d07b0 msgr2=0x7f6b5c0d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:13.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.863+0000 7f6b62488640 1 -- 172.21.15.7:0/3984195008 shutdown_connections 2024-04-25T09:55:13.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.863+0000 7f6b62488640 1 -- 172.21.15.7:0/3984195008 wait complete. 2024-04-25T09:55:13.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.864+0000 7f6b62488640 1 Processor -- start 2024-04-25T09:55:13.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.865+0000 7f6b62488640 1 -- start start 2024-04-25T09:55:13.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.865+0000 7f6b62488640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b5c06c6c0 0x7f6b5c0c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:13.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.865+0000 7f6b62488640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6b5c0b6a40 0x7f6b5c0cd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:13.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.865+0000 7f6b62488640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b5c15dd00 0x7f6b5c0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:13.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.865+0000 7f6b62488640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c0d2780 con 0x7f6b5c06c6c0 2024-04-25T09:55:13.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.865+0000 7f6b62488640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c0d2260 con 0x7f6b5c15dd00 2024-04-25T09:55:13.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.865+0000 7f6b62488640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c0d2900 con 0x7f6b5c0b6a40 2024-04-25T09:55:13.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.865+0000 7f6b5bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b5c06c6c0 0x7f6b5c0c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:13.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.865+0000 7f6b5bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b5c06c6c0 0x7f6b5c0c9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38582/0 (socket says 172.21.15.7:38582) 2024-04-25T09:55:13.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.865+0000 7f6b5bfff640 1 -- 172.21.15.7:0/850456028 learned_addr learned my addr 172.21.15.7:0/850456028 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:13.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.865+0000 7f6b5b7fe640 1 --2- 172.21.15.7:0/850456028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6b5c0b6a40 0x7f6b5c0cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:13.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.866+0000 7f6b60a25640 1 --2- 172.21.15.7:0/850456028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b5c15dd00 0x7f6b5c0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:13.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.866+0000 7f6b5bfff640 1 -- 172.21.15.7:0/850456028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6b5c0b6a40 msgr2=0x7f6b5c0cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:13.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.866+0000 7f6b5bfff640 1 --2- 172.21.15.7:0/850456028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6b5c0b6a40 0x7f6b5c0cd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.866+0000 7f6b5bfff640 1 -- 172.21.15.7:0/850456028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b5c15dd00 msgr2=0x7f6b5c0b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:13.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.866+0000 7f6b5bfff640 1 --2- 172.21.15.7:0/850456028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b5c15dd00 0x7f6b5c0b78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:13.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.866+0000 7f6b5bfff640 1 -- 172.21.15.7:0/850456028 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b5c15a790 con 0x7f6b5c06c6c0 2024-04-25T09:55:13.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.866+0000 7f6b5bfff640 1 --2- 172.21.15.7:0/850456028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b5c06c6c0 0x7f6b5c0c9420 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c00e840 tx=0x7f6b4c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:13.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.866+0000 7f6b58ff9640 1 -- 172.21.15.7:0/850456028 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c017070 con 0x7f6b5c06c6c0 2024-04-25T09:55:13.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.866+0000 7f6b58ff9640 1 -- 172.21.15.7:0/850456028 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4c00c8e0 con 0x7f6b5c06c6c0 2024-04-25T09:55:13.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.866+0000 7f6b62488640 1 -- 172.21.15.7:0/850456028 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b5c15aa70 con 0x7f6b5c06c6c0 2024-04-25T09:55:13.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.866+0000 7f6b58ff9640 1 -- 172.21.15.7:0/850456028 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c00ccd0 con 0x7f6b5c06c6c0 2024-04-25T09:55:13.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.866+0000 7f6b62488640 1 -- 172.21.15.7:0/850456028 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b5c0caea0 con 0x7f6b5c06c6c0 2024-04-25T09:55:13.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.867+0000 7f6b62488640 1 -- 172.21.15.7:0/850456028 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b5c068fd0 con 0x7f6b5c06c6c0 2024-04-25T09:55:13.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.868+0000 7f6b58ff9640 1 -- 172.21.15.7:0/850456028 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6b4c01a070 con 0x7f6b5c06c6c0 2024-04-25T09:55:13.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.868+0000 7f6b58ff9640 1 --2- 172.21.15.7:0/850456028 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6b4806b4d0 0x7f6b4806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:13.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.868+0000 7f6b58ff9640 1 -- 172.21.15.7:0/850456028 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f6b4c08a760 con 0x7f6b5c06c6c0 2024-04-25T09:55:13.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.868+0000 7f6b5b7fe640 1 --2- 172.21.15.7:0/850456028 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6b4806b4d0 0x7f6b4806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:13.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.869+0000 7f6b5b7fe640 1 --2- 172.21.15.7:0/850456028 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6b4806b4d0 0x7f6b4806d990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c1f6c80 tx=0x7f6b50007e80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:13.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:13.872+0000 7f6b58ff9640 1 -- 172.21.15.7:0/850456028 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6b4c058c20 con 0x7f6b5c06c6c0 2024-04-25T09:55:14.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.067+0000 7f6b62488640 1 -- 172.21.15.7:0/850456028 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6b5c0d1620 con 0x7f6b5c06c6c0 2024-04-25T09:55:14.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.067+0000 7f6b58ff9640 1 -- 172.21.15.7:0/850456028 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6b4c05ccc0 con 0x7f6b5c06c6c0 2024-04-25T09:55:14.070 INFO:teuthology.orchestra.run.smithi007.stderr:listed 0 entries 2024-04-25T09:55:14.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.069+0000 7f6b62488640 1 -- 172.21.15.7:0/850456028 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6b4806b4d0 msgr2=0x7f6b4806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:14.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.069+0000 7f6b62488640 1 --2- 172.21.15.7:0/850456028 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6b4806b4d0 0x7f6b4806d990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c1f6c80 tx=0x7f6b50007e80 comp rx=0 tx=0).stop 2024-04-25T09:55:14.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.069+0000 7f6b62488640 1 -- 172.21.15.7:0/850456028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b5c06c6c0 msgr2=0x7f6b5c0c9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:14.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.069+0000 7f6b62488640 1 --2- 172.21.15.7:0/850456028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b5c06c6c0 0x7f6b5c0c9420 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c00e840 tx=0x7f6b4c00ed00 comp rx=0 tx=0).stop 2024-04-25T09:55:14.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.069+0000 7f6b62488640 1 -- 172.21.15.7:0/850456028 shutdown_connections 2024-04-25T09:55:14.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.069+0000 7f6b62488640 1 --2- 172.21.15.7:0/850456028 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6b4806b4d0 0x7f6b4806d990 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:14.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.069+0000 7f6b62488640 1 --2- 172.21.15.7:0/850456028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b5c15dd00 0x7f6b5c0b78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:14.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.069+0000 7f6b62488640 1 --2- 172.21.15.7:0/850456028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6b5c0b6a40 0x7f6b5c0cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:14.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.069+0000 7f6b62488640 1 --2- 172.21.15.7:0/850456028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b5c06c6c0 0x7f6b5c0c9420 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:14.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.069+0000 7f6b62488640 1 -- 172.21.15.7:0/850456028 >> 172.21.15.7:0/850456028 conn(0x7f6b5c0d07b0 msgr2=0x7f6b5c0c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:14.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.069+0000 7f6b62488640 1 -- 172.21.15.7:0/850456028 shutdown_connections 2024-04-25T09:55:14.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.069+0000 7f6b62488640 1 -- 172.21.15.7:0/850456028 wait complete. 2024-04-25T09:55:14.083 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:55:14.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:14.083 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-04-25T09:55:14.109 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-04-25T09:55:14.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:14.109 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:55:14.165 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:55:14.165 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:55:14.185 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:55:14.185 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:55:14.244 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:55:14.245 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:55:14.303 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:55:14.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.402+0000 7f0a16415640 1 Processor -- start 2024-04-25T09:55:14.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.402+0000 7f0a16415640 1 -- start start 2024-04-25T09:55:14.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.402+0000 7f0a16415640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0a100d0aa0 0x7f0a10161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:14.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.402+0000 7f0a16415640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a1015e8a0 con 0x7f0a101622b0 2024-04-25T09:55:14.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.402+0000 7f0a16415640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a1015eb80 con 0x7f0a1015da60 2024-04-25T09:55:14.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.402+0000 7f0a16415640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a1015ee60 con 0x7f0a100d0aa0 2024-04-25T09:55:14.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.403+0000 7f0a0f7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0a100d0aa0 0x7f0a10161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:14.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.403+0000 7f0a149b2640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0a101622b0 0x7f0a100ce520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:59236/0 (socket says 172.21.15.7:59236) 2024-04-25T09:55:14.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.403+0000 7f0a149b2640 1 -- 172.21.15.7:0/3581183630 learned_addr learned my addr 172.21.15.7:0/3581183630 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:14.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.403+0000 7f0a0f7fe640 1 -- 172.21.15.7:0/3581183630 >> v1:172.21.15.55:6789/0 conn(0x7f0a1015da60 legacy=0x7f0a1015de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:14.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.403+0000 7f0a0f7fe640 1 -- 172.21.15.7:0/3581183630 >> v1:172.21.15.7:6789/0 conn(0x7f0a101622b0 legacy=0x7f0a100ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:14.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.403+0000 7f0a0f7fe640 1 -- 172.21.15.7:0/3581183630 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a10161850 con 0x7f0a100d0aa0 2024-04-25T09:55:14.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.403+0000 7f0a0effd640 1 -- 172.21.15.7:0/3581183630 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 517676543 0 0) 0x7f0a1015e8a0 con 0x7f0a101622b0 2024-04-25T09:55:14.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.404+0000 7f0a0f7fe640 1 --2- 172.21.15.7:0/3581183630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a100d0aa0 0x7f0a10161d70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0a040097a0 tx=0x7f0a0402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a3df6bdeb54b97 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:14.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.404+0000 7f0a0effd640 1 -- 172.21.15.7:0/3581183630 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a04037070 con 0x7f0a100d0aa0 2024-04-25T09:55:14.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.404+0000 7f0a0effd640 1 -- 172.21.15.7:0/3581183630 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a04032440 con 0x7f0a100d0aa0 2024-04-25T09:55:14.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.404+0000 7f0a0effd640 1 -- 172.21.15.7:0/3581183630 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a04032810 con 0x7f0a100d0aa0 2024-04-25T09:55:14.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.404+0000 7f0a16415640 1 -- 172.21.15.7:0/3581183630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a100d0aa0 msgr2=0x7f0a10161d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:14.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.404+0000 7f0a16415640 1 --2- 172.21.15.7:0/3581183630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a100d0aa0 0x7f0a10161d70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0a040097a0 tx=0x7f0a0402a1a0 comp rx=0 tx=0).stop 2024-04-25T09:55:14.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.404+0000 7f0a16415640 1 -- 172.21.15.7:0/3581183630 shutdown_connections 2024-04-25T09:55:14.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.404+0000 7f0a16415640 1 --2- 172.21.15.7:0/3581183630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a100d0aa0 0x7f0a10161d70 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:14.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.404+0000 7f0a16415640 1 -- 172.21.15.7:0/3581183630 >> 172.21.15.7:0/3581183630 conn(0x7f0a1006bfe0 msgr2=0x7f0a1006c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:14.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.405+0000 7f0a16415640 1 -- 172.21.15.7:0/3581183630 shutdown_connections 2024-04-25T09:55:14.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.405+0000 7f0a16415640 1 -- 172.21.15.7:0/3581183630 wait complete. 2024-04-25T09:55:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.406+0000 7f0a16415640 1 Processor -- start 2024-04-25T09:55:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.406+0000 7f0a16415640 1 -- start start 2024-04-25T09:55:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.407+0000 7f0a16415640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a100d0aa0 0x7f0a101588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.407+0000 7f0a16415640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a1015da60 0x7f0a100b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.407+0000 7f0a16415640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a101622b0 0x7f0a100b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.407+0000 7f0a16415640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a100cedb0 con 0x7f0a1015da60 2024-04-25T09:55:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.407+0000 7f0a16415640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a100cec30 con 0x7f0a101622b0 2024-04-25T09:55:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.407+0000 7f0a16415640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a100d2ca0 con 0x7f0a100d0aa0 2024-04-25T09:55:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.407+0000 7f0a0f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a1015da60 0x7f0a100b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.407+0000 7f0a0f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a1015da60 0x7f0a100b56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38594/0 (socket says 172.21.15.7:38594) 2024-04-25T09:55:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.407+0000 7f0a0f7fe640 1 -- 172.21.15.7:0/1113394673 learned_addr learned my addr 172.21.15.7:0/1113394673 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.407+0000 7f0a149b2640 1 --2- 172.21.15.7:0/1113394673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a101622b0 0x7f0a100b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.407+0000 7f0a0f7fe640 1 -- 172.21.15.7:0/1113394673 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a100d0aa0 msgr2=0x7f0a101588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.407+0000 7f0a0ffff640 1 --2- 172.21.15.7:0/1113394673 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a100d0aa0 0x7f0a101588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.407+0000 7f0a0f7fe640 1 --2- 172.21.15.7:0/1113394673 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a100d0aa0 0x7f0a101588f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.407+0000 7f0a0f7fe640 1 -- 172.21.15.7:0/1113394673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a101622b0 msgr2=0x7f0a100b5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.407+0000 7f0a0f7fe640 1 --2- 172.21.15.7:0/1113394673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a101622b0 0x7f0a100b5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.407+0000 7f0a0f7fe640 1 -- 172.21.15.7:0/1113394673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a100cca50 con 0x7f0a1015da60 2024-04-25T09:55:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.407+0000 7f0a0f7fe640 1 --2- 172.21.15.7:0/1113394673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a1015da60 0x7f0a100b56c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0a040097a0 tx=0x7f0a040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.407+0000 7f0a0cff9640 1 -- 172.21.15.7:0/1113394673 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a04037050 con 0x7f0a1015da60 2024-04-25T09:55:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.407+0000 7f0a0cff9640 1 -- 172.21.15.7:0/1113394673 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a04038040 con 0x7f0a1015da60 2024-04-25T09:55:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.407+0000 7f0a0cff9640 1 -- 172.21.15.7:0/1113394673 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a04004490 con 0x7f0a1015da60 2024-04-25T09:55:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.407+0000 7f0a16415640 1 -- 172.21.15.7:0/1113394673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a100ccd30 con 0x7f0a1015da60 2024-04-25T09:55:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.408+0000 7f0a16415640 1 -- 172.21.15.7:0/1113394673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a101f4720 con 0x7f0a1015da60 2024-04-25T09:55:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.408+0000 7f0a16415640 1 -- 172.21.15.7:0/1113394673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a10068fd0 con 0x7f0a1015da60 2024-04-25T09:55:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.409+0000 7f0a0cff9640 1 -- 172.21.15.7:0/1113394673 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0a04030900 con 0x7f0a1015da60 2024-04-25T09:55:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.409+0000 7f0a0cff9640 1 --2- 172.21.15.7:0/1113394673 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f09fc06b500 0x7f09fc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.409+0000 7f0a0cff9640 1 -- 172.21.15.7:0/1113394673 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f0a040ab120 con 0x7f0a1015da60 2024-04-25T09:55:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.410+0000 7f0a0ffff640 1 --2- 172.21.15.7:0/1113394673 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f09fc06b500 0x7f09fc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.410+0000 7f0a0ffff640 1 --2- 172.21.15.7:0/1113394673 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f09fc06b500 0x7f09fc06d9c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0a100d3710 tx=0x7f0a00009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.414+0000 7f0a0cff9640 1 -- 172.21.15.7:0/1113394673 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0a04079cc0 con 0x7f0a1015da60 2024-04-25T09:55:14.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.593+0000 7f0a16415640 1 -- 172.21.15.7:0/1113394673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a100d1560 con 0x7f0a1015da60 2024-04-25T09:55:14.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.595+0000 7f0a0cff9640 1 -- 172.21.15.7:0/1113394673 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18807 (secure 0 0 0) 0x7f0a040795c0 con 0x7f0a1015da60 2024-04-25T09:55:14.598 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:14.598 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:55:09.591504+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:54:26.011833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:54:26.535536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:54:30.264996+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:55:14.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.596+0000 7f0a16415640 1 -- 172.21.15.7:0/1113394673 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f09fc06b500 msgr2=0x7f09fc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:14.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.596+0000 7f0a16415640 1 --2- 172.21.15.7:0/1113394673 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f09fc06b500 0x7f09fc06d9c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0a100d3710 tx=0x7f0a00009040 comp rx=0 tx=0).stop 2024-04-25T09:55:14.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.596+0000 7f0a16415640 1 -- 172.21.15.7:0/1113394673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a1015da60 msgr2=0x7f0a100b56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:14.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.596+0000 7f0a16415640 1 --2- 172.21.15.7:0/1113394673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a1015da60 0x7f0a100b56c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0a040097a0 tx=0x7f0a040046c0 comp rx=0 tx=0).stop 2024-04-25T09:55:14.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.597+0000 7f0a16415640 1 -- 172.21.15.7:0/1113394673 shutdown_connections 2024-04-25T09:55:14.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.597+0000 7f0a16415640 1 --2- 172.21.15.7:0/1113394673 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f09fc06b500 0x7f09fc06d9c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:14.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.597+0000 7f0a16415640 1 --2- 172.21.15.7:0/1113394673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a101622b0 0x7f0a100b5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:14.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.597+0000 7f0a16415640 1 --2- 172.21.15.7:0/1113394673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a1015da60 0x7f0a100b56c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:14.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.597+0000 7f0a16415640 1 --2- 172.21.15.7:0/1113394673 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a100d0aa0 0x7f0a101588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:14.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.597+0000 7f0a16415640 1 -- 172.21.15.7:0/1113394673 >> 172.21.15.7:0/1113394673 conn(0x7f0a1006bfe0 msgr2=0x7f0a1015de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:14.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.597+0000 7f0a16415640 1 -- 172.21.15.7:0/1113394673 shutdown_connections 2024-04-25T09:55:14.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.597+0000 7f0a16415640 1 -- 172.21.15.7:0/1113394673 wait complete. 2024-04-25T09:55:14.611 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:54:26.011833+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:54:26.535536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:54:30.264996+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:55:14.611 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:55:14.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.712+0000 7f7d5397e640 1 Processor -- start 2024-04-25T09:55:14.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.712+0000 7f7d5397e640 1 -- start start 2024-04-25T09:55:14.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.713+0000 7f7d5397e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d4c15deb0 0x7f7d4c0b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:14.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.713+0000 7f7d5397e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7d4c0ce030 0x7f7d4c0b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:14.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.713+0000 7f7d5397e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7d4c0b6f20 0x7f7d4c0d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:14.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.713+0000 7f7d5397e640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4c0d1a40 con 0x7f7d4c0ce030 2024-04-25T09:55:14.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.713+0000 7f7d5397e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4c0d1d20 con 0x7f7d4c0b6f20 2024-04-25T09:55:14.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.713+0000 7f7d5397e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c0d2000 con 0x7f7d4c15deb0 2024-04-25T09:55:14.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.713+0000 7f7d50f19640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7d4c0ce030 0x7f7d4c0b69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:14.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.713+0000 7f7d50f19640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7d4c0ce030 0x7f7d4c0b69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38598/0 (socket says 172.21.15.7:38598) 2024-04-25T09:55:14.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.713+0000 7f7d50f19640 1 -- 172.21.15.7:0/98497868 learned_addr learned my addr 172.21.15.7:0/98497868 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:14.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.713+0000 7f7d5171a640 1 --2- 172.21.15.7:0/98497868 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d4c15deb0 0x7f7d4c0b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:14.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.713+0000 7f7d51f1b640 1 --2- 172.21.15.7:0/98497868 >> v2:172.21.15.55:3300/0 conn(0x7f7d4c0b6f20 0x7f7d4c0d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:14.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.714+0000 7f7d50f19640 1 -- 172.21.15.7:0/98497868 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d4c15deb0 msgr2=0x7f7d4c0b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:14.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.714+0000 7f7d50f19640 1 --2- 172.21.15.7:0/98497868 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d4c15deb0 0x7f7d4c0b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:14.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.714+0000 7f7d50f19640 1 -- 172.21.15.7:0/98497868 >> v2:172.21.15.55:3300/0 conn(0x7f7d4c0b6f20 msgr2=0x7f7d4c0d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:14.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.714+0000 7f7d50f19640 1 --2- 172.21.15.7:0/98497868 >> v2:172.21.15.55:3300/0 conn(0x7f7d4c0b6f20 0x7f7d4c0d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:14.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.714+0000 7f7d50f19640 1 -- 172.21.15.7:0/98497868 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c0d22e0 con 0x7f7d4c0ce030 2024-04-25T09:55:14.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.714+0000 7f7d50f19640 1 --2- 172.21.15.7:0/98497868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d4c0ce030 0x7f7d4c0b69e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c0cddb0 tx=0x7f7d4002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=975c3e7874a41f22 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:14.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.714+0000 7f7d4bfff640 1 -- 172.21.15.7:0/98497868 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d40037070 con 0x7f7d4c0ce030 2024-04-25T09:55:14.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.715+0000 7f7d4bfff640 1 -- 172.21.15.7:0/98497868 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d40032440 con 0x7f7d4c0ce030 2024-04-25T09:55:14.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.715+0000 7f7d4bfff640 1 -- 172.21.15.7:0/98497868 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d40032810 con 0x7f7d4c0ce030 2024-04-25T09:55:14.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.715+0000 7f7d5397e640 1 -- 172.21.15.7:0/98497868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d4c0ce030 msgr2=0x7f7d4c0b69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:14.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.715+0000 7f7d5397e640 1 --2- 172.21.15.7:0/98497868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d4c0ce030 0x7f7d4c0b69e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c0cddb0 tx=0x7f7d4002a1e0 comp rx=0 tx=0).stop 2024-04-25T09:55:14.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.715+0000 7f7d5397e640 1 -- 172.21.15.7:0/98497868 shutdown_connections 2024-04-25T09:55:14.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.715+0000 7f7d5397e640 1 --2- 172.21.15.7:0/98497868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d4c0ce030 0x7f7d4c0b69e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:14.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.715+0000 7f7d5397e640 1 --2- 172.21.15.7:0/98497868 >> v2:172.21.15.55:3300/0 conn(0x7f7d4c0b6f20 0x7f7d4c0d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:14.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.715+0000 7f7d5397e640 1 --2- 172.21.15.7:0/98497868 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d4c15deb0 0x7f7d4c0b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:14.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.715+0000 7f7d5397e640 1 -- 172.21.15.7:0/98497868 >> 172.21.15.7:0/98497868 conn(0x7f7d4c0726b0 msgr2=0x7f7d4c072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:14.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.715+0000 7f7d5397e640 1 -- 172.21.15.7:0/98497868 shutdown_connections 2024-04-25T09:55:14.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.715+0000 7f7d5397e640 1 -- 172.21.15.7:0/98497868 wait complete. 2024-04-25T09:55:14.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.716+0000 7f7d5397e640 1 Processor -- start 2024-04-25T09:55:14.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.716+0000 7f7d5397e640 1 -- start start 2024-04-25T09:55:14.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.717+0000 7f7d5397e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d4c0b6f20 0x7f7d4c0c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:14.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.717+0000 7f7d5397e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d4c0ce030 0x7f7d4c146a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:14.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.717+0000 7f7d5397e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d4c15deb0 0x7f7d4c0cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:14.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.717+0000 7f7d5397e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c0d3ca0 con 0x7f7d4c0b6f20 2024-04-25T09:55:14.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.717+0000 7f7d5397e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c0ce490 con 0x7f7d4c0ce030 2024-04-25T09:55:14.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.717+0000 7f7d5397e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c0d3e20 con 0x7f7d4c15deb0 2024-04-25T09:55:14.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.717+0000 7f7d5171a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d4c0b6f20 0x7f7d4c0c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:14.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.717+0000 7f7d5171a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d4c0b6f20 0x7f7d4c0c9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38608/0 (socket says 172.21.15.7:38608) 2024-04-25T09:55:14.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.717+0000 7f7d5171a640 1 -- 172.21.15.7:0/3237626331 learned_addr learned my addr 172.21.15.7:0/3237626331 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:14.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.717+0000 7f7d50f19640 1 --2- 172.21.15.7:0/3237626331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d4c0ce030 0x7f7d4c146a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:14.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.717+0000 7f7d51f1b640 1 --2- 172.21.15.7:0/3237626331 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d4c15deb0 0x7f7d4c0cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:14.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.717+0000 7f7d5171a640 1 -- 172.21.15.7:0/3237626331 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d4c15deb0 msgr2=0x7f7d4c0cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:14.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.717+0000 7f7d5171a640 1 --2- 172.21.15.7:0/3237626331 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d4c15deb0 0x7f7d4c0cd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:14.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.717+0000 7f7d5171a640 1 -- 172.21.15.7:0/3237626331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d4c0ce030 msgr2=0x7f7d4c146a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:14.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.717+0000 7f7d5171a640 1 --2- 172.21.15.7:0/3237626331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d4c0ce030 0x7f7d4c146a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:14.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.717+0000 7f7d5171a640 1 -- 172.21.15.7:0/3237626331 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c1498d0 con 0x7f7d4c0b6f20 2024-04-25T09:55:14.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.718+0000 7f7d5171a640 1 --2- 172.21.15.7:0/3237626331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d4c0b6f20 0x7f7d4c0c9a70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7d44007e70 tx=0x7f7d4400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:14.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.718+0000 7f7d49ffb640 1 -- 172.21.15.7:0/3237626331 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d44014620 con 0x7f7d4c0b6f20 2024-04-25T09:55:14.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.718+0000 7f7d49ffb640 1 -- 172.21.15.7:0/3237626331 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d44019070 con 0x7f7d4c0b6f20 2024-04-25T09:55:14.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.718+0000 7f7d5397e640 1 -- 172.21.15.7:0/3237626331 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4c0cc9d0 con 0x7f7d4c0b6f20 2024-04-25T09:55:14.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.718+0000 7f7d49ffb640 1 -- 172.21.15.7:0/3237626331 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d44014a00 con 0x7f7d4c0b6f20 2024-04-25T09:55:14.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.718+0000 7f7d5397e640 1 -- 172.21.15.7:0/3237626331 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4c0cc630 con 0x7f7d4c0b6f20 2024-04-25T09:55:14.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.719+0000 7f7d5397e640 1 -- 172.21.15.7:0/3237626331 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d4c068f60 con 0x7f7d4c0b6f20 2024-04-25T09:55:14.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.719+0000 7f7d49ffb640 1 -- 172.21.15.7:0/3237626331 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7d44014ba0 con 0x7f7d4c0b6f20 2024-04-25T09:55:14.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.720+0000 7f7d49ffb640 1 --2- 172.21.15.7:0/3237626331 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7d3806b4d0 0x7f7d3806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:14.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.720+0000 7f7d49ffb640 1 -- 172.21.15.7:0/3237626331 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f7d4408ae70 con 0x7f7d4c0b6f20 2024-04-25T09:55:14.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.720+0000 7f7d50f19640 1 --2- 172.21.15.7:0/3237626331 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7d3806b4d0 0x7f7d3806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:14.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.720+0000 7f7d50f19640 1 --2- 172.21.15.7:0/3237626331 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7d3806b4d0 0x7f7d3806d990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7d40034000 tx=0x7f7d4002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:14.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.724+0000 7f7d49ffb640 1 -- 172.21.15.7:0/3237626331 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7d440598f0 con 0x7f7d4c0b6f20 2024-04-25T09:55:14.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.904+0000 7f7d5397e640 1 -- 172.21.15.7:0/3237626331 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7d4c06ae80 con 0x7f7d4c0b6f20 2024-04-25T09:55:14.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.904+0000 7f7d49ffb640 1 -- 172.21.15.7:0/3237626331 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7d440591f0 con 0x7f7d4c0b6f20 2024-04-25T09:55:14.907 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T09:55:14.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.906+0000 7f7d5397e640 1 -- 172.21.15.7:0/3237626331 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7d3806b4d0 msgr2=0x7f7d3806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:14.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.906+0000 7f7d5397e640 1 --2- 172.21.15.7:0/3237626331 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7d3806b4d0 0x7f7d3806d990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7d40034000 tx=0x7f7d4002e000 comp rx=0 tx=0).stop 2024-04-25T09:55:14.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.906+0000 7f7d5397e640 1 -- 172.21.15.7:0/3237626331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d4c0b6f20 msgr2=0x7f7d4c0c9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:14.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.906+0000 7f7d5397e640 1 --2- 172.21.15.7:0/3237626331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d4c0b6f20 0x7f7d4c0c9a70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7d44007e70 tx=0x7f7d4400e4b0 comp rx=0 tx=0).stop 2024-04-25T09:55:14.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.906+0000 7f7d5397e640 1 -- 172.21.15.7:0/3237626331 shutdown_connections 2024-04-25T09:55:14.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.906+0000 7f7d5397e640 1 --2- 172.21.15.7:0/3237626331 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7d3806b4d0 0x7f7d3806d990 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:14.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.906+0000 7f7d5397e640 1 --2- 172.21.15.7:0/3237626331 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d4c15deb0 0x7f7d4c0cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:14.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.906+0000 7f7d5397e640 1 --2- 172.21.15.7:0/3237626331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d4c0ce030 0x7f7d4c146a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:14.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.906+0000 7f7d5397e640 1 --2- 172.21.15.7:0/3237626331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d4c0b6f20 0x7f7d4c0c9a70 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:14.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.906+0000 7f7d5397e640 1 -- 172.21.15.7:0/3237626331 >> 172.21.15.7:0/3237626331 conn(0x7f7d4c0726b0 msgr2=0x7f7d4c072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:14.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.906+0000 7f7d5397e640 1 -- 172.21.15.7:0/3237626331 shutdown_connections 2024-04-25T09:55:14.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:14.906+0000 7f7d5397e640 1 -- 172.21.15.7:0/3237626331 wait complete. 2024-04-25T09:55:14.920 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:55:15.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.020+0000 7f4e69fd5640 1 Processor -- start 2024-04-25T09:55:15.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.020+0000 7f4e69fd5640 1 -- start start 2024-04-25T09:55:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.021+0000 7f4e69fd5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4e640d0780 0x7f4e640d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.021+0000 7f4e69fd5640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4e640b9130 0x7f4e640d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.021+0000 7f4e69fd5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e640d10a0 con 0x7f4e640b9590 2024-04-25T09:55:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.021+0000 7f4e69fd5640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e640b7ef0 con 0x7f4e640b9130 2024-04-25T09:55:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.021+0000 7f4e69fd5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e640b81d0 con 0x7f4e640d0780 2024-04-25T09:55:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.021+0000 7f4e62ffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4e640b9130 0x7f4e640d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.021+0000 7f4e62ffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4e640b9130 0x7f4e640d1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38618/0 (socket says 172.21.15.7:38618) 2024-04-25T09:55:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.021+0000 7f4e62ffd640 1 -- 172.21.15.7:0/2858836258 learned_addr learned my addr 172.21.15.7:0/2858836258 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.021+0000 7f4e637fe640 1 --2- 172.21.15.7:0/2858836258 >> v2:172.21.15.55:3300/0 conn(0x7f4e640d0780 0x7f4e640d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.021+0000 7f4e62ffd640 1 -- 172.21.15.7:0/2858836258 >> v2:172.21.15.55:3300/0 conn(0x7f4e640d0780 msgr2=0x7f4e640d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.021+0000 7f4e62ffd640 1 --2- 172.21.15.7:0/2858836258 >> v2:172.21.15.55:3300/0 conn(0x7f4e640d0780 0x7f4e640d0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.021+0000 7f4e62ffd640 1 -- 172.21.15.7:0/2858836258 >> v1:172.21.15.55:6789/0 conn(0x7f4e640b9590 legacy=0x7f4e640d2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.021+0000 7f4e62ffd640 1 -- 172.21.15.7:0/2858836258 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e640b84b0 con 0x7f4e640b9130 2024-04-25T09:55:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.022+0000 7f4e62ffd640 1 --2- 172.21.15.7:0/2858836258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e640b9130 0x7f4e640d1c30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4e640b6180 tx=0x7f4e5802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=418bde07850d4e80 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.022+0000 7f4e627fc640 1 -- 172.21.15.7:0/2858836258 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e58037070 con 0x7f4e640b9130 2024-04-25T09:55:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.022+0000 7f4e627fc640 1 -- 172.21.15.7:0/2858836258 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e58032440 con 0x7f4e640b9130 2024-04-25T09:55:15.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.022+0000 7f4e627fc640 1 -- 172.21.15.7:0/2858836258 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e58032810 con 0x7f4e640b9130 2024-04-25T09:55:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.023+0000 7f4e69fd5640 1 -- 172.21.15.7:0/2858836258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e640b9130 msgr2=0x7f4e640d1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.023+0000 7f4e69fd5640 1 --2- 172.21.15.7:0/2858836258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e640b9130 0x7f4e640d1c30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4e640b6180 tx=0x7f4e5802a270 comp rx=0 tx=0).stop 2024-04-25T09:55:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.023+0000 7f4e69fd5640 1 -- 172.21.15.7:0/2858836258 shutdown_connections 2024-04-25T09:55:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.023+0000 7f4e69fd5640 1 --2- 172.21.15.7:0/2858836258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e640b9130 0x7f4e640d1c30 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.023+0000 7f4e69fd5640 1 --2- 172.21.15.7:0/2858836258 >> v2:172.21.15.55:3300/0 conn(0x7f4e640d0780 0x7f4e640d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.023+0000 7f4e69fd5640 1 -- 172.21.15.7:0/2858836258 >> 172.21.15.7:0/2858836258 conn(0x7f4e640726b0 msgr2=0x7f4e64072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.023+0000 7f4e69fd5640 1 -- 172.21.15.7:0/2858836258 shutdown_connections 2024-04-25T09:55:15.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.023+0000 7f4e69fd5640 1 -- 172.21.15.7:0/2858836258 wait complete. 2024-04-25T09:55:15.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.024+0000 7f4e69fd5640 1 Processor -- start 2024-04-25T09:55:15.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.024+0000 7f4e69fd5640 1 -- start start 2024-04-25T09:55:15.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.025+0000 7f4e69fd5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e640b9130 0x7f4e640c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:15.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.025+0000 7f4e69fd5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e640b9590 0x7f4e64159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:15.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.025+0000 7f4e69fd5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e640d0780 0x7f4e640cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:15.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.025+0000 7f4e69fd5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e641611b0 con 0x7f4e640b9590 2024-04-25T09:55:15.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.025+0000 7f4e69fd5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e640b8a70 con 0x7f4e640b9130 2024-04-25T09:55:15.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.025+0000 7f4e69fd5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e64161330 con 0x7f4e640d0780 2024-04-25T09:55:15.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.025+0000 7f4e62ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e640b9590 0x7f4e64159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:15.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.025+0000 7f4e62ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e640b9590 0x7f4e64159bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38632/0 (socket says 172.21.15.7:38632) 2024-04-25T09:55:15.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.025+0000 7f4e62ffd640 1 -- 172.21.15.7:0/2700105306 learned_addr learned my addr 172.21.15.7:0/2700105306 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.025+0000 7f4e637fe640 1 --2- 172.21.15.7:0/2700105306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e640b9130 0x7f4e640c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.025+0000 7f4e63fff640 1 --2- 172.21.15.7:0/2700105306 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e640d0780 0x7f4e640cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.025+0000 7f4e62ffd640 1 -- 172.21.15.7:0/2700105306 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e640d0780 msgr2=0x7f4e640cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.025+0000 7f4e62ffd640 1 --2- 172.21.15.7:0/2700105306 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e640d0780 0x7f4e640cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.025+0000 7f4e62ffd640 1 -- 172.21.15.7:0/2700105306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e640b9130 msgr2=0x7f4e640c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.025+0000 7f4e62ffd640 1 --2- 172.21.15.7:0/2700105306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e640b9130 0x7f4e640c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.025+0000 7f4e62ffd640 1 -- 172.21.15.7:0/2700105306 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e640cb300 con 0x7f4e640b9590 2024-04-25T09:55:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.025+0000 7f4e637fe640 1 --2- 172.21.15.7:0/2700105306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e640b9130 0x7f4e640c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.026+0000 7f4e62ffd640 1 --2- 172.21.15.7:0/2700105306 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e640b9590 0x7f4e64159bd0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4e58000c00 tx=0x7f4e580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.026+0000 7f4e4bfff640 1 -- 172.21.15.7:0/2700105306 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e58041020 con 0x7f4e640b9590 2024-04-25T09:55:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.026+0000 7f4e4bfff640 1 -- 172.21.15.7:0/2700105306 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e580306c0 con 0x7f4e640b9590 2024-04-25T09:55:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.026+0000 7f4e4bfff640 1 -- 172.21.15.7:0/2700105306 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e58037040 con 0x7f4e640b9590 2024-04-25T09:55:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.026+0000 7f4e69fd5640 1 -- 172.21.15.7:0/2700105306 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e640cb5a0 con 0x7f4e640b9590 2024-04-25T09:55:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.026+0000 7f4e69fd5640 1 -- 172.21.15.7:0/2700105306 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e640cbb60 con 0x7f4e640b9590 2024-04-25T09:55:15.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.027+0000 7f4e69fd5640 1 -- 172.21.15.7:0/2700105306 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e640685d0 con 0x7f4e640b9590 2024-04-25T09:55:15.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.027+0000 7f4e4bfff640 1 -- 172.21.15.7:0/2700105306 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4e58044020 con 0x7f4e640b9590 2024-04-25T09:55:15.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.028+0000 7f4e4bfff640 1 --2- 172.21.15.7:0/2700105306 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4e5006b4d0 0x7f4e5006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:15.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.028+0000 7f4e4bfff640 1 -- 172.21.15.7:0/2700105306 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f4e580aae00 con 0x7f4e640b9590 2024-04-25T09:55:15.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.028+0000 7f4e637fe640 1 --2- 172.21.15.7:0/2700105306 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4e5006b4d0 0x7f4e5006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:15.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.028+0000 7f4e637fe640 1 --2- 172.21.15.7:0/2700105306 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4e5006b4d0 0x7f4e5006d990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4e54006fd0 tx=0x7f4e54008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:15.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.032+0000 7f4e4bfff640 1 -- 172.21.15.7:0/2700105306 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4e5804b030 con 0x7f4e640b9590 2024-04-25T09:55:15.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.215+0000 7f4e69fd5640 1 -- 172.21.15.7:0/2700105306 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4e64068f60 con 0x7f4e640b9590 2024-04-25T09:55:15.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.216+0000 7f4e4bfff640 1 -- 172.21.15.7:0/2700105306 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4e58079880 con 0x7f4e640b9590 2024-04-25T09:55:15.219 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:55:15.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.218+0000 7f4e69fd5640 1 -- 172.21.15.7:0/2700105306 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4e5006b4d0 msgr2=0x7f4e5006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:15.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.218+0000 7f4e69fd5640 1 --2- 172.21.15.7:0/2700105306 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4e5006b4d0 0x7f4e5006d990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4e54006fd0 tx=0x7f4e54008040 comp rx=0 tx=0).stop 2024-04-25T09:55:15.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.218+0000 7f4e69fd5640 1 -- 172.21.15.7:0/2700105306 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e640b9590 msgr2=0x7f4e64159bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:15.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.218+0000 7f4e69fd5640 1 --2- 172.21.15.7:0/2700105306 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e640b9590 0x7f4e64159bd0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4e58000c00 tx=0x7f4e580046c0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.218+0000 7f4e69fd5640 1 -- 172.21.15.7:0/2700105306 shutdown_connections 2024-04-25T09:55:15.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.218+0000 7f4e69fd5640 1 --2- 172.21.15.7:0/2700105306 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4e5006b4d0 0x7f4e5006d990 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.218+0000 7f4e69fd5640 1 --2- 172.21.15.7:0/2700105306 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e640d0780 0x7f4e640cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.218+0000 7f4e69fd5640 1 --2- 172.21.15.7:0/2700105306 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e640b9590 0x7f4e64159bd0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.218+0000 7f4e69fd5640 1 --2- 172.21.15.7:0/2700105306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e640b9130 0x7f4e640c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.218+0000 7f4e69fd5640 1 -- 172.21.15.7:0/2700105306 >> 172.21.15.7:0/2700105306 conn(0x7f4e640726b0 msgr2=0x7f4e640b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:15.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.218+0000 7f4e69fd5640 1 -- 172.21.15.7:0/2700105306 shutdown_connections 2024-04-25T09:55:15.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.218+0000 7f4e69fd5640 1 -- 172.21.15.7:0/2700105306 wait complete. 2024-04-25T09:55:15.232 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:55:15.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.333+0000 7f01662b3640 1 Processor -- start 2024-04-25T09:55:15.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.333+0000 7f01662b3640 1 -- start start 2024-04-25T09:55:15.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.334+0000 7f01662b3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f01600ce0d0 0x7f016006abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:15.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.334+0000 7f01662b3640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f016006b9b0 con 0x7f016006b130 2024-04-25T09:55:15.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.334+0000 7f01662b3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f016006bc90 con 0x7f01600af490 2024-04-25T09:55:15.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.334+0000 7f01662b3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01600af870 con 0x7f01600ce0d0 2024-04-25T09:55:15.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.334+0000 7f0164850640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f016006b130 0x7f016006db40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:59252/0 (socket says 172.21.15.7:59252) 2024-04-25T09:55:15.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.334+0000 7f0164850640 1 -- 172.21.15.7:0/2919065261 learned_addr learned my addr 172.21.15.7:0/2919065261 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:15.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.334+0000 7f015f7fe640 1 --2- 172.21.15.7:0/2919065261 >> v2:172.21.15.55:3300/0 conn(0x7f01600ce0d0 0x7f016006abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:15.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.334+0000 7f015effd640 1 -- 172.21.15.7:0/2919065261 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1131869207 0 0) 0x7f016006b9b0 con 0x7f016006b130 2024-04-25T09:55:15.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.335+0000 7f015effd640 1 -- 172.21.15.7:0/2919065261 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0148003520 con 0x7f016006b130 2024-04-25T09:55:15.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.335+0000 7f015effd640 1 -- 172.21.15.7:0/2919065261 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1715851310 0 0) 0x7f0148003520 con 0x7f016006b130 2024-04-25T09:55:15.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.335+0000 7f015effd640 1 -- 172.21.15.7:0/2919065261 >> v2:172.21.15.55:3300/0 conn(0x7f01600ce0d0 msgr2=0x7f016006abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:15.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.335+0000 7f015effd640 1 --2- 172.21.15.7:0/2919065261 >> v2:172.21.15.55:3300/0 conn(0x7f01600ce0d0 0x7f016006abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.335+0000 7f015effd640 1 -- 172.21.15.7:0/2919065261 >> v1:172.21.15.55:6789/0 conn(0x7f01600af490 legacy=0x7f01600cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:15.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.335+0000 7f015effd640 1 -- 172.21.15.7:0/2919065261 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016006bf70 con 0x7f016006b130 2024-04-25T09:55:15.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.335+0000 7f015effd640 1 -- 172.21.15.7:0/2919065261 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f01580019f0 con 0x7f016006b130 2024-04-25T09:55:15.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.335+0000 7f015effd640 1 -- 172.21.15.7:0/2919065261 >> v1:172.21.15.7:6789/0 conn(0x7f016006b130 legacy=0x7f016006db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:15.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.335+0000 7f015effd640 1 --2- 172.21.15.7:0/2919065261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01480039b0 0x7f0148003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:15.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.335+0000 7f015effd640 1 --2- 172.21.15.7:0/2919065261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01480043b0 0x7f0148004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:15.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.335+0000 7f015effd640 1 --2- 172.21.15.7:0/2919065261 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0148005080 0x7f014800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:15.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.335+0000 7f015effd640 1 -- 172.21.15.7:0/2919065261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01600af870 con 0x7f01480039b0 2024-04-25T09:55:15.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.335+0000 7f015effd640 1 -- 172.21.15.7:0/2919065261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014800bfe0 con 0x7f01480043b0 2024-04-25T09:55:15.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.335+0000 7f015ffff640 1 --2- 172.21.15.7:0/2919065261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01480039b0 0x7f0148003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:15.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.335+0000 7f015effd640 1 -- 172.21.15.7:0/2919065261 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014800c1e0 con 0x7f0148005080 2024-04-25T09:55:15.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.335+0000 7f015f7fe640 1 --2- 172.21.15.7:0/2919065261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01480043b0 0x7f0148004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:15.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.335+0000 7f0164850640 1 --2- 172.21.15.7:0/2919065261 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0148005080 0x7f014800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:15.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.335+0000 7f015ffff640 1 -- 172.21.15.7:0/2919065261 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0148005080 msgr2=0x7f014800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:15.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.335+0000 7f015ffff640 1 --2- 172.21.15.7:0/2919065261 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0148005080 0x7f014800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.335+0000 7f015ffff640 1 -- 172.21.15.7:0/2919065261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01480043b0 msgr2=0x7f0148004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:15.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.335+0000 7f015ffff640 1 --2- 172.21.15.7:0/2919065261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01480043b0 0x7f0148004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.335+0000 7f015ffff640 1 -- 172.21.15.7:0/2919065261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0148003520 con 0x7f01480039b0 2024-04-25T09:55:15.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.335+0000 7f0164850640 1 --2- 172.21.15.7:0/2919065261 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0148005080 0x7f014800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:15.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.335+0000 7f0164850640 1 -- 172.21.15.7:0/2919065261 reap_dead start 2024-04-25T09:55:15.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.336+0000 7f015ffff640 1 --2- 172.21.15.7:0/2919065261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01480039b0 0x7f0148003d90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0150001860 tx=0x7f0148005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e372262f28a00db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:15.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.336+0000 7f015effd640 1 -- 172.21.15.7:0/2919065261 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0150037070 con 0x7f01480039b0 2024-04-25T09:55:15.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.336+0000 7f015effd640 1 -- 172.21.15.7:0/2919065261 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f015002abf0 con 0x7f01480039b0 2024-04-25T09:55:15.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.336+0000 7f015effd640 1 -- 172.21.15.7:0/2919065261 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0150001430 con 0x7f01480039b0 2024-04-25T09:55:15.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.337+0000 7f01662b3640 1 -- 172.21.15.7:0/2919065261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01480039b0 msgr2=0x7f0148003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:15.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.337+0000 7f01662b3640 1 --2- 172.21.15.7:0/2919065261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01480039b0 0x7f0148003d90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0150001860 tx=0x7f0148005830 comp rx=0 tx=0).stop 2024-04-25T09:55:15.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.337+0000 7f01662b3640 1 -- 172.21.15.7:0/2919065261 shutdown_connections 2024-04-25T09:55:15.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.337+0000 7f01662b3640 1 --2- 172.21.15.7:0/2919065261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01480039b0 0x7f0148003d90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.337+0000 7f01662b3640 1 -- 172.21.15.7:0/2919065261 >> 172.21.15.7:0/2919065261 conn(0x7f01600cc870 msgr2=0x7f01600ccc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:15.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.337+0000 7f01662b3640 1 -- 172.21.15.7:0/2919065261 shutdown_connections 2024-04-25T09:55:15.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.337+0000 7f01662b3640 1 -- 172.21.15.7:0/2919065261 wait complete. 2024-04-25T09:55:15.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.338+0000 7f01662b3640 1 Processor -- start 2024-04-25T09:55:15.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.338+0000 7f01662b3640 1 -- start start 2024-04-25T09:55:15.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.339+0000 7f01662b3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01480039b0 0x7f0160132cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:15.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.339+0000 7f01662b3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01600b45f0 0x7f0160154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:15.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.339+0000 7f01662b3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0160143fa0 0x7f0160144420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:15.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.339+0000 7f01662b3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016006b6f0 con 0x7f01480039b0 2024-04-25T09:55:15.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.339+0000 7f01662b3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016006b570 con 0x7f01600b45f0 2024-04-25T09:55:15.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.339+0000 7f01662b3640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f016006abf0 con 0x7f0160143fa0 2024-04-25T09:55:15.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.339+0000 7f015ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01480039b0 0x7f0160132cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:15.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.339+0000 7f015ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01480039b0 0x7f0160132cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38658/0 (socket says 172.21.15.7:38658) 2024-04-25T09:55:15.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.339+0000 7f015ffff640 1 -- 172.21.15.7:0/3297667004 learned_addr learned my addr 172.21.15.7:0/3297667004 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:15.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.339+0000 7f015f7fe640 1 --2- 172.21.15.7:0/3297667004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01600b45f0 0x7f0160154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:15.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.339+0000 7f0164850640 1 --2- 172.21.15.7:0/3297667004 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0160143fa0 0x7f0160144420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:15.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.339+0000 7f015ffff640 1 -- 172.21.15.7:0/3297667004 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0160143fa0 msgr2=0x7f0160144420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:15.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.339+0000 7f015ffff640 1 --2- 172.21.15.7:0/3297667004 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0160143fa0 0x7f0160144420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.339+0000 7f015ffff640 1 -- 172.21.15.7:0/3297667004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01600b45f0 msgr2=0x7f0160154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:15.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.339+0000 7f015ffff640 1 --2- 172.21.15.7:0/3297667004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01600b45f0 0x7f0160154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.339+0000 7f015ffff640 1 -- 172.21.15.7:0/3297667004 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0160144960 con 0x7f01480039b0 2024-04-25T09:55:15.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.339+0000 7f015f7fe640 1 --2- 172.21.15.7:0/3297667004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01600b45f0 0x7f0160154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:15.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.339+0000 7f015ffff640 1 --2- 172.21.15.7:0/3297667004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01480039b0 0x7f0160132cc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f015002a6c0 tx=0x7f0150001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:15.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.340+0000 7f015cff9640 1 -- 172.21.15.7:0/3297667004 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0150040020 con 0x7f01480039b0 2024-04-25T09:55:15.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.340+0000 7f015cff9640 1 -- 172.21.15.7:0/3297667004 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0150038040 con 0x7f01480039b0 2024-04-25T09:55:15.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.340+0000 7f01662b3640 1 -- 172.21.15.7:0/3297667004 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0160131ae0 con 0x7f01480039b0 2024-04-25T09:55:15.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.340+0000 7f015cff9640 1 -- 172.21.15.7:0/3297667004 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0150037070 con 0x7f01480039b0 2024-04-25T09:55:15.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.340+0000 7f01662b3640 1 -- 172.21.15.7:0/3297667004 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01600b5060 con 0x7f01480039b0 2024-04-25T09:55:15.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.341+0000 7f01662b3640 1 -- 172.21.15.7:0/3297667004 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0160068f60 con 0x7f01480039b0 2024-04-25T09:55:15.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.341+0000 7f015cff9640 1 -- 172.21.15.7:0/3297667004 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0150043020 con 0x7f01480039b0 2024-04-25T09:55:15.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.341+0000 7f015cff9640 1 --2- 172.21.15.7:0/3297667004 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f014c06b4d0 0x7f014c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:15.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.342+0000 7f015cff9640 1 -- 172.21.15.7:0/3297667004 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f01500aa850 con 0x7f01480039b0 2024-04-25T09:55:15.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.342+0000 7f015f7fe640 1 --2- 172.21.15.7:0/3297667004 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f014c06b4d0 0x7f014c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:15.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.342+0000 7f015f7fe640 1 --2- 172.21.15.7:0/3297667004 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f014c06b4d0 0x7f014c06d990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0160144e20 tx=0x7f0154008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:15.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.346+0000 7f015cff9640 1 -- 172.21.15.7:0/3297667004 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f015004a020 con 0x7f01480039b0 2024-04-25T09:55:15.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.523+0000 7f01662b3640 1 -- 172.21.15.7:0/3297667004 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f01600669c0 con 0x7f01480039b0 2024-04-25T09:55:15.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.524+0000 7f015cff9640 1 -- 172.21.15.7:0/3297667004 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f01500793f0 con 0x7f01480039b0 2024-04-25T09:55:15.527 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T09:55:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.526+0000 7f01662b3640 1 -- 172.21.15.7:0/3297667004 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f014c06b4d0 msgr2=0x7f014c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.526+0000 7f01662b3640 1 --2- 172.21.15.7:0/3297667004 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f014c06b4d0 0x7f014c06d990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0160144e20 tx=0x7f0154008040 comp rx=0 tx=0).stop 2024-04-25T09:55:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.526+0000 7f01662b3640 1 -- 172.21.15.7:0/3297667004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01480039b0 msgr2=0x7f0160132cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.526+0000 7f01662b3640 1 --2- 172.21.15.7:0/3297667004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01480039b0 0x7f0160132cc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f015002a6c0 tx=0x7f0150001230 comp rx=0 tx=0).stop 2024-04-25T09:55:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.526+0000 7f01662b3640 1 -- 172.21.15.7:0/3297667004 shutdown_connections 2024-04-25T09:55:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.526+0000 7f01662b3640 1 --2- 172.21.15.7:0/3297667004 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f014c06b4d0 0x7f014c06d990 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.526+0000 7f01662b3640 1 --2- 172.21.15.7:0/3297667004 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0160143fa0 0x7f0160144420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.526+0000 7f01662b3640 1 --2- 172.21.15.7:0/3297667004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01600b45f0 0x7f0160154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.526+0000 7f01662b3640 1 --2- 172.21.15.7:0/3297667004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01480039b0 0x7f0160132cc0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.526+0000 7f01662b3640 1 -- 172.21.15.7:0/3297667004 >> 172.21.15.7:0/3297667004 conn(0x7f01600cc870 msgr2=0x7f016006e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.526+0000 7f01662b3640 1 -- 172.21.15.7:0/3297667004 shutdown_connections 2024-04-25T09:55:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.526+0000 7f01662b3640 1 -- 172.21.15.7:0/3297667004 wait complete. 2024-04-25T09:55:15.540 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:55:15.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.641+0000 7f2b01493640 1 Processor -- start 2024-04-25T09:55:15.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.641+0000 7f2b01493640 1 -- start start 2024-04-25T09:55:15.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.642+0000 7f2b01493640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2afc15a850 0x7f2afc0b2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:15.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.642+0000 7f2b01493640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2afc0b2d40 0x7f2afc0ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:15.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.642+0000 7f2b01493640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2afc0cc400 con 0x7f2afc0cd490 2024-04-25T09:55:15.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.642+0000 7f2b01493640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2afc15f310 con 0x7f2afc15a850 2024-04-25T09:55:15.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.642+0000 7f2b01493640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2afc0cb360 con 0x7f2afc0b2d40 2024-04-25T09:55:15.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.642+0000 7f2afaffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2afc15a850 0x7f2afc0b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:15.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.642+0000 7f2afb7fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2afc0cd490 0x7f2afc06f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:59266/0 (socket says 172.21.15.7:59266) 2024-04-25T09:55:15.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.642+0000 7f2afb7fe640 1 -- 172.21.15.7:0/4216347638 learned_addr learned my addr 172.21.15.7:0/4216347638 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:15.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.642+0000 7f2afa7fc640 1 --2- 172.21.15.7:0/4216347638 >> v2:172.21.15.55:3300/0 conn(0x7f2afc0b2d40 0x7f2afc0ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:15.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.642+0000 7f2afaffd640 1 -- 172.21.15.7:0/4216347638 >> v2:172.21.15.55:3300/0 conn(0x7f2afc0b2d40 msgr2=0x7f2afc0ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:15.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.642+0000 7f2afaffd640 1 --2- 172.21.15.7:0/4216347638 >> v2:172.21.15.55:3300/0 conn(0x7f2afc0b2d40 0x7f2afc0ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.642+0000 7f2afaffd640 1 -- 172.21.15.7:0/4216347638 >> v1:172.21.15.7:6789/0 conn(0x7f2afc0cd490 legacy=0x7f2afc06f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:15.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.642+0000 7f2afaffd640 1 -- 172.21.15.7:0/4216347638 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2afc0cb640 con 0x7f2afc15a850 2024-04-25T09:55:15.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.642+0000 7f2af9ffb640 1 -- 172.21.15.7:0/4216347638 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 404821628 0 0) 0x7f2afc0cc400 con 0x7f2afc0cd490 2024-04-25T09:55:15.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.643+0000 7f2afaffd640 1 --2- 172.21.15.7:0/4216347638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2afc15a850 0x7f2afc0b2800 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2afc0d1620 tx=0x7f2aec02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7c0de2cafaa152 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:15.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.643+0000 7f2af9ffb640 1 -- 172.21.15.7:0/4216347638 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec037070 con 0x7f2afc15a850 2024-04-25T09:55:15.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.643+0000 7f2af9ffb640 1 -- 172.21.15.7:0/4216347638 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aec032440 con 0x7f2afc15a850 2024-04-25T09:55:15.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.643+0000 7f2af9ffb640 1 -- 172.21.15.7:0/4216347638 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec02ae60 con 0x7f2afc15a850 2024-04-25T09:55:15.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.644+0000 7f2b01493640 1 -- 172.21.15.7:0/4216347638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2afc15a850 msgr2=0x7f2afc0b2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:15.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.644+0000 7f2b01493640 1 --2- 172.21.15.7:0/4216347638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2afc15a850 0x7f2afc0b2800 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2afc0d1620 tx=0x7f2aec02a110 comp rx=0 tx=0).stop 2024-04-25T09:55:15.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.644+0000 7f2b01493640 1 -- 172.21.15.7:0/4216347638 shutdown_connections 2024-04-25T09:55:15.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.644+0000 7f2b01493640 1 --2- 172.21.15.7:0/4216347638 >> v2:172.21.15.55:3300/0 conn(0x7f2afc0b2d40 0x7f2afc0ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.644+0000 7f2b01493640 1 --2- 172.21.15.7:0/4216347638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2afc15a850 0x7f2afc0b2800 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.644+0000 7f2b01493640 1 -- 172.21.15.7:0/4216347638 >> 172.21.15.7:0/4216347638 conn(0x7f2afc0999f0 msgr2=0x7f2afc0b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:15.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.644+0000 7f2b01493640 1 -- 172.21.15.7:0/4216347638 shutdown_connections 2024-04-25T09:55:15.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.644+0000 7f2b01493640 1 -- 172.21.15.7:0/4216347638 wait complete. 2024-04-25T09:55:15.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.645+0000 7f2b01493640 1 Processor -- start 2024-04-25T09:55:15.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.645+0000 7f2b01493640 1 -- start start 2024-04-25T09:55:15.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.646+0000 7f2b01493640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2afc0b2d40 0x7f2afc15ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:15.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.646+0000 7f2b01493640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2afc0cd490 0x7f2afc14b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:15.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.646+0000 7f2b01493640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2afc15a850 0x7f2afc0c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:15.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.646+0000 7f2b01493640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc0cb050 con 0x7f2afc0cd490 2024-04-25T09:55:15.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.646+0000 7f2b01493640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc0cbc00 con 0x7f2afc15a850 2024-04-25T09:55:15.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.646+0000 7f2b01493640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc15ac30 con 0x7f2afc0b2d40 2024-04-25T09:55:15.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.646+0000 7f2afa7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2afc0cd490 0x7f2afc14b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:15.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.646+0000 7f2afa7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2afc0cd490 0x7f2afc14b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38684/0 (socket says 172.21.15.7:38684) 2024-04-25T09:55:15.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.646+0000 7f2afa7fc640 1 -- 172.21.15.7:0/3119036921 learned_addr learned my addr 172.21.15.7:0/3119036921 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:15.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.646+0000 7f2afaffd640 1 --2- 172.21.15.7:0/3119036921 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2afc0b2d40 0x7f2afc15ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:15.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.646+0000 7f2afb7fe640 1 --2- 172.21.15.7:0/3119036921 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2afc15a850 0x7f2afc0c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:15.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.646+0000 7f2afa7fc640 1 -- 172.21.15.7:0/3119036921 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2afc0b2d40 msgr2=0x7f2afc15ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:15.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.646+0000 7f2afa7fc640 1 --2- 172.21.15.7:0/3119036921 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2afc0b2d40 0x7f2afc15ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.646+0000 7f2afa7fc640 1 -- 172.21.15.7:0/3119036921 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2afc15a850 msgr2=0x7f2afc0c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:15.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.646+0000 7f2afa7fc640 1 --2- 172.21.15.7:0/3119036921 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2afc15a850 0x7f2afc0c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.646+0000 7f2afa7fc640 1 -- 172.21.15.7:0/3119036921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2afc0c9380 con 0x7f2afc0cd490 2024-04-25T09:55:15.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.646+0000 7f2afaffd640 1 --2- 172.21.15.7:0/3119036921 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2afc0b2d40 0x7f2afc15ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:15.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.646+0000 7f2afb7fe640 1 --2- 172.21.15.7:0/3119036921 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2afc15a850 0x7f2afc0c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:15.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.646+0000 7f2afa7fc640 1 --2- 172.21.15.7:0/3119036921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2afc0cd490 0x7f2afc14b7f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2af000d5f0 tx=0x7f2af000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:15.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.647+0000 7f2ae37fe640 1 -- 172.21.15.7:0/3119036921 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af00125f0 con 0x7f2afc0cd490 2024-04-25T09:55:15.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.647+0000 7f2ae37fe640 1 -- 172.21.15.7:0/3119036921 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af0019070 con 0x7f2afc0cd490 2024-04-25T09:55:15.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.647+0000 7f2b01493640 1 -- 172.21.15.7:0/3119036921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2afc0c9660 con 0x7f2afc0cd490 2024-04-25T09:55:15.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.647+0000 7f2ae37fe640 1 -- 172.21.15.7:0/3119036921 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af00129d0 con 0x7f2afc0cd490 2024-04-25T09:55:15.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.647+0000 7f2b01493640 1 -- 172.21.15.7:0/3119036921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2afc0c9c20 con 0x7f2afc0cd490 2024-04-25T09:55:15.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.648+0000 7f2b01493640 1 -- 172.21.15.7:0/3119036921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2afc068f60 con 0x7f2afc0cd490 2024-04-25T09:55:15.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.648+0000 7f2ae37fe640 1 -- 172.21.15.7:0/3119036921 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2af0012b70 con 0x7f2afc0cd490 2024-04-25T09:55:15.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.649+0000 7f2ae37fe640 1 --2- 172.21.15.7:0/3119036921 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2ae806b4d0 0x7f2ae806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:15.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.649+0000 7f2afaffd640 1 --2- 172.21.15.7:0/3119036921 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2ae806b4d0 0x7f2ae806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:15.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.649+0000 7f2ae37fe640 1 -- 172.21.15.7:0/3119036921 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f2af008aa00 con 0x7f2afc0cd490 2024-04-25T09:55:15.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.649+0000 7f2afaffd640 1 --2- 172.21.15.7:0/3119036921 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2ae806b4d0 0x7f2ae806d990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2aec034000 tx=0x7f2aec02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:15.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.653+0000 7f2ae37fe640 1 -- 172.21.15.7:0/3119036921 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2af0059480 con 0x7f2afc0cd490 2024-04-25T09:55:15.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.837+0000 7f2b01493640 1 -- 172.21.15.7:0/3119036921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2afc0ccd30 con 0x7f2afc0cd490 2024-04-25T09:55:15.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.837+0000 7f2ae37fe640 1 -- 172.21.15.7:0/3119036921 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2af0058d80 con 0x7f2afc0cd490 2024-04-25T09:55:15.840 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:55:15.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.840+0000 7f2b01493640 1 -- 172.21.15.7:0/3119036921 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2ae806b4d0 msgr2=0x7f2ae806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:15.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.840+0000 7f2b01493640 1 --2- 172.21.15.7:0/3119036921 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2ae806b4d0 0x7f2ae806d990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2aec034000 tx=0x7f2aec02e000 comp rx=0 tx=0).stop 2024-04-25T09:55:15.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.840+0000 7f2b01493640 1 -- 172.21.15.7:0/3119036921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2afc0cd490 msgr2=0x7f2afc14b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:15.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.840+0000 7f2b01493640 1 --2- 172.21.15.7:0/3119036921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2afc0cd490 0x7f2afc14b7f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2af000d5f0 tx=0x7f2af000dab0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.840+0000 7f2b01493640 1 -- 172.21.15.7:0/3119036921 shutdown_connections 2024-04-25T09:55:15.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.840+0000 7f2b01493640 1 --2- 172.21.15.7:0/3119036921 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2ae806b4d0 0x7f2ae806d990 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.840+0000 7f2b01493640 1 --2- 172.21.15.7:0/3119036921 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2afc15a850 0x7f2afc0c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.840+0000 7f2b01493640 1 --2- 172.21.15.7:0/3119036921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2afc0cd490 0x7f2afc14b7f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.840+0000 7f2b01493640 1 --2- 172.21.15.7:0/3119036921 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2afc0b2d40 0x7f2afc15ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.840+0000 7f2b01493640 1 -- 172.21.15.7:0/3119036921 >> 172.21.15.7:0/3119036921 conn(0x7f2afc0999f0 msgr2=0x7f2afc06ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:15.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.840+0000 7f2b01493640 1 -- 172.21.15.7:0/3119036921 shutdown_connections 2024-04-25T09:55:15.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.840+0000 7f2b01493640 1 -- 172.21.15.7:0/3119036921 wait complete. 2024-04-25T09:55:15.854 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:55:15.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.952+0000 7f7a54529640 1 Processor -- start 2024-04-25T09:55:15.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.953+0000 7f7a54529640 1 -- start start 2024-04-25T09:55:15.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.953+0000 7f7a54529640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7a4c0b6b90 0x7f7a4c0d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:15.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.953+0000 7f7a54529640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7a4c0d0780 0x7f7a4c0d27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:15.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.953+0000 7f7a54529640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a4c162040 con 0x7f7a4c15dc10 2024-04-25T09:55:15.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.953+0000 7f7a54529640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4c0d1d90 con 0x7f7a4c0d0780 2024-04-25T09:55:15.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.953+0000 7f7a54529640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4c0d0c30 con 0x7f7a4c0b6b90 2024-04-25T09:55:15.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.954+0000 7f7a52ac6640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7a4c0d0780 0x7f7a4c0d27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:15.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.954+0000 7f7a522c5640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7a4c15dc10 0x7f7a4c1615f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:59268/0 (socket says 172.21.15.7:59268) 2024-04-25T09:55:15.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.954+0000 7f7a522c5640 1 -- 172.21.15.7:0/3270109297 learned_addr learned my addr 172.21.15.7:0/3270109297 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:15.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.954+0000 7f7a51ac4640 1 --2- 172.21.15.7:0/3270109297 >> v2:172.21.15.55:3300/0 conn(0x7f7a4c0b6b90 0x7f7a4c0d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:15.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.954+0000 7f7a52ac6640 1 -- 172.21.15.7:0/3270109297 >> v2:172.21.15.55:3300/0 conn(0x7f7a4c0b6b90 msgr2=0x7f7a4c0d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:15.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.954+0000 7f7a52ac6640 1 --2- 172.21.15.7:0/3270109297 >> v2:172.21.15.55:3300/0 conn(0x7f7a4c0b6b90 0x7f7a4c0d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.954+0000 7f7a52ac6640 1 -- 172.21.15.7:0/3270109297 >> v1:172.21.15.7:6789/0 conn(0x7f7a4c15dc10 legacy=0x7f7a4c1615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:15.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.954+0000 7f7a52ac6640 1 -- 172.21.15.7:0/3270109297 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c162320 con 0x7f7a4c0d0780 2024-04-25T09:55:15.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.954+0000 7f7a512c3640 1 -- 172.21.15.7:0/3270109297 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4039242902 0 0) 0x7f7a4c162040 con 0x7f7a4c15dc10 2024-04-25T09:55:15.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.955+0000 7f7a52ac6640 1 --2- 172.21.15.7:0/3270109297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a4c0d0780 0x7f7a4c0d27e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0cfda0 tx=0x7f7a4402a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0319d8a71f87d85 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:15.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.955+0000 7f7a512c3640 1 -- 172.21.15.7:0/3270109297 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a44007740 con 0x7f7a4c0d0780 2024-04-25T09:55:15.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.955+0000 7f7a512c3640 1 -- 172.21.15.7:0/3270109297 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a440078e0 con 0x7f7a4c0d0780 2024-04-25T09:55:15.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.955+0000 7f7a512c3640 1 -- 172.21.15.7:0/3270109297 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a44007cb0 con 0x7f7a4c0d0780 2024-04-25T09:55:15.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.955+0000 7f7a54529640 1 -- 172.21.15.7:0/3270109297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a4c0d0780 msgr2=0x7f7a4c0d27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:15.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.955+0000 7f7a54529640 1 --2- 172.21.15.7:0/3270109297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a4c0d0780 0x7f7a4c0d27e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0cfda0 tx=0x7f7a4402a560 comp rx=0 tx=0).stop 2024-04-25T09:55:15.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.955+0000 7f7a54529640 1 -- 172.21.15.7:0/3270109297 shutdown_connections 2024-04-25T09:55:15.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.955+0000 7f7a54529640 1 --2- 172.21.15.7:0/3270109297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a4c0d0780 0x7f7a4c0d27e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.955+0000 7f7a54529640 1 --2- 172.21.15.7:0/3270109297 >> v2:172.21.15.55:3300/0 conn(0x7f7a4c0b6b90 0x7f7a4c0d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.955+0000 7f7a54529640 1 -- 172.21.15.7:0/3270109297 >> 172.21.15.7:0/3270109297 conn(0x7f7a4c072290 msgr2=0x7f7a4c0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:15.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.956+0000 7f7a54529640 1 -- 172.21.15.7:0/3270109297 shutdown_connections 2024-04-25T09:55:15.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.956+0000 7f7a54529640 1 -- 172.21.15.7:0/3270109297 wait complete. 2024-04-25T09:55:15.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.957+0000 7f7a54529640 1 Processor -- start 2024-04-25T09:55:15.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.957+0000 7f7a54529640 1 -- start start 2024-04-25T09:55:15.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.957+0000 7f7a54529640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a4c0b6b90 0x7f7a4c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:15.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.957+0000 7f7a54529640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7a4c0d0780 0x7f7a4c0b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:15.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.957+0000 7f7a54529640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a4c15dc10 0x7f7a4c0b5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:15.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.958+0000 7f7a54529640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c0ce3e0 con 0x7f7a4c0b6b90 2024-04-25T09:55:15.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.958+0000 7f7a54529640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c161d00 con 0x7f7a4c15dc10 2024-04-25T09:55:15.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.958+0000 7f7a54529640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c0ce560 con 0x7f7a4c0d0780 2024-04-25T09:55:15.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.958+0000 7f7a522c5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a4c0b6b90 0x7f7a4c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.958+0000 7f7a522c5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a4c0b6b90 0x7f7a4c0b4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38708/0 (socket says 172.21.15.7:38708) 2024-04-25T09:55:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.958+0000 7f7a522c5640 1 -- 172.21.15.7:0/3518821129 learned_addr learned my addr 172.21.15.7:0/3518821129 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.958+0000 7f7a522c5640 1 -- 172.21.15.7:0/3518821129 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7a4c0d0780 msgr2=0x7f7a4c0b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.958+0000 7f7a522c5640 1 --2- 172.21.15.7:0/3518821129 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7a4c0d0780 0x7f7a4c0b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.958+0000 7f7a522c5640 1 -- 172.21.15.7:0/3518821129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a4c15dc10 msgr2=0x7f7a4c0b5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.958+0000 7f7a52ac6640 1 --2- 172.21.15.7:0/3518821129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a4c15dc10 0x7f7a4c0b5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.958+0000 7f7a522c5640 1 --2- 172.21.15.7:0/3518821129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a4c15dc10 0x7f7a4c0b5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.958+0000 7f7a522c5640 1 -- 172.21.15.7:0/3518821129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c0b43d0 con 0x7f7a4c0b6b90 2024-04-25T09:55:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.958+0000 7f7a52ac6640 1 --2- 172.21.15.7:0/3518821129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a4c15dc10 0x7f7a4c0b5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.958+0000 7f7a522c5640 1 --2- 172.21.15.7:0/3518821129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a4c0b6b90 0x7f7a4c0b4eb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800c4d0 tx=0x7f7a4800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.958+0000 7f7a42ffd640 1 -- 172.21.15.7:0/3518821129 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a48018070 con 0x7f7a4c0b6b90 2024-04-25T09:55:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.958+0000 7f7a42ffd640 1 -- 172.21.15.7:0/3518821129 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a480074e0 con 0x7f7a4c0b6b90 2024-04-25T09:55:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.958+0000 7f7a42ffd640 1 -- 172.21.15.7:0/3518821129 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a48004a20 con 0x7f7a4c0b6b90 2024-04-25T09:55:15.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.958+0000 7f7a54529640 1 -- 172.21.15.7:0/3518821129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a4c0b5e90 con 0x7f7a4c0b6b90 2024-04-25T09:55:15.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.958+0000 7f7a54529640 1 -- 172.21.15.7:0/3518821129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a4c0b3690 con 0x7f7a4c0b6b90 2024-04-25T09:55:15.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.959+0000 7f7a54529640 1 -- 172.21.15.7:0/3518821129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a4c067420 con 0x7f7a4c0b6b90 2024-04-25T09:55:15.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.960+0000 7f7a42ffd640 1 -- 172.21.15.7:0/3518821129 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7a4801b070 con 0x7f7a4c0b6b90 2024-04-25T09:55:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.960+0000 7f7a42ffd640 1 --2- 172.21.15.7:0/3518821129 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7a3006b500 0x7f7a3006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.960+0000 7f7a42ffd640 1 -- 172.21.15.7:0/3518821129 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f7a48089a00 con 0x7f7a4c0b6b90 2024-04-25T09:55:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.960+0000 7f7a51ac4640 1 --2- 172.21.15.7:0/3518821129 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7a3006b500 0x7f7a3006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.961+0000 7f7a51ac4640 1 --2- 172.21.15.7:0/3518821129 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7a3006b500 0x7f7a3006d9c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c006e80 tx=0x7f7a3c006dd0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:15.965+0000 7f7a42ffd640 1 -- 172.21.15.7:0/3518821129 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7a4c067420 con 0x7f7a4c0b6b90 2024-04-25T09:55:16.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.156+0000 7f7a54529640 1 -- 172.21.15.7:0/3518821129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7a4c068fd0 con 0x7f7a4c0b6b90 2024-04-25T09:55:16.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.157+0000 7f7a42ffd640 1 -- 172.21.15.7:0/3518821129 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7a480583f0 con 0x7f7a4c0b6b90 2024-04-25T09:55:16.160 INFO:teuthology.orchestra.run.smithi007.stderr:listed 0 entries 2024-04-25T09:55:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.159+0000 7f7a54529640 1 -- 172.21.15.7:0/3518821129 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7a3006b500 msgr2=0x7f7a3006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.159+0000 7f7a54529640 1 --2- 172.21.15.7:0/3518821129 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7a3006b500 0x7f7a3006d9c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c006e80 tx=0x7f7a3c006dd0 comp rx=0 tx=0).stop 2024-04-25T09:55:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.159+0000 7f7a54529640 1 -- 172.21.15.7:0/3518821129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a4c0b6b90 msgr2=0x7f7a4c0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.159+0000 7f7a54529640 1 --2- 172.21.15.7:0/3518821129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a4c0b6b90 0x7f7a4c0b4eb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800c4d0 tx=0x7f7a4800c990 comp rx=0 tx=0).stop 2024-04-25T09:55:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.159+0000 7f7a54529640 1 -- 172.21.15.7:0/3518821129 shutdown_connections 2024-04-25T09:55:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.159+0000 7f7a54529640 1 --2- 172.21.15.7:0/3518821129 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7a3006b500 0x7f7a3006d9c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.159+0000 7f7a54529640 1 --2- 172.21.15.7:0/3518821129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a4c15dc10 0x7f7a4c0b5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.159+0000 7f7a54529640 1 --2- 172.21.15.7:0/3518821129 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7a4c0d0780 0x7f7a4c0b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.159+0000 7f7a54529640 1 --2- 172.21.15.7:0/3518821129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a4c0b6b90 0x7f7a4c0b4eb0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.159+0000 7f7a54529640 1 -- 172.21.15.7:0/3518821129 >> 172.21.15.7:0/3518821129 conn(0x7f7a4c072290 msgr2=0x7f7a4c0d2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:16.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.159+0000 7f7a54529640 1 -- 172.21.15.7:0/3518821129 shutdown_connections 2024-04-25T09:55:16.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.159+0000 7f7a54529640 1 -- 172.21.15.7:0/3518821129 wait complete. 2024-04-25T09:55:16.173 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-25T09:55:16.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:16.173 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-04-25T09:55:16.204 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T09:55:16.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:16.204 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-25T09:55:16.273 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:55:16.273 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:55:16.288 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:55:16.288 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:55:16.344 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:55:16.344 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:55:16.400 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:55:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.538+0000 7ff03dffe640 1 Processor -- start 2024-04-25T09:55:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.538+0000 7ff03dffe640 1 -- start start 2024-04-25T09:55:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.539+0000 7ff03dffe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff03815dd00 0x7ff0380b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.539+0000 7ff03dffe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff0380b6a40 0x7ff0380b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.539+0000 7ff03dffe640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff03806cd00 con 0x7ff03806bfb0 2024-04-25T09:55:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.539+0000 7ff03dffe640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff03815e0e0 con 0x7ff0380b6a40 2024-04-25T09:55:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.539+0000 7ff03dffe640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff03806cfe0 con 0x7ff03815dd00 2024-04-25T09:55:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.539+0000 7ff036ffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff0380b6a40 0x7ff0380b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.539+0000 7ff037fff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff03806bfb0 0x7ff03806c420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:59272/0 (socket says 172.21.15.7:59272) 2024-04-25T09:55:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.539+0000 7ff037fff640 1 -- 172.21.15.7:0/2050404722 learned_addr learned my addr 172.21.15.7:0/2050404722 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.539+0000 7ff0377fe640 1 --2- 172.21.15.7:0/2050404722 >> v2:172.21.15.55:3300/0 conn(0x7ff03815dd00 0x7ff0380b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.539+0000 7ff036ffd640 1 -- 172.21.15.7:0/2050404722 >> v2:172.21.15.55:3300/0 conn(0x7ff03815dd00 msgr2=0x7ff0380b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.539+0000 7ff036ffd640 1 --2- 172.21.15.7:0/2050404722 >> v2:172.21.15.55:3300/0 conn(0x7ff03815dd00 0x7ff0380b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.539+0000 7ff036ffd640 1 -- 172.21.15.7:0/2050404722 >> v1:172.21.15.7:6789/0 conn(0x7ff03806bfb0 legacy=0x7ff03806c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.539+0000 7ff036ffd640 1 -- 172.21.15.7:0/2050404722 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0380d1ca0 con 0x7ff0380b6a40 2024-04-25T09:55:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.540+0000 7ff036ffd640 1 --2- 172.21.15.7:0/2050404722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0380b6a40 0x7ff0380b5c90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff0380d4920 tx=0x7ff02c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e839b238a81d0a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:16.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.540+0000 7ff0367fc640 1 -- 172.21.15.7:0/2050404722 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c037070 con 0x7ff0380b6a40 2024-04-25T09:55:16.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.540+0000 7ff0367fc640 1 -- 172.21.15.7:0/2050404722 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02c032440 con 0x7ff0380b6a40 2024-04-25T09:55:16.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.540+0000 7ff0367fc640 1 -- 172.21.15.7:0/2050404722 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c032810 con 0x7ff0380b6a40 2024-04-25T09:55:16.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.540+0000 7ff03dffe640 1 -- 172.21.15.7:0/2050404722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0380b6a40 msgr2=0x7ff0380b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:16.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.540+0000 7ff03dffe640 1 --2- 172.21.15.7:0/2050404722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0380b6a40 0x7ff0380b5c90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff0380d4920 tx=0x7ff02c02a230 comp rx=0 tx=0).stop 2024-04-25T09:55:16.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.541+0000 7ff03dffe640 1 -- 172.21.15.7:0/2050404722 shutdown_connections 2024-04-25T09:55:16.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.541+0000 7ff03dffe640 1 --2- 172.21.15.7:0/2050404722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0380b6a40 0x7ff0380b5c90 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:16.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.541+0000 7ff03dffe640 1 --2- 172.21.15.7:0/2050404722 >> v2:172.21.15.55:3300/0 conn(0x7ff03815dd00 0x7ff0380b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:16.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.541+0000 7ff03dffe640 1 -- 172.21.15.7:0/2050404722 >> 172.21.15.7:0/2050404722 conn(0x7ff0380d07b0 msgr2=0x7ff0380d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:16.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.541+0000 7ff03dffe640 1 -- 172.21.15.7:0/2050404722 shutdown_connections 2024-04-25T09:55:16.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.541+0000 7ff03dffe640 1 -- 172.21.15.7:0/2050404722 wait complete. 2024-04-25T09:55:16.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.542+0000 7ff03dffe640 1 Processor -- start 2024-04-25T09:55:16.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.542+0000 7ff03dffe640 1 -- start start 2024-04-25T09:55:16.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.543+0000 7ff03dffe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff03806bfb0 0x7ff0381f7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:16.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.543+0000 7ff03dffe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0380b6a40 0x7ff03815ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:16.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.543+0000 7ff03dffe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff03815dd00 0x7ff038158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:16.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.543+0000 7ff03dffe640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0380d2780 con 0x7ff0380b6a40 2024-04-25T09:55:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.543+0000 7ff03dffe640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0380d2260 con 0x7ff03815dd00 2024-04-25T09:55:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.543+0000 7ff03dffe640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0380d2900 con 0x7ff03806bfb0 2024-04-25T09:55:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.543+0000 7ff036ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0380b6a40 0x7ff03815ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.543+0000 7ff036ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0380b6a40 0x7ff03815ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38732/0 (socket says 172.21.15.7:38732) 2024-04-25T09:55:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.543+0000 7ff036ffd640 1 -- 172.21.15.7:0/2712159549 learned_addr learned my addr 172.21.15.7:0/2712159549 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.543+0000 7ff036ffd640 1 -- 172.21.15.7:0/2712159549 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff03806bfb0 msgr2=0x7ff0381f7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.543+0000 7ff0377fe640 1 --2- 172.21.15.7:0/2712159549 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff03806bfb0 0x7ff0381f7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.543+0000 7ff037fff640 1 --2- 172.21.15.7:0/2712159549 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff03815dd00 0x7ff038158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.543+0000 7ff036ffd640 1 --2- 172.21.15.7:0/2712159549 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff03806bfb0 0x7ff0381f7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.543+0000 7ff036ffd640 1 -- 172.21.15.7:0/2712159549 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff03815dd00 msgr2=0x7ff038158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.543+0000 7ff036ffd640 1 --2- 172.21.15.7:0/2712159549 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff03815dd00 0x7ff038158dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.543+0000 7ff036ffd640 1 -- 172.21.15.7:0/2712159549 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0381604a0 con 0x7ff0380b6a40 2024-04-25T09:55:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.543+0000 7ff036ffd640 1 --2- 172.21.15.7:0/2712159549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0380b6a40 0x7ff03815ff60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff02c000c00 tx=0x7ff02c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.543+0000 7ff01ffff640 1 -- 172.21.15.7:0/2712159549 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c037040 con 0x7ff0380b6a40 2024-04-25T09:55:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.543+0000 7ff01ffff640 1 -- 172.21.15.7:0/2712159549 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02c042070 con 0x7ff0380b6a40 2024-04-25T09:55:16.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.543+0000 7ff03dffe640 1 -- 172.21.15.7:0/2712159549 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff038160b40 con 0x7ff0380b6a40 2024-04-25T09:55:16.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.543+0000 7ff01ffff640 1 -- 172.21.15.7:0/2712159549 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c030960 con 0x7ff0380b6a40 2024-04-25T09:55:16.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.544+0000 7ff03dffe640 1 -- 172.21.15.7:0/2712159549 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0381f73f0 con 0x7ff0380b6a40 2024-04-25T09:55:16.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.545+0000 7ff03dffe640 1 -- 172.21.15.7:0/2712159549 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff038068fd0 con 0x7ff0380b6a40 2024-04-25T09:55:16.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.545+0000 7ff01ffff640 1 -- 172.21.15.7:0/2712159549 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff02c030b00 con 0x7ff0380b6a40 2024-04-25T09:55:16.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.545+0000 7ff01ffff640 1 --2- 172.21.15.7:0/2712159549 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff02406b4d0 0x7ff02406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:16.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.545+0000 7ff01ffff640 1 -- 172.21.15.7:0/2712159549 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7ff02c0aaf50 con 0x7ff0380b6a40 2024-04-25T09:55:16.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.545+0000 7ff0377fe640 1 --2- 172.21.15.7:0/2712159549 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff02406b4d0 0x7ff02406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:16.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.546+0000 7ff0377fe640 1 --2- 172.21.15.7:0/2712159549 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff02406b4d0 0x7ff02406d990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff028009970 tx=0x7ff028008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:16.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.549+0000 7ff01ffff640 1 -- 172.21.15.7:0/2712159549 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff02c045360 con 0x7ff0380b6a40 2024-04-25T09:55:16.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.731+0000 7ff03dffe640 1 -- 172.21.15.7:0/2712159549 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0380b5170 con 0x7ff0380b6a40 2024-04-25T09:55:16.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.732+0000 7ff01ffff640 1 -- 172.21.15.7:0/2712159549 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18807 (secure 0 0 0) 0x7ff02c079af0 con 0x7ff0380b6a40 2024-04-25T09:55:16.735 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:16.735 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:55:09.591504+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:54:26.011833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:54:26.535536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:54:30.264996+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:55:16.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.734+0000 7ff03dffe640 1 -- 172.21.15.7:0/2712159549 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff02406b4d0 msgr2=0x7ff02406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:16.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.734+0000 7ff03dffe640 1 --2- 172.21.15.7:0/2712159549 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff02406b4d0 0x7ff02406d990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff028009970 tx=0x7ff028008040 comp rx=0 tx=0).stop 2024-04-25T09:55:16.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.734+0000 7ff03dffe640 1 -- 172.21.15.7:0/2712159549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0380b6a40 msgr2=0x7ff03815ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:16.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.734+0000 7ff03dffe640 1 --2- 172.21.15.7:0/2712159549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0380b6a40 0x7ff03815ff60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff02c000c00 tx=0x7ff02c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:55:16.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.734+0000 7ff03dffe640 1 -- 172.21.15.7:0/2712159549 shutdown_connections 2024-04-25T09:55:16.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.734+0000 7ff03dffe640 1 --2- 172.21.15.7:0/2712159549 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff02406b4d0 0x7ff02406d990 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:16.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.734+0000 7ff03dffe640 1 --2- 172.21.15.7:0/2712159549 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff03815dd00 0x7ff038158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:16.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.734+0000 7ff03dffe640 1 --2- 172.21.15.7:0/2712159549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0380b6a40 0x7ff03815ff60 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:16.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.734+0000 7ff03dffe640 1 --2- 172.21.15.7:0/2712159549 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff03806bfb0 0x7ff0381f7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:16.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.734+0000 7ff03dffe640 1 -- 172.21.15.7:0/2712159549 >> 172.21.15.7:0/2712159549 conn(0x7ff0380d07b0 msgr2=0x7ff0380b9050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:16.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.734+0000 7ff03dffe640 1 -- 172.21.15.7:0/2712159549 shutdown_connections 2024-04-25T09:55:16.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.734+0000 7ff03dffe640 1 -- 172.21.15.7:0/2712159549 wait complete. 2024-04-25T09:55:16.748 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:54:26.011833+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:54:26.535536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:54:30.264996+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:55:16.748 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:55:16.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.848+0000 7faae4789640 1 Processor -- start 2024-04-25T09:55:16.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.848+0000 7faae4789640 1 -- start start 2024-04-25T09:55:16.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.849+0000 7faae4789640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faadc0ce830 0x7faadc15eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:16.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.849+0000 7faae4789640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faadc0ced10 con 0x7faadc15f1c0 2024-04-25T09:55:16.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.849+0000 7faae4789640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faadc0d1b40 con 0x7faadc0d3760 2024-04-25T09:55:16.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.849+0000 7faae4789640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faadc0ce380 con 0x7faadc0ce830 2024-04-25T09:55:16.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.849+0000 7faae1d24640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7faadc15f1c0 0x7faadc0b2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:59288/0 (socket says 172.21.15.7:59288) 2024-04-25T09:55:16.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.850+0000 7faae1d24640 1 -- 172.21.15.7:0/2069601184 learned_addr learned my addr 172.21.15.7:0/2069601184 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:16.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.850+0000 7faae2d26640 1 --2- 172.21.15.7:0/2069601184 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faadc0ce830 0x7faadc15eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:16.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.850+0000 7faae1523640 1 -- 172.21.15.7:0/2069601184 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 56913665 0 0) 0x7faadc0ced10 con 0x7faadc15f1c0 2024-04-25T09:55:16.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.850+0000 7faae1523640 1 -- 172.21.15.7:0/2069601184 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faac4003520 con 0x7faadc15f1c0 2024-04-25T09:55:16.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.850+0000 7faae1523640 1 -- 172.21.15.7:0/2069601184 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2543607961 0 0) 0x7faadc0d1b40 con 0x7faadc0d3760 2024-04-25T09:55:16.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.850+0000 7faae1523640 1 -- 172.21.15.7:0/2069601184 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faadc0ced10 con 0x7faadc0d3760 2024-04-25T09:55:16.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.850+0000 7faae2d26640 1 -- 172.21.15.7:0/2069601184 >> v1:172.21.15.55:6789/0 conn(0x7faadc0d3760 legacy=0x7faadc0d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:16.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.850+0000 7faae1523640 1 -- 172.21.15.7:0/2069601184 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1625398815 0 0) 0x7faac4003520 con 0x7faadc15f1c0 2024-04-25T09:55:16.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.850+0000 7faae2d26640 1 -- 172.21.15.7:0/2069601184 >> v1:172.21.15.7:6789/0 conn(0x7faadc15f1c0 legacy=0x7faadc0b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:16.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.850+0000 7faae2d26640 1 -- 172.21.15.7:0/2069601184 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faadc0d1e20 con 0x7faadc0ce830 2024-04-25T09:55:16.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.851+0000 7faae2d26640 1 --2- 172.21.15.7:0/2069601184 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faadc0ce830 0x7faadc15eac0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faacc009dc0 tx=0x7faacc02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1717d8dae0dd19a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:16.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.851+0000 7faae1523640 1 -- 172.21.15.7:0/2069601184 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad0001670 con 0x7faadc0ce830 2024-04-25T09:55:16.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.851+0000 7faae1523640 1 -- 172.21.15.7:0/2069601184 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faacc007540 con 0x7faadc0ce830 2024-04-25T09:55:16.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.851+0000 7faae1523640 1 -- 172.21.15.7:0/2069601184 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc0078f0 con 0x7faadc0ce830 2024-04-25T09:55:16.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.852+0000 7faae4789640 1 -- 172.21.15.7:0/2069601184 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faadc0ce830 msgr2=0x7faadc15eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:16.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.852+0000 7faae4789640 1 --2- 172.21.15.7:0/2069601184 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faadc0ce830 0x7faadc15eac0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faacc009dc0 tx=0x7faacc02a660 comp rx=0 tx=0).stop 2024-04-25T09:55:16.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.852+0000 7faae4789640 1 -- 172.21.15.7:0/2069601184 shutdown_connections 2024-04-25T09:55:16.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.852+0000 7faae4789640 1 --2- 172.21.15.7:0/2069601184 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faadc0ce830 0x7faadc15eac0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:16.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.852+0000 7faae4789640 1 -- 172.21.15.7:0/2069601184 >> 172.21.15.7:0/2069601184 conn(0x7faadc072680 msgr2=0x7faadc072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:16.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.852+0000 7faae4789640 1 -- 172.21.15.7:0/2069601184 shutdown_connections 2024-04-25T09:55:16.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.852+0000 7faae4789640 1 -- 172.21.15.7:0/2069601184 wait complete. 2024-04-25T09:55:16.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.853+0000 7faae4789640 1 Processor -- start 2024-04-25T09:55:16.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.853+0000 7faae4789640 1 -- start start 2024-04-25T09:55:16.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.854+0000 7faae4789640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faadc0ce830 0x7faadc14ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:16.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.854+0000 7faae4789640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faadc0d3760 0x7faadc0cae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:16.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.854+0000 7faae4789640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faadc15f1c0 0x7faadc0b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:16.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.854+0000 7faae4789640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc0d2190 con 0x7faadc15f1c0 2024-04-25T09:55:16.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.854+0000 7faae4789640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc15f000 con 0x7faadc0d3760 2024-04-25T09:55:16.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.854+0000 7faae4789640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faadc0b2950 con 0x7faadc0ce830 2024-04-25T09:55:16.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.854+0000 7faae2d26640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faadc15f1c0 0x7faadc0b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:16.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.854+0000 7faae2d26640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faadc15f1c0 0x7faadc0b4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38734/0 (socket says 172.21.15.7:38734) 2024-04-25T09:55:16.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.854+0000 7faae2d26640 1 -- 172.21.15.7:0/1923048046 learned_addr learned my addr 172.21.15.7:0/1923048046 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:16.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.854+0000 7faae2525640 1 --2- 172.21.15.7:0/1923048046 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faadc0ce830 0x7faadc14ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:16.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.854+0000 7faae1d24640 1 --2- 172.21.15.7:0/1923048046 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faadc0d3760 0x7faadc0cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:16.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.854+0000 7faae2d26640 1 -- 172.21.15.7:0/1923048046 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faadc0ce830 msgr2=0x7faadc14ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:16.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.854+0000 7faae2d26640 1 --2- 172.21.15.7:0/1923048046 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faadc0ce830 0x7faadc14ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:16.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.854+0000 7faae2d26640 1 -- 172.21.15.7:0/1923048046 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faadc0d3760 msgr2=0x7faadc0cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:16.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.854+0000 7faae2d26640 1 --2- 172.21.15.7:0/1923048046 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faadc0d3760 0x7faadc0cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:16.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.854+0000 7faae2d26640 1 -- 172.21.15.7:0/1923048046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faadc0b2d50 con 0x7faadc15f1c0 2024-04-25T09:55:16.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.854+0000 7faae2d26640 1 --2- 172.21.15.7:0/1923048046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faadc15f1c0 0x7faadc0b4f40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7faacc009ee0 tx=0x7faacc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:16.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.855+0000 7faadaffd640 1 -- 172.21.15.7:0/1923048046 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc040070 con 0x7faadc15f1c0 2024-04-25T09:55:16.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.855+0000 7faadaffd640 1 -- 172.21.15.7:0/1923048046 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faacc031c40 con 0x7faadc15f1c0 2024-04-25T09:55:16.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.855+0000 7faae4789640 1 -- 172.21.15.7:0/1923048046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faadc0b2ff0 con 0x7faadc15f1c0 2024-04-25T09:55:16.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.855+0000 7faadaffd640 1 -- 172.21.15.7:0/1923048046 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc009450 con 0x7faadc15f1c0 2024-04-25T09:55:16.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.855+0000 7faae4789640 1 -- 172.21.15.7:0/1923048046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faadc0b3890 con 0x7faadc15f1c0 2024-04-25T09:55:16.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.856+0000 7faae4789640 1 -- 172.21.15.7:0/1923048046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faadc0b33e0 con 0x7faadc15f1c0 2024-04-25T09:55:16.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.856+0000 7faadaffd640 1 -- 172.21.15.7:0/1923048046 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faacc039040 con 0x7faadc15f1c0 2024-04-25T09:55:16.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.857+0000 7faadaffd640 1 --2- 172.21.15.7:0/1923048046 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faac806b500 0x7faac806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:16.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.857+0000 7faae2525640 1 --2- 172.21.15.7:0/1923048046 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faac806b500 0x7faac806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:16.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.857+0000 7faadaffd640 1 -- 172.21.15.7:0/1923048046 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7faacc0ab8f0 con 0x7faadc15f1c0 2024-04-25T09:55:16.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.857+0000 7faae2525640 1 --2- 172.21.15.7:0/1923048046 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faac806b500 0x7faac806d9c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7faad40011e0 tx=0x7faad4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:16.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:16.861+0000 7faadaffd640 1 -- 172.21.15.7:0/1923048046 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faacc030e20 con 0x7faadc15f1c0 2024-04-25T09:55:17.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.042+0000 7faae4789640 1 -- 172.21.15.7:0/1923048046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faadc0b31c0 con 0x7faadc15f1c0 2024-04-25T09:55:17.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.043+0000 7faadaffd640 1 -- 172.21.15.7:0/1923048046 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7faacc07a380 con 0x7faadc15f1c0 2024-04-25T09:55:17.046 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T09:55:17.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.044+0000 7faae4789640 1 -- 172.21.15.7:0/1923048046 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faac806b500 msgr2=0x7faac806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:17.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.044+0000 7faae4789640 1 --2- 172.21.15.7:0/1923048046 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faac806b500 0x7faac806d9c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7faad40011e0 tx=0x7faad4009040 comp rx=0 tx=0).stop 2024-04-25T09:55:17.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.044+0000 7faae4789640 1 -- 172.21.15.7:0/1923048046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faadc15f1c0 msgr2=0x7faadc0b4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:17.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.044+0000 7faae4789640 1 --2- 172.21.15.7:0/1923048046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faadc15f1c0 0x7faadc0b4f40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7faacc009ee0 tx=0x7faacc004a40 comp rx=0 tx=0).stop 2024-04-25T09:55:17.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.044+0000 7faae4789640 1 -- 172.21.15.7:0/1923048046 shutdown_connections 2024-04-25T09:55:17.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.044+0000 7faae4789640 1 --2- 172.21.15.7:0/1923048046 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faac806b500 0x7faac806d9c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.044+0000 7faae4789640 1 --2- 172.21.15.7:0/1923048046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faadc15f1c0 0x7faadc0b4f40 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.044+0000 7faae4789640 1 --2- 172.21.15.7:0/1923048046 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faadc0d3760 0x7faadc0cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.044+0000 7faae4789640 1 --2- 172.21.15.7:0/1923048046 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faadc0ce830 0x7faadc14ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.044+0000 7faae4789640 1 -- 172.21.15.7:0/1923048046 >> 172.21.15.7:0/1923048046 conn(0x7faadc072680 msgr2=0x7faadc072a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:17.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.045+0000 7faae4789640 1 -- 172.21.15.7:0/1923048046 shutdown_connections 2024-04-25T09:55:17.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.045+0000 7faae4789640 1 -- 172.21.15.7:0/1923048046 wait complete. 2024-04-25T09:55:17.058 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:55:17.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.159+0000 7f005582a640 1 Processor -- start 2024-04-25T09:55:17.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.160+0000 7f005582a640 1 -- start start 2024-04-25T09:55:17.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.160+0000 7f005582a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f005006e950 0x7f00500b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:17.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.160+0000 7f005582a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f00500ce610 0x7f00500ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:17.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.160+0000 7f005582a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00500b2ee0 con 0x7f0050143fb0 2024-04-25T09:55:17.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.160+0000 7f005582a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00500b3150 con 0x7f005006e950 2024-04-25T09:55:17.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.160+0000 7f005582a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00500b3430 con 0x7f00500ce610 2024-04-25T09:55:17.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.161+0000 7f004e7fc640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f005006e950 0x7f00500b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:17.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.161+0000 7f004effd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0050143fb0 0x7f005006e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:59290/0 (socket says 172.21.15.7:59290) 2024-04-25T09:55:17.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.161+0000 7f004effd640 1 -- 172.21.15.7:0/1776063177 learned_addr learned my addr 172.21.15.7:0/1776063177 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:17.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.161+0000 7f004f7fe640 1 --2- 172.21.15.7:0/1776063177 >> v2:172.21.15.55:3300/0 conn(0x7f00500ce610 0x7f00500ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:17.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.161+0000 7f004e7fc640 1 -- 172.21.15.7:0/1776063177 >> v2:172.21.15.55:3300/0 conn(0x7f00500ce610 msgr2=0x7f00500ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:17.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.161+0000 7f004e7fc640 1 --2- 172.21.15.7:0/1776063177 >> v2:172.21.15.55:3300/0 conn(0x7f00500ce610 0x7f00500ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.161+0000 7f004e7fc640 1 -- 172.21.15.7:0/1776063177 >> v1:172.21.15.7:6789/0 conn(0x7f0050143fb0 legacy=0x7f005006e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:17.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.161+0000 7f004e7fc640 1 -- 172.21.15.7:0/1776063177 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00500b3710 con 0x7f005006e950 2024-04-25T09:55:17.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.161+0000 7f004dffb640 1 -- 172.21.15.7:0/1776063177 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2896407431 0 0) 0x7f00500b2ee0 con 0x7f0050143fb0 2024-04-25T09:55:17.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.162+0000 7f004e7fc640 1 --2- 172.21.15.7:0/1776063177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f005006e950 0x7f00500b3c30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f00500cd8e0 tx=0x7f004402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93092dd5331da0ef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:17.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.162+0000 7f004dffb640 1 -- 172.21.15.7:0/1776063177 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0044037070 con 0x7f005006e950 2024-04-25T09:55:17.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.162+0000 7f004dffb640 1 -- 172.21.15.7:0/1776063177 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0044032440 con 0x7f005006e950 2024-04-25T09:55:17.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.162+0000 7f004dffb640 1 -- 172.21.15.7:0/1776063177 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004402ae60 con 0x7f005006e950 2024-04-25T09:55:17.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.162+0000 7f005582a640 1 -- 172.21.15.7:0/1776063177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f005006e950 msgr2=0x7f00500b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:17.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.162+0000 7f005582a640 1 --2- 172.21.15.7:0/1776063177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f005006e950 0x7f00500b3c30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f00500cd8e0 tx=0x7f004402a110 comp rx=0 tx=0).stop 2024-04-25T09:55:17.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.162+0000 7f005582a640 1 -- 172.21.15.7:0/1776063177 shutdown_connections 2024-04-25T09:55:17.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.162+0000 7f005582a640 1 --2- 172.21.15.7:0/1776063177 >> v2:172.21.15.55:3300/0 conn(0x7f00500ce610 0x7f00500ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.162+0000 7f005582a640 1 --2- 172.21.15.7:0/1776063177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f005006e950 0x7f00500b3c30 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.162+0000 7f005582a640 1 -- 172.21.15.7:0/1776063177 >> 172.21.15.7:0/1776063177 conn(0x7f005006ab60 msgr2=0x7f005006af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:17.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.162+0000 7f005582a640 1 -- 172.21.15.7:0/1776063177 shutdown_connections 2024-04-25T09:55:17.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.162+0000 7f005582a640 1 -- 172.21.15.7:0/1776063177 wait complete. 2024-04-25T09:55:17.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.163+0000 7f005582a640 1 Processor -- start 2024-04-25T09:55:17.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.164+0000 7f005582a640 1 -- start start 2024-04-25T09:55:17.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.164+0000 7f005582a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f005006e950 0x7f00500a8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:17.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.164+0000 7f005582a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00500ce610 0x7f005015d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:17.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.164+0000 7f005582a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0050143fb0 0x7f00501e5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:17.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.164+0000 7f005582a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00500cf2f0 con 0x7f00500ce610 2024-04-25T09:55:17.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.164+0000 7f005582a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0050144390 con 0x7f0050143fb0 2024-04-25T09:55:17.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.164+0000 7f005582a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005015ac70 con 0x7f005006e950 2024-04-25T09:55:17.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.164+0000 7f004e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00500ce610 0x7f005015d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:17.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.165+0000 7f004e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00500ce610 0x7f005015d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38744/0 (socket says 172.21.15.7:38744) 2024-04-25T09:55:17.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.165+0000 7f004e7fc640 1 -- 172.21.15.7:0/178600001 learned_addr learned my addr 172.21.15.7:0/178600001 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:17.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.165+0000 7f004effd640 1 --2- 172.21.15.7:0/178600001 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f005006e950 0x7f00500a8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:17.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.165+0000 7f004e7fc640 1 -- 172.21.15.7:0/178600001 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f005006e950 msgr2=0x7f00500a8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:17.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.165+0000 7f004e7fc640 1 --2- 172.21.15.7:0/178600001 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f005006e950 0x7f00500a8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.165+0000 7f004e7fc640 1 -- 172.21.15.7:0/178600001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0050143fb0 msgr2=0x7f00501e5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:17.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.165+0000 7f004e7fc640 1 --2- 172.21.15.7:0/178600001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0050143fb0 0x7f00501e5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.165+0000 7f004e7fc640 1 -- 172.21.15.7:0/178600001 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00500a8450 con 0x7f00500ce610 2024-04-25T09:55:17.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.165+0000 7f004e7fc640 1 --2- 172.21.15.7:0/178600001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00500ce610 0x7f005015d280 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0044009890 tx=0x7f00440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:17.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.165+0000 7f0037fff640 1 -- 172.21.15.7:0/178600001 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0044037040 con 0x7f00500ce610 2024-04-25T09:55:17.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.165+0000 7f0037fff640 1 -- 172.21.15.7:0/178600001 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0044042070 con 0x7f00500ce610 2024-04-25T09:55:17.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.165+0000 7f005582a640 1 -- 172.21.15.7:0/178600001 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00501e6630 con 0x7f00500ce610 2024-04-25T09:55:17.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.165+0000 7f0037fff640 1 -- 172.21.15.7:0/178600001 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0044030a50 con 0x7f00500ce610 2024-04-25T09:55:17.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.165+0000 7f005582a640 1 -- 172.21.15.7:0/178600001 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00500a86f0 con 0x7f00500ce610 2024-04-25T09:55:17.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.166+0000 7f005582a640 1 -- 172.21.15.7:0/178600001 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0050068f60 con 0x7f00500ce610 2024-04-25T09:55:17.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.167+0000 7f0037fff640 1 -- 172.21.15.7:0/178600001 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0044030bf0 con 0x7f00500ce610 2024-04-25T09:55:17.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.167+0000 7f0037fff640 1 --2- 172.21.15.7:0/178600001 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f003c06b4d0 0x7f003c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:17.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.167+0000 7f0037fff640 1 -- 172.21.15.7:0/178600001 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f00440ab080 con 0x7f00500ce610 2024-04-25T09:55:17.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.167+0000 7f004effd640 1 --2- 172.21.15.7:0/178600001 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f003c06b4d0 0x7f003c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:17.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.168+0000 7f004effd640 1 --2- 172.21.15.7:0/178600001 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f003c06b4d0 0x7f003c06d990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0040000f60 tx=0x7f0040009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:17.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.171+0000 7f0037fff640 1 -- 172.21.15.7:0/178600001 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0044045360 con 0x7f00500ce610 2024-04-25T09:55:17.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.351+0000 7f005582a640 1 -- 172.21.15.7:0/178600001 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f005006c1a0 con 0x7f00500ce610 2024-04-25T09:55:17.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.351+0000 7f0037fff640 1 -- 172.21.15.7:0/178600001 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0044079b90 con 0x7f00500ce610 2024-04-25T09:55:17.354 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:55:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.353+0000 7f005582a640 1 -- 172.21.15.7:0/178600001 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f003c06b4d0 msgr2=0x7f003c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.353+0000 7f005582a640 1 --2- 172.21.15.7:0/178600001 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f003c06b4d0 0x7f003c06d990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0040000f60 tx=0x7f0040009040 comp rx=0 tx=0).stop 2024-04-25T09:55:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.353+0000 7f005582a640 1 -- 172.21.15.7:0/178600001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00500ce610 msgr2=0x7f005015d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.353+0000 7f005582a640 1 --2- 172.21.15.7:0/178600001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00500ce610 0x7f005015d280 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0044009890 tx=0x7f00440046c0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.353+0000 7f005582a640 1 -- 172.21.15.7:0/178600001 shutdown_connections 2024-04-25T09:55:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.353+0000 7f005582a640 1 --2- 172.21.15.7:0/178600001 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f003c06b4d0 0x7f003c06d990 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.353+0000 7f005582a640 1 --2- 172.21.15.7:0/178600001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0050143fb0 0x7f00501e5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.353+0000 7f005582a640 1 --2- 172.21.15.7:0/178600001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00500ce610 0x7f005015d280 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.353+0000 7f005582a640 1 --2- 172.21.15.7:0/178600001 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f005006e950 0x7f00500a8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.353+0000 7f005582a640 1 -- 172.21.15.7:0/178600001 >> 172.21.15.7:0/178600001 conn(0x7f005006ab60 msgr2=0x7f00500b19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:17.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.353+0000 7f005582a640 1 -- 172.21.15.7:0/178600001 shutdown_connections 2024-04-25T09:55:17.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.353+0000 7f005582a640 1 -- 172.21.15.7:0/178600001 wait complete. 2024-04-25T09:55:17.367 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:55:17.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.467+0000 7f5a2f5be640 1 Processor -- start 2024-04-25T09:55:17.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.467+0000 7f5a2f5be640 1 -- start start 2024-04-25T09:55:17.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.468+0000 7f5a2f5be640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5a2806b270 0x7f5a280cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:17.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.468+0000 7f5a2f5be640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5a280cc760 0x7f5a280cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:17.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.468+0000 7f5a2f5be640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a280caf00 con 0x7f5a2815dc60 2024-04-25T09:55:17.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.468+0000 7f5a2f5be640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a280cb1e0 con 0x7f5a2806b270 2024-04-25T09:55:17.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.468+0000 7f5a2f5be640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a280cb4c0 con 0x7f5a280cc760 2024-04-25T09:55:17.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.468+0000 7f5a2cb59640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5a2806b270 0x7f5a280cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:17.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.468+0000 7f5a2d35a640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5a2815dc60 0x7f5a2806ab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:59304/0 (socket says 172.21.15.7:59304) 2024-04-25T09:55:17.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.468+0000 7f5a2d35a640 1 -- 172.21.15.7:0/3510589595 learned_addr learned my addr 172.21.15.7:0/3510589595 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:17.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.468+0000 7f5a2cb59640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5a2806b270 0x7f5a280cbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38758/0 (socket says 172.21.15.7:38758) 2024-04-25T09:55:17.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.468+0000 7f5a2db5b640 1 --2- 172.21.15.7:0/3510589595 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5a280cc760 0x7f5a280cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:17.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.469+0000 7f5a2cb59640 1 -- 172.21.15.7:0/3510589595 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5a280cc760 msgr2=0x7f5a280cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:17.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.469+0000 7f5a2cb59640 1 --2- 172.21.15.7:0/3510589595 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5a280cc760 0x7f5a280cf8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.469+0000 7f5a2cb59640 1 -- 172.21.15.7:0/3510589595 >> v1:172.21.15.7:6789/0 conn(0x7f5a2815dc60 legacy=0x7f5a2806ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:17.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.469+0000 7f5a27fff640 1 -- 172.21.15.7:0/3510589595 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4253597856 0 0) 0x7f5a280caf00 con 0x7f5a2815dc60 2024-04-25T09:55:17.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.469+0000 7f5a2cb59640 1 -- 172.21.15.7:0/3510589595 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a280cb7a0 con 0x7f5a2806b270 2024-04-25T09:55:17.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.469+0000 7f5a2cb59640 1 --2- 172.21.15.7:0/3510589595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a2806b270 0x7f5a280cbfa0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c0097a0 tx=0x7f5a1c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a99491b80ba8e29 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:17.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.470+0000 7f5a27fff640 1 -- 172.21.15.7:0/3510589595 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c037070 con 0x7f5a2806b270 2024-04-25T09:55:17.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.470+0000 7f5a27fff640 1 -- 172.21.15.7:0/3510589595 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1c032440 con 0x7f5a2806b270 2024-04-25T09:55:17.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.470+0000 7f5a27fff640 1 -- 172.21.15.7:0/3510589595 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c032810 con 0x7f5a2806b270 2024-04-25T09:55:17.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.470+0000 7f5a2f5be640 1 -- 172.21.15.7:0/3510589595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a2806b270 msgr2=0x7f5a280cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:17.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.470+0000 7f5a2f5be640 1 --2- 172.21.15.7:0/3510589595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a2806b270 0x7f5a280cbfa0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c0097a0 tx=0x7f5a1c02a180 comp rx=0 tx=0).stop 2024-04-25T09:55:17.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.470+0000 7f5a2f5be640 1 -- 172.21.15.7:0/3510589595 shutdown_connections 2024-04-25T09:55:17.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.470+0000 7f5a2f5be640 1 --2- 172.21.15.7:0/3510589595 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5a280cc760 0x7f5a280cf8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.470+0000 7f5a2f5be640 1 --2- 172.21.15.7:0/3510589595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a2806b270 0x7f5a280cbfa0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.470+0000 7f5a2f5be640 1 -- 172.21.15.7:0/3510589595 >> 172.21.15.7:0/3510589595 conn(0x7f5a280725e0 msgr2=0x7f5a280999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:17.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.470+0000 7f5a2f5be640 1 -- 172.21.15.7:0/3510589595 shutdown_connections 2024-04-25T09:55:17.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.470+0000 7f5a2f5be640 1 -- 172.21.15.7:0/3510589595 wait complete. 2024-04-25T09:55:17.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.471+0000 7f5a2f5be640 1 Processor -- start 2024-04-25T09:55:17.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.471+0000 7f5a2f5be640 1 -- start start 2024-04-25T09:55:17.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.472+0000 7f5a2f5be640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a2806b270 0x7f5a28152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:17.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.472+0000 7f5a2f5be640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5a280cc760 0x7f5a2815b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:17.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.472+0000 7f5a2f5be640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a2815dc60 0x7f5a2815be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:17.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.472+0000 7f5a2f5be640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a280ce150 con 0x7f5a2815dc60 2024-04-25T09:55:17.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.472+0000 7f5a2f5be640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a280cabd0 con 0x7f5a2806b270 2024-04-25T09:55:17.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.472+0000 7f5a2f5be640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a280ce2d0 con 0x7f5a280cc760 2024-04-25T09:55:17.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.472+0000 7f5a2db5b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a2815dc60 0x7f5a2815be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:17.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.472+0000 7f5a2db5b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a2815dc60 0x7f5a2815be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38772/0 (socket says 172.21.15.7:38772) 2024-04-25T09:55:17.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.472+0000 7f5a2db5b640 1 -- 172.21.15.7:0/2103811628 learned_addr learned my addr 172.21.15.7:0/2103811628 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:17.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.472+0000 7f5a2cb59640 1 --2- 172.21.15.7:0/2103811628 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5a280cc760 0x7f5a2815b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:17.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.472+0000 7f5a2d35a640 1 --2- 172.21.15.7:0/2103811628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a2806b270 0x7f5a28152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:17.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.473+0000 7f5a2db5b640 1 -- 172.21.15.7:0/2103811628 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5a280cc760 msgr2=0x7f5a2815b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:17.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.473+0000 7f5a2db5b640 1 --2- 172.21.15.7:0/2103811628 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5a280cc760 0x7f5a2815b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.473+0000 7f5a2db5b640 1 -- 172.21.15.7:0/2103811628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a2806b270 msgr2=0x7f5a28152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:17.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.473+0000 7f5a2db5b640 1 --2- 172.21.15.7:0/2103811628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a2806b270 0x7f5a28152d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.473+0000 7f5a2db5b640 1 -- 172.21.15.7:0/2103811628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a280b4180 con 0x7f5a2815dc60 2024-04-25T09:55:17.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.473+0000 7f5a2db5b640 1 --2- 172.21.15.7:0/2103811628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a2815dc60 0x7f5a2815be70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5a18009dd0 tx=0x7f5a1800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:17.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.473+0000 7f5a25ffb640 1 -- 172.21.15.7:0/2103811628 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a18018020 con 0x7f5a2815dc60 2024-04-25T09:55:17.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.473+0000 7f5a25ffb640 1 -- 172.21.15.7:0/2103811628 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a18014480 con 0x7f5a2815dc60 2024-04-25T09:55:17.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.473+0000 7f5a25ffb640 1 -- 172.21.15.7:0/2103811628 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a18014870 con 0x7f5a2815dc60 2024-04-25T09:55:17.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.473+0000 7f5a2f5be640 1 -- 172.21.15.7:0/2103811628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a280b4460 con 0x7f5a2815dc60 2024-04-25T09:55:17.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.473+0000 7f5a2f5be640 1 -- 172.21.15.7:0/2103811628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a280b4a20 con 0x7f5a2815dc60 2024-04-25T09:55:17.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.474+0000 7f5a2f5be640 1 -- 172.21.15.7:0/2103811628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a28068f60 con 0x7f5a2815dc60 2024-04-25T09:55:17.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.475+0000 7f5a25ffb640 1 -- 172.21.15.7:0/2103811628 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5a18005d10 con 0x7f5a2815dc60 2024-04-25T09:55:17.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.475+0000 7f5a25ffb640 1 --2- 172.21.15.7:0/2103811628 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5a1406b4d0 0x7f5a1406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:17.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.475+0000 7f5a25ffb640 1 -- 172.21.15.7:0/2103811628 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f5a1808b060 con 0x7f5a2815dc60 2024-04-25T09:55:17.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.475+0000 7f5a2d35a640 1 --2- 172.21.15.7:0/2103811628 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5a1406b4d0 0x7f5a1406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:17.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.476+0000 7f5a2d35a640 1 --2- 172.21.15.7:0/2103811628 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5a1406b4d0 0x7f5a1406d990 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5a20000f60 tx=0x7f5a20007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:17.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.479+0000 7f5a25ffb640 1 -- 172.21.15.7:0/2103811628 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5a18022070 con 0x7f5a2815dc60 2024-04-25T09:55:17.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.661+0000 7f5a2f5be640 1 -- 172.21.15.7:0/2103811628 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5a280b6500 con 0x7f5a2815dc60 2024-04-25T09:55:17.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.661+0000 7f5a25ffb640 1 -- 172.21.15.7:0/2103811628 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5a18010040 con 0x7f5a2815dc60 2024-04-25T09:55:17.664 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T09:55:17.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.664+0000 7f5a2f5be640 1 -- 172.21.15.7:0/2103811628 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5a1406b4d0 msgr2=0x7f5a1406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:17.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.664+0000 7f5a2f5be640 1 --2- 172.21.15.7:0/2103811628 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5a1406b4d0 0x7f5a1406d990 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5a20000f60 tx=0x7f5a20007d50 comp rx=0 tx=0).stop 2024-04-25T09:55:17.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.664+0000 7f5a2f5be640 1 -- 172.21.15.7:0/2103811628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a2815dc60 msgr2=0x7f5a2815be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:17.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.664+0000 7f5a2f5be640 1 --2- 172.21.15.7:0/2103811628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a2815dc60 0x7f5a2815be70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5a18009dd0 tx=0x7f5a1800c490 comp rx=0 tx=0).stop 2024-04-25T09:55:17.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.664+0000 7f5a2f5be640 1 -- 172.21.15.7:0/2103811628 shutdown_connections 2024-04-25T09:55:17.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.664+0000 7f5a2f5be640 1 --2- 172.21.15.7:0/2103811628 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5a1406b4d0 0x7f5a1406d990 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.664+0000 7f5a2f5be640 1 --2- 172.21.15.7:0/2103811628 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a2815dc60 0x7f5a2815be70 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.664+0000 7f5a2f5be640 1 --2- 172.21.15.7:0/2103811628 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5a280cc760 0x7f5a2815b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.664+0000 7f5a2f5be640 1 --2- 172.21.15.7:0/2103811628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a2806b270 0x7f5a28152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.664+0000 7f5a2f5be640 1 -- 172.21.15.7:0/2103811628 >> 172.21.15.7:0/2103811628 conn(0x7f5a280725e0 msgr2=0x7f5a2806ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:17.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.664+0000 7f5a2f5be640 1 -- 172.21.15.7:0/2103811628 shutdown_connections 2024-04-25T09:55:17.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.664+0000 7f5a2f5be640 1 -- 172.21.15.7:0/2103811628 wait complete. 2024-04-25T09:55:17.677 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:55:17.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.778+0000 7f59a0888640 1 Processor -- start 2024-04-25T09:55:17.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.778+0000 7f59a0888640 1 -- start start 2024-04-25T09:55:17.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.779+0000 7f59a0888640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f599c0d0a00 0x7f599c09a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:17.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.779+0000 7f59a0888640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f599c09a7d0 0x7f599c0cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:17.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.779+0000 7f59a0888640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f599c1615e0 con 0x7f599c161200 2024-04-25T09:55:17.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.779+0000 7f59a0888640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f599c06c9f0 con 0x7f599c09a7d0 2024-04-25T09:55:17.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.779+0000 7f59a0888640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599c06ccd0 con 0x7f599c0d0a00 2024-04-25T09:55:17.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.779+0000 7f599ad9d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f599c09a7d0 0x7f599c0cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:17.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.779+0000 7f599ad9d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f599c09a7d0 0x7f599c0cf840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38786/0 (socket says 172.21.15.7:38786) 2024-04-25T09:55:17.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.779+0000 7f599ad9d640 1 -- 172.21.15.7:0/1996929015 learned_addr learned my addr 172.21.15.7:0/1996929015 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:17.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.779+0000 7f5999d9b640 1 --2- 172.21.15.7:0/1996929015 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f599c0d0a00 0x7f599c09a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:17.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.780+0000 7f599ad9d640 1 -- 172.21.15.7:0/1996929015 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f599c0d0a00 msgr2=0x7f599c09a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:17.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.780+0000 7f599ad9d640 1 --2- 172.21.15.7:0/1996929015 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f599c0d0a00 0x7f599c09a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.780+0000 7f599ad9d640 1 -- 172.21.15.7:0/1996929015 >> v1:172.21.15.55:6789/0 conn(0x7f599c161200 legacy=0x7f599c0cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:17.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.780+0000 7f599ad9d640 1 -- 172.21.15.7:0/1996929015 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f599c099a90 con 0x7f599c09a7d0 2024-04-25T09:55:17.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.780+0000 7f5999d9b640 1 --2- 172.21.15.7:0/1996929015 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f599c0d0a00 0x7f599c09a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:17.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.780+0000 7f599ad9d640 1 --2- 172.21.15.7:0/1996929015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f599c09a7d0 0x7f599c0cf840 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f598c009e50 tx=0x7f598c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db9f2bf1efa4521 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:17.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.781+0000 7f599959a640 1 -- 172.21.15.7:0/1996929015 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598c036070 con 0x7f599c09a7d0 2024-04-25T09:55:17.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.781+0000 7f599959a640 1 -- 172.21.15.7:0/1996929015 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598c031600 con 0x7f599c09a7d0 2024-04-25T09:55:17.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.781+0000 7f599959a640 1 -- 172.21.15.7:0/1996929015 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598c0319d0 con 0x7f599c09a7d0 2024-04-25T09:55:17.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.781+0000 7f59a0888640 1 -- 172.21.15.7:0/1996929015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f599c09a7d0 msgr2=0x7f599c0cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:17.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.781+0000 7f59a0888640 1 --2- 172.21.15.7:0/1996929015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f599c09a7d0 0x7f599c0cf840 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f598c009e50 tx=0x7f598c02a710 comp rx=0 tx=0).stop 2024-04-25T09:55:17.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.781+0000 7f59a0888640 1 -- 172.21.15.7:0/1996929015 shutdown_connections 2024-04-25T09:55:17.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.781+0000 7f59a0888640 1 --2- 172.21.15.7:0/1996929015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f599c09a7d0 0x7f599c0cf840 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.781+0000 7f59a0888640 1 --2- 172.21.15.7:0/1996929015 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f599c0d0a00 0x7f599c09a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.781+0000 7f59a0888640 1 -- 172.21.15.7:0/1996929015 >> 172.21.15.7:0/1996929015 conn(0x7f599c0b31a0 msgr2=0x7f599c0b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:17.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.781+0000 7f59a0888640 1 -- 172.21.15.7:0/1996929015 shutdown_connections 2024-04-25T09:55:17.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.781+0000 7f59a0888640 1 -- 172.21.15.7:0/1996929015 wait complete. 2024-04-25T09:55:17.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.783+0000 7f59a0888640 1 Processor -- start 2024-04-25T09:55:17.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.783+0000 7f59a0888640 1 -- start start 2024-04-25T09:55:17.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.783+0000 7f59a0888640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f599c09a7d0 0x7f599c14b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:17.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.783+0000 7f59a0888640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f599c0d0a00 0x7f599c1f36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:17.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.783+0000 7f59a0888640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f599c161200 0x7f599c1f76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:17.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.783+0000 7f59a0888640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599c06cfb0 con 0x7f599c09a7d0 2024-04-25T09:55:17.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.783+0000 7f59a0888640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599c06c680 con 0x7f599c0d0a00 2024-04-25T09:55:17.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.783+0000 7f59a0888640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599c06d130 con 0x7f599c161200 2024-04-25T09:55:17.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.783+0000 7f599a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f599c09a7d0 0x7f599c14b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:17.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.783+0000 7f599a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f599c09a7d0 0x7f599c14b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38794/0 (socket says 172.21.15.7:38794) 2024-04-25T09:55:17.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.783+0000 7f599a59c640 1 -- 172.21.15.7:0/528395678 learned_addr learned my addr 172.21.15.7:0/528395678 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:17.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.784+0000 7f599ad9d640 1 --2- 172.21.15.7:0/528395678 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f599c161200 0x7f599c1f76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:17.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.784+0000 7f5999d9b640 1 --2- 172.21.15.7:0/528395678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f599c0d0a00 0x7f599c1f36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:17.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.784+0000 7f599a59c640 1 -- 172.21.15.7:0/528395678 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f599c161200 msgr2=0x7f599c1f76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:17.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.784+0000 7f599a59c640 1 --2- 172.21.15.7:0/528395678 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f599c161200 0x7f599c1f76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.784+0000 7f599a59c640 1 -- 172.21.15.7:0/528395678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f599c0d0a00 msgr2=0x7f599c1f36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:17.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.784+0000 7f599a59c640 1 --2- 172.21.15.7:0/528395678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f599c0d0a00 0x7f599c1f36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.784+0000 7f599a59c640 1 -- 172.21.15.7:0/528395678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f599c0c8ab0 con 0x7f599c09a7d0 2024-04-25T09:55:17.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.784+0000 7f599ad9d640 1 --2- 172.21.15.7:0/528395678 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f599c161200 0x7f599c1f76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:17.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.784+0000 7f5999d9b640 1 --2- 172.21.15.7:0/528395678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f599c0d0a00 0x7f599c1f36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:17.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.784+0000 7f599a59c640 1 --2- 172.21.15.7:0/528395678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f599c09a7d0 0x7f599c14b850 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f599400c3c0 tx=0x7f599400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:17.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.784+0000 7f5992ffd640 1 -- 172.21.15.7:0/528395678 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59940052d0 con 0x7f599c09a7d0 2024-04-25T09:55:17.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.784+0000 7f5992ffd640 1 -- 172.21.15.7:0/528395678 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5994005490 con 0x7f599c09a7d0 2024-04-25T09:55:17.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.784+0000 7f59a0888640 1 -- 172.21.15.7:0/528395678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599c1f3cd0 con 0x7f599c09a7d0 2024-04-25T09:55:17.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.784+0000 7f5992ffd640 1 -- 172.21.15.7:0/528395678 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5994007260 con 0x7f599c09a7d0 2024-04-25T09:55:17.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.784+0000 7f59a0888640 1 -- 172.21.15.7:0/528395678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f599c1f4290 con 0x7f599c09a7d0 2024-04-25T09:55:17.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.785+0000 7f59a0888640 1 -- 172.21.15.7:0/528395678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f599c068f60 con 0x7f599c09a7d0 2024-04-25T09:55:17.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.786+0000 7f5992ffd640 1 -- 172.21.15.7:0/528395678 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5994007400 con 0x7f599c09a7d0 2024-04-25T09:55:17.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.786+0000 7f5992ffd640 1 --2- 172.21.15.7:0/528395678 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f597c06b4d0 0x7f597c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:17.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.786+0000 7f5999d9b640 1 --2- 172.21.15.7:0/528395678 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f597c06b4d0 0x7f597c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:17.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.786+0000 7f5992ffd640 1 -- 172.21.15.7:0/528395678 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f5994089a10 con 0x7f599c09a7d0 2024-04-25T09:55:17.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.787+0000 7f5999d9b640 1 --2- 172.21.15.7:0/528395678 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f597c06b4d0 0x7f597c06d990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f599c14bd90 tx=0x7f5984008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:17.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.791+0000 7f5992ffd640 1 -- 172.21.15.7:0/528395678 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f599c0c8ab0 con 0x7f599c09a7d0 2024-04-25T09:55:17.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.970+0000 7f59a0888640 1 -- 172.21.15.7:0/528395678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f599c0cb700 con 0x7f599c09a7d0 2024-04-25T09:55:17.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.970+0000 7f5992ffd640 1 -- 172.21.15.7:0/528395678 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f599c1615e0 con 0x7f599c09a7d0 2024-04-25T09:55:17.973 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:55:17.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.972+0000 7f59a0888640 1 -- 172.21.15.7:0/528395678 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f597c06b4d0 msgr2=0x7f597c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:17.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.972+0000 7f59a0888640 1 --2- 172.21.15.7:0/528395678 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f597c06b4d0 0x7f597c06d990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f599c14bd90 tx=0x7f5984008040 comp rx=0 tx=0).stop 2024-04-25T09:55:17.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.972+0000 7f59a0888640 1 -- 172.21.15.7:0/528395678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f599c09a7d0 msgr2=0x7f599c14b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:17.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.972+0000 7f59a0888640 1 --2- 172.21.15.7:0/528395678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f599c09a7d0 0x7f599c14b850 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f599400c3c0 tx=0x7f599400c880 comp rx=0 tx=0).stop 2024-04-25T09:55:17.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.972+0000 7f59a0888640 1 -- 172.21.15.7:0/528395678 shutdown_connections 2024-04-25T09:55:17.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.972+0000 7f59a0888640 1 --2- 172.21.15.7:0/528395678 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f597c06b4d0 0x7f597c06d990 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.972+0000 7f59a0888640 1 --2- 172.21.15.7:0/528395678 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f599c161200 0x7f599c1f76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.972+0000 7f59a0888640 1 --2- 172.21.15.7:0/528395678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f599c0d0a00 0x7f599c1f36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.972+0000 7f59a0888640 1 --2- 172.21.15.7:0/528395678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f599c09a7d0 0x7f599c14b850 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:17.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.972+0000 7f59a0888640 1 -- 172.21.15.7:0/528395678 >> 172.21.15.7:0/528395678 conn(0x7f599c0b31a0 msgr2=0x7f599c1617c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:17.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.972+0000 7f59a0888640 1 -- 172.21.15.7:0/528395678 shutdown_connections 2024-04-25T09:55:17.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:17.972+0000 7f59a0888640 1 -- 172.21.15.7:0/528395678 wait complete. 2024-04-25T09:55:17.986 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:55:18.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.084+0000 7f797506f640 1 Processor -- start 2024-04-25T09:55:18.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.084+0000 7f797506f640 1 -- start start 2024-04-25T09:55:18.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.085+0000 7f797506f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f797015db00 0x7f79700d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:18.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.085+0000 7f797506f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f79700b53b0 0x7f79700d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:18.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.085+0000 7f797506f640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f79700ce2b0 0x7f7970161670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:18.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.085+0000 7f797506f640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79700d1e80 con 0x7f79700ce2b0 2024-04-25T09:55:18.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.085+0000 7f797506f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79700b5930 con 0x7f797015db00 2024-04-25T09:55:18.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.085+0000 7f797506f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79700b5c10 con 0x7f79700b53b0 2024-04-25T09:55:18.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.085+0000 7f796f59e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f79700ce2b0 0x7f7970161670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:18.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.085+0000 7f796f59e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f79700ce2b0 0x7f7970161670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38802/0 (socket says 172.21.15.7:38802) 2024-04-25T09:55:18.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.085+0000 7f796f59e640 1 -- 172.21.15.7:0/3901068885 learned_addr learned my addr 172.21.15.7:0/3901068885 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:18.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.085+0000 7f796ed9d640 1 --2- 172.21.15.7:0/3901068885 >> v2:172.21.15.55:3300/0 conn(0x7f797015db00 0x7f79700d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:18.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.086+0000 7f796e59c640 1 --2- 172.21.15.7:0/3901068885 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f79700b53b0 0x7f79700d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:18.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.086+0000 7f796f59e640 1 -- 172.21.15.7:0/3901068885 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f79700b53b0 msgr2=0x7f79700d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:18.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.086+0000 7f796f59e640 1 --2- 172.21.15.7:0/3901068885 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f79700b53b0 0x7f79700d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:18.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.086+0000 7f796f59e640 1 -- 172.21.15.7:0/3901068885 >> v2:172.21.15.55:3300/0 conn(0x7f797015db00 msgr2=0x7f79700d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:18.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.086+0000 7f796f59e640 1 --2- 172.21.15.7:0/3901068885 >> v2:172.21.15.55:3300/0 conn(0x7f797015db00 0x7f79700d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:18.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.086+0000 7f796f59e640 1 -- 172.21.15.7:0/3901068885 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79700b5ef0 con 0x7f79700ce2b0 2024-04-25T09:55:18.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.086+0000 7f796f59e640 1 --2- 172.21.15.7:0/3901068885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79700ce2b0 0x7f7970161670 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f79700d4940 tx=0x7f796002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc1a0d5ab4603b71 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:18.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.087+0000 7f796dd9b640 1 -- 172.21.15.7:0/3901068885 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7960036070 con 0x7f79700ce2b0 2024-04-25T09:55:18.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.087+0000 7f796dd9b640 1 -- 172.21.15.7:0/3901068885 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7960031600 con 0x7f79700ce2b0 2024-04-25T09:55:18.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.087+0000 7f796dd9b640 1 -- 172.21.15.7:0/3901068885 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79600319d0 con 0x7f79700ce2b0 2024-04-25T09:55:18.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.087+0000 7f797506f640 1 -- 172.21.15.7:0/3901068885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79700ce2b0 msgr2=0x7f7970161670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:18.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.087+0000 7f797506f640 1 --2- 172.21.15.7:0/3901068885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79700ce2b0 0x7f7970161670 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f79700d4940 tx=0x7f796002a6a0 comp rx=0 tx=0).stop 2024-04-25T09:55:18.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.087+0000 7f797506f640 1 -- 172.21.15.7:0/3901068885 shutdown_connections 2024-04-25T09:55:18.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.087+0000 7f797506f640 1 --2- 172.21.15.7:0/3901068885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79700ce2b0 0x7f7970161670 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:18.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.087+0000 7f797506f640 1 --2- 172.21.15.7:0/3901068885 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f79700b53b0 0x7f79700d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:18.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.087+0000 7f797506f640 1 --2- 172.21.15.7:0/3901068885 >> v2:172.21.15.55:3300/0 conn(0x7f797015db00 0x7f79700d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:18.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.087+0000 7f797506f640 1 -- 172.21.15.7:0/3901068885 >> 172.21.15.7:0/3901068885 conn(0x7f7970072290 msgr2=0x7f79700726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:18.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.087+0000 7f797506f640 1 -- 172.21.15.7:0/3901068885 shutdown_connections 2024-04-25T09:55:18.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.087+0000 7f797506f640 1 -- 172.21.15.7:0/3901068885 wait complete. 2024-04-25T09:55:18.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.089+0000 7f797506f640 1 Processor -- start 2024-04-25T09:55:18.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.089+0000 7f797506f640 1 -- start start 2024-04-25T09:55:18.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.089+0000 7f797506f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f79700b53b0 0x7f7970153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:18.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.089+0000 7f797506f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79700ce2b0 0x7f79700cb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:18.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.089+0000 7f797506f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f797015db00 0x7f79701538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:18.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.090+0000 7f797506f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79700d3660 con 0x7f797015db00 2024-04-25T09:55:18.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.090+0000 7f797506f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79700b61d0 con 0x7f79700ce2b0 2024-04-25T09:55:18.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.090+0000 7f797506f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79700b6c10 con 0x7f79700b53b0 2024-04-25T09:55:18.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.090+0000 7f796f59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f797015db00 0x7f79701538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:18.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.090+0000 7f796f59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f797015db00 0x7f79701538a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38818/0 (socket says 172.21.15.7:38818) 2024-04-25T09:55:18.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.090+0000 7f796f59e640 1 -- 172.21.15.7:0/953022075 learned_addr learned my addr 172.21.15.7:0/953022075 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:18.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.090+0000 7f796ed9d640 1 --2- 172.21.15.7:0/953022075 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f79700b53b0 0x7f7970153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:18.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.090+0000 7f796e59c640 1 --2- 172.21.15.7:0/953022075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79700ce2b0 0x7f79700cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:18.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.090+0000 7f796f59e640 1 -- 172.21.15.7:0/953022075 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f79700b53b0 msgr2=0x7f7970153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:18.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.090+0000 7f796f59e640 1 --2- 172.21.15.7:0/953022075 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f79700b53b0 0x7f7970153060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:18.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.090+0000 7f796f59e640 1 -- 172.21.15.7:0/953022075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79700ce2b0 msgr2=0x7f79700cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:18.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.090+0000 7f796f59e640 1 --2- 172.21.15.7:0/953022075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79700ce2b0 0x7f79700cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:18.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.090+0000 7f796f59e640 1 -- 172.21.15.7:0/953022075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79700cc860 con 0x7f797015db00 2024-04-25T09:55:18.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.090+0000 7f796e59c640 1 --2- 172.21.15.7:0/953022075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79700ce2b0 0x7f79700cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:18.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.090+0000 7f796f59e640 1 --2- 172.21.15.7:0/953022075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f797015db00 0x7f79701538a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7960009f40 tx=0x7f7960004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:18.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.090+0000 7f79677fe640 1 -- 172.21.15.7:0/953022075 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7960041020 con 0x7f797015db00 2024-04-25T09:55:18.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.090+0000 7f79677fe640 1 -- 172.21.15.7:0/953022075 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7960007820 con 0x7f797015db00 2024-04-25T09:55:18.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.090+0000 7f797506f640 1 -- 172.21.15.7:0/953022075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79700ccb40 con 0x7f797015db00 2024-04-25T09:55:18.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.090+0000 7f79677fe640 1 -- 172.21.15.7:0/953022075 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7960036040 con 0x7f797015db00 2024-04-25T09:55:18.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.090+0000 7f797506f640 1 -- 172.21.15.7:0/953022075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79701f3850 con 0x7f797015db00 2024-04-25T09:55:18.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.091+0000 7f797506f640 1 -- 172.21.15.7:0/953022075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79701f3b10 con 0x7f797015db00 2024-04-25T09:55:18.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.092+0000 7f79677fe640 1 -- 172.21.15.7:0/953022075 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7960044020 con 0x7f797015db00 2024-04-25T09:55:18.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.092+0000 7f79677fe640 1 --2- 172.21.15.7:0/953022075 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f795006b4d0 0x7f795006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:18.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.092+0000 7f79677fe640 1 -- 172.21.15.7:0/953022075 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f79600ab180 con 0x7f797015db00 2024-04-25T09:55:18.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.092+0000 7f796ed9d640 1 --2- 172.21.15.7:0/953022075 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f795006b4d0 0x7f795006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:18.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.093+0000 7f796ed9d640 1 --2- 172.21.15.7:0/953022075 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f795006b4d0 0x7f795006d990 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7968009a20 tx=0x7f7968009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:18.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.097+0000 7f79677fe640 1 -- 172.21.15.7:0/953022075 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f796004b030 con 0x7f797015db00 2024-04-25T09:55:18.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.290+0000 7f797506f640 1 -- 172.21.15.7:0/953022075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7970149e50 con 0x7f797015db00 2024-04-25T09:55:18.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.291+0000 7f79677fe640 1 -- 172.21.15.7:0/953022075 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7960079cb0 con 0x7f797015db00 2024-04-25T09:55:18.294 INFO:teuthology.orchestra.run.smithi007.stderr:listed 0 entries 2024-04-25T09:55:18.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.293+0000 7f797506f640 1 -- 172.21.15.7:0/953022075 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f795006b4d0 msgr2=0x7f795006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:18.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.293+0000 7f797506f640 1 --2- 172.21.15.7:0/953022075 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f795006b4d0 0x7f795006d990 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7968009a20 tx=0x7f7968009190 comp rx=0 tx=0).stop 2024-04-25T09:55:18.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.293+0000 7f797506f640 1 -- 172.21.15.7:0/953022075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f797015db00 msgr2=0x7f79701538a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:18.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.293+0000 7f797506f640 1 --2- 172.21.15.7:0/953022075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f797015db00 0x7f79701538a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7960009f40 tx=0x7f7960004a40 comp rx=0 tx=0).stop 2024-04-25T09:55:18.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.293+0000 7f797506f640 1 -- 172.21.15.7:0/953022075 shutdown_connections 2024-04-25T09:55:18.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.293+0000 7f797506f640 1 --2- 172.21.15.7:0/953022075 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f795006b4d0 0x7f795006d990 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:18.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.293+0000 7f797506f640 1 --2- 172.21.15.7:0/953022075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f797015db00 0x7f79701538a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:18.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.293+0000 7f797506f640 1 --2- 172.21.15.7:0/953022075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79700ce2b0 0x7f79700cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:18.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.293+0000 7f797506f640 1 --2- 172.21.15.7:0/953022075 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f79700b53b0 0x7f7970153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:18.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.293+0000 7f797506f640 1 -- 172.21.15.7:0/953022075 >> 172.21.15.7:0/953022075 conn(0x7f7970072290 msgr2=0x7f79700c78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:18.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.293+0000 7f797506f640 1 -- 172.21.15.7:0/953022075 shutdown_connections 2024-04-25T09:55:18.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.293+0000 7f797506f640 1 -- 172.21.15.7:0/953022075 wait complete. 2024-04-25T09:55:18.307 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-04-25T09:55:18.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:18.307 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-04-25T09:55:18.332 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-04-25T09:55:18.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:18.332 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-25T09:55:18.388 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:55:18.388 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:55:18.408 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:55:18.408 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:55:18.467 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:55:18.467 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:55:18.525 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:55:18.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.623+0000 7f5408bf4640 1 Processor -- start 2024-04-25T09:55:18.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.624+0000 7f5408bf4640 1 -- start start 2024-04-25T09:55:18.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.624+0000 7f5408bf4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f540415d7b0 0x7f540406fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:18.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.624+0000 7f5408bf4640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54041618f0 con 0x7f54040b53c0 2024-04-25T09:55:18.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.624+0000 7f5408bf4640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5404161bd0 con 0x7f540415eba0 2024-04-25T09:55:18.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.624+0000 7f5408bf4640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5404161eb0 con 0x7f540415d7b0 2024-04-25T09:55:18.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.624+0000 7f53fbfff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f54040b53c0 0x7f540406ab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:59310/0 (socket says 172.21.15.7:59310) 2024-04-25T09:55:18.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.624+0000 7f53fbfff640 1 -- 172.21.15.7:0/2137753225 learned_addr learned my addr 172.21.15.7:0/2137753225 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:18.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.625+0000 7f5401d9b640 1 -- 172.21.15.7:0/2137753225 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4186393172 0 0) 0x7f54041618f0 con 0x7f54040b53c0 2024-04-25T09:55:18.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.625+0000 7f5401d9b640 1 -- 172.21.15.7:0/2137753225 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53f0003520 con 0x7f54040b53c0 2024-04-25T09:55:18.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.625+0000 7f540259c640 1 --2- 172.21.15.7:0/2137753225 >> v2:172.21.15.55:3300/0 conn(0x7f540415d7b0 0x7f540406fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:18.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.625+0000 7f5401d9b640 1 -- 172.21.15.7:0/2137753225 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 101344602 0 0) 0x7f53f0003520 con 0x7f54040b53c0 2024-04-25T09:55:18.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.625+0000 7f5401d9b640 1 -- 172.21.15.7:0/2137753225 >> v2:172.21.15.55:3300/0 conn(0x7f540415d7b0 msgr2=0x7f540406fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:18.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.625+0000 7f5401d9b640 1 --2- 172.21.15.7:0/2137753225 >> v2:172.21.15.55:3300/0 conn(0x7f540415d7b0 0x7f540406fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:18.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.625+0000 7f5401d9b640 1 -- 172.21.15.7:0/2137753225 >> v1:172.21.15.55:6789/0 conn(0x7f540415eba0 legacy=0x7f54040b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:18.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.625+0000 7f5401d9b640 1 -- 172.21.15.7:0/2137753225 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5404162190 con 0x7f54040b53c0 2024-04-25T09:55:18.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.625+0000 7f5401d9b640 1 -- 172.21.15.7:0/2137753225 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f53ec001670 con 0x7f54040b53c0 2024-04-25T09:55:18.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.625+0000 7f5401d9b640 1 -- 172.21.15.7:0/2137753225 >> v1:172.21.15.7:6789/0 conn(0x7f54040b53c0 legacy=0x7f540406ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:18.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.625+0000 7f5401d9b640 1 --2- 172.21.15.7:0/2137753225 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f53f00039b0 0x7f53f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:18.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.625+0000 7f5401d9b640 1 --2- 172.21.15.7:0/2137753225 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53f0004800 0x7f53f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:18.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.625+0000 7f5401d9b640 1 --2- 172.21.15.7:0/2137753225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53f00051c0 0x7f53f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:18.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.625+0000 7f5401d9b640 1 -- 172.21.15.7:0/2137753225 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5404161eb0 con 0x7f53f0004800 2024-04-25T09:55:18.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.625+0000 7f5401d9b640 1 -- 172.21.15.7:0/2137753225 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f000c060 con 0x7f53f00051c0 2024-04-25T09:55:18.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.625+0000 7f5401d9b640 1 -- 172.21.15.7:0/2137753225 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f000c260 con 0x7f53f00039b0 2024-04-25T09:55:18.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.625+0000 7f53fbfff640 1 --2- 172.21.15.7:0/2137753225 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53f0004800 0x7f53f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:18.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.625+0000 7f540259c640 1 --2- 172.21.15.7:0/2137753225 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f53f00039b0 0x7f53f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:18.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.625+0000 7f5402d9d640 1 --2- 172.21.15.7:0/2137753225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53f00051c0 0x7f53f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:18.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.626+0000 7f53fbfff640 1 -- 172.21.15.7:0/2137753225 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f53f00039b0 msgr2=0x7f53f0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:18.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.626+0000 7f53fbfff640 1 --2- 172.21.15.7:0/2137753225 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f53f00039b0 0x7f53f0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:18.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.626+0000 7f53fbfff640 1 -- 172.21.15.7:0/2137753225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53f00051c0 msgr2=0x7f53f000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:18.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.626+0000 7f53fbfff640 1 --2- 172.21.15.7:0/2137753225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53f00051c0 0x7f53f000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:18.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.626+0000 7f53fbfff640 1 -- 172.21.15.7:0/2137753225 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f0003520 con 0x7f53f0004800 2024-04-25T09:55:18.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.626+0000 7f5402d9d640 1 -- 172.21.15.7:0/2137753225 reap_dead start 2024-04-25T09:55:18.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.626+0000 7f53fbfff640 1 --2- 172.21.15.7:0/2137753225 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53f0004800 0x7f53f0004c80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f53ec00c240 tx=0x7f53f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3accadcbbc534e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:18.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.627+0000 7f5401d9b640 1 -- 172.21.15.7:0/2137753225 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec007cf0 con 0x7f53f0004800 2024-04-25T09:55:18.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.627+0000 7f5401d9b640 1 -- 172.21.15.7:0/2137753225 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ec0058d0 con 0x7f53f0004800 2024-04-25T09:55:18.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.627+0000 7f5401d9b640 1 -- 172.21.15.7:0/2137753225 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec005ca0 con 0x7f53f0004800 2024-04-25T09:55:18.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.627+0000 7f5408bf4640 1 -- 172.21.15.7:0/2137753225 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53f0004800 msgr2=0x7f53f0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:18.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.627+0000 7f5408bf4640 1 --2- 172.21.15.7:0/2137753225 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53f0004800 0x7f53f0004c80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f53ec00c240 tx=0x7f53f0005830 comp rx=0 tx=0).stop 2024-04-25T09:55:18.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.627+0000 7f5408bf4640 1 -- 172.21.15.7:0/2137753225 shutdown_connections 2024-04-25T09:55:18.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.627+0000 7f5408bf4640 1 --2- 172.21.15.7:0/2137753225 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53f0004800 0x7f53f0004c80 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:18.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.627+0000 7f5408bf4640 1 -- 172.21.15.7:0/2137753225 >> 172.21.15.7:0/2137753225 conn(0x7f54040b2390 msgr2=0x7f54040b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:18.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.627+0000 7f5408bf4640 1 -- 172.21.15.7:0/2137753225 shutdown_connections 2024-04-25T09:55:18.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.627+0000 7f5408bf4640 1 -- 172.21.15.7:0/2137753225 wait complete. 2024-04-25T09:55:18.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.628+0000 7f5408bf4640 1 Processor -- start 2024-04-25T09:55:18.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.629+0000 7f5408bf4640 1 -- start start 2024-04-25T09:55:18.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.629+0000 7f5408bf4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53f0004800 0x7f5404148160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:18.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.629+0000 7f5408bf4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5404153770 0x7f5404158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:18.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.629+0000 7f5408bf4640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f54041588c0 0x7f54040b1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:18.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.629+0000 7f5408bf4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54040b59d0 con 0x7f5404153770 2024-04-25T09:55:18.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.629+0000 7f5408bf4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54040b5850 con 0x7f53f0004800 2024-04-25T09:55:18.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.629+0000 7f5408bf4640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54040b5b50 con 0x7f54041588c0 2024-04-25T09:55:18.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.629+0000 7f53fbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5404153770 0x7f5404158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:18.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.629+0000 7f53fbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5404153770 0x7f5404158380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38828/0 (socket says 172.21.15.7:38828) 2024-04-25T09:55:18.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.629+0000 7f53fbfff640 1 -- 172.21.15.7:0/129620197 learned_addr learned my addr 172.21.15.7:0/129620197 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:18.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.630+0000 7f5402d9d640 1 --2- 172.21.15.7:0/129620197 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f54041588c0 0x7f54040b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:18.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.630+0000 7f540259c640 1 --2- 172.21.15.7:0/129620197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53f0004800 0x7f5404148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:18.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.630+0000 7f53fbfff640 1 -- 172.21.15.7:0/129620197 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f54041588c0 msgr2=0x7f54040b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:18.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.630+0000 7f53fbfff640 1 --2- 172.21.15.7:0/129620197 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f54041588c0 0x7f54040b1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:18.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.630+0000 7f53fbfff640 1 -- 172.21.15.7:0/129620197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53f0004800 msgr2=0x7f5404148160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:18.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.630+0000 7f53fbfff640 1 --2- 172.21.15.7:0/129620197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53f0004800 0x7f5404148160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:18.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.630+0000 7f53fbfff640 1 -- 172.21.15.7:0/129620197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5404158df0 con 0x7f5404153770 2024-04-25T09:55:18.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.630+0000 7f53fbfff640 1 --2- 172.21.15.7:0/129620197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5404153770 0x7f5404158380 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f53ec001970 tx=0x7f5404162360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:18.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.630+0000 7f53faffd640 1 -- 172.21.15.7:0/129620197 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec041020 con 0x7f5404153770 2024-04-25T09:55:18.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.630+0000 7f53faffd640 1 -- 172.21.15.7:0/129620197 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ec007070 con 0x7f5404153770 2024-04-25T09:55:18.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.630+0000 7f5408bf4640 1 -- 172.21.15.7:0/129620197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54041590d0 con 0x7f5404153770 2024-04-25T09:55:18.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.630+0000 7f53faffd640 1 -- 172.21.15.7:0/129620197 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec038040 con 0x7f5404153770 2024-04-25T09:55:18.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.630+0000 7f5408bf4640 1 -- 172.21.15.7:0/129620197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54041f3ad0 con 0x7f5404153770 2024-04-25T09:55:18.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.631+0000 7f5408bf4640 1 -- 172.21.15.7:0/129620197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5404068fd0 con 0x7f5404153770 2024-04-25T09:55:18.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.632+0000 7f53faffd640 1 -- 172.21.15.7:0/129620197 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f53ec044020 con 0x7f5404153770 2024-04-25T09:55:18.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.632+0000 7f53faffd640 1 --2- 172.21.15.7:0/129620197 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f53e406b4d0 0x7f53e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:18.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.632+0000 7f53faffd640 1 -- 172.21.15.7:0/129620197 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f53ec0aa4b0 con 0x7f5404153770 2024-04-25T09:55:18.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.632+0000 7f540259c640 1 --2- 172.21.15.7:0/129620197 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f53e406b4d0 0x7f53e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:18.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.633+0000 7f540259c640 1 --2- 172.21.15.7:0/129620197 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f53e406b4d0 0x7f53e406d990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f54040cf850 tx=0x7f53f4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:18.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.636+0000 7f53faffd640 1 -- 172.21.15.7:0/129620197 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f53ec04b030 con 0x7f5404153770 2024-04-25T09:55:18.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.818+0000 7f5408bf4640 1 -- 172.21.15.7:0/129620197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54040b00e0 con 0x7f5404153770 2024-04-25T09:55:18.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.819+0000 7f53faffd640 1 -- 172.21.15.7:0/129620197 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18807 (secure 0 0 0) 0x7f53ec0790e0 con 0x7f5404153770 2024-04-25T09:55:18.822 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:18.822 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:55:09.591504+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:54:26.011833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:54:26.535536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:54:30.264996+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:55:18.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.821+0000 7f5408bf4640 1 -- 172.21.15.7:0/129620197 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f53e406b4d0 msgr2=0x7f53e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.821+0000 7f5408bf4640 1 --2- 172.21.15.7:0/129620197 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f53e406b4d0 0x7f53e406d990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f54040cf850 tx=0x7f53f4008040 comp rx=0 tx=0).stop 2024-04-25T09:55:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.821+0000 7f5408bf4640 1 -- 172.21.15.7:0/129620197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5404153770 msgr2=0x7f5404158380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.821+0000 7f5408bf4640 1 --2- 172.21.15.7:0/129620197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5404153770 0x7f5404158380 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f53ec001970 tx=0x7f5404162360 comp rx=0 tx=0).stop 2024-04-25T09:55:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.821+0000 7f5408bf4640 1 -- 172.21.15.7:0/129620197 shutdown_connections 2024-04-25T09:55:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.821+0000 7f5408bf4640 1 --2- 172.21.15.7:0/129620197 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f53e406b4d0 0x7f53e406d990 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.821+0000 7f5408bf4640 1 --2- 172.21.15.7:0/129620197 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f54041588c0 0x7f54040b1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.821+0000 7f5408bf4640 1 --2- 172.21.15.7:0/129620197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5404153770 0x7f5404158380 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.822+0000 7f5408bf4640 1 --2- 172.21.15.7:0/129620197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53f0004800 0x7f5404148160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.822+0000 7f5408bf4640 1 -- 172.21.15.7:0/129620197 >> 172.21.15.7:0/129620197 conn(0x7f54040b2390 msgr2=0x7f54040b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.822+0000 7f5408bf4640 1 -- 172.21.15.7:0/129620197 shutdown_connections 2024-04-25T09:55:18.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.822+0000 7f5408bf4640 1 -- 172.21.15.7:0/129620197 wait complete. 2024-04-25T09:55:18.835 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:54:26.011833+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:54:26.535536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:54:30.264996+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:55:18.836 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:55:18.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.937+0000 7f7a4ecc4640 1 Processor -- start 2024-04-25T09:55:18.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.937+0000 7f7a4ecc4640 1 -- start start 2024-04-25T09:55:18.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.937+0000 7f7a4ecc4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7a4815deb0 0x7f7a480b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:18.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.937+0000 7f7a4ecc4640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7a480ce030 0x7f7a480b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:18.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.937+0000 7f7a4ecc4640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a480ce4c0 con 0x7f7a480b6f20 2024-04-25T09:55:18.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.937+0000 7f7a4ecc4640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a480d1a40 con 0x7f7a480ce030 2024-04-25T09:55:18.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.937+0000 7f7a4ecc4640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a480d1d20 con 0x7f7a4815deb0 2024-04-25T09:55:18.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.938+0000 7f7a47fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7a480ce030 0x7f7a480b69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:18.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.938+0000 7f7a47fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7a480ce030 0x7f7a480b69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38842/0 (socket says 172.21.15.7:38842) 2024-04-25T09:55:18.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.938+0000 7f7a47fff640 1 -- 172.21.15.7:0/942058433 learned_addr learned my addr 172.21.15.7:0/942058433 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:18.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.938+0000 7f7a4ca60640 1 --2- 172.21.15.7:0/942058433 >> v2:172.21.15.55:3300/0 conn(0x7f7a4815deb0 0x7f7a480b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:18.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.938+0000 7f7a47fff640 1 -- 172.21.15.7:0/942058433 >> v2:172.21.15.55:3300/0 conn(0x7f7a4815deb0 msgr2=0x7f7a480b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:18.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.938+0000 7f7a47fff640 1 --2- 172.21.15.7:0/942058433 >> v2:172.21.15.55:3300/0 conn(0x7f7a4815deb0 0x7f7a480b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:18.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.938+0000 7f7a47fff640 1 -- 172.21.15.7:0/942058433 >> v1:172.21.15.55:6789/0 conn(0x7f7a480b6f20 legacy=0x7f7a480d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:18.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.938+0000 7f7a47fff640 1 -- 172.21.15.7:0/942058433 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a480d2000 con 0x7f7a480ce030 2024-04-25T09:55:18.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.939+0000 7f7a47fff640 1 --2- 172.21.15.7:0/942058433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a480ce030 0x7f7a480b69e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7a480d43f0 tx=0x7f7a3402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db30a65341303ff6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:18.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.939+0000 7f7a477fe640 1 -- 172.21.15.7:0/942058433 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a34037070 con 0x7f7a480ce030 2024-04-25T09:55:18.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.939+0000 7f7a477fe640 1 -- 172.21.15.7:0/942058433 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a34032440 con 0x7f7a480ce030 2024-04-25T09:55:18.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.939+0000 7f7a477fe640 1 -- 172.21.15.7:0/942058433 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a34032810 con 0x7f7a480ce030 2024-04-25T09:55:18.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.939+0000 7f7a4ecc4640 1 -- 172.21.15.7:0/942058433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a480ce030 msgr2=0x7f7a480b69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:18.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.939+0000 7f7a4ecc4640 1 --2- 172.21.15.7:0/942058433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a480ce030 0x7f7a480b69e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7a480d43f0 tx=0x7f7a3402a270 comp rx=0 tx=0).stop 2024-04-25T09:55:18.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.939+0000 7f7a4ecc4640 1 -- 172.21.15.7:0/942058433 shutdown_connections 2024-04-25T09:55:18.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.939+0000 7f7a4ecc4640 1 --2- 172.21.15.7:0/942058433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a480ce030 0x7f7a480b69e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:18.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.939+0000 7f7a4ecc4640 1 --2- 172.21.15.7:0/942058433 >> v2:172.21.15.55:3300/0 conn(0x7f7a4815deb0 0x7f7a480b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:18.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.939+0000 7f7a4ecc4640 1 -- 172.21.15.7:0/942058433 >> 172.21.15.7:0/942058433 conn(0x7f7a480726b0 msgr2=0x7f7a48072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:18.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.939+0000 7f7a4ecc4640 1 -- 172.21.15.7:0/942058433 shutdown_connections 2024-04-25T09:55:18.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.939+0000 7f7a4ecc4640 1 -- 172.21.15.7:0/942058433 wait complete. 2024-04-25T09:55:18.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.941+0000 7f7a4ecc4640 1 Processor -- start 2024-04-25T09:55:18.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.941+0000 7f7a4ecc4640 1 -- start start 2024-04-25T09:55:18.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.941+0000 7f7a4ecc4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a480b6f20 0x7f7a480c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:18.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.941+0000 7f7a4ecc4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a480ce030 0x7f7a480cb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:18.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.941+0000 7f7a4ecc4640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7a4815deb0 0x7f7a480cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:18.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.941+0000 7f7a4ecc4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a480d3e70 con 0x7f7a480ce030 2024-04-25T09:55:18.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.942+0000 7f7a4ecc4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a480d25c0 con 0x7f7a480b6f20 2024-04-25T09:55:18.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.942+0000 7f7a4ecc4640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a480d3ff0 con 0x7f7a4815deb0 2024-04-25T09:55:18.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.942+0000 7f7a47fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a480ce030 0x7f7a480cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:18.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.942+0000 7f7a47fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a480ce030 0x7f7a480cb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38856/0 (socket says 172.21.15.7:38856) 2024-04-25T09:55:18.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.942+0000 7f7a47fff640 1 -- 172.21.15.7:0/81406386 learned_addr learned my addr 172.21.15.7:0/81406386 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:18.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.942+0000 7f7a4ca60640 1 --2- 172.21.15.7:0/81406386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a480b6f20 0x7f7a480c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:18.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.942+0000 7f7a4d261640 1 --2- 172.21.15.7:0/81406386 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7a4815deb0 0x7f7a480cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:18.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.942+0000 7f7a47fff640 1 -- 172.21.15.7:0/81406386 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7a4815deb0 msgr2=0x7f7a480cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:18.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.942+0000 7f7a47fff640 1 --2- 172.21.15.7:0/81406386 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7a4815deb0 0x7f7a480cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:18.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.942+0000 7f7a47fff640 1 -- 172.21.15.7:0/81406386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a480b6f20 msgr2=0x7f7a480c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:18.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.942+0000 7f7a47fff640 1 --2- 172.21.15.7:0/81406386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a480b6f20 0x7f7a480c9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:18.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.942+0000 7f7a47fff640 1 -- 172.21.15.7:0/81406386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a480cab40 con 0x7f7a480ce030 2024-04-25T09:55:18.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.942+0000 7f7a47fff640 1 --2- 172.21.15.7:0/81406386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a480ce030 0x7f7a480cb790 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7a3402a2b0 tx=0x7f7a340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:18.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.942+0000 7f7a457fa640 1 -- 172.21.15.7:0/81406386 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a34041020 con 0x7f7a480ce030 2024-04-25T09:55:18.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.942+0000 7f7a457fa640 1 -- 172.21.15.7:0/81406386 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a340306c0 con 0x7f7a480ce030 2024-04-25T09:55:18.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.942+0000 7f7a457fa640 1 -- 172.21.15.7:0/81406386 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a34037040 con 0x7f7a480ce030 2024-04-25T09:55:18.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.942+0000 7f7a4ecc4640 1 -- 172.21.15.7:0/81406386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a48157fe0 con 0x7f7a480ce030 2024-04-25T09:55:18.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.942+0000 7f7a4ecc4640 1 -- 172.21.15.7:0/81406386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a481585a0 con 0x7f7a480ce030 2024-04-25T09:55:18.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.943+0000 7f7a4ecc4640 1 -- 172.21.15.7:0/81406386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a48068f60 con 0x7f7a480ce030 2024-04-25T09:55:18.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.944+0000 7f7a457fa640 1 -- 172.21.15.7:0/81406386 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7a34044020 con 0x7f7a480ce030 2024-04-25T09:55:18.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.944+0000 7f7a457fa640 1 --2- 172.21.15.7:0/81406386 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7a2c06b4d0 0x7f7a2c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:18.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.944+0000 7f7a4ca60640 1 --2- 172.21.15.7:0/81406386 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7a2c06b4d0 0x7f7a2c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:18.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.944+0000 7f7a457fa640 1 -- 172.21.15.7:0/81406386 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f7a340aac40 con 0x7f7a480ce030 2024-04-25T09:55:18.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.945+0000 7f7a4ca60640 1 --2- 172.21.15.7:0/81406386 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7a2c06b4d0 0x7f7a2c06d990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c006fd0 tx=0x7f7a3c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:18.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:18.949+0000 7f7a457fa640 1 -- 172.21.15.7:0/81406386 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7a3404b030 con 0x7f7a480ce030 2024-04-25T09:55:19.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.127+0000 7f7a4ecc4640 1 -- 172.21.15.7:0/81406386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7a4815d510 con 0x7f7a480ce030 2024-04-25T09:55:19.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.127+0000 7f7a457fa640 1 -- 172.21.15.7:0/81406386 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7a34079100 con 0x7f7a480ce030 2024-04-25T09:55:19.130 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T09:55:19.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.129+0000 7f7a4ecc4640 1 -- 172.21.15.7:0/81406386 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7a2c06b4d0 msgr2=0x7f7a2c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:19.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.129+0000 7f7a4ecc4640 1 --2- 172.21.15.7:0/81406386 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7a2c06b4d0 0x7f7a2c06d990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c006fd0 tx=0x7f7a3c008040 comp rx=0 tx=0).stop 2024-04-25T09:55:19.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.129+0000 7f7a4ecc4640 1 -- 172.21.15.7:0/81406386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a480ce030 msgr2=0x7f7a480cb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:19.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.129+0000 7f7a4ecc4640 1 --2- 172.21.15.7:0/81406386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a480ce030 0x7f7a480cb790 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7a3402a2b0 tx=0x7f7a340046c0 comp rx=0 tx=0).stop 2024-04-25T09:55:19.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.129+0000 7f7a4ecc4640 1 -- 172.21.15.7:0/81406386 shutdown_connections 2024-04-25T09:55:19.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.129+0000 7f7a4ecc4640 1 --2- 172.21.15.7:0/81406386 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7a2c06b4d0 0x7f7a2c06d990 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:19.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.129+0000 7f7a4ecc4640 1 --2- 172.21.15.7:0/81406386 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7a4815deb0 0x7f7a480cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:19.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.129+0000 7f7a4ecc4640 1 --2- 172.21.15.7:0/81406386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a480ce030 0x7f7a480cb790 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:19.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.129+0000 7f7a4ecc4640 1 --2- 172.21.15.7:0/81406386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a480b6f20 0x7f7a480c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:19.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.129+0000 7f7a4ecc4640 1 -- 172.21.15.7:0/81406386 >> 172.21.15.7:0/81406386 conn(0x7f7a480726b0 msgr2=0x7f7a480b3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:19.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.129+0000 7f7a4ecc4640 1 -- 172.21.15.7:0/81406386 shutdown_connections 2024-04-25T09:55:19.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.129+0000 7f7a4ecc4640 1 -- 172.21.15.7:0/81406386 wait complete. 2024-04-25T09:55:19.143 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:55:19.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.243+0000 7f2850c2a640 1 Processor -- start 2024-04-25T09:55:19.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.243+0000 7f2850c2a640 1 -- start start 2024-04-25T09:55:19.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.244+0000 7f2850c2a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f284c0cfc40 0x7f284c0d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.244+0000 7f2850c2a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f284c0b1480 0x7f284c0b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.244+0000 7f2850c2a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f284c0ce070 0x7f284c0ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.244+0000 7f2850c2a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f284c0b25e0 con 0x7f284c0cfc40 2024-04-25T09:55:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.244+0000 7f2850c2a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f284c15bec0 con 0x7f284c0b1480 2024-04-25T09:55:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.244+0000 7f2850c2a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284c0d0560 con 0x7f284c0ce070 2024-04-25T09:55:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.244+0000 7f284a59c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f284c0cfc40 0x7f284c0d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.244+0000 7f284a59c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f284c0cfc40 0x7f284c0d0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38872/0 (socket says 172.21.15.7:38872) 2024-04-25T09:55:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.244+0000 7f284a59c640 1 -- 172.21.15.7:0/2677662443 learned_addr learned my addr 172.21.15.7:0/2677662443 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.244+0000 7f284ad9d640 1 --2- 172.21.15.7:0/2677662443 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f284c0ce070 0x7f284c0ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.244+0000 7f2849d9b640 1 --2- 172.21.15.7:0/2677662443 >> v2:172.21.15.55:3300/0 conn(0x7f284c0b1480 0x7f284c0b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.245+0000 7f284a59c640 1 -- 172.21.15.7:0/2677662443 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f284c0ce070 msgr2=0x7f284c0ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.245+0000 7f284a59c640 1 --2- 172.21.15.7:0/2677662443 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f284c0ce070 0x7f284c0ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.245+0000 7f284a59c640 1 -- 172.21.15.7:0/2677662443 >> v2:172.21.15.55:3300/0 conn(0x7f284c0b1480 msgr2=0x7f284c0b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.245+0000 7f284a59c640 1 --2- 172.21.15.7:0/2677662443 >> v2:172.21.15.55:3300/0 conn(0x7f284c0b1480 0x7f284c0b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:19.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.245+0000 7f284a59c640 1 -- 172.21.15.7:0/2677662443 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c0b19d0 con 0x7f284c0cfc40 2024-04-25T09:55:19.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.245+0000 7f2849d9b640 1 --2- 172.21.15.7:0/2677662443 >> v2:172.21.15.55:3300/0 conn(0x7f284c0b1480 0x7f284c0b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.245+0000 7f284a59c640 1 --2- 172.21.15.7:0/2677662443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f284c0cfc40 0x7f284c0d0020 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f284c067390 tx=0x7f284402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=165c7ccfca9adcb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.246+0000 7f284959a640 1 -- 172.21.15.7:0/2677662443 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2844036070 con 0x7f284c0cfc40 2024-04-25T09:55:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.246+0000 7f284959a640 1 -- 172.21.15.7:0/2677662443 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2844031600 con 0x7f284c0cfc40 2024-04-25T09:55:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.246+0000 7f284959a640 1 -- 172.21.15.7:0/2677662443 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28440319d0 con 0x7f284c0cfc40 2024-04-25T09:55:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.246+0000 7f2850c2a640 1 -- 172.21.15.7:0/2677662443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f284c0cfc40 msgr2=0x7f284c0d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.246+0000 7f2850c2a640 1 --2- 172.21.15.7:0/2677662443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f284c0cfc40 0x7f284c0d0020 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f284c067390 tx=0x7f284402a6a0 comp rx=0 tx=0).stop 2024-04-25T09:55:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.246+0000 7f2850c2a640 1 -- 172.21.15.7:0/2677662443 shutdown_connections 2024-04-25T09:55:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.246+0000 7f2850c2a640 1 --2- 172.21.15.7:0/2677662443 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f284c0ce070 0x7f284c0ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.246+0000 7f2850c2a640 1 --2- 172.21.15.7:0/2677662443 >> v2:172.21.15.55:3300/0 conn(0x7f284c0b1480 0x7f284c0b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.246+0000 7f2850c2a640 1 --2- 172.21.15.7:0/2677662443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f284c0cfc40 0x7f284c0d0020 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.246+0000 7f2850c2a640 1 -- 172.21.15.7:0/2677662443 >> 172.21.15.7:0/2677662443 conn(0x7f284c08af80 msgr2=0x7f284c08b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:19.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.246+0000 7f2850c2a640 1 -- 172.21.15.7:0/2677662443 shutdown_connections 2024-04-25T09:55:19.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.246+0000 7f2850c2a640 1 -- 172.21.15.7:0/2677662443 wait complete. 2024-04-25T09:55:19.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.248+0000 7f2850c2a640 1 Processor -- start 2024-04-25T09:55:19.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.248+0000 7f2850c2a640 1 -- start start 2024-04-25T09:55:19.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.248+0000 7f2850c2a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f284c0b1480 0x7f284c06d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:19.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.248+0000 7f2850c2a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f284c0ce070 0x7f284c06bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:19.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.248+0000 7f2850c2a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f284c0cfc40 0x7f284c1e59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:19.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.248+0000 7f2850c2a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c0b2270 con 0x7f284c0b1480 2024-04-25T09:55:19.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.248+0000 7f2850c2a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c0b1f90 con 0x7f284c0cfc40 2024-04-25T09:55:19.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.248+0000 7f2850c2a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284c0b1010 con 0x7f284c0ce070 2024-04-25T09:55:19.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.248+0000 7f284a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f284c0b1480 0x7f284c06d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:19.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.248+0000 7f284a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f284c0b1480 0x7f284c06d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38886/0 (socket says 172.21.15.7:38886) 2024-04-25T09:55:19.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.248+0000 7f284a59c640 1 -- 172.21.15.7:0/3090063318 learned_addr learned my addr 172.21.15.7:0/3090063318 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:19.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.249+0000 7f284ad9d640 1 --2- 172.21.15.7:0/3090063318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f284c0cfc40 0x7f284c1e59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:19.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.249+0000 7f2849d9b640 1 --2- 172.21.15.7:0/3090063318 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f284c0ce070 0x7f284c06bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:19.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.249+0000 7f284a59c640 1 -- 172.21.15.7:0/3090063318 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f284c0ce070 msgr2=0x7f284c06bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:19.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.249+0000 7f284a59c640 1 --2- 172.21.15.7:0/3090063318 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f284c0ce070 0x7f284c06bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:19.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.249+0000 7f284a59c640 1 -- 172.21.15.7:0/3090063318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f284c0cfc40 msgr2=0x7f284c1e59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:19.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.249+0000 7f284a59c640 1 --2- 172.21.15.7:0/3090063318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f284c0cfc40 0x7f284c1e59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:19.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.249+0000 7f284a59c640 1 -- 172.21.15.7:0/3090063318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c06c850 con 0x7f284c0b1480 2024-04-25T09:55:19.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.249+0000 7f2849d9b640 1 --2- 172.21.15.7:0/3090063318 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f284c0ce070 0x7f284c06bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:19.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.249+0000 7f284a59c640 1 --2- 172.21.15.7:0/3090063318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f284c0b1480 0x7f284c06d8f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2844009e20 tx=0x7f2844004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:19.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.249+0000 7f283affd640 1 -- 172.21.15.7:0/3090063318 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2844036050 con 0x7f284c0b1480 2024-04-25T09:55:19.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.249+0000 7f283affd640 1 -- 172.21.15.7:0/3090063318 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2844042070 con 0x7f284c0b1480 2024-04-25T09:55:19.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.249+0000 7f2850c2a640 1 -- 172.21.15.7:0/3090063318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f284c06cb30 con 0x7f284c0b1480 2024-04-25T09:55:19.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.249+0000 7f283affd640 1 -- 172.21.15.7:0/3090063318 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2844009510 con 0x7f284c0b1480 2024-04-25T09:55:19.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.249+0000 7f2850c2a640 1 -- 172.21.15.7:0/3090063318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f284c06d0f0 con 0x7f284c0b1480 2024-04-25T09:55:19.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.250+0000 7f2850c2a640 1 -- 172.21.15.7:0/3090063318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f284c068f60 con 0x7f284c0b1480 2024-04-25T09:55:19.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.251+0000 7f283affd640 1 -- 172.21.15.7:0/3090063318 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2844007c70 con 0x7f284c0b1480 2024-04-25T09:55:19.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.251+0000 7f283affd640 1 --2- 172.21.15.7:0/3090063318 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f282c06b500 0x7f282c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:19.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.251+0000 7f283affd640 1 -- 172.21.15.7:0/3090063318 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f28440ab340 con 0x7f284c0b1480 2024-04-25T09:55:19.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.251+0000 7f2849d9b640 1 --2- 172.21.15.7:0/3090063318 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f282c06b500 0x7f282c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:19.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.251+0000 7f2849d9b640 1 --2- 172.21.15.7:0/3090063318 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f282c06b500 0x7f282c06d9c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f284c0c7b20 tx=0x7f2840008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:19.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.255+0000 7f283affd640 1 -- 172.21.15.7:0/3090063318 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2844079dc0 con 0x7f284c0b1480 2024-04-25T09:55:19.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.433+0000 7f2850c2a640 1 -- 172.21.15.7:0/3090063318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f284c0d1790 con 0x7f284c0b1480 2024-04-25T09:55:19.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.434+0000 7f283affd640 1 -- 172.21.15.7:0/3090063318 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f28440796c0 con 0x7f284c0b1480 2024-04-25T09:55:19.436 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:55:19.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.435+0000 7f2850c2a640 1 -- 172.21.15.7:0/3090063318 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f282c06b500 msgr2=0x7f282c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:19.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.435+0000 7f2850c2a640 1 --2- 172.21.15.7:0/3090063318 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f282c06b500 0x7f282c06d9c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f284c0c7b20 tx=0x7f2840008040 comp rx=0 tx=0).stop 2024-04-25T09:55:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.435+0000 7f2850c2a640 1 -- 172.21.15.7:0/3090063318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f284c0b1480 msgr2=0x7f284c06d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.435+0000 7f2850c2a640 1 --2- 172.21.15.7:0/3090063318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f284c0b1480 0x7f284c06d8f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2844009e20 tx=0x7f2844004a40 comp rx=0 tx=0).stop 2024-04-25T09:55:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.435+0000 7f2850c2a640 1 -- 172.21.15.7:0/3090063318 shutdown_connections 2024-04-25T09:55:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.435+0000 7f2850c2a640 1 --2- 172.21.15.7:0/3090063318 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f282c06b500 0x7f282c06d9c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.435+0000 7f2850c2a640 1 --2- 172.21.15.7:0/3090063318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f284c0cfc40 0x7f284c1e59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.435+0000 7f2850c2a640 1 --2- 172.21.15.7:0/3090063318 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f284c0ce070 0x7f284c06bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.435+0000 7f2850c2a640 1 --2- 172.21.15.7:0/3090063318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f284c0b1480 0x7f284c06d8f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.435+0000 7f2850c2a640 1 -- 172.21.15.7:0/3090063318 >> 172.21.15.7:0/3090063318 conn(0x7f284c08af80 msgr2=0x7f284c0cd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.435+0000 7f2850c2a640 1 -- 172.21.15.7:0/3090063318 shutdown_connections 2024-04-25T09:55:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.436+0000 7f2850c2a640 1 -- 172.21.15.7:0/3090063318 wait complete. 2024-04-25T09:55:19.449 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:55:19.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.550+0000 7f37f709e640 1 Processor -- start 2024-04-25T09:55:19.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.550+0000 7f37f709e640 1 -- start start 2024-04-25T09:55:19.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.550+0000 7f37f709e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f37f00d0780 0x7f37f00d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:19.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.550+0000 7f37f709e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f37f00b9130 0x7f37f00d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:19.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.551+0000 7f37f709e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f37f00b9590 0x7f37f00d2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:19.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.551+0000 7f37f709e640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37f00d10a0 con 0x7f37f00b9130 2024-04-25T09:55:19.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.551+0000 7f37f709e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37f00b7ef0 con 0x7f37f00d0780 2024-04-25T09:55:19.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.551+0000 7f37f709e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f00b81d0 con 0x7f37f00b9590 2024-04-25T09:55:19.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.551+0000 7f37effff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f37f00b9130 0x7f37f00d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:19.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.551+0000 7f37effff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f37f00b9130 0x7f37f00d1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38888/0 (socket says 172.21.15.7:38888) 2024-04-25T09:55:19.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.551+0000 7f37effff640 1 -- 172.21.15.7:0/3080199235 learned_addr learned my addr 172.21.15.7:0/3080199235 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:19.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.551+0000 7f37effff640 1 -- 172.21.15.7:0/3080199235 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f37f00b9590 msgr2=0x7f37f00d2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:19.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.551+0000 7f37effff640 1 --2- 172.21.15.7:0/3080199235 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f37f00b9590 0x7f37f00d2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:19.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.551+0000 7f37effff640 1 -- 172.21.15.7:0/3080199235 >> v2:172.21.15.55:3300/0 conn(0x7f37f00d0780 msgr2=0x7f37f00d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:19.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.551+0000 7f37effff640 1 --2- 172.21.15.7:0/3080199235 >> v2:172.21.15.55:3300/0 conn(0x7f37f00d0780 0x7f37f00d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:19.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.551+0000 7f37effff640 1 -- 172.21.15.7:0/3080199235 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f00b84b0 con 0x7f37f00b9130 2024-04-25T09:55:19.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.552+0000 7f37effff640 1 --2- 172.21.15.7:0/3080199235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37f00b9130 0x7f37f00d1c30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f37f00b6180 tx=0x7f37e002a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2ffdc6bebeffc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:19.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.552+0000 7f37ef7fe640 1 -- 172.21.15.7:0/3080199235 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e0037070 con 0x7f37f00b9130 2024-04-25T09:55:19.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.552+0000 7f37ef7fe640 1 -- 172.21.15.7:0/3080199235 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e0032440 con 0x7f37f00b9130 2024-04-25T09:55:19.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.552+0000 7f37ef7fe640 1 -- 172.21.15.7:0/3080199235 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e0032810 con 0x7f37f00b9130 2024-04-25T09:55:19.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.552+0000 7f37f709e640 1 -- 172.21.15.7:0/3080199235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37f00b9130 msgr2=0x7f37f00d1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:19.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.552+0000 7f37f709e640 1 --2- 172.21.15.7:0/3080199235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37f00b9130 0x7f37f00d1c30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f37f00b6180 tx=0x7f37e002a200 comp rx=0 tx=0).stop 2024-04-25T09:55:19.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.552+0000 7f37f709e640 1 -- 172.21.15.7:0/3080199235 shutdown_connections 2024-04-25T09:55:19.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.552+0000 7f37f709e640 1 --2- 172.21.15.7:0/3080199235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37f00b9130 0x7f37f00d1c30 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:19.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.552+0000 7f37f709e640 1 --2- 172.21.15.7:0/3080199235 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f37f00b9590 0x7f37f00d2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:19.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.552+0000 7f37f709e640 1 --2- 172.21.15.7:0/3080199235 >> v2:172.21.15.55:3300/0 conn(0x7f37f00d0780 0x7f37f00d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:19.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.552+0000 7f37f709e640 1 -- 172.21.15.7:0/3080199235 >> 172.21.15.7:0/3080199235 conn(0x7f37f00726b0 msgr2=0x7f37f0072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:19.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.552+0000 7f37f709e640 1 -- 172.21.15.7:0/3080199235 shutdown_connections 2024-04-25T09:55:19.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.552+0000 7f37f709e640 1 -- 172.21.15.7:0/3080199235 wait complete. 2024-04-25T09:55:19.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.554+0000 7f37f709e640 1 Processor -- start 2024-04-25T09:55:19.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.554+0000 7f37f709e640 1 -- start start 2024-04-25T09:55:19.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.554+0000 7f37f709e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37f00b9130 0x7f37f0152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:19.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.554+0000 7f37f709e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f37f00b9590 0x7f37f015a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:19.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.554+0000 7f37f709e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37f00d0780 0x7f37f00cce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:19.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.554+0000 7f37f709e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f01611b0 con 0x7f37f00d0780 2024-04-25T09:55:19.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.554+0000 7f37f709e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f00b8a70 con 0x7f37f00b9130 2024-04-25T09:55:19.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.554+0000 7f37f709e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f0161330 con 0x7f37f00b9590 2024-04-25T09:55:19.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.555+0000 7f37f563b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37f00d0780 0x7f37f00cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:19.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.555+0000 7f37f563b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37f00d0780 0x7f37f00cce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38904/0 (socket says 172.21.15.7:38904) 2024-04-25T09:55:19.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.555+0000 7f37f563b640 1 -- 172.21.15.7:0/2510536211 learned_addr learned my addr 172.21.15.7:0/2510536211 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:19.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.555+0000 7f37f4e3a640 1 --2- 172.21.15.7:0/2510536211 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37f00b9130 0x7f37f0152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:19.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.555+0000 7f37effff640 1 --2- 172.21.15.7:0/2510536211 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f37f00b9590 0x7f37f015a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:19.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.555+0000 7f37f563b640 1 -- 172.21.15.7:0/2510536211 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f37f00b9590 msgr2=0x7f37f015a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:19.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.555+0000 7f37f563b640 1 --2- 172.21.15.7:0/2510536211 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f37f00b9590 0x7f37f015a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:19.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.555+0000 7f37f563b640 1 -- 172.21.15.7:0/2510536211 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37f00b9130 msgr2=0x7f37f0152fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:19.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.555+0000 7f37f563b640 1 --2- 172.21.15.7:0/2510536211 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37f00b9130 0x7f37f0152fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:19.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.555+0000 7f37f563b640 1 -- 172.21.15.7:0/2510536211 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f00c6f50 con 0x7f37f00d0780 2024-04-25T09:55:19.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.555+0000 7f37effff640 1 --2- 172.21.15.7:0/2510536211 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f37f00b9590 0x7f37f015a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:19.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.555+0000 7f37f4e3a640 1 --2- 172.21.15.7:0/2510536211 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37f00b9130 0x7f37f0152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:19.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.555+0000 7f37f563b640 1 --2- 172.21.15.7:0/2510536211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37f00d0780 0x7f37f00cce40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f37d800b3c0 tx=0x7f37d800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:19.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.555+0000 7f37ed7fa640 1 -- 172.21.15.7:0/2510536211 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d8011830 con 0x7f37f00d0780 2024-04-25T09:55:19.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.555+0000 7f37ed7fa640 1 -- 172.21.15.7:0/2510536211 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d8016070 con 0x7f37f00d0780 2024-04-25T09:55:19.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.555+0000 7f37f709e640 1 -- 172.21.15.7:0/2510536211 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f00c71f0 con 0x7f37f00d0780 2024-04-25T09:55:19.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.555+0000 7f37ed7fa640 1 -- 172.21.15.7:0/2510536211 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d8011c10 con 0x7f37f00d0780 2024-04-25T09:55:19.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.555+0000 7f37f709e640 1 -- 172.21.15.7:0/2510536211 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f00cbd80 con 0x7f37f00d0780 2024-04-25T09:55:19.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.556+0000 7f37f709e640 1 -- 172.21.15.7:0/2510536211 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f0068f60 con 0x7f37f00d0780 2024-04-25T09:55:19.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.557+0000 7f37ed7fa640 1 -- 172.21.15.7:0/2510536211 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f37d801b460 con 0x7f37f00d0780 2024-04-25T09:55:19.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.557+0000 7f37ed7fa640 1 --2- 172.21.15.7:0/2510536211 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f37d006b4d0 0x7f37d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:19.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.557+0000 7f37ed7fa640 1 -- 172.21.15.7:0/2510536211 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f37d808a230 con 0x7f37f00d0780 2024-04-25T09:55:19.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.557+0000 7f37f4e3a640 1 --2- 172.21.15.7:0/2510536211 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f37d006b4d0 0x7f37d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:19.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.558+0000 7f37f4e3a640 1 --2- 172.21.15.7:0/2510536211 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f37d006b4d0 0x7f37d006d990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f37e8009fa0 tx=0x7f37e8009570 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:19.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.562+0000 7f37ed7fa640 1 -- 172.21.15.7:0/2510536211 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f37d8058d40 con 0x7f37f00d0780 2024-04-25T09:55:19.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.745+0000 7f37f709e640 1 -- 172.21.15.7:0/2510536211 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f37f00c7950 con 0x7f37f00d0780 2024-04-25T09:55:19.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.746+0000 7f37ed7fa640 1 -- 172.21.15.7:0/2510536211 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f37d8058640 con 0x7f37f00d0780 2024-04-25T09:55:19.749 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T09:55:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.747+0000 7f37f709e640 1 -- 172.21.15.7:0/2510536211 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f37d006b4d0 msgr2=0x7f37d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.747+0000 7f37f709e640 1 --2- 172.21.15.7:0/2510536211 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f37d006b4d0 0x7f37d006d990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f37e8009fa0 tx=0x7f37e8009570 comp rx=0 tx=0).stop 2024-04-25T09:55:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.747+0000 7f37f709e640 1 -- 172.21.15.7:0/2510536211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37f00d0780 msgr2=0x7f37f00cce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.747+0000 7f37f709e640 1 --2- 172.21.15.7:0/2510536211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37f00d0780 0x7f37f00cce40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f37d800b3c0 tx=0x7f37d800b880 comp rx=0 tx=0).stop 2024-04-25T09:55:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.748+0000 7f37f709e640 1 -- 172.21.15.7:0/2510536211 shutdown_connections 2024-04-25T09:55:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.748+0000 7f37f709e640 1 --2- 172.21.15.7:0/2510536211 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f37d006b4d0 0x7f37d006d990 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.748+0000 7f37f709e640 1 --2- 172.21.15.7:0/2510536211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37f00d0780 0x7f37f00cce40 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.748+0000 7f37f709e640 1 --2- 172.21.15.7:0/2510536211 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f37f00b9590 0x7f37f015a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.748+0000 7f37f709e640 1 --2- 172.21.15.7:0/2510536211 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37f00b9130 0x7f37f0152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.748+0000 7f37f709e640 1 -- 172.21.15.7:0/2510536211 >> 172.21.15.7:0/2510536211 conn(0x7f37f00726b0 msgr2=0x7f37f0160250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.748+0000 7f37f709e640 1 -- 172.21.15.7:0/2510536211 shutdown_connections 2024-04-25T09:55:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.748+0000 7f37f709e640 1 -- 172.21.15.7:0/2510536211 wait complete. 2024-04-25T09:55:19.761 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:55:19.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.863+0000 7f3487d5a640 1 Processor -- start 2024-04-25T09:55:19.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.863+0000 7f3487d5a640 1 -- start start 2024-04-25T09:55:19.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.864+0000 7f3487d5a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f34800d3760 0x7f348015eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:19.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.864+0000 7f3487d5a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34800ced10 con 0x7f34800ce830 2024-04-25T09:55:19.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.864+0000 7f3487d5a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34800d1b40 con 0x7f348015f1c0 2024-04-25T09:55:19.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.864+0000 7f3487d5a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34800ce380 con 0x7f34800d3760 2024-04-25T09:55:19.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.864+0000 7f3485af6640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f34800d3760 0x7f348015eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:19.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.864+0000 7f34862f7640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f34800ce830 0x7f34800b2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34028/0 (socket says 172.21.15.7:34028) 2024-04-25T09:55:19.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.864+0000 7f34862f7640 1 -- 172.21.15.7:0/3097808271 learned_addr learned my addr 172.21.15.7:0/3097808271 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:19.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.864+0000 7f3485af6640 1 -- 172.21.15.7:0/3097808271 >> v1:172.21.15.55:6789/0 conn(0x7f348015f1c0 legacy=0x7f34800d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:19.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.864+0000 7f3485af6640 1 -- 172.21.15.7:0/3097808271 >> v1:172.21.15.7:6789/0 conn(0x7f34800ce830 legacy=0x7f34800b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:19.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.864+0000 7f3485af6640 1 -- 172.21.15.7:0/3097808271 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34800d1e20 con 0x7f34800d3760 2024-04-25T09:55:19.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.865+0000 7f3485af6640 1 --2- 172.21.15.7:0/3097808271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34800d3760 0x7f348015eac0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f347c0097a0 tx=0x7f347c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=271b85dde375b5f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:19.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.865+0000 7f3484af4640 1 -- 172.21.15.7:0/3097808271 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c037070 con 0x7f34800d3760 2024-04-25T09:55:19.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.865+0000 7f3484af4640 1 -- 172.21.15.7:0/3097808271 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347c032440 con 0x7f34800d3760 2024-04-25T09:55:19.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.865+0000 7f3484af4640 1 -- 172.21.15.7:0/3097808271 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c032810 con 0x7f34800d3760 2024-04-25T09:55:19.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.866+0000 7f3487d5a640 1 -- 172.21.15.7:0/3097808271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34800d3760 msgr2=0x7f348015eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:19.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.866+0000 7f3487d5a640 1 --2- 172.21.15.7:0/3097808271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34800d3760 0x7f348015eac0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f347c0097a0 tx=0x7f347c02a230 comp rx=0 tx=0).stop 2024-04-25T09:55:19.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.866+0000 7f3487d5a640 1 -- 172.21.15.7:0/3097808271 shutdown_connections 2024-04-25T09:55:19.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.866+0000 7f3487d5a640 1 --2- 172.21.15.7:0/3097808271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34800d3760 0x7f348015eac0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:19.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.866+0000 7f3487d5a640 1 -- 172.21.15.7:0/3097808271 >> 172.21.15.7:0/3097808271 conn(0x7f3480072680 msgr2=0x7f3480072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:19.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.866+0000 7f3487d5a640 1 -- 172.21.15.7:0/3097808271 shutdown_connections 2024-04-25T09:55:19.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.866+0000 7f3487d5a640 1 -- 172.21.15.7:0/3097808271 wait complete. 2024-04-25T09:55:19.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.867+0000 7f3487d5a640 1 Processor -- start 2024-04-25T09:55:19.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.867+0000 7f3487d5a640 1 -- start start 2024-04-25T09:55:19.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.868+0000 7f3487d5a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f34800ce830 0x7f34801f6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:19.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.868+0000 7f3487d5a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34800d3760 0x7f34800b3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:19.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.868+0000 7f3487d5a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f348015f1c0 0x7f34801f3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:19.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.868+0000 7f3487d5a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34800d2190 con 0x7f348015f1c0 2024-04-25T09:55:19.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.868+0000 7f3487d5a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348015f000 con 0x7f34800d3760 2024-04-25T09:55:19.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.868+0000 7f3487d5a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34800b2950 con 0x7f34800ce830 2024-04-25T09:55:19.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.868+0000 7f34862f7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f348015f1c0 0x7f34801f3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:19.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.868+0000 7f34862f7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f348015f1c0 0x7f34801f3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36414/0 (socket says 172.21.15.7:36414) 2024-04-25T09:55:19.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.868+0000 7f34862f7640 1 -- 172.21.15.7:0/1090285993 learned_addr learned my addr 172.21.15.7:0/1090285993 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:19.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.868+0000 7f34852f5640 1 --2- 172.21.15.7:0/1090285993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34800d3760 0x7f34800b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:19.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.868+0000 7f3485af6640 1 --2- 172.21.15.7:0/1090285993 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f34800ce830 0x7f34801f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:19.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.869+0000 7f3485af6640 1 -- 172.21.15.7:0/1090285993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34800d3760 msgr2=0x7f34800b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:19.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.869+0000 7f3485af6640 1 --2- 172.21.15.7:0/1090285993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34800d3760 0x7f34800b3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:19.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.869+0000 7f3485af6640 1 -- 172.21.15.7:0/1090285993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f348015f1c0 msgr2=0x7f34801f3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:19.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.869+0000 7f3485af6640 1 --2- 172.21.15.7:0/1090285993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f348015f1c0 0x7f34801f3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:19.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.869+0000 7f3485af6640 1 -- 172.21.15.7:0/1090285993 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34800b42e0 con 0x7f34800ce830 2024-04-25T09:55:19.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.869+0000 7f34852f5640 1 --2- 172.21.15.7:0/1090285993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34800d3760 0x7f34800b3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:55:19.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.869+0000 7f3485af6640 1 --2- 172.21.15.7:0/1090285993 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f34800ce830 0x7f34801f6510 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f34800d45d0 tx=0x7f347c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:19.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.869+0000 7f34767fc640 1 -- 172.21.15.7:0/1090285993 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c032e60 con 0x7f34800ce830 2024-04-25T09:55:19.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.869+0000 7f34767fc640 1 -- 172.21.15.7:0/1090285993 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347c042070 con 0x7f34800ce830 2024-04-25T09:55:19.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.869+0000 7f3487d5a640 1 -- 172.21.15.7:0/1090285993 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34800b45c0 con 0x7f34800ce830 2024-04-25T09:55:19.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.869+0000 7f34767fc640 1 -- 172.21.15.7:0/1090285993 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c037040 con 0x7f34800ce830 2024-04-25T09:55:19.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.869+0000 7f3487d5a640 1 -- 172.21.15.7:0/1090285993 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34800b4b80 con 0x7f34800ce830 2024-04-25T09:55:19.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.870+0000 7f3487d5a640 1 -- 172.21.15.7:0/1090285993 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3480068f60 con 0x7f34800ce830 2024-04-25T09:55:19.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.871+0000 7f34767fc640 1 -- 172.21.15.7:0/1090285993 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f347c030bb0 con 0x7f34800ce830 2024-04-25T09:55:19.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.871+0000 7f34767fc640 1 --2- 172.21.15.7:0/1090285993 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f346406b4d0 0x7f346406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:19.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.871+0000 7f34767fc640 1 -- 172.21.15.7:0/1090285993 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f347c0aba10 con 0x7f34800ce830 2024-04-25T09:55:19.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.871+0000 7f34852f5640 1 --2- 172.21.15.7:0/1090285993 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f346406b4d0 0x7f346406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:19.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.872+0000 7f34852f5640 1 --2- 172.21.15.7:0/1090285993 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f346406b4d0 0x7f346406d990 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f34801f3830 tx=0x7f3470009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:19.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:19.875+0000 7f34767fc640 1 -- 172.21.15.7:0/1090285993 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f347c065030 con 0x7f34800ce830 2024-04-25T09:55:20.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.056+0000 7f3487d5a640 1 -- 172.21.15.7:0/1090285993 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f348006ad60 con 0x7f34800ce830 2024-04-25T09:55:20.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.057+0000 7f34767fc640 1 -- 172.21.15.7:0/1090285993 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f347c079eb0 con 0x7f34800ce830 2024-04-25T09:55:20.060 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:55:20.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.059+0000 7f3487d5a640 1 -- 172.21.15.7:0/1090285993 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f346406b4d0 msgr2=0x7f346406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:20.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.059+0000 7f3487d5a640 1 --2- 172.21.15.7:0/1090285993 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f346406b4d0 0x7f346406d990 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f34801f3830 tx=0x7f3470009040 comp rx=0 tx=0).stop 2024-04-25T09:55:20.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.059+0000 7f3487d5a640 1 -- 172.21.15.7:0/1090285993 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f34800ce830 msgr2=0x7f34801f6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:20.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.059+0000 7f3487d5a640 1 --2- 172.21.15.7:0/1090285993 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f34800ce830 0x7f34801f6510 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f34800d45d0 tx=0x7f347c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:55:20.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.059+0000 7f3487d5a640 1 -- 172.21.15.7:0/1090285993 shutdown_connections 2024-04-25T09:55:20.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.059+0000 7f3487d5a640 1 --2- 172.21.15.7:0/1090285993 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f346406b4d0 0x7f346406d990 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:20.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.059+0000 7f3487d5a640 1 --2- 172.21.15.7:0/1090285993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f348015f1c0 0x7f34801f3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:20.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.059+0000 7f3487d5a640 1 --2- 172.21.15.7:0/1090285993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34800d3760 0x7f34800b3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:20.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.059+0000 7f3487d5a640 1 --2- 172.21.15.7:0/1090285993 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f34800ce830 0x7f34801f6510 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:20.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.059+0000 7f3487d5a640 1 -- 172.21.15.7:0/1090285993 >> 172.21.15.7:0/1090285993 conn(0x7f3480072680 msgr2=0x7f348006bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:20.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.059+0000 7f3487d5a640 1 -- 172.21.15.7:0/1090285993 shutdown_connections 2024-04-25T09:55:20.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.059+0000 7f3487d5a640 1 -- 172.21.15.7:0/1090285993 wait complete. 2024-04-25T09:55:20.073 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:55:20.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.171+0000 7efcecc46640 1 Processor -- start 2024-04-25T09:55:20.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.172+0000 7efcecc46640 1 -- start start 2024-04-25T09:55:20.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.172+0000 7efcecc46640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efce80d0aa0 0x7efce8161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:20.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.172+0000 7efcecc46640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efce81622b0 0x7efce80ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:20.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.172+0000 7efcecc46640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce815e8a0 con 0x7efce815da60 2024-04-25T09:55:20.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.172+0000 7efcecc46640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce815eb80 con 0x7efce80d0aa0 2024-04-25T09:55:20.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.172+0000 7efcecc46640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce815ee60 con 0x7efce81622b0 2024-04-25T09:55:20.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.172+0000 7efcdffff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efce80d0aa0 0x7efce8161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:20.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.173+0000 7efcdffff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efce80d0aa0 0x7efce8161d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36422/0 (socket says 172.21.15.7:36422) 2024-04-25T09:55:20.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.173+0000 7efcdffff640 1 -- 172.21.15.7:0/1964239609 learned_addr learned my addr 172.21.15.7:0/1964239609 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:20.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.173+0000 7efcdffff640 1 -- 172.21.15.7:0/1964239609 >> v2:172.21.15.55:3300/0 conn(0x7efce81622b0 msgr2=0x7efce80ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:20.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.173+0000 7efce6d9d640 1 --2- 172.21.15.7:0/1964239609 >> v2:172.21.15.55:3300/0 conn(0x7efce81622b0 0x7efce80ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:20.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.173+0000 7efcdffff640 1 --2- 172.21.15.7:0/1964239609 >> v2:172.21.15.55:3300/0 conn(0x7efce81622b0 0x7efce80ce520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:20.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.173+0000 7efcdffff640 1 -- 172.21.15.7:0/1964239609 >> v1:172.21.15.55:6789/0 conn(0x7efce815da60 legacy=0x7efce815de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:20.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.173+0000 7efcdffff640 1 -- 172.21.15.7:0/1964239609 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce8161850 con 0x7efce80d0aa0 2024-04-25T09:55:20.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.173+0000 7efcdffff640 1 --2- 172.21.15.7:0/1964239609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce80d0aa0 0x7efce8161d70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7efce8161580 tx=0x7efcd002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ba3e2c7fa76963 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:20.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.174+0000 7efce5d9b640 1 -- 172.21.15.7:0/1964239609 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd0037070 con 0x7efce80d0aa0 2024-04-25T09:55:20.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.174+0000 7efce5d9b640 1 -- 172.21.15.7:0/1964239609 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd0032440 con 0x7efce80d0aa0 2024-04-25T09:55:20.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.174+0000 7efce5d9b640 1 -- 172.21.15.7:0/1964239609 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd0032810 con 0x7efce80d0aa0 2024-04-25T09:55:20.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.174+0000 7efcecc46640 1 -- 172.21.15.7:0/1964239609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce80d0aa0 msgr2=0x7efce8161d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:20.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.174+0000 7efcecc46640 1 --2- 172.21.15.7:0/1964239609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce80d0aa0 0x7efce8161d70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7efce8161580 tx=0x7efcd002a1a0 comp rx=0 tx=0).stop 2024-04-25T09:55:20.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.174+0000 7efcecc46640 1 -- 172.21.15.7:0/1964239609 shutdown_connections 2024-04-25T09:55:20.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.174+0000 7efcecc46640 1 --2- 172.21.15.7:0/1964239609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce80d0aa0 0x7efce8161d70 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:20.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.174+0000 7efcecc46640 1 --2- 172.21.15.7:0/1964239609 >> v2:172.21.15.55:3300/0 conn(0x7efce81622b0 0x7efce80ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:20.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.174+0000 7efcecc46640 1 -- 172.21.15.7:0/1964239609 >> 172.21.15.7:0/1964239609 conn(0x7efce806bfe0 msgr2=0x7efce806c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:20.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.174+0000 7efcecc46640 1 -- 172.21.15.7:0/1964239609 shutdown_connections 2024-04-25T09:55:20.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.174+0000 7efcecc46640 1 -- 172.21.15.7:0/1964239609 wait complete. 2024-04-25T09:55:20.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.176+0000 7efcecc46640 1 Processor -- start 2024-04-25T09:55:20.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.176+0000 7efcecc46640 1 -- start start 2024-04-25T09:55:20.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.176+0000 7efcecc46640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce80d0aa0 0x7efce80aa220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:20.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.176+0000 7efcecc46640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efce815da60 0x7efce81e8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:20.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.176+0000 7efcecc46640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efce81622b0 0x7efce81f7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:20.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.176+0000 7efcecc46640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce80cebe0 con 0x7efce80d0aa0 2024-04-25T09:55:20.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.176+0000 7efcecc46640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce80cea60 con 0x7efce815da60 2024-04-25T09:55:20.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.176+0000 7efcecc46640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce80ced60 con 0x7efce81622b0 2024-04-25T09:55:20.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.176+0000 7efce659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce80d0aa0 0x7efce80aa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:20.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.176+0000 7efce659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce80d0aa0 0x7efce80aa220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36438/0 (socket says 172.21.15.7:36438) 2024-04-25T09:55:20.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.176+0000 7efce659c640 1 -- 172.21.15.7:0/2872160248 learned_addr learned my addr 172.21.15.7:0/2872160248 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:20.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.177+0000 7efce6d9d640 1 --2- 172.21.15.7:0/2872160248 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efce81622b0 0x7efce81f7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:20.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.177+0000 7efcdffff640 1 --2- 172.21.15.7:0/2872160248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efce815da60 0x7efce81e8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:20.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.177+0000 7efce659c640 1 -- 172.21.15.7:0/2872160248 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efce81622b0 msgr2=0x7efce81f7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:20.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.177+0000 7efce659c640 1 --2- 172.21.15.7:0/2872160248 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efce81622b0 0x7efce81f7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:20.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.177+0000 7efce659c640 1 -- 172.21.15.7:0/2872160248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efce815da60 msgr2=0x7efce81e8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:20.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.177+0000 7efce659c640 1 --2- 172.21.15.7:0/2872160248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efce815da60 0x7efce81e8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:20.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.177+0000 7efce659c640 1 -- 172.21.15.7:0/2872160248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce80aa760 con 0x7efce80d0aa0 2024-04-25T09:55:20.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.177+0000 7efce659c640 1 --2- 172.21.15.7:0/2872160248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce80d0aa0 0x7efce80aa220 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7efcd800b3e0 tx=0x7efcd800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:20.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.177+0000 7efcdeffd640 1 -- 172.21.15.7:0/2872160248 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd8015020 con 0x7efce80d0aa0 2024-04-25T09:55:20.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.177+0000 7efcdeffd640 1 -- 172.21.15.7:0/2872160248 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd8011850 con 0x7efce80d0aa0 2024-04-25T09:55:20.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.177+0000 7efcecc46640 1 -- 172.21.15.7:0/2872160248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce81e7ac0 con 0x7efce80d0aa0 2024-04-25T09:55:20.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.177+0000 7efcdeffd640 1 -- 172.21.15.7:0/2872160248 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd8011c40 con 0x7efce80d0aa0 2024-04-25T09:55:20.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.177+0000 7efcecc46640 1 -- 172.21.15.7:0/2872160248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce81e8080 con 0x7efce80d0aa0 2024-04-25T09:55:20.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.178+0000 7efcecc46640 1 -- 172.21.15.7:0/2872160248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce8068fd0 con 0x7efce80d0aa0 2024-04-25T09:55:20.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.179+0000 7efcdeffd640 1 -- 172.21.15.7:0/2872160248 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efcd8018020 con 0x7efce80d0aa0 2024-04-25T09:55:20.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.179+0000 7efcdeffd640 1 --2- 172.21.15.7:0/2872160248 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efcc806b4d0 0x7efcc806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:20.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.179+0000 7efcdeffd640 1 -- 172.21.15.7:0/2872160248 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7efcd808a380 con 0x7efce80d0aa0 2024-04-25T09:55:20.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.179+0000 7efcdffff640 1 --2- 172.21.15.7:0/2872160248 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efcc806b4d0 0x7efcc806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:20.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.179+0000 7efcdffff640 1 --2- 172.21.15.7:0/2872160248 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efcc806b4d0 0x7efcc806d990 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efcd0034000 tx=0x7efcd002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:20.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.183+0000 7efcdeffd640 1 -- 172.21.15.7:0/2872160248 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efcd801f020 con 0x7efce80d0aa0 2024-04-25T09:55:20.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.378+0000 7efcecc46640 1 -- 172.21.15.7:0/2872160248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7efce80b8d80 con 0x7efce80d0aa0 2024-04-25T09:55:20.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.378+0000 7efcdeffd640 1 -- 172.21.15.7:0/2872160248 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7efcd8058840 con 0x7efce80d0aa0 2024-04-25T09:55:20.381 INFO:teuthology.orchestra.run.smithi007.stderr:listed 0 entries 2024-04-25T09:55:20.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.380+0000 7efcecc46640 1 -- 172.21.15.7:0/2872160248 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efcc806b4d0 msgr2=0x7efcc806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:20.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.380+0000 7efcecc46640 1 --2- 172.21.15.7:0/2872160248 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efcc806b4d0 0x7efcc806d990 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efcd0034000 tx=0x7efcd002e000 comp rx=0 tx=0).stop 2024-04-25T09:55:20.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.380+0000 7efcecc46640 1 -- 172.21.15.7:0/2872160248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce80d0aa0 msgr2=0x7efce80aa220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:20.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.380+0000 7efcecc46640 1 --2- 172.21.15.7:0/2872160248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce80d0aa0 0x7efce80aa220 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7efcd800b3e0 tx=0x7efcd800b8a0 comp rx=0 tx=0).stop 2024-04-25T09:55:20.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.380+0000 7efcecc46640 1 -- 172.21.15.7:0/2872160248 shutdown_connections 2024-04-25T09:55:20.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.380+0000 7efcecc46640 1 --2- 172.21.15.7:0/2872160248 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efcc806b4d0 0x7efcc806d990 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:20.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.380+0000 7efcecc46640 1 --2- 172.21.15.7:0/2872160248 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efce81622b0 0x7efce81f7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:20.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.380+0000 7efcecc46640 1 --2- 172.21.15.7:0/2872160248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efce815da60 0x7efce81e8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:20.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.380+0000 7efcecc46640 1 --2- 172.21.15.7:0/2872160248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce80d0aa0 0x7efce80aa220 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:20.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.380+0000 7efcecc46640 1 -- 172.21.15.7:0/2872160248 >> 172.21.15.7:0/2872160248 conn(0x7efce806bfe0 msgr2=0x7efce8160aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:20.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.380+0000 7efcecc46640 1 -- 172.21.15.7:0/2872160248 shutdown_connections 2024-04-25T09:55:20.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.380+0000 7efcecc46640 1 -- 172.21.15.7:0/2872160248 wait complete. 2024-04-25T09:55:20.394 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-04-25T09:55:20.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:20.394 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-04-25T09:55:20.426 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T09:55:20.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:20.426 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-25T09:55:20.484 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:55:20.485 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:55:20.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.584+0000 7f9efeb68640 1 Processor -- start 2024-04-25T09:55:20.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.584+0000 7f9efeb68640 1 -- start start 2024-04-25T09:55:20.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.585+0000 7f9efeb68640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9ef80d0950 0x7f9ef8168980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:20.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.585+0000 7f9efeb68640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef8162040 con 0x7f9ef80b6b90 2024-04-25T09:55:20.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.585+0000 7f9efeb68640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef8162320 con 0x7f9ef815dc10 2024-04-25T09:55:20.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.585+0000 7f9efeb68640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef80d1d90 con 0x7f9ef80d0950 2024-04-25T09:55:20.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.585+0000 7f9ef7fff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9ef80b6b90 0x7f9ef80d0240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34034/0 (socket says 172.21.15.7:34034) 2024-04-25T09:55:20.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.585+0000 7f9ef7fff640 1 -- 172.21.15.7:0/3269258432 learned_addr learned my addr 172.21.15.7:0/3269258432 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:20.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.585+0000 7f9efd105640 1 --2- 172.21.15.7:0/3269258432 >> v2:172.21.15.55:3300/0 conn(0x7f9ef80d0950 0x7f9ef8168980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:20.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.585+0000 7f9ef77fe640 1 -- 172.21.15.7:0/3269258432 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705061637 0 0) 0x7f9ef8162040 con 0x7f9ef80b6b90 2024-04-25T09:55:20.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.585+0000 7f9ef77fe640 1 -- 172.21.15.7:0/3269258432 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ee8003520 con 0x7f9ef80b6b90 2024-04-25T09:55:20.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.585+0000 7f9ef77fe640 1 -- 172.21.15.7:0/3269258432 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3552504261 0 0) 0x7f9ee8003520 con 0x7f9ef80b6b90 2024-04-25T09:55:20.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.585+0000 7f9ef77fe640 1 -- 172.21.15.7:0/3269258432 >> v2:172.21.15.55:3300/0 conn(0x7f9ef80d0950 msgr2=0x7f9ef8168980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:20.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.585+0000 7f9ef77fe640 1 --2- 172.21.15.7:0/3269258432 >> v2:172.21.15.55:3300/0 conn(0x7f9ef80d0950 0x7f9ef8168980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:20.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.585+0000 7f9ef77fe640 1 -- 172.21.15.7:0/3269258432 >> v1:172.21.15.55:6789/0 conn(0x7f9ef815dc10 legacy=0x7f9ef81615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:20.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.585+0000 7f9ef77fe640 1 -- 172.21.15.7:0/3269258432 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef80d1fe0 con 0x7f9ef80b6b90 2024-04-25T09:55:20.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.585+0000 7f9ef77fe640 1 -- 172.21.15.7:0/3269258432 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f9ee4001670 con 0x7f9ef80b6b90 2024-04-25T09:55:20.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.585+0000 7f9ef77fe640 1 -- 172.21.15.7:0/3269258432 >> v1:172.21.15.7:6789/0 conn(0x7f9ef80b6b90 legacy=0x7f9ef80d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:20.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.585+0000 7f9ef77fe640 1 --2- 172.21.15.7:0/3269258432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ee80039b0 0x7f9ee8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:20.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.585+0000 7f9ef77fe640 1 --2- 172.21.15.7:0/3269258432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ee8004800 0x7f9ee8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:20.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.585+0000 7f9ef77fe640 1 --2- 172.21.15.7:0/3269258432 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ee80052e0 0x7f9ee800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:20.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.585+0000 7f9ef77fe640 1 -- 172.21.15.7:0/3269258432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef80d1d90 con 0x7f9ee8004800 2024-04-25T09:55:20.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.585+0000 7f9ef77fe640 1 -- 172.21.15.7:0/3269258432 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee800c1b0 con 0x7f9ee80039b0 2024-04-25T09:55:20.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.585+0000 7f9ef77fe640 1 -- 172.21.15.7:0/3269258432 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee800c3b0 con 0x7f9ee80052e0 2024-04-25T09:55:20.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.586+0000 7f9ef7fff640 1 --2- 172.21.15.7:0/3269258432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ee8004800 0x7f9ee8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:20.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.586+0000 7f9efc904640 1 --2- 172.21.15.7:0/3269258432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ee80039b0 0x7f9ee8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:20.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.586+0000 7f9efd105640 1 --2- 172.21.15.7:0/3269258432 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ee80052e0 0x7f9ee800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:20.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.586+0000 7f9ef7fff640 1 -- 172.21.15.7:0/3269258432 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ee80052e0 msgr2=0x7f9ee800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:20.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.586+0000 7f9ef7fff640 1 --2- 172.21.15.7:0/3269258432 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ee80052e0 0x7f9ee800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:20.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.586+0000 7f9ef7fff640 1 -- 172.21.15.7:0/3269258432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ee80039b0 msgr2=0x7f9ee8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:20.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.586+0000 7f9ef7fff640 1 --2- 172.21.15.7:0/3269258432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ee80039b0 0x7f9ee8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:20.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.586+0000 7f9efd105640 1 -- 172.21.15.7:0/3269258432 reap_dead start 2024-04-25T09:55:20.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.586+0000 7f9ef7fff640 1 -- 172.21.15.7:0/3269258432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee8003520 con 0x7f9ee8004800 2024-04-25T09:55:20.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.586+0000 7f9efc904640 1 --2- 172.21.15.7:0/3269258432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ee80039b0 0x7f9ee8003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:55:20.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.587+0000 7f9ef7fff640 1 --2- 172.21.15.7:0/3269258432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ee8004800 0x7f9ee8004c80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9ef806b960 tx=0x7f9ee8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32552e6d2361e96f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:20.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.587+0000 7f9ef77fe640 1 -- 172.21.15.7:0/3269258432 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4007d10 con 0x7f9ee8004800 2024-04-25T09:55:20.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.587+0000 7f9ef77fe640 1 -- 172.21.15.7:0/3269258432 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee4005ad0 con 0x7f9ee8004800 2024-04-25T09:55:20.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.587+0000 7f9ef77fe640 1 -- 172.21.15.7:0/3269258432 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4007070 con 0x7f9ee8004800 2024-04-25T09:55:20.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.587+0000 7f9efeb68640 1 -- 172.21.15.7:0/3269258432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ee8004800 msgr2=0x7f9ee8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:20.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.587+0000 7f9efeb68640 1 --2- 172.21.15.7:0/3269258432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ee8004800 0x7f9ee8004c80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9ef806b960 tx=0x7f9ee8005830 comp rx=0 tx=0).stop 2024-04-25T09:55:20.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.587+0000 7f9efeb68640 1 -- 172.21.15.7:0/3269258432 shutdown_connections 2024-04-25T09:55:20.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.587+0000 7f9efeb68640 1 --2- 172.21.15.7:0/3269258432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ee8004800 0x7f9ee8004c80 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:20.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.587+0000 7f9efeb68640 1 -- 172.21.15.7:0/3269258432 >> 172.21.15.7:0/3269258432 conn(0x7f9ef8072290 msgr2=0x7f9ef80726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:20.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.587+0000 7f9efeb68640 1 -- 172.21.15.7:0/3269258432 shutdown_connections 2024-04-25T09:55:20.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.587+0000 7f9efeb68640 1 -- 172.21.15.7:0/3269258432 wait complete. 2024-04-25T09:55:20.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.588+0000 7f9efeb68640 1 Processor -- start 2024-04-25T09:55:20.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.589+0000 7f9efeb68640 1 -- start start 2024-04-25T09:55:20.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.589+0000 7f9efeb68640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ee8004800 0x7f9ef814f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:20.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.589+0000 7f9efeb68640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ef80b5110 0x7f9ef80b5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:20.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.589+0000 7f9efeb68640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ef80b5ad0 0x7f9ef80d2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:20.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.589+0000 7f9efeb68640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef80d03c0 con 0x7f9ef80b5ad0 2024-04-25T09:55:20.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.589+0000 7f9efeb68640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef80d0240 con 0x7f9ee8004800 2024-04-25T09:55:20.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.589+0000 7f9efeb68640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef80d0540 con 0x7f9ef80b5110 2024-04-25T09:55:20.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.589+0000 7f9efd105640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ef80b5ad0 0x7f9ef80d2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:20.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.590+0000 7f9efd105640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ef80b5ad0 0x7f9ef80d2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36456/0 (socket says 172.21.15.7:36456) 2024-04-25T09:55:20.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.590+0000 7f9efd105640 1 -- 172.21.15.7:0/727950762 learned_addr learned my addr 172.21.15.7:0/727950762 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:20.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.590+0000 7f9efc904640 1 --2- 172.21.15.7:0/727950762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ee8004800 0x7f9ef814f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:20.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.590+0000 7f9ef7fff640 1 --2- 172.21.15.7:0/727950762 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ef80b5110 0x7f9ef80b5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:20.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.590+0000 7f9efd105640 1 -- 172.21.15.7:0/727950762 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ef80b5110 msgr2=0x7f9ef80b5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:20.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.590+0000 7f9efd105640 1 --2- 172.21.15.7:0/727950762 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ef80b5110 0x7f9ef80b5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:20.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.590+0000 7f9efd105640 1 -- 172.21.15.7:0/727950762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ee8004800 msgr2=0x7f9ef814f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:20.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.590+0000 7f9efd105640 1 --2- 172.21.15.7:0/727950762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ee8004800 0x7f9ef814f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:20.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.590+0000 7f9efd105640 1 -- 172.21.15.7:0/727950762 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef814e210 con 0x7f9ef80b5ad0 2024-04-25T09:55:20.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.590+0000 7f9ef7fff640 1 --2- 172.21.15.7:0/727950762 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ef80b5110 0x7f9ef80b5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:20.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.590+0000 7f9efd105640 1 --2- 172.21.15.7:0/727950762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ef80b5ad0 0x7f9ef80d2500 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9ef80d0dc0 tx=0x7f9ef0011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:20.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.590+0000 7f9ef57fa640 1 -- 172.21.15.7:0/727950762 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef000fbc0 con 0x7f9ef80b5ad0 2024-04-25T09:55:20.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.590+0000 7f9ef57fa640 1 -- 172.21.15.7:0/727950762 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef000fd60 con 0x7f9ef80b5ad0 2024-04-25T09:55:20.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.590+0000 7f9ef57fa640 1 -- 172.21.15.7:0/727950762 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef0015670 con 0x7f9ef80b5ad0 2024-04-25T09:55:20.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.590+0000 7f9efeb68640 1 -- 172.21.15.7:0/727950762 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef814e4f0 con 0x7f9ef80b5ad0 2024-04-25T09:55:20.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.590+0000 7f9efeb68640 1 -- 172.21.15.7:0/727950762 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef814eab0 con 0x7f9ef80b5ad0 2024-04-25T09:55:20.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.591+0000 7f9efeb68640 1 -- 172.21.15.7:0/727950762 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef8068fd0 con 0x7f9ef80b5ad0 2024-04-25T09:55:20.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.592+0000 7f9ef57fa640 1 -- 172.21.15.7:0/727950762 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9ef0015810 con 0x7f9ef80b5ad0 2024-04-25T09:55:20.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.592+0000 7f9ef57fa640 1 --2- 172.21.15.7:0/727950762 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9edc06b4d0 0x7f9edc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:20.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.592+0000 7f9ef57fa640 1 -- 172.21.15.7:0/727950762 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f9ef008b3a0 con 0x7f9ef80b5ad0 2024-04-25T09:55:20.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.592+0000 7f9efc904640 1 --2- 172.21.15.7:0/727950762 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9edc06b4d0 0x7f9edc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:20.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.593+0000 7f9efc904640 1 --2- 172.21.15.7:0/727950762 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9edc06b4d0 0x7f9edc06d990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9eec000c00 tx=0x7f9eec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:20.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.596+0000 7f9ef57fa640 1 -- 172.21.15.7:0/727950762 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9ef0019030 con 0x7f9ef80b5ad0 2024-04-25T09:55:20.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.814+0000 7f9efeb68640 1 -- 172.21.15.7:0/727950762 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ef8072920 con 0x7f9ef80b5ad0 2024-04-25T09:55:20.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.815+0000 7f9ef57fa640 1 -- 172.21.15.7:0/727950762 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4928 (secure 0 0 0) 0x7f9ef0010040 con 0x7f9ef80b5ad0 2024-04-25T09:55:20.818 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:20.818 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1968579214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1968579214},{"type":"v1","addr":"172.21.15.7:6837","nonce":1968579214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3479570567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3479570567},{"type":"v1","addr":"172.21.15.55:6834","nonce":3479570567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/2289657027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2289657027},{"type":"v1","addr":"172.21.15.7:6836","nonce":2289657027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:54:27.558601+0000","modified":"2024-04-25T09:54:43.635854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/3779228372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3779228372},{"type":"v1","addr":"172.21.15.55:6835","nonce":3779228372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:55:20.818 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 8 2024-04-25T09:55:20.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.817+0000 7f9efeb68640 1 -- 172.21.15.7:0/727950762 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9edc06b4d0 msgr2=0x7f9edc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:20.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.817+0000 7f9efeb68640 1 --2- 172.21.15.7:0/727950762 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9edc06b4d0 0x7f9edc06d990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9eec000c00 tx=0x7f9eec009040 comp rx=0 tx=0).stop 2024-04-25T09:55:20.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.817+0000 7f9efeb68640 1 -- 172.21.15.7:0/727950762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ef80b5ad0 msgr2=0x7f9ef80d2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:20.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.817+0000 7f9efeb68640 1 --2- 172.21.15.7:0/727950762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ef80b5ad0 0x7f9ef80d2500 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9ef80d0dc0 tx=0x7f9ef0011f10 comp rx=0 tx=0).stop 2024-04-25T09:55:20.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.817+0000 7f9efeb68640 1 -- 172.21.15.7:0/727950762 shutdown_connections 2024-04-25T09:55:20.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.817+0000 7f9efeb68640 1 --2- 172.21.15.7:0/727950762 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9edc06b4d0 0x7f9edc06d990 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:20.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.817+0000 7f9efeb68640 1 --2- 172.21.15.7:0/727950762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ef80b5ad0 0x7f9ef80d2500 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:20.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.817+0000 7f9efeb68640 1 --2- 172.21.15.7:0/727950762 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ef80b5110 0x7f9ef80b5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:20.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.817+0000 7f9efeb68640 1 --2- 172.21.15.7:0/727950762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ee8004800 0x7f9ef814f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:20.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.817+0000 7f9efeb68640 1 -- 172.21.15.7:0/727950762 >> 172.21.15.7:0/727950762 conn(0x7f9ef8072290 msgr2=0x7f9ef80c85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:20.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.817+0000 7f9efeb68640 1 -- 172.21.15.7:0/727950762 shutdown_connections 2024-04-25T09:55:20.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.817+0000 7f9efeb68640 1 -- 172.21.15.7:0/727950762 wait complete. 2024-04-25T09:55:20.831 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:55:20.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.929+0000 7fa48478b640 1 Processor -- start 2024-04-25T09:55:20.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.929+0000 7fa48478b640 1 -- start start 2024-04-25T09:55:20.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.930+0000 7fa48478b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa47c071ed0 0x7fa47c0ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:20.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.930+0000 7fa48478b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa47c0ce890 0x7fa47c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:20.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.930+0000 7fa48478b640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa47c15bdc0 con 0x7fa47c1529e0 2024-04-25T09:55:20.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.930+0000 7fa48478b640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa47c0ced00 con 0x7fa47c071ed0 2024-04-25T09:55:20.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.930+0000 7fa48478b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c0b2340 con 0x7fa47c0ce890 2024-04-25T09:55:20.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.930+0000 7fa481d26640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa47c071ed0 0x7fa47c0ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:20.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.930+0000 7fa481d26640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa47c071ed0 0x7fa47c0ce350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36462/0 (socket says 172.21.15.7:36462) 2024-04-25T09:55:20.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.930+0000 7fa481d26640 1 -- 172.21.15.7:0/1926629003 learned_addr learned my addr 172.21.15.7:0/1926629003 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:20.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.930+0000 7fa482527640 1 --1- 172.21.15.7:0/1926629003 >> v1:172.21.15.7:6789/0 conn(0x7fa47c1529e0 0x7fa47c0c5ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34036/0 (socket says 172.21.15.7:34036) 2024-04-25T09:55:20.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.930+0000 7fa481d26640 1 -- 172.21.15.7:0/1926629003 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa47c0ce890 msgr2=0x7fa47c06d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:20.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.930+0000 7fa481d26640 1 --2- 172.21.15.7:0/1926629003 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa47c0ce890 0x7fa47c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:20.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.930+0000 7fa481d26640 1 -- 172.21.15.7:0/1926629003 >> v1:172.21.15.7:6789/0 conn(0x7fa47c1529e0 legacy=0x7fa47c0c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:20.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.930+0000 7fa481d26640 1 -- 172.21.15.7:0/1926629003 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47c15c060 con 0x7fa47c071ed0 2024-04-25T09:55:20.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.931+0000 7fa481d26640 1 --2- 172.21.15.7:0/1926629003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa47c071ed0 0x7fa47c0ce350 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa46c009870 tx=0x7fa46c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f85dedcfdbedb0d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:20.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.931+0000 7fa481525640 1 -- 172.21.15.7:0/1926629003 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c037070 con 0x7fa47c071ed0 2024-04-25T09:55:20.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.931+0000 7fa481525640 1 -- 172.21.15.7:0/1926629003 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46c032440 con 0x7fa47c071ed0 2024-04-25T09:55:20.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.931+0000 7fa481525640 1 -- 172.21.15.7:0/1926629003 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c032810 con 0x7fa47c071ed0 2024-04-25T09:55:20.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.932+0000 7fa48478b640 1 -- 172.21.15.7:0/1926629003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa47c071ed0 msgr2=0x7fa47c0ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:20.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.932+0000 7fa48478b640 1 --2- 172.21.15.7:0/1926629003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa47c071ed0 0x7fa47c0ce350 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa46c009870 tx=0x7fa46c02a270 comp rx=0 tx=0).stop 2024-04-25T09:55:20.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.932+0000 7fa48478b640 1 -- 172.21.15.7:0/1926629003 shutdown_connections 2024-04-25T09:55:20.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.932+0000 7fa48478b640 1 --2- 172.21.15.7:0/1926629003 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa47c0ce890 0x7fa47c06d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:20.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.932+0000 7fa48478b640 1 --2- 172.21.15.7:0/1926629003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa47c071ed0 0x7fa47c0ce350 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:20.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.932+0000 7fa48478b640 1 -- 172.21.15.7:0/1926629003 >> 172.21.15.7:0/1926629003 conn(0x7fa47c071150 msgr2=0x7fa47c071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:20.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.932+0000 7fa48478b640 1 -- 172.21.15.7:0/1926629003 shutdown_connections 2024-04-25T09:55:20.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.932+0000 7fa48478b640 1 -- 172.21.15.7:0/1926629003 wait complete. 2024-04-25T09:55:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.933+0000 7fa48478b640 1 Processor -- start 2024-04-25T09:55:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.933+0000 7fa48478b640 1 -- start start 2024-04-25T09:55:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.934+0000 7fa48478b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa47c071ed0 0x7fa47c0b3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.934+0000 7fa48478b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa47c0ce890 0x7fa47c157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.934+0000 7fa48478b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa47c142bc0 0x7fa47c157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.934+0000 7fa48478b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c15c900 con 0x7fa47c142bc0 2024-04-25T09:55:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.934+0000 7fa48478b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c15c620 con 0x7fa47c071ed0 2024-04-25T09:55:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.934+0000 7fa48478b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c0c65e0 con 0x7fa47c0ce890 2024-04-25T09:55:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.934+0000 7fa482d28640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa47c142bc0 0x7fa47c157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.934+0000 7fa482d28640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa47c142bc0 0x7fa47c157e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36464/0 (socket says 172.21.15.7:36464) 2024-04-25T09:55:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.934+0000 7fa482d28640 1 -- 172.21.15.7:0/2685325438 learned_addr learned my addr 172.21.15.7:0/2685325438 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.934+0000 7fa481d26640 1 --2- 172.21.15.7:0/2685325438 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa47c0ce890 0x7fa47c157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.934+0000 7fa482527640 1 --2- 172.21.15.7:0/2685325438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa47c071ed0 0x7fa47c0b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.934+0000 7fa482d28640 1 -- 172.21.15.7:0/2685325438 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa47c0ce890 msgr2=0x7fa47c157950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.934+0000 7fa482d28640 1 --2- 172.21.15.7:0/2685325438 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa47c0ce890 0x7fa47c157950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.934+0000 7fa482d28640 1 -- 172.21.15.7:0/2685325438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa47c071ed0 msgr2=0x7fa47c0b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.934+0000 7fa482d28640 1 --2- 172.21.15.7:0/2685325438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa47c071ed0 0x7fa47c0b3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.934+0000 7fa482d28640 1 -- 172.21.15.7:0/2685325438 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47c15dba0 con 0x7fa47c142bc0 2024-04-25T09:55:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.934+0000 7fa482d28640 1 --2- 172.21.15.7:0/2685325438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa47c142bc0 0x7fa47c157e90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa47400b9a0 tx=0x7fa47400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.934+0000 7fa472ffd640 1 -- 172.21.15.7:0/2685325438 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa474019070 con 0x7fa47c142bc0 2024-04-25T09:55:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.935+0000 7fa472ffd640 1 -- 172.21.15.7:0/2685325438 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47400cbc0 con 0x7fa47c142bc0 2024-04-25T09:55:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.935+0000 7fa48478b640 1 -- 172.21.15.7:0/2685325438 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa47c15de80 con 0x7fa47c142bc0 2024-04-25T09:55:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.935+0000 7fa472ffd640 1 -- 172.21.15.7:0/2685325438 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa474014440 con 0x7fa47c142bc0 2024-04-25T09:55:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.935+0000 7fa48478b640 1 -- 172.21.15.7:0/2685325438 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa47c0b3eb0 con 0x7fa47c142bc0 2024-04-25T09:55:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.936+0000 7fa48478b640 1 -- 172.21.15.7:0/2685325438 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa47c068fd0 con 0x7fa47c142bc0 2024-04-25T09:55:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.936+0000 7fa472ffd640 1 -- 172.21.15.7:0/2685325438 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa47401c070 con 0x7fa47c142bc0 2024-04-25T09:55:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.936+0000 7fa472ffd640 1 --2- 172.21.15.7:0/2685325438 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa46006b500 0x7fa46006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.936+0000 7fa472ffd640 1 -- 172.21.15.7:0/2685325438 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fa47408a310 con 0x7fa47c142bc0 2024-04-25T09:55:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.936+0000 7fa482527640 1 --2- 172.21.15.7:0/2685325438 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa46006b500 0x7fa46006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.937+0000 7fa482527640 1 --2- 172.21.15.7:0/2685325438 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa46006b500 0x7fa46006d9c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa478000f60 tx=0x7fa478007cc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:20.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:20.941+0000 7fa472ffd640 1 -- 172.21.15.7:0/2685325438 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa474058d90 con 0x7fa47c142bc0 2024-04-25T09:55:21.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.120+0000 7fa48478b640 1 -- 172.21.15.7:0/2685325438 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa47c152070 con 0x7fa47c142bc0 2024-04-25T09:55:21.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.121+0000 7fa472ffd640 1 -- 172.21.15.7:0/2685325438 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18807 (secure 0 0 0) 0x7fa474058690 con 0x7fa47c142bc0 2024-04-25T09:55:21.124 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:21.125 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:55:09.591504+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:54:26.011833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:54:26.535536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:54:30.264996+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:55:21.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.123+0000 7fa48478b640 1 -- 172.21.15.7:0/2685325438 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa46006b500 msgr2=0x7fa46006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:21.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.123+0000 7fa48478b640 1 --2- 172.21.15.7:0/2685325438 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa46006b500 0x7fa46006d9c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa478000f60 tx=0x7fa478007cc0 comp rx=0 tx=0).stop 2024-04-25T09:55:21.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.123+0000 7fa48478b640 1 -- 172.21.15.7:0/2685325438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa47c142bc0 msgr2=0x7fa47c157e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:21.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.123+0000 7fa48478b640 1 --2- 172.21.15.7:0/2685325438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa47c142bc0 0x7fa47c157e90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa47400b9a0 tx=0x7fa47400be60 comp rx=0 tx=0).stop 2024-04-25T09:55:21.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.123+0000 7fa48478b640 1 -- 172.21.15.7:0/2685325438 shutdown_connections 2024-04-25T09:55:21.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.123+0000 7fa48478b640 1 --2- 172.21.15.7:0/2685325438 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa46006b500 0x7fa46006d9c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:21.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.123+0000 7fa48478b640 1 --2- 172.21.15.7:0/2685325438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa47c142bc0 0x7fa47c157e90 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:21.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.123+0000 7fa48478b640 1 --2- 172.21.15.7:0/2685325438 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa47c0ce890 0x7fa47c157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:21.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.123+0000 7fa48478b640 1 --2- 172.21.15.7:0/2685325438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa47c071ed0 0x7fa47c0b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:21.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.123+0000 7fa48478b640 1 -- 172.21.15.7:0/2685325438 >> 172.21.15.7:0/2685325438 conn(0x7fa47c071150 msgr2=0x7fa47c0c4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:21.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.123+0000 7fa48478b640 1 -- 172.21.15.7:0/2685325438 shutdown_connections 2024-04-25T09:55:21.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.123+0000 7fa48478b640 1 -- 172.21.15.7:0/2685325438 wait complete. 2024-04-25T09:55:21.137 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:54:26.011833+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:54:26.535536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:54:30.264996+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:55:21.138 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:55:21.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.238+0000 7efe68858640 1 Processor -- start 2024-04-25T09:55:21.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.238+0000 7efe68858640 1 -- start start 2024-04-25T09:55:21.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.239+0000 7efe68858640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efe6415b7a0 0x7efe640b1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:21.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.239+0000 7efe68858640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efe640cd580 0x7efe6406afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:21.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.239+0000 7efe68858640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe640b1e40 con 0x7efe6406ab60 2024-04-25T09:55:21.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.239+0000 7efe68858640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe6406b500 con 0x7efe640cd580 2024-04-25T09:55:21.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.239+0000 7efe68858640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe640d13e0 con 0x7efe6415b7a0 2024-04-25T09:55:21.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.240+0000 7efe62d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efe640cd580 0x7efe6406afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:21.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.240+0000 7efe6259c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efe6415b7a0 0x7efe640b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:21.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.240+0000 7efe61d9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7efe6406ab60 0x7efe6415f430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:44712/0 (socket says 172.21.15.7:44712) 2024-04-25T09:55:21.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.240+0000 7efe61d9b640 1 -- 172.21.15.7:0/3429045164 learned_addr learned my addr 172.21.15.7:0/3429045164 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:21.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.240+0000 7efe6159a640 1 -- 172.21.15.7:0/3429045164 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1485074300 0 0) 0x7efe4c001110 con 0x7efe6406ab60 2024-04-25T09:55:21.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.240+0000 7efe6259c640 1 -- 172.21.15.7:0/3429045164 >> v2:172.21.15.55:3300/0 conn(0x7efe640cd580 msgr2=0x7efe6406afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:21.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.240+0000 7efe6259c640 1 --2- 172.21.15.7:0/3429045164 >> v2:172.21.15.55:3300/0 conn(0x7efe640cd580 0x7efe6406afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:21.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.240+0000 7efe6259c640 1 -- 172.21.15.7:0/3429045164 >> v1:172.21.15.55:6789/0 conn(0x7efe6406ab60 legacy=0x7efe6415f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:21.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.240+0000 7efe6259c640 1 -- 172.21.15.7:0/3429045164 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe640d0860 con 0x7efe6415b7a0 2024-04-25T09:55:21.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.240+0000 7efe62d9d640 1 --2- 172.21.15.7:0/3429045164 >> v2:172.21.15.55:3300/0 conn(0x7efe640cd580 0x7efe6406afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:55:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.241+0000 7efe6259c640 1 --2- 172.21.15.7:0/3429045164 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efe6415b7a0 0x7efe640b1900 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efe5c0097a0 tx=0x7efe5c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21c07a4e4039ea77 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.241+0000 7efe6159a640 1 -- 172.21.15.7:0/3429045164 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5c037070 con 0x7efe6415b7a0 2024-04-25T09:55:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.241+0000 7efe6159a640 1 -- 172.21.15.7:0/3429045164 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe5c032440 con 0x7efe6415b7a0 2024-04-25T09:55:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.241+0000 7efe6159a640 1 -- 172.21.15.7:0/3429045164 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5c032810 con 0x7efe6415b7a0 2024-04-25T09:55:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.241+0000 7efe68858640 1 -- 172.21.15.7:0/3429045164 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efe6415b7a0 msgr2=0x7efe640b1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.241+0000 7efe68858640 1 --2- 172.21.15.7:0/3429045164 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efe6415b7a0 0x7efe640b1900 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efe5c0097a0 tx=0x7efe5c02a180 comp rx=0 tx=0).stop 2024-04-25T09:55:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.242+0000 7efe68858640 1 -- 172.21.15.7:0/3429045164 shutdown_connections 2024-04-25T09:55:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.242+0000 7efe68858640 1 --2- 172.21.15.7:0/3429045164 >> v2:172.21.15.55:3300/0 conn(0x7efe640cd580 0x7efe6406afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.242+0000 7efe68858640 1 --2- 172.21.15.7:0/3429045164 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efe6415b7a0 0x7efe640b1900 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.242+0000 7efe68858640 1 -- 172.21.15.7:0/3429045164 >> 172.21.15.7:0/3429045164 conn(0x7efe640725e0 msgr2=0x7efe640999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.242+0000 7efe68858640 1 -- 172.21.15.7:0/3429045164 shutdown_connections 2024-04-25T09:55:21.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.242+0000 7efe68858640 1 -- 172.21.15.7:0/3429045164 wait complete. 2024-04-25T09:55:21.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.243+0000 7efe68858640 1 Processor -- start 2024-04-25T09:55:21.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.243+0000 7efe68858640 1 -- start start 2024-04-25T09:55:21.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.244+0000 7efe68858640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe6406ab60 0x7efe640b5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:21.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.244+0000 7efe68858640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe640cd580 0x7efe6414c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:21.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.244+0000 7efe68858640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efe6415b7a0 0x7efe640c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:21.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.244+0000 7efe68858640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe640d1100 con 0x7efe6406ab60 2024-04-25T09:55:21.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.244+0000 7efe68858640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe640d0e20 con 0x7efe640cd580 2024-04-25T09:55:21.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.244+0000 7efe68858640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe640d04f0 con 0x7efe6415b7a0 2024-04-25T09:55:21.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.244+0000 7efe6259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe6406ab60 0x7efe640b5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:21.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.244+0000 7efe6259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe6406ab60 0x7efe640b5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36468/0 (socket says 172.21.15.7:36468) 2024-04-25T09:55:21.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.244+0000 7efe6259c640 1 -- 172.21.15.7:0/1452350286 learned_addr learned my addr 172.21.15.7:0/1452350286 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:21.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.244+0000 7efe61d9b640 1 --2- 172.21.15.7:0/1452350286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe640cd580 0x7efe6414c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:21.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.244+0000 7efe6259c640 1 -- 172.21.15.7:0/1452350286 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efe6415b7a0 msgr2=0x7efe640c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:21.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.244+0000 7efe6259c640 1 --2- 172.21.15.7:0/1452350286 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efe6415b7a0 0x7efe640c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:21.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.244+0000 7efe6259c640 1 -- 172.21.15.7:0/1452350286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe640cd580 msgr2=0x7efe6414c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:21.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.244+0000 7efe6259c640 1 --2- 172.21.15.7:0/1452350286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe640cd580 0x7efe6414c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:21.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.244+0000 7efe6259c640 1 -- 172.21.15.7:0/1452350286 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe640ad910 con 0x7efe6406ab60 2024-04-25T09:55:21.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.244+0000 7efe61d9b640 1 --2- 172.21.15.7:0/1452350286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe640cd580 0x7efe6414c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:21.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.244+0000 7efe6259c640 1 --2- 172.21.15.7:0/1452350286 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe6406ab60 0x7efe640b5e50 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7efe5c035040 tx=0x7efe5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:21.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.244+0000 7efe5affd640 1 -- 172.21.15.7:0/1452350286 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5c037040 con 0x7efe6406ab60 2024-04-25T09:55:21.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.245+0000 7efe5affd640 1 -- 172.21.15.7:0/1452350286 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe5c03b4f0 con 0x7efe6406ab60 2024-04-25T09:55:21.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.245+0000 7efe68858640 1 -- 172.21.15.7:0/1452350286 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe640adbf0 con 0x7efe6406ab60 2024-04-25T09:55:21.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.245+0000 7efe5affd640 1 -- 172.21.15.7:0/1452350286 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5c03b900 con 0x7efe6406ab60 2024-04-25T09:55:21.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.245+0000 7efe68858640 1 -- 172.21.15.7:0/1452350286 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe640ae1b0 con 0x7efe6406ab60 2024-04-25T09:55:21.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.246+0000 7efe68858640 1 -- 172.21.15.7:0/1452350286 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe64068f60 con 0x7efe6406ab60 2024-04-25T09:55:21.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.246+0000 7efe5affd640 1 -- 172.21.15.7:0/1452350286 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efe5c044020 con 0x7efe6406ab60 2024-04-25T09:55:21.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.247+0000 7efe5affd640 1 --2- 172.21.15.7:0/1452350286 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efe4406b4d0 0x7efe4406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:21.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.247+0000 7efe61d9b640 1 --2- 172.21.15.7:0/1452350286 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efe4406b4d0 0x7efe4406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:21.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.247+0000 7efe5affd640 1 -- 172.21.15.7:0/1452350286 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7efe5c0aa7e0 con 0x7efe6406ab60 2024-04-25T09:55:21.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.247+0000 7efe61d9b640 1 --2- 172.21.15.7:0/1452350286 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efe4406b4d0 0x7efe4406d990 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efe640cd0c0 tx=0x7efe4c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:21.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.251+0000 7efe5affd640 1 -- 172.21.15.7:0/1452350286 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efe5c079260 con 0x7efe6406ab60 2024-04-25T09:55:21.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.430+0000 7efe68858640 1 -- 172.21.15.7:0/1452350286 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efe6415d6d0 con 0x7efe6406ab60 2024-04-25T09:55:21.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.431+0000 7efe5affd640 1 -- 172.21.15.7:0/1452350286 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7efe5c078b60 con 0x7efe6406ab60 2024-04-25T09:55:21.434 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T09:55:21.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.432+0000 7efe68858640 1 -- 172.21.15.7:0/1452350286 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efe4406b4d0 msgr2=0x7efe4406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:21.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.432+0000 7efe68858640 1 --2- 172.21.15.7:0/1452350286 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efe4406b4d0 0x7efe4406d990 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efe640cd0c0 tx=0x7efe4c009040 comp rx=0 tx=0).stop 2024-04-25T09:55:21.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.432+0000 7efe68858640 1 -- 172.21.15.7:0/1452350286 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe6406ab60 msgr2=0x7efe640b5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:21.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.432+0000 7efe68858640 1 --2- 172.21.15.7:0/1452350286 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe6406ab60 0x7efe640b5e50 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7efe5c035040 tx=0x7efe5c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:55:21.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.433+0000 7efe68858640 1 -- 172.21.15.7:0/1452350286 shutdown_connections 2024-04-25T09:55:21.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.433+0000 7efe68858640 1 --2- 172.21.15.7:0/1452350286 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efe4406b4d0 0x7efe4406d990 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:21.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.433+0000 7efe68858640 1 --2- 172.21.15.7:0/1452350286 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efe6415b7a0 0x7efe640c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:21.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.433+0000 7efe68858640 1 --2- 172.21.15.7:0/1452350286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe640cd580 0x7efe6414c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:21.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.433+0000 7efe68858640 1 --2- 172.21.15.7:0/1452350286 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe6406ab60 0x7efe640b5e50 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:21.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.433+0000 7efe68858640 1 -- 172.21.15.7:0/1452350286 >> 172.21.15.7:0/1452350286 conn(0x7efe640725e0 msgr2=0x7efe6415bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:21.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.433+0000 7efe68858640 1 -- 172.21.15.7:0/1452350286 shutdown_connections 2024-04-25T09:55:21.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.433+0000 7efe68858640 1 -- 172.21.15.7:0/1452350286 wait complete. 2024-04-25T09:55:21.447 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:55:21.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.547+0000 7f141723f640 1 Processor -- start 2024-04-25T09:55:21.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.547+0000 7f141723f640 1 -- start start 2024-04-25T09:55:21.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.548+0000 7f141723f640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f141015f1c0 0x7f141015eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:21.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.548+0000 7f141723f640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14100ced10 con 0x7f14100ce830 2024-04-25T09:55:21.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.548+0000 7f141723f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14100d1b40 con 0x7f14100d3760 2024-04-25T09:55:21.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.548+0000 7f141723f640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14100ce380 con 0x7f141015f1c0 2024-04-25T09:55:21.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.548+0000 7f140ffff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f141015f1c0 0x7f141015eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:21.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.548+0000 7f14157dc640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f14100ce830 0x7f14100b2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34044/0 (socket says 172.21.15.7:34044) 2024-04-25T09:55:21.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.548+0000 7f14157dc640 1 -- 172.21.15.7:0/3506442884 learned_addr learned my addr 172.21.15.7:0/3506442884 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:21.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.549+0000 7f140ffff640 1 -- 172.21.15.7:0/3506442884 >> v1:172.21.15.55:6789/0 conn(0x7f14100d3760 legacy=0x7f14100d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:21.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.549+0000 7f140ffff640 1 -- 172.21.15.7:0/3506442884 >> v1:172.21.15.7:6789/0 conn(0x7f14100ce830 legacy=0x7f14100b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:21.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.549+0000 7f140ffff640 1 -- 172.21.15.7:0/3506442884 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14100d1e20 con 0x7f141015f1c0 2024-04-25T09:55:21.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.549+0000 7f140f7fe640 1 -- 172.21.15.7:0/3506442884 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 425275837 0 0) 0x7f14100ced10 con 0x7f14100ce830 2024-04-25T09:55:21.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.549+0000 7f140ffff640 1 --2- 172.21.15.7:0/3506442884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f141015f1c0 0x7f141015eac0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f14040097a0 tx=0x7f140402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed9c3da7a2d269c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:21.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.549+0000 7f140f7fe640 1 -- 172.21.15.7:0/3506442884 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1404037070 con 0x7f141015f1c0 2024-04-25T09:55:21.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.550+0000 7f140f7fe640 1 -- 172.21.15.7:0/3506442884 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1404032440 con 0x7f141015f1c0 2024-04-25T09:55:21.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.550+0000 7f140f7fe640 1 -- 172.21.15.7:0/3506442884 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1404032810 con 0x7f141015f1c0 2024-04-25T09:55:21.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.550+0000 7f141723f640 1 -- 172.21.15.7:0/3506442884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f141015f1c0 msgr2=0x7f141015eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:21.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.550+0000 7f141723f640 1 --2- 172.21.15.7:0/3506442884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f141015f1c0 0x7f141015eac0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f14040097a0 tx=0x7f140402a230 comp rx=0 tx=0).stop 2024-04-25T09:55:21.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.550+0000 7f141723f640 1 -- 172.21.15.7:0/3506442884 shutdown_connections 2024-04-25T09:55:21.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.550+0000 7f141723f640 1 --2- 172.21.15.7:0/3506442884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f141015f1c0 0x7f141015eac0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:21.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.550+0000 7f141723f640 1 -- 172.21.15.7:0/3506442884 >> 172.21.15.7:0/3506442884 conn(0x7f1410072680 msgr2=0x7f1410072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:21.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.550+0000 7f141723f640 1 -- 172.21.15.7:0/3506442884 shutdown_connections 2024-04-25T09:55:21.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.550+0000 7f141723f640 1 -- 172.21.15.7:0/3506442884 wait complete. 2024-04-25T09:55:21.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.551+0000 7f141723f640 1 Processor -- start 2024-04-25T09:55:21.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.551+0000 7f141723f640 1 -- start start 2024-04-25T09:55:21.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.552+0000 7f141723f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14100ce830 0x7f141014f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:21.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.552+0000 7f141723f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14100d3760 0x7f14100cc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:21.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.552+0000 7f141723f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f141015f1c0 0x7f14100cb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:21.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.552+0000 7f141723f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14100d2190 con 0x7f14100ce830 2024-04-25T09:55:21.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.552+0000 7f141723f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141015f000 con 0x7f14100d3760 2024-04-25T09:55:21.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.552+0000 7f141723f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14100b2950 con 0x7f141015f1c0 2024-04-25T09:55:21.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.552+0000 7f1414fdb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14100ce830 0x7f141014f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:21.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.552+0000 7f1414fdb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14100ce830 0x7f141014f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36484/0 (socket says 172.21.15.7:36484) 2024-04-25T09:55:21.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.552+0000 7f1414fdb640 1 -- 172.21.15.7:0/3842324324 learned_addr learned my addr 172.21.15.7:0/3842324324 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:21.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.552+0000 7f140ffff640 1 --2- 172.21.15.7:0/3842324324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14100d3760 0x7f14100cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:21.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.553+0000 7f14157dc640 1 --2- 172.21.15.7:0/3842324324 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f141015f1c0 0x7f14100cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:21.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.553+0000 7f1414fdb640 1 -- 172.21.15.7:0/3842324324 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f141015f1c0 msgr2=0x7f14100cb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:21.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.553+0000 7f1414fdb640 1 --2- 172.21.15.7:0/3842324324 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f141015f1c0 0x7f14100cb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:21.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.553+0000 7f1414fdb640 1 -- 172.21.15.7:0/3842324324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14100d3760 msgr2=0x7f14100cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:21.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.553+0000 7f1414fdb640 1 --2- 172.21.15.7:0/3842324324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14100d3760 0x7f14100cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:21.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.553+0000 7f1414fdb640 1 -- 172.21.15.7:0/3842324324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14101e76e0 con 0x7f14100ce830 2024-04-25T09:55:21.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.553+0000 7f140ffff640 1 --2- 172.21.15.7:0/3842324324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14100d3760 0x7f14100cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:21.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.553+0000 7f1414fdb640 1 --2- 172.21.15.7:0/3842324324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14100ce830 0x7f141014f8e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f140800c870 tx=0x7f140800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:21.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.553+0000 7f140d7fa640 1 -- 172.21.15.7:0/3842324324 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1408003b70 con 0x7f14100ce830 2024-04-25T09:55:21.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.553+0000 7f140d7fa640 1 -- 172.21.15.7:0/3842324324 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1408003d30 con 0x7f14100ce830 2024-04-25T09:55:21.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.553+0000 7f141723f640 1 -- 172.21.15.7:0/3842324324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14101e79c0 con 0x7f14100ce830 2024-04-25T09:55:21.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.553+0000 7f140d7fa640 1 -- 172.21.15.7:0/3842324324 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140800aa90 con 0x7f14100ce830 2024-04-25T09:55:21.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.553+0000 7f141723f640 1 -- 172.21.15.7:0/3842324324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14101e7ca0 con 0x7f14100ce830 2024-04-25T09:55:21.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.554+0000 7f141723f640 1 -- 172.21.15.7:0/3842324324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1410068f60 con 0x7f14100ce830 2024-04-25T09:55:21.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.555+0000 7f140d7fa640 1 -- 172.21.15.7:0/3842324324 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f140800ac30 con 0x7f14100ce830 2024-04-25T09:55:21.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.555+0000 7f140d7fa640 1 --2- 172.21.15.7:0/3842324324 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f13fc06b4d0 0x7f13fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:21.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.555+0000 7f140d7fa640 1 -- 172.21.15.7:0/3842324324 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f140808a670 con 0x7f14100ce830 2024-04-25T09:55:21.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.555+0000 7f140ffff640 1 --2- 172.21.15.7:0/3842324324 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f13fc06b4d0 0x7f13fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:21.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.556+0000 7f140ffff640 1 --2- 172.21.15.7:0/3842324324 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f13fc06b4d0 0x7f13fc06d990 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1404034000 tx=0x7f140402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:21.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.559+0000 7f140d7fa640 1 -- 172.21.15.7:0/3842324324 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1408059050 con 0x7f14100ce830 2024-04-25T09:55:21.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.740+0000 7f141723f640 1 -- 172.21.15.7:0/3842324324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1410160760 con 0x7f14100ce830 2024-04-25T09:55:21.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.740+0000 7f140d7fa640 1 -- 172.21.15.7:0/3842324324 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1408058950 con 0x7f14100ce830 2024-04-25T09:55:21.743 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:55:21.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.742+0000 7f141723f640 1 -- 172.21.15.7:0/3842324324 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f13fc06b4d0 msgr2=0x7f13fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:21.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.742+0000 7f141723f640 1 --2- 172.21.15.7:0/3842324324 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f13fc06b4d0 0x7f13fc06d990 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1404034000 tx=0x7f140402e000 comp rx=0 tx=0).stop 2024-04-25T09:55:21.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.742+0000 7f141723f640 1 -- 172.21.15.7:0/3842324324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14100ce830 msgr2=0x7f141014f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:21.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.742+0000 7f141723f640 1 --2- 172.21.15.7:0/3842324324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14100ce830 0x7f141014f8e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f140800c870 tx=0x7f140800cd30 comp rx=0 tx=0).stop 2024-04-25T09:55:21.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.742+0000 7f141723f640 1 -- 172.21.15.7:0/3842324324 shutdown_connections 2024-04-25T09:55:21.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.742+0000 7f141723f640 1 --2- 172.21.15.7:0/3842324324 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f13fc06b4d0 0x7f13fc06d990 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:21.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.742+0000 7f141723f640 1 --2- 172.21.15.7:0/3842324324 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f141015f1c0 0x7f14100cb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:21.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.742+0000 7f141723f640 1 --2- 172.21.15.7:0/3842324324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14100d3760 0x7f14100cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:21.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.742+0000 7f141723f640 1 --2- 172.21.15.7:0/3842324324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14100ce830 0x7f141014f8e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:21.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.742+0000 7f141723f640 1 -- 172.21.15.7:0/3842324324 >> 172.21.15.7:0/3842324324 conn(0x7f1410072680 msgr2=0x7f14100c9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:21.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.743+0000 7f141723f640 1 -- 172.21.15.7:0/3842324324 shutdown_connections 2024-04-25T09:55:21.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.743+0000 7f141723f640 1 -- 172.21.15.7:0/3842324324 wait complete. 2024-04-25T09:55:21.756 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:55:21.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.857+0000 7fd2dd5b0640 1 Processor -- start 2024-04-25T09:55:21.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.857+0000 7fd2dd5b0640 1 -- start start 2024-04-25T09:55:21.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.858+0000 7fd2dd5b0640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd2d8143fb0 0x7fd2d80b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:21.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.858+0000 7fd2dd5b0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2d806e240 0x7fd2d806e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:21.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.858+0000 7fd2dd5b0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd2d80ce610 0x7fd2d80cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:21.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.858+0000 7fd2dd5b0640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d806ebe0 con 0x7fd2d8143fb0 2024-04-25T09:55:21.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.858+0000 7fd2dd5b0640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d80b2ee0 con 0x7fd2d80ce610 2024-04-25T09:55:21.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.858+0000 7fd2dd5b0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d80b3150 con 0x7fd2d806e240 2024-04-25T09:55:21.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.858+0000 7fd2d6ffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd2d8143fb0 0x7fd2d80b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:21.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.858+0000 7fd2d6ffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd2d8143fb0 0x7fd2d80b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36490/0 (socket says 172.21.15.7:36490) 2024-04-25T09:55:21.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.858+0000 7fd2d6ffd640 1 -- 172.21.15.7:0/4067895909 learned_addr learned my addr 172.21.15.7:0/4067895909 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:21.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.858+0000 7fd2cffff640 1 --2- 172.21.15.7:0/4067895909 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2d806e240 0x7fd2d806e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:21.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.858+0000 7fd2d77fe640 1 --2- 172.21.15.7:0/4067895909 >> v2:172.21.15.55:3300/0 conn(0x7fd2d80ce610 0x7fd2d80cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:21.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.858+0000 7fd2d6ffd640 1 -- 172.21.15.7:0/4067895909 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2d806e240 msgr2=0x7fd2d806e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:21.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.858+0000 7fd2d6ffd640 1 --2- 172.21.15.7:0/4067895909 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2d806e240 0x7fd2d806e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:21.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.858+0000 7fd2d6ffd640 1 -- 172.21.15.7:0/4067895909 >> v2:172.21.15.55:3300/0 conn(0x7fd2d80ce610 msgr2=0x7fd2d80cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:21.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.858+0000 7fd2d6ffd640 1 --2- 172.21.15.7:0/4067895909 >> v2:172.21.15.55:3300/0 conn(0x7fd2d80ce610 0x7fd2d80cea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:21.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.858+0000 7fd2d6ffd640 1 -- 172.21.15.7:0/4067895909 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d80b3430 con 0x7fd2d8143fb0 2024-04-25T09:55:21.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.859+0000 7fd2d6ffd640 1 --2- 172.21.15.7:0/4067895909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2d8143fb0 0x7fd2d80b3c30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd2d806bac0 tx=0x7fd2c802c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bbad3a07e4da22c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:21.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.859+0000 7fd2d67fc640 1 -- 172.21.15.7:0/4067895909 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8032790 con 0x7fd2d8143fb0 2024-04-25T09:55:21.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.859+0000 7fd2d67fc640 1 -- 172.21.15.7:0/4067895909 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c8038070 con 0x7fd2d8143fb0 2024-04-25T09:55:21.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.859+0000 7fd2d67fc640 1 -- 172.21.15.7:0/4067895909 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8032b50 con 0x7fd2d8143fb0 2024-04-25T09:55:21.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.860+0000 7fd2dd5b0640 1 -- 172.21.15.7:0/4067895909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2d8143fb0 msgr2=0x7fd2d80b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:21.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.860+0000 7fd2dd5b0640 1 --2- 172.21.15.7:0/4067895909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2d8143fb0 0x7fd2d80b3c30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd2d806bac0 tx=0x7fd2c802c890 comp rx=0 tx=0).stop 2024-04-25T09:55:21.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.860+0000 7fd2dd5b0640 1 -- 172.21.15.7:0/4067895909 shutdown_connections 2024-04-25T09:55:21.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.860+0000 7fd2dd5b0640 1 --2- 172.21.15.7:0/4067895909 >> v2:172.21.15.55:3300/0 conn(0x7fd2d80ce610 0x7fd2d80cea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:21.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.860+0000 7fd2dd5b0640 1 --2- 172.21.15.7:0/4067895909 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2d806e240 0x7fd2d806e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:21.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.860+0000 7fd2dd5b0640 1 --2- 172.21.15.7:0/4067895909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2d8143fb0 0x7fd2d80b3c30 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:21.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.860+0000 7fd2dd5b0640 1 -- 172.21.15.7:0/4067895909 >> 172.21.15.7:0/4067895909 conn(0x7fd2d806ab60 msgr2=0x7fd2d806af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:21.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.860+0000 7fd2dd5b0640 1 -- 172.21.15.7:0/4067895909 shutdown_connections 2024-04-25T09:55:21.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.860+0000 7fd2dd5b0640 1 -- 172.21.15.7:0/4067895909 wait complete. 2024-04-25T09:55:21.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.861+0000 7fd2dd5b0640 1 Processor -- start 2024-04-25T09:55:21.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.861+0000 7fd2dd5b0640 1 -- start start 2024-04-25T09:55:21.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.862+0000 7fd2dd5b0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2d806e240 0x7fd2d8133340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:21.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.862+0000 7fd2dd5b0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2d80ce610 0x7fd2d8159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:21.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.862+0000 7fd2dd5b0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2d8143fb0 0x7fd2d8142200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:21.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.862+0000 7fd2dd5b0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d80cf2f0 con 0x7fd2d806e240 2024-04-25T09:55:21.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.862+0000 7fd2dd5b0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d8144390 con 0x7fd2d8143fb0 2024-04-25T09:55:21.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.862+0000 7fd2dd5b0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d80cef70 con 0x7fd2d80ce610 2024-04-25T09:55:21.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.862+0000 7fd2d6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2d806e240 0x7fd2d8133340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:21.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.862+0000 7fd2d6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2d806e240 0x7fd2d8133340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36506/0 (socket says 172.21.15.7:36506) 2024-04-25T09:55:21.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.862+0000 7fd2d6ffd640 1 -- 172.21.15.7:0/1378089082 learned_addr learned my addr 172.21.15.7:0/1378089082 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:21.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.862+0000 7fd2d6ffd640 1 -- 172.21.15.7:0/1378089082 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2d80ce610 msgr2=0x7fd2d8159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:21.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.862+0000 7fd2d6ffd640 1 --2- 172.21.15.7:0/1378089082 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2d80ce610 0x7fd2d8159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:21.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.862+0000 7fd2d6ffd640 1 -- 172.21.15.7:0/1378089082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2d8143fb0 msgr2=0x7fd2d8142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:21.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.862+0000 7fd2d77fe640 1 --2- 172.21.15.7:0/1378089082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2d8143fb0 0x7fd2d8142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:21.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.862+0000 7fd2d6ffd640 1 --2- 172.21.15.7:0/1378089082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2d8143fb0 0x7fd2d8142200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:21.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.862+0000 7fd2d6ffd640 1 -- 172.21.15.7:0/1378089082 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d81322a0 con 0x7fd2d806e240 2024-04-25T09:55:21.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.862+0000 7fd2d6ffd640 1 --2- 172.21.15.7:0/1378089082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2d806e240 0x7fd2d8133340 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd2c802c8d0 tx=0x7fd2c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:21.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.862+0000 7fd2cf7fe640 1 -- 172.21.15.7:0/1378089082 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8043070 con 0x7fd2d806e240 2024-04-25T09:55:21.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.863+0000 7fd2cf7fe640 1 -- 172.21.15.7:0/1378089082 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c803c640 con 0x7fd2d806e240 2024-04-25T09:55:21.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.863+0000 7fd2dd5b0640 1 -- 172.21.15.7:0/1378089082 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d8132580 con 0x7fd2d806e240 2024-04-25T09:55:21.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.863+0000 7fd2cf7fe640 1 -- 172.21.15.7:0/1378089082 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c803ca30 con 0x7fd2d806e240 2024-04-25T09:55:21.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.863+0000 7fd2dd5b0640 1 -- 172.21.15.7:0/1378089082 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d8132b40 con 0x7fd2d806e240 2024-04-25T09:55:21.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.864+0000 7fd2dd5b0640 1 -- 172.21.15.7:0/1378089082 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d8068f60 con 0x7fd2d806e240 2024-04-25T09:55:21.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.864+0000 7fd2cf7fe640 1 -- 172.21.15.7:0/1378089082 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd2c8046070 con 0x7fd2d806e240 2024-04-25T09:55:21.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.864+0000 7fd2cf7fe640 1 --2- 172.21.15.7:0/1378089082 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd2b806b4d0 0x7fd2b806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:21.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.865+0000 7fd2cf7fe640 1 -- 172.21.15.7:0/1378089082 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fd2c80aae30 con 0x7fd2d806e240 2024-04-25T09:55:21.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.865+0000 7fd2cffff640 1 --2- 172.21.15.7:0/1378089082 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd2b806b4d0 0x7fd2b806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:21.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.865+0000 7fd2cffff640 1 --2- 172.21.15.7:0/1378089082 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd2b806b4d0 0x7fd2b806d990 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80b1a50 tx=0x7fd2c0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:21.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:21.869+0000 7fd2cf7fe640 1 -- 172.21.15.7:0/1378089082 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd2c8079940 con 0x7fd2d806e240 2024-04-25T09:55:22.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.051+0000 7fd2dd5b0640 1 -- 172.21.15.7:0/1378089082 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd2d815d440 con 0x7fd2d806e240 2024-04-25T09:55:22.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.051+0000 7fd2cf7fe640 1 -- 172.21.15.7:0/1378089082 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd2c8079240 con 0x7fd2d806e240 2024-04-25T09:55:22.054 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T09:55:22.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.053+0000 7fd2dd5b0640 1 -- 172.21.15.7:0/1378089082 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd2b806b4d0 msgr2=0x7fd2b806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:22.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.053+0000 7fd2dd5b0640 1 --2- 172.21.15.7:0/1378089082 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd2b806b4d0 0x7fd2b806d990 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80b1a50 tx=0x7fd2c0008040 comp rx=0 tx=0).stop 2024-04-25T09:55:22.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.053+0000 7fd2dd5b0640 1 -- 172.21.15.7:0/1378089082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2d806e240 msgr2=0x7fd2d8133340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:22.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.053+0000 7fd2dd5b0640 1 --2- 172.21.15.7:0/1378089082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2d806e240 0x7fd2d8133340 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd2c802c8d0 tx=0x7fd2c8004730 comp rx=0 tx=0).stop 2024-04-25T09:55:22.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.053+0000 7fd2dd5b0640 1 -- 172.21.15.7:0/1378089082 shutdown_connections 2024-04-25T09:55:22.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.053+0000 7fd2dd5b0640 1 --2- 172.21.15.7:0/1378089082 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd2b806b4d0 0x7fd2b806d990 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:22.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.053+0000 7fd2dd5b0640 1 --2- 172.21.15.7:0/1378089082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2d8143fb0 0x7fd2d8142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:22.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.053+0000 7fd2dd5b0640 1 --2- 172.21.15.7:0/1378089082 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2d80ce610 0x7fd2d8159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:22.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.053+0000 7fd2dd5b0640 1 --2- 172.21.15.7:0/1378089082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2d806e240 0x7fd2d8133340 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:22.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.053+0000 7fd2dd5b0640 1 -- 172.21.15.7:0/1378089082 >> 172.21.15.7:0/1378089082 conn(0x7fd2d806ab60 msgr2=0x7fd2d80cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:22.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.053+0000 7fd2dd5b0640 1 -- 172.21.15.7:0/1378089082 shutdown_connections 2024-04-25T09:55:22.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.053+0000 7fd2dd5b0640 1 -- 172.21.15.7:0/1378089082 wait complete. 2024-04-25T09:55:22.067 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:55:22.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.167+0000 7f619d570640 1 Processor -- start 2024-04-25T09:55:22.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.167+0000 7f619d570640 1 -- start start 2024-04-25T09:55:22.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.168+0000 7f619d570640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f619815f1c0 0x7f619815eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:22.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.168+0000 7f619d570640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f61980ce830 0x7f61980b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:22.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.168+0000 7f619d570640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61980ced10 con 0x7f61980d3760 2024-04-25T09:55:22.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.168+0000 7f619d570640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61980ce380 con 0x7f61980ce830 2024-04-25T09:55:22.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.168+0000 7f619d570640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f619815f000 con 0x7f619815f1c0 2024-04-25T09:55:22.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.168+0000 7f61977fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f61980ce830 0x7f61980b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:22.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.168+0000 7f61967fc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f619815f1c0 0x7f619815eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:22.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.168+0000 7f6196ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f61980d3760 0x7f61980d3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:44732/0 (socket says 172.21.15.7:44732) 2024-04-25T09:55:22.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.168+0000 7f6196ffd640 1 -- 172.21.15.7:0/855818390 learned_addr learned my addr 172.21.15.7:0/855818390 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:22.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.168+0000 7f61977fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f61980ce830 0x7f61980b2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:56320/0 (socket says 172.21.15.7:56320) 2024-04-25T09:55:22.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.169+0000 7f61977fe640 1 -- 172.21.15.7:0/855818390 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f619815f1c0 msgr2=0x7f619815eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:22.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.169+0000 7f61977fe640 1 --2- 172.21.15.7:0/855818390 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f619815f1c0 0x7f619815eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:22.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.169+0000 7f61977fe640 1 -- 172.21.15.7:0/855818390 >> v1:172.21.15.55:6789/0 conn(0x7f61980d3760 legacy=0x7f61980d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:22.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.169+0000 7f61977fe640 1 -- 172.21.15.7:0/855818390 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61980d1b40 con 0x7f61980ce830 2024-04-25T09:55:22.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.170+0000 7f61977fe640 1 --2- 172.21.15.7:0/855818390 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61980ce830 0x7f61980b2240 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6188009d90 tx=0x7f618802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8ca3f6168e8016c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:22.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.170+0000 7f6195ffb640 1 -- 172.21.15.7:0/855818390 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6188007740 con 0x7f61980ce830 2024-04-25T09:55:22.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.170+0000 7f6195ffb640 1 -- 172.21.15.7:0/855818390 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61880078e0 con 0x7f61980ce830 2024-04-25T09:55:22.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.170+0000 7f6195ffb640 1 -- 172.21.15.7:0/855818390 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6188007cb0 con 0x7f61980ce830 2024-04-25T09:55:22.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.170+0000 7f619d570640 1 -- 172.21.15.7:0/855818390 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61980ce830 msgr2=0x7f61980b2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:22.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.170+0000 7f619d570640 1 --2- 172.21.15.7:0/855818390 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61980ce830 0x7f61980b2240 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6188009d90 tx=0x7f618802a660 comp rx=0 tx=0).stop 2024-04-25T09:55:22.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.170+0000 7f619d570640 1 -- 172.21.15.7:0/855818390 shutdown_connections 2024-04-25T09:55:22.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.170+0000 7f619d570640 1 --2- 172.21.15.7:0/855818390 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61980ce830 0x7f61980b2240 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:22.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.170+0000 7f619d570640 1 --2- 172.21.15.7:0/855818390 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f619815f1c0 0x7f619815eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:22.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.170+0000 7f619d570640 1 -- 172.21.15.7:0/855818390 >> 172.21.15.7:0/855818390 conn(0x7f6198072680 msgr2=0x7f6198072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:22.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.170+0000 7f619d570640 1 -- 172.21.15.7:0/855818390 shutdown_connections 2024-04-25T09:55:22.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.171+0000 7f619d570640 1 -- 172.21.15.7:0/855818390 wait complete. 2024-04-25T09:55:22.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.172+0000 7f619d570640 1 Processor -- start 2024-04-25T09:55:22.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.172+0000 7f619d570640 1 -- start start 2024-04-25T09:55:22.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.172+0000 7f619d570640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61980ce830 0x7f61981e6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:22.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.172+0000 7f619d570640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f61980d3760 0x7f61981f6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:22.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.172+0000 7f619d570640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f619815f1c0 0x7f61981f2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:22.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.172+0000 7f619d570640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619815de10 con 0x7f619815f1c0 2024-04-25T09:55:22.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.172+0000 7f619d570640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61980d2190 con 0x7f61980ce830 2024-04-25T09:55:22.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.172+0000 7f619d570640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61980b2780 con 0x7f61980d3760 2024-04-25T09:55:22.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.173+0000 7f61977fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f619815f1c0 0x7f61981f2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:22.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.173+0000 7f61977fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f619815f1c0 0x7f61981f2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36508/0 (socket says 172.21.15.7:36508) 2024-04-25T09:55:22.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.173+0000 7f61977fe640 1 -- 172.21.15.7:0/946731796 learned_addr learned my addr 172.21.15.7:0/946731796 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:22.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.173+0000 7f6196ffd640 1 --2- 172.21.15.7:0/946731796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61980ce830 0x7f61981e6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:22.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.173+0000 7f61967fc640 1 --2- 172.21.15.7:0/946731796 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f61980d3760 0x7f61981f6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:22.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.173+0000 7f61977fe640 1 -- 172.21.15.7:0/946731796 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f61980d3760 msgr2=0x7f61981f6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:22.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.173+0000 7f61977fe640 1 --2- 172.21.15.7:0/946731796 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f61980d3760 0x7f61981f6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:22.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.173+0000 7f61977fe640 1 -- 172.21.15.7:0/946731796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61980ce830 msgr2=0x7f61981e6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:22.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.173+0000 7f61977fe640 1 --2- 172.21.15.7:0/946731796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61980ce830 0x7f61981e6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:22.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.173+0000 7f61977fe640 1 -- 172.21.15.7:0/946731796 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61980cb860 con 0x7f619815f1c0 2024-04-25T09:55:22.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.173+0000 7f61977fe640 1 --2- 172.21.15.7:0/946731796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f619815f1c0 0x7f61981f2a40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6188009eb0 tx=0x7f6188004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:22.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.173+0000 7f618f7fe640 1 -- 172.21.15.7:0/946731796 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6188040070 con 0x7f619815f1c0 2024-04-25T09:55:22.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.173+0000 7f618f7fe640 1 -- 172.21.15.7:0/946731796 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6188031bc0 con 0x7f619815f1c0 2024-04-25T09:55:22.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.173+0000 7f618f7fe640 1 -- 172.21.15.7:0/946731796 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6188009450 con 0x7f619815f1c0 2024-04-25T09:55:22.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.173+0000 7f619d570640 1 -- 172.21.15.7:0/946731796 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61981e6fa0 con 0x7f619815f1c0 2024-04-25T09:55:22.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.173+0000 7f619d570640 1 -- 172.21.15.7:0/946731796 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61980cc0c0 con 0x7f619815f1c0 2024-04-25T09:55:22.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.174+0000 7f619d570640 1 -- 172.21.15.7:0/946731796 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6198068f60 con 0x7f619815f1c0 2024-04-25T09:55:22.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.175+0000 7f618f7fe640 1 -- 172.21.15.7:0/946731796 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6188039040 con 0x7f619815f1c0 2024-04-25T09:55:22.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.175+0000 7f618f7fe640 1 --2- 172.21.15.7:0/946731796 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f617806b4d0 0x7f617806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:22.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.175+0000 7f618f7fe640 1 -- 172.21.15.7:0/946731796 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f61880abd10 con 0x7f619815f1c0 2024-04-25T09:55:22.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.175+0000 7f6196ffd640 1 --2- 172.21.15.7:0/946731796 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f617806b4d0 0x7f617806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:22.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.176+0000 7f6196ffd640 1 --2- 172.21.15.7:0/946731796 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f617806b4d0 0x7f617806d990 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6190007fd0 tx=0x7f6190007e80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:22.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.179+0000 7f618f7fe640 1 -- 172.21.15.7:0/946731796 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f618807a140 con 0x7f619815f1c0 2024-04-25T09:55:22.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.360+0000 7f619d570640 1 -- 172.21.15.7:0/946731796 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f61980ce610 con 0x7f619815f1c0 2024-04-25T09:55:22.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.361+0000 7f618f7fe640 1 -- 172.21.15.7:0/946731796 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f618807e1e0 con 0x7f619815f1c0 2024-04-25T09:55:22.364 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:55:22.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.362+0000 7f619d570640 1 -- 172.21.15.7:0/946731796 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f617806b4d0 msgr2=0x7f617806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:22.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.362+0000 7f619d570640 1 --2- 172.21.15.7:0/946731796 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f617806b4d0 0x7f617806d990 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6190007fd0 tx=0x7f6190007e80 comp rx=0 tx=0).stop 2024-04-25T09:55:22.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.362+0000 7f619d570640 1 -- 172.21.15.7:0/946731796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f619815f1c0 msgr2=0x7f61981f2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:22.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.362+0000 7f619d570640 1 --2- 172.21.15.7:0/946731796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f619815f1c0 0x7f61981f2a40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6188009eb0 tx=0x7f6188004a40 comp rx=0 tx=0).stop 2024-04-25T09:55:22.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.362+0000 7f619d570640 1 -- 172.21.15.7:0/946731796 shutdown_connections 2024-04-25T09:55:22.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.362+0000 7f619d570640 1 --2- 172.21.15.7:0/946731796 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f617806b4d0 0x7f617806d990 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:22.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.362+0000 7f619d570640 1 --2- 172.21.15.7:0/946731796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f619815f1c0 0x7f61981f2a40 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:22.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.362+0000 7f619d570640 1 --2- 172.21.15.7:0/946731796 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f61980d3760 0x7f61981f6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:22.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.362+0000 7f619d570640 1 --2- 172.21.15.7:0/946731796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61980ce830 0x7f61981e6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:22.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.362+0000 7f619d570640 1 -- 172.21.15.7:0/946731796 >> 172.21.15.7:0/946731796 conn(0x7f6198072680 msgr2=0x7f619815e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:22.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.363+0000 7f619d570640 1 -- 172.21.15.7:0/946731796 shutdown_connections 2024-04-25T09:55:22.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.363+0000 7f619d570640 1 -- 172.21.15.7:0/946731796 wait complete. 2024-04-25T09:55:22.376 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:55:22.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.474+0000 7fdb8014c640 1 Processor -- start 2024-04-25T09:55:22.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.474+0000 7fdb8014c640 1 -- start start 2024-04-25T09:55:22.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.475+0000 7fdb8014c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdb780b5e60 0x7fdb7806bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:22.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.475+0000 7fdb8014c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdb780b6a40 0x7fdb7806c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:22.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.475+0000 7fdb8014c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb7806ca30 con 0x7fdb7815dd00 2024-04-25T09:55:22.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.475+0000 7fdb8014c640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb7815e0e0 con 0x7fdb780b5e60 2024-04-25T09:55:22.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.475+0000 7fdb8014c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7806cfe0 con 0x7fdb780b6a40 2024-04-25T09:55:22.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.475+0000 7fdb7d6e7640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdb780b5e60 0x7fdb7806bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:22.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.475+0000 7fdb7d6e7640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdb780b5e60 0x7fdb7806bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36518/0 (socket says 172.21.15.7:36518) 2024-04-25T09:55:22.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.475+0000 7fdb7d6e7640 1 -- 172.21.15.7:0/2445040072 learned_addr learned my addr 172.21.15.7:0/2445040072 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:22.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.475+0000 7fdb7e6e9640 1 --2- 172.21.15.7:0/2445040072 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdb780b6a40 0x7fdb7806c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:22.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.475+0000 7fdb7d6e7640 1 -- 172.21.15.7:0/2445040072 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdb780b6a40 msgr2=0x7fdb7806c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:22.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.475+0000 7fdb7d6e7640 1 --2- 172.21.15.7:0/2445040072 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdb780b6a40 0x7fdb7806c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:22.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.475+0000 7fdb7d6e7640 1 -- 172.21.15.7:0/2445040072 >> v1:172.21.15.55:6789/0 conn(0x7fdb7815dd00 legacy=0x7fdb780b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:22.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.475+0000 7fdb7d6e7640 1 -- 172.21.15.7:0/2445040072 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7806cd00 con 0x7fdb780b5e60 2024-04-25T09:55:22.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.476+0000 7fdb7d6e7640 1 --2- 172.21.15.7:0/2445040072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb780b5e60 0x7fdb7806bfb0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fdb68009870 tx=0x7fdb6802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4170833381514a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:22.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.476+0000 7fdb7cee6640 1 -- 172.21.15.7:0/2445040072 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb68037070 con 0x7fdb780b5e60 2024-04-25T09:55:22.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.476+0000 7fdb7cee6640 1 -- 172.21.15.7:0/2445040072 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb68032440 con 0x7fdb780b5e60 2024-04-25T09:55:22.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.476+0000 7fdb7cee6640 1 -- 172.21.15.7:0/2445040072 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb68032810 con 0x7fdb780b5e60 2024-04-25T09:55:22.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.477+0000 7fdb8014c640 1 -- 172.21.15.7:0/2445040072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb780b5e60 msgr2=0x7fdb7806bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:22.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.477+0000 7fdb8014c640 1 --2- 172.21.15.7:0/2445040072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb780b5e60 0x7fdb7806bfb0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fdb68009870 tx=0x7fdb6802a2a0 comp rx=0 tx=0).stop 2024-04-25T09:55:22.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.477+0000 7fdb8014c640 1 -- 172.21.15.7:0/2445040072 shutdown_connections 2024-04-25T09:55:22.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.477+0000 7fdb8014c640 1 --2- 172.21.15.7:0/2445040072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb780b5e60 0x7fdb7806bfb0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:22.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.477+0000 7fdb8014c640 1 --2- 172.21.15.7:0/2445040072 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdb780b6a40 0x7fdb7806c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:22.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.477+0000 7fdb8014c640 1 -- 172.21.15.7:0/2445040072 >> 172.21.15.7:0/2445040072 conn(0x7fdb780d07b0 msgr2=0x7fdb780d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:22.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.477+0000 7fdb8014c640 1 -- 172.21.15.7:0/2445040072 shutdown_connections 2024-04-25T09:55:22.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.477+0000 7fdb8014c640 1 -- 172.21.15.7:0/2445040072 wait complete. 2024-04-25T09:55:22.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.478+0000 7fdb8014c640 1 Processor -- start 2024-04-25T09:55:22.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.478+0000 7fdb8014c640 1 -- start start 2024-04-25T09:55:22.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.479+0000 7fdb8014c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb780b5e60 0x7fdb781f6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:22.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.479+0000 7fdb8014c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdb780b6a40 0x7fdb78154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:22.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.479+0000 7fdb8014c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb7815dd00 0x7fdb78160830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:22.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.479+0000 7fdb8014c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb780d2260 con 0x7fdb780b5e60 2024-04-25T09:55:22.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.479+0000 7fdb8014c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb780d1f80 con 0x7fdb7815dd00 2024-04-25T09:55:22.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.479+0000 7fdb8014c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb780d2780 con 0x7fdb780b6a40 2024-04-25T09:55:22.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.479+0000 7fdb7dee8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb780b5e60 0x7fdb781f6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:22.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.479+0000 7fdb7dee8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb780b5e60 0x7fdb781f6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36534/0 (socket says 172.21.15.7:36534) 2024-04-25T09:55:22.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.479+0000 7fdb7dee8640 1 -- 172.21.15.7:0/105758010 learned_addr learned my addr 172.21.15.7:0/105758010 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:22.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.479+0000 7fdb7e6e9640 1 --2- 172.21.15.7:0/105758010 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb7815dd00 0x7fdb78160830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:22.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.479+0000 7fdb7d6e7640 1 --2- 172.21.15.7:0/105758010 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdb780b6a40 0x7fdb78154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:22.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.479+0000 7fdb7dee8640 1 -- 172.21.15.7:0/105758010 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdb780b6a40 msgr2=0x7fdb78154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:22.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.479+0000 7fdb7dee8640 1 --2- 172.21.15.7:0/105758010 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdb780b6a40 0x7fdb78154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:22.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.479+0000 7fdb7dee8640 1 -- 172.21.15.7:0/105758010 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb7815dd00 msgr2=0x7fdb78160830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:22.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.479+0000 7fdb7dee8640 1 --2- 172.21.15.7:0/105758010 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb7815dd00 0x7fdb78160830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:22.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.479+0000 7fdb7dee8640 1 -- 172.21.15.7:0/105758010 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7815fa70 con 0x7fdb780b5e60 2024-04-25T09:55:22.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.479+0000 7fdb7dee8640 1 --2- 172.21.15.7:0/105758010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb780b5e60 0x7fdb781f6890 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400b420 tx=0x7fdb7400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:22.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.479+0000 7fdb6e7fc640 1 -- 172.21.15.7:0/105758010 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb74011830 con 0x7fdb780b5e60 2024-04-25T09:55:22.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.479+0000 7fdb6e7fc640 1 -- 172.21.15.7:0/105758010 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb74016070 con 0x7fdb780b5e60 2024-04-25T09:55:22.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.479+0000 7fdb6e7fc640 1 -- 172.21.15.7:0/105758010 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb74011c10 con 0x7fdb780b5e60 2024-04-25T09:55:22.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.479+0000 7fdb8014c640 1 -- 172.21.15.7:0/105758010 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb7815fd50 con 0x7fdb780b5e60 2024-04-25T09:55:22.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.480+0000 7fdb8014c640 1 -- 172.21.15.7:0/105758010 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb781f6dd0 con 0x7fdb780b5e60 2024-04-25T09:55:22.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.481+0000 7fdb8014c640 1 -- 172.21.15.7:0/105758010 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb780b8950 con 0x7fdb780b5e60 2024-04-25T09:55:22.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.481+0000 7fdb6e7fc640 1 -- 172.21.15.7:0/105758010 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdb7401b460 con 0x7fdb780b5e60 2024-04-25T09:55:22.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.481+0000 7fdb6e7fc640 1 --2- 172.21.15.7:0/105758010 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdb5c06b500 0x7fdb5c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:22.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.482+0000 7fdb6e7fc640 1 -- 172.21.15.7:0/105758010 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fdb7408a150 con 0x7fdb780b5e60 2024-04-25T09:55:22.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.482+0000 7fdb7d6e7640 1 --2- 172.21.15.7:0/105758010 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdb5c06b500 0x7fdb5c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:22.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.482+0000 7fdb7d6e7640 1 --2- 172.21.15.7:0/105758010 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdb5c06b500 0x7fdb5c06d9c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdb68034000 tx=0x7fdb6802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:22.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.486+0000 7fdb6e7fc640 1 -- 172.21.15.7:0/105758010 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdb780b8950 con 0x7fdb780b5e60 2024-04-25T09:55:22.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.706+0000 7fdb8014c640 1 -- 172.21.15.7:0/105758010 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb78068fd0 con 0x7fdb780b5e60 2024-04-25T09:55:22.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.706+0000 7fdb6e7fc640 1 -- 172.21.15.7:0/105758010 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4928 (secure 0 0 0) 0x7fdb74058610 con 0x7fdb780b5e60 2024-04-25T09:55:22.709 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:22.709 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1968579214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1968579214},{"type":"v1","addr":"172.21.15.7:6837","nonce":1968579214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3479570567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3479570567},{"type":"v1","addr":"172.21.15.55:6834","nonce":3479570567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/2289657027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2289657027},{"type":"v1","addr":"172.21.15.7:6836","nonce":2289657027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:54:27.558601+0000","modified":"2024-04-25T09:54:43.635854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/3779228372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3779228372},{"type":"v1","addr":"172.21.15.55:6835","nonce":3779228372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:55:22.710 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 8 2024-04-25T09:55:22.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.708+0000 7fdb8014c640 1 -- 172.21.15.7:0/105758010 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdb5c06b500 msgr2=0x7fdb5c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:22.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.708+0000 7fdb8014c640 1 --2- 172.21.15.7:0/105758010 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdb5c06b500 0x7fdb5c06d9c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdb68034000 tx=0x7fdb6802e000 comp rx=0 tx=0).stop 2024-04-25T09:55:22.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.708+0000 7fdb8014c640 1 -- 172.21.15.7:0/105758010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb780b5e60 msgr2=0x7fdb781f6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:22.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.708+0000 7fdb8014c640 1 --2- 172.21.15.7:0/105758010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb780b5e60 0x7fdb781f6890 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400b420 tx=0x7fdb7400b8e0 comp rx=0 tx=0).stop 2024-04-25T09:55:22.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.708+0000 7fdb8014c640 1 -- 172.21.15.7:0/105758010 shutdown_connections 2024-04-25T09:55:22.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.708+0000 7fdb8014c640 1 --2- 172.21.15.7:0/105758010 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdb5c06b500 0x7fdb5c06d9c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:22.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.708+0000 7fdb8014c640 1 --2- 172.21.15.7:0/105758010 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb7815dd00 0x7fdb78160830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:22.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.708+0000 7fdb8014c640 1 --2- 172.21.15.7:0/105758010 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdb780b6a40 0x7fdb78154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:22.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.708+0000 7fdb8014c640 1 --2- 172.21.15.7:0/105758010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb780b5e60 0x7fdb781f6890 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:22.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.708+0000 7fdb8014c640 1 -- 172.21.15.7:0/105758010 >> 172.21.15.7:0/105758010 conn(0x7fdb780d07b0 msgr2=0x7fdb780d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:22.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.708+0000 7fdb8014c640 1 -- 172.21.15.7:0/105758010 shutdown_connections 2024-04-25T09:55:22.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.708+0000 7fdb8014c640 1 -- 172.21.15.7:0/105758010 wait complete. 2024-04-25T09:55:22.722 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:55:22.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.819+0000 7f49d6ee1640 1 Processor -- start 2024-04-25T09:55:22.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.819+0000 7f49d6ee1640 1 -- start start 2024-04-25T09:55:22.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.820+0000 7f49d6ee1640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f49d00d0a50 0x7f49d00d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:22.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.820+0000 7f49d6ee1640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f49d00b53b0 0x7f49d00d2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:22.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.820+0000 7f49d6ee1640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d00d1e80 con 0x7f49d015db00 2024-04-25T09:55:22.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.820+0000 7f49d6ee1640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d00b5930 con 0x7f49d00b53b0 2024-04-25T09:55:22.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.820+0000 7f49d6ee1640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d00b5c10 con 0x7f49d00d0a50 2024-04-25T09:55:22.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.820+0000 7f49d4c7d640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f49d015db00 0x7f49d00d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34056/0 (socket says 172.21.15.7:34056) 2024-04-25T09:55:22.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.820+0000 7f49d547e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f49d00b53b0 0x7f49d00d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:22.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.820+0000 7f49d4c7d640 1 -- 172.21.15.7:0/2157229217 learned_addr learned my addr 172.21.15.7:0/2157229217 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:22.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.821+0000 7f49cffff640 1 --2- 172.21.15.7:0/2157229217 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f49d00d0a50 0x7f49d00d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:22.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.821+0000 7f49d547e640 1 -- 172.21.15.7:0/2157229217 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f49d00d0a50 msgr2=0x7f49d00d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:22.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.821+0000 7f49d547e640 1 --2- 172.21.15.7:0/2157229217 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f49d00d0a50 0x7f49d00d2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:22.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.821+0000 7f49d547e640 1 -- 172.21.15.7:0/2157229217 >> v1:172.21.15.7:6789/0 conn(0x7f49d015db00 legacy=0x7f49d00d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:22.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.821+0000 7f49cf7fe640 1 -- 172.21.15.7:0/2157229217 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1287428669 0 0) 0x7f49d00d1e80 con 0x7f49d015db00 2024-04-25T09:55:22.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.821+0000 7f49d547e640 1 -- 172.21.15.7:0/2157229217 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d00b5ef0 con 0x7f49d00b53b0 2024-04-25T09:55:22.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.822+0000 7f49d547e640 1 --2- 172.21.15.7:0/2157229217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49d00b53b0 0x7f49d00d2870 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f49b80097a0 tx=0x7f49b802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e8f773fdf7eeb8f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:22.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.822+0000 7f49cf7fe640 1 -- 172.21.15.7:0/2157229217 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b8037070 con 0x7f49d00b53b0 2024-04-25T09:55:22.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.822+0000 7f49cf7fe640 1 -- 172.21.15.7:0/2157229217 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b8032440 con 0x7f49d00b53b0 2024-04-25T09:55:22.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.822+0000 7f49cf7fe640 1 -- 172.21.15.7:0/2157229217 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b8032810 con 0x7f49d00b53b0 2024-04-25T09:55:22.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.822+0000 7f49d6ee1640 1 -- 172.21.15.7:0/2157229217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49d00b53b0 msgr2=0x7f49d00d2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:22.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.822+0000 7f49d6ee1640 1 --2- 172.21.15.7:0/2157229217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49d00b53b0 0x7f49d00d2870 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f49b80097a0 tx=0x7f49b802a180 comp rx=0 tx=0).stop 2024-04-25T09:55:22.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.822+0000 7f49d6ee1640 1 -- 172.21.15.7:0/2157229217 shutdown_connections 2024-04-25T09:55:22.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.822+0000 7f49d6ee1640 1 --2- 172.21.15.7:0/2157229217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49d00b53b0 0x7f49d00d2870 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:22.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.822+0000 7f49d6ee1640 1 --2- 172.21.15.7:0/2157229217 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f49d00d0a50 0x7f49d00d2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:22.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.822+0000 7f49d6ee1640 1 -- 172.21.15.7:0/2157229217 >> 172.21.15.7:0/2157229217 conn(0x7f49d0072290 msgr2=0x7f49d00726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:22.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.822+0000 7f49d6ee1640 1 -- 172.21.15.7:0/2157229217 shutdown_connections 2024-04-25T09:55:22.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.822+0000 7f49d6ee1640 1 -- 172.21.15.7:0/2157229217 wait complete. 2024-04-25T09:55:22.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.823+0000 7f49d6ee1640 1 Processor -- start 2024-04-25T09:55:22.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.824+0000 7f49d6ee1640 1 -- start start 2024-04-25T09:55:22.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.824+0000 7f49d6ee1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49d00b53b0 0x7f49d014acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:22.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.824+0000 7f49d6ee1640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f49d00d0a50 0x7f49d00c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:22.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.824+0000 7f49d6ee1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49d015db00 0x7f49d00c7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:22.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.824+0000 7f49d6ee1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d00d3660 con 0x7f49d015db00 2024-04-25T09:55:22.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.824+0000 7f49d6ee1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d00b61d0 con 0x7f49d00b53b0 2024-04-25T09:55:22.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.824+0000 7f49d6ee1640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d00ce2b0 con 0x7f49d00d0a50 2024-04-25T09:55:22.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.825+0000 7f49d547e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49d015db00 0x7f49d00c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:22.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.825+0000 7f49d547e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49d015db00 0x7f49d00c7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36554/0 (socket says 172.21.15.7:36554) 2024-04-25T09:55:22.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.825+0000 7f49d547e640 1 -- 172.21.15.7:0/532931801 learned_addr learned my addr 172.21.15.7:0/532931801 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:22.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.825+0000 7f49cffff640 1 --2- 172.21.15.7:0/532931801 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f49d00d0a50 0x7f49d00c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:22.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.825+0000 7f49d4c7d640 1 --2- 172.21.15.7:0/532931801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49d00b53b0 0x7f49d014acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:22.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.825+0000 7f49d547e640 1 -- 172.21.15.7:0/532931801 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f49d00d0a50 msgr2=0x7f49d00c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:22.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.825+0000 7f49d547e640 1 --2- 172.21.15.7:0/532931801 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f49d00d0a50 0x7f49d00c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:22.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.825+0000 7f49d547e640 1 -- 172.21.15.7:0/532931801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49d00b53b0 msgr2=0x7f49d014acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:22.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.825+0000 7f49d547e640 1 --2- 172.21.15.7:0/532931801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49d00b53b0 0x7f49d014acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:22.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.825+0000 7f49d547e640 1 -- 172.21.15.7:0/532931801 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d00c7d40 con 0x7f49d015db00 2024-04-25T09:55:22.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.825+0000 7f49cffff640 1 --2- 172.21.15.7:0/532931801 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f49d00d0a50 0x7f49d00c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:22.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.825+0000 7f49d4c7d640 1 --2- 172.21.15.7:0/532931801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49d00b53b0 0x7f49d014acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:22.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.825+0000 7f49d547e640 1 --2- 172.21.15.7:0/532931801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49d015db00 0x7f49d00c7460 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f49b8035040 tx=0x7f49b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:22.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.825+0000 7f49cd7fa640 1 -- 172.21.15.7:0/532931801 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b8037040 con 0x7f49d015db00 2024-04-25T09:55:22.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.825+0000 7f49cd7fa640 1 -- 172.21.15.7:0/532931801 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b8042070 con 0x7f49d015db00 2024-04-25T09:55:22.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.825+0000 7f49d6ee1640 1 -- 172.21.15.7:0/532931801 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d00c8020 con 0x7f49d015db00 2024-04-25T09:55:22.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.825+0000 7f49cd7fa640 1 -- 172.21.15.7:0/532931801 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b80308a0 con 0x7f49d015db00 2024-04-25T09:55:22.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.825+0000 7f49d6ee1640 1 -- 172.21.15.7:0/532931801 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d00c85e0 con 0x7f49d015db00 2024-04-25T09:55:22.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.826+0000 7f49d6ee1640 1 -- 172.21.15.7:0/532931801 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d0068fd0 con 0x7f49d015db00 2024-04-25T09:55:22.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.827+0000 7f49cd7fa640 1 -- 172.21.15.7:0/532931801 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f49b8030a40 con 0x7f49d015db00 2024-04-25T09:55:22.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.827+0000 7f49cd7fa640 1 --2- 172.21.15.7:0/532931801 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f49b006b4d0 0x7f49b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:22.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.827+0000 7f49cd7fa640 1 -- 172.21.15.7:0/532931801 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f49b80aafa0 con 0x7f49d015db00 2024-04-25T09:55:22.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.827+0000 7f49d4c7d640 1 --2- 172.21.15.7:0/532931801 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f49b006b4d0 0x7f49b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:22.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.828+0000 7f49d4c7d640 1 --2- 172.21.15.7:0/532931801 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f49b006b4d0 0x7f49b006d990 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f49c80012e0 tx=0x7f49c8005b90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:22.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:22.832+0000 7f49cd7fa640 1 -- 172.21.15.7:0/532931801 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f49b8079ab0 con 0x7f49d015db00 2024-04-25T09:55:23.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.013+0000 7f49d6ee1640 1 -- 172.21.15.7:0/532931801 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49d00d16b0 con 0x7f49d015db00 2024-04-25T09:55:23.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.014+0000 7f49cd7fa640 1 -- 172.21.15.7:0/532931801 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18807 (secure 0 0 0) 0x7f49b80793b0 con 0x7f49d015db00 2024-04-25T09:55:23.017 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:23.018 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:55:09.591504+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:54:26.011833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:54:26.535536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:54:30.264996+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:55:23.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.016+0000 7f49d6ee1640 1 -- 172.21.15.7:0/532931801 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f49b006b4d0 msgr2=0x7f49b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.016+0000 7f49d6ee1640 1 --2- 172.21.15.7:0/532931801 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f49b006b4d0 0x7f49b006d990 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f49c80012e0 tx=0x7f49c8005b90 comp rx=0 tx=0).stop 2024-04-25T09:55:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.016+0000 7f49d6ee1640 1 -- 172.21.15.7:0/532931801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49d015db00 msgr2=0x7f49d00c7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.016+0000 7f49d6ee1640 1 --2- 172.21.15.7:0/532931801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49d015db00 0x7f49d00c7460 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f49b8035040 tx=0x7f49b80046c0 comp rx=0 tx=0).stop 2024-04-25T09:55:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.016+0000 7f49d6ee1640 1 -- 172.21.15.7:0/532931801 shutdown_connections 2024-04-25T09:55:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.016+0000 7f49d6ee1640 1 --2- 172.21.15.7:0/532931801 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f49b006b4d0 0x7f49b006d990 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.016+0000 7f49d6ee1640 1 --2- 172.21.15.7:0/532931801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49d015db00 0x7f49d00c7460 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.016+0000 7f49d6ee1640 1 --2- 172.21.15.7:0/532931801 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f49d00d0a50 0x7f49d00c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.016+0000 7f49d6ee1640 1 --2- 172.21.15.7:0/532931801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49d00b53b0 0x7f49d014acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.016+0000 7f49d6ee1640 1 -- 172.21.15.7:0/532931801 >> 172.21.15.7:0/532931801 conn(0x7f49d0072290 msgr2=0x7f49d00b8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.016+0000 7f49d6ee1640 1 -- 172.21.15.7:0/532931801 shutdown_connections 2024-04-25T09:55:23.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.016+0000 7f49d6ee1640 1 -- 172.21.15.7:0/532931801 wait complete. 2024-04-25T09:55:23.031 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:55:23.031 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:55:23.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.129+0000 7fbe1799b640 1 Processor -- start 2024-04-25T09:55:23.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.130+0000 7fbe1799b640 1 -- start start 2024-04-25T09:55:23.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.130+0000 7fbe1799b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbe100c5010 0x7fbe1015be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:23.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.130+0000 7fbe1799b640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe100cd510 con 0x7fbe1006e970 2024-04-25T09:55:23.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.130+0000 7fbe1799b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe100cd7f0 con 0x7fbe10151720 2024-04-25T09:55:23.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.130+0000 7fbe1799b640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe100c53f0 con 0x7fbe100c5010 2024-04-25T09:55:23.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.131+0000 7fbe14f36640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbe1006e970 0x7fbe100c4900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34070/0 (socket says 172.21.15.7:34070) 2024-04-25T09:55:23.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.131+0000 7fbe14f36640 1 -- 172.21.15.7:0/3901673750 learned_addr learned my addr 172.21.15.7:0/3901673750 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:23.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.131+0000 7fbe15f38640 1 --2- 172.21.15.7:0/3901673750 >> v2:172.21.15.7:3300/0 conn(0x7fbe100c5010 0x7fbe1015be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:23.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.131+0000 7fbe15f38640 1 -- 172.21.15.7:0/3901673750 >> v1:172.21.15.55:6789/0 conn(0x7fbe10151720 legacy=0x7fbe1006e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:23.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.131+0000 7fbe15f38640 1 -- 172.21.15.7:0/3901673750 >> v1:172.21.15.7:6789/0 conn(0x7fbe1006e970 legacy=0x7fbe100c4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:23.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.131+0000 7fbe0ffff640 1 -- 172.21.15.7:0/3901673750 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1784961755 0 0) 0x7fbe100cd510 con 0x7fbe1006e970 2024-04-25T09:55:23.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.131+0000 7fbe15f38640 1 -- 172.21.15.7:0/3901673750 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe100cdad0 con 0x7fbe100c5010 2024-04-25T09:55:23.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.132+0000 7fbe15f38640 1 --2- 172.21.15.7:0/3901673750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe100c5010 0x7fbe1015be70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbe00009d90 tx=0x7fbe0002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f611421575d1e941 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:23.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.132+0000 7fbe0ffff640 1 -- 172.21.15.7:0/3901673750 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00007740 con 0x7fbe100c5010 2024-04-25T09:55:23.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.132+0000 7fbe0ffff640 1 -- 172.21.15.7:0/3901673750 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe000078e0 con 0x7fbe100c5010 2024-04-25T09:55:23.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.132+0000 7fbe0ffff640 1 -- 172.21.15.7:0/3901673750 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00007cb0 con 0x7fbe100c5010 2024-04-25T09:55:23.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.132+0000 7fbe1799b640 1 -- 172.21.15.7:0/3901673750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe100c5010 msgr2=0x7fbe1015be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:23.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.132+0000 7fbe1799b640 1 --2- 172.21.15.7:0/3901673750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe100c5010 0x7fbe1015be70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbe00009d90 tx=0x7fbe0002a6f0 comp rx=0 tx=0).stop 2024-04-25T09:55:23.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.132+0000 7fbe1799b640 1 -- 172.21.15.7:0/3901673750 shutdown_connections 2024-04-25T09:55:23.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.132+0000 7fbe1799b640 1 --2- 172.21.15.7:0/3901673750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe100c5010 0x7fbe1015be70 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:23.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.132+0000 7fbe1799b640 1 -- 172.21.15.7:0/3901673750 >> 172.21.15.7:0/3901673750 conn(0x7fbe10071150 msgr2=0x7fbe10071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:23.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.132+0000 7fbe1799b640 1 -- 172.21.15.7:0/3901673750 shutdown_connections 2024-04-25T09:55:23.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.132+0000 7fbe1799b640 1 -- 172.21.15.7:0/3901673750 wait complete. 2024-04-25T09:55:23.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.134+0000 7fbe1799b640 1 Processor -- start 2024-04-25T09:55:23.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.134+0000 7fbe1799b640 1 -- start start 2024-04-25T09:55:23.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.134+0000 7fbe1799b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe1006e970 0x7fbe10141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:23.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.134+0000 7fbe1799b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe100c5010 0x7fbe100cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:23.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.134+0000 7fbe1799b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe10151720 0x7fbe1014c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:23.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.134+0000 7fbe1799b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe10151b00 con 0x7fbe10151720 2024-04-25T09:55:23.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.134+0000 7fbe1799b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe100ce090 con 0x7fbe100c5010 2024-04-25T09:55:23.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.134+0000 7fbe1799b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe100ce5b0 con 0x7fbe1006e970 2024-04-25T09:55:23.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.134+0000 7fbe15f38640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe10151720 0x7fbe1014c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:23.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.134+0000 7fbe15f38640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe10151720 0x7fbe1014c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36566/0 (socket says 172.21.15.7:36566) 2024-04-25T09:55:23.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.135+0000 7fbe15f38640 1 -- 172.21.15.7:0/1507184681 learned_addr learned my addr 172.21.15.7:0/1507184681 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:23.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.135+0000 7fbe14f36640 1 --2- 172.21.15.7:0/1507184681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe100c5010 0x7fbe100cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:23.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.135+0000 7fbe15737640 1 --2- 172.21.15.7:0/1507184681 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe1006e970 0x7fbe10141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:23.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.135+0000 7fbe15f38640 1 -- 172.21.15.7:0/1507184681 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe1006e970 msgr2=0x7fbe10141fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:23.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.135+0000 7fbe15f38640 1 --2- 172.21.15.7:0/1507184681 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe1006e970 0x7fbe10141fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:23.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.135+0000 7fbe15f38640 1 -- 172.21.15.7:0/1507184681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe100c5010 msgr2=0x7fbe100cc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:23.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.135+0000 7fbe15f38640 1 --2- 172.21.15.7:0/1507184681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe100c5010 0x7fbe100cc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:23.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.135+0000 7fbe15f38640 1 -- 172.21.15.7:0/1507184681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe100cb270 con 0x7fbe10151720 2024-04-25T09:55:23.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.135+0000 7fbe15737640 1 --2- 172.21.15.7:0/1507184681 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe1006e970 0x7fbe10141fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:23.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.135+0000 7fbe15f38640 1 --2- 172.21.15.7:0/1507184681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe10151720 0x7fbe1014c7e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbe00009eb0 tx=0x7fbe00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:23.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.135+0000 7fbe0dffb640 1 -- 172.21.15.7:0/1507184681 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00040070 con 0x7fbe10151720 2024-04-25T09:55:23.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.135+0000 7fbe0dffb640 1 -- 172.21.15.7:0/1507184681 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe00031c90 con 0x7fbe10151720 2024-04-25T09:55:23.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.135+0000 7fbe1799b640 1 -- 172.21.15.7:0/1507184681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe100cb550 con 0x7fbe10151720 2024-04-25T09:55:23.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.135+0000 7fbe0dffb640 1 -- 172.21.15.7:0/1507184681 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00045680 con 0x7fbe10151720 2024-04-25T09:55:23.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.135+0000 7fbe1799b640 1 -- 172.21.15.7:0/1507184681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe100cbb10 con 0x7fbe10151720 2024-04-25T09:55:23.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.136+0000 7fbe1799b640 1 -- 172.21.15.7:0/1507184681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe10068fd0 con 0x7fbe10151720 2024-04-25T09:55:23.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.137+0000 7fbe0dffb640 1 -- 172.21.15.7:0/1507184681 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbe00039040 con 0x7fbe10151720 2024-04-25T09:55:23.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.137+0000 7fbe0dffb640 1 --2- 172.21.15.7:0/1507184681 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbdfc06b4d0 0x7fbdfc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:23.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.137+0000 7fbe0dffb640 1 -- 172.21.15.7:0/1507184681 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fbe000abfa0 con 0x7fbe10151720 2024-04-25T09:55:23.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.137+0000 7fbe15737640 1 --2- 172.21.15.7:0/1507184681 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbdfc06b4d0 0x7fbdfc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:23.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.138+0000 7fbe15737640 1 --2- 172.21.15.7:0/1507184681 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbdfc06b4d0 0x7fbdfc06d990 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbe08000f60 tx=0x7fbe08009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:23.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.141+0000 7fbe0dffb640 1 -- 172.21.15.7:0/1507184681 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbe0007ab70 con 0x7fbe10151720 2024-04-25T09:55:23.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.359+0000 7fbe1799b640 1 -- 172.21.15.7:0/1507184681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe100b1790 con 0x7fbe10151720 2024-04-25T09:55:23.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.359+0000 7fbe0dffb640 1 -- 172.21.15.7:0/1507184681 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4928 (secure 0 0 0) 0x7fbe0007a470 con 0x7fbe10151720 2024-04-25T09:55:23.362 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:23.362 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1968579214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1968579214},{"type":"v1","addr":"172.21.15.7:6837","nonce":1968579214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3479570567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3479570567},{"type":"v1","addr":"172.21.15.55:6834","nonce":3479570567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/2289657027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2289657027},{"type":"v1","addr":"172.21.15.7:6836","nonce":2289657027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:54:27.558601+0000","modified":"2024-04-25T09:54:43.635854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/3779228372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3779228372},{"type":"v1","addr":"172.21.15.55:6835","nonce":3779228372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:55:23.363 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 8 2024-04-25T09:55:23.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.361+0000 7fbe1799b640 1 -- 172.21.15.7:0/1507184681 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbdfc06b4d0 msgr2=0x7fbdfc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:23.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.361+0000 7fbe1799b640 1 --2- 172.21.15.7:0/1507184681 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbdfc06b4d0 0x7fbdfc06d990 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbe08000f60 tx=0x7fbe08009040 comp rx=0 tx=0).stop 2024-04-25T09:55:23.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.361+0000 7fbe1799b640 1 -- 172.21.15.7:0/1507184681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe10151720 msgr2=0x7fbe1014c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:23.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.361+0000 7fbe1799b640 1 --2- 172.21.15.7:0/1507184681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe10151720 0x7fbe1014c7e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbe00009eb0 tx=0x7fbe00004a40 comp rx=0 tx=0).stop 2024-04-25T09:55:23.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.361+0000 7fbe1799b640 1 -- 172.21.15.7:0/1507184681 shutdown_connections 2024-04-25T09:55:23.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.361+0000 7fbe1799b640 1 --2- 172.21.15.7:0/1507184681 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbdfc06b4d0 0x7fbdfc06d990 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:23.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.361+0000 7fbe1799b640 1 --2- 172.21.15.7:0/1507184681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe10151720 0x7fbe1014c7e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:23.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.361+0000 7fbe1799b640 1 --2- 172.21.15.7:0/1507184681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe100c5010 0x7fbe100cc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:23.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.361+0000 7fbe1799b640 1 --2- 172.21.15.7:0/1507184681 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe1006e970 0x7fbe10141fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:23.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.361+0000 7fbe1799b640 1 -- 172.21.15.7:0/1507184681 >> 172.21.15.7:0/1507184681 conn(0x7fbe10071150 msgr2=0x7fbe101588d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:23.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.361+0000 7fbe1799b640 1 -- 172.21.15.7:0/1507184681 shutdown_connections 2024-04-25T09:55:23.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.361+0000 7fbe1799b640 1 -- 172.21.15.7:0/1507184681 wait complete. 2024-04-25T09:55:23.375 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:55:23.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.473+0000 7fe8b17e7640 1 Processor -- start 2024-04-25T09:55:23.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.473+0000 7fe8b17e7640 1 -- start start 2024-04-25T09:55:23.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.474+0000 7fe8b17e7640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe8ac0d0a50 0x7fe8ac0d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:23.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.474+0000 7fe8b17e7640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8ac0d1e80 con 0x7fe8ac0b53b0 2024-04-25T09:55:23.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.474+0000 7fe8b17e7640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8ac0b5930 con 0x7fe8ac15db00 2024-04-25T09:55:23.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.474+0000 7fe8b17e7640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac0b5c10 con 0x7fe8ac0d0a50 2024-04-25T09:55:23.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.474+0000 7fe8ab7fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe8ac0b53b0 0x7fe8ac0d2870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34080/0 (socket says 172.21.15.7:34080) 2024-04-25T09:55:23.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.474+0000 7fe8ab7fe640 1 -- 172.21.15.7:0/4138489223 learned_addr learned my addr 172.21.15.7:0/4138489223 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:23.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.474+0000 7fe8aa7fc640 1 --2- 172.21.15.7:0/4138489223 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe8ac0d0a50 0x7fe8ac0d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:23.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.474+0000 7fe8a9ffb640 1 -- 172.21.15.7:0/4138489223 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2044240315 0 0) 0x7fe8ac0d1e80 con 0x7fe8ac0b53b0 2024-04-25T09:55:23.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.474+0000 7fe8a9ffb640 1 -- 172.21.15.7:0/4138489223 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe894003520 con 0x7fe8ac0b53b0 2024-04-25T09:55:23.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.474+0000 7fe8a9ffb640 1 -- 172.21.15.7:0/4138489223 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 861852459 0 0) 0x7fe894003520 con 0x7fe8ac0b53b0 2024-04-25T09:55:23.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.474+0000 7fe8a9ffb640 1 -- 172.21.15.7:0/4138489223 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe8ac0d0a50 msgr2=0x7fe8ac0d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:23.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.474+0000 7fe8a9ffb640 1 --2- 172.21.15.7:0/4138489223 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe8ac0d0a50 0x7fe8ac0d2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:23.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.474+0000 7fe8a9ffb640 1 -- 172.21.15.7:0/4138489223 >> v1:172.21.15.55:6789/0 conn(0x7fe8ac15db00 legacy=0x7fe8ac0d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:23.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.474+0000 7fe8a9ffb640 1 -- 172.21.15.7:0/4138489223 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ac0b5ef0 con 0x7fe8ac0b53b0 2024-04-25T09:55:23.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.474+0000 7fe8a9ffb640 1 -- 172.21.15.7:0/4138489223 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fe8a40019f0 con 0x7fe8ac0b53b0 2024-04-25T09:55:23.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.475+0000 7fe8a9ffb640 1 -- 172.21.15.7:0/4138489223 >> v1:172.21.15.7:6789/0 conn(0x7fe8ac0b53b0 legacy=0x7fe8ac0d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:23.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.475+0000 7fe8a9ffb640 1 --2- 172.21.15.7:0/4138489223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8940039e0 0x7fe894003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:23.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.475+0000 7fe8a9ffb640 1 --2- 172.21.15.7:0/4138489223 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe8ac0d0a50 0x7fe894004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:23.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.475+0000 7fe8a9ffb640 1 --2- 172.21.15.7:0/4138489223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe894004d40 0x7fe8940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:23.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.475+0000 7fe8a9ffb640 1 -- 172.21.15.7:0/4138489223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac0b5c10 con 0x7fe8940039e0 2024-04-25T09:55:23.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.475+0000 7fe8a9ffb640 1 -- 172.21.15.7:0/4138489223 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89400ba70 con 0x7fe894004d40 2024-04-25T09:55:23.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.475+0000 7fe8a9ffb640 1 -- 172.21.15.7:0/4138489223 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89400bc70 con 0x7fe8ac0d0a50 2024-04-25T09:55:23.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.475+0000 7fe8aaffd640 1 --2- 172.21.15.7:0/4138489223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8940039e0 0x7fe894003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:23.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.475+0000 7fe8ab7fe640 1 --2- 172.21.15.7:0/4138489223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe894004d40 0x7fe8940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:23.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.475+0000 7fe8aa7fc640 1 --2- 172.21.15.7:0/4138489223 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe8ac0d0a50 0x7fe894004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:23.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.475+0000 7fe8aaffd640 1 -- 172.21.15.7:0/4138489223 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe8ac0d0a50 msgr2=0x7fe894004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:23.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.475+0000 7fe8aaffd640 1 --2- 172.21.15.7:0/4138489223 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe8ac0d0a50 0x7fe894004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:23.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.475+0000 7fe8aaffd640 1 -- 172.21.15.7:0/4138489223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe894004d40 msgr2=0x7fe8940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:23.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.475+0000 7fe8aaffd640 1 --2- 172.21.15.7:0/4138489223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe894004d40 0x7fe8940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:23.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.475+0000 7fe8aaffd640 1 -- 172.21.15.7:0/4138489223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe894003520 con 0x7fe8940039e0 2024-04-25T09:55:23.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.476+0000 7fe8aaffd640 1 --2- 172.21.15.7:0/4138489223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8940039e0 0x7fe894003e00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe89c001720 tx=0x7fe894005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bbb0823793c4bec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:23.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.476+0000 7fe8a9ffb640 1 -- 172.21.15.7:0/4138489223 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c001370 con 0x7fe8940039e0 2024-04-25T09:55:23.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.476+0000 7fe8a9ffb640 1 -- 172.21.15.7:0/4138489223 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89c0052d0 con 0x7fe8940039e0 2024-04-25T09:55:23.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.476+0000 7fe8a9ffb640 1 -- 172.21.15.7:0/4138489223 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c02abc0 con 0x7fe8940039e0 2024-04-25T09:55:23.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.476+0000 7fe8b17e7640 1 -- 172.21.15.7:0/4138489223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8940039e0 msgr2=0x7fe894003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:23.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.476+0000 7fe8b17e7640 1 --2- 172.21.15.7:0/4138489223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8940039e0 0x7fe894003e00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe89c001720 tx=0x7fe894005830 comp rx=0 tx=0).stop 2024-04-25T09:55:23.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.476+0000 7fe8ab7fe640 1 -- 172.21.15.7:0/4138489223 reap_dead start 2024-04-25T09:55:23.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.476+0000 7fe8b17e7640 1 -- 172.21.15.7:0/4138489223 shutdown_connections 2024-04-25T09:55:23.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.476+0000 7fe8b17e7640 1 -- 172.21.15.7:0/4138489223 >> 172.21.15.7:0/4138489223 conn(0x7fe8ac072290 msgr2=0x7fe8ac0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:23.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.476+0000 7fe8b17e7640 1 -- 172.21.15.7:0/4138489223 shutdown_connections 2024-04-25T09:55:23.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.476+0000 7fe8b17e7640 1 -- 172.21.15.7:0/4138489223 wait complete. 2024-04-25T09:55:23.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.478+0000 7fe8b17e7640 1 Processor -- start 2024-04-25T09:55:23.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.478+0000 7fe8b17e7640 1 -- start start 2024-04-25T09:55:23.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.478+0000 7fe8b17e7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8940039e0 0x7fe8ac0cd630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:23.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.478+0000 7fe8b17e7640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe8ac0caa00 0x7fe8ac1524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:23.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.478+0000 7fe8b17e7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8ac1580e0 0x7fe8ac158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:23.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.478+0000 7fe8b17e7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac0d3660 con 0x7fe8940039e0 2024-04-25T09:55:23.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.478+0000 7fe8b17e7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac0b61d0 con 0x7fe8ac1580e0 2024-04-25T09:55:23.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.478+0000 7fe8b17e7640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac0d2f80 con 0x7fe8ac0caa00 2024-04-25T09:55:23.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.479+0000 7fe8aaffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8940039e0 0x7fe8ac0cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:23.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.479+0000 7fe8aaffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8940039e0 0x7fe8ac0cd630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36584/0 (socket says 172.21.15.7:36584) 2024-04-25T09:55:23.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.479+0000 7fe8aaffd640 1 -- 172.21.15.7:0/1069774673 learned_addr learned my addr 172.21.15.7:0/1069774673 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:23.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.479+0000 7fe8ab7fe640 1 --2- 172.21.15.7:0/1069774673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8ac1580e0 0x7fe8ac158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:23.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.479+0000 7fe8aa7fc640 1 --2- 172.21.15.7:0/1069774673 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe8ac0caa00 0x7fe8ac1524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:23.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.479+0000 7fe8aaffd640 1 -- 172.21.15.7:0/1069774673 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe8ac0caa00 msgr2=0x7fe8ac1524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:23.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.479+0000 7fe8aaffd640 1 --2- 172.21.15.7:0/1069774673 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe8ac0caa00 0x7fe8ac1524d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:23.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.479+0000 7fe8aaffd640 1 -- 172.21.15.7:0/1069774673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8ac1580e0 msgr2=0x7fe8ac158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:23.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.479+0000 7fe8aaffd640 1 --2- 172.21.15.7:0/1069774673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8ac1580e0 0x7fe8ac158590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:23.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.479+0000 7fe8aaffd640 1 -- 172.21.15.7:0/1069774673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ac1597e0 con 0x7fe8940039e0 2024-04-25T09:55:23.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.479+0000 7fe8aaffd640 1 --2- 172.21.15.7:0/1069774673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8940039e0 0x7fe8ac0cd630 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe89c008fd0 tx=0x7fe89c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:23.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.479+0000 7fe8937fe640 1 -- 172.21.15.7:0/1069774673 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c042070 con 0x7fe8940039e0 2024-04-25T09:55:23.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.479+0000 7fe8937fe640 1 -- 172.21.15.7:0/1069774673 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89c005480 con 0x7fe8940039e0 2024-04-25T09:55:23.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.479+0000 7fe8b17e7640 1 -- 172.21.15.7:0/1069774673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8ac0caf70 con 0x7fe8940039e0 2024-04-25T09:55:23.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.479+0000 7fe8937fe640 1 -- 172.21.15.7:0/1069774673 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c037040 con 0x7fe8940039e0 2024-04-25T09:55:23.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.479+0000 7fe8b17e7640 1 -- 172.21.15.7:0/1069774673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8ac15f800 con 0x7fe8940039e0 2024-04-25T09:55:23.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.480+0000 7fe8b17e7640 1 -- 172.21.15.7:0/1069774673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8ac068fd0 con 0x7fe8940039e0 2024-04-25T09:55:23.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.481+0000 7fe8937fe640 1 -- 172.21.15.7:0/1069774673 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe89c045070 con 0x7fe8940039e0 2024-04-25T09:55:23.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.481+0000 7fe8937fe640 1 --2- 172.21.15.7:0/1069774673 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe89806b500 0x7fe89806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:23.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.481+0000 7fe8937fe640 1 -- 172.21.15.7:0/1069774673 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fe89c0a9c60 con 0x7fe8940039e0 2024-04-25T09:55:23.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.481+0000 7fe8aa7fc640 1 --2- 172.21.15.7:0/1069774673 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe89806b500 0x7fe89806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:23.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.481+0000 7fe8aa7fc640 1 --2- 172.21.15.7:0/1069774673 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe89806b500 0x7fe89806d9c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac15ceb0 tx=0x7fe8a0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:23.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.485+0000 7fe8937fe640 1 -- 172.21.15.7:0/1069774673 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe89c078090 con 0x7fe8940039e0 2024-04-25T09:55:23.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.703+0000 7fe8b17e7640 1 -- 172.21.15.7:0/1069774673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8ac0d16b0 con 0x7fe8940039e0 2024-04-25T09:55:23.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.704+0000 7fe8937fe640 1 -- 172.21.15.7:0/1069774673 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4928 (secure 0 0 0) 0x7fe89c0a9070 con 0x7fe8940039e0 2024-04-25T09:55:23.707 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:23.707 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1968579214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1968579214},{"type":"v1","addr":"172.21.15.7:6837","nonce":1968579214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3479570567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3479570567},{"type":"v1","addr":"172.21.15.55:6834","nonce":3479570567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/2289657027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2289657027},{"type":"v1","addr":"172.21.15.7:6836","nonce":2289657027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:54:27.558601+0000","modified":"2024-04-25T09:54:43.635854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/3779228372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3779228372},{"type":"v1","addr":"172.21.15.55:6835","nonce":3779228372}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:55:23.707 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 8 2024-04-25T09:55:23.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.706+0000 7fe8b17e7640 1 -- 172.21.15.7:0/1069774673 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe89806b500 msgr2=0x7fe89806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:23.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.706+0000 7fe8b17e7640 1 --2- 172.21.15.7:0/1069774673 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe89806b500 0x7fe89806d9c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac15ceb0 tx=0x7fe8a0008040 comp rx=0 tx=0).stop 2024-04-25T09:55:23.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.706+0000 7fe8b17e7640 1 -- 172.21.15.7:0/1069774673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8940039e0 msgr2=0x7fe8ac0cd630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:23.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.706+0000 7fe8b17e7640 1 --2- 172.21.15.7:0/1069774673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8940039e0 0x7fe8ac0cd630 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe89c008fd0 tx=0x7fe89c001120 comp rx=0 tx=0).stop 2024-04-25T09:55:23.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.706+0000 7fe8b17e7640 1 -- 172.21.15.7:0/1069774673 shutdown_connections 2024-04-25T09:55:23.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.706+0000 7fe8b17e7640 1 --2- 172.21.15.7:0/1069774673 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe89806b500 0x7fe89806d9c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:23.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.706+0000 7fe8b17e7640 1 --2- 172.21.15.7:0/1069774673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8ac1580e0 0x7fe8ac158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:23.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.706+0000 7fe8b17e7640 1 --2- 172.21.15.7:0/1069774673 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe8ac0caa00 0x7fe8ac1524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:23.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.706+0000 7fe8b17e7640 1 --2- 172.21.15.7:0/1069774673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8940039e0 0x7fe8ac0cd630 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:23.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.706+0000 7fe8b17e7640 1 -- 172.21.15.7:0/1069774673 >> 172.21.15.7:0/1069774673 conn(0x7fe8ac072290 msgr2=0x7fe8ac157130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:23.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.706+0000 7fe8b17e7640 1 -- 172.21.15.7:0/1069774673 shutdown_connections 2024-04-25T09:55:23.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.706+0000 7fe8b17e7640 1 -- 172.21.15.7:0/1069774673 wait complete. 2024-04-25T09:55:23.720 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:55:23.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.818+0000 7f39b8bd5640 1 Processor -- start 2024-04-25T09:55:23.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.818+0000 7f39b8bd5640 1 -- start start 2024-04-25T09:55:23.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.819+0000 7f39b8bd5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39b415dc10 0x7f39b41615f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:23.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.819+0000 7f39b8bd5640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f39b4161b30 0x7f39b40d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:23.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.819+0000 7f39b8bd5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f39b40b6b90 0x7f39b40d0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:23.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.819+0000 7f39b8bd5640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b40d1d90 con 0x7f39b4161b30 2024-04-25T09:55:23.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.819+0000 7f39b8bd5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b4162040 con 0x7f39b40b6b90 2024-04-25T09:55:23.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.819+0000 7f39b8bd5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b4162320 con 0x7f39b415dc10 2024-04-25T09:55:23.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.819+0000 7f39b1d9b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f39b4161b30 0x7f39b40d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:23.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.819+0000 7f39b1d9b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f39b4161b30 0x7f39b40d0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36594/0 (socket says 172.21.15.7:36594) 2024-04-25T09:55:23.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.819+0000 7f39b1d9b640 1 -- 172.21.15.7:0/847381706 learned_addr learned my addr 172.21.15.7:0/847381706 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:23.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.819+0000 7f39b2d9d640 1 --2- 172.21.15.7:0/847381706 >> v2:172.21.15.55:3300/0 conn(0x7f39b40b6b90 0x7f39b40d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:23.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.819+0000 7f39b259c640 1 --2- 172.21.15.7:0/847381706 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39b415dc10 0x7f39b41615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:23.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.819+0000 7f39b1d9b640 1 -- 172.21.15.7:0/847381706 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39b415dc10 msgr2=0x7f39b41615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:23.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.819+0000 7f39b1d9b640 1 --2- 172.21.15.7:0/847381706 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39b415dc10 0x7f39b41615f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:23.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.819+0000 7f39b1d9b640 1 -- 172.21.15.7:0/847381706 >> v2:172.21.15.55:3300/0 conn(0x7f39b40b6b90 msgr2=0x7f39b40d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:23.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.819+0000 7f39b1d9b640 1 --2- 172.21.15.7:0/847381706 >> v2:172.21.15.55:3300/0 conn(0x7f39b40b6b90 0x7f39b40d0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:23.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.819+0000 7f39b1d9b640 1 -- 172.21.15.7:0/847381706 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b40d1fe0 con 0x7f39b4161b30 2024-04-25T09:55:23.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.820+0000 7f39b1d9b640 1 --2- 172.21.15.7:0/847381706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39b4161b30 0x7f39b40d0240 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f39b40b6470 tx=0x7f399c02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1dcb3e959df41a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:23.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.820+0000 7f39b159a640 1 -- 172.21.15.7:0/847381706 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c037070 con 0x7f39b4161b30 2024-04-25T09:55:23.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.820+0000 7f39b159a640 1 -- 172.21.15.7:0/847381706 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399c02ae00 con 0x7f39b4161b30 2024-04-25T09:55:23.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.820+0000 7f39b159a640 1 -- 172.21.15.7:0/847381706 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c032660 con 0x7f39b4161b30 2024-04-25T09:55:23.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.821+0000 7f39b8bd5640 1 -- 172.21.15.7:0/847381706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39b4161b30 msgr2=0x7f39b40d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:23.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.821+0000 7f39b8bd5640 1 --2- 172.21.15.7:0/847381706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39b4161b30 0x7f39b40d0240 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f39b40b6470 tx=0x7f399c02a0b0 comp rx=0 tx=0).stop 2024-04-25T09:55:23.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.821+0000 7f39b8bd5640 1 -- 172.21.15.7:0/847381706 shutdown_connections 2024-04-25T09:55:23.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.821+0000 7f39b8bd5640 1 --2- 172.21.15.7:0/847381706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39b4161b30 0x7f39b40d0240 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:23.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.821+0000 7f39b8bd5640 1 --2- 172.21.15.7:0/847381706 >> v2:172.21.15.55:3300/0 conn(0x7f39b40b6b90 0x7f39b40d0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:23.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.821+0000 7f39b8bd5640 1 --2- 172.21.15.7:0/847381706 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39b415dc10 0x7f39b41615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:23.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.821+0000 7f39b8bd5640 1 -- 172.21.15.7:0/847381706 >> 172.21.15.7:0/847381706 conn(0x7f39b4072290 msgr2=0x7f39b40726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:23.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.821+0000 7f39b8bd5640 1 -- 172.21.15.7:0/847381706 shutdown_connections 2024-04-25T09:55:23.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.821+0000 7f39b8bd5640 1 -- 172.21.15.7:0/847381706 wait complete. 2024-04-25T09:55:23.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.822+0000 7f39b8bd5640 1 Processor -- start 2024-04-25T09:55:23.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.822+0000 7f39b8bd5640 1 -- start start 2024-04-25T09:55:23.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.823+0000 7f39b8bd5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39b40b6b90 0x7f39b414fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:23.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.823+0000 7f39b8bd5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39b415dc10 0x7f39b40c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:23.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.823+0000 7f39b8bd5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39b4161b30 0x7f39b415f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:23.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.823+0000 7f39b8bd5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40b54b0 con 0x7f39b40b6b90 2024-04-25T09:55:23.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.823+0000 7f39b8bd5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40b5330 con 0x7f39b4161b30 2024-04-25T09:55:23.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.823+0000 7f39b8bd5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40b5630 con 0x7f39b415dc10 2024-04-25T09:55:23.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.823+0000 7f39b259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39b40b6b90 0x7f39b414fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:23.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.823+0000 7f39b259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39b40b6b90 0x7f39b414fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36606/0 (socket says 172.21.15.7:36606) 2024-04-25T09:55:23.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.823+0000 7f39b259c640 1 -- 172.21.15.7:0/1316959163 learned_addr learned my addr 172.21.15.7:0/1316959163 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:23.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.823+0000 7f39b2d9d640 1 --2- 172.21.15.7:0/1316959163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39b4161b30 0x7f39b415f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:23.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.823+0000 7f39b1d9b640 1 --2- 172.21.15.7:0/1316959163 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39b415dc10 0x7f39b40c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:23.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.823+0000 7f39b259c640 1 -- 172.21.15.7:0/1316959163 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39b415dc10 msgr2=0x7f39b40c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:23.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.823+0000 7f39b259c640 1 --2- 172.21.15.7:0/1316959163 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39b415dc10 0x7f39b40c7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:23.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.823+0000 7f39b259c640 1 -- 172.21.15.7:0/1316959163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39b4161b30 msgr2=0x7f39b415f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:23.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.823+0000 7f39b259c640 1 --2- 172.21.15.7:0/1316959163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39b4161b30 0x7f39b415f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:23.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.823+0000 7f39b259c640 1 -- 172.21.15.7:0/1316959163 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b40c8420 con 0x7f39b40b6b90 2024-04-25T09:55:23.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.824+0000 7f39b259c640 1 --2- 172.21.15.7:0/1316959163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39b40b6b90 0x7f39b414fd10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f39ac007ef0 tx=0x7f39ac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:23.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.824+0000 7f39aaffd640 1 -- 172.21.15.7:0/1316959163 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac014620 con 0x7f39b40b6b90 2024-04-25T09:55:23.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.824+0000 7f39aaffd640 1 -- 172.21.15.7:0/1316959163 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ac019070 con 0x7f39b40b6b90 2024-04-25T09:55:23.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.824+0000 7f39b8bd5640 1 -- 172.21.15.7:0/1316959163 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b40c8700 con 0x7f39b40b6b90 2024-04-25T09:55:23.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.824+0000 7f39aaffd640 1 -- 172.21.15.7:0/1316959163 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac014a00 con 0x7f39b40b6b90 2024-04-25T09:55:23.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.824+0000 7f39b8bd5640 1 -- 172.21.15.7:0/1316959163 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b40c8cc0 con 0x7f39b40b6b90 2024-04-25T09:55:23.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.825+0000 7f39b8bd5640 1 -- 172.21.15.7:0/1316959163 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b4068fd0 con 0x7f39b40b6b90 2024-04-25T09:55:23.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.825+0000 7f39aaffd640 1 -- 172.21.15.7:0/1316959163 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f39ac014ba0 con 0x7f39b40b6b90 2024-04-25T09:55:23.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.826+0000 7f39aaffd640 1 --2- 172.21.15.7:0/1316959163 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f399406b4d0 0x7f399406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:23.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.826+0000 7f39aaffd640 1 -- 172.21.15.7:0/1316959163 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f39ac08af50 con 0x7f39b40b6b90 2024-04-25T09:55:23.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.826+0000 7f39b1d9b640 1 --2- 172.21.15.7:0/1316959163 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f399406b4d0 0x7f399406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:23.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.826+0000 7f39b1d9b640 1 --2- 172.21.15.7:0/1316959163 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f399406b4d0 0x7f399406d990 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f399c034000 tx=0x7f399c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:23.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:23.830+0000 7f39aaffd640 1 -- 172.21.15.7:0/1316959163 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f39ac0599c0 con 0x7f39b40b6b90 2024-04-25T09:55:24.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.019+0000 7f39b8bd5640 1 -- 172.21.15.7:0/1316959163 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39b4150410 con 0x7f39b40b6b90 2024-04-25T09:55:24.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.020+0000 7f39aaffd640 1 -- 172.21.15.7:0/1316959163 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18807 (secure 0 0 0) 0x7f39ac0592c0 con 0x7f39b40b6b90 2024-04-25T09:55:24.023 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:24.023 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:55:09.591504+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:54:26.011833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:54:26.535536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:54:30.264996+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:55:24.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.022+0000 7f39b8bd5640 1 -- 172.21.15.7:0/1316959163 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f399406b4d0 msgr2=0x7f399406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:24.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.022+0000 7f39b8bd5640 1 --2- 172.21.15.7:0/1316959163 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f399406b4d0 0x7f399406d990 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f399c034000 tx=0x7f399c02e000 comp rx=0 tx=0).stop 2024-04-25T09:55:24.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.022+0000 7f39b8bd5640 1 -- 172.21.15.7:0/1316959163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39b40b6b90 msgr2=0x7f39b414fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:24.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.022+0000 7f39b8bd5640 1 --2- 172.21.15.7:0/1316959163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39b40b6b90 0x7f39b414fd10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f39ac007ef0 tx=0x7f39ac00e4b0 comp rx=0 tx=0).stop 2024-04-25T09:55:24.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.023+0000 7f39b8bd5640 1 -- 172.21.15.7:0/1316959163 shutdown_connections 2024-04-25T09:55:24.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.023+0000 7f39b8bd5640 1 --2- 172.21.15.7:0/1316959163 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f399406b4d0 0x7f399406d990 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:24.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.023+0000 7f39b8bd5640 1 --2- 172.21.15.7:0/1316959163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39b4161b30 0x7f39b415f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:24.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.023+0000 7f39b8bd5640 1 --2- 172.21.15.7:0/1316959163 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39b415dc10 0x7f39b40c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:24.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.023+0000 7f39b8bd5640 1 --2- 172.21.15.7:0/1316959163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39b40b6b90 0x7f39b414fd10 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:24.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.023+0000 7f39b8bd5640 1 -- 172.21.15.7:0/1316959163 >> 172.21.15.7:0/1316959163 conn(0x7f39b4072290 msgr2=0x7f39b40b87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:24.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.023+0000 7f39b8bd5640 1 -- 172.21.15.7:0/1316959163 shutdown_connections 2024-04-25T09:55:24.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.023+0000 7f39b8bd5640 1 -- 172.21.15.7:0/1316959163 wait complete. 2024-04-25T09:55:24.037 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:55:24.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.136+0000 7ff0df509640 1 Processor -- start 2024-04-25T09:55:24.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.137+0000 7ff0df509640 1 -- start start 2024-04-25T09:55:24.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.137+0000 7ff0df509640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0d815db00 0x7ff0d80d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:24.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.137+0000 7ff0df509640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff0d80b53b0 0x7ff0d80d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:24.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.137+0000 7ff0df509640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d80d1e80 con 0x7ff0d80ce2b0 2024-04-25T09:55:24.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.137+0000 7ff0df509640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d80b5930 con 0x7ff0d80b53b0 2024-04-25T09:55:24.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.137+0000 7ff0df509640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d80b5c10 con 0x7ff0d815db00 2024-04-25T09:55:24.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.137+0000 7ff0ddaa6640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff0d80ce2b0 0x7ff0d8161670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34084/0 (socket says 172.21.15.7:34084) 2024-04-25T09:55:24.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.138+0000 7ff0ddaa6640 1 -- 172.21.15.7:0/435208193 learned_addr learned my addr 172.21.15.7:0/435208193 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:24.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.138+0000 7ff0dcaa4640 1 --2- 172.21.15.7:0/435208193 >> v2:172.21.15.55:3300/0 conn(0x7ff0d80b53b0 0x7ff0d80d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:24.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.138+0000 7ff0dd2a5640 1 --2- 172.21.15.7:0/435208193 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0d815db00 0x7ff0d80d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:24.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.138+0000 7ff0cffff640 1 -- 172.21.15.7:0/435208193 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 452054801 0 0) 0x7ff0d80d1e80 con 0x7ff0d80ce2b0 2024-04-25T09:55:24.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.138+0000 7ff0cffff640 1 -- 172.21.15.7:0/435208193 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0c4003520 con 0x7ff0d80ce2b0 2024-04-25T09:55:24.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.138+0000 7ff0cffff640 1 -- 172.21.15.7:0/435208193 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3953636744 0 0) 0x7ff0c4003520 con 0x7ff0d80ce2b0 2024-04-25T09:55:24.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.138+0000 7ff0cffff640 1 -- 172.21.15.7:0/435208193 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0d815db00 msgr2=0x7ff0d80d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:24.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.138+0000 7ff0cffff640 1 --2- 172.21.15.7:0/435208193 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0d815db00 0x7ff0d80d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:24.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.138+0000 7ff0cffff640 1 -- 172.21.15.7:0/435208193 >> v2:172.21.15.55:3300/0 conn(0x7ff0d80b53b0 msgr2=0x7ff0d80d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:24.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.138+0000 7ff0cffff640 1 --2- 172.21.15.7:0/435208193 >> v2:172.21.15.55:3300/0 conn(0x7ff0d80b53b0 0x7ff0d80d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:24.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.138+0000 7ff0cffff640 1 -- 172.21.15.7:0/435208193 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d80b5ef0 con 0x7ff0d80ce2b0 2024-04-25T09:55:24.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.138+0000 7ff0cffff640 1 -- 172.21.15.7:0/435208193 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7ff0d00019f0 con 0x7ff0d80ce2b0 2024-04-25T09:55:24.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.138+0000 7ff0dcaa4640 1 --2- 172.21.15.7:0/435208193 >> v2:172.21.15.55:3300/0 conn(0x7ff0d80b53b0 0x7ff0d80d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:55:24.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.138+0000 7ff0cffff640 1 -- 172.21.15.7:0/435208193 >> v1:172.21.15.7:6789/0 conn(0x7ff0d80ce2b0 legacy=0x7ff0d8161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:24.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.138+0000 7ff0cffff640 1 --2- 172.21.15.7:0/435208193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0c40039b0 0x7ff0c4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:24.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.138+0000 7ff0cffff640 1 --2- 172.21.15.7:0/435208193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0c4004800 0x7ff0c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:24.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.138+0000 7ff0cffff640 1 --2- 172.21.15.7:0/435208193 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0d815db00 0x7ff0c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:24.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.138+0000 7ff0cffff640 1 -- 172.21.15.7:0/435208193 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d80b5930 con 0x7ff0c4004800 2024-04-25T09:55:24.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.138+0000 7ff0cffff640 1 -- 172.21.15.7:0/435208193 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d80b5c10 con 0x7ff0c40039b0 2024-04-25T09:55:24.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.138+0000 7ff0cffff640 1 -- 172.21.15.7:0/435208193 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c400b9c0 con 0x7ff0d815db00 2024-04-25T09:55:24.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.138+0000 7ff0dcaa4640 1 --2- 172.21.15.7:0/435208193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0c4004800 0x7ff0c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:24.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.138+0000 7ff0dd2a5640 1 --2- 172.21.15.7:0/435208193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0c40039b0 0x7ff0c4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:24.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.138+0000 7ff0ddaa6640 1 --2- 172.21.15.7:0/435208193 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0d815db00 0x7ff0c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:24.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.139+0000 7ff0dcaa4640 1 -- 172.21.15.7:0/435208193 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0d815db00 msgr2=0x7ff0c40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:24.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.139+0000 7ff0dcaa4640 1 --2- 172.21.15.7:0/435208193 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0d815db00 0x7ff0c40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:24.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.139+0000 7ff0dcaa4640 1 -- 172.21.15.7:0/435208193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0c40039b0 msgr2=0x7ff0c4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:24.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.139+0000 7ff0dcaa4640 1 --2- 172.21.15.7:0/435208193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0c40039b0 0x7ff0c4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:24.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.139+0000 7ff0dcaa4640 1 -- 172.21.15.7:0/435208193 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c4003520 con 0x7ff0c4004800 2024-04-25T09:55:24.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.139+0000 7ff0ddaa6640 1 --2- 172.21.15.7:0/435208193 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0d815db00 0x7ff0c40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:24.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.139+0000 7ff0dcaa4640 1 --2- 172.21.15.7:0/435208193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0c4004800 0x7ff0c4004c80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8009c90 tx=0x7ff0c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d88a225047808b60 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:24.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.139+0000 7ff0cffff640 1 -- 172.21.15.7:0/435208193 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c8036070 con 0x7ff0c4004800 2024-04-25T09:55:24.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.139+0000 7ff0cffff640 1 -- 172.21.15.7:0/435208193 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c8031400 con 0x7ff0c4004800 2024-04-25T09:55:24.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.140+0000 7ff0cffff640 1 -- 172.21.15.7:0/435208193 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c8009860 con 0x7ff0c4004800 2024-04-25T09:55:24.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.140+0000 7ff0df509640 1 -- 172.21.15.7:0/435208193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0c4004800 msgr2=0x7ff0c4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:24.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.140+0000 7ff0df509640 1 --2- 172.21.15.7:0/435208193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0c4004800 0x7ff0c4004c80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8009c90 tx=0x7ff0c4005830 comp rx=0 tx=0).stop 2024-04-25T09:55:24.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.140+0000 7ff0ddaa6640 1 -- 172.21.15.7:0/435208193 reap_dead start 2024-04-25T09:55:24.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.140+0000 7ff0df509640 1 -- 172.21.15.7:0/435208193 shutdown_connections 2024-04-25T09:55:24.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.140+0000 7ff0df509640 1 -- 172.21.15.7:0/435208193 >> 172.21.15.7:0/435208193 conn(0x7ff0d8072290 msgr2=0x7ff0d80726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:24.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.140+0000 7ff0df509640 1 -- 172.21.15.7:0/435208193 shutdown_connections 2024-04-25T09:55:24.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.140+0000 7ff0df509640 1 -- 172.21.15.7:0/435208193 wait complete. 2024-04-25T09:55:24.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.141+0000 7ff0df509640 1 Processor -- start 2024-04-25T09:55:24.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.141+0000 7ff0df509640 1 -- start start 2024-04-25T09:55:24.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.142+0000 7ff0df509640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0c4004800 0x7ff0d815fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:24.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.142+0000 7ff0df509640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0d81560b0 0x7ff0d8149c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:24.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.142+0000 7ff0df509640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0d8159fa0 0x7ff0d815a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:24.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.142+0000 7ff0df509640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d80d3660 con 0x7ff0d8159fa0 2024-04-25T09:55:24.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.142+0000 7ff0df509640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d80b61d0 con 0x7ff0c4004800 2024-04-25T09:55:24.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.142+0000 7ff0df509640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d80b6c10 con 0x7ff0d81560b0 2024-04-25T09:55:24.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.142+0000 7ff0ddaa6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0d8159fa0 0x7ff0d815a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:24.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.142+0000 7ff0ddaa6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0d8159fa0 0x7ff0d815a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36636/0 (socket says 172.21.15.7:36636) 2024-04-25T09:55:24.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.142+0000 7ff0ddaa6640 1 -- 172.21.15.7:0/676905517 learned_addr learned my addr 172.21.15.7:0/676905517 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:24.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.142+0000 7ff0dd2a5640 1 --2- 172.21.15.7:0/676905517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0c4004800 0x7ff0d815fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:24.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.142+0000 7ff0dcaa4640 1 --2- 172.21.15.7:0/676905517 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0d81560b0 0x7ff0d8149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:24.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.143+0000 7ff0ddaa6640 1 -- 172.21.15.7:0/676905517 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0d81560b0 msgr2=0x7ff0d8149c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:24.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.143+0000 7ff0ddaa6640 1 --2- 172.21.15.7:0/676905517 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0d81560b0 0x7ff0d8149c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:24.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.143+0000 7ff0ddaa6640 1 -- 172.21.15.7:0/676905517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0c4004800 msgr2=0x7ff0d815fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:24.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.143+0000 7ff0ddaa6640 1 --2- 172.21.15.7:0/676905517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0c4004800 0x7ff0d815fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:24.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.143+0000 7ff0ddaa6640 1 -- 172.21.15.7:0/676905517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d8160600 con 0x7ff0d8159fa0 2024-04-25T09:55:24.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.143+0000 7ff0dd2a5640 1 --2- 172.21.15.7:0/676905517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0c4004800 0x7ff0d815fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:24.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.143+0000 7ff0ddaa6640 1 --2- 172.21.15.7:0/676905517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0d8159fa0 0x7ff0d815a420 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0000f80 tx=0x7ff0d000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:24.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.143+0000 7ff0cdffb640 1 -- 172.21.15.7:0/676905517 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d000eb30 con 0x7ff0d8159fa0 2024-04-25T09:55:24.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.143+0000 7ff0cdffb640 1 -- 172.21.15.7:0/676905517 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d000ecd0 con 0x7ff0d8159fa0 2024-04-25T09:55:24.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.143+0000 7ff0df509640 1 -- 172.21.15.7:0/676905517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d81608e0 con 0x7ff0d8159fa0 2024-04-25T09:55:24.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.143+0000 7ff0cdffb640 1 -- 172.21.15.7:0/676905517 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0014670 con 0x7ff0d8159fa0 2024-04-25T09:55:24.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.143+0000 7ff0df509640 1 -- 172.21.15.7:0/676905517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d80cbb20 con 0x7ff0d8159fa0 2024-04-25T09:55:24.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.144+0000 7ff0df509640 1 -- 172.21.15.7:0/676905517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d80cb910 con 0x7ff0d8159fa0 2024-04-25T09:55:24.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.145+0000 7ff0cdffb640 1 -- 172.21.15.7:0/676905517 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff0d0014810 con 0x7ff0d8159fa0 2024-04-25T09:55:24.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.145+0000 7ff0cdffb640 1 --2- 172.21.15.7:0/676905517 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff0bc06b4d0 0x7ff0bc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:24.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.145+0000 7ff0cdffb640 1 -- 172.21.15.7:0/676905517 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7ff0d008a2e0 con 0x7ff0d8159fa0 2024-04-25T09:55:24.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.145+0000 7ff0dd2a5640 1 --2- 172.21.15.7:0/676905517 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff0bc06b4d0 0x7ff0bc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:24.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.145+0000 7ff0dd2a5640 1 --2- 172.21.15.7:0/676905517 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff0bc06b4d0 0x7ff0bc06d990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff0d40099e0 tx=0x7ff0d4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:24.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.149+0000 7ff0cdffb640 1 -- 172.21.15.7:0/676905517 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff0d0058df0 con 0x7ff0d8159fa0 2024-04-25T09:55:24.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.370+0000 7ff0df509640 1 -- 172.21.15.7:0/676905517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff0d8068fd0 con 0x7ff0d8159fa0 2024-04-25T09:55:24.373 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-04-25T09:55:24.371+0000 7f45ad572640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:55:24.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.372+0000 7ff0cdffb640 1 -- 172.21.15.7:0/676905517 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff0d00586f0 con 0x7ff0d8159fa0 2024-04-25T09:55:24.375 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:55:24.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.375+0000 7ff0df509640 1 -- 172.21.15.7:0/676905517 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff0bc06b4d0 msgr2=0x7ff0bc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:24.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.376+0000 7ff0df509640 1 --2- 172.21.15.7:0/676905517 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff0bc06b4d0 0x7ff0bc06d990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff0d40099e0 tx=0x7ff0d4008040 comp rx=0 tx=0).stop 2024-04-25T09:55:24.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.376+0000 7ff0df509640 1 -- 172.21.15.7:0/676905517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0d8159fa0 msgr2=0x7ff0d815a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:24.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.376+0000 7ff0df509640 1 --2- 172.21.15.7:0/676905517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0d8159fa0 0x7ff0d815a420 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0000f80 tx=0x7ff0d000e530 comp rx=0 tx=0).stop 2024-04-25T09:55:24.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.376+0000 7ff0df509640 1 -- 172.21.15.7:0/676905517 shutdown_connections 2024-04-25T09:55:24.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.376+0000 7ff0df509640 1 --2- 172.21.15.7:0/676905517 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff0bc06b4d0 0x7ff0bc06d990 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:24.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.376+0000 7ff0df509640 1 --2- 172.21.15.7:0/676905517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0d8159fa0 0x7ff0d815a420 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:24.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.376+0000 7ff0df509640 1 --2- 172.21.15.7:0/676905517 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0d81560b0 0x7ff0d8149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:24.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.376+0000 7ff0df509640 1 --2- 172.21.15.7:0/676905517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0c4004800 0x7ff0d815fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:24.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.376+0000 7ff0df509640 1 -- 172.21.15.7:0/676905517 >> 172.21.15.7:0/676905517 conn(0x7ff0d8072290 msgr2=0x7ff0d80b6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:24.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.376+0000 7ff0df509640 1 -- 172.21.15.7:0/676905517 shutdown_connections 2024-04-25T09:55:24.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.376+0000 7ff0df509640 1 -- 172.21.15.7:0/676905517 wait complete. 2024-04-25T09:55:24.380 INFO:tasks.ceph.mds.b.smithi055.stderr: -6111> 2024-04-25T09:54:21.527+0000 7ff800bfe640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-04-25T09:55:24.381 INFO:tasks.ceph.mds.b.smithi055.stderr: -4882> 2024-04-25T09:54:32.524+0000 7ff7fabf2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:55:24.389 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:55:24.415 INFO:tasks.ceph.mds.b.smithi055.stdout:starting mds.b at 2024-04-25T09:55:24.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.490+0000 7f37bd8bc640 1 Processor -- start 2024-04-25T09:55:24.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.490+0000 7f37bd8bc640 1 -- start start 2024-04-25T09:55:24.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.491+0000 7f37bd8bc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f37b80ce680 0x7f37b80ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:24.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.491+0000 7f37bd8bc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f37b80b6a70 0x7f37b80b6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:24.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.491+0000 7f37bd8bc640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b815df10 con 0x7f37b815db30 2024-04-25T09:55:24.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.491+0000 7f37bd8bc640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37b80cf020 con 0x7f37b80b6a70 2024-04-25T09:55:24.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.491+0000 7f37bd8bc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b80d1780 con 0x7f37b80ce680 2024-04-25T09:55:24.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.491+0000 7f37affff640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f37b80ce680 0x7f37b80ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:24.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.491+0000 7f37b77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f37b80b6a70 0x7f37b80b6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:24.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.491+0000 7f37b77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f37b80b6a70 0x7f37b80b6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:56430/0 (socket says 172.21.15.7:56430) 2024-04-25T09:55:24.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.491+0000 7f37b6ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f37b815db30 0x7f37b80d0440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:44778/0 (socket says 172.21.15.7:44778) 2024-04-25T09:55:24.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.491+0000 7f37affff640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f37b80ce680 0x7f37b80ceae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:57272/0 (socket says 172.21.15.7:57272) 2024-04-25T09:55:24.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.491+0000 7f37b77fe640 1 -- 172.21.15.7:0/2068700263 learned_addr learned my addr 172.21.15.7:0/2068700263 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:24.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.491+0000 7f37b77fe640 1 -- 172.21.15.7:0/2068700263 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f37b80ce680 msgr2=0x7f37b80ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:24.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.491+0000 7f37b77fe640 1 --2- 172.21.15.7:0/2068700263 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f37b80ce680 0x7f37b80ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:24.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.491+0000 7f37b77fe640 1 -- 172.21.15.7:0/2068700263 >> v1:172.21.15.55:6789/0 conn(0x7f37b815db30 legacy=0x7f37b80d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:24.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.491+0000 7f37b77fe640 1 -- 172.21.15.7:0/2068700263 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b80d1a60 con 0x7f37b80b6a70 2024-04-25T09:55:24.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.491+0000 7f37b67fc640 1 -- 172.21.15.7:0/2068700263 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3606687334 0 0) 0x7f37b815df10 con 0x7f37b815db30 2024-04-25T09:55:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.492+0000 7f37b77fe640 1 --2- 172.21.15.7:0/2068700263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37b80b6a70 0x7f37b80b6ec0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f37b0009e50 tx=0x7f37b002a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fb360c1945db0a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.492+0000 7f37b67fc640 1 -- 172.21.15.7:0/2068700263 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b0036070 con 0x7f37b80b6a70 2024-04-25T09:55:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.492+0000 7f37b67fc640 1 -- 172.21.15.7:0/2068700263 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b0031600 con 0x7f37b80b6a70 2024-04-25T09:55:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.492+0000 7f37b67fc640 1 -- 172.21.15.7:0/2068700263 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b00319d0 con 0x7f37b80b6a70 2024-04-25T09:55:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.493+0000 7f37bd8bc640 1 -- 172.21.15.7:0/2068700263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37b80b6a70 msgr2=0x7f37b80b6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.493+0000 7f37bd8bc640 1 --2- 172.21.15.7:0/2068700263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37b80b6a70 0x7f37b80b6ec0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f37b0009e50 tx=0x7f37b002a710 comp rx=0 tx=0).stop 2024-04-25T09:55:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.493+0000 7f37bd8bc640 1 -- 172.21.15.7:0/2068700263 shutdown_connections 2024-04-25T09:55:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.493+0000 7f37bd8bc640 1 --2- 172.21.15.7:0/2068700263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37b80b6a70 0x7f37b80b6ec0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.493+0000 7f37bd8bc640 1 --2- 172.21.15.7:0/2068700263 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f37b80ce680 0x7f37b80ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.493+0000 7f37bd8bc640 1 -- 172.21.15.7:0/2068700263 >> 172.21.15.7:0/2068700263 conn(0x7f37b80728c0 msgr2=0x7f37b806bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.493+0000 7f37bd8bc640 1 -- 172.21.15.7:0/2068700263 shutdown_connections 2024-04-25T09:55:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.493+0000 7f37bd8bc640 1 -- 172.21.15.7:0/2068700263 wait complete. 2024-04-25T09:55:24.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.494+0000 7f37bd8bc640 1 Processor -- start 2024-04-25T09:55:24.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.494+0000 7f37bd8bc640 1 -- start start 2024-04-25T09:55:24.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.495+0000 7f37bd8bc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37b80b6a70 0x7f37b8157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:24.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.495+0000 7f37bd8bc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37b80ce680 0x7f37b80ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:24.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.495+0000 7f37bd8bc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f37b815db30 0x7f37b8159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:24.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.495+0000 7f37bd8bc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b80d1410 con 0x7f37b80b6a70 2024-04-25T09:55:24.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.495+0000 7f37bd8bc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b80d2020 con 0x7f37b80ce680 2024-04-25T09:55:24.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.495+0000 7f37bd8bc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b80d0b50 con 0x7f37b815db30 2024-04-25T09:55:24.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.495+0000 7f37b6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37b80b6a70 0x7f37b8157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:24.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.495+0000 7f37b6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37b80b6a70 0x7f37b8157580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36646/0 (socket says 172.21.15.7:36646) 2024-04-25T09:55:24.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.495+0000 7f37b6ffd640 1 -- 172.21.15.7:0/2610122587 learned_addr learned my addr 172.21.15.7:0/2610122587 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:24.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.495+0000 7f37affff640 1 --2- 172.21.15.7:0/2610122587 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37b80ce680 0x7f37b80ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:24.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.495+0000 7f37b77fe640 1 --2- 172.21.15.7:0/2610122587 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f37b815db30 0x7f37b8159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:24.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.495+0000 7f37b6ffd640 1 -- 172.21.15.7:0/2610122587 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f37b815db30 msgr2=0x7f37b8159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:24.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.495+0000 7f37b6ffd640 1 --2- 172.21.15.7:0/2610122587 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f37b815db30 0x7f37b8159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:24.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.495+0000 7f37b6ffd640 1 -- 172.21.15.7:0/2610122587 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37b80ce680 msgr2=0x7f37b80ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:24.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.495+0000 7f37b6ffd640 1 --2- 172.21.15.7:0/2610122587 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37b80ce680 0x7f37b80ccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:24.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.495+0000 7f37b6ffd640 1 -- 172.21.15.7:0/2610122587 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b814b230 con 0x7f37b80b6a70 2024-04-25T09:55:24.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.496+0000 7f37b6ffd640 1 --2- 172.21.15.7:0/2610122587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37b80b6a70 0x7f37b8157580 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f37a800c4d0 tx=0x7f37a800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:24.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.496+0000 7f37b4ff9640 1 -- 172.21.15.7:0/2610122587 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a8018070 con 0x7f37b80b6a70 2024-04-25T09:55:24.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.496+0000 7f37b4ff9640 1 -- 172.21.15.7:0/2610122587 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a8007500 con 0x7f37b80b6a70 2024-04-25T09:55:24.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.496+0000 7f37b4ff9640 1 -- 172.21.15.7:0/2610122587 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a8004a20 con 0x7f37b80b6a70 2024-04-25T09:55:24.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.496+0000 7f37bd8bc640 1 -- 172.21.15.7:0/2610122587 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b81567c0 con 0x7f37b80b6a70 2024-04-25T09:55:24.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.496+0000 7f37bd8bc640 1 -- 172.21.15.7:0/2610122587 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b8156d80 con 0x7f37b80b6a70 2024-04-25T09:55:24.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.497+0000 7f37bd8bc640 1 -- 172.21.15.7:0/2610122587 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b81571b0 con 0x7f37b80b6a70 2024-04-25T09:55:24.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.498+0000 7f37b4ff9640 1 -- 172.21.15.7:0/2610122587 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f37a801b070 con 0x7f37b80b6a70 2024-04-25T09:55:24.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.498+0000 7f37b4ff9640 1 --2- 172.21.15.7:0/2610122587 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f379806b4d0 0x7f379806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:24.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.498+0000 7f37b4ff9640 1 -- 172.21.15.7:0/2610122587 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6821+0+0 (secure 0 0 0) 0x7f37a80899c0 con 0x7f37b80b6a70 2024-04-25T09:55:24.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.498+0000 7f37affff640 1 --2- 172.21.15.7:0/2610122587 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f379806b4d0 0x7f379806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:24.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.499+0000 7f37affff640 1 --2- 172.21.15.7:0/2610122587 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f379806b4d0 0x7f379806d990 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f37b8152200 tx=0x7f37a0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:24.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.502+0000 7f37b4ff9640 1 -- 172.21.15.7:0/2610122587 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f37a808be20 con 0x7f37b80b6a70 2024-04-25T09:55:24.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:24.720+0000 7f37bd8bc640 1 -- 172.21.15.7:0/2610122587 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f37b8068f60 con 0x7f37b80b6a70 2024-04-25T09:55:25.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.374+0000 7f37b4ff9640 1 -- 172.21.15.7:0/2610122587 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f37a80583e0 con 0x7f37b80b6a70 2024-04-25T09:55:25.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.377+0000 7f37bd8bc640 1 -- 172.21.15.7:0/2610122587 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f379806b4d0 msgr2=0x7f379806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:25.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.377+0000 7f37bd8bc640 1 --2- 172.21.15.7:0/2610122587 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f379806b4d0 0x7f379806d990 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f37b8152200 tx=0x7f37a0008040 comp rx=0 tx=0).stop 2024-04-25T09:55:25.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.377+0000 7f37bd8bc640 1 -- 172.21.15.7:0/2610122587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37b80b6a70 msgr2=0x7f37b8157580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:25.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.377+0000 7f37bd8bc640 1 --2- 172.21.15.7:0/2610122587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37b80b6a70 0x7f37b8157580 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f37a800c4d0 tx=0x7f37a800c990 comp rx=0 tx=0).stop 2024-04-25T09:55:25.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.377+0000 7f37bd8bc640 1 -- 172.21.15.7:0/2610122587 shutdown_connections 2024-04-25T09:55:25.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.377+0000 7f37bd8bc640 1 --2- 172.21.15.7:0/2610122587 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f379806b4d0 0x7f379806d990 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:25.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.377+0000 7f37bd8bc640 1 --2- 172.21.15.7:0/2610122587 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f37b815db30 0x7f37b8159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:25.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.377+0000 7f37bd8bc640 1 --2- 172.21.15.7:0/2610122587 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37b80ce680 0x7f37b80ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:25.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.377+0000 7f37bd8bc640 1 --2- 172.21.15.7:0/2610122587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37b80b6a70 0x7f37b8157580 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:25.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.377+0000 7f37bd8bc640 1 -- 172.21.15.7:0/2610122587 >> 172.21.15.7:0/2610122587 conn(0x7f37b80728c0 msgr2=0x7f37b80d27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:25.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.377+0000 7f37bd8bc640 1 -- 172.21.15.7:0/2610122587 shutdown_connections 2024-04-25T09:55:25.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.377+0000 7f37bd8bc640 1 -- 172.21.15.7:0/2610122587 wait complete. 2024-04-25T09:55:25.394 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:55:25.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.504+0000 7fc7ee32b640 1 Processor -- start 2024-04-25T09:55:25.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.504+0000 7fc7ee32b640 1 -- start start 2024-04-25T09:55:25.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.505+0000 7fc7ee32b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc7e815dba0 0x7fc7e80b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:25.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.505+0000 7fc7ee32b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc7e815df80 0x7fc7e80cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:25.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.505+0000 7fc7ee32b640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e80d1a10 con 0x7fc7e80b6a40 2024-04-25T09:55:25.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.505+0000 7fc7ee32b640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e80d1cb0 con 0x7fc7e815df80 2024-04-25T09:55:25.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.505+0000 7fc7ee32b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e80d1f90 con 0x7fc7e815dba0 2024-04-25T09:55:25.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.505+0000 7fc7e77fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc7e815df80 0x7fc7e80cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:25.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.505+0000 7fc7e77fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc7e815df80 0x7fc7e80cea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36654/0 (socket says 172.21.15.7:36654) 2024-04-25T09:55:25.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.505+0000 7fc7ec8c8640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc7e80b6a40 0x7fc7e80d0220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34100/0 (socket says 172.21.15.7:34100) 2024-04-25T09:55:25.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.505+0000 7fc7e77fe640 1 -- 172.21.15.7:0/2767563140 learned_addr learned my addr 172.21.15.7:0/2767563140 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:25.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.505+0000 7fc7e7fff640 1 --2- 172.21.15.7:0/2767563140 >> v2:172.21.15.55:3300/0 conn(0x7fc7e815dba0 0x7fc7e80b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:25.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.505+0000 7fc7e77fe640 1 -- 172.21.15.7:0/2767563140 >> v2:172.21.15.55:3300/0 conn(0x7fc7e815dba0 msgr2=0x7fc7e80b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:25.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.505+0000 7fc7e77fe640 1 --2- 172.21.15.7:0/2767563140 >> v2:172.21.15.55:3300/0 conn(0x7fc7e815dba0 0x7fc7e80b2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:25.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.505+0000 7fc7e77fe640 1 -- 172.21.15.7:0/2767563140 >> v1:172.21.15.7:6789/0 conn(0x7fc7e80b6a40 legacy=0x7fc7e80d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:25.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.505+0000 7fc7e77fe640 1 -- 172.21.15.7:0/2767563140 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e80d2270 con 0x7fc7e815df80 2024-04-25T09:55:25.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.505+0000 7fc7e7fff640 1 --2- 172.21.15.7:0/2767563140 >> v2:172.21.15.55:3300/0 conn(0x7fc7e815dba0 0x7fc7e80b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:25.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.506+0000 7fc7e77fe640 1 --2- 172.21.15.7:0/2767563140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7e815df80 0x7fc7e80cea80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc7e806cde0 tx=0x7fc7d802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e5d547dc938b049 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:25.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.506+0000 7fc7e6ffd640 1 -- 172.21.15.7:0/2767563140 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d8037070 con 0x7fc7e815df80 2024-04-25T09:55:25.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.506+0000 7fc7e6ffd640 1 -- 172.21.15.7:0/2767563140 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d8032440 con 0x7fc7e815df80 2024-04-25T09:55:25.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.506+0000 7fc7e6ffd640 1 -- 172.21.15.7:0/2767563140 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d8032810 con 0x7fc7e815df80 2024-04-25T09:55:25.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.507+0000 7fc7ee32b640 1 -- 172.21.15.7:0/2767563140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7e815df80 msgr2=0x7fc7e80cea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:25.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.507+0000 7fc7ee32b640 1 --2- 172.21.15.7:0/2767563140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7e815df80 0x7fc7e80cea80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc7e806cde0 tx=0x7fc7d802a1e0 comp rx=0 tx=0).stop 2024-04-25T09:55:25.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.507+0000 7fc7ee32b640 1 -- 172.21.15.7:0/2767563140 shutdown_connections 2024-04-25T09:55:25.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.507+0000 7fc7ee32b640 1 --2- 172.21.15.7:0/2767563140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7e815df80 0x7fc7e80cea80 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:25.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.507+0000 7fc7ee32b640 1 --2- 172.21.15.7:0/2767563140 >> v2:172.21.15.55:3300/0 conn(0x7fc7e815dba0 0x7fc7e80b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:25.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.507+0000 7fc7ee32b640 1 -- 172.21.15.7:0/2767563140 >> 172.21.15.7:0/2767563140 conn(0x7fc7e806c530 msgr2=0x7fc7e8072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:25.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.507+0000 7fc7ee32b640 1 -- 172.21.15.7:0/2767563140 shutdown_connections 2024-04-25T09:55:25.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.507+0000 7fc7ee32b640 1 -- 172.21.15.7:0/2767563140 wait complete. 2024-04-25T09:55:25.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.508+0000 7fc7ee32b640 1 Processor -- start 2024-04-25T09:55:25.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.508+0000 7fc7ee32b640 1 -- start start 2024-04-25T09:55:25.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.509+0000 7fc7ee32b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc7e80b6a40 0x7fc7e8155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:25.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.509+0000 7fc7ee32b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7e815dba0 0x7fc7e814bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:25.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.509+0000 7fc7ee32b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7e815df80 0x7fc7e8157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:25.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.509+0000 7fc7ee32b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e80d0930 con 0x7fc7e815df80 2024-04-25T09:55:25.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.509+0000 7fc7ee32b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e80d25e0 con 0x7fc7e815dba0 2024-04-25T09:55:25.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.509+0000 7fc7ee32b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e80d0ab0 con 0x7fc7e80b6a40 2024-04-25T09:55:25.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.509+0000 7fc7ec8c8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7e815df80 0x7fc7e8157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:25.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.509+0000 7fc7ec8c8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7e815df80 0x7fc7e8157dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36658/0 (socket says 172.21.15.7:36658) 2024-04-25T09:55:25.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.509+0000 7fc7ec8c8640 1 -- 172.21.15.7:0/3256279578 learned_addr learned my addr 172.21.15.7:0/3256279578 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:25.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.509+0000 7fc7e77fe640 1 --2- 172.21.15.7:0/3256279578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7e815dba0 0x7fc7e814bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:25.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.509+0000 7fc7e7fff640 1 --2- 172.21.15.7:0/3256279578 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc7e80b6a40 0x7fc7e8155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:25.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.509+0000 7fc7ec8c8640 1 -- 172.21.15.7:0/3256279578 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc7e80b6a40 msgr2=0x7fc7e8155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:25.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.509+0000 7fc7ec8c8640 1 --2- 172.21.15.7:0/3256279578 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc7e80b6a40 0x7fc7e8155710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:25.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.509+0000 7fc7ec8c8640 1 -- 172.21.15.7:0/3256279578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7e815dba0 msgr2=0x7fc7e814bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:25.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.509+0000 7fc7ec8c8640 1 --2- 172.21.15.7:0/3256279578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7e815dba0 0x7fc7e814bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:25.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.509+0000 7fc7ec8c8640 1 -- 172.21.15.7:0/3256279578 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e8155c50 con 0x7fc7e815df80 2024-04-25T09:55:25.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.509+0000 7fc7e77fe640 1 --2- 172.21.15.7:0/3256279578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7e815dba0 0x7fc7e814bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:25.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.509+0000 7fc7e7fff640 1 --2- 172.21.15.7:0/3256279578 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc7e80b6a40 0x7fc7e8155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:25.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.510+0000 7fc7ec8c8640 1 --2- 172.21.15.7:0/3256279578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7e815df80 0x7fc7e8157dd0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc7e000c780 tx=0x7fc7e000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:25.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.510+0000 7fc7e4ff9640 1 -- 172.21.15.7:0/3256279578 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0017070 con 0x7fc7e815df80 2024-04-25T09:55:25.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.510+0000 7fc7e4ff9640 1 -- 172.21.15.7:0/3256279578 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e000a640 con 0x7fc7e815df80 2024-04-25T09:55:25.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.510+0000 7fc7ee32b640 1 -- 172.21.15.7:0/3256279578 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e814c250 con 0x7fc7e815df80 2024-04-25T09:55:25.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.510+0000 7fc7e4ff9640 1 -- 172.21.15.7:0/3256279578 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e000a9f0 con 0x7fc7e815df80 2024-04-25T09:55:25.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.510+0000 7fc7ee32b640 1 -- 172.21.15.7:0/3256279578 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e81561b0 con 0x7fc7e815df80 2024-04-25T09:55:25.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.511+0000 7fc7ee32b640 1 -- 172.21.15.7:0/3256279578 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e8069040 con 0x7fc7e815df80 2024-04-25T09:55:25.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.511+0000 7fc7e4ff9640 1 -- 172.21.15.7:0/3256279578 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc7e001a070 con 0x7fc7e815df80 2024-04-25T09:55:25.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.512+0000 7fc7e4ff9640 1 --2- 172.21.15.7:0/3256279578 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc7c806b4d0 0x7fc7c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:25.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.512+0000 7fc7e4ff9640 1 -- 172.21.15.7:0/3256279578 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6821+0+0 (secure 0 0 0) 0x7fc7e0089bb0 con 0x7fc7e815df80 2024-04-25T09:55:25.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.512+0000 7fc7e7fff640 1 --2- 172.21.15.7:0/3256279578 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc7c806b4d0 0x7fc7c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:25.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.512+0000 7fc7e7fff640 1 --2- 172.21.15.7:0/3256279578 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc7c806b4d0 0x7fc7c806d990 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000aa30 tx=0x7fc7d0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:25.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.516+0000 7fc7e4ff9640 1 -- 172.21.15.7:0/3256279578 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc7e8155c50 con 0x7fc7e815df80 2024-04-25T09:55:25.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:25.696+0000 7fc7ee32b640 1 -- 172.21.15.7:0/3256279578 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc7e80cebb0 con 0x7fc7e815df80 2024-04-25T09:55:26.165 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:55:26.168 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:55:26.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.671+0000 7fc7e4ff9640 1 -- 172.21.15.7:0/3256279578 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc7e0057ee0 con 0x7fc7e815df80 2024-04-25T09:55:26.674 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:55:26.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.674+0000 7fc7ee32b640 1 -- 172.21.15.7:0/3256279578 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc7c806b4d0 msgr2=0x7fc7c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:26.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.674+0000 7fc7ee32b640 1 --2- 172.21.15.7:0/3256279578 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc7c806b4d0 0x7fc7c806d990 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000aa30 tx=0x7fc7d0008040 comp rx=0 tx=0).stop 2024-04-25T09:55:26.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.674+0000 7fc7ee32b640 1 -- 172.21.15.7:0/3256279578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7e815df80 msgr2=0x7fc7e8157dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:26.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.674+0000 7fc7ee32b640 1 --2- 172.21.15.7:0/3256279578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7e815df80 0x7fc7e8157dd0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc7e000c780 tx=0x7fc7e000cc40 comp rx=0 tx=0).stop 2024-04-25T09:55:26.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.676+0000 7fc7ee32b640 1 -- 172.21.15.7:0/3256279578 shutdown_connections 2024-04-25T09:55:26.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.676+0000 7fc7ee32b640 1 --2- 172.21.15.7:0/3256279578 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc7c806b4d0 0x7fc7c806d990 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:26.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.676+0000 7fc7ee32b640 1 --2- 172.21.15.7:0/3256279578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7e815df80 0x7fc7e8157dd0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:26.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.676+0000 7fc7ee32b640 1 --2- 172.21.15.7:0/3256279578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7e815dba0 0x7fc7e814bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:26.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.676+0000 7fc7ee32b640 1 --2- 172.21.15.7:0/3256279578 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc7e80b6a40 0x7fc7e8155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:26.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.676+0000 7fc7ee32b640 1 -- 172.21.15.7:0/3256279578 >> 172.21.15.7:0/3256279578 conn(0x7fc7e806c530 msgr2=0x7fc7e8072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:26.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.677+0000 7fc7ee32b640 1 -- 172.21.15.7:0/3256279578 shutdown_connections 2024-04-25T09:55:26.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.677+0000 7fc7ee32b640 1 -- 172.21.15.7:0/3256279578 wait complete. 2024-04-25T09:55:26.695 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:55:26.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.804+0000 7f1f6b363640 1 Processor -- start 2024-04-25T09:55:26.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.804+0000 7f1f6b363640 1 -- start start 2024-04-25T09:55:26.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.804+0000 7f1f6b363640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1f640ce4a0 0x7f1f640cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:26.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.804+0000 7f1f6b363640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f640cf930 con 0x7f1f640ce040 2024-04-25T09:55:26.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.804+0000 7f1f6b363640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f640cfbe0 con 0x7f1f6415b940 2024-04-25T09:55:26.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.804+0000 7f1f6b363640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f640cfec0 con 0x7f1f640ce4a0 2024-04-25T09:55:26.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.805+0000 7f1f69900640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1f640ce4a0 0x7f1f640cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:26.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.805+0000 7f1f69900640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1f640ce4a0 0x7f1f640cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36674/0 (socket says 172.21.15.7:36674) 2024-04-25T09:55:26.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.805+0000 7f1f69900640 1 -- 172.21.15.7:0/1919157512 learned_addr learned my addr 172.21.15.7:0/1919157512 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:26.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.805+0000 7f1f688fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1f640ce040 0x7f1f640cc760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34104/0 (socket says 172.21.15.7:34104) 2024-04-25T09:55:26.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.805+0000 7f1f69900640 1 -- 172.21.15.7:0/1919157512 >> v1:172.21.15.55:6789/0 conn(0x7f1f6415b940 legacy=0x7f1f640cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:26.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.805+0000 7f1f69900640 1 -- 172.21.15.7:0/1919157512 >> v1:172.21.15.7:6789/0 conn(0x7f1f640ce040 legacy=0x7f1f640cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:26.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.805+0000 7f1f69900640 1 -- 172.21.15.7:0/1919157512 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f640d01a0 con 0x7f1f640ce4a0 2024-04-25T09:55:26.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.805+0000 7f1f5bfff640 1 -- 172.21.15.7:0/1919157512 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2524238326 0 0) 0x7f1f640cf930 con 0x7f1f640ce040 2024-04-25T09:55:26.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.806+0000 7f1f69900640 1 --2- 172.21.15.7:0/1919157512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f640ce4a0 0x7f1f640cce70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c009e50 tx=0x7f1f5c02a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a36fe1b37eff02e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:26.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.806+0000 7f1f5bfff640 1 -- 172.21.15.7:0/1919157512 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c036070 con 0x7f1f640ce4a0 2024-04-25T09:55:26.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.806+0000 7f1f5bfff640 1 -- 172.21.15.7:0/1919157512 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5c031600 con 0x7f1f640ce4a0 2024-04-25T09:55:26.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.806+0000 7f1f5bfff640 1 -- 172.21.15.7:0/1919157512 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c0319f0 con 0x7f1f640ce4a0 2024-04-25T09:55:26.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.806+0000 7f1f6b363640 1 -- 172.21.15.7:0/1919157512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f640ce4a0 msgr2=0x7f1f640cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:26.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.806+0000 7f1f6b363640 1 --2- 172.21.15.7:0/1919157512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f640ce4a0 0x7f1f640cce70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c009e50 tx=0x7f1f5c02a7c0 comp rx=0 tx=0).stop 2024-04-25T09:55:26.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.806+0000 7f1f6b363640 1 -- 172.21.15.7:0/1919157512 shutdown_connections 2024-04-25T09:55:26.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.806+0000 7f1f6b363640 1 --2- 172.21.15.7:0/1919157512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f640ce4a0 0x7f1f640cce70 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:26.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.806+0000 7f1f6b363640 1 -- 172.21.15.7:0/1919157512 >> 172.21.15.7:0/1919157512 conn(0x7f1f640d1650 msgr2=0x7f1f640d1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:26.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.806+0000 7f1f6b363640 1 -- 172.21.15.7:0/1919157512 shutdown_connections 2024-04-25T09:55:26.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.806+0000 7f1f6b363640 1 -- 172.21.15.7:0/1919157512 wait complete. 2024-04-25T09:55:26.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.808+0000 7f1f6b363640 1 Processor -- start 2024-04-25T09:55:26.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.808+0000 7f1f6b363640 1 -- start start 2024-04-25T09:55:26.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.808+0000 7f1f6b363640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1f640ce040 0x7f1f641f5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:26.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.808+0000 7f1f6b363640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f640ce4a0 0x7f1f64155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:26.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.808+0000 7f1f6b363640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f6415b940 0x7f1f640afe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:26.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.808+0000 7f1f6b363640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6415bd20 con 0x7f1f6415b940 2024-04-25T09:55:26.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.808+0000 7f1f6b363640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f640ce930 con 0x7f1f640ce4a0 2024-04-25T09:55:26.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.808+0000 7f1f6b363640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f640cc160 con 0x7f1f640ce040 2024-04-25T09:55:26.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.809+0000 7f1f69900640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f6415b940 0x7f1f640afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:26.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.809+0000 7f1f69900640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f6415b940 0x7f1f640afe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36686/0 (socket says 172.21.15.7:36686) 2024-04-25T09:55:26.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.809+0000 7f1f69900640 1 -- 172.21.15.7:0/3477428519 learned_addr learned my addr 172.21.15.7:0/3477428519 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:26.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.809+0000 7f1f688fe640 1 --2- 172.21.15.7:0/3477428519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f640ce4a0 0x7f1f64155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:26.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.809+0000 7f1f690ff640 1 --2- 172.21.15.7:0/3477428519 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1f640ce040 0x7f1f641f5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:26.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.809+0000 7f1f69900640 1 -- 172.21.15.7:0/3477428519 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1f640ce040 msgr2=0x7f1f641f5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:26.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.809+0000 7f1f69900640 1 --2- 172.21.15.7:0/3477428519 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1f640ce040 0x7f1f641f5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:26.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.809+0000 7f1f69900640 1 -- 172.21.15.7:0/3477428519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f640ce4a0 msgr2=0x7f1f64155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:26.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.809+0000 7f1f69900640 1 --2- 172.21.15.7:0/3477428519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f640ce4a0 0x7f1f64155080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:26.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.809+0000 7f1f69900640 1 -- 172.21.15.7:0/3477428519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f641f5950 con 0x7f1f6415b940 2024-04-25T09:55:26.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.809+0000 7f1f69900640 1 --2- 172.21.15.7:0/3477428519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f6415b940 0x7f1f640afe60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c02a800 tx=0x7f1f5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:26.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.809+0000 7f1f59ffb640 1 -- 172.21.15.7:0/3477428519 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c036050 con 0x7f1f6415b940 2024-04-25T09:55:26.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.809+0000 7f1f59ffb640 1 -- 172.21.15.7:0/3477428519 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5c042070 con 0x7f1f6415b940 2024-04-25T09:55:26.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.809+0000 7f1f6b363640 1 -- 172.21.15.7:0/3477428519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f641f1410 con 0x7f1f6415b940 2024-04-25T09:55:26.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.809+0000 7f1f59ffb640 1 -- 172.21.15.7:0/3477428519 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c009510 con 0x7f1f6415b940 2024-04-25T09:55:26.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.809+0000 7f1f6b363640 1 -- 172.21.15.7:0/3477428519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f641f16d0 con 0x7f1f6415b940 2024-04-25T09:55:26.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.810+0000 7f1f6b363640 1 -- 172.21.15.7:0/3477428519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f64069040 con 0x7f1f6415b940 2024-04-25T09:55:26.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.811+0000 7f1f59ffb640 1 -- 172.21.15.7:0/3477428519 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1f5c004470 con 0x7f1f6415b940 2024-04-25T09:55:26.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.811+0000 7f1f59ffb640 1 --2- 172.21.15.7:0/3477428519 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1f4806b4d0 0x7f1f4806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:26.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.811+0000 7f1f59ffb640 1 -- 172.21.15.7:0/3477428519 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6383+0+0 (secure 0 0 0) 0x7f1f5c0ab300 con 0x7f1f6415b940 2024-04-25T09:55:26.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.811+0000 7f1f690ff640 1 --2- 172.21.15.7:0/3477428519 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1f4806b4d0 0x7f1f4806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:26.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.812+0000 7f1f690ff640 1 --2- 172.21.15.7:0/3477428519 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1f4806b4d0 0x7f1f4806d990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1f60000f60 tx=0x7f1f60009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:26.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.816+0000 7f1f59ffb640 1 -- 172.21.15.7:0/3477428519 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1f641f5950 con 0x7f1f6415b940 2024-04-25T09:55:26.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:26.996+0000 7f1f6b363640 1 -- 172.21.15.7:0/3477428519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1f64070820 con 0x7f1f6415b940 2024-04-25T09:55:27.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.672+0000 7f1f59ffb640 1 -- 172.21.15.7:0/3477428519 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1f5c079880 con 0x7f1f6415b940 2024-04-25T09:55:27.675 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2024-04-25T09:55:27.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.677+0000 7f1f6b363640 1 -- 172.21.15.7:0/3477428519 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1f4806b4d0 msgr2=0x7f1f4806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:27.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.677+0000 7f1f6b363640 1 --2- 172.21.15.7:0/3477428519 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1f4806b4d0 0x7f1f4806d990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1f60000f60 tx=0x7f1f60009040 comp rx=0 tx=0).stop 2024-04-25T09:55:27.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.677+0000 7f1f6b363640 1 -- 172.21.15.7:0/3477428519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f6415b940 msgr2=0x7f1f640afe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:27.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.677+0000 7f1f6b363640 1 --2- 172.21.15.7:0/3477428519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f6415b940 0x7f1f640afe60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c02a800 tx=0x7f1f5c004a40 comp rx=0 tx=0).stop 2024-04-25T09:55:27.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.678+0000 7f1f6b363640 1 -- 172.21.15.7:0/3477428519 shutdown_connections 2024-04-25T09:55:27.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.678+0000 7f1f6b363640 1 --2- 172.21.15.7:0/3477428519 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1f4806b4d0 0x7f1f4806d990 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:27.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.678+0000 7f1f6b363640 1 --2- 172.21.15.7:0/3477428519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f6415b940 0x7f1f640afe60 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:27.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.678+0000 7f1f6b363640 1 --2- 172.21.15.7:0/3477428519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f640ce4a0 0x7f1f64155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:27.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.678+0000 7f1f6b363640 1 --2- 172.21.15.7:0/3477428519 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1f640ce040 0x7f1f641f5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:27.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.678+0000 7f1f6b363640 1 -- 172.21.15.7:0/3477428519 >> 172.21.15.7:0/3477428519 conn(0x7f1f640d1650 msgr2=0x7f1f640b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:27.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.679+0000 7f1f6b363640 1 -- 172.21.15.7:0/3477428519 shutdown_connections 2024-04-25T09:55:27.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.679+0000 7f1f6b363640 1 -- 172.21.15.7:0/3477428519 wait complete. 2024-04-25T09:55:27.698 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-25T09:55:27.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.807+0000 7f6501e2a640 1 Processor -- start 2024-04-25T09:55:27.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.807+0000 7f6501e2a640 1 -- start start 2024-04-25T09:55:27.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.808+0000 7f6501e2a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f64fc15dba0 0x7f64fc0b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:27.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.808+0000 7f6501e2a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f64fc15df80 0x7f64fc0cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:27.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.808+0000 7f6501e2a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64fc0d1a10 con 0x7f64fc0b6a40 2024-04-25T09:55:27.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.808+0000 7f6501e2a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64fc0d1cb0 con 0x7f64fc15dba0 2024-04-25T09:55:27.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.808+0000 7f6501e2a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc0d1f90 con 0x7f64fc15df80 2024-04-25T09:55:27.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.808+0000 7f64fb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f64fc15dba0 0x7f64fc0b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:27.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.808+0000 7f64fbfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f64fc0b6a40 0x7f64fc0d0220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:44798/0 (socket says 172.21.15.7:44798) 2024-04-25T09:55:27.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.808+0000 7f64faffd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f64fc15df80 0x7f64fc0cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:27.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.808+0000 7f64fbfff640 1 -- 172.21.15.7:0/1011217892 learned_addr learned my addr 172.21.15.7:0/1011217892 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:27.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.808+0000 7f64faffd640 1 -- 172.21.15.7:0/1011217892 >> v2:172.21.15.55:3300/0 conn(0x7f64fc15dba0 msgr2=0x7f64fc0b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:27.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.808+0000 7f64faffd640 1 --2- 172.21.15.7:0/1011217892 >> v2:172.21.15.55:3300/0 conn(0x7f64fc15dba0 0x7f64fc0b2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:27.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.808+0000 7f64faffd640 1 -- 172.21.15.7:0/1011217892 >> v1:172.21.15.55:6789/0 conn(0x7f64fc0b6a40 legacy=0x7f64fc0d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:27.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.808+0000 7f64fa7fc640 1 -- 172.21.15.7:0/1011217892 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1946623665 0 0) 0x7f64fc0d1a10 con 0x7f64fc0b6a40 2024-04-25T09:55:27.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.808+0000 7f64faffd640 1 -- 172.21.15.7:0/1011217892 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64fc0d2270 con 0x7f64fc15df80 2024-04-25T09:55:27.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.808+0000 7f64fb7fe640 1 --2- 172.21.15.7:0/1011217892 >> v2:172.21.15.55:3300/0 conn(0x7f64fc15dba0 0x7f64fc0b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:55:27.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.808+0000 7f64faffd640 1 --2- 172.21.15.7:0/1011217892 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f64fc15df80 0x7f64fc0cea80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f64f00097a0 tx=0x7f64f002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cf61689ccab8140 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:27.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.808+0000 7f64fa7fc640 1 -- 172.21.15.7:0/1011217892 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f0037070 con 0x7f64fc15df80 2024-04-25T09:55:27.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.808+0000 7f64fa7fc640 1 -- 172.21.15.7:0/1011217892 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f0032440 con 0x7f64fc15df80 2024-04-25T09:55:27.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.808+0000 7f64fa7fc640 1 -- 172.21.15.7:0/1011217892 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f0032810 con 0x7f64fc15df80 2024-04-25T09:55:27.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.809+0000 7f6501e2a640 1 -- 172.21.15.7:0/1011217892 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f64fc15df80 msgr2=0x7f64fc0cea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:27.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.809+0000 7f6501e2a640 1 --2- 172.21.15.7:0/1011217892 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f64fc15df80 0x7f64fc0cea80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f64f00097a0 tx=0x7f64f002a180 comp rx=0 tx=0).stop 2024-04-25T09:55:27.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.809+0000 7f6501e2a640 1 -- 172.21.15.7:0/1011217892 shutdown_connections 2024-04-25T09:55:27.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.809+0000 7f6501e2a640 1 --2- 172.21.15.7:0/1011217892 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f64fc15df80 0x7f64fc0cea80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:27.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.809+0000 7f6501e2a640 1 --2- 172.21.15.7:0/1011217892 >> v2:172.21.15.55:3300/0 conn(0x7f64fc15dba0 0x7f64fc0b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:27.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.809+0000 7f6501e2a640 1 -- 172.21.15.7:0/1011217892 >> 172.21.15.7:0/1011217892 conn(0x7f64fc06c530 msgr2=0x7f64fc072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:27.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.809+0000 7f6501e2a640 1 -- 172.21.15.7:0/1011217892 shutdown_connections 2024-04-25T09:55:27.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.809+0000 7f6501e2a640 1 -- 172.21.15.7:0/1011217892 wait complete. 2024-04-25T09:55:27.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.810+0000 7f6501e2a640 1 Processor -- start 2024-04-25T09:55:27.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.810+0000 7f6501e2a640 1 -- start start 2024-04-25T09:55:27.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.811+0000 7f6501e2a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f64fc0b6a40 0x7f64fc0aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:27.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.811+0000 7f6501e2a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64fc15dba0 0x7f64fc159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:27.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.811+0000 7f6501e2a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64fc15df80 0x7f64fc0b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:27.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.811+0000 7f6501e2a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc0d0930 con 0x7f64fc15dba0 2024-04-25T09:55:27.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.811+0000 7f6501e2a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc0cefc0 con 0x7f64fc15df80 2024-04-25T09:55:27.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.811+0000 7f6501e2a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc0d0ab0 con 0x7f64fc0b6a40 2024-04-25T09:55:27.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.811+0000 7f64fb7fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f64fc0b6a40 0x7f64fc0aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:27.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.811+0000 7f64faffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64fc15dba0 0x7f64fc159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:27.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.811+0000 7f64fb7fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f64fc0b6a40 0x7f64fc0aa4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:57318/0 (socket says 172.21.15.7:57318) 2024-04-25T09:55:27.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.811+0000 7f64fbfff640 1 --2- 172.21.15.7:0/3254657074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64fc15df80 0x7f64fc0b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:27.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.811+0000 7f64fb7fe640 1 -- 172.21.15.7:0/3254657074 learned_addr learned my addr 172.21.15.7:0/3254657074 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:27.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.812+0000 7f64faffd640 1 -- 172.21.15.7:0/3254657074 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f64fc0b6a40 msgr2=0x7f64fc0aa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:27.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.812+0000 7f64faffd640 1 --2- 172.21.15.7:0/3254657074 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f64fc0b6a40 0x7f64fc0aa4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:27.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.812+0000 7f64faffd640 1 -- 172.21.15.7:0/3254657074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64fc15df80 msgr2=0x7f64fc0b5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:27.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.812+0000 7f64faffd640 1 --2- 172.21.15.7:0/3254657074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64fc15df80 0x7f64fc0b5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:27.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.812+0000 7f64faffd640 1 -- 172.21.15.7:0/3254657074 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64fc0b34c0 con 0x7f64fc15dba0 2024-04-25T09:55:27.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.812+0000 7f64fbfff640 1 --2- 172.21.15.7:0/3254657074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64fc15df80 0x7f64fc0b5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:55:27.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.812+0000 7f64faffd640 1 --2- 172.21.15.7:0/3254657074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64fc15dba0 0x7f64fc159630 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f64f0031000 tx=0x7f64f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:27.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.812+0000 7f64e3fff640 1 -- 172.21.15.7:0/3254657074 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f0041020 con 0x7f64fc15dba0 2024-04-25T09:55:27.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.812+0000 7f6501e2a640 1 -- 172.21.15.7:0/3254657074 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64fc0b37a0 con 0x7f64fc15dba0 2024-04-25T09:55:27.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.812+0000 7f64e3fff640 1 -- 172.21.15.7:0/3254657074 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f0030700 con 0x7f64fc15dba0 2024-04-25T09:55:27.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.812+0000 7f64e3fff640 1 -- 172.21.15.7:0/3254657074 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f0037040 con 0x7f64fc15dba0 2024-04-25T09:55:27.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.812+0000 7f6501e2a640 1 -- 172.21.15.7:0/3254657074 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64fc0b3d60 con 0x7f64fc15dba0 2024-04-25T09:55:27.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.813+0000 7f6501e2a640 1 -- 172.21.15.7:0/3254657074 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64fc0cea10 con 0x7f64fc15dba0 2024-04-25T09:55:27.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.814+0000 7f64e3fff640 1 -- 172.21.15.7:0/3254657074 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f64f0044020 con 0x7f64fc15dba0 2024-04-25T09:55:27.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.814+0000 7f64e3fff640 1 --2- 172.21.15.7:0/3254657074 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f64e806b4d0 0x7f64e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:27.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.814+0000 7f64e3fff640 1 -- 172.21.15.7:0/3254657074 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f64f00aa8a0 con 0x7f64fc15dba0 2024-04-25T09:55:27.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.814+0000 7f64fb7fe640 1 --2- 172.21.15.7:0/3254657074 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f64e806b4d0 0x7f64e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:27.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.815+0000 7f64fb7fe640 1 --2- 172.21.15.7:0/3254657074 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f64e806b4d0 0x7f64e806d990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f64ec009560 tx=0x7f64ec009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:27.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:27.820+0000 7f64e3fff640 1 -- 172.21.15.7:0/3254657074 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f64fc0cea10 con 0x7f64fc15dba0 2024-04-25T09:55:28.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.005+0000 7f6501e2a640 1 -- 172.21.15.7:0/3254657074 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f64fc06ae80 con 0x7f64fc15dba0 2024-04-25T09:55:28.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.685+0000 7f64e3fff640 1 -- 172.21.15.7:0/3254657074 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7f64f004b030 con 0x7f64fc15dba0 2024-04-25T09:55:28.687 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data_ec' removed 2024-04-25T09:55:28.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.691+0000 7f6501e2a640 1 -- 172.21.15.7:0/3254657074 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f64e806b4d0 msgr2=0x7f64e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:28.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.691+0000 7f6501e2a640 1 --2- 172.21.15.7:0/3254657074 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f64e806b4d0 0x7f64e806d990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f64ec009560 tx=0x7f64ec009190 comp rx=0 tx=0).stop 2024-04-25T09:55:28.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.691+0000 7f6501e2a640 1 -- 172.21.15.7:0/3254657074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64fc15dba0 msgr2=0x7f64fc159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:28.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.691+0000 7f6501e2a640 1 --2- 172.21.15.7:0/3254657074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64fc15dba0 0x7f64fc159630 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f64f0031000 tx=0x7f64f00046c0 comp rx=0 tx=0).stop 2024-04-25T09:55:28.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.691+0000 7f6501e2a640 1 -- 172.21.15.7:0/3254657074 shutdown_connections 2024-04-25T09:55:28.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.691+0000 7f6501e2a640 1 --2- 172.21.15.7:0/3254657074 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f64e806b4d0 0x7f64e806d990 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:28.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.691+0000 7f6501e2a640 1 --2- 172.21.15.7:0/3254657074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64fc15df80 0x7f64fc0b5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:28.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.691+0000 7f6501e2a640 1 --2- 172.21.15.7:0/3254657074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64fc15dba0 0x7f64fc159630 secure :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f64f0031000 tx=0x7f64f00046c0 comp rx=0 tx=0).stop 2024-04-25T09:55:28.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.691+0000 7f6501e2a640 1 --2- 172.21.15.7:0/3254657074 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f64fc0b6a40 0x7f64fc0aa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:28.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.691+0000 7f6501e2a640 1 -- 172.21.15.7:0/3254657074 >> 172.21.15.7:0/3254657074 conn(0x7f64fc06c530 msgr2=0x7f64fc15f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:28.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.691+0000 7f6501e2a640 1 -- 172.21.15.7:0/3254657074 shutdown_connections 2024-04-25T09:55:28.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.691+0000 7f6501e2a640 1 -- 172.21.15.7:0/3254657074 wait complete. 2024-04-25T09:55:28.709 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:55:28.709 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:55:28.709 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:55:28.709 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:55:28.710 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:55:28.710 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:55:28.710 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:55:28.710 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:55:28.710 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:55:28.710 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:55:28.711 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:55:28.711 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:55:28.711 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:55:28.711 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:55:28.711 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:55:28.711 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:55:28.720 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:55:28.721 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:55:28.721 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:55:28.721 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:55:28.723 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:55:28.723 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:55:28.724 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:55:28.725 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:55:28.763 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:55:28.763 DEBUG:teuthology.parallel:result is None 2024-04-25T09:55:28.764 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:55:28.765 DEBUG:teuthology.parallel:result is None 2024-04-25T09:55:28.766 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:55:28.766 DEBUG:teuthology.parallel:result is None 2024-04-25T09:55:28.766 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:55:28.767 DEBUG:teuthology.parallel:result is None 2024-04-25T09:55:28.767 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:55:28.845 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-04-25T09:55:28.845 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-04-25T09:55:28.850 INFO:tasks.ceph.mds.d.smithi055.stdout:starting mds.d at 2024-04-25T09:55:28.850 INFO:tasks.ceph.mds.b.smithi055.stdout:starting mds.b at 2024-04-25T09:55:28.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.876+0000 7ff54ce37640 1 Processor -- start 2024-04-25T09:55:28.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.876+0000 7ff54ce37640 1 -- start start 2024-04-25T09:55:28.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.877+0000 7ff54ce37640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff54815db00 0x7ff5480d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:28.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.877+0000 7ff54ce37640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff5480b53b0 0x7ff5480d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:28.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.877+0000 7ff54ce37640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5480d1e80 con 0x7ff5480ce2b0 2024-04-25T09:55:28.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.877+0000 7ff54ce37640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5480b5930 con 0x7ff5480b53b0 2024-04-25T09:55:28.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.877+0000 7ff54ce37640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5480b5c10 con 0x7ff54815db00 2024-04-25T09:55:28.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.878+0000 7ff54659c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff54815db00 0x7ff5480d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:28.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.878+0000 7ff545d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff5480b53b0 0x7ff5480d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:28.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.878+0000 7ff54659c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff54815db00 0x7ff5480d0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:57364/0 (socket says 172.21.15.7:57364) 2024-04-25T09:55:28.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.878+0000 7ff54659c640 1 -- 172.21.15.7:0/628786016 learned_addr learned my addr 172.21.15.7:0/628786016 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:28.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.878+0000 7ff546d9d640 1 --1- 172.21.15.7:0/628786016 >> v1:172.21.15.55:6789/0 conn(0x7ff5480ce2b0 0x7ff548161670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:44820/0 (socket says 172.21.15.7:44820) 2024-04-25T09:55:28.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.878+0000 7ff54659c640 1 -- 172.21.15.7:0/628786016 >> v2:172.21.15.55:3300/0 conn(0x7ff5480b53b0 msgr2=0x7ff5480d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:28.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.878+0000 7ff54659c640 1 --2- 172.21.15.7:0/628786016 >> v2:172.21.15.55:3300/0 conn(0x7ff5480b53b0 0x7ff5480d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:28.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.878+0000 7ff54659c640 1 -- 172.21.15.7:0/628786016 >> v1:172.21.15.55:6789/0 conn(0x7ff5480ce2b0 legacy=0x7ff548161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:28.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.878+0000 7ff54659c640 1 -- 172.21.15.7:0/628786016 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5480b5ef0 con 0x7ff54815db00 2024-04-25T09:55:28.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.879+0000 7ff54659c640 1 --2- 172.21.15.7:0/628786016 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff54815db00 0x7ff5480d0340 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff530009870 tx=0x7ff53002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fcf1209081830a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:28.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.879+0000 7ff54559a640 1 -- 172.21.15.7:0/628786016 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff530037070 con 0x7ff54815db00 2024-04-25T09:55:28.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.879+0000 7ff54559a640 1 -- 172.21.15.7:0/628786016 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff530032440 con 0x7ff54815db00 2024-04-25T09:55:28.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.879+0000 7ff54559a640 1 -- 172.21.15.7:0/628786016 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff530032810 con 0x7ff54815db00 2024-04-25T09:55:28.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.879+0000 7ff54ce37640 1 -- 172.21.15.7:0/628786016 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff54815db00 msgr2=0x7ff5480d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:28.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.879+0000 7ff54ce37640 1 --2- 172.21.15.7:0/628786016 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff54815db00 0x7ff5480d0340 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff530009870 tx=0x7ff53002a270 comp rx=0 tx=0).stop 2024-04-25T09:55:28.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.879+0000 7ff54ce37640 1 -- 172.21.15.7:0/628786016 shutdown_connections 2024-04-25T09:55:28.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.879+0000 7ff54ce37640 1 --2- 172.21.15.7:0/628786016 >> v2:172.21.15.55:3300/0 conn(0x7ff5480b53b0 0x7ff5480d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:28.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.879+0000 7ff54ce37640 1 --2- 172.21.15.7:0/628786016 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff54815db00 0x7ff5480d0340 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:28.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.879+0000 7ff54ce37640 1 -- 172.21.15.7:0/628786016 >> 172.21.15.7:0/628786016 conn(0x7ff548072290 msgr2=0x7ff5480726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:28.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.879+0000 7ff54ce37640 1 -- 172.21.15.7:0/628786016 shutdown_connections 2024-04-25T09:55:28.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.879+0000 7ff54ce37640 1 -- 172.21.15.7:0/628786016 wait complete. 2024-04-25T09:55:28.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.881+0000 7ff54ce37640 1 Processor -- start 2024-04-25T09:55:28.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.881+0000 7ff54ce37640 1 -- start start 2024-04-25T09:55:28.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.882+0000 7ff54ce37640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff5480b53b0 0x7ff5481529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:28.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.882+0000 7ff54ce37640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5480ce2b0 0x7ff5480ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:28.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.882+0000 7ff54ce37640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff54815db00 0x7ff5480cd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:28.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.882+0000 7ff54ce37640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5480d3660 con 0x7ff5480ce2b0 2024-04-25T09:55:28.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.882+0000 7ff54ce37640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5480b61d0 con 0x7ff54815db00 2024-04-25T09:55:28.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.882+0000 7ff54ce37640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5480b6c10 con 0x7ff5480b53b0 2024-04-25T09:55:28.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.882+0000 7ff545d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5480ce2b0 0x7ff5480ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:28.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.882+0000 7ff545d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5480ce2b0 0x7ff5480ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36726/0 (socket says 172.21.15.7:36726) 2024-04-25T09:55:28.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.882+0000 7ff545d9b640 1 -- 172.21.15.7:0/1293192240 learned_addr learned my addr 172.21.15.7:0/1293192240 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:28.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.882+0000 7ff54659c640 1 --2- 172.21.15.7:0/1293192240 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff5480b53b0 0x7ff5481529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:28.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.882+0000 7ff546d9d640 1 --2- 172.21.15.7:0/1293192240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff54815db00 0x7ff5480cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:28.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.882+0000 7ff545d9b640 1 -- 172.21.15.7:0/1293192240 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff5480b53b0 msgr2=0x7ff5481529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:28.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.882+0000 7ff545d9b640 1 --2- 172.21.15.7:0/1293192240 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff5480b53b0 0x7ff5481529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:28.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.882+0000 7ff545d9b640 1 -- 172.21.15.7:0/1293192240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff54815db00 msgr2=0x7ff5480cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:28.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.882+0000 7ff545d9b640 1 --2- 172.21.15.7:0/1293192240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff54815db00 0x7ff5480cd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:28.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.882+0000 7ff545d9b640 1 -- 172.21.15.7:0/1293192240 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5481f6dd0 con 0x7ff5480ce2b0 2024-04-25T09:55:28.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.882+0000 7ff545d9b640 1 --2- 172.21.15.7:0/1293192240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5480ce2b0 0x7ff5480ccbd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff53800e9b0 tx=0x7ff53800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:28.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.883+0000 7ff53effd640 1 -- 172.21.15.7:0/1293192240 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff538017070 con 0x7ff5480ce2b0 2024-04-25T09:55:28.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.883+0000 7ff53effd640 1 -- 172.21.15.7:0/1293192240 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53800c9a0 con 0x7ff5480ce2b0 2024-04-25T09:55:28.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.883+0000 7ff54ce37640 1 -- 172.21.15.7:0/1293192240 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5481f70b0 con 0x7ff5480ce2b0 2024-04-25T09:55:28.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.883+0000 7ff53effd640 1 -- 172.21.15.7:0/1293192240 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53800cd90 con 0x7ff5480ce2b0 2024-04-25T09:55:28.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.883+0000 7ff54ce37640 1 -- 172.21.15.7:0/1293192240 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5481f7670 con 0x7ff5480ce2b0 2024-04-25T09:55:28.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.884+0000 7ff54ce37640 1 -- 172.21.15.7:0/1293192240 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff548068fd0 con 0x7ff5480ce2b0 2024-04-25T09:55:28.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.884+0000 7ff53effd640 1 -- 172.21.15.7:0/1293192240 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff53801a070 con 0x7ff5480ce2b0 2024-04-25T09:55:28.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.884+0000 7ff53effd640 1 --2- 172.21.15.7:0/1293192240 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff52806b500 0x7ff52806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:28.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.885+0000 7ff53effd640 1 -- 172.21.15.7:0/1293192240 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5335+0+0 (secure 0 0 0) 0x7ff53808a380 con 0x7ff5480ce2b0 2024-04-25T09:55:28.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.885+0000 7ff54659c640 1 --2- 172.21.15.7:0/1293192240 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff52806b500 0x7ff52806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:28.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.885+0000 7ff54659c640 1 --2- 172.21.15.7:0/1293192240 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff52806b500 0x7ff52806d9c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff530034000 tx=0x7ff53002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:28.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:28.889+0000 7ff53effd640 1 -- 172.21.15.7:0/1293192240 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff538058d10 con 0x7ff5480ce2b0 2024-04-25T09:55:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.081+0000 7ff54ce37640 1 -- 172.21.15.7:0/1293192240 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff5480d16b0 con 0x7ff5480ce2b0 2024-04-25T09:55:29.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.702+0000 7ff53effd640 1 -- 172.21.15.7:0/1293192240 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff53805cdb0 con 0x7ff5480ce2b0 2024-04-25T09:55:29.704 INFO:teuthology.orchestra.run.smithi007.stderr: removed all blocklist entries 2024-04-25T09:55:29.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.705+0000 7ff54ce37640 1 -- 172.21.15.7:0/1293192240 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff52806b500 msgr2=0x7ff52806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:29.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.705+0000 7ff54ce37640 1 --2- 172.21.15.7:0/1293192240 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff52806b500 0x7ff52806d9c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff530034000 tx=0x7ff53002e000 comp rx=0 tx=0).stop 2024-04-25T09:55:29.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.705+0000 7ff54ce37640 1 -- 172.21.15.7:0/1293192240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5480ce2b0 msgr2=0x7ff5480ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:29.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.705+0000 7ff54ce37640 1 --2- 172.21.15.7:0/1293192240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5480ce2b0 0x7ff5480ccbd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff53800e9b0 tx=0x7ff53800ee70 comp rx=0 tx=0).stop 2024-04-25T09:55:29.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.705+0000 7ff54ce37640 1 -- 172.21.15.7:0/1293192240 shutdown_connections 2024-04-25T09:55:29.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.705+0000 7ff54ce37640 1 --2- 172.21.15.7:0/1293192240 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff52806b500 0x7ff52806d9c0 secure :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff530034000 tx=0x7ff53002e000 comp rx=0 tx=0).stop 2024-04-25T09:55:29.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.705+0000 7ff54ce37640 1 --2- 172.21.15.7:0/1293192240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff54815db00 0x7ff5480cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:29.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.705+0000 7ff54ce37640 1 --2- 172.21.15.7:0/1293192240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5480ce2b0 0x7ff5480ccbd0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:29.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.705+0000 7ff54ce37640 1 --2- 172.21.15.7:0/1293192240 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff5480b53b0 0x7ff5481529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:29.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.705+0000 7ff54ce37640 1 -- 172.21.15.7:0/1293192240 >> 172.21.15.7:0/1293192240 conn(0x7ff548072290 msgr2=0x7ff5480c9380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:29.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.705+0000 7ff54ce37640 1 -- 172.21.15.7:0/1293192240 shutdown_connections 2024-04-25T09:55:29.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.705+0000 7ff54ce37640 1 -- 172.21.15.7:0/1293192240 wait complete. 2024-04-25T09:55:29.722 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:55:29.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.825+0000 7f899fd42640 1 Processor -- start 2024-04-25T09:55:29.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.825+0000 7f899fd42640 1 -- start start 2024-04-25T09:55:29.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.826+0000 7f899fd42640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89980cd740 0x7f89980d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:29.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.826+0000 7f899fd42640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f899806cd90 0x7f89980cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:29.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.826+0000 7f899fd42640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8998099b90 con 0x7f89980d08d0 2024-04-25T09:55:29.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.826+0000 7f899fd42640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89980cdb20 con 0x7f899806cd90 2024-04-25T09:55:29.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.826+0000 7f899fd42640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8998099e70 con 0x7f89980cd740 2024-04-25T09:55:29.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.826+0000 7f899e2df640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f899806cd90 0x7f89980cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:29.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.826+0000 7f899d2dd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f89980d08d0 0x7f899806c680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40510/0 (socket says 172.21.15.7:40510) 2024-04-25T09:55:29.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.826+0000 7f899e2df640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f899806cd90 0x7f89980cbc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41904/0 (socket says 172.21.15.7:41904) 2024-04-25T09:55:29.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.826+0000 7f899d2dd640 1 -- 172.21.15.7:0/3848642209 learned_addr learned my addr 172.21.15.7:0/3848642209 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:29.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.827+0000 7f899dade640 1 --2- 172.21.15.7:0/3848642209 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89980cd740 0x7f89980d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:29.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.827+0000 7f899e2df640 1 -- 172.21.15.7:0/3848642209 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89980cd740 msgr2=0x7f89980d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:29.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.827+0000 7f899e2df640 1 --2- 172.21.15.7:0/3848642209 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89980cd740 0x7f89980d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:29.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.827+0000 7f899e2df640 1 -- 172.21.15.7:0/3848642209 >> v1:172.21.15.7:6789/0 conn(0x7f89980d08d0 legacy=0x7f899806c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:29.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.827+0000 7f899e2df640 1 -- 172.21.15.7:0/3848642209 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899809a150 con 0x7f899806cd90 2024-04-25T09:55:29.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.827+0000 7f899cadc640 1 -- 172.21.15.7:0/3848642209 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3505229990 0 0) 0x7f8998099b90 con 0x7f89980d08d0 2024-04-25T09:55:29.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.827+0000 7f899e2df640 1 --2- 172.21.15.7:0/3848642209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f899806cd90 0x7f89980cbc90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8988009d90 tx=0x7f898802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139eee487fe0503c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:29.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.828+0000 7f899cadc640 1 -- 172.21.15.7:0/3848642209 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8988007740 con 0x7f899806cd90 2024-04-25T09:55:29.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.828+0000 7f899cadc640 1 -- 172.21.15.7:0/3848642209 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89880078e0 con 0x7f899806cd90 2024-04-25T09:55:29.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.828+0000 7f899cadc640 1 -- 172.21.15.7:0/3848642209 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8988007cb0 con 0x7f899806cd90 2024-04-25T09:55:29.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.828+0000 7f899fd42640 1 -- 172.21.15.7:0/3848642209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f899806cd90 msgr2=0x7f89980cbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:29.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.828+0000 7f899fd42640 1 --2- 172.21.15.7:0/3848642209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f899806cd90 0x7f89980cbc90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8988009d90 tx=0x7f898802a660 comp rx=0 tx=0).stop 2024-04-25T09:55:29.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.828+0000 7f899fd42640 1 -- 172.21.15.7:0/3848642209 shutdown_connections 2024-04-25T09:55:29.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.828+0000 7f899fd42640 1 --2- 172.21.15.7:0/3848642209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f899806cd90 0x7f89980cbc90 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:29.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.828+0000 7f899fd42640 1 --2- 172.21.15.7:0/3848642209 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89980cd740 0x7f89980d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:29.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.828+0000 7f899fd42640 1 -- 172.21.15.7:0/3848642209 >> 172.21.15.7:0/3848642209 conn(0x7f89980b3130 msgr2=0x7f89980b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:29.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.828+0000 7f899fd42640 1 -- 172.21.15.7:0/3848642209 shutdown_connections 2024-04-25T09:55:29.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.828+0000 7f899fd42640 1 -- 172.21.15.7:0/3848642209 wait complete. 2024-04-25T09:55:29.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.829+0000 7f899fd42640 1 Processor -- start 2024-04-25T09:55:29.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.830+0000 7f899fd42640 1 -- start start 2024-04-25T09:55:29.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.830+0000 7f899fd42640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f899806cd90 0x7f89980b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:29.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.830+0000 7f899fd42640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89980cd740 0x7f89980ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:29.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.830+0000 7f899fd42640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89980d08d0 0x7f8998070370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:29.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.830+0000 7f899fd42640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899809ac30 con 0x7f89980d08d0 2024-04-25T09:55:29.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.830+0000 7f899fd42640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899809a710 con 0x7f89980cd740 2024-04-25T09:55:29.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.830+0000 7f899fd42640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899809adb0 con 0x7f899806cd90 2024-04-25T09:55:29.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.830+0000 7f899e2df640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89980d08d0 0x7f8998070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:29.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.830+0000 7f899e2df640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89980d08d0 0x7f8998070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41920/0 (socket says 172.21.15.7:41920) 2024-04-25T09:55:29.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.830+0000 7f899e2df640 1 -- 172.21.15.7:0/2170611137 learned_addr learned my addr 172.21.15.7:0/2170611137 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:29.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.830+0000 7f899dade640 1 --2- 172.21.15.7:0/2170611137 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f899806cd90 0x7f89980b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:29.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.830+0000 7f899d2dd640 1 --2- 172.21.15.7:0/2170611137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89980cd740 0x7f89980ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:29.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.831+0000 7f899e2df640 1 -- 172.21.15.7:0/2170611137 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f899806cd90 msgr2=0x7f89980b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:29.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.831+0000 7f899e2df640 1 --2- 172.21.15.7:0/2170611137 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f899806cd90 0x7f89980b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:29.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.831+0000 7f899e2df640 1 -- 172.21.15.7:0/2170611137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89980cd740 msgr2=0x7f89980ae330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:29.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.831+0000 7f899e2df640 1 --2- 172.21.15.7:0/2170611137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89980cd740 0x7f89980ae330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:29.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.831+0000 7f899e2df640 1 -- 172.21.15.7:0/2170611137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89980ae870 con 0x7f89980d08d0 2024-04-25T09:55:29.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.831+0000 7f899dade640 1 --2- 172.21.15.7:0/2170611137 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f899806cd90 0x7f89980b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:29.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.831+0000 7f899d2dd640 1 --2- 172.21.15.7:0/2170611137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89980cd740 0x7f89980ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:29.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.831+0000 7f899e2df640 1 --2- 172.21.15.7:0/2170611137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89980d08d0 0x7f8998070370 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8988009d90 tx=0x7f8988004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:29.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.831+0000 7f89967fc640 1 -- 172.21.15.7:0/2170611137 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8988040070 con 0x7f89980d08d0 2024-04-25T09:55:29.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.831+0000 7f89967fc640 1 -- 172.21.15.7:0/2170611137 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8988031bc0 con 0x7f89980d08d0 2024-04-25T09:55:29.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.831+0000 7f899fd42640 1 -- 172.21.15.7:0/2170611137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89980aeb10 con 0x7f89980d08d0 2024-04-25T09:55:29.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.831+0000 7f89967fc640 1 -- 172.21.15.7:0/2170611137 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8988009450 con 0x7f89980d08d0 2024-04-25T09:55:29.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.831+0000 7f899fd42640 1 -- 172.21.15.7:0/2170611137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89980af0d0 con 0x7f89980d08d0 2024-04-25T09:55:29.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.832+0000 7f899fd42640 1 -- 172.21.15.7:0/2170611137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8998068fd0 con 0x7f89980d08d0 2024-04-25T09:55:29.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.833+0000 7f89967fc640 1 -- 172.21.15.7:0/2170611137 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8988039040 con 0x7f89980d08d0 2024-04-25T09:55:29.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.833+0000 7f89967fc640 1 --2- 172.21.15.7:0/2170611137 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f898406b4d0 0x7f898406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:29.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.833+0000 7f89967fc640 1 -- 172.21.15.7:0/2170611137 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f89880ab520 con 0x7f89980d08d0 2024-04-25T09:55:29.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.833+0000 7f899dade640 1 --2- 172.21.15.7:0/2170611137 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f898406b4d0 0x7f898406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:29.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.833+0000 7f899dade640 1 --2- 172.21.15.7:0/2170611137 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f898406b4d0 0x7f898406d990 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8990009b90 tx=0x7f8990008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:29.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:29.837+0000 7f89967fc640 1 -- 172.21.15.7:0/2170611137 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8988079f10 con 0x7f89980d08d0 2024-04-25T09:55:30.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.090+0000 7f899fd42640 1 -- 172.21.15.7:0/2170611137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f89980b4040 con 0x7f89980d08d0 2024-04-25T09:55:30.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.090+0000 7f89967fc640 1 -- 172.21.15.7:0/2170611137 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f898807dfb0 con 0x7f89980d08d0 2024-04-25T09:55:30.092 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:30.092 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T09:55:30.092 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_dump": [ 2024-04-25T09:55:30.093 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:55:30.093 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.a", 2024-04-25T09:55:30.093 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmDER5IhAA2ih+YNPXKaTRN6KeMKiDaA==", 2024-04-25T09:55:30.093 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:55:30.093 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:55:30.093 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T09:55:30.093 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T09:55:30.093 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:55:30.093 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:55:30.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:55:30.093 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:55:30.093 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.b", 2024-04-25T09:55:30.094 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmp55aLhAAD3pB8YjSzrpU6DfjQTVHPw==", 2024-04-25T09:55:30.094 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:55:30.094 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:55:30.094 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T09:55:30.094 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T09:55:30.094 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:55:30.094 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:55:30.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:55:30.094 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:55:30.094 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.c", 2024-04-25T09:55:30.094 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpm8jBtKRAAiDZo8S/z1fE588t8tiuX8Q==", 2024-04-25T09:55:30.094 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:55:30.095 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:55:30.095 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T09:55:30.095 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T09:55:30.095 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:55:30.095 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:55:30.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:55:30.095 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:55:30.095 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.d", 2024-04-25T09:55:30.095 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmZWyRNRAA6tdquR+Hh8Lhx7LATegX6g==", 2024-04-25T09:55:30.095 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:55:30.095 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:55:30.095 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T09:55:30.096 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T09:55:30.096 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:55:30.096 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:55:30.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:55:30.096 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:55:30.096 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.0", 2024-04-25T09:55:30.096 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAaKCpmfHZ9HBAA9FYBJbc1QdNt1a9qtFhgBw==", 2024-04-25T09:55:30.096 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:55:30.096 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:55:30.096 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:55:30.096 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:55:30.096 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:55:30.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:55:30.097 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:55:30.097 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.1", 2024-04-25T09:55:30.097 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAdKCpmtYOgGhAAbM8XXG5fT+UNSvzvijeJ9Q==", 2024-04-25T09:55:30.097 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:55:30.097 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:55:30.097 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:55:30.097 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:55:30.097 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:55:30.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:55:30.097 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:55:30.097 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.2", 2024-04-25T09:55:30.097 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAgKCpmz4uZGBAA6JD3UWZ/8l12y4lJg0kH0A==", 2024-04-25T09:55:30.098 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:55:30.098 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:55:30.098 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:55:30.098 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:55:30.098 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:55:30.098 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:55:30.098 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:55:30.098 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.3", 2024-04-25T09:55:30.098 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAjKCpmcbXXFhAAsK64H4YqdiD1VJKQtn46OQ==", 2024-04-25T09:55:30.098 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:55:30.098 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:55:30.098 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:55:30.099 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:55:30.099 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:55:30.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:55:30.099 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:55:30.099 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.4", 2024-04-25T09:55:30.099 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAsKCpmzEDuKxAAmzxdcdVZIq2bGfG0rYcBBg==", 2024-04-25T09:55:30.099 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:55:30.099 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:55:30.099 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:55:30.099 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:55:30.099 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:55:30.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:55:30.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:55:30.100 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.5", 2024-04-25T09:55:30.100 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAvKCpmfyC4KxAAl6QUtdlRRaRNZpECSoHLJQ==", 2024-04-25T09:55:30.100 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:55:30.100 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:55:30.100 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:55:30.100 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:55:30.100 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:55:30.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:55:30.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:55:30.100 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.6", 2024-04-25T09:55:30.100 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAyKCpmBrUsKxAAH5IlxYRXUtPKYWDdTqBp3w==", 2024-04-25T09:55:30.101 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:55:30.101 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:55:30.101 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:55:30.101 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:55:30.101 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:55:30.101 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:55:30.101 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:55:30.101 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.7", 2024-04-25T09:55:30.101 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQA1KCpmmwTSKhAAdzw/c0Xc6KCQHssqUI910g==", 2024-04-25T09:55:30.101 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:55:30.101 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:55:30.101 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:55:30.102 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:55:30.102 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:55:30.102 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:55:30.102 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:55:30.102 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.0", 2024-04-25T09:55:30.102 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmaJKeORAALxC5ZqLLEu0zJFG+SOGukQ==", 2024-04-25T09:55:30.102 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:55:30.102 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:55:30.102 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-04-25T09:55:30.102 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-04-25T09:55:30.102 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-04-25T09:55:30.102 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:55:30.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:55:30.103 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:55:30.103 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.1", 2024-04-25T09:55:30.103 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAZKCpmC2i6BhAAtKmpTNs/Tga7NtOkm7jSOg==", 2024-04-25T09:55:30.103 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:55:30.103 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:55:30.103 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-04-25T09:55:30.103 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-04-25T09:55:30.103 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-04-25T09:55:30.103 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:55:30.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:55:30.104 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:55:30.104 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.2", 2024-04-25T09:55:30.104 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAZKCpmytCIAxAAhP2UjagzGbz1ySErw1cw3Q==", 2024-04-25T09:55:30.104 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:55:30.104 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:55:30.104 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-04-25T09:55:30.104 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-04-25T09:55:30.104 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-04-25T09:55:30.104 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:55:30.104 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:55:30.104 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:55:30.104 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.3", 2024-04-25T09:55:30.105 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAZKCpmSj88DBAAg+N3XDyc3H6fUBqkScD/9Q==", 2024-04-25T09:55:30.105 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:55:30.105 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:55:30.105 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-04-25T09:55:30.105 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-04-25T09:55:30.105 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-04-25T09:55:30.105 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:55:30.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:55:30.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:55:30.105 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.admin", 2024-04-25T09:55:30.105 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpm8SYpBhAACl5SVNaaKZV7rIIFaFlmvw==", 2024-04-25T09:55:30.105 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:55:30.106 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-04-25T09:55:30.106 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T09:55:30.106 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T09:55:30.106 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:55:30.106 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:55:30.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:55:30.106 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:55:30.106 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.bootstrap-mds", 2024-04-25T09:55:30.106 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQA7KCpmo7d3IhAAIg/k6GAUU1ihRxMM5L1u3Q==", 2024-04-25T09:55:30.106 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:55:30.106 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile bootstrap-mds" 2024-04-25T09:55:30.106 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:55:30.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:55:30.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:55:30.107 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.bootstrap-mgr", 2024-04-25T09:55:30.107 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQA7KCpmzL93IhAAcRUU92jWkNxo/lTnjy/jWQ==", 2024-04-25T09:55:30.107 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:55:30.107 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-25T09:55:30.107 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:55:30.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:55:30.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:55:30.107 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.bootstrap-osd", 2024-04-25T09:55:30.107 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQA7KCpmqcd3IhAA1RlPiaa5DK6Gsi2WsjWIwA==", 2024-04-25T09:55:30.108 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:55:30.108 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile bootstrap-osd" 2024-04-25T09:55:30.108 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:55:30.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:55:30.108 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:55:30.108 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.bootstrap-rbd", 2024-04-25T09:55:30.108 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQA7KCpmuc53IhAAMZEPty5SpFMNIsQ6COcJ2w==", 2024-04-25T09:55:30.108 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:55:30.108 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-25T09:55:30.108 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:55:30.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:55:30.108 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:55:30.109 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-25T09:55:30.109 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQA7KCpmB9Z3IhAAjTxqcy/uz9yArGLbK8tzOg==", 2024-04-25T09:55:30.109 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:55:30.109 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-25T09:55:30.109 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:55:30.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:55:30.109 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:55:30.109 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.bootstrap-rgw", 2024-04-25T09:55:30.109 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQA7KCpmyd53IhAA96Ck/QesckNcGov2q4+NSg==", 2024-04-25T09:55:30.109 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:55:30.109 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-25T09:55:30.110 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:55:30.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:55:30.110 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:55:30.110 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.x", 2024-04-25T09:55:30.110 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmqIdPHxAACc5SoI1y74ickl2cPjfGIg==", 2024-04-25T09:55:30.110 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:55:30.110 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-04-25T09:55:30.110 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2024-04-25T09:55:30.110 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:55:30.110 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:55:30.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:55:30.111 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:55:30.111 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.y", 2024-04-25T09:55:30.111 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmCvpDGxAAYsxd6zUjxUgY0sYwR4VvAQ==", 2024-04-25T09:55:30.111 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:55:30.111 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-04-25T09:55:30.111 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2024-04-25T09:55:30.111 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:55:30.111 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:55:30.111 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:55:30.111 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-25T09:55:30.111 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T09:55:30.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.092+0000 7f899fd42640 1 -- 172.21.15.7:0/2170611137 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f898406b4d0 msgr2=0x7f898406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:30.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.092+0000 7f899fd42640 1 --2- 172.21.15.7:0/2170611137 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f898406b4d0 0x7f898406d990 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8990009b90 tx=0x7f8990008040 comp rx=0 tx=0).stop 2024-04-25T09:55:30.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.092+0000 7f899fd42640 1 -- 172.21.15.7:0/2170611137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89980d08d0 msgr2=0x7f8998070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:30.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.092+0000 7f899fd42640 1 --2- 172.21.15.7:0/2170611137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89980d08d0 0x7f8998070370 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8988009d90 tx=0x7f8988004a40 comp rx=0 tx=0).stop 2024-04-25T09:55:30.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.092+0000 7f899fd42640 1 -- 172.21.15.7:0/2170611137 shutdown_connections 2024-04-25T09:55:30.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.092+0000 7f899fd42640 1 --2- 172.21.15.7:0/2170611137 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f898406b4d0 0x7f898406d990 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:30.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.092+0000 7f899fd42640 1 --2- 172.21.15.7:0/2170611137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89980d08d0 0x7f8998070370 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:30.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.092+0000 7f899fd42640 1 --2- 172.21.15.7:0/2170611137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89980cd740 0x7f89980ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:30.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.092+0000 7f899fd42640 1 --2- 172.21.15.7:0/2170611137 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f899806cd90 0x7f89980b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:30.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.092+0000 7f899fd42640 1 -- 172.21.15.7:0/2170611137 >> 172.21.15.7:0/2170611137 conn(0x7f89980b3130 msgr2=0x7f899806c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:30.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.092+0000 7f899fd42640 1 -- 172.21.15.7:0/2170611137 shutdown_connections 2024-04-25T09:55:30.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.092+0000 7f899fd42640 1 -- 172.21.15.7:0/2170611137 wait complete. 2024-04-25T09:55:30.115 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-25T09:55:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.214+0000 7f69691f4640 1 Processor -- start 2024-04-25T09:55:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.214+0000 7f69691f4640 1 -- start start 2024-04-25T09:55:30.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.215+0000 7f69691f4640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f696415eb70 0x7f69640af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:30.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.215+0000 7f69691f4640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69640aeba0 con 0x7f696415a900 2024-04-25T09:55:30.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.215+0000 7f69691f4640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69640aee10 con 0x7f69640ae710 2024-04-25T09:55:30.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.215+0000 7f69691f4640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69640afa30 con 0x7f696415eb70 2024-04-25T09:55:30.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.215+0000 7f6962d9d640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f696415a900 0x7f696415e460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40516/0 (socket says 172.21.15.7:40516) 2024-04-25T09:55:30.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.215+0000 7f6962d9d640 1 -- 172.21.15.7:0/585729887 learned_addr learned my addr 172.21.15.7:0/585729887 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:30.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.216+0000 7f696259c640 1 --2- 172.21.15.7:0/585729887 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f696415eb70 0x7f69640af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:30.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.216+0000 7f6961d9b640 1 -- 172.21.15.7:0/585729887 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4184358479 0 0) 0x7f69640aeba0 con 0x7f696415a900 2024-04-25T09:55:30.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.216+0000 7f6961d9b640 1 -- 172.21.15.7:0/585729887 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f694c003520 con 0x7f696415a900 2024-04-25T09:55:30.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.216+0000 7f6961d9b640 1 -- 172.21.15.7:0/585729887 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1982401482 0 0) 0x7f69640aee10 con 0x7f69640ae710 2024-04-25T09:55:30.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.216+0000 7f6961d9b640 1 -- 172.21.15.7:0/585729887 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69640aeba0 con 0x7f69640ae710 2024-04-25T09:55:30.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.216+0000 7f6961d9b640 1 -- 172.21.15.7:0/585729887 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2142133580 0 0) 0x7f694c003520 con 0x7f696415a900 2024-04-25T09:55:30.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.216+0000 7f6961d9b640 1 -- 172.21.15.7:0/585729887 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f696415eb70 msgr2=0x7f69640af3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:30.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.216+0000 7f6961d9b640 1 --2- 172.21.15.7:0/585729887 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f696415eb70 0x7f69640af3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:30.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.216+0000 7f6961d9b640 1 -- 172.21.15.7:0/585729887 >> v1:172.21.15.55:6789/0 conn(0x7f69640ae710 legacy=0x7f69640b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:30.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.216+0000 7f6961d9b640 1 -- 172.21.15.7:0/585729887 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69640afc80 con 0x7f696415a900 2024-04-25T09:55:30.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.216+0000 7f6961d9b640 1 -- 172.21.15.7:0/585729887 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f6958001670 con 0x7f696415a900 2024-04-25T09:55:30.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.216+0000 7f696259c640 1 --2- 172.21.15.7:0/585729887 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f696415eb70 0x7f69640af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:55:30.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.216+0000 7f6961d9b640 1 -- 172.21.15.7:0/585729887 >> v1:172.21.15.7:6789/0 conn(0x7f696415a900 legacy=0x7f696415e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:30.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.216+0000 7f6961d9b640 1 --2- 172.21.15.7:0/585729887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f694c003b70 0x7f694c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:30.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.216+0000 7f6961d9b640 1 --2- 172.21.15.7:0/585729887 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f696415eb70 0x7f694c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:30.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.216+0000 7f6961d9b640 1 --2- 172.21.15.7:0/585729887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f694c004d40 0x7f694c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:30.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.216+0000 7f6961d9b640 1 -- 172.21.15.7:0/585729887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69640afa30 con 0x7f694c004d40 2024-04-25T09:55:30.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.216+0000 7f6961d9b640 1 -- 172.21.15.7:0/585729887 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694c00ba70 con 0x7f694c003b70 2024-04-25T09:55:30.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.216+0000 7f6961d9b640 1 -- 172.21.15.7:0/585729887 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f694c00bc70 con 0x7f696415eb70 2024-04-25T09:55:30.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.216+0000 7f696359e640 1 --2- 172.21.15.7:0/585729887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f694c004d40 0x7f694c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:30.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.216+0000 7f6962d9d640 1 --2- 172.21.15.7:0/585729887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f694c003b70 0x7f694c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:30.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.216+0000 7f696259c640 1 --2- 172.21.15.7:0/585729887 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f696415eb70 0x7f694c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:30.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.217+0000 7f696359e640 1 -- 172.21.15.7:0/585729887 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f696415eb70 msgr2=0x7f694c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:30.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.217+0000 7f696359e640 1 --2- 172.21.15.7:0/585729887 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f696415eb70 0x7f694c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:30.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.217+0000 7f696359e640 1 -- 172.21.15.7:0/585729887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f694c003b70 msgr2=0x7f694c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:30.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.217+0000 7f696359e640 1 --2- 172.21.15.7:0/585729887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f694c003b70 0x7f694c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:30.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.217+0000 7f696359e640 1 -- 172.21.15.7:0/585729887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f694c003520 con 0x7f694c004d40 2024-04-25T09:55:30.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.217+0000 7f696359e640 1 --2- 172.21.15.7:0/585729887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f694c004d40 0x7f694c0051c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f695c001bb0 tx=0x7f694c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=327f7c25d5620c15 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:30.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.217+0000 7f6961d9b640 1 -- 172.21.15.7:0/585729887 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c001bf0 con 0x7f694c004d40 2024-04-25T09:55:30.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.217+0000 7f6961d9b640 1 -- 172.21.15.7:0/585729887 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695c003b70 con 0x7f694c004d40 2024-04-25T09:55:30.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.218+0000 7f6961d9b640 1 -- 172.21.15.7:0/585729887 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c0050d0 con 0x7f694c004d40 2024-04-25T09:55:30.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.218+0000 7f69691f4640 1 -- 172.21.15.7:0/585729887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f694c004d40 msgr2=0x7f694c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:30.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.218+0000 7f69691f4640 1 --2- 172.21.15.7:0/585729887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f694c004d40 0x7f694c0051c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f695c001bb0 tx=0x7f694c005830 comp rx=0 tx=0).stop 2024-04-25T09:55:30.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.218+0000 7f696359e640 1 -- 172.21.15.7:0/585729887 reap_dead start 2024-04-25T09:55:30.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.218+0000 7f69691f4640 1 -- 172.21.15.7:0/585729887 shutdown_connections 2024-04-25T09:55:30.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.218+0000 7f69691f4640 1 -- 172.21.15.7:0/585729887 >> 172.21.15.7:0/585729887 conn(0x7f69640b5c30 msgr2=0x7f69640999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:30.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.218+0000 7f69691f4640 1 -- 172.21.15.7:0/585729887 shutdown_connections 2024-04-25T09:55:30.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.218+0000 7f69691f4640 1 -- 172.21.15.7:0/585729887 wait complete. 2024-04-25T09:55:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.220+0000 7f69691f4640 1 Processor -- start 2024-04-25T09:55:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.220+0000 7f69691f4640 1 -- start start 2024-04-25T09:55:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.220+0000 7f69691f4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f694c004d40 0x7f696414ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.220+0000 7f69691f4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f696414a010 0x7f6964149960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.220+0000 7f69691f4640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f696415d270 0x7f696414c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.220+0000 7f69691f4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696415ace0 con 0x7f696414a010 2024-04-25T09:55:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.220+0000 7f69691f4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69640b02d0 con 0x7f694c004d40 2024-04-25T09:55:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.220+0000 7f69691f4640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69640af3e0 con 0x7f696415d270 2024-04-25T09:55:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.220+0000 7f696259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f696414a010 0x7f6964149960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.221+0000 7f696259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f696414a010 0x7f6964149960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41926/0 (socket says 172.21.15.7:41926) 2024-04-25T09:55:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.221+0000 7f696259c640 1 -- 172.21.15.7:0/2649919266 learned_addr learned my addr 172.21.15.7:0/2649919266 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.221+0000 7f6962d9d640 1 --2- 172.21.15.7:0/2649919266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f694c004d40 0x7f696414ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.221+0000 7f696259c640 1 -- 172.21.15.7:0/2649919266 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f696415d270 msgr2=0x7f696414c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.221+0000 7f696359e640 1 --2- 172.21.15.7:0/2649919266 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f696415d270 0x7f696414c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.221+0000 7f696259c640 1 --2- 172.21.15.7:0/2649919266 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f696415d270 0x7f696414c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.221+0000 7f696259c640 1 -- 172.21.15.7:0/2649919266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f694c004d40 msgr2=0x7f696414ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.221+0000 7f696259c640 1 --2- 172.21.15.7:0/2649919266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f694c004d40 0x7f696414ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.221+0000 7f696259c640 1 -- 172.21.15.7:0/2649919266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696414bc20 con 0x7f696414a010 2024-04-25T09:55:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.221+0000 7f696259c640 1 --2- 172.21.15.7:0/2649919266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f696414a010 0x7f6964149960 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f69540119d0 tx=0x7f6954011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.221+0000 7f694b7fe640 1 -- 172.21.15.7:0/2649919266 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695400faf0 con 0x7f696414a010 2024-04-25T09:55:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.221+0000 7f694b7fe640 1 -- 172.21.15.7:0/2649919266 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695400fc90 con 0x7f696414a010 2024-04-25T09:55:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.221+0000 7f69691f4640 1 -- 172.21.15.7:0/2649919266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f696414bf00 con 0x7f696414a010 2024-04-25T09:55:30.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.221+0000 7f694b7fe640 1 -- 172.21.15.7:0/2649919266 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6954004030 con 0x7f696414a010 2024-04-25T09:55:30.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.221+0000 7f69691f4640 1 -- 172.21.15.7:0/2649919266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f696414c4c0 con 0x7f696414a010 2024-04-25T09:55:30.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.222+0000 7f69691f4640 1 -- 172.21.15.7:0/2649919266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6964068fd0 con 0x7f696414a010 2024-04-25T09:55:30.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.223+0000 7f694b7fe640 1 -- 172.21.15.7:0/2649919266 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6954012040 con 0x7f696414a010 2024-04-25T09:55:30.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.223+0000 7f694b7fe640 1 --2- 172.21.15.7:0/2649919266 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f695006b500 0x7f695006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:30.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.223+0000 7f694b7fe640 1 -- 172.21.15.7:0/2649919266 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f695408a470 con 0x7f696414a010 2024-04-25T09:55:30.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.223+0000 7f6962d9d640 1 --2- 172.21.15.7:0/2649919266 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f695006b500 0x7f695006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:30.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.224+0000 7f6962d9d640 1 --2- 172.21.15.7:0/2649919266 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f695006b500 0x7f695006d9c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6958001eb0 tx=0x7f6958009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:30.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.227+0000 7f694b7fe640 1 -- 172.21.15.7:0/2649919266 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6954019070 con 0x7f696414a010 2024-04-25T09:55:30.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.479+0000 7f69691f4640 1 -- 172.21.15.7:0/2649919266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f69640b59f0 con 0x7f696414a010 2024-04-25T09:55:30.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.481+0000 7f694b7fe640 1 -- 172.21.15.7:0/2649919266 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f695405de20 con 0x7f696414a010 2024-04-25T09:55:30.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.483+0000 7f69691f4640 1 -- 172.21.15.7:0/2649919266 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f695006b500 msgr2=0x7f695006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:30.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.483+0000 7f69691f4640 1 --2- 172.21.15.7:0/2649919266 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f695006b500 0x7f695006d9c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6958001eb0 tx=0x7f6958009040 comp rx=0 tx=0).stop 2024-04-25T09:55:30.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.483+0000 7f69691f4640 1 -- 172.21.15.7:0/2649919266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f696414a010 msgr2=0x7f6964149960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:30.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.483+0000 7f69691f4640 1 --2- 172.21.15.7:0/2649919266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f696414a010 0x7f6964149960 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f69540119d0 tx=0x7f6954011e90 comp rx=0 tx=0).stop 2024-04-25T09:55:30.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.483+0000 7f69691f4640 1 -- 172.21.15.7:0/2649919266 shutdown_connections 2024-04-25T09:55:30.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.483+0000 7f69691f4640 1 --2- 172.21.15.7:0/2649919266 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f695006b500 0x7f695006d9c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:30.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.483+0000 7f69691f4640 1 --2- 172.21.15.7:0/2649919266 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f696415d270 0x7f696414c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:30.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.483+0000 7f69691f4640 1 --2- 172.21.15.7:0/2649919266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f696414a010 0x7f6964149960 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:30.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.483+0000 7f69691f4640 1 --2- 172.21.15.7:0/2649919266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f694c004d40 0x7f696414ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:30.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.483+0000 7f69691f4640 1 -- 172.21.15.7:0/2649919266 >> 172.21.15.7:0/2649919266 conn(0x7f69640b5c30 msgr2=0x7f69640b0660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:30.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.483+0000 7f69691f4640 1 -- 172.21.15.7:0/2649919266 shutdown_connections 2024-04-25T09:55:30.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.484+0000 7f69691f4640 1 -- 172.21.15.7:0/2649919266 wait complete. 2024-04-25T09:55:30.496 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-25T09:55:30.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.596+0000 7fe6a31e7640 1 Processor -- start 2024-04-25T09:55:30.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.596+0000 7fe6a31e7640 1 -- start start 2024-04-25T09:55:30.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.596+0000 7fe6a31e7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe69c15da20 0x7fe69c09a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:30.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.596+0000 7fe6a31e7640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe69c06c330 0x7fe69c06c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:30.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.597+0000 7fe6a31e7640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69c0cfad0 con 0x7fe69c06bc70 2024-04-25T09:55:30.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.597+0000 7fe6a31e7640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe69c0d06e0 con 0x7fe69c15da20 2024-04-25T09:55:30.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.597+0000 7fe6a31e7640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c09a940 con 0x7fe69c06c330 2024-04-25T09:55:30.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.597+0000 7fe69bfff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe69c06bc70 0x7fe69c0d0b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40532/0 (socket says 172.21.15.7:40532) 2024-04-25T09:55:30.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.597+0000 7fe69bfff640 1 -- 172.21.15.7:0/777563055 learned_addr learned my addr 172.21.15.7:0/777563055 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:30.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.597+0000 7fe69b7fe640 1 -- 172.21.15.7:0/777563055 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1297352508 0 0) 0x7fe69c0cfad0 con 0x7fe69c06bc70 2024-04-25T09:55:30.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.597+0000 7fe69b7fe640 1 -- 172.21.15.7:0/777563055 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe684003520 con 0x7fe69c06bc70 2024-04-25T09:55:30.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.597+0000 7fe6a0f83640 1 --2- 172.21.15.7:0/777563055 >> v2:172.21.15.55:3300/0 conn(0x7fe69c15da20 0x7fe69c09a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:30.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.597+0000 7fe6a1784640 1 --2- 172.21.15.7:0/777563055 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe69c06c330 0x7fe69c06c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:30.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.597+0000 7fe69b7fe640 1 -- 172.21.15.7:0/777563055 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3901329623 0 0) 0x7fe684003520 con 0x7fe69c06bc70 2024-04-25T09:55:30.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.597+0000 7fe69b7fe640 1 -- 172.21.15.7:0/777563055 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe69c06c330 msgr2=0x7fe69c06c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:30.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.597+0000 7fe69b7fe640 1 --2- 172.21.15.7:0/777563055 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe69c06c330 0x7fe69c06c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:30.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.597+0000 7fe69b7fe640 1 -- 172.21.15.7:0/777563055 >> v2:172.21.15.55:3300/0 conn(0x7fe69c15da20 msgr2=0x7fe69c09a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:30.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.597+0000 7fe69b7fe640 1 --2- 172.21.15.7:0/777563055 >> v2:172.21.15.55:3300/0 conn(0x7fe69c15da20 0x7fe69c09a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:30.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.597+0000 7fe69b7fe640 1 -- 172.21.15.7:0/777563055 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69c0cfdb0 con 0x7fe69c06bc70 2024-04-25T09:55:30.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.597+0000 7fe69b7fe640 1 -- 172.21.15.7:0/777563055 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fe690001670 con 0x7fe69c06bc70 2024-04-25T09:55:30.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.597+0000 7fe69b7fe640 1 -- 172.21.15.7:0/777563055 >> v1:172.21.15.7:6789/0 conn(0x7fe69c06bc70 legacy=0x7fe69c0d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:30.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.597+0000 7fe69b7fe640 1 --2- 172.21.15.7:0/777563055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6840039b0 0x7fe684003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:30.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.597+0000 7fe69b7fe640 1 --2- 172.21.15.7:0/777563055 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe69c06c330 0x7fe684004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:30.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.597+0000 7fe69b7fe640 1 --2- 172.21.15.7:0/777563055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe684004d40 0x7fe6840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:30.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.597+0000 7fe69b7fe640 1 -- 172.21.15.7:0/777563055 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c0d06e0 con 0x7fe684004d40 2024-04-25T09:55:30.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.597+0000 7fe69b7fe640 1 -- 172.21.15.7:0/777563055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c09a940 con 0x7fe6840039b0 2024-04-25T09:55:30.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.597+0000 7fe69b7fe640 1 -- 172.21.15.7:0/777563055 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe68400b9c0 con 0x7fe69c06c330 2024-04-25T09:55:30.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.598+0000 7fe6a1784640 1 --2- 172.21.15.7:0/777563055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe684004d40 0x7fe6840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:30.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.598+0000 7fe6a0f83640 1 --2- 172.21.15.7:0/777563055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6840039b0 0x7fe684003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:30.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.598+0000 7fe69bfff640 1 --2- 172.21.15.7:0/777563055 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe69c06c330 0x7fe684004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:30.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.598+0000 7fe6a1784640 1 -- 172.21.15.7:0/777563055 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe69c06c330 msgr2=0x7fe684004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:30.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.598+0000 7fe6a1784640 1 --2- 172.21.15.7:0/777563055 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe69c06c330 0x7fe684004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:30.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.598+0000 7fe6a1784640 1 -- 172.21.15.7:0/777563055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6840039b0 msgr2=0x7fe684003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:30.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.598+0000 7fe6a1784640 1 --2- 172.21.15.7:0/777563055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6840039b0 0x7fe684003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:30.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.598+0000 7fe6a1784640 1 -- 172.21.15.7:0/777563055 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe684003520 con 0x7fe684004d40 2024-04-25T09:55:30.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.599+0000 7fe6a1784640 1 --2- 172.21.15.7:0/777563055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe684004d40 0x7fe6840051c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe694009af0 tx=0x7fe684005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52793fc2e2ae9290 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:30.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.599+0000 7fe69b7fe640 1 -- 172.21.15.7:0/777563055 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe694036070 con 0x7fe684004d40 2024-04-25T09:55:30.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.599+0000 7fe69b7fe640 1 -- 172.21.15.7:0/777563055 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe694031400 con 0x7fe684004d40 2024-04-25T09:55:30.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.599+0000 7fe69b7fe640 1 -- 172.21.15.7:0/777563055 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe694009690 con 0x7fe684004d40 2024-04-25T09:55:30.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.599+0000 7fe6a31e7640 1 -- 172.21.15.7:0/777563055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe684004d40 msgr2=0x7fe6840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:30.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.599+0000 7fe6a31e7640 1 --2- 172.21.15.7:0/777563055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe684004d40 0x7fe6840051c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe694009af0 tx=0x7fe684005830 comp rx=0 tx=0).stop 2024-04-25T09:55:30.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.599+0000 7fe6a1784640 1 -- 172.21.15.7:0/777563055 reap_dead start 2024-04-25T09:55:30.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.599+0000 7fe6a31e7640 1 -- 172.21.15.7:0/777563055 shutdown_connections 2024-04-25T09:55:30.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.599+0000 7fe6a31e7640 1 -- 172.21.15.7:0/777563055 >> 172.21.15.7:0/777563055 conn(0x7fe69c0d16f0 msgr2=0x7fe69c0d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:30.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.599+0000 7fe6a31e7640 1 -- 172.21.15.7:0/777563055 shutdown_connections 2024-04-25T09:55:30.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.599+0000 7fe6a31e7640 1 -- 172.21.15.7:0/777563055 wait complete. 2024-04-25T09:55:30.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.600+0000 7fe6a31e7640 1 Processor -- start 2024-04-25T09:55:30.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.600+0000 7fe6a31e7640 1 -- start start 2024-04-25T09:55:30.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.601+0000 7fe6a31e7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe684004d40 0x7fe69c157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:30.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.601+0000 7fe6a31e7640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe69c159a60 0x7fe69c09b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:30.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.601+0000 7fe6a31e7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe69c15ac40 0x7fe69c09bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:30.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.601+0000 7fe6a31e7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c0d1280 con 0x7fe684004d40 2024-04-25T09:55:30.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.601+0000 7fe6a31e7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c0d0370 con 0x7fe69c15ac40 2024-04-25T09:55:30.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.601+0000 7fe6a31e7640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c15de00 con 0x7fe69c159a60 2024-04-25T09:55:30.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.601+0000 7fe6a0f83640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe684004d40 0x7fe69c157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:30.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.601+0000 7fe6a0f83640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe684004d40 0x7fe69c157df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41954/0 (socket says 172.21.15.7:41954) 2024-04-25T09:55:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.601+0000 7fe6a0f83640 1 -- 172.21.15.7:0/261466519 learned_addr learned my addr 172.21.15.7:0/261466519 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.602+0000 7fe6a1784640 1 --2- 172.21.15.7:0/261466519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe69c15ac40 0x7fe69c09bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.602+0000 7fe69bfff640 1 --2- 172.21.15.7:0/261466519 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe69c159a60 0x7fe69c09b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.602+0000 7fe6a0f83640 1 -- 172.21.15.7:0/261466519 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe69c159a60 msgr2=0x7fe69c09b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.602+0000 7fe6a0f83640 1 --2- 172.21.15.7:0/261466519 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe69c159a60 0x7fe69c09b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.602+0000 7fe6a0f83640 1 -- 172.21.15.7:0/261466519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe69c15ac40 msgr2=0x7fe69c09bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.602+0000 7fe6a0f83640 1 --2- 172.21.15.7:0/261466519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe69c15ac40 0x7fe69c09bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.602+0000 7fe6a0f83640 1 -- 172.21.15.7:0/261466519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69c159f90 con 0x7fe684004d40 2024-04-25T09:55:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.602+0000 7fe6a1784640 1 --2- 172.21.15.7:0/261466519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe69c15ac40 0x7fe69c09bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.602+0000 7fe6a0f83640 1 --2- 172.21.15.7:0/261466519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe684004d40 0x7fe69c157df0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe68c011e60 tx=0x7fe68c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.602+0000 7fe6997fa640 1 -- 172.21.15.7:0/261466519 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c015630 con 0x7fe684004d40 2024-04-25T09:55:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.602+0000 7fe6997fa640 1 -- 172.21.15.7:0/261466519 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68c0157d0 con 0x7fe684004d40 2024-04-25T09:55:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.602+0000 7fe6a31e7640 1 -- 172.21.15.7:0/261466519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe69c15a270 con 0x7fe684004d40 2024-04-25T09:55:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.602+0000 7fe6997fa640 1 -- 172.21.15.7:0/261466519 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c015ba0 con 0x7fe684004d40 2024-04-25T09:55:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.602+0000 7fe6a31e7640 1 -- 172.21.15.7:0/261466519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe69c15b320 con 0x7fe684004d40 2024-04-25T09:55:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.603+0000 7fe6a31e7640 1 -- 172.21.15.7:0/261466519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe69c068fd0 con 0x7fe684004d40 2024-04-25T09:55:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.603+0000 7fe6997fa640 1 -- 172.21.15.7:0/261466519 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe68c01d400 con 0x7fe684004d40 2024-04-25T09:55:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.604+0000 7fe6997fa640 1 --2- 172.21.15.7:0/261466519 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe68806b500 0x7fe68806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.604+0000 7fe6997fa640 1 -- 172.21.15.7:0/261466519 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fe68c08b180 con 0x7fe684004d40 2024-04-25T09:55:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.604+0000 7fe69bfff640 1 --2- 172.21.15.7:0/261466519 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe68806b500 0x7fe68806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.604+0000 7fe69bfff640 1 --2- 172.21.15.7:0/261466519 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe68806b500 0x7fe68806d9c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe690007fd0 tx=0x7fe690009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:30.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.608+0000 7fe6997fa640 1 -- 172.21.15.7:0/261466519 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe68c019030 con 0x7fe684004d40 2024-04-25T09:55:30.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.863+0000 7fe6a31e7640 1 -- 172.21.15.7:0/261466519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fe69c0b4a90 con 0x7fe684004d40 2024-04-25T09:55:30.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.865+0000 7fe6997fa640 1 -- 172.21.15.7:0/261466519 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe68c010040 con 0x7fe684004d40 2024-04-25T09:55:30.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.867+0000 7fe6a31e7640 1 -- 172.21.15.7:0/261466519 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe68806b500 msgr2=0x7fe68806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:30.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.867+0000 7fe6a31e7640 1 --2- 172.21.15.7:0/261466519 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe68806b500 0x7fe68806d9c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe690007fd0 tx=0x7fe690009040 comp rx=0 tx=0).stop 2024-04-25T09:55:30.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.867+0000 7fe6a31e7640 1 -- 172.21.15.7:0/261466519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe684004d40 msgr2=0x7fe69c157df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:30.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.867+0000 7fe6a31e7640 1 --2- 172.21.15.7:0/261466519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe684004d40 0x7fe69c157df0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe68c011e60 tx=0x7fe68c00f580 comp rx=0 tx=0).stop 2024-04-25T09:55:30.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.867+0000 7fe6a31e7640 1 -- 172.21.15.7:0/261466519 shutdown_connections 2024-04-25T09:55:30.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.867+0000 7fe6a31e7640 1 --2- 172.21.15.7:0/261466519 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe68806b500 0x7fe68806d9c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:30.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.867+0000 7fe6a31e7640 1 --2- 172.21.15.7:0/261466519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe69c15ac40 0x7fe69c09bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:30.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.867+0000 7fe6a31e7640 1 --2- 172.21.15.7:0/261466519 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe69c159a60 0x7fe69c09b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:30.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.867+0000 7fe6a31e7640 1 --2- 172.21.15.7:0/261466519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe684004d40 0x7fe69c157df0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:30.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.867+0000 7fe6a31e7640 1 -- 172.21.15.7:0/261466519 >> 172.21.15.7:0/261466519 conn(0x7fe69c0d16f0 msgr2=0x7fe69c0d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:30.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.868+0000 7fe6a31e7640 1 -- 172.21.15.7:0/261466519 shutdown_connections 2024-04-25T09:55:30.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.868+0000 7fe6a31e7640 1 -- 172.21.15.7:0/261466519 wait complete. 2024-04-25T09:55:30.880 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-25T09:55:30.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.980+0000 7f7441e58640 1 Processor -- start 2024-04-25T09:55:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.980+0000 7f7441e58640 1 -- start start 2024-04-25T09:55:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.981+0000 7f7441e58640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f743c15db00 0x7f743c0d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.981+0000 7f7441e58640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f743c0d1e80 con 0x7f743c0b53b0 2024-04-25T09:55:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.981+0000 7f7441e58640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f743c162490 con 0x7f743c0ce2b0 2024-04-25T09:55:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.981+0000 7f7441e58640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f743c0b5930 con 0x7f743c15db00 2024-04-25T09:55:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.981+0000 7f743b7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f743c15db00 0x7f743c0d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.981+0000 7f743affd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f743c0b53b0 0x7f743c161670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40538/0 (socket says 172.21.15.7:40538) 2024-04-25T09:55:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.981+0000 7f743affd640 1 -- 172.21.15.7:0/2230103826 learned_addr learned my addr 172.21.15.7:0/2230103826 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.981+0000 7f743b7fe640 1 -- 172.21.15.7:0/2230103826 >> v1:172.21.15.55:6789/0 conn(0x7f743c0ce2b0 legacy=0x7f743c161d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.981+0000 7f743b7fe640 1 -- 172.21.15.7:0/2230103826 >> v1:172.21.15.7:6789/0 conn(0x7f743c0b53b0 legacy=0x7f743c161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.981+0000 7f743b7fe640 1 -- 172.21.15.7:0/2230103826 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743c0b5c10 con 0x7f743c15db00 2024-04-25T09:55:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.981+0000 7f743a7fc640 1 -- 172.21.15.7:0/2230103826 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3683478583 0 0) 0x7f743c0d1e80 con 0x7f743c0b53b0 2024-04-25T09:55:30.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.982+0000 7f743b7fe640 1 --2- 172.21.15.7:0/2230103826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f743c15db00 0x7f743c0d0340 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f742c0097a0 tx=0x7f742c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3622161f1753f76 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.982+0000 7f743a7fc640 1 -- 172.21.15.7:0/2230103826 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c037070 con 0x7f743c15db00 2024-04-25T09:55:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.982+0000 7f743a7fc640 1 -- 172.21.15.7:0/2230103826 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742c032440 con 0x7f743c15db00 2024-04-25T09:55:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.982+0000 7f743a7fc640 1 -- 172.21.15.7:0/2230103826 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c032810 con 0x7f743c15db00 2024-04-25T09:55:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.982+0000 7f7441e58640 1 -- 172.21.15.7:0/2230103826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f743c15db00 msgr2=0x7f743c0d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.983+0000 7f7441e58640 1 --2- 172.21.15.7:0/2230103826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f743c15db00 0x7f743c0d0340 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f742c0097a0 tx=0x7f742c02a1e0 comp rx=0 tx=0).stop 2024-04-25T09:55:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.983+0000 7f7441e58640 1 -- 172.21.15.7:0/2230103826 shutdown_connections 2024-04-25T09:55:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.983+0000 7f7441e58640 1 --2- 172.21.15.7:0/2230103826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f743c15db00 0x7f743c0d0340 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.983+0000 7f7441e58640 1 -- 172.21.15.7:0/2230103826 >> 172.21.15.7:0/2230103826 conn(0x7f743c072290 msgr2=0x7f743c0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.983+0000 7f7441e58640 1 -- 172.21.15.7:0/2230103826 shutdown_connections 2024-04-25T09:55:30.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.983+0000 7f7441e58640 1 -- 172.21.15.7:0/2230103826 wait complete. 2024-04-25T09:55:30.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.984+0000 7f7441e58640 1 Processor -- start 2024-04-25T09:55:30.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.984+0000 7f7441e58640 1 -- start start 2024-04-25T09:55:30.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.985+0000 7f7441e58640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f743c0b53b0 0x7f743c15cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:30.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.985+0000 7f7441e58640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f743c0ce2b0 0x7f743c152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:30.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.985+0000 7f7441e58640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f743c15db00 0x7f743c160320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:30.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.985+0000 7f7441e58640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c0b61d0 con 0x7f743c0b53b0 2024-04-25T09:55:30.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.985+0000 7f7441e58640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c15dee0 con 0x7f743c15db00 2024-04-25T09:55:30.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.985+0000 7f7441e58640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743c0d3660 con 0x7f743c0ce2b0 2024-04-25T09:55:30.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.985+0000 7f743b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f743c0b53b0 0x7f743c15cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:30.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.985+0000 7f743b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f743c0b53b0 0x7f743c15cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41968/0 (socket says 172.21.15.7:41968) 2024-04-25T09:55:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.985+0000 7f743b7fe640 1 -- 172.21.15.7:0/847465358 learned_addr learned my addr 172.21.15.7:0/847465358 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.985+0000 7f743b7fe640 1 -- 172.21.15.7:0/847465358 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f743c0ce2b0 msgr2=0x7f743c152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.985+0000 7f743b7fe640 1 --2- 172.21.15.7:0/847465358 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f743c0ce2b0 0x7f743c152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.985+0000 7f743b7fe640 1 -- 172.21.15.7:0/847465358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f743c15db00 msgr2=0x7f743c160320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.985+0000 7f743b7fe640 1 --2- 172.21.15.7:0/847465358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f743c15db00 0x7f743c160320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.985+0000 7f743b7fe640 1 -- 172.21.15.7:0/847465358 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743c153400 con 0x7f743c0b53b0 2024-04-25T09:55:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.985+0000 7f743b7fe640 1 --2- 172.21.15.7:0/847465358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f743c0b53b0 0x7f743c15cd70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f742c000c00 tx=0x7f742c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.985+0000 7f7423fff640 1 -- 172.21.15.7:0/847465358 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c041070 con 0x7f743c0b53b0 2024-04-25T09:55:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.985+0000 7f7423fff640 1 -- 172.21.15.7:0/847465358 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742c03c930 con 0x7f743c0b53b0 2024-04-25T09:55:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.985+0000 7f7441e58640 1 -- 172.21.15.7:0/847465358 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f743c15efe0 con 0x7f743c0b53b0 2024-04-25T09:55:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.986+0000 7f7423fff640 1 -- 172.21.15.7:0/847465358 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c037040 con 0x7f743c0b53b0 2024-04-25T09:55:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.986+0000 7f7441e58640 1 -- 172.21.15.7:0/847465358 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743c15f5a0 con 0x7f743c0b53b0 2024-04-25T09:55:30.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.987+0000 7f7441e58640 1 -- 172.21.15.7:0/847465358 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f743c068fd0 con 0x7f743c0b53b0 2024-04-25T09:55:30.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.987+0000 7f7423fff640 1 -- 172.21.15.7:0/847465358 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f742c044070 con 0x7f743c0b53b0 2024-04-25T09:55:30.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.987+0000 7f7423fff640 1 --2- 172.21.15.7:0/847465358 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f742806b500 0x7f742806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:30.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.988+0000 7f7423fff640 1 -- 172.21.15.7:0/847465358 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f742c0ab050 con 0x7f743c0b53b0 2024-04-25T09:55:30.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.988+0000 7f743affd640 1 --2- 172.21.15.7:0/847465358 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f742806b500 0x7f742806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:30.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.988+0000 7f743affd640 1 --2- 172.21.15.7:0/847465358 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f742806b500 0x7f742806d9c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7430007fd0 tx=0x7f7430007960 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:30.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:30.992+0000 7f7423fff640 1 -- 172.21.15.7:0/847465358 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f742c07a1b0 con 0x7f743c0b53b0 2024-04-25T09:55:31.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.240+0000 7f7441e58640 1 -- 172.21.15.7:0/847465358 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f743c0d16b0 con 0x7f743c0b53b0 2024-04-25T09:55:31.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.242+0000 7f7423fff640 1 -- 172.21.15.7:0/847465358 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f742c079ab0 con 0x7f743c0b53b0 2024-04-25T09:55:31.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.244+0000 7f7441e58640 1 -- 172.21.15.7:0/847465358 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f742806b500 msgr2=0x7f742806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:31.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.244+0000 7f7441e58640 1 --2- 172.21.15.7:0/847465358 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f742806b500 0x7f742806d9c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7430007fd0 tx=0x7f7430007960 comp rx=0 tx=0).stop 2024-04-25T09:55:31.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.244+0000 7f7441e58640 1 -- 172.21.15.7:0/847465358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f743c0b53b0 msgr2=0x7f743c15cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:31.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.244+0000 7f7441e58640 1 --2- 172.21.15.7:0/847465358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f743c0b53b0 0x7f743c15cd70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f742c000c00 tx=0x7f742c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:55:31.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.244+0000 7f7441e58640 1 -- 172.21.15.7:0/847465358 shutdown_connections 2024-04-25T09:55:31.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.244+0000 7f7441e58640 1 --2- 172.21.15.7:0/847465358 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f742806b500 0x7f742806d9c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:31.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.244+0000 7f7441e58640 1 --2- 172.21.15.7:0/847465358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f743c15db00 0x7f743c160320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:31.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.244+0000 7f7441e58640 1 --2- 172.21.15.7:0/847465358 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f743c0ce2b0 0x7f743c152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:31.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.244+0000 7f7441e58640 1 --2- 172.21.15.7:0/847465358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f743c0b53b0 0x7f743c15cd70 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:31.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.244+0000 7f7441e58640 1 -- 172.21.15.7:0/847465358 >> 172.21.15.7:0/847465358 conn(0x7f743c072290 msgr2=0x7f743c072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:31.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.244+0000 7f7441e58640 1 -- 172.21.15.7:0/847465358 shutdown_connections 2024-04-25T09:55:31.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.244+0000 7f7441e58640 1 -- 172.21.15.7:0/847465358 wait complete. 2024-04-25T09:55:31.258 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-25T09:55:31.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.356+0000 7f2e24f70640 1 Processor -- start 2024-04-25T09:55:31.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.356+0000 7f2e24f70640 1 -- start start 2024-04-25T09:55:31.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.357+0000 7f2e24f70640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2e2015db00 0x7f2e200d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:31.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.357+0000 7f2e24f70640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e200b53b0 0x7f2e200d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:31.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.357+0000 7f2e24f70640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e200d1e80 con 0x7f2e200ce2b0 2024-04-25T09:55:31.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.357+0000 7f2e24f70640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e200b5930 con 0x7f2e2015db00 2024-04-25T09:55:31.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.357+0000 7f2e24f70640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e200b5c10 con 0x7f2e200b53b0 2024-04-25T09:55:31.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.357+0000 7f2e1e59c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2e2015db00 0x7f2e200d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:31.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.357+0000 7f2e1e59c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2e2015db00 0x7f2e200d0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41984/0 (socket says 172.21.15.7:41984) 2024-04-25T09:55:31.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.357+0000 7f2e1e59c640 1 -- 172.21.15.7:0/626051630 learned_addr learned my addr 172.21.15.7:0/626051630 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:31.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.357+0000 7f2e1dd9b640 1 --2- 172.21.15.7:0/626051630 >> v2:172.21.15.55:3300/0 conn(0x7f2e200b53b0 0x7f2e200d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:31.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.358+0000 7f2e1e59c640 1 -- 172.21.15.7:0/626051630 >> v2:172.21.15.55:3300/0 conn(0x7f2e200b53b0 msgr2=0x7f2e200d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:31.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.358+0000 7f2e1e59c640 1 --2- 172.21.15.7:0/626051630 >> v2:172.21.15.55:3300/0 conn(0x7f2e200b53b0 0x7f2e200d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:31.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.358+0000 7f2e1e59c640 1 -- 172.21.15.7:0/626051630 >> v1:172.21.15.55:6789/0 conn(0x7f2e200ce2b0 legacy=0x7f2e20161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:31.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.358+0000 7f2e1e59c640 1 -- 172.21.15.7:0/626051630 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e200b5ef0 con 0x7f2e2015db00 2024-04-25T09:55:31.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.358+0000 7f2e1e59c640 1 --2- 172.21.15.7:0/626051630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e2015db00 0x7f2e200d0340 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2e200d4a00 tx=0x7f2e1002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118c8f5b7ffd969a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:31.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.358+0000 7f2e1d59a640 1 -- 172.21.15.7:0/626051630 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e10037070 con 0x7f2e2015db00 2024-04-25T09:55:31.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.358+0000 7f2e1d59a640 1 -- 172.21.15.7:0/626051630 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e10032440 con 0x7f2e2015db00 2024-04-25T09:55:31.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.358+0000 7f2e1d59a640 1 -- 172.21.15.7:0/626051630 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e10032810 con 0x7f2e2015db00 2024-04-25T09:55:31.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.359+0000 7f2e24f70640 1 -- 172.21.15.7:0/626051630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e2015db00 msgr2=0x7f2e200d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:31.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.359+0000 7f2e24f70640 1 --2- 172.21.15.7:0/626051630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e2015db00 0x7f2e200d0340 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2e200d4a00 tx=0x7f2e1002a270 comp rx=0 tx=0).stop 2024-04-25T09:55:31.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.359+0000 7f2e24f70640 1 -- 172.21.15.7:0/626051630 shutdown_connections 2024-04-25T09:55:31.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.359+0000 7f2e24f70640 1 --2- 172.21.15.7:0/626051630 >> v2:172.21.15.55:3300/0 conn(0x7f2e200b53b0 0x7f2e200d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:31.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.359+0000 7f2e24f70640 1 --2- 172.21.15.7:0/626051630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e2015db00 0x7f2e200d0340 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:31.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.359+0000 7f2e24f70640 1 -- 172.21.15.7:0/626051630 >> 172.21.15.7:0/626051630 conn(0x7f2e20072290 msgr2=0x7f2e200726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:31.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.359+0000 7f2e24f70640 1 -- 172.21.15.7:0/626051630 shutdown_connections 2024-04-25T09:55:31.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.359+0000 7f2e24f70640 1 -- 172.21.15.7:0/626051630 wait complete. 2024-04-25T09:55:31.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.360+0000 7f2e24f70640 1 Processor -- start 2024-04-25T09:55:31.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.360+0000 7f2e24f70640 1 -- start start 2024-04-25T09:55:31.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.361+0000 7f2e24f70640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e200b53b0 0x7f2e201f33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:31.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.361+0000 7f2e24f70640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e200ce2b0 0x7f2e201514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:31.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.361+0000 7f2e24f70640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e2015db00 0x7f2e20142700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:31.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.361+0000 7f2e24f70640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e200d3660 con 0x7f2e200b53b0 2024-04-25T09:55:31.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.361+0000 7f2e24f70640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e200b61d0 con 0x7f2e200ce2b0 2024-04-25T09:55:31.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.361+0000 7f2e24f70640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e200b6c10 con 0x7f2e2015db00 2024-04-25T09:55:31.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.361+0000 7f2e1e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e200b53b0 0x7f2e201f33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:31.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.361+0000 7f2e1e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e200b53b0 0x7f2e201f33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41998/0 (socket says 172.21.15.7:41998) 2024-04-25T09:55:31.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.361+0000 7f2e1e59c640 1 -- 172.21.15.7:0/2283298668 learned_addr learned my addr 172.21.15.7:0/2283298668 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:31.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.361+0000 7f2e1e59c640 1 -- 172.21.15.7:0/2283298668 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e2015db00 msgr2=0x7f2e20142700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:31.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.361+0000 7f2e1e59c640 1 --2- 172.21.15.7:0/2283298668 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e2015db00 0x7f2e20142700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:31.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.361+0000 7f2e1e59c640 1 -- 172.21.15.7:0/2283298668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e200ce2b0 msgr2=0x7f2e201514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:31.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.361+0000 7f2e1e59c640 1 --2- 172.21.15.7:0/2283298668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e200ce2b0 0x7f2e201514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:31.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.362+0000 7f2e1e59c640 1 -- 172.21.15.7:0/2283298668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e200cbfc0 con 0x7f2e200b53b0 2024-04-25T09:55:31.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.362+0000 7f2e1e59c640 1 --2- 172.21.15.7:0/2283298668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e200b53b0 0x7f2e201f33b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2e1002a2b0 tx=0x7f2e100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:31.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.362+0000 7f2e0effd640 1 -- 172.21.15.7:0/2283298668 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e10037040 con 0x7f2e200b53b0 2024-04-25T09:55:31.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.362+0000 7f2e0effd640 1 -- 172.21.15.7:0/2283298668 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e10042070 con 0x7f2e200b53b0 2024-04-25T09:55:31.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.362+0000 7f2e24f70640 1 -- 172.21.15.7:0/2283298668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e200cc2a0 con 0x7f2e200b53b0 2024-04-25T09:55:31.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.362+0000 7f2e0effd640 1 -- 172.21.15.7:0/2283298668 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e10030880 con 0x7f2e200b53b0 2024-04-25T09:55:31.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.362+0000 7f2e24f70640 1 -- 172.21.15.7:0/2283298668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e200cc860 con 0x7f2e200b53b0 2024-04-25T09:55:31.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.363+0000 7f2e24f70640 1 -- 172.21.15.7:0/2283298668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e20068fd0 con 0x7f2e200b53b0 2024-04-25T09:55:31.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.363+0000 7f2e0effd640 1 -- 172.21.15.7:0/2283298668 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2e10030a20 con 0x7f2e200b53b0 2024-04-25T09:55:31.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.364+0000 7f2e0effd640 1 --2- 172.21.15.7:0/2283298668 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2e0006b4d0 0x7f2e0006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:31.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.364+0000 7f2e0effd640 1 -- 172.21.15.7:0/2283298668 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f2e100aaa50 con 0x7f2e200b53b0 2024-04-25T09:55:31.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.364+0000 7f2e1dd9b640 1 --2- 172.21.15.7:0/2283298668 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2e0006b4d0 0x7f2e0006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:31.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.364+0000 7f2e1dd9b640 1 --2- 172.21.15.7:0/2283298668 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2e0006b4d0 0x7f2e0006d990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2e2006be50 tx=0x7f2e140095a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:31.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.368+0000 7f2e0effd640 1 -- 172.21.15.7:0/2283298668 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2e10079970 con 0x7f2e200b53b0 2024-04-25T09:55:31.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.617+0000 7f2e24f70640 1 -- 172.21.15.7:0/2283298668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f2e200d16b0 con 0x7f2e200b53b0 2024-04-25T09:55:31.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.619+0000 7f2e0effd640 1 -- 172.21.15.7:0/2283298668 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2e10079270 con 0x7f2e200b53b0 2024-04-25T09:55:31.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.621+0000 7f2e24f70640 1 -- 172.21.15.7:0/2283298668 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2e0006b4d0 msgr2=0x7f2e0006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:31.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.621+0000 7f2e24f70640 1 --2- 172.21.15.7:0/2283298668 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2e0006b4d0 0x7f2e0006d990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2e2006be50 tx=0x7f2e140095a0 comp rx=0 tx=0).stop 2024-04-25T09:55:31.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.621+0000 7f2e24f70640 1 -- 172.21.15.7:0/2283298668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e200b53b0 msgr2=0x7f2e201f33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:31.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.621+0000 7f2e24f70640 1 --2- 172.21.15.7:0/2283298668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e200b53b0 0x7f2e201f33b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2e1002a2b0 tx=0x7f2e100046c0 comp rx=0 tx=0).stop 2024-04-25T09:55:31.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.621+0000 7f2e24f70640 1 -- 172.21.15.7:0/2283298668 shutdown_connections 2024-04-25T09:55:31.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.621+0000 7f2e24f70640 1 --2- 172.21.15.7:0/2283298668 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2e0006b4d0 0x7f2e0006d990 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:31.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.621+0000 7f2e24f70640 1 --2- 172.21.15.7:0/2283298668 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e2015db00 0x7f2e20142700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:31.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.621+0000 7f2e24f70640 1 --2- 172.21.15.7:0/2283298668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e200ce2b0 0x7f2e201514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:31.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.621+0000 7f2e24f70640 1 --2- 172.21.15.7:0/2283298668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e200b53b0 0x7f2e201f33b0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:31.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.621+0000 7f2e24f70640 1 -- 172.21.15.7:0/2283298668 >> 172.21.15.7:0/2283298668 conn(0x7f2e20072290 msgr2=0x7f2e200c7540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:31.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.621+0000 7f2e24f70640 1 -- 172.21.15.7:0/2283298668 shutdown_connections 2024-04-25T09:55:31.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.621+0000 7f2e24f70640 1 -- 172.21.15.7:0/2283298668 wait complete. 2024-04-25T09:55:31.635 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-25T09:55:31.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.734+0000 7f4ed54fc640 1 Processor -- start 2024-04-25T09:55:31.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.734+0000 7f4ed54fc640 1 -- start start 2024-04-25T09:55:31.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.735+0000 7f4ed54fc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4ed015db00 0x7f4ed00d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:31.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.735+0000 7f4ed54fc640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed00d1e80 con 0x7f4ed00b53b0 2024-04-25T09:55:31.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.735+0000 7f4ed54fc640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed0162490 con 0x7f4ed00ce2b0 2024-04-25T09:55:31.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.735+0000 7f4ed54fc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed00b5930 con 0x7f4ed015db00 2024-04-25T09:55:31.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.735+0000 7f4ece7fc640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f4ed00b53b0 0x7f4ed0161670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40554/0 (socket says 172.21.15.7:40554) 2024-04-25T09:55:31.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.735+0000 7f4ece7fc640 1 -- 172.21.15.7:0/394858862 learned_addr learned my addr 172.21.15.7:0/394858862 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:31.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.735+0000 7f4eceffd640 1 --2- 172.21.15.7:0/394858862 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4ed015db00 0x7f4ed00d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:31.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.735+0000 7f4ecdffb640 1 -- 172.21.15.7:0/394858862 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072460181 0 0) 0x7f4ed00d1e80 con 0x7f4ed00b53b0 2024-04-25T09:55:31.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.735+0000 7f4ecdffb640 1 -- 172.21.15.7:0/394858862 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4eb8003520 con 0x7f4ed00b53b0 2024-04-25T09:55:31.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.735+0000 7f4ecdffb640 1 -- 172.21.15.7:0/394858862 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2848808218 0 0) 0x7f4ed0162490 con 0x7f4ed00ce2b0 2024-04-25T09:55:31.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.735+0000 7f4ecdffb640 1 -- 172.21.15.7:0/394858862 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ed00d1e80 con 0x7f4ed00ce2b0 2024-04-25T09:55:31.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.735+0000 7f4ecdffb640 1 -- 172.21.15.7:0/394858862 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4056812731 0 0) 0x7f4eb8003520 con 0x7f4ed00b53b0 2024-04-25T09:55:31.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.735+0000 7f4ecdffb640 1 -- 172.21.15.7:0/394858862 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4ed015db00 msgr2=0x7f4ed00d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:31.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.735+0000 7f4ecdffb640 1 --2- 172.21.15.7:0/394858862 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4ed015db00 0x7f4ed00d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:31.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.735+0000 7f4ecdffb640 1 -- 172.21.15.7:0/394858862 >> v1:172.21.15.55:6789/0 conn(0x7f4ed00ce2b0 legacy=0x7f4ed0161d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:31.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.735+0000 7f4ecdffb640 1 -- 172.21.15.7:0/394858862 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed00b5c10 con 0x7f4ed00b53b0 2024-04-25T09:55:31.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.735+0000 7f4ecdffb640 1 -- 172.21.15.7:0/394858862 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f4ec4001670 con 0x7f4ed00b53b0 2024-04-25T09:55:31.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.735+0000 7f4ecdffb640 1 -- 172.21.15.7:0/394858862 >> v1:172.21.15.7:6789/0 conn(0x7f4ed00b53b0 legacy=0x7f4ed0161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:31.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.736+0000 7f4ecdffb640 1 --2- 172.21.15.7:0/394858862 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4ed015db00 0x7f4eb8003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:31.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.736+0000 7f4ecdffb640 1 --2- 172.21.15.7:0/394858862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4eb80040d0 0x7f4eb8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:31.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.736+0000 7f4ecdffb640 1 --2- 172.21.15.7:0/394858862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eb8004d40 0x7f4eb80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:31.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.736+0000 7f4ecdffb640 1 -- 172.21.15.7:0/394858862 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed00b5930 con 0x7f4eb8004d40 2024-04-25T09:55:31.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.736+0000 7f4ecdffb640 1 -- 172.21.15.7:0/394858862 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb800baa0 con 0x7f4eb80040d0 2024-04-25T09:55:31.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.736+0000 7f4ecdffb640 1 -- 172.21.15.7:0/394858862 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb800bca0 con 0x7f4ed015db00 2024-04-25T09:55:31.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.736+0000 7f4eceffd640 1 --2- 172.21.15.7:0/394858862 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4ed015db00 0x7f4eb8003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:31.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.736+0000 7f4ecf7fe640 1 --2- 172.21.15.7:0/394858862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eb8004d40 0x7f4eb80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:31.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.736+0000 7f4ece7fc640 1 --2- 172.21.15.7:0/394858862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4eb80040d0 0x7f4eb8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:31.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.736+0000 7f4ecf7fe640 1 -- 172.21.15.7:0/394858862 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4ed015db00 msgr2=0x7f4eb8003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:31.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.736+0000 7f4ecf7fe640 1 --2- 172.21.15.7:0/394858862 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4ed015db00 0x7f4eb8003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:31.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.736+0000 7f4ecf7fe640 1 -- 172.21.15.7:0/394858862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4eb80040d0 msgr2=0x7f4eb8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:31.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.736+0000 7f4ecf7fe640 1 --2- 172.21.15.7:0/394858862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4eb80040d0 0x7f4eb8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:31.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.736+0000 7f4ecf7fe640 1 -- 172.21.15.7:0/394858862 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb8003520 con 0x7f4eb8004d40 2024-04-25T09:55:31.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.736+0000 7f4eceffd640 1 --2- 172.21.15.7:0/394858862 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4ed015db00 0x7f4eb8003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:55:31.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.737+0000 7f4ecf7fe640 1 --2- 172.21.15.7:0/394858862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eb8004d40 0x7f4eb80051c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8001fd0 tx=0x7f4eb8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=208538bc128b3f00 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:31.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.737+0000 7f4ecdffb640 1 -- 172.21.15.7:0/394858862 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec8001bf0 con 0x7f4eb8004d40 2024-04-25T09:55:31.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.737+0000 7f4ecdffb640 1 -- 172.21.15.7:0/394858862 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec8003b70 con 0x7f4eb8004d40 2024-04-25T09:55:31.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.737+0000 7f4ecdffb640 1 -- 172.21.15.7:0/394858862 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec80050d0 con 0x7f4eb8004d40 2024-04-25T09:55:31.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.737+0000 7f4ed54fc640 1 -- 172.21.15.7:0/394858862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eb8004d40 msgr2=0x7f4eb80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:31.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.737+0000 7f4ed54fc640 1 --2- 172.21.15.7:0/394858862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eb8004d40 0x7f4eb80051c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8001fd0 tx=0x7f4eb8005830 comp rx=0 tx=0).stop 2024-04-25T09:55:31.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.738+0000 7f4ecf7fe640 1 -- 172.21.15.7:0/394858862 reap_dead start 2024-04-25T09:55:31.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.738+0000 7f4ed54fc640 1 -- 172.21.15.7:0/394858862 shutdown_connections 2024-04-25T09:55:31.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.738+0000 7f4ed54fc640 1 -- 172.21.15.7:0/394858862 >> 172.21.15.7:0/394858862 conn(0x7f4ed0072290 msgr2=0x7f4ed00726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:31.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.738+0000 7f4ed54fc640 1 -- 172.21.15.7:0/394858862 shutdown_connections 2024-04-25T09:55:31.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.738+0000 7f4ed54fc640 1 -- 172.21.15.7:0/394858862 wait complete. 2024-04-25T09:55:31.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.739+0000 7f4ed54fc640 1 Processor -- start 2024-04-25T09:55:31.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.739+0000 7f4ed54fc640 1 -- start start 2024-04-25T09:55:31.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.740+0000 7f4ed54fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4eb8004d40 0x7f4ed01545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:31.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.740+0000 7f4ed54fc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4ed015ed10 0x7f4ed0152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:31.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.740+0000 7f4ed54fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ed01f3760 0x7f4ed01f3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:31.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.740+0000 7f4ed54fc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed00b61d0 con 0x7f4ed01f3760 2024-04-25T09:55:31.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.740+0000 7f4ed54fc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed015dee0 con 0x7f4eb8004d40 2024-04-25T09:55:31.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.740+0000 7f4ed54fc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed00d3660 con 0x7f4ed015ed10 2024-04-25T09:55:31.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.740+0000 7f4ecf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ed01f3760 0x7f4ed01f3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:31.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.740+0000 7f4ecf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ed01f3760 0x7f4ed01f3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42010/0 (socket says 172.21.15.7:42010) 2024-04-25T09:55:31.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.740+0000 7f4ecf7fe640 1 -- 172.21.15.7:0/4034798664 learned_addr learned my addr 172.21.15.7:0/4034798664 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:31.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.740+0000 7f4eceffd640 1 --2- 172.21.15.7:0/4034798664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4eb8004d40 0x7f4ed01545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:31.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.740+0000 7f4ece7fc640 1 --2- 172.21.15.7:0/4034798664 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4ed015ed10 0x7f4ed0152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:31.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.740+0000 7f4ecf7fe640 1 -- 172.21.15.7:0/4034798664 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4ed015ed10 msgr2=0x7f4ed0152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:31.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.740+0000 7f4ecf7fe640 1 --2- 172.21.15.7:0/4034798664 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4ed015ed10 0x7f4ed0152dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:31.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.740+0000 7f4ecf7fe640 1 -- 172.21.15.7:0/4034798664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4eb8004d40 msgr2=0x7f4ed01545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:31.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.740+0000 7f4ecf7fe640 1 --2- 172.21.15.7:0/4034798664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4eb8004d40 0x7f4ed01545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:31.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.740+0000 7f4ecf7fe640 1 -- 172.21.15.7:0/4034798664 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed015f500 con 0x7f4ed01f3760 2024-04-25T09:55:31.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.740+0000 7f4ece7fc640 1 --2- 172.21.15.7:0/4034798664 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4ed015ed10 0x7f4ed0152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:31.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.740+0000 7f4eceffd640 1 --2- 172.21.15.7:0/4034798664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4eb8004d40 0x7f4ed01545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:31.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.740+0000 7f4ecf7fe640 1 --2- 172.21.15.7:0/4034798664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ed01f3760 0x7f4ed01f3be0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8005040 tx=0x7f4ec8001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:31.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.740+0000 7f4eb77fe640 1 -- 172.21.15.7:0/4034798664 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec0009690 con 0x7f4ed01f3760 2024-04-25T09:55:31.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.740+0000 7f4eb77fe640 1 -- 172.21.15.7:0/4034798664 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec8043070 con 0x7f4ed01f3760 2024-04-25T09:55:31.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.740+0000 7f4ed54fc640 1 -- 172.21.15.7:0/4034798664 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed015f7e0 con 0x7f4ed01f3760 2024-04-25T09:55:31.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.741+0000 7f4eb77fe640 1 -- 172.21.15.7:0/4034798664 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec8001bf0 con 0x7f4ed01f3760 2024-04-25T09:55:31.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.741+0000 7f4ed54fc640 1 -- 172.21.15.7:0/4034798664 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed015fda0 con 0x7f4ed01f3760 2024-04-25T09:55:31.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.741+0000 7f4ed54fc640 1 -- 172.21.15.7:0/4034798664 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed0068fd0 con 0x7f4ed01f3760 2024-04-25T09:55:31.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.742+0000 7f4eb77fe640 1 -- 172.21.15.7:0/4034798664 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4ec803a040 con 0x7f4ed01f3760 2024-04-25T09:55:31.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.742+0000 7f4eb77fe640 1 --2- 172.21.15.7:0/4034798664 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4ebc06b500 0x7f4ebc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:31.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.743+0000 7f4eceffd640 1 --2- 172.21.15.7:0/4034798664 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4ebc06b500 0x7f4ebc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:31.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.743+0000 7f4eb77fe640 1 -- 172.21.15.7:0/4034798664 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f4ec80aa3b0 con 0x7f4ed01f3760 2024-04-25T09:55:31.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.743+0000 7f4eceffd640 1 --2- 172.21.15.7:0/4034798664 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4ebc06b500 0x7f4ebc06d9c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0009d60 tx=0x7f4ec0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:31.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.747+0000 7f4eb77fe640 1 -- 172.21.15.7:0/4034798664 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4ec8079480 con 0x7f4ed01f3760 2024-04-25T09:55:31.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.994+0000 7f4ed54fc640 1 -- 172.21.15.7:0/4034798664 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f4ed00b7a80 con 0x7f4ed01f3760 2024-04-25T09:55:31.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.997+0000 7f4eb77fe640 1 -- 172.21.15.7:0/4034798664 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4ec8078d80 con 0x7f4ed01f3760 2024-04-25T09:55:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.999+0000 7f4ed54fc640 1 -- 172.21.15.7:0/4034798664 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4ebc06b500 msgr2=0x7f4ebc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.999+0000 7f4ed54fc640 1 --2- 172.21.15.7:0/4034798664 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4ebc06b500 0x7f4ebc06d9c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0009d60 tx=0x7f4ec0008040 comp rx=0 tx=0).stop 2024-04-25T09:55:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.999+0000 7f4ed54fc640 1 -- 172.21.15.7:0/4034798664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ed01f3760 msgr2=0x7f4ed01f3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.999+0000 7f4ed54fc640 1 --2- 172.21.15.7:0/4034798664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ed01f3760 0x7f4ed01f3be0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8005040 tx=0x7f4ec8001650 comp rx=0 tx=0).stop 2024-04-25T09:55:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.999+0000 7f4ed54fc640 1 -- 172.21.15.7:0/4034798664 shutdown_connections 2024-04-25T09:55:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.999+0000 7f4ed54fc640 1 --2- 172.21.15.7:0/4034798664 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4ebc06b500 0x7f4ebc06d9c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.999+0000 7f4ed54fc640 1 --2- 172.21.15.7:0/4034798664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ed01f3760 0x7f4ed01f3be0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.999+0000 7f4ed54fc640 1 --2- 172.21.15.7:0/4034798664 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4ed015ed10 0x7f4ed0152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.999+0000 7f4ed54fc640 1 --2- 172.21.15.7:0/4034798664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4eb8004d40 0x7f4ed01545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.999+0000 7f4ed54fc640 1 -- 172.21.15.7:0/4034798664 >> 172.21.15.7:0/4034798664 conn(0x7f4ed0072290 msgr2=0x7f4ed00b6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.999+0000 7f4ed54fc640 1 -- 172.21.15.7:0/4034798664 shutdown_connections 2024-04-25T09:55:32.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:31.999+0000 7f4ed54fc640 1 -- 172.21.15.7:0/4034798664 wait complete. 2024-04-25T09:55:32.012 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-25T09:55:32.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.111+0000 7febef21f640 1 Processor -- start 2024-04-25T09:55:32.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.111+0000 7febef21f640 1 -- start start 2024-04-25T09:55:32.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.112+0000 7febef21f640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7febe80ce710 0x7febe8144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:32.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.112+0000 7febef21f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7febe80cdc80 0x7febe815bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:32.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.112+0000 7febef21f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe8144870 con 0x7febe80ceaf0 2024-04-25T09:55:32.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.112+0000 7febef21f640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe80c57a0 con 0x7febe80ce710 2024-04-25T09:55:32.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.112+0000 7febef21f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe8145390 con 0x7febe80cdc80 2024-04-25T09:55:32.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.112+0000 7febecfbb640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7febe80ce710 0x7febe8144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:32.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.112+0000 7febecfbb640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7febe80ce710 0x7febe8144ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42016/0 (socket says 172.21.15.7:42016) 2024-04-25T09:55:32.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.112+0000 7febecfbb640 1 -- 172.21.15.7:0/2247916933 learned_addr learned my addr 172.21.15.7:0/2247916933 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:32.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.112+0000 7febecfbb640 1 -- 172.21.15.7:0/2247916933 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7febe80cdc80 msgr2=0x7febe815bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:32.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.112+0000 7febed7bc640 1 --2- 172.21.15.7:0/2247916933 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7febe80cdc80 0x7febe815bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:32.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.112+0000 7febecfbb640 1 --2- 172.21.15.7:0/2247916933 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7febe80cdc80 0x7febe815bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.112+0000 7febecfbb640 1 -- 172.21.15.7:0/2247916933 >> v1:172.21.15.55:6789/0 conn(0x7febe80ceaf0 legacy=0x7febe8070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:32.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.112+0000 7febecfbb640 1 -- 172.21.15.7:0/2247916933 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe81450b0 con 0x7febe80ce710 2024-04-25T09:55:32.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.112+0000 7febed7bc640 1 --2- 172.21.15.7:0/2247916933 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7febe80cdc80 0x7febe815bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:32.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.113+0000 7febecfbb640 1 --2- 172.21.15.7:0/2247916933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febe80ce710 0x7febe8144ad0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7febdc009870 tx=0x7febdc02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad6576a10b23879 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:32.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.113+0000 7febe77fe640 1 -- 172.21.15.7:0/2247916933 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc037070 con 0x7febe80ce710 2024-04-25T09:55:32.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.113+0000 7febe77fe640 1 -- 172.21.15.7:0/2247916933 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febdc032440 con 0x7febe80ce710 2024-04-25T09:55:32.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.113+0000 7febe77fe640 1 -- 172.21.15.7:0/2247916933 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc032810 con 0x7febe80ce710 2024-04-25T09:55:32.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.114+0000 7febef21f640 1 -- 172.21.15.7:0/2247916933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febe80ce710 msgr2=0x7febe8144ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:32.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.114+0000 7febef21f640 1 --2- 172.21.15.7:0/2247916933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febe80ce710 0x7febe8144ad0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7febdc009870 tx=0x7febdc02a200 comp rx=0 tx=0).stop 2024-04-25T09:55:32.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.114+0000 7febef21f640 1 -- 172.21.15.7:0/2247916933 shutdown_connections 2024-04-25T09:55:32.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.114+0000 7febef21f640 1 --2- 172.21.15.7:0/2247916933 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7febe80cdc80 0x7febe815bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.114+0000 7febef21f640 1 --2- 172.21.15.7:0/2247916933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febe80ce710 0x7febe8144ad0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.114+0000 7febef21f640 1 -- 172.21.15.7:0/2247916933 >> 172.21.15.7:0/2247916933 conn(0x7febe80b2390 msgr2=0x7febe80b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:32.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.114+0000 7febef21f640 1 -- 172.21.15.7:0/2247916933 shutdown_connections 2024-04-25T09:55:32.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.114+0000 7febef21f640 1 -- 172.21.15.7:0/2247916933 wait complete. 2024-04-25T09:55:32.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.115+0000 7febef21f640 1 Processor -- start 2024-04-25T09:55:32.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.115+0000 7febef21f640 1 -- start start 2024-04-25T09:55:32.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.116+0000 7febef21f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febe80cdc80 0x7febe81e0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:32.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.116+0000 7febef21f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febe80ce710 0x7febe81e5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:32.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.116+0000 7febef21f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7febe80ceaf0 0x7febe81327a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:32.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.116+0000 7febef21f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe80cef50 con 0x7febe80ce710 2024-04-25T09:55:32.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.116+0000 7febef21f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe80cd480 con 0x7febe80cdc80 2024-04-25T09:55:32.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.116+0000 7febef21f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe80ce0f0 con 0x7febe80ceaf0 2024-04-25T09:55:32.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.116+0000 7febe7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febe80ce710 0x7febe81e5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:32.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.116+0000 7febe7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febe80ce710 0x7febe81e5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42022/0 (socket says 172.21.15.7:42022) 2024-04-25T09:55:32.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.116+0000 7febe7fff640 1 -- 172.21.15.7:0/1870635859 learned_addr learned my addr 172.21.15.7:0/1870635859 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:32.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.116+0000 7febecfbb640 1 --2- 172.21.15.7:0/1870635859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febe80cdc80 0x7febe81e0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:32.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.116+0000 7febed7bc640 1 --2- 172.21.15.7:0/1870635859 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7febe80ceaf0 0x7febe81327a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:32.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.116+0000 7febe7fff640 1 -- 172.21.15.7:0/1870635859 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7febe80ceaf0 msgr2=0x7febe81327a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:32.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.116+0000 7febe7fff640 1 --2- 172.21.15.7:0/1870635859 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7febe80ceaf0 0x7febe81327a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.116+0000 7febe7fff640 1 -- 172.21.15.7:0/1870635859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febe80cdc80 msgr2=0x7febe81e0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:32.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.116+0000 7febe7fff640 1 --2- 172.21.15.7:0/1870635859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febe80cdc80 0x7febe81e0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.116+0000 7febe7fff640 1 -- 172.21.15.7:0/1870635859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe81e05c0 con 0x7febe80ce710 2024-04-25T09:55:32.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.116+0000 7febecfbb640 1 --2- 172.21.15.7:0/1870635859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febe80cdc80 0x7febe81e0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:32.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.116+0000 7febe7fff640 1 --2- 172.21.15.7:0/1870635859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febe80ce710 0x7febe81e5f70 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7febd400b3f0 tx=0x7febd400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:32.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.117+0000 7febe57fa640 1 -- 172.21.15.7:0/1870635859 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4015020 con 0x7febe80ce710 2024-04-25T09:55:32.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.117+0000 7febe57fa640 1 -- 172.21.15.7:0/1870635859 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd4011830 con 0x7febe80ce710 2024-04-25T09:55:32.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.117+0000 7febef21f640 1 -- 172.21.15.7:0/1870635859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe80c8060 con 0x7febe80ce710 2024-04-25T09:55:32.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.117+0000 7febe57fa640 1 -- 172.21.15.7:0/1870635859 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4011c20 con 0x7febe80ce710 2024-04-25T09:55:32.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.117+0000 7febef21f640 1 -- 172.21.15.7:0/1870635859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe80c8620 con 0x7febe80ce710 2024-04-25T09:55:32.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.118+0000 7febef21f640 1 -- 172.21.15.7:0/1870635859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe8068fd0 con 0x7febe80ce710 2024-04-25T09:55:32.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.118+0000 7febe57fa640 1 -- 172.21.15.7:0/1870635859 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7febd4018020 con 0x7febe80ce710 2024-04-25T09:55:32.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.119+0000 7febe57fa640 1 --2- 172.21.15.7:0/1870635859 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7febcc06b4d0 0x7febcc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:32.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.119+0000 7febecfbb640 1 --2- 172.21.15.7:0/1870635859 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7febcc06b4d0 0x7febcc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:32.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.119+0000 7febe57fa640 1 -- 172.21.15.7:0/1870635859 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7febd4089cc0 con 0x7febe80ce710 2024-04-25T09:55:32.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.119+0000 7febecfbb640 1 --2- 172.21.15.7:0/1870635859 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7febcc06b4d0 0x7febcc06d990 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7febdc034000 tx=0x7febdc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:32.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.123+0000 7febe57fa640 1 -- 172.21.15.7:0/1870635859 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7febd401f030 con 0x7febe80ce710 2024-04-25T09:55:32.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.374+0000 7febef21f640 1 -- 172.21.15.7:0/1870635859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7febe80afd80 con 0x7febe80ce710 2024-04-25T09:55:32.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.377+0000 7febe57fa640 1 -- 172.21.15.7:0/1870635859 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7febd40172c0 con 0x7febe80ce710 2024-04-25T09:55:32.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.379+0000 7febef21f640 1 -- 172.21.15.7:0/1870635859 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7febcc06b4d0 msgr2=0x7febcc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:32.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.379+0000 7febef21f640 1 --2- 172.21.15.7:0/1870635859 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7febcc06b4d0 0x7febcc06d990 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7febdc034000 tx=0x7febdc02e000 comp rx=0 tx=0).stop 2024-04-25T09:55:32.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.379+0000 7febef21f640 1 -- 172.21.15.7:0/1870635859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febe80ce710 msgr2=0x7febe81e5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:32.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.379+0000 7febef21f640 1 --2- 172.21.15.7:0/1870635859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febe80ce710 0x7febe81e5f70 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7febd400b3f0 tx=0x7febd400b8b0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.379+0000 7febef21f640 1 -- 172.21.15.7:0/1870635859 shutdown_connections 2024-04-25T09:55:32.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.379+0000 7febef21f640 1 --2- 172.21.15.7:0/1870635859 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7febcc06b4d0 0x7febcc06d990 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.379+0000 7febef21f640 1 --2- 172.21.15.7:0/1870635859 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7febe80ceaf0 0x7febe81327a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.379+0000 7febef21f640 1 --2- 172.21.15.7:0/1870635859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febe80ce710 0x7febe81e5f70 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.379+0000 7febef21f640 1 --2- 172.21.15.7:0/1870635859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febe80cdc80 0x7febe81e0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.379+0000 7febef21f640 1 -- 172.21.15.7:0/1870635859 >> 172.21.15.7:0/1870635859 conn(0x7febe80b2390 msgr2=0x7febe81437c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:32.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.379+0000 7febef21f640 1 -- 172.21.15.7:0/1870635859 shutdown_connections 2024-04-25T09:55:32.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.379+0000 7febef21f640 1 -- 172.21.15.7:0/1870635859 wait complete. 2024-04-25T09:55:32.393 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:55:32.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.490+0000 7f59d003a640 1 Processor -- start 2024-04-25T09:55:32.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.490+0000 7f59d003a640 1 -- start start 2024-04-25T09:55:32.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.491+0000 7f59d003a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f59c8144100 0x7f59c80cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:32.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.491+0000 7f59d003a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f59c80ced20 0x7f59c806e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:32.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.491+0000 7f59d003a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59c806e7a0 0x7f59c815e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:32.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.491+0000 7f59d003a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c81444e0 con 0x7f59c80ced20 2024-04-25T09:55:32.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.491+0000 7f59d003a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c815ac70 con 0x7f59c8144100 2024-04-25T09:55:32.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.491+0000 7f59d003a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80cdbf0 con 0x7f59c806e7a0 2024-04-25T09:55:32.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.491+0000 7f59cd5d5640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f59c80ced20 0x7f59c806e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:32.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.491+0000 7f59cd5d5640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f59c80ced20 0x7f59c806e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42026/0 (socket says 172.21.15.7:42026) 2024-04-25T09:55:32.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.491+0000 7f59cd5d5640 1 -- 172.21.15.7:0/2140924394 learned_addr learned my addr 172.21.15.7:0/2140924394 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:32.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.492+0000 7f59ce5d7640 1 --2- 172.21.15.7:0/2140924394 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59c806e7a0 0x7f59c815e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:32.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.492+0000 7f59cddd6640 1 --2- 172.21.15.7:0/2140924394 >> v2:172.21.15.55:3300/0 conn(0x7f59c8144100 0x7f59c80cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:32.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.492+0000 7f59cd5d5640 1 -- 172.21.15.7:0/2140924394 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59c806e7a0 msgr2=0x7f59c815e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:32.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.492+0000 7f59cd5d5640 1 --2- 172.21.15.7:0/2140924394 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59c806e7a0 0x7f59c815e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.492+0000 7f59cd5d5640 1 -- 172.21.15.7:0/2140924394 >> v2:172.21.15.55:3300/0 conn(0x7f59c8144100 msgr2=0x7f59c80cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:32.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.492+0000 7f59cd5d5640 1 --2- 172.21.15.7:0/2140924394 >> v2:172.21.15.55:3300/0 conn(0x7f59c8144100 0x7f59c80cd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.492+0000 7f59cd5d5640 1 -- 172.21.15.7:0/2140924394 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c80cded0 con 0x7f59c80ced20 2024-04-25T09:55:32.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.492+0000 7f59ce5d7640 1 --2- 172.21.15.7:0/2140924394 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59c806e7a0 0x7f59c815e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:32.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.492+0000 7f59cddd6640 1 --2- 172.21.15.7:0/2140924394 >> v2:172.21.15.55:3300/0 conn(0x7f59c8144100 0x7f59c80cd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:32.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.492+0000 7f59cd5d5640 1 --2- 172.21.15.7:0/2140924394 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c80ced20 0x7f59c806e260 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f59c8072230 tx=0x7f59b802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6609f89c991c270 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:32.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.493+0000 7f59ccdd4640 1 -- 172.21.15.7:0/2140924394 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b8037070 con 0x7f59c80ced20 2024-04-25T09:55:32.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.493+0000 7f59ccdd4640 1 -- 172.21.15.7:0/2140924394 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b8032440 con 0x7f59c80ced20 2024-04-25T09:55:32.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.493+0000 7f59ccdd4640 1 -- 172.21.15.7:0/2140924394 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b8032810 con 0x7f59c80ced20 2024-04-25T09:55:32.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.493+0000 7f59d003a640 1 -- 172.21.15.7:0/2140924394 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c80ced20 msgr2=0x7f59c806e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:32.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.493+0000 7f59d003a640 1 --2- 172.21.15.7:0/2140924394 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c80ced20 0x7f59c806e260 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f59c8072230 tx=0x7f59b802a1e0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.493+0000 7f59d003a640 1 -- 172.21.15.7:0/2140924394 shutdown_connections 2024-04-25T09:55:32.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.493+0000 7f59d003a640 1 --2- 172.21.15.7:0/2140924394 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c80ced20 0x7f59c806e260 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.493+0000 7f59d003a640 1 --2- 172.21.15.7:0/2140924394 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59c806e7a0 0x7f59c815e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.493+0000 7f59d003a640 1 --2- 172.21.15.7:0/2140924394 >> v2:172.21.15.55:3300/0 conn(0x7f59c8144100 0x7f59c80cd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.493+0000 7f59d003a640 1 -- 172.21.15.7:0/2140924394 >> 172.21.15.7:0/2140924394 conn(0x7f59c8071150 msgr2=0x7f59c8071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:32.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.493+0000 7f59d003a640 1 -- 172.21.15.7:0/2140924394 shutdown_connections 2024-04-25T09:55:32.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.493+0000 7f59d003a640 1 -- 172.21.15.7:0/2140924394 wait complete. 2024-04-25T09:55:32.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.495+0000 7f59d003a640 1 Processor -- start 2024-04-25T09:55:32.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.495+0000 7f59d003a640 1 -- start start 2024-04-25T09:55:32.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.495+0000 7f59d003a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c806e7a0 0x7f59c8139a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:32.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.495+0000 7f59d003a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59c80ced20 0x7f59c813ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:32.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.495+0000 7f59d003a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c8144100 0x7f59c80c6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:32.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.495+0000 7f59d003a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80cea00 con 0x7f59c8144100 2024-04-25T09:55:32.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.495+0000 7f59d003a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80ce490 con 0x7f59c806e7a0 2024-04-25T09:55:32.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.495+0000 7f59d003a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c815e7a0 con 0x7f59c80ced20 2024-04-25T09:55:32.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.495+0000 7f59ce5d7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c8144100 0x7f59c80c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:32.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.496+0000 7f59ce5d7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c8144100 0x7f59c80c6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42030/0 (socket says 172.21.15.7:42030) 2024-04-25T09:55:32.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.496+0000 7f59ce5d7640 1 -- 172.21.15.7:0/26554962 learned_addr learned my addr 172.21.15.7:0/26554962 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:32.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.496+0000 7f59cd5d5640 1 --2- 172.21.15.7:0/26554962 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59c80ced20 0x7f59c813ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:32.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.496+0000 7f59cddd6640 1 --2- 172.21.15.7:0/26554962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c806e7a0 0x7f59c8139a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:32.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.496+0000 7f59ce5d7640 1 -- 172.21.15.7:0/26554962 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59c80ced20 msgr2=0x7f59c813ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:32.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.496+0000 7f59ce5d7640 1 --2- 172.21.15.7:0/26554962 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59c80ced20 0x7f59c813ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.496+0000 7f59ce5d7640 1 -- 172.21.15.7:0/26554962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c806e7a0 msgr2=0x7f59c8139a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:32.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.496+0000 7f59ce5d7640 1 --2- 172.21.15.7:0/26554962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c806e7a0 0x7f59c8139a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.496+0000 7f59ce5d7640 1 -- 172.21.15.7:0/26554962 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c813f740 con 0x7f59c8144100 2024-04-25T09:55:32.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.496+0000 7f59cd5d5640 1 --2- 172.21.15.7:0/26554962 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59c80ced20 0x7f59c813ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:32.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.496+0000 7f59cddd6640 1 --2- 172.21.15.7:0/26554962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c806e7a0 0x7f59c8139a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:32.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.496+0000 7f59ce5d7640 1 --2- 172.21.15.7:0/26554962 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c8144100 0x7f59c80c6980 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f59c400cf20 tx=0x7f59c400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:32.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.496+0000 7f59be7fc640 1 -- 172.21.15.7:0/26554962 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c401a070 con 0x7f59c8144100 2024-04-25T09:55:32.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.496+0000 7f59be7fc640 1 -- 172.21.15.7:0/26554962 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c400d840 con 0x7f59c8144100 2024-04-25T09:55:32.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.496+0000 7f59d003a640 1 -- 172.21.15.7:0/26554962 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c813fa20 con 0x7f59c8144100 2024-04-25T09:55:32.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.496+0000 7f59be7fc640 1 -- 172.21.15.7:0/26554962 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c400dc30 con 0x7f59c8144100 2024-04-25T09:55:32.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.496+0000 7f59d003a640 1 -- 172.21.15.7:0/26554962 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c813ffe0 con 0x7f59c8144100 2024-04-25T09:55:32.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.497+0000 7f59d003a640 1 -- 172.21.15.7:0/26554962 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c8068fd0 con 0x7f59c8144100 2024-04-25T09:55:32.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.498+0000 7f59be7fc640 1 -- 172.21.15.7:0/26554962 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f59c401d070 con 0x7f59c8144100 2024-04-25T09:55:32.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.498+0000 7f59be7fc640 1 --2- 172.21.15.7:0/26554962 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f59ac06b4d0 0x7f59ac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:32.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.498+0000 7f59be7fc640 1 -- 172.21.15.7:0/26554962 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f59c408a8a0 con 0x7f59c8144100 2024-04-25T09:55:32.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.498+0000 7f59cddd6640 1 --2- 172.21.15.7:0/26554962 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f59ac06b4d0 0x7f59ac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:32.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.499+0000 7f59cddd6640 1 --2- 172.21.15.7:0/26554962 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f59ac06b4d0 0x7f59ac06d990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f59c0006fd0 tx=0x7f59c0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:32.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.502+0000 7f59be7fc640 1 -- 172.21.15.7:0/26554962 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f59c4059970 con 0x7f59c8144100 2024-04-25T09:55:32.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.683+0000 7f59d003a640 1 -- 172.21.15.7:0/26554962 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59c806e0e0 con 0x7f59c8144100 2024-04-25T09:55:32.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.684+0000 7f59be7fc640 1 -- 172.21.15.7:0/26554962 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+13068 (secure 0 0 0) 0x7f59c4059270 con 0x7f59c8144100 2024-04-25T09:55:32.687 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:32.687 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":35,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:55:29.709290+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:55:32.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.685+0000 7f59d003a640 1 -- 172.21.15.7:0/26554962 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f59ac06b4d0 msgr2=0x7f59ac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:32.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.685+0000 7f59d003a640 1 --2- 172.21.15.7:0/26554962 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f59ac06b4d0 0x7f59ac06d990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f59c0006fd0 tx=0x7f59c0008040 comp rx=0 tx=0).stop 2024-04-25T09:55:32.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.685+0000 7f59d003a640 1 -- 172.21.15.7:0/26554962 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c8144100 msgr2=0x7f59c80c6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:32.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.685+0000 7f59d003a640 1 --2- 172.21.15.7:0/26554962 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c8144100 0x7f59c80c6980 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f59c400cf20 tx=0x7f59c400a7d0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.686+0000 7f59d003a640 1 -- 172.21.15.7:0/26554962 shutdown_connections 2024-04-25T09:55:32.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.686+0000 7f59d003a640 1 --2- 172.21.15.7:0/26554962 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f59ac06b4d0 0x7f59ac06d990 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.686+0000 7f59d003a640 1 --2- 172.21.15.7:0/26554962 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c8144100 0x7f59c80c6980 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.686+0000 7f59d003a640 1 --2- 172.21.15.7:0/26554962 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59c80ced20 0x7f59c813ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.686+0000 7f59d003a640 1 --2- 172.21.15.7:0/26554962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c806e7a0 0x7f59c8139a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.686+0000 7f59d003a640 1 -- 172.21.15.7:0/26554962 >> 172.21.15.7:0/26554962 conn(0x7f59c8071150 msgr2=0x7f59c815d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:32.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.686+0000 7f59d003a640 1 -- 172.21.15.7:0/26554962 shutdown_connections 2024-04-25T09:55:32.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.686+0000 7f59d003a640 1 -- 172.21.15.7:0/26554962 wait complete. 2024-04-25T09:55:32.699 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:55:32.700 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:55:32.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.800+0000 7f9237ebd640 1 Processor -- start 2024-04-25T09:55:32.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.801+0000 7f9237ebd640 1 -- start start 2024-04-25T09:55:32.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.801+0000 7f9237ebd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f92300d3760 0x7f923015eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:32.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.801+0000 7f9237ebd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f923015f1c0 0x7f92300d3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:32.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.801+0000 7f9237ebd640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92300d4080 con 0x7f92300ce830 2024-04-25T09:55:32.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.801+0000 7f9237ebd640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92300ce380 con 0x7f923015f1c0 2024-04-25T09:55:32.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.801+0000 7f9237ebd640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f923015f000 con 0x7f92300d3760 2024-04-25T09:55:32.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.802+0000 7f9235458640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f923015f1c0 0x7f92300d3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:32.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.802+0000 7f9235458640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f923015f1c0 0x7f92300d3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42042/0 (socket says 172.21.15.7:42042) 2024-04-25T09:55:32.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.802+0000 7f9235458640 1 -- 172.21.15.7:0/2329248153 learned_addr learned my addr 172.21.15.7:0/2329248153 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:32.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.802+0000 7f9235c59640 1 --2- 172.21.15.7:0/2329248153 >> v2:172.21.15.55:3300/0 conn(0x7f92300d3760 0x7f923015eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:32.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.802+0000 7f9235458640 1 -- 172.21.15.7:0/2329248153 >> v2:172.21.15.55:3300/0 conn(0x7f92300d3760 msgr2=0x7f923015eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:32.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.802+0000 7f9235458640 1 --2- 172.21.15.7:0/2329248153 >> v2:172.21.15.55:3300/0 conn(0x7f92300d3760 0x7f923015eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.802+0000 7f9235458640 1 -- 172.21.15.7:0/2329248153 >> v1:172.21.15.55:6789/0 conn(0x7f92300ce830 legacy=0x7f92300b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:32.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.802+0000 7f9235458640 1 -- 172.21.15.7:0/2329248153 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92300ced10 con 0x7f923015f1c0 2024-04-25T09:55:32.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.803+0000 7f9235458640 1 --2- 172.21.15.7:0/2329248153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f923015f1c0 0x7f92300d3b40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f92300b6320 tx=0x7f922002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b955cbb4fa0d4c9e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:32.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.803+0000 7f9234c57640 1 -- 172.21.15.7:0/2329248153 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9220037070 con 0x7f923015f1c0 2024-04-25T09:55:32.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.803+0000 7f9234c57640 1 -- 172.21.15.7:0/2329248153 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9220032440 con 0x7f923015f1c0 2024-04-25T09:55:32.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.803+0000 7f9234c57640 1 -- 172.21.15.7:0/2329248153 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9220032810 con 0x7f923015f1c0 2024-04-25T09:55:32.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.803+0000 7f9237ebd640 1 -- 172.21.15.7:0/2329248153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f923015f1c0 msgr2=0x7f92300d3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:32.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.803+0000 7f9237ebd640 1 --2- 172.21.15.7:0/2329248153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f923015f1c0 0x7f92300d3b40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f92300b6320 tx=0x7f922002a270 comp rx=0 tx=0).stop 2024-04-25T09:55:32.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.803+0000 7f9237ebd640 1 -- 172.21.15.7:0/2329248153 shutdown_connections 2024-04-25T09:55:32.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.803+0000 7f9237ebd640 1 --2- 172.21.15.7:0/2329248153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f923015f1c0 0x7f92300d3b40 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.803+0000 7f9237ebd640 1 --2- 172.21.15.7:0/2329248153 >> v2:172.21.15.55:3300/0 conn(0x7f92300d3760 0x7f923015eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.803+0000 7f9237ebd640 1 -- 172.21.15.7:0/2329248153 >> 172.21.15.7:0/2329248153 conn(0x7f9230072680 msgr2=0x7f9230072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:32.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.803+0000 7f9237ebd640 1 -- 172.21.15.7:0/2329248153 shutdown_connections 2024-04-25T09:55:32.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.803+0000 7f9237ebd640 1 -- 172.21.15.7:0/2329248153 wait complete. 2024-04-25T09:55:32.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.804+0000 7f9237ebd640 1 Processor -- start 2024-04-25T09:55:32.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.805+0000 7f9237ebd640 1 -- start start 2024-04-25T09:55:32.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.805+0000 7f9237ebd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92300ce830 0x7f92301f33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:32.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.805+0000 7f9237ebd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92300d3760 0x7f9230148670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:32.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.805+0000 7f9237ebd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f923015f1c0 0x7f9230148bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:32.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.805+0000 7f9237ebd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92300d1e20 con 0x7f92300d3760 2024-04-25T09:55:32.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.805+0000 7f9237ebd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92300d2190 con 0x7f923015f1c0 2024-04-25T09:55:32.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.805+0000 7f9237ebd640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923015de10 con 0x7f92300ce830 2024-04-25T09:55:32.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.805+0000 7f9235458640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92300d3760 0x7f9230148670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:32.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.805+0000 7f9235458640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92300d3760 0x7f9230148670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42058/0 (socket says 172.21.15.7:42058) 2024-04-25T09:55:32.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.805+0000 7f9235458640 1 -- 172.21.15.7:0/1735365453 learned_addr learned my addr 172.21.15.7:0/1735365453 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:32.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.806+0000 7f9235c59640 1 --2- 172.21.15.7:0/1735365453 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92300ce830 0x7f92301f33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:32.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.806+0000 7f923645a640 1 --2- 172.21.15.7:0/1735365453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f923015f1c0 0x7f9230148bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:32.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.806+0000 7f9235458640 1 -- 172.21.15.7:0/1735365453 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92300ce830 msgr2=0x7f92301f33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:32.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.806+0000 7f9235458640 1 --2- 172.21.15.7:0/1735365453 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92300ce830 0x7f92301f33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.806+0000 7f9235458640 1 -- 172.21.15.7:0/1735365453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f923015f1c0 msgr2=0x7f9230148bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:32.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.806+0000 7f9235458640 1 --2- 172.21.15.7:0/1735365453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f923015f1c0 0x7f9230148bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.806+0000 7f9235458640 1 -- 172.21.15.7:0/1735365453 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9230149af0 con 0x7f92300d3760 2024-04-25T09:55:32.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.806+0000 7f9235458640 1 --2- 172.21.15.7:0/1735365453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92300d3760 0x7f9230148670 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f922002a2b0 tx=0x7f92200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:32.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.806+0000 7f92267fc640 1 -- 172.21.15.7:0/1735365453 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9220041020 con 0x7f92300d3760 2024-04-25T09:55:32.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.806+0000 7f92267fc640 1 -- 172.21.15.7:0/1735365453 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92200306c0 con 0x7f92300d3760 2024-04-25T09:55:32.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.806+0000 7f9237ebd640 1 -- 172.21.15.7:0/1735365453 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92301f3910 con 0x7f92300d3760 2024-04-25T09:55:32.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.806+0000 7f92267fc640 1 -- 172.21.15.7:0/1735365453 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9220037040 con 0x7f92300d3760 2024-04-25T09:55:32.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.806+0000 7f9237ebd640 1 -- 172.21.15.7:0/1735365453 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9230146830 con 0x7f92300d3760 2024-04-25T09:55:32.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.807+0000 7f9237ebd640 1 -- 172.21.15.7:0/1735365453 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9230068f60 con 0x7f92300d3760 2024-04-25T09:55:32.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.808+0000 7f92267fc640 1 -- 172.21.15.7:0/1735365453 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9220044020 con 0x7f92300d3760 2024-04-25T09:55:32.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.808+0000 7f92267fc640 1 --2- 172.21.15.7:0/1735365453 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f921406b4d0 0x7f921406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:32.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.808+0000 7f92267fc640 1 -- 172.21.15.7:0/1735365453 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f92200aa5d0 con 0x7f92300d3760 2024-04-25T09:55:32.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.808+0000 7f9235c59640 1 --2- 172.21.15.7:0/1735365453 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f921406b4d0 0x7f921406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:32.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.808+0000 7f9235c59640 1 --2- 172.21.15.7:0/1735365453 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f921406b4d0 0x7f921406d990 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f922c006fd0 tx=0x7f922c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:32.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.812+0000 7f92267fc640 1 -- 172.21.15.7:0/1735365453 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f922004b030 con 0x7f92300d3760 2024-04-25T09:55:32.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.992+0000 7f9237ebd640 1 -- 172.21.15.7:0/1735365453 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f92300d3360 con 0x7f92300d3760 2024-04-25T09:55:32.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.992+0000 7f92267fc640 1 -- 172.21.15.7:0/1735365453 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f92301f3910 con 0x7f92300d3760 2024-04-25T09:55:32.995 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T09:55:32.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.994+0000 7f9237ebd640 1 -- 172.21.15.7:0/1735365453 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f921406b4d0 msgr2=0x7f921406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:32.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.994+0000 7f9237ebd640 1 --2- 172.21.15.7:0/1735365453 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f921406b4d0 0x7f921406d990 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f922c006fd0 tx=0x7f922c008040 comp rx=0 tx=0).stop 2024-04-25T09:55:32.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.994+0000 7f9237ebd640 1 -- 172.21.15.7:0/1735365453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92300d3760 msgr2=0x7f9230148670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:32.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.994+0000 7f9237ebd640 1 --2- 172.21.15.7:0/1735365453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92300d3760 0x7f9230148670 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f922002a2b0 tx=0x7f92200046c0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.994+0000 7f9237ebd640 1 -- 172.21.15.7:0/1735365453 shutdown_connections 2024-04-25T09:55:32.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.994+0000 7f9237ebd640 1 --2- 172.21.15.7:0/1735365453 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f921406b4d0 0x7f921406d990 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.994+0000 7f9237ebd640 1 --2- 172.21.15.7:0/1735365453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f923015f1c0 0x7f9230148bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.994+0000 7f9237ebd640 1 --2- 172.21.15.7:0/1735365453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92300d3760 0x7f9230148670 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.994+0000 7f9237ebd640 1 --2- 172.21.15.7:0/1735365453 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92300ce830 0x7f92301f33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:32.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.994+0000 7f9237ebd640 1 -- 172.21.15.7:0/1735365453 >> 172.21.15.7:0/1735365453 conn(0x7f9230072680 msgr2=0x7f9230072a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:32.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.994+0000 7f9237ebd640 1 -- 172.21.15.7:0/1735365453 shutdown_connections 2024-04-25T09:55:32.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:32.994+0000 7f9237ebd640 1 -- 172.21.15.7:0/1735365453 wait complete. 2024-04-25T09:55:33.008 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:55:33.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.105+0000 7fd816622640 1 Processor -- start 2024-04-25T09:55:33.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.106+0000 7fd816622640 1 -- start start 2024-04-25T09:55:33.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.106+0000 7fd816622640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd81015db00 0x7fd8100d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:33.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.106+0000 7fd816622640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd8100b53b0 0x7fd8100d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:33.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.106+0000 7fd816622640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8100d1e80 con 0x7fd8100ce2b0 2024-04-25T09:55:33.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.106+0000 7fd816622640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8100b5930 con 0x7fd81015db00 2024-04-25T09:55:33.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.106+0000 7fd816622640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8100b5c10 con 0x7fd8100b53b0 2024-04-25T09:55:33.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.106+0000 7fd80ffff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd81015db00 0x7fd8100d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:33.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.107+0000 7fd80ffff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd81015db00 0x7fd8100d0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42074/0 (socket says 172.21.15.7:42074) 2024-04-25T09:55:33.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.107+0000 7fd80ffff640 1 -- 172.21.15.7:0/2763926820 learned_addr learned my addr 172.21.15.7:0/2763926820 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:33.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.107+0000 7fd80f7fe640 1 --2- 172.21.15.7:0/2763926820 >> v2:172.21.15.55:3300/0 conn(0x7fd8100b53b0 0x7fd8100d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:33.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.107+0000 7fd80ffff640 1 -- 172.21.15.7:0/2763926820 >> v2:172.21.15.55:3300/0 conn(0x7fd8100b53b0 msgr2=0x7fd8100d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:33.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.107+0000 7fd80ffff640 1 --2- 172.21.15.7:0/2763926820 >> v2:172.21.15.55:3300/0 conn(0x7fd8100b53b0 0x7fd8100d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:33.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.107+0000 7fd80ffff640 1 -- 172.21.15.7:0/2763926820 >> v1:172.21.15.55:6789/0 conn(0x7fd8100ce2b0 legacy=0x7fd810161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:33.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.107+0000 7fd80ffff640 1 -- 172.21.15.7:0/2763926820 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8100b5ef0 con 0x7fd81015db00 2024-04-25T09:55:33.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.108+0000 7fd80ffff640 1 --2- 172.21.15.7:0/2763926820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd81015db00 0x7fd8100d0340 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd8100d4a00 tx=0x7fd80002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e37150ebbb2da202 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:33.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.108+0000 7fd80effd640 1 -- 172.21.15.7:0/2763926820 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800037070 con 0x7fd81015db00 2024-04-25T09:55:33.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.108+0000 7fd80effd640 1 -- 172.21.15.7:0/2763926820 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd800032440 con 0x7fd81015db00 2024-04-25T09:55:33.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.108+0000 7fd80effd640 1 -- 172.21.15.7:0/2763926820 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800032810 con 0x7fd81015db00 2024-04-25T09:55:33.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.108+0000 7fd816622640 1 -- 172.21.15.7:0/2763926820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd81015db00 msgr2=0x7fd8100d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:33.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.108+0000 7fd816622640 1 --2- 172.21.15.7:0/2763926820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd81015db00 0x7fd8100d0340 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd8100d4a00 tx=0x7fd80002a270 comp rx=0 tx=0).stop 2024-04-25T09:55:33.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.108+0000 7fd816622640 1 -- 172.21.15.7:0/2763926820 shutdown_connections 2024-04-25T09:55:33.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.108+0000 7fd816622640 1 --2- 172.21.15.7:0/2763926820 >> v2:172.21.15.55:3300/0 conn(0x7fd8100b53b0 0x7fd8100d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:33.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.108+0000 7fd816622640 1 --2- 172.21.15.7:0/2763926820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd81015db00 0x7fd8100d0340 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:33.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.108+0000 7fd816622640 1 -- 172.21.15.7:0/2763926820 >> 172.21.15.7:0/2763926820 conn(0x7fd810072290 msgr2=0x7fd8100726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:33.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.108+0000 7fd816622640 1 -- 172.21.15.7:0/2763926820 shutdown_connections 2024-04-25T09:55:33.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.108+0000 7fd816622640 1 -- 172.21.15.7:0/2763926820 wait complete. 2024-04-25T09:55:33.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.109+0000 7fd816622640 1 Processor -- start 2024-04-25T09:55:33.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.110+0000 7fd816622640 1 -- start start 2024-04-25T09:55:33.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.110+0000 7fd816622640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8100b53b0 0x7fd81015f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:33.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.110+0000 7fd816622640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8100ce2b0 0x7fd81014e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:33.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.110+0000 7fd816622640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd81015db00 0x7fd81014ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:33.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.110+0000 7fd816622640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8100d3660 con 0x7fd8100b53b0 2024-04-25T09:55:33.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.110+0000 7fd816622640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8100b61d0 con 0x7fd81015db00 2024-04-25T09:55:33.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.110+0000 7fd816622640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8100b6c10 con 0x7fd8100ce2b0 2024-04-25T09:55:33.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.110+0000 7fd80ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8100b53b0 0x7fd81015f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:33.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.110+0000 7fd80ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8100b53b0 0x7fd81015f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42080/0 (socket says 172.21.15.7:42080) 2024-04-25T09:55:33.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.110+0000 7fd80ffff640 1 -- 172.21.15.7:0/654447863 learned_addr learned my addr 172.21.15.7:0/654447863 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:33.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.111+0000 7fd80f7fe640 1 --2- 172.21.15.7:0/654447863 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8100ce2b0 0x7fd81014e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:33.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.111+0000 7fd814bbf640 1 --2- 172.21.15.7:0/654447863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd81015db00 0x7fd81014ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:33.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.111+0000 7fd80ffff640 1 -- 172.21.15.7:0/654447863 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8100ce2b0 msgr2=0x7fd81014e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:33.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.111+0000 7fd80ffff640 1 --2- 172.21.15.7:0/654447863 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8100ce2b0 0x7fd81014e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:33.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.111+0000 7fd80ffff640 1 -- 172.21.15.7:0/654447863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd81015db00 msgr2=0x7fd81014ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:33.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.111+0000 7fd80ffff640 1 --2- 172.21.15.7:0/654447863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd81015db00 0x7fd81014ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:33.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.111+0000 7fd80ffff640 1 -- 172.21.15.7:0/654447863 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd81015fab0 con 0x7fd8100b53b0 2024-04-25T09:55:33.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.111+0000 7fd814bbf640 1 --2- 172.21.15.7:0/654447863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd81015db00 0x7fd81014ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:33.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.111+0000 7fd80ffff640 1 --2- 172.21.15.7:0/654447863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8100b53b0 0x7fd81015f140 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd80002a2b0 tx=0x7fd8000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:33.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.111+0000 7fd80cff9640 1 -- 172.21.15.7:0/654447863 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800041020 con 0x7fd8100b53b0 2024-04-25T09:55:33.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.111+0000 7fd80cff9640 1 -- 172.21.15.7:0/654447863 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8000306c0 con 0x7fd8100b53b0 2024-04-25T09:55:33.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.111+0000 7fd816622640 1 -- 172.21.15.7:0/654447863 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd81015fd90 con 0x7fd8100b53b0 2024-04-25T09:55:33.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.111+0000 7fd80cff9640 1 -- 172.21.15.7:0/654447863 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800037040 con 0x7fd8100b53b0 2024-04-25T09:55:33.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.111+0000 7fd816622640 1 -- 172.21.15.7:0/654447863 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd810160350 con 0x7fd8100b53b0 2024-04-25T09:55:33.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.112+0000 7fd816622640 1 -- 172.21.15.7:0/654447863 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd810068fd0 con 0x7fd8100b53b0 2024-04-25T09:55:33.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.113+0000 7fd80cff9640 1 -- 172.21.15.7:0/654447863 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd800044020 con 0x7fd8100b53b0 2024-04-25T09:55:33.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.113+0000 7fd80cff9640 1 --2- 172.21.15.7:0/654447863 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd7fc06b4d0 0x7fd7fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:33.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.113+0000 7fd80cff9640 1 -- 172.21.15.7:0/654447863 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fd8000aa7d0 con 0x7fd8100b53b0 2024-04-25T09:55:33.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.113+0000 7fd80f7fe640 1 --2- 172.21.15.7:0/654447863 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd7fc06b4d0 0x7fd7fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:33.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.113+0000 7fd80f7fe640 1 --2- 172.21.15.7:0/654447863 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd7fc06b4d0 0x7fd7fc06d990 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd8100cd520 tx=0x7fd804008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:33.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.117+0000 7fd80cff9640 1 -- 172.21.15.7:0/654447863 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd80004b030 con 0x7fd8100b53b0 2024-04-25T09:55:33.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.301+0000 7fd816622640 1 -- 172.21.15.7:0/654447863 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd8100cdc60 con 0x7fd8100b53b0 2024-04-25T09:55:33.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.301+0000 7fd80cff9640 1 -- 172.21.15.7:0/654447863 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd800079810 con 0x7fd8100b53b0 2024-04-25T09:55:33.304 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:33.304 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2024-04-25T09:55:33.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:55:33.305 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2024-04-25T09:55:33.305 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2024-04-25T09:55:33.305 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:55:33.305 INFO:teuthology.orchestra.run.smithi007.stdout:] 2024-04-25T09:55:33.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.303+0000 7fd816622640 1 -- 172.21.15.7:0/654447863 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd7fc06b4d0 msgr2=0x7fd7fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:33.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.303+0000 7fd816622640 1 --2- 172.21.15.7:0/654447863 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd7fc06b4d0 0x7fd7fc06d990 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd8100cd520 tx=0x7fd804008040 comp rx=0 tx=0).stop 2024-04-25T09:55:33.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.303+0000 7fd816622640 1 -- 172.21.15.7:0/654447863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8100b53b0 msgr2=0x7fd81015f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:33.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.303+0000 7fd816622640 1 --2- 172.21.15.7:0/654447863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8100b53b0 0x7fd81015f140 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd80002a2b0 tx=0x7fd8000046c0 comp rx=0 tx=0).stop 2024-04-25T09:55:33.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.303+0000 7fd816622640 1 -- 172.21.15.7:0/654447863 shutdown_connections 2024-04-25T09:55:33.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.303+0000 7fd816622640 1 --2- 172.21.15.7:0/654447863 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd7fc06b4d0 0x7fd7fc06d990 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:33.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.303+0000 7fd816622640 1 --2- 172.21.15.7:0/654447863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd81015db00 0x7fd81014ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:33.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.303+0000 7fd816622640 1 --2- 172.21.15.7:0/654447863 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8100ce2b0 0x7fd81014e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:33.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.303+0000 7fd816622640 1 --2- 172.21.15.7:0/654447863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8100b53b0 0x7fd81015f140 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:33.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.303+0000 7fd816622640 1 -- 172.21.15.7:0/654447863 >> 172.21.15.7:0/654447863 conn(0x7fd810072290 msgr2=0x7fd8100d03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:33.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.303+0000 7fd816622640 1 -- 172.21.15.7:0/654447863 shutdown_connections 2024-04-25T09:55:33.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.303+0000 7fd816622640 1 -- 172.21.15.7:0/654447863 wait complete. 2024-04-25T09:55:33.317 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:55:33.317 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:55:33.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.419+0000 7f1240f61640 1 Processor -- start 2024-04-25T09:55:33.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.419+0000 7f1240f61640 1 -- start start 2024-04-25T09:55:33.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.419+0000 7f1240f61640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f123c15d9b0 0x7f123c0d0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:33.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.420+0000 7f1240f61640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f123c0b9240 0x7f123c0d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:33.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.420+0000 7f1240f61640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f123c0cee00 con 0x7f123c0ce900 2024-04-25T09:55:33.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.420+0000 7f1240f61640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f123c0b7500 con 0x7f123c15d9b0 2024-04-25T09:55:33.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.420+0000 7f1240f61640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123c0b7750 con 0x7f123c0b9240 2024-04-25T09:55:33.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.420+0000 7f1233fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f123c0ce900 0x7f123c161520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:36010/0 (socket says 172.21.15.7:36010) 2024-04-25T09:55:33.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.420+0000 7f123ad9d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f123c0b9240 0x7f123c0d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:33.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.420+0000 7f1233fff640 1 -- 172.21.15.7:0/1477693548 learned_addr learned my addr 172.21.15.7:0/1477693548 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:33.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.420+0000 7f123a59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f123c15d9b0 0x7f123c0d0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:33.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.420+0000 7f1239d9b640 1 -- 172.21.15.7:0/1477693548 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3132973718 0 0) 0x7f123c0cee00 con 0x7f123c0ce900 2024-04-25T09:55:33.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.420+0000 7f1239d9b640 1 -- 172.21.15.7:0/1477693548 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1228003520 con 0x7f123c0ce900 2024-04-25T09:55:33.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.420+0000 7f123ad9d640 1 -- 172.21.15.7:0/1477693548 >> v2:172.21.15.55:3300/0 conn(0x7f123c15d9b0 msgr2=0x7f123c0d0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:33.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.420+0000 7f123ad9d640 1 --2- 172.21.15.7:0/1477693548 >> v2:172.21.15.55:3300/0 conn(0x7f123c15d9b0 0x7f123c0d0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:33.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.420+0000 7f123ad9d640 1 -- 172.21.15.7:0/1477693548 >> v1:172.21.15.55:6789/0 conn(0x7f123c0ce900 legacy=0x7f123c161520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:33.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.420+0000 7f123ad9d640 1 -- 172.21.15.7:0/1477693548 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123c0b7a30 con 0x7f123c0b9240 2024-04-25T09:55:33.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.420+0000 7f123a59c640 1 --2- 172.21.15.7:0/1477693548 >> v2:172.21.15.55:3300/0 conn(0x7f123c15d9b0 0x7f123c0d0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:55:33.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.421+0000 7f123ad9d640 1 --2- 172.21.15.7:0/1477693548 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f123c0b9240 0x7f123c0d0d50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f123c0b7680 tx=0x7f123402a5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c29d74bb5442c72b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:33.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.421+0000 7f1239d9b640 1 -- 172.21.15.7:0/1477693548 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1234007740 con 0x7f123c0b9240 2024-04-25T09:55:33.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.421+0000 7f1239d9b640 1 -- 172.21.15.7:0/1477693548 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12340078e0 con 0x7f123c0b9240 2024-04-25T09:55:33.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.421+0000 7f1239d9b640 1 -- 172.21.15.7:0/1477693548 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1234007c90 con 0x7f123c0b9240 2024-04-25T09:55:33.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.422+0000 7f1240f61640 1 -- 172.21.15.7:0/1477693548 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f123c0b9240 msgr2=0x7f123c0d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:33.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.422+0000 7f1240f61640 1 --2- 172.21.15.7:0/1477693548 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f123c0b9240 0x7f123c0d0d50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f123c0b7680 tx=0x7f123402a5b0 comp rx=0 tx=0).stop 2024-04-25T09:55:33.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.422+0000 7f1240f61640 1 -- 172.21.15.7:0/1477693548 shutdown_connections 2024-04-25T09:55:33.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.422+0000 7f1240f61640 1 --2- 172.21.15.7:0/1477693548 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f123c0b9240 0x7f123c0d0d50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:33.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.422+0000 7f1240f61640 1 --2- 172.21.15.7:0/1477693548 >> v2:172.21.15.55:3300/0 conn(0x7f123c15d9b0 0x7f123c0d0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:33.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.422+0000 7f1240f61640 1 -- 172.21.15.7:0/1477693548 >> 172.21.15.7:0/1477693548 conn(0x7f123c0726b0 msgr2=0x7f123c072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:33.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.422+0000 7f1240f61640 1 -- 172.21.15.7:0/1477693548 shutdown_connections 2024-04-25T09:55:33.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.422+0000 7f1240f61640 1 -- 172.21.15.7:0/1477693548 wait complete. 2024-04-25T09:55:33.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.423+0000 7f1240f61640 1 Processor -- start 2024-04-25T09:55:33.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.423+0000 7f1240f61640 1 -- start start 2024-04-25T09:55:33.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.424+0000 7f1240f61640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f123c0b9240 0x7f123c15f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:33.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.424+0000 7f1240f61640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f123c0ce900 0x7f123c154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:33.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.424+0000 7f1240f61640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f123c15d9b0 0x7f123c0cba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:33.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.424+0000 7f1240f61640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c0b2bc0 con 0x7f123c0b9240 2024-04-25T09:55:33.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.424+0000 7f1240f61640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c15dd90 con 0x7f123c0ce900 2024-04-25T09:55:33.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.424+0000 7f1240f61640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123c0b2d40 con 0x7f123c15d9b0 2024-04-25T09:55:33.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.424+0000 7f123a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f123c0b9240 0x7f123c15f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:33.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.424+0000 7f123a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f123c0b9240 0x7f123c15f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42084/0 (socket says 172.21.15.7:42084) 2024-04-25T09:55:33.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.424+0000 7f123a59c640 1 -- 172.21.15.7:0/1998987644 learned_addr learned my addr 172.21.15.7:0/1998987644 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:33.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.424+0000 7f1233fff640 1 --2- 172.21.15.7:0/1998987644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f123c0ce900 0x7f123c154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:33.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.424+0000 7f123ad9d640 1 --2- 172.21.15.7:0/1998987644 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f123c15d9b0 0x7f123c0cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:33.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.425+0000 7f123a59c640 1 -- 172.21.15.7:0/1998987644 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f123c15d9b0 msgr2=0x7f123c0cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:33.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.425+0000 7f123a59c640 1 --2- 172.21.15.7:0/1998987644 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f123c15d9b0 0x7f123c0cba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:33.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.425+0000 7f123a59c640 1 -- 172.21.15.7:0/1998987644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f123c0ce900 msgr2=0x7f123c154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:33.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.425+0000 7f123a59c640 1 --2- 172.21.15.7:0/1998987644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f123c0ce900 0x7f123c154ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:33.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.425+0000 7f123a59c640 1 -- 172.21.15.7:0/1998987644 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123c0cbf50 con 0x7f123c0b9240 2024-04-25T09:55:33.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.425+0000 7f123a59c640 1 --2- 172.21.15.7:0/1998987644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f123c0b9240 0x7f123c15f640 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f122c00ec10 tx=0x7f122c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:33.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.425+0000 7f1232ffd640 1 -- 172.21.15.7:0/1998987644 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c017070 con 0x7f123c0b9240 2024-04-25T09:55:33.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.425+0000 7f1232ffd640 1 -- 172.21.15.7:0/1998987644 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122c00cc30 con 0x7f123c0b9240 2024-04-25T09:55:33.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.425+0000 7f1232ffd640 1 -- 172.21.15.7:0/1998987644 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c013470 con 0x7f123c0b9240 2024-04-25T09:55:33.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.425+0000 7f1240f61640 1 -- 172.21.15.7:0/1998987644 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f123c0ccd00 con 0x7f123c0b9240 2024-04-25T09:55:33.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.425+0000 7f1240f61640 1 -- 172.21.15.7:0/1998987644 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123c15ee40 con 0x7f123c0b9240 2024-04-25T09:55:33.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.426+0000 7f1240f61640 1 -- 172.21.15.7:0/1998987644 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123c15e990 con 0x7f123c0b9240 2024-04-25T09:55:33.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.427+0000 7f1232ffd640 1 -- 172.21.15.7:0/1998987644 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f122c01a070 con 0x7f123c0b9240 2024-04-25T09:55:33.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.427+0000 7f1232ffd640 1 --2- 172.21.15.7:0/1998987644 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f121c06b4d0 0x7f121c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:33.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.427+0000 7f1232ffd640 1 -- 172.21.15.7:0/1998987644 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f122c089e80 con 0x7f123c0b9240 2024-04-25T09:55:33.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.427+0000 7f1233fff640 1 --2- 172.21.15.7:0/1998987644 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f121c06b4d0 0x7f121c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:33.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.428+0000 7f1233fff640 1 --2- 172.21.15.7:0/1998987644 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f121c06b4d0 0x7f121c06d990 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f123c158a20 tx=0x7f1224009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:33.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.431+0000 7f1232ffd640 1 -- 172.21.15.7:0/1998987644 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f122c058900 con 0x7f123c0b9240 2024-04-25T09:55:33.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.612+0000 7f1240f61640 1 -- 172.21.15.7:0/1998987644 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f123c069040 con 0x7f123c0b9240 2024-04-25T09:55:33.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.710+0000 7f1232ffd640 1 -- 172.21.15.7:0/1998987644 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) v1 ==== 138+0+0 (secure 0 0 0) 0x7f122c05c9a0 con 0x7f123c0b9240 2024-04-25T09:55:33.713 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2024-04-25T09:55:33.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.712+0000 7f1240f61640 1 -- 172.21.15.7:0/1998987644 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f121c06b4d0 msgr2=0x7f121c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:33.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.712+0000 7f1240f61640 1 --2- 172.21.15.7:0/1998987644 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f121c06b4d0 0x7f121c06d990 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f123c158a20 tx=0x7f1224009040 comp rx=0 tx=0).stop 2024-04-25T09:55:33.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.712+0000 7f1240f61640 1 -- 172.21.15.7:0/1998987644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f123c0b9240 msgr2=0x7f123c15f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:33.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.712+0000 7f1240f61640 1 --2- 172.21.15.7:0/1998987644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f123c0b9240 0x7f123c15f640 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f122c00ec10 tx=0x7f122c00c520 comp rx=0 tx=0).stop 2024-04-25T09:55:33.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.712+0000 7f1240f61640 1 -- 172.21.15.7:0/1998987644 shutdown_connections 2024-04-25T09:55:33.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.712+0000 7f1240f61640 1 --2- 172.21.15.7:0/1998987644 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f121c06b4d0 0x7f121c06d990 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:33.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.712+0000 7f1240f61640 1 --2- 172.21.15.7:0/1998987644 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f123c15d9b0 0x7f123c0cba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:33.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.712+0000 7f1240f61640 1 --2- 172.21.15.7:0/1998987644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f123c0ce900 0x7f123c154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:33.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.712+0000 7f1240f61640 1 --2- 172.21.15.7:0/1998987644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f123c0b9240 0x7f123c15f640 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:33.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.712+0000 7f1240f61640 1 -- 172.21.15.7:0/1998987644 >> 172.21.15.7:0/1998987644 conn(0x7f123c0726b0 msgr2=0x7f123c073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:33.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.712+0000 7f1240f61640 1 -- 172.21.15.7:0/1998987644 shutdown_connections 2024-04-25T09:55:33.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.712+0000 7f1240f61640 1 -- 172.21.15.7:0/1998987644 wait complete. 2024-04-25T09:55:33.730 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:55:33.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.835+0000 7fe05175c640 1 Processor -- start 2024-04-25T09:55:33.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.835+0000 7fe05175c640 1 -- start start 2024-04-25T09:55:33.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.835+0000 7fe05175c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe04c0d0780 0x7fe04c0d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:33.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.835+0000 7fe05175c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe04c0b9130 0x7fe04c0d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:33.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.835+0000 7fe05175c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe04c0b9590 0x7fe04c0d2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:33.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.835+0000 7fe05175c640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe04c0d10a0 con 0x7fe04c0b9590 2024-04-25T09:55:33.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.835+0000 7fe05175c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe04c0b7ef0 con 0x7fe04c0d0780 2024-04-25T09:55:33.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.835+0000 7fe05175c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c0b81d0 con 0x7fe04c0b9130 2024-04-25T09:55:33.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.836+0000 7fe04b7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe04c0b9590 0x7fe04c0d2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:33.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.836+0000 7fe04b7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe04c0b9590 0x7fe04c0d2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42100/0 (socket says 172.21.15.7:42100) 2024-04-25T09:55:33.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.836+0000 7fe04b7fe640 1 -- 172.21.15.7:0/480867819 learned_addr learned my addr 172.21.15.7:0/480867819 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:33.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.836+0000 7fe043fff640 1 --2- 172.21.15.7:0/480867819 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe04c0b9130 0x7fe04c0d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:33.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.836+0000 7fe04affd640 1 --2- 172.21.15.7:0/480867819 >> v2:172.21.15.55:3300/0 conn(0x7fe04c0d0780 0x7fe04c0d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:33.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.836+0000 7fe04b7fe640 1 -- 172.21.15.7:0/480867819 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe04c0b9130 msgr2=0x7fe04c0d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:33.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.836+0000 7fe04b7fe640 1 --2- 172.21.15.7:0/480867819 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe04c0b9130 0x7fe04c0d1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:33.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.836+0000 7fe04b7fe640 1 -- 172.21.15.7:0/480867819 >> v2:172.21.15.55:3300/0 conn(0x7fe04c0d0780 msgr2=0x7fe04c0d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:33.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.836+0000 7fe04b7fe640 1 --2- 172.21.15.7:0/480867819 >> v2:172.21.15.55:3300/0 conn(0x7fe04c0d0780 0x7fe04c0d0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:33.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.836+0000 7fe04b7fe640 1 -- 172.21.15.7:0/480867819 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c0b84b0 con 0x7fe04c0b9590 2024-04-25T09:55:33.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.837+0000 7fe04b7fe640 1 --2- 172.21.15.7:0/480867819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe04c0b9590 0x7fe04c0d2170 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0b6180 tx=0x7fe04402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c53c26dacb5f383 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:33.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.837+0000 7fe04a7fc640 1 -- 172.21.15.7:0/480867819 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe044036070 con 0x7fe04c0b9590 2024-04-25T09:55:33.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.837+0000 7fe04a7fc640 1 -- 172.21.15.7:0/480867819 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe044031600 con 0x7fe04c0b9590 2024-04-25T09:55:33.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.837+0000 7fe04a7fc640 1 -- 172.21.15.7:0/480867819 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0440319d0 con 0x7fe04c0b9590 2024-04-25T09:55:33.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.837+0000 7fe05175c640 1 -- 172.21.15.7:0/480867819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe04c0b9590 msgr2=0x7fe04c0d2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:33.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.837+0000 7fe05175c640 1 --2- 172.21.15.7:0/480867819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe04c0b9590 0x7fe04c0d2170 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0b6180 tx=0x7fe04402a6a0 comp rx=0 tx=0).stop 2024-04-25T09:55:33.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.837+0000 7fe05175c640 1 -- 172.21.15.7:0/480867819 shutdown_connections 2024-04-25T09:55:33.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.837+0000 7fe05175c640 1 --2- 172.21.15.7:0/480867819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe04c0b9590 0x7fe04c0d2170 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:33.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.837+0000 7fe05175c640 1 --2- 172.21.15.7:0/480867819 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe04c0b9130 0x7fe04c0d1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:33.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.837+0000 7fe05175c640 1 --2- 172.21.15.7:0/480867819 >> v2:172.21.15.55:3300/0 conn(0x7fe04c0d0780 0x7fe04c0d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:33.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.837+0000 7fe05175c640 1 -- 172.21.15.7:0/480867819 >> 172.21.15.7:0/480867819 conn(0x7fe04c0726b0 msgr2=0x7fe04c072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:33.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.838+0000 7fe05175c640 1 -- 172.21.15.7:0/480867819 shutdown_connections 2024-04-25T09:55:33.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.838+0000 7fe05175c640 1 -- 172.21.15.7:0/480867819 wait complete. 2024-04-25T09:55:33.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.839+0000 7fe05175c640 1 Processor -- start 2024-04-25T09:55:33.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.839+0000 7fe05175c640 1 -- start start 2024-04-25T09:55:33.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.839+0000 7fe05175c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe04c0b9130 0x7fe04c0c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:33.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.839+0000 7fe05175c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe04c0b9590 0x7fe04c149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:33.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.839+0000 7fe05175c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe04c0d0780 0x7fe04c0cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:33.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.839+0000 7fe05175c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c1611b0 con 0x7fe04c0b9590 2024-04-25T09:55:33.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.839+0000 7fe05175c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c0b8a70 con 0x7fe04c0b9130 2024-04-25T09:55:33.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.839+0000 7fe05175c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c161330 con 0x7fe04c0d0780 2024-04-25T09:55:33.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.840+0000 7fe043fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe04c0b9590 0x7fe04c149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:33.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.840+0000 7fe043fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe04c0b9590 0x7fe04c149cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42108/0 (socket says 172.21.15.7:42108) 2024-04-25T09:55:33.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.840+0000 7fe043fff640 1 -- 172.21.15.7:0/3190835860 learned_addr learned my addr 172.21.15.7:0/3190835860 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:33.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.840+0000 7fe04affd640 1 --2- 172.21.15.7:0/3190835860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe04c0b9130 0x7fe04c0c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:33.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.840+0000 7fe04b7fe640 1 --2- 172.21.15.7:0/3190835860 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe04c0d0780 0x7fe04c0cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:33.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.840+0000 7fe043fff640 1 -- 172.21.15.7:0/3190835860 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe04c0d0780 msgr2=0x7fe04c0cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:33.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.840+0000 7fe043fff640 1 --2- 172.21.15.7:0/3190835860 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe04c0d0780 0x7fe04c0cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:33.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.840+0000 7fe043fff640 1 -- 172.21.15.7:0/3190835860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe04c0b9130 msgr2=0x7fe04c0c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:33.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.840+0000 7fe043fff640 1 --2- 172.21.15.7:0/3190835860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe04c0b9130 0x7fe04c0c9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:33.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.840+0000 7fe043fff640 1 -- 172.21.15.7:0/3190835860 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c0cbb50 con 0x7fe04c0b9590 2024-04-25T09:55:33.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.840+0000 7fe043fff640 1 --2- 172.21.15.7:0/3190835860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe04c0b9590 0x7fe04c149cb0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe03400d800 tx=0x7fe03400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:33.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.840+0000 7fe0437fe640 1 -- 172.21.15.7:0/3190835860 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe034018020 con 0x7fe04c0b9590 2024-04-25T09:55:33.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.840+0000 7fe0437fe640 1 -- 172.21.15.7:0/3190835860 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0340096a0 con 0x7fe04c0b9590 2024-04-25T09:55:33.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.840+0000 7fe0437fe640 1 -- 172.21.15.7:0/3190835860 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe034009a70 con 0x7fe04c0b9590 2024-04-25T09:55:33.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.840+0000 7fe05175c640 1 -- 172.21.15.7:0/3190835860 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe04c0cbe30 con 0x7fe04c0b9590 2024-04-25T09:55:33.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.840+0000 7fe05175c640 1 -- 172.21.15.7:0/3190835860 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe04c0c7560 con 0x7fe04c0b9590 2024-04-25T09:55:33.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.841+0000 7fe05175c640 1 -- 172.21.15.7:0/3190835860 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe04c0cc2f0 con 0x7fe04c0b9590 2024-04-25T09:55:33.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.842+0000 7fe0437fe640 1 -- 172.21.15.7:0/3190835860 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe03401b020 con 0x7fe04c0b9590 2024-04-25T09:55:33.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.842+0000 7fe0437fe640 1 --2- 172.21.15.7:0/3190835860 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe02c06b4d0 0x7fe02c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:33.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.842+0000 7fe0437fe640 1 -- 172.21.15.7:0/3190835860 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5619+0+0 (secure 0 0 0) 0x7fe03408a5e0 con 0x7fe04c0b9590 2024-04-25T09:55:33.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.843+0000 7fe04affd640 1 --2- 172.21.15.7:0/3190835860 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe02c06b4d0 0x7fe02c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:33.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.843+0000 7fe04affd640 1 --2- 172.21.15.7:0/3190835860 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe02c06b4d0 0x7fe02c06d990 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe03c0079a0 tx=0x7fe03c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:33.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:33.846+0000 7fe0437fe640 1 -- 172.21.15.7:0/3190835860 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe034022030 con 0x7fe04c0b9590 2024-04-25T09:55:34.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.028+0000 7fe05175c640 1 -- 172.21.15.7:0/3190835860 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe04c0685d0 con 0x7fe04c0b9590 2024-04-25T09:55:34.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.720+0000 7fe0437fe640 1 -- 172.21.15.7:0/3190835860 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe034058fd0 con 0x7fe04c0b9590 2024-04-25T09:55:34.723 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2024-04-25T09:55:34.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.724+0000 7fe05175c640 1 -- 172.21.15.7:0/3190835860 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe02c06b4d0 msgr2=0x7fe02c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:34.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.724+0000 7fe05175c640 1 --2- 172.21.15.7:0/3190835860 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe02c06b4d0 0x7fe02c06d990 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe03c0079a0 tx=0x7fe03c008040 comp rx=0 tx=0).stop 2024-04-25T09:55:34.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.724+0000 7fe05175c640 1 -- 172.21.15.7:0/3190835860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe04c0b9590 msgr2=0x7fe04c149cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:34.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.724+0000 7fe05175c640 1 --2- 172.21.15.7:0/3190835860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe04c0b9590 0x7fe04c149cb0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe03400d800 tx=0x7fe03400dcc0 comp rx=0 tx=0).stop 2024-04-25T09:55:34.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.724+0000 7fe05175c640 1 -- 172.21.15.7:0/3190835860 shutdown_connections 2024-04-25T09:55:34.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.724+0000 7fe05175c640 1 --2- 172.21.15.7:0/3190835860 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe02c06b4d0 0x7fe02c06d990 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:34.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.724+0000 7fe05175c640 1 --2- 172.21.15.7:0/3190835860 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe04c0d0780 0x7fe04c0cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:34.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.724+0000 7fe05175c640 1 --2- 172.21.15.7:0/3190835860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe04c0b9590 0x7fe04c149cb0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:34.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.724+0000 7fe05175c640 1 --2- 172.21.15.7:0/3190835860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe04c0b9130 0x7fe04c0c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:34.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.724+0000 7fe05175c640 1 -- 172.21.15.7:0/3190835860 >> 172.21.15.7:0/3190835860 conn(0x7fe04c0726b0 msgr2=0x7fe04c0b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:34.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.725+0000 7fe05175c640 1 -- 172.21.15.7:0/3190835860 shutdown_connections 2024-04-25T09:55:34.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.725+0000 7fe05175c640 1 -- 172.21.15.7:0/3190835860 wait complete. 2024-04-25T09:55:34.755 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:55:34.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.860+0000 7f436926f640 1 Processor -- start 2024-04-25T09:55:34.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.860+0000 7f436926f640 1 -- start start 2024-04-25T09:55:34.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.861+0000 7f436926f640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f43640d0a00 0x7f436409a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:34.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.861+0000 7f436926f640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43641615e0 con 0x7f4364161200 2024-04-25T09:55:34.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.861+0000 7f436926f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f436406c9f0 con 0x7f436409a7d0 2024-04-25T09:55:34.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.861+0000 7f436926f640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f436406ccd0 con 0x7f43640d0a00 2024-04-25T09:55:34.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.861+0000 7f43627fc640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f43640d0a00 0x7f436409a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:34.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.861+0000 7f43627fc640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f43640d0a00 0x7f436409a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42122/0 (socket says 172.21.15.7:42122) 2024-04-25T09:55:34.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.861+0000 7f43627fc640 1 -- 172.21.15.7:0/2631551794 learned_addr learned my addr 172.21.15.7:0/2631551794 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:34.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.861+0000 7f4362ffd640 1 --1- 172.21.15.7:0/2631551794 >> v1:172.21.15.7:6789/0 conn(0x7f4364161200 0x7f43640cbd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40558/0 (socket says 172.21.15.7:40558) 2024-04-25T09:55:34.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.861+0000 7f43627fc640 1 -- 172.21.15.7:0/2631551794 >> v1:172.21.15.55:6789/0 conn(0x7f436409a7d0 legacy=0x7f43640cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:34.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.861+0000 7f43627fc640 1 -- 172.21.15.7:0/2631551794 >> v1:172.21.15.7:6789/0 conn(0x7f4364161200 legacy=0x7f43640cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:34.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.861+0000 7f43627fc640 1 -- 172.21.15.7:0/2631551794 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4364099a90 con 0x7f43640d0a00 2024-04-25T09:55:34.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.862+0000 7f43627fc640 1 --2- 172.21.15.7:0/2631551794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43640d0a00 0x7f436409a290 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f434c009870 tx=0x7f434c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccbc30cf7b65789 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:34.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.862+0000 7f4361ffb640 1 -- 172.21.15.7:0/2631551794 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c037070 con 0x7f43640d0a00 2024-04-25T09:55:34.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.862+0000 7f4361ffb640 1 -- 172.21.15.7:0/2631551794 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434c032440 con 0x7f43640d0a00 2024-04-25T09:55:34.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.862+0000 7f4361ffb640 1 -- 172.21.15.7:0/2631551794 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c032810 con 0x7f43640d0a00 2024-04-25T09:55:34.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.863+0000 7f436926f640 1 -- 172.21.15.7:0/2631551794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43640d0a00 msgr2=0x7f436409a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:34.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.863+0000 7f436926f640 1 --2- 172.21.15.7:0/2631551794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43640d0a00 0x7f436409a290 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f434c009870 tx=0x7f434c02a2a0 comp rx=0 tx=0).stop 2024-04-25T09:55:34.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.863+0000 7f436926f640 1 -- 172.21.15.7:0/2631551794 shutdown_connections 2024-04-25T09:55:34.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.863+0000 7f436926f640 1 --2- 172.21.15.7:0/2631551794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43640d0a00 0x7f436409a290 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:34.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.863+0000 7f436926f640 1 -- 172.21.15.7:0/2631551794 >> 172.21.15.7:0/2631551794 conn(0x7f43640b31a0 msgr2=0x7f43640b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:34.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.863+0000 7f436926f640 1 -- 172.21.15.7:0/2631551794 shutdown_connections 2024-04-25T09:55:34.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.863+0000 7f436926f640 1 -- 172.21.15.7:0/2631551794 wait complete. 2024-04-25T09:55:34.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.864+0000 7f436926f640 1 Processor -- start 2024-04-25T09:55:34.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.864+0000 7f436926f640 1 -- start start 2024-04-25T09:55:34.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.865+0000 7f436926f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f436409a7d0 0x7f436415c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:34.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.865+0000 7f436926f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f43640d0a00 0x7f43640b4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:34.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.865+0000 7f436926f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4364161200 0x7f43640b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:34.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.865+0000 7f436926f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436406cfb0 con 0x7f436409a7d0 2024-04-25T09:55:34.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.865+0000 7f436926f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436406c680 con 0x7f4364161200 2024-04-25T09:55:34.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.865+0000 7f436926f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f436406d130 con 0x7f43640d0a00 2024-04-25T09:55:34.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.865+0000 7f4362ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f436409a7d0 0x7f436415c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:34.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.865+0000 7f4362ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f436409a7d0 0x7f436415c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42134/0 (socket says 172.21.15.7:42134) 2024-04-25T09:55:34.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.865+0000 7f4362ffd640 1 -- 172.21.15.7:0/286571247 learned_addr learned my addr 172.21.15.7:0/286571247 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:34.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.865+0000 7f43627fc640 1 --2- 172.21.15.7:0/286571247 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f43640d0a00 0x7f43640b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:34.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.865+0000 7f43637fe640 1 --2- 172.21.15.7:0/286571247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4364161200 0x7f43640b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:34.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.865+0000 7f4362ffd640 1 -- 172.21.15.7:0/286571247 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f43640d0a00 msgr2=0x7f43640b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:34.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.865+0000 7f4362ffd640 1 --2- 172.21.15.7:0/286571247 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f43640d0a00 0x7f43640b4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:34.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.865+0000 7f4362ffd640 1 -- 172.21.15.7:0/286571247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4364161200 msgr2=0x7f43640b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:34.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.865+0000 7f4362ffd640 1 --2- 172.21.15.7:0/286571247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4364161200 0x7f43640b4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:34.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.865+0000 7f4362ffd640 1 -- 172.21.15.7:0/286571247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43640c9830 con 0x7f436409a7d0 2024-04-25T09:55:34.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.865+0000 7f43637fe640 1 --2- 172.21.15.7:0/286571247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4364161200 0x7f43640b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:34.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.866+0000 7f4362ffd640 1 --2- 172.21.15.7:0/286571247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f436409a7d0 0x7f436415c8d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f435c00c400 tx=0x7f435c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:34.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.866+0000 7f435b7fe640 1 -- 172.21.15.7:0/286571247 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c0074e0 con 0x7f436409a7d0 2024-04-25T09:55:34.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.866+0000 7f435b7fe640 1 -- 172.21.15.7:0/286571247 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435c007680 con 0x7f436409a7d0 2024-04-25T09:55:34.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.866+0000 7f436926f640 1 -- 172.21.15.7:0/286571247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43640c9b10 con 0x7f436409a7d0 2024-04-25T09:55:34.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.866+0000 7f435b7fe640 1 -- 172.21.15.7:0/286571247 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c004a00 con 0x7f436409a7d0 2024-04-25T09:55:34.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.866+0000 7f436926f640 1 -- 172.21.15.7:0/286571247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43640ca0d0 con 0x7f436409a7d0 2024-04-25T09:55:34.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.867+0000 7f436926f640 1 -- 172.21.15.7:0/286571247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4364068f60 con 0x7f436409a7d0 2024-04-25T09:55:34.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.867+0000 7f435b7fe640 1 -- 172.21.15.7:0/286571247 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f435c01a020 con 0x7f436409a7d0 2024-04-25T09:55:34.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.868+0000 7f435b7fe640 1 --2- 172.21.15.7:0/286571247 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f434406b4d0 0x7f434406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:34.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.868+0000 7f435b7fe640 1 -- 172.21.15.7:0/286571247 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6001+0+0 (secure 0 0 0) 0x7f435c089ac0 con 0x7f436409a7d0 2024-04-25T09:55:34.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.868+0000 7f43627fc640 1 --2- 172.21.15.7:0/286571247 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f434406b4d0 0x7f434406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:34.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.868+0000 7f43627fc640 1 --2- 172.21.15.7:0/286571247 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f434406b4d0 0x7f434406d990 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f434c034000 tx=0x7f434c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:34.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:34.872+0000 7f435b7fe640 1 -- 172.21.15.7:0/286571247 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f43641615e0 con 0x7f436409a7d0 2024-04-25T09:55:35.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.090+0000 7f436926f640 1 -- 172.21.15.7:0/286571247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4364071200 con 0x7f436409a7d0 2024-04-25T09:55:35.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.721+0000 7f435b7fe640 1 -- 172.21.15.7:0/286571247 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f435c0588a0 con 0x7f436409a7d0 2024-04-25T09:55:35.725 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 5 and data pool 6 2024-04-25T09:55:35.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.725+0000 7f436926f640 1 -- 172.21.15.7:0/286571247 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f434406b4d0 msgr2=0x7f434406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:35.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.725+0000 7f436926f640 1 --2- 172.21.15.7:0/286571247 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f434406b4d0 0x7f434406d990 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f434c034000 tx=0x7f434c02e000 comp rx=0 tx=0).stop 2024-04-25T09:55:35.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.725+0000 7f436926f640 1 -- 172.21.15.7:0/286571247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f436409a7d0 msgr2=0x7f436415c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:35.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.725+0000 7f436926f640 1 --2- 172.21.15.7:0/286571247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f436409a7d0 0x7f436415c8d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f435c00c400 tx=0x7f435c00c8c0 comp rx=0 tx=0).stop 2024-04-25T09:55:35.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.725+0000 7f436926f640 1 -- 172.21.15.7:0/286571247 shutdown_connections 2024-04-25T09:55:35.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.725+0000 7f436926f640 1 --2- 172.21.15.7:0/286571247 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f434406b4d0 0x7f434406d990 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:35.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.725+0000 7f436926f640 1 --2- 172.21.15.7:0/286571247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4364161200 0x7f43640b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:35.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.725+0000 7f436926f640 1 --2- 172.21.15.7:0/286571247 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f43640d0a00 0x7f43640b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:35.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.725+0000 7f436926f640 1 --2- 172.21.15.7:0/286571247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f436409a7d0 0x7f436415c8d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:35.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.725+0000 7f436926f640 1 -- 172.21.15.7:0/286571247 >> 172.21.15.7:0/286571247 conn(0x7f43640b31a0 msgr2=0x7f43640d0120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:35.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.725+0000 7f436926f640 1 -- 172.21.15.7:0/286571247 shutdown_connections 2024-04-25T09:55:35.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.726+0000 7f436926f640 1 -- 172.21.15.7:0/286571247 wait complete. 2024-04-25T09:55:35.756 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:55:35.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.859+0000 7fa802b7e640 1 Processor -- start 2024-04-25T09:55:35.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.860+0000 7fa802b7e640 1 -- start start 2024-04-25T09:55:35.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.860+0000 7fa802b7e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa7fc0d0a50 0x7fa7fc0d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:35.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.860+0000 7fa802b7e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa7fc0b53b0 0x7fa7fc0d2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:35.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.860+0000 7fa802b7e640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7fc0d1e80 con 0x7fa7fc15db00 2024-04-25T09:55:35.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.860+0000 7fa802b7e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7fc0b5930 con 0x7fa7fc0d0a50 2024-04-25T09:55:35.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.860+0000 7fa802b7e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc0b5c10 con 0x7fa7fc0b53b0 2024-04-25T09:55:35.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.860+0000 7fa80091a640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa7fc15db00 0x7fa7fc0d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40570/0 (socket says 172.21.15.7:40570) 2024-04-25T09:55:35.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.860+0000 7fa80091a640 1 -- 172.21.15.7:0/2461427654 learned_addr learned my addr 172.21.15.7:0/2461427654 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:35.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.861+0000 7fa7fbfff640 1 --2- 172.21.15.7:0/2461427654 >> v2:172.21.15.55:3300/0 conn(0x7fa7fc0d0a50 0x7fa7fc0d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:35.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.861+0000 7fa80111b640 1 --2- 172.21.15.7:0/2461427654 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa7fc0b53b0 0x7fa7fc0d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:35.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.861+0000 7fa7fb7fe640 1 -- 172.21.15.7:0/2461427654 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1953497342 0 0) 0x7fa7fc0d1e80 con 0x7fa7fc15db00 2024-04-25T09:55:35.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.861+0000 7fa7fb7fe640 1 -- 172.21.15.7:0/2461427654 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7ec003520 con 0x7fa7fc15db00 2024-04-25T09:55:35.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.861+0000 7fa7fb7fe640 1 -- 172.21.15.7:0/2461427654 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1193911546 0 0) 0x7fa7ec003520 con 0x7fa7fc15db00 2024-04-25T09:55:35.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.861+0000 7fa7fb7fe640 1 -- 172.21.15.7:0/2461427654 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa7fc0b53b0 msgr2=0x7fa7fc0d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:35.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.861+0000 7fa7fb7fe640 1 --2- 172.21.15.7:0/2461427654 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa7fc0b53b0 0x7fa7fc0d2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:35.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.861+0000 7fa7fb7fe640 1 -- 172.21.15.7:0/2461427654 >> v2:172.21.15.55:3300/0 conn(0x7fa7fc0d0a50 msgr2=0x7fa7fc0d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:35.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.861+0000 7fa7fb7fe640 1 --2- 172.21.15.7:0/2461427654 >> v2:172.21.15.55:3300/0 conn(0x7fa7fc0d0a50 0x7fa7fc0d2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.861+0000 7fa7fb7fe640 1 -- 172.21.15.7:0/2461427654 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7fc0b5ef0 con 0x7fa7fc15db00 2024-04-25T09:55:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.861+0000 7fa7fb7fe640 1 -- 172.21.15.7:0/2461427654 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fa7f0001670 con 0x7fa7fc15db00 2024-04-25T09:55:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.861+0000 7fa7fbfff640 1 --2- 172.21.15.7:0/2461427654 >> v2:172.21.15.55:3300/0 conn(0x7fa7fc0d0a50 0x7fa7fc0d2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:55:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.861+0000 7fa7fb7fe640 1 -- 172.21.15.7:0/2461427654 >> v1:172.21.15.7:6789/0 conn(0x7fa7fc15db00 legacy=0x7fa7fc0d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.861+0000 7fa7fb7fe640 1 --2- 172.21.15.7:0/2461427654 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa7fc0b53b0 0x7fa7ec0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.861+0000 7fa7fb7fe640 1 --2- 172.21.15.7:0/2461427654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7ec003f30 0x7fa7ec004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.861+0000 7fa7fb7fe640 1 --2- 172.21.15.7:0/2461427654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7ec004d40 0x7fa7ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.861+0000 7fa7fb7fe640 1 -- 172.21.15.7:0/2461427654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc0b5930 con 0x7fa7ec004d40 2024-04-25T09:55:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.861+0000 7fa7fb7fe640 1 -- 172.21.15.7:0/2461427654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc0b5c10 con 0x7fa7ec003f30 2024-04-25T09:55:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.861+0000 7fa7fb7fe640 1 -- 172.21.15.7:0/2461427654 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec00b9c0 con 0x7fa7fc0b53b0 2024-04-25T09:55:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.861+0000 7fa80111b640 1 --2- 172.21.15.7:0/2461427654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7ec004d40 0x7fa7ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.861+0000 7fa80091a640 1 --2- 172.21.15.7:0/2461427654 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa7fc0b53b0 0x7fa7ec0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.861+0000 7fa7fbfff640 1 --2- 172.21.15.7:0/2461427654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7ec003f30 0x7fa7ec004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.862+0000 7fa80111b640 1 -- 172.21.15.7:0/2461427654 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa7fc0b53b0 msgr2=0x7fa7ec0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:35.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.862+0000 7fa80111b640 1 --2- 172.21.15.7:0/2461427654 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa7fc0b53b0 0x7fa7ec0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:35.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.862+0000 7fa80111b640 1 -- 172.21.15.7:0/2461427654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7ec003f30 msgr2=0x7fa7ec004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:35.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.862+0000 7fa80111b640 1 --2- 172.21.15.7:0/2461427654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7ec003f30 0x7fa7ec004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:35.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.862+0000 7fa80111b640 1 -- 172.21.15.7:0/2461427654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ec003520 con 0x7fa7ec004d40 2024-04-25T09:55:35.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.862+0000 7fa80111b640 1 --2- 172.21.15.7:0/2461427654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7ec004d40 0x7fa7ec0051c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4009f90 tx=0x7fa7ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f1c4de3da43b0b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:35.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.862+0000 7fa7fb7fe640 1 -- 172.21.15.7:0/2461427654 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4009c10 con 0x7fa7ec004d40 2024-04-25T09:55:35.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.862+0000 7fa7fb7fe640 1 -- 172.21.15.7:0/2461427654 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f4036070 con 0x7fa7ec004d40 2024-04-25T09:55:35.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.862+0000 7fa7fb7fe640 1 -- 172.21.15.7:0/2461427654 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4031630 con 0x7fa7ec004d40 2024-04-25T09:55:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.863+0000 7fa802b7e640 1 -- 172.21.15.7:0/2461427654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7ec004d40 msgr2=0x7fa7ec0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.863+0000 7fa802b7e640 1 --2- 172.21.15.7:0/2461427654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7ec004d40 0x7fa7ec0051c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4009f90 tx=0x7fa7ec005830 comp rx=0 tx=0).stop 2024-04-25T09:55:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.863+0000 7fa80111b640 1 -- 172.21.15.7:0/2461427654 reap_dead start 2024-04-25T09:55:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.863+0000 7fa802b7e640 1 -- 172.21.15.7:0/2461427654 shutdown_connections 2024-04-25T09:55:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.863+0000 7fa802b7e640 1 -- 172.21.15.7:0/2461427654 >> 172.21.15.7:0/2461427654 conn(0x7fa7fc072290 msgr2=0x7fa7fc0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.863+0000 7fa802b7e640 1 -- 172.21.15.7:0/2461427654 shutdown_connections 2024-04-25T09:55:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.863+0000 7fa802b7e640 1 -- 172.21.15.7:0/2461427654 wait complete. 2024-04-25T09:55:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.864+0000 7fa802b7e640 1 Processor -- start 2024-04-25T09:55:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.864+0000 7fa802b7e640 1 -- start start 2024-04-25T09:55:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.865+0000 7fa802b7e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7ec004d40 0x7fa7fc0c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.865+0000 7fa802b7e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa7fc1f3d40 0x7fa7fc1f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.865+0000 7fa802b7e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7fc15bf80 0x7fa7fc15c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.865+0000 7fa802b7e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc0d3660 con 0x7fa7ec004d40 2024-04-25T09:55:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.865+0000 7fa802b7e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc0b61d0 con 0x7fa7fc15bf80 2024-04-25T09:55:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.865+0000 7fa802b7e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc0ce2b0 con 0x7fa7fc1f3d40 2024-04-25T09:55:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.865+0000 7fa80091a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7ec004d40 0x7fa7fc0c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.865+0000 7fa80091a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7ec004d40 0x7fa7fc0c9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42146/0 (socket says 172.21.15.7:42146) 2024-04-25T09:55:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.865+0000 7fa80091a640 1 -- 172.21.15.7:0/57558649 learned_addr learned my addr 172.21.15.7:0/57558649 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.865+0000 7fa7fbfff640 1 --2- 172.21.15.7:0/57558649 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa7fc1f3d40 0x7fa7fc1f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.865+0000 7fa80111b640 1 --2- 172.21.15.7:0/57558649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7fc15bf80 0x7fa7fc15c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:35.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.866+0000 7fa80091a640 1 -- 172.21.15.7:0/57558649 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa7fc1f3d40 msgr2=0x7fa7fc1f2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:35.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.866+0000 7fa80091a640 1 --2- 172.21.15.7:0/57558649 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa7fc1f3d40 0x7fa7fc1f2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:35.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.866+0000 7fa80091a640 1 -- 172.21.15.7:0/57558649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7fc15bf80 msgr2=0x7fa7fc15c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:35.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.866+0000 7fa80091a640 1 --2- 172.21.15.7:0/57558649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7fc15bf80 0x7fa7fc15c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:35.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.866+0000 7fa80091a640 1 -- 172.21.15.7:0/57558649 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7fc1f7760 con 0x7fa7ec004d40 2024-04-25T09:55:35.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.866+0000 7fa80091a640 1 --2- 172.21.15.7:0/57558649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7ec004d40 0x7fa7fc0c9ae0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa7f00017e0 tx=0x7fa7f00077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:35.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.866+0000 7fa7f97fa640 1 -- 172.21.15.7:0/57558649 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f000f9c0 con 0x7fa7ec004d40 2024-04-25T09:55:35.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.866+0000 7fa7f97fa640 1 -- 172.21.15.7:0/57558649 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f0018070 con 0x7fa7ec004d40 2024-04-25T09:55:35.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.866+0000 7fa802b7e640 1 -- 172.21.15.7:0/57558649 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7fc1f69a0 con 0x7fa7ec004d40 2024-04-25T09:55:35.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.866+0000 7fa7f97fa640 1 -- 172.21.15.7:0/57558649 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f000fdc0 con 0x7fa7ec004d40 2024-04-25T09:55:35.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.866+0000 7fa802b7e640 1 -- 172.21.15.7:0/57558649 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7fc1f6f60 con 0x7fa7ec004d40 2024-04-25T09:55:35.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.867+0000 7fa802b7e640 1 -- 172.21.15.7:0/57558649 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7fc068fd0 con 0x7fa7ec004d40 2024-04-25T09:55:35.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.868+0000 7fa7f97fa640 1 -- 172.21.15.7:0/57558649 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa7f001d460 con 0x7fa7ec004d40 2024-04-25T09:55:35.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.868+0000 7fa7f97fa640 1 --2- 172.21.15.7:0/57558649 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa7e006b500 0x7fa7e006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:35.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.868+0000 7fa7f97fa640 1 -- 172.21.15.7:0/57558649 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa7f008a420 con 0x7fa7ec004d40 2024-04-25T09:55:35.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.868+0000 7fa7fbfff640 1 --2- 172.21.15.7:0/57558649 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa7e006b500 0x7fa7e006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:35.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.869+0000 7fa7fbfff640 1 --2- 172.21.15.7:0/57558649 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa7e006b500 0x7fa7e006d9c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc0cda90 tx=0x7fa7e8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:35.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:35.873+0000 7fa7f97fa640 1 -- 172.21.15.7:0/57558649 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa7f0058ac0 con 0x7fa7ec004d40 2024-04-25T09:55:36.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.054+0000 7fa802b7e640 1 -- 172.21.15.7:0/57558649 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7fc0d16b0 con 0x7fa7ec004d40 2024-04-25T09:55:36.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.055+0000 7fa7f97fa640 1 -- 172.21.15.7:0/57558649 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16859 (secure 0 0 0) 0x7fa7f005cb60 con 0x7fa7ec004d40 2024-04-25T09:55:36.058 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:36.058 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":38,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:55:35.091647+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:55:33.644089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T09:55:34.059847+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:55:36.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.057+0000 7fa802b7e640 1 -- 172.21.15.7:0/57558649 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa7e006b500 msgr2=0x7fa7e006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:36.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.057+0000 7fa802b7e640 1 --2- 172.21.15.7:0/57558649 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa7e006b500 0x7fa7e006d9c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc0cda90 tx=0x7fa7e8009190 comp rx=0 tx=0).stop 2024-04-25T09:55:36.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.057+0000 7fa802b7e640 1 -- 172.21.15.7:0/57558649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7ec004d40 msgr2=0x7fa7fc0c9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:36.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.057+0000 7fa802b7e640 1 --2- 172.21.15.7:0/57558649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7ec004d40 0x7fa7fc0c9ae0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa7f00017e0 tx=0x7fa7f00077a0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.057+0000 7fa802b7e640 1 -- 172.21.15.7:0/57558649 shutdown_connections 2024-04-25T09:55:36.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.057+0000 7fa802b7e640 1 --2- 172.21.15.7:0/57558649 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa7e006b500 0x7fa7e006d9c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.057+0000 7fa802b7e640 1 --2- 172.21.15.7:0/57558649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7fc15bf80 0x7fa7fc15c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.057+0000 7fa802b7e640 1 --2- 172.21.15.7:0/57558649 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa7fc1f3d40 0x7fa7fc1f2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.057+0000 7fa802b7e640 1 --2- 172.21.15.7:0/57558649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7ec004d40 0x7fa7fc0c9ae0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.057+0000 7fa802b7e640 1 -- 172.21.15.7:0/57558649 >> 172.21.15.7:0/57558649 conn(0x7fa7fc072290 msgr2=0x7fa7fc153df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:36.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.058+0000 7fa802b7e640 1 -- 172.21.15.7:0/57558649 shutdown_connections 2024-04-25T09:55:36.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.058+0000 7fa802b7e640 1 -- 172.21.15.7:0/57558649 wait complete. 2024-04-25T09:55:36.072 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:55:36.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.169+0000 7f9c777a5640 1 Processor -- start 2024-04-25T09:55:36.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.170+0000 7f9c777a5640 1 -- start start 2024-04-25T09:55:36.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.170+0000 7f9c777a5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9c7015db00 0x7f9c700d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:36.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.170+0000 7f9c777a5640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9c700b53b0 0x7f9c700d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:36.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.170+0000 7f9c777a5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9c700ce2b0 0x7f9c70161670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:36.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.170+0000 7f9c777a5640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c700d1e80 con 0x7f9c700b53b0 2024-04-25T09:55:36.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.170+0000 7f9c777a5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c700b5930 con 0x7f9c700ce2b0 2024-04-25T09:55:36.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.170+0000 7f9c777a5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c700b5c10 con 0x7f9c7015db00 2024-04-25T09:55:36.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.170+0000 7f9c74d40640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9c700b53b0 0x7f9c700d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:36.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.171+0000 7f9c74d40640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9c700b53b0 0x7f9c700d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42150/0 (socket says 172.21.15.7:42150) 2024-04-25T09:55:36.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.171+0000 7f9c74d40640 1 -- 172.21.15.7:0/3836441275 learned_addr learned my addr 172.21.15.7:0/3836441275 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:36.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.171+0000 7f9c75541640 1 --2- 172.21.15.7:0/3836441275 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9c7015db00 0x7f9c700d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:36.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.171+0000 7f9c75d42640 1 --2- 172.21.15.7:0/3836441275 >> v2:172.21.15.55:3300/0 conn(0x7f9c700ce2b0 0x7f9c70161670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:36.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.171+0000 7f9c74d40640 1 -- 172.21.15.7:0/3836441275 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9c7015db00 msgr2=0x7f9c700d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:36.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.171+0000 7f9c74d40640 1 --2- 172.21.15.7:0/3836441275 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9c7015db00 0x7f9c700d0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.171+0000 7f9c74d40640 1 -- 172.21.15.7:0/3836441275 >> v2:172.21.15.55:3300/0 conn(0x7f9c700ce2b0 msgr2=0x7f9c70161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:36.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.171+0000 7f9c74d40640 1 --2- 172.21.15.7:0/3836441275 >> v2:172.21.15.55:3300/0 conn(0x7f9c700ce2b0 0x7f9c70161670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.171+0000 7f9c74d40640 1 -- 172.21.15.7:0/3836441275 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c700b5ef0 con 0x7f9c700b53b0 2024-04-25T09:55:36.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.171+0000 7f9c74d40640 1 --2- 172.21.15.7:0/3836441275 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c700b53b0 0x7f9c700d0880 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9c700ce010 tx=0x7f9c6002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1bb671985f1417e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:36.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.172+0000 7f9c67fff640 1 -- 172.21.15.7:0/3836441275 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c60037070 con 0x7f9c700b53b0 2024-04-25T09:55:36.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.172+0000 7f9c67fff640 1 -- 172.21.15.7:0/3836441275 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c60032440 con 0x7f9c700b53b0 2024-04-25T09:55:36.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.172+0000 7f9c67fff640 1 -- 172.21.15.7:0/3836441275 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c60032810 con 0x7f9c700b53b0 2024-04-25T09:55:36.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.172+0000 7f9c777a5640 1 -- 172.21.15.7:0/3836441275 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c700b53b0 msgr2=0x7f9c700d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:36.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.172+0000 7f9c777a5640 1 --2- 172.21.15.7:0/3836441275 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c700b53b0 0x7f9c700d0880 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9c700ce010 tx=0x7f9c6002a1e0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.172+0000 7f9c777a5640 1 -- 172.21.15.7:0/3836441275 shutdown_connections 2024-04-25T09:55:36.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.172+0000 7f9c777a5640 1 --2- 172.21.15.7:0/3836441275 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c700b53b0 0x7f9c700d0880 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.172+0000 7f9c777a5640 1 --2- 172.21.15.7:0/3836441275 >> v2:172.21.15.55:3300/0 conn(0x7f9c700ce2b0 0x7f9c70161670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.172+0000 7f9c777a5640 1 --2- 172.21.15.7:0/3836441275 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9c7015db00 0x7f9c700d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.172+0000 7f9c777a5640 1 -- 172.21.15.7:0/3836441275 >> 172.21.15.7:0/3836441275 conn(0x7f9c70072290 msgr2=0x7f9c700726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:36.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.172+0000 7f9c777a5640 1 -- 172.21.15.7:0/3836441275 shutdown_connections 2024-04-25T09:55:36.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.172+0000 7f9c777a5640 1 -- 172.21.15.7:0/3836441275 wait complete. 2024-04-25T09:55:36.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.173+0000 7f9c777a5640 1 Processor -- start 2024-04-25T09:55:36.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.173+0000 7f9c777a5640 1 -- start start 2024-04-25T09:55:36.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.174+0000 7f9c777a5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c700b53b0 0x7f9c700cd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:36.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.174+0000 7f9c777a5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c700ce2b0 0x7f9c701601e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:36.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.174+0000 7f9c777a5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9c7015db00 0x7f9c70143f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:36.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.174+0000 7f9c777a5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c700d3660 con 0x7f9c700ce2b0 2024-04-25T09:55:36.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.174+0000 7f9c777a5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c700b61d0 con 0x7f9c700b53b0 2024-04-25T09:55:36.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.174+0000 7f9c777a5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c700b6c10 con 0x7f9c7015db00 2024-04-25T09:55:36.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.174+0000 7f9c74d40640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c700ce2b0 0x7f9c701601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:36.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.174+0000 7f9c74d40640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c700ce2b0 0x7f9c701601e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42166/0 (socket says 172.21.15.7:42166) 2024-04-25T09:55:36.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.174+0000 7f9c74d40640 1 -- 172.21.15.7:0/884512245 learned_addr learned my addr 172.21.15.7:0/884512245 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:36.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.174+0000 7f9c75541640 1 --2- 172.21.15.7:0/884512245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c700b53b0 0x7f9c700cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:36.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.174+0000 7f9c75d42640 1 --2- 172.21.15.7:0/884512245 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9c7015db00 0x7f9c70143f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:36.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.175+0000 7f9c74d40640 1 -- 172.21.15.7:0/884512245 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9c7015db00 msgr2=0x7f9c70143f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:36.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.175+0000 7f9c74d40640 1 --2- 172.21.15.7:0/884512245 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9c7015db00 0x7f9c70143f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.175+0000 7f9c74d40640 1 -- 172.21.15.7:0/884512245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c700b53b0 msgr2=0x7f9c700cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:36.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.175+0000 7f9c74d40640 1 --2- 172.21.15.7:0/884512245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c700b53b0 0x7f9c700cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.175+0000 7f9c74d40640 1 -- 172.21.15.7:0/884512245 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c701f3770 con 0x7f9c700ce2b0 2024-04-25T09:55:36.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.175+0000 7f9c74d40640 1 --2- 172.21.15.7:0/884512245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c700ce2b0 0x7f9c701601e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9c60000c00 tx=0x7f9c600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:36.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.175+0000 7f9c65ffb640 1 -- 172.21.15.7:0/884512245 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c60041070 con 0x7f9c700ce2b0 2024-04-25T09:55:36.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.175+0000 7f9c65ffb640 1 -- 172.21.15.7:0/884512245 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6003c870 con 0x7f9c700ce2b0 2024-04-25T09:55:36.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.175+0000 7f9c777a5640 1 -- 172.21.15.7:0/884512245 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c7015f140 con 0x7f9c700ce2b0 2024-04-25T09:55:36.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.175+0000 7f9c65ffb640 1 -- 172.21.15.7:0/884512245 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c60037040 con 0x7f9c700ce2b0 2024-04-25T09:55:36.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.175+0000 7f9c777a5640 1 -- 172.21.15.7:0/884512245 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c7015f700 con 0x7f9c700ce2b0 2024-04-25T09:55:36.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.176+0000 7f9c777a5640 1 -- 172.21.15.7:0/884512245 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c70068fd0 con 0x7f9c700ce2b0 2024-04-25T09:55:36.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.177+0000 7f9c65ffb640 1 -- 172.21.15.7:0/884512245 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9c60044070 con 0x7f9c700ce2b0 2024-04-25T09:55:36.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.177+0000 7f9c65ffb640 1 --2- 172.21.15.7:0/884512245 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9c5406b4d0 0x7f9c5406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:36.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.177+0000 7f9c65ffb640 1 -- 172.21.15.7:0/884512245 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9c600aaf00 con 0x7f9c700ce2b0 2024-04-25T09:55:36.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.177+0000 7f9c75541640 1 --2- 172.21.15.7:0/884512245 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9c5406b4d0 0x7f9c5406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:36.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.178+0000 7f9c75541640 1 --2- 172.21.15.7:0/884512245 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9c5406b4d0 0x7f9c5406d990 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c00a9a0 tx=0x7f9c6c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:36.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.181+0000 7f9c65ffb640 1 -- 172.21.15.7:0/884512245 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9c60079590 con 0x7f9c700ce2b0 2024-04-25T09:55:36.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.362+0000 7f9c777a5640 1 -- 172.21.15.7:0/884512245 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c700d16b0 con 0x7f9c700ce2b0 2024-04-25T09:55:36.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.363+0000 7f9c65ffb640 1 -- 172.21.15.7:0/884512245 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16859 (secure 0 0 0) 0x7f9c6007d630 con 0x7f9c700ce2b0 2024-04-25T09:55:36.366 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:36.366 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":38,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:55:35.091647+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:55:33.644089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T09:55:34.059847+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:55:36.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.365+0000 7f9c777a5640 1 -- 172.21.15.7:0/884512245 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9c5406b4d0 msgr2=0x7f9c5406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:36.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.365+0000 7f9c777a5640 1 --2- 172.21.15.7:0/884512245 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9c5406b4d0 0x7f9c5406d990 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c00a9a0 tx=0x7f9c6c008040 comp rx=0 tx=0).stop 2024-04-25T09:55:36.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.365+0000 7f9c777a5640 1 -- 172.21.15.7:0/884512245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c700ce2b0 msgr2=0x7f9c701601e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:36.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.365+0000 7f9c777a5640 1 --2- 172.21.15.7:0/884512245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c700ce2b0 0x7f9c701601e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9c60000c00 tx=0x7f9c600046c0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.365+0000 7f9c777a5640 1 -- 172.21.15.7:0/884512245 shutdown_connections 2024-04-25T09:55:36.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.365+0000 7f9c777a5640 1 --2- 172.21.15.7:0/884512245 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9c5406b4d0 0x7f9c5406d990 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.365+0000 7f9c777a5640 1 --2- 172.21.15.7:0/884512245 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9c7015db00 0x7f9c70143f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.365+0000 7f9c777a5640 1 --2- 172.21.15.7:0/884512245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c700ce2b0 0x7f9c701601e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.365+0000 7f9c777a5640 1 --2- 172.21.15.7:0/884512245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c700b53b0 0x7f9c700cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.365+0000 7f9c777a5640 1 -- 172.21.15.7:0/884512245 >> 172.21.15.7:0/884512245 conn(0x7f9c70072290 msgr2=0x7f9c700c7540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:36.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.365+0000 7f9c777a5640 1 -- 172.21.15.7:0/884512245 shutdown_connections 2024-04-25T09:55:36.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.365+0000 7f9c777a5640 1 -- 172.21.15.7:0/884512245 wait complete. 2024-04-25T09:55:36.379 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:55:36.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.480+0000 7fb35f729640 1 Processor -- start 2024-04-25T09:55:36.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.480+0000 7fb35f729640 1 -- start start 2024-04-25T09:55:36.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.480+0000 7fb35f729640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb3580d07c0 0x7fb3580b9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:36.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.480+0000 7fb35f729640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb35815de50 0x7fb3580d1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:36.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.481+0000 7fb35f729640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb3580d0ba0 0x7fb3580d37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:36.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.481+0000 7fb35f729640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3580d2320 con 0x7fb3580d0ba0 2024-04-25T09:55:36.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.481+0000 7fb35f729640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3580d2600 con 0x7fb3580d07c0 2024-04-25T09:55:36.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.481+0000 7fb35f729640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3580d28e0 con 0x7fb35815de50 2024-04-25T09:55:36.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.481+0000 7fb35dcc6640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb3580d0ba0 0x7fb3580d37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:36.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.481+0000 7fb35dcc6640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb3580d0ba0 0x7fb3580d37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42176/0 (socket says 172.21.15.7:42176) 2024-04-25T09:55:36.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.481+0000 7fb35dcc6640 1 -- 172.21.15.7:0/2198883716 learned_addr learned my addr 172.21.15.7:0/2198883716 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:36.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.481+0000 7fb35d4c5640 1 --2- 172.21.15.7:0/2198883716 >> v2:172.21.15.55:3300/0 conn(0x7fb3580d07c0 0x7fb3580b9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:36.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.481+0000 7fb35ccc4640 1 --2- 172.21.15.7:0/2198883716 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb35815de50 0x7fb3580d1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:36.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.481+0000 7fb35dcc6640 1 -- 172.21.15.7:0/2198883716 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb35815de50 msgr2=0x7fb3580d1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:36.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.481+0000 7fb35dcc6640 1 --2- 172.21.15.7:0/2198883716 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb35815de50 0x7fb3580d1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.481+0000 7fb35dcc6640 1 -- 172.21.15.7:0/2198883716 >> v2:172.21.15.55:3300/0 conn(0x7fb3580d07c0 msgr2=0x7fb3580b9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:36.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.481+0000 7fb35dcc6640 1 --2- 172.21.15.7:0/2198883716 >> v2:172.21.15.55:3300/0 conn(0x7fb3580d07c0 0x7fb3580b9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.481+0000 7fb35dcc6640 1 -- 172.21.15.7:0/2198883716 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3580d2bc0 con 0x7fb3580d0ba0 2024-04-25T09:55:36.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.482+0000 7fb35dcc6640 1 --2- 172.21.15.7:0/2198883716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3580d0ba0 0x7fb3580d37e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb3580b5940 tx=0x7fb35002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f4f0b79dfed1f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:36.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.482+0000 7fb34ffff640 1 -- 172.21.15.7:0/2198883716 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb350036070 con 0x7fb3580d0ba0 2024-04-25T09:55:36.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.482+0000 7fb34ffff640 1 -- 172.21.15.7:0/2198883716 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb350031600 con 0x7fb3580d0ba0 2024-04-25T09:55:36.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.482+0000 7fb34ffff640 1 -- 172.21.15.7:0/2198883716 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3500319d0 con 0x7fb3580d0ba0 2024-04-25T09:55:36.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.482+0000 7fb35f729640 1 -- 172.21.15.7:0/2198883716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3580d0ba0 msgr2=0x7fb3580d37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:36.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.482+0000 7fb35f729640 1 --2- 172.21.15.7:0/2198883716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3580d0ba0 0x7fb3580d37e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb3580b5940 tx=0x7fb35002a6a0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.483+0000 7fb35f729640 1 -- 172.21.15.7:0/2198883716 shutdown_connections 2024-04-25T09:55:36.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.483+0000 7fb35f729640 1 --2- 172.21.15.7:0/2198883716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3580d0ba0 0x7fb3580d37e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.483+0000 7fb35f729640 1 --2- 172.21.15.7:0/2198883716 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb35815de50 0x7fb3580d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.483+0000 7fb35f729640 1 --2- 172.21.15.7:0/2198883716 >> v2:172.21.15.55:3300/0 conn(0x7fb3580d07c0 0x7fb3580b9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.483+0000 7fb35f729640 1 -- 172.21.15.7:0/2198883716 >> 172.21.15.7:0/2198883716 conn(0x7fb3580726b0 msgr2=0x7fb358072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:36.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.483+0000 7fb35f729640 1 -- 172.21.15.7:0/2198883716 shutdown_connections 2024-04-25T09:55:36.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.483+0000 7fb35f729640 1 -- 172.21.15.7:0/2198883716 wait complete. 2024-04-25T09:55:36.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.484+0000 7fb35f729640 1 Processor -- start 2024-04-25T09:55:36.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.484+0000 7fb35f729640 1 -- start start 2024-04-25T09:55:36.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.484+0000 7fb35f729640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3580d07c0 0x7fb35815a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:36.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.485+0000 7fb35f729640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3580d0ba0 0x7fb3581511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:36.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.485+0000 7fb35f729640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb35815de50 0x7fb3581516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:36.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.485+0000 7fb35f729640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3580d33c0 con 0x7fb3580d0ba0 2024-04-25T09:55:36.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.485+0000 7fb35f729640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3580d1010 con 0x7fb35815de50 2024-04-25T09:55:36.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.485+0000 7fb35f729640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3580c7ff0 con 0x7fb3580d07c0 2024-04-25T09:55:36.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.485+0000 7fb35ccc4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3580d0ba0 0x7fb3581511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:36.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.485+0000 7fb35ccc4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3580d0ba0 0x7fb3581511b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42188/0 (socket says 172.21.15.7:42188) 2024-04-25T09:55:36.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.485+0000 7fb35ccc4640 1 -- 172.21.15.7:0/780636318 learned_addr learned my addr 172.21.15.7:0/780636318 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:36.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.485+0000 7fb35dcc6640 1 --2- 172.21.15.7:0/780636318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb35815de50 0x7fb3581516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:36.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.485+0000 7fb35ccc4640 1 -- 172.21.15.7:0/780636318 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3580d07c0 msgr2=0x7fb35815a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:36.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.485+0000 7fb35ccc4640 1 --2- 172.21.15.7:0/780636318 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3580d07c0 0x7fb35815a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.485+0000 7fb35ccc4640 1 -- 172.21.15.7:0/780636318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb35815de50 msgr2=0x7fb3581516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:36.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.485+0000 7fb35ccc4640 1 --2- 172.21.15.7:0/780636318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb35815de50 0x7fb3581516f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.485+0000 7fb35ccc4640 1 -- 172.21.15.7:0/780636318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb358152ae0 con 0x7fb3580d0ba0 2024-04-25T09:55:36.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.485+0000 7fb35ccc4640 1 --2- 172.21.15.7:0/780636318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3580d0ba0 0x7fb3581511b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb34800e870 tx=0x7fb34800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:36.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.485+0000 7fb34dffb640 1 -- 172.21.15.7:0/780636318 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb348017070 con 0x7fb3580d0ba0 2024-04-25T09:55:36.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.485+0000 7fb34dffb640 1 -- 172.21.15.7:0/780636318 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34800c940 con 0x7fb3580d0ba0 2024-04-25T09:55:36.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.485+0000 7fb35f729640 1 -- 172.21.15.7:0/780636318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb358154750 con 0x7fb3580d0ba0 2024-04-25T09:55:36.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.485+0000 7fb34dffb640 1 -- 172.21.15.7:0/780636318 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34800cd30 con 0x7fb3580d0ba0 2024-04-25T09:55:36.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.485+0000 7fb35f729640 1 -- 172.21.15.7:0/780636318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb358154d10 con 0x7fb3580d0ba0 2024-04-25T09:55:36.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.487+0000 7fb35f729640 1 -- 172.21.15.7:0/780636318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb358073ce0 con 0x7fb3580d0ba0 2024-04-25T09:55:36.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.487+0000 7fb34dffb640 1 -- 172.21.15.7:0/780636318 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb34801a070 con 0x7fb3580d0ba0 2024-04-25T09:55:36.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.487+0000 7fb34dffb640 1 --2- 172.21.15.7:0/780636318 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb33c06b4d0 0x7fb33c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:36.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.488+0000 7fb34dffb640 1 -- 172.21.15.7:0/780636318 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb34808a6b0 con 0x7fb3580d0ba0 2024-04-25T09:55:36.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.488+0000 7fb35d4c5640 1 --2- 172.21.15.7:0/780636318 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb33c06b4d0 0x7fb33c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:36.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.488+0000 7fb35d4c5640 1 --2- 172.21.15.7:0/780636318 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb33c06b4d0 0x7fb33c06d990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb354009a40 tx=0x7fb354009500 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:36.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.492+0000 7fb34dffb640 1 -- 172.21.15.7:0/780636318 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb358073ce0 con 0x7fb3580d0ba0 2024-04-25T09:55:36.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.713+0000 7fb35f729640 1 -- 172.21.15.7:0/780636318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb358068f60 con 0x7fb3580d0ba0 2024-04-25T09:55:36.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.747+0000 7fb34dffb640 1 -- 172.21.15.7:0/780636318 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb358152ae0 con 0x7fb3580d0ba0 2024-04-25T09:55:36.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.750+0000 7fb35f729640 1 -- 172.21.15.7:0/780636318 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb33c06b4d0 msgr2=0x7fb33c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:36.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.750+0000 7fb35f729640 1 --2- 172.21.15.7:0/780636318 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb33c06b4d0 0x7fb33c06d990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb354009a40 tx=0x7fb354009500 comp rx=0 tx=0).stop 2024-04-25T09:55:36.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.750+0000 7fb35f729640 1 -- 172.21.15.7:0/780636318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3580d0ba0 msgr2=0x7fb3581511b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:36.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.750+0000 7fb35f729640 1 --2- 172.21.15.7:0/780636318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3580d0ba0 0x7fb3581511b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb34800e870 tx=0x7fb34800ed30 comp rx=0 tx=0).stop 2024-04-25T09:55:36.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.750+0000 7fb35f729640 1 -- 172.21.15.7:0/780636318 shutdown_connections 2024-04-25T09:55:36.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.750+0000 7fb35f729640 1 --2- 172.21.15.7:0/780636318 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb33c06b4d0 0x7fb33c06d990 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.750+0000 7fb35f729640 1 --2- 172.21.15.7:0/780636318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb35815de50 0x7fb3581516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.750+0000 7fb35f729640 1 --2- 172.21.15.7:0/780636318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3580d0ba0 0x7fb3581511b0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.750+0000 7fb35f729640 1 --2- 172.21.15.7:0/780636318 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3580d07c0 0x7fb35815a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.750+0000 7fb35f729640 1 -- 172.21.15.7:0/780636318 >> 172.21.15.7:0/780636318 conn(0x7fb3580726b0 msgr2=0x7fb3580b6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:36.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.750+0000 7fb35f729640 1 -- 172.21.15.7:0/780636318 shutdown_connections 2024-04-25T09:55:36.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.750+0000 7fb35f729640 1 -- 172.21.15.7:0/780636318 wait complete. 2024-04-25T09:55:36.764 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:55:36.764 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:55:36.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.865+0000 7ff77139d640 1 Processor -- start 2024-04-25T09:55:36.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.865+0000 7ff77139d640 1 -- start start 2024-04-25T09:55:36.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.866+0000 7ff77139d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff76c0d3760 0x7ff76c15eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:36.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.866+0000 7ff77139d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff76c15f1c0 0x7ff76c0d3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:36.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.866+0000 7ff77139d640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff76c0d4080 con 0x7ff76c0ce830 2024-04-25T09:55:36.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.866+0000 7ff77139d640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff76c0ce380 con 0x7ff76c0d3760 2024-04-25T09:55:36.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.866+0000 7ff77139d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff76c15f000 con 0x7ff76c15f1c0 2024-04-25T09:55:36.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.866+0000 7ff76b7fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff76c0ce830 0x7ff76c0b2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40574/0 (socket says 172.21.15.7:40574) 2024-04-25T09:55:36.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.866+0000 7ff76affd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff76c0d3760 0x7ff76c15eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:36.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.866+0000 7ff76b7fe640 1 -- 172.21.15.7:0/2656588210 learned_addr learned my addr 172.21.15.7:0/2656588210 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:36.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.866+0000 7ff76a7fc640 1 --2- 172.21.15.7:0/2656588210 >> v2:172.21.15.55:3300/0 conn(0x7ff76c15f1c0 0x7ff76c0d3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:36.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.866+0000 7ff76affd640 1 -- 172.21.15.7:0/2656588210 >> v2:172.21.15.55:3300/0 conn(0x7ff76c15f1c0 msgr2=0x7ff76c0d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:36.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.866+0000 7ff76affd640 1 --2- 172.21.15.7:0/2656588210 >> v2:172.21.15.55:3300/0 conn(0x7ff76c15f1c0 0x7ff76c0d3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.866+0000 7ff76affd640 1 -- 172.21.15.7:0/2656588210 >> v1:172.21.15.7:6789/0 conn(0x7ff76c0ce830 legacy=0x7ff76c0b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:36.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.866+0000 7ff76affd640 1 -- 172.21.15.7:0/2656588210 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76c0ced10 con 0x7ff76c0d3760 2024-04-25T09:55:36.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.866+0000 7ff769ffb640 1 -- 172.21.15.7:0/2656588210 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 964679154 0 0) 0x7ff76c0d4080 con 0x7ff76c0ce830 2024-04-25T09:55:36.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.867+0000 7ff76affd640 1 --2- 172.21.15.7:0/2656588210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff76c0d3760 0x7ff76c15eac0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0b9830 tx=0x7ff75c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=713843ed8507e788 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:36.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.867+0000 7ff769ffb640 1 -- 172.21.15.7:0/2656588210 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c037070 con 0x7ff76c0d3760 2024-04-25T09:55:36.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.867+0000 7ff769ffb640 1 -- 172.21.15.7:0/2656588210 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75c032440 con 0x7ff76c0d3760 2024-04-25T09:55:36.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.867+0000 7ff769ffb640 1 -- 172.21.15.7:0/2656588210 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c032810 con 0x7ff76c0d3760 2024-04-25T09:55:36.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.867+0000 7ff77139d640 1 -- 172.21.15.7:0/2656588210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff76c0d3760 msgr2=0x7ff76c15eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:36.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.867+0000 7ff77139d640 1 --2- 172.21.15.7:0/2656588210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff76c0d3760 0x7ff76c15eac0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0b9830 tx=0x7ff75c02a1a0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.868+0000 7ff77139d640 1 -- 172.21.15.7:0/2656588210 shutdown_connections 2024-04-25T09:55:36.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.868+0000 7ff77139d640 1 --2- 172.21.15.7:0/2656588210 >> v2:172.21.15.55:3300/0 conn(0x7ff76c15f1c0 0x7ff76c0d3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.868+0000 7ff77139d640 1 --2- 172.21.15.7:0/2656588210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff76c0d3760 0x7ff76c15eac0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.868+0000 7ff77139d640 1 -- 172.21.15.7:0/2656588210 >> 172.21.15.7:0/2656588210 conn(0x7ff76c072680 msgr2=0x7ff76c072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:36.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.868+0000 7ff77139d640 1 -- 172.21.15.7:0/2656588210 shutdown_connections 2024-04-25T09:55:36.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.868+0000 7ff77139d640 1 -- 172.21.15.7:0/2656588210 wait complete. 2024-04-25T09:55:36.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.869+0000 7ff77139d640 1 Processor -- start 2024-04-25T09:55:36.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.869+0000 7ff77139d640 1 -- start start 2024-04-25T09:55:36.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.870+0000 7ff77139d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff76c0ce830 0x7ff76c1e8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:36.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.870+0000 7ff77139d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff76c0d3760 0x7ff76c0c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:36.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.870+0000 7ff77139d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff76c15f1c0 0x7ff76c1e9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:36.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.870+0000 7ff77139d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c0d1e20 con 0x7ff76c15f1c0 2024-04-25T09:55:36.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.870+0000 7ff77139d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c0d2190 con 0x7ff76c0ce830 2024-04-25T09:55:36.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.870+0000 7ff77139d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c15de10 con 0x7ff76c0d3760 2024-04-25T09:55:36.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.870+0000 7ff76b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff76c15f1c0 0x7ff76c1e9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:36.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.870+0000 7ff76b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff76c15f1c0 0x7ff76c1e9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42202/0 (socket says 172.21.15.7:42202) 2024-04-25T09:55:36.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.870+0000 7ff76b7fe640 1 -- 172.21.15.7:0/2340243125 learned_addr learned my addr 172.21.15.7:0/2340243125 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:36.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.870+0000 7ff76affd640 1 --2- 172.21.15.7:0/2340243125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff76c0ce830 0x7ff76c1e8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:36.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.870+0000 7ff76b7fe640 1 -- 172.21.15.7:0/2340243125 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff76c0d3760 msgr2=0x7ff76c0c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:36.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.870+0000 7ff76b7fe640 1 --2- 172.21.15.7:0/2340243125 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff76c0d3760 0x7ff76c0c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.870+0000 7ff76b7fe640 1 -- 172.21.15.7:0/2340243125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff76c0ce830 msgr2=0x7ff76c1e8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:36.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.870+0000 7ff76b7fe640 1 --2- 172.21.15.7:0/2340243125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff76c0ce830 0x7ff76c1e8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:36.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.870+0000 7ff76b7fe640 1 -- 172.21.15.7:0/2340243125 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76c0c9b40 con 0x7ff76c15f1c0 2024-04-25T09:55:36.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.870+0000 7ff76b7fe640 1 --2- 172.21.15.7:0/2340243125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff76c15f1c0 0x7ff76c1e9290 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff76400c760 tx=0x7ff76400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:36.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.870+0000 7ff7537fe640 1 -- 172.21.15.7:0/2340243125 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff764018070 con 0x7ff76c15f1c0 2024-04-25T09:55:36.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.870+0000 7ff7537fe640 1 -- 172.21.15.7:0/2340243125 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76400a640 con 0x7ff76c15f1c0 2024-04-25T09:55:36.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.870+0000 7ff77139d640 1 -- 172.21.15.7:0/2340243125 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff76c0c8aa0 con 0x7ff76c15f1c0 2024-04-25T09:55:36.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.870+0000 7ff7537fe640 1 -- 172.21.15.7:0/2340243125 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76400aa30 con 0x7ff76c15f1c0 2024-04-25T09:55:36.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.871+0000 7ff77139d640 1 -- 172.21.15.7:0/2340243125 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff76c0c9060 con 0x7ff76c15f1c0 2024-04-25T09:55:36.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.871+0000 7ff77139d640 1 -- 172.21.15.7:0/2340243125 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff76c068f60 con 0x7ff76c15f1c0 2024-04-25T09:55:36.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.872+0000 7ff7537fe640 1 -- 172.21.15.7:0/2340243125 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff76401b070 con 0x7ff76c15f1c0 2024-04-25T09:55:36.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.872+0000 7ff7537fe640 1 --2- 172.21.15.7:0/2340243125 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff75806b500 0x7ff75806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:36.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.872+0000 7ff7537fe640 1 -- 172.21.15.7:0/2340243125 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff7640898f0 con 0x7ff76c15f1c0 2024-04-25T09:55:36.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.872+0000 7ff76affd640 1 --2- 172.21.15.7:0/2340243125 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff75806b500 0x7ff75806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:36.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.873+0000 7ff76affd640 1 --2- 172.21.15.7:0/2340243125 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff75806b500 0x7ff75806d9c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff75c034000 tx=0x7ff75c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:36.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:36.877+0000 7ff7537fe640 1 -- 172.21.15.7:0/2340243125 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff7640585e0 con 0x7ff76c15f1c0 2024-04-25T09:55:37.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.094+0000 7ff77139d640 1 -- 172.21.15.7:0/2340243125 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff76c072c70 con 0x7ff76c15f1c0 2024-04-25T09:55:37.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.757+0000 7ff7537fe640 1 -- 172.21.15.7:0/2340243125 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff764057ee0 con 0x7ff76c15f1c0 2024-04-25T09:55:37.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.760+0000 7ff77139d640 1 -- 172.21.15.7:0/2340243125 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff75806b500 msgr2=0x7ff75806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:37.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.760+0000 7ff77139d640 1 --2- 172.21.15.7:0/2340243125 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff75806b500 0x7ff75806d9c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff75c034000 tx=0x7ff75c02e000 comp rx=0 tx=0).stop 2024-04-25T09:55:37.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.760+0000 7ff77139d640 1 -- 172.21.15.7:0/2340243125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff76c15f1c0 msgr2=0x7ff76c1e9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:37.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.760+0000 7ff77139d640 1 --2- 172.21.15.7:0/2340243125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff76c15f1c0 0x7ff76c1e9290 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff76400c760 tx=0x7ff76400cc20 comp rx=0 tx=0).stop 2024-04-25T09:55:37.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.760+0000 7ff77139d640 1 -- 172.21.15.7:0/2340243125 shutdown_connections 2024-04-25T09:55:37.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.760+0000 7ff77139d640 1 --2- 172.21.15.7:0/2340243125 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff75806b500 0x7ff75806d9c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:37.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.760+0000 7ff77139d640 1 --2- 172.21.15.7:0/2340243125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff76c15f1c0 0x7ff76c1e9290 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:37.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.760+0000 7ff77139d640 1 --2- 172.21.15.7:0/2340243125 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff76c0d3760 0x7ff76c0c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:37.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.760+0000 7ff77139d640 1 --2- 172.21.15.7:0/2340243125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff76c0ce830 0x7ff76c1e8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:37.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.760+0000 7ff77139d640 1 -- 172.21.15.7:0/2340243125 >> 172.21.15.7:0/2340243125 conn(0x7ff76c072680 msgr2=0x7ff76c0b7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:37.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.760+0000 7ff77139d640 1 -- 172.21.15.7:0/2340243125 shutdown_connections 2024-04-25T09:55:37.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.760+0000 7ff77139d640 1 -- 172.21.15.7:0/2340243125 wait complete. 2024-04-25T09:55:37.776 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:55:37.777 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:55:37.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.881+0000 7f0aa2038640 1 Processor -- start 2024-04-25T09:55:37.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.881+0000 7f0aa2038640 1 -- start start 2024-04-25T09:55:37.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.882+0000 7f0aa2038640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0a9c06ab60 0x7f0a9c0b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:37.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.882+0000 7f0aa2038640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a9c0b5a20 con 0x7f0a9c0afc00 2024-04-25T09:55:37.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.882+0000 7f0aa2038640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a9c0b0160 con 0x7f0a9c15dc60 2024-04-25T09:55:37.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.882+0000 7f0aa2038640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a9c0b1310 con 0x7f0a9c06ab60 2024-04-25T09:55:37.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.882+0000 7f0a9bfff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0a9c0afc00 0x7f0a9c0b0c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40584/0 (socket says 172.21.15.7:40584) 2024-04-25T09:55:37.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.882+0000 7f0a9bfff640 1 -- 172.21.15.7:0/511119948 learned_addr learned my addr 172.21.15.7:0/511119948 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:37.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.883+0000 7f0a9b7fe640 1 --2- 172.21.15.7:0/511119948 >> v2:172.21.15.55:3300/0 conn(0x7f0a9c06ab60 0x7f0a9c0b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:37.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.883+0000 7f0a9a7fc640 1 -- 172.21.15.7:0/511119948 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2284085168 0 0) 0x7f0a9c0b5a20 con 0x7f0a9c0afc00 2024-04-25T09:55:37.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.883+0000 7f0a9a7fc640 1 -- 172.21.15.7:0/511119948 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a84003520 con 0x7f0a9c0afc00 2024-04-25T09:55:37.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.883+0000 7f0a9a7fc640 1 -- 172.21.15.7:0/511119948 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 755895665 0 0) 0x7f0a84003520 con 0x7f0a9c0afc00 2024-04-25T09:55:37.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.883+0000 7f0a9a7fc640 1 -- 172.21.15.7:0/511119948 >> v2:172.21.15.55:3300/0 conn(0x7f0a9c06ab60 msgr2=0x7f0a9c0b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:37.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.883+0000 7f0a9a7fc640 1 --2- 172.21.15.7:0/511119948 >> v2:172.21.15.55:3300/0 conn(0x7f0a9c06ab60 0x7f0a9c0b1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:37.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.883+0000 7f0a9a7fc640 1 -- 172.21.15.7:0/511119948 >> v1:172.21.15.55:6789/0 conn(0x7f0a9c15dc60 legacy=0x7f0a9c06af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:37.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.883+0000 7f0a9a7fc640 1 -- 172.21.15.7:0/511119948 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9c0b5740 con 0x7f0a9c0afc00 2024-04-25T09:55:37.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.883+0000 7f0a9a7fc640 1 -- 172.21.15.7:0/511119948 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f0a940019f0 con 0x7f0a9c0afc00 2024-04-25T09:55:37.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.883+0000 7f0a9a7fc640 1 -- 172.21.15.7:0/511119948 >> v1:172.21.15.7:6789/0 conn(0x7f0a9c0afc00 legacy=0x7f0a9c0b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:37.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.883+0000 7f0a9a7fc640 1 --2- 172.21.15.7:0/511119948 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a840039b0 0x7f0a84003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:37.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.883+0000 7f0a9a7fc640 1 --2- 172.21.15.7:0/511119948 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a84004800 0x7f0a84004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:37.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.883+0000 7f0a9a7fc640 1 --2- 172.21.15.7:0/511119948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a840052e0 0x7f0a8400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:37.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.883+0000 7f0a9a7fc640 1 -- 172.21.15.7:0/511119948 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c0b1310 con 0x7f0a840052e0 2024-04-25T09:55:37.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.883+0000 7f0a9a7fc640 1 -- 172.21.15.7:0/511119948 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8400c1b0 con 0x7f0a840039b0 2024-04-25T09:55:37.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.883+0000 7f0a9a7fc640 1 -- 172.21.15.7:0/511119948 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8400c3b0 con 0x7f0a84004800 2024-04-25T09:55:37.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.883+0000 7f0a9bfff640 1 --2- 172.21.15.7:0/511119948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a840052e0 0x7f0a8400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:37.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.883+0000 7f0a9b7fe640 1 --2- 172.21.15.7:0/511119948 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a840039b0 0x7f0a84003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:37.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.883+0000 7f0a9affd640 1 --2- 172.21.15.7:0/511119948 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a84004800 0x7f0a84004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:37.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.884+0000 7f0a9bfff640 1 -- 172.21.15.7:0/511119948 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a84004800 msgr2=0x7f0a84004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:37.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.884+0000 7f0a9bfff640 1 --2- 172.21.15.7:0/511119948 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a84004800 0x7f0a84004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:37.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.884+0000 7f0a9bfff640 1 -- 172.21.15.7:0/511119948 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a840039b0 msgr2=0x7f0a84003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:37.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.884+0000 7f0a9bfff640 1 --2- 172.21.15.7:0/511119948 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a840039b0 0x7f0a84003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:37.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.884+0000 7f0a9bfff640 1 -- 172.21.15.7:0/511119948 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a84003520 con 0x7f0a840052e0 2024-04-25T09:55:37.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.884+0000 7f0a9affd640 1 --2- 172.21.15.7:0/511119948 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a84004800 0x7f0a84004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:37.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.884+0000 7f0a9bfff640 1 -- 172.21.15.7:0/511119948 reap_dead start 2024-04-25T09:55:37.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.884+0000 7f0a9bfff640 1 --2- 172.21.15.7:0/511119948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a840052e0 0x7f0a8400b9c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0a9400a440 tx=0x7f0a84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=169a1daa65bb2b9f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:37.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.884+0000 7f0a9a7fc640 1 -- 172.21.15.7:0/511119948 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9400a480 con 0x7f0a840052e0 2024-04-25T09:55:37.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.884+0000 7f0a9a7fc640 1 -- 172.21.15.7:0/511119948 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9403b630 con 0x7f0a840052e0 2024-04-25T09:55:37.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.884+0000 7f0a9a7fc640 1 -- 172.21.15.7:0/511119948 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9403ba20 con 0x7f0a840052e0 2024-04-25T09:55:37.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.885+0000 7f0aa2038640 1 -- 172.21.15.7:0/511119948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a840052e0 msgr2=0x7f0a8400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:37.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.885+0000 7f0aa2038640 1 --2- 172.21.15.7:0/511119948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a840052e0 0x7f0a8400b9c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0a9400a440 tx=0x7f0a84005830 comp rx=0 tx=0).stop 2024-04-25T09:55:37.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.885+0000 7f0aa2038640 1 -- 172.21.15.7:0/511119948 shutdown_connections 2024-04-25T09:55:37.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.885+0000 7f0aa2038640 1 --2- 172.21.15.7:0/511119948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a840052e0 0x7f0a8400b9c0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:37.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.885+0000 7f0aa2038640 1 -- 172.21.15.7:0/511119948 >> 172.21.15.7:0/511119948 conn(0x7f0a9c0b5c30 msgr2=0x7f0a9c0999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:37.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.885+0000 7f0aa2038640 1 -- 172.21.15.7:0/511119948 shutdown_connections 2024-04-25T09:55:37.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.885+0000 7f0aa2038640 1 -- 172.21.15.7:0/511119948 wait complete. 2024-04-25T09:55:37.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.886+0000 7f0aa2038640 1 Processor -- start 2024-04-25T09:55:37.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.887+0000 7f0aa2038640 1 -- start start 2024-04-25T09:55:37.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.887+0000 7f0aa2038640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a840052e0 0x7f0a9c15e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:37.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.887+0000 7f0aa2038640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a9c14f4c0 0x7f0a9c14e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.887+0000 7f0aa2038640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a9c14eb10 0x7f0a9c150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.887+0000 7f0aa2038640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c0b53e0 con 0x7f0a9c14f4c0 2024-04-25T09:55:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.887+0000 7f0aa2038640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c0b5260 con 0x7f0a840052e0 2024-04-25T09:55:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.887+0000 7f0aa2038640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c0b1ba0 con 0x7f0a9c14eb10 2024-04-25T09:55:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.887+0000 7f0a9affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a9c14f4c0 0x7f0a9c14e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.887+0000 7f0a9affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a9c14f4c0 0x7f0a9c14e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42222/0 (socket says 172.21.15.7:42222) 2024-04-25T09:55:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.887+0000 7f0a9affd640 1 -- 172.21.15.7:0/500886189 learned_addr learned my addr 172.21.15.7:0/500886189 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.887+0000 7f0a9b7fe640 1 --2- 172.21.15.7:0/500886189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a840052e0 0x7f0a9c15e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.888+0000 7f0a9bfff640 1 --2- 172.21.15.7:0/500886189 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a9c14eb10 0x7f0a9c150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.888+0000 7f0a9affd640 1 -- 172.21.15.7:0/500886189 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a9c14eb10 msgr2=0x7f0a9c150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.888+0000 7f0a9affd640 1 --2- 172.21.15.7:0/500886189 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a9c14eb10 0x7f0a9c150ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.888+0000 7f0a9affd640 1 -- 172.21.15.7:0/500886189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a840052e0 msgr2=0x7f0a9c15e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.888+0000 7f0a9affd640 1 --2- 172.21.15.7:0/500886189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a840052e0 0x7f0a9c15e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.888+0000 7f0a9affd640 1 -- 172.21.15.7:0/500886189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9c14f0d0 con 0x7f0a9c14f4c0 2024-04-25T09:55:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.888+0000 7f0a9bfff640 1 --2- 172.21.15.7:0/500886189 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a9c14eb10 0x7f0a9c150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:37.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.888+0000 7f0a9affd640 1 --2- 172.21.15.7:0/500886189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a9c14f4c0 0x7f0a9c14e2f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0a90000c00 tx=0x7f0a9000e830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:37.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.888+0000 7f0a83fff640 1 -- 172.21.15.7:0/500886189 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a90019070 con 0x7f0a9c14f4c0 2024-04-25T09:55:37.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.888+0000 7f0a83fff640 1 -- 172.21.15.7:0/500886189 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a900052e0 con 0x7f0a9c14f4c0 2024-04-25T09:55:37.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.888+0000 7f0a83fff640 1 -- 172.21.15.7:0/500886189 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a90003830 con 0x7f0a9c14f4c0 2024-04-25T09:55:37.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.888+0000 7f0aa2038640 1 -- 172.21.15.7:0/500886189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a9c15fbb0 con 0x7f0a9c14f4c0 2024-04-25T09:55:37.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.888+0000 7f0aa2038640 1 -- 172.21.15.7:0/500886189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a9c160170 con 0x7f0a9c14f4c0 2024-04-25T09:55:37.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.889+0000 7f0aa2038640 1 -- 172.21.15.7:0/500886189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a9c068fd0 con 0x7f0a9c14f4c0 2024-04-25T09:55:37.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.890+0000 7f0a83fff640 1 -- 172.21.15.7:0/500886189 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0a9001c070 con 0x7f0a9c14f4c0 2024-04-25T09:55:37.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.890+0000 7f0a83fff640 1 --2- 172.21.15.7:0/500886189 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0a8806b4d0 0x7f0a8806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:37.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.890+0000 7f0a83fff640 1 -- 172.21.15.7:0/500886189 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0a90089810 con 0x7f0a9c14f4c0 2024-04-25T09:55:37.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.890+0000 7f0a9b7fe640 1 --2- 172.21.15.7:0/500886189 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0a8806b4d0 0x7f0a8806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:37.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.890+0000 7f0a9b7fe640 1 --2- 172.21.15.7:0/500886189 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0a8806b4d0 0x7f0a8806d990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c009b40 tx=0x7f0a8c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:37.894+0000 7f0a83fff640 1 -- 172.21.15.7:0/500886189 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0a90057eb0 con 0x7f0a9c14f4c0 2024-04-25T09:55:38.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.112+0000 7f0aa2038640 1 -- 172.21.15.7:0/500886189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a9c159610 con 0x7f0a9c14f4c0 2024-04-25T09:55:38.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.113+0000 7f0a83fff640 1 -- 172.21.15.7:0/500886189 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4929 (secure 0 0 0) 0x7f0a9005bf50 con 0x7f0a9c14f4c0 2024-04-25T09:55:38.116 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:38.116 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5047,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2022061608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2022061608},{"type":"v1","addr":"172.21.15.55:6834","nonce":2022061608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5382,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/2607466795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2607466795},{"type":"v1","addr":"172.21.15.7:6836","nonce":2607466795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5385,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1576325055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1576325055},{"type":"v1","addr":"172.21.15.7:6837","nonce":1576325055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:55:35.091962+0000","modified":"2024-04-25T09:55:37.095949+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5391":{"gid":5391,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/223801838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":223801838},{"type":"v1","addr":"172.21.15.55:6835","nonce":223801838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T09:55:38.116 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 15 2024-04-25T09:55:38.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.115+0000 7f0aa2038640 1 -- 172.21.15.7:0/500886189 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0a8806b4d0 msgr2=0x7f0a8806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:38.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.115+0000 7f0aa2038640 1 --2- 172.21.15.7:0/500886189 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0a8806b4d0 0x7f0a8806d990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c009b40 tx=0x7f0a8c009190 comp rx=0 tx=0).stop 2024-04-25T09:55:38.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.115+0000 7f0aa2038640 1 -- 172.21.15.7:0/500886189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a9c14f4c0 msgr2=0x7f0a9c14e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:38.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.115+0000 7f0aa2038640 1 --2- 172.21.15.7:0/500886189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a9c14f4c0 0x7f0a9c14e2f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0a90000c00 tx=0x7f0a9000e830 comp rx=0 tx=0).stop 2024-04-25T09:55:38.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.115+0000 7f0aa2038640 1 -- 172.21.15.7:0/500886189 shutdown_connections 2024-04-25T09:55:38.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.115+0000 7f0aa2038640 1 --2- 172.21.15.7:0/500886189 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0a8806b4d0 0x7f0a8806d990 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:38.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.115+0000 7f0aa2038640 1 --2- 172.21.15.7:0/500886189 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a9c14eb10 0x7f0a9c150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:38.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.115+0000 7f0aa2038640 1 --2- 172.21.15.7:0/500886189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a9c14f4c0 0x7f0a9c14e2f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:38.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.115+0000 7f0aa2038640 1 --2- 172.21.15.7:0/500886189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a840052e0 0x7f0a9c15e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:38.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.115+0000 7f0aa2038640 1 -- 172.21.15.7:0/500886189 >> 172.21.15.7:0/500886189 conn(0x7f0a9c0b5c30 msgr2=0x7f0a9c06af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:38.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.115+0000 7f0aa2038640 1 -- 172.21.15.7:0/500886189 shutdown_connections 2024-04-25T09:55:38.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.115+0000 7f0aa2038640 1 -- 172.21.15.7:0/500886189 wait complete. 2024-04-25T09:55:38.129 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:55:38.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.226+0000 7fa665dbd640 1 Processor -- start 2024-04-25T09:55:38.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.226+0000 7fa665dbd640 1 -- start start 2024-04-25T09:55:38.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.227+0000 7fa665dbd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa66015da20 0x7fa66009a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:38.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.227+0000 7fa665dbd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa66006c330 0x7fa66006c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:38.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.227+0000 7fa665dbd640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6600cfad0 con 0x7fa66006bc70 2024-04-25T09:55:38.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.227+0000 7fa665dbd640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6600d06e0 con 0x7fa66015da20 2024-04-25T09:55:38.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.227+0000 7fa665dbd640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa66009a940 con 0x7fa66006c330 2024-04-25T09:55:38.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.227+0000 7fa65f7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa66015da20 0x7fa66009a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:38.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.227+0000 7fa65f7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa66015da20 0x7fa66009a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42224/0 (socket says 172.21.15.7:42224) 2024-04-25T09:55:38.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.227+0000 7fa65f7fe640 1 -- 172.21.15.7:0/2802685165 learned_addr learned my addr 172.21.15.7:0/2802685165 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:38.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.228+0000 7fa65ffff640 1 --2- 172.21.15.7:0/2802685165 >> v2:172.21.15.55:3300/0 conn(0x7fa66006c330 0x7fa66006c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:38.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.228+0000 7fa65f7fe640 1 -- 172.21.15.7:0/2802685165 >> v2:172.21.15.55:3300/0 conn(0x7fa66006c330 msgr2=0x7fa66006c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:38.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.228+0000 7fa65f7fe640 1 --2- 172.21.15.7:0/2802685165 >> v2:172.21.15.55:3300/0 conn(0x7fa66006c330 0x7fa66006c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:38.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.228+0000 7fa65f7fe640 1 -- 172.21.15.7:0/2802685165 >> v1:172.21.15.55:6789/0 conn(0x7fa66006bc70 legacy=0x7fa6600d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:38.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.228+0000 7fa65f7fe640 1 -- 172.21.15.7:0/2802685165 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6600cfdb0 con 0x7fa66015da20 2024-04-25T09:55:38.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.228+0000 7fa65f7fe640 1 --2- 172.21.15.7:0/2802685165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa66015da20 0x7fa66009a400 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa66006f320 tx=0x7fa65002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa26a91f77babd54 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:38.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.228+0000 7fa65e7fc640 1 -- 172.21.15.7:0/2802685165 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa650037070 con 0x7fa66015da20 2024-04-25T09:55:38.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.229+0000 7fa65e7fc640 1 -- 172.21.15.7:0/2802685165 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa650032440 con 0x7fa66015da20 2024-04-25T09:55:38.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.229+0000 7fa65e7fc640 1 -- 172.21.15.7:0/2802685165 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa650032810 con 0x7fa66015da20 2024-04-25T09:55:38.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.229+0000 7fa665dbd640 1 -- 172.21.15.7:0/2802685165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa66015da20 msgr2=0x7fa66009a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:38.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.229+0000 7fa665dbd640 1 --2- 172.21.15.7:0/2802685165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa66015da20 0x7fa66009a400 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa66006f320 tx=0x7fa65002a230 comp rx=0 tx=0).stop 2024-04-25T09:55:38.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.229+0000 7fa665dbd640 1 -- 172.21.15.7:0/2802685165 shutdown_connections 2024-04-25T09:55:38.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.229+0000 7fa665dbd640 1 --2- 172.21.15.7:0/2802685165 >> v2:172.21.15.55:3300/0 conn(0x7fa66006c330 0x7fa66006c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:38.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.229+0000 7fa665dbd640 1 --2- 172.21.15.7:0/2802685165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa66015da20 0x7fa66009a400 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:38.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.229+0000 7fa665dbd640 1 -- 172.21.15.7:0/2802685165 >> 172.21.15.7:0/2802685165 conn(0x7fa6600d16f0 msgr2=0x7fa6600d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:38.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.229+0000 7fa665dbd640 1 -- 172.21.15.7:0/2802685165 shutdown_connections 2024-04-25T09:55:38.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.229+0000 7fa665dbd640 1 -- 172.21.15.7:0/2802685165 wait complete. 2024-04-25T09:55:38.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.230+0000 7fa665dbd640 1 Processor -- start 2024-04-25T09:55:38.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.230+0000 7fa665dbd640 1 -- start start 2024-04-25T09:55:38.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.231+0000 7fa665dbd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa66006bc70 0x7fa660151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:38.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.231+0000 7fa665dbd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa66006c330 0x7fa6600cae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:38.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.231+0000 7fa665dbd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa66015da20 0x7fa6600cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:38.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.231+0000 7fa665dbd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6600d1280 con 0x7fa66006c330 2024-04-25T09:55:38.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.231+0000 7fa665dbd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6600d0370 con 0x7fa66015da20 2024-04-25T09:55:38.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.231+0000 7fa665dbd640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66015de00 con 0x7fa66006bc70 2024-04-25T09:55:38.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.231+0000 7fa65effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa66006c330 0x7fa6600cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:38.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.231+0000 7fa65effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa66006c330 0x7fa6600cae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42228/0 (socket says 172.21.15.7:42228) 2024-04-25T09:55:38.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.231+0000 7fa65effd640 1 -- 172.21.15.7:0/3387511426 learned_addr learned my addr 172.21.15.7:0/3387511426 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:38.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.231+0000 7fa65ffff640 1 --2- 172.21.15.7:0/3387511426 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa66015da20 0x7fa6600cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:38.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.232+0000 7fa65f7fe640 1 --2- 172.21.15.7:0/3387511426 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa66006bc70 0x7fa660151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:38.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.232+0000 7fa65effd640 1 -- 172.21.15.7:0/3387511426 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa66006bc70 msgr2=0x7fa660151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:38.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.232+0000 7fa65effd640 1 --2- 172.21.15.7:0/3387511426 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa66006bc70 0x7fa660151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:38.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.232+0000 7fa65effd640 1 -- 172.21.15.7:0/3387511426 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa66015da20 msgr2=0x7fa6600cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:38.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.232+0000 7fa65effd640 1 --2- 172.21.15.7:0/3387511426 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa66015da20 0x7fa6600cb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:38.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.232+0000 7fa65effd640 1 -- 172.21.15.7:0/3387511426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6600c96b0 con 0x7fa66006c330 2024-04-25T09:55:38.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.232+0000 7fa65f7fe640 1 --2- 172.21.15.7:0/3387511426 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa66006bc70 0x7fa660151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:38.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.232+0000 7fa65effd640 1 --2- 172.21.15.7:0/3387511426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa66006c330 0x7fa6600cae60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa65400b3c0 tx=0x7fa65400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:38.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.232+0000 7fa647fff640 1 -- 172.21.15.7:0/3387511426 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa654011830 con 0x7fa66006c330 2024-04-25T09:55:38.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.232+0000 7fa647fff640 1 -- 172.21.15.7:0/3387511426 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa654016070 con 0x7fa66006c330 2024-04-25T09:55:38.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.232+0000 7fa665dbd640 1 -- 172.21.15.7:0/3387511426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6600c9990 con 0x7fa66006c330 2024-04-25T09:55:38.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.232+0000 7fa647fff640 1 -- 172.21.15.7:0/3387511426 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa654011c50 con 0x7fa66006c330 2024-04-25T09:55:38.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.232+0000 7fa665dbd640 1 -- 172.21.15.7:0/3387511426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6600c9f50 con 0x7fa66006c330 2024-04-25T09:55:38.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.233+0000 7fa665dbd640 1 -- 172.21.15.7:0/3387511426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa660159040 con 0x7fa66006c330 2024-04-25T09:55:38.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.233+0000 7fa647fff640 1 -- 172.21.15.7:0/3387511426 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa65401b460 con 0x7fa66006c330 2024-04-25T09:55:38.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.234+0000 7fa647fff640 1 --2- 172.21.15.7:0/3387511426 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa64c06b500 0x7fa64c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:38.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.234+0000 7fa65f7fe640 1 --2- 172.21.15.7:0/3387511426 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa64c06b500 0x7fa64c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:38.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.234+0000 7fa647fff640 1 -- 172.21.15.7:0/3387511426 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa654089ef0 con 0x7fa66006c330 2024-04-25T09:55:38.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.234+0000 7fa65f7fe640 1 --2- 172.21.15.7:0/3387511426 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa64c06b500 0x7fa64c06d9c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa650034000 tx=0x7fa65002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:38.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.238+0000 7fa647fff640 1 -- 172.21.15.7:0/3387511426 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa660159040 con 0x7fa66006c330 2024-04-25T09:55:38.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.417+0000 7fa665dbd640 1 -- 172.21.15.7:0/3387511426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa660068fd0 con 0x7fa66006c330 2024-04-25T09:55:38.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.418+0000 7fa647fff640 1 -- 172.21.15.7:0/3387511426 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16846 (secure 0 0 0) 0x7fa654020020 con 0x7fa66006c330 2024-04-25T09:55:38.421 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:38.421 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":39,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:55:36.722817+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:55:33.644089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T09:55:34.059847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:55:38.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.420+0000 7fa665dbd640 1 -- 172.21.15.7:0/3387511426 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa64c06b500 msgr2=0x7fa64c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:38.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.420+0000 7fa665dbd640 1 --2- 172.21.15.7:0/3387511426 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa64c06b500 0x7fa64c06d9c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa650034000 tx=0x7fa65002e000 comp rx=0 tx=0).stop 2024-04-25T09:55:38.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.420+0000 7fa665dbd640 1 -- 172.21.15.7:0/3387511426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa66006c330 msgr2=0x7fa6600cae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:38.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.420+0000 7fa665dbd640 1 --2- 172.21.15.7:0/3387511426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa66006c330 0x7fa6600cae60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa65400b3c0 tx=0x7fa65400b880 comp rx=0 tx=0).stop 2024-04-25T09:55:38.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.420+0000 7fa665dbd640 1 -- 172.21.15.7:0/3387511426 shutdown_connections 2024-04-25T09:55:38.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.420+0000 7fa665dbd640 1 --2- 172.21.15.7:0/3387511426 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa64c06b500 0x7fa64c06d9c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:38.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.420+0000 7fa665dbd640 1 --2- 172.21.15.7:0/3387511426 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa66015da20 0x7fa6600cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:38.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.420+0000 7fa665dbd640 1 --2- 172.21.15.7:0/3387511426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa66006c330 0x7fa6600cae60 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:38.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.420+0000 7fa665dbd640 1 --2- 172.21.15.7:0/3387511426 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa66006bc70 0x7fa660151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:38.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.420+0000 7fa665dbd640 1 -- 172.21.15.7:0/3387511426 >> 172.21.15.7:0/3387511426 conn(0x7fa6600d16f0 msgr2=0x7fa6600999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:38.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.420+0000 7fa665dbd640 1 -- 172.21.15.7:0/3387511426 shutdown_connections 2024-04-25T09:55:38.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.420+0000 7fa665dbd640 1 -- 172.21.15.7:0/3387511426 wait complete. 2024-04-25T09:55:38.434 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:55:38.435 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:55:38.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.532+0000 7f26d46fc640 1 Processor -- start 2024-04-25T09:55:38.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.532+0000 7f26d46fc640 1 -- start start 2024-04-25T09:55:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.533+0000 7f26d46fc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f26cc06e970 0x7f26cc15be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.533+0000 7f26d46fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f26cc0c4900 0x7f26cc0c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.533+0000 7f26d46fc640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26cc0cd510 con 0x7f26cc151720 2024-04-25T09:55:38.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.533+0000 7f26d46fc640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26cc0cd7f0 con 0x7f26cc0c4900 2024-04-25T09:55:38.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.533+0000 7f26d46fc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc0cdad0 con 0x7f26cc06e970 2024-04-25T09:55:38.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.533+0000 7f26d2498640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f26cc151720 0x7f26cc06e260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40592/0 (socket says 172.21.15.7:40592) 2024-04-25T09:55:38.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.533+0000 7f26d2498640 1 -- 172.21.15.7:0/721345960 learned_addr learned my addr 172.21.15.7:0/721345960 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:38.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.533+0000 7f26d2c99640 1 --2- 172.21.15.7:0/721345960 >> v2:172.21.15.55:3300/0 conn(0x7f26cc0c4900 0x7f26cc0c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:38.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.533+0000 7f26d1c97640 1 --2- 172.21.15.7:0/721345960 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f26cc06e970 0x7f26cc15be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:38.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.533+0000 7f26d1496640 1 -- 172.21.15.7:0/721345960 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 960133117 0 0) 0x7f26cc0cd510 con 0x7f26cc151720 2024-04-25T09:55:38.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.533+0000 7f26d1496640 1 -- 172.21.15.7:0/721345960 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26b8003520 con 0x7f26cc151720 2024-04-25T09:55:38.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.533+0000 7f26d2c99640 1 -- 172.21.15.7:0/721345960 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f26cc06e970 msgr2=0x7f26cc15be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:38.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.533+0000 7f26d2c99640 1 --2- 172.21.15.7:0/721345960 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f26cc06e970 0x7f26cc15be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:38.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.533+0000 7f26d1496640 1 -- 172.21.15.7:0/721345960 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1762540825 0 0) 0x7f26b8003520 con 0x7f26cc151720 2024-04-25T09:55:38.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.533+0000 7f26d2c99640 1 -- 172.21.15.7:0/721345960 >> v1:172.21.15.7:6789/0 conn(0x7f26cc151720 legacy=0x7f26cc06e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:38.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.533+0000 7f26d2c99640 1 -- 172.21.15.7:0/721345960 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26cc0cddb0 con 0x7f26cc0c4900 2024-04-25T09:55:38.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.534+0000 7f26d2c99640 1 --2- 172.21.15.7:0/721345960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26cc0c4900 0x7f26cc0c4d90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f26c4009d90 tx=0x7f26c402a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48c7ea8556cd2ab2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:38.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.534+0000 7f26d1496640 1 -- 172.21.15.7:0/721345960 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c8001670 con 0x7f26cc0c4900 2024-04-25T09:55:38.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.534+0000 7f26d1496640 1 -- 172.21.15.7:0/721345960 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c4007540 con 0x7f26cc0c4900 2024-04-25T09:55:38.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.534+0000 7f26d1496640 1 -- 172.21.15.7:0/721345960 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c40078f0 con 0x7f26cc0c4900 2024-04-25T09:55:38.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.535+0000 7f26d46fc640 1 -- 172.21.15.7:0/721345960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26cc0c4900 msgr2=0x7f26cc0c4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:38.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.535+0000 7f26d46fc640 1 --2- 172.21.15.7:0/721345960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26cc0c4900 0x7f26cc0c4d90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f26c4009d90 tx=0x7f26c402a5f0 comp rx=0 tx=0).stop 2024-04-25T09:55:38.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.535+0000 7f26d46fc640 1 -- 172.21.15.7:0/721345960 shutdown_connections 2024-04-25T09:55:38.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.535+0000 7f26d46fc640 1 --2- 172.21.15.7:0/721345960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26cc0c4900 0x7f26cc0c4d90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:38.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.535+0000 7f26d46fc640 1 --2- 172.21.15.7:0/721345960 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f26cc06e970 0x7f26cc15be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:38.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.535+0000 7f26d46fc640 1 -- 172.21.15.7:0/721345960 >> 172.21.15.7:0/721345960 conn(0x7f26cc071150 msgr2=0x7f26cc071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:38.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.535+0000 7f26d46fc640 1 -- 172.21.15.7:0/721345960 shutdown_connections 2024-04-25T09:55:38.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.535+0000 7f26d46fc640 1 -- 172.21.15.7:0/721345960 wait complete. 2024-04-25T09:55:38.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.536+0000 7f26d46fc640 1 Processor -- start 2024-04-25T09:55:38.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.536+0000 7f26d46fc640 1 -- start start 2024-04-25T09:55:38.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.537+0000 7f26d46fc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f26cc06e970 0x7f26cc152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:38.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.537+0000 7f26d46fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26cc0c4900 0x7f26cc149910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:38.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.537+0000 7f26d46fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26cc151720 0x7f26cc157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:38.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.537+0000 7f26d46fc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc151b00 con 0x7f26cc0c4900 2024-04-25T09:55:38.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.537+0000 7f26d46fc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc0c52d0 con 0x7f26cc151720 2024-04-25T09:55:38.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.537+0000 7f26d46fc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc0ce5b0 con 0x7f26cc06e970 2024-04-25T09:55:38.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.537+0000 7f26d1c97640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26cc0c4900 0x7f26cc149910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:38.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.537+0000 7f26d1c97640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26cc0c4900 0x7f26cc149910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42236/0 (socket says 172.21.15.7:42236) 2024-04-25T09:55:38.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.537+0000 7f26d1c97640 1 -- 172.21.15.7:0/2021664828 learned_addr learned my addr 172.21.15.7:0/2021664828 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:38.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.537+0000 7f26d2c99640 1 --2- 172.21.15.7:0/2021664828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26cc151720 0x7f26cc157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:38.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.537+0000 7f26d2498640 1 --2- 172.21.15.7:0/2021664828 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f26cc06e970 0x7f26cc152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:38.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.538+0000 7f26d1c97640 1 -- 172.21.15.7:0/2021664828 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f26cc06e970 msgr2=0x7f26cc152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:38.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.538+0000 7f26d1c97640 1 --2- 172.21.15.7:0/2021664828 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f26cc06e970 0x7f26cc152cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:38.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.538+0000 7f26d1c97640 1 -- 172.21.15.7:0/2021664828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26cc151720 msgr2=0x7f26cc157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:38.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.538+0000 7f26d1c97640 1 --2- 172.21.15.7:0/2021664828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26cc151720 0x7f26cc157060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:38.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.538+0000 7f26d1c97640 1 -- 172.21.15.7:0/2021664828 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26cc14a540 con 0x7f26cc0c4900 2024-04-25T09:55:38.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.538+0000 7f26d1c97640 1 --2- 172.21.15.7:0/2021664828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26cc0c4900 0x7f26cc149910 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00e9b0 tx=0x7f26bc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:38.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.538+0000 7f26c2ffd640 1 -- 172.21.15.7:0/2021664828 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc017070 con 0x7f26cc0c4900 2024-04-25T09:55:38.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.538+0000 7f26c2ffd640 1 -- 172.21.15.7:0/2021664828 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26bc00c9a0 con 0x7f26cc0c4900 2024-04-25T09:55:38.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.538+0000 7f26c2ffd640 1 -- 172.21.15.7:0/2021664828 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc00cd90 con 0x7f26cc0c4900 2024-04-25T09:55:38.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.538+0000 7f26d46fc640 1 -- 172.21.15.7:0/2021664828 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26cc153640 con 0x7f26cc0c4900 2024-04-25T09:55:38.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.538+0000 7f26d46fc640 1 -- 172.21.15.7:0/2021664828 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26cc153c00 con 0x7f26cc0c4900 2024-04-25T09:55:38.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.539+0000 7f26d46fc640 1 -- 172.21.15.7:0/2021664828 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26cc068fd0 con 0x7f26cc0c4900 2024-04-25T09:55:38.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.539+0000 7f26c2ffd640 1 -- 172.21.15.7:0/2021664828 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f26bc01a070 con 0x7f26cc0c4900 2024-04-25T09:55:38.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.540+0000 7f26c2ffd640 1 --2- 172.21.15.7:0/2021664828 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f26b006b4d0 0x7f26b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:38.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.540+0000 7f26c2ffd640 1 -- 172.21.15.7:0/2021664828 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f26bc08a240 con 0x7f26cc0c4900 2024-04-25T09:55:38.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.540+0000 7f26d2498640 1 --2- 172.21.15.7:0/2021664828 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f26b006b4d0 0x7f26b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:38.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.540+0000 7f26d2498640 1 --2- 172.21.15.7:0/2021664828 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f26b006b4d0 0x7f26b006d990 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f26c8005880 tx=0x7f26c80057f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:38.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.544+0000 7f26c2ffd640 1 -- 172.21.15.7:0/2021664828 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f26bc058970 con 0x7f26cc0c4900 2024-04-25T09:55:38.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.719+0000 7f26d46fc640 1 -- 172.21.15.7:0/2021664828 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f26cc15c150 con 0x7f26b006b4d0 2024-04-25T09:55:38.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.725+0000 7f26c2ffd640 1 -- 172.21.15.7:0/2021664828 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249429 (secure 0 0 0) 0x7f26cc15c150 con 0x7f26b006b4d0 2024-04-25T09:55:38.731 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:38.732 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T09:55:38.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.728+0000 7f26d46fc640 1 -- 172.21.15.7:0/2021664828 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f26b006b4d0 msgr2=0x7f26b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:38.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.728+0000 7f26d46fc640 1 --2- 172.21.15.7:0/2021664828 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f26b006b4d0 0x7f26b006d990 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f26c8005880 tx=0x7f26c80057f0 comp rx=0 tx=0).stop 2024-04-25T09:55:38.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.728+0000 7f26d46fc640 1 -- 172.21.15.7:0/2021664828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26cc0c4900 msgr2=0x7f26cc149910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:38.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.728+0000 7f26d46fc640 1 --2- 172.21.15.7:0/2021664828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26cc0c4900 0x7f26cc149910 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00e9b0 tx=0x7f26bc00ee70 comp rx=0 tx=0).stop 2024-04-25T09:55:38.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.728+0000 7f26d46fc640 1 -- 172.21.15.7:0/2021664828 shutdown_connections 2024-04-25T09:55:38.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.728+0000 7f26d46fc640 1 --2- 172.21.15.7:0/2021664828 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f26b006b4d0 0x7f26b006d990 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:38.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.728+0000 7f26d46fc640 1 --2- 172.21.15.7:0/2021664828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26cc151720 0x7f26cc157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:38.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.728+0000 7f26d46fc640 1 --2- 172.21.15.7:0/2021664828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26cc0c4900 0x7f26cc149910 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:38.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.728+0000 7f26d46fc640 1 --2- 172.21.15.7:0/2021664828 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f26cc06e970 0x7f26cc152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:38.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.728+0000 7f26d46fc640 1 -- 172.21.15.7:0/2021664828 >> 172.21.15.7:0/2021664828 conn(0x7f26cc071150 msgr2=0x7f26cc15cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:38.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.728+0000 7f26d46fc640 1 -- 172.21.15.7:0/2021664828 shutdown_connections 2024-04-25T09:55:38.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.728+0000 7f26d46fc640 1 -- 172.21.15.7:0/2021664828 wait complete. 2024-04-25T09:55:38.742 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-04-25T09:55:37.868426+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591062,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":189,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":245532,"kb_used_data":4408,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754729188,"statfs":{"total":773094113280,"available":772842688512,"internally_reserved":0,"allocated":4513792,"data_stored":2591764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":246795825},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":694,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.156837"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.729869+0000","last_change":"2024-04-25T09:55:34.729869+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.729869+0000","last_undegraded":"2024-04-25T09:55:34.729869+0000","last_fullsized":"2024-04-25T09:55:34.729869+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.730011+0000","last_change":"2024-04-25T09:55:34.730011+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.730011+0000","last_undegraded":"2024-04-25T09:55:34.730011+0000","last_fullsized":"2024-04-25T09:55:34.730011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727236+0000","last_change":"2024-04-25T09:55:34.727236+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727236+0000","last_undegraded":"2024-04-25T09:55:34.727236+0000","last_fullsized":"2024-04-25T09:55:34.727236+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.734467+0000","last_change":"2024-04-25T09:55:34.734467+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.734467+0000","last_undegraded":"2024-04-25T09:55:34.734467+0000","last_fullsized":"2024-04-25T09:55:34.734467+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.733882+0000","last_change":"2024-04-25T09:55:34.733882+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.733882+0000","last_undegraded":"2024-04-25T09:55:34.733882+0000","last_fullsized":"2024-04-25T09:55:34.733882+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727866+0000","last_change":"2024-04-25T09:55:34.727866+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727866+0000","last_undegraded":"2024-04-25T09:55:34.727866+0000","last_fullsized":"2024-04-25T09:55:34.727866+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773290+0000","last_change":"2024-04-25T09:55:35.764026+0000","last_active":"2024-04-25T09:55:35.773290+0000","last_peered":"2024-04-25T09:55:35.773290+0000","last_clean":"2024-04-25T09:55:35.773290+0000","last_became_active":"2024-04-25T09:55:35.763499+0000","last_became_peered":"2024-04-25T09:55:35.763499+0000","last_unstale":"2024-04-25T09:55:35.773290+0000","last_undegraded":"2024-04-25T09:55:35.773290+0000","last_fullsized":"2024-04-25T09:55:35.773290+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:53.251434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.729371+0000","last_change":"2024-04-25T09:55:34.729371+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.729371+0000","last_undegraded":"2024-04-25T09:55:34.729371+0000","last_fullsized":"2024-04-25T09:55:34.729371+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727715+0000","last_change":"2024-04-25T09:55:34.727715+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727715+0000","last_undegraded":"2024-04-25T09:55:34.727715+0000","last_fullsized":"2024-04-25T09:55:34.727715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773363+0000","last_change":"2024-04-25T09:55:35.764915+0000","last_active":"2024-04-25T09:55:35.773363+0000","last_peered":"2024-04-25T09:55:35.773363+0000","last_clean":"2024-04-25T09:55:35.773363+0000","last_became_active":"2024-04-25T09:55:35.764601+0000","last_became_peered":"2024-04-25T09:55:35.764601+0000","last_unstale":"2024-04-25T09:55:35.773363+0000","last_undegraded":"2024-04-25T09:55:35.773363+0000","last_fullsized":"2024-04-25T09:55:35.773363+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:59.279223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773868+0000","last_change":"2024-04-25T09:55:35.768030+0000","last_active":"2024-04-25T09:55:35.773868+0000","last_peered":"2024-04-25T09:55:35.773868+0000","last_clean":"2024-04-25T09:55:35.773868+0000","last_became_active":"2024-04-25T09:55:35.767735+0000","last_became_peered":"2024-04-25T09:55:35.767735+0000","last_unstale":"2024-04-25T09:55:35.773868+0000","last_undegraded":"2024-04-25T09:55:35.773868+0000","last_fullsized":"2024-04-25T09:55:35.773868+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:31:37.702240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727470+0000","last_change":"2024-04-25T09:55:34.727470+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727470+0000","last_undegraded":"2024-04-25T09:55:34.727470+0000","last_fullsized":"2024-04-25T09:55:34.727470+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773102+0000","last_change":"2024-04-25T09:55:35.759552+0000","last_active":"2024-04-25T09:55:35.773102+0000","last_peered":"2024-04-25T09:55:35.773102+0000","last_clean":"2024-04-25T09:55:35.773102+0000","last_became_active":"2024-04-25T09:55:35.759261+0000","last_became_peered":"2024-04-25T09:55:35.759261+0000","last_unstale":"2024-04-25T09:55:35.773102+0000","last_undegraded":"2024-04-25T09:55:35.773102+0000","last_fullsized":"2024-04-25T09:55:35.773102+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:07.479394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.767781+0000","last_change":"2024-04-25T09:55:35.762865+0000","last_active":"2024-04-25T09:55:35.767781+0000","last_peered":"2024-04-25T09:55:35.767781+0000","last_clean":"2024-04-25T09:55:35.767781+0000","last_became_active":"2024-04-25T09:55:35.762187+0000","last_became_peered":"2024-04-25T09:55:35.762187+0000","last_unstale":"2024-04-25T09:55:35.767781+0000","last_undegraded":"2024-04-25T09:55:35.767781+0000","last_fullsized":"2024-04-25T09:55:35.767781+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:20.546402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773267+0000","last_change":"2024-04-25T09:55:35.763794+0000","last_active":"2024-04-25T09:55:35.773267+0000","last_peered":"2024-04-25T09:55:35.773267+0000","last_clean":"2024-04-25T09:55:35.773267+0000","last_became_active":"2024-04-25T09:55:35.763203+0000","last_became_peered":"2024-04-25T09:55:35.763203+0000","last_unstale":"2024-04-25T09:55:35.773267+0000","last_undegraded":"2024-04-25T09:55:35.773267+0000","last_fullsized":"2024-04-25T09:55:35.773267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:10.115716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.764092+0000","last_change":"2024-04-25T09:55:35.760046+0000","last_active":"2024-04-25T09:55:35.764092+0000","last_peered":"2024-04-25T09:55:35.764092+0000","last_clean":"2024-04-25T09:55:35.764092+0000","last_became_active":"2024-04-25T09:55:35.759769+0000","last_became_peered":"2024-04-25T09:55:35.759769+0000","last_unstale":"2024-04-25T09:55:35.764092+0000","last_undegraded":"2024-04-25T09:55:35.764092+0000","last_fullsized":"2024-04-25T09:55:35.764092+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:02.497946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773399+0000","last_change":"2024-04-25T09:55:35.768514+0000","last_active":"2024-04-25T09:55:35.773399+0000","last_peered":"2024-04-25T09:55:35.773399+0000","last_clean":"2024-04-25T09:55:35.773399+0000","last_became_active":"2024-04-25T09:55:35.768212+0000","last_became_peered":"2024-04-25T09:55:35.768212+0000","last_unstale":"2024-04-25T09:55:35.773399+0000","last_undegraded":"2024-04-25T09:55:35.773399+0000","last_fullsized":"2024-04-25T09:55:35.773399+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:53.251434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.772951+0000","last_change":"2024-04-25T09:55:35.766182+0000","last_active":"2024-04-25T09:55:35.772951+0000","last_peered":"2024-04-25T09:55:35.772951+0000","last_clean":"2024-04-25T09:55:35.772951+0000","last_became_active":"2024-04-25T09:55:35.765914+0000","last_became_peered":"2024-04-25T09:55:35.765914+0000","last_unstale":"2024-04-25T09:55:35.772951+0000","last_undegraded":"2024-04-25T09:55:35.772951+0000","last_fullsized":"2024-04-25T09:55:35.772951+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:23.632331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.733244+0000","last_change":"2024-04-25T09:55:34.733244+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.733244+0000","last_undegraded":"2024-04-25T09:55:34.733244+0000","last_fullsized":"2024-04-25T09:55:34.733244+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.772798+0000","last_change":"2024-04-25T09:55:35.761736+0000","last_active":"2024-04-25T09:55:35.772798+0000","last_peered":"2024-04-25T09:55:35.772798+0000","last_clean":"2024-04-25T09:55:35.772798+0000","last_became_active":"2024-04-25T09:55:35.761387+0000","last_became_peered":"2024-04-25T09:55:35.761387+0000","last_unstale":"2024-04-25T09:55:35.772798+0000","last_undegraded":"2024-04-25T09:55:35.772798+0000","last_fullsized":"2024-04-25T09:55:35.772798+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:27.173551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773130+0000","last_change":"2024-04-25T09:55:35.759573+0000","last_active":"2024-04-25T09:55:35.773130+0000","last_peered":"2024-04-25T09:55:35.773130+0000","last_clean":"2024-04-25T09:55:35.773130+0000","last_became_active":"2024-04-25T09:55:35.759200+0000","last_became_peered":"2024-04-25T09:55:35.759200+0000","last_unstale":"2024-04-25T09:55:35.773130+0000","last_undegraded":"2024-04-25T09:55:35.773130+0000","last_fullsized":"2024-04-25T09:55:35.773130+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:12.257881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.758730+0000","last_change":"2024-04-25T09:55:35.747716+0000","last_active":"2024-04-25T09:55:35.758730+0000","last_peered":"2024-04-25T09:55:35.758730+0000","last_clean":"2024-04-25T09:55:35.758730+0000","last_became_active":"2024-04-25T09:55:35.747370+0000","last_became_peered":"2024-04-25T09:55:35.747370+0000","last_unstale":"2024-04-25T09:55:35.758730+0000","last_undegraded":"2024-04-25T09:55:35.758730+0000","last_fullsized":"2024-04-25T09:55:35.758730+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:27.173551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.763900+0000","last_change":"2024-04-25T09:55:35.756163+0000","last_active":"2024-04-25T09:55:35.763900+0000","last_peered":"2024-04-25T09:55:35.763900+0000","last_clean":"2024-04-25T09:55:35.763900+0000","last_became_active":"2024-04-25T09:55:35.755783+0000","last_became_peered":"2024-04-25T09:55:35.755783+0000","last_unstale":"2024-04-25T09:55:35.763900+0000","last_undegraded":"2024-04-25T09:55:35.763900+0000","last_fullsized":"2024-04-25T09:55:35.763900+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:43.087615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.732715+0000","last_change":"2024-04-25T09:55:34.732715+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.732715+0000","last_undegraded":"2024-04-25T09:55:34.732715+0000","last_fullsized":"2024-04-25T09:55:34.732715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.761341+0000","last_change":"2024-04-25T09:55:35.749966+0000","last_active":"2024-04-25T09:55:35.761341+0000","last_peered":"2024-04-25T09:55:35.761341+0000","last_clean":"2024-04-25T09:55:35.761341+0000","last_became_active":"2024-04-25T09:55:35.749527+0000","last_became_peered":"2024-04-25T09:55:35.749527+0000","last_unstale":"2024-04-25T09:55:35.761341+0000","last_undegraded":"2024-04-25T09:55:35.761341+0000","last_fullsized":"2024-04-25T09:55:35.761341+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:13.247677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.730311+0000","last_change":"2024-04-25T09:55:34.730311+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.730311+0000","last_undegraded":"2024-04-25T09:55:34.730311+0000","last_fullsized":"2024-04-25T09:55:34.730311+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.760704+0000","last_change":"2024-04-25T09:55:35.750137+0000","last_active":"2024-04-25T09:55:35.760704+0000","last_peered":"2024-04-25T09:55:35.760704+0000","last_clean":"2024-04-25T09:55:35.760704+0000","last_became_active":"2024-04-25T09:55:35.749850+0000","last_became_peered":"2024-04-25T09:55:35.749850+0000","last_unstale":"2024-04-25T09:55:35.760704+0000","last_undegraded":"2024-04-25T09:55:35.760704+0000","last_fullsized":"2024-04-25T09:55:35.760704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:28.106434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773079+0000","last_change":"2024-04-25T09:55:35.759353+0000","last_active":"2024-04-25T09:55:35.773079+0000","last_peered":"2024-04-25T09:55:35.773079+0000","last_clean":"2024-04-25T09:55:35.773079+0000","last_became_active":"2024-04-25T09:55:35.758976+0000","last_became_peered":"2024-04-25T09:55:35.758976+0000","last_unstale":"2024-04-25T09:55:35.773079+0000","last_undegraded":"2024-04-25T09:55:35.773079+0000","last_fullsized":"2024-04-25T09:55:35.773079+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:02.497946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.761770+0000","last_change":"2024-04-25T09:55:35.759021+0000","last_active":"2024-04-25T09:55:35.761770+0000","last_peered":"2024-04-25T09:55:35.761770+0000","last_clean":"2024-04-25T09:55:35.761770+0000","last_became_active":"2024-04-25T09:55:35.758662+0000","last_became_peered":"2024-04-25T09:55:35.758662+0000","last_unstale":"2024-04-25T09:55:35.761770+0000","last_undegraded":"2024-04-25T09:55:35.761770+0000","last_fullsized":"2024-04-25T09:55:35.761770+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:37.746023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.760726+0000","last_change":"2024-04-25T09:55:35.752315+0000","last_active":"2024-04-25T09:55:35.760726+0000","last_peered":"2024-04-25T09:55:35.760726+0000","last_clean":"2024-04-25T09:55:35.760726+0000","last_became_active":"2024-04-25T09:55:35.750495+0000","last_became_peered":"2024-04-25T09:55:35.750495+0000","last_unstale":"2024-04-25T09:55:35.760726+0000","last_undegraded":"2024-04-25T09:55:35.760726+0000","last_fullsized":"2024-04-25T09:55:35.760726+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:25.069355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.763873+0000","last_change":"2024-04-25T09:55:35.756176+0000","last_active":"2024-04-25T09:55:35.763873+0000","last_peered":"2024-04-25T09:55:35.763873+0000","last_clean":"2024-04-25T09:55:35.763873+0000","last_became_active":"2024-04-25T09:55:35.755837+0000","last_became_peered":"2024-04-25T09:55:35.755837+0000","last_unstale":"2024-04-25T09:55:35.763873+0000","last_undegraded":"2024-04-25T09:55:35.763873+0000","last_fullsized":"2024-04-25T09:55:35.763873+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:20.546402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727558+0000","last_change":"2024-04-25T09:55:34.727558+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727558+0000","last_undegraded":"2024-04-25T09:55:34.727558+0000","last_fullsized":"2024-04-25T09:55:34.727558+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.764060+0000","last_change":"2024-04-25T09:55:35.760617+0000","last_active":"2024-04-25T09:55:35.764060+0000","last_peered":"2024-04-25T09:55:35.764060+0000","last_clean":"2024-04-25T09:55:35.764060+0000","last_became_active":"2024-04-25T09:55:35.760321+0000","last_became_peered":"2024-04-25T09:55:35.760321+0000","last_unstale":"2024-04-25T09:55:35.764060+0000","last_undegraded":"2024-04-25T09:55:35.764060+0000","last_fullsized":"2024-04-25T09:55:35.764060+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:07.479394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.762942+0000","last_change":"2024-04-25T09:55:34.745543+0000","last_active":"2024-04-25T09:55:35.762942+0000","last_peered":"2024-04-25T09:55:35.762942+0000","last_clean":"2024-04-25T09:55:35.762942+0000","last_became_active":"2024-04-25T09:55:34.745243+0000","last_became_peered":"2024-04-25T09:55:34.745243+0000","last_unstale":"2024-04-25T09:55:35.762942+0000","last_undegraded":"2024-04-25T09:55:35.762942+0000","last_fullsized":"2024-04-25T09:55:35.762942+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:49.336547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.730036+0000","last_change":"2024-04-25T09:55:34.730036+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.730036+0000","last_undegraded":"2024-04-25T09:55:34.730036+0000","last_fullsized":"2024-04-25T09:55:34.730036+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.747850+0000","last_change":"2024-04-25T09:55:34.747086+0000","last_active":"2024-04-25T09:55:34.747850+0000","last_peered":"2024-04-25T09:55:34.747850+0000","last_clean":"2024-04-25T09:55:34.747850+0000","last_became_active":"2024-04-25T09:55:34.746760+0000","last_became_peered":"2024-04-25T09:55:34.746760+0000","last_unstale":"2024-04-25T09:55:34.747850+0000","last_undegraded":"2024-04-25T09:55:34.747850+0000","last_fullsized":"2024-04-25T09:55:34.747850+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:49.336547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.769019+0000","last_change":"2024-04-25T09:55:35.764169+0000","last_active":"2024-04-25T09:55:35.769019+0000","last_peered":"2024-04-25T09:55:35.769019+0000","last_clean":"2024-04-25T09:55:35.769019+0000","last_became_active":"2024-04-25T09:55:35.763842+0000","last_became_peered":"2024-04-25T09:55:35.763842+0000","last_unstale":"2024-04-25T09:55:35.769019+0000","last_undegraded":"2024-04-25T09:55:35.769019+0000","last_fullsized":"2024-04-25T09:55:35.769019+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:58.821504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.744649+0000","last_change":"2024-04-25T09:55:34.743621+0000","last_active":"2024-04-25T09:55:34.744649+0000","last_peered":"2024-04-25T09:55:34.744649+0000","last_clean":"2024-04-25T09:55:34.744649+0000","last_became_active":"2024-04-25T09:55:34.743238+0000","last_became_peered":"2024-04-25T09:55:34.743238+0000","last_unstale":"2024-04-25T09:55:34.744649+0000","last_undegraded":"2024-04-25T09:55:34.744649+0000","last_fullsized":"2024-04-25T09:55:34.744649+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:49.289488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.728924+0000","last_change":"2024-04-25T09:55:34.728924+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.728924+0000","last_undegraded":"2024-04-25T09:55:34.728924+0000","last_fullsized":"2024-04-25T09:55:34.728924+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.749586+0000","last_change":"2024-04-25T09:55:34.744009+0000","last_active":"2024-04-25T09:55:35.749586+0000","last_peered":"2024-04-25T09:55:35.749586+0000","last_clean":"2024-04-25T09:55:35.749586+0000","last_became_active":"2024-04-25T09:55:34.743062+0000","last_became_peered":"2024-04-25T09:55:34.743062+0000","last_unstale":"2024-04-25T09:55:35.749586+0000","last_undegraded":"2024-04-25T09:55:35.749586+0000","last_fullsized":"2024-04-25T09:55:35.749586+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:49.336547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.728747+0000","last_change":"2024-04-25T09:55:34.728747+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.728747+0000","last_undegraded":"2024-04-25T09:55:34.728747+0000","last_fullsized":"2024-04-25T09:55:34.728747+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.759042+0000","last_change":"2024-04-25T09:55:34.750441+0000","last_active":"2024-04-25T09:55:35.759042+0000","last_peered":"2024-04-25T09:55:35.759042+0000","last_clean":"2024-04-25T09:55:35.759042+0000","last_became_active":"2024-04-25T09:55:34.750055+0000","last_became_peered":"2024-04-25T09:55:34.750055+0000","last_unstale":"2024-04-25T09:55:35.759042+0000","last_undegraded":"2024-04-25T09:55:35.759042+0000","last_fullsized":"2024-04-25T09:55:35.759042+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:19.539959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773442+0000","last_change":"2024-04-25T09:55:35.765490+0000","last_active":"2024-04-25T09:55:35.773442+0000","last_peered":"2024-04-25T09:55:35.773442+0000","last_clean":"2024-04-25T09:55:35.773442+0000","last_became_active":"2024-04-25T09:55:35.762884+0000","last_became_peered":"2024-04-25T09:55:35.762884+0000","last_unstale":"2024-04-25T09:55:35.773442+0000","last_undegraded":"2024-04-25T09:55:35.773442+0000","last_fullsized":"2024-04-25T09:55:35.773442+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:34.458200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.760230+0000","last_change":"2024-04-25T09:55:34.744929+0000","last_active":"2024-04-25T09:55:35.760230+0000","last_peered":"2024-04-25T09:55:35.760230+0000","last_clean":"2024-04-25T09:55:35.760230+0000","last_became_active":"2024-04-25T09:55:34.744561+0000","last_became_peered":"2024-04-25T09:55:34.744561+0000","last_unstale":"2024-04-25T09:55:35.760230+0000","last_undegraded":"2024-04-25T09:55:35.760230+0000","last_fullsized":"2024-04-25T09:55:35.760230+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:24.062912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.767805+0000","last_change":"2024-04-25T09:55:35.763093+0000","last_active":"2024-04-25T09:55:35.767805+0000","last_peered":"2024-04-25T09:55:35.767805+0000","last_clean":"2024-04-25T09:55:35.767805+0000","last_became_active":"2024-04-25T09:55:35.762596+0000","last_became_peered":"2024-04-25T09:55:35.762596+0000","last_unstale":"2024-04-25T09:55:35.767805+0000","last_undegraded":"2024-04-25T09:55:35.767805+0000","last_fullsized":"2024-04-25T09:55:35.767805+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:43.087615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.750521+0000","last_change":"2024-04-25T09:55:34.749888+0000","last_active":"2024-04-25T09:55:34.750521+0000","last_peered":"2024-04-25T09:55:34.750521+0000","last_clean":"2024-04-25T09:55:34.750521+0000","last_became_active":"2024-04-25T09:55:34.749584+0000","last_became_peered":"2024-04-25T09:55:34.749584+0000","last_unstale":"2024-04-25T09:55:34.750521+0000","last_undegraded":"2024-04-25T09:55:34.750521+0000","last_fullsized":"2024-04-25T09:55:34.750521+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:49.336547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.728439+0000","last_change":"2024-04-25T09:55:34.728439+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.728439+0000","last_undegraded":"2024-04-25T09:55:34.728439+0000","last_fullsized":"2024-04-25T09:55:34.728439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.741286+0000","last_change":"2024-04-25T09:55:34.743854+0000","last_active":"2024-04-25T09:55:35.741286+0000","last_peered":"2024-04-25T09:55:35.741286+0000","last_clean":"2024-04-25T09:55:35.741286+0000","last_became_active":"2024-04-25T09:55:34.743570+0000","last_became_peered":"2024-04-25T09:55:34.743570+0000","last_unstale":"2024-04-25T09:55:35.741286+0000","last_undegraded":"2024-04-25T09:55:35.741286+0000","last_fullsized":"2024-04-25T09:55:35.741286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:14.801427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.731859+0000","last_change":"2024-04-25T09:55:34.731859+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.731859+0000","last_undegraded":"2024-04-25T09:55:34.731859+0000","last_fullsized":"2024-04-25T09:55:34.731859+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.735677+0000","last_change":"2024-04-25T09:55:34.734433+0000","last_active":"2024-04-25T09:55:34.735677+0000","last_peered":"2024-04-25T09:55:34.735677+0000","last_clean":"2024-04-25T09:55:34.735677+0000","last_became_active":"2024-04-25T09:55:34.733827+0000","last_became_peered":"2024-04-25T09:55:34.733827+0000","last_unstale":"2024-04-25T09:55:34.735677+0000","last_undegraded":"2024-04-25T09:55:34.735677+0000","last_fullsized":"2024-04-25T09:55:34.735677+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:19.539959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.772866+0000","last_change":"2024-04-25T09:55:35.765319+0000","last_active":"2024-04-25T09:55:35.772866+0000","last_peered":"2024-04-25T09:55:35.772866+0000","last_clean":"2024-04-25T09:55:35.772866+0000","last_became_active":"2024-04-25T09:55:35.764862+0000","last_became_peered":"2024-04-25T09:55:35.764862+0000","last_unstale":"2024-04-25T09:55:35.772866+0000","last_undegraded":"2024-04-25T09:55:35.772866+0000","last_fullsized":"2024-04-25T09:55:35.772866+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:58.065939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.750195+0000","last_change":"2024-04-25T09:55:34.749934+0000","last_active":"2024-04-25T09:55:35.750195+0000","last_peered":"2024-04-25T09:55:35.750195+0000","last_clean":"2024-04-25T09:55:35.750195+0000","last_became_active":"2024-04-25T09:55:34.748781+0000","last_became_peered":"2024-04-25T09:55:34.748781+0000","last_unstale":"2024-04-25T09:55:35.750195+0000","last_undegraded":"2024-04-25T09:55:35.750195+0000","last_fullsized":"2024-04-25T09:55:35.750195+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:42.081172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.728487+0000","last_change":"2024-04-25T09:55:34.728487+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.728487+0000","last_undegraded":"2024-04-25T09:55:34.728487+0000","last_fullsized":"2024-04-25T09:55:34.728487+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.768519+0000","last_change":"2024-04-25T09:55:34.751988+0000","last_active":"2024-04-25T09:55:35.768519+0000","last_peered":"2024-04-25T09:55:35.768519+0000","last_clean":"2024-04-25T09:55:35.768519+0000","last_became_active":"2024-04-25T09:55:34.751600+0000","last_became_peered":"2024-04-25T09:55:34.751600+0000","last_unstale":"2024-04-25T09:55:35.768519+0000","last_undegraded":"2024-04-25T09:55:35.768519+0000","last_fullsized":"2024-04-25T09:55:35.768519+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:57.815061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.753143+0000","last_change":"2024-04-25T09:55:35.745530+0000","last_active":"2024-04-25T09:55:35.753143+0000","last_peered":"2024-04-25T09:55:35.753143+0000","last_clean":"2024-04-25T09:55:35.753143+0000","last_became_active":"2024-04-25T09:55:35.745156+0000","last_became_peered":"2024-04-25T09:55:35.745156+0000","last_unstale":"2024-04-25T09:55:35.753143+0000","last_undegraded":"2024-04-25T09:55:35.753143+0000","last_fullsized":"2024-04-25T09:55:35.753143+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:25.069355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.747509+0000","last_change":"2024-04-25T09:55:34.746883+0000","last_active":"2024-04-25T09:55:34.747509+0000","last_peered":"2024-04-25T09:55:34.747509+0000","last_clean":"2024-04-25T09:55:34.747509+0000","last_became_active":"2024-04-25T09:55:34.746605+0000","last_became_peered":"2024-04-25T09:55:34.746605+0000","last_unstale":"2024-04-25T09:55:34.747509+0000","last_undegraded":"2024-04-25T09:55:34.747509+0000","last_fullsized":"2024-04-25T09:55:34.747509+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:42.081172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.728352+0000","last_change":"2024-04-25T09:55:34.728352+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.728352+0000","last_undegraded":"2024-04-25T09:55:34.728352+0000","last_fullsized":"2024-04-25T09:55:34.728352+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.735751+0000","last_change":"2024-04-25T09:55:34.734268+0000","last_active":"2024-04-25T09:55:34.735751+0000","last_peered":"2024-04-25T09:55:34.735751+0000","last_clean":"2024-04-25T09:55:34.735751+0000","last_became_active":"2024-04-25T09:55:34.733940+0000","last_became_peered":"2024-04-25T09:55:34.733940+0000","last_unstale":"2024-04-25T09:55:34.735751+0000","last_undegraded":"2024-04-25T09:55:34.735751+0000","last_fullsized":"2024-04-25T09:55:34.735751+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:22.625888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.726523+0000","last_change":"2024-04-25T09:55:34.726523+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.726523+0000","last_undegraded":"2024-04-25T09:55:34.726523+0000","last_fullsized":"2024-04-25T09:55:34.726523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.751808+0000","last_change":"2024-04-25T09:55:34.751004+0000","last_active":"2024-04-25T09:55:34.751808+0000","last_peered":"2024-04-25T09:55:34.751808+0000","last_clean":"2024-04-25T09:55:34.751808+0000","last_became_active":"2024-04-25T09:55:34.750719+0000","last_became_peered":"2024-04-25T09:55:34.750719+0000","last_unstale":"2024-04-25T09:55:34.751808+0000","last_undegraded":"2024-04-25T09:55:34.751808+0000","last_fullsized":"2024-04-25T09:55:34.751808+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:14.801427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.764461+0000","last_change":"2024-04-25T09:55:35.756163+0000","last_active":"2024-04-25T09:55:35.764461+0000","last_peered":"2024-04-25T09:55:35.764461+0000","last_clean":"2024-04-25T09:55:35.764461+0000","last_became_active":"2024-04-25T09:55:35.755652+0000","last_became_peered":"2024-04-25T09:55:35.755652+0000","last_unstale":"2024-04-25T09:55:35.764461+0000","last_undegraded":"2024-04-25T09:55:35.764461+0000","last_fullsized":"2024-04-25T09:55:35.764461+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:58.821504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.740102+0000","last_change":"2024-04-25T09:55:34.745319+0000","last_active":"2024-04-25T09:55:35.740102+0000","last_peered":"2024-04-25T09:55:35.740102+0000","last_clean":"2024-04-25T09:55:35.740102+0000","last_became_active":"2024-04-25T09:55:34.745029+0000","last_became_peered":"2024-04-25T09:55:34.745029+0000","last_unstale":"2024-04-25T09:55:35.740102+0000","last_undegraded":"2024-04-25T09:55:35.740102+0000","last_fullsized":"2024-04-25T09:55:35.740102+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:14.801427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.726983+0000","last_change":"2024-04-25T09:55:34.726983+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.726983+0000","last_undegraded":"2024-04-25T09:55:34.726983+0000","last_fullsized":"2024-04-25T09:55:34.726983+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.761411+0000","last_change":"2024-04-25T09:55:34.746478+0000","last_active":"2024-04-25T09:55:35.761411+0000","last_peered":"2024-04-25T09:55:35.761411+0000","last_clean":"2024-04-25T09:55:35.761411+0000","last_became_active":"2024-04-25T09:55:34.745385+0000","last_became_peered":"2024-04-25T09:55:34.745385+0000","last_unstale":"2024-04-25T09:55:35.761411+0000","last_undegraded":"2024-04-25T09:55:35.761411+0000","last_fullsized":"2024-04-25T09:55:35.761411+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:27.099991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727061+0000","last_change":"2024-04-25T09:55:34.727061+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727061+0000","last_undegraded":"2024-04-25T09:55:34.727061+0000","last_fullsized":"2024-04-25T09:55:34.727061+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.761760+0000","last_change":"2024-04-25T09:55:34.751912+0000","last_active":"2024-04-25T09:55:35.761760+0000","last_peered":"2024-04-25T09:55:35.761760+0000","last_clean":"2024-04-25T09:55:35.761760+0000","last_became_active":"2024-04-25T09:55:34.751601+0000","last_became_peered":"2024-04-25T09:55:34.751601+0000","last_unstale":"2024-04-25T09:55:35.761760+0000","last_undegraded":"2024-04-25T09:55:35.761760+0000","last_fullsized":"2024-04-25T09:55:35.761760+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:26.167108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773893+0000","last_change":"2024-04-25T09:55:35.767965+0000","last_active":"2024-04-25T09:55:35.773893+0000","last_peered":"2024-04-25T09:55:35.773893+0000","last_clean":"2024-04-25T09:55:35.773893+0000","last_became_active":"2024-04-25T09:55:35.767682+0000","last_became_peered":"2024-04-25T09:55:35.767682+0000","last_unstale":"2024-04-25T09:55:35.773893+0000","last_undegraded":"2024-04-25T09:55:35.773893+0000","last_fullsized":"2024-04-25T09:55:35.773893+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:03.959180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.767824+0000","last_change":"2024-04-25T09:55:34.752634+0000","last_active":"2024-04-25T09:55:35.767824+0000","last_peered":"2024-04-25T09:55:35.767824+0000","last_clean":"2024-04-25T09:55:35.767824+0000","last_became_active":"2024-04-25T09:55:34.752309+0000","last_became_peered":"2024-04-25T09:55:34.752309+0000","last_unstale":"2024-04-25T09:55:35.767824+0000","last_undegraded":"2024-04-25T09:55:35.767824+0000","last_fullsized":"2024-04-25T09:55:35.767824+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:27.099991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.763693+0000","last_change":"2024-04-25T09:55:35.749342+0000","last_active":"2024-04-25T09:55:35.763693+0000","last_peered":"2024-04-25T09:55:35.763693+0000","last_clean":"2024-04-25T09:55:35.763693+0000","last_became_active":"2024-04-25T09:55:35.749073+0000","last_became_peered":"2024-04-25T09:55:35.749073+0000","last_unstale":"2024-04-25T09:55:35.763693+0000","last_undegraded":"2024-04-25T09:55:35.763693+0000","last_fullsized":"2024-04-25T09:55:35.763693+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:23.632331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.749062+0000","last_change":"2024-04-25T09:55:34.748592+0000","last_active":"2024-04-25T09:55:34.749062+0000","last_peered":"2024-04-25T09:55:34.749062+0000","last_clean":"2024-04-25T09:55:34.749062+0000","last_became_active":"2024-04-25T09:55:34.748241+0000","last_became_peered":"2024-04-25T09:55:34.748241+0000","last_unstale":"2024-04-25T09:55:34.749062+0000","last_undegraded":"2024-04-25T09:55:34.749062+0000","last_fullsized":"2024-04-25T09:55:34.749062+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:58.101203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.731923+0000","last_change":"2024-04-25T09:55:34.731923+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.731923+0000","last_undegraded":"2024-04-25T09:55:34.731923+0000","last_fullsized":"2024-04-25T09:55:34.731923+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.746236+0000","last_change":"2024-04-25T09:55:34.744760+0000","last_active":"2024-04-25T09:55:34.746236+0000","last_peered":"2024-04-25T09:55:34.746236+0000","last_clean":"2024-04-25T09:55:34.746236+0000","last_became_active":"2024-04-25T09:55:34.744440+0000","last_became_peered":"2024-04-25T09:55:34.744440+0000","last_unstale":"2024-04-25T09:55:34.746236+0000","last_undegraded":"2024-04-25T09:55:34.746236+0000","last_fullsized":"2024-04-25T09:55:34.746236+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:32.776034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.763822+0000","last_change":"2024-04-25T09:55:35.756114+0000","last_active":"2024-04-25T09:55:35.763822+0000","last_peered":"2024-04-25T09:55:35.763822+0000","last_clean":"2024-04-25T09:55:35.763822+0000","last_became_active":"2024-04-25T09:55:35.755727+0000","last_became_peered":"2024-04-25T09:55:35.755727+0000","last_unstale":"2024-04-25T09:55:35.763822+0000","last_undegraded":"2024-04-25T09:55:35.763822+0000","last_fullsized":"2024-04-25T09:55:35.763822+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:23.632331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.737877+0000","last_change":"2024-04-25T09:55:34.737032+0000","last_active":"2024-04-25T09:55:34.737877+0000","last_peered":"2024-04-25T09:55:34.737877+0000","last_clean":"2024-04-25T09:55:34.737877+0000","last_became_active":"2024-04-25T09:55:34.736683+0000","last_became_peered":"2024-04-25T09:55:34.736683+0000","last_unstale":"2024-04-25T09:55:34.737877+0000","last_undegraded":"2024-04-25T09:55:34.737877+0000","last_fullsized":"2024-04-25T09:55:34.737877+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:49.623487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.730122+0000","last_change":"2024-04-25T09:55:34.730122+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.730122+0000","last_undegraded":"2024-04-25T09:55:34.730122+0000","last_fullsized":"2024-04-25T09:55:34.730122+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.745997+0000","last_change":"2024-04-25T09:55:34.745223+0000","last_active":"2024-04-25T09:55:34.745997+0000","last_peered":"2024-04-25T09:55:34.745997+0000","last_clean":"2024-04-25T09:55:34.745997+0000","last_became_active":"2024-04-25T09:55:34.744879+0000","last_became_peered":"2024-04-25T09:55:34.744879+0000","last_unstale":"2024-04-25T09:55:34.745997+0000","last_undegraded":"2024-04-25T09:55:34.745997+0000","last_fullsized":"2024-04-25T09:55:34.745997+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:15.660968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773369+0000","last_change":"2024-04-25T09:55:35.764920+0000","last_active":"2024-04-25T09:55:35.773369+0000","last_peered":"2024-04-25T09:55:35.773369+0000","last_clean":"2024-04-25T09:55:35.773369+0000","last_became_active":"2024-04-25T09:55:35.764523+0000","last_became_peered":"2024-04-25T09:55:35.764523+0000","last_unstale":"2024-04-25T09:55:35.773369+0000","last_undegraded":"2024-04-25T09:55:35.773369+0000","last_fullsized":"2024-04-25T09:55:35.773369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:12.411252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.744431+0000","last_change":"2024-04-25T09:55:34.747558+0000","last_active":"2024-04-25T09:55:35.744431+0000","last_peered":"2024-04-25T09:55:35.744431+0000","last_clean":"2024-04-25T09:55:35.744431+0000","last_became_active":"2024-04-25T09:55:34.747247+0000","last_became_peered":"2024-04-25T09:55:34.747247+0000","last_unstale":"2024-04-25T09:55:35.744431+0000","last_undegraded":"2024-04-25T09:55:35.744431+0000","last_fullsized":"2024-04-25T09:55:35.744431+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:36.739580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.726476+0000","last_change":"2024-04-25T09:55:34.726476+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.726476+0000","last_undegraded":"2024-04-25T09:55:34.726476+0000","last_fullsized":"2024-04-25T09:55:34.726476+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.740441+0000","last_change":"2024-04-25T09:55:34.738977+0000","last_active":"2024-04-25T09:55:34.740441+0000","last_peered":"2024-04-25T09:55:34.740441+0000","last_clean":"2024-04-25T09:55:34.740441+0000","last_became_active":"2024-04-25T09:55:34.738688+0000","last_became_peered":"2024-04-25T09:55:34.738688+0000","last_unstale":"2024-04-25T09:55:34.740441+0000","last_undegraded":"2024-04-25T09:55:34.740441+0000","last_fullsized":"2024-04-25T09:55:34.740441+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:08.898597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.729237+0000","last_change":"2024-04-25T09:55:34.729237+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.729237+0000","last_undegraded":"2024-04-25T09:55:34.729237+0000","last_fullsized":"2024-04-25T09:55:34.729237+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.759569+0000","last_change":"2024-04-25T09:55:34.751955+0000","last_active":"2024-04-25T09:55:35.759569+0000","last_peered":"2024-04-25T09:55:35.759569+0000","last_clean":"2024-04-25T09:55:35.759569+0000","last_became_active":"2024-04-25T09:55:34.751661+0000","last_became_peered":"2024-04-25T09:55:34.751661+0000","last_unstale":"2024-04-25T09:55:35.759569+0000","last_undegraded":"2024-04-25T09:55:35.759569+0000","last_fullsized":"2024-04-25T09:55:35.759569+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:22.625888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.772888+0000","last_change":"2024-04-25T09:55:35.765747+0000","last_active":"2024-04-25T09:55:35.772888+0000","last_peered":"2024-04-25T09:55:35.772888+0000","last_clean":"2024-04-25T09:55:35.772888+0000","last_became_active":"2024-04-25T09:55:35.765400+0000","last_became_peered":"2024-04-25T09:55:35.765400+0000","last_unstale":"2024-04-25T09:55:35.772888+0000","last_undegraded":"2024-04-25T09:55:35.772888+0000","last_fullsized":"2024-04-25T09:55:35.772888+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:10.115716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.750254+0000","last_change":"2024-04-25T09:55:34.749607+0000","last_active":"2024-04-25T09:55:34.750254+0000","last_peered":"2024-04-25T09:55:34.750254+0000","last_clean":"2024-04-25T09:55:34.750254+0000","last_became_active":"2024-04-25T09:55:34.749293+0000","last_became_peered":"2024-04-25T09:55:34.749293+0000","last_unstale":"2024-04-25T09:55:34.750254+0000","last_undegraded":"2024-04-25T09:55:34.750254+0000","last_fullsized":"2024-04-25T09:55:34.750254+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:47.145780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.726240+0000","last_change":"2024-04-25T09:55:34.726240+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.726240+0000","last_undegraded":"2024-04-25T09:55:34.726240+0000","last_fullsized":"2024-04-25T09:55:34.726240+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.735927+0000","last_change":"2024-04-25T09:55:34.734044+0000","last_active":"2024-04-25T09:55:34.735927+0000","last_peered":"2024-04-25T09:55:34.735927+0000","last_clean":"2024-04-25T09:55:34.735927+0000","last_became_active":"2024-04-25T09:55:34.733742+0000","last_became_peered":"2024-04-25T09:55:34.733742+0000","last_unstale":"2024-04-25T09:55:34.735927+0000","last_undegraded":"2024-04-25T09:55:34.735927+0000","last_fullsized":"2024-04-25T09:55:34.735927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:49.289488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727916+0000","last_change":"2024-04-25T09:55:34.727916+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727916+0000","last_undegraded":"2024-04-25T09:55:34.727916+0000","last_fullsized":"2024-04-25T09:55:34.727916+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.738952+0000","last_change":"2024-04-25T09:55:34.738180+0000","last_active":"2024-04-25T09:55:34.738952+0000","last_peered":"2024-04-25T09:55:34.738952+0000","last_clean":"2024-04-25T09:55:34.738952+0000","last_became_active":"2024-04-25T09:55:34.737894+0000","last_became_peered":"2024-04-25T09:55:34.737894+0000","last_unstale":"2024-04-25T09:55:34.738952+0000","last_undegraded":"2024-04-25T09:55:34.738952+0000","last_fullsized":"2024-04-25T09:55:34.738952+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:32.776034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727617+0000","last_change":"2024-04-25T09:55:34.727617+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727617+0000","last_undegraded":"2024-04-25T09:55:34.727617+0000","last_fullsized":"2024-04-25T09:55:34.727617+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.739163+0000","last_change":"2024-04-25T09:55:34.742098+0000","last_active":"2024-04-25T09:55:35.739163+0000","last_peered":"2024-04-25T09:55:35.739163+0000","last_clean":"2024-04-25T09:55:35.739163+0000","last_became_active":"2024-04-25T09:55:34.741787+0000","last_became_peered":"2024-04-25T09:55:34.741787+0000","last_unstale":"2024-04-25T09:55:35.739163+0000","last_undegraded":"2024-04-25T09:55:35.739163+0000","last_fullsized":"2024-04-25T09:55:35.739163+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:32.776034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.752849+0000","last_change":"2024-04-25T09:55:35.746484+0000","last_active":"2024-04-25T09:55:35.752849+0000","last_peered":"2024-04-25T09:55:35.752849+0000","last_clean":"2024-04-25T09:55:35.752849+0000","last_became_active":"2024-04-25T09:55:35.746195+0000","last_became_peered":"2024-04-25T09:55:35.746195+0000","last_unstale":"2024-04-25T09:55:35.752849+0000","last_undegraded":"2024-04-25T09:55:35.752849+0000","last_fullsized":"2024-04-25T09:55:35.752849+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:37.746023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.741723+0000","last_change":"2024-04-25T09:55:34.743941+0000","last_active":"2024-04-25T09:55:35.741723+0000","last_peered":"2024-04-25T09:55:35.741723+0000","last_clean":"2024-04-25T09:55:35.741723+0000","last_became_active":"2024-04-25T09:55:34.743567+0000","last_became_peered":"2024-04-25T09:55:34.743567+0000","last_unstale":"2024-04-25T09:55:35.741723+0000","last_undegraded":"2024-04-25T09:55:35.741723+0000","last_fullsized":"2024-04-25T09:55:35.741723+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:12.241234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.772778+0000","last_change":"2024-04-25T09:55:35.765142+0000","last_active":"2024-04-25T09:55:35.772778+0000","last_peered":"2024-04-25T09:55:35.772778+0000","last_clean":"2024-04-25T09:55:35.772778+0000","last_became_active":"2024-04-25T09:55:35.764844+0000","last_became_peered":"2024-04-25T09:55:35.764844+0000","last_unstale":"2024-04-25T09:55:35.772778+0000","last_undegraded":"2024-04-25T09:55:35.772778+0000","last_fullsized":"2024-04-25T09:55:35.772778+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:12.257881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.735709+0000","last_change":"2024-04-25T09:55:34.731152+0000","last_active":"2024-04-25T09:55:34.735709+0000","last_peered":"2024-04-25T09:55:34.735709+0000","last_clean":"2024-04-25T09:55:34.735709+0000","last_became_active":"2024-04-25T09:55:34.730845+0000","last_became_peered":"2024-04-25T09:55:34.730845+0000","last_unstale":"2024-04-25T09:55:34.735709+0000","last_undegraded":"2024-04-25T09:55:34.735709+0000","last_fullsized":"2024-04-25T09:55:34.735709+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:26.167108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773156+0000","last_change":"2024-04-25T09:55:35.762049+0000","last_active":"2024-04-25T09:55:35.773156+0000","last_peered":"2024-04-25T09:55:35.773156+0000","last_clean":"2024-04-25T09:55:35.773156+0000","last_became_active":"2024-04-25T09:55:35.761764+0000","last_became_peered":"2024-04-25T09:55:35.761764+0000","last_unstale":"2024-04-25T09:55:35.773156+0000","last_undegraded":"2024-04-25T09:55:35.773156+0000","last_fullsized":"2024-04-25T09:55:35.773156+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:58.065939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.744977+0000","last_change":"2024-04-25T09:55:34.746165+0000","last_active":"2024-04-25T09:55:35.744977+0000","last_peered":"2024-04-25T09:55:35.744977+0000","last_clean":"2024-04-25T09:55:35.744977+0000","last_became_active":"2024-04-25T09:55:34.745859+0000","last_became_peered":"2024-04-25T09:55:34.745859+0000","last_unstale":"2024-04-25T09:55:35.744977+0000","last_undegraded":"2024-04-25T09:55:35.744977+0000","last_fullsized":"2024-04-25T09:55:35.744977+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:26.167108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.744054+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T09:55:35.744054+0000","last_peered":"2024-04-25T09:55:35.744054+0000","last_clean":"2024-04-25T09:55:35.744054+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T09:55:35.744054+0000","last_undegraded":"2024-04-25T09:55:35.744054+0000","last_fullsized":"2024-04-25T09:55:35.744054+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":694,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542163,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1015808,"data_stored":770080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542163,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":179712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542165,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":421888,"data_stored":179712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":179712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":409600,"data_stored":173045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":409600,"data_stored":173045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":409600,"data_stored":173045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1003520,"data_stored":763413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:55:38.747 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:55:38.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.881+0000 7f60e3d9b640 1 Processor -- start 2024-04-25T09:55:38.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.882+0000 7f60e3d9b640 1 -- start start 2024-04-25T09:55:38.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.882+0000 7f60e3d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f60dc0cd740 0x7f60dc0d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:38.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.882+0000 7f60e3d9b640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60dc099b90 con 0x7f60dc0d08d0 2024-04-25T09:55:38.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.882+0000 7f60e3d9b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60dc099e70 con 0x7f60dc06cd90 2024-04-25T09:55:38.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.882+0000 7f60e3d9b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60dc0cdb20 con 0x7f60dc0cd740 2024-04-25T09:55:38.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.883+0000 7f60e1336640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f60dc0d08d0 0x7f60dc06c680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40606/0 (socket says 172.21.15.7:40606) 2024-04-25T09:55:38.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.883+0000 7f60e1336640 1 -- 172.21.15.7:0/2941172169 learned_addr learned my addr 172.21.15.7:0/2941172169 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:38.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.883+0000 7f60e1b37640 1 --2- 172.21.15.7:0/2941172169 >> v2:172.21.15.55:3300/0 conn(0x7f60dc0cd740 0x7f60dc0d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:38.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.883+0000 7f60e0b35640 1 -- 172.21.15.7:0/2941172169 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 841941272 0 0) 0x7f60dc099b90 con 0x7f60dc0d08d0 2024-04-25T09:55:38.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.883+0000 7f60e0b35640 1 -- 172.21.15.7:0/2941172169 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60c8003520 con 0x7f60dc0d08d0 2024-04-25T09:55:38.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.883+0000 7f60e0b35640 1 -- 172.21.15.7:0/2941172169 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2134030653 0 0) 0x7f60c8003520 con 0x7f60dc0d08d0 2024-04-25T09:55:38.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.883+0000 7f60e0b35640 1 -- 172.21.15.7:0/2941172169 >> v2:172.21.15.55:3300/0 conn(0x7f60dc0cd740 msgr2=0x7f60dc0d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:38.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.883+0000 7f60e0b35640 1 --2- 172.21.15.7:0/2941172169 >> v2:172.21.15.55:3300/0 conn(0x7f60dc0cd740 0x7f60dc0d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:38.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.883+0000 7f60e0b35640 1 -- 172.21.15.7:0/2941172169 >> v1:172.21.15.55:6789/0 conn(0x7f60dc06cd90 legacy=0x7f60dc0cbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:38.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.883+0000 7f60e0b35640 1 -- 172.21.15.7:0/2941172169 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60dc09a150 con 0x7f60dc0d08d0 2024-04-25T09:55:38.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.883+0000 7f60e0b35640 1 -- 172.21.15.7:0/2941172169 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f60d0001670 con 0x7f60dc0d08d0 2024-04-25T09:55:38.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.883+0000 7f60e0b35640 1 -- 172.21.15.7:0/2941172169 >> v1:172.21.15.7:6789/0 conn(0x7f60dc0d08d0 legacy=0x7f60dc06c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:38.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.883+0000 7f60e0b35640 1 --2- 172.21.15.7:0/2941172169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60c80039b0 0x7f60c8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:38.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.883+0000 7f60e0b35640 1 --2- 172.21.15.7:0/2941172169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c8004800 0x7f60c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:38.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.883+0000 7f60e0b35640 1 --2- 172.21.15.7:0/2941172169 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f60c80051c0 0x7f60c800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:38.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.883+0000 7f60e0b35640 1 -- 172.21.15.7:0/2941172169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c800c030 con 0x7f60c8004800 2024-04-25T09:55:38.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.883+0000 7f60e0b35640 1 -- 172.21.15.7:0/2941172169 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c800c1e0 con 0x7f60c80039b0 2024-04-25T09:55:38.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.883+0000 7f60e0b35640 1 -- 172.21.15.7:0/2941172169 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c800c3e0 con 0x7f60c80051c0 2024-04-25T09:55:38.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.883+0000 7f60e1336640 1 --2- 172.21.15.7:0/2941172169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c8004800 0x7f60c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:38.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.884+0000 7f60e1b37640 1 --2- 172.21.15.7:0/2941172169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60c80039b0 0x7f60c8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:38.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.884+0000 7f60e2338640 1 --2- 172.21.15.7:0/2941172169 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f60c80051c0 0x7f60c800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:38.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.884+0000 7f60e1336640 1 -- 172.21.15.7:0/2941172169 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f60c80051c0 msgr2=0x7f60c800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:38.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.884+0000 7f60e1336640 1 --2- 172.21.15.7:0/2941172169 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f60c80051c0 0x7f60c800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:38.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.884+0000 7f60e1336640 1 -- 172.21.15.7:0/2941172169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60c80039b0 msgr2=0x7f60c8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:38.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.884+0000 7f60e1336640 1 --2- 172.21.15.7:0/2941172169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60c80039b0 0x7f60c8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:38.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.884+0000 7f60e1336640 1 -- 172.21.15.7:0/2941172169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c8003520 con 0x7f60c8004800 2024-04-25T09:55:38.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.884+0000 7f60e2338640 1 -- 172.21.15.7:0/2941172169 reap_dead start 2024-04-25T09:55:38.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.884+0000 7f60e1336640 1 --2- 172.21.15.7:0/2941172169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c8004800 0x7f60c8004c80 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f60d000c210 tx=0x7f60c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d867a425971cbd9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:38.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.885+0000 7f60e0b35640 1 -- 172.21.15.7:0/2941172169 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0007d30 con 0x7f60c8004800 2024-04-25T09:55:38.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.885+0000 7f60e0b35640 1 -- 172.21.15.7:0/2941172169 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d0005ad0 con 0x7f60c8004800 2024-04-25T09:55:38.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.885+0000 7f60e0b35640 1 -- 172.21.15.7:0/2941172169 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0007070 con 0x7f60c8004800 2024-04-25T09:55:38.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.885+0000 7f60e3d9b640 1 -- 172.21.15.7:0/2941172169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c8004800 msgr2=0x7f60c8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:38.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.885+0000 7f60e3d9b640 1 --2- 172.21.15.7:0/2941172169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c8004800 0x7f60c8004c80 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f60d000c210 tx=0x7f60c8005830 comp rx=0 tx=0).stop 2024-04-25T09:55:38.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.885+0000 7f60e3d9b640 1 -- 172.21.15.7:0/2941172169 shutdown_connections 2024-04-25T09:55:38.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.885+0000 7f60e3d9b640 1 --2- 172.21.15.7:0/2941172169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c8004800 0x7f60c8004c80 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:38.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.885+0000 7f60e3d9b640 1 -- 172.21.15.7:0/2941172169 >> 172.21.15.7:0/2941172169 conn(0x7f60dc0b3130 msgr2=0x7f60dc0b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:38.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.885+0000 7f60e3d9b640 1 -- 172.21.15.7:0/2941172169 shutdown_connections 2024-04-25T09:55:38.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.885+0000 7f60e3d9b640 1 -- 172.21.15.7:0/2941172169 wait complete. 2024-04-25T09:55:38.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.886+0000 7f60e3d9b640 1 Processor -- start 2024-04-25T09:55:38.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.886+0000 7f60e3d9b640 1 -- start start 2024-04-25T09:55:38.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.887+0000 7f60e3d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c8004800 0x7f60dc09b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:38.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.887+0000 7f60e3d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60dc150f90 0x7f60dc09de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:38.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.887+0000 7f60e3d9b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f60dc09e370 0x7f60dc0caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:38.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.887+0000 7f60e3d9b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60dc09ac30 con 0x7f60c8004800 2024-04-25T09:55:38.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.887+0000 7f60e3d9b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60dc09a710 con 0x7f60dc150f90 2024-04-25T09:55:38.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.887+0000 7f60e3d9b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60dc09adb0 con 0x7f60dc09e370 2024-04-25T09:55:38.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.887+0000 7f60e1b37640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c8004800 0x7f60dc09b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:38.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.887+0000 7f60e1b37640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c8004800 0x7f60dc09b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42250/0 (socket says 172.21.15.7:42250) 2024-04-25T09:55:38.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.887+0000 7f60e1b37640 1 -- 172.21.15.7:0/216077114 learned_addr learned my addr 172.21.15.7:0/216077114 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:38.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.887+0000 7f60e1336640 1 --2- 172.21.15.7:0/216077114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60dc150f90 0x7f60dc09de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:38.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.887+0000 7f60e2338640 1 --2- 172.21.15.7:0/216077114 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f60dc09e370 0x7f60dc0caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:38.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.888+0000 7f60e1b37640 1 -- 172.21.15.7:0/216077114 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f60dc09e370 msgr2=0x7f60dc0caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:38.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.888+0000 7f60e1b37640 1 --2- 172.21.15.7:0/216077114 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f60dc09e370 0x7f60dc0caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:38.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.888+0000 7f60e1b37640 1 -- 172.21.15.7:0/216077114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60dc150f90 msgr2=0x7f60dc09de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:38.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.888+0000 7f60e1b37640 1 --2- 172.21.15.7:0/216077114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60dc150f90 0x7f60dc09de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:38.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.888+0000 7f60e1b37640 1 -- 172.21.15.7:0/216077114 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60dc09e7f0 con 0x7f60c8004800 2024-04-25T09:55:38.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.888+0000 7f60e2338640 1 --2- 172.21.15.7:0/216077114 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f60dc09e370 0x7f60dc0caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:38.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.888+0000 7f60e1b37640 1 --2- 172.21.15.7:0/216077114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c8004800 0x7f60dc09b480 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f60d8011aa0 tx=0x7f60d8011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:38.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.888+0000 7f60ce7fc640 1 -- 172.21.15.7:0/216077114 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d800fb20 con 0x7f60c8004800 2024-04-25T09:55:38.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.888+0000 7f60ce7fc640 1 -- 172.21.15.7:0/216077114 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d800fcc0 con 0x7f60c8004800 2024-04-25T09:55:38.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.888+0000 7f60e3d9b640 1 -- 172.21.15.7:0/216077114 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60dc151900 con 0x7f60c8004800 2024-04-25T09:55:38.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.888+0000 7f60ce7fc640 1 -- 172.21.15.7:0/216077114 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d8014660 con 0x7f60c8004800 2024-04-25T09:55:38.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.888+0000 7f60e3d9b640 1 -- 172.21.15.7:0/216077114 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60dc151ec0 con 0x7f60c8004800 2024-04-25T09:55:38.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.889+0000 7f60e3d9b640 1 -- 172.21.15.7:0/216077114 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60dc073ce0 con 0x7f60c8004800 2024-04-25T09:55:38.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.889+0000 7f60ce7fc640 1 -- 172.21.15.7:0/216077114 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f60d8012040 con 0x7f60c8004800 2024-04-25T09:55:38.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.890+0000 7f60ce7fc640 1 --2- 172.21.15.7:0/216077114 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f60c006b500 0x7f60c006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:38.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.890+0000 7f60ce7fc640 1 -- 172.21.15.7:0/216077114 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f60d808aa10 con 0x7f60c8004800 2024-04-25T09:55:38.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.890+0000 7f60e1336640 1 --2- 172.21.15.7:0/216077114 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f60c006b500 0x7f60c006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:38.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.890+0000 7f60e1336640 1 --2- 172.21.15.7:0/216077114 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f60c006b500 0x7f60c006d9c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f60d0033000 tx=0x7f60d002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:38.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:38.894+0000 7f60ce7fc640 1 -- 172.21.15.7:0/216077114 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f60dc073ce0 con 0x7f60c8004800 2024-04-25T09:55:39.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.069+0000 7f60e3d9b640 1 -- 172.21.15.7:0/216077114 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f60dc068fd0 con 0x7f60c006b500 2024-04-25T09:55:39.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.075+0000 7f60ce7fc640 1 -- 172.21.15.7:0/216077114 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249429 (secure 0 0 0) 0x7f60dc068fd0 con 0x7f60c006b500 2024-04-25T09:55:39.081 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:39.082 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T09:55:39.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.078+0000 7f60e3d9b640 1 -- 172.21.15.7:0/216077114 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f60c006b500 msgr2=0x7f60c006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:39.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.078+0000 7f60e3d9b640 1 --2- 172.21.15.7:0/216077114 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f60c006b500 0x7f60c006d9c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f60d0033000 tx=0x7f60d002e000 comp rx=0 tx=0).stop 2024-04-25T09:55:39.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.078+0000 7f60e3d9b640 1 -- 172.21.15.7:0/216077114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c8004800 msgr2=0x7f60dc09b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:39.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.078+0000 7f60e3d9b640 1 --2- 172.21.15.7:0/216077114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c8004800 0x7f60dc09b480 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f60d8011aa0 tx=0x7f60d8011f60 comp rx=0 tx=0).stop 2024-04-25T09:55:39.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.078+0000 7f60e3d9b640 1 -- 172.21.15.7:0/216077114 shutdown_connections 2024-04-25T09:55:39.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.078+0000 7f60e3d9b640 1 --2- 172.21.15.7:0/216077114 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f60c006b500 0x7f60c006d9c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:39.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.078+0000 7f60e3d9b640 1 --2- 172.21.15.7:0/216077114 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f60dc09e370 0x7f60dc0caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:39.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.078+0000 7f60e3d9b640 1 --2- 172.21.15.7:0/216077114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60dc150f90 0x7f60dc09de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:39.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.078+0000 7f60e3d9b640 1 --2- 172.21.15.7:0/216077114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c8004800 0x7f60dc09b480 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:39.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.078+0000 7f60e3d9b640 1 -- 172.21.15.7:0/216077114 >> 172.21.15.7:0/216077114 conn(0x7f60dc0b3130 msgr2=0x7f60dc06f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:39.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.079+0000 7f60e3d9b640 1 -- 172.21.15.7:0/216077114 shutdown_connections 2024-04-25T09:55:39.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.079+0000 7f60e3d9b640 1 -- 172.21.15.7:0/216077114 wait complete. 2024-04-25T09:55:39.092 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-04-25T09:55:37.868426+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591062,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":189,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":245532,"kb_used_data":4408,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754729188,"statfs":{"total":773094113280,"available":772842688512,"internally_reserved":0,"allocated":4513792,"data_stored":2591764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":246795825},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":694,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.156837"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.729869+0000","last_change":"2024-04-25T09:55:34.729869+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.729869+0000","last_undegraded":"2024-04-25T09:55:34.729869+0000","last_fullsized":"2024-04-25T09:55:34.729869+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.730011+0000","last_change":"2024-04-25T09:55:34.730011+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.730011+0000","last_undegraded":"2024-04-25T09:55:34.730011+0000","last_fullsized":"2024-04-25T09:55:34.730011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727236+0000","last_change":"2024-04-25T09:55:34.727236+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727236+0000","last_undegraded":"2024-04-25T09:55:34.727236+0000","last_fullsized":"2024-04-25T09:55:34.727236+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.734467+0000","last_change":"2024-04-25T09:55:34.734467+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.734467+0000","last_undegraded":"2024-04-25T09:55:34.734467+0000","last_fullsized":"2024-04-25T09:55:34.734467+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.733882+0000","last_change":"2024-04-25T09:55:34.733882+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.733882+0000","last_undegraded":"2024-04-25T09:55:34.733882+0000","last_fullsized":"2024-04-25T09:55:34.733882+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727866+0000","last_change":"2024-04-25T09:55:34.727866+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727866+0000","last_undegraded":"2024-04-25T09:55:34.727866+0000","last_fullsized":"2024-04-25T09:55:34.727866+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773290+0000","last_change":"2024-04-25T09:55:35.764026+0000","last_active":"2024-04-25T09:55:35.773290+0000","last_peered":"2024-04-25T09:55:35.773290+0000","last_clean":"2024-04-25T09:55:35.773290+0000","last_became_active":"2024-04-25T09:55:35.763499+0000","last_became_peered":"2024-04-25T09:55:35.763499+0000","last_unstale":"2024-04-25T09:55:35.773290+0000","last_undegraded":"2024-04-25T09:55:35.773290+0000","last_fullsized":"2024-04-25T09:55:35.773290+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:53.251434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.729371+0000","last_change":"2024-04-25T09:55:34.729371+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.729371+0000","last_undegraded":"2024-04-25T09:55:34.729371+0000","last_fullsized":"2024-04-25T09:55:34.729371+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727715+0000","last_change":"2024-04-25T09:55:34.727715+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727715+0000","last_undegraded":"2024-04-25T09:55:34.727715+0000","last_fullsized":"2024-04-25T09:55:34.727715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773363+0000","last_change":"2024-04-25T09:55:35.764915+0000","last_active":"2024-04-25T09:55:35.773363+0000","last_peered":"2024-04-25T09:55:35.773363+0000","last_clean":"2024-04-25T09:55:35.773363+0000","last_became_active":"2024-04-25T09:55:35.764601+0000","last_became_peered":"2024-04-25T09:55:35.764601+0000","last_unstale":"2024-04-25T09:55:35.773363+0000","last_undegraded":"2024-04-25T09:55:35.773363+0000","last_fullsized":"2024-04-25T09:55:35.773363+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:59.279223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773868+0000","last_change":"2024-04-25T09:55:35.768030+0000","last_active":"2024-04-25T09:55:35.773868+0000","last_peered":"2024-04-25T09:55:35.773868+0000","last_clean":"2024-04-25T09:55:35.773868+0000","last_became_active":"2024-04-25T09:55:35.767735+0000","last_became_peered":"2024-04-25T09:55:35.767735+0000","last_unstale":"2024-04-25T09:55:35.773868+0000","last_undegraded":"2024-04-25T09:55:35.773868+0000","last_fullsized":"2024-04-25T09:55:35.773868+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:31:37.702240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727470+0000","last_change":"2024-04-25T09:55:34.727470+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727470+0000","last_undegraded":"2024-04-25T09:55:34.727470+0000","last_fullsized":"2024-04-25T09:55:34.727470+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773102+0000","last_change":"2024-04-25T09:55:35.759552+0000","last_active":"2024-04-25T09:55:35.773102+0000","last_peered":"2024-04-25T09:55:35.773102+0000","last_clean":"2024-04-25T09:55:35.773102+0000","last_became_active":"2024-04-25T09:55:35.759261+0000","last_became_peered":"2024-04-25T09:55:35.759261+0000","last_unstale":"2024-04-25T09:55:35.773102+0000","last_undegraded":"2024-04-25T09:55:35.773102+0000","last_fullsized":"2024-04-25T09:55:35.773102+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:07.479394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.767781+0000","last_change":"2024-04-25T09:55:35.762865+0000","last_active":"2024-04-25T09:55:35.767781+0000","last_peered":"2024-04-25T09:55:35.767781+0000","last_clean":"2024-04-25T09:55:35.767781+0000","last_became_active":"2024-04-25T09:55:35.762187+0000","last_became_peered":"2024-04-25T09:55:35.762187+0000","last_unstale":"2024-04-25T09:55:35.767781+0000","last_undegraded":"2024-04-25T09:55:35.767781+0000","last_fullsized":"2024-04-25T09:55:35.767781+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:20.546402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773267+0000","last_change":"2024-04-25T09:55:35.763794+0000","last_active":"2024-04-25T09:55:35.773267+0000","last_peered":"2024-04-25T09:55:35.773267+0000","last_clean":"2024-04-25T09:55:35.773267+0000","last_became_active":"2024-04-25T09:55:35.763203+0000","last_became_peered":"2024-04-25T09:55:35.763203+0000","last_unstale":"2024-04-25T09:55:35.773267+0000","last_undegraded":"2024-04-25T09:55:35.773267+0000","last_fullsized":"2024-04-25T09:55:35.773267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:10.115716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.764092+0000","last_change":"2024-04-25T09:55:35.760046+0000","last_active":"2024-04-25T09:55:35.764092+0000","last_peered":"2024-04-25T09:55:35.764092+0000","last_clean":"2024-04-25T09:55:35.764092+0000","last_became_active":"2024-04-25T09:55:35.759769+0000","last_became_peered":"2024-04-25T09:55:35.759769+0000","last_unstale":"2024-04-25T09:55:35.764092+0000","last_undegraded":"2024-04-25T09:55:35.764092+0000","last_fullsized":"2024-04-25T09:55:35.764092+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:02.497946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773399+0000","last_change":"2024-04-25T09:55:35.768514+0000","last_active":"2024-04-25T09:55:35.773399+0000","last_peered":"2024-04-25T09:55:35.773399+0000","last_clean":"2024-04-25T09:55:35.773399+0000","last_became_active":"2024-04-25T09:55:35.768212+0000","last_became_peered":"2024-04-25T09:55:35.768212+0000","last_unstale":"2024-04-25T09:55:35.773399+0000","last_undegraded":"2024-04-25T09:55:35.773399+0000","last_fullsized":"2024-04-25T09:55:35.773399+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:53.251434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.772951+0000","last_change":"2024-04-25T09:55:35.766182+0000","last_active":"2024-04-25T09:55:35.772951+0000","last_peered":"2024-04-25T09:55:35.772951+0000","last_clean":"2024-04-25T09:55:35.772951+0000","last_became_active":"2024-04-25T09:55:35.765914+0000","last_became_peered":"2024-04-25T09:55:35.765914+0000","last_unstale":"2024-04-25T09:55:35.772951+0000","last_undegraded":"2024-04-25T09:55:35.772951+0000","last_fullsized":"2024-04-25T09:55:35.772951+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:23.632331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.733244+0000","last_change":"2024-04-25T09:55:34.733244+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.733244+0000","last_undegraded":"2024-04-25T09:55:34.733244+0000","last_fullsized":"2024-04-25T09:55:34.733244+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.772798+0000","last_change":"2024-04-25T09:55:35.761736+0000","last_active":"2024-04-25T09:55:35.772798+0000","last_peered":"2024-04-25T09:55:35.772798+0000","last_clean":"2024-04-25T09:55:35.772798+0000","last_became_active":"2024-04-25T09:55:35.761387+0000","last_became_peered":"2024-04-25T09:55:35.761387+0000","last_unstale":"2024-04-25T09:55:35.772798+0000","last_undegraded":"2024-04-25T09:55:35.772798+0000","last_fullsized":"2024-04-25T09:55:35.772798+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:27.173551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773130+0000","last_change":"2024-04-25T09:55:35.759573+0000","last_active":"2024-04-25T09:55:35.773130+0000","last_peered":"2024-04-25T09:55:35.773130+0000","last_clean":"2024-04-25T09:55:35.773130+0000","last_became_active":"2024-04-25T09:55:35.759200+0000","last_became_peered":"2024-04-25T09:55:35.759200+0000","last_unstale":"2024-04-25T09:55:35.773130+0000","last_undegraded":"2024-04-25T09:55:35.773130+0000","last_fullsized":"2024-04-25T09:55:35.773130+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:12.257881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.758730+0000","last_change":"2024-04-25T09:55:35.747716+0000","last_active":"2024-04-25T09:55:35.758730+0000","last_peered":"2024-04-25T09:55:35.758730+0000","last_clean":"2024-04-25T09:55:35.758730+0000","last_became_active":"2024-04-25T09:55:35.747370+0000","last_became_peered":"2024-04-25T09:55:35.747370+0000","last_unstale":"2024-04-25T09:55:35.758730+0000","last_undegraded":"2024-04-25T09:55:35.758730+0000","last_fullsized":"2024-04-25T09:55:35.758730+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:27.173551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.763900+0000","last_change":"2024-04-25T09:55:35.756163+0000","last_active":"2024-04-25T09:55:35.763900+0000","last_peered":"2024-04-25T09:55:35.763900+0000","last_clean":"2024-04-25T09:55:35.763900+0000","last_became_active":"2024-04-25T09:55:35.755783+0000","last_became_peered":"2024-04-25T09:55:35.755783+0000","last_unstale":"2024-04-25T09:55:35.763900+0000","last_undegraded":"2024-04-25T09:55:35.763900+0000","last_fullsized":"2024-04-25T09:55:35.763900+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:43.087615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.732715+0000","last_change":"2024-04-25T09:55:34.732715+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.732715+0000","last_undegraded":"2024-04-25T09:55:34.732715+0000","last_fullsized":"2024-04-25T09:55:34.732715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.761341+0000","last_change":"2024-04-25T09:55:35.749966+0000","last_active":"2024-04-25T09:55:35.761341+0000","last_peered":"2024-04-25T09:55:35.761341+0000","last_clean":"2024-04-25T09:55:35.761341+0000","last_became_active":"2024-04-25T09:55:35.749527+0000","last_became_peered":"2024-04-25T09:55:35.749527+0000","last_unstale":"2024-04-25T09:55:35.761341+0000","last_undegraded":"2024-04-25T09:55:35.761341+0000","last_fullsized":"2024-04-25T09:55:35.761341+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:13.247677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.730311+0000","last_change":"2024-04-25T09:55:34.730311+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.730311+0000","last_undegraded":"2024-04-25T09:55:34.730311+0000","last_fullsized":"2024-04-25T09:55:34.730311+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.760704+0000","last_change":"2024-04-25T09:55:35.750137+0000","last_active":"2024-04-25T09:55:35.760704+0000","last_peered":"2024-04-25T09:55:35.760704+0000","last_clean":"2024-04-25T09:55:35.760704+0000","last_became_active":"2024-04-25T09:55:35.749850+0000","last_became_peered":"2024-04-25T09:55:35.749850+0000","last_unstale":"2024-04-25T09:55:35.760704+0000","last_undegraded":"2024-04-25T09:55:35.760704+0000","last_fullsized":"2024-04-25T09:55:35.760704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:28.106434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773079+0000","last_change":"2024-04-25T09:55:35.759353+0000","last_active":"2024-04-25T09:55:35.773079+0000","last_peered":"2024-04-25T09:55:35.773079+0000","last_clean":"2024-04-25T09:55:35.773079+0000","last_became_active":"2024-04-25T09:55:35.758976+0000","last_became_peered":"2024-04-25T09:55:35.758976+0000","last_unstale":"2024-04-25T09:55:35.773079+0000","last_undegraded":"2024-04-25T09:55:35.773079+0000","last_fullsized":"2024-04-25T09:55:35.773079+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:02.497946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.761770+0000","last_change":"2024-04-25T09:55:35.759021+0000","last_active":"2024-04-25T09:55:35.761770+0000","last_peered":"2024-04-25T09:55:35.761770+0000","last_clean":"2024-04-25T09:55:35.761770+0000","last_became_active":"2024-04-25T09:55:35.758662+0000","last_became_peered":"2024-04-25T09:55:35.758662+0000","last_unstale":"2024-04-25T09:55:35.761770+0000","last_undegraded":"2024-04-25T09:55:35.761770+0000","last_fullsized":"2024-04-25T09:55:35.761770+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:37.746023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.760726+0000","last_change":"2024-04-25T09:55:35.752315+0000","last_active":"2024-04-25T09:55:35.760726+0000","last_peered":"2024-04-25T09:55:35.760726+0000","last_clean":"2024-04-25T09:55:35.760726+0000","last_became_active":"2024-04-25T09:55:35.750495+0000","last_became_peered":"2024-04-25T09:55:35.750495+0000","last_unstale":"2024-04-25T09:55:35.760726+0000","last_undegraded":"2024-04-25T09:55:35.760726+0000","last_fullsized":"2024-04-25T09:55:35.760726+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:25.069355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.763873+0000","last_change":"2024-04-25T09:55:35.756176+0000","last_active":"2024-04-25T09:55:35.763873+0000","last_peered":"2024-04-25T09:55:35.763873+0000","last_clean":"2024-04-25T09:55:35.763873+0000","last_became_active":"2024-04-25T09:55:35.755837+0000","last_became_peered":"2024-04-25T09:55:35.755837+0000","last_unstale":"2024-04-25T09:55:35.763873+0000","last_undegraded":"2024-04-25T09:55:35.763873+0000","last_fullsized":"2024-04-25T09:55:35.763873+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:20.546402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727558+0000","last_change":"2024-04-25T09:55:34.727558+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727558+0000","last_undegraded":"2024-04-25T09:55:34.727558+0000","last_fullsized":"2024-04-25T09:55:34.727558+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.764060+0000","last_change":"2024-04-25T09:55:35.760617+0000","last_active":"2024-04-25T09:55:35.764060+0000","last_peered":"2024-04-25T09:55:35.764060+0000","last_clean":"2024-04-25T09:55:35.764060+0000","last_became_active":"2024-04-25T09:55:35.760321+0000","last_became_peered":"2024-04-25T09:55:35.760321+0000","last_unstale":"2024-04-25T09:55:35.764060+0000","last_undegraded":"2024-04-25T09:55:35.764060+0000","last_fullsized":"2024-04-25T09:55:35.764060+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:07.479394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.762942+0000","last_change":"2024-04-25T09:55:34.745543+0000","last_active":"2024-04-25T09:55:35.762942+0000","last_peered":"2024-04-25T09:55:35.762942+0000","last_clean":"2024-04-25T09:55:35.762942+0000","last_became_active":"2024-04-25T09:55:34.745243+0000","last_became_peered":"2024-04-25T09:55:34.745243+0000","last_unstale":"2024-04-25T09:55:35.762942+0000","last_undegraded":"2024-04-25T09:55:35.762942+0000","last_fullsized":"2024-04-25T09:55:35.762942+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:49.336547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.730036+0000","last_change":"2024-04-25T09:55:34.730036+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.730036+0000","last_undegraded":"2024-04-25T09:55:34.730036+0000","last_fullsized":"2024-04-25T09:55:34.730036+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.747850+0000","last_change":"2024-04-25T09:55:34.747086+0000","last_active":"2024-04-25T09:55:34.747850+0000","last_peered":"2024-04-25T09:55:34.747850+0000","last_clean":"2024-04-25T09:55:34.747850+0000","last_became_active":"2024-04-25T09:55:34.746760+0000","last_became_peered":"2024-04-25T09:55:34.746760+0000","last_unstale":"2024-04-25T09:55:34.747850+0000","last_undegraded":"2024-04-25T09:55:34.747850+0000","last_fullsized":"2024-04-25T09:55:34.747850+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:49.336547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.769019+0000","last_change":"2024-04-25T09:55:35.764169+0000","last_active":"2024-04-25T09:55:35.769019+0000","last_peered":"2024-04-25T09:55:35.769019+0000","last_clean":"2024-04-25T09:55:35.769019+0000","last_became_active":"2024-04-25T09:55:35.763842+0000","last_became_peered":"2024-04-25T09:55:35.763842+0000","last_unstale":"2024-04-25T09:55:35.769019+0000","last_undegraded":"2024-04-25T09:55:35.769019+0000","last_fullsized":"2024-04-25T09:55:35.769019+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:58.821504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.744649+0000","last_change":"2024-04-25T09:55:34.743621+0000","last_active":"2024-04-25T09:55:34.744649+0000","last_peered":"2024-04-25T09:55:34.744649+0000","last_clean":"2024-04-25T09:55:34.744649+0000","last_became_active":"2024-04-25T09:55:34.743238+0000","last_became_peered":"2024-04-25T09:55:34.743238+0000","last_unstale":"2024-04-25T09:55:34.744649+0000","last_undegraded":"2024-04-25T09:55:34.744649+0000","last_fullsized":"2024-04-25T09:55:34.744649+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:49.289488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.728924+0000","last_change":"2024-04-25T09:55:34.728924+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.728924+0000","last_undegraded":"2024-04-25T09:55:34.728924+0000","last_fullsized":"2024-04-25T09:55:34.728924+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.749586+0000","last_change":"2024-04-25T09:55:34.744009+0000","last_active":"2024-04-25T09:55:35.749586+0000","last_peered":"2024-04-25T09:55:35.749586+0000","last_clean":"2024-04-25T09:55:35.749586+0000","last_became_active":"2024-04-25T09:55:34.743062+0000","last_became_peered":"2024-04-25T09:55:34.743062+0000","last_unstale":"2024-04-25T09:55:35.749586+0000","last_undegraded":"2024-04-25T09:55:35.749586+0000","last_fullsized":"2024-04-25T09:55:35.749586+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:49.336547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.728747+0000","last_change":"2024-04-25T09:55:34.728747+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.728747+0000","last_undegraded":"2024-04-25T09:55:34.728747+0000","last_fullsized":"2024-04-25T09:55:34.728747+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.759042+0000","last_change":"2024-04-25T09:55:34.750441+0000","last_active":"2024-04-25T09:55:35.759042+0000","last_peered":"2024-04-25T09:55:35.759042+0000","last_clean":"2024-04-25T09:55:35.759042+0000","last_became_active":"2024-04-25T09:55:34.750055+0000","last_became_peered":"2024-04-25T09:55:34.750055+0000","last_unstale":"2024-04-25T09:55:35.759042+0000","last_undegraded":"2024-04-25T09:55:35.759042+0000","last_fullsized":"2024-04-25T09:55:35.759042+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:19.539959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773442+0000","last_change":"2024-04-25T09:55:35.765490+0000","last_active":"2024-04-25T09:55:35.773442+0000","last_peered":"2024-04-25T09:55:35.773442+0000","last_clean":"2024-04-25T09:55:35.773442+0000","last_became_active":"2024-04-25T09:55:35.762884+0000","last_became_peered":"2024-04-25T09:55:35.762884+0000","last_unstale":"2024-04-25T09:55:35.773442+0000","last_undegraded":"2024-04-25T09:55:35.773442+0000","last_fullsized":"2024-04-25T09:55:35.773442+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:34.458200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.760230+0000","last_change":"2024-04-25T09:55:34.744929+0000","last_active":"2024-04-25T09:55:35.760230+0000","last_peered":"2024-04-25T09:55:35.760230+0000","last_clean":"2024-04-25T09:55:35.760230+0000","last_became_active":"2024-04-25T09:55:34.744561+0000","last_became_peered":"2024-04-25T09:55:34.744561+0000","last_unstale":"2024-04-25T09:55:35.760230+0000","last_undegraded":"2024-04-25T09:55:35.760230+0000","last_fullsized":"2024-04-25T09:55:35.760230+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:24.062912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.767805+0000","last_change":"2024-04-25T09:55:35.763093+0000","last_active":"2024-04-25T09:55:35.767805+0000","last_peered":"2024-04-25T09:55:35.767805+0000","last_clean":"2024-04-25T09:55:35.767805+0000","last_became_active":"2024-04-25T09:55:35.762596+0000","last_became_peered":"2024-04-25T09:55:35.762596+0000","last_unstale":"2024-04-25T09:55:35.767805+0000","last_undegraded":"2024-04-25T09:55:35.767805+0000","last_fullsized":"2024-04-25T09:55:35.767805+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:43.087615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.750521+0000","last_change":"2024-04-25T09:55:34.749888+0000","last_active":"2024-04-25T09:55:34.750521+0000","last_peered":"2024-04-25T09:55:34.750521+0000","last_clean":"2024-04-25T09:55:34.750521+0000","last_became_active":"2024-04-25T09:55:34.749584+0000","last_became_peered":"2024-04-25T09:55:34.749584+0000","last_unstale":"2024-04-25T09:55:34.750521+0000","last_undegraded":"2024-04-25T09:55:34.750521+0000","last_fullsized":"2024-04-25T09:55:34.750521+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:49.336547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.728439+0000","last_change":"2024-04-25T09:55:34.728439+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.728439+0000","last_undegraded":"2024-04-25T09:55:34.728439+0000","last_fullsized":"2024-04-25T09:55:34.728439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.741286+0000","last_change":"2024-04-25T09:55:34.743854+0000","last_active":"2024-04-25T09:55:35.741286+0000","last_peered":"2024-04-25T09:55:35.741286+0000","last_clean":"2024-04-25T09:55:35.741286+0000","last_became_active":"2024-04-25T09:55:34.743570+0000","last_became_peered":"2024-04-25T09:55:34.743570+0000","last_unstale":"2024-04-25T09:55:35.741286+0000","last_undegraded":"2024-04-25T09:55:35.741286+0000","last_fullsized":"2024-04-25T09:55:35.741286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:14.801427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.731859+0000","last_change":"2024-04-25T09:55:34.731859+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.731859+0000","last_undegraded":"2024-04-25T09:55:34.731859+0000","last_fullsized":"2024-04-25T09:55:34.731859+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.735677+0000","last_change":"2024-04-25T09:55:34.734433+0000","last_active":"2024-04-25T09:55:34.735677+0000","last_peered":"2024-04-25T09:55:34.735677+0000","last_clean":"2024-04-25T09:55:34.735677+0000","last_became_active":"2024-04-25T09:55:34.733827+0000","last_became_peered":"2024-04-25T09:55:34.733827+0000","last_unstale":"2024-04-25T09:55:34.735677+0000","last_undegraded":"2024-04-25T09:55:34.735677+0000","last_fullsized":"2024-04-25T09:55:34.735677+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:19.539959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.772866+0000","last_change":"2024-04-25T09:55:35.765319+0000","last_active":"2024-04-25T09:55:35.772866+0000","last_peered":"2024-04-25T09:55:35.772866+0000","last_clean":"2024-04-25T09:55:35.772866+0000","last_became_active":"2024-04-25T09:55:35.764862+0000","last_became_peered":"2024-04-25T09:55:35.764862+0000","last_unstale":"2024-04-25T09:55:35.772866+0000","last_undegraded":"2024-04-25T09:55:35.772866+0000","last_fullsized":"2024-04-25T09:55:35.772866+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:58.065939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.750195+0000","last_change":"2024-04-25T09:55:34.749934+0000","last_active":"2024-04-25T09:55:35.750195+0000","last_peered":"2024-04-25T09:55:35.750195+0000","last_clean":"2024-04-25T09:55:35.750195+0000","last_became_active":"2024-04-25T09:55:34.748781+0000","last_became_peered":"2024-04-25T09:55:34.748781+0000","last_unstale":"2024-04-25T09:55:35.750195+0000","last_undegraded":"2024-04-25T09:55:35.750195+0000","last_fullsized":"2024-04-25T09:55:35.750195+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:42.081172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.728487+0000","last_change":"2024-04-25T09:55:34.728487+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.728487+0000","last_undegraded":"2024-04-25T09:55:34.728487+0000","last_fullsized":"2024-04-25T09:55:34.728487+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.768519+0000","last_change":"2024-04-25T09:55:34.751988+0000","last_active":"2024-04-25T09:55:35.768519+0000","last_peered":"2024-04-25T09:55:35.768519+0000","last_clean":"2024-04-25T09:55:35.768519+0000","last_became_active":"2024-04-25T09:55:34.751600+0000","last_became_peered":"2024-04-25T09:55:34.751600+0000","last_unstale":"2024-04-25T09:55:35.768519+0000","last_undegraded":"2024-04-25T09:55:35.768519+0000","last_fullsized":"2024-04-25T09:55:35.768519+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:57.815061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.753143+0000","last_change":"2024-04-25T09:55:35.745530+0000","last_active":"2024-04-25T09:55:35.753143+0000","last_peered":"2024-04-25T09:55:35.753143+0000","last_clean":"2024-04-25T09:55:35.753143+0000","last_became_active":"2024-04-25T09:55:35.745156+0000","last_became_peered":"2024-04-25T09:55:35.745156+0000","last_unstale":"2024-04-25T09:55:35.753143+0000","last_undegraded":"2024-04-25T09:55:35.753143+0000","last_fullsized":"2024-04-25T09:55:35.753143+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:25.069355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.747509+0000","last_change":"2024-04-25T09:55:34.746883+0000","last_active":"2024-04-25T09:55:34.747509+0000","last_peered":"2024-04-25T09:55:34.747509+0000","last_clean":"2024-04-25T09:55:34.747509+0000","last_became_active":"2024-04-25T09:55:34.746605+0000","last_became_peered":"2024-04-25T09:55:34.746605+0000","last_unstale":"2024-04-25T09:55:34.747509+0000","last_undegraded":"2024-04-25T09:55:34.747509+0000","last_fullsized":"2024-04-25T09:55:34.747509+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:42.081172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.728352+0000","last_change":"2024-04-25T09:55:34.728352+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.728352+0000","last_undegraded":"2024-04-25T09:55:34.728352+0000","last_fullsized":"2024-04-25T09:55:34.728352+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.735751+0000","last_change":"2024-04-25T09:55:34.734268+0000","last_active":"2024-04-25T09:55:34.735751+0000","last_peered":"2024-04-25T09:55:34.735751+0000","last_clean":"2024-04-25T09:55:34.735751+0000","last_became_active":"2024-04-25T09:55:34.733940+0000","last_became_peered":"2024-04-25T09:55:34.733940+0000","last_unstale":"2024-04-25T09:55:34.735751+0000","last_undegraded":"2024-04-25T09:55:34.735751+0000","last_fullsized":"2024-04-25T09:55:34.735751+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:22.625888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.726523+0000","last_change":"2024-04-25T09:55:34.726523+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.726523+0000","last_undegraded":"2024-04-25T09:55:34.726523+0000","last_fullsized":"2024-04-25T09:55:34.726523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.751808+0000","last_change":"2024-04-25T09:55:34.751004+0000","last_active":"2024-04-25T09:55:34.751808+0000","last_peered":"2024-04-25T09:55:34.751808+0000","last_clean":"2024-04-25T09:55:34.751808+0000","last_became_active":"2024-04-25T09:55:34.750719+0000","last_became_peered":"2024-04-25T09:55:34.750719+0000","last_unstale":"2024-04-25T09:55:34.751808+0000","last_undegraded":"2024-04-25T09:55:34.751808+0000","last_fullsized":"2024-04-25T09:55:34.751808+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:14.801427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.764461+0000","last_change":"2024-04-25T09:55:35.756163+0000","last_active":"2024-04-25T09:55:35.764461+0000","last_peered":"2024-04-25T09:55:35.764461+0000","last_clean":"2024-04-25T09:55:35.764461+0000","last_became_active":"2024-04-25T09:55:35.755652+0000","last_became_peered":"2024-04-25T09:55:35.755652+0000","last_unstale":"2024-04-25T09:55:35.764461+0000","last_undegraded":"2024-04-25T09:55:35.764461+0000","last_fullsized":"2024-04-25T09:55:35.764461+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:58.821504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.740102+0000","last_change":"2024-04-25T09:55:34.745319+0000","last_active":"2024-04-25T09:55:35.740102+0000","last_peered":"2024-04-25T09:55:35.740102+0000","last_clean":"2024-04-25T09:55:35.740102+0000","last_became_active":"2024-04-25T09:55:34.745029+0000","last_became_peered":"2024-04-25T09:55:34.745029+0000","last_unstale":"2024-04-25T09:55:35.740102+0000","last_undegraded":"2024-04-25T09:55:35.740102+0000","last_fullsized":"2024-04-25T09:55:35.740102+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:14.801427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.726983+0000","last_change":"2024-04-25T09:55:34.726983+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.726983+0000","last_undegraded":"2024-04-25T09:55:34.726983+0000","last_fullsized":"2024-04-25T09:55:34.726983+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.761411+0000","last_change":"2024-04-25T09:55:34.746478+0000","last_active":"2024-04-25T09:55:35.761411+0000","last_peered":"2024-04-25T09:55:35.761411+0000","last_clean":"2024-04-25T09:55:35.761411+0000","last_became_active":"2024-04-25T09:55:34.745385+0000","last_became_peered":"2024-04-25T09:55:34.745385+0000","last_unstale":"2024-04-25T09:55:35.761411+0000","last_undegraded":"2024-04-25T09:55:35.761411+0000","last_fullsized":"2024-04-25T09:55:35.761411+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:27.099991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727061+0000","last_change":"2024-04-25T09:55:34.727061+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727061+0000","last_undegraded":"2024-04-25T09:55:34.727061+0000","last_fullsized":"2024-04-25T09:55:34.727061+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.761760+0000","last_change":"2024-04-25T09:55:34.751912+0000","last_active":"2024-04-25T09:55:35.761760+0000","last_peered":"2024-04-25T09:55:35.761760+0000","last_clean":"2024-04-25T09:55:35.761760+0000","last_became_active":"2024-04-25T09:55:34.751601+0000","last_became_peered":"2024-04-25T09:55:34.751601+0000","last_unstale":"2024-04-25T09:55:35.761760+0000","last_undegraded":"2024-04-25T09:55:35.761760+0000","last_fullsized":"2024-04-25T09:55:35.761760+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:26.167108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773893+0000","last_change":"2024-04-25T09:55:35.767965+0000","last_active":"2024-04-25T09:55:35.773893+0000","last_peered":"2024-04-25T09:55:35.773893+0000","last_clean":"2024-04-25T09:55:35.773893+0000","last_became_active":"2024-04-25T09:55:35.767682+0000","last_became_peered":"2024-04-25T09:55:35.767682+0000","last_unstale":"2024-04-25T09:55:35.773893+0000","last_undegraded":"2024-04-25T09:55:35.773893+0000","last_fullsized":"2024-04-25T09:55:35.773893+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:03.959180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.767824+0000","last_change":"2024-04-25T09:55:34.752634+0000","last_active":"2024-04-25T09:55:35.767824+0000","last_peered":"2024-04-25T09:55:35.767824+0000","last_clean":"2024-04-25T09:55:35.767824+0000","last_became_active":"2024-04-25T09:55:34.752309+0000","last_became_peered":"2024-04-25T09:55:34.752309+0000","last_unstale":"2024-04-25T09:55:35.767824+0000","last_undegraded":"2024-04-25T09:55:35.767824+0000","last_fullsized":"2024-04-25T09:55:35.767824+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:27.099991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.763693+0000","last_change":"2024-04-25T09:55:35.749342+0000","last_active":"2024-04-25T09:55:35.763693+0000","last_peered":"2024-04-25T09:55:35.763693+0000","last_clean":"2024-04-25T09:55:35.763693+0000","last_became_active":"2024-04-25T09:55:35.749073+0000","last_became_peered":"2024-04-25T09:55:35.749073+0000","last_unstale":"2024-04-25T09:55:35.763693+0000","last_undegraded":"2024-04-25T09:55:35.763693+0000","last_fullsized":"2024-04-25T09:55:35.763693+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:23.632331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.749062+0000","last_change":"2024-04-25T09:55:34.748592+0000","last_active":"2024-04-25T09:55:34.749062+0000","last_peered":"2024-04-25T09:55:34.749062+0000","last_clean":"2024-04-25T09:55:34.749062+0000","last_became_active":"2024-04-25T09:55:34.748241+0000","last_became_peered":"2024-04-25T09:55:34.748241+0000","last_unstale":"2024-04-25T09:55:34.749062+0000","last_undegraded":"2024-04-25T09:55:34.749062+0000","last_fullsized":"2024-04-25T09:55:34.749062+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:58.101203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.731923+0000","last_change":"2024-04-25T09:55:34.731923+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.731923+0000","last_undegraded":"2024-04-25T09:55:34.731923+0000","last_fullsized":"2024-04-25T09:55:34.731923+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.746236+0000","last_change":"2024-04-25T09:55:34.744760+0000","last_active":"2024-04-25T09:55:34.746236+0000","last_peered":"2024-04-25T09:55:34.746236+0000","last_clean":"2024-04-25T09:55:34.746236+0000","last_became_active":"2024-04-25T09:55:34.744440+0000","last_became_peered":"2024-04-25T09:55:34.744440+0000","last_unstale":"2024-04-25T09:55:34.746236+0000","last_undegraded":"2024-04-25T09:55:34.746236+0000","last_fullsized":"2024-04-25T09:55:34.746236+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:32.776034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.763822+0000","last_change":"2024-04-25T09:55:35.756114+0000","last_active":"2024-04-25T09:55:35.763822+0000","last_peered":"2024-04-25T09:55:35.763822+0000","last_clean":"2024-04-25T09:55:35.763822+0000","last_became_active":"2024-04-25T09:55:35.755727+0000","last_became_peered":"2024-04-25T09:55:35.755727+0000","last_unstale":"2024-04-25T09:55:35.763822+0000","last_undegraded":"2024-04-25T09:55:35.763822+0000","last_fullsized":"2024-04-25T09:55:35.763822+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:23.632331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.737877+0000","last_change":"2024-04-25T09:55:34.737032+0000","last_active":"2024-04-25T09:55:34.737877+0000","last_peered":"2024-04-25T09:55:34.737877+0000","last_clean":"2024-04-25T09:55:34.737877+0000","last_became_active":"2024-04-25T09:55:34.736683+0000","last_became_peered":"2024-04-25T09:55:34.736683+0000","last_unstale":"2024-04-25T09:55:34.737877+0000","last_undegraded":"2024-04-25T09:55:34.737877+0000","last_fullsized":"2024-04-25T09:55:34.737877+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:49.623487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.730122+0000","last_change":"2024-04-25T09:55:34.730122+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.730122+0000","last_undegraded":"2024-04-25T09:55:34.730122+0000","last_fullsized":"2024-04-25T09:55:34.730122+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.745997+0000","last_change":"2024-04-25T09:55:34.745223+0000","last_active":"2024-04-25T09:55:34.745997+0000","last_peered":"2024-04-25T09:55:34.745997+0000","last_clean":"2024-04-25T09:55:34.745997+0000","last_became_active":"2024-04-25T09:55:34.744879+0000","last_became_peered":"2024-04-25T09:55:34.744879+0000","last_unstale":"2024-04-25T09:55:34.745997+0000","last_undegraded":"2024-04-25T09:55:34.745997+0000","last_fullsized":"2024-04-25T09:55:34.745997+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:15.660968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773369+0000","last_change":"2024-04-25T09:55:35.764920+0000","last_active":"2024-04-25T09:55:35.773369+0000","last_peered":"2024-04-25T09:55:35.773369+0000","last_clean":"2024-04-25T09:55:35.773369+0000","last_became_active":"2024-04-25T09:55:35.764523+0000","last_became_peered":"2024-04-25T09:55:35.764523+0000","last_unstale":"2024-04-25T09:55:35.773369+0000","last_undegraded":"2024-04-25T09:55:35.773369+0000","last_fullsized":"2024-04-25T09:55:35.773369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:12.411252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.744431+0000","last_change":"2024-04-25T09:55:34.747558+0000","last_active":"2024-04-25T09:55:35.744431+0000","last_peered":"2024-04-25T09:55:35.744431+0000","last_clean":"2024-04-25T09:55:35.744431+0000","last_became_active":"2024-04-25T09:55:34.747247+0000","last_became_peered":"2024-04-25T09:55:34.747247+0000","last_unstale":"2024-04-25T09:55:35.744431+0000","last_undegraded":"2024-04-25T09:55:35.744431+0000","last_fullsized":"2024-04-25T09:55:35.744431+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:36.739580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.726476+0000","last_change":"2024-04-25T09:55:34.726476+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.726476+0000","last_undegraded":"2024-04-25T09:55:34.726476+0000","last_fullsized":"2024-04-25T09:55:34.726476+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.740441+0000","last_change":"2024-04-25T09:55:34.738977+0000","last_active":"2024-04-25T09:55:34.740441+0000","last_peered":"2024-04-25T09:55:34.740441+0000","last_clean":"2024-04-25T09:55:34.740441+0000","last_became_active":"2024-04-25T09:55:34.738688+0000","last_became_peered":"2024-04-25T09:55:34.738688+0000","last_unstale":"2024-04-25T09:55:34.740441+0000","last_undegraded":"2024-04-25T09:55:34.740441+0000","last_fullsized":"2024-04-25T09:55:34.740441+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:08.898597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.729237+0000","last_change":"2024-04-25T09:55:34.729237+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.729237+0000","last_undegraded":"2024-04-25T09:55:34.729237+0000","last_fullsized":"2024-04-25T09:55:34.729237+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.759569+0000","last_change":"2024-04-25T09:55:34.751955+0000","last_active":"2024-04-25T09:55:35.759569+0000","last_peered":"2024-04-25T09:55:35.759569+0000","last_clean":"2024-04-25T09:55:35.759569+0000","last_became_active":"2024-04-25T09:55:34.751661+0000","last_became_peered":"2024-04-25T09:55:34.751661+0000","last_unstale":"2024-04-25T09:55:35.759569+0000","last_undegraded":"2024-04-25T09:55:35.759569+0000","last_fullsized":"2024-04-25T09:55:35.759569+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:22.625888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.772888+0000","last_change":"2024-04-25T09:55:35.765747+0000","last_active":"2024-04-25T09:55:35.772888+0000","last_peered":"2024-04-25T09:55:35.772888+0000","last_clean":"2024-04-25T09:55:35.772888+0000","last_became_active":"2024-04-25T09:55:35.765400+0000","last_became_peered":"2024-04-25T09:55:35.765400+0000","last_unstale":"2024-04-25T09:55:35.772888+0000","last_undegraded":"2024-04-25T09:55:35.772888+0000","last_fullsized":"2024-04-25T09:55:35.772888+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:10.115716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.750254+0000","last_change":"2024-04-25T09:55:34.749607+0000","last_active":"2024-04-25T09:55:34.750254+0000","last_peered":"2024-04-25T09:55:34.750254+0000","last_clean":"2024-04-25T09:55:34.750254+0000","last_became_active":"2024-04-25T09:55:34.749293+0000","last_became_peered":"2024-04-25T09:55:34.749293+0000","last_unstale":"2024-04-25T09:55:34.750254+0000","last_undegraded":"2024-04-25T09:55:34.750254+0000","last_fullsized":"2024-04-25T09:55:34.750254+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:47.145780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.726240+0000","last_change":"2024-04-25T09:55:34.726240+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.726240+0000","last_undegraded":"2024-04-25T09:55:34.726240+0000","last_fullsized":"2024-04-25T09:55:34.726240+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.735927+0000","last_change":"2024-04-25T09:55:34.734044+0000","last_active":"2024-04-25T09:55:34.735927+0000","last_peered":"2024-04-25T09:55:34.735927+0000","last_clean":"2024-04-25T09:55:34.735927+0000","last_became_active":"2024-04-25T09:55:34.733742+0000","last_became_peered":"2024-04-25T09:55:34.733742+0000","last_unstale":"2024-04-25T09:55:34.735927+0000","last_undegraded":"2024-04-25T09:55:34.735927+0000","last_fullsized":"2024-04-25T09:55:34.735927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:49.289488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727916+0000","last_change":"2024-04-25T09:55:34.727916+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727916+0000","last_undegraded":"2024-04-25T09:55:34.727916+0000","last_fullsized":"2024-04-25T09:55:34.727916+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.738952+0000","last_change":"2024-04-25T09:55:34.738180+0000","last_active":"2024-04-25T09:55:34.738952+0000","last_peered":"2024-04-25T09:55:34.738952+0000","last_clean":"2024-04-25T09:55:34.738952+0000","last_became_active":"2024-04-25T09:55:34.737894+0000","last_became_peered":"2024-04-25T09:55:34.737894+0000","last_unstale":"2024-04-25T09:55:34.738952+0000","last_undegraded":"2024-04-25T09:55:34.738952+0000","last_fullsized":"2024-04-25T09:55:34.738952+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:32.776034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727617+0000","last_change":"2024-04-25T09:55:34.727617+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727617+0000","last_undegraded":"2024-04-25T09:55:34.727617+0000","last_fullsized":"2024-04-25T09:55:34.727617+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.739163+0000","last_change":"2024-04-25T09:55:34.742098+0000","last_active":"2024-04-25T09:55:35.739163+0000","last_peered":"2024-04-25T09:55:35.739163+0000","last_clean":"2024-04-25T09:55:35.739163+0000","last_became_active":"2024-04-25T09:55:34.741787+0000","last_became_peered":"2024-04-25T09:55:34.741787+0000","last_unstale":"2024-04-25T09:55:35.739163+0000","last_undegraded":"2024-04-25T09:55:35.739163+0000","last_fullsized":"2024-04-25T09:55:35.739163+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:32.776034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.752849+0000","last_change":"2024-04-25T09:55:35.746484+0000","last_active":"2024-04-25T09:55:35.752849+0000","last_peered":"2024-04-25T09:55:35.752849+0000","last_clean":"2024-04-25T09:55:35.752849+0000","last_became_active":"2024-04-25T09:55:35.746195+0000","last_became_peered":"2024-04-25T09:55:35.746195+0000","last_unstale":"2024-04-25T09:55:35.752849+0000","last_undegraded":"2024-04-25T09:55:35.752849+0000","last_fullsized":"2024-04-25T09:55:35.752849+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:37.746023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.741723+0000","last_change":"2024-04-25T09:55:34.743941+0000","last_active":"2024-04-25T09:55:35.741723+0000","last_peered":"2024-04-25T09:55:35.741723+0000","last_clean":"2024-04-25T09:55:35.741723+0000","last_became_active":"2024-04-25T09:55:34.743567+0000","last_became_peered":"2024-04-25T09:55:34.743567+0000","last_unstale":"2024-04-25T09:55:35.741723+0000","last_undegraded":"2024-04-25T09:55:35.741723+0000","last_fullsized":"2024-04-25T09:55:35.741723+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:12.241234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.772778+0000","last_change":"2024-04-25T09:55:35.765142+0000","last_active":"2024-04-25T09:55:35.772778+0000","last_peered":"2024-04-25T09:55:35.772778+0000","last_clean":"2024-04-25T09:55:35.772778+0000","last_became_active":"2024-04-25T09:55:35.764844+0000","last_became_peered":"2024-04-25T09:55:35.764844+0000","last_unstale":"2024-04-25T09:55:35.772778+0000","last_undegraded":"2024-04-25T09:55:35.772778+0000","last_fullsized":"2024-04-25T09:55:35.772778+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:12.257881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.735709+0000","last_change":"2024-04-25T09:55:34.731152+0000","last_active":"2024-04-25T09:55:34.735709+0000","last_peered":"2024-04-25T09:55:34.735709+0000","last_clean":"2024-04-25T09:55:34.735709+0000","last_became_active":"2024-04-25T09:55:34.730845+0000","last_became_peered":"2024-04-25T09:55:34.730845+0000","last_unstale":"2024-04-25T09:55:34.735709+0000","last_undegraded":"2024-04-25T09:55:34.735709+0000","last_fullsized":"2024-04-25T09:55:34.735709+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:26.167108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773156+0000","last_change":"2024-04-25T09:55:35.762049+0000","last_active":"2024-04-25T09:55:35.773156+0000","last_peered":"2024-04-25T09:55:35.773156+0000","last_clean":"2024-04-25T09:55:35.773156+0000","last_became_active":"2024-04-25T09:55:35.761764+0000","last_became_peered":"2024-04-25T09:55:35.761764+0000","last_unstale":"2024-04-25T09:55:35.773156+0000","last_undegraded":"2024-04-25T09:55:35.773156+0000","last_fullsized":"2024-04-25T09:55:35.773156+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:58.065939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.744977+0000","last_change":"2024-04-25T09:55:34.746165+0000","last_active":"2024-04-25T09:55:35.744977+0000","last_peered":"2024-04-25T09:55:35.744977+0000","last_clean":"2024-04-25T09:55:35.744977+0000","last_became_active":"2024-04-25T09:55:34.745859+0000","last_became_peered":"2024-04-25T09:55:34.745859+0000","last_unstale":"2024-04-25T09:55:35.744977+0000","last_undegraded":"2024-04-25T09:55:35.744977+0000","last_fullsized":"2024-04-25T09:55:35.744977+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:26.167108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.744054+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T09:55:35.744054+0000","last_peered":"2024-04-25T09:55:35.744054+0000","last_clean":"2024-04-25T09:55:35.744054+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T09:55:35.744054+0000","last_undegraded":"2024-04-25T09:55:35.744054+0000","last_fullsized":"2024-04-25T09:55:35.744054+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":694,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542163,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1015808,"data_stored":770080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542163,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":179712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542165,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":421888,"data_stored":179712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":179712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":409600,"data_stored":173045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":409600,"data_stored":173045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":409600,"data_stored":173045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1003520,"data_stored":763413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:55:39.096 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:55:39.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.230+0000 7f435cecb640 1 Processor -- start 2024-04-25T09:55:39.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.230+0000 7f435cecb640 1 -- start start 2024-04-25T09:55:39.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.231+0000 7f435cecb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f435815db00 0x7f43580d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:39.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.231+0000 7f435cecb640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f43580ce2b0 0x7f43580d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:39.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.231+0000 7f435cecb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43580d1e80 con 0x7f43580b53b0 2024-04-25T09:55:39.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.231+0000 7f435cecb640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43580b5930 con 0x7f43580ce2b0 2024-04-25T09:55:39.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.231+0000 7f435cecb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43580b5c10 con 0x7f435815db00 2024-04-25T09:55:39.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.231+0000 7f4356d9d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f43580ce2b0 0x7f43580d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:39.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.231+0000 7f4356d9d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f43580ce2b0 0x7f43580d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42262/0 (socket says 172.21.15.7:42262) 2024-04-25T09:55:39.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.231+0000 7f4356d9d640 1 -- 172.21.15.7:0/4155156300 learned_addr learned my addr 172.21.15.7:0/4155156300 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:39.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.232+0000 7f435659c640 1 --2- 172.21.15.7:0/4155156300 >> v2:172.21.15.55:3300/0 conn(0x7f435815db00 0x7f43580d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:39.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.232+0000 7f4356d9d640 1 -- 172.21.15.7:0/4155156300 >> v2:172.21.15.55:3300/0 conn(0x7f435815db00 msgr2=0x7f43580d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:39.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.232+0000 7f4356d9d640 1 --2- 172.21.15.7:0/4155156300 >> v2:172.21.15.55:3300/0 conn(0x7f435815db00 0x7f43580d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:39.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.232+0000 7f4356d9d640 1 -- 172.21.15.7:0/4155156300 >> v1:172.21.15.55:6789/0 conn(0x7f43580b53b0 legacy=0x7f4358161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:39.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.232+0000 7f4356d9d640 1 -- 172.21.15.7:0/4155156300 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43580b5ef0 con 0x7f43580ce2b0 2024-04-25T09:55:39.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.232+0000 7f4356d9d640 1 --2- 172.21.15.7:0/4155156300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43580ce2b0 0x7f43580d0880 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f43580d4940 tx=0x7f434802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b46ee6afe81d8525 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:39.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.233+0000 7f435559a640 1 -- 172.21.15.7:0/4155156300 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4348036070 con 0x7f43580ce2b0 2024-04-25T09:55:39.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.233+0000 7f435559a640 1 -- 172.21.15.7:0/4155156300 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4348031600 con 0x7f43580ce2b0 2024-04-25T09:55:39.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.233+0000 7f435559a640 1 -- 172.21.15.7:0/4155156300 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43480319d0 con 0x7f43580ce2b0 2024-04-25T09:55:39.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.233+0000 7f435cecb640 1 -- 172.21.15.7:0/4155156300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43580ce2b0 msgr2=0x7f43580d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:39.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.233+0000 7f435cecb640 1 --2- 172.21.15.7:0/4155156300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43580ce2b0 0x7f43580d0880 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f43580d4940 tx=0x7f434802a6f0 comp rx=0 tx=0).stop 2024-04-25T09:55:39.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.233+0000 7f435cecb640 1 -- 172.21.15.7:0/4155156300 shutdown_connections 2024-04-25T09:55:39.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.233+0000 7f435cecb640 1 --2- 172.21.15.7:0/4155156300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43580ce2b0 0x7f43580d0880 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:39.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.233+0000 7f435cecb640 1 --2- 172.21.15.7:0/4155156300 >> v2:172.21.15.55:3300/0 conn(0x7f435815db00 0x7f43580d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:39.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.233+0000 7f435cecb640 1 -- 172.21.15.7:0/4155156300 >> 172.21.15.7:0/4155156300 conn(0x7f4358072290 msgr2=0x7f43580726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:39.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.233+0000 7f435cecb640 1 -- 172.21.15.7:0/4155156300 shutdown_connections 2024-04-25T09:55:39.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.233+0000 7f435cecb640 1 -- 172.21.15.7:0/4155156300 wait complete. 2024-04-25T09:55:39.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.235+0000 7f435cecb640 1 Processor -- start 2024-04-25T09:55:39.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.235+0000 7f435cecb640 1 -- start start 2024-04-25T09:55:39.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.235+0000 7f435cecb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43580b53b0 0x7f43580c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:39.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.235+0000 7f435cecb640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f43580ce2b0 0x7f435814bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:39.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.235+0000 7f435cecb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f435815db00 0x7f435814c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:39.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.235+0000 7f435cecb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43580d3660 con 0x7f43580b53b0 2024-04-25T09:55:39.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.235+0000 7f435cecb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43580b61d0 con 0x7f435815db00 2024-04-25T09:55:39.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.235+0000 7f435cecb640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43580b6c10 con 0x7f43580ce2b0 2024-04-25T09:55:39.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.236+0000 7f435659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43580b53b0 0x7f43580c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:39.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.236+0000 7f435659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43580b53b0 0x7f43580c95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42276/0 (socket says 172.21.15.7:42276) 2024-04-25T09:55:39.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.236+0000 7f435659c640 1 -- 172.21.15.7:0/1594586052 learned_addr learned my addr 172.21.15.7:0/1594586052 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:39.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.236+0000 7f435659c640 1 -- 172.21.15.7:0/1594586052 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f43580ce2b0 msgr2=0x7f435814bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:39.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.236+0000 7f435659c640 1 --2- 172.21.15.7:0/1594586052 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f43580ce2b0 0x7f435814bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:39.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.236+0000 7f435659c640 1 -- 172.21.15.7:0/1594586052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f435815db00 msgr2=0x7f435814c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:39.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.236+0000 7f435659c640 1 --2- 172.21.15.7:0/1594586052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f435815db00 0x7f435814c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:39.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.236+0000 7f435659c640 1 -- 172.21.15.7:0/1594586052 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43580c7f10 con 0x7f43580b53b0 2024-04-25T09:55:39.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.236+0000 7f435659c640 1 --2- 172.21.15.7:0/1594586052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43580b53b0 0x7f43580c95c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f435000d5f0 tx=0x7f435000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:39.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.236+0000 7f434effd640 1 -- 172.21.15.7:0/1594586052 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43500125f0 con 0x7f43580b53b0 2024-04-25T09:55:39.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.236+0000 7f434effd640 1 -- 172.21.15.7:0/1594586052 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4350019070 con 0x7f43580b53b0 2024-04-25T09:55:39.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.236+0000 7f435cecb640 1 -- 172.21.15.7:0/1594586052 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43580c81f0 con 0x7f43580b53b0 2024-04-25T09:55:39.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.236+0000 7f434effd640 1 -- 172.21.15.7:0/1594586052 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43500129d0 con 0x7f43580b53b0 2024-04-25T09:55:39.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.236+0000 7f435cecb640 1 -- 172.21.15.7:0/1594586052 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43580c87b0 con 0x7f43580b53b0 2024-04-25T09:55:39.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.237+0000 7f435cecb640 1 -- 172.21.15.7:0/1594586052 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4358068fd0 con 0x7f43580b53b0 2024-04-25T09:55:39.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.238+0000 7f434effd640 1 -- 172.21.15.7:0/1594586052 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4350012b70 con 0x7f43580b53b0 2024-04-25T09:55:39.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.238+0000 7f434effd640 1 --2- 172.21.15.7:0/1594586052 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f433806b500 0x7f433806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:39.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.238+0000 7f434effd640 1 -- 172.21.15.7:0/1594586052 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f435008a760 con 0x7f43580b53b0 2024-04-25T09:55:39.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.238+0000 7f4355d9b640 1 --2- 172.21.15.7:0/1594586052 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f433806b500 0x7f433806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:39.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.239+0000 7f4355d9b640 1 --2- 172.21.15.7:0/1594586052 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f433806b500 0x7f433806d9c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4358155140 tx=0x7f43400079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:39.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.243+0000 7f434effd640 1 -- 172.21.15.7:0/1594586052 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4350059450 con 0x7f43580b53b0 2024-04-25T09:55:39.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.417+0000 7f435cecb640 1 -- 172.21.15.7:0/1594586052 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f43580d16b0 con 0x7f433806b500 2024-04-25T09:55:39.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.423+0000 7f434effd640 1 -- 172.21.15.7:0/1594586052 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249429 (secure 0 0 0) 0x7f43580d16b0 con 0x7f433806b500 2024-04-25T09:55:39.429 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:39.430 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T09:55:39.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.426+0000 7f435cecb640 1 -- 172.21.15.7:0/1594586052 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f433806b500 msgr2=0x7f433806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:39.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.426+0000 7f435cecb640 1 --2- 172.21.15.7:0/1594586052 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f433806b500 0x7f433806d9c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4358155140 tx=0x7f43400079b0 comp rx=0 tx=0).stop 2024-04-25T09:55:39.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.426+0000 7f435cecb640 1 -- 172.21.15.7:0/1594586052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43580b53b0 msgr2=0x7f43580c95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:39.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.426+0000 7f435cecb640 1 --2- 172.21.15.7:0/1594586052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43580b53b0 0x7f43580c95c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f435000d5f0 tx=0x7f435000dab0 comp rx=0 tx=0).stop 2024-04-25T09:55:39.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.426+0000 7f435cecb640 1 -- 172.21.15.7:0/1594586052 shutdown_connections 2024-04-25T09:55:39.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.426+0000 7f435cecb640 1 --2- 172.21.15.7:0/1594586052 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f433806b500 0x7f433806d9c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:39.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.426+0000 7f435cecb640 1 --2- 172.21.15.7:0/1594586052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f435815db00 0x7f435814c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:39.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.426+0000 7f435cecb640 1 --2- 172.21.15.7:0/1594586052 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f43580ce2b0 0x7f435814bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:39.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.426+0000 7f435cecb640 1 --2- 172.21.15.7:0/1594586052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43580b53b0 0x7f43580c95c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:39.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.426+0000 7f435cecb640 1 -- 172.21.15.7:0/1594586052 >> 172.21.15.7:0/1594586052 conn(0x7f4358072290 msgr2=0x7f43580d37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:39.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.426+0000 7f435cecb640 1 -- 172.21.15.7:0/1594586052 shutdown_connections 2024-04-25T09:55:39.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.426+0000 7f435cecb640 1 -- 172.21.15.7:0/1594586052 wait complete. 2024-04-25T09:55:39.440 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-04-25T09:55:37.868426+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591062,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":189,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":245532,"kb_used_data":4408,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754729188,"statfs":{"total":773094113280,"available":772842688512,"internally_reserved":0,"allocated":4513792,"data_stored":2591764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":246795825},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":694,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.156837"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.729869+0000","last_change":"2024-04-25T09:55:34.729869+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.729869+0000","last_undegraded":"2024-04-25T09:55:34.729869+0000","last_fullsized":"2024-04-25T09:55:34.729869+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.730011+0000","last_change":"2024-04-25T09:55:34.730011+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.730011+0000","last_undegraded":"2024-04-25T09:55:34.730011+0000","last_fullsized":"2024-04-25T09:55:34.730011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727236+0000","last_change":"2024-04-25T09:55:34.727236+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727236+0000","last_undegraded":"2024-04-25T09:55:34.727236+0000","last_fullsized":"2024-04-25T09:55:34.727236+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.734467+0000","last_change":"2024-04-25T09:55:34.734467+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.734467+0000","last_undegraded":"2024-04-25T09:55:34.734467+0000","last_fullsized":"2024-04-25T09:55:34.734467+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.733882+0000","last_change":"2024-04-25T09:55:34.733882+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.733882+0000","last_undegraded":"2024-04-25T09:55:34.733882+0000","last_fullsized":"2024-04-25T09:55:34.733882+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727866+0000","last_change":"2024-04-25T09:55:34.727866+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727866+0000","last_undegraded":"2024-04-25T09:55:34.727866+0000","last_fullsized":"2024-04-25T09:55:34.727866+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773290+0000","last_change":"2024-04-25T09:55:35.764026+0000","last_active":"2024-04-25T09:55:35.773290+0000","last_peered":"2024-04-25T09:55:35.773290+0000","last_clean":"2024-04-25T09:55:35.773290+0000","last_became_active":"2024-04-25T09:55:35.763499+0000","last_became_peered":"2024-04-25T09:55:35.763499+0000","last_unstale":"2024-04-25T09:55:35.773290+0000","last_undegraded":"2024-04-25T09:55:35.773290+0000","last_fullsized":"2024-04-25T09:55:35.773290+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:53.251434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.729371+0000","last_change":"2024-04-25T09:55:34.729371+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.729371+0000","last_undegraded":"2024-04-25T09:55:34.729371+0000","last_fullsized":"2024-04-25T09:55:34.729371+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727715+0000","last_change":"2024-04-25T09:55:34.727715+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727715+0000","last_undegraded":"2024-04-25T09:55:34.727715+0000","last_fullsized":"2024-04-25T09:55:34.727715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773363+0000","last_change":"2024-04-25T09:55:35.764915+0000","last_active":"2024-04-25T09:55:35.773363+0000","last_peered":"2024-04-25T09:55:35.773363+0000","last_clean":"2024-04-25T09:55:35.773363+0000","last_became_active":"2024-04-25T09:55:35.764601+0000","last_became_peered":"2024-04-25T09:55:35.764601+0000","last_unstale":"2024-04-25T09:55:35.773363+0000","last_undegraded":"2024-04-25T09:55:35.773363+0000","last_fullsized":"2024-04-25T09:55:35.773363+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:59.279223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773868+0000","last_change":"2024-04-25T09:55:35.768030+0000","last_active":"2024-04-25T09:55:35.773868+0000","last_peered":"2024-04-25T09:55:35.773868+0000","last_clean":"2024-04-25T09:55:35.773868+0000","last_became_active":"2024-04-25T09:55:35.767735+0000","last_became_peered":"2024-04-25T09:55:35.767735+0000","last_unstale":"2024-04-25T09:55:35.773868+0000","last_undegraded":"2024-04-25T09:55:35.773868+0000","last_fullsized":"2024-04-25T09:55:35.773868+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:31:37.702240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727470+0000","last_change":"2024-04-25T09:55:34.727470+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727470+0000","last_undegraded":"2024-04-25T09:55:34.727470+0000","last_fullsized":"2024-04-25T09:55:34.727470+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773102+0000","last_change":"2024-04-25T09:55:35.759552+0000","last_active":"2024-04-25T09:55:35.773102+0000","last_peered":"2024-04-25T09:55:35.773102+0000","last_clean":"2024-04-25T09:55:35.773102+0000","last_became_active":"2024-04-25T09:55:35.759261+0000","last_became_peered":"2024-04-25T09:55:35.759261+0000","last_unstale":"2024-04-25T09:55:35.773102+0000","last_undegraded":"2024-04-25T09:55:35.773102+0000","last_fullsized":"2024-04-25T09:55:35.773102+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:07.479394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.767781+0000","last_change":"2024-04-25T09:55:35.762865+0000","last_active":"2024-04-25T09:55:35.767781+0000","last_peered":"2024-04-25T09:55:35.767781+0000","last_clean":"2024-04-25T09:55:35.767781+0000","last_became_active":"2024-04-25T09:55:35.762187+0000","last_became_peered":"2024-04-25T09:55:35.762187+0000","last_unstale":"2024-04-25T09:55:35.767781+0000","last_undegraded":"2024-04-25T09:55:35.767781+0000","last_fullsized":"2024-04-25T09:55:35.767781+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:20.546402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773267+0000","last_change":"2024-04-25T09:55:35.763794+0000","last_active":"2024-04-25T09:55:35.773267+0000","last_peered":"2024-04-25T09:55:35.773267+0000","last_clean":"2024-04-25T09:55:35.773267+0000","last_became_active":"2024-04-25T09:55:35.763203+0000","last_became_peered":"2024-04-25T09:55:35.763203+0000","last_unstale":"2024-04-25T09:55:35.773267+0000","last_undegraded":"2024-04-25T09:55:35.773267+0000","last_fullsized":"2024-04-25T09:55:35.773267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:10.115716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.764092+0000","last_change":"2024-04-25T09:55:35.760046+0000","last_active":"2024-04-25T09:55:35.764092+0000","last_peered":"2024-04-25T09:55:35.764092+0000","last_clean":"2024-04-25T09:55:35.764092+0000","last_became_active":"2024-04-25T09:55:35.759769+0000","last_became_peered":"2024-04-25T09:55:35.759769+0000","last_unstale":"2024-04-25T09:55:35.764092+0000","last_undegraded":"2024-04-25T09:55:35.764092+0000","last_fullsized":"2024-04-25T09:55:35.764092+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:02.497946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773399+0000","last_change":"2024-04-25T09:55:35.768514+0000","last_active":"2024-04-25T09:55:35.773399+0000","last_peered":"2024-04-25T09:55:35.773399+0000","last_clean":"2024-04-25T09:55:35.773399+0000","last_became_active":"2024-04-25T09:55:35.768212+0000","last_became_peered":"2024-04-25T09:55:35.768212+0000","last_unstale":"2024-04-25T09:55:35.773399+0000","last_undegraded":"2024-04-25T09:55:35.773399+0000","last_fullsized":"2024-04-25T09:55:35.773399+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:53.251434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.772951+0000","last_change":"2024-04-25T09:55:35.766182+0000","last_active":"2024-04-25T09:55:35.772951+0000","last_peered":"2024-04-25T09:55:35.772951+0000","last_clean":"2024-04-25T09:55:35.772951+0000","last_became_active":"2024-04-25T09:55:35.765914+0000","last_became_peered":"2024-04-25T09:55:35.765914+0000","last_unstale":"2024-04-25T09:55:35.772951+0000","last_undegraded":"2024-04-25T09:55:35.772951+0000","last_fullsized":"2024-04-25T09:55:35.772951+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:23.632331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.733244+0000","last_change":"2024-04-25T09:55:34.733244+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.733244+0000","last_undegraded":"2024-04-25T09:55:34.733244+0000","last_fullsized":"2024-04-25T09:55:34.733244+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.772798+0000","last_change":"2024-04-25T09:55:35.761736+0000","last_active":"2024-04-25T09:55:35.772798+0000","last_peered":"2024-04-25T09:55:35.772798+0000","last_clean":"2024-04-25T09:55:35.772798+0000","last_became_active":"2024-04-25T09:55:35.761387+0000","last_became_peered":"2024-04-25T09:55:35.761387+0000","last_unstale":"2024-04-25T09:55:35.772798+0000","last_undegraded":"2024-04-25T09:55:35.772798+0000","last_fullsized":"2024-04-25T09:55:35.772798+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:27.173551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773130+0000","last_change":"2024-04-25T09:55:35.759573+0000","last_active":"2024-04-25T09:55:35.773130+0000","last_peered":"2024-04-25T09:55:35.773130+0000","last_clean":"2024-04-25T09:55:35.773130+0000","last_became_active":"2024-04-25T09:55:35.759200+0000","last_became_peered":"2024-04-25T09:55:35.759200+0000","last_unstale":"2024-04-25T09:55:35.773130+0000","last_undegraded":"2024-04-25T09:55:35.773130+0000","last_fullsized":"2024-04-25T09:55:35.773130+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:12.257881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.758730+0000","last_change":"2024-04-25T09:55:35.747716+0000","last_active":"2024-04-25T09:55:35.758730+0000","last_peered":"2024-04-25T09:55:35.758730+0000","last_clean":"2024-04-25T09:55:35.758730+0000","last_became_active":"2024-04-25T09:55:35.747370+0000","last_became_peered":"2024-04-25T09:55:35.747370+0000","last_unstale":"2024-04-25T09:55:35.758730+0000","last_undegraded":"2024-04-25T09:55:35.758730+0000","last_fullsized":"2024-04-25T09:55:35.758730+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:27.173551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.763900+0000","last_change":"2024-04-25T09:55:35.756163+0000","last_active":"2024-04-25T09:55:35.763900+0000","last_peered":"2024-04-25T09:55:35.763900+0000","last_clean":"2024-04-25T09:55:35.763900+0000","last_became_active":"2024-04-25T09:55:35.755783+0000","last_became_peered":"2024-04-25T09:55:35.755783+0000","last_unstale":"2024-04-25T09:55:35.763900+0000","last_undegraded":"2024-04-25T09:55:35.763900+0000","last_fullsized":"2024-04-25T09:55:35.763900+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:43.087615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.732715+0000","last_change":"2024-04-25T09:55:34.732715+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.732715+0000","last_undegraded":"2024-04-25T09:55:34.732715+0000","last_fullsized":"2024-04-25T09:55:34.732715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.761341+0000","last_change":"2024-04-25T09:55:35.749966+0000","last_active":"2024-04-25T09:55:35.761341+0000","last_peered":"2024-04-25T09:55:35.761341+0000","last_clean":"2024-04-25T09:55:35.761341+0000","last_became_active":"2024-04-25T09:55:35.749527+0000","last_became_peered":"2024-04-25T09:55:35.749527+0000","last_unstale":"2024-04-25T09:55:35.761341+0000","last_undegraded":"2024-04-25T09:55:35.761341+0000","last_fullsized":"2024-04-25T09:55:35.761341+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:13.247677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.730311+0000","last_change":"2024-04-25T09:55:34.730311+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.730311+0000","last_undegraded":"2024-04-25T09:55:34.730311+0000","last_fullsized":"2024-04-25T09:55:34.730311+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.760704+0000","last_change":"2024-04-25T09:55:35.750137+0000","last_active":"2024-04-25T09:55:35.760704+0000","last_peered":"2024-04-25T09:55:35.760704+0000","last_clean":"2024-04-25T09:55:35.760704+0000","last_became_active":"2024-04-25T09:55:35.749850+0000","last_became_peered":"2024-04-25T09:55:35.749850+0000","last_unstale":"2024-04-25T09:55:35.760704+0000","last_undegraded":"2024-04-25T09:55:35.760704+0000","last_fullsized":"2024-04-25T09:55:35.760704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:28.106434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773079+0000","last_change":"2024-04-25T09:55:35.759353+0000","last_active":"2024-04-25T09:55:35.773079+0000","last_peered":"2024-04-25T09:55:35.773079+0000","last_clean":"2024-04-25T09:55:35.773079+0000","last_became_active":"2024-04-25T09:55:35.758976+0000","last_became_peered":"2024-04-25T09:55:35.758976+0000","last_unstale":"2024-04-25T09:55:35.773079+0000","last_undegraded":"2024-04-25T09:55:35.773079+0000","last_fullsized":"2024-04-25T09:55:35.773079+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:02.497946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.761770+0000","last_change":"2024-04-25T09:55:35.759021+0000","last_active":"2024-04-25T09:55:35.761770+0000","last_peered":"2024-04-25T09:55:35.761770+0000","last_clean":"2024-04-25T09:55:35.761770+0000","last_became_active":"2024-04-25T09:55:35.758662+0000","last_became_peered":"2024-04-25T09:55:35.758662+0000","last_unstale":"2024-04-25T09:55:35.761770+0000","last_undegraded":"2024-04-25T09:55:35.761770+0000","last_fullsized":"2024-04-25T09:55:35.761770+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:37.746023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.760726+0000","last_change":"2024-04-25T09:55:35.752315+0000","last_active":"2024-04-25T09:55:35.760726+0000","last_peered":"2024-04-25T09:55:35.760726+0000","last_clean":"2024-04-25T09:55:35.760726+0000","last_became_active":"2024-04-25T09:55:35.750495+0000","last_became_peered":"2024-04-25T09:55:35.750495+0000","last_unstale":"2024-04-25T09:55:35.760726+0000","last_undegraded":"2024-04-25T09:55:35.760726+0000","last_fullsized":"2024-04-25T09:55:35.760726+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:25.069355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.763873+0000","last_change":"2024-04-25T09:55:35.756176+0000","last_active":"2024-04-25T09:55:35.763873+0000","last_peered":"2024-04-25T09:55:35.763873+0000","last_clean":"2024-04-25T09:55:35.763873+0000","last_became_active":"2024-04-25T09:55:35.755837+0000","last_became_peered":"2024-04-25T09:55:35.755837+0000","last_unstale":"2024-04-25T09:55:35.763873+0000","last_undegraded":"2024-04-25T09:55:35.763873+0000","last_fullsized":"2024-04-25T09:55:35.763873+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:20.546402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727558+0000","last_change":"2024-04-25T09:55:34.727558+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727558+0000","last_undegraded":"2024-04-25T09:55:34.727558+0000","last_fullsized":"2024-04-25T09:55:34.727558+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.764060+0000","last_change":"2024-04-25T09:55:35.760617+0000","last_active":"2024-04-25T09:55:35.764060+0000","last_peered":"2024-04-25T09:55:35.764060+0000","last_clean":"2024-04-25T09:55:35.764060+0000","last_became_active":"2024-04-25T09:55:35.760321+0000","last_became_peered":"2024-04-25T09:55:35.760321+0000","last_unstale":"2024-04-25T09:55:35.764060+0000","last_undegraded":"2024-04-25T09:55:35.764060+0000","last_fullsized":"2024-04-25T09:55:35.764060+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:07.479394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.762942+0000","last_change":"2024-04-25T09:55:34.745543+0000","last_active":"2024-04-25T09:55:35.762942+0000","last_peered":"2024-04-25T09:55:35.762942+0000","last_clean":"2024-04-25T09:55:35.762942+0000","last_became_active":"2024-04-25T09:55:34.745243+0000","last_became_peered":"2024-04-25T09:55:34.745243+0000","last_unstale":"2024-04-25T09:55:35.762942+0000","last_undegraded":"2024-04-25T09:55:35.762942+0000","last_fullsized":"2024-04-25T09:55:35.762942+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:49.336547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.730036+0000","last_change":"2024-04-25T09:55:34.730036+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.730036+0000","last_undegraded":"2024-04-25T09:55:34.730036+0000","last_fullsized":"2024-04-25T09:55:34.730036+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.747850+0000","last_change":"2024-04-25T09:55:34.747086+0000","last_active":"2024-04-25T09:55:34.747850+0000","last_peered":"2024-04-25T09:55:34.747850+0000","last_clean":"2024-04-25T09:55:34.747850+0000","last_became_active":"2024-04-25T09:55:34.746760+0000","last_became_peered":"2024-04-25T09:55:34.746760+0000","last_unstale":"2024-04-25T09:55:34.747850+0000","last_undegraded":"2024-04-25T09:55:34.747850+0000","last_fullsized":"2024-04-25T09:55:34.747850+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:49.336547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.769019+0000","last_change":"2024-04-25T09:55:35.764169+0000","last_active":"2024-04-25T09:55:35.769019+0000","last_peered":"2024-04-25T09:55:35.769019+0000","last_clean":"2024-04-25T09:55:35.769019+0000","last_became_active":"2024-04-25T09:55:35.763842+0000","last_became_peered":"2024-04-25T09:55:35.763842+0000","last_unstale":"2024-04-25T09:55:35.769019+0000","last_undegraded":"2024-04-25T09:55:35.769019+0000","last_fullsized":"2024-04-25T09:55:35.769019+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:58.821504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.744649+0000","last_change":"2024-04-25T09:55:34.743621+0000","last_active":"2024-04-25T09:55:34.744649+0000","last_peered":"2024-04-25T09:55:34.744649+0000","last_clean":"2024-04-25T09:55:34.744649+0000","last_became_active":"2024-04-25T09:55:34.743238+0000","last_became_peered":"2024-04-25T09:55:34.743238+0000","last_unstale":"2024-04-25T09:55:34.744649+0000","last_undegraded":"2024-04-25T09:55:34.744649+0000","last_fullsized":"2024-04-25T09:55:34.744649+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:49.289488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.728924+0000","last_change":"2024-04-25T09:55:34.728924+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.728924+0000","last_undegraded":"2024-04-25T09:55:34.728924+0000","last_fullsized":"2024-04-25T09:55:34.728924+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.749586+0000","last_change":"2024-04-25T09:55:34.744009+0000","last_active":"2024-04-25T09:55:35.749586+0000","last_peered":"2024-04-25T09:55:35.749586+0000","last_clean":"2024-04-25T09:55:35.749586+0000","last_became_active":"2024-04-25T09:55:34.743062+0000","last_became_peered":"2024-04-25T09:55:34.743062+0000","last_unstale":"2024-04-25T09:55:35.749586+0000","last_undegraded":"2024-04-25T09:55:35.749586+0000","last_fullsized":"2024-04-25T09:55:35.749586+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:49.336547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.728747+0000","last_change":"2024-04-25T09:55:34.728747+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.728747+0000","last_undegraded":"2024-04-25T09:55:34.728747+0000","last_fullsized":"2024-04-25T09:55:34.728747+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.759042+0000","last_change":"2024-04-25T09:55:34.750441+0000","last_active":"2024-04-25T09:55:35.759042+0000","last_peered":"2024-04-25T09:55:35.759042+0000","last_clean":"2024-04-25T09:55:35.759042+0000","last_became_active":"2024-04-25T09:55:34.750055+0000","last_became_peered":"2024-04-25T09:55:34.750055+0000","last_unstale":"2024-04-25T09:55:35.759042+0000","last_undegraded":"2024-04-25T09:55:35.759042+0000","last_fullsized":"2024-04-25T09:55:35.759042+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:19.539959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773442+0000","last_change":"2024-04-25T09:55:35.765490+0000","last_active":"2024-04-25T09:55:35.773442+0000","last_peered":"2024-04-25T09:55:35.773442+0000","last_clean":"2024-04-25T09:55:35.773442+0000","last_became_active":"2024-04-25T09:55:35.762884+0000","last_became_peered":"2024-04-25T09:55:35.762884+0000","last_unstale":"2024-04-25T09:55:35.773442+0000","last_undegraded":"2024-04-25T09:55:35.773442+0000","last_fullsized":"2024-04-25T09:55:35.773442+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:34.458200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.760230+0000","last_change":"2024-04-25T09:55:34.744929+0000","last_active":"2024-04-25T09:55:35.760230+0000","last_peered":"2024-04-25T09:55:35.760230+0000","last_clean":"2024-04-25T09:55:35.760230+0000","last_became_active":"2024-04-25T09:55:34.744561+0000","last_became_peered":"2024-04-25T09:55:34.744561+0000","last_unstale":"2024-04-25T09:55:35.760230+0000","last_undegraded":"2024-04-25T09:55:35.760230+0000","last_fullsized":"2024-04-25T09:55:35.760230+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:24.062912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.767805+0000","last_change":"2024-04-25T09:55:35.763093+0000","last_active":"2024-04-25T09:55:35.767805+0000","last_peered":"2024-04-25T09:55:35.767805+0000","last_clean":"2024-04-25T09:55:35.767805+0000","last_became_active":"2024-04-25T09:55:35.762596+0000","last_became_peered":"2024-04-25T09:55:35.762596+0000","last_unstale":"2024-04-25T09:55:35.767805+0000","last_undegraded":"2024-04-25T09:55:35.767805+0000","last_fullsized":"2024-04-25T09:55:35.767805+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:43.087615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.750521+0000","last_change":"2024-04-25T09:55:34.749888+0000","last_active":"2024-04-25T09:55:34.750521+0000","last_peered":"2024-04-25T09:55:34.750521+0000","last_clean":"2024-04-25T09:55:34.750521+0000","last_became_active":"2024-04-25T09:55:34.749584+0000","last_became_peered":"2024-04-25T09:55:34.749584+0000","last_unstale":"2024-04-25T09:55:34.750521+0000","last_undegraded":"2024-04-25T09:55:34.750521+0000","last_fullsized":"2024-04-25T09:55:34.750521+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:49.336547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.728439+0000","last_change":"2024-04-25T09:55:34.728439+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.728439+0000","last_undegraded":"2024-04-25T09:55:34.728439+0000","last_fullsized":"2024-04-25T09:55:34.728439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.741286+0000","last_change":"2024-04-25T09:55:34.743854+0000","last_active":"2024-04-25T09:55:35.741286+0000","last_peered":"2024-04-25T09:55:35.741286+0000","last_clean":"2024-04-25T09:55:35.741286+0000","last_became_active":"2024-04-25T09:55:34.743570+0000","last_became_peered":"2024-04-25T09:55:34.743570+0000","last_unstale":"2024-04-25T09:55:35.741286+0000","last_undegraded":"2024-04-25T09:55:35.741286+0000","last_fullsized":"2024-04-25T09:55:35.741286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:14.801427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.731859+0000","last_change":"2024-04-25T09:55:34.731859+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.731859+0000","last_undegraded":"2024-04-25T09:55:34.731859+0000","last_fullsized":"2024-04-25T09:55:34.731859+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.735677+0000","last_change":"2024-04-25T09:55:34.734433+0000","last_active":"2024-04-25T09:55:34.735677+0000","last_peered":"2024-04-25T09:55:34.735677+0000","last_clean":"2024-04-25T09:55:34.735677+0000","last_became_active":"2024-04-25T09:55:34.733827+0000","last_became_peered":"2024-04-25T09:55:34.733827+0000","last_unstale":"2024-04-25T09:55:34.735677+0000","last_undegraded":"2024-04-25T09:55:34.735677+0000","last_fullsized":"2024-04-25T09:55:34.735677+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:19.539959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.772866+0000","last_change":"2024-04-25T09:55:35.765319+0000","last_active":"2024-04-25T09:55:35.772866+0000","last_peered":"2024-04-25T09:55:35.772866+0000","last_clean":"2024-04-25T09:55:35.772866+0000","last_became_active":"2024-04-25T09:55:35.764862+0000","last_became_peered":"2024-04-25T09:55:35.764862+0000","last_unstale":"2024-04-25T09:55:35.772866+0000","last_undegraded":"2024-04-25T09:55:35.772866+0000","last_fullsized":"2024-04-25T09:55:35.772866+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:58.065939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.750195+0000","last_change":"2024-04-25T09:55:34.749934+0000","last_active":"2024-04-25T09:55:35.750195+0000","last_peered":"2024-04-25T09:55:35.750195+0000","last_clean":"2024-04-25T09:55:35.750195+0000","last_became_active":"2024-04-25T09:55:34.748781+0000","last_became_peered":"2024-04-25T09:55:34.748781+0000","last_unstale":"2024-04-25T09:55:35.750195+0000","last_undegraded":"2024-04-25T09:55:35.750195+0000","last_fullsized":"2024-04-25T09:55:35.750195+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:42.081172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.728487+0000","last_change":"2024-04-25T09:55:34.728487+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.728487+0000","last_undegraded":"2024-04-25T09:55:34.728487+0000","last_fullsized":"2024-04-25T09:55:34.728487+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.768519+0000","last_change":"2024-04-25T09:55:34.751988+0000","last_active":"2024-04-25T09:55:35.768519+0000","last_peered":"2024-04-25T09:55:35.768519+0000","last_clean":"2024-04-25T09:55:35.768519+0000","last_became_active":"2024-04-25T09:55:34.751600+0000","last_became_peered":"2024-04-25T09:55:34.751600+0000","last_unstale":"2024-04-25T09:55:35.768519+0000","last_undegraded":"2024-04-25T09:55:35.768519+0000","last_fullsized":"2024-04-25T09:55:35.768519+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:57.815061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.753143+0000","last_change":"2024-04-25T09:55:35.745530+0000","last_active":"2024-04-25T09:55:35.753143+0000","last_peered":"2024-04-25T09:55:35.753143+0000","last_clean":"2024-04-25T09:55:35.753143+0000","last_became_active":"2024-04-25T09:55:35.745156+0000","last_became_peered":"2024-04-25T09:55:35.745156+0000","last_unstale":"2024-04-25T09:55:35.753143+0000","last_undegraded":"2024-04-25T09:55:35.753143+0000","last_fullsized":"2024-04-25T09:55:35.753143+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:25.069355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.747509+0000","last_change":"2024-04-25T09:55:34.746883+0000","last_active":"2024-04-25T09:55:34.747509+0000","last_peered":"2024-04-25T09:55:34.747509+0000","last_clean":"2024-04-25T09:55:34.747509+0000","last_became_active":"2024-04-25T09:55:34.746605+0000","last_became_peered":"2024-04-25T09:55:34.746605+0000","last_unstale":"2024-04-25T09:55:34.747509+0000","last_undegraded":"2024-04-25T09:55:34.747509+0000","last_fullsized":"2024-04-25T09:55:34.747509+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:42.081172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.728352+0000","last_change":"2024-04-25T09:55:34.728352+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.728352+0000","last_undegraded":"2024-04-25T09:55:34.728352+0000","last_fullsized":"2024-04-25T09:55:34.728352+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.735751+0000","last_change":"2024-04-25T09:55:34.734268+0000","last_active":"2024-04-25T09:55:34.735751+0000","last_peered":"2024-04-25T09:55:34.735751+0000","last_clean":"2024-04-25T09:55:34.735751+0000","last_became_active":"2024-04-25T09:55:34.733940+0000","last_became_peered":"2024-04-25T09:55:34.733940+0000","last_unstale":"2024-04-25T09:55:34.735751+0000","last_undegraded":"2024-04-25T09:55:34.735751+0000","last_fullsized":"2024-04-25T09:55:34.735751+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:22.625888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.726523+0000","last_change":"2024-04-25T09:55:34.726523+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.726523+0000","last_undegraded":"2024-04-25T09:55:34.726523+0000","last_fullsized":"2024-04-25T09:55:34.726523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.751808+0000","last_change":"2024-04-25T09:55:34.751004+0000","last_active":"2024-04-25T09:55:34.751808+0000","last_peered":"2024-04-25T09:55:34.751808+0000","last_clean":"2024-04-25T09:55:34.751808+0000","last_became_active":"2024-04-25T09:55:34.750719+0000","last_became_peered":"2024-04-25T09:55:34.750719+0000","last_unstale":"2024-04-25T09:55:34.751808+0000","last_undegraded":"2024-04-25T09:55:34.751808+0000","last_fullsized":"2024-04-25T09:55:34.751808+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:14.801427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.764461+0000","last_change":"2024-04-25T09:55:35.756163+0000","last_active":"2024-04-25T09:55:35.764461+0000","last_peered":"2024-04-25T09:55:35.764461+0000","last_clean":"2024-04-25T09:55:35.764461+0000","last_became_active":"2024-04-25T09:55:35.755652+0000","last_became_peered":"2024-04-25T09:55:35.755652+0000","last_unstale":"2024-04-25T09:55:35.764461+0000","last_undegraded":"2024-04-25T09:55:35.764461+0000","last_fullsized":"2024-04-25T09:55:35.764461+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:58.821504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.740102+0000","last_change":"2024-04-25T09:55:34.745319+0000","last_active":"2024-04-25T09:55:35.740102+0000","last_peered":"2024-04-25T09:55:35.740102+0000","last_clean":"2024-04-25T09:55:35.740102+0000","last_became_active":"2024-04-25T09:55:34.745029+0000","last_became_peered":"2024-04-25T09:55:34.745029+0000","last_unstale":"2024-04-25T09:55:35.740102+0000","last_undegraded":"2024-04-25T09:55:35.740102+0000","last_fullsized":"2024-04-25T09:55:35.740102+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:14.801427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.726983+0000","last_change":"2024-04-25T09:55:34.726983+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.726983+0000","last_undegraded":"2024-04-25T09:55:34.726983+0000","last_fullsized":"2024-04-25T09:55:34.726983+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.761411+0000","last_change":"2024-04-25T09:55:34.746478+0000","last_active":"2024-04-25T09:55:35.761411+0000","last_peered":"2024-04-25T09:55:35.761411+0000","last_clean":"2024-04-25T09:55:35.761411+0000","last_became_active":"2024-04-25T09:55:34.745385+0000","last_became_peered":"2024-04-25T09:55:34.745385+0000","last_unstale":"2024-04-25T09:55:35.761411+0000","last_undegraded":"2024-04-25T09:55:35.761411+0000","last_fullsized":"2024-04-25T09:55:35.761411+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:27.099991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727061+0000","last_change":"2024-04-25T09:55:34.727061+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727061+0000","last_undegraded":"2024-04-25T09:55:34.727061+0000","last_fullsized":"2024-04-25T09:55:34.727061+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.761760+0000","last_change":"2024-04-25T09:55:34.751912+0000","last_active":"2024-04-25T09:55:35.761760+0000","last_peered":"2024-04-25T09:55:35.761760+0000","last_clean":"2024-04-25T09:55:35.761760+0000","last_became_active":"2024-04-25T09:55:34.751601+0000","last_became_peered":"2024-04-25T09:55:34.751601+0000","last_unstale":"2024-04-25T09:55:35.761760+0000","last_undegraded":"2024-04-25T09:55:35.761760+0000","last_fullsized":"2024-04-25T09:55:35.761760+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:26.167108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773893+0000","last_change":"2024-04-25T09:55:35.767965+0000","last_active":"2024-04-25T09:55:35.773893+0000","last_peered":"2024-04-25T09:55:35.773893+0000","last_clean":"2024-04-25T09:55:35.773893+0000","last_became_active":"2024-04-25T09:55:35.767682+0000","last_became_peered":"2024-04-25T09:55:35.767682+0000","last_unstale":"2024-04-25T09:55:35.773893+0000","last_undegraded":"2024-04-25T09:55:35.773893+0000","last_fullsized":"2024-04-25T09:55:35.773893+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:03.959180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.767824+0000","last_change":"2024-04-25T09:55:34.752634+0000","last_active":"2024-04-25T09:55:35.767824+0000","last_peered":"2024-04-25T09:55:35.767824+0000","last_clean":"2024-04-25T09:55:35.767824+0000","last_became_active":"2024-04-25T09:55:34.752309+0000","last_became_peered":"2024-04-25T09:55:34.752309+0000","last_unstale":"2024-04-25T09:55:35.767824+0000","last_undegraded":"2024-04-25T09:55:35.767824+0000","last_fullsized":"2024-04-25T09:55:35.767824+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:27.099991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.763693+0000","last_change":"2024-04-25T09:55:35.749342+0000","last_active":"2024-04-25T09:55:35.763693+0000","last_peered":"2024-04-25T09:55:35.763693+0000","last_clean":"2024-04-25T09:55:35.763693+0000","last_became_active":"2024-04-25T09:55:35.749073+0000","last_became_peered":"2024-04-25T09:55:35.749073+0000","last_unstale":"2024-04-25T09:55:35.763693+0000","last_undegraded":"2024-04-25T09:55:35.763693+0000","last_fullsized":"2024-04-25T09:55:35.763693+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:23.632331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.749062+0000","last_change":"2024-04-25T09:55:34.748592+0000","last_active":"2024-04-25T09:55:34.749062+0000","last_peered":"2024-04-25T09:55:34.749062+0000","last_clean":"2024-04-25T09:55:34.749062+0000","last_became_active":"2024-04-25T09:55:34.748241+0000","last_became_peered":"2024-04-25T09:55:34.748241+0000","last_unstale":"2024-04-25T09:55:34.749062+0000","last_undegraded":"2024-04-25T09:55:34.749062+0000","last_fullsized":"2024-04-25T09:55:34.749062+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:58.101203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.731923+0000","last_change":"2024-04-25T09:55:34.731923+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.731923+0000","last_undegraded":"2024-04-25T09:55:34.731923+0000","last_fullsized":"2024-04-25T09:55:34.731923+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.746236+0000","last_change":"2024-04-25T09:55:34.744760+0000","last_active":"2024-04-25T09:55:34.746236+0000","last_peered":"2024-04-25T09:55:34.746236+0000","last_clean":"2024-04-25T09:55:34.746236+0000","last_became_active":"2024-04-25T09:55:34.744440+0000","last_became_peered":"2024-04-25T09:55:34.744440+0000","last_unstale":"2024-04-25T09:55:34.746236+0000","last_undegraded":"2024-04-25T09:55:34.746236+0000","last_fullsized":"2024-04-25T09:55:34.746236+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:32.776034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.763822+0000","last_change":"2024-04-25T09:55:35.756114+0000","last_active":"2024-04-25T09:55:35.763822+0000","last_peered":"2024-04-25T09:55:35.763822+0000","last_clean":"2024-04-25T09:55:35.763822+0000","last_became_active":"2024-04-25T09:55:35.755727+0000","last_became_peered":"2024-04-25T09:55:35.755727+0000","last_unstale":"2024-04-25T09:55:35.763822+0000","last_undegraded":"2024-04-25T09:55:35.763822+0000","last_fullsized":"2024-04-25T09:55:35.763822+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:23.632331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.737877+0000","last_change":"2024-04-25T09:55:34.737032+0000","last_active":"2024-04-25T09:55:34.737877+0000","last_peered":"2024-04-25T09:55:34.737877+0000","last_clean":"2024-04-25T09:55:34.737877+0000","last_became_active":"2024-04-25T09:55:34.736683+0000","last_became_peered":"2024-04-25T09:55:34.736683+0000","last_unstale":"2024-04-25T09:55:34.737877+0000","last_undegraded":"2024-04-25T09:55:34.737877+0000","last_fullsized":"2024-04-25T09:55:34.737877+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:49.623487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.730122+0000","last_change":"2024-04-25T09:55:34.730122+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.730122+0000","last_undegraded":"2024-04-25T09:55:34.730122+0000","last_fullsized":"2024-04-25T09:55:34.730122+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.745997+0000","last_change":"2024-04-25T09:55:34.745223+0000","last_active":"2024-04-25T09:55:34.745997+0000","last_peered":"2024-04-25T09:55:34.745997+0000","last_clean":"2024-04-25T09:55:34.745997+0000","last_became_active":"2024-04-25T09:55:34.744879+0000","last_became_peered":"2024-04-25T09:55:34.744879+0000","last_unstale":"2024-04-25T09:55:34.745997+0000","last_undegraded":"2024-04-25T09:55:34.745997+0000","last_fullsized":"2024-04-25T09:55:34.745997+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:15.660968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773369+0000","last_change":"2024-04-25T09:55:35.764920+0000","last_active":"2024-04-25T09:55:35.773369+0000","last_peered":"2024-04-25T09:55:35.773369+0000","last_clean":"2024-04-25T09:55:35.773369+0000","last_became_active":"2024-04-25T09:55:35.764523+0000","last_became_peered":"2024-04-25T09:55:35.764523+0000","last_unstale":"2024-04-25T09:55:35.773369+0000","last_undegraded":"2024-04-25T09:55:35.773369+0000","last_fullsized":"2024-04-25T09:55:35.773369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:12.411252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.744431+0000","last_change":"2024-04-25T09:55:34.747558+0000","last_active":"2024-04-25T09:55:35.744431+0000","last_peered":"2024-04-25T09:55:35.744431+0000","last_clean":"2024-04-25T09:55:35.744431+0000","last_became_active":"2024-04-25T09:55:34.747247+0000","last_became_peered":"2024-04-25T09:55:34.747247+0000","last_unstale":"2024-04-25T09:55:35.744431+0000","last_undegraded":"2024-04-25T09:55:35.744431+0000","last_fullsized":"2024-04-25T09:55:35.744431+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:36.739580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.726476+0000","last_change":"2024-04-25T09:55:34.726476+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.726476+0000","last_undegraded":"2024-04-25T09:55:34.726476+0000","last_fullsized":"2024-04-25T09:55:34.726476+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.740441+0000","last_change":"2024-04-25T09:55:34.738977+0000","last_active":"2024-04-25T09:55:34.740441+0000","last_peered":"2024-04-25T09:55:34.740441+0000","last_clean":"2024-04-25T09:55:34.740441+0000","last_became_active":"2024-04-25T09:55:34.738688+0000","last_became_peered":"2024-04-25T09:55:34.738688+0000","last_unstale":"2024-04-25T09:55:34.740441+0000","last_undegraded":"2024-04-25T09:55:34.740441+0000","last_fullsized":"2024-04-25T09:55:34.740441+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:08.898597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.729237+0000","last_change":"2024-04-25T09:55:34.729237+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.729237+0000","last_undegraded":"2024-04-25T09:55:34.729237+0000","last_fullsized":"2024-04-25T09:55:34.729237+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.759569+0000","last_change":"2024-04-25T09:55:34.751955+0000","last_active":"2024-04-25T09:55:35.759569+0000","last_peered":"2024-04-25T09:55:35.759569+0000","last_clean":"2024-04-25T09:55:35.759569+0000","last_became_active":"2024-04-25T09:55:34.751661+0000","last_became_peered":"2024-04-25T09:55:34.751661+0000","last_unstale":"2024-04-25T09:55:35.759569+0000","last_undegraded":"2024-04-25T09:55:35.759569+0000","last_fullsized":"2024-04-25T09:55:35.759569+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:22.625888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.772888+0000","last_change":"2024-04-25T09:55:35.765747+0000","last_active":"2024-04-25T09:55:35.772888+0000","last_peered":"2024-04-25T09:55:35.772888+0000","last_clean":"2024-04-25T09:55:35.772888+0000","last_became_active":"2024-04-25T09:55:35.765400+0000","last_became_peered":"2024-04-25T09:55:35.765400+0000","last_unstale":"2024-04-25T09:55:35.772888+0000","last_undegraded":"2024-04-25T09:55:35.772888+0000","last_fullsized":"2024-04-25T09:55:35.772888+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:10.115716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.750254+0000","last_change":"2024-04-25T09:55:34.749607+0000","last_active":"2024-04-25T09:55:34.750254+0000","last_peered":"2024-04-25T09:55:34.750254+0000","last_clean":"2024-04-25T09:55:34.750254+0000","last_became_active":"2024-04-25T09:55:34.749293+0000","last_became_peered":"2024-04-25T09:55:34.749293+0000","last_unstale":"2024-04-25T09:55:34.750254+0000","last_undegraded":"2024-04-25T09:55:34.750254+0000","last_fullsized":"2024-04-25T09:55:34.750254+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:47.145780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.726240+0000","last_change":"2024-04-25T09:55:34.726240+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.726240+0000","last_undegraded":"2024-04-25T09:55:34.726240+0000","last_fullsized":"2024-04-25T09:55:34.726240+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.735927+0000","last_change":"2024-04-25T09:55:34.734044+0000","last_active":"2024-04-25T09:55:34.735927+0000","last_peered":"2024-04-25T09:55:34.735927+0000","last_clean":"2024-04-25T09:55:34.735927+0000","last_became_active":"2024-04-25T09:55:34.733742+0000","last_became_peered":"2024-04-25T09:55:34.733742+0000","last_unstale":"2024-04-25T09:55:34.735927+0000","last_undegraded":"2024-04-25T09:55:34.735927+0000","last_fullsized":"2024-04-25T09:55:34.735927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:49.289488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727916+0000","last_change":"2024-04-25T09:55:34.727916+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727916+0000","last_undegraded":"2024-04-25T09:55:34.727916+0000","last_fullsized":"2024-04-25T09:55:34.727916+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.738952+0000","last_change":"2024-04-25T09:55:34.738180+0000","last_active":"2024-04-25T09:55:34.738952+0000","last_peered":"2024-04-25T09:55:34.738952+0000","last_clean":"2024-04-25T09:55:34.738952+0000","last_became_active":"2024-04-25T09:55:34.737894+0000","last_became_peered":"2024-04-25T09:55:34.737894+0000","last_unstale":"2024-04-25T09:55:34.738952+0000","last_undegraded":"2024-04-25T09:55:34.738952+0000","last_fullsized":"2024-04-25T09:55:34.738952+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:32.776034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727617+0000","last_change":"2024-04-25T09:55:34.727617+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727617+0000","last_undegraded":"2024-04-25T09:55:34.727617+0000","last_fullsized":"2024-04-25T09:55:34.727617+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.739163+0000","last_change":"2024-04-25T09:55:34.742098+0000","last_active":"2024-04-25T09:55:35.739163+0000","last_peered":"2024-04-25T09:55:35.739163+0000","last_clean":"2024-04-25T09:55:35.739163+0000","last_became_active":"2024-04-25T09:55:34.741787+0000","last_became_peered":"2024-04-25T09:55:34.741787+0000","last_unstale":"2024-04-25T09:55:35.739163+0000","last_undegraded":"2024-04-25T09:55:35.739163+0000","last_fullsized":"2024-04-25T09:55:35.739163+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:32.776034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.752849+0000","last_change":"2024-04-25T09:55:35.746484+0000","last_active":"2024-04-25T09:55:35.752849+0000","last_peered":"2024-04-25T09:55:35.752849+0000","last_clean":"2024-04-25T09:55:35.752849+0000","last_became_active":"2024-04-25T09:55:35.746195+0000","last_became_peered":"2024-04-25T09:55:35.746195+0000","last_unstale":"2024-04-25T09:55:35.752849+0000","last_undegraded":"2024-04-25T09:55:35.752849+0000","last_fullsized":"2024-04-25T09:55:35.752849+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:37.746023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.741723+0000","last_change":"2024-04-25T09:55:34.743941+0000","last_active":"2024-04-25T09:55:35.741723+0000","last_peered":"2024-04-25T09:55:35.741723+0000","last_clean":"2024-04-25T09:55:35.741723+0000","last_became_active":"2024-04-25T09:55:34.743567+0000","last_became_peered":"2024-04-25T09:55:34.743567+0000","last_unstale":"2024-04-25T09:55:35.741723+0000","last_undegraded":"2024-04-25T09:55:35.741723+0000","last_fullsized":"2024-04-25T09:55:35.741723+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:12.241234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.772778+0000","last_change":"2024-04-25T09:55:35.765142+0000","last_active":"2024-04-25T09:55:35.772778+0000","last_peered":"2024-04-25T09:55:35.772778+0000","last_clean":"2024-04-25T09:55:35.772778+0000","last_became_active":"2024-04-25T09:55:35.764844+0000","last_became_peered":"2024-04-25T09:55:35.764844+0000","last_unstale":"2024-04-25T09:55:35.772778+0000","last_undegraded":"2024-04-25T09:55:35.772778+0000","last_fullsized":"2024-04-25T09:55:35.772778+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:12.257881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.735709+0000","last_change":"2024-04-25T09:55:34.731152+0000","last_active":"2024-04-25T09:55:34.735709+0000","last_peered":"2024-04-25T09:55:34.735709+0000","last_clean":"2024-04-25T09:55:34.735709+0000","last_became_active":"2024-04-25T09:55:34.730845+0000","last_became_peered":"2024-04-25T09:55:34.730845+0000","last_unstale":"2024-04-25T09:55:34.735709+0000","last_undegraded":"2024-04-25T09:55:34.735709+0000","last_fullsized":"2024-04-25T09:55:34.735709+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:26.167108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773156+0000","last_change":"2024-04-25T09:55:35.762049+0000","last_active":"2024-04-25T09:55:35.773156+0000","last_peered":"2024-04-25T09:55:35.773156+0000","last_clean":"2024-04-25T09:55:35.773156+0000","last_became_active":"2024-04-25T09:55:35.761764+0000","last_became_peered":"2024-04-25T09:55:35.761764+0000","last_unstale":"2024-04-25T09:55:35.773156+0000","last_undegraded":"2024-04-25T09:55:35.773156+0000","last_fullsized":"2024-04-25T09:55:35.773156+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:58.065939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.744977+0000","last_change":"2024-04-25T09:55:34.746165+0000","last_active":"2024-04-25T09:55:35.744977+0000","last_peered":"2024-04-25T09:55:35.744977+0000","last_clean":"2024-04-25T09:55:35.744977+0000","last_became_active":"2024-04-25T09:55:34.745859+0000","last_became_peered":"2024-04-25T09:55:34.745859+0000","last_unstale":"2024-04-25T09:55:35.744977+0000","last_undegraded":"2024-04-25T09:55:35.744977+0000","last_fullsized":"2024-04-25T09:55:35.744977+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:26.167108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.744054+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T09:55:35.744054+0000","last_peered":"2024-04-25T09:55:35.744054+0000","last_clean":"2024-04-25T09:55:35.744054+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T09:55:35.744054+0000","last_undegraded":"2024-04-25T09:55:35.744054+0000","last_fullsized":"2024-04-25T09:55:35.744054+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":694,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542163,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1015808,"data_stored":770080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542163,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":179712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542165,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":421888,"data_stored":179712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":179712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":409600,"data_stored":173045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":409600,"data_stored":173045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":409600,"data_stored":173045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1003520,"data_stored":763413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:55:39.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2024-04-25T09:55:39.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:55:34.729869+0000', 'last_change': '2024-04-25T09:55:34.729869+0000', 'last_active': '2024-04-25T09:55:34.715847+0000', 'last_peered': '2024-04-25T09:55:34.715847+0000', 'last_clean': '2024-04-25T09:55:34.715847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:55:34.729869+0000', 'last_undegraded': '2024-04-25T09:55:34.729869+0000', 'last_fullsized': '2024-04-25T09:55:34.729869+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_clean_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:55:39.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2024-04-25T09:55:39.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:55:34.730011+0000', 'last_change': '2024-04-25T09:55:34.730011+0000', 'last_active': '2024-04-25T09:55:34.715847+0000', 'last_peered': '2024-04-25T09:55:34.715847+0000', 'last_clean': '2024-04-25T09:55:34.715847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:55:34.730011+0000', 'last_undegraded': '2024-04-25T09:55:34.730011+0000', 'last_fullsized': '2024-04-25T09:55:34.730011+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_clean_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:55:39.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2024-04-25T09:55:39.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:55:34.727236+0000', 'last_change': '2024-04-25T09:55:34.727236+0000', 'last_active': '2024-04-25T09:55:34.715847+0000', 'last_peered': '2024-04-25T09:55:34.715847+0000', 'last_clean': '2024-04-25T09:55:34.715847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:55:34.727236+0000', 'last_undegraded': '2024-04-25T09:55:34.727236+0000', 'last_fullsized': '2024-04-25T09:55:34.727236+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_clean_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:55:39.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2024-04-25T09:55:39.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:55:34.734467+0000', 'last_change': '2024-04-25T09:55:34.734467+0000', 'last_active': '2024-04-25T09:55:34.715847+0000', 'last_peered': '2024-04-25T09:55:34.715847+0000', 'last_clean': '2024-04-25T09:55:34.715847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:55:34.734467+0000', 'last_undegraded': '2024-04-25T09:55:34.734467+0000', 'last_fullsized': '2024-04-25T09:55:34.734467+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_clean_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:55:39.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2024-04-25T09:55:39.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:55:34.733882+0000', 'last_change': '2024-04-25T09:55:34.733882+0000', 'last_active': '2024-04-25T09:55:34.715847+0000', 'last_peered': '2024-04-25T09:55:34.715847+0000', 'last_clean': '2024-04-25T09:55:34.715847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:55:34.733882+0000', 'last_undegraded': '2024-04-25T09:55:34.733882+0000', 'last_fullsized': '2024-04-25T09:55:34.733882+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_clean_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:55:39.445 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2024-04-25T09:55:39.445 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:55:34.727866+0000', 'last_change': '2024-04-25T09:55:34.727866+0000', 'last_active': '2024-04-25T09:55:34.715847+0000', 'last_peered': '2024-04-25T09:55:34.715847+0000', 'last_clean': '2024-04-25T09:55:34.715847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:55:34.727866+0000', 'last_undegraded': '2024-04-25T09:55:34.727866+0000', 'last_fullsized': '2024-04-25T09:55:34.727866+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_clean_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:55:39.445 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2024-04-25T09:55:39.445 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:55:34.729371+0000', 'last_change': '2024-04-25T09:55:34.729371+0000', 'last_active': '2024-04-25T09:55:34.715847+0000', 'last_peered': '2024-04-25T09:55:34.715847+0000', 'last_clean': '2024-04-25T09:55:34.715847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:55:34.729371+0000', 'last_undegraded': '2024-04-25T09:55:34.729371+0000', 'last_fullsized': '2024-04-25T09:55:34.729371+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_clean_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:55:39.445 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2024-04-25T09:55:39.445 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:55:34.727715+0000', 'last_change': '2024-04-25T09:55:34.727715+0000', 'last_active': '2024-04-25T09:55:34.715847+0000', 'last_peered': '2024-04-25T09:55:34.715847+0000', 'last_clean': '2024-04-25T09:55:34.715847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:55:34.727715+0000', 'last_undegraded': '2024-04-25T09:55:34.727715+0000', 'last_fullsized': '2024-04-25T09:55:34.727715+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_clean_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:55:39.445 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2024-04-25T09:55:39.445 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:55:34.727470+0000', 'last_change': '2024-04-25T09:55:34.727470+0000', 'last_active': '2024-04-25T09:55:34.715847+0000', 'last_peered': '2024-04-25T09:55:34.715847+0000', 'last_clean': '2024-04-25T09:55:34.715847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:55:34.727470+0000', 'last_undegraded': '2024-04-25T09:55:34.727470+0000', 'last_fullsized': '2024-04-25T09:55:34.727470+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_clean_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:55:39.446 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2024-04-25T09:55:39.446 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:55:34.733244+0000', 'last_change': '2024-04-25T09:55:34.733244+0000', 'last_active': '2024-04-25T09:55:34.715847+0000', 'last_peered': '2024-04-25T09:55:34.715847+0000', 'last_clean': '2024-04-25T09:55:34.715847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:55:34.733244+0000', 'last_undegraded': '2024-04-25T09:55:34.733244+0000', 'last_fullsized': '2024-04-25T09:55:34.733244+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_clean_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:55:39.446 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2024-04-25T09:55:39.446 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:55:34.732715+0000', 'last_change': '2024-04-25T09:55:34.732715+0000', 'last_active': '2024-04-25T09:55:34.715847+0000', 'last_peered': '2024-04-25T09:55:34.715847+0000', 'last_clean': '2024-04-25T09:55:34.715847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:55:34.732715+0000', 'last_undegraded': '2024-04-25T09:55:34.732715+0000', 'last_fullsized': '2024-04-25T09:55:34.732715+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_clean_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:55:39.446 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2024-04-25T09:55:39.446 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:55:34.730311+0000', 'last_change': '2024-04-25T09:55:34.730311+0000', 'last_active': '2024-04-25T09:55:34.715847+0000', 'last_peered': '2024-04-25T09:55:34.715847+0000', 'last_clean': '2024-04-25T09:55:34.715847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:55:34.730311+0000', 'last_undegraded': '2024-04-25T09:55:34.730311+0000', 'last_fullsized': '2024-04-25T09:55:34.730311+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_clean_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:55:39.446 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2024-04-25T09:55:39.446 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:55:34.727558+0000', 'last_change': '2024-04-25T09:55:34.727558+0000', 'last_active': '2024-04-25T09:55:34.715847+0000', 'last_peered': '2024-04-25T09:55:34.715847+0000', 'last_clean': '2024-04-25T09:55:34.715847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:55:34.727558+0000', 'last_undegraded': '2024-04-25T09:55:34.727558+0000', 'last_fullsized': '2024-04-25T09:55:34.727558+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_clean_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:55:39.446 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2024-04-25T09:55:39.446 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:55:34.730036+0000', 'last_change': '2024-04-25T09:55:34.730036+0000', 'last_active': '2024-04-25T09:55:34.715847+0000', 'last_peered': '2024-04-25T09:55:34.715847+0000', 'last_clean': '2024-04-25T09:55:34.715847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:55:34.730036+0000', 'last_undegraded': '2024-04-25T09:55:34.730036+0000', 'last_fullsized': '2024-04-25T09:55:34.730036+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_clean_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:55:39.447 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2024-04-25T09:55:39.447 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:55:34.728924+0000', 'last_change': '2024-04-25T09:55:34.728924+0000', 'last_active': '2024-04-25T09:55:34.715847+0000', 'last_peered': '2024-04-25T09:55:34.715847+0000', 'last_clean': '2024-04-25T09:55:34.715847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:55:34.728924+0000', 'last_undegraded': '2024-04-25T09:55:34.728924+0000', 'last_fullsized': '2024-04-25T09:55:34.728924+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_clean_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:55:39.447 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2024-04-25T09:55:39.447 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:55:34.728747+0000', 'last_change': '2024-04-25T09:55:34.728747+0000', 'last_active': '2024-04-25T09:55:34.715847+0000', 'last_peered': '2024-04-25T09:55:34.715847+0000', 'last_clean': '2024-04-25T09:55:34.715847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:55:34.728747+0000', 'last_undegraded': '2024-04-25T09:55:34.728747+0000', 'last_fullsized': '2024-04-25T09:55:34.728747+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_clean_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:55:39.447 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2024-04-25T09:55:39.447 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:55:34.728439+0000', 'last_change': '2024-04-25T09:55:34.728439+0000', 'last_active': '2024-04-25T09:55:34.715847+0000', 'last_peered': '2024-04-25T09:55:34.715847+0000', 'last_clean': '2024-04-25T09:55:34.715847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:55:34.728439+0000', 'last_undegraded': '2024-04-25T09:55:34.728439+0000', 'last_fullsized': '2024-04-25T09:55:34.728439+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_clean_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:55:39.447 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2024-04-25T09:55:39.447 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:55:34.731859+0000', 'last_change': '2024-04-25T09:55:34.731859+0000', 'last_active': '2024-04-25T09:55:34.715847+0000', 'last_peered': '2024-04-25T09:55:34.715847+0000', 'last_clean': '2024-04-25T09:55:34.715847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:55:34.731859+0000', 'last_undegraded': '2024-04-25T09:55:34.731859+0000', 'last_fullsized': '2024-04-25T09:55:34.731859+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_clean_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:55:39.447 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2024-04-25T09:55:39.447 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:55:34.728487+0000', 'last_change': '2024-04-25T09:55:34.728487+0000', 'last_active': '2024-04-25T09:55:34.715847+0000', 'last_peered': '2024-04-25T09:55:34.715847+0000', 'last_clean': '2024-04-25T09:55:34.715847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:55:34.728487+0000', 'last_undegraded': '2024-04-25T09:55:34.728487+0000', 'last_fullsized': '2024-04-25T09:55:34.728487+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_clean_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:55:39.447 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2024-04-25T09:55:39.447 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:55:34.728352+0000', 'last_change': '2024-04-25T09:55:34.728352+0000', 'last_active': '2024-04-25T09:55:34.715847+0000', 'last_peered': '2024-04-25T09:55:34.715847+0000', 'last_clean': '2024-04-25T09:55:34.715847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:55:34.728352+0000', 'last_undegraded': '2024-04-25T09:55:34.728352+0000', 'last_fullsized': '2024-04-25T09:55:34.728352+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_clean_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:55:39.448 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2024-04-25T09:55:39.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:55:34.726523+0000', 'last_change': '2024-04-25T09:55:34.726523+0000', 'last_active': '2024-04-25T09:55:34.715847+0000', 'last_peered': '2024-04-25T09:55:34.715847+0000', 'last_clean': '2024-04-25T09:55:34.715847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:55:34.726523+0000', 'last_undegraded': '2024-04-25T09:55:34.726523+0000', 'last_fullsized': '2024-04-25T09:55:34.726523+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_clean_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:55:39.448 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2024-04-25T09:55:39.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:55:34.726983+0000', 'last_change': '2024-04-25T09:55:34.726983+0000', 'last_active': '2024-04-25T09:55:34.715847+0000', 'last_peered': '2024-04-25T09:55:34.715847+0000', 'last_clean': '2024-04-25T09:55:34.715847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:55:34.726983+0000', 'last_undegraded': '2024-04-25T09:55:34.726983+0000', 'last_fullsized': '2024-04-25T09:55:34.726983+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_clean_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:55:39.448 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2024-04-25T09:55:39.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:55:34.727061+0000', 'last_change': '2024-04-25T09:55:34.727061+0000', 'last_active': '2024-04-25T09:55:34.715847+0000', 'last_peered': '2024-04-25T09:55:34.715847+0000', 'last_clean': '2024-04-25T09:55:34.715847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:55:34.727061+0000', 'last_undegraded': '2024-04-25T09:55:34.727061+0000', 'last_fullsized': '2024-04-25T09:55:34.727061+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_clean_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:55:39.448 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2024-04-25T09:55:39.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:55:34.731923+0000', 'last_change': '2024-04-25T09:55:34.731923+0000', 'last_active': '2024-04-25T09:55:34.715847+0000', 'last_peered': '2024-04-25T09:55:34.715847+0000', 'last_clean': '2024-04-25T09:55:34.715847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:55:34.731923+0000', 'last_undegraded': '2024-04-25T09:55:34.731923+0000', 'last_fullsized': '2024-04-25T09:55:34.731923+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_clean_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:55:39.448 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2024-04-25T09:55:39.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:55:34.730122+0000', 'last_change': '2024-04-25T09:55:34.730122+0000', 'last_active': '2024-04-25T09:55:34.715847+0000', 'last_peered': '2024-04-25T09:55:34.715847+0000', 'last_clean': '2024-04-25T09:55:34.715847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:55:34.730122+0000', 'last_undegraded': '2024-04-25T09:55:34.730122+0000', 'last_fullsized': '2024-04-25T09:55:34.730122+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_clean_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:55:39.448 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2024-04-25T09:55:39.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:55:34.726476+0000', 'last_change': '2024-04-25T09:55:34.726476+0000', 'last_active': '2024-04-25T09:55:34.715847+0000', 'last_peered': '2024-04-25T09:55:34.715847+0000', 'last_clean': '2024-04-25T09:55:34.715847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:55:34.726476+0000', 'last_undegraded': '2024-04-25T09:55:34.726476+0000', 'last_fullsized': '2024-04-25T09:55:34.726476+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_clean_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:55:39.448 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2024-04-25T09:55:39.449 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:55:34.729237+0000', 'last_change': '2024-04-25T09:55:34.729237+0000', 'last_active': '2024-04-25T09:55:34.715847+0000', 'last_peered': '2024-04-25T09:55:34.715847+0000', 'last_clean': '2024-04-25T09:55:34.715847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:55:34.729237+0000', 'last_undegraded': '2024-04-25T09:55:34.729237+0000', 'last_fullsized': '2024-04-25T09:55:34.729237+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_clean_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:55:39.449 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2024-04-25T09:55:39.449 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:55:34.726240+0000', 'last_change': '2024-04-25T09:55:34.726240+0000', 'last_active': '2024-04-25T09:55:34.715847+0000', 'last_peered': '2024-04-25T09:55:34.715847+0000', 'last_clean': '2024-04-25T09:55:34.715847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:55:34.726240+0000', 'last_undegraded': '2024-04-25T09:55:34.726240+0000', 'last_fullsized': '2024-04-25T09:55:34.726240+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_clean_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:55:39.449 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2024-04-25T09:55:39.449 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:55:34.727916+0000', 'last_change': '2024-04-25T09:55:34.727916+0000', 'last_active': '2024-04-25T09:55:34.715847+0000', 'last_peered': '2024-04-25T09:55:34.715847+0000', 'last_clean': '2024-04-25T09:55:34.715847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:55:34.727916+0000', 'last_undegraded': '2024-04-25T09:55:34.727916+0000', 'last_fullsized': '2024-04-25T09:55:34.727916+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_clean_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:55:39.449 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2024-04-25T09:55:39.449 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:55:34.727617+0000', 'last_change': '2024-04-25T09:55:34.727617+0000', 'last_active': '2024-04-25T09:55:34.715847+0000', 'last_peered': '2024-04-25T09:55:34.715847+0000', 'last_clean': '2024-04-25T09:55:34.715847+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:55:34.727617+0000', 'last_undegraded': '2024-04-25T09:55:34.727617+0000', 'last_fullsized': '2024-04-25T09:55:34.727617+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'last_clean_scrub_stamp': '2024-04-25T09:55:34.715847+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:55:39.450 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:55:39.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.577+0000 7f1bdcb34640 1 Processor -- start 2024-04-25T09:55:39.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.577+0000 7f1bdcb34640 1 -- start start 2024-04-25T09:55:39.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.578+0000 7f1bdcb34640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1bd80d0950 0x7f1bd8168700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:39.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.578+0000 7f1bdcb34640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd80d2240 con 0x7f1bd815dad0 2024-04-25T09:55:39.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.578+0000 7f1bdcb34640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd80d2520 con 0x7f1bd80b9580 2024-04-25T09:55:39.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.578+0000 7f1bdcb34640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd80b7990 con 0x7f1bd80d0950 2024-04-25T09:55:39.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.578+0000 7f1bd659c640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1bd815dad0 0x7f1bd80d18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40612/0 (socket says 172.21.15.7:40612) 2024-04-25T09:55:39.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.578+0000 7f1bd659c640 1 -- 172.21.15.7:0/3552331632 learned_addr learned my addr 172.21.15.7:0/3552331632 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:39.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.578+0000 7f1bd6d9d640 1 --2- 172.21.15.7:0/3552331632 >> v2:172.21.15.55:3300/0 conn(0x7f1bd80d0950 0x7f1bd8168700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:39.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.578+0000 7f1bd559a640 1 -- 172.21.15.7:0/3552331632 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2442544924 0 0) 0x7f1bd80d2240 con 0x7f1bd815dad0 2024-04-25T09:55:39.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.578+0000 7f1bd559a640 1 -- 172.21.15.7:0/3552331632 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bc0003520 con 0x7f1bd815dad0 2024-04-25T09:55:39.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.579+0000 7f1bd559a640 1 -- 172.21.15.7:0/3552331632 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 797928861 0 0) 0x7f1bc0003520 con 0x7f1bd815dad0 2024-04-25T09:55:39.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.579+0000 7f1bd6d9d640 1 -- 172.21.15.7:0/3552331632 >> v1:172.21.15.55:6789/0 conn(0x7f1bd80b9580 legacy=0x7f1bd80d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:39.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.579+0000 7f1bd6d9d640 1 -- 172.21.15.7:0/3552331632 >> v1:172.21.15.7:6789/0 conn(0x7f1bd815dad0 legacy=0x7f1bd80d18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.579+0000 7f1bd6d9d640 1 -- 172.21.15.7:0/3552331632 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd80d2800 con 0x7f1bd80d0950 2024-04-25T09:55:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.580+0000 7f1bd6d9d640 1 --2- 172.21.15.7:0/3552331632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bd80d0950 0x7f1bd8168700 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009d90 tx=0x7f1bd002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56e648bf75cc6597 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.580+0000 7f1bd559a640 1 -- 172.21.15.7:0/3552331632 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8001670 con 0x7f1bd80d0950 2024-04-25T09:55:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.580+0000 7f1bd559a640 1 -- 172.21.15.7:0/3552331632 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd0007540 con 0x7f1bd80d0950 2024-04-25T09:55:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.580+0000 7f1bd559a640 1 -- 172.21.15.7:0/3552331632 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd00078f0 con 0x7f1bd80d0950 2024-04-25T09:55:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.580+0000 7f1bdcb34640 1 -- 172.21.15.7:0/3552331632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bd80d0950 msgr2=0x7f1bd8168700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.580+0000 7f1bdcb34640 1 --2- 172.21.15.7:0/3552331632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bd80d0950 0x7f1bd8168700 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009d90 tx=0x7f1bd002a680 comp rx=0 tx=0).stop 2024-04-25T09:55:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.580+0000 7f1bdcb34640 1 -- 172.21.15.7:0/3552331632 shutdown_connections 2024-04-25T09:55:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.580+0000 7f1bdcb34640 1 --2- 172.21.15.7:0/3552331632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bd80d0950 0x7f1bd8168700 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.580+0000 7f1bdcb34640 1 -- 172.21.15.7:0/3552331632 >> 172.21.15.7:0/3552331632 conn(0x7f1bd806bfe0 msgr2=0x7f1bd806c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.580+0000 7f1bdcb34640 1 -- 172.21.15.7:0/3552331632 shutdown_connections 2024-04-25T09:55:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.580+0000 7f1bdcb34640 1 -- 172.21.15.7:0/3552331632 wait complete. 2024-04-25T09:55:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.582+0000 7f1bdcb34640 1 Processor -- start 2024-04-25T09:55:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.582+0000 7f1bdcb34640 1 -- start start 2024-04-25T09:55:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.582+0000 7f1bdcb34640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1bd80b9580 0x7f1bd814a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:39.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.582+0000 7f1bdcb34640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1bd80d0950 0x7f1bd814abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:39.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.582+0000 7f1bdcb34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bd815dad0 0x7f1bd81575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:39.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.582+0000 7f1bdcb34640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd80d2dc0 con 0x7f1bd80b9580 2024-04-25T09:55:39.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.582+0000 7f1bdcb34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd815deb0 con 0x7f1bd815dad0 2024-04-25T09:55:39.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.582+0000 7f1bdcb34640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd81602d0 con 0x7f1bd80d0950 2024-04-25T09:55:39.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.583+0000 7f1bd659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1bd80b9580 0x7f1bd814a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:39.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.583+0000 7f1bd659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1bd80b9580 0x7f1bd814a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42288/0 (socket says 172.21.15.7:42288) 2024-04-25T09:55:39.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.583+0000 7f1bd659c640 1 -- 172.21.15.7:0/2783408606 learned_addr learned my addr 172.21.15.7:0/2783408606 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:39.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.583+0000 7f1bd6d9d640 1 --2- 172.21.15.7:0/2783408606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bd815dad0 0x7f1bd81575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:39.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.583+0000 7f1bd5d9b640 1 --2- 172.21.15.7:0/2783408606 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1bd80d0950 0x7f1bd814abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:39.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.583+0000 7f1bd659c640 1 -- 172.21.15.7:0/2783408606 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1bd80d0950 msgr2=0x7f1bd814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:39.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.583+0000 7f1bd659c640 1 --2- 172.21.15.7:0/2783408606 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1bd80d0950 0x7f1bd814abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:39.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.583+0000 7f1bd659c640 1 -- 172.21.15.7:0/2783408606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bd815dad0 msgr2=0x7f1bd81575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:39.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.583+0000 7f1bd659c640 1 --2- 172.21.15.7:0/2783408606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bd815dad0 0x7f1bd81575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:39.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.583+0000 7f1bd659c640 1 -- 172.21.15.7:0/2783408606 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd81605b0 con 0x7f1bd80b9580 2024-04-25T09:55:39.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.583+0000 7f1bd6d9d640 1 --2- 172.21.15.7:0/2783408606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bd815dad0 0x7f1bd81575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:39.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.583+0000 7f1bd659c640 1 --2- 172.21.15.7:0/2783408606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1bd80b9580 0x7f1bd814a6a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800c580 tx=0x7f1bc800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:39.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.583+0000 7f1bc6ffd640 1 -- 172.21.15.7:0/2783408606 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8017070 con 0x7f1bd80b9580 2024-04-25T09:55:39.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.583+0000 7f1bc6ffd640 1 -- 172.21.15.7:0/2783408606 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc8005ce0 con 0x7f1bd80b9580 2024-04-25T09:55:39.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.583+0000 7f1bdcb34640 1 -- 172.21.15.7:0/2783408606 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd8160890 con 0x7f1bd80b9580 2024-04-25T09:55:39.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.583+0000 7f1bc6ffd640 1 -- 172.21.15.7:0/2783408606 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8007330 con 0x7f1bd80b9580 2024-04-25T09:55:39.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.583+0000 7f1bdcb34640 1 -- 172.21.15.7:0/2783408606 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd8157b10 con 0x7f1bd80b9580 2024-04-25T09:55:39.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.584+0000 7f1bdcb34640 1 -- 172.21.15.7:0/2783408606 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd8074bb0 con 0x7f1bd80b9580 2024-04-25T09:55:39.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.585+0000 7f1bc6ffd640 1 -- 172.21.15.7:0/2783408606 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1bc801a070 con 0x7f1bd80b9580 2024-04-25T09:55:39.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.585+0000 7f1bc6ffd640 1 --2- 172.21.15.7:0/2783408606 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1bb806b4d0 0x7f1bb806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:39.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.585+0000 7f1bc6ffd640 1 -- 172.21.15.7:0/2783408606 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1bc80898b0 con 0x7f1bd80b9580 2024-04-25T09:55:39.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.585+0000 7f1bd5d9b640 1 --2- 172.21.15.7:0/2783408606 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1bb806b4d0 0x7f1bb806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:39.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.586+0000 7f1bd5d9b640 1 --2- 172.21.15.7:0/2783408606 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1bb806b4d0 0x7f1bb806d990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1bd815f3b0 tx=0x7f1bcc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:39.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.589+0000 7f1bc6ffd640 1 -- 172.21.15.7:0/2783408606 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1bc80585b0 con 0x7f1bd80b9580 2024-04-25T09:55:39.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.841+0000 7f1bdcb34640 1 -- 172.21.15.7:0/2783408606 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f1bd80d2240 con 0x7f1bd80b9580 2024-04-25T09:55:39.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.841+0000 7f1bc6ffd640 1 -- 172.21.15.7:0/2783408606 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1258 (secure 0 0 0) 0x7f1bc8057eb0 con 0x7f1bd80b9580 2024-04-25T09:55:39.844 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:39.844 INFO:teuthology.orchestra.run.smithi007.stdout:{"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":96,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":39,"num_osds":8,"num_up_osds":8,"osd_up_since":1714038855,"num_in_osds":8,"osd_in_since":1714038845,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":67},{"state_name":"creating+peering","count":30}],"num_pgs":97,"num_pools":3,"num_objects":14,"data_bytes":591062,"bytes_used":251424768,"bytes_avail":772842688512,"bytes_total":773094113280,"inactive_pgs_ratio":0.30927833914756775,"write_bytes_sec":739,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":15,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"b","status":"up:active","gid":5391}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2024-04-25T09:55:23.866202+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:55:39.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.843+0000 7f1bdcb34640 1 -- 172.21.15.7:0/2783408606 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1bb806b4d0 msgr2=0x7f1bb806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:39.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.843+0000 7f1bdcb34640 1 --2- 172.21.15.7:0/2783408606 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1bb806b4d0 0x7f1bb806d990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1bd815f3b0 tx=0x7f1bcc009040 comp rx=0 tx=0).stop 2024-04-25T09:55:39.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.843+0000 7f1bdcb34640 1 -- 172.21.15.7:0/2783408606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1bd80b9580 msgr2=0x7f1bd814a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:39.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.843+0000 7f1bdcb34640 1 --2- 172.21.15.7:0/2783408606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1bd80b9580 0x7f1bd814a6a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800c580 tx=0x7f1bc800ca40 comp rx=0 tx=0).stop 2024-04-25T09:55:39.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.844+0000 7f1bdcb34640 1 -- 172.21.15.7:0/2783408606 shutdown_connections 2024-04-25T09:55:39.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.844+0000 7f1bdcb34640 1 --2- 172.21.15.7:0/2783408606 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1bb806b4d0 0x7f1bb806d990 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:39.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.844+0000 7f1bdcb34640 1 --2- 172.21.15.7:0/2783408606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bd815dad0 0x7f1bd81575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:39.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.844+0000 7f1bdcb34640 1 --2- 172.21.15.7:0/2783408606 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1bd80d0950 0x7f1bd814abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:39.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.844+0000 7f1bdcb34640 1 --2- 172.21.15.7:0/2783408606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1bd80b9580 0x7f1bd814a6a0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:39.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.844+0000 7f1bdcb34640 1 -- 172.21.15.7:0/2783408606 >> 172.21.15.7:0/2783408606 conn(0x7f1bd806bfe0 msgr2=0x7f1bd806c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:39.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.844+0000 7f1bdcb34640 1 -- 172.21.15.7:0/2783408606 shutdown_connections 2024-04-25T09:55:39.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.844+0000 7f1bdcb34640 1 -- 172.21.15.7:0/2783408606 wait complete. 2024-04-25T09:55:39.857 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T09:55:39.857 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:55:39.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.956+0000 7faa06589640 1 Processor -- start 2024-04-25T09:55:39.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.956+0000 7faa06589640 1 -- start start 2024-04-25T09:55:39.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.957+0000 7faa06589640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faa0015dd00 0x7faa000b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:39.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.957+0000 7faa06589640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faa0006c6c0 0x7faa000b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:39.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.957+0000 7faa06589640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa0006cd00 con 0x7faa000b6a40 2024-04-25T09:55:39.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.957+0000 7faa06589640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa0015e0e0 con 0x7faa0006c6c0 2024-04-25T09:55:39.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.957+0000 7faa06589640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa0006cfe0 con 0x7faa0015dd00 2024-04-25T09:55:39.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.957+0000 7faa04b26640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faa0006c6c0 0x7faa000b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:39.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.957+0000 7faa04b26640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faa0006c6c0 0x7faa000b5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54614/0 (socket says 172.21.15.7:54614) 2024-04-25T09:55:39.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.957+0000 7faa04b26640 1 -- 172.21.15.7:0/2474282540 learned_addr learned my addr 172.21.15.7:0/2474282540 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:39.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.957+0000 7fa9fffff640 1 --2- 172.21.15.7:0/2474282540 >> v2:172.21.15.55:3300/0 conn(0x7faa0015dd00 0x7faa000b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:39.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.957+0000 7faa04b26640 1 -- 172.21.15.7:0/2474282540 >> v2:172.21.15.55:3300/0 conn(0x7faa0015dd00 msgr2=0x7faa000b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:39.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.957+0000 7faa04b26640 1 --2- 172.21.15.7:0/2474282540 >> v2:172.21.15.55:3300/0 conn(0x7faa0015dd00 0x7faa000b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:39.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.957+0000 7faa04b26640 1 -- 172.21.15.7:0/2474282540 >> v1:172.21.15.55:6789/0 conn(0x7faa000b6a40 legacy=0x7faa0006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:39.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.957+0000 7faa04b26640 1 -- 172.21.15.7:0/2474282540 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa000d1ca0 con 0x7faa0006c6c0 2024-04-25T09:55:39.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.957+0000 7fa9fffff640 1 --2- 172.21.15.7:0/2474282540 >> v2:172.21.15.55:3300/0 conn(0x7faa0015dd00 0x7faa000b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:39.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.958+0000 7faa04b26640 1 --2- 172.21.15.7:0/2474282540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa0006c6c0 0x7faa000b5c90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7faa000d4920 tx=0x7fa9f802a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba949bd9fabe8f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:39.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.958+0000 7fa9feffd640 1 -- 172.21.15.7:0/2474282540 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f8036070 con 0x7faa0006c6c0 2024-04-25T09:55:39.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.958+0000 7fa9feffd640 1 -- 172.21.15.7:0/2474282540 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f8031600 con 0x7faa0006c6c0 2024-04-25T09:55:39.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.958+0000 7fa9feffd640 1 -- 172.21.15.7:0/2474282540 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f80319f0 con 0x7faa0006c6c0 2024-04-25T09:55:39.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.958+0000 7faa06589640 1 -- 172.21.15.7:0/2474282540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa0006c6c0 msgr2=0x7faa000b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:39.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.958+0000 7faa06589640 1 --2- 172.21.15.7:0/2474282540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa0006c6c0 0x7faa000b5c90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7faa000d4920 tx=0x7fa9f802a7c0 comp rx=0 tx=0).stop 2024-04-25T09:55:39.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.959+0000 7faa06589640 1 -- 172.21.15.7:0/2474282540 shutdown_connections 2024-04-25T09:55:39.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.959+0000 7faa06589640 1 --2- 172.21.15.7:0/2474282540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa0006c6c0 0x7faa000b5c90 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:39.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.959+0000 7faa06589640 1 --2- 172.21.15.7:0/2474282540 >> v2:172.21.15.55:3300/0 conn(0x7faa0015dd00 0x7faa000b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:39.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.959+0000 7faa06589640 1 -- 172.21.15.7:0/2474282540 >> 172.21.15.7:0/2474282540 conn(0x7faa000d07b0 msgr2=0x7faa000d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:39.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.959+0000 7faa06589640 1 -- 172.21.15.7:0/2474282540 shutdown_connections 2024-04-25T09:55:39.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.959+0000 7faa06589640 1 -- 172.21.15.7:0/2474282540 wait complete. 2024-04-25T09:55:39.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.960+0000 7faa06589640 1 Processor -- start 2024-04-25T09:55:39.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.960+0000 7faa06589640 1 -- start start 2024-04-25T09:55:39.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.961+0000 7faa06589640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa0006c6c0 0x7faa000ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:39.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.961+0000 7faa06589640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faa000b6a40 0x7faa000b8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:39.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.961+0000 7faa06589640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa0015dd00 0x7faa000c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:39.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.961+0000 7faa06589640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa000d2780 con 0x7faa0015dd00 2024-04-25T09:55:39.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.961+0000 7faa06589640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa000d2260 con 0x7faa0006c6c0 2024-04-25T09:55:39.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.961+0000 7faa06589640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa000d2900 con 0x7faa000b6a40 2024-04-25T09:55:39.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.961+0000 7faa04b26640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa0015dd00 0x7faa000c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:39.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.961+0000 7faa04b26640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa0015dd00 0x7faa000c90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54630/0 (socket says 172.21.15.7:54630) 2024-04-25T09:55:39.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.961+0000 7faa04b26640 1 -- 172.21.15.7:0/3278319866 learned_addr learned my addr 172.21.15.7:0/3278319866 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:39.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.961+0000 7fa9fffff640 1 --2- 172.21.15.7:0/3278319866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa0006c6c0 0x7faa000ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:39.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.961+0000 7fa9ff7fe640 1 --2- 172.21.15.7:0/3278319866 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faa000b6a40 0x7faa000b8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:39.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.961+0000 7faa04b26640 1 -- 172.21.15.7:0/3278319866 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faa000b6a40 msgr2=0x7faa000b8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:39.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.961+0000 7faa04b26640 1 --2- 172.21.15.7:0/3278319866 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faa000b6a40 0x7faa000b8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:39.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.961+0000 7faa04b26640 1 -- 172.21.15.7:0/3278319866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa0006c6c0 msgr2=0x7faa000ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:39.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.961+0000 7faa04b26640 1 --2- 172.21.15.7:0/3278319866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa0006c6c0 0x7faa000ca9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:39.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.961+0000 7faa04b26640 1 -- 172.21.15.7:0/3278319866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa001f6de0 con 0x7faa0015dd00 2024-04-25T09:55:39.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.961+0000 7fa9fffff640 1 --2- 172.21.15.7:0/3278319866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa0006c6c0 0x7faa000ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:39.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.961+0000 7faa04b26640 1 --2- 172.21.15.7:0/3278319866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa0015dd00 0x7faa000c90f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8009f40 tx=0x7fa9f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:39.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.961+0000 7fa9fcff9640 1 -- 172.21.15.7:0/3278319866 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f8036050 con 0x7faa0015dd00 2024-04-25T09:55:39.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.961+0000 7fa9fcff9640 1 -- 172.21.15.7:0/3278319866 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f8037040 con 0x7faa0015dd00 2024-04-25T09:55:39.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.961+0000 7faa06589640 1 -- 172.21.15.7:0/3278319866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa001f70c0 con 0x7faa0015dd00 2024-04-25T09:55:39.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.962+0000 7fa9fcff9640 1 -- 172.21.15.7:0/3278319866 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f8009510 con 0x7faa0015dd00 2024-04-25T09:55:39.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.962+0000 7faa06589640 1 -- 172.21.15.7:0/3278319866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa001f7680 con 0x7faa0015dd00 2024-04-25T09:55:39.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.963+0000 7faa06589640 1 -- 172.21.15.7:0/3278319866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa00068fd0 con 0x7faa0015dd00 2024-04-25T09:55:39.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.963+0000 7fa9fcff9640 1 -- 172.21.15.7:0/3278319866 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa9f8044020 con 0x7faa0015dd00 2024-04-25T09:55:39.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.963+0000 7fa9fcff9640 1 --2- 172.21.15.7:0/3278319866 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa9ec06b4d0 0x7fa9ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:39.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.964+0000 7fa9fcff9640 1 -- 172.21.15.7:0/3278319866 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa9f80aa740 con 0x7faa0015dd00 2024-04-25T09:55:39.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.964+0000 7fa9fffff640 1 --2- 172.21.15.7:0/3278319866 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa9ec06b4d0 0x7fa9ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:39.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.964+0000 7fa9fffff640 1 --2- 172.21.15.7:0/3278319866 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa9ec06b4d0 0x7fa9ec06d990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0006fd0 tx=0x7fa9f0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:39.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:39.968+0000 7fa9fcff9640 1 -- 172.21.15.7:0/3278319866 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa9f804b020 con 0x7faa0015dd00 2024-04-25T09:55:40.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:40.145+0000 7faa06589640 1 -- 172.21.15.7:0/3278319866 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faa000caf20 con 0x7fa9ec06b4d0 2024-04-25T09:55:40.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:40.151+0000 7fa9fcff9640 1 -- 172.21.15.7:0/3278319866 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249429 (secure 0 0 0) 0x7faa000caf20 con 0x7fa9ec06b4d0 2024-04-25T09:55:40.156 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:40.157 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T09:55:40.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:40.154+0000 7faa06589640 1 -- 172.21.15.7:0/3278319866 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa9ec06b4d0 msgr2=0x7fa9ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:40.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:40.154+0000 7faa06589640 1 --2- 172.21.15.7:0/3278319866 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa9ec06b4d0 0x7fa9ec06d990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0006fd0 tx=0x7fa9f0008040 comp rx=0 tx=0).stop 2024-04-25T09:55:40.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:40.154+0000 7faa06589640 1 -- 172.21.15.7:0/3278319866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa0015dd00 msgr2=0x7faa000c90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:40.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:40.154+0000 7faa06589640 1 --2- 172.21.15.7:0/3278319866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa0015dd00 0x7faa000c90f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8009f40 tx=0x7fa9f8004a40 comp rx=0 tx=0).stop 2024-04-25T09:55:40.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:40.154+0000 7faa06589640 1 -- 172.21.15.7:0/3278319866 shutdown_connections 2024-04-25T09:55:40.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:40.154+0000 7faa06589640 1 --2- 172.21.15.7:0/3278319866 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa9ec06b4d0 0x7fa9ec06d990 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:40.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:40.154+0000 7faa06589640 1 --2- 172.21.15.7:0/3278319866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa0015dd00 0x7faa000c90f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:40.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:40.154+0000 7faa06589640 1 --2- 172.21.15.7:0/3278319866 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faa000b6a40 0x7faa000b8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:40.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:40.154+0000 7faa06589640 1 --2- 172.21.15.7:0/3278319866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa0006c6c0 0x7faa000ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:40.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:40.154+0000 7faa06589640 1 -- 172.21.15.7:0/3278319866 >> 172.21.15.7:0/3278319866 conn(0x7faa000d07b0 msgr2=0x7faa0015be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:40.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:40.154+0000 7faa06589640 1 -- 172.21.15.7:0/3278319866 shutdown_connections 2024-04-25T09:55:40.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:40.154+0000 7faa06589640 1 -- 172.21.15.7:0/3278319866 wait complete. 2024-04-25T09:55:40.167 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2024-04-25T09:55:39.868729+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591062,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":189,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":245532,"kb_used_data":4408,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754729188,"statfs":{"total":773094113280,"available":772842688512,"internally_reserved":0,"allocated":4513792,"data_stored":2591764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":246795825},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":694,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000944"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.729869+0000","last_change":"2024-04-25T09:55:34.729869+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.729869+0000","last_undegraded":"2024-04-25T09:55:34.729869+0000","last_fullsized":"2024-04-25T09:55:34.729869+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.730011+0000","last_change":"2024-04-25T09:55:34.730011+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.730011+0000","last_undegraded":"2024-04-25T09:55:34.730011+0000","last_fullsized":"2024-04-25T09:55:34.730011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727236+0000","last_change":"2024-04-25T09:55:34.727236+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727236+0000","last_undegraded":"2024-04-25T09:55:34.727236+0000","last_fullsized":"2024-04-25T09:55:34.727236+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.734467+0000","last_change":"2024-04-25T09:55:34.734467+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.734467+0000","last_undegraded":"2024-04-25T09:55:34.734467+0000","last_fullsized":"2024-04-25T09:55:34.734467+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.733882+0000","last_change":"2024-04-25T09:55:34.733882+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.733882+0000","last_undegraded":"2024-04-25T09:55:34.733882+0000","last_fullsized":"2024-04-25T09:55:34.733882+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727866+0000","last_change":"2024-04-25T09:55:34.727866+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727866+0000","last_undegraded":"2024-04-25T09:55:34.727866+0000","last_fullsized":"2024-04-25T09:55:34.727866+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773290+0000","last_change":"2024-04-25T09:55:35.764026+0000","last_active":"2024-04-25T09:55:35.773290+0000","last_peered":"2024-04-25T09:55:35.773290+0000","last_clean":"2024-04-25T09:55:35.773290+0000","last_became_active":"2024-04-25T09:55:35.763499+0000","last_became_peered":"2024-04-25T09:55:35.763499+0000","last_unstale":"2024-04-25T09:55:35.773290+0000","last_undegraded":"2024-04-25T09:55:35.773290+0000","last_fullsized":"2024-04-25T09:55:35.773290+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:53.251434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.729371+0000","last_change":"2024-04-25T09:55:34.729371+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.729371+0000","last_undegraded":"2024-04-25T09:55:34.729371+0000","last_fullsized":"2024-04-25T09:55:34.729371+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727715+0000","last_change":"2024-04-25T09:55:34.727715+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727715+0000","last_undegraded":"2024-04-25T09:55:34.727715+0000","last_fullsized":"2024-04-25T09:55:34.727715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773363+0000","last_change":"2024-04-25T09:55:35.764915+0000","last_active":"2024-04-25T09:55:35.773363+0000","last_peered":"2024-04-25T09:55:35.773363+0000","last_clean":"2024-04-25T09:55:35.773363+0000","last_became_active":"2024-04-25T09:55:35.764601+0000","last_became_peered":"2024-04-25T09:55:35.764601+0000","last_unstale":"2024-04-25T09:55:35.773363+0000","last_undegraded":"2024-04-25T09:55:35.773363+0000","last_fullsized":"2024-04-25T09:55:35.773363+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:59.279223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773868+0000","last_change":"2024-04-25T09:55:35.768030+0000","last_active":"2024-04-25T09:55:35.773868+0000","last_peered":"2024-04-25T09:55:35.773868+0000","last_clean":"2024-04-25T09:55:35.773868+0000","last_became_active":"2024-04-25T09:55:35.767735+0000","last_became_peered":"2024-04-25T09:55:35.767735+0000","last_unstale":"2024-04-25T09:55:35.773868+0000","last_undegraded":"2024-04-25T09:55:35.773868+0000","last_fullsized":"2024-04-25T09:55:35.773868+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:31:37.702240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727470+0000","last_change":"2024-04-25T09:55:34.727470+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727470+0000","last_undegraded":"2024-04-25T09:55:34.727470+0000","last_fullsized":"2024-04-25T09:55:34.727470+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773102+0000","last_change":"2024-04-25T09:55:35.759552+0000","last_active":"2024-04-25T09:55:35.773102+0000","last_peered":"2024-04-25T09:55:35.773102+0000","last_clean":"2024-04-25T09:55:35.773102+0000","last_became_active":"2024-04-25T09:55:35.759261+0000","last_became_peered":"2024-04-25T09:55:35.759261+0000","last_unstale":"2024-04-25T09:55:35.773102+0000","last_undegraded":"2024-04-25T09:55:35.773102+0000","last_fullsized":"2024-04-25T09:55:35.773102+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:07.479394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.767781+0000","last_change":"2024-04-25T09:55:35.762865+0000","last_active":"2024-04-25T09:55:35.767781+0000","last_peered":"2024-04-25T09:55:35.767781+0000","last_clean":"2024-04-25T09:55:35.767781+0000","last_became_active":"2024-04-25T09:55:35.762187+0000","last_became_peered":"2024-04-25T09:55:35.762187+0000","last_unstale":"2024-04-25T09:55:35.767781+0000","last_undegraded":"2024-04-25T09:55:35.767781+0000","last_fullsized":"2024-04-25T09:55:35.767781+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:20.546402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773267+0000","last_change":"2024-04-25T09:55:35.763794+0000","last_active":"2024-04-25T09:55:35.773267+0000","last_peered":"2024-04-25T09:55:35.773267+0000","last_clean":"2024-04-25T09:55:35.773267+0000","last_became_active":"2024-04-25T09:55:35.763203+0000","last_became_peered":"2024-04-25T09:55:35.763203+0000","last_unstale":"2024-04-25T09:55:35.773267+0000","last_undegraded":"2024-04-25T09:55:35.773267+0000","last_fullsized":"2024-04-25T09:55:35.773267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:10.115716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.764092+0000","last_change":"2024-04-25T09:55:35.760046+0000","last_active":"2024-04-25T09:55:35.764092+0000","last_peered":"2024-04-25T09:55:35.764092+0000","last_clean":"2024-04-25T09:55:35.764092+0000","last_became_active":"2024-04-25T09:55:35.759769+0000","last_became_peered":"2024-04-25T09:55:35.759769+0000","last_unstale":"2024-04-25T09:55:35.764092+0000","last_undegraded":"2024-04-25T09:55:35.764092+0000","last_fullsized":"2024-04-25T09:55:35.764092+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:02.497946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773399+0000","last_change":"2024-04-25T09:55:35.768514+0000","last_active":"2024-04-25T09:55:35.773399+0000","last_peered":"2024-04-25T09:55:35.773399+0000","last_clean":"2024-04-25T09:55:35.773399+0000","last_became_active":"2024-04-25T09:55:35.768212+0000","last_became_peered":"2024-04-25T09:55:35.768212+0000","last_unstale":"2024-04-25T09:55:35.773399+0000","last_undegraded":"2024-04-25T09:55:35.773399+0000","last_fullsized":"2024-04-25T09:55:35.773399+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:53.251434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.772951+0000","last_change":"2024-04-25T09:55:35.766182+0000","last_active":"2024-04-25T09:55:35.772951+0000","last_peered":"2024-04-25T09:55:35.772951+0000","last_clean":"2024-04-25T09:55:35.772951+0000","last_became_active":"2024-04-25T09:55:35.765914+0000","last_became_peered":"2024-04-25T09:55:35.765914+0000","last_unstale":"2024-04-25T09:55:35.772951+0000","last_undegraded":"2024-04-25T09:55:35.772951+0000","last_fullsized":"2024-04-25T09:55:35.772951+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:23.632331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.733244+0000","last_change":"2024-04-25T09:55:34.733244+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.733244+0000","last_undegraded":"2024-04-25T09:55:34.733244+0000","last_fullsized":"2024-04-25T09:55:34.733244+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.772798+0000","last_change":"2024-04-25T09:55:35.761736+0000","last_active":"2024-04-25T09:55:35.772798+0000","last_peered":"2024-04-25T09:55:35.772798+0000","last_clean":"2024-04-25T09:55:35.772798+0000","last_became_active":"2024-04-25T09:55:35.761387+0000","last_became_peered":"2024-04-25T09:55:35.761387+0000","last_unstale":"2024-04-25T09:55:35.772798+0000","last_undegraded":"2024-04-25T09:55:35.772798+0000","last_fullsized":"2024-04-25T09:55:35.772798+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:27.173551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773130+0000","last_change":"2024-04-25T09:55:35.759573+0000","last_active":"2024-04-25T09:55:35.773130+0000","last_peered":"2024-04-25T09:55:35.773130+0000","last_clean":"2024-04-25T09:55:35.773130+0000","last_became_active":"2024-04-25T09:55:35.759200+0000","last_became_peered":"2024-04-25T09:55:35.759200+0000","last_unstale":"2024-04-25T09:55:35.773130+0000","last_undegraded":"2024-04-25T09:55:35.773130+0000","last_fullsized":"2024-04-25T09:55:35.773130+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:12.257881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.758730+0000","last_change":"2024-04-25T09:55:35.747716+0000","last_active":"2024-04-25T09:55:35.758730+0000","last_peered":"2024-04-25T09:55:35.758730+0000","last_clean":"2024-04-25T09:55:35.758730+0000","last_became_active":"2024-04-25T09:55:35.747370+0000","last_became_peered":"2024-04-25T09:55:35.747370+0000","last_unstale":"2024-04-25T09:55:35.758730+0000","last_undegraded":"2024-04-25T09:55:35.758730+0000","last_fullsized":"2024-04-25T09:55:35.758730+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:27.173551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.763900+0000","last_change":"2024-04-25T09:55:35.756163+0000","last_active":"2024-04-25T09:55:35.763900+0000","last_peered":"2024-04-25T09:55:35.763900+0000","last_clean":"2024-04-25T09:55:35.763900+0000","last_became_active":"2024-04-25T09:55:35.755783+0000","last_became_peered":"2024-04-25T09:55:35.755783+0000","last_unstale":"2024-04-25T09:55:35.763900+0000","last_undegraded":"2024-04-25T09:55:35.763900+0000","last_fullsized":"2024-04-25T09:55:35.763900+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:43.087615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.732715+0000","last_change":"2024-04-25T09:55:34.732715+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.732715+0000","last_undegraded":"2024-04-25T09:55:34.732715+0000","last_fullsized":"2024-04-25T09:55:34.732715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.761341+0000","last_change":"2024-04-25T09:55:35.749966+0000","last_active":"2024-04-25T09:55:35.761341+0000","last_peered":"2024-04-25T09:55:35.761341+0000","last_clean":"2024-04-25T09:55:35.761341+0000","last_became_active":"2024-04-25T09:55:35.749527+0000","last_became_peered":"2024-04-25T09:55:35.749527+0000","last_unstale":"2024-04-25T09:55:35.761341+0000","last_undegraded":"2024-04-25T09:55:35.761341+0000","last_fullsized":"2024-04-25T09:55:35.761341+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:13.247677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.730311+0000","last_change":"2024-04-25T09:55:34.730311+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.730311+0000","last_undegraded":"2024-04-25T09:55:34.730311+0000","last_fullsized":"2024-04-25T09:55:34.730311+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.760704+0000","last_change":"2024-04-25T09:55:35.750137+0000","last_active":"2024-04-25T09:55:35.760704+0000","last_peered":"2024-04-25T09:55:35.760704+0000","last_clean":"2024-04-25T09:55:35.760704+0000","last_became_active":"2024-04-25T09:55:35.749850+0000","last_became_peered":"2024-04-25T09:55:35.749850+0000","last_unstale":"2024-04-25T09:55:35.760704+0000","last_undegraded":"2024-04-25T09:55:35.760704+0000","last_fullsized":"2024-04-25T09:55:35.760704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:28.106434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773079+0000","last_change":"2024-04-25T09:55:35.759353+0000","last_active":"2024-04-25T09:55:35.773079+0000","last_peered":"2024-04-25T09:55:35.773079+0000","last_clean":"2024-04-25T09:55:35.773079+0000","last_became_active":"2024-04-25T09:55:35.758976+0000","last_became_peered":"2024-04-25T09:55:35.758976+0000","last_unstale":"2024-04-25T09:55:35.773079+0000","last_undegraded":"2024-04-25T09:55:35.773079+0000","last_fullsized":"2024-04-25T09:55:35.773079+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:02.497946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.761770+0000","last_change":"2024-04-25T09:55:35.759021+0000","last_active":"2024-04-25T09:55:35.761770+0000","last_peered":"2024-04-25T09:55:35.761770+0000","last_clean":"2024-04-25T09:55:35.761770+0000","last_became_active":"2024-04-25T09:55:35.758662+0000","last_became_peered":"2024-04-25T09:55:35.758662+0000","last_unstale":"2024-04-25T09:55:35.761770+0000","last_undegraded":"2024-04-25T09:55:35.761770+0000","last_fullsized":"2024-04-25T09:55:35.761770+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:37.746023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.760726+0000","last_change":"2024-04-25T09:55:35.752315+0000","last_active":"2024-04-25T09:55:35.760726+0000","last_peered":"2024-04-25T09:55:35.760726+0000","last_clean":"2024-04-25T09:55:35.760726+0000","last_became_active":"2024-04-25T09:55:35.750495+0000","last_became_peered":"2024-04-25T09:55:35.750495+0000","last_unstale":"2024-04-25T09:55:35.760726+0000","last_undegraded":"2024-04-25T09:55:35.760726+0000","last_fullsized":"2024-04-25T09:55:35.760726+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:25.069355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.763873+0000","last_change":"2024-04-25T09:55:35.756176+0000","last_active":"2024-04-25T09:55:35.763873+0000","last_peered":"2024-04-25T09:55:35.763873+0000","last_clean":"2024-04-25T09:55:35.763873+0000","last_became_active":"2024-04-25T09:55:35.755837+0000","last_became_peered":"2024-04-25T09:55:35.755837+0000","last_unstale":"2024-04-25T09:55:35.763873+0000","last_undegraded":"2024-04-25T09:55:35.763873+0000","last_fullsized":"2024-04-25T09:55:35.763873+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:20.546402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727558+0000","last_change":"2024-04-25T09:55:34.727558+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727558+0000","last_undegraded":"2024-04-25T09:55:34.727558+0000","last_fullsized":"2024-04-25T09:55:34.727558+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.764060+0000","last_change":"2024-04-25T09:55:35.760617+0000","last_active":"2024-04-25T09:55:35.764060+0000","last_peered":"2024-04-25T09:55:35.764060+0000","last_clean":"2024-04-25T09:55:35.764060+0000","last_became_active":"2024-04-25T09:55:35.760321+0000","last_became_peered":"2024-04-25T09:55:35.760321+0000","last_unstale":"2024-04-25T09:55:35.764060+0000","last_undegraded":"2024-04-25T09:55:35.764060+0000","last_fullsized":"2024-04-25T09:55:35.764060+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:07.479394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.762942+0000","last_change":"2024-04-25T09:55:34.745543+0000","last_active":"2024-04-25T09:55:35.762942+0000","last_peered":"2024-04-25T09:55:35.762942+0000","last_clean":"2024-04-25T09:55:35.762942+0000","last_became_active":"2024-04-25T09:55:34.745243+0000","last_became_peered":"2024-04-25T09:55:34.745243+0000","last_unstale":"2024-04-25T09:55:35.762942+0000","last_undegraded":"2024-04-25T09:55:35.762942+0000","last_fullsized":"2024-04-25T09:55:35.762942+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:49.336547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.730036+0000","last_change":"2024-04-25T09:55:34.730036+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.730036+0000","last_undegraded":"2024-04-25T09:55:34.730036+0000","last_fullsized":"2024-04-25T09:55:34.730036+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.747850+0000","last_change":"2024-04-25T09:55:34.747086+0000","last_active":"2024-04-25T09:55:34.747850+0000","last_peered":"2024-04-25T09:55:34.747850+0000","last_clean":"2024-04-25T09:55:34.747850+0000","last_became_active":"2024-04-25T09:55:34.746760+0000","last_became_peered":"2024-04-25T09:55:34.746760+0000","last_unstale":"2024-04-25T09:55:34.747850+0000","last_undegraded":"2024-04-25T09:55:34.747850+0000","last_fullsized":"2024-04-25T09:55:34.747850+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:49.336547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.769019+0000","last_change":"2024-04-25T09:55:35.764169+0000","last_active":"2024-04-25T09:55:35.769019+0000","last_peered":"2024-04-25T09:55:35.769019+0000","last_clean":"2024-04-25T09:55:35.769019+0000","last_became_active":"2024-04-25T09:55:35.763842+0000","last_became_peered":"2024-04-25T09:55:35.763842+0000","last_unstale":"2024-04-25T09:55:35.769019+0000","last_undegraded":"2024-04-25T09:55:35.769019+0000","last_fullsized":"2024-04-25T09:55:35.769019+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:58.821504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.744649+0000","last_change":"2024-04-25T09:55:34.743621+0000","last_active":"2024-04-25T09:55:34.744649+0000","last_peered":"2024-04-25T09:55:34.744649+0000","last_clean":"2024-04-25T09:55:34.744649+0000","last_became_active":"2024-04-25T09:55:34.743238+0000","last_became_peered":"2024-04-25T09:55:34.743238+0000","last_unstale":"2024-04-25T09:55:34.744649+0000","last_undegraded":"2024-04-25T09:55:34.744649+0000","last_fullsized":"2024-04-25T09:55:34.744649+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:49.289488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.728924+0000","last_change":"2024-04-25T09:55:34.728924+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.728924+0000","last_undegraded":"2024-04-25T09:55:34.728924+0000","last_fullsized":"2024-04-25T09:55:34.728924+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.749586+0000","last_change":"2024-04-25T09:55:34.744009+0000","last_active":"2024-04-25T09:55:35.749586+0000","last_peered":"2024-04-25T09:55:35.749586+0000","last_clean":"2024-04-25T09:55:35.749586+0000","last_became_active":"2024-04-25T09:55:34.743062+0000","last_became_peered":"2024-04-25T09:55:34.743062+0000","last_unstale":"2024-04-25T09:55:35.749586+0000","last_undegraded":"2024-04-25T09:55:35.749586+0000","last_fullsized":"2024-04-25T09:55:35.749586+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:49.336547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.728747+0000","last_change":"2024-04-25T09:55:34.728747+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.728747+0000","last_undegraded":"2024-04-25T09:55:34.728747+0000","last_fullsized":"2024-04-25T09:55:34.728747+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.759042+0000","last_change":"2024-04-25T09:55:34.750441+0000","last_active":"2024-04-25T09:55:35.759042+0000","last_peered":"2024-04-25T09:55:35.759042+0000","last_clean":"2024-04-25T09:55:35.759042+0000","last_became_active":"2024-04-25T09:55:34.750055+0000","last_became_peered":"2024-04-25T09:55:34.750055+0000","last_unstale":"2024-04-25T09:55:35.759042+0000","last_undegraded":"2024-04-25T09:55:35.759042+0000","last_fullsized":"2024-04-25T09:55:35.759042+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:19.539959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773442+0000","last_change":"2024-04-25T09:55:35.765490+0000","last_active":"2024-04-25T09:55:35.773442+0000","last_peered":"2024-04-25T09:55:35.773442+0000","last_clean":"2024-04-25T09:55:35.773442+0000","last_became_active":"2024-04-25T09:55:35.762884+0000","last_became_peered":"2024-04-25T09:55:35.762884+0000","last_unstale":"2024-04-25T09:55:35.773442+0000","last_undegraded":"2024-04-25T09:55:35.773442+0000","last_fullsized":"2024-04-25T09:55:35.773442+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:34.458200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.760230+0000","last_change":"2024-04-25T09:55:34.744929+0000","last_active":"2024-04-25T09:55:35.760230+0000","last_peered":"2024-04-25T09:55:35.760230+0000","last_clean":"2024-04-25T09:55:35.760230+0000","last_became_active":"2024-04-25T09:55:34.744561+0000","last_became_peered":"2024-04-25T09:55:34.744561+0000","last_unstale":"2024-04-25T09:55:35.760230+0000","last_undegraded":"2024-04-25T09:55:35.760230+0000","last_fullsized":"2024-04-25T09:55:35.760230+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:24.062912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.767805+0000","last_change":"2024-04-25T09:55:35.763093+0000","last_active":"2024-04-25T09:55:35.767805+0000","last_peered":"2024-04-25T09:55:35.767805+0000","last_clean":"2024-04-25T09:55:35.767805+0000","last_became_active":"2024-04-25T09:55:35.762596+0000","last_became_peered":"2024-04-25T09:55:35.762596+0000","last_unstale":"2024-04-25T09:55:35.767805+0000","last_undegraded":"2024-04-25T09:55:35.767805+0000","last_fullsized":"2024-04-25T09:55:35.767805+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:43.087615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.750521+0000","last_change":"2024-04-25T09:55:34.749888+0000","last_active":"2024-04-25T09:55:34.750521+0000","last_peered":"2024-04-25T09:55:34.750521+0000","last_clean":"2024-04-25T09:55:34.750521+0000","last_became_active":"2024-04-25T09:55:34.749584+0000","last_became_peered":"2024-04-25T09:55:34.749584+0000","last_unstale":"2024-04-25T09:55:34.750521+0000","last_undegraded":"2024-04-25T09:55:34.750521+0000","last_fullsized":"2024-04-25T09:55:34.750521+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:49.336547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.728439+0000","last_change":"2024-04-25T09:55:34.728439+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.728439+0000","last_undegraded":"2024-04-25T09:55:34.728439+0000","last_fullsized":"2024-04-25T09:55:34.728439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.741286+0000","last_change":"2024-04-25T09:55:34.743854+0000","last_active":"2024-04-25T09:55:35.741286+0000","last_peered":"2024-04-25T09:55:35.741286+0000","last_clean":"2024-04-25T09:55:35.741286+0000","last_became_active":"2024-04-25T09:55:34.743570+0000","last_became_peered":"2024-04-25T09:55:34.743570+0000","last_unstale":"2024-04-25T09:55:35.741286+0000","last_undegraded":"2024-04-25T09:55:35.741286+0000","last_fullsized":"2024-04-25T09:55:35.741286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:14.801427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.731859+0000","last_change":"2024-04-25T09:55:34.731859+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.731859+0000","last_undegraded":"2024-04-25T09:55:34.731859+0000","last_fullsized":"2024-04-25T09:55:34.731859+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.735677+0000","last_change":"2024-04-25T09:55:34.734433+0000","last_active":"2024-04-25T09:55:34.735677+0000","last_peered":"2024-04-25T09:55:34.735677+0000","last_clean":"2024-04-25T09:55:34.735677+0000","last_became_active":"2024-04-25T09:55:34.733827+0000","last_became_peered":"2024-04-25T09:55:34.733827+0000","last_unstale":"2024-04-25T09:55:34.735677+0000","last_undegraded":"2024-04-25T09:55:34.735677+0000","last_fullsized":"2024-04-25T09:55:34.735677+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:19.539959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.772866+0000","last_change":"2024-04-25T09:55:35.765319+0000","last_active":"2024-04-25T09:55:35.772866+0000","last_peered":"2024-04-25T09:55:35.772866+0000","last_clean":"2024-04-25T09:55:35.772866+0000","last_became_active":"2024-04-25T09:55:35.764862+0000","last_became_peered":"2024-04-25T09:55:35.764862+0000","last_unstale":"2024-04-25T09:55:35.772866+0000","last_undegraded":"2024-04-25T09:55:35.772866+0000","last_fullsized":"2024-04-25T09:55:35.772866+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:58.065939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.750195+0000","last_change":"2024-04-25T09:55:34.749934+0000","last_active":"2024-04-25T09:55:35.750195+0000","last_peered":"2024-04-25T09:55:35.750195+0000","last_clean":"2024-04-25T09:55:35.750195+0000","last_became_active":"2024-04-25T09:55:34.748781+0000","last_became_peered":"2024-04-25T09:55:34.748781+0000","last_unstale":"2024-04-25T09:55:35.750195+0000","last_undegraded":"2024-04-25T09:55:35.750195+0000","last_fullsized":"2024-04-25T09:55:35.750195+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:42.081172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.728487+0000","last_change":"2024-04-25T09:55:34.728487+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.728487+0000","last_undegraded":"2024-04-25T09:55:34.728487+0000","last_fullsized":"2024-04-25T09:55:34.728487+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.768519+0000","last_change":"2024-04-25T09:55:34.751988+0000","last_active":"2024-04-25T09:55:35.768519+0000","last_peered":"2024-04-25T09:55:35.768519+0000","last_clean":"2024-04-25T09:55:35.768519+0000","last_became_active":"2024-04-25T09:55:34.751600+0000","last_became_peered":"2024-04-25T09:55:34.751600+0000","last_unstale":"2024-04-25T09:55:35.768519+0000","last_undegraded":"2024-04-25T09:55:35.768519+0000","last_fullsized":"2024-04-25T09:55:35.768519+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:57.815061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.753143+0000","last_change":"2024-04-25T09:55:35.745530+0000","last_active":"2024-04-25T09:55:35.753143+0000","last_peered":"2024-04-25T09:55:35.753143+0000","last_clean":"2024-04-25T09:55:35.753143+0000","last_became_active":"2024-04-25T09:55:35.745156+0000","last_became_peered":"2024-04-25T09:55:35.745156+0000","last_unstale":"2024-04-25T09:55:35.753143+0000","last_undegraded":"2024-04-25T09:55:35.753143+0000","last_fullsized":"2024-04-25T09:55:35.753143+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:25.069355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.747509+0000","last_change":"2024-04-25T09:55:34.746883+0000","last_active":"2024-04-25T09:55:34.747509+0000","last_peered":"2024-04-25T09:55:34.747509+0000","last_clean":"2024-04-25T09:55:34.747509+0000","last_became_active":"2024-04-25T09:55:34.746605+0000","last_became_peered":"2024-04-25T09:55:34.746605+0000","last_unstale":"2024-04-25T09:55:34.747509+0000","last_undegraded":"2024-04-25T09:55:34.747509+0000","last_fullsized":"2024-04-25T09:55:34.747509+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:42.081172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.728352+0000","last_change":"2024-04-25T09:55:34.728352+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.728352+0000","last_undegraded":"2024-04-25T09:55:34.728352+0000","last_fullsized":"2024-04-25T09:55:34.728352+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.735751+0000","last_change":"2024-04-25T09:55:34.734268+0000","last_active":"2024-04-25T09:55:34.735751+0000","last_peered":"2024-04-25T09:55:34.735751+0000","last_clean":"2024-04-25T09:55:34.735751+0000","last_became_active":"2024-04-25T09:55:34.733940+0000","last_became_peered":"2024-04-25T09:55:34.733940+0000","last_unstale":"2024-04-25T09:55:34.735751+0000","last_undegraded":"2024-04-25T09:55:34.735751+0000","last_fullsized":"2024-04-25T09:55:34.735751+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:22.625888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.726523+0000","last_change":"2024-04-25T09:55:34.726523+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.726523+0000","last_undegraded":"2024-04-25T09:55:34.726523+0000","last_fullsized":"2024-04-25T09:55:34.726523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.751808+0000","last_change":"2024-04-25T09:55:34.751004+0000","last_active":"2024-04-25T09:55:34.751808+0000","last_peered":"2024-04-25T09:55:34.751808+0000","last_clean":"2024-04-25T09:55:34.751808+0000","last_became_active":"2024-04-25T09:55:34.750719+0000","last_became_peered":"2024-04-25T09:55:34.750719+0000","last_unstale":"2024-04-25T09:55:34.751808+0000","last_undegraded":"2024-04-25T09:55:34.751808+0000","last_fullsized":"2024-04-25T09:55:34.751808+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:14.801427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.764461+0000","last_change":"2024-04-25T09:55:35.756163+0000","last_active":"2024-04-25T09:55:35.764461+0000","last_peered":"2024-04-25T09:55:35.764461+0000","last_clean":"2024-04-25T09:55:35.764461+0000","last_became_active":"2024-04-25T09:55:35.755652+0000","last_became_peered":"2024-04-25T09:55:35.755652+0000","last_unstale":"2024-04-25T09:55:35.764461+0000","last_undegraded":"2024-04-25T09:55:35.764461+0000","last_fullsized":"2024-04-25T09:55:35.764461+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:58.821504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.740102+0000","last_change":"2024-04-25T09:55:34.745319+0000","last_active":"2024-04-25T09:55:35.740102+0000","last_peered":"2024-04-25T09:55:35.740102+0000","last_clean":"2024-04-25T09:55:35.740102+0000","last_became_active":"2024-04-25T09:55:34.745029+0000","last_became_peered":"2024-04-25T09:55:34.745029+0000","last_unstale":"2024-04-25T09:55:35.740102+0000","last_undegraded":"2024-04-25T09:55:35.740102+0000","last_fullsized":"2024-04-25T09:55:35.740102+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:14.801427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.726983+0000","last_change":"2024-04-25T09:55:34.726983+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.726983+0000","last_undegraded":"2024-04-25T09:55:34.726983+0000","last_fullsized":"2024-04-25T09:55:34.726983+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.761411+0000","last_change":"2024-04-25T09:55:34.746478+0000","last_active":"2024-04-25T09:55:35.761411+0000","last_peered":"2024-04-25T09:55:35.761411+0000","last_clean":"2024-04-25T09:55:35.761411+0000","last_became_active":"2024-04-25T09:55:34.745385+0000","last_became_peered":"2024-04-25T09:55:34.745385+0000","last_unstale":"2024-04-25T09:55:35.761411+0000","last_undegraded":"2024-04-25T09:55:35.761411+0000","last_fullsized":"2024-04-25T09:55:35.761411+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:27.099991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727061+0000","last_change":"2024-04-25T09:55:34.727061+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727061+0000","last_undegraded":"2024-04-25T09:55:34.727061+0000","last_fullsized":"2024-04-25T09:55:34.727061+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.761760+0000","last_change":"2024-04-25T09:55:34.751912+0000","last_active":"2024-04-25T09:55:35.761760+0000","last_peered":"2024-04-25T09:55:35.761760+0000","last_clean":"2024-04-25T09:55:35.761760+0000","last_became_active":"2024-04-25T09:55:34.751601+0000","last_became_peered":"2024-04-25T09:55:34.751601+0000","last_unstale":"2024-04-25T09:55:35.761760+0000","last_undegraded":"2024-04-25T09:55:35.761760+0000","last_fullsized":"2024-04-25T09:55:35.761760+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:26.167108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773893+0000","last_change":"2024-04-25T09:55:35.767965+0000","last_active":"2024-04-25T09:55:35.773893+0000","last_peered":"2024-04-25T09:55:35.773893+0000","last_clean":"2024-04-25T09:55:35.773893+0000","last_became_active":"2024-04-25T09:55:35.767682+0000","last_became_peered":"2024-04-25T09:55:35.767682+0000","last_unstale":"2024-04-25T09:55:35.773893+0000","last_undegraded":"2024-04-25T09:55:35.773893+0000","last_fullsized":"2024-04-25T09:55:35.773893+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:03.959180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.767824+0000","last_change":"2024-04-25T09:55:34.752634+0000","last_active":"2024-04-25T09:55:35.767824+0000","last_peered":"2024-04-25T09:55:35.767824+0000","last_clean":"2024-04-25T09:55:35.767824+0000","last_became_active":"2024-04-25T09:55:34.752309+0000","last_became_peered":"2024-04-25T09:55:34.752309+0000","last_unstale":"2024-04-25T09:55:35.767824+0000","last_undegraded":"2024-04-25T09:55:35.767824+0000","last_fullsized":"2024-04-25T09:55:35.767824+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:27.099991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.763693+0000","last_change":"2024-04-25T09:55:35.749342+0000","last_active":"2024-04-25T09:55:35.763693+0000","last_peered":"2024-04-25T09:55:35.763693+0000","last_clean":"2024-04-25T09:55:35.763693+0000","last_became_active":"2024-04-25T09:55:35.749073+0000","last_became_peered":"2024-04-25T09:55:35.749073+0000","last_unstale":"2024-04-25T09:55:35.763693+0000","last_undegraded":"2024-04-25T09:55:35.763693+0000","last_fullsized":"2024-04-25T09:55:35.763693+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:23.632331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.749062+0000","last_change":"2024-04-25T09:55:34.748592+0000","last_active":"2024-04-25T09:55:34.749062+0000","last_peered":"2024-04-25T09:55:34.749062+0000","last_clean":"2024-04-25T09:55:34.749062+0000","last_became_active":"2024-04-25T09:55:34.748241+0000","last_became_peered":"2024-04-25T09:55:34.748241+0000","last_unstale":"2024-04-25T09:55:34.749062+0000","last_undegraded":"2024-04-25T09:55:34.749062+0000","last_fullsized":"2024-04-25T09:55:34.749062+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:58.101203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.731923+0000","last_change":"2024-04-25T09:55:34.731923+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.731923+0000","last_undegraded":"2024-04-25T09:55:34.731923+0000","last_fullsized":"2024-04-25T09:55:34.731923+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.746236+0000","last_change":"2024-04-25T09:55:34.744760+0000","last_active":"2024-04-25T09:55:34.746236+0000","last_peered":"2024-04-25T09:55:34.746236+0000","last_clean":"2024-04-25T09:55:34.746236+0000","last_became_active":"2024-04-25T09:55:34.744440+0000","last_became_peered":"2024-04-25T09:55:34.744440+0000","last_unstale":"2024-04-25T09:55:34.746236+0000","last_undegraded":"2024-04-25T09:55:34.746236+0000","last_fullsized":"2024-04-25T09:55:34.746236+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:32.776034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.763822+0000","last_change":"2024-04-25T09:55:35.756114+0000","last_active":"2024-04-25T09:55:35.763822+0000","last_peered":"2024-04-25T09:55:35.763822+0000","last_clean":"2024-04-25T09:55:35.763822+0000","last_became_active":"2024-04-25T09:55:35.755727+0000","last_became_peered":"2024-04-25T09:55:35.755727+0000","last_unstale":"2024-04-25T09:55:35.763822+0000","last_undegraded":"2024-04-25T09:55:35.763822+0000","last_fullsized":"2024-04-25T09:55:35.763822+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:23.632331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.737877+0000","last_change":"2024-04-25T09:55:34.737032+0000","last_active":"2024-04-25T09:55:34.737877+0000","last_peered":"2024-04-25T09:55:34.737877+0000","last_clean":"2024-04-25T09:55:34.737877+0000","last_became_active":"2024-04-25T09:55:34.736683+0000","last_became_peered":"2024-04-25T09:55:34.736683+0000","last_unstale":"2024-04-25T09:55:34.737877+0000","last_undegraded":"2024-04-25T09:55:34.737877+0000","last_fullsized":"2024-04-25T09:55:34.737877+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:49.623487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.730122+0000","last_change":"2024-04-25T09:55:34.730122+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.730122+0000","last_undegraded":"2024-04-25T09:55:34.730122+0000","last_fullsized":"2024-04-25T09:55:34.730122+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.745997+0000","last_change":"2024-04-25T09:55:34.745223+0000","last_active":"2024-04-25T09:55:34.745997+0000","last_peered":"2024-04-25T09:55:34.745997+0000","last_clean":"2024-04-25T09:55:34.745997+0000","last_became_active":"2024-04-25T09:55:34.744879+0000","last_became_peered":"2024-04-25T09:55:34.744879+0000","last_unstale":"2024-04-25T09:55:34.745997+0000","last_undegraded":"2024-04-25T09:55:34.745997+0000","last_fullsized":"2024-04-25T09:55:34.745997+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:15.660968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773369+0000","last_change":"2024-04-25T09:55:35.764920+0000","last_active":"2024-04-25T09:55:35.773369+0000","last_peered":"2024-04-25T09:55:35.773369+0000","last_clean":"2024-04-25T09:55:35.773369+0000","last_became_active":"2024-04-25T09:55:35.764523+0000","last_became_peered":"2024-04-25T09:55:35.764523+0000","last_unstale":"2024-04-25T09:55:35.773369+0000","last_undegraded":"2024-04-25T09:55:35.773369+0000","last_fullsized":"2024-04-25T09:55:35.773369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:12.411252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.744431+0000","last_change":"2024-04-25T09:55:34.747558+0000","last_active":"2024-04-25T09:55:35.744431+0000","last_peered":"2024-04-25T09:55:35.744431+0000","last_clean":"2024-04-25T09:55:35.744431+0000","last_became_active":"2024-04-25T09:55:34.747247+0000","last_became_peered":"2024-04-25T09:55:34.747247+0000","last_unstale":"2024-04-25T09:55:35.744431+0000","last_undegraded":"2024-04-25T09:55:35.744431+0000","last_fullsized":"2024-04-25T09:55:35.744431+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:36.739580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.726476+0000","last_change":"2024-04-25T09:55:34.726476+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.726476+0000","last_undegraded":"2024-04-25T09:55:34.726476+0000","last_fullsized":"2024-04-25T09:55:34.726476+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.740441+0000","last_change":"2024-04-25T09:55:34.738977+0000","last_active":"2024-04-25T09:55:34.740441+0000","last_peered":"2024-04-25T09:55:34.740441+0000","last_clean":"2024-04-25T09:55:34.740441+0000","last_became_active":"2024-04-25T09:55:34.738688+0000","last_became_peered":"2024-04-25T09:55:34.738688+0000","last_unstale":"2024-04-25T09:55:34.740441+0000","last_undegraded":"2024-04-25T09:55:34.740441+0000","last_fullsized":"2024-04-25T09:55:34.740441+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:08.898597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.729237+0000","last_change":"2024-04-25T09:55:34.729237+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.729237+0000","last_undegraded":"2024-04-25T09:55:34.729237+0000","last_fullsized":"2024-04-25T09:55:34.729237+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.759569+0000","last_change":"2024-04-25T09:55:34.751955+0000","last_active":"2024-04-25T09:55:35.759569+0000","last_peered":"2024-04-25T09:55:35.759569+0000","last_clean":"2024-04-25T09:55:35.759569+0000","last_became_active":"2024-04-25T09:55:34.751661+0000","last_became_peered":"2024-04-25T09:55:34.751661+0000","last_unstale":"2024-04-25T09:55:35.759569+0000","last_undegraded":"2024-04-25T09:55:35.759569+0000","last_fullsized":"2024-04-25T09:55:35.759569+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:22.625888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.772888+0000","last_change":"2024-04-25T09:55:35.765747+0000","last_active":"2024-04-25T09:55:35.772888+0000","last_peered":"2024-04-25T09:55:35.772888+0000","last_clean":"2024-04-25T09:55:35.772888+0000","last_became_active":"2024-04-25T09:55:35.765400+0000","last_became_peered":"2024-04-25T09:55:35.765400+0000","last_unstale":"2024-04-25T09:55:35.772888+0000","last_undegraded":"2024-04-25T09:55:35.772888+0000","last_fullsized":"2024-04-25T09:55:35.772888+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:10.115716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.750254+0000","last_change":"2024-04-25T09:55:34.749607+0000","last_active":"2024-04-25T09:55:34.750254+0000","last_peered":"2024-04-25T09:55:34.750254+0000","last_clean":"2024-04-25T09:55:34.750254+0000","last_became_active":"2024-04-25T09:55:34.749293+0000","last_became_peered":"2024-04-25T09:55:34.749293+0000","last_unstale":"2024-04-25T09:55:34.750254+0000","last_undegraded":"2024-04-25T09:55:34.750254+0000","last_fullsized":"2024-04-25T09:55:34.750254+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:47.145780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.726240+0000","last_change":"2024-04-25T09:55:34.726240+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.726240+0000","last_undegraded":"2024-04-25T09:55:34.726240+0000","last_fullsized":"2024-04-25T09:55:34.726240+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.735927+0000","last_change":"2024-04-25T09:55:34.734044+0000","last_active":"2024-04-25T09:55:34.735927+0000","last_peered":"2024-04-25T09:55:34.735927+0000","last_clean":"2024-04-25T09:55:34.735927+0000","last_became_active":"2024-04-25T09:55:34.733742+0000","last_became_peered":"2024-04-25T09:55:34.733742+0000","last_unstale":"2024-04-25T09:55:34.735927+0000","last_undegraded":"2024-04-25T09:55:34.735927+0000","last_fullsized":"2024-04-25T09:55:34.735927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:49.289488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727916+0000","last_change":"2024-04-25T09:55:34.727916+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727916+0000","last_undegraded":"2024-04-25T09:55:34.727916+0000","last_fullsized":"2024-04-25T09:55:34.727916+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.738952+0000","last_change":"2024-04-25T09:55:34.738180+0000","last_active":"2024-04-25T09:55:34.738952+0000","last_peered":"2024-04-25T09:55:34.738952+0000","last_clean":"2024-04-25T09:55:34.738952+0000","last_became_active":"2024-04-25T09:55:34.737894+0000","last_became_peered":"2024-04-25T09:55:34.737894+0000","last_unstale":"2024-04-25T09:55:34.738952+0000","last_undegraded":"2024-04-25T09:55:34.738952+0000","last_fullsized":"2024-04-25T09:55:34.738952+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:32.776034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:55:34.727617+0000","last_change":"2024-04-25T09:55:34.727617+0000","last_active":"2024-04-25T09:55:34.715847+0000","last_peered":"2024-04-25T09:55:34.715847+0000","last_clean":"2024-04-25T09:55:34.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:55:34.727617+0000","last_undegraded":"2024-04-25T09:55:34.727617+0000","last_fullsized":"2024-04-25T09:55:34.727617+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.739163+0000","last_change":"2024-04-25T09:55:34.742098+0000","last_active":"2024-04-25T09:55:35.739163+0000","last_peered":"2024-04-25T09:55:35.739163+0000","last_clean":"2024-04-25T09:55:35.739163+0000","last_became_active":"2024-04-25T09:55:34.741787+0000","last_became_peered":"2024-04-25T09:55:34.741787+0000","last_unstale":"2024-04-25T09:55:35.739163+0000","last_undegraded":"2024-04-25T09:55:35.739163+0000","last_fullsized":"2024-04-25T09:55:35.739163+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:32.776034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.752849+0000","last_change":"2024-04-25T09:55:35.746484+0000","last_active":"2024-04-25T09:55:35.752849+0000","last_peered":"2024-04-25T09:55:35.752849+0000","last_clean":"2024-04-25T09:55:35.752849+0000","last_became_active":"2024-04-25T09:55:35.746195+0000","last_became_peered":"2024-04-25T09:55:35.746195+0000","last_unstale":"2024-04-25T09:55:35.752849+0000","last_undegraded":"2024-04-25T09:55:35.752849+0000","last_fullsized":"2024-04-25T09:55:35.752849+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:37.746023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.741723+0000","last_change":"2024-04-25T09:55:34.743941+0000","last_active":"2024-04-25T09:55:35.741723+0000","last_peered":"2024-04-25T09:55:35.741723+0000","last_clean":"2024-04-25T09:55:35.741723+0000","last_became_active":"2024-04-25T09:55:34.743567+0000","last_became_peered":"2024-04-25T09:55:34.743567+0000","last_unstale":"2024-04-25T09:55:35.741723+0000","last_undegraded":"2024-04-25T09:55:35.741723+0000","last_fullsized":"2024-04-25T09:55:35.741723+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:12.241234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.772778+0000","last_change":"2024-04-25T09:55:35.765142+0000","last_active":"2024-04-25T09:55:35.772778+0000","last_peered":"2024-04-25T09:55:35.772778+0000","last_clean":"2024-04-25T09:55:35.772778+0000","last_became_active":"2024-04-25T09:55:35.764844+0000","last_became_peered":"2024-04-25T09:55:35.764844+0000","last_unstale":"2024-04-25T09:55:35.772778+0000","last_undegraded":"2024-04-25T09:55:35.772778+0000","last_fullsized":"2024-04-25T09:55:35.772778+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:12.257881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:55:34.735709+0000","last_change":"2024-04-25T09:55:34.731152+0000","last_active":"2024-04-25T09:55:34.735709+0000","last_peered":"2024-04-25T09:55:34.735709+0000","last_clean":"2024-04-25T09:55:34.735709+0000","last_became_active":"2024-04-25T09:55:34.730845+0000","last_became_peered":"2024-04-25T09:55:34.730845+0000","last_unstale":"2024-04-25T09:55:34.735709+0000","last_undegraded":"2024-04-25T09:55:34.735709+0000","last_fullsized":"2024-04-25T09:55:34.735709+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:26.167108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.773156+0000","last_change":"2024-04-25T09:55:35.762049+0000","last_active":"2024-04-25T09:55:35.773156+0000","last_peered":"2024-04-25T09:55:35.773156+0000","last_clean":"2024-04-25T09:55:35.773156+0000","last_became_active":"2024-04-25T09:55:35.761764+0000","last_became_peered":"2024-04-25T09:55:35.761764+0000","last_unstale":"2024-04-25T09:55:35.773156+0000","last_undegraded":"2024-04-25T09:55:35.773156+0000","last_fullsized":"2024-04-25T09:55:35.773156+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:58.065939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.744977+0000","last_change":"2024-04-25T09:55:34.746165+0000","last_active":"2024-04-25T09:55:35.744977+0000","last_peered":"2024-04-25T09:55:35.744977+0000","last_clean":"2024-04-25T09:55:35.744977+0000","last_became_active":"2024-04-25T09:55:34.745859+0000","last_became_peered":"2024-04-25T09:55:34.745859+0000","last_unstale":"2024-04-25T09:55:35.744977+0000","last_undegraded":"2024-04-25T09:55:35.744977+0000","last_fullsized":"2024-04-25T09:55:35.744977+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:26.167108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T09:55:35.744054+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T09:55:35.744054+0000","last_peered":"2024-04-25T09:55:35.744054+0000","last_clean":"2024-04-25T09:55:35.744054+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T09:55:35.744054+0000","last_undegraded":"2024-04-25T09:55:35.744054+0000","last_fullsized":"2024-04-25T09:55:35.744054+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":694,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542163,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1015808,"data_stored":770080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542163,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":179712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542165,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":421888,"data_stored":179712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":179712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":409600,"data_stored":173045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":409600,"data_stored":173045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":409600,"data_stored":173045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1003520,"data_stored":763413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:55:40.712 INFO:tasks.ceph.mds.b.smithi055.stderr:2024-04-25T09:55:40.710+0000 7fee25d15640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:55:43.172 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:55:43.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.283+0000 7f795e0fc640 1 Processor -- start 2024-04-25T09:55:43.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.283+0000 7f795e0fc640 1 -- start start 2024-04-25T09:55:43.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.284+0000 7f795e0fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f79581529e0 0x7f79580c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:43.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.284+0000 7f795e0fc640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f795815bdc0 con 0x7f79580cea60 2024-04-25T09:55:43.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.284+0000 7f795e0fc640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f795815c060 con 0x7f79580c6410 2024-04-25T09:55:43.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.284+0000 7f795e0fc640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79580b2340 con 0x7f79581529e0 2024-04-25T09:55:43.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.284+0000 7f7957fff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f79580cea60 0x7f795806d150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58664/0 (socket says 172.21.15.7:58664) 2024-04-25T09:55:43.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.284+0000 7f7957fff640 1 -- 172.21.15.7:0/2766229308 learned_addr learned my addr 172.21.15.7:0/2766229308 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:43.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.284+0000 7f79577fe640 1 --2- 172.21.15.7:0/2766229308 >> v2:172.21.15.55:3300/0 conn(0x7f79581529e0 0x7f79580c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:43.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.284+0000 7f79567fc640 1 -- 172.21.15.7:0/2766229308 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 858413247 0 0) 0x7f795815bdc0 con 0x7f79580cea60 2024-04-25T09:55:43.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.284+0000 7f79567fc640 1 -- 172.21.15.7:0/2766229308 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7940003520 con 0x7f79580cea60 2024-04-25T09:55:43.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.285+0000 7f79567fc640 1 -- 172.21.15.7:0/2766229308 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3055266083 0 0) 0x7f7940003520 con 0x7f79580cea60 2024-04-25T09:55:43.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.285+0000 7f79567fc640 1 -- 172.21.15.7:0/2766229308 >> v2:172.21.15.55:3300/0 conn(0x7f79581529e0 msgr2=0x7f79580c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:43.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.285+0000 7f79567fc640 1 --2- 172.21.15.7:0/2766229308 >> v2:172.21.15.55:3300/0 conn(0x7f79581529e0 0x7f79580c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:43.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.285+0000 7f79567fc640 1 -- 172.21.15.7:0/2766229308 >> v1:172.21.15.55:6789/0 conn(0x7f79580c6410 legacy=0x7f79580ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:43.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.285+0000 7f79567fc640 1 -- 172.21.15.7:0/2766229308 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795815c340 con 0x7f79580cea60 2024-04-25T09:55:43.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.285+0000 7f79567fc640 1 -- 172.21.15.7:0/2766229308 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f79500019f0 con 0x7f79580cea60 2024-04-25T09:55:43.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.285+0000 7f79567fc640 1 -- 172.21.15.7:0/2766229308 >> v1:172.21.15.7:6789/0 conn(0x7f79580cea60 legacy=0x7f795806d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:43.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.285+0000 7f79567fc640 1 --2- 172.21.15.7:0/2766229308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7940003a00 0x7f7940003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:43.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.285+0000 7f79567fc640 1 --2- 172.21.15.7:0/2766229308 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7940004800 0x7f7940004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:43.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.285+0000 7f79567fc640 1 --2- 172.21.15.7:0/2766229308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79400051c0 0x7f794000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:43.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.285+0000 7f79567fc640 1 -- 172.21.15.7:0/2766229308 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79580b2340 con 0x7f7940003a00 2024-04-25T09:55:43.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.285+0000 7f79567fc640 1 -- 172.21.15.7:0/2766229308 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794000c0c0 con 0x7f79400051c0 2024-04-25T09:55:43.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.285+0000 7f79567fc640 1 -- 172.21.15.7:0/2766229308 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794000c2c0 con 0x7f7940004800 2024-04-25T09:55:43.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.285+0000 7f79577fe640 1 --2- 172.21.15.7:0/2766229308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7940003a00 0x7f7940003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:43.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.285+0000 7f7957fff640 1 --2- 172.21.15.7:0/2766229308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79400051c0 0x7f794000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:43.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.285+0000 7f7956ffd640 1 --2- 172.21.15.7:0/2766229308 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7940004800 0x7f7940004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:43.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.285+0000 7f79577fe640 1 -- 172.21.15.7:0/2766229308 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7940004800 msgr2=0x7f7940004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:43.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.285+0000 7f79577fe640 1 --2- 172.21.15.7:0/2766229308 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7940004800 0x7f7940004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:43.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.285+0000 7f79577fe640 1 -- 172.21.15.7:0/2766229308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79400051c0 msgr2=0x7f794000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:43.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.285+0000 7f79577fe640 1 --2- 172.21.15.7:0/2766229308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79400051c0 0x7f794000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:43.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.285+0000 7f7957fff640 1 -- 172.21.15.7:0/2766229308 reap_dead start 2024-04-25T09:55:43.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.285+0000 7f79577fe640 1 -- 172.21.15.7:0/2766229308 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7940003520 con 0x7f7940003a00 2024-04-25T09:55:43.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.285+0000 7f7956ffd640 1 --2- 172.21.15.7:0/2766229308 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7940004800 0x7f7940004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:43.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.286+0000 7f79577fe640 1 --2- 172.21.15.7:0/2766229308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7940003a00 0x7f7940003e20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7948009ac0 tx=0x7f7940005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354e600703cc1100 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:43.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.286+0000 7f79567fc640 1 -- 172.21.15.7:0/2766229308 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948036070 con 0x7f7940003a00 2024-04-25T09:55:43.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.286+0000 7f79567fc640 1 -- 172.21.15.7:0/2766229308 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7948031400 con 0x7f7940003a00 2024-04-25T09:55:43.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.286+0000 7f79567fc640 1 -- 172.21.15.7:0/2766229308 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948009690 con 0x7f7940003a00 2024-04-25T09:55:43.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.287+0000 7f795e0fc640 1 -- 172.21.15.7:0/2766229308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7940003a00 msgr2=0x7f7940003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:43.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.287+0000 7f795e0fc640 1 --2- 172.21.15.7:0/2766229308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7940003a00 0x7f7940003e20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7948009ac0 tx=0x7f7940005830 comp rx=0 tx=0).stop 2024-04-25T09:55:43.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.287+0000 7f795e0fc640 1 -- 172.21.15.7:0/2766229308 shutdown_connections 2024-04-25T09:55:43.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.287+0000 7f795e0fc640 1 --2- 172.21.15.7:0/2766229308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7940003a00 0x7f7940003e20 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:43.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.287+0000 7f795e0fc640 1 -- 172.21.15.7:0/2766229308 >> 172.21.15.7:0/2766229308 conn(0x7f7958071150 msgr2=0x7f7958071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:43.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.287+0000 7f795e0fc640 1 -- 172.21.15.7:0/2766229308 shutdown_connections 2024-04-25T09:55:43.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.287+0000 7f795e0fc640 1 -- 172.21.15.7:0/2766229308 wait complete. 2024-04-25T09:55:43.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.288+0000 7f795e0fc640 1 Processor -- start 2024-04-25T09:55:43.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.288+0000 7f795e0fc640 1 -- start start 2024-04-25T09:55:43.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.289+0000 7f795e0fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7940003a00 0x7f79580c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:43.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.289+0000 7f795e0fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7958144e30 0x7f79580c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:43.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.289+0000 7f795e0fc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7958145290 0x7f79580c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:43.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.289+0000 7f795e0fc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7958071ed0 con 0x7f7940003a00 2024-04-25T09:55:43.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.289+0000 7f795e0fc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795815c900 con 0x7f7958144e30 2024-04-25T09:55:43.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.289+0000 7f795e0fc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7958072050 con 0x7f7958145290 2024-04-25T09:55:43.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.289+0000 7f79577fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7940003a00 0x7f79580c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:43.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.289+0000 7f79577fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7940003a00 0x7f79580c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54648/0 (socket says 172.21.15.7:54648) 2024-04-25T09:55:43.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.289+0000 7f79577fe640 1 -- 172.21.15.7:0/435088727 learned_addr learned my addr 172.21.15.7:0/435088727 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:43.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.289+0000 7f7956ffd640 1 --2- 172.21.15.7:0/435088727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7958144e30 0x7f79580c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:43.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.289+0000 7f79577fe640 1 -- 172.21.15.7:0/435088727 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7958145290 msgr2=0x7f79580c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:43.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.289+0000 7f7957fff640 1 --2- 172.21.15.7:0/435088727 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7958145290 0x7f79580c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:43.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.289+0000 7f79577fe640 1 --2- 172.21.15.7:0/435088727 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7958145290 0x7f79580c8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:43.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.289+0000 7f79577fe640 1 -- 172.21.15.7:0/435088727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7958144e30 msgr2=0x7f79580c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:43.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.289+0000 7f79577fe640 1 --2- 172.21.15.7:0/435088727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7958144e30 0x7f79580c7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:43.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.289+0000 7f79577fe640 1 -- 172.21.15.7:0/435088727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79580c86b0 con 0x7f7940003a00 2024-04-25T09:55:43.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.289+0000 7f7956ffd640 1 --2- 172.21.15.7:0/435088727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7958144e30 0x7f79580c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:43.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.290+0000 7f79577fe640 1 --2- 172.21.15.7:0/435088727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7940003a00 0x7f79580c9750 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7948034040 tx=0x7f7948004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:43.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.290+0000 7f793ffff640 1 -- 172.21.15.7:0/435088727 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794803f020 con 0x7f7940003a00 2024-04-25T09:55:43.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.290+0000 7f793ffff640 1 -- 172.21.15.7:0/435088727 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7948037040 con 0x7f7940003a00 2024-04-25T09:55:43.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.290+0000 7f795e0fc640 1 -- 172.21.15.7:0/435088727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79580c8990 con 0x7f7940003a00 2024-04-25T09:55:43.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.290+0000 7f793ffff640 1 -- 172.21.15.7:0/435088727 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948036070 con 0x7f7940003a00 2024-04-25T09:55:43.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.290+0000 7f795e0fc640 1 -- 172.21.15.7:0/435088727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79580c8f50 con 0x7f7940003a00 2024-04-25T09:55:43.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.291+0000 7f795e0fc640 1 -- 172.21.15.7:0/435088727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7958068fd0 con 0x7f7940003a00 2024-04-25T09:55:43.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.291+0000 7f793ffff640 1 -- 172.21.15.7:0/435088727 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7948042020 con 0x7f7940003a00 2024-04-25T09:55:43.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.292+0000 7f793ffff640 1 --2- 172.21.15.7:0/435088727 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f794406b4d0 0x7f794406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:43.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.292+0000 7f793ffff640 1 -- 172.21.15.7:0/435088727 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f79480aa3d0 con 0x7f7940003a00 2024-04-25T09:55:43.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.292+0000 7f7956ffd640 1 --2- 172.21.15.7:0/435088727 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f794406b4d0 0x7f794406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:43.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.292+0000 7f7956ffd640 1 --2- 172.21.15.7:0/435088727 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f794406b4d0 0x7f794406d990 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f79580b4080 tx=0x7f794c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:43.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.296+0000 7f793ffff640 1 -- 172.21.15.7:0/435088727 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7948049030 con 0x7f7940003a00 2024-04-25T09:55:43.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.472+0000 7f795e0fc640 1 -- 172.21.15.7:0/435088727 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7958152390 con 0x7f794406b4d0 2024-04-25T09:55:43.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.478+0000 7f793ffff640 1 -- 172.21.15.7:0/435088727 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251943 (secure 0 0 0) 0x7f7958152390 con 0x7f794406b4d0 2024-04-25T09:55:43.485 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:43.486 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T09:55:43.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.481+0000 7f795e0fc640 1 -- 172.21.15.7:0/435088727 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f794406b4d0 msgr2=0x7f794406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:43.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.481+0000 7f795e0fc640 1 --2- 172.21.15.7:0/435088727 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f794406b4d0 0x7f794406d990 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f79580b4080 tx=0x7f794c009040 comp rx=0 tx=0).stop 2024-04-25T09:55:43.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.481+0000 7f795e0fc640 1 -- 172.21.15.7:0/435088727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7940003a00 msgr2=0x7f79580c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:43.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.481+0000 7f795e0fc640 1 --2- 172.21.15.7:0/435088727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7940003a00 0x7f79580c9750 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7948034040 tx=0x7f7948004730 comp rx=0 tx=0).stop 2024-04-25T09:55:43.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.481+0000 7f795e0fc640 1 -- 172.21.15.7:0/435088727 shutdown_connections 2024-04-25T09:55:43.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.481+0000 7f795e0fc640 1 --2- 172.21.15.7:0/435088727 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f794406b4d0 0x7f794406d990 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:43.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.481+0000 7f795e0fc640 1 --2- 172.21.15.7:0/435088727 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7958145290 0x7f79580c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:43.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.481+0000 7f795e0fc640 1 --2- 172.21.15.7:0/435088727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7958144e30 0x7f79580c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:43.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.481+0000 7f795e0fc640 1 --2- 172.21.15.7:0/435088727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7940003a00 0x7f79580c9750 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:43.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.481+0000 7f795e0fc640 1 -- 172.21.15.7:0/435088727 >> 172.21.15.7:0/435088727 conn(0x7f7958071150 msgr2=0x7f795806d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:43.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.481+0000 7f795e0fc640 1 -- 172.21.15.7:0/435088727 shutdown_connections 2024-04-25T09:55:43.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.481+0000 7f795e0fc640 1 -- 172.21.15.7:0/435088727 wait complete. 2024-04-25T09:55:43.495 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2024-04-25T09:55:41.869115+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":245848,"kb_used_data":4712,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754728872,"statfs":{"total":773094113280,"available":772842364928,"internally_reserved":0,"allocated":4825088,"data_stored":2734124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":246795825},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.147327"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:36.726490+0000","last_change":"2024-04-25T09:55:35.736015+0000","last_active":"2024-04-25T09:55:36.726490+0000","last_peered":"2024-04-25T09:55:36.726490+0000","last_clean":"2024-04-25T09:55:36.726490+0000","last_became_active":"2024-04-25T09:55:35.735740+0000","last_became_peered":"2024-04-25T09:55:35.735740+0000","last_unstale":"2024-04-25T09:55:36.726490+0000","last_undegraded":"2024-04-25T09:55:36.726490+0000","last_fullsized":"2024-04-25T09:55:36.726490+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:20.866093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:36.726369+0000","last_change":"2024-04-25T09:55:35.743290+0000","last_active":"2024-04-25T09:55:36.726369+0000","last_peered":"2024-04-25T09:55:36.726369+0000","last_clean":"2024-04-25T09:55:36.726369+0000","last_became_active":"2024-04-25T09:55:35.742702+0000","last_became_peered":"2024-04-25T09:55:35.742702+0000","last_unstale":"2024-04-25T09:55:36.726369+0000","last_undegraded":"2024-04-25T09:55:36.726369+0000","last_fullsized":"2024-04-25T09:55:36.726369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:42.334263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.719518+0000","last_change":"2024-04-25T09:55:35.768383+0000","last_active":"2024-04-25T09:55:37.719518+0000","last_peered":"2024-04-25T09:55:37.719518+0000","last_clean":"2024-04-25T09:55:37.719518+0000","last_became_active":"2024-04-25T09:55:35.767988+0000","last_became_peered":"2024-04-25T09:55:35.767988+0000","last_unstale":"2024-04-25T09:55:37.719518+0000","last_undegraded":"2024-04-25T09:55:37.719518+0000","last_fullsized":"2024-04-25T09:55:37.719518+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:59.279223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.619671+0000","last_change":"2024-04-25T09:55:35.749026+0000","last_active":"2024-04-25T09:55:37.619671+0000","last_peered":"2024-04-25T09:55:37.619671+0000","last_clean":"2024-04-25T09:55:37.619671+0000","last_became_active":"2024-04-25T09:55:35.748728+0000","last_became_peered":"2024-04-25T09:55:35.748728+0000","last_unstale":"2024-04-25T09:55:37.619671+0000","last_undegraded":"2024-04-25T09:55:37.619671+0000","last_fullsized":"2024-04-25T09:55:37.619671+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:50.295931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.619523+0000","last_change":"2024-04-25T09:55:35.748915+0000","last_active":"2024-04-25T09:55:37.619523+0000","last_peered":"2024-04-25T09:55:37.619523+0000","last_clean":"2024-04-25T09:55:37.619523+0000","last_became_active":"2024-04-25T09:55:35.748609+0000","last_became_peered":"2024-04-25T09:55:35.748609+0000","last_unstale":"2024-04-25T09:55:37.619523+0000","last_undegraded":"2024-04-25T09:55:37.619523+0000","last_fullsized":"2024-04-25T09:55:37.619523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:07:34.763767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.233110+0000","last_change":"2024-04-25T09:55:35.732839+0000","last_active":"2024-04-25T09:55:37.233110+0000","last_peered":"2024-04-25T09:55:37.233110+0000","last_clean":"2024-04-25T09:55:37.233110+0000","last_became_active":"2024-04-25T09:55:35.732531+0000","last_became_peered":"2024-04-25T09:55:35.732531+0000","last_unstale":"2024-04-25T09:55:37.233110+0000","last_undegraded":"2024-04-25T09:55:37.233110+0000","last_fullsized":"2024-04-25T09:55:37.233110+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:58.065939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.719543+0000","last_change":"2024-04-25T09:55:35.764026+0000","last_active":"2024-04-25T09:55:37.719543+0000","last_peered":"2024-04-25T09:55:37.719543+0000","last_clean":"2024-04-25T09:55:37.719543+0000","last_became_active":"2024-04-25T09:55:35.763499+0000","last_became_peered":"2024-04-25T09:55:35.763499+0000","last_unstale":"2024-04-25T09:55:37.719543+0000","last_undegraded":"2024-04-25T09:55:37.719543+0000","last_fullsized":"2024-04-25T09:55:37.719543+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:21.986206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:36.725993+0000","last_change":"2024-04-25T09:55:35.762044+0000","last_active":"2024-04-25T09:55:36.725993+0000","last_peered":"2024-04-25T09:55:36.725993+0000","last_clean":"2024-04-25T09:55:36.725993+0000","last_became_active":"2024-04-25T09:55:35.761596+0000","last_became_peered":"2024-04-25T09:55:35.761596+0000","last_unstale":"2024-04-25T09:55:36.725993+0000","last_undegraded":"2024-04-25T09:55:36.725993+0000","last_fullsized":"2024-04-25T09:55:36.725993+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:21.986206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.719879+0000","last_change":"2024-04-25T09:55:35.762562+0000","last_active":"2024-04-25T09:55:37.719879+0000","last_peered":"2024-04-25T09:55:37.719879+0000","last_clean":"2024-04-25T09:55:37.719879+0000","last_became_active":"2024-04-25T09:55:35.762252+0000","last_became_peered":"2024-04-25T09:55:35.762252+0000","last_unstale":"2024-04-25T09:55:37.719879+0000","last_undegraded":"2024-04-25T09:55:37.719879+0000","last_fullsized":"2024-04-25T09:55:37.719879+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:03.959180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.720053+0000","last_change":"2024-04-25T09:55:35.764915+0000","last_active":"2024-04-25T09:55:37.720053+0000","last_peered":"2024-04-25T09:55:37.720053+0000","last_clean":"2024-04-25T09:55:37.720053+0000","last_became_active":"2024-04-25T09:55:35.764601+0000","last_became_peered":"2024-04-25T09:55:35.764601+0000","last_unstale":"2024-04-25T09:55:37.720053+0000","last_undegraded":"2024-04-25T09:55:37.720053+0000","last_fullsized":"2024-04-25T09:55:37.720053+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:20.866093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.719875+0000","last_change":"2024-04-25T09:55:35.768030+0000","last_active":"2024-04-25T09:55:37.719875+0000","last_peered":"2024-04-25T09:55:37.719875+0000","last_clean":"2024-04-25T09:55:37.719875+0000","last_became_active":"2024-04-25T09:55:35.767735+0000","last_became_peered":"2024-04-25T09:55:35.767735+0000","last_unstale":"2024-04-25T09:55:37.719875+0000","last_undegraded":"2024-04-25T09:55:37.719875+0000","last_fullsized":"2024-04-25T09:55:37.719875+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:42.334263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.719693+0000","last_change":"2024-04-25T09:55:35.740224+0000","last_active":"2024-04-25T09:55:37.719693+0000","last_peered":"2024-04-25T09:55:37.719693+0000","last_clean":"2024-04-25T09:55:37.719693+0000","last_became_active":"2024-04-25T09:55:35.739906+0000","last_became_peered":"2024-04-25T09:55:35.739906+0000","last_unstale":"2024-04-25T09:55:37.719693+0000","last_undegraded":"2024-04-25T09:55:37.719693+0000","last_fullsized":"2024-04-25T09:55:37.719693+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:31:37.702240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.719700+0000","last_change":"2024-04-25T09:55:35.759552+0000","last_active":"2024-04-25T09:55:37.719700+0000","last_peered":"2024-04-25T09:55:37.719700+0000","last_clean":"2024-04-25T09:55:37.719700+0000","last_became_active":"2024-04-25T09:55:35.759261+0000","last_became_peered":"2024-04-25T09:55:35.759261+0000","last_unstale":"2024-04-25T09:55:37.719700+0000","last_undegraded":"2024-04-25T09:55:37.719700+0000","last_fullsized":"2024-04-25T09:55:37.719700+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:43.267633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:36.731549+0000","last_change":"2024-04-25T09:55:35.762865+0000","last_active":"2024-04-25T09:55:36.731549+0000","last_peered":"2024-04-25T09:55:36.731549+0000","last_clean":"2024-04-25T09:55:36.731549+0000","last_became_active":"2024-04-25T09:55:35.762187+0000","last_became_peered":"2024-04-25T09:55:35.762187+0000","last_unstale":"2024-04-25T09:55:36.731549+0000","last_undegraded":"2024-04-25T09:55:36.731549+0000","last_fullsized":"2024-04-25T09:55:36.731549+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:02.497946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.719540+0000","last_change":"2024-04-25T09:55:35.763794+0000","last_active":"2024-04-25T09:55:37.719540+0000","last_peered":"2024-04-25T09:55:37.719540+0000","last_clean":"2024-04-25T09:55:37.719540+0000","last_became_active":"2024-04-25T09:55:35.763203+0000","last_became_peered":"2024-04-25T09:55:35.763203+0000","last_unstale":"2024-04-25T09:55:37.719540+0000","last_undegraded":"2024-04-25T09:55:37.719540+0000","last_fullsized":"2024-04-25T09:55:37.719540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:32.847084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.436208+0000","last_change":"2024-04-25T09:55:35.760046+0000","last_active":"2024-04-25T09:55:37.436208+0000","last_peered":"2024-04-25T09:55:37.436208+0000","last_clean":"2024-04-25T09:55:37.436208+0000","last_became_active":"2024-04-25T09:55:35.759769+0000","last_became_peered":"2024-04-25T09:55:35.759769+0000","last_unstale":"2024-04-25T09:55:37.436208+0000","last_undegraded":"2024-04-25T09:55:37.436208+0000","last_fullsized":"2024-04-25T09:55:37.436208+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:12.411252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.436505+0000","last_change":"2024-04-25T09:55:35.768514+0000","last_active":"2024-04-25T09:55:37.436505+0000","last_peered":"2024-04-25T09:55:37.436505+0000","last_clean":"2024-04-25T09:55:37.436505+0000","last_became_active":"2024-04-25T09:55:35.768212+0000","last_became_peered":"2024-04-25T09:55:35.768212+0000","last_unstale":"2024-04-25T09:55:37.436505+0000","last_undegraded":"2024-04-25T09:55:37.436505+0000","last_fullsized":"2024-04-25T09:55:37.436505+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:24.105924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.026555+0000","last_change":"2024-04-25T09:55:35.766182+0000","last_active":"2024-04-25T09:55:37.026555+0000","last_peered":"2024-04-25T09:55:37.026555+0000","last_clean":"2024-04-25T09:55:37.026555+0000","last_became_active":"2024-04-25T09:55:35.765914+0000","last_became_peered":"2024-04-25T09:55:35.765914+0000","last_unstale":"2024-04-25T09:55:37.026555+0000","last_undegraded":"2024-04-25T09:55:37.026555+0000","last_fullsized":"2024-04-25T09:55:37.026555+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:58.821504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.619753+0000","last_change":"2024-04-25T09:55:35.743143+0000","last_active":"2024-04-25T09:55:37.619753+0000","last_peered":"2024-04-25T09:55:37.619753+0000","last_clean":"2024-04-25T09:55:37.619753+0000","last_became_active":"2024-04-25T09:55:35.742813+0000","last_became_peered":"2024-04-25T09:55:35.742813+0000","last_unstale":"2024-04-25T09:55:37.619753+0000","last_undegraded":"2024-04-25T09:55:37.619753+0000","last_fullsized":"2024-04-25T09:55:37.619753+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:50.342990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.026592+0000","last_change":"2024-04-25T09:55:35.761736+0000","last_active":"2024-04-25T09:55:37.026592+0000","last_peered":"2024-04-25T09:55:37.026592+0000","last_clean":"2024-04-25T09:55:37.026592+0000","last_became_active":"2024-04-25T09:55:35.761387+0000","last_became_peered":"2024-04-25T09:55:35.761387+0000","last_unstale":"2024-04-25T09:55:37.026592+0000","last_undegraded":"2024-04-25T09:55:37.026592+0000","last_fullsized":"2024-04-25T09:55:37.026592+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:02.497946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.719872+0000","last_change":"2024-04-25T09:55:35.759573+0000","last_active":"2024-04-25T09:55:37.719872+0000","last_peered":"2024-04-25T09:55:37.719872+0000","last_clean":"2024-04-25T09:55:37.719872+0000","last_became_active":"2024-04-25T09:55:35.759200+0000","last_became_peered":"2024-04-25T09:55:35.759200+0000","last_unstale":"2024-04-25T09:55:37.719872+0000","last_undegraded":"2024-04-25T09:55:37.719872+0000","last_fullsized":"2024-04-25T09:55:37.719872+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:32.446255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:36.732276+0000","last_change":"2024-04-25T09:55:35.747716+0000","last_active":"2024-04-25T09:55:36.732276+0000","last_peered":"2024-04-25T09:55:36.732276+0000","last_clean":"2024-04-25T09:55:36.732276+0000","last_became_active":"2024-04-25T09:55:35.747370+0000","last_became_peered":"2024-04-25T09:55:35.747370+0000","last_unstale":"2024-04-25T09:55:36.732276+0000","last_undegraded":"2024-04-25T09:55:36.732276+0000","last_fullsized":"2024-04-25T09:55:36.732276+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:53.251434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.436293+0000","last_change":"2024-04-25T09:55:35.756163+0000","last_active":"2024-04-25T09:55:37.436293+0000","last_peered":"2024-04-25T09:55:37.436293+0000","last_clean":"2024-04-25T09:55:37.436293+0000","last_became_active":"2024-04-25T09:55:35.755783+0000","last_became_peered":"2024-04-25T09:55:35.755783+0000","last_unstale":"2024-04-25T09:55:37.436293+0000","last_undegraded":"2024-04-25T09:55:37.436293+0000","last_fullsized":"2024-04-25T09:55:37.436293+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:34.458200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.619449+0000","last_change":"2024-04-25T09:55:35.756145+0000","last_active":"2024-04-25T09:55:37.619449+0000","last_peered":"2024-04-25T09:55:37.619449+0000","last_clean":"2024-04-25T09:55:37.619449+0000","last_became_active":"2024-04-25T09:55:35.755847+0000","last_became_peered":"2024-04-25T09:55:35.755847+0000","last_unstale":"2024-04-25T09:55:37.619449+0000","last_undegraded":"2024-04-25T09:55:37.619449+0000","last_fullsized":"2024-04-25T09:55:37.619449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:45.136416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.026621+0000","last_change":"2024-04-25T09:55:35.749966+0000","last_active":"2024-04-25T09:55:37.026621+0000","last_peered":"2024-04-25T09:55:37.026621+0000","last_clean":"2024-04-25T09:55:37.026621+0000","last_became_active":"2024-04-25T09:55:35.749527+0000","last_became_peered":"2024-04-25T09:55:35.749527+0000","last_unstale":"2024-04-25T09:55:37.026621+0000","last_undegraded":"2024-04-25T09:55:37.026621+0000","last_fullsized":"2024-04-25T09:55:37.026621+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:07.479394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.233482+0000","last_change":"2024-04-25T09:55:35.767975+0000","last_active":"2024-04-25T09:55:37.233482+0000","last_peered":"2024-04-25T09:55:37.233482+0000","last_clean":"2024-04-25T09:55:37.233482+0000","last_became_active":"2024-04-25T09:55:35.767669+0000","last_became_peered":"2024-04-25T09:55:35.767669+0000","last_unstale":"2024-04-25T09:55:37.233482+0000","last_undegraded":"2024-04-25T09:55:37.233482+0000","last_fullsized":"2024-04-25T09:55:37.233482+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:12.411252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.026805+0000","last_change":"2024-04-25T09:55:35.750137+0000","last_active":"2024-04-25T09:55:37.026805+0000","last_peered":"2024-04-25T09:55:37.026805+0000","last_clean":"2024-04-25T09:55:37.026805+0000","last_became_active":"2024-04-25T09:55:35.749850+0000","last_became_peered":"2024-04-25T09:55:35.749850+0000","last_unstale":"2024-04-25T09:55:37.026805+0000","last_undegraded":"2024-04-25T09:55:37.026805+0000","last_fullsized":"2024-04-25T09:55:37.026805+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:58.065939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.719919+0000","last_change":"2024-04-25T09:55:35.759353+0000","last_active":"2024-04-25T09:55:37.719919+0000","last_peered":"2024-04-25T09:55:37.719919+0000","last_clean":"2024-04-25T09:55:37.719919+0000","last_became_active":"2024-04-25T09:55:35.758976+0000","last_became_peered":"2024-04-25T09:55:35.758976+0000","last_unstale":"2024-04-25T09:55:37.719919+0000","last_undegraded":"2024-04-25T09:55:37.719919+0000","last_fullsized":"2024-04-25T09:55:37.719919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:13.538258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.026437+0000","last_change":"2024-04-25T09:55:35.759021+0000","last_active":"2024-04-25T09:55:37.026437+0000","last_peered":"2024-04-25T09:55:37.026437+0000","last_clean":"2024-04-25T09:55:37.026437+0000","last_became_active":"2024-04-25T09:55:35.758662+0000","last_became_peered":"2024-04-25T09:55:35.758662+0000","last_unstale":"2024-04-25T09:55:37.026437+0000","last_undegraded":"2024-04-25T09:55:37.026437+0000","last_fullsized":"2024-04-25T09:55:37.026437+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:43.087615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.026650+0000","last_change":"2024-04-25T09:55:35.752315+0000","last_active":"2024-04-25T09:55:37.026650+0000","last_peered":"2024-04-25T09:55:37.026650+0000","last_clean":"2024-04-25T09:55:37.026650+0000","last_became_active":"2024-04-25T09:55:35.750495+0000","last_became_peered":"2024-04-25T09:55:35.750495+0000","last_unstale":"2024-04-25T09:55:37.026650+0000","last_undegraded":"2024-04-25T09:55:37.026650+0000","last_fullsized":"2024-04-25T09:55:37.026650+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:12.257881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.436426+0000","last_change":"2024-04-25T09:55:35.756176+0000","last_active":"2024-04-25T09:55:37.436426+0000","last_peered":"2024-04-25T09:55:37.436426+0000","last_clean":"2024-04-25T09:55:37.436426+0000","last_became_active":"2024-04-25T09:55:35.755837+0000","last_became_peered":"2024-04-25T09:55:35.755837+0000","last_unstale":"2024-04-25T09:55:37.436426+0000","last_undegraded":"2024-04-25T09:55:37.436426+0000","last_fullsized":"2024-04-25T09:55:37.436426+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:31:37.702240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.233056+0000","last_change":"2024-04-25T09:55:35.740654+0000","last_active":"2024-04-25T09:55:37.233056+0000","last_peered":"2024-04-25T09:55:37.233056+0000","last_clean":"2024-04-25T09:55:37.233056+0000","last_became_active":"2024-04-25T09:55:35.740348+0000","last_became_peered":"2024-04-25T09:55:35.740348+0000","last_unstale":"2024-04-25T09:55:37.233056+0000","last_undegraded":"2024-04-25T09:55:37.233056+0000","last_fullsized":"2024-04-25T09:55:37.233056+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:12.257881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.436645+0000","last_change":"2024-04-25T09:55:35.760617+0000","last_active":"2024-04-25T09:55:37.436645+0000","last_peered":"2024-04-25T09:55:37.436645+0000","last_clean":"2024-04-25T09:55:37.436645+0000","last_became_active":"2024-04-25T09:55:35.760321+0000","last_became_peered":"2024-04-25T09:55:35.760321+0000","last_unstale":"2024-04-25T09:55:37.436645+0000","last_undegraded":"2024-04-25T09:55:37.436645+0000","last_fullsized":"2024-04-25T09:55:37.436645+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:21.986206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.026748+0000","last_change":"2024-04-25T09:55:34.745543+0000","last_active":"2024-04-25T09:55:37.026748+0000","last_peered":"2024-04-25T09:55:37.026748+0000","last_clean":"2024-04-25T09:55:37.026748+0000","last_became_active":"2024-04-25T09:55:34.745243+0000","last_became_peered":"2024-04-25T09:55:34.745243+0000","last_unstale":"2024-04-25T09:55:37.026748+0000","last_undegraded":"2024-04-25T09:55:37.026748+0000","last_fullsized":"2024-04-25T09:55:37.026748+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:49.336547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.233398+0000","last_change":"2024-04-25T09:55:35.769428+0000","last_active":"2024-04-25T09:55:37.233398+0000","last_peered":"2024-04-25T09:55:37.233398+0000","last_clean":"2024-04-25T09:55:37.233398+0000","last_became_active":"2024-04-25T09:55:35.769115+0000","last_became_peered":"2024-04-25T09:55:35.769115+0000","last_unstale":"2024-04-25T09:55:37.233398+0000","last_undegraded":"2024-04-25T09:55:37.233398+0000","last_fullsized":"2024-04-25T09:55:37.233398+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:59.279223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.719743+0000","last_change":"2024-04-25T09:55:34.747086+0000","last_active":"2024-04-25T09:55:37.719743+0000","last_peered":"2024-04-25T09:55:37.719743+0000","last_clean":"2024-04-25T09:55:37.719743+0000","last_became_active":"2024-04-25T09:55:34.746760+0000","last_became_peered":"2024-04-25T09:55:34.746760+0000","last_unstale":"2024-04-25T09:55:37.719743+0000","last_undegraded":"2024-04-25T09:55:37.719743+0000","last_fullsized":"2024-04-25T09:55:37.719743+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:27.099991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:36.732244+0000","last_change":"2024-04-25T09:55:35.764169+0000","last_active":"2024-04-25T09:55:36.732244+0000","last_peered":"2024-04-25T09:55:36.732244+0000","last_clean":"2024-04-25T09:55:36.732244+0000","last_became_active":"2024-04-25T09:55:35.763842+0000","last_became_peered":"2024-04-25T09:55:35.763842+0000","last_unstale":"2024-04-25T09:55:36.732244+0000","last_undegraded":"2024-04-25T09:55:36.732244+0000","last_fullsized":"2024-04-25T09:55:36.732244+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:10.115716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.233489+0000","last_change":"2024-04-25T09:55:34.743621+0000","last_active":"2024-04-25T09:55:37.233489+0000","last_peered":"2024-04-25T09:55:37.233489+0000","last_clean":"2024-04-25T09:55:37.233489+0000","last_became_active":"2024-04-25T09:55:34.743238+0000","last_became_peered":"2024-04-25T09:55:34.743238+0000","last_unstale":"2024-04-25T09:55:37.233489+0000","last_undegraded":"2024-04-25T09:55:37.233489+0000","last_fullsized":"2024-04-25T09:55:37.233489+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:24.062912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:36.726451+0000","last_change":"2024-04-25T09:55:35.752098+0000","last_active":"2024-04-25T09:55:36.726451+0000","last_peered":"2024-04-25T09:55:36.726451+0000","last_clean":"2024-04-25T09:55:36.726451+0000","last_became_active":"2024-04-25T09:55:35.751819+0000","last_became_peered":"2024-04-25T09:55:35.751819+0000","last_unstale":"2024-04-25T09:55:36.726451+0000","last_undegraded":"2024-04-25T09:55:36.726451+0000","last_fullsized":"2024-04-25T09:55:36.726451+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:13.538258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:36.731944+0000","last_change":"2024-04-25T09:55:34.744009+0000","last_active":"2024-04-25T09:55:36.731944+0000","last_peered":"2024-04-25T09:55:36.731944+0000","last_clean":"2024-04-25T09:55:36.731944+0000","last_became_active":"2024-04-25T09:55:34.743062+0000","last_became_peered":"2024-04-25T09:55:34.743062+0000","last_unstale":"2024-04-25T09:55:36.731944+0000","last_undegraded":"2024-04-25T09:55:36.731944+0000","last_fullsized":"2024-04-25T09:55:36.731944+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:49.336547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.719385+0000","last_change":"2024-04-25T09:55:35.733608+0000","last_active":"2024-04-25T09:55:37.719385+0000","last_peered":"2024-04-25T09:55:37.719385+0000","last_clean":"2024-04-25T09:55:37.719385+0000","last_became_active":"2024-04-25T09:55:35.733306+0000","last_became_peered":"2024-04-25T09:55:35.733306+0000","last_unstale":"2024-04-25T09:55:37.719385+0000","last_undegraded":"2024-04-25T09:55:37.719385+0000","last_fullsized":"2024-04-25T09:55:37.719385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:58.065939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.719832+0000","last_change":"2024-04-25T09:55:34.750441+0000","last_active":"2024-04-25T09:55:37.719832+0000","last_peered":"2024-04-25T09:55:37.719832+0000","last_clean":"2024-04-25T09:55:37.719832+0000","last_became_active":"2024-04-25T09:55:34.750055+0000","last_became_peered":"2024-04-25T09:55:34.750055+0000","last_unstale":"2024-04-25T09:55:37.719832+0000","last_undegraded":"2024-04-25T09:55:37.719832+0000","last_fullsized":"2024-04-25T09:55:37.719832+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:19.539959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.719756+0000","last_change":"2024-04-25T09:55:35.765490+0000","last_active":"2024-04-25T09:55:37.719756+0000","last_peered":"2024-04-25T09:55:37.719756+0000","last_clean":"2024-04-25T09:55:37.719756+0000","last_became_active":"2024-04-25T09:55:35.762884+0000","last_became_peered":"2024-04-25T09:55:35.762884+0000","last_unstale":"2024-04-25T09:55:37.719756+0000","last_undegraded":"2024-04-25T09:55:37.719756+0000","last_fullsized":"2024-04-25T09:55:37.719756+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:22.034106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.436232+0000","last_change":"2024-04-25T09:55:34.744929+0000","last_active":"2024-04-25T09:55:37.436232+0000","last_peered":"2024-04-25T09:55:37.436232+0000","last_clean":"2024-04-25T09:55:37.436232+0000","last_became_active":"2024-04-25T09:55:34.744561+0000","last_became_peered":"2024-04-25T09:55:34.744561+0000","last_unstale":"2024-04-25T09:55:37.436232+0000","last_undegraded":"2024-04-25T09:55:37.436232+0000","last_fullsized":"2024-04-25T09:55:37.436232+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:24.062912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:36.731763+0000","last_change":"2024-04-25T09:55:35.763093+0000","last_active":"2024-04-25T09:55:36.731763+0000","last_peered":"2024-04-25T09:55:36.731763+0000","last_clean":"2024-04-25T09:55:36.731763+0000","last_became_active":"2024-04-25T09:55:35.762596+0000","last_became_peered":"2024-04-25T09:55:35.762596+0000","last_unstale":"2024-04-25T09:55:36.731763+0000","last_undegraded":"2024-04-25T09:55:36.731763+0000","last_fullsized":"2024-04-25T09:55:36.731763+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:12.257881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.233081+0000","last_change":"2024-04-25T09:55:34.749888+0000","last_active":"2024-04-25T09:55:37.233081+0000","last_peered":"2024-04-25T09:55:37.233081+0000","last_clean":"2024-04-25T09:55:37.233081+0000","last_became_active":"2024-04-25T09:55:34.749584+0000","last_became_peered":"2024-04-25T09:55:34.749584+0000","last_unstale":"2024-04-25T09:55:37.233081+0000","last_undegraded":"2024-04-25T09:55:37.233081+0000","last_fullsized":"2024-04-25T09:55:37.233081+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:27.099991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:36.726200+0000","last_change":"2024-04-25T09:55:35.753391+0000","last_active":"2024-04-25T09:55:36.726200+0000","last_peered":"2024-04-25T09:55:36.726200+0000","last_clean":"2024-04-25T09:55:36.726200+0000","last_became_active":"2024-04-25T09:55:35.752535+0000","last_became_peered":"2024-04-25T09:55:35.752535+0000","last_unstale":"2024-04-25T09:55:36.726200+0000","last_undegraded":"2024-04-25T09:55:36.726200+0000","last_fullsized":"2024-04-25T09:55:36.726200+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:43.267633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:36.731438+0000","last_change":"2024-04-25T09:55:34.743854+0000","last_active":"2024-04-25T09:55:36.731438+0000","last_peered":"2024-04-25T09:55:36.731438+0000","last_clean":"2024-04-25T09:55:36.731438+0000","last_became_active":"2024-04-25T09:55:34.743570+0000","last_became_peered":"2024-04-25T09:55:34.743570+0000","last_unstale":"2024-04-25T09:55:36.731438+0000","last_undegraded":"2024-04-25T09:55:36.731438+0000","last_fullsized":"2024-04-25T09:55:36.731438+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:14.801427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.619720+0000","last_change":"2024-04-25T09:55:35.748815+0000","last_active":"2024-04-25T09:55:37.619720+0000","last_peered":"2024-04-25T09:55:37.619720+0000","last_clean":"2024-04-25T09:55:37.619720+0000","last_became_active":"2024-04-25T09:55:35.748512+0000","last_became_peered":"2024-04-25T09:55:35.748512+0000","last_unstale":"2024-04-25T09:55:37.619720+0000","last_undegraded":"2024-04-25T09:55:37.619720+0000","last_fullsized":"2024-04-25T09:55:37.619720+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:33.782476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:36.726543+0000","last_change":"2024-04-25T09:55:34.734433+0000","last_active":"2024-04-25T09:55:36.726543+0000","last_peered":"2024-04-25T09:55:36.726543+0000","last_clean":"2024-04-25T09:55:36.726543+0000","last_became_active":"2024-04-25T09:55:34.733827+0000","last_became_peered":"2024-04-25T09:55:34.733827+0000","last_unstale":"2024-04-25T09:55:36.726543+0000","last_undegraded":"2024-04-25T09:55:36.726543+0000","last_fullsized":"2024-04-25T09:55:36.726543+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:11.251438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.436669+0000","last_change":"2024-04-25T09:55:35.765319+0000","last_active":"2024-04-25T09:55:37.436669+0000","last_peered":"2024-04-25T09:55:37.436669+0000","last_clean":"2024-04-25T09:55:37.436669+0000","last_became_active":"2024-04-25T09:55:35.764862+0000","last_became_peered":"2024-04-25T09:55:35.764862+0000","last_unstale":"2024-04-25T09:55:37.436669+0000","last_undegraded":"2024-04-25T09:55:37.436669+0000","last_fullsized":"2024-04-25T09:55:37.436669+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:16.866150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.720151+0000","last_change":"2024-04-25T09:55:34.749934+0000","last_active":"2024-04-25T09:55:37.720151+0000","last_peered":"2024-04-25T09:55:37.720151+0000","last_clean":"2024-04-25T09:55:37.720151+0000","last_became_active":"2024-04-25T09:55:34.748781+0000","last_became_peered":"2024-04-25T09:55:34.748781+0000","last_unstale":"2024-04-25T09:55:37.720151+0000","last_undegraded":"2024-04-25T09:55:37.720151+0000","last_fullsized":"2024-04-25T09:55:37.720151+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:42.081172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.719696+0000","last_change":"2024-04-25T09:55:35.756166+0000","last_active":"2024-04-25T09:55:37.719696+0000","last_peered":"2024-04-25T09:55:37.719696+0000","last_clean":"2024-04-25T09:55:37.719696+0000","last_became_active":"2024-04-25T09:55:35.755850+0000","last_became_peered":"2024-04-25T09:55:35.755850+0000","last_unstale":"2024-04-25T09:55:37.719696+0000","last_undegraded":"2024-04-25T09:55:37.719696+0000","last_fullsized":"2024-04-25T09:55:37.719696+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:34.458200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.720012+0000","last_change":"2024-04-25T09:55:34.751988+0000","last_active":"2024-04-25T09:55:37.720012+0000","last_peered":"2024-04-25T09:55:37.720012+0000","last_clean":"2024-04-25T09:55:37.720012+0000","last_became_active":"2024-04-25T09:55:34.751600+0000","last_became_peered":"2024-04-25T09:55:34.751600+0000","last_unstale":"2024-04-25T09:55:37.720012+0000","last_undegraded":"2024-04-25T09:55:37.720012+0000","last_fullsized":"2024-04-25T09:55:37.720012+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:57.815061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:36.732272+0000","last_change":"2024-04-25T09:55:35.745530+0000","last_active":"2024-04-25T09:55:36.732272+0000","last_peered":"2024-04-25T09:55:36.732272+0000","last_clean":"2024-04-25T09:55:36.732272+0000","last_became_active":"2024-04-25T09:55:35.745156+0000","last_became_peered":"2024-04-25T09:55:35.745156+0000","last_unstale":"2024-04-25T09:55:36.732272+0000","last_undegraded":"2024-04-25T09:55:36.732272+0000","last_fullsized":"2024-04-25T09:55:36.732272+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:59.279223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:36.726269+0000","last_change":"2024-04-25T09:55:34.746883+0000","last_active":"2024-04-25T09:55:36.726269+0000","last_peered":"2024-04-25T09:55:36.726269+0000","last_clean":"2024-04-25T09:55:36.726269+0000","last_became_active":"2024-04-25T09:55:34.746605+0000","last_became_peered":"2024-04-25T09:55:34.746605+0000","last_unstale":"2024-04-25T09:55:36.726269+0000","last_undegraded":"2024-04-25T09:55:36.726269+0000","last_fullsized":"2024-04-25T09:55:36.726269+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:01.491503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.719488+0000","last_change":"2024-04-25T09:55:35.762241+0000","last_active":"2024-04-25T09:55:37.719488+0000","last_peered":"2024-04-25T09:55:37.719488+0000","last_clean":"2024-04-25T09:55:37.719488+0000","last_became_active":"2024-04-25T09:55:35.761896+0000","last_became_peered":"2024-04-25T09:55:35.761896+0000","last_unstale":"2024-04-25T09:55:37.719488+0000","last_undegraded":"2024-04-25T09:55:37.719488+0000","last_fullsized":"2024-04-25T09:55:37.719488+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:53.251434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:36.726306+0000","last_change":"2024-04-25T09:55:34.734268+0000","last_active":"2024-04-25T09:55:36.726306+0000","last_peered":"2024-04-25T09:55:36.726306+0000","last_clean":"2024-04-25T09:55:36.726306+0000","last_became_active":"2024-04-25T09:55:34.733940+0000","last_became_peered":"2024-04-25T09:55:34.733940+0000","last_unstale":"2024-04-25T09:55:36.726306+0000","last_undegraded":"2024-04-25T09:55:36.726306+0000","last_fullsized":"2024-04-25T09:55:36.726306+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:57.059496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:36.726072+0000","last_change":"2024-04-25T09:55:35.736212+0000","last_active":"2024-04-25T09:55:36.726072+0000","last_peered":"2024-04-25T09:55:36.726072+0000","last_clean":"2024-04-25T09:55:36.726072+0000","last_became_active":"2024-04-25T09:55:35.735914+0000","last_became_peered":"2024-04-25T09:55:35.735914+0000","last_unstale":"2024-04-25T09:55:36.726072+0000","last_undegraded":"2024-04-25T09:55:36.726072+0000","last_fullsized":"2024-04-25T09:55:36.726072+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:16.866150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.233153+0000","last_change":"2024-04-25T09:55:34.751004+0000","last_active":"2024-04-25T09:55:37.233153+0000","last_peered":"2024-04-25T09:55:37.233153+0000","last_clean":"2024-04-25T09:55:37.233153+0000","last_became_active":"2024-04-25T09:55:34.750719+0000","last_became_peered":"2024-04-25T09:55:34.750719+0000","last_unstale":"2024-04-25T09:55:37.233153+0000","last_undegraded":"2024-04-25T09:55:37.233153+0000","last_fullsized":"2024-04-25T09:55:37.233153+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:36.739580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.436601+0000","last_change":"2024-04-25T09:55:35.756163+0000","last_active":"2024-04-25T09:55:37.436601+0000","last_peered":"2024-04-25T09:55:37.436601+0000","last_clean":"2024-04-25T09:55:37.436601+0000","last_became_active":"2024-04-25T09:55:35.755652+0000","last_became_peered":"2024-04-25T09:55:35.755652+0000","last_unstale":"2024-04-25T09:55:37.436601+0000","last_undegraded":"2024-04-25T09:55:37.436601+0000","last_fullsized":"2024-04-25T09:55:37.436601+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:32.847084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.026280+0000","last_change":"2024-04-25T09:55:34.745319+0000","last_active":"2024-04-25T09:55:37.026280+0000","last_peered":"2024-04-25T09:55:37.026280+0000","last_clean":"2024-04-25T09:55:37.026280+0000","last_became_active":"2024-04-25T09:55:34.745029+0000","last_became_peered":"2024-04-25T09:55:34.745029+0000","last_unstale":"2024-04-25T09:55:37.026280+0000","last_undegraded":"2024-04-25T09:55:37.026280+0000","last_fullsized":"2024-04-25T09:55:37.026280+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:14.801427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:36.726209+0000","last_change":"2024-04-25T09:55:35.736497+0000","last_active":"2024-04-25T09:55:36.726209+0000","last_peered":"2024-04-25T09:55:36.726209+0000","last_clean":"2024-04-25T09:55:36.726209+0000","last_became_active":"2024-04-25T09:55:35.736208+0000","last_became_peered":"2024-04-25T09:55:35.736208+0000","last_unstale":"2024-04-25T09:55:36.726209+0000","last_undegraded":"2024-04-25T09:55:36.726209+0000","last_fullsized":"2024-04-25T09:55:36.726209+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:22.034106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.436223+0000","last_change":"2024-04-25T09:55:34.746478+0000","last_active":"2024-04-25T09:55:37.436223+0000","last_peered":"2024-04-25T09:55:37.436223+0000","last_clean":"2024-04-25T09:55:37.436223+0000","last_became_active":"2024-04-25T09:55:34.745385+0000","last_became_peered":"2024-04-25T09:55:34.745385+0000","last_unstale":"2024-04-25T09:55:37.436223+0000","last_undegraded":"2024-04-25T09:55:37.436223+0000","last_fullsized":"2024-04-25T09:55:37.436223+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:27.099991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:36.726308+0000","last_change":"2024-04-25T09:55:35.761314+0000","last_active":"2024-04-25T09:55:36.726308+0000","last_peered":"2024-04-25T09:55:36.726308+0000","last_clean":"2024-04-25T09:55:36.726308+0000","last_became_active":"2024-04-25T09:55:35.761025+0000","last_became_peered":"2024-04-25T09:55:35.761025+0000","last_unstale":"2024-04-25T09:55:36.726308+0000","last_undegraded":"2024-04-25T09:55:36.726308+0000","last_fullsized":"2024-04-25T09:55:36.726308+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:37.661249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.720164+0000","last_change":"2024-04-25T09:55:34.751912+0000","last_active":"2024-04-25T09:55:37.720164+0000","last_peered":"2024-04-25T09:55:37.720164+0000","last_clean":"2024-04-25T09:55:37.720164+0000","last_became_active":"2024-04-25T09:55:34.751601+0000","last_became_peered":"2024-04-25T09:55:34.751601+0000","last_unstale":"2024-04-25T09:55:37.720164+0000","last_undegraded":"2024-04-25T09:55:37.720164+0000","last_fullsized":"2024-04-25T09:55:37.720164+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:26.167108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.719880+0000","last_change":"2024-04-25T09:55:35.767965+0000","last_active":"2024-04-25T09:55:37.719880+0000","last_peered":"2024-04-25T09:55:37.719880+0000","last_clean":"2024-04-25T09:55:37.719880+0000","last_became_active":"2024-04-25T09:55:35.767682+0000","last_became_peered":"2024-04-25T09:55:35.767682+0000","last_unstale":"2024-04-25T09:55:37.719880+0000","last_undegraded":"2024-04-25T09:55:37.719880+0000","last_fullsized":"2024-04-25T09:55:37.719880+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:37.661249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:36.732187+0000","last_change":"2024-04-25T09:55:34.752634+0000","last_active":"2024-04-25T09:55:36.732187+0000","last_peered":"2024-04-25T09:55:36.732187+0000","last_clean":"2024-04-25T09:55:36.732187+0000","last_became_active":"2024-04-25T09:55:34.752309+0000","last_became_peered":"2024-04-25T09:55:34.752309+0000","last_unstale":"2024-04-25T09:55:36.732187+0000","last_undegraded":"2024-04-25T09:55:36.732187+0000","last_fullsized":"2024-04-25T09:55:36.732187+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:27.099991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:36.732043+0000","last_change":"2024-04-25T09:55:35.749342+0000","last_active":"2024-04-25T09:55:36.732043+0000","last_peered":"2024-04-25T09:55:36.732043+0000","last_clean":"2024-04-25T09:55:36.732043+0000","last_became_active":"2024-04-25T09:55:35.749073+0000","last_became_peered":"2024-04-25T09:55:35.749073+0000","last_unstale":"2024-04-25T09:55:36.732043+0000","last_undegraded":"2024-04-25T09:55:36.732043+0000","last_fullsized":"2024-04-25T09:55:36.732043+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:58.065939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.619721+0000","last_change":"2024-04-25T09:55:34.748592+0000","last_active":"2024-04-25T09:55:37.619721+0000","last_peered":"2024-04-25T09:55:37.619721+0000","last_clean":"2024-04-25T09:55:37.619721+0000","last_became_active":"2024-04-25T09:55:34.748241+0000","last_became_peered":"2024-04-25T09:55:34.748241+0000","last_unstale":"2024-04-25T09:55:37.619721+0000","last_undegraded":"2024-04-25T09:55:37.619721+0000","last_fullsized":"2024-04-25T09:55:37.619721+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:02:14.916190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.619791+0000","last_change":"2024-04-25T09:55:35.742666+0000","last_active":"2024-04-25T09:55:37.619791+0000","last_peered":"2024-04-25T09:55:37.619791+0000","last_clean":"2024-04-25T09:55:37.619791+0000","last_became_active":"2024-04-25T09:55:35.742385+0000","last_became_peered":"2024-04-25T09:55:35.742385+0000","last_unstale":"2024-04-25T09:55:37.619791+0000","last_undegraded":"2024-04-25T09:55:37.619791+0000","last_fullsized":"2024-04-25T09:55:37.619791+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:15.807870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.233215+0000","last_change":"2024-04-25T09:55:34.744760+0000","last_active":"2024-04-25T09:55:37.233215+0000","last_peered":"2024-04-25T09:55:37.233215+0000","last_clean":"2024-04-25T09:55:37.233215+0000","last_became_active":"2024-04-25T09:55:34.744440+0000","last_became_peered":"2024-04-25T09:55:34.744440+0000","last_unstale":"2024-04-25T09:55:37.233215+0000","last_undegraded":"2024-04-25T09:55:37.233215+0000","last_fullsized":"2024-04-25T09:55:37.233215+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:12.241234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.436456+0000","last_change":"2024-04-25T09:55:35.756114+0000","last_active":"2024-04-25T09:55:37.436456+0000","last_peered":"2024-04-25T09:55:37.436456+0000","last_clean":"2024-04-25T09:55:37.436456+0000","last_became_active":"2024-04-25T09:55:35.755727+0000","last_became_peered":"2024-04-25T09:55:35.755727+0000","last_unstale":"2024-04-25T09:55:37.436456+0000","last_undegraded":"2024-04-25T09:55:37.436456+0000","last_fullsized":"2024-04-25T09:55:37.436456+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:03.959180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.619586+0000","last_change":"2024-04-25T09:55:34.737032+0000","last_active":"2024-04-25T09:55:37.619586+0000","last_peered":"2024-04-25T09:55:37.619586+0000","last_clean":"2024-04-25T09:55:37.619586+0000","last_became_active":"2024-04-25T09:55:34.736683+0000","last_became_peered":"2024-04-25T09:55:34.736683+0000","last_unstale":"2024-04-25T09:55:37.619586+0000","last_undegraded":"2024-04-25T09:55:37.619586+0000","last_fullsized":"2024-04-25T09:55:37.619586+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:48:34.922687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.719476+0000","last_change":"2024-04-25T09:55:35.756394+0000","last_active":"2024-04-25T09:55:37.719476+0000","last_peered":"2024-04-25T09:55:37.719476+0000","last_clean":"2024-04-25T09:55:37.719476+0000","last_became_active":"2024-04-25T09:55:35.756079+0000","last_became_peered":"2024-04-25T09:55:35.756079+0000","last_unstale":"2024-04-25T09:55:37.719476+0000","last_undegraded":"2024-04-25T09:55:37.719476+0000","last_fullsized":"2024-04-25T09:55:37.719476+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:10.115716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.619510+0000","last_change":"2024-04-25T09:55:34.745223+0000","last_active":"2024-04-25T09:55:37.619510+0000","last_peered":"2024-04-25T09:55:37.619510+0000","last_clean":"2024-04-25T09:55:37.619510+0000","last_became_active":"2024-04-25T09:55:34.744879+0000","last_became_peered":"2024-04-25T09:55:34.744879+0000","last_unstale":"2024-04-25T09:55:37.619510+0000","last_undegraded":"2024-04-25T09:55:37.619510+0000","last_fullsized":"2024-04-25T09:55:37.619510+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:36.345726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.719591+0000","last_change":"2024-04-25T09:55:35.764920+0000","last_active":"2024-04-25T09:55:37.719591+0000","last_peered":"2024-04-25T09:55:37.719591+0000","last_clean":"2024-04-25T09:55:37.719591+0000","last_became_active":"2024-04-25T09:55:35.764523+0000","last_became_peered":"2024-04-25T09:55:35.764523+0000","last_unstale":"2024-04-25T09:55:37.719591+0000","last_undegraded":"2024-04-25T09:55:37.719591+0000","last_fullsized":"2024-04-25T09:55:37.719591+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:16.866150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.436450+0000","last_change":"2024-04-25T09:55:34.747558+0000","last_active":"2024-04-25T09:55:37.436450+0000","last_peered":"2024-04-25T09:55:37.436450+0000","last_clean":"2024-04-25T09:55:37.436450+0000","last_became_active":"2024-04-25T09:55:34.747247+0000","last_became_peered":"2024-04-25T09:55:34.747247+0000","last_unstale":"2024-04-25T09:55:37.436450+0000","last_undegraded":"2024-04-25T09:55:37.436450+0000","last_fullsized":"2024-04-25T09:55:37.436450+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:36.739580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:36.726349+0000","last_change":"2024-04-25T09:55:35.753124+0000","last_active":"2024-04-25T09:55:36.726349+0000","last_peered":"2024-04-25T09:55:36.726349+0000","last_clean":"2024-04-25T09:55:36.726349+0000","last_became_active":"2024-04-25T09:55:35.752822+0000","last_became_peered":"2024-04-25T09:55:35.752822+0000","last_unstale":"2024-04-25T09:55:36.726349+0000","last_undegraded":"2024-04-25T09:55:36.726349+0000","last_fullsized":"2024-04-25T09:55:36.726349+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:32.446255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.619390+0000","last_change":"2024-04-25T09:55:34.738977+0000","last_active":"2024-04-25T09:55:37.619390+0000","last_peered":"2024-04-25T09:55:37.619390+0000","last_clean":"2024-04-25T09:55:37.619390+0000","last_became_active":"2024-04-25T09:55:34.738688+0000","last_became_peered":"2024-04-25T09:55:34.738688+0000","last_unstale":"2024-04-25T09:55:37.619390+0000","last_undegraded":"2024-04-25T09:55:37.619390+0000","last_fullsized":"2024-04-25T09:55:37.619390+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:30:14.702977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.233255+0000","last_change":"2024-04-25T09:55:35.767938+0000","last_active":"2024-04-25T09:55:37.233255+0000","last_peered":"2024-04-25T09:55:37.233255+0000","last_clean":"2024-04-25T09:55:37.233255+0000","last_became_active":"2024-04-25T09:55:35.767648+0000","last_became_peered":"2024-04-25T09:55:35.767648+0000","last_unstale":"2024-04-25T09:55:37.233255+0000","last_undegraded":"2024-04-25T09:55:37.233255+0000","last_fullsized":"2024-04-25T09:55:37.233255+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:53.251434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.720247+0000","last_change":"2024-04-25T09:55:34.751955+0000","last_active":"2024-04-25T09:55:37.720247+0000","last_peered":"2024-04-25T09:55:37.720247+0000","last_clean":"2024-04-25T09:55:37.720247+0000","last_became_active":"2024-04-25T09:55:34.751661+0000","last_became_peered":"2024-04-25T09:55:34.751661+0000","last_unstale":"2024-04-25T09:55:37.720247+0000","last_undegraded":"2024-04-25T09:55:37.720247+0000","last_fullsized":"2024-04-25T09:55:37.720247+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:22.625888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.436724+0000","last_change":"2024-04-25T09:55:35.765747+0000","last_active":"2024-04-25T09:55:37.436724+0000","last_peered":"2024-04-25T09:55:37.436724+0000","last_clean":"2024-04-25T09:55:37.436724+0000","last_became_active":"2024-04-25T09:55:35.765400+0000","last_became_peered":"2024-04-25T09:55:35.765400+0000","last_unstale":"2024-04-25T09:55:37.436724+0000","last_undegraded":"2024-04-25T09:55:37.436724+0000","last_fullsized":"2024-04-25T09:55:37.436724+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:43.267633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.619714+0000","last_change":"2024-04-25T09:55:34.749607+0000","last_active":"2024-04-25T09:55:37.619714+0000","last_peered":"2024-04-25T09:55:37.619714+0000","last_clean":"2024-04-25T09:55:37.619714+0000","last_became_active":"2024-04-25T09:55:34.749293+0000","last_became_peered":"2024-04-25T09:55:34.749293+0000","last_unstale":"2024-04-25T09:55:37.619714+0000","last_undegraded":"2024-04-25T09:55:37.619714+0000","last_fullsized":"2024-04-25T09:55:37.619714+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:09:36.004959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:36.726527+0000","last_change":"2024-04-25T09:55:35.748004+0000","last_active":"2024-04-25T09:55:36.726527+0000","last_peered":"2024-04-25T09:55:36.726527+0000","last_clean":"2024-04-25T09:55:36.726527+0000","last_became_active":"2024-04-25T09:55:35.747732+0000","last_became_peered":"2024-04-25T09:55:35.747732+0000","last_unstale":"2024-04-25T09:55:36.726527+0000","last_undegraded":"2024-04-25T09:55:36.726527+0000","last_fullsized":"2024-04-25T09:55:36.726527+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:22:31.051816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.719494+0000","last_change":"2024-04-25T09:55:34.734044+0000","last_active":"2024-04-25T09:55:37.719494+0000","last_peered":"2024-04-25T09:55:37.719494+0000","last_clean":"2024-04-25T09:55:37.719494+0000","last_became_active":"2024-04-25T09:55:34.733742+0000","last_became_peered":"2024-04-25T09:55:34.733742+0000","last_unstale":"2024-04-25T09:55:37.719494+0000","last_undegraded":"2024-04-25T09:55:37.719494+0000","last_fullsized":"2024-04-25T09:55:37.719494+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:12.241234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.719573+0000","last_change":"2024-04-25T09:55:35.734742+0000","last_active":"2024-04-25T09:55:37.719573+0000","last_peered":"2024-04-25T09:55:37.719573+0000","last_clean":"2024-04-25T09:55:37.719573+0000","last_became_active":"2024-04-25T09:55:35.734435+0000","last_became_peered":"2024-04-25T09:55:35.734435+0000","last_unstale":"2024-04-25T09:55:37.719573+0000","last_undegraded":"2024-04-25T09:55:37.719573+0000","last_fullsized":"2024-04-25T09:55:37.719573+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:12.411252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.719678+0000","last_change":"2024-04-25T09:55:34.738180+0000","last_active":"2024-04-25T09:55:37.719678+0000","last_peered":"2024-04-25T09:55:37.719678+0000","last_clean":"2024-04-25T09:55:37.719678+0000","last_became_active":"2024-04-25T09:55:34.737894+0000","last_became_peered":"2024-04-25T09:55:34.737894+0000","last_unstale":"2024-04-25T09:55:37.719678+0000","last_undegraded":"2024-04-25T09:55:37.719678+0000","last_fullsized":"2024-04-25T09:55:37.719678+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:24.062912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.233104+0000","last_change":"2024-04-25T09:55:35.752246+0000","last_active":"2024-04-25T09:55:37.233104+0000","last_peered":"2024-04-25T09:55:37.233104+0000","last_clean":"2024-04-25T09:55:37.233104+0000","last_became_active":"2024-04-25T09:55:35.751956+0000","last_became_peered":"2024-04-25T09:55:35.751956+0000","last_unstale":"2024-04-25T09:55:37.233104+0000","last_undegraded":"2024-04-25T09:55:37.233104+0000","last_fullsized":"2024-04-25T09:55:37.233104+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:10.115716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.026391+0000","last_change":"2024-04-25T09:55:34.742098+0000","last_active":"2024-04-25T09:55:37.026391+0000","last_peered":"2024-04-25T09:55:37.026391+0000","last_clean":"2024-04-25T09:55:37.026391+0000","last_became_active":"2024-04-25T09:55:34.741787+0000","last_became_peered":"2024-04-25T09:55:34.741787+0000","last_unstale":"2024-04-25T09:55:37.026391+0000","last_undegraded":"2024-04-25T09:55:37.026391+0000","last_fullsized":"2024-04-25T09:55:37.026391+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:32.776034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:36.731670+0000","last_change":"2024-04-25T09:55:35.746484+0000","last_active":"2024-04-25T09:55:36.731670+0000","last_peered":"2024-04-25T09:55:36.731670+0000","last_clean":"2024-04-25T09:55:36.731670+0000","last_became_active":"2024-04-25T09:55:35.746195+0000","last_became_peered":"2024-04-25T09:55:35.746195+0000","last_unstale":"2024-04-25T09:55:36.731670+0000","last_undegraded":"2024-04-25T09:55:36.731670+0000","last_fullsized":"2024-04-25T09:55:36.731670+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:07.479394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:36.731557+0000","last_change":"2024-04-25T09:55:34.743941+0000","last_active":"2024-04-25T09:55:36.731557+0000","last_peered":"2024-04-25T09:55:36.731557+0000","last_clean":"2024-04-25T09:55:36.731557+0000","last_became_active":"2024-04-25T09:55:34.743567+0000","last_became_peered":"2024-04-25T09:55:34.743567+0000","last_unstale":"2024-04-25T09:55:36.731557+0000","last_undegraded":"2024-04-25T09:55:36.731557+0000","last_fullsized":"2024-04-25T09:55:36.731557+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:12.241234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.436419+0000","last_change":"2024-04-25T09:55:35.765142+0000","last_active":"2024-04-25T09:55:37.436419+0000","last_peered":"2024-04-25T09:55:37.436419+0000","last_clean":"2024-04-25T09:55:37.436419+0000","last_became_active":"2024-04-25T09:55:35.764844+0000","last_became_peered":"2024-04-25T09:55:35.764844+0000","last_unstale":"2024-04-25T09:55:37.436419+0000","last_undegraded":"2024-04-25T09:55:37.436419+0000","last_fullsized":"2024-04-25T09:55:37.436419+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:18.277482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:36.725979+0000","last_change":"2024-04-25T09:55:34.731152+0000","last_active":"2024-04-25T09:55:36.725979+0000","last_peered":"2024-04-25T09:55:36.725979+0000","last_clean":"2024-04-25T09:55:36.725979+0000","last_became_active":"2024-04-25T09:55:34.730845+0000","last_became_peered":"2024-04-25T09:55:34.730845+0000","last_unstale":"2024-04-25T09:55:36.725979+0000","last_undegraded":"2024-04-25T09:55:36.725979+0000","last_fullsized":"2024-04-25T09:55:36.725979+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:06.472951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.720139+0000","last_change":"2024-04-25T09:55:35.762049+0000","last_active":"2024-04-25T09:55:37.720139+0000","last_peered":"2024-04-25T09:55:37.720139+0000","last_clean":"2024-04-25T09:55:37.720139+0000","last_became_active":"2024-04-25T09:55:35.761764+0000","last_became_peered":"2024-04-25T09:55:35.761764+0000","last_unstale":"2024-04-25T09:55:37.720139+0000","last_undegraded":"2024-04-25T09:55:37.720139+0000","last_fullsized":"2024-04-25T09:55:37.720139+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:34.715847+0000","last_clean_scrub_stamp":"2024-04-25T09:55:34.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:22:31.051816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.436710+0000","last_change":"2024-04-25T09:55:34.746165+0000","last_active":"2024-04-25T09:55:37.436710+0000","last_peered":"2024-04-25T09:55:37.436710+0000","last_clean":"2024-04-25T09:55:37.436710+0000","last_became_active":"2024-04-25T09:55:34.745859+0000","last_became_peered":"2024-04-25T09:55:34.745859+0000","last_unstale":"2024-04-25T09:55:37.436710+0000","last_undegraded":"2024-04-25T09:55:37.436710+0000","last_fullsized":"2024-04-25T09:55:37.436710+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:55:33.709404+0000","last_clean_scrub_stamp":"2024-04-25T09:55:33.709404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:26.167108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":201,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:55:37.436665+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T09:55:37.436665+0000","last_peered":"2024-04-25T09:55:37.436665+0000","last_clean":"2024-04-25T09:55:37.436665+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T09:55:37.436665+0000","last_undegraded":"2024-04-25T09:55:37.436665+0000","last_fullsized":"2024-04-25T09:55:37.436665+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542164,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1056768,"data_stored":785621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542164,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":450560,"data_stored":194153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":454656,"data_stored":193683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542163,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":194175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":462848,"data_stored":195217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":450560,"data_stored":193641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":450560,"data_stored":193661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1044480,"data_stored":783973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:55:43.499 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:55:43.499 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:55:43.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.641+0000 7f6da435c640 1 Processor -- start 2024-04-25T09:55:43.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.641+0000 7f6da435c640 1 -- start start 2024-04-25T09:55:43.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.642+0000 7f6da435c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6d9c15db00 0x7f6d9c0d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:43.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.642+0000 7f6da435c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d9c0ce2b0 0x7f6d9c0d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:43.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.642+0000 7f6da435c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d9c0d1e80 con 0x7f6d9c0b53b0 2024-04-25T09:55:43.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.642+0000 7f6da435c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d9c0b5930 con 0x7f6d9c15db00 2024-04-25T09:55:43.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.642+0000 7f6da435c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c0b5c10 con 0x7f6d9c0ce2b0 2024-04-25T09:55:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.642+0000 7f6da28f9640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d9c0ce2b0 0x7f6d9c0d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.642+0000 7f6da20f8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6d9c15db00 0x7f6d9c0d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.642+0000 7f6da28f9640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d9c0ce2b0 0x7f6d9c0d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:44024/0 (socket says 172.21.15.7:44024) 2024-04-25T09:55:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.642+0000 7f6da28f9640 1 -- 172.21.15.7:0/1816481878 learned_addr learned my addr 172.21.15.7:0/1816481878 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.642+0000 7f6da20f8640 1 -- 172.21.15.7:0/1816481878 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d9c0ce2b0 msgr2=0x7f6d9c0d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.642+0000 7f6da20f8640 1 --2- 172.21.15.7:0/1816481878 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d9c0ce2b0 0x7f6d9c0d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.642+0000 7f6da20f8640 1 -- 172.21.15.7:0/1816481878 >> v1:172.21.15.55:6789/0 conn(0x7f6d9c0b53b0 legacy=0x7f6d9c161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.642+0000 7f6da20f8640 1 -- 172.21.15.7:0/1816481878 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9c0b5ef0 con 0x7f6d9c15db00 2024-04-25T09:55:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.642+0000 7f6da28f9640 1 --2- 172.21.15.7:0/1816481878 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d9c0ce2b0 0x7f6d9c0d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:55:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.643+0000 7f6da20f8640 1 --2- 172.21.15.7:0/1816481878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d9c15db00 0x7f6d9c0d0340 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6d980097a0 tx=0x7f6d9802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47bbe139e090d74c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.643+0000 7f6da10f6640 1 -- 172.21.15.7:0/1816481878 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d98037070 con 0x7f6d9c15db00 2024-04-25T09:55:43.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.643+0000 7f6da10f6640 1 -- 172.21.15.7:0/1816481878 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d98032440 con 0x7f6d9c15db00 2024-04-25T09:55:43.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.643+0000 7f6da10f6640 1 -- 172.21.15.7:0/1816481878 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d98032810 con 0x7f6d9c15db00 2024-04-25T09:55:43.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.644+0000 7f6da435c640 1 -- 172.21.15.7:0/1816481878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d9c15db00 msgr2=0x7f6d9c0d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:43.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.644+0000 7f6da435c640 1 --2- 172.21.15.7:0/1816481878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d9c15db00 0x7f6d9c0d0340 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6d980097a0 tx=0x7f6d9802a180 comp rx=0 tx=0).stop 2024-04-25T09:55:43.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.644+0000 7f6da435c640 1 -- 172.21.15.7:0/1816481878 shutdown_connections 2024-04-25T09:55:43.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.644+0000 7f6da435c640 1 --2- 172.21.15.7:0/1816481878 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d9c0ce2b0 0x7f6d9c0d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:43.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.644+0000 7f6da435c640 1 --2- 172.21.15.7:0/1816481878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d9c15db00 0x7f6d9c0d0340 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:43.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.644+0000 7f6da435c640 1 -- 172.21.15.7:0/1816481878 >> 172.21.15.7:0/1816481878 conn(0x7f6d9c072290 msgr2=0x7f6d9c0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:43.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.644+0000 7f6da435c640 1 -- 172.21.15.7:0/1816481878 shutdown_connections 2024-04-25T09:55:43.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.644+0000 7f6da435c640 1 -- 172.21.15.7:0/1816481878 wait complete. 2024-04-25T09:55:43.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.645+0000 7f6da435c640 1 Processor -- start 2024-04-25T09:55:43.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.645+0000 7f6da435c640 1 -- start start 2024-04-25T09:55:43.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.646+0000 7f6da435c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d9c0b53b0 0x7f6d9c15ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:43.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.646+0000 7f6da435c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d9c0ce2b0 0x7f6d9c1e62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:43.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.646+0000 7f6da435c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d9c15db00 0x7f6d9c0b82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:43.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.646+0000 7f6da435c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c0d3660 con 0x7f6d9c0b53b0 2024-04-25T09:55:43.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.646+0000 7f6da435c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c0b61d0 con 0x7f6d9c15db00 2024-04-25T09:55:43.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.646+0000 7f6da435c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c0b6c10 con 0x7f6d9c0ce2b0 2024-04-25T09:55:43.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.646+0000 7f6da20f8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d9c0b53b0 0x7f6d9c15ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:43.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.646+0000 7f6da20f8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d9c0b53b0 0x7f6d9c15ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54662/0 (socket says 172.21.15.7:54662) 2024-04-25T09:55:43.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.646+0000 7f6da20f8640 1 -- 172.21.15.7:0/807390502 learned_addr learned my addr 172.21.15.7:0/807390502 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:43.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.646+0000 7f6da18f7640 1 --2- 172.21.15.7:0/807390502 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d9c0ce2b0 0x7f6d9c1e62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:43.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.646+0000 7f6da28f9640 1 --2- 172.21.15.7:0/807390502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d9c15db00 0x7f6d9c0b82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:43.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.647+0000 7f6da20f8640 1 -- 172.21.15.7:0/807390502 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d9c0ce2b0 msgr2=0x7f6d9c1e62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:43.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.647+0000 7f6da20f8640 1 --2- 172.21.15.7:0/807390502 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d9c0ce2b0 0x7f6d9c1e62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:43.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.647+0000 7f6da20f8640 1 -- 172.21.15.7:0/807390502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d9c15db00 msgr2=0x7f6d9c0b82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:43.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.647+0000 7f6da20f8640 1 --2- 172.21.15.7:0/807390502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d9c15db00 0x7f6d9c0b82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:43.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.647+0000 7f6da20f8640 1 -- 172.21.15.7:0/807390502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9c1e6c30 con 0x7f6d9c0b53b0 2024-04-25T09:55:43.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.647+0000 7f6da18f7640 1 --2- 172.21.15.7:0/807390502 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d9c0ce2b0 0x7f6d9c1e62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:43.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.647+0000 7f6da20f8640 1 --2- 172.21.15.7:0/807390502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d9c0b53b0 0x7f6d9c15ce40 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6d98035040 tx=0x7f6d980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:43.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.647+0000 7f6d92ffd640 1 -- 172.21.15.7:0/807390502 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d98037040 con 0x7f6d9c0b53b0 2024-04-25T09:55:43.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.647+0000 7f6d92ffd640 1 -- 172.21.15.7:0/807390502 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d98030500 con 0x7f6d9c0b53b0 2024-04-25T09:55:43.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.647+0000 7f6d92ffd640 1 -- 172.21.15.7:0/807390502 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d980308d0 con 0x7f6d9c0b53b0 2024-04-25T09:55:43.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.647+0000 7f6da435c640 1 -- 172.21.15.7:0/807390502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d9c1e6f10 con 0x7f6d9c0b53b0 2024-04-25T09:55:43.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.647+0000 7f6da435c640 1 -- 172.21.15.7:0/807390502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d9c1e74d0 con 0x7f6d9c0b53b0 2024-04-25T09:55:43.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.648+0000 7f6da435c640 1 -- 172.21.15.7:0/807390502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d9c068fd0 con 0x7f6d9c0b53b0 2024-04-25T09:55:43.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.649+0000 7f6d92ffd640 1 -- 172.21.15.7:0/807390502 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6d98044020 con 0x7f6d9c0b53b0 2024-04-25T09:55:43.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.649+0000 7f6d92ffd640 1 --2- 172.21.15.7:0/807390502 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6d8006b4d0 0x7f6d8006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:43.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.649+0000 7f6d92ffd640 1 -- 172.21.15.7:0/807390502 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6d980aa610 con 0x7f6d9c0b53b0 2024-04-25T09:55:43.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.649+0000 7f6da18f7640 1 --2- 172.21.15.7:0/807390502 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6d8006b4d0 0x7f6d8006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:43.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.650+0000 7f6da18f7640 1 --2- 172.21.15.7:0/807390502 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6d8006b4d0 0x7f6d8006d990 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c0c9930 tx=0x7f6d8c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:43.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.653+0000 7f6d92ffd640 1 -- 172.21.15.7:0/807390502 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6d98079300 con 0x7f6d9c0b53b0 2024-04-25T09:55:43.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.904+0000 7f6da435c640 1 -- 172.21.15.7:0/807390502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6d9c0d16b0 con 0x7f6d9c0b53b0 2024-04-25T09:55:43.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.906+0000 7f6d92ffd640 1 -- 172.21.15.7:0/807390502 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7f6d98078c00 con 0x7f6d9c0b53b0 2024-04-25T09:55:43.909 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2024-04-25T09:55:43.909 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAYKCpmaJKeORAALxC5ZqLLEu0zJFG+SOGukQ== 2024-04-25T09:55:43.910 INFO:teuthology.orchestra.run.smithi007.stdout: caps mds = "allow" 2024-04-25T09:55:43.910 INFO:teuthology.orchestra.run.smithi007.stdout: caps mon = "allow r" 2024-04-25T09:55:43.910 INFO:teuthology.orchestra.run.smithi007.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:55:43.910 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2024-04-25T09:55:43.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.908+0000 7f6da435c640 1 -- 172.21.15.7:0/807390502 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6d8006b4d0 msgr2=0x7f6d8006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:43.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.908+0000 7f6da435c640 1 --2- 172.21.15.7:0/807390502 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6d8006b4d0 0x7f6d8006d990 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c0c9930 tx=0x7f6d8c009040 comp rx=0 tx=0).stop 2024-04-25T09:55:43.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.908+0000 7f6da435c640 1 -- 172.21.15.7:0/807390502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d9c0b53b0 msgr2=0x7f6d9c15ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:43.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.908+0000 7f6da435c640 1 --2- 172.21.15.7:0/807390502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d9c0b53b0 0x7f6d9c15ce40 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6d98035040 tx=0x7f6d980046c0 comp rx=0 tx=0).stop 2024-04-25T09:55:43.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.908+0000 7f6da435c640 1 -- 172.21.15.7:0/807390502 shutdown_connections 2024-04-25T09:55:43.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.908+0000 7f6da435c640 1 --2- 172.21.15.7:0/807390502 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6d8006b4d0 0x7f6d8006d990 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:43.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.908+0000 7f6da435c640 1 --2- 172.21.15.7:0/807390502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d9c15db00 0x7f6d9c0b82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:43.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.908+0000 7f6da435c640 1 --2- 172.21.15.7:0/807390502 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d9c0ce2b0 0x7f6d9c1e62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:43.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.908+0000 7f6da435c640 1 --2- 172.21.15.7:0/807390502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d9c0b53b0 0x7f6d9c15ce40 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:43.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.908+0000 7f6da435c640 1 -- 172.21.15.7:0/807390502 >> 172.21.15.7:0/807390502 conn(0x7f6d9c072290 msgr2=0x7f6d9c0c8470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:43.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.908+0000 7f6da435c640 1 -- 172.21.15.7:0/807390502 shutdown_connections 2024-04-25T09:55:43.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:43.908+0000 7f6da435c640 1 -- 172.21.15.7:0/807390502 wait complete. 2024-04-25T09:55:43.922 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:55:44.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.020+0000 7ff6a133b640 1 Processor -- start 2024-04-25T09:55:44.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.020+0000 7ff6a133b640 1 -- start start 2024-04-25T09:55:44.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.021+0000 7ff6a133b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff69c0b2950 0x7ff69c15b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.021+0000 7ff6a133b640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff69c0b5460 con 0x7ff69c0afd40 2024-04-25T09:55:44.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.021+0000 7ff6a133b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff69c0b5700 con 0x7ff69c0b4fd0 2024-04-25T09:55:44.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.021+0000 7ff6a133b640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff69c0d02a0 con 0x7ff69c0b2950 2024-04-25T09:55:44.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.021+0000 7ff69b7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff69c0b2950 0x7ff69c15b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.021+0000 7ff69b7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff69c0b2950 0x7ff69c15b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54666/0 (socket says 172.21.15.7:54666) 2024-04-25T09:55:44.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.021+0000 7ff69affd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff69c0afd40 0x7ff69c0d0d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58678/0 (socket says 172.21.15.7:58678) 2024-04-25T09:55:44.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.021+0000 7ff69b7fe640 1 -- 172.21.15.7:0/2073695532 learned_addr learned my addr 172.21.15.7:0/2073695532 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:44.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.022+0000 7ff69b7fe640 1 -- 172.21.15.7:0/2073695532 >> v1:172.21.15.55:6789/0 conn(0x7ff69c0b4fd0 legacy=0x7ff69c0b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:44.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.022+0000 7ff69b7fe640 1 -- 172.21.15.7:0/2073695532 >> v1:172.21.15.7:6789/0 conn(0x7ff69c0afd40 legacy=0x7ff69c0d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:44.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.022+0000 7ff69b7fe640 1 -- 172.21.15.7:0/2073695532 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69c0d0580 con 0x7ff69c0b2950 2024-04-25T09:55:44.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.022+0000 7ff699ffb640 1 -- 172.21.15.7:0/2073695532 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928230106 0 0) 0x7ff69c0b5460 con 0x7ff69c0afd40 2024-04-25T09:55:44.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.022+0000 7ff69b7fe640 1 --2- 172.21.15.7:0/2073695532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff69c0b2950 0x7ff69c15b7c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff68c009e50 tx=0x7ff68c02a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=463023b86c330b6d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:44.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.022+0000 7ff699ffb640 1 -- 172.21.15.7:0/2073695532 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c036070 con 0x7ff69c0b2950 2024-04-25T09:55:44.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.022+0000 7ff699ffb640 1 -- 172.21.15.7:0/2073695532 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68c031600 con 0x7ff69c0b2950 2024-04-25T09:55:44.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.022+0000 7ff699ffb640 1 -- 172.21.15.7:0/2073695532 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c0319d0 con 0x7ff69c0b2950 2024-04-25T09:55:44.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.023+0000 7ff6a133b640 1 -- 172.21.15.7:0/2073695532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff69c0b2950 msgr2=0x7ff69c15b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:44.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.023+0000 7ff6a133b640 1 --2- 172.21.15.7:0/2073695532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff69c0b2950 0x7ff69c15b7c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff68c009e50 tx=0x7ff68c02a760 comp rx=0 tx=0).stop 2024-04-25T09:55:44.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.023+0000 7ff6a133b640 1 -- 172.21.15.7:0/2073695532 shutdown_connections 2024-04-25T09:55:44.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.023+0000 7ff6a133b640 1 --2- 172.21.15.7:0/2073695532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff69c0b2950 0x7ff69c15b7c0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.023+0000 7ff6a133b640 1 -- 172.21.15.7:0/2073695532 >> 172.21.15.7:0/2073695532 conn(0x7ff69c066ad0 msgr2=0x7ff69c06bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:44.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.023+0000 7ff6a133b640 1 -- 172.21.15.7:0/2073695532 shutdown_connections 2024-04-25T09:55:44.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.023+0000 7ff6a133b640 1 -- 172.21.15.7:0/2073695532 wait complete. 2024-04-25T09:55:44.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.024+0000 7ff6a133b640 1 Processor -- start 2024-04-25T09:55:44.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.024+0000 7ff6a133b640 1 -- start start 2024-04-25T09:55:44.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.025+0000 7ff6a133b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff69c0afd40 0x7ff69c156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.025+0000 7ff6a133b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff69c0b2950 0x7ff69c0cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.025+0000 7ff6a133b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff69c0b4fd0 0x7ff69c0cb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.025+0000 7ff6a133b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c0ce460 con 0x7ff69c0b2950 2024-04-25T09:55:44.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.025+0000 7ff6a133b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c0b59e0 con 0x7ff69c0b4fd0 2024-04-25T09:55:44.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.025+0000 7ff6a133b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c0ce5e0 con 0x7ff69c0afd40 2024-04-25T09:55:44.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.025+0000 7ff69a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff69c0b2950 0x7ff69c0cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.025+0000 7ff69a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff69c0b2950 0x7ff69c0cb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54676/0 (socket says 172.21.15.7:54676) 2024-04-25T09:55:44.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.025+0000 7ff69a7fc640 1 -- 172.21.15.7:0/2699775656 learned_addr learned my addr 172.21.15.7:0/2699775656 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:44.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.025+0000 7ff69affd640 1 --2- 172.21.15.7:0/2699775656 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff69c0afd40 0x7ff69c156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.026+0000 7ff69a7fc640 1 -- 172.21.15.7:0/2699775656 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff69c0afd40 msgr2=0x7ff69c156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:44.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.026+0000 7ff69a7fc640 1 --2- 172.21.15.7:0/2699775656 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff69c0afd40 0x7ff69c156bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.026+0000 7ff69a7fc640 1 -- 172.21.15.7:0/2699775656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff69c0b4fd0 msgr2=0x7ff69c0cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:44.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.026+0000 7ff69b7fe640 1 --2- 172.21.15.7:0/2699775656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff69c0b4fd0 0x7ff69c0cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.026+0000 7ff69a7fc640 1 --2- 172.21.15.7:0/2699775656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff69c0b4fd0 0x7ff69c0cb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.026+0000 7ff69a7fc640 1 -- 172.21.15.7:0/2699775656 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69c0c97e0 con 0x7ff69c0b2950 2024-04-25T09:55:44.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.026+0000 7ff69b7fe640 1 --2- 172.21.15.7:0/2699775656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff69c0b4fd0 0x7ff69c0cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:44.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.026+0000 7ff69a7fc640 1 --2- 172.21.15.7:0/2699775656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff69c0b2950 0x7ff69c0cb300 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff68400b3f0 tx=0x7ff68400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:44.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.026+0000 7ff6937fe640 1 -- 172.21.15.7:0/2699775656 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff684015020 con 0x7ff69c0b2950 2024-04-25T09:55:44.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.026+0000 7ff6937fe640 1 -- 172.21.15.7:0/2699775656 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff684011830 con 0x7ff69c0b2950 2024-04-25T09:55:44.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.026+0000 7ff6937fe640 1 -- 172.21.15.7:0/2699775656 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff684011c20 con 0x7ff69c0b2950 2024-04-25T09:55:44.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.026+0000 7ff6a133b640 1 -- 172.21.15.7:0/2699775656 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff69c0c9ac0 con 0x7ff69c0b2950 2024-04-25T09:55:44.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.026+0000 7ff6a133b640 1 -- 172.21.15.7:0/2699775656 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff69c0ca080 con 0x7ff69c0b2950 2024-04-25T09:55:44.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.027+0000 7ff6a133b640 1 -- 172.21.15.7:0/2699775656 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff69c0cfcf0 con 0x7ff69c0b2950 2024-04-25T09:55:44.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.027+0000 7ff6937fe640 1 -- 172.21.15.7:0/2699775656 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff684018020 con 0x7ff69c0b2950 2024-04-25T09:55:44.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.028+0000 7ff6937fe640 1 --2- 172.21.15.7:0/2699775656 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff67c06b500 0x7ff67c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.028+0000 7ff6937fe640 1 -- 172.21.15.7:0/2699775656 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff684089f20 con 0x7ff69c0b2950 2024-04-25T09:55:44.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.028+0000 7ff69affd640 1 --2- 172.21.15.7:0/2699775656 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff67c06b500 0x7ff67c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.028+0000 7ff69affd640 1 --2- 172.21.15.7:0/2699775656 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff67c06b500 0x7ff67c06d9c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff694000f60 tx=0x7ff694009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:44.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.032+0000 7ff6937fe640 1 -- 172.21.15.7:0/2699775656 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff69c0cfcf0 con 0x7ff69c0b2950 2024-04-25T09:55:44.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.251+0000 7ff6a133b640 1 -- 172.21.15.7:0/2699775656 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff69c068fd0 con 0x7ff69c0b2950 2024-04-25T09:55:44.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.251+0000 7ff6937fe640 1 -- 172.21.15.7:0/2699775656 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4929 (secure 0 0 0) 0x7ff68401f030 con 0x7ff69c0b2950 2024-04-25T09:55:44.255 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:44.255 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5047,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2022061608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2022061608},{"type":"v1","addr":"172.21.15.55:6834","nonce":2022061608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5382,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/2607466795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2607466795},{"type":"v1","addr":"172.21.15.7:6836","nonce":2607466795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5385,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1576325055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1576325055},{"type":"v1","addr":"172.21.15.7:6837","nonce":1576325055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:55:35.091962+0000","modified":"2024-04-25T09:55:37.095949+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5391":{"gid":5391,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/223801838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":223801838},{"type":"v1","addr":"172.21.15.55:6835","nonce":223801838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T09:55:44.255 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 15 2024-04-25T09:55:44.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.253+0000 7ff6a133b640 1 -- 172.21.15.7:0/2699775656 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff67c06b500 msgr2=0x7ff67c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:44.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.253+0000 7ff6a133b640 1 --2- 172.21.15.7:0/2699775656 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff67c06b500 0x7ff67c06d9c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff694000f60 tx=0x7ff694009040 comp rx=0 tx=0).stop 2024-04-25T09:55:44.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.253+0000 7ff6a133b640 1 -- 172.21.15.7:0/2699775656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff69c0b2950 msgr2=0x7ff69c0cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:44.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.253+0000 7ff6a133b640 1 --2- 172.21.15.7:0/2699775656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff69c0b2950 0x7ff69c0cb300 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff68400b3f0 tx=0x7ff68400b8b0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.253+0000 7ff6a133b640 1 -- 172.21.15.7:0/2699775656 shutdown_connections 2024-04-25T09:55:44.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.253+0000 7ff6a133b640 1 --2- 172.21.15.7:0/2699775656 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff67c06b500 0x7ff67c06d9c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.253+0000 7ff6a133b640 1 --2- 172.21.15.7:0/2699775656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff69c0b4fd0 0x7ff69c0cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.253+0000 7ff6a133b640 1 --2- 172.21.15.7:0/2699775656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff69c0b2950 0x7ff69c0cb300 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.253+0000 7ff6a133b640 1 --2- 172.21.15.7:0/2699775656 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff69c0afd40 0x7ff69c156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.253+0000 7ff6a133b640 1 -- 172.21.15.7:0/2699775656 >> 172.21.15.7:0/2699775656 conn(0x7ff69c066ad0 msgr2=0x7ff69c0b2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:44.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.253+0000 7ff6a133b640 1 -- 172.21.15.7:0/2699775656 shutdown_connections 2024-04-25T09:55:44.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.253+0000 7ff6a133b640 1 -- 172.21.15.7:0/2699775656 wait complete. 2024-04-25T09:55:44.670 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:55:35.091962+0000', 'modified': '2024-04-25T09:55:37.095949+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5391}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5391': {'gid': 5391, 'name': 'b', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6835/223801838', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6833', 'nonce': 223801838}, {'type': 'v1', 'addr': '172.21.15.55:6835', 'nonce': 223801838}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:55:44.670 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:55:44.670 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T09:55:44.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.774+0000 7fa98041f640 1 Processor -- start 2024-04-25T09:55:44.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.774+0000 7fa98041f640 1 -- start start 2024-04-25T09:55:44.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.775+0000 7fa98041f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa9780d2ca0 0x7fa9780d30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.775+0000 7fa98041f640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa97815e8a0 con 0x7fa97815da60 2024-04-25T09:55:44.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.775+0000 7fa98041f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa97815eb80 con 0x7fa9780d0aa0 2024-04-25T09:55:44.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.775+0000 7fa98041f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa97815ee60 con 0x7fa9780d2ca0 2024-04-25T09:55:44.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.775+0000 7fa97e1bb640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa97815da60 0x7fa97815de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58692/0 (socket says 172.21.15.7:58692) 2024-04-25T09:55:44.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.775+0000 7fa97e1bb640 1 -- 172.21.15.7:0/1609037924 learned_addr learned my addr 172.21.15.7:0/1609037924 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:44.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.775+0000 7fa97e9bc640 1 --2- 172.21.15.7:0/1609037924 >> v2:172.21.15.55:3300/0 conn(0x7fa9780d2ca0 0x7fa9780d30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.775+0000 7fa97d1b9640 1 -- 172.21.15.7:0/1609037924 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1202678068 0 0) 0x7fa97815e8a0 con 0x7fa97815da60 2024-04-25T09:55:44.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.775+0000 7fa97d1b9640 1 -- 172.21.15.7:0/1609037924 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa964003520 con 0x7fa97815da60 2024-04-25T09:55:44.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.775+0000 7fa97d1b9640 1 -- 172.21.15.7:0/1609037924 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1376128486 0 0) 0x7fa97815eb80 con 0x7fa9780d0aa0 2024-04-25T09:55:44.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.775+0000 7fa97d1b9640 1 -- 172.21.15.7:0/1609037924 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa97815e8a0 con 0x7fa9780d0aa0 2024-04-25T09:55:44.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.775+0000 7fa97d1b9640 1 -- 172.21.15.7:0/1609037924 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2346557088 0 0) 0x7fa964003520 con 0x7fa97815da60 2024-04-25T09:55:44.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.775+0000 7fa97d1b9640 1 -- 172.21.15.7:0/1609037924 >> v2:172.21.15.55:3300/0 conn(0x7fa9780d2ca0 msgr2=0x7fa9780d30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:44.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.775+0000 7fa97d1b9640 1 --2- 172.21.15.7:0/1609037924 >> v2:172.21.15.55:3300/0 conn(0x7fa9780d2ca0 0x7fa9780d30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.775+0000 7fa97d1b9640 1 -- 172.21.15.7:0/1609037924 >> v1:172.21.15.55:6789/0 conn(0x7fa9780d0aa0 legacy=0x7fa978161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:44.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.775+0000 7fa97d1b9640 1 -- 172.21.15.7:0/1609037924 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa978161850 con 0x7fa97815da60 2024-04-25T09:55:44.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.775+0000 7fa97d1b9640 1 -- 172.21.15.7:0/1609037924 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fa974001670 con 0x7fa97815da60 2024-04-25T09:55:44.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.775+0000 7fa97e9bc640 1 --2- 172.21.15.7:0/1609037924 >> v2:172.21.15.55:3300/0 conn(0x7fa9780d2ca0 0x7fa9780d30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:55:44.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.775+0000 7fa97d1b9640 1 -- 172.21.15.7:0/1609037924 >> v1:172.21.15.7:6789/0 conn(0x7fa97815da60 legacy=0x7fa97815de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:44.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.775+0000 7fa97d1b9640 1 --2- 172.21.15.7:0/1609037924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa964003b40 0x7fa964003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.775+0000 7fa97d1b9640 1 --2- 172.21.15.7:0/1609037924 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa964004800 0x7fa964004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.775+0000 7fa97d1b9640 1 --2- 172.21.15.7:0/1609037924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9640051c0 0x7fa96400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.775+0000 7fa97d1b9640 1 -- 172.21.15.7:0/1609037924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97815ee60 con 0x7fa9640051c0 2024-04-25T09:55:44.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.775+0000 7fa97d1b9640 1 -- 172.21.15.7:0/1609037924 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96400c0f0 con 0x7fa964003b40 2024-04-25T09:55:44.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.775+0000 7fa97d1b9640 1 -- 172.21.15.7:0/1609037924 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96400c2f0 con 0x7fa964004800 2024-04-25T09:55:44.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.776+0000 7fa97e9bc640 1 --2- 172.21.15.7:0/1609037924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9640051c0 0x7fa96400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.776+0000 7fa97e1bb640 1 --2- 172.21.15.7:0/1609037924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa964003b40 0x7fa964003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.776+0000 7fa97d9ba640 1 --2- 172.21.15.7:0/1609037924 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa964004800 0x7fa964004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.776+0000 7fa97e9bc640 1 -- 172.21.15.7:0/1609037924 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa964004800 msgr2=0x7fa964004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:44.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.776+0000 7fa97e9bc640 1 --2- 172.21.15.7:0/1609037924 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa964004800 0x7fa964004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.776+0000 7fa97e9bc640 1 -- 172.21.15.7:0/1609037924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa964003b40 msgr2=0x7fa964003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:44.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.776+0000 7fa97e9bc640 1 --2- 172.21.15.7:0/1609037924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa964003b40 0x7fa964003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.776+0000 7fa97e9bc640 1 -- 172.21.15.7:0/1609037924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa964003520 con 0x7fa9640051c0 2024-04-25T09:55:44.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.777+0000 7fa97e9bc640 1 -- 172.21.15.7:0/1609037924 reap_dead start 2024-04-25T09:55:44.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.777+0000 7fa97e9bc640 1 --2- 172.21.15.7:0/1609037924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9640051c0 0x7fa96400b9c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa97000e350 tx=0x7fa964005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b2b297990deac8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:44.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.777+0000 7fa97d1b9640 1 -- 172.21.15.7:0/1609037924 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970009de0 con 0x7fa9640051c0 2024-04-25T09:55:44.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.777+0000 7fa97d1b9640 1 -- 172.21.15.7:0/1609037924 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa970003bd0 con 0x7fa9640051c0 2024-04-25T09:55:44.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.777+0000 7fa97d1b9640 1 -- 172.21.15.7:0/1609037924 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970004020 con 0x7fa9640051c0 2024-04-25T09:55:44.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.777+0000 7fa98041f640 1 -- 172.21.15.7:0/1609037924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9640051c0 msgr2=0x7fa96400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:44.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.777+0000 7fa98041f640 1 --2- 172.21.15.7:0/1609037924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9640051c0 0x7fa96400b9c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa97000e350 tx=0x7fa964005830 comp rx=0 tx=0).stop 2024-04-25T09:55:44.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.777+0000 7fa98041f640 1 -- 172.21.15.7:0/1609037924 shutdown_connections 2024-04-25T09:55:44.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.777+0000 7fa98041f640 1 --2- 172.21.15.7:0/1609037924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9640051c0 0x7fa96400b9c0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.777+0000 7fa98041f640 1 -- 172.21.15.7:0/1609037924 >> 172.21.15.7:0/1609037924 conn(0x7fa97806bfe0 msgr2=0x7fa97806c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:44.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.777+0000 7fa98041f640 1 -- 172.21.15.7:0/1609037924 shutdown_connections 2024-04-25T09:55:44.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.777+0000 7fa98041f640 1 -- 172.21.15.7:0/1609037924 wait complete. 2024-04-25T09:55:44.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.779+0000 7fa98041f640 1 Processor -- start 2024-04-25T09:55:44.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.779+0000 7fa98041f640 1 -- start start 2024-04-25T09:55:44.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.779+0000 7fa98041f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa9640051c0 0x7fa9781562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.779+0000 7fa98041f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9780cb4c0 0x7fa9780cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.779+0000 7fa98041f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9781e7a40 0x7fa9781e7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.779+0000 7fa98041f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9780d3440 con 0x7fa9781e7a40 2024-04-25T09:55:44.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.779+0000 7fa98041f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9780d32c0 con 0x7fa9780cb4c0 2024-04-25T09:55:44.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.779+0000 7fa98041f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9780d35c0 con 0x7fa9640051c0 2024-04-25T09:55:44.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.779+0000 7fa97e9bc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9781e7a40 0x7fa9781e7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.780+0000 7fa97e9bc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9781e7a40 0x7fa9781e7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54684/0 (socket says 172.21.15.7:54684) 2024-04-25T09:55:44.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.780+0000 7fa97e9bc640 1 -- 172.21.15.7:0/3075184060 learned_addr learned my addr 172.21.15.7:0/3075184060 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:44.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.780+0000 7fa97d9ba640 1 --2- 172.21.15.7:0/3075184060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9780cb4c0 0x7fa9780cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.780+0000 7fa97e1bb640 1 --2- 172.21.15.7:0/3075184060 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa9640051c0 0x7fa9781562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.780+0000 7fa97e9bc640 1 -- 172.21.15.7:0/3075184060 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa9640051c0 msgr2=0x7fa9781562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:44.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.780+0000 7fa97e9bc640 1 --2- 172.21.15.7:0/3075184060 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa9640051c0 0x7fa9781562f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.780+0000 7fa97e9bc640 1 -- 172.21.15.7:0/3075184060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9780cb4c0 msgr2=0x7fa9780cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:44.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.780+0000 7fa97e9bc640 1 --2- 172.21.15.7:0/3075184060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9780cb4c0 0x7fa9780cbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.780+0000 7fa97e9bc640 1 -- 172.21.15.7:0/3075184060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9780ccb30 con 0x7fa9781e7a40 2024-04-25T09:55:44.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.780+0000 7fa97d9ba640 1 --2- 172.21.15.7:0/3075184060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9780cb4c0 0x7fa9780cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:44.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.780+0000 7fa97e9bc640 1 --2- 172.21.15.7:0/3075184060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9781e7a40 0x7fa9781e7ec0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fa97000e440 tx=0x7fa970009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:44.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.780+0000 7fa96effd640 1 -- 172.21.15.7:0/3075184060 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970009de0 con 0x7fa9781e7a40 2024-04-25T09:55:44.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.780+0000 7fa96effd640 1 -- 172.21.15.7:0/3075184060 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa970036610 con 0x7fa9781e7a40 2024-04-25T09:55:44.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.780+0000 7fa98041f640 1 -- 172.21.15.7:0/3075184060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9780cce10 con 0x7fa9781e7a40 2024-04-25T09:55:44.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.780+0000 7fa96effd640 1 -- 172.21.15.7:0/3075184060 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9700369e0 con 0x7fa9781e7a40 2024-04-25T09:55:44.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.780+0000 7fa98041f640 1 -- 172.21.15.7:0/3075184060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9780cd3d0 con 0x7fa9781e7a40 2024-04-25T09:55:44.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.782+0000 7fa96effd640 1 -- 172.21.15.7:0/3075184060 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa970040070 con 0x7fa9781e7a40 2024-04-25T09:55:44.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.782+0000 7fa96effd640 1 --2- 172.21.15.7:0/3075184060 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa95c06b500 0x7fa95c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.782+0000 7fa96effd640 1 -- 172.21.15.7:0/3075184060 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa9700ab0f0 con 0x7fa9781e7a40 2024-04-25T09:55:44.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.782+0000 7fa97e1bb640 1 --2- 172.21.15.7:0/3075184060 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa95c06b500 0x7fa95c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.783+0000 7fa97e1bb640 1 --2- 172.21.15.7:0/3075184060 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa95c06b500 0x7fa95c06d9c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa9781f6a50 tx=0x7fa974009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:44.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.783+0000 7fa9831ff740 1 Processor -- start 2024-04-25T09:55:44.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.784+0000 7fa9831ff740 1 -- start start 2024-04-25T09:55:44.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.784+0000 7fa9831ff740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd835b5230 0x55fd835b5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.784+0000 7fa9831ff740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd835d2ad0 0x55fd835d3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.784+0000 7fa9831ff740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fd8358af10 0x55fd835d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.784+0000 7fa9831ff740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd834eda10 con 0x55fd835d2ad0 2024-04-25T09:55:44.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.784+0000 7fa9831ff740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd83496b30 con 0x55fd835b5230 2024-04-25T09:55:44.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.784+0000 7fa9831ff740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fd834e9c50 con 0x55fd8358af10 2024-04-25T09:55:44.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.784+0000 7fa97d9ba640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd835d2ad0 0x55fd835d3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.784+0000 7fa97d9ba640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd835d2ad0 0x55fd835d3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54692/0 (socket says 172.21.15.7:54692) 2024-04-25T09:55:44.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.784+0000 7fa97d9ba640 1 -- 172.21.15.7:0/3266468486 learned_addr learned my addr 172.21.15.7:0/3266468486 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:44.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.784+0000 7fa97e1bb640 1 --2- 172.21.15.7:0/3266468486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd835b5230 0x55fd835b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.785+0000 7fa97e9bc640 1 --2- 172.21.15.7:0/3266468486 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fd8358af10 0x55fd835d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.785+0000 7fa97d9ba640 1 -- 172.21.15.7:0/3266468486 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fd8358af10 msgr2=0x55fd835d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:44.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.785+0000 7fa97d9ba640 1 --2- 172.21.15.7:0/3266468486 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fd8358af10 0x55fd835d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.785+0000 7fa97d9ba640 1 -- 172.21.15.7:0/3266468486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd835b5230 msgr2=0x55fd835b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:44.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.785+0000 7fa97d9ba640 1 --2- 172.21.15.7:0/3266468486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd835b5230 0x55fd835b5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.785+0000 7fa97d9ba640 1 -- 172.21.15.7:0/3266468486 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd834abe10 con 0x55fd835d2ad0 2024-04-25T09:55:44.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.785+0000 7fa97e1bb640 1 --2- 172.21.15.7:0/3266468486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd835b5230 0x55fd835b5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:44.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.785+0000 7fa97e9bc640 1 --2- 172.21.15.7:0/3266468486 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fd8358af10 0x55fd835d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:44.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.785+0000 7fa97d9ba640 1 --2- 172.21.15.7:0/3266468486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd835d2ad0 0x55fd835d3020 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa9680079a0 tx=0x7fa9680039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42aa914e8daa772c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:44.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.785+0000 7fa95bfff640 1 -- 172.21.15.7:0/3266468486 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa968001490 con 0x55fd835d2ad0 2024-04-25T09:55:44.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.785+0000 7fa95bfff640 1 -- 172.21.15.7:0/3266468486 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa968019070 con 0x55fd835d2ad0 2024-04-25T09:55:44.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.785+0000 7fa95bfff640 1 -- 172.21.15.7:0/3266468486 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa968001870 con 0x55fd835d2ad0 2024-04-25T09:55:44.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.786+0000 7fa9831ff740 1 -- 172.21.15.7:0/3266468486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd835d2ad0 msgr2=0x55fd835d3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:44.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.786+0000 7fa9831ff740 1 --2- 172.21.15.7:0/3266468486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd835d2ad0 0x55fd835d3020 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa9680079a0 tx=0x7fa9680039c0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.786+0000 7fa9831ff740 1 -- 172.21.15.7:0/3266468486 shutdown_connections 2024-04-25T09:55:44.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.786+0000 7fa9831ff740 1 --2- 172.21.15.7:0/3266468486 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fd8358af10 0x55fd835d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.786+0000 7fa9831ff740 1 --2- 172.21.15.7:0/3266468486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd835d2ad0 0x55fd835d3020 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.786+0000 7fa9831ff740 1 --2- 172.21.15.7:0/3266468486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd835b5230 0x55fd835b5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.786+0000 7fa9831ff740 1 -- 172.21.15.7:0/3266468486 >> 172.21.15.7:0/3266468486 conn(0x55fd83587840 msgr2=0x55fd835d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:44.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.786+0000 7fa9831ff740 1 -- 172.21.15.7:0/3266468486 shutdown_connections 2024-04-25T09:55:44.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.786+0000 7fa9831ff740 1 -- 172.21.15.7:0/3266468486 wait complete. 2024-04-25T09:55:44.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.786+0000 7fa9831ff740 1 -- start start 2024-04-25T09:55:44.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.787+0000 7fa9831ff740 1 Processor -- start 2024-04-25T09:55:44.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.787+0000 7fa9831ff740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fd835b5230 0x55fd835a3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.787+0000 7fa9831ff740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd835d2ad0 0x55fd835c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.787+0000 7fa9831ff740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd835e4580 0x55fd835e39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.787+0000 7fa9831ff740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd8358bcb0 con 0x55fd835d2ad0 2024-04-25T09:55:44.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.787+0000 7fa9831ff740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd834aa0c0 con 0x55fd835e4580 2024-04-25T09:55:44.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.787+0000 7fa9831ff740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fd83585770 con 0x55fd835b5230 2024-04-25T09:55:44.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.788+0000 7fa9831ff740 10 client.0 _ll_register_callbacks cb 0x55fd8349dec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:55:44.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.788+0000 7fa97d9ba640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd835d2ad0 0x55fd835c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.788+0000 7fa97d9ba640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd835d2ad0 0x55fd835c70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54702/0 (socket says 172.21.15.7:54702) 2024-04-25T09:55:44.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.788+0000 7fa97d9ba640 1 -- 172.21.15.7:0/2631693704 learned_addr learned my addr 172.21.15.7:0/2631693704 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:44.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.788+0000 7fa97e9bc640 1 --2- 172.21.15.7:0/2631693704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd835e4580 0x55fd835e39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.788+0000 7fa97d9ba640 1 -- 172.21.15.7:0/2631693704 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fd835b5230 msgr2=0x55fd835a3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:44.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.788+0000 7fa97d9ba640 1 --2- 172.21.15.7:0/2631693704 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fd835b5230 0x55fd835a3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.788+0000 7fa97d9ba640 1 -- 172.21.15.7:0/2631693704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd835e4580 msgr2=0x55fd835e39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:44.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.788+0000 7fa97d9ba640 1 --2- 172.21.15.7:0/2631693704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd835e4580 0x55fd835e39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.788+0000 7fa97d9ba640 1 -- 172.21.15.7:0/2631693704 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fd832022d0 con 0x55fd835d2ad0 2024-04-25T09:55:44.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.788+0000 7fa97d9ba640 1 --2- 172.21.15.7:0/2631693704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd835d2ad0 0x55fd835c70f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa968001ac0 tx=0x7fa9680012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997bf59a4c857724 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:44.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.788+0000 7fa9597fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:55:44.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.788+0000 7fa9597fa640 1 -- 172.21.15.7:0/2631693704 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9680069d0 con 0x55fd835d2ad0 2024-04-25T09:55:44.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.788+0000 7fa9597fa640 1 -- 172.21.15.7:0/2631693704 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa968006b70 con 0x55fd835d2ad0 2024-04-25T09:55:44.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.788+0000 7fa9831ff740 1 -- 172.21.15.7:0/2631693704 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa968019070 con 0x55fd835d2ad0 2024-04-25T09:55:44.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.788+0000 7fa9597fa640 1 -- 172.21.15.7:0/2631693704 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa96802d050 con 0x55fd835d2ad0 2024-04-25T09:55:44.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.788+0000 7fa9831ff740 10 client.5577 fetch_fsmap learned FSMap version 15 2024-04-25T09:55:44.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.788+0000 7fa9831ff740 1 -- 172.21.15.7:0/2631693704 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55fd832cc6b0 con 0x55fd835d2ad0 2024-04-25T09:55:44.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.789+0000 7fa9597fa640 1 -- 172.21.15.7:0/2631693704 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa968019070 con 0x55fd835d2ad0 2024-04-25T09:55:44.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.789+0000 7fa9597fa640 1 -- 172.21.15.7:0/2631693704 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa968030020 con 0x55fd835d2ad0 2024-04-25T09:55:44.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.789+0000 7fa9831ff740 10 client.5577 fetch_fsmap finished waiting for FSMap version 15 2024-04-25T09:55:44.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.789+0000 7fa9831ff740 10 client.5577 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T09:55:44.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.789+0000 7fa9831ff740 20 client.5577 populate_metadata read hostname 'smithi007' 2024-04-25T09:55:44.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.789+0000 7fa9831ff740 1 --2- 172.21.15.7:0/2631693704 >> [v2:172.21.15.55:6833/223801838,v1:172.21.15.55:6835/223801838] conn(0x55fd835b73d0 0x55fd835b77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.789+0000 7fa9831ff740 4 client.5577 mds_command: new command op to 5391 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:55:44.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.789+0000 7fa9831ff740 1 -- 172.21.15.7:0/2631693704 --> [v2:172.21.15.55:6833/223801838,v1:172.21.15.55:6835/223801838] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fd8354c920 con 0x55fd835b73d0 2024-04-25T09:55:44.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.789+0000 7fa97e1bb640 1 --2- 172.21.15.7:0/2631693704 >> [v2:172.21.15.55:6833/223801838,v1:172.21.15.55:6835/223801838] conn(0x55fd835b73d0 0x55fd835b77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.789+0000 7fa9597fa640 10 client.5577 ms_handle_connect on v2:172.21.15.55:6833/223801838 2024-04-25T09:55:44.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.789+0000 7fa97e1bb640 1 --2- 172.21.15.7:0/2631693704 >> [v2:172.21.15.55:6833/223801838,v1:172.21.15.55:6835/223801838] conn(0x55fd835b73d0 0x55fd835b77d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a95faa70e9e985 server_cookie=26b02462d18996f4 in_seq=0 out_seq=0 2024-04-25T09:55:44.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.790+0000 7fa9597fa640 1 -- 172.21.15.7:0/2631693704 <== mds.0 v2:172.21.15.55:6833/223801838 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fd8354c920 con 0x55fd835b73d0 2024-04-25T09:55:44.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.790+0000 7fa9597fa640 10 client.5577 handle_command_reply: tid=0 2024-04-25T09:55:44.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.790+0000 7fa9831ff740 1 client.5577 shutdown 2024-04-25T09:55:44.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.790+0000 7fa9831ff740 1 -- 172.21.15.7:0/2631693704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd835d2ad0 msgr2=0x55fd835c70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:44.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.790+0000 7fa9831ff740 1 --2- 172.21.15.7:0/2631693704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd835d2ad0 0x55fd835c70f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa968001ac0 tx=0x7fa9680012d0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.790+0000 7fa9831ff740 1 -- 172.21.15.7:0/2631693704 shutdown_connections 2024-04-25T09:55:44.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.790+0000 7fa9831ff740 1 --2- 172.21.15.7:0/2631693704 >> [v2:172.21.15.55:6833/223801838,v1:172.21.15.55:6835/223801838] conn(0x55fd835b73d0 0x55fd835b77d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.790+0000 7fa9831ff740 1 --2- 172.21.15.7:0/2631693704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd835e4580 0x55fd835e39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.790+0000 7fa9831ff740 1 --2- 172.21.15.7:0/2631693704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd835d2ad0 0x55fd835c70f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.790+0000 7fa9597fa640 0 client.5577 ms_handle_reset on v2:172.21.15.55:6833/223801838 2024-04-25T09:55:44.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.790+0000 7fa9831ff740 1 --2- 172.21.15.7:0/2631693704 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fd835b5230 0x55fd835a3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.790+0000 7fa9831ff740 1 -- 172.21.15.7:0/2631693704 >> 172.21.15.7:0/2631693704 conn(0x55fd8358af10 msgr2=0x55fd835d3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:44.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.791+0000 7fa9831ff740 1 -- 172.21.15.7:0/2631693704 shutdown_connections 2024-04-25T09:55:44.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.791+0000 7fa9831ff740 1 -- 172.21.15.7:0/2631693704 wait complete. 2024-04-25T09:55:44.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.791+0000 7fa9831ff740 20 client.5577 trim_cache size 0 max 16384 2024-04-25T09:55:44.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.807+0000 7fa9831ff740 1 Processor -- start 2024-04-25T09:55:44.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.807+0000 7fa9831ff740 1 -- start start 2024-04-25T09:55:44.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.807+0000 7fa9831ff740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd835b5230 0x55fd835b77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.807+0000 7fa9831ff740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fd835b73d0 0x55fd835b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.807+0000 7fa9831ff740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd835d2ad0 0x55fd835b3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.807+0000 7fa9831ff740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9781ffb00 con 0x55fd835b5230 2024-04-25T09:55:44.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.807+0000 7fa9831ff740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9781fef00 con 0x55fd835d2ad0 2024-04-25T09:55:44.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.807+0000 7fa9831ff740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9781ff500 con 0x55fd835b73d0 2024-04-25T09:55:44.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.807+0000 7fa97e1bb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd835b5230 0x55fd835b77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.807+0000 7fa97e1bb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd835b5230 0x55fd835b77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54708/0 (socket says 172.21.15.7:54708) 2024-04-25T09:55:44.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.808+0000 7fa97e1bb640 1 -- 172.21.15.7:0/3855765180 learned_addr learned my addr 172.21.15.7:0/3855765180 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:44.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.808+0000 7fa97e9bc640 1 --2- 172.21.15.7:0/3855765180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd835d2ad0 0x55fd835b3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.808+0000 7fa97d9ba640 1 --2- 172.21.15.7:0/3855765180 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fd835b73d0 0x55fd835b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.808+0000 7fa97e1bb640 1 -- 172.21.15.7:0/3855765180 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fd835b73d0 msgr2=0x55fd835b7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:44.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.808+0000 7fa97e1bb640 1 --2- 172.21.15.7:0/3855765180 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fd835b73d0 0x55fd835b7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.808+0000 7fa97e1bb640 1 -- 172.21.15.7:0/3855765180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd835d2ad0 msgr2=0x55fd835b3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:44.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.808+0000 7fa97e1bb640 1 --2- 172.21.15.7:0/3855765180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd835d2ad0 0x55fd835b3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.808+0000 7fa97e1bb640 1 -- 172.21.15.7:0/3855765180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd835d4520 con 0x55fd835b5230 2024-04-25T09:55:44.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.808+0000 7fa97e1bb640 1 --2- 172.21.15.7:0/3855765180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd835b5230 0x55fd835b77b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa9740255a0 tx=0x7fa974015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=345e1f9ccd633366 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:44.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.808+0000 7fa95b7fe640 1 -- 172.21.15.7:0/3855765180 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97401a030 con 0x55fd835b5230 2024-04-25T09:55:44.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.808+0000 7fa95b7fe640 1 -- 172.21.15.7:0/3855765180 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa974007590 con 0x55fd835b5230 2024-04-25T09:55:44.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.808+0000 7fa95b7fe640 1 -- 172.21.15.7:0/3855765180 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa974022440 con 0x55fd835b5230 2024-04-25T09:55:44.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.809+0000 7fa9831ff740 1 -- 172.21.15.7:0/3855765180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd835b5230 msgr2=0x55fd835b77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:44.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.809+0000 7fa9831ff740 1 --2- 172.21.15.7:0/3855765180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd835b5230 0x55fd835b77b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa9740255a0 tx=0x7fa974015000 comp rx=0 tx=0).stop 2024-04-25T09:55:44.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.809+0000 7fa9831ff740 1 -- 172.21.15.7:0/3855765180 shutdown_connections 2024-04-25T09:55:44.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.809+0000 7fa9831ff740 1 --2- 172.21.15.7:0/3855765180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd835d2ad0 0x55fd835b3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.809+0000 7fa9831ff740 1 --2- 172.21.15.7:0/3855765180 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fd835b73d0 0x55fd835b7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.809+0000 7fa9831ff740 1 --2- 172.21.15.7:0/3855765180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd835b5230 0x55fd835b77b0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.809+0000 7fa9831ff740 1 -- 172.21.15.7:0/3855765180 >> 172.21.15.7:0/3855765180 conn(0x55fd8358af10 msgr2=0x55fd8358b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:44.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.809+0000 7fa9831ff740 1 -- 172.21.15.7:0/3855765180 shutdown_connections 2024-04-25T09:55:44.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.810+0000 7fa9831ff740 1 -- 172.21.15.7:0/3855765180 wait complete. 2024-04-25T09:55:44.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.810+0000 7fa9831ff740 1 -- start start 2024-04-25T09:55:44.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.810+0000 7fa9831ff740 1 Processor -- start 2024-04-25T09:55:44.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.811+0000 7fa9831ff740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd835b5230 0x55fd836320e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.811+0000 7fa9831ff740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd835b73d0 0x55fd8363b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.811+0000 7fa9831ff740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fd835d2ad0 0x55fd835b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.811+0000 7fa9831ff740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd835b6cb0 con 0x55fd835b5230 2024-04-25T09:55:44.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.811+0000 7fa9831ff740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd8358bcb0 con 0x55fd835b73d0 2024-04-25T09:55:44.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.811+0000 7fa9831ff740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fd835d5dd0 con 0x55fd835d2ad0 2024-04-25T09:55:44.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.811+0000 7fa9831ff740 10 client.0 _ll_register_callbacks cb 0x55fd83585c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:55:44.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.811+0000 7fa97e1bb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd835b5230 0x55fd836320e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.811+0000 7fa97e1bb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd835b5230 0x55fd836320e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54716/0 (socket says 172.21.15.7:54716) 2024-04-25T09:55:44.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.811+0000 7fa97e1bb640 1 -- 172.21.15.7:0/2291637422 learned_addr learned my addr 172.21.15.7:0/2291637422 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:44.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.811+0000 7fa97e9bc640 1 --2- 172.21.15.7:0/2291637422 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fd835d2ad0 0x55fd835b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.811+0000 7fa97d9ba640 1 --2- 172.21.15.7:0/2291637422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd835b73d0 0x55fd8363b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.812+0000 7fa97e1bb640 1 -- 172.21.15.7:0/2291637422 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fd835d2ad0 msgr2=0x55fd835b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:44.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.812+0000 7fa97e1bb640 1 --2- 172.21.15.7:0/2291637422 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fd835d2ad0 0x55fd835b0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.812+0000 7fa97e1bb640 1 -- 172.21.15.7:0/2291637422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd835b73d0 msgr2=0x55fd8363b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:44.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.812+0000 7fa97e1bb640 1 --2- 172.21.15.7:0/2291637422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd835b73d0 0x55fd8363b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.812+0000 7fa97e1bb640 1 -- 172.21.15.7:0/2291637422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fd8358cb90 con 0x55fd835b5230 2024-04-25T09:55:44.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.812+0000 7fa97e9bc640 1 --2- 172.21.15.7:0/2291637422 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fd835d2ad0 0x55fd835b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:44.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.812+0000 7fa97e1bb640 1 --2- 172.21.15.7:0/2291637422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd835b5230 0x55fd836320e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa974001200 tx=0x7fa97815ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a64e3a041a54a9f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:44.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.812+0000 7fa9597fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:55:44.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.812+0000 7fa9597fa640 1 -- 172.21.15.7:0/2291637422 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa974039650 con 0x55fd835b5230 2024-04-25T09:55:44.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.812+0000 7fa9597fa640 1 -- 172.21.15.7:0/2291637422 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa9740397f0 con 0x55fd835b5230 2024-04-25T09:55:44.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.812+0000 7fa9831ff740 1 -- 172.21.15.7:0/2291637422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa974007590 con 0x55fd835b5230 2024-04-25T09:55:44.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.812+0000 7fa9597fa640 1 -- 172.21.15.7:0/2291637422 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa974041050 con 0x55fd835b5230 2024-04-25T09:55:44.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.812+0000 7fa9831ff740 10 client.5583 fetch_fsmap learned FSMap version 15 2024-04-25T09:55:44.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.812+0000 7fa9831ff740 1 -- 172.21.15.7:0/2291637422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55fd835b4c20 con 0x55fd835b5230 2024-04-25T09:55:44.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.812+0000 7fa9597fa640 1 -- 172.21.15.7:0/2291637422 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa974007590 con 0x55fd835b5230 2024-04-25T09:55:44.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.812+0000 7fa9597fa640 1 -- 172.21.15.7:0/2291637422 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa974044020 con 0x55fd835b5230 2024-04-25T09:55:44.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.812+0000 7fa9831ff740 10 client.5583 fetch_fsmap finished waiting for FSMap version 15 2024-04-25T09:55:44.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.812+0000 7fa9831ff740 10 client.5583 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T09:55:44.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.812+0000 7fa9831ff740 20 client.5583 populate_metadata read hostname 'smithi007' 2024-04-25T09:55:44.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.812+0000 7fa9831ff740 1 --2- 172.21.15.7:0/2291637422 >> [v2:172.21.15.55:6833/223801838,v1:172.21.15.55:6835/223801838] conn(0x55fd835e4580 0x55fd835b87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.812+0000 7fa9831ff740 4 client.5583 mds_command: new command op to 5391 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:55:44.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.812+0000 7fa9831ff740 1 -- 172.21.15.7:0/2291637422 --> [v2:172.21.15.55:6833/223801838,v1:172.21.15.55:6835/223801838] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fd834faf50 con 0x55fd835e4580 2024-04-25T09:55:44.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.813+0000 7fa97d9ba640 1 --2- 172.21.15.7:0/2291637422 >> [v2:172.21.15.55:6833/223801838,v1:172.21.15.55:6835/223801838] conn(0x55fd835e4580 0x55fd835b87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.813+0000 7fa9597fa640 10 client.5583 ms_handle_connect on v2:172.21.15.55:6833/223801838 2024-04-25T09:55:44.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.813+0000 7fa97d9ba640 1 --2- 172.21.15.7:0/2291637422 >> [v2:172.21.15.55:6833/223801838,v1:172.21.15.55:6835/223801838] conn(0x55fd835e4580 0x55fd835b87d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a34fc54c0707a0ad server_cookie=c91db53ad656b131 in_seq=0 out_seq=0 2024-04-25T09:55:44.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.813+0000 7fa9597fa640 1 -- 172.21.15.7:0/2291637422 <== mds.0 v2:172.21.15.55:6833/223801838 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55fd834faf50 con 0x55fd835e4580 2024-04-25T09:55:44.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.813+0000 7fa9597fa640 10 client.5583 handle_command_reply: tid=0 2024-04-25T09:55:44.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.813+0000 7fa9831ff740 1 client.5583 shutdown 2024-04-25T09:55:44.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.813+0000 7fa9831ff740 1 -- 172.21.15.7:0/2291637422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd835b5230 msgr2=0x55fd836320e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:44.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.813+0000 7fa9831ff740 1 --2- 172.21.15.7:0/2291637422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd835b5230 0x55fd836320e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa974001200 tx=0x7fa97815ea70 comp rx=0 tx=0).stop 2024-04-25T09:55:44.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.814+0000 7fa9831ff740 1 -- 172.21.15.7:0/2291637422 shutdown_connections 2024-04-25T09:55:44.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.814+0000 7fa9831ff740 1 --2- 172.21.15.7:0/2291637422 >> [v2:172.21.15.55:6833/223801838,v1:172.21.15.55:6835/223801838] conn(0x55fd835e4580 0x55fd835b87d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.814+0000 7fa9831ff740 1 --2- 172.21.15.7:0/2291637422 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fd835d2ad0 0x55fd835b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.814+0000 7fa9831ff740 1 --2- 172.21.15.7:0/2291637422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd835b73d0 0x55fd8363b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.814+0000 7fa9831ff740 1 --2- 172.21.15.7:0/2291637422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd835b5230 0x55fd836320e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.814+0000 7fa9597fa640 0 client.5583 ms_handle_reset on v2:172.21.15.55:6833/223801838 2024-04-25T09:55:44.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.814+0000 7fa9831ff740 1 -- 172.21.15.7:0/2291637422 >> 172.21.15.7:0/2291637422 conn(0x55fd8358af10 msgr2=0x55fd835c8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:44.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.814+0000 7fa9831ff740 1 -- 172.21.15.7:0/2291637422 shutdown_connections 2024-04-25T09:55:44.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.814+0000 7fa9831ff740 1 -- 172.21.15.7:0/2291637422 wait complete. 2024-04-25T09:55:44.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.814+0000 7fa9831ff740 20 client.5583 trim_cache size 0 max 16384 2024-04-25T09:55:44.822 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T09:55:44.822 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "c03d0745-5946-49c3-ad88-1165c5b68b4e", 2024-04-25T09:55:44.822 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-04-25T09:55:44.822 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 5391, 2024-04-25T09:55:44.822 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-04-25T09:55:44.822 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-04-25T09:55:44.823 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-04-25T09:55:44.823 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 9.0911774919999999, 2024-04-25T09:55:44.823 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 15, 2024-04-25T09:55:44.823 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 39, 2024-04-25T09:55:44.823 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 39, 2024-04-25T09:55:44.823 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 15.964627709 2024-04-25T09:55:44.823 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T09:55:44.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.814+0000 7fa98041f640 1 -- 172.21.15.7:0/3075184060 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa95c06b500 msgr2=0x7fa95c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:44.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.814+0000 7fa98041f640 1 --2- 172.21.15.7:0/3075184060 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa95c06b500 0x7fa95c06d9c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa9781f6a50 tx=0x7fa974009040 comp rx=0 tx=0).stop 2024-04-25T09:55:44.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.814+0000 7fa98041f640 1 -- 172.21.15.7:0/3075184060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9781e7a40 msgr2=0x7fa9781e7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:44.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.814+0000 7fa98041f640 1 --2- 172.21.15.7:0/3075184060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9781e7a40 0x7fa9781e7ec0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fa97000e440 tx=0x7fa970009750 comp rx=0 tx=0).stop 2024-04-25T09:55:44.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.814+0000 7fa98041f640 1 -- 172.21.15.7:0/3075184060 shutdown_connections 2024-04-25T09:55:44.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.814+0000 7fa98041f640 1 --2- 172.21.15.7:0/3075184060 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa95c06b500 0x7fa95c06d9c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.814+0000 7fa98041f640 1 --2- 172.21.15.7:0/3075184060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9781e7a40 0x7fa9781e7ec0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.814+0000 7fa98041f640 1 --2- 172.21.15.7:0/3075184060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9780cb4c0 0x7fa9780cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.814+0000 7fa98041f640 1 --2- 172.21.15.7:0/3075184060 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa9640051c0 0x7fa9781562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.814+0000 7fa98041f640 1 -- 172.21.15.7:0/3075184060 >> 172.21.15.7:0/3075184060 conn(0x7fa97806bfe0 msgr2=0x7fa978160440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:44.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.814+0000 7fa98041f640 1 -- 172.21.15.7:0/3075184060 shutdown_connections 2024-04-25T09:55:44.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.814+0000 7fa98041f640 1 -- 172.21.15.7:0/3075184060 wait complete. 2024-04-25T09:55:44.828 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:55:44.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.926+0000 7f1c62cb3640 1 Processor -- start 2024-04-25T09:55:44.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.926+0000 7f1c62cb3640 1 -- start start 2024-04-25T09:55:44.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.926+0000 7f1c62cb3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c5c15db00 0x7f1c5c0d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.926+0000 7f1c62cb3640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1c5c0b53b0 0x7f1c5c0d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.926+0000 7f1c62cb3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c5c0d1e80 con 0x7f1c5c0ce2b0 2024-04-25T09:55:44.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.926+0000 7f1c62cb3640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c5c0b5930 con 0x7f1c5c0b53b0 2024-04-25T09:55:44.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.926+0000 7f1c62cb3640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c0b5c10 con 0x7f1c5c15db00 2024-04-25T09:55:44.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.927+0000 7f1c5bfff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1c5c0b53b0 0x7f1c5c0d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.927+0000 7f1c5bfff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1c5c0b53b0 0x7f1c5c0d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54722/0 (socket says 172.21.15.7:54722) 2024-04-25T09:55:44.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.927+0000 7f1c5bfff640 1 -- 172.21.15.7:0/2384040870 learned_addr learned my addr 172.21.15.7:0/2384040870 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:44.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.927+0000 7f1c60a4f640 1 --2- 172.21.15.7:0/2384040870 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c5c15db00 0x7f1c5c0d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.927+0000 7f1c5bfff640 1 -- 172.21.15.7:0/2384040870 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c5c15db00 msgr2=0x7f1c5c0d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:44.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.927+0000 7f1c5bfff640 1 --2- 172.21.15.7:0/2384040870 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c5c15db00 0x7f1c5c0d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.927+0000 7f1c5bfff640 1 -- 172.21.15.7:0/2384040870 >> v1:172.21.15.55:6789/0 conn(0x7f1c5c0ce2b0 legacy=0x7f1c5c161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:44.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.927+0000 7f1c5bfff640 1 -- 172.21.15.7:0/2384040870 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5c0b5ef0 con 0x7f1c5c0b53b0 2024-04-25T09:55:44.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.927+0000 7f1c60a4f640 1 --2- 172.21.15.7:0/2384040870 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c5c15db00 0x7f1c5c0d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:44.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.928+0000 7f1c5bfff640 1 --2- 172.21.15.7:0/2384040870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c5c0b53b0 0x7f1c5c0d0880 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1c48009870 tx=0x7f1c4802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=564fa1e9b2e0eac6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:44.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.928+0000 7f1c5b7fe640 1 -- 172.21.15.7:0/2384040870 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c48037070 con 0x7f1c5c0b53b0 2024-04-25T09:55:44.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.928+0000 7f1c5b7fe640 1 -- 172.21.15.7:0/2384040870 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c48032440 con 0x7f1c5c0b53b0 2024-04-25T09:55:44.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.928+0000 7f1c5b7fe640 1 -- 172.21.15.7:0/2384040870 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c48032810 con 0x7f1c5c0b53b0 2024-04-25T09:55:44.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.928+0000 7f1c62cb3640 1 -- 172.21.15.7:0/2384040870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c5c0b53b0 msgr2=0x7f1c5c0d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:44.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.928+0000 7f1c62cb3640 1 --2- 172.21.15.7:0/2384040870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c5c0b53b0 0x7f1c5c0d0880 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1c48009870 tx=0x7f1c4802a270 comp rx=0 tx=0).stop 2024-04-25T09:55:44.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.928+0000 7f1c62cb3640 1 -- 172.21.15.7:0/2384040870 shutdown_connections 2024-04-25T09:55:44.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.928+0000 7f1c62cb3640 1 --2- 172.21.15.7:0/2384040870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c5c0b53b0 0x7f1c5c0d0880 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.928+0000 7f1c62cb3640 1 --2- 172.21.15.7:0/2384040870 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c5c15db00 0x7f1c5c0d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.928+0000 7f1c62cb3640 1 -- 172.21.15.7:0/2384040870 >> 172.21.15.7:0/2384040870 conn(0x7f1c5c072290 msgr2=0x7f1c5c0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:44.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.928+0000 7f1c62cb3640 1 -- 172.21.15.7:0/2384040870 shutdown_connections 2024-04-25T09:55:44.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.928+0000 7f1c62cb3640 1 -- 172.21.15.7:0/2384040870 wait complete. 2024-04-25T09:55:44.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.929+0000 7f1c62cb3640 1 Processor -- start 2024-04-25T09:55:44.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.930+0000 7f1c62cb3640 1 -- start start 2024-04-25T09:55:44.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.930+0000 7f1c62cb3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c5c0b53b0 0x7f1c5c149970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.930+0000 7f1c62cb3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c5c0ce2b0 0x7f1c5c157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.930+0000 7f1c62cb3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c5c15db00 0x7f1c5c1580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.930+0000 7f1c62cb3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c0d3660 con 0x7f1c5c0b53b0 2024-04-25T09:55:44.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.930+0000 7f1c62cb3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c0b61d0 con 0x7f1c5c0ce2b0 2024-04-25T09:55:44.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.930+0000 7f1c62cb3640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c0b6c10 con 0x7f1c5c15db00 2024-04-25T09:55:44.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.930+0000 7f1c60a4f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c5c0b53b0 0x7f1c5c149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.930+0000 7f1c60a4f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c5c0b53b0 0x7f1c5c149970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54738/0 (socket says 172.21.15.7:54738) 2024-04-25T09:55:44.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.930+0000 7f1c60a4f640 1 -- 172.21.15.7:0/314443373 learned_addr learned my addr 172.21.15.7:0/314443373 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:44.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.931+0000 7f1c5bfff640 1 --2- 172.21.15.7:0/314443373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c5c0ce2b0 0x7f1c5c157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.931+0000 7f1c60a4f640 1 -- 172.21.15.7:0/314443373 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c5c15db00 msgr2=0x7f1c5c1580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:44.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.931+0000 7f1c61250640 1 --2- 172.21.15.7:0/314443373 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c5c15db00 0x7f1c5c1580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.931+0000 7f1c60a4f640 1 --2- 172.21.15.7:0/314443373 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c5c15db00 0x7f1c5c1580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.931+0000 7f1c60a4f640 1 -- 172.21.15.7:0/314443373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c5c0ce2b0 msgr2=0x7f1c5c157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:44.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.931+0000 7f1c60a4f640 1 --2- 172.21.15.7:0/314443373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c5c0ce2b0 0x7f1c5c157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:44.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.931+0000 7f1c60a4f640 1 -- 172.21.15.7:0/314443373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5c1488d0 con 0x7f1c5c0b53b0 2024-04-25T09:55:44.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.931+0000 7f1c61250640 1 --2- 172.21.15.7:0/314443373 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c5c15db00 0x7f1c5c1580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:44.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.931+0000 7f1c5bfff640 1 --2- 172.21.15.7:0/314443373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c5c0ce2b0 0x7f1c5c157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:44.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.931+0000 7f1c60a4f640 1 --2- 172.21.15.7:0/314443373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c5c0b53b0 0x7f1c5c149970 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f1c5000d7d0 tx=0x7f1c5000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:44.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.931+0000 7f1c597fa640 1 -- 172.21.15.7:0/314443373 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c50004030 con 0x7f1c5c0b53b0 2024-04-25T09:55:44.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.931+0000 7f1c597fa640 1 -- 172.21.15.7:0/314443373 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c500041d0 con 0x7f1c5c0b53b0 2024-04-25T09:55:44.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.931+0000 7f1c62cb3640 1 -- 172.21.15.7:0/314443373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c5c148bb0 con 0x7f1c5c0b53b0 2024-04-25T09:55:44.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.931+0000 7f1c597fa640 1 -- 172.21.15.7:0/314443373 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5000b6c0 con 0x7f1c5c0b53b0 2024-04-25T09:55:44.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.931+0000 7f1c62cb3640 1 -- 172.21.15.7:0/314443373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c5c149170 con 0x7f1c5c0b53b0 2024-04-25T09:55:44.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.932+0000 7f1c62cb3640 1 -- 172.21.15.7:0/314443373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c5c068fd0 con 0x7f1c5c0b53b0 2024-04-25T09:55:44.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.933+0000 7f1c597fa640 1 -- 172.21.15.7:0/314443373 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1c5000b860 con 0x7f1c5c0b53b0 2024-04-25T09:55:44.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.933+0000 7f1c597fa640 1 --2- 172.21.15.7:0/314443373 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1c4006b4d0 0x7f1c4006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:44.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.933+0000 7f1c597fa640 1 -- 172.21.15.7:0/314443373 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1c5008a5f0 con 0x7f1c5c0b53b0 2024-04-25T09:55:44.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.933+0000 7f1c5bfff640 1 --2- 172.21.15.7:0/314443373 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1c4006b4d0 0x7f1c4006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:44.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.934+0000 7f1c5bfff640 1 --2- 172.21.15.7:0/314443373 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1c4006b4d0 0x7f1c4006d990 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1c48034000 tx=0x7f1c4802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:44.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:44.938+0000 7f1c597fa640 1 -- 172.21.15.7:0/314443373 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1c50059370 con 0x7f1c5c0b53b0 2024-04-25T09:55:45.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:45.155+0000 7f1c62cb3640 1 -- 172.21.15.7:0/314443373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1c5c0d16b0 con 0x7f1c5c0b53b0 2024-04-25T09:55:45.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:45.156+0000 7f1c597fa640 1 -- 172.21.15.7:0/314443373 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1c50058c70 con 0x7f1c5c0b53b0 2024-04-25T09:55:45.159 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:55:45.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:45.157+0000 7f1c62cb3640 1 -- 172.21.15.7:0/314443373 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1c4006b4d0 msgr2=0x7f1c4006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:45.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:45.157+0000 7f1c62cb3640 1 --2- 172.21.15.7:0/314443373 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1c4006b4d0 0x7f1c4006d990 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1c48034000 tx=0x7f1c4802e000 comp rx=0 tx=0).stop 2024-04-25T09:55:45.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:45.157+0000 7f1c62cb3640 1 -- 172.21.15.7:0/314443373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c5c0b53b0 msgr2=0x7f1c5c149970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:45.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:45.157+0000 7f1c62cb3640 1 --2- 172.21.15.7:0/314443373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c5c0b53b0 0x7f1c5c149970 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f1c5000d7d0 tx=0x7f1c5000dc90 comp rx=0 tx=0).stop 2024-04-25T09:55:45.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:45.158+0000 7f1c62cb3640 1 -- 172.21.15.7:0/314443373 shutdown_connections 2024-04-25T09:55:45.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:45.158+0000 7f1c62cb3640 1 --2- 172.21.15.7:0/314443373 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1c4006b4d0 0x7f1c4006d990 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:45.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:45.158+0000 7f1c62cb3640 1 --2- 172.21.15.7:0/314443373 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c5c15db00 0x7f1c5c1580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:45.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:45.158+0000 7f1c62cb3640 1 --2- 172.21.15.7:0/314443373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c5c0ce2b0 0x7f1c5c157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:45.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:45.158+0000 7f1c62cb3640 1 --2- 172.21.15.7:0/314443373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c5c0b53b0 0x7f1c5c149970 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:45.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:45.158+0000 7f1c62cb3640 1 -- 172.21.15.7:0/314443373 >> 172.21.15.7:0/314443373 conn(0x7f1c5c072290 msgr2=0x7f1c5c15c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:45.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:45.158+0000 7f1c62cb3640 1 -- 172.21.15.7:0/314443373 shutdown_connections 2024-04-25T09:55:45.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:45.158+0000 7f1c62cb3640 1 -- 172.21.15.7:0/314443373 wait complete. 2024-04-25T09:55:45.171 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:55:45.171 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:55:45.171 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-04-25T09:55:45.171 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:55:45.172 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:55:45.172 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:55:45.172 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:55:45.172 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:55:45.172 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:55:45.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:45.172 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-04-25T09:55:45.188 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:55:45.188 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:55:45.188 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:55:45.188 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:55:45.188 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-04-25T09:55:45.188 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:55:45.188 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:55:45.188 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-04-25T09:55:45.188 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-04-25T09:55:45.188 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:55:45.188 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-04-25T09:55:45.189 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-04-25T09:55:45.189 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:55:45.189 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-04-25T09:55:45.189 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-04-25T09:55:45.189 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T09:55:45.189 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42654sec preferred_lft 42654sec 2024-04-25T09:55:45.189 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link noprefixroute 2024-04-25T09:55:45.189 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:55:45.189 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:55:45.189 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-04-25T09:55:45.189 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-04-25T09:55:45.189 INFO:teuthology.orchestra.run.smithi007.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:55:45.189 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 26:0c:99:53:12:e3 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:55:45.190 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:55:45.190 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:55:45.190 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::50aa:55ff:febc:5f67/64 scope link 2024-04-25T09:55:45.190 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:55:45.190 INFO:teuthology.orchestra.run.smithi007.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:55:45.190 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 6e:99:f1:00:a9:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:55:45.190 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6c99:f1ff:fe00:a95e/64 scope link 2024-04-25T09:55:45.190 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:55:45.190 INFO:teuthology.orchestra.run.smithi007.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:55:45.190 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 26:0c:99:53:12:e3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:55:45.190 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::240c:99ff:fe53:12e3/64 scope link 2024-04-25T09:55:45.190 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:55:45.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:45.191 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:55:45.251 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-04-25T09:55:45.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:45.252 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-04-25T09:55:45.309 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-04-25T09:55:45.309 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:55:45.309 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T09:55:45.309 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T09:55:45.309 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:55:45.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:45.309 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-04-25T09:55:45.309 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-25T09:55:45.309 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:55:45.310 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:55:45.310 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:55:45.310 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-25T09:55:45.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:45.394 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-04-25T09:55:45.409 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:55:45.409 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:55:45.410 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:55:45.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:45.410 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-04-25T09:55:45.475 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:55:45.475 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:55:45.530 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:55:45.530 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:55:45.530 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:55:45.584 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:55:45.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:45.585 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:55:45.667 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:55:45.667 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:55:45.667 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T09:55:45.676 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:55:45.676 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:55:45.676 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T09:55:45.676 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T09:55:45.676 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:55:45.682 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:55:45.682 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:55:45.682 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T09:55:45.682 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T09:55:45.682 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:55:45.682 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790" 2024-04-25T09:55:45.682 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790:/ 2024-04-25T09:55:45.682 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c03d0745-5946-49c3-ad88-1165c5b68b4e" will pass to kernel 2024-04-25T09:55:45.683 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T09:55:45.683 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-04-25T09:55:45.683 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T09:55:45.683 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T09:55:45.683 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T09:55:45.684 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:55:45.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:45.685 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:55:45.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:45.750 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:55:45.816 INFO:teuthology.orchestra.run.smithi007.stdout:client4931 2024-04-25T09:55:45.816 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:55:45.816 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:55:45.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:45.871 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir) 2024-04-25T09:55:45.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:45.935 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir/childdir) 2024-04-25T09:55:45.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:45.993 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch rfile) 2024-04-25T09:55:46.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:46.050 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/pfile) 2024-04-25T09:55:46.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:46.111 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/childdir/cfile) 2024-04-25T09:55:46.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:46.169 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T09:55:46.232 INFO:teuthology.orchestra.run.smithi007.stdout:./ 2024-04-25T09:55:46.232 INFO:teuthology.orchestra.run.smithi007.stdout:./rfile 2024-04-25T09:55:46.232 INFO:teuthology.orchestra.run.smithi007.stdout:./parentdir 2024-04-25T09:55:46.233 INFO:teuthology.orchestra.run.smithi007.stdout:./parentdir/pfile 2024-04-25T09:55:46.233 INFO:teuthology.orchestra.run.smithi007.stdout:./parentdir/childdir 2024-04-25T09:55:46.233 INFO:teuthology.orchestra.run.smithi007.stdout:./parentdir/childdir/cfile 2024-04-25T09:55:46.234 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T09:55:46.234 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T09:55:46.234 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T09:55:46.234 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T09:55:46.234 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T09:55:46.234 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T09:55:46.342 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-04-25T09:55:46.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:55:46.349 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T09:55:46.349 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T09:55:46.349 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T09:55:46.349 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T09:55:46.349 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./rfile").st_ino) 2024-04-25T09:55:46.349 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T09:55:46.455 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627778 2024-04-25T09:55:46.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:55:46.464 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T09:55:46.464 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T09:55:46.464 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T09:55:46.464 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T09:55:46.464 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir").st_ino) 2024-04-25T09:55:46.464 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T09:55:46.570 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627776 2024-04-25T09:55:46.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:55:46.579 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T09:55:46.579 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T09:55:46.579 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T09:55:46.579 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T09:55:46.579 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/pfile").st_ino) 2024-04-25T09:55:46.579 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T09:55:46.686 INFO:teuthology.orchestra.run.smithi007.stdout:1099511628279 2024-04-25T09:55:46.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:55:46.695 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T09:55:46.695 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T09:55:46.695 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T09:55:46.695 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T09:55:46.695 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir").st_ino) 2024-04-25T09:55:46.695 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T09:55:46.802 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627777 2024-04-25T09:55:46.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:55:46.813 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T09:55:46.813 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T09:55:46.813 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T09:55:46.813 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T09:55:46.813 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir/cfile").st_ino) 2024-04-25T09:55:46.813 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T09:55:46.918 INFO:teuthology.orchestra.run.smithi007.stdout:1099511628280 2024-04-25T09:55:46.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:55:46.927 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:55:46.927 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:55:46.982 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:55:46.982 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:55:47.038 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:55:47.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.175+0000 7f8ce65f4640 1 Processor -- start 2024-04-25T09:55:47.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.175+0000 7f8ce65f4640 1 -- start start 2024-04-25T09:55:47.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.176+0000 7f8ce65f4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8ce015da60 0x7f8ce00d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:47.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.176+0000 7f8ce65f4640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8ce015de40 0x7f8ce0161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:47.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.176+0000 7f8ce65f4640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce015e8a0 con 0x7f8ce01622b0 2024-04-25T09:55:47.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.176+0000 7f8ce65f4640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce015eb80 con 0x7f8ce015de40 2024-04-25T09:55:47.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.176+0000 7f8ce65f4640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce015ee60 con 0x7f8ce015da60 2024-04-25T09:55:47.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.176+0000 7f8cdf7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8ce015de40 0x7f8ce0161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:47.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.176+0000 7f8cdf7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8ce015de40 0x7f8ce0161d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54746/0 (socket says 172.21.15.7:54746) 2024-04-25T09:55:47.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.176+0000 7f8cdf7fe640 1 -- 172.21.15.7:0/470878597 learned_addr learned my addr 172.21.15.7:0/470878597 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:47.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.176+0000 7f8cdffff640 1 --2- 172.21.15.7:0/470878597 >> v2:172.21.15.55:3300/0 conn(0x7f8ce015da60 0x7f8ce00d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:47.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.177+0000 7f8cdf7fe640 1 -- 172.21.15.7:0/470878597 >> v2:172.21.15.55:3300/0 conn(0x7f8ce015da60 msgr2=0x7f8ce00d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:47.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.177+0000 7f8cdf7fe640 1 --2- 172.21.15.7:0/470878597 >> v2:172.21.15.55:3300/0 conn(0x7f8ce015da60 0x7f8ce00d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:47.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.177+0000 7f8cdf7fe640 1 -- 172.21.15.7:0/470878597 >> v1:172.21.15.55:6789/0 conn(0x7f8ce01622b0 legacy=0x7f8ce00ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:47.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.177+0000 7f8cdf7fe640 1 -- 172.21.15.7:0/470878597 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce0161850 con 0x7f8ce015de40 2024-04-25T09:55:47.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.177+0000 7f8cdf7fe640 1 --2- 172.21.15.7:0/470878597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce015de40 0x7f8ce0161d70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8ce006db00 tx=0x7f8cd002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9d269a342e3ad80 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:47.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.178+0000 7f8cdeffd640 1 -- 172.21.15.7:0/470878597 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0037070 con 0x7f8ce015de40 2024-04-25T09:55:47.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.178+0000 7f8cdeffd640 1 -- 172.21.15.7:0/470878597 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd0032440 con 0x7f8ce015de40 2024-04-25T09:55:47.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.178+0000 7f8cdeffd640 1 -- 172.21.15.7:0/470878597 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0032810 con 0x7f8ce015de40 2024-04-25T09:55:47.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.178+0000 7f8ce65f4640 1 -- 172.21.15.7:0/470878597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce015de40 msgr2=0x7f8ce0161d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:47.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.178+0000 7f8ce65f4640 1 --2- 172.21.15.7:0/470878597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce015de40 0x7f8ce0161d70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8ce006db00 tx=0x7f8cd002a1e0 comp rx=0 tx=0).stop 2024-04-25T09:55:47.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.178+0000 7f8ce65f4640 1 -- 172.21.15.7:0/470878597 shutdown_connections 2024-04-25T09:55:47.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.178+0000 7f8ce65f4640 1 --2- 172.21.15.7:0/470878597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce015de40 0x7f8ce0161d70 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:47.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.178+0000 7f8ce65f4640 1 --2- 172.21.15.7:0/470878597 >> v2:172.21.15.55:3300/0 conn(0x7f8ce015da60 0x7f8ce00d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:47.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.178+0000 7f8ce65f4640 1 -- 172.21.15.7:0/470878597 >> 172.21.15.7:0/470878597 conn(0x7f8ce006bfe0 msgr2=0x7f8ce006c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:47.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.178+0000 7f8ce65f4640 1 -- 172.21.15.7:0/470878597 shutdown_connections 2024-04-25T09:55:47.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.178+0000 7f8ce65f4640 1 -- 172.21.15.7:0/470878597 wait complete. 2024-04-25T09:55:47.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.179+0000 7f8ce65f4640 1 Processor -- start 2024-04-25T09:55:47.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.180+0000 7f8ce65f4640 1 -- start start 2024-04-25T09:55:47.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.180+0000 7f8ce65f4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce015da60 0x7f8ce0158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:47.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.180+0000 7f8ce65f4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ce015de40 0x7f8ce00cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:47.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.180+0000 7f8ce65f4640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ce01622b0 0x7f8ce015f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:47.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.180+0000 7f8ce65f4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce015e2d0 con 0x7f8ce015da60 2024-04-25T09:55:47.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.180+0000 7f8ce65f4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce00cee40 con 0x7f8ce015de40 2024-04-25T09:55:47.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.180+0000 7f8ce65f4640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce015e450 con 0x7f8ce01622b0 2024-04-25T09:55:47.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.180+0000 7f8cdffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce015da60 0x7f8ce0158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:47.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.180+0000 7f8cdffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce015da60 0x7f8ce0158a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54748/0 (socket says 172.21.15.7:54748) 2024-04-25T09:55:47.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.180+0000 7f8cdffff640 1 -- 172.21.15.7:0/907216704 learned_addr learned my addr 172.21.15.7:0/907216704 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:47.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.181+0000 7f8cdf7fe640 1 --2- 172.21.15.7:0/907216704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ce015de40 0x7f8ce00cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:47.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.181+0000 7f8ce4b91640 1 --2- 172.21.15.7:0/907216704 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ce01622b0 0x7f8ce015f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:47.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.181+0000 7f8cdffff640 1 -- 172.21.15.7:0/907216704 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ce01622b0 msgr2=0x7f8ce015f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:47.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.181+0000 7f8cdffff640 1 --2- 172.21.15.7:0/907216704 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ce01622b0 0x7f8ce015f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:47.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.181+0000 7f8cdffff640 1 -- 172.21.15.7:0/907216704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ce015de40 msgr2=0x7f8ce00cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:47.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.181+0000 7f8cdffff640 1 --2- 172.21.15.7:0/907216704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ce015de40 0x7f8ce00cc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:47.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.181+0000 7f8cdffff640 1 -- 172.21.15.7:0/907216704 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce00b3450 con 0x7f8ce015da60 2024-04-25T09:55:47.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.181+0000 7f8cdffff640 1 --2- 172.21.15.7:0/907216704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce015da60 0x7f8ce0158a60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8cc800d800 tx=0x7f8cc800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:47.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.181+0000 7f8cdcff9640 1 -- 172.21.15.7:0/907216704 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc800b660 con 0x7f8ce015da60 2024-04-25T09:55:47.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.181+0000 7f8cdcff9640 1 -- 172.21.15.7:0/907216704 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc8019070 con 0x7f8ce015da60 2024-04-25T09:55:47.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.181+0000 7f8ce65f4640 1 -- 172.21.15.7:0/907216704 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce00b3730 con 0x7f8ce015da60 2024-04-25T09:55:47.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.181+0000 7f8cdcff9640 1 -- 172.21.15.7:0/907216704 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc800ba20 con 0x7f8ce015da60 2024-04-25T09:55:47.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.181+0000 7f8ce65f4640 1 -- 172.21.15.7:0/907216704 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce01f7970 con 0x7f8ce015da60 2024-04-25T09:55:47.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.182+0000 7f8ce65f4640 1 -- 172.21.15.7:0/907216704 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce0068fd0 con 0x7f8ce015da60 2024-04-25T09:55:47.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.183+0000 7f8cdcff9640 1 -- 172.21.15.7:0/907216704 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8cc800bbc0 con 0x7f8ce015da60 2024-04-25T09:55:47.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.183+0000 7f8cdcff9640 1 --2- 172.21.15.7:0/907216704 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8cc006b500 0x7f8cc006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:47.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.183+0000 7f8cdcff9640 1 -- 172.21.15.7:0/907216704 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8cc808a760 con 0x7f8ce015da60 2024-04-25T09:55:47.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.183+0000 7f8cdf7fe640 1 --2- 172.21.15.7:0/907216704 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8cc006b500 0x7f8cc006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:47.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.184+0000 7f8cdf7fe640 1 --2- 172.21.15.7:0/907216704 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8cc006b500 0x7f8cc006d9c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0034000 tx=0x7f8cd002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:47.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.187+0000 7f8cdcff9640 1 -- 172.21.15.7:0/907216704 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8cc801c360 con 0x7f8ce015da60 2024-04-25T09:55:47.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.367+0000 7f8ce65f4640 1 -- 172.21.15.7:0/907216704 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ce00d1560 con 0x7f8ce015da60 2024-04-25T09:55:47.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.368+0000 7f8cdcff9640 1 -- 172.21.15.7:0/907216704 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16846 (secure 0 0 0) 0x7f8cc80594e0 con 0x7f8ce015da60 2024-04-25T09:55:47.371 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:47.371 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":39,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:55:36.722817+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:55:33.644089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T09:55:34.059847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:55:47.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.370+0000 7f8ce65f4640 1 -- 172.21.15.7:0/907216704 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8cc006b500 msgr2=0x7f8cc006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:47.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.370+0000 7f8ce65f4640 1 --2- 172.21.15.7:0/907216704 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8cc006b500 0x7f8cc006d9c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0034000 tx=0x7f8cd002e000 comp rx=0 tx=0).stop 2024-04-25T09:55:47.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.370+0000 7f8ce65f4640 1 -- 172.21.15.7:0/907216704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce015da60 msgr2=0x7f8ce0158a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:47.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.370+0000 7f8ce65f4640 1 --2- 172.21.15.7:0/907216704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce015da60 0x7f8ce0158a60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8cc800d800 tx=0x7f8cc800dcc0 comp rx=0 tx=0).stop 2024-04-25T09:55:47.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.370+0000 7f8ce65f4640 1 -- 172.21.15.7:0/907216704 shutdown_connections 2024-04-25T09:55:47.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.370+0000 7f8ce65f4640 1 --2- 172.21.15.7:0/907216704 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8cc006b500 0x7f8cc006d9c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:47.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.370+0000 7f8ce65f4640 1 --2- 172.21.15.7:0/907216704 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ce01622b0 0x7f8ce015f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:47.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.370+0000 7f8ce65f4640 1 --2- 172.21.15.7:0/907216704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ce015de40 0x7f8ce00cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:47.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.370+0000 7f8ce65f4640 1 --2- 172.21.15.7:0/907216704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce015da60 0x7f8ce0158a60 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:47.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.370+0000 7f8ce65f4640 1 -- 172.21.15.7:0/907216704 >> 172.21.15.7:0/907216704 conn(0x7f8ce006bfe0 msgr2=0x7f8ce006c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:47.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.370+0000 7f8ce65f4640 1 -- 172.21.15.7:0/907216704 shutdown_connections 2024-04-25T09:55:47.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.370+0000 7f8ce65f4640 1 -- 172.21.15.7:0/907216704 wait complete. 2024-04-25T09:55:47.384 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:55:33.644089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:55:34.059847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:55:47.385 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:55:47.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.485+0000 7f17e1d90640 1 Processor -- start 2024-04-25T09:55:47.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.485+0000 7f17e1d90640 1 -- start start 2024-04-25T09:55:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.486+0000 7f17e1d90640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f17dc0b2c30 0x7f17dc0ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.486+0000 7f17e1d90640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17dc0d1a40 con 0x7f17dc15deb0 2024-04-25T09:55:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.486+0000 7f17e1d90640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17dc0d1d20 con 0x7f17dc0d3760 2024-04-25T09:55:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.486+0000 7f17e1d90640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17dc0d2000 con 0x7f17dc0b2c30 2024-04-25T09:55:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.486+0000 7f17db7fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f17dc15deb0 0x7f17dc0b69e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58706/0 (socket says 172.21.15.7:58706) 2024-04-25T09:55:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.486+0000 7f17db7fe640 1 -- 172.21.15.7:0/232416547 learned_addr learned my addr 172.21.15.7:0/232416547 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.486+0000 7f17daffd640 1 --2- 172.21.15.7:0/232416547 >> v2:172.21.15.55:3300/0 conn(0x7f17dc0b2c30 0x7f17dc0ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.486+0000 7f17da7fc640 1 -- 172.21.15.7:0/232416547 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1620084294 0 0) 0x7f17dc0d1a40 con 0x7f17dc15deb0 2024-04-25T09:55:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.486+0000 7f17da7fc640 1 -- 172.21.15.7:0/232416547 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17c4003520 con 0x7f17dc15deb0 2024-04-25T09:55:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.487+0000 7f17da7fc640 1 -- 172.21.15.7:0/232416547 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2170154981 0 0) 0x7f17c4003520 con 0x7f17dc15deb0 2024-04-25T09:55:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.487+0000 7f17da7fc640 1 -- 172.21.15.7:0/232416547 >> v2:172.21.15.55:3300/0 conn(0x7f17dc0b2c30 msgr2=0x7f17dc0ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.487+0000 7f17da7fc640 1 --2- 172.21.15.7:0/232416547 >> v2:172.21.15.55:3300/0 conn(0x7f17dc0b2c30 0x7f17dc0ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.487+0000 7f17da7fc640 1 -- 172.21.15.7:0/232416547 >> v1:172.21.15.55:6789/0 conn(0x7f17dc0d3760 legacy=0x7f17dc0d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.487+0000 7f17da7fc640 1 -- 172.21.15.7:0/232416547 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17dc0d22e0 con 0x7f17dc15deb0 2024-04-25T09:55:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.487+0000 7f17da7fc640 1 -- 172.21.15.7:0/232416547 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f17cc001670 con 0x7f17dc15deb0 2024-04-25T09:55:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.487+0000 7f17da7fc640 1 -- 172.21.15.7:0/232416547 >> v1:172.21.15.7:6789/0 conn(0x7f17dc15deb0 legacy=0x7f17dc0b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.487+0000 7f17da7fc640 1 --2- 172.21.15.7:0/232416547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17c40039b0 0x7f17c4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.487+0000 7f17da7fc640 1 --2- 172.21.15.7:0/232416547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17c4004800 0x7f17c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.487+0000 7f17da7fc640 1 --2- 172.21.15.7:0/232416547 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f17c40051c0 0x7f17c400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.487+0000 7f17da7fc640 1 -- 172.21.15.7:0/232416547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc0d2000 con 0x7f17c40039b0 2024-04-25T09:55:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.487+0000 7f17da7fc640 1 -- 172.21.15.7:0/232416547 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c400c060 con 0x7f17c4004800 2024-04-25T09:55:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.487+0000 7f17da7fc640 1 -- 172.21.15.7:0/232416547 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c400c260 con 0x7f17c40051c0 2024-04-25T09:55:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.487+0000 7f17db7fe640 1 --2- 172.21.15.7:0/232416547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17c40039b0 0x7f17c4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.487+0000 7f17daffd640 1 --2- 172.21.15.7:0/232416547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17c4004800 0x7f17c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.487+0000 7f17dbfff640 1 --2- 172.21.15.7:0/232416547 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f17c40051c0 0x7f17c400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.487+0000 7f17db7fe640 1 -- 172.21.15.7:0/232416547 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f17c40051c0 msgr2=0x7f17c400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.487+0000 7f17db7fe640 1 --2- 172.21.15.7:0/232416547 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f17c40051c0 0x7f17c400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.487+0000 7f17db7fe640 1 -- 172.21.15.7:0/232416547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17c4004800 msgr2=0x7f17c4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.487+0000 7f17db7fe640 1 --2- 172.21.15.7:0/232416547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17c4004800 0x7f17c4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:47.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.487+0000 7f17db7fe640 1 -- 172.21.15.7:0/232416547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c4003520 con 0x7f17c40039b0 2024-04-25T09:55:47.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.487+0000 7f17dbfff640 1 -- 172.21.15.7:0/232416547 reap_dead start 2024-04-25T09:55:47.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.487+0000 7f17daffd640 1 --2- 172.21.15.7:0/232416547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17c4004800 0x7f17c4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:47.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.488+0000 7f17db7fe640 1 --2- 172.21.15.7:0/232416547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17c40039b0 0x7f17c4003dd0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f17cc00c240 tx=0x7f17c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81047541134c77ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:47.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.488+0000 7f17da7fc640 1 -- 172.21.15.7:0/232416547 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc007d10 con 0x7f17c40039b0 2024-04-25T09:55:47.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.488+0000 7f17da7fc640 1 -- 172.21.15.7:0/232416547 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17cc005ad0 con 0x7f17c40039b0 2024-04-25T09:55:47.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.488+0000 7f17da7fc640 1 -- 172.21.15.7:0/232416547 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc007070 con 0x7f17c40039b0 2024-04-25T09:55:47.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.489+0000 7f17e1d90640 1 -- 172.21.15.7:0/232416547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17c40039b0 msgr2=0x7f17c4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:47.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.489+0000 7f17e1d90640 1 --2- 172.21.15.7:0/232416547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17c40039b0 0x7f17c4003dd0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f17cc00c240 tx=0x7f17c4005830 comp rx=0 tx=0).stop 2024-04-25T09:55:47.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.489+0000 7f17e1d90640 1 -- 172.21.15.7:0/232416547 shutdown_connections 2024-04-25T09:55:47.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.489+0000 7f17e1d90640 1 --2- 172.21.15.7:0/232416547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17c40039b0 0x7f17c4003dd0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:47.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.489+0000 7f17e1d90640 1 -- 172.21.15.7:0/232416547 >> 172.21.15.7:0/232416547 conn(0x7f17dc0726b0 msgr2=0x7f17dc072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:47.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.489+0000 7f17e1d90640 1 -- 172.21.15.7:0/232416547 shutdown_connections 2024-04-25T09:55:47.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.489+0000 7f17e1d90640 1 -- 172.21.15.7:0/232416547 wait complete. 2024-04-25T09:55:47.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.490+0000 7f17e1d90640 1 Processor -- start 2024-04-25T09:55:47.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.490+0000 7f17e1d90640 1 -- start start 2024-04-25T09:55:47.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.491+0000 7f17e1d90640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17c40039b0 0x7f17dc149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:47.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.491+0000 7f17e1d90640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f17dc0b3040 0x7f17dc0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:47.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.491+0000 7f17e1d90640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17dc15fcf0 0x7f17dc160170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:47.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.491+0000 7f17e1d90640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc0ce1b0 con 0x7f17dc15fcf0 2024-04-25T09:55:47.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.491+0000 7f17e1d90640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc0ce030 con 0x7f17c40039b0 2024-04-25T09:55:47.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.491+0000 7f17e1d90640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc0ce330 con 0x7f17dc0b3040 2024-04-25T09:55:47.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.491+0000 7f17dbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17dc15fcf0 0x7f17dc160170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:47.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.491+0000 7f17dbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17dc15fcf0 0x7f17dc160170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54758/0 (socket says 172.21.15.7:54758) 2024-04-25T09:55:47.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.491+0000 7f17dbfff640 1 -- 172.21.15.7:0/265830050 learned_addr learned my addr 172.21.15.7:0/265830050 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:47.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.491+0000 7f17db7fe640 1 --2- 172.21.15.7:0/265830050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17c40039b0 0x7f17dc149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:47.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.491+0000 7f17daffd640 1 --2- 172.21.15.7:0/265830050 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f17dc0b3040 0x7f17dc0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:47.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.491+0000 7f17dbfff640 1 -- 172.21.15.7:0/265830050 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f17dc0b3040 msgr2=0x7f17dc0b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:47.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.491+0000 7f17dbfff640 1 --2- 172.21.15.7:0/265830050 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f17dc0b3040 0x7f17dc0b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:47.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.491+0000 7f17dbfff640 1 -- 172.21.15.7:0/265830050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17c40039b0 msgr2=0x7f17dc149e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:47.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.491+0000 7f17dbfff640 1 --2- 172.21.15.7:0/265830050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17c40039b0 0x7f17dc149e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:47.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.491+0000 7f17dbfff640 1 -- 172.21.15.7:0/265830050 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17dc1608d0 con 0x7f17dc15fcf0 2024-04-25T09:55:47.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.491+0000 7f17db7fe640 1 --2- 172.21.15.7:0/265830050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17c40039b0 0x7f17dc149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:55:47.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.491+0000 7f17dbfff640 1 --2- 172.21.15.7:0/265830050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17dc15fcf0 0x7f17dc160170 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f17dc08cc70 tx=0x7f17d400e9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:47.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.491+0000 7f17c3fff640 1 -- 172.21.15.7:0/265830050 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d4003b80 con 0x7f17dc15fcf0 2024-04-25T09:55:47.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.491+0000 7f17c3fff640 1 -- 172.21.15.7:0/265830050 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d4018070 con 0x7f17dc15fcf0 2024-04-25T09:55:47.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.492+0000 7f17e1d90640 1 -- 172.21.15.7:0/265830050 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17dc160bb0 con 0x7f17dc15fcf0 2024-04-25T09:55:47.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.492+0000 7f17c3fff640 1 -- 172.21.15.7:0/265830050 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d40050d0 con 0x7f17dc15fcf0 2024-04-25T09:55:47.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.492+0000 7f17e1d90640 1 -- 172.21.15.7:0/265830050 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17dc0cb410 con 0x7f17dc15fcf0 2024-04-25T09:55:47.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.493+0000 7f17e1d90640 1 -- 172.21.15.7:0/265830050 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17dc068f60 con 0x7f17dc15fcf0 2024-04-25T09:55:47.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.493+0000 7f17c3fff640 1 -- 172.21.15.7:0/265830050 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f17d4005270 con 0x7f17dc15fcf0 2024-04-25T09:55:47.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.493+0000 7f17c3fff640 1 --2- 172.21.15.7:0/265830050 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f17c806b500 0x7f17c806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:47.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.494+0000 7f17c3fff640 1 -- 172.21.15.7:0/265830050 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f17d4089ff0 con 0x7f17dc15fcf0 2024-04-25T09:55:47.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.494+0000 7f17db7fe640 1 --2- 172.21.15.7:0/265830050 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f17c806b500 0x7f17c806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:47.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.494+0000 7f17db7fe640 1 --2- 172.21.15.7:0/265830050 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f17c806b500 0x7f17c806d9c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f17cc033000 tx=0x7f17cc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:47.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.498+0000 7f17c3fff640 1 -- 172.21.15.7:0/265830050 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f17d4058c40 con 0x7f17dc15fcf0 2024-04-25T09:55:47.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.676+0000 7f17e1d90640 1 -- 172.21.15.7:0/265830050 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f17dc15d660 con 0x7f17dc15fcf0 2024-04-25T09:55:47.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.677+0000 7f17c3fff640 1 -- 172.21.15.7:0/265830050 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f17d4058540 con 0x7f17dc15fcf0 2024-04-25T09:55:47.680 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T09:55:47.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.678+0000 7f17e1d90640 1 -- 172.21.15.7:0/265830050 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f17c806b500 msgr2=0x7f17c806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:47.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.678+0000 7f17e1d90640 1 --2- 172.21.15.7:0/265830050 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f17c806b500 0x7f17c806d9c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f17cc033000 tx=0x7f17cc02e000 comp rx=0 tx=0).stop 2024-04-25T09:55:47.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.678+0000 7f17e1d90640 1 -- 172.21.15.7:0/265830050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17dc15fcf0 msgr2=0x7f17dc160170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:47.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.678+0000 7f17e1d90640 1 --2- 172.21.15.7:0/265830050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17dc15fcf0 0x7f17dc160170 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f17dc08cc70 tx=0x7f17d400e9e0 comp rx=0 tx=0).stop 2024-04-25T09:55:47.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.678+0000 7f17e1d90640 1 -- 172.21.15.7:0/265830050 shutdown_connections 2024-04-25T09:55:47.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.678+0000 7f17e1d90640 1 --2- 172.21.15.7:0/265830050 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f17c806b500 0x7f17c806d9c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:47.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.678+0000 7f17e1d90640 1 --2- 172.21.15.7:0/265830050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17dc15fcf0 0x7f17dc160170 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:47.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.678+0000 7f17e1d90640 1 --2- 172.21.15.7:0/265830050 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f17dc0b3040 0x7f17dc0b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:47.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.678+0000 7f17e1d90640 1 --2- 172.21.15.7:0/265830050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17c40039b0 0x7f17dc149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:47.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.678+0000 7f17e1d90640 1 -- 172.21.15.7:0/265830050 >> 172.21.15.7:0/265830050 conn(0x7f17dc0726b0 msgr2=0x7f17dc0c7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:47.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.679+0000 7f17e1d90640 1 -- 172.21.15.7:0/265830050 shutdown_connections 2024-04-25T09:55:47.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.679+0000 7f17e1d90640 1 -- 172.21.15.7:0/265830050 wait complete. 2024-04-25T09:55:47.692 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:55:47.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.794+0000 7ff96f49a640 1 Processor -- start 2024-04-25T09:55:47.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.794+0000 7ff96f49a640 1 -- start start 2024-04-25T09:55:47.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.795+0000 7ff96f49a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff9680d3e70 0x7ff9680ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:47.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.795+0000 7ff96f49a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9680d1a40 con 0x7ff9680b2c30 2024-04-25T09:55:47.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.795+0000 7ff96f49a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9680d1d20 con 0x7ff96815deb0 2024-04-25T09:55:47.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.795+0000 7ff96f49a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9680d2000 con 0x7ff9680d3e70 2024-04-25T09:55:47.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.795+0000 7ff96ca35640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff9680b2c30 0x7ff9680d3760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58720/0 (socket says 172.21.15.7:58720) 2024-04-25T09:55:47.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.795+0000 7ff96ca35640 1 -- 172.21.15.7:0/4035167137 learned_addr learned my addr 172.21.15.7:0/4035167137 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:47.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.795+0000 7ff96da37640 1 --2- 172.21.15.7:0/4035167137 >> v2:172.21.15.55:3300/0 conn(0x7ff9680d3e70 0x7ff9680ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:47.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.795+0000 7ff95ffff640 1 -- 172.21.15.7:0/4035167137 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2733583312 0 0) 0x7ff9680d1a40 con 0x7ff9680b2c30 2024-04-25T09:55:47.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.795+0000 7ff95ffff640 1 -- 172.21.15.7:0/4035167137 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff954003520 con 0x7ff9680b2c30 2024-04-25T09:55:47.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.795+0000 7ff96da37640 1 -- 172.21.15.7:0/4035167137 >> v1:172.21.15.55:6789/0 conn(0x7ff96815deb0 legacy=0x7ff9680b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:47.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.795+0000 7ff95ffff640 1 -- 172.21.15.7:0/4035167137 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 382900152 0 0) 0x7ff9680d1d20 con 0x7ff96815deb0 2024-04-25T09:55:47.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.795+0000 7ff96da37640 1 -- 172.21.15.7:0/4035167137 >> v1:172.21.15.7:6789/0 conn(0x7ff9680b2c30 legacy=0x7ff9680d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:47.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.795+0000 7ff96da37640 1 -- 172.21.15.7:0/4035167137 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9680d22e0 con 0x7ff9680d3e70 2024-04-25T09:55:47.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.796+0000 7ff96da37640 1 --2- 172.21.15.7:0/4035167137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9680d3e70 0x7ff9680ce030 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff960009d90 tx=0x7ff96002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7b8fcb744cdbd30 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:47.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.796+0000 7ff95ffff640 1 -- 172.21.15.7:0/4035167137 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff960035020 con 0x7ff9680d3e70 2024-04-25T09:55:47.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.796+0000 7ff95ffff640 1 -- 172.21.15.7:0/4035167137 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff960007540 con 0x7ff9680d3e70 2024-04-25T09:55:47.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.796+0000 7ff95ffff640 1 -- 172.21.15.7:0/4035167137 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff958001670 con 0x7ff9680d3e70 2024-04-25T09:55:47.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.797+0000 7ff96f49a640 1 -- 172.21.15.7:0/4035167137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9680d3e70 msgr2=0x7ff9680ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:47.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.797+0000 7ff96f49a640 1 --2- 172.21.15.7:0/4035167137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9680d3e70 0x7ff9680ce030 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff960009d90 tx=0x7ff96002a660 comp rx=0 tx=0).stop 2024-04-25T09:55:47.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.797+0000 7ff96f49a640 1 -- 172.21.15.7:0/4035167137 shutdown_connections 2024-04-25T09:55:47.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.797+0000 7ff96f49a640 1 --2- 172.21.15.7:0/4035167137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9680d3e70 0x7ff9680ce030 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:47.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.797+0000 7ff96f49a640 1 -- 172.21.15.7:0/4035167137 >> 172.21.15.7:0/4035167137 conn(0x7ff9680726b0 msgr2=0x7ff968072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:47.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.797+0000 7ff96f49a640 1 -- 172.21.15.7:0/4035167137 shutdown_connections 2024-04-25T09:55:47.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.797+0000 7ff96f49a640 1 -- 172.21.15.7:0/4035167137 wait complete. 2024-04-25T09:55:47.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.798+0000 7ff96f49a640 1 Processor -- start 2024-04-25T09:55:47.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.798+0000 7ff96f49a640 1 -- start start 2024-04-25T09:55:47.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.799+0000 7ff96f49a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9680b2c30 0x7ff968158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:47.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.799+0000 7ff96f49a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9680d3e70 0x7ff9681f2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:47.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.799+0000 7ff96f49a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff96815deb0 0x7ff9680b7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:47.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.799+0000 7ff96f49a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9680d2ae0 con 0x7ff9680d3e70 2024-04-25T09:55:47.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.799+0000 7ff96f49a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9680b70f0 con 0x7ff96815deb0 2024-04-25T09:55:47.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.799+0000 7ff96f49a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9680d2c60 con 0x7ff9680b2c30 2024-04-25T09:55:47.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.799+0000 7ff96ca35640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9680d3e70 0x7ff9681f2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:47.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.799+0000 7ff96ca35640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9680d3e70 0x7ff9681f2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54774/0 (socket says 172.21.15.7:54774) 2024-04-25T09:55:47.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.799+0000 7ff96ca35640 1 -- 172.21.15.7:0/1025553260 learned_addr learned my addr 172.21.15.7:0/1025553260 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:47.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.799+0000 7ff96d236640 1 --2- 172.21.15.7:0/1025553260 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9680b2c30 0x7ff968158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:47.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.799+0000 7ff96da37640 1 --2- 172.21.15.7:0/1025553260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff96815deb0 0x7ff9680b7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:47.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.799+0000 7ff96ca35640 1 -- 172.21.15.7:0/1025553260 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9680b2c30 msgr2=0x7ff968158740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:47.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.799+0000 7ff96ca35640 1 --2- 172.21.15.7:0/1025553260 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9680b2c30 0x7ff968158740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:47.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.799+0000 7ff96ca35640 1 -- 172.21.15.7:0/1025553260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff96815deb0 msgr2=0x7ff9680b7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:47.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.799+0000 7ff96ca35640 1 --2- 172.21.15.7:0/1025553260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff96815deb0 0x7ff9680b7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:47.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.799+0000 7ff96ca35640 1 -- 172.21.15.7:0/1025553260 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff968158f70 con 0x7ff9680d3e70 2024-04-25T09:55:47.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.800+0000 7ff96ca35640 1 --2- 172.21.15.7:0/1025553260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9680d3e70 0x7ff9681f2bb0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff95800c760 tx=0x7ff95800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:47.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.800+0000 7ff95dffb640 1 -- 172.21.15.7:0/1025553260 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff958018070 con 0x7ff9680d3e70 2024-04-25T09:55:47.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.800+0000 7ff95dffb640 1 -- 172.21.15.7:0/1025553260 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9580074e0 con 0x7ff9680d3e70 2024-04-25T09:55:47.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.800+0000 7ff96f49a640 1 -- 172.21.15.7:0/1025553260 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff968159250 con 0x7ff9680d3e70 2024-04-25T09:55:47.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.800+0000 7ff95dffb640 1 -- 172.21.15.7:0/1025553260 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff958004a00 con 0x7ff9680d3e70 2024-04-25T09:55:47.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.800+0000 7ff96f49a640 1 -- 172.21.15.7:0/1025553260 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff968159810 con 0x7ff9680d3e70 2024-04-25T09:55:47.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.801+0000 7ff96f49a640 1 -- 172.21.15.7:0/1025553260 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff968068f60 con 0x7ff9680d3e70 2024-04-25T09:55:47.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.801+0000 7ff95dffb640 1 -- 172.21.15.7:0/1025553260 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff95801b070 con 0x7ff9680d3e70 2024-04-25T09:55:47.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.802+0000 7ff95dffb640 1 --2- 172.21.15.7:0/1025553260 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff94c06b4d0 0x7ff94c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:47.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.802+0000 7ff95dffb640 1 -- 172.21.15.7:0/1025553260 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff958089870 con 0x7ff9680d3e70 2024-04-25T09:55:47.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.802+0000 7ff96d236640 1 --2- 172.21.15.7:0/1025553260 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff94c06b4d0 0x7ff94c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:47.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.802+0000 7ff96d236640 1 --2- 172.21.15.7:0/1025553260 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff94c06b4d0 0x7ff94c06d990 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff964000f60 tx=0x7ff964009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:47.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.806+0000 7ff95dffb640 1 -- 172.21.15.7:0/1025553260 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff958057f10 con 0x7ff9680d3e70 2024-04-25T09:55:47.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.985+0000 7ff96f49a640 1 -- 172.21.15.7:0/1025553260 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff9680b7f40 con 0x7ff9680d3e70 2024-04-25T09:55:47.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.985+0000 7ff95dffb640 1 -- 172.21.15.7:0/1025553260 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff95805bfb0 con 0x7ff9680d3e70 2024-04-25T09:55:47.988 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:55:47.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.987+0000 7ff96f49a640 1 -- 172.21.15.7:0/1025553260 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff94c06b4d0 msgr2=0x7ff94c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:47.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.987+0000 7ff96f49a640 1 --2- 172.21.15.7:0/1025553260 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff94c06b4d0 0x7ff94c06d990 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff964000f60 tx=0x7ff964009040 comp rx=0 tx=0).stop 2024-04-25T09:55:47.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.987+0000 7ff96f49a640 1 -- 172.21.15.7:0/1025553260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9680d3e70 msgr2=0x7ff9681f2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:47.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.987+0000 7ff96f49a640 1 --2- 172.21.15.7:0/1025553260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9680d3e70 0x7ff9681f2bb0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff95800c760 tx=0x7ff95800cc20 comp rx=0 tx=0).stop 2024-04-25T09:55:47.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.987+0000 7ff96f49a640 1 -- 172.21.15.7:0/1025553260 shutdown_connections 2024-04-25T09:55:47.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.987+0000 7ff96f49a640 1 --2- 172.21.15.7:0/1025553260 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff94c06b4d0 0x7ff94c06d990 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:47.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.987+0000 7ff96f49a640 1 --2- 172.21.15.7:0/1025553260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff96815deb0 0x7ff9680b7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:47.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.987+0000 7ff96f49a640 1 --2- 172.21.15.7:0/1025553260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9680d3e70 0x7ff9681f2bb0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:47.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.987+0000 7ff96f49a640 1 --2- 172.21.15.7:0/1025553260 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9680b2c30 0x7ff968158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:47.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.987+0000 7ff96f49a640 1 -- 172.21.15.7:0/1025553260 >> 172.21.15.7:0/1025553260 conn(0x7ff9680726b0 msgr2=0x7ff9680b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:47.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.987+0000 7ff96f49a640 1 -- 172.21.15.7:0/1025553260 shutdown_connections 2024-04-25T09:55:47.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:47.987+0000 7ff96f49a640 1 -- 172.21.15.7:0/1025553260 wait complete. 2024-04-25T09:55:48.001 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:55:48.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.101+0000 7f95550b3640 1 Processor -- start 2024-04-25T09:55:48.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.101+0000 7f95550b3640 1 -- start start 2024-04-25T09:55:48.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.102+0000 7f95550b3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f955015d8d0 0x7f955006cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:48.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.102+0000 7f95550b3640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f955006bf50 con 0x7f955009a100 2024-04-25T09:55:48.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.102+0000 7f95550b3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95500cfe60 con 0x7f955015dcb0 2024-04-25T09:55:48.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.102+0000 7f95550b3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95500d0140 con 0x7f955015d8d0 2024-04-25T09:55:48.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.102+0000 7f954f59e640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f955009a100 0x7f95500ccea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58730/0 (socket says 172.21.15.7:58730) 2024-04-25T09:55:48.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.102+0000 7f954f59e640 1 -- 172.21.15.7:0/2064764416 learned_addr learned my addr 172.21.15.7:0/2064764416 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:48.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.102+0000 7f954ed9d640 1 --2- 172.21.15.7:0/2064764416 >> v2:172.21.15.55:3300/0 conn(0x7f955015d8d0 0x7f955006cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:48.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.102+0000 7f954dd9b640 1 -- 172.21.15.7:0/2064764416 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1106643571 0 0) 0x7f955006bf50 con 0x7f955009a100 2024-04-25T09:55:48.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.103+0000 7f954dd9b640 1 -- 172.21.15.7:0/2064764416 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f953c003520 con 0x7f955009a100 2024-04-25T09:55:48.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.103+0000 7f954dd9b640 1 -- 172.21.15.7:0/2064764416 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3208013810 0 0) 0x7f953c003520 con 0x7f955009a100 2024-04-25T09:55:48.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.103+0000 7f954dd9b640 1 -- 172.21.15.7:0/2064764416 >> v2:172.21.15.55:3300/0 conn(0x7f955015d8d0 msgr2=0x7f955006cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:48.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.103+0000 7f954dd9b640 1 --2- 172.21.15.7:0/2064764416 >> v2:172.21.15.55:3300/0 conn(0x7f955015d8d0 0x7f955006cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:48.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.103+0000 7f954dd9b640 1 -- 172.21.15.7:0/2064764416 >> v1:172.21.15.55:6789/0 conn(0x7f955015dcb0 legacy=0x7f95500999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:48.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.103+0000 7f954dd9b640 1 -- 172.21.15.7:0/2064764416 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95500d0420 con 0x7f955009a100 2024-04-25T09:55:48.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.103+0000 7f954dd9b640 1 -- 172.21.15.7:0/2064764416 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f9540001a10 con 0x7f955009a100 2024-04-25T09:55:48.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.103+0000 7f954dd9b640 1 -- 172.21.15.7:0/2064764416 >> v1:172.21.15.7:6789/0 conn(0x7f955009a100 legacy=0x7f95500ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:48.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.103+0000 7f954dd9b640 1 --2- 172.21.15.7:0/2064764416 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f953c003a00 0x7f953c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:48.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.103+0000 7f954dd9b640 1 --2- 172.21.15.7:0/2064764416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f953c004800 0x7f953c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:48.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.103+0000 7f954dd9b640 1 --2- 172.21.15.7:0/2064764416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f953c0051c0 0x7f953c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:48.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.103+0000 7f954dd9b640 1 -- 172.21.15.7:0/2064764416 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95500d0140 con 0x7f953c004800 2024-04-25T09:55:48.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.103+0000 7f954dd9b640 1 -- 172.21.15.7:0/2064764416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953c00c0c0 con 0x7f953c0051c0 2024-04-25T09:55:48.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.103+0000 7f954dd9b640 1 -- 172.21.15.7:0/2064764416 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f953c00c2c0 con 0x7f953c003a00 2024-04-25T09:55:48.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.103+0000 7f954e59c640 1 --2- 172.21.15.7:0/2064764416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f953c004800 0x7f953c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:48.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.103+0000 7f954ed9d640 1 --2- 172.21.15.7:0/2064764416 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f953c003a00 0x7f953c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:48.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.103+0000 7f954f59e640 1 --2- 172.21.15.7:0/2064764416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f953c0051c0 0x7f953c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:48.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.103+0000 7f954e59c640 1 -- 172.21.15.7:0/2064764416 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f953c003a00 msgr2=0x7f953c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:48.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.103+0000 7f954e59c640 1 --2- 172.21.15.7:0/2064764416 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f953c003a00 0x7f953c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:48.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.103+0000 7f954e59c640 1 -- 172.21.15.7:0/2064764416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f953c0051c0 msgr2=0x7f953c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:48.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.103+0000 7f954e59c640 1 --2- 172.21.15.7:0/2064764416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f953c0051c0 0x7f953c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:48.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.103+0000 7f954e59c640 1 -- 172.21.15.7:0/2064764416 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f953c003520 con 0x7f953c004800 2024-04-25T09:55:48.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.103+0000 7f954f59e640 1 -- 172.21.15.7:0/2064764416 reap_dead start 2024-04-25T09:55:48.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.104+0000 7f954e59c640 1 --2- 172.21.15.7:0/2064764416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f953c004800 0x7f953c004c80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9538001750 tx=0x7f953c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eae1534332cc245 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:48.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.104+0000 7f954dd9b640 1 -- 172.21.15.7:0/2064764416 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9538001370 con 0x7f953c004800 2024-04-25T09:55:48.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.104+0000 7f954dd9b640 1 -- 172.21.15.7:0/2064764416 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95380052d0 con 0x7f953c004800 2024-04-25T09:55:48.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.104+0000 7f954dd9b640 1 -- 172.21.15.7:0/2064764416 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953802abc0 con 0x7f953c004800 2024-04-25T09:55:48.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.105+0000 7f95550b3640 1 -- 172.21.15.7:0/2064764416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f953c004800 msgr2=0x7f953c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:48.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.105+0000 7f95550b3640 1 --2- 172.21.15.7:0/2064764416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f953c004800 0x7f953c004c80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9538001750 tx=0x7f953c005830 comp rx=0 tx=0).stop 2024-04-25T09:55:48.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.105+0000 7f95550b3640 1 -- 172.21.15.7:0/2064764416 shutdown_connections 2024-04-25T09:55:48.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.105+0000 7f95550b3640 1 --2- 172.21.15.7:0/2064764416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f953c004800 0x7f953c004c80 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:48.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.105+0000 7f95550b3640 1 -- 172.21.15.7:0/2064764416 >> 172.21.15.7:0/2064764416 conn(0x7f95500b3120 msgr2=0x7f95500b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:48.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.105+0000 7f95550b3640 1 -- 172.21.15.7:0/2064764416 shutdown_connections 2024-04-25T09:55:48.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.105+0000 7f95550b3640 1 -- 172.21.15.7:0/2064764416 wait complete. 2024-04-25T09:55:48.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.106+0000 7f95550b3640 1 Processor -- start 2024-04-25T09:55:48.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.106+0000 7f95550b3640 1 -- start start 2024-04-25T09:55:48.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.107+0000 7f95550b3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f953c004800 0x7f9550149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:48.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.107+0000 7f95550b3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95500b4ff0 0x7f95500afa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:48.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.107+0000 7f95550b3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95500affd0 0x7f95500c7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:48.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.107+0000 7f95550b3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95500d0f00 con 0x7f95500affd0 2024-04-25T09:55:48.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.107+0000 7f95550b3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95500d09e0 con 0x7f95500b4ff0 2024-04-25T09:55:48.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.107+0000 7f95550b3640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95500b4250 con 0x7f953c004800 2024-04-25T09:55:48.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.107+0000 7f954f59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95500affd0 0x7f95500c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:48.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.107+0000 7f954f59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95500affd0 0x7f95500c7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54792/0 (socket says 172.21.15.7:54792) 2024-04-25T09:55:48.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.107+0000 7f954f59e640 1 -- 172.21.15.7:0/2737800474 learned_addr learned my addr 172.21.15.7:0/2737800474 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:48.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.107+0000 7f954ed9d640 1 --2- 172.21.15.7:0/2737800474 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f953c004800 0x7f9550149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:48.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.107+0000 7f954e59c640 1 --2- 172.21.15.7:0/2737800474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95500b4ff0 0x7f95500afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:48.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.107+0000 7f954f59e640 1 -- 172.21.15.7:0/2737800474 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f953c004800 msgr2=0x7f9550149920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:48.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.107+0000 7f954f59e640 1 --2- 172.21.15.7:0/2737800474 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f953c004800 0x7f9550149920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:48.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.107+0000 7f954f59e640 1 -- 172.21.15.7:0/2737800474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95500b4ff0 msgr2=0x7f95500afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:48.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.107+0000 7f954f59e640 1 --2- 172.21.15.7:0/2737800474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95500b4ff0 0x7f95500afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:48.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.107+0000 7f954f59e640 1 -- 172.21.15.7:0/2737800474 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9550149e60 con 0x7f95500affd0 2024-04-25T09:55:48.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.108+0000 7f954f59e640 1 --2- 172.21.15.7:0/2737800474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95500affd0 0x7f95500c7090 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9550072e90 tx=0x7f9540007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:48.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.108+0000 7f95477fe640 1 -- 172.21.15.7:0/2737800474 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954000ab30 con 0x7f95500affd0 2024-04-25T09:55:48.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.108+0000 7f95477fe640 1 -- 172.21.15.7:0/2737800474 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9540019070 con 0x7f95500affd0 2024-04-25T09:55:48.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.108+0000 7f95550b3640 1 -- 172.21.15.7:0/2737800474 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95500c7dc0 con 0x7f95500affd0 2024-04-25T09:55:48.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.108+0000 7f95477fe640 1 -- 172.21.15.7:0/2737800474 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95400133f0 con 0x7f95500affd0 2024-04-25T09:55:48.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.108+0000 7f95550b3640 1 -- 172.21.15.7:0/2737800474 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95500b47f0 con 0x7f95500affd0 2024-04-25T09:55:48.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.109+0000 7f95550b3640 1 -- 172.21.15.7:0/2737800474 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9550068f60 con 0x7f95500affd0 2024-04-25T09:55:48.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.109+0000 7f95477fe640 1 -- 172.21.15.7:0/2737800474 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9540013590 con 0x7f95500affd0 2024-04-25T09:55:48.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.110+0000 7f95477fe640 1 --2- 172.21.15.7:0/2737800474 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f953006b500 0x7f953006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:48.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.110+0000 7f95477fe640 1 -- 172.21.15.7:0/2737800474 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f954008a900 con 0x7f95500affd0 2024-04-25T09:55:48.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.110+0000 7f954ed9d640 1 --2- 172.21.15.7:0/2737800474 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f953006b500 0x7f953006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:48.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.110+0000 7f954ed9d640 1 --2- 172.21.15.7:0/2737800474 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f953006b500 0x7f953006d9c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9548009b00 tx=0x7f9548008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:48.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.114+0000 7f95477fe640 1 -- 172.21.15.7:0/2737800474 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f95400595f0 con 0x7f95500affd0 2024-04-25T09:55:48.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.295+0000 7f95550b3640 1 -- 172.21.15.7:0/2737800474 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f955015c4a0 con 0x7f95500affd0 2024-04-25T09:55:48.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.296+0000 7f95477fe640 1 -- 172.21.15.7:0/2737800474 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9540058ef0 con 0x7f95500affd0 2024-04-25T09:55:48.299 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T09:55:48.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.298+0000 7f95550b3640 1 -- 172.21.15.7:0/2737800474 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f953006b500 msgr2=0x7f953006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:48.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.298+0000 7f95550b3640 1 --2- 172.21.15.7:0/2737800474 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f953006b500 0x7f953006d9c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9548009b00 tx=0x7f9548008040 comp rx=0 tx=0).stop 2024-04-25T09:55:48.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.298+0000 7f95550b3640 1 -- 172.21.15.7:0/2737800474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95500affd0 msgr2=0x7f95500c7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:48.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.298+0000 7f95550b3640 1 --2- 172.21.15.7:0/2737800474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95500affd0 0x7f95500c7090 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9550072e90 tx=0x7f9540007bd0 comp rx=0 tx=0).stop 2024-04-25T09:55:48.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.298+0000 7f95550b3640 1 -- 172.21.15.7:0/2737800474 shutdown_connections 2024-04-25T09:55:48.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.298+0000 7f95550b3640 1 --2- 172.21.15.7:0/2737800474 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f953006b500 0x7f953006d9c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:48.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.298+0000 7f95550b3640 1 --2- 172.21.15.7:0/2737800474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95500affd0 0x7f95500c7090 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:48.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.298+0000 7f95550b3640 1 --2- 172.21.15.7:0/2737800474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95500b4ff0 0x7f95500afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:48.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.298+0000 7f95550b3640 1 --2- 172.21.15.7:0/2737800474 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f953c004800 0x7f9550149920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:48.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.298+0000 7f95550b3640 1 -- 172.21.15.7:0/2737800474 >> 172.21.15.7:0/2737800474 conn(0x7f95500b3120 msgr2=0x7f955006c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:48.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.298+0000 7f95550b3640 1 -- 172.21.15.7:0/2737800474 shutdown_connections 2024-04-25T09:55:48.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.298+0000 7f95550b3640 1 -- 172.21.15.7:0/2737800474 wait complete. 2024-04-25T09:55:48.312 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:55:48.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.410+0000 7f8836b9e640 1 Processor -- start 2024-04-25T09:55:48.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.411+0000 7f8836b9e640 1 -- start start 2024-04-25T09:55:48.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.411+0000 7f8836b9e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f883009ab40 0x7f88300cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:48.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.411+0000 7f8836b9e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f88300999f0 0x7f8830099e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:48.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.411+0000 7f8836b9e640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88300cc060 con 0x7f883015ba20 2024-04-25T09:55:48.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.411+0000 7f8836b9e640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f883015be00 con 0x7f88300999f0 2024-04-25T09:55:48.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.411+0000 7f8836b9e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88300d0320 con 0x7f883009ab40 2024-04-25T09:55:48.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.412+0000 7f8835b9c640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f883015ba20 0x7f88300cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58742/0 (socket says 172.21.15.7:58742) 2024-04-25T09:55:48.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.412+0000 7f8835b9c640 1 -- 172.21.15.7:0/1766806494 learned_addr learned my addr 172.21.15.7:0/1766806494 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:48.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.412+0000 7f883639d640 1 --2- 172.21.15.7:0/1766806494 >> v2:172.21.15.7:3300/0 conn(0x7f88300999f0 0x7f8830099e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:48.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.412+0000 7f883539b640 1 --2- 172.21.15.7:0/1766806494 >> v2:172.21.15.55:3300/0 conn(0x7f883009ab40 0x7f88300cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:48.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.412+0000 7f883639d640 1 -- 172.21.15.7:0/1766806494 >> v2:172.21.15.55:3300/0 conn(0x7f883009ab40 msgr2=0x7f88300cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:48.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.412+0000 7f883639d640 1 --2- 172.21.15.7:0/1766806494 >> v2:172.21.15.55:3300/0 conn(0x7f883009ab40 0x7f88300cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:48.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.412+0000 7f883639d640 1 -- 172.21.15.7:0/1766806494 >> v1:172.21.15.7:6789/0 conn(0x7f883015ba20 legacy=0x7f88300cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:48.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.412+0000 7f8834b9a640 1 -- 172.21.15.7:0/1766806494 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 756418160 0 0) 0x7f88300cc060 con 0x7f883015ba20 2024-04-25T09:55:48.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.412+0000 7f883639d640 1 -- 172.21.15.7:0/1766806494 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88300cc300 con 0x7f88300999f0 2024-04-25T09:55:48.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.413+0000 7f883639d640 1 --2- 172.21.15.7:0/1766806494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88300999f0 0x7f8830099e80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f883006ec00 tx=0x7f882802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa8da338c779d3f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:48.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.413+0000 7f8834b9a640 1 -- 172.21.15.7:0/1766806494 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8828007740 con 0x7f88300999f0 2024-04-25T09:55:48.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.413+0000 7f8834b9a640 1 -- 172.21.15.7:0/1766806494 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88280078e0 con 0x7f88300999f0 2024-04-25T09:55:48.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.413+0000 7f8834b9a640 1 -- 172.21.15.7:0/1766806494 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8828007cb0 con 0x7f88300999f0 2024-04-25T09:55:48.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.413+0000 7f8836b9e640 1 -- 172.21.15.7:0/1766806494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88300999f0 msgr2=0x7f8830099e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:48.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.413+0000 7f8836b9e640 1 --2- 172.21.15.7:0/1766806494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88300999f0 0x7f8830099e80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f883006ec00 tx=0x7f882802a710 comp rx=0 tx=0).stop 2024-04-25T09:55:48.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.413+0000 7f8836b9e640 1 -- 172.21.15.7:0/1766806494 shutdown_connections 2024-04-25T09:55:48.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.413+0000 7f8836b9e640 1 --2- 172.21.15.7:0/1766806494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88300999f0 0x7f8830099e80 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:48.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.413+0000 7f8836b9e640 1 --2- 172.21.15.7:0/1766806494 >> v2:172.21.15.55:3300/0 conn(0x7f883009ab40 0x7f88300cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:48.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.413+0000 7f8836b9e640 1 -- 172.21.15.7:0/1766806494 >> 172.21.15.7:0/1766806494 conn(0x7f88300b2f60 msgr2=0x7f88300b3370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:48.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.413+0000 7f8836b9e640 1 -- 172.21.15.7:0/1766806494 shutdown_connections 2024-04-25T09:55:48.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.413+0000 7f8836b9e640 1 -- 172.21.15.7:0/1766806494 wait complete. 2024-04-25T09:55:48.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.415+0000 7f8836b9e640 1 Processor -- start 2024-04-25T09:55:48.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.415+0000 7f8836b9e640 1 -- start start 2024-04-25T09:55:48.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.415+0000 7f8836b9e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88300999f0 0x7f88300b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:48.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.415+0000 7f8836b9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f883009ab40 0x7f88300b4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:48.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.415+0000 7f8836b9e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f883015ba20 0x7f88301f5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:48.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.415+0000 7f8836b9e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88300ccba0 con 0x7f883015ba20 2024-04-25T09:55:48.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.415+0000 7f8836b9e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88300cc8c0 con 0x7f883009ab40 2024-04-25T09:55:48.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.416+0000 7f8836b9e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88300b0a50 con 0x7f88300999f0 2024-04-25T09:55:48.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.416+0000 7f883639d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f883015ba20 0x7f88301f5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:48.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.416+0000 7f883639d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f883015ba20 0x7f88301f5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54816/0 (socket says 172.21.15.7:54816) 2024-04-25T09:55:48.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.416+0000 7f883639d640 1 -- 172.21.15.7:0/2988264321 learned_addr learned my addr 172.21.15.7:0/2988264321 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:48.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.416+0000 7f8835b9c640 1 --2- 172.21.15.7:0/2988264321 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88300999f0 0x7f88300b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:48.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.416+0000 7f883539b640 1 --2- 172.21.15.7:0/2988264321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f883009ab40 0x7f88300b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:48.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.416+0000 7f883639d640 1 -- 172.21.15.7:0/2988264321 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88300999f0 msgr2=0x7f88300b3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:48.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.416+0000 7f883639d640 1 --2- 172.21.15.7:0/2988264321 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88300999f0 0x7f88300b3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:48.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.416+0000 7f883639d640 1 -- 172.21.15.7:0/2988264321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f883009ab40 msgr2=0x7f88300b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:48.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.416+0000 7f883639d640 1 --2- 172.21.15.7:0/2988264321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f883009ab40 0x7f88300b4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:48.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.416+0000 7f883639d640 1 -- 172.21.15.7:0/2988264321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88300b5080 con 0x7f883015ba20 2024-04-25T09:55:48.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.416+0000 7f883639d640 1 --2- 172.21.15.7:0/2988264321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f883015ba20 0x7f88301f5060 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f882802ad00 tx=0x7f8828004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:48.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.416+0000 7f88267fc640 1 -- 172.21.15.7:0/2988264321 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8828040070 con 0x7f883015ba20 2024-04-25T09:55:48.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.416+0000 7f88267fc640 1 -- 172.21.15.7:0/2988264321 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8828031bc0 con 0x7f883015ba20 2024-04-25T09:55:48.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.416+0000 7f8836b9e640 1 -- 172.21.15.7:0/2988264321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88300b5360 con 0x7f883015ba20 2024-04-25T09:55:48.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.417+0000 7f88267fc640 1 -- 172.21.15.7:0/2988264321 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8828009450 con 0x7f883015ba20 2024-04-25T09:55:48.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.417+0000 7f8836b9e640 1 -- 172.21.15.7:0/2988264321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88301f4b40 con 0x7f883015ba20 2024-04-25T09:55:48.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.417+0000 7f8836b9e640 1 -- 172.21.15.7:0/2988264321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88301f4650 con 0x7f883015ba20 2024-04-25T09:55:48.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.418+0000 7f88267fc640 1 -- 172.21.15.7:0/2988264321 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8828039040 con 0x7f883015ba20 2024-04-25T09:55:48.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.418+0000 7f88267fc640 1 --2- 172.21.15.7:0/2988264321 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f881406b4d0 0x7f881406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:48.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.419+0000 7f88267fc640 1 -- 172.21.15.7:0/2988264321 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f88280aba40 con 0x7f883015ba20 2024-04-25T09:55:48.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.419+0000 7f8835b9c640 1 --2- 172.21.15.7:0/2988264321 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f881406b4d0 0x7f881406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:48.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.419+0000 7f8835b9c640 1 --2- 172.21.15.7:0/2988264321 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f881406b4d0 0x7f881406d990 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f882c007fd0 tx=0x7f882c007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:48.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.423+0000 7f88267fc640 1 -- 172.21.15.7:0/2988264321 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f882807a290 con 0x7f883015ba20 2024-04-25T09:55:48.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.613+0000 7f8836b9e640 1 -- 172.21.15.7:0/2988264321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8830068f60 con 0x7f883015ba20 2024-04-25T09:55:48.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.614+0000 7f88267fc640 1 -- 172.21.15.7:0/2988264321 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v39) v1 ==== 80+0+0 (secure 0 0 0) 0x7f88280abe20 con 0x7f883015ba20 2024-04-25T09:55:48.617 INFO:teuthology.orchestra.run.smithi007.stderr:listed 0 entries 2024-04-25T09:55:48.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.616+0000 7f8836b9e640 1 -- 172.21.15.7:0/2988264321 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f881406b4d0 msgr2=0x7f881406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:48.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.616+0000 7f8836b9e640 1 --2- 172.21.15.7:0/2988264321 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f881406b4d0 0x7f881406d990 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f882c007fd0 tx=0x7f882c007de0 comp rx=0 tx=0).stop 2024-04-25T09:55:48.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.616+0000 7f8836b9e640 1 -- 172.21.15.7:0/2988264321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f883015ba20 msgr2=0x7f88301f5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:48.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.616+0000 7f8836b9e640 1 --2- 172.21.15.7:0/2988264321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f883015ba20 0x7f88301f5060 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f882802ad00 tx=0x7f8828004a40 comp rx=0 tx=0).stop 2024-04-25T09:55:48.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.616+0000 7f8836b9e640 1 -- 172.21.15.7:0/2988264321 shutdown_connections 2024-04-25T09:55:48.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.616+0000 7f8836b9e640 1 --2- 172.21.15.7:0/2988264321 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f881406b4d0 0x7f881406d990 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:48.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.616+0000 7f8836b9e640 1 --2- 172.21.15.7:0/2988264321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f883015ba20 0x7f88301f5060 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:48.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.616+0000 7f8836b9e640 1 --2- 172.21.15.7:0/2988264321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f883009ab40 0x7f88300b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:48.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.616+0000 7f8836b9e640 1 --2- 172.21.15.7:0/2988264321 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88300999f0 0x7f88300b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:48.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.616+0000 7f8836b9e640 1 -- 172.21.15.7:0/2988264321 >> 172.21.15.7:0/2988264321 conn(0x7f88300b2f60 msgr2=0x7f88300ae590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:48.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.616+0000 7f8836b9e640 1 -- 172.21.15.7:0/2988264321 shutdown_connections 2024-04-25T09:55:48.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.616+0000 7f8836b9e640 1 -- 172.21.15.7:0/2988264321 wait complete. 2024-04-25T09:55:48.630 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:55:48.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:48.630 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:55:48.678 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-04-25T09:55:48.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:55:48.679 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:55:48.705 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:55:48.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.843+0000 7f8ee4de0640 1 Processor -- start 2024-04-25T09:55:48.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.843+0000 7f8ee4de0640 1 -- start start 2024-04-25T09:55:48.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.843+0000 7f8ee4de0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ee015eba0 0x7f8ee006fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:48.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.844+0000 7f8ee4de0640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ee01618f0 con 0x7f8ee006ab60 2024-04-25T09:55:48.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.844+0000 7f8ee4de0640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ee0161bd0 con 0x7f8ee015d7b0 2024-04-25T09:55:48.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.844+0000 7f8ee4de0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee0161eb0 con 0x7f8ee015eba0 2024-04-25T09:55:48.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.844+0000 7f8eded9d640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f8ee006ab60 0x7f8ee00b3a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58748/0 (socket says 172.21.15.7:58748) 2024-04-25T09:55:48.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.844+0000 7f8eded9d640 1 -- 172.21.15.7:0/3726215472 learned_addr learned my addr 172.21.15.7:0/3726215472 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:48.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.844+0000 7f8eddd9b640 1 --2- 172.21.15.7:0/3726215472 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ee015eba0 0x7f8ee006fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:48.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.844+0000 7f8edd59a640 1 -- 172.21.15.7:0/3726215472 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1800635277 0 0) 0x7f8ee01618f0 con 0x7f8ee006ab60 2024-04-25T09:55:48.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.844+0000 7f8edd59a640 1 -- 172.21.15.7:0/3726215472 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ecc003520 con 0x7f8ee006ab60 2024-04-25T09:55:48.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.844+0000 7f8edd59a640 1 -- 172.21.15.7:0/3726215472 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2424109899 0 0) 0x7f8ecc003520 con 0x7f8ee006ab60 2024-04-25T09:55:48.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.844+0000 7f8edd59a640 1 -- 172.21.15.7:0/3726215472 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ee015eba0 msgr2=0x7f8ee006fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:48.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.844+0000 7f8edd59a640 1 --2- 172.21.15.7:0/3726215472 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ee015eba0 0x7f8ee006fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:48.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.844+0000 7f8edd59a640 1 -- 172.21.15.7:0/3726215472 >> v1:172.21.15.55:6789/0 conn(0x7f8ee015d7b0 legacy=0x7f8ee00b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:48.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.844+0000 7f8edd59a640 1 -- 172.21.15.7:0/3726215472 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee0162190 con 0x7f8ee006ab60 2024-04-25T09:55:48.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.844+0000 7f8edd59a640 1 -- 172.21.15.7:0/3726215472 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f8ed8001670 con 0x7f8ee006ab60 2024-04-25T09:55:48.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.844+0000 7f8edd59a640 1 -- 172.21.15.7:0/3726215472 >> v1:172.21.15.7:6789/0 conn(0x7f8ee006ab60 legacy=0x7f8ee00b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:48.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.844+0000 7f8edd59a640 1 --2- 172.21.15.7:0/3726215472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ecc0039e0 0x7f8ecc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:48.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.844+0000 7f8edd59a640 1 --2- 172.21.15.7:0/3726215472 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ee015eba0 0x7f8ecc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:48.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.844+0000 7f8edd59a640 1 --2- 172.21.15.7:0/3726215472 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ecc004d40 0x7f8ecc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:48.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.844+0000 7f8edd59a640 1 -- 172.21.15.7:0/3726215472 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee0161eb0 con 0x7f8ecc0039e0 2024-04-25T09:55:48.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.844+0000 7f8edd59a640 1 -- 172.21.15.7:0/3726215472 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc00b9f0 con 0x7f8ecc004d40 2024-04-25T09:55:48.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.844+0000 7f8edd59a640 1 -- 172.21.15.7:0/3726215472 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc00bbf0 con 0x7f8ee015eba0 2024-04-25T09:55:48.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.844+0000 7f8ede59c640 1 --2- 172.21.15.7:0/3726215472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ecc0039e0 0x7f8ecc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:48.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.845+0000 7f8eddd9b640 1 --2- 172.21.15.7:0/3726215472 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ee015eba0 0x7f8ecc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:48.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.845+0000 7f8eded9d640 1 --2- 172.21.15.7:0/3726215472 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ecc004d40 0x7f8ecc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:48.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.845+0000 7f8ede59c640 1 -- 172.21.15.7:0/3726215472 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ee015eba0 msgr2=0x7f8ecc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:48.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.845+0000 7f8ede59c640 1 --2- 172.21.15.7:0/3726215472 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ee015eba0 0x7f8ecc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:48.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.845+0000 7f8ede59c640 1 -- 172.21.15.7:0/3726215472 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ecc004d40 msgr2=0x7f8ecc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:48.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.845+0000 7f8ede59c640 1 --2- 172.21.15.7:0/3726215472 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ecc004d40 0x7f8ecc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:48.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.845+0000 7f8ede59c640 1 -- 172.21.15.7:0/3726215472 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ecc003520 con 0x7f8ecc0039e0 2024-04-25T09:55:48.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.846+0000 7f8ede59c640 1 --2- 172.21.15.7:0/3726215472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ecc0039e0 0x7f8ecc003dc0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0001f60 tx=0x7f8ecc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8701c1b2f03dda server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:48.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.846+0000 7f8edd59a640 1 -- 172.21.15.7:0/3726215472 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed0037070 con 0x7f8ecc0039e0 2024-04-25T09:55:48.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.846+0000 7f8edd59a640 1 -- 172.21.15.7:0/3726215472 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed0032440 con 0x7f8ecc0039e0 2024-04-25T09:55:48.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.846+0000 7f8edd59a640 1 -- 172.21.15.7:0/3726215472 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed0001b30 con 0x7f8ecc0039e0 2024-04-25T09:55:48.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.846+0000 7f8ee4de0640 1 -- 172.21.15.7:0/3726215472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ecc0039e0 msgr2=0x7f8ecc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:48.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.846+0000 7f8ee4de0640 1 --2- 172.21.15.7:0/3726215472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ecc0039e0 0x7f8ecc003dc0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0001f60 tx=0x7f8ecc005830 comp rx=0 tx=0).stop 2024-04-25T09:55:48.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.846+0000 7f8eded9d640 1 -- 172.21.15.7:0/3726215472 reap_dead start 2024-04-25T09:55:48.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.846+0000 7f8ee4de0640 1 -- 172.21.15.7:0/3726215472 shutdown_connections 2024-04-25T09:55:48.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.846+0000 7f8ee4de0640 1 -- 172.21.15.7:0/3726215472 >> 172.21.15.7:0/3726215472 conn(0x7f8ee00b2390 msgr2=0x7f8ee00b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:48.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.846+0000 7f8ee4de0640 1 -- 172.21.15.7:0/3726215472 shutdown_connections 2024-04-25T09:55:48.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.846+0000 7f8ee4de0640 1 -- 172.21.15.7:0/3726215472 wait complete. 2024-04-25T09:55:48.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.848+0000 7f8ee4de0640 1 Processor -- start 2024-04-25T09:55:48.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.848+0000 7f8ee4de0640 1 -- start start 2024-04-25T09:55:48.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.849+0000 7f8ee4de0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ecc0039e0 0x7f8ee00a8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:48.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.849+0000 7f8ee4de0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ee01f73a0 0x7f8ee014cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:48.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.849+0000 7f8ee4de0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ee00aa3f0 0x7f8ee00aa870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:48.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.849+0000 7f8ee4de0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee0161690 con 0x7f8ecc0039e0 2024-04-25T09:55:48.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.849+0000 7f8ee4de0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee0161510 con 0x7f8ee01f73a0 2024-04-25T09:55:48.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.849+0000 7f8ee4de0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee006fa00 con 0x7f8ee00aa3f0 2024-04-25T09:55:48.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.849+0000 7f8ede59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ecc0039e0 0x7f8ee00a8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:48.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.849+0000 7f8ede59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ecc0039e0 0x7f8ee00a8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54840/0 (socket says 172.21.15.7:54840) 2024-04-25T09:55:48.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.849+0000 7f8ede59c640 1 -- 172.21.15.7:0/2208501463 learned_addr learned my addr 172.21.15.7:0/2208501463 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:48.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.849+0000 7f8eddd9b640 1 --2- 172.21.15.7:0/2208501463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ee01f73a0 0x7f8ee014cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:48.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.849+0000 7f8eded9d640 1 --2- 172.21.15.7:0/2208501463 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ee00aa3f0 0x7f8ee00aa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:48.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.849+0000 7f8ede59c640 1 -- 172.21.15.7:0/2208501463 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ee00aa3f0 msgr2=0x7f8ee00aa870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:48.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.849+0000 7f8ede59c640 1 --2- 172.21.15.7:0/2208501463 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ee00aa3f0 0x7f8ee00aa870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:48.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.849+0000 7f8ede59c640 1 -- 172.21.15.7:0/2208501463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ee01f73a0 msgr2=0x7f8ee014cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:48.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.849+0000 7f8ede59c640 1 --2- 172.21.15.7:0/2208501463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ee01f73a0 0x7f8ee014cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:48.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.849+0000 7f8ede59c640 1 -- 172.21.15.7:0/2208501463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee01f7800 con 0x7f8ecc0039e0 2024-04-25T09:55:48.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.849+0000 7f8eddd9b640 1 --2- 172.21.15.7:0/2208501463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ee01f73a0 0x7f8ee014cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:48.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.849+0000 7f8eded9d640 1 --2- 172.21.15.7:0/2208501463 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ee00aa3f0 0x7f8ee00aa870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:48.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.849+0000 7f8ede59c640 1 --2- 172.21.15.7:0/2208501463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ecc0039e0 0x7f8ee00a8450 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8ed002a970 tx=0x7f8ed00015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:48.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.849+0000 7f8ed6ffd640 1 -- 172.21.15.7:0/2208501463 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed0037040 con 0x7f8ecc0039e0 2024-04-25T09:55:48.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.849+0000 7f8ed6ffd640 1 -- 172.21.15.7:0/2208501463 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed0041070 con 0x7f8ecc0039e0 2024-04-25T09:55:48.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.849+0000 7f8ee4de0640 1 -- 172.21.15.7:0/2208501463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee00a8ae0 con 0x7f8ecc0039e0 2024-04-25T09:55:48.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.849+0000 7f8ed6ffd640 1 -- 172.21.15.7:0/2208501463 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed0003970 con 0x7f8ecc0039e0 2024-04-25T09:55:48.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.849+0000 7f8ee4de0640 1 -- 172.21.15.7:0/2208501463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee00a90a0 con 0x7f8ecc0039e0 2024-04-25T09:55:48.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.850+0000 7f8ee4de0640 1 -- 172.21.15.7:0/2208501463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee0068fd0 con 0x7f8ecc0039e0 2024-04-25T09:55:48.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.851+0000 7f8ed6ffd640 1 -- 172.21.15.7:0/2208501463 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8ed0003b10 con 0x7f8ecc0039e0 2024-04-25T09:55:48.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.851+0000 7f8ed6ffd640 1 --2- 172.21.15.7:0/2208501463 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8ec006b4d0 0x7f8ec006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:48.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.851+0000 7f8ed6ffd640 1 -- 172.21.15.7:0/2208501463 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8ed00aa8e0 con 0x7f8ecc0039e0 2024-04-25T09:55:48.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.851+0000 7f8eddd9b640 1 --2- 172.21.15.7:0/2208501463 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8ec006b4d0 0x7f8ec006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:48.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.852+0000 7f8eddd9b640 1 --2- 172.21.15.7:0/2208501463 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8ec006b4d0 0x7f8ec006d990 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8ee00cb540 tx=0x7f8ec8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:48.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:48.855+0000 7f8ed6ffd640 1 -- 172.21.15.7:0/2208501463 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8ed00795e0 con 0x7f8ecc0039e0 2024-04-25T09:55:49.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.072+0000 7f8ee4de0640 1 -- 172.21.15.7:0/2208501463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ee00b00e0 con 0x7f8ecc0039e0 2024-04-25T09:55:49.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.073+0000 7f8ed6ffd640 1 -- 172.21.15.7:0/2208501463 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4929 (secure 0 0 0) 0x7f8ed0078ee0 con 0x7f8ecc0039e0 2024-04-25T09:55:49.076 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:49.076 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5047,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2022061608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2022061608},{"type":"v1","addr":"172.21.15.55:6834","nonce":2022061608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5382,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/2607466795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2607466795},{"type":"v1","addr":"172.21.15.7:6836","nonce":2607466795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5385,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1576325055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1576325055},{"type":"v1","addr":"172.21.15.7:6837","nonce":1576325055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:55:35.091962+0000","modified":"2024-04-25T09:55:37.095949+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5391":{"gid":5391,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/223801838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":223801838},{"type":"v1","addr":"172.21.15.55:6835","nonce":223801838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T09:55:49.076 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 15 2024-04-25T09:55:49.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.074+0000 7f8ee4de0640 1 -- 172.21.15.7:0/2208501463 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8ec006b4d0 msgr2=0x7f8ec006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:49.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.074+0000 7f8ee4de0640 1 --2- 172.21.15.7:0/2208501463 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8ec006b4d0 0x7f8ec006d990 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8ee00cb540 tx=0x7f8ec8008040 comp rx=0 tx=0).stop 2024-04-25T09:55:49.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.074+0000 7f8ee4de0640 1 -- 172.21.15.7:0/2208501463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ecc0039e0 msgr2=0x7f8ee00a8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:49.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.074+0000 7f8ee4de0640 1 --2- 172.21.15.7:0/2208501463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ecc0039e0 0x7f8ee00a8450 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8ed002a970 tx=0x7f8ed00015b0 comp rx=0 tx=0).stop 2024-04-25T09:55:49.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.075+0000 7f8ee4de0640 1 -- 172.21.15.7:0/2208501463 shutdown_connections 2024-04-25T09:55:49.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.075+0000 7f8ee4de0640 1 --2- 172.21.15.7:0/2208501463 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8ec006b4d0 0x7f8ec006d990 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:49.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.075+0000 7f8ee4de0640 1 --2- 172.21.15.7:0/2208501463 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ee00aa3f0 0x7f8ee00aa870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:49.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.075+0000 7f8ee4de0640 1 --2- 172.21.15.7:0/2208501463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ee01f73a0 0x7f8ee014cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:49.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.075+0000 7f8ee4de0640 1 --2- 172.21.15.7:0/2208501463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ecc0039e0 0x7f8ee00a8450 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:49.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.075+0000 7f8ee4de0640 1 -- 172.21.15.7:0/2208501463 >> 172.21.15.7:0/2208501463 conn(0x7f8ee00b2390 msgr2=0x7f8ee00cfa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:49.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.075+0000 7f8ee4de0640 1 -- 172.21.15.7:0/2208501463 shutdown_connections 2024-04-25T09:55:49.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.075+0000 7f8ee4de0640 1 -- 172.21.15.7:0/2208501463 wait complete. 2024-04-25T09:55:49.089 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-04-25T09:55:49.233 INFO:teuthology.orchestra.run.smithi055.stdout:{"message":"","return_code":0} 2024-04-25T09:55:49.233 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T09:55:49.233 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:55:49.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.332+0000 7ff07b807640 1 Processor -- start 2024-04-25T09:55:49.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.332+0000 7ff07b807640 1 -- start start 2024-04-25T09:55:49.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.333+0000 7ff07b807640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff07415dd00 0x7ff0740b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:49.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.333+0000 7ff07b807640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff0740b6a40 0x7ff0740b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:49.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.333+0000 7ff07b807640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff07406cd00 con 0x7ff07406bfb0 2024-04-25T09:55:49.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.333+0000 7ff07b807640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff07415e0e0 con 0x7ff0740b6a40 2024-04-25T09:55:49.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.333+0000 7ff07b807640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07406cfe0 con 0x7ff07415dd00 2024-04-25T09:55:49.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.333+0000 7ff079da4640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff07406bfb0 0x7ff07406c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58754/0 (socket says 172.21.15.7:58754) 2024-04-25T09:55:49.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.333+0000 7ff079da4640 1 -- 172.21.15.7:0/1967879636 learned_addr learned my addr 172.21.15.7:0/1967879636 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:55:49.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.333+0000 7ff078da2640 1 --2- 172.21.15.7:0/1967879636 >> v2:172.21.15.55:3300/0 conn(0x7ff0740b6a40 0x7ff0740b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:49.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.333+0000 7ff0795a3640 1 --2- 172.21.15.7:0/1967879636 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff07415dd00 0x7ff0740b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:49.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.333+0000 7ff06bfff640 1 -- 172.21.15.7:0/1967879636 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1758169654 0 0) 0x7ff07406cd00 con 0x7ff07406bfb0 2024-04-25T09:55:49.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.333+0000 7ff06bfff640 1 -- 172.21.15.7:0/1967879636 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff060003520 con 0x7ff07406bfb0 2024-04-25T09:55:49.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.333+0000 7ff06bfff640 1 -- 172.21.15.7:0/1967879636 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2702575277 0 0) 0x7ff060003520 con 0x7ff07406bfb0 2024-04-25T09:55:49.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.333+0000 7ff06bfff640 1 -- 172.21.15.7:0/1967879636 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff07415dd00 msgr2=0x7ff0740b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:49.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.333+0000 7ff06bfff640 1 --2- 172.21.15.7:0/1967879636 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff07415dd00 0x7ff0740b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:49.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.333+0000 7ff06bfff640 1 -- 172.21.15.7:0/1967879636 >> v2:172.21.15.55:3300/0 conn(0x7ff0740b6a40 msgr2=0x7ff0740b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:49.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.333+0000 7ff06bfff640 1 --2- 172.21.15.7:0/1967879636 >> v2:172.21.15.55:3300/0 conn(0x7ff0740b6a40 0x7ff0740b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:49.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.333+0000 7ff06bfff640 1 -- 172.21.15.7:0/1967879636 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0740d1ca0 con 0x7ff07406bfb0 2024-04-25T09:55:49.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.333+0000 7ff06bfff640 1 -- 172.21.15.7:0/1967879636 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7ff06c0019f0 con 0x7ff07406bfb0 2024-04-25T09:55:49.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.333+0000 7ff078da2640 1 --2- 172.21.15.7:0/1967879636 >> v2:172.21.15.55:3300/0 conn(0x7ff0740b6a40 0x7ff0740b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:55:49.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.333+0000 7ff06bfff640 1 -- 172.21.15.7:0/1967879636 >> v1:172.21.15.7:6789/0 conn(0x7ff07406bfb0 legacy=0x7ff07406c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:49.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.333+0000 7ff06bfff640 1 --2- 172.21.15.7:0/1967879636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0600039b0 0x7ff060003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:49.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.333+0000 7ff06bfff640 1 --2- 172.21.15.7:0/1967879636 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff07415dd00 0x7ff060004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:49.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.333+0000 7ff06bfff640 1 --2- 172.21.15.7:0/1967879636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff060004d40 0x7ff0600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:49.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.333+0000 7ff06bfff640 1 -- 172.21.15.7:0/1967879636 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07415e0e0 con 0x7ff060004d40 2024-04-25T09:55:49.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.333+0000 7ff06bfff640 1 -- 172.21.15.7:0/1967879636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07406cfe0 con 0x7ff0600039b0 2024-04-25T09:55:49.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.333+0000 7ff06bfff640 1 -- 172.21.15.7:0/1967879636 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06000b9c0 con 0x7ff07415dd00 2024-04-25T09:55:49.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.334+0000 7ff079da4640 1 --2- 172.21.15.7:0/1967879636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff060004d40 0x7ff0600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:49.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.334+0000 7ff078da2640 1 --2- 172.21.15.7:0/1967879636 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff07415dd00 0x7ff060004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:49.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.334+0000 7ff0795a3640 1 --2- 172.21.15.7:0/1967879636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0600039b0 0x7ff060003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:49.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.334+0000 7ff079da4640 1 -- 172.21.15.7:0/1967879636 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff07415dd00 msgr2=0x7ff060004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:49.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.334+0000 7ff079da4640 1 --2- 172.21.15.7:0/1967879636 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff07415dd00 0x7ff060004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:49.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.334+0000 7ff079da4640 1 -- 172.21.15.7:0/1967879636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0600039b0 msgr2=0x7ff060003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:49.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.334+0000 7ff079da4640 1 --2- 172.21.15.7:0/1967879636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0600039b0 0x7ff060003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:49.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.334+0000 7ff079da4640 1 -- 172.21.15.7:0/1967879636 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff060003520 con 0x7ff060004d40 2024-04-25T09:55:49.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.335+0000 7ff079da4640 1 --2- 172.21.15.7:0/1967879636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff060004d40 0x7ff0600051c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff06c00a8a0 tx=0x7ff060005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2553addf9c2a4ab1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:49.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.335+0000 7ff06bfff640 1 -- 172.21.15.7:0/1967879636 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c00a4c0 con 0x7ff060004d40 2024-04-25T09:55:49.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.335+0000 7ff06bfff640 1 -- 172.21.15.7:0/1967879636 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06c02f070 con 0x7ff060004d40 2024-04-25T09:55:49.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.335+0000 7ff06bfff640 1 -- 172.21.15.7:0/1967879636 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c02bd30 con 0x7ff060004d40 2024-04-25T09:55:49.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.335+0000 7ff07b807640 1 -- 172.21.15.7:0/1967879636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff060004d40 msgr2=0x7ff0600051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:49.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.335+0000 7ff07b807640 1 --2- 172.21.15.7:0/1967879636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff060004d40 0x7ff0600051c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff06c00a8a0 tx=0x7ff060005830 comp rx=0 tx=0).stop 2024-04-25T09:55:49.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.335+0000 7ff079da4640 1 -- 172.21.15.7:0/1967879636 reap_dead start 2024-04-25T09:55:49.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.335+0000 7ff07b807640 1 -- 172.21.15.7:0/1967879636 shutdown_connections 2024-04-25T09:55:49.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.335+0000 7ff07b807640 1 -- 172.21.15.7:0/1967879636 >> 172.21.15.7:0/1967879636 conn(0x7ff0740d07b0 msgr2=0x7ff0740d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:49.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.335+0000 7ff07b807640 1 -- 172.21.15.7:0/1967879636 shutdown_connections 2024-04-25T09:55:49.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.335+0000 7ff07b807640 1 -- 172.21.15.7:0/1967879636 wait complete. 2024-04-25T09:55:49.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.337+0000 7ff07b807640 1 Processor -- start 2024-04-25T09:55:49.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.337+0000 7ff07b807640 1 -- start start 2024-04-25T09:55:49.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.337+0000 7ff07b807640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff060004d40 0x7ff0740c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:49.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.337+0000 7ff07b807640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff074153ca0 0x7ff074154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:49.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.337+0000 7ff07b807640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0740cc600 0x7ff0740cca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:49.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.337+0000 7ff07b807640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0740b5750 con 0x7ff060004d40 2024-04-25T09:55:49.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.337+0000 7ff07b807640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0740d2260 con 0x7ff0740cc600 2024-04-25T09:55:49.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.337+0000 7ff07b807640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0740b58d0 con 0x7ff074153ca0 2024-04-25T09:55:49.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.337+0000 7ff0795a3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff060004d40 0x7ff0740c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:49.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.337+0000 7ff0795a3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff060004d40 0x7ff0740c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54856/0 (socket says 172.21.15.7:54856) 2024-04-25T09:55:49.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.337+0000 7ff0795a3640 1 -- 172.21.15.7:0/2338966541 learned_addr learned my addr 172.21.15.7:0/2338966541 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:49.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.338+0000 7ff0795a3640 1 -- 172.21.15.7:0/2338966541 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff074153ca0 msgr2=0x7ff074154120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:49.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.338+0000 7ff078da2640 1 --2- 172.21.15.7:0/2338966541 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff074153ca0 0x7ff074154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:49.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.338+0000 7ff079da4640 1 --2- 172.21.15.7:0/2338966541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0740cc600 0x7ff0740cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:49.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.338+0000 7ff0795a3640 1 --2- 172.21.15.7:0/2338966541 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff074153ca0 0x7ff074154120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:49.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.338+0000 7ff0795a3640 1 -- 172.21.15.7:0/2338966541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0740cc600 msgr2=0x7ff0740cca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:49.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.338+0000 7ff0795a3640 1 --2- 172.21.15.7:0/2338966541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0740cc600 0x7ff0740cca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:49.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.338+0000 7ff0795a3640 1 -- 172.21.15.7:0/2338966541 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0740cd2f0 con 0x7ff060004d40 2024-04-25T09:55:49.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.338+0000 7ff078da2640 1 --2- 172.21.15.7:0/2338966541 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff074153ca0 0x7ff074154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:55:49.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.338+0000 7ff0795a3640 1 --2- 172.21.15.7:0/2338966541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff060004d40 0x7ff0740c9040 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff0700118e0 tx=0x7ff070011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:49.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.338+0000 7ff069ffb640 1 -- 172.21.15.7:0/2338966541 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07000fa90 con 0x7ff060004d40 2024-04-25T09:55:49.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.338+0000 7ff069ffb640 1 -- 172.21.15.7:0/2338966541 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07000fc30 con 0x7ff060004d40 2024-04-25T09:55:49.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.338+0000 7ff07b807640 1 -- 172.21.15.7:0/2338966541 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0740cd5d0 con 0x7ff060004d40 2024-04-25T09:55:49.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.338+0000 7ff069ffb640 1 -- 172.21.15.7:0/2338966541 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff070014440 con 0x7ff060004d40 2024-04-25T09:55:49.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.338+0000 7ff07b807640 1 -- 172.21.15.7:0/2338966541 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff074151a60 con 0x7ff060004d40 2024-04-25T09:55:49.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.339+0000 7ff07b807640 1 -- 172.21.15.7:0/2338966541 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff074068fd0 con 0x7ff060004d40 2024-04-25T09:55:49.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.340+0000 7ff069ffb640 1 -- 172.21.15.7:0/2338966541 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff070012040 con 0x7ff060004d40 2024-04-25T09:55:49.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.340+0000 7ff069ffb640 1 --2- 172.21.15.7:0/2338966541 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff05806b500 0x7ff05806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:49.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.340+0000 7ff069ffb640 1 -- 172.21.15.7:0/2338966541 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff07008a8e0 con 0x7ff060004d40 2024-04-25T09:55:49.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.340+0000 7ff078da2640 1 --2- 172.21.15.7:0/2338966541 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff05806b500 0x7ff05806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:49.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.341+0000 7ff078da2640 1 --2- 172.21.15.7:0/2338966541 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff05806b500 0x7ff05806d9c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff07414ff30 tx=0x7ff064008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:49.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.344+0000 7ff069ffb640 1 -- 172.21.15.7:0/2338966541 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff070019030 con 0x7ff060004d40 2024-04-25T09:55:49.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.561+0000 7ff07b807640 1 -- 172.21.15.7:0/2338966541 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0740d1620 con 0x7ff060004d40 2024-04-25T09:55:49.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.561+0000 7ff069ffb640 1 -- 172.21.15.7:0/2338966541 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4929 (secure 0 0 0) 0x7ff070059010 con 0x7ff060004d40 2024-04-25T09:55:49.565 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:55:49.566 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5047,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2022061608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2022061608},{"type":"v1","addr":"172.21.15.55:6834","nonce":2022061608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5382,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/2607466795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2607466795},{"type":"v1","addr":"172.21.15.7:6836","nonce":2607466795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5385,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1576325055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1576325055},{"type":"v1","addr":"172.21.15.7:6837","nonce":1576325055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:55:35.091962+0000","modified":"2024-04-25T09:55:37.095949+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5391":{"gid":5391,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/223801838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":223801838},{"type":"v1","addr":"172.21.15.55:6835","nonce":223801838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T09:55:49.567 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 15 2024-04-25T09:55:49.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.563+0000 7ff07b807640 1 -- 172.21.15.7:0/2338966541 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff05806b500 msgr2=0x7ff05806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:49.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.563+0000 7ff07b807640 1 --2- 172.21.15.7:0/2338966541 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff05806b500 0x7ff05806d9c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff07414ff30 tx=0x7ff064008040 comp rx=0 tx=0).stop 2024-04-25T09:55:49.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.563+0000 7ff07b807640 1 -- 172.21.15.7:0/2338966541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff060004d40 msgr2=0x7ff0740c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:49.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.563+0000 7ff07b807640 1 --2- 172.21.15.7:0/2338966541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff060004d40 0x7ff0740c9040 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff0700118e0 tx=0x7ff070011da0 comp rx=0 tx=0).stop 2024-04-25T09:55:49.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.563+0000 7ff07b807640 1 -- 172.21.15.7:0/2338966541 shutdown_connections 2024-04-25T09:55:49.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.563+0000 7ff07b807640 1 --2- 172.21.15.7:0/2338966541 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff05806b500 0x7ff05806d9c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:49.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.563+0000 7ff07b807640 1 --2- 172.21.15.7:0/2338966541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0740cc600 0x7ff0740cca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:49.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.563+0000 7ff07b807640 1 --2- 172.21.15.7:0/2338966541 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff074153ca0 0x7ff074154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:49.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.563+0000 7ff07b807640 1 --2- 172.21.15.7:0/2338966541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff060004d40 0x7ff0740c9040 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:49.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.563+0000 7ff07b807640 1 -- 172.21.15.7:0/2338966541 >> 172.21.15.7:0/2338966541 conn(0x7ff0740d07b0 msgr2=0x7ff0740b6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:49.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.563+0000 7ff07b807640 1 -- 172.21.15.7:0/2338966541 shutdown_connections 2024-04-25T09:55:49.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:49.563+0000 7ff07b807640 1 -- 172.21.15.7:0/2338966541 wait complete. 2024-04-25T09:55:49.578 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json tag path /parentdir mytag 2024-04-25T09:55:49.709 INFO:teuthology.orchestra.run.smithi055.stdout:{"return_code":0,"scrub_tag":"mytag","mode":"asynchronous"} 2024-04-25T09:55:49.709 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag" } 2024-04-25T09:55:56.225 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:55:56.229 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:55:59.710 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000000.00000000 scrub_tag 2024-04-25T09:55:59.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.760+0000 7fc267f78f40 1 Processor -- start 2024-04-25T09:55:59.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.760+0000 7fc267f78f40 1 -- start start 2024-04-25T09:55:59.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.761+0000 7fc267f78f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc250002460 0x5592c357dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.761+0000 7fc267f78f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5592c3650c50 0x5592c357bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.761+0000 7fc267f78f40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5592c35c5040 0x5592c364d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.761+0000 7fc267f78f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592c3523df0 con 0x7fc250002460 2024-04-25T09:55:59.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.761+0000 7fc267f78f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592c3527d50 con 0x5592c3650c50 2024-04-25T09:55:59.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.761+0000 7fc267f78f40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5592c3580940 con 0x5592c35c5040 2024-04-25T09:55:59.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.761+0000 7fc265a7b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc250002460 0x5592c357dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.761+0000 7fc265a7b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc250002460 0x5592c357dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35044/0 (socket says 172.21.15.7:35044) 2024-04-25T09:55:59.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.761+0000 7fc265a7b640 1 -- 172.21.15.7:0/1355195410 learned_addr learned my addr 172.21.15.7:0/1355195410 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:59.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.761+0000 7fc26527a640 1 --2- 172.21.15.7:0/1355195410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5592c3650c50 0x5592c357bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.761+0000 7fc26627c640 1 --2- 172.21.15.7:0/1355195410 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5592c35c5040 0x5592c364d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.761+0000 7fc265a7b640 1 -- 172.21.15.7:0/1355195410 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5592c35c5040 msgr2=0x5592c364d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.761+0000 7fc265a7b640 1 --2- 172.21.15.7:0/1355195410 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5592c35c5040 0x5592c364d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.761+0000 7fc265a7b640 1 -- 172.21.15.7:0/1355195410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5592c3650c50 msgr2=0x5592c357bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.761+0000 7fc265a7b640 1 --2- 172.21.15.7:0/1355195410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5592c3650c50 0x5592c357bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.761+0000 7fc265a7b640 1 -- 172.21.15.7:0/1355195410 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592c35c42e0 con 0x7fc250002460 2024-04-25T09:55:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.762+0000 7fc265a7b640 1 --2- 172.21.15.7:0/1355195410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc250002460 0x5592c357dbf0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc258025a10 tx=0x7fc258052000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd14b8758264e5ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.762+0000 7fc257fff640 1 -- 172.21.15.7:0/1355195410 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc258052830 con 0x7fc250002460 2024-04-25T09:55:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.762+0000 7fc257fff640 1 -- 172.21.15.7:0/1355195410 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc258063070 con 0x7fc250002460 2024-04-25T09:55:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.762+0000 7fc257fff640 1 -- 172.21.15.7:0/1355195410 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc258052bd0 con 0x7fc250002460 2024-04-25T09:55:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.762+0000 7fc267f78f40 1 -- 172.21.15.7:0/1355195410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc250002460 msgr2=0x5592c357dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.762+0000 7fc267f78f40 1 --2- 172.21.15.7:0/1355195410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc250002460 0x5592c357dbf0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc258025a10 tx=0x7fc258052000 comp rx=0 tx=0).stop 2024-04-25T09:55:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.763+0000 7fc267f78f40 1 -- 172.21.15.7:0/1355195410 shutdown_connections 2024-04-25T09:55:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.763+0000 7fc267f78f40 1 --2- 172.21.15.7:0/1355195410 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5592c35c5040 0x5592c364d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.763+0000 7fc267f78f40 1 --2- 172.21.15.7:0/1355195410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5592c3650c50 0x5592c357bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.763+0000 7fc267f78f40 1 --2- 172.21.15.7:0/1355195410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc250002460 0x5592c357dbf0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.763+0000 7fc267f78f40 1 -- 172.21.15.7:0/1355195410 >> 172.21.15.7:0/1355195410 conn(0x5592c35aa2b0 msgr2=0x5592c35a9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.763+0000 7fc267f78f40 1 -- 172.21.15.7:0/1355195410 shutdown_connections 2024-04-25T09:55:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.763+0000 7fc267f78f40 1 -- 172.21.15.7:0/1355195410 wait complete. 2024-04-25T09:55:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.763+0000 7fc267f78f40 1 Processor -- start 2024-04-25T09:55:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.763+0000 7fc267f78f40 1 -- start start 2024-04-25T09:55:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.764+0000 7fc267f78f40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5592c35c5040 0x5592c36e4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.764+0000 7fc267f78f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592c3650c50 0x5592c357c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.764+0000 7fc267f78f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc250002460 0x5592c364ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.764+0000 7fc267f78f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592c35c05a0 con 0x5592c3650c50 2024-04-25T09:55:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.764+0000 7fc267f78f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592c35c2030 con 0x7fc250002460 2024-04-25T09:55:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.764+0000 7fc267f78f40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5592c35c4000 con 0x5592c35c5040 2024-04-25T09:55:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.764+0000 7fc26527a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592c3650c50 0x5592c357c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.764+0000 7fc26527a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592c3650c50 0x5592c357c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35052/0 (socket says 172.21.15.7:35052) 2024-04-25T09:55:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.764+0000 7fc26527a640 1 -- 172.21.15.7:0/2311122597 learned_addr learned my addr 172.21.15.7:0/2311122597 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.764+0000 7fc265a7b640 1 --2- 172.21.15.7:0/2311122597 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5592c35c5040 0x5592c36e4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.764+0000 7fc26627c640 1 --2- 172.21.15.7:0/2311122597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc250002460 0x5592c364ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.765+0000 7fc26527a640 1 -- 172.21.15.7:0/2311122597 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5592c35c5040 msgr2=0x5592c36e4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.765+0000 7fc26527a640 1 --2- 172.21.15.7:0/2311122597 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5592c35c5040 0x5592c36e4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.765+0000 7fc26527a640 1 -- 172.21.15.7:0/2311122597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc250002460 msgr2=0x5592c364ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.765+0000 7fc26527a640 1 --2- 172.21.15.7:0/2311122597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc250002460 0x5592c364ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.765+0000 7fc26527a640 1 -- 172.21.15.7:0/2311122597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592c357c5b0 con 0x5592c3650c50 2024-04-25T09:55:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.765+0000 7fc26527a640 1 --2- 172.21.15.7:0/2311122597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592c3650c50 0x5592c357c070 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc25c008a40 tx=0x7fc25c008b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.765+0000 7fc256ffd640 1 -- 172.21.15.7:0/2311122597 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25c013a80 con 0x5592c3650c50 2024-04-25T09:55:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.765+0000 7fc256ffd640 1 -- 172.21.15.7:0/2311122597 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25c013c20 con 0x5592c3650c50 2024-04-25T09:55:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.765+0000 7fc267f78f40 1 -- 172.21.15.7:0/2311122597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5592c364c450 con 0x5592c3650c50 2024-04-25T09:55:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.765+0000 7fc256ffd640 1 -- 172.21.15.7:0/2311122597 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25c016420 con 0x5592c3650c50 2024-04-25T09:55:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.765+0000 7fc267f78f40 1 -- 172.21.15.7:0/2311122597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5592c36e4740 con 0x5592c3650c50 2024-04-25T09:55:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.767+0000 7fc256ffd640 1 -- 172.21.15.7:0/2311122597 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc25c0165c0 con 0x5592c3650c50 2024-04-25T09:55:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.767+0000 7fc256ffd640 1 --2- 172.21.15.7:0/2311122597 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc248069ee0 0x7fc24806c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.767+0000 7fc256ffd640 1 -- 172.21.15.7:0/2311122597 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc25c089ff0 con 0x5592c3650c50 2024-04-25T09:55:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.767+0000 7fc265a7b640 1 --2- 172.21.15.7:0/2311122597 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc248069ee0 0x7fc24806c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.768+0000 7fc267f78f40 1 --2- 172.21.15.7:0/2311122597 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x5592c35a9a40 0x5592c36eae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.768+0000 7fc267f78f40 1 -- 172.21.15.7:0/2311122597 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:1 5.10 5:0cf6ad0f:::10000000000.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39) v9 -- 0x5592c36eb3a0 con 0x5592c35a9a40 2024-04-25T09:55:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.768+0000 7fc26627c640 1 --2- 172.21.15.7:0/2311122597 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x5592c35a9a40 0x5592c36eae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.768+0000 7fc265a7b640 1 --2- 172.21.15.7:0/2311122597 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc248069ee0 0x7fc24806c3a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc258000f60 tx=0x7fc258003000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.768+0000 7fc26627c640 1 --2- 172.21.15.7:0/2311122597 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x5592c35a9a40 0x5592c36eae60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.769+0000 7fc26627c640 1 -- 172.21.15.7:0/2311122597 <== osd.7 v2:172.21.15.55:6816/2960381217 1 ==== osd_op_reply(1 10000000000.00000000 [getxattr (9) out=9b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7fc260001900 con 0x5592c35a9a40 2024-04-25T09:55:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.769+0000 7fc267f78f40 1 -- 172.21.15.7:0/2311122597 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x5592c35a9a40 msgr2=0x5592c36eae60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.769+0000 7fc267f78f40 1 --2- 172.21.15.7:0/2311122597 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x5592c35a9a40 0x5592c36eae60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.769+0000 7fc267f78f40 1 -- 172.21.15.7:0/2311122597 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc248069ee0 msgr2=0x7fc24806c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.769+0000 7fc267f78f40 1 --2- 172.21.15.7:0/2311122597 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc248069ee0 0x7fc24806c3a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc258000f60 tx=0x7fc258003000 comp rx=0 tx=0).stop 2024-04-25T09:55:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.769+0000 7fc267f78f40 1 -- 172.21.15.7:0/2311122597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592c3650c50 msgr2=0x5592c357c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.769+0000 7fc267f78f40 1 --2- 172.21.15.7:0/2311122597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5592c3650c50 0x5592c357c070 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc25c008a40 tx=0x7fc25c008b30 comp rx=0 tx=0).stop 2024-04-25T09:55:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.769+0000 7fc26627c640 1 -- 172.21.15.7:0/2311122597 reap_dead start 2024-04-25T09:55:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.769+0000 7fc267f78f40 1 -- 172.21.15.7:0/2311122597 shutdown_connections 2024-04-25T09:55:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.769+0000 7fc267f78f40 1 -- 172.21.15.7:0/2311122597 >> 172.21.15.7:0/2311122597 conn(0x5592c35aa2b0 msgr2=0x5592c35bf710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.769+0000 7fc267f78f40 1 -- 172.21.15.7:0/2311122597 shutdown_connections 2024-04-25T09:55:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.769+0000 7fc267f78f40 1 -- 172.21.15.7:0/2311122597 wait complete. 2024-04-25T09:55:59.776 INFO:teuthology.orchestra.run.smithi007.stdout:mytag 2024-04-25T09:55:59.777 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000001.00000000 scrub_tag 2024-04-25T09:55:59.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.820+0000 7f0fda20bf40 1 Processor -- start 2024-04-25T09:55:59.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.820+0000 7f0fda20bf40 1 -- start start 2024-04-25T09:55:59.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.820+0000 7f0fda20bf40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3e70a6e70 0x55e3e70d6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.820+0000 7f0fda20bf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e7164e90 0x55e3e717dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.820+0000 7f0fda20bf40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e3e7165270 0x55e3e7161dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.820+0000 7f0fda20bf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3e7165bf0 con 0x55e3e7164e90 2024-04-25T09:55:59.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.820+0000 7f0fda20bf40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3e704fdf0 con 0x55e3e70a6e70 2024-04-25T09:55:59.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.820+0000 7f0fda20bf40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e3e7165e90 con 0x55e3e7165270 2024-04-25T09:55:59.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.820+0000 7f0fd689e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e7164e90 0x55e3e717dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.820+0000 7f0fd689e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e7164e90 0x55e3e717dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35054/0 (socket says 172.21.15.7:35054) 2024-04-25T09:55:59.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.820+0000 7f0fd689e640 1 -- 172.21.15.7:0/390913008 learned_addr learned my addr 172.21.15.7:0/390913008 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:59.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.821+0000 7f0fd709f640 1 --2- 172.21.15.7:0/390913008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3e70a6e70 0x55e3e70d6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.821+0000 7f0fd78a0640 1 --2- 172.21.15.7:0/390913008 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e3e7165270 0x55e3e7161dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.821+0000 7f0fd689e640 1 -- 172.21.15.7:0/390913008 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e3e7165270 msgr2=0x55e3e7161dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:59.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.821+0000 7f0fd689e640 1 --2- 172.21.15.7:0/390913008 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e3e7165270 0x55e3e7161dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.821+0000 7f0fd689e640 1 -- 172.21.15.7:0/390913008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3e70a6e70 msgr2=0x55e3e70d6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:59.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.821+0000 7f0fd689e640 1 --2- 172.21.15.7:0/390913008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3e70a6e70 0x55e3e70d6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.821+0000 7f0fd689e640 1 -- 172.21.15.7:0/390913008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3e6fd5c50 con 0x55e3e7164e90 2024-04-25T09:55:59.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.821+0000 7f0fd689e640 1 --2- 172.21.15.7:0/390913008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e7164e90 0x55e3e717dfc0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0001e10 tx=0x7f0fc000b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e9977f260c031d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:59.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.821+0000 7f0fd589c640 1 -- 172.21.15.7:0/390913008 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc0016070 con 0x55e3e7164e90 2024-04-25T09:55:59.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.821+0000 7f0fd589c640 1 -- 172.21.15.7:0/390913008 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc000d6d0 con 0x55e3e7164e90 2024-04-25T09:55:59.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.821+0000 7f0fd589c640 1 -- 172.21.15.7:0/390913008 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc000db00 con 0x55e3e7164e90 2024-04-25T09:55:59.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.822+0000 7f0fda20bf40 1 -- 172.21.15.7:0/390913008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e7164e90 msgr2=0x55e3e717dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:59.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.822+0000 7f0fda20bf40 1 --2- 172.21.15.7:0/390913008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e7164e90 0x55e3e717dfc0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0001e10 tx=0x7f0fc000b650 comp rx=0 tx=0).stop 2024-04-25T09:55:59.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.822+0000 7f0fda20bf40 1 -- 172.21.15.7:0/390913008 shutdown_connections 2024-04-25T09:55:59.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.822+0000 7f0fda20bf40 1 --2- 172.21.15.7:0/390913008 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e3e7165270 0x55e3e7161dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.822+0000 7f0fda20bf40 1 --2- 172.21.15.7:0/390913008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e7164e90 0x55e3e717dfc0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.822+0000 7f0fda20bf40 1 --2- 172.21.15.7:0/390913008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3e70a6e70 0x55e3e70d6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.822+0000 7f0fda20bf40 1 -- 172.21.15.7:0/390913008 >> 172.21.15.7:0/390913008 conn(0x55e3e70a7a60 msgr2=0x55e3e70f27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:59.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.822+0000 7f0fda20bf40 1 -- 172.21.15.7:0/390913008 shutdown_connections 2024-04-25T09:55:59.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.822+0000 7f0fda20bf40 1 -- 172.21.15.7:0/390913008 wait complete. 2024-04-25T09:55:59.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.822+0000 7f0fda20bf40 1 Processor -- start 2024-04-25T09:55:59.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.822+0000 7f0fda20bf40 1 -- start start 2024-04-25T09:55:59.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.823+0000 7f0fda20bf40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3e70a6e70 0x55e3e71792d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.823+0000 7f0fda20bf40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e3e7164e90 0x55e3e7160e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.823+0000 7f0fda20bf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e7165270 0x55e3e70d79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.823+0000 7f0fda20bf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3e70aab50 con 0x55e3e7165270 2024-04-25T09:55:59.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.823+0000 7f0fda20bf40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3e7162c20 con 0x55e3e70a6e70 2024-04-25T09:55:59.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.823+0000 7f0fda20bf40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e3e7162940 con 0x55e3e7164e90 2024-04-25T09:55:59.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.823+0000 7f0fd78a0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e7165270 0x55e3e70d79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.823+0000 7f0fd78a0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e7165270 0x55e3e70d79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35064/0 (socket says 172.21.15.7:35064) 2024-04-25T09:55:59.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.823+0000 7f0fd709f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3e70a6e70 0x55e3e71792d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.823+0000 7f0fd78a0640 1 -- 172.21.15.7:0/103961967 learned_addr learned my addr 172.21.15.7:0/103961967 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:59.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.823+0000 7f0fd689e640 1 --2- 172.21.15.7:0/103961967 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e3e7164e90 0x55e3e7160e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.824+0000 7f0fd78a0640 1 -- 172.21.15.7:0/103961967 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e3e7164e90 msgr2=0x55e3e7160e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:59.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.824+0000 7f0fd78a0640 1 --2- 172.21.15.7:0/103961967 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e3e7164e90 0x55e3e7160e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.824+0000 7f0fd78a0640 1 -- 172.21.15.7:0/103961967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3e70a6e70 msgr2=0x55e3e71792d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:59.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.824+0000 7f0fd78a0640 1 --2- 172.21.15.7:0/103961967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3e70a6e70 0x55e3e71792d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.824+0000 7f0fd78a0640 1 -- 172.21.15.7:0/103961967 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3e7179810 con 0x55e3e7165270 2024-04-25T09:55:59.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.824+0000 7f0fd78a0640 1 --2- 172.21.15.7:0/103961967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e7165270 0x55e3e70d79f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8007000 tx=0x7f0fc8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:59.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.824+0000 7f0fd489a640 1 -- 172.21.15.7:0/103961967 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc8055040 con 0x55e3e7165270 2024-04-25T09:55:59.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.824+0000 7f0fd489a640 1 -- 172.21.15.7:0/103961967 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc8065440 con 0x55e3e7165270 2024-04-25T09:55:59.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.824+0000 7f0fd489a640 1 -- 172.21.15.7:0/103961967 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc80657f0 con 0x55e3e7165270 2024-04-25T09:55:59.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.824+0000 7f0fda20bf40 1 -- 172.21.15.7:0/103961967 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e3e70d60c0 con 0x55e3e7165270 2024-04-25T09:55:59.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.824+0000 7f0fda20bf40 1 -- 172.21.15.7:0/103961967 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e3e715e860 con 0x55e3e7165270 2024-04-25T09:55:59.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.825+0000 7f0fd489a640 1 -- 172.21.15.7:0/103961967 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0fc8058020 con 0x55e3e7165270 2024-04-25T09:55:59.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.826+0000 7f0fd489a640 1 --2- 172.21.15.7:0/103961967 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0fb8069eb0 0x7f0fb806c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.826+0000 7f0fd489a640 1 -- 172.21.15.7:0/103961967 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0fc80cd030 con 0x55e3e7165270 2024-04-25T09:55:59.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.826+0000 7f0fd709f640 1 --2- 172.21.15.7:0/103961967 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0fb8069eb0 0x7f0fb806c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.826+0000 7f0fda20bf40 1 --2- 172.21.15.7:0/103961967 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x55e3e715f370 0x55e3e715f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.826+0000 7f0fda20bf40 1 -- 172.21.15.7:0/103961967 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:1 5.7 5:e2e07930:::10000000001.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39) v9 -- 0x55e3e715fcb0 con 0x55e3e715f370 2024-04-25T09:55:59.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.826+0000 7f0fd709f640 1 --2- 172.21.15.7:0/103961967 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0fb8069eb0 0x7f0fb806c370 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0005400 tx=0x7f0fd000c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:59.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.826+0000 7f0fd689e640 1 --2- 172.21.15.7:0/103961967 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x55e3e715f370 0x55e3e715f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.827+0000 7f0fd689e640 1 --2- 172.21.15.7:0/103961967 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x55e3e715f370 0x55e3e715f770 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:59.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.827+0000 7f0fd689e640 1 -- 172.21.15.7:0/103961967 <== osd.5 v2:172.21.15.55:6800/2514169616 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (9) out=9b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f0fc000d880 con 0x55e3e715f370 2024-04-25T09:55:59.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.827+0000 7f0fda20bf40 1 -- 172.21.15.7:0/103961967 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x55e3e715f370 msgr2=0x55e3e715f770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:59.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.827+0000 7f0fda20bf40 1 --2- 172.21.15.7:0/103961967 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x55e3e715f370 0x55e3e715f770 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.827+0000 7f0fda20bf40 1 -- 172.21.15.7:0/103961967 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0fb8069eb0 msgr2=0x7f0fb806c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:59.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.827+0000 7f0fda20bf40 1 --2- 172.21.15.7:0/103961967 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0fb8069eb0 0x7f0fb806c370 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0005400 tx=0x7f0fd000c040 comp rx=0 tx=0).stop 2024-04-25T09:55:59.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.827+0000 7f0fda20bf40 1 -- 172.21.15.7:0/103961967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e7165270 msgr2=0x55e3e70d79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:59.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.827+0000 7f0fda20bf40 1 --2- 172.21.15.7:0/103961967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3e7165270 0x55e3e70d79f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8007000 tx=0x7f0fc8003330 comp rx=0 tx=0).stop 2024-04-25T09:55:59.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.827+0000 7f0fd78a0640 1 -- 172.21.15.7:0/103961967 reap_dead start 2024-04-25T09:55:59.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.827+0000 7f0fda20bf40 1 -- 172.21.15.7:0/103961967 shutdown_connections 2024-04-25T09:55:59.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.827+0000 7f0fda20bf40 1 -- 172.21.15.7:0/103961967 >> 172.21.15.7:0/103961967 conn(0x55e3e70a7a60 msgr2=0x55e3e71620e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:59.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.827+0000 7f0fda20bf40 1 -- 172.21.15.7:0/103961967 shutdown_connections 2024-04-25T09:55:59.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.827+0000 7f0fda20bf40 1 -- 172.21.15.7:0/103961967 wait complete. 2024-04-25T09:55:59.835 INFO:teuthology.orchestra.run.smithi007.stdout:mytag 2024-04-25T09:55:59.836 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2024-04-25T09:55:59.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.876+0000 7f77b4d0ff40 1 Processor -- start 2024-04-25T09:55:59.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.876+0000 7f77b4d0ff40 1 -- start start 2024-04-25T09:55:59.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.877+0000 7f77b4d0ff40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e45fc86e70 0x55e45fcb2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.877+0000 7f77b4d0ff40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e45fd44e90 0x55e45fc89a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.877+0000 7f77b4d0ff40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e45fd45270 0x55e45fd5f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.877+0000 7f77b4d0ff40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e45fc2fdf0 con 0x55e45fd44e90 2024-04-25T09:55:59.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.877+0000 7f77b4d0ff40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e45fc33d50 con 0x55e45fc86e70 2024-04-25T09:55:59.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.877+0000 7f77b4d0ff40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e45fd45bf0 con 0x55e45fd45270 2024-04-25T09:55:59.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.877+0000 7f77b200f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e45fd44e90 0x55e45fc89a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.877+0000 7f77b200f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e45fd44e90 0x55e45fc89a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35074/0 (socket says 172.21.15.7:35074) 2024-04-25T09:55:59.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.877+0000 7f77b200f640 1 -- 172.21.15.7:0/3013396384 learned_addr learned my addr 172.21.15.7:0/3013396384 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:59.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.877+0000 7f77b2810640 1 --2- 172.21.15.7:0/3013396384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e45fc86e70 0x55e45fcb2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.877+0000 7f77b3011640 1 --2- 172.21.15.7:0/3013396384 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e45fd45270 0x55e45fd5f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.877+0000 7f77b200f640 1 -- 172.21.15.7:0/3013396384 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e45fd45270 msgr2=0x55e45fd5f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:59.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.877+0000 7f77b200f640 1 --2- 172.21.15.7:0/3013396384 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e45fd45270 0x55e45fd5f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.877+0000 7f77b200f640 1 -- 172.21.15.7:0/3013396384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e45fc86e70 msgr2=0x55e45fcb2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:59.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.877+0000 7f77b200f640 1 --2- 172.21.15.7:0/3013396384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e45fc86e70 0x55e45fcb2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.877+0000 7f77b200f640 1 -- 172.21.15.7:0/3013396384 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e45fc88030 con 0x55e45fd44e90 2024-04-25T09:55:59.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.878+0000 7f77b200f640 1 --2- 172.21.15.7:0/3013396384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e45fd44e90 0x55e45fc89a60 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f779c00b240 tx=0x7f779c00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f1f741f3799edc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:59.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.878+0000 7f77b100d640 1 -- 172.21.15.7:0/3013396384 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c008070 con 0x55e45fd44e90 2024-04-25T09:55:59.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.878+0000 7f77b100d640 1 -- 172.21.15.7:0/3013396384 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779c00d500 con 0x55e45fd44e90 2024-04-25T09:55:59.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.878+0000 7f77b100d640 1 -- 172.21.15.7:0/3013396384 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c00d910 con 0x55e45fd44e90 2024-04-25T09:55:59.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.878+0000 7f77b4d0ff40 1 -- 172.21.15.7:0/3013396384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e45fd44e90 msgr2=0x55e45fc89a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:59.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.878+0000 7f77b4d0ff40 1 --2- 172.21.15.7:0/3013396384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e45fd44e90 0x55e45fc89a60 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f779c00b240 tx=0x7f779c00b700 comp rx=0 tx=0).stop 2024-04-25T09:55:59.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.878+0000 7f77b4d0ff40 1 -- 172.21.15.7:0/3013396384 shutdown_connections 2024-04-25T09:55:59.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.878+0000 7f77b4d0ff40 1 --2- 172.21.15.7:0/3013396384 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e45fd45270 0x55e45fd5f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.878+0000 7f77b4d0ff40 1 --2- 172.21.15.7:0/3013396384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e45fd44e90 0x55e45fc89a60 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.878+0000 7f77b4d0ff40 1 --2- 172.21.15.7:0/3013396384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e45fc86e70 0x55e45fcb2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.878+0000 7f77b4d0ff40 1 -- 172.21.15.7:0/3013396384 >> 172.21.15.7:0/3013396384 conn(0x55e45fc87a60 msgr2=0x55e45fd43750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:59.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.878+0000 7f77b4d0ff40 1 -- 172.21.15.7:0/3013396384 shutdown_connections 2024-04-25T09:55:59.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.878+0000 7f77b4d0ff40 1 -- 172.21.15.7:0/3013396384 wait complete. 2024-04-25T09:55:59.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.879+0000 7f77b4d0ff40 1 Processor -- start 2024-04-25T09:55:59.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.879+0000 7f77b4d0ff40 1 -- start start 2024-04-25T09:55:59.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.880+0000 7f77b4d0ff40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e45fc86e70 0x55e45fd5ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.880+0000 7f77b4d0ff40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e45fd44e90 0x55e45fd46680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.880+0000 7f77b4d0ff40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e45fd45270 0x55e45fd41110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.880+0000 7f77b4d0ff40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e45fd59ed0 con 0x55e45fd45270 2024-04-25T09:55:59.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.880+0000 7f77b4d0ff40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e45fd497b0 con 0x55e45fc86e70 2024-04-25T09:55:59.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.880+0000 7f77b4d0ff40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e45fd5a220 con 0x55e45fd44e90 2024-04-25T09:55:59.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.880+0000 7f77b3011640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e45fd45270 0x55e45fd41110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.880+0000 7f77b3011640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e45fd45270 0x55e45fd41110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35080/0 (socket says 172.21.15.7:35080) 2024-04-25T09:55:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.880+0000 7f77b3011640 1 -- 172.21.15.7:0/2362309625 learned_addr learned my addr 172.21.15.7:0/2362309625 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.880+0000 7f77b200f640 1 --2- 172.21.15.7:0/2362309625 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e45fd44e90 0x55e45fd46680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.880+0000 7f77b2810640 1 --2- 172.21.15.7:0/2362309625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e45fc86e70 0x55e45fd5ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.880+0000 7f77b3011640 1 -- 172.21.15.7:0/2362309625 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e45fd44e90 msgr2=0x55e45fd46680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.880+0000 7f77b3011640 1 --2- 172.21.15.7:0/2362309625 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e45fd44e90 0x55e45fd46680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.880+0000 7f77b3011640 1 -- 172.21.15.7:0/2362309625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e45fc86e70 msgr2=0x55e45fd5ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.880+0000 7f77b3011640 1 --2- 172.21.15.7:0/2362309625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e45fc86e70 0x55e45fd5ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.880+0000 7f77b3011640 1 -- 172.21.15.7:0/2362309625 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e45fd5fe80 con 0x55e45fd45270 2024-04-25T09:55:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.880+0000 7f77b3011640 1 --2- 172.21.15.7:0/2362309625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e45fd45270 0x55e45fd41110 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00dfa0 tx=0x7f77ac00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.881+0000 7f77abfff640 1 -- 172.21.15.7:0/2362309625 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac0032d0 con 0x55e45fd45270 2024-04-25T09:55:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.881+0000 7f77abfff640 1 -- 172.21.15.7:0/2362309625 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ac016070 con 0x55e45fd45270 2024-04-25T09:55:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.881+0000 7f77b4d0ff40 1 -- 172.21.15.7:0/2362309625 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e45fcb83c0 con 0x55e45fd45270 2024-04-25T09:55:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.881+0000 7f77abfff640 1 -- 172.21.15.7:0/2362309625 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac001710 con 0x55e45fd45270 2024-04-25T09:55:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.881+0000 7f77b4d0ff40 1 -- 172.21.15.7:0/2362309625 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e45fd5f600 con 0x55e45fd45270 2024-04-25T09:55:59.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.882+0000 7f77abfff640 1 -- 172.21.15.7:0/2362309625 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f77ac0018b0 con 0x55e45fd45270 2024-04-25T09:55:59.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.882+0000 7f77abfff640 1 --2- 172.21.15.7:0/2362309625 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7794069eb0 0x7f779406c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.883+0000 7f77b2810640 1 --2- 172.21.15.7:0/2362309625 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7794069eb0 0x7f779406c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.883+0000 7f77abfff640 1 -- 172.21.15.7:0/2362309625 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f77ac088eb0 con 0x55e45fd45270 2024-04-25T09:55:59.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.883+0000 7f77b4d0ff40 1 --2- 172.21.15.7:0/2362309625 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x55e45fd41e20 0x55e45fd43750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.883+0000 7f77b4d0ff40 1 -- 172.21.15.7:0/2362309625 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:1 6.36 6:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39) v9 -- 0x55e45fdec320 con 0x55e45fd41e20 2024-04-25T09:55:59.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.883+0000 7f77b2810640 1 --2- 172.21.15.7:0/2362309625 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7794069eb0 0x7f779406c370 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f77a4057000 tx=0x7f77a405d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:59.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.883+0000 7f77b200f640 1 --2- 172.21.15.7:0/2362309625 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x55e45fd41e20 0x55e45fd43750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.884+0000 7f77b200f640 1 --2- 172.21.15.7:0/2362309625 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x55e45fd41e20 0x55e45fd43750 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:59.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.884+0000 7f77b200f640 1 -- 172.21.15.7:0/2362309625 <== osd.5 v2:172.21.15.55:6800/2514169616 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr (9) out=9b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f779c00d730 con 0x55e45fd41e20 2024-04-25T09:55:59.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.884+0000 7f77b4d0ff40 1 -- 172.21.15.7:0/2362309625 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x55e45fd41e20 msgr2=0x55e45fd43750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:59.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.884+0000 7f77b4d0ff40 1 --2- 172.21.15.7:0/2362309625 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x55e45fd41e20 0x55e45fd43750 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.884+0000 7f77b4d0ff40 1 -- 172.21.15.7:0/2362309625 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7794069eb0 msgr2=0x7f779406c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:59.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.884+0000 7f77b4d0ff40 1 --2- 172.21.15.7:0/2362309625 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7794069eb0 0x7f779406c370 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f77a4057000 tx=0x7f77a405d040 comp rx=0 tx=0).stop 2024-04-25T09:55:59.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.884+0000 7f77b4d0ff40 1 -- 172.21.15.7:0/2362309625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e45fd45270 msgr2=0x55e45fd41110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:59.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.884+0000 7f77b4d0ff40 1 --2- 172.21.15.7:0/2362309625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e45fd45270 0x55e45fd41110 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00dfa0 tx=0x7f77ac00b5b0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.884+0000 7f77b3011640 1 -- 172.21.15.7:0/2362309625 reap_dead start 2024-04-25T09:55:59.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.884+0000 7f77b4d0ff40 1 -- 172.21.15.7:0/2362309625 shutdown_connections 2024-04-25T09:55:59.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.884+0000 7f77b4d0ff40 1 -- 172.21.15.7:0/2362309625 >> 172.21.15.7:0/2362309625 conn(0x55e45fc87a60 msgr2=0x55e45fd5dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:59.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.884+0000 7f77b4d0ff40 1 -- 172.21.15.7:0/2362309625 shutdown_connections 2024-04-25T09:55:59.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.884+0000 7f77b4d0ff40 1 -- 172.21.15.7:0/2362309625 wait complete. 2024-04-25T09:55:59.892 INFO:teuthology.orchestra.run.smithi007.stdout:mytag 2024-04-25T09:55:59.892 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2024-04-25T09:55:59.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.972+0000 7f9a9cbebf40 1 Processor -- start 2024-04-25T09:55:59.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.972+0000 7f9a9cbebf40 1 -- start start 2024-04-25T09:55:59.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.973+0000 7f9a9cbebf40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559570031e90 0x55957002dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.973+0000 7f9a9cbebf40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559570032270 0x55956ffbef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.973+0000 7f9a9cbebf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559570032680 0x55956ffbf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.973+0000 7f9a9cbebf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x559570032e90 con 0x559570032680 2024-04-25T09:55:59.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.973+0000 7f9a9cbebf40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559570032bf0 con 0x559570032270 2024-04-25T09:55:59.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.973+0000 7f9a9cbebf40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x559570033130 con 0x559570031e90 2024-04-25T09:55:59.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.973+0000 7f9a9aeed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559570032680 0x55956ffbf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.973+0000 7f9a9aeed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559570032680 0x55956ffbf480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35094/0 (socket says 172.21.15.7:35094) 2024-04-25T09:55:59.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.973+0000 7f9a9aeed640 1 -- 172.21.15.7:0/1183889761 learned_addr learned my addr 172.21.15.7:0/1183889761 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:59.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.973+0000 7f9a9a6ec640 1 --2- 172.21.15.7:0/1183889761 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559570031e90 0x55957002dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.973+0000 7f9a99eeb640 1 --2- 172.21.15.7:0/1183889761 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559570032270 0x55956ffbef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.973+0000 7f9a9aeed640 1 -- 172.21.15.7:0/1183889761 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559570031e90 msgr2=0x55957002dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:59.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.973+0000 7f9a9aeed640 1 --2- 172.21.15.7:0/1183889761 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559570031e90 0x55957002dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.973+0000 7f9a9aeed640 1 -- 172.21.15.7:0/1183889761 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559570032270 msgr2=0x55956ffbef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:55:59.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.973+0000 7f9a9aeed640 1 --2- 172.21.15.7:0/1183889761 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559570032270 0x55956ffbef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.973+0000 7f9a9aeed640 1 -- 172.21.15.7:0/1183889761 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55956feb6de0 con 0x559570032680 2024-04-25T09:55:59.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.974+0000 7f9a9aeed640 1 --2- 172.21.15.7:0/1183889761 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559570032680 0x55956ffbf480 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400a4e0 tx=0x7f9a9400a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a29952ee75c4b86b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:59.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.974+0000 7f9a98ee9640 1 -- 172.21.15.7:0/1183889761 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a94015070 con 0x559570032680 2024-04-25T09:55:59.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.974+0000 7f9a98ee9640 1 -- 172.21.15.7:0/1183889761 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9400e710 con 0x559570032680 2024-04-25T09:55:59.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.974+0000 7f9a98ee9640 1 -- 172.21.15.7:0/1183889761 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9400eae0 con 0x559570032680 2024-04-25T09:55:59.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.974+0000 7f9a9cbebf40 1 -- 172.21.15.7:0/1183889761 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559570032680 msgr2=0x55956ffbf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:59.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.974+0000 7f9a9cbebf40 1 --2- 172.21.15.7:0/1183889761 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559570032680 0x55956ffbf480 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400a4e0 tx=0x7f9a9400a8e0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.974+0000 7f9a9cbebf40 1 -- 172.21.15.7:0/1183889761 shutdown_connections 2024-04-25T09:55:59.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.974+0000 7f9a9cbebf40 1 --2- 172.21.15.7:0/1183889761 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559570032680 0x55956ffbf480 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.974+0000 7f9a9cbebf40 1 --2- 172.21.15.7:0/1183889761 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559570032270 0x55956ffbef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.974+0000 7f9a9cbebf40 1 --2- 172.21.15.7:0/1183889761 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559570031e90 0x55957002dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.974+0000 7f9a9cbebf40 1 -- 172.21.15.7:0/1183889761 >> 172.21.15.7:0/1183889761 conn(0x55956ff74a60 msgr2=0x55956ff767e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:59.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.974+0000 7f9a9cbebf40 1 -- 172.21.15.7:0/1183889761 shutdown_connections 2024-04-25T09:55:59.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.974+0000 7f9a9cbebf40 1 -- 172.21.15.7:0/1183889761 wait complete. 2024-04-25T09:55:59.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.975+0000 7f9a9cbebf40 1 Processor -- start 2024-04-25T09:55:59.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.975+0000 7f9a9cbebf40 1 -- start start 2024-04-25T09:55:59.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.976+0000 7f9a9cbebf40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559570031e90 0x559570047f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.976+0000 7f9a9cbebf40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559570032270 0x55956ff736b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.976+0000 7f9a9cbebf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559570032680 0x55957002c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.976+0000 7f9a9cbebf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55956ffa1c40 con 0x559570032680 2024-04-25T09:55:59.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.976+0000 7f9a9cbebf40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55957004eb80 con 0x559570032270 2024-04-25T09:55:59.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.976+0000 7f9a9cbebf40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x559570047300 con 0x559570031e90 2024-04-25T09:55:59.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.976+0000 7f9a9aeed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559570032680 0x55957002c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.976+0000 7f9a9aeed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559570032680 0x55957002c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35108/0 (socket says 172.21.15.7:35108) 2024-04-25T09:55:59.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.976+0000 7f9a9aeed640 1 -- 172.21.15.7:0/3705120909 learned_addr learned my addr 172.21.15.7:0/3705120909 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:55:59.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.976+0000 7f9a9a6ec640 1 --2- 172.21.15.7:0/3705120909 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559570031e90 0x559570047f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.976+0000 7f9a99eeb640 1 --2- 172.21.15.7:0/3705120909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559570032270 0x55956ff736b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.976+0000 7f9a9aeed640 1 -- 172.21.15.7:0/3705120909 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559570031e90 msgr2=0x559570047f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:59.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.976+0000 7f9a9aeed640 1 --2- 172.21.15.7:0/3705120909 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559570031e90 0x559570047f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.976+0000 7f9a9aeed640 1 -- 172.21.15.7:0/3705120909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559570032270 msgr2=0x55956ff736b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:59.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.976+0000 7f9a9aeed640 1 --2- 172.21.15.7:0/3705120909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559570032270 0x55956ff736b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.976+0000 7f9a9aeed640 1 -- 172.21.15.7:0/3705120909 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55956fea2c50 con 0x559570032680 2024-04-25T09:55:59.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.976+0000 7f9a9aeed640 1 --2- 172.21.15.7:0/3705120909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559570032680 0x55957002c3a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x55957004fbf0 tx=0x7f9a94003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:59.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.976+0000 7f9a8b7fe640 1 -- 172.21.15.7:0/3705120909 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a94020070 con 0x559570032680 2024-04-25T09:55:59.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.976+0000 7f9a8b7fe640 1 -- 172.21.15.7:0/3705120909 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9401c640 con 0x559570032680 2024-04-25T09:55:59.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.976+0000 7f9a9cbebf40 1 -- 172.21.15.7:0/3705120909 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559570048450 con 0x559570032680 2024-04-25T09:55:59.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.977+0000 7f9a8b7fe640 1 -- 172.21.15.7:0/3705120909 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a94015040 con 0x559570032680 2024-04-25T09:55:59.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.977+0000 7f9a9cbebf40 1 -- 172.21.15.7:0/3705120909 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55957002b5e0 con 0x559570032680 2024-04-25T09:55:59.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.978+0000 7f9a8b7fe640 1 -- 172.21.15.7:0/3705120909 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9a94023070 con 0x559570032680 2024-04-25T09:55:59.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.978+0000 7f9a8b7fe640 1 --2- 172.21.15.7:0/3705120909 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9a7c069eb0 0x7f9a7c06c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.978+0000 7f9a8b7fe640 1 -- 172.21.15.7:0/3705120909 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9a9408a110 con 0x559570032680 2024-04-25T09:55:59.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.978+0000 7f9a9a6ec640 1 --2- 172.21.15.7:0/3705120909 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9a7c069eb0 0x7f9a7c06c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.979+0000 7f9a9cbebf40 1 --2- 172.21.15.7:0/3705120909 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x55956ff73bf0 0x55956ffa3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:55:59.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.979+0000 7f9a9cbebf40 1 -- 172.21.15.7:0/3705120909 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:1 6.19 6:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39) v9 -- 0x55956ffbf5c0 con 0x55956ff73bf0 2024-04-25T09:55:59.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.979+0000 7f9a9a6ec640 1 --2- 172.21.15.7:0/3705120909 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9a7c069eb0 0x7f9a7c06c370 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c057000 tx=0x7f9a8c052000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:59.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.979+0000 7f9a99eeb640 1 --2- 172.21.15.7:0/3705120909 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x55956ff73bf0 0x55956ffa3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:55:59.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.979+0000 7f9a99eeb640 1 --2- 172.21.15.7:0/3705120909 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x55956ff73bf0 0x55956ffa3530 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:55:59.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.980+0000 7f9a99eeb640 1 -- 172.21.15.7:0/3705120909 <== osd.5 v2:172.21.15.55:6800/2514169616 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (9) out=9b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f9a9000a950 con 0x55956ff73bf0 2024-04-25T09:55:59.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.980+0000 7f9a9cbebf40 1 -- 172.21.15.7:0/3705120909 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x55956ff73bf0 msgr2=0x55956ffa3530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:59.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.980+0000 7f9a9cbebf40 1 --2- 172.21.15.7:0/3705120909 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x55956ff73bf0 0x55956ffa3530 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:55:59.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.980+0000 7f9a9cbebf40 1 -- 172.21.15.7:0/3705120909 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9a7c069eb0 msgr2=0x7f9a7c06c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:59.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.980+0000 7f9a9cbebf40 1 --2- 172.21.15.7:0/3705120909 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9a7c069eb0 0x7f9a7c06c370 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c057000 tx=0x7f9a8c052000 comp rx=0 tx=0).stop 2024-04-25T09:55:59.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.980+0000 7f9a9cbebf40 1 -- 172.21.15.7:0/3705120909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559570032680 msgr2=0x55957002c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:55:59.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.980+0000 7f9a9cbebf40 1 --2- 172.21.15.7:0/3705120909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559570032680 0x55957002c3a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x55957004fbf0 tx=0x7f9a94003330 comp rx=0 tx=0).stop 2024-04-25T09:55:59.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.980+0000 7f9a9aeed640 1 -- 172.21.15.7:0/3705120909 reap_dead start 2024-04-25T09:55:59.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.980+0000 7f9a9cbebf40 1 -- 172.21.15.7:0/3705120909 shutdown_connections 2024-04-25T09:55:59.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.980+0000 7f9a9cbebf40 1 -- 172.21.15.7:0/3705120909 >> 172.21.15.7:0/3705120909 conn(0x55956ff74a60 msgr2=0x55956ff767e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:55:59.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.980+0000 7f9a9cbebf40 1 -- 172.21.15.7:0/3705120909 shutdown_connections 2024-04-25T09:55:59.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:55:59.980+0000 7f9a9cbebf40 1 -- 172.21.15.7:0/3705120909 wait complete. 2024-04-25T09:55:59.989 INFO:teuthology.orchestra.run.smithi007.stdout:mytag 2024-04-25T09:55:59.989 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2024-04-25T09:56:00.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.070+0000 7fb42ed08f40 1 Processor -- start 2024-04-25T09:56:00.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.070+0000 7fb42ed08f40 1 -- start start 2024-04-25T09:56:00.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.070+0000 7fb42ed08f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560e13e2cca0 0x560e13ee4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:00.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.070+0000 7fb42ed08f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e13e58850 0x560e13e5c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:00.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.070+0000 7fb42ed08f40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e13eec080 0x560e13e305b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:00.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.070+0000 7fb42ed08f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e13e77a50 con 0x560e13e58850 2024-04-25T09:56:00.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.070+0000 7fb42ed08f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e13dd5df0 con 0x560e13e2cca0 2024-04-25T09:56:00.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.070+0000 7fb42ed08f40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x560e13e2d0b0 con 0x560e13eec080 2024-04-25T09:56:00.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.070+0000 7fb42c00a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e13e58850 0x560e13e5c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:00.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.071+0000 7fb42c00a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e13e58850 0x560e13e5c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35120/0 (socket says 172.21.15.7:35120) 2024-04-25T09:56:00.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.071+0000 7fb42c00a640 1 -- 172.21.15.7:0/2472069346 learned_addr learned my addr 172.21.15.7:0/2472069346 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:00.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.071+0000 7fb42c80b640 1 --2- 172.21.15.7:0/2472069346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560e13e2cca0 0x560e13ee4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:00.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.071+0000 7fb42d00c640 1 --2- 172.21.15.7:0/2472069346 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e13eec080 0x560e13e305b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:00.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.071+0000 7fb42c00a640 1 -- 172.21.15.7:0/2472069346 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e13eec080 msgr2=0x560e13e305b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:00.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.071+0000 7fb42c00a640 1 --2- 172.21.15.7:0/2472069346 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e13eec080 0x560e13e305b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:00.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.071+0000 7fb42c00a640 1 -- 172.21.15.7:0/2472069346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560e13e2cca0 msgr2=0x560e13ee4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:00.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.071+0000 7fb42c00a640 1 --2- 172.21.15.7:0/2472069346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560e13e2cca0 0x560e13ee4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:00.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.071+0000 7fb42c00a640 1 -- 172.21.15.7:0/2472069346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e13d5bc50 con 0x560e13e58850 2024-04-25T09:56:00.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.071+0000 7fb42d00c640 1 --2- 172.21.15.7:0/2472069346 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e13eec080 0x560e13e305b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:00.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.071+0000 7fb42c00a640 1 --2- 172.21.15.7:0/2472069346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e13e58850 0x560e13e5c100 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb4140095d0 tx=0x7fb414009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f70dc061f36f91e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:00.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.071+0000 7fb42b008640 1 -- 172.21.15.7:0/2472069346 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb414006680 con 0x560e13e58850 2024-04-25T09:56:00.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.071+0000 7fb42b008640 1 -- 172.21.15.7:0/2472069346 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb414006820 con 0x560e13e58850 2024-04-25T09:56:00.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.071+0000 7fb42b008640 1 -- 172.21.15.7:0/2472069346 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb414006c10 con 0x560e13e58850 2024-04-25T09:56:00.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.072+0000 7fb42ed08f40 1 -- 172.21.15.7:0/2472069346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e13e58850 msgr2=0x560e13e5c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:00.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.072+0000 7fb42ed08f40 1 --2- 172.21.15.7:0/2472069346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e13e58850 0x560e13e5c100 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb4140095d0 tx=0x7fb414009a90 comp rx=0 tx=0).stop 2024-04-25T09:56:00.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.072+0000 7fb42ed08f40 1 -- 172.21.15.7:0/2472069346 shutdown_connections 2024-04-25T09:56:00.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.072+0000 7fb42ed08f40 1 --2- 172.21.15.7:0/2472069346 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e13eec080 0x560e13e305b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:00.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.072+0000 7fb42ed08f40 1 --2- 172.21.15.7:0/2472069346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e13e58850 0x560e13e5c100 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:00.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.072+0000 7fb42ed08f40 1 --2- 172.21.15.7:0/2472069346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560e13e2cca0 0x560e13ee4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:00.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.072+0000 7fb42ed08f40 1 -- 172.21.15.7:0/2472069346 >> 172.21.15.7:0/2472069346 conn(0x560e13e2da60 msgr2=0x560e13f06000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:00.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.072+0000 7fb42ed08f40 1 -- 172.21.15.7:0/2472069346 shutdown_connections 2024-04-25T09:56:00.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.072+0000 7fb42ed08f40 1 -- 172.21.15.7:0/2472069346 wait complete. 2024-04-25T09:56:00.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.072+0000 7fb42ed08f40 1 Processor -- start 2024-04-25T09:56:00.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.072+0000 7fb42ed08f40 1 -- start start 2024-04-25T09:56:00.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.073+0000 7fb42ed08f40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e13e2cca0 0x560e13eff8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:00.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.073+0000 7fb42ed08f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e13e58850 0x560e13e5cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:00.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.073+0000 7fb42ed08f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560e13eec080 0x560e13e738e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:00.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.073+0000 7fb42ed08f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e13e5a040 con 0x560e13e58850 2024-04-25T09:56:00.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.073+0000 7fb42ed08f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e13ee50e0 con 0x560e13eec080 2024-04-25T09:56:00.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.073+0000 7fb42ed08f40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x560e13e5a320 con 0x560e13e2cca0 2024-04-25T09:56:00.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.073+0000 7fb42c00a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e13e58850 0x560e13e5cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:00.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.073+0000 7fb42c00a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e13e58850 0x560e13e5cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35128/0 (socket says 172.21.15.7:35128) 2024-04-25T09:56:00.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.073+0000 7fb42c00a640 1 -- 172.21.15.7:0/823684153 learned_addr learned my addr 172.21.15.7:0/823684153 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:00.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.073+0000 7fb42d00c640 1 --2- 172.21.15.7:0/823684153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560e13eec080 0x560e13e738e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:00.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.073+0000 7fb42c80b640 1 --2- 172.21.15.7:0/823684153 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e13e2cca0 0x560e13eff8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:00.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.073+0000 7fb42c00a640 1 -- 172.21.15.7:0/823684153 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e13e2cca0 msgr2=0x560e13eff8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:00.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.073+0000 7fb42c00a640 1 --2- 172.21.15.7:0/823684153 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e13e2cca0 0x560e13eff8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:00.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.073+0000 7fb42c00a640 1 -- 172.21.15.7:0/823684153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560e13eec080 msgr2=0x560e13e738e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:00.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.073+0000 7fb42c00a640 1 --2- 172.21.15.7:0/823684153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560e13eec080 0x560e13e738e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:00.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.073+0000 7fb42c00a640 1 -- 172.21.15.7:0/823684153 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e13e74f00 con 0x560e13e58850 2024-04-25T09:56:00.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.073+0000 7fb42c80b640 1 --2- 172.21.15.7:0/823684153 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e13e2cca0 0x560e13eff8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:00.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.073+0000 7fb42c00a640 1 --2- 172.21.15.7:0/823684153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e13e58850 0x560e13e5cfe0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb41400afd0 tx=0x7fb414003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:00.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.074+0000 7fb42a006640 1 -- 172.21.15.7:0/823684153 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb414020070 con 0x560e13e58850 2024-04-25T09:56:00.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.074+0000 7fb42a006640 1 -- 172.21.15.7:0/823684153 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4140058e0 con 0x560e13e58850 2024-04-25T09:56:00.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.074+0000 7fb42ed08f40 1 -- 172.21.15.7:0/823684153 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560e13e72e00 con 0x560e13e58850 2024-04-25T09:56:00.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.074+0000 7fb42a006640 1 -- 172.21.15.7:0/823684153 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41401c880 con 0x560e13e58850 2024-04-25T09:56:00.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.074+0000 7fb42ed08f40 1 -- 172.21.15.7:0/823684153 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560e13e733c0 con 0x560e13e58850 2024-04-25T09:56:00.084 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:56:00.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.075+0000 7fb42a006640 1 -- 172.21.15.7:0/823684153 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb414023070 con 0x560e13e58850 2024-04-25T09:56:00.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.075+0000 7fb42a006640 1 --2- 172.21.15.7:0/823684153 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb40c069eb0 0x7fb40c06c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:00.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.076+0000 7fb42c80b640 1 --2- 172.21.15.7:0/823684153 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb40c069eb0 0x7fb40c06c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:00.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.076+0000 7fb42a006640 1 -- 172.21.15.7:0/823684153 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb41408a700 con 0x560e13e58850 2024-04-25T09:56:00.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.076+0000 7fb42ed08f40 1 --2- 172.21.15.7:0/823684153 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x560e13e5d520 0x560e13f94e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:00.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.076+0000 7fb42ed08f40 1 -- 172.21.15.7:0/823684153 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:1 6.12 6:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39) v9 -- 0x560e13e73e20 con 0x560e13e5d520 2024-04-25T09:56:00.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.076+0000 7fb42d00c640 1 --2- 172.21.15.7:0/823684153 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x560e13e5d520 0x560e13f94e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:00.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.076+0000 7fb42c80b640 1 --2- 172.21.15.7:0/823684153 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb40c069eb0 0x7fb40c06c370 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb424057000 tx=0x7fb424052000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:00.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.076+0000 7fb42d00c640 1 --2- 172.21.15.7:0/823684153 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x560e13e5d520 0x560e13f94e50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:00.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.077+0000 7fb42d00c640 1 -- 172.21.15.7:0/823684153 <== osd.7 v2:172.21.15.55:6816/2960381217 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x7fb41c00d7b0 con 0x560e13e5d520 2024-04-25T09:56:00.086 INFO:teuthology.orchestra.run.smithi007.stderr:error getting xattr cephfs_data/10000000002.00000000/scrub_tag: (61) No data available 2024-04-25T09:56:00.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.077+0000 7fb42ed08f40 1 -- 172.21.15.7:0/823684153 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x560e13e5d520 msgr2=0x560e13f94e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:00.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.077+0000 7fb42ed08f40 1 --2- 172.21.15.7:0/823684153 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x560e13e5d520 0x560e13f94e50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:00.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.077+0000 7fb42ed08f40 1 -- 172.21.15.7:0/823684153 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb40c069eb0 msgr2=0x7fb40c06c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:00.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.077+0000 7fb42ed08f40 1 --2- 172.21.15.7:0/823684153 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb40c069eb0 0x7fb40c06c370 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb424057000 tx=0x7fb424052000 comp rx=0 tx=0).stop 2024-04-25T09:56:00.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.077+0000 7fb42ed08f40 1 -- 172.21.15.7:0/823684153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e13e58850 msgr2=0x560e13e5cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:00.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.077+0000 7fb42ed08f40 1 --2- 172.21.15.7:0/823684153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e13e58850 0x560e13e5cfe0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb41400afd0 tx=0x7fb414003020 comp rx=0 tx=0).stop 2024-04-25T09:56:00.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.077+0000 7fb42d00c640 1 -- 172.21.15.7:0/823684153 reap_dead start 2024-04-25T09:56:00.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.077+0000 7fb42ed08f40 1 -- 172.21.15.7:0/823684153 shutdown_connections 2024-04-25T09:56:00.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.077+0000 7fb42ed08f40 1 -- 172.21.15.7:0/823684153 >> 172.21.15.7:0/823684153 conn(0x560e13e2da60 msgr2=0x560e13ee8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:00.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.077+0000 7fb42ed08f40 1 -- 172.21.15.7:0/823684153 shutdown_connections 2024-04-25T09:56:00.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.077+0000 7fb42ed08f40 1 -- 172.21.15.7:0/823684153 wait complete. 2024-04-25T09:56:00.087 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:56:00.087 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:56:00.167 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:56:00.206 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:56:00.206 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:56:00.206 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:56:00.224 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13704 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:56:00.224 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:56:00.224 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:56:00.265 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19023 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:56:00.265 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:56:00.265 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:56:00.281 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13704 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:56:00.281 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:56:00.281 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:56:00.323 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19023 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:56:00.324 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:56:00.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.421+0000 7fb5daa8f640 1 Processor -- start 2024-04-25T09:56:00.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.421+0000 7fb5daa8f640 1 -- start start 2024-04-25T09:56:00.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.422+0000 7fb5daa8f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5d415db00 0x7fb5d40d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:00.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.422+0000 7fb5daa8f640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb5d40ce2b0 0x7fb5d40d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:00.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.422+0000 7fb5daa8f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5d40d1e80 con 0x7fb5d40b53b0 2024-04-25T09:56:00.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.422+0000 7fb5daa8f640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5d40b5930 con 0x7fb5d40ce2b0 2024-04-25T09:56:00.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.422+0000 7fb5daa8f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d40b5c10 con 0x7fb5d415db00 2024-04-25T09:56:00.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.422+0000 7fb5d902c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb5d40ce2b0 0x7fb5d40d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:00.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.422+0000 7fb5d902c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb5d40ce2b0 0x7fb5d40d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35138/0 (socket says 172.21.15.7:35138) 2024-04-25T09:56:00.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.422+0000 7fb5d902c640 1 -- 172.21.15.7:0/1802519192 learned_addr learned my addr 172.21.15.7:0/1802519192 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:00.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.422+0000 7fb5d882b640 1 --2- 172.21.15.7:0/1802519192 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5d415db00 0x7fb5d40d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:00.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.423+0000 7fb5d902c640 1 -- 172.21.15.7:0/1802519192 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5d415db00 msgr2=0x7fb5d40d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:00.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.423+0000 7fb5d902c640 1 --2- 172.21.15.7:0/1802519192 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5d415db00 0x7fb5d40d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:00.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.423+0000 7fb5d902c640 1 -- 172.21.15.7:0/1802519192 >> v1:172.21.15.55:6789/0 conn(0x7fb5d40b53b0 legacy=0x7fb5d4161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:00.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.423+0000 7fb5d902c640 1 -- 172.21.15.7:0/1802519192 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d40b5ef0 con 0x7fb5d40ce2b0 2024-04-25T09:56:00.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.423+0000 7fb5d882b640 1 --2- 172.21.15.7:0/1802519192 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5d415db00 0x7fb5d40d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:56:00.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.423+0000 7fb5d902c640 1 --2- 172.21.15.7:0/1802519192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d40ce2b0 0x7fb5d40d0880 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc009e50 tx=0x7fb5cc02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f598c1b7294c71f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:00.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.423+0000 7fb5d37fe640 1 -- 172.21.15.7:0/1802519192 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc036070 con 0x7fb5d40ce2b0 2024-04-25T09:56:00.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.423+0000 7fb5d37fe640 1 -- 172.21.15.7:0/1802519192 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5cc031600 con 0x7fb5d40ce2b0 2024-04-25T09:56:00.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.423+0000 7fb5d37fe640 1 -- 172.21.15.7:0/1802519192 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc0319d0 con 0x7fb5d40ce2b0 2024-04-25T09:56:00.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.424+0000 7fb5daa8f640 1 -- 172.21.15.7:0/1802519192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d40ce2b0 msgr2=0x7fb5d40d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:00.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.424+0000 7fb5daa8f640 1 --2- 172.21.15.7:0/1802519192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d40ce2b0 0x7fb5d40d0880 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc009e50 tx=0x7fb5cc02a6c0 comp rx=0 tx=0).stop 2024-04-25T09:56:00.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.424+0000 7fb5daa8f640 1 -- 172.21.15.7:0/1802519192 shutdown_connections 2024-04-25T09:56:00.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.424+0000 7fb5daa8f640 1 --2- 172.21.15.7:0/1802519192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d40ce2b0 0x7fb5d40d0880 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:00.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.424+0000 7fb5daa8f640 1 --2- 172.21.15.7:0/1802519192 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5d415db00 0x7fb5d40d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:00.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.424+0000 7fb5daa8f640 1 -- 172.21.15.7:0/1802519192 >> 172.21.15.7:0/1802519192 conn(0x7fb5d4072290 msgr2=0x7fb5d40726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:00.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.424+0000 7fb5daa8f640 1 -- 172.21.15.7:0/1802519192 shutdown_connections 2024-04-25T09:56:00.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.424+0000 7fb5daa8f640 1 -- 172.21.15.7:0/1802519192 wait complete. 2024-04-25T09:56:00.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.425+0000 7fb5daa8f640 1 Processor -- start 2024-04-25T09:56:00.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.425+0000 7fb5daa8f640 1 -- start start 2024-04-25T09:56:00.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.426+0000 7fb5daa8f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5d40b53b0 0x7fb5d414f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:00.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.426+0000 7fb5daa8f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5d40ce2b0 0x7fb5d415e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:00.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.426+0000 7fb5daa8f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d415db00 0x7fb5d40c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:00.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.426+0000 7fb5daa8f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d40d3660 con 0x7fb5d415db00 2024-04-25T09:56:00.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.426+0000 7fb5daa8f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d40b61d0 con 0x7fb5d40ce2b0 2024-04-25T09:56:00.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.426+0000 7fb5daa8f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d40b6c10 con 0x7fb5d40b53b0 2024-04-25T09:56:00.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.426+0000 7fb5d902c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d415db00 0x7fb5d40c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:00.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.426+0000 7fb5d902c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d415db00 0x7fb5d40c9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35146/0 (socket says 172.21.15.7:35146) 2024-04-25T09:56:00.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.426+0000 7fb5d902c640 1 -- 172.21.15.7:0/2097196163 learned_addr learned my addr 172.21.15.7:0/2097196163 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:00.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.426+0000 7fb5d882b640 1 --2- 172.21.15.7:0/2097196163 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5d40b53b0 0x7fb5d414f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:00.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.426+0000 7fb5d3fff640 1 --2- 172.21.15.7:0/2097196163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5d40ce2b0 0x7fb5d415e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:00.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.426+0000 7fb5d902c640 1 -- 172.21.15.7:0/2097196163 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5d40b53b0 msgr2=0x7fb5d414f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:00.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.426+0000 7fb5d902c640 1 --2- 172.21.15.7:0/2097196163 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5d40b53b0 0x7fb5d414f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:00.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.426+0000 7fb5d902c640 1 -- 172.21.15.7:0/2097196163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5d40ce2b0 msgr2=0x7fb5d415e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:00.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.426+0000 7fb5d902c640 1 --2- 172.21.15.7:0/2097196163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5d40ce2b0 0x7fb5d415e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:00.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.426+0000 7fb5d902c640 1 -- 172.21.15.7:0/2097196163 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d40c9a50 con 0x7fb5d415db00 2024-04-25T09:56:00.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.426+0000 7fb5d3fff640 1 --2- 172.21.15.7:0/2097196163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5d40ce2b0 0x7fb5d415e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:00.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.427+0000 7fb5d902c640 1 --2- 172.21.15.7:0/2097196163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d415db00 0x7fb5d40c9070 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc034040 tx=0x7fb5cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:00.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.427+0000 7fb5d17fa640 1 -- 172.21.15.7:0/2097196163 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc03f020 con 0x7fb5d415db00 2024-04-25T09:56:00.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.427+0000 7fb5d17fa640 1 -- 172.21.15.7:0/2097196163 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5cc037040 con 0x7fb5d415db00 2024-04-25T09:56:00.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.427+0000 7fb5d17fa640 1 -- 172.21.15.7:0/2097196163 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc036070 con 0x7fb5d415db00 2024-04-25T09:56:00.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.427+0000 7fb5daa8f640 1 -- 172.21.15.7:0/2097196163 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d40cab30 con 0x7fb5d415db00 2024-04-25T09:56:00.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.427+0000 7fb5daa8f640 1 -- 172.21.15.7:0/2097196163 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d40cb0f0 con 0x7fb5d415db00 2024-04-25T09:56:00.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.428+0000 7fb5daa8f640 1 -- 172.21.15.7:0/2097196163 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5d4068fd0 con 0x7fb5d415db00 2024-04-25T09:56:00.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.428+0000 7fb5d17fa640 1 -- 172.21.15.7:0/2097196163 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb5cc042020 con 0x7fb5d415db00 2024-04-25T09:56:00.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.429+0000 7fb5d17fa640 1 --2- 172.21.15.7:0/2097196163 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb5c006b500 0x7fb5c006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:00.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.429+0000 7fb5d882b640 1 --2- 172.21.15.7:0/2097196163 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb5c006b500 0x7fb5c006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:00.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.429+0000 7fb5d17fa640 1 -- 172.21.15.7:0/2097196163 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb5cc0aa7d0 con 0x7fb5d415db00 2024-04-25T09:56:00.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.429+0000 7fb5d882b640 1 --2- 172.21.15.7:0/2097196163 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb5c006b500 0x7fb5c006d9c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb5c400aac0 tx=0x7fb5c4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:00.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.434+0000 7fb5d17fa640 1 -- 172.21.15.7:0/2097196163 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb5cc049030 con 0x7fb5d415db00 2024-04-25T09:56:00.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.652+0000 7fb5daa8f640 1 -- 172.21.15.7:0/2097196163 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5d40d16b0 con 0x7fb5d415db00 2024-04-25T09:56:00.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.653+0000 7fb5d17fa640 1 -- 172.21.15.7:0/2097196163 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4929 (secure 0 0 0) 0x7fb5cc079550 con 0x7fb5d415db00 2024-04-25T09:56:00.657 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:00.657 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5047,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2022061608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2022061608},{"type":"v1","addr":"172.21.15.55:6834","nonce":2022061608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5382,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/2607466795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2607466795},{"type":"v1","addr":"172.21.15.7:6836","nonce":2607466795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5385,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1576325055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1576325055},{"type":"v1","addr":"172.21.15.7:6837","nonce":1576325055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:55:35.091962+0000","modified":"2024-04-25T09:55:37.095949+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5391":{"gid":5391,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/223801838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":223801838},{"type":"v1","addr":"172.21.15.55:6835","nonce":223801838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T09:56:00.657 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 15 2024-04-25T09:56:00.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.655+0000 7fb5daa8f640 1 -- 172.21.15.7:0/2097196163 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb5c006b500 msgr2=0x7fb5c006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:00.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.655+0000 7fb5daa8f640 1 --2- 172.21.15.7:0/2097196163 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb5c006b500 0x7fb5c006d9c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb5c400aac0 tx=0x7fb5c4008040 comp rx=0 tx=0).stop 2024-04-25T09:56:00.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.655+0000 7fb5daa8f640 1 -- 172.21.15.7:0/2097196163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d415db00 msgr2=0x7fb5d40c9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:00.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.655+0000 7fb5daa8f640 1 --2- 172.21.15.7:0/2097196163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d415db00 0x7fb5d40c9070 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc034040 tx=0x7fb5cc004a40 comp rx=0 tx=0).stop 2024-04-25T09:56:00.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.655+0000 7fb5daa8f640 1 -- 172.21.15.7:0/2097196163 shutdown_connections 2024-04-25T09:56:00.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.655+0000 7fb5daa8f640 1 --2- 172.21.15.7:0/2097196163 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb5c006b500 0x7fb5c006d9c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:00.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.655+0000 7fb5daa8f640 1 --2- 172.21.15.7:0/2097196163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5d415db00 0x7fb5d40c9070 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:00.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.655+0000 7fb5daa8f640 1 --2- 172.21.15.7:0/2097196163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5d40ce2b0 0x7fb5d415e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:00.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.655+0000 7fb5daa8f640 1 --2- 172.21.15.7:0/2097196163 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5d40b53b0 0x7fb5d414f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:00.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.655+0000 7fb5daa8f640 1 -- 172.21.15.7:0/2097196163 >> 172.21.15.7:0/2097196163 conn(0x7fb5d4072290 msgr2=0x7fb5d4157b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:00.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.655+0000 7fb5daa8f640 1 -- 172.21.15.7:0/2097196163 shutdown_connections 2024-04-25T09:56:00.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.655+0000 7fb5daa8f640 1 -- 172.21.15.7:0/2097196163 wait complete. 2024-04-25T09:56:00.669 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:56:00.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.767+0000 7f68d0c58640 1 Processor -- start 2024-04-25T09:56:00.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.767+0000 7f68d0c58640 1 -- start start 2024-04-25T09:56:00.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.768+0000 7f68d0c58640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f68cc06e970 0x7f68cc0cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:00.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.768+0000 7f68d0c58640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68cc0cdbf0 con 0x7f68cc0ced20 2024-04-25T09:56:00.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.768+0000 7f68d0c58640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68cc0cded0 con 0x7f68cc144100 2024-04-25T09:56:00.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.768+0000 7f68d0c58640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68cc1444e0 con 0x7f68cc06e970 2024-04-25T09:56:00.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.768+0000 7f68c9d9b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f68cc06e970 0x7f68cc0cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:00.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.768+0000 7f68c9d9b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f68cc06e970 0x7f68cc0cd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35152/0 (socket says 172.21.15.7:35152) 2024-04-25T09:56:00.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.768+0000 7f68c9d9b640 1 -- 172.21.15.7:0/3876904043 learned_addr learned my addr 172.21.15.7:0/3876904043 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:00.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.768+0000 7f68cad9d640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f68cc0ced20 0x7f68cc15b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39276/0 (socket says 172.21.15.7:39276) 2024-04-25T09:56:00.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.768+0000 7f68c9d9b640 1 -- 172.21.15.7:0/3876904043 >> v1:172.21.15.55:6789/0 conn(0x7f68cc144100 legacy=0x7f68cc06e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:00.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.768+0000 7f68c9d9b640 1 -- 172.21.15.7:0/3876904043 >> v1:172.21.15.7:6789/0 conn(0x7f68cc0ced20 legacy=0x7f68cc15b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:00.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.768+0000 7f68c9d9b640 1 -- 172.21.15.7:0/3876904043 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68cc0ce1b0 con 0x7f68cc06e970 2024-04-25T09:56:00.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.768+0000 7f68c959a640 1 -- 172.21.15.7:0/3876904043 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2605148311 0 0) 0x7f68cc0cdbf0 con 0x7f68cc0ced20 2024-04-25T09:56:00.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.769+0000 7f68c9d9b640 1 --2- 172.21.15.7:0/3876904043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68cc06e970 0x7f68cc0cd610 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f68c0009870 tx=0x7f68c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=276e4a23d5d24481 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:00.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.769+0000 7f68c959a640 1 -- 172.21.15.7:0/3876904043 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c0037070 con 0x7f68cc06e970 2024-04-25T09:56:00.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.769+0000 7f68c959a640 1 -- 172.21.15.7:0/3876904043 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c0032440 con 0x7f68cc06e970 2024-04-25T09:56:00.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.769+0000 7f68c959a640 1 -- 172.21.15.7:0/3876904043 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c0032810 con 0x7f68cc06e970 2024-04-25T09:56:00.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.770+0000 7f68d0c58640 1 -- 172.21.15.7:0/3876904043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68cc06e970 msgr2=0x7f68cc0cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:00.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.770+0000 7f68d0c58640 1 --2- 172.21.15.7:0/3876904043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68cc06e970 0x7f68cc0cd610 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f68c0009870 tx=0x7f68c002a270 comp rx=0 tx=0).stop 2024-04-25T09:56:00.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.770+0000 7f68d0c58640 1 -- 172.21.15.7:0/3876904043 shutdown_connections 2024-04-25T09:56:00.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.770+0000 7f68d0c58640 1 --2- 172.21.15.7:0/3876904043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68cc06e970 0x7f68cc0cd610 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:00.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.770+0000 7f68d0c58640 1 -- 172.21.15.7:0/3876904043 >> 172.21.15.7:0/3876904043 conn(0x7f68cc071150 msgr2=0x7f68cc071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:00.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.770+0000 7f68d0c58640 1 -- 172.21.15.7:0/3876904043 shutdown_connections 2024-04-25T09:56:00.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.770+0000 7f68d0c58640 1 -- 172.21.15.7:0/3876904043 wait complete. 2024-04-25T09:56:00.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.771+0000 7f68d0c58640 1 Processor -- start 2024-04-25T09:56:00.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.771+0000 7f68d0c58640 1 -- start start 2024-04-25T09:56:00.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.772+0000 7f68d0c58640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68cc06e970 0x7f68cc0cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:00.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.772+0000 7f68d0c58640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68cc0ced20 0x7f68cc159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:00.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.772+0000 7f68d0c58640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f68cc144100 0x7f68cc15a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.772+0000 7f68d0c58640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc0cea00 con 0x7f68cc06e970 2024-04-25T09:56:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.772+0000 7f68d0c58640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc15ac70 con 0x7f68cc0ced20 2024-04-25T09:56:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.772+0000 7f68d0c58640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc15b840 con 0x7f68cc144100 2024-04-25T09:56:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.772+0000 7f68ca59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68cc06e970 0x7f68cc0cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.772+0000 7f68ca59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68cc06e970 0x7f68cc0cbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35160/0 (socket says 172.21.15.7:35160) 2024-04-25T09:56:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.772+0000 7f68ca59c640 1 -- 172.21.15.7:0/2368412465 learned_addr learned my addr 172.21.15.7:0/2368412465 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.772+0000 7f68c9d9b640 1 --2- 172.21.15.7:0/2368412465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68cc0ced20 0x7f68cc159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.772+0000 7f68ca59c640 1 -- 172.21.15.7:0/2368412465 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f68cc144100 msgr2=0x7f68cc15a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.772+0000 7f68cad9d640 1 --2- 172.21.15.7:0/2368412465 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f68cc144100 0x7f68cc15a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.772+0000 7f68ca59c640 1 --2- 172.21.15.7:0/2368412465 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f68cc144100 0x7f68cc15a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.772+0000 7f68ca59c640 1 -- 172.21.15.7:0/2368412465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68cc0ced20 msgr2=0x7f68cc159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.772+0000 7f68ca59c640 1 --2- 172.21.15.7:0/2368412465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68cc0ced20 0x7f68cc159dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.772+0000 7f68ca59c640 1 -- 172.21.15.7:0/2368412465 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68cc1f34a0 con 0x7f68cc06e970 2024-04-25T09:56:00.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.773+0000 7f68ca59c640 1 --2- 172.21.15.7:0/2368412465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68cc06e970 0x7f68cc0cbdc0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f68c400c430 tx=0x7f68c400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:00.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.773+0000 7f68baffd640 1 -- 172.21.15.7:0/2368412465 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c4017070 con 0x7f68cc06e970 2024-04-25T09:56:00.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.773+0000 7f68baffd640 1 -- 172.21.15.7:0/2368412465 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c40052d0 con 0x7f68cc06e970 2024-04-25T09:56:00.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.773+0000 7f68d0c58640 1 -- 172.21.15.7:0/2368412465 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68cc1e6740 con 0x7f68cc06e970 2024-04-25T09:56:00.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.773+0000 7f68baffd640 1 -- 172.21.15.7:0/2368412465 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c4003830 con 0x7f68cc06e970 2024-04-25T09:56:00.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.773+0000 7f68d0c58640 1 -- 172.21.15.7:0/2368412465 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68cc1f3a40 con 0x7f68cc06e970 2024-04-25T09:56:00.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.774+0000 7f68d0c58640 1 -- 172.21.15.7:0/2368412465 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68cc068fd0 con 0x7f68cc06e970 2024-04-25T09:56:00.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.774+0000 7f68baffd640 1 -- 172.21.15.7:0/2368412465 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f68c401a070 con 0x7f68cc06e970 2024-04-25T09:56:00.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.775+0000 7f68baffd640 1 --2- 172.21.15.7:0/2368412465 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f68ac06b4d0 0x7f68ac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:00.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.775+0000 7f68baffd640 1 -- 172.21.15.7:0/2368412465 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f68c4089680 con 0x7f68cc06e970 2024-04-25T09:56:00.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.775+0000 7f68c9d9b640 1 --2- 172.21.15.7:0/2368412465 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f68ac06b4d0 0x7f68ac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:00.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.775+0000 7f68c9d9b640 1 --2- 172.21.15.7:0/2368412465 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f68ac06b4d0 0x7f68ac06d990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f68c0034000 tx=0x7f68c002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:00.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.779+0000 7f68baffd640 1 -- 172.21.15.7:0/2368412465 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f68c4058400 con 0x7f68cc06e970 2024-04-25T09:56:00.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.960+0000 7f68d0c58640 1 -- 172.21.15.7:0/2368412465 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68cc06c1a0 con 0x7f68cc06e970 2024-04-25T09:56:00.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.961+0000 7f68baffd640 1 -- 172.21.15.7:0/2368412465 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16846 (secure 0 0 0) 0x7f68c4057d00 con 0x7f68cc06e970 2024-04-25T09:56:00.965 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:00.965 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":39,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:55:36.722817+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:55:33.644089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T09:55:34.059847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:56:00.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.963+0000 7f68d0c58640 1 -- 172.21.15.7:0/2368412465 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f68ac06b4d0 msgr2=0x7f68ac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:00.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.963+0000 7f68d0c58640 1 --2- 172.21.15.7:0/2368412465 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f68ac06b4d0 0x7f68ac06d990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f68c0034000 tx=0x7f68c002e000 comp rx=0 tx=0).stop 2024-04-25T09:56:00.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.963+0000 7f68d0c58640 1 -- 172.21.15.7:0/2368412465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68cc06e970 msgr2=0x7f68cc0cbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:00.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.963+0000 7f68d0c58640 1 --2- 172.21.15.7:0/2368412465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68cc06e970 0x7f68cc0cbdc0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f68c400c430 tx=0x7f68c400c8f0 comp rx=0 tx=0).stop 2024-04-25T09:56:00.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.963+0000 7f68d0c58640 1 -- 172.21.15.7:0/2368412465 shutdown_connections 2024-04-25T09:56:00.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.963+0000 7f68d0c58640 1 --2- 172.21.15.7:0/2368412465 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f68ac06b4d0 0x7f68ac06d990 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:00.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.963+0000 7f68d0c58640 1 --2- 172.21.15.7:0/2368412465 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f68cc144100 0x7f68cc15a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:00.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.963+0000 7f68d0c58640 1 --2- 172.21.15.7:0/2368412465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68cc0ced20 0x7f68cc159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:00.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.963+0000 7f68d0c58640 1 --2- 172.21.15.7:0/2368412465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68cc06e970 0x7f68cc0cbdc0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:00.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.963+0000 7f68d0c58640 1 -- 172.21.15.7:0/2368412465 >> 172.21.15.7:0/2368412465 conn(0x7f68cc071150 msgr2=0x7f68cc0c8520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:00.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.963+0000 7f68d0c58640 1 -- 172.21.15.7:0/2368412465 shutdown_connections 2024-04-25T09:56:00.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:00.963+0000 7f68d0c58640 1 -- 172.21.15.7:0/2368412465 wait complete. 2024-04-25T09:56:00.977 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:55:33.644089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:55:34.059847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:56:00.978 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:56:01.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.079+0000 7f2999b5c640 1 Processor -- start 2024-04-25T09:56:01.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.079+0000 7f2999b5c640 1 -- start start 2024-04-25T09:56:01.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.079+0000 7f2999b5c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f29940d3760 0x7f299415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:01.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.079+0000 7f2999b5c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f29940ce830 0x7f29940b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:01.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.079+0000 7f2999b5c640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29940ced10 con 0x7f299415f1c0 2024-04-25T09:56:01.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.080+0000 7f2999b5c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29940ce380 con 0x7f29940ce830 2024-04-25T09:56:01.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.080+0000 7f2999b5c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299415f000 con 0x7f29940d3760 2024-04-25T09:56:01.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.080+0000 7f2992ffd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f299415f1c0 0x7f29940d3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39282/0 (socket says 172.21.15.7:39282) 2024-04-25T09:56:01.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.080+0000 7f2992ffd640 1 -- 172.21.15.7:0/1190075826 learned_addr learned my addr 172.21.15.7:0/1190075826 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:56:01.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.080+0000 7f29927fc640 1 -- 172.21.15.7:0/1190075826 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3154570389 0 0) 0x7f29940ced10 con 0x7f299415f1c0 2024-04-25T09:56:01.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.080+0000 7f29937fe640 1 --2- 172.21.15.7:0/1190075826 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f29940d3760 0x7f299415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:01.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.080+0000 7f29927fc640 1 -- 172.21.15.7:0/1190075826 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f297c003520 con 0x7f299415f1c0 2024-04-25T09:56:01.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.080+0000 7f2993fff640 1 --2- 172.21.15.7:0/1190075826 >> v2:172.21.15.55:3300/0 conn(0x7f29940ce830 0x7f29940b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:01.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.080+0000 7f29927fc640 1 -- 172.21.15.7:0/1190075826 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3092888595 0 0) 0x7f297c003520 con 0x7f299415f1c0 2024-04-25T09:56:01.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.080+0000 7f29927fc640 1 -- 172.21.15.7:0/1190075826 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f29940d3760 msgr2=0x7f299415eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:01.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.080+0000 7f29927fc640 1 --2- 172.21.15.7:0/1190075826 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f29940d3760 0x7f299415eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:01.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.080+0000 7f29927fc640 1 -- 172.21.15.7:0/1190075826 >> v2:172.21.15.55:3300/0 conn(0x7f29940ce830 msgr2=0x7f29940b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:01.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.080+0000 7f29927fc640 1 --2- 172.21.15.7:0/1190075826 >> v2:172.21.15.55:3300/0 conn(0x7f29940ce830 0x7f29940b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:01.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.080+0000 7f29927fc640 1 -- 172.21.15.7:0/1190075826 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29940d1b40 con 0x7f299415f1c0 2024-04-25T09:56:01.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.080+0000 7f29927fc640 1 -- 172.21.15.7:0/1190075826 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f2988001670 con 0x7f299415f1c0 2024-04-25T09:56:01.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.080+0000 7f29927fc640 1 -- 172.21.15.7:0/1190075826 >> v1:172.21.15.7:6789/0 conn(0x7f299415f1c0 legacy=0x7f29940d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:01.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.080+0000 7f29927fc640 1 --2- 172.21.15.7:0/1190075826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f297c0039b0 0x7f297c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:01.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.080+0000 7f29927fc640 1 --2- 172.21.15.7:0/1190075826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f297c004800 0x7f297c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:01.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.080+0000 7f29927fc640 1 --2- 172.21.15.7:0/1190075826 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f29940d3760 0x7f297c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:01.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.080+0000 7f29927fc640 1 -- 172.21.15.7:0/1190075826 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299415f000 con 0x7f297c0039b0 2024-04-25T09:56:01.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.080+0000 7f29927fc640 1 -- 172.21.15.7:0/1190075826 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297c00b9c0 con 0x7f297c004800 2024-04-25T09:56:01.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.080+0000 7f29927fc640 1 -- 172.21.15.7:0/1190075826 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f297c00bb40 con 0x7f29940d3760 2024-04-25T09:56:01.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.080+0000 7f29937fe640 1 --2- 172.21.15.7:0/1190075826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f297c0039b0 0x7f297c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:01.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.081+0000 7f2992ffd640 1 --2- 172.21.15.7:0/1190075826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f297c004800 0x7f297c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:01.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.081+0000 7f2993fff640 1 --2- 172.21.15.7:0/1190075826 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f29940d3760 0x7f297c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:01.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.081+0000 7f29937fe640 1 -- 172.21.15.7:0/1190075826 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f29940d3760 msgr2=0x7f297c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:01.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.081+0000 7f29937fe640 1 --2- 172.21.15.7:0/1190075826 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f29940d3760 0x7f297c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:01.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.081+0000 7f29937fe640 1 -- 172.21.15.7:0/1190075826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f297c004800 msgr2=0x7f297c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:01.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.081+0000 7f29937fe640 1 --2- 172.21.15.7:0/1190075826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f297c004800 0x7f297c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:01.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.081+0000 7f29937fe640 1 -- 172.21.15.7:0/1190075826 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f297c003520 con 0x7f297c0039b0 2024-04-25T09:56:01.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.081+0000 7f2992ffd640 1 --2- 172.21.15.7:0/1190075826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f297c004800 0x7f297c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:01.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.081+0000 7f2993fff640 1 --2- 172.21.15.7:0/1190075826 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f29940d3760 0x7f297c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:01.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.081+0000 7f29937fe640 1 --2- 172.21.15.7:0/1190075826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f297c0039b0 0x7f297c003dd0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2984009ac0 tx=0x7f297c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9b473bc458146e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:01.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.082+0000 7f29927fc640 1 -- 172.21.15.7:0/1190075826 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2984036070 con 0x7f297c0039b0 2024-04-25T09:56:01.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.082+0000 7f29927fc640 1 -- 172.21.15.7:0/1190075826 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2984031400 con 0x7f297c0039b0 2024-04-25T09:56:01.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.082+0000 7f29927fc640 1 -- 172.21.15.7:0/1190075826 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2984009690 con 0x7f297c0039b0 2024-04-25T09:56:01.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.082+0000 7f2999b5c640 1 -- 172.21.15.7:0/1190075826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f297c0039b0 msgr2=0x7f297c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:01.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.082+0000 7f2999b5c640 1 --2- 172.21.15.7:0/1190075826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f297c0039b0 0x7f297c003dd0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2984009ac0 tx=0x7f297c005830 comp rx=0 tx=0).stop 2024-04-25T09:56:01.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.082+0000 7f2993fff640 1 -- 172.21.15.7:0/1190075826 reap_dead start 2024-04-25T09:56:01.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.082+0000 7f2999b5c640 1 -- 172.21.15.7:0/1190075826 shutdown_connections 2024-04-25T09:56:01.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.082+0000 7f2999b5c640 1 -- 172.21.15.7:0/1190075826 >> 172.21.15.7:0/1190075826 conn(0x7f2994072680 msgr2=0x7f2994072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:01.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.082+0000 7f2999b5c640 1 -- 172.21.15.7:0/1190075826 shutdown_connections 2024-04-25T09:56:01.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.082+0000 7f2999b5c640 1 -- 172.21.15.7:0/1190075826 wait complete. 2024-04-25T09:56:01.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.083+0000 7f2999b5c640 1 Processor -- start 2024-04-25T09:56:01.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.084+0000 7f2999b5c640 1 -- start start 2024-04-25T09:56:01.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.084+0000 7f2999b5c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f297c0039b0 0x7f29940cd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:01.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.084+0000 7f2999b5c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2994159d70 0x7f29941e75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:01.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.084+0000 7f2999b5c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29941e7b00 0x7f29941f6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:01.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.084+0000 7f2999b5c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299415de10 con 0x7f29941e7b00 2024-04-25T09:56:01.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.084+0000 7f2999b5c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29940d2190 con 0x7f2994159d70 2024-04-25T09:56:01.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.084+0000 7f2999b5c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299415eac0 con 0x7f297c0039b0 2024-04-25T09:56:01.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.084+0000 7f2993fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29941e7b00 0x7f29941f6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:01.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.084+0000 7f2993fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29941e7b00 0x7f29941f6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35186/0 (socket says 172.21.15.7:35186) 2024-04-25T09:56:01.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.084+0000 7f2993fff640 1 -- 172.21.15.7:0/2493593177 learned_addr learned my addr 172.21.15.7:0/2493593177 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:01.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.085+0000 7f2992ffd640 1 --2- 172.21.15.7:0/2493593177 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2994159d70 0x7f29941e75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:01.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.085+0000 7f29937fe640 1 --2- 172.21.15.7:0/2493593177 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f297c0039b0 0x7f29940cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:01.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.085+0000 7f2993fff640 1 -- 172.21.15.7:0/2493593177 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f297c0039b0 msgr2=0x7f29940cd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:01.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.085+0000 7f2993fff640 1 --2- 172.21.15.7:0/2493593177 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f297c0039b0 0x7f29940cd070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:01.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.085+0000 7f2993fff640 1 -- 172.21.15.7:0/2493593177 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2994159d70 msgr2=0x7f29941e75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:01.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.085+0000 7f2993fff640 1 --2- 172.21.15.7:0/2493593177 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2994159d70 0x7f29941e75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:01.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.085+0000 7f2993fff640 1 -- 172.21.15.7:0/2493593177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29940cd5b0 con 0x7f29941e7b00 2024-04-25T09:56:01.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.085+0000 7f2993fff640 1 --2- 172.21.15.7:0/2493593177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29941e7b00 0x7f29941f6fe0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f29940cec40 tx=0x7f298c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:01.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.085+0000 7f297bfff640 1 -- 172.21.15.7:0/2493593177 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c01a030 con 0x7f29941e7b00 2024-04-25T09:56:01.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.085+0000 7f297bfff640 1 -- 172.21.15.7:0/2493593177 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c010e20 con 0x7f29941e7b00 2024-04-25T09:56:01.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.085+0000 7f2999b5c640 1 -- 172.21.15.7:0/2493593177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29941e6c00 con 0x7f29941e7b00 2024-04-25T09:56:01.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.085+0000 7f297bfff640 1 -- 172.21.15.7:0/2493593177 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c003bd0 con 0x7f29941e7b00 2024-04-25T09:56:01.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.085+0000 7f2999b5c640 1 -- 172.21.15.7:0/2493593177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29940ca9d0 con 0x7f29941e7b00 2024-04-25T09:56:01.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.086+0000 7f2999b5c640 1 -- 172.21.15.7:0/2493593177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2994068f60 con 0x7f29941e7b00 2024-04-25T09:56:01.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.086+0000 7f297bfff640 1 -- 172.21.15.7:0/2493593177 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f298c01d070 con 0x7f29941e7b00 2024-04-25T09:56:01.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.087+0000 7f297bfff640 1 --2- 172.21.15.7:0/2493593177 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f298006b4d0 0x7f298006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:01.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.087+0000 7f297bfff640 1 -- 172.21.15.7:0/2493593177 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f298c08a8b0 con 0x7f29941e7b00 2024-04-25T09:56:01.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.087+0000 7f29937fe640 1 --2- 172.21.15.7:0/2493593177 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f298006b4d0 0x7f298006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:01.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.087+0000 7f29937fe640 1 --2- 172.21.15.7:0/2493593177 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f298006b4d0 0x7f298006d990 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2984033000 tx=0x7f2984008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:01.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.091+0000 7f297bfff640 1 -- 172.21.15.7:0/2493593177 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f29940cd5b0 con 0x7f29941e7b00 2024-04-25T09:56:01.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.269+0000 7f2999b5c640 1 -- 172.21.15.7:0/2493593177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f29941e73a0 con 0x7f29941e7b00 2024-04-25T09:56:01.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.270+0000 7f297bfff640 1 -- 172.21.15.7:0/2493593177 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f298c059630 con 0x7f29941e7b00 2024-04-25T09:56:01.273 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T09:56:01.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.271+0000 7f2999b5c640 1 -- 172.21.15.7:0/2493593177 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f298006b4d0 msgr2=0x7f298006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:01.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.271+0000 7f2999b5c640 1 --2- 172.21.15.7:0/2493593177 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f298006b4d0 0x7f298006d990 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2984033000 tx=0x7f2984008030 comp rx=0 tx=0).stop 2024-04-25T09:56:01.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.271+0000 7f2999b5c640 1 -- 172.21.15.7:0/2493593177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29941e7b00 msgr2=0x7f29941f6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:01.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.271+0000 7f2999b5c640 1 --2- 172.21.15.7:0/2493593177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29941e7b00 0x7f29941f6fe0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f29940cec40 tx=0x7f298c009f90 comp rx=0 tx=0).stop 2024-04-25T09:56:01.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.271+0000 7f2999b5c640 1 -- 172.21.15.7:0/2493593177 shutdown_connections 2024-04-25T09:56:01.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.271+0000 7f2999b5c640 1 --2- 172.21.15.7:0/2493593177 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f298006b4d0 0x7f298006d990 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:01.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.271+0000 7f2999b5c640 1 --2- 172.21.15.7:0/2493593177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29941e7b00 0x7f29941f6fe0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:01.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.271+0000 7f2999b5c640 1 --2- 172.21.15.7:0/2493593177 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2994159d70 0x7f29941e75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:01.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.271+0000 7f2999b5c640 1 --2- 172.21.15.7:0/2493593177 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f297c0039b0 0x7f29940cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:01.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.271+0000 7f2999b5c640 1 -- 172.21.15.7:0/2493593177 >> 172.21.15.7:0/2493593177 conn(0x7f2994072680 msgr2=0x7f29940b78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:01.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.272+0000 7f2999b5c640 1 -- 172.21.15.7:0/2493593177 shutdown_connections 2024-04-25T09:56:01.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.272+0000 7f2999b5c640 1 -- 172.21.15.7:0/2493593177 wait complete. 2024-04-25T09:56:01.286 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:56:01.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.386+0000 7f6a0ea8f640 1 Processor -- start 2024-04-25T09:56:01.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.386+0000 7f6a0ea8f640 1 -- start start 2024-04-25T09:56:01.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.387+0000 7f6a0ea8f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6a0806bf10 0x7f6a080999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:01.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.387+0000 7f6a0ea8f640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6a08099f30 0x7f6a0815d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:01.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.387+0000 7f6a0ea8f640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a080d02f0 con 0x7f6a080cda20 2024-04-25T09:56:01.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.387+0000 7f6a0ea8f640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a080cde00 con 0x7f6a08099f30 2024-04-25T09:56:01.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.387+0000 7f6a0ea8f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a080d05d0 con 0x7f6a0806bf10 2024-04-25T09:56:01.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.387+0000 7f6a0d02c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6a08099f30 0x7f6a0815d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:01.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.387+0000 7f6a0d02c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6a08099f30 0x7f6a0815d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35190/0 (socket says 172.21.15.7:35190) 2024-04-25T09:56:01.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.387+0000 7f6a0d02c640 1 -- 172.21.15.7:0/631849546 learned_addr learned my addr 172.21.15.7:0/631849546 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:01.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.387+0000 7f69fffff640 1 --2- 172.21.15.7:0/631849546 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6a0806bf10 0x7f6a080999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:01.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.387+0000 7f6a0d02c640 1 -- 172.21.15.7:0/631849546 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6a0806bf10 msgr2=0x7f6a080999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:01.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.387+0000 7f6a0d02c640 1 --2- 172.21.15.7:0/631849546 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6a0806bf10 0x7f6a080999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:01.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.387+0000 7f6a0d02c640 1 -- 172.21.15.7:0/631849546 >> v1:172.21.15.7:6789/0 conn(0x7f6a080cda20 legacy=0x7f6a080cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:01.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.387+0000 7f6a0d02c640 1 -- 172.21.15.7:0/631849546 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a080d08b0 con 0x7f6a08099f30 2024-04-25T09:56:01.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.387+0000 7f69ff7fe640 1 -- 172.21.15.7:0/631849546 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3950072438 0 0) 0x7f6a080d02f0 con 0x7f6a080cda20 2024-04-25T09:56:01.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.387+0000 7f69fffff640 1 --2- 172.21.15.7:0/631849546 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6a0806bf10 0x7f6a080999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:56:01.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.388+0000 7f6a0d02c640 1 --2- 172.21.15.7:0/631849546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a08099f30 0x7f6a0815d290 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009e50 tx=0x7f6a0002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451e5d4804841c4f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:01.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.388+0000 7f69ff7fe640 1 -- 172.21.15.7:0/631849546 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a00036070 con 0x7f6a08099f30 2024-04-25T09:56:01.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.388+0000 7f69ff7fe640 1 -- 172.21.15.7:0/631849546 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a00031600 con 0x7f6a08099f30 2024-04-25T09:56:01.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.388+0000 7f69ff7fe640 1 -- 172.21.15.7:0/631849546 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a000319d0 con 0x7f6a08099f30 2024-04-25T09:56:01.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.389+0000 7f6a0ea8f640 1 -- 172.21.15.7:0/631849546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a08099f30 msgr2=0x7f6a0815d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:01.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.389+0000 7f6a0ea8f640 1 --2- 172.21.15.7:0/631849546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a08099f30 0x7f6a0815d290 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009e50 tx=0x7f6a0002a710 comp rx=0 tx=0).stop 2024-04-25T09:56:01.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.389+0000 7f6a0ea8f640 1 -- 172.21.15.7:0/631849546 shutdown_connections 2024-04-25T09:56:01.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.389+0000 7f6a0ea8f640 1 --2- 172.21.15.7:0/631849546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a08099f30 0x7f6a0815d290 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:01.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.389+0000 7f6a0ea8f640 1 --2- 172.21.15.7:0/631849546 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6a0806bf10 0x7f6a080999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:01.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.389+0000 7f6a0ea8f640 1 -- 172.21.15.7:0/631849546 >> 172.21.15.7:0/631849546 conn(0x7f6a080b3110 msgr2=0x7f6a080b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:01.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.389+0000 7f6a0ea8f640 1 -- 172.21.15.7:0/631849546 shutdown_connections 2024-04-25T09:56:01.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.389+0000 7f6a0ea8f640 1 -- 172.21.15.7:0/631849546 wait complete. 2024-04-25T09:56:01.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.390+0000 7f6a0ea8f640 1 Processor -- start 2024-04-25T09:56:01.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.390+0000 7f6a0ea8f640 1 -- start start 2024-04-25T09:56:01.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.391+0000 7f6a0ea8f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6a0806bf10 0x7f6a0814c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:01.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.391+0000 7f6a0ea8f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a08099f30 0x7f6a0814d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:01.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.391+0000 7f6a0ea8f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a080cda20 0x7f6a0814de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:01.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.391+0000 7f6a0ea8f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0815d7d0 con 0x7f6a08099f30 2024-04-25T09:56:01.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.391+0000 7f6a0ea8f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a080d0e70 con 0x7f6a080cda20 2024-04-25T09:56:01.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.391+0000 7f6a0ea8f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0815d950 con 0x7f6a0806bf10 2024-04-25T09:56:01.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.391+0000 7f69fffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a08099f30 0x7f6a0814d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:01.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.391+0000 7f69fffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a08099f30 0x7f6a0814d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35204/0 (socket says 172.21.15.7:35204) 2024-04-25T09:56:01.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.391+0000 7f69fffff640 1 -- 172.21.15.7:0/13075727 learned_addr learned my addr 172.21.15.7:0/13075727 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:01.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.391+0000 7f6a0d02c640 1 --2- 172.21.15.7:0/13075727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a080cda20 0x7f6a0814de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:01.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.391+0000 7f6a0c82b640 1 --2- 172.21.15.7:0/13075727 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6a0806bf10 0x7f6a0814c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:01.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.391+0000 7f69fffff640 1 -- 172.21.15.7:0/13075727 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6a0806bf10 msgr2=0x7f6a0814c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:01.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.391+0000 7f69fffff640 1 --2- 172.21.15.7:0/13075727 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6a0806bf10 0x7f6a0814c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:01.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.391+0000 7f69fffff640 1 -- 172.21.15.7:0/13075727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a080cda20 msgr2=0x7f6a0814de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:01.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.391+0000 7f69fffff640 1 --2- 172.21.15.7:0/13075727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a080cda20 0x7f6a0814de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:01.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.391+0000 7f69fffff640 1 -- 172.21.15.7:0/13075727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0814cbb0 con 0x7f6a08099f30 2024-04-25T09:56:01.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.391+0000 7f69fffff640 1 --2- 172.21.15.7:0/13075727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a08099f30 0x7f6a0814d8e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f69f800c7f0 tx=0x7f69f800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:01.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.392+0000 7f69fd7fa640 1 -- 172.21.15.7:0/13075727 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f8015070 con 0x7f6a08099f30 2024-04-25T09:56:01.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.392+0000 7f69fd7fa640 1 -- 172.21.15.7:0/13075727 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f8007a30 con 0x7f6a08099f30 2024-04-25T09:56:01.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.392+0000 7f69fd7fa640 1 -- 172.21.15.7:0/13075727 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f8007e00 con 0x7f6a08099f30 2024-04-25T09:56:01.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.392+0000 7f6a0ea8f640 1 -- 172.21.15.7:0/13075727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a0814ce90 con 0x7f6a08099f30 2024-04-25T09:56:01.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.392+0000 7f6a0ea8f640 1 -- 172.21.15.7:0/13075727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a0814d450 con 0x7f6a08099f30 2024-04-25T09:56:01.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.393+0000 7f6a0ea8f640 1 -- 172.21.15.7:0/13075727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a08068f60 con 0x7f6a08099f30 2024-04-25T09:56:01.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.393+0000 7f69fd7fa640 1 -- 172.21.15.7:0/13075727 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f69f8018070 con 0x7f6a08099f30 2024-04-25T09:56:01.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.393+0000 7f69fd7fa640 1 --2- 172.21.15.7:0/13075727 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f69f406b4d0 0x7f69f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:01.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.393+0000 7f69fd7fa640 1 -- 172.21.15.7:0/13075727 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f69f808a2b0 con 0x7f6a08099f30 2024-04-25T09:56:01.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.394+0000 7f6a0c82b640 1 --2- 172.21.15.7:0/13075727 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f69f406b4d0 0x7f69f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:01.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.394+0000 7f6a0c82b640 1 --2- 172.21.15.7:0/13075727 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f69f406b4d0 0x7f69f406d990 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6a04007fd0 tx=0x7f6a04009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:01.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.398+0000 7f69fd7fa640 1 -- 172.21.15.7:0/13075727 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f69f8059030 con 0x7f6a08099f30 2024-04-25T09:56:01.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.575+0000 7f6a0ea8f640 1 -- 172.21.15.7:0/13075727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6a080cfa90 con 0x7f6a08099f30 2024-04-25T09:56:01.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.576+0000 7f69fd7fa640 1 -- 172.21.15.7:0/13075727 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7f69f8058930 con 0x7f6a08099f30 2024-04-25T09:56:01.579 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:56:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.577+0000 7f6a0ea8f640 1 -- 172.21.15.7:0/13075727 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f69f406b4d0 msgr2=0x7f69f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.577+0000 7f6a0ea8f640 1 --2- 172.21.15.7:0/13075727 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f69f406b4d0 0x7f69f406d990 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6a04007fd0 tx=0x7f6a04009040 comp rx=0 tx=0).stop 2024-04-25T09:56:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.577+0000 7f6a0ea8f640 1 -- 172.21.15.7:0/13075727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a08099f30 msgr2=0x7f6a0814d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.577+0000 7f6a0ea8f640 1 --2- 172.21.15.7:0/13075727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a08099f30 0x7f6a0814d8e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f69f800c7f0 tx=0x7f69f800cbf0 comp rx=0 tx=0).stop 2024-04-25T09:56:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.577+0000 7f6a0ea8f640 1 -- 172.21.15.7:0/13075727 shutdown_connections 2024-04-25T09:56:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.577+0000 7f6a0ea8f640 1 --2- 172.21.15.7:0/13075727 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f69f406b4d0 0x7f69f406d990 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.577+0000 7f6a0ea8f640 1 --2- 172.21.15.7:0/13075727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a080cda20 0x7f6a0814de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.577+0000 7f6a0ea8f640 1 --2- 172.21.15.7:0/13075727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a08099f30 0x7f6a0814d8e0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.577+0000 7f6a0ea8f640 1 --2- 172.21.15.7:0/13075727 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6a0806bf10 0x7f6a0814c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.577+0000 7f6a0ea8f640 1 -- 172.21.15.7:0/13075727 >> 172.21.15.7:0/13075727 conn(0x7f6a080b3110 msgr2=0x7f6a08073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.577+0000 7f6a0ea8f640 1 -- 172.21.15.7:0/13075727 shutdown_connections 2024-04-25T09:56:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.578+0000 7f6a0ea8f640 1 -- 172.21.15.7:0/13075727 wait complete. 2024-04-25T09:56:01.591 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:56:01.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.692+0000 7fdfb6989640 1 Processor -- start 2024-04-25T09:56:01.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.692+0000 7fdfb6989640 1 -- start start 2024-04-25T09:56:01.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.693+0000 7fdfb6989640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdfb0143fb0 0x7fdfb00b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:01.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.693+0000 7fdfb6989640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdfb006e240 0x7fdfb006e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:01.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.693+0000 7fdfb6989640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb00b2ee0 con 0x7fdfb00ce610 2024-04-25T09:56:01.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.693+0000 7fdfb6989640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb00b3150 con 0x7fdfb006e240 2024-04-25T09:56:01.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.693+0000 7fdfb6989640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb00b3430 con 0x7fdfb0143fb0 2024-04-25T09:56:01.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.693+0000 7fdfaf7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdfb006e240 0x7fdfb006e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:01.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.693+0000 7fdfaf7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdfb006e240 0x7fdfb006e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35218/0 (socket says 172.21.15.7:35218) 2024-04-25T09:56:01.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.693+0000 7fdfaf7fe640 1 -- 172.21.15.7:0/4118867846 learned_addr learned my addr 172.21.15.7:0/4118867846 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:01.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.693+0000 7fdfaffff640 1 --2- 172.21.15.7:0/4118867846 >> v2:172.21.15.55:3300/0 conn(0x7fdfb0143fb0 0x7fdfb00b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:01.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.693+0000 7fdfaf7fe640 1 -- 172.21.15.7:0/4118867846 >> v2:172.21.15.55:3300/0 conn(0x7fdfb0143fb0 msgr2=0x7fdfb00b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:01.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.693+0000 7fdfaf7fe640 1 --2- 172.21.15.7:0/4118867846 >> v2:172.21.15.55:3300/0 conn(0x7fdfb0143fb0 0x7fdfb00b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:01.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.693+0000 7fdfaf7fe640 1 -- 172.21.15.7:0/4118867846 >> v1:172.21.15.55:6789/0 conn(0x7fdfb00ce610 legacy=0x7fdfb00cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:01.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.693+0000 7fdfaf7fe640 1 -- 172.21.15.7:0/4118867846 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb00b3710 con 0x7fdfb006e240 2024-04-25T09:56:01.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.694+0000 7fdfaf7fe640 1 --2- 172.21.15.7:0/4118867846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfb006e240 0x7fdfb006e6d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00b4d20 tx=0x7fdfa002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a3402b7906e0241 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:01.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.694+0000 7fdfaeffd640 1 -- 172.21.15.7:0/4118867846 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0037070 con 0x7fdfb006e240 2024-04-25T09:56:01.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.694+0000 7fdfaeffd640 1 -- 172.21.15.7:0/4118867846 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa0032440 con 0x7fdfb006e240 2024-04-25T09:56:01.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.694+0000 7fdfaeffd640 1 -- 172.21.15.7:0/4118867846 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0032810 con 0x7fdfb006e240 2024-04-25T09:56:01.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.695+0000 7fdfb6989640 1 -- 172.21.15.7:0/4118867846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfb006e240 msgr2=0x7fdfb006e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:01.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.695+0000 7fdfb6989640 1 --2- 172.21.15.7:0/4118867846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfb006e240 0x7fdfb006e6d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00b4d20 tx=0x7fdfa002a270 comp rx=0 tx=0).stop 2024-04-25T09:56:01.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.695+0000 7fdfb6989640 1 -- 172.21.15.7:0/4118867846 shutdown_connections 2024-04-25T09:56:01.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.695+0000 7fdfb6989640 1 --2- 172.21.15.7:0/4118867846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfb006e240 0x7fdfb006e6d0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:01.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.695+0000 7fdfb6989640 1 --2- 172.21.15.7:0/4118867846 >> v2:172.21.15.55:3300/0 conn(0x7fdfb0143fb0 0x7fdfb00b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:01.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.695+0000 7fdfb6989640 1 -- 172.21.15.7:0/4118867846 >> 172.21.15.7:0/4118867846 conn(0x7fdfb006ab60 msgr2=0x7fdfb006af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:01.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.695+0000 7fdfb6989640 1 -- 172.21.15.7:0/4118867846 shutdown_connections 2024-04-25T09:56:01.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.695+0000 7fdfb6989640 1 -- 172.21.15.7:0/4118867846 wait complete. 2024-04-25T09:56:01.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.696+0000 7fdfb6989640 1 Processor -- start 2024-04-25T09:56:01.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.696+0000 7fdfb6989640 1 -- start start 2024-04-25T09:56:01.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.697+0000 7fdfb6989640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfb006e240 0x7fdfb013d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:01.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.697+0000 7fdfb6989640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdfb00ce610 0x7fdfb00b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:01.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.697+0000 7fdfb6989640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb0143fb0 0x7fdfb013bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:01.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.697+0000 7fdfb6989640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb015ac70 con 0x7fdfb006e240 2024-04-25T09:56:01.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.697+0000 7fdfb6989640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb00cf2f0 con 0x7fdfb0143fb0 2024-04-25T09:56:01.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.697+0000 7fdfb6989640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb015adf0 con 0x7fdfb00ce610 2024-04-25T09:56:01.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.697+0000 7fdfaffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfb006e240 0x7fdfb013d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:01.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.697+0000 7fdfaffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfb006e240 0x7fdfb013d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35230/0 (socket says 172.21.15.7:35230) 2024-04-25T09:56:01.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.697+0000 7fdfaffff640 1 -- 172.21.15.7:0/3315572938 learned_addr learned my addr 172.21.15.7:0/3315572938 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:01.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.697+0000 7fdfaf7fe640 1 --2- 172.21.15.7:0/3315572938 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdfb00ce610 0x7fdfb00b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:01.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.697+0000 7fdfb4f26640 1 --2- 172.21.15.7:0/3315572938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb0143fb0 0x7fdfb013bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:01.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.697+0000 7fdfaffff640 1 -- 172.21.15.7:0/3315572938 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdfb00ce610 msgr2=0x7fdfb00b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:01.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.697+0000 7fdfaffff640 1 --2- 172.21.15.7:0/3315572938 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdfb00ce610 0x7fdfb00b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:01.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.697+0000 7fdfaffff640 1 -- 172.21.15.7:0/3315572938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb0143fb0 msgr2=0x7fdfb013bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:01.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.697+0000 7fdfaffff640 1 --2- 172.21.15.7:0/3315572938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb0143fb0 0x7fdfb013bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:01.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.697+0000 7fdfaffff640 1 -- 172.21.15.7:0/3315572938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb00b2160 con 0x7fdfb006e240 2024-04-25T09:56:01.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.697+0000 7fdfaf7fe640 1 --2- 172.21.15.7:0/3315572938 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdfb00ce610 0x7fdfb00b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:01.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.697+0000 7fdfb4f26640 1 --2- 172.21.15.7:0/3315572938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb0143fb0 0x7fdfb013bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:01.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.697+0000 7fdfaffff640 1 --2- 172.21.15.7:0/3315572938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfb006e240 0x7fdfb013d6d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fdf9800d620 tx=0x7fdf9800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:01.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.698+0000 7fdfacff9640 1 -- 172.21.15.7:0/3315572938 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9800b620 con 0x7fdfb006e240 2024-04-25T09:56:01.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.698+0000 7fdfacff9640 1 -- 172.21.15.7:0/3315572938 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf98019070 con 0x7fdfb006e240 2024-04-25T09:56:01.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.698+0000 7fdfb6989640 1 -- 172.21.15.7:0/3315572938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb013c820 con 0x7fdfb006e240 2024-04-25T09:56:01.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.698+0000 7fdfacff9640 1 -- 172.21.15.7:0/3315572938 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9800ba00 con 0x7fdfb006e240 2024-04-25T09:56:01.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.698+0000 7fdfb6989640 1 -- 172.21.15.7:0/3315572938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb00b1140 con 0x7fdfb006e240 2024-04-25T09:56:01.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.699+0000 7fdfb6989640 1 -- 172.21.15.7:0/3315572938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb0068f60 con 0x7fdfb006e240 2024-04-25T09:56:01.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.699+0000 7fdfacff9640 1 -- 172.21.15.7:0/3315572938 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdf9800bba0 con 0x7fdfb006e240 2024-04-25T09:56:01.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.700+0000 7fdfacff9640 1 --2- 172.21.15.7:0/3315572938 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdf9006b4d0 0x7fdf9006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:01.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.700+0000 7fdfacff9640 1 -- 172.21.15.7:0/3315572938 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fdf9808a7b0 con 0x7fdfb006e240 2024-04-25T09:56:01.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.700+0000 7fdfaf7fe640 1 --2- 172.21.15.7:0/3315572938 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdf9006b4d0 0x7fdf9006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:01.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.700+0000 7fdfaf7fe640 1 --2- 172.21.15.7:0/3315572938 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdf9006b4d0 0x7fdf9006d990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0034000 tx=0x7fdfa002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:01.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.704+0000 7fdfacff9640 1 -- 172.21.15.7:0/3315572938 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdf980594a0 con 0x7fdfb006e240 2024-04-25T09:56:01.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.885+0000 7fdfb6989640 1 -- 172.21.15.7:0/3315572938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdfb00b4ad0 con 0x7fdfb006e240 2024-04-25T09:56:01.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.885+0000 7fdfacff9640 1 -- 172.21.15.7:0/3315572938 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdf98058da0 con 0x7fdfb006e240 2024-04-25T09:56:01.888 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T09:56:01.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.887+0000 7fdfb6989640 1 -- 172.21.15.7:0/3315572938 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdf9006b4d0 msgr2=0x7fdf9006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:01.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.887+0000 7fdfb6989640 1 --2- 172.21.15.7:0/3315572938 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdf9006b4d0 0x7fdf9006d990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0034000 tx=0x7fdfa002e000 comp rx=0 tx=0).stop 2024-04-25T09:56:01.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.887+0000 7fdfb6989640 1 -- 172.21.15.7:0/3315572938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfb006e240 msgr2=0x7fdfb013d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:01.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.887+0000 7fdfb6989640 1 --2- 172.21.15.7:0/3315572938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfb006e240 0x7fdfb013d6d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fdf9800d620 tx=0x7fdf9800dae0 comp rx=0 tx=0).stop 2024-04-25T09:56:01.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.887+0000 7fdfb6989640 1 -- 172.21.15.7:0/3315572938 shutdown_connections 2024-04-25T09:56:01.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.887+0000 7fdfb6989640 1 --2- 172.21.15.7:0/3315572938 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdf9006b4d0 0x7fdf9006d990 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:01.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.887+0000 7fdfb6989640 1 --2- 172.21.15.7:0/3315572938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb0143fb0 0x7fdfb013bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:01.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.887+0000 7fdfb6989640 1 --2- 172.21.15.7:0/3315572938 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdfb00ce610 0x7fdfb00b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:01.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.887+0000 7fdfb6989640 1 --2- 172.21.15.7:0/3315572938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfb006e240 0x7fdfb013d6d0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:01.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.887+0000 7fdfb6989640 1 -- 172.21.15.7:0/3315572938 >> 172.21.15.7:0/3315572938 conn(0x7fdfb006ab60 msgr2=0x7fdfb015cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:01.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.887+0000 7fdfb6989640 1 -- 172.21.15.7:0/3315572938 shutdown_connections 2024-04-25T09:56:01.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:01.887+0000 7fdfb6989640 1 -- 172.21.15.7:0/3315572938 wait complete. 2024-04-25T09:56:01.901 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:56:02.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.000+0000 7f72b153b640 1 Processor -- start 2024-04-25T09:56:02.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.000+0000 7f72b153b640 1 -- start start 2024-04-25T09:56:02.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.001+0000 7f72b153b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f72ac15a900 0x7f72ac0af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:02.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.001+0000 7f72b153b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f72ac0ae710 0x7f72ac15e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:02.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.001+0000 7f72b153b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72ac0aeb70 con 0x7f72ac15e9a0 2024-04-25T09:56:02.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.001+0000 7f72b153b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72ac0afa30 con 0x7f72ac0ae710 2024-04-25T09:56:02.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.001+0000 7f72b153b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac0b02d0 con 0x7f72ac15a900 2024-04-25T09:56:02.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.001+0000 7f72aaffd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f72ac15a900 0x7f72ac0af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:02.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.001+0000 7f72a3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f72ac0ae710 0x7f72ac15e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:02.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.001+0000 7f72aaffd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f72ac15a900 0x7f72ac0af3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:42102/0 (socket says 172.21.15.7:42102) 2024-04-25T09:56:02.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.001+0000 7f72aaffd640 1 -- 172.21.15.7:0/2810687903 learned_addr learned my addr 172.21.15.7:0/2810687903 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:02.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.001+0000 7f72a3fff640 1 -- 172.21.15.7:0/2810687903 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f72ac15a900 msgr2=0x7f72ac0af3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:02.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.001+0000 7f72a3fff640 1 --2- 172.21.15.7:0/2810687903 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f72ac15a900 0x7f72ac0af3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.001+0000 7f72a3fff640 1 -- 172.21.15.7:0/2810687903 >> v1:172.21.15.55:6789/0 conn(0x7f72ac15e9a0 legacy=0x7f72ac0b3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:02.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.001+0000 7f72a3fff640 1 -- 172.21.15.7:0/2810687903 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ac0aee10 con 0x7f72ac0ae710 2024-04-25T09:56:02.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.001+0000 7f72aaffd640 1 --2- 172.21.15.7:0/2810687903 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f72ac15a900 0x7f72ac0af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:56:02.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.002+0000 7f72a3fff640 1 --2- 172.21.15.7:0/2810687903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72ac0ae710 0x7f72ac15e460 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f72940097a0 tx=0x7f729402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44ccc672acbf41c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:02.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.002+0000 7f72aa7fc640 1 -- 172.21.15.7:0/2810687903 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7294037070 con 0x7f72ac0ae710 2024-04-25T09:56:02.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.002+0000 7f72aa7fc640 1 -- 172.21.15.7:0/2810687903 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7294032440 con 0x7f72ac0ae710 2024-04-25T09:56:02.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.002+0000 7f72aa7fc640 1 -- 172.21.15.7:0/2810687903 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7294032810 con 0x7f72ac0ae710 2024-04-25T09:56:02.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.003+0000 7f72b153b640 1 -- 172.21.15.7:0/2810687903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72ac0ae710 msgr2=0x7f72ac15e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:02.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.003+0000 7f72b153b640 1 --2- 172.21.15.7:0/2810687903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72ac0ae710 0x7f72ac15e460 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f72940097a0 tx=0x7f729402a180 comp rx=0 tx=0).stop 2024-04-25T09:56:02.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.003+0000 7f72b153b640 1 -- 172.21.15.7:0/2810687903 shutdown_connections 2024-04-25T09:56:02.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.003+0000 7f72b153b640 1 --2- 172.21.15.7:0/2810687903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72ac0ae710 0x7f72ac15e460 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.003+0000 7f72b153b640 1 --2- 172.21.15.7:0/2810687903 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f72ac15a900 0x7f72ac0af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.003+0000 7f72b153b640 1 -- 172.21.15.7:0/2810687903 >> 172.21.15.7:0/2810687903 conn(0x7f72ac0b5c30 msgr2=0x7f72ac0999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:02.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.003+0000 7f72b153b640 1 -- 172.21.15.7:0/2810687903 shutdown_connections 2024-04-25T09:56:02.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.003+0000 7f72b153b640 1 -- 172.21.15.7:0/2810687903 wait complete. 2024-04-25T09:56:02.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.004+0000 7f72b153b640 1 Processor -- start 2024-04-25T09:56:02.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.004+0000 7f72b153b640 1 -- start start 2024-04-25T09:56:02.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.005+0000 7f72b153b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f72ac0ae710 0x7f72ac14cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:02.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.005+0000 7f72b153b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72ac15a900 0x7f72ac14d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:02.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.005+0000 7f72b153b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72ac15e9a0 0x7f72ac14dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:02.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.005+0000 7f72b153b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac15ace0 con 0x7f72ac15a900 2024-04-25T09:56:02.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.005+0000 7f72b153b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac0aff60 con 0x7f72ac15e9a0 2024-04-25T09:56:02.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.005+0000 7f72b153b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac0b1770 con 0x7f72ac0ae710 2024-04-25T09:56:02.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.005+0000 7f72a3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72ac15a900 0x7f72ac14d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:02.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.005+0000 7f72a3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72ac15a900 0x7f72ac14d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35234/0 (socket says 172.21.15.7:35234) 2024-04-25T09:56:02.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.005+0000 7f72a3fff640 1 -- 172.21.15.7:0/2725546161 learned_addr learned my addr 172.21.15.7:0/2725546161 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:02.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.005+0000 7f72aaffd640 1 --2- 172.21.15.7:0/2725546161 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f72ac0ae710 0x7f72ac14cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:02.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.005+0000 7f72ab7fe640 1 --2- 172.21.15.7:0/2725546161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72ac15e9a0 0x7f72ac14dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:02.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.006+0000 7f72a3fff640 1 -- 172.21.15.7:0/2725546161 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f72ac0ae710 msgr2=0x7f72ac14cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:02.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.006+0000 7f72a3fff640 1 --2- 172.21.15.7:0/2725546161 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f72ac0ae710 0x7f72ac14cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.006+0000 7f72a3fff640 1 -- 172.21.15.7:0/2725546161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72ac15e9a0 msgr2=0x7f72ac14dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:02.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.006+0000 7f72a3fff640 1 --2- 172.21.15.7:0/2725546161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72ac15e9a0 0x7f72ac14dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.006+0000 7f72a3fff640 1 -- 172.21.15.7:0/2725546161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ac150820 con 0x7f72ac15a900 2024-04-25T09:56:02.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.006+0000 7f72ab7fe640 1 --2- 172.21.15.7:0/2725546161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72ac15e9a0 0x7f72ac14dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:02.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.006+0000 7f72a3fff640 1 --2- 172.21.15.7:0/2725546161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72ac15a900 0x7f72ac14d700 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f72940097a0 tx=0x7f72940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:02.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.006+0000 7f72a37fe640 1 -- 172.21.15.7:0/2725546161 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7294041070 con 0x7f72ac15a900 2024-04-25T09:56:02.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.006+0000 7f72a37fe640 1 -- 172.21.15.7:0/2725546161 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729403c870 con 0x7f72ac15a900 2024-04-25T09:56:02.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.006+0000 7f72b153b640 1 -- 172.21.15.7:0/2725546161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72ac150b00 con 0x7f72ac15a900 2024-04-25T09:56:02.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.006+0000 7f72a37fe640 1 -- 172.21.15.7:0/2725546161 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7294037040 con 0x7f72ac15a900 2024-04-25T09:56:02.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.006+0000 7f72b153b640 1 -- 172.21.15.7:0/2725546161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72ac15b1e0 con 0x7f72ac15a900 2024-04-25T09:56:02.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.007+0000 7f72b153b640 1 -- 172.21.15.7:0/2725546161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72ac068fd0 con 0x7f72ac15a900 2024-04-25T09:56:02.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.008+0000 7f72a37fe640 1 -- 172.21.15.7:0/2725546161 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7294044070 con 0x7f72ac15a900 2024-04-25T09:56:02.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.008+0000 7f72a37fe640 1 --2- 172.21.15.7:0/2725546161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f728c06b4d0 0x7f728c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:02.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.008+0000 7f72a37fe640 1 -- 172.21.15.7:0/2725546161 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f72940ab1b0 con 0x7f72ac15a900 2024-04-25T09:56:02.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.008+0000 7f72aaffd640 1 --2- 172.21.15.7:0/2725546161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f728c06b4d0 0x7f728c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:02.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.008+0000 7f72aaffd640 1 --2- 172.21.15.7:0/2725546161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f728c06b4d0 0x7f728c06d990 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f729c006ca0 tx=0x7f729c00b450 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:02.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.012+0000 7f72a37fe640 1 -- 172.21.15.7:0/2725546161 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7294079970 con 0x7f72ac15a900 2024-04-25T09:56:02.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.229+0000 7f72b153b640 1 -- 172.21.15.7:0/2725546161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72ac0b59f0 con 0x7f72ac15a900 2024-04-25T09:56:02.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.229+0000 7f72a37fe640 1 -- 172.21.15.7:0/2725546161 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4929 (secure 0 0 0) 0x7f729407da10 con 0x7f72ac15a900 2024-04-25T09:56:02.233 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:02.233 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5047,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2022061608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2022061608},{"type":"v1","addr":"172.21.15.55:6834","nonce":2022061608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5382,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/2607466795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2607466795},{"type":"v1","addr":"172.21.15.7:6836","nonce":2607466795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5385,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1576325055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1576325055},{"type":"v1","addr":"172.21.15.7:6837","nonce":1576325055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:55:35.091962+0000","modified":"2024-04-25T09:55:37.095949+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5391":{"gid":5391,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/223801838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":223801838},{"type":"v1","addr":"172.21.15.55:6835","nonce":223801838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T09:56:02.233 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 15 2024-04-25T09:56:02.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.231+0000 7f72b153b640 1 -- 172.21.15.7:0/2725546161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f728c06b4d0 msgr2=0x7f728c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:02.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.231+0000 7f72b153b640 1 --2- 172.21.15.7:0/2725546161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f728c06b4d0 0x7f728c06d990 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f729c006ca0 tx=0x7f729c00b450 comp rx=0 tx=0).stop 2024-04-25T09:56:02.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.231+0000 7f72b153b640 1 -- 172.21.15.7:0/2725546161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72ac15a900 msgr2=0x7f72ac14d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:02.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.231+0000 7f72b153b640 1 --2- 172.21.15.7:0/2725546161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72ac15a900 0x7f72ac14d700 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f72940097a0 tx=0x7f72940046c0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.231+0000 7f72b153b640 1 -- 172.21.15.7:0/2725546161 shutdown_connections 2024-04-25T09:56:02.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.231+0000 7f72b153b640 1 --2- 172.21.15.7:0/2725546161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f728c06b4d0 0x7f728c06d990 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.231+0000 7f72b153b640 1 --2- 172.21.15.7:0/2725546161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72ac15e9a0 0x7f72ac14dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.231+0000 7f72b153b640 1 --2- 172.21.15.7:0/2725546161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72ac15a900 0x7f72ac14d700 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.231+0000 7f72b153b640 1 --2- 172.21.15.7:0/2725546161 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f72ac0ae710 0x7f72ac14cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.231+0000 7f72b153b640 1 -- 172.21.15.7:0/2725546161 >> 172.21.15.7:0/2725546161 conn(0x7f72ac0b5c30 msgr2=0x7f72ac06e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:02.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.231+0000 7f72b153b640 1 -- 172.21.15.7:0/2725546161 shutdown_connections 2024-04-25T09:56:02.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.231+0000 7f72b153b640 1 -- 172.21.15.7:0/2725546161 wait complete. 2024-04-25T09:56:02.246 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:56:02.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.343+0000 7ffb80b3b640 1 Processor -- start 2024-04-25T09:56:02.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.343+0000 7ffb80b3b640 1 -- start start 2024-04-25T09:56:02.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.344+0000 7ffb80b3b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffb7c0b53b0 0x7ffb7c0d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:02.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.344+0000 7ffb80b3b640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb7c0d1e80 con 0x7ffb7c15db00 2024-04-25T09:56:02.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.344+0000 7ffb80b3b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb7c0b5930 con 0x7ffb7c0d0a50 2024-04-25T09:56:02.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.344+0000 7ffb80b3b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c0b5c10 con 0x7ffb7c0b53b0 2024-04-25T09:56:02.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.344+0000 7ffb7a59c640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ffb7c15db00 0x7ffb7c0d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39306/0 (socket says 172.21.15.7:39306) 2024-04-25T09:56:02.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.344+0000 7ffb7a59c640 1 -- 172.21.15.7:0/2665133444 learned_addr learned my addr 172.21.15.7:0/2665133444 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:56:02.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.344+0000 7ffb7ad9d640 1 --2- 172.21.15.7:0/2665133444 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffb7c0b53b0 0x7ffb7c0d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:02.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.344+0000 7ffb7959a640 1 -- 172.21.15.7:0/2665133444 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3019671247 0 0) 0x7ffb7c0d1e80 con 0x7ffb7c15db00 2024-04-25T09:56:02.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.344+0000 7ffb7959a640 1 -- 172.21.15.7:0/2665133444 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb64003520 con 0x7ffb7c15db00 2024-04-25T09:56:02.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.344+0000 7ffb7959a640 1 -- 172.21.15.7:0/2665133444 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1224625833 0 0) 0x7ffb64003520 con 0x7ffb7c15db00 2024-04-25T09:56:02.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.344+0000 7ffb7959a640 1 -- 172.21.15.7:0/2665133444 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffb7c0b53b0 msgr2=0x7ffb7c0d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:02.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.344+0000 7ffb7959a640 1 --2- 172.21.15.7:0/2665133444 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffb7c0b53b0 0x7ffb7c0d2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.344+0000 7ffb7959a640 1 -- 172.21.15.7:0/2665133444 >> v1:172.21.15.55:6789/0 conn(0x7ffb7c0d0a50 legacy=0x7ffb7c0d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:02.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.344+0000 7ffb7959a640 1 -- 172.21.15.7:0/2665133444 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7c0b5ef0 con 0x7ffb7c15db00 2024-04-25T09:56:02.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.345+0000 7ffb7959a640 1 -- 172.21.15.7:0/2665133444 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7ffb6c001670 con 0x7ffb7c15db00 2024-04-25T09:56:02.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.345+0000 7ffb7959a640 1 -- 172.21.15.7:0/2665133444 >> v1:172.21.15.7:6789/0 conn(0x7ffb7c15db00 legacy=0x7ffb7c0d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:02.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.345+0000 7ffb7959a640 1 --2- 172.21.15.7:0/2665133444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb640039e0 0x7ffb64003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:02.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.345+0000 7ffb7959a640 1 --2- 172.21.15.7:0/2665133444 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffb7c0b53b0 0x7ffb64004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:02.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.345+0000 7ffb7959a640 1 --2- 172.21.15.7:0/2665133444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb64004d40 0x7ffb640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:02.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.345+0000 7ffb7959a640 1 -- 172.21.15.7:0/2665133444 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c0b5c10 con 0x7ffb64004d40 2024-04-25T09:56:02.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.345+0000 7ffb7959a640 1 -- 172.21.15.7:0/2665133444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6400baa0 con 0x7ffb640039e0 2024-04-25T09:56:02.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.345+0000 7ffb7959a640 1 -- 172.21.15.7:0/2665133444 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6400bca0 con 0x7ffb7c0b53b0 2024-04-25T09:56:02.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.345+0000 7ffb7ad9d640 1 --2- 172.21.15.7:0/2665133444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb64004d40 0x7ffb640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:02.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.345+0000 7ffb7a59c640 1 --2- 172.21.15.7:0/2665133444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb640039e0 0x7ffb64003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:02.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.345+0000 7ffb79d9b640 1 --2- 172.21.15.7:0/2665133444 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffb7c0b53b0 0x7ffb64004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:02.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.345+0000 7ffb7ad9d640 1 -- 172.21.15.7:0/2665133444 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffb7c0b53b0 msgr2=0x7ffb64004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:02.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.345+0000 7ffb7ad9d640 1 --2- 172.21.15.7:0/2665133444 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffb7c0b53b0 0x7ffb64004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.345+0000 7ffb7ad9d640 1 -- 172.21.15.7:0/2665133444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb640039e0 msgr2=0x7ffb64003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:02.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.345+0000 7ffb7ad9d640 1 --2- 172.21.15.7:0/2665133444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb640039e0 0x7ffb64003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.345+0000 7ffb7ad9d640 1 -- 172.21.15.7:0/2665133444 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb64003520 con 0x7ffb64004d40 2024-04-25T09:56:02.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.346+0000 7ffb7ad9d640 1 --2- 172.21.15.7:0/2665133444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb64004d40 0x7ffb640051c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0b5860 tx=0x7ffb64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927f8f3e1f2e83bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:02.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.346+0000 7ffb7959a640 1 -- 172.21.15.7:0/2665133444 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb74037070 con 0x7ffb64004d40 2024-04-25T09:56:02.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.346+0000 7ffb7959a640 1 -- 172.21.15.7:0/2665133444 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7402e050 con 0x7ffb64004d40 2024-04-25T09:56:02.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.346+0000 7ffb7959a640 1 -- 172.21.15.7:0/2665133444 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb74009c10 con 0x7ffb64004d40 2024-04-25T09:56:02.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.346+0000 7ffb80b3b640 1 -- 172.21.15.7:0/2665133444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb64004d40 msgr2=0x7ffb640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:02.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.346+0000 7ffb80b3b640 1 --2- 172.21.15.7:0/2665133444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb64004d40 0x7ffb640051c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0b5860 tx=0x7ffb64005830 comp rx=0 tx=0).stop 2024-04-25T09:56:02.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.346+0000 7ffb7ad9d640 1 -- 172.21.15.7:0/2665133444 reap_dead start 2024-04-25T09:56:02.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.347+0000 7ffb80b3b640 1 -- 172.21.15.7:0/2665133444 shutdown_connections 2024-04-25T09:56:02.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.347+0000 7ffb80b3b640 1 -- 172.21.15.7:0/2665133444 >> 172.21.15.7:0/2665133444 conn(0x7ffb7c072290 msgr2=0x7ffb7c0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:02.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.347+0000 7ffb80b3b640 1 -- 172.21.15.7:0/2665133444 shutdown_connections 2024-04-25T09:56:02.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.347+0000 7ffb80b3b640 1 -- 172.21.15.7:0/2665133444 wait complete. 2024-04-25T09:56:02.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.348+0000 7ffb80b3b640 1 Processor -- start 2024-04-25T09:56:02.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.348+0000 7ffb80b3b640 1 -- start start 2024-04-25T09:56:02.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.349+0000 7ffb80b3b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb64004d40 0x7ffb7c1f6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:02.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.349+0000 7ffb80b3b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb7c154fd0 0x7ffb7c155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:02.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.349+0000 7ffb80b3b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffb7c15bc50 0x7ffb7c15c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:02.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.349+0000 7ffb80b3b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c0d3660 con 0x7ffb7c154fd0 2024-04-25T09:56:02.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.349+0000 7ffb80b3b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c0b61d0 con 0x7ffb64004d40 2024-04-25T09:56:02.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.349+0000 7ffb80b3b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c0ce2b0 con 0x7ffb7c15bc50 2024-04-25T09:56:02.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.349+0000 7ffb79d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb7c154fd0 0x7ffb7c155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:02.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.349+0000 7ffb79d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb7c154fd0 0x7ffb7c155450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35248/0 (socket says 172.21.15.7:35248) 2024-04-25T09:56:02.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.349+0000 7ffb79d9b640 1 -- 172.21.15.7:0/670656386 learned_addr learned my addr 172.21.15.7:0/670656386 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:02.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.349+0000 7ffb79d9b640 1 -- 172.21.15.7:0/670656386 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffb7c15bc50 msgr2=0x7ffb7c15c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:02.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.349+0000 7ffb7ad9d640 1 --2- 172.21.15.7:0/670656386 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffb7c15bc50 0x7ffb7c15c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:02.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.349+0000 7ffb7a59c640 1 --2- 172.21.15.7:0/670656386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb64004d40 0x7ffb7c1f6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:02.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.349+0000 7ffb79d9b640 1 --2- 172.21.15.7:0/670656386 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffb7c15bc50 0x7ffb7c15c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.349+0000 7ffb79d9b640 1 -- 172.21.15.7:0/670656386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb64004d40 msgr2=0x7ffb7c1f6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:02.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.349+0000 7ffb79d9b640 1 --2- 172.21.15.7:0/670656386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb64004d40 0x7ffb7c1f6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.349+0000 7ffb79d9b640 1 -- 172.21.15.7:0/670656386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7c155c80 con 0x7ffb7c154fd0 2024-04-25T09:56:02.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.349+0000 7ffb7ad9d640 1 --2- 172.21.15.7:0/670656386 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffb7c15bc50 0x7ffb7c15c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:56:02.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.349+0000 7ffb7a59c640 1 --2- 172.21.15.7:0/670656386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb64004d40 0x7ffb7c1f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:56:02.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.349+0000 7ffb79d9b640 1 --2- 172.21.15.7:0/670656386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb7c154fd0 0x7ffb7c155450 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ffb7000f820 tx=0x7ffb7000fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:02.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.349+0000 7ffb6affd640 1 -- 172.21.15.7:0/670656386 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb700050d0 con 0x7ffb7c154fd0 2024-04-25T09:56:02.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.349+0000 7ffb6affd640 1 -- 172.21.15.7:0/670656386 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb70018070 con 0x7ffb7c154fd0 2024-04-25T09:56:02.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.350+0000 7ffb80b3b640 1 -- 172.21.15.7:0/670656386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb7c155f60 con 0x7ffb7c154fd0 2024-04-25T09:56:02.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.350+0000 7ffb6affd640 1 -- 172.21.15.7:0/670656386 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb70005490 con 0x7ffb7c154fd0 2024-04-25T09:56:02.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.350+0000 7ffb80b3b640 1 -- 172.21.15.7:0/670656386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb7c1f4720 con 0x7ffb7c154fd0 2024-04-25T09:56:02.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.351+0000 7ffb80b3b640 1 -- 172.21.15.7:0/670656386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb7c068fd0 con 0x7ffb7c154fd0 2024-04-25T09:56:02.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.351+0000 7ffb6affd640 1 -- 172.21.15.7:0/670656386 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffb7000d730 con 0x7ffb7c154fd0 2024-04-25T09:56:02.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.351+0000 7ffb6affd640 1 --2- 172.21.15.7:0/670656386 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ffb5c06b4d0 0x7ffb5c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:02.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.352+0000 7ffb6affd640 1 -- 172.21.15.7:0/670656386 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ffb7008a260 con 0x7ffb7c154fd0 2024-04-25T09:56:02.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.352+0000 7ffb7a59c640 1 --2- 172.21.15.7:0/670656386 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ffb5c06b4d0 0x7ffb5c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:02.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.352+0000 7ffb7a59c640 1 --2- 172.21.15.7:0/670656386 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ffb5c06b4d0 0x7ffb5c06d990 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c1f1150 tx=0x7ffb6c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:02.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.356+0000 7ffb6affd640 1 -- 172.21.15.7:0/670656386 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffb70058f50 con 0x7ffb7c154fd0 2024-04-25T09:56:02.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.535+0000 7ffb80b3b640 1 -- 172.21.15.7:0/670656386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb7c0d0450 con 0x7ffb7c154fd0 2024-04-25T09:56:02.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.536+0000 7ffb6affd640 1 -- 172.21.15.7:0/670656386 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16846 (secure 0 0 0) 0x7ffb70058850 con 0x7ffb7c154fd0 2024-04-25T09:56:02.539 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:02.539 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":39,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:55:36.722817+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:55:33.644089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T09:55:34.059847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:56:02.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.538+0000 7ffb80b3b640 1 -- 172.21.15.7:0/670656386 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ffb5c06b4d0 msgr2=0x7ffb5c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:02.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.538+0000 7ffb80b3b640 1 --2- 172.21.15.7:0/670656386 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ffb5c06b4d0 0x7ffb5c06d990 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c1f1150 tx=0x7ffb6c009040 comp rx=0 tx=0).stop 2024-04-25T09:56:02.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.538+0000 7ffb80b3b640 1 -- 172.21.15.7:0/670656386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb7c154fd0 msgr2=0x7ffb7c155450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:02.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.538+0000 7ffb80b3b640 1 --2- 172.21.15.7:0/670656386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb7c154fd0 0x7ffb7c155450 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ffb7000f820 tx=0x7ffb7000fce0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.538+0000 7ffb80b3b640 1 -- 172.21.15.7:0/670656386 shutdown_connections 2024-04-25T09:56:02.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.538+0000 7ffb80b3b640 1 --2- 172.21.15.7:0/670656386 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ffb5c06b4d0 0x7ffb5c06d990 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.538+0000 7ffb80b3b640 1 --2- 172.21.15.7:0/670656386 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffb7c15bc50 0x7ffb7c15c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.538+0000 7ffb80b3b640 1 --2- 172.21.15.7:0/670656386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb7c154fd0 0x7ffb7c155450 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.538+0000 7ffb80b3b640 1 --2- 172.21.15.7:0/670656386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb64004d40 0x7ffb7c1f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.538+0000 7ffb80b3b640 1 -- 172.21.15.7:0/670656386 >> 172.21.15.7:0/670656386 conn(0x7ffb7c072290 msgr2=0x7ffb7c0c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:02.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.538+0000 7ffb80b3b640 1 -- 172.21.15.7:0/670656386 shutdown_connections 2024-04-25T09:56:02.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.538+0000 7ffb80b3b640 1 -- 172.21.15.7:0/670656386 wait complete. 2024-04-25T09:56:02.552 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:56:02.552 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:56:02.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.650+0000 7f57f2493640 1 Processor -- start 2024-04-25T09:56:02.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.650+0000 7f57f2493640 1 -- start start 2024-04-25T09:56:02.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.651+0000 7f57f2493640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f57ec15db00 0x7f57ec0d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:02.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.651+0000 7f57f2493640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f57ec0b53b0 0x7f57ec0d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:02.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.651+0000 7f57f2493640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f57ec0ce2b0 0x7f57ec161670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:02.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.651+0000 7f57f2493640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57ec0d1e80 con 0x7f57ec15db00 2024-04-25T09:56:02.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.651+0000 7f57f2493640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57ec0b5930 con 0x7f57ec0b53b0 2024-04-25T09:56:02.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.651+0000 7f57f2493640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57ec0b5c10 con 0x7f57ec0ce2b0 2024-04-25T09:56:02.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.651+0000 7f57ebfff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f57ec15db00 0x7f57ec0d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:02.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.651+0000 7f57ebfff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f57ec15db00 0x7f57ec0d0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35262/0 (socket says 172.21.15.7:35262) 2024-04-25T09:56:02.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.651+0000 7f57ebfff640 1 -- 172.21.15.7:0/2857873541 learned_addr learned my addr 172.21.15.7:0/2857873541 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:02.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.651+0000 7f57f0a30640 1 --2- 172.21.15.7:0/2857873541 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f57ec0ce2b0 0x7f57ec161670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:02.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.651+0000 7f57eb7fe640 1 --2- 172.21.15.7:0/2857873541 >> v2:172.21.15.55:3300/0 conn(0x7f57ec0b53b0 0x7f57ec0d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:02.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.651+0000 7f57ebfff640 1 -- 172.21.15.7:0/2857873541 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f57ec0ce2b0 msgr2=0x7f57ec161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:02.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.651+0000 7f57ebfff640 1 --2- 172.21.15.7:0/2857873541 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f57ec0ce2b0 0x7f57ec161670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.651+0000 7f57ebfff640 1 -- 172.21.15.7:0/2857873541 >> v2:172.21.15.55:3300/0 conn(0x7f57ec0b53b0 msgr2=0x7f57ec0d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:02.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.651+0000 7f57ebfff640 1 --2- 172.21.15.7:0/2857873541 >> v2:172.21.15.55:3300/0 conn(0x7f57ec0b53b0 0x7f57ec0d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.651+0000 7f57ebfff640 1 -- 172.21.15.7:0/2857873541 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ec0b5ef0 con 0x7f57ec15db00 2024-04-25T09:56:02.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.651+0000 7f57f0a30640 1 --2- 172.21.15.7:0/2857873541 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f57ec0ce2b0 0x7f57ec161670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:56:02.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.651+0000 7f57eb7fe640 1 --2- 172.21.15.7:0/2857873541 >> v2:172.21.15.55:3300/0 conn(0x7f57ec0b53b0 0x7f57ec0d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:56:02.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.652+0000 7f57ebfff640 1 --2- 172.21.15.7:0/2857873541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57ec15db00 0x7f57ec0d0340 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f57ec0d4a00 tx=0x7f57dc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c674a2b10d011dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:02.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.652+0000 7f57eaffd640 1 -- 172.21.15.7:0/2857873541 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc037070 con 0x7f57ec15db00 2024-04-25T09:56:02.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.652+0000 7f57eaffd640 1 -- 172.21.15.7:0/2857873541 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57dc032440 con 0x7f57ec15db00 2024-04-25T09:56:02.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.652+0000 7f57eaffd640 1 -- 172.21.15.7:0/2857873541 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc032810 con 0x7f57ec15db00 2024-04-25T09:56:02.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.653+0000 7f57f2493640 1 -- 172.21.15.7:0/2857873541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57ec15db00 msgr2=0x7f57ec0d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:02.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.653+0000 7f57f2493640 1 --2- 172.21.15.7:0/2857873541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57ec15db00 0x7f57ec0d0340 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f57ec0d4a00 tx=0x7f57dc02a1e0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.653+0000 7f57f2493640 1 -- 172.21.15.7:0/2857873541 shutdown_connections 2024-04-25T09:56:02.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.653+0000 7f57f2493640 1 --2- 172.21.15.7:0/2857873541 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f57ec0ce2b0 0x7f57ec161670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.653+0000 7f57f2493640 1 --2- 172.21.15.7:0/2857873541 >> v2:172.21.15.55:3300/0 conn(0x7f57ec0b53b0 0x7f57ec0d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.653+0000 7f57f2493640 1 --2- 172.21.15.7:0/2857873541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57ec15db00 0x7f57ec0d0340 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.653+0000 7f57f2493640 1 -- 172.21.15.7:0/2857873541 >> 172.21.15.7:0/2857873541 conn(0x7f57ec072290 msgr2=0x7f57ec0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:02.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.653+0000 7f57f2493640 1 -- 172.21.15.7:0/2857873541 shutdown_connections 2024-04-25T09:56:02.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.653+0000 7f57f2493640 1 -- 172.21.15.7:0/2857873541 wait complete. 2024-04-25T09:56:02.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.654+0000 7f57f2493640 1 Processor -- start 2024-04-25T09:56:02.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.654+0000 7f57f2493640 1 -- start start 2024-04-25T09:56:02.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.655+0000 7f57f2493640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57ec0b53b0 0x7f57ec1518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:02.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.655+0000 7f57f2493640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f57ec0ce2b0 0x7f57ec14f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:02.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.655+0000 7f57f2493640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57ec15db00 0x7f57ec0c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:02.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.655+0000 7f57f2493640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ec0d3660 con 0x7f57ec15db00 2024-04-25T09:56:02.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.655+0000 7f57f2493640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ec0b61d0 con 0x7f57ec0b53b0 2024-04-25T09:56:02.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.655+0000 7f57f2493640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57ec0b6c10 con 0x7f57ec0ce2b0 2024-04-25T09:56:02.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.655+0000 7f57f0a30640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57ec15db00 0x7f57ec0c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:02.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.655+0000 7f57f0a30640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57ec15db00 0x7f57ec0c9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35268/0 (socket says 172.21.15.7:35268) 2024-04-25T09:56:02.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.655+0000 7f57f0a30640 1 -- 172.21.15.7:0/3115415191 learned_addr learned my addr 172.21.15.7:0/3115415191 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:02.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.655+0000 7f57eb7fe640 1 --2- 172.21.15.7:0/3115415191 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f57ec0ce2b0 0x7f57ec14f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:02.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.655+0000 7f57ebfff640 1 --2- 172.21.15.7:0/3115415191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57ec0b53b0 0x7f57ec1518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:02.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.655+0000 7f57f0a30640 1 -- 172.21.15.7:0/3115415191 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f57ec0ce2b0 msgr2=0x7f57ec14f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:02.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.655+0000 7f57f0a30640 1 --2- 172.21.15.7:0/3115415191 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f57ec0ce2b0 0x7f57ec14f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.655+0000 7f57f0a30640 1 -- 172.21.15.7:0/3115415191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57ec0b53b0 msgr2=0x7f57ec1518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:02.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.655+0000 7f57f0a30640 1 --2- 172.21.15.7:0/3115415191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57ec0b53b0 0x7f57ec1518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.655+0000 7f57f0a30640 1 -- 172.21.15.7:0/3115415191 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ec1f6dd0 con 0x7f57ec15db00 2024-04-25T09:56:02.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.655+0000 7f57eb7fe640 1 --2- 172.21.15.7:0/3115415191 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f57ec0ce2b0 0x7f57ec14f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:56:02.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.655+0000 7f57ebfff640 1 --2- 172.21.15.7:0/3115415191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57ec0b53b0 0x7f57ec1518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:56:02.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.655+0000 7f57f0a30640 1 --2- 172.21.15.7:0/3115415191 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57ec15db00 0x7f57ec0c9680 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f57e400cef0 tx=0x7f57e400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:02.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.656+0000 7f57e8ff9640 1 -- 172.21.15.7:0/3115415191 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e401a070 con 0x7f57ec15db00 2024-04-25T09:56:02.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.656+0000 7f57e8ff9640 1 -- 172.21.15.7:0/3115415191 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e400d860 con 0x7f57ec15db00 2024-04-25T09:56:02.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.656+0000 7f57f2493640 1 -- 172.21.15.7:0/3115415191 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57ec1f70b0 con 0x7f57ec15db00 2024-04-25T09:56:02.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.656+0000 7f57e8ff9640 1 -- 172.21.15.7:0/3115415191 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e400dc50 con 0x7f57ec15db00 2024-04-25T09:56:02.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.656+0000 7f57f2493640 1 -- 172.21.15.7:0/3115415191 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57ec1f7670 con 0x7f57ec15db00 2024-04-25T09:56:02.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.657+0000 7f57f2493640 1 -- 172.21.15.7:0/3115415191 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57ec068fd0 con 0x7f57ec15db00 2024-04-25T09:56:02.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.657+0000 7f57e8ff9640 1 -- 172.21.15.7:0/3115415191 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f57e401d070 con 0x7f57ec15db00 2024-04-25T09:56:02.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.657+0000 7f57e8ff9640 1 --2- 172.21.15.7:0/3115415191 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f57d806b4d0 0x7f57d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:02.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.657+0000 7f57e8ff9640 1 -- 172.21.15.7:0/3115415191 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f57e408aba0 con 0x7f57ec15db00 2024-04-25T09:56:02.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.658+0000 7f57ebfff640 1 --2- 172.21.15.7:0/3115415191 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f57d806b4d0 0x7f57d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:02.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.658+0000 7f57ebfff640 1 --2- 172.21.15.7:0/3115415191 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f57d806b4d0 0x7f57d806d990 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f57dc034000 tx=0x7f57dc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:02.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.661+0000 7f57e8ff9640 1 -- 172.21.15.7:0/3115415191 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f57e4059940 con 0x7f57ec15db00 2024-04-25T09:56:02.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.882+0000 7f57f2493640 1 -- 172.21.15.7:0/3115415191 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57ec0b7d80 con 0x7f57ec15db00 2024-04-25T09:56:02.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.883+0000 7f57e8ff9640 1 -- 172.21.15.7:0/3115415191 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4929 (secure 0 0 0) 0x7f57e4059240 con 0x7f57ec15db00 2024-04-25T09:56:02.886 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:02.886 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5047,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2022061608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2022061608},{"type":"v1","addr":"172.21.15.55:6834","nonce":2022061608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5382,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/2607466795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2607466795},{"type":"v1","addr":"172.21.15.7:6836","nonce":2607466795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5385,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1576325055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1576325055},{"type":"v1","addr":"172.21.15.7:6837","nonce":1576325055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:55:35.091962+0000","modified":"2024-04-25T09:55:37.095949+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5391":{"gid":5391,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/223801838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":223801838},{"type":"v1","addr":"172.21.15.55:6835","nonce":223801838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T09:56:02.886 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 15 2024-04-25T09:56:02.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.885+0000 7f57f2493640 1 -- 172.21.15.7:0/3115415191 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f57d806b4d0 msgr2=0x7f57d806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:02.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.885+0000 7f57f2493640 1 --2- 172.21.15.7:0/3115415191 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f57d806b4d0 0x7f57d806d990 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f57dc034000 tx=0x7f57dc02e000 comp rx=0 tx=0).stop 2024-04-25T09:56:02.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.885+0000 7f57f2493640 1 -- 172.21.15.7:0/3115415191 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57ec15db00 msgr2=0x7f57ec0c9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:02.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.885+0000 7f57f2493640 1 --2- 172.21.15.7:0/3115415191 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57ec15db00 0x7f57ec0c9680 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f57e400cef0 tx=0x7f57e400a710 comp rx=0 tx=0).stop 2024-04-25T09:56:02.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.885+0000 7f57f2493640 1 -- 172.21.15.7:0/3115415191 shutdown_connections 2024-04-25T09:56:02.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.885+0000 7f57f2493640 1 --2- 172.21.15.7:0/3115415191 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f57d806b4d0 0x7f57d806d990 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.885+0000 7f57f2493640 1 --2- 172.21.15.7:0/3115415191 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57ec15db00 0x7f57ec0c9680 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.885+0000 7f57f2493640 1 --2- 172.21.15.7:0/3115415191 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f57ec0ce2b0 0x7f57ec14f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.885+0000 7f57f2493640 1 --2- 172.21.15.7:0/3115415191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57ec0b53b0 0x7f57ec1518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:02.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.885+0000 7f57f2493640 1 -- 172.21.15.7:0/3115415191 >> 172.21.15.7:0/3115415191 conn(0x7f57ec072290 msgr2=0x7f57ec0b6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:02.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.885+0000 7f57f2493640 1 -- 172.21.15.7:0/3115415191 shutdown_connections 2024-04-25T09:56:02.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.885+0000 7f57f2493640 1 -- 172.21.15.7:0/3115415191 wait complete. 2024-04-25T09:56:02.899 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:56:03.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.997+0000 7ffa608b5640 1 Processor -- start 2024-04-25T09:56:03.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.997+0000 7ffa608b5640 1 -- start start 2024-04-25T09:56:03.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.998+0000 7ffa608b5640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffa5c15db00 0x7ffa5c0d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:03.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.998+0000 7ffa608b5640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa5c0d1e80 con 0x7ffa5c0ce2b0 2024-04-25T09:56:03.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.998+0000 7ffa608b5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa5c162490 con 0x7ffa5c0b53b0 2024-04-25T09:56:03.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.998+0000 7ffa608b5640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa5c0b5930 con 0x7ffa5c15db00 2024-04-25T09:56:03.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.998+0000 7ffa5a59c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffa5c15db00 0x7ffa5c0d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:03.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.998+0000 7ffa5a59c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffa5c15db00 0x7ffa5c0d0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35276/0 (socket says 172.21.15.7:35276) 2024-04-25T09:56:03.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.998+0000 7ffa5a59c640 1 -- 172.21.15.7:0/2174971493 learned_addr learned my addr 172.21.15.7:0/2174971493 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:03.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.998+0000 7ffa5ad9d640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ffa5c0ce2b0 0x7ffa5c161d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39322/0 (socket says 172.21.15.7:39322) 2024-04-25T09:56:03.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.998+0000 7ffa5a59c640 1 -- 172.21.15.7:0/2174971493 >> v1:172.21.15.55:6789/0 conn(0x7ffa5c0b53b0 legacy=0x7ffa5c161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:03.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.998+0000 7ffa5a59c640 1 -- 172.21.15.7:0/2174971493 >> v1:172.21.15.7:6789/0 conn(0x7ffa5c0ce2b0 legacy=0x7ffa5c161d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:03.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.998+0000 7ffa5a59c640 1 -- 172.21.15.7:0/2174971493 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c0b5c10 con 0x7ffa5c15db00 2024-04-25T09:56:03.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.998+0000 7ffa59d9b640 1 -- 172.21.15.7:0/2174971493 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776308633 0 0) 0x7ffa5c0d1e80 con 0x7ffa5c0ce2b0 2024-04-25T09:56:03.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.999+0000 7ffa5a59c640 1 --2- 172.21.15.7:0/2174971493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa5c15db00 0x7ffa5c0d0340 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c009870 tx=0x7ffa4c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ffdf525f3f2636 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:03.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.999+0000 7ffa59d9b640 1 -- 172.21.15.7:0/2174971493 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c037070 con 0x7ffa5c15db00 2024-04-25T09:56:03.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.999+0000 7ffa59d9b640 1 -- 172.21.15.7:0/2174971493 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4c032440 con 0x7ffa5c15db00 2024-04-25T09:56:03.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:02.999+0000 7ffa59d9b640 1 -- 172.21.15.7:0/2174971493 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c032810 con 0x7ffa5c15db00 2024-04-25T09:56:03.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.000+0000 7ffa608b5640 1 -- 172.21.15.7:0/2174971493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa5c15db00 msgr2=0x7ffa5c0d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:03.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.000+0000 7ffa608b5640 1 --2- 172.21.15.7:0/2174971493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa5c15db00 0x7ffa5c0d0340 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c009870 tx=0x7ffa4c02a2a0 comp rx=0 tx=0).stop 2024-04-25T09:56:03.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.000+0000 7ffa608b5640 1 -- 172.21.15.7:0/2174971493 shutdown_connections 2024-04-25T09:56:03.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.000+0000 7ffa608b5640 1 --2- 172.21.15.7:0/2174971493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa5c15db00 0x7ffa5c0d0340 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:03.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.000+0000 7ffa608b5640 1 -- 172.21.15.7:0/2174971493 >> 172.21.15.7:0/2174971493 conn(0x7ffa5c072290 msgr2=0x7ffa5c0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:03.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.000+0000 7ffa608b5640 1 -- 172.21.15.7:0/2174971493 shutdown_connections 2024-04-25T09:56:03.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.000+0000 7ffa608b5640 1 -- 172.21.15.7:0/2174971493 wait complete. 2024-04-25T09:56:03.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.001+0000 7ffa608b5640 1 Processor -- start 2024-04-25T09:56:03.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.001+0000 7ffa608b5640 1 -- start start 2024-04-25T09:56:03.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.002+0000 7ffa608b5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffa5c0b53b0 0x7ffa5c0caa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:03.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.002+0000 7ffa608b5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa5c0ce2b0 0x7ffa5c160a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:03.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.002+0000 7ffa608b5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa5c15db00 0x7ffa5c1f3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:03.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.002+0000 7ffa608b5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c0b61d0 con 0x7ffa5c15db00 2024-04-25T09:56:03.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.002+0000 7ffa608b5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c15dee0 con 0x7ffa5c0ce2b0 2024-04-25T09:56:03.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.002+0000 7ffa608b5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c0d3660 con 0x7ffa5c0b53b0 2024-04-25T09:56:03.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.002+0000 7ffa5ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa5c15db00 0x7ffa5c1f3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.002+0000 7ffa5ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa5c15db00 0x7ffa5c1f3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35278/0 (socket says 172.21.15.7:35278) 2024-04-25T09:56:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.002+0000 7ffa5ad9d640 1 -- 172.21.15.7:0/380586157 learned_addr learned my addr 172.21.15.7:0/380586157 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.002+0000 7ffa53fff640 1 --2- 172.21.15.7:0/380586157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa5c0ce2b0 0x7ffa5c160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.002+0000 7ffa5a59c640 1 --2- 172.21.15.7:0/380586157 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffa5c0b53b0 0x7ffa5c0caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.002+0000 7ffa5ad9d640 1 -- 172.21.15.7:0/380586157 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffa5c0b53b0 msgr2=0x7ffa5c0caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.002+0000 7ffa5ad9d640 1 --2- 172.21.15.7:0/380586157 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffa5c0b53b0 0x7ffa5c0caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.002+0000 7ffa5ad9d640 1 -- 172.21.15.7:0/380586157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa5c0ce2b0 msgr2=0x7ffa5c160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.002+0000 7ffa5ad9d640 1 --2- 172.21.15.7:0/380586157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa5c0ce2b0 0x7ffa5c160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.002+0000 7ffa5ad9d640 1 -- 172.21.15.7:0/380586157 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c160fa0 con 0x7ffa5c15db00 2024-04-25T09:56:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.002+0000 7ffa5ad9d640 1 --2- 172.21.15.7:0/380586157 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa5c15db00 0x7ffa5c1f3010 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400c730 tx=0x7ffa5400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.003+0000 7ffa52ffd640 1 -- 172.21.15.7:0/380586157 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa54018070 con 0x7ffa5c15db00 2024-04-25T09:56:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.003+0000 7ffa52ffd640 1 -- 172.21.15.7:0/380586157 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5400ce40 con 0x7ffa5c15db00 2024-04-25T09:56:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.003+0000 7ffa608b5640 1 -- 172.21.15.7:0/380586157 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa5c1f3550 con 0x7ffa5c15db00 2024-04-25T09:56:03.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.003+0000 7ffa52ffd640 1 -- 172.21.15.7:0/380586157 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5400a860 con 0x7ffa5c15db00 2024-04-25T09:56:03.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.003+0000 7ffa608b5640 1 -- 172.21.15.7:0/380586157 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa5c0cb2c0 con 0x7ffa5c15db00 2024-04-25T09:56:03.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.004+0000 7ffa608b5640 1 -- 172.21.15.7:0/380586157 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa5c068fd0 con 0x7ffa5c15db00 2024-04-25T09:56:03.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.005+0000 7ffa52ffd640 1 -- 172.21.15.7:0/380586157 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffa5401b070 con 0x7ffa5c15db00 2024-04-25T09:56:03.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.005+0000 7ffa52ffd640 1 --2- 172.21.15.7:0/380586157 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ffa3c06b4d0 0x7ffa3c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:03.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.005+0000 7ffa52ffd640 1 -- 172.21.15.7:0/380586157 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ffa54089860 con 0x7ffa5c15db00 2024-04-25T09:56:03.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.005+0000 7ffa5a59c640 1 --2- 172.21.15.7:0/380586157 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ffa3c06b4d0 0x7ffa3c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:03.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.006+0000 7ffa5a59c640 1 --2- 172.21.15.7:0/380586157 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ffa3c06b4d0 0x7ffa3c06d990 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c034000 tx=0x7ffa4c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:03.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.010+0000 7ffa52ffd640 1 -- 172.21.15.7:0/380586157 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffa54057f00 con 0x7ffa5c15db00 2024-04-25T09:56:03.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.233+0000 7ffa608b5640 1 -- 172.21.15.7:0/380586157 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa5c0d16b0 con 0x7ffa5c15db00 2024-04-25T09:56:03.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.234+0000 7ffa52ffd640 1 -- 172.21.15.7:0/380586157 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4929 (secure 0 0 0) 0x7ffa5405bfa0 con 0x7ffa5c15db00 2024-04-25T09:56:03.237 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:03.237 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5047,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2022061608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2022061608},{"type":"v1","addr":"172.21.15.55:6834","nonce":2022061608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5382,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/2607466795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2607466795},{"type":"v1","addr":"172.21.15.7:6836","nonce":2607466795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5385,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1576325055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1576325055},{"type":"v1","addr":"172.21.15.7:6837","nonce":1576325055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:55:35.091962+0000","modified":"2024-04-25T09:55:37.095949+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5391":{"gid":5391,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/223801838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":223801838},{"type":"v1","addr":"172.21.15.55:6835","nonce":223801838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T09:56:03.237 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 15 2024-04-25T09:56:03.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.235+0000 7ffa608b5640 1 -- 172.21.15.7:0/380586157 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ffa3c06b4d0 msgr2=0x7ffa3c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:03.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.235+0000 7ffa608b5640 1 --2- 172.21.15.7:0/380586157 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ffa3c06b4d0 0x7ffa3c06d990 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c034000 tx=0x7ffa4c02e000 comp rx=0 tx=0).stop 2024-04-25T09:56:03.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.235+0000 7ffa608b5640 1 -- 172.21.15.7:0/380586157 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa5c15db00 msgr2=0x7ffa5c1f3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:03.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.235+0000 7ffa608b5640 1 --2- 172.21.15.7:0/380586157 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa5c15db00 0x7ffa5c1f3010 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400c730 tx=0x7ffa5400cbf0 comp rx=0 tx=0).stop 2024-04-25T09:56:03.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.235+0000 7ffa608b5640 1 -- 172.21.15.7:0/380586157 shutdown_connections 2024-04-25T09:56:03.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.235+0000 7ffa608b5640 1 --2- 172.21.15.7:0/380586157 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ffa3c06b4d0 0x7ffa3c06d990 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:03.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.236+0000 7ffa608b5640 1 --2- 172.21.15.7:0/380586157 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa5c15db00 0x7ffa5c1f3010 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:03.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.236+0000 7ffa608b5640 1 --2- 172.21.15.7:0/380586157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa5c0ce2b0 0x7ffa5c160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:03.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.236+0000 7ffa608b5640 1 --2- 172.21.15.7:0/380586157 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffa5c0b53b0 0x7ffa5c0caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:03.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.236+0000 7ffa608b5640 1 -- 172.21.15.7:0/380586157 >> 172.21.15.7:0/380586157 conn(0x7ffa5c072290 msgr2=0x7ffa5c0b6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:03.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.236+0000 7ffa608b5640 1 -- 172.21.15.7:0/380586157 shutdown_connections 2024-04-25T09:56:03.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.236+0000 7ffa608b5640 1 -- 172.21.15.7:0/380586157 wait complete. 2024-04-25T09:56:03.250 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:56:03.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.347+0000 7f83785e2640 1 Processor -- start 2024-04-25T09:56:03.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.347+0000 7f83785e2640 1 -- start start 2024-04-25T09:56:03.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.348+0000 7f83785e2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f837015db00 0x7f83700d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:03.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.348+0000 7f83785e2640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f83700ce2b0 0x7f83700d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:03.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.348+0000 7f83785e2640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83700d1e80 con 0x7f83700b53b0 2024-04-25T09:56:03.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.348+0000 7f83785e2640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83700b5930 con 0x7f83700ce2b0 2024-04-25T09:56:03.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.348+0000 7f83785e2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83700b5c10 con 0x7f837015db00 2024-04-25T09:56:03.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.348+0000 7f8376b7f640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f83700ce2b0 0x7f83700d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:03.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.348+0000 7f8375b7d640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f83700b53b0 0x7f8370161670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39338/0 (socket says 172.21.15.7:39338) 2024-04-25T09:56:03.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.348+0000 7f8375b7d640 1 -- 172.21.15.7:0/1919084969 learned_addr learned my addr 172.21.15.7:0/1919084969 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:56:03.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.349+0000 7f837637e640 1 --2- 172.21.15.7:0/1919084969 >> v2:172.21.15.55:3300/0 conn(0x7f837015db00 0x7f83700d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:03.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.349+0000 7f837537c640 1 -- 172.21.15.7:0/1919084969 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582098830 0 0) 0x7f83700d1e80 con 0x7f83700b53b0 2024-04-25T09:56:03.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.349+0000 7f837537c640 1 -- 172.21.15.7:0/1919084969 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8358003520 con 0x7f83700b53b0 2024-04-25T09:56:03.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.349+0000 7f8376b7f640 1 -- 172.21.15.7:0/1919084969 >> v2:172.21.15.55:3300/0 conn(0x7f837015db00 msgr2=0x7f83700d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:03.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.349+0000 7f8376b7f640 1 --2- 172.21.15.7:0/1919084969 >> v2:172.21.15.55:3300/0 conn(0x7f837015db00 0x7f83700d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:03.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.349+0000 7f8376b7f640 1 -- 172.21.15.7:0/1919084969 >> v1:172.21.15.7:6789/0 conn(0x7f83700b53b0 legacy=0x7f8370161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:03.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.349+0000 7f8376b7f640 1 -- 172.21.15.7:0/1919084969 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83700b5ef0 con 0x7f83700ce2b0 2024-04-25T09:56:03.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.350+0000 7f8376b7f640 1 --2- 172.21.15.7:0/1919084969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83700ce2b0 0x7f83700d0880 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f83700d4940 tx=0x7f836002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b141554fabb03c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:03.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.350+0000 7f837537c640 1 -- 172.21.15.7:0/1919084969 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8360007740 con 0x7f83700ce2b0 2024-04-25T09:56:03.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.350+0000 7f837537c640 1 -- 172.21.15.7:0/1919084969 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83600078e0 con 0x7f83700ce2b0 2024-04-25T09:56:03.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.350+0000 7f837537c640 1 -- 172.21.15.7:0/1919084969 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8360007cb0 con 0x7f83700ce2b0 2024-04-25T09:56:03.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.350+0000 7f83785e2640 1 -- 172.21.15.7:0/1919084969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83700ce2b0 msgr2=0x7f83700d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:03.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.350+0000 7f83785e2640 1 --2- 172.21.15.7:0/1919084969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83700ce2b0 0x7f83700d0880 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f83700d4940 tx=0x7f836002a680 comp rx=0 tx=0).stop 2024-04-25T09:56:03.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.350+0000 7f83785e2640 1 -- 172.21.15.7:0/1919084969 shutdown_connections 2024-04-25T09:56:03.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.350+0000 7f83785e2640 1 --2- 172.21.15.7:0/1919084969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83700ce2b0 0x7f83700d0880 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:03.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.350+0000 7f83785e2640 1 --2- 172.21.15.7:0/1919084969 >> v2:172.21.15.55:3300/0 conn(0x7f837015db00 0x7f83700d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:03.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.350+0000 7f83785e2640 1 -- 172.21.15.7:0/1919084969 >> 172.21.15.7:0/1919084969 conn(0x7f8370072290 msgr2=0x7f83700726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:03.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.350+0000 7f83785e2640 1 -- 172.21.15.7:0/1919084969 shutdown_connections 2024-04-25T09:56:03.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.350+0000 7f83785e2640 1 -- 172.21.15.7:0/1919084969 wait complete. 2024-04-25T09:56:03.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.352+0000 7f83785e2640 1 Processor -- start 2024-04-25T09:56:03.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.352+0000 7f83785e2640 1 -- start start 2024-04-25T09:56:03.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.352+0000 7f83785e2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83700b53b0 0x7f837014dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:03.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.352+0000 7f83785e2640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f83700ce2b0 0x7f837014cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:03.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.352+0000 7f83785e2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f837015db00 0x7f83700c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:03.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.352+0000 7f83785e2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83700d3660 con 0x7f83700b53b0 2024-04-25T09:56:03.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.352+0000 7f83785e2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83700b61d0 con 0x7f837015db00 2024-04-25T09:56:03.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.352+0000 7f83785e2640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83700b6c10 con 0x7f83700ce2b0 2024-04-25T09:56:03.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.352+0000 7f837637e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83700b53b0 0x7f837014dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:03.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.352+0000 7f837637e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83700b53b0 0x7f837014dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35282/0 (socket says 172.21.15.7:35282) 2024-04-25T09:56:03.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.352+0000 7f837637e640 1 -- 172.21.15.7:0/2557587277 learned_addr learned my addr 172.21.15.7:0/2557587277 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:03.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.353+0000 7f8376b7f640 1 --2- 172.21.15.7:0/2557587277 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f837015db00 0x7f83700c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:03.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.353+0000 7f837637e640 1 -- 172.21.15.7:0/2557587277 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f83700ce2b0 msgr2=0x7f837014cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:03.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.353+0000 7f837637e640 1 --2- 172.21.15.7:0/2557587277 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f83700ce2b0 0x7f837014cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:03.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.353+0000 7f837637e640 1 -- 172.21.15.7:0/2557587277 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f837015db00 msgr2=0x7f83700c9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:03.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.353+0000 7f837637e640 1 --2- 172.21.15.7:0/2557587277 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f837015db00 0x7f83700c9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:03.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.353+0000 7f837637e640 1 -- 172.21.15.7:0/2557587277 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83701587b0 con 0x7f83700b53b0 2024-04-25T09:56:03.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.353+0000 7f837637e640 1 --2- 172.21.15.7:0/2557587277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83700b53b0 0x7f837014dd90 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f836800e870 tx=0x7f836800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:03.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.353+0000 7f836effd640 1 -- 172.21.15.7:0/2557587277 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8368017070 con 0x7f83700b53b0 2024-04-25T09:56:03.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.353+0000 7f836effd640 1 -- 172.21.15.7:0/2557587277 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836800c940 con 0x7f83700b53b0 2024-04-25T09:56:03.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.353+0000 7f83785e2640 1 -- 172.21.15.7:0/2557587277 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8370158a90 con 0x7f83700b53b0 2024-04-25T09:56:03.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.353+0000 7f836effd640 1 -- 172.21.15.7:0/2557587277 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836800cd30 con 0x7f83700b53b0 2024-04-25T09:56:03.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.353+0000 7f83785e2640 1 -- 172.21.15.7:0/2557587277 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8370159050 con 0x7f83700b53b0 2024-04-25T09:56:03.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.354+0000 7f83785e2640 1 -- 172.21.15.7:0/2557587277 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8370068fd0 con 0x7f83700b53b0 2024-04-25T09:56:03.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.355+0000 7f836effd640 1 -- 172.21.15.7:0/2557587277 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f836801a070 con 0x7f83700b53b0 2024-04-25T09:56:03.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.355+0000 7f836effd640 1 --2- 172.21.15.7:0/2557587277 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f835c06b4d0 0x7f835c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:03.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.355+0000 7f836effd640 1 -- 172.21.15.7:0/2557587277 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f836808a630 con 0x7f83700b53b0 2024-04-25T09:56:03.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.355+0000 7f8375b7d640 1 --2- 172.21.15.7:0/2557587277 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f835c06b4d0 0x7f835c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:03.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.356+0000 7f8375b7d640 1 --2- 172.21.15.7:0/2557587277 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f835c06b4d0 0x7f835c06d990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8364000f60 tx=0x7f83640078f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:03.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.359+0000 7f836effd640 1 -- 172.21.15.7:0/2557587277 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8368059320 con 0x7f83700b53b0 2024-04-25T09:56:03.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.542+0000 7f83785e2640 1 -- 172.21.15.7:0/2557587277 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f837015d320 con 0x7f83700b53b0 2024-04-25T09:56:03.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.543+0000 7f836effd640 1 -- 172.21.15.7:0/2557587277 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16846 (secure 0 0 0) 0x7f8368058c20 con 0x7f83700b53b0 2024-04-25T09:56:03.546 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:03.547 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":39,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:55:36.722817+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:55:33.644089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T09:55:34.059847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:56:03.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.545+0000 7f83785e2640 1 -- 172.21.15.7:0/2557587277 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f835c06b4d0 msgr2=0x7f835c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:03.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.545+0000 7f83785e2640 1 --2- 172.21.15.7:0/2557587277 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f835c06b4d0 0x7f835c06d990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8364000f60 tx=0x7f83640078f0 comp rx=0 tx=0).stop 2024-04-25T09:56:03.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.545+0000 7f83785e2640 1 -- 172.21.15.7:0/2557587277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83700b53b0 msgr2=0x7f837014dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:03.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.545+0000 7f83785e2640 1 --2- 172.21.15.7:0/2557587277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83700b53b0 0x7f837014dd90 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f836800e870 tx=0x7f836800ed30 comp rx=0 tx=0).stop 2024-04-25T09:56:03.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.545+0000 7f83785e2640 1 -- 172.21.15.7:0/2557587277 shutdown_connections 2024-04-25T09:56:03.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.545+0000 7f83785e2640 1 --2- 172.21.15.7:0/2557587277 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f835c06b4d0 0x7f835c06d990 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:03.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.545+0000 7f83785e2640 1 --2- 172.21.15.7:0/2557587277 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f837015db00 0x7f83700c9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:03.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.545+0000 7f83785e2640 1 --2- 172.21.15.7:0/2557587277 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f83700ce2b0 0x7f837014cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:03.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.545+0000 7f83785e2640 1 --2- 172.21.15.7:0/2557587277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83700b53b0 0x7f837014dd90 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:03.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.545+0000 7f83785e2640 1 -- 172.21.15.7:0/2557587277 >> 172.21.15.7:0/2557587277 conn(0x7f8370072290 msgr2=0x7f8370072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:03.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.545+0000 7f83785e2640 1 -- 172.21.15.7:0/2557587277 shutdown_connections 2024-04-25T09:56:03.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.545+0000 7f83785e2640 1 -- 172.21.15.7:0/2557587277 wait complete. 2024-04-25T09:56:03.559 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:56:03.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.658+0000 7fce60eac640 1 Processor -- start 2024-04-25T09:56:03.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.658+0000 7fce60eac640 1 -- start start 2024-04-25T09:56:03.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.659+0000 7fce60eac640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fce5c0b5e60 0x7fce5c06bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:03.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.659+0000 7fce60eac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fce5c0b6a40 0x7fce5c06c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:03.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.659+0000 7fce60eac640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce5c06ca30 con 0x7fce5c15dd00 2024-04-25T09:56:03.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.659+0000 7fce60eac640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce5c15e0e0 con 0x7fce5c0b6a40 2024-04-25T09:56:03.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.659+0000 7fce60eac640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c06cfe0 con 0x7fce5c0b5e60 2024-04-25T09:56:03.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.659+0000 7fce5ad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fce5c0b6a40 0x7fce5c06c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:03.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.659+0000 7fce59d9b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fce5c0b5e60 0x7fce5c06bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:03.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.659+0000 7fce5a59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fce5c15dd00 0x7fce5c0b5750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:59712/0 (socket says 172.21.15.7:59712) 2024-04-25T09:56:03.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.659+0000 7fce5ad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fce5c0b6a40 0x7fce5c06c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:42126/0 (socket says 172.21.15.7:42126) 2024-04-25T09:56:03.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.659+0000 7fce5a59c640 1 -- 172.21.15.7:0/778851318 learned_addr learned my addr 172.21.15.7:0/778851318 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:56:03.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.659+0000 7fce5ad9d640 1 -- 172.21.15.7:0/778851318 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fce5c0b5e60 msgr2=0x7fce5c06bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:03.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.659+0000 7fce5ad9d640 1 --2- 172.21.15.7:0/778851318 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fce5c0b5e60 0x7fce5c06bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:03.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.659+0000 7fce5ad9d640 1 -- 172.21.15.7:0/778851318 >> v1:172.21.15.55:6789/0 conn(0x7fce5c15dd00 legacy=0x7fce5c0b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:03.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.659+0000 7fce5959a640 1 -- 172.21.15.7:0/778851318 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3448914765 0 0) 0x7fce5c06ca30 con 0x7fce5c15dd00 2024-04-25T09:56:03.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.659+0000 7fce5ad9d640 1 -- 172.21.15.7:0/778851318 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce5c06cd00 con 0x7fce5c0b6a40 2024-04-25T09:56:03.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.660+0000 7fce5ad9d640 1 --2- 172.21.15.7:0/778851318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce5c0b6a40 0x7fce5c06c4f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fce54009d90 tx=0x7fce5402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85f429ffaa14374d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:03.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.660+0000 7fce5959a640 1 -- 172.21.15.7:0/778851318 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce54007740 con 0x7fce5c0b6a40 2024-04-25T09:56:03.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.660+0000 7fce5959a640 1 -- 172.21.15.7:0/778851318 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce540078e0 con 0x7fce5c0b6a40 2024-04-25T09:56:03.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.660+0000 7fce5959a640 1 -- 172.21.15.7:0/778851318 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce54007cb0 con 0x7fce5c0b6a40 2024-04-25T09:56:03.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.661+0000 7fce60eac640 1 -- 172.21.15.7:0/778851318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce5c0b6a40 msgr2=0x7fce5c06c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:03.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.661+0000 7fce60eac640 1 --2- 172.21.15.7:0/778851318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce5c0b6a40 0x7fce5c06c4f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fce54009d90 tx=0x7fce5402a6f0 comp rx=0 tx=0).stop 2024-04-25T09:56:03.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.661+0000 7fce60eac640 1 -- 172.21.15.7:0/778851318 shutdown_connections 2024-04-25T09:56:03.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.661+0000 7fce60eac640 1 --2- 172.21.15.7:0/778851318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce5c0b6a40 0x7fce5c06c4f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:03.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.661+0000 7fce60eac640 1 --2- 172.21.15.7:0/778851318 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fce5c0b5e60 0x7fce5c06bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:03.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.661+0000 7fce60eac640 1 -- 172.21.15.7:0/778851318 >> 172.21.15.7:0/778851318 conn(0x7fce5c0d07b0 msgr2=0x7fce5c0d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:03.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.661+0000 7fce60eac640 1 -- 172.21.15.7:0/778851318 shutdown_connections 2024-04-25T09:56:03.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.661+0000 7fce60eac640 1 -- 172.21.15.7:0/778851318 wait complete. 2024-04-25T09:56:03.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.662+0000 7fce60eac640 1 Processor -- start 2024-04-25T09:56:03.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.662+0000 7fce60eac640 1 -- start start 2024-04-25T09:56:03.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.663+0000 7fce60eac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce5c0b5e60 0x7fce5c0c9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:03.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.663+0000 7fce60eac640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce5c0b6a40 0x7fce5c1425c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.663+0000 7fce60eac640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fce5c15dd00 0x7fce5c155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.663+0000 7fce60eac640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c0d2260 con 0x7fce5c0b6a40 2024-04-25T09:56:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.663+0000 7fce60eac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c0d1f80 con 0x7fce5c0b5e60 2024-04-25T09:56:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.663+0000 7fce60eac640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c0d2780 con 0x7fce5c15dd00 2024-04-25T09:56:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.663+0000 7fce59d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce5c0b6a40 0x7fce5c1425c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.663+0000 7fce59d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce5c0b6a40 0x7fce5c1425c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35296/0 (socket says 172.21.15.7:35296) 2024-04-25T09:56:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.663+0000 7fce59d9b640 1 -- 172.21.15.7:0/1172062965 learned_addr learned my addr 172.21.15.7:0/1172062965 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.663+0000 7fce5a59c640 1 --2- 172.21.15.7:0/1172062965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce5c0b5e60 0x7fce5c0c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.663+0000 7fce5ad9d640 1 --2- 172.21.15.7:0/1172062965 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fce5c15dd00 0x7fce5c155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.664+0000 7fce59d9b640 1 -- 172.21.15.7:0/1172062965 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fce5c15dd00 msgr2=0x7fce5c155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.664+0000 7fce59d9b640 1 --2- 172.21.15.7:0/1172062965 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fce5c15dd00 0x7fce5c155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.664+0000 7fce59d9b640 1 -- 172.21.15.7:0/1172062965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce5c0b5e60 msgr2=0x7fce5c0c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.664+0000 7fce59d9b640 1 --2- 172.21.15.7:0/1172062965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce5c0b5e60 0x7fce5c0c9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.664+0000 7fce59d9b640 1 -- 172.21.15.7:0/1172062965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce5c0cb8d0 con 0x7fce5c0b6a40 2024-04-25T09:56:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.664+0000 7fce59d9b640 1 --2- 172.21.15.7:0/1172062965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce5c0b6a40 0x7fce5c1425c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fce5000e960 tx=0x7fce5000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:03.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.664+0000 7fce4affd640 1 -- 172.21.15.7:0/1172062965 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce50017070 con 0x7fce5c0b6a40 2024-04-25T09:56:03.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.664+0000 7fce4affd640 1 -- 172.21.15.7:0/1172062965 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5000ca00 con 0x7fce5c0b6a40 2024-04-25T09:56:03.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.664+0000 7fce4affd640 1 -- 172.21.15.7:0/1172062965 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5000cdf0 con 0x7fce5c0b6a40 2024-04-25T09:56:03.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.664+0000 7fce60eac640 1 -- 172.21.15.7:0/1172062965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce5c0ca9e0 con 0x7fce5c0b6a40 2024-04-25T09:56:03.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.664+0000 7fce60eac640 1 -- 172.21.15.7:0/1172062965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce5c0cafa0 con 0x7fce5c0b6a40 2024-04-25T09:56:03.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.665+0000 7fce60eac640 1 -- 172.21.15.7:0/1172062965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce5c068fd0 con 0x7fce5c0b6a40 2024-04-25T09:56:03.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.666+0000 7fce4affd640 1 -- 172.21.15.7:0/1172062965 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fce5001a070 con 0x7fce5c0b6a40 2024-04-25T09:56:03.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.666+0000 7fce4affd640 1 --2- 172.21.15.7:0/1172062965 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fce3c06b500 0x7fce3c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:03.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.666+0000 7fce4affd640 1 -- 172.21.15.7:0/1172062965 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fce5008a360 con 0x7fce5c0b6a40 2024-04-25T09:56:03.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.666+0000 7fce5a59c640 1 --2- 172.21.15.7:0/1172062965 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fce3c06b500 0x7fce3c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:03.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.666+0000 7fce5a59c640 1 --2- 172.21.15.7:0/1172062965 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fce3c06b500 0x7fce3c06d9c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fce4c007fd0 tx=0x7fce4c007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:03.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.670+0000 7fce4affd640 1 -- 172.21.15.7:0/1172062965 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fce50058a00 con 0x7fce5c0b6a40 2024-04-25T09:56:03.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.887+0000 7fce60eac640 1 -- 172.21.15.7:0/1172062965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fce5c1f6c60 con 0x7fce5c0b6a40 2024-04-25T09:56:03.891 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-04-25T09:56:03.888+0000 7f45ad572640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:56:03.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.894+0000 7fce4affd640 1 -- 172.21.15.7:0/1172062965 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) v1 ==== 161+0+0 (secure 0 0 0) 0x7fce5005caa0 con 0x7fce5c0b6a40 2024-04-25T09:56:03.897 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:56:03.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.896+0000 7fce60eac640 1 -- 172.21.15.7:0/1172062965 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fce3c06b500 msgr2=0x7fce3c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:03.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.896+0000 7fce60eac640 1 --2- 172.21.15.7:0/1172062965 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fce3c06b500 0x7fce3c06d9c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fce4c007fd0 tx=0x7fce4c007de0 comp rx=0 tx=0).stop 2024-04-25T09:56:03.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.896+0000 7fce60eac640 1 -- 172.21.15.7:0/1172062965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce5c0b6a40 msgr2=0x7fce5c1425c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:03.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.896+0000 7fce60eac640 1 --2- 172.21.15.7:0/1172062965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce5c0b6a40 0x7fce5c1425c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fce5000e960 tx=0x7fce5000ee20 comp rx=0 tx=0).stop 2024-04-25T09:56:03.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.896+0000 7fce60eac640 1 -- 172.21.15.7:0/1172062965 shutdown_connections 2024-04-25T09:56:03.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.896+0000 7fce60eac640 1 --2- 172.21.15.7:0/1172062965 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fce3c06b500 0x7fce3c06d9c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:03.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.896+0000 7fce60eac640 1 --2- 172.21.15.7:0/1172062965 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fce5c15dd00 0x7fce5c155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:03.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.896+0000 7fce60eac640 1 --2- 172.21.15.7:0/1172062965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce5c0b6a40 0x7fce5c1425c0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:03.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.896+0000 7fce60eac640 1 --2- 172.21.15.7:0/1172062965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce5c0b5e60 0x7fce5c0c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:03.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.896+0000 7fce60eac640 1 -- 172.21.15.7:0/1172062965 >> 172.21.15.7:0/1172062965 conn(0x7fce5c0d07b0 msgr2=0x7fce5c0ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:03.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.896+0000 7fce60eac640 1 -- 172.21.15.7:0/1172062965 shutdown_connections 2024-04-25T09:56:03.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:03.897+0000 7fce60eac640 1 -- 172.21.15.7:0/1172062965 wait complete. 2024-04-25T09:56:03.903 INFO:tasks.ceph.mds.b.smithi055.stderr: -6508> 2024-04-25T09:55:40.710+0000 7fee25d15640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:56:03.911 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:56:03.939 INFO:tasks.ceph.mds.b.smithi055.stdout:starting mds.b at 2024-04-25T09:56:04.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.011+0000 7feb2b5b0640 1 Processor -- start 2024-04-25T09:56:04.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.012+0000 7feb2b5b0640 1 -- start start 2024-04-25T09:56:04.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.012+0000 7feb2b5b0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feb240d3760 0x7feb2415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:04.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.012+0000 7feb2b5b0640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7feb2415f1c0 0x7feb240d3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:04.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.012+0000 7feb2b5b0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feb240ce830 0x7feb240b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:04.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.012+0000 7feb2b5b0640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb240ce380 con 0x7feb2415f1c0 2024-04-25T09:56:04.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.012+0000 7feb2b5b0640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb2415f000 con 0x7feb240ce830 2024-04-25T09:56:04.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.012+0000 7feb2b5b0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb240d2190 con 0x7feb240d3760 2024-04-25T09:56:04.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.013+0000 7feb28b4b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7feb2415f1c0 0x7feb240d3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:04.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.013+0000 7feb28b4b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7feb2415f1c0 0x7feb240d3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35312/0 (socket says 172.21.15.7:35312) 2024-04-25T09:56:04.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.013+0000 7feb28b4b640 1 -- 172.21.15.7:0/3206415233 learned_addr learned my addr 172.21.15.7:0/3206415233 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:04.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.013+0000 7feb28b4b640 1 -- 172.21.15.7:0/3206415233 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feb240d3760 msgr2=0x7feb2415eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:04.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.013+0000 7feb2934c640 1 --2- 172.21.15.7:0/3206415233 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feb240d3760 0x7feb2415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:04.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.013+0000 7feb29b4d640 1 --2- 172.21.15.7:0/3206415233 >> v2:172.21.15.55:3300/0 conn(0x7feb240ce830 0x7feb240b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:04.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.013+0000 7feb28b4b640 1 --2- 172.21.15.7:0/3206415233 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feb240d3760 0x7feb2415eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:04.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.013+0000 7feb28b4b640 1 -- 172.21.15.7:0/3206415233 >> v2:172.21.15.55:3300/0 conn(0x7feb240ce830 msgr2=0x7feb240b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:04.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.013+0000 7feb28b4b640 1 --2- 172.21.15.7:0/3206415233 >> v2:172.21.15.55:3300/0 conn(0x7feb240ce830 0x7feb240b2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:04.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.013+0000 7feb28b4b640 1 -- 172.21.15.7:0/3206415233 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb240d4080 con 0x7feb2415f1c0 2024-04-25T09:56:04.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.014+0000 7feb28b4b640 1 --2- 172.21.15.7:0/3206415233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb2415f1c0 0x7feb240d3b40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7feb240d1760 tx=0x7feb1402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b49a0c4388d0dc74 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:04.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.016+0000 7feb1bfff640 1 -- 172.21.15.7:0/3206415233 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb14037070 con 0x7feb2415f1c0 2024-04-25T09:56:04.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.016+0000 7feb1bfff640 1 -- 172.21.15.7:0/3206415233 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb14032440 con 0x7feb2415f1c0 2024-04-25T09:56:04.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.016+0000 7feb1bfff640 1 -- 172.21.15.7:0/3206415233 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb14032810 con 0x7feb2415f1c0 2024-04-25T09:56:04.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.016+0000 7feb2b5b0640 1 -- 172.21.15.7:0/3206415233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb2415f1c0 msgr2=0x7feb240d3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:04.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.016+0000 7feb2b5b0640 1 --2- 172.21.15.7:0/3206415233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb2415f1c0 0x7feb240d3b40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7feb240d1760 tx=0x7feb1402a1e0 comp rx=0 tx=0).stop 2024-04-25T09:56:04.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.016+0000 7feb2b5b0640 1 -- 172.21.15.7:0/3206415233 shutdown_connections 2024-04-25T09:56:04.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.016+0000 7feb2b5b0640 1 --2- 172.21.15.7:0/3206415233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb2415f1c0 0x7feb240d3b40 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:04.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.016+0000 7feb2b5b0640 1 --2- 172.21.15.7:0/3206415233 >> v2:172.21.15.55:3300/0 conn(0x7feb240ce830 0x7feb240b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:04.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.016+0000 7feb2b5b0640 1 --2- 172.21.15.7:0/3206415233 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feb240d3760 0x7feb2415eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:04.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.016+0000 7feb2b5b0640 1 -- 172.21.15.7:0/3206415233 >> 172.21.15.7:0/3206415233 conn(0x7feb24072680 msgr2=0x7feb24072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:04.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.016+0000 7feb2b5b0640 1 -- 172.21.15.7:0/3206415233 shutdown_connections 2024-04-25T09:56:04.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.016+0000 7feb2b5b0640 1 -- 172.21.15.7:0/3206415233 wait complete. 2024-04-25T09:56:04.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.018+0000 7feb2b5b0640 1 Processor -- start 2024-04-25T09:56:04.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.018+0000 7feb2b5b0640 1 -- start start 2024-04-25T09:56:04.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.018+0000 7feb2b5b0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb240ce830 0x7feb2415a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:04.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.018+0000 7feb2b5b0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb240d3760 0x7feb2415c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:04.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.018+0000 7feb2b5b0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feb2415f1c0 0x7feb240cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:04.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.018+0000 7feb2b5b0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb240d1e20 con 0x7feb240d3760 2024-04-25T09:56:04.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.018+0000 7feb2b5b0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb240d1b40 con 0x7feb240ce830 2024-04-25T09:56:04.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.018+0000 7feb2b5b0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb2415de10 con 0x7feb2415f1c0 2024-04-25T09:56:04.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.018+0000 7feb28b4b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb240d3760 0x7feb2415c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:04.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.019+0000 7feb28b4b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb240d3760 0x7feb2415c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35322/0 (socket says 172.21.15.7:35322) 2024-04-25T09:56:04.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.019+0000 7feb28b4b640 1 -- 172.21.15.7:0/2051301240 learned_addr learned my addr 172.21.15.7:0/2051301240 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:04.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.019+0000 7feb2934c640 1 --2- 172.21.15.7:0/2051301240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb240ce830 0x7feb2415a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:04.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.019+0000 7feb29b4d640 1 --2- 172.21.15.7:0/2051301240 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feb2415f1c0 0x7feb240cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:04.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.019+0000 7feb28b4b640 1 -- 172.21.15.7:0/2051301240 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feb2415f1c0 msgr2=0x7feb240cc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:04.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.019+0000 7feb28b4b640 1 --2- 172.21.15.7:0/2051301240 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feb2415f1c0 0x7feb240cc730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:04.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.019+0000 7feb28b4b640 1 -- 172.21.15.7:0/2051301240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb240ce830 msgr2=0x7feb2415a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:04.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.019+0000 7feb28b4b640 1 --2- 172.21.15.7:0/2051301240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb240ce830 0x7feb2415a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:04.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.019+0000 7feb28b4b640 1 -- 172.21.15.7:0/2051301240 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2415a320 con 0x7feb240d3760 2024-04-25T09:56:04.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.019+0000 7feb28b4b640 1 --2- 172.21.15.7:0/2051301240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb240d3760 0x7feb2415c1f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7feb1402a220 tx=0x7feb140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:04.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.019+0000 7feb19ffb640 1 -- 172.21.15.7:0/2051301240 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb14037040 con 0x7feb240d3760 2024-04-25T09:56:04.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.019+0000 7feb19ffb640 1 -- 172.21.15.7:0/2051301240 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb14042070 con 0x7feb240d3760 2024-04-25T09:56:04.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.019+0000 7feb19ffb640 1 -- 172.21.15.7:0/2051301240 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb14030bb0 con 0x7feb240d3760 2024-04-25T09:56:04.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.019+0000 7feb2b5b0640 1 -- 172.21.15.7:0/2051301240 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb240cae60 con 0x7feb240d3760 2024-04-25T09:56:04.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.020+0000 7feb2b5b0640 1 -- 172.21.15.7:0/2051301240 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb240cb700 con 0x7feb240d3760 2024-04-25T09:56:04.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.021+0000 7feb2b5b0640 1 -- 172.21.15.7:0/2051301240 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb24068f60 con 0x7feb240d3760 2024-04-25T09:56:04.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.021+0000 7feb19ffb640 1 -- 172.21.15.7:0/2051301240 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7feb14047460 con 0x7feb240d3760 2024-04-25T09:56:04.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.021+0000 7feb19ffb640 1 --2- 172.21.15.7:0/2051301240 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7feb0806b500 0x7feb0806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:04.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.022+0000 7feb19ffb640 1 -- 172.21.15.7:0/2051301240 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6187+0+0 (secure 0 0 0) 0x7feb140aaeb0 con 0x7feb240d3760 2024-04-25T09:56:04.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.022+0000 7feb2934c640 1 --2- 172.21.15.7:0/2051301240 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7feb0806b500 0x7feb0806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:04.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.022+0000 7feb2934c640 1 --2- 172.21.15.7:0/2051301240 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7feb0806b500 0x7feb0806d9c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7feb2000aac0 tx=0x7feb20008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:04.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.026+0000 7feb19ffb640 1 -- 172.21.15.7:0/2051301240 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7feb14079500 con 0x7feb240d3760 2024-04-25T09:56:04.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.247+0000 7feb2b5b0640 1 -- 172.21.15.7:0/2051301240 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7feb240ce610 con 0x7feb240d3760 2024-04-25T09:56:04.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.895+0000 7feb19ffb640 1 -- 172.21.15.7:0/2051301240 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7feb1407d5a0 con 0x7feb240d3760 2024-04-25T09:56:04.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.898+0000 7feb2b5b0640 1 -- 172.21.15.7:0/2051301240 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7feb0806b500 msgr2=0x7feb0806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:04.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.898+0000 7feb2b5b0640 1 --2- 172.21.15.7:0/2051301240 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7feb0806b500 0x7feb0806d9c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7feb2000aac0 tx=0x7feb20008040 comp rx=0 tx=0).stop 2024-04-25T09:56:04.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.898+0000 7feb2b5b0640 1 -- 172.21.15.7:0/2051301240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb240d3760 msgr2=0x7feb2415c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:04.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.898+0000 7feb2b5b0640 1 --2- 172.21.15.7:0/2051301240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb240d3760 0x7feb2415c1f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7feb1402a220 tx=0x7feb140046c0 comp rx=0 tx=0).stop 2024-04-25T09:56:04.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.898+0000 7feb2b5b0640 1 -- 172.21.15.7:0/2051301240 shutdown_connections 2024-04-25T09:56:04.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.898+0000 7feb2b5b0640 1 --2- 172.21.15.7:0/2051301240 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7feb0806b500 0x7feb0806d9c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:04.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.898+0000 7feb2b5b0640 1 --2- 172.21.15.7:0/2051301240 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feb2415f1c0 0x7feb240cc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:04.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.898+0000 7feb2b5b0640 1 --2- 172.21.15.7:0/2051301240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb240d3760 0x7feb2415c1f0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:04.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.898+0000 7feb2b5b0640 1 --2- 172.21.15.7:0/2051301240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb240ce830 0x7feb2415a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:04.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.898+0000 7feb2b5b0640 1 -- 172.21.15.7:0/2051301240 >> 172.21.15.7:0/2051301240 conn(0x7feb24072680 msgr2=0x7feb240d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:04.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.898+0000 7feb2b5b0640 1 -- 172.21.15.7:0/2051301240 shutdown_connections 2024-04-25T09:56:04.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:04.898+0000 7feb2b5b0640 1 -- 172.21.15.7:0/2051301240 wait complete. 2024-04-25T09:56:04.914 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:56:05.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.022+0000 7fd0991d5640 1 Processor -- start 2024-04-25T09:56:05.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.022+0000 7fd0991d5640 1 -- start start 2024-04-25T09:56:05.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.023+0000 7fd0991d5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd09415a8e0 0x7fd09415ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:05.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.023+0000 7fd0991d5640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd0940b11b0 0x7fd0940b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:05.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.023+0000 7fd0991d5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd09415f2b0 con 0x7fd0940aeae0 2024-04-25T09:56:05.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.023+0000 7fd0991d5640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd09415acc0 con 0x7fd0940b11b0 2024-04-25T09:56:05.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.023+0000 7fd0991d5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0940cd440 con 0x7fd09415a8e0 2024-04-25T09:56:05.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.023+0000 7fd09359e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd0940b11b0 0x7fd0940b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:05.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.023+0000 7fd09359e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd0940b11b0 0x7fd0940b15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35330/0 (socket says 172.21.15.7:35330) 2024-04-25T09:56:05.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.023+0000 7fd09359e640 1 -- 172.21.15.7:0/99148452 learned_addr learned my addr 172.21.15.7:0/99148452 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:05.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.023+0000 7fd092d9d640 1 --2- 172.21.15.7:0/99148452 >> v2:172.21.15.55:3300/0 conn(0x7fd09415a8e0 0x7fd09415ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:05.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.023+0000 7fd09359e640 1 -- 172.21.15.7:0/99148452 >> v2:172.21.15.55:3300/0 conn(0x7fd09415a8e0 msgr2=0x7fd09415ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:05.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.023+0000 7fd09359e640 1 --2- 172.21.15.7:0/99148452 >> v2:172.21.15.55:3300/0 conn(0x7fd09415a8e0 0x7fd09415ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:05.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.023+0000 7fd09359e640 1 -- 172.21.15.7:0/99148452 >> v1:172.21.15.55:6789/0 conn(0x7fd0940aeae0 legacy=0x7fd0940b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:05.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.023+0000 7fd09359e640 1 -- 172.21.15.7:0/99148452 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0940b2c30 con 0x7fd0940b11b0 2024-04-25T09:56:05.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.024+0000 7fd092d9d640 1 --2- 172.21.15.7:0/99148452 >> v2:172.21.15.55:3300/0 conn(0x7fd09415a8e0 0x7fd09415ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:56:05.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.024+0000 7fd09359e640 1 --2- 172.21.15.7:0/99148452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0940b11b0 0x7fd0940b15e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd0940723c0 tx=0x7fd08c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b8249c1ffa7c00 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:05.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.024+0000 7fd09259c640 1 -- 172.21.15.7:0/99148452 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c036070 con 0x7fd0940b11b0 2024-04-25T09:56:05.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.024+0000 7fd09259c640 1 -- 172.21.15.7:0/99148452 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08c031600 con 0x7fd0940b11b0 2024-04-25T09:56:05.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.024+0000 7fd09259c640 1 -- 172.21.15.7:0/99148452 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c0319d0 con 0x7fd0940b11b0 2024-04-25T09:56:05.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.025+0000 7fd0991d5640 1 -- 172.21.15.7:0/99148452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0940b11b0 msgr2=0x7fd0940b15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:05.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.025+0000 7fd0991d5640 1 --2- 172.21.15.7:0/99148452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0940b11b0 0x7fd0940b15e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd0940723c0 tx=0x7fd08c02a6f0 comp rx=0 tx=0).stop 2024-04-25T09:56:05.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.025+0000 7fd0991d5640 1 -- 172.21.15.7:0/99148452 shutdown_connections 2024-04-25T09:56:05.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.025+0000 7fd0991d5640 1 --2- 172.21.15.7:0/99148452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0940b11b0 0x7fd0940b15e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:05.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.025+0000 7fd0991d5640 1 --2- 172.21.15.7:0/99148452 >> v2:172.21.15.55:3300/0 conn(0x7fd09415a8e0 0x7fd09415ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:05.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.025+0000 7fd0991d5640 1 -- 172.21.15.7:0/99148452 >> 172.21.15.7:0/99148452 conn(0x7fd094066f80 msgr2=0x7fd09406ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:05.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.025+0000 7fd0991d5640 1 -- 172.21.15.7:0/99148452 shutdown_connections 2024-04-25T09:56:05.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.025+0000 7fd0991d5640 1 -- 172.21.15.7:0/99148452 wait complete. 2024-04-25T09:56:05.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.026+0000 7fd0991d5640 1 Processor -- start 2024-04-25T09:56:05.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.027+0000 7fd0991d5640 1 -- start start 2024-04-25T09:56:05.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.027+0000 7fd0991d5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0940aeae0 0x7fd09414e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:05.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.027+0000 7fd0991d5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd0940b11b0 0x7fd0940b0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:05.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.027+0000 7fd0991d5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd09415a8e0 0x7fd0940b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:05.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.027+0000 7fd0991d5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0940cd950 con 0x7fd0940aeae0 2024-04-25T09:56:05.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.027+0000 7fd0991d5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0940b1b20 con 0x7fd09415a8e0 2024-04-25T09:56:05.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.027+0000 7fd0991d5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0940cdc30 con 0x7fd0940b11b0 2024-04-25T09:56:05.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.027+0000 7fd092d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0940aeae0 0x7fd09414e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:05.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.027+0000 7fd092d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0940aeae0 0x7fd09414e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35338/0 (socket says 172.21.15.7:35338) 2024-04-25T09:56:05.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.027+0000 7fd092d9d640 1 -- 172.21.15.7:0/468475468 learned_addr learned my addr 172.21.15.7:0/468475468 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:05.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.028+0000 7fd092d9d640 1 -- 172.21.15.7:0/468475468 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd0940b11b0 msgr2=0x7fd0940b0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:05.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.028+0000 7fd092d9d640 1 --2- 172.21.15.7:0/468475468 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd0940b11b0 0x7fd0940b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:05.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.028+0000 7fd092d9d640 1 -- 172.21.15.7:0/468475468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd09415a8e0 msgr2=0x7fd0940b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:05.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.028+0000 7fd092d9d640 1 --2- 172.21.15.7:0/468475468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd09415a8e0 0x7fd0940b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:05.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.028+0000 7fd092d9d640 1 -- 172.21.15.7:0/468475468 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd094150710 con 0x7fd0940aeae0 2024-04-25T09:56:05.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.028+0000 7fd092d9d640 1 --2- 172.21.15.7:0/468475468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0940aeae0 0x7fd09414e9e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd08400c7f0 tx=0x7fd08400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:05.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.028+0000 7fd08bfff640 1 -- 172.21.15.7:0/468475468 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd084015070 con 0x7fd0940aeae0 2024-04-25T09:56:05.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.028+0000 7fd08bfff640 1 -- 172.21.15.7:0/468475468 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd084007a30 con 0x7fd0940aeae0 2024-04-25T09:56:05.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.028+0000 7fd0991d5640 1 -- 172.21.15.7:0/468475468 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0941509f0 con 0x7fd0940aeae0 2024-04-25T09:56:05.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.028+0000 7fd08bfff640 1 -- 172.21.15.7:0/468475468 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd084007e00 con 0x7fd0940aeae0 2024-04-25T09:56:05.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.028+0000 7fd0991d5640 1 -- 172.21.15.7:0/468475468 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd094150fb0 con 0x7fd0940aeae0 2024-04-25T09:56:05.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.029+0000 7fd0991d5640 1 -- 172.21.15.7:0/468475468 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd094069040 con 0x7fd0940aeae0 2024-04-25T09:56:05.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.029+0000 7fd08bfff640 1 -- 172.21.15.7:0/468475468 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd084018070 con 0x7fd0940aeae0 2024-04-25T09:56:05.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.030+0000 7fd08bfff640 1 --2- 172.21.15.7:0/468475468 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd07406b4d0 0x7fd07406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:05.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.030+0000 7fd08bfff640 1 -- 172.21.15.7:0/468475468 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fd08408a300 con 0x7fd0940aeae0 2024-04-25T09:56:05.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.030+0000 7fd08a59c640 1 --2- 172.21.15.7:0/468475468 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd07406b4d0 0x7fd07406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:05.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.030+0000 7fd08a59c640 1 --2- 172.21.15.7:0/468475468 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd07406b4d0 0x7fd07406d990 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd07c006fd0 tx=0x7fd07c006bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:05.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.034+0000 7fd08bfff640 1 -- 172.21.15.7:0/468475468 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd084059030 con 0x7fd0940aeae0 2024-04-25T09:56:05.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:05.213+0000 7fd0991d5640 1 -- 172.21.15.7:0/468475468 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd09415c5b0 con 0x7fd0940aeae0 2024-04-25T09:56:06.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.025+0000 7fd08bfff640 1 -- 172.21.15.7:0/468475468 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v41) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd08408a120 con 0x7fd0940aeae0 2024-04-25T09:56:06.029 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:56:06.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.029+0000 7fd0991d5640 1 -- 172.21.15.7:0/468475468 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd07406b4d0 msgr2=0x7fd07406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:06.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.029+0000 7fd0991d5640 1 --2- 172.21.15.7:0/468475468 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd07406b4d0 0x7fd07406d990 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd07c006fd0 tx=0x7fd07c006bc0 comp rx=0 tx=0).stop 2024-04-25T09:56:06.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.029+0000 7fd0991d5640 1 -- 172.21.15.7:0/468475468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0940aeae0 msgr2=0x7fd09414e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:06.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.029+0000 7fd0991d5640 1 --2- 172.21.15.7:0/468475468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0940aeae0 0x7fd09414e9e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd08400c7f0 tx=0x7fd08400cbf0 comp rx=0 tx=0).stop 2024-04-25T09:56:06.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.029+0000 7fd0991d5640 1 -- 172.21.15.7:0/468475468 shutdown_connections 2024-04-25T09:56:06.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.029+0000 7fd0991d5640 1 --2- 172.21.15.7:0/468475468 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd07406b4d0 0x7fd07406d990 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:06.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.029+0000 7fd0991d5640 1 --2- 172.21.15.7:0/468475468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd09415a8e0 0x7fd0940b0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:06.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.029+0000 7fd0991d5640 1 --2- 172.21.15.7:0/468475468 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd0940b11b0 0x7fd0940b0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:06.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.029+0000 7fd0991d5640 1 --2- 172.21.15.7:0/468475468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd0940aeae0 0x7fd09414e9e0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:06.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.029+0000 7fd0991d5640 1 -- 172.21.15.7:0/468475468 >> 172.21.15.7:0/468475468 conn(0x7fd094066f80 msgr2=0x7fd094071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:06.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.030+0000 7fd0991d5640 1 -- 172.21.15.7:0/468475468 shutdown_connections 2024-04-25T09:56:06.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.030+0000 7fd0991d5640 1 -- 172.21.15.7:0/468475468 wait complete. 2024-04-25T09:56:06.047 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:56:06.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.158+0000 7f37829ce640 1 Processor -- start 2024-04-25T09:56:06.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.158+0000 7f37829ce640 1 -- start start 2024-04-25T09:56:06.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.159+0000 7f37829ce640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f377c15de70 0x7f377c0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:06.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.159+0000 7f37829ce640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f377c0d3f10 0x7f377c0b6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:06.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.159+0000 7f37829ce640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377c0d2290 con 0x7f377c0d3330 2024-04-25T09:56:06.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.159+0000 7f37829ce640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377c0d2570 con 0x7f377c0d3f10 2024-04-25T09:56:06.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.159+0000 7f37829ce640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377c0d2850 con 0x7f377c15de70 2024-04-25T09:56:06.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.159+0000 7f377b7fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f377c0d3330 0x7f377c0d3800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39344/0 (socket says 172.21.15.7:39344) 2024-04-25T09:56:06.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.159+0000 7f377b7fe640 1 -- 172.21.15.7:0/3394233302 learned_addr learned my addr 172.21.15.7:0/3394233302 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:56:06.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.159+0000 7f377affd640 1 -- 172.21.15.7:0/3394233302 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3629410928 0 0) 0x7f377c0d2290 con 0x7f377c0d3330 2024-04-25T09:56:06.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.159+0000 7f377affd640 1 -- 172.21.15.7:0/3394233302 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3764003520 con 0x7f377c0d3330 2024-04-25T09:56:06.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.160+0000 7f377bfff640 1 --2- 172.21.15.7:0/3394233302 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f377c15de70 0x7f377c0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:06.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.160+0000 7f3780f6b640 1 --2- 172.21.15.7:0/3394233302 >> v2:172.21.15.55:3300/0 conn(0x7f377c0d3f10 0x7f377c0b6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:06.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.160+0000 7f377affd640 1 -- 172.21.15.7:0/3394233302 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1239965976 0 0) 0x7f3764003520 con 0x7f377c0d3330 2024-04-25T09:56:06.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.160+0000 7f377affd640 1 -- 172.21.15.7:0/3394233302 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f377c15de70 msgr2=0x7f377c0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:06.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.160+0000 7f377affd640 1 --2- 172.21.15.7:0/3394233302 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f377c15de70 0x7f377c0d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:06.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.160+0000 7f377affd640 1 -- 172.21.15.7:0/3394233302 >> v2:172.21.15.55:3300/0 conn(0x7f377c0d3f10 msgr2=0x7f377c0b6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:06.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.160+0000 7f377affd640 1 --2- 172.21.15.7:0/3394233302 >> v2:172.21.15.55:3300/0 conn(0x7f377c0d3f10 0x7f377c0b6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:06.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.160+0000 7f377affd640 1 -- 172.21.15.7:0/3394233302 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c0d2b30 con 0x7f377c0d3330 2024-04-25T09:56:06.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.160+0000 7f377affd640 1 -- 172.21.15.7:0/3394233302 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f376c001670 con 0x7f377c0d3330 2024-04-25T09:56:06.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.160+0000 7f377affd640 1 -- 172.21.15.7:0/3394233302 >> v1:172.21.15.7:6789/0 conn(0x7f377c0d3330 legacy=0x7f377c0d3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:06.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.160+0000 7f377affd640 1 --2- 172.21.15.7:0/3394233302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37640039b0 0x7f3764003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:06.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.160+0000 7f377affd640 1 --2- 172.21.15.7:0/3394233302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3764004800 0x7f3764004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:06.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.160+0000 7f377affd640 1 --2- 172.21.15.7:0/3394233302 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f377c15de70 0x7f37640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:06.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.160+0000 7f377affd640 1 -- 172.21.15.7:0/3394233302 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c0d2570 con 0x7f37640039b0 2024-04-25T09:56:06.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.160+0000 7f377affd640 1 -- 172.21.15.7:0/3394233302 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c0d2850 con 0x7f3764004800 2024-04-25T09:56:06.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.160+0000 7f377affd640 1 -- 172.21.15.7:0/3394233302 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376400b9c0 con 0x7f377c15de70 2024-04-25T09:56:06.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.160+0000 7f377bfff640 1 --2- 172.21.15.7:0/3394233302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37640039b0 0x7f3764003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:06.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.160+0000 7f377b7fe640 1 --2- 172.21.15.7:0/3394233302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3764004800 0x7f3764004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:06.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.160+0000 7f3780f6b640 1 --2- 172.21.15.7:0/3394233302 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f377c15de70 0x7f37640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:06.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.160+0000 7f377bfff640 1 -- 172.21.15.7:0/3394233302 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f377c15de70 msgr2=0x7f37640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:06.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.160+0000 7f377bfff640 1 --2- 172.21.15.7:0/3394233302 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f377c15de70 0x7f37640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:06.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.160+0000 7f377bfff640 1 -- 172.21.15.7:0/3394233302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3764004800 msgr2=0x7f3764004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:06.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.160+0000 7f377bfff640 1 --2- 172.21.15.7:0/3394233302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3764004800 0x7f3764004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:06.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.160+0000 7f377bfff640 1 -- 172.21.15.7:0/3394233302 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3764003520 con 0x7f37640039b0 2024-04-25T09:56:06.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.160+0000 7f3780f6b640 1 --2- 172.21.15.7:0/3394233302 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f377c15de70 0x7f37640051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:06.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.161+0000 7f377bfff640 1 --2- 172.21.15.7:0/3394233302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37640039b0 0x7f3764003dd0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3770009ac0 tx=0x7f3764005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a8d6ce7ebd7fe0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:06.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.161+0000 7f377affd640 1 -- 172.21.15.7:0/3394233302 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770036070 con 0x7f37640039b0 2024-04-25T09:56:06.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.161+0000 7f377affd640 1 -- 172.21.15.7:0/3394233302 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3770031400 con 0x7f37640039b0 2024-04-25T09:56:06.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.161+0000 7f377affd640 1 -- 172.21.15.7:0/3394233302 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770009690 con 0x7f37640039b0 2024-04-25T09:56:06.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.162+0000 7f37829ce640 1 -- 172.21.15.7:0/3394233302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37640039b0 msgr2=0x7f3764003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:06.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.162+0000 7f37829ce640 1 --2- 172.21.15.7:0/3394233302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37640039b0 0x7f3764003dd0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3770009ac0 tx=0x7f3764005830 comp rx=0 tx=0).stop 2024-04-25T09:56:06.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.162+0000 7f3780f6b640 1 -- 172.21.15.7:0/3394233302 reap_dead start 2024-04-25T09:56:06.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.162+0000 7f37829ce640 1 -- 172.21.15.7:0/3394233302 shutdown_connections 2024-04-25T09:56:06.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.162+0000 7f37829ce640 1 -- 172.21.15.7:0/3394233302 >> 172.21.15.7:0/3394233302 conn(0x7f377c0726b0 msgr2=0x7f377c072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:06.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.162+0000 7f37829ce640 1 -- 172.21.15.7:0/3394233302 shutdown_connections 2024-04-25T09:56:06.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.162+0000 7f37829ce640 1 -- 172.21.15.7:0/3394233302 wait complete. 2024-04-25T09:56:06.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.163+0000 7f37829ce640 1 Processor -- start 2024-04-25T09:56:06.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.163+0000 7f37829ce640 1 -- start start 2024-04-25T09:56:06.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.164+0000 7f37829ce640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37640039b0 0x7f377c1557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:06.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.164+0000 7f37829ce640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f377c152fc0 0x7f377c0c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:06.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.164+0000 7f37829ce640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f377c0cbe10 0x7f377c0cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:06.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.164+0000 7f37829ce640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c0b9410 con 0x7f377c0cbe10 2024-04-25T09:56:06.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.164+0000 7f37829ce640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c0b9290 con 0x7f37640039b0 2024-04-25T09:56:06.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.164+0000 7f37829ce640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377c0d1920 con 0x7f377c152fc0 2024-04-25T09:56:06.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.164+0000 7f3780f6b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f377c0cbe10 0x7f377c0cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:06.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.164+0000 7f3780f6b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f377c0cbe10 0x7f377c0cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35354/0 (socket says 172.21.15.7:35354) 2024-04-25T09:56:06.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.164+0000 7f3780f6b640 1 -- 172.21.15.7:0/2543365839 learned_addr learned my addr 172.21.15.7:0/2543365839 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:06.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.164+0000 7f377bfff640 1 --2- 172.21.15.7:0/2543365839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37640039b0 0x7f377c1557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:06.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.164+0000 7f377b7fe640 1 --2- 172.21.15.7:0/2543365839 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f377c152fc0 0x7f377c0c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:06.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.164+0000 7f3780f6b640 1 -- 172.21.15.7:0/2543365839 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f377c152fc0 msgr2=0x7f377c0c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:06.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.164+0000 7f3780f6b640 1 --2- 172.21.15.7:0/2543365839 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f377c152fc0 0x7f377c0c9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:06.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.164+0000 7f3780f6b640 1 -- 172.21.15.7:0/2543365839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37640039b0 msgr2=0x7f377c1557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:06.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.164+0000 7f3780f6b640 1 --2- 172.21.15.7:0/2543365839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37640039b0 0x7f377c1557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:06.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.164+0000 7f3780f6b640 1 -- 172.21.15.7:0/2543365839 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c1f4ec0 con 0x7f377c0cbe10 2024-04-25T09:56:06.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.164+0000 7f377bfff640 1 --2- 172.21.15.7:0/2543365839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37640039b0 0x7f377c1557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:56:06.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.164+0000 7f3780f6b640 1 --2- 172.21.15.7:0/2543365839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f377c0cbe10 0x7f377c0cc290 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f377c0b6800 tx=0x7f3774009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:06.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.165+0000 7f3778ff9640 1 -- 172.21.15.7:0/2543365839 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774010d30 con 0x7f377c0cbe10 2024-04-25T09:56:06.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.165+0000 7f3778ff9640 1 -- 172.21.15.7:0/2543365839 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3774003990 con 0x7f377c0cbe10 2024-04-25T09:56:06.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.165+0000 7f3778ff9640 1 -- 172.21.15.7:0/2543365839 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774003d80 con 0x7f377c0cbe10 2024-04-25T09:56:06.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.165+0000 7f37829ce640 1 -- 172.21.15.7:0/2543365839 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f377c1f51a0 con 0x7f377c0cbe10 2024-04-25T09:56:06.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.165+0000 7f37829ce640 1 -- 172.21.15.7:0/2543365839 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f377c1f5760 con 0x7f377c0cbe10 2024-04-25T09:56:06.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.166+0000 7f37829ce640 1 -- 172.21.15.7:0/2543365839 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f377c069040 con 0x7f377c0cbe10 2024-04-25T09:56:06.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.166+0000 7f3778ff9640 1 -- 172.21.15.7:0/2543365839 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f377401e020 con 0x7f377c0cbe10 2024-04-25T09:56:06.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.167+0000 7f3778ff9640 1 --2- 172.21.15.7:0/2543365839 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f376806b500 0x7f376806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:06.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.167+0000 7f3778ff9640 1 -- 172.21.15.7:0/2543365839 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5749+0+0 (secure 0 0 0) 0x7f377408a840 con 0x7f377c0cbe10 2024-04-25T09:56:06.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.167+0000 7f377bfff640 1 --2- 172.21.15.7:0/2543365839 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f376806b500 0x7f376806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:06.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.167+0000 7f377bfff640 1 --2- 172.21.15.7:0/2543365839 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f376806b500 0x7f376806d9c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3770033000 tx=0x7f3770008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:06.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.171+0000 7f3778ff9640 1 -- 172.21.15.7:0/2543365839 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3774059600 con 0x7f377c0cbe10 2024-04-25T09:56:06.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:06.349+0000 7f37829ce640 1 -- 172.21.15.7:0/2543365839 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f377c0cdc30 con 0x7f377c0cbe10 2024-04-25T09:56:07.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.027+0000 7f3778ff9640 1 -- 172.21.15.7:0/2543365839 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v42) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3774058f00 con 0x7f377c0cbe10 2024-04-25T09:56:07.030 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2024-04-25T09:56:07.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.031+0000 7f37829ce640 1 -- 172.21.15.7:0/2543365839 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f376806b500 msgr2=0x7f376806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:07.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.031+0000 7f37829ce640 1 --2- 172.21.15.7:0/2543365839 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f376806b500 0x7f376806d9c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3770033000 tx=0x7f3770008030 comp rx=0 tx=0).stop 2024-04-25T09:56:07.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.031+0000 7f37829ce640 1 -- 172.21.15.7:0/2543365839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f377c0cbe10 msgr2=0x7f377c0cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:07.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.031+0000 7f37829ce640 1 --2- 172.21.15.7:0/2543365839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f377c0cbe10 0x7f377c0cc290 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f377c0b6800 tx=0x7f3774009f90 comp rx=0 tx=0).stop 2024-04-25T09:56:07.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.031+0000 7f37829ce640 1 -- 172.21.15.7:0/2543365839 shutdown_connections 2024-04-25T09:56:07.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.031+0000 7f37829ce640 1 --2- 172.21.15.7:0/2543365839 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f376806b500 0x7f376806d9c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:07.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.031+0000 7f37829ce640 1 --2- 172.21.15.7:0/2543365839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f377c0cbe10 0x7f377c0cc290 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:07.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.031+0000 7f37829ce640 1 --2- 172.21.15.7:0/2543365839 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f377c152fc0 0x7f377c0c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:07.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.031+0000 7f37829ce640 1 --2- 172.21.15.7:0/2543365839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37640039b0 0x7f377c1557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:07.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.031+0000 7f37829ce640 1 -- 172.21.15.7:0/2543365839 >> 172.21.15.7:0/2543365839 conn(0x7f377c0726b0 msgr2=0x7f377c160360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:07.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.034+0000 7f37829ce640 1 -- 172.21.15.7:0/2543365839 shutdown_connections 2024-04-25T09:56:07.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.035+0000 7f37829ce640 1 -- 172.21.15.7:0/2543365839 wait complete. 2024-04-25T09:56:07.055 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:56:07.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.160+0000 7f76cb16a640 1 Processor -- start 2024-04-25T09:56:07.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.161+0000 7f76cb16a640 1 -- start start 2024-04-25T09:56:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.161+0000 7f76cb16a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f76c40cfc40 0x7f76c40d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.161+0000 7f76cb16a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f76c40cc580 0x7f76c40cca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.161+0000 7f76cb16a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c40b25e0 con 0x7f76c40b1480 2024-04-25T09:56:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.161+0000 7f76cb16a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76c415bec0 con 0x7f76c40cc580 2024-04-25T09:56:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.161+0000 7f76cb16a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c40d0560 con 0x7f76c40cfc40 2024-04-25T09:56:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.161+0000 7f76c9707640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f76c40cc580 0x7f76c40cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.161+0000 7f76c3fff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f76c40b1480 0x7f76c40b0ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39348/0 (socket says 172.21.15.7:39348) 2024-04-25T09:56:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.162+0000 7f76c3fff640 1 -- 172.21.15.7:0/2950237832 learned_addr learned my addr 172.21.15.7:0/2950237832 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:56:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.162+0000 7f76c8f06640 1 --2- 172.21.15.7:0/2950237832 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f76c40cfc40 0x7f76c40d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.162+0000 7f76c9707640 1 -- 172.21.15.7:0/2950237832 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f76c40cfc40 msgr2=0x7f76c40d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:07.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.162+0000 7f76c9707640 1 --2- 172.21.15.7:0/2950237832 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f76c40cfc40 0x7f76c40d0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:07.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.162+0000 7f76c9707640 1 -- 172.21.15.7:0/2950237832 >> v1:172.21.15.7:6789/0 conn(0x7f76c40b1480 legacy=0x7f76c40b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:07.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.162+0000 7f76c9707640 1 -- 172.21.15.7:0/2950237832 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c40b19d0 con 0x7f76c40cc580 2024-04-25T09:56:07.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.162+0000 7f76c37fe640 1 -- 172.21.15.7:0/2950237832 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1277538920 0 0) 0x7f76c40b25e0 con 0x7f76c40b1480 2024-04-25T09:56:07.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.163+0000 7f76c9707640 1 --2- 172.21.15.7:0/2950237832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76c40cc580 0x7f76c40cca10 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f76b40097a0 tx=0x7f76b402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=247e3892236fb8ef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:07.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.163+0000 7f76c37fe640 1 -- 172.21.15.7:0/2950237832 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b4037070 con 0x7f76c40cc580 2024-04-25T09:56:07.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.163+0000 7f76c37fe640 1 -- 172.21.15.7:0/2950237832 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b402ae50 con 0x7f76c40cc580 2024-04-25T09:56:07.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.163+0000 7f76c37fe640 1 -- 172.21.15.7:0/2950237832 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b4032660 con 0x7f76c40cc580 2024-04-25T09:56:07.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.163+0000 7f76cb16a640 1 -- 172.21.15.7:0/2950237832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76c40cc580 msgr2=0x7f76c40cca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:07.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.163+0000 7f76cb16a640 1 --2- 172.21.15.7:0/2950237832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76c40cc580 0x7f76c40cca10 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f76b40097a0 tx=0x7f76b402a100 comp rx=0 tx=0).stop 2024-04-25T09:56:07.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.163+0000 7f76cb16a640 1 -- 172.21.15.7:0/2950237832 shutdown_connections 2024-04-25T09:56:07.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.163+0000 7f76cb16a640 1 --2- 172.21.15.7:0/2950237832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76c40cc580 0x7f76c40cca10 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:07.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.163+0000 7f76cb16a640 1 --2- 172.21.15.7:0/2950237832 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f76c40cfc40 0x7f76c40d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:07.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.163+0000 7f76cb16a640 1 -- 172.21.15.7:0/2950237832 >> 172.21.15.7:0/2950237832 conn(0x7f76c408af80 msgr2=0x7f76c408b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:07.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.163+0000 7f76cb16a640 1 -- 172.21.15.7:0/2950237832 shutdown_connections 2024-04-25T09:56:07.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.163+0000 7f76cb16a640 1 -- 172.21.15.7:0/2950237832 wait complete. 2024-04-25T09:56:07.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.164+0000 7f76cb16a640 1 Processor -- start 2024-04-25T09:56:07.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.165+0000 7f76cb16a640 1 -- start start 2024-04-25T09:56:07.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.165+0000 7f76cb16a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76c40b1480 0x7f76c414fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:07.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.165+0000 7f76cb16a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f76c40cc580 0x7f76c40c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:07.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.165+0000 7f76cb16a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76c40cfc40 0x7f76c40ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:07.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.165+0000 7f76cb16a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c40b2270 con 0x7f76c40cfc40 2024-04-25T09:56:07.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.165+0000 7f76cb16a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c40b1f90 con 0x7f76c40b1480 2024-04-25T09:56:07.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.165+0000 7f76cb16a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c40ccf50 con 0x7f76c40cc580 2024-04-25T09:56:07.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.166+0000 7f76c9707640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76c40cfc40 0x7f76c40ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:07.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.166+0000 7f76c9707640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76c40cfc40 0x7f76c40ae2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35360/0 (socket says 172.21.15.7:35360) 2024-04-25T09:56:07.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.166+0000 7f76c9707640 1 -- 172.21.15.7:0/619930789 learned_addr learned my addr 172.21.15.7:0/619930789 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:07.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.166+0000 7f76c8f06640 1 --2- 172.21.15.7:0/619930789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76c40b1480 0x7f76c414fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:07.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.166+0000 7f76c3fff640 1 --2- 172.21.15.7:0/619930789 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f76c40cc580 0x7f76c40c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:07.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.166+0000 7f76c9707640 1 -- 172.21.15.7:0/619930789 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f76c40cc580 msgr2=0x7f76c40c5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:07.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.166+0000 7f76c9707640 1 --2- 172.21.15.7:0/619930789 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f76c40cc580 0x7f76c40c5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:07.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.166+0000 7f76c9707640 1 -- 172.21.15.7:0/619930789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76c40b1480 msgr2=0x7f76c414fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:07.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.166+0000 7f76c9707640 1 --2- 172.21.15.7:0/619930789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76c40b1480 0x7f76c414fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:07.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.166+0000 7f76c9707640 1 -- 172.21.15.7:0/619930789 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c40b54f0 con 0x7f76c40cfc40 2024-04-25T09:56:07.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.166+0000 7f76c3fff640 1 --2- 172.21.15.7:0/619930789 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f76c40cc580 0x7f76c40c5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:07.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.166+0000 7f76c8f06640 1 --2- 172.21.15.7:0/619930789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76c40b1480 0x7f76c414fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:07.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.166+0000 7f76c9707640 1 --2- 172.21.15.7:0/619930789 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76c40cfc40 0x7f76c40ae2b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f76b4035040 tx=0x7f76b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:07.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.166+0000 7f76c17fa640 1 -- 172.21.15.7:0/619930789 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b4041070 con 0x7f76c40cfc40 2024-04-25T09:56:07.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.166+0000 7f76c17fa640 1 -- 172.21.15.7:0/619930789 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b4032e10 con 0x7f76c40cfc40 2024-04-25T09:56:07.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.166+0000 7f76cb16a640 1 -- 172.21.15.7:0/619930789 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c40b57d0 con 0x7f76c40cfc40 2024-04-25T09:56:07.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.166+0000 7f76c17fa640 1 -- 172.21.15.7:0/619930789 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b4037040 con 0x7f76c40cfc40 2024-04-25T09:56:07.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.166+0000 7f76cb16a640 1 -- 172.21.15.7:0/619930789 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c414ff90 con 0x7f76c40cfc40 2024-04-25T09:56:07.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.167+0000 7f76cb16a640 1 -- 172.21.15.7:0/619930789 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c415b6a0 con 0x7f76c40cfc40 2024-04-25T09:56:07.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.168+0000 7f76c17fa640 1 -- 172.21.15.7:0/619930789 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f76b4044070 con 0x7f76c40cfc40 2024-04-25T09:56:07.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.168+0000 7f76c17fa640 1 --2- 172.21.15.7:0/619930789 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f76b006b4d0 0x7f76b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:07.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.168+0000 7f76c17fa640 1 -- 172.21.15.7:0/619930789 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f76b40aa5f0 con 0x7f76c40cfc40 2024-04-25T09:56:07.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.168+0000 7f76c8f06640 1 --2- 172.21.15.7:0/619930789 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f76b006b4d0 0x7f76b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:07.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.169+0000 7f76c8f06640 1 --2- 172.21.15.7:0/619930789 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f76b006b4d0 0x7f76b006d990 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f76bc009a80 tx=0x7f76bc0039d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:07.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.172+0000 7f76c17fa640 1 -- 172.21.15.7:0/619930789 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f76b4079540 con 0x7f76c40cfc40 2024-04-25T09:56:07.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.356+0000 7f76cb16a640 1 -- 172.21.15.7:0/619930789 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f76c4068f60 con 0x7f76c40cfc40 2024-04-25T09:56:07.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.359+0000 7f76c17fa640 1 -- 172.21.15.7:0/619930789 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f76b4078e40 con 0x7f76c40cfc40 2024-04-25T09:56:07.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.361+0000 7f76cb16a640 1 -- 172.21.15.7:0/619930789 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f76b006b4d0 msgr2=0x7f76b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:07.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.361+0000 7f76cb16a640 1 --2- 172.21.15.7:0/619930789 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f76b006b4d0 0x7f76b006d990 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f76bc009a80 tx=0x7f76bc0039d0 comp rx=0 tx=0).stop 2024-04-25T09:56:07.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.361+0000 7f76cb16a640 1 -- 172.21.15.7:0/619930789 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76c40cfc40 msgr2=0x7f76c40ae2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:07.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.361+0000 7f76cb16a640 1 --2- 172.21.15.7:0/619930789 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76c40cfc40 0x7f76c40ae2b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f76b4035040 tx=0x7f76b40046c0 comp rx=0 tx=0).stop 2024-04-25T09:56:07.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.361+0000 7f76cb16a640 1 -- 172.21.15.7:0/619930789 shutdown_connections 2024-04-25T09:56:07.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.361+0000 7f76cb16a640 1 --2- 172.21.15.7:0/619930789 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f76b006b4d0 0x7f76b006d990 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:07.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.361+0000 7f76cb16a640 1 --2- 172.21.15.7:0/619930789 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76c40cfc40 0x7f76c40ae2b0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:07.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.361+0000 7f76cb16a640 1 --2- 172.21.15.7:0/619930789 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f76c40cc580 0x7f76c40c5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:07.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.361+0000 7f76cb16a640 1 --2- 172.21.15.7:0/619930789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76c40b1480 0x7f76c414fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:07.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.361+0000 7f76cb16a640 1 -- 172.21.15.7:0/619930789 >> 172.21.15.7:0/619930789 conn(0x7f76c408af80 msgr2=0x7f76c40d1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:07.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.361+0000 7f76cb16a640 1 -- 172.21.15.7:0/619930789 shutdown_connections 2024-04-25T09:56:07.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.361+0000 7f76cb16a640 1 -- 172.21.15.7:0/619930789 wait complete. 2024-04-25T09:56:07.377 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2024-04-25T09:56:07.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.475+0000 7f4e1b02a640 1 Processor -- start 2024-04-25T09:56:07.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.475+0000 7f4e1b02a640 1 -- start start 2024-04-25T09:56:07.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.475+0000 7f4e1b02a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4e1415da60 0x7f4e140d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:07.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.476+0000 7f4e1b02a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e1415e2d0 0x7f4e140ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:07.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.476+0000 7f4e1b02a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e1415e8a0 con 0x7f4e1415de40 2024-04-25T09:56:07.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.476+0000 7f4e1b02a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e1415eb80 con 0x7f4e1415da60 2024-04-25T09:56:07.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.476+0000 7f4e1b02a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1415ee60 con 0x7f4e1415e2d0 2024-04-25T09:56:07.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.476+0000 7f4e195c7640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e1415e2d0 0x7f4e140ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:07.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.476+0000 7f4e18dc6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4e1415da60 0x7f4e140d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:07.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.476+0000 7f4e13fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4e1415de40 0x7f4e14161d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:59728/0 (socket says 172.21.15.7:59728) 2024-04-25T09:56:07.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.476+0000 7f4e13fff640 1 -- 172.21.15.7:0/956549061 learned_addr learned my addr 172.21.15.7:0/956549061 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:56:07.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.476+0000 7f4e195c7640 1 -- 172.21.15.7:0/956549061 >> v2:172.21.15.55:3300/0 conn(0x7f4e1415da60 msgr2=0x7f4e140d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:07.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.476+0000 7f4e195c7640 1 --2- 172.21.15.7:0/956549061 >> v2:172.21.15.55:3300/0 conn(0x7f4e1415da60 0x7f4e140d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:07.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.476+0000 7f4e195c7640 1 -- 172.21.15.7:0/956549061 >> v1:172.21.15.55:6789/0 conn(0x7f4e1415de40 legacy=0x7f4e14161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:07.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.476+0000 7f4e195c7640 1 -- 172.21.15.7:0/956549061 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e14161850 con 0x7f4e1415e2d0 2024-04-25T09:56:07.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.476+0000 7f4e18dc6640 1 --2- 172.21.15.7:0/956549061 >> v2:172.21.15.55:3300/0 conn(0x7f4e1415da60 0x7f4e140d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:56:07.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.477+0000 7f4e195c7640 1 --2- 172.21.15.7:0/956549061 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e1415e2d0 0x7f4e140ce520 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c009d90 tx=0x7f4e0c02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc1a82d3709ed9c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:07.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.477+0000 7f4e137fe640 1 -- 172.21.15.7:0/956549061 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c031600 con 0x7f4e1415e2d0 2024-04-25T09:56:07.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.477+0000 7f4e137fe640 1 -- 172.21.15.7:0/956549061 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0c0317a0 con 0x7f4e1415e2d0 2024-04-25T09:56:07.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.477+0000 7f4e137fe640 1 -- 172.21.15.7:0/956549061 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c031b70 con 0x7f4e1415e2d0 2024-04-25T09:56:07.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.478+0000 7f4e1b02a640 1 -- 172.21.15.7:0/956549061 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e1415e2d0 msgr2=0x7f4e140ce520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:07.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.478+0000 7f4e1b02a640 1 --2- 172.21.15.7:0/956549061 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e1415e2d0 0x7f4e140ce520 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c009d90 tx=0x7f4e0c02a5d0 comp rx=0 tx=0).stop 2024-04-25T09:56:07.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.478+0000 7f4e1b02a640 1 -- 172.21.15.7:0/956549061 shutdown_connections 2024-04-25T09:56:07.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.478+0000 7f4e1b02a640 1 --2- 172.21.15.7:0/956549061 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e1415e2d0 0x7f4e140ce520 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:07.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.478+0000 7f4e1b02a640 1 --2- 172.21.15.7:0/956549061 >> v2:172.21.15.55:3300/0 conn(0x7f4e1415da60 0x7f4e140d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:07.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.478+0000 7f4e1b02a640 1 -- 172.21.15.7:0/956549061 >> 172.21.15.7:0/956549061 conn(0x7f4e1406bfe0 msgr2=0x7f4e1406c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:07.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.478+0000 7f4e1b02a640 1 -- 172.21.15.7:0/956549061 shutdown_connections 2024-04-25T09:56:07.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.478+0000 7f4e1b02a640 1 -- 172.21.15.7:0/956549061 wait complete. 2024-04-25T09:56:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.479+0000 7f4e1b02a640 1 Processor -- start 2024-04-25T09:56:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.479+0000 7f4e1b02a640 1 -- start start 2024-04-25T09:56:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.480+0000 7f4e1b02a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e1415da60 0x7f4e14159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.480+0000 7f4e1b02a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e1415de40 0x7f4e140aa220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.480+0000 7f4e1b02a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e1415e2d0 0x7f4e141f3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.480+0000 7f4e1b02a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e140cebe0 con 0x7f4e1415de40 2024-04-25T09:56:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.480+0000 7f4e1b02a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e140cea60 con 0x7f4e1415e2d0 2024-04-25T09:56:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.480+0000 7f4e1b02a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e140ced60 con 0x7f4e1415da60 2024-04-25T09:56:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.480+0000 7f4e13fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e1415de40 0x7f4e140aa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:07.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.480+0000 7f4e13fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e1415de40 0x7f4e140aa220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35362/0 (socket says 172.21.15.7:35362) 2024-04-25T09:56:07.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.480+0000 7f4e13fff640 1 -- 172.21.15.7:0/1356809363 learned_addr learned my addr 172.21.15.7:0/1356809363 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:07.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.480+0000 7f4e195c7640 1 --2- 172.21.15.7:0/1356809363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e1415e2d0 0x7f4e141f3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:07.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.480+0000 7f4e18dc6640 1 --2- 172.21.15.7:0/1356809363 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e1415da60 0x7f4e14159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:07.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.480+0000 7f4e13fff640 1 -- 172.21.15.7:0/1356809363 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e1415da60 msgr2=0x7f4e14159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:07.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.480+0000 7f4e13fff640 1 --2- 172.21.15.7:0/1356809363 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e1415da60 0x7f4e14159a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:07.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.481+0000 7f4e13fff640 1 -- 172.21.15.7:0/1356809363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e1415e2d0 msgr2=0x7f4e141f3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:07.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.481+0000 7f4e13fff640 1 --2- 172.21.15.7:0/1356809363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e1415e2d0 0x7f4e141f3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:07.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.481+0000 7f4e13fff640 1 -- 172.21.15.7:0/1356809363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e140aa760 con 0x7f4e1415de40 2024-04-25T09:56:07.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.481+0000 7f4e13fff640 1 --2- 172.21.15.7:0/1356809363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e1415de40 0x7f4e140aa220 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc00c3f0 tx=0x7f4dfc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:07.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.481+0000 7f4e117fa640 1 -- 172.21.15.7:0/1356809363 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc017070 con 0x7f4e1415de40 2024-04-25T09:56:07.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.481+0000 7f4e117fa640 1 -- 172.21.15.7:0/1356809363 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dfc005ce0 con 0x7f4e1415de40 2024-04-25T09:56:07.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.481+0000 7f4e1b02a640 1 -- 172.21.15.7:0/1356809363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e140b42c0 con 0x7f4e1415de40 2024-04-25T09:56:07.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.481+0000 7f4e117fa640 1 -- 172.21.15.7:0/1356809363 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc0072f0 con 0x7f4e1415de40 2024-04-25T09:56:07.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.481+0000 7f4e1b02a640 1 -- 172.21.15.7:0/1356809363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e140b4880 con 0x7f4e1415de40 2024-04-25T09:56:07.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.482+0000 7f4e1b02a640 1 -- 172.21.15.7:0/1356809363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e14068fd0 con 0x7f4e1415de40 2024-04-25T09:56:07.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.483+0000 7f4e117fa640 1 -- 172.21.15.7:0/1356809363 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4dfc01a070 con 0x7f4e1415de40 2024-04-25T09:56:07.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.483+0000 7f4e117fa640 1 --2- 172.21.15.7:0/1356809363 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4df406b4d0 0x7f4df406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:07.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.483+0000 7f4e117fa640 1 -- 172.21.15.7:0/1356809363 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f4dfc0892f0 con 0x7f4e1415de40 2024-04-25T09:56:07.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.483+0000 7f4e18dc6640 1 --2- 172.21.15.7:0/1356809363 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4df406b4d0 0x7f4df406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:07.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.484+0000 7f4e18dc6640 1 --2- 172.21.15.7:0/1356809363 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4df406b4d0 0x7f4df406d990 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4e140b5ab0 tx=0x7f4e04009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:07.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.487+0000 7f4e117fa640 1 -- 172.21.15.7:0/1356809363 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4dfc057d20 con 0x7f4e1415de40 2024-04-25T09:56:07.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:07.738+0000 7f4e1b02a640 1 -- 172.21.15.7:0/1356809363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) v1 -- 0x7f4e140d1560 con 0x7f4e1415de40 2024-04-25T09:56:08.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.036+0000 7f4e117fa640 1 -- 172.21.15.7:0/1356809363 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v117) v1 ==== 142+0+0 (secure 0 0 0) 0x7f4dfc05bdc0 con 0x7f4e1415de40 2024-04-25T09:56:08.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.038+0000 7f4e1b02a640 1 -- 172.21.15.7:0/1356809363 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4df406b4d0 msgr2=0x7f4df406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:08.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.038+0000 7f4e1b02a640 1 --2- 172.21.15.7:0/1356809363 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4df406b4d0 0x7f4df406d990 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4e140b5ab0 tx=0x7f4e04009190 comp rx=0 tx=0).stop 2024-04-25T09:56:08.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.038+0000 7f4e1b02a640 1 -- 172.21.15.7:0/1356809363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e1415de40 msgr2=0x7f4e140aa220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:08.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.038+0000 7f4e1b02a640 1 --2- 172.21.15.7:0/1356809363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e1415de40 0x7f4e140aa220 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc00c3f0 tx=0x7f4dfc00c8b0 comp rx=0 tx=0).stop 2024-04-25T09:56:08.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.038+0000 7f4e1b02a640 1 -- 172.21.15.7:0/1356809363 shutdown_connections 2024-04-25T09:56:08.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.038+0000 7f4e1b02a640 1 --2- 172.21.15.7:0/1356809363 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4df406b4d0 0x7f4df406d990 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:08.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.038+0000 7f4e1b02a640 1 --2- 172.21.15.7:0/1356809363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e1415e2d0 0x7f4e141f3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:08.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.038+0000 7f4e1b02a640 1 --2- 172.21.15.7:0/1356809363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e1415de40 0x7f4e140aa220 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:08.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.038+0000 7f4e1b02a640 1 --2- 172.21.15.7:0/1356809363 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e1415da60 0x7f4e14159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:08.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.038+0000 7f4e1b02a640 1 -- 172.21.15.7:0/1356809363 >> 172.21.15.7:0/1356809363 conn(0x7f4e1406bfe0 msgr2=0x7f4e141603f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:08.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.039+0000 7f4e1b02a640 1 -- 172.21.15.7:0/1356809363 shutdown_connections 2024-04-25T09:56:08.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.039+0000 7f4e1b02a640 1 -- 172.21.15.7:0/1356809363 wait complete. 2024-04-25T09:56:08.053 INFO:tasks.cephfs_test_runner:test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-04-25T09:56:08.053 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) That the MDS can repair an inodes backtrace in the data pool 2024-04-25T09:56:08.053 INFO:tasks.cephfs_test_runner:test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T09:56:08.054 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:56:08.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.154+0000 7f1f0866b640 1 Processor -- start 2024-04-25T09:56:08.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.154+0000 7f1f0866b640 1 -- start start 2024-04-25T09:56:08.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.155+0000 7f1f0866b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1f00141150 0x7f1f0006df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:08.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.155+0000 7f1f0866b640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f000c4ab0 con 0x7f1f00141ac0 2024-04-25T09:56:08.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.155+0000 7f1f0866b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f0006d150 con 0x7f1f000b1dd0 2024-04-25T09:56:08.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.155+0000 7f1f0866b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f000cbc30 con 0x7f1f00141150 2024-04-25T09:56:08.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.155+0000 7f1f05c06640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1f00141ac0 0x7f1f00140a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39354/0 (socket says 172.21.15.7:39354) 2024-04-25T09:56:08.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.155+0000 7f1f05c06640 1 -- 172.21.15.7:0/2303305843 learned_addr learned my addr 172.21.15.7:0/2303305843 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:56:08.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.155+0000 7f1f06c08640 1 --2- 172.21.15.7:0/2303305843 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1f00141150 0x7f1f0006df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:08.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.155+0000 7f1f05405640 1 -- 172.21.15.7:0/2303305843 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2958503000 0 0) 0x7f1f000c4ab0 con 0x7f1f00141ac0 2024-04-25T09:56:08.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.155+0000 7f1f05405640 1 -- 172.21.15.7:0/2303305843 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1eec003520 con 0x7f1f00141ac0 2024-04-25T09:56:08.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.155+0000 7f1f05405640 1 -- 172.21.15.7:0/2303305843 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 737439357 0 0) 0x7f1eec003520 con 0x7f1f00141ac0 2024-04-25T09:56:08.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.155+0000 7f1f05405640 1 -- 172.21.15.7:0/2303305843 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1f00141150 msgr2=0x7f1f0006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:08.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.155+0000 7f1f05405640 1 --2- 172.21.15.7:0/2303305843 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1f00141150 0x7f1f0006df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:08.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.155+0000 7f1f05405640 1 -- 172.21.15.7:0/2303305843 >> v1:172.21.15.55:6789/0 conn(0x7f1f000b1dd0 legacy=0x7f1f0015ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:08.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.155+0000 7f1f05405640 1 -- 172.21.15.7:0/2303305843 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f0006d430 con 0x7f1f00141ac0 2024-04-25T09:56:08.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.155+0000 7f1f05405640 1 -- 172.21.15.7:0/2303305843 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f1ef0001690 con 0x7f1f00141ac0 2024-04-25T09:56:08.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.155+0000 7f1f05405640 1 -- 172.21.15.7:0/2303305843 >> v1:172.21.15.7:6789/0 conn(0x7f1f00141ac0 legacy=0x7f1f00140a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:08.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.155+0000 7f1f05405640 1 --2- 172.21.15.7:0/2303305843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1eec0039e0 0x7f1eec003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:08.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.155+0000 7f1f05405640 1 --2- 172.21.15.7:0/2303305843 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1f00141150 0x7f1eec004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:08.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.155+0000 7f1f05405640 1 --2- 172.21.15.7:0/2303305843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1eec004d40 0x7f1eec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:08.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.155+0000 7f1f05405640 1 -- 172.21.15.7:0/2303305843 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec00ba70 con 0x7f1eec004d40 2024-04-25T09:56:08.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.155+0000 7f1f05405640 1 -- 172.21.15.7:0/2303305843 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec00bc20 con 0x7f1eec0039e0 2024-04-25T09:56:08.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.155+0000 7f1f05405640 1 -- 172.21.15.7:0/2303305843 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec00be20 con 0x7f1f00141150 2024-04-25T09:56:08.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.156+0000 7f1f06c08640 1 --2- 172.21.15.7:0/2303305843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1eec004d40 0x7f1eec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:08.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.156+0000 7f1f06407640 1 --2- 172.21.15.7:0/2303305843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1eec0039e0 0x7f1eec003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:08.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.156+0000 7f1f05c06640 1 --2- 172.21.15.7:0/2303305843 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1f00141150 0x7f1eec004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:08.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.156+0000 7f1f06c08640 1 -- 172.21.15.7:0/2303305843 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1f00141150 msgr2=0x7f1eec004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:08.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.156+0000 7f1f06c08640 1 --2- 172.21.15.7:0/2303305843 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1f00141150 0x7f1eec004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:08.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.156+0000 7f1f06c08640 1 -- 172.21.15.7:0/2303305843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1eec0039e0 msgr2=0x7f1eec003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:08.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.156+0000 7f1f06c08640 1 --2- 172.21.15.7:0/2303305843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1eec0039e0 0x7f1eec003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:08.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.156+0000 7f1f06c08640 1 -- 172.21.15.7:0/2303305843 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eec003520 con 0x7f1eec004d40 2024-04-25T09:56:08.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.157+0000 7f1f06c08640 1 --2- 172.21.15.7:0/2303305843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1eec004d40 0x7f1eec0051c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1f000b27a0 tx=0x7f1eec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c39a182464fecd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:08.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.157+0000 7f1f05405640 1 -- 172.21.15.7:0/2303305843 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef800adf0 con 0x7f1eec004d40 2024-04-25T09:56:08.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.157+0000 7f1f05405640 1 -- 172.21.15.7:0/2303305843 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef8033630 con 0x7f1eec004d40 2024-04-25T09:56:08.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.157+0000 7f1f05405640 1 -- 172.21.15.7:0/2303305843 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef8033a00 con 0x7f1eec004d40 2024-04-25T09:56:08.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.157+0000 7f1f0866b640 1 -- 172.21.15.7:0/2303305843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1eec004d40 msgr2=0x7f1eec0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:08.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.157+0000 7f1f0866b640 1 --2- 172.21.15.7:0/2303305843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1eec004d40 0x7f1eec0051c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1f000b27a0 tx=0x7f1eec005830 comp rx=0 tx=0).stop 2024-04-25T09:56:08.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.157+0000 7f1f06c08640 1 -- 172.21.15.7:0/2303305843 reap_dead start 2024-04-25T09:56:08.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.157+0000 7f1f0866b640 1 -- 172.21.15.7:0/2303305843 shutdown_connections 2024-04-25T09:56:08.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.157+0000 7f1f0866b640 1 -- 172.21.15.7:0/2303305843 >> 172.21.15.7:0/2303305843 conn(0x7f1f00071150 msgr2=0x7f1f00071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:08.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.157+0000 7f1f0866b640 1 -- 172.21.15.7:0/2303305843 shutdown_connections 2024-04-25T09:56:08.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.157+0000 7f1f0866b640 1 -- 172.21.15.7:0/2303305843 wait complete. 2024-04-25T09:56:08.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.158+0000 7f1f0866b640 1 Processor -- start 2024-04-25T09:56:08.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.159+0000 7f1f0866b640 1 -- start start 2024-04-25T09:56:08.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.159+0000 7f1f0866b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1eec004d40 0x7f1f001567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:08.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.159+0000 7f1f0866b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f00156d10 0x7f1f000ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:08.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.159+0000 7f1f0866b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f000caa20 0x7f1f000b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:08.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.159+0000 7f1f0866b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0006d9f0 con 0x7f1f00156d10 2024-04-25T09:56:08.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.159+0000 7f1f0866b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f000b21b0 con 0x7f1f000caa20 2024-04-25T09:56:08.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.159+0000 7f1f0866b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f00141f50 con 0x7f1eec004d40 2024-04-25T09:56:08.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.159+0000 7f1f05c06640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f00156d10 0x7f1f000ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:08.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.159+0000 7f1f05c06640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f00156d10 0x7f1f000ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35376/0 (socket says 172.21.15.7:35376) 2024-04-25T09:56:08.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.159+0000 7f1f05c06640 1 -- 172.21.15.7:0/927017671 learned_addr learned my addr 172.21.15.7:0/927017671 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:08.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.160+0000 7f1f06407640 1 --2- 172.21.15.7:0/927017671 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1eec004d40 0x7f1f001567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:08.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.160+0000 7f1f06c08640 1 --2- 172.21.15.7:0/927017671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f000caa20 0x7f1f000b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:08.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.160+0000 7f1f05c06640 1 -- 172.21.15.7:0/927017671 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1eec004d40 msgr2=0x7f1f001567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:08.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.160+0000 7f1f05c06640 1 --2- 172.21.15.7:0/927017671 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1eec004d40 0x7f1f001567d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:08.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.160+0000 7f1f05c06640 1 -- 172.21.15.7:0/927017671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f000caa20 msgr2=0x7f1f000b3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:08.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.160+0000 7f1f05c06640 1 --2- 172.21.15.7:0/927017671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f000caa20 0x7f1f000b3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:08.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.160+0000 7f1f05c06640 1 -- 172.21.15.7:0/927017671 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f001f7e50 con 0x7f1f00156d10 2024-04-25T09:56:08.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.160+0000 7f1f06c08640 1 --2- 172.21.15.7:0/927017671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f000caa20 0x7f1f000b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:08.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.160+0000 7f1f06407640 1 --2- 172.21.15.7:0/927017671 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1eec004d40 0x7f1f001567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:08.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.160+0000 7f1f05c06640 1 --2- 172.21.15.7:0/927017671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f00156d10 0x7f1f000ca4e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0007310 tx=0x7f1ef00077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:08.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.160+0000 7f1ef6ffd640 1 -- 172.21.15.7:0/927017671 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef000f9c0 con 0x7f1f00156d10 2024-04-25T09:56:08.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.160+0000 7f1ef6ffd640 1 -- 172.21.15.7:0/927017671 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef0018070 con 0x7f1f00156d10 2024-04-25T09:56:08.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.160+0000 7f1f0866b640 1 -- 172.21.15.7:0/927017671 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f001f7090 con 0x7f1f00156d10 2024-04-25T09:56:08.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.160+0000 7f1ef6ffd640 1 -- 172.21.15.7:0/927017671 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef000fd80 con 0x7f1f00156d10 2024-04-25T09:56:08.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.160+0000 7f1f0866b640 1 -- 172.21.15.7:0/927017671 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f001f7650 con 0x7f1f00156d10 2024-04-25T09:56:08.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.161+0000 7f1f0866b640 1 -- 172.21.15.7:0/927017671 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f00068fd0 con 0x7f1f00156d10 2024-04-25T09:56:08.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.162+0000 7f1ef6ffd640 1 -- 172.21.15.7:0/927017671 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1ef001d460 con 0x7f1f00156d10 2024-04-25T09:56:08.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.162+0000 7f1ef6ffd640 1 --2- 172.21.15.7:0/927017671 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1ee406b500 0x7f1ee406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:08.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.162+0000 7f1f06407640 1 --2- 172.21.15.7:0/927017671 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1ee406b500 0x7f1ee406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:08.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.162+0000 7f1ef6ffd640 1 -- 172.21.15.7:0/927017671 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f1ef008a090 con 0x7f1f00156d10 2024-04-25T09:56:08.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.163+0000 7f1f06407640 1 --2- 172.21.15.7:0/927017671 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1ee406b500 0x7f1ee406d9c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1efc0036b0 tx=0x7f1efc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:08.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.167+0000 7f1ef6ffd640 1 -- 172.21.15.7:0/927017671 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1ef0059110 con 0x7f1f00156d10 2024-04-25T09:56:08.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.347+0000 7f1f0866b640 1 -- 172.21.15.7:0/927017671 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f000cb9a0 con 0x7f1f00156d10 2024-04-25T09:56:08.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.348+0000 7f1ef6ffd640 1 -- 172.21.15.7:0/927017671 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+13195 (secure 0 0 0) 0x7f1ef0058a10 con 0x7f1f00156d10 2024-04-25T09:56:08.351 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:08.351 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":42,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:56:07.026521+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6835/223801838":"2024-04-26T09:56:03.888962+0000","172.21.15.55:6833/223801838":"2024-04-26T09:56:03.888962+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:56:08.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.350+0000 7f1f0866b640 1 -- 172.21.15.7:0/927017671 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1ee406b500 msgr2=0x7f1ee406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:08.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.350+0000 7f1f0866b640 1 --2- 172.21.15.7:0/927017671 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1ee406b500 0x7f1ee406d9c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1efc0036b0 tx=0x7f1efc009040 comp rx=0 tx=0).stop 2024-04-25T09:56:08.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.350+0000 7f1f0866b640 1 -- 172.21.15.7:0/927017671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f00156d10 msgr2=0x7f1f000ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:08.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.350+0000 7f1f0866b640 1 --2- 172.21.15.7:0/927017671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f00156d10 0x7f1f000ca4e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0007310 tx=0x7f1ef00077d0 comp rx=0 tx=0).stop 2024-04-25T09:56:08.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.350+0000 7f1f0866b640 1 -- 172.21.15.7:0/927017671 shutdown_connections 2024-04-25T09:56:08.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.350+0000 7f1f0866b640 1 --2- 172.21.15.7:0/927017671 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1ee406b500 0x7f1ee406d9c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:08.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.350+0000 7f1f0866b640 1 --2- 172.21.15.7:0/927017671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f000caa20 0x7f1f000b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:08.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.350+0000 7f1f0866b640 1 --2- 172.21.15.7:0/927017671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f00156d10 0x7f1f000ca4e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:08.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.350+0000 7f1f0866b640 1 --2- 172.21.15.7:0/927017671 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1eec004d40 0x7f1f001567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:08.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.350+0000 7f1f0866b640 1 -- 172.21.15.7:0/927017671 >> 172.21.15.7:0/927017671 conn(0x7f1f00071150 msgr2=0x7f1f000cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:08.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.350+0000 7f1f0866b640 1 -- 172.21.15.7:0/927017671 shutdown_connections 2024-04-25T09:56:08.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.350+0000 7f1f0866b640 1 -- 172.21.15.7:0/927017671 wait complete. 2024-04-25T09:56:08.364 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:56:08.364 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:56:08.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.464+0000 7f97f852b640 1 Processor -- start 2024-04-25T09:56:08.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.464+0000 7f97f852b640 1 -- start start 2024-04-25T09:56:08.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.465+0000 7f97f852b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f97f00d2c40 0x7f97f00b9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:08.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.465+0000 7f97f852b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f97f00b68b0 0x7f97f00b6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:08.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.465+0000 7f97f852b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f00b7ef0 con 0x7f97f00d0780 2024-04-25T09:56:08.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.465+0000 7f97f852b640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f00b81d0 con 0x7f97f00d2c40 2024-04-25T09:56:08.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.465+0000 7f97f852b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f00b84b0 con 0x7f97f00b68b0 2024-04-25T09:56:08.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.465+0000 7f97f5ac6640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f97f00d2c40 0x7f97f00b9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:08.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.465+0000 7f97f5ac6640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f97f00d2c40 0x7f97f00b9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35388/0 (socket says 172.21.15.7:35388) 2024-04-25T09:56:08.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.465+0000 7f97f5ac6640 1 -- 172.21.15.7:0/1546333122 learned_addr learned my addr 172.21.15.7:0/1546333122 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:08.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.465+0000 7f97f6ac8640 1 --2- 172.21.15.7:0/1546333122 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f97f00b68b0 0x7f97f00b6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:08.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.465+0000 7f97f5ac6640 1 -- 172.21.15.7:0/1546333122 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f97f00b68b0 msgr2=0x7f97f00b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:08.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.465+0000 7f97f5ac6640 1 --2- 172.21.15.7:0/1546333122 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f97f00b68b0 0x7f97f00b6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:08.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.465+0000 7f97f5ac6640 1 -- 172.21.15.7:0/1546333122 >> v1:172.21.15.55:6789/0 conn(0x7f97f00d0780 legacy=0x7f97f00d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:08.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.465+0000 7f97f5ac6640 1 -- 172.21.15.7:0/1546333122 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f00b8790 con 0x7f97f00d2c40 2024-04-25T09:56:08.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.466+0000 7f97f5ac6640 1 --2- 172.21.15.7:0/1546333122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97f00d2c40 0x7f97f00b9130 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f97e0009870 tx=0x7f97e002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8520f9a25b70a5c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:08.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.466+0000 7f97f52c5640 1 -- 172.21.15.7:0/1546333122 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e0037070 con 0x7f97f00d2c40 2024-04-25T09:56:08.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.466+0000 7f97f52c5640 1 -- 172.21.15.7:0/1546333122 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e0032440 con 0x7f97f00d2c40 2024-04-25T09:56:08.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.466+0000 7f97f52c5640 1 -- 172.21.15.7:0/1546333122 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e0032810 con 0x7f97f00d2c40 2024-04-25T09:56:08.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.466+0000 7f97f852b640 1 -- 172.21.15.7:0/1546333122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97f00d2c40 msgr2=0x7f97f00b9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:08.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.466+0000 7f97f852b640 1 --2- 172.21.15.7:0/1546333122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97f00d2c40 0x7f97f00b9130 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f97e0009870 tx=0x7f97e002a210 comp rx=0 tx=0).stop 2024-04-25T09:56:08.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.467+0000 7f97f852b640 1 -- 172.21.15.7:0/1546333122 shutdown_connections 2024-04-25T09:56:08.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.467+0000 7f97f852b640 1 --2- 172.21.15.7:0/1546333122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97f00d2c40 0x7f97f00b9130 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:08.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.467+0000 7f97f852b640 1 --2- 172.21.15.7:0/1546333122 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f97f00b68b0 0x7f97f00b6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:08.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.467+0000 7f97f852b640 1 -- 172.21.15.7:0/1546333122 >> 172.21.15.7:0/1546333122 conn(0x7f97f00726b0 msgr2=0x7f97f0072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:08.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.467+0000 7f97f852b640 1 -- 172.21.15.7:0/1546333122 shutdown_connections 2024-04-25T09:56:08.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.467+0000 7f97f852b640 1 -- 172.21.15.7:0/1546333122 wait complete. 2024-04-25T09:56:08.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.468+0000 7f97f852b640 1 Processor -- start 2024-04-25T09:56:08.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.468+0000 7f97f852b640 1 -- start start 2024-04-25T09:56:08.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.469+0000 7f97f852b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97f00b68b0 0x7f97f00cab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:08.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.469+0000 7f97f852b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f97f00d0780 0x7f97f00cd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:08.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.469+0000 7f97f852b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97f00d2c40 0x7f97f01f6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:08.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.469+0000 7f97f852b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f00b97f0 con 0x7f97f00d2c40 2024-04-25T09:56:08.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.469+0000 7f97f852b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f00b9670 con 0x7f97f00b68b0 2024-04-25T09:56:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.469+0000 7f97f852b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f01611b0 con 0x7f97f00d0780 2024-04-25T09:56:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.469+0000 7f97f6ac8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97f00d2c40 0x7f97f01f6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.469+0000 7f97f6ac8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97f00d2c40 0x7f97f01f6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35398/0 (socket says 172.21.15.7:35398) 2024-04-25T09:56:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.469+0000 7f97f6ac8640 1 -- 172.21.15.7:0/2917251273 learned_addr learned my addr 172.21.15.7:0/2917251273 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.469+0000 7f97f62c7640 1 --2- 172.21.15.7:0/2917251273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97f00b68b0 0x7f97f00cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.469+0000 7f97f5ac6640 1 --2- 172.21.15.7:0/2917251273 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f97f00d0780 0x7f97f00cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.469+0000 7f97f6ac8640 1 -- 172.21.15.7:0/2917251273 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f97f00d0780 msgr2=0x7f97f00cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.469+0000 7f97f6ac8640 1 --2- 172.21.15.7:0/2917251273 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f97f00d0780 0x7f97f00cd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.469+0000 7f97f6ac8640 1 -- 172.21.15.7:0/2917251273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97f00b68b0 msgr2=0x7f97f00cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.469+0000 7f97f6ac8640 1 --2- 172.21.15.7:0/2917251273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97f00b68b0 0x7f97f00cab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.469+0000 7f97f6ac8640 1 -- 172.21.15.7:0/2917251273 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f015c9a0 con 0x7f97f00d2c40 2024-04-25T09:56:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.469+0000 7f97f6ac8640 1 --2- 172.21.15.7:0/2917251273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97f00d2c40 0x7f97f01f6240 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f97e800cd70 tx=0x7f97e800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.469+0000 7f97e6ffd640 1 -- 172.21.15.7:0/2917251273 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e8003b90 con 0x7f97f00d2c40 2024-04-25T09:56:08.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.469+0000 7f97e6ffd640 1 -- 172.21.15.7:0/2917251273 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e8003d30 con 0x7f97f00d2c40 2024-04-25T09:56:08.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.469+0000 7f97e6ffd640 1 -- 172.21.15.7:0/2917251273 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e8004240 con 0x7f97f00d2c40 2024-04-25T09:56:08.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.469+0000 7f97f852b640 1 -- 172.21.15.7:0/2917251273 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f015cc80 con 0x7f97f00d2c40 2024-04-25T09:56:08.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.469+0000 7f97f852b640 1 -- 172.21.15.7:0/2917251273 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f015d240 con 0x7f97f00d2c40 2024-04-25T09:56:08.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.470+0000 7f97f852b640 1 -- 172.21.15.7:0/2917251273 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f00685d0 con 0x7f97f00d2c40 2024-04-25T09:56:08.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.471+0000 7f97e6ffd640 1 -- 172.21.15.7:0/2917251273 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f97e80043e0 con 0x7f97f00d2c40 2024-04-25T09:56:08.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.471+0000 7f97e6ffd640 1 --2- 172.21.15.7:0/2917251273 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f97d406b4d0 0x7f97d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:08.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.471+0000 7f97e6ffd640 1 -- 172.21.15.7:0/2917251273 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f97e808aa90 con 0x7f97f00d2c40 2024-04-25T09:56:08.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.471+0000 7f97f62c7640 1 --2- 172.21.15.7:0/2917251273 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f97d406b4d0 0x7f97d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:08.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.472+0000 7f97f62c7640 1 --2- 172.21.15.7:0/2917251273 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f97d406b4d0 0x7f97d406d990 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f97ec004f60 tx=0x7f97ec007e30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:08.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.476+0000 7f97e6ffd640 1 -- 172.21.15.7:0/2917251273 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f97e8059420 con 0x7f97f00d2c40 2024-04-25T09:56:08.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.656+0000 7f97f852b640 1 -- 172.21.15.7:0/2917251273 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f97f015b530 con 0x7f97f00d2c40 2024-04-25T09:56:08.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.656+0000 7f97e6ffd640 1 -- 172.21.15.7:0/2917251273 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f97e805d4c0 con 0x7f97f00d2c40 2024-04-25T09:56:08.659 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T09:56:08.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.658+0000 7f97f852b640 1 -- 172.21.15.7:0/2917251273 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f97d406b4d0 msgr2=0x7f97d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:08.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.658+0000 7f97f852b640 1 --2- 172.21.15.7:0/2917251273 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f97d406b4d0 0x7f97d406d990 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f97ec004f60 tx=0x7f97ec007e30 comp rx=0 tx=0).stop 2024-04-25T09:56:08.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.658+0000 7f97f852b640 1 -- 172.21.15.7:0/2917251273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97f00d2c40 msgr2=0x7f97f01f6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:08.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.658+0000 7f97f852b640 1 --2- 172.21.15.7:0/2917251273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97f00d2c40 0x7f97f01f6240 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f97e800cd70 tx=0x7f97e800a660 comp rx=0 tx=0).stop 2024-04-25T09:56:08.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.658+0000 7f97f852b640 1 -- 172.21.15.7:0/2917251273 shutdown_connections 2024-04-25T09:56:08.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.658+0000 7f97f852b640 1 --2- 172.21.15.7:0/2917251273 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f97d406b4d0 0x7f97d406d990 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:08.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.658+0000 7f97f852b640 1 --2- 172.21.15.7:0/2917251273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97f00d2c40 0x7f97f01f6240 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:08.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.658+0000 7f97f852b640 1 --2- 172.21.15.7:0/2917251273 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f97f00d0780 0x7f97f00cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:08.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.658+0000 7f97f852b640 1 --2- 172.21.15.7:0/2917251273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97f00b68b0 0x7f97f00cab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:08.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.658+0000 7f97f852b640 1 -- 172.21.15.7:0/2917251273 >> 172.21.15.7:0/2917251273 conn(0x7f97f00726b0 msgr2=0x7f97f00d3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:08.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.658+0000 7f97f852b640 1 -- 172.21.15.7:0/2917251273 shutdown_connections 2024-04-25T09:56:08.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.658+0000 7f97f852b640 1 -- 172.21.15.7:0/2917251273 wait complete. 2024-04-25T09:56:08.673 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2024-04-25T09:56:08.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.770+0000 7f1cce1d5640 1 Processor -- start 2024-04-25T09:56:08.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.770+0000 7f1cce1d5640 1 -- start start 2024-04-25T09:56:08.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.771+0000 7f1cce1d5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1cc815db00 0x7f1cc80d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:08.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.771+0000 7f1cce1d5640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1cc80ce2b0 0x7f1cc80d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:08.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.771+0000 7f1cce1d5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc80d1e80 con 0x7f1cc80b53b0 2024-04-25T09:56:08.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.771+0000 7f1cce1d5640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc80b5930 con 0x7f1cc80ce2b0 2024-04-25T09:56:08.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.771+0000 7f1cce1d5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc80b5c10 con 0x7f1cc815db00 2024-04-25T09:56:08.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.771+0000 7f1cc7fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1cc80ce2b0 0x7f1cc80d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:08.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.771+0000 7f1cc7fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1cc80ce2b0 0x7f1cc80d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35406/0 (socket says 172.21.15.7:35406) 2024-04-25T09:56:08.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.771+0000 7f1cc7fff640 1 -- 172.21.15.7:0/3786006971 learned_addr learned my addr 172.21.15.7:0/3786006971 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:08.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.772+0000 7f1cc77fe640 1 --2- 172.21.15.7:0/3786006971 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1cc815db00 0x7f1cc80d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:08.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.772+0000 7f1cc7fff640 1 -- 172.21.15.7:0/3786006971 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1cc815db00 msgr2=0x7f1cc80d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:08.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.772+0000 7f1cc7fff640 1 --2- 172.21.15.7:0/3786006971 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1cc815db00 0x7f1cc80d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:08.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.772+0000 7f1cc7fff640 1 -- 172.21.15.7:0/3786006971 >> v1:172.21.15.55:6789/0 conn(0x7f1cc80b53b0 legacy=0x7f1cc8161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:08.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.772+0000 7f1cc7fff640 1 -- 172.21.15.7:0/3786006971 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc80b5ef0 con 0x7f1cc80ce2b0 2024-04-25T09:56:08.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.773+0000 7f1cc7fff640 1 --2- 172.21.15.7:0/3786006971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cc80ce2b0 0x7f1cc80d0880 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0009e50 tx=0x7f1cc002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7742dec1b18674c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:08.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.773+0000 7f1cc67fc640 1 -- 172.21.15.7:0/3786006971 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc0036070 con 0x7f1cc80ce2b0 2024-04-25T09:56:08.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.773+0000 7f1cc67fc640 1 -- 172.21.15.7:0/3786006971 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc0031600 con 0x7f1cc80ce2b0 2024-04-25T09:56:08.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.773+0000 7f1cc67fc640 1 -- 172.21.15.7:0/3786006971 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc00319d0 con 0x7f1cc80ce2b0 2024-04-25T09:56:08.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.773+0000 7f1cce1d5640 1 -- 172.21.15.7:0/3786006971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cc80ce2b0 msgr2=0x7f1cc80d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:08.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.773+0000 7f1cce1d5640 1 --2- 172.21.15.7:0/3786006971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cc80ce2b0 0x7f1cc80d0880 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0009e50 tx=0x7f1cc002a710 comp rx=0 tx=0).stop 2024-04-25T09:56:08.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.773+0000 7f1cce1d5640 1 -- 172.21.15.7:0/3786006971 shutdown_connections 2024-04-25T09:56:08.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.773+0000 7f1cce1d5640 1 --2- 172.21.15.7:0/3786006971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cc80ce2b0 0x7f1cc80d0880 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:08.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.773+0000 7f1cce1d5640 1 --2- 172.21.15.7:0/3786006971 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1cc815db00 0x7f1cc80d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:08.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.773+0000 7f1cce1d5640 1 -- 172.21.15.7:0/3786006971 >> 172.21.15.7:0/3786006971 conn(0x7f1cc8072290 msgr2=0x7f1cc80726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:08.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.773+0000 7f1cce1d5640 1 -- 172.21.15.7:0/3786006971 shutdown_connections 2024-04-25T09:56:08.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.773+0000 7f1cce1d5640 1 -- 172.21.15.7:0/3786006971 wait complete. 2024-04-25T09:56:08.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.774+0000 7f1cce1d5640 1 Processor -- start 2024-04-25T09:56:08.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.775+0000 7f1cce1d5640 1 -- start start 2024-04-25T09:56:08.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.775+0000 7f1cce1d5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cc80b53b0 0x7f1cc80c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:08.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.775+0000 7f1cce1d5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1cc80ce2b0 0x7f1cc80c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:08.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.775+0000 7f1cce1d5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cc815db00 0x7f1cc81495d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:08.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.775+0000 7f1cce1d5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc80d3660 con 0x7f1cc80b53b0 2024-04-25T09:56:08.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.775+0000 7f1cce1d5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc80b61d0 con 0x7f1cc815db00 2024-04-25T09:56:08.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.775+0000 7f1cce1d5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc80b6c10 con 0x7f1cc80ce2b0 2024-04-25T09:56:08.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.775+0000 7f1cc77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cc80b53b0 0x7f1cc80c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:08.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.776+0000 7f1cc77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cc80b53b0 0x7f1cc80c63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35410/0 (socket says 172.21.15.7:35410) 2024-04-25T09:56:08.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.776+0000 7f1cc77fe640 1 -- 172.21.15.7:0/1763120564 learned_addr learned my addr 172.21.15.7:0/1763120564 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:08.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.776+0000 7f1cc7fff640 1 --2- 172.21.15.7:0/1763120564 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cc815db00 0x7f1cc81495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:08.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.776+0000 7f1cc6ffd640 1 --2- 172.21.15.7:0/1763120564 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1cc80ce2b0 0x7f1cc80c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:08.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.776+0000 7f1cc77fe640 1 -- 172.21.15.7:0/1763120564 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1cc80ce2b0 msgr2=0x7f1cc80c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:08.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.776+0000 7f1cc77fe640 1 --2- 172.21.15.7:0/1763120564 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1cc80ce2b0 0x7f1cc80c9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:08.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.776+0000 7f1cc77fe640 1 -- 172.21.15.7:0/1763120564 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cc815db00 msgr2=0x7f1cc81495d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:08.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.776+0000 7f1cc77fe640 1 --2- 172.21.15.7:0/1763120564 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cc815db00 0x7f1cc81495d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:08.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.776+0000 7f1cc77fe640 1 -- 172.21.15.7:0/1763120564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc80c7500 con 0x7f1cc80b53b0 2024-04-25T09:56:08.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.776+0000 7f1cc77fe640 1 --2- 172.21.15.7:0/1763120564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cc80b53b0 0x7f1cc80c63b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1cb800e870 tx=0x7f1cb800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:08.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.776+0000 7f1caffff640 1 -- 172.21.15.7:0/1763120564 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8017070 con 0x7f1cc80b53b0 2024-04-25T09:56:08.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.776+0000 7f1caffff640 1 -- 172.21.15.7:0/1763120564 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb800c940 con 0x7f1cc80b53b0 2024-04-25T09:56:08.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.776+0000 7f1cce1d5640 1 -- 172.21.15.7:0/1763120564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc80c77a0 con 0x7f1cc80b53b0 2024-04-25T09:56:08.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.776+0000 7f1caffff640 1 -- 172.21.15.7:0/1763120564 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb800cd30 con 0x7f1cc80b53b0 2024-04-25T09:56:08.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.776+0000 7f1cce1d5640 1 -- 172.21.15.7:0/1763120564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc815f390 con 0x7f1cc80b53b0 2024-04-25T09:56:08.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.777+0000 7f1cce1d5640 1 -- 172.21.15.7:0/1763120564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc8068fd0 con 0x7f1cc80b53b0 2024-04-25T09:56:08.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.778+0000 7f1caffff640 1 -- 172.21.15.7:0/1763120564 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1cb801a070 con 0x7f1cc80b53b0 2024-04-25T09:56:08.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.778+0000 7f1caffff640 1 --2- 172.21.15.7:0/1763120564 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1cb406b4d0 0x7f1cb406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:08.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.778+0000 7f1caffff640 1 -- 172.21.15.7:0/1763120564 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f1cb8089e10 con 0x7f1cc80b53b0 2024-04-25T09:56:08.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.778+0000 7f1cc6ffd640 1 --2- 172.21.15.7:0/1763120564 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1cb406b4d0 0x7f1cb406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:08.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.779+0000 7f1cc6ffd640 1 --2- 172.21.15.7:0/1763120564 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1cb406b4d0 0x7f1cb406d990 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1cc80b9340 tx=0x7f1cbc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:08.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:08.782+0000 7f1caffff640 1 -- 172.21.15.7:0/1763120564 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1cb8058840 con 0x7f1cc80b53b0 2024-04-25T09:56:09.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.030+0000 7f1cce1d5640 1 -- 172.21.15.7:0/1763120564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) v1 -- 0x7f1cc80d16b0 con 0x7f1cc80b53b0 2024-04-25T09:56:09.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.038+0000 7f1caffff640 1 -- 172.21.15.7:0/1763120564 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v118) v1 ==== 152+0+0 (secure 0 0 0) 0x7f1cb805c8e0 con 0x7f1cc80b53b0 2024-04-25T09:56:09.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.040+0000 7f1cce1d5640 1 -- 172.21.15.7:0/1763120564 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1cb406b4d0 msgr2=0x7f1cb406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:09.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.040+0000 7f1cce1d5640 1 --2- 172.21.15.7:0/1763120564 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1cb406b4d0 0x7f1cb406d990 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1cc80b9340 tx=0x7f1cbc009040 comp rx=0 tx=0).stop 2024-04-25T09:56:09.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.040+0000 7f1cce1d5640 1 -- 172.21.15.7:0/1763120564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cc80b53b0 msgr2=0x7f1cc80c63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:09.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.040+0000 7f1cce1d5640 1 --2- 172.21.15.7:0/1763120564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cc80b53b0 0x7f1cc80c63b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1cb800e870 tx=0x7f1cb800ed30 comp rx=0 tx=0).stop 2024-04-25T09:56:09.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.040+0000 7f1cce1d5640 1 -- 172.21.15.7:0/1763120564 shutdown_connections 2024-04-25T09:56:09.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.040+0000 7f1cce1d5640 1 --2- 172.21.15.7:0/1763120564 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1cb406b4d0 0x7f1cb406d990 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:09.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.040+0000 7f1cce1d5640 1 --2- 172.21.15.7:0/1763120564 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cc815db00 0x7f1cc81495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:09.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.040+0000 7f1cce1d5640 1 --2- 172.21.15.7:0/1763120564 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1cc80ce2b0 0x7f1cc80c9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:09.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.040+0000 7f1cce1d5640 1 --2- 172.21.15.7:0/1763120564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cc80b53b0 0x7f1cc80c63b0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:09.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.040+0000 7f1cce1d5640 1 -- 172.21.15.7:0/1763120564 >> 172.21.15.7:0/1763120564 conn(0x7f1cc8072290 msgr2=0x7f1cc815c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:09.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.040+0000 7f1cce1d5640 1 -- 172.21.15.7:0/1763120564 shutdown_connections 2024-04-25T09:56:09.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.040+0000 7f1cce1d5640 1 -- 172.21.15.7:0/1763120564 wait complete. 2024-04-25T09:56:09.054 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:56:09.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.155+0000 7fe401038640 1 Processor -- start 2024-04-25T09:56:09.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.155+0000 7fe401038640 1 -- start start 2024-04-25T09:56:09.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.155+0000 7fe401038640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe3fc0d3e70 0x7fe3fc0ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:09.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.156+0000 7fe401038640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3fc0d1a40 con 0x7fe3fc15deb0 2024-04-25T09:56:09.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.156+0000 7fe401038640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3fc0d1d20 con 0x7fe3fc0b2c30 2024-04-25T09:56:09.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.156+0000 7fe401038640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3fc0d2000 con 0x7fe3fc0d3e70 2024-04-25T09:56:09.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.156+0000 7fe3fad9d640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe3fc15deb0 0x7fe3fc0b69e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39356/0 (socket says 172.21.15.7:39356) 2024-04-25T09:56:09.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.156+0000 7fe3fad9d640 1 -- 172.21.15.7:0/1564856893 learned_addr learned my addr 172.21.15.7:0/1564856893 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:56:09.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.156+0000 7fe3fb59e640 1 --2- 172.21.15.7:0/1564856893 >> v2:172.21.15.55:3300/0 conn(0x7fe3fc0d3e70 0x7fe3fc0ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:09.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.156+0000 7fe3f9d9b640 1 -- 172.21.15.7:0/1564856893 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737376062 0 0) 0x7fe3fc0d1a40 con 0x7fe3fc15deb0 2024-04-25T09:56:09.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.156+0000 7fe3f9d9b640 1 -- 172.21.15.7:0/1564856893 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3e4003520 con 0x7fe3fc15deb0 2024-04-25T09:56:09.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.156+0000 7fe3f9d9b640 1 -- 172.21.15.7:0/1564856893 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1218743350 0 0) 0x7fe3e4003520 con 0x7fe3fc15deb0 2024-04-25T09:56:09.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.156+0000 7fe3f9d9b640 1 -- 172.21.15.7:0/1564856893 >> v2:172.21.15.55:3300/0 conn(0x7fe3fc0d3e70 msgr2=0x7fe3fc0ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:09.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.156+0000 7fe3f9d9b640 1 --2- 172.21.15.7:0/1564856893 >> v2:172.21.15.55:3300/0 conn(0x7fe3fc0d3e70 0x7fe3fc0ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:09.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.156+0000 7fe3f9d9b640 1 -- 172.21.15.7:0/1564856893 >> v1:172.21.15.55:6789/0 conn(0x7fe3fc0b2c30 legacy=0x7fe3fc0d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:09.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.156+0000 7fe3f9d9b640 1 -- 172.21.15.7:0/1564856893 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3fc0d22e0 con 0x7fe3fc15deb0 2024-04-25T09:56:09.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.156+0000 7fe3f9d9b640 1 -- 172.21.15.7:0/1564856893 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fe3ec001670 con 0x7fe3fc15deb0 2024-04-25T09:56:09.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.156+0000 7fe3f9d9b640 1 -- 172.21.15.7:0/1564856893 >> v1:172.21.15.7:6789/0 conn(0x7fe3fc15deb0 legacy=0x7fe3fc0b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:09.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.156+0000 7fe3f9d9b640 1 --2- 172.21.15.7:0/1564856893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3e40039b0 0x7fe3e4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:09.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.156+0000 7fe3f9d9b640 1 --2- 172.21.15.7:0/1564856893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3e40043b0 0x7fe3e4004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:09.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.156+0000 7fe3f9d9b640 1 --2- 172.21.15.7:0/1564856893 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe3e4005080 0x7fe3e400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:09.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.156+0000 7fe3f9d9b640 1 -- 172.21.15.7:0/1564856893 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0d2000 con 0x7fe3e40039b0 2024-04-25T09:56:09.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.156+0000 7fe3f9d9b640 1 -- 172.21.15.7:0/1564856893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e400bfe0 con 0x7fe3e40043b0 2024-04-25T09:56:09.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.156+0000 7fe3f9d9b640 1 -- 172.21.15.7:0/1564856893 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e400c1e0 con 0x7fe3e4005080 2024-04-25T09:56:09.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.156+0000 7fe3fad9d640 1 --2- 172.21.15.7:0/1564856893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3e40039b0 0x7fe3e4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:09.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.156+0000 7fe3fa59c640 1 --2- 172.21.15.7:0/1564856893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3e40043b0 0x7fe3e4004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:09.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.157+0000 7fe3fb59e640 1 --2- 172.21.15.7:0/1564856893 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe3e4005080 0x7fe3e400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:09.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.157+0000 7fe3fad9d640 1 -- 172.21.15.7:0/1564856893 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe3e4005080 msgr2=0x7fe3e400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:09.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.157+0000 7fe3fad9d640 1 --2- 172.21.15.7:0/1564856893 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe3e4005080 0x7fe3e400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:09.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.157+0000 7fe3fad9d640 1 -- 172.21.15.7:0/1564856893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3e40043b0 msgr2=0x7fe3e4004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:09.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.157+0000 7fe3fad9d640 1 --2- 172.21.15.7:0/1564856893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3e40043b0 0x7fe3e4004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:09.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.157+0000 7fe3fad9d640 1 -- 172.21.15.7:0/1564856893 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e4003520 con 0x7fe3e40039b0 2024-04-25T09:56:09.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.157+0000 7fe3fb59e640 1 -- 172.21.15.7:0/1564856893 reap_dead start 2024-04-25T09:56:09.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.157+0000 7fe3fad9d640 1 --2- 172.21.15.7:0/1564856893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3e40039b0 0x7fe3e4003d90 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec00c240 tx=0x7fe3e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb253cb826d8c3fd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:09.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.158+0000 7fe3f9d9b640 1 -- 172.21.15.7:0/1564856893 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec007d30 con 0x7fe3e40039b0 2024-04-25T09:56:09.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.158+0000 7fe3f9d9b640 1 -- 172.21.15.7:0/1564856893 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ec005af0 con 0x7fe3e40039b0 2024-04-25T09:56:09.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.158+0000 7fe3f9d9b640 1 -- 172.21.15.7:0/1564856893 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec007070 con 0x7fe3e40039b0 2024-04-25T09:56:09.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.158+0000 7fe401038640 1 -- 172.21.15.7:0/1564856893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3e40039b0 msgr2=0x7fe3e4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:09.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.158+0000 7fe401038640 1 --2- 172.21.15.7:0/1564856893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3e40039b0 0x7fe3e4003d90 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec00c240 tx=0x7fe3e4005830 comp rx=0 tx=0).stop 2024-04-25T09:56:09.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.158+0000 7fe401038640 1 -- 172.21.15.7:0/1564856893 shutdown_connections 2024-04-25T09:56:09.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.158+0000 7fe401038640 1 --2- 172.21.15.7:0/1564856893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3e40039b0 0x7fe3e4003d90 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:09.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.158+0000 7fe401038640 1 -- 172.21.15.7:0/1564856893 >> 172.21.15.7:0/1564856893 conn(0x7fe3fc0726b0 msgr2=0x7fe3fc072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:09.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.158+0000 7fe401038640 1 -- 172.21.15.7:0/1564856893 shutdown_connections 2024-04-25T09:56:09.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.158+0000 7fe401038640 1 -- 172.21.15.7:0/1564856893 wait complete. 2024-04-25T09:56:09.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.160+0000 7fe401038640 1 Processor -- start 2024-04-25T09:56:09.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.160+0000 7fe401038640 1 -- start start 2024-04-25T09:56:09.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.160+0000 7fe401038640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3e40039b0 0x7fe3fc0b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:09.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.160+0000 7fe401038640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3fc160a80 0x7fe3fc154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:09.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.160+0000 7fe401038640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe3fc0cb590 0x7fe3fc0b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:09.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.160+0000 7fe401038640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0ce1b0 con 0x7fe3fc160a80 2024-04-25T09:56:09.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.160+0000 7fe401038640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0ce030 con 0x7fe3e40039b0 2024-04-25T09:56:09.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.160+0000 7fe401038640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0ce330 con 0x7fe3fc0cb590 2024-04-25T09:56:09.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.160+0000 7fe3fa59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3fc160a80 0x7fe3fc154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:09.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.160+0000 7fe3fa59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3fc160a80 0x7fe3fc154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35430/0 (socket says 172.21.15.7:35430) 2024-04-25T09:56:09.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.160+0000 7fe3fa59c640 1 -- 172.21.15.7:0/2675569478 learned_addr learned my addr 172.21.15.7:0/2675569478 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:09.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.161+0000 7fe3fad9d640 1 --2- 172.21.15.7:0/2675569478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3e40039b0 0x7fe3fc0b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:09.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.161+0000 7fe3fb59e640 1 --2- 172.21.15.7:0/2675569478 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe3fc0cb590 0x7fe3fc0b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:09.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.161+0000 7fe3fa59c640 1 -- 172.21.15.7:0/2675569478 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe3fc0cb590 msgr2=0x7fe3fc0b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:09.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.161+0000 7fe3fa59c640 1 --2- 172.21.15.7:0/2675569478 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe3fc0cb590 0x7fe3fc0b4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:09.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.161+0000 7fe3fa59c640 1 -- 172.21.15.7:0/2675569478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3e40039b0 msgr2=0x7fe3fc0b3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:09.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.161+0000 7fe3fa59c640 1 --2- 172.21.15.7:0/2675569478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3e40039b0 0x7fe3fc0b3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:09.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.161+0000 7fe3fa59c640 1 -- 172.21.15.7:0/2675569478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3fc15e3c0 con 0x7fe3fc160a80 2024-04-25T09:56:09.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.161+0000 7fe3fa59c640 1 --2- 172.21.15.7:0/2675569478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3fc160a80 0x7fe3fc154f00 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe3f000f750 tx=0x7fe3f000fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:09.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.161+0000 7fe3e37fe640 1 -- 172.21.15.7:0/2675569478 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f000fe60 con 0x7fe3fc160a80 2024-04-25T09:56:09.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.161+0000 7fe3e37fe640 1 -- 172.21.15.7:0/2675569478 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f0018070 con 0x7fe3fc160a80 2024-04-25T09:56:09.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.161+0000 7fe401038640 1 -- 172.21.15.7:0/2675569478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3fc15e6a0 con 0x7fe3fc160a80 2024-04-25T09:56:09.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.161+0000 7fe3e37fe640 1 -- 172.21.15.7:0/2675569478 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f000d730 con 0x7fe3fc160a80 2024-04-25T09:56:09.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.161+0000 7fe401038640 1 -- 172.21.15.7:0/2675569478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3fc15ec60 con 0x7fe3fc160a80 2024-04-25T09:56:09.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.162+0000 7fe401038640 1 -- 172.21.15.7:0/2675569478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3fc15ee60 con 0x7fe3fc160a80 2024-04-25T09:56:09.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.163+0000 7fe3e37fe640 1 -- 172.21.15.7:0/2675569478 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe3f000d8d0 con 0x7fe3fc160a80 2024-04-25T09:56:09.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.163+0000 7fe3e37fe640 1 --2- 172.21.15.7:0/2675569478 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe3e806b500 0x7fe3e806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:09.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.163+0000 7fe3fad9d640 1 --2- 172.21.15.7:0/2675569478 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe3e806b500 0x7fe3e806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:09.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.163+0000 7fe3e37fe640 1 -- 172.21.15.7:0/2675569478 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fe3f0089ef0 con 0x7fe3fc160a80 2024-04-25T09:56:09.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.164+0000 7fe3fad9d640 1 --2- 172.21.15.7:0/2675569478 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe3e806b500 0x7fe3e806d9c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec032000 tx=0x7fe3ec02d000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:09.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.167+0000 7fe3e37fe640 1 -- 172.21.15.7:0/2675569478 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe3fc15ee60 con 0x7fe3fc160a80 2024-04-25T09:56:09.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.350+0000 7fe401038640 1 -- 172.21.15.7:0/2675569478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe3fc068f60 con 0x7fe3fc160a80 2024-04-25T09:56:09.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.353+0000 7fe3e37fe640 1 -- 172.21.15.7:0/2675569478 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe3f001a310 con 0x7fe3fc160a80 2024-04-25T09:56:09.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.355+0000 7fe401038640 1 -- 172.21.15.7:0/2675569478 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe3e806b500 msgr2=0x7fe3e806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:09.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.355+0000 7fe401038640 1 --2- 172.21.15.7:0/2675569478 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe3e806b500 0x7fe3e806d9c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec032000 tx=0x7fe3ec02d000 comp rx=0 tx=0).stop 2024-04-25T09:56:09.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.355+0000 7fe401038640 1 -- 172.21.15.7:0/2675569478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3fc160a80 msgr2=0x7fe3fc154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:09.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.355+0000 7fe401038640 1 --2- 172.21.15.7:0/2675569478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3fc160a80 0x7fe3fc154f00 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe3f000f750 tx=0x7fe3f000fc10 comp rx=0 tx=0).stop 2024-04-25T09:56:09.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.355+0000 7fe401038640 1 -- 172.21.15.7:0/2675569478 shutdown_connections 2024-04-25T09:56:09.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.355+0000 7fe401038640 1 --2- 172.21.15.7:0/2675569478 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe3e806b500 0x7fe3e806d9c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:09.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.355+0000 7fe401038640 1 --2- 172.21.15.7:0/2675569478 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe3fc0cb590 0x7fe3fc0b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:09.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.355+0000 7fe401038640 1 --2- 172.21.15.7:0/2675569478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3fc160a80 0x7fe3fc154f00 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:09.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.355+0000 7fe401038640 1 --2- 172.21.15.7:0/2675569478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3e40039b0 0x7fe3fc0b3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:09.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.355+0000 7fe401038640 1 -- 172.21.15.7:0/2675569478 >> 172.21.15.7:0/2675569478 conn(0x7fe3fc0726b0 msgr2=0x7fe3fc0c7020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:09.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.355+0000 7fe401038640 1 -- 172.21.15.7:0/2675569478 shutdown_connections 2024-04-25T09:56:09.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.355+0000 7fe401038640 1 -- 172.21.15.7:0/2675569478 wait complete. 2024-04-25T09:56:09.369 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:56:09.369 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:56:09.405 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:56:09.446 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:56:09.446 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:56:09.446 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:56:09.462 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13704 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:56:09.462 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:56:09.462 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:56:09.505 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19023 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:56:09.506 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:56:09.506 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:56:09.521 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13704 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:56:09.521 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:56:09.521 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:56:09.563 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19023 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:56:09.563 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:56:09.564 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:56:09.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.661+0000 7efcae7a5640 1 Processor -- start 2024-04-25T09:56:09.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.661+0000 7efcae7a5640 1 -- start start 2024-04-25T09:56:09.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.661+0000 7efcae7a5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efca815dd00 0x7efca80b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:09.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.662+0000 7efcae7a5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efca806c6c0 0x7efca80b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:09.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.662+0000 7efcae7a5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efca806cd00 con 0x7efca80b6a40 2024-04-25T09:56:09.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.662+0000 7efcae7a5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca815e0e0 con 0x7efca806c6c0 2024-04-25T09:56:09.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.662+0000 7efcae7a5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca806cfe0 con 0x7efca815dd00 2024-04-25T09:56:09.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.662+0000 7efcacd42640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efca806c6c0 0x7efca80b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:09.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.662+0000 7efca7fff640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efca815dd00 0x7efca80b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:09.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.662+0000 7efca77fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7efca80b6a40 0x7efca806bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:59784/0 (socket says 172.21.15.7:59784) 2024-04-25T09:56:09.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.662+0000 7efcacd42640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efca806c6c0 0x7efca80b5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:42292/0 (socket says 172.21.15.7:42292) 2024-04-25T09:56:09.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.662+0000 7efca77fe640 1 -- 172.21.15.7:0/3113673835 learned_addr learned my addr 172.21.15.7:0/3113673835 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:56:09.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.662+0000 7efca7fff640 1 -- 172.21.15.7:0/3113673835 >> v2:172.21.15.55:3300/0 conn(0x7efca806c6c0 msgr2=0x7efca80b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:09.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.662+0000 7efca7fff640 1 --2- 172.21.15.7:0/3113673835 >> v2:172.21.15.55:3300/0 conn(0x7efca806c6c0 0x7efca80b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:09.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.662+0000 7efca7fff640 1 -- 172.21.15.7:0/3113673835 >> v1:172.21.15.55:6789/0 conn(0x7efca80b6a40 legacy=0x7efca806bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:09.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.662+0000 7efca7fff640 1 -- 172.21.15.7:0/3113673835 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca80d1ca0 con 0x7efca815dd00 2024-04-25T09:56:09.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.662+0000 7efcacd42640 1 --2- 172.21.15.7:0/3113673835 >> v2:172.21.15.55:3300/0 conn(0x7efca806c6c0 0x7efca80b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:56:09.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.663+0000 7efca7fff640 1 --2- 172.21.15.7:0/3113673835 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efca815dd00 0x7efca80b5750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efc980097a0 tx=0x7efc9802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86800d0267af666 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:09.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.663+0000 7efca6ffd640 1 -- 172.21.15.7:0/3113673835 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc98037070 con 0x7efca815dd00 2024-04-25T09:56:09.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.663+0000 7efca6ffd640 1 -- 172.21.15.7:0/3113673835 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc98032440 con 0x7efca815dd00 2024-04-25T09:56:09.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.663+0000 7efca6ffd640 1 -- 172.21.15.7:0/3113673835 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc98032810 con 0x7efca815dd00 2024-04-25T09:56:09.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.664+0000 7efcae7a5640 1 -- 172.21.15.7:0/3113673835 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efca815dd00 msgr2=0x7efca80b5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:09.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.664+0000 7efcae7a5640 1 --2- 172.21.15.7:0/3113673835 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efca815dd00 0x7efca80b5750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efc980097a0 tx=0x7efc9802a210 comp rx=0 tx=0).stop 2024-04-25T09:56:09.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.664+0000 7efcae7a5640 1 -- 172.21.15.7:0/3113673835 shutdown_connections 2024-04-25T09:56:09.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.664+0000 7efcae7a5640 1 --2- 172.21.15.7:0/3113673835 >> v2:172.21.15.55:3300/0 conn(0x7efca806c6c0 0x7efca80b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:09.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.664+0000 7efcae7a5640 1 --2- 172.21.15.7:0/3113673835 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efca815dd00 0x7efca80b5750 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:09.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.664+0000 7efcae7a5640 1 -- 172.21.15.7:0/3113673835 >> 172.21.15.7:0/3113673835 conn(0x7efca80d07b0 msgr2=0x7efca80d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:09.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.664+0000 7efcae7a5640 1 -- 172.21.15.7:0/3113673835 shutdown_connections 2024-04-25T09:56:09.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.664+0000 7efcae7a5640 1 -- 172.21.15.7:0/3113673835 wait complete. 2024-04-25T09:56:09.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.665+0000 7efcae7a5640 1 Processor -- start 2024-04-25T09:56:09.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.665+0000 7efcae7a5640 1 -- start start 2024-04-25T09:56:09.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.666+0000 7efcae7a5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efca806c6c0 0x7efca80c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:09.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.666+0000 7efcae7a5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efca80b6a40 0x7efca81454e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.666+0000 7efcae7a5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efca815dd00 0x7efca815ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.666+0000 7efcae7a5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca80d2780 con 0x7efca80b6a40 2024-04-25T09:56:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.666+0000 7efcae7a5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca80d2260 con 0x7efca806c6c0 2024-04-25T09:56:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.666+0000 7efcae7a5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca80d2900 con 0x7efca815dd00 2024-04-25T09:56:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.666+0000 7efca77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efca80b6a40 0x7efca81454e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.666+0000 7efca77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efca80b6a40 0x7efca81454e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35440/0 (socket says 172.21.15.7:35440) 2024-04-25T09:56:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.666+0000 7efca77fe640 1 -- 172.21.15.7:0/3038828522 learned_addr learned my addr 172.21.15.7:0/3038828522 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.666+0000 7efcacd42640 1 --2- 172.21.15.7:0/3038828522 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efca815dd00 0x7efca815ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.666+0000 7efca7fff640 1 --2- 172.21.15.7:0/3038828522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efca806c6c0 0x7efca80c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.667+0000 7efca77fe640 1 -- 172.21.15.7:0/3038828522 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efca815dd00 msgr2=0x7efca815ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.667+0000 7efca77fe640 1 --2- 172.21.15.7:0/3038828522 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efca815dd00 0x7efca815ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.667+0000 7efca77fe640 1 -- 172.21.15.7:0/3038828522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efca806c6c0 msgr2=0x7efca80c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.667+0000 7efca77fe640 1 --2- 172.21.15.7:0/3038828522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efca806c6c0 0x7efca80c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.667+0000 7efca77fe640 1 -- 172.21.15.7:0/3038828522 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca80cc1a0 con 0x7efca80b6a40 2024-04-25T09:56:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.667+0000 7efca7fff640 1 --2- 172.21.15.7:0/3038828522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efca806c6c0 0x7efca80c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:09.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.667+0000 7efca77fe640 1 --2- 172.21.15.7:0/3038828522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efca80b6a40 0x7efca81454e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00c400 tx=0x7efc9c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:09.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.667+0000 7efca4ff9640 1 -- 172.21.15.7:0/3038828522 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c017070 con 0x7efca80b6a40 2024-04-25T09:56:09.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.667+0000 7efca4ff9640 1 -- 172.21.15.7:0/3038828522 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9c005ce0 con 0x7efca80b6a40 2024-04-25T09:56:09.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.667+0000 7efcae7a5640 1 -- 172.21.15.7:0/3038828522 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca80cc440 con 0x7efca80b6a40 2024-04-25T09:56:09.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.667+0000 7efca4ff9640 1 -- 172.21.15.7:0/3038828522 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c0072f0 con 0x7efca80b6a40 2024-04-25T09:56:09.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.667+0000 7efcae7a5640 1 -- 172.21.15.7:0/3038828522 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca80c9960 con 0x7efca80b6a40 2024-04-25T09:56:09.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.668+0000 7efcae7a5640 1 -- 172.21.15.7:0/3038828522 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca8073ce0 con 0x7efca80b6a40 2024-04-25T09:56:09.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.668+0000 7efca4ff9640 1 -- 172.21.15.7:0/3038828522 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efc9c01a070 con 0x7efca80b6a40 2024-04-25T09:56:09.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.669+0000 7efca4ff9640 1 --2- 172.21.15.7:0/3038828522 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efc9406b4d0 0x7efc9406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:09.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.669+0000 7efca4ff9640 1 -- 172.21.15.7:0/3038828522 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5335+0+0 (secure 0 0 0) 0x7efc9c089380 con 0x7efca80b6a40 2024-04-25T09:56:09.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.669+0000 7efca7fff640 1 --2- 172.21.15.7:0/3038828522 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efc9406b4d0 0x7efc9406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:09.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.669+0000 7efca7fff640 1 --2- 172.21.15.7:0/3038828522 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efc9406b4d0 0x7efc9406d990 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7efc98034000 tx=0x7efc9802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.673+0000 7efca4ff9640 1 -- 172.21.15.7:0/3038828522 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efca8073ce0 con 0x7efca80b6a40 2024-04-25T09:56:09.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.891+0000 7efcae7a5640 1 -- 172.21.15.7:0/3038828522 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efca8068fd0 con 0x7efca80b6a40 2024-04-25T09:56:09.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.891+0000 7efca4ff9640 1 -- 172.21.15.7:0/3038828522 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+3693 (secure 0 0 0) 0x7efc9c058400 con 0x7efca80b6a40 2024-04-25T09:56:09.895 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:09.895 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":17,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5047,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2022061608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2022061608},{"type":"v1","addr":"172.21.15.55:6834","nonce":2022061608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5356,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2616176049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2616176049},{"type":"v1","addr":"172.21.15.55:6835","nonce":2616176049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5382,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/2607466795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2607466795},{"type":"v1","addr":"172.21.15.7:6836","nonce":2607466795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5385,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1576325055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1576325055},{"type":"v1","addr":"172.21.15.7:6837","nonce":1576325055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[]} 2024-04-25T09:56:09.896 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 17 2024-04-25T09:56:09.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.893+0000 7efcae7a5640 1 -- 172.21.15.7:0/3038828522 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efc9406b4d0 msgr2=0x7efc9406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:09.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.893+0000 7efcae7a5640 1 --2- 172.21.15.7:0/3038828522 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efc9406b4d0 0x7efc9406d990 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7efc98034000 tx=0x7efc9802e000 comp rx=0 tx=0).stop 2024-04-25T09:56:09.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.893+0000 7efcae7a5640 1 -- 172.21.15.7:0/3038828522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efca80b6a40 msgr2=0x7efca81454e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:09.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.893+0000 7efcae7a5640 1 --2- 172.21.15.7:0/3038828522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efca80b6a40 0x7efca81454e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00c400 tx=0x7efc9c00c800 comp rx=0 tx=0).stop 2024-04-25T09:56:09.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.894+0000 7efcae7a5640 1 -- 172.21.15.7:0/3038828522 shutdown_connections 2024-04-25T09:56:09.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.894+0000 7efcae7a5640 1 --2- 172.21.15.7:0/3038828522 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efc9406b4d0 0x7efc9406d990 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:09.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.894+0000 7efcae7a5640 1 --2- 172.21.15.7:0/3038828522 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efca815dd00 0x7efca815ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:09.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.894+0000 7efcae7a5640 1 --2- 172.21.15.7:0/3038828522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efca80b6a40 0x7efca81454e0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:09.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.894+0000 7efcae7a5640 1 --2- 172.21.15.7:0/3038828522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efca806c6c0 0x7efca80c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:09.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.894+0000 7efcae7a5640 1 -- 172.21.15.7:0/3038828522 >> 172.21.15.7:0/3038828522 conn(0x7efca80d07b0 msgr2=0x7efca80b8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:09.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.894+0000 7efcae7a5640 1 -- 172.21.15.7:0/3038828522 shutdown_connections 2024-04-25T09:56:09.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:09.894+0000 7efcae7a5640 1 -- 172.21.15.7:0/3038828522 wait complete. 2024-04-25T09:56:09.908 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:56:09.909 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:56:09.909 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:56:09.909 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:56:09.909 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:56:09.910 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:56:09.910 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:56:09.910 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:56:09.911 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:56:09.911 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:56:09.911 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:56:09.911 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:56:09.912 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:56:09.912 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:56:09.912 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:56:09.912 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:56:09.921 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:56:09.921 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:56:09.922 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:56:09.922 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:56:09.924 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:56:09.924 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:56:09.925 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:56:09.925 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:56:09.964 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:56:09.965 DEBUG:teuthology.parallel:result is None 2024-04-25T09:56:09.966 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:56:09.966 DEBUG:teuthology.parallel:result is None 2024-04-25T09:56:09.967 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:56:09.967 DEBUG:teuthology.parallel:result is None 2024-04-25T09:56:09.968 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:56:09.968 DEBUG:teuthology.parallel:result is None 2024-04-25T09:56:09.968 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:56:10.041 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-04-25T09:56:10.041 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-04-25T09:56:10.053 INFO:tasks.ceph.mds.d.smithi055.stdout:starting mds.d at 2024-04-25T09:56:10.053 INFO:tasks.ceph.mds.b.smithi055.stdout:starting mds.b at 2024-04-25T09:56:10.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.072+0000 7eff76dc1640 1 Processor -- start 2024-04-25T09:56:10.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.072+0000 7eff76dc1640 1 -- start start 2024-04-25T09:56:10.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.073+0000 7eff76dc1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7eff700cd740 0x7eff700d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:10.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.073+0000 7eff76dc1640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7eff700d08d0 0x7eff7006c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:10.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.073+0000 7eff76dc1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff70099b90 con 0x7eff7006cbc0 2024-04-25T09:56:10.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.073+0000 7eff76dc1640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff700cdb20 con 0x7eff700d08d0 2024-04-25T09:56:10.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.073+0000 7eff76dc1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff700ccca0 con 0x7eff700cd740 2024-04-25T09:56:10.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.073+0000 7eff6ffff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7eff700d08d0 0x7eff7006c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:10.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.073+0000 7eff6ffff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7eff700d08d0 0x7eff7006c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58924/0 (socket says 172.21.15.7:58924) 2024-04-25T09:56:10.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.073+0000 7eff6ffff640 1 -- 172.21.15.7:0/2616080466 learned_addr learned my addr 172.21.15.7:0/2616080466 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:10.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.073+0000 7eff74b5d640 1 --2- 172.21.15.7:0/2616080466 >> v2:172.21.15.55:3300/0 conn(0x7eff700cd740 0x7eff700d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:10.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.073+0000 7eff6ffff640 1 -- 172.21.15.7:0/2616080466 >> v2:172.21.15.55:3300/0 conn(0x7eff700cd740 msgr2=0x7eff700d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:10.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.073+0000 7eff6ffff640 1 --2- 172.21.15.7:0/2616080466 >> v2:172.21.15.55:3300/0 conn(0x7eff700cd740 0x7eff700d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:10.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.073+0000 7eff6ffff640 1 -- 172.21.15.7:0/2616080466 >> v1:172.21.15.55:6789/0 conn(0x7eff7006cbc0 legacy=0x7eff70161830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:10.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.073+0000 7eff6ffff640 1 -- 172.21.15.7:0/2616080466 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff70099e70 con 0x7eff700d08d0 2024-04-25T09:56:10.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.074+0000 7eff6ffff640 1 --2- 172.21.15.7:0/2616080466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff700d08d0 0x7eff7006c680 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7eff7006ebf0 tx=0x7eff5c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19dcd5a9fb2c1d52 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:10.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.074+0000 7eff6f7fe640 1 -- 172.21.15.7:0/2616080466 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c037070 con 0x7eff700d08d0 2024-04-25T09:56:10.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.074+0000 7eff6f7fe640 1 -- 172.21.15.7:0/2616080466 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c032440 con 0x7eff700d08d0 2024-04-25T09:56:10.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.074+0000 7eff6f7fe640 1 -- 172.21.15.7:0/2616080466 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c032810 con 0x7eff700d08d0 2024-04-25T09:56:10.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.075+0000 7eff76dc1640 1 -- 172.21.15.7:0/2616080466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff700d08d0 msgr2=0x7eff7006c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:10.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.075+0000 7eff76dc1640 1 --2- 172.21.15.7:0/2616080466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff700d08d0 0x7eff7006c680 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7eff7006ebf0 tx=0x7eff5c02a270 comp rx=0 tx=0).stop 2024-04-25T09:56:10.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.075+0000 7eff76dc1640 1 -- 172.21.15.7:0/2616080466 shutdown_connections 2024-04-25T09:56:10.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.075+0000 7eff76dc1640 1 --2- 172.21.15.7:0/2616080466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff700d08d0 0x7eff7006c680 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:10.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.075+0000 7eff76dc1640 1 --2- 172.21.15.7:0/2616080466 >> v2:172.21.15.55:3300/0 conn(0x7eff700cd740 0x7eff700d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:10.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.075+0000 7eff76dc1640 1 -- 172.21.15.7:0/2616080466 >> 172.21.15.7:0/2616080466 conn(0x7eff700b3130 msgr2=0x7eff700b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:10.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.075+0000 7eff76dc1640 1 -- 172.21.15.7:0/2616080466 shutdown_connections 2024-04-25T09:56:10.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.075+0000 7eff76dc1640 1 -- 172.21.15.7:0/2616080466 wait complete. 2024-04-25T09:56:10.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.076+0000 7eff76dc1640 1 Processor -- start 2024-04-25T09:56:10.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.076+0000 7eff76dc1640 1 -- start start 2024-04-25T09:56:10.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.077+0000 7eff76dc1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff7006cbc0 0x7eff700ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:10.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.077+0000 7eff76dc1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff700cd740 0x7eff7014cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:10.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.077+0000 7eff76dc1640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7eff700d08d0 0x7eff700cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:10.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.077+0000 7eff76dc1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff7009a430 con 0x7eff700cd740 2024-04-25T09:56:10.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.077+0000 7eff76dc1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff7006cff0 con 0x7eff7006cbc0 2024-04-25T09:56:10.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.077+0000 7eff76dc1640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff7009a710 con 0x7eff700d08d0 2024-04-25T09:56:10.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.077+0000 7eff6ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff700cd740 0x7eff7014cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:10.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.077+0000 7eff6ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff700cd740 0x7eff7014cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58932/0 (socket says 172.21.15.7:58932) 2024-04-25T09:56:10.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.077+0000 7eff6ffff640 1 -- 172.21.15.7:0/4008129484 learned_addr learned my addr 172.21.15.7:0/4008129484 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:10.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.077+0000 7eff74b5d640 1 --2- 172.21.15.7:0/4008129484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff7006cbc0 0x7eff700ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:10.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.077+0000 7eff7535e640 1 --2- 172.21.15.7:0/4008129484 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7eff700d08d0 0x7eff700cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:10.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.077+0000 7eff6ffff640 1 -- 172.21.15.7:0/4008129484 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7eff700d08d0 msgr2=0x7eff700cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:10.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.077+0000 7eff6ffff640 1 --2- 172.21.15.7:0/4008129484 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7eff700d08d0 0x7eff700cbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:10.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.077+0000 7eff6ffff640 1 -- 172.21.15.7:0/4008129484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff7006cbc0 msgr2=0x7eff700ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:10.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.077+0000 7eff6ffff640 1 --2- 172.21.15.7:0/4008129484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff7006cbc0 0x7eff700ae4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:10.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.077+0000 7eff6ffff640 1 -- 172.21.15.7:0/4008129484 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff700cc510 con 0x7eff700cd740 2024-04-25T09:56:10.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.078+0000 7eff6ffff640 1 --2- 172.21.15.7:0/4008129484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff700cd740 0x7eff7014cb90 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7eff5c02a2b0 tx=0x7eff5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:10.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.078+0000 7eff6d7fa640 1 -- 172.21.15.7:0/4008129484 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c037040 con 0x7eff700cd740 2024-04-25T09:56:10.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.078+0000 7eff6d7fa640 1 -- 172.21.15.7:0/4008129484 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c042070 con 0x7eff700cd740 2024-04-25T09:56:10.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.078+0000 7eff76dc1640 1 -- 172.21.15.7:0/4008129484 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff700b0920 con 0x7eff700cd740 2024-04-25T09:56:10.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.078+0000 7eff6d7fa640 1 -- 172.21.15.7:0/4008129484 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c030880 con 0x7eff700cd740 2024-04-25T09:56:10.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.078+0000 7eff76dc1640 1 -- 172.21.15.7:0/4008129484 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff700b0ee0 con 0x7eff700cd740 2024-04-25T09:56:10.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.079+0000 7eff76dc1640 1 -- 172.21.15.7:0/4008129484 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff70068fd0 con 0x7eff700cd740 2024-04-25T09:56:10.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.080+0000 7eff6d7fa640 1 -- 172.21.15.7:0/4008129484 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7eff5c030a20 con 0x7eff700cd740 2024-04-25T09:56:10.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.080+0000 7eff6d7fa640 1 --2- 172.21.15.7:0/4008129484 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7eff5406b4d0 0x7eff5406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:10.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.080+0000 7eff6d7fa640 1 -- 172.21.15.7:0/4008129484 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5335+0+0 (secure 0 0 0) 0x7eff5c0aa740 con 0x7eff700cd740 2024-04-25T09:56:10.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.080+0000 7eff74b5d640 1 --2- 172.21.15.7:0/4008129484 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7eff5406b4d0 0x7eff5406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:10.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.081+0000 7eff74b5d640 1 --2- 172.21.15.7:0/4008129484 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7eff5406b4d0 0x7eff5406d990 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7eff64009b40 tx=0x7eff64009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:10.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.084+0000 7eff6d7fa640 1 -- 172.21.15.7:0/4008129484 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7eff700cc510 con 0x7eff700cd740 2024-04-25T09:56:10.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:10.279+0000 7eff76dc1640 1 -- 172.21.15.7:0/4008129484 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7eff700b51c0 con 0x7eff700cd740 2024-04-25T09:56:11.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.377+0000 7eff6d7fa640 1 -- 172.21.15.7:0/4008129484 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v47) v1 ==== 97+0+0 (secure 0 0 0) 0x7eff5c079170 con 0x7eff700cd740 2024-04-25T09:56:11.380 INFO:teuthology.orchestra.run.smithi007.stderr: removed all blocklist entries 2024-04-25T09:56:11.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.380+0000 7eff76dc1640 1 -- 172.21.15.7:0/4008129484 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7eff5406b4d0 msgr2=0x7eff5406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:11.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.380+0000 7eff76dc1640 1 --2- 172.21.15.7:0/4008129484 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7eff5406b4d0 0x7eff5406d990 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7eff64009b40 tx=0x7eff64009190 comp rx=0 tx=0).stop 2024-04-25T09:56:11.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.380+0000 7eff76dc1640 1 -- 172.21.15.7:0/4008129484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff700cd740 msgr2=0x7eff7014cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:11.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.380+0000 7eff76dc1640 1 --2- 172.21.15.7:0/4008129484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff700cd740 0x7eff7014cb90 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7eff5c02a2b0 tx=0x7eff5c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:56:11.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.381+0000 7eff76dc1640 1 -- 172.21.15.7:0/4008129484 shutdown_connections 2024-04-25T09:56:11.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.381+0000 7eff76dc1640 1 --2- 172.21.15.7:0/4008129484 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7eff5406b4d0 0x7eff5406d990 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:11.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.381+0000 7eff76dc1640 1 --2- 172.21.15.7:0/4008129484 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7eff700d08d0 0x7eff700cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:11.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.381+0000 7eff76dc1640 1 --2- 172.21.15.7:0/4008129484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff700cd740 0x7eff7014cb90 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:11.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.381+0000 7eff76dc1640 1 --2- 172.21.15.7:0/4008129484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff7006cbc0 0x7eff700ae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:11.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.381+0000 7eff76dc1640 1 -- 172.21.15.7:0/4008129484 >> 172.21.15.7:0/4008129484 conn(0x7eff700b3130 msgr2=0x7eff7006f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:11.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.381+0000 7eff76dc1640 1 -- 172.21.15.7:0/4008129484 shutdown_connections 2024-04-25T09:56:11.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.381+0000 7eff76dc1640 1 -- 172.21.15.7:0/4008129484 wait complete. 2024-04-25T09:56:11.397 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:56:11.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.501+0000 7fc29ec93640 1 Processor -- start 2024-04-25T09:56:11.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.501+0000 7fc29ec93640 1 -- start start 2024-04-25T09:56:11.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.502+0000 7fc29ec93640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc29815dd00 0x7fc2980b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:11.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.502+0000 7fc29ec93640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc29806cd00 con 0x7fc2980b6a40 2024-04-25T09:56:11.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.502+0000 7fc29ec93640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2980d1ca0 con 0x7fc29806c6c0 2024-04-25T09:56:11.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.502+0000 7fc29ec93640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29815e0e0 con 0x7fc29815dd00 2024-04-25T09:56:11.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.502+0000 7fc297fff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc2980b6a40 0x7fc29806bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53638/0 (socket says 172.21.15.7:53638) 2024-04-25T09:56:11.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.502+0000 7fc297fff640 1 -- 172.21.15.7:0/1771337120 learned_addr learned my addr 172.21.15.7:0/1771337120 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:56:11.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.502+0000 7fc29ca2f640 1 --2- 172.21.15.7:0/1771337120 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc29815dd00 0x7fc2980b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:11.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.503+0000 7fc2977fe640 1 -- 172.21.15.7:0/1771337120 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513269527 0 0) 0x7fc29806cd00 con 0x7fc2980b6a40 2024-04-25T09:56:11.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.503+0000 7fc2977fe640 1 -- 172.21.15.7:0/1771337120 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc280003520 con 0x7fc2980b6a40 2024-04-25T09:56:11.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.503+0000 7fc2977fe640 1 -- 172.21.15.7:0/1771337120 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 648881763 0 0) 0x7fc2980d1ca0 con 0x7fc29806c6c0 2024-04-25T09:56:11.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.503+0000 7fc2977fe640 1 -- 172.21.15.7:0/1771337120 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc29806cd00 con 0x7fc29806c6c0 2024-04-25T09:56:11.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.503+0000 7fc2977fe640 1 -- 172.21.15.7:0/1771337120 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 59341215 0 0) 0x7fc280003520 con 0x7fc2980b6a40 2024-04-25T09:56:11.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.503+0000 7fc2977fe640 1 -- 172.21.15.7:0/1771337120 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc29815dd00 msgr2=0x7fc2980b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:11.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.503+0000 7fc2977fe640 1 --2- 172.21.15.7:0/1771337120 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc29815dd00 0x7fc2980b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:11.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.503+0000 7fc2977fe640 1 -- 172.21.15.7:0/1771337120 >> v1:172.21.15.55:6789/0 conn(0x7fc29806c6c0 legacy=0x7fc2980d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:11.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.503+0000 7fc2977fe640 1 -- 172.21.15.7:0/1771337120 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2980d1f80 con 0x7fc2980b6a40 2024-04-25T09:56:11.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.503+0000 7fc2977fe640 1 -- 172.21.15.7:0/1771337120 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fc28c001670 con 0x7fc2980b6a40 2024-04-25T09:56:11.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.503+0000 7fc2977fe640 1 -- 172.21.15.7:0/1771337120 >> v1:172.21.15.7:6789/0 conn(0x7fc2980b6a40 legacy=0x7fc29806bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:11.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.503+0000 7fc2977fe640 1 --2- 172.21.15.7:0/1771337120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc280003b70 0x7fc280003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:11.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.503+0000 7fc2977fe640 1 --2- 172.21.15.7:0/1771337120 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc29815dd00 0x7fc280004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:11.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.503+0000 7fc2977fe640 1 --2- 172.21.15.7:0/1771337120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc280004d40 0x7fc2800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:11.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.503+0000 7fc2977fe640 1 -- 172.21.15.7:0/1771337120 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29815e0e0 con 0x7fc280003b70 2024-04-25T09:56:11.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.503+0000 7fc2977fe640 1 -- 172.21.15.7:0/1771337120 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28000ba70 con 0x7fc280004d40 2024-04-25T09:56:11.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.503+0000 7fc2977fe640 1 -- 172.21.15.7:0/1771337120 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc28000bc20 con 0x7fc29815dd00 2024-04-25T09:56:11.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.503+0000 7fc29ca2f640 1 --2- 172.21.15.7:0/1771337120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc280003b70 0x7fc280003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:11.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.503+0000 7fc297fff640 1 --2- 172.21.15.7:0/1771337120 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc29815dd00 0x7fc280004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:11.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.503+0000 7fc29d230640 1 --2- 172.21.15.7:0/1771337120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc280004d40 0x7fc2800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:11.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.503+0000 7fc29ca2f640 1 -- 172.21.15.7:0/1771337120 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc29815dd00 msgr2=0x7fc280004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:11.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.503+0000 7fc29ca2f640 1 --2- 172.21.15.7:0/1771337120 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc29815dd00 0x7fc280004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:11.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.503+0000 7fc29ca2f640 1 -- 172.21.15.7:0/1771337120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc280004d40 msgr2=0x7fc2800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:11.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.503+0000 7fc29ca2f640 1 --2- 172.21.15.7:0/1771337120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc280004d40 0x7fc2800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:11.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.503+0000 7fc29ca2f640 1 -- 172.21.15.7:0/1771337120 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc280003520 con 0x7fc280003b70 2024-04-25T09:56:11.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.504+0000 7fc29ca2f640 1 --2- 172.21.15.7:0/1771337120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc280003b70 0x7fc280003f70 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc290009fc0 tx=0x7fc280005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6ddd04c3dc35c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:11.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.504+0000 7fc2977fe640 1 -- 172.21.15.7:0/1771337120 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc290009c10 con 0x7fc280003b70 2024-04-25T09:56:11.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.504+0000 7fc2977fe640 1 -- 172.21.15.7:0/1771337120 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc290036070 con 0x7fc280003b70 2024-04-25T09:56:11.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.504+0000 7fc2977fe640 1 -- 172.21.15.7:0/1771337120 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc290031880 con 0x7fc280003b70 2024-04-25T09:56:11.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.505+0000 7fc29ec93640 1 -- 172.21.15.7:0/1771337120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc280003b70 msgr2=0x7fc280003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:11.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.505+0000 7fc29ec93640 1 --2- 172.21.15.7:0/1771337120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc280003b70 0x7fc280003f70 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc290009fc0 tx=0x7fc280005830 comp rx=0 tx=0).stop 2024-04-25T09:56:11.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.505+0000 7fc29d230640 1 -- 172.21.15.7:0/1771337120 reap_dead start 2024-04-25T09:56:11.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.505+0000 7fc29ec93640 1 -- 172.21.15.7:0/1771337120 shutdown_connections 2024-04-25T09:56:11.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.505+0000 7fc29ec93640 1 -- 172.21.15.7:0/1771337120 >> 172.21.15.7:0/1771337120 conn(0x7fc2980d07b0 msgr2=0x7fc2980d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:11.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.505+0000 7fc29ec93640 1 -- 172.21.15.7:0/1771337120 shutdown_connections 2024-04-25T09:56:11.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.505+0000 7fc29ec93640 1 -- 172.21.15.7:0/1771337120 wait complete. 2024-04-25T09:56:11.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.506+0000 7fc29ec93640 1 Processor -- start 2024-04-25T09:56:11.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.506+0000 7fc29ec93640 1 -- start start 2024-04-25T09:56:11.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.507+0000 7fc29ec93640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc280003b70 0x7fc2980b8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:11.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.507+0000 7fc29ec93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc29815c670 0x7fc2981529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:11.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.507+0000 7fc29ec93640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc298152f20 0x7fc298153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:11.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.507+0000 7fc29ec93640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2980d2e90 con 0x7fc298152f20 2024-04-25T09:56:11.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.507+0000 7fc29ec93640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29806cfe0 con 0x7fc29815c670 2024-04-25T09:56:11.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.507+0000 7fc29ec93640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2980d3010 con 0x7fc280003b70 2024-04-25T09:56:11.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.507+0000 7fc29d230640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc298152f20 0x7fc298153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:11.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.507+0000 7fc29d230640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc298152f20 0x7fc298153a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58946/0 (socket says 172.21.15.7:58946) 2024-04-25T09:56:11.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.507+0000 7fc29d230640 1 -- 172.21.15.7:0/4213284953 learned_addr learned my addr 172.21.15.7:0/4213284953 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:11.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.507+0000 7fc297fff640 1 --2- 172.21.15.7:0/4213284953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc29815c670 0x7fc2981529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:11.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.507+0000 7fc29ca2f640 1 --2- 172.21.15.7:0/4213284953 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc280003b70 0x7fc2980b8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:11.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.508+0000 7fc29d230640 1 -- 172.21.15.7:0/4213284953 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc280003b70 msgr2=0x7fc2980b8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:11.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.508+0000 7fc29d230640 1 --2- 172.21.15.7:0/4213284953 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc280003b70 0x7fc2980b8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:11.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.508+0000 7fc29d230640 1 -- 172.21.15.7:0/4213284953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc29815c670 msgr2=0x7fc2981529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:11.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.508+0000 7fc29d230640 1 --2- 172.21.15.7:0/4213284953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc29815c670 0x7fc2981529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:11.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.508+0000 7fc29d230640 1 -- 172.21.15.7:0/4213284953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29815b5d0 con 0x7fc298152f20 2024-04-25T09:56:11.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.508+0000 7fc29d230640 1 --2- 172.21.15.7:0/4213284953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc298152f20 0x7fc298153a10 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc29806d290 tx=0x7fc28800f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:11.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.508+0000 7fc2957fa640 1 -- 172.21.15.7:0/4213284953 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc288019070 con 0x7fc298152f20 2024-04-25T09:56:11.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.508+0000 7fc2957fa640 1 -- 172.21.15.7:0/4213284953 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2880050d0 con 0x7fc298152f20 2024-04-25T09:56:11.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.508+0000 7fc29ec93640 1 -- 172.21.15.7:0/4213284953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc29815b8b0 con 0x7fc298152f20 2024-04-25T09:56:11.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.508+0000 7fc2957fa640 1 -- 172.21.15.7:0/4213284953 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc288006aa0 con 0x7fc298152f20 2024-04-25T09:56:11.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.508+0000 7fc29ec93640 1 -- 172.21.15.7:0/4213284953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc29815be70 con 0x7fc298152f20 2024-04-25T09:56:11.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.509+0000 7fc29ec93640 1 -- 172.21.15.7:0/4213284953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc298068fd0 con 0x7fc298152f20 2024-04-25T09:56:11.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.510+0000 7fc2957fa640 1 -- 172.21.15.7:0/4213284953 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc28801c070 con 0x7fc298152f20 2024-04-25T09:56:11.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.510+0000 7fc2957fa640 1 --2- 172.21.15.7:0/4213284953 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc28406b4d0 0x7fc28406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:11.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.510+0000 7fc2957fa640 1 -- 172.21.15.7:0/4213284953 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fc288089050 con 0x7fc298152f20 2024-04-25T09:56:11.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.510+0000 7fc29ca2f640 1 --2- 172.21.15.7:0/4213284953 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc28406b4d0 0x7fc28406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:11.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.510+0000 7fc29ca2f640 1 --2- 172.21.15.7:0/4213284953 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc28406b4d0 0x7fc28406d990 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc290035000 tx=0x7fc29002f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:11.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.514+0000 7fc2957fa640 1 -- 172.21.15.7:0/4213284953 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc288057ad0 con 0x7fc298152f20 2024-04-25T09:56:11.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.761+0000 7fc29ec93640 1 -- 172.21.15.7:0/4213284953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc2980d1620 con 0x7fc298152f20 2024-04-25T09:56:11.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.762+0000 7fc2957fa640 1 -- 172.21.15.7:0/4213284953 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fc28805bb70 con 0x7fc298152f20 2024-04-25T09:56:11.765 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:11.765 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T09:56:11.765 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_dump": [ 2024-04-25T09:56:11.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:56:11.765 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.a", 2024-04-25T09:56:11.765 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmDER5IhAA2ih+YNPXKaTRN6KeMKiDaA==", 2024-04-25T09:56:11.765 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:56:11.766 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:56:11.766 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T09:56:11.766 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T09:56:11.766 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:56:11.766 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:56:11.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:56:11.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:56:11.766 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.b", 2024-04-25T09:56:11.766 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmp55aLhAAD3pB8YjSzrpU6DfjQTVHPw==", 2024-04-25T09:56:11.766 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:56:11.766 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:56:11.766 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T09:56:11.767 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T09:56:11.767 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:56:11.767 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:56:11.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:56:11.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:56:11.767 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.c", 2024-04-25T09:56:11.767 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpm8jBtKRAAiDZo8S/z1fE588t8tiuX8Q==", 2024-04-25T09:56:11.767 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:56:11.767 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:56:11.767 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T09:56:11.767 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T09:56:11.767 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:56:11.767 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:56:11.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:56:11.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:56:11.768 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.d", 2024-04-25T09:56:11.768 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmZWyRNRAA6tdquR+Hh8Lhx7LATegX6g==", 2024-04-25T09:56:11.768 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:56:11.768 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:56:11.768 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T09:56:11.768 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T09:56:11.768 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:56:11.768 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:56:11.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:56:11.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:56:11.768 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.0", 2024-04-25T09:56:11.768 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAaKCpmfHZ9HBAA9FYBJbc1QdNt1a9qtFhgBw==", 2024-04-25T09:56:11.768 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:56:11.768 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:56:11.769 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:56:11.769 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:56:11.769 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:56:11.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:56:11.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:56:11.769 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.1", 2024-04-25T09:56:11.769 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAdKCpmtYOgGhAAbM8XXG5fT+UNSvzvijeJ9Q==", 2024-04-25T09:56:11.769 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:56:11.769 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:56:11.769 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:56:11.769 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:56:11.769 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:56:11.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:56:11.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:56:11.770 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.2", 2024-04-25T09:56:11.770 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAgKCpmz4uZGBAA6JD3UWZ/8l12y4lJg0kH0A==", 2024-04-25T09:56:11.770 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:56:11.770 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:56:11.770 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:56:11.770 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:56:11.770 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:56:11.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:56:11.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:56:11.770 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.3", 2024-04-25T09:56:11.770 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAjKCpmcbXXFhAAsK64H4YqdiD1VJKQtn46OQ==", 2024-04-25T09:56:11.770 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:56:11.770 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:56:11.770 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:56:11.771 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:56:11.771 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:56:11.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:56:11.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:56:11.771 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.4", 2024-04-25T09:56:11.771 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAsKCpmzEDuKxAAmzxdcdVZIq2bGfG0rYcBBg==", 2024-04-25T09:56:11.771 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:56:11.771 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:56:11.771 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:56:11.771 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:56:11.771 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:56:11.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:56:11.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:56:11.772 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.5", 2024-04-25T09:56:11.772 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAvKCpmfyC4KxAAl6QUtdlRRaRNZpECSoHLJQ==", 2024-04-25T09:56:11.772 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:56:11.772 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:56:11.772 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:56:11.772 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:56:11.772 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:56:11.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:56:11.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:56:11.772 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.6", 2024-04-25T09:56:11.772 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAyKCpmBrUsKxAAH5IlxYRXUtPKYWDdTqBp3w==", 2024-04-25T09:56:11.772 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:56:11.772 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:56:11.773 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:56:11.773 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:56:11.773 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:56:11.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:56:11.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:56:11.773 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.7", 2024-04-25T09:56:11.773 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQA1KCpmmwTSKhAAdzw/c0Xc6KCQHssqUI910g==", 2024-04-25T09:56:11.773 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:56:11.773 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:56:11.773 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:56:11.773 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:56:11.773 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:56:11.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:56:11.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:56:11.774 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.0", 2024-04-25T09:56:11.774 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmaJKeORAALxC5ZqLLEu0zJFG+SOGukQ==", 2024-04-25T09:56:11.774 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:56:11.774 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:56:11.774 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow r", 2024-04-25T09:56:11.774 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:56:11.774 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:56:11.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:56:11.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:56:11.774 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.1", 2024-04-25T09:56:11.774 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAZKCpmC2i6BhAAtKmpTNs/Tga7NtOkm7jSOg==", 2024-04-25T09:56:11.774 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:56:11.774 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:56:11.775 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-04-25T09:56:11.775 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-04-25T09:56:11.775 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-04-25T09:56:11.775 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:56:11.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:56:11.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:56:11.775 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.2", 2024-04-25T09:56:11.775 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAZKCpmytCIAxAAhP2UjagzGbz1ySErw1cw3Q==", 2024-04-25T09:56:11.775 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:56:11.775 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:56:11.775 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-04-25T09:56:11.775 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-04-25T09:56:11.775 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-04-25T09:56:11.775 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:56:11.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:56:11.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:56:11.776 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.3", 2024-04-25T09:56:11.776 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAZKCpmSj88DBAAg+N3XDyc3H6fUBqkScD/9Q==", 2024-04-25T09:56:11.776 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:56:11.776 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:56:11.776 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-04-25T09:56:11.776 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-04-25T09:56:11.776 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-04-25T09:56:11.776 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:56:11.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:56:11.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:56:11.776 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.admin", 2024-04-25T09:56:11.776 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpm8SYpBhAACl5SVNaaKZV7rIIFaFlmvw==", 2024-04-25T09:56:11.776 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:56:11.777 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-04-25T09:56:11.777 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T09:56:11.777 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T09:56:11.777 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:56:11.777 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:56:11.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:56:11.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:56:11.777 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.x", 2024-04-25T09:56:11.777 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmqIdPHxAACc5SoI1y74ickl2cPjfGIg==", 2024-04-25T09:56:11.777 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:56:11.777 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-04-25T09:56:11.777 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2024-04-25T09:56:11.777 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:56:11.777 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:56:11.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:56:11.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:56:11.778 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.y", 2024-04-25T09:56:11.778 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmCvpDGxAAYsxd6zUjxUgY0sYwR4VvAQ==", 2024-04-25T09:56:11.778 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:56:11.778 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-04-25T09:56:11.778 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2024-04-25T09:56:11.778 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:56:11.778 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:56:11.778 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:56:11.778 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-25T09:56:11.778 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T09:56:11.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.763+0000 7fc29ec93640 1 -- 172.21.15.7:0/4213284953 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc28406b4d0 msgr2=0x7fc28406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:11.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.763+0000 7fc29ec93640 1 --2- 172.21.15.7:0/4213284953 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc28406b4d0 0x7fc28406d990 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc290035000 tx=0x7fc29002f000 comp rx=0 tx=0).stop 2024-04-25T09:56:11.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.763+0000 7fc29ec93640 1 -- 172.21.15.7:0/4213284953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc298152f20 msgr2=0x7fc298153a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:11.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.763+0000 7fc29ec93640 1 --2- 172.21.15.7:0/4213284953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc298152f20 0x7fc298153a10 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc29806d290 tx=0x7fc28800f9f0 comp rx=0 tx=0).stop 2024-04-25T09:56:11.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.764+0000 7fc29ec93640 1 -- 172.21.15.7:0/4213284953 shutdown_connections 2024-04-25T09:56:11.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.764+0000 7fc29ec93640 1 --2- 172.21.15.7:0/4213284953 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc28406b4d0 0x7fc28406d990 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:11.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.764+0000 7fc29ec93640 1 --2- 172.21.15.7:0/4213284953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc298152f20 0x7fc298153a10 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:11.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.764+0000 7fc29ec93640 1 --2- 172.21.15.7:0/4213284953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc29815c670 0x7fc2981529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:11.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.764+0000 7fc29ec93640 1 --2- 172.21.15.7:0/4213284953 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc280003b70 0x7fc2980b8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:11.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.764+0000 7fc29ec93640 1 -- 172.21.15.7:0/4213284953 >> 172.21.15.7:0/4213284953 conn(0x7fc2980d07b0 msgr2=0x7fc2980b7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:11.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.764+0000 7fc29ec93640 1 -- 172.21.15.7:0/4213284953 shutdown_connections 2024-04-25T09:56:11.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.764+0000 7fc29ec93640 1 -- 172.21.15.7:0/4213284953 wait complete. 2024-04-25T09:56:11.781 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:56:11.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.878+0000 7fc006942640 1 Processor -- start 2024-04-25T09:56:11.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.878+0000 7fc006942640 1 -- start start 2024-04-25T09:56:11.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.879+0000 7fc006942640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc00015dc10 0x7fc0001615f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:11.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.879+0000 7fc006942640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc0000d0950 0x7fc0000d27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:11.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.879+0000 7fc006942640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc000162040 con 0x7fc000161b30 2024-04-25T09:56:11.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.879+0000 7fc006942640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0000d1d90 con 0x7fc00015dc10 2024-04-25T09:56:11.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.879+0000 7fc006942640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc000162320 con 0x7fc0000d0950 2024-04-25T09:56:11.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.879+0000 7fbfff7fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc000161b30 0x7fc0000d0240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53652/0 (socket says 172.21.15.7:53652) 2024-04-25T09:56:11.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.879+0000 7fbfff7fe640 1 -- 172.21.15.7:0/1068809548 learned_addr learned my addr 172.21.15.7:0/1068809548 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:56:11.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.879+0000 7fbffffff640 1 --2- 172.21.15.7:0/1068809548 >> v2:172.21.15.55:3300/0 conn(0x7fc00015dc10 0x7fc0001615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:11.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.879+0000 7fc004edf640 1 --2- 172.21.15.7:0/1068809548 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc0000d0950 0x7fc0000d27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:11.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.880+0000 7fbffeffd640 1 -- 172.21.15.7:0/1068809548 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3285169671 0 0) 0x7fc000162040 con 0x7fc000161b30 2024-04-25T09:56:11.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.880+0000 7fbffeffd640 1 -- 172.21.15.7:0/1068809548 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfec003520 con 0x7fc000161b30 2024-04-25T09:56:11.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.880+0000 7fbffffff640 1 -- 172.21.15.7:0/1068809548 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc0000d0950 msgr2=0x7fc0000d27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:11.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.880+0000 7fbffffff640 1 --2- 172.21.15.7:0/1068809548 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc0000d0950 0x7fc0000d27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:11.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.880+0000 7fbffffff640 1 -- 172.21.15.7:0/1068809548 >> v1:172.21.15.7:6789/0 conn(0x7fc000161b30 legacy=0x7fc0000d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:11.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.880+0000 7fbffeffd640 1 -- 172.21.15.7:0/1068809548 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3455439175 0 0) 0x7fbfec003520 con 0x7fc000161b30 2024-04-25T09:56:11.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.880+0000 7fbffffff640 1 -- 172.21.15.7:0/1068809548 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0000d1fe0 con 0x7fc00015dc10 2024-04-25T09:56:11.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.881+0000 7fbffffff640 1 --2- 172.21.15.7:0/1068809548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc00015dc10 0x7fc0001615f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbfe80097a0 tx=0x7fbfe802a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ab2ee0ee78b2c6f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:11.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.881+0000 7fbffeffd640 1 -- 172.21.15.7:0/1068809548 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe8037070 con 0x7fc00015dc10 2024-04-25T09:56:11.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.881+0000 7fbffeffd640 1 -- 172.21.15.7:0/1068809548 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe802aa90 con 0x7fc00015dc10 2024-04-25T09:56:11.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.881+0000 7fbffeffd640 1 -- 172.21.15.7:0/1068809548 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff0001670 con 0x7fc00015dc10 2024-04-25T09:56:11.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.881+0000 7fc006942640 1 -- 172.21.15.7:0/1068809548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc00015dc10 msgr2=0x7fc0001615f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:11.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.881+0000 7fc006942640 1 --2- 172.21.15.7:0/1068809548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc00015dc10 0x7fc0001615f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbfe80097a0 tx=0x7fbfe802a000 comp rx=0 tx=0).stop 2024-04-25T09:56:11.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.881+0000 7fc006942640 1 -- 172.21.15.7:0/1068809548 shutdown_connections 2024-04-25T09:56:11.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.881+0000 7fc006942640 1 --2- 172.21.15.7:0/1068809548 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc0000d0950 0x7fc0000d27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:11.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.881+0000 7fc006942640 1 --2- 172.21.15.7:0/1068809548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc00015dc10 0x7fc0001615f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:11.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.881+0000 7fc006942640 1 -- 172.21.15.7:0/1068809548 >> 172.21.15.7:0/1068809548 conn(0x7fc000072290 msgr2=0x7fc0000726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:11.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.881+0000 7fc006942640 1 -- 172.21.15.7:0/1068809548 shutdown_connections 2024-04-25T09:56:11.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.881+0000 7fc006942640 1 -- 172.21.15.7:0/1068809548 wait complete. 2024-04-25T09:56:11.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.883+0000 7fc006942640 1 Processor -- start 2024-04-25T09:56:11.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.883+0000 7fc006942640 1 -- start start 2024-04-25T09:56:11.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.883+0000 7fc006942640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0000d0950 0x7fc0000c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:11.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.883+0000 7fc006942640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc00015dc10 0x7fc00014f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:11.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.883+0000 7fc006942640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc000161b30 0x7fc0001601c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:11.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.883+0000 7fc006942640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0000b6d10 con 0x7fc00015dc10 2024-04-25T09:56:11.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.883+0000 7fc006942640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0000b6b90 con 0x7fc0000d0950 2024-04-25T09:56:11.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.883+0000 7fc006942640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0000b6e90 con 0x7fc000161b30 2024-04-25T09:56:11.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.884+0000 7fbfff7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc00015dc10 0x7fc00014f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:11.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.884+0000 7fbfff7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc00015dc10 0x7fc00014f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58962/0 (socket says 172.21.15.7:58962) 2024-04-25T09:56:11.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.884+0000 7fbfff7fe640 1 -- 172.21.15.7:0/2846735707 learned_addr learned my addr 172.21.15.7:0/2846735707 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:11.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.884+0000 7fc004edf640 1 --2- 172.21.15.7:0/2846735707 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc000161b30 0x7fc0001601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:11.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.884+0000 7fbffffff640 1 --2- 172.21.15.7:0/2846735707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0000d0950 0x7fc0000c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:11.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.884+0000 7fbfff7fe640 1 -- 172.21.15.7:0/2846735707 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc000161b30 msgr2=0x7fc0001601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:11.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.884+0000 7fbfff7fe640 1 --2- 172.21.15.7:0/2846735707 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc000161b30 0x7fc0001601c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:11.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.884+0000 7fbfff7fe640 1 -- 172.21.15.7:0/2846735707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0000d0950 msgr2=0x7fc0000c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:11.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.884+0000 7fbfff7fe640 1 --2- 172.21.15.7:0/2846735707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0000d0950 0x7fc0000c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:11.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.884+0000 7fbfff7fe640 1 -- 172.21.15.7:0/2846735707 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0000c7e30 con 0x7fc00015dc10 2024-04-25T09:56:11.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.884+0000 7fbfff7fe640 1 --2- 172.21.15.7:0/2846735707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc00015dc10 0x7fc00014f690 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fbff000c5b0 tx=0x7fbff000ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:11.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.884+0000 7fbffcff9640 1 -- 172.21.15.7:0/2846735707 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff0017070 con 0x7fc00015dc10 2024-04-25T09:56:11.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.884+0000 7fbffcff9640 1 -- 172.21.15.7:0/2846735707 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff0005ce0 con 0x7fc00015dc10 2024-04-25T09:56:11.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.884+0000 7fc006942640 1 -- 172.21.15.7:0/2846735707 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0000c80d0 con 0x7fc00015dc10 2024-04-25T09:56:11.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.884+0000 7fbffcff9640 1 -- 172.21.15.7:0/2846735707 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff0007330 con 0x7fc00015dc10 2024-04-25T09:56:11.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.884+0000 7fc006942640 1 -- 172.21.15.7:0/2846735707 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0000c8690 con 0x7fc00015dc10 2024-04-25T09:56:11.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.885+0000 7fc006942640 1 -- 172.21.15.7:0/2846735707 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc000068fd0 con 0x7fc00015dc10 2024-04-25T09:56:11.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.886+0000 7fbffcff9640 1 -- 172.21.15.7:0/2846735707 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbff001a070 con 0x7fc00015dc10 2024-04-25T09:56:11.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.886+0000 7fbffcff9640 1 --2- 172.21.15.7:0/2846735707 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbfe006b4d0 0x7fbfe006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:11.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.886+0000 7fbffcff9640 1 -- 172.21.15.7:0/2846735707 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fbff0089360 con 0x7fc00015dc10 2024-04-25T09:56:11.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.886+0000 7fbffffff640 1 --2- 172.21.15.7:0/2846735707 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbfe006b4d0 0x7fbfe006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:11.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.887+0000 7fbffffff640 1 --2- 172.21.15.7:0/2846735707 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbfe006b4d0 0x7fbfe006d990 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8034000 tx=0x7fbfe802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:11.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:11.891+0000 7fbffcff9640 1 -- 172.21.15.7:0/2846735707 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbff0057d40 con 0x7fc00015dc10 2024-04-25T09:56:12.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.073+0000 7fc006942640 1 -- 172.21.15.7:0/2846735707 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0000cf360 con 0x7fc00015dc10 2024-04-25T09:56:12.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.074+0000 7fbffcff9640 1 -- 172.21.15.7:0/2846735707 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+13068 (secure 0 0 0) 0x7fbff005bde0 con 0x7fc00015dc10 2024-04-25T09:56:12.077 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:12.077 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":47,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:56:11.376533+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:56:12.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.076+0000 7fc006942640 1 -- 172.21.15.7:0/2846735707 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbfe006b4d0 msgr2=0x7fbfe006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:12.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.076+0000 7fc006942640 1 --2- 172.21.15.7:0/2846735707 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbfe006b4d0 0x7fbfe006d990 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8034000 tx=0x7fbfe802e000 comp rx=0 tx=0).stop 2024-04-25T09:56:12.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.076+0000 7fc006942640 1 -- 172.21.15.7:0/2846735707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc00015dc10 msgr2=0x7fc00014f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:12.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.076+0000 7fc006942640 1 --2- 172.21.15.7:0/2846735707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc00015dc10 0x7fc00014f690 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fbff000c5b0 tx=0x7fbff000ca70 comp rx=0 tx=0).stop 2024-04-25T09:56:12.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.076+0000 7fc006942640 1 -- 172.21.15.7:0/2846735707 shutdown_connections 2024-04-25T09:56:12.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.076+0000 7fc006942640 1 --2- 172.21.15.7:0/2846735707 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbfe006b4d0 0x7fbfe006d990 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:12.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.076+0000 7fc006942640 1 --2- 172.21.15.7:0/2846735707 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc000161b30 0x7fc0001601c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:12.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.076+0000 7fc006942640 1 --2- 172.21.15.7:0/2846735707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc00015dc10 0x7fc00014f690 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:12.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.076+0000 7fc006942640 1 --2- 172.21.15.7:0/2846735707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0000d0950 0x7fc0000c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:12.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.076+0000 7fc006942640 1 -- 172.21.15.7:0/2846735707 >> 172.21.15.7:0/2846735707 conn(0x7fc000072290 msgr2=0x7fc0000b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:12.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.076+0000 7fc006942640 1 -- 172.21.15.7:0/2846735707 shutdown_connections 2024-04-25T09:56:12.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.076+0000 7fc006942640 1 -- 172.21.15.7:0/2846735707 wait complete. 2024-04-25T09:56:12.090 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:56:12.091 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:56:12.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.191+0000 7f8a724bd640 1 Processor -- start 2024-04-25T09:56:12.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.191+0000 7f8a724bd640 1 -- start start 2024-04-25T09:56:12.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.192+0000 7f8a724bd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8a6c15dc60 0x7f8a6c0cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:12.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.192+0000 7f8a724bd640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a6c0caf00 con 0x7f8a6c06b270 2024-04-25T09:56:12.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.192+0000 7f8a724bd640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a6c0cb1e0 con 0x7f8a6c0cc760 2024-04-25T09:56:12.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.192+0000 7f8a724bd640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a6c0cb4c0 con 0x7f8a6c15dc60 2024-04-25T09:56:12.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.192+0000 7f8a70a5a640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f8a6c06b270 0x7f8a6c0cf8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53656/0 (socket says 172.21.15.7:53656) 2024-04-25T09:56:12.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.192+0000 7f8a70a5a640 1 -- 172.21.15.7:0/2510854901 learned_addr learned my addr 172.21.15.7:0/2510854901 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:56:12.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.193+0000 7f8a6bfff640 1 --2- 172.21.15.7:0/2510854901 >> v2:172.21.15.55:3300/0 conn(0x7f8a6c15dc60 0x7f8a6c0cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:12.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.193+0000 7f8a6affd640 1 -- 172.21.15.7:0/2510854901 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3732460829 0 0) 0x7f8a6c0caf00 con 0x7f8a6c06b270 2024-04-25T09:56:12.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.193+0000 7f8a6affd640 1 -- 172.21.15.7:0/2510854901 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a58003520 con 0x7f8a6c06b270 2024-04-25T09:56:12.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.193+0000 7f8a6affd640 1 -- 172.21.15.7:0/2510854901 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1214037931 0 0) 0x7f8a58003520 con 0x7f8a6c06b270 2024-04-25T09:56:12.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.193+0000 7f8a6affd640 1 -- 172.21.15.7:0/2510854901 >> v2:172.21.15.55:3300/0 conn(0x7f8a6c15dc60 msgr2=0x7f8a6c0cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:12.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.193+0000 7f8a6affd640 1 --2- 172.21.15.7:0/2510854901 >> v2:172.21.15.55:3300/0 conn(0x7f8a6c15dc60 0x7f8a6c0cbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:12.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.193+0000 7f8a6affd640 1 -- 172.21.15.7:0/2510854901 >> v1:172.21.15.55:6789/0 conn(0x7f8a6c0cc760 legacy=0x7f8a6c06ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:12.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.193+0000 7f8a6affd640 1 -- 172.21.15.7:0/2510854901 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6c0cb7a0 con 0x7f8a6c06b270 2024-04-25T09:56:12.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.193+0000 7f8a6affd640 1 -- 172.21.15.7:0/2510854901 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f8a640019f0 con 0x7f8a6c06b270 2024-04-25T09:56:12.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.193+0000 7f8a6affd640 1 -- 172.21.15.7:0/2510854901 >> v1:172.21.15.7:6789/0 conn(0x7f8a6c06b270 legacy=0x7f8a6c0cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:12.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.193+0000 7f8a6affd640 1 --2- 172.21.15.7:0/2510854901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a580039b0 0x7f8a58003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:12.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.193+0000 7f8a6affd640 1 --2- 172.21.15.7:0/2510854901 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8a58004800 0x7f8a58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:12.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.193+0000 7f8a6affd640 1 --2- 172.21.15.7:0/2510854901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a580051c0 0x7f8a5800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:12.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.193+0000 7f8a6affd640 1 -- 172.21.15.7:0/2510854901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c0cb4c0 con 0x7f8a580039b0 2024-04-25T09:56:12.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.193+0000 7f8a6affd640 1 -- 172.21.15.7:0/2510854901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5800c060 con 0x7f8a580051c0 2024-04-25T09:56:12.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.193+0000 7f8a6affd640 1 -- 172.21.15.7:0/2510854901 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5800c260 con 0x7f8a58004800 2024-04-25T09:56:12.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.193+0000 7f8a6bfff640 1 --2- 172.21.15.7:0/2510854901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a580039b0 0x7f8a58003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:12.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.193+0000 7f8a70a5a640 1 --2- 172.21.15.7:0/2510854901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a580051c0 0x7f8a5800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:12.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.193+0000 7f8a6b7fe640 1 --2- 172.21.15.7:0/2510854901 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8a58004800 0x7f8a58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:12.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.193+0000 7f8a6bfff640 1 -- 172.21.15.7:0/2510854901 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8a58004800 msgr2=0x7f8a58004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:12.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.193+0000 7f8a6bfff640 1 --2- 172.21.15.7:0/2510854901 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8a58004800 0x7f8a58004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:12.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.193+0000 7f8a6bfff640 1 -- 172.21.15.7:0/2510854901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a580051c0 msgr2=0x7f8a5800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:12.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.193+0000 7f8a6bfff640 1 --2- 172.21.15.7:0/2510854901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a580051c0 0x7f8a5800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:12.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.193+0000 7f8a6bfff640 1 -- 172.21.15.7:0/2510854901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a58003520 con 0x7f8a580039b0 2024-04-25T09:56:12.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.193+0000 7f8a70a5a640 1 --2- 172.21.15.7:0/2510854901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a580051c0 0x7f8a5800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:12.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.193+0000 7f8a6b7fe640 1 --2- 172.21.15.7:0/2510854901 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8a58004800 0x7f8a58004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:56:12.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.193+0000 7f8a70a5a640 1 -- 172.21.15.7:0/2510854901 reap_dead start 2024-04-25T09:56:12.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.194+0000 7f8a6bfff640 1 --2- 172.21.15.7:0/2510854901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a580039b0 0x7f8a58003dd0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c009ac0 tx=0x7f8a58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07e347fb95bc14b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:12.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.194+0000 7f8a6affd640 1 -- 172.21.15.7:0/2510854901 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c036070 con 0x7f8a580039b0 2024-04-25T09:56:12.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.194+0000 7f8a6affd640 1 -- 172.21.15.7:0/2510854901 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5c031400 con 0x7f8a580039b0 2024-04-25T09:56:12.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.194+0000 7f8a6affd640 1 -- 172.21.15.7:0/2510854901 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c009690 con 0x7f8a580039b0 2024-04-25T09:56:12.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.195+0000 7f8a724bd640 1 -- 172.21.15.7:0/2510854901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a580039b0 msgr2=0x7f8a58003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:12.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.195+0000 7f8a724bd640 1 --2- 172.21.15.7:0/2510854901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a580039b0 0x7f8a58003dd0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c009ac0 tx=0x7f8a58005830 comp rx=0 tx=0).stop 2024-04-25T09:56:12.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.195+0000 7f8a724bd640 1 -- 172.21.15.7:0/2510854901 shutdown_connections 2024-04-25T09:56:12.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.195+0000 7f8a724bd640 1 --2- 172.21.15.7:0/2510854901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a580039b0 0x7f8a58003dd0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:12.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.195+0000 7f8a724bd640 1 -- 172.21.15.7:0/2510854901 >> 172.21.15.7:0/2510854901 conn(0x7f8a6c0725e0 msgr2=0x7f8a6c0999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:12.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.195+0000 7f8a724bd640 1 -- 172.21.15.7:0/2510854901 shutdown_connections 2024-04-25T09:56:12.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.195+0000 7f8a724bd640 1 -- 172.21.15.7:0/2510854901 wait complete. 2024-04-25T09:56:12.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.196+0000 7f8a724bd640 1 Processor -- start 2024-04-25T09:56:12.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.196+0000 7f8a724bd640 1 -- start start 2024-04-25T09:56:12.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.197+0000 7f8a724bd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a580039b0 0x7f8a6c14fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:12.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.197+0000 7f8a724bd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8a6c1e8340 0x7f8a6c1e87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:12.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.197+0000 7f8a724bd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a6c15e040 0x7f8a6c15e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:12.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.197+0000 7f8a724bd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c0ce150 con 0x7f8a580039b0 2024-04-25T09:56:12.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.197+0000 7f8a724bd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c0cabd0 con 0x7f8a6c15e040 2024-04-25T09:56:12.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.197+0000 7f8a724bd640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c0ce2d0 con 0x7f8a6c1e8340 2024-04-25T09:56:12.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.197+0000 7f8a6bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a580039b0 0x7f8a6c14fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:12.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.197+0000 7f8a6bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a580039b0 0x7f8a6c14fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58972/0 (socket says 172.21.15.7:58972) 2024-04-25T09:56:12.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.197+0000 7f8a6bfff640 1 -- 172.21.15.7:0/2503635229 learned_addr learned my addr 172.21.15.7:0/2503635229 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:12.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.197+0000 7f8a6bfff640 1 -- 172.21.15.7:0/2503635229 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8a6c1e8340 msgr2=0x7f8a6c1e87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:12.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.197+0000 7f8a6bfff640 1 --2- 172.21.15.7:0/2503635229 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8a6c1e8340 0x7f8a6c1e87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:12.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.197+0000 7f8a6bfff640 1 -- 172.21.15.7:0/2503635229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a6c15e040 msgr2=0x7f8a6c15e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:12.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.197+0000 7f8a6bfff640 1 --2- 172.21.15.7:0/2503635229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a6c15e040 0x7f8a6c15e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:12.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.197+0000 7f8a6bfff640 1 -- 172.21.15.7:0/2503635229 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6c150070 con 0x7f8a580039b0 2024-04-25T09:56:12.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.197+0000 7f8a6bfff640 1 --2- 172.21.15.7:0/2503635229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a580039b0 0x7f8a6c14fb30 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c034040 tx=0x7f8a5c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:12.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.198+0000 7f8a68ff9640 1 -- 172.21.15.7:0/2503635229 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c03f020 con 0x7f8a580039b0 2024-04-25T09:56:12.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.198+0000 7f8a68ff9640 1 -- 172.21.15.7:0/2503635229 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5c037040 con 0x7f8a580039b0 2024-04-25T09:56:12.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.198+0000 7f8a724bd640 1 -- 172.21.15.7:0/2503635229 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a6c1e8e70 con 0x7f8a580039b0 2024-04-25T09:56:12.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.198+0000 7f8a68ff9640 1 -- 172.21.15.7:0/2503635229 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c036070 con 0x7f8a580039b0 2024-04-25T09:56:12.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.198+0000 7f8a724bd640 1 -- 172.21.15.7:0/2503635229 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a6c0b4100 con 0x7f8a580039b0 2024-04-25T09:56:12.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.199+0000 7f8a724bd640 1 -- 172.21.15.7:0/2503635229 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a6c0cf1c0 con 0x7f8a580039b0 2024-04-25T09:56:12.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.199+0000 7f8a68ff9640 1 -- 172.21.15.7:0/2503635229 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8a5c042020 con 0x7f8a580039b0 2024-04-25T09:56:12.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.199+0000 7f8a68ff9640 1 --2- 172.21.15.7:0/2503635229 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8a4c06b500 0x7f8a4c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:12.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.200+0000 7f8a68ff9640 1 -- 172.21.15.7:0/2503635229 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f8a5c0a9d80 con 0x7f8a580039b0 2024-04-25T09:56:12.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.200+0000 7f8a6b7fe640 1 --2- 172.21.15.7:0/2503635229 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8a4c06b500 0x7f8a4c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:12.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.200+0000 7f8a6b7fe640 1 --2- 172.21.15.7:0/2503635229 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8a4c06b500 0x7f8a4c06d9c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c156d70 tx=0x7f8a54009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:12.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.204+0000 7f8a68ff9640 1 -- 172.21.15.7:0/2503635229 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8a6c0cf1c0 con 0x7f8a580039b0 2024-04-25T09:56:12.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.383+0000 7f8a724bd640 1 -- 172.21.15.7:0/2503635229 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8a6c068f60 con 0x7f8a580039b0 2024-04-25T09:56:12.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.383+0000 7f8a68ff9640 1 -- 172.21.15.7:0/2503635229 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8a5c049070 con 0x7f8a580039b0 2024-04-25T09:56:12.386 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T09:56:12.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.385+0000 7f8a724bd640 1 -- 172.21.15.7:0/2503635229 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8a4c06b500 msgr2=0x7f8a4c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:12.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.385+0000 7f8a724bd640 1 --2- 172.21.15.7:0/2503635229 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8a4c06b500 0x7f8a4c06d9c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c156d70 tx=0x7f8a54009040 comp rx=0 tx=0).stop 2024-04-25T09:56:12.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.385+0000 7f8a724bd640 1 -- 172.21.15.7:0/2503635229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a580039b0 msgr2=0x7f8a6c14fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:12.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.385+0000 7f8a724bd640 1 --2- 172.21.15.7:0/2503635229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a580039b0 0x7f8a6c14fb30 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c034040 tx=0x7f8a5c004730 comp rx=0 tx=0).stop 2024-04-25T09:56:12.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.385+0000 7f8a724bd640 1 -- 172.21.15.7:0/2503635229 shutdown_connections 2024-04-25T09:56:12.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.385+0000 7f8a724bd640 1 --2- 172.21.15.7:0/2503635229 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8a4c06b500 0x7f8a4c06d9c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:12.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.385+0000 7f8a724bd640 1 --2- 172.21.15.7:0/2503635229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a6c15e040 0x7f8a6c15e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:12.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.385+0000 7f8a724bd640 1 --2- 172.21.15.7:0/2503635229 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8a6c1e8340 0x7f8a6c1e87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:12.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.385+0000 7f8a724bd640 1 --2- 172.21.15.7:0/2503635229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a580039b0 0x7f8a6c14fb30 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:12.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.385+0000 7f8a724bd640 1 -- 172.21.15.7:0/2503635229 >> 172.21.15.7:0/2503635229 conn(0x7f8a6c0725e0 msgr2=0x7f8a6c06ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:12.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.385+0000 7f8a724bd640 1 -- 172.21.15.7:0/2503635229 shutdown_connections 2024-04-25T09:56:12.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.385+0000 7f8a724bd640 1 -- 172.21.15.7:0/2503635229 wait complete. 2024-04-25T09:56:12.399 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:56:12.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.497+0000 7fdd2d949640 1 Processor -- start 2024-04-25T09:56:12.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.497+0000 7fdd2d949640 1 -- start start 2024-04-25T09:56:12.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.497+0000 7fdd2d949640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdd2815dd00 0x7fdd280b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:12.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.497+0000 7fdd2d949640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd2806c6c0 0x7fdd280b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:12.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.497+0000 7fdd2d949640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd2806cd00 con 0x7fdd280b6a40 2024-04-25T09:56:12.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.497+0000 7fdd2d949640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd2815e0e0 con 0x7fdd2815dd00 2024-04-25T09:56:12.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.497+0000 7fdd2d949640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2806cfe0 con 0x7fdd2806c6c0 2024-04-25T09:56:12.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.498+0000 7fdd26ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdd2815dd00 0x7fdd280b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:12.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.498+0000 7fdd277fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd2806c6c0 0x7fdd280b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:12.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.498+0000 7fdd267fc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdd280b6a40 0x7fdd2806bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:36132/0 (socket says 172.21.15.7:36132) 2024-04-25T09:56:12.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.498+0000 7fdd267fc640 1 -- 172.21.15.7:0/2616208119 learned_addr learned my addr 172.21.15.7:0/2616208119 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:56:12.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.498+0000 7fdd25ffb640 1 -- 172.21.15.7:0/2616208119 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3943986893 0 0) 0x7fdd2806cd00 con 0x7fdd280b6a40 2024-04-25T09:56:12.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.498+0000 7fdd25ffb640 1 -- 172.21.15.7:0/2616208119 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd14003520 con 0x7fdd280b6a40 2024-04-25T09:56:12.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.498+0000 7fdd277fe640 1 -- 172.21.15.7:0/2616208119 >> v2:172.21.15.55:3300/0 conn(0x7fdd2815dd00 msgr2=0x7fdd280b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:12.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.498+0000 7fdd277fe640 1 --2- 172.21.15.7:0/2616208119 >> v2:172.21.15.55:3300/0 conn(0x7fdd2815dd00 0x7fdd280b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:12.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.498+0000 7fdd277fe640 1 -- 172.21.15.7:0/2616208119 >> v1:172.21.15.55:6789/0 conn(0x7fdd280b6a40 legacy=0x7fdd2806bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:12.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.498+0000 7fdd277fe640 1 -- 172.21.15.7:0/2616208119 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd280d1ca0 con 0x7fdd2806c6c0 2024-04-25T09:56:12.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.498+0000 7fdd26ffd640 1 --2- 172.21.15.7:0/2616208119 >> v2:172.21.15.55:3300/0 conn(0x7fdd2815dd00 0x7fdd280b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:56:12.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.499+0000 7fdd277fe640 1 --2- 172.21.15.7:0/2616208119 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd2806c6c0 0x7fdd280b5c90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdd200097a0 tx=0x7fdd2002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26728b59ba6bbf1b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:12.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.499+0000 7fdd25ffb640 1 -- 172.21.15.7:0/2616208119 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd20037070 con 0x7fdd2806c6c0 2024-04-25T09:56:12.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.499+0000 7fdd25ffb640 1 -- 172.21.15.7:0/2616208119 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd20032440 con 0x7fdd2806c6c0 2024-04-25T09:56:12.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.499+0000 7fdd25ffb640 1 -- 172.21.15.7:0/2616208119 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd20032810 con 0x7fdd2806c6c0 2024-04-25T09:56:12.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.500+0000 7fdd2d949640 1 -- 172.21.15.7:0/2616208119 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd2806c6c0 msgr2=0x7fdd280b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:12.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.500+0000 7fdd2d949640 1 --2- 172.21.15.7:0/2616208119 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd2806c6c0 0x7fdd280b5c90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdd200097a0 tx=0x7fdd2002a210 comp rx=0 tx=0).stop 2024-04-25T09:56:12.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.500+0000 7fdd2d949640 1 -- 172.21.15.7:0/2616208119 shutdown_connections 2024-04-25T09:56:12.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.500+0000 7fdd2d949640 1 --2- 172.21.15.7:0/2616208119 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd2806c6c0 0x7fdd280b5c90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:12.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.500+0000 7fdd2d949640 1 --2- 172.21.15.7:0/2616208119 >> v2:172.21.15.55:3300/0 conn(0x7fdd2815dd00 0x7fdd280b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:12.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.500+0000 7fdd2d949640 1 -- 172.21.15.7:0/2616208119 >> 172.21.15.7:0/2616208119 conn(0x7fdd280d07b0 msgr2=0x7fdd280d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:12.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.500+0000 7fdd2d949640 1 -- 172.21.15.7:0/2616208119 shutdown_connections 2024-04-25T09:56:12.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.500+0000 7fdd2d949640 1 -- 172.21.15.7:0/2616208119 wait complete. 2024-04-25T09:56:12.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.501+0000 7fdd2d949640 1 Processor -- start 2024-04-25T09:56:12.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.501+0000 7fdd2d949640 1 -- start start 2024-04-25T09:56:12.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.502+0000 7fdd2d949640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd2806c6c0 0x7fdd28157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:12.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.502+0000 7fdd2d949640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd280b6a40 0x7fdd281593f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:12.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.502+0000 7fdd2d949640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd2815dd00 0x7fdd280c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:12.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.502+0000 7fdd2d949640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd280d2780 con 0x7fdd280b6a40 2024-04-25T09:56:12.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.502+0000 7fdd2d949640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd280d2260 con 0x7fdd2806c6c0 2024-04-25T09:56:12.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.502+0000 7fdd2d949640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd280d2900 con 0x7fdd2815dd00 2024-04-25T09:56:12.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.502+0000 7fdd267fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd280b6a40 0x7fdd281593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:12.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.502+0000 7fdd267fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd280b6a40 0x7fdd281593f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58976/0 (socket says 172.21.15.7:58976) 2024-04-25T09:56:12.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.502+0000 7fdd267fc640 1 -- 172.21.15.7:0/231460771 learned_addr learned my addr 172.21.15.7:0/231460771 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:12.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.502+0000 7fdd277fe640 1 --2- 172.21.15.7:0/231460771 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd2815dd00 0x7fdd280c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:12.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.502+0000 7fdd26ffd640 1 --2- 172.21.15.7:0/231460771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd2806c6c0 0x7fdd28157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:12.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.502+0000 7fdd267fc640 1 -- 172.21.15.7:0/231460771 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd2815dd00 msgr2=0x7fdd280c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:12.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.502+0000 7fdd267fc640 1 --2- 172.21.15.7:0/231460771 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd2815dd00 0x7fdd280c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:12.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.502+0000 7fdd267fc640 1 -- 172.21.15.7:0/231460771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd2806c6c0 msgr2=0x7fdd28157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:12.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.502+0000 7fdd267fc640 1 --2- 172.21.15.7:0/231460771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd2806c6c0 0x7fdd28157d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:12.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.502+0000 7fdd267fc640 1 -- 172.21.15.7:0/231460771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd280c9c80 con 0x7fdd280b6a40 2024-04-25T09:56:12.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.502+0000 7fdd267fc640 1 --2- 172.21.15.7:0/231460771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd280b6a40 0x7fdd281593f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fdd1000c430 tx=0x7fdd1000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:12.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.503+0000 7fdd1ffff640 1 -- 172.21.15.7:0/231460771 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd10017070 con 0x7fdd280b6a40 2024-04-25T09:56:12.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.503+0000 7fdd1ffff640 1 -- 172.21.15.7:0/231460771 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd10005ce0 con 0x7fdd280b6a40 2024-04-25T09:56:12.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.503+0000 7fdd1ffff640 1 -- 172.21.15.7:0/231460771 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd100072f0 con 0x7fdd280b6a40 2024-04-25T09:56:12.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.503+0000 7fdd2d949640 1 -- 172.21.15.7:0/231460771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd28158350 con 0x7fdd280b6a40 2024-04-25T09:56:12.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.503+0000 7fdd2d949640 1 -- 172.21.15.7:0/231460771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd28158910 con 0x7fdd280b6a40 2024-04-25T09:56:12.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.504+0000 7fdd2d949640 1 -- 172.21.15.7:0/231460771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd28068fd0 con 0x7fdd280b6a40 2024-04-25T09:56:12.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.504+0000 7fdd1ffff640 1 -- 172.21.15.7:0/231460771 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdd1001a070 con 0x7fdd280b6a40 2024-04-25T09:56:12.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.505+0000 7fdd1ffff640 1 --2- 172.21.15.7:0/231460771 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdd0806b4d0 0x7fdd0806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:12.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.505+0000 7fdd1ffff640 1 -- 172.21.15.7:0/231460771 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fdd100894f0 con 0x7fdd280b6a40 2024-04-25T09:56:12.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.505+0000 7fdd26ffd640 1 --2- 172.21.15.7:0/231460771 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdd0806b4d0 0x7fdd0806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:12.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.505+0000 7fdd26ffd640 1 --2- 172.21.15.7:0/231460771 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdd0806b4d0 0x7fdd0806d990 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fdd18009fd0 tx=0x7fdd1800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:12.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.509+0000 7fdd1ffff640 1 -- 172.21.15.7:0/231460771 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdd10058530 con 0x7fdd280b6a40 2024-04-25T09:56:12.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.691+0000 7fdd2d949640 1 -- 172.21.15.7:0/231460771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdd28153bb0 con 0x7fdd280b6a40 2024-04-25T09:56:12.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.692+0000 7fdd1ffff640 1 -- 172.21.15.7:0/231460771 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v47) v1 ==== 84+0+65 (secure 0 0 0) 0x7fdd10057e30 con 0x7fdd280b6a40 2024-04-25T09:56:12.695 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:12.695 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2024-04-25T09:56:12.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:56:12.695 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2024-04-25T09:56:12.695 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2024-04-25T09:56:12.696 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:56:12.696 INFO:teuthology.orchestra.run.smithi007.stdout:] 2024-04-25T09:56:12.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.694+0000 7fdd2d949640 1 -- 172.21.15.7:0/231460771 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdd0806b4d0 msgr2=0x7fdd0806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:12.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.694+0000 7fdd2d949640 1 --2- 172.21.15.7:0/231460771 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdd0806b4d0 0x7fdd0806d990 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fdd18009fd0 tx=0x7fdd1800b040 comp rx=0 tx=0).stop 2024-04-25T09:56:12.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.694+0000 7fdd2d949640 1 -- 172.21.15.7:0/231460771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd280b6a40 msgr2=0x7fdd281593f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:12.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.694+0000 7fdd2d949640 1 --2- 172.21.15.7:0/231460771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd280b6a40 0x7fdd281593f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fdd1000c430 tx=0x7fdd1000c8f0 comp rx=0 tx=0).stop 2024-04-25T09:56:12.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.694+0000 7fdd2d949640 1 -- 172.21.15.7:0/231460771 shutdown_connections 2024-04-25T09:56:12.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.694+0000 7fdd2d949640 1 --2- 172.21.15.7:0/231460771 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdd0806b4d0 0x7fdd0806d990 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:12.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.694+0000 7fdd2d949640 1 --2- 172.21.15.7:0/231460771 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd2815dd00 0x7fdd280c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:12.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.694+0000 7fdd2d949640 1 --2- 172.21.15.7:0/231460771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd280b6a40 0x7fdd281593f0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:12.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.694+0000 7fdd2d949640 1 --2- 172.21.15.7:0/231460771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd2806c6c0 0x7fdd28157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:12.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.694+0000 7fdd2d949640 1 -- 172.21.15.7:0/231460771 >> 172.21.15.7:0/231460771 conn(0x7fdd280d07b0 msgr2=0x7fdd2815bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:12.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.694+0000 7fdd2d949640 1 -- 172.21.15.7:0/231460771 shutdown_connections 2024-04-25T09:56:12.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.694+0000 7fdd2d949640 1 -- 172.21.15.7:0/231460771 wait complete. 2024-04-25T09:56:12.707 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:56:12.708 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:56:12.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.809+0000 7f4630f90640 1 Processor -- start 2024-04-25T09:56:12.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.809+0000 7f4630f90640 1 -- start start 2024-04-25T09:56:12.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.810+0000 7f4630f90640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f462c15deb0 0x7f462c0cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:12.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.810+0000 7f4630f90640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f462c0d0010 con 0x7f462c0cad70 2024-04-25T09:56:12.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.810+0000 7f4630f90640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f462c0d02b0 con 0x7f462c0cb220 2024-04-25T09:56:12.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.810+0000 7f4630f90640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f462c0cc9b0 con 0x7f462c15deb0 2024-04-25T09:56:12.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.810+0000 7f462a59c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f462c15deb0 0x7f462c0cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:12.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.810+0000 7f4629d9b640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f462c0cad70 0x7f462c0cd6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53666/0 (socket says 172.21.15.7:53666) 2024-04-25T09:56:12.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.810+0000 7f4629d9b640 1 -- 172.21.15.7:0/2722503361 learned_addr learned my addr 172.21.15.7:0/2722503361 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:56:12.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.811+0000 7f462a59c640 1 -- 172.21.15.7:0/2722503361 >> v1:172.21.15.55:6789/0 conn(0x7f462c0cb220 legacy=0x7f462c0b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:12.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.811+0000 7f462a59c640 1 -- 172.21.15.7:0/2722503361 >> v1:172.21.15.7:6789/0 conn(0x7f462c0cad70 legacy=0x7f462c0cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:12.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.811+0000 7f462a59c640 1 -- 172.21.15.7:0/2722503361 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462c0ccc00 con 0x7f462c15deb0 2024-04-25T09:56:12.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.811+0000 7f462959a640 1 -- 172.21.15.7:0/2722503361 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1332397518 0 0) 0x7f462c0d0010 con 0x7f462c0cad70 2024-04-25T09:56:12.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.811+0000 7f462a59c640 1 --2- 172.21.15.7:0/2722503361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f462c15deb0 0x7f462c0cfad0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f46240097a0 tx=0x7f462402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238f4c889b96a0bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:12.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.812+0000 7f462959a640 1 -- 172.21.15.7:0/2722503361 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4624037070 con 0x7f462c15deb0 2024-04-25T09:56:12.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.812+0000 7f462959a640 1 -- 172.21.15.7:0/2722503361 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4624032440 con 0x7f462c15deb0 2024-04-25T09:56:12.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.812+0000 7f462959a640 1 -- 172.21.15.7:0/2722503361 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4624032810 con 0x7f462c15deb0 2024-04-25T09:56:12.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.812+0000 7f4630f90640 1 -- 172.21.15.7:0/2722503361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f462c15deb0 msgr2=0x7f462c0cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:12.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.812+0000 7f4630f90640 1 --2- 172.21.15.7:0/2722503361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f462c15deb0 0x7f462c0cfad0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f46240097a0 tx=0x7f462402a230 comp rx=0 tx=0).stop 2024-04-25T09:56:12.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.812+0000 7f4630f90640 1 -- 172.21.15.7:0/2722503361 shutdown_connections 2024-04-25T09:56:12.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.812+0000 7f4630f90640 1 --2- 172.21.15.7:0/2722503361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f462c15deb0 0x7f462c0cfad0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:12.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.812+0000 7f4630f90640 1 -- 172.21.15.7:0/2722503361 >> 172.21.15.7:0/2722503361 conn(0x7f462c0999f0 msgr2=0x7f462c0b22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:12.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.812+0000 7f4630f90640 1 -- 172.21.15.7:0/2722503361 shutdown_connections 2024-04-25T09:56:12.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.812+0000 7f4630f90640 1 -- 172.21.15.7:0/2722503361 wait complete. 2024-04-25T09:56:12.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.814+0000 7f4630f90640 1 Processor -- start 2024-04-25T09:56:12.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.814+0000 7f4630f90640 1 -- start start 2024-04-25T09:56:12.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.814+0000 7f4630f90640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f462c0cad70 0x7f462c0ad710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:12.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.814+0000 7f4630f90640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f462c0cb220 0x7f462c0adc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:12.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.814+0000 7f4630f90640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f462c15deb0 0x7f462c0afa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:12.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.814+0000 7f4630f90640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462c0cddf0 con 0x7f462c0cb220 2024-04-25T09:56:12.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.814+0000 7f4630f90640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462c0ce590 con 0x7f462c15deb0 2024-04-25T09:56:12.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.814+0000 7f4630f90640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462c0cdf70 con 0x7f462c0cad70 2024-04-25T09:56:12.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.814+0000 7f4629d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f462c0cb220 0x7f462c0adc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:12.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.814+0000 7f4629d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f462c0cb220 0x7f462c0adc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58996/0 (socket says 172.21.15.7:58996) 2024-04-25T09:56:12.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.814+0000 7f4629d9b640 1 -- 172.21.15.7:0/3622786335 learned_addr learned my addr 172.21.15.7:0/3622786335 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:12.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.815+0000 7f462a59c640 1 --2- 172.21.15.7:0/3622786335 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f462c0cad70 0x7f462c0ad710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:12.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.815+0000 7f462ad9d640 1 --2- 172.21.15.7:0/3622786335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f462c15deb0 0x7f462c0afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:12.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.815+0000 7f4629d9b640 1 -- 172.21.15.7:0/3622786335 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f462c0cad70 msgr2=0x7f462c0ad710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:12.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.815+0000 7f4629d9b640 1 --2- 172.21.15.7:0/3622786335 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f462c0cad70 0x7f462c0ad710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:12.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.815+0000 7f4629d9b640 1 -- 172.21.15.7:0/3622786335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f462c15deb0 msgr2=0x7f462c0afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:12.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.815+0000 7f4629d9b640 1 --2- 172.21.15.7:0/3622786335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f462c15deb0 0x7f462c0afa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:12.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.815+0000 7f4629d9b640 1 -- 172.21.15.7:0/3622786335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462c0ae4a0 con 0x7f462c0cb220 2024-04-25T09:56:12.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.815+0000 7f462ad9d640 1 --2- 172.21.15.7:0/3622786335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f462c15deb0 0x7f462c0afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:12.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.815+0000 7f4629d9b640 1 --2- 172.21.15.7:0/3622786335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f462c0cb220 0x7f462c0adc50 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f461400c3f0 tx=0x7f461400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:12.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.815+0000 7f4622ffd640 1 -- 172.21.15.7:0/3622786335 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4614017070 con 0x7f462c0cb220 2024-04-25T09:56:12.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.815+0000 7f4622ffd640 1 -- 172.21.15.7:0/3622786335 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4614005ce0 con 0x7f462c0cb220 2024-04-25T09:56:12.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.815+0000 7f4630f90640 1 -- 172.21.15.7:0/3622786335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f462c0ae780 con 0x7f462c0cb220 2024-04-25T09:56:12.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.815+0000 7f4622ffd640 1 -- 172.21.15.7:0/3622786335 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4614007310 con 0x7f462c0cb220 2024-04-25T09:56:12.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.815+0000 7f4630f90640 1 -- 172.21.15.7:0/3622786335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f462c0aed40 con 0x7f462c0cb220 2024-04-25T09:56:12.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.816+0000 7f4630f90640 1 -- 172.21.15.7:0/3622786335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f462c069040 con 0x7f462c0cb220 2024-04-25T09:56:12.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.817+0000 7f4622ffd640 1 -- 172.21.15.7:0/3622786335 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f461401a070 con 0x7f462c0cb220 2024-04-25T09:56:12.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.817+0000 7f4622ffd640 1 --2- 172.21.15.7:0/3622786335 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f460c06b4d0 0x7f460c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:12.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.817+0000 7f4622ffd640 1 -- 172.21.15.7:0/3622786335 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f46140894d0 con 0x7f462c0cb220 2024-04-25T09:56:12.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.817+0000 7f462a59c640 1 --2- 172.21.15.7:0/3622786335 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f460c06b4d0 0x7f460c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:12.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.817+0000 7f462a59c640 1 --2- 172.21.15.7:0/3622786335 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f460c06b4d0 0x7f460c06d990 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4624034000 tx=0x7f462402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:12.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:12.821+0000 7f4622ffd640 1 -- 172.21.15.7:0/3622786335 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4614058490 con 0x7f462c0cb220 2024-04-25T09:56:13.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.000+0000 7f4630f90640 1 -- 172.21.15.7:0/3622786335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f462c0cd930 con 0x7f462c0cb220 2024-04-25T09:56:13.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.380+0000 7f4622ffd640 1 -- 172.21.15.7:0/3622786335 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v48) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4614057d90 con 0x7f462c0cb220 2024-04-25T09:56:13.383 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2024-04-25T09:56:13.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.383+0000 7f4630f90640 1 -- 172.21.15.7:0/3622786335 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f460c06b4d0 msgr2=0x7f460c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:13.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.383+0000 7f4630f90640 1 --2- 172.21.15.7:0/3622786335 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f460c06b4d0 0x7f460c06d990 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4624034000 tx=0x7f462402e000 comp rx=0 tx=0).stop 2024-04-25T09:56:13.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.383+0000 7f4630f90640 1 -- 172.21.15.7:0/3622786335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f462c0cb220 msgr2=0x7f462c0adc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:13.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.383+0000 7f4630f90640 1 --2- 172.21.15.7:0/3622786335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f462c0cb220 0x7f462c0adc50 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f461400c3f0 tx=0x7f461400c8b0 comp rx=0 tx=0).stop 2024-04-25T09:56:13.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.383+0000 7f4630f90640 1 -- 172.21.15.7:0/3622786335 shutdown_connections 2024-04-25T09:56:13.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.383+0000 7f4630f90640 1 --2- 172.21.15.7:0/3622786335 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f460c06b4d0 0x7f460c06d990 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.383+0000 7f4630f90640 1 --2- 172.21.15.7:0/3622786335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f462c15deb0 0x7f462c0afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.383+0000 7f4630f90640 1 --2- 172.21.15.7:0/3622786335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f462c0cb220 0x7f462c0adc50 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.383+0000 7f4630f90640 1 --2- 172.21.15.7:0/3622786335 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f462c0cad70 0x7f462c0ad710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.384+0000 7f4630f90640 1 -- 172.21.15.7:0/3622786335 >> 172.21.15.7:0/3622786335 conn(0x7f462c0999f0 msgr2=0x7f462c0cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.384+0000 7f4630f90640 1 -- 172.21.15.7:0/3622786335 shutdown_connections 2024-04-25T09:56:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.384+0000 7f4630f90640 1 -- 172.21.15.7:0/3622786335 wait complete. 2024-04-25T09:56:13.401 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:56:13.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.508+0000 7face265d640 1 Processor -- start 2024-04-25T09:56:13.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.508+0000 7face265d640 1 -- start start 2024-04-25T09:56:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.509+0000 7face265d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7facdc06ab60 0x7facdc06fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.509+0000 7face265d640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facdc0700f0 con 0x7facdc06f7d0 2024-04-25T09:56:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.509+0000 7face265d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facdc06b0d0 con 0x7facdc0b2950 2024-04-25T09:56:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.509+0000 7face265d640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facdc161c10 con 0x7facdc06ab60 2024-04-25T09:56:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.509+0000 7facdb7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7facdc06ab60 0x7facdc06fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.509+0000 7facdbfff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7facdc06f7d0 0x7facdc1620a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53678/0 (socket says 172.21.15.7:53678) 2024-04-25T09:56:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.509+0000 7facdbfff640 1 -- 172.21.15.7:0/2147943869 learned_addr learned my addr 172.21.15.7:0/2147943869 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:56:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.509+0000 7facdb7fe640 1 -- 172.21.15.7:0/2147943869 >> v1:172.21.15.55:6789/0 conn(0x7facdc0b2950 legacy=0x7facdc15d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.509+0000 7facdb7fe640 1 -- 172.21.15.7:0/2147943869 >> v1:172.21.15.7:6789/0 conn(0x7facdc06f7d0 legacy=0x7facdc1620a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.509+0000 7facdaffd640 1 -- 172.21.15.7:0/2147943869 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1395385281 0 0) 0x7facdc0700f0 con 0x7facdc06f7d0 2024-04-25T09:56:13.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.509+0000 7facdb7fe640 1 -- 172.21.15.7:0/2147943869 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facdc06b3b0 con 0x7facdc06ab60 2024-04-25T09:56:13.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.510+0000 7facdb7fe640 1 --2- 172.21.15.7:0/2147943869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facdc06ab60 0x7facdc06fbb0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7faccc0097a0 tx=0x7faccc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f470220509d63150 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:13.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.510+0000 7facdaffd640 1 -- 172.21.15.7:0/2147943869 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc037070 con 0x7facdc06ab60 2024-04-25T09:56:13.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.510+0000 7facdaffd640 1 -- 172.21.15.7:0/2147943869 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faccc032440 con 0x7facdc06ab60 2024-04-25T09:56:13.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.510+0000 7facdaffd640 1 -- 172.21.15.7:0/2147943869 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc032810 con 0x7facdc06ab60 2024-04-25T09:56:13.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.511+0000 7face265d640 1 -- 172.21.15.7:0/2147943869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facdc06ab60 msgr2=0x7facdc06fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:13.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.511+0000 7face265d640 1 --2- 172.21.15.7:0/2147943869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facdc06ab60 0x7facdc06fbb0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7faccc0097a0 tx=0x7faccc02a270 comp rx=0 tx=0).stop 2024-04-25T09:56:13.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.511+0000 7face265d640 1 -- 172.21.15.7:0/2147943869 shutdown_connections 2024-04-25T09:56:13.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.511+0000 7face265d640 1 --2- 172.21.15.7:0/2147943869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facdc06ab60 0x7facdc06fbb0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:13.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.511+0000 7face265d640 1 -- 172.21.15.7:0/2147943869 >> 172.21.15.7:0/2147943869 conn(0x7facdc0999f0 msgr2=0x7facdc0b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:13.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.511+0000 7face265d640 1 -- 172.21.15.7:0/2147943869 shutdown_connections 2024-04-25T09:56:13.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.511+0000 7face265d640 1 -- 172.21.15.7:0/2147943869 wait complete. 2024-04-25T09:56:13.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.512+0000 7face265d640 1 Processor -- start 2024-04-25T09:56:13.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.512+0000 7face265d640 1 -- start start 2024-04-25T09:56:13.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.513+0000 7face265d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7facdc06ab60 0x7facdc1f7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:13.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.513+0000 7face265d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facdc06f7d0 0x7facdc0b3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:13.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.513+0000 7face265d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facdc0b2950 0x7facdc0ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:13.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.513+0000 7face265d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc0b2de0 con 0x7facdc06f7d0 2024-04-25T09:56:13.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.513+0000 7face265d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc0afd90 con 0x7facdc0b2950 2024-04-25T09:56:13.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.513+0000 7face265d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facdc0b2f60 con 0x7facdc06ab60 2024-04-25T09:56:13.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.513+0000 7facdb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facdc06f7d0 0x7facdc0b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:13.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.513+0000 7facdb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facdc06f7d0 0x7facdc0b3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59008/0 (socket says 172.21.15.7:59008) 2024-04-25T09:56:13.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.513+0000 7facdb7fe640 1 -- 172.21.15.7:0/455326119 learned_addr learned my addr 172.21.15.7:0/455326119 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.513+0000 7face0bfa640 1 --2- 172.21.15.7:0/455326119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facdc0b2950 0x7facdc0ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.513+0000 7facdbfff640 1 --2- 172.21.15.7:0/455326119 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7facdc06ab60 0x7facdc1f7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.513+0000 7facdb7fe640 1 -- 172.21.15.7:0/455326119 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7facdc06ab60 msgr2=0x7facdc1f7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.513+0000 7facdb7fe640 1 --2- 172.21.15.7:0/455326119 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7facdc06ab60 0x7facdc1f7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.513+0000 7facdb7fe640 1 -- 172.21.15.7:0/455326119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facdc0b2950 msgr2=0x7facdc0ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.513+0000 7facdb7fe640 1 --2- 172.21.15.7:0/455326119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facdc0b2950 0x7facdc0ca3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.513+0000 7facdb7fe640 1 -- 172.21.15.7:0/455326119 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facdc1f82b0 con 0x7facdc06f7d0 2024-04-25T09:56:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.513+0000 7facdbfff640 1 --2- 172.21.15.7:0/455326119 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7facdc06ab60 0x7facdc1f7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.514+0000 7facdb7fe640 1 --2- 172.21.15.7:0/455326119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facdc06f7d0 0x7facdc0b3170 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7faccc0097a0 tx=0x7faccc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.514+0000 7facd8ff9640 1 -- 172.21.15.7:0/455326119 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc041070 con 0x7facdc06f7d0 2024-04-25T09:56:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.514+0000 7facd8ff9640 1 -- 172.21.15.7:0/455326119 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faccc03c870 con 0x7facdc06f7d0 2024-04-25T09:56:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.514+0000 7face265d640 1 -- 172.21.15.7:0/455326119 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facdc1f7a10 con 0x7facdc06f7d0 2024-04-25T09:56:13.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.514+0000 7facd8ff9640 1 -- 172.21.15.7:0/455326119 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc037040 con 0x7facdc06f7d0 2024-04-25T09:56:13.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.514+0000 7face265d640 1 -- 172.21.15.7:0/455326119 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facdc1f7fd0 con 0x7facdc06f7d0 2024-04-25T09:56:13.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.515+0000 7face265d640 1 -- 172.21.15.7:0/455326119 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facdc068f60 con 0x7facdc06f7d0 2024-04-25T09:56:13.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.515+0000 7facd8ff9640 1 -- 172.21.15.7:0/455326119 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faccc044070 con 0x7facdc06f7d0 2024-04-25T09:56:13.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.516+0000 7facd8ff9640 1 --2- 172.21.15.7:0/455326119 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7facc806b500 0x7facc806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:13.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.516+0000 7facd8ff9640 1 -- 172.21.15.7:0/455326119 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5619+0+0 (secure 0 0 0) 0x7faccc0aad50 con 0x7facdc06f7d0 2024-04-25T09:56:13.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.516+0000 7facdbfff640 1 --2- 172.21.15.7:0/455326119 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7facc806b500 0x7facc806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:13.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.516+0000 7facdbfff640 1 --2- 172.21.15.7:0/455326119 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7facc806b500 0x7facc806d9c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7facd0000f60 tx=0x7facd0007c10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:13.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.520+0000 7facd8ff9640 1 -- 172.21.15.7:0/455326119 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faccc0ae030 con 0x7facdc06f7d0 2024-04-25T09:56:13.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:13.700+0000 7face265d640 1 -- 172.21.15.7:0/455326119 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7facdc06b7d0 con 0x7facdc06f7d0 2024-04-25T09:56:14.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.388+0000 7facd8ff9640 1 -- 172.21.15.7:0/455326119 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v49) v1 ==== 170+0+0 (secure 0 0 0) 0x7faccc079d50 con 0x7facdc06f7d0 2024-04-25T09:56:14.392 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2024-04-25T09:56:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.392+0000 7face265d640 1 -- 172.21.15.7:0/455326119 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7facc806b500 msgr2=0x7facc806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.392+0000 7face265d640 1 --2- 172.21.15.7:0/455326119 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7facc806b500 0x7facc806d9c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7facd0000f60 tx=0x7facd0007c10 comp rx=0 tx=0).stop 2024-04-25T09:56:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.392+0000 7face265d640 1 -- 172.21.15.7:0/455326119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facdc06f7d0 msgr2=0x7facdc0b3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.392+0000 7face265d640 1 --2- 172.21.15.7:0/455326119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facdc06f7d0 0x7facdc0b3170 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7faccc0097a0 tx=0x7faccc0046c0 comp rx=0 tx=0).stop 2024-04-25T09:56:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.392+0000 7face265d640 1 -- 172.21.15.7:0/455326119 shutdown_connections 2024-04-25T09:56:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.392+0000 7face265d640 1 --2- 172.21.15.7:0/455326119 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7facc806b500 0x7facc806d9c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.392+0000 7face265d640 1 --2- 172.21.15.7:0/455326119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facdc0b2950 0x7facdc0ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.392+0000 7face265d640 1 --2- 172.21.15.7:0/455326119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7facdc06f7d0 0x7facdc0b3170 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.392+0000 7face265d640 1 --2- 172.21.15.7:0/455326119 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7facdc06ab60 0x7facdc1f7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.392+0000 7face265d640 1 -- 172.21.15.7:0/455326119 >> 172.21.15.7:0/455326119 conn(0x7facdc0999f0 msgr2=0x7facdc0cb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.392+0000 7face265d640 1 -- 172.21.15.7:0/455326119 shutdown_connections 2024-04-25T09:56:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.392+0000 7face265d640 1 -- 172.21.15.7:0/455326119 wait complete. 2024-04-25T09:56:14.419 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:56:14.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.524+0000 7f9aec812640 1 Processor -- start 2024-04-25T09:56:14.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.524+0000 7f9aec812640 1 -- start start 2024-04-25T09:56:14.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.525+0000 7f9aec812640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9ae80b37f0 0x7f9ae806b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:14.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.525+0000 7f9aec812640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ae80acd30 0x7f9ae806be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:14.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.525+0000 7f9aec812640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae80ad290 con 0x7f9ae806dcb0 2024-04-25T09:56:14.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.525+0000 7f9aec812640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae80b3cf0 con 0x7f9ae80b37f0 2024-04-25T09:56:14.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.525+0000 7f9aec812640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae806ab60 con 0x7f9ae80acd30 2024-04-25T09:56:14.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.525+0000 7f9ae5d9b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9ae80b37f0 0x7f9ae806b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:14.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.525+0000 7f9ae5d9b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9ae80b37f0 0x7f9ae806b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59016/0 (socket says 172.21.15.7:59016) 2024-04-25T09:56:14.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.525+0000 7f9ae5d9b640 1 -- 172.21.15.7:0/3036864207 learned_addr learned my addr 172.21.15.7:0/3036864207 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:14.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.525+0000 7f9ae6d9d640 1 --2- 172.21.15.7:0/3036864207 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ae80acd30 0x7f9ae806be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:14.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.525+0000 7f9ae5d9b640 1 -- 172.21.15.7:0/3036864207 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ae80acd30 msgr2=0x7f9ae806be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:14.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.525+0000 7f9ae5d9b640 1 --2- 172.21.15.7:0/3036864207 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ae80acd30 0x7f9ae806be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:14.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.525+0000 7f9ae5d9b640 1 -- 172.21.15.7:0/3036864207 >> v1:172.21.15.55:6789/0 conn(0x7f9ae806dcb0 legacy=0x7f9ae806e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:14.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.525+0000 7f9ae5d9b640 1 -- 172.21.15.7:0/3036864207 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae806ae40 con 0x7f9ae80b37f0 2024-04-25T09:56:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.526+0000 7f9ae5d9b640 1 --2- 172.21.15.7:0/3036864207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ae80b37f0 0x7f9ae806b920 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9adc009870 tx=0x7f9adc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a4224552fcd916 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.526+0000 7f9ae559a640 1 -- 172.21.15.7:0/3036864207 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9adc037070 con 0x7f9ae80b37f0 2024-04-25T09:56:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.526+0000 7f9ae559a640 1 -- 172.21.15.7:0/3036864207 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9adc032440 con 0x7f9ae80b37f0 2024-04-25T09:56:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.526+0000 7f9ae559a640 1 -- 172.21.15.7:0/3036864207 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9adc032810 con 0x7f9ae80b37f0 2024-04-25T09:56:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.527+0000 7f9aec812640 1 -- 172.21.15.7:0/3036864207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ae80b37f0 msgr2=0x7f9ae806b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.527+0000 7f9aec812640 1 --2- 172.21.15.7:0/3036864207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ae80b37f0 0x7f9ae806b920 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9adc009870 tx=0x7f9adc02a210 comp rx=0 tx=0).stop 2024-04-25T09:56:14.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.527+0000 7f9aec812640 1 -- 172.21.15.7:0/3036864207 shutdown_connections 2024-04-25T09:56:14.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.527+0000 7f9aec812640 1 --2- 172.21.15.7:0/3036864207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ae80b37f0 0x7f9ae806b920 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:14.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.527+0000 7f9aec812640 1 --2- 172.21.15.7:0/3036864207 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ae80acd30 0x7f9ae806be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:14.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.527+0000 7f9aec812640 1 -- 172.21.15.7:0/3036864207 >> 172.21.15.7:0/3036864207 conn(0x7f9ae80cfdc0 msgr2=0x7f9ae80d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:14.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.527+0000 7f9aec812640 1 -- 172.21.15.7:0/3036864207 shutdown_connections 2024-04-25T09:56:14.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.527+0000 7f9aec812640 1 -- 172.21.15.7:0/3036864207 wait complete. 2024-04-25T09:56:14.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.528+0000 7f9aec812640 1 Processor -- start 2024-04-25T09:56:14.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.528+0000 7f9aec812640 1 -- start start 2024-04-25T09:56:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.529+0000 7f9aec812640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ae806dcb0 0x7f9ae8144720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.529+0000 7f9aec812640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ae80acd30 0x7f9ae8153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.529+0000 7f9aec812640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ae80b37f0 0x7f9ae8153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.529+0000 7f9aec812640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae806c3a0 con 0x7f9ae806dcb0 2024-04-25T09:56:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.529+0000 7f9aec812640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae806b400 con 0x7f9ae80acd30 2024-04-25T09:56:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.529+0000 7f9aec812640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae806f6d0 con 0x7f9ae80b37f0 2024-04-25T09:56:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.529+0000 7f9ae659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ae806dcb0 0x7f9ae8144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.529+0000 7f9ae659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ae806dcb0 0x7f9ae8144720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59032/0 (socket says 172.21.15.7:59032) 2024-04-25T09:56:14.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.529+0000 7f9ae659c640 1 -- 172.21.15.7:0/3324211281 learned_addr learned my addr 172.21.15.7:0/3324211281 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:14.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.529+0000 7f9ae5d9b640 1 --2- 172.21.15.7:0/3324211281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ae80acd30 0x7f9ae8153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:14.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.529+0000 7f9ae6d9d640 1 --2- 172.21.15.7:0/3324211281 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ae80b37f0 0x7f9ae8153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:14.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.530+0000 7f9ae659c640 1 -- 172.21.15.7:0/3324211281 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ae80b37f0 msgr2=0x7f9ae8153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:14.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.530+0000 7f9ae659c640 1 --2- 172.21.15.7:0/3324211281 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ae80b37f0 0x7f9ae8153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:14.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.530+0000 7f9ae659c640 1 -- 172.21.15.7:0/3324211281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ae80acd30 msgr2=0x7f9ae8153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:14.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.530+0000 7f9ae659c640 1 --2- 172.21.15.7:0/3324211281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ae80acd30 0x7f9ae8153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:14.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.530+0000 7f9ae659c640 1 -- 172.21.15.7:0/3324211281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae8152510 con 0x7f9ae806dcb0 2024-04-25T09:56:14.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.530+0000 7f9ae659c640 1 --2- 172.21.15.7:0/3324211281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ae806dcb0 0x7f9ae8144720 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9ad800b3f0 tx=0x7f9ad800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:14.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.530+0000 7f9ad6ffd640 1 -- 172.21.15.7:0/3324211281 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8015020 con 0x7f9ae806dcb0 2024-04-25T09:56:14.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.530+0000 7f9ad6ffd640 1 -- 172.21.15.7:0/3324211281 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad8011830 con 0x7f9ae806dcb0 2024-04-25T09:56:14.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.530+0000 7f9ad6ffd640 1 -- 172.21.15.7:0/3324211281 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8011c20 con 0x7f9ae806dcb0 2024-04-25T09:56:14.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.530+0000 7f9aec812640 1 -- 172.21.15.7:0/3324211281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae81527f0 con 0x7f9ae806dcb0 2024-04-25T09:56:14.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.530+0000 7f9aec812640 1 -- 172.21.15.7:0/3324211281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae8152db0 con 0x7f9ae806dcb0 2024-04-25T09:56:14.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.531+0000 7f9aec812640 1 -- 172.21.15.7:0/3324211281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae8068f60 con 0x7f9ae806dcb0 2024-04-25T09:56:14.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.531+0000 7f9ad6ffd640 1 -- 172.21.15.7:0/3324211281 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9ad8018020 con 0x7f9ae806dcb0 2024-04-25T09:56:14.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.532+0000 7f9ad6ffd640 1 --2- 172.21.15.7:0/3324211281 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9ac806b4d0 0x7f9ac806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:14.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.532+0000 7f9ad6ffd640 1 -- 172.21.15.7:0/3324211281 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6001+0+0 (secure 0 0 0) 0x7f9ad8089d90 con 0x7f9ae806dcb0 2024-04-25T09:56:14.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.532+0000 7f9ae5d9b640 1 --2- 172.21.15.7:0/3324211281 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9ac806b4d0 0x7f9ac806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:14.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.532+0000 7f9ae5d9b640 1 --2- 172.21.15.7:0/3324211281 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9ac806b4d0 0x7f9ac806d990 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9adc034000 tx=0x7f9adc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:14.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.536+0000 7f9ad6ffd640 1 -- 172.21.15.7:0/3324211281 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9ad801f030 con 0x7f9ae806dcb0 2024-04-25T09:56:14.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:14.755+0000 7f9aec812640 1 -- 172.21.15.7:0/3324211281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9ae80b0ba0 con 0x7f9ae806dcb0 2024-04-25T09:56:15.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.390+0000 7f9ad6ffd640 1 -- 172.21.15.7:0/3324211281 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v19) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9ad8058520 con 0x7f9ae806dcb0 2024-04-25T09:56:15.394 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 7 and data pool 8 2024-04-25T09:56:15.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.396+0000 7f9aec812640 1 -- 172.21.15.7:0/3324211281 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9ac806b4d0 msgr2=0x7f9ac806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:15.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.396+0000 7f9aec812640 1 --2- 172.21.15.7:0/3324211281 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9ac806b4d0 0x7f9ac806d990 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9adc034000 tx=0x7f9adc02e000 comp rx=0 tx=0).stop 2024-04-25T09:56:15.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.396+0000 7f9aec812640 1 -- 172.21.15.7:0/3324211281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ae806dcb0 msgr2=0x7f9ae8144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:15.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.396+0000 7f9aec812640 1 --2- 172.21.15.7:0/3324211281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ae806dcb0 0x7f9ae8144720 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9ad800b3f0 tx=0x7f9ad800b8b0 comp rx=0 tx=0).stop 2024-04-25T09:56:15.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.397+0000 7f9aec812640 1 -- 172.21.15.7:0/3324211281 shutdown_connections 2024-04-25T09:56:15.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.397+0000 7f9aec812640 1 --2- 172.21.15.7:0/3324211281 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9ac806b4d0 0x7f9ac806d990 secure :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9adc034000 tx=0x7f9adc02e000 comp rx=0 tx=0).stop 2024-04-25T09:56:15.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.397+0000 7f9aec812640 1 --2- 172.21.15.7:0/3324211281 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ae80b37f0 0x7f9ae8153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:15.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.397+0000 7f9aec812640 1 --2- 172.21.15.7:0/3324211281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ae80acd30 0x7f9ae8153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:15.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.397+0000 7f9aec812640 1 --2- 172.21.15.7:0/3324211281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ae806dcb0 0x7f9ae8144720 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:15.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.397+0000 7f9aec812640 1 -- 172.21.15.7:0/3324211281 >> 172.21.15.7:0/3324211281 conn(0x7f9ae80cfdc0 msgr2=0x7f9ae80afa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:15.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.400+0000 7f9aec812640 1 -- 172.21.15.7:0/3324211281 shutdown_connections 2024-04-25T09:56:15.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.401+0000 7f9aec812640 1 -- 172.21.15.7:0/3324211281 wait complete. 2024-04-25T09:56:15.437 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:56:15.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.538+0000 7f588d24a640 1 Processor -- start 2024-04-25T09:56:15.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.538+0000 7f588d24a640 1 -- start start 2024-04-25T09:56:15.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.539+0000 7f588d24a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f58880d0330 0x7f58880999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:15.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.539+0000 7f588d24a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5888099f30 0x7f58880b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:15.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.539+0000 7f588d24a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58880ccbc0 con 0x7f588815b8e0 2024-04-25T09:56:15.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.539+0000 7f588d24a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f588809a380 con 0x7f58880d0330 2024-04-25T09:56:15.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.539+0000 7f588d24a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58880cd7d0 con 0x7f5888099f30 2024-04-25T09:56:15.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.539+0000 7f588659c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f58880d0330 0x7f58880999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:15.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.539+0000 7f588659c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f58880d0330 0x7f58880999f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59044/0 (socket says 172.21.15.7:59044) 2024-04-25T09:56:15.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.539+0000 7f588659c640 1 -- 172.21.15.7:0/913731314 learned_addr learned my addr 172.21.15.7:0/913731314 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:15.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.539+0000 7f588759e640 1 --2- 172.21.15.7:0/913731314 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5888099f30 0x7f58880b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:15.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.540+0000 7f588659c640 1 -- 172.21.15.7:0/913731314 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5888099f30 msgr2=0x7f58880b0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:15.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.540+0000 7f588659c640 1 --2- 172.21.15.7:0/913731314 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5888099f30 0x7f58880b0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:15.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.540+0000 7f588659c640 1 -- 172.21.15.7:0/913731314 >> v1:172.21.15.55:6789/0 conn(0x7f588815b8e0 legacy=0x7f58880cc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:15.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.540+0000 7f588659c640 1 -- 172.21.15.7:0/913731314 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58880ccea0 con 0x7f58880d0330 2024-04-25T09:56:15.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.540+0000 7f588659c640 1 --2- 172.21.15.7:0/913731314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58880d0330 0x7f58880999f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f587c009870 tx=0x7f587c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e1c00898879d1e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:15.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.540+0000 7f5885d9b640 1 -- 172.21.15.7:0/913731314 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587c037070 con 0x7f58880d0330 2024-04-25T09:56:15.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.540+0000 7f5885d9b640 1 -- 172.21.15.7:0/913731314 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587c032440 con 0x7f58880d0330 2024-04-25T09:56:15.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.540+0000 7f5885d9b640 1 -- 172.21.15.7:0/913731314 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587c032810 con 0x7f58880d0330 2024-04-25T09:56:15.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.541+0000 7f588d24a640 1 -- 172.21.15.7:0/913731314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58880d0330 msgr2=0x7f58880999f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:15.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.541+0000 7f588d24a640 1 --2- 172.21.15.7:0/913731314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58880d0330 0x7f58880999f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f587c009870 tx=0x7f587c02a270 comp rx=0 tx=0).stop 2024-04-25T09:56:15.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.541+0000 7f588d24a640 1 -- 172.21.15.7:0/913731314 shutdown_connections 2024-04-25T09:56:15.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.541+0000 7f588d24a640 1 --2- 172.21.15.7:0/913731314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58880d0330 0x7f58880999f0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:15.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.541+0000 7f588d24a640 1 --2- 172.21.15.7:0/913731314 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5888099f30 0x7f58880b0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:15.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.541+0000 7f588d24a640 1 -- 172.21.15.7:0/913731314 >> 172.21.15.7:0/913731314 conn(0x7f58880b3130 msgr2=0x7f58880b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:15.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.541+0000 7f588d24a640 1 -- 172.21.15.7:0/913731314 shutdown_connections 2024-04-25T09:56:15.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.541+0000 7f588d24a640 1 -- 172.21.15.7:0/913731314 wait complete. 2024-04-25T09:56:15.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.542+0000 7f588d24a640 1 Processor -- start 2024-04-25T09:56:15.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.543+0000 7f588d24a640 1 -- start start 2024-04-25T09:56:15.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.543+0000 7f588d24a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5888099f30 0x7f58880b4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:15.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.543+0000 7f588d24a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58880d0330 0x7f58880c7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:15.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.543+0000 7f588d24a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f588815b8e0 0x7f58880c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:15.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.543+0000 7f588d24a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58880cd460 con 0x7f5888099f30 2024-04-25T09:56:15.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.543+0000 7f588d24a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58880d07c0 con 0x7f58880d0330 2024-04-25T09:56:15.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.543+0000 7f588d24a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f588815bcc0 con 0x7f588815b8e0 2024-04-25T09:56:15.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.543+0000 7f5886d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5888099f30 0x7f58880b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:15.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.543+0000 7f5886d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5888099f30 0x7f58880b4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59060/0 (socket says 172.21.15.7:59060) 2024-04-25T09:56:15.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.543+0000 7f5886d9d640 1 -- 172.21.15.7:0/866403212 learned_addr learned my addr 172.21.15.7:0/866403212 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:15.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.544+0000 7f588759e640 1 --2- 172.21.15.7:0/866403212 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f588815b8e0 0x7f58880c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:15.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.544+0000 7f588659c640 1 --2- 172.21.15.7:0/866403212 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58880d0330 0x7f58880c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:15.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.544+0000 7f5886d9d640 1 -- 172.21.15.7:0/866403212 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f588815b8e0 msgr2=0x7f58880c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:15.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.544+0000 7f5886d9d640 1 --2- 172.21.15.7:0/866403212 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f588815b8e0 0x7f58880c7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:15.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.544+0000 7f5886d9d640 1 -- 172.21.15.7:0/866403212 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58880d0330 msgr2=0x7f58880c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:15.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.544+0000 7f5886d9d640 1 --2- 172.21.15.7:0/866403212 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58880d0330 0x7f58880c7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:15.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.544+0000 7f5886d9d640 1 -- 172.21.15.7:0/866403212 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58880c7b80 con 0x7f5888099f30 2024-04-25T09:56:15.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.544+0000 7f5886d9d640 1 --2- 172.21.15.7:0/866403212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5888099f30 0x7f58880b4260 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f587800c340 tx=0x7f587800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:15.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.544+0000 7f586f7fe640 1 -- 172.21.15.7:0/866403212 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5878017070 con 0x7f5888099f30 2024-04-25T09:56:15.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.544+0000 7f586f7fe640 1 -- 172.21.15.7:0/866403212 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58780052d0 con 0x7f5888099f30 2024-04-25T09:56:15.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.544+0000 7f586f7fe640 1 -- 172.21.15.7:0/866403212 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5878003850 con 0x7f5888099f30 2024-04-25T09:56:15.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.544+0000 7f588d24a640 1 -- 172.21.15.7:0/866403212 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58880c7e20 con 0x7f5888099f30 2024-04-25T09:56:15.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.544+0000 7f588d24a640 1 -- 172.21.15.7:0/866403212 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f588806c1a0 con 0x7f5888099f30 2024-04-25T09:56:15.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.545+0000 7f588d24a640 1 -- 172.21.15.7:0/866403212 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5888068fd0 con 0x7f5888099f30 2024-04-25T09:56:15.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.546+0000 7f586f7fe640 1 -- 172.21.15.7:0/866403212 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f587801a070 con 0x7f5888099f30 2024-04-25T09:56:15.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.546+0000 7f586f7fe640 1 --2- 172.21.15.7:0/866403212 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f587406b4d0 0x7f587406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:15.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.546+0000 7f586f7fe640 1 -- 172.21.15.7:0/866403212 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5878089560 con 0x7f5888099f30 2024-04-25T09:56:15.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.546+0000 7f588659c640 1 --2- 172.21.15.7:0/866403212 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f587406b4d0 0x7f587406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:15.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.547+0000 7f588659c640 1 --2- 172.21.15.7:0/866403212 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f587406b4d0 0x7f587406d990 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f587c034000 tx=0x7f587c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:15.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.551+0000 7f586f7fe640 1 -- 172.21.15.7:0/866403212 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5878057c90 con 0x7f5888099f30 2024-04-25T09:56:15.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.730+0000 7f588d24a640 1 -- 172.21.15.7:0/866403212 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f588815b0e0 con 0x7f5888099f30 2024-04-25T09:56:15.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.732+0000 7f586f7fe640 1 -- 172.21.15.7:0/866403212 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16859 (secure 0 0 0) 0x7f587805bd30 con 0x7f5888099f30 2024-04-25T09:56:15.735 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:15.735 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":50,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:56:14.756670+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:56:13.032097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T09:56:13.732257+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:56:15.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.734+0000 7f588d24a640 1 -- 172.21.15.7:0/866403212 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f587406b4d0 msgr2=0x7f587406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:15.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.734+0000 7f588d24a640 1 --2- 172.21.15.7:0/866403212 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f587406b4d0 0x7f587406d990 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f587c034000 tx=0x7f587c02e000 comp rx=0 tx=0).stop 2024-04-25T09:56:15.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.734+0000 7f588d24a640 1 -- 172.21.15.7:0/866403212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5888099f30 msgr2=0x7f58880b4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:15.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.734+0000 7f588d24a640 1 --2- 172.21.15.7:0/866403212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5888099f30 0x7f58880b4260 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f587800c340 tx=0x7f587800c800 comp rx=0 tx=0).stop 2024-04-25T09:56:15.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.734+0000 7f588d24a640 1 -- 172.21.15.7:0/866403212 shutdown_connections 2024-04-25T09:56:15.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.734+0000 7f588d24a640 1 --2- 172.21.15.7:0/866403212 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f587406b4d0 0x7f587406d990 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:15.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.734+0000 7f588d24a640 1 --2- 172.21.15.7:0/866403212 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f588815b8e0 0x7f58880c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:15.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.734+0000 7f588d24a640 1 --2- 172.21.15.7:0/866403212 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58880d0330 0x7f58880c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:15.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.734+0000 7f588d24a640 1 --2- 172.21.15.7:0/866403212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5888099f30 0x7f58880b4260 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:15.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.734+0000 7f588d24a640 1 -- 172.21.15.7:0/866403212 >> 172.21.15.7:0/866403212 conn(0x7f58880b3130 msgr2=0x7f58880cf790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:15.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.734+0000 7f588d24a640 1 -- 172.21.15.7:0/866403212 shutdown_connections 2024-04-25T09:56:15.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.734+0000 7f588d24a640 1 -- 172.21.15.7:0/866403212 wait complete. 2024-04-25T09:56:15.749 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:56:15.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.846+0000 7f3ca7f1d640 1 Processor -- start 2024-04-25T09:56:15.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.846+0000 7f3ca7f1d640 1 -- start start 2024-04-25T09:56:15.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.847+0000 7f3ca7f1d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3ca00ced30 0x7f3ca0168960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:15.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.847+0000 7f3ca7f1d640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ca0161fa0 con 0x7f3ca00b9250 2024-04-25T09:56:15.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.847+0000 7f3ca7f1d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ca0162280 con 0x7f3ca015d920 2024-04-25T09:56:15.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.847+0000 7f3ca7f1d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca00d1de0 con 0x7f3ca00ced30 2024-04-25T09:56:15.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.847+0000 7f3ca54b8640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3ca00b9250 0x7f3ca00ce620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53688/0 (socket says 172.21.15.7:53688) 2024-04-25T09:56:15.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.847+0000 7f3ca54b8640 1 -- 172.21.15.7:0/3138589581 learned_addr learned my addr 172.21.15.7:0/3138589581 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:56:15.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.847+0000 7f3ca64ba640 1 --2- 172.21.15.7:0/3138589581 >> v2:172.21.15.55:3300/0 conn(0x7f3ca00ced30 0x7f3ca0168960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:15.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.847+0000 7f3ca4cb7640 1 -- 172.21.15.7:0/3138589581 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679651966 0 0) 0x7f3ca0161fa0 con 0x7f3ca00b9250 2024-04-25T09:56:15.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.847+0000 7f3ca4cb7640 1 -- 172.21.15.7:0/3138589581 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c8c003520 con 0x7f3ca00b9250 2024-04-25T09:56:15.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.847+0000 7f3ca4cb7640 1 -- 172.21.15.7:0/3138589581 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2799925439 0 0) 0x7f3c8c003520 con 0x7f3ca00b9250 2024-04-25T09:56:15.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.847+0000 7f3ca4cb7640 1 -- 172.21.15.7:0/3138589581 >> v2:172.21.15.55:3300/0 conn(0x7f3ca00ced30 msgr2=0x7f3ca0168960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:15.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.847+0000 7f3ca4cb7640 1 --2- 172.21.15.7:0/3138589581 >> v2:172.21.15.55:3300/0 conn(0x7f3ca00ced30 0x7f3ca0168960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:15.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.847+0000 7f3ca4cb7640 1 -- 172.21.15.7:0/3138589581 >> v1:172.21.15.55:6789/0 conn(0x7f3ca015d920 legacy=0x7f3ca0161630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:15.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.847+0000 7f3ca4cb7640 1 -- 172.21.15.7:0/3138589581 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca00d1a70 con 0x7f3ca00b9250 2024-04-25T09:56:15.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.848+0000 7f3ca4cb7640 1 -- 172.21.15.7:0/3138589581 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f3c90001670 con 0x7f3ca00b9250 2024-04-25T09:56:15.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.848+0000 7f3ca64ba640 1 --2- 172.21.15.7:0/3138589581 >> v2:172.21.15.55:3300/0 conn(0x7f3ca00ced30 0x7f3ca0168960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:56:15.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.848+0000 7f3ca4cb7640 1 -- 172.21.15.7:0/3138589581 >> v1:172.21.15.7:6789/0 conn(0x7f3ca00b9250 legacy=0x7f3ca00ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:15.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.848+0000 7f3ca4cb7640 1 --2- 172.21.15.7:0/3138589581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c8c0039b0 0x7f3c8c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:15.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.848+0000 7f3ca4cb7640 1 --2- 172.21.15.7:0/3138589581 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c8c004800 0x7f3c8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:15.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.848+0000 7f3ca4cb7640 1 --2- 172.21.15.7:0/3138589581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c8c0052e0 0x7f3c8c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:15.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.848+0000 7f3ca4cb7640 1 -- 172.21.15.7:0/3138589581 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca00d1de0 con 0x7f3c8c0052e0 2024-04-25T09:56:15.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.848+0000 7f3ca4cb7640 1 -- 172.21.15.7:0/3138589581 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c00c1b0 con 0x7f3c8c0039b0 2024-04-25T09:56:15.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.848+0000 7f3ca4cb7640 1 -- 172.21.15.7:0/3138589581 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c00c3b0 con 0x7f3c8c004800 2024-04-25T09:56:15.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.848+0000 7f3ca64ba640 1 --2- 172.21.15.7:0/3138589581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c8c0052e0 0x7f3c8c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:15.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.848+0000 7f3ca5cb9640 1 --2- 172.21.15.7:0/3138589581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c8c0039b0 0x7f3c8c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:15.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.848+0000 7f3ca54b8640 1 --2- 172.21.15.7:0/3138589581 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c8c004800 0x7f3c8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:15.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.848+0000 7f3ca64ba640 1 -- 172.21.15.7:0/3138589581 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c8c004800 msgr2=0x7f3c8c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:15.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.848+0000 7f3ca64ba640 1 --2- 172.21.15.7:0/3138589581 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c8c004800 0x7f3c8c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:15.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.848+0000 7f3ca64ba640 1 -- 172.21.15.7:0/3138589581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c8c0039b0 msgr2=0x7f3c8c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:15.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.848+0000 7f3ca64ba640 1 --2- 172.21.15.7:0/3138589581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c8c0039b0 0x7f3c8c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:15.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.848+0000 7f3ca64ba640 1 -- 172.21.15.7:0/3138589581 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8c003520 con 0x7f3c8c0052e0 2024-04-25T09:56:15.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.849+0000 7f3ca64ba640 1 -- 172.21.15.7:0/3138589581 reap_dead start 2024-04-25T09:56:15.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.849+0000 7f3ca64ba640 1 --2- 172.21.15.7:0/3138589581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c8c0052e0 0x7f3c8c00b9c0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00cf200 tx=0x7f3c8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d37eb9a0fba89c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:15.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.849+0000 7f3ca4cb7640 1 -- 172.21.15.7:0/3138589581 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c98009de0 con 0x7f3c8c0052e0 2024-04-25T09:56:15.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.849+0000 7f3ca4cb7640 1 -- 172.21.15.7:0/3138589581 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c98003b90 con 0x7f3c8c0052e0 2024-04-25T09:56:15.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.849+0000 7f3ca4cb7640 1 -- 172.21.15.7:0/3138589581 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c98004020 con 0x7f3c8c0052e0 2024-04-25T09:56:15.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.849+0000 7f3ca7f1d640 1 -- 172.21.15.7:0/3138589581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c8c0052e0 msgr2=0x7f3c8c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:15.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.849+0000 7f3ca7f1d640 1 --2- 172.21.15.7:0/3138589581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c8c0052e0 0x7f3c8c00b9c0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00cf200 tx=0x7f3c8c005830 comp rx=0 tx=0).stop 2024-04-25T09:56:15.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.849+0000 7f3ca7f1d640 1 -- 172.21.15.7:0/3138589581 shutdown_connections 2024-04-25T09:56:15.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.849+0000 7f3ca7f1d640 1 --2- 172.21.15.7:0/3138589581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c8c0052e0 0x7f3c8c00b9c0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:15.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.850+0000 7f3ca7f1d640 1 -- 172.21.15.7:0/3138589581 >> 172.21.15.7:0/3138589581 conn(0x7f3ca006bfe0 msgr2=0x7f3ca006c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:15.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.850+0000 7f3ca7f1d640 1 -- 172.21.15.7:0/3138589581 shutdown_connections 2024-04-25T09:56:15.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.850+0000 7f3ca7f1d640 1 -- 172.21.15.7:0/3138589581 wait complete. 2024-04-25T09:56:15.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.851+0000 7f3ca7f1d640 1 Processor -- start 2024-04-25T09:56:15.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.851+0000 7f3ca7f1d640 1 -- start start 2024-04-25T09:56:15.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.851+0000 7f3ca7f1d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c8c0052e0 0x7f3ca015bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:15.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.851+0000 7f3ca7f1d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ca015c110 0x7f3ca00cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:15.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.852+0000 7f3ca7f1d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3ca01f7580 0x7f3ca01f7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:15.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.852+0000 7f3ca7f1d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca0162560 con 0x7f3ca015c110 2024-04-25T09:56:15.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.852+0000 7f3ca7f1d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca015df10 con 0x7f3c8c0052e0 2024-04-25T09:56:15.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.852+0000 7f3ca7f1d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca00ce620 con 0x7f3ca01f7580 2024-04-25T09:56:15.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.852+0000 7f3ca54b8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ca015c110 0x7f3ca00cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:15.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.852+0000 7f3ca54b8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ca015c110 0x7f3ca00cc240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59080/0 (socket says 172.21.15.7:59080) 2024-04-25T09:56:15.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.852+0000 7f3ca54b8640 1 -- 172.21.15.7:0/3393222755 learned_addr learned my addr 172.21.15.7:0/3393222755 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:15.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.852+0000 7f3ca5cb9640 1 --2- 172.21.15.7:0/3393222755 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c8c0052e0 0x7f3ca015bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:15.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.852+0000 7f3ca54b8640 1 -- 172.21.15.7:0/3393222755 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3ca01f7580 msgr2=0x7f3ca01f7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:15.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.852+0000 7f3ca54b8640 1 --2- 172.21.15.7:0/3393222755 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3ca01f7580 0x7f3ca01f7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:15.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.852+0000 7f3ca54b8640 1 -- 172.21.15.7:0/3393222755 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c8c0052e0 msgr2=0x7f3ca015bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:15.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.852+0000 7f3ca54b8640 1 --2- 172.21.15.7:0/3393222755 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c8c0052e0 0x7f3ca015bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:15.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.852+0000 7f3ca54b8640 1 -- 172.21.15.7:0/3393222755 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca00cc780 con 0x7f3ca015c110 2024-04-25T09:56:15.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.852+0000 7f3ca54b8640 1 --2- 172.21.15.7:0/3393222755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ca015c110 0x7f3ca00cc240 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3c90007fd0 tx=0x7f3c90007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:15.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.852+0000 7f3c967fc640 1 -- 172.21.15.7:0/3393222755 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9000f730 con 0x7f3ca015c110 2024-04-25T09:56:15.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.852+0000 7f3c967fc640 1 -- 172.21.15.7:0/3393222755 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c90018070 con 0x7f3ca015c110 2024-04-25T09:56:15.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.852+0000 7f3c967fc640 1 -- 172.21.15.7:0/3393222755 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9000fb10 con 0x7f3ca015c110 2024-04-25T09:56:15.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.852+0000 7f3ca7f1d640 1 -- 172.21.15.7:0/3393222755 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca00cb1a0 con 0x7f3ca015c110 2024-04-25T09:56:15.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.852+0000 7f3ca7f1d640 1 -- 172.21.15.7:0/3393222755 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca00cb760 con 0x7f3ca015c110 2024-04-25T09:56:15.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.853+0000 7f3ca7f1d640 1 -- 172.21.15.7:0/3393222755 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ca0068fd0 con 0x7f3ca015c110 2024-04-25T09:56:15.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.854+0000 7f3c967fc640 1 -- 172.21.15.7:0/3393222755 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3c9000fcb0 con 0x7f3ca015c110 2024-04-25T09:56:15.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.854+0000 7f3c967fc640 1 --2- 172.21.15.7:0/3393222755 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3c8406b4d0 0x7f3c8406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:15.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.854+0000 7f3c967fc640 1 -- 172.21.15.7:0/3393222755 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3c9008a230 con 0x7f3ca015c110 2024-04-25T09:56:15.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.854+0000 7f3ca5cb9640 1 --2- 172.21.15.7:0/3393222755 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3c8406b4d0 0x7f3c8406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:15.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.855+0000 7f3ca5cb9640 1 --2- 172.21.15.7:0/3393222755 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3c8406b4d0 0x7f3c8406d990 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c000c00 tx=0x7f3c9c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:15.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:15.858+0000 7f3c967fc640 1 -- 172.21.15.7:0/3393222755 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3c90058fb0 con 0x7f3ca015c110 2024-04-25T09:56:16.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.039+0000 7f3ca7f1d640 1 -- 172.21.15.7:0/3393222755 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ca00b64e0 con 0x7f3ca015c110 2024-04-25T09:56:16.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.041+0000 7f3c967fc640 1 -- 172.21.15.7:0/3393222755 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16859 (secure 0 0 0) 0x7f3c900588b0 con 0x7f3ca015c110 2024-04-25T09:56:16.044 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:16.044 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":50,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:56:14.756670+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:56:13.032097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T09:56:13.732257+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:56:16.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.043+0000 7f3ca7f1d640 1 -- 172.21.15.7:0/3393222755 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3c8406b4d0 msgr2=0x7f3c8406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:16.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.043+0000 7f3ca7f1d640 1 --2- 172.21.15.7:0/3393222755 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3c8406b4d0 0x7f3c8406d990 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c000c00 tx=0x7f3c9c009040 comp rx=0 tx=0).stop 2024-04-25T09:56:16.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.043+0000 7f3ca7f1d640 1 -- 172.21.15.7:0/3393222755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ca015c110 msgr2=0x7f3ca00cc240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:16.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.043+0000 7f3ca7f1d640 1 --2- 172.21.15.7:0/3393222755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ca015c110 0x7f3ca00cc240 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3c90007fd0 tx=0x7f3c90007430 comp rx=0 tx=0).stop 2024-04-25T09:56:16.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.043+0000 7f3ca7f1d640 1 -- 172.21.15.7:0/3393222755 shutdown_connections 2024-04-25T09:56:16.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.043+0000 7f3ca7f1d640 1 --2- 172.21.15.7:0/3393222755 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3c8406b4d0 0x7f3c8406d990 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:16.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.043+0000 7f3ca7f1d640 1 --2- 172.21.15.7:0/3393222755 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3ca01f7580 0x7f3ca01f7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:16.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.043+0000 7f3ca7f1d640 1 --2- 172.21.15.7:0/3393222755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ca015c110 0x7f3ca00cc240 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:16.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.043+0000 7f3ca7f1d640 1 --2- 172.21.15.7:0/3393222755 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c8c0052e0 0x7f3ca015bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:16.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.043+0000 7f3ca7f1d640 1 -- 172.21.15.7:0/3393222755 >> 172.21.15.7:0/3393222755 conn(0x7f3ca006bfe0 msgr2=0x7f3ca00d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:16.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.043+0000 7f3ca7f1d640 1 -- 172.21.15.7:0/3393222755 shutdown_connections 2024-04-25T09:56:16.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.043+0000 7f3ca7f1d640 1 -- 172.21.15.7:0/3393222755 wait complete. 2024-04-25T09:56:16.057 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:56:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.159+0000 7f04fa69a640 1 Processor -- start 2024-04-25T09:56:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.159+0000 7f04fa69a640 1 -- start start 2024-04-25T09:56:16.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.159+0000 7f04fa69a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f04f415a940 0x7f04f40cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:16.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.159+0000 7f04fa69a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f04f415f040 0x7f04f40b2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:16.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.159+0000 7f04fa69a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f415ad20 con 0x7f04f40ccfd0 2024-04-25T09:56:16.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.159+0000 7f04fa69a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f40cb0d0 con 0x7f04f415a940 2024-04-25T09:56:16.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.159+0000 7f04fa69a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f40b3030 con 0x7f04f415f040 2024-04-25T09:56:16.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.160+0000 7f04f3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f04f415a940 0x7f04f40cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:16.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.160+0000 7f04f8c37640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f04f40ccfd0 0x7f04f406e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:36184/0 (socket says 172.21.15.7:36184) 2024-04-25T09:56:16.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.160+0000 7f04f8c37640 1 -- 172.21.15.7:0/621271855 learned_addr learned my addr 172.21.15.7:0/621271855 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:56:16.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.160+0000 7f04f37fe640 1 --2- 172.21.15.7:0/621271855 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f04f415f040 0x7f04f40b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:16.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.160+0000 7f04f3fff640 1 -- 172.21.15.7:0/621271855 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f04f415f040 msgr2=0x7f04f40b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:16.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.160+0000 7f04f3fff640 1 --2- 172.21.15.7:0/621271855 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f04f415f040 0x7f04f40b2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:16.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.160+0000 7f04f3fff640 1 -- 172.21.15.7:0/621271855 >> v1:172.21.15.55:6789/0 conn(0x7f04f40ccfd0 legacy=0x7f04f406e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:16.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.160+0000 7f04f2ffd640 1 -- 172.21.15.7:0/621271855 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 887044490 0 0) 0x7f04f415ad20 con 0x7f04f40ccfd0 2024-04-25T09:56:16.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.160+0000 7f04f3fff640 1 -- 172.21.15.7:0/621271855 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f40cb300 con 0x7f04f415a940 2024-04-25T09:56:16.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.161+0000 7f04f3fff640 1 --2- 172.21.15.7:0/621271855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04f415a940 0x7f04f40cc0c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f04e40097a0 tx=0x7f04e402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d861e097223be0bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:16.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.161+0000 7f04f2ffd640 1 -- 172.21.15.7:0/621271855 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e4037070 con 0x7f04f415a940 2024-04-25T09:56:16.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.161+0000 7f04f2ffd640 1 -- 172.21.15.7:0/621271855 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e402ae50 con 0x7f04f415a940 2024-04-25T09:56:16.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.161+0000 7f04f2ffd640 1 -- 172.21.15.7:0/621271855 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e4032660 con 0x7f04f415a940 2024-04-25T09:56:16.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.162+0000 7f04fa69a640 1 -- 172.21.15.7:0/621271855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04f415a940 msgr2=0x7f04f40cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:16.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.162+0000 7f04fa69a640 1 --2- 172.21.15.7:0/621271855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04f415a940 0x7f04f40cc0c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f04e40097a0 tx=0x7f04e402a100 comp rx=0 tx=0).stop 2024-04-25T09:56:16.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.162+0000 7f04fa69a640 1 -- 172.21.15.7:0/621271855 shutdown_connections 2024-04-25T09:56:16.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.162+0000 7f04fa69a640 1 --2- 172.21.15.7:0/621271855 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f04f415f040 0x7f04f40b2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:16.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.162+0000 7f04fa69a640 1 --2- 172.21.15.7:0/621271855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04f415a940 0x7f04f40cc0c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:16.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.162+0000 7f04fa69a640 1 -- 172.21.15.7:0/621271855 >> 172.21.15.7:0/621271855 conn(0x7f04f40999f0 msgr2=0x7f04f40b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:16.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.162+0000 7f04fa69a640 1 -- 172.21.15.7:0/621271855 shutdown_connections 2024-04-25T09:56:16.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.162+0000 7f04fa69a640 1 -- 172.21.15.7:0/621271855 wait complete. 2024-04-25T09:56:16.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.163+0000 7f04fa69a640 1 Processor -- start 2024-04-25T09:56:16.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.163+0000 7f04fa69a640 1 -- start start 2024-04-25T09:56:16.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.164+0000 7f04fa69a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04f40ccfd0 0x7f04f40c3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:16.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.164+0000 7f04fa69a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04f415a940 0x7f04f4150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:16.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.164+0000 7f04fa69a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f04f415f040 0x7f04f41506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:16.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.164+0000 7f04fa69a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f40cbba0 con 0x7f04f415a940 2024-04-25T09:56:16.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.164+0000 7f04fa69a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f40cb8c0 con 0x7f04f40ccfd0 2024-04-25T09:56:16.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.164+0000 7f04fa69a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f40b2d40 con 0x7f04f415f040 2024-04-25T09:56:16.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.164+0000 7f04f37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04f415a940 0x7f04f4150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:16.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.164+0000 7f04f37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04f415a940 0x7f04f4150170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59094/0 (socket says 172.21.15.7:59094) 2024-04-25T09:56:16.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.164+0000 7f04f37fe640 1 -- 172.21.15.7:0/2936754902 learned_addr learned my addr 172.21.15.7:0/2936754902 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:16.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.164+0000 7f04f3fff640 1 --2- 172.21.15.7:0/2936754902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04f40ccfd0 0x7f04f40c3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:16.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.164+0000 7f04f8c37640 1 --2- 172.21.15.7:0/2936754902 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f04f415f040 0x7f04f41506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:16.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.164+0000 7f04f37fe640 1 -- 172.21.15.7:0/2936754902 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f04f415f040 msgr2=0x7f04f41506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:16.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.164+0000 7f04f37fe640 1 --2- 172.21.15.7:0/2936754902 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f04f415f040 0x7f04f41506b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:16.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.164+0000 7f04f37fe640 1 -- 172.21.15.7:0/2936754902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04f40ccfd0 msgr2=0x7f04f40c3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:16.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.164+0000 7f04f37fe640 1 --2- 172.21.15.7:0/2936754902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04f40ccfd0 0x7f04f40c3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:16.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.164+0000 7f04f37fe640 1 -- 172.21.15.7:0/2936754902 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f40ad620 con 0x7f04f415a940 2024-04-25T09:56:16.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.164+0000 7f04f8c37640 1 --2- 172.21.15.7:0/2936754902 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f04f415f040 0x7f04f41506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:56:16.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.165+0000 7f04f37fe640 1 --2- 172.21.15.7:0/2936754902 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04f415a940 0x7f04f4150170 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f04e800e870 tx=0x7f04e800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:16.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.165+0000 7f04f0ff9640 1 -- 172.21.15.7:0/2936754902 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e8017070 con 0x7f04f415a940 2024-04-25T09:56:16.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.165+0000 7f04f0ff9640 1 -- 172.21.15.7:0/2936754902 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e800c940 con 0x7f04f415a940 2024-04-25T09:56:16.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.165+0000 7f04fa69a640 1 -- 172.21.15.7:0/2936754902 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f40ad900 con 0x7f04f415a940 2024-04-25T09:56:16.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.165+0000 7f04f0ff9640 1 -- 172.21.15.7:0/2936754902 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e800cd30 con 0x7f04f415a940 2024-04-25T09:56:16.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.165+0000 7f04fa69a640 1 -- 172.21.15.7:0/2936754902 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f40adec0 con 0x7f04f415a940 2024-04-25T09:56:16.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.166+0000 7f04fa69a640 1 -- 172.21.15.7:0/2936754902 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f415a140 con 0x7f04f415a940 2024-04-25T09:56:16.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.166+0000 7f04f0ff9640 1 -- 172.21.15.7:0/2936754902 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f04e801a070 con 0x7f04f415a940 2024-04-25T09:56:16.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.167+0000 7f04f0ff9640 1 --2- 172.21.15.7:0/2936754902 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f04e006b4d0 0x7f04e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:16.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.167+0000 7f04f0ff9640 1 -- 172.21.15.7:0/2936754902 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f04e808a640 con 0x7f04f415a940 2024-04-25T09:56:16.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.167+0000 7f04f3fff640 1 --2- 172.21.15.7:0/2936754902 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f04e006b4d0 0x7f04e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:16.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.167+0000 7f04f3fff640 1 --2- 172.21.15.7:0/2936754902 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f04e006b4d0 0x7f04e006d990 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f04e4034000 tx=0x7f04e402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:16.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.171+0000 7f04f0ff9640 1 -- 172.21.15.7:0/2936754902 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f04f415a140 con 0x7f04f415a940 2024-04-25T09:56:16.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.391+0000 7f04fa69a640 1 -- 172.21.15.7:0/2936754902 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f04f4068f60 con 0x7f04f415a940 2024-04-25T09:56:16.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.412+0000 7f04f0ff9640 1 -- 172.21.15.7:0/2936754902 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v20) v1 ==== 118+0+0 (secure 0 0 0) 0x7f04e80592a0 con 0x7f04f415a940 2024-04-25T09:56:16.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.414+0000 7f04fa69a640 1 -- 172.21.15.7:0/2936754902 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f04e006b4d0 msgr2=0x7f04e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:16.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.414+0000 7f04fa69a640 1 --2- 172.21.15.7:0/2936754902 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f04e006b4d0 0x7f04e006d990 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f04e4034000 tx=0x7f04e402e000 comp rx=0 tx=0).stop 2024-04-25T09:56:16.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.414+0000 7f04fa69a640 1 -- 172.21.15.7:0/2936754902 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04f415a940 msgr2=0x7f04f4150170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:16.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.414+0000 7f04fa69a640 1 --2- 172.21.15.7:0/2936754902 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04f415a940 0x7f04f4150170 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f04e800e870 tx=0x7f04e800ed30 comp rx=0 tx=0).stop 2024-04-25T09:56:16.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.414+0000 7f04fa69a640 1 -- 172.21.15.7:0/2936754902 shutdown_connections 2024-04-25T09:56:16.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.414+0000 7f04fa69a640 1 --2- 172.21.15.7:0/2936754902 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f04e006b4d0 0x7f04e006d990 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:16.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.414+0000 7f04fa69a640 1 --2- 172.21.15.7:0/2936754902 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f04f415f040 0x7f04f41506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:16.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.414+0000 7f04fa69a640 1 --2- 172.21.15.7:0/2936754902 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04f415a940 0x7f04f4150170 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:16.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.414+0000 7f04fa69a640 1 --2- 172.21.15.7:0/2936754902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04f40ccfd0 0x7f04f40c3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:16.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.414+0000 7f04fa69a640 1 -- 172.21.15.7:0/2936754902 >> 172.21.15.7:0/2936754902 conn(0x7f04f40999f0 msgr2=0x7f04f406eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:16.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.414+0000 7f04fa69a640 1 -- 172.21.15.7:0/2936754902 shutdown_connections 2024-04-25T09:56:16.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.414+0000 7f04fa69a640 1 -- 172.21.15.7:0/2936754902 wait complete. 2024-04-25T09:56:16.430 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:56:16.430 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:56:16.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.530+0000 7f11e3553640 1 Processor -- start 2024-04-25T09:56:16.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.530+0000 7f11e3553640 1 -- start start 2024-04-25T09:56:16.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.531+0000 7f11e3553640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f11dc15a820 0x7f11dc15e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:16.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.531+0000 7f11e3553640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f11dc0d0940 0x7f11dc0cb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:16.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.531+0000 7f11e3553640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11dc15ec40 con 0x7f11dc0ccf90 2024-04-25T09:56:16.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.531+0000 7f11e3553640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11dc0c40d0 con 0x7f11dc0d0940 2024-04-25T09:56:16.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.531+0000 7f11e3553640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc15ef20 con 0x7f11dc15a820 2024-04-25T09:56:16.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.531+0000 7f11e1af0640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f11dc0d0940 0x7f11dc0cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:16.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.531+0000 7f11e1af0640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f11dc0d0940 0x7f11dc0cb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59104/0 (socket says 172.21.15.7:59104) 2024-04-25T09:56:16.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.531+0000 7f11e1af0640 1 -- 172.21.15.7:0/4233638256 learned_addr learned my addr 172.21.15.7:0/4233638256 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:16.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.532+0000 7f11e12ef640 1 --2- 172.21.15.7:0/4233638256 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f11dc15a820 0x7f11dc15e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:16.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.532+0000 7f11e1af0640 1 -- 172.21.15.7:0/4233638256 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f11dc15a820 msgr2=0x7f11dc15e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:16.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.532+0000 7f11e1af0640 1 --2- 172.21.15.7:0/4233638256 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f11dc15a820 0x7f11dc15e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:16.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.532+0000 7f11e1af0640 1 -- 172.21.15.7:0/4233638256 >> v1:172.21.15.55:6789/0 conn(0x7f11dc0ccf90 legacy=0x7f11dc0d0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:16.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.532+0000 7f11e1af0640 1 -- 172.21.15.7:0/4233638256 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11dc15f200 con 0x7f11dc0d0940 2024-04-25T09:56:16.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.532+0000 7f11e12ef640 1 --2- 172.21.15.7:0/4233638256 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f11dc15a820 0x7f11dc15e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:56:16.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.532+0000 7f11e1af0640 1 --2- 172.21.15.7:0/4233638256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11dc0d0940 0x7f11dc0cb990 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f11d4009e50 tx=0x7f11d402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af0e775b0157cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:16.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.533+0000 7f11d3fff640 1 -- 172.21.15.7:0/4233638256 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d4036070 con 0x7f11dc0d0940 2024-04-25T09:56:16.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.533+0000 7f11d3fff640 1 -- 172.21.15.7:0/4233638256 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d4031600 con 0x7f11dc0d0940 2024-04-25T09:56:16.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.533+0000 7f11d3fff640 1 -- 172.21.15.7:0/4233638256 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d40319d0 con 0x7f11dc0d0940 2024-04-25T09:56:16.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.533+0000 7f11e3553640 1 -- 172.21.15.7:0/4233638256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11dc0d0940 msgr2=0x7f11dc0cb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:16.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.533+0000 7f11e3553640 1 --2- 172.21.15.7:0/4233638256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11dc0d0940 0x7f11dc0cb990 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f11d4009e50 tx=0x7f11d402a6c0 comp rx=0 tx=0).stop 2024-04-25T09:56:16.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.533+0000 7f11e3553640 1 -- 172.21.15.7:0/4233638256 shutdown_connections 2024-04-25T09:56:16.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.533+0000 7f11e3553640 1 --2- 172.21.15.7:0/4233638256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11dc0d0940 0x7f11dc0cb990 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:16.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.533+0000 7f11e3553640 1 --2- 172.21.15.7:0/4233638256 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f11dc15a820 0x7f11dc15e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:16.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.533+0000 7f11e3553640 1 -- 172.21.15.7:0/4233638256 >> 172.21.15.7:0/4233638256 conn(0x7f11dc0725e0 msgr2=0x7f11dc0999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:16.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.533+0000 7f11e3553640 1 -- 172.21.15.7:0/4233638256 shutdown_connections 2024-04-25T09:56:16.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.533+0000 7f11e3553640 1 -- 172.21.15.7:0/4233638256 wait complete. 2024-04-25T09:56:16.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.534+0000 7f11e3553640 1 Processor -- start 2024-04-25T09:56:16.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.534+0000 7f11e3553640 1 -- start start 2024-04-25T09:56:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.535+0000 7f11e3553640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11dc0ccf90 0x7f11dc1eea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.535+0000 7f11e3553640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11dc0d0940 0x7f11dc1f1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.535+0000 7f11e3553640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f11dc15a820 0x7f11dc0cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.535+0000 7f11e3553640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc15ac00 con 0x7f11dc0d0940 2024-04-25T09:56:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.535+0000 7f11e3553640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc15e930 con 0x7f11dc0ccf90 2024-04-25T09:56:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.535+0000 7f11e3553640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc0cb090 con 0x7f11dc15a820 2024-04-25T09:56:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.535+0000 7f11e0aee640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11dc0d0940 0x7f11dc1f1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.535+0000 7f11e0aee640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11dc0d0940 0x7f11dc1f1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59114/0 (socket says 172.21.15.7:59114) 2024-04-25T09:56:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.535+0000 7f11e0aee640 1 -- 172.21.15.7:0/2465351465 learned_addr learned my addr 172.21.15.7:0/2465351465 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.535+0000 7f11e1af0640 1 --2- 172.21.15.7:0/2465351465 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f11dc15a820 0x7f11dc0cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.535+0000 7f11e12ef640 1 --2- 172.21.15.7:0/2465351465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11dc0ccf90 0x7f11dc1eea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.536+0000 7f11e0aee640 1 -- 172.21.15.7:0/2465351465 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f11dc15a820 msgr2=0x7f11dc0cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.536+0000 7f11e0aee640 1 --2- 172.21.15.7:0/2465351465 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f11dc15a820 0x7f11dc0cbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.536+0000 7f11e0aee640 1 -- 172.21.15.7:0/2465351465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11dc0ccf90 msgr2=0x7f11dc1eea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.536+0000 7f11e0aee640 1 --2- 172.21.15.7:0/2465351465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11dc0ccf90 0x7f11dc1eea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.536+0000 7f11e0aee640 1 -- 172.21.15.7:0/2465351465 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11dc0c8710 con 0x7f11dc0d0940 2024-04-25T09:56:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.536+0000 7f11e0aee640 1 --2- 172.21.15.7:0/2465351465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11dc0d0940 0x7f11dc1f1480 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f11cc00b3f0 tx=0x7f11cc00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.536+0000 7f11d1ffb640 1 -- 172.21.15.7:0/2465351465 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11cc015020 con 0x7f11dc0d0940 2024-04-25T09:56:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.536+0000 7f11d1ffb640 1 -- 172.21.15.7:0/2465351465 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11cc011830 con 0x7f11dc0d0940 2024-04-25T09:56:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.536+0000 7f11d1ffb640 1 -- 172.21.15.7:0/2465351465 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11cc011c20 con 0x7f11dc0d0940 2024-04-25T09:56:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.536+0000 7f11e3553640 1 -- 172.21.15.7:0/2465351465 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11dc0c89f0 con 0x7f11dc0d0940 2024-04-25T09:56:16.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.536+0000 7f11e3553640 1 -- 172.21.15.7:0/2465351465 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11dc0c8fb0 con 0x7f11dc0d0940 2024-04-25T09:56:16.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.537+0000 7f11e3553640 1 -- 172.21.15.7:0/2465351465 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11dc068f60 con 0x7f11dc0d0940 2024-04-25T09:56:16.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.538+0000 7f11d1ffb640 1 -- 172.21.15.7:0/2465351465 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f11cc018020 con 0x7f11dc0d0940 2024-04-25T09:56:16.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.538+0000 7f11d1ffb640 1 --2- 172.21.15.7:0/2465351465 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f11c006b4d0 0x7f11c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.538+0000 7f11e12ef640 1 --2- 172.21.15.7:0/2465351465 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f11c006b4d0 0x7f11c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.538+0000 7f11d1ffb640 1 -- 172.21.15.7:0/2465351465 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f11cc089e40 con 0x7f11dc0d0940 2024-04-25T09:56:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.539+0000 7f11e12ef640 1 --2- 172.21.15.7:0/2465351465 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f11c006b4d0 0x7f11c006d990 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f11dc073df0 tx=0x7f11d8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:16.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.542+0000 7f11d1ffb640 1 -- 172.21.15.7:0/2465351465 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f11cc01f030 con 0x7f11dc0d0940 2024-04-25T09:56:16.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:16.762+0000 7f11e3553640 1 -- 172.21.15.7:0/2465351465 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f11dc0d10d0 con 0x7f11dc0d0940 2024-04-25T09:56:17.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.421+0000 7f11d1ffb640 1 -- 172.21.15.7:0/2465351465 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v21) v1 ==== 122+0+0 (secure 0 0 0) 0x7f11cc058550 con 0x7f11dc0d0940 2024-04-25T09:56:17.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.424+0000 7f11e3553640 1 -- 172.21.15.7:0/2465351465 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f11c006b4d0 msgr2=0x7f11c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:17.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.424+0000 7f11e3553640 1 --2- 172.21.15.7:0/2465351465 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f11c006b4d0 0x7f11c006d990 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f11dc073df0 tx=0x7f11d8008040 comp rx=0 tx=0).stop 2024-04-25T09:56:17.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.424+0000 7f11e3553640 1 -- 172.21.15.7:0/2465351465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11dc0d0940 msgr2=0x7f11dc1f1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:17.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.424+0000 7f11e3553640 1 --2- 172.21.15.7:0/2465351465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11dc0d0940 0x7f11dc1f1480 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f11cc00b3f0 tx=0x7f11cc00b8b0 comp rx=0 tx=0).stop 2024-04-25T09:56:17.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.424+0000 7f11e3553640 1 -- 172.21.15.7:0/2465351465 shutdown_connections 2024-04-25T09:56:17.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.424+0000 7f11e3553640 1 --2- 172.21.15.7:0/2465351465 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f11c006b4d0 0x7f11c006d990 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:17.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.424+0000 7f11e3553640 1 --2- 172.21.15.7:0/2465351465 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f11dc15a820 0x7f11dc0cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:17.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.424+0000 7f11e3553640 1 --2- 172.21.15.7:0/2465351465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11dc0d0940 0x7f11dc1f1480 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:17.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.424+0000 7f11e3553640 1 --2- 172.21.15.7:0/2465351465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11dc0ccf90 0x7f11dc1eea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:17.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.424+0000 7f11e3553640 1 -- 172.21.15.7:0/2465351465 >> 172.21.15.7:0/2465351465 conn(0x7f11dc0725e0 msgr2=0x7f11dc0d0230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:17.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.424+0000 7f11e3553640 1 -- 172.21.15.7:0/2465351465 shutdown_connections 2024-04-25T09:56:17.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.424+0000 7f11e3553640 1 -- 172.21.15.7:0/2465351465 wait complete. 2024-04-25T09:56:17.441 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:56:17.441 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:56:17.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.545+0000 7f1db6b10640 1 Processor -- start 2024-04-25T09:56:17.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.545+0000 7f1db6b10640 1 -- start start 2024-04-25T09:56:17.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.545+0000 7f1db6b10640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1db01529e0 0x7f1db00c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:17.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.546+0000 7f1db6b10640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1db00cea60 0x7f1db006d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:17.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.546+0000 7f1db6b10640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db015bdc0 con 0x7f1db00c6410 2024-04-25T09:56:17.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.546+0000 7f1db6b10640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db00b2340 con 0x7f1db01529e0 2024-04-25T09:56:17.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.546+0000 7f1db6b10640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db015c060 con 0x7f1db00cea60 2024-04-25T09:56:17.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.546+0000 7f1db48ac640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1db01529e0 0x7f1db00c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:17.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.546+0000 7f1db48ac640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1db01529e0 0x7f1db00c5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59122/0 (socket says 172.21.15.7:59122) 2024-04-25T09:56:17.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.546+0000 7f1daffff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1db00c6410 0x7f1db00ce350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53700/0 (socket says 172.21.15.7:53700) 2024-04-25T09:56:17.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.546+0000 7f1db48ac640 1 -- 172.21.15.7:0/1019211867 learned_addr learned my addr 172.21.15.7:0/1019211867 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:17.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.546+0000 7f1db50ad640 1 --2- 172.21.15.7:0/1019211867 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1db00cea60 0x7f1db006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:17.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.546+0000 7f1db48ac640 1 -- 172.21.15.7:0/1019211867 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1db00cea60 msgr2=0x7f1db006d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:17.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.546+0000 7f1db48ac640 1 --2- 172.21.15.7:0/1019211867 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1db00cea60 0x7f1db006d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:17.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.546+0000 7f1db48ac640 1 -- 172.21.15.7:0/1019211867 >> v1:172.21.15.7:6789/0 conn(0x7f1db00c6410 legacy=0x7f1db00ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:17.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.546+0000 7f1db48ac640 1 -- 172.21.15.7:0/1019211867 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db015c340 con 0x7f1db01529e0 2024-04-25T09:56:17.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.546+0000 7f1daf7fe640 1 -- 172.21.15.7:0/1019211867 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3840932651 0 0) 0x7f1db015bdc0 con 0x7f1db00c6410 2024-04-25T09:56:17.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.546+0000 7f1db50ad640 1 --2- 172.21.15.7:0/1019211867 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1db00cea60 0x7f1db006d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:56:17.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.547+0000 7f1db48ac640 1 --2- 172.21.15.7:0/1019211867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db01529e0 0x7f1db00c5ed0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1da8009e50 tx=0x7f1da802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91129d5af5e96da8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:17.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.547+0000 7f1daf7fe640 1 -- 172.21.15.7:0/1019211867 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da8036070 con 0x7f1db01529e0 2024-04-25T09:56:17.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.547+0000 7f1daf7fe640 1 -- 172.21.15.7:0/1019211867 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da8031600 con 0x7f1db01529e0 2024-04-25T09:56:17.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.547+0000 7f1daf7fe640 1 -- 172.21.15.7:0/1019211867 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da80319d0 con 0x7f1db01529e0 2024-04-25T09:56:17.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.547+0000 7f1db6b10640 1 -- 172.21.15.7:0/1019211867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db01529e0 msgr2=0x7f1db00c5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:17.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.547+0000 7f1db6b10640 1 --2- 172.21.15.7:0/1019211867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db01529e0 0x7f1db00c5ed0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1da8009e50 tx=0x7f1da802a710 comp rx=0 tx=0).stop 2024-04-25T09:56:17.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.547+0000 7f1db6b10640 1 -- 172.21.15.7:0/1019211867 shutdown_connections 2024-04-25T09:56:17.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.547+0000 7f1db6b10640 1 --2- 172.21.15.7:0/1019211867 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1db00cea60 0x7f1db006d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:17.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.548+0000 7f1db6b10640 1 --2- 172.21.15.7:0/1019211867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db01529e0 0x7f1db00c5ed0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:17.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.548+0000 7f1db6b10640 1 -- 172.21.15.7:0/1019211867 >> 172.21.15.7:0/1019211867 conn(0x7f1db0071150 msgr2=0x7f1db0071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:17.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.548+0000 7f1db6b10640 1 -- 172.21.15.7:0/1019211867 shutdown_connections 2024-04-25T09:56:17.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.548+0000 7f1db6b10640 1 -- 172.21.15.7:0/1019211867 wait complete. 2024-04-25T09:56:17.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.549+0000 7f1db6b10640 1 Processor -- start 2024-04-25T09:56:17.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.549+0000 7f1db6b10640 1 -- start start 2024-04-25T09:56:17.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.550+0000 7f1db6b10640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1db00c6410 0x7f1db0152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:17.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.550+0000 7f1db6b10640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1db00cea60 0x7f1db01539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:17.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.550+0000 7f1db6b10640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db01e6870 0x7f1db0142b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:17.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.550+0000 7f1db6b10640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db0071ed0 con 0x7f1db01e6870 2024-04-25T09:56:17.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.550+0000 7f1db6b10640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db015c900 con 0x7f1db00c6410 2024-04-25T09:56:17.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.550+0000 7f1db6b10640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db0072050 con 0x7f1db00cea60 2024-04-25T09:56:17.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.550+0000 7f1db50ad640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db01e6870 0x7f1db0142b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:17.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.550+0000 7f1db50ad640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db01e6870 0x7f1db0142b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59130/0 (socket says 172.21.15.7:59130) 2024-04-25T09:56:17.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.550+0000 7f1db50ad640 1 -- 172.21.15.7:0/2848996056 learned_addr learned my addr 172.21.15.7:0/2848996056 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:17.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.550+0000 7f1daffff640 1 --2- 172.21.15.7:0/2848996056 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1db00cea60 0x7f1db01539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:17.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.550+0000 7f1db48ac640 1 --2- 172.21.15.7:0/2848996056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1db00c6410 0x7f1db0152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:17.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.550+0000 7f1db50ad640 1 -- 172.21.15.7:0/2848996056 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1db00cea60 msgr2=0x7f1db01539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:17.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.550+0000 7f1db50ad640 1 --2- 172.21.15.7:0/2848996056 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1db00cea60 0x7f1db01539c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:17.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.550+0000 7f1db50ad640 1 -- 172.21.15.7:0/2848996056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1db00c6410 msgr2=0x7f1db0152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:17.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.550+0000 7f1db50ad640 1 --2- 172.21.15.7:0/2848996056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1db00c6410 0x7f1db0152dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:17.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.550+0000 7f1db50ad640 1 -- 172.21.15.7:0/2848996056 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db01e6e30 con 0x7f1db01e6870 2024-04-25T09:56:17.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.550+0000 7f1db50ad640 1 --2- 172.21.15.7:0/2848996056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db01e6870 0x7f1db0142b30 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1da000c5d0 tx=0x7f1da000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:17.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.551+0000 7f1dad7fa640 1 -- 172.21.15.7:0/2848996056 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da0015070 con 0x7f1db01e6870 2024-04-25T09:56:17.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.551+0000 7f1dad7fa640 1 -- 172.21.15.7:0/2848996056 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da0004240 con 0x7f1db01e6870 2024-04-25T09:56:17.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.551+0000 7f1db6b10640 1 -- 172.21.15.7:0/2848996056 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db01e7110 con 0x7f1db01e6870 2024-04-25T09:56:17.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.551+0000 7f1dad7fa640 1 -- 172.21.15.7:0/2848996056 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da0003610 con 0x7f1db01e6870 2024-04-25T09:56:17.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.551+0000 7f1db6b10640 1 -- 172.21.15.7:0/2848996056 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db01e76d0 con 0x7f1db01e6870 2024-04-25T09:56:17.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.552+0000 7f1db6b10640 1 -- 172.21.15.7:0/2848996056 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db0068fd0 con 0x7f1db01e6870 2024-04-25T09:56:17.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.552+0000 7f1dad7fa640 1 -- 172.21.15.7:0/2848996056 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1da00037b0 con 0x7f1db01e6870 2024-04-25T09:56:17.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.552+0000 7f1dad7fa640 1 --2- 172.21.15.7:0/2848996056 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1d9006b500 0x7f1d9006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:17.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.553+0000 7f1dad7fa640 1 -- 172.21.15.7:0/2848996056 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1da008a160 con 0x7f1db01e6870 2024-04-25T09:56:17.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.553+0000 7f1db48ac640 1 --2- 172.21.15.7:0/2848996056 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1d9006b500 0x7f1d9006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:17.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.553+0000 7f1db48ac640 1 --2- 172.21.15.7:0/2848996056 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1d9006b500 0x7f1d9006d9c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1da8033000 tx=0x7f1da8009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:17.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.557+0000 7f1dad7fa640 1 -- 172.21.15.7:0/2848996056 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1da0058e50 con 0x7f1db01e6870 2024-04-25T09:56:17.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.775+0000 7f1db6b10640 1 -- 172.21.15.7:0/2848996056 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1db00b1cb0 con 0x7f1db01e6870 2024-04-25T09:56:17.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.775+0000 7f1dad7fa640 1 -- 172.21.15.7:0/2848996056 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4932 (secure 0 0 0) 0x7f1da0058750 con 0x7f1db01e6870 2024-04-25T09:56:17.779 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:17.779 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5072,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1716545079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1716545079},{"type":"v1","addr":"172.21.15.7:6837","nonce":1716545079}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5434,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1851611776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1851611776},{"type":"v1","addr":"172.21.15.55:6834","nonce":1851611776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2607486300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2607486300},{"type":"v1","addr":"172.21.15.55:6835","nonce":2607486300}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:56:14.756973+0000","modified":"2024-04-25T09:56:16.763894+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5820":{"gid":5820,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6836/2232311564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2232311564},{"type":"v1","addr":"172.21.15.7:6836","nonce":2232311564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:56:17.779 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 21 2024-04-25T09:56:17.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.777+0000 7f1db6b10640 1 -- 172.21.15.7:0/2848996056 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1d9006b500 msgr2=0x7f1d9006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:17.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.777+0000 7f1db6b10640 1 --2- 172.21.15.7:0/2848996056 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1d9006b500 0x7f1d9006d9c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1da8033000 tx=0x7f1da8009000 comp rx=0 tx=0).stop 2024-04-25T09:56:17.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.777+0000 7f1db6b10640 1 -- 172.21.15.7:0/2848996056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db01e6870 msgr2=0x7f1db0142b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:17.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.777+0000 7f1db6b10640 1 --2- 172.21.15.7:0/2848996056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db01e6870 0x7f1db0142b30 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1da000c5d0 tx=0x7f1da000ca90 comp rx=0 tx=0).stop 2024-04-25T09:56:17.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.777+0000 7f1db6b10640 1 -- 172.21.15.7:0/2848996056 shutdown_connections 2024-04-25T09:56:17.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.777+0000 7f1db6b10640 1 --2- 172.21.15.7:0/2848996056 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1d9006b500 0x7f1d9006d9c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:17.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.777+0000 7f1db6b10640 1 --2- 172.21.15.7:0/2848996056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1db01e6870 0x7f1db0142b30 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:17.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.777+0000 7f1db6b10640 1 --2- 172.21.15.7:0/2848996056 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1db00cea60 0x7f1db01539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:17.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.777+0000 7f1db6b10640 1 --2- 172.21.15.7:0/2848996056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1db00c6410 0x7f1db0152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:17.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.777+0000 7f1db6b10640 1 -- 172.21.15.7:0/2848996056 >> 172.21.15.7:0/2848996056 conn(0x7f1db0071150 msgr2=0x7f1db0158b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:17.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.777+0000 7f1db6b10640 1 -- 172.21.15.7:0/2848996056 shutdown_connections 2024-04-25T09:56:17.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.778+0000 7f1db6b10640 1 -- 172.21.15.7:0/2848996056 wait complete. 2024-04-25T09:56:17.792 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:56:17.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.890+0000 7fd183e4d640 1 Processor -- start 2024-04-25T09:56:17.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.890+0000 7fd183e4d640 1 -- start start 2024-04-25T09:56:17.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.891+0000 7fd183e4d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd17c0b6a40 0x7fd17c06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:17.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.891+0000 7fd183e4d640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd17c06cd00 con 0x7fd17c15dd00 2024-04-25T09:56:17.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.891+0000 7fd183e4d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd17c0d1ca0 con 0x7fd17c0b5e60 2024-04-25T09:56:17.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.891+0000 7fd183e4d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c15e0e0 con 0x7fd17c0b6a40 2024-04-25T09:56:17.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.891+0000 7fd181be9640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd17c15dd00 0x7fd17c0b5750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53716/0 (socket says 172.21.15.7:53716) 2024-04-25T09:56:17.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.891+0000 7fd181be9640 1 -- 172.21.15.7:0/2683242373 learned_addr learned my addr 172.21.15.7:0/2683242373 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:56:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.891+0000 7fd1823ea640 1 --2- 172.21.15.7:0/2683242373 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd17c0b6a40 0x7fd17c06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.891+0000 7fd180be7640 1 -- 172.21.15.7:0/2683242373 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3700156695 0 0) 0x7fd17c06cd00 con 0x7fd17c15dd00 2024-04-25T09:56:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.892+0000 7fd180be7640 1 -- 172.21.15.7:0/2683242373 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd164003520 con 0x7fd17c15dd00 2024-04-25T09:56:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.892+0000 7fd180be7640 1 -- 172.21.15.7:0/2683242373 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 768296502 0 0) 0x7fd164003520 con 0x7fd17c15dd00 2024-04-25T09:56:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.892+0000 7fd180be7640 1 -- 172.21.15.7:0/2683242373 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd17c0b6a40 msgr2=0x7fd17c06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.892+0000 7fd180be7640 1 --2- 172.21.15.7:0/2683242373 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd17c0b6a40 0x7fd17c06c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.892+0000 7fd180be7640 1 -- 172.21.15.7:0/2683242373 >> v1:172.21.15.55:6789/0 conn(0x7fd17c0b5e60 legacy=0x7fd17c06bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.892+0000 7fd180be7640 1 -- 172.21.15.7:0/2683242373 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17c0d1f80 con 0x7fd17c15dd00 2024-04-25T09:56:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.892+0000 7fd180be7640 1 -- 172.21.15.7:0/2683242373 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fd174001670 con 0x7fd17c15dd00 2024-04-25T09:56:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.892+0000 7fd180be7640 1 -- 172.21.15.7:0/2683242373 >> v1:172.21.15.7:6789/0 conn(0x7fd17c15dd00 legacy=0x7fd17c0b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.892+0000 7fd180be7640 1 --2- 172.21.15.7:0/2683242373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1640039e0 0x7fd164003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.892+0000 7fd180be7640 1 --2- 172.21.15.7:0/2683242373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd164004390 0x7fd164004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.892+0000 7fd180be7640 1 --2- 172.21.15.7:0/2683242373 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd17c0b6a40 0x7fd1640050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.892+0000 7fd180be7640 1 -- 172.21.15.7:0/2683242373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c15e0e0 con 0x7fd1640039e0 2024-04-25T09:56:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.892+0000 7fd180be7640 1 -- 172.21.15.7:0/2683242373 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16400b9c0 con 0x7fd164004390 2024-04-25T09:56:17.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.892+0000 7fd180be7640 1 -- 172.21.15.7:0/2683242373 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd16400bbc0 con 0x7fd17c0b6a40 2024-04-25T09:56:17.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.892+0000 7fd181be9640 1 --2- 172.21.15.7:0/2683242373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1640039e0 0x7fd164003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:17.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.892+0000 7fd1813e8640 1 --2- 172.21.15.7:0/2683242373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd164004390 0x7fd164004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:17.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.892+0000 7fd1823ea640 1 --2- 172.21.15.7:0/2683242373 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd17c0b6a40 0x7fd1640050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:17.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.892+0000 7fd181be9640 1 -- 172.21.15.7:0/2683242373 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd17c0b6a40 msgr2=0x7fd1640050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:17.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.892+0000 7fd181be9640 1 --2- 172.21.15.7:0/2683242373 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd17c0b6a40 0x7fd1640050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:17.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.892+0000 7fd181be9640 1 -- 172.21.15.7:0/2683242373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd164004390 msgr2=0x7fd164004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:17.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.892+0000 7fd181be9640 1 --2- 172.21.15.7:0/2683242373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd164004390 0x7fd164004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:17.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.892+0000 7fd181be9640 1 -- 172.21.15.7:0/2683242373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd164003520 con 0x7fd1640039e0 2024-04-25T09:56:17.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.893+0000 7fd181be9640 1 --2- 172.21.15.7:0/2683242373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1640039e0 0x7fd164003dc0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fd17400c290 tx=0x7fd164005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d221c91607adca64 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:17.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.893+0000 7fd180be7640 1 -- 172.21.15.7:0/2683242373 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd174007d50 con 0x7fd1640039e0 2024-04-25T09:56:17.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.893+0000 7fd180be7640 1 -- 172.21.15.7:0/2683242373 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd174005af0 con 0x7fd1640039e0 2024-04-25T09:56:17.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.893+0000 7fd180be7640 1 -- 172.21.15.7:0/2683242373 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd174007070 con 0x7fd1640039e0 2024-04-25T09:56:17.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.894+0000 7fd183e4d640 1 -- 172.21.15.7:0/2683242373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1640039e0 msgr2=0x7fd164003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:17.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.894+0000 7fd183e4d640 1 --2- 172.21.15.7:0/2683242373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1640039e0 0x7fd164003dc0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fd17400c290 tx=0x7fd164005830 comp rx=0 tx=0).stop 2024-04-25T09:56:17.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.894+0000 7fd1823ea640 1 -- 172.21.15.7:0/2683242373 reap_dead start 2024-04-25T09:56:17.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.894+0000 7fd183e4d640 1 -- 172.21.15.7:0/2683242373 shutdown_connections 2024-04-25T09:56:17.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.894+0000 7fd183e4d640 1 -- 172.21.15.7:0/2683242373 >> 172.21.15.7:0/2683242373 conn(0x7fd17c0d07b0 msgr2=0x7fd17c0d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:17.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.894+0000 7fd183e4d640 1 -- 172.21.15.7:0/2683242373 shutdown_connections 2024-04-25T09:56:17.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.894+0000 7fd183e4d640 1 -- 172.21.15.7:0/2683242373 wait complete. 2024-04-25T09:56:17.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.895+0000 7fd183e4d640 1 Processor -- start 2024-04-25T09:56:17.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.895+0000 7fd183e4d640 1 -- start start 2024-04-25T09:56:17.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.896+0000 7fd183e4d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1640039e0 0x7fd17c14fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:17.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.896+0000 7fd183e4d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd17c0cd3f0 0x7fd17c15e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:17.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.896+0000 7fd183e4d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd17c158170 0x7fd17c1585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:17.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.896+0000 7fd183e4d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c06c6c0 con 0x7fd1640039e0 2024-04-25T09:56:17.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.896+0000 7fd183e4d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c06cfe0 con 0x7fd17c0cd3f0 2024-04-25T09:56:17.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.896+0000 7fd183e4d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c06c840 con 0x7fd17c158170 2024-04-25T09:56:17.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.896+0000 7fd181be9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1640039e0 0x7fd17c14fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:17.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.896+0000 7fd181be9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1640039e0 0x7fd17c14fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59154/0 (socket says 172.21.15.7:59154) 2024-04-25T09:56:17.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.896+0000 7fd181be9640 1 -- 172.21.15.7:0/3197159203 learned_addr learned my addr 172.21.15.7:0/3197159203 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:17.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.896+0000 7fd1813e8640 1 --2- 172.21.15.7:0/3197159203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd17c0cd3f0 0x7fd17c15e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:17.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.896+0000 7fd181be9640 1 -- 172.21.15.7:0/3197159203 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd17c158170 msgr2=0x7fd17c1585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:17.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.896+0000 7fd1823ea640 1 --2- 172.21.15.7:0/3197159203 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd17c158170 0x7fd17c1585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:17.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.896+0000 7fd181be9640 1 --2- 172.21.15.7:0/3197159203 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd17c158170 0x7fd17c1585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:17.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.896+0000 7fd181be9640 1 -- 172.21.15.7:0/3197159203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd17c0cd3f0 msgr2=0x7fd17c15e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:17.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.896+0000 7fd181be9640 1 --2- 172.21.15.7:0/3197159203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd17c0cd3f0 0x7fd17c15e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:17.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.896+0000 7fd181be9640 1 -- 172.21.15.7:0/3197159203 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17c150390 con 0x7fd1640039e0 2024-04-25T09:56:17.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.896+0000 7fd1823ea640 1 --2- 172.21.15.7:0/3197159203 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd17c158170 0x7fd17c1585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:56:17.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.896+0000 7fd1813e8640 1 --2- 172.21.15.7:0/3197159203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd17c0cd3f0 0x7fd17c15e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:56:17.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.896+0000 7fd181be9640 1 --2- 172.21.15.7:0/3197159203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1640039e0 0x7fd17c14fe50 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd17402ae50 tx=0x7fd174001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:17.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.896+0000 7fd17a7fc640 1 -- 172.21.15.7:0/3197159203 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd174042070 con 0x7fd1640039e0 2024-04-25T09:56:17.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.896+0000 7fd17a7fc640 1 -- 172.21.15.7:0/3197159203 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1740074a0 con 0x7fd1640039e0 2024-04-25T09:56:17.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.897+0000 7fd17a7fc640 1 -- 172.21.15.7:0/3197159203 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd174007d50 con 0x7fd1640039e0 2024-04-25T09:56:17.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.897+0000 7fd183e4d640 1 -- 172.21.15.7:0/3197159203 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd17c15ebd0 con 0x7fd1640039e0 2024-04-25T09:56:17.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.897+0000 7fd183e4d640 1 -- 172.21.15.7:0/3197159203 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd17c15f190 con 0x7fd1640039e0 2024-04-25T09:56:17.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.897+0000 7fd183e4d640 1 -- 172.21.15.7:0/3197159203 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd17c068fd0 con 0x7fd1640039e0 2024-04-25T09:56:17.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.898+0000 7fd17a7fc640 1 -- 172.21.15.7:0/3197159203 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd174045070 con 0x7fd1640039e0 2024-04-25T09:56:17.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.898+0000 7fd17a7fc640 1 --2- 172.21.15.7:0/3197159203 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd16806b500 0x7fd16806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:17.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.898+0000 7fd17a7fc640 1 -- 172.21.15.7:0/3197159203 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd1740ab2e0 con 0x7fd1640039e0 2024-04-25T09:56:17.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.898+0000 7fd1813e8640 1 --2- 172.21.15.7:0/3197159203 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd16806b500 0x7fd16806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:17.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.899+0000 7fd1813e8640 1 --2- 172.21.15.7:0/3197159203 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd16806b500 0x7fd16806d9c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd17c15d3c0 tx=0x7fd170009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:17.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:17.903+0000 7fd17a7fc640 1 -- 172.21.15.7:0/3197159203 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd174005ac0 con 0x7fd1640039e0 2024-04-25T09:56:18.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.084+0000 7fd183e4d640 1 -- 172.21.15.7:0/3197159203 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd17c0d1620 con 0x7fd1640039e0 2024-04-25T09:56:18.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.085+0000 7fd17a7fc640 1 -- 172.21.15.7:0/3197159203 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16846 (secure 0 0 0) 0x7fd174079980 con 0x7fd1640039e0 2024-04-25T09:56:18.089 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:18.089 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":51,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:56:16.391447+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:56:13.032097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T09:56:13.732257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:56:18.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.087+0000 7fd183e4d640 1 -- 172.21.15.7:0/3197159203 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd16806b500 msgr2=0x7fd16806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:18.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.087+0000 7fd183e4d640 1 --2- 172.21.15.7:0/3197159203 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd16806b500 0x7fd16806d9c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd17c15d3c0 tx=0x7fd170009040 comp rx=0 tx=0).stop 2024-04-25T09:56:18.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.087+0000 7fd183e4d640 1 -- 172.21.15.7:0/3197159203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1640039e0 msgr2=0x7fd17c14fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:18.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.087+0000 7fd183e4d640 1 --2- 172.21.15.7:0/3197159203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1640039e0 0x7fd17c14fe50 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd17402ae50 tx=0x7fd174001a40 comp rx=0 tx=0).stop 2024-04-25T09:56:18.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.087+0000 7fd183e4d640 1 -- 172.21.15.7:0/3197159203 shutdown_connections 2024-04-25T09:56:18.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.087+0000 7fd183e4d640 1 --2- 172.21.15.7:0/3197159203 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd16806b500 0x7fd16806d9c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:18.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.087+0000 7fd183e4d640 1 --2- 172.21.15.7:0/3197159203 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd17c158170 0x7fd17c1585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:18.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.087+0000 7fd183e4d640 1 --2- 172.21.15.7:0/3197159203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd17c0cd3f0 0x7fd17c15e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:18.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.087+0000 7fd183e4d640 1 --2- 172.21.15.7:0/3197159203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1640039e0 0x7fd17c14fe50 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:18.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.087+0000 7fd183e4d640 1 -- 172.21.15.7:0/3197159203 >> 172.21.15.7:0/3197159203 conn(0x7fd17c0d07b0 msgr2=0x7fd17c0b4190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:18.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.087+0000 7fd183e4d640 1 -- 172.21.15.7:0/3197159203 shutdown_connections 2024-04-25T09:56:18.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.088+0000 7fd183e4d640 1 -- 172.21.15.7:0/3197159203 wait complete. 2024-04-25T09:56:18.102 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:56:18.102 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:56:18.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.199+0000 7fcd91f42640 1 Processor -- start 2024-04-25T09:56:18.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.199+0000 7fcd91f42640 1 -- start start 2024-04-25T09:56:18.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.200+0000 7fcd91f42640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcd8c0d0aa0 0x7fcd8c161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:18.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.200+0000 7fcd91f42640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcd8c1622b0 0x7fcd8c0ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:18.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.200+0000 7fcd91f42640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd8c15e8a0 con 0x7fcd8c15da60 2024-04-25T09:56:18.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.200+0000 7fcd91f42640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd8c15eb80 con 0x7fcd8c1622b0 2024-04-25T09:56:18.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.200+0000 7fcd91f42640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c15ee60 con 0x7fcd8c0d0aa0 2024-04-25T09:56:18.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.200+0000 7fcd8b7fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fcd8c15da60 0x7fcd8c15de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53726/0 (socket says 172.21.15.7:53726) 2024-04-25T09:56:18.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.200+0000 7fcd8b7fe640 1 -- 172.21.15.7:0/2830385081 learned_addr learned my addr 172.21.15.7:0/2830385081 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:56:18.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.200+0000 7fcd8bfff640 1 --2- 172.21.15.7:0/2830385081 >> v2:172.21.15.7:3300/0 conn(0x7fcd8c1622b0 0x7fcd8c0ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:18.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.200+0000 7fcd8a7fc640 1 -- 172.21.15.7:0/2830385081 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2005665687 0 0) 0x7fcd8c15e8a0 con 0x7fcd8c15da60 2024-04-25T09:56:18.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.200+0000 7fcd8a7fc640 1 -- 172.21.15.7:0/2830385081 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd74003520 con 0x7fcd8c15da60 2024-04-25T09:56:18.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.200+0000 7fcd8affd640 1 --2- 172.21.15.7:0/2830385081 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcd8c0d0aa0 0x7fcd8c161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:18.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.200+0000 7fcd8bfff640 1 -- 172.21.15.7:0/2830385081 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcd8c0d0aa0 msgr2=0x7fcd8c161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:18.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.200+0000 7fcd8bfff640 1 --2- 172.21.15.7:0/2830385081 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcd8c0d0aa0 0x7fcd8c161d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:18.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.200+0000 7fcd8bfff640 1 -- 172.21.15.7:0/2830385081 >> v1:172.21.15.7:6789/0 conn(0x7fcd8c15da60 legacy=0x7fcd8c15de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:18.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.200+0000 7fcd8bfff640 1 -- 172.21.15.7:0/2830385081 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8c161850 con 0x7fcd8c1622b0 2024-04-25T09:56:18.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.200+0000 7fcd8affd640 1 --2- 172.21.15.7:0/2830385081 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcd8c0d0aa0 0x7fcd8c161d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:56:18.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.201+0000 7fcd8bfff640 1 --2- 172.21.15.7:0/2830385081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd8c1622b0 0x7fcd8c0ce520 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fcd84009d90 tx=0x7fcd8402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d958e8a152d7a21 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:18.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.201+0000 7fcd8a7fc640 1 -- 172.21.15.7:0/2830385081 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd84031600 con 0x7fcd8c1622b0 2024-04-25T09:56:18.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.201+0000 7fcd8a7fc640 1 -- 172.21.15.7:0/2830385081 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd840317a0 con 0x7fcd8c1622b0 2024-04-25T09:56:18.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.201+0000 7fcd8a7fc640 1 -- 172.21.15.7:0/2830385081 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd84031b50 con 0x7fcd8c1622b0 2024-04-25T09:56:18.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.202+0000 7fcd91f42640 1 -- 172.21.15.7:0/2830385081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd8c1622b0 msgr2=0x7fcd8c0ce520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:18.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.202+0000 7fcd91f42640 1 --2- 172.21.15.7:0/2830385081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd8c1622b0 0x7fcd8c0ce520 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fcd84009d90 tx=0x7fcd8402a5d0 comp rx=0 tx=0).stop 2024-04-25T09:56:18.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.202+0000 7fcd91f42640 1 -- 172.21.15.7:0/2830385081 shutdown_connections 2024-04-25T09:56:18.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.202+0000 7fcd91f42640 1 --2- 172.21.15.7:0/2830385081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd8c1622b0 0x7fcd8c0ce520 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:18.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.202+0000 7fcd91f42640 1 --2- 172.21.15.7:0/2830385081 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcd8c0d0aa0 0x7fcd8c161d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:18.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.202+0000 7fcd91f42640 1 -- 172.21.15.7:0/2830385081 >> 172.21.15.7:0/2830385081 conn(0x7fcd8c06bfe0 msgr2=0x7fcd8c06c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:18.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.202+0000 7fcd91f42640 1 -- 172.21.15.7:0/2830385081 shutdown_connections 2024-04-25T09:56:18.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.202+0000 7fcd91f42640 1 -- 172.21.15.7:0/2830385081 wait complete. 2024-04-25T09:56:18.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.203+0000 7fcd91f42640 1 Processor -- start 2024-04-25T09:56:18.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.203+0000 7fcd91f42640 1 -- start start 2024-04-25T09:56:18.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.204+0000 7fcd91f42640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd8c0d0aa0 0x7fcd8c1f74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:18.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.204+0000 7fcd91f42640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcd8c15da60 0x7fcd8c15b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:18.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.204+0000 7fcd91f42640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd8c1622b0 0x7fcd8c15bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:18.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.204+0000 7fcd91f42640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c0cebe0 con 0x7fcd8c1622b0 2024-04-25T09:56:18.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.204+0000 7fcd91f42640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c0cea60 con 0x7fcd8c0d0aa0 2024-04-25T09:56:18.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.204+0000 7fcd91f42640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c0ced60 con 0x7fcd8c15da60 2024-04-25T09:56:18.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.204+0000 7fcd8bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd8c1622b0 0x7fcd8c15bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:18.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.204+0000 7fcd8bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd8c1622b0 0x7fcd8c15bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59170/0 (socket says 172.21.15.7:59170) 2024-04-25T09:56:18.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.204+0000 7fcd8bfff640 1 -- 172.21.15.7:0/1189297017 learned_addr learned my addr 172.21.15.7:0/1189297017 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:18.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.204+0000 7fcd8b7fe640 1 --2- 172.21.15.7:0/1189297017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd8c0d0aa0 0x7fcd8c1f74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:18.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.204+0000 7fcd8affd640 1 --2- 172.21.15.7:0/1189297017 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcd8c15da60 0x7fcd8c15b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:18.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.204+0000 7fcd8bfff640 1 -- 172.21.15.7:0/1189297017 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcd8c15da60 msgr2=0x7fcd8c15b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:18.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.204+0000 7fcd8bfff640 1 --2- 172.21.15.7:0/1189297017 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcd8c15da60 0x7fcd8c15b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:18.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.204+0000 7fcd8bfff640 1 -- 172.21.15.7:0/1189297017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd8c0d0aa0 msgr2=0x7fcd8c1f74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:18.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.204+0000 7fcd8bfff640 1 --2- 172.21.15.7:0/1189297017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd8c0d0aa0 0x7fcd8c1f74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:18.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.204+0000 7fcd8bfff640 1 -- 172.21.15.7:0/1189297017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8c0cda30 con 0x7fcd8c1622b0 2024-04-25T09:56:18.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.205+0000 7fcd8bfff640 1 --2- 172.21.15.7:0/1189297017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd8c1622b0 0x7fcd8c15bc60 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fcd84009eb0 tx=0x7fcd84004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:18.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.205+0000 7fcd73fff640 1 -- 172.21.15.7:0/1189297017 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8403f070 con 0x7fcd8c1622b0 2024-04-25T09:56:18.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.205+0000 7fcd73fff640 1 -- 172.21.15.7:0/1189297017 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd84030c00 con 0x7fcd8c1622b0 2024-04-25T09:56:18.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.205+0000 7fcd73fff640 1 -- 172.21.15.7:0/1189297017 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd84009450 con 0x7fcd8c1622b0 2024-04-25T09:56:18.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.205+0000 7fcd91f42640 1 -- 172.21.15.7:0/1189297017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd8c0cd480 con 0x7fcd8c1622b0 2024-04-25T09:56:18.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.205+0000 7fcd91f42640 1 -- 172.21.15.7:0/1189297017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd8c1f6a00 con 0x7fcd8c1622b0 2024-04-25T09:56:18.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.206+0000 7fcd91f42640 1 -- 172.21.15.7:0/1189297017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd8c068fd0 con 0x7fcd8c1622b0 2024-04-25T09:56:18.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.206+0000 7fcd73fff640 1 -- 172.21.15.7:0/1189297017 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcd8403b410 con 0x7fcd8c1622b0 2024-04-25T09:56:18.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.207+0000 7fcd73fff640 1 --2- 172.21.15.7:0/1189297017 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcd7806b500 0x7fcd7806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:18.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.207+0000 7fcd73fff640 1 -- 172.21.15.7:0/1189297017 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcd840ab4a0 con 0x7fcd8c1622b0 2024-04-25T09:56:18.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.207+0000 7fcd8b7fe640 1 --2- 172.21.15.7:0/1189297017 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcd7806b500 0x7fcd7806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:18.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.207+0000 7fcd8b7fe640 1 --2- 172.21.15.7:0/1189297017 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcd7806b500 0x7fcd7806d9c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c005880 tx=0x7fcd7c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:18.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.211+0000 7fcd73fff640 1 -- 172.21.15.7:0/1189297017 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcd8407a220 con 0x7fcd8c1622b0 2024-04-25T09:56:18.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.389+0000 7fcd91f42640 1 -- 172.21.15.7:0/1189297017 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcd8c0d1560 con 0x7fcd7806b500 2024-04-25T09:56:18.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.395+0000 7fcd73fff640 1 -- 172.21.15.7:0/1189297017 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+248778 (secure 0 0 0) 0x7fcd8c0d1560 con 0x7fcd7806b500 2024-04-25T09:56:18.401 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:18.403 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T09:56:18.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.398+0000 7fcd91f42640 1 -- 172.21.15.7:0/1189297017 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcd7806b500 msgr2=0x7fcd7806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:18.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.398+0000 7fcd91f42640 1 --2- 172.21.15.7:0/1189297017 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcd7806b500 0x7fcd7806d9c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c005880 tx=0x7fcd7c009040 comp rx=0 tx=0).stop 2024-04-25T09:56:18.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.398+0000 7fcd91f42640 1 -- 172.21.15.7:0/1189297017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd8c1622b0 msgr2=0x7fcd8c15bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:18.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.398+0000 7fcd91f42640 1 --2- 172.21.15.7:0/1189297017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd8c1622b0 0x7fcd8c15bc60 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fcd84009eb0 tx=0x7fcd84004a40 comp rx=0 tx=0).stop 2024-04-25T09:56:18.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.398+0000 7fcd91f42640 1 -- 172.21.15.7:0/1189297017 shutdown_connections 2024-04-25T09:56:18.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.398+0000 7fcd91f42640 1 --2- 172.21.15.7:0/1189297017 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcd7806b500 0x7fcd7806d9c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:18.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.398+0000 7fcd91f42640 1 --2- 172.21.15.7:0/1189297017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd8c1622b0 0x7fcd8c15bc60 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:18.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.398+0000 7fcd91f42640 1 --2- 172.21.15.7:0/1189297017 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcd8c15da60 0x7fcd8c15b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:18.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.398+0000 7fcd91f42640 1 --2- 172.21.15.7:0/1189297017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd8c0d0aa0 0x7fcd8c1f74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:18.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.398+0000 7fcd91f42640 1 -- 172.21.15.7:0/1189297017 >> 172.21.15.7:0/1189297017 conn(0x7fcd8c06bfe0 msgr2=0x7fcd8c15de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:18.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.398+0000 7fcd91f42640 1 -- 172.21.15.7:0/1189297017 shutdown_connections 2024-04-25T09:56:18.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.398+0000 7fcd91f42640 1 -- 172.21.15.7:0/1189297017 wait complete. 2024-04-25T09:56:18.412 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2024-04-25T09:56:17.877249+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":174,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255136,"kb_used_data":5680,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754719584,"statfs":{"total":773094113280,"available":772832854016,"internally_reserved":0,"allocated":5816320,"data_stored":3205836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":742,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.495639"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.400552+0000","last_change":"2024-04-25T09:56:14.400552+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.400552+0000","last_undegraded":"2024-04-25T09:56:14.400552+0000","last_fullsized":"2024-04-25T09:56:14.400552+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.419019+0000","last_change":"2024-04-25T09:56:15.414664+0000","last_active":"2024-04-25T09:56:15.419019+0000","last_peered":"2024-04-25T09:56:15.419019+0000","last_clean":"2024-04-25T09:56:15.419019+0000","last_became_active":"2024-04-25T09:56:15.414291+0000","last_became_peered":"2024-04-25T09:56:15.414291+0000","last_unstale":"2024-04-25T09:56:15.419019+0000","last_undegraded":"2024-04-25T09:56:15.419019+0000","last_fullsized":"2024-04-25T09:56:15.419019+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:57.405816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.405512+0000","last_change":"2024-04-25T09:56:14.405512+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.405512+0000","last_undegraded":"2024-04-25T09:56:14.405512+0000","last_fullsized":"2024-04-25T09:56:14.405512+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.418562+0000","last_change":"2024-04-25T09:56:15.413750+0000","last_active":"2024-04-25T09:56:15.418562+0000","last_peered":"2024-04-25T09:56:15.418562+0000","last_clean":"2024-04-25T09:56:15.418562+0000","last_became_active":"2024-04-25T09:56:15.413442+0000","last_became_peered":"2024-04-25T09:56:15.413442+0000","last_unstale":"2024-04-25T09:56:15.418562+0000","last_undegraded":"2024-04-25T09:56:15.418562+0000","last_fullsized":"2024-04-25T09:56:15.418562+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:05.088117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.412912+0000","last_change":"2024-04-25T09:56:15.403689+0000","last_active":"2024-04-25T09:56:15.412912+0000","last_peered":"2024-04-25T09:56:15.412912+0000","last_clean":"2024-04-25T09:56:15.412912+0000","last_became_active":"2024-04-25T09:56:15.403310+0000","last_became_peered":"2024-04-25T09:56:15.403310+0000","last_unstale":"2024-04-25T09:56:15.412912+0000","last_undegraded":"2024-04-25T09:56:15.412912+0000","last_fullsized":"2024-04-25T09:56:15.412912+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:32.473975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.399868+0000","last_change":"2024-04-25T09:56:14.399868+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.399868+0000","last_undegraded":"2024-04-25T09:56:14.399868+0000","last_fullsized":"2024-04-25T09:56:14.399868+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.400932+0000","last_change":"2024-04-25T09:56:14.400932+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.400932+0000","last_undegraded":"2024-04-25T09:56:14.400932+0000","last_fullsized":"2024-04-25T09:56:14.400932+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397566+0000","last_change":"2024-04-25T09:56:14.397566+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397566+0000","last_undegraded":"2024-04-25T09:56:14.397566+0000","last_fullsized":"2024-04-25T09:56:14.397566+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.399128+0000","last_change":"2024-04-25T09:56:14.399128+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.399128+0000","last_undegraded":"2024-04-25T09:56:14.399128+0000","last_fullsized":"2024-04-25T09:56:14.399128+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.399463+0000","last_change":"2024-04-25T09:56:14.399463+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.399463+0000","last_undegraded":"2024-04-25T09:56:14.399463+0000","last_fullsized":"2024-04-25T09:56:14.399463+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.401987+0000","last_change":"2024-04-25T09:56:14.401987+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.401987+0000","last_undegraded":"2024-04-25T09:56:14.401987+0000","last_fullsized":"2024-04-25T09:56:14.401987+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396299+0000","last_change":"2024-04-25T09:56:14.396299+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396299+0000","last_undegraded":"2024-04-25T09:56:14.396299+0000","last_fullsized":"2024-04-25T09:56:14.396299+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.398876+0000","last_change":"2024-04-25T09:56:14.398876+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.398876+0000","last_undegraded":"2024-04-25T09:56:14.398876+0000","last_fullsized":"2024-04-25T09:56:14.398876+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.400902+0000","last_change":"2024-04-25T09:56:14.400902+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.400902+0000","last_undegraded":"2024-04-25T09:56:14.400902+0000","last_fullsized":"2024-04-25T09:56:14.400902+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.418608+0000","last_change":"2024-04-25T09:56:15.412875+0000","last_active":"2024-04-25T09:56:15.418608+0000","last_peered":"2024-04-25T09:56:15.418608+0000","last_clean":"2024-04-25T09:56:15.418608+0000","last_became_active":"2024-04-25T09:56:15.410551+0000","last_became_peered":"2024-04-25T09:56:15.410551+0000","last_unstale":"2024-04-25T09:56:15.418608+0000","last_undegraded":"2024-04-25T09:56:15.418608+0000","last_fullsized":"2024-04-25T09:56:15.418608+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:52.657234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.398412+0000","last_change":"2024-04-25T09:56:14.398412+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.398412+0000","last_undegraded":"2024-04-25T09:56:14.398412+0000","last_fullsized":"2024-04-25T09:56:14.398412+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.404109+0000","last_change":"2024-04-25T09:56:14.404109+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.404109+0000","last_undegraded":"2024-04-25T09:56:14.404109+0000","last_fullsized":"2024-04-25T09:56:14.404109+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.420717+0000","last_change":"2024-04-25T09:56:15.415498+0000","last_active":"2024-04-25T09:56:15.420717+0000","last_peered":"2024-04-25T09:56:15.420717+0000","last_clean":"2024-04-25T09:56:15.420717+0000","last_became_active":"2024-04-25T09:56:15.415058+0000","last_became_peered":"2024-04-25T09:56:15.415058+0000","last_unstale":"2024-04-25T09:56:15.420717+0000","last_undegraded":"2024-04-25T09:56:15.420717+0000","last_fullsized":"2024-04-25T09:56:15.420717+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:08.074490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.400388+0000","last_change":"2024-04-25T09:56:14.400388+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.400388+0000","last_undegraded":"2024-04-25T09:56:14.400388+0000","last_fullsized":"2024-04-25T09:56:14.400388+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.419210+0000","last_change":"2024-04-25T09:56:15.415691+0000","last_active":"2024-04-25T09:56:15.419210+0000","last_peered":"2024-04-25T09:56:15.419210+0000","last_clean":"2024-04-25T09:56:15.419210+0000","last_became_active":"2024-04-25T09:56:15.410685+0000","last_became_peered":"2024-04-25T09:56:15.410685+0000","last_unstale":"2024-04-25T09:56:15.419210+0000","last_undegraded":"2024-04-25T09:56:15.419210+0000","last_fullsized":"2024-04-25T09:56:15.419210+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:40.524761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.407634+0000","last_change":"2024-04-25T09:56:15.406055+0000","last_active":"2024-04-25T09:56:15.407634+0000","last_peered":"2024-04-25T09:56:15.407634+0000","last_clean":"2024-04-25T09:56:15.407634+0000","last_became_active":"2024-04-25T09:56:15.405683+0000","last_became_peered":"2024-04-25T09:56:15.405683+0000","last_unstale":"2024-04-25T09:56:15.407634+0000","last_undegraded":"2024-04-25T09:56:15.407634+0000","last_fullsized":"2024-04-25T09:56:15.407634+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:56.579633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.398789+0000","last_change":"2024-04-25T09:56:14.398789+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.398789+0000","last_undegraded":"2024-04-25T09:56:14.398789+0000","last_fullsized":"2024-04-25T09:56:14.398789+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.402466+0000","last_change":"2024-04-25T09:56:14.402466+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.402466+0000","last_undegraded":"2024-04-25T09:56:14.402466+0000","last_fullsized":"2024-04-25T09:56:14.402466+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.399899+0000","last_change":"2024-04-25T09:56:14.399899+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.399899+0000","last_undegraded":"2024-04-25T09:56:14.399899+0000","last_fullsized":"2024-04-25T09:56:14.399899+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.403666+0000","last_change":"2024-04-25T09:56:14.403666+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.403666+0000","last_undegraded":"2024-04-25T09:56:14.403666+0000","last_fullsized":"2024-04-25T09:56:14.403666+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397725+0000","last_change":"2024-04-25T09:56:14.397725+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397725+0000","last_undegraded":"2024-04-25T09:56:14.397725+0000","last_fullsized":"2024-04-25T09:56:14.397725+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397960+0000","last_change":"2024-04-25T09:56:14.397960+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397960+0000","last_undegraded":"2024-04-25T09:56:14.397960+0000","last_fullsized":"2024-04-25T09:56:14.397960+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.419251+0000","last_change":"2024-04-25T09:56:15.416284+0000","last_active":"2024-04-25T09:56:15.419251+0000","last_peered":"2024-04-25T09:56:15.419251+0000","last_clean":"2024-04-25T09:56:15.419251+0000","last_became_active":"2024-04-25T09:56:15.416000+0000","last_became_peered":"2024-04-25T09:56:15.416000+0000","last_unstale":"2024-04-25T09:56:15.419251+0000","last_undegraded":"2024-04-25T09:56:15.419251+0000","last_fullsized":"2024-04-25T09:56:15.419251+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:19.710411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.399865+0000","last_change":"2024-04-25T09:56:14.399865+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.399865+0000","last_undegraded":"2024-04-25T09:56:14.399865+0000","last_fullsized":"2024-04-25T09:56:14.399865+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.417516+0000","last_change":"2024-04-25T09:56:15.406771+0000","last_active":"2024-04-25T09:56:15.417516+0000","last_peered":"2024-04-25T09:56:15.417516+0000","last_clean":"2024-04-25T09:56:15.417516+0000","last_became_active":"2024-04-25T09:56:15.406430+0000","last_became_peered":"2024-04-25T09:56:15.406430+0000","last_unstale":"2024-04-25T09:56:15.417516+0000","last_undegraded":"2024-04-25T09:56:15.417516+0000","last_fullsized":"2024-04-25T09:56:15.417516+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:34.121647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.399374+0000","last_change":"2024-04-25T09:56:14.399374+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.399374+0000","last_undegraded":"2024-04-25T09:56:14.399374+0000","last_fullsized":"2024-04-25T09:56:14.399374+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.413116+0000","last_change":"2024-04-25T09:56:15.408712+0000","last_active":"2024-04-25T09:56:15.413116+0000","last_peered":"2024-04-25T09:56:15.413116+0000","last_clean":"2024-04-25T09:56:15.413116+0000","last_became_active":"2024-04-25T09:56:15.408367+0000","last_became_peered":"2024-04-25T09:56:15.408367+0000","last_unstale":"2024-04-25T09:56:15.413116+0000","last_undegraded":"2024-04-25T09:56:15.413116+0000","last_fullsized":"2024-04-25T09:56:15.413116+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:52.399587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.420686+0000","last_change":"2024-04-25T09:56:15.417224+0000","last_active":"2024-04-25T09:56:15.420686+0000","last_peered":"2024-04-25T09:56:15.420686+0000","last_clean":"2024-04-25T09:56:15.420686+0000","last_became_active":"2024-04-25T09:56:15.415334+0000","last_became_peered":"2024-04-25T09:56:15.415334+0000","last_unstale":"2024-04-25T09:56:15.420686+0000","last_undegraded":"2024-04-25T09:56:15.420686+0000","last_fullsized":"2024-04-25T09:56:15.420686+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:52.399587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.419504+0000","last_change":"2024-04-25T09:56:14.413604+0000","last_active":"2024-04-25T09:56:15.419504+0000","last_peered":"2024-04-25T09:56:15.419504+0000","last_clean":"2024-04-25T09:56:15.419504+0000","last_became_active":"2024-04-25T09:56:14.413289+0000","last_became_peered":"2024-04-25T09:56:14.413289+0000","last_unstale":"2024-04-25T09:56:15.419504+0000","last_undegraded":"2024-04-25T09:56:15.419504+0000","last_fullsized":"2024-04-25T09:56:15.419504+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:42.555560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.413358+0000","last_change":"2024-04-25T09:56:15.407627+0000","last_active":"2024-04-25T09:56:15.413358+0000","last_peered":"2024-04-25T09:56:15.413358+0000","last_clean":"2024-04-25T09:56:15.413358+0000","last_became_active":"2024-04-25T09:56:15.407321+0000","last_became_peered":"2024-04-25T09:56:15.407321+0000","last_unstale":"2024-04-25T09:56:15.413358+0000","last_undegraded":"2024-04-25T09:56:15.413358+0000","last_fullsized":"2024-04-25T09:56:15.413358+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:05.088117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.409745+0000","last_change":"2024-04-25T09:56:14.407748+0000","last_active":"2024-04-25T09:56:14.409745+0000","last_peered":"2024-04-25T09:56:14.409745+0000","last_clean":"2024-04-25T09:56:14.409745+0000","last_became_active":"2024-04-25T09:56:14.407486+0000","last_became_peered":"2024-04-25T09:56:14.407486+0000","last_unstale":"2024-04-25T09:56:14.409745+0000","last_undegraded":"2024-04-25T09:56:14.409745+0000","last_fullsized":"2024-04-25T09:56:14.409745+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:59.529887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.417147+0000","last_change":"2024-04-25T09:56:15.414659+0000","last_active":"2024-04-25T09:56:15.417147+0000","last_peered":"2024-04-25T09:56:15.417147+0000","last_clean":"2024-04-25T09:56:15.417147+0000","last_became_active":"2024-04-25T09:56:15.410616+0000","last_became_peered":"2024-04-25T09:56:15.410616+0000","last_unstale":"2024-04-25T09:56:15.417147+0000","last_undegraded":"2024-04-25T09:56:15.417147+0000","last_fullsized":"2024-04-25T09:56:15.417147+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:34.121647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.412708+0000","last_change":"2024-04-25T09:56:14.408749+0000","last_active":"2024-04-25T09:56:14.412708+0000","last_peered":"2024-04-25T09:56:14.412708+0000","last_clean":"2024-04-25T09:56:14.412708+0000","last_became_active":"2024-04-25T09:56:14.408402+0000","last_became_peered":"2024-04-25T09:56:14.408402+0000","last_unstale":"2024-04-25T09:56:14.412708+0000","last_undegraded":"2024-04-25T09:56:14.412708+0000","last_fullsized":"2024-04-25T09:56:14.412708+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:09.715610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396837+0000","last_change":"2024-04-25T09:56:14.396837+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396837+0000","last_undegraded":"2024-04-25T09:56:14.396837+0000","last_fullsized":"2024-04-25T09:56:14.396837+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.428006+0000","last_change":"2024-04-25T09:56:14.416066+0000","last_active":"2024-04-25T09:56:15.428006+0000","last_peered":"2024-04-25T09:56:15.428006+0000","last_clean":"2024-04-25T09:56:15.428006+0000","last_became_active":"2024-04-25T09:56:14.415761+0000","last_became_peered":"2024-04-25T09:56:14.415761+0000","last_unstale":"2024-04-25T09:56:15.428006+0000","last_undegraded":"2024-04-25T09:56:15.428006+0000","last_fullsized":"2024-04-25T09:56:15.428006+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:51.655284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.412231+0000","last_change":"2024-04-25T09:56:15.405699+0000","last_active":"2024-04-25T09:56:15.412231+0000","last_peered":"2024-04-25T09:56:15.412231+0000","last_clean":"2024-04-25T09:56:15.412231+0000","last_became_active":"2024-04-25T09:56:15.405415+0000","last_became_peered":"2024-04-25T09:56:15.405415+0000","last_unstale":"2024-04-25T09:56:15.412231+0000","last_undegraded":"2024-04-25T09:56:15.412231+0000","last_fullsized":"2024-04-25T09:56:15.412231+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:11.547014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.414754+0000","last_change":"2024-04-25T09:56:14.411984+0000","last_active":"2024-04-25T09:56:14.414754+0000","last_peered":"2024-04-25T09:56:14.414754+0000","last_clean":"2024-04-25T09:56:14.414754+0000","last_became_active":"2024-04-25T09:56:14.411230+0000","last_became_peered":"2024-04-25T09:56:14.411230+0000","last_unstale":"2024-04-25T09:56:14.414754+0000","last_undegraded":"2024-04-25T09:56:14.414754+0000","last_fullsized":"2024-04-25T09:56:14.414754+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:02.173295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.414998+0000","last_change":"2024-04-25T09:56:15.409846+0000","last_active":"2024-04-25T09:56:15.414998+0000","last_peered":"2024-04-25T09:56:15.414998+0000","last_clean":"2024-04-25T09:56:15.414998+0000","last_became_active":"2024-04-25T09:56:15.409530+0000","last_became_peered":"2024-04-25T09:56:15.409530+0000","last_unstale":"2024-04-25T09:56:15.414998+0000","last_undegraded":"2024-04-25T09:56:15.414998+0000","last_fullsized":"2024-04-25T09:56:15.414998+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:19.710411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.424782+0000","last_change":"2024-04-25T09:56:14.411589+0000","last_active":"2024-04-25T09:56:15.424782+0000","last_peered":"2024-04-25T09:56:15.424782+0000","last_clean":"2024-04-25T09:56:15.424782+0000","last_became_active":"2024-04-25T09:56:14.411266+0000","last_became_peered":"2024-04-25T09:56:14.411266+0000","last_unstale":"2024-04-25T09:56:15.424782+0000","last_undegraded":"2024-04-25T09:56:15.424782+0000","last_fullsized":"2024-04-25T09:56:15.424782+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:02.173295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396786+0000","last_change":"2024-04-25T09:56:14.396786+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396786+0000","last_undegraded":"2024-04-25T09:56:14.396786+0000","last_fullsized":"2024-04-25T09:56:14.396786+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.398970+0000","last_change":"2024-04-25T09:56:14.413373+0000","last_active":"2024-04-25T09:56:15.398970+0000","last_peered":"2024-04-25T09:56:15.398970+0000","last_clean":"2024-04-25T09:56:15.398970+0000","last_became_active":"2024-04-25T09:56:14.413066+0000","last_became_peered":"2024-04-25T09:56:14.413066+0000","last_unstale":"2024-04-25T09:56:15.398970+0000","last_undegraded":"2024-04-25T09:56:15.398970+0000","last_fullsized":"2024-04-25T09:56:15.398970+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:02.173295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.415067+0000","last_change":"2024-04-25T09:56:15.409215+0000","last_active":"2024-04-25T09:56:15.415067+0000","last_peered":"2024-04-25T09:56:15.415067+0000","last_clean":"2024-04-25T09:56:15.415067+0000","last_became_active":"2024-04-25T09:56:15.408934+0000","last_became_peered":"2024-04-25T09:56:15.408934+0000","last_unstale":"2024-04-25T09:56:15.415067+0000","last_undegraded":"2024-04-25T09:56:15.415067+0000","last_fullsized":"2024-04-25T09:56:15.415067+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:40.524761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.411668+0000","last_change":"2024-04-25T09:56:14.409931+0000","last_active":"2024-04-25T09:56:14.411668+0000","last_peered":"2024-04-25T09:56:14.411668+0000","last_clean":"2024-04-25T09:56:14.411668+0000","last_became_active":"2024-04-25T09:56:14.409653+0000","last_became_peered":"2024-04-25T09:56:14.409653+0000","last_unstale":"2024-04-25T09:56:14.411668+0000","last_undegraded":"2024-04-25T09:56:14.411668+0000","last_fullsized":"2024-04-25T09:56:14.411668+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:02.560063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.412321+0000","last_change":"2024-04-25T09:56:15.404379+0000","last_active":"2024-04-25T09:56:15.412321+0000","last_peered":"2024-04-25T09:56:15.412321+0000","last_clean":"2024-04-25T09:56:15.412321+0000","last_became_active":"2024-04-25T09:56:15.404111+0000","last_became_peered":"2024-04-25T09:56:15.404111+0000","last_unstale":"2024-04-25T09:56:15.412321+0000","last_undegraded":"2024-04-25T09:56:15.412321+0000","last_fullsized":"2024-04-25T09:56:15.412321+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:49.392569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.401436+0000","last_change":"2024-04-25T09:56:14.415504+0000","last_active":"2024-04-25T09:56:15.401436+0000","last_peered":"2024-04-25T09:56:15.401436+0000","last_clean":"2024-04-25T09:56:15.401436+0000","last_became_active":"2024-04-25T09:56:14.414650+0000","last_became_peered":"2024-04-25T09:56:14.414650+0000","last_unstale":"2024-04-25T09:56:15.401436+0000","last_undegraded":"2024-04-25T09:56:15.401436+0000","last_fullsized":"2024-04-25T09:56:15.401436+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:43.308611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.413378+0000","last_change":"2024-04-25T09:56:15.409591+0000","last_active":"2024-04-25T09:56:15.413378+0000","last_peered":"2024-04-25T09:56:15.413378+0000","last_clean":"2024-04-25T09:56:15.413378+0000","last_became_active":"2024-04-25T09:56:15.409263+0000","last_became_peered":"2024-04-25T09:56:15.409263+0000","last_unstale":"2024-04-25T09:56:15.413378+0000","last_undegraded":"2024-04-25T09:56:15.413378+0000","last_fullsized":"2024-04-25T09:56:15.413378+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:26.649129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.394600+0000","last_change":"2024-04-25T09:56:14.412591+0000","last_active":"2024-04-25T09:56:15.394600+0000","last_peered":"2024-04-25T09:56:15.394600+0000","last_clean":"2024-04-25T09:56:15.394600+0000","last_became_active":"2024-04-25T09:56:14.412210+0000","last_became_peered":"2024-04-25T09:56:14.412210+0000","last_unstale":"2024-04-25T09:56:15.394600+0000","last_undegraded":"2024-04-25T09:56:15.394600+0000","last_fullsized":"2024-04-25T09:56:15.394600+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:02.560063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397298+0000","last_change":"2024-04-25T09:56:14.397298+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397298+0000","last_undegraded":"2024-04-25T09:56:14.397298+0000","last_fullsized":"2024-04-25T09:56:14.397298+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.427707+0000","last_change":"2024-04-25T09:56:14.416329+0000","last_active":"2024-04-25T09:56:15.427707+0000","last_peered":"2024-04-25T09:56:15.427707+0000","last_clean":"2024-04-25T09:56:15.427707+0000","last_became_active":"2024-04-25T09:56:14.416028+0000","last_became_peered":"2024-04-25T09:56:14.416028+0000","last_unstale":"2024-04-25T09:56:15.427707+0000","last_undegraded":"2024-04-25T09:56:15.427707+0000","last_fullsized":"2024-04-25T09:56:15.427707+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:10.545063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.417689+0000","last_change":"2024-04-25T09:56:15.413056+0000","last_active":"2024-04-25T09:56:15.417689+0000","last_peered":"2024-04-25T09:56:15.417689+0000","last_clean":"2024-04-25T09:56:15.417689+0000","last_became_active":"2024-04-25T09:56:15.412739+0000","last_became_peered":"2024-04-25T09:56:15.412739+0000","last_unstale":"2024-04-25T09:56:15.417689+0000","last_undegraded":"2024-04-25T09:56:15.417689+0000","last_fullsized":"2024-04-25T09:56:15.417689+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:56.579633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.416935+0000","last_change":"2024-04-25T09:56:14.408541+0000","last_active":"2024-04-25T09:56:14.416935+0000","last_peered":"2024-04-25T09:56:14.416935+0000","last_clean":"2024-04-25T09:56:14.416935+0000","last_became_active":"2024-04-25T09:56:14.407599+0000","last_became_peered":"2024-04-25T09:56:14.407599+0000","last_unstale":"2024-04-25T09:56:14.416935+0000","last_undegraded":"2024-04-25T09:56:14.416935+0000","last_fullsized":"2024-04-25T09:56:14.416935+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:51.655284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.413240+0000","last_change":"2024-04-25T09:56:15.407624+0000","last_active":"2024-04-25T09:56:15.413240+0000","last_peered":"2024-04-25T09:56:15.413240+0000","last_clean":"2024-04-25T09:56:15.413240+0000","last_became_active":"2024-04-25T09:56:15.407295+0000","last_became_peered":"2024-04-25T09:56:15.407295+0000","last_unstale":"2024-04-25T09:56:15.413240+0000","last_undegraded":"2024-04-25T09:56:15.413240+0000","last_fullsized":"2024-04-25T09:56:15.413240+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:57.405816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.414774+0000","last_change":"2024-04-25T09:56:14.412434+0000","last_active":"2024-04-25T09:56:14.414774+0000","last_peered":"2024-04-25T09:56:14.414774+0000","last_clean":"2024-04-25T09:56:14.414774+0000","last_became_active":"2024-04-25T09:56:14.411639+0000","last_became_peered":"2024-04-25T09:56:14.411639+0000","last_unstale":"2024-04-25T09:56:14.414774+0000","last_undegraded":"2024-04-25T09:56:14.414774+0000","last_fullsized":"2024-04-25T09:56:14.414774+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:31.472024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397944+0000","last_change":"2024-04-25T09:56:14.397944+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397944+0000","last_undegraded":"2024-04-25T09:56:14.397944+0000","last_fullsized":"2024-04-25T09:56:14.397944+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.400394+0000","last_change":"2024-04-25T09:56:14.417041+0000","last_active":"2024-04-25T09:56:15.400394+0000","last_peered":"2024-04-25T09:56:15.400394+0000","last_clean":"2024-04-25T09:56:15.400394+0000","last_became_active":"2024-04-25T09:56:14.416523+0000","last_became_peered":"2024-04-25T09:56:14.416523+0000","last_unstale":"2024-04-25T09:56:15.400394+0000","last_undegraded":"2024-04-25T09:56:15.400394+0000","last_fullsized":"2024-04-25T09:56:15.400394+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:48.390619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397265+0000","last_change":"2024-04-25T09:56:14.397265+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397265+0000","last_undegraded":"2024-04-25T09:56:14.397265+0000","last_fullsized":"2024-04-25T09:56:14.397265+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.401072+0000","last_change":"2024-04-25T09:56:14.413069+0000","last_active":"2024-04-25T09:56:15.401072+0000","last_peered":"2024-04-25T09:56:15.401072+0000","last_clean":"2024-04-25T09:56:15.401072+0000","last_became_active":"2024-04-25T09:56:14.412763+0000","last_became_peered":"2024-04-25T09:56:14.412763+0000","last_unstale":"2024-04-25T09:56:15.401072+0000","last_undegraded":"2024-04-25T09:56:15.401072+0000","last_fullsized":"2024-04-25T09:56:15.401072+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:55.577682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397743+0000","last_change":"2024-04-25T09:56:14.397743+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397743+0000","last_undegraded":"2024-04-25T09:56:14.397743+0000","last_fullsized":"2024-04-25T09:56:14.397743+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.416043+0000","last_change":"2024-04-25T09:56:14.409356+0000","last_active":"2024-04-25T09:56:14.416043+0000","last_peered":"2024-04-25T09:56:14.416043+0000","last_clean":"2024-04-25T09:56:14.416043+0000","last_became_active":"2024-04-25T09:56:14.409096+0000","last_became_peered":"2024-04-25T09:56:14.409096+0000","last_unstale":"2024-04-25T09:56:14.416043+0000","last_undegraded":"2024-04-25T09:56:14.416043+0000","last_fullsized":"2024-04-25T09:56:14.416043+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:04.086167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397108+0000","last_change":"2024-04-25T09:56:14.397108+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397108+0000","last_undegraded":"2024-04-25T09:56:14.397108+0000","last_fullsized":"2024-04-25T09:56:14.397108+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.405920+0000","last_change":"2024-04-25T09:56:14.405032+0000","last_active":"2024-04-25T09:56:14.405920+0000","last_peered":"2024-04-25T09:56:14.405920+0000","last_clean":"2024-04-25T09:56:14.405920+0000","last_became_active":"2024-04-25T09:56:14.404522+0000","last_became_peered":"2024-04-25T09:56:14.404522+0000","last_unstale":"2024-04-25T09:56:14.405920+0000","last_undegraded":"2024-04-25T09:56:14.405920+0000","last_fullsized":"2024-04-25T09:56:14.405920+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:09.715610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396240+0000","last_change":"2024-04-25T09:56:14.396240+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396240+0000","last_undegraded":"2024-04-25T09:56:14.396240+0000","last_fullsized":"2024-04-25T09:56:14.396240+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.413788+0000","last_change":"2024-04-25T09:56:14.412352+0000","last_active":"2024-04-25T09:56:14.413788+0000","last_peered":"2024-04-25T09:56:14.413788+0000","last_clean":"2024-04-25T09:56:14.413788+0000","last_became_active":"2024-04-25T09:56:14.412017+0000","last_became_peered":"2024-04-25T09:56:14.412017+0000","last_unstale":"2024-04-25T09:56:14.413788+0000","last_undegraded":"2024-04-25T09:56:14.413788+0000","last_fullsized":"2024-04-25T09:56:14.413788+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:46.143188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.417725+0000","last_change":"2024-04-25T09:56:15.414094+0000","last_active":"2024-04-25T09:56:15.417725+0000","last_peered":"2024-04-25T09:56:15.417725+0000","last_clean":"2024-04-25T09:56:15.417725+0000","last_became_active":"2024-04-25T09:56:15.413821+0000","last_became_peered":"2024-04-25T09:56:15.413821+0000","last_unstale":"2024-04-25T09:56:15.417725+0000","last_undegraded":"2024-04-25T09:56:15.417725+0000","last_fullsized":"2024-04-25T09:56:15.417725+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:25:17.174689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.420402+0000","last_change":"2024-04-25T09:56:14.410213+0000","last_active":"2024-04-25T09:56:15.420402+0000","last_peered":"2024-04-25T09:56:15.420402+0000","last_clean":"2024-04-25T09:56:15.420402+0000","last_became_active":"2024-04-25T09:56:14.409924+0000","last_became_peered":"2024-04-25T09:56:14.409924+0000","last_unstale":"2024-04-25T09:56:15.420402+0000","last_undegraded":"2024-04-25T09:56:15.420402+0000","last_fullsized":"2024-04-25T09:56:15.420402+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:10.545063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396079+0000","last_change":"2024-04-25T09:56:14.396079+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396079+0000","last_undegraded":"2024-04-25T09:56:14.396079+0000","last_fullsized":"2024-04-25T09:56:14.396079+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.400209+0000","last_change":"2024-04-25T09:56:14.406144+0000","last_active":"2024-04-25T09:56:15.400209+0000","last_peered":"2024-04-25T09:56:15.400209+0000","last_clean":"2024-04-25T09:56:15.400209+0000","last_became_active":"2024-04-25T09:56:14.405807+0000","last_became_peered":"2024-04-25T09:56:14.405807+0000","last_unstale":"2024-04-25T09:56:15.400209+0000","last_undegraded":"2024-04-25T09:56:15.400209+0000","last_fullsized":"2024-04-25T09:56:15.400209+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:31.472024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.413272+0000","last_change":"2024-04-25T09:56:15.409815+0000","last_active":"2024-04-25T09:56:15.413272+0000","last_peered":"2024-04-25T09:56:15.413272+0000","last_clean":"2024-04-25T09:56:15.413272+0000","last_became_active":"2024-04-25T09:56:15.409514+0000","last_became_peered":"2024-04-25T09:56:15.409514+0000","last_unstale":"2024-04-25T09:56:15.413272+0000","last_undegraded":"2024-04-25T09:56:15.413272+0000","last_fullsized":"2024-04-25T09:56:15.413272+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:35.961223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.408759+0000","last_change":"2024-04-25T09:56:14.406874+0000","last_active":"2024-04-25T09:56:14.408759+0000","last_peered":"2024-04-25T09:56:14.408759+0000","last_clean":"2024-04-25T09:56:14.408759+0000","last_became_active":"2024-04-25T09:56:14.406576+0000","last_became_peered":"2024-04-25T09:56:14.406576+0000","last_unstale":"2024-04-25T09:56:14.408759+0000","last_undegraded":"2024-04-25T09:56:14.408759+0000","last_fullsized":"2024-04-25T09:56:14.408759+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:52.202052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.415248+0000","last_change":"2024-04-25T09:56:15.410149+0000","last_active":"2024-04-25T09:56:15.415248+0000","last_peered":"2024-04-25T09:56:15.415248+0000","last_clean":"2024-04-25T09:56:15.415248+0000","last_became_active":"2024-04-25T09:56:15.409859+0000","last_became_peered":"2024-04-25T09:56:15.409859+0000","last_unstale":"2024-04-25T09:56:15.415248+0000","last_undegraded":"2024-04-25T09:56:15.415248+0000","last_fullsized":"2024-04-25T09:56:15.415248+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:44.310561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.414542+0000","last_change":"2024-04-25T09:56:14.406954+0000","last_active":"2024-04-25T09:56:14.414542+0000","last_peered":"2024-04-25T09:56:14.414542+0000","last_clean":"2024-04-25T09:56:14.414542+0000","last_became_active":"2024-04-25T09:56:14.406675+0000","last_became_peered":"2024-04-25T09:56:14.406675+0000","last_unstale":"2024-04-25T09:56:14.414542+0000","last_undegraded":"2024-04-25T09:56:14.414542+0000","last_fullsized":"2024-04-25T09:56:14.414542+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:39.522811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.395751+0000","last_change":"2024-04-25T09:56:14.395751+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.395751+0000","last_undegraded":"2024-04-25T09:56:14.395751+0000","last_fullsized":"2024-04-25T09:56:14.395751+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.409782+0000","last_change":"2024-04-25T09:56:14.406606+0000","last_active":"2024-04-25T09:56:14.409782+0000","last_peered":"2024-04-25T09:56:14.409782+0000","last_clean":"2024-04-25T09:56:14.409782+0000","last_became_active":"2024-04-25T09:56:14.406331+0000","last_became_peered":"2024-04-25T09:56:14.406331+0000","last_unstale":"2024-04-25T09:56:14.409782+0000","last_undegraded":"2024-04-25T09:56:14.409782+0000","last_fullsized":"2024-04-25T09:56:14.409782+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:42.555560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396387+0000","last_change":"2024-04-25T09:56:14.396387+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396387+0000","last_undegraded":"2024-04-25T09:56:14.396387+0000","last_fullsized":"2024-04-25T09:56:14.396387+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.416484+0000","last_change":"2024-04-25T09:56:14.414276+0000","last_active":"2024-04-25T09:56:14.416484+0000","last_peered":"2024-04-25T09:56:14.416484+0000","last_clean":"2024-04-25T09:56:14.416484+0000","last_became_active":"2024-04-25T09:56:14.413964+0000","last_became_peered":"2024-04-25T09:56:14.413964+0000","last_unstale":"2024-04-25T09:56:14.416484+0000","last_undegraded":"2024-04-25T09:56:14.416484+0000","last_fullsized":"2024-04-25T09:56:14.416484+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:50.921675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.417028+0000","last_change":"2024-04-25T09:56:15.409393+0000","last_active":"2024-04-25T09:56:15.417028+0000","last_peered":"2024-04-25T09:56:15.417028+0000","last_clean":"2024-04-25T09:56:15.417028+0000","last_became_active":"2024-04-25T09:56:15.409064+0000","last_became_peered":"2024-04-25T09:56:15.409064+0000","last_unstale":"2024-04-25T09:56:15.417028+0000","last_undegraded":"2024-04-25T09:56:15.417028+0000","last_fullsized":"2024-04-25T09:56:15.417028+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:08.074490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.426138+0000","last_change":"2024-04-25T09:56:14.415037+0000","last_active":"2024-04-25T09:56:15.426138+0000","last_peered":"2024-04-25T09:56:15.426138+0000","last_clean":"2024-04-25T09:56:15.426138+0000","last_became_active":"2024-04-25T09:56:14.414744+0000","last_became_peered":"2024-04-25T09:56:14.414744+0000","last_unstale":"2024-04-25T09:56:15.426138+0000","last_undegraded":"2024-04-25T09:56:15.426138+0000","last_fullsized":"2024-04-25T09:56:15.426138+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:02.560063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.395691+0000","last_change":"2024-04-25T09:56:14.395691+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.395691+0000","last_undegraded":"2024-04-25T09:56:14.395691+0000","last_fullsized":"2024-04-25T09:56:14.395691+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.401176+0000","last_change":"2024-04-25T09:56:14.415403+0000","last_active":"2024-04-25T09:56:15.401176+0000","last_peered":"2024-04-25T09:56:15.401176+0000","last_clean":"2024-04-25T09:56:15.401176+0000","last_became_active":"2024-04-25T09:56:14.414434+0000","last_became_peered":"2024-04-25T09:56:14.414434+0000","last_unstale":"2024-04-25T09:56:15.401176+0000","last_undegraded":"2024-04-25T09:56:15.401176+0000","last_fullsized":"2024-04-25T09:56:15.401176+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:25:16.172738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396338+0000","last_change":"2024-04-25T09:56:14.396338+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396338+0000","last_undegraded":"2024-04-25T09:56:14.396338+0000","last_fullsized":"2024-04-25T09:56:14.396338+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.415726+0000","last_change":"2024-04-25T09:56:14.414412+0000","last_active":"2024-04-25T09:56:14.415726+0000","last_peered":"2024-04-25T09:56:14.415726+0000","last_clean":"2024-04-25T09:56:14.415726+0000","last_became_active":"2024-04-25T09:56:14.413362+0000","last_became_peered":"2024-04-25T09:56:14.413362+0000","last_unstale":"2024-04-25T09:56:14.415726+0000","last_undegraded":"2024-04-25T09:56:14.415726+0000","last_fullsized":"2024-04-25T09:56:14.415726+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:48.390619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396316+0000","last_change":"2024-04-25T09:56:14.396316+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396316+0000","last_undegraded":"2024-04-25T09:56:14.396316+0000","last_fullsized":"2024-04-25T09:56:14.396316+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.414726+0000","last_change":"2024-04-25T09:56:14.408232+0000","last_active":"2024-04-25T09:56:14.414726+0000","last_peered":"2024-04-25T09:56:14.414726+0000","last_clean":"2024-04-25T09:56:14.414726+0000","last_became_active":"2024-04-25T09:56:14.407536+0000","last_became_peered":"2024-04-25T09:56:14.407536+0000","last_unstale":"2024-04-25T09:56:14.414726+0000","last_undegraded":"2024-04-25T09:56:14.414726+0000","last_fullsized":"2024-04-25T09:56:14.414726+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:18.708460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.418448+0000","last_change":"2024-04-25T09:56:15.416647+0000","last_active":"2024-04-25T09:56:15.418448+0000","last_peered":"2024-04-25T09:56:15.418448+0000","last_clean":"2024-04-25T09:56:15.418448+0000","last_became_active":"2024-04-25T09:56:15.416335+0000","last_became_peered":"2024-04-25T09:56:15.416335+0000","last_unstale":"2024-04-25T09:56:15.418448+0000","last_undegraded":"2024-04-25T09:56:15.418448+0000","last_fullsized":"2024-04-25T09:56:15.418448+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:57.464568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.416176+0000","last_change":"2024-04-25T09:56:14.413483+0000","last_active":"2024-04-25T09:56:14.416176+0000","last_peered":"2024-04-25T09:56:14.416176+0000","last_clean":"2024-04-25T09:56:14.416176+0000","last_became_active":"2024-04-25T09:56:14.413153+0000","last_became_peered":"2024-04-25T09:56:14.413153+0000","last_unstale":"2024-04-25T09:56:14.416176+0000","last_undegraded":"2024-04-25T09:56:14.416176+0000","last_fullsized":"2024-04-25T09:56:14.416176+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:56.403865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396787+0000","last_change":"2024-04-25T09:56:14.396787+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396787+0000","last_undegraded":"2024-04-25T09:56:14.396787+0000","last_fullsized":"2024-04-25T09:56:14.396787+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.394476+0000","last_change":"2024-04-25T09:56:14.411470+0000","last_active":"2024-04-25T09:56:15.394476+0000","last_peered":"2024-04-25T09:56:15.394476+0000","last_clean":"2024-04-25T09:56:15.394476+0000","last_became_active":"2024-04-25T09:56:14.411162+0000","last_became_peered":"2024-04-25T09:56:14.411162+0000","last_unstale":"2024-04-25T09:56:15.394476+0000","last_undegraded":"2024-04-25T09:56:15.394476+0000","last_fullsized":"2024-04-25T09:56:15.394476+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:42.555560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.398722+0000","last_change":"2024-04-25T09:56:14.398722+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.398722+0000","last_undegraded":"2024-04-25T09:56:14.398722+0000","last_fullsized":"2024-04-25T09:56:14.398722+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.401348+0000","last_change":"2024-04-25T09:56:14.410884+0000","last_active":"2024-04-25T09:56:15.401348+0000","last_peered":"2024-04-25T09:56:15.401348+0000","last_clean":"2024-04-25T09:56:15.401348+0000","last_became_active":"2024-04-25T09:56:14.410576+0000","last_became_peered":"2024-04-25T09:56:14.410576+0000","last_unstale":"2024-04-25T09:56:15.401348+0000","last_undegraded":"2024-04-25T09:56:15.401348+0000","last_fullsized":"2024-04-25T09:56:15.401348+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:18.708460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.414961+0000","last_change":"2024-04-25T09:56:15.408216+0000","last_active":"2024-04-25T09:56:15.414961+0000","last_peered":"2024-04-25T09:56:15.414961+0000","last_clean":"2024-04-25T09:56:15.414961+0000","last_became_active":"2024-04-25T09:56:15.407935+0000","last_became_peered":"2024-04-25T09:56:15.407935+0000","last_unstale":"2024-04-25T09:56:15.414961+0000","last_undegraded":"2024-04-25T09:56:15.414961+0000","last_fullsized":"2024-04-25T09:56:15.414961+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:25:17.174689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.417104+0000","last_change":"2024-04-25T09:56:14.415709+0000","last_active":"2024-04-25T09:56:14.417104+0000","last_peered":"2024-04-25T09:56:14.417104+0000","last_clean":"2024-04-25T09:56:14.417104+0000","last_became_active":"2024-04-25T09:56:14.415165+0000","last_became_peered":"2024-04-25T09:56:14.415165+0000","last_unstale":"2024-04-25T09:56:14.417104+0000","last_undegraded":"2024-04-25T09:56:14.417104+0000","last_fullsized":"2024-04-25T09:56:14.417104+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:10.545063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":220,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.400324+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T09:56:15.400324+0000","last_peered":"2024-04-25T09:56:15.400324+0000","last_clean":"2024-04-25T09:56:15.400324+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T09:56:15.400324+0000","last_undegraded":"2024-04-25T09:56:15.400324+0000","last_fullsized":"2024-04-25T09:56:15.400324+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":742,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1171456,"data_stored":843299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542171,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31768,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":598016,"data_stored":260750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542173,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":589824,"data_stored":260098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542170,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":577536,"data_stored":252931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":577536,"data_stored":252931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":577536,"data_stored":252931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":565248,"data_stored":246264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1159168,"data_stored":836632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:56:18.417 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:56:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.550+0000 7f21798e1640 1 Processor -- start 2024-04-25T09:56:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.551+0000 7f21798e1640 1 -- start start 2024-04-25T09:56:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.551+0000 7f21798e1640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f21740d0a50 0x7f21740d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.551+0000 7f21798e1640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f21740b53b0 0x7f21740d2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.551+0000 7f21798e1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21740d1e80 con 0x7f217415db00 2024-04-25T09:56:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.551+0000 7f21798e1640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21740b5930 con 0x7f21740b53b0 2024-04-25T09:56:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.551+0000 7f21798e1640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21740b5c10 con 0x7f21740d0a50 2024-04-25T09:56:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.551+0000 7f21737fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f21740b53b0 0x7f21740d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.551+0000 7f21737fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f21740b53b0 0x7f21740d2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59178/0 (socket says 172.21.15.7:59178) 2024-04-25T09:56:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.551+0000 7f21737fe640 1 -- 172.21.15.7:0/3379371220 learned_addr learned my addr 172.21.15.7:0/3379371220 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.552+0000 7f21727fc640 1 --2- 172.21.15.7:0/3379371220 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f21740d0a50 0x7f21740d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.552+0000 7f21737fe640 1 -- 172.21.15.7:0/3379371220 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f21740d0a50 msgr2=0x7f21740d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.552+0000 7f21737fe640 1 --2- 172.21.15.7:0/3379371220 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f21740d0a50 0x7f21740d2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.552+0000 7f21737fe640 1 -- 172.21.15.7:0/3379371220 >> v1:172.21.15.55:6789/0 conn(0x7f217415db00 legacy=0x7f21740d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.552+0000 7f21737fe640 1 -- 172.21.15.7:0/3379371220 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21740b5ef0 con 0x7f21740b53b0 2024-04-25T09:56:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.552+0000 7f21737fe640 1 --2- 172.21.15.7:0/3379371220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21740b53b0 0x7f21740d2870 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f2164009e50 tx=0x7f216402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8168a7ea762f97ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.553+0000 7f2171ffb640 1 -- 172.21.15.7:0/3379371220 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2164036070 con 0x7f21740b53b0 2024-04-25T09:56:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.553+0000 7f2171ffb640 1 -- 172.21.15.7:0/3379371220 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2164031600 con 0x7f21740b53b0 2024-04-25T09:56:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.553+0000 7f2171ffb640 1 -- 172.21.15.7:0/3379371220 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21640319d0 con 0x7f21740b53b0 2024-04-25T09:56:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.553+0000 7f21798e1640 1 -- 172.21.15.7:0/3379371220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21740b53b0 msgr2=0x7f21740d2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.553+0000 7f21798e1640 1 --2- 172.21.15.7:0/3379371220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21740b53b0 0x7f21740d2870 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f2164009e50 tx=0x7f216402a710 comp rx=0 tx=0).stop 2024-04-25T09:56:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.553+0000 7f21798e1640 1 -- 172.21.15.7:0/3379371220 shutdown_connections 2024-04-25T09:56:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.553+0000 7f21798e1640 1 --2- 172.21.15.7:0/3379371220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21740b53b0 0x7f21740d2870 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.553+0000 7f21798e1640 1 --2- 172.21.15.7:0/3379371220 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f21740d0a50 0x7f21740d2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.553+0000 7f21798e1640 1 -- 172.21.15.7:0/3379371220 >> 172.21.15.7:0/3379371220 conn(0x7f2174072290 msgr2=0x7f21740726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.553+0000 7f21798e1640 1 -- 172.21.15.7:0/3379371220 shutdown_connections 2024-04-25T09:56:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.553+0000 7f21798e1640 1 -- 172.21.15.7:0/3379371220 wait complete. 2024-04-25T09:56:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.554+0000 7f21798e1640 1 Processor -- start 2024-04-25T09:56:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.555+0000 7f21798e1640 1 -- start start 2024-04-25T09:56:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.555+0000 7f21798e1640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f21740b53b0 0x7f2174155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.555+0000 7f21798e1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21740d0a50 0x7f21740cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.555+0000 7f21798e1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f217415db00 0x7f21740c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:18.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.555+0000 7f21798e1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21740d3660 con 0x7f217415db00 2024-04-25T09:56:18.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.555+0000 7f21798e1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21740b61d0 con 0x7f21740d0a50 2024-04-25T09:56:18.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.555+0000 7f21798e1640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21740ce2b0 con 0x7f21740b53b0 2024-04-25T09:56:18.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.555+0000 7f21737fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f217415db00 0x7f21740c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:18.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.555+0000 7f21737fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f217415db00 0x7f21740c8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59182/0 (socket says 172.21.15.7:59182) 2024-04-25T09:56:18.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.555+0000 7f21737fe640 1 -- 172.21.15.7:0/2658384084 learned_addr learned my addr 172.21.15.7:0/2658384084 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:18.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.555+0000 7f2172ffd640 1 --2- 172.21.15.7:0/2658384084 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f21740b53b0 0x7f2174155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:18.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.555+0000 7f21727fc640 1 --2- 172.21.15.7:0/2658384084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21740d0a50 0x7f21740cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:18.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.556+0000 7f21737fe640 1 -- 172.21.15.7:0/2658384084 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f21740b53b0 msgr2=0x7f2174155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:18.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.556+0000 7f21737fe640 1 --2- 172.21.15.7:0/2658384084 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f21740b53b0 0x7f2174155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:18.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.556+0000 7f21737fe640 1 -- 172.21.15.7:0/2658384084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21740d0a50 msgr2=0x7f21740cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:18.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.556+0000 7f21737fe640 1 --2- 172.21.15.7:0/2658384084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21740d0a50 0x7f21740cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:18.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.556+0000 7f21737fe640 1 -- 172.21.15.7:0/2658384084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21740c79d0 con 0x7f217415db00 2024-04-25T09:56:18.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.556+0000 7f21737fe640 1 --2- 172.21.15.7:0/2658384084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f217415db00 0x7f21740c8f80 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f2164034040 tx=0x7f2164004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:18.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.556+0000 7f216bfff640 1 -- 172.21.15.7:0/2658384084 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216403f020 con 0x7f217415db00 2024-04-25T09:56:18.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.556+0000 7f216bfff640 1 -- 172.21.15.7:0/2658384084 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2164037040 con 0x7f217415db00 2024-04-25T09:56:18.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.556+0000 7f21798e1640 1 -- 172.21.15.7:0/2658384084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21740c7cb0 con 0x7f217415db00 2024-04-25T09:56:18.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.556+0000 7f216bfff640 1 -- 172.21.15.7:0/2658384084 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2164036070 con 0x7f217415db00 2024-04-25T09:56:18.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.556+0000 7f21798e1640 1 -- 172.21.15.7:0/2658384084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21740c8270 con 0x7f217415db00 2024-04-25T09:56:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.557+0000 7f21798e1640 1 -- 172.21.15.7:0/2658384084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2174159a50 con 0x7f217415db00 2024-04-25T09:56:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.558+0000 7f216bfff640 1 -- 172.21.15.7:0/2658384084 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2164042020 con 0x7f217415db00 2024-04-25T09:56:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.558+0000 7f216bfff640 1 --2- 172.21.15.7:0/2658384084 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f215406b4d0 0x7f215406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.558+0000 7f216bfff640 1 -- 172.21.15.7:0/2658384084 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f21640aa670 con 0x7f217415db00 2024-04-25T09:56:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.558+0000 7f2172ffd640 1 --2- 172.21.15.7:0/2658384084 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f215406b4d0 0x7f215406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.559+0000 7f2172ffd640 1 --2- 172.21.15.7:0/2658384084 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f215406b4d0 0x7f215406d990 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f216c0016e0 tx=0x7f216c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:18.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.563+0000 7f216bfff640 1 -- 172.21.15.7:0/2658384084 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2174159a50 con 0x7f217415db00 2024-04-25T09:56:18.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.739+0000 7f21798e1640 1 -- 172.21.15.7:0/2658384084 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2174068fd0 con 0x7f215406b4d0 2024-04-25T09:56:18.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.745+0000 7f216bfff640 1 -- 172.21.15.7:0/2658384084 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+248778 (secure 0 0 0) 0x7f2174068fd0 con 0x7f215406b4d0 2024-04-25T09:56:18.751 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:18.752 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T09:56:18.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.748+0000 7f21798e1640 1 -- 172.21.15.7:0/2658384084 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f215406b4d0 msgr2=0x7f215406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:18.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.748+0000 7f21798e1640 1 --2- 172.21.15.7:0/2658384084 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f215406b4d0 0x7f215406d990 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f216c0016e0 tx=0x7f216c009040 comp rx=0 tx=0).stop 2024-04-25T09:56:18.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.748+0000 7f21798e1640 1 -- 172.21.15.7:0/2658384084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f217415db00 msgr2=0x7f21740c8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:18.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.748+0000 7f21798e1640 1 --2- 172.21.15.7:0/2658384084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f217415db00 0x7f21740c8f80 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f2164034040 tx=0x7f2164004a40 comp rx=0 tx=0).stop 2024-04-25T09:56:18.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.748+0000 7f21798e1640 1 -- 172.21.15.7:0/2658384084 shutdown_connections 2024-04-25T09:56:18.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.748+0000 7f21798e1640 1 --2- 172.21.15.7:0/2658384084 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f215406b4d0 0x7f215406d990 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:18.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.748+0000 7f21798e1640 1 --2- 172.21.15.7:0/2658384084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f217415db00 0x7f21740c8f80 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:18.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.748+0000 7f21798e1640 1 --2- 172.21.15.7:0/2658384084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21740d0a50 0x7f21740cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:18.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.748+0000 7f21798e1640 1 --2- 172.21.15.7:0/2658384084 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f21740b53b0 0x7f2174155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:18.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.748+0000 7f21798e1640 1 -- 172.21.15.7:0/2658384084 >> 172.21.15.7:0/2658384084 conn(0x7f2174072290 msgr2=0x7f21740b70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:18.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.748+0000 7f21798e1640 1 -- 172.21.15.7:0/2658384084 shutdown_connections 2024-04-25T09:56:18.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.748+0000 7f21798e1640 1 -- 172.21.15.7:0/2658384084 wait complete. 2024-04-25T09:56:18.762 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2024-04-25T09:56:17.877249+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":174,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255136,"kb_used_data":5680,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754719584,"statfs":{"total":773094113280,"available":772832854016,"internally_reserved":0,"allocated":5816320,"data_stored":3205836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":742,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.495639"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.400552+0000","last_change":"2024-04-25T09:56:14.400552+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.400552+0000","last_undegraded":"2024-04-25T09:56:14.400552+0000","last_fullsized":"2024-04-25T09:56:14.400552+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.419019+0000","last_change":"2024-04-25T09:56:15.414664+0000","last_active":"2024-04-25T09:56:15.419019+0000","last_peered":"2024-04-25T09:56:15.419019+0000","last_clean":"2024-04-25T09:56:15.419019+0000","last_became_active":"2024-04-25T09:56:15.414291+0000","last_became_peered":"2024-04-25T09:56:15.414291+0000","last_unstale":"2024-04-25T09:56:15.419019+0000","last_undegraded":"2024-04-25T09:56:15.419019+0000","last_fullsized":"2024-04-25T09:56:15.419019+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:57.405816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.405512+0000","last_change":"2024-04-25T09:56:14.405512+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.405512+0000","last_undegraded":"2024-04-25T09:56:14.405512+0000","last_fullsized":"2024-04-25T09:56:14.405512+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.418562+0000","last_change":"2024-04-25T09:56:15.413750+0000","last_active":"2024-04-25T09:56:15.418562+0000","last_peered":"2024-04-25T09:56:15.418562+0000","last_clean":"2024-04-25T09:56:15.418562+0000","last_became_active":"2024-04-25T09:56:15.413442+0000","last_became_peered":"2024-04-25T09:56:15.413442+0000","last_unstale":"2024-04-25T09:56:15.418562+0000","last_undegraded":"2024-04-25T09:56:15.418562+0000","last_fullsized":"2024-04-25T09:56:15.418562+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:05.088117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.412912+0000","last_change":"2024-04-25T09:56:15.403689+0000","last_active":"2024-04-25T09:56:15.412912+0000","last_peered":"2024-04-25T09:56:15.412912+0000","last_clean":"2024-04-25T09:56:15.412912+0000","last_became_active":"2024-04-25T09:56:15.403310+0000","last_became_peered":"2024-04-25T09:56:15.403310+0000","last_unstale":"2024-04-25T09:56:15.412912+0000","last_undegraded":"2024-04-25T09:56:15.412912+0000","last_fullsized":"2024-04-25T09:56:15.412912+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:32.473975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.399868+0000","last_change":"2024-04-25T09:56:14.399868+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.399868+0000","last_undegraded":"2024-04-25T09:56:14.399868+0000","last_fullsized":"2024-04-25T09:56:14.399868+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.400932+0000","last_change":"2024-04-25T09:56:14.400932+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.400932+0000","last_undegraded":"2024-04-25T09:56:14.400932+0000","last_fullsized":"2024-04-25T09:56:14.400932+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397566+0000","last_change":"2024-04-25T09:56:14.397566+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397566+0000","last_undegraded":"2024-04-25T09:56:14.397566+0000","last_fullsized":"2024-04-25T09:56:14.397566+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.399128+0000","last_change":"2024-04-25T09:56:14.399128+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.399128+0000","last_undegraded":"2024-04-25T09:56:14.399128+0000","last_fullsized":"2024-04-25T09:56:14.399128+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.399463+0000","last_change":"2024-04-25T09:56:14.399463+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.399463+0000","last_undegraded":"2024-04-25T09:56:14.399463+0000","last_fullsized":"2024-04-25T09:56:14.399463+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.401987+0000","last_change":"2024-04-25T09:56:14.401987+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.401987+0000","last_undegraded":"2024-04-25T09:56:14.401987+0000","last_fullsized":"2024-04-25T09:56:14.401987+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396299+0000","last_change":"2024-04-25T09:56:14.396299+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396299+0000","last_undegraded":"2024-04-25T09:56:14.396299+0000","last_fullsized":"2024-04-25T09:56:14.396299+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.398876+0000","last_change":"2024-04-25T09:56:14.398876+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.398876+0000","last_undegraded":"2024-04-25T09:56:14.398876+0000","last_fullsized":"2024-04-25T09:56:14.398876+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.400902+0000","last_change":"2024-04-25T09:56:14.400902+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.400902+0000","last_undegraded":"2024-04-25T09:56:14.400902+0000","last_fullsized":"2024-04-25T09:56:14.400902+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.418608+0000","last_change":"2024-04-25T09:56:15.412875+0000","last_active":"2024-04-25T09:56:15.418608+0000","last_peered":"2024-04-25T09:56:15.418608+0000","last_clean":"2024-04-25T09:56:15.418608+0000","last_became_active":"2024-04-25T09:56:15.410551+0000","last_became_peered":"2024-04-25T09:56:15.410551+0000","last_unstale":"2024-04-25T09:56:15.418608+0000","last_undegraded":"2024-04-25T09:56:15.418608+0000","last_fullsized":"2024-04-25T09:56:15.418608+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:52.657234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.398412+0000","last_change":"2024-04-25T09:56:14.398412+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.398412+0000","last_undegraded":"2024-04-25T09:56:14.398412+0000","last_fullsized":"2024-04-25T09:56:14.398412+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.404109+0000","last_change":"2024-04-25T09:56:14.404109+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.404109+0000","last_undegraded":"2024-04-25T09:56:14.404109+0000","last_fullsized":"2024-04-25T09:56:14.404109+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.420717+0000","last_change":"2024-04-25T09:56:15.415498+0000","last_active":"2024-04-25T09:56:15.420717+0000","last_peered":"2024-04-25T09:56:15.420717+0000","last_clean":"2024-04-25T09:56:15.420717+0000","last_became_active":"2024-04-25T09:56:15.415058+0000","last_became_peered":"2024-04-25T09:56:15.415058+0000","last_unstale":"2024-04-25T09:56:15.420717+0000","last_undegraded":"2024-04-25T09:56:15.420717+0000","last_fullsized":"2024-04-25T09:56:15.420717+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:08.074490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.400388+0000","last_change":"2024-04-25T09:56:14.400388+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.400388+0000","last_undegraded":"2024-04-25T09:56:14.400388+0000","last_fullsized":"2024-04-25T09:56:14.400388+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.419210+0000","last_change":"2024-04-25T09:56:15.415691+0000","last_active":"2024-04-25T09:56:15.419210+0000","last_peered":"2024-04-25T09:56:15.419210+0000","last_clean":"2024-04-25T09:56:15.419210+0000","last_became_active":"2024-04-25T09:56:15.410685+0000","last_became_peered":"2024-04-25T09:56:15.410685+0000","last_unstale":"2024-04-25T09:56:15.419210+0000","last_undegraded":"2024-04-25T09:56:15.419210+0000","last_fullsized":"2024-04-25T09:56:15.419210+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:40.524761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.407634+0000","last_change":"2024-04-25T09:56:15.406055+0000","last_active":"2024-04-25T09:56:15.407634+0000","last_peered":"2024-04-25T09:56:15.407634+0000","last_clean":"2024-04-25T09:56:15.407634+0000","last_became_active":"2024-04-25T09:56:15.405683+0000","last_became_peered":"2024-04-25T09:56:15.405683+0000","last_unstale":"2024-04-25T09:56:15.407634+0000","last_undegraded":"2024-04-25T09:56:15.407634+0000","last_fullsized":"2024-04-25T09:56:15.407634+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:56.579633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.398789+0000","last_change":"2024-04-25T09:56:14.398789+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.398789+0000","last_undegraded":"2024-04-25T09:56:14.398789+0000","last_fullsized":"2024-04-25T09:56:14.398789+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.402466+0000","last_change":"2024-04-25T09:56:14.402466+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.402466+0000","last_undegraded":"2024-04-25T09:56:14.402466+0000","last_fullsized":"2024-04-25T09:56:14.402466+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.399899+0000","last_change":"2024-04-25T09:56:14.399899+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.399899+0000","last_undegraded":"2024-04-25T09:56:14.399899+0000","last_fullsized":"2024-04-25T09:56:14.399899+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.403666+0000","last_change":"2024-04-25T09:56:14.403666+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.403666+0000","last_undegraded":"2024-04-25T09:56:14.403666+0000","last_fullsized":"2024-04-25T09:56:14.403666+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397725+0000","last_change":"2024-04-25T09:56:14.397725+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397725+0000","last_undegraded":"2024-04-25T09:56:14.397725+0000","last_fullsized":"2024-04-25T09:56:14.397725+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397960+0000","last_change":"2024-04-25T09:56:14.397960+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397960+0000","last_undegraded":"2024-04-25T09:56:14.397960+0000","last_fullsized":"2024-04-25T09:56:14.397960+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.419251+0000","last_change":"2024-04-25T09:56:15.416284+0000","last_active":"2024-04-25T09:56:15.419251+0000","last_peered":"2024-04-25T09:56:15.419251+0000","last_clean":"2024-04-25T09:56:15.419251+0000","last_became_active":"2024-04-25T09:56:15.416000+0000","last_became_peered":"2024-04-25T09:56:15.416000+0000","last_unstale":"2024-04-25T09:56:15.419251+0000","last_undegraded":"2024-04-25T09:56:15.419251+0000","last_fullsized":"2024-04-25T09:56:15.419251+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:19.710411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.399865+0000","last_change":"2024-04-25T09:56:14.399865+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.399865+0000","last_undegraded":"2024-04-25T09:56:14.399865+0000","last_fullsized":"2024-04-25T09:56:14.399865+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.417516+0000","last_change":"2024-04-25T09:56:15.406771+0000","last_active":"2024-04-25T09:56:15.417516+0000","last_peered":"2024-04-25T09:56:15.417516+0000","last_clean":"2024-04-25T09:56:15.417516+0000","last_became_active":"2024-04-25T09:56:15.406430+0000","last_became_peered":"2024-04-25T09:56:15.406430+0000","last_unstale":"2024-04-25T09:56:15.417516+0000","last_undegraded":"2024-04-25T09:56:15.417516+0000","last_fullsized":"2024-04-25T09:56:15.417516+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:34.121647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.399374+0000","last_change":"2024-04-25T09:56:14.399374+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.399374+0000","last_undegraded":"2024-04-25T09:56:14.399374+0000","last_fullsized":"2024-04-25T09:56:14.399374+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.413116+0000","last_change":"2024-04-25T09:56:15.408712+0000","last_active":"2024-04-25T09:56:15.413116+0000","last_peered":"2024-04-25T09:56:15.413116+0000","last_clean":"2024-04-25T09:56:15.413116+0000","last_became_active":"2024-04-25T09:56:15.408367+0000","last_became_peered":"2024-04-25T09:56:15.408367+0000","last_unstale":"2024-04-25T09:56:15.413116+0000","last_undegraded":"2024-04-25T09:56:15.413116+0000","last_fullsized":"2024-04-25T09:56:15.413116+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:52.399587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.420686+0000","last_change":"2024-04-25T09:56:15.417224+0000","last_active":"2024-04-25T09:56:15.420686+0000","last_peered":"2024-04-25T09:56:15.420686+0000","last_clean":"2024-04-25T09:56:15.420686+0000","last_became_active":"2024-04-25T09:56:15.415334+0000","last_became_peered":"2024-04-25T09:56:15.415334+0000","last_unstale":"2024-04-25T09:56:15.420686+0000","last_undegraded":"2024-04-25T09:56:15.420686+0000","last_fullsized":"2024-04-25T09:56:15.420686+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:52.399587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.419504+0000","last_change":"2024-04-25T09:56:14.413604+0000","last_active":"2024-04-25T09:56:15.419504+0000","last_peered":"2024-04-25T09:56:15.419504+0000","last_clean":"2024-04-25T09:56:15.419504+0000","last_became_active":"2024-04-25T09:56:14.413289+0000","last_became_peered":"2024-04-25T09:56:14.413289+0000","last_unstale":"2024-04-25T09:56:15.419504+0000","last_undegraded":"2024-04-25T09:56:15.419504+0000","last_fullsized":"2024-04-25T09:56:15.419504+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:42.555560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.413358+0000","last_change":"2024-04-25T09:56:15.407627+0000","last_active":"2024-04-25T09:56:15.413358+0000","last_peered":"2024-04-25T09:56:15.413358+0000","last_clean":"2024-04-25T09:56:15.413358+0000","last_became_active":"2024-04-25T09:56:15.407321+0000","last_became_peered":"2024-04-25T09:56:15.407321+0000","last_unstale":"2024-04-25T09:56:15.413358+0000","last_undegraded":"2024-04-25T09:56:15.413358+0000","last_fullsized":"2024-04-25T09:56:15.413358+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:05.088117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.409745+0000","last_change":"2024-04-25T09:56:14.407748+0000","last_active":"2024-04-25T09:56:14.409745+0000","last_peered":"2024-04-25T09:56:14.409745+0000","last_clean":"2024-04-25T09:56:14.409745+0000","last_became_active":"2024-04-25T09:56:14.407486+0000","last_became_peered":"2024-04-25T09:56:14.407486+0000","last_unstale":"2024-04-25T09:56:14.409745+0000","last_undegraded":"2024-04-25T09:56:14.409745+0000","last_fullsized":"2024-04-25T09:56:14.409745+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:59.529887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.417147+0000","last_change":"2024-04-25T09:56:15.414659+0000","last_active":"2024-04-25T09:56:15.417147+0000","last_peered":"2024-04-25T09:56:15.417147+0000","last_clean":"2024-04-25T09:56:15.417147+0000","last_became_active":"2024-04-25T09:56:15.410616+0000","last_became_peered":"2024-04-25T09:56:15.410616+0000","last_unstale":"2024-04-25T09:56:15.417147+0000","last_undegraded":"2024-04-25T09:56:15.417147+0000","last_fullsized":"2024-04-25T09:56:15.417147+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:34.121647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.412708+0000","last_change":"2024-04-25T09:56:14.408749+0000","last_active":"2024-04-25T09:56:14.412708+0000","last_peered":"2024-04-25T09:56:14.412708+0000","last_clean":"2024-04-25T09:56:14.412708+0000","last_became_active":"2024-04-25T09:56:14.408402+0000","last_became_peered":"2024-04-25T09:56:14.408402+0000","last_unstale":"2024-04-25T09:56:14.412708+0000","last_undegraded":"2024-04-25T09:56:14.412708+0000","last_fullsized":"2024-04-25T09:56:14.412708+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:09.715610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396837+0000","last_change":"2024-04-25T09:56:14.396837+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396837+0000","last_undegraded":"2024-04-25T09:56:14.396837+0000","last_fullsized":"2024-04-25T09:56:14.396837+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.428006+0000","last_change":"2024-04-25T09:56:14.416066+0000","last_active":"2024-04-25T09:56:15.428006+0000","last_peered":"2024-04-25T09:56:15.428006+0000","last_clean":"2024-04-25T09:56:15.428006+0000","last_became_active":"2024-04-25T09:56:14.415761+0000","last_became_peered":"2024-04-25T09:56:14.415761+0000","last_unstale":"2024-04-25T09:56:15.428006+0000","last_undegraded":"2024-04-25T09:56:15.428006+0000","last_fullsized":"2024-04-25T09:56:15.428006+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:51.655284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.412231+0000","last_change":"2024-04-25T09:56:15.405699+0000","last_active":"2024-04-25T09:56:15.412231+0000","last_peered":"2024-04-25T09:56:15.412231+0000","last_clean":"2024-04-25T09:56:15.412231+0000","last_became_active":"2024-04-25T09:56:15.405415+0000","last_became_peered":"2024-04-25T09:56:15.405415+0000","last_unstale":"2024-04-25T09:56:15.412231+0000","last_undegraded":"2024-04-25T09:56:15.412231+0000","last_fullsized":"2024-04-25T09:56:15.412231+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:11.547014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.414754+0000","last_change":"2024-04-25T09:56:14.411984+0000","last_active":"2024-04-25T09:56:14.414754+0000","last_peered":"2024-04-25T09:56:14.414754+0000","last_clean":"2024-04-25T09:56:14.414754+0000","last_became_active":"2024-04-25T09:56:14.411230+0000","last_became_peered":"2024-04-25T09:56:14.411230+0000","last_unstale":"2024-04-25T09:56:14.414754+0000","last_undegraded":"2024-04-25T09:56:14.414754+0000","last_fullsized":"2024-04-25T09:56:14.414754+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:02.173295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.414998+0000","last_change":"2024-04-25T09:56:15.409846+0000","last_active":"2024-04-25T09:56:15.414998+0000","last_peered":"2024-04-25T09:56:15.414998+0000","last_clean":"2024-04-25T09:56:15.414998+0000","last_became_active":"2024-04-25T09:56:15.409530+0000","last_became_peered":"2024-04-25T09:56:15.409530+0000","last_unstale":"2024-04-25T09:56:15.414998+0000","last_undegraded":"2024-04-25T09:56:15.414998+0000","last_fullsized":"2024-04-25T09:56:15.414998+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:19.710411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.424782+0000","last_change":"2024-04-25T09:56:14.411589+0000","last_active":"2024-04-25T09:56:15.424782+0000","last_peered":"2024-04-25T09:56:15.424782+0000","last_clean":"2024-04-25T09:56:15.424782+0000","last_became_active":"2024-04-25T09:56:14.411266+0000","last_became_peered":"2024-04-25T09:56:14.411266+0000","last_unstale":"2024-04-25T09:56:15.424782+0000","last_undegraded":"2024-04-25T09:56:15.424782+0000","last_fullsized":"2024-04-25T09:56:15.424782+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:02.173295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396786+0000","last_change":"2024-04-25T09:56:14.396786+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396786+0000","last_undegraded":"2024-04-25T09:56:14.396786+0000","last_fullsized":"2024-04-25T09:56:14.396786+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.398970+0000","last_change":"2024-04-25T09:56:14.413373+0000","last_active":"2024-04-25T09:56:15.398970+0000","last_peered":"2024-04-25T09:56:15.398970+0000","last_clean":"2024-04-25T09:56:15.398970+0000","last_became_active":"2024-04-25T09:56:14.413066+0000","last_became_peered":"2024-04-25T09:56:14.413066+0000","last_unstale":"2024-04-25T09:56:15.398970+0000","last_undegraded":"2024-04-25T09:56:15.398970+0000","last_fullsized":"2024-04-25T09:56:15.398970+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:02.173295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.415067+0000","last_change":"2024-04-25T09:56:15.409215+0000","last_active":"2024-04-25T09:56:15.415067+0000","last_peered":"2024-04-25T09:56:15.415067+0000","last_clean":"2024-04-25T09:56:15.415067+0000","last_became_active":"2024-04-25T09:56:15.408934+0000","last_became_peered":"2024-04-25T09:56:15.408934+0000","last_unstale":"2024-04-25T09:56:15.415067+0000","last_undegraded":"2024-04-25T09:56:15.415067+0000","last_fullsized":"2024-04-25T09:56:15.415067+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:40.524761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.411668+0000","last_change":"2024-04-25T09:56:14.409931+0000","last_active":"2024-04-25T09:56:14.411668+0000","last_peered":"2024-04-25T09:56:14.411668+0000","last_clean":"2024-04-25T09:56:14.411668+0000","last_became_active":"2024-04-25T09:56:14.409653+0000","last_became_peered":"2024-04-25T09:56:14.409653+0000","last_unstale":"2024-04-25T09:56:14.411668+0000","last_undegraded":"2024-04-25T09:56:14.411668+0000","last_fullsized":"2024-04-25T09:56:14.411668+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:02.560063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.412321+0000","last_change":"2024-04-25T09:56:15.404379+0000","last_active":"2024-04-25T09:56:15.412321+0000","last_peered":"2024-04-25T09:56:15.412321+0000","last_clean":"2024-04-25T09:56:15.412321+0000","last_became_active":"2024-04-25T09:56:15.404111+0000","last_became_peered":"2024-04-25T09:56:15.404111+0000","last_unstale":"2024-04-25T09:56:15.412321+0000","last_undegraded":"2024-04-25T09:56:15.412321+0000","last_fullsized":"2024-04-25T09:56:15.412321+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:49.392569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.401436+0000","last_change":"2024-04-25T09:56:14.415504+0000","last_active":"2024-04-25T09:56:15.401436+0000","last_peered":"2024-04-25T09:56:15.401436+0000","last_clean":"2024-04-25T09:56:15.401436+0000","last_became_active":"2024-04-25T09:56:14.414650+0000","last_became_peered":"2024-04-25T09:56:14.414650+0000","last_unstale":"2024-04-25T09:56:15.401436+0000","last_undegraded":"2024-04-25T09:56:15.401436+0000","last_fullsized":"2024-04-25T09:56:15.401436+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:43.308611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.413378+0000","last_change":"2024-04-25T09:56:15.409591+0000","last_active":"2024-04-25T09:56:15.413378+0000","last_peered":"2024-04-25T09:56:15.413378+0000","last_clean":"2024-04-25T09:56:15.413378+0000","last_became_active":"2024-04-25T09:56:15.409263+0000","last_became_peered":"2024-04-25T09:56:15.409263+0000","last_unstale":"2024-04-25T09:56:15.413378+0000","last_undegraded":"2024-04-25T09:56:15.413378+0000","last_fullsized":"2024-04-25T09:56:15.413378+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:26.649129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.394600+0000","last_change":"2024-04-25T09:56:14.412591+0000","last_active":"2024-04-25T09:56:15.394600+0000","last_peered":"2024-04-25T09:56:15.394600+0000","last_clean":"2024-04-25T09:56:15.394600+0000","last_became_active":"2024-04-25T09:56:14.412210+0000","last_became_peered":"2024-04-25T09:56:14.412210+0000","last_unstale":"2024-04-25T09:56:15.394600+0000","last_undegraded":"2024-04-25T09:56:15.394600+0000","last_fullsized":"2024-04-25T09:56:15.394600+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:02.560063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397298+0000","last_change":"2024-04-25T09:56:14.397298+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397298+0000","last_undegraded":"2024-04-25T09:56:14.397298+0000","last_fullsized":"2024-04-25T09:56:14.397298+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.427707+0000","last_change":"2024-04-25T09:56:14.416329+0000","last_active":"2024-04-25T09:56:15.427707+0000","last_peered":"2024-04-25T09:56:15.427707+0000","last_clean":"2024-04-25T09:56:15.427707+0000","last_became_active":"2024-04-25T09:56:14.416028+0000","last_became_peered":"2024-04-25T09:56:14.416028+0000","last_unstale":"2024-04-25T09:56:15.427707+0000","last_undegraded":"2024-04-25T09:56:15.427707+0000","last_fullsized":"2024-04-25T09:56:15.427707+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:10.545063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.417689+0000","last_change":"2024-04-25T09:56:15.413056+0000","last_active":"2024-04-25T09:56:15.417689+0000","last_peered":"2024-04-25T09:56:15.417689+0000","last_clean":"2024-04-25T09:56:15.417689+0000","last_became_active":"2024-04-25T09:56:15.412739+0000","last_became_peered":"2024-04-25T09:56:15.412739+0000","last_unstale":"2024-04-25T09:56:15.417689+0000","last_undegraded":"2024-04-25T09:56:15.417689+0000","last_fullsized":"2024-04-25T09:56:15.417689+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:56.579633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.416935+0000","last_change":"2024-04-25T09:56:14.408541+0000","last_active":"2024-04-25T09:56:14.416935+0000","last_peered":"2024-04-25T09:56:14.416935+0000","last_clean":"2024-04-25T09:56:14.416935+0000","last_became_active":"2024-04-25T09:56:14.407599+0000","last_became_peered":"2024-04-25T09:56:14.407599+0000","last_unstale":"2024-04-25T09:56:14.416935+0000","last_undegraded":"2024-04-25T09:56:14.416935+0000","last_fullsized":"2024-04-25T09:56:14.416935+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:51.655284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.413240+0000","last_change":"2024-04-25T09:56:15.407624+0000","last_active":"2024-04-25T09:56:15.413240+0000","last_peered":"2024-04-25T09:56:15.413240+0000","last_clean":"2024-04-25T09:56:15.413240+0000","last_became_active":"2024-04-25T09:56:15.407295+0000","last_became_peered":"2024-04-25T09:56:15.407295+0000","last_unstale":"2024-04-25T09:56:15.413240+0000","last_undegraded":"2024-04-25T09:56:15.413240+0000","last_fullsized":"2024-04-25T09:56:15.413240+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:57.405816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.414774+0000","last_change":"2024-04-25T09:56:14.412434+0000","last_active":"2024-04-25T09:56:14.414774+0000","last_peered":"2024-04-25T09:56:14.414774+0000","last_clean":"2024-04-25T09:56:14.414774+0000","last_became_active":"2024-04-25T09:56:14.411639+0000","last_became_peered":"2024-04-25T09:56:14.411639+0000","last_unstale":"2024-04-25T09:56:14.414774+0000","last_undegraded":"2024-04-25T09:56:14.414774+0000","last_fullsized":"2024-04-25T09:56:14.414774+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:31.472024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397944+0000","last_change":"2024-04-25T09:56:14.397944+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397944+0000","last_undegraded":"2024-04-25T09:56:14.397944+0000","last_fullsized":"2024-04-25T09:56:14.397944+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.400394+0000","last_change":"2024-04-25T09:56:14.417041+0000","last_active":"2024-04-25T09:56:15.400394+0000","last_peered":"2024-04-25T09:56:15.400394+0000","last_clean":"2024-04-25T09:56:15.400394+0000","last_became_active":"2024-04-25T09:56:14.416523+0000","last_became_peered":"2024-04-25T09:56:14.416523+0000","last_unstale":"2024-04-25T09:56:15.400394+0000","last_undegraded":"2024-04-25T09:56:15.400394+0000","last_fullsized":"2024-04-25T09:56:15.400394+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:48.390619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397265+0000","last_change":"2024-04-25T09:56:14.397265+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397265+0000","last_undegraded":"2024-04-25T09:56:14.397265+0000","last_fullsized":"2024-04-25T09:56:14.397265+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.401072+0000","last_change":"2024-04-25T09:56:14.413069+0000","last_active":"2024-04-25T09:56:15.401072+0000","last_peered":"2024-04-25T09:56:15.401072+0000","last_clean":"2024-04-25T09:56:15.401072+0000","last_became_active":"2024-04-25T09:56:14.412763+0000","last_became_peered":"2024-04-25T09:56:14.412763+0000","last_unstale":"2024-04-25T09:56:15.401072+0000","last_undegraded":"2024-04-25T09:56:15.401072+0000","last_fullsized":"2024-04-25T09:56:15.401072+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:55.577682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397743+0000","last_change":"2024-04-25T09:56:14.397743+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397743+0000","last_undegraded":"2024-04-25T09:56:14.397743+0000","last_fullsized":"2024-04-25T09:56:14.397743+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.416043+0000","last_change":"2024-04-25T09:56:14.409356+0000","last_active":"2024-04-25T09:56:14.416043+0000","last_peered":"2024-04-25T09:56:14.416043+0000","last_clean":"2024-04-25T09:56:14.416043+0000","last_became_active":"2024-04-25T09:56:14.409096+0000","last_became_peered":"2024-04-25T09:56:14.409096+0000","last_unstale":"2024-04-25T09:56:14.416043+0000","last_undegraded":"2024-04-25T09:56:14.416043+0000","last_fullsized":"2024-04-25T09:56:14.416043+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:04.086167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397108+0000","last_change":"2024-04-25T09:56:14.397108+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397108+0000","last_undegraded":"2024-04-25T09:56:14.397108+0000","last_fullsized":"2024-04-25T09:56:14.397108+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.405920+0000","last_change":"2024-04-25T09:56:14.405032+0000","last_active":"2024-04-25T09:56:14.405920+0000","last_peered":"2024-04-25T09:56:14.405920+0000","last_clean":"2024-04-25T09:56:14.405920+0000","last_became_active":"2024-04-25T09:56:14.404522+0000","last_became_peered":"2024-04-25T09:56:14.404522+0000","last_unstale":"2024-04-25T09:56:14.405920+0000","last_undegraded":"2024-04-25T09:56:14.405920+0000","last_fullsized":"2024-04-25T09:56:14.405920+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:09.715610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396240+0000","last_change":"2024-04-25T09:56:14.396240+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396240+0000","last_undegraded":"2024-04-25T09:56:14.396240+0000","last_fullsized":"2024-04-25T09:56:14.396240+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.413788+0000","last_change":"2024-04-25T09:56:14.412352+0000","last_active":"2024-04-25T09:56:14.413788+0000","last_peered":"2024-04-25T09:56:14.413788+0000","last_clean":"2024-04-25T09:56:14.413788+0000","last_became_active":"2024-04-25T09:56:14.412017+0000","last_became_peered":"2024-04-25T09:56:14.412017+0000","last_unstale":"2024-04-25T09:56:14.413788+0000","last_undegraded":"2024-04-25T09:56:14.413788+0000","last_fullsized":"2024-04-25T09:56:14.413788+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:46.143188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.417725+0000","last_change":"2024-04-25T09:56:15.414094+0000","last_active":"2024-04-25T09:56:15.417725+0000","last_peered":"2024-04-25T09:56:15.417725+0000","last_clean":"2024-04-25T09:56:15.417725+0000","last_became_active":"2024-04-25T09:56:15.413821+0000","last_became_peered":"2024-04-25T09:56:15.413821+0000","last_unstale":"2024-04-25T09:56:15.417725+0000","last_undegraded":"2024-04-25T09:56:15.417725+0000","last_fullsized":"2024-04-25T09:56:15.417725+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:25:17.174689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.420402+0000","last_change":"2024-04-25T09:56:14.410213+0000","last_active":"2024-04-25T09:56:15.420402+0000","last_peered":"2024-04-25T09:56:15.420402+0000","last_clean":"2024-04-25T09:56:15.420402+0000","last_became_active":"2024-04-25T09:56:14.409924+0000","last_became_peered":"2024-04-25T09:56:14.409924+0000","last_unstale":"2024-04-25T09:56:15.420402+0000","last_undegraded":"2024-04-25T09:56:15.420402+0000","last_fullsized":"2024-04-25T09:56:15.420402+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:10.545063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396079+0000","last_change":"2024-04-25T09:56:14.396079+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396079+0000","last_undegraded":"2024-04-25T09:56:14.396079+0000","last_fullsized":"2024-04-25T09:56:14.396079+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.400209+0000","last_change":"2024-04-25T09:56:14.406144+0000","last_active":"2024-04-25T09:56:15.400209+0000","last_peered":"2024-04-25T09:56:15.400209+0000","last_clean":"2024-04-25T09:56:15.400209+0000","last_became_active":"2024-04-25T09:56:14.405807+0000","last_became_peered":"2024-04-25T09:56:14.405807+0000","last_unstale":"2024-04-25T09:56:15.400209+0000","last_undegraded":"2024-04-25T09:56:15.400209+0000","last_fullsized":"2024-04-25T09:56:15.400209+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:31.472024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.413272+0000","last_change":"2024-04-25T09:56:15.409815+0000","last_active":"2024-04-25T09:56:15.413272+0000","last_peered":"2024-04-25T09:56:15.413272+0000","last_clean":"2024-04-25T09:56:15.413272+0000","last_became_active":"2024-04-25T09:56:15.409514+0000","last_became_peered":"2024-04-25T09:56:15.409514+0000","last_unstale":"2024-04-25T09:56:15.413272+0000","last_undegraded":"2024-04-25T09:56:15.413272+0000","last_fullsized":"2024-04-25T09:56:15.413272+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:35.961223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.408759+0000","last_change":"2024-04-25T09:56:14.406874+0000","last_active":"2024-04-25T09:56:14.408759+0000","last_peered":"2024-04-25T09:56:14.408759+0000","last_clean":"2024-04-25T09:56:14.408759+0000","last_became_active":"2024-04-25T09:56:14.406576+0000","last_became_peered":"2024-04-25T09:56:14.406576+0000","last_unstale":"2024-04-25T09:56:14.408759+0000","last_undegraded":"2024-04-25T09:56:14.408759+0000","last_fullsized":"2024-04-25T09:56:14.408759+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:52.202052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.415248+0000","last_change":"2024-04-25T09:56:15.410149+0000","last_active":"2024-04-25T09:56:15.415248+0000","last_peered":"2024-04-25T09:56:15.415248+0000","last_clean":"2024-04-25T09:56:15.415248+0000","last_became_active":"2024-04-25T09:56:15.409859+0000","last_became_peered":"2024-04-25T09:56:15.409859+0000","last_unstale":"2024-04-25T09:56:15.415248+0000","last_undegraded":"2024-04-25T09:56:15.415248+0000","last_fullsized":"2024-04-25T09:56:15.415248+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:44.310561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.414542+0000","last_change":"2024-04-25T09:56:14.406954+0000","last_active":"2024-04-25T09:56:14.414542+0000","last_peered":"2024-04-25T09:56:14.414542+0000","last_clean":"2024-04-25T09:56:14.414542+0000","last_became_active":"2024-04-25T09:56:14.406675+0000","last_became_peered":"2024-04-25T09:56:14.406675+0000","last_unstale":"2024-04-25T09:56:14.414542+0000","last_undegraded":"2024-04-25T09:56:14.414542+0000","last_fullsized":"2024-04-25T09:56:14.414542+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:39.522811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.395751+0000","last_change":"2024-04-25T09:56:14.395751+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.395751+0000","last_undegraded":"2024-04-25T09:56:14.395751+0000","last_fullsized":"2024-04-25T09:56:14.395751+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.409782+0000","last_change":"2024-04-25T09:56:14.406606+0000","last_active":"2024-04-25T09:56:14.409782+0000","last_peered":"2024-04-25T09:56:14.409782+0000","last_clean":"2024-04-25T09:56:14.409782+0000","last_became_active":"2024-04-25T09:56:14.406331+0000","last_became_peered":"2024-04-25T09:56:14.406331+0000","last_unstale":"2024-04-25T09:56:14.409782+0000","last_undegraded":"2024-04-25T09:56:14.409782+0000","last_fullsized":"2024-04-25T09:56:14.409782+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:42.555560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396387+0000","last_change":"2024-04-25T09:56:14.396387+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396387+0000","last_undegraded":"2024-04-25T09:56:14.396387+0000","last_fullsized":"2024-04-25T09:56:14.396387+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.416484+0000","last_change":"2024-04-25T09:56:14.414276+0000","last_active":"2024-04-25T09:56:14.416484+0000","last_peered":"2024-04-25T09:56:14.416484+0000","last_clean":"2024-04-25T09:56:14.416484+0000","last_became_active":"2024-04-25T09:56:14.413964+0000","last_became_peered":"2024-04-25T09:56:14.413964+0000","last_unstale":"2024-04-25T09:56:14.416484+0000","last_undegraded":"2024-04-25T09:56:14.416484+0000","last_fullsized":"2024-04-25T09:56:14.416484+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:50.921675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.417028+0000","last_change":"2024-04-25T09:56:15.409393+0000","last_active":"2024-04-25T09:56:15.417028+0000","last_peered":"2024-04-25T09:56:15.417028+0000","last_clean":"2024-04-25T09:56:15.417028+0000","last_became_active":"2024-04-25T09:56:15.409064+0000","last_became_peered":"2024-04-25T09:56:15.409064+0000","last_unstale":"2024-04-25T09:56:15.417028+0000","last_undegraded":"2024-04-25T09:56:15.417028+0000","last_fullsized":"2024-04-25T09:56:15.417028+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:08.074490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.426138+0000","last_change":"2024-04-25T09:56:14.415037+0000","last_active":"2024-04-25T09:56:15.426138+0000","last_peered":"2024-04-25T09:56:15.426138+0000","last_clean":"2024-04-25T09:56:15.426138+0000","last_became_active":"2024-04-25T09:56:14.414744+0000","last_became_peered":"2024-04-25T09:56:14.414744+0000","last_unstale":"2024-04-25T09:56:15.426138+0000","last_undegraded":"2024-04-25T09:56:15.426138+0000","last_fullsized":"2024-04-25T09:56:15.426138+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:02.560063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.395691+0000","last_change":"2024-04-25T09:56:14.395691+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.395691+0000","last_undegraded":"2024-04-25T09:56:14.395691+0000","last_fullsized":"2024-04-25T09:56:14.395691+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.401176+0000","last_change":"2024-04-25T09:56:14.415403+0000","last_active":"2024-04-25T09:56:15.401176+0000","last_peered":"2024-04-25T09:56:15.401176+0000","last_clean":"2024-04-25T09:56:15.401176+0000","last_became_active":"2024-04-25T09:56:14.414434+0000","last_became_peered":"2024-04-25T09:56:14.414434+0000","last_unstale":"2024-04-25T09:56:15.401176+0000","last_undegraded":"2024-04-25T09:56:15.401176+0000","last_fullsized":"2024-04-25T09:56:15.401176+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:25:16.172738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396338+0000","last_change":"2024-04-25T09:56:14.396338+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396338+0000","last_undegraded":"2024-04-25T09:56:14.396338+0000","last_fullsized":"2024-04-25T09:56:14.396338+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.415726+0000","last_change":"2024-04-25T09:56:14.414412+0000","last_active":"2024-04-25T09:56:14.415726+0000","last_peered":"2024-04-25T09:56:14.415726+0000","last_clean":"2024-04-25T09:56:14.415726+0000","last_became_active":"2024-04-25T09:56:14.413362+0000","last_became_peered":"2024-04-25T09:56:14.413362+0000","last_unstale":"2024-04-25T09:56:14.415726+0000","last_undegraded":"2024-04-25T09:56:14.415726+0000","last_fullsized":"2024-04-25T09:56:14.415726+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:48.390619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396316+0000","last_change":"2024-04-25T09:56:14.396316+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396316+0000","last_undegraded":"2024-04-25T09:56:14.396316+0000","last_fullsized":"2024-04-25T09:56:14.396316+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.414726+0000","last_change":"2024-04-25T09:56:14.408232+0000","last_active":"2024-04-25T09:56:14.414726+0000","last_peered":"2024-04-25T09:56:14.414726+0000","last_clean":"2024-04-25T09:56:14.414726+0000","last_became_active":"2024-04-25T09:56:14.407536+0000","last_became_peered":"2024-04-25T09:56:14.407536+0000","last_unstale":"2024-04-25T09:56:14.414726+0000","last_undegraded":"2024-04-25T09:56:14.414726+0000","last_fullsized":"2024-04-25T09:56:14.414726+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:18.708460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.418448+0000","last_change":"2024-04-25T09:56:15.416647+0000","last_active":"2024-04-25T09:56:15.418448+0000","last_peered":"2024-04-25T09:56:15.418448+0000","last_clean":"2024-04-25T09:56:15.418448+0000","last_became_active":"2024-04-25T09:56:15.416335+0000","last_became_peered":"2024-04-25T09:56:15.416335+0000","last_unstale":"2024-04-25T09:56:15.418448+0000","last_undegraded":"2024-04-25T09:56:15.418448+0000","last_fullsized":"2024-04-25T09:56:15.418448+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:57.464568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.416176+0000","last_change":"2024-04-25T09:56:14.413483+0000","last_active":"2024-04-25T09:56:14.416176+0000","last_peered":"2024-04-25T09:56:14.416176+0000","last_clean":"2024-04-25T09:56:14.416176+0000","last_became_active":"2024-04-25T09:56:14.413153+0000","last_became_peered":"2024-04-25T09:56:14.413153+0000","last_unstale":"2024-04-25T09:56:14.416176+0000","last_undegraded":"2024-04-25T09:56:14.416176+0000","last_fullsized":"2024-04-25T09:56:14.416176+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:56.403865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396787+0000","last_change":"2024-04-25T09:56:14.396787+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396787+0000","last_undegraded":"2024-04-25T09:56:14.396787+0000","last_fullsized":"2024-04-25T09:56:14.396787+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.394476+0000","last_change":"2024-04-25T09:56:14.411470+0000","last_active":"2024-04-25T09:56:15.394476+0000","last_peered":"2024-04-25T09:56:15.394476+0000","last_clean":"2024-04-25T09:56:15.394476+0000","last_became_active":"2024-04-25T09:56:14.411162+0000","last_became_peered":"2024-04-25T09:56:14.411162+0000","last_unstale":"2024-04-25T09:56:15.394476+0000","last_undegraded":"2024-04-25T09:56:15.394476+0000","last_fullsized":"2024-04-25T09:56:15.394476+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:42.555560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.398722+0000","last_change":"2024-04-25T09:56:14.398722+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.398722+0000","last_undegraded":"2024-04-25T09:56:14.398722+0000","last_fullsized":"2024-04-25T09:56:14.398722+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.401348+0000","last_change":"2024-04-25T09:56:14.410884+0000","last_active":"2024-04-25T09:56:15.401348+0000","last_peered":"2024-04-25T09:56:15.401348+0000","last_clean":"2024-04-25T09:56:15.401348+0000","last_became_active":"2024-04-25T09:56:14.410576+0000","last_became_peered":"2024-04-25T09:56:14.410576+0000","last_unstale":"2024-04-25T09:56:15.401348+0000","last_undegraded":"2024-04-25T09:56:15.401348+0000","last_fullsized":"2024-04-25T09:56:15.401348+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:18.708460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.414961+0000","last_change":"2024-04-25T09:56:15.408216+0000","last_active":"2024-04-25T09:56:15.414961+0000","last_peered":"2024-04-25T09:56:15.414961+0000","last_clean":"2024-04-25T09:56:15.414961+0000","last_became_active":"2024-04-25T09:56:15.407935+0000","last_became_peered":"2024-04-25T09:56:15.407935+0000","last_unstale":"2024-04-25T09:56:15.414961+0000","last_undegraded":"2024-04-25T09:56:15.414961+0000","last_fullsized":"2024-04-25T09:56:15.414961+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:25:17.174689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.417104+0000","last_change":"2024-04-25T09:56:14.415709+0000","last_active":"2024-04-25T09:56:14.417104+0000","last_peered":"2024-04-25T09:56:14.417104+0000","last_clean":"2024-04-25T09:56:14.417104+0000","last_became_active":"2024-04-25T09:56:14.415165+0000","last_became_peered":"2024-04-25T09:56:14.415165+0000","last_unstale":"2024-04-25T09:56:14.417104+0000","last_undegraded":"2024-04-25T09:56:14.417104+0000","last_fullsized":"2024-04-25T09:56:14.417104+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:10.545063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":220,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.400324+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T09:56:15.400324+0000","last_peered":"2024-04-25T09:56:15.400324+0000","last_clean":"2024-04-25T09:56:15.400324+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T09:56:15.400324+0000","last_undegraded":"2024-04-25T09:56:15.400324+0000","last_fullsized":"2024-04-25T09:56:15.400324+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":742,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1171456,"data_stored":843299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542171,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31768,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":598016,"data_stored":260750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542173,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":589824,"data_stored":260098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542170,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":577536,"data_stored":252931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":577536,"data_stored":252931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":577536,"data_stored":252931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":565248,"data_stored":246264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1159168,"data_stored":836632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:56:18.766 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:56:18.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.900+0000 7fc273688640 1 Processor -- start 2024-04-25T09:56:18.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.901+0000 7fc273688640 1 -- start start 2024-04-25T09:56:18.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.901+0000 7fc273688640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc26c15b8e0 0x7fc26c0d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:18.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.901+0000 7fc273688640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc26c0cc300 0x7fc26c0999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:18.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.901+0000 7fc273688640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc26c099f30 0x7fc26c15f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:18.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.901+0000 7fc273688640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc26c09a380 con 0x7fc26c0cc300 2024-04-25T09:56:18.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.901+0000 7fc273688640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc26c0cd7d0 con 0x7fc26c15b8e0 2024-04-25T09:56:18.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.901+0000 7fc273688640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c0ccbc0 con 0x7fc26c099f30 2024-04-25T09:56:18.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.902+0000 7fc270c23640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc26c0cc300 0x7fc26c0999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:18.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.902+0000 7fc270c23640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc26c0cc300 0x7fc26c0999f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59192/0 (socket says 172.21.15.7:59192) 2024-04-25T09:56:18.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.902+0000 7fc270c23640 1 -- 172.21.15.7:0/1874837259 learned_addr learned my addr 172.21.15.7:0/1874837259 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:18.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.902+0000 7fc271424640 1 --2- 172.21.15.7:0/1874837259 >> v2:172.21.15.55:3300/0 conn(0x7fc26c15b8e0 0x7fc26c0d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:18.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.902+0000 7fc271c25640 1 --2- 172.21.15.7:0/1874837259 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc26c099f30 0x7fc26c15f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:18.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.902+0000 7fc270c23640 1 -- 172.21.15.7:0/1874837259 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc26c099f30 msgr2=0x7fc26c15f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:18.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.902+0000 7fc270c23640 1 --2- 172.21.15.7:0/1874837259 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc26c099f30 0x7fc26c15f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:18.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.902+0000 7fc270c23640 1 -- 172.21.15.7:0/1874837259 >> v2:172.21.15.55:3300/0 conn(0x7fc26c15b8e0 msgr2=0x7fc26c0d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:18.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.902+0000 7fc270c23640 1 --2- 172.21.15.7:0/1874837259 >> v2:172.21.15.55:3300/0 conn(0x7fc26c15b8e0 0x7fc26c0d0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:18.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.902+0000 7fc270c23640 1 -- 172.21.15.7:0/1874837259 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26c0ccea0 con 0x7fc26c0cc300 2024-04-25T09:56:18.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.902+0000 7fc271c25640 1 --2- 172.21.15.7:0/1874837259 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc26c099f30 0x7fc26c15f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:56:18.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.903+0000 7fc270c23640 1 --2- 172.21.15.7:0/1874837259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc26c0cc300 0x7fc26c0999f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0b4230 tx=0x7fc25c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1730554e6fd70e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:18.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.903+0000 7fc263fff640 1 -- 172.21.15.7:0/1874837259 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25c037070 con 0x7fc26c0cc300 2024-04-25T09:56:18.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.903+0000 7fc263fff640 1 -- 172.21.15.7:0/1874837259 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25c032440 con 0x7fc26c0cc300 2024-04-25T09:56:18.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.903+0000 7fc263fff640 1 -- 172.21.15.7:0/1874837259 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25c032810 con 0x7fc26c0cc300 2024-04-25T09:56:18.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.903+0000 7fc273688640 1 -- 172.21.15.7:0/1874837259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc26c0cc300 msgr2=0x7fc26c0999f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:18.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.903+0000 7fc273688640 1 --2- 172.21.15.7:0/1874837259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc26c0cc300 0x7fc26c0999f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0b4230 tx=0x7fc25c02a1e0 comp rx=0 tx=0).stop 2024-04-25T09:56:18.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.903+0000 7fc273688640 1 -- 172.21.15.7:0/1874837259 shutdown_connections 2024-04-25T09:56:18.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.903+0000 7fc273688640 1 --2- 172.21.15.7:0/1874837259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc26c0cc300 0x7fc26c0999f0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:18.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.903+0000 7fc273688640 1 --2- 172.21.15.7:0/1874837259 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc26c099f30 0x7fc26c15f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:18.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.903+0000 7fc273688640 1 --2- 172.21.15.7:0/1874837259 >> v2:172.21.15.55:3300/0 conn(0x7fc26c15b8e0 0x7fc26c0d0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:18.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.903+0000 7fc273688640 1 -- 172.21.15.7:0/1874837259 >> 172.21.15.7:0/1874837259 conn(0x7fc26c0b3130 msgr2=0x7fc26c0b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:18.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.903+0000 7fc273688640 1 -- 172.21.15.7:0/1874837259 shutdown_connections 2024-04-25T09:56:18.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.904+0000 7fc273688640 1 -- 172.21.15.7:0/1874837259 wait complete. 2024-04-25T09:56:18.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.905+0000 7fc273688640 1 Processor -- start 2024-04-25T09:56:18.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.905+0000 7fc273688640 1 -- start start 2024-04-25T09:56:18.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.905+0000 7fc273688640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc26c099f30 0x7fc26c156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:18.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.905+0000 7fc273688640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc26c0cc300 0x7fc26c06d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:18.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.905+0000 7fc273688640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc26c15b8e0 0x7fc26c06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:18.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.905+0000 7fc273688640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c15bcc0 con 0x7fc26c099f30 2024-04-25T09:56:18.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.905+0000 7fc273688640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c0cd460 con 0x7fc26c0cc300 2024-04-25T09:56:18.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.905+0000 7fc273688640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c15be40 con 0x7fc26c15b8e0 2024-04-25T09:56:18.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.905+0000 7fc271424640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc26c099f30 0x7fc26c156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:18.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.905+0000 7fc271424640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc26c099f30 0x7fc26c156aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59202/0 (socket says 172.21.15.7:59202) 2024-04-25T09:56:18.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.905+0000 7fc271424640 1 -- 172.21.15.7:0/460407574 learned_addr learned my addr 172.21.15.7:0/460407574 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:18.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.906+0000 7fc270c23640 1 --2- 172.21.15.7:0/460407574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc26c0cc300 0x7fc26c06d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:18.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.906+0000 7fc271c25640 1 --2- 172.21.15.7:0/460407574 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc26c15b8e0 0x7fc26c06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:18.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.906+0000 7fc271424640 1 -- 172.21.15.7:0/460407574 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc26c15b8e0 msgr2=0x7fc26c06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:18.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.906+0000 7fc271424640 1 --2- 172.21.15.7:0/460407574 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc26c15b8e0 0x7fc26c06d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:18.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.906+0000 7fc271424640 1 -- 172.21.15.7:0/460407574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc26c0cc300 msgr2=0x7fc26c06d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:18.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.906+0000 7fc271424640 1 --2- 172.21.15.7:0/460407574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc26c0cc300 0x7fc26c06d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:18.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.906+0000 7fc271424640 1 -- 172.21.15.7:0/460407574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26c06bd10 con 0x7fc26c099f30 2024-04-25T09:56:18.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.906+0000 7fc270c23640 1 --2- 172.21.15.7:0/460407574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc26c0cc300 0x7fc26c06d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:56:18.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.906+0000 7fc271c25640 1 --2- 172.21.15.7:0/460407574 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc26c15b8e0 0x7fc26c06d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:56:18.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.906+0000 7fc271424640 1 --2- 172.21.15.7:0/460407574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc26c099f30 0x7fc26c156aa0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc26800d5f0 tx=0x7fc26800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:18.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.906+0000 7fc261ffb640 1 -- 172.21.15.7:0/460407574 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2680125f0 con 0x7fc26c099f30 2024-04-25T09:56:18.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.906+0000 7fc261ffb640 1 -- 172.21.15.7:0/460407574 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc268019070 con 0x7fc26c099f30 2024-04-25T09:56:18.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.906+0000 7fc273688640 1 -- 172.21.15.7:0/460407574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc26c0c7480 con 0x7fc26c099f30 2024-04-25T09:56:18.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.906+0000 7fc261ffb640 1 -- 172.21.15.7:0/460407574 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2680129d0 con 0x7fc26c099f30 2024-04-25T09:56:18.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.906+0000 7fc273688640 1 -- 172.21.15.7:0/460407574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc26c06c290 con 0x7fc26c099f30 2024-04-25T09:56:18.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.907+0000 7fc273688640 1 -- 172.21.15.7:0/460407574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc26c0d1210 con 0x7fc26c099f30 2024-04-25T09:56:18.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.908+0000 7fc261ffb640 1 -- 172.21.15.7:0/460407574 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc268012b70 con 0x7fc26c099f30 2024-04-25T09:56:18.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.908+0000 7fc261ffb640 1 --2- 172.21.15.7:0/460407574 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc25006b4d0 0x7fc25006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:18.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.908+0000 7fc261ffb640 1 -- 172.21.15.7:0/460407574 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc26808a790 con 0x7fc26c099f30 2024-04-25T09:56:18.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.908+0000 7fc270c23640 1 --2- 172.21.15.7:0/460407574 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc25006b4d0 0x7fc25006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:18.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.909+0000 7fc270c23640 1 --2- 172.21.15.7:0/460407574 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc25006b4d0 0x7fc25006d990 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc25c034000 tx=0x7fc25c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:18.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:18.912+0000 7fc261ffb640 1 -- 172.21.15.7:0/460407574 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc26c0d1210 con 0x7fc26c099f30 2024-04-25T09:56:19.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.088+0000 7fc273688640 1 -- 172.21.15.7:0/460407574 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc26c068fd0 con 0x7fc25006b4d0 2024-04-25T09:56:19.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.094+0000 7fc261ffb640 1 -- 172.21.15.7:0/460407574 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+248778 (secure 0 0 0) 0x7fc26c068fd0 con 0x7fc25006b4d0 2024-04-25T09:56:19.100 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:19.101 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T09:56:19.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.097+0000 7fc273688640 1 -- 172.21.15.7:0/460407574 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc25006b4d0 msgr2=0x7fc25006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:19.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.097+0000 7fc273688640 1 --2- 172.21.15.7:0/460407574 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc25006b4d0 0x7fc25006d990 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc25c034000 tx=0x7fc25c02e000 comp rx=0 tx=0).stop 2024-04-25T09:56:19.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.097+0000 7fc273688640 1 -- 172.21.15.7:0/460407574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc26c099f30 msgr2=0x7fc26c156aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:19.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.097+0000 7fc273688640 1 --2- 172.21.15.7:0/460407574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc26c099f30 0x7fc26c156aa0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc26800d5f0 tx=0x7fc26800dab0 comp rx=0 tx=0).stop 2024-04-25T09:56:19.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.097+0000 7fc273688640 1 -- 172.21.15.7:0/460407574 shutdown_connections 2024-04-25T09:56:19.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.097+0000 7fc273688640 1 --2- 172.21.15.7:0/460407574 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc25006b4d0 0x7fc25006d990 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:19.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.097+0000 7fc273688640 1 --2- 172.21.15.7:0/460407574 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc26c15b8e0 0x7fc26c06d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:19.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.097+0000 7fc273688640 1 --2- 172.21.15.7:0/460407574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc26c0cc300 0x7fc26c06d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:19.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.097+0000 7fc273688640 1 --2- 172.21.15.7:0/460407574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc26c099f30 0x7fc26c156aa0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:19.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.097+0000 7fc273688640 1 -- 172.21.15.7:0/460407574 >> 172.21.15.7:0/460407574 conn(0x7fc26c0b3130 msgr2=0x7fc26c0c7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:19.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.097+0000 7fc273688640 1 -- 172.21.15.7:0/460407574 shutdown_connections 2024-04-25T09:56:19.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.097+0000 7fc273688640 1 -- 172.21.15.7:0/460407574 wait complete. 2024-04-25T09:56:19.111 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2024-04-25T09:56:17.877249+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":174,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255136,"kb_used_data":5680,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754719584,"statfs":{"total":773094113280,"available":772832854016,"internally_reserved":0,"allocated":5816320,"data_stored":3205836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":742,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.495639"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.400552+0000","last_change":"2024-04-25T09:56:14.400552+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.400552+0000","last_undegraded":"2024-04-25T09:56:14.400552+0000","last_fullsized":"2024-04-25T09:56:14.400552+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.419019+0000","last_change":"2024-04-25T09:56:15.414664+0000","last_active":"2024-04-25T09:56:15.419019+0000","last_peered":"2024-04-25T09:56:15.419019+0000","last_clean":"2024-04-25T09:56:15.419019+0000","last_became_active":"2024-04-25T09:56:15.414291+0000","last_became_peered":"2024-04-25T09:56:15.414291+0000","last_unstale":"2024-04-25T09:56:15.419019+0000","last_undegraded":"2024-04-25T09:56:15.419019+0000","last_fullsized":"2024-04-25T09:56:15.419019+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:57.405816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.405512+0000","last_change":"2024-04-25T09:56:14.405512+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.405512+0000","last_undegraded":"2024-04-25T09:56:14.405512+0000","last_fullsized":"2024-04-25T09:56:14.405512+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.418562+0000","last_change":"2024-04-25T09:56:15.413750+0000","last_active":"2024-04-25T09:56:15.418562+0000","last_peered":"2024-04-25T09:56:15.418562+0000","last_clean":"2024-04-25T09:56:15.418562+0000","last_became_active":"2024-04-25T09:56:15.413442+0000","last_became_peered":"2024-04-25T09:56:15.413442+0000","last_unstale":"2024-04-25T09:56:15.418562+0000","last_undegraded":"2024-04-25T09:56:15.418562+0000","last_fullsized":"2024-04-25T09:56:15.418562+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:05.088117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.412912+0000","last_change":"2024-04-25T09:56:15.403689+0000","last_active":"2024-04-25T09:56:15.412912+0000","last_peered":"2024-04-25T09:56:15.412912+0000","last_clean":"2024-04-25T09:56:15.412912+0000","last_became_active":"2024-04-25T09:56:15.403310+0000","last_became_peered":"2024-04-25T09:56:15.403310+0000","last_unstale":"2024-04-25T09:56:15.412912+0000","last_undegraded":"2024-04-25T09:56:15.412912+0000","last_fullsized":"2024-04-25T09:56:15.412912+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:32.473975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.399868+0000","last_change":"2024-04-25T09:56:14.399868+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.399868+0000","last_undegraded":"2024-04-25T09:56:14.399868+0000","last_fullsized":"2024-04-25T09:56:14.399868+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.400932+0000","last_change":"2024-04-25T09:56:14.400932+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.400932+0000","last_undegraded":"2024-04-25T09:56:14.400932+0000","last_fullsized":"2024-04-25T09:56:14.400932+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397566+0000","last_change":"2024-04-25T09:56:14.397566+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397566+0000","last_undegraded":"2024-04-25T09:56:14.397566+0000","last_fullsized":"2024-04-25T09:56:14.397566+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.399128+0000","last_change":"2024-04-25T09:56:14.399128+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.399128+0000","last_undegraded":"2024-04-25T09:56:14.399128+0000","last_fullsized":"2024-04-25T09:56:14.399128+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.399463+0000","last_change":"2024-04-25T09:56:14.399463+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.399463+0000","last_undegraded":"2024-04-25T09:56:14.399463+0000","last_fullsized":"2024-04-25T09:56:14.399463+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.401987+0000","last_change":"2024-04-25T09:56:14.401987+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.401987+0000","last_undegraded":"2024-04-25T09:56:14.401987+0000","last_fullsized":"2024-04-25T09:56:14.401987+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396299+0000","last_change":"2024-04-25T09:56:14.396299+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396299+0000","last_undegraded":"2024-04-25T09:56:14.396299+0000","last_fullsized":"2024-04-25T09:56:14.396299+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.398876+0000","last_change":"2024-04-25T09:56:14.398876+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.398876+0000","last_undegraded":"2024-04-25T09:56:14.398876+0000","last_fullsized":"2024-04-25T09:56:14.398876+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.400902+0000","last_change":"2024-04-25T09:56:14.400902+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.400902+0000","last_undegraded":"2024-04-25T09:56:14.400902+0000","last_fullsized":"2024-04-25T09:56:14.400902+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.418608+0000","last_change":"2024-04-25T09:56:15.412875+0000","last_active":"2024-04-25T09:56:15.418608+0000","last_peered":"2024-04-25T09:56:15.418608+0000","last_clean":"2024-04-25T09:56:15.418608+0000","last_became_active":"2024-04-25T09:56:15.410551+0000","last_became_peered":"2024-04-25T09:56:15.410551+0000","last_unstale":"2024-04-25T09:56:15.418608+0000","last_undegraded":"2024-04-25T09:56:15.418608+0000","last_fullsized":"2024-04-25T09:56:15.418608+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:52.657234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.398412+0000","last_change":"2024-04-25T09:56:14.398412+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.398412+0000","last_undegraded":"2024-04-25T09:56:14.398412+0000","last_fullsized":"2024-04-25T09:56:14.398412+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.404109+0000","last_change":"2024-04-25T09:56:14.404109+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.404109+0000","last_undegraded":"2024-04-25T09:56:14.404109+0000","last_fullsized":"2024-04-25T09:56:14.404109+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.420717+0000","last_change":"2024-04-25T09:56:15.415498+0000","last_active":"2024-04-25T09:56:15.420717+0000","last_peered":"2024-04-25T09:56:15.420717+0000","last_clean":"2024-04-25T09:56:15.420717+0000","last_became_active":"2024-04-25T09:56:15.415058+0000","last_became_peered":"2024-04-25T09:56:15.415058+0000","last_unstale":"2024-04-25T09:56:15.420717+0000","last_undegraded":"2024-04-25T09:56:15.420717+0000","last_fullsized":"2024-04-25T09:56:15.420717+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:08.074490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.400388+0000","last_change":"2024-04-25T09:56:14.400388+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.400388+0000","last_undegraded":"2024-04-25T09:56:14.400388+0000","last_fullsized":"2024-04-25T09:56:14.400388+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.419210+0000","last_change":"2024-04-25T09:56:15.415691+0000","last_active":"2024-04-25T09:56:15.419210+0000","last_peered":"2024-04-25T09:56:15.419210+0000","last_clean":"2024-04-25T09:56:15.419210+0000","last_became_active":"2024-04-25T09:56:15.410685+0000","last_became_peered":"2024-04-25T09:56:15.410685+0000","last_unstale":"2024-04-25T09:56:15.419210+0000","last_undegraded":"2024-04-25T09:56:15.419210+0000","last_fullsized":"2024-04-25T09:56:15.419210+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:40.524761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.407634+0000","last_change":"2024-04-25T09:56:15.406055+0000","last_active":"2024-04-25T09:56:15.407634+0000","last_peered":"2024-04-25T09:56:15.407634+0000","last_clean":"2024-04-25T09:56:15.407634+0000","last_became_active":"2024-04-25T09:56:15.405683+0000","last_became_peered":"2024-04-25T09:56:15.405683+0000","last_unstale":"2024-04-25T09:56:15.407634+0000","last_undegraded":"2024-04-25T09:56:15.407634+0000","last_fullsized":"2024-04-25T09:56:15.407634+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:56.579633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.398789+0000","last_change":"2024-04-25T09:56:14.398789+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.398789+0000","last_undegraded":"2024-04-25T09:56:14.398789+0000","last_fullsized":"2024-04-25T09:56:14.398789+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.402466+0000","last_change":"2024-04-25T09:56:14.402466+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.402466+0000","last_undegraded":"2024-04-25T09:56:14.402466+0000","last_fullsized":"2024-04-25T09:56:14.402466+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.399899+0000","last_change":"2024-04-25T09:56:14.399899+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.399899+0000","last_undegraded":"2024-04-25T09:56:14.399899+0000","last_fullsized":"2024-04-25T09:56:14.399899+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.403666+0000","last_change":"2024-04-25T09:56:14.403666+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.403666+0000","last_undegraded":"2024-04-25T09:56:14.403666+0000","last_fullsized":"2024-04-25T09:56:14.403666+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397725+0000","last_change":"2024-04-25T09:56:14.397725+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397725+0000","last_undegraded":"2024-04-25T09:56:14.397725+0000","last_fullsized":"2024-04-25T09:56:14.397725+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397960+0000","last_change":"2024-04-25T09:56:14.397960+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397960+0000","last_undegraded":"2024-04-25T09:56:14.397960+0000","last_fullsized":"2024-04-25T09:56:14.397960+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.419251+0000","last_change":"2024-04-25T09:56:15.416284+0000","last_active":"2024-04-25T09:56:15.419251+0000","last_peered":"2024-04-25T09:56:15.419251+0000","last_clean":"2024-04-25T09:56:15.419251+0000","last_became_active":"2024-04-25T09:56:15.416000+0000","last_became_peered":"2024-04-25T09:56:15.416000+0000","last_unstale":"2024-04-25T09:56:15.419251+0000","last_undegraded":"2024-04-25T09:56:15.419251+0000","last_fullsized":"2024-04-25T09:56:15.419251+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:19.710411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.399865+0000","last_change":"2024-04-25T09:56:14.399865+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.399865+0000","last_undegraded":"2024-04-25T09:56:14.399865+0000","last_fullsized":"2024-04-25T09:56:14.399865+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.417516+0000","last_change":"2024-04-25T09:56:15.406771+0000","last_active":"2024-04-25T09:56:15.417516+0000","last_peered":"2024-04-25T09:56:15.417516+0000","last_clean":"2024-04-25T09:56:15.417516+0000","last_became_active":"2024-04-25T09:56:15.406430+0000","last_became_peered":"2024-04-25T09:56:15.406430+0000","last_unstale":"2024-04-25T09:56:15.417516+0000","last_undegraded":"2024-04-25T09:56:15.417516+0000","last_fullsized":"2024-04-25T09:56:15.417516+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:34.121647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.399374+0000","last_change":"2024-04-25T09:56:14.399374+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.399374+0000","last_undegraded":"2024-04-25T09:56:14.399374+0000","last_fullsized":"2024-04-25T09:56:14.399374+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.413116+0000","last_change":"2024-04-25T09:56:15.408712+0000","last_active":"2024-04-25T09:56:15.413116+0000","last_peered":"2024-04-25T09:56:15.413116+0000","last_clean":"2024-04-25T09:56:15.413116+0000","last_became_active":"2024-04-25T09:56:15.408367+0000","last_became_peered":"2024-04-25T09:56:15.408367+0000","last_unstale":"2024-04-25T09:56:15.413116+0000","last_undegraded":"2024-04-25T09:56:15.413116+0000","last_fullsized":"2024-04-25T09:56:15.413116+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:52.399587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.420686+0000","last_change":"2024-04-25T09:56:15.417224+0000","last_active":"2024-04-25T09:56:15.420686+0000","last_peered":"2024-04-25T09:56:15.420686+0000","last_clean":"2024-04-25T09:56:15.420686+0000","last_became_active":"2024-04-25T09:56:15.415334+0000","last_became_peered":"2024-04-25T09:56:15.415334+0000","last_unstale":"2024-04-25T09:56:15.420686+0000","last_undegraded":"2024-04-25T09:56:15.420686+0000","last_fullsized":"2024-04-25T09:56:15.420686+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:52.399587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.419504+0000","last_change":"2024-04-25T09:56:14.413604+0000","last_active":"2024-04-25T09:56:15.419504+0000","last_peered":"2024-04-25T09:56:15.419504+0000","last_clean":"2024-04-25T09:56:15.419504+0000","last_became_active":"2024-04-25T09:56:14.413289+0000","last_became_peered":"2024-04-25T09:56:14.413289+0000","last_unstale":"2024-04-25T09:56:15.419504+0000","last_undegraded":"2024-04-25T09:56:15.419504+0000","last_fullsized":"2024-04-25T09:56:15.419504+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:42.555560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.413358+0000","last_change":"2024-04-25T09:56:15.407627+0000","last_active":"2024-04-25T09:56:15.413358+0000","last_peered":"2024-04-25T09:56:15.413358+0000","last_clean":"2024-04-25T09:56:15.413358+0000","last_became_active":"2024-04-25T09:56:15.407321+0000","last_became_peered":"2024-04-25T09:56:15.407321+0000","last_unstale":"2024-04-25T09:56:15.413358+0000","last_undegraded":"2024-04-25T09:56:15.413358+0000","last_fullsized":"2024-04-25T09:56:15.413358+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:05.088117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.409745+0000","last_change":"2024-04-25T09:56:14.407748+0000","last_active":"2024-04-25T09:56:14.409745+0000","last_peered":"2024-04-25T09:56:14.409745+0000","last_clean":"2024-04-25T09:56:14.409745+0000","last_became_active":"2024-04-25T09:56:14.407486+0000","last_became_peered":"2024-04-25T09:56:14.407486+0000","last_unstale":"2024-04-25T09:56:14.409745+0000","last_undegraded":"2024-04-25T09:56:14.409745+0000","last_fullsized":"2024-04-25T09:56:14.409745+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:59.529887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.417147+0000","last_change":"2024-04-25T09:56:15.414659+0000","last_active":"2024-04-25T09:56:15.417147+0000","last_peered":"2024-04-25T09:56:15.417147+0000","last_clean":"2024-04-25T09:56:15.417147+0000","last_became_active":"2024-04-25T09:56:15.410616+0000","last_became_peered":"2024-04-25T09:56:15.410616+0000","last_unstale":"2024-04-25T09:56:15.417147+0000","last_undegraded":"2024-04-25T09:56:15.417147+0000","last_fullsized":"2024-04-25T09:56:15.417147+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:34.121647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.412708+0000","last_change":"2024-04-25T09:56:14.408749+0000","last_active":"2024-04-25T09:56:14.412708+0000","last_peered":"2024-04-25T09:56:14.412708+0000","last_clean":"2024-04-25T09:56:14.412708+0000","last_became_active":"2024-04-25T09:56:14.408402+0000","last_became_peered":"2024-04-25T09:56:14.408402+0000","last_unstale":"2024-04-25T09:56:14.412708+0000","last_undegraded":"2024-04-25T09:56:14.412708+0000","last_fullsized":"2024-04-25T09:56:14.412708+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:09.715610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396837+0000","last_change":"2024-04-25T09:56:14.396837+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396837+0000","last_undegraded":"2024-04-25T09:56:14.396837+0000","last_fullsized":"2024-04-25T09:56:14.396837+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.428006+0000","last_change":"2024-04-25T09:56:14.416066+0000","last_active":"2024-04-25T09:56:15.428006+0000","last_peered":"2024-04-25T09:56:15.428006+0000","last_clean":"2024-04-25T09:56:15.428006+0000","last_became_active":"2024-04-25T09:56:14.415761+0000","last_became_peered":"2024-04-25T09:56:14.415761+0000","last_unstale":"2024-04-25T09:56:15.428006+0000","last_undegraded":"2024-04-25T09:56:15.428006+0000","last_fullsized":"2024-04-25T09:56:15.428006+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:51.655284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.412231+0000","last_change":"2024-04-25T09:56:15.405699+0000","last_active":"2024-04-25T09:56:15.412231+0000","last_peered":"2024-04-25T09:56:15.412231+0000","last_clean":"2024-04-25T09:56:15.412231+0000","last_became_active":"2024-04-25T09:56:15.405415+0000","last_became_peered":"2024-04-25T09:56:15.405415+0000","last_unstale":"2024-04-25T09:56:15.412231+0000","last_undegraded":"2024-04-25T09:56:15.412231+0000","last_fullsized":"2024-04-25T09:56:15.412231+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:11.547014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.414754+0000","last_change":"2024-04-25T09:56:14.411984+0000","last_active":"2024-04-25T09:56:14.414754+0000","last_peered":"2024-04-25T09:56:14.414754+0000","last_clean":"2024-04-25T09:56:14.414754+0000","last_became_active":"2024-04-25T09:56:14.411230+0000","last_became_peered":"2024-04-25T09:56:14.411230+0000","last_unstale":"2024-04-25T09:56:14.414754+0000","last_undegraded":"2024-04-25T09:56:14.414754+0000","last_fullsized":"2024-04-25T09:56:14.414754+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:02.173295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.414998+0000","last_change":"2024-04-25T09:56:15.409846+0000","last_active":"2024-04-25T09:56:15.414998+0000","last_peered":"2024-04-25T09:56:15.414998+0000","last_clean":"2024-04-25T09:56:15.414998+0000","last_became_active":"2024-04-25T09:56:15.409530+0000","last_became_peered":"2024-04-25T09:56:15.409530+0000","last_unstale":"2024-04-25T09:56:15.414998+0000","last_undegraded":"2024-04-25T09:56:15.414998+0000","last_fullsized":"2024-04-25T09:56:15.414998+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:19.710411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.424782+0000","last_change":"2024-04-25T09:56:14.411589+0000","last_active":"2024-04-25T09:56:15.424782+0000","last_peered":"2024-04-25T09:56:15.424782+0000","last_clean":"2024-04-25T09:56:15.424782+0000","last_became_active":"2024-04-25T09:56:14.411266+0000","last_became_peered":"2024-04-25T09:56:14.411266+0000","last_unstale":"2024-04-25T09:56:15.424782+0000","last_undegraded":"2024-04-25T09:56:15.424782+0000","last_fullsized":"2024-04-25T09:56:15.424782+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:02.173295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396786+0000","last_change":"2024-04-25T09:56:14.396786+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396786+0000","last_undegraded":"2024-04-25T09:56:14.396786+0000","last_fullsized":"2024-04-25T09:56:14.396786+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.398970+0000","last_change":"2024-04-25T09:56:14.413373+0000","last_active":"2024-04-25T09:56:15.398970+0000","last_peered":"2024-04-25T09:56:15.398970+0000","last_clean":"2024-04-25T09:56:15.398970+0000","last_became_active":"2024-04-25T09:56:14.413066+0000","last_became_peered":"2024-04-25T09:56:14.413066+0000","last_unstale":"2024-04-25T09:56:15.398970+0000","last_undegraded":"2024-04-25T09:56:15.398970+0000","last_fullsized":"2024-04-25T09:56:15.398970+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:02.173295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.415067+0000","last_change":"2024-04-25T09:56:15.409215+0000","last_active":"2024-04-25T09:56:15.415067+0000","last_peered":"2024-04-25T09:56:15.415067+0000","last_clean":"2024-04-25T09:56:15.415067+0000","last_became_active":"2024-04-25T09:56:15.408934+0000","last_became_peered":"2024-04-25T09:56:15.408934+0000","last_unstale":"2024-04-25T09:56:15.415067+0000","last_undegraded":"2024-04-25T09:56:15.415067+0000","last_fullsized":"2024-04-25T09:56:15.415067+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:40.524761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.411668+0000","last_change":"2024-04-25T09:56:14.409931+0000","last_active":"2024-04-25T09:56:14.411668+0000","last_peered":"2024-04-25T09:56:14.411668+0000","last_clean":"2024-04-25T09:56:14.411668+0000","last_became_active":"2024-04-25T09:56:14.409653+0000","last_became_peered":"2024-04-25T09:56:14.409653+0000","last_unstale":"2024-04-25T09:56:14.411668+0000","last_undegraded":"2024-04-25T09:56:14.411668+0000","last_fullsized":"2024-04-25T09:56:14.411668+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:02.560063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.412321+0000","last_change":"2024-04-25T09:56:15.404379+0000","last_active":"2024-04-25T09:56:15.412321+0000","last_peered":"2024-04-25T09:56:15.412321+0000","last_clean":"2024-04-25T09:56:15.412321+0000","last_became_active":"2024-04-25T09:56:15.404111+0000","last_became_peered":"2024-04-25T09:56:15.404111+0000","last_unstale":"2024-04-25T09:56:15.412321+0000","last_undegraded":"2024-04-25T09:56:15.412321+0000","last_fullsized":"2024-04-25T09:56:15.412321+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:49.392569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.401436+0000","last_change":"2024-04-25T09:56:14.415504+0000","last_active":"2024-04-25T09:56:15.401436+0000","last_peered":"2024-04-25T09:56:15.401436+0000","last_clean":"2024-04-25T09:56:15.401436+0000","last_became_active":"2024-04-25T09:56:14.414650+0000","last_became_peered":"2024-04-25T09:56:14.414650+0000","last_unstale":"2024-04-25T09:56:15.401436+0000","last_undegraded":"2024-04-25T09:56:15.401436+0000","last_fullsized":"2024-04-25T09:56:15.401436+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:43.308611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.413378+0000","last_change":"2024-04-25T09:56:15.409591+0000","last_active":"2024-04-25T09:56:15.413378+0000","last_peered":"2024-04-25T09:56:15.413378+0000","last_clean":"2024-04-25T09:56:15.413378+0000","last_became_active":"2024-04-25T09:56:15.409263+0000","last_became_peered":"2024-04-25T09:56:15.409263+0000","last_unstale":"2024-04-25T09:56:15.413378+0000","last_undegraded":"2024-04-25T09:56:15.413378+0000","last_fullsized":"2024-04-25T09:56:15.413378+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:26.649129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.394600+0000","last_change":"2024-04-25T09:56:14.412591+0000","last_active":"2024-04-25T09:56:15.394600+0000","last_peered":"2024-04-25T09:56:15.394600+0000","last_clean":"2024-04-25T09:56:15.394600+0000","last_became_active":"2024-04-25T09:56:14.412210+0000","last_became_peered":"2024-04-25T09:56:14.412210+0000","last_unstale":"2024-04-25T09:56:15.394600+0000","last_undegraded":"2024-04-25T09:56:15.394600+0000","last_fullsized":"2024-04-25T09:56:15.394600+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:02.560063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397298+0000","last_change":"2024-04-25T09:56:14.397298+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397298+0000","last_undegraded":"2024-04-25T09:56:14.397298+0000","last_fullsized":"2024-04-25T09:56:14.397298+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.427707+0000","last_change":"2024-04-25T09:56:14.416329+0000","last_active":"2024-04-25T09:56:15.427707+0000","last_peered":"2024-04-25T09:56:15.427707+0000","last_clean":"2024-04-25T09:56:15.427707+0000","last_became_active":"2024-04-25T09:56:14.416028+0000","last_became_peered":"2024-04-25T09:56:14.416028+0000","last_unstale":"2024-04-25T09:56:15.427707+0000","last_undegraded":"2024-04-25T09:56:15.427707+0000","last_fullsized":"2024-04-25T09:56:15.427707+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:10.545063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.417689+0000","last_change":"2024-04-25T09:56:15.413056+0000","last_active":"2024-04-25T09:56:15.417689+0000","last_peered":"2024-04-25T09:56:15.417689+0000","last_clean":"2024-04-25T09:56:15.417689+0000","last_became_active":"2024-04-25T09:56:15.412739+0000","last_became_peered":"2024-04-25T09:56:15.412739+0000","last_unstale":"2024-04-25T09:56:15.417689+0000","last_undegraded":"2024-04-25T09:56:15.417689+0000","last_fullsized":"2024-04-25T09:56:15.417689+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:56.579633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.416935+0000","last_change":"2024-04-25T09:56:14.408541+0000","last_active":"2024-04-25T09:56:14.416935+0000","last_peered":"2024-04-25T09:56:14.416935+0000","last_clean":"2024-04-25T09:56:14.416935+0000","last_became_active":"2024-04-25T09:56:14.407599+0000","last_became_peered":"2024-04-25T09:56:14.407599+0000","last_unstale":"2024-04-25T09:56:14.416935+0000","last_undegraded":"2024-04-25T09:56:14.416935+0000","last_fullsized":"2024-04-25T09:56:14.416935+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:51.655284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.413240+0000","last_change":"2024-04-25T09:56:15.407624+0000","last_active":"2024-04-25T09:56:15.413240+0000","last_peered":"2024-04-25T09:56:15.413240+0000","last_clean":"2024-04-25T09:56:15.413240+0000","last_became_active":"2024-04-25T09:56:15.407295+0000","last_became_peered":"2024-04-25T09:56:15.407295+0000","last_unstale":"2024-04-25T09:56:15.413240+0000","last_undegraded":"2024-04-25T09:56:15.413240+0000","last_fullsized":"2024-04-25T09:56:15.413240+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:57.405816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.414774+0000","last_change":"2024-04-25T09:56:14.412434+0000","last_active":"2024-04-25T09:56:14.414774+0000","last_peered":"2024-04-25T09:56:14.414774+0000","last_clean":"2024-04-25T09:56:14.414774+0000","last_became_active":"2024-04-25T09:56:14.411639+0000","last_became_peered":"2024-04-25T09:56:14.411639+0000","last_unstale":"2024-04-25T09:56:14.414774+0000","last_undegraded":"2024-04-25T09:56:14.414774+0000","last_fullsized":"2024-04-25T09:56:14.414774+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:31.472024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397944+0000","last_change":"2024-04-25T09:56:14.397944+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397944+0000","last_undegraded":"2024-04-25T09:56:14.397944+0000","last_fullsized":"2024-04-25T09:56:14.397944+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.400394+0000","last_change":"2024-04-25T09:56:14.417041+0000","last_active":"2024-04-25T09:56:15.400394+0000","last_peered":"2024-04-25T09:56:15.400394+0000","last_clean":"2024-04-25T09:56:15.400394+0000","last_became_active":"2024-04-25T09:56:14.416523+0000","last_became_peered":"2024-04-25T09:56:14.416523+0000","last_unstale":"2024-04-25T09:56:15.400394+0000","last_undegraded":"2024-04-25T09:56:15.400394+0000","last_fullsized":"2024-04-25T09:56:15.400394+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:48.390619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397265+0000","last_change":"2024-04-25T09:56:14.397265+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397265+0000","last_undegraded":"2024-04-25T09:56:14.397265+0000","last_fullsized":"2024-04-25T09:56:14.397265+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.401072+0000","last_change":"2024-04-25T09:56:14.413069+0000","last_active":"2024-04-25T09:56:15.401072+0000","last_peered":"2024-04-25T09:56:15.401072+0000","last_clean":"2024-04-25T09:56:15.401072+0000","last_became_active":"2024-04-25T09:56:14.412763+0000","last_became_peered":"2024-04-25T09:56:14.412763+0000","last_unstale":"2024-04-25T09:56:15.401072+0000","last_undegraded":"2024-04-25T09:56:15.401072+0000","last_fullsized":"2024-04-25T09:56:15.401072+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:55.577682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397743+0000","last_change":"2024-04-25T09:56:14.397743+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397743+0000","last_undegraded":"2024-04-25T09:56:14.397743+0000","last_fullsized":"2024-04-25T09:56:14.397743+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.416043+0000","last_change":"2024-04-25T09:56:14.409356+0000","last_active":"2024-04-25T09:56:14.416043+0000","last_peered":"2024-04-25T09:56:14.416043+0000","last_clean":"2024-04-25T09:56:14.416043+0000","last_became_active":"2024-04-25T09:56:14.409096+0000","last_became_peered":"2024-04-25T09:56:14.409096+0000","last_unstale":"2024-04-25T09:56:14.416043+0000","last_undegraded":"2024-04-25T09:56:14.416043+0000","last_fullsized":"2024-04-25T09:56:14.416043+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:04.086167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397108+0000","last_change":"2024-04-25T09:56:14.397108+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397108+0000","last_undegraded":"2024-04-25T09:56:14.397108+0000","last_fullsized":"2024-04-25T09:56:14.397108+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.405920+0000","last_change":"2024-04-25T09:56:14.405032+0000","last_active":"2024-04-25T09:56:14.405920+0000","last_peered":"2024-04-25T09:56:14.405920+0000","last_clean":"2024-04-25T09:56:14.405920+0000","last_became_active":"2024-04-25T09:56:14.404522+0000","last_became_peered":"2024-04-25T09:56:14.404522+0000","last_unstale":"2024-04-25T09:56:14.405920+0000","last_undegraded":"2024-04-25T09:56:14.405920+0000","last_fullsized":"2024-04-25T09:56:14.405920+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:09.715610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396240+0000","last_change":"2024-04-25T09:56:14.396240+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396240+0000","last_undegraded":"2024-04-25T09:56:14.396240+0000","last_fullsized":"2024-04-25T09:56:14.396240+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.413788+0000","last_change":"2024-04-25T09:56:14.412352+0000","last_active":"2024-04-25T09:56:14.413788+0000","last_peered":"2024-04-25T09:56:14.413788+0000","last_clean":"2024-04-25T09:56:14.413788+0000","last_became_active":"2024-04-25T09:56:14.412017+0000","last_became_peered":"2024-04-25T09:56:14.412017+0000","last_unstale":"2024-04-25T09:56:14.413788+0000","last_undegraded":"2024-04-25T09:56:14.413788+0000","last_fullsized":"2024-04-25T09:56:14.413788+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:46.143188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.417725+0000","last_change":"2024-04-25T09:56:15.414094+0000","last_active":"2024-04-25T09:56:15.417725+0000","last_peered":"2024-04-25T09:56:15.417725+0000","last_clean":"2024-04-25T09:56:15.417725+0000","last_became_active":"2024-04-25T09:56:15.413821+0000","last_became_peered":"2024-04-25T09:56:15.413821+0000","last_unstale":"2024-04-25T09:56:15.417725+0000","last_undegraded":"2024-04-25T09:56:15.417725+0000","last_fullsized":"2024-04-25T09:56:15.417725+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:25:17.174689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.420402+0000","last_change":"2024-04-25T09:56:14.410213+0000","last_active":"2024-04-25T09:56:15.420402+0000","last_peered":"2024-04-25T09:56:15.420402+0000","last_clean":"2024-04-25T09:56:15.420402+0000","last_became_active":"2024-04-25T09:56:14.409924+0000","last_became_peered":"2024-04-25T09:56:14.409924+0000","last_unstale":"2024-04-25T09:56:15.420402+0000","last_undegraded":"2024-04-25T09:56:15.420402+0000","last_fullsized":"2024-04-25T09:56:15.420402+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:10.545063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396079+0000","last_change":"2024-04-25T09:56:14.396079+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396079+0000","last_undegraded":"2024-04-25T09:56:14.396079+0000","last_fullsized":"2024-04-25T09:56:14.396079+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.400209+0000","last_change":"2024-04-25T09:56:14.406144+0000","last_active":"2024-04-25T09:56:15.400209+0000","last_peered":"2024-04-25T09:56:15.400209+0000","last_clean":"2024-04-25T09:56:15.400209+0000","last_became_active":"2024-04-25T09:56:14.405807+0000","last_became_peered":"2024-04-25T09:56:14.405807+0000","last_unstale":"2024-04-25T09:56:15.400209+0000","last_undegraded":"2024-04-25T09:56:15.400209+0000","last_fullsized":"2024-04-25T09:56:15.400209+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:31.472024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.413272+0000","last_change":"2024-04-25T09:56:15.409815+0000","last_active":"2024-04-25T09:56:15.413272+0000","last_peered":"2024-04-25T09:56:15.413272+0000","last_clean":"2024-04-25T09:56:15.413272+0000","last_became_active":"2024-04-25T09:56:15.409514+0000","last_became_peered":"2024-04-25T09:56:15.409514+0000","last_unstale":"2024-04-25T09:56:15.413272+0000","last_undegraded":"2024-04-25T09:56:15.413272+0000","last_fullsized":"2024-04-25T09:56:15.413272+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:35.961223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.408759+0000","last_change":"2024-04-25T09:56:14.406874+0000","last_active":"2024-04-25T09:56:14.408759+0000","last_peered":"2024-04-25T09:56:14.408759+0000","last_clean":"2024-04-25T09:56:14.408759+0000","last_became_active":"2024-04-25T09:56:14.406576+0000","last_became_peered":"2024-04-25T09:56:14.406576+0000","last_unstale":"2024-04-25T09:56:14.408759+0000","last_undegraded":"2024-04-25T09:56:14.408759+0000","last_fullsized":"2024-04-25T09:56:14.408759+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:52.202052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.415248+0000","last_change":"2024-04-25T09:56:15.410149+0000","last_active":"2024-04-25T09:56:15.415248+0000","last_peered":"2024-04-25T09:56:15.415248+0000","last_clean":"2024-04-25T09:56:15.415248+0000","last_became_active":"2024-04-25T09:56:15.409859+0000","last_became_peered":"2024-04-25T09:56:15.409859+0000","last_unstale":"2024-04-25T09:56:15.415248+0000","last_undegraded":"2024-04-25T09:56:15.415248+0000","last_fullsized":"2024-04-25T09:56:15.415248+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:44.310561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.414542+0000","last_change":"2024-04-25T09:56:14.406954+0000","last_active":"2024-04-25T09:56:14.414542+0000","last_peered":"2024-04-25T09:56:14.414542+0000","last_clean":"2024-04-25T09:56:14.414542+0000","last_became_active":"2024-04-25T09:56:14.406675+0000","last_became_peered":"2024-04-25T09:56:14.406675+0000","last_unstale":"2024-04-25T09:56:14.414542+0000","last_undegraded":"2024-04-25T09:56:14.414542+0000","last_fullsized":"2024-04-25T09:56:14.414542+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:39.522811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.395751+0000","last_change":"2024-04-25T09:56:14.395751+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.395751+0000","last_undegraded":"2024-04-25T09:56:14.395751+0000","last_fullsized":"2024-04-25T09:56:14.395751+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.409782+0000","last_change":"2024-04-25T09:56:14.406606+0000","last_active":"2024-04-25T09:56:14.409782+0000","last_peered":"2024-04-25T09:56:14.409782+0000","last_clean":"2024-04-25T09:56:14.409782+0000","last_became_active":"2024-04-25T09:56:14.406331+0000","last_became_peered":"2024-04-25T09:56:14.406331+0000","last_unstale":"2024-04-25T09:56:14.409782+0000","last_undegraded":"2024-04-25T09:56:14.409782+0000","last_fullsized":"2024-04-25T09:56:14.409782+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:42.555560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396387+0000","last_change":"2024-04-25T09:56:14.396387+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396387+0000","last_undegraded":"2024-04-25T09:56:14.396387+0000","last_fullsized":"2024-04-25T09:56:14.396387+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.416484+0000","last_change":"2024-04-25T09:56:14.414276+0000","last_active":"2024-04-25T09:56:14.416484+0000","last_peered":"2024-04-25T09:56:14.416484+0000","last_clean":"2024-04-25T09:56:14.416484+0000","last_became_active":"2024-04-25T09:56:14.413964+0000","last_became_peered":"2024-04-25T09:56:14.413964+0000","last_unstale":"2024-04-25T09:56:14.416484+0000","last_undegraded":"2024-04-25T09:56:14.416484+0000","last_fullsized":"2024-04-25T09:56:14.416484+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:50.921675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.417028+0000","last_change":"2024-04-25T09:56:15.409393+0000","last_active":"2024-04-25T09:56:15.417028+0000","last_peered":"2024-04-25T09:56:15.417028+0000","last_clean":"2024-04-25T09:56:15.417028+0000","last_became_active":"2024-04-25T09:56:15.409064+0000","last_became_peered":"2024-04-25T09:56:15.409064+0000","last_unstale":"2024-04-25T09:56:15.417028+0000","last_undegraded":"2024-04-25T09:56:15.417028+0000","last_fullsized":"2024-04-25T09:56:15.417028+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:08.074490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.426138+0000","last_change":"2024-04-25T09:56:14.415037+0000","last_active":"2024-04-25T09:56:15.426138+0000","last_peered":"2024-04-25T09:56:15.426138+0000","last_clean":"2024-04-25T09:56:15.426138+0000","last_became_active":"2024-04-25T09:56:14.414744+0000","last_became_peered":"2024-04-25T09:56:14.414744+0000","last_unstale":"2024-04-25T09:56:15.426138+0000","last_undegraded":"2024-04-25T09:56:15.426138+0000","last_fullsized":"2024-04-25T09:56:15.426138+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:02.560063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.395691+0000","last_change":"2024-04-25T09:56:14.395691+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.395691+0000","last_undegraded":"2024-04-25T09:56:14.395691+0000","last_fullsized":"2024-04-25T09:56:14.395691+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.401176+0000","last_change":"2024-04-25T09:56:14.415403+0000","last_active":"2024-04-25T09:56:15.401176+0000","last_peered":"2024-04-25T09:56:15.401176+0000","last_clean":"2024-04-25T09:56:15.401176+0000","last_became_active":"2024-04-25T09:56:14.414434+0000","last_became_peered":"2024-04-25T09:56:14.414434+0000","last_unstale":"2024-04-25T09:56:15.401176+0000","last_undegraded":"2024-04-25T09:56:15.401176+0000","last_fullsized":"2024-04-25T09:56:15.401176+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:25:16.172738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396338+0000","last_change":"2024-04-25T09:56:14.396338+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396338+0000","last_undegraded":"2024-04-25T09:56:14.396338+0000","last_fullsized":"2024-04-25T09:56:14.396338+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.415726+0000","last_change":"2024-04-25T09:56:14.414412+0000","last_active":"2024-04-25T09:56:14.415726+0000","last_peered":"2024-04-25T09:56:14.415726+0000","last_clean":"2024-04-25T09:56:14.415726+0000","last_became_active":"2024-04-25T09:56:14.413362+0000","last_became_peered":"2024-04-25T09:56:14.413362+0000","last_unstale":"2024-04-25T09:56:14.415726+0000","last_undegraded":"2024-04-25T09:56:14.415726+0000","last_fullsized":"2024-04-25T09:56:14.415726+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:48.390619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396316+0000","last_change":"2024-04-25T09:56:14.396316+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396316+0000","last_undegraded":"2024-04-25T09:56:14.396316+0000","last_fullsized":"2024-04-25T09:56:14.396316+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.414726+0000","last_change":"2024-04-25T09:56:14.408232+0000","last_active":"2024-04-25T09:56:14.414726+0000","last_peered":"2024-04-25T09:56:14.414726+0000","last_clean":"2024-04-25T09:56:14.414726+0000","last_became_active":"2024-04-25T09:56:14.407536+0000","last_became_peered":"2024-04-25T09:56:14.407536+0000","last_unstale":"2024-04-25T09:56:14.414726+0000","last_undegraded":"2024-04-25T09:56:14.414726+0000","last_fullsized":"2024-04-25T09:56:14.414726+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:18.708460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.418448+0000","last_change":"2024-04-25T09:56:15.416647+0000","last_active":"2024-04-25T09:56:15.418448+0000","last_peered":"2024-04-25T09:56:15.418448+0000","last_clean":"2024-04-25T09:56:15.418448+0000","last_became_active":"2024-04-25T09:56:15.416335+0000","last_became_peered":"2024-04-25T09:56:15.416335+0000","last_unstale":"2024-04-25T09:56:15.418448+0000","last_undegraded":"2024-04-25T09:56:15.418448+0000","last_fullsized":"2024-04-25T09:56:15.418448+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:57.464568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.416176+0000","last_change":"2024-04-25T09:56:14.413483+0000","last_active":"2024-04-25T09:56:14.416176+0000","last_peered":"2024-04-25T09:56:14.416176+0000","last_clean":"2024-04-25T09:56:14.416176+0000","last_became_active":"2024-04-25T09:56:14.413153+0000","last_became_peered":"2024-04-25T09:56:14.413153+0000","last_unstale":"2024-04-25T09:56:14.416176+0000","last_undegraded":"2024-04-25T09:56:14.416176+0000","last_fullsized":"2024-04-25T09:56:14.416176+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:56.403865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396787+0000","last_change":"2024-04-25T09:56:14.396787+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396787+0000","last_undegraded":"2024-04-25T09:56:14.396787+0000","last_fullsized":"2024-04-25T09:56:14.396787+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.394476+0000","last_change":"2024-04-25T09:56:14.411470+0000","last_active":"2024-04-25T09:56:15.394476+0000","last_peered":"2024-04-25T09:56:15.394476+0000","last_clean":"2024-04-25T09:56:15.394476+0000","last_became_active":"2024-04-25T09:56:14.411162+0000","last_became_peered":"2024-04-25T09:56:14.411162+0000","last_unstale":"2024-04-25T09:56:15.394476+0000","last_undegraded":"2024-04-25T09:56:15.394476+0000","last_fullsized":"2024-04-25T09:56:15.394476+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:42.555560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.398722+0000","last_change":"2024-04-25T09:56:14.398722+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.398722+0000","last_undegraded":"2024-04-25T09:56:14.398722+0000","last_fullsized":"2024-04-25T09:56:14.398722+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.401348+0000","last_change":"2024-04-25T09:56:14.410884+0000","last_active":"2024-04-25T09:56:15.401348+0000","last_peered":"2024-04-25T09:56:15.401348+0000","last_clean":"2024-04-25T09:56:15.401348+0000","last_became_active":"2024-04-25T09:56:14.410576+0000","last_became_peered":"2024-04-25T09:56:14.410576+0000","last_unstale":"2024-04-25T09:56:15.401348+0000","last_undegraded":"2024-04-25T09:56:15.401348+0000","last_fullsized":"2024-04-25T09:56:15.401348+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:18.708460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.414961+0000","last_change":"2024-04-25T09:56:15.408216+0000","last_active":"2024-04-25T09:56:15.414961+0000","last_peered":"2024-04-25T09:56:15.414961+0000","last_clean":"2024-04-25T09:56:15.414961+0000","last_became_active":"2024-04-25T09:56:15.407935+0000","last_became_peered":"2024-04-25T09:56:15.407935+0000","last_unstale":"2024-04-25T09:56:15.414961+0000","last_undegraded":"2024-04-25T09:56:15.414961+0000","last_fullsized":"2024-04-25T09:56:15.414961+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:25:17.174689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.417104+0000","last_change":"2024-04-25T09:56:14.415709+0000","last_active":"2024-04-25T09:56:14.417104+0000","last_peered":"2024-04-25T09:56:14.417104+0000","last_clean":"2024-04-25T09:56:14.417104+0000","last_became_active":"2024-04-25T09:56:14.415165+0000","last_became_peered":"2024-04-25T09:56:14.415165+0000","last_unstale":"2024-04-25T09:56:14.417104+0000","last_undegraded":"2024-04-25T09:56:14.417104+0000","last_fullsized":"2024-04-25T09:56:14.417104+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:10.545063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":220,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.400324+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T09:56:15.400324+0000","last_peered":"2024-04-25T09:56:15.400324+0000","last_clean":"2024-04-25T09:56:15.400324+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T09:56:15.400324+0000","last_undegraded":"2024-04-25T09:56:15.400324+0000","last_fullsized":"2024-04-25T09:56:15.400324+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":742,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1171456,"data_stored":843299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542171,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31768,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":598016,"data_stored":260750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542173,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":589824,"data_stored":260098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542170,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":577536,"data_stored":252931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":577536,"data_stored":252931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":577536,"data_stored":252931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":565248,"data_stored":246264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1159168,"data_stored":836632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:56:19.114 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3f is not active+clean 2024-04-25T09:56:19.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.400552+0000', 'last_change': '2024-04-25T09:56:14.400552+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.400552+0000', 'last_undegraded': '2024-04-25T09:56:14.400552+0000', 'last_fullsized': '2024-04-25T09:56:14.400552+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:56:19.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3d is not active+clean 2024-04-25T09:56:19.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.405512+0000', 'last_change': '2024-04-25T09:56:14.405512+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.405512+0000', 'last_undegraded': '2024-04-25T09:56:14.405512+0000', 'last_fullsized': '2024-04-25T09:56:14.405512+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:56:19.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3a is not active+clean 2024-04-25T09:56:19.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.399868+0000', 'last_change': '2024-04-25T09:56:14.399868+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.399868+0000', 'last_undegraded': '2024-04-25T09:56:14.399868+0000', 'last_fullsized': '2024-04-25T09:56:14.399868+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:56:19.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.39 is not active+clean 2024-04-25T09:56:19.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.400932+0000', 'last_change': '2024-04-25T09:56:14.400932+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.400932+0000', 'last_undegraded': '2024-04-25T09:56:14.400932+0000', 'last_fullsized': '2024-04-25T09:56:14.400932+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:56:19.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.38 is not active+clean 2024-04-25T09:56:19.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.397566+0000', 'last_change': '2024-04-25T09:56:14.397566+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.397566+0000', 'last_undegraded': '2024-04-25T09:56:14.397566+0000', 'last_fullsized': '2024-04-25T09:56:14.397566+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:56:19.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.37 is not active+clean 2024-04-25T09:56:19.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.399128+0000', 'last_change': '2024-04-25T09:56:14.399128+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.399128+0000', 'last_undegraded': '2024-04-25T09:56:14.399128+0000', 'last_fullsized': '2024-04-25T09:56:14.399128+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:56:19.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.36 is not active+clean 2024-04-25T09:56:19.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.399463+0000', 'last_change': '2024-04-25T09:56:14.399463+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.399463+0000', 'last_undegraded': '2024-04-25T09:56:14.399463+0000', 'last_fullsized': '2024-04-25T09:56:14.399463+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:56:19.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.35 is not active+clean 2024-04-25T09:56:19.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.401987+0000', 'last_change': '2024-04-25T09:56:14.401987+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.401987+0000', 'last_undegraded': '2024-04-25T09:56:14.401987+0000', 'last_fullsized': '2024-04-25T09:56:14.401987+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:56:19.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.34 is not active+clean 2024-04-25T09:56:19.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.396299+0000', 'last_change': '2024-04-25T09:56:14.396299+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.396299+0000', 'last_undegraded': '2024-04-25T09:56:14.396299+0000', 'last_fullsized': '2024-04-25T09:56:14.396299+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:56:19.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.33 is not active+clean 2024-04-25T09:56:19.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.398876+0000', 'last_change': '2024-04-25T09:56:14.398876+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.398876+0000', 'last_undegraded': '2024-04-25T09:56:14.398876+0000', 'last_fullsized': '2024-04-25T09:56:14.398876+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:56:19.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.32 is not active+clean 2024-04-25T09:56:19.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.400902+0000', 'last_change': '2024-04-25T09:56:14.400902+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.400902+0000', 'last_undegraded': '2024-04-25T09:56:14.400902+0000', 'last_fullsized': '2024-04-25T09:56:14.400902+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:56:19.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.30 is not active+clean 2024-04-25T09:56:19.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.398412+0000', 'last_change': '2024-04-25T09:56:14.398412+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.398412+0000', 'last_undegraded': '2024-04-25T09:56:14.398412+0000', 'last_fullsized': '2024-04-25T09:56:14.398412+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:56:19.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2f is not active+clean 2024-04-25T09:56:19.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.404109+0000', 'last_change': '2024-04-25T09:56:14.404109+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.404109+0000', 'last_undegraded': '2024-04-25T09:56:14.404109+0000', 'last_fullsized': '2024-04-25T09:56:14.404109+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:56:19.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2d is not active+clean 2024-04-25T09:56:19.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.400388+0000', 'last_change': '2024-04-25T09:56:14.400388+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.400388+0000', 'last_undegraded': '2024-04-25T09:56:14.400388+0000', 'last_fullsized': '2024-04-25T09:56:14.400388+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:56:19.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2a is not active+clean 2024-04-25T09:56:19.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.398789+0000', 'last_change': '2024-04-25T09:56:14.398789+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.398789+0000', 'last_undegraded': '2024-04-25T09:56:14.398789+0000', 'last_fullsized': '2024-04-25T09:56:14.398789+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:56:19.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.29 is not active+clean 2024-04-25T09:56:19.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.402466+0000', 'last_change': '2024-04-25T09:56:14.402466+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.402466+0000', 'last_undegraded': '2024-04-25T09:56:14.402466+0000', 'last_fullsized': '2024-04-25T09:56:14.402466+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:56:19.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.28 is not active+clean 2024-04-25T09:56:19.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.399899+0000', 'last_change': '2024-04-25T09:56:14.399899+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.399899+0000', 'last_undegraded': '2024-04-25T09:56:14.399899+0000', 'last_fullsized': '2024-04-25T09:56:14.399899+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:56:19.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.27 is not active+clean 2024-04-25T09:56:19.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.403666+0000', 'last_change': '2024-04-25T09:56:14.403666+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.403666+0000', 'last_undegraded': '2024-04-25T09:56:14.403666+0000', 'last_fullsized': '2024-04-25T09:56:14.403666+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:56:19.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.26 is not active+clean 2024-04-25T09:56:19.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.397725+0000', 'last_change': '2024-04-25T09:56:14.397725+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.397725+0000', 'last_undegraded': '2024-04-25T09:56:14.397725+0000', 'last_fullsized': '2024-04-25T09:56:14.397725+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:56:19.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.25 is not active+clean 2024-04-25T09:56:19.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.397960+0000', 'last_change': '2024-04-25T09:56:14.397960+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.397960+0000', 'last_undegraded': '2024-04-25T09:56:14.397960+0000', 'last_fullsized': '2024-04-25T09:56:14.397960+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:56:19.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.23 is not active+clean 2024-04-25T09:56:19.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.399865+0000', 'last_change': '2024-04-25T09:56:14.399865+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.399865+0000', 'last_undegraded': '2024-04-25T09:56:14.399865+0000', 'last_fullsized': '2024-04-25T09:56:14.399865+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:56:19.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.21 is not active+clean 2024-04-25T09:56:19.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.399374+0000', 'last_change': '2024-04-25T09:56:14.399374+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.399374+0000', 'last_undegraded': '2024-04-25T09:56:14.399374+0000', 'last_fullsized': '2024-04-25T09:56:14.399374+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:56:19.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2024-04-25T09:56:19.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.396837+0000', 'last_change': '2024-04-25T09:56:14.396837+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.396837+0000', 'last_undegraded': '2024-04-25T09:56:14.396837+0000', 'last_fullsized': '2024-04-25T09:56:14.396837+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:56:19.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2024-04-25T09:56:19.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.396786+0000', 'last_change': '2024-04-25T09:56:14.396786+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.396786+0000', 'last_undegraded': '2024-04-25T09:56:14.396786+0000', 'last_fullsized': '2024-04-25T09:56:14.396786+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:56:19.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2024-04-25T09:56:19.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.397298+0000', 'last_change': '2024-04-25T09:56:14.397298+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.397298+0000', 'last_undegraded': '2024-04-25T09:56:14.397298+0000', 'last_fullsized': '2024-04-25T09:56:14.397298+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:56:19.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2024-04-25T09:56:19.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.397944+0000', 'last_change': '2024-04-25T09:56:14.397944+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.397944+0000', 'last_undegraded': '2024-04-25T09:56:14.397944+0000', 'last_fullsized': '2024-04-25T09:56:14.397944+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:56:19.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2024-04-25T09:56:19.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.397265+0000', 'last_change': '2024-04-25T09:56:14.397265+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.397265+0000', 'last_undegraded': '2024-04-25T09:56:14.397265+0000', 'last_fullsized': '2024-04-25T09:56:14.397265+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:56:19.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2024-04-25T09:56:19.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.397743+0000', 'last_change': '2024-04-25T09:56:14.397743+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.397743+0000', 'last_undegraded': '2024-04-25T09:56:14.397743+0000', 'last_fullsized': '2024-04-25T09:56:14.397743+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:56:19.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2024-04-25T09:56:19.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.397108+0000', 'last_change': '2024-04-25T09:56:14.397108+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.397108+0000', 'last_undegraded': '2024-04-25T09:56:14.397108+0000', 'last_fullsized': '2024-04-25T09:56:14.397108+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:56:19.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2024-04-25T09:56:19.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.396240+0000', 'last_change': '2024-04-25T09:56:14.396240+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.396240+0000', 'last_undegraded': '2024-04-25T09:56:14.396240+0000', 'last_fullsized': '2024-04-25T09:56:14.396240+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:56:19.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2024-04-25T09:56:19.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.396079+0000', 'last_change': '2024-04-25T09:56:14.396079+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.396079+0000', 'last_undegraded': '2024-04-25T09:56:14.396079+0000', 'last_fullsized': '2024-04-25T09:56:14.396079+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:56:19.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2024-04-25T09:56:19.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.395751+0000', 'last_change': '2024-04-25T09:56:14.395751+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.395751+0000', 'last_undegraded': '2024-04-25T09:56:14.395751+0000', 'last_fullsized': '2024-04-25T09:56:14.395751+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:56:19.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2024-04-25T09:56:19.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.396387+0000', 'last_change': '2024-04-25T09:56:14.396387+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.396387+0000', 'last_undegraded': '2024-04-25T09:56:14.396387+0000', 'last_fullsized': '2024-04-25T09:56:14.396387+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:56:19.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2024-04-25T09:56:19.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.395691+0000', 'last_change': '2024-04-25T09:56:14.395691+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.395691+0000', 'last_undegraded': '2024-04-25T09:56:14.395691+0000', 'last_fullsized': '2024-04-25T09:56:14.395691+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:56:19.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2024-04-25T09:56:19.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.396338+0000', 'last_change': '2024-04-25T09:56:14.396338+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.396338+0000', 'last_undegraded': '2024-04-25T09:56:14.396338+0000', 'last_fullsized': '2024-04-25T09:56:14.396338+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:56:19.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2024-04-25T09:56:19.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.396316+0000', 'last_change': '2024-04-25T09:56:14.396316+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.396316+0000', 'last_undegraded': '2024-04-25T09:56:14.396316+0000', 'last_fullsized': '2024-04-25T09:56:14.396316+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:56:19.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2024-04-25T09:56:19.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.396787+0000', 'last_change': '2024-04-25T09:56:14.396787+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.396787+0000', 'last_undegraded': '2024-04-25T09:56:14.396787+0000', 'last_fullsized': '2024-04-25T09:56:14.396787+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:56:19.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2024-04-25T09:56:19.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:56:14.398722+0000', 'last_change': '2024-04-25T09:56:14.398722+0000', 'last_active': '2024-04-25T09:56:14.381591+0000', 'last_peered': '2024-04-25T09:56:14.381591+0000', 'last_clean': '2024-04-25T09:56:14.381591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:56:14.398722+0000', 'last_undegraded': '2024-04-25T09:56:14.398722+0000', 'last_fullsized': '2024-04-25T09:56:14.398722+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'last_clean_scrub_stamp': '2024-04-25T09:56:14.381591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:56:19.121 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:56:19.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.248+0000 7fe37b9f5640 1 Processor -- start 2024-04-25T09:56:19.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.248+0000 7fe37b9f5640 1 -- start start 2024-04-25T09:56:19.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.249+0000 7fe37b9f5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe37415dad0 0x7fe3740d18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:19.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.249+0000 7fe37b9f5640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe3740b9580 0x7fe3740d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:19.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.249+0000 7fe37b9f5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3740d2240 con 0x7fe3740d32e0 2024-04-25T09:56:19.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.249+0000 7fe37b9f5640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3740b7990 con 0x7fe3740b9580 2024-04-25T09:56:19.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.249+0000 7fe37b9f5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3740d2520 con 0x7fe37415dad0 2024-04-25T09:56:19.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.249+0000 7fe378f90640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe3740b9580 0x7fe3740d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:19.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.249+0000 7fe378f90640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe3740b9580 0x7fe3740d0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59214/0 (socket says 172.21.15.7:59214) 2024-04-25T09:56:19.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.249+0000 7fe378f90640 1 -- 172.21.15.7:0/965086721 learned_addr learned my addr 172.21.15.7:0/965086721 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:19.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.250+0000 7fe379791640 1 --2- 172.21.15.7:0/965086721 >> v2:172.21.15.55:3300/0 conn(0x7fe37415dad0 0x7fe3740d18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:19.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.250+0000 7fe378f90640 1 -- 172.21.15.7:0/965086721 >> v2:172.21.15.55:3300/0 conn(0x7fe37415dad0 msgr2=0x7fe3740d18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:19.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.250+0000 7fe378f90640 1 --2- 172.21.15.7:0/965086721 >> v2:172.21.15.55:3300/0 conn(0x7fe37415dad0 0x7fe3740d18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:19.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.250+0000 7fe378f90640 1 -- 172.21.15.7:0/965086721 >> v1:172.21.15.55:6789/0 conn(0x7fe3740d32e0 legacy=0x7fe3740b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:19.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.250+0000 7fe378f90640 1 -- 172.21.15.7:0/965086721 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3740d2800 con 0x7fe3740b9580 2024-04-25T09:56:19.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.250+0000 7fe379791640 1 --2- 172.21.15.7:0/965086721 >> v2:172.21.15.55:3300/0 conn(0x7fe37415dad0 0x7fe3740d18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:56:19.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.250+0000 7fe378f90640 1 --2- 172.21.15.7:0/965086721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3740b9580 0x7fe3740d0240 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe3740b6440 tx=0x7fe36802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792d4acd34608c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:19.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.250+0000 7fe373fff640 1 -- 172.21.15.7:0/965086721 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe368037070 con 0x7fe3740b9580 2024-04-25T09:56:19.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.251+0000 7fe373fff640 1 -- 172.21.15.7:0/965086721 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe368032440 con 0x7fe3740b9580 2024-04-25T09:56:19.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.251+0000 7fe373fff640 1 -- 172.21.15.7:0/965086721 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe368032810 con 0x7fe3740b9580 2024-04-25T09:56:19.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.251+0000 7fe37b9f5640 1 -- 172.21.15.7:0/965086721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3740b9580 msgr2=0x7fe3740d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:19.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.251+0000 7fe37b9f5640 1 --2- 172.21.15.7:0/965086721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3740b9580 0x7fe3740d0240 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe3740b6440 tx=0x7fe36802a2c0 comp rx=0 tx=0).stop 2024-04-25T09:56:19.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.251+0000 7fe37b9f5640 1 -- 172.21.15.7:0/965086721 shutdown_connections 2024-04-25T09:56:19.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.251+0000 7fe37b9f5640 1 --2- 172.21.15.7:0/965086721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3740b9580 0x7fe3740d0240 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:19.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.251+0000 7fe37b9f5640 1 --2- 172.21.15.7:0/965086721 >> v2:172.21.15.55:3300/0 conn(0x7fe37415dad0 0x7fe3740d18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:19.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.251+0000 7fe37b9f5640 1 -- 172.21.15.7:0/965086721 >> 172.21.15.7:0/965086721 conn(0x7fe37406bfe0 msgr2=0x7fe37406c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:19.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.251+0000 7fe37b9f5640 1 -- 172.21.15.7:0/965086721 shutdown_connections 2024-04-25T09:56:19.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.251+0000 7fe37b9f5640 1 -- 172.21.15.7:0/965086721 wait complete. 2024-04-25T09:56:19.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.252+0000 7fe37b9f5640 1 Processor -- start 2024-04-25T09:56:19.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.252+0000 7fe37b9f5640 1 -- start start 2024-04-25T09:56:19.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.253+0000 7fe37b9f5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3740b9580 0x7fe374151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:19.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.253+0000 7fe37b9f5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe3740d32e0 0x7fe37414c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:19.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.253+0000 7fe37b9f5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe37415dad0 0x7fe374156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:19.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.253+0000 7fe37b9f5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37415deb0 con 0x7fe3740b9580 2024-04-25T09:56:19.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.253+0000 7fe37b9f5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3740d2dc0 con 0x7fe37415dad0 2024-04-25T09:56:19.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.253+0000 7fe37b9f5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37414d1d0 con 0x7fe3740d32e0 2024-04-25T09:56:19.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.253+0000 7fe379791640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3740b9580 0x7fe374151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:19.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.253+0000 7fe379791640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3740b9580 0x7fe374151e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59216/0 (socket says 172.21.15.7:59216) 2024-04-25T09:56:19.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.253+0000 7fe379791640 1 -- 172.21.15.7:0/405613777 learned_addr learned my addr 172.21.15.7:0/405613777 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:19.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.253+0000 7fe378f90640 1 --2- 172.21.15.7:0/405613777 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe3740d32e0 0x7fe37414c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:19.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.253+0000 7fe379f92640 1 --2- 172.21.15.7:0/405613777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe37415dad0 0x7fe374156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:19.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.253+0000 7fe379791640 1 -- 172.21.15.7:0/405613777 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe3740d32e0 msgr2=0x7fe37414c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:19.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.253+0000 7fe379791640 1 --2- 172.21.15.7:0/405613777 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe3740d32e0 0x7fe37414c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:19.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.253+0000 7fe379791640 1 -- 172.21.15.7:0/405613777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe37415dad0 msgr2=0x7fe374156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:19.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.253+0000 7fe379791640 1 --2- 172.21.15.7:0/405613777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe37415dad0 0x7fe374156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:19.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.253+0000 7fe379791640 1 -- 172.21.15.7:0/405613777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3740cc850 con 0x7fe3740b9580 2024-04-25T09:56:19.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.254+0000 7fe379791640 1 --2- 172.21.15.7:0/405613777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3740b9580 0x7fe374151e70 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fe36c00c820 tx=0x7fe36c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:19.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.254+0000 7fe371ffb640 1 -- 172.21.15.7:0/405613777 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c015070 con 0x7fe3740b9580 2024-04-25T09:56:19.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.254+0000 7fe371ffb640 1 -- 172.21.15.7:0/405613777 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36c007a30 con 0x7fe3740b9580 2024-04-25T09:56:19.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.254+0000 7fe37b9f5640 1 -- 172.21.15.7:0/405613777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3740ccb30 con 0x7fe3740b9580 2024-04-25T09:56:19.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.254+0000 7fe371ffb640 1 -- 172.21.15.7:0/405613777 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c007de0 con 0x7fe3740b9580 2024-04-25T09:56:19.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.254+0000 7fe37b9f5640 1 -- 172.21.15.7:0/405613777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3740cd0f0 con 0x7fe3740b9580 2024-04-25T09:56:19.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.255+0000 7fe37b9f5640 1 -- 172.21.15.7:0/405613777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe374074bb0 con 0x7fe3740b9580 2024-04-25T09:56:19.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.255+0000 7fe371ffb640 1 -- 172.21.15.7:0/405613777 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe36c018070 con 0x7fe3740b9580 2024-04-25T09:56:19.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.256+0000 7fe371ffb640 1 --2- 172.21.15.7:0/405613777 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe36006b4d0 0x7fe36006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:19.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.256+0000 7fe371ffb640 1 -- 172.21.15.7:0/405613777 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe36c08a1b0 con 0x7fe3740b9580 2024-04-25T09:56:19.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.256+0000 7fe378f90640 1 --2- 172.21.15.7:0/405613777 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe36006b4d0 0x7fe36006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:19.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.256+0000 7fe378f90640 1 --2- 172.21.15.7:0/405613777 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe36006b4d0 0x7fe36006d990 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe368034000 tx=0x7fe36802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:19.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.260+0000 7fe371ffb640 1 -- 172.21.15.7:0/405613777 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe36c058f30 con 0x7fe3740b9580 2024-04-25T09:56:19.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.508+0000 7fe37b9f5640 1 -- 172.21.15.7:0/405613777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe3740b8570 con 0x7fe3740b9580 2024-04-25T09:56:19.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.509+0000 7fe371ffb640 1 -- 172.21.15.7:0/405613777 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1645 (secure 0 0 0) 0x7fe36c058830 con 0x7fe3740b9580 2024-04-25T09:56:19.512 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:19.512 INFO:teuthology.orchestra.run.smithi007.stdout:{"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":135,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":51,"num_osds":8,"num_up_osds":8,"osd_up_since":1714038855,"num_in_osds":8,"osd_in_since":1714038845,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":59},{"state_name":"creating+peering","count":38}],"num_pgs":97,"num_pools":3,"num_objects":9,"data_bytes":591110,"bytes_used":261259264,"bytes_avail":772832854016,"bytes_total":773094113280,"inactive_pgs_ratio":0.39175257086753845,"write_bytes_sec":683,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":21,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5820}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2024-04-25T09:56:01.874246+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:56:19.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.511+0000 7fe37b9f5640 1 -- 172.21.15.7:0/405613777 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe36006b4d0 msgr2=0x7fe36006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:19.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.511+0000 7fe37b9f5640 1 --2- 172.21.15.7:0/405613777 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe36006b4d0 0x7fe36006d990 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe368034000 tx=0x7fe36802e000 comp rx=0 tx=0).stop 2024-04-25T09:56:19.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.511+0000 7fe37b9f5640 1 -- 172.21.15.7:0/405613777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3740b9580 msgr2=0x7fe374151e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:19.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.511+0000 7fe37b9f5640 1 --2- 172.21.15.7:0/405613777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3740b9580 0x7fe374151e70 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fe36c00c820 tx=0x7fe36c00cce0 comp rx=0 tx=0).stop 2024-04-25T09:56:19.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.511+0000 7fe37b9f5640 1 -- 172.21.15.7:0/405613777 shutdown_connections 2024-04-25T09:56:19.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.511+0000 7fe37b9f5640 1 --2- 172.21.15.7:0/405613777 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe36006b4d0 0x7fe36006d990 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:19.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.511+0000 7fe37b9f5640 1 --2- 172.21.15.7:0/405613777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe37415dad0 0x7fe374156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:19.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.511+0000 7fe37b9f5640 1 --2- 172.21.15.7:0/405613777 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe3740d32e0 0x7fe37414c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:19.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.511+0000 7fe37b9f5640 1 --2- 172.21.15.7:0/405613777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3740b9580 0x7fe374151e70 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:19.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.511+0000 7fe37b9f5640 1 -- 172.21.15.7:0/405613777 >> 172.21.15.7:0/405613777 conn(0x7fe37406bfe0 msgr2=0x7fe37415c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:19.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.511+0000 7fe37b9f5640 1 -- 172.21.15.7:0/405613777 shutdown_connections 2024-04-25T09:56:19.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.511+0000 7fe37b9f5640 1 -- 172.21.15.7:0/405613777 wait complete. 2024-04-25T09:56:19.524 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T09:56:19.525 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:56:19.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.622+0000 7f76b9ce1640 1 Processor -- start 2024-04-25T09:56:19.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.622+0000 7f76b9ce1640 1 -- start start 2024-04-25T09:56:19.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.623+0000 7f76b9ce1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f76b406e970 0x7f76b40cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:19.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.623+0000 7f76b9ce1640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f76b40ced20 0x7f76b415b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:19.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.623+0000 7f76b9ce1640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b40cdbf0 con 0x7f76b4144100 2024-04-25T09:56:19.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.623+0000 7f76b9ce1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b41444e0 con 0x7f76b406e970 2024-04-25T09:56:19.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.623+0000 7f76b9ce1640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b415ac70 con 0x7f76b40ced20 2024-04-25T09:56:19.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.623+0000 7f76b37fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f76b4144100 0x7f76b406e260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53732/0 (socket says 172.21.15.7:53732) 2024-04-25T09:56:19.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.623+0000 7f76b37fe640 1 -- 172.21.15.7:0/2845762475 learned_addr learned my addr 172.21.15.7:0/2845762475 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:56:19.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.623+0000 7f76b3fff640 1 --2- 172.21.15.7:0/2845762475 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f76b40ced20 0x7f76b415b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:19.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.623+0000 7f76b2ffd640 1 --2- 172.21.15.7:0/2845762475 >> v2:172.21.15.55:3300/0 conn(0x7f76b406e970 0x7f76b40cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:19.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.623+0000 7f76b27fc640 1 -- 172.21.15.7:0/2845762475 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4200090167 0 0) 0x7f76b40cdbf0 con 0x7f76b4144100 2024-04-25T09:56:19.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.624+0000 7f76b27fc640 1 -- 172.21.15.7:0/2845762475 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f769c003520 con 0x7f76b4144100 2024-04-25T09:56:19.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.624+0000 7f76b2ffd640 1 -- 172.21.15.7:0/2845762475 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f76b40ced20 msgr2=0x7f76b415b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:19.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.624+0000 7f76b2ffd640 1 --2- 172.21.15.7:0/2845762475 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f76b40ced20 0x7f76b415b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:19.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.624+0000 7f76b2ffd640 1 -- 172.21.15.7:0/2845762475 >> v1:172.21.15.7:6789/0 conn(0x7f76b4144100 legacy=0x7f76b406e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:19.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.624+0000 7f76b27fc640 1 -- 172.21.15.7:0/2845762475 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3763306266 0 0) 0x7f769c003520 con 0x7f76b4144100 2024-04-25T09:56:19.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.624+0000 7f76b2ffd640 1 -- 172.21.15.7:0/2845762475 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b40cded0 con 0x7f76b406e970 2024-04-25T09:56:19.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.624+0000 7f76b3fff640 1 --2- 172.21.15.7:0/2845762475 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f76b40ced20 0x7f76b415b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:56:19.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.625+0000 7f76b2ffd640 1 --2- 172.21.15.7:0/2845762475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76b406e970 0x7f76b40cd610 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f76a80097a0 tx=0x7f76a802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc89a8c09128ab70 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:19.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.625+0000 7f76b27fc640 1 -- 172.21.15.7:0/2845762475 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a8037070 con 0x7f76b406e970 2024-04-25T09:56:19.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.625+0000 7f76b27fc640 1 -- 172.21.15.7:0/2845762475 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a802aba0 con 0x7f76b406e970 2024-04-25T09:56:19.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.625+0000 7f76b27fc640 1 -- 172.21.15.7:0/2845762475 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a4001670 con 0x7f76b406e970 2024-04-25T09:56:19.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.625+0000 7f76b9ce1640 1 -- 172.21.15.7:0/2845762475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76b406e970 msgr2=0x7f76b40cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:19.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.625+0000 7f76b9ce1640 1 --2- 172.21.15.7:0/2845762475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76b406e970 0x7f76b40cd610 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f76a80097a0 tx=0x7f76a802a110 comp rx=0 tx=0).stop 2024-04-25T09:56:19.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.625+0000 7f76b9ce1640 1 -- 172.21.15.7:0/2845762475 shutdown_connections 2024-04-25T09:56:19.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.625+0000 7f76b9ce1640 1 --2- 172.21.15.7:0/2845762475 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f76b40ced20 0x7f76b415b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:19.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.625+0000 7f76b9ce1640 1 --2- 172.21.15.7:0/2845762475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76b406e970 0x7f76b40cd610 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:19.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.625+0000 7f76b9ce1640 1 -- 172.21.15.7:0/2845762475 >> 172.21.15.7:0/2845762475 conn(0x7f76b4071150 msgr2=0x7f76b4071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:19.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.625+0000 7f76b9ce1640 1 -- 172.21.15.7:0/2845762475 shutdown_connections 2024-04-25T09:56:19.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.625+0000 7f76b9ce1640 1 -- 172.21.15.7:0/2845762475 wait complete. 2024-04-25T09:56:19.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.627+0000 7f76b9ce1640 1 Processor -- start 2024-04-25T09:56:19.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.627+0000 7f76b9ce1640 1 -- start start 2024-04-25T09:56:19.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.627+0000 7f76b9ce1640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f76b406e970 0x7f76b40c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:19.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.627+0000 7f76b9ce1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76b40ced20 0x7f76b4159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:19.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.627+0000 7f76b9ce1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b4144100 0x7f76b40c7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:19.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.627+0000 7f76b9ce1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b40cea00 con 0x7f76b4144100 2024-04-25T09:56:19.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.627+0000 7f76b9ce1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b40ce490 con 0x7f76b40ced20 2024-04-25T09:56:19.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.627+0000 7f76b9ce1640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b415b670 con 0x7f76b406e970 2024-04-25T09:56:19.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.628+0000 7f76b3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b4144100 0x7f76b40c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:19.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.628+0000 7f76b3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b4144100 0x7f76b40c7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59230/0 (socket says 172.21.15.7:59230) 2024-04-25T09:56:19.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.628+0000 7f76b3fff640 1 -- 172.21.15.7:0/1076429720 learned_addr learned my addr 172.21.15.7:0/1076429720 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:19.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.628+0000 7f76b2ffd640 1 --2- 172.21.15.7:0/1076429720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76b40ced20 0x7f76b4159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:19.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.628+0000 7f76b37fe640 1 --2- 172.21.15.7:0/1076429720 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f76b406e970 0x7f76b40c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:19.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.628+0000 7f76b3fff640 1 -- 172.21.15.7:0/1076429720 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f76b406e970 msgr2=0x7f76b40c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:19.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.628+0000 7f76b3fff640 1 --2- 172.21.15.7:0/1076429720 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f76b406e970 0x7f76b40c8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:19.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.628+0000 7f76b3fff640 1 -- 172.21.15.7:0/1076429720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76b40ced20 msgr2=0x7f76b4159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:19.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.628+0000 7f76b3fff640 1 --2- 172.21.15.7:0/1076429720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76b40ced20 0x7f76b4159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:19.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.628+0000 7f76b3fff640 1 -- 172.21.15.7:0/1076429720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b40c7d50 con 0x7f76b4144100 2024-04-25T09:56:19.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.628+0000 7f76b3fff640 1 --2- 172.21.15.7:0/1076429720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b4144100 0x7f76b40c7320 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00efc0 tx=0x7f76ac009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:19.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.628+0000 7f769bfff640 1 -- 172.21.15.7:0/1076429720 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac018030 con 0x7f76b4144100 2024-04-25T09:56:19.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.628+0000 7f769bfff640 1 -- 172.21.15.7:0/1076429720 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ac00cde0 con 0x7f76b4144100 2024-04-25T09:56:19.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.628+0000 7f769bfff640 1 -- 172.21.15.7:0/1076429720 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac003bb0 con 0x7f76b4144100 2024-04-25T09:56:19.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.628+0000 7f76b9ce1640 1 -- 172.21.15.7:0/1076429720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b40c8030 con 0x7f76b4144100 2024-04-25T09:56:19.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.628+0000 7f76b9ce1640 1 -- 172.21.15.7:0/1076429720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b40c85f0 con 0x7f76b4144100 2024-04-25T09:56:19.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.629+0000 7f76b9ce1640 1 -- 172.21.15.7:0/1076429720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b4068fd0 con 0x7f76b4144100 2024-04-25T09:56:19.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.630+0000 7f769bfff640 1 -- 172.21.15.7:0/1076429720 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f76ac005d10 con 0x7f76b4144100 2024-04-25T09:56:19.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.630+0000 7f769bfff640 1 --2- 172.21.15.7:0/1076429720 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f76a006b4d0 0x7f76a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:19.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.630+0000 7f769bfff640 1 -- 172.21.15.7:0/1076429720 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f76ac08ac70 con 0x7f76b4144100 2024-04-25T09:56:19.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.630+0000 7f76b37fe640 1 --2- 172.21.15.7:0/1076429720 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f76a006b4d0 0x7f76a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:19.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.631+0000 7f76b37fe640 1 --2- 172.21.15.7:0/1076429720 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f76a006b4d0 0x7f76a006d990 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f76a4005880 tx=0x7f76a40057f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:19.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.634+0000 7f769bfff640 1 -- 172.21.15.7:0/1076429720 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f76ac022070 con 0x7f76b4144100 2024-04-25T09:56:19.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.812+0000 7f76b9ce1640 1 -- 172.21.15.7:0/1076429720 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f76b40b1ed0 con 0x7f76a006b4d0 2024-04-25T09:56:19.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.817+0000 7f769bfff640 1 -- 172.21.15.7:0/1076429720 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+248778 (secure 0 0 0) 0x7f76b40b1ed0 con 0x7f76a006b4d0 2024-04-25T09:56:19.823 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:19.824 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T09:56:19.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.820+0000 7f76b9ce1640 1 -- 172.21.15.7:0/1076429720 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f76a006b4d0 msgr2=0x7f76a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:19.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.820+0000 7f76b9ce1640 1 --2- 172.21.15.7:0/1076429720 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f76a006b4d0 0x7f76a006d990 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f76a4005880 tx=0x7f76a40057f0 comp rx=0 tx=0).stop 2024-04-25T09:56:19.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.820+0000 7f76b9ce1640 1 -- 172.21.15.7:0/1076429720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b4144100 msgr2=0x7f76b40c7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:19.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.820+0000 7f76b9ce1640 1 --2- 172.21.15.7:0/1076429720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b4144100 0x7f76b40c7320 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00efc0 tx=0x7f76ac009f90 comp rx=0 tx=0).stop 2024-04-25T09:56:19.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.820+0000 7f76b9ce1640 1 -- 172.21.15.7:0/1076429720 shutdown_connections 2024-04-25T09:56:19.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.820+0000 7f76b9ce1640 1 --2- 172.21.15.7:0/1076429720 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f76a006b4d0 0x7f76a006d990 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:19.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.820+0000 7f76b9ce1640 1 --2- 172.21.15.7:0/1076429720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76b4144100 0x7f76b40c7320 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:19.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.820+0000 7f76b9ce1640 1 --2- 172.21.15.7:0/1076429720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76b40ced20 0x7f76b4159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:19.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.820+0000 7f76b9ce1640 1 --2- 172.21.15.7:0/1076429720 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f76b406e970 0x7f76b40c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:19.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.820+0000 7f76b9ce1640 1 -- 172.21.15.7:0/1076429720 >> 172.21.15.7:0/1076429720 conn(0x7f76b4071150 msgr2=0x7f76b40b4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:19.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.820+0000 7f76b9ce1640 1 -- 172.21.15.7:0/1076429720 shutdown_connections 2024-04-25T09:56:19.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:19.821+0000 7f76b9ce1640 1 -- 172.21.15.7:0/1076429720 wait complete. 2024-04-25T09:56:19.834 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2024-04-25T09:56:17.877249+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":174,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255136,"kb_used_data":5680,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754719584,"statfs":{"total":773094113280,"available":772832854016,"internally_reserved":0,"allocated":5816320,"data_stored":3205836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":742,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.495639"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.400552+0000","last_change":"2024-04-25T09:56:14.400552+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.400552+0000","last_undegraded":"2024-04-25T09:56:14.400552+0000","last_fullsized":"2024-04-25T09:56:14.400552+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.419019+0000","last_change":"2024-04-25T09:56:15.414664+0000","last_active":"2024-04-25T09:56:15.419019+0000","last_peered":"2024-04-25T09:56:15.419019+0000","last_clean":"2024-04-25T09:56:15.419019+0000","last_became_active":"2024-04-25T09:56:15.414291+0000","last_became_peered":"2024-04-25T09:56:15.414291+0000","last_unstale":"2024-04-25T09:56:15.419019+0000","last_undegraded":"2024-04-25T09:56:15.419019+0000","last_fullsized":"2024-04-25T09:56:15.419019+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:57.405816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.405512+0000","last_change":"2024-04-25T09:56:14.405512+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.405512+0000","last_undegraded":"2024-04-25T09:56:14.405512+0000","last_fullsized":"2024-04-25T09:56:14.405512+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.418562+0000","last_change":"2024-04-25T09:56:15.413750+0000","last_active":"2024-04-25T09:56:15.418562+0000","last_peered":"2024-04-25T09:56:15.418562+0000","last_clean":"2024-04-25T09:56:15.418562+0000","last_became_active":"2024-04-25T09:56:15.413442+0000","last_became_peered":"2024-04-25T09:56:15.413442+0000","last_unstale":"2024-04-25T09:56:15.418562+0000","last_undegraded":"2024-04-25T09:56:15.418562+0000","last_fullsized":"2024-04-25T09:56:15.418562+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:05.088117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.412912+0000","last_change":"2024-04-25T09:56:15.403689+0000","last_active":"2024-04-25T09:56:15.412912+0000","last_peered":"2024-04-25T09:56:15.412912+0000","last_clean":"2024-04-25T09:56:15.412912+0000","last_became_active":"2024-04-25T09:56:15.403310+0000","last_became_peered":"2024-04-25T09:56:15.403310+0000","last_unstale":"2024-04-25T09:56:15.412912+0000","last_undegraded":"2024-04-25T09:56:15.412912+0000","last_fullsized":"2024-04-25T09:56:15.412912+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:32.473975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.399868+0000","last_change":"2024-04-25T09:56:14.399868+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.399868+0000","last_undegraded":"2024-04-25T09:56:14.399868+0000","last_fullsized":"2024-04-25T09:56:14.399868+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.400932+0000","last_change":"2024-04-25T09:56:14.400932+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.400932+0000","last_undegraded":"2024-04-25T09:56:14.400932+0000","last_fullsized":"2024-04-25T09:56:14.400932+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397566+0000","last_change":"2024-04-25T09:56:14.397566+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397566+0000","last_undegraded":"2024-04-25T09:56:14.397566+0000","last_fullsized":"2024-04-25T09:56:14.397566+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.399128+0000","last_change":"2024-04-25T09:56:14.399128+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.399128+0000","last_undegraded":"2024-04-25T09:56:14.399128+0000","last_fullsized":"2024-04-25T09:56:14.399128+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.399463+0000","last_change":"2024-04-25T09:56:14.399463+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.399463+0000","last_undegraded":"2024-04-25T09:56:14.399463+0000","last_fullsized":"2024-04-25T09:56:14.399463+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.401987+0000","last_change":"2024-04-25T09:56:14.401987+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.401987+0000","last_undegraded":"2024-04-25T09:56:14.401987+0000","last_fullsized":"2024-04-25T09:56:14.401987+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396299+0000","last_change":"2024-04-25T09:56:14.396299+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396299+0000","last_undegraded":"2024-04-25T09:56:14.396299+0000","last_fullsized":"2024-04-25T09:56:14.396299+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.398876+0000","last_change":"2024-04-25T09:56:14.398876+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.398876+0000","last_undegraded":"2024-04-25T09:56:14.398876+0000","last_fullsized":"2024-04-25T09:56:14.398876+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.400902+0000","last_change":"2024-04-25T09:56:14.400902+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.400902+0000","last_undegraded":"2024-04-25T09:56:14.400902+0000","last_fullsized":"2024-04-25T09:56:14.400902+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.418608+0000","last_change":"2024-04-25T09:56:15.412875+0000","last_active":"2024-04-25T09:56:15.418608+0000","last_peered":"2024-04-25T09:56:15.418608+0000","last_clean":"2024-04-25T09:56:15.418608+0000","last_became_active":"2024-04-25T09:56:15.410551+0000","last_became_peered":"2024-04-25T09:56:15.410551+0000","last_unstale":"2024-04-25T09:56:15.418608+0000","last_undegraded":"2024-04-25T09:56:15.418608+0000","last_fullsized":"2024-04-25T09:56:15.418608+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:52.657234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.398412+0000","last_change":"2024-04-25T09:56:14.398412+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.398412+0000","last_undegraded":"2024-04-25T09:56:14.398412+0000","last_fullsized":"2024-04-25T09:56:14.398412+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.404109+0000","last_change":"2024-04-25T09:56:14.404109+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.404109+0000","last_undegraded":"2024-04-25T09:56:14.404109+0000","last_fullsized":"2024-04-25T09:56:14.404109+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.420717+0000","last_change":"2024-04-25T09:56:15.415498+0000","last_active":"2024-04-25T09:56:15.420717+0000","last_peered":"2024-04-25T09:56:15.420717+0000","last_clean":"2024-04-25T09:56:15.420717+0000","last_became_active":"2024-04-25T09:56:15.415058+0000","last_became_peered":"2024-04-25T09:56:15.415058+0000","last_unstale":"2024-04-25T09:56:15.420717+0000","last_undegraded":"2024-04-25T09:56:15.420717+0000","last_fullsized":"2024-04-25T09:56:15.420717+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:08.074490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.400388+0000","last_change":"2024-04-25T09:56:14.400388+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.400388+0000","last_undegraded":"2024-04-25T09:56:14.400388+0000","last_fullsized":"2024-04-25T09:56:14.400388+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.419210+0000","last_change":"2024-04-25T09:56:15.415691+0000","last_active":"2024-04-25T09:56:15.419210+0000","last_peered":"2024-04-25T09:56:15.419210+0000","last_clean":"2024-04-25T09:56:15.419210+0000","last_became_active":"2024-04-25T09:56:15.410685+0000","last_became_peered":"2024-04-25T09:56:15.410685+0000","last_unstale":"2024-04-25T09:56:15.419210+0000","last_undegraded":"2024-04-25T09:56:15.419210+0000","last_fullsized":"2024-04-25T09:56:15.419210+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:40.524761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.407634+0000","last_change":"2024-04-25T09:56:15.406055+0000","last_active":"2024-04-25T09:56:15.407634+0000","last_peered":"2024-04-25T09:56:15.407634+0000","last_clean":"2024-04-25T09:56:15.407634+0000","last_became_active":"2024-04-25T09:56:15.405683+0000","last_became_peered":"2024-04-25T09:56:15.405683+0000","last_unstale":"2024-04-25T09:56:15.407634+0000","last_undegraded":"2024-04-25T09:56:15.407634+0000","last_fullsized":"2024-04-25T09:56:15.407634+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:56.579633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.398789+0000","last_change":"2024-04-25T09:56:14.398789+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.398789+0000","last_undegraded":"2024-04-25T09:56:14.398789+0000","last_fullsized":"2024-04-25T09:56:14.398789+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.402466+0000","last_change":"2024-04-25T09:56:14.402466+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.402466+0000","last_undegraded":"2024-04-25T09:56:14.402466+0000","last_fullsized":"2024-04-25T09:56:14.402466+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.399899+0000","last_change":"2024-04-25T09:56:14.399899+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.399899+0000","last_undegraded":"2024-04-25T09:56:14.399899+0000","last_fullsized":"2024-04-25T09:56:14.399899+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.403666+0000","last_change":"2024-04-25T09:56:14.403666+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.403666+0000","last_undegraded":"2024-04-25T09:56:14.403666+0000","last_fullsized":"2024-04-25T09:56:14.403666+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397725+0000","last_change":"2024-04-25T09:56:14.397725+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397725+0000","last_undegraded":"2024-04-25T09:56:14.397725+0000","last_fullsized":"2024-04-25T09:56:14.397725+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397960+0000","last_change":"2024-04-25T09:56:14.397960+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397960+0000","last_undegraded":"2024-04-25T09:56:14.397960+0000","last_fullsized":"2024-04-25T09:56:14.397960+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.419251+0000","last_change":"2024-04-25T09:56:15.416284+0000","last_active":"2024-04-25T09:56:15.419251+0000","last_peered":"2024-04-25T09:56:15.419251+0000","last_clean":"2024-04-25T09:56:15.419251+0000","last_became_active":"2024-04-25T09:56:15.416000+0000","last_became_peered":"2024-04-25T09:56:15.416000+0000","last_unstale":"2024-04-25T09:56:15.419251+0000","last_undegraded":"2024-04-25T09:56:15.419251+0000","last_fullsized":"2024-04-25T09:56:15.419251+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:19.710411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.399865+0000","last_change":"2024-04-25T09:56:14.399865+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.399865+0000","last_undegraded":"2024-04-25T09:56:14.399865+0000","last_fullsized":"2024-04-25T09:56:14.399865+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.417516+0000","last_change":"2024-04-25T09:56:15.406771+0000","last_active":"2024-04-25T09:56:15.417516+0000","last_peered":"2024-04-25T09:56:15.417516+0000","last_clean":"2024-04-25T09:56:15.417516+0000","last_became_active":"2024-04-25T09:56:15.406430+0000","last_became_peered":"2024-04-25T09:56:15.406430+0000","last_unstale":"2024-04-25T09:56:15.417516+0000","last_undegraded":"2024-04-25T09:56:15.417516+0000","last_fullsized":"2024-04-25T09:56:15.417516+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:34.121647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.399374+0000","last_change":"2024-04-25T09:56:14.399374+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.399374+0000","last_undegraded":"2024-04-25T09:56:14.399374+0000","last_fullsized":"2024-04-25T09:56:14.399374+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.413116+0000","last_change":"2024-04-25T09:56:15.408712+0000","last_active":"2024-04-25T09:56:15.413116+0000","last_peered":"2024-04-25T09:56:15.413116+0000","last_clean":"2024-04-25T09:56:15.413116+0000","last_became_active":"2024-04-25T09:56:15.408367+0000","last_became_peered":"2024-04-25T09:56:15.408367+0000","last_unstale":"2024-04-25T09:56:15.413116+0000","last_undegraded":"2024-04-25T09:56:15.413116+0000","last_fullsized":"2024-04-25T09:56:15.413116+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:52.399587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.420686+0000","last_change":"2024-04-25T09:56:15.417224+0000","last_active":"2024-04-25T09:56:15.420686+0000","last_peered":"2024-04-25T09:56:15.420686+0000","last_clean":"2024-04-25T09:56:15.420686+0000","last_became_active":"2024-04-25T09:56:15.415334+0000","last_became_peered":"2024-04-25T09:56:15.415334+0000","last_unstale":"2024-04-25T09:56:15.420686+0000","last_undegraded":"2024-04-25T09:56:15.420686+0000","last_fullsized":"2024-04-25T09:56:15.420686+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:52.399587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.419504+0000","last_change":"2024-04-25T09:56:14.413604+0000","last_active":"2024-04-25T09:56:15.419504+0000","last_peered":"2024-04-25T09:56:15.419504+0000","last_clean":"2024-04-25T09:56:15.419504+0000","last_became_active":"2024-04-25T09:56:14.413289+0000","last_became_peered":"2024-04-25T09:56:14.413289+0000","last_unstale":"2024-04-25T09:56:15.419504+0000","last_undegraded":"2024-04-25T09:56:15.419504+0000","last_fullsized":"2024-04-25T09:56:15.419504+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:42.555560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.413358+0000","last_change":"2024-04-25T09:56:15.407627+0000","last_active":"2024-04-25T09:56:15.413358+0000","last_peered":"2024-04-25T09:56:15.413358+0000","last_clean":"2024-04-25T09:56:15.413358+0000","last_became_active":"2024-04-25T09:56:15.407321+0000","last_became_peered":"2024-04-25T09:56:15.407321+0000","last_unstale":"2024-04-25T09:56:15.413358+0000","last_undegraded":"2024-04-25T09:56:15.413358+0000","last_fullsized":"2024-04-25T09:56:15.413358+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:05.088117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.409745+0000","last_change":"2024-04-25T09:56:14.407748+0000","last_active":"2024-04-25T09:56:14.409745+0000","last_peered":"2024-04-25T09:56:14.409745+0000","last_clean":"2024-04-25T09:56:14.409745+0000","last_became_active":"2024-04-25T09:56:14.407486+0000","last_became_peered":"2024-04-25T09:56:14.407486+0000","last_unstale":"2024-04-25T09:56:14.409745+0000","last_undegraded":"2024-04-25T09:56:14.409745+0000","last_fullsized":"2024-04-25T09:56:14.409745+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:59.529887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.417147+0000","last_change":"2024-04-25T09:56:15.414659+0000","last_active":"2024-04-25T09:56:15.417147+0000","last_peered":"2024-04-25T09:56:15.417147+0000","last_clean":"2024-04-25T09:56:15.417147+0000","last_became_active":"2024-04-25T09:56:15.410616+0000","last_became_peered":"2024-04-25T09:56:15.410616+0000","last_unstale":"2024-04-25T09:56:15.417147+0000","last_undegraded":"2024-04-25T09:56:15.417147+0000","last_fullsized":"2024-04-25T09:56:15.417147+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:34.121647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.412708+0000","last_change":"2024-04-25T09:56:14.408749+0000","last_active":"2024-04-25T09:56:14.412708+0000","last_peered":"2024-04-25T09:56:14.412708+0000","last_clean":"2024-04-25T09:56:14.412708+0000","last_became_active":"2024-04-25T09:56:14.408402+0000","last_became_peered":"2024-04-25T09:56:14.408402+0000","last_unstale":"2024-04-25T09:56:14.412708+0000","last_undegraded":"2024-04-25T09:56:14.412708+0000","last_fullsized":"2024-04-25T09:56:14.412708+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:09.715610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396837+0000","last_change":"2024-04-25T09:56:14.396837+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396837+0000","last_undegraded":"2024-04-25T09:56:14.396837+0000","last_fullsized":"2024-04-25T09:56:14.396837+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.428006+0000","last_change":"2024-04-25T09:56:14.416066+0000","last_active":"2024-04-25T09:56:15.428006+0000","last_peered":"2024-04-25T09:56:15.428006+0000","last_clean":"2024-04-25T09:56:15.428006+0000","last_became_active":"2024-04-25T09:56:14.415761+0000","last_became_peered":"2024-04-25T09:56:14.415761+0000","last_unstale":"2024-04-25T09:56:15.428006+0000","last_undegraded":"2024-04-25T09:56:15.428006+0000","last_fullsized":"2024-04-25T09:56:15.428006+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:51.655284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.412231+0000","last_change":"2024-04-25T09:56:15.405699+0000","last_active":"2024-04-25T09:56:15.412231+0000","last_peered":"2024-04-25T09:56:15.412231+0000","last_clean":"2024-04-25T09:56:15.412231+0000","last_became_active":"2024-04-25T09:56:15.405415+0000","last_became_peered":"2024-04-25T09:56:15.405415+0000","last_unstale":"2024-04-25T09:56:15.412231+0000","last_undegraded":"2024-04-25T09:56:15.412231+0000","last_fullsized":"2024-04-25T09:56:15.412231+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:11.547014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.414754+0000","last_change":"2024-04-25T09:56:14.411984+0000","last_active":"2024-04-25T09:56:14.414754+0000","last_peered":"2024-04-25T09:56:14.414754+0000","last_clean":"2024-04-25T09:56:14.414754+0000","last_became_active":"2024-04-25T09:56:14.411230+0000","last_became_peered":"2024-04-25T09:56:14.411230+0000","last_unstale":"2024-04-25T09:56:14.414754+0000","last_undegraded":"2024-04-25T09:56:14.414754+0000","last_fullsized":"2024-04-25T09:56:14.414754+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:02.173295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.414998+0000","last_change":"2024-04-25T09:56:15.409846+0000","last_active":"2024-04-25T09:56:15.414998+0000","last_peered":"2024-04-25T09:56:15.414998+0000","last_clean":"2024-04-25T09:56:15.414998+0000","last_became_active":"2024-04-25T09:56:15.409530+0000","last_became_peered":"2024-04-25T09:56:15.409530+0000","last_unstale":"2024-04-25T09:56:15.414998+0000","last_undegraded":"2024-04-25T09:56:15.414998+0000","last_fullsized":"2024-04-25T09:56:15.414998+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:19.710411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.424782+0000","last_change":"2024-04-25T09:56:14.411589+0000","last_active":"2024-04-25T09:56:15.424782+0000","last_peered":"2024-04-25T09:56:15.424782+0000","last_clean":"2024-04-25T09:56:15.424782+0000","last_became_active":"2024-04-25T09:56:14.411266+0000","last_became_peered":"2024-04-25T09:56:14.411266+0000","last_unstale":"2024-04-25T09:56:15.424782+0000","last_undegraded":"2024-04-25T09:56:15.424782+0000","last_fullsized":"2024-04-25T09:56:15.424782+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:02.173295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396786+0000","last_change":"2024-04-25T09:56:14.396786+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396786+0000","last_undegraded":"2024-04-25T09:56:14.396786+0000","last_fullsized":"2024-04-25T09:56:14.396786+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.398970+0000","last_change":"2024-04-25T09:56:14.413373+0000","last_active":"2024-04-25T09:56:15.398970+0000","last_peered":"2024-04-25T09:56:15.398970+0000","last_clean":"2024-04-25T09:56:15.398970+0000","last_became_active":"2024-04-25T09:56:14.413066+0000","last_became_peered":"2024-04-25T09:56:14.413066+0000","last_unstale":"2024-04-25T09:56:15.398970+0000","last_undegraded":"2024-04-25T09:56:15.398970+0000","last_fullsized":"2024-04-25T09:56:15.398970+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:02.173295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.415067+0000","last_change":"2024-04-25T09:56:15.409215+0000","last_active":"2024-04-25T09:56:15.415067+0000","last_peered":"2024-04-25T09:56:15.415067+0000","last_clean":"2024-04-25T09:56:15.415067+0000","last_became_active":"2024-04-25T09:56:15.408934+0000","last_became_peered":"2024-04-25T09:56:15.408934+0000","last_unstale":"2024-04-25T09:56:15.415067+0000","last_undegraded":"2024-04-25T09:56:15.415067+0000","last_fullsized":"2024-04-25T09:56:15.415067+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:40.524761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.411668+0000","last_change":"2024-04-25T09:56:14.409931+0000","last_active":"2024-04-25T09:56:14.411668+0000","last_peered":"2024-04-25T09:56:14.411668+0000","last_clean":"2024-04-25T09:56:14.411668+0000","last_became_active":"2024-04-25T09:56:14.409653+0000","last_became_peered":"2024-04-25T09:56:14.409653+0000","last_unstale":"2024-04-25T09:56:14.411668+0000","last_undegraded":"2024-04-25T09:56:14.411668+0000","last_fullsized":"2024-04-25T09:56:14.411668+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:02.560063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.412321+0000","last_change":"2024-04-25T09:56:15.404379+0000","last_active":"2024-04-25T09:56:15.412321+0000","last_peered":"2024-04-25T09:56:15.412321+0000","last_clean":"2024-04-25T09:56:15.412321+0000","last_became_active":"2024-04-25T09:56:15.404111+0000","last_became_peered":"2024-04-25T09:56:15.404111+0000","last_unstale":"2024-04-25T09:56:15.412321+0000","last_undegraded":"2024-04-25T09:56:15.412321+0000","last_fullsized":"2024-04-25T09:56:15.412321+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:49.392569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.401436+0000","last_change":"2024-04-25T09:56:14.415504+0000","last_active":"2024-04-25T09:56:15.401436+0000","last_peered":"2024-04-25T09:56:15.401436+0000","last_clean":"2024-04-25T09:56:15.401436+0000","last_became_active":"2024-04-25T09:56:14.414650+0000","last_became_peered":"2024-04-25T09:56:14.414650+0000","last_unstale":"2024-04-25T09:56:15.401436+0000","last_undegraded":"2024-04-25T09:56:15.401436+0000","last_fullsized":"2024-04-25T09:56:15.401436+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:43.308611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.413378+0000","last_change":"2024-04-25T09:56:15.409591+0000","last_active":"2024-04-25T09:56:15.413378+0000","last_peered":"2024-04-25T09:56:15.413378+0000","last_clean":"2024-04-25T09:56:15.413378+0000","last_became_active":"2024-04-25T09:56:15.409263+0000","last_became_peered":"2024-04-25T09:56:15.409263+0000","last_unstale":"2024-04-25T09:56:15.413378+0000","last_undegraded":"2024-04-25T09:56:15.413378+0000","last_fullsized":"2024-04-25T09:56:15.413378+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:26.649129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.394600+0000","last_change":"2024-04-25T09:56:14.412591+0000","last_active":"2024-04-25T09:56:15.394600+0000","last_peered":"2024-04-25T09:56:15.394600+0000","last_clean":"2024-04-25T09:56:15.394600+0000","last_became_active":"2024-04-25T09:56:14.412210+0000","last_became_peered":"2024-04-25T09:56:14.412210+0000","last_unstale":"2024-04-25T09:56:15.394600+0000","last_undegraded":"2024-04-25T09:56:15.394600+0000","last_fullsized":"2024-04-25T09:56:15.394600+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:02.560063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397298+0000","last_change":"2024-04-25T09:56:14.397298+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397298+0000","last_undegraded":"2024-04-25T09:56:14.397298+0000","last_fullsized":"2024-04-25T09:56:14.397298+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.427707+0000","last_change":"2024-04-25T09:56:14.416329+0000","last_active":"2024-04-25T09:56:15.427707+0000","last_peered":"2024-04-25T09:56:15.427707+0000","last_clean":"2024-04-25T09:56:15.427707+0000","last_became_active":"2024-04-25T09:56:14.416028+0000","last_became_peered":"2024-04-25T09:56:14.416028+0000","last_unstale":"2024-04-25T09:56:15.427707+0000","last_undegraded":"2024-04-25T09:56:15.427707+0000","last_fullsized":"2024-04-25T09:56:15.427707+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:10.545063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.417689+0000","last_change":"2024-04-25T09:56:15.413056+0000","last_active":"2024-04-25T09:56:15.417689+0000","last_peered":"2024-04-25T09:56:15.417689+0000","last_clean":"2024-04-25T09:56:15.417689+0000","last_became_active":"2024-04-25T09:56:15.412739+0000","last_became_peered":"2024-04-25T09:56:15.412739+0000","last_unstale":"2024-04-25T09:56:15.417689+0000","last_undegraded":"2024-04-25T09:56:15.417689+0000","last_fullsized":"2024-04-25T09:56:15.417689+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:56.579633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.416935+0000","last_change":"2024-04-25T09:56:14.408541+0000","last_active":"2024-04-25T09:56:14.416935+0000","last_peered":"2024-04-25T09:56:14.416935+0000","last_clean":"2024-04-25T09:56:14.416935+0000","last_became_active":"2024-04-25T09:56:14.407599+0000","last_became_peered":"2024-04-25T09:56:14.407599+0000","last_unstale":"2024-04-25T09:56:14.416935+0000","last_undegraded":"2024-04-25T09:56:14.416935+0000","last_fullsized":"2024-04-25T09:56:14.416935+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:51.655284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.413240+0000","last_change":"2024-04-25T09:56:15.407624+0000","last_active":"2024-04-25T09:56:15.413240+0000","last_peered":"2024-04-25T09:56:15.413240+0000","last_clean":"2024-04-25T09:56:15.413240+0000","last_became_active":"2024-04-25T09:56:15.407295+0000","last_became_peered":"2024-04-25T09:56:15.407295+0000","last_unstale":"2024-04-25T09:56:15.413240+0000","last_undegraded":"2024-04-25T09:56:15.413240+0000","last_fullsized":"2024-04-25T09:56:15.413240+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:57.405816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.414774+0000","last_change":"2024-04-25T09:56:14.412434+0000","last_active":"2024-04-25T09:56:14.414774+0000","last_peered":"2024-04-25T09:56:14.414774+0000","last_clean":"2024-04-25T09:56:14.414774+0000","last_became_active":"2024-04-25T09:56:14.411639+0000","last_became_peered":"2024-04-25T09:56:14.411639+0000","last_unstale":"2024-04-25T09:56:14.414774+0000","last_undegraded":"2024-04-25T09:56:14.414774+0000","last_fullsized":"2024-04-25T09:56:14.414774+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:31.472024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397944+0000","last_change":"2024-04-25T09:56:14.397944+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397944+0000","last_undegraded":"2024-04-25T09:56:14.397944+0000","last_fullsized":"2024-04-25T09:56:14.397944+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.400394+0000","last_change":"2024-04-25T09:56:14.417041+0000","last_active":"2024-04-25T09:56:15.400394+0000","last_peered":"2024-04-25T09:56:15.400394+0000","last_clean":"2024-04-25T09:56:15.400394+0000","last_became_active":"2024-04-25T09:56:14.416523+0000","last_became_peered":"2024-04-25T09:56:14.416523+0000","last_unstale":"2024-04-25T09:56:15.400394+0000","last_undegraded":"2024-04-25T09:56:15.400394+0000","last_fullsized":"2024-04-25T09:56:15.400394+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:48.390619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397265+0000","last_change":"2024-04-25T09:56:14.397265+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397265+0000","last_undegraded":"2024-04-25T09:56:14.397265+0000","last_fullsized":"2024-04-25T09:56:14.397265+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.401072+0000","last_change":"2024-04-25T09:56:14.413069+0000","last_active":"2024-04-25T09:56:15.401072+0000","last_peered":"2024-04-25T09:56:15.401072+0000","last_clean":"2024-04-25T09:56:15.401072+0000","last_became_active":"2024-04-25T09:56:14.412763+0000","last_became_peered":"2024-04-25T09:56:14.412763+0000","last_unstale":"2024-04-25T09:56:15.401072+0000","last_undegraded":"2024-04-25T09:56:15.401072+0000","last_fullsized":"2024-04-25T09:56:15.401072+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:55.577682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397743+0000","last_change":"2024-04-25T09:56:14.397743+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397743+0000","last_undegraded":"2024-04-25T09:56:14.397743+0000","last_fullsized":"2024-04-25T09:56:14.397743+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.416043+0000","last_change":"2024-04-25T09:56:14.409356+0000","last_active":"2024-04-25T09:56:14.416043+0000","last_peered":"2024-04-25T09:56:14.416043+0000","last_clean":"2024-04-25T09:56:14.416043+0000","last_became_active":"2024-04-25T09:56:14.409096+0000","last_became_peered":"2024-04-25T09:56:14.409096+0000","last_unstale":"2024-04-25T09:56:14.416043+0000","last_undegraded":"2024-04-25T09:56:14.416043+0000","last_fullsized":"2024-04-25T09:56:14.416043+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:04.086167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.397108+0000","last_change":"2024-04-25T09:56:14.397108+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.397108+0000","last_undegraded":"2024-04-25T09:56:14.397108+0000","last_fullsized":"2024-04-25T09:56:14.397108+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.405920+0000","last_change":"2024-04-25T09:56:14.405032+0000","last_active":"2024-04-25T09:56:14.405920+0000","last_peered":"2024-04-25T09:56:14.405920+0000","last_clean":"2024-04-25T09:56:14.405920+0000","last_became_active":"2024-04-25T09:56:14.404522+0000","last_became_peered":"2024-04-25T09:56:14.404522+0000","last_unstale":"2024-04-25T09:56:14.405920+0000","last_undegraded":"2024-04-25T09:56:14.405920+0000","last_fullsized":"2024-04-25T09:56:14.405920+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:09.715610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396240+0000","last_change":"2024-04-25T09:56:14.396240+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396240+0000","last_undegraded":"2024-04-25T09:56:14.396240+0000","last_fullsized":"2024-04-25T09:56:14.396240+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.413788+0000","last_change":"2024-04-25T09:56:14.412352+0000","last_active":"2024-04-25T09:56:14.413788+0000","last_peered":"2024-04-25T09:56:14.413788+0000","last_clean":"2024-04-25T09:56:14.413788+0000","last_became_active":"2024-04-25T09:56:14.412017+0000","last_became_peered":"2024-04-25T09:56:14.412017+0000","last_unstale":"2024-04-25T09:56:14.413788+0000","last_undegraded":"2024-04-25T09:56:14.413788+0000","last_fullsized":"2024-04-25T09:56:14.413788+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:46.143188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.417725+0000","last_change":"2024-04-25T09:56:15.414094+0000","last_active":"2024-04-25T09:56:15.417725+0000","last_peered":"2024-04-25T09:56:15.417725+0000","last_clean":"2024-04-25T09:56:15.417725+0000","last_became_active":"2024-04-25T09:56:15.413821+0000","last_became_peered":"2024-04-25T09:56:15.413821+0000","last_unstale":"2024-04-25T09:56:15.417725+0000","last_undegraded":"2024-04-25T09:56:15.417725+0000","last_fullsized":"2024-04-25T09:56:15.417725+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:25:17.174689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.420402+0000","last_change":"2024-04-25T09:56:14.410213+0000","last_active":"2024-04-25T09:56:15.420402+0000","last_peered":"2024-04-25T09:56:15.420402+0000","last_clean":"2024-04-25T09:56:15.420402+0000","last_became_active":"2024-04-25T09:56:14.409924+0000","last_became_peered":"2024-04-25T09:56:14.409924+0000","last_unstale":"2024-04-25T09:56:15.420402+0000","last_undegraded":"2024-04-25T09:56:15.420402+0000","last_fullsized":"2024-04-25T09:56:15.420402+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:10.545063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396079+0000","last_change":"2024-04-25T09:56:14.396079+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396079+0000","last_undegraded":"2024-04-25T09:56:14.396079+0000","last_fullsized":"2024-04-25T09:56:14.396079+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.400209+0000","last_change":"2024-04-25T09:56:14.406144+0000","last_active":"2024-04-25T09:56:15.400209+0000","last_peered":"2024-04-25T09:56:15.400209+0000","last_clean":"2024-04-25T09:56:15.400209+0000","last_became_active":"2024-04-25T09:56:14.405807+0000","last_became_peered":"2024-04-25T09:56:14.405807+0000","last_unstale":"2024-04-25T09:56:15.400209+0000","last_undegraded":"2024-04-25T09:56:15.400209+0000","last_fullsized":"2024-04-25T09:56:15.400209+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:31.472024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.413272+0000","last_change":"2024-04-25T09:56:15.409815+0000","last_active":"2024-04-25T09:56:15.413272+0000","last_peered":"2024-04-25T09:56:15.413272+0000","last_clean":"2024-04-25T09:56:15.413272+0000","last_became_active":"2024-04-25T09:56:15.409514+0000","last_became_peered":"2024-04-25T09:56:15.409514+0000","last_unstale":"2024-04-25T09:56:15.413272+0000","last_undegraded":"2024-04-25T09:56:15.413272+0000","last_fullsized":"2024-04-25T09:56:15.413272+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:35.961223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.408759+0000","last_change":"2024-04-25T09:56:14.406874+0000","last_active":"2024-04-25T09:56:14.408759+0000","last_peered":"2024-04-25T09:56:14.408759+0000","last_clean":"2024-04-25T09:56:14.408759+0000","last_became_active":"2024-04-25T09:56:14.406576+0000","last_became_peered":"2024-04-25T09:56:14.406576+0000","last_unstale":"2024-04-25T09:56:14.408759+0000","last_undegraded":"2024-04-25T09:56:14.408759+0000","last_fullsized":"2024-04-25T09:56:14.408759+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:52.202052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.415248+0000","last_change":"2024-04-25T09:56:15.410149+0000","last_active":"2024-04-25T09:56:15.415248+0000","last_peered":"2024-04-25T09:56:15.415248+0000","last_clean":"2024-04-25T09:56:15.415248+0000","last_became_active":"2024-04-25T09:56:15.409859+0000","last_became_peered":"2024-04-25T09:56:15.409859+0000","last_unstale":"2024-04-25T09:56:15.415248+0000","last_undegraded":"2024-04-25T09:56:15.415248+0000","last_fullsized":"2024-04-25T09:56:15.415248+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:44.310561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.414542+0000","last_change":"2024-04-25T09:56:14.406954+0000","last_active":"2024-04-25T09:56:14.414542+0000","last_peered":"2024-04-25T09:56:14.414542+0000","last_clean":"2024-04-25T09:56:14.414542+0000","last_became_active":"2024-04-25T09:56:14.406675+0000","last_became_peered":"2024-04-25T09:56:14.406675+0000","last_unstale":"2024-04-25T09:56:14.414542+0000","last_undegraded":"2024-04-25T09:56:14.414542+0000","last_fullsized":"2024-04-25T09:56:14.414542+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:39.522811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.395751+0000","last_change":"2024-04-25T09:56:14.395751+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.395751+0000","last_undegraded":"2024-04-25T09:56:14.395751+0000","last_fullsized":"2024-04-25T09:56:14.395751+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.409782+0000","last_change":"2024-04-25T09:56:14.406606+0000","last_active":"2024-04-25T09:56:14.409782+0000","last_peered":"2024-04-25T09:56:14.409782+0000","last_clean":"2024-04-25T09:56:14.409782+0000","last_became_active":"2024-04-25T09:56:14.406331+0000","last_became_peered":"2024-04-25T09:56:14.406331+0000","last_unstale":"2024-04-25T09:56:14.409782+0000","last_undegraded":"2024-04-25T09:56:14.409782+0000","last_fullsized":"2024-04-25T09:56:14.409782+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:42.555560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396387+0000","last_change":"2024-04-25T09:56:14.396387+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396387+0000","last_undegraded":"2024-04-25T09:56:14.396387+0000","last_fullsized":"2024-04-25T09:56:14.396387+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.416484+0000","last_change":"2024-04-25T09:56:14.414276+0000","last_active":"2024-04-25T09:56:14.416484+0000","last_peered":"2024-04-25T09:56:14.416484+0000","last_clean":"2024-04-25T09:56:14.416484+0000","last_became_active":"2024-04-25T09:56:14.413964+0000","last_became_peered":"2024-04-25T09:56:14.413964+0000","last_unstale":"2024-04-25T09:56:14.416484+0000","last_undegraded":"2024-04-25T09:56:14.416484+0000","last_fullsized":"2024-04-25T09:56:14.416484+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:50.921675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.417028+0000","last_change":"2024-04-25T09:56:15.409393+0000","last_active":"2024-04-25T09:56:15.417028+0000","last_peered":"2024-04-25T09:56:15.417028+0000","last_clean":"2024-04-25T09:56:15.417028+0000","last_became_active":"2024-04-25T09:56:15.409064+0000","last_became_peered":"2024-04-25T09:56:15.409064+0000","last_unstale":"2024-04-25T09:56:15.417028+0000","last_undegraded":"2024-04-25T09:56:15.417028+0000","last_fullsized":"2024-04-25T09:56:15.417028+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:08.074490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.426138+0000","last_change":"2024-04-25T09:56:14.415037+0000","last_active":"2024-04-25T09:56:15.426138+0000","last_peered":"2024-04-25T09:56:15.426138+0000","last_clean":"2024-04-25T09:56:15.426138+0000","last_became_active":"2024-04-25T09:56:14.414744+0000","last_became_peered":"2024-04-25T09:56:14.414744+0000","last_unstale":"2024-04-25T09:56:15.426138+0000","last_undegraded":"2024-04-25T09:56:15.426138+0000","last_fullsized":"2024-04-25T09:56:15.426138+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:02.560063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.395691+0000","last_change":"2024-04-25T09:56:14.395691+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.395691+0000","last_undegraded":"2024-04-25T09:56:14.395691+0000","last_fullsized":"2024-04-25T09:56:14.395691+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.401176+0000","last_change":"2024-04-25T09:56:14.415403+0000","last_active":"2024-04-25T09:56:15.401176+0000","last_peered":"2024-04-25T09:56:15.401176+0000","last_clean":"2024-04-25T09:56:15.401176+0000","last_became_active":"2024-04-25T09:56:14.414434+0000","last_became_peered":"2024-04-25T09:56:14.414434+0000","last_unstale":"2024-04-25T09:56:15.401176+0000","last_undegraded":"2024-04-25T09:56:15.401176+0000","last_fullsized":"2024-04-25T09:56:15.401176+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:25:16.172738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396338+0000","last_change":"2024-04-25T09:56:14.396338+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396338+0000","last_undegraded":"2024-04-25T09:56:14.396338+0000","last_fullsized":"2024-04-25T09:56:14.396338+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.415726+0000","last_change":"2024-04-25T09:56:14.414412+0000","last_active":"2024-04-25T09:56:14.415726+0000","last_peered":"2024-04-25T09:56:14.415726+0000","last_clean":"2024-04-25T09:56:14.415726+0000","last_became_active":"2024-04-25T09:56:14.413362+0000","last_became_peered":"2024-04-25T09:56:14.413362+0000","last_unstale":"2024-04-25T09:56:14.415726+0000","last_undegraded":"2024-04-25T09:56:14.415726+0000","last_fullsized":"2024-04-25T09:56:14.415726+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:48.390619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396316+0000","last_change":"2024-04-25T09:56:14.396316+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396316+0000","last_undegraded":"2024-04-25T09:56:14.396316+0000","last_fullsized":"2024-04-25T09:56:14.396316+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.414726+0000","last_change":"2024-04-25T09:56:14.408232+0000","last_active":"2024-04-25T09:56:14.414726+0000","last_peered":"2024-04-25T09:56:14.414726+0000","last_clean":"2024-04-25T09:56:14.414726+0000","last_became_active":"2024-04-25T09:56:14.407536+0000","last_became_peered":"2024-04-25T09:56:14.407536+0000","last_unstale":"2024-04-25T09:56:14.414726+0000","last_undegraded":"2024-04-25T09:56:14.414726+0000","last_fullsized":"2024-04-25T09:56:14.414726+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:18.708460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.418448+0000","last_change":"2024-04-25T09:56:15.416647+0000","last_active":"2024-04-25T09:56:15.418448+0000","last_peered":"2024-04-25T09:56:15.418448+0000","last_clean":"2024-04-25T09:56:15.418448+0000","last_became_active":"2024-04-25T09:56:15.416335+0000","last_became_peered":"2024-04-25T09:56:15.416335+0000","last_unstale":"2024-04-25T09:56:15.418448+0000","last_undegraded":"2024-04-25T09:56:15.418448+0000","last_fullsized":"2024-04-25T09:56:15.418448+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:57.464568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.416176+0000","last_change":"2024-04-25T09:56:14.413483+0000","last_active":"2024-04-25T09:56:14.416176+0000","last_peered":"2024-04-25T09:56:14.416176+0000","last_clean":"2024-04-25T09:56:14.416176+0000","last_became_active":"2024-04-25T09:56:14.413153+0000","last_became_peered":"2024-04-25T09:56:14.413153+0000","last_unstale":"2024-04-25T09:56:14.416176+0000","last_undegraded":"2024-04-25T09:56:14.416176+0000","last_fullsized":"2024-04-25T09:56:14.416176+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:56.403865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.396787+0000","last_change":"2024-04-25T09:56:14.396787+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.396787+0000","last_undegraded":"2024-04-25T09:56:14.396787+0000","last_fullsized":"2024-04-25T09:56:14.396787+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.394476+0000","last_change":"2024-04-25T09:56:14.411470+0000","last_active":"2024-04-25T09:56:15.394476+0000","last_peered":"2024-04-25T09:56:15.394476+0000","last_clean":"2024-04-25T09:56:15.394476+0000","last_became_active":"2024-04-25T09:56:14.411162+0000","last_became_peered":"2024-04-25T09:56:14.411162+0000","last_unstale":"2024-04-25T09:56:15.394476+0000","last_undegraded":"2024-04-25T09:56:15.394476+0000","last_fullsized":"2024-04-25T09:56:15.394476+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:42.555560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:56:14.398722+0000","last_change":"2024-04-25T09:56:14.398722+0000","last_active":"2024-04-25T09:56:14.381591+0000","last_peered":"2024-04-25T09:56:14.381591+0000","last_clean":"2024-04-25T09:56:14.381591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:56:14.398722+0000","last_undegraded":"2024-04-25T09:56:14.398722+0000","last_fullsized":"2024-04-25T09:56:14.398722+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.401348+0000","last_change":"2024-04-25T09:56:14.410884+0000","last_active":"2024-04-25T09:56:15.401348+0000","last_peered":"2024-04-25T09:56:15.401348+0000","last_clean":"2024-04-25T09:56:15.401348+0000","last_became_active":"2024-04-25T09:56:14.410576+0000","last_became_peered":"2024-04-25T09:56:14.410576+0000","last_unstale":"2024-04-25T09:56:15.401348+0000","last_undegraded":"2024-04-25T09:56:15.401348+0000","last_fullsized":"2024-04-25T09:56:15.401348+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:18.708460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.414961+0000","last_change":"2024-04-25T09:56:15.408216+0000","last_active":"2024-04-25T09:56:15.414961+0000","last_peered":"2024-04-25T09:56:15.414961+0000","last_clean":"2024-04-25T09:56:15.414961+0000","last_became_active":"2024-04-25T09:56:15.407935+0000","last_became_peered":"2024-04-25T09:56:15.407935+0000","last_unstale":"2024-04-25T09:56:15.414961+0000","last_undegraded":"2024-04-25T09:56:15.414961+0000","last_fullsized":"2024-04-25T09:56:15.414961+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:25:17.174689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:56:14.417104+0000","last_change":"2024-04-25T09:56:14.415709+0000","last_active":"2024-04-25T09:56:14.417104+0000","last_peered":"2024-04-25T09:56:14.417104+0000","last_clean":"2024-04-25T09:56:14.417104+0000","last_became_active":"2024-04-25T09:56:14.415165+0000","last_became_peered":"2024-04-25T09:56:14.415165+0000","last_unstale":"2024-04-25T09:56:14.417104+0000","last_undegraded":"2024-04-25T09:56:14.417104+0000","last_fullsized":"2024-04-25T09:56:14.417104+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:10.545063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":220,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T09:56:15.400324+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T09:56:15.400324+0000","last_peered":"2024-04-25T09:56:15.400324+0000","last_clean":"2024-04-25T09:56:15.400324+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T09:56:15.400324+0000","last_undegraded":"2024-04-25T09:56:15.400324+0000","last_fullsized":"2024-04-25T09:56:15.400324+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":742,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1171456,"data_stored":843299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542171,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31768,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":598016,"data_stored":260750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542173,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":589824,"data_stored":260098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542170,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":577536,"data_stored":252931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":577536,"data_stored":252931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":577536,"data_stored":252931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":565248,"data_stored":246264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1159168,"data_stored":836632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:56:21.059 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-04-25T09:56:21.056+0000 7fb7bac2e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:56:22.839 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:56:22.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.949+0000 7f2d47c5d640 1 Processor -- start 2024-04-25T09:56:22.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.949+0000 7f2d47c5d640 1 -- start start 2024-04-25T09:56:22.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.950+0000 7f2d47c5d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2d4015da60 0x7f2d400d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:22.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.950+0000 7f2d47c5d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d4015de40 0x7f2d4015e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:22.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.950+0000 7f2d47c5d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d4015e8a0 con 0x7f2d40161d70 2024-04-25T09:56:22.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.950+0000 7f2d47c5d640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d4015eb80 con 0x7f2d4015da60 2024-04-25T09:56:22.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.950+0000 7f2d47c5d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4015ee60 con 0x7f2d4015de40 2024-04-25T09:56:22.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.950+0000 7f2d459f9640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2d4015da60 0x7f2d400d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:22.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.950+0000 7f2d459f9640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2d4015da60 0x7f2d400d0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56854/0 (socket says 172.21.15.7:56854) 2024-04-25T09:56:22.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.950+0000 7f2d459f9640 1 -- 172.21.15.7:0/1136007440 learned_addr learned my addr 172.21.15.7:0/1136007440 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:22.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.950+0000 7f2d451f8640 1 --2- 172.21.15.7:0/1136007440 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d4015de40 0x7f2d4015e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:22.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.951+0000 7f2d459f9640 1 -- 172.21.15.7:0/1136007440 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d4015de40 msgr2=0x7f2d4015e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:22.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.951+0000 7f2d459f9640 1 --2- 172.21.15.7:0/1136007440 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d4015de40 0x7f2d4015e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:22.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.951+0000 7f2d459f9640 1 -- 172.21.15.7:0/1136007440 >> v1:172.21.15.55:6789/0 conn(0x7f2d40161d70 legacy=0x7f2d400ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:22.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.951+0000 7f2d459f9640 1 -- 172.21.15.7:0/1136007440 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d40161850 con 0x7f2d4015da60 2024-04-25T09:56:22.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.951+0000 7f2d459f9640 1 --2- 172.21.15.7:0/1136007440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d4015da60 0x7f2d400d0aa0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c009870 tx=0x7f2d3c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=809d7db9c4de9397 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:22.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.952+0000 7f2d449f7640 1 -- 172.21.15.7:0/1136007440 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c037070 con 0x7f2d4015da60 2024-04-25T09:56:22.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.952+0000 7f2d449f7640 1 -- 172.21.15.7:0/1136007440 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3c032440 con 0x7f2d4015da60 2024-04-25T09:56:22.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.952+0000 7f2d449f7640 1 -- 172.21.15.7:0/1136007440 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c032810 con 0x7f2d4015da60 2024-04-25T09:56:22.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.952+0000 7f2d47c5d640 1 -- 172.21.15.7:0/1136007440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d4015da60 msgr2=0x7f2d400d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:22.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.952+0000 7f2d47c5d640 1 --2- 172.21.15.7:0/1136007440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d4015da60 0x7f2d400d0aa0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c009870 tx=0x7f2d3c02a1c0 comp rx=0 tx=0).stop 2024-04-25T09:56:22.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.952+0000 7f2d47c5d640 1 -- 172.21.15.7:0/1136007440 shutdown_connections 2024-04-25T09:56:22.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.952+0000 7f2d47c5d640 1 --2- 172.21.15.7:0/1136007440 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d4015de40 0x7f2d4015e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:22.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.952+0000 7f2d47c5d640 1 --2- 172.21.15.7:0/1136007440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d4015da60 0x7f2d400d0aa0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:22.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.952+0000 7f2d47c5d640 1 -- 172.21.15.7:0/1136007440 >> 172.21.15.7:0/1136007440 conn(0x7f2d4006bfe0 msgr2=0x7f2d4006c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:22.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.952+0000 7f2d47c5d640 1 -- 172.21.15.7:0/1136007440 shutdown_connections 2024-04-25T09:56:22.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.952+0000 7f2d47c5d640 1 -- 172.21.15.7:0/1136007440 wait complete. 2024-04-25T09:56:22.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.953+0000 7f2d47c5d640 1 Processor -- start 2024-04-25T09:56:22.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.954+0000 7f2d47c5d640 1 -- start start 2024-04-25T09:56:22.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.954+0000 7f2d47c5d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d4015da60 0x7f2d400cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:22.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.954+0000 7f2d47c5d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d4015de40 0x7f2d400c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:22.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.954+0000 7f2d47c5d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d40161d70 0x7f2d400cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:22.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.954+0000 7f2d47c5d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d401621e0 con 0x7f2d4015da60 2024-04-25T09:56:22.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.954+0000 7f2d47c5d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d40162360 con 0x7f2d40161d70 2024-04-25T09:56:22.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.954+0000 7f2d47c5d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d401624e0 con 0x7f2d4015de40 2024-04-25T09:56:22.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.954+0000 7f2d459f9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d4015da60 0x7f2d400cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:22.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.954+0000 7f2d459f9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d4015da60 0x7f2d400cb2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56860/0 (socket says 172.21.15.7:56860) 2024-04-25T09:56:22.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.955+0000 7f2d459f9640 1 -- 172.21.15.7:0/4116096902 learned_addr learned my addr 172.21.15.7:0/4116096902 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:22.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.955+0000 7f2d451f8640 1 --2- 172.21.15.7:0/4116096902 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d4015de40 0x7f2d400c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:22.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.955+0000 7f2d461fa640 1 --2- 172.21.15.7:0/4116096902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d40161d70 0x7f2d400cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:22.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.955+0000 7f2d459f9640 1 -- 172.21.15.7:0/4116096902 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d4015de40 msgr2=0x7f2d400c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:22.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.955+0000 7f2d459f9640 1 --2- 172.21.15.7:0/4116096902 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d4015de40 0x7f2d400c94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:22.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.955+0000 7f2d459f9640 1 -- 172.21.15.7:0/4116096902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d40161d70 msgr2=0x7f2d400cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:22.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.955+0000 7f2d459f9640 1 --2- 172.21.15.7:0/4116096902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d40161d70 0x7f2d400cd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:22.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.955+0000 7f2d459f9640 1 -- 172.21.15.7:0/4116096902 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d400c9a10 con 0x7f2d4015da60 2024-04-25T09:56:22.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.955+0000 7f2d461fa640 1 --2- 172.21.15.7:0/4116096902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d40161d70 0x7f2d400cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:22.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.955+0000 7f2d459f9640 1 --2- 172.21.15.7:0/4116096902 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d4015da60 0x7f2d400cb2e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c000c00 tx=0x7f2d3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:22.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.955+0000 7f2d367fc640 1 -- 172.21.15.7:0/4116096902 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c041020 con 0x7f2d4015da60 2024-04-25T09:56:22.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.955+0000 7f2d367fc640 1 -- 172.21.15.7:0/4116096902 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3c0306c0 con 0x7f2d4015da60 2024-04-25T09:56:22.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.955+0000 7f2d47c5d640 1 -- 172.21.15.7:0/4116096902 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d400cd820 con 0x7f2d4015da60 2024-04-25T09:56:22.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.955+0000 7f2d367fc640 1 -- 172.21.15.7:0/4116096902 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c037040 con 0x7f2d4015da60 2024-04-25T09:56:22.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.955+0000 7f2d47c5d640 1 -- 172.21.15.7:0/4116096902 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d400cbbd0 con 0x7f2d4015da60 2024-04-25T09:56:22.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.956+0000 7f2d47c5d640 1 -- 172.21.15.7:0/4116096902 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d40068070 con 0x7f2d4015da60 2024-04-25T09:56:22.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.957+0000 7f2d367fc640 1 -- 172.21.15.7:0/4116096902 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2d3c044020 con 0x7f2d4015da60 2024-04-25T09:56:22.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.957+0000 7f2d367fc640 1 --2- 172.21.15.7:0/4116096902 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d2406b4d0 0x7f2d2406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:22.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.957+0000 7f2d367fc640 1 -- 172.21.15.7:0/4116096902 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2d3c0aab30 con 0x7f2d4015da60 2024-04-25T09:56:22.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.957+0000 7f2d451f8640 1 --2- 172.21.15.7:0/4116096902 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d2406b4d0 0x7f2d2406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:22.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.958+0000 7f2d451f8640 1 --2- 172.21.15.7:0/4116096902 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d2406b4d0 0x7f2d2406d990 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2d400cb820 tx=0x7f2d30008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:22.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:22.961+0000 7f2d367fc640 1 -- 172.21.15.7:0/4116096902 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2d40068070 con 0x7f2d4015da60 2024-04-25T09:56:23.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.138+0000 7f2d47c5d640 1 -- 172.21.15.7:0/4116096902 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2d40068fd0 con 0x7f2d2406b4d0 2024-04-25T09:56:23.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.144+0000 7f2d367fc640 1 -- 172.21.15.7:0/4116096902 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251909 (secure 0 0 0) 0x7f2d40068fd0 con 0x7f2d2406b4d0 2024-04-25T09:56:23.149 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:23.150 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T09:56:23.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.147+0000 7f2d47c5d640 1 -- 172.21.15.7:0/4116096902 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d2406b4d0 msgr2=0x7f2d2406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:23.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.147+0000 7f2d47c5d640 1 --2- 172.21.15.7:0/4116096902 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d2406b4d0 0x7f2d2406d990 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2d400cb820 tx=0x7f2d30008040 comp rx=0 tx=0).stop 2024-04-25T09:56:23.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.147+0000 7f2d47c5d640 1 -- 172.21.15.7:0/4116096902 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d4015da60 msgr2=0x7f2d400cb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:23.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.147+0000 7f2d47c5d640 1 --2- 172.21.15.7:0/4116096902 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d4015da60 0x7f2d400cb2e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c000c00 tx=0x7f2d3c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:56:23.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.147+0000 7f2d47c5d640 1 -- 172.21.15.7:0/4116096902 shutdown_connections 2024-04-25T09:56:23.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.147+0000 7f2d47c5d640 1 --2- 172.21.15.7:0/4116096902 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d2406b4d0 0x7f2d2406d990 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:23.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.147+0000 7f2d47c5d640 1 --2- 172.21.15.7:0/4116096902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d40161d70 0x7f2d400cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:23.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.147+0000 7f2d47c5d640 1 --2- 172.21.15.7:0/4116096902 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d4015de40 0x7f2d400c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:23.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.147+0000 7f2d47c5d640 1 --2- 172.21.15.7:0/4116096902 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d4015da60 0x7f2d400cb2e0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:23.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.147+0000 7f2d47c5d640 1 -- 172.21.15.7:0/4116096902 >> 172.21.15.7:0/4116096902 conn(0x7f2d4006bfe0 msgr2=0x7f2d401602d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:23.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.147+0000 7f2d47c5d640 1 -- 172.21.15.7:0/4116096902 shutdown_connections 2024-04-25T09:56:23.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.147+0000 7f2d47c5d640 1 -- 172.21.15.7:0/4116096902 wait complete. 2024-04-25T09:56:23.161 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2024-04-25T09:56:21.877956+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255368,"kb_used_data":5928,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754719352,"statfs":{"total":773094113280,"available":772832616448,"internally_reserved":0,"allocated":6070272,"data_stored":3319876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.487568"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.866356+0000","last_change":"2024-04-25T09:56:15.413314+0000","last_active":"2024-04-25T09:56:17.866356+0000","last_peered":"2024-04-25T09:56:17.866356+0000","last_clean":"2024-04-25T09:56:17.866356+0000","last_became_active":"2024-04-25T09:56:15.413013+0000","last_became_peered":"2024-04-25T09:56:15.413013+0000","last_unstale":"2024-04-25T09:56:17.866356+0000","last_undegraded":"2024-04-25T09:56:17.866356+0000","last_fullsized":"2024-04-25T09:56:17.866356+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:24.780346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.241266+0000","last_change":"2024-04-25T09:56:15.414664+0000","last_active":"2024-04-25T09:56:17.241266+0000","last_peered":"2024-04-25T09:56:17.241266+0000","last_clean":"2024-04-25T09:56:17.241266+0000","last_became_active":"2024-04-25T09:56:15.414291+0000","last_became_peered":"2024-04-25T09:56:15.414291+0000","last_unstale":"2024-04-25T09:56:17.241266+0000","last_undegraded":"2024-04-25T09:56:17.241266+0000","last_fullsized":"2024-04-25T09:56:17.241266+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:33.332153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.766060+0000","last_change":"2024-04-25T09:56:15.412913+0000","last_active":"2024-04-25T09:56:16.766060+0000","last_peered":"2024-04-25T09:56:16.766060+0000","last_clean":"2024-04-25T09:56:16.766060+0000","last_became_active":"2024-04-25T09:56:15.412631+0000","last_became_peered":"2024-04-25T09:56:15.412631+0000","last_unstale":"2024-04-25T09:56:16.766060+0000","last_undegraded":"2024-04-25T09:56:16.766060+0000","last_fullsized":"2024-04-25T09:56:16.766060+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:54.085294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.241267+0000","last_change":"2024-04-25T09:56:15.413750+0000","last_active":"2024-04-25T09:56:17.241267+0000","last_peered":"2024-04-25T09:56:17.241267+0000","last_clean":"2024-04-25T09:56:17.241267+0000","last_became_active":"2024-04-25T09:56:15.413442+0000","last_became_peered":"2024-04-25T09:56:15.413442+0000","last_unstale":"2024-04-25T09:56:17.241267+0000","last_undegraded":"2024-04-25T09:56:17.241267+0000","last_fullsized":"2024-04-25T09:56:17.241267+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:37.345279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.866901+0000","last_change":"2024-04-25T09:56:15.403689+0000","last_active":"2024-04-25T09:56:17.866901+0000","last_peered":"2024-04-25T09:56:17.866901+0000","last_clean":"2024-04-25T09:56:17.866901+0000","last_became_active":"2024-04-25T09:56:15.403310+0000","last_became_peered":"2024-04-25T09:56:15.403310+0000","last_unstale":"2024-04-25T09:56:17.866901+0000","last_undegraded":"2024-04-25T09:56:17.866901+0000","last_fullsized":"2024-04-25T09:56:17.866901+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:40.524761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.866232+0000","last_change":"2024-04-25T09:56:15.421658+0000","last_active":"2024-04-25T09:56:17.866232+0000","last_peered":"2024-04-25T09:56:17.866232+0000","last_clean":"2024-04-25T09:56:17.866232+0000","last_became_active":"2024-04-25T09:56:15.421323+0000","last_became_peered":"2024-04-25T09:56:15.421323+0000","last_unstale":"2024-04-25T09:56:17.866232+0000","last_undegraded":"2024-04-25T09:56:17.866232+0000","last_fullsized":"2024-04-25T09:56:17.866232+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:08.074490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.765669+0000","last_change":"2024-04-25T09:56:15.414014+0000","last_active":"2024-04-25T09:56:16.765669+0000","last_peered":"2024-04-25T09:56:16.765669+0000","last_clean":"2024-04-25T09:56:16.765669+0000","last_became_active":"2024-04-25T09:56:15.413725+0000","last_became_peered":"2024-04-25T09:56:15.413725+0000","last_unstale":"2024-04-25T09:56:16.765669+0000","last_undegraded":"2024-04-25T09:56:16.765669+0000","last_fullsized":"2024-04-25T09:56:16.765669+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:25:09.831193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.394543+0000","last_change":"2024-04-25T09:56:15.407898+0000","last_active":"2024-04-25T09:56:16.394543+0000","last_peered":"2024-04-25T09:56:16.394543+0000","last_clean":"2024-04-25T09:56:16.394543+0000","last_became_active":"2024-04-25T09:56:15.407601+0000","last_became_peered":"2024-04-25T09:56:15.407601+0000","last_unstale":"2024-04-25T09:56:16.394543+0000","last_undegraded":"2024-04-25T09:56:16.394543+0000","last_fullsized":"2024-04-25T09:56:16.394543+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:55.790250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.394646+0000","last_change":"2024-04-25T09:56:15.408112+0000","last_active":"2024-04-25T09:56:16.394646+0000","last_peered":"2024-04-25T09:56:16.394646+0000","last_clean":"2024-04-25T09:56:16.394646+0000","last_became_active":"2024-04-25T09:56:15.407737+0000","last_became_peered":"2024-04-25T09:56:15.407737+0000","last_unstale":"2024-04-25T09:56:16.394646+0000","last_undegraded":"2024-04-25T09:56:16.394646+0000","last_fullsized":"2024-04-25T09:56:16.394646+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:25.719200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.866398+0000","last_change":"2024-04-25T09:56:15.416053+0000","last_active":"2024-04-25T09:56:17.866398+0000","last_peered":"2024-04-25T09:56:17.866398+0000","last_clean":"2024-04-25T09:56:17.866398+0000","last_became_active":"2024-04-25T09:56:15.415796+0000","last_became_peered":"2024-04-25T09:56:15.415796+0000","last_unstale":"2024-04-25T09:56:17.866398+0000","last_undegraded":"2024-04-25T09:56:17.866398+0000","last_fullsized":"2024-04-25T09:56:17.866398+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:30:23.231562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.399430+0000","last_change":"2024-04-25T09:56:15.418742+0000","last_active":"2024-04-25T09:56:16.399430+0000","last_peered":"2024-04-25T09:56:16.399430+0000","last_clean":"2024-04-25T09:56:16.399430+0000","last_became_active":"2024-04-25T09:56:15.418442+0000","last_became_peered":"2024-04-25T09:56:15.418442+0000","last_unstale":"2024-04-25T09:56:16.399430+0000","last_undegraded":"2024-04-25T09:56:16.399430+0000","last_fullsized":"2024-04-25T09:56:16.399430+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:17.367984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.394623+0000","last_change":"2024-04-25T09:56:15.407702+0000","last_active":"2024-04-25T09:56:16.394623+0000","last_peered":"2024-04-25T09:56:16.394623+0000","last_clean":"2024-04-25T09:56:16.394623+0000","last_became_active":"2024-04-25T09:56:15.407411+0000","last_became_peered":"2024-04-25T09:56:15.407411+0000","last_unstale":"2024-04-25T09:56:16.394623+0000","last_undegraded":"2024-04-25T09:56:16.394623+0000","last_fullsized":"2024-04-25T09:56:16.394623+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:54.085294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.866241+0000","last_change":"2024-04-25T09:56:15.416711+0000","last_active":"2024-04-25T09:56:17.866241+0000","last_peered":"2024-04-25T09:56:17.866241+0000","last_clean":"2024-04-25T09:56:17.866241+0000","last_became_active":"2024-04-25T09:56:15.416437+0000","last_became_peered":"2024-04-25T09:56:15.416437+0000","last_unstale":"2024-04-25T09:56:17.866241+0000","last_undegraded":"2024-04-25T09:56:17.866241+0000","last_fullsized":"2024-04-25T09:56:17.866241+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:35.961223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.765905+0000","last_change":"2024-04-25T09:56:15.416372+0000","last_active":"2024-04-25T09:56:16.765905+0000","last_peered":"2024-04-25T09:56:16.765905+0000","last_clean":"2024-04-25T09:56:16.765905+0000","last_became_active":"2024-04-25T09:56:15.416100+0000","last_became_peered":"2024-04-25T09:56:15.416100+0000","last_unstale":"2024-04-25T09:56:16.765905+0000","last_undegraded":"2024-04-25T09:56:16.765905+0000","last_fullsized":"2024-04-25T09:56:16.765905+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:16.281218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.240877+0000","last_change":"2024-04-25T09:56:15.412875+0000","last_active":"2024-04-25T09:56:17.240877+0000","last_peered":"2024-04-25T09:56:17.240877+0000","last_clean":"2024-04-25T09:56:17.240877+0000","last_became_active":"2024-04-25T09:56:15.410551+0000","last_became_peered":"2024-04-25T09:56:15.410551+0000","last_unstale":"2024-04-25T09:56:17.240877+0000","last_undegraded":"2024-04-25T09:56:17.240877+0000","last_fullsized":"2024-04-25T09:56:17.240877+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:57.464568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.866085+0000","last_change":"2024-04-25T09:56:15.415031+0000","last_active":"2024-04-25T09:56:17.866085+0000","last_peered":"2024-04-25T09:56:17.866085+0000","last_clean":"2024-04-25T09:56:17.866085+0000","last_became_active":"2024-04-25T09:56:15.414693+0000","last_became_peered":"2024-04-25T09:56:15.414693+0000","last_unstale":"2024-04-25T09:56:17.866085+0000","last_undegraded":"2024-04-25T09:56:17.866085+0000","last_fullsized":"2024-04-25T09:56:17.866085+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:57.405816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.766252+0000","last_change":"2024-04-25T09:56:15.420132+0000","last_active":"2024-04-25T09:56:16.766252+0000","last_peered":"2024-04-25T09:56:16.766252+0000","last_clean":"2024-04-25T09:56:16.766252+0000","last_became_active":"2024-04-25T09:56:15.419809+0000","last_became_peered":"2024-04-25T09:56:15.419809+0000","last_unstale":"2024-04-25T09:56:16.766252+0000","last_undegraded":"2024-04-25T09:56:16.766252+0000","last_fullsized":"2024-04-25T09:56:16.766252+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:31.047999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.241295+0000","last_change":"2024-04-25T09:56:15.415498+0000","last_active":"2024-04-25T09:56:17.241295+0000","last_peered":"2024-04-25T09:56:17.241295+0000","last_clean":"2024-04-25T09:56:17.241295+0000","last_became_active":"2024-04-25T09:56:15.415058+0000","last_became_peered":"2024-04-25T09:56:15.415058+0000","last_unstale":"2024-04-25T09:56:17.241295+0000","last_undegraded":"2024-04-25T09:56:17.241295+0000","last_fullsized":"2024-04-25T09:56:17.241295+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:10.549821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.766036+0000","last_change":"2024-04-25T09:56:15.414843+0000","last_active":"2024-04-25T09:56:16.766036+0000","last_peered":"2024-04-25T09:56:16.766036+0000","last_clean":"2024-04-25T09:56:16.766036+0000","last_became_active":"2024-04-25T09:56:15.414578+0000","last_became_peered":"2024-04-25T09:56:15.414578+0000","last_unstale":"2024-04-25T09:56:16.766036+0000","last_undegraded":"2024-04-25T09:56:16.766036+0000","last_fullsized":"2024-04-25T09:56:16.766036+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:25.719200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.932753+0000","last_change":"2024-04-25T09:56:15.415691+0000","last_active":"2024-04-25T09:56:16.932753+0000","last_peered":"2024-04-25T09:56:16.932753+0000","last_clean":"2024-04-25T09:56:16.932753+0000","last_became_active":"2024-04-25T09:56:15.410685+0000","last_became_peered":"2024-04-25T09:56:15.410685+0000","last_unstale":"2024-04-25T09:56:16.932753+0000","last_undegraded":"2024-04-25T09:56:16.932753+0000","last_fullsized":"2024-04-25T09:56:16.932753+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:08.074490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.932682+0000","last_change":"2024-04-25T09:56:15.406055+0000","last_active":"2024-04-25T09:56:16.932682+0000","last_peered":"2024-04-25T09:56:16.932682+0000","last_clean":"2024-04-25T09:56:16.932682+0000","last_became_active":"2024-04-25T09:56:15.405683+0000","last_became_peered":"2024-04-25T09:56:15.405683+0000","last_unstale":"2024-04-25T09:56:16.932682+0000","last_undegraded":"2024-04-25T09:56:16.932682+0000","last_fullsized":"2024-04-25T09:56:16.932682+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:52.399587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.394283+0000","last_change":"2024-04-25T09:56:15.407180+0000","last_active":"2024-04-25T09:56:16.394283+0000","last_peered":"2024-04-25T09:56:16.394283+0000","last_clean":"2024-04-25T09:56:16.394283+0000","last_became_active":"2024-04-25T09:56:15.406867+0000","last_became_peered":"2024-04-25T09:56:15.406867+0000","last_unstale":"2024-04-25T09:56:16.394283+0000","last_undegraded":"2024-04-25T09:56:16.394283+0000","last_fullsized":"2024-04-25T09:56:16.394283+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:16.281218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.399282+0000","last_change":"2024-04-25T09:56:15.420542+0000","last_active":"2024-04-25T09:56:16.399282+0000","last_peered":"2024-04-25T09:56:16.399282+0000","last_clean":"2024-04-25T09:56:16.399282+0000","last_became_active":"2024-04-25T09:56:15.420236+0000","last_became_peered":"2024-04-25T09:56:15.420236+0000","last_unstale":"2024-04-25T09:56:16.399282+0000","last_undegraded":"2024-04-25T09:56:16.399282+0000","last_fullsized":"2024-04-25T09:56:16.399282+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:14.123944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.765634+0000","last_change":"2024-04-25T09:56:15.417391+0000","last_active":"2024-04-25T09:56:16.765634+0000","last_peered":"2024-04-25T09:56:16.765634+0000","last_clean":"2024-04-25T09:56:16.765634+0000","last_became_active":"2024-04-25T09:56:15.417090+0000","last_became_peered":"2024-04-25T09:56:15.417090+0000","last_unstale":"2024-04-25T09:56:16.765634+0000","last_undegraded":"2024-04-25T09:56:16.765634+0000","last_fullsized":"2024-04-25T09:56:16.765634+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:27.100795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.766343+0000","last_change":"2024-04-25T09:56:15.412106+0000","last_active":"2024-04-25T09:56:16.766343+0000","last_peered":"2024-04-25T09:56:16.766343+0000","last_clean":"2024-04-25T09:56:16.766343+0000","last_became_active":"2024-04-25T09:56:15.411776+0000","last_became_peered":"2024-04-25T09:56:15.411776+0000","last_unstale":"2024-04-25T09:56:16.766343+0000","last_undegraded":"2024-04-25T09:56:16.766343+0000","last_fullsized":"2024-04-25T09:56:16.766343+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:43.649734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.394579+0000","last_change":"2024-04-25T09:56:15.425702+0000","last_active":"2024-04-25T09:56:16.394579+0000","last_peered":"2024-04-25T09:56:16.394579+0000","last_clean":"2024-04-25T09:56:16.394579+0000","last_became_active":"2024-04-25T09:56:15.425449+0000","last_became_peered":"2024-04-25T09:56:15.425449+0000","last_unstale":"2024-04-25T09:56:16.394579+0000","last_undegraded":"2024-04-25T09:56:16.394579+0000","last_fullsized":"2024-04-25T09:56:16.394579+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:45.634015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.866516+0000","last_change":"2024-04-25T09:56:15.415905+0000","last_active":"2024-04-25T09:56:17.866516+0000","last_peered":"2024-04-25T09:56:17.866516+0000","last_clean":"2024-04-25T09:56:17.866516+0000","last_became_active":"2024-04-25T09:56:15.415643+0000","last_became_peered":"2024-04-25T09:56:15.415643+0000","last_unstale":"2024-04-25T09:56:17.866516+0000","last_undegraded":"2024-04-25T09:56:17.866516+0000","last_fullsized":"2024-04-25T09:56:17.866516+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:33.332153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.932848+0000","last_change":"2024-04-25T09:56:15.416284+0000","last_active":"2024-04-25T09:56:16.932848+0000","last_peered":"2024-04-25T09:56:16.932848+0000","last_clean":"2024-04-25T09:56:16.932848+0000","last_became_active":"2024-04-25T09:56:15.416000+0000","last_became_peered":"2024-04-25T09:56:15.416000+0000","last_unstale":"2024-04-25T09:56:16.932848+0000","last_undegraded":"2024-04-25T09:56:16.932848+0000","last_fullsized":"2024-04-25T09:56:16.932848+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:26.649129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.765831+0000","last_change":"2024-04-25T09:56:15.412543+0000","last_active":"2024-04-25T09:56:16.765831+0000","last_peered":"2024-04-25T09:56:16.765831+0000","last_clean":"2024-04-25T09:56:16.765831+0000","last_became_active":"2024-04-25T09:56:15.411532+0000","last_became_peered":"2024-04-25T09:56:15.411532+0000","last_unstale":"2024-04-25T09:56:16.765831+0000","last_undegraded":"2024-04-25T09:56:16.765831+0000","last_fullsized":"2024-04-25T09:56:16.765831+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:58.624827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.241137+0000","last_change":"2024-04-25T09:56:15.406771+0000","last_active":"2024-04-25T09:56:17.241137+0000","last_peered":"2024-04-25T09:56:17.241137+0000","last_clean":"2024-04-25T09:56:17.241137+0000","last_became_active":"2024-04-25T09:56:15.406430+0000","last_became_peered":"2024-04-25T09:56:15.406430+0000","last_unstale":"2024-04-25T09:56:17.241137+0000","last_undegraded":"2024-04-25T09:56:17.241137+0000","last_fullsized":"2024-04-25T09:56:17.241137+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:39.614891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.765727+0000","last_change":"2024-04-25T09:56:15.415527+0000","last_active":"2024-04-25T09:56:16.765727+0000","last_peered":"2024-04-25T09:56:16.765727+0000","last_clean":"2024-04-25T09:56:16.765727+0000","last_became_active":"2024-04-25T09:56:15.415263+0000","last_became_peered":"2024-04-25T09:56:15.415263+0000","last_unstale":"2024-04-25T09:56:16.765727+0000","last_undegraded":"2024-04-25T09:56:16.765727+0000","last_fullsized":"2024-04-25T09:56:16.765727+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:09:45.343630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.465438+0000","last_change":"2024-04-25T09:56:15.408712+0000","last_active":"2024-04-25T09:56:16.465438+0000","last_peered":"2024-04-25T09:56:16.465438+0000","last_clean":"2024-04-25T09:56:16.465438+0000","last_became_active":"2024-04-25T09:56:15.408367+0000","last_became_peered":"2024-04-25T09:56:15.408367+0000","last_unstale":"2024-04-25T09:56:16.465438+0000","last_undegraded":"2024-04-25T09:56:16.465438+0000","last_fullsized":"2024-04-25T09:56:16.465438+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:30:23.231562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.240842+0000","last_change":"2024-04-25T09:56:15.417224+0000","last_active":"2024-04-25T09:56:17.240842+0000","last_peered":"2024-04-25T09:56:17.240842+0000","last_clean":"2024-04-25T09:56:17.240842+0000","last_became_active":"2024-04-25T09:56:15.415334+0000","last_became_peered":"2024-04-25T09:56:15.415334+0000","last_unstale":"2024-04-25T09:56:17.240842+0000","last_undegraded":"2024-04-25T09:56:17.240842+0000","last_fullsized":"2024-04-25T09:56:17.240842+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:35.961223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.932871+0000","last_change":"2024-04-25T09:56:14.413604+0000","last_active":"2024-04-25T09:56:16.932871+0000","last_peered":"2024-04-25T09:56:16.932871+0000","last_clean":"2024-04-25T09:56:16.932871+0000","last_became_active":"2024-04-25T09:56:14.413289+0000","last_became_peered":"2024-04-25T09:56:14.413289+0000","last_unstale":"2024-04-25T09:56:16.932871+0000","last_undegraded":"2024-04-25T09:56:16.932871+0000","last_fullsized":"2024-04-25T09:56:16.932871+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:42.555560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.465520+0000","last_change":"2024-04-25T09:56:15.407627+0000","last_active":"2024-04-25T09:56:16.465520+0000","last_peered":"2024-04-25T09:56:16.465520+0000","last_clean":"2024-04-25T09:56:16.465520+0000","last_became_active":"2024-04-25T09:56:15.407321+0000","last_became_peered":"2024-04-25T09:56:15.407321+0000","last_unstale":"2024-04-25T09:56:16.465520+0000","last_undegraded":"2024-04-25T09:56:16.465520+0000","last_fullsized":"2024-04-25T09:56:16.465520+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:33.332153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.866495+0000","last_change":"2024-04-25T09:56:14.407748+0000","last_active":"2024-04-25T09:56:17.866495+0000","last_peered":"2024-04-25T09:56:17.866495+0000","last_clean":"2024-04-25T09:56:17.866495+0000","last_became_active":"2024-04-25T09:56:14.407486+0000","last_became_peered":"2024-04-25T09:56:14.407486+0000","last_unstale":"2024-04-25T09:56:17.866495+0000","last_undegraded":"2024-04-25T09:56:17.866495+0000","last_fullsized":"2024-04-25T09:56:17.866495+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:02.173295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.932660+0000","last_change":"2024-04-25T09:56:15.414659+0000","last_active":"2024-04-25T09:56:16.932660+0000","last_peered":"2024-04-25T09:56:16.932660+0000","last_clean":"2024-04-25T09:56:16.932660+0000","last_became_active":"2024-04-25T09:56:15.410616+0000","last_became_peered":"2024-04-25T09:56:15.410616+0000","last_unstale":"2024-04-25T09:56:16.932660+0000","last_undegraded":"2024-04-25T09:56:16.932660+0000","last_fullsized":"2024-04-25T09:56:16.932660+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:57.405816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.866510+0000","last_change":"2024-04-25T09:56:14.408749+0000","last_active":"2024-04-25T09:56:17.866510+0000","last_peered":"2024-04-25T09:56:17.866510+0000","last_clean":"2024-04-25T09:56:17.866510+0000","last_became_active":"2024-04-25T09:56:14.408402+0000","last_became_peered":"2024-04-25T09:56:14.408402+0000","last_unstale":"2024-04-25T09:56:17.866510+0000","last_undegraded":"2024-04-25T09:56:17.866510+0000","last_fullsized":"2024-04-25T09:56:17.866510+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:31.472024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.394294+0000","last_change":"2024-04-25T09:56:15.414549+0000","last_active":"2024-04-25T09:56:16.394294+0000","last_peered":"2024-04-25T09:56:16.394294+0000","last_clean":"2024-04-25T09:56:16.394294+0000","last_became_active":"2024-04-25T09:56:15.414282+0000","last_became_peered":"2024-04-25T09:56:15.414282+0000","last_unstale":"2024-04-25T09:56:16.394294+0000","last_undegraded":"2024-04-25T09:56:16.394294+0000","last_fullsized":"2024-04-25T09:56:16.394294+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:58.624827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.465817+0000","last_change":"2024-04-25T09:56:14.416066+0000","last_active":"2024-04-25T09:56:16.465817+0000","last_peered":"2024-04-25T09:56:16.465817+0000","last_clean":"2024-04-25T09:56:16.465817+0000","last_became_active":"2024-04-25T09:56:14.415761+0000","last_became_peered":"2024-04-25T09:56:14.415761+0000","last_unstale":"2024-04-25T09:56:16.465817+0000","last_undegraded":"2024-04-25T09:56:16.465817+0000","last_fullsized":"2024-04-25T09:56:16.465817+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:51.655284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.867136+0000","last_change":"2024-04-25T09:56:15.405699+0000","last_active":"2024-04-25T09:56:17.867136+0000","last_peered":"2024-04-25T09:56:17.867136+0000","last_clean":"2024-04-25T09:56:17.867136+0000","last_became_active":"2024-04-25T09:56:15.405415+0000","last_became_peered":"2024-04-25T09:56:15.405415+0000","last_unstale":"2024-04-25T09:56:17.867136+0000","last_undegraded":"2024-04-25T09:56:17.867136+0000","last_fullsized":"2024-04-25T09:56:17.867136+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:52.657234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.765862+0000","last_change":"2024-04-25T09:56:14.411984+0000","last_active":"2024-04-25T09:56:16.765862+0000","last_peered":"2024-04-25T09:56:16.765862+0000","last_clean":"2024-04-25T09:56:16.765862+0000","last_became_active":"2024-04-25T09:56:14.411230+0000","last_became_peered":"2024-04-25T09:56:14.411230+0000","last_unstale":"2024-04-25T09:56:16.765862+0000","last_undegraded":"2024-04-25T09:56:16.765862+0000","last_fullsized":"2024-04-25T09:56:16.765862+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:43.308611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.241059+0000","last_change":"2024-04-25T09:56:15.409846+0000","last_active":"2024-04-25T09:56:17.241059+0000","last_peered":"2024-04-25T09:56:17.241059+0000","last_clean":"2024-04-25T09:56:17.241059+0000","last_became_active":"2024-04-25T09:56:15.409530+0000","last_became_peered":"2024-04-25T09:56:15.409530+0000","last_unstale":"2024-04-25T09:56:17.241059+0000","last_undegraded":"2024-04-25T09:56:17.241059+0000","last_fullsized":"2024-04-25T09:56:17.241059+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:24.780346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.866601+0000","last_change":"2024-04-25T09:56:14.411589+0000","last_active":"2024-04-25T09:56:17.866601+0000","last_peered":"2024-04-25T09:56:17.866601+0000","last_clean":"2024-04-25T09:56:17.866601+0000","last_became_active":"2024-04-25T09:56:14.411266+0000","last_became_peered":"2024-04-25T09:56:14.411266+0000","last_unstale":"2024-04-25T09:56:17.866601+0000","last_undegraded":"2024-04-25T09:56:17.866601+0000","last_fullsized":"2024-04-25T09:56:17.866601+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:02.173295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.394770+0000","last_change":"2024-04-25T09:56:15.424950+0000","last_active":"2024-04-25T09:56:16.394770+0000","last_peered":"2024-04-25T09:56:16.394770+0000","last_clean":"2024-04-25T09:56:16.394770+0000","last_became_active":"2024-04-25T09:56:15.424124+0000","last_became_peered":"2024-04-25T09:56:15.424124+0000","last_unstale":"2024-04-25T09:56:16.394770+0000","last_undegraded":"2024-04-25T09:56:16.394770+0000","last_fullsized":"2024-04-25T09:56:16.394770+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:20.228444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.932528+0000","last_change":"2024-04-25T09:56:14.413373+0000","last_active":"2024-04-25T09:56:16.932528+0000","last_peered":"2024-04-25T09:56:16.932528+0000","last_clean":"2024-04-25T09:56:16.932528+0000","last_became_active":"2024-04-25T09:56:14.413066+0000","last_became_peered":"2024-04-25T09:56:14.413066+0000","last_unstale":"2024-04-25T09:56:16.932528+0000","last_undegraded":"2024-04-25T09:56:16.932528+0000","last_fullsized":"2024-04-25T09:56:16.932528+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:02.173295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.241078+0000","last_change":"2024-04-25T09:56:15.409215+0000","last_active":"2024-04-25T09:56:17.241078+0000","last_peered":"2024-04-25T09:56:17.241078+0000","last_clean":"2024-04-25T09:56:17.241078+0000","last_became_active":"2024-04-25T09:56:15.408934+0000","last_became_peered":"2024-04-25T09:56:15.408934+0000","last_unstale":"2024-04-25T09:56:17.241078+0000","last_undegraded":"2024-04-25T09:56:17.241078+0000","last_fullsized":"2024-04-25T09:56:17.241078+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:30:23.231562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.765608+0000","last_change":"2024-04-25T09:56:14.409931+0000","last_active":"2024-04-25T09:56:16.765608+0000","last_peered":"2024-04-25T09:56:16.765608+0000","last_clean":"2024-04-25T09:56:16.765608+0000","last_became_active":"2024-04-25T09:56:14.409653+0000","last_became_peered":"2024-04-25T09:56:14.409653+0000","last_unstale":"2024-04-25T09:56:16.765608+0000","last_undegraded":"2024-04-25T09:56:16.765608+0000","last_fullsized":"2024-04-25T09:56:16.765608+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:25:16.172738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.866876+0000","last_change":"2024-04-25T09:56:15.404379+0000","last_active":"2024-04-25T09:56:17.866876+0000","last_peered":"2024-04-25T09:56:17.866876+0000","last_clean":"2024-04-25T09:56:17.866876+0000","last_became_active":"2024-04-25T09:56:15.404111+0000","last_became_peered":"2024-04-25T09:56:15.404111+0000","last_unstale":"2024-04-25T09:56:17.866876+0000","last_undegraded":"2024-04-25T09:56:17.866876+0000","last_fullsized":"2024-04-25T09:56:17.866876+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:34.121647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.241141+0000","last_change":"2024-04-25T09:56:14.415504+0000","last_active":"2024-04-25T09:56:17.241141+0000","last_peered":"2024-04-25T09:56:17.241141+0000","last_clean":"2024-04-25T09:56:17.241141+0000","last_became_active":"2024-04-25T09:56:14.414650+0000","last_became_peered":"2024-04-25T09:56:14.414650+0000","last_unstale":"2024-04-25T09:56:17.241141+0000","last_undegraded":"2024-04-25T09:56:17.241141+0000","last_fullsized":"2024-04-25T09:56:17.241141+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:43.308611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.465452+0000","last_change":"2024-04-25T09:56:15.409591+0000","last_active":"2024-04-25T09:56:16.465452+0000","last_peered":"2024-04-25T09:56:16.465452+0000","last_clean":"2024-04-25T09:56:16.465452+0000","last_became_active":"2024-04-25T09:56:15.409263+0000","last_became_peered":"2024-04-25T09:56:15.409263+0000","last_unstale":"2024-04-25T09:56:16.465452+0000","last_undegraded":"2024-04-25T09:56:16.465452+0000","last_fullsized":"2024-04-25T09:56:16.465452+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:10.549821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.866973+0000","last_change":"2024-04-25T09:56:14.412591+0000","last_active":"2024-04-25T09:56:17.866973+0000","last_peered":"2024-04-25T09:56:17.866973+0000","last_clean":"2024-04-25T09:56:17.866973+0000","last_became_active":"2024-04-25T09:56:14.412210+0000","last_became_peered":"2024-04-25T09:56:14.412210+0000","last_unstale":"2024-04-25T09:56:17.866973+0000","last_undegraded":"2024-04-25T09:56:17.866973+0000","last_fullsized":"2024-04-25T09:56:17.866973+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:02.560063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.765961+0000","last_change":"2024-04-25T09:56:15.411878+0000","last_active":"2024-04-25T09:56:16.765961+0000","last_peered":"2024-04-25T09:56:16.765961+0000","last_clean":"2024-04-25T09:56:16.765961+0000","last_became_active":"2024-04-25T09:56:15.411588+0000","last_became_peered":"2024-04-25T09:56:15.411588+0000","last_unstale":"2024-04-25T09:56:16.765961+0000","last_undegraded":"2024-04-25T09:56:16.765961+0000","last_fullsized":"2024-04-25T09:56:16.765961+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:51.292196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.241183+0000","last_change":"2024-04-25T09:56:14.416329+0000","last_active":"2024-04-25T09:56:17.241183+0000","last_peered":"2024-04-25T09:56:17.241183+0000","last_clean":"2024-04-25T09:56:17.241183+0000","last_became_active":"2024-04-25T09:56:14.416028+0000","last_became_peered":"2024-04-25T09:56:14.416028+0000","last_unstale":"2024-04-25T09:56:17.241183+0000","last_undegraded":"2024-04-25T09:56:17.241183+0000","last_fullsized":"2024-04-25T09:56:17.241183+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:10.545063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.866985+0000","last_change":"2024-04-25T09:56:15.413056+0000","last_active":"2024-04-25T09:56:17.866985+0000","last_peered":"2024-04-25T09:56:17.866985+0000","last_clean":"2024-04-25T09:56:17.866985+0000","last_became_active":"2024-04-25T09:56:15.412739+0000","last_became_peered":"2024-04-25T09:56:15.412739+0000","last_unstale":"2024-04-25T09:56:17.866985+0000","last_undegraded":"2024-04-25T09:56:17.866985+0000","last_fullsized":"2024-04-25T09:56:17.866985+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:19.710411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.394647+0000","last_change":"2024-04-25T09:56:14.408541+0000","last_active":"2024-04-25T09:56:16.394647+0000","last_peered":"2024-04-25T09:56:16.394647+0000","last_clean":"2024-04-25T09:56:16.394647+0000","last_became_active":"2024-04-25T09:56:14.407599+0000","last_became_peered":"2024-04-25T09:56:14.407599+0000","last_unstale":"2024-04-25T09:56:16.394647+0000","last_undegraded":"2024-04-25T09:56:16.394647+0000","last_fullsized":"2024-04-25T09:56:16.394647+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:23.778395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.465672+0000","last_change":"2024-04-25T09:56:15.407624+0000","last_active":"2024-04-25T09:56:16.465672+0000","last_peered":"2024-04-25T09:56:16.465672+0000","last_clean":"2024-04-25T09:56:16.465672+0000","last_became_active":"2024-04-25T09:56:15.407295+0000","last_became_peered":"2024-04-25T09:56:15.407295+0000","last_unstale":"2024-04-25T09:56:16.465672+0000","last_undegraded":"2024-04-25T09:56:16.465672+0000","last_fullsized":"2024-04-25T09:56:16.465672+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:37.345279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.765982+0000","last_change":"2024-04-25T09:56:14.412434+0000","last_active":"2024-04-25T09:56:16.765982+0000","last_peered":"2024-04-25T09:56:16.765982+0000","last_clean":"2024-04-25T09:56:16.765982+0000","last_became_active":"2024-04-25T09:56:14.411639+0000","last_became_peered":"2024-04-25T09:56:14.411639+0000","last_unstale":"2024-04-25T09:56:16.765982+0000","last_undegraded":"2024-04-25T09:56:16.765982+0000","last_fullsized":"2024-04-25T09:56:16.765982+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:33.119696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.766208+0000","last_change":"2024-04-25T09:56:15.410973+0000","last_active":"2024-04-25T09:56:16.766208+0000","last_peered":"2024-04-25T09:56:16.766208+0000","last_clean":"2024-04-25T09:56:16.766208+0000","last_became_active":"2024-04-25T09:56:15.410657+0000","last_became_peered":"2024-04-25T09:56:15.410657+0000","last_unstale":"2024-04-25T09:56:16.766208+0000","last_undegraded":"2024-04-25T09:56:16.766208+0000","last_fullsized":"2024-04-25T09:56:16.766208+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:24:05.374091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.932548+0000","last_change":"2024-04-25T09:56:14.417041+0000","last_active":"2024-04-25T09:56:16.932548+0000","last_peered":"2024-04-25T09:56:16.932548+0000","last_clean":"2024-04-25T09:56:16.932548+0000","last_became_active":"2024-04-25T09:56:14.416523+0000","last_became_peered":"2024-04-25T09:56:14.416523+0000","last_unstale":"2024-04-25T09:56:16.932548+0000","last_undegraded":"2024-04-25T09:56:16.932548+0000","last_fullsized":"2024-04-25T09:56:16.932548+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:48.390619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.394755+0000","last_change":"2024-04-25T09:56:15.406269+0000","last_active":"2024-04-25T09:56:16.394755+0000","last_peered":"2024-04-25T09:56:16.394755+0000","last_clean":"2024-04-25T09:56:16.394755+0000","last_became_active":"2024-04-25T09:56:15.405901+0000","last_became_peered":"2024-04-25T09:56:15.405901+0000","last_unstale":"2024-04-25T09:56:16.394755+0000","last_undegraded":"2024-04-25T09:56:16.394755+0000","last_fullsized":"2024-04-25T09:56:16.394755+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:31.047999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.240993+0000","last_change":"2024-04-25T09:56:14.413069+0000","last_active":"2024-04-25T09:56:17.240993+0000","last_peered":"2024-04-25T09:56:17.240993+0000","last_clean":"2024-04-25T09:56:17.240993+0000","last_became_active":"2024-04-25T09:56:14.412763+0000","last_became_peered":"2024-04-25T09:56:14.412763+0000","last_unstale":"2024-04-25T09:56:17.240993+0000","last_undegraded":"2024-04-25T09:56:17.240993+0000","last_fullsized":"2024-04-25T09:56:17.240993+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:55.577682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.766256+0000","last_change":"2024-04-25T09:56:15.422107+0000","last_active":"2024-04-25T09:56:16.766256+0000","last_peered":"2024-04-25T09:56:16.766256+0000","last_clean":"2024-04-25T09:56:16.766256+0000","last_became_active":"2024-04-25T09:56:15.421034+0000","last_became_peered":"2024-04-25T09:56:15.421034+0000","last_unstale":"2024-04-25T09:56:16.766256+0000","last_undegraded":"2024-04-25T09:56:16.766256+0000","last_fullsized":"2024-04-25T09:56:16.766256+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:20.228444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.394480+0000","last_change":"2024-04-25T09:56:14.409356+0000","last_active":"2024-04-25T09:56:16.394480+0000","last_peered":"2024-04-25T09:56:16.394480+0000","last_clean":"2024-04-25T09:56:16.394480+0000","last_became_active":"2024-04-25T09:56:14.409096+0000","last_became_peered":"2024-04-25T09:56:14.409096+0000","last_unstale":"2024-04-25T09:56:16.394480+0000","last_undegraded":"2024-04-25T09:56:16.394480+0000","last_fullsized":"2024-04-25T09:56:16.394480+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:56.462617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.394373+0000","last_change":"2024-04-25T09:56:15.408883+0000","last_active":"2024-04-25T09:56:16.394373+0000","last_peered":"2024-04-25T09:56:16.394373+0000","last_clean":"2024-04-25T09:56:16.394373+0000","last_became_active":"2024-04-25T09:56:15.408568+0000","last_became_peered":"2024-04-25T09:56:15.408568+0000","last_unstale":"2024-04-25T09:56:16.394373+0000","last_undegraded":"2024-04-25T09:56:16.394373+0000","last_fullsized":"2024-04-25T09:56:16.394373+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:51.292196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.766319+0000","last_change":"2024-04-25T09:56:14.405032+0000","last_active":"2024-04-25T09:56:16.766319+0000","last_peered":"2024-04-25T09:56:16.766319+0000","last_clean":"2024-04-25T09:56:16.766319+0000","last_became_active":"2024-04-25T09:56:14.404522+0000","last_became_peered":"2024-04-25T09:56:14.404522+0000","last_unstale":"2024-04-25T09:56:16.766319+0000","last_undegraded":"2024-04-25T09:56:16.766319+0000","last_fullsized":"2024-04-25T09:56:16.766319+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:39.522811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.866100+0000","last_change":"2024-04-25T09:56:15.416574+0000","last_active":"2024-04-25T09:56:17.866100+0000","last_peered":"2024-04-25T09:56:17.866100+0000","last_clean":"2024-04-25T09:56:17.866100+0000","last_became_active":"2024-04-25T09:56:15.416306+0000","last_became_peered":"2024-04-25T09:56:15.416306+0000","last_unstale":"2024-04-25T09:56:17.866100+0000","last_undegraded":"2024-04-25T09:56:17.866100+0000","last_fullsized":"2024-04-25T09:56:17.866100+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:52.399587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.399459+0000","last_change":"2024-04-25T09:56:14.412352+0000","last_active":"2024-04-25T09:56:16.399459+0000","last_peered":"2024-04-25T09:56:16.399459+0000","last_clean":"2024-04-25T09:56:16.399459+0000","last_became_active":"2024-04-25T09:56:14.412017+0000","last_became_peered":"2024-04-25T09:56:14.412017+0000","last_unstale":"2024-04-25T09:56:16.399459+0000","last_undegraded":"2024-04-25T09:56:16.399459+0000","last_fullsized":"2024-04-25T09:56:16.399459+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:36.729733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.866713+0000","last_change":"2024-04-25T09:56:15.414094+0000","last_active":"2024-04-25T09:56:17.866713+0000","last_peered":"2024-04-25T09:56:17.866713+0000","last_clean":"2024-04-25T09:56:17.866713+0000","last_became_active":"2024-04-25T09:56:15.413821+0000","last_became_peered":"2024-04-25T09:56:15.413821+0000","last_unstale":"2024-04-25T09:56:17.866713+0000","last_undegraded":"2024-04-25T09:56:17.866713+0000","last_fullsized":"2024-04-25T09:56:17.866713+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:44.310561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.932923+0000","last_change":"2024-04-25T09:56:14.410213+0000","last_active":"2024-04-25T09:56:16.932923+0000","last_peered":"2024-04-25T09:56:16.932923+0000","last_clean":"2024-04-25T09:56:16.932923+0000","last_became_active":"2024-04-25T09:56:14.409924+0000","last_became_peered":"2024-04-25T09:56:14.409924+0000","last_unstale":"2024-04-25T09:56:16.932923+0000","last_undegraded":"2024-04-25T09:56:16.932923+0000","last_fullsized":"2024-04-25T09:56:16.932923+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:10.545063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.866259+0000","last_change":"2024-04-25T09:56:15.415421+0000","last_active":"2024-04-25T09:56:17.866259+0000","last_peered":"2024-04-25T09:56:17.866259+0000","last_clean":"2024-04-25T09:56:17.866259+0000","last_became_active":"2024-04-25T09:56:15.414889+0000","last_became_peered":"2024-04-25T09:56:15.414889+0000","last_unstale":"2024-04-25T09:56:17.866259+0000","last_undegraded":"2024-04-25T09:56:17.866259+0000","last_fullsized":"2024-04-25T09:56:17.866259+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:57.464568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.932877+0000","last_change":"2024-04-25T09:56:14.406144+0000","last_active":"2024-04-25T09:56:16.932877+0000","last_peered":"2024-04-25T09:56:16.932877+0000","last_clean":"2024-04-25T09:56:16.932877+0000","last_became_active":"2024-04-25T09:56:14.405807+0000","last_became_peered":"2024-04-25T09:56:14.405807+0000","last_unstale":"2024-04-25T09:56:16.932877+0000","last_undegraded":"2024-04-25T09:56:16.932877+0000","last_fullsized":"2024-04-25T09:56:16.932877+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:31.472024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.465708+0000","last_change":"2024-04-25T09:56:15.409815+0000","last_active":"2024-04-25T09:56:16.465708+0000","last_peered":"2024-04-25T09:56:16.465708+0000","last_clean":"2024-04-25T09:56:16.465708+0000","last_became_active":"2024-04-25T09:56:15.409514+0000","last_became_peered":"2024-04-25T09:56:15.409514+0000","last_unstale":"2024-04-25T09:56:16.465708+0000","last_undegraded":"2024-04-25T09:56:16.465708+0000","last_fullsized":"2024-04-25T09:56:16.465708+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:40.950569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.866369+0000","last_change":"2024-04-25T09:56:14.406874+0000","last_active":"2024-04-25T09:56:17.866369+0000","last_peered":"2024-04-25T09:56:17.866369+0000","last_clean":"2024-04-25T09:56:17.866369+0000","last_became_active":"2024-04-25T09:56:14.406576+0000","last_became_peered":"2024-04-25T09:56:14.406576+0000","last_unstale":"2024-04-25T09:56:17.866369+0000","last_undegraded":"2024-04-25T09:56:17.866369+0000","last_fullsized":"2024-04-25T09:56:17.866369+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:02.560063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.932965+0000","last_change":"2024-04-25T09:56:15.410149+0000","last_active":"2024-04-25T09:56:16.932965+0000","last_peered":"2024-04-25T09:56:16.932965+0000","last_clean":"2024-04-25T09:56:16.932965+0000","last_became_active":"2024-04-25T09:56:15.409859+0000","last_became_peered":"2024-04-25T09:56:15.409859+0000","last_unstale":"2024-04-25T09:56:16.932965+0000","last_undegraded":"2024-04-25T09:56:16.932965+0000","last_fullsized":"2024-04-25T09:56:16.932965+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:35.961223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.394274+0000","last_change":"2024-04-25T09:56:14.406954+0000","last_active":"2024-04-25T09:56:16.394274+0000","last_peered":"2024-04-25T09:56:16.394274+0000","last_clean":"2024-04-25T09:56:16.394274+0000","last_became_active":"2024-04-25T09:56:14.406675+0000","last_became_peered":"2024-04-25T09:56:14.406675+0000","last_unstale":"2024-04-25T09:56:16.394274+0000","last_undegraded":"2024-04-25T09:56:16.394274+0000","last_fullsized":"2024-04-25T09:56:16.394274+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:07.072539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.766037+0000","last_change":"2024-04-25T09:56:15.412136+0000","last_active":"2024-04-25T09:56:16.766037+0000","last_peered":"2024-04-25T09:56:16.766037+0000","last_clean":"2024-04-25T09:56:16.766037+0000","last_became_active":"2024-04-25T09:56:15.411855+0000","last_became_peered":"2024-04-25T09:56:15.411855+0000","last_unstale":"2024-04-25T09:56:16.766037+0000","last_undegraded":"2024-04-25T09:56:16.766037+0000","last_fullsized":"2024-04-25T09:56:16.766037+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:45.634015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.765829+0000","last_change":"2024-04-25T09:56:14.406606+0000","last_active":"2024-04-25T09:56:16.765829+0000","last_peered":"2024-04-25T09:56:16.765829+0000","last_clean":"2024-04-25T09:56:16.765829+0000","last_became_active":"2024-04-25T09:56:14.406331+0000","last_became_peered":"2024-04-25T09:56:14.406331+0000","last_unstale":"2024-04-25T09:56:16.765829+0000","last_undegraded":"2024-04-25T09:56:16.765829+0000","last_fullsized":"2024-04-25T09:56:16.765829+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:55.577682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.866398+0000","last_change":"2024-04-25T09:56:15.420737+0000","last_active":"2024-04-25T09:56:17.866398+0000","last_peered":"2024-04-25T09:56:17.866398+0000","last_clean":"2024-04-25T09:56:17.866398+0000","last_became_active":"2024-04-25T09:56:15.420375+0000","last_became_peered":"2024-04-25T09:56:15.420375+0000","last_unstale":"2024-04-25T09:56:17.866398+0000","last_undegraded":"2024-04-25T09:56:17.866398+0000","last_fullsized":"2024-04-25T09:56:17.866398+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:39.614891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.399168+0000","last_change":"2024-04-25T09:56:14.414276+0000","last_active":"2024-04-25T09:56:16.399168+0000","last_peered":"2024-04-25T09:56:16.399168+0000","last_clean":"2024-04-25T09:56:16.399168+0000","last_became_active":"2024-04-25T09:56:14.413964+0000","last_became_peered":"2024-04-25T09:56:14.413964+0000","last_unstale":"2024-04-25T09:56:16.399168+0000","last_undegraded":"2024-04-25T09:56:16.399168+0000","last_fullsized":"2024-04-25T09:56:16.399168+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:48.779510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.465723+0000","last_change":"2024-04-25T09:56:15.409393+0000","last_active":"2024-04-25T09:56:16.465723+0000","last_peered":"2024-04-25T09:56:16.465723+0000","last_clean":"2024-04-25T09:56:16.465723+0000","last_became_active":"2024-04-25T09:56:15.409064+0000","last_became_peered":"2024-04-25T09:56:15.409064+0000","last_unstale":"2024-04-25T09:56:16.465723+0000","last_undegraded":"2024-04-25T09:56:16.465723+0000","last_fullsized":"2024-04-25T09:56:16.465723+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:13.495223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.932907+0000","last_change":"2024-04-25T09:56:14.415037+0000","last_active":"2024-04-25T09:56:16.932907+0000","last_peered":"2024-04-25T09:56:16.932907+0000","last_clean":"2024-04-25T09:56:16.932907+0000","last_became_active":"2024-04-25T09:56:14.414744+0000","last_became_peered":"2024-04-25T09:56:14.414744+0000","last_unstale":"2024-04-25T09:56:16.932907+0000","last_undegraded":"2024-04-25T09:56:16.932907+0000","last_fullsized":"2024-04-25T09:56:16.932907+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:02.560063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.866234+0000","last_change":"2024-04-25T09:56:15.414080+0000","last_active":"2024-04-25T09:56:17.866234+0000","last_peered":"2024-04-25T09:56:17.866234+0000","last_clean":"2024-04-25T09:56:17.866234+0000","last_became_active":"2024-04-25T09:56:15.413751+0000","last_became_peered":"2024-04-25T09:56:15.413751+0000","last_unstale":"2024-04-25T09:56:17.866234+0000","last_undegraded":"2024-04-25T09:56:17.866234+0000","last_fullsized":"2024-04-25T09:56:17.866234+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:26.649129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.241220+0000","last_change":"2024-04-25T09:56:14.415403+0000","last_active":"2024-04-25T09:56:17.241220+0000","last_peered":"2024-04-25T09:56:17.241220+0000","last_clean":"2024-04-25T09:56:17.241220+0000","last_became_active":"2024-04-25T09:56:14.414434+0000","last_became_peered":"2024-04-25T09:56:14.414434+0000","last_unstale":"2024-04-25T09:56:17.241220+0000","last_undegraded":"2024-04-25T09:56:17.241220+0000","last_fullsized":"2024-04-25T09:56:17.241220+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:25:16.172738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.394328+0000","last_change":"2024-04-25T09:56:15.402818+0000","last_active":"2024-04-25T09:56:16.394328+0000","last_peered":"2024-04-25T09:56:16.394328+0000","last_clean":"2024-04-25T09:56:16.394328+0000","last_became_active":"2024-04-25T09:56:15.402539+0000","last_became_peered":"2024-04-25T09:56:15.402539+0000","last_unstale":"2024-04-25T09:56:16.394328+0000","last_undegraded":"2024-04-25T09:56:16.394328+0000","last_fullsized":"2024-04-25T09:56:16.394328+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:03.435993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.765985+0000","last_change":"2024-04-25T09:56:14.414412+0000","last_active":"2024-04-25T09:56:16.765985+0000","last_peered":"2024-04-25T09:56:16.765985+0000","last_clean":"2024-04-25T09:56:16.765985+0000","last_became_active":"2024-04-25T09:56:14.413362+0000","last_became_peered":"2024-04-25T09:56:14.413362+0000","last_unstale":"2024-04-25T09:56:16.765985+0000","last_undegraded":"2024-04-25T09:56:16.765985+0000","last_fullsized":"2024-04-25T09:56:16.765985+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:51.655284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.765934+0000","last_change":"2024-04-25T09:56:15.424040+0000","last_active":"2024-04-25T09:56:16.765934+0000","last_peered":"2024-04-25T09:56:16.765934+0000","last_clean":"2024-04-25T09:56:16.765934+0000","last_became_active":"2024-04-25T09:56:15.423744+0000","last_became_peered":"2024-04-25T09:56:15.423744+0000","last_unstale":"2024-04-25T09:56:16.765934+0000","last_undegraded":"2024-04-25T09:56:16.765934+0000","last_fullsized":"2024-04-25T09:56:16.765934+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:03.435993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.394390+0000","last_change":"2024-04-25T09:56:14.408232+0000","last_active":"2024-04-25T09:56:16.394390+0000","last_peered":"2024-04-25T09:56:16.394390+0000","last_clean":"2024-04-25T09:56:16.394390+0000","last_became_active":"2024-04-25T09:56:14.407536+0000","last_became_peered":"2024-04-25T09:56:14.407536+0000","last_unstale":"2024-04-25T09:56:16.394390+0000","last_undegraded":"2024-04-25T09:56:16.394390+0000","last_fullsized":"2024-04-25T09:56:16.394390+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:34.959272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.465510+0000","last_change":"2024-04-25T09:56:15.416647+0000","last_active":"2024-04-25T09:56:16.465510+0000","last_peered":"2024-04-25T09:56:16.465510+0000","last_clean":"2024-04-25T09:56:16.465510+0000","last_became_active":"2024-04-25T09:56:15.416335+0000","last_became_peered":"2024-04-25T09:56:15.416335+0000","last_unstale":"2024-04-25T09:56:16.465510+0000","last_undegraded":"2024-04-25T09:56:16.465510+0000","last_fullsized":"2024-04-25T09:56:16.465510+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:39.614891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.394382+0000","last_change":"2024-04-25T09:56:14.413483+0000","last_active":"2024-04-25T09:56:16.394382+0000","last_peered":"2024-04-25T09:56:16.394382+0000","last_clean":"2024-04-25T09:56:16.394382+0000","last_became_active":"2024-04-25T09:56:14.413153+0000","last_became_peered":"2024-04-25T09:56:14.413153+0000","last_unstale":"2024-04-25T09:56:16.394382+0000","last_undegraded":"2024-04-25T09:56:16.394382+0000","last_fullsized":"2024-04-25T09:56:16.394382+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:25.647178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.766027+0000","last_change":"2024-04-25T09:56:15.424157+0000","last_active":"2024-04-25T09:56:16.766027+0000","last_peered":"2024-04-25T09:56:16.766027+0000","last_clean":"2024-04-25T09:56:16.766027+0000","last_became_active":"2024-04-25T09:56:15.423791+0000","last_became_peered":"2024-04-25T09:56:15.423791+0000","last_unstale":"2024-04-25T09:56:16.766027+0000","last_undegraded":"2024-04-25T09:56:16.766027+0000","last_fullsized":"2024-04-25T09:56:16.766027+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:55.790250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.866563+0000","last_change":"2024-04-25T09:56:14.411470+0000","last_active":"2024-04-25T09:56:17.866563+0000","last_peered":"2024-04-25T09:56:17.866563+0000","last_clean":"2024-04-25T09:56:17.866563+0000","last_became_active":"2024-04-25T09:56:14.411162+0000","last_became_peered":"2024-04-25T09:56:14.411162+0000","last_unstale":"2024-04-25T09:56:17.866563+0000","last_undegraded":"2024-04-25T09:56:17.866563+0000","last_fullsized":"2024-04-25T09:56:17.866563+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:42.555560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.394730+0000","last_change":"2024-04-25T09:56:15.426910+0000","last_active":"2024-04-25T09:56:16.394730+0000","last_peered":"2024-04-25T09:56:16.394730+0000","last_clean":"2024-04-25T09:56:16.394730+0000","last_became_active":"2024-04-25T09:56:15.426082+0000","last_became_peered":"2024-04-25T09:56:15.426082+0000","last_unstale":"2024-04-25T09:56:16.394730+0000","last_undegraded":"2024-04-25T09:56:16.394730+0000","last_fullsized":"2024-04-25T09:56:16.394730+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:24:05.374091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.465686+0000","last_change":"2024-04-25T09:56:14.410884+0000","last_active":"2024-04-25T09:56:16.465686+0000","last_peered":"2024-04-25T09:56:16.465686+0000","last_clean":"2024-04-25T09:56:16.465686+0000","last_became_active":"2024-04-25T09:56:14.410576+0000","last_became_peered":"2024-04-25T09:56:14.410576+0000","last_unstale":"2024-04-25T09:56:16.465686+0000","last_undegraded":"2024-04-25T09:56:16.465686+0000","last_fullsized":"2024-04-25T09:56:16.465686+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:18.708460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.932590+0000","last_change":"2024-04-25T09:56:15.408216+0000","last_active":"2024-04-25T09:56:16.932590+0000","last_peered":"2024-04-25T09:56:16.932590+0000","last_clean":"2024-04-25T09:56:16.932590+0000","last_became_active":"2024-04-25T09:56:15.407935+0000","last_became_peered":"2024-04-25T09:56:15.407935+0000","last_unstale":"2024-04-25T09:56:16.932590+0000","last_undegraded":"2024-04-25T09:56:16.932590+0000","last_fullsized":"2024-04-25T09:56:16.932590+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:14.381591+0000","last_clean_scrub_stamp":"2024-04-25T09:56:14.381591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:05.088117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"51'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:16.766147+0000","last_change":"2024-04-25T09:56:14.415709+0000","last_active":"2024-04-25T09:56:16.766147+0000","last_peered":"2024-04-25T09:56:16.766147+0000","last_clean":"2024-04-25T09:56:16.766147+0000","last_became_active":"2024-04-25T09:56:14.415165+0000","last_became_peered":"2024-04-25T09:56:14.415165+0000","last_unstale":"2024-04-25T09:56:16.766147+0000","last_undegraded":"2024-04-25T09:56:16.766147+0000","last_fullsized":"2024-04-25T09:56:16.766147+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:56:13.379641+0000","last_clean_scrub_stamp":"2024-04-25T09:56:13.379641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:18.708460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":223,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:56:17.240620+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T09:56:17.240620+0000","last_peered":"2024-04-25T09:56:17.240620+0000","last_clean":"2024-04-25T09:56:17.240620+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T09:56:17.240620+0000","last_undegraded":"2024-04-25T09:56:17.240620+0000","last_fullsized":"2024-04-25T09:56:17.240620+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542172,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1204224,"data_stored":857282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542172,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31776,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340064,"statfs":{"total":96636764160,"available":96604225536,"internally_reserved":0,"allocated":610304,"data_stored":267442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542174,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31768,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":602112,"data_stored":266790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542171,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":606208,"data_stored":267372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31784,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340056,"statfs":{"total":96636764160,"available":96604217344,"internally_reserved":0,"allocated":618496,"data_stored":268424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":614400,"data_stored":268402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31776,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340064,"statfs":{"total":96636764160,"available":96604225536,"internally_reserved":0,"allocated":610304,"data_stored":266950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1204224,"data_stored":857214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:56:23.165 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:56:23.165 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:56:23.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.305+0000 7f543168f640 1 Processor -- start 2024-04-25T09:56:23.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.305+0000 7f543168f640 1 -- start start 2024-04-25T09:56:23.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.306+0000 7f543168f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f542c15db00 0x7f542c0d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:23.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.306+0000 7f543168f640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f542c0d1e80 con 0x7f542c0b53b0 2024-04-25T09:56:23.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.306+0000 7f543168f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f542c162490 con 0x7f542c0ce2b0 2024-04-25T09:56:23.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.306+0000 7f543168f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f542c0b5930 con 0x7f542c15db00 2024-04-25T09:56:23.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.306+0000 7f542a7fc640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f542c0b53b0 0x7f542c161670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:32966/0 (socket says 172.21.15.7:32966) 2024-04-25T09:56:23.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.306+0000 7f542a7fc640 1 -- 172.21.15.7:0/547853857 learned_addr learned my addr 172.21.15.7:0/547853857 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:56:23.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.306+0000 7f5429ffb640 1 -- 172.21.15.7:0/547853857 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3019876992 0 0) 0x7f542c0d1e80 con 0x7f542c0b53b0 2024-04-25T09:56:23.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.306+0000 7f542affd640 1 --2- 172.21.15.7:0/547853857 >> v2:172.21.15.55:3300/0 conn(0x7f542c15db00 0x7f542c0d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.307+0000 7f5429ffb640 1 -- 172.21.15.7:0/547853857 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5418003520 con 0x7f542c0b53b0 2024-04-25T09:56:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.307+0000 7f5429ffb640 1 -- 172.21.15.7:0/547853857 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4291218936 0 0) 0x7f5418003520 con 0x7f542c0b53b0 2024-04-25T09:56:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.307+0000 7f5429ffb640 1 -- 172.21.15.7:0/547853857 >> v2:172.21.15.55:3300/0 conn(0x7f542c15db00 msgr2=0x7f542c0d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.307+0000 7f5429ffb640 1 --2- 172.21.15.7:0/547853857 >> v2:172.21.15.55:3300/0 conn(0x7f542c15db00 0x7f542c0d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.307+0000 7f5429ffb640 1 -- 172.21.15.7:0/547853857 >> v1:172.21.15.55:6789/0 conn(0x7f542c0ce2b0 legacy=0x7f542c161d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.307+0000 7f5429ffb640 1 -- 172.21.15.7:0/547853857 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542c0b5c10 con 0x7f542c0b53b0 2024-04-25T09:56:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.307+0000 7f5429ffb640 1 -- 172.21.15.7:0/547853857 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f5414001670 con 0x7f542c0b53b0 2024-04-25T09:56:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.307+0000 7f5429ffb640 1 -- 172.21.15.7:0/547853857 >> v1:172.21.15.7:6789/0 conn(0x7f542c0b53b0 legacy=0x7f542c161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.307+0000 7f5429ffb640 1 --2- 172.21.15.7:0/547853857 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f54180039b0 0x7f5418003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.307+0000 7f5429ffb640 1 --2- 172.21.15.7:0/547853857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5418004800 0x7f5418004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.307+0000 7f5429ffb640 1 --2- 172.21.15.7:0/547853857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54180051c0 0x7f541800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.307+0000 7f5429ffb640 1 -- 172.21.15.7:0/547853857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542c0b5930 con 0x7f54180051c0 2024-04-25T09:56:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.307+0000 7f5429ffb640 1 -- 172.21.15.7:0/547853857 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541800c060 con 0x7f5418004800 2024-04-25T09:56:23.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.307+0000 7f5429ffb640 1 -- 172.21.15.7:0/547853857 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541800c260 con 0x7f54180039b0 2024-04-25T09:56:23.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.307+0000 7f542b7fe640 1 --2- 172.21.15.7:0/547853857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54180051c0 0x7f541800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:23.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.307+0000 7f542affd640 1 --2- 172.21.15.7:0/547853857 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f54180039b0 0x7f5418003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:23.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.307+0000 7f542a7fc640 1 --2- 172.21.15.7:0/547853857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5418004800 0x7f5418004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:23.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.307+0000 7f542b7fe640 1 -- 172.21.15.7:0/547853857 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f54180039b0 msgr2=0x7f5418003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:23.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.307+0000 7f542b7fe640 1 --2- 172.21.15.7:0/547853857 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f54180039b0 0x7f5418003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:23.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.307+0000 7f542b7fe640 1 -- 172.21.15.7:0/547853857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5418004800 msgr2=0x7f5418004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:23.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.307+0000 7f542b7fe640 1 --2- 172.21.15.7:0/547853857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5418004800 0x7f5418004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:23.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.307+0000 7f542b7fe640 1 -- 172.21.15.7:0/547853857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5418003520 con 0x7f54180051c0 2024-04-25T09:56:23.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.308+0000 7f542b7fe640 1 -- 172.21.15.7:0/547853857 reap_dead start 2024-04-25T09:56:23.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.308+0000 7f542b7fe640 1 --2- 172.21.15.7:0/547853857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54180051c0 0x7f541800b9c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f541c001750 tx=0x7f5418005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da06275e2bf02cf2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:23.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.308+0000 7f5429ffb640 1 -- 172.21.15.7:0/547853857 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c001370 con 0x7f54180051c0 2024-04-25T09:56:23.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.308+0000 7f5429ffb640 1 -- 172.21.15.7:0/547853857 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541c005310 con 0x7f54180051c0 2024-04-25T09:56:23.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.308+0000 7f5429ffb640 1 -- 172.21.15.7:0/547853857 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c02abe0 con 0x7f54180051c0 2024-04-25T09:56:23.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.309+0000 7f543168f640 1 -- 172.21.15.7:0/547853857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54180051c0 msgr2=0x7f541800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:23.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.309+0000 7f543168f640 1 --2- 172.21.15.7:0/547853857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54180051c0 0x7f541800b9c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f541c001750 tx=0x7f5418005830 comp rx=0 tx=0).stop 2024-04-25T09:56:23.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.309+0000 7f543168f640 1 -- 172.21.15.7:0/547853857 shutdown_connections 2024-04-25T09:56:23.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.309+0000 7f543168f640 1 --2- 172.21.15.7:0/547853857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54180051c0 0x7f541800b9c0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:23.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.309+0000 7f543168f640 1 -- 172.21.15.7:0/547853857 >> 172.21.15.7:0/547853857 conn(0x7f542c072290 msgr2=0x7f542c0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:23.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.309+0000 7f543168f640 1 -- 172.21.15.7:0/547853857 shutdown_connections 2024-04-25T09:56:23.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.309+0000 7f543168f640 1 -- 172.21.15.7:0/547853857 wait complete. 2024-04-25T09:56:23.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.310+0000 7f543168f640 1 Processor -- start 2024-04-25T09:56:23.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.310+0000 7f543168f640 1 -- start start 2024-04-25T09:56:23.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.311+0000 7f543168f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54180051c0 0x7f542c15c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:23.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.311+0000 7f543168f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f542c152920 0x7f542c152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:23.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.311+0000 7f543168f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f542c0cc970 0x7f542c0cce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:23.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.311+0000 7f543168f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542c0b61d0 con 0x7f542c0cc970 2024-04-25T09:56:23.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.311+0000 7f543168f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542c15dee0 con 0x7f54180051c0 2024-04-25T09:56:23.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.311+0000 7f543168f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542c0d3660 con 0x7f542c152920 2024-04-25T09:56:23.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.311+0000 7f542b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f542c0cc970 0x7f542c0cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:23.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.311+0000 7f542b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f542c0cc970 0x7f542c0cce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56880/0 (socket says 172.21.15.7:56880) 2024-04-25T09:56:23.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.311+0000 7f542b7fe640 1 -- 172.21.15.7:0/2816226109 learned_addr learned my addr 172.21.15.7:0/2816226109 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:23.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.311+0000 7f542a7fc640 1 --2- 172.21.15.7:0/2816226109 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f542c152920 0x7f542c152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:23.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.311+0000 7f542affd640 1 --2- 172.21.15.7:0/2816226109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54180051c0 0x7f542c15c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:23.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.311+0000 7f542b7fe640 1 -- 172.21.15.7:0/2816226109 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f542c152920 msgr2=0x7f542c152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:23.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.311+0000 7f542b7fe640 1 --2- 172.21.15.7:0/2816226109 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f542c152920 0x7f542c152da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:23.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.311+0000 7f542b7fe640 1 -- 172.21.15.7:0/2816226109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54180051c0 msgr2=0x7f542c15c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:23.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.311+0000 7f542b7fe640 1 --2- 172.21.15.7:0/2816226109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54180051c0 0x7f542c15c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:23.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.311+0000 7f542b7fe640 1 -- 172.21.15.7:0/2816226109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542c160270 con 0x7f542c0cc970 2024-04-25T09:56:23.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.311+0000 7f542a7fc640 1 --2- 172.21.15.7:0/2816226109 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f542c152920 0x7f542c152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:23.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.312+0000 7f542b7fe640 1 --2- 172.21.15.7:0/2816226109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f542c0cc970 0x7f542c0cce20 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f541c001870 tx=0x7f541c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:23.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.312+0000 7f54237fe640 1 -- 172.21.15.7:0/2816226109 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c001370 con 0x7f542c0cc970 2024-04-25T09:56:23.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.312+0000 7f54237fe640 1 -- 172.21.15.7:0/2816226109 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541c02ae20 con 0x7f542c0cc970 2024-04-25T09:56:23.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.312+0000 7f543168f640 1 -- 172.21.15.7:0/2816226109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f542c1e7f20 con 0x7f542c0cc970 2024-04-25T09:56:23.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.312+0000 7f54237fe640 1 -- 172.21.15.7:0/2816226109 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c007a30 con 0x7f542c0cc970 2024-04-25T09:56:23.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.312+0000 7f543168f640 1 -- 172.21.15.7:0/2816226109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f542c1e84e0 con 0x7f542c0cc970 2024-04-25T09:56:23.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.313+0000 7f543168f640 1 -- 172.21.15.7:0/2816226109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f542c068fd0 con 0x7f542c0cc970 2024-04-25T09:56:23.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.313+0000 7f54237fe640 1 -- 172.21.15.7:0/2816226109 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f541c007030 con 0x7f542c0cc970 2024-04-25T09:56:23.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.314+0000 7f54237fe640 1 --2- 172.21.15.7:0/2816226109 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f540c06b4d0 0x7f540c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:23.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.314+0000 7f542affd640 1 --2- 172.21.15.7:0/2816226109 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f540c06b4d0 0x7f540c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:23.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.314+0000 7f54237fe640 1 -- 172.21.15.7:0/2816226109 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f541c0a95a0 con 0x7f542c0cc970 2024-04-25T09:56:23.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.314+0000 7f542affd640 1 --2- 172.21.15.7:0/2816226109 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f540c06b4d0 0x7f540c06d990 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f542c153370 tx=0x7f542400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:23.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.318+0000 7f54237fe640 1 -- 172.21.15.7:0/2816226109 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f541c077c40 con 0x7f542c0cc970 2024-04-25T09:56:23.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.572+0000 7f543168f640 1 -- 172.21.15.7:0/2816226109 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f542c0d16b0 con 0x7f542c0cc970 2024-04-25T09:56:23.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.575+0000 7f54237fe640 1 -- 172.21.15.7:0/2816226109 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+147 (secure 0 0 0) 0x7f541c07bce0 con 0x7f542c0cc970 2024-04-25T09:56:23.578 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2024-04-25T09:56:23.578 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAYKCpmaJKeORAALxC5ZqLLEu0zJFG+SOGukQ== 2024-04-25T09:56:23.578 INFO:teuthology.orchestra.run.smithi007.stdout: caps mds = "allow" 2024-04-25T09:56:23.578 INFO:teuthology.orchestra.run.smithi007.stdout: caps mon = "allow r" 2024-04-25T09:56:23.578 INFO:teuthology.orchestra.run.smithi007.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:56:23.578 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2024-04-25T09:56:23.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.577+0000 7f543168f640 1 -- 172.21.15.7:0/2816226109 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f540c06b4d0 msgr2=0x7f540c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:23.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.577+0000 7f543168f640 1 --2- 172.21.15.7:0/2816226109 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f540c06b4d0 0x7f540c06d990 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f542c153370 tx=0x7f542400b040 comp rx=0 tx=0).stop 2024-04-25T09:56:23.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.577+0000 7f543168f640 1 -- 172.21.15.7:0/2816226109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f542c0cc970 msgr2=0x7f542c0cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:23.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.577+0000 7f543168f640 1 --2- 172.21.15.7:0/2816226109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f542c0cc970 0x7f542c0cce20 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f541c001870 tx=0x7f541c001120 comp rx=0 tx=0).stop 2024-04-25T09:56:23.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.577+0000 7f543168f640 1 -- 172.21.15.7:0/2816226109 shutdown_connections 2024-04-25T09:56:23.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.577+0000 7f543168f640 1 --2- 172.21.15.7:0/2816226109 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f540c06b4d0 0x7f540c06d990 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:23.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.577+0000 7f543168f640 1 --2- 172.21.15.7:0/2816226109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f542c0cc970 0x7f542c0cce20 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:23.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.577+0000 7f543168f640 1 --2- 172.21.15.7:0/2816226109 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f542c152920 0x7f542c152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:23.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.577+0000 7f543168f640 1 --2- 172.21.15.7:0/2816226109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54180051c0 0x7f542c15c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:23.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.577+0000 7f543168f640 1 -- 172.21.15.7:0/2816226109 >> 172.21.15.7:0/2816226109 conn(0x7f542c072290 msgr2=0x7f542c0d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:23.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.577+0000 7f543168f640 1 -- 172.21.15.7:0/2816226109 shutdown_connections 2024-04-25T09:56:23.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.577+0000 7f543168f640 1 -- 172.21.15.7:0/2816226109 wait complete. 2024-04-25T09:56:23.591 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:56:23.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.689+0000 7f227d390640 1 Processor -- start 2024-04-25T09:56:23.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.689+0000 7f227d390640 1 -- start start 2024-04-25T09:56:23.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.690+0000 7f227d390640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2278145250 0x7f22780b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:23.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.690+0000 7f227d390640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f227815f490 0x7f227815f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:23.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.690+0000 7f227d390640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2278145630 con 0x7f22780afaa0 2024-04-25T09:56:23.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.690+0000 7f227d390640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f227815fe10 con 0x7f2278145250 2024-04-25T09:56:23.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.690+0000 7f227d390640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22780aff00 con 0x7f227815f490 2024-04-25T09:56:23.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.691+0000 7f2276ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2278145250 0x7f22780b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:23.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.691+0000 7f22777fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f227815f490 0x7f227815f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:23.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.691+0000 7f22777fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f227815f490 0x7f227815f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:38086/0 (socket says 172.21.15.7:38086) 2024-04-25T09:56:23.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.691+0000 7f2276ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2278145250 0x7f22780b4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:58700/0 (socket says 172.21.15.7:58700) 2024-04-25T09:56:23.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.691+0000 7f22767fc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f22780afaa0 0x7f22780d0e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:58464/0 (socket says 172.21.15.7:58464) 2024-04-25T09:56:23.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.691+0000 7f22777fe640 1 -- 172.21.15.7:0/1531526572 learned_addr learned my addr 172.21.15.7:0/1531526572 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:23.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.691+0000 7f22777fe640 1 -- 172.21.15.7:0/1531526572 >> v2:172.21.15.55:3300/0 conn(0x7f2278145250 msgr2=0x7f22780b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:23.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.691+0000 7f22777fe640 1 --2- 172.21.15.7:0/1531526572 >> v2:172.21.15.55:3300/0 conn(0x7f2278145250 0x7f22780b4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:23.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.691+0000 7f22777fe640 1 -- 172.21.15.7:0/1531526572 >> v1:172.21.15.55:6789/0 conn(0x7f22780afaa0 legacy=0x7f22780d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:23.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.691+0000 7f22777fe640 1 -- 172.21.15.7:0/1531526572 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22780b55b0 con 0x7f227815f490 2024-04-25T09:56:23.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.691+0000 7f2276ffd640 1 --2- 172.21.15.7:0/1531526572 >> v2:172.21.15.55:3300/0 conn(0x7f2278145250 0x7f22780b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:56:23.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.692+0000 7f22777fe640 1 --2- 172.21.15.7:0/1531526572 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f227815f490 0x7f227815f8d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2268009e50 tx=0x7f226802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3932cf1288a710d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:23.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.692+0000 7f2275ffb640 1 -- 172.21.15.7:0/1531526572 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2268036070 con 0x7f227815f490 2024-04-25T09:56:23.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.692+0000 7f2275ffb640 1 -- 172.21.15.7:0/1531526572 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2268031600 con 0x7f227815f490 2024-04-25T09:56:23.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.692+0000 7f2275ffb640 1 -- 172.21.15.7:0/1531526572 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22680319d0 con 0x7f227815f490 2024-04-25T09:56:23.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.693+0000 7f227d390640 1 -- 172.21.15.7:0/1531526572 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f227815f490 msgr2=0x7f227815f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:23.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.693+0000 7f227d390640 1 --2- 172.21.15.7:0/1531526572 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f227815f490 0x7f227815f8d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2268009e50 tx=0x7f226802a710 comp rx=0 tx=0).stop 2024-04-25T09:56:23.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.693+0000 7f227d390640 1 -- 172.21.15.7:0/1531526572 shutdown_connections 2024-04-25T09:56:23.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.693+0000 7f227d390640 1 --2- 172.21.15.7:0/1531526572 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f227815f490 0x7f227815f8d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:23.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.693+0000 7f227d390640 1 --2- 172.21.15.7:0/1531526572 >> v2:172.21.15.55:3300/0 conn(0x7f2278145250 0x7f22780b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:23.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.693+0000 7f227d390640 1 -- 172.21.15.7:0/1531526572 >> 172.21.15.7:0/1531526572 conn(0x7f22780b59f0 msgr2=0x7f22780b5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:23.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.693+0000 7f227d390640 1 -- 172.21.15.7:0/1531526572 shutdown_connections 2024-04-25T09:56:23.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.693+0000 7f227d390640 1 -- 172.21.15.7:0/1531526572 wait complete. 2024-04-25T09:56:23.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.694+0000 7f227d390640 1 Processor -- start 2024-04-25T09:56:23.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.694+0000 7f227d390640 1 -- start start 2024-04-25T09:56:23.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.695+0000 7f227d390640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22780afaa0 0x7f22780d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:23.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.695+0000 7f227d390640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2278145250 0x7f22781f3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:23.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.695+0000 7f227d390640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f227815f490 0x7f22781f44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:23.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.695+0000 7f227d390640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22780af580 con 0x7f22780afaa0 2024-04-25T09:56:23.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.695+0000 7f227d390640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22780af2a0 con 0x7f227815f490 2024-04-25T09:56:23.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.695+0000 7f227d390640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22780aec90 con 0x7f2278145250 2024-04-25T09:56:23.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.695+0000 7f2276ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22780afaa0 0x7f22780d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:23.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.695+0000 7f2276ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22780afaa0 0x7f22780d03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56896/0 (socket says 172.21.15.7:56896) 2024-04-25T09:56:23.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.695+0000 7f2276ffd640 1 -- 172.21.15.7:0/2808565550 learned_addr learned my addr 172.21.15.7:0/2808565550 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:23.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.695+0000 7f22767fc640 1 --2- 172.21.15.7:0/2808565550 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2278145250 0x7f22781f3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:23.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.695+0000 7f22777fe640 1 --2- 172.21.15.7:0/2808565550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f227815f490 0x7f22781f44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:23.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.695+0000 7f2276ffd640 1 -- 172.21.15.7:0/2808565550 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2278145250 msgr2=0x7f22781f3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:23.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.695+0000 7f2276ffd640 1 --2- 172.21.15.7:0/2808565550 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2278145250 0x7f22781f3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:23.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.695+0000 7f2276ffd640 1 -- 172.21.15.7:0/2808565550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f227815f490 msgr2=0x7f22781f44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:23.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.695+0000 7f2276ffd640 1 --2- 172.21.15.7:0/2808565550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f227815f490 0x7f22781f44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:23.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.695+0000 7f2276ffd640 1 -- 172.21.15.7:0/2808565550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22781f42b0 con 0x7f22780afaa0 2024-04-25T09:56:23.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.695+0000 7f2276ffd640 1 --2- 172.21.15.7:0/2808565550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22780afaa0 0x7f22780d03a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f227000ebe0 tx=0x7f227000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:23.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.696+0000 7f226f7fe640 1 -- 172.21.15.7:0/2808565550 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2270017070 con 0x7f22780afaa0 2024-04-25T09:56:23.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.696+0000 7f226f7fe640 1 -- 172.21.15.7:0/2808565550 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227000cc30 con 0x7f22780afaa0 2024-04-25T09:56:23.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.696+0000 7f227d390640 1 -- 172.21.15.7:0/2808565550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22780c9850 con 0x7f22780afaa0 2024-04-25T09:56:23.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.696+0000 7f226f7fe640 1 -- 172.21.15.7:0/2808565550 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2270013470 con 0x7f22780afaa0 2024-04-25T09:56:23.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.696+0000 7f227d390640 1 -- 172.21.15.7:0/2808565550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22780c9dd0 con 0x7f22780afaa0 2024-04-25T09:56:23.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.697+0000 7f227d390640 1 -- 172.21.15.7:0/2808565550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2278068fd0 con 0x7f22780afaa0 2024-04-25T09:56:23.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.697+0000 7f226f7fe640 1 -- 172.21.15.7:0/2808565550 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f227001a070 con 0x7f22780afaa0 2024-04-25T09:56:23.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.698+0000 7f226f7fe640 1 --2- 172.21.15.7:0/2808565550 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f225806b500 0x7f225806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:23.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.698+0000 7f22767fc640 1 --2- 172.21.15.7:0/2808565550 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f225806b500 0x7f225806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:23.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.698+0000 7f226f7fe640 1 -- 172.21.15.7:0/2808565550 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f227008a190 con 0x7f22780afaa0 2024-04-25T09:56:23.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.698+0000 7f22767fc640 1 --2- 172.21.15.7:0/2808565550 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f225806b500 0x7f225806d9c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f22780b1fc0 tx=0x7f2260007e20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:23.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.702+0000 7f226f7fe640 1 -- 172.21.15.7:0/2808565550 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f22781f42b0 con 0x7f22780afaa0 2024-04-25T09:56:23.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.919+0000 7f227d390640 1 -- 172.21.15.7:0/2808565550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f227806b730 con 0x7f22780afaa0 2024-04-25T09:56:23.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.919+0000 7f226f7fe640 1 -- 172.21.15.7:0/2808565550 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4932 (secure 0 0 0) 0x7f22700588c0 con 0x7f22780afaa0 2024-04-25T09:56:23.923 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:23.923 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5072,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1716545079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1716545079},{"type":"v1","addr":"172.21.15.7:6837","nonce":1716545079}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5434,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1851611776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1851611776},{"type":"v1","addr":"172.21.15.55:6834","nonce":1851611776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2607486300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2607486300},{"type":"v1","addr":"172.21.15.55:6835","nonce":2607486300}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:56:14.756973+0000","modified":"2024-04-25T09:56:16.763894+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5820":{"gid":5820,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6836/2232311564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2232311564},{"type":"v1","addr":"172.21.15.7:6836","nonce":2232311564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:56:23.923 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 21 2024-04-25T09:56:23.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.922+0000 7f227d390640 1 -- 172.21.15.7:0/2808565550 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f225806b500 msgr2=0x7f225806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:23.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.922+0000 7f227d390640 1 --2- 172.21.15.7:0/2808565550 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f225806b500 0x7f225806d9c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f22780b1fc0 tx=0x7f2260007e20 comp rx=0 tx=0).stop 2024-04-25T09:56:23.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.922+0000 7f227d390640 1 -- 172.21.15.7:0/2808565550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22780afaa0 msgr2=0x7f22780d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:23.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.922+0000 7f227d390640 1 --2- 172.21.15.7:0/2808565550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22780afaa0 0x7f22780d03a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f227000ebe0 tx=0x7f227000c520 comp rx=0 tx=0).stop 2024-04-25T09:56:23.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.922+0000 7f227d390640 1 -- 172.21.15.7:0/2808565550 shutdown_connections 2024-04-25T09:56:23.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.922+0000 7f227d390640 1 --2- 172.21.15.7:0/2808565550 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f225806b500 0x7f225806d9c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:23.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.922+0000 7f227d390640 1 --2- 172.21.15.7:0/2808565550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f227815f490 0x7f22781f44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:23.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.922+0000 7f227d390640 1 --2- 172.21.15.7:0/2808565550 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2278145250 0x7f22781f3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:23.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.922+0000 7f227d390640 1 --2- 172.21.15.7:0/2808565550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22780afaa0 0x7f22780d03a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:23.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.922+0000 7f227d390640 1 -- 172.21.15.7:0/2808565550 >> 172.21.15.7:0/2808565550 conn(0x7f22780b59f0 msgr2=0x7f22780d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:23.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.922+0000 7f227d390640 1 -- 172.21.15.7:0/2808565550 shutdown_connections 2024-04-25T09:56:23.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:23.922+0000 7f227d390640 1 -- 172.21.15.7:0/2808565550 wait complete. 2024-04-25T09:56:24.338 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:56:14.756973+0000', 'modified': '2024-04-25T09:56:16.763894+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5820}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5820': {'gid': 5820, 'name': 'c', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.7:6836/2232311564', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6835', 'nonce': 2232311564}, {'type': 'v1', 'addr': '172.21.15.7:6836', 'nonce': 2232311564}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:56:24.338 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:56:24.339 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T09:56:24.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.443+0000 7f4ffd0b3640 1 Processor -- start 2024-04-25T09:56:24.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.443+0000 7f4ffd0b3640 1 -- start start 2024-04-25T09:56:24.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.444+0000 7f4ffd0b3640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4ff80d0a50 0x7f4ff80d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:24.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.444+0000 7f4ffd0b3640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff80d1e80 con 0x7f4ff815db00 2024-04-25T09:56:24.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.444+0000 7f4ffd0b3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff80b5930 con 0x7f4ff80b53b0 2024-04-25T09:56:24.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.444+0000 7f4ffd0b3640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff80b5c10 con 0x7f4ff80d0a50 2024-04-25T09:56:24.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.444+0000 7f4ff659c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4ff80d0a50 0x7f4ff80d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:24.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.444+0000 7f4ff6d9d640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f4ff815db00 0x7f4ff80d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:32972/0 (socket says 172.21.15.7:32972) 2024-04-25T09:56:24.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.444+0000 7f4ff6d9d640 1 -- 172.21.15.7:0/1295659642 learned_addr learned my addr 172.21.15.7:0/1295659642 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:56:24.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.445+0000 7f4ff659c640 1 -- 172.21.15.7:0/1295659642 >> v1:172.21.15.55:6789/0 conn(0x7f4ff80b53b0 legacy=0x7f4ff80d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:24.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.445+0000 7f4ff659c640 1 -- 172.21.15.7:0/1295659642 >> v1:172.21.15.7:6789/0 conn(0x7f4ff815db00 legacy=0x7f4ff80d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:24.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.445+0000 7f4ff659c640 1 -- 172.21.15.7:0/1295659642 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff80b5ef0 con 0x7f4ff80d0a50 2024-04-25T09:56:24.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.445+0000 7f4ff5d9b640 1 -- 172.21.15.7:0/1295659642 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 830332893 0 0) 0x7f4ff80d1e80 con 0x7f4ff815db00 2024-04-25T09:56:24.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.445+0000 7f4ff659c640 1 --2- 172.21.15.7:0/1295659642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ff80d0a50 0x7f4ff80d2330 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0097a0 tx=0x7f4fec02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf7087326bb8bda8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:24.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.445+0000 7f4ff5d9b640 1 -- 172.21.15.7:0/1295659642 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec037070 con 0x7f4ff80d0a50 2024-04-25T09:56:24.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.445+0000 7f4ff5d9b640 1 -- 172.21.15.7:0/1295659642 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fec032440 con 0x7f4ff80d0a50 2024-04-25T09:56:24.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.445+0000 7f4ff5d9b640 1 -- 172.21.15.7:0/1295659642 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec032810 con 0x7f4ff80d0a50 2024-04-25T09:56:24.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.446+0000 7f4ffd0b3640 1 -- 172.21.15.7:0/1295659642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ff80d0a50 msgr2=0x7f4ff80d2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:24.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.446+0000 7f4ffd0b3640 1 --2- 172.21.15.7:0/1295659642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ff80d0a50 0x7f4ff80d2330 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0097a0 tx=0x7f4fec02a1e0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.446+0000 7f4ffd0b3640 1 -- 172.21.15.7:0/1295659642 shutdown_connections 2024-04-25T09:56:24.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.446+0000 7f4ffd0b3640 1 --2- 172.21.15.7:0/1295659642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ff80d0a50 0x7f4ff80d2330 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.446+0000 7f4ffd0b3640 1 -- 172.21.15.7:0/1295659642 >> 172.21.15.7:0/1295659642 conn(0x7f4ff8072290 msgr2=0x7f4ff80726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:24.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.446+0000 7f4ffd0b3640 1 -- 172.21.15.7:0/1295659642 shutdown_connections 2024-04-25T09:56:24.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.446+0000 7f4ffd0b3640 1 -- 172.21.15.7:0/1295659642 wait complete. 2024-04-25T09:56:24.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.448+0000 7f4ffd0b3640 1 Processor -- start 2024-04-25T09:56:24.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.448+0000 7f4ffd0b3640 1 -- start start 2024-04-25T09:56:24.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.448+0000 7f4ffd0b3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ff80b53b0 0x7f4ff8156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:24.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.448+0000 7f4ffd0b3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ff80d0a50 0x7f4ff81500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:24.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.448+0000 7f4ffd0b3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4ff815db00 0x7f4ff81505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:24.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.448+0000 7f4ffd0b3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff80d3660 con 0x7f4ff80b53b0 2024-04-25T09:56:24.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.448+0000 7f4ffd0b3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff80b61d0 con 0x7f4ff80d0a50 2024-04-25T09:56:24.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.448+0000 7f4ffd0b3640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff80d2f80 con 0x7f4ff815db00 2024-04-25T09:56:24.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.448+0000 7f4ff6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ff80b53b0 0x7f4ff8156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:24.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.448+0000 7f4ff6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ff80b53b0 0x7f4ff8156ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56912/0 (socket says 172.21.15.7:56912) 2024-04-25T09:56:24.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.448+0000 7f4ff6d9d640 1 -- 172.21.15.7:0/1535191987 learned_addr learned my addr 172.21.15.7:0/1535191987 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:24.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.449+0000 7f4ff659c640 1 --2- 172.21.15.7:0/1535191987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ff80d0a50 0x7f4ff81500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:24.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.449+0000 7f4ff759e640 1 --2- 172.21.15.7:0/1535191987 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4ff815db00 0x7f4ff81505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:24.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.449+0000 7f4ff6d9d640 1 -- 172.21.15.7:0/1535191987 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4ff815db00 msgr2=0x7f4ff81505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:24.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.449+0000 7f4ff6d9d640 1 --2- 172.21.15.7:0/1535191987 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4ff815db00 0x7f4ff81505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.449+0000 7f4ff6d9d640 1 -- 172.21.15.7:0/1535191987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ff80d0a50 msgr2=0x7f4ff81500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:24.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.449+0000 7f4ff6d9d640 1 --2- 172.21.15.7:0/1535191987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ff80d0a50 0x7f4ff81500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.449+0000 7f4ff6d9d640 1 -- 172.21.15.7:0/1535191987 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff815e5b0 con 0x7f4ff80b53b0 2024-04-25T09:56:24.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.449+0000 7f4ff659c640 1 --2- 172.21.15.7:0/1535191987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ff80d0a50 0x7f4ff81500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:24.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.449+0000 7f4ff6d9d640 1 --2- 172.21.15.7:0/1535191987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ff80b53b0 0x7f4ff8156ab0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800c430 tx=0x7f4fe800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:24.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.449+0000 7f4fdf7fe640 1 -- 172.21.15.7:0/1535191987 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe80074e0 con 0x7f4ff80b53b0 2024-04-25T09:56:24.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.449+0000 7f4fdf7fe640 1 -- 172.21.15.7:0/1535191987 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe80047e0 con 0x7f4ff80b53b0 2024-04-25T09:56:24.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.449+0000 7f4ffd0b3640 1 -- 172.21.15.7:0/1535191987 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff815e890 con 0x7f4ff80b53b0 2024-04-25T09:56:24.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.449+0000 7f4fdf7fe640 1 -- 172.21.15.7:0/1535191987 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8004bd0 con 0x7f4ff80b53b0 2024-04-25T09:56:24.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.449+0000 7f4ffd0b3640 1 -- 172.21.15.7:0/1535191987 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff815ee50 con 0x7f4ff80b53b0 2024-04-25T09:56:24.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.451+0000 7f4fdf7fe640 1 -- 172.21.15.7:0/1535191987 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4fe8011070 con 0x7f4ff80b53b0 2024-04-25T09:56:24.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.451+0000 7f4fdf7fe640 1 --2- 172.21.15.7:0/1535191987 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4fe406b4d0 0x7f4fe406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:24.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.452+0000 7f4fdf7fe640 1 -- 172.21.15.7:0/1535191987 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4fe808a050 con 0x7f4ff80b53b0 2024-04-25T09:56:24.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.452+0000 7f4ff659c640 1 --2- 172.21.15.7:0/1535191987 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4fe406b4d0 0x7f4fe406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:24.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.452+0000 7f4ff659c640 1 --2- 172.21.15.7:0/1535191987 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4fe406b4d0 0x7f4fe406d990 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4fec034000 tx=0x7f4fec02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:24.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.452+0000 7f4fffdb4740 1 Processor -- start 2024-04-25T09:56:24.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.452+0000 7f4fffdb4740 1 -- start start 2024-04-25T09:56:24.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.453+0000 7f4fffdb4740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5649c8cb4230 0x5649c8cb4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:24.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.453+0000 7f4fffdb4740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5649c8cd1ad0 0x5649c8cd2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:24.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.453+0000 7f4fffdb4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5649c8c89f10 0x5649c8cd0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:24.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.453+0000 7f4fffdb4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649c8beca10 con 0x5649c8c89f10 2024-04-25T09:56:24.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.453+0000 7f4fffdb4740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649c8b95b30 con 0x5649c8cb4230 2024-04-25T09:56:24.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.453+0000 7f4fffdb4740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649c8be8c50 con 0x5649c8cd1ad0 2024-04-25T09:56:24.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.453+0000 7f4ff759e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5649c8c89f10 0x5649c8cd0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:24.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.453+0000 7f4ff759e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5649c8c89f10 0x5649c8cd0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56920/0 (socket says 172.21.15.7:56920) 2024-04-25T09:56:24.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.453+0000 7f4ff759e640 1 -- 172.21.15.7:0/722769788 learned_addr learned my addr 172.21.15.7:0/722769788 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:24.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.453+0000 7f4ff6d9d640 1 --2- 172.21.15.7:0/722769788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5649c8cb4230 0x5649c8cb4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:24.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.453+0000 7f4ff659c640 1 --2- 172.21.15.7:0/722769788 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5649c8cd1ad0 0x5649c8cd2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:24.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.454+0000 7f4ff759e640 1 -- 172.21.15.7:0/722769788 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5649c8cd1ad0 msgr2=0x5649c8cd2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:24.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.454+0000 7f4ff759e640 1 --2- 172.21.15.7:0/722769788 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5649c8cd1ad0 0x5649c8cd2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.454+0000 7f4ff759e640 1 -- 172.21.15.7:0/722769788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5649c8cb4230 msgr2=0x5649c8cb4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:24.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.454+0000 7f4ff759e640 1 --2- 172.21.15.7:0/722769788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5649c8cb4230 0x5649c8cb4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.454+0000 7f4ff759e640 1 -- 172.21.15.7:0/722769788 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649c8baae10 con 0x5649c8c89f10 2024-04-25T09:56:24.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.454+0000 7f4ff759e640 1 --2- 172.21.15.7:0/722769788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5649c8c89f10 0x5649c8cd0190 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00053b0 tx=0x7f4ff0005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c869aa21809db03f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:24.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.454+0000 7f4fdcff9640 1 -- 172.21.15.7:0/722769788 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0006d60 con 0x5649c8c89f10 2024-04-25T09:56:24.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.454+0000 7f4fdcff9640 1 -- 172.21.15.7:0/722769788 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff0018070 con 0x5649c8c89f10 2024-04-25T09:56:24.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.454+0000 7f4fdcff9640 1 -- 172.21.15.7:0/722769788 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff000ea70 con 0x5649c8c89f10 2024-04-25T09:56:24.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.455+0000 7f4fffdb4740 1 -- 172.21.15.7:0/722769788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5649c8c89f10 msgr2=0x5649c8cd0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:24.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.455+0000 7f4fffdb4740 1 --2- 172.21.15.7:0/722769788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5649c8c89f10 0x5649c8cd0190 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00053b0 tx=0x7f4ff0005870 comp rx=0 tx=0).stop 2024-04-25T09:56:24.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.455+0000 7f4fffdb4740 1 -- 172.21.15.7:0/722769788 shutdown_connections 2024-04-25T09:56:24.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.455+0000 7f4fffdb4740 1 --2- 172.21.15.7:0/722769788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5649c8c89f10 0x5649c8cd0190 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.455+0000 7f4fffdb4740 1 --2- 172.21.15.7:0/722769788 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5649c8cd1ad0 0x5649c8cd2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.455+0000 7f4fffdb4740 1 --2- 172.21.15.7:0/722769788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5649c8cb4230 0x5649c8cb4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.455+0000 7f4fffdb4740 1 -- 172.21.15.7:0/722769788 >> 172.21.15.7:0/722769788 conn(0x5649c8c86840 msgr2=0x5649c8ccf040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:24.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.455+0000 7f4fffdb4740 1 -- 172.21.15.7:0/722769788 shutdown_connections 2024-04-25T09:56:24.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.455+0000 7f4fffdb4740 1 -- 172.21.15.7:0/722769788 wait complete. 2024-04-25T09:56:24.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.455+0000 7f4fffdb4740 1 -- start start 2024-04-25T09:56:24.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.455+0000 7f4fffdb4740 1 Processor -- start 2024-04-25T09:56:24.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.456+0000 7f4fffdb4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5649c8cb4230 0x5649c8cb0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:24.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.456+0000 7f4fffdb4740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5649c8cd1ad0 0x5649c8cb7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:24.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.456+0000 7f4fffdb4740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5649c8c834a0 0x5649c8c83920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:24.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.456+0000 7f4fffdb4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649c8c8acb0 con 0x5649c8cb4230 2024-04-25T09:56:24.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.456+0000 7f4fffdb4740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649c8ba90c0 con 0x5649c8cd1ad0 2024-04-25T09:56:24.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.456+0000 7f4fffdb4740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649c8c84770 con 0x5649c8c834a0 2024-04-25T09:56:24.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.456+0000 7f4fffdb4740 10 client.0 _ll_register_callbacks cb 0x5649c8b9cec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:56:24.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.456+0000 7f4ff6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5649c8cb4230 0x5649c8cb0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:24.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.456+0000 7f4ff6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5649c8cb4230 0x5649c8cb0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56932/0 (socket says 172.21.15.7:56932) 2024-04-25T09:56:24.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.456+0000 7f4ff6d9d640 1 -- 172.21.15.7:0/3820368890 learned_addr learned my addr 172.21.15.7:0/3820368890 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:24.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.456+0000 7f4ff659c640 1 --2- 172.21.15.7:0/3820368890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5649c8cd1ad0 0x5649c8cb7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:24.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.456+0000 7f4ff759e640 1 --2- 172.21.15.7:0/3820368890 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5649c8c834a0 0x5649c8c83920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:24.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.456+0000 7f4ff6d9d640 1 -- 172.21.15.7:0/3820368890 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5649c8c834a0 msgr2=0x5649c8c83920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:24.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.456+0000 7f4ff6d9d640 1 --2- 172.21.15.7:0/3820368890 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5649c8c834a0 0x5649c8c83920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.456+0000 7f4ff6d9d640 1 -- 172.21.15.7:0/3820368890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5649c8cd1ad0 msgr2=0x5649c8cb7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:24.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.456+0000 7f4ff6d9d640 1 --2- 172.21.15.7:0/3820368890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5649c8cd1ad0 0x5649c8cb7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.457+0000 7f4ff6d9d640 1 -- 172.21.15.7:0/3820368890 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5649c89012d0 con 0x5649c8cb4230 2024-04-25T09:56:24.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.457+0000 7f4ff659c640 1 --2- 172.21.15.7:0/3820368890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5649c8cd1ad0 0x5649c8cb7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:24.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.457+0000 7f4ff6d9d640 1 --2- 172.21.15.7:0/3820368890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5649c8cb4230 0x5649c8cb0540 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8054aa0 tx=0x7f4fe8058700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e842fec76e9e64 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:24.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.457+0000 7f4fd5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:56:24.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.457+0000 7f4fd5ffb640 1 -- 172.21.15.7:0/3820368890 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe80701d0 con 0x5649c8cb4230 2024-04-25T09:56:24.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.457+0000 7f4fd5ffb640 1 -- 172.21.15.7:0/3820368890 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4fe8057a90 con 0x5649c8cb4230 2024-04-25T09:56:24.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.457+0000 7f4fffdb4740 1 -- 172.21.15.7:0/3820368890 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4ff0018070 con 0x5649c8cb4230 2024-04-25T09:56:24.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.457+0000 7f4fd5ffb640 1 -- 172.21.15.7:0/3820368890 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4fe8088050 con 0x5649c8cb4230 2024-04-25T09:56:24.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.457+0000 7f4fffdb4740 10 client.5988 fetch_fsmap learned FSMap version 21 2024-04-25T09:56:24.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.457+0000 7f4fffdb4740 1 -- 172.21.15.7:0/3820368890 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x5649c89cb6b0 con 0x5649c8cb4230 2024-04-25T09:56:24.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.457+0000 7f4fd5ffb640 1 -- 172.21.15.7:0/3820368890 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff0018070 con 0x5649c8cb4230 2024-04-25T09:56:24.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.457+0000 7f4fd5ffb640 1 -- 172.21.15.7:0/3820368890 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 21) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4fe8054390 con 0x5649c8cb4230 2024-04-25T09:56:24.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.457+0000 7f4fffdb4740 10 client.5988 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T09:56:24.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.457+0000 7f4fffdb4740 10 client.5988 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:56:24.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.457+0000 7f4fffdb4740 20 client.5988 populate_metadata read hostname 'smithi007' 2024-04-25T09:56:24.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.457+0000 7f4fffdb4740 1 --2- 172.21.15.7:0/3820368890 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x5649c8cc65c0 0x5649c8cc69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:24.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.457+0000 7f4fffdb4740 4 client.5988 mds_command: new command op to 5820 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:56:24.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.457+0000 7f4fffdb4740 1 -- 172.21.15.7:0/3820368890 --> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5649c8c4b920 con 0x5649c8cc65c0 2024-04-25T09:56:24.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.457+0000 7f4ff659c640 1 --2- 172.21.15.7:0/3820368890 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x5649c8cc65c0 0x5649c8cc69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:24.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.458+0000 7f4fd5ffb640 10 client.5988 ms_handle_connect on v2:172.21.15.7:6835/2232311564 2024-04-25T09:56:24.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.458+0000 7f4ff659c640 1 --2- 172.21.15.7:0/3820368890 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x5649c8cc65c0 0x5649c8cc69a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee3fe99e13092831 server_cookie=87f090e365b0a33f in_seq=0 out_seq=0 2024-04-25T09:56:24.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.458+0000 7f4fd5ffb640 1 -- 172.21.15.7:0/3820368890 <== mds.0 v2:172.21.15.7:6835/2232311564 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5649c8c4b920 con 0x5649c8cc65c0 2024-04-25T09:56:24.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.458+0000 7f4fd5ffb640 10 client.5988 handle_command_reply: tid=0 2024-04-25T09:56:24.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.458+0000 7f4fffdb4740 1 client.5988 shutdown 2024-04-25T09:56:24.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.459+0000 7f4fffdb4740 1 -- 172.21.15.7:0/3820368890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5649c8cb4230 msgr2=0x5649c8cb0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:24.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.459+0000 7f4fffdb4740 1 --2- 172.21.15.7:0/3820368890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5649c8cb4230 0x5649c8cb0540 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8054aa0 tx=0x7f4fe8058700 comp rx=0 tx=0).stop 2024-04-25T09:56:24.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.459+0000 7f4fffdb4740 1 -- 172.21.15.7:0/3820368890 shutdown_connections 2024-04-25T09:56:24.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.459+0000 7f4fffdb4740 1 --2- 172.21.15.7:0/3820368890 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x5649c8cc65c0 0x5649c8cc69a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.459+0000 7f4fffdb4740 1 --2- 172.21.15.7:0/3820368890 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5649c8c834a0 0x5649c8c83920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.459+0000 7f4fffdb4740 1 --2- 172.21.15.7:0/3820368890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5649c8cd1ad0 0x5649c8cb7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.459+0000 7f4fd5ffb640 0 client.5988 ms_handle_reset on v2:172.21.15.7:6835/2232311564 2024-04-25T09:56:24.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.459+0000 7f4fffdb4740 1 --2- 172.21.15.7:0/3820368890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5649c8cb4230 0x5649c8cb0540 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.459+0000 7f4fffdb4740 1 -- 172.21.15.7:0/3820368890 >> 172.21.15.7:0/3820368890 conn(0x5649c8c89f10 msgr2=0x5649c8cce870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:24.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.459+0000 7f4fffdb4740 1 -- 172.21.15.7:0/3820368890 shutdown_connections 2024-04-25T09:56:24.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.459+0000 7f4fffdb4740 1 -- 172.21.15.7:0/3820368890 wait complete. 2024-04-25T09:56:24.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.459+0000 7f4fffdb4740 20 client.5988 trim_cache size 0 max 16384 2024-04-25T09:56:24.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.475+0000 7f4fffdb4740 1 Processor -- start 2024-04-25T09:56:24.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.475+0000 7f4fffdb4740 1 -- start start 2024-04-25T09:56:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.475+0000 7f4fffdb4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5649c8c834a0 0x5649c8ce9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.475+0000 7f4fffdb4740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5649c8cb4230 0x5649c8c8a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.475+0000 7f4fffdb4740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5649c8cd1ad0 0x5649c8c8a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.475+0000 7f4fffdb4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff8200210 con 0x5649c8c834a0 2024-04-25T09:56:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.475+0000 7f4fffdb4740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff81ff4a0 con 0x5649c8cb4230 2024-04-25T09:56:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.475+0000 7f4fffdb4740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff80c96f0 con 0x5649c8cd1ad0 2024-04-25T09:56:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.475+0000 7f4ff6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5649c8c834a0 0x5649c8ce9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.475+0000 7f4ff6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5649c8c834a0 0x5649c8ce9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56938/0 (socket says 172.21.15.7:56938) 2024-04-25T09:56:24.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.475+0000 7f4ff6d9d640 1 -- 172.21.15.7:0/4268099864 learned_addr learned my addr 172.21.15.7:0/4268099864 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.476+0000 7f4ff6d9d640 1 -- 172.21.15.7:0/4268099864 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5649c8cd1ad0 msgr2=0x5649c8c8a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.476+0000 7f4ff6d9d640 1 --2- 172.21.15.7:0/4268099864 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5649c8cd1ad0 0x5649c8c8a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.476+0000 7f4ff6d9d640 1 -- 172.21.15.7:0/4268099864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5649c8cb4230 msgr2=0x5649c8c8a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.476+0000 7f4ff6d9d640 1 --2- 172.21.15.7:0/4268099864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5649c8cb4230 0x5649c8c8a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.476+0000 7f4ff6d9d640 1 -- 172.21.15.7:0/4268099864 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649c8c8b4f0 con 0x5649c8c834a0 2024-04-25T09:56:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.476+0000 7f4ff6d9d640 1 --2- 172.21.15.7:0/4268099864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5649c8c834a0 0x5649c8ce9490 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8000fb0 tx=0x7f4fe805c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=938b3df4e6f6aab5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.476+0000 7f4fd7fff640 1 -- 172.21.15.7:0/4268099864 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8075070 con 0x5649c8c834a0 2024-04-25T09:56:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.476+0000 7f4fd7fff640 1 -- 172.21.15.7:0/4268099864 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe805c790 con 0x5649c8c834a0 2024-04-25T09:56:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.476+0000 7f4fd7fff640 1 -- 172.21.15.7:0/4268099864 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe80701d0 con 0x5649c8c834a0 2024-04-25T09:56:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.476+0000 7f4fffdb4740 1 -- 172.21.15.7:0/4268099864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5649c8c834a0 msgr2=0x5649c8ce9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.476+0000 7f4fffdb4740 1 --2- 172.21.15.7:0/4268099864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5649c8c834a0 0x5649c8ce9490 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8000fb0 tx=0x7f4fe805c000 comp rx=0 tx=0).stop 2024-04-25T09:56:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.476+0000 7f4fffdb4740 1 -- 172.21.15.7:0/4268099864 shutdown_connections 2024-04-25T09:56:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.476+0000 7f4fffdb4740 1 --2- 172.21.15.7:0/4268099864 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5649c8cd1ad0 0x5649c8c8a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.476+0000 7f4fffdb4740 1 --2- 172.21.15.7:0/4268099864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5649c8cb4230 0x5649c8c8a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.476+0000 7f4fffdb4740 1 --2- 172.21.15.7:0/4268099864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5649c8c834a0 0x5649c8ce9490 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.477+0000 7f4fffdb4740 1 -- 172.21.15.7:0/4268099864 >> 172.21.15.7:0/4268099864 conn(0x5649c8c89f10 msgr2=0x5649c8cb3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.477+0000 7f4fffdb4740 1 -- 172.21.15.7:0/4268099864 shutdown_connections 2024-04-25T09:56:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.477+0000 7f4fffdb4740 1 -- 172.21.15.7:0/4268099864 wait complete. 2024-04-25T09:56:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.477+0000 7f4fffdb4740 1 -- start start 2024-04-25T09:56:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.477+0000 7f4fffdb4740 1 Processor -- start 2024-04-25T09:56:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.478+0000 7f4fffdb4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5649c8c834a0 0x5649c8d3cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.478+0000 7f4fffdb4740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5649c8cb4230 0x5649c8c8a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.478+0000 7f4fffdb4740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5649c8cd1ad0 0x5649c8c8a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.478+0000 7f4fffdb4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649c8cc8130 con 0x5649c8c834a0 2024-04-25T09:56:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.478+0000 7f4fffdb4740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff80c7e00 con 0x5649c8cd1ad0 2024-04-25T09:56:24.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.478+0000 7f4fffdb4740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649c8cb0ea0 con 0x5649c8cb4230 2024-04-25T09:56:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.478+0000 7f4fffdb4740 10 client.0 _ll_register_callbacks cb 0x5649c8c84c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:56:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.478+0000 7f4ff6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5649c8c834a0 0x5649c8d3cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.478+0000 7f4ff6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5649c8c834a0 0x5649c8d3cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56948/0 (socket says 172.21.15.7:56948) 2024-04-25T09:56:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.478+0000 7f4ff6d9d640 1 -- 172.21.15.7:0/3031100622 learned_addr learned my addr 172.21.15.7:0/3031100622 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.478+0000 7f4ff659c640 1 --2- 172.21.15.7:0/3031100622 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5649c8cb4230 0x5649c8c8a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.478+0000 7f4ff759e640 1 --2- 172.21.15.7:0/3031100622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5649c8cd1ad0 0x5649c8c8a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.478+0000 7f4ff6d9d640 1 -- 172.21.15.7:0/3031100622 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5649c8cb4230 msgr2=0x5649c8c8a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.478+0000 7f4ff6d9d640 1 --2- 172.21.15.7:0/3031100622 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5649c8cb4230 0x5649c8c8a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.478+0000 7f4ff6d9d640 1 -- 172.21.15.7:0/3031100622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5649c8cd1ad0 msgr2=0x5649c8c8a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.478+0000 7f4ff6d9d640 1 --2- 172.21.15.7:0/3031100622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5649c8cd1ad0 0x5649c8c8a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.478+0000 7f4ff6d9d640 1 -- 172.21.15.7:0/3031100622 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5649c8cb3b50 con 0x5649c8c834a0 2024-04-25T09:56:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.478+0000 7f4ff6d9d640 1 --2- 172.21.15.7:0/3031100622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5649c8c834a0 0x5649c8d3cc70 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800cdf0 tx=0x7f4fe8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99af63642c9191bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.478+0000 7f4fd5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:56:24.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.478+0000 7f4fd5ffb640 1 -- 172.21.15.7:0/3031100622 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8075050 con 0x5649c8c834a0 2024-04-25T09:56:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.479+0000 7f4fd5ffb640 1 -- 172.21.15.7:0/3031100622 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4fe8078d50 con 0x5649c8c834a0 2024-04-25T09:56:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.479+0000 7f4fffdb4740 1 -- 172.21.15.7:0/3031100622 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4fe805c790 con 0x5649c8c834a0 2024-04-25T09:56:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.479+0000 7f4fd5ffb640 1 -- 172.21.15.7:0/3031100622 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4fe80701d0 con 0x5649c8c834a0 2024-04-25T09:56:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.479+0000 7f4fffdb4740 10 client.5994 fetch_fsmap learned FSMap version 21 2024-04-25T09:56:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.479+0000 7f4fffdb4740 1 -- 172.21.15.7:0/3031100622 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x5649c8cafc80 con 0x5649c8c834a0 2024-04-25T09:56:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.479+0000 7f4fd5ffb640 1 -- 172.21.15.7:0/3031100622 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe805c790 con 0x5649c8c834a0 2024-04-25T09:56:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.479+0000 7f4fd5ffb640 1 -- 172.21.15.7:0/3031100622 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 21) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4fe8057500 con 0x5649c8c834a0 2024-04-25T09:56:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.479+0000 7f4fffdb4740 10 client.5994 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T09:56:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.479+0000 7f4fffdb4740 10 client.5994 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:56:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.479+0000 7f4fffdb4740 20 client.5994 populate_metadata read hostname 'smithi007' 2024-04-25T09:56:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.479+0000 7f4fffdb4740 1 --2- 172.21.15.7:0/3031100622 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x5649c8d3da10 0x5649c8d3ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.479+0000 7f4fffdb4740 4 client.5994 mds_command: new command op to 5820 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:56:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.479+0000 7f4fffdb4740 1 -- 172.21.15.7:0/3031100622 --> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5649c8cc9570 con 0x5649c8d3da10 2024-04-25T09:56:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.479+0000 7f4ff659c640 1 --2- 172.21.15.7:0/3031100622 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x5649c8d3da10 0x5649c8d3ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:24.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.479+0000 7f4fd5ffb640 10 client.5994 ms_handle_connect on v2:172.21.15.7:6835/2232311564 2024-04-25T09:56:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.479+0000 7f4ff659c640 1 --2- 172.21.15.7:0/3031100622 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x5649c8d3da10 0x5649c8d3ddf0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed0d35e6486a0bc6 server_cookie=b81e85f85763ad62 in_seq=0 out_seq=0 2024-04-25T09:56:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.480+0000 7f4fd5ffb640 1 -- 172.21.15.7:0/3031100622 <== mds.0 v2:172.21.15.7:6835/2232311564 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5649c8cc9570 con 0x5649c8d3da10 2024-04-25T09:56:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.480+0000 7f4fd5ffb640 10 client.5994 handle_command_reply: tid=0 2024-04-25T09:56:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.480+0000 7f4fffdb4740 1 client.5994 shutdown 2024-04-25T09:56:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.480+0000 7f4fffdb4740 1 -- 172.21.15.7:0/3031100622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5649c8c834a0 msgr2=0x5649c8d3cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.480+0000 7f4fffdb4740 1 --2- 172.21.15.7:0/3031100622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5649c8c834a0 0x5649c8d3cc70 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800cdf0 tx=0x7f4fe8000ed0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.480+0000 7f4fffdb4740 1 -- 172.21.15.7:0/3031100622 shutdown_connections 2024-04-25T09:56:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.480+0000 7f4fffdb4740 1 --2- 172.21.15.7:0/3031100622 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x5649c8d3da10 0x5649c8d3ddf0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.480+0000 7f4fffdb4740 1 --2- 172.21.15.7:0/3031100622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5649c8cd1ad0 0x5649c8c8a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.480+0000 7f4fffdb4740 1 --2- 172.21.15.7:0/3031100622 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5649c8cb4230 0x5649c8c8a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.480+0000 7f4fd5ffb640 0 client.5994 ms_handle_reset on v2:172.21.15.7:6835/2232311564 2024-04-25T09:56:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.480+0000 7f4fffdb4740 1 --2- 172.21.15.7:0/3031100622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5649c8c834a0 0x5649c8d3cc70 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.480+0000 7f4fffdb4740 1 -- 172.21.15.7:0/3031100622 >> 172.21.15.7:0/3031100622 conn(0x5649c8c89f10 msgr2=0x5649c8ccf400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.480+0000 7f4fffdb4740 1 -- 172.21.15.7:0/3031100622 shutdown_connections 2024-04-25T09:56:24.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.480+0000 7f4fffdb4740 1 -- 172.21.15.7:0/3031100622 wait complete. 2024-04-25T09:56:24.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.480+0000 7f4fffdb4740 20 client.5994 trim_cache size 0 max 16384 2024-04-25T09:56:24.490 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T09:56:24.490 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "c03d0745-5946-49c3-ad88-1165c5b68b4e", 2024-04-25T09:56:24.490 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-04-25T09:56:24.490 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 5820, 2024-04-25T09:56:24.490 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-04-25T09:56:24.490 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-04-25T09:56:24.490 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-04-25T09:56:24.490 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 9.0887647380000001, 2024-04-25T09:56:24.491 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 21, 2024-04-25T09:56:24.491 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 51, 2024-04-25T09:56:24.491 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 51, 2024-04-25T09:56:24.491 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 14.439842886999999 2024-04-25T09:56:24.491 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T09:56:24.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.480+0000 7f4ffd0b3640 1 -- 172.21.15.7:0/1535191987 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4fe406b4d0 msgr2=0x7f4fe406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:24.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.480+0000 7f4ffd0b3640 1 --2- 172.21.15.7:0/1535191987 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4fe406b4d0 0x7f4fe406d990 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4fec034000 tx=0x7f4fec02e000 comp rx=0 tx=0).stop 2024-04-25T09:56:24.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.480+0000 7f4ffd0b3640 1 -- 172.21.15.7:0/1535191987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ff80b53b0 msgr2=0x7f4ff8156ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:24.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.480+0000 7f4ffd0b3640 1 --2- 172.21.15.7:0/1535191987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ff80b53b0 0x7f4ff8156ab0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800c430 tx=0x7f4fe800c8f0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.480+0000 7f4ffd0b3640 1 -- 172.21.15.7:0/1535191987 shutdown_connections 2024-04-25T09:56:24.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.480+0000 7f4ffd0b3640 1 --2- 172.21.15.7:0/1535191987 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4fe406b4d0 0x7f4fe406d990 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.480+0000 7f4ffd0b3640 1 --2- 172.21.15.7:0/1535191987 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4ff815db00 0x7f4ff81505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.480+0000 7f4ffd0b3640 1 --2- 172.21.15.7:0/1535191987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ff80d0a50 0x7f4ff81500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.480+0000 7f4ffd0b3640 1 --2- 172.21.15.7:0/1535191987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ff80b53b0 0x7f4ff8156ab0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.481+0000 7f4ffd0b3640 1 -- 172.21.15.7:0/1535191987 >> 172.21.15.7:0/1535191987 conn(0x7f4ff8072290 msgr2=0x7f4ff8157e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:24.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.481+0000 7f4ffd0b3640 1 -- 172.21.15.7:0/1535191987 shutdown_connections 2024-04-25T09:56:24.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.481+0000 7f4ffd0b3640 1 -- 172.21.15.7:0/1535191987 wait complete. 2024-04-25T09:56:24.494 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:56:24.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.592+0000 7fb6c3b6a640 1 Processor -- start 2024-04-25T09:56:24.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.593+0000 7fb6c3b6a640 1 -- start start 2024-04-25T09:56:24.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.593+0000 7fb6c3b6a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb6bc0d0330 0x7fb6bc0999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:24.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.593+0000 7fb6c3b6a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb6bc099f30 0x7fb6bc0b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:24.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.593+0000 7fb6c3b6a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6bc09a330 con 0x7fb6bc15b8e0 2024-04-25T09:56:24.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.593+0000 7fb6c3b6a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6bc0cd7d0 con 0x7fb6bc099f30 2024-04-25T09:56:24.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.593+0000 7fb6c3b6a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6bc0d07c0 con 0x7fb6bc0d0330 2024-04-25T09:56:24.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.594+0000 7fb6c1906640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb6bc15b8e0 0x7fb6bc0cc300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:32980/0 (socket says 172.21.15.7:32980) 2024-04-25T09:56:24.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.594+0000 7fb6c1906640 1 -- 172.21.15.7:0/2336505716 learned_addr learned my addr 172.21.15.7:0/2336505716 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:56:24.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.594+0000 7fb6c2107640 1 --2- 172.21.15.7:0/2336505716 >> v2:172.21.15.7:3300/0 conn(0x7fb6bc099f30 0x7fb6bc0b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:24.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.594+0000 7fb6c2107640 1 -- 172.21.15.7:0/2336505716 >> v2:172.21.15.55:3300/0 conn(0x7fb6bc0d0330 msgr2=0x7fb6bc0999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:24.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.594+0000 7fb6c2107640 1 --2- 172.21.15.7:0/2336505716 >> v2:172.21.15.55:3300/0 conn(0x7fb6bc0d0330 0x7fb6bc0999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.594+0000 7fb6c2107640 1 -- 172.21.15.7:0/2336505716 >> v1:172.21.15.7:6789/0 conn(0x7fb6bc15b8e0 legacy=0x7fb6bc0cc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:24.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.594+0000 7fb6c2107640 1 -- 172.21.15.7:0/2336505716 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6bc0ccbc0 con 0x7fb6bc099f30 2024-04-25T09:56:24.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.595+0000 7fb6c2107640 1 --2- 172.21.15.7:0/2336505716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6bc099f30 0x7fb6bc0b0a50 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc072f90 tx=0x7fb6b402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d97aa3f29f8220d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:24.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.595+0000 7fb6c0904640 1 -- 172.21.15.7:0/2336505716 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4007740 con 0x7fb6bc099f30 2024-04-25T09:56:24.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.595+0000 7fb6c0904640 1 -- 172.21.15.7:0/2336505716 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b40078e0 con 0x7fb6bc099f30 2024-04-25T09:56:24.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.595+0000 7fb6c0904640 1 -- 172.21.15.7:0/2336505716 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4007cb0 con 0x7fb6bc099f30 2024-04-25T09:56:24.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.595+0000 7fb6c3b6a640 1 -- 172.21.15.7:0/2336505716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6bc099f30 msgr2=0x7fb6bc0b0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:24.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.595+0000 7fb6c3b6a640 1 --2- 172.21.15.7:0/2336505716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6bc099f30 0x7fb6bc0b0a50 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc072f90 tx=0x7fb6b402a680 comp rx=0 tx=0).stop 2024-04-25T09:56:24.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.595+0000 7fb6c3b6a640 1 -- 172.21.15.7:0/2336505716 shutdown_connections 2024-04-25T09:56:24.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.595+0000 7fb6c3b6a640 1 --2- 172.21.15.7:0/2336505716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6bc099f30 0x7fb6bc0b0a50 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.595+0000 7fb6c3b6a640 1 --2- 172.21.15.7:0/2336505716 >> v2:172.21.15.55:3300/0 conn(0x7fb6bc0d0330 0x7fb6bc0999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.595+0000 7fb6c3b6a640 1 -- 172.21.15.7:0/2336505716 >> 172.21.15.7:0/2336505716 conn(0x7fb6bc0b3130 msgr2=0x7fb6bc0b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:24.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.595+0000 7fb6c3b6a640 1 -- 172.21.15.7:0/2336505716 shutdown_connections 2024-04-25T09:56:24.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.595+0000 7fb6c3b6a640 1 -- 172.21.15.7:0/2336505716 wait complete. 2024-04-25T09:56:24.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.597+0000 7fb6c3b6a640 1 Processor -- start 2024-04-25T09:56:24.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.597+0000 7fb6c3b6a640 1 -- start start 2024-04-25T09:56:24.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.597+0000 7fb6c3b6a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6bc099f30 0x7fb6bc155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:24.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.597+0000 7fb6c3b6a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb6bc0d0330 0x7fb6bc06bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:24.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.597+0000 7fb6c3b6a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6bc15b8e0 0x7fb6bc0c7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:24.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.597+0000 7fb6c3b6a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc0cd460 con 0x7fb6bc15b8e0 2024-04-25T09:56:24.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.597+0000 7fb6c3b6a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc0cd180 con 0x7fb6bc099f30 2024-04-25T09:56:24.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.597+0000 7fb6c3b6a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc15bcc0 con 0x7fb6bc0d0330 2024-04-25T09:56:24.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.597+0000 7fb6c2107640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6bc15b8e0 0x7fb6bc0c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:24.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.597+0000 7fb6c2107640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6bc15b8e0 0x7fb6bc0c7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56958/0 (socket says 172.21.15.7:56958) 2024-04-25T09:56:24.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.597+0000 7fb6c2107640 1 -- 172.21.15.7:0/127731363 learned_addr learned my addr 172.21.15.7:0/127731363 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:24.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.598+0000 7fb6c1906640 1 --2- 172.21.15.7:0/127731363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6bc099f30 0x7fb6bc155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:24.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.598+0000 7fb6c1105640 1 --2- 172.21.15.7:0/127731363 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb6bc0d0330 0x7fb6bc06bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:24.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.598+0000 7fb6c2107640 1 -- 172.21.15.7:0/127731363 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb6bc0d0330 msgr2=0x7fb6bc06bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:24.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.598+0000 7fb6c2107640 1 --2- 172.21.15.7:0/127731363 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb6bc0d0330 0x7fb6bc06bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.598+0000 7fb6c2107640 1 -- 172.21.15.7:0/127731363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6bc099f30 msgr2=0x7fb6bc155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:24.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.598+0000 7fb6c2107640 1 --2- 172.21.15.7:0/127731363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6bc099f30 0x7fb6bc155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.598+0000 7fb6c2107640 1 -- 172.21.15.7:0/127731363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6bc06c3e0 con 0x7fb6bc15b8e0 2024-04-25T09:56:24.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.598+0000 7fb6c2107640 1 --2- 172.21.15.7:0/127731363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6bc15b8e0 0x7fb6bc0c7180 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fb6b402ac70 tx=0x7fb6b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:24.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.598+0000 7fb6b27fc640 1 -- 172.21.15.7:0/127731363 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4040070 con 0x7fb6bc15b8e0 2024-04-25T09:56:24.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.598+0000 7fb6b27fc640 1 -- 172.21.15.7:0/127731363 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b4031bc0 con 0x7fb6bc15b8e0 2024-04-25T09:56:24.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.598+0000 7fb6b27fc640 1 -- 172.21.15.7:0/127731363 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4045460 con 0x7fb6bc15b8e0 2024-04-25T09:56:24.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.598+0000 7fb6c3b6a640 1 -- 172.21.15.7:0/127731363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6bc06c6c0 con 0x7fb6bc15b8e0 2024-04-25T09:56:24.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.598+0000 7fb6c3b6a640 1 -- 172.21.15.7:0/127731363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6bc15d220 con 0x7fb6bc15b8e0 2024-04-25T09:56:24.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.599+0000 7fb6c3b6a640 1 -- 172.21.15.7:0/127731363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6bc068fd0 con 0x7fb6bc15b8e0 2024-04-25T09:56:24.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.600+0000 7fb6b27fc640 1 -- 172.21.15.7:0/127731363 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb6b4039040 con 0x7fb6bc15b8e0 2024-04-25T09:56:24.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.600+0000 7fb6b27fc640 1 --2- 172.21.15.7:0/127731363 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb6a006b4d0 0x7fb6a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:24.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.600+0000 7fb6b27fc640 1 -- 172.21.15.7:0/127731363 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb6b40abcc0 con 0x7fb6bc15b8e0 2024-04-25T09:56:24.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.601+0000 7fb6c1906640 1 --2- 172.21.15.7:0/127731363 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb6a006b4d0 0x7fb6a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:24.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.601+0000 7fb6c1906640 1 --2- 172.21.15.7:0/127731363 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb6a006b4d0 0x7fb6a006d990 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac007fd0 tx=0x7fb6ac007e80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:24.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.605+0000 7fb6b27fc640 1 -- 172.21.15.7:0/127731363 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb6b407a9b0 con 0x7fb6bc15b8e0 2024-04-25T09:56:24.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.825+0000 7fb6c3b6a640 1 -- 172.21.15.7:0/127731363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb6bc15d3f0 con 0x7fb6bc15b8e0 2024-04-25T09:56:24.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.825+0000 7fb6b27fc640 1 -- 172.21.15.7:0/127731363 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb6b407a2b0 con 0x7fb6bc15b8e0 2024-04-25T09:56:24.828 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:56:24.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.827+0000 7fb6c3b6a640 1 -- 172.21.15.7:0/127731363 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb6a006b4d0 msgr2=0x7fb6a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:24.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.827+0000 7fb6c3b6a640 1 --2- 172.21.15.7:0/127731363 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb6a006b4d0 0x7fb6a006d990 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac007fd0 tx=0x7fb6ac007e80 comp rx=0 tx=0).stop 2024-04-25T09:56:24.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.827+0000 7fb6c3b6a640 1 -- 172.21.15.7:0/127731363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6bc15b8e0 msgr2=0x7fb6bc0c7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:24.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.827+0000 7fb6c3b6a640 1 --2- 172.21.15.7:0/127731363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6bc15b8e0 0x7fb6bc0c7180 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fb6b402ac70 tx=0x7fb6b4004a40 comp rx=0 tx=0).stop 2024-04-25T09:56:24.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.827+0000 7fb6c3b6a640 1 -- 172.21.15.7:0/127731363 shutdown_connections 2024-04-25T09:56:24.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.827+0000 7fb6c3b6a640 1 --2- 172.21.15.7:0/127731363 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb6a006b4d0 0x7fb6a006d990 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.827+0000 7fb6c3b6a640 1 --2- 172.21.15.7:0/127731363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6bc15b8e0 0x7fb6bc0c7180 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.827+0000 7fb6c3b6a640 1 --2- 172.21.15.7:0/127731363 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb6bc0d0330 0x7fb6bc06bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.827+0000 7fb6c3b6a640 1 --2- 172.21.15.7:0/127731363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6bc099f30 0x7fb6bc155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:24.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.827+0000 7fb6c3b6a640 1 -- 172.21.15.7:0/127731363 >> 172.21.15.7:0/127731363 conn(0x7fb6bc0b3130 msgr2=0x7fb6bc0b0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:24.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.827+0000 7fb6c3b6a640 1 -- 172.21.15.7:0/127731363 shutdown_connections 2024-04-25T09:56:24.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:24.827+0000 7fb6c3b6a640 1 -- 172.21.15.7:0/127731363 wait complete. 2024-04-25T09:56:24.841 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:56:24.841 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:56:24.841 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-04-25T09:56:24.841 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:56:24.841 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:56:24.841 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:56:24.841 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:56:24.841 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:56:24.841 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:56:24.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:56:24.841 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-04-25T09:56:24.857 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:56:24.857 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:56:24.857 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:56:24.857 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:56:24.857 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-04-25T09:56:24.857 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:56:24.857 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:56:24.857 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-04-25T09:56:24.857 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-04-25T09:56:24.857 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:56:24.857 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-04-25T09:56:24.857 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-04-25T09:56:24.857 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:56:24.857 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-04-25T09:56:24.858 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-04-25T09:56:24.858 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T09:56:24.858 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42615sec preferred_lft 42615sec 2024-04-25T09:56:24.858 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link noprefixroute 2024-04-25T09:56:24.858 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:56:24.858 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:56:24.858 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-04-25T09:56:24.858 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-04-25T09:56:24.858 INFO:teuthology.orchestra.run.smithi007.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:56:24.858 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 26:0c:99:53:12:e3 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:56:24.858 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:56:24.858 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:56:24.858 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::50aa:55ff:febc:5f67/64 scope link 2024-04-25T09:56:24.858 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:56:24.859 INFO:teuthology.orchestra.run.smithi007.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:56:24.859 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 6e:99:f1:00:a9:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:56:24.859 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6c99:f1ff:fe00:a95e/64 scope link 2024-04-25T09:56:24.859 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:56:24.859 INFO:teuthology.orchestra.run.smithi007.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:56:24.859 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 26:0c:99:53:12:e3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:56:24.859 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::240c:99ff:fe53:12e3/64 scope link 2024-04-25T09:56:24.859 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:56:24.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:56:24.859 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:56:24.920 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-04-25T09:56:24.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:56:24.921 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-04-25T09:56:24.978 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-04-25T09:56:24.978 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:56:24.978 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T09:56:24.978 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T09:56:24.978 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:56:24.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:56:24.979 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-04-25T09:56:24.979 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-25T09:56:24.979 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:56:24.979 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:56:24.979 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:56:24.979 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-25T09:56:25.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:56:25.063 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-04-25T09:56:25.078 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:56:25.078 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:56:25.078 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:56:25.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:56:25.079 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-04-25T09:56:25.142 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:56:25.142 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:56:25.198 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:56:25.198 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:56:25.198 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:56:25.253 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:56:25.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:56:25.253 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:56:25.336 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:56:25.336 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:56:25.336 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T09:56:25.345 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:56:25.345 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:56:25.345 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T09:56:25.345 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T09:56:25.345 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:56:25.350 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:56:25.350 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:56:25.350 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T09:56:25.350 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T09:56:25.350 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:56:25.350 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790" 2024-04-25T09:56:25.350 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790:/ 2024-04-25T09:56:25.350 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c03d0745-5946-49c3-ad88-1165c5b68b4e" will pass to kernel 2024-04-25T09:56:25.351 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T09:56:25.351 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-04-25T09:56:25.351 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T09:56:25.351 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T09:56:25.351 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T09:56:25.352 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:56:25.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:56:25.353 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:56:25.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:56:25.418 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:56:25.478 INFO:teuthology.orchestra.run.smithi007.stdout:client5174 2024-04-25T09:56:25.479 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:56:25.479 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:56:25.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:56:25.535 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_a) 2024-04-25T09:56:25.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:56:25.594 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent_a/alpha) 2024-04-25T09:56:25.651 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T09:56:25.651 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T09:56:25.651 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T09:56:25.651 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T09:56:25.651 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/parent_a/alpha").st_ino) 2024-04-25T09:56:25.651 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T09:56:25.757 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627777 2024-04-25T09:56:25.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:56:25.766 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:56:25.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.903+0000 7f2e0a56a640 1 Processor -- start 2024-04-25T09:56:25.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.903+0000 7f2e0a56a640 1 -- start start 2024-04-25T09:56:25.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.904+0000 7f2e0a56a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e0415dd00 0x7f2e040b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:25.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.904+0000 7f2e0a56a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e040b6a40 0x7f2e040b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:25.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.904+0000 7f2e0a56a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e0406cd00 con 0x7f2e0406bfb0 2024-04-25T09:56:25.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.904+0000 7f2e0a56a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e0415e0e0 con 0x7f2e040b6a40 2024-04-25T09:56:25.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.904+0000 7f2e0a56a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0406cfe0 con 0x7f2e0415dd00 2024-04-25T09:56:25.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.904+0000 7f2e03fff640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e0415dd00 0x7f2e040b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:25.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.904+0000 7f2e037fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e040b6a40 0x7f2e040b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:25.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.904+0000 7f2e03fff640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e0415dd00 0x7f2e040b5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:38154/0 (socket says 172.21.15.7:38154) 2024-04-25T09:56:25.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.904+0000 7f2e08b07640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2e0406bfb0 0x7f2e0406c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:58478/0 (socket says 172.21.15.7:58478) 2024-04-25T09:56:25.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.904+0000 7f2e03fff640 1 -- 172.21.15.7:0/3077656113 learned_addr learned my addr 172.21.15.7:0/3077656113 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:25.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.905+0000 7f2e03fff640 1 -- 172.21.15.7:0/3077656113 >> v2:172.21.15.55:3300/0 conn(0x7f2e040b6a40 msgr2=0x7f2e040b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:25.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.905+0000 7f2e03fff640 1 --2- 172.21.15.7:0/3077656113 >> v2:172.21.15.55:3300/0 conn(0x7f2e040b6a40 0x7f2e040b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:25.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.905+0000 7f2e03fff640 1 -- 172.21.15.7:0/3077656113 >> v1:172.21.15.55:6789/0 conn(0x7f2e0406bfb0 legacy=0x7f2e0406c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:25.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.905+0000 7f2e02ffd640 1 -- 172.21.15.7:0/3077656113 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2382387515 0 0) 0x7f2e0406cd00 con 0x7f2e0406bfb0 2024-04-25T09:56:25.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.905+0000 7f2e03fff640 1 -- 172.21.15.7:0/3077656113 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e040d1ca0 con 0x7f2e0415dd00 2024-04-25T09:56:25.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.905+0000 7f2e037fe640 1 --2- 172.21.15.7:0/3077656113 >> v2:172.21.15.55:3300/0 conn(0x7f2e040b6a40 0x7f2e040b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:56:25.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.906+0000 7f2e03fff640 1 --2- 172.21.15.7:0/3077656113 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e0415dd00 0x7f2e040b5750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2df8009870 tx=0x7f2df802a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=526f122e2a6a2673 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:25.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.906+0000 7f2e02ffd640 1 -- 172.21.15.7:0/3077656113 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df8037070 con 0x7f2e0415dd00 2024-04-25T09:56:25.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.906+0000 7f2e02ffd640 1 -- 172.21.15.7:0/3077656113 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df802ae50 con 0x7f2e0415dd00 2024-04-25T09:56:25.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.906+0000 7f2e02ffd640 1 -- 172.21.15.7:0/3077656113 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df8032860 con 0x7f2e0415dd00 2024-04-25T09:56:25.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.906+0000 7f2e0a56a640 1 -- 172.21.15.7:0/3077656113 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e0415dd00 msgr2=0x7f2e040b5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:25.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.906+0000 7f2e0a56a640 1 --2- 172.21.15.7:0/3077656113 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e0415dd00 0x7f2e040b5750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2df8009870 tx=0x7f2df802a300 comp rx=0 tx=0).stop 2024-04-25T09:56:25.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.906+0000 7f2e0a56a640 1 -- 172.21.15.7:0/3077656113 shutdown_connections 2024-04-25T09:56:25.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.906+0000 7f2e0a56a640 1 --2- 172.21.15.7:0/3077656113 >> v2:172.21.15.55:3300/0 conn(0x7f2e040b6a40 0x7f2e040b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:25.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.906+0000 7f2e0a56a640 1 --2- 172.21.15.7:0/3077656113 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e0415dd00 0x7f2e040b5750 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:25.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.906+0000 7f2e0a56a640 1 -- 172.21.15.7:0/3077656113 >> 172.21.15.7:0/3077656113 conn(0x7f2e040d07b0 msgr2=0x7f2e040d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:25.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.906+0000 7f2e0a56a640 1 -- 172.21.15.7:0/3077656113 shutdown_connections 2024-04-25T09:56:25.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.906+0000 7f2e0a56a640 1 -- 172.21.15.7:0/3077656113 wait complete. 2024-04-25T09:56:25.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.907+0000 7f2e0a56a640 1 Processor -- start 2024-04-25T09:56:25.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.908+0000 7f2e0a56a640 1 -- start start 2024-04-25T09:56:25.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.908+0000 7f2e0a56a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e0406bfb0 0x7f2e040c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:25.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.908+0000 7f2e0a56a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e040b6a40 0x7f2e0415c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:25.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.908+0000 7f2e0a56a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e0415dd00 0x7f2e040b7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:25.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.908+0000 7f2e0a56a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e040d2780 con 0x7f2e0406bfb0 2024-04-25T09:56:25.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.908+0000 7f2e0a56a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e040d2260 con 0x7f2e0415dd00 2024-04-25T09:56:25.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.908+0000 7f2e0a56a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e040d2900 con 0x7f2e040b6a40 2024-04-25T09:56:25.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.909+0000 7f2e03fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e0406bfb0 0x7f2e040c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:25.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.909+0000 7f2e03fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e0406bfb0 0x7f2e040c94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56972/0 (socket says 172.21.15.7:56972) 2024-04-25T09:56:25.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.909+0000 7f2e03fff640 1 -- 172.21.15.7:0/623638025 learned_addr learned my addr 172.21.15.7:0/623638025 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:25.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.909+0000 7f2e037fe640 1 --2- 172.21.15.7:0/623638025 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e040b6a40 0x7f2e0415c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:25.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.909+0000 7f2e08b07640 1 --2- 172.21.15.7:0/623638025 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e0415dd00 0x7f2e040b7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:25.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.909+0000 7f2e03fff640 1 -- 172.21.15.7:0/623638025 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e040b6a40 msgr2=0x7f2e0415c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:25.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.909+0000 7f2e03fff640 1 --2- 172.21.15.7:0/623638025 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e040b6a40 0x7f2e0415c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:25.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.909+0000 7f2e03fff640 1 -- 172.21.15.7:0/623638025 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e0415dd00 msgr2=0x7f2e040b7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:25.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.909+0000 7f2e03fff640 1 --2- 172.21.15.7:0/623638025 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e0415dd00 0x7f2e040b7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:25.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.909+0000 7f2e03fff640 1 -- 172.21.15.7:0/623638025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e040caf50 con 0x7f2e0406bfb0 2024-04-25T09:56:25.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.909+0000 7f2e037fe640 1 --2- 172.21.15.7:0/623638025 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e040b6a40 0x7f2e0415c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:56:25.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.909+0000 7f2e08b07640 1 --2- 172.21.15.7:0/623638025 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e0415dd00 0x7f2e040b7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:56:25.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.909+0000 7f2e03fff640 1 --2- 172.21.15.7:0/623638025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e0406bfb0 0x7f2e040c94e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2df8035040 tx=0x7f2df80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:25.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.909+0000 7f2e00ff9640 1 -- 172.21.15.7:0/623638025 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df8037040 con 0x7f2e0406bfb0 2024-04-25T09:56:25.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.909+0000 7f2e00ff9640 1 -- 172.21.15.7:0/623638025 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df8004230 con 0x7f2e0406bfb0 2024-04-25T09:56:25.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.909+0000 7f2e0a56a640 1 -- 172.21.15.7:0/623638025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e0415cd20 con 0x7f2e0406bfb0 2024-04-25T09:56:25.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.909+0000 7f2e00ff9640 1 -- 172.21.15.7:0/623638025 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df8003610 con 0x7f2e0406bfb0 2024-04-25T09:56:25.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.909+0000 7f2e0a56a640 1 -- 172.21.15.7:0/623638025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e040cb1f0 con 0x7f2e0406bfb0 2024-04-25T09:56:25.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.910+0000 7f2e0a56a640 1 -- 172.21.15.7:0/623638025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e04068fd0 con 0x7f2e0406bfb0 2024-04-25T09:56:25.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.911+0000 7f2e00ff9640 1 -- 172.21.15.7:0/623638025 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2df803a070 con 0x7f2e0406bfb0 2024-04-25T09:56:25.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.911+0000 7f2e00ff9640 1 --2- 172.21.15.7:0/623638025 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2df006b4d0 0x7f2df006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:25.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.911+0000 7f2e00ff9640 1 -- 172.21.15.7:0/623638025 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2df80aa960 con 0x7f2e0406bfb0 2024-04-25T09:56:25.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.911+0000 7f2e037fe640 1 --2- 172.21.15.7:0/623638025 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2df006b4d0 0x7f2df006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:25.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.912+0000 7f2e037fe640 1 --2- 172.21.15.7:0/623638025 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2df006b4d0 0x7f2df006d990 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2e040b82e0 tx=0x7f2df4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:25.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:25.915+0000 7f2e00ff9640 1 -- 172.21.15.7:0/623638025 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2df8041020 con 0x7f2e0406bfb0 2024-04-25T09:56:26.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.134+0000 7f2e0a56a640 1 -- 172.21.15.7:0/623638025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e040d1620 con 0x7f2e0406bfb0 2024-04-25T09:56:26.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.134+0000 7f2e00ff9640 1 -- 172.21.15.7:0/623638025 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4932 (secure 0 0 0) 0x7f2df8079650 con 0x7f2e0406bfb0 2024-04-25T09:56:26.138 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:26.138 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5072,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1716545079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1716545079},{"type":"v1","addr":"172.21.15.7:6837","nonce":1716545079}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5434,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1851611776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1851611776},{"type":"v1","addr":"172.21.15.55:6834","nonce":1851611776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2607486300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2607486300},{"type":"v1","addr":"172.21.15.55:6835","nonce":2607486300}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:56:14.756973+0000","modified":"2024-04-25T09:56:16.763894+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5820":{"gid":5820,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6836/2232311564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2232311564},{"type":"v1","addr":"172.21.15.7:6836","nonce":2232311564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:56:26.138 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 21 2024-04-25T09:56:26.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.136+0000 7f2e0a56a640 1 -- 172.21.15.7:0/623638025 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2df006b4d0 msgr2=0x7f2df006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.136+0000 7f2e0a56a640 1 --2- 172.21.15.7:0/623638025 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2df006b4d0 0x7f2df006d990 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2e040b82e0 tx=0x7f2df4008040 comp rx=0 tx=0).stop 2024-04-25T09:56:26.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.136+0000 7f2e0a56a640 1 -- 172.21.15.7:0/623638025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e0406bfb0 msgr2=0x7f2e040c94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.136+0000 7f2e0a56a640 1 --2- 172.21.15.7:0/623638025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e0406bfb0 0x7f2e040c94e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2df8035040 tx=0x7f2df80046c0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.137+0000 7f2e0a56a640 1 -- 172.21.15.7:0/623638025 shutdown_connections 2024-04-25T09:56:26.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.137+0000 7f2e0a56a640 1 --2- 172.21.15.7:0/623638025 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2df006b4d0 0x7f2df006d990 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.137+0000 7f2e0a56a640 1 --2- 172.21.15.7:0/623638025 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e0415dd00 0x7f2e040b7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.137+0000 7f2e0a56a640 1 --2- 172.21.15.7:0/623638025 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e040b6a40 0x7f2e0415c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.137+0000 7f2e0a56a640 1 --2- 172.21.15.7:0/623638025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e0406bfb0 0x7f2e040c94e0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.137+0000 7f2e0a56a640 1 -- 172.21.15.7:0/623638025 >> 172.21.15.7:0/623638025 conn(0x7f2e040d07b0 msgr2=0x7f2e040c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:26.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.137+0000 7f2e0a56a640 1 -- 172.21.15.7:0/623638025 shutdown_connections 2024-04-25T09:56:26.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.137+0000 7f2e0a56a640 1 -- 172.21.15.7:0/623638025 wait complete. 2024-04-25T09:56:26.151 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-25T09:56:26.273 INFO:teuthology.orchestra.run.smithi007.stdout:{"message":"","return_code":0} 2024-04-25T09:56:26.273 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T09:56:26.273 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-04-25T09:56:26.282 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:56:26.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.313+0000 7f01bc461f40 1 Processor -- start 2024-04-25T09:56:26.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.314+0000 7f01bc461f40 1 -- start start 2024-04-25T09:56:26.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.314+0000 7f01bc461f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01a8003ab0 0x55cda43fc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.314+0000 7f01bc461f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cda44b43b0 0x55cda44d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.314+0000 7f01bc461f40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55cda44d15e0 0x55cda44b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.314+0000 7f01bc461f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda43a2df0 con 0x7f01a8003ab0 2024-04-25T09:56:26.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.314+0000 7f01bc461f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda43a6d50 con 0x55cda44b43b0 2024-04-25T09:56:26.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.314+0000 7f01bc461f40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cda43fa0b0 con 0x55cda44d15e0 2024-04-25T09:56:26.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.314+0000 7f01b9f62640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01a8003ab0 0x55cda43fc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.314+0000 7f01b9f62640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01a8003ab0 0x55cda43fc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57002/0 (socket says 172.21.15.7:57002) 2024-04-25T09:56:26.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.314+0000 7f01b9f62640 1 -- 172.21.15.7:0/4219379308 learned_addr learned my addr 172.21.15.7:0/4219379308 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:26.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.315+0000 7f01ba763640 1 --2- 172.21.15.7:0/4219379308 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55cda44d15e0 0x55cda44b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.315+0000 7f01b9761640 1 --2- 172.21.15.7:0/4219379308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cda44b43b0 0x55cda44d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.315+0000 7f01b9f62640 1 -- 172.21.15.7:0/4219379308 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55cda44d15e0 msgr2=0x55cda44b2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:26.319 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:56:26.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.315+0000 7f01b9f62640 1 --2- 172.21.15.7:0/4219379308 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55cda44d15e0 0x55cda44b2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.315+0000 7f01b9f62640 1 -- 172.21.15.7:0/4219379308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cda44b43b0 msgr2=0x55cda44d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:26.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.315+0000 7f01b9f62640 1 --2- 172.21.15.7:0/4219379308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cda44b43b0 0x55cda44d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.315+0000 7f01b9f62640 1 -- 172.21.15.7:0/4219379308 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cda44b5250 con 0x7f01a8003ab0 2024-04-25T09:56:26.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.315+0000 7f01b9761640 1 --2- 172.21.15.7:0/4219379308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cda44b43b0 0x55cda44d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:56:26.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.315+0000 7f01b9f62640 1 --2- 172.21.15.7:0/4219379308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01a8003ab0 0x55cda43fc7e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f01b4002f90 tx=0x7f01b400e760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b99be7366e6e852 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:26.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.315+0000 7f01b3fff640 1 -- 172.21.15.7:0/4219379308 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b4001ac0 con 0x7f01a8003ab0 2024-04-25T09:56:26.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.315+0000 7f01b3fff640 1 -- 172.21.15.7:0/4219379308 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b4001c60 con 0x7f01a8003ab0 2024-04-25T09:56:26.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.315+0000 7f01b3fff640 1 -- 172.21.15.7:0/4219379308 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b4002230 con 0x7f01a8003ab0 2024-04-25T09:56:26.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.315+0000 7f01bc461f40 1 -- 172.21.15.7:0/4219379308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01a8003ab0 msgr2=0x55cda43fc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.315+0000 7f01bc461f40 1 --2- 172.21.15.7:0/4219379308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01a8003ab0 0x55cda43fc7e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f01b4002f90 tx=0x7f01b400e760 comp rx=0 tx=0).stop 2024-04-25T09:56:26.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.315+0000 7f01bc461f40 1 -- 172.21.15.7:0/4219379308 shutdown_connections 2024-04-25T09:56:26.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.315+0000 7f01bc461f40 1 --2- 172.21.15.7:0/4219379308 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55cda44d15e0 0x55cda44b2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.315+0000 7f01bc461f40 1 --2- 172.21.15.7:0/4219379308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cda44b43b0 0x55cda44d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.315+0000 7f01bc461f40 1 --2- 172.21.15.7:0/4219379308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01a8003ab0 0x55cda43fc7e0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.315+0000 7f01bc461f40 1 -- 172.21.15.7:0/4219379308 >> 172.21.15.7:0/4219379308 conn(0x55cda43faa60 msgr2=0x55cda44d69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.315+0000 7f01bc461f40 1 -- 172.21.15.7:0/4219379308 shutdown_connections 2024-04-25T09:56:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.316+0000 7f01bc461f40 1 -- 172.21.15.7:0/4219379308 wait complete. 2024-04-25T09:56:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.316+0000 7f01bc461f40 1 Processor -- start 2024-04-25T09:56:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.316+0000 7f01bc461f40 1 -- start start 2024-04-25T09:56:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.317+0000 7f01bc461f40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55cda44b43b0 0x55cda44d0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.317+0000 7f01bc461f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cda44d15e0 0x55cda44ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.317+0000 7f01bc461f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01a8003ab0 0x55cda44aeb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.317+0000 7f01bc461f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda44b3e00 con 0x7f01a8003ab0 2024-04-25T09:56:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.317+0000 7f01bc461f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda44b54d0 con 0x55cda44d15e0 2024-04-25T09:56:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.317+0000 7f01bc461f40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cda43fbab0 con 0x55cda44b43b0 2024-04-25T09:56:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.317+0000 7f01ba763640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01a8003ab0 0x55cda44aeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.317+0000 7f01ba763640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01a8003ab0 0x55cda44aeb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57006/0 (socket says 172.21.15.7:57006) 2024-04-25T09:56:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.317+0000 7f01ba763640 1 -- 172.21.15.7:0/2695290370 learned_addr learned my addr 172.21.15.7:0/2695290370 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.317+0000 7f01b9761640 1 --2- 172.21.15.7:0/2695290370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cda44d15e0 0x55cda44ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.317+0000 7f01b9f62640 1 --2- 172.21.15.7:0/2695290370 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55cda44b43b0 0x55cda44d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.317+0000 7f01ba763640 1 -- 172.21.15.7:0/2695290370 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55cda44b43b0 msgr2=0x55cda44d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.317+0000 7f01ba763640 1 --2- 172.21.15.7:0/2695290370 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55cda44b43b0 0x55cda44d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.317+0000 7f01ba763640 1 -- 172.21.15.7:0/2695290370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cda44d15e0 msgr2=0x55cda44ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.317+0000 7f01ba763640 1 --2- 172.21.15.7:0/2695290370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cda44d15e0 0x55cda44ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.317+0000 7f01ba763640 1 -- 172.21.15.7:0/2695290370 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cda44cd180 con 0x7f01a8003ab0 2024-04-25T09:56:26.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.317+0000 7f01b9f62640 1 --2- 172.21.15.7:0/2695290370 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55cda44b43b0 0x55cda44d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:56:26.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.317+0000 7f01ba763640 1 --2- 172.21.15.7:0/2695290370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01a8003ab0 0x55cda44aeb70 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f01ac0012e0 tx=0x55cda44cd9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:26.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.318+0000 7f01b2ffd640 1 -- 172.21.15.7:0/2695290370 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ac001c10 con 0x7f01a8003ab0 2024-04-25T09:56:26.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.318+0000 7f01b2ffd640 1 -- 172.21.15.7:0/2695290370 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ac006070 con 0x7f01a8003ab0 2024-04-25T09:56:26.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.318+0000 7f01b2ffd640 1 -- 172.21.15.7:0/2695290370 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ac04d950 con 0x7f01a8003ab0 2024-04-25T09:56:26.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.318+0000 7f01bc461f40 1 -- 172.21.15.7:0/2695290370 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cda44cdc00 con 0x7f01a8003ab0 2024-04-25T09:56:26.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.318+0000 7f01bc461f40 1 -- 172.21.15.7:0/2695290370 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cda44ce1c0 con 0x7f01a8003ab0 2024-04-25T09:56:26.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.319+0000 7f01b2ffd640 1 -- 172.21.15.7:0/2695290370 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f01ac05f030 con 0x7f01a8003ab0 2024-04-25T09:56:26.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.319+0000 7f01b2ffd640 1 --2- 172.21.15.7:0/2695290370 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f019c069eb0 0x7f019c06c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.320+0000 7f01b2ffd640 1 -- 172.21.15.7:0/2695290370 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f01ac0cb5c0 con 0x7f01a8003ab0 2024-04-25T09:56:26.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.320+0000 7f01b9f62640 1 --2- 172.21.15.7:0/2695290370 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f019c069eb0 0x7f019c06c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.320+0000 7f01bc461f40 1 --2- 172.21.15.7:0/2695290370 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x55cda44ce9c0 0x55cda44cee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.320+0000 7f01bc461f40 1 -- 172.21.15.7:0/2695290370 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v9 -- 0x55cda44cf360 con 0x55cda44ce9c0 2024-04-25T09:56:26.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.320+0000 7f01b9761640 1 --2- 172.21.15.7:0/2695290370 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x55cda44ce9c0 0x55cda44cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.320+0000 7f01b9f62640 1 --2- 172.21.15.7:0/2695290370 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f019c069eb0 0x7f019c06c370 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f01b4002f30 tx=0x7f01b4008000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:26.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.320+0000 7f01b9761640 1 --2- 172.21.15.7:0/2695290370 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x55cda44ce9c0 0x55cda44cee20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:26.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.321+0000 7f01b9761640 1 -- 172.21.15.7:0/2695290370 <== osd.1 v2:172.21.15.7:6816/434435857 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7f01a4009a60 con 0x55cda44ce9c0 2024-04-25T09:56:26.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.321+0000 7f01bc461f40 1 -- 172.21.15.7:0/2695290370 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x55cda44ce9c0 msgr2=0x55cda44cee20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.321+0000 7f01bc461f40 1 --2- 172.21.15.7:0/2695290370 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x55cda44ce9c0 0x55cda44cee20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.321+0000 7f01bc461f40 1 -- 172.21.15.7:0/2695290370 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f019c069eb0 msgr2=0x7f019c06c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.321+0000 7f01bc461f40 1 --2- 172.21.15.7:0/2695290370 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f019c069eb0 0x7f019c06c370 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f01b4002f30 tx=0x7f01b4008000 comp rx=0 tx=0).stop 2024-04-25T09:56:26.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.321+0000 7f01bc461f40 1 -- 172.21.15.7:0/2695290370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01a8003ab0 msgr2=0x55cda44aeb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.321+0000 7f01bc461f40 1 --2- 172.21.15.7:0/2695290370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01a8003ab0 0x55cda44aeb70 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f01ac0012e0 tx=0x55cda44cd9f0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.321+0000 7f01ba763640 1 -- 172.21.15.7:0/2695290370 reap_dead start 2024-04-25T09:56:26.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.321+0000 7f01bc461f40 1 -- 172.21.15.7:0/2695290370 shutdown_connections 2024-04-25T09:56:26.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.321+0000 7f01bc461f40 1 -- 172.21.15.7:0/2695290370 >> 172.21.15.7:0/2695290370 conn(0x55cda43faa60 msgr2=0x55cda44d69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:26.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.321+0000 7f01bc461f40 1 -- 172.21.15.7:0/2695290370 shutdown_connections 2024-04-25T09:56:26.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.321+0000 7f01bc461f40 1 -- 172.21.15.7:0/2695290370 wait complete. 2024-04-25T09:56:26.330 INFO:teuthology.orchestra.run.smithi007.stdout:Yalphaparent_a 2024-04-25T09:56:26.330 DEBUG:teuthology.orchestra.run.smithi007:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-04-25T09:56:26.435 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T09:56:26.435 INFO:teuthology.orchestra.run.smithi007.stdout: "ino": 1099511627777, 2024-04-25T09:56:26.435 INFO:teuthology.orchestra.run.smithi007.stdout: "ancestors": [ 2024-04-25T09:56:26.435 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:56:26.435 INFO:teuthology.orchestra.run.smithi007.stdout: "dirino": 1099511627776, 2024-04-25T09:56:26.436 INFO:teuthology.orchestra.run.smithi007.stdout: "dname": "alpha", 2024-04-25T09:56:26.436 INFO:teuthology.orchestra.run.smithi007.stdout: "version": 2 2024-04-25T09:56:26.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:56:26.436 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:56:26.436 INFO:teuthology.orchestra.run.smithi007.stdout: "dirino": 1, 2024-04-25T09:56:26.436 INFO:teuthology.orchestra.run.smithi007.stdout: "dname": "parent_a", 2024-04-25T09:56:26.436 INFO:teuthology.orchestra.run.smithi007.stdout: "version": 4 2024-04-25T09:56:26.436 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:56:26.436 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-25T09:56:26.436 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 8, 2024-04-25T09:56:26.436 INFO:teuthology.orchestra.run.smithi007.stdout: "old_pools": [] 2024-04-25T09:56:26.436 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T09:56:26.436 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:26.453 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'oh i'"'"'m sorry did i overwrite your xattr?' 2024-04-25T09:56:26.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.534+0000 7fe41e3d6f40 1 Processor -- start 2024-04-25T09:56:26.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.534+0000 7fe41e3d6f40 1 -- start start 2024-04-25T09:56:26.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.534+0000 7fe41e3d6f40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563164728e70 0x563164802fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.534+0000 7fe41e3d6f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5631647f6ad0 0x5631647f38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.534+0000 7fe41e3d6f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631647f6eb0 0x563164801360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.534+0000 7fe41e3d6f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631646d1df0 con 0x5631647f6eb0 2024-04-25T09:56:26.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.534+0000 7fe41e3d6f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631646d5d50 con 0x5631647f6ad0 2024-04-25T09:56:26.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.534+0000 7fe41e3d6f40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5631648047f0 con 0x563164728e70 2024-04-25T09:56:26.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.534+0000 7fe41c6d8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631647f6eb0 0x563164801360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.535+0000 7fe41c6d8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631647f6eb0 0x563164801360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57024/0 (socket says 172.21.15.7:57024) 2024-04-25T09:56:26.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.535+0000 7fe41c6d8640 1 -- 172.21.15.7:0/603067557 learned_addr learned my addr 172.21.15.7:0/603067557 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:26.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.535+0000 7fe41b6d6640 1 --2- 172.21.15.7:0/603067557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5631647f6ad0 0x5631647f38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.535+0000 7fe41bed7640 1 --2- 172.21.15.7:0/603067557 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563164728e70 0x563164802fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.535+0000 7fe41c6d8640 1 -- 172.21.15.7:0/603067557 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563164728e70 msgr2=0x563164802fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:26.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.535+0000 7fe41c6d8640 1 --2- 172.21.15.7:0/603067557 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563164728e70 0x563164802fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.535+0000 7fe41c6d8640 1 -- 172.21.15.7:0/603067557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5631647f6ad0 msgr2=0x5631647f38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:26.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.535+0000 7fe41c6d8640 1 --2- 172.21.15.7:0/603067557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5631647f6ad0 0x5631647f38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.535+0000 7fe41c6d8640 1 -- 172.21.15.7:0/603067557 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56316472ac10 con 0x5631647f6eb0 2024-04-25T09:56:26.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.535+0000 7fe41c6d8640 1 --2- 172.21.15.7:0/603067557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631647f6eb0 0x563164801360 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fe40c00a4b0 tx=0x7fe40c050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e32daac48999a577 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:26.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.535+0000 7fe41a6d4640 1 -- 172.21.15.7:0/603067557 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c054040 con 0x5631647f6eb0 2024-04-25T09:56:26.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.535+0000 7fe41a6d4640 1 -- 172.21.15.7:0/603067557 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40c0508c0 con 0x5631647f6eb0 2024-04-25T09:56:26.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.535+0000 7fe41a6d4640 1 -- 172.21.15.7:0/603067557 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c050cb0 con 0x5631647f6eb0 2024-04-25T09:56:26.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.536+0000 7fe41e3d6f40 1 -- 172.21.15.7:0/603067557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631647f6eb0 msgr2=0x563164801360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.536+0000 7fe41e3d6f40 1 --2- 172.21.15.7:0/603067557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631647f6eb0 0x563164801360 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fe40c00a4b0 tx=0x7fe40c050000 comp rx=0 tx=0).stop 2024-04-25T09:56:26.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.536+0000 7fe41e3d6f40 1 -- 172.21.15.7:0/603067557 shutdown_connections 2024-04-25T09:56:26.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.536+0000 7fe41e3d6f40 1 --2- 172.21.15.7:0/603067557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631647f6eb0 0x563164801360 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.536+0000 7fe41e3d6f40 1 --2- 172.21.15.7:0/603067557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5631647f6ad0 0x5631647f38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.536+0000 7fe41e3d6f40 1 --2- 172.21.15.7:0/603067557 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563164728e70 0x563164802fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.536+0000 7fe41e3d6f40 1 -- 172.21.15.7:0/603067557 >> 172.21.15.7:0/603067557 conn(0x563164729a60 msgr2=0x563164756780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:26.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.536+0000 7fe41e3d6f40 1 -- 172.21.15.7:0/603067557 shutdown_connections 2024-04-25T09:56:26.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.536+0000 7fe41e3d6f40 1 -- 172.21.15.7:0/603067557 wait complete. 2024-04-25T09:56:26.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.536+0000 7fe41e3d6f40 1 Processor -- start 2024-04-25T09:56:26.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.536+0000 7fe41e3d6f40 1 -- start start 2024-04-25T09:56:26.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.537+0000 7fe41e3d6f40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563164728e70 0x563164756690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.537+0000 7fe41e3d6f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631647f6ad0 0x5631647ecc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.537+0000 7fe41e3d6f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5631647f6eb0 0x5631647ed1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.537+0000 7fe41e3d6f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x563164754ad0 con 0x5631647f6ad0 2024-04-25T09:56:26.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.537+0000 7fe41e3d6f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631647f9b50 con 0x5631647f6eb0 2024-04-25T09:56:26.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.537+0000 7fe41e3d6f40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5631647f3e30 con 0x563164728e70 2024-04-25T09:56:26.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.537+0000 7fe41b6d6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631647f6ad0 0x5631647ecc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.537+0000 7fe41b6d6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631647f6ad0 0x5631647ecc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57026/0 (socket says 172.21.15.7:57026) 2024-04-25T09:56:26.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.537+0000 7fe41b6d6640 1 -- 172.21.15.7:0/1958308958 learned_addr learned my addr 172.21.15.7:0/1958308958 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:26.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.537+0000 7fe41bed7640 1 --2- 172.21.15.7:0/1958308958 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563164728e70 0x563164756690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.537+0000 7fe41c6d8640 1 --2- 172.21.15.7:0/1958308958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5631647f6eb0 0x5631647ed1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.538+0000 7fe41b6d6640 1 -- 172.21.15.7:0/1958308958 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563164728e70 msgr2=0x563164756690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.538+0000 7fe41b6d6640 1 --2- 172.21.15.7:0/1958308958 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563164728e70 0x563164756690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.538+0000 7fe41b6d6640 1 -- 172.21.15.7:0/1958308958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5631647f6eb0 msgr2=0x5631647ed1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.538+0000 7fe41b6d6640 1 --2- 172.21.15.7:0/1958308958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5631647f6eb0 0x5631647ed1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.538+0000 7fe41b6d6640 1 -- 172.21.15.7:0/1958308958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5631647edd30 con 0x5631647f6ad0 2024-04-25T09:56:26.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.538+0000 7fe41c6d8640 1 --2- 172.21.15.7:0/1958308958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5631647f6eb0 0x5631647ed1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:26.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.538+0000 7fe41b6d6640 1 --2- 172.21.15.7:0/1958308958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631647f6ad0 0x5631647ecc80 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe40400dfc0 tx=0x7fe40400b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:26.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.538+0000 7fe4196d2640 1 -- 172.21.15.7:0/1958308958 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe404015070 con 0x5631647f6ad0 2024-04-25T09:56:26.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.538+0000 7fe4196d2640 1 -- 172.21.15.7:0/1958308958 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe404011640 con 0x5631647f6ad0 2024-04-25T09:56:26.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.538+0000 7fe41e3d6f40 1 -- 172.21.15.7:0/1958308958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5631647f2940 con 0x5631647f6ad0 2024-04-25T09:56:26.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.538+0000 7fe4196d2640 1 -- 172.21.15.7:0/1958308958 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe404011a30 con 0x5631647f6ad0 2024-04-25T09:56:26.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.538+0000 7fe41e3d6f40 1 -- 172.21.15.7:0/1958308958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5631647ec930 con 0x5631647f6ad0 2024-04-25T09:56:26.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.539+0000 7fe4196d2640 1 -- 172.21.15.7:0/1958308958 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe404018070 con 0x5631647f6ad0 2024-04-25T09:56:26.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.540+0000 7fe4196d2640 1 --2- 172.21.15.7:0/1958308958 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe3fc069ee0 0x7fe3fc06c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.540+0000 7fe4196d2640 1 -- 172.21.15.7:0/1958308958 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe404089020 con 0x5631647f6ad0 2024-04-25T09:56:26.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.540+0000 7fe41bed7640 1 --2- 172.21.15.7:0/1958308958 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe3fc069ee0 0x7fe3fc06c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.540+0000 7fe41e3d6f40 1 --2- 172.21.15.7:0/1958308958 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x563164729e40 0x5631648a8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.540+0000 7fe41e3d6f40 1 -- 172.21.15.7:0/1958308958 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [setxattr parent (40) in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) v9 -- 0x5631648a9120 con 0x563164729e40 2024-04-25T09:56:26.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.540+0000 7fe41c6d8640 1 --2- 172.21.15.7:0/1958308958 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x563164729e40 0x5631648a8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.540+0000 7fe41bed7640 1 --2- 172.21.15.7:0/1958308958 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe3fc069ee0 0x7fe3fc06c3a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe414000c00 tx=0x7fe4140018b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:26.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.540+0000 7fe41c6d8640 1 --2- 172.21.15.7:0/1958308958 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x563164729e40 0x5631648a8be0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:26.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.541+0000 7fe41c6d8640 1 -- 172.21.15.7:0/1958308958 <== osd.1 v2:172.21.15.7:6816/434435857 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (40)] v51'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fe40c056030 con 0x563164729e40 2024-04-25T09:56:26.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.542+0000 7fe41e3d6f40 1 -- 172.21.15.7:0/1958308958 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x563164729e40 msgr2=0x5631648a8be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.542+0000 7fe41e3d6f40 1 --2- 172.21.15.7:0/1958308958 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x563164729e40 0x5631648a8be0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.542+0000 7fe41e3d6f40 1 -- 172.21.15.7:0/1958308958 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe3fc069ee0 msgr2=0x7fe3fc06c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.542+0000 7fe41e3d6f40 1 --2- 172.21.15.7:0/1958308958 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe3fc069ee0 0x7fe3fc06c3a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe414000c00 tx=0x7fe4140018b0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.542+0000 7fe41e3d6f40 1 -- 172.21.15.7:0/1958308958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631647f6ad0 msgr2=0x5631647ecc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.542+0000 7fe41e3d6f40 1 --2- 172.21.15.7:0/1958308958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5631647f6ad0 0x5631647ecc80 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe40400dfc0 tx=0x7fe40400b5b0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.542+0000 7fe41c6d8640 1 -- 172.21.15.7:0/1958308958 reap_dead start 2024-04-25T09:56:26.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.542+0000 7fe41e3d6f40 1 -- 172.21.15.7:0/1958308958 shutdown_connections 2024-04-25T09:56:26.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.542+0000 7fe41e3d6f40 1 -- 172.21.15.7:0/1958308958 >> 172.21.15.7:0/1958308958 conn(0x563164729a60 msgr2=0x563164802f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:26.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.542+0000 7fe41e3d6f40 1 -- 172.21.15.7:0/1958308958 shutdown_connections 2024-04-25T09:56:26.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.542+0000 7fe41e3d6f40 1 -- 172.21.15.7:0/1958308958 wait complete. 2024-04-25T09:56:26.549 DEBUG:teuthology.orchestra.run.smithi007:> sudo daemon-helper kill ceph --cluster ceph -w 2024-04-25T09:56:26.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:56:26.551 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub start / repair,recursive 2024-04-25T09:56:26.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.654+0000 7f1abdfb0640 1 Processor -- start 2024-04-25T09:56:26.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.654+0000 7f1abdfb0640 1 -- start start 2024-04-25T09:56:26.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.654+0000 7f1abdfb0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ab815de70 0x7f1ab80d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.654+0000 7f1abdfb0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1ab80d3330 0x7f1ab80d3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.654+0000 7f1abdfb0640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab80d2290 con 0x7f1ab80b9290 2024-04-25T09:56:26.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.654+0000 7f1abdfb0640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab80d2570 con 0x7f1ab80d3330 2024-04-25T09:56:26.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.654+0000 7f1abdfb0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab80d2850 con 0x7f1ab815de70 2024-04-25T09:56:26.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.655+0000 7f1ab7fff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1ab80b9290 0x7f1ab80b52f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33002/0 (socket says 172.21.15.7:33002) 2024-04-25T09:56:26.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.655+0000 7f1ab7fff640 1 -- 172.21.15.7:0/2239855746 learned_addr learned my addr 172.21.15.7:0/2239855746 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:56:26.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.655+0000 7f1ab77fe640 1 --2- 172.21.15.7:0/2239855746 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ab815de70 0x7f1ab80d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.655+0000 7f1ab6ffd640 1 --2- 172.21.15.7:0/2239855746 >> v2:172.21.15.55:3300/0 conn(0x7f1ab80d3330 0x7f1ab80d3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.655+0000 7f1ab67fc640 1 -- 172.21.15.7:0/2239855746 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399483373 0 0) 0x7f1ab80d2290 con 0x7f1ab80b9290 2024-04-25T09:56:26.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.655+0000 7f1ab67fc640 1 -- 172.21.15.7:0/2239855746 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1aa0003520 con 0x7f1ab80b9290 2024-04-25T09:56:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.655+0000 7f1ab67fc640 1 -- 172.21.15.7:0/2239855746 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2661988499 0 0) 0x7f1aa0003520 con 0x7f1ab80b9290 2024-04-25T09:56:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.655+0000 7f1ab67fc640 1 -- 172.21.15.7:0/2239855746 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ab815de70 msgr2=0x7f1ab80d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.655+0000 7f1ab67fc640 1 --2- 172.21.15.7:0/2239855746 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ab815de70 0x7f1ab80d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.655+0000 7f1ab67fc640 1 -- 172.21.15.7:0/2239855746 >> v2:172.21.15.55:3300/0 conn(0x7f1ab80d3330 msgr2=0x7f1ab80d3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.655+0000 7f1ab67fc640 1 --2- 172.21.15.7:0/2239855746 >> v2:172.21.15.55:3300/0 conn(0x7f1ab80d3330 0x7f1ab80d3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.655+0000 7f1ab67fc640 1 -- 172.21.15.7:0/2239855746 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab80d2b30 con 0x7f1ab80b9290 2024-04-25T09:56:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.655+0000 7f1ab67fc640 1 -- 172.21.15.7:0/2239855746 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f1ab00019f0 con 0x7f1ab80b9290 2024-04-25T09:56:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.655+0000 7f1ab67fc640 1 -- 172.21.15.7:0/2239855746 >> v1:172.21.15.7:6789/0 conn(0x7f1ab80b9290 legacy=0x7f1ab80b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.655+0000 7f1ab67fc640 1 --2- 172.21.15.7:0/2239855746 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ab815de70 0x7f1aa00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.655+0000 7f1ab67fc640 1 --2- 172.21.15.7:0/2239855746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aa0003f30 0x7f1aa0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.655+0000 7f1ab67fc640 1 --2- 172.21.15.7:0/2239855746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1aa0004d40 0x7f1aa00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.655+0000 7f1ab67fc640 1 -- 172.21.15.7:0/2239855746 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab80d2570 con 0x7f1aa0003f30 2024-04-25T09:56:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.655+0000 7f1ab67fc640 1 -- 172.21.15.7:0/2239855746 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab80d2850 con 0x7f1aa0004d40 2024-04-25T09:56:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.655+0000 7f1ab67fc640 1 -- 172.21.15.7:0/2239855746 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa000b9c0 con 0x7f1ab815de70 2024-04-25T09:56:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.655+0000 7f1ab6ffd640 1 --2- 172.21.15.7:0/2239855746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aa0003f30 0x7f1aa0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.655+0000 7f1ab77fe640 1 --2- 172.21.15.7:0/2239855746 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ab815de70 0x7f1aa00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.655+0000 7f1ab7fff640 1 --2- 172.21.15.7:0/2239855746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1aa0004d40 0x7f1aa00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.656+0000 7f1ab6ffd640 1 -- 172.21.15.7:0/2239855746 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ab815de70 msgr2=0x7f1aa00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:26.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.656+0000 7f1ab6ffd640 1 --2- 172.21.15.7:0/2239855746 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ab815de70 0x7f1aa00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.656+0000 7f1ab6ffd640 1 -- 172.21.15.7:0/2239855746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1aa0004d40 msgr2=0x7f1aa00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:26.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.656+0000 7f1ab6ffd640 1 --2- 172.21.15.7:0/2239855746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1aa0004d40 0x7f1aa00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.656+0000 7f1ab6ffd640 1 -- 172.21.15.7:0/2239855746 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa0003520 con 0x7f1aa0003f30 2024-04-25T09:56:26.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.656+0000 7f1ab6ffd640 1 --2- 172.21.15.7:0/2239855746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aa0003f30 0x7f1aa0004800 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f1aac009a90 tx=0x7f1aa0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf19495ecdde3762 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:26.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.656+0000 7f1ab67fc640 1 -- 172.21.15.7:0/2239855746 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac036070 con 0x7f1aa0003f30 2024-04-25T09:56:26.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.657+0000 7f1ab67fc640 1 -- 172.21.15.7:0/2239855746 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aac031400 con 0x7f1aa0003f30 2024-04-25T09:56:26.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.657+0000 7f1ab67fc640 1 -- 172.21.15.7:0/2239855746 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac009690 con 0x7f1aa0003f30 2024-04-25T09:56:26.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.657+0000 7f1abdfb0640 1 -- 172.21.15.7:0/2239855746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aa0003f30 msgr2=0x7f1aa0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.657+0000 7f1abdfb0640 1 --2- 172.21.15.7:0/2239855746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1aa0003f30 0x7f1aa0004800 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f1aac009a90 tx=0x7f1aa0005830 comp rx=0 tx=0).stop 2024-04-25T09:56:26.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.657+0000 7f1ab7fff640 1 -- 172.21.15.7:0/2239855746 reap_dead start 2024-04-25T09:56:26.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.657+0000 7f1abdfb0640 1 -- 172.21.15.7:0/2239855746 shutdown_connections 2024-04-25T09:56:26.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.657+0000 7f1abdfb0640 1 -- 172.21.15.7:0/2239855746 >> 172.21.15.7:0/2239855746 conn(0x7f1ab80726b0 msgr2=0x7f1ab8072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:26.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.657+0000 7f1abdfb0640 1 -- 172.21.15.7:0/2239855746 shutdown_connections 2024-04-25T09:56:26.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.657+0000 7f1abdfb0640 1 -- 172.21.15.7:0/2239855746 wait complete. 2024-04-25T09:56:26.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.658+0000 7f1abdfb0640 1 Processor -- start 2024-04-25T09:56:26.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.659+0000 7f1abdfb0640 1 -- start start 2024-04-25T09:56:26.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.659+0000 7f1abdfb0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1aa0003f30 0x7f1ab8156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.659+0000 7f1abdfb0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ab81590c0 0x7f1ab81f3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.659+0000 7f1abdfb0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ab81f3740 0x7f1ab815c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.659+0000 7f1abdfb0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab80d3ec0 con 0x7f1ab81590c0 2024-04-25T09:56:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.659+0000 7f1abdfb0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab80d3d40 con 0x7f1aa0003f30 2024-04-25T09:56:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.659+0000 7f1abdfb0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab80d4040 con 0x7f1ab81f3740 2024-04-25T09:56:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.659+0000 7f1ab6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ab81590c0 0x7f1ab81f3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.660+0000 7f1ab6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ab81590c0 0x7f1ab81f3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57056/0 (socket says 172.21.15.7:57056) 2024-04-25T09:56:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.660+0000 7f1ab6ffd640 1 -- 172.21.15.7:0/2251104033 learned_addr learned my addr 172.21.15.7:0/2251104033 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.660+0000 7f1ab77fe640 1 --2- 172.21.15.7:0/2251104033 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1aa0003f30 0x7f1ab8156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.660+0000 7f1ab7fff640 1 --2- 172.21.15.7:0/2251104033 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ab81f3740 0x7f1ab815c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.660+0000 7f1ab6ffd640 1 -- 172.21.15.7:0/2251104033 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ab81f3740 msgr2=0x7f1ab815c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.660+0000 7f1ab6ffd640 1 --2- 172.21.15.7:0/2251104033 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ab81f3740 0x7f1ab815c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.660+0000 7f1ab6ffd640 1 -- 172.21.15.7:0/2251104033 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1aa0003f30 msgr2=0x7f1ab8156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.660+0000 7f1ab6ffd640 1 --2- 172.21.15.7:0/2251104033 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1aa0003f30 0x7f1ab8156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.660+0000 7f1ab6ffd640 1 -- 172.21.15.7:0/2251104033 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab8156f40 con 0x7f1ab81590c0 2024-04-25T09:56:26.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.660+0000 7f1ab6ffd640 1 --2- 172.21.15.7:0/2251104033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ab81590c0 0x7f1ab81f3200 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f1aac000c00 tx=0x7f1aac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:26.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.660+0000 7f1a9ffff640 1 -- 172.21.15.7:0/2251104033 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac040020 con 0x7f1ab81590c0 2024-04-25T09:56:26.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.660+0000 7f1a9ffff640 1 -- 172.21.15.7:0/2251104033 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aac003c60 con 0x7f1ab81590c0 2024-04-25T09:56:26.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.660+0000 7f1abdfb0640 1 -- 172.21.15.7:0/2251104033 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab8156240 con 0x7f1ab81590c0 2024-04-25T09:56:26.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.660+0000 7f1a9ffff640 1 -- 172.21.15.7:0/2251104033 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac036040 con 0x7f1ab81590c0 2024-04-25T09:56:26.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.660+0000 7f1abdfb0640 1 -- 172.21.15.7:0/2251104033 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab80cb790 con 0x7f1ab81590c0 2024-04-25T09:56:26.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.662+0000 7f1a9ffff640 1 -- 172.21.15.7:0/2251104033 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1aac043020 con 0x7f1ab81590c0 2024-04-25T09:56:26.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.662+0000 7f1a9ffff640 1 --2- 172.21.15.7:0/2251104033 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1aa406b500 0x7f1aa406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.663+0000 7f1a9ffff640 1 -- 172.21.15.7:0/2251104033 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1aac0aa290 con 0x7f1ab81590c0 2024-04-25T09:56:26.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.663+0000 7f1ab77fe640 1 --2- 172.21.15.7:0/2251104033 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1aa406b500 0x7f1aa406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.663+0000 7f1ab77fe640 1 --2- 172.21.15.7:0/2251104033 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1aa406b500 0x7f1aa406d9c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8009ae0 tx=0x7f1aa8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:26.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.663+0000 7f1ac0d93740 1 Processor -- start 2024-04-25T09:56:26.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.663+0000 7f1ac0d93740 1 -- start start 2024-04-25T09:56:26.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.665+0000 7f1ac0d93740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557552295bb0 0x557552295f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.665+0000 7f1ac0d93740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557552290830 0x5575522947b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.665+0000 7f1ac0d93740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557552294cf0 0x557552295130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.665+0000 7f1ac0d93740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575521f9ac0 con 0x557552294cf0 2024-04-25T09:56:26.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.665+0000 7f1ac0d93740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575521a2d80 con 0x557552290830 2024-04-25T09:56:26.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.665+0000 7f1ac0d93740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5575521f5b60 con 0x557552295bb0 2024-04-25T09:56:26.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.665+0000 7f1ab7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557552294cf0 0x557552295130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.665+0000 7f1ab7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557552294cf0 0x557552295130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57058/0 (socket says 172.21.15.7:57058) 2024-04-25T09:56:26.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.665+0000 7f1ab7fff640 1 -- 172.21.15.7:0/2817612009 learned_addr learned my addr 172.21.15.7:0/2817612009 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:26.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.665+0000 7f1ab6ffd640 1 --2- 172.21.15.7:0/2817612009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557552290830 0x5575522947b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.665+0000 7f1ab77fe640 1 --2- 172.21.15.7:0/2817612009 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557552295bb0 0x557552295f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.665+0000 7f1ab7fff640 1 -- 172.21.15.7:0/2817612009 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557552295bb0 msgr2=0x557552295f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:26.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.665+0000 7f1ab7fff640 1 --2- 172.21.15.7:0/2817612009 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557552295bb0 0x557552295f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.665+0000 7f1ab7fff640 1 -- 172.21.15.7:0/2817612009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557552290830 msgr2=0x5575522947b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:26.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.665+0000 7f1ab7fff640 1 --2- 172.21.15.7:0/2817612009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557552290830 0x5575522947b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.665+0000 7f1ab7fff640 1 -- 172.21.15.7:0/2817612009 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557551fd67e0 con 0x557552294cf0 2024-04-25T09:56:26.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.665+0000 7f1ab6ffd640 1 --2- 172.21.15.7:0/2817612009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557552290830 0x5575522947b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:56:26.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.665+0000 7f1ab7fff640 1 --2- 172.21.15.7:0/2817612009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557552294cf0 0x557552295130 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f1ab808cbd0 tx=0x7f1ab000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb302ab1c1c83aa7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:26.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.665+0000 7f1a9d7fa640 1 -- 172.21.15.7:0/2817612009 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab0015440 con 0x557552294cf0 2024-04-25T09:56:26.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.665+0000 7f1a9d7fa640 1 -- 172.21.15.7:0/2817612009 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab00155e0 con 0x557552294cf0 2024-04-25T09:56:26.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.665+0000 7f1a9d7fa640 1 -- 172.21.15.7:0/2817612009 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab0015790 con 0x557552294cf0 2024-04-25T09:56:26.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.666+0000 7f1ac0d93740 1 -- 172.21.15.7:0/2817612009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557552294cf0 msgr2=0x557552295130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.666+0000 7f1ac0d93740 1 --2- 172.21.15.7:0/2817612009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557552294cf0 0x557552295130 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f1ab808cbd0 tx=0x7f1ab000a060 comp rx=0 tx=0).stop 2024-04-25T09:56:26.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.666+0000 7f1ac0d93740 1 -- 172.21.15.7:0/2817612009 shutdown_connections 2024-04-25T09:56:26.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.666+0000 7f1ac0d93740 1 --2- 172.21.15.7:0/2817612009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557552294cf0 0x557552295130 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.666+0000 7f1ac0d93740 1 --2- 172.21.15.7:0/2817612009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557552290830 0x5575522947b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.666+0000 7f1ac0d93740 1 --2- 172.21.15.7:0/2817612009 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557552295bb0 0x557552295f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.666+0000 7f1ac0d93740 1 -- 172.21.15.7:0/2817612009 >> 172.21.15.7:0/2817612009 conn(0x557552292cb0 msgr2=0x5575522db770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:26.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.666+0000 7f1ac0d93740 1 -- 172.21.15.7:0/2817612009 shutdown_connections 2024-04-25T09:56:26.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.666+0000 7f1ac0d93740 1 -- 172.21.15.7:0/2817612009 wait complete. 2024-04-25T09:56:26.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.667+0000 7f1ac0d93740 1 -- start start 2024-04-25T09:56:26.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.667+0000 7f1ac0d93740 1 Processor -- start 2024-04-25T09:56:26.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.668+0000 7f1ac0d93740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557552294cf0 0x5575522b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.668+0000 7f1ac0d93740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557552295bb0 0x5575522b2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.668+0000 7f1ac0d93740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575522b2c40 0x5575522e0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.668+0000 7f1ac0d93740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575522c1740 con 0x5575522b2c40 2024-04-25T09:56:26.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.668+0000 7f1ac0d93740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557552198530 con 0x557552294cf0 2024-04-25T09:56:26.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.668+0000 7f1ac0d93740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5575522c0bc0 con 0x557552295bb0 2024-04-25T09:56:26.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.668+0000 7f1ac0d93740 10 client.0 _ll_register_callbacks cb 0x5575521f0130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:56:26.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.668+0000 7f1ab7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575522b2c40 0x5575522e0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.668+0000 7f1ab7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575522b2c40 0x5575522e0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57066/0 (socket says 172.21.15.7:57066) 2024-04-25T09:56:26.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.668+0000 7f1ab7fff640 1 -- 172.21.15.7:0/746052854 learned_addr learned my addr 172.21.15.7:0/746052854 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:26.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.668+0000 7f1ab77fe640 1 --2- 172.21.15.7:0/746052854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557552294cf0 0x5575522b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.668+0000 7f1ab6ffd640 1 --2- 172.21.15.7:0/746052854 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557552295bb0 0x5575522b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.668+0000 7f1ab7fff640 1 -- 172.21.15.7:0/746052854 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557552295bb0 msgr2=0x5575522b2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:26.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.668+0000 7f1ab7fff640 1 --2- 172.21.15.7:0/746052854 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557552295bb0 0x5575522b2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.668+0000 7f1ab7fff640 1 -- 172.21.15.7:0/746052854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557552294cf0 msgr2=0x5575522b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:26.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.668+0000 7f1ab7fff640 1 --2- 172.21.15.7:0/746052854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557552294cf0 0x5575522b2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.668+0000 7f1ab7fff640 1 -- 172.21.15.7:0/746052854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557552036f70 con 0x5575522b2c40 2024-04-25T09:56:26.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.668+0000 7f1ab7fff640 1 --2- 172.21.15.7:0/746052854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575522b2c40 0x5575522e0830 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f1ab80b96b0 tx=0x7f1ab80d2460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9340e9b7c85f19c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:26.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.668+0000 7f1a967fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:56:26.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.669+0000 7f1a967fc640 1 -- 172.21.15.7:0/746052854 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab0028060 con 0x5575522b2c40 2024-04-25T09:56:26.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.669+0000 7f1a967fc640 1 -- 172.21.15.7:0/746052854 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1ab00172e0 con 0x5575522b2c40 2024-04-25T09:56:26.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.669+0000 7f1ac0d93740 1 -- 172.21.15.7:0/746052854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1ab00155e0 con 0x5575522b2c40 2024-04-25T09:56:26.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.669+0000 7f1a967fc640 1 -- 172.21.15.7:0/746052854 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ab002e050 con 0x5575522b2c40 2024-04-25T09:56:26.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.669+0000 7f1ac0d93740 10 client.6039 fetch_fsmap learned FSMap version 21 2024-04-25T09:56:26.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.669+0000 7f1ac0d93740 1 -- 172.21.15.7:0/746052854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x557551ece170 con 0x5575522b2c40 2024-04-25T09:56:26.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.669+0000 7f1a967fc640 1 -- 172.21.15.7:0/746052854 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab00155e0 con 0x5575522b2c40 2024-04-25T09:56:26.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.669+0000 7f1a967fc640 1 -- 172.21.15.7:0/746052854 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 21) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1ab0031020 con 0x5575522b2c40 2024-04-25T09:56:26.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.669+0000 7f1ac0d93740 10 client.6039 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T09:56:26.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.669+0000 7f1ac0d93740 10 client.6039 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-04-25T09:56:26.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.669+0000 7f1ac0d93740 20 client.6039 populate_metadata read hostname 'smithi007' 2024-04-25T09:56:26.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.669+0000 7f1ac0d93740 1 --2- 172.21.15.7:0/746052854 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x5575522dccf0 0x5575522dd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.669+0000 7f1ac0d93740 4 client.6039 mds_command: new command op to 5820 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:56:26.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.669+0000 7f1ac0d93740 1 -- 172.21.15.7:0/746052854 --> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557552207000 con 0x5575522dccf0 2024-04-25T09:56:26.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.669+0000 7f1ab77fe640 1 --2- 172.21.15.7:0/746052854 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x5575522dccf0 0x5575522dd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.670+0000 7f1a967fc640 10 client.6039 ms_handle_connect on v2:172.21.15.7:6835/2232311564 2024-04-25T09:56:26.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.670+0000 7f1ab77fe640 1 --2- 172.21.15.7:0/746052854 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x5575522dccf0 0x5575522dd0f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9699b3f7af8853b6 server_cookie=742e4bdf46370c86 in_seq=0 out_seq=0 2024-04-25T09:56:26.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.670+0000 7f1a967fc640 1 -- 172.21.15.7:0/746052854 <== mds.0 v2:172.21.15.7:6835/2232311564 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557552207000 con 0x5575522dccf0 2024-04-25T09:56:26.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.670+0000 7f1a967fc640 10 client.6039 handle_command_reply: tid=0 2024-04-25T09:56:26.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.670+0000 7f1ac0d93740 1 client.6039 shutdown 2024-04-25T09:56:26.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.670+0000 7f1ac0d93740 1 -- 172.21.15.7:0/746052854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575522b2c40 msgr2=0x5575522e0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.670+0000 7f1ac0d93740 1 --2- 172.21.15.7:0/746052854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575522b2c40 0x5575522e0830 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f1ab80b96b0 tx=0x7f1ab80d2460 comp rx=0 tx=0).stop 2024-04-25T09:56:26.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.670+0000 7f1ac0d93740 1 -- 172.21.15.7:0/746052854 shutdown_connections 2024-04-25T09:56:26.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.670+0000 7f1ac0d93740 1 --2- 172.21.15.7:0/746052854 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x5575522dccf0 0x5575522dd0f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.670+0000 7f1ac0d93740 1 --2- 172.21.15.7:0/746052854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575522b2c40 0x5575522e0830 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.670+0000 7f1ac0d93740 1 --2- 172.21.15.7:0/746052854 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557552295bb0 0x5575522b2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.670+0000 7f1ac0d93740 1 --2- 172.21.15.7:0/746052854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557552294cf0 0x5575522b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.670+0000 7f1ac0d93740 1 -- 172.21.15.7:0/746052854 >> 172.21.15.7:0/746052854 conn(0x557552290830 msgr2=0x55755228ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:26.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.670+0000 7f1a967fc640 0 client.6039 ms_handle_reset on v2:172.21.15.7:6835/2232311564 2024-04-25T09:56:26.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.671+0000 7f1ac0d93740 1 -- 172.21.15.7:0/746052854 shutdown_connections 2024-04-25T09:56:26.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.671+0000 7f1ac0d93740 1 -- 172.21.15.7:0/746052854 wait complete. 2024-04-25T09:56:26.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.671+0000 7f1ac0d93740 20 client.6039 trim_cache size 0 max 16384 2024-04-25T09:56:26.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.675+0000 7f4662cb3640 1 Processor -- start 2024-04-25T09:56:26.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.675+0000 7f4662cb3640 1 -- start start 2024-04-25T09:56:26.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.676+0000 7f4662cb3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f465c0ced70 0x7f465c0d1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.676+0000 7f4662cb3640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f465c0b79d0 con 0x7f465c0d3390 2024-04-25T09:56:26.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.676+0000 7f4662cb3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f465c0d22f0 con 0x7f465c15deb0 2024-04-25T09:56:26.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.676+0000 7f4662cb3640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f465c0d25d0 con 0x7f465c0ced70 2024-04-25T09:56:26.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.676+0000 7f4653fff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f465c0d3390 0x7f465c0ce660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33004/0 (socket says 172.21.15.7:33004) 2024-04-25T09:56:26.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.676+0000 7f4653fff640 1 -- 172.21.15.7:0/2131518184 learned_addr learned my addr 172.21.15.7:0/2131518184 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:56:26.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.676+0000 7f4661250640 1 --2- 172.21.15.7:0/2131518184 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f465c0ced70 0x7f465c0d1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.676+0000 7f46537fe640 1 -- 172.21.15.7:0/2131518184 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2086597709 0 0) 0x7f465c0b79d0 con 0x7f465c0d3390 2024-04-25T09:56:26.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.676+0000 7f46537fe640 1 -- 172.21.15.7:0/2131518184 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4644003520 con 0x7f465c0d3390 2024-04-25T09:56:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.676+0000 7f46537fe640 1 -- 172.21.15.7:0/2131518184 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 187523723 0 0) 0x7f4644003520 con 0x7f465c0d3390 2024-04-25T09:56:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.676+0000 7f46537fe640 1 -- 172.21.15.7:0/2131518184 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f465c0ced70 msgr2=0x7f465c0d1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.676+0000 7f46537fe640 1 --2- 172.21.15.7:0/2131518184 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f465c0ced70 0x7f465c0d1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.676+0000 7f46537fe640 1 -- 172.21.15.7:0/2131518184 >> v1:172.21.15.55:6789/0 conn(0x7f465c15deb0 legacy=0x7f465c0b9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.676+0000 7f46537fe640 1 -- 172.21.15.7:0/2131518184 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465c0d28b0 con 0x7f465c0d3390 2024-04-25T09:56:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.676+0000 7f46537fe640 1 -- 172.21.15.7:0/2131518184 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f464c001690 con 0x7f465c0d3390 2024-04-25T09:56:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.677+0000 7f46537fe640 1 -- 172.21.15.7:0/2131518184 >> v1:172.21.15.7:6789/0 conn(0x7f465c0d3390 legacy=0x7f465c0ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.677+0000 7f46537fe640 1 --2- 172.21.15.7:0/2131518184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46440039e0 0x7f4644003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.677+0000 7f46537fe640 1 --2- 172.21.15.7:0/2131518184 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f465c0ced70 0x7f4644004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.677+0000 7f46537fe640 1 --2- 172.21.15.7:0/2131518184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4644004d40 0x7f46440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.677+0000 7f46537fe640 1 -- 172.21.15.7:0/2131518184 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465c0d25d0 con 0x7f46440039e0 2024-04-25T09:56:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.677+0000 7f46537fe640 1 -- 172.21.15.7:0/2131518184 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464400bb20 con 0x7f4644004d40 2024-04-25T09:56:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.677+0000 7f46537fe640 1 -- 172.21.15.7:0/2131518184 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464400bd20 con 0x7f465c0ced70 2024-04-25T09:56:26.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.677+0000 7f4660a4f640 1 --2- 172.21.15.7:0/2131518184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46440039e0 0x7f4644003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.677+0000 7f4661250640 1 --2- 172.21.15.7:0/2131518184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4644004d40 0x7f46440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.677+0000 7f4653fff640 1 --2- 172.21.15.7:0/2131518184 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f465c0ced70 0x7f4644004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.677+0000 7f4660a4f640 1 -- 172.21.15.7:0/2131518184 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f465c0ced70 msgr2=0x7f4644004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:26.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.677+0000 7f4660a4f640 1 --2- 172.21.15.7:0/2131518184 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f465c0ced70 0x7f4644004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.677+0000 7f4660a4f640 1 -- 172.21.15.7:0/2131518184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4644004d40 msgr2=0x7f46440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:26.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.677+0000 7f4660a4f640 1 --2- 172.21.15.7:0/2131518184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4644004d40 0x7f46440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.677+0000 7f4660a4f640 1 -- 172.21.15.7:0/2131518184 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4644003520 con 0x7f46440039e0 2024-04-25T09:56:26.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.677+0000 7f4661250640 1 --2- 172.21.15.7:0/2131518184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4644004d40 0x7f46440051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:26.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.678+0000 7f4660a4f640 1 --2- 172.21.15.7:0/2131518184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46440039e0 0x7f4644003e00 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f4658001750 tx=0x7f4644005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a749b4dc12dd9461 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:26.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.678+0000 7f46537fe640 1 -- 172.21.15.7:0/2131518184 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4658001370 con 0x7f46440039e0 2024-04-25T09:56:26.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.678+0000 7f46537fe640 1 -- 172.21.15.7:0/2131518184 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46580052d0 con 0x7f46440039e0 2024-04-25T09:56:26.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.678+0000 7f46537fe640 1 -- 172.21.15.7:0/2131518184 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465802ab20 con 0x7f46440039e0 2024-04-25T09:56:26.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.678+0000 7f4662cb3640 1 -- 172.21.15.7:0/2131518184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46440039e0 msgr2=0x7f4644003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.678+0000 7f4662cb3640 1 --2- 172.21.15.7:0/2131518184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46440039e0 0x7f4644003e00 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f4658001750 tx=0x7f4644005830 comp rx=0 tx=0).stop 2024-04-25T09:56:26.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.678+0000 7f4661250640 1 -- 172.21.15.7:0/2131518184 reap_dead start 2024-04-25T09:56:26.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.678+0000 7f4662cb3640 1 -- 172.21.15.7:0/2131518184 shutdown_connections 2024-04-25T09:56:26.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.678+0000 7f4662cb3640 1 -- 172.21.15.7:0/2131518184 >> 172.21.15.7:0/2131518184 conn(0x7f465c0726b0 msgr2=0x7f465c072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:26.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.678+0000 7f4662cb3640 1 -- 172.21.15.7:0/2131518184 shutdown_connections 2024-04-25T09:56:26.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.679+0000 7f4662cb3640 1 -- 172.21.15.7:0/2131518184 wait complete. 2024-04-25T09:56:26.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.680+0000 7f4662cb3640 1 Processor -- start 2024-04-25T09:56:26.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.680+0000 7f4662cb3640 1 -- start start 2024-04-25T09:56:26.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.681+0000 7f4662cb3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f46440039e0 0x7f465c160bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.681+0000 7f4662cb3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f465c1f42d0 0x7f465c143910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.681+0000 7f4662cb3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f465c156380 0x7f465c153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.681+0000 7f4662cb3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465c0d1c60 con 0x7f465c156380 2024-04-25T09:56:26.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.681+0000 7f4662cb3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465c0d2b90 con 0x7f465c1f42d0 2024-04-25T09:56:26.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.681+0000 7f4662cb3640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f465c0d1de0 con 0x7f46440039e0 2024-04-25T09:56:26.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.681+0000 7f4661250640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f465c156380 0x7f465c153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.681+0000 7f4661250640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f465c156380 0x7f465c153aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57086/0 (socket says 172.21.15.7:57086) 2024-04-25T09:56:26.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.681+0000 7f4661250640 1 -- 172.21.15.7:0/3976736611 learned_addr learned my addr 172.21.15.7:0/3976736611 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:26.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.681+0000 7f4660a4f640 1 --2- 172.21.15.7:0/3976736611 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f46440039e0 0x7f465c160bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.681+0000 7f4653fff640 1 --2- 172.21.15.7:0/3976736611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f465c1f42d0 0x7f465c143910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.681+0000 7f4661250640 1 -- 172.21.15.7:0/3976736611 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f46440039e0 msgr2=0x7f465c160bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.681+0000 7f4661250640 1 --2- 172.21.15.7:0/3976736611 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f46440039e0 0x7f465c160bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.681+0000 7f4661250640 1 -- 172.21.15.7:0/3976736611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f465c1f42d0 msgr2=0x7f465c143910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.681+0000 7f4661250640 1 --2- 172.21.15.7:0/3976736611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f465c1f42d0 0x7f465c143910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.681+0000 7f4661250640 1 -- 172.21.15.7:0/3976736611 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465c0cbae0 con 0x7f465c156380 2024-04-25T09:56:26.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.681+0000 7f4660a4f640 1 --2- 172.21.15.7:0/3976736611 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f46440039e0 0x7f465c160bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:56:26.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.681+0000 7f4653fff640 1 --2- 172.21.15.7:0/3976736611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f465c1f42d0 0x7f465c143910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:56:26.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.681+0000 7f4661250640 1 --2- 172.21.15.7:0/3976736611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f465c156380 0x7f465c153aa0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f465c1617e0 tx=0x7f4654010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:26.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.681+0000 7f46517fa640 1 -- 172.21.15.7:0/3976736611 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465401a030 con 0x7f465c156380 2024-04-25T09:56:26.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.682+0000 7f46517fa640 1 -- 172.21.15.7:0/3976736611 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4654010e00 con 0x7f465c156380 2024-04-25T09:56:26.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.682+0000 7f4662cb3640 1 -- 172.21.15.7:0/3976736611 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f465c0cbdc0 con 0x7f465c156380 2024-04-25T09:56:26.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.682+0000 7f46517fa640 1 -- 172.21.15.7:0/3976736611 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4654003bd0 con 0x7f465c156380 2024-04-25T09:56:26.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.682+0000 7f4662cb3640 1 -- 172.21.15.7:0/3976736611 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f465c161110 con 0x7f465c156380 2024-04-25T09:56:26.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.682+0000 7f4662cb3640 1 -- 172.21.15.7:0/3976736611 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f465c068f60 con 0x7f465c156380 2024-04-25T09:56:26.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.683+0000 7f46517fa640 1 -- 172.21.15.7:0/3976736611 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4654005d10 con 0x7f465c156380 2024-04-25T09:56:26.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.684+0000 7f46517fa640 1 --2- 172.21.15.7:0/3976736611 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f464806b500 0x7f464806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.684+0000 7f46517fa640 1 -- 172.21.15.7:0/3976736611 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f465408b6a0 con 0x7f465c156380 2024-04-25T09:56:26.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.684+0000 7f4660a4f640 1 --2- 172.21.15.7:0/3976736611 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f464806b500 0x7f464806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.684+0000 7f46517fa640 1 -- 172.21.15.7:0/3976736611 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+501 (secure 0 0 0) 0x7f4654025020 con 0x7f465c156380 2024-04-25T09:56:26.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.684+0000 7f4642ffd640 1 -- 172.21.15.7:0/3976736611 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f46340034b0 con 0x7f465c156380 2024-04-25T09:56:26.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.684+0000 7f4660a4f640 1 --2- 172.21.15.7:0/3976736611 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f464806b500 0x7f464806d9c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4658032000 tx=0x7f465802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:26.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.688+0000 7f1ac0d93740 1 Processor -- start 2024-04-25T09:56:26.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.688+0000 7f1ac0d93740 1 -- start start 2024-04-25T09:56:26.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.689+0000 7f1ac0d93740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557552294cf0 0x5575522fe370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.689+0000 7f1ac0d93740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557552295bb0 0x5575522b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.689+0000 7f1ac0d93740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575522b2c40 0x5575522df110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.689+0000 7f1ac0d93740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab8200c10 con 0x5575522b2c40 2024-04-25T09:56:26.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.689+0000 7f1ac0d93740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab81ffdb0 con 0x557552295bb0 2024-04-25T09:56:26.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.689+0000 7f1ac0d93740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab81ff280 con 0x557552294cf0 2024-04-25T09:56:26.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.689+0000 7f1ab7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575522b2c40 0x5575522df110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.689+0000 7f1ab7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575522b2c40 0x5575522df110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57096/0 (socket says 172.21.15.7:57096) 2024-04-25T09:56:26.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.689+0000 7f1ab7fff640 1 -- 172.21.15.7:0/3361114413 learned_addr learned my addr 172.21.15.7:0/3361114413 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:26.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.689+0000 7f1ab77fe640 1 --2- 172.21.15.7:0/3361114413 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557552294cf0 0x5575522fe370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.689+0000 7f1ab6ffd640 1 --2- 172.21.15.7:0/3361114413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557552295bb0 0x5575522b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.689+0000 7f1ab7fff640 1 -- 172.21.15.7:0/3361114413 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557552294cf0 msgr2=0x5575522fe370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:26.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.689+0000 7f1ab7fff640 1 --2- 172.21.15.7:0/3361114413 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557552294cf0 0x5575522fe370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.689+0000 7f1ab7fff640 1 -- 172.21.15.7:0/3361114413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557552295bb0 msgr2=0x5575522b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:26.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.689+0000 7f1ab7fff640 1 --2- 172.21.15.7:0/3361114413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557552295bb0 0x5575522b2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.689+0000 7f1ab7fff640 1 -- 172.21.15.7:0/3361114413 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575522e0ba0 con 0x5575522b2c40 2024-04-25T09:56:26.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.689+0000 7f1ab77fe640 1 --2- 172.21.15.7:0/3361114413 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557552294cf0 0x5575522fe370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:26.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.689+0000 7f1ab6ffd640 1 --2- 172.21.15.7:0/3361114413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557552295bb0 0x5575522b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:26.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.689+0000 7f1ab7fff640 1 --2- 172.21.15.7:0/3361114413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575522b2c40 0x5575522df110 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0001ac0 tx=0x7f1ab0021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e635b57c076e0ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:26.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.689+0000 7f1a9cff9640 1 -- 172.21.15.7:0/3361114413 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab0037070 con 0x5575522b2c40 2024-04-25T09:56:26.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.689+0000 7f1a9cff9640 1 -- 172.21.15.7:0/3361114413 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab00172e0 con 0x5575522b2c40 2024-04-25T09:56:26.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.690+0000 7f1a9cff9640 1 -- 172.21.15.7:0/3361114413 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab00157e0 con 0x5575522b2c40 2024-04-25T09:56:26.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.690+0000 7f1ac0d93740 1 -- 172.21.15.7:0/3361114413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575522b2c40 msgr2=0x5575522df110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.690+0000 7f1ac0d93740 1 --2- 172.21.15.7:0/3361114413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575522b2c40 0x5575522df110 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0001ac0 tx=0x7f1ab0021000 comp rx=0 tx=0).stop 2024-04-25T09:56:26.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.690+0000 7f1ac0d93740 1 -- 172.21.15.7:0/3361114413 shutdown_connections 2024-04-25T09:56:26.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.690+0000 7f1ac0d93740 1 --2- 172.21.15.7:0/3361114413 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575522b2c40 0x5575522df110 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.690+0000 7f1ac0d93740 1 --2- 172.21.15.7:0/3361114413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557552295bb0 0x5575522b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.690+0000 7f1ac0d93740 1 --2- 172.21.15.7:0/3361114413 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557552294cf0 0x5575522fe370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.690+0000 7f1ac0d93740 1 -- 172.21.15.7:0/3361114413 >> 172.21.15.7:0/3361114413 conn(0x557552290830 msgr2=0x5575522e17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:26.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.690+0000 7f1ac0d93740 1 -- 172.21.15.7:0/3361114413 shutdown_connections 2024-04-25T09:56:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.690+0000 7f1ac0d93740 1 -- 172.21.15.7:0/3361114413 wait complete. 2024-04-25T09:56:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.691+0000 7f1ac0d93740 1 -- start start 2024-04-25T09:56:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.691+0000 7f1ac0d93740 1 Processor -- start 2024-04-25T09:56:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.692+0000 7f1ac0d93740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557552294cf0 0x5575522edff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.692+0000 7f1ac0d93740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557552295bb0 0x5575522c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.692+0000 7f1ac0d93740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575522b2c40 0x5575522c4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.692+0000 7f1ac0d93740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab81ff7b0 con 0x5575522b2c40 2024-04-25T09:56:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.692+0000 7f1ac0d93740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575522fe9c0 con 0x557552294cf0 2024-04-25T09:56:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.692+0000 7f1ac0d93740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5575522deb90 con 0x557552295bb0 2024-04-25T09:56:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.692+0000 7f1ac0d93740 10 client.0 _ll_register_callbacks cb 0x7f1ab0001910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:56:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.692+0000 7f1ab7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575522b2c40 0x5575522c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.692+0000 7f1ab7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575522b2c40 0x5575522c4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57104/0 (socket says 172.21.15.7:57104) 2024-04-25T09:56:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.692+0000 7f1ab7fff640 1 -- 172.21.15.7:0/3607767638 learned_addr learned my addr 172.21.15.7:0/3607767638 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:26.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.692+0000 7f1ab77fe640 1 --2- 172.21.15.7:0/3607767638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557552294cf0 0x5575522edff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.692+0000 7f1ab6ffd640 1 --2- 172.21.15.7:0/3607767638 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557552295bb0 0x5575522c3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.692+0000 7f1ab7fff640 1 -- 172.21.15.7:0/3607767638 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557552295bb0 msgr2=0x5575522c3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.692+0000 7f1ab7fff640 1 --2- 172.21.15.7:0/3607767638 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557552295bb0 0x5575522c3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.692+0000 7f1ab7fff640 1 -- 172.21.15.7:0/3607767638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557552294cf0 msgr2=0x5575522edff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.692+0000 7f1ab7fff640 1 --2- 172.21.15.7:0/3607767638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557552294cf0 0x5575522edff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.692+0000 7f1ab7fff640 1 -- 172.21.15.7:0/3607767638 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557552292770 con 0x5575522b2c40 2024-04-25T09:56:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.692+0000 7f1ab7fff640 1 --2- 172.21.15.7:0/3607767638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575522b2c40 0x5575522c4070 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0001ac0 tx=0x7f1ab0006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a3f209e642e2fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.692+0000 7f1a967fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:56:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.692+0000 7f1a967fc640 1 -- 172.21.15.7:0/3607767638 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab0041060 con 0x5575522b2c40 2024-04-25T09:56:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.692+0000 7f1a967fc640 1 -- 172.21.15.7:0/3607767638 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1ab0015ab0 con 0x5575522b2c40 2024-04-25T09:56:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.692+0000 7f1ac0d93740 1 -- 172.21.15.7:0/3607767638 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1ab00172e0 con 0x5575522b2c40 2024-04-25T09:56:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.693+0000 7f1a967fc640 1 -- 172.21.15.7:0/3607767638 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ab0047050 con 0x5575522b2c40 2024-04-25T09:56:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.693+0000 7f1ac0d93740 10 client.6051 fetch_fsmap learned FSMap version 21 2024-04-25T09:56:26.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.693+0000 7f1ac0d93740 1 -- 172.21.15.7:0/3607767638 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x5575522ee530 con 0x5575522b2c40 2024-04-25T09:56:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.693+0000 7f1a967fc640 1 -- 172.21.15.7:0/3607767638 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab00172e0 con 0x5575522b2c40 2024-04-25T09:56:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.693+0000 7f1a967fc640 1 -- 172.21.15.7:0/3607767638 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 21) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1ab004a020 con 0x5575522b2c40 2024-04-25T09:56:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.693+0000 7f1ac0d93740 10 client.6051 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T09:56:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.693+0000 7f1ac0d93740 10 client.6051 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-04-25T09:56:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.693+0000 7f1ac0d93740 20 client.6051 populate_metadata read hostname 'smithi007' 2024-04-25T09:56:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.693+0000 7f1ac0d93740 1 --2- 172.21.15.7:0/3607767638 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x5575522df8a0 0x5575522de010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.693+0000 7f1ac0d93740 4 client.6051 mds_command: new command op to 5820 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-04-25T09:56:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.693+0000 7f1ac0d93740 1 -- 172.21.15.7:0/3607767638 --> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x557552201350 con 0x5575522df8a0 2024-04-25T09:56:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.693+0000 7f1ab77fe640 1 --2- 172.21.15.7:0/3607767638 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x5575522df8a0 0x5575522de010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.693+0000 7f1a967fc640 10 client.6051 ms_handle_connect on v2:172.21.15.7:6835/2232311564 2024-04-25T09:56:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.693+0000 7f1ab77fe640 1 --2- 172.21.15.7:0/3607767638 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x5575522df8a0 0x5575522de010 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e63777716e2b5997 server_cookie=23e8cf5c8368ee5f in_seq=0 out_seq=0 2024-04-25T09:56:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.694+0000 7f1a967fc640 1 -- 172.21.15.7:0/3607767638 <== mds.0 v2:172.21.15.7:6835/2232311564 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x557552201350 con 0x5575522df8a0 2024-04-25T09:56:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.694+0000 7f1a967fc640 10 client.6051 handle_command_reply: tid=0 2024-04-25T09:56:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.694+0000 7f1ac0d93740 1 client.6051 shutdown 2024-04-25T09:56:26.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.694+0000 7f1ac0d93740 1 -- 172.21.15.7:0/3607767638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575522b2c40 msgr2=0x5575522c4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.694+0000 7f1ac0d93740 1 --2- 172.21.15.7:0/3607767638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575522b2c40 0x5575522c4070 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0001ac0 tx=0x7f1ab0006040 comp rx=0 tx=0).stop 2024-04-25T09:56:26.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.694+0000 7f1ac0d93740 1 -- 172.21.15.7:0/3607767638 shutdown_connections 2024-04-25T09:56:26.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.694+0000 7f1ac0d93740 1 --2- 172.21.15.7:0/3607767638 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x5575522df8a0 0x5575522de010 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.694+0000 7f1a967fc640 0 client.6051 ms_handle_reset on v2:172.21.15.7:6835/2232311564 2024-04-25T09:56:26.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.694+0000 7f1ac0d93740 1 --2- 172.21.15.7:0/3607767638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575522b2c40 0x5575522c4070 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.694+0000 7f1ac0d93740 1 --2- 172.21.15.7:0/3607767638 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557552295bb0 0x5575522c3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.694+0000 7f1ac0d93740 1 --2- 172.21.15.7:0/3607767638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557552294cf0 0x5575522edff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.694+0000 7f1ac0d93740 1 -- 172.21.15.7:0/3607767638 >> 172.21.15.7:0/3607767638 conn(0x557552290830 msgr2=0x5575522e1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:26.704 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-04-25T09:56:26.694+0000 7fb7b6c26640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5174=0-4194304@1} caps={5174=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5174 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x5654b949d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T09:56:26.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.694+0000 7f1ac0d93740 1 -- 172.21.15.7:0/3607767638 shutdown_connections 2024-04-25T09:56:26.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.694+0000 7f1ac0d93740 1 -- 172.21.15.7:0/3607767638 wait complete. 2024-04-25T09:56:26.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.695+0000 7f1ac0d93740 20 client.6051 trim_cache size 0 max 16384 2024-04-25T09:56:26.705 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T09:56:26.705 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-04-25T09:56:26.706 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "faf264ae-a3c7-4901-980e-0ee27a5e1b35", 2024-04-25T09:56:26.706 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-04-25T09:56:26.706 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T09:56:26.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.695+0000 7f1abdfb0640 1 -- 172.21.15.7:0/2251104033 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1aa406b500 msgr2=0x7f1aa406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.695+0000 7f1abdfb0640 1 --2- 172.21.15.7:0/2251104033 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1aa406b500 0x7f1aa406d9c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8009ae0 tx=0x7f1aa8009190 comp rx=0 tx=0).stop 2024-04-25T09:56:26.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.695+0000 7f1abdfb0640 1 -- 172.21.15.7:0/2251104033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ab81590c0 msgr2=0x7f1ab81f3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.695+0000 7f1abdfb0640 1 --2- 172.21.15.7:0/2251104033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ab81590c0 0x7f1ab81f3200 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f1aac000c00 tx=0x7f1aac004730 comp rx=0 tx=0).stop 2024-04-25T09:56:26.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.695+0000 7f1abdfb0640 1 -- 172.21.15.7:0/2251104033 shutdown_connections 2024-04-25T09:56:26.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.695+0000 7f1abdfb0640 1 --2- 172.21.15.7:0/2251104033 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1aa406b500 0x7f1aa406d9c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.695+0000 7f1abdfb0640 1 --2- 172.21.15.7:0/2251104033 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ab81f3740 0x7f1ab815c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.695+0000 7f1abdfb0640 1 --2- 172.21.15.7:0/2251104033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ab81590c0 0x7f1ab81f3200 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.695+0000 7f1abdfb0640 1 --2- 172.21.15.7:0/2251104033 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1aa0003f30 0x7f1ab8156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.695+0000 7f1abdfb0640 1 -- 172.21.15.7:0/2251104033 >> 172.21.15.7:0/2251104033 conn(0x7f1ab80726b0 msgr2=0x7f1ab80b82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:26.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.695+0000 7f1abdfb0640 1 -- 172.21.15.7:0/2251104033 shutdown_connections 2024-04-25T09:56:26.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.695+0000 7f1abdfb0640 1 -- 172.21.15.7:0/2251104033 wait complete. 2024-04-25T09:56:26.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:56:26.709 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub status 2024-04-25T09:56:26.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.808+0000 7f9b5a4d2640 1 Processor -- start 2024-04-25T09:56:26.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.808+0000 7f9b5a4d2640 1 -- start start 2024-04-25T09:56:26.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.809+0000 7f9b5a4d2640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9b540d3760 0x7f9b5415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.809+0000 7f9b5a4d2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9b540ce830 0x7f9b540b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.809+0000 7f9b5a4d2640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b540ced10 con 0x7f9b5415f1c0 2024-04-25T09:56:26.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.809+0000 7f9b5a4d2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b540ce380 con 0x7f9b540ce830 2024-04-25T09:56:26.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.809+0000 7f9b5a4d2640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5415f000 con 0x7f9b540d3760 2024-04-25T09:56:26.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.809+0000 7f9b537fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9b5415f1c0 0x7f9b540d3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33008/0 (socket says 172.21.15.7:33008) 2024-04-25T09:56:26.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.809+0000 7f9b537fe640 1 -- 172.21.15.7:0/1181866693 learned_addr learned my addr 172.21.15.7:0/1181866693 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:56:26.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.810+0000 7f9b58a6f640 1 --2- 172.21.15.7:0/1181866693 >> v2:172.21.15.55:3300/0 conn(0x7f9b540ce830 0x7f9b540b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.810+0000 7f9b53fff640 1 --2- 172.21.15.7:0/1181866693 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9b540d3760 0x7f9b5415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.810+0000 7f9b52ffd640 1 -- 172.21.15.7:0/1181866693 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3198797123 0 0) 0x7f9b540ced10 con 0x7f9b5415f1c0 2024-04-25T09:56:26.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.810+0000 7f9b52ffd640 1 -- 172.21.15.7:0/1181866693 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b3c003520 con 0x7f9b5415f1c0 2024-04-25T09:56:26.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.810+0000 7f9b52ffd640 1 -- 172.21.15.7:0/1181866693 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 670736474 0 0) 0x7f9b3c003520 con 0x7f9b5415f1c0 2024-04-25T09:56:26.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.810+0000 7f9b52ffd640 1 -- 172.21.15.7:0/1181866693 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9b540d3760 msgr2=0x7f9b5415eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:26.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.810+0000 7f9b52ffd640 1 --2- 172.21.15.7:0/1181866693 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9b540d3760 0x7f9b5415eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.810+0000 7f9b52ffd640 1 -- 172.21.15.7:0/1181866693 >> v2:172.21.15.55:3300/0 conn(0x7f9b540ce830 msgr2=0x7f9b540b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:26.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.810+0000 7f9b52ffd640 1 --2- 172.21.15.7:0/1181866693 >> v2:172.21.15.55:3300/0 conn(0x7f9b540ce830 0x7f9b540b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.810+0000 7f9b52ffd640 1 -- 172.21.15.7:0/1181866693 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b540d1b40 con 0x7f9b5415f1c0 2024-04-25T09:56:26.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.810+0000 7f9b52ffd640 1 -- 172.21.15.7:0/1181866693 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f9b48001670 con 0x7f9b5415f1c0 2024-04-25T09:56:26.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.810+0000 7f9b52ffd640 1 -- 172.21.15.7:0/1181866693 >> v1:172.21.15.7:6789/0 conn(0x7f9b5415f1c0 legacy=0x7f9b540d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.810+0000 7f9b52ffd640 1 --2- 172.21.15.7:0/1181866693 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9b3c0039b0 0x7f9b3c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.810+0000 7f9b52ffd640 1 --2- 172.21.15.7:0/1181866693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b3c0043a0 0x7f9b3c004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.810+0000 7f9b52ffd640 1 --2- 172.21.15.7:0/1181866693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b3c004ef0 0x7f9b3c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.810+0000 7f9b52ffd640 1 -- 172.21.15.7:0/1181866693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5415f000 con 0x7f9b3c0043a0 2024-04-25T09:56:26.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.810+0000 7f9b52ffd640 1 -- 172.21.15.7:0/1181866693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c00bf00 con 0x7f9b3c004ef0 2024-04-25T09:56:26.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.810+0000 7f9b52ffd640 1 -- 172.21.15.7:0/1181866693 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c00c080 con 0x7f9b3c0039b0 2024-04-25T09:56:26.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.810+0000 7f9b53fff640 1 --2- 172.21.15.7:0/1181866693 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9b540d3760 0x7f9b5415eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:56:26.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.810+0000 7f9b58a6f640 1 --2- 172.21.15.7:0/1181866693 >> v2:172.21.15.55:3300/0 conn(0x7f9b540ce830 0x7f9b540b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:56:26.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.810+0000 7f9b537fe640 1 --2- 172.21.15.7:0/1181866693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b3c0043a0 0x7f9b3c004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.810+0000 7f9b58a6f640 1 --2- 172.21.15.7:0/1181866693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b3c004ef0 0x7f9b3c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.810+0000 7f9b53fff640 1 --2- 172.21.15.7:0/1181866693 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9b3c0039b0 0x7f9b3c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.810+0000 7f9b537fe640 1 -- 172.21.15.7:0/1181866693 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9b3c0039b0 msgr2=0x7f9b3c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:26.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.810+0000 7f9b537fe640 1 --2- 172.21.15.7:0/1181866693 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9b3c0039b0 0x7f9b3c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.810+0000 7f9b537fe640 1 -- 172.21.15.7:0/1181866693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b3c004ef0 msgr2=0x7f9b3c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:26.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.810+0000 7f9b537fe640 1 --2- 172.21.15.7:0/1181866693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b3c004ef0 0x7f9b3c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.810+0000 7f9b537fe640 1 -- 172.21.15.7:0/1181866693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3c003520 con 0x7f9b3c0043a0 2024-04-25T09:56:26.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.811+0000 7f9b537fe640 1 --2- 172.21.15.7:0/1181866693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b3c0043a0 0x7f9b3c004880 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9b4800c210 tx=0x7f9b3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30f76026bdb675cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:26.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.811+0000 7f9b52ffd640 1 -- 172.21.15.7:0/1181866693 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b48007d30 con 0x7f9b3c0043a0 2024-04-25T09:56:26.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.811+0000 7f9b52ffd640 1 -- 172.21.15.7:0/1181866693 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b48005ad0 con 0x7f9b3c0043a0 2024-04-25T09:56:26.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.811+0000 7f9b52ffd640 1 -- 172.21.15.7:0/1181866693 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b48007070 con 0x7f9b3c0043a0 2024-04-25T09:56:26.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.812+0000 7f9b5a4d2640 1 -- 172.21.15.7:0/1181866693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b3c0043a0 msgr2=0x7f9b3c004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.812+0000 7f9b5a4d2640 1 --2- 172.21.15.7:0/1181866693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b3c0043a0 0x7f9b3c004880 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9b4800c210 tx=0x7f9b3c005830 comp rx=0 tx=0).stop 2024-04-25T09:56:26.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.812+0000 7f9b58a6f640 1 -- 172.21.15.7:0/1181866693 reap_dead start 2024-04-25T09:56:26.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.812+0000 7f9b5a4d2640 1 -- 172.21.15.7:0/1181866693 shutdown_connections 2024-04-25T09:56:26.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.812+0000 7f9b5a4d2640 1 -- 172.21.15.7:0/1181866693 >> 172.21.15.7:0/1181866693 conn(0x7f9b54072680 msgr2=0x7f9b54072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:26.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.812+0000 7f9b5a4d2640 1 -- 172.21.15.7:0/1181866693 shutdown_connections 2024-04-25T09:56:26.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.812+0000 7f9b5a4d2640 1 -- 172.21.15.7:0/1181866693 wait complete. 2024-04-25T09:56:26.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.813+0000 7f9b5a4d2640 1 Processor -- start 2024-04-25T09:56:26.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.813+0000 7f9b5a4d2640 1 -- start start 2024-04-25T09:56:26.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.814+0000 7f9b5a4d2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b3c0043a0 0x7f9b541f3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.814+0000 7f9b5a4d2640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9b541574c0 0x7f9b54157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.814+0000 7f9b5a4d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b540c8fb0 0x7f9b540c9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.814+0000 7f9b5a4d2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5415de10 con 0x7f9b3c0043a0 2024-04-25T09:56:26.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.814+0000 7f9b5a4d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b540d2190 con 0x7f9b540c8fb0 2024-04-25T09:56:26.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.814+0000 7f9b5a4d2640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5415eac0 con 0x7f9b541574c0 2024-04-25T09:56:26.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.814+0000 7f9b53fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b3c0043a0 0x7f9b541f3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.814+0000 7f9b53fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b3c0043a0 0x7f9b541f3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57130/0 (socket says 172.21.15.7:57130) 2024-04-25T09:56:26.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.814+0000 7f9b53fff640 1 -- 172.21.15.7:0/1717536376 learned_addr learned my addr 172.21.15.7:0/1717536376 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:26.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.814+0000 7f9b537fe640 1 --2- 172.21.15.7:0/1717536376 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9b541574c0 0x7f9b54157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.814+0000 7f9b58a6f640 1 --2- 172.21.15.7:0/1717536376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b540c8fb0 0x7f9b540c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.815+0000 7f9b53fff640 1 -- 172.21.15.7:0/1717536376 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9b541574c0 msgr2=0x7f9b54157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.815+0000 7f9b53fff640 1 --2- 172.21.15.7:0/1717536376 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9b541574c0 0x7f9b54157920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.815+0000 7f9b53fff640 1 -- 172.21.15.7:0/1717536376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b540c8fb0 msgr2=0x7f9b540c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.815+0000 7f9b53fff640 1 --2- 172.21.15.7:0/1717536376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b540c8fb0 0x7f9b540c9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.815+0000 7f9b53fff640 1 -- 172.21.15.7:0/1717536376 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b541f3760 con 0x7f9b3c0043a0 2024-04-25T09:56:26.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.815+0000 7f9b58a6f640 1 --2- 172.21.15.7:0/1717536376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b540c8fb0 0x7f9b540c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:26.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.815+0000 7f9b53fff640 1 --2- 172.21.15.7:0/1717536376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b3c0043a0 0x7f9b541f3220 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f9b44011830 tx=0x7f9b44011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:26.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.815+0000 7f9b50ff9640 1 -- 172.21.15.7:0/1717536376 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4400f9c0 con 0x7f9b3c0043a0 2024-04-25T09:56:26.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.815+0000 7f9b50ff9640 1 -- 172.21.15.7:0/1717536376 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4400fb60 con 0x7f9b3c0043a0 2024-04-25T09:56:26.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.815+0000 7f9b50ff9640 1 -- 172.21.15.7:0/1717536376 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b44015460 con 0x7f9b3c0043a0 2024-04-25T09:56:26.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.815+0000 7f9b5a4d2640 1 -- 172.21.15.7:0/1717536376 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b540cb2a0 con 0x7f9b3c0043a0 2024-04-25T09:56:26.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.815+0000 7f9b5a4d2640 1 -- 172.21.15.7:0/1717536376 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b540cb860 con 0x7f9b3c0043a0 2024-04-25T09:56:26.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.816+0000 7f9b50ff9640 1 -- 172.21.15.7:0/1717536376 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9b44015810 con 0x7f9b3c0043a0 2024-04-25T09:56:26.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.817+0000 7f9b50ff9640 1 --2- 172.21.15.7:0/1717536376 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9b4006b4d0 0x7f9b4006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.817+0000 7f9b537fe640 1 --2- 172.21.15.7:0/1717536376 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9b4006b4d0 0x7f9b4006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.817+0000 7f9b50ff9640 1 -- 172.21.15.7:0/1717536376 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9b4408af90 con 0x7f9b3c0043a0 2024-04-25T09:56:26.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.818+0000 7f9b537fe640 1 --2- 172.21.15.7:0/1717536376 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9b4006b4d0 0x7f9b4006d990 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9b48033000 tx=0x7f9b48009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:26.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.818+0000 7f9b5d1d8740 1 Processor -- start 2024-04-25T09:56:26.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.818+0000 7f9b5d1d8740 1 -- start start 2024-04-25T09:56:26.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.819+0000 7f9b5d1d8740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56351134bb10 0x56351134e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.819+0000 7f9b5d1d8740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56351134bef0 0x56351134e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.819+0000 7f9b5d1d8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56351131e770 0x563511321f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.819+0000 7f9b5d1d8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x563511287da0 con 0x56351131e770 2024-04-25T09:56:26.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.819+0000 7f9b5d1d8740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x563511230b80 con 0x56351134bb10 2024-04-25T09:56:26.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.819+0000 7f9b5d1d8740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x563511283e40 con 0x56351134bef0 2024-04-25T09:56:26.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.819+0000 7f9b58a6f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56351131e770 0x563511321f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.819+0000 7f9b58a6f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56351131e770 0x563511321f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57132/0 (socket says 172.21.15.7:57132) 2024-04-25T09:56:26.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.819+0000 7f9b58a6f640 1 -- 172.21.15.7:0/625345236 learned_addr learned my addr 172.21.15.7:0/625345236 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:26.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.819+0000 7f9b537fe640 1 --2- 172.21.15.7:0/625345236 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56351134bef0 0x56351134e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.819+0000 7f9b58a6f640 1 -- 172.21.15.7:0/625345236 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56351134bef0 msgr2=0x56351134e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:26.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.819+0000 7f9b53fff640 1 --2- 172.21.15.7:0/625345236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56351134bb10 0x56351134e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.819+0000 7f9b58a6f640 1 --2- 172.21.15.7:0/625345236 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56351134bef0 0x56351134e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.819+0000 7f9b58a6f640 1 -- 172.21.15.7:0/625345236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56351134bb10 msgr2=0x56351134e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:26.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.819+0000 7f9b58a6f640 1 --2- 172.21.15.7:0/625345236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56351134bb10 0x56351134e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.819+0000 7f9b58a6f640 1 -- 172.21.15.7:0/625345236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56351123af10 con 0x56351131e770 2024-04-25T09:56:26.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.819+0000 7f9b58a6f640 1 --2- 172.21.15.7:0/625345236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56351131e770 0x563511321f80 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f9b540d0b70 tx=0x7f9b4c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e217b3a5fbcb9a09 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:26.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.820+0000 7f9b39ffb640 1 -- 172.21.15.7:0/625345236 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c01b020 con 0x56351131e770 2024-04-25T09:56:26.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.820+0000 7f9b39ffb640 1 -- 172.21.15.7:0/625345236 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c007e30 con 0x56351131e770 2024-04-25T09:56:26.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.820+0000 7f9b39ffb640 1 -- 172.21.15.7:0/625345236 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c017880 con 0x56351131e770 2024-04-25T09:56:26.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.820+0000 7f9b5d1d8740 1 -- 172.21.15.7:0/625345236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56351131e770 msgr2=0x563511321f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.820+0000 7f9b5d1d8740 1 --2- 172.21.15.7:0/625345236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56351131e770 0x563511321f80 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f9b540d0b70 tx=0x7f9b4c009750 comp rx=0 tx=0).stop 2024-04-25T09:56:26.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.820+0000 7f9b5d1d8740 1 -- 172.21.15.7:0/625345236 shutdown_connections 2024-04-25T09:56:26.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.820+0000 7f9b5d1d8740 1 --2- 172.21.15.7:0/625345236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56351131e770 0x563511321f80 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.820+0000 7f9b5d1d8740 1 --2- 172.21.15.7:0/625345236 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56351134bef0 0x56351134e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.820+0000 7f9b5d1d8740 1 --2- 172.21.15.7:0/625345236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56351134bb10 0x56351134e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.820+0000 7f9b5d1d8740 1 -- 172.21.15.7:0/625345236 >> 172.21.15.7:0/625345236 conn(0x5635113209e0 msgr2=0x563511369320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:26.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.820+0000 7f9b5d1d8740 1 -- 172.21.15.7:0/625345236 shutdown_connections 2024-04-25T09:56:26.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.820+0000 7f9b5d1d8740 1 -- 172.21.15.7:0/625345236 wait complete. 2024-04-25T09:56:26.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.821+0000 7f9b5d1d8740 1 -- start start 2024-04-25T09:56:26.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.821+0000 7f9b5d1d8740 1 Processor -- start 2024-04-25T09:56:26.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.822+0000 7f9b5d1d8740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56351134bb10 0x563511364cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.822+0000 7f9b5d1d8740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56351134bef0 0x563511364640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.822+0000 7f9b5d1d8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635113416a0 0x56351136bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.822+0000 7f9b5d1d8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x563511323b90 con 0x5635113416a0 2024-04-25T09:56:26.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.822+0000 7f9b5d1d8740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635112264b0 con 0x56351134bef0 2024-04-25T09:56:26.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.822+0000 7f9b5d1d8740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x563511323e70 con 0x56351134bb10 2024-04-25T09:56:26.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.822+0000 7f9b5d1d8740 10 client.0 _ll_register_callbacks cb 0x563511266180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:56:26.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.822+0000 7f9b58a6f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635113416a0 0x56351136bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.822+0000 7f9b58a6f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635113416a0 0x56351136bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57138/0 (socket says 172.21.15.7:57138) 2024-04-25T09:56:26.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.822+0000 7f9b58a6f640 1 -- 172.21.15.7:0/1568653475 learned_addr learned my addr 172.21.15.7:0/1568653475 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:26.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.822+0000 7f9b53fff640 1 --2- 172.21.15.7:0/1568653475 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56351134bb10 0x563511364cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.822+0000 7f9b537fe640 1 --2- 172.21.15.7:0/1568653475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56351134bef0 0x563511364640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.822+0000 7f9b58a6f640 1 -- 172.21.15.7:0/1568653475 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56351134bb10 msgr2=0x563511364cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:26.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.822+0000 7f9b58a6f640 1 --2- 172.21.15.7:0/1568653475 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56351134bb10 0x563511364cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.822+0000 7f9b58a6f640 1 -- 172.21.15.7:0/1568653475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56351134bef0 msgr2=0x563511364640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:26.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.822+0000 7f9b58a6f640 1 --2- 172.21.15.7:0/1568653475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56351134bef0 0x563511364640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.822+0000 7f9b58a6f640 1 -- 172.21.15.7:0/1568653475 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5635110667d0 con 0x5635113416a0 2024-04-25T09:56:26.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.822+0000 7f9b537fe640 1 --2- 172.21.15.7:0/1568653475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56351134bef0 0x563511364640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:56:26.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.822+0000 7f9b58a6f640 1 --2- 172.21.15.7:0/1568653475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635113416a0 0x56351136bdc0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x563511326070 tx=0x7f9b4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d37c841759999eb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:26.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.822+0000 7f9b32ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:56:26.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.823+0000 7f9b32ffd640 1 -- 172.21.15.7:0/1568653475 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c01b040 con 0x5635113416a0 2024-04-25T09:56:26.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.823+0000 7f9b32ffd640 1 -- 172.21.15.7:0/1568653475 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9b4c003b90 con 0x5635113416a0 2024-04-25T09:56:26.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.823+0000 7f9b5d1d8740 1 -- 172.21.15.7:0/1568653475 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9b4c007e30 con 0x5635113416a0 2024-04-25T09:56:26.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.823+0000 7f9b32ffd640 1 -- 172.21.15.7:0/1568653475 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b4c032050 con 0x5635113416a0 2024-04-25T09:56:26.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.823+0000 7f9b5d1d8740 10 client.6063 fetch_fsmap learned FSMap version 21 2024-04-25T09:56:26.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.823+0000 7f9b5d1d8740 1 -- 172.21.15.7:0/1568653475 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x563510f9c3f0 con 0x5635113416a0 2024-04-25T09:56:26.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.823+0000 7f9b32ffd640 1 -- 172.21.15.7:0/1568653475 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c007e30 con 0x5635113416a0 2024-04-25T09:56:26.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.823+0000 7f9b32ffd640 1 -- 172.21.15.7:0/1568653475 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 21) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9b4c035020 con 0x5635113416a0 2024-04-25T09:56:26.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.823+0000 7f9b5d1d8740 10 client.6063 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T09:56:26.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.823+0000 7f9b5d1d8740 10 client.6063 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-04-25T09:56:26.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.823+0000 7f9b5d1d8740 20 client.6063 populate_metadata read hostname 'smithi007' 2024-04-25T09:56:26.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.823+0000 7f9b5d1d8740 1 --2- 172.21.15.7:0/1568653475 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x563511368990 0x56351136a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.823+0000 7f9b5d1d8740 4 client.6063 mds_command: new command op to 5820 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:56:26.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.823+0000 7f9b5d1d8740 1 -- 172.21.15.7:0/1568653475 --> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5635112952e0 con 0x563511368990 2024-04-25T09:56:26.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.823+0000 7f9b53fff640 1 --2- 172.21.15.7:0/1568653475 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x563511368990 0x56351136a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.824+0000 7f9b32ffd640 10 client.6063 ms_handle_connect on v2:172.21.15.7:6835/2232311564 2024-04-25T09:56:26.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.824+0000 7f9b53fff640 1 --2- 172.21.15.7:0/1568653475 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x563511368990 0x56351136a450 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2256c801556ef9cf server_cookie=2a33b1dca6f7362 in_seq=0 out_seq=0 2024-04-25T09:56:26.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.824+0000 7f9b32ffd640 1 -- 172.21.15.7:0/1568653475 <== mds.0 v2:172.21.15.7:6835/2232311564 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5635112952e0 con 0x563511368990 2024-04-25T09:56:26.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.824+0000 7f9b32ffd640 10 client.6063 handle_command_reply: tid=0 2024-04-25T09:56:26.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.824+0000 7f9b5d1d8740 1 client.6063 shutdown 2024-04-25T09:56:26.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.824+0000 7f9b5d1d8740 1 -- 172.21.15.7:0/1568653475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635113416a0 msgr2=0x56351136bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.824+0000 7f9b5d1d8740 1 --2- 172.21.15.7:0/1568653475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635113416a0 0x56351136bdc0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x563511326070 tx=0x7f9b4c004a40 comp rx=0 tx=0).stop 2024-04-25T09:56:26.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.824+0000 7f9b5d1d8740 1 -- 172.21.15.7:0/1568653475 shutdown_connections 2024-04-25T09:56:26.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.824+0000 7f9b5d1d8740 1 --2- 172.21.15.7:0/1568653475 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x563511368990 0x56351136a450 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.824+0000 7f9b5d1d8740 1 --2- 172.21.15.7:0/1568653475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5635113416a0 0x56351136bdc0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.824+0000 7f9b5d1d8740 1 --2- 172.21.15.7:0/1568653475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56351134bef0 0x563511364640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.824+0000 7f9b32ffd640 0 client.6063 ms_handle_reset on v2:172.21.15.7:6835/2232311564 2024-04-25T09:56:26.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.824+0000 7f9b5d1d8740 1 --2- 172.21.15.7:0/1568653475 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56351134bb10 0x563511364cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.824+0000 7f9b5d1d8740 1 -- 172.21.15.7:0/1568653475 >> 172.21.15.7:0/1568653475 conn(0x56351131e770 msgr2=0x56351131f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:26.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.824+0000 7f9b5d1d8740 1 -- 172.21.15.7:0/1568653475 shutdown_connections 2024-04-25T09:56:26.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.824+0000 7f9b5d1d8740 1 -- 172.21.15.7:0/1568653475 wait complete. 2024-04-25T09:56:26.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.825+0000 7f9b5d1d8740 20 client.6063 trim_cache size 0 max 16384 2024-04-25T09:56:26.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.839+0000 7f9b5d1d8740 1 Processor -- start 2024-04-25T09:56:26.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.840+0000 7f9b5d1d8740 1 -- start start 2024-04-25T09:56:26.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.840+0000 7f9b5d1d8740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5635113416a0 0x56351136ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.840+0000 7f9b5d1d8740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56351134bb10 0x56351131ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.840+0000 7f9b5d1d8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56351134bef0 0x56351131f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.840+0000 7f9b5d1d8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b542009c0 con 0x56351134bef0 2024-04-25T09:56:26.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.840+0000 7f9b5d1d8740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b541ffbc0 con 0x56351134bb10 2024-04-25T09:56:26.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.840+0000 7f9b5d1d8740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b541ff0c0 con 0x5635113416a0 2024-04-25T09:56:26.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.840+0000 7f9b58a6f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56351134bef0 0x56351131f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.840+0000 7f9b58a6f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56351134bef0 0x56351131f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57152/0 (socket says 172.21.15.7:57152) 2024-04-25T09:56:26.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.840+0000 7f9b58a6f640 1 -- 172.21.15.7:0/3161760885 learned_addr learned my addr 172.21.15.7:0/3161760885 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:26.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.841+0000 7f9b58a6f640 1 -- 172.21.15.7:0/3161760885 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5635113416a0 msgr2=0x56351136ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:26.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.841+0000 7f9b58a6f640 1 --2- 172.21.15.7:0/3161760885 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5635113416a0 0x56351136ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.841+0000 7f9b58a6f640 1 -- 172.21.15.7:0/3161760885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56351134bb10 msgr2=0x56351131ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:26.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.841+0000 7f9b58a6f640 1 --2- 172.21.15.7:0/3161760885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56351134bb10 0x56351131ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.841+0000 7f9b58a6f640 1 -- 172.21.15.7:0/3161760885 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563510f5c0f0 con 0x56351134bef0 2024-04-25T09:56:26.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.841+0000 7f9b58a6f640 1 --2- 172.21.15.7:0/3161760885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56351134bef0 0x56351131f2c0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c0098c0 tx=0x7f9b4c021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=640aad1e61add1f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:26.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.841+0000 7f9b397fa640 1 -- 172.21.15.7:0/3161760885 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c03a070 con 0x56351134bef0 2024-04-25T09:56:26.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.841+0000 7f9b397fa640 1 -- 172.21.15.7:0/3161760885 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c003f00 con 0x56351134bef0 2024-04-25T09:56:26.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.841+0000 7f9b397fa640 1 -- 172.21.15.7:0/3161760885 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c01b070 con 0x56351134bef0 2024-04-25T09:56:26.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.841+0000 7f9b5d1d8740 1 -- 172.21.15.7:0/3161760885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56351134bef0 msgr2=0x56351131f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.841+0000 7f9b5d1d8740 1 --2- 172.21.15.7:0/3161760885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56351134bef0 0x56351131f2c0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c0098c0 tx=0x7f9b4c021000 comp rx=0 tx=0).stop 2024-04-25T09:56:26.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.842+0000 7f9b5d1d8740 1 -- 172.21.15.7:0/3161760885 shutdown_connections 2024-04-25T09:56:26.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.842+0000 7f9b5d1d8740 1 --2- 172.21.15.7:0/3161760885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56351134bef0 0x56351131f2c0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.842+0000 7f9b5d1d8740 1 --2- 172.21.15.7:0/3161760885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56351134bb10 0x56351131ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.842+0000 7f9b5d1d8740 1 --2- 172.21.15.7:0/3161760885 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5635113416a0 0x56351136ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.842+0000 7f9b5d1d8740 1 -- 172.21.15.7:0/3161760885 >> 172.21.15.7:0/3161760885 conn(0x56351131e770 msgr2=0x563511323350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:26.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.842+0000 7f9b5d1d8740 1 -- 172.21.15.7:0/3161760885 shutdown_connections 2024-04-25T09:56:26.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.842+0000 7f9b5d1d8740 1 -- 172.21.15.7:0/3161760885 wait complete. 2024-04-25T09:56:26.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.842+0000 7f9b5d1d8740 1 -- start start 2024-04-25T09:56:26.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.842+0000 7f9b5d1d8740 1 Processor -- start 2024-04-25T09:56:26.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.843+0000 7f9b5d1d8740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5635113416a0 0x5635113d2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.843+0000 7f9b5d1d8740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56351134bb10 0x563511322990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.843+0000 7f9b5d1d8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56351134bef0 0x5635113401c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.843+0000 7f9b5d1d8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x563511352130 con 0x56351134bef0 2024-04-25T09:56:26.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.843+0000 7f9b5d1d8740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b541ff5c0 con 0x5635113416a0 2024-04-25T09:56:26.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.843+0000 7f9b5d1d8740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5635113414b0 con 0x56351134bb10 2024-04-25T09:56:26.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.843+0000 7f9b5d1d8740 10 client.0 _ll_register_callbacks cb 0x7f9b4c009ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:56:26.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.843+0000 7f9b58a6f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56351134bef0 0x5635113401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.843+0000 7f9b58a6f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56351134bef0 0x5635113401c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57168/0 (socket says 172.21.15.7:57168) 2024-04-25T09:56:26.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.843+0000 7f9b58a6f640 1 -- 172.21.15.7:0/4281590182 learned_addr learned my addr 172.21.15.7:0/4281590182 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:26.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.843+0000 7f9b53fff640 1 --2- 172.21.15.7:0/4281590182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5635113416a0 0x5635113d2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.843+0000 7f9b537fe640 1 --2- 172.21.15.7:0/4281590182 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56351134bb10 0x563511322990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.843+0000 7f9b58a6f640 1 -- 172.21.15.7:0/4281590182 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56351134bb10 msgr2=0x563511322990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:26.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.843+0000 7f9b58a6f640 1 --2- 172.21.15.7:0/4281590182 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56351134bb10 0x563511322990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.844+0000 7f9b58a6f640 1 -- 172.21.15.7:0/4281590182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5635113416a0 msgr2=0x5635113d2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:26.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.844+0000 7f9b58a6f640 1 --2- 172.21.15.7:0/4281590182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5635113416a0 0x5635113d2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.844+0000 7f9b58a6f640 1 -- 172.21.15.7:0/4281590182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563511369320 con 0x56351134bef0 2024-04-25T09:56:26.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.844+0000 7f9b58a6f640 1 --2- 172.21.15.7:0/4281590182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56351134bef0 0x5635113401c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c039040 tx=0x7f9b4c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84381490eaf286c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:26.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.844+0000 7f9b32ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:56:26.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.844+0000 7f9b32ffd640 1 -- 172.21.15.7:0/4281590182 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c043030 con 0x56351134bef0 2024-04-25T09:56:26.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.844+0000 7f9b32ffd640 1 -- 172.21.15.7:0/4281590182 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9b4c020630 con 0x56351134bef0 2024-04-25T09:56:26.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.844+0000 7f9b5d1d8740 1 -- 172.21.15.7:0/4281590182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9b4c003f00 con 0x56351134bef0 2024-04-25T09:56:26.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.844+0000 7f9b32ffd640 1 -- 172.21.15.7:0/4281590182 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b4c03a050 con 0x56351134bef0 2024-04-25T09:56:26.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.844+0000 7f9b5d1d8740 10 client.6069 fetch_fsmap learned FSMap version 21 2024-04-25T09:56:26.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.844+0000 7f9b5d1d8740 1 -- 172.21.15.7:0/4281590182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x563511349550 con 0x56351134bef0 2024-04-25T09:56:26.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.844+0000 7f9b32ffd640 1 -- 172.21.15.7:0/4281590182 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c003f00 con 0x56351134bef0 2024-04-25T09:56:26.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.844+0000 7f9b32ffd640 1 -- 172.21.15.7:0/4281590182 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 21) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9b4c035050 con 0x56351134bef0 2024-04-25T09:56:26.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.844+0000 7f9b5d1d8740 10 client.6069 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T09:56:26.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.844+0000 7f9b5d1d8740 10 client.6069 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-04-25T09:56:26.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.844+0000 7f9b5d1d8740 20 client.6069 populate_metadata read hostname 'smithi007' 2024-04-25T09:56:26.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.844+0000 7f9b5d1d8740 1 --2- 172.21.15.7:0/4281590182 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x563511369b00 0x56351137b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:26.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.844+0000 7f9b5d1d8740 4 client.6069 mds_command: new command op to 5820 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:56:26.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.844+0000 7f9b5d1d8740 1 -- 172.21.15.7:0/4281590182 --> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56351128f630 con 0x563511369b00 2024-04-25T09:56:26.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.844+0000 7f9b53fff640 1 --2- 172.21.15.7:0/4281590182 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x563511369b00 0x56351137b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:26.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.845+0000 7f9b32ffd640 10 client.6069 ms_handle_connect on v2:172.21.15.7:6835/2232311564 2024-04-25T09:56:26.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.845+0000 7f9b53fff640 1 --2- 172.21.15.7:0/4281590182 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x563511369b00 0x56351137b290 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d513e20cc48a154 server_cookie=2c8579b1abdbb2c6 in_seq=0 out_seq=0 2024-04-25T09:56:26.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.845+0000 7f9b32ffd640 1 -- 172.21.15.7:0/4281590182 <== mds.0 v2:172.21.15.7:6835/2232311564 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x56351128f630 con 0x563511369b00 2024-04-25T09:56:26.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.845+0000 7f9b32ffd640 10 client.6069 handle_command_reply: tid=0 2024-04-25T09:56:26.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.845+0000 7f9b5d1d8740 1 client.6069 shutdown 2024-04-25T09:56:26.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.845+0000 7f9b5d1d8740 1 -- 172.21.15.7:0/4281590182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56351134bef0 msgr2=0x5635113401c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.845+0000 7f9b5d1d8740 1 --2- 172.21.15.7:0/4281590182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56351134bef0 0x5635113401c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c039040 tx=0x7f9b4c00b040 comp rx=0 tx=0).stop 2024-04-25T09:56:26.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.845+0000 7f9b5d1d8740 1 -- 172.21.15.7:0/4281590182 shutdown_connections 2024-04-25T09:56:26.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.845+0000 7f9b5d1d8740 1 --2- 172.21.15.7:0/4281590182 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x563511369b00 0x56351137b290 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.845+0000 7f9b5d1d8740 1 --2- 172.21.15.7:0/4281590182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56351134bef0 0x5635113401c0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.845+0000 7f9b5d1d8740 1 --2- 172.21.15.7:0/4281590182 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56351134bb10 0x563511322990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.845+0000 7f9b5d1d8740 1 --2- 172.21.15.7:0/4281590182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5635113416a0 0x5635113d2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.845+0000 7f9b32ffd640 0 client.6069 ms_handle_reset on v2:172.21.15.7:6835/2232311564 2024-04-25T09:56:26.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.845+0000 7f9b5d1d8740 1 -- 172.21.15.7:0/4281590182 >> 172.21.15.7:0/4281590182 conn(0x56351131e770 msgr2=0x56351134e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:26.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.845+0000 7f9b5d1d8740 1 -- 172.21.15.7:0/4281590182 shutdown_connections 2024-04-25T09:56:26.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.845+0000 7f9b5d1d8740 1 -- 172.21.15.7:0/4281590182 wait complete. 2024-04-25T09:56:26.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.845+0000 7f9b5d1d8740 20 client.6069 trim_cache size 0 max 16384 2024-04-25T09:56:26.855 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T09:56:26.855 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:56:26.855 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-04-25T09:56:26.855 INFO:teuthology.orchestra.run.smithi007.stdout: "faf264ae-a3c7-4901-980e-0ee27a5e1b35": { 2024-04-25T09:56:26.855 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-04-25T09:56:26.856 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "faf264ae-a3c7-4901-980e-0ee27a5e1b35", 2024-04-25T09:56:26.856 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,repair" 2024-04-25T09:56:26.856 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:56:26.856 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:56:26.856 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T09:56:26.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.846+0000 7f9b5a4d2640 1 -- 172.21.15.7:0/1717536376 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9b4006b4d0 msgr2=0x7f9b4006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.846+0000 7f9b5a4d2640 1 --2- 172.21.15.7:0/1717536376 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9b4006b4d0 0x7f9b4006d990 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9b48033000 tx=0x7f9b48009030 comp rx=0 tx=0).stop 2024-04-25T09:56:26.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.846+0000 7f9b5a4d2640 1 -- 172.21.15.7:0/1717536376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b3c0043a0 msgr2=0x7f9b541f3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:26.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.846+0000 7f9b5a4d2640 1 --2- 172.21.15.7:0/1717536376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b3c0043a0 0x7f9b541f3220 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f9b44011830 tx=0x7f9b44011cf0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.846+0000 7f9b5a4d2640 1 -- 172.21.15.7:0/1717536376 shutdown_connections 2024-04-25T09:56:26.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.846+0000 7f9b5a4d2640 1 --2- 172.21.15.7:0/1717536376 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9b4006b4d0 0x7f9b4006d990 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.846+0000 7f9b5a4d2640 1 --2- 172.21.15.7:0/1717536376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b540c8fb0 0x7f9b540c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.846+0000 7f9b5a4d2640 1 --2- 172.21.15.7:0/1717536376 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9b541574c0 0x7f9b54157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.846+0000 7f9b5a4d2640 1 --2- 172.21.15.7:0/1717536376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9b3c0043a0 0x7f9b541f3220 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:26.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.846+0000 7f9b5a4d2640 1 -- 172.21.15.7:0/1717536376 >> 172.21.15.7:0/1717536376 conn(0x7f9b54072680 msgr2=0x7f9b5415fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:26.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.846+0000 7f9b5a4d2640 1 -- 172.21.15.7:0/1717536376 shutdown_connections 2024-04-25T09:56:26.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:26.846+0000 7f9b5a4d2640 1 -- 172.21.15.7:0/1717536376 wait complete. 2024-04-25T09:56:26.860 INFO:tasks.cephfs.filesystem:scrub status for tag:faf264ae-a3c7-4901-980e-0ee27a5e1b35 - {'path': '/', 'tag': 'faf264ae-a3c7-4901-980e-0ee27a5e1b35', 'options': 'recursive,repair'} 2024-04-25T09:56:27.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:27.584+0000 7f46517fa640 1 -- 172.21.15.7:0/3976736611 <== mon.0 v2:172.21.15.7:3300/0 7 ==== log(6 entries from seq 1 at 2024-04-25T09:56:26.695149+0000) v1 ==== 1078+0+0 (secure 0 0 0) 0x7f4654089b50 con 0x7f465c156380 2024-04-25T09:56:27.588 INFO:teuthology.orchestra.run.smithi007.stdout: cluster: 2024-04-25T09:56:27.588 INFO:teuthology.orchestra.run.smithi007.stdout: id: c03d0745-5946-49c3-ad88-1165c5b68b4e 2024-04-25T09:56:27.588 INFO:teuthology.orchestra.run.smithi007.stdout: health: HEALTH_OK 2024-04-25T09:56:27.588 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:27.588 INFO:teuthology.orchestra.run.smithi007.stdout: services: 2024-04-25T09:56:27.588 INFO:teuthology.orchestra.run.smithi007.stdout: mon: 3 daemons, quorum a,b,c (age 2m) 2024-04-25T09:56:27.589 INFO:teuthology.orchestra.run.smithi007.stdout: mgr: y(active, since 2m), standbys: x 2024-04-25T09:56:27.589 INFO:teuthology.orchestra.run.smithi007.stdout: mds: 1/1 daemons up, 3 standby 2024-04-25T09:56:27.589 INFO:teuthology.orchestra.run.smithi007.stdout: osd: 8 osds: 8 up (since 2m), 8 in (since 2m) 2024-04-25T09:56:27.589 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:27.589 INFO:teuthology.orchestra.run.smithi007.stdout: data: 2024-04-25T09:56:27.589 INFO:teuthology.orchestra.run.smithi007.stdout: volumes: 1/1 healthy 2024-04-25T09:56:27.589 INFO:teuthology.orchestra.run.smithi007.stdout: pools: 3 pools, 97 pgs 2024-04-25T09:56:27.589 INFO:teuthology.orchestra.run.smithi007.stdout: objects: 24 objects, 579 KiB 2024-04-25T09:56:27.589 INFO:teuthology.orchestra.run.smithi007.stdout: usage: 249 MiB used, 720 GiB / 720 GiB avail 2024-04-25T09:56:27.589 INFO:teuthology.orchestra.run.smithi007.stdout: pgs: 97 active+clean 2024-04-25T09:56:27.589 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:27.589 INFO:teuthology.orchestra.run.smithi007.stdout: io: 2024-04-25T09:56:27.589 INFO:teuthology.orchestra.run.smithi007.stdout: client: 1.4 KiB/s wr, 0 op/s rd, 4 op/s wr 2024-04-25T09:56:27.590 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:27.590 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:27.590 INFO:teuthology.orchestra.run.smithi007.stdout:2024-04-25T09:56:26.695149+0000 mds.c [INF] scrub queued for path: / 2024-04-25T09:56:27.590 INFO:teuthology.orchestra.run.smithi007.stdout:2024-04-25T09:56:26.695152+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-04-25T09:56:27.590 INFO:teuthology.orchestra.run.smithi007.stdout:2024-04-25T09:56:26.695157+0000 mds.c [INF] scrub summary: active paths [/] 2024-04-25T09:56:27.590 INFO:teuthology.orchestra.run.smithi007.stdout:2024-04-25T09:56:26.695929+0000 mds.c [WRN] bad backtrace on inode 0x10000000001(/parent_a/alpha), rewriting it 2024-04-25T09:56:27.590 INFO:teuthology.orchestra.run.smithi007.stdout:2024-04-25T09:56:26.695938+0000 mds.c [INF] Scrub repaired inode 0x10000000001 (/parent_a/alpha) 2024-04-25T09:56:27.590 INFO:teuthology.orchestra.run.smithi007.stdout:2024-04-25T09:56:26.696475+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-04-25T09:56:31.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:31.590+0000 7f46517fa640 1 -- 172.21.15.7:0/3976736611 <== mon.0 v2:172.21.15.7:3300/0 8 ==== log(1 entries from seq 7 at 2024-04-25T09:56:30.045629+0000) v1 ==== 189+0+0 (secure 0 0 0) 0x7f4654057dc0 con 0x7f465c156380 2024-04-25T09:56:31.594 INFO:teuthology.orchestra.run.smithi007.stdout:2024-04-25T09:56:30.045629+0000 mds.c [INF] scrub summary: idle 2024-04-25T09:56:56.383 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:56:56.387 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:56:56.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:56:56.861 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub status 2024-04-25T09:56:56.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.974+0000 7f8ab1c1f640 1 Processor -- start 2024-04-25T09:56:56.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.974+0000 7f8ab1c1f640 1 -- start start 2024-04-25T09:56:56.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.974+0000 7f8ab1c1f640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8aac06e950 0x7f8aac0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:56.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.974+0000 7f8ab1c1f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8aac0ce610 0x7f8aac0ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:56.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.974+0000 7f8ab1c1f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aac0b2ee0 con 0x7f8aac143fb0 2024-04-25T09:56:56.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.975+0000 7f8ab1c1f640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aac0b3150 con 0x7f8aac06e950 2024-04-25T09:56:56.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.975+0000 7f8ab1c1f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac0b3430 con 0x7f8aac0ce610 2024-04-25T09:56:56.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.975+0000 7f8aaaffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8aac06e950 0x7f8aac0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:56.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.975+0000 7f8aaaffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8aac06e950 0x7f8aac0b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55036/0 (socket says 172.21.15.7:55036) 2024-04-25T09:56:56.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.975+0000 7f8aaaffd640 1 -- 172.21.15.7:0/3322393868 learned_addr learned my addr 172.21.15.7:0/3322393868 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:56.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.975+0000 7f8aabfff640 1 --2- 172.21.15.7:0/3322393868 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8aac0ce610 0x7f8aac0ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:56.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.975+0000 7f8aaaffd640 1 -- 172.21.15.7:0/3322393868 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8aac0ce610 msgr2=0x7f8aac0ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:56.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.975+0000 7f8aaaffd640 1 --2- 172.21.15.7:0/3322393868 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8aac0ce610 0x7f8aac0ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:56.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.975+0000 7f8aaaffd640 1 -- 172.21.15.7:0/3322393868 >> v1:172.21.15.55:6789/0 conn(0x7f8aac143fb0 legacy=0x7f8aac06e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:56.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.975+0000 7f8aaaffd640 1 -- 172.21.15.7:0/3322393868 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aac0b3710 con 0x7f8aac06e950 2024-04-25T09:56:56.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.976+0000 7f8aaaffd640 1 --2- 172.21.15.7:0/3322393868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aac06e950 0x7f8aac0b3c30 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0009870 tx=0x7f8aa002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd960ed5d70f404 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:56.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.976+0000 7f8aaa7fc640 1 -- 172.21.15.7:0/3322393868 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa0037070 con 0x7f8aac06e950 2024-04-25T09:56:56.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.976+0000 7f8aaa7fc640 1 -- 172.21.15.7:0/3322393868 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa0032440 con 0x7f8aac06e950 2024-04-25T09:56:56.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.976+0000 7f8aaa7fc640 1 -- 172.21.15.7:0/3322393868 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa0032810 con 0x7f8aac06e950 2024-04-25T09:56:56.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.976+0000 7f8ab1c1f640 1 -- 172.21.15.7:0/3322393868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aac06e950 msgr2=0x7f8aac0b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:56.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.976+0000 7f8ab1c1f640 1 --2- 172.21.15.7:0/3322393868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aac06e950 0x7f8aac0b3c30 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0009870 tx=0x7f8aa002a210 comp rx=0 tx=0).stop 2024-04-25T09:56:56.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.976+0000 7f8ab1c1f640 1 -- 172.21.15.7:0/3322393868 shutdown_connections 2024-04-25T09:56:56.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.976+0000 7f8ab1c1f640 1 --2- 172.21.15.7:0/3322393868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aac06e950 0x7f8aac0b3c30 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:56.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.976+0000 7f8ab1c1f640 1 --2- 172.21.15.7:0/3322393868 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8aac0ce610 0x7f8aac0ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:56.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.976+0000 7f8ab1c1f640 1 -- 172.21.15.7:0/3322393868 >> 172.21.15.7:0/3322393868 conn(0x7f8aac06ab60 msgr2=0x7f8aac06af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:56.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.977+0000 7f8ab1c1f640 1 -- 172.21.15.7:0/3322393868 shutdown_connections 2024-04-25T09:56:56.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.977+0000 7f8ab1c1f640 1 -- 172.21.15.7:0/3322393868 wait complete. 2024-04-25T09:56:56.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.978+0000 7f8ab1c1f640 1 Processor -- start 2024-04-25T09:56:56.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.978+0000 7f8ab1c1f640 1 -- start start 2024-04-25T09:56:56.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.979+0000 7f8ab1c1f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aac06e950 0x7f8aac140e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:56.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.979+0000 7f8ab1c1f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aac0ce610 0x7f8aac13bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:56.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.979+0000 7f8ab1c1f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8aac143fb0 0x7f8aac0b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:56.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.979+0000 7f8ab1c1f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac0cf2f0 con 0x7f8aac06e950 2024-04-25T09:56:56.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.979+0000 7f8ab1c1f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac144390 con 0x7f8aac0ce610 2024-04-25T09:56:56.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.979+0000 7f8ab1c1f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac15ac70 con 0x7f8aac143fb0 2024-04-25T09:56:56.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.979+0000 7f8aab7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aac06e950 0x7f8aac140e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:56.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.979+0000 7f8aab7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aac06e950 0x7f8aac140e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55046/0 (socket says 172.21.15.7:55046) 2024-04-25T09:56:56.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.979+0000 7f8aab7fe640 1 -- 172.21.15.7:0/2145889238 learned_addr learned my addr 172.21.15.7:0/2145889238 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:56.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.979+0000 7f8aabfff640 1 --2- 172.21.15.7:0/2145889238 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8aac143fb0 0x7f8aac0b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:56.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.979+0000 7f8aaaffd640 1 --2- 172.21.15.7:0/2145889238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aac0ce610 0x7f8aac13bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:56.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.979+0000 7f8aab7fe640 1 -- 172.21.15.7:0/2145889238 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8aac143fb0 msgr2=0x7f8aac0b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:56.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.979+0000 7f8aab7fe640 1 --2- 172.21.15.7:0/2145889238 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8aac143fb0 0x7f8aac0b0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:56.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.979+0000 7f8aab7fe640 1 -- 172.21.15.7:0/2145889238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aac0ce610 msgr2=0x7f8aac13bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:56.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.979+0000 7f8aab7fe640 1 --2- 172.21.15.7:0/2145889238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aac0ce610 0x7f8aac13bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:56.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.979+0000 7f8aab7fe640 1 -- 172.21.15.7:0/2145889238 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aac0b0140 con 0x7f8aac06e950 2024-04-25T09:56:56.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.979+0000 7f8aab7fe640 1 --2- 172.21.15.7:0/2145889238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aac06e950 0x7f8aac140e60 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00b420 tx=0x7f8a9c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:56.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.979+0000 7f8a93fff640 1 -- 172.21.15.7:0/2145889238 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c011830 con 0x7f8aac06e950 2024-04-25T09:56:56.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.980+0000 7f8a93fff640 1 -- 172.21.15.7:0/2145889238 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9c016070 con 0x7f8aac06e950 2024-04-25T09:56:56.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.980+0000 7f8ab1c1f640 1 -- 172.21.15.7:0/2145889238 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aac0b0420 con 0x7f8aac06e950 2024-04-25T09:56:56.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.980+0000 7f8a93fff640 1 -- 172.21.15.7:0/2145889238 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c011c10 con 0x7f8aac06e950 2024-04-25T09:56:56.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.980+0000 7f8ab1c1f640 1 -- 172.21.15.7:0/2145889238 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aac15a4c0 con 0x7f8aac06e950 2024-04-25T09:56:56.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.981+0000 7f8a93fff640 1 -- 172.21.15.7:0/2145889238 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8a9c01b460 con 0x7f8aac06e950 2024-04-25T09:56:56.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.982+0000 7f8a93fff640 1 --2- 172.21.15.7:0/2145889238 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8a9806b4d0 0x7f8a9806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:56.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.982+0000 7f8a93fff640 1 -- 172.21.15.7:0/2145889238 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8a9c089f40 con 0x7f8aac06e950 2024-04-25T09:56:56.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.982+0000 7f8aaaffd640 1 --2- 172.21.15.7:0/2145889238 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8a9806b4d0 0x7f8a9806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:56.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.982+0000 7f8aaaffd640 1 --2- 172.21.15.7:0/2145889238 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8a9806b4d0 0x7f8a9806d990 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0034000 tx=0x7f8aa002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:56.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.983+0000 7f8ab4a04740 1 Processor -- start 2024-04-25T09:56:56.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.983+0000 7f8ab4a04740 1 -- start start 2024-04-25T09:56:56.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.984+0000 7f8ab4a04740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55bf76687b10 0x55bf7668a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:56.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.984+0000 7f8ab4a04740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf76687ef0 0x55bf7668a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:56.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.984+0000 7f8ab4a04740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bf7665a770 0x55bf7665df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:56.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.984+0000 7f8ab4a04740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf765c3da0 con 0x55bf7665a770 2024-04-25T09:56:56.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.984+0000 7f8ab4a04740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf7656cb80 con 0x55bf76687ef0 2024-04-25T09:56:56.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.984+0000 7f8ab4a04740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bf765bfe40 con 0x55bf76687b10 2024-04-25T09:56:56.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.984+0000 7f8aabfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bf7665a770 0x55bf7665df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:56.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.984+0000 7f8aabfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bf7665a770 0x55bf7665df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55062/0 (socket says 172.21.15.7:55062) 2024-04-25T09:56:56.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.984+0000 7f8aabfff640 1 -- 172.21.15.7:0/2317065370 learned_addr learned my addr 172.21.15.7:0/2317065370 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:56.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.984+0000 7f8aaaffd640 1 --2- 172.21.15.7:0/2317065370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf76687ef0 0x55bf7668a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:56.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.984+0000 7f8aab7fe640 1 --2- 172.21.15.7:0/2317065370 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55bf76687b10 0x55bf7668a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:56.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.984+0000 7f8aabfff640 1 -- 172.21.15.7:0/2317065370 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55bf76687b10 msgr2=0x55bf7668a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:56.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.984+0000 7f8aabfff640 1 --2- 172.21.15.7:0/2317065370 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55bf76687b10 0x55bf7668a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:56.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.984+0000 7f8aabfff640 1 -- 172.21.15.7:0/2317065370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf76687ef0 msgr2=0x55bf7668a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:56.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.984+0000 7f8aabfff640 1 --2- 172.21.15.7:0/2317065370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf76687ef0 0x55bf7668a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:56.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.984+0000 7f8aabfff640 1 -- 172.21.15.7:0/2317065370 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf76576f10 con 0x55bf7665a770 2024-04-25T09:56:56.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.984+0000 7f8aabfff640 1 --2- 172.21.15.7:0/2317065370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bf7665a770 0x55bf7665df80 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40039e0 tx=0x7f8aa4003ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18c3b0014bcd14f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:56.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.985+0000 7f8a917fa640 1 -- 172.21.15.7:0/2317065370 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4015420 con 0x55bf7665a770 2024-04-25T09:56:56.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.985+0000 7f8a917fa640 1 -- 172.21.15.7:0/2317065370 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa401a070 con 0x55bf7665a770 2024-04-25T09:56:56.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.985+0000 7f8a917fa640 1 -- 172.21.15.7:0/2317065370 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa40157c0 con 0x55bf7665a770 2024-04-25T09:56:56.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.985+0000 7f8ab4a04740 1 -- 172.21.15.7:0/2317065370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bf7665a770 msgr2=0x55bf7665df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:56.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.985+0000 7f8ab4a04740 1 --2- 172.21.15.7:0/2317065370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bf7665a770 0x55bf7665df80 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40039e0 tx=0x7f8aa4003ea0 comp rx=0 tx=0).stop 2024-04-25T09:56:56.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.985+0000 7f8ab4a04740 1 -- 172.21.15.7:0/2317065370 shutdown_connections 2024-04-25T09:56:56.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.985+0000 7f8ab4a04740 1 --2- 172.21.15.7:0/2317065370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bf7665a770 0x55bf7665df80 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:56.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.985+0000 7f8ab4a04740 1 --2- 172.21.15.7:0/2317065370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf76687ef0 0x55bf7668a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:56.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.985+0000 7f8ab4a04740 1 --2- 172.21.15.7:0/2317065370 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55bf76687b10 0x55bf7668a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:56.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.985+0000 7f8ab4a04740 1 -- 172.21.15.7:0/2317065370 >> 172.21.15.7:0/2317065370 conn(0x55bf7665c9e0 msgr2=0x55bf766a5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:56.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.985+0000 7f8ab4a04740 1 -- 172.21.15.7:0/2317065370 shutdown_connections 2024-04-25T09:56:56.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.986+0000 7f8ab4a04740 1 -- 172.21.15.7:0/2317065370 wait complete. 2024-04-25T09:56:56.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.986+0000 7f8ab4a04740 1 -- start start 2024-04-25T09:56:56.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.986+0000 7f8ab4a04740 1 Processor -- start 2024-04-25T09:56:56.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.987+0000 7f8ab4a04740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55bf76687b10 0x55bf766a23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:56.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.987+0000 7f8ab4a04740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf76687ef0 0x55bf766a8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:56.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.987+0000 7f8ab4a04740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bf7667fae0 0x55bf7667ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:56.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.987+0000 7f8ab4a04740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf7665fb90 con 0x55bf7667fae0 2024-04-25T09:56:56.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.987+0000 7f8ab4a04740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf765624b0 con 0x55bf76687ef0 2024-04-25T09:56:56.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.987+0000 7f8ab4a04740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bf7665fe70 con 0x55bf76687b10 2024-04-25T09:56:56.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.987+0000 7f8ab4a04740 10 client.0 _ll_register_callbacks cb 0x55bf765a2180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:56:56.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.987+0000 7f8aabfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bf7667fae0 0x55bf7667ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:56.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.987+0000 7f8aabfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bf7667fae0 0x55bf7667ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55064/0 (socket says 172.21.15.7:55064) 2024-04-25T09:56:56.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.987+0000 7f8aabfff640 1 -- 172.21.15.7:0/336224269 learned_addr learned my addr 172.21.15.7:0/336224269 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:56.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.987+0000 7f8aaaffd640 1 --2- 172.21.15.7:0/336224269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf76687ef0 0x55bf766a8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:56.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.987+0000 7f8aab7fe640 1 --2- 172.21.15.7:0/336224269 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55bf76687b10 0x55bf766a23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:56.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.987+0000 7f8aabfff640 1 -- 172.21.15.7:0/336224269 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55bf76687b10 msgr2=0x55bf766a23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:56.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.987+0000 7f8aabfff640 1 --2- 172.21.15.7:0/336224269 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55bf76687b10 0x55bf766a23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:56.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.987+0000 7f8aabfff640 1 -- 172.21.15.7:0/336224269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf76687ef0 msgr2=0x55bf766a8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:56.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.987+0000 7f8aabfff640 1 --2- 172.21.15.7:0/336224269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf76687ef0 0x55bf766a8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:56.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.987+0000 7f8aabfff640 1 -- 172.21.15.7:0/336224269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bf763a27d0 con 0x55bf7667fae0 2024-04-25T09:56:56.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.988+0000 7f8aabfff640 1 --2- 172.21.15.7:0/336224269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bf7667fae0 0x55bf7667ff60 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4003ee0 tx=0x7f8aa4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c7b20f59d9cf3d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:56.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.988+0000 7f8a8a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:56:56.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.988+0000 7f8a8a7fc640 1 -- 172.21.15.7:0/336224269 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4015c40 con 0x55bf7667fae0 2024-04-25T09:56:56.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.988+0000 7f8a8a7fc640 1 -- 172.21.15.7:0/336224269 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8aa4015de0 con 0x55bf7667fae0 2024-04-25T09:56:56.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.988+0000 7f8ab4a04740 1 -- 172.21.15.7:0/336224269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8aa401a070 con 0x55bf7667fae0 2024-04-25T09:56:56.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.988+0000 7f8a8a7fc640 1 -- 172.21.15.7:0/336224269 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8aa402e050 con 0x55bf7667fae0 2024-04-25T09:56:56.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.988+0000 7f8ab4a04740 10 client.6081 fetch_fsmap learned FSMap version 21 2024-04-25T09:56:56.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.988+0000 7f8ab4a04740 1 -- 172.21.15.7:0/336224269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x55bf762d83f0 con 0x55bf7667fae0 2024-04-25T09:56:56.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.988+0000 7f8a8a7fc640 1 -- 172.21.15.7:0/336224269 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa401a070 con 0x55bf7667fae0 2024-04-25T09:56:56.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.988+0000 7f8a8a7fc640 1 -- 172.21.15.7:0/336224269 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 21) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8aa4031020 con 0x55bf7667fae0 2024-04-25T09:56:56.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.988+0000 7f8ab4a04740 10 client.6081 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T09:56:56.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.988+0000 7f8ab4a04740 10 client.6081 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-04-25T09:56:56.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.988+0000 7f8ab4a04740 20 client.6081 populate_metadata read hostname 'smithi007' 2024-04-25T09:56:56.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.988+0000 7f8ab4a04740 1 --2- 172.21.15.7:0/336224269 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x55bf7667e210 0x55bf766c2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:56.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.988+0000 7f8ab4a04740 4 client.6081 mds_command: new command op to 5820 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:56:56.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.988+0000 7f8ab4a04740 1 -- 172.21.15.7:0/336224269 --> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bf765d12e0 con 0x55bf7667e210 2024-04-25T09:56:56.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.988+0000 7f8aab7fe640 1 --2- 172.21.15.7:0/336224269 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x55bf7667e210 0x55bf766c2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:56.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.989+0000 7f8aab7fe640 1 --2- 172.21.15.7:0/336224269 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x55bf7667e210 0x55bf766c2600 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e681274738726e19 server_cookie=7b259483d3de40b8 in_seq=0 out_seq=0 2024-04-25T09:56:56.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.989+0000 7f8a8a7fc640 10 client.6081 ms_handle_connect on v2:172.21.15.7:6835/2232311564 2024-04-25T09:56:56.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.989+0000 7f8a8a7fc640 1 -- 172.21.15.7:0/336224269 <== mds.0 v2:172.21.15.7:6835/2232311564 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55bf765d12e0 con 0x55bf7667e210 2024-04-25T09:56:56.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.989+0000 7f8a8a7fc640 10 client.6081 handle_command_reply: tid=0 2024-04-25T09:56:56.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.989+0000 7f8ab4a04740 1 client.6081 shutdown 2024-04-25T09:56:56.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.989+0000 7f8ab4a04740 1 -- 172.21.15.7:0/336224269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bf7667fae0 msgr2=0x55bf7667ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:57.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.989+0000 7f8ab4a04740 1 --2- 172.21.15.7:0/336224269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bf7667fae0 0x55bf7667ff60 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4003ee0 tx=0x7f8aa4004ab0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.990+0000 7f8ab4a04740 1 -- 172.21.15.7:0/336224269 shutdown_connections 2024-04-25T09:56:57.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.990+0000 7f8ab4a04740 1 --2- 172.21.15.7:0/336224269 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x55bf7667e210 0x55bf766c2600 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.990+0000 7f8ab4a04740 1 --2- 172.21.15.7:0/336224269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bf7667fae0 0x55bf7667ff60 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.990+0000 7f8ab4a04740 1 --2- 172.21.15.7:0/336224269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf76687ef0 0x55bf766a8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.990+0000 7f8a8a7fc640 0 client.6081 ms_handle_reset on v2:172.21.15.7:6835/2232311564 2024-04-25T09:56:57.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.990+0000 7f8ab4a04740 1 --2- 172.21.15.7:0/336224269 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55bf76687b10 0x55bf766a23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.990+0000 7f8ab4a04740 1 -- 172.21.15.7:0/336224269 >> 172.21.15.7:0/336224269 conn(0x55bf7665a770 msgr2=0x55bf76686f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:57.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.990+0000 7f8ab4a04740 1 -- 172.21.15.7:0/336224269 shutdown_connections 2024-04-25T09:56:57.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.990+0000 7f8ab4a04740 1 -- 172.21.15.7:0/336224269 wait complete. 2024-04-25T09:56:57.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:56.990+0000 7f8ab4a04740 20 client.6081 trim_cache size 0 max 16384 2024-04-25T09:56:57.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.005+0000 7f8ab4a04740 1 Processor -- start 2024-04-25T09:56:57.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.005+0000 7f8ab4a04740 1 -- start start 2024-04-25T09:56:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.006+0000 7f8ab4a04740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bf7667fae0 0x55bf76686320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.006+0000 7f8ab4a04740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55bf76687b10 0x55bf766a6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.006+0000 7f8ab4a04740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf76687ef0 0x55bf766a6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.006+0000 7f8ab4a04740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac200370 con 0x55bf7667fae0 2024-04-25T09:56:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.006+0000 7f8ab4a04740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac1ff530 con 0x55bf76687ef0 2024-04-25T09:56:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.006+0000 7f8ab4a04740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac0adda0 con 0x55bf76687b10 2024-04-25T09:56:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.006+0000 7f8aab7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bf7667fae0 0x55bf76686320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.006+0000 7f8aab7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bf7667fae0 0x55bf76686320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55070/0 (socket says 172.21.15.7:55070) 2024-04-25T09:56:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.006+0000 7f8aab7fe640 1 -- 172.21.15.7:0/1184297076 learned_addr learned my addr 172.21.15.7:0/1184297076 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:57.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.006+0000 7f8aab7fe640 1 -- 172.21.15.7:0/1184297076 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55bf76687b10 msgr2=0x55bf766a6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:57.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.006+0000 7f8aab7fe640 1 --2- 172.21.15.7:0/1184297076 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55bf76687b10 0x55bf766a6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.006+0000 7f8aab7fe640 1 -- 172.21.15.7:0/1184297076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf76687ef0 msgr2=0x55bf766a6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:57.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.006+0000 7f8aab7fe640 1 --2- 172.21.15.7:0/1184297076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf76687ef0 0x55bf766a6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.006+0000 7f8aab7fe640 1 -- 172.21.15.7:0/1184297076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf762980f0 con 0x55bf7667fae0 2024-04-25T09:56:57.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.007+0000 7f8aab7fe640 1 --2- 172.21.15.7:0/1184297076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bf7667fae0 0x55bf76686320 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c088370 tx=0x7f8a9c01d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca17160c3b289c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:57.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.007+0000 7f8a90ff9640 1 -- 172.21.15.7:0/1184297076 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c085070 con 0x55bf7667fae0 2024-04-25T09:56:57.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.007+0000 7f8a90ff9640 1 -- 172.21.15.7:0/1184297076 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9c056970 con 0x55bf7667fae0 2024-04-25T09:56:57.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.007+0000 7f8a90ff9640 1 -- 172.21.15.7:0/1184297076 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c057ac0 con 0x55bf7667fae0 2024-04-25T09:56:57.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.007+0000 7f8ab4a04740 1 -- 172.21.15.7:0/1184297076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bf7667fae0 msgr2=0x55bf76686320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:57.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.007+0000 7f8ab4a04740 1 --2- 172.21.15.7:0/1184297076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bf7667fae0 0x55bf76686320 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c088370 tx=0x7f8a9c01d040 comp rx=0 tx=0).stop 2024-04-25T09:56:57.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.007+0000 7f8ab4a04740 1 -- 172.21.15.7:0/1184297076 shutdown_connections 2024-04-25T09:56:57.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.007+0000 7f8ab4a04740 1 --2- 172.21.15.7:0/1184297076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf76687ef0 0x55bf766a6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.007+0000 7f8ab4a04740 1 --2- 172.21.15.7:0/1184297076 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55bf76687b10 0x55bf766a6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.007+0000 7f8ab4a04740 1 --2- 172.21.15.7:0/1184297076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bf7667fae0 0x55bf76686320 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.007+0000 7f8ab4a04740 1 -- 172.21.15.7:0/1184297076 >> 172.21.15.7:0/1184297076 conn(0x55bf7665a770 msgr2=0x55bf76682b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:57.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.007+0000 7f8ab4a04740 1 -- 172.21.15.7:0/1184297076 shutdown_connections 2024-04-25T09:56:57.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.007+0000 7f8ab4a04740 1 -- 172.21.15.7:0/1184297076 wait complete. 2024-04-25T09:56:57.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.008+0000 7f8ab4a04740 1 -- start start 2024-04-25T09:56:57.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.008+0000 7f8ab4a04740 1 Processor -- start 2024-04-25T09:56:57.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.009+0000 7f8ab4a04740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bf7667fae0 0x55bf766a6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:57.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.009+0000 7f8ab4a04740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf76687b10 0x55bf766a6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:57.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.009+0000 7f8ab4a04740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55bf76687ef0 0x55bf76680f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:57.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.009+0000 7f8ab4a04740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac1fef80 con 0x55bf7667fae0 2024-04-25T09:56:57.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.009+0000 7f8ab4a04740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf76685df0 con 0x55bf76687b10 2024-04-25T09:56:57.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.009+0000 7f8ab4a04740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bf76655b80 con 0x55bf76687ef0 2024-04-25T09:56:57.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.009+0000 7f8ab4a04740 10 client.0 _ll_register_callbacks cb 0x7f8aa4009c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:56:57.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.009+0000 7f8aab7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bf7667fae0 0x55bf766a6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:57.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.009+0000 7f8aab7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bf7667fae0 0x55bf766a6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55080/0 (socket says 172.21.15.7:55080) 2024-04-25T09:56:57.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.009+0000 7f8aab7fe640 1 -- 172.21.15.7:0/374532128 learned_addr learned my addr 172.21.15.7:0/374532128 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:57.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.009+0000 7f8aabfff640 1 --2- 172.21.15.7:0/374532128 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55bf76687ef0 0x55bf76680f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:57.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.009+0000 7f8aaaffd640 1 --2- 172.21.15.7:0/374532128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf76687b10 0x55bf766a6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:57.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.009+0000 7f8aab7fe640 1 -- 172.21.15.7:0/374532128 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55bf76687ef0 msgr2=0x55bf76680f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:57.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.009+0000 7f8aab7fe640 1 --2- 172.21.15.7:0/374532128 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55bf76687ef0 0x55bf76680f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.009+0000 7f8aab7fe640 1 -- 172.21.15.7:0/374532128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf76687b10 msgr2=0x55bf766a6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:57.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.009+0000 7f8aab7fe640 1 --2- 172.21.15.7:0/374532128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf76687b10 0x55bf766a6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.009+0000 7f8aab7fe640 1 -- 172.21.15.7:0/374532128 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bf7667ef50 con 0x55bf7667fae0 2024-04-25T09:56:57.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.009+0000 7f8aab7fe640 1 --2- 172.21.15.7:0/374532128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bf7667fae0 0x55bf766a6450 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c015000 tx=0x7f8aa400e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48e135324f5347ce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:57.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.009+0000 7f8a8a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:56:57.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.009+0000 7f8a8a7fc640 1 -- 172.21.15.7:0/374532128 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c085070 con 0x55bf7667fae0 2024-04-25T09:56:57.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.010+0000 7f8a8a7fc640 1 -- 172.21.15.7:0/374532128 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8a9c057cc0 con 0x55bf7667fae0 2024-04-25T09:56:57.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.010+0000 7f8ab4a04740 1 -- 172.21.15.7:0/374532128 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8a9c056970 con 0x55bf7667fae0 2024-04-25T09:56:57.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.010+0000 7f8a8a7fc640 1 -- 172.21.15.7:0/374532128 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a9c0543c0 con 0x55bf7667fae0 2024-04-25T09:56:57.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.010+0000 7f8ab4a04740 10 client.6087 fetch_fsmap learned FSMap version 21 2024-04-25T09:56:57.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.010+0000 7f8ab4a04740 1 -- 172.21.15.7:0/374532128 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x55bf766a5320 con 0x55bf7667fae0 2024-04-25T09:56:57.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.010+0000 7f8a8a7fc640 1 -- 172.21.15.7:0/374532128 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9c056970 con 0x55bf7667fae0 2024-04-25T09:56:57.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.010+0000 7f8a8a7fc640 1 -- 172.21.15.7:0/374532128 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 21) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8a9c054560 con 0x55bf7667fae0 2024-04-25T09:56:57.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.010+0000 7f8ab4a04740 10 client.6087 fetch_fsmap finished waiting for FSMap version 21 2024-04-25T09:56:57.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.010+0000 7f8ab4a04740 10 client.6087 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-04-25T09:56:57.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.010+0000 7f8ab4a04740 20 client.6087 populate_metadata read hostname 'smithi007' 2024-04-25T09:56:57.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.010+0000 7f8ab4a04740 1 --2- 172.21.15.7:0/374532128 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x55bf7665f840 0x55bf766814b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:57.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.010+0000 7f8ab4a04740 4 client.6087 mds_command: new command op to 5820 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:56:57.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.010+0000 7f8ab4a04740 1 -- 172.21.15.7:0/374532128 --> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55bf765cb630 con 0x55bf7665f840 2024-04-25T09:56:57.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.010+0000 7f8aaaffd640 1 --2- 172.21.15.7:0/374532128 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x55bf7665f840 0x55bf766814b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:57.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.010+0000 7f8aaaffd640 1 --2- 172.21.15.7:0/374532128 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x55bf7665f840 0x55bf766814b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0c7319d87fbb924 server_cookie=5bd7a96ae80a1ebc in_seq=0 out_seq=0 2024-04-25T09:56:57.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.010+0000 7f8a8a7fc640 10 client.6087 ms_handle_connect on v2:172.21.15.7:6835/2232311564 2024-04-25T09:56:57.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.011+0000 7f8a8a7fc640 1 -- 172.21.15.7:0/374532128 <== mds.0 v2:172.21.15.7:6835/2232311564 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55bf765cb630 con 0x55bf7665f840 2024-04-25T09:56:57.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.011+0000 7f8a8a7fc640 10 client.6087 handle_command_reply: tid=0 2024-04-25T09:56:57.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.011+0000 7f8ab4a04740 1 client.6087 shutdown 2024-04-25T09:56:57.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.011+0000 7f8ab4a04740 1 -- 172.21.15.7:0/374532128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bf7667fae0 msgr2=0x55bf766a6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:57.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.011+0000 7f8ab4a04740 1 --2- 172.21.15.7:0/374532128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bf7667fae0 0x55bf766a6450 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c015000 tx=0x7f8aa400e000 comp rx=0 tx=0).stop 2024-04-25T09:56:57.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.011+0000 7f8ab4a04740 1 -- 172.21.15.7:0/374532128 shutdown_connections 2024-04-25T09:56:57.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.011+0000 7f8ab4a04740 1 --2- 172.21.15.7:0/374532128 >> [v2:172.21.15.7:6835/2232311564,v1:172.21.15.7:6836/2232311564] conn(0x55bf7665f840 0x55bf766814b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.011+0000 7f8ab4a04740 1 --2- 172.21.15.7:0/374532128 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55bf76687ef0 0x55bf76680f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.011+0000 7f8ab4a04740 1 --2- 172.21.15.7:0/374532128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bf76687b10 0x55bf766a6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.011+0000 7f8ab4a04740 1 --2- 172.21.15.7:0/374532128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bf7667fae0 0x55bf766a6450 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.011+0000 7f8a8a7fc640 0 client.6087 ms_handle_reset on v2:172.21.15.7:6835/2232311564 2024-04-25T09:56:57.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.011+0000 7f8ab4a04740 1 -- 172.21.15.7:0/374532128 >> 172.21.15.7:0/374532128 conn(0x55bf7665a770 msgr2=0x55bf766607a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:57.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.011+0000 7f8ab4a04740 1 -- 172.21.15.7:0/374532128 shutdown_connections 2024-04-25T09:56:57.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.011+0000 7f8ab4a04740 1 -- 172.21.15.7:0/374532128 wait complete. 2024-04-25T09:56:57.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.011+0000 7f8ab4a04740 20 client.6087 trim_cache size 0 max 16384 2024-04-25T09:56:57.022 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T09:56:57.022 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-04-25T09:56:57.022 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-04-25T09:56:57.022 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T09:56:57.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.011+0000 7f8ab1c1f640 1 -- 172.21.15.7:0/2145889238 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8a9806b4d0 msgr2=0x7f8a9806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:57.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.011+0000 7f8ab1c1f640 1 --2- 172.21.15.7:0/2145889238 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8a9806b4d0 0x7f8a9806d990 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0034000 tx=0x7f8aa002e000 comp rx=0 tx=0).stop 2024-04-25T09:56:57.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.011+0000 7f8ab1c1f640 1 -- 172.21.15.7:0/2145889238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aac06e950 msgr2=0x7f8aac140e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:57.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.011+0000 7f8ab1c1f640 1 --2- 172.21.15.7:0/2145889238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aac06e950 0x7f8aac140e60 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00b420 tx=0x7f8a9c00b8e0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.011+0000 7f8ab1c1f640 1 -- 172.21.15.7:0/2145889238 shutdown_connections 2024-04-25T09:56:57.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.011+0000 7f8ab1c1f640 1 --2- 172.21.15.7:0/2145889238 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8a9806b4d0 0x7f8a9806d990 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.011+0000 7f8ab1c1f640 1 --2- 172.21.15.7:0/2145889238 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8aac143fb0 0x7f8aac0b0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.011+0000 7f8ab1c1f640 1 --2- 172.21.15.7:0/2145889238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aac0ce610 0x7f8aac13bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.011+0000 7f8ab1c1f640 1 --2- 172.21.15.7:0/2145889238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aac06e950 0x7f8aac140e60 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.012+0000 7f8ab1c1f640 1 -- 172.21.15.7:0/2145889238 >> 172.21.15.7:0/2145889238 conn(0x7f8aac06ab60 msgr2=0x7f8aac15b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:57.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.012+0000 7f8ab1c1f640 1 -- 172.21.15.7:0/2145889238 shutdown_connections 2024-04-25T09:56:57.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.012+0000 7f8ab1c1f640 1 -- 172.21.15.7:0/2145889238 wait complete. 2024-04-25T09:56:57.026 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:56:57.127 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:56:57.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.226+0000 7ff885676640 1 Processor -- start 2024-04-25T09:56:57.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.226+0000 7ff885676640 1 -- start start 2024-04-25T09:56:57.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.227+0000 7ff885676640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff88015db00 0x7ff8800d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:57.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.227+0000 7ff885676640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff8800ce2b0 0x7ff8800d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:57.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.227+0000 7ff885676640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8800d1e80 con 0x7ff8800b53b0 2024-04-25T09:56:57.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.227+0000 7ff885676640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8800b5930 con 0x7ff8800ce2b0 2024-04-25T09:56:57.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.227+0000 7ff885676640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8800b5c10 con 0x7ff88015db00 2024-04-25T09:56:57.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.227+0000 7ff87f7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff8800ce2b0 0x7ff8800d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:57.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.227+0000 7ff87e7fc640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff8800b53b0 0x7ff880161670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46740/0 (socket says 172.21.15.7:46740) 2024-04-25T09:56:57.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.227+0000 7ff87e7fc640 1 -- 172.21.15.7:0/1615260608 learned_addr learned my addr 172.21.15.7:0/1615260608 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:56:57.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.227+0000 7ff87effd640 1 --2- 172.21.15.7:0/1615260608 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff88015db00 0x7ff8800d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:57.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.227+0000 7ff87dffb640 1 -- 172.21.15.7:0/1615260608 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1779954393 0 0) 0x7ff8800d1e80 con 0x7ff8800b53b0 2024-04-25T09:56:57.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.227+0000 7ff87dffb640 1 -- 172.21.15.7:0/1615260608 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff86c003520 con 0x7ff8800b53b0 2024-04-25T09:56:57.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.227+0000 7ff87f7fe640 1 -- 172.21.15.7:0/1615260608 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff88015db00 msgr2=0x7ff8800d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:57.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.227+0000 7ff87f7fe640 1 --2- 172.21.15.7:0/1615260608 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff88015db00 0x7ff8800d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.227+0000 7ff87f7fe640 1 -- 172.21.15.7:0/1615260608 >> v1:172.21.15.7:6789/0 conn(0x7ff8800b53b0 legacy=0x7ff880161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:57.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.227+0000 7ff87f7fe640 1 -- 172.21.15.7:0/1615260608 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8800b5ef0 con 0x7ff8800ce2b0 2024-04-25T09:56:57.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.228+0000 7ff87f7fe640 1 --2- 172.21.15.7:0/1615260608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8800ce2b0 0x7ff8800d0880 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ff870009d90 tx=0x7ff87002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1551d36308fc649 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:57.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.228+0000 7ff87dffb640 1 -- 172.21.15.7:0/1615260608 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff870007740 con 0x7ff8800ce2b0 2024-04-25T09:56:57.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.228+0000 7ff87dffb640 1 -- 172.21.15.7:0/1615260608 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8700078e0 con 0x7ff8800ce2b0 2024-04-25T09:56:57.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.228+0000 7ff87dffb640 1 -- 172.21.15.7:0/1615260608 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff870007cb0 con 0x7ff8800ce2b0 2024-04-25T09:56:57.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.229+0000 7ff885676640 1 -- 172.21.15.7:0/1615260608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8800ce2b0 msgr2=0x7ff8800d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:57.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.229+0000 7ff885676640 1 --2- 172.21.15.7:0/1615260608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8800ce2b0 0x7ff8800d0880 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ff870009d90 tx=0x7ff87002a660 comp rx=0 tx=0).stop 2024-04-25T09:56:57.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.229+0000 7ff885676640 1 -- 172.21.15.7:0/1615260608 shutdown_connections 2024-04-25T09:56:57.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.229+0000 7ff885676640 1 --2- 172.21.15.7:0/1615260608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8800ce2b0 0x7ff8800d0880 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.229+0000 7ff885676640 1 --2- 172.21.15.7:0/1615260608 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff88015db00 0x7ff8800d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.229+0000 7ff885676640 1 -- 172.21.15.7:0/1615260608 >> 172.21.15.7:0/1615260608 conn(0x7ff880072290 msgr2=0x7ff8800726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:57.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.229+0000 7ff885676640 1 -- 172.21.15.7:0/1615260608 shutdown_connections 2024-04-25T09:56:57.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.229+0000 7ff885676640 1 -- 172.21.15.7:0/1615260608 wait complete. 2024-04-25T09:56:57.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.230+0000 7ff885676640 1 Processor -- start 2024-04-25T09:56:57.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.230+0000 7ff885676640 1 -- start start 2024-04-25T09:56:57.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.231+0000 7ff885676640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8800b53b0 0x7ff88015ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:57.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.231+0000 7ff885676640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8800ce2b0 0x7ff8800c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:57.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.231+0000 7ff885676640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff88015db00 0x7ff8800c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:57.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.231+0000 7ff885676640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8800d3660 con 0x7ff88015db00 2024-04-25T09:56:57.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.231+0000 7ff885676640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8800b61d0 con 0x7ff8800b53b0 2024-04-25T09:56:57.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.231+0000 7ff885676640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8800b6c10 con 0x7ff8800ce2b0 2024-04-25T09:56:57.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.231+0000 7ff87f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff88015db00 0x7ff8800c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:57.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.231+0000 7ff87f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff88015db00 0x7ff8800c9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55098/0 (socket says 172.21.15.7:55098) 2024-04-25T09:56:57.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.231+0000 7ff87f7fe640 1 -- 172.21.15.7:0/3496656102 learned_addr learned my addr 172.21.15.7:0/3496656102 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:57.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.231+0000 7ff87effd640 1 --2- 172.21.15.7:0/3496656102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8800b53b0 0x7ff88015ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:57.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.231+0000 7ff87e7fc640 1 --2- 172.21.15.7:0/3496656102 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8800ce2b0 0x7ff8800c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:57.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.232+0000 7ff87f7fe640 1 -- 172.21.15.7:0/3496656102 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8800ce2b0 msgr2=0x7ff8800c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:57.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.232+0000 7ff87f7fe640 1 --2- 172.21.15.7:0/3496656102 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8800ce2b0 0x7ff8800c9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.232+0000 7ff87f7fe640 1 -- 172.21.15.7:0/3496656102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8800b53b0 msgr2=0x7ff88015ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:57.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.232+0000 7ff87f7fe640 1 --2- 172.21.15.7:0/3496656102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8800b53b0 0x7ff88015ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.232+0000 7ff87f7fe640 1 -- 172.21.15.7:0/3496656102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8801f3870 con 0x7ff88015db00 2024-04-25T09:56:57.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.232+0000 7ff87f7fe640 1 --2- 172.21.15.7:0/3496656102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff88015db00 0x7ff8800c9ca0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ff870009eb0 tx=0x7ff870004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:57.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.232+0000 7ff8777fe640 1 -- 172.21.15.7:0/3496656102 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff870040070 con 0x7ff88015db00 2024-04-25T09:56:57.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.232+0000 7ff8777fe640 1 -- 172.21.15.7:0/3496656102 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff870031bc0 con 0x7ff88015db00 2024-04-25T09:56:57.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.232+0000 7ff885676640 1 -- 172.21.15.7:0/3496656102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8801f3b50 con 0x7ff88015db00 2024-04-25T09:56:57.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.232+0000 7ff8777fe640 1 -- 172.21.15.7:0/3496656102 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff870009450 con 0x7ff88015db00 2024-04-25T09:56:57.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.232+0000 7ff885676640 1 -- 172.21.15.7:0/3496656102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8801f4110 con 0x7ff88015db00 2024-04-25T09:56:57.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.233+0000 7ff885676640 1 -- 172.21.15.7:0/3496656102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff880068fd0 con 0x7ff88015db00 2024-04-25T09:56:57.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.233+0000 7ff8777fe640 1 -- 172.21.15.7:0/3496656102 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff870039040 con 0x7ff88015db00 2024-04-25T09:56:57.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.234+0000 7ff8777fe640 1 --2- 172.21.15.7:0/3496656102 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff86006b4d0 0x7ff86006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:57.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.234+0000 7ff8777fe640 1 -- 172.21.15.7:0/3496656102 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff8700ab9e0 con 0x7ff88015db00 2024-04-25T09:56:57.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.234+0000 7ff87effd640 1 --2- 172.21.15.7:0/3496656102 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff86006b4d0 0x7ff86006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:57.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.234+0000 7ff87effd640 1 --2- 172.21.15.7:0/3496656102 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff86006b4d0 0x7ff86006d990 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff878009aa0 tx=0x7ff878009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:57.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.238+0000 7ff8777fe640 1 -- 172.21.15.7:0/3496656102 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff87007a1a0 con 0x7ff88015db00 2024-04-25T09:56:57.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.458+0000 7ff885676640 1 -- 172.21.15.7:0/3496656102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8800d16b0 con 0x7ff88015db00 2024-04-25T09:56:57.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.459+0000 7ff8777fe640 1 -- 172.21.15.7:0/3496656102 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4932 (secure 0 0 0) 0x7ff87007e240 con 0x7ff88015db00 2024-04-25T09:56:57.463 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:57.463 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5072,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1716545079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1716545079},{"type":"v1","addr":"172.21.15.7:6837","nonce":1716545079}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5434,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1851611776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1851611776},{"type":"v1","addr":"172.21.15.55:6834","nonce":1851611776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2607486300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2607486300},{"type":"v1","addr":"172.21.15.55:6835","nonce":2607486300}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:56:14.756973+0000","modified":"2024-04-25T09:56:16.763894+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5820":{"gid":5820,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6836/2232311564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2232311564},{"type":"v1","addr":"172.21.15.7:6836","nonce":2232311564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:56:57.463 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 21 2024-04-25T09:56:57.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.461+0000 7ff885676640 1 -- 172.21.15.7:0/3496656102 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff86006b4d0 msgr2=0x7ff86006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:57.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.461+0000 7ff885676640 1 --2- 172.21.15.7:0/3496656102 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff86006b4d0 0x7ff86006d990 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff878009aa0 tx=0x7ff878009190 comp rx=0 tx=0).stop 2024-04-25T09:56:57.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.461+0000 7ff885676640 1 -- 172.21.15.7:0/3496656102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff88015db00 msgr2=0x7ff8800c9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:57.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.461+0000 7ff885676640 1 --2- 172.21.15.7:0/3496656102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff88015db00 0x7ff8800c9ca0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ff870009eb0 tx=0x7ff870004a40 comp rx=0 tx=0).stop 2024-04-25T09:56:57.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.461+0000 7ff885676640 1 -- 172.21.15.7:0/3496656102 shutdown_connections 2024-04-25T09:56:57.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.461+0000 7ff885676640 1 --2- 172.21.15.7:0/3496656102 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff86006b4d0 0x7ff86006d990 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.461+0000 7ff885676640 1 --2- 172.21.15.7:0/3496656102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff88015db00 0x7ff8800c9ca0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.461+0000 7ff885676640 1 --2- 172.21.15.7:0/3496656102 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8800ce2b0 0x7ff8800c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.461+0000 7ff885676640 1 --2- 172.21.15.7:0/3496656102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8800b53b0 0x7ff88015ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.461+0000 7ff885676640 1 -- 172.21.15.7:0/3496656102 >> 172.21.15.7:0/3496656102 conn(0x7ff880072290 msgr2=0x7ff8800d4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:57.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.461+0000 7ff885676640 1 -- 172.21.15.7:0/3496656102 shutdown_connections 2024-04-25T09:56:57.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.461+0000 7ff885676640 1 -- 172.21.15.7:0/3496656102 wait complete. 2024-04-25T09:56:57.476 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-25T09:56:57.597 INFO:teuthology.orchestra.run.smithi007.stdout:{"message":"","return_code":0} 2024-04-25T09:56:57.597 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T09:56:57.597 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-04-25T09:56:57.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.637+0000 7fd2c551df40 1 Processor -- start 2024-04-25T09:56:57.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.637+0000 7fd2c551df40 1 -- start start 2024-04-25T09:56:57.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.638+0000 7fd2c551df40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5627a5a15e70 0x5627a5b7c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:57.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.638+0000 7fd2c551df40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627a5ae3ad0 0x5627a5ae57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:57.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.638+0000 7fd2c551df40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5627a5ae3eb0 0x5627a5ae6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:57.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.638+0000 7fd2c551df40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627a5af17f0 con 0x5627a5ae3ad0 2024-04-25T09:56:57.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.638+0000 7fd2c551df40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627a59bedf0 con 0x5627a5a15e70 2024-04-25T09:56:57.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.638+0000 7fd2c551df40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5627a5af1230 con 0x5627a5ae3eb0 2024-04-25T09:56:57.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.638+0000 7fd2c1d99640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627a5ae3ad0 0x5627a5ae57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:57.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.638+0000 7fd2c1d99640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627a5ae3ad0 0x5627a5ae57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55110/0 (socket says 172.21.15.7:55110) 2024-04-25T09:56:57.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.638+0000 7fd2c1d99640 1 -- 172.21.15.7:0/1458775050 learned_addr learned my addr 172.21.15.7:0/1458775050 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:57.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.638+0000 7fd2c259a640 1 --2- 172.21.15.7:0/1458775050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5627a5a15e70 0x5627a5b7c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:57.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.638+0000 7fd2c2d9b640 1 --2- 172.21.15.7:0/1458775050 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5627a5ae3eb0 0x5627a5ae6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:57.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.639+0000 7fd2c1d99640 1 -- 172.21.15.7:0/1458775050 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5627a5ae3eb0 msgr2=0x5627a5ae6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:57.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.639+0000 7fd2c1d99640 1 --2- 172.21.15.7:0/1458775050 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5627a5ae3eb0 0x5627a5ae6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.639+0000 7fd2c1d99640 1 -- 172.21.15.7:0/1458775050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5627a5a15e70 msgr2=0x5627a5b7c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:57.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.639+0000 7fd2c1d99640 1 --2- 172.21.15.7:0/1458775050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5627a5a15e70 0x5627a5b7c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.639+0000 7fd2c1d99640 1 -- 172.21.15.7:0/1458775050 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627a5944c50 con 0x5627a5ae3ad0 2024-04-25T09:56:57.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.639+0000 7fd2c2d9b640 1 --2- 172.21.15.7:0/1458775050 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5627a5ae3eb0 0x5627a5ae6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:57.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.639+0000 7fd2c1d99640 1 --2- 172.21.15.7:0/1458775050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627a5ae3ad0 0x5627a5ae57b0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8006f20 tx=0x7fd2b800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd9694525b70ed9a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:57.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.639+0000 7fd2c0d97640 1 -- 172.21.15.7:0/1458775050 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b8012070 con 0x5627a5ae3ad0 2024-04-25T09:56:57.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.639+0000 7fd2c0d97640 1 -- 172.21.15.7:0/1458775050 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b800e690 con 0x5627a5ae3ad0 2024-04-25T09:56:57.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.639+0000 7fd2c0d97640 1 -- 172.21.15.7:0/1458775050 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b800ea80 con 0x5627a5ae3ad0 2024-04-25T09:56:57.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.639+0000 7fd2c551df40 1 -- 172.21.15.7:0/1458775050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627a5ae3ad0 msgr2=0x5627a5ae57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:57.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.639+0000 7fd2c551df40 1 --2- 172.21.15.7:0/1458775050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627a5ae3ad0 0x5627a5ae57b0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8006f20 tx=0x7fd2b800b780 comp rx=0 tx=0).stop 2024-04-25T09:56:57.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.639+0000 7fd2c551df40 1 -- 172.21.15.7:0/1458775050 shutdown_connections 2024-04-25T09:56:57.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.639+0000 7fd2c551df40 1 --2- 172.21.15.7:0/1458775050 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5627a5ae3eb0 0x5627a5ae6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.639+0000 7fd2c551df40 1 --2- 172.21.15.7:0/1458775050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627a5ae3ad0 0x5627a5ae57b0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.639+0000 7fd2c551df40 1 --2- 172.21.15.7:0/1458775050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5627a5a15e70 0x5627a5b7c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.639+0000 7fd2c551df40 1 -- 172.21.15.7:0/1458775050 >> 172.21.15.7:0/1458775050 conn(0x5627a5a16a60 msgr2=0x5627a5a5f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:57.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.639+0000 7fd2c551df40 1 -- 172.21.15.7:0/1458775050 shutdown_connections 2024-04-25T09:56:57.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.639+0000 7fd2c551df40 1 -- 172.21.15.7:0/1458775050 wait complete. 2024-04-25T09:56:57.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.640+0000 7fd2c551df40 1 Processor -- start 2024-04-25T09:56:57.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.640+0000 7fd2c551df40 1 -- start start 2024-04-25T09:56:57.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.641+0000 7fd2c551df40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5627a5a15e70 0x5627a5b7b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:57.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.641+0000 7fd2c551df40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627a5ae3ad0 0x5627a5aebda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:57.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.641+0000 7fd2c551df40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5627a5ae3eb0 0x5627a5aec2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:57.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.641+0000 7fd2c551df40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627a5a1a600 con 0x5627a5ae3ad0 2024-04-25T09:56:57.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.641+0000 7fd2c551df40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627a5af02b0 con 0x5627a5ae3eb0 2024-04-25T09:56:57.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.641+0000 7fd2c551df40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5627a5b7c7e0 con 0x5627a5a15e70 2024-04-25T09:56:57.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.641+0000 7fd2c1d99640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627a5ae3ad0 0x5627a5aebda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:57.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.641+0000 7fd2c1d99640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627a5ae3ad0 0x5627a5aebda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55112/0 (socket says 172.21.15.7:55112) 2024-04-25T09:56:57.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.641+0000 7fd2c1d99640 1 -- 172.21.15.7:0/2478443231 learned_addr learned my addr 172.21.15.7:0/2478443231 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:57.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.641+0000 7fd2c2d9b640 1 --2- 172.21.15.7:0/2478443231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5627a5ae3eb0 0x5627a5aec2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:57.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.641+0000 7fd2c259a640 1 --2- 172.21.15.7:0/2478443231 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5627a5a15e70 0x5627a5b7b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:57.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.641+0000 7fd2c1d99640 1 -- 172.21.15.7:0/2478443231 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5627a5a15e70 msgr2=0x5627a5b7b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:57.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.641+0000 7fd2c1d99640 1 --2- 172.21.15.7:0/2478443231 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5627a5a15e70 0x5627a5b7b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.641+0000 7fd2c1d99640 1 -- 172.21.15.7:0/2478443231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5627a5ae3eb0 msgr2=0x5627a5aec2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:57.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.641+0000 7fd2c1d99640 1 --2- 172.21.15.7:0/2478443231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5627a5ae3eb0 0x5627a5aec2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.641+0000 7fd2c1d99640 1 -- 172.21.15.7:0/2478443231 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627a5b7c610 con 0x5627a5ae3ad0 2024-04-25T09:56:57.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.641+0000 7fd2c259a640 1 --2- 172.21.15.7:0/2478443231 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5627a5a15e70 0x5627a5b7b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:57.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.641+0000 7fd2c1d99640 1 --2- 172.21.15.7:0/2478443231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627a5ae3ad0 0x5627a5aebda0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8006ec0 tx=0x7fd2b8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:57.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.642+0000 7fd2b37fe640 1 -- 172.21.15.7:0/2478443231 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b8012050 con 0x5627a5ae3ad0 2024-04-25T09:56:57.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.642+0000 7fd2b37fe640 1 -- 172.21.15.7:0/2478443231 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b8017650 con 0x5627a5ae3ad0 2024-04-25T09:56:57.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.642+0000 7fd2c551df40 1 -- 172.21.15.7:0/2478443231 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5627a5b7bdd0 con 0x5627a5ae3ad0 2024-04-25T09:56:57.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.642+0000 7fd2b37fe640 1 -- 172.21.15.7:0/2478443231 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b8017ac0 con 0x5627a5ae3ad0 2024-04-25T09:56:57.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.642+0000 7fd2c551df40 1 -- 172.21.15.7:0/2478443231 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627a5b7c330 con 0x5627a5ae3ad0 2024-04-25T09:56:57.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.643+0000 7fd2b37fe640 1 -- 172.21.15.7:0/2478443231 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd2b8021070 con 0x5627a5ae3ad0 2024-04-25T09:56:57.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.643+0000 7fd2b37fe640 1 --2- 172.21.15.7:0/2478443231 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd2a4069eb0 0x7fd2a406c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:57.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.644+0000 7fd2b37fe640 1 -- 172.21.15.7:0/2478443231 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd2b808af40 con 0x5627a5ae3ad0 2024-04-25T09:56:57.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.644+0000 7fd2c259a640 1 --2- 172.21.15.7:0/2478443231 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd2a4069eb0 0x7fd2a406c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:57.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.644+0000 7fd2c551df40 1 --2- 172.21.15.7:0/2478443231 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x5627a5ae4a20 0x5627a5ae4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:57.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.644+0000 7fd2c551df40 1 -- 172.21.15.7:0/2478443231 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) v9 -- 0x5627a5ad60e0 con 0x5627a5ae4a20 2024-04-25T09:56:57.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.644+0000 7fd2c2d9b640 1 --2- 172.21.15.7:0/2478443231 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x5627a5ae4a20 0x5627a5ae4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:57.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.644+0000 7fd2c259a640 1 --2- 172.21.15.7:0/2478443231 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd2a4069eb0 0x7fd2a406c370 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd2b400a520 tx=0x7fd2b4050000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:57.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.644+0000 7fd2c2d9b640 1 --2- 172.21.15.7:0/2478443231 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x5627a5ae4a20 0x5627a5ae4e30 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:57.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.644+0000 7fd2c2d9b640 1 -- 172.21.15.7:0/2478443231 <== osd.1 v2:172.21.15.7:6816/434435857 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7fd2bc00abe0 con 0x5627a5ae4a20 2024-04-25T09:56:57.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.644+0000 7fd2c551df40 1 -- 172.21.15.7:0/2478443231 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x5627a5ae4a20 msgr2=0x5627a5ae4e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:57.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.644+0000 7fd2c551df40 1 --2- 172.21.15.7:0/2478443231 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x5627a5ae4a20 0x5627a5ae4e30 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.645+0000 7fd2c551df40 1 -- 172.21.15.7:0/2478443231 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd2a4069eb0 msgr2=0x7fd2a406c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:57.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.645+0000 7fd2c551df40 1 --2- 172.21.15.7:0/2478443231 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd2a4069eb0 0x7fd2a406c370 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd2b400a520 tx=0x7fd2b4050000 comp rx=0 tx=0).stop 2024-04-25T09:56:57.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.645+0000 7fd2c551df40 1 -- 172.21.15.7:0/2478443231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627a5ae3ad0 msgr2=0x5627a5aebda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:57.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.645+0000 7fd2c551df40 1 --2- 172.21.15.7:0/2478443231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5627a5ae3ad0 0x5627a5aebda0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8006ec0 tx=0x7fd2b8000bc0 comp rx=0 tx=0).stop 2024-04-25T09:56:57.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.645+0000 7fd2c2d9b640 1 -- 172.21.15.7:0/2478443231 reap_dead start 2024-04-25T09:56:57.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.645+0000 7fd2c551df40 1 -- 172.21.15.7:0/2478443231 shutdown_connections 2024-04-25T09:56:57.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.645+0000 7fd2c551df40 1 -- 172.21.15.7:0/2478443231 >> 172.21.15.7:0/2478443231 conn(0x5627a5a16a60 msgr2=0x5627a5ae57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:57.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.645+0000 7fd2c551df40 1 -- 172.21.15.7:0/2478443231 shutdown_connections 2024-04-25T09:56:57.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:57.645+0000 7fd2c551df40 1 -- 172.21.15.7:0/2478443231 wait complete. 2024-04-25T09:56:57.655 INFO:teuthology.orchestra.run.smithi007.stdout:Yalphaparent_a 2024-04-25T09:56:57.655 DEBUG:teuthology.orchestra.run.smithi007:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-04-25T09:56:57.741 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T09:56:57.742 INFO:teuthology.orchestra.run.smithi007.stdout: "ino": 1099511627777, 2024-04-25T09:56:57.742 INFO:teuthology.orchestra.run.smithi007.stdout: "ancestors": [ 2024-04-25T09:56:57.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:56:57.742 INFO:teuthology.orchestra.run.smithi007.stdout: "dirino": 1099511627776, 2024-04-25T09:56:57.742 INFO:teuthology.orchestra.run.smithi007.stdout: "dname": "alpha", 2024-04-25T09:56:57.742 INFO:teuthology.orchestra.run.smithi007.stdout: "version": 2 2024-04-25T09:56:57.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:56:57.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:56:57.742 INFO:teuthology.orchestra.run.smithi007.stdout: "dirino": 1, 2024-04-25T09:56:57.742 INFO:teuthology.orchestra.run.smithi007.stdout: "dname": "parent_a", 2024-04-25T09:56:57.742 INFO:teuthology.orchestra.run.smithi007.stdout: "version": 4 2024-04-25T09:56:57.743 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:56:57.743 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-25T09:56:57.743 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 8, 2024-04-25T09:56:57.743 INFO:teuthology.orchestra.run.smithi007.stdout: "old_pools": [] 2024-04-25T09:56:57.743 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T09:56:57.743 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:57.744 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:56:57.744 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:56:57.820 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:56:57.862 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:56:57.863 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:56:57.863 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:56:57.879 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:56:57.879 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:56:57.935 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:56:58.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.073+0000 7f0718390640 1 Processor -- start 2024-04-25T09:56:58.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.073+0000 7f0718390640 1 -- start start 2024-04-25T09:56:58.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.074+0000 7f0718390640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f071015db00 0x7f07100d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:58.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.074+0000 7f0718390640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07100ce2b0 0x7f07100d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:58.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.074+0000 7f0718390640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07100d1e80 con 0x7f07100b53b0 2024-04-25T09:56:58.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.074+0000 7f0718390640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07100b5930 con 0x7f071015db00 2024-04-25T09:56:58.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.074+0000 7f0718390640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07100b5c10 con 0x7f07100ce2b0 2024-04-25T09:56:58.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.074+0000 7f071592b640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f07100b53b0 0x7f0710161670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46748/0 (socket says 172.21.15.7:46748) 2024-04-25T09:56:58.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.074+0000 7f071592b640 1 -- 172.21.15.7:0/2794008094 learned_addr learned my addr 172.21.15.7:0/2794008094 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:56:58.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.074+0000 7f071612c640 1 --2- 172.21.15.7:0/2794008094 >> v2:172.21.15.55:3300/0 conn(0x7f071015db00 0x7f07100d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:58.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.074+0000 7f071512a640 1 -- 172.21.15.7:0/2794008094 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1901404679 0 0) 0x7f07100d1e80 con 0x7f07100b53b0 2024-04-25T09:56:58.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.074+0000 7f071692d640 1 --2- 172.21.15.7:0/2794008094 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07100ce2b0 0x7f07100d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:58.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.074+0000 7f071512a640 1 -- 172.21.15.7:0/2794008094 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06fc003520 con 0x7f07100b53b0 2024-04-25T09:56:58.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.074+0000 7f071512a640 1 -- 172.21.15.7:0/2794008094 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1714326897 0 0) 0x7f06fc003520 con 0x7f07100b53b0 2024-04-25T09:56:58.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.074+0000 7f071512a640 1 -- 172.21.15.7:0/2794008094 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07100ce2b0 msgr2=0x7f07100d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:58.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.074+0000 7f071512a640 1 --2- 172.21.15.7:0/2794008094 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07100ce2b0 0x7f07100d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:58.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.074+0000 7f071512a640 1 -- 172.21.15.7:0/2794008094 >> v2:172.21.15.55:3300/0 conn(0x7f071015db00 msgr2=0x7f07100d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:58.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.074+0000 7f071512a640 1 --2- 172.21.15.7:0/2794008094 >> v2:172.21.15.55:3300/0 conn(0x7f071015db00 0x7f07100d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:58.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.074+0000 7f071512a640 1 -- 172.21.15.7:0/2794008094 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07100b5ef0 con 0x7f07100b53b0 2024-04-25T09:56:58.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.074+0000 7f071512a640 1 -- 172.21.15.7:0/2794008094 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f0700001670 con 0x7f07100b53b0 2024-04-25T09:56:58.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.074+0000 7f071512a640 1 -- 172.21.15.7:0/2794008094 >> v1:172.21.15.7:6789/0 conn(0x7f07100b53b0 legacy=0x7f0710161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:58.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.074+0000 7f071512a640 1 --2- 172.21.15.7:0/2794008094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06fc0039b0 0x7f06fc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:58.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.075+0000 7f071512a640 1 --2- 172.21.15.7:0/2794008094 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07100ce2b0 0x7f06fc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:58.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.075+0000 7f071512a640 1 --2- 172.21.15.7:0/2794008094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06fc004d40 0x7f06fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:58.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.075+0000 7f071512a640 1 -- 172.21.15.7:0/2794008094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07100b5930 con 0x7f06fc004d40 2024-04-25T09:56:58.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.075+0000 7f071512a640 1 -- 172.21.15.7:0/2794008094 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07100b5c10 con 0x7f06fc0039b0 2024-04-25T09:56:58.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.075+0000 7f071512a640 1 -- 172.21.15.7:0/2794008094 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc00b9c0 con 0x7f07100ce2b0 2024-04-25T09:56:58.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.075+0000 7f071692d640 1 --2- 172.21.15.7:0/2794008094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06fc004d40 0x7f06fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:58.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.075+0000 7f071612c640 1 --2- 172.21.15.7:0/2794008094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06fc0039b0 0x7f06fc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:58.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.075+0000 7f071592b640 1 --2- 172.21.15.7:0/2794008094 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07100ce2b0 0x7f06fc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:58.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.075+0000 7f071692d640 1 -- 172.21.15.7:0/2794008094 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07100ce2b0 msgr2=0x7f06fc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:58.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.075+0000 7f071692d640 1 --2- 172.21.15.7:0/2794008094 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07100ce2b0 0x7f06fc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:58.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.075+0000 7f071692d640 1 -- 172.21.15.7:0/2794008094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06fc0039b0 msgr2=0x7f06fc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:58.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.075+0000 7f071692d640 1 --2- 172.21.15.7:0/2794008094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06fc0039b0 0x7f06fc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:58.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.075+0000 7f071692d640 1 -- 172.21.15.7:0/2794008094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06fc003520 con 0x7f06fc004d40 2024-04-25T09:56:58.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.076+0000 7f071692d640 1 --2- 172.21.15.7:0/2794008094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06fc004d40 0x7f06fc0051c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f070800e170 tx=0x7f06fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd4577af42701d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:58.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.076+0000 7f071512a640 1 -- 172.21.15.7:0/2794008094 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0708034020 con 0x7f06fc004d40 2024-04-25T09:56:58.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.076+0000 7f071512a640 1 -- 172.21.15.7:0/2794008094 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07080305f0 con 0x7f06fc004d40 2024-04-25T09:56:58.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.076+0000 7f071512a640 1 -- 172.21.15.7:0/2794008094 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0708009c10 con 0x7f06fc004d40 2024-04-25T09:56:58.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.076+0000 7f0718390640 1 -- 172.21.15.7:0/2794008094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06fc004d40 msgr2=0x7f06fc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:58.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.076+0000 7f0718390640 1 --2- 172.21.15.7:0/2794008094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06fc004d40 0x7f06fc0051c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f070800e170 tx=0x7f06fc005830 comp rx=0 tx=0).stop 2024-04-25T09:56:58.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.076+0000 7f071692d640 1 -- 172.21.15.7:0/2794008094 reap_dead start 2024-04-25T09:56:58.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.076+0000 7f0718390640 1 -- 172.21.15.7:0/2794008094 shutdown_connections 2024-04-25T09:56:58.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.076+0000 7f0718390640 1 -- 172.21.15.7:0/2794008094 >> 172.21.15.7:0/2794008094 conn(0x7f0710072290 msgr2=0x7f07100726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:58.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.076+0000 7f0718390640 1 -- 172.21.15.7:0/2794008094 shutdown_connections 2024-04-25T09:56:58.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.076+0000 7f0718390640 1 -- 172.21.15.7:0/2794008094 wait complete. 2024-04-25T09:56:58.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.078+0000 7f0718390640 1 Processor -- start 2024-04-25T09:56:58.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.078+0000 7f0718390640 1 -- start start 2024-04-25T09:56:58.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.078+0000 7f0718390640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06fc004d40 0x7f071015f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:58.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.078+0000 7f0718390640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0710160a20 0x7f071014ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:58.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.078+0000 7f0718390640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f071015b160 0x7f071015b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:58.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.078+0000 7f0718390640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07100d3660 con 0x7f06fc004d40 2024-04-25T09:56:58.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.078+0000 7f0718390640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07100b61d0 con 0x7f0710160a20 2024-04-25T09:56:58.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.078+0000 7f0718390640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07100b6c10 con 0x7f071015b160 2024-04-25T09:56:58.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.078+0000 7f071612c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06fc004d40 0x7f071015f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:58.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.078+0000 7f071612c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06fc004d40 0x7f071015f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55122/0 (socket says 172.21.15.7:55122) 2024-04-25T09:56:58.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.078+0000 7f071612c640 1 -- 172.21.15.7:0/1751454849 learned_addr learned my addr 172.21.15.7:0/1751454849 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:58.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.079+0000 7f071592b640 1 --2- 172.21.15.7:0/1751454849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0710160a20 0x7f071014ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:58.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.079+0000 7f071692d640 1 --2- 172.21.15.7:0/1751454849 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f071015b160 0x7f071015b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:58.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.079+0000 7f071612c640 1 -- 172.21.15.7:0/1751454849 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f071015b160 msgr2=0x7f071015b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:58.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.079+0000 7f071612c640 1 --2- 172.21.15.7:0/1751454849 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f071015b160 0x7f071015b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:58.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.079+0000 7f071612c640 1 -- 172.21.15.7:0/1751454849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0710160a20 msgr2=0x7f071014ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:58.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.079+0000 7f071612c640 1 --2- 172.21.15.7:0/1751454849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0710160a20 0x7f071014ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:58.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.079+0000 7f071612c640 1 -- 172.21.15.7:0/1751454849 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071015eba0 con 0x7f06fc004d40 2024-04-25T09:56:58.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.079+0000 7f071692d640 1 --2- 172.21.15.7:0/1751454849 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f071015b160 0x7f071015b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:58.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.079+0000 7f071612c640 1 --2- 172.21.15.7:0/1751454849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06fc004d40 0x7f071015f920 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f070c011ad0 tx=0x7f070c011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:58.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.079+0000 7f0706ffd640 1 -- 172.21.15.7:0/1751454849 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c00fbb0 con 0x7f06fc004d40 2024-04-25T09:56:58.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.079+0000 7f0706ffd640 1 -- 172.21.15.7:0/1751454849 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070c00fd50 con 0x7f06fc004d40 2024-04-25T09:56:58.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.079+0000 7f0718390640 1 -- 172.21.15.7:0/1751454849 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f071015ee40 con 0x7f06fc004d40 2024-04-25T09:56:58.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.079+0000 7f0706ffd640 1 -- 172.21.15.7:0/1751454849 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c014660 con 0x7f06fc004d40 2024-04-25T09:56:58.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.079+0000 7f0718390640 1 -- 172.21.15.7:0/1751454849 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f071015f400 con 0x7f06fc004d40 2024-04-25T09:56:58.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.080+0000 7f0718390640 1 -- 172.21.15.7:0/1751454849 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0710068fd0 con 0x7f06fc004d40 2024-04-25T09:56:58.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.081+0000 7f0706ffd640 1 -- 172.21.15.7:0/1751454849 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f070c012040 con 0x7f06fc004d40 2024-04-25T09:56:58.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.081+0000 7f0706ffd640 1 --2- 172.21.15.7:0/1751454849 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f06f406b4d0 0x7f06f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:58.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.081+0000 7f0706ffd640 1 -- 172.21.15.7:0/1751454849 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f070c08aaa0 con 0x7f06fc004d40 2024-04-25T09:56:58.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.081+0000 7f071592b640 1 --2- 172.21.15.7:0/1751454849 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f06f406b4d0 0x7f06f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:58.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.082+0000 7f071592b640 1 --2- 172.21.15.7:0/1751454849 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f06f406b4d0 0x7f06f406d990 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f071015ead0 tx=0x7f0700007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:58.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.085+0000 7f0706ffd640 1 -- 172.21.15.7:0/1751454849 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f070c019030 con 0x7f06fc004d40 2024-04-25T09:56:58.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.266+0000 7f0718390640 1 -- 172.21.15.7:0/1751454849 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07100c6f20 con 0x7f06fc004d40 2024-04-25T09:56:58.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.267+0000 7f0706ffd640 1 -- 172.21.15.7:0/1751454849 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16846 (secure 0 0 0) 0x7f070c059710 con 0x7f06fc004d40 2024-04-25T09:56:58.270 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:56:58.271 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":51,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:56:16.391447+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:56:13.032097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T09:56:13.732257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:56:58.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.269+0000 7f0718390640 1 -- 172.21.15.7:0/1751454849 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f06f406b4d0 msgr2=0x7f06f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:58.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.269+0000 7f0718390640 1 --2- 172.21.15.7:0/1751454849 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f06f406b4d0 0x7f06f406d990 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f071015ead0 tx=0x7f0700007040 comp rx=0 tx=0).stop 2024-04-25T09:56:58.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.269+0000 7f0718390640 1 -- 172.21.15.7:0/1751454849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06fc004d40 msgr2=0x7f071015f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:58.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.269+0000 7f0718390640 1 --2- 172.21.15.7:0/1751454849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06fc004d40 0x7f071015f920 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f070c011ad0 tx=0x7f070c011f90 comp rx=0 tx=0).stop 2024-04-25T09:56:58.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.269+0000 7f0718390640 1 -- 172.21.15.7:0/1751454849 shutdown_connections 2024-04-25T09:56:58.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.269+0000 7f0718390640 1 --2- 172.21.15.7:0/1751454849 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f06f406b4d0 0x7f06f406d990 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:58.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.269+0000 7f0718390640 1 --2- 172.21.15.7:0/1751454849 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f071015b160 0x7f071015b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:58.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.269+0000 7f0718390640 1 --2- 172.21.15.7:0/1751454849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0710160a20 0x7f071014ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:58.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.269+0000 7f0718390640 1 --2- 172.21.15.7:0/1751454849 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06fc004d40 0x7f071015f920 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:58.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.269+0000 7f0718390640 1 -- 172.21.15.7:0/1751454849 >> 172.21.15.7:0/1751454849 conn(0x7f0710072290 msgr2=0x7f07100c7650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:58.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.269+0000 7f0718390640 1 -- 172.21.15.7:0/1751454849 shutdown_connections 2024-04-25T09:56:58.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.269+0000 7f0718390640 1 -- 172.21.15.7:0/1751454849 wait complete. 2024-04-25T09:56:58.284 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:56:13.032097+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:56:13.732257+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:56:58.284 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:56:58.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.384+0000 7f2f75f5c640 1 Processor -- start 2024-04-25T09:56:58.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.384+0000 7f2f75f5c640 1 -- start start 2024-04-25T09:56:58.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.385+0000 7f2f75f5c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f700ce830 0x7f2f7015eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:58.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.385+0000 7f2f75f5c640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f700ced10 con 0x7f2f700d3760 2024-04-25T09:56:58.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.385+0000 7f2f75f5c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f700d1b40 con 0x7f2f7015f1c0 2024-04-25T09:56:58.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.385+0000 7f2f75f5c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f700ce380 con 0x7f2f700ce830 2024-04-25T09:56:58.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.385+0000 7f2f6f7fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2f700d3760 0x7f2f700d3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46758/0 (socket says 172.21.15.7:46758) 2024-04-25T09:56:58.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.385+0000 7f2f6f7fe640 1 -- 172.21.15.7:0/2535605676 learned_addr learned my addr 172.21.15.7:0/2535605676 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:56:58.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.385+0000 7f2f6ffff640 1 --2- 172.21.15.7:0/2535605676 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f700ce830 0x7f2f7015eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:58.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.386+0000 7f2f6e7fc640 1 -- 172.21.15.7:0/2535605676 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3458651706 0 0) 0x7f2f700ced10 con 0x7f2f700d3760 2024-04-25T09:56:58.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.386+0000 7f2f6e7fc640 1 -- 172.21.15.7:0/2535605676 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f58003520 con 0x7f2f700d3760 2024-04-25T09:56:58.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.386+0000 7f2f6e7fc640 1 -- 172.21.15.7:0/2535605676 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 394033348 0 0) 0x7f2f700d1b40 con 0x7f2f7015f1c0 2024-04-25T09:56:58.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.386+0000 7f2f6e7fc640 1 -- 172.21.15.7:0/2535605676 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f700ced10 con 0x7f2f7015f1c0 2024-04-25T09:56:58.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.386+0000 7f2f6e7fc640 1 -- 172.21.15.7:0/2535605676 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4055478679 0 0) 0x7f2f58003520 con 0x7f2f700d3760 2024-04-25T09:56:58.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.386+0000 7f2f6e7fc640 1 -- 172.21.15.7:0/2535605676 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f700ce830 msgr2=0x7f2f7015eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:58.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.386+0000 7f2f6e7fc640 1 --2- 172.21.15.7:0/2535605676 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f700ce830 0x7f2f7015eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:58.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.386+0000 7f2f6e7fc640 1 -- 172.21.15.7:0/2535605676 >> v1:172.21.15.55:6789/0 conn(0x7f2f7015f1c0 legacy=0x7f2f700b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:58.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.386+0000 7f2f6e7fc640 1 -- 172.21.15.7:0/2535605676 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f700d1e20 con 0x7f2f700d3760 2024-04-25T09:56:58.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.386+0000 7f2f6e7fc640 1 -- 172.21.15.7:0/2535605676 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f2f60001670 con 0x7f2f700d3760 2024-04-25T09:56:58.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.386+0000 7f2f6e7fc640 1 -- 172.21.15.7:0/2535605676 >> v1:172.21.15.7:6789/0 conn(0x7f2f700d3760 legacy=0x7f2f700d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:58.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.386+0000 7f2f6e7fc640 1 --2- 172.21.15.7:0/2535605676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f58003b70 0x7f2f58003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:58.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.386+0000 7f2f6e7fc640 1 --2- 172.21.15.7:0/2535605676 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f700ce830 0x7f2f58004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:58.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.386+0000 7f2f6e7fc640 1 --2- 172.21.15.7:0/2535605676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f58004d40 0x7f2f580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:58.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.386+0000 7f2f6e7fc640 1 -- 172.21.15.7:0/2535605676 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5800ba70 con 0x7f2f58003b70 2024-04-25T09:56:58.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.386+0000 7f2f6e7fc640 1 -- 172.21.15.7:0/2535605676 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5800bbf0 con 0x7f2f58004d40 2024-04-25T09:56:58.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.386+0000 7f2f6e7fc640 1 -- 172.21.15.7:0/2535605676 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5800bdf0 con 0x7f2f700ce830 2024-04-25T09:56:58.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.386+0000 7f2f6f7fe640 1 --2- 172.21.15.7:0/2535605676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f58003b70 0x7f2f58003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:58.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.386+0000 7f2f6ffff640 1 --2- 172.21.15.7:0/2535605676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f58004d40 0x7f2f580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:58.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.386+0000 7f2f6effd640 1 --2- 172.21.15.7:0/2535605676 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f700ce830 0x7f2f58004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:58.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.386+0000 7f2f6f7fe640 1 -- 172.21.15.7:0/2535605676 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f700ce830 msgr2=0x7f2f58004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:58.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.386+0000 7f2f6f7fe640 1 --2- 172.21.15.7:0/2535605676 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f700ce830 0x7f2f58004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:58.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.386+0000 7f2f6f7fe640 1 -- 172.21.15.7:0/2535605676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f58004d40 msgr2=0x7f2f580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:58.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.386+0000 7f2f6f7fe640 1 --2- 172.21.15.7:0/2535605676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f58004d40 0x7f2f580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:58.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.386+0000 7f2f6f7fe640 1 -- 172.21.15.7:0/2535605676 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f58003520 con 0x7f2f58003b70 2024-04-25T09:56:58.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.386+0000 7f2f6ffff640 1 --2- 172.21.15.7:0/2535605676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f58004d40 0x7f2f580051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:58.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.387+0000 7f2f6f7fe640 1 --2- 172.21.15.7:0/2535605676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f58003b70 0x7f2f58003f70 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2f60007fc0 tx=0x7f2f58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf7bbd6d0be1e1f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:58.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.387+0000 7f2f6e7fc640 1 -- 172.21.15.7:0/2535605676 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f60007be0 con 0x7f2f58003b70 2024-04-25T09:56:58.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.387+0000 7f2f6e7fc640 1 -- 172.21.15.7:0/2535605676 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f60005af0 con 0x7f2f58003b70 2024-04-25T09:56:58.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.387+0000 7f2f6e7fc640 1 -- 172.21.15.7:0/2535605676 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f60007070 con 0x7f2f58003b70 2024-04-25T09:56:58.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.388+0000 7f2f75f5c640 1 -- 172.21.15.7:0/2535605676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f58003b70 msgr2=0x7f2f58003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:58.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.388+0000 7f2f75f5c640 1 --2- 172.21.15.7:0/2535605676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f58003b70 0x7f2f58003f70 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2f60007fc0 tx=0x7f2f58005830 comp rx=0 tx=0).stop 2024-04-25T09:56:58.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.388+0000 7f2f6ffff640 1 -- 172.21.15.7:0/2535605676 reap_dead start 2024-04-25T09:56:58.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.388+0000 7f2f75f5c640 1 -- 172.21.15.7:0/2535605676 shutdown_connections 2024-04-25T09:56:58.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.388+0000 7f2f75f5c640 1 -- 172.21.15.7:0/2535605676 >> 172.21.15.7:0/2535605676 conn(0x7f2f70072680 msgr2=0x7f2f70072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:58.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.388+0000 7f2f75f5c640 1 -- 172.21.15.7:0/2535605676 shutdown_connections 2024-04-25T09:56:58.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.388+0000 7f2f75f5c640 1 -- 172.21.15.7:0/2535605676 wait complete. 2024-04-25T09:56:58.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.389+0000 7f2f75f5c640 1 Processor -- start 2024-04-25T09:56:58.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.389+0000 7f2f75f5c640 1 -- start start 2024-04-25T09:56:58.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.390+0000 7f2f75f5c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f58003b70 0x7f2f700c6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:58.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.390+0000 7f2f75f5c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f7015af70 0x7f2f70159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:58.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.390+0000 7f2f75f5c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f701599c0 0x7f2f701499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:58.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.390+0000 7f2f75f5c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7015eac0 con 0x7f2f58003b70 2024-04-25T09:56:58.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.390+0000 7f2f75f5c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f700d2190 con 0x7f2f701599c0 2024-04-25T09:56:58.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.390+0000 7f2f75f5c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7015ec40 con 0x7f2f7015af70 2024-04-25T09:56:58.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.390+0000 7f2f6f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f58003b70 0x7f2f700c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:58.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.390+0000 7f2f6f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f58003b70 0x7f2f700c6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55142/0 (socket says 172.21.15.7:55142) 2024-04-25T09:56:58.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.390+0000 7f2f6f7fe640 1 -- 172.21.15.7:0/944388516 learned_addr learned my addr 172.21.15.7:0/944388516 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:58.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.390+0000 7f2f6effd640 1 --2- 172.21.15.7:0/944388516 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f7015af70 0x7f2f70159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:58.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.390+0000 7f2f6ffff640 1 --2- 172.21.15.7:0/944388516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f701599c0 0x7f2f701499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:58.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.390+0000 7f2f6f7fe640 1 -- 172.21.15.7:0/944388516 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f7015af70 msgr2=0x7f2f70159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:58.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.390+0000 7f2f6f7fe640 1 --2- 172.21.15.7:0/944388516 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f7015af70 0x7f2f70159480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:58.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.390+0000 7f2f6f7fe640 1 -- 172.21.15.7:0/944388516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f701599c0 msgr2=0x7f2f701499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:58.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.390+0000 7f2f6f7fe640 1 --2- 172.21.15.7:0/944388516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f701599c0 0x7f2f701499d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:58.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.390+0000 7f2f6f7fe640 1 -- 172.21.15.7:0/944388516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f70159ed0 con 0x7f2f58003b70 2024-04-25T09:56:58.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.390+0000 7f2f6ffff640 1 --2- 172.21.15.7:0/944388516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f701599c0 0x7f2f701499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:56:58.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.391+0000 7f2f6f7fe640 1 --2- 172.21.15.7:0/944388516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f58003b70 0x7f2f700c6400 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2f6000c1a0 tx=0x7f2f700ceee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:58.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.391+0000 7f2f57fff640 1 -- 172.21.15.7:0/944388516 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f60001670 con 0x7f2f58003b70 2024-04-25T09:56:58.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.391+0000 7f2f57fff640 1 -- 172.21.15.7:0/944388516 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f60042070 con 0x7f2f58003b70 2024-04-25T09:56:58.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.391+0000 7f2f57fff640 1 -- 172.21.15.7:0/944388516 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f60007270 con 0x7f2f58003b70 2024-04-25T09:56:58.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.391+0000 7f2f75f5c640 1 -- 172.21.15.7:0/944388516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f7015a1b0 con 0x7f2f58003b70 2024-04-25T09:56:58.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.391+0000 7f2f75f5c640 1 -- 172.21.15.7:0/944388516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f7015a770 con 0x7f2f58003b70 2024-04-25T09:56:58.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.392+0000 7f2f75f5c640 1 -- 172.21.15.7:0/944388516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f70068f60 con 0x7f2f58003b70 2024-04-25T09:56:58.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.392+0000 7f2f57fff640 1 -- 172.21.15.7:0/944388516 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2f60007410 con 0x7f2f58003b70 2024-04-25T09:56:58.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.393+0000 7f2f57fff640 1 --2- 172.21.15.7:0/944388516 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2f5c06b4d0 0x7f2f5c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:58.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.393+0000 7f2f57fff640 1 -- 172.21.15.7:0/944388516 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2f600aa670 con 0x7f2f58003b70 2024-04-25T09:56:58.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.393+0000 7f2f6effd640 1 --2- 172.21.15.7:0/944388516 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2f5c06b4d0 0x7f2f5c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:58.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.393+0000 7f2f6effd640 1 --2- 172.21.15.7:0/944388516 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2f5c06b4d0 0x7f2f5c06d990 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2f64007fd0 tx=0x7f2f64009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:58.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.397+0000 7f2f57fff640 1 -- 172.21.15.7:0/944388516 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2f60030380 con 0x7f2f58003b70 2024-04-25T09:56:58.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.578+0000 7f2f75f5c640 1 -- 172.21.15.7:0/944388516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2f7015e680 con 0x7f2f58003b70 2024-04-25T09:56:58.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.579+0000 7f2f57fff640 1 -- 172.21.15.7:0/944388516 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2f600793e0 con 0x7f2f58003b70 2024-04-25T09:56:58.582 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T09:56:58.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.580+0000 7f2f75f5c640 1 -- 172.21.15.7:0/944388516 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2f5c06b4d0 msgr2=0x7f2f5c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:58.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.580+0000 7f2f75f5c640 1 --2- 172.21.15.7:0/944388516 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2f5c06b4d0 0x7f2f5c06d990 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2f64007fd0 tx=0x7f2f64009040 comp rx=0 tx=0).stop 2024-04-25T09:56:58.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.580+0000 7f2f75f5c640 1 -- 172.21.15.7:0/944388516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f58003b70 msgr2=0x7f2f700c6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:58.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.580+0000 7f2f75f5c640 1 --2- 172.21.15.7:0/944388516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f58003b70 0x7f2f700c6400 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2f6000c1a0 tx=0x7f2f700ceee0 comp rx=0 tx=0).stop 2024-04-25T09:56:58.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.580+0000 7f2f75f5c640 1 -- 172.21.15.7:0/944388516 shutdown_connections 2024-04-25T09:56:58.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.580+0000 7f2f75f5c640 1 --2- 172.21.15.7:0/944388516 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2f5c06b4d0 0x7f2f5c06d990 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:58.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.580+0000 7f2f75f5c640 1 --2- 172.21.15.7:0/944388516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f701599c0 0x7f2f701499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:58.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.580+0000 7f2f75f5c640 1 --2- 172.21.15.7:0/944388516 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f7015af70 0x7f2f70159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:58.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.580+0000 7f2f75f5c640 1 --2- 172.21.15.7:0/944388516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f58003b70 0x7f2f700c6400 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:58.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.580+0000 7f2f75f5c640 1 -- 172.21.15.7:0/944388516 >> 172.21.15.7:0/944388516 conn(0x7f2f70072680 msgr2=0x7f2f700b8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:58.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.581+0000 7f2f75f5c640 1 -- 172.21.15.7:0/944388516 shutdown_connections 2024-04-25T09:56:58.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.581+0000 7f2f75f5c640 1 -- 172.21.15.7:0/944388516 wait complete. 2024-04-25T09:56:58.595 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:56:58.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.696+0000 7fbea211b640 1 Processor -- start 2024-04-25T09:56:58.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.696+0000 7fbea211b640 1 -- start start 2024-04-25T09:56:58.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.697+0000 7fbea211b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbe9c0cefb0 0x7fbe9c0d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:58.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.697+0000 7fbea211b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbe9c0d21b0 0x7fbe9c0b7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:58.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.697+0000 7fbea211b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe9c0d29c0 con 0x7fbe9c15db70 2024-04-25T09:56:58.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.697+0000 7fbea211b640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe9c0b6ce0 con 0x7fbe9c0cefb0 2024-04-25T09:56:58.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.697+0000 7fbea211b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe9c0d2f80 con 0x7fbe9c0d21b0 2024-04-25T09:56:58.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.697+0000 7fbe9affd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbe9c0cefb0 0x7fbe9c0d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:58.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.697+0000 7fbe9affd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbe9c0cefb0 0x7fbe9c0d1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55144/0 (socket says 172.21.15.7:55144) 2024-04-25T09:56:58.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.697+0000 7fbe9affd640 1 -- 172.21.15.7:0/3315767300 learned_addr learned my addr 172.21.15.7:0/3315767300 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:58.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.698+0000 7fbe9bfff640 1 --2- 172.21.15.7:0/3315767300 >> v2:172.21.15.55:3300/0 conn(0x7fbe9c0d21b0 0x7fbe9c0b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:58.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.698+0000 7fbe9affd640 1 -- 172.21.15.7:0/3315767300 >> v2:172.21.15.55:3300/0 conn(0x7fbe9c0d21b0 msgr2=0x7fbe9c0b7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:58.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.698+0000 7fbe9affd640 1 --2- 172.21.15.7:0/3315767300 >> v2:172.21.15.55:3300/0 conn(0x7fbe9c0d21b0 0x7fbe9c0b7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:58.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.698+0000 7fbe9affd640 1 -- 172.21.15.7:0/3315767300 >> v1:172.21.15.55:6789/0 conn(0x7fbe9c15db70 legacy=0x7fbe9c0ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:58.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.698+0000 7fbe9affd640 1 -- 172.21.15.7:0/3315767300 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9c0d2ca0 con 0x7fbe9c0cefb0 2024-04-25T09:56:58.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.698+0000 7fbe9affd640 1 --2- 172.21.15.7:0/3315767300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe9c0cefb0 0x7fbe9c0d1c70 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0b71f0 tx=0x7fbe9002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d40146b3ef9493b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:58.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.699+0000 7fbe9a7fc640 1 -- 172.21.15.7:0/3315767300 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe90037070 con 0x7fbe9c0cefb0 2024-04-25T09:56:58.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.699+0000 7fbe9a7fc640 1 -- 172.21.15.7:0/3315767300 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe90032440 con 0x7fbe9c0cefb0 2024-04-25T09:56:58.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.699+0000 7fbe9a7fc640 1 -- 172.21.15.7:0/3315767300 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe90032810 con 0x7fbe9c0cefb0 2024-04-25T09:56:58.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.699+0000 7fbea211b640 1 -- 172.21.15.7:0/3315767300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe9c0cefb0 msgr2=0x7fbe9c0d1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:58.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.699+0000 7fbea211b640 1 --2- 172.21.15.7:0/3315767300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe9c0cefb0 0x7fbe9c0d1c70 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0b71f0 tx=0x7fbe9002a230 comp rx=0 tx=0).stop 2024-04-25T09:56:58.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.699+0000 7fbea211b640 1 -- 172.21.15.7:0/3315767300 shutdown_connections 2024-04-25T09:56:58.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.699+0000 7fbea211b640 1 --2- 172.21.15.7:0/3315767300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe9c0cefb0 0x7fbe9c0d1c70 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:58.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.699+0000 7fbea211b640 1 --2- 172.21.15.7:0/3315767300 >> v2:172.21.15.55:3300/0 conn(0x7fbe9c0d21b0 0x7fbe9c0b7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:58.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.699+0000 7fbea211b640 1 -- 172.21.15.7:0/3315767300 >> 172.21.15.7:0/3315767300 conn(0x7fbe9c0b5370 msgr2=0x7fbe9c0b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:58.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.699+0000 7fbea211b640 1 -- 172.21.15.7:0/3315767300 shutdown_connections 2024-04-25T09:56:58.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.699+0000 7fbea211b640 1 -- 172.21.15.7:0/3315767300 wait complete. 2024-04-25T09:56:58.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.700+0000 7fbea211b640 1 Processor -- start 2024-04-25T09:56:58.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.701+0000 7fbea211b640 1 -- start start 2024-04-25T09:56:58.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.701+0000 7fbea211b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe9c0cefb0 0x7fbe9c160d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:58.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.701+0000 7fbea211b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe9c0d21b0 0x7fbe9c14b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:58.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.701+0000 7fbea211b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe9c15db70 0x7fbe9c14be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.701+0000 7fbea211b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c0d2600 con 0x7fbe9c15db70 2024-04-25T09:56:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.701+0000 7fbea211b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c0b7280 con 0x7fbe9c0d21b0 2024-04-25T09:56:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.701+0000 7fbea211b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c0d2780 con 0x7fbe9c0cefb0 2024-04-25T09:56:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.701+0000 7fbe9bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe9c15db70 0x7fbe9c14be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.701+0000 7fbe9bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe9c15db70 0x7fbe9c14be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55160/0 (socket says 172.21.15.7:55160) 2024-04-25T09:56:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.701+0000 7fbe9bfff640 1 -- 172.21.15.7:0/2089483411 learned_addr learned my addr 172.21.15.7:0/2089483411 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.701+0000 7fbe9b7fe640 1 --2- 172.21.15.7:0/2089483411 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe9c0cefb0 0x7fbe9c160d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.702+0000 7fbe9affd640 1 --2- 172.21.15.7:0/2089483411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe9c0d21b0 0x7fbe9c14b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.702+0000 7fbe9bfff640 1 -- 172.21.15.7:0/2089483411 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe9c0cefb0 msgr2=0x7fbe9c160d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.702+0000 7fbe9bfff640 1 --2- 172.21.15.7:0/2089483411 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe9c0cefb0 0x7fbe9c160d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.702+0000 7fbe9bfff640 1 -- 172.21.15.7:0/2089483411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe9c0d21b0 msgr2=0x7fbe9c14b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.702+0000 7fbe9bfff640 1 --2- 172.21.15.7:0/2089483411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe9c0d21b0 0x7fbe9c14b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.702+0000 7fbe9bfff640 1 -- 172.21.15.7:0/2089483411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9c0c9dc0 con 0x7fbe9c15db70 2024-04-25T09:56:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.702+0000 7fbe9affd640 1 --2- 172.21.15.7:0/2089483411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe9c0d21b0 0x7fbe9c14b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.702+0000 7fbe9bfff640 1 --2- 172.21.15.7:0/2089483411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe9c15db70 0x7fbe9c14be20 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fbe94007e40 tx=0x7fbe9400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.702+0000 7fbe83fff640 1 -- 172.21.15.7:0/2089483411 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe94014620 con 0x7fbe9c15db70 2024-04-25T09:56:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.702+0000 7fbe83fff640 1 -- 172.21.15.7:0/2089483411 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe94019070 con 0x7fbe9c15db70 2024-04-25T09:56:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.702+0000 7fbea211b640 1 -- 172.21.15.7:0/2089483411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe9c15e4c0 con 0x7fbe9c15db70 2024-04-25T09:56:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.702+0000 7fbe83fff640 1 -- 172.21.15.7:0/2089483411 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe94014a20 con 0x7fbe9c15db70 2024-04-25T09:56:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.702+0000 7fbea211b640 1 -- 172.21.15.7:0/2089483411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe9c0c8d40 con 0x7fbe9c15db70 2024-04-25T09:56:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.703+0000 7fbea211b640 1 -- 172.21.15.7:0/2089483411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe9c068f60 con 0x7fbe9c15db70 2024-04-25T09:56:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.704+0000 7fbe83fff640 1 -- 172.21.15.7:0/2089483411 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbe94014bc0 con 0x7fbe9c15db70 2024-04-25T09:56:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.704+0000 7fbe83fff640 1 --2- 172.21.15.7:0/2089483411 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbe8806b4d0 0x7fbe8806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.704+0000 7fbe83fff640 1 -- 172.21.15.7:0/2089483411 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbe9408acb0 con 0x7fbe9c15db70 2024-04-25T09:56:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.704+0000 7fbe9b7fe640 1 --2- 172.21.15.7:0/2089483411 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbe8806b4d0 0x7fbe8806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.705+0000 7fbe9b7fe640 1 --2- 172.21.15.7:0/2089483411 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbe8806b4d0 0x7fbe8806d990 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c006fd0 tx=0x7fbe8c009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:58.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.708+0000 7fbe83fff640 1 -- 172.21.15.7:0/2089483411 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbe94059910 con 0x7fbe9c15db70 2024-04-25T09:56:58.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.888+0000 7fbea211b640 1 -- 172.21.15.7:0/2089483411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbe9c0d0ea0 con 0x7fbe9c15db70 2024-04-25T09:56:58.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.888+0000 7fbe83fff640 1 -- 172.21.15.7:0/2089483411 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbe94059210 con 0x7fbe9c15db70 2024-04-25T09:56:58.892 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:56:58.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.890+0000 7fbea211b640 1 -- 172.21.15.7:0/2089483411 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbe8806b4d0 msgr2=0x7fbe8806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:58.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.890+0000 7fbea211b640 1 --2- 172.21.15.7:0/2089483411 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbe8806b4d0 0x7fbe8806d990 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c006fd0 tx=0x7fbe8c009060 comp rx=0 tx=0).stop 2024-04-25T09:56:58.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.890+0000 7fbea211b640 1 -- 172.21.15.7:0/2089483411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe9c15db70 msgr2=0x7fbe9c14be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:58.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.890+0000 7fbea211b640 1 --2- 172.21.15.7:0/2089483411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe9c15db70 0x7fbe9c14be20 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fbe94007e40 tx=0x7fbe9400e4b0 comp rx=0 tx=0).stop 2024-04-25T09:56:58.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.890+0000 7fbea211b640 1 -- 172.21.15.7:0/2089483411 shutdown_connections 2024-04-25T09:56:58.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.890+0000 7fbea211b640 1 --2- 172.21.15.7:0/2089483411 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbe8806b4d0 0x7fbe8806d990 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:58.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.890+0000 7fbea211b640 1 --2- 172.21.15.7:0/2089483411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe9c15db70 0x7fbe9c14be20 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:58.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.890+0000 7fbea211b640 1 --2- 172.21.15.7:0/2089483411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe9c0d21b0 0x7fbe9c14b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:58.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.890+0000 7fbea211b640 1 --2- 172.21.15.7:0/2089483411 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe9c0cefb0 0x7fbe9c160d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:58.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.890+0000 7fbea211b640 1 -- 172.21.15.7:0/2089483411 >> 172.21.15.7:0/2089483411 conn(0x7fbe9c0b5370 msgr2=0x7fbe9c0b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:58.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.890+0000 7fbea211b640 1 -- 172.21.15.7:0/2089483411 shutdown_connections 2024-04-25T09:56:58.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:58.890+0000 7fbea211b640 1 -- 172.21.15.7:0/2089483411 wait complete. 2024-04-25T09:56:58.904 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:56:59.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.004+0000 7fd79365d640 1 Processor -- start 2024-04-25T09:56:59.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.004+0000 7fd79365d640 1 -- start start 2024-04-25T09:56:59.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.005+0000 7fd79365d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd78c0d0780 0x7fd78c0d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:59.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.005+0000 7fd79365d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd78c0b9130 0x7fd78c0d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:59.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.005+0000 7fd79365d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd78c0d10a0 con 0x7fd78c0b9590 2024-04-25T09:56:59.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.005+0000 7fd79365d640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd78c0b7ef0 con 0x7fd78c0d0780 2024-04-25T09:56:59.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.005+0000 7fd79365d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c0b81d0 con 0x7fd78c0b9130 2024-04-25T09:56:59.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.005+0000 7fd7913f9640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd78c0d0780 0x7fd78c0d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:59.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.005+0000 7fd7913f9640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd78c0d0780 0x7fd78c0d0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55166/0 (socket says 172.21.15.7:55166) 2024-04-25T09:56:59.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.005+0000 7fd7913f9640 1 -- 172.21.15.7:0/1668835598 learned_addr learned my addr 172.21.15.7:0/1668835598 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:59.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.005+0000 7fd790bf8640 1 --2- 172.21.15.7:0/1668835598 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd78c0b9130 0x7fd78c0d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:59.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.005+0000 7fd7913f9640 1 -- 172.21.15.7:0/1668835598 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd78c0b9130 msgr2=0x7fd78c0d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:59.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.005+0000 7fd7913f9640 1 --2- 172.21.15.7:0/1668835598 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd78c0b9130 0x7fd78c0d1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:59.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.005+0000 7fd7913f9640 1 -- 172.21.15.7:0/1668835598 >> v1:172.21.15.55:6789/0 conn(0x7fd78c0b9590 legacy=0x7fd78c0d2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:59.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.005+0000 7fd7913f9640 1 -- 172.21.15.7:0/1668835598 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78c0b84b0 con 0x7fd78c0d0780 2024-04-25T09:56:59.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.006+0000 7fd7913f9640 1 --2- 172.21.15.7:0/1668835598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd78c0d0780 0x7fd78c0d0b60 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd788009870 tx=0x7fd78802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c458867a0e6aa728 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:59.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.006+0000 7fd783fff640 1 -- 172.21.15.7:0/1668835598 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd788037070 con 0x7fd78c0d0780 2024-04-25T09:56:59.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.006+0000 7fd783fff640 1 -- 172.21.15.7:0/1668835598 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd788032440 con 0x7fd78c0d0780 2024-04-25T09:56:59.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.006+0000 7fd783fff640 1 -- 172.21.15.7:0/1668835598 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd788032810 con 0x7fd78c0d0780 2024-04-25T09:56:59.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.007+0000 7fd79365d640 1 -- 172.21.15.7:0/1668835598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd78c0d0780 msgr2=0x7fd78c0d0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:59.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.007+0000 7fd79365d640 1 --2- 172.21.15.7:0/1668835598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd78c0d0780 0x7fd78c0d0b60 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd788009870 tx=0x7fd78802a270 comp rx=0 tx=0).stop 2024-04-25T09:56:59.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.007+0000 7fd79365d640 1 -- 172.21.15.7:0/1668835598 shutdown_connections 2024-04-25T09:56:59.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.007+0000 7fd79365d640 1 --2- 172.21.15.7:0/1668835598 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd78c0b9130 0x7fd78c0d1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:59.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.007+0000 7fd79365d640 1 --2- 172.21.15.7:0/1668835598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd78c0d0780 0x7fd78c0d0b60 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:59.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.007+0000 7fd79365d640 1 -- 172.21.15.7:0/1668835598 >> 172.21.15.7:0/1668835598 conn(0x7fd78c0726b0 msgr2=0x7fd78c072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:59.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.007+0000 7fd79365d640 1 -- 172.21.15.7:0/1668835598 shutdown_connections 2024-04-25T09:56:59.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.007+0000 7fd79365d640 1 -- 172.21.15.7:0/1668835598 wait complete. 2024-04-25T09:56:59.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.008+0000 7fd79365d640 1 Processor -- start 2024-04-25T09:56:59.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.008+0000 7fd79365d640 1 -- start start 2024-04-25T09:56:59.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.009+0000 7fd79365d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd78c0b9130 0x7fd78c0ce070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:59.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.009+0000 7fd79365d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd78c0b9590 0x7fd78c0c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:59.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.009+0000 7fd79365d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd78c0d0780 0x7fd78c0c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:59.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.009+0000 7fd79365d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c1611b0 con 0x7fd78c0d0780 2024-04-25T09:56:59.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.009+0000 7fd79365d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c0b8a70 con 0x7fd78c0b9590 2024-04-25T09:56:59.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.009+0000 7fd79365d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c161330 con 0x7fd78c0b9130 2024-04-25T09:56:59.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.009+0000 7fd791bfa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd78c0d0780 0x7fd78c0c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:59.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.009+0000 7fd791bfa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd78c0d0780 0x7fd78c0c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55172/0 (socket says 172.21.15.7:55172) 2024-04-25T09:56:59.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.009+0000 7fd791bfa640 1 -- 172.21.15.7:0/298191943 learned_addr learned my addr 172.21.15.7:0/298191943 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:59.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.009+0000 7fd7913f9640 1 --2- 172.21.15.7:0/298191943 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd78c0b9130 0x7fd78c0ce070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:59.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.009+0000 7fd790bf8640 1 --2- 172.21.15.7:0/298191943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd78c0b9590 0x7fd78c0c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:59.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.009+0000 7fd791bfa640 1 -- 172.21.15.7:0/298191943 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd78c0b9130 msgr2=0x7fd78c0ce070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:59.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.009+0000 7fd791bfa640 1 --2- 172.21.15.7:0/298191943 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd78c0b9130 0x7fd78c0ce070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:59.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.009+0000 7fd791bfa640 1 -- 172.21.15.7:0/298191943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd78c0b9590 msgr2=0x7fd78c0c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:59.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.009+0000 7fd791bfa640 1 --2- 172.21.15.7:0/298191943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd78c0b9590 0x7fd78c0c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:59.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.009+0000 7fd791bfa640 1 -- 172.21.15.7:0/298191943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78c0cb7c0 con 0x7fd78c0d0780 2024-04-25T09:56:59.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.009+0000 7fd790bf8640 1 --2- 172.21.15.7:0/298191943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd78c0b9590 0x7fd78c0c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:59.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.010+0000 7fd791bfa640 1 --2- 172.21.15.7:0/298191943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd78c0d0780 0x7fd78c0c8790 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fd78400c730 tx=0x7fd78400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:59.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.010+0000 7fd781ffb640 1 -- 172.21.15.7:0/298191943 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd784003b70 con 0x7fd78c0d0780 2024-04-25T09:56:59.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.010+0000 7fd781ffb640 1 -- 172.21.15.7:0/298191943 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd784003d10 con 0x7fd78c0d0780 2024-04-25T09:56:59.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.010+0000 7fd79365d640 1 -- 172.21.15.7:0/298191943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd78c1f3fd0 con 0x7fd78c0d0780 2024-04-25T09:56:59.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.010+0000 7fd781ffb640 1 -- 172.21.15.7:0/298191943 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78400aa90 con 0x7fd78c0d0780 2024-04-25T09:56:59.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.010+0000 7fd79365d640 1 -- 172.21.15.7:0/298191943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd78c0cad00 con 0x7fd78c0d0780 2024-04-25T09:56:59.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.011+0000 7fd79365d640 1 -- 172.21.15.7:0/298191943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd78c0685d0 con 0x7fd78c0d0780 2024-04-25T09:56:59.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.011+0000 7fd781ffb640 1 -- 172.21.15.7:0/298191943 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd78400ac30 con 0x7fd78c0d0780 2024-04-25T09:56:59.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.012+0000 7fd781ffb640 1 --2- 172.21.15.7:0/298191943 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd77006b4d0 0x7fd77006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:59.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.012+0000 7fd781ffb640 1 -- 172.21.15.7:0/298191943 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd78408a150 con 0x7fd78c0d0780 2024-04-25T09:56:59.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.012+0000 7fd7913f9640 1 --2- 172.21.15.7:0/298191943 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd77006b4d0 0x7fd77006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:59.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.012+0000 7fd7913f9640 1 --2- 172.21.15.7:0/298191943 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd77006b4d0 0x7fd77006d990 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd788034000 tx=0x7fd78802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:59.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.016+0000 7fd781ffb640 1 -- 172.21.15.7:0/298191943 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd784058ed0 con 0x7fd78c0d0780 2024-04-25T09:56:59.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.194+0000 7fd79365d640 1 -- 172.21.15.7:0/298191943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd78c068f60 con 0x7fd78c0d0780 2024-04-25T09:56:59.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.195+0000 7fd781ffb640 1 -- 172.21.15.7:0/298191943 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd7840587d0 con 0x7fd78c0d0780 2024-04-25T09:56:59.198 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T09:56:59.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.196+0000 7fd79365d640 1 -- 172.21.15.7:0/298191943 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd77006b4d0 msgr2=0x7fd77006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:59.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.196+0000 7fd79365d640 1 --2- 172.21.15.7:0/298191943 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd77006b4d0 0x7fd77006d990 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd788034000 tx=0x7fd78802e000 comp rx=0 tx=0).stop 2024-04-25T09:56:59.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.196+0000 7fd79365d640 1 -- 172.21.15.7:0/298191943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd78c0d0780 msgr2=0x7fd78c0c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:59.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.196+0000 7fd79365d640 1 --2- 172.21.15.7:0/298191943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd78c0d0780 0x7fd78c0c8790 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fd78400c730 tx=0x7fd78400cbf0 comp rx=0 tx=0).stop 2024-04-25T09:56:59.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.197+0000 7fd79365d640 1 -- 172.21.15.7:0/298191943 shutdown_connections 2024-04-25T09:56:59.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.197+0000 7fd79365d640 1 --2- 172.21.15.7:0/298191943 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd77006b4d0 0x7fd77006d990 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:59.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.197+0000 7fd79365d640 1 --2- 172.21.15.7:0/298191943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd78c0d0780 0x7fd78c0c8790 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:59.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.197+0000 7fd79365d640 1 --2- 172.21.15.7:0/298191943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd78c0b9590 0x7fd78c0c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:59.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.197+0000 7fd79365d640 1 --2- 172.21.15.7:0/298191943 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd78c0b9130 0x7fd78c0ce070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:59.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.197+0000 7fd79365d640 1 -- 172.21.15.7:0/298191943 >> 172.21.15.7:0/298191943 conn(0x7fd78c0726b0 msgr2=0x7fd78c15e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:59.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.197+0000 7fd79365d640 1 -- 172.21.15.7:0/298191943 shutdown_connections 2024-04-25T09:56:59.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.197+0000 7fd79365d640 1 -- 172.21.15.7:0/298191943 wait complete. 2024-04-25T09:56:59.211 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:56:59.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.309+0000 7f3399abd640 1 Processor -- start 2024-04-25T09:56:59.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.309+0000 7f3399abd640 1 -- start start 2024-04-25T09:56:59.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.310+0000 7f3399abd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3394145260 0x7f33940726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:59.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.310+0000 7f3399abd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f339415c8f0 0x7f339406ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:59.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.310+0000 7f3399abd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f339406b0a0 0x7f33940d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:59.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.310+0000 7f3399abd640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3394160110 con 0x7f339406b0a0 2024-04-25T09:56:59.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.310+0000 7f3399abd640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f339415cd50 con 0x7f339415c8f0 2024-04-25T09:56:59.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.310+0000 7f3399abd640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339415f500 con 0x7f3394145260 2024-04-25T09:56:59.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.310+0000 7f3393fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f339406b0a0 0x7f33940d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:59.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.311+0000 7f3393fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f339406b0a0 0x7f33940d0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55186/0 (socket says 172.21.15.7:55186) 2024-04-25T09:56:59.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.311+0000 7f3393fff640 1 -- 172.21.15.7:0/3184604058 learned_addr learned my addr 172.21.15.7:0/3184604058 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:59.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.311+0000 7f33937fe640 1 --2- 172.21.15.7:0/3184604058 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3394145260 0x7f33940726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:59.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.311+0000 7f3392ffd640 1 --2- 172.21.15.7:0/3184604058 >> v2:172.21.15.55:3300/0 conn(0x7f339415c8f0 0x7f339406ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:59.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.311+0000 7f3393fff640 1 -- 172.21.15.7:0/3184604058 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3394145260 msgr2=0x7f33940726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:59.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.311+0000 7f3393fff640 1 --2- 172.21.15.7:0/3184604058 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3394145260 0x7f33940726e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:59.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.311+0000 7f3393fff640 1 -- 172.21.15.7:0/3184604058 >> v2:172.21.15.55:3300/0 conn(0x7f339415c8f0 msgr2=0x7f339406ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:59.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.311+0000 7f3393fff640 1 --2- 172.21.15.7:0/3184604058 >> v2:172.21.15.55:3300/0 conn(0x7f339415c8f0 0x7f339406ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:59.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.311+0000 7f3393fff640 1 -- 172.21.15.7:0/3184604058 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339415f7e0 con 0x7f339406b0a0 2024-04-25T09:56:59.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.311+0000 7f33937fe640 1 --2- 172.21.15.7:0/3184604058 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3394145260 0x7f33940726e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:56:59.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.312+0000 7f3393fff640 1 --2- 172.21.15.7:0/3184604058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f339406b0a0 0x7f33940d0570 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f339406e150 tx=0x7f338c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3dcf0508d0cb83 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:59.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.312+0000 7f33927fc640 1 -- 172.21.15.7:0/3184604058 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c036070 con 0x7f339406b0a0 2024-04-25T09:56:59.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.312+0000 7f33927fc640 1 -- 172.21.15.7:0/3184604058 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338c031600 con 0x7f339406b0a0 2024-04-25T09:56:59.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.312+0000 7f33927fc640 1 -- 172.21.15.7:0/3184604058 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c0319d0 con 0x7f339406b0a0 2024-04-25T09:56:59.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.312+0000 7f3399abd640 1 -- 172.21.15.7:0/3184604058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f339406b0a0 msgr2=0x7f33940d0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:59.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.312+0000 7f3399abd640 1 --2- 172.21.15.7:0/3184604058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f339406b0a0 0x7f33940d0570 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f339406e150 tx=0x7f338c02a6a0 comp rx=0 tx=0).stop 2024-04-25T09:56:59.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.312+0000 7f3399abd640 1 -- 172.21.15.7:0/3184604058 shutdown_connections 2024-04-25T09:56:59.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.312+0000 7f3399abd640 1 --2- 172.21.15.7:0/3184604058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f339406b0a0 0x7f33940d0570 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:59.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.312+0000 7f3399abd640 1 --2- 172.21.15.7:0/3184604058 >> v2:172.21.15.55:3300/0 conn(0x7f339415c8f0 0x7f339406ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:59.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.312+0000 7f3399abd640 1 --2- 172.21.15.7:0/3184604058 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3394145260 0x7f33940726e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:59.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.312+0000 7f3399abd640 1 -- 172.21.15.7:0/3184604058 >> 172.21.15.7:0/3184604058 conn(0x7f33940b5c30 msgr2=0x7f33940999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:59.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.312+0000 7f3399abd640 1 -- 172.21.15.7:0/3184604058 shutdown_connections 2024-04-25T09:56:59.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.312+0000 7f3399abd640 1 -- 172.21.15.7:0/3184604058 wait complete. 2024-04-25T09:56:59.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.313+0000 7f3399abd640 1 Processor -- start 2024-04-25T09:56:59.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.314+0000 7f3399abd640 1 -- start start 2024-04-25T09:56:59.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.314+0000 7f3399abd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f339406b0a0 0x7f339413dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:59.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.314+0000 7f3399abd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3394145260 0x7f339413f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:59.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.314+0000 7f3399abd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f339415c8f0 0x7f339413ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:59.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.314+0000 7f3399abd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33940d0ab0 con 0x7f3394145260 2024-04-25T09:56:59.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.314+0000 7f3399abd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339415fda0 con 0x7f339406b0a0 2024-04-25T09:56:59.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.314+0000 7f3399abd640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33940d0c30 con 0x7f339415c8f0 2024-04-25T09:56:59.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.315+0000 7f3392ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3394145260 0x7f339413f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:59.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.315+0000 7f3392ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3394145260 0x7f339413f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55188/0 (socket says 172.21.15.7:55188) 2024-04-25T09:56:59.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.315+0000 7f3392ffd640 1 -- 172.21.15.7:0/89945886 learned_addr learned my addr 172.21.15.7:0/89945886 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:59.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.315+0000 7f3393fff640 1 --2- 172.21.15.7:0/89945886 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f339415c8f0 0x7f339413ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:59.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.315+0000 7f3392ffd640 1 -- 172.21.15.7:0/89945886 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f339415c8f0 msgr2=0x7f339413ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:59.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.315+0000 7f33937fe640 1 --2- 172.21.15.7:0/89945886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f339406b0a0 0x7f339413dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:59.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.315+0000 7f3392ffd640 1 --2- 172.21.15.7:0/89945886 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f339415c8f0 0x7f339413ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:59.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.315+0000 7f3392ffd640 1 -- 172.21.15.7:0/89945886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f339406b0a0 msgr2=0x7f339413dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:59.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.315+0000 7f3392ffd640 1 --2- 172.21.15.7:0/89945886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f339406b0a0 0x7f339413dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:59.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.315+0000 7f3392ffd640 1 -- 172.21.15.7:0/89945886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339413e520 con 0x7f3394145260 2024-04-25T09:56:59.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.315+0000 7f3393fff640 1 --2- 172.21.15.7:0/89945886 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f339415c8f0 0x7f339413ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:56:59.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.315+0000 7f33937fe640 1 --2- 172.21.15.7:0/89945886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f339406b0a0 0x7f339413dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:56:59.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.315+0000 7f3392ffd640 1 --2- 172.21.15.7:0/89945886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3394145260 0x7f339413f9d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f338800d5f0 tx=0x7f338800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:59.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.315+0000 7f337bfff640 1 -- 172.21.15.7:0/89945886 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33880125f0 con 0x7f3394145260 2024-04-25T09:56:59.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.315+0000 7f337bfff640 1 -- 172.21.15.7:0/89945886 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3388019070 con 0x7f3394145260 2024-04-25T09:56:59.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.315+0000 7f337bfff640 1 -- 172.21.15.7:0/89945886 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33880129d0 con 0x7f3394145260 2024-04-25T09:56:59.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.315+0000 7f3399abd640 1 -- 172.21.15.7:0/89945886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33940afd50 con 0x7f3394145260 2024-04-25T09:56:59.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.315+0000 7f3399abd640 1 -- 172.21.15.7:0/89945886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33940b0310 con 0x7f3394145260 2024-04-25T09:56:59.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.316+0000 7f3399abd640 1 -- 172.21.15.7:0/89945886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3394067ba0 con 0x7f3394145260 2024-04-25T09:56:59.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.317+0000 7f337bfff640 1 -- 172.21.15.7:0/89945886 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3388012b70 con 0x7f3394145260 2024-04-25T09:56:59.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.317+0000 7f337bfff640 1 --2- 172.21.15.7:0/89945886 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f338006b4d0 0x7f338006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:59.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.317+0000 7f337bfff640 1 -- 172.21.15.7:0/89945886 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f338808a6f0 con 0x7f3394145260 2024-04-25T09:56:59.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.317+0000 7f33937fe640 1 --2- 172.21.15.7:0/89945886 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f338006b4d0 0x7f338006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:59.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.318+0000 7f33937fe640 1 --2- 172.21.15.7:0/89945886 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f338006b4d0 0x7f338006d990 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3384006fd0 tx=0x7f3384008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:59.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.321+0000 7f337bfff640 1 -- 172.21.15.7:0/89945886 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3394067ba0 con 0x7f3394145260 2024-04-25T09:56:59.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.513+0000 7f3399abd640 1 -- 172.21.15.7:0/89945886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3394070a20 con 0x7f3394145260 2024-04-25T09:56:59.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.513+0000 7f337bfff640 1 -- 172.21.15.7:0/89945886 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v51) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3388059470 con 0x7f3394145260 2024-04-25T09:56:59.517 INFO:teuthology.orchestra.run.smithi007.stderr:listed 0 entries 2024-04-25T09:56:59.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.515+0000 7f3399abd640 1 -- 172.21.15.7:0/89945886 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f338006b4d0 msgr2=0x7f338006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:59.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.515+0000 7f3399abd640 1 --2- 172.21.15.7:0/89945886 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f338006b4d0 0x7f338006d990 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3384006fd0 tx=0x7f3384008040 comp rx=0 tx=0).stop 2024-04-25T09:56:59.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.515+0000 7f3399abd640 1 -- 172.21.15.7:0/89945886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3394145260 msgr2=0x7f339413f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:59.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.515+0000 7f3399abd640 1 --2- 172.21.15.7:0/89945886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3394145260 0x7f339413f9d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f338800d5f0 tx=0x7f338800dab0 comp rx=0 tx=0).stop 2024-04-25T09:56:59.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.515+0000 7f3399abd640 1 -- 172.21.15.7:0/89945886 shutdown_connections 2024-04-25T09:56:59.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.515+0000 7f3399abd640 1 --2- 172.21.15.7:0/89945886 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f338006b4d0 0x7f338006d990 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:59.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.515+0000 7f3399abd640 1 --2- 172.21.15.7:0/89945886 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f339415c8f0 0x7f339413ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:59.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.515+0000 7f3399abd640 1 --2- 172.21.15.7:0/89945886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3394145260 0x7f339413f9d0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:59.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.515+0000 7f3399abd640 1 --2- 172.21.15.7:0/89945886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f339406b0a0 0x7f339413dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:59.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.515+0000 7f3399abd640 1 -- 172.21.15.7:0/89945886 >> 172.21.15.7:0/89945886 conn(0x7f33940b5c30 msgr2=0x7f339415d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:59.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.516+0000 7f3399abd640 1 -- 172.21.15.7:0/89945886 shutdown_connections 2024-04-25T09:56:59.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.516+0000 7f3399abd640 1 -- 172.21.15.7:0/89945886 wait complete. 2024-04-25T09:56:59.530 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:56:59.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:56:59.530 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:56:59.570 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-04-25T09:56:59.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:56:59.571 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:56:59.627 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:56:59.627 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:56:59.645 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19023 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:56:59.646 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:56:59.646 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:56:59.683 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13704 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:56:59.683 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:56:59.683 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:56:59.702 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19023 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:56:59.703 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:56:59.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.821+0000 7f72358ac640 1 Processor -- start 2024-04-25T09:56:59.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.821+0000 7f72358ac640 1 -- start start 2024-04-25T09:56:59.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.821+0000 7f72358ac640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f723015eba0 0x7f723006fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:59.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.821+0000 7f72358ac640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72301618f0 con 0x7f723015d7b0 2024-04-25T09:56:59.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.821+0000 7f72358ac640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7230161bd0 con 0x7f723006ab60 2024-04-25T09:56:59.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.821+0000 7f72358ac640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7230161eb0 con 0x7f723015eba0 2024-04-25T09:56:59.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.822+0000 7f722effd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f723015d7b0 0x7f72300b53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56522/0 (socket says 172.21.15.7:56522) 2024-04-25T09:56:59.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.822+0000 7f722effd640 1 -- 172.21.15.7:0/226163291 learned_addr learned my addr 172.21.15.7:0/226163291 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:56:59.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.822+0000 7f7227fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f723015eba0 0x7f723006fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:59.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.822+0000 7f7227fff640 1 -- 172.21.15.7:0/226163291 >> v1:172.21.15.55:6789/0 conn(0x7f723006ab60 legacy=0x7f723006af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:56:59.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.822+0000 7f722e7fc640 1 -- 172.21.15.7:0/226163291 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2631292302 0 0) 0x7f72301618f0 con 0x7f723015d7b0 2024-04-25T09:56:59.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.822+0000 7f7227fff640 1 -- 172.21.15.7:0/226163291 >> v1:172.21.15.7:6789/0 conn(0x7f723015d7b0 legacy=0x7f72300b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:59.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.822+0000 7f7227fff640 1 -- 172.21.15.7:0/226163291 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7230162190 con 0x7f723015eba0 2024-04-25T09:56:59.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.823+0000 7f7227fff640 1 --2- 172.21.15.7:0/226163291 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f723015eba0 0x7f723006fa00 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f72180097d0 tx=0x7f721802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e07284db7c936a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:59.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.823+0000 7f722e7fc640 1 -- 172.21.15.7:0/226163291 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7218037070 con 0x7f723015eba0 2024-04-25T09:56:59.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.823+0000 7f722e7fc640 1 -- 172.21.15.7:0/226163291 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7218032440 con 0x7f723015eba0 2024-04-25T09:56:59.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.823+0000 7f722e7fc640 1 -- 172.21.15.7:0/226163291 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7218032810 con 0x7f723015eba0 2024-04-25T09:56:59.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.823+0000 7f72358ac640 1 -- 172.21.15.7:0/226163291 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f723015eba0 msgr2=0x7f723006fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:59.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.823+0000 7f72358ac640 1 --2- 172.21.15.7:0/226163291 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f723015eba0 0x7f723006fa00 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f72180097d0 tx=0x7f721802a1c0 comp rx=0 tx=0).stop 2024-04-25T09:56:59.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.823+0000 7f72358ac640 1 -- 172.21.15.7:0/226163291 shutdown_connections 2024-04-25T09:56:59.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.823+0000 7f72358ac640 1 --2- 172.21.15.7:0/226163291 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f723015eba0 0x7f723006fa00 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:59.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.823+0000 7f72358ac640 1 -- 172.21.15.7:0/226163291 >> 172.21.15.7:0/226163291 conn(0x7f72300b2390 msgr2=0x7f72300b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:56:59.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.823+0000 7f72358ac640 1 -- 172.21.15.7:0/226163291 shutdown_connections 2024-04-25T09:56:59.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.824+0000 7f72358ac640 1 -- 172.21.15.7:0/226163291 wait complete. 2024-04-25T09:56:59.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.825+0000 7f72358ac640 1 Processor -- start 2024-04-25T09:56:59.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.825+0000 7f72358ac640 1 -- start start 2024-04-25T09:56:59.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.825+0000 7f72358ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f723006ab60 0x7f72300c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:59.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.825+0000 7f72358ac640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f723015d7b0 0x7f7230147f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:59.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.825+0000 7f72358ac640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f723015eba0 0x7f72300ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:59.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.825+0000 7f72358ac640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7230161690 con 0x7f723015d7b0 2024-04-25T09:56:59.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.825+0000 7f72358ac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7230161510 con 0x7f723006ab60 2024-04-25T09:56:59.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.825+0000 7f72358ac640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72300b3a70 con 0x7f723015eba0 2024-04-25T09:56:59.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.825+0000 7f7227fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f723015d7b0 0x7f7230147f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:59.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.825+0000 7f7227fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f723015d7b0 0x7f7230147f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49884/0 (socket says 172.21.15.7:49884) 2024-04-25T09:56:59.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.825+0000 7f7227fff640 1 -- 172.21.15.7:0/3407449782 learned_addr learned my addr 172.21.15.7:0/3407449782 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:56:59.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.826+0000 7f722effd640 1 --2- 172.21.15.7:0/3407449782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f723006ab60 0x7f72300c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:59.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.826+0000 7f722f7fe640 1 --2- 172.21.15.7:0/3407449782 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f723015eba0 0x7f72300ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:59.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.826+0000 7f7227fff640 1 -- 172.21.15.7:0/3407449782 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f723015eba0 msgr2=0x7f72300ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:59.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.826+0000 7f7227fff640 1 --2- 172.21.15.7:0/3407449782 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f723015eba0 0x7f72300ca5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:59.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.826+0000 7f7227fff640 1 -- 172.21.15.7:0/3407449782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f723006ab60 msgr2=0x7f72300c9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:56:59.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.826+0000 7f7227fff640 1 --2- 172.21.15.7:0/3407449782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f723006ab60 0x7f72300c9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:56:59.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.826+0000 7f7227fff640 1 -- 172.21.15.7:0/3407449782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723015fc00 con 0x7f723015d7b0 2024-04-25T09:56:59.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.826+0000 7f7227fff640 1 --2- 172.21.15.7:0/3407449782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f723015d7b0 0x7f7230147f40 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f72180098f0 tx=0x7f72180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:59.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.826+0000 7f722cff9640 1 -- 172.21.15.7:0/3407449782 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7218037040 con 0x7f723015d7b0 2024-04-25T09:56:59.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.826+0000 7f722cff9640 1 -- 172.21.15.7:0/3407449782 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7218042070 con 0x7f723015d7b0 2024-04-25T09:56:59.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.826+0000 7f72358ac640 1 -- 172.21.15.7:0/3407449782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f723015fee0 con 0x7f723015d7b0 2024-04-25T09:56:59.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.826+0000 7f722cff9640 1 -- 172.21.15.7:0/3407449782 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7218030bf0 con 0x7f723015d7b0 2024-04-25T09:56:59.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.826+0000 7f72358ac640 1 -- 172.21.15.7:0/3407449782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72301604a0 con 0x7f723015d7b0 2024-04-25T09:56:59.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.827+0000 7f72358ac640 1 -- 172.21.15.7:0/3407449782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7230153900 con 0x7f723015d7b0 2024-04-25T09:56:59.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.827+0000 7f722cff9640 1 -- 172.21.15.7:0/3407449782 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7218047460 con 0x7f723015d7b0 2024-04-25T09:56:59.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.828+0000 7f722cff9640 1 --2- 172.21.15.7:0/3407449782 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f721006b4d0 0x7f721006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:56:59.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.828+0000 7f722cff9640 1 -- 172.21.15.7:0/3407449782 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f72180aaff0 con 0x7f723015d7b0 2024-04-25T09:56:59.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.828+0000 7f722effd640 1 --2- 172.21.15.7:0/3407449782 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f721006b4d0 0x7f721006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:56:59.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.828+0000 7f722effd640 1 --2- 172.21.15.7:0/3407449782 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f721006b4d0 0x7f721006d990 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7220000f60 tx=0x7f7220007b90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:56:59.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:56:59.832+0000 7f722cff9640 1 -- 172.21.15.7:0/3407449782 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7218032e20 con 0x7f723015d7b0 2024-04-25T09:57:00.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.050+0000 7f72358ac640 1 -- 172.21.15.7:0/3407449782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7230071780 con 0x7f723015d7b0 2024-04-25T09:57:00.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.050+0000 7f722cff9640 1 -- 172.21.15.7:0/3407449782 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4932 (secure 0 0 0) 0x7f7230071780 con 0x7f723015d7b0 2024-04-25T09:57:00.054 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:57:00.054 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5072,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1716545079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1716545079},{"type":"v1","addr":"172.21.15.7:6837","nonce":1716545079}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5434,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1851611776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1851611776},{"type":"v1","addr":"172.21.15.55:6834","nonce":1851611776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2607486300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2607486300},{"type":"v1","addr":"172.21.15.55:6835","nonce":2607486300}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:56:14.756973+0000","modified":"2024-04-25T09:56:16.763894+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5820":{"gid":5820,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6836/2232311564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2232311564},{"type":"v1","addr":"172.21.15.7:6836","nonce":2232311564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:57:00.054 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 21 2024-04-25T09:57:00.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.052+0000 7f72358ac640 1 -- 172.21.15.7:0/3407449782 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f721006b4d0 msgr2=0x7f721006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:00.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.052+0000 7f72358ac640 1 --2- 172.21.15.7:0/3407449782 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f721006b4d0 0x7f721006d990 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7220000f60 tx=0x7f7220007b90 comp rx=0 tx=0).stop 2024-04-25T09:57:00.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.052+0000 7f72358ac640 1 -- 172.21.15.7:0/3407449782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f723015d7b0 msgr2=0x7f7230147f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:00.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.052+0000 7f72358ac640 1 --2- 172.21.15.7:0/3407449782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f723015d7b0 0x7f7230147f40 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f72180098f0 tx=0x7f72180046c0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.052+0000 7f72358ac640 1 -- 172.21.15.7:0/3407449782 shutdown_connections 2024-04-25T09:57:00.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.052+0000 7f72358ac640 1 --2- 172.21.15.7:0/3407449782 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f721006b4d0 0x7f721006d990 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.052+0000 7f72358ac640 1 --2- 172.21.15.7:0/3407449782 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f723015eba0 0x7f72300ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.052+0000 7f72358ac640 1 --2- 172.21.15.7:0/3407449782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f723015d7b0 0x7f7230147f40 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.052+0000 7f72358ac640 1 --2- 172.21.15.7:0/3407449782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f723006ab60 0x7f72300c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.052+0000 7f72358ac640 1 -- 172.21.15.7:0/3407449782 >> 172.21.15.7:0/3407449782 conn(0x7f72300b2390 msgr2=0x7f72300b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:00.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.053+0000 7f72358ac640 1 -- 172.21.15.7:0/3407449782 shutdown_connections 2024-04-25T09:57:00.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.053+0000 7f72358ac640 1 -- 172.21.15.7:0/3407449782 wait complete. 2024-04-25T09:57:00.067 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:57:00.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.164+0000 7f52d7a5d640 1 Processor -- start 2024-04-25T09:57:00.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.164+0000 7f52d7a5d640 1 -- start start 2024-04-25T09:57:00.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.165+0000 7f52d7a5d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f52d015da60 0x7f52d00d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:00.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.165+0000 7f52d7a5d640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d015e8a0 con 0x7f52d015de40 2024-04-25T09:57:00.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.165+0000 7f52d7a5d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d015eb80 con 0x7f52d015e2d0 2024-04-25T09:57:00.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.165+0000 7f52d7a5d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d015ee60 con 0x7f52d015da60 2024-04-25T09:57:00.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.165+0000 7f52d4ff8640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f52d015de40 0x7f52d0161d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56532/0 (socket says 172.21.15.7:56532) 2024-04-25T09:57:00.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.165+0000 7f52d4ff8640 1 -- 172.21.15.7:0/4280212260 learned_addr learned my addr 172.21.15.7:0/4280212260 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:57:00.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.165+0000 7f52d57f9640 1 --2- 172.21.15.7:0/4280212260 >> v2:172.21.15.55:3300/0 conn(0x7f52d015da60 0x7f52d00d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:00.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.165+0000 7f52c7fff640 1 -- 172.21.15.7:0/4280212260 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078757454 0 0) 0x7f52d015e8a0 con 0x7f52d015de40 2024-04-25T09:57:00.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.165+0000 7f52c7fff640 1 -- 172.21.15.7:0/4280212260 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52bc003520 con 0x7f52d015de40 2024-04-25T09:57:00.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.166+0000 7f52c7fff640 1 -- 172.21.15.7:0/4280212260 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1665189279 0 0) 0x7f52bc003520 con 0x7f52d015de40 2024-04-25T09:57:00.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.166+0000 7f52c7fff640 1 -- 172.21.15.7:0/4280212260 >> v2:172.21.15.55:3300/0 conn(0x7f52d015da60 msgr2=0x7f52d00d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:00.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.166+0000 7f52c7fff640 1 --2- 172.21.15.7:0/4280212260 >> v2:172.21.15.55:3300/0 conn(0x7f52d015da60 0x7f52d00d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.166+0000 7f52c7fff640 1 -- 172.21.15.7:0/4280212260 >> v1:172.21.15.55:6789/0 conn(0x7f52d015e2d0 legacy=0x7f52d00ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:00.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.166+0000 7f52c7fff640 1 -- 172.21.15.7:0/4280212260 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d0161850 con 0x7f52d015de40 2024-04-25T09:57:00.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.166+0000 7f52c7fff640 1 -- 172.21.15.7:0/4280212260 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f52c0001670 con 0x7f52d015de40 2024-04-25T09:57:00.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.166+0000 7f52c7fff640 1 -- 172.21.15.7:0/4280212260 >> v1:172.21.15.7:6789/0 conn(0x7f52d015de40 legacy=0x7f52d0161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:00.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.166+0000 7f52c7fff640 1 --2- 172.21.15.7:0/4280212260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52bc0039b0 0x7f52bc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:00.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.166+0000 7f52c7fff640 1 --2- 172.21.15.7:0/4280212260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52bc0043b0 0x7f52bc004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:00.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.166+0000 7f52c7fff640 1 --2- 172.21.15.7:0/4280212260 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f52bc005120 0x7f52bc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:00.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.166+0000 7f52c7fff640 1 -- 172.21.15.7:0/4280212260 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d015ee60 con 0x7f52bc0043b0 2024-04-25T09:57:00.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.166+0000 7f52c7fff640 1 -- 172.21.15.7:0/4280212260 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc00c060 con 0x7f52bc0039b0 2024-04-25T09:57:00.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.166+0000 7f52c7fff640 1 -- 172.21.15.7:0/4280212260 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc00c260 con 0x7f52bc005120 2024-04-25T09:57:00.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.166+0000 7f52d4ff8640 1 --2- 172.21.15.7:0/4280212260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52bc0043b0 0x7f52bc004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:00.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.166+0000 7f52d57f9640 1 --2- 172.21.15.7:0/4280212260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52bc0039b0 0x7f52bc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:00.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.166+0000 7f52d5ffa640 1 --2- 172.21.15.7:0/4280212260 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f52bc005120 0x7f52bc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:00.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.166+0000 7f52d4ff8640 1 -- 172.21.15.7:0/4280212260 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f52bc005120 msgr2=0x7f52bc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:00.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.166+0000 7f52d4ff8640 1 --2- 172.21.15.7:0/4280212260 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f52bc005120 0x7f52bc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.166+0000 7f52d4ff8640 1 -- 172.21.15.7:0/4280212260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52bc0039b0 msgr2=0x7f52bc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:00.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.166+0000 7f52d4ff8640 1 --2- 172.21.15.7:0/4280212260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52bc0039b0 0x7f52bc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.166+0000 7f52d5ffa640 1 -- 172.21.15.7:0/4280212260 reap_dead start 2024-04-25T09:57:00.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.166+0000 7f52d4ff8640 1 -- 172.21.15.7:0/4280212260 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc003520 con 0x7f52bc0043b0 2024-04-25T09:57:00.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.167+0000 7f52d4ff8640 1 --2- 172.21.15.7:0/4280212260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52bc0043b0 0x7f52bc004880 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f52c000c240 tx=0x7f52bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802af2af069c0299 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:00.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.167+0000 7f52c7fff640 1 -- 172.21.15.7:0/4280212260 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c0007d30 con 0x7f52bc0043b0 2024-04-25T09:57:00.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.167+0000 7f52c7fff640 1 -- 172.21.15.7:0/4280212260 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c00058d0 con 0x7f52bc0043b0 2024-04-25T09:57:00.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.167+0000 7f52c7fff640 1 -- 172.21.15.7:0/4280212260 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c0005d20 con 0x7f52bc0043b0 2024-04-25T09:57:00.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.167+0000 7f52d7a5d640 1 -- 172.21.15.7:0/4280212260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52bc0043b0 msgr2=0x7f52bc004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:00.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.167+0000 7f52d7a5d640 1 --2- 172.21.15.7:0/4280212260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52bc0043b0 0x7f52bc004880 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f52c000c240 tx=0x7f52bc005830 comp rx=0 tx=0).stop 2024-04-25T09:57:00.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.168+0000 7f52d7a5d640 1 -- 172.21.15.7:0/4280212260 shutdown_connections 2024-04-25T09:57:00.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.168+0000 7f52d7a5d640 1 --2- 172.21.15.7:0/4280212260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52bc0043b0 0x7f52bc004880 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.168+0000 7f52d7a5d640 1 -- 172.21.15.7:0/4280212260 >> 172.21.15.7:0/4280212260 conn(0x7f52d006bfe0 msgr2=0x7f52d006c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:00.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.168+0000 7f52d7a5d640 1 -- 172.21.15.7:0/4280212260 shutdown_connections 2024-04-25T09:57:00.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.168+0000 7f52d7a5d640 1 -- 172.21.15.7:0/4280212260 wait complete. 2024-04-25T09:57:00.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.169+0000 7f52d7a5d640 1 Processor -- start 2024-04-25T09:57:00.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.169+0000 7f52d7a5d640 1 -- start start 2024-04-25T09:57:00.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.170+0000 7f52d7a5d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52bc0043b0 0x7f52d00aa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:00.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.170+0000 7f52d7a5d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f52d014d6d0 0x7f52d00cb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:00.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.170+0000 7f52d7a5d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52d00cccf0 0x7f52d00cd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:00.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.170+0000 7f52d7a5d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d00d0e30 con 0x7f52bc0043b0 2024-04-25T09:57:00.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.170+0000 7f52d7a5d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d00d0cb0 con 0x7f52d00cccf0 2024-04-25T09:57:00.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.170+0000 7f52d7a5d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d0161d70 con 0x7f52d014d6d0 2024-04-25T09:57:00.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.170+0000 7f52d57f9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52bc0043b0 0x7f52d00aa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:00.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.170+0000 7f52d57f9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52bc0043b0 0x7f52d00aa5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49902/0 (socket says 172.21.15.7:49902) 2024-04-25T09:57:00.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.170+0000 7f52d57f9640 1 -- 172.21.15.7:0/1579664819 learned_addr learned my addr 172.21.15.7:0/1579664819 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:00.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.170+0000 7f52d4ff8640 1 --2- 172.21.15.7:0/1579664819 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f52d014d6d0 0x7f52d00cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:00.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.170+0000 7f52d57f9640 1 -- 172.21.15.7:0/1579664819 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f52d014d6d0 msgr2=0x7f52d00cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:00.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.170+0000 7f52d5ffa640 1 --2- 172.21.15.7:0/1579664819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52d00cccf0 0x7f52d00cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:00.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.170+0000 7f52d57f9640 1 --2- 172.21.15.7:0/1579664819 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f52d014d6d0 0x7f52d00cb400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.170+0000 7f52d57f9640 1 -- 172.21.15.7:0/1579664819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52d00cccf0 msgr2=0x7f52d00cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:00.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.170+0000 7f52d57f9640 1 --2- 172.21.15.7:0/1579664819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52d00cccf0 0x7f52d00cd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.170+0000 7f52d57f9640 1 -- 172.21.15.7:0/1579664819 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d00cbc50 con 0x7f52bc0043b0 2024-04-25T09:57:00.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.170+0000 7f52d57f9640 1 --2- 172.21.15.7:0/1579664819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52bc0043b0 0x7f52d00aa5e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f52cc0118f0 tx=0x7f52cc011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:00.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.170+0000 7f52c5ffb640 1 -- 172.21.15.7:0/1579664819 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc019070 con 0x7f52bc0043b0 2024-04-25T09:57:00.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.170+0000 7f52c5ffb640 1 -- 172.21.15.7:0/1579664819 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52cc004240 con 0x7f52bc0043b0 2024-04-25T09:57:00.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.170+0000 7f52c5ffb640 1 -- 172.21.15.7:0/1579664819 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc00f820 con 0x7f52bc0043b0 2024-04-25T09:57:00.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.170+0000 7f52d7a5d640 1 -- 172.21.15.7:0/1579664819 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d00cbf30 con 0x7f52bc0043b0 2024-04-25T09:57:00.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.171+0000 7f52d7a5d640 1 -- 172.21.15.7:0/1579664819 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d00cc4f0 con 0x7f52bc0043b0 2024-04-25T09:57:00.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.171+0000 7f52d7a5d640 1 -- 172.21.15.7:0/1579664819 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d0068fd0 con 0x7f52bc0043b0 2024-04-25T09:57:00.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.172+0000 7f52c5ffb640 1 -- 172.21.15.7:0/1579664819 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f52cc01c070 con 0x7f52bc0043b0 2024-04-25T09:57:00.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.172+0000 7f52c5ffb640 1 --2- 172.21.15.7:0/1579664819 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f52b406b4d0 0x7f52b406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:00.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.172+0000 7f52c5ffb640 1 -- 172.21.15.7:0/1579664819 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f52cc08a7d0 con 0x7f52bc0043b0 2024-04-25T09:57:00.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.172+0000 7f52d4ff8640 1 --2- 172.21.15.7:0/1579664819 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f52b406b4d0 0x7f52b406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:00.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.173+0000 7f52d4ff8640 1 --2- 172.21.15.7:0/1579664819 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f52b406b4d0 0x7f52b406d990 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f52c0033000 tx=0x7f52c002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:00.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.177+0000 7f52c5ffb640 1 -- 172.21.15.7:0/1579664819 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f52cc0594c0 con 0x7f52bc0043b0 2024-04-25T09:57:00.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.356+0000 7f52d7a5d640 1 -- 172.21.15.7:0/1579664819 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52d00d1560 con 0x7f52bc0043b0 2024-04-25T09:57:00.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.357+0000 7f52c5ffb640 1 -- 172.21.15.7:0/1579664819 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16846 (secure 0 0 0) 0x7f52cc058dc0 con 0x7f52bc0043b0 2024-04-25T09:57:00.361 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:57:00.361 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":51,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:56:16.391447+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:56:13.032097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T09:56:13.732257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:57:00.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.359+0000 7f52d7a5d640 1 -- 172.21.15.7:0/1579664819 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f52b406b4d0 msgr2=0x7f52b406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:00.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.359+0000 7f52d7a5d640 1 --2- 172.21.15.7:0/1579664819 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f52b406b4d0 0x7f52b406d990 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f52c0033000 tx=0x7f52c002e000 comp rx=0 tx=0).stop 2024-04-25T09:57:00.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.359+0000 7f52d7a5d640 1 -- 172.21.15.7:0/1579664819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52bc0043b0 msgr2=0x7f52d00aa5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:00.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.359+0000 7f52d7a5d640 1 --2- 172.21.15.7:0/1579664819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52bc0043b0 0x7f52d00aa5e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f52cc0118f0 tx=0x7f52cc011db0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.359+0000 7f52d7a5d640 1 -- 172.21.15.7:0/1579664819 shutdown_connections 2024-04-25T09:57:00.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.359+0000 7f52d7a5d640 1 --2- 172.21.15.7:0/1579664819 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f52b406b4d0 0x7f52b406d990 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.359+0000 7f52d7a5d640 1 --2- 172.21.15.7:0/1579664819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52d00cccf0 0x7f52d00cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.359+0000 7f52d7a5d640 1 --2- 172.21.15.7:0/1579664819 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f52d014d6d0 0x7f52d00cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.359+0000 7f52d7a5d640 1 --2- 172.21.15.7:0/1579664819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52bc0043b0 0x7f52d00aa5e0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.359+0000 7f52d7a5d640 1 -- 172.21.15.7:0/1579664819 >> 172.21.15.7:0/1579664819 conn(0x7f52d006bfe0 msgr2=0x7f52d0160870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:00.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.359+0000 7f52d7a5d640 1 -- 172.21.15.7:0/1579664819 shutdown_connections 2024-04-25T09:57:00.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.359+0000 7f52d7a5d640 1 -- 172.21.15.7:0/1579664819 wait complete. 2024-04-25T09:57:00.373 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:56:13.032097+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:56:13.732257+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:57:00.374 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:57:00.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.474+0000 7f3dab49e640 1 Processor -- start 2024-04-25T09:57:00.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.475+0000 7f3dab49e640 1 -- start start 2024-04-25T09:57:00.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.475+0000 7f3dab49e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3da40cda20 0x7f3da40cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:00.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.475+0000 7f3dab49e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3da406bf10 0x7f3da40999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:00.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.475+0000 7f3dab49e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da40d02f0 con 0x7f3da4099f30 2024-04-25T09:57:00.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.475+0000 7f3dab49e640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da40cde00 con 0x7f3da406bf10 2024-04-25T09:57:00.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.475+0000 7f3dab49e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da40d05d0 con 0x7f3da40cda20 2024-04-25T09:57:00.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.475+0000 7f3da8a39640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3da406bf10 0x7f3da40999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:00.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.476+0000 7f3da8a39640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3da406bf10 0x7f3da40999f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49908/0 (socket says 172.21.15.7:49908) 2024-04-25T09:57:00.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.476+0000 7f3da8a39640 1 -- 172.21.15.7:0/3711483247 learned_addr learned my addr 172.21.15.7:0/3711483247 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:00.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.476+0000 7f3da8a39640 1 -- 172.21.15.7:0/3711483247 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3da40cda20 msgr2=0x7f3da40cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:00.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.476+0000 7f3da923a640 1 --2- 172.21.15.7:0/3711483247 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3da40cda20 0x7f3da40cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:00.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.476+0000 7f3da8a39640 1 --2- 172.21.15.7:0/3711483247 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3da40cda20 0x7f3da40cf9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.476+0000 7f3da8a39640 1 -- 172.21.15.7:0/3711483247 >> v1:172.21.15.55:6789/0 conn(0x7f3da4099f30 legacy=0x7f3da415d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:00.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.476+0000 7f3da8a39640 1 -- 172.21.15.7:0/3711483247 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da40d08b0 con 0x7f3da406bf10 2024-04-25T09:57:00.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.476+0000 7f3da923a640 1 --2- 172.21.15.7:0/3711483247 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3da40cda20 0x7f3da40cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:57:00.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.477+0000 7f3da8a39640 1 --2- 172.21.15.7:0/3711483247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3da406bf10 0x7f3da40999f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f3d94009870 tx=0x7f3d9402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab714c7088e06711 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:00.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.477+0000 7f3d9bfff640 1 -- 172.21.15.7:0/3711483247 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d94037070 con 0x7f3da406bf10 2024-04-25T09:57:00.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.477+0000 7f3d9bfff640 1 -- 172.21.15.7:0/3711483247 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d94032440 con 0x7f3da406bf10 2024-04-25T09:57:00.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.477+0000 7f3d9bfff640 1 -- 172.21.15.7:0/3711483247 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d94032810 con 0x7f3da406bf10 2024-04-25T09:57:00.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.477+0000 7f3dab49e640 1 -- 172.21.15.7:0/3711483247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3da406bf10 msgr2=0x7f3da40999f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:00.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.477+0000 7f3dab49e640 1 --2- 172.21.15.7:0/3711483247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3da406bf10 0x7f3da40999f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f3d94009870 tx=0x7f3d9402a270 comp rx=0 tx=0).stop 2024-04-25T09:57:00.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.477+0000 7f3dab49e640 1 -- 172.21.15.7:0/3711483247 shutdown_connections 2024-04-25T09:57:00.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.477+0000 7f3dab49e640 1 --2- 172.21.15.7:0/3711483247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3da406bf10 0x7f3da40999f0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.477+0000 7f3dab49e640 1 --2- 172.21.15.7:0/3711483247 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3da40cda20 0x7f3da40cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.477+0000 7f3dab49e640 1 -- 172.21.15.7:0/3711483247 >> 172.21.15.7:0/3711483247 conn(0x7f3da40b3110 msgr2=0x7f3da40b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:00.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.477+0000 7f3dab49e640 1 -- 172.21.15.7:0/3711483247 shutdown_connections 2024-04-25T09:57:00.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.477+0000 7f3dab49e640 1 -- 172.21.15.7:0/3711483247 wait complete. 2024-04-25T09:57:00.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.479+0000 7f3dab49e640 1 Processor -- start 2024-04-25T09:57:00.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.479+0000 7f3dab49e640 1 -- start start 2024-04-25T09:57:00.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.479+0000 7f3dab49e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3da406bf10 0x7f3da4151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:00.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.479+0000 7f3dab49e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3da4099f30 0x7f3da40c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:00.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.479+0000 7f3dab49e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3da40cda20 0x7f3da415dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:00.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.479+0000 7f3dab49e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da40cff10 con 0x7f3da406bf10 2024-04-25T09:57:00.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.479+0000 7f3dab49e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da40d0e70 con 0x7f3da4099f30 2024-04-25T09:57:00.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.479+0000 7f3dab49e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da40d0090 con 0x7f3da40cda20 2024-04-25T09:57:00.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.479+0000 7f3da923a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3da406bf10 0x7f3da4151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:00.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.479+0000 7f3da923a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3da406bf10 0x7f3da4151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49916/0 (socket says 172.21.15.7:49916) 2024-04-25T09:57:00.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.479+0000 7f3da923a640 1 -- 172.21.15.7:0/2918955439 learned_addr learned my addr 172.21.15.7:0/2918955439 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:00.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.480+0000 7f3da8a39640 1 --2- 172.21.15.7:0/2918955439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3da4099f30 0x7f3da40c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:00.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.480+0000 7f3da9a3b640 1 --2- 172.21.15.7:0/2918955439 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3da40cda20 0x7f3da415dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:00.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.480+0000 7f3da923a640 1 -- 172.21.15.7:0/2918955439 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3da40cda20 msgr2=0x7f3da415dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:00.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.480+0000 7f3da923a640 1 --2- 172.21.15.7:0/2918955439 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3da40cda20 0x7f3da415dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.480+0000 7f3da923a640 1 -- 172.21.15.7:0/2918955439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3da4099f30 msgr2=0x7f3da40c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:00.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.480+0000 7f3da923a640 1 --2- 172.21.15.7:0/2918955439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3da4099f30 0x7f3da40c6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.480+0000 7f3da923a640 1 -- 172.21.15.7:0/2918955439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da40c5280 con 0x7f3da406bf10 2024-04-25T09:57:00.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.480+0000 7f3da923a640 1 --2- 172.21.15.7:0/2918955439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3da406bf10 0x7f3da4151c50 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f3da000c820 tx=0x7f3da000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:00.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.480+0000 7f3d99ffb640 1 -- 172.21.15.7:0/2918955439 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da0015070 con 0x7f3da406bf10 2024-04-25T09:57:00.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.480+0000 7f3d99ffb640 1 -- 172.21.15.7:0/2918955439 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da0007a30 con 0x7f3da406bf10 2024-04-25T09:57:00.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.480+0000 7f3d99ffb640 1 -- 172.21.15.7:0/2918955439 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da0007e00 con 0x7f3da406bf10 2024-04-25T09:57:00.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.480+0000 7f3dab49e640 1 -- 172.21.15.7:0/2918955439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da40c5560 con 0x7f3da406bf10 2024-04-25T09:57:00.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.480+0000 7f3dab49e640 1 -- 172.21.15.7:0/2918955439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da40c5b20 con 0x7f3da406bf10 2024-04-25T09:57:00.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.481+0000 7f3dab49e640 1 -- 172.21.15.7:0/2918955439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da4068f60 con 0x7f3da406bf10 2024-04-25T09:57:00.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.482+0000 7f3d99ffb640 1 -- 172.21.15.7:0/2918955439 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3da0018070 con 0x7f3da406bf10 2024-04-25T09:57:00.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.482+0000 7f3d99ffb640 1 --2- 172.21.15.7:0/2918955439 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3d8806b4d0 0x7f3d8806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:00.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.482+0000 7f3d99ffb640 1 -- 172.21.15.7:0/2918955439 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3da008a230 con 0x7f3da406bf10 2024-04-25T09:57:00.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.482+0000 7f3da8a39640 1 --2- 172.21.15.7:0/2918955439 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3d8806b4d0 0x7f3d8806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:00.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.483+0000 7f3da8a39640 1 --2- 172.21.15.7:0/2918955439 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3d8806b4d0 0x7f3d8806d990 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3d94034000 tx=0x7f3d9402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:00.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.486+0000 7f3d99ffb640 1 -- 172.21.15.7:0/2918955439 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3da0058960 con 0x7f3da406bf10 2024-04-25T09:57:00.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.671+0000 7f3dab49e640 1 -- 172.21.15.7:0/2918955439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3da41602d0 con 0x7f3da406bf10 2024-04-25T09:57:00.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.672+0000 7f3d99ffb640 1 -- 172.21.15.7:0/2918955439 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3da005ca00 con 0x7f3da406bf10 2024-04-25T09:57:00.675 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T09:57:00.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.674+0000 7f3dab49e640 1 -- 172.21.15.7:0/2918955439 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3d8806b4d0 msgr2=0x7f3d8806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:00.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.674+0000 7f3dab49e640 1 --2- 172.21.15.7:0/2918955439 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3d8806b4d0 0x7f3d8806d990 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3d94034000 tx=0x7f3d9402e000 comp rx=0 tx=0).stop 2024-04-25T09:57:00.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.674+0000 7f3dab49e640 1 -- 172.21.15.7:0/2918955439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3da406bf10 msgr2=0x7f3da4151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:00.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.674+0000 7f3dab49e640 1 --2- 172.21.15.7:0/2918955439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3da406bf10 0x7f3da4151c50 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f3da000c820 tx=0x7f3da000cc20 comp rx=0 tx=0).stop 2024-04-25T09:57:00.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.674+0000 7f3dab49e640 1 -- 172.21.15.7:0/2918955439 shutdown_connections 2024-04-25T09:57:00.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.674+0000 7f3dab49e640 1 --2- 172.21.15.7:0/2918955439 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3d8806b4d0 0x7f3d8806d990 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.674+0000 7f3dab49e640 1 --2- 172.21.15.7:0/2918955439 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3da40cda20 0x7f3da415dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.674+0000 7f3dab49e640 1 --2- 172.21.15.7:0/2918955439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3da4099f30 0x7f3da40c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.674+0000 7f3dab49e640 1 --2- 172.21.15.7:0/2918955439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3da406bf10 0x7f3da4151c50 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.674+0000 7f3dab49e640 1 -- 172.21.15.7:0/2918955439 >> 172.21.15.7:0/2918955439 conn(0x7f3da40b3110 msgr2=0x7f3da40cc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:00.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.674+0000 7f3dab49e640 1 -- 172.21.15.7:0/2918955439 shutdown_connections 2024-04-25T09:57:00.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.674+0000 7f3dab49e640 1 -- 172.21.15.7:0/2918955439 wait complete. 2024-04-25T09:57:00.688 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:57:00.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.788+0000 7fcce0542640 1 Processor -- start 2024-04-25T09:57:00.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.788+0000 7fcce0542640 1 -- start start 2024-04-25T09:57:00.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.789+0000 7fcce0542640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fccd80b1480 0x7fccd80b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:00.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.789+0000 7fcce0542640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fccd80cc580 0x7fccd80cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:00.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.789+0000 7fcce0542640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd80b25e0 con 0x7fccd80cfc40 2024-04-25T09:57:00.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.789+0000 7fcce0542640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccd815bec0 con 0x7fccd80b1480 2024-04-25T09:57:00.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.789+0000 7fcce0542640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccd80b19d0 con 0x7fccd80cc580 2024-04-25T09:57:00.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.789+0000 7fccddadd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fccd80b1480 0x7fccd80b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:00.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.789+0000 7fccddadd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fccd80b1480 0x7fccd80b0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49932/0 (socket says 172.21.15.7:49932) 2024-04-25T09:57:00.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.789+0000 7fccddadd640 1 -- 172.21.15.7:0/565485725 learned_addr learned my addr 172.21.15.7:0/565485725 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:00.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.790+0000 7fccddadd640 1 -- 172.21.15.7:0/565485725 >> v2:172.21.15.55:3300/0 conn(0x7fccd80cc580 msgr2=0x7fccd80cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:00.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.790+0000 7fccdeadf640 1 --2- 172.21.15.7:0/565485725 >> v2:172.21.15.55:3300/0 conn(0x7fccd80cc580 0x7fccd80cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:00.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.790+0000 7fccddadd640 1 --2- 172.21.15.7:0/565485725 >> v2:172.21.15.55:3300/0 conn(0x7fccd80cc580 0x7fccd80cc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.790+0000 7fccddadd640 1 -- 172.21.15.7:0/565485725 >> v1:172.21.15.55:6789/0 conn(0x7fccd80cfc40 legacy=0x7fccd80d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:00.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.790+0000 7fccddadd640 1 -- 172.21.15.7:0/565485725 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd80b1cb0 con 0x7fccd80b1480 2024-04-25T09:57:00.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.790+0000 7fccdeadf640 1 --2- 172.21.15.7:0/565485725 >> v2:172.21.15.55:3300/0 conn(0x7fccd80cc580 0x7fccd80cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:57:00.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.790+0000 7fccddadd640 1 --2- 172.21.15.7:0/565485725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccd80b1480 0x7fccd80b0ad0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fccd8072f10 tx=0x7fcccc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0db1896dced7550 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:00.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.791+0000 7fccdd2dc640 1 -- 172.21.15.7:0/565485725 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc037070 con 0x7fccd80b1480 2024-04-25T09:57:00.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.791+0000 7fccdd2dc640 1 -- 172.21.15.7:0/565485725 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcccc032440 con 0x7fccd80b1480 2024-04-25T09:57:00.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.791+0000 7fccdd2dc640 1 -- 172.21.15.7:0/565485725 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc032810 con 0x7fccd80b1480 2024-04-25T09:57:00.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.791+0000 7fcce0542640 1 -- 172.21.15.7:0/565485725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccd80b1480 msgr2=0x7fccd80b0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:00.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.791+0000 7fcce0542640 1 --2- 172.21.15.7:0/565485725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccd80b1480 0x7fccd80b0ad0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fccd8072f10 tx=0x7fcccc02a230 comp rx=0 tx=0).stop 2024-04-25T09:57:00.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.791+0000 7fcce0542640 1 -- 172.21.15.7:0/565485725 shutdown_connections 2024-04-25T09:57:00.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.791+0000 7fcce0542640 1 --2- 172.21.15.7:0/565485725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccd80b1480 0x7fccd80b0ad0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.791+0000 7fcce0542640 1 --2- 172.21.15.7:0/565485725 >> v2:172.21.15.55:3300/0 conn(0x7fccd80cc580 0x7fccd80cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.791+0000 7fcce0542640 1 -- 172.21.15.7:0/565485725 >> 172.21.15.7:0/565485725 conn(0x7fccd808af80 msgr2=0x7fccd808b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:00.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.791+0000 7fcce0542640 1 -- 172.21.15.7:0/565485725 shutdown_connections 2024-04-25T09:57:00.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.791+0000 7fcce0542640 1 -- 172.21.15.7:0/565485725 wait complete. 2024-04-25T09:57:00.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.792+0000 7fcce0542640 1 Processor -- start 2024-04-25T09:57:00.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.792+0000 7fcce0542640 1 -- start start 2024-04-25T09:57:00.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.793+0000 7fcce0542640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccd80b1480 0x7fccd80c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:00.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.793+0000 7fcce0542640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fccd80cc580 0x7fccd80c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:00.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.793+0000 7fcce0542640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccd80cfc40 0x7fccd8159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:00.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.793+0000 7fcce0542640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd80b1010 con 0x7fccd80cfc40 2024-04-25T09:57:00.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.793+0000 7fcce0542640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd80b2270 con 0x7fccd80b1480 2024-04-25T09:57:00.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.793+0000 7fcce0542640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd80ccf30 con 0x7fccd80cc580 2024-04-25T09:57:00.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.793+0000 7fccdeadf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccd80cfc40 0x7fccd8159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:00.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.793+0000 7fccdeadf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccd80cfc40 0x7fccd8159930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49938/0 (socket says 172.21.15.7:49938) 2024-04-25T09:57:00.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.793+0000 7fccdeadf640 1 -- 172.21.15.7:0/1984503194 learned_addr learned my addr 172.21.15.7:0/1984503194 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:00.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.793+0000 7fccddadd640 1 --2- 172.21.15.7:0/1984503194 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fccd80cc580 0x7fccd80c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:00.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.793+0000 7fccde2de640 1 --2- 172.21.15.7:0/1984503194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccd80b1480 0x7fccd80c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:00.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.794+0000 7fccdeadf640 1 -- 172.21.15.7:0/1984503194 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fccd80cc580 msgr2=0x7fccd80c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:00.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.794+0000 7fccdeadf640 1 --2- 172.21.15.7:0/1984503194 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fccd80cc580 0x7fccd80c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.794+0000 7fccdeadf640 1 -- 172.21.15.7:0/1984503194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccd80b1480 msgr2=0x7fccd80c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:00.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.794+0000 7fccdeadf640 1 --2- 172.21.15.7:0/1984503194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccd80b1480 0x7fccd80c4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.794+0000 7fccdeadf640 1 -- 172.21.15.7:0/1984503194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd80c65b0 con 0x7fccd80cfc40 2024-04-25T09:57:00.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.794+0000 7fccde2de640 1 --2- 172.21.15.7:0/1984503194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccd80b1480 0x7fccd80c4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:57:00.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.794+0000 7fccdeadf640 1 --2- 172.21.15.7:0/1984503194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccd80cfc40 0x7fccd8159930 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fccd000c7f0 tx=0x7fccd000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:00.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.794+0000 7fccd6ffd640 1 -- 172.21.15.7:0/1984503194 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd0015070 con 0x7fccd80cfc40 2024-04-25T09:57:00.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.794+0000 7fccd6ffd640 1 -- 172.21.15.7:0/1984503194 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd0007820 con 0x7fccd80cfc40 2024-04-25T09:57:00.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.794+0000 7fcce0542640 1 -- 172.21.15.7:0/1984503194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd80c5510 con 0x7fccd80cfc40 2024-04-25T09:57:00.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.794+0000 7fccd6ffd640 1 -- 172.21.15.7:0/1984503194 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd0007c50 con 0x7fccd80cfc40 2024-04-25T09:57:00.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.794+0000 7fcce0542640 1 -- 172.21.15.7:0/1984503194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd80c5ad0 con 0x7fccd80cfc40 2024-04-25T09:57:00.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.795+0000 7fcce0542640 1 -- 172.21.15.7:0/1984503194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd8068f60 con 0x7fccd80cfc40 2024-04-25T09:57:00.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.795+0000 7fccd6ffd640 1 -- 172.21.15.7:0/1984503194 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fccd0018070 con 0x7fccd80cfc40 2024-04-25T09:57:00.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.796+0000 7fccd6ffd640 1 --2- 172.21.15.7:0/1984503194 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fccc406b4d0 0x7fccc406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:00.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.796+0000 7fccd6ffd640 1 -- 172.21.15.7:0/1984503194 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fccd008a430 con 0x7fccd80cfc40 2024-04-25T09:57:00.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.796+0000 7fccde2de640 1 --2- 172.21.15.7:0/1984503194 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fccc406b4d0 0x7fccc406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:00.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.796+0000 7fccde2de640 1 --2- 172.21.15.7:0/1984503194 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fccc406b4d0 0x7fccc406d990 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fccc8009fc0 tx=0x7fccc8009550 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:00.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.800+0000 7fccd6ffd640 1 -- 172.21.15.7:0/1984503194 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fccd00591b0 con 0x7fccd80cfc40 2024-04-25T09:57:00.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.979+0000 7fcce0542640 1 -- 172.21.15.7:0/1984503194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fccd815b120 con 0x7fccd80cfc40 2024-04-25T09:57:00.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.979+0000 7fccd6ffd640 1 -- 172.21.15.7:0/1984503194 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) v1 ==== 104+0+11 (secure 0 0 0) 0x7fccd0058ab0 con 0x7fccd80cfc40 2024-04-25T09:57:00.983 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:57:00.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.982+0000 7fcce0542640 1 -- 172.21.15.7:0/1984503194 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fccc406b4d0 msgr2=0x7fccc406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:00.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.982+0000 7fcce0542640 1 --2- 172.21.15.7:0/1984503194 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fccc406b4d0 0x7fccc406d990 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fccc8009fc0 tx=0x7fccc8009550 comp rx=0 tx=0).stop 2024-04-25T09:57:00.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.982+0000 7fcce0542640 1 -- 172.21.15.7:0/1984503194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccd80cfc40 msgr2=0x7fccd8159930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:00.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.982+0000 7fcce0542640 1 --2- 172.21.15.7:0/1984503194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccd80cfc40 0x7fccd8159930 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fccd000c7f0 tx=0x7fccd000ccb0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.982+0000 7fcce0542640 1 -- 172.21.15.7:0/1984503194 shutdown_connections 2024-04-25T09:57:00.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.982+0000 7fcce0542640 1 --2- 172.21.15.7:0/1984503194 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fccc406b4d0 0x7fccc406d990 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.982+0000 7fcce0542640 1 --2- 172.21.15.7:0/1984503194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccd80cfc40 0x7fccd8159930 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.982+0000 7fcce0542640 1 --2- 172.21.15.7:0/1984503194 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fccd80cc580 0x7fccd80c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.982+0000 7fcce0542640 1 --2- 172.21.15.7:0/1984503194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccd80b1480 0x7fccd80c4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:00.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.982+0000 7fcce0542640 1 -- 172.21.15.7:0/1984503194 >> 172.21.15.7:0/1984503194 conn(0x7fccd808af80 msgr2=0x7fccd8070a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:00.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.982+0000 7fcce0542640 1 -- 172.21.15.7:0/1984503194 shutdown_connections 2024-04-25T09:57:00.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:00.982+0000 7fcce0542640 1 -- 172.21.15.7:0/1984503194 wait complete. 2024-04-25T09:57:00.996 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:57:01.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.096+0000 7f368e49a640 1 Processor -- start 2024-04-25T09:57:01.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.096+0000 7f368e49a640 1 -- start start 2024-04-25T09:57:01.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.096+0000 7f368e49a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f368806ab60 0x7f368806afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:01.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.096+0000 7f368e49a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36880cc570 0x7f36880cca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:01.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.096+0000 7f368e49a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36880d13e0 con 0x7f368815b7a0 2024-04-25T09:57:01.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.096+0000 7f368e49a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f368806b500 con 0x7f368806ab60 2024-04-25T09:57:01.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.096+0000 7f368e49a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36880d0860 con 0x7f36880cc570 2024-04-25T09:57:01.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.097+0000 7f3687fff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f368815b7a0 0x7f36880b1900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56544/0 (socket says 172.21.15.7:56544) 2024-04-25T09:57:01.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.097+0000 7f3687fff640 1 -- 172.21.15.7:0/1626818511 learned_addr learned my addr 172.21.15.7:0/1626818511 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:57:01.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.097+0000 7f368ca37640 1 --2- 172.21.15.7:0/1626818511 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36880cc570 0x7f36880cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:01.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.097+0000 7f36877fe640 1 --2- 172.21.15.7:0/1626818511 >> v2:172.21.15.55:3300/0 conn(0x7f368806ab60 0x7f368806afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:01.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.097+0000 7f3686ffd640 1 -- 172.21.15.7:0/1626818511 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 882118728 0 0) 0x7f36880d13e0 con 0x7f368815b7a0 2024-04-25T09:57:01.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.097+0000 7f3686ffd640 1 -- 172.21.15.7:0/1626818511 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3670003520 con 0x7f368815b7a0 2024-04-25T09:57:01.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.097+0000 7f3686ffd640 1 -- 172.21.15.7:0/1626818511 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1809888128 0 0) 0x7f3670003520 con 0x7f368815b7a0 2024-04-25T09:57:01.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.097+0000 7f368ca37640 1 -- 172.21.15.7:0/1626818511 >> v2:172.21.15.55:3300/0 conn(0x7f368806ab60 msgr2=0x7f368806afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:01.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.097+0000 7f368ca37640 1 --2- 172.21.15.7:0/1626818511 >> v2:172.21.15.55:3300/0 conn(0x7f368806ab60 0x7f368806afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:01.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.097+0000 7f368ca37640 1 -- 172.21.15.7:0/1626818511 >> v1:172.21.15.7:6789/0 conn(0x7f368815b7a0 legacy=0x7f36880b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:01.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.097+0000 7f368ca37640 1 -- 172.21.15.7:0/1626818511 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36880d0b40 con 0x7f36880cc570 2024-04-25T09:57:01.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.097+0000 7f36877fe640 1 --2- 172.21.15.7:0/1626818511 >> v2:172.21.15.55:3300/0 conn(0x7f368806ab60 0x7f368806afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:57:01.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.098+0000 7f368ca37640 1 --2- 172.21.15.7:0/1626818511 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36880cc570 0x7f36880cca00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3680009d90 tx=0x7f368002a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78a84d01000f894c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:01.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.098+0000 7f3686ffd640 1 -- 172.21.15.7:0/1626818511 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3678001670 con 0x7f36880cc570 2024-04-25T09:57:01.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.098+0000 7f3686ffd640 1 -- 172.21.15.7:0/1626818511 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3680007540 con 0x7f36880cc570 2024-04-25T09:57:01.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.098+0000 7f3686ffd640 1 -- 172.21.15.7:0/1626818511 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36800078f0 con 0x7f36880cc570 2024-04-25T09:57:01.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.099+0000 7f368e49a640 1 -- 172.21.15.7:0/1626818511 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36880cc570 msgr2=0x7f36880cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:01.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.099+0000 7f368e49a640 1 --2- 172.21.15.7:0/1626818511 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36880cc570 0x7f36880cca00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3680009d90 tx=0x7f368002a5f0 comp rx=0 tx=0).stop 2024-04-25T09:57:01.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.099+0000 7f368e49a640 1 -- 172.21.15.7:0/1626818511 shutdown_connections 2024-04-25T09:57:01.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.099+0000 7f368e49a640 1 --2- 172.21.15.7:0/1626818511 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36880cc570 0x7f36880cca00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:01.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.099+0000 7f368e49a640 1 --2- 172.21.15.7:0/1626818511 >> v2:172.21.15.55:3300/0 conn(0x7f368806ab60 0x7f368806afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:01.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.099+0000 7f368e49a640 1 -- 172.21.15.7:0/1626818511 >> 172.21.15.7:0/1626818511 conn(0x7f36880725e0 msgr2=0x7f36880999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:01.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.099+0000 7f368e49a640 1 -- 172.21.15.7:0/1626818511 shutdown_connections 2024-04-25T09:57:01.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.099+0000 7f368e49a640 1 -- 172.21.15.7:0/1626818511 wait complete. 2024-04-25T09:57:01.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.100+0000 7f368e49a640 1 Processor -- start 2024-04-25T09:57:01.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.100+0000 7f368e49a640 1 -- start start 2024-04-25T09:57:01.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.101+0000 7f368e49a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f368806ab60 0x7f36881f6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:01.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.101+0000 7f368e49a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36880cc570 0x7f36880b3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:01.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.101+0000 7f368e49a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f368815b7a0 0x7f36880b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:01.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.101+0000 7f368e49a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36880d04f0 con 0x7f368815b7a0 2024-04-25T09:57:01.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.101+0000 7f368e49a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36880d1100 con 0x7f36880cc570 2024-04-25T09:57:01.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.101+0000 7f368e49a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36880b13c0 con 0x7f368806ab60 2024-04-25T09:57:01.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.101+0000 7f368ca37640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f368815b7a0 0x7f36880b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:01.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.101+0000 7f368ca37640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f368815b7a0 0x7f36880b5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49952/0 (socket says 172.21.15.7:49952) 2024-04-25T09:57:01.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.101+0000 7f368ca37640 1 -- 172.21.15.7:0/1386820379 learned_addr learned my addr 172.21.15.7:0/1386820379 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:01.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.101+0000 7f36877fe640 1 --2- 172.21.15.7:0/1386820379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36880cc570 0x7f36880b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:01.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.101+0000 7f3687fff640 1 --2- 172.21.15.7:0/1386820379 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f368806ab60 0x7f36881f6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:01.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.101+0000 7f368ca37640 1 -- 172.21.15.7:0/1386820379 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f368806ab60 msgr2=0x7f36881f6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:01.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.101+0000 7f368ca37640 1 --2- 172.21.15.7:0/1386820379 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f368806ab60 0x7f36881f6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:01.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.101+0000 7f368ca37640 1 -- 172.21.15.7:0/1386820379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36880cc570 msgr2=0x7f36880b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.101+0000 7f368ca37640 1 --2- 172.21.15.7:0/1386820379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36880cc570 0x7f36880b3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.101+0000 7f368ca37640 1 -- 172.21.15.7:0/1386820379 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36880ce280 con 0x7f368815b7a0 2024-04-25T09:57:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.101+0000 7f36877fe640 1 --2- 172.21.15.7:0/1386820379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36880cc570 0x7f36880b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:57:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.101+0000 7f3687fff640 1 --2- 172.21.15.7:0/1386820379 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f368806ab60 0x7f36881f6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:57:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.102+0000 7f368ca37640 1 --2- 172.21.15.7:0/1386820379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f368815b7a0 0x7f36880b5a40 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f3680009eb0 tx=0x7f3680004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.102+0000 7f3684ff9640 1 -- 172.21.15.7:0/1386820379 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3680040070 con 0x7f368815b7a0 2024-04-25T09:57:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.102+0000 7f3684ff9640 1 -- 172.21.15.7:0/1386820379 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3680031c40 con 0x7f368815b7a0 2024-04-25T09:57:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.102+0000 7f368e49a640 1 -- 172.21.15.7:0/1386820379 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36880ce560 con 0x7f368815b7a0 2024-04-25T09:57:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.102+0000 7f3684ff9640 1 -- 172.21.15.7:0/1386820379 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3680009450 con 0x7f368815b7a0 2024-04-25T09:57:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.102+0000 7f368e49a640 1 -- 172.21.15.7:0/1386820379 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36880b5f80 con 0x7f368815b7a0 2024-04-25T09:57:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.103+0000 7f368e49a640 1 -- 172.21.15.7:0/1386820379 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3688068f60 con 0x7f368815b7a0 2024-04-25T09:57:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.103+0000 7f3684ff9640 1 -- 172.21.15.7:0/1386820379 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3680039040 con 0x7f368815b7a0 2024-04-25T09:57:01.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.104+0000 7f3684ff9640 1 --2- 172.21.15.7:0/1386820379 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f367406b4d0 0x7f367406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:01.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.104+0000 7f3684ff9640 1 -- 172.21.15.7:0/1386820379 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f36800ab6e0 con 0x7f368815b7a0 2024-04-25T09:57:01.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.104+0000 7f3687fff640 1 --2- 172.21.15.7:0/1386820379 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f367406b4d0 0x7f367406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:01.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.104+0000 7f3687fff640 1 --2- 172.21.15.7:0/1386820379 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f367406b4d0 0x7f367406d990 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3678005880 tx=0x7f3678009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:01.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.108+0000 7f3684ff9640 1 -- 172.21.15.7:0/1386820379 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f36800303a0 con 0x7f368815b7a0 2024-04-25T09:57:01.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.291+0000 7f368e49a640 1 -- 172.21.15.7:0/1386820379 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3688157770 con 0x7f368815b7a0 2024-04-25T09:57:01.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.291+0000 7f3684ff9640 1 -- 172.21.15.7:0/1386820379 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) v1 ==== 100+0+11 (secure 0 0 0) 0x7f368007a580 con 0x7f368815b7a0 2024-04-25T09:57:01.295 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T09:57:01.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.293+0000 7f368e49a640 1 -- 172.21.15.7:0/1386820379 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f367406b4d0 msgr2=0x7f367406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:01.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.293+0000 7f368e49a640 1 --2- 172.21.15.7:0/1386820379 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f367406b4d0 0x7f367406d990 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3678005880 tx=0x7f3678009040 comp rx=0 tx=0).stop 2024-04-25T09:57:01.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.293+0000 7f368e49a640 1 -- 172.21.15.7:0/1386820379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f368815b7a0 msgr2=0x7f36880b5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:01.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.293+0000 7f368e49a640 1 --2- 172.21.15.7:0/1386820379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f368815b7a0 0x7f36880b5a40 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f3680009eb0 tx=0x7f3680004a40 comp rx=0 tx=0).stop 2024-04-25T09:57:01.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.293+0000 7f368e49a640 1 -- 172.21.15.7:0/1386820379 shutdown_connections 2024-04-25T09:57:01.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.293+0000 7f368e49a640 1 --2- 172.21.15.7:0/1386820379 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f367406b4d0 0x7f367406d990 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:01.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.293+0000 7f368e49a640 1 --2- 172.21.15.7:0/1386820379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f368815b7a0 0x7f36880b5a40 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:01.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.293+0000 7f368e49a640 1 --2- 172.21.15.7:0/1386820379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36880cc570 0x7f36880b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:01.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.293+0000 7f368e49a640 1 --2- 172.21.15.7:0/1386820379 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f368806ab60 0x7f36881f6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:01.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.293+0000 7f368e49a640 1 -- 172.21.15.7:0/1386820379 >> 172.21.15.7:0/1386820379 conn(0x7f36880725e0 msgr2=0x7f36880b2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:01.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.293+0000 7f368e49a640 1 -- 172.21.15.7:0/1386820379 shutdown_connections 2024-04-25T09:57:01.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.293+0000 7f368e49a640 1 -- 172.21.15.7:0/1386820379 wait complete. 2024-04-25T09:57:01.308 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:57:01.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.406+0000 7f48314bc640 1 Processor -- start 2024-04-25T09:57:01.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.406+0000 7f48314bc640 1 -- start start 2024-04-25T09:57:01.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.407+0000 7f48314bc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f482c0b5e60 0x7f482c06bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:01.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.407+0000 7f48314bc640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f482c06cd00 con 0x7f482c0b6a40 2024-04-25T09:57:01.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.407+0000 7f48314bc640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f482c0d1ca0 con 0x7f482c15dd00 2024-04-25T09:57:01.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.407+0000 7f48314bc640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f482c15e0e0 con 0x7f482c0b5e60 2024-04-25T09:57:01.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.407+0000 7f482b7fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f482c0b6a40 0x7f482c06c4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56560/0 (socket says 172.21.15.7:56560) 2024-04-25T09:57:01.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.407+0000 7f482b7fe640 1 -- 172.21.15.7:0/2747796378 learned_addr learned my addr 172.21.15.7:0/2747796378 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:57:01.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.407+0000 7f4823fff640 1 --2- 172.21.15.7:0/2747796378 >> v2:172.21.15.55:3300/0 conn(0x7f482c0b5e60 0x7f482c06bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:01.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.407+0000 7f482a7fc640 1 -- 172.21.15.7:0/2747796378 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2300101037 0 0) 0x7f482c06cd00 con 0x7f482c0b6a40 2024-04-25T09:57:01.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.407+0000 7f482a7fc640 1 -- 172.21.15.7:0/2747796378 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4818003520 con 0x7f482c0b6a40 2024-04-25T09:57:01.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.407+0000 7f4823fff640 1 -- 172.21.15.7:0/2747796378 >> v1:172.21.15.55:6789/0 conn(0x7f482c15dd00 legacy=0x7f482c0b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:01.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.407+0000 7f4823fff640 1 -- 172.21.15.7:0/2747796378 >> v1:172.21.15.7:6789/0 conn(0x7f482c0b6a40 legacy=0x7f482c06c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:01.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.407+0000 7f4823fff640 1 -- 172.21.15.7:0/2747796378 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482c0d1f80 con 0x7f482c0b5e60 2024-04-25T09:57:01.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.408+0000 7f4823fff640 1 --2- 172.21.15.7:0/2747796378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f482c0b5e60 0x7f482c06bfb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f48140097a0 tx=0x7f481402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11b0374fc93e40ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:01.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.408+0000 7f482a7fc640 1 -- 172.21.15.7:0/2747796378 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4814037070 con 0x7f482c0b5e60 2024-04-25T09:57:01.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.408+0000 7f482a7fc640 1 -- 172.21.15.7:0/2747796378 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4814032440 con 0x7f482c0b5e60 2024-04-25T09:57:01.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.408+0000 7f482a7fc640 1 -- 172.21.15.7:0/2747796378 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4814032810 con 0x7f482c0b5e60 2024-04-25T09:57:01.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.409+0000 7f48314bc640 1 -- 172.21.15.7:0/2747796378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f482c0b5e60 msgr2=0x7f482c06bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:01.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.409+0000 7f48314bc640 1 --2- 172.21.15.7:0/2747796378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f482c0b5e60 0x7f482c06bfb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f48140097a0 tx=0x7f481402a230 comp rx=0 tx=0).stop 2024-04-25T09:57:01.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.409+0000 7f48314bc640 1 -- 172.21.15.7:0/2747796378 shutdown_connections 2024-04-25T09:57:01.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.409+0000 7f48314bc640 1 --2- 172.21.15.7:0/2747796378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f482c0b5e60 0x7f482c06bfb0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:01.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.409+0000 7f48314bc640 1 -- 172.21.15.7:0/2747796378 >> 172.21.15.7:0/2747796378 conn(0x7f482c0d07b0 msgr2=0x7f482c0d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:01.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.409+0000 7f48314bc640 1 -- 172.21.15.7:0/2747796378 shutdown_connections 2024-04-25T09:57:01.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.409+0000 7f48314bc640 1 -- 172.21.15.7:0/2747796378 wait complete. 2024-04-25T09:57:01.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.410+0000 7f48314bc640 1 Processor -- start 2024-04-25T09:57:01.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.410+0000 7f48314bc640 1 -- start start 2024-04-25T09:57:01.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.411+0000 7f48314bc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f482c0b5e60 0x7f482c14bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:01.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.411+0000 7f48314bc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f482c0b6a40 0x7f482c15e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:01.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.411+0000 7f48314bc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f482c15dd00 0x7f482c1547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:01.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.411+0000 7f48314bc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482c168ab0 con 0x7f482c15dd00 2024-04-25T09:57:01.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.411+0000 7f48314bc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482c06cfe0 con 0x7f482c0b6a40 2024-04-25T09:57:01.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.411+0000 7f48314bc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482c168c30 con 0x7f482c0b5e60 2024-04-25T09:57:01.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.411+0000 7f482b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f482c15dd00 0x7f482c1547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:01.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.411+0000 7f482b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f482c15dd00 0x7f482c1547f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49956/0 (socket says 172.21.15.7:49956) 2024-04-25T09:57:01.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.411+0000 7f482b7fe640 1 -- 172.21.15.7:0/1759827112 learned_addr learned my addr 172.21.15.7:0/1759827112 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:01.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.411+0000 7f4823fff640 1 --2- 172.21.15.7:0/1759827112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f482c0b6a40 0x7f482c15e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:01.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.411+0000 7f482affd640 1 --2- 172.21.15.7:0/1759827112 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f482c0b5e60 0x7f482c14bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:01.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.412+0000 7f482b7fe640 1 -- 172.21.15.7:0/1759827112 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f482c0b5e60 msgr2=0x7f482c14bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:01.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.412+0000 7f482b7fe640 1 --2- 172.21.15.7:0/1759827112 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f482c0b5e60 0x7f482c14bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:01.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.412+0000 7f482b7fe640 1 -- 172.21.15.7:0/1759827112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f482c0b6a40 msgr2=0x7f482c15e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:01.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.412+0000 7f482b7fe640 1 --2- 172.21.15.7:0/1759827112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f482c0b6a40 0x7f482c15e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:01.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.412+0000 7f482b7fe640 1 -- 172.21.15.7:0/1759827112 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482c14c300 con 0x7f482c15dd00 2024-04-25T09:57:01.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.412+0000 7f482b7fe640 1 --2- 172.21.15.7:0/1759827112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f482c15dd00 0x7f482c1547f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f482400cb40 tx=0x7f482400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:01.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.412+0000 7f48237fe640 1 -- 172.21.15.7:0/1759827112 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4824017070 con 0x7f482c15dd00 2024-04-25T09:57:01.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.412+0000 7f48237fe640 1 -- 172.21.15.7:0/1759827112 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f482400aca0 con 0x7f482c15dd00 2024-04-25T09:57:01.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.412+0000 7f48314bc640 1 -- 172.21.15.7:0/1759827112 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f482c155240 con 0x7f482c15dd00 2024-04-25T09:57:01.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.412+0000 7f48237fe640 1 -- 172.21.15.7:0/1759827112 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4824012620 con 0x7f482c15dd00 2024-04-25T09:57:01.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.412+0000 7f48314bc640 1 -- 172.21.15.7:0/1759827112 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f482c155800 con 0x7f482c15dd00 2024-04-25T09:57:01.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.413+0000 7f48314bc640 1 -- 172.21.15.7:0/1759827112 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f482c068fd0 con 0x7f482c15dd00 2024-04-25T09:57:01.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.414+0000 7f48237fe640 1 -- 172.21.15.7:0/1759827112 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f482401a070 con 0x7f482c15dd00 2024-04-25T09:57:01.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.414+0000 7f48237fe640 1 --2- 172.21.15.7:0/1759827112 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f480c06b4d0 0x7f480c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:01.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.414+0000 7f48237fe640 1 -- 172.21.15.7:0/1759827112 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f482408a0d0 con 0x7f482c15dd00 2024-04-25T09:57:01.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.414+0000 7f482affd640 1 --2- 172.21.15.7:0/1759827112 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f480c06b4d0 0x7f480c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:01.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.415+0000 7f482affd640 1 --2- 172.21.15.7:0/1759827112 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f480c06b4d0 0x7f480c06d990 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f481c0016e0 tx=0x7f481c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:01.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.418+0000 7f48237fe640 1 -- 172.21.15.7:0/1759827112 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f48240587e0 con 0x7f482c15dd00 2024-04-25T09:57:01.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.638+0000 7f48314bc640 1 -- 172.21.15.7:0/1759827112 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f482c0d1620 con 0x7f482c15dd00 2024-04-25T09:57:01.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.639+0000 7f48237fe640 1 -- 172.21.15.7:0/1759827112 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4932 (secure 0 0 0) 0x7f482405c880 con 0x7f482c15dd00 2024-04-25T09:57:01.642 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:57:01.643 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5072,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1716545079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1716545079},{"type":"v1","addr":"172.21.15.7:6837","nonce":1716545079}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5434,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1851611776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1851611776},{"type":"v1","addr":"172.21.15.55:6834","nonce":1851611776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2607486300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2607486300},{"type":"v1","addr":"172.21.15.55:6835","nonce":2607486300}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:56:14.756973+0000","modified":"2024-04-25T09:56:16.763894+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5820":{"gid":5820,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6836/2232311564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2232311564},{"type":"v1","addr":"172.21.15.7:6836","nonce":2232311564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:57:01.643 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 21 2024-04-25T09:57:01.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.641+0000 7f48314bc640 1 -- 172.21.15.7:0/1759827112 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f480c06b4d0 msgr2=0x7f480c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:01.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.641+0000 7f48314bc640 1 --2- 172.21.15.7:0/1759827112 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f480c06b4d0 0x7f480c06d990 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f481c0016e0 tx=0x7f481c009040 comp rx=0 tx=0).stop 2024-04-25T09:57:01.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.641+0000 7f48314bc640 1 -- 172.21.15.7:0/1759827112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f482c15dd00 msgr2=0x7f482c1547f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:01.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.641+0000 7f48314bc640 1 --2- 172.21.15.7:0/1759827112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f482c15dd00 0x7f482c1547f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f482400cb40 tx=0x7f482400a060 comp rx=0 tx=0).stop 2024-04-25T09:57:01.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.641+0000 7f48314bc640 1 -- 172.21.15.7:0/1759827112 shutdown_connections 2024-04-25T09:57:01.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.641+0000 7f48314bc640 1 --2- 172.21.15.7:0/1759827112 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f480c06b4d0 0x7f480c06d990 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:01.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.641+0000 7f48314bc640 1 --2- 172.21.15.7:0/1759827112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f482c15dd00 0x7f482c1547f0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:01.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.641+0000 7f48314bc640 1 --2- 172.21.15.7:0/1759827112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f482c0b6a40 0x7f482c15e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:01.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.641+0000 7f48314bc640 1 --2- 172.21.15.7:0/1759827112 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f482c0b5e60 0x7f482c14bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:01.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.641+0000 7f48314bc640 1 -- 172.21.15.7:0/1759827112 >> 172.21.15.7:0/1759827112 conn(0x7f482c0d07b0 msgr2=0x7f482c06bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:01.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.641+0000 7f48314bc640 1 -- 172.21.15.7:0/1759827112 shutdown_connections 2024-04-25T09:57:01.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.641+0000 7f48314bc640 1 -- 172.21.15.7:0/1759827112 wait complete. 2024-04-25T09:57:01.656 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:57:01.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.753+0000 7f0f06bf5640 1 Processor -- start 2024-04-25T09:57:01.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.753+0000 7f0f06bf5640 1 -- start start 2024-04-25T09:57:01.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.754+0000 7f0f06bf5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f000cea60 0x7f0f000c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:01.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.754+0000 7f0f06bf5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0f0015ced0 0x7f0f000c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:01.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.754+0000 7f0f06bf5640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f0006d1f0 con 0x7f0f0015ee90 2024-04-25T09:57:01.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.754+0000 7f0f06bf5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f0006d4d0 con 0x7f0f0015ced0 2024-04-25T09:57:01.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.754+0000 7f0f06bf5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0006d7b0 con 0x7f0f000cea60 2024-04-25T09:57:01.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.754+0000 7f0f04991640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0f0015ee90 0x7f0f000ce350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56574/0 (socket says 172.21.15.7:56574) 2024-04-25T09:57:01.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.754+0000 7f0f04991640 1 -- 172.21.15.7:0/887754183 learned_addr learned my addr 172.21.15.7:0/887754183 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:57:01.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.754+0000 7f0eff7fe640 1 -- 172.21.15.7:0/887754183 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611268899 0 0) 0x7f0f0006d1f0 con 0x7f0f0015ee90 2024-04-25T09:57:01.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.754+0000 7f0eff7fe640 1 -- 172.21.15.7:0/887754183 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ef0003520 con 0x7f0f0015ee90 2024-04-25T09:57:01.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.754+0000 7f0efffff640 1 --2- 172.21.15.7:0/887754183 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f000cea60 0x7f0f000c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:01.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.754+0000 7f0f05192640 1 --2- 172.21.15.7:0/887754183 >> v2:172.21.15.55:3300/0 conn(0x7f0f0015ced0 0x7f0f000c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:01.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.754+0000 7f0eff7fe640 1 -- 172.21.15.7:0/887754183 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1508010916 0 0) 0x7f0ef0003520 con 0x7f0f0015ee90 2024-04-25T09:57:01.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.754+0000 7f0eff7fe640 1 -- 172.21.15.7:0/887754183 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f000cea60 msgr2=0x7f0f000c5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:01.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.754+0000 7f0eff7fe640 1 --2- 172.21.15.7:0/887754183 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f000cea60 0x7f0f000c5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:01.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.754+0000 7f0eff7fe640 1 -- 172.21.15.7:0/887754183 >> v2:172.21.15.55:3300/0 conn(0x7f0f0015ced0 msgr2=0x7f0f000c5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:01.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.754+0000 7f0eff7fe640 1 --2- 172.21.15.7:0/887754183 >> v2:172.21.15.55:3300/0 conn(0x7f0f0015ced0 0x7f0f000c5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:01.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.754+0000 7f0eff7fe640 1 -- 172.21.15.7:0/887754183 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0006da90 con 0x7f0f0015ee90 2024-04-25T09:57:01.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.754+0000 7f0eff7fe640 1 -- 172.21.15.7:0/887754183 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f0ef4001670 con 0x7f0f0015ee90 2024-04-25T09:57:01.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.754+0000 7f0eff7fe640 1 -- 172.21.15.7:0/887754183 >> v1:172.21.15.7:6789/0 conn(0x7f0f0015ee90 legacy=0x7f0f000ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:01.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.754+0000 7f0eff7fe640 1 --2- 172.21.15.7:0/887754183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ef00039b0 0x7f0ef0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:01.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.754+0000 7f0eff7fe640 1 --2- 172.21.15.7:0/887754183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ef0004800 0x7f0ef0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:01.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.754+0000 7f0eff7fe640 1 --2- 172.21.15.7:0/887754183 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f000cea60 0x7f0ef00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:01.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.754+0000 7f0eff7fe640 1 -- 172.21.15.7:0/887754183 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0006d4d0 con 0x7f0ef00039b0 2024-04-25T09:57:01.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.754+0000 7f0eff7fe640 1 -- 172.21.15.7:0/887754183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0006d7b0 con 0x7f0ef0004800 2024-04-25T09:57:01.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.754+0000 7f0eff7fe640 1 -- 172.21.15.7:0/887754183 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef000b9f0 con 0x7f0f000cea60 2024-04-25T09:57:01.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.755+0000 7f0f04991640 1 --2- 172.21.15.7:0/887754183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ef00039b0 0x7f0ef0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:01.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.755+0000 7f0efffff640 1 --2- 172.21.15.7:0/887754183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ef0004800 0x7f0ef0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:01.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.755+0000 7f0f05192640 1 --2- 172.21.15.7:0/887754183 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f000cea60 0x7f0ef00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:01.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.755+0000 7f0f04991640 1 -- 172.21.15.7:0/887754183 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f000cea60 msgr2=0x7f0ef00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:01.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.755+0000 7f0f04991640 1 --2- 172.21.15.7:0/887754183 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f000cea60 0x7f0ef00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:01.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.755+0000 7f0f04991640 1 -- 172.21.15.7:0/887754183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ef0004800 msgr2=0x7f0ef0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:01.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.755+0000 7f0f04991640 1 --2- 172.21.15.7:0/887754183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ef0004800 0x7f0ef0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:01.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.755+0000 7f0f04991640 1 -- 172.21.15.7:0/887754183 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef0003520 con 0x7f0ef00039b0 2024-04-25T09:57:01.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.756+0000 7f0f04991640 1 --2- 172.21.15.7:0/887754183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ef00039b0 0x7f0ef0003dd0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4001050 tx=0x7f0ef0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717d6adafbf0b0f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:01.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.756+0000 7f0eff7fe640 1 -- 172.21.15.7:0/887754183 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4007d70 con 0x7f0ef00039b0 2024-04-25T09:57:01.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.756+0000 7f0eff7fe640 1 -- 172.21.15.7:0/887754183 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef4005af0 con 0x7f0ef00039b0 2024-04-25T09:57:01.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.756+0000 7f0eff7fe640 1 -- 172.21.15.7:0/887754183 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4007070 con 0x7f0ef00039b0 2024-04-25T09:57:01.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.756+0000 7f0f06bf5640 1 -- 172.21.15.7:0/887754183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ef00039b0 msgr2=0x7f0ef0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:01.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.756+0000 7f0f06bf5640 1 --2- 172.21.15.7:0/887754183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ef00039b0 0x7f0ef0003dd0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4001050 tx=0x7f0ef0005830 comp rx=0 tx=0).stop 2024-04-25T09:57:01.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.756+0000 7f0f05192640 1 -- 172.21.15.7:0/887754183 reap_dead start 2024-04-25T09:57:01.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.756+0000 7f0f06bf5640 1 -- 172.21.15.7:0/887754183 shutdown_connections 2024-04-25T09:57:01.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.756+0000 7f0f06bf5640 1 -- 172.21.15.7:0/887754183 >> 172.21.15.7:0/887754183 conn(0x7f0f00071150 msgr2=0x7f0f00071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:01.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.756+0000 7f0f06bf5640 1 -- 172.21.15.7:0/887754183 shutdown_connections 2024-04-25T09:57:01.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.756+0000 7f0f06bf5640 1 -- 172.21.15.7:0/887754183 wait complete. 2024-04-25T09:57:01.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.758+0000 7f0f06bf5640 1 Processor -- start 2024-04-25T09:57:01.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.758+0000 7f0f06bf5640 1 -- start start 2024-04-25T09:57:01.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.758+0000 7f0f06bf5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ef00039b0 0x7f0f000cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:01.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.758+0000 7f0f06bf5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f0014cbd0 0x7f0f0014c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:01.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.758+0000 7f0f06bf5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f001505c0 0x7f0f00152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:01.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.758+0000 7f0f06bf5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f000c5b90 con 0x7f0f0014cbd0 2024-04-25T09:57:01.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.758+0000 7f0f06bf5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f000c5a10 con 0x7f0ef00039b0 2024-04-25T09:57:01.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.758+0000 7f0f06bf5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f000c5d10 con 0x7f0f001505c0 2024-04-25T09:57:01.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.759+0000 7f0efffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f0014cbd0 0x7f0f0014c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:01.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.759+0000 7f0efffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f0014cbd0 0x7f0f0014c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49982/0 (socket says 172.21.15.7:49982) 2024-04-25T09:57:01.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.759+0000 7f0efffff640 1 -- 172.21.15.7:0/4074268209 learned_addr learned my addr 172.21.15.7:0/4074268209 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:01.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.759+0000 7f0f04991640 1 --2- 172.21.15.7:0/4074268209 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ef00039b0 0x7f0f000cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:01.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.759+0000 7f0f05192640 1 --2- 172.21.15.7:0/4074268209 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f001505c0 0x7f0f00152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:01.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.759+0000 7f0efffff640 1 -- 172.21.15.7:0/4074268209 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f001505c0 msgr2=0x7f0f00152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:01.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.759+0000 7f0efffff640 1 --2- 172.21.15.7:0/4074268209 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f001505c0 0x7f0f00152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:01.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.759+0000 7f0efffff640 1 -- 172.21.15.7:0/4074268209 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ef00039b0 msgr2=0x7f0f000cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:01.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.759+0000 7f0efffff640 1 --2- 172.21.15.7:0/4074268209 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ef00039b0 0x7f0f000cd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:01.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.759+0000 7f0efffff640 1 -- 172.21.15.7:0/4074268209 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f000cc450 con 0x7f0f0014cbd0 2024-04-25T09:57:01.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.759+0000 7f0efffff640 1 --2- 172.21.15.7:0/4074268209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f0014cbd0 0x7f0f0014c310 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0118e0 tx=0x7f0eec011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:01.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.759+0000 7f0efd7fa640 1 -- 172.21.15.7:0/4074268209 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec00faf0 con 0x7f0f0014cbd0 2024-04-25T09:57:01.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.759+0000 7f0efd7fa640 1 -- 172.21.15.7:0/4074268209 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eec00fc90 con 0x7f0f0014cbd0 2024-04-25T09:57:01.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.759+0000 7f0f06bf5640 1 -- 172.21.15.7:0/4074268209 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f000cc6f0 con 0x7f0f0014cbd0 2024-04-25T09:57:01.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.759+0000 7f0efd7fa640 1 -- 172.21.15.7:0/4074268209 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec014440 con 0x7f0f0014cbd0 2024-04-25T09:57:01.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.759+0000 7f0f06bf5640 1 -- 172.21.15.7:0/4074268209 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f000cccb0 con 0x7f0f0014cbd0 2024-04-25T09:57:01.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.760+0000 7f0f06bf5640 1 -- 172.21.15.7:0/4074268209 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f00068fd0 con 0x7f0f0014cbd0 2024-04-25T09:57:01.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.761+0000 7f0efd7fa640 1 -- 172.21.15.7:0/4074268209 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0eec012040 con 0x7f0f0014cbd0 2024-04-25T09:57:01.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.761+0000 7f0efd7fa640 1 --2- 172.21.15.7:0/4074268209 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0ee406b4d0 0x7f0ee406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:01.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.762+0000 7f0efd7fa640 1 -- 172.21.15.7:0/4074268209 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0eec08a980 con 0x7f0f0014cbd0 2024-04-25T09:57:01.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.762+0000 7f0f04991640 1 --2- 172.21.15.7:0/4074268209 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0ee406b4d0 0x7f0ee406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:01.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.762+0000 7f0f04991640 1 --2- 172.21.15.7:0/4074268209 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0ee406b4d0 0x7f0ee406d990 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4033000 tx=0x7f0ef4009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:01.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.766+0000 7f0efd7fa640 1 -- 172.21.15.7:0/4074268209 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0eec019030 con 0x7f0f0014cbd0 2024-04-25T09:57:01.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.947+0000 7f0f06bf5640 1 -- 172.21.15.7:0/4074268209 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f00159910 con 0x7f0f0014cbd0 2024-04-25T09:57:01.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.948+0000 7f0efd7fa640 1 -- 172.21.15.7:0/4074268209 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16846 (secure 0 0 0) 0x7f0eec059020 con 0x7f0f0014cbd0 2024-04-25T09:57:01.952 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:57:01.952 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":51,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:56:16.391447+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:56:13.032097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T09:56:13.732257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:57:01.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.950+0000 7f0f06bf5640 1 -- 172.21.15.7:0/4074268209 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0ee406b4d0 msgr2=0x7f0ee406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:01.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.950+0000 7f0f06bf5640 1 --2- 172.21.15.7:0/4074268209 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0ee406b4d0 0x7f0ee406d990 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4033000 tx=0x7f0ef4009030 comp rx=0 tx=0).stop 2024-04-25T09:57:01.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.950+0000 7f0f06bf5640 1 -- 172.21.15.7:0/4074268209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f0014cbd0 msgr2=0x7f0f0014c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:01.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.950+0000 7f0f06bf5640 1 --2- 172.21.15.7:0/4074268209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f0014cbd0 0x7f0f0014c310 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0118e0 tx=0x7f0eec011da0 comp rx=0 tx=0).stop 2024-04-25T09:57:01.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.950+0000 7f0f06bf5640 1 -- 172.21.15.7:0/4074268209 shutdown_connections 2024-04-25T09:57:01.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.950+0000 7f0f06bf5640 1 --2- 172.21.15.7:0/4074268209 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0ee406b4d0 0x7f0ee406d990 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:01.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.950+0000 7f0f06bf5640 1 --2- 172.21.15.7:0/4074268209 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0f001505c0 0x7f0f00152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:01.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.950+0000 7f0f06bf5640 1 --2- 172.21.15.7:0/4074268209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f0014cbd0 0x7f0f0014c310 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:01.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.950+0000 7f0f06bf5640 1 --2- 172.21.15.7:0/4074268209 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ef00039b0 0x7f0f000cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:01.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.950+0000 7f0f06bf5640 1 -- 172.21.15.7:0/4074268209 >> 172.21.15.7:0/4074268209 conn(0x7f0f00071150 msgr2=0x7f0f0015a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:01.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.950+0000 7f0f06bf5640 1 -- 172.21.15.7:0/4074268209 shutdown_connections 2024-04-25T09:57:01.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:01.950+0000 7f0f06bf5640 1 -- 172.21.15.7:0/4074268209 wait complete. 2024-04-25T09:57:01.964 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:57:01.965 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:57:02.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.062+0000 7f1f0c26f640 1 Processor -- start 2024-04-25T09:57:02.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.062+0000 7f1f0c26f640 1 -- start start 2024-04-25T09:57:02.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.063+0000 7f1f0c26f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1f0409a8e0 0x7f1f040cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:02.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.063+0000 7f1f0c26f640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f04099b20 con 0x7f1f0406c250 2024-04-25T09:57:02.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.063+0000 7f1f0c26f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f04099e00 con 0x7f1f0406bce0 2024-04-25T09:57:02.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.063+0000 7f1f0c26f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f0409a450 con 0x7f1f0409a8e0 2024-04-25T09:57:02.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.063+0000 7f1f0a00b640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1f0406c250 0x7f1f0406c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56588/0 (socket says 172.21.15.7:56588) 2024-04-25T09:57:02.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.063+0000 7f1f0a00b640 1 -- 172.21.15.7:0/4050576347 learned_addr learned my addr 172.21.15.7:0/4050576347 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:57:02.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.063+0000 7f1f0a80c640 1 --2- 172.21.15.7:0/4050576347 >> v2:172.21.15.55:3300/0 conn(0x7f1f0409a8e0 0x7f1f040cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:02.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.063+0000 7f1f09009640 1 -- 172.21.15.7:0/4050576347 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1731656633 0 0) 0x7f1f04099b20 con 0x7f1f0406c250 2024-04-25T09:57:02.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.063+0000 7f1f09009640 1 -- 172.21.15.7:0/4050576347 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ef0003520 con 0x7f1f0406c250 2024-04-25T09:57:02.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.063+0000 7f1f09009640 1 -- 172.21.15.7:0/4050576347 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1494089629 0 0) 0x7f1ef0003520 con 0x7f1f0406c250 2024-04-25T09:57:02.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.063+0000 7f1f09009640 1 -- 172.21.15.7:0/4050576347 >> v2:172.21.15.55:3300/0 conn(0x7f1f0409a8e0 msgr2=0x7f1f040cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:02.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.063+0000 7f1f09009640 1 --2- 172.21.15.7:0/4050576347 >> v2:172.21.15.55:3300/0 conn(0x7f1f0409a8e0 0x7f1f040cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:02.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.063+0000 7f1f09009640 1 -- 172.21.15.7:0/4050576347 >> v1:172.21.15.55:6789/0 conn(0x7f1f0406bce0 legacy=0x7f1f040d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:02.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.063+0000 7f1f09009640 1 -- 172.21.15.7:0/4050576347 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f0409a0e0 con 0x7f1f0406c250 2024-04-25T09:57:02.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.063+0000 7f1f09009640 1 -- 172.21.15.7:0/4050576347 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f1f00001670 con 0x7f1f0406c250 2024-04-25T09:57:02.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.063+0000 7f1f09009640 1 -- 172.21.15.7:0/4050576347 >> v1:172.21.15.7:6789/0 conn(0x7f1f0406c250 legacy=0x7f1f0406c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:02.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.063+0000 7f1f09009640 1 --2- 172.21.15.7:0/4050576347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ef00039b0 0x7f1ef0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:02.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.063+0000 7f1f09009640 1 --2- 172.21.15.7:0/4050576347 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ef0004800 0x7f1ef0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:02.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.063+0000 7f1f09009640 1 --2- 172.21.15.7:0/4050576347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ef00052e0 0x7f1ef000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:02.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.063+0000 7f1f09009640 1 -- 172.21.15.7:0/4050576347 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0409a450 con 0x7f1ef00052e0 2024-04-25T09:57:02.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.063+0000 7f1f09009640 1 -- 172.21.15.7:0/4050576347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef000c1b0 con 0x7f1ef00039b0 2024-04-25T09:57:02.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.063+0000 7f1f09009640 1 -- 172.21.15.7:0/4050576347 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef000c3b0 con 0x7f1ef0004800 2024-04-25T09:57:02.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.063+0000 7f1f0a80c640 1 --2- 172.21.15.7:0/4050576347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ef00052e0 0x7f1ef000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:02.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.063+0000 7f1f0a00b640 1 --2- 172.21.15.7:0/4050576347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ef00039b0 0x7f1ef0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:02.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.064+0000 7f1f0980a640 1 --2- 172.21.15.7:0/4050576347 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ef0004800 0x7f1ef0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:02.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.064+0000 7f1f0a80c640 1 -- 172.21.15.7:0/4050576347 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ef0004800 msgr2=0x7f1ef0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:02.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.064+0000 7f1f0a80c640 1 --2- 172.21.15.7:0/4050576347 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ef0004800 0x7f1ef0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:02.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.064+0000 7f1f0a80c640 1 -- 172.21.15.7:0/4050576347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ef00039b0 msgr2=0x7f1ef0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:02.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.064+0000 7f1f0a80c640 1 --2- 172.21.15.7:0/4050576347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ef00039b0 0x7f1ef0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:02.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.064+0000 7f1f0a80c640 1 -- 172.21.15.7:0/4050576347 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef0003520 con 0x7f1ef00052e0 2024-04-25T09:57:02.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.064+0000 7f1f0a80c640 1 -- 172.21.15.7:0/4050576347 reap_dead start 2024-04-25T09:57:02.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.064+0000 7f1f0a80c640 1 --2- 172.21.15.7:0/4050576347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ef00052e0 0x7f1ef000b9c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f1efc009f90 tx=0x7f1ef0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3579c6dcc5f853b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:02.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.065+0000 7f1f09009640 1 -- 172.21.15.7:0/4050576347 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc035020 con 0x7f1ef00052e0 2024-04-25T09:57:02.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.065+0000 7f1f09009640 1 -- 172.21.15.7:0/4050576347 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1efc003b90 con 0x7f1ef00052e0 2024-04-25T09:57:02.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.065+0000 7f1f09009640 1 -- 172.21.15.7:0/4050576347 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc009c10 con 0x7f1ef00052e0 2024-04-25T09:57:02.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.065+0000 7f1f0c26f640 1 -- 172.21.15.7:0/4050576347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ef00052e0 msgr2=0x7f1ef000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:02.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.065+0000 7f1f0c26f640 1 --2- 172.21.15.7:0/4050576347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ef00052e0 0x7f1ef000b9c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f1efc009f90 tx=0x7f1ef0005830 comp rx=0 tx=0).stop 2024-04-25T09:57:02.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.065+0000 7f1f0c26f640 1 -- 172.21.15.7:0/4050576347 shutdown_connections 2024-04-25T09:57:02.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.065+0000 7f1f0c26f640 1 --2- 172.21.15.7:0/4050576347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ef00052e0 0x7f1ef000b9c0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:02.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.065+0000 7f1f0c26f640 1 -- 172.21.15.7:0/4050576347 >> 172.21.15.7:0/4050576347 conn(0x7f1f040d16e0 msgr2=0x7f1f040d1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:02.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.065+0000 7f1f0c26f640 1 -- 172.21.15.7:0/4050576347 shutdown_connections 2024-04-25T09:57:02.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.065+0000 7f1f0c26f640 1 -- 172.21.15.7:0/4050576347 wait complete. 2024-04-25T09:57:02.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.066+0000 7f1f0c26f640 1 Processor -- start 2024-04-25T09:57:02.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.066+0000 7f1f0c26f640 1 -- start start 2024-04-25T09:57:02.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.067+0000 7f1f0c26f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ef00052e0 0x7f1f040c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:02.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.067+0000 7f1f0c26f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f041621e0 0x7f1f0415c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:02.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.067+0000 7f1f0c26f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f040cb330 0x7f1f040cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:02.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.067+0000 7f1f0c26f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0415f000 con 0x7f1f040cb330 2024-04-25T09:57:02.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.067+0000 7f1f0c26f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f040d0c60 con 0x7f1f041621e0 2024-04-25T09:57:02.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.067+0000 7f1f0c26f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0415f180 con 0x7f1ef00052e0 2024-04-25T09:57:02.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.067+0000 7f1f0a80c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f040cb330 0x7f1f040cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:02.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.067+0000 7f1f0a80c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f040cb330 0x7f1f040cc9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50004/0 (socket says 172.21.15.7:50004) 2024-04-25T09:57:02.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.067+0000 7f1f0a80c640 1 -- 172.21.15.7:0/990587955 learned_addr learned my addr 172.21.15.7:0/990587955 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:02.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.067+0000 7f1f0980a640 1 --2- 172.21.15.7:0/990587955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f041621e0 0x7f1f0415c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:02.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.067+0000 7f1f0a00b640 1 --2- 172.21.15.7:0/990587955 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ef00052e0 0x7f1f040c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:02.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.068+0000 7f1f0a80c640 1 -- 172.21.15.7:0/990587955 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ef00052e0 msgr2=0x7f1f040c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:02.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.068+0000 7f1f0a80c640 1 --2- 172.21.15.7:0/990587955 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ef00052e0 0x7f1f040c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:02.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.068+0000 7f1f0a80c640 1 -- 172.21.15.7:0/990587955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f041621e0 msgr2=0x7f1f0415c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:02.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.068+0000 7f1f0a80c640 1 --2- 172.21.15.7:0/990587955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f041621e0 0x7f1f0415c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:02.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.068+0000 7f1f0a80c640 1 -- 172.21.15.7:0/990587955 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f0415d470 con 0x7f1f040cb330 2024-04-25T09:57:02.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.068+0000 7f1f0980a640 1 --2- 172.21.15.7:0/990587955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f041621e0 0x7f1f0415c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:57:02.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.068+0000 7f1f0a00b640 1 --2- 172.21.15.7:0/990587955 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ef00052e0 0x7f1f040c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:57:02.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.068+0000 7f1f0a80c640 1 --2- 172.21.15.7:0/990587955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f040cb330 0x7f1f040cc9d0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f1efc00e230 tx=0x7f1efc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:02.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.068+0000 7f1efaffd640 1 -- 172.21.15.7:0/990587955 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc035030 con 0x7f1f040cb330 2024-04-25T09:57:02.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.068+0000 7f1efaffd640 1 -- 172.21.15.7:0/990587955 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1efc042070 con 0x7f1f040cb330 2024-04-25T09:57:02.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.068+0000 7f1f0c26f640 1 -- 172.21.15.7:0/990587955 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f0415cbd0 con 0x7f1f040cb330 2024-04-25T09:57:02.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.068+0000 7f1efaffd640 1 -- 172.21.15.7:0/990587955 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc009c10 con 0x7f1f040cb330 2024-04-25T09:57:02.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.068+0000 7f1f0c26f640 1 -- 172.21.15.7:0/990587955 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f0415d190 con 0x7f1f040cb330 2024-04-25T09:57:02.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.069+0000 7f1f0c26f640 1 -- 172.21.15.7:0/990587955 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f04068fd0 con 0x7f1f040cb330 2024-04-25T09:57:02.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.069+0000 7f1efaffd640 1 -- 172.21.15.7:0/990587955 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1efc005d10 con 0x7f1f040cb330 2024-04-25T09:57:02.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.070+0000 7f1efaffd640 1 --2- 172.21.15.7:0/990587955 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1ee806b4d0 0x7f1ee806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:02.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.070+0000 7f1efaffd640 1 -- 172.21.15.7:0/990587955 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1efc0aadf0 con 0x7f1f040cb330 2024-04-25T09:57:02.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.070+0000 7f1f0a00b640 1 --2- 172.21.15.7:0/990587955 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1ee806b4d0 0x7f1ee806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:02.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.070+0000 7f1f0a00b640 1 --2- 172.21.15.7:0/990587955 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1ee806b4d0 0x7f1ee806d990 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1f000011e0 tx=0x7f1f00009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:02.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.074+0000 7f1efaffd640 1 -- 172.21.15.7:0/990587955 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1efc079c00 con 0x7f1f040cb330 2024-04-25T09:57:02.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.295+0000 7f1f0c26f640 1 -- 172.21.15.7:0/990587955 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f040d1150 con 0x7f1f040cb330 2024-04-25T09:57:02.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.296+0000 7f1efaffd640 1 -- 172.21.15.7:0/990587955 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4932 (secure 0 0 0) 0x7f1efc079500 con 0x7f1f040cb330 2024-04-25T09:57:02.299 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:57:02.299 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5072,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1716545079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1716545079},{"type":"v1","addr":"172.21.15.7:6837","nonce":1716545079}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5434,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1851611776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1851611776},{"type":"v1","addr":"172.21.15.55:6834","nonce":1851611776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2607486300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2607486300},{"type":"v1","addr":"172.21.15.55:6835","nonce":2607486300}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:56:14.756973+0000","modified":"2024-04-25T09:56:16.763894+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5820":{"gid":5820,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6836/2232311564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2232311564},{"type":"v1","addr":"172.21.15.7:6836","nonce":2232311564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:57:02.300 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 21 2024-04-25T09:57:02.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.298+0000 7f1f0c26f640 1 -- 172.21.15.7:0/990587955 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1ee806b4d0 msgr2=0x7f1ee806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:02.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.298+0000 7f1f0c26f640 1 --2- 172.21.15.7:0/990587955 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1ee806b4d0 0x7f1ee806d990 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1f000011e0 tx=0x7f1f00009040 comp rx=0 tx=0).stop 2024-04-25T09:57:02.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.298+0000 7f1f0c26f640 1 -- 172.21.15.7:0/990587955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f040cb330 msgr2=0x7f1f040cc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:02.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.298+0000 7f1f0c26f640 1 --2- 172.21.15.7:0/990587955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f040cb330 0x7f1f040cc9d0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f1efc00e230 tx=0x7f1efc009750 comp rx=0 tx=0).stop 2024-04-25T09:57:02.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.298+0000 7f1f0c26f640 1 -- 172.21.15.7:0/990587955 shutdown_connections 2024-04-25T09:57:02.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.298+0000 7f1f0c26f640 1 --2- 172.21.15.7:0/990587955 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1ee806b4d0 0x7f1ee806d990 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:02.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.298+0000 7f1f0c26f640 1 --2- 172.21.15.7:0/990587955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f040cb330 0x7f1f040cc9d0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:02.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.298+0000 7f1f0c26f640 1 --2- 172.21.15.7:0/990587955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f041621e0 0x7f1f0415c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:02.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.298+0000 7f1f0c26f640 1 --2- 172.21.15.7:0/990587955 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ef00052e0 0x7f1f040c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:02.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.298+0000 7f1f0c26f640 1 -- 172.21.15.7:0/990587955 >> 172.21.15.7:0/990587955 conn(0x7f1f040d16e0 msgr2=0x7f1f040cbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:02.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.298+0000 7f1f0c26f640 1 -- 172.21.15.7:0/990587955 shutdown_connections 2024-04-25T09:57:02.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.298+0000 7f1f0c26f640 1 -- 172.21.15.7:0/990587955 wait complete. 2024-04-25T09:57:02.312 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:57:02.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.410+0000 7faf5bf9d640 1 Processor -- start 2024-04-25T09:57:02.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.410+0000 7faf5bf9d640 1 -- start start 2024-04-25T09:57:02.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.411+0000 7faf5bf9d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faf540b1a60 0x7faf54166850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:02.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.411+0000 7faf5bf9d640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf540ccbc0 con 0x7faf540d0330 2024-04-25T09:57:02.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.411+0000 7faf5bf9d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf540ccea0 con 0x7faf5415b8e0 2024-04-25T09:57:02.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.411+0000 7faf5bf9d640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf540cd7d0 con 0x7faf540b1a60 2024-04-25T09:57:02.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.412+0000 7faf5a53a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faf540b1a60 0x7faf54166850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:02.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.412+0000 7faf5a53a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faf540b1a60 0x7faf54166850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50020/0 (socket says 172.21.15.7:50020) 2024-04-25T09:57:02.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.412+0000 7faf5a53a640 1 -- 172.21.15.7:0/2988614448 learned_addr learned my addr 172.21.15.7:0/2988614448 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:02.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.412+0000 7faf5a53a640 1 -- 172.21.15.7:0/2988614448 >> v1:172.21.15.55:6789/0 conn(0x7faf5415b8e0 legacy=0x7faf540cc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:02.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.412+0000 7faf5a53a640 1 -- 172.21.15.7:0/2988614448 >> v1:172.21.15.7:6789/0 conn(0x7faf540d0330 legacy=0x7faf540999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:02.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.412+0000 7faf58d37640 1 -- 172.21.15.7:0/2988614448 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1480091905 0 0) 0x7faf540ccea0 con 0x7faf5415b8e0 2024-04-25T09:57:02.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.412+0000 7faf5a53a640 1 -- 172.21.15.7:0/2988614448 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf540cd180 con 0x7faf540b1a60 2024-04-25T09:57:02.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.413+0000 7faf5a53a640 1 --2- 172.21.15.7:0/2988614448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf540b1a60 0x7faf54166850 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009870 tx=0x7faf4c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d53d0d57e19569a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:02.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.413+0000 7faf58d37640 1 -- 172.21.15.7:0/2988614448 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c037070 con 0x7faf540b1a60 2024-04-25T09:57:02.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.413+0000 7faf58d37640 1 -- 172.21.15.7:0/2988614448 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4c02ae50 con 0x7faf540b1a60 2024-04-25T09:57:02.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.413+0000 7faf58d37640 1 -- 172.21.15.7:0/2988614448 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c032860 con 0x7faf540b1a60 2024-04-25T09:57:02.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.414+0000 7faf5bf9d640 1 -- 172.21.15.7:0/2988614448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf540b1a60 msgr2=0x7faf54166850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:02.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.414+0000 7faf5bf9d640 1 --2- 172.21.15.7:0/2988614448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf540b1a60 0x7faf54166850 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009870 tx=0x7faf4c02a300 comp rx=0 tx=0).stop 2024-04-25T09:57:02.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.414+0000 7faf5bf9d640 1 -- 172.21.15.7:0/2988614448 shutdown_connections 2024-04-25T09:57:02.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.414+0000 7faf5bf9d640 1 --2- 172.21.15.7:0/2988614448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf540b1a60 0x7faf54166850 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:02.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.414+0000 7faf5bf9d640 1 -- 172.21.15.7:0/2988614448 >> 172.21.15.7:0/2988614448 conn(0x7faf540b3130 msgr2=0x7faf540b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:02.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.414+0000 7faf5bf9d640 1 -- 172.21.15.7:0/2988614448 shutdown_connections 2024-04-25T09:57:02.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.414+0000 7faf5bf9d640 1 -- 172.21.15.7:0/2988614448 wait complete. 2024-04-25T09:57:02.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.415+0000 7faf5bf9d640 1 Processor -- start 2024-04-25T09:57:02.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.415+0000 7faf5bf9d640 1 -- start start 2024-04-25T09:57:02.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.416+0000 7faf5bf9d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faf540b1a60 0x7faf5406c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:02.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.416+0000 7faf5bf9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf540d0330 0x7faf541576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:02.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.416+0000 7faf5bf9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf5415b8e0 0x7faf54157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:02.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.416+0000 7faf5bf9d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5415bcc0 con 0x7faf540d0330 2024-04-25T09:57:02.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.416+0000 7faf5bf9d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf540d07c0 con 0x7faf5415b8e0 2024-04-25T09:57:02.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.416+0000 7faf5bf9d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5415be40 con 0x7faf540b1a60 2024-04-25T09:57:02.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.416+0000 7faf59538640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf540d0330 0x7faf541576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:02.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.416+0000 7faf59538640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf540d0330 0x7faf541576d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50024/0 (socket says 172.21.15.7:50024) 2024-04-25T09:57:02.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.416+0000 7faf59538640 1 -- 172.21.15.7:0/3930984955 learned_addr learned my addr 172.21.15.7:0/3930984955 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:02.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.416+0000 7faf59d39640 1 --2- 172.21.15.7:0/3930984955 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faf540b1a60 0x7faf5406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:02.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.416+0000 7faf5a53a640 1 --2- 172.21.15.7:0/3930984955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf5415b8e0 0x7faf54157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:02.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.416+0000 7faf59538640 1 -- 172.21.15.7:0/3930984955 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faf540b1a60 msgr2=0x7faf5406c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:02.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.416+0000 7faf59538640 1 --2- 172.21.15.7:0/3930984955 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faf540b1a60 0x7faf5406c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:02.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.416+0000 7faf59538640 1 -- 172.21.15.7:0/3930984955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf5415b8e0 msgr2=0x7faf54157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:02.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.416+0000 7faf59538640 1 --2- 172.21.15.7:0/3930984955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf5415b8e0 0x7faf54157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:02.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.416+0000 7faf59538640 1 -- 172.21.15.7:0/3930984955 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5406c840 con 0x7faf540d0330 2024-04-25T09:57:02.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.416+0000 7faf59d39640 1 --2- 172.21.15.7:0/3930984955 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faf540b1a60 0x7faf5406c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:57:02.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.416+0000 7faf5a53a640 1 --2- 172.21.15.7:0/3930984955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf5415b8e0 0x7faf54157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:57:02.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.416+0000 7faf59538640 1 --2- 172.21.15.7:0/3930984955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf540d0330 0x7faf541576d0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7faf4400c450 tx=0x7faf4400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:02.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.417+0000 7faf4a7fc640 1 -- 172.21.15.7:0/3930984955 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf440052d0 con 0x7faf540d0330 2024-04-25T09:57:02.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.417+0000 7faf4a7fc640 1 -- 172.21.15.7:0/3930984955 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf44005470 con 0x7faf540d0330 2024-04-25T09:57:02.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.417+0000 7faf4a7fc640 1 -- 172.21.15.7:0/3930984955 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf44012870 con 0x7faf540d0330 2024-04-25T09:57:02.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.417+0000 7faf5bf9d640 1 -- 172.21.15.7:0/3930984955 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf5406cae0 con 0x7faf540d0330 2024-04-25T09:57:02.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.417+0000 7faf5bf9d640 1 -- 172.21.15.7:0/3930984955 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5406d0a0 con 0x7faf540d0330 2024-04-25T09:57:02.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.418+0000 7faf5bf9d640 1 -- 172.21.15.7:0/3930984955 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf54068fd0 con 0x7faf540d0330 2024-04-25T09:57:02.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.418+0000 7faf4a7fc640 1 -- 172.21.15.7:0/3930984955 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faf44012a10 con 0x7faf540d0330 2024-04-25T09:57:02.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.418+0000 7faf4a7fc640 1 --2- 172.21.15.7:0/3930984955 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faf3806b4d0 0x7faf3806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:02.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.418+0000 7faf4a7fc640 1 -- 172.21.15.7:0/3930984955 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7faf44089fb0 con 0x7faf540d0330 2024-04-25T09:57:02.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.419+0000 7faf59d39640 1 --2- 172.21.15.7:0/3930984955 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faf3806b4d0 0x7faf3806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:02.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.419+0000 7faf59d39640 1 --2- 172.21.15.7:0/3930984955 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faf3806b4d0 0x7faf3806d990 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7faf5406bf90 tx=0x7faf50009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:02.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.423+0000 7faf4a7fc640 1 -- 172.21.15.7:0/3930984955 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faf44058cb0 con 0x7faf540d0330 2024-04-25T09:57:02.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.639+0000 7faf5bf9d640 1 -- 172.21.15.7:0/3930984955 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf540b0810 con 0x7faf540d0330 2024-04-25T09:57:02.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.640+0000 7faf4a7fc640 1 -- 172.21.15.7:0/3930984955 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4932 (secure 0 0 0) 0x7faf440585b0 con 0x7faf540d0330 2024-04-25T09:57:02.643 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:57:02.643 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5072,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1716545079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1716545079},{"type":"v1","addr":"172.21.15.7:6837","nonce":1716545079}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5434,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1851611776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1851611776},{"type":"v1","addr":"172.21.15.55:6834","nonce":1851611776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2607486300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2607486300},{"type":"v1","addr":"172.21.15.55:6835","nonce":2607486300}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:56:14.756973+0000","modified":"2024-04-25T09:56:16.763894+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5820":{"gid":5820,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6836/2232311564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2232311564},{"type":"v1","addr":"172.21.15.7:6836","nonce":2232311564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:57:02.644 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 21 2024-04-25T09:57:02.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.641+0000 7faf5bf9d640 1 -- 172.21.15.7:0/3930984955 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faf3806b4d0 msgr2=0x7faf3806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:02.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.641+0000 7faf5bf9d640 1 --2- 172.21.15.7:0/3930984955 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faf3806b4d0 0x7faf3806d990 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7faf5406bf90 tx=0x7faf50009040 comp rx=0 tx=0).stop 2024-04-25T09:57:02.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.641+0000 7faf5bf9d640 1 -- 172.21.15.7:0/3930984955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf540d0330 msgr2=0x7faf541576d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:02.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.641+0000 7faf5bf9d640 1 --2- 172.21.15.7:0/3930984955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf540d0330 0x7faf541576d0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7faf4400c450 tx=0x7faf4400c910 comp rx=0 tx=0).stop 2024-04-25T09:57:02.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.641+0000 7faf5bf9d640 1 -- 172.21.15.7:0/3930984955 shutdown_connections 2024-04-25T09:57:02.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.641+0000 7faf5bf9d640 1 --2- 172.21.15.7:0/3930984955 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faf3806b4d0 0x7faf3806d990 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:02.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.641+0000 7faf5bf9d640 1 --2- 172.21.15.7:0/3930984955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf5415b8e0 0x7faf54157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:02.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.641+0000 7faf5bf9d640 1 --2- 172.21.15.7:0/3930984955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf540d0330 0x7faf541576d0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:02.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.641+0000 7faf5bf9d640 1 --2- 172.21.15.7:0/3930984955 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faf540b1a60 0x7faf5406c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:02.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.641+0000 7faf5bf9d640 1 -- 172.21.15.7:0/3930984955 >> 172.21.15.7:0/3930984955 conn(0x7faf540b3130 msgr2=0x7faf540ce050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:02.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.641+0000 7faf5bf9d640 1 -- 172.21.15.7:0/3930984955 shutdown_connections 2024-04-25T09:57:02.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.642+0000 7faf5bf9d640 1 -- 172.21.15.7:0/3930984955 wait complete. 2024-04-25T09:57:02.656 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:57:02.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.753+0000 7f743305d640 1 Processor -- start 2024-04-25T09:57:02.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.753+0000 7f743305d640 1 -- start start 2024-04-25T09:57:02.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.754+0000 7f743305d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f742c1529e0 0x7f742c0c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:02.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.754+0000 7f743305d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f742c0c6410 0x7f742c0ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:02.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.754+0000 7f743305d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f742c15bdc0 con 0x7f742c071ed0 2024-04-25T09:57:02.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.754+0000 7f743305d640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f742c0b2340 con 0x7f742c0c6410 2024-04-25T09:57:02.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.754+0000 7f743305d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f742c15c060 con 0x7f742c1529e0 2024-04-25T09:57:02.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.754+0000 7f742bfff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f742c0c6410 0x7f742c0ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:02.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.754+0000 7f742bfff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f742c0c6410 0x7f742c0ce350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50026/0 (socket says 172.21.15.7:50026) 2024-04-25T09:57:02.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.754+0000 7f742bfff640 1 -- 172.21.15.7:0/3160209103 learned_addr learned my addr 172.21.15.7:0/3160209103 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:02.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.754+0000 7f7430df9640 1 --2- 172.21.15.7:0/3160209103 >> v2:172.21.15.55:3300/0 conn(0x7f742c1529e0 0x7f742c0c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:02.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.754+0000 7f742bfff640 1 -- 172.21.15.7:0/3160209103 >> v2:172.21.15.55:3300/0 conn(0x7f742c1529e0 msgr2=0x7f742c0c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:02.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.754+0000 7f742bfff640 1 --2- 172.21.15.7:0/3160209103 >> v2:172.21.15.55:3300/0 conn(0x7f742c1529e0 0x7f742c0c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:02.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.754+0000 7f742bfff640 1 -- 172.21.15.7:0/3160209103 >> v1:172.21.15.55:6789/0 conn(0x7f742c071ed0 legacy=0x7f742c0c4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:02.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.754+0000 7f742bfff640 1 -- 172.21.15.7:0/3160209103 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f742c15c340 con 0x7f742c0c6410 2024-04-25T09:57:02.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.754+0000 7f7430df9640 1 --2- 172.21.15.7:0/3160209103 >> v2:172.21.15.55:3300/0 conn(0x7f742c1529e0 0x7f742c0c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:57:02.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.755+0000 7f742bfff640 1 --2- 172.21.15.7:0/3160209103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f742c0c6410 0x7f742c0ce350 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f742c071d60 tx=0x7f741802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2d345792da33e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:02.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.755+0000 7f742b7fe640 1 -- 172.21.15.7:0/3160209103 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7418037070 con 0x7f742c0c6410 2024-04-25T09:57:02.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.755+0000 7f742b7fe640 1 -- 172.21.15.7:0/3160209103 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7418032440 con 0x7f742c0c6410 2024-04-25T09:57:02.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.755+0000 7f742b7fe640 1 -- 172.21.15.7:0/3160209103 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7418032810 con 0x7f742c0c6410 2024-04-25T09:57:02.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.756+0000 7f743305d640 1 -- 172.21.15.7:0/3160209103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f742c0c6410 msgr2=0x7f742c0ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:02.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.756+0000 7f743305d640 1 --2- 172.21.15.7:0/3160209103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f742c0c6410 0x7f742c0ce350 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f742c071d60 tx=0x7f741802a230 comp rx=0 tx=0).stop 2024-04-25T09:57:02.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.756+0000 7f743305d640 1 -- 172.21.15.7:0/3160209103 shutdown_connections 2024-04-25T09:57:02.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.756+0000 7f743305d640 1 --2- 172.21.15.7:0/3160209103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f742c0c6410 0x7f742c0ce350 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:02.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.756+0000 7f743305d640 1 --2- 172.21.15.7:0/3160209103 >> v2:172.21.15.55:3300/0 conn(0x7f742c1529e0 0x7f742c0c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:02.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.756+0000 7f743305d640 1 -- 172.21.15.7:0/3160209103 >> 172.21.15.7:0/3160209103 conn(0x7f742c071150 msgr2=0x7f742c071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:02.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.756+0000 7f743305d640 1 -- 172.21.15.7:0/3160209103 shutdown_connections 2024-04-25T09:57:02.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.756+0000 7f743305d640 1 -- 172.21.15.7:0/3160209103 wait complete. 2024-04-25T09:57:02.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.757+0000 7f743305d640 1 Processor -- start 2024-04-25T09:57:02.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.757+0000 7f743305d640 1 -- start start 2024-04-25T09:57:02.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.758+0000 7f743305d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f742c071ed0 0x7f742c14ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:02.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.758+0000 7f743305d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f742c0c6410 0x7f742c1f3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:02.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.758+0000 7f743305d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f742c0b2820 0x7f742c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:02.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.758+0000 7f743305d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742c06e160 con 0x7f742c0c6410 2024-04-25T09:57:02.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.758+0000 7f743305d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742c15c900 con 0x7f742c071ed0 2024-04-25T09:57:02.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.758+0000 7f743305d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742c06e2e0 con 0x7f742c0b2820 2024-04-25T09:57:02.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.758+0000 7f742bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f742c0c6410 0x7f742c1f3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:02.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.758+0000 7f742bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f742c0c6410 0x7f742c1f3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50038/0 (socket says 172.21.15.7:50038) 2024-04-25T09:57:02.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.758+0000 7f742bfff640 1 -- 172.21.15.7:0/352903299 learned_addr learned my addr 172.21.15.7:0/352903299 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:02.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.758+0000 7f7430df9640 1 --2- 172.21.15.7:0/352903299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f742c071ed0 0x7f742c14ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:02.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.758+0000 7f74315fa640 1 --2- 172.21.15.7:0/352903299 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f742c0b2820 0x7f742c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:02.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.758+0000 7f742bfff640 1 -- 172.21.15.7:0/352903299 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f742c0b2820 msgr2=0x7f742c0b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:02.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.758+0000 7f742bfff640 1 --2- 172.21.15.7:0/352903299 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f742c0b2820 0x7f742c0b32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:02.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.758+0000 7f742bfff640 1 -- 172.21.15.7:0/352903299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f742c071ed0 msgr2=0x7f742c14ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:02.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.758+0000 7f742bfff640 1 --2- 172.21.15.7:0/352903299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f742c071ed0 0x7f742c14ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:02.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.758+0000 7f742bfff640 1 -- 172.21.15.7:0/352903299 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f742c1f4170 con 0x7f742c0c6410 2024-04-25T09:57:02.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.758+0000 7f74315fa640 1 --2- 172.21.15.7:0/352903299 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f742c0b2820 0x7f742c0b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:57:02.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.758+0000 7f742bfff640 1 --2- 172.21.15.7:0/352903299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f742c0c6410 0x7f742c1f3c30 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f7418000c00 tx=0x7f74180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:02.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.758+0000 7f74297fa640 1 -- 172.21.15.7:0/352903299 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7418041020 con 0x7f742c0c6410 2024-04-25T09:57:02.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.759+0000 7f74297fa640 1 -- 172.21.15.7:0/352903299 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7418030970 con 0x7f742c0c6410 2024-04-25T09:57:02.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.759+0000 7f74297fa640 1 -- 172.21.15.7:0/352903299 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7418037040 con 0x7f742c0c6410 2024-04-25T09:57:02.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.759+0000 7f743305d640 1 -- 172.21.15.7:0/352903299 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f742c0b0ff0 con 0x7f742c0c6410 2024-04-25T09:57:02.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.759+0000 7f743305d640 1 -- 172.21.15.7:0/352903299 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f742c0cc740 con 0x7f742c0c6410 2024-04-25T09:57:02.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.760+0000 7f743305d640 1 -- 172.21.15.7:0/352903299 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f742c068fd0 con 0x7f742c0c6410 2024-04-25T09:57:02.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.760+0000 7f74297fa640 1 -- 172.21.15.7:0/352903299 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7418044020 con 0x7f742c0c6410 2024-04-25T09:57:02.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.761+0000 7f74297fa640 1 --2- 172.21.15.7:0/352903299 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f741006b4d0 0x7f741006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:02.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.761+0000 7f74297fa640 1 -- 172.21.15.7:0/352903299 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f74180aad90 con 0x7f742c0c6410 2024-04-25T09:57:02.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.761+0000 7f7430df9640 1 --2- 172.21.15.7:0/352903299 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f741006b4d0 0x7f741006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:02.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.761+0000 7f7430df9640 1 --2- 172.21.15.7:0/352903299 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f741006b4d0 0x7f741006d990 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f742000a990 tx=0x7f7420008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:02.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.765+0000 7f74297fa640 1 -- 172.21.15.7:0/352903299 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f741804b030 con 0x7f742c0c6410 2024-04-25T09:57:02.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.945+0000 7f743305d640 1 -- 172.21.15.7:0/352903299 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f742c0cc4f0 con 0x7f742c0c6410 2024-04-25T09:57:02.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.946+0000 7f74297fa640 1 -- 172.21.15.7:0/352903299 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16846 (secure 0 0 0) 0x7f742c1f4170 con 0x7f742c0c6410 2024-04-25T09:57:02.950 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:57:02.950 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":51,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:56:16.391447+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:56:13.032097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T09:56:13.732257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:57:02.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.948+0000 7f743305d640 1 -- 172.21.15.7:0/352903299 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f741006b4d0 msgr2=0x7f741006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:02.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.948+0000 7f743305d640 1 --2- 172.21.15.7:0/352903299 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f741006b4d0 0x7f741006d990 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f742000a990 tx=0x7f7420008040 comp rx=0 tx=0).stop 2024-04-25T09:57:02.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.948+0000 7f743305d640 1 -- 172.21.15.7:0/352903299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f742c0c6410 msgr2=0x7f742c1f3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:02.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.948+0000 7f743305d640 1 --2- 172.21.15.7:0/352903299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f742c0c6410 0x7f742c1f3c30 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f7418000c00 tx=0x7f74180046c0 comp rx=0 tx=0).stop 2024-04-25T09:57:02.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.948+0000 7f743305d640 1 -- 172.21.15.7:0/352903299 shutdown_connections 2024-04-25T09:57:02.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.948+0000 7f743305d640 1 --2- 172.21.15.7:0/352903299 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f741006b4d0 0x7f741006d990 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:02.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.948+0000 7f743305d640 1 --2- 172.21.15.7:0/352903299 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f742c0b2820 0x7f742c0b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:02.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.948+0000 7f743305d640 1 --2- 172.21.15.7:0/352903299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f742c0c6410 0x7f742c1f3c30 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:02.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.948+0000 7f743305d640 1 --2- 172.21.15.7:0/352903299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f742c071ed0 0x7f742c14ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:02.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.948+0000 7f743305d640 1 -- 172.21.15.7:0/352903299 >> 172.21.15.7:0/352903299 conn(0x7f742c071150 msgr2=0x7f742c150af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:02.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.948+0000 7f743305d640 1 -- 172.21.15.7:0/352903299 shutdown_connections 2024-04-25T09:57:02.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:02.948+0000 7f743305d640 1 -- 172.21.15.7:0/352903299 wait complete. 2024-04-25T09:57:02.963 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:57:03.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.062+0000 7f913d007640 1 Processor -- start 2024-04-25T09:57:03.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.062+0000 7f913d007640 1 -- start start 2024-04-25T09:57:03.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.063+0000 7f913d007640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f91380b5e60 0x7f913806bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:03.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.063+0000 7f913d007640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f91380b6a40 0x7f913806c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:03.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.063+0000 7f913d007640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f913806ca30 con 0x7f913815dd00 2024-04-25T09:57:03.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.063+0000 7f913d007640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f913815e0e0 con 0x7f91380b5e60 2024-04-25T09:57:03.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.063+0000 7f913d007640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f913806cfe0 con 0x7f91380b6a40 2024-04-25T09:57:03.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.063+0000 7f912ffff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f91380b5e60 0x7f913806bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:03.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.063+0000 7f912ffff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f91380b5e60 0x7f913806bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50044/0 (socket says 172.21.15.7:50044) 2024-04-25T09:57:03.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.063+0000 7f912ffff640 1 -- 172.21.15.7:0/2610178312 learned_addr learned my addr 172.21.15.7:0/2610178312 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:03.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.063+0000 7f913759e640 1 --2- 172.21.15.7:0/2610178312 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f91380b6a40 0x7f913806c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:03.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.063+0000 7f912ffff640 1 -- 172.21.15.7:0/2610178312 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f91380b6a40 msgr2=0x7f913806c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:03.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.063+0000 7f912ffff640 1 --2- 172.21.15.7:0/2610178312 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f91380b6a40 0x7f913806c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:03.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.063+0000 7f912ffff640 1 -- 172.21.15.7:0/2610178312 >> v1:172.21.15.55:6789/0 conn(0x7f913815dd00 legacy=0x7f91380b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:03.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.063+0000 7f912ffff640 1 -- 172.21.15.7:0/2610178312 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913806cd00 con 0x7f91380b5e60 2024-04-25T09:57:03.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.064+0000 7f912ffff640 1 --2- 172.21.15.7:0/2610178312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91380b5e60 0x7f913806bfb0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f9120009870 tx=0x7f912002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2053f7f45029b6f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:03.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.064+0000 7f913659c640 1 -- 172.21.15.7:0/2610178312 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9120037070 con 0x7f91380b5e60 2024-04-25T09:57:03.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.064+0000 7f913659c640 1 -- 172.21.15.7:0/2610178312 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912002ae50 con 0x7f91380b5e60 2024-04-25T09:57:03.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.064+0000 7f913659c640 1 -- 172.21.15.7:0/2610178312 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9120032860 con 0x7f91380b5e60 2024-04-25T09:57:03.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.064+0000 7f913d007640 1 -- 172.21.15.7:0/2610178312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91380b5e60 msgr2=0x7f913806bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:03.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.064+0000 7f913d007640 1 --2- 172.21.15.7:0/2610178312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91380b5e60 0x7f913806bfb0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f9120009870 tx=0x7f912002a300 comp rx=0 tx=0).stop 2024-04-25T09:57:03.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.064+0000 7f913d007640 1 -- 172.21.15.7:0/2610178312 shutdown_connections 2024-04-25T09:57:03.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.064+0000 7f913d007640 1 --2- 172.21.15.7:0/2610178312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91380b5e60 0x7f913806bfb0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:03.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.064+0000 7f913d007640 1 --2- 172.21.15.7:0/2610178312 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f91380b6a40 0x7f913806c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:03.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.064+0000 7f913d007640 1 -- 172.21.15.7:0/2610178312 >> 172.21.15.7:0/2610178312 conn(0x7f91380d07b0 msgr2=0x7f91380d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:03.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.064+0000 7f913d007640 1 -- 172.21.15.7:0/2610178312 shutdown_connections 2024-04-25T09:57:03.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.065+0000 7f913d007640 1 -- 172.21.15.7:0/2610178312 wait complete. 2024-04-25T09:57:03.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.066+0000 7f913d007640 1 Processor -- start 2024-04-25T09:57:03.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.066+0000 7f913d007640 1 -- start start 2024-04-25T09:57:03.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.066+0000 7f913d007640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f91380b5e60 0x7f91381f49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:03.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.066+0000 7f913d007640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91380b6a40 0x7f91381f38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:03.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.066+0000 7f913d007640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f913815dd00 0x7f9138158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:03.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.067+0000 7f913d007640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91380d2260 con 0x7f91380b6a40 2024-04-25T09:57:03.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.067+0000 7f913d007640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91380d1f80 con 0x7f913815dd00 2024-04-25T09:57:03.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.067+0000 7f913d007640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91380d2780 con 0x7f91380b5e60 2024-04-25T09:57:03.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.067+0000 7f912ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91380b6a40 0x7f91381f38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:03.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.067+0000 7f912ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91380b6a40 0x7f91381f38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50060/0 (socket says 172.21.15.7:50060) 2024-04-25T09:57:03.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.067+0000 7f912ffff640 1 -- 172.21.15.7:0/384830097 learned_addr learned my addr 172.21.15.7:0/384830097 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:03.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.067+0000 7f913759e640 1 --2- 172.21.15.7:0/384830097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f913815dd00 0x7f9138158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:03.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.067+0000 7f9136d9d640 1 --2- 172.21.15.7:0/384830097 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f91380b5e60 0x7f91381f49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:03.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.067+0000 7f912ffff640 1 -- 172.21.15.7:0/384830097 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f91380b5e60 msgr2=0x7f91381f49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:03.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.067+0000 7f912ffff640 1 --2- 172.21.15.7:0/384830097 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f91380b5e60 0x7f91381f49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:03.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.067+0000 7f912ffff640 1 -- 172.21.15.7:0/384830097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f913815dd00 msgr2=0x7f9138158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:03.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.067+0000 7f912ffff640 1 --2- 172.21.15.7:0/384830097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f913815dd00 0x7f9138158ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:03.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.067+0000 7f912ffff640 1 -- 172.21.15.7:0/384830097 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9138156bc0 con 0x7f91380b6a40 2024-04-25T09:57:03.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.067+0000 7f912ffff640 1 --2- 172.21.15.7:0/384830097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91380b6a40 0x7f91381f38f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9120000c00 tx=0x7f91200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:03.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.067+0000 7f912f7fe640 1 -- 172.21.15.7:0/384830097 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9120041070 con 0x7f91380b6a40 2024-04-25T09:57:03.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.067+0000 7f912f7fe640 1 -- 172.21.15.7:0/384830097 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912003c670 con 0x7f91380b6a40 2024-04-25T09:57:03.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.067+0000 7f913d007640 1 -- 172.21.15.7:0/384830097 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9138156ea0 con 0x7f91380b6a40 2024-04-25T09:57:03.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.067+0000 7f912f7fe640 1 -- 172.21.15.7:0/384830097 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9120037040 con 0x7f91380b6a40 2024-04-25T09:57:03.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.067+0000 7f913d007640 1 -- 172.21.15.7:0/384830097 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9138157460 con 0x7f91380b6a40 2024-04-25T09:57:03.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.068+0000 7f913d007640 1 -- 172.21.15.7:0/384830097 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9138067420 con 0x7f91380b6a40 2024-04-25T09:57:03.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.069+0000 7f912f7fe640 1 -- 172.21.15.7:0/384830097 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9120044070 con 0x7f91380b6a40 2024-04-25T09:57:03.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.069+0000 7f912f7fe640 1 --2- 172.21.15.7:0/384830097 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f911806b4d0 0x7f911806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:03.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.069+0000 7f912f7fe640 1 -- 172.21.15.7:0/384830097 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f91200aab80 con 0x7f91380b6a40 2024-04-25T09:57:03.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.069+0000 7f9136d9d640 1 --2- 172.21.15.7:0/384830097 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f911806b4d0 0x7f911806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:03.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.070+0000 7f9136d9d640 1 --2- 172.21.15.7:0/384830097 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f911806b4d0 0x7f911806d990 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f91280016e0 tx=0x7f9128009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:03.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.073+0000 7f912f7fe640 1 -- 172.21.15.7:0/384830097 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9138067420 con 0x7f91380b6a40 2024-04-25T09:57:03.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.292+0000 7f913d007640 1 -- 172.21.15.7:0/384830097 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9138073ce0 con 0x7f91380b6a40 2024-04-25T09:57:03.296 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-04-25T09:57:03.293+0000 7f45ad572640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:57:03.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.294+0000 7f912f7fe640 1 -- 172.21.15.7:0/384830097 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9138073ce0 con 0x7f91380b6a40 2024-04-25T09:57:03.297 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:57:03.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.298+0000 7f913d007640 1 -- 172.21.15.7:0/384830097 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f911806b4d0 msgr2=0x7f911806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:03.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.298+0000 7f913d007640 1 --2- 172.21.15.7:0/384830097 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f911806b4d0 0x7f911806d990 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f91280016e0 tx=0x7f9128009040 comp rx=0 tx=0).stop 2024-04-25T09:57:03.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.298+0000 7f913d007640 1 -- 172.21.15.7:0/384830097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91380b6a40 msgr2=0x7f91381f38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:03.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.298+0000 7f913d007640 1 --2- 172.21.15.7:0/384830097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91380b6a40 0x7f91381f38f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9120000c00 tx=0x7f91200046c0 comp rx=0 tx=0).stop 2024-04-25T09:57:03.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.298+0000 7f913d007640 1 -- 172.21.15.7:0/384830097 shutdown_connections 2024-04-25T09:57:03.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.298+0000 7f913d007640 1 --2- 172.21.15.7:0/384830097 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f911806b4d0 0x7f911806d990 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:03.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.298+0000 7f913d007640 1 --2- 172.21.15.7:0/384830097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f913815dd00 0x7f9138158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:03.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.298+0000 7f913d007640 1 --2- 172.21.15.7:0/384830097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91380b6a40 0x7f91381f38f0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:03.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.298+0000 7f913d007640 1 --2- 172.21.15.7:0/384830097 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f91380b5e60 0x7f91381f49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:03.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.298+0000 7f913d007640 1 -- 172.21.15.7:0/384830097 >> 172.21.15.7:0/384830097 conn(0x7f91380d07b0 msgr2=0x7f91380d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:03.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.298+0000 7f913d007640 1 -- 172.21.15.7:0/384830097 shutdown_connections 2024-04-25T09:57:03.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.298+0000 7f913d007640 1 -- 172.21.15.7:0/384830097 wait complete. 2024-04-25T09:57:03.305 INFO:tasks.ceph.mds.c.smithi007.stderr: -5786> 2024-04-25T09:56:21.056+0000 7fb7bac2e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:57:03.310 INFO:tasks.ceph.mds.c.smithi007.stderr: -3143> 2024-04-25T09:56:26.694+0000 7fb7b6c26640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5174=0-4194304@1} caps={5174=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5174 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x5654b949d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T09:57:03.316 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:57:03.340 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-04-25T09:57:03.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.419+0000 7fe67ee6f640 1 Processor -- start 2024-04-25T09:57:03.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.419+0000 7fe67ee6f640 1 -- start start 2024-04-25T09:57:03.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.420+0000 7fe67ee6f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe67815b7a0 0x7fe6780b1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:03.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.420+0000 7fe67ee6f640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6780b1e40 con 0x7fe6780cd580 2024-04-25T09:57:03.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.420+0000 7fe67ee6f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe678160250 con 0x7fe67806ab60 2024-04-25T09:57:03.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.420+0000 7fe67ee6f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6780d13e0 con 0x7fe67815b7a0 2024-04-25T09:57:03.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.420+0000 7fe67d40c640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe6780cd580 0x7fe67815fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56612/0 (socket says 172.21.15.7:56612) 2024-04-25T09:57:03.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.420+0000 7fe67d40c640 1 -- 172.21.15.7:0/1427443297 learned_addr learned my addr 172.21.15.7:0/1427443297 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:57:03.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.420+0000 7fe67cc0b640 1 --2- 172.21.15.7:0/1427443297 >> v2:172.21.15.55:3300/0 conn(0x7fe67815b7a0 0x7fe6780b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:03.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.421+0000 7fe6777fe640 1 -- 172.21.15.7:0/1427443297 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2598356169 0 0) 0x7fe670001490 con 0x7fe6780cd580 2024-04-25T09:57:03.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.421+0000 7fe6777fe640 1 -- 172.21.15.7:0/1427443297 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe660003520 con 0x7fe6780cd580 2024-04-25T09:57:03.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.421+0000 7fe6777fe640 1 -- 172.21.15.7:0/1427443297 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3676552667 0 0) 0x7fe678160250 con 0x7fe67806ab60 2024-04-25T09:57:03.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.421+0000 7fe6777fe640 1 -- 172.21.15.7:0/1427443297 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe670001490 con 0x7fe67806ab60 2024-04-25T09:57:03.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.421+0000 7fe67cc0b640 1 -- 172.21.15.7:0/1427443297 >> v1:172.21.15.55:6789/0 conn(0x7fe67806ab60 legacy=0x7fe67815f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:03.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.421+0000 7fe67cc0b640 1 -- 172.21.15.7:0/1427443297 >> v1:172.21.15.7:6789/0 conn(0x7fe6780cd580 legacy=0x7fe67815fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:03.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.421+0000 7fe67cc0b640 1 -- 172.21.15.7:0/1427443297 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6780d0860 con 0x7fe67815b7a0 2024-04-25T09:57:03.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.422+0000 7fe67cc0b640 1 --2- 172.21.15.7:0/1427443297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe67815b7a0 0x7fe6780b1900 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe6680097a0 tx=0x7fe66802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8efcf960c8f846e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:03.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.422+0000 7fe6777fe640 1 -- 172.21.15.7:0/1427443297 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe668037070 con 0x7fe67815b7a0 2024-04-25T09:57:03.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.422+0000 7fe6777fe640 1 -- 172.21.15.7:0/1427443297 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe668032440 con 0x7fe67815b7a0 2024-04-25T09:57:03.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.422+0000 7fe6777fe640 1 -- 172.21.15.7:0/1427443297 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6680327f0 con 0x7fe67815b7a0 2024-04-25T09:57:03.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.422+0000 7fe67ee6f640 1 -- 172.21.15.7:0/1427443297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe67815b7a0 msgr2=0x7fe6780b1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:03.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.422+0000 7fe67ee6f640 1 --2- 172.21.15.7:0/1427443297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe67815b7a0 0x7fe6780b1900 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe6680097a0 tx=0x7fe66802a230 comp rx=0 tx=0).stop 2024-04-25T09:57:03.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.422+0000 7fe67ee6f640 1 -- 172.21.15.7:0/1427443297 shutdown_connections 2024-04-25T09:57:03.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.422+0000 7fe67ee6f640 1 --2- 172.21.15.7:0/1427443297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe67815b7a0 0x7fe6780b1900 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:03.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.422+0000 7fe67ee6f640 1 -- 172.21.15.7:0/1427443297 >> 172.21.15.7:0/1427443297 conn(0x7fe6780725e0 msgr2=0x7fe6780999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:03.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.422+0000 7fe67ee6f640 1 -- 172.21.15.7:0/1427443297 shutdown_connections 2024-04-25T09:57:03.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.422+0000 7fe67ee6f640 1 -- 172.21.15.7:0/1427443297 wait complete. 2024-04-25T09:57:03.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.424+0000 7fe67ee6f640 1 Processor -- start 2024-04-25T09:57:03.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.424+0000 7fe67ee6f640 1 -- start start 2024-04-25T09:57:03.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.425+0000 7fe67ee6f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe67806ab60 0x7fe6780b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:03.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.425+0000 7fe67ee6f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6780cd580 0x7fe678156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:03.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.425+0000 7fe67ee6f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe67815b7a0 0x7fe6781f7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:03.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.425+0000 7fe67ee6f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6780d1100 con 0x7fe67806ab60 2024-04-25T09:57:03.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.425+0000 7fe67ee6f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6780d0e20 con 0x7fe67815b7a0 2024-04-25T09:57:03.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.425+0000 7fe67ee6f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6780d04f0 con 0x7fe6780cd580 2024-04-25T09:57:03.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.425+0000 7fe67cc0b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe67806ab60 0x7fe6780b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:03.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.425+0000 7fe67cc0b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe67806ab60 0x7fe6780b55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50082/0 (socket says 172.21.15.7:50082) 2024-04-25T09:57:03.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.425+0000 7fe67cc0b640 1 -- 172.21.15.7:0/1217191374 learned_addr learned my addr 172.21.15.7:0/1217191374 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:03.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.425+0000 7fe67cc0b640 1 -- 172.21.15.7:0/1217191374 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6780cd580 msgr2=0x7fe678156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:03.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.425+0000 7fe67cc0b640 1 --2- 172.21.15.7:0/1217191374 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6780cd580 0x7fe678156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:03.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.425+0000 7fe67cc0b640 1 -- 172.21.15.7:0/1217191374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe67815b7a0 msgr2=0x7fe6781f7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:03.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.425+0000 7fe67cc0b640 1 --2- 172.21.15.7:0/1217191374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe67815b7a0 0x7fe6781f7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:03.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.425+0000 7fe67cc0b640 1 -- 172.21.15.7:0/1217191374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6780b5bd0 con 0x7fe67806ab60 2024-04-25T09:57:03.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.425+0000 7fe67cc0b640 1 --2- 172.21.15.7:0/1217191374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe67806ab60 0x7fe6780b55f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fe66802a270 tx=0x7fe6680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:03.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.425+0000 7fe6757fa640 1 -- 172.21.15.7:0/1217191374 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe668041020 con 0x7fe67806ab60 2024-04-25T09:57:03.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.425+0000 7fe6757fa640 1 -- 172.21.15.7:0/1217191374 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66803d6e0 con 0x7fe67806ab60 2024-04-25T09:57:03.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.425+0000 7fe67ee6f640 1 -- 172.21.15.7:0/1217191374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6780b5eb0 con 0x7fe67806ab60 2024-04-25T09:57:03.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.425+0000 7fe6757fa640 1 -- 172.21.15.7:0/1217191374 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe668037040 con 0x7fe67806ab60 2024-04-25T09:57:03.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.426+0000 7fe67ee6f640 1 -- 172.21.15.7:0/1217191374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6781f7410 con 0x7fe67806ab60 2024-04-25T09:57:03.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.426+0000 7fe67ee6f640 1 -- 172.21.15.7:0/1217191374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe678068f60 con 0x7fe67806ab60 2024-04-25T09:57:03.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.427+0000 7fe6757fa640 1 -- 172.21.15.7:0/1217191374 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe668044020 con 0x7fe67806ab60 2024-04-25T09:57:03.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.427+0000 7fe6757fa640 1 --2- 172.21.15.7:0/1217191374 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe66406b4d0 0x7fe66406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:03.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.428+0000 7fe6757fa640 1 -- 172.21.15.7:0/1217191374 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fe6680aabd0 con 0x7fe67806ab60 2024-04-25T09:57:03.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.428+0000 7fe677fff640 1 --2- 172.21.15.7:0/1217191374 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe66406b4d0 0x7fe66406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:03.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.428+0000 7fe677fff640 1 --2- 172.21.15.7:0/1217191374 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe66406b4d0 0x7fe66406d990 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe66c0011e0 tx=0x7fe66c0078f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:03.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.433+0000 7fe6757fa640 1 -- 172.21.15.7:0/1217191374 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe66804b030 con 0x7fe67806ab60 2024-04-25T09:57:03.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:03.652+0000 7fe67ee6f640 1 -- 172.21.15.7:0/1217191374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe6780ca8b0 con 0x7fe67806ab60 2024-04-25T09:57:04.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.296+0000 7fe6757fa640 1 -- 172.21.15.7:0/1217191374 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe668079880 con 0x7fe67806ab60 2024-04-25T09:57:04.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.298+0000 7fe67ee6f640 1 -- 172.21.15.7:0/1217191374 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe66406b4d0 msgr2=0x7fe66406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:04.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.298+0000 7fe67ee6f640 1 --2- 172.21.15.7:0/1217191374 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe66406b4d0 0x7fe66406d990 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe66c0011e0 tx=0x7fe66c0078f0 comp rx=0 tx=0).stop 2024-04-25T09:57:04.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.298+0000 7fe67ee6f640 1 -- 172.21.15.7:0/1217191374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe67806ab60 msgr2=0x7fe6780b55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:04.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.298+0000 7fe67ee6f640 1 --2- 172.21.15.7:0/1217191374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe67806ab60 0x7fe6780b55f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fe66802a270 tx=0x7fe6680046c0 comp rx=0 tx=0).stop 2024-04-25T09:57:04.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.299+0000 7fe67ee6f640 1 -- 172.21.15.7:0/1217191374 shutdown_connections 2024-04-25T09:57:04.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.299+0000 7fe67ee6f640 1 --2- 172.21.15.7:0/1217191374 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe66406b4d0 0x7fe66406d990 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:04.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.299+0000 7fe67ee6f640 1 --2- 172.21.15.7:0/1217191374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe67815b7a0 0x7fe6781f7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:04.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.299+0000 7fe67ee6f640 1 --2- 172.21.15.7:0/1217191374 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6780cd580 0x7fe678156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:04.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.299+0000 7fe67ee6f640 1 --2- 172.21.15.7:0/1217191374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe67806ab60 0x7fe6780b55f0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:04.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.299+0000 7fe67ee6f640 1 -- 172.21.15.7:0/1217191374 >> 172.21.15.7:0/1217191374 conn(0x7fe6780725e0 msgr2=0x7fe67806e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:04.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.299+0000 7fe67ee6f640 1 -- 172.21.15.7:0/1217191374 shutdown_connections 2024-04-25T09:57:04.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.299+0000 7fe67ee6f640 1 -- 172.21.15.7:0/1217191374 wait complete. 2024-04-25T09:57:04.315 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:57:04.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.465+0000 7ffbadc1b640 1 Processor -- start 2024-04-25T09:57:04.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.466+0000 7ffbadc1b640 1 -- start start 2024-04-25T09:57:04.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.466+0000 7ffbadc1b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffba80cc9b0 0x7ffba815fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:04.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.466+0000 7ffbadc1b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffba8160190 0x7ffba806ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:04.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.466+0000 7ffbadc1b640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba8141a00 con 0x7ffba80b1ae0 2024-04-25T09:57:04.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.466+0000 7ffbadc1b640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffba80b1ec0 con 0x7ffba80cc9b0 2024-04-25T09:57:04.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.466+0000 7ffbadc1b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffba815f4e0 con 0x7ffba8160190 2024-04-25T09:57:04.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.467+0000 7ffba6ffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffba80cc9b0 0x7ffba815fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:04.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.467+0000 7ffba77fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ffba80b1ae0 0x7ffba8141230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56616/0 (socket says 172.21.15.7:56616) 2024-04-25T09:57:04.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.467+0000 7ffba77fe640 1 -- 172.21.15.7:0/2226620903 learned_addr learned my addr 172.21.15.7:0/2226620903 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:57:04.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.467+0000 7ffba7fff640 1 --2- 172.21.15.7:0/2226620903 >> v2:172.21.15.55:3300/0 conn(0x7ffba8160190 0x7ffba806ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:04.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.467+0000 7ffba6ffd640 1 -- 172.21.15.7:0/2226620903 >> v2:172.21.15.55:3300/0 conn(0x7ffba8160190 msgr2=0x7ffba806ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:04.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.467+0000 7ffba6ffd640 1 --2- 172.21.15.7:0/2226620903 >> v2:172.21.15.55:3300/0 conn(0x7ffba8160190 0x7ffba806ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:04.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.467+0000 7ffba6ffd640 1 -- 172.21.15.7:0/2226620903 >> v1:172.21.15.7:6789/0 conn(0x7ffba80b1ae0 legacy=0x7ffba8141230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:04.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.467+0000 7ffba67fc640 1 -- 172.21.15.7:0/2226620903 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 105541741 0 0) 0x7ffba8141a00 con 0x7ffba80b1ae0 2024-04-25T09:57:04.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.467+0000 7ffba6ffd640 1 -- 172.21.15.7:0/2226620903 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba8141ce0 con 0x7ffba80cc9b0 2024-04-25T09:57:04.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.467+0000 7ffba7fff640 1 --2- 172.21.15.7:0/2226620903 >> v2:172.21.15.55:3300/0 conn(0x7ffba8160190 0x7ffba806ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:57:04.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.468+0000 7ffba6ffd640 1 --2- 172.21.15.7:0/2226620903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba80cc9b0 0x7ffba815fc50 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ffba80cb8d0 tx=0x7ffb9c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=130b6e435ababf33 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:04.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.468+0000 7ffba67fc640 1 -- 172.21.15.7:0/2226620903 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c037070 con 0x7ffba80cc9b0 2024-04-25T09:57:04.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.468+0000 7ffba67fc640 1 -- 172.21.15.7:0/2226620903 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb9c032440 con 0x7ffba80cc9b0 2024-04-25T09:57:04.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.468+0000 7ffba67fc640 1 -- 172.21.15.7:0/2226620903 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c02ae60 con 0x7ffba80cc9b0 2024-04-25T09:57:04.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.468+0000 7ffbadc1b640 1 -- 172.21.15.7:0/2226620903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba80cc9b0 msgr2=0x7ffba815fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:04.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.468+0000 7ffbadc1b640 1 --2- 172.21.15.7:0/2226620903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba80cc9b0 0x7ffba815fc50 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ffba80cb8d0 tx=0x7ffb9c02a110 comp rx=0 tx=0).stop 2024-04-25T09:57:04.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.468+0000 7ffbadc1b640 1 -- 172.21.15.7:0/2226620903 shutdown_connections 2024-04-25T09:57:04.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.468+0000 7ffbadc1b640 1 --2- 172.21.15.7:0/2226620903 >> v2:172.21.15.55:3300/0 conn(0x7ffba8160190 0x7ffba806ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:04.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.468+0000 7ffbadc1b640 1 --2- 172.21.15.7:0/2226620903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba80cc9b0 0x7ffba815fc50 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:04.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.468+0000 7ffbadc1b640 1 -- 172.21.15.7:0/2226620903 >> 172.21.15.7:0/2226620903 conn(0x7ffba8072650 msgr2=0x7ffba80999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:04.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.468+0000 7ffbadc1b640 1 -- 172.21.15.7:0/2226620903 shutdown_connections 2024-04-25T09:57:04.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.468+0000 7ffbadc1b640 1 -- 172.21.15.7:0/2226620903 wait complete. 2024-04-25T09:57:04.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.470+0000 7ffbadc1b640 1 Processor -- start 2024-04-25T09:57:04.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.470+0000 7ffbadc1b640 1 -- start start 2024-04-25T09:57:04.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.470+0000 7ffbadc1b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffba80b1ae0 0x7ffba80c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:04.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.470+0000 7ffbadc1b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffba80cc9b0 0x7ffba81e6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:04.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.471+0000 7ffbadc1b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba8160190 0x7ffba80b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:04.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.471+0000 7ffbadc1b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba806b0a0 con 0x7ffba8160190 2024-04-25T09:57:04.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.471+0000 7ffbadc1b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba815f730 con 0x7ffba80cc9b0 2024-04-25T09:57:04.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.471+0000 7ffbadc1b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba806b220 con 0x7ffba80b1ae0 2024-04-25T09:57:04.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.471+0000 7ffba7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba8160190 0x7ffba80b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:04.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.471+0000 7ffba7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba8160190 0x7ffba80b33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50098/0 (socket says 172.21.15.7:50098) 2024-04-25T09:57:04.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.471+0000 7ffba7fff640 1 -- 172.21.15.7:0/657774639 learned_addr learned my addr 172.21.15.7:0/657774639 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:04.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.471+0000 7ffba7fff640 1 -- 172.21.15.7:0/657774639 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffba80b1ae0 msgr2=0x7ffba80c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:04.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.471+0000 7ffba7fff640 1 --2- 172.21.15.7:0/657774639 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffba80b1ae0 0x7ffba80c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:04.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.471+0000 7ffba7fff640 1 -- 172.21.15.7:0/657774639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffba80cc9b0 msgr2=0x7ffba81e6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:04.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.471+0000 7ffba7fff640 1 --2- 172.21.15.7:0/657774639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffba80cc9b0 0x7ffba81e6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:04.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.471+0000 7ffba7fff640 1 -- 172.21.15.7:0/657774639 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba81e7570 con 0x7ffba8160190 2024-04-25T09:57:04.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.471+0000 7ffba7fff640 1 --2- 172.21.15.7:0/657774639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba8160190 0x7ffba80b33a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ffba000ce40 tx=0x7ffba000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:04.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.471+0000 7ffb8ffff640 1 -- 172.21.15.7:0/657774639 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba0003b90 con 0x7ffba8160190 2024-04-25T09:57:04.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.471+0000 7ffb8ffff640 1 -- 172.21.15.7:0/657774639 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba0003d50 con 0x7ffba8160190 2024-04-25T09:57:04.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.471+0000 7ffbadc1b640 1 -- 172.21.15.7:0/657774639 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba81e7850 con 0x7ffba8160190 2024-04-25T09:57:04.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.471+0000 7ffb8ffff640 1 -- 172.21.15.7:0/657774639 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba0004260 con 0x7ffba8160190 2024-04-25T09:57:04.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.471+0000 7ffbadc1b640 1 -- 172.21.15.7:0/657774639 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba80c4f00 con 0x7ffba8160190 2024-04-25T09:57:04.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.472+0000 7ffbadc1b640 1 -- 172.21.15.7:0/657774639 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba80cb950 con 0x7ffba8160190 2024-04-25T09:57:04.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.473+0000 7ffb8ffff640 1 -- 172.21.15.7:0/657774639 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffba0004400 con 0x7ffba8160190 2024-04-25T09:57:04.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.473+0000 7ffb8ffff640 1 --2- 172.21.15.7:0/657774639 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ffb9406b500 0x7ffb9406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:04.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.473+0000 7ffb8ffff640 1 -- 172.21.15.7:0/657774639 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6187+0+0 (secure 0 0 0) 0x7ffba008ae00 con 0x7ffba8160190 2024-04-25T09:57:04.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.473+0000 7ffba77fe640 1 --2- 172.21.15.7:0/657774639 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ffb9406b500 0x7ffb9406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:04.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.474+0000 7ffba77fe640 1 --2- 172.21.15.7:0/657774639 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ffb9406b500 0x7ffb9406d9c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ffb98007fd0 tx=0x7ffb98007960 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:04.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.477+0000 7ffb8ffff640 1 -- 172.21.15.7:0/657774639 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffba80cb950 con 0x7ffba8160190 2024-04-25T09:57:04.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:04.657+0000 7ffbadc1b640 1 -- 172.21.15.7:0/657774639 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ffba8069040 con 0x7ffba8160190 2024-04-25T09:57:05.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.657+0000 7ffb8ffff640 1 -- 172.21.15.7:0/657774639 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v53) v1 ==== 181+0+0 (secure 0 0 0) 0x7ffba0059a00 con 0x7ffba8160190 2024-04-25T09:57:05.660 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:57:05.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.661+0000 7ffbadc1b640 1 -- 172.21.15.7:0/657774639 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ffb9406b500 msgr2=0x7ffb9406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:05.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.661+0000 7ffbadc1b640 1 --2- 172.21.15.7:0/657774639 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ffb9406b500 0x7ffb9406d9c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ffb98007fd0 tx=0x7ffb98007960 comp rx=0 tx=0).stop 2024-04-25T09:57:05.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.661+0000 7ffbadc1b640 1 -- 172.21.15.7:0/657774639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba8160190 msgr2=0x7ffba80b33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:05.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.661+0000 7ffbadc1b640 1 --2- 172.21.15.7:0/657774639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba8160190 0x7ffba80b33a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ffba000ce40 tx=0x7ffba000a710 comp rx=0 tx=0).stop 2024-04-25T09:57:05.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.661+0000 7ffbadc1b640 1 -- 172.21.15.7:0/657774639 shutdown_connections 2024-04-25T09:57:05.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.661+0000 7ffbadc1b640 1 --2- 172.21.15.7:0/657774639 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ffb9406b500 0x7ffb9406d9c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:05.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.661+0000 7ffbadc1b640 1 --2- 172.21.15.7:0/657774639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba8160190 0x7ffba80b33a0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:05.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.661+0000 7ffbadc1b640 1 --2- 172.21.15.7:0/657774639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffba80cc9b0 0x7ffba81e6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:05.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.661+0000 7ffbadc1b640 1 --2- 172.21.15.7:0/657774639 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffba80b1ae0 0x7ffba80c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:05.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.661+0000 7ffbadc1b640 1 -- 172.21.15.7:0/657774639 >> 172.21.15.7:0/657774639 conn(0x7ffba8072650 msgr2=0x7ffba80af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:05.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.661+0000 7ffbadc1b640 1 -- 172.21.15.7:0/657774639 shutdown_connections 2024-04-25T09:57:05.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.661+0000 7ffbadc1b640 1 -- 172.21.15.7:0/657774639 wait complete. 2024-04-25T09:57:05.683 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:57:05.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.790+0000 7fa9ca3a9640 1 Processor -- start 2024-04-25T09:57:05.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.790+0000 7fa9ca3a9640 1 -- start start 2024-04-25T09:57:05.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.791+0000 7fa9ca3a9640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa9c415d980 0x7fa9c4161520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:05.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.791+0000 7fa9ca3a9640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa9c40b9390 0x7fa9c40d1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:05.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.791+0000 7fa9ca3a9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9c4162450 con 0x7fa9c40d1f80 2024-04-25T09:57:05.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.791+0000 7fa9ca3a9640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9c4161bb0 con 0x7fa9c415d980 2024-04-25T09:57:05.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.791+0000 7fa9ca3a9640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c4161e90 con 0x7fa9c40b9390 2024-04-25T09:57:05.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.791+0000 7fa9c3fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa9c415d980 0x7fa9c4161520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:05.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.791+0000 7fa9c3fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa9c415d980 0x7fa9c4161520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50102/0 (socket says 172.21.15.7:50102) 2024-04-25T09:57:05.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.791+0000 7fa9c3fff640 1 -- 172.21.15.7:0/3233676245 learned_addr learned my addr 172.21.15.7:0/3233676245 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:05.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.791+0000 7fa9c37fe640 1 --2- 172.21.15.7:0/3233676245 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa9c40b9390 0x7fa9c40d1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:05.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.791+0000 7fa9c3fff640 1 -- 172.21.15.7:0/3233676245 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa9c40b9390 msgr2=0x7fa9c40d1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:05.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.791+0000 7fa9c3fff640 1 --2- 172.21.15.7:0/3233676245 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa9c40b9390 0x7fa9c40d1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:05.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.791+0000 7fa9c3fff640 1 -- 172.21.15.7:0/3233676245 >> v1:172.21.15.55:6789/0 conn(0x7fa9c40d1f80 legacy=0x7fa9c415e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:05.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.791+0000 7fa9c3fff640 1 -- 172.21.15.7:0/3233676245 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c4162170 con 0x7fa9c415d980 2024-04-25T09:57:05.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.792+0000 7fa9c3fff640 1 --2- 172.21.15.7:0/3233676245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9c415d980 0x7fa9c4161520 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8009870 tx=0x7fa9b802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f84d2dc544c8db1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:05.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.792+0000 7fa9c2ffd640 1 -- 172.21.15.7:0/3233676245 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b8037070 con 0x7fa9c415d980 2024-04-25T09:57:05.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.792+0000 7fa9c2ffd640 1 -- 172.21.15.7:0/3233676245 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b8032440 con 0x7fa9c415d980 2024-04-25T09:57:05.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.792+0000 7fa9c2ffd640 1 -- 172.21.15.7:0/3233676245 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b8032810 con 0x7fa9c415d980 2024-04-25T09:57:05.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.793+0000 7fa9ca3a9640 1 -- 172.21.15.7:0/3233676245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9c415d980 msgr2=0x7fa9c4161520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:05.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.793+0000 7fa9ca3a9640 1 --2- 172.21.15.7:0/3233676245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9c415d980 0x7fa9c4161520 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8009870 tx=0x7fa9b802a270 comp rx=0 tx=0).stop 2024-04-25T09:57:05.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.793+0000 7fa9ca3a9640 1 -- 172.21.15.7:0/3233676245 shutdown_connections 2024-04-25T09:57:05.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.793+0000 7fa9ca3a9640 1 --2- 172.21.15.7:0/3233676245 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa9c40b9390 0x7fa9c40d1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:05.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.793+0000 7fa9ca3a9640 1 --2- 172.21.15.7:0/3233676245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9c415d980 0x7fa9c4161520 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:05.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.793+0000 7fa9ca3a9640 1 -- 172.21.15.7:0/3233676245 >> 172.21.15.7:0/3233676245 conn(0x7fa9c406c3d0 msgr2=0x7fa9c406c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:05.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.793+0000 7fa9ca3a9640 1 -- 172.21.15.7:0/3233676245 shutdown_connections 2024-04-25T09:57:05.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.793+0000 7fa9ca3a9640 1 -- 172.21.15.7:0/3233676245 wait complete. 2024-04-25T09:57:05.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.794+0000 7fa9ca3a9640 1 Processor -- start 2024-04-25T09:57:05.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.794+0000 7fa9ca3a9640 1 -- start start 2024-04-25T09:57:05.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.795+0000 7fa9ca3a9640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa9c40b9390 0x7fa9c4153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:05.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.795+0000 7fa9ca3a9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9c40d1f80 0x7fa9c40c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:05.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.795+0000 7fa9ca3a9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9c415d980 0x7fa9c40caa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:05.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.795+0000 7fa9ca3a9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c415dd60 con 0x7fa9c415d980 2024-04-25T09:57:05.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.795+0000 7fa9ca3a9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c40b9820 con 0x7fa9c40d1f80 2024-04-25T09:57:05.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.795+0000 7fa9ca3a9640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c415ed00 con 0x7fa9c40b9390 2024-04-25T09:57:05.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.795+0000 7fa9c8946640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9c415d980 0x7fa9c40caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:05.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.795+0000 7fa9c8946640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9c415d980 0x7fa9c40caa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50108/0 (socket says 172.21.15.7:50108) 2024-04-25T09:57:05.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.795+0000 7fa9c8946640 1 -- 172.21.15.7:0/3673988555 learned_addr learned my addr 172.21.15.7:0/3673988555 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:05.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.795+0000 7fa9c3fff640 1 --2- 172.21.15.7:0/3673988555 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa9c40b9390 0x7fa9c4153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:05.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.795+0000 7fa9c37fe640 1 --2- 172.21.15.7:0/3673988555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9c40d1f80 0x7fa9c40c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:05.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.796+0000 7fa9c8946640 1 -- 172.21.15.7:0/3673988555 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa9c40b9390 msgr2=0x7fa9c4153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:05.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.796+0000 7fa9c8946640 1 --2- 172.21.15.7:0/3673988555 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa9c40b9390 0x7fa9c4153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:05.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.796+0000 7fa9c8946640 1 -- 172.21.15.7:0/3673988555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9c40d1f80 msgr2=0x7fa9c40c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:05.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.796+0000 7fa9c8946640 1 --2- 172.21.15.7:0/3673988555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9c40d1f80 0x7fa9c40c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:05.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.796+0000 7fa9c8946640 1 -- 172.21.15.7:0/3673988555 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c40cb470 con 0x7fa9c415d980 2024-04-25T09:57:05.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.796+0000 7fa9c37fe640 1 --2- 172.21.15.7:0/3673988555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9c40d1f80 0x7fa9c40c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:57:05.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.796+0000 7fa9c8946640 1 --2- 172.21.15.7:0/3673988555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9c415d980 0x7fa9c40caa20 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc00c7a0 tx=0x7fa9bc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:05.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.796+0000 7fa9c0ff9640 1 -- 172.21.15.7:0/3673988555 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc003b70 con 0x7fa9c415d980 2024-04-25T09:57:05.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.796+0000 7fa9c0ff9640 1 -- 172.21.15.7:0/3673988555 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9bc003d30 con 0x7fa9c415d980 2024-04-25T09:57:05.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.796+0000 7fa9c0ff9640 1 -- 172.21.15.7:0/3673988555 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc00aa90 con 0x7fa9c415d980 2024-04-25T09:57:05.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.796+0000 7fa9ca3a9640 1 -- 172.21.15.7:0/3673988555 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9c40cb750 con 0x7fa9c415d980 2024-04-25T09:57:05.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.796+0000 7fa9ca3a9640 1 -- 172.21.15.7:0/3673988555 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9c4152d40 con 0x7fa9c415d980 2024-04-25T09:57:05.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.797+0000 7fa9ca3a9640 1 -- 172.21.15.7:0/3673988555 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9c4069040 con 0x7fa9c415d980 2024-04-25T09:57:05.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.797+0000 7fa9c0ff9640 1 -- 172.21.15.7:0/3673988555 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa9bc00ac30 con 0x7fa9c415d980 2024-04-25T09:57:05.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.798+0000 7fa9c0ff9640 1 --2- 172.21.15.7:0/3673988555 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa9b006b4d0 0x7fa9b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:05.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.798+0000 7fa9c0ff9640 1 -- 172.21.15.7:0/3673988555 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5749+0+0 (secure 0 0 0) 0x7fa9bc08a050 con 0x7fa9c415d980 2024-04-25T09:57:05.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.798+0000 7fa9c3fff640 1 --2- 172.21.15.7:0/3673988555 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa9b006b4d0 0x7fa9b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:05.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.799+0000 7fa9c3fff640 1 --2- 172.21.15.7:0/3673988555 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa9b006b4d0 0x7fa9b006d990 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8034000 tx=0x7fa9b802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:05.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.802+0000 7fa9c0ff9640 1 -- 172.21.15.7:0/3673988555 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa9bc058f30 con 0x7fa9c415d980 2024-04-25T09:57:05.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:05.984+0000 7fa9ca3a9640 1 -- 172.21.15.7:0/3673988555 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa9c4160c30 con 0x7fa9c415d980 2024-04-25T09:57:06.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.672+0000 7fa9c0ff9640 1 -- 172.21.15.7:0/3673988555 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v54) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa9bc058830 con 0x7fa9c415d980 2024-04-25T09:57:06.676 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2024-04-25T09:57:06.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.676+0000 7fa9ca3a9640 1 -- 172.21.15.7:0/3673988555 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa9b006b4d0 msgr2=0x7fa9b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:06.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.676+0000 7fa9ca3a9640 1 --2- 172.21.15.7:0/3673988555 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa9b006b4d0 0x7fa9b006d990 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8034000 tx=0x7fa9b802e000 comp rx=0 tx=0).stop 2024-04-25T09:57:06.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.676+0000 7fa9ca3a9640 1 -- 172.21.15.7:0/3673988555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9c415d980 msgr2=0x7fa9c40caa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:06.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.676+0000 7fa9ca3a9640 1 --2- 172.21.15.7:0/3673988555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9c415d980 0x7fa9c40caa20 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc00c7a0 tx=0x7fa9bc00cc60 comp rx=0 tx=0).stop 2024-04-25T09:57:06.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.676+0000 7fa9ca3a9640 1 -- 172.21.15.7:0/3673988555 shutdown_connections 2024-04-25T09:57:06.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.676+0000 7fa9ca3a9640 1 --2- 172.21.15.7:0/3673988555 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa9b006b4d0 0x7fa9b006d990 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:06.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.676+0000 7fa9ca3a9640 1 --2- 172.21.15.7:0/3673988555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9c415d980 0x7fa9c40caa20 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:06.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.676+0000 7fa9ca3a9640 1 --2- 172.21.15.7:0/3673988555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9c40d1f80 0x7fa9c40c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:06.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.676+0000 7fa9ca3a9640 1 --2- 172.21.15.7:0/3673988555 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa9c40b9390 0x7fa9c4153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:06.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.676+0000 7fa9ca3a9640 1 -- 172.21.15.7:0/3673988555 >> 172.21.15.7:0/3673988555 conn(0x7fa9c406c3d0 msgr2=0x7fa9c40d2460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:06.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.677+0000 7fa9ca3a9640 1 -- 172.21.15.7:0/3673988555 shutdown_connections 2024-04-25T09:57:06.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.677+0000 7fa9ca3a9640 1 -- 172.21.15.7:0/3673988555 wait complete. 2024-04-25T09:57:06.694 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:57:06.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.800+0000 7ff3208b3640 1 Processor -- start 2024-04-25T09:57:06.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.800+0000 7ff3208b3640 1 -- start start 2024-04-25T09:57:06.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.801+0000 7ff3208b3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff31c0d3e70 0x7ff31c0ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:06.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.801+0000 7ff3208b3640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff31c0d1a40 con 0x7ff31c0b2c30 2024-04-25T09:57:06.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.801+0000 7ff3208b3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff31c0d1d20 con 0x7ff31c15deb0 2024-04-25T09:57:06.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.801+0000 7ff3208b3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff31c0d2000 con 0x7ff31c0d3e70 2024-04-25T09:57:06.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.801+0000 7ff313fff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff31c0b2c30 0x7ff31c0d3760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56620/0 (socket says 172.21.15.7:56620) 2024-04-25T09:57:06.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.801+0000 7ff313fff640 1 -- 172.21.15.7:0/610698078 learned_addr learned my addr 172.21.15.7:0/610698078 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:57:06.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.801+0000 7ff31ad9d640 1 --2- 172.21.15.7:0/610698078 >> v2:172.21.15.55:3300/0 conn(0x7ff31c0d3e70 0x7ff31c0ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:06.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.801+0000 7ff319d9b640 1 -- 172.21.15.7:0/610698078 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3297752471 0 0) 0x7ff31c0d1a40 con 0x7ff31c0b2c30 2024-04-25T09:57:06.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.801+0000 7ff319d9b640 1 -- 172.21.15.7:0/610698078 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff308003520 con 0x7ff31c0b2c30 2024-04-25T09:57:06.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.801+0000 7ff319d9b640 1 -- 172.21.15.7:0/610698078 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2819718959 0 0) 0x7ff31c0d1d20 con 0x7ff31c15deb0 2024-04-25T09:57:06.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.801+0000 7ff319d9b640 1 -- 172.21.15.7:0/610698078 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff31c0d1a40 con 0x7ff31c15deb0 2024-04-25T09:57:06.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.801+0000 7ff319d9b640 1 -- 172.21.15.7:0/610698078 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4124923983 0 0) 0x7ff308003520 con 0x7ff31c0b2c30 2024-04-25T09:57:06.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.801+0000 7ff319d9b640 1 -- 172.21.15.7:0/610698078 >> v2:172.21.15.55:3300/0 conn(0x7ff31c0d3e70 msgr2=0x7ff31c0ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:06.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.801+0000 7ff319d9b640 1 --2- 172.21.15.7:0/610698078 >> v2:172.21.15.55:3300/0 conn(0x7ff31c0d3e70 0x7ff31c0ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:06.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.801+0000 7ff319d9b640 1 -- 172.21.15.7:0/610698078 >> v1:172.21.15.55:6789/0 conn(0x7ff31c15deb0 legacy=0x7ff31c0b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:06.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.801+0000 7ff319d9b640 1 -- 172.21.15.7:0/610698078 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31c0d22e0 con 0x7ff31c0b2c30 2024-04-25T09:57:06.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.801+0000 7ff319d9b640 1 -- 172.21.15.7:0/610698078 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7ff3040015f0 con 0x7ff31c0b2c30 2024-04-25T09:57:06.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.801+0000 7ff319d9b640 1 -- 172.21.15.7:0/610698078 >> v1:172.21.15.7:6789/0 conn(0x7ff31c0b2c30 legacy=0x7ff31c0d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:06.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.801+0000 7ff319d9b640 1 --2- 172.21.15.7:0/610698078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff308003b90 0x7ff308003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:06.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.801+0000 7ff319d9b640 1 --2- 172.21.15.7:0/610698078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff308004800 0x7ff308004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:06.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.801+0000 7ff319d9b640 1 --2- 172.21.15.7:0/610698078 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff3080051c0 0x7ff30800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:06.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.801+0000 7ff319d9b640 1 -- 172.21.15.7:0/610698078 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c0d2000 con 0x7ff308003b90 2024-04-25T09:57:06.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.801+0000 7ff319d9b640 1 -- 172.21.15.7:0/610698078 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30800c090 con 0x7ff308004800 2024-04-25T09:57:06.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.801+0000 7ff319d9b640 1 -- 172.21.15.7:0/610698078 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff30800c290 con 0x7ff3080051c0 2024-04-25T09:57:06.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.802+0000 7ff31a59c640 1 --2- 172.21.15.7:0/610698078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff308003b90 0x7ff308003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:06.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.802+0000 7ff313fff640 1 --2- 172.21.15.7:0/610698078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff308004800 0x7ff308004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:06.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.802+0000 7ff31ad9d640 1 --2- 172.21.15.7:0/610698078 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff3080051c0 0x7ff30800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:06.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.802+0000 7ff31a59c640 1 -- 172.21.15.7:0/610698078 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff3080051c0 msgr2=0x7ff30800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:06.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.802+0000 7ff31a59c640 1 --2- 172.21.15.7:0/610698078 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff3080051c0 0x7ff30800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:06.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.802+0000 7ff31a59c640 1 -- 172.21.15.7:0/610698078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff308004800 msgr2=0x7ff308004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:06.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.802+0000 7ff31a59c640 1 --2- 172.21.15.7:0/610698078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff308004800 0x7ff308004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:06.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.802+0000 7ff31a59c640 1 -- 172.21.15.7:0/610698078 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff308003520 con 0x7ff308003b90 2024-04-25T09:57:06.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.802+0000 7ff313fff640 1 --2- 172.21.15.7:0/610698078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff308004800 0x7ff308004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:57:06.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.802+0000 7ff31ad9d640 1 -- 172.21.15.7:0/610698078 reap_dead start 2024-04-25T09:57:06.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.803+0000 7ff31a59c640 1 --2- 172.21.15.7:0/610698078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff308003b90 0x7ff308003f90 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7ff30c0018d0 tx=0x7ff308005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7674570fc632ee9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:06.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.803+0000 7ff319d9b640 1 -- 172.21.15.7:0/610698078 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c0014f0 con 0x7ff308003b90 2024-04-25T09:57:06.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.803+0000 7ff319d9b640 1 -- 172.21.15.7:0/610698078 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff30c0052d0 con 0x7ff308003b90 2024-04-25T09:57:06.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.803+0000 7ff319d9b640 1 -- 172.21.15.7:0/610698078 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c02ac60 con 0x7ff308003b90 2024-04-25T09:57:06.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.803+0000 7ff3208b3640 1 -- 172.21.15.7:0/610698078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff308003b90 msgr2=0x7ff308003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:06.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.803+0000 7ff3208b3640 1 --2- 172.21.15.7:0/610698078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff308003b90 0x7ff308003f90 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7ff30c0018d0 tx=0x7ff308005830 comp rx=0 tx=0).stop 2024-04-25T09:57:06.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.803+0000 7ff3208b3640 1 -- 172.21.15.7:0/610698078 shutdown_connections 2024-04-25T09:57:06.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.803+0000 7ff3208b3640 1 --2- 172.21.15.7:0/610698078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff308003b90 0x7ff308003f90 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:06.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.803+0000 7ff3208b3640 1 -- 172.21.15.7:0/610698078 >> 172.21.15.7:0/610698078 conn(0x7ff31c0726b0 msgr2=0x7ff31c072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:06.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.803+0000 7ff3208b3640 1 -- 172.21.15.7:0/610698078 shutdown_connections 2024-04-25T09:57:06.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.803+0000 7ff3208b3640 1 -- 172.21.15.7:0/610698078 wait complete. 2024-04-25T09:57:06.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.805+0000 7ff3208b3640 1 Processor -- start 2024-04-25T09:57:06.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.805+0000 7ff3208b3640 1 -- start start 2024-04-25T09:57:06.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.805+0000 7ff3208b3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff308003b90 0x7ff31c0ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:06.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.805+0000 7ff3208b3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff31c14f6a0 0x7ff31c0b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:06.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.805+0000 7ff3208b3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff31c0aa1a0 0x7ff31c0aa620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:06.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.805+0000 7ff3208b3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c0ce1b0 con 0x7ff31c14f6a0 2024-04-25T09:57:06.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.805+0000 7ff3208b3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c0ce030 con 0x7ff31c0aa1a0 2024-04-25T09:57:06.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.805+0000 7ff3208b3640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c0ce330 con 0x7ff308003b90 2024-04-25T09:57:06.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.806+0000 7ff313fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff31c14f6a0 0x7ff31c0b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:06.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.806+0000 7ff313fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff31c14f6a0 0x7ff31c0b1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50120/0 (socket says 172.21.15.7:50120) 2024-04-25T09:57:06.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.806+0000 7ff313fff640 1 -- 172.21.15.7:0/1507190521 learned_addr learned my addr 172.21.15.7:0/1507190521 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:06.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.806+0000 7ff31a59c640 1 --2- 172.21.15.7:0/1507190521 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff308003b90 0x7ff31c0ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:06.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.806+0000 7ff31ad9d640 1 --2- 172.21.15.7:0/1507190521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff31c0aa1a0 0x7ff31c0aa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:06.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.806+0000 7ff313fff640 1 -- 172.21.15.7:0/1507190521 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff308003b90 msgr2=0x7ff31c0ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:06.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.806+0000 7ff313fff640 1 --2- 172.21.15.7:0/1507190521 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff308003b90 0x7ff31c0ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:06.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.806+0000 7ff313fff640 1 -- 172.21.15.7:0/1507190521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff31c0aa1a0 msgr2=0x7ff31c0aa620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:06.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.806+0000 7ff313fff640 1 --2- 172.21.15.7:0/1507190521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff31c0aa1a0 0x7ff31c0aa620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:06.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.806+0000 7ff313fff640 1 -- 172.21.15.7:0/1507190521 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31c0cbcd0 con 0x7ff31c14f6a0 2024-04-25T09:57:06.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.806+0000 7ff31a59c640 1 --2- 172.21.15.7:0/1507190521 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff308003b90 0x7ff31c0ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:57:06.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.806+0000 7ff313fff640 1 --2- 172.21.15.7:0/1507190521 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff31c14f6a0 0x7ff31c0b1d40 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7ff30400e7b0 tx=0x7ff30400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:06.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.806+0000 7ff312ffd640 1 -- 172.21.15.7:0/1507190521 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30400c660 con 0x7ff31c14f6a0 2024-04-25T09:57:06.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.806+0000 7ff312ffd640 1 -- 172.21.15.7:0/1507190521 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff304018070 con 0x7ff31c14f6a0 2024-04-25T09:57:06.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.806+0000 7ff312ffd640 1 -- 172.21.15.7:0/1507190521 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30400ca00 con 0x7ff31c14f6a0 2024-04-25T09:57:06.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.806+0000 7ff3208b3640 1 -- 172.21.15.7:0/1507190521 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff31c0cbfb0 con 0x7ff31c14f6a0 2024-04-25T09:57:06.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.806+0000 7ff3208b3640 1 -- 172.21.15.7:0/1507190521 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff31c0cc570 con 0x7ff31c14f6a0 2024-04-25T09:57:06.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.807+0000 7ff3208b3640 1 -- 172.21.15.7:0/1507190521 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff31c068f60 con 0x7ff31c14f6a0 2024-04-25T09:57:06.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.808+0000 7ff312ffd640 1 -- 172.21.15.7:0/1507190521 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff30400cba0 con 0x7ff31c14f6a0 2024-04-25T09:57:06.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.808+0000 7ff312ffd640 1 --2- 172.21.15.7:0/1507190521 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff2fc06b4d0 0x7ff2fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:06.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.808+0000 7ff312ffd640 1 -- 172.21.15.7:0/1507190521 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5335+0+0 (secure 0 0 0) 0x7ff304089d30 con 0x7ff31c14f6a0 2024-04-25T09:57:06.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.808+0000 7ff31a59c640 1 --2- 172.21.15.7:0/1507190521 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff2fc06b4d0 0x7ff2fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:06.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.809+0000 7ff31a59c640 1 --2- 172.21.15.7:0/1507190521 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff2fc06b4d0 0x7ff2fc06d990 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff30c032000 tx=0x7ff30c009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:06.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.812+0000 7ff312ffd640 1 -- 172.21.15.7:0/1507190521 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff304058d20 con 0x7ff31c14f6a0 2024-04-25T09:57:06.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.992+0000 7ff3208b3640 1 -- 172.21.15.7:0/1507190521 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff31c0b6520 con 0x7ff31c14f6a0 2024-04-25T09:57:06.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.995+0000 7ff312ffd640 1 -- 172.21.15.7:0/1507190521 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff304058620 con 0x7ff31c14f6a0 2024-04-25T09:57:07.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.997+0000 7ff3208b3640 1 -- 172.21.15.7:0/1507190521 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff2fc06b4d0 msgr2=0x7ff2fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:07.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.997+0000 7ff3208b3640 1 --2- 172.21.15.7:0/1507190521 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff2fc06b4d0 0x7ff2fc06d990 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff30c032000 tx=0x7ff30c009030 comp rx=0 tx=0).stop 2024-04-25T09:57:07.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.998+0000 7ff3208b3640 1 -- 172.21.15.7:0/1507190521 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff31c14f6a0 msgr2=0x7ff31c0b1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:07.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.998+0000 7ff3208b3640 1 --2- 172.21.15.7:0/1507190521 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff31c14f6a0 0x7ff31c0b1d40 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7ff30400e7b0 tx=0x7ff30400ec70 comp rx=0 tx=0).stop 2024-04-25T09:57:07.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.998+0000 7ff3208b3640 1 -- 172.21.15.7:0/1507190521 shutdown_connections 2024-04-25T09:57:07.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.998+0000 7ff3208b3640 1 --2- 172.21.15.7:0/1507190521 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff2fc06b4d0 0x7ff2fc06d990 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:07.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.998+0000 7ff3208b3640 1 --2- 172.21.15.7:0/1507190521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff31c0aa1a0 0x7ff31c0aa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:07.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.998+0000 7ff3208b3640 1 --2- 172.21.15.7:0/1507190521 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff31c14f6a0 0x7ff31c0b1d40 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:07.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.998+0000 7ff3208b3640 1 --2- 172.21.15.7:0/1507190521 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff308003b90 0x7ff31c0ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:07.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.998+0000 7ff3208b3640 1 -- 172.21.15.7:0/1507190521 >> 172.21.15.7:0/1507190521 conn(0x7ff31c0726b0 msgr2=0x7ff31c0c7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:07.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.998+0000 7ff3208b3640 1 -- 172.21.15.7:0/1507190521 shutdown_connections 2024-04-25T09:57:07.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:06.998+0000 7ff3208b3640 1 -- 172.21.15.7:0/1507190521 wait complete. 2024-04-25T09:57:07.012 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2024-04-25T09:57:07.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.109+0000 7ff8ef67d640 1 Processor -- start 2024-04-25T09:57:07.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.110+0000 7ff8ef67d640 1 -- start start 2024-04-25T09:57:07.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.110+0000 7ff8ef67d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff8e815db00 0x7ff8e80d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:07.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.110+0000 7ff8ef67d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff8e80b53b0 0x7ff8e80d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:07.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.110+0000 7ff8ef67d640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e80d1e80 con 0x7ff8e80ce2b0 2024-04-25T09:57:07.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.110+0000 7ff8ef67d640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e80b5930 con 0x7ff8e80b53b0 2024-04-25T09:57:07.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.110+0000 7ff8ef67d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e80b5c10 con 0x7ff8e815db00 2024-04-25T09:57:07.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.110+0000 7ff8ecc18640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff8e80b53b0 0x7ff8e80d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:07.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.110+0000 7ff8edc1a640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff8e80ce2b0 0x7ff8e8161670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56626/0 (socket says 172.21.15.7:56626) 2024-04-25T09:57:07.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.110+0000 7ff8edc1a640 1 -- 172.21.15.7:0/1468896495 learned_addr learned my addr 172.21.15.7:0/1468896495 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:57:07.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.111+0000 7ff8ed419640 1 --2- 172.21.15.7:0/1468896495 >> v2:172.21.15.55:3300/0 conn(0x7ff8e815db00 0x7ff8e80d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:07.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.111+0000 7ff8ecc18640 1 -- 172.21.15.7:0/1468896495 >> v2:172.21.15.55:3300/0 conn(0x7ff8e815db00 msgr2=0x7ff8e80d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:07.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.111+0000 7ff8ecc18640 1 --2- 172.21.15.7:0/1468896495 >> v2:172.21.15.55:3300/0 conn(0x7ff8e815db00 0x7ff8e80d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:07.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.111+0000 7ff8ecc18640 1 -- 172.21.15.7:0/1468896495 >> v1:172.21.15.7:6789/0 conn(0x7ff8e80ce2b0 legacy=0x7ff8e8161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:07.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.111+0000 7ff8e7fff640 1 -- 172.21.15.7:0/1468896495 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2308802379 0 0) 0x7ff8e80d1e80 con 0x7ff8e80ce2b0 2024-04-25T09:57:07.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.111+0000 7ff8ecc18640 1 -- 172.21.15.7:0/1468896495 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e80b5ef0 con 0x7ff8e80b53b0 2024-04-25T09:57:07.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.111+0000 7ff8ecc18640 1 --2- 172.21.15.7:0/1468896495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8e80b53b0 0x7ff8e80d0880 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ff8e80d4940 tx=0x7ff8dc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc71c9975339fb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:07.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.112+0000 7ff8e7fff640 1 -- 172.21.15.7:0/1468896495 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc037070 con 0x7ff8e80b53b0 2024-04-25T09:57:07.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.112+0000 7ff8e7fff640 1 -- 172.21.15.7:0/1468896495 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8dc032440 con 0x7ff8e80b53b0 2024-04-25T09:57:07.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.112+0000 7ff8e7fff640 1 -- 172.21.15.7:0/1468896495 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc032810 con 0x7ff8e80b53b0 2024-04-25T09:57:07.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.112+0000 7ff8ef67d640 1 -- 172.21.15.7:0/1468896495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8e80b53b0 msgr2=0x7ff8e80d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:07.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.112+0000 7ff8ef67d640 1 --2- 172.21.15.7:0/1468896495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8e80b53b0 0x7ff8e80d0880 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ff8e80d4940 tx=0x7ff8dc02a1a0 comp rx=0 tx=0).stop 2024-04-25T09:57:07.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.112+0000 7ff8ef67d640 1 -- 172.21.15.7:0/1468896495 shutdown_connections 2024-04-25T09:57:07.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.112+0000 7ff8ef67d640 1 --2- 172.21.15.7:0/1468896495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8e80b53b0 0x7ff8e80d0880 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:07.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.112+0000 7ff8ef67d640 1 --2- 172.21.15.7:0/1468896495 >> v2:172.21.15.55:3300/0 conn(0x7ff8e815db00 0x7ff8e80d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:07.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.112+0000 7ff8ef67d640 1 -- 172.21.15.7:0/1468896495 >> 172.21.15.7:0/1468896495 conn(0x7ff8e8072290 msgr2=0x7ff8e80726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:07.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.112+0000 7ff8ef67d640 1 -- 172.21.15.7:0/1468896495 shutdown_connections 2024-04-25T09:57:07.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.112+0000 7ff8ef67d640 1 -- 172.21.15.7:0/1468896495 wait complete. 2024-04-25T09:57:07.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.113+0000 7ff8ef67d640 1 Processor -- start 2024-04-25T09:57:07.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.114+0000 7ff8ef67d640 1 -- start start 2024-04-25T09:57:07.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.114+0000 7ff8ef67d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8e80b53b0 0x7ff8e8160b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:07.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.114+0000 7ff8ef67d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8e80ce2b0 0x7ff8e815e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:07.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.114+0000 7ff8ef67d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8e815db00 0x7ff8e8149e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:07.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.114+0000 7ff8ef67d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e80d3660 con 0x7ff8e80b53b0 2024-04-25T09:57:07.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.114+0000 7ff8ef67d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e80b61d0 con 0x7ff8e80ce2b0 2024-04-25T09:57:07.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.114+0000 7ff8ef67d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e80b6c10 con 0x7ff8e815db00 2024-04-25T09:57:07.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.114+0000 7ff8ed419640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8e80b53b0 0x7ff8e8160b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:07.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.114+0000 7ff8ed419640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8e80b53b0 0x7ff8e8160b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50128/0 (socket says 172.21.15.7:50128) 2024-04-25T09:57:07.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.114+0000 7ff8ed419640 1 -- 172.21.15.7:0/328137653 learned_addr learned my addr 172.21.15.7:0/328137653 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:07.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.114+0000 7ff8ecc18640 1 --2- 172.21.15.7:0/328137653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8e80ce2b0 0x7ff8e815e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:07.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.114+0000 7ff8edc1a640 1 --2- 172.21.15.7:0/328137653 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8e815db00 0x7ff8e8149e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:07.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.115+0000 7ff8ed419640 1 -- 172.21.15.7:0/328137653 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8e815db00 msgr2=0x7ff8e8149e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:07.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.115+0000 7ff8ed419640 1 --2- 172.21.15.7:0/328137653 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8e815db00 0x7ff8e8149e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:07.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.115+0000 7ff8ed419640 1 -- 172.21.15.7:0/328137653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8e80ce2b0 msgr2=0x7ff8e815e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:07.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.115+0000 7ff8ed419640 1 --2- 172.21.15.7:0/328137653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8e80ce2b0 0x7ff8e815e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:07.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.115+0000 7ff8ed419640 1 -- 172.21.15.7:0/328137653 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e815e890 con 0x7ff8e80b53b0 2024-04-25T09:57:07.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.115+0000 7ff8edc1a640 1 --2- 172.21.15.7:0/328137653 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8e815db00 0x7ff8e8149e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:57:07.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.115+0000 7ff8ed419640 1 --2- 172.21.15.7:0/328137653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8e80b53b0 0x7ff8e8160b50 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7ff8e000d5d0 tx=0x7ff8e000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:07.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.115+0000 7ff8e5ffb640 1 -- 172.21.15.7:0/328137653 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e00125f0 con 0x7ff8e80b53b0 2024-04-25T09:57:07.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.115+0000 7ff8e5ffb640 1 -- 172.21.15.7:0/328137653 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e0019070 con 0x7ff8e80b53b0 2024-04-25T09:57:07.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.115+0000 7ff8e5ffb640 1 -- 172.21.15.7:0/328137653 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e00129f0 con 0x7ff8e80b53b0 2024-04-25T09:57:07.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.115+0000 7ff8ef67d640 1 -- 172.21.15.7:0/328137653 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e815eb70 con 0x7ff8e80b53b0 2024-04-25T09:57:07.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.115+0000 7ff8ef67d640 1 -- 172.21.15.7:0/328137653 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e815f130 con 0x7ff8e80b53b0 2024-04-25T09:57:07.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.116+0000 7ff8ef67d640 1 -- 172.21.15.7:0/328137653 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e8068fd0 con 0x7ff8e80b53b0 2024-04-25T09:57:07.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.116+0000 7ff8e5ffb640 1 -- 172.21.15.7:0/328137653 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff8e0012b90 con 0x7ff8e80b53b0 2024-04-25T09:57:07.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.117+0000 7ff8e5ffb640 1 --2- 172.21.15.7:0/328137653 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff8d406b4d0 0x7ff8d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:07.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.117+0000 7ff8ecc18640 1 --2- 172.21.15.7:0/328137653 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff8d406b4d0 0x7ff8d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:07.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.117+0000 7ff8e5ffb640 1 -- 172.21.15.7:0/328137653 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5335+0+0 (secure 0 0 0) 0x7ff8e008a410 con 0x7ff8e80b53b0 2024-04-25T09:57:07.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.118+0000 7ff8ecc18640 1 --2- 172.21.15.7:0/328137653 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff8d406b4d0 0x7ff8d406d990 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc034000 tx=0x7ff8dc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:07.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.121+0000 7ff8e5ffb640 1 -- 172.21.15.7:0/328137653 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff8e00593f0 con 0x7ff8e80b53b0 2024-04-25T09:57:07.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.369+0000 7ff8ef67d640 1 -- 172.21.15.7:0/328137653 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) v1 -- 0x7ff8e80d16b0 con 0x7ff8e80b53b0 2024-04-25T09:57:07.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.674+0000 7ff8e5ffb640 1 -- 172.21.15.7:0/328137653 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v160) v1 ==== 149+0+0 (secure 0 0 0) 0x7ff8e0058cf0 con 0x7ff8e80b53b0 2024-04-25T09:57:07.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.676+0000 7ff8ef67d640 1 -- 172.21.15.7:0/328137653 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff8d406b4d0 msgr2=0x7ff8d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:07.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.676+0000 7ff8ef67d640 1 --2- 172.21.15.7:0/328137653 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff8d406b4d0 0x7ff8d406d990 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc034000 tx=0x7ff8dc02e000 comp rx=0 tx=0).stop 2024-04-25T09:57:07.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.676+0000 7ff8ef67d640 1 -- 172.21.15.7:0/328137653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8e80b53b0 msgr2=0x7ff8e8160b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:07.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.676+0000 7ff8ef67d640 1 --2- 172.21.15.7:0/328137653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8e80b53b0 0x7ff8e8160b50 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7ff8e000d5d0 tx=0x7ff8e000da90 comp rx=0 tx=0).stop 2024-04-25T09:57:07.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.676+0000 7ff8ef67d640 1 -- 172.21.15.7:0/328137653 shutdown_connections 2024-04-25T09:57:07.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.676+0000 7ff8ef67d640 1 --2- 172.21.15.7:0/328137653 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff8d406b4d0 0x7ff8d406d990 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:07.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.676+0000 7ff8ef67d640 1 --2- 172.21.15.7:0/328137653 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8e815db00 0x7ff8e8149e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:07.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.676+0000 7ff8ef67d640 1 --2- 172.21.15.7:0/328137653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8e80ce2b0 0x7ff8e815e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:07.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.676+0000 7ff8ef67d640 1 --2- 172.21.15.7:0/328137653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8e80b53b0 0x7ff8e8160b50 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:07.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.676+0000 7ff8ef67d640 1 -- 172.21.15.7:0/328137653 >> 172.21.15.7:0/328137653 conn(0x7ff8e8072290 msgr2=0x7ff8e80b7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:07.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.676+0000 7ff8ef67d640 1 -- 172.21.15.7:0/328137653 shutdown_connections 2024-04-25T09:57:07.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.676+0000 7ff8ef67d640 1 -- 172.21.15.7:0/328137653 wait complete. 2024-04-25T09:57:07.691 INFO:tasks.cephfs_test_runner:That the MDS can repair an inodes backtrace in the data pool ... ok 2024-04-25T09:57:07.691 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-04-25T09:57:07.691 INFO:tasks.cephfs_test_runner:test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T09:57:07.692 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:57:07.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.790+0000 7f6964b89640 1 Processor -- start 2024-04-25T09:57:07.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.790+0000 7f6964b89640 1 -- start start 2024-04-25T09:57:07.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.791+0000 7f6964b89640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f696015da50 0x7f69600cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:07.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.791+0000 7f6964b89640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f696015de30 0x7f696015e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:07.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.791+0000 7f6964b89640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69600ce2b0 con 0x7f69600d0280 2024-04-25T09:57:07.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.791+0000 7f6964b89640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f696015e960 con 0x7f696015de30 2024-04-25T09:57:07.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.791+0000 7f6964b89640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696015ec40 con 0x7f696015da50 2024-04-25T09:57:07.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.791+0000 7f695dd9b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f696015de30 0x7f696015e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:07.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.791+0000 7f695dd9b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f696015de30 0x7f696015e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50138/0 (socket says 172.21.15.7:50138) 2024-04-25T09:57:07.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.791+0000 7f695dd9b640 1 -- 172.21.15.7:0/2333865179 learned_addr learned my addr 172.21.15.7:0/2333865179 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:07.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.792+0000 7f695dd9b640 1 -- 172.21.15.7:0/2333865179 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f696015da50 msgr2=0x7f69600cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:07.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.792+0000 7f695dd9b640 1 --2- 172.21.15.7:0/2333865179 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f696015da50 0x7f69600cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:07.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.792+0000 7f695dd9b640 1 -- 172.21.15.7:0/2333865179 >> v1:172.21.15.55:6789/0 conn(0x7f69600d0280 legacy=0x7f69600d1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:07.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.792+0000 7f695dd9b640 1 -- 172.21.15.7:0/2333865179 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69600ce570 con 0x7f696015de30 2024-04-25T09:57:07.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.792+0000 7f695dd9b640 1 --2- 172.21.15.7:0/2333865179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f696015de30 0x7f696015e290 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f6948009870 tx=0x7f694802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb6c47e5161b0ce0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:07.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.793+0000 7f695d59a640 1 -- 172.21.15.7:0/2333865179 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6948037070 con 0x7f696015de30 2024-04-25T09:57:07.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.793+0000 7f695d59a640 1 -- 172.21.15.7:0/2333865179 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6948032440 con 0x7f696015de30 2024-04-25T09:57:07.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.793+0000 7f695d59a640 1 -- 172.21.15.7:0/2333865179 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6948032810 con 0x7f696015de30 2024-04-25T09:57:07.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.793+0000 7f6964b89640 1 -- 172.21.15.7:0/2333865179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f696015de30 msgr2=0x7f696015e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:07.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.793+0000 7f6964b89640 1 --2- 172.21.15.7:0/2333865179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f696015de30 0x7f696015e290 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f6948009870 tx=0x7f694802a210 comp rx=0 tx=0).stop 2024-04-25T09:57:07.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.793+0000 7f6964b89640 1 -- 172.21.15.7:0/2333865179 shutdown_connections 2024-04-25T09:57:07.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.793+0000 7f6964b89640 1 --2- 172.21.15.7:0/2333865179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f696015de30 0x7f696015e290 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:07.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.793+0000 7f6964b89640 1 --2- 172.21.15.7:0/2333865179 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f696015da50 0x7f69600cea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:07.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.793+0000 7f6964b89640 1 -- 172.21.15.7:0/2333865179 >> 172.21.15.7:0/2333865179 conn(0x7f6960072290 msgr2=0x7f6960072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:07.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.793+0000 7f6964b89640 1 -- 172.21.15.7:0/2333865179 shutdown_connections 2024-04-25T09:57:07.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.793+0000 7f6964b89640 1 -- 172.21.15.7:0/2333865179 wait complete. 2024-04-25T09:57:07.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.795+0000 7f6964b89640 1 Processor -- start 2024-04-25T09:57:07.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.795+0000 7f6964b89640 1 -- start start 2024-04-25T09:57:07.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.795+0000 7f6964b89640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69600d0280 0x7f69600c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:07.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.795+0000 7f6964b89640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f696015da50 0x7f69600cd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:07.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.795+0000 7f6964b89640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f696015de30 0x7f696015abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:07.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.795+0000 7f6964b89640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69601617c0 con 0x7f696015de30 2024-04-25T09:57:07.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.795+0000 7f6964b89640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6960161640 con 0x7f69600d0280 2024-04-25T09:57:07.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.795+0000 7f6964b89640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69600d2450 con 0x7f696015da50 2024-04-25T09:57:07.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.795+0000 7f695ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f696015de30 0x7f696015abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:07.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.795+0000 7f695ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f696015de30 0x7f696015abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50144/0 (socket says 172.21.15.7:50144) 2024-04-25T09:57:07.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.795+0000 7f695ed9d640 1 -- 172.21.15.7:0/582500493 learned_addr learned my addr 172.21.15.7:0/582500493 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:07.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.796+0000 7f695dd9b640 1 --2- 172.21.15.7:0/582500493 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f696015da50 0x7f69600cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:07.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.796+0000 7f695e59c640 1 --2- 172.21.15.7:0/582500493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69600d0280 0x7f69600c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:07.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.796+0000 7f695ed9d640 1 -- 172.21.15.7:0/582500493 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f696015da50 msgr2=0x7f69600cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:07.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.796+0000 7f695ed9d640 1 --2- 172.21.15.7:0/582500493 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f696015da50 0x7f69600cd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:07.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.796+0000 7f695ed9d640 1 -- 172.21.15.7:0/582500493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69600d0280 msgr2=0x7f69600c7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:07.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.796+0000 7f695ed9d640 1 --2- 172.21.15.7:0/582500493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69600d0280 0x7f69600c7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:07.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.796+0000 7f695ed9d640 1 -- 172.21.15.7:0/582500493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69600cd790 con 0x7f696015de30 2024-04-25T09:57:07.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.796+0000 7f695ed9d640 1 --2- 172.21.15.7:0/582500493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f696015de30 0x7f696015abb0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f695000c7b0 tx=0x7f695000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:07.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.796+0000 7f6956ffd640 1 -- 172.21.15.7:0/582500493 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6950017070 con 0x7f696015de30 2024-04-25T09:57:07.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.796+0000 7f6956ffd640 1 -- 172.21.15.7:0/582500493 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6950003da0 con 0x7f696015de30 2024-04-25T09:57:07.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.796+0000 7f6956ffd640 1 -- 172.21.15.7:0/582500493 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69500052b0 con 0x7f696015de30 2024-04-25T09:57:07.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.796+0000 7f6964b89640 1 -- 172.21.15.7:0/582500493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69600c8b30 con 0x7f696015de30 2024-04-25T09:57:07.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.796+0000 7f6964b89640 1 -- 172.21.15.7:0/582500493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69600c8570 con 0x7f696015de30 2024-04-25T09:57:07.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.797+0000 7f6964b89640 1 -- 172.21.15.7:0/582500493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6960068fd0 con 0x7f696015de30 2024-04-25T09:57:07.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.798+0000 7f6956ffd640 1 -- 172.21.15.7:0/582500493 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f695001a070 con 0x7f696015de30 2024-04-25T09:57:07.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.798+0000 7f6956ffd640 1 --2- 172.21.15.7:0/582500493 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f694006b4d0 0x7f694006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:07.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.798+0000 7f695e59c640 1 --2- 172.21.15.7:0/582500493 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f694006b4d0 0x7f694006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:07.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.798+0000 7f6956ffd640 1 -- 172.21.15.7:0/582500493 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f69500896d0 con 0x7f696015de30 2024-04-25T09:57:07.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.799+0000 7f695e59c640 1 --2- 172.21.15.7:0/582500493 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f694006b4d0 0x7f694006d990 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6958009890 tx=0x7f6958008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:07.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.803+0000 7f6956ffd640 1 -- 172.21.15.7:0/582500493 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f69600cd790 con 0x7f696015de30 2024-04-25T09:57:07.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.989+0000 7f6964b89640 1 -- 172.21.15.7:0/582500493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69600ced30 con 0x7f696015de30 2024-04-25T09:57:07.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.989+0000 7f6956ffd640 1 -- 172.21.15.7:0/582500493 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+13195 (secure 0 0 0) 0x7f69500586c0 con 0x7f696015de30 2024-04-25T09:57:07.993 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:57:07.993 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":54,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:57:06.664956+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6836/2232311564":"2024-04-26T09:57:03.294041+0000","172.21.15.7:6835/2232311564":"2024-04-26T09:57:03.294041+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:57:07.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.991+0000 7f6964b89640 1 -- 172.21.15.7:0/582500493 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f694006b4d0 msgr2=0x7f694006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:07.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.991+0000 7f6964b89640 1 --2- 172.21.15.7:0/582500493 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f694006b4d0 0x7f694006d990 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6958009890 tx=0x7f6958008040 comp rx=0 tx=0).stop 2024-04-25T09:57:07.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.991+0000 7f6964b89640 1 -- 172.21.15.7:0/582500493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f696015de30 msgr2=0x7f696015abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:07.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.991+0000 7f6964b89640 1 --2- 172.21.15.7:0/582500493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f696015de30 0x7f696015abb0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f695000c7b0 tx=0x7f695000cc70 comp rx=0 tx=0).stop 2024-04-25T09:57:07.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.991+0000 7f6964b89640 1 -- 172.21.15.7:0/582500493 shutdown_connections 2024-04-25T09:57:07.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.991+0000 7f6964b89640 1 --2- 172.21.15.7:0/582500493 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f694006b4d0 0x7f694006d990 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:07.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.991+0000 7f6964b89640 1 --2- 172.21.15.7:0/582500493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f696015de30 0x7f696015abb0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:07.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.991+0000 7f6964b89640 1 --2- 172.21.15.7:0/582500493 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f696015da50 0x7f69600cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:07.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.991+0000 7f6964b89640 1 --2- 172.21.15.7:0/582500493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69600d0280 0x7f69600c7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:07.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.991+0000 7f6964b89640 1 -- 172.21.15.7:0/582500493 >> 172.21.15.7:0/582500493 conn(0x7f6960072290 msgr2=0x7f696015c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:07.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.991+0000 7f6964b89640 1 -- 172.21.15.7:0/582500493 shutdown_connections 2024-04-25T09:57:07.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:07.991+0000 7f6964b89640 1 -- 172.21.15.7:0/582500493 wait complete. 2024-04-25T09:57:08.006 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:57:08.006 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:57:08.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.106+0000 7efc2fa9e640 1 Processor -- start 2024-04-25T09:57:08.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.107+0000 7efc2fa9e640 1 -- start start 2024-04-25T09:57:08.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.107+0000 7efc2fa9e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efc280cfc40 0x7efc280d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:08.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.107+0000 7efc2fa9e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efc280cc580 0x7efc280cca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:08.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.107+0000 7efc2fa9e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc280b25e0 con 0x7efc280b1480 2024-04-25T09:57:08.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.107+0000 7efc2fa9e640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc2815bec0 con 0x7efc280cfc40 2024-04-25T09:57:08.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.107+0000 7efc2fa9e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc280d0560 con 0x7efc280cc580 2024-04-25T09:57:08.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.107+0000 7efc2d83a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efc280cfc40 0x7efc280d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:08.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.107+0000 7efc2d83a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efc280cfc40 0x7efc280d0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50154/0 (socket says 172.21.15.7:50154) 2024-04-25T09:57:08.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.108+0000 7efc2d83a640 1 -- 172.21.15.7:0/3568213764 learned_addr learned my addr 172.21.15.7:0/3568213764 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:08.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.108+0000 7efc2e03b640 1 --2- 172.21.15.7:0/3568213764 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efc280cc580 0x7efc280cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:08.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.108+0000 7efc2d83a640 1 -- 172.21.15.7:0/3568213764 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efc280cc580 msgr2=0x7efc280cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:08.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.108+0000 7efc2d83a640 1 --2- 172.21.15.7:0/3568213764 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efc280cc580 0x7efc280cca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:08.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.108+0000 7efc2d83a640 1 -- 172.21.15.7:0/3568213764 >> v1:172.21.15.55:6789/0 conn(0x7efc280b1480 legacy=0x7efc280b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:08.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.108+0000 7efc2d83a640 1 -- 172.21.15.7:0/3568213764 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc280b19d0 con 0x7efc280cfc40 2024-04-25T09:57:08.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.108+0000 7efc2d83a640 1 --2- 172.21.15.7:0/3568213764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc280cfc40 0x7efc280d0020 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7efc18009e50 tx=0x7efc1802a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c85a88bc3e2cbca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:08.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.109+0000 7efc2c838640 1 -- 172.21.15.7:0/3568213764 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc18036070 con 0x7efc280cfc40 2024-04-25T09:57:08.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.109+0000 7efc2c838640 1 -- 172.21.15.7:0/3568213764 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc18031600 con 0x7efc280cfc40 2024-04-25T09:57:08.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.109+0000 7efc2c838640 1 -- 172.21.15.7:0/3568213764 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc180319d0 con 0x7efc280cfc40 2024-04-25T09:57:08.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.109+0000 7efc2fa9e640 1 -- 172.21.15.7:0/3568213764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc280cfc40 msgr2=0x7efc280d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:08.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.109+0000 7efc2fa9e640 1 --2- 172.21.15.7:0/3568213764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc280cfc40 0x7efc280d0020 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7efc18009e50 tx=0x7efc1802a630 comp rx=0 tx=0).stop 2024-04-25T09:57:08.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.109+0000 7efc2fa9e640 1 -- 172.21.15.7:0/3568213764 shutdown_connections 2024-04-25T09:57:08.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.109+0000 7efc2fa9e640 1 --2- 172.21.15.7:0/3568213764 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efc280cc580 0x7efc280cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:08.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.109+0000 7efc2fa9e640 1 --2- 172.21.15.7:0/3568213764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc280cfc40 0x7efc280d0020 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:08.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.109+0000 7efc2fa9e640 1 -- 172.21.15.7:0/3568213764 >> 172.21.15.7:0/3568213764 conn(0x7efc2808af80 msgr2=0x7efc2808b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:08.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.109+0000 7efc2fa9e640 1 -- 172.21.15.7:0/3568213764 shutdown_connections 2024-04-25T09:57:08.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.109+0000 7efc2fa9e640 1 -- 172.21.15.7:0/3568213764 wait complete. 2024-04-25T09:57:08.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.110+0000 7efc2fa9e640 1 Processor -- start 2024-04-25T09:57:08.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.110+0000 7efc2fa9e640 1 -- start start 2024-04-25T09:57:08.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.111+0000 7efc2fa9e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efc280b1480 0x7efc28154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:08.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.111+0000 7efc2fa9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc280cc580 0x7efc280afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:08.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.111+0000 7efc2fa9e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc280cfc40 0x7efc280b0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:08.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.111+0000 7efc2fa9e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc280b2270 con 0x7efc280cfc40 2024-04-25T09:57:08.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.111+0000 7efc2fa9e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc280b1f90 con 0x7efc280cc580 2024-04-25T09:57:08.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.111+0000 7efc2fa9e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc280ccf50 con 0x7efc280b1480 2024-04-25T09:57:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.111+0000 7efc2e03b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc280cfc40 0x7efc280b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.111+0000 7efc2e03b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc280cfc40 0x7efc280b0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50168/0 (socket says 172.21.15.7:50168) 2024-04-25T09:57:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.111+0000 7efc2e03b640 1 -- 172.21.15.7:0/3738142804 learned_addr learned my addr 172.21.15.7:0/3738142804 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.111+0000 7efc2d83a640 1 --2- 172.21.15.7:0/3738142804 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efc280b1480 0x7efc28154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.111+0000 7efc2d039640 1 --2- 172.21.15.7:0/3738142804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc280cc580 0x7efc280afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.112+0000 7efc2e03b640 1 -- 172.21.15.7:0/3738142804 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efc280b1480 msgr2=0x7efc28154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.112+0000 7efc2e03b640 1 --2- 172.21.15.7:0/3738142804 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efc280b1480 0x7efc28154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.112+0000 7efc2e03b640 1 -- 172.21.15.7:0/3738142804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc280cc580 msgr2=0x7efc280afc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.112+0000 7efc2e03b640 1 --2- 172.21.15.7:0/3738142804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc280cc580 0x7efc280afc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.112+0000 7efc2e03b640 1 -- 172.21.15.7:0/3738142804 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc280b6260 con 0x7efc280cfc40 2024-04-25T09:57:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.112+0000 7efc2e03b640 1 --2- 172.21.15.7:0/3738142804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc280cfc40 0x7efc280b0170 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7efc2000c7f0 tx=0x7efc2000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.112+0000 7efc267fc640 1 -- 172.21.15.7:0/3738142804 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc20015070 con 0x7efc280cfc40 2024-04-25T09:57:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.112+0000 7efc267fc640 1 -- 172.21.15.7:0/3738142804 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc20004220 con 0x7efc280cfc40 2024-04-25T09:57:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.112+0000 7efc2fa9e640 1 -- 172.21.15.7:0/3738142804 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc280b59c0 con 0x7efc280cfc40 2024-04-25T09:57:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.112+0000 7efc267fc640 1 -- 172.21.15.7:0/3738142804 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc20007620 con 0x7efc280cfc40 2024-04-25T09:57:08.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.112+0000 7efc2fa9e640 1 -- 172.21.15.7:0/3738142804 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc280b5f80 con 0x7efc280cfc40 2024-04-25T09:57:08.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.113+0000 7efc2fa9e640 1 -- 172.21.15.7:0/3738142804 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc28068f60 con 0x7efc280cfc40 2024-04-25T09:57:08.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.114+0000 7efc267fc640 1 -- 172.21.15.7:0/3738142804 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efc200077c0 con 0x7efc280cfc40 2024-04-25T09:57:08.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.114+0000 7efc267fc640 1 --2- 172.21.15.7:0/3738142804 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efc1406b4d0 0x7efc1406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:08.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.114+0000 7efc267fc640 1 -- 172.21.15.7:0/3738142804 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5335+0+0 (secure 0 0 0) 0x7efc20089df0 con 0x7efc280cfc40 2024-04-25T09:57:08.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.114+0000 7efc2d83a640 1 --2- 172.21.15.7:0/3738142804 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efc1406b4d0 0x7efc1406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:08.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.115+0000 7efc2d83a640 1 --2- 172.21.15.7:0/3738142804 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efc1406b4d0 0x7efc1406d990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7efc18033000 tx=0x7efc18009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:08.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.118+0000 7efc267fc640 1 -- 172.21.15.7:0/3738142804 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efc20058790 con 0x7efc280cfc40 2024-04-25T09:57:08.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.301+0000 7efc2fa9e640 1 -- 172.21.15.7:0/3738142804 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efc2806e130 con 0x7efc280cfc40 2024-04-25T09:57:08.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.302+0000 7efc267fc640 1 -- 172.21.15.7:0/3738142804 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7efc2005c830 con 0x7efc280cfc40 2024-04-25T09:57:08.306 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T09:57:08.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.304+0000 7efc2fa9e640 1 -- 172.21.15.7:0/3738142804 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efc1406b4d0 msgr2=0x7efc1406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:08.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.304+0000 7efc2fa9e640 1 --2- 172.21.15.7:0/3738142804 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efc1406b4d0 0x7efc1406d990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7efc18033000 tx=0x7efc18009000 comp rx=0 tx=0).stop 2024-04-25T09:57:08.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.304+0000 7efc2fa9e640 1 -- 172.21.15.7:0/3738142804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc280cfc40 msgr2=0x7efc280b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:08.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.304+0000 7efc2fa9e640 1 --2- 172.21.15.7:0/3738142804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc280cfc40 0x7efc280b0170 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7efc2000c7f0 tx=0x7efc2000ccb0 comp rx=0 tx=0).stop 2024-04-25T09:57:08.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.304+0000 7efc2fa9e640 1 -- 172.21.15.7:0/3738142804 shutdown_connections 2024-04-25T09:57:08.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.304+0000 7efc2fa9e640 1 --2- 172.21.15.7:0/3738142804 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efc1406b4d0 0x7efc1406d990 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:08.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.304+0000 7efc2fa9e640 1 --2- 172.21.15.7:0/3738142804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc280cfc40 0x7efc280b0170 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:08.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.304+0000 7efc2fa9e640 1 --2- 172.21.15.7:0/3738142804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc280cc580 0x7efc280afc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:08.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.304+0000 7efc2fa9e640 1 --2- 172.21.15.7:0/3738142804 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efc280b1480 0x7efc28154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:08.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.304+0000 7efc2fa9e640 1 -- 172.21.15.7:0/3738142804 >> 172.21.15.7:0/3738142804 conn(0x7efc2808af80 msgr2=0x7efc2806f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:08.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.304+0000 7efc2fa9e640 1 -- 172.21.15.7:0/3738142804 shutdown_connections 2024-04-25T09:57:08.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.304+0000 7efc2fa9e640 1 -- 172.21.15.7:0/3738142804 wait complete. 2024-04-25T09:57:08.318 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2024-04-25T09:57:08.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.415+0000 7f7c6e934640 1 Processor -- start 2024-04-25T09:57:08.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.415+0000 7f7c6e934640 1 -- start start 2024-04-25T09:57:08.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.416+0000 7f7c6e934640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7c6806ab60 0x7f7c680b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:08.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.416+0000 7f7c6e934640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7c6815dc60 0x7f7c6806af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:08.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.416+0000 7f7c6e934640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c680b5a20 con 0x7f7c680afc00 2024-04-25T09:57:08.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.416+0000 7f7c6e934640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c680b0160 con 0x7f7c6815dc60 2024-04-25T09:57:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.416+0000 7f7c6e934640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6806b480 con 0x7f7c6806ab60 2024-04-25T09:57:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.417+0000 7f7c67fff640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7c6806ab60 0x7f7c680b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.417+0000 7f7c677fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7c6815dc60 0x7f7c6806af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.417+0000 7f7c67fff640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7c6806ab60 0x7f7c680b1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:33028/0 (socket says 172.21.15.7:33028) 2024-04-25T09:57:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.417+0000 7f7c6ced1640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7c680afc00 0x7f7c680b0c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:33916/0 (socket says 172.21.15.7:33916) 2024-04-25T09:57:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.417+0000 7f7c677fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7c6815dc60 0x7f7c6806af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:50876/0 (socket says 172.21.15.7:50876) 2024-04-25T09:57:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.417+0000 7f7c67fff640 1 -- 172.21.15.7:0/3076332968 learned_addr learned my addr 172.21.15.7:0/3076332968 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.417+0000 7f7c66ffd640 1 -- 172.21.15.7:0/3076332968 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1218615307 0 0) 0x7f7c680b5a20 con 0x7f7c680afc00 2024-04-25T09:57:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.417+0000 7f7c66ffd640 1 -- 172.21.15.7:0/3076332968 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c50003520 con 0x7f7c680afc00 2024-04-25T09:57:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.417+0000 7f7c67fff640 1 -- 172.21.15.7:0/3076332968 >> v2:172.21.15.55:3300/0 conn(0x7f7c6815dc60 msgr2=0x7f7c6806af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.417+0000 7f7c67fff640 1 --2- 172.21.15.7:0/3076332968 >> v2:172.21.15.55:3300/0 conn(0x7f7c6815dc60 0x7f7c6806af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.417+0000 7f7c67fff640 1 -- 172.21.15.7:0/3076332968 >> v1:172.21.15.55:6789/0 conn(0x7f7c680afc00 legacy=0x7f7c680b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.417+0000 7f7c67fff640 1 -- 172.21.15.7:0/3076332968 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c680b1310 con 0x7f7c6806ab60 2024-04-25T09:57:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.417+0000 7f7c677fe640 1 --2- 172.21.15.7:0/3076332968 >> v2:172.21.15.55:3300/0 conn(0x7f7c6815dc60 0x7f7c6806af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:57:08.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.418+0000 7f7c67fff640 1 --2- 172.21.15.7:0/3076332968 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7c6806ab60 0x7f7c680b1ba0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7c58009870 tx=0x7f7c5802a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84fa8e7e2759fe5e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:08.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.418+0000 7f7c66ffd640 1 -- 172.21.15.7:0/3076332968 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58037070 con 0x7f7c6806ab60 2024-04-25T09:57:08.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.418+0000 7f7c66ffd640 1 -- 172.21.15.7:0/3076332968 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c58032440 con 0x7f7c6806ab60 2024-04-25T09:57:08.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.418+0000 7f7c66ffd640 1 -- 172.21.15.7:0/3076332968 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58032810 con 0x7f7c6806ab60 2024-04-25T09:57:08.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.418+0000 7f7c6e934640 1 -- 172.21.15.7:0/3076332968 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7c6806ab60 msgr2=0x7f7c680b1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:08.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.418+0000 7f7c6e934640 1 --2- 172.21.15.7:0/3076332968 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7c6806ab60 0x7f7c680b1ba0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7c58009870 tx=0x7f7c5802a130 comp rx=0 tx=0).stop 2024-04-25T09:57:08.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.418+0000 7f7c6e934640 1 -- 172.21.15.7:0/3076332968 shutdown_connections 2024-04-25T09:57:08.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.418+0000 7f7c6e934640 1 --2- 172.21.15.7:0/3076332968 >> v2:172.21.15.55:3300/0 conn(0x7f7c6815dc60 0x7f7c6806af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:08.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.418+0000 7f7c6e934640 1 --2- 172.21.15.7:0/3076332968 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7c6806ab60 0x7f7c680b1ba0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:08.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.419+0000 7f7c6e934640 1 -- 172.21.15.7:0/3076332968 >> 172.21.15.7:0/3076332968 conn(0x7f7c680b5c30 msgr2=0x7f7c680999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:08.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.419+0000 7f7c6e934640 1 -- 172.21.15.7:0/3076332968 shutdown_connections 2024-04-25T09:57:08.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.419+0000 7f7c6e934640 1 -- 172.21.15.7:0/3076332968 wait complete. 2024-04-25T09:57:08.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.420+0000 7f7c6e934640 1 Processor -- start 2024-04-25T09:57:08.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.420+0000 7f7c6e934640 1 -- start start 2024-04-25T09:57:08.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.421+0000 7f7c6e934640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c6806ab60 0x7f7c680d0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.421+0000 7f7c6e934640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c680afc00 0x7f7c680b3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.421+0000 7f7c6e934640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7c6815dc60 0x7f7c680b3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.421+0000 7f7c6e934640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c680b5260 con 0x7f7c680afc00 2024-04-25T09:57:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.421+0000 7f7c6e934640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c680b0400 con 0x7f7c6806ab60 2024-04-25T09:57:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.421+0000 7f7c6e934640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c680b53e0 con 0x7f7c6815dc60 2024-04-25T09:57:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.421+0000 7f7c677fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c680afc00 0x7f7c680b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.421+0000 7f7c677fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c680afc00 0x7f7c680b3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50178/0 (socket says 172.21.15.7:50178) 2024-04-25T09:57:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.421+0000 7f7c677fe640 1 -- 172.21.15.7:0/4195393210 learned_addr learned my addr 172.21.15.7:0/4195393210 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.421+0000 7f7c67fff640 1 --2- 172.21.15.7:0/4195393210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c6806ab60 0x7f7c680d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.421+0000 7f7c6ced1640 1 --2- 172.21.15.7:0/4195393210 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7c6815dc60 0x7f7c680b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.421+0000 7f7c677fe640 1 -- 172.21.15.7:0/4195393210 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7c6815dc60 msgr2=0x7f7c680b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.421+0000 7f7c677fe640 1 --2- 172.21.15.7:0/4195393210 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7c6815dc60 0x7f7c680b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:08.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.421+0000 7f7c677fe640 1 -- 172.21.15.7:0/4195393210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c6806ab60 msgr2=0x7f7c680d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.421+0000 7f7c677fe640 1 --2- 172.21.15.7:0/4195393210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c6806ab60 0x7f7c680d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.421+0000 7f7c677fe640 1 -- 172.21.15.7:0/4195393210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6809b310 con 0x7f7c680afc00 2024-04-25T09:57:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.421+0000 7f7c677fe640 1 --2- 172.21.15.7:0/4195393210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c680afc00 0x7f7c680b3200 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c00e960 tx=0x7f7c5c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.421+0000 7f7c64ff9640 1 -- 172.21.15.7:0/4195393210 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c017070 con 0x7f7c680afc00 2024-04-25T09:57:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.421+0000 7f7c64ff9640 1 -- 172.21.15.7:0/4195393210 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5c00ca00 con 0x7f7c680afc00 2024-04-25T09:57:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.421+0000 7f7c64ff9640 1 -- 172.21.15.7:0/4195393210 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c00cdd0 con 0x7f7c680afc00 2024-04-25T09:57:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.421+0000 7f7c6e934640 1 -- 172.21.15.7:0/4195393210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6809b5f0 con 0x7f7c680afc00 2024-04-25T09:57:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.421+0000 7f7c6e934640 1 -- 172.21.15.7:0/4195393210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c6809bbb0 con 0x7f7c680afc00 2024-04-25T09:57:08.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.422+0000 7f7c6e934640 1 -- 172.21.15.7:0/4195393210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c6809bf90 con 0x7f7c680afc00 2024-04-25T09:57:08.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.423+0000 7f7c64ff9640 1 -- 172.21.15.7:0/4195393210 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7c5c01a070 con 0x7f7c680afc00 2024-04-25T09:57:08.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.423+0000 7f7c64ff9640 1 --2- 172.21.15.7:0/4195393210 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7c5406b500 0x7f7c5406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:08.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.423+0000 7f7c64ff9640 1 -- 172.21.15.7:0/4195393210 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f7c5c089ed0 con 0x7f7c680afc00 2024-04-25T09:57:08.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.423+0000 7f7c67fff640 1 --2- 172.21.15.7:0/4195393210 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7c5406b500 0x7f7c5406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:08.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.424+0000 7f7c67fff640 1 --2- 172.21.15.7:0/4195393210 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7c5406b500 0x7f7c5406d9c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7c58034000 tx=0x7f7c5802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:08.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.428+0000 7f7c64ff9640 1 -- 172.21.15.7:0/4195393210 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7c6809bf90 con 0x7f7c680afc00 2024-04-25T09:57:08.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:08.687+0000 7f7c6e934640 1 -- 172.21.15.7:0/4195393210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) v1 -- 0x7f7c68068fd0 con 0x7f7c680afc00 2024-04-25T09:57:09.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.679+0000 7f7c64ff9640 1 -- 172.21.15.7:0/4195393210 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v162) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7c5c058870 con 0x7f7c680afc00 2024-04-25T09:57:09.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.682+0000 7f7c6e934640 1 -- 172.21.15.7:0/4195393210 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7c5406b500 msgr2=0x7f7c5406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:09.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.682+0000 7f7c6e934640 1 --2- 172.21.15.7:0/4195393210 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7c5406b500 0x7f7c5406d9c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7c58034000 tx=0x7f7c5802e000 comp rx=0 tx=0).stop 2024-04-25T09:57:09.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.682+0000 7f7c6e934640 1 -- 172.21.15.7:0/4195393210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c680afc00 msgr2=0x7f7c680b3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:09.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.682+0000 7f7c6e934640 1 --2- 172.21.15.7:0/4195393210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c680afc00 0x7f7c680b3200 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c00e960 tx=0x7f7c5c00ee20 comp rx=0 tx=0).stop 2024-04-25T09:57:09.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.682+0000 7f7c6e934640 1 -- 172.21.15.7:0/4195393210 shutdown_connections 2024-04-25T09:57:09.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.682+0000 7f7c6e934640 1 --2- 172.21.15.7:0/4195393210 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7c5406b500 0x7f7c5406d9c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:09.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.682+0000 7f7c6e934640 1 --2- 172.21.15.7:0/4195393210 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7c6815dc60 0x7f7c680b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:09.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.682+0000 7f7c6e934640 1 --2- 172.21.15.7:0/4195393210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c680afc00 0x7f7c680b3200 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:09.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.682+0000 7f7c6e934640 1 --2- 172.21.15.7:0/4195393210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c6806ab60 0x7f7c680d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:09.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.682+0000 7f7c6e934640 1 -- 172.21.15.7:0/4195393210 >> 172.21.15.7:0/4195393210 conn(0x7f7c680b5c30 msgr2=0x7f7c680b0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:09.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.682+0000 7f7c6e934640 1 -- 172.21.15.7:0/4195393210 shutdown_connections 2024-04-25T09:57:09.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.682+0000 7f7c6e934640 1 -- 172.21.15.7:0/4195393210 wait complete. 2024-04-25T09:57:09.699 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:57:09.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.806+0000 7f53d594f640 1 Processor -- start 2024-04-25T09:57:09.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.807+0000 7f53d594f640 1 -- start start 2024-04-25T09:57:09.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.807+0000 7f53d594f640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f53d00d3760 0x7f53d015eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:09.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.807+0000 7f53d594f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f53d015f1c0 0x7f53d00d3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:09.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.807+0000 7f53d594f640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d00d4080 con 0x7f53d00ce830 2024-04-25T09:57:09.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.807+0000 7f53d594f640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d00ce380 con 0x7f53d00d3760 2024-04-25T09:57:09.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.807+0000 7f53d594f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d015f000 con 0x7f53d015f1c0 2024-04-25T09:57:09.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.807+0000 7f53ceffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f53d00d3760 0x7f53d015eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:09.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.807+0000 7f53cf7fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f53d00ce830 0x7f53d00b2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56060/0 (socket says 172.21.15.7:56060) 2024-04-25T09:57:09.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.808+0000 7f53cf7fe640 1 -- 172.21.15.7:0/770498728 learned_addr learned my addr 172.21.15.7:0/770498728 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:57:09.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.808+0000 7f53ceffd640 1 -- 172.21.15.7:0/770498728 >> v2:172.21.15.55:3300/0 conn(0x7f53d015f1c0 msgr2=0x7f53d00d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:09.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.808+0000 7f53ceffd640 1 --2- 172.21.15.7:0/770498728 >> v2:172.21.15.55:3300/0 conn(0x7f53d015f1c0 0x7f53d00d3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:09.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.808+0000 7f53ceffd640 1 -- 172.21.15.7:0/770498728 >> v1:172.21.15.7:6789/0 conn(0x7f53d00ce830 legacy=0x7f53d00b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:09.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.808+0000 7f53ceffd640 1 -- 172.21.15.7:0/770498728 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d00ced10 con 0x7f53d00d3760 2024-04-25T09:57:09.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.808+0000 7f53cdffb640 1 -- 172.21.15.7:0/770498728 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728447208 0 0) 0x7f53d00d4080 con 0x7f53d00ce830 2024-04-25T09:57:09.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.809+0000 7f53ceffd640 1 --2- 172.21.15.7:0/770498728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53d00d3760 0x7f53d015eac0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f53d00b9830 tx=0x7f53c802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=261bb1b0afef58e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:09.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.809+0000 7f53cdffb640 1 -- 172.21.15.7:0/770498728 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8037070 con 0x7f53d00d3760 2024-04-25T09:57:09.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.809+0000 7f53cdffb640 1 -- 172.21.15.7:0/770498728 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c8032440 con 0x7f53d00d3760 2024-04-25T09:57:09.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.809+0000 7f53cdffb640 1 -- 172.21.15.7:0/770498728 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8032810 con 0x7f53d00d3760 2024-04-25T09:57:09.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.809+0000 7f53d594f640 1 -- 172.21.15.7:0/770498728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53d00d3760 msgr2=0x7f53d015eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:09.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.809+0000 7f53d594f640 1 --2- 172.21.15.7:0/770498728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53d00d3760 0x7f53d015eac0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f53d00b9830 tx=0x7f53c802a1a0 comp rx=0 tx=0).stop 2024-04-25T09:57:09.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.809+0000 7f53d594f640 1 -- 172.21.15.7:0/770498728 shutdown_connections 2024-04-25T09:57:09.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.809+0000 7f53d594f640 1 --2- 172.21.15.7:0/770498728 >> v2:172.21.15.55:3300/0 conn(0x7f53d015f1c0 0x7f53d00d3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:09.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.809+0000 7f53d594f640 1 --2- 172.21.15.7:0/770498728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53d00d3760 0x7f53d015eac0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:09.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.809+0000 7f53d594f640 1 -- 172.21.15.7:0/770498728 >> 172.21.15.7:0/770498728 conn(0x7f53d0072680 msgr2=0x7f53d0072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:09.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.809+0000 7f53d594f640 1 -- 172.21.15.7:0/770498728 shutdown_connections 2024-04-25T09:57:09.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.809+0000 7f53d594f640 1 -- 172.21.15.7:0/770498728 wait complete. 2024-04-25T09:57:09.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.811+0000 7f53d594f640 1 Processor -- start 2024-04-25T09:57:09.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.811+0000 7f53d594f640 1 -- start start 2024-04-25T09:57:09.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.811+0000 7f53d594f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53d00ce830 0x7f53d00ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:09.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.811+0000 7f53d594f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f53d00d3760 0x7f53d01f4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:09.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.812+0000 7f53d594f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53d015f1c0 0x7f53d0148f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:09.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.812+0000 7f53d594f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d00d1e20 con 0x7f53d015f1c0 2024-04-25T09:57:09.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.812+0000 7f53d594f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d00d2190 con 0x7f53d00ce830 2024-04-25T09:57:09.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.812+0000 7f53d594f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d015de10 con 0x7f53d00d3760 2024-04-25T09:57:09.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.812+0000 7f53cf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53d015f1c0 0x7f53d0148f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:09.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.812+0000 7f53cf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53d015f1c0 0x7f53d0148f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48998/0 (socket says 172.21.15.7:48998) 2024-04-25T09:57:09.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.812+0000 7f53cf7fe640 1 -- 172.21.15.7:0/236422121 learned_addr learned my addr 172.21.15.7:0/236422121 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:09.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.812+0000 7f53ceffd640 1 --2- 172.21.15.7:0/236422121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53d00ce830 0x7f53d00ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:09.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.812+0000 7f53cf7fe640 1 -- 172.21.15.7:0/236422121 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f53d00d3760 msgr2=0x7f53d01f4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:09.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.812+0000 7f53cf7fe640 1 --2- 172.21.15.7:0/236422121 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f53d00d3760 0x7f53d01f4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:09.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.812+0000 7f53cf7fe640 1 -- 172.21.15.7:0/236422121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53d00ce830 msgr2=0x7f53d00ca8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:09.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.812+0000 7f53cf7fe640 1 --2- 172.21.15.7:0/236422121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53d00ce830 0x7f53d00ca8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:09.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.812+0000 7f53cf7fe640 1 -- 172.21.15.7:0/236422121 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d00caf80 con 0x7f53d015f1c0 2024-04-25T09:57:09.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.812+0000 7f53cf7fe640 1 --2- 172.21.15.7:0/236422121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53d015f1c0 0x7f53d0148f70 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f53c000c7b0 tx=0x7f53c000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:09.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.812+0000 7f53c7fff640 1 -- 172.21.15.7:0/236422121 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c0018070 con 0x7f53d015f1c0 2024-04-25T09:57:09.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.812+0000 7f53c7fff640 1 -- 172.21.15.7:0/236422121 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c000a640 con 0x7f53d015f1c0 2024-04-25T09:57:09.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.812+0000 7f53d594f640 1 -- 172.21.15.7:0/236422121 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d00cb260 con 0x7f53d015f1c0 2024-04-25T09:57:09.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.812+0000 7f53c7fff640 1 -- 172.21.15.7:0/236422121 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c000ce60 con 0x7f53d015f1c0 2024-04-25T09:57:09.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.812+0000 7f53d594f640 1 -- 172.21.15.7:0/236422121 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d00cb820 con 0x7f53d015f1c0 2024-04-25T09:57:09.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.813+0000 7f53d594f640 1 -- 172.21.15.7:0/236422121 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d0068f60 con 0x7f53d015f1c0 2024-04-25T09:57:09.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.814+0000 7f53c7fff640 1 -- 172.21.15.7:0/236422121 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f53c001b070 con 0x7f53d015f1c0 2024-04-25T09:57:09.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.814+0000 7f53c7fff640 1 --2- 172.21.15.7:0/236422121 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f53b006b4d0 0x7f53b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:09.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.814+0000 7f53c7fff640 1 -- 172.21.15.7:0/236422121 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f53c0089530 con 0x7f53d015f1c0 2024-04-25T09:57:09.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.814+0000 7f53ceffd640 1 --2- 172.21.15.7:0/236422121 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f53b006b4d0 0x7f53b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:09.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.815+0000 7f53ceffd640 1 --2- 172.21.15.7:0/236422121 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f53b006b4d0 0x7f53b006d990 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f53c8034000 tx=0x7f53c802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:09.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.819+0000 7f53c7fff640 1 -- 172.21.15.7:0/236422121 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f53c0058520 con 0x7f53d015f1c0 2024-04-25T09:57:10.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:09.999+0000 7f53d594f640 1 -- 172.21.15.7:0/236422121 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f53d00ce140 con 0x7f53d015f1c0 2024-04-25T09:57:10.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.002+0000 7f53c7fff640 1 -- 172.21.15.7:0/236422121 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f53c0057e20 con 0x7f53d015f1c0 2024-04-25T09:57:10.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.005+0000 7f53d594f640 1 -- 172.21.15.7:0/236422121 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f53b006b4d0 msgr2=0x7f53b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:10.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.005+0000 7f53d594f640 1 --2- 172.21.15.7:0/236422121 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f53b006b4d0 0x7f53b006d990 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f53c8034000 tx=0x7f53c802e000 comp rx=0 tx=0).stop 2024-04-25T09:57:10.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.005+0000 7f53d594f640 1 -- 172.21.15.7:0/236422121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53d015f1c0 msgr2=0x7f53d0148f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:10.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.005+0000 7f53d594f640 1 --2- 172.21.15.7:0/236422121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53d015f1c0 0x7f53d0148f70 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f53c000c7b0 tx=0x7f53c000cc70 comp rx=0 tx=0).stop 2024-04-25T09:57:10.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.005+0000 7f53d594f640 1 -- 172.21.15.7:0/236422121 shutdown_connections 2024-04-25T09:57:10.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.005+0000 7f53d594f640 1 --2- 172.21.15.7:0/236422121 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f53b006b4d0 0x7f53b006d990 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:10.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.005+0000 7f53d594f640 1 --2- 172.21.15.7:0/236422121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53d015f1c0 0x7f53d0148f70 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:10.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.005+0000 7f53d594f640 1 --2- 172.21.15.7:0/236422121 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f53d00d3760 0x7f53d01f4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:10.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.005+0000 7f53d594f640 1 --2- 172.21.15.7:0/236422121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53d00ce830 0x7f53d00ca8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:10.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.005+0000 7f53d594f640 1 -- 172.21.15.7:0/236422121 >> 172.21.15.7:0/236422121 conn(0x7f53d0072680 msgr2=0x7f53d00d2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:10.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.005+0000 7f53d594f640 1 -- 172.21.15.7:0/236422121 shutdown_connections 2024-04-25T09:57:10.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.005+0000 7f53d594f640 1 -- 172.21.15.7:0/236422121 wait complete. 2024-04-25T09:57:10.019 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:57:10.019 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:57:10.066 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:57:10.115 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:57:10.116 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:57:10.116 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:57:10.131 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13704 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:57:10.131 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:57:10.131 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:57:10.149 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19023 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:57:10.149 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:57:10.149 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:57:10.186 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13704 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:57:10.186 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:57:10.187 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:57:10.207 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19023 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:57:10.207 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:57:10.207 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:57:10.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.324+0000 7f3a10af5640 1 Processor -- start 2024-04-25T09:57:10.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.324+0000 7f3a10af5640 1 -- start start 2024-04-25T09:57:10.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.325+0000 7f3a10af5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3a0c15d7b0 0x7f3a0c06fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:10.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.325+0000 7f3a10af5640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3a0c15eba0 0x7f3a0c0b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:10.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.325+0000 7f3a10af5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a0c1618f0 con 0x7f3a0c0b53c0 2024-04-25T09:57:10.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.325+0000 7f3a10af5640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a0c161bd0 con 0x7f3a0c15eba0 2024-04-25T09:57:10.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.325+0000 7f3a10af5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a0c161eb0 con 0x7f3a0c15d7b0 2024-04-25T09:57:10.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.325+0000 7f3a0ad9d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3a0c15eba0 0x7f3a0c0b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:10.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.325+0000 7f3a0ad9d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3a0c15eba0 0x7f3a0c0b3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49002/0 (socket says 172.21.15.7:49002) 2024-04-25T09:57:10.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.325+0000 7f3a0ad9d640 1 -- 172.21.15.7:0/1764034430 learned_addr learned my addr 172.21.15.7:0/1764034430 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:10.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.325+0000 7f3a0a59c640 1 --2- 172.21.15.7:0/1764034430 >> v2:172.21.15.55:3300/0 conn(0x7f3a0c15d7b0 0x7f3a0c06fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:10.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.326+0000 7f3a0ad9d640 1 -- 172.21.15.7:0/1764034430 >> v2:172.21.15.55:3300/0 conn(0x7f3a0c15d7b0 msgr2=0x7f3a0c06fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:10.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.326+0000 7f3a0ad9d640 1 --2- 172.21.15.7:0/1764034430 >> v2:172.21.15.55:3300/0 conn(0x7f3a0c15d7b0 0x7f3a0c06fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:10.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.326+0000 7f3a0ad9d640 1 -- 172.21.15.7:0/1764034430 >> v1:172.21.15.55:6789/0 conn(0x7f3a0c0b53c0 legacy=0x7f3a0c06ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:10.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.326+0000 7f3a0ad9d640 1 -- 172.21.15.7:0/1764034430 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0c162190 con 0x7f3a0c15eba0 2024-04-25T09:57:10.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.326+0000 7f3a0ad9d640 1 --2- 172.21.15.7:0/1764034430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a0c15eba0 0x7f3a0c0b3a70 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c06dd00 tx=0x7f3a0402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa72eba33406750 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:10.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.326+0000 7f3a0959a640 1 -- 172.21.15.7:0/1764034430 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a04036070 con 0x7f3a0c15eba0 2024-04-25T09:57:10.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.326+0000 7f3a0959a640 1 -- 172.21.15.7:0/1764034430 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a04031600 con 0x7f3a0c15eba0 2024-04-25T09:57:10.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.327+0000 7f3a0959a640 1 -- 172.21.15.7:0/1764034430 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a040319d0 con 0x7f3a0c15eba0 2024-04-25T09:57:10.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.327+0000 7f3a10af5640 1 -- 172.21.15.7:0/1764034430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a0c15eba0 msgr2=0x7f3a0c0b3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:10.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.327+0000 7f3a10af5640 1 --2- 172.21.15.7:0/1764034430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a0c15eba0 0x7f3a0c0b3a70 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c06dd00 tx=0x7f3a0402a730 comp rx=0 tx=0).stop 2024-04-25T09:57:10.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.327+0000 7f3a10af5640 1 -- 172.21.15.7:0/1764034430 shutdown_connections 2024-04-25T09:57:10.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.327+0000 7f3a10af5640 1 --2- 172.21.15.7:0/1764034430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a0c15eba0 0x7f3a0c0b3a70 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:10.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.327+0000 7f3a10af5640 1 --2- 172.21.15.7:0/1764034430 >> v2:172.21.15.55:3300/0 conn(0x7f3a0c15d7b0 0x7f3a0c06fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:10.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.327+0000 7f3a10af5640 1 -- 172.21.15.7:0/1764034430 >> 172.21.15.7:0/1764034430 conn(0x7f3a0c0b2390 msgr2=0x7f3a0c0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:10.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.327+0000 7f3a10af5640 1 -- 172.21.15.7:0/1764034430 shutdown_connections 2024-04-25T09:57:10.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.327+0000 7f3a10af5640 1 -- 172.21.15.7:0/1764034430 wait complete. 2024-04-25T09:57:10.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.328+0000 7f3a10af5640 1 Processor -- start 2024-04-25T09:57:10.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.328+0000 7f3a10af5640 1 -- start start 2024-04-25T09:57:10.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.329+0000 7f3a10af5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a0c0b53c0 0x7f3a0c1595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:10.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.329+0000 7f3a10af5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3a0c15d7b0 0x7f3a0c15b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:10.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.329+0000 7f3a10af5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a0c15eba0 0x7f3a0c152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:10.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.329+0000 7f3a10af5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0c06b3f0 con 0x7f3a0c0b53c0 2024-04-25T09:57:10.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.329+0000 7f3a10af5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0c06b270 con 0x7f3a0c15eba0 2024-04-25T09:57:10.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.329+0000 7f3a10af5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0c0b5850 con 0x7f3a0c15d7b0 2024-04-25T09:57:10.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.329+0000 7f3a0a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a0c0b53c0 0x7f3a0c1595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:10.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.329+0000 7f3a0a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a0c0b53c0 0x7f3a0c1595c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49014/0 (socket says 172.21.15.7:49014) 2024-04-25T09:57:10.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.329+0000 7f3a0a59c640 1 -- 172.21.15.7:0/616818661 learned_addr learned my addr 172.21.15.7:0/616818661 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:10.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.329+0000 7f3a09d9b640 1 --2- 172.21.15.7:0/616818661 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3a0c15d7b0 0x7f3a0c15b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:10.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.329+0000 7f3a0ad9d640 1 --2- 172.21.15.7:0/616818661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a0c15eba0 0x7f3a0c152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:10.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.330+0000 7f3a0a59c640 1 -- 172.21.15.7:0/616818661 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3a0c15d7b0 msgr2=0x7f3a0c15b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:10.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.330+0000 7f3a0a59c640 1 --2- 172.21.15.7:0/616818661 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3a0c15d7b0 0x7f3a0c15b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:10.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.330+0000 7f3a0a59c640 1 -- 172.21.15.7:0/616818661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a0c15eba0 msgr2=0x7f3a0c152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:10.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.330+0000 7f3a0a59c640 1 --2- 172.21.15.7:0/616818661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a0c15eba0 0x7f3a0c152350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:10.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.330+0000 7f3a0a59c640 1 -- 172.21.15.7:0/616818661 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0c152890 con 0x7f3a0c0b53c0 2024-04-25T09:57:10.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.330+0000 7f3a0ad9d640 1 --2- 172.21.15.7:0/616818661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a0c15eba0 0x7f3a0c152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:57:10.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.330+0000 7f3a0a59c640 1 --2- 172.21.15.7:0/616818661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a0c0b53c0 0x7f3a0c1595c0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f39fc00d830 tx=0x7f39fc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:10.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.330+0000 7f3a02ffd640 1 -- 172.21.15.7:0/616818661 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39fc00b6c0 con 0x7f3a0c0b53c0 2024-04-25T09:57:10.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.330+0000 7f3a02ffd640 1 -- 172.21.15.7:0/616818661 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39fc019070 con 0x7f3a0c0b53c0 2024-04-25T09:57:10.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.330+0000 7f3a10af5640 1 -- 172.21.15.7:0/616818661 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a0c159c50 con 0x7f3a0c0b53c0 2024-04-25T09:57:10.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.330+0000 7f3a02ffd640 1 -- 172.21.15.7:0/616818661 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39fc00ba80 con 0x7f3a0c0b53c0 2024-04-25T09:57:10.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.330+0000 7f3a10af5640 1 -- 172.21.15.7:0/616818661 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a0c15a210 con 0x7f3a0c0b53c0 2024-04-25T09:57:10.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.331+0000 7f3a10af5640 1 -- 172.21.15.7:0/616818661 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a0c068fd0 con 0x7f3a0c0b53c0 2024-04-25T09:57:10.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.331+0000 7f3a02ffd640 1 -- 172.21.15.7:0/616818661 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f39fc01e460 con 0x7f3a0c0b53c0 2024-04-25T09:57:10.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.332+0000 7f3a02ffd640 1 --2- 172.21.15.7:0/616818661 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f39ec06b500 0x7f39ec06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:10.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.332+0000 7f3a02ffd640 1 -- 172.21.15.7:0/616818661 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f39fc08a6c0 con 0x7f3a0c0b53c0 2024-04-25T09:57:10.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.332+0000 7f3a09d9b640 1 --2- 172.21.15.7:0/616818661 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f39ec06b500 0x7f39ec06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:10.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.332+0000 7f3a09d9b640 1 --2- 172.21.15.7:0/616818661 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f39ec06b500 0x7f39ec06d9c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f39f4007fd0 tx=0x7f39f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:10.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.336+0000 7f3a02ffd640 1 -- 172.21.15.7:0/616818661 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f39fc059740 con 0x7f3a0c0b53c0 2024-04-25T09:57:10.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.552+0000 7f3a10af5640 1 -- 172.21.15.7:0/616818661 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a0c0b00e0 con 0x7f3a0c0b53c0 2024-04-25T09:57:10.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.553+0000 7f3a02ffd640 1 -- 172.21.15.7:0/616818661 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+3693 (secure 0 0 0) 0x7f39fc059040 con 0x7f3a0c0b53c0 2024-04-25T09:57:10.557 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:57:10.557 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5072,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1716545079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1716545079},{"type":"v1","addr":"172.21.15.7:6837","nonce":1716545079}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5434,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1851611776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1851611776},{"type":"v1","addr":"172.21.15.55:6834","nonce":1851611776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2607486300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2607486300},{"type":"v1","addr":"172.21.15.55:6835","nonce":2607486300}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":6210,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1635413485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1635413485},{"type":"v1","addr":"172.21.15.7:6836","nonce":1635413485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[]} 2024-04-25T09:57:10.557 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 23 2024-04-25T09:57:10.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.555+0000 7f3a10af5640 1 -- 172.21.15.7:0/616818661 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f39ec06b500 msgr2=0x7f39ec06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:10.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.555+0000 7f3a10af5640 1 --2- 172.21.15.7:0/616818661 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f39ec06b500 0x7f39ec06d9c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f39f4007fd0 tx=0x7f39f4009040 comp rx=0 tx=0).stop 2024-04-25T09:57:10.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.555+0000 7f3a10af5640 1 -- 172.21.15.7:0/616818661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a0c0b53c0 msgr2=0x7f3a0c1595c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:10.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.555+0000 7f3a10af5640 1 --2- 172.21.15.7:0/616818661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a0c0b53c0 0x7f3a0c1595c0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f39fc00d830 tx=0x7f39fc00dcf0 comp rx=0 tx=0).stop 2024-04-25T09:57:10.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.555+0000 7f3a10af5640 1 -- 172.21.15.7:0/616818661 shutdown_connections 2024-04-25T09:57:10.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.555+0000 7f3a10af5640 1 --2- 172.21.15.7:0/616818661 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f39ec06b500 0x7f39ec06d9c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:10.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.555+0000 7f3a10af5640 1 --2- 172.21.15.7:0/616818661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a0c15eba0 0x7f3a0c152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:10.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.555+0000 7f3a10af5640 1 --2- 172.21.15.7:0/616818661 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3a0c15d7b0 0x7f3a0c15b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:10.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.555+0000 7f3a10af5640 1 --2- 172.21.15.7:0/616818661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a0c0b53c0 0x7f3a0c1595c0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:10.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.555+0000 7f3a10af5640 1 -- 172.21.15.7:0/616818661 >> 172.21.15.7:0/616818661 conn(0x7f3a0c0b2390 msgr2=0x7f3a0c0b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:10.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.555+0000 7f3a10af5640 1 -- 172.21.15.7:0/616818661 shutdown_connections 2024-04-25T09:57:10.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.555+0000 7f3a10af5640 1 -- 172.21.15.7:0/616818661 wait complete. 2024-04-25T09:57:10.569 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:57:10.569 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:57:10.570 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:57:10.570 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:57:10.570 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:57:10.570 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:57:10.570 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:57:10.570 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:57:10.571 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:57:10.571 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:57:10.571 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:57:10.571 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:57:10.571 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:57:10.571 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:57:10.571 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:57:10.572 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:57:10.582 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:57:10.582 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:57:10.583 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:57:10.583 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:57:10.584 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:57:10.584 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:57:10.585 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:57:10.585 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:57:10.625 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:57:10.625 DEBUG:teuthology.parallel:result is None 2024-04-25T09:57:10.625 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:57:10.626 DEBUG:teuthology.parallel:result is None 2024-04-25T09:57:10.628 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:57:10.628 DEBUG:teuthology.parallel:result is None 2024-04-25T09:57:10.628 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:57:10.629 DEBUG:teuthology.parallel:result is None 2024-04-25T09:57:10.629 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:57:10.701 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-04-25T09:57:10.701 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-04-25T09:57:10.712 INFO:tasks.ceph.mds.b.smithi055.stdout:starting mds.b at 2024-04-25T09:57:10.713 INFO:tasks.ceph.mds.d.smithi055.stdout:starting mds.d at 2024-04-25T09:57:10.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.733+0000 7fc2564e1640 1 Processor -- start 2024-04-25T09:57:10.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.734+0000 7fc2564e1640 1 -- start start 2024-04-25T09:57:10.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.734+0000 7fc2564e1640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc25015db00 0x7fc2500d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:10.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.734+0000 7fc2564e1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc2500ce2b0 0x7fc2500d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:10.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.734+0000 7fc2564e1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2500d1e80 con 0x7fc2500b53b0 2024-04-25T09:57:10.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.734+0000 7fc2564e1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2500b5930 con 0x7fc2500ce2b0 2024-04-25T09:57:10.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.734+0000 7fc2564e1640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2500b5c10 con 0x7fc25015db00 2024-04-25T09:57:10.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.735+0000 7fc24ffff640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc25015db00 0x7fc2500d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:10.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.735+0000 7fc254a7e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc2500ce2b0 0x7fc2500d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:10.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.735+0000 7fc24f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc2500b53b0 0x7fc250161670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:38030/0 (socket says 172.21.15.7:38030) 2024-04-25T09:57:10.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.735+0000 7fc24f7fe640 1 -- 172.21.15.7:0/1792341537 learned_addr learned my addr 172.21.15.7:0/1792341537 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:57:10.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.735+0000 7fc254a7e640 1 -- 172.21.15.7:0/1792341537 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc25015db00 msgr2=0x7fc2500d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:10.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.735+0000 7fc254a7e640 1 --2- 172.21.15.7:0/1792341537 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc25015db00 0x7fc2500d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:10.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.735+0000 7fc254a7e640 1 -- 172.21.15.7:0/1792341537 >> v1:172.21.15.55:6789/0 conn(0x7fc2500b53b0 legacy=0x7fc250161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:10.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.735+0000 7fc24effd640 1 -- 172.21.15.7:0/1792341537 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705384192 0 0) 0x7fc2500d1e80 con 0x7fc2500b53b0 2024-04-25T09:57:10.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.735+0000 7fc254a7e640 1 -- 172.21.15.7:0/1792341537 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2500b5ef0 con 0x7fc2500ce2b0 2024-04-25T09:57:10.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.736+0000 7fc254a7e640 1 --2- 172.21.15.7:0/1792341537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2500ce2b0 0x7fc2500d0880 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc248009d90 tx=0x7fc24802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a8325d0464509ce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:10.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.736+0000 7fc24effd640 1 -- 172.21.15.7:0/1792341537 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc248007740 con 0x7fc2500ce2b0 2024-04-25T09:57:10.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.736+0000 7fc24effd640 1 -- 172.21.15.7:0/1792341537 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2480078e0 con 0x7fc2500ce2b0 2024-04-25T09:57:10.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.736+0000 7fc24effd640 1 -- 172.21.15.7:0/1792341537 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc248007cb0 con 0x7fc2500ce2b0 2024-04-25T09:57:10.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.736+0000 7fc2564e1640 1 -- 172.21.15.7:0/1792341537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2500ce2b0 msgr2=0x7fc2500d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:10.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.736+0000 7fc2564e1640 1 --2- 172.21.15.7:0/1792341537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2500ce2b0 0x7fc2500d0880 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc248009d90 tx=0x7fc24802a660 comp rx=0 tx=0).stop 2024-04-25T09:57:10.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.736+0000 7fc2564e1640 1 -- 172.21.15.7:0/1792341537 shutdown_connections 2024-04-25T09:57:10.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.736+0000 7fc2564e1640 1 --2- 172.21.15.7:0/1792341537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2500ce2b0 0x7fc2500d0880 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:10.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.736+0000 7fc2564e1640 1 --2- 172.21.15.7:0/1792341537 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc25015db00 0x7fc2500d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:10.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.736+0000 7fc2564e1640 1 -- 172.21.15.7:0/1792341537 >> 172.21.15.7:0/1792341537 conn(0x7fc250072290 msgr2=0x7fc2500726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:10.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.737+0000 7fc2564e1640 1 -- 172.21.15.7:0/1792341537 shutdown_connections 2024-04-25T09:57:10.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.737+0000 7fc2564e1640 1 -- 172.21.15.7:0/1792341537 wait complete. 2024-04-25T09:57:10.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.738+0000 7fc2564e1640 1 Processor -- start 2024-04-25T09:57:10.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.738+0000 7fc2564e1640 1 -- start start 2024-04-25T09:57:10.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.738+0000 7fc2564e1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2500b53b0 0x7fc25015e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:10.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.739+0000 7fc2564e1640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2500ce2b0 0x7fc2501f36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:10.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.739+0000 7fc2564e1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc25015db00 0x7fc250149d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:10.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.739+0000 7fc2564e1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2500d3660 con 0x7fc25015db00 2024-04-25T09:57:10.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.739+0000 7fc2564e1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2500b61d0 con 0x7fc2500b53b0 2024-04-25T09:57:10.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.739+0000 7fc2564e1640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2500b6c10 con 0x7fc2500ce2b0 2024-04-25T09:57:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.739+0000 7fc254a7e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc25015db00 0x7fc250149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.739+0000 7fc24ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2500b53b0 0x7fc25015e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.739+0000 7fc254a7e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc25015db00 0x7fc250149d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49080/0 (socket says 172.21.15.7:49080) 2024-04-25T09:57:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.739+0000 7fc24f7fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2500ce2b0 0x7fc2501f36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.739+0000 7fc254a7e640 1 -- 172.21.15.7:0/2804896416 learned_addr learned my addr 172.21.15.7:0/2804896416 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.739+0000 7fc254a7e640 1 -- 172.21.15.7:0/2804896416 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2500ce2b0 msgr2=0x7fc2501f36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.739+0000 7fc254a7e640 1 --2- 172.21.15.7:0/2804896416 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2500ce2b0 0x7fc2501f36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.739+0000 7fc254a7e640 1 -- 172.21.15.7:0/2804896416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2500b53b0 msgr2=0x7fc25015e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.739+0000 7fc254a7e640 1 --2- 172.21.15.7:0/2804896416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2500b53b0 0x7fc25015e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.739+0000 7fc254a7e640 1 -- 172.21.15.7:0/2804896416 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc25015fe80 con 0x7fc25015db00 2024-04-25T09:57:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.739+0000 7fc24ffff640 1 --2- 172.21.15.7:0/2804896416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2500b53b0 0x7fc25015e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:57:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.739+0000 7fc254a7e640 1 --2- 172.21.15.7:0/2804896416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc25015db00 0x7fc250149d80 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fc248009eb0 tx=0x7fc248004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.739+0000 7fc24cff9640 1 -- 172.21.15.7:0/2804896416 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc248040070 con 0x7fc25015db00 2024-04-25T09:57:10.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.739+0000 7fc24cff9640 1 -- 172.21.15.7:0/2804896416 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc248031bc0 con 0x7fc25015db00 2024-04-25T09:57:10.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.739+0000 7fc2564e1640 1 -- 172.21.15.7:0/2804896416 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2501f3c10 con 0x7fc25015db00 2024-04-25T09:57:10.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.740+0000 7fc24cff9640 1 -- 172.21.15.7:0/2804896416 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc248009450 con 0x7fc25015db00 2024-04-25T09:57:10.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.740+0000 7fc2564e1640 1 -- 172.21.15.7:0/2804896416 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2501f41c0 con 0x7fc25015db00 2024-04-25T09:57:10.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.741+0000 7fc2564e1640 1 -- 172.21.15.7:0/2804896416 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc250068fd0 con 0x7fc25015db00 2024-04-25T09:57:10.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.741+0000 7fc24cff9640 1 -- 172.21.15.7:0/2804896416 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc248039040 con 0x7fc25015db00 2024-04-25T09:57:10.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.741+0000 7fc24cff9640 1 --2- 172.21.15.7:0/2804896416 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc23006b4d0 0x7fc23006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:10.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.742+0000 7fc24cff9640 1 -- 172.21.15.7:0/2804896416 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fc2480ab420 con 0x7fc25015db00 2024-04-25T09:57:10.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.742+0000 7fc24ffff640 1 --2- 172.21.15.7:0/2804896416 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc23006b4d0 0x7fc23006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:10.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.742+0000 7fc24ffff640 1 --2- 172.21.15.7:0/2804896416 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc23006b4d0 0x7fc23006d990 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc238009e90 tx=0x7fc238009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:10.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.746+0000 7fc24cff9640 1 -- 172.21.15.7:0/2804896416 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc248079dc0 con 0x7fc25015db00 2024-04-25T09:57:10.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:10.940+0000 7fc2564e1640 1 -- 172.21.15.7:0/2804896416 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc2500d16b0 con 0x7fc25015db00 2024-04-25T09:57:11.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.709+0000 7fc24cff9640 1 -- 172.21.15.7:0/2804896416 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v56) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc24807de60 con 0x7fc25015db00 2024-04-25T09:57:11.713 INFO:teuthology.orchestra.run.smithi007.stderr: removed all blocklist entries 2024-04-25T09:57:11.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.712+0000 7fc2564e1640 1 -- 172.21.15.7:0/2804896416 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc23006b4d0 msgr2=0x7fc23006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:11.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.712+0000 7fc2564e1640 1 --2- 172.21.15.7:0/2804896416 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc23006b4d0 0x7fc23006d990 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc238009e90 tx=0x7fc238009190 comp rx=0 tx=0).stop 2024-04-25T09:57:11.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.712+0000 7fc2564e1640 1 -- 172.21.15.7:0/2804896416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc25015db00 msgr2=0x7fc250149d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:11.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.712+0000 7fc2564e1640 1 --2- 172.21.15.7:0/2804896416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc25015db00 0x7fc250149d80 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fc248009eb0 tx=0x7fc248004a40 comp rx=0 tx=0).stop 2024-04-25T09:57:11.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.712+0000 7fc2564e1640 1 -- 172.21.15.7:0/2804896416 shutdown_connections 2024-04-25T09:57:11.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.712+0000 7fc2564e1640 1 --2- 172.21.15.7:0/2804896416 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc23006b4d0 0x7fc23006d990 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:11.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.712+0000 7fc2564e1640 1 --2- 172.21.15.7:0/2804896416 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc25015db00 0x7fc250149d80 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:11.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.712+0000 7fc2564e1640 1 --2- 172.21.15.7:0/2804896416 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2500ce2b0 0x7fc2501f36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:11.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.712+0000 7fc2564e1640 1 --2- 172.21.15.7:0/2804896416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2500b53b0 0x7fc25015e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:11.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.712+0000 7fc2564e1640 1 -- 172.21.15.7:0/2804896416 >> 172.21.15.7:0/2804896416 conn(0x7fc250072290 msgr2=0x7fc25015bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:11.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.712+0000 7fc2564e1640 1 -- 172.21.15.7:0/2804896416 shutdown_connections 2024-04-25T09:57:11.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.712+0000 7fc2564e1640 1 -- 172.21.15.7:0/2804896416 wait complete. 2024-04-25T09:57:11.731 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:57:11.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.834+0000 7f7ad5e12640 1 Processor -- start 2024-04-25T09:57:11.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.834+0000 7f7ad5e12640 1 -- start start 2024-04-25T09:57:11.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.835+0000 7f7ad5e12640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7ad015da60 0x7f7ad00d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:11.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.835+0000 7f7ad5e12640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7ad015e2a0 0x7f7ad00ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:11.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.835+0000 7f7ad5e12640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ad015e8a0 con 0x7f7ad015de40 2024-04-25T09:57:11.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.835+0000 7f7ad5e12640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad015eb80 con 0x7f7ad015e2a0 2024-04-25T09:57:11.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.835+0000 7f7ad5e12640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad015ee60 con 0x7f7ad015da60 2024-04-25T09:57:11.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.835+0000 7f7acf7fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7ad015da60 0x7f7ad00d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:11.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.835+0000 7f7acffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7ad015e2a0 0x7f7ad00ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:11.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.835+0000 7f7aceffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7ad015de40 0x7f7ad0161d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:38046/0 (socket says 172.21.15.7:38046) 2024-04-25T09:57:11.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.835+0000 7f7aceffd640 1 -- 172.21.15.7:0/153894244 learned_addr learned my addr 172.21.15.7:0/153894244 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:57:11.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.835+0000 7f7acffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7ad015e2a0 0x7f7ad00ce520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:54508/0 (socket says 172.21.15.7:54508) 2024-04-25T09:57:11.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.836+0000 7f7acffff640 1 -- 172.21.15.7:0/153894244 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7ad015da60 msgr2=0x7f7ad00d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:11.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.836+0000 7f7acffff640 1 --2- 172.21.15.7:0/153894244 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7ad015da60 0x7f7ad00d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:11.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.836+0000 7f7acffff640 1 -- 172.21.15.7:0/153894244 >> v1:172.21.15.55:6789/0 conn(0x7f7ad015de40 legacy=0x7f7ad0161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:11.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.836+0000 7f7ace7fc640 1 -- 172.21.15.7:0/153894244 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503412677 0 0) 0x7f7ad015e8a0 con 0x7f7ad015de40 2024-04-25T09:57:11.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.836+0000 7f7acffff640 1 -- 172.21.15.7:0/153894244 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad0161850 con 0x7f7ad015e2a0 2024-04-25T09:57:11.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.836+0000 7f7acf7fe640 1 --2- 172.21.15.7:0/153894244 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7ad015da60 0x7f7ad00d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:57:11.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.837+0000 7f7acffff640 1 --2- 172.21.15.7:0/153894244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ad015e2a0 0x7f7ad00ce520 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8009d90 tx=0x7f7ac802a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9546c7c95eb44169 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:11.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.837+0000 7f7ace7fc640 1 -- 172.21.15.7:0/153894244 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8031600 con 0x7f7ad015e2a0 2024-04-25T09:57:11.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.837+0000 7f7ace7fc640 1 -- 172.21.15.7:0/153894244 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac80317a0 con 0x7f7ad015e2a0 2024-04-25T09:57:11.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.837+0000 7f7ace7fc640 1 -- 172.21.15.7:0/153894244 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8031b70 con 0x7f7ad015e2a0 2024-04-25T09:57:11.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.837+0000 7f7ad5e12640 1 -- 172.21.15.7:0/153894244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ad015e2a0 msgr2=0x7f7ad00ce520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:11.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.837+0000 7f7ad5e12640 1 --2- 172.21.15.7:0/153894244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ad015e2a0 0x7f7ad00ce520 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8009d90 tx=0x7f7ac802a5d0 comp rx=0 tx=0).stop 2024-04-25T09:57:11.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.837+0000 7f7ad5e12640 1 -- 172.21.15.7:0/153894244 shutdown_connections 2024-04-25T09:57:11.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.837+0000 7f7ad5e12640 1 --2- 172.21.15.7:0/153894244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ad015e2a0 0x7f7ad00ce520 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:11.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.837+0000 7f7ad5e12640 1 --2- 172.21.15.7:0/153894244 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7ad015da60 0x7f7ad00d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:11.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.837+0000 7f7ad5e12640 1 -- 172.21.15.7:0/153894244 >> 172.21.15.7:0/153894244 conn(0x7f7ad006bfe0 msgr2=0x7f7ad006c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:11.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.837+0000 7f7ad5e12640 1 -- 172.21.15.7:0/153894244 shutdown_connections 2024-04-25T09:57:11.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.837+0000 7f7ad5e12640 1 -- 172.21.15.7:0/153894244 wait complete. 2024-04-25T09:57:11.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.839+0000 7f7ad5e12640 1 Processor -- start 2024-04-25T09:57:11.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.839+0000 7f7ad5e12640 1 -- start start 2024-04-25T09:57:11.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.839+0000 7f7ad5e12640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ad015da60 0x7f7ad00cb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:11.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.840+0000 7f7ad5e12640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7ad015de40 0x7f7ad01f4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:11.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.840+0000 7f7ad5e12640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ad015e2a0 0x7f7ad00b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:11.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.840+0000 7f7ad5e12640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad00cebe0 con 0x7f7ad015e2a0 2024-04-25T09:57:11.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.840+0000 7f7ad5e12640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad00cea60 con 0x7f7ad015da60 2024-04-25T09:57:11.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.840+0000 7f7ad5e12640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad00ced60 con 0x7f7ad015de40 2024-04-25T09:57:11.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.840+0000 7f7acffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ad015e2a0 0x7f7ad00b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:11.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.840+0000 7f7acffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ad015e2a0 0x7f7ad00b4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49086/0 (socket says 172.21.15.7:49086) 2024-04-25T09:57:11.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.840+0000 7f7acffff640 1 -- 172.21.15.7:0/4292201069 learned_addr learned my addr 172.21.15.7:0/4292201069 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:11.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.840+0000 7f7acf7fe640 1 --2- 172.21.15.7:0/4292201069 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ad015da60 0x7f7ad00cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:11.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.840+0000 7f7aceffd640 1 --2- 172.21.15.7:0/4292201069 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7ad015de40 0x7f7ad01f4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:11.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.840+0000 7f7acffff640 1 -- 172.21.15.7:0/4292201069 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7ad015de40 msgr2=0x7f7ad01f4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:11.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.840+0000 7f7acffff640 1 --2- 172.21.15.7:0/4292201069 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7ad015de40 0x7f7ad01f4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:11.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.840+0000 7f7acffff640 1 -- 172.21.15.7:0/4292201069 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ad015da60 msgr2=0x7f7ad00cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:11.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.840+0000 7f7acffff640 1 --2- 172.21.15.7:0/4292201069 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ad015da60 0x7f7ad00cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:11.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.840+0000 7f7acffff640 1 -- 172.21.15.7:0/4292201069 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad00cc2b0 con 0x7f7ad015e2a0 2024-04-25T09:57:11.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.840+0000 7f7acffff640 1 --2- 172.21.15.7:0/4292201069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ad015e2a0 0x7f7ad00b4e20 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8009d90 tx=0x7f7ac8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:11.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.840+0000 7f7ab7fff640 1 -- 172.21.15.7:0/4292201069 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8040070 con 0x7f7ad015e2a0 2024-04-25T09:57:11.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.840+0000 7f7ab7fff640 1 -- 172.21.15.7:0/4292201069 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac8030be0 con 0x7f7ad015e2a0 2024-04-25T09:57:11.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.841+0000 7f7ad5e12640 1 -- 172.21.15.7:0/4292201069 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad00cc590 con 0x7f7ad015e2a0 2024-04-25T09:57:11.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.841+0000 7f7ab7fff640 1 -- 172.21.15.7:0/4292201069 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8009450 con 0x7f7ad015e2a0 2024-04-25T09:57:11.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.841+0000 7f7ad5e12640 1 -- 172.21.15.7:0/4292201069 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad00cce30 con 0x7f7ad015e2a0 2024-04-25T09:57:11.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.842+0000 7f7ad5e12640 1 -- 172.21.15.7:0/4292201069 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad00cc760 con 0x7f7ad015e2a0 2024-04-25T09:57:11.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.842+0000 7f7ab7fff640 1 -- 172.21.15.7:0/4292201069 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7ac8039040 con 0x7f7ad015e2a0 2024-04-25T09:57:11.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.843+0000 7f7ab7fff640 1 --2- 172.21.15.7:0/4292201069 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7abc06b4d0 0x7f7abc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:11.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.843+0000 7f7acf7fe640 1 --2- 172.21.15.7:0/4292201069 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7abc06b4d0 0x7f7abc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:11.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.843+0000 7f7ab7fff640 1 -- 172.21.15.7:0/4292201069 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f7ac80aac80 con 0x7f7ad015e2a0 2024-04-25T09:57:11.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.843+0000 7f7acf7fe640 1 --2- 172.21.15.7:0/4292201069 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7abc06b4d0 0x7f7abc06d990 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0009560 tx=0x7f7ac0009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:11.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:11.847+0000 7f7ab7fff640 1 -- 172.21.15.7:0/4292201069 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7ac80795f0 con 0x7f7ad015e2a0 2024-04-25T09:57:12.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.095+0000 7f7ad5e12640 1 -- 172.21.15.7:0/4292201069 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7ad0068fd0 con 0x7f7ad015e2a0 2024-04-25T09:57:12.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.095+0000 7f7ab7fff640 1 -- 172.21.15.7:0/4292201069 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f7ac807d690 con 0x7f7ad015e2a0 2024-04-25T09:57:12.099 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:57:12.099 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T09:57:12.099 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_dump": [ 2024-04-25T09:57:12.099 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:57:12.099 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.a", 2024-04-25T09:57:12.099 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmDER5IhAA2ih+YNPXKaTRN6KeMKiDaA==", 2024-04-25T09:57:12.099 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:57:12.099 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:57:12.099 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T09:57:12.099 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T09:57:12.099 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:57:12.100 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:57:12.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:57:12.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:57:12.100 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.b", 2024-04-25T09:57:12.100 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmp55aLhAAD3pB8YjSzrpU6DfjQTVHPw==", 2024-04-25T09:57:12.100 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:57:12.100 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:57:12.100 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T09:57:12.100 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T09:57:12.100 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:57:12.100 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:57:12.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:57:12.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:57:12.101 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.c", 2024-04-25T09:57:12.101 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpm8jBtKRAAiDZo8S/z1fE588t8tiuX8Q==", 2024-04-25T09:57:12.101 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:57:12.101 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:57:12.101 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T09:57:12.101 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T09:57:12.101 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:57:12.101 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:57:12.101 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:57:12.101 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:57:12.101 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.d", 2024-04-25T09:57:12.101 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmZWyRNRAA6tdquR+Hh8Lhx7LATegX6g==", 2024-04-25T09:57:12.101 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:57:12.101 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:57:12.101 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T09:57:12.102 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T09:57:12.102 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:57:12.102 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:57:12.102 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:57:12.102 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:57:12.102 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.0", 2024-04-25T09:57:12.102 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAaKCpmfHZ9HBAA9FYBJbc1QdNt1a9qtFhgBw==", 2024-04-25T09:57:12.102 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:57:12.102 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:57:12.102 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:57:12.102 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:57:12.102 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:57:12.102 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:57:12.102 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:57:12.103 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.1", 2024-04-25T09:57:12.103 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAdKCpmtYOgGhAAbM8XXG5fT+UNSvzvijeJ9Q==", 2024-04-25T09:57:12.103 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:57:12.103 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:57:12.103 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:57:12.103 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:57:12.103 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:57:12.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:57:12.103 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:57:12.103 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.2", 2024-04-25T09:57:12.103 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAgKCpmz4uZGBAA6JD3UWZ/8l12y4lJg0kH0A==", 2024-04-25T09:57:12.103 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:57:12.103 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:57:12.103 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:57:12.104 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:57:12.104 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:57:12.104 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:57:12.104 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:57:12.104 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.3", 2024-04-25T09:57:12.104 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAjKCpmcbXXFhAAsK64H4YqdiD1VJKQtn46OQ==", 2024-04-25T09:57:12.104 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:57:12.104 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:57:12.104 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:57:12.104 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:57:12.104 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:57:12.104 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:57:12.104 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:57:12.104 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.4", 2024-04-25T09:57:12.104 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAsKCpmzEDuKxAAmzxdcdVZIq2bGfG0rYcBBg==", 2024-04-25T09:57:12.105 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:57:12.105 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:57:12.105 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:57:12.105 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:57:12.105 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:57:12.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:57:12.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:57:12.105 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.5", 2024-04-25T09:57:12.105 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAvKCpmfyC4KxAAl6QUtdlRRaRNZpECSoHLJQ==", 2024-04-25T09:57:12.105 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:57:12.105 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:57:12.105 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:57:12.105 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:57:12.105 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:57:12.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:57:12.106 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:57:12.106 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.6", 2024-04-25T09:57:12.106 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAyKCpmBrUsKxAAH5IlxYRXUtPKYWDdTqBp3w==", 2024-04-25T09:57:12.106 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:57:12.106 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:57:12.106 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:57:12.106 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:57:12.106 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:57:12.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:57:12.106 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:57:12.106 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.7", 2024-04-25T09:57:12.106 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQA1KCpmmwTSKhAAdzw/c0Xc6KCQHssqUI910g==", 2024-04-25T09:57:12.106 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:57:12.107 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:57:12.107 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:57:12.107 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:57:12.107 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:57:12.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:57:12.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:57:12.107 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.0", 2024-04-25T09:57:12.107 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmaJKeORAALxC5ZqLLEu0zJFG+SOGukQ==", 2024-04-25T09:57:12.107 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:57:12.107 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:57:12.107 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow r", 2024-04-25T09:57:12.107 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:57:12.107 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:57:12.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:57:12.108 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:57:12.108 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.1", 2024-04-25T09:57:12.108 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAZKCpmC2i6BhAAtKmpTNs/Tga7NtOkm7jSOg==", 2024-04-25T09:57:12.108 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:57:12.108 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:57:12.108 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-04-25T09:57:12.108 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-04-25T09:57:12.108 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-04-25T09:57:12.108 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:57:12.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:57:12.108 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:57:12.108 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.2", 2024-04-25T09:57:12.108 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAZKCpmytCIAxAAhP2UjagzGbz1ySErw1cw3Q==", 2024-04-25T09:57:12.108 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:57:12.109 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:57:12.109 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-04-25T09:57:12.109 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-04-25T09:57:12.109 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-04-25T09:57:12.109 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:57:12.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:57:12.109 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:57:12.109 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.3", 2024-04-25T09:57:12.109 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAZKCpmSj88DBAAg+N3XDyc3H6fUBqkScD/9Q==", 2024-04-25T09:57:12.109 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:57:12.109 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:57:12.109 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-04-25T09:57:12.109 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-04-25T09:57:12.109 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-04-25T09:57:12.110 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:57:12.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:57:12.110 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:57:12.110 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.admin", 2024-04-25T09:57:12.110 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpm8SYpBhAACl5SVNaaKZV7rIIFaFlmvw==", 2024-04-25T09:57:12.110 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:57:12.110 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-04-25T09:57:12.110 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T09:57:12.110 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T09:57:12.110 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:57:12.110 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:57:12.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:57:12.110 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:57:12.110 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.x", 2024-04-25T09:57:12.110 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmqIdPHxAACc5SoI1y74ickl2cPjfGIg==", 2024-04-25T09:57:12.111 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:57:12.111 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-04-25T09:57:12.111 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2024-04-25T09:57:12.111 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:57:12.111 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:57:12.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:57:12.111 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:57:12.111 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.y", 2024-04-25T09:57:12.111 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmCvpDGxAAYsxd6zUjxUgY0sYwR4VvAQ==", 2024-04-25T09:57:12.111 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:57:12.111 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-04-25T09:57:12.111 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2024-04-25T09:57:12.111 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:57:12.111 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:57:12.112 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:57:12.112 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-25T09:57:12.112 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T09:57:12.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.097+0000 7f7ad5e12640 1 -- 172.21.15.7:0/4292201069 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7abc06b4d0 msgr2=0x7f7abc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:12.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.097+0000 7f7ad5e12640 1 --2- 172.21.15.7:0/4292201069 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7abc06b4d0 0x7f7abc06d990 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0009560 tx=0x7f7ac0009190 comp rx=0 tx=0).stop 2024-04-25T09:57:12.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.097+0000 7f7ad5e12640 1 -- 172.21.15.7:0/4292201069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ad015e2a0 msgr2=0x7f7ad00b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:12.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.097+0000 7f7ad5e12640 1 --2- 172.21.15.7:0/4292201069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ad015e2a0 0x7f7ad00b4e20 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8009d90 tx=0x7f7ac8004a40 comp rx=0 tx=0).stop 2024-04-25T09:57:12.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.097+0000 7f7ad5e12640 1 -- 172.21.15.7:0/4292201069 shutdown_connections 2024-04-25T09:57:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.097+0000 7f7ad5e12640 1 --2- 172.21.15.7:0/4292201069 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7abc06b4d0 0x7f7abc06d990 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.097+0000 7f7ad5e12640 1 --2- 172.21.15.7:0/4292201069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ad015e2a0 0x7f7ad00b4e20 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.097+0000 7f7ad5e12640 1 --2- 172.21.15.7:0/4292201069 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7ad015de40 0x7f7ad01f4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.097+0000 7f7ad5e12640 1 --2- 172.21.15.7:0/4292201069 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ad015da60 0x7f7ad00cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.097+0000 7f7ad5e12640 1 -- 172.21.15.7:0/4292201069 >> 172.21.15.7:0/4292201069 conn(0x7f7ad006bfe0 msgr2=0x7f7ad006c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.097+0000 7f7ad5e12640 1 -- 172.21.15.7:0/4292201069 shutdown_connections 2024-04-25T09:57:12.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.097+0000 7f7ad5e12640 1 -- 172.21.15.7:0/4292201069 wait complete. 2024-04-25T09:57:12.114 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:57:12.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.212+0000 7f05c0122640 1 Processor -- start 2024-04-25T09:57:12.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.212+0000 7f05c0122640 1 -- start start 2024-04-25T09:57:12.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.213+0000 7f05c0122640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05b806bc70 0x7f05b809a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:12.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.213+0000 7f05c0122640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f05b806c330 0x7f05b806c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:12.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.213+0000 7f05c0122640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05b80cfad0 con 0x7f05b815da20 2024-04-25T09:57:12.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.213+0000 7f05c0122640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b80d06e0 con 0x7f05b806c330 2024-04-25T09:57:12.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.213+0000 7f05c0122640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b809a940 con 0x7f05b806bc70 2024-04-25T09:57:12.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.213+0000 7f05bdebe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f05b815da20 0x7f05b80d0b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56068/0 (socket says 172.21.15.7:56068) 2024-04-25T09:57:12.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.213+0000 7f05bdebe640 1 -- 172.21.15.7:0/349585515 learned_addr learned my addr 172.21.15.7:0/349585515 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:57:12.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.213+0000 7f05be6bf640 1 --2- 172.21.15.7:0/349585515 >> v2:172.21.15.55:3300/0 conn(0x7f05b806c330 0x7f05b806c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:12.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.213+0000 7f05bd6bd640 1 --2- 172.21.15.7:0/349585515 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05b806bc70 0x7f05b809a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:12.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.213+0000 7f05bcebc640 1 -- 172.21.15.7:0/349585515 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3860745623 0 0) 0x7f05b80cfad0 con 0x7f05b815da20 2024-04-25T09:57:12.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.213+0000 7f05bcebc640 1 -- 172.21.15.7:0/349585515 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05a4003520 con 0x7f05b815da20 2024-04-25T09:57:12.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.214+0000 7f05bcebc640 1 -- 172.21.15.7:0/349585515 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1043925492 0 0) 0x7f05a4003520 con 0x7f05b815da20 2024-04-25T09:57:12.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.214+0000 7f05be6bf640 1 -- 172.21.15.7:0/349585515 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05b806bc70 msgr2=0x7f05b809a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:12.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.214+0000 7f05be6bf640 1 --2- 172.21.15.7:0/349585515 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05b806bc70 0x7f05b809a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:12.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.214+0000 7f05be6bf640 1 -- 172.21.15.7:0/349585515 >> v1:172.21.15.7:6789/0 conn(0x7f05b815da20 legacy=0x7f05b80d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:12.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.214+0000 7f05be6bf640 1 -- 172.21.15.7:0/349585515 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b80cfdb0 con 0x7f05b806c330 2024-04-25T09:57:12.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.214+0000 7f05be6bf640 1 --2- 172.21.15.7:0/349585515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05b806c330 0x7f05b806c7b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f05b0009d90 tx=0x7f05b002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=827075254075db7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:12.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.214+0000 7f05bcebc640 1 -- 172.21.15.7:0/349585515 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b4001670 con 0x7f05b806c330 2024-04-25T09:57:12.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.215+0000 7f05bcebc640 1 -- 172.21.15.7:0/349585515 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b0007540 con 0x7f05b806c330 2024-04-25T09:57:12.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.215+0000 7f05bcebc640 1 -- 172.21.15.7:0/349585515 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b00078f0 con 0x7f05b806c330 2024-04-25T09:57:12.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.215+0000 7f05c0122640 1 -- 172.21.15.7:0/349585515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05b806c330 msgr2=0x7f05b806c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:12.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.215+0000 7f05c0122640 1 --2- 172.21.15.7:0/349585515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05b806c330 0x7f05b806c7b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f05b0009d90 tx=0x7f05b002a5f0 comp rx=0 tx=0).stop 2024-04-25T09:57:12.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.215+0000 7f05c0122640 1 -- 172.21.15.7:0/349585515 shutdown_connections 2024-04-25T09:57:12.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.215+0000 7f05c0122640 1 --2- 172.21.15.7:0/349585515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05b806c330 0x7f05b806c7b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:12.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.215+0000 7f05c0122640 1 --2- 172.21.15.7:0/349585515 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05b806bc70 0x7f05b809a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:12.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.215+0000 7f05c0122640 1 -- 172.21.15.7:0/349585515 >> 172.21.15.7:0/349585515 conn(0x7f05b80d16f0 msgr2=0x7f05b80d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:12.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.215+0000 7f05c0122640 1 -- 172.21.15.7:0/349585515 shutdown_connections 2024-04-25T09:57:12.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.215+0000 7f05c0122640 1 -- 172.21.15.7:0/349585515 wait complete. 2024-04-25T09:57:12.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.216+0000 7f05c0122640 1 Processor -- start 2024-04-25T09:57:12.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.216+0000 7f05c0122640 1 -- start start 2024-04-25T09:57:12.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.217+0000 7f05c0122640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05b806bc70 0x7f05b80c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:12.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.217+0000 7f05c0122640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b806c330 0x7f05b80b6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:12.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.217+0000 7f05c0122640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05b815da20 0x7f05b814ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:12.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.217+0000 7f05c0122640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b80d1280 con 0x7f05b806c330 2024-04-25T09:57:12.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.217+0000 7f05c0122640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b80d0370 con 0x7f05b815da20 2024-04-25T09:57:12.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.217+0000 7f05c0122640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b815de00 con 0x7f05b806bc70 2024-04-25T09:57:12.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.217+0000 7f05bd6bd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b806c330 0x7f05b80b6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:12.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.217+0000 7f05bd6bd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b806c330 0x7f05b80b6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49094/0 (socket says 172.21.15.7:49094) 2024-04-25T09:57:12.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.217+0000 7f05bd6bd640 1 -- 172.21.15.7:0/2447887324 learned_addr learned my addr 172.21.15.7:0/2447887324 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:12.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.217+0000 7f05be6bf640 1 --2- 172.21.15.7:0/2447887324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05b815da20 0x7f05b814ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:12.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.217+0000 7f05bdebe640 1 --2- 172.21.15.7:0/2447887324 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05b806bc70 0x7f05b80c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:12.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.217+0000 7f05bd6bd640 1 -- 172.21.15.7:0/2447887324 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05b806bc70 msgr2=0x7f05b80c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:12.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.217+0000 7f05bd6bd640 1 --2- 172.21.15.7:0/2447887324 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05b806bc70 0x7f05b80c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:12.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.217+0000 7f05bd6bd640 1 -- 172.21.15.7:0/2447887324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05b815da20 msgr2=0x7f05b814ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:12.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.217+0000 7f05bd6bd640 1 --2- 172.21.15.7:0/2447887324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05b815da20 0x7f05b814ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:12.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.218+0000 7f05bd6bd640 1 -- 172.21.15.7:0/2447887324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b80b7000 con 0x7f05b806c330 2024-04-25T09:57:12.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.218+0000 7f05bdebe640 1 --2- 172.21.15.7:0/2447887324 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05b806bc70 0x7f05b80c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:57:12.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.218+0000 7f05bd6bd640 1 --2- 172.21.15.7:0/2447887324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b806c330 0x7f05b80b6820 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f05a800e840 tx=0x7f05a800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:12.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.218+0000 7f05ae7fc640 1 -- 172.21.15.7:0/2447887324 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a8017070 con 0x7f05b806c330 2024-04-25T09:57:12.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.218+0000 7f05ae7fc640 1 -- 172.21.15.7:0/2447887324 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a800c8e0 con 0x7f05b806c330 2024-04-25T09:57:12.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.218+0000 7f05c0122640 1 -- 172.21.15.7:0/2447887324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b80b6d60 con 0x7f05b806c330 2024-04-25T09:57:12.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.218+0000 7f05ae7fc640 1 -- 172.21.15.7:0/2447887324 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a800ccb0 con 0x7f05b806c330 2024-04-25T09:57:12.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.218+0000 7f05c0122640 1 -- 172.21.15.7:0/2447887324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b80b4fa0 con 0x7f05b806c330 2024-04-25T09:57:12.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.219+0000 7f05c0122640 1 -- 172.21.15.7:0/2447887324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b8068fd0 con 0x7f05b806c330 2024-04-25T09:57:12.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.219+0000 7f05ae7fc640 1 -- 172.21.15.7:0/2447887324 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f05a801a070 con 0x7f05b806c330 2024-04-25T09:57:12.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.220+0000 7f05ae7fc640 1 --2- 172.21.15.7:0/2447887324 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f059c06b500 0x7f059c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:12.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.220+0000 7f05ae7fc640 1 -- 172.21.15.7:0/2447887324 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f05a8089d10 con 0x7f05b806c330 2024-04-25T09:57:12.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.220+0000 7f05bdebe640 1 --2- 172.21.15.7:0/2447887324 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f059c06b500 0x7f059c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:12.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.220+0000 7f05bdebe640 1 --2- 172.21.15.7:0/2447887324 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f059c06b500 0x7f059c06d9c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f05b4005880 tx=0x7f05b4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:12.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.224+0000 7f05ae7fc640 1 -- 172.21.15.7:0/2447887324 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f05a8058790 con 0x7f05b806c330 2024-04-25T09:57:12.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.406+0000 7f05c0122640 1 -- 172.21.15.7:0/2447887324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05b80cf030 con 0x7f05b806c330 2024-04-25T09:57:12.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.407+0000 7f05ae7fc640 1 -- 172.21.15.7:0/2447887324 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+13068 (secure 0 0 0) 0x7f05a805c830 con 0x7f05b806c330 2024-04-25T09:57:12.410 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:57:12.410 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":58,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:57:11.718466+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:57:12.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.408+0000 7f05c0122640 1 -- 172.21.15.7:0/2447887324 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f059c06b500 msgr2=0x7f059c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:12.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.408+0000 7f05c0122640 1 --2- 172.21.15.7:0/2447887324 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f059c06b500 0x7f059c06d9c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f05b4005880 tx=0x7f05b4009040 comp rx=0 tx=0).stop 2024-04-25T09:57:12.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.408+0000 7f05c0122640 1 -- 172.21.15.7:0/2447887324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b806c330 msgr2=0x7f05b80b6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:12.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.408+0000 7f05c0122640 1 --2- 172.21.15.7:0/2447887324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b806c330 0x7f05b80b6820 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f05a800e840 tx=0x7f05a800ed00 comp rx=0 tx=0).stop 2024-04-25T09:57:12.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.408+0000 7f05c0122640 1 -- 172.21.15.7:0/2447887324 shutdown_connections 2024-04-25T09:57:12.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.408+0000 7f05c0122640 1 --2- 172.21.15.7:0/2447887324 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f059c06b500 0x7f059c06d9c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:12.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.408+0000 7f05c0122640 1 --2- 172.21.15.7:0/2447887324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05b815da20 0x7f05b814ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:12.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.408+0000 7f05c0122640 1 --2- 172.21.15.7:0/2447887324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b806c330 0x7f05b80b6820 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:12.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.408+0000 7f05c0122640 1 --2- 172.21.15.7:0/2447887324 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05b806bc70 0x7f05b80c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:12.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.408+0000 7f05c0122640 1 -- 172.21.15.7:0/2447887324 >> 172.21.15.7:0/2447887324 conn(0x7f05b80d16f0 msgr2=0x7f05b80d0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:12.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.409+0000 7f05c0122640 1 -- 172.21.15.7:0/2447887324 shutdown_connections 2024-04-25T09:57:12.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.409+0000 7f05c0122640 1 -- 172.21.15.7:0/2447887324 wait complete. 2024-04-25T09:57:12.423 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:57:12.424 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:57:12.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.524+0000 7f55b37f9640 1 Processor -- start 2024-04-25T09:57:12.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.524+0000 7f55b37f9640 1 -- start start 2024-04-25T09:57:12.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.525+0000 7f55b37f9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f55ac0d0780 0x7f55ac0d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:12.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.525+0000 7f55b37f9640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f55ac0b9130 0x7f55ac0d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:12.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.525+0000 7f55b37f9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55ac0d10a0 con 0x7f55ac0b9590 2024-04-25T09:57:12.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.525+0000 7f55b37f9640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55ac0b7ef0 con 0x7f55ac0b9130 2024-04-25T09:57:12.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.525+0000 7f55b37f9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55ac0b81d0 con 0x7f55ac0d0780 2024-04-25T09:57:12.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.525+0000 7f55b0d94640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f55ac0b9130 0x7f55ac0d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:12.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.525+0000 7f55b0d94640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f55ac0b9130 0x7f55ac0d1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49104/0 (socket says 172.21.15.7:49104) 2024-04-25T09:57:12.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.525+0000 7f55b0d94640 1 -- 172.21.15.7:0/3359367495 learned_addr learned my addr 172.21.15.7:0/3359367495 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:12.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.525+0000 7f55b1595640 1 --2- 172.21.15.7:0/3359367495 >> v2:172.21.15.55:3300/0 conn(0x7f55ac0d0780 0x7f55ac0d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:12.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.525+0000 7f55b0d94640 1 -- 172.21.15.7:0/3359367495 >> v2:172.21.15.55:3300/0 conn(0x7f55ac0d0780 msgr2=0x7f55ac0d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:12.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.525+0000 7f55b0d94640 1 --2- 172.21.15.7:0/3359367495 >> v2:172.21.15.55:3300/0 conn(0x7f55ac0d0780 0x7f55ac0d0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:12.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.525+0000 7f55b0d94640 1 -- 172.21.15.7:0/3359367495 >> v1:172.21.15.55:6789/0 conn(0x7f55ac0b9590 legacy=0x7f55ac0d2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:12.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.525+0000 7f55b0d94640 1 -- 172.21.15.7:0/3359367495 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ac0b84b0 con 0x7f55ac0b9130 2024-04-25T09:57:12.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.526+0000 7f55b0d94640 1 --2- 172.21.15.7:0/3359367495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55ac0b9130 0x7f55ac0d1c30 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f55ac0b6180 tx=0x7f559c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11032f5e8c295feb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:12.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.526+0000 7f55a3fff640 1 -- 172.21.15.7:0/3359367495 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559c037070 con 0x7f55ac0b9130 2024-04-25T09:57:12.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.526+0000 7f55a3fff640 1 -- 172.21.15.7:0/3359367495 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559c032440 con 0x7f55ac0b9130 2024-04-25T09:57:12.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.526+0000 7f55a3fff640 1 -- 172.21.15.7:0/3359367495 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559c032810 con 0x7f55ac0b9130 2024-04-25T09:57:12.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.527+0000 7f55b37f9640 1 -- 172.21.15.7:0/3359367495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55ac0b9130 msgr2=0x7f55ac0d1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:12.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.527+0000 7f55b37f9640 1 --2- 172.21.15.7:0/3359367495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55ac0b9130 0x7f55ac0d1c30 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f55ac0b6180 tx=0x7f559c02a270 comp rx=0 tx=0).stop 2024-04-25T09:57:12.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.527+0000 7f55b37f9640 1 -- 172.21.15.7:0/3359367495 shutdown_connections 2024-04-25T09:57:12.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.527+0000 7f55b37f9640 1 --2- 172.21.15.7:0/3359367495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55ac0b9130 0x7f55ac0d1c30 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:12.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.527+0000 7f55b37f9640 1 --2- 172.21.15.7:0/3359367495 >> v2:172.21.15.55:3300/0 conn(0x7f55ac0d0780 0x7f55ac0d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:12.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.527+0000 7f55b37f9640 1 -- 172.21.15.7:0/3359367495 >> 172.21.15.7:0/3359367495 conn(0x7f55ac0726b0 msgr2=0x7f55ac072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:12.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.527+0000 7f55b37f9640 1 -- 172.21.15.7:0/3359367495 shutdown_connections 2024-04-25T09:57:12.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.527+0000 7f55b37f9640 1 -- 172.21.15.7:0/3359367495 wait complete. 2024-04-25T09:57:12.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.528+0000 7f55b37f9640 1 Processor -- start 2024-04-25T09:57:12.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.528+0000 7f55b37f9640 1 -- start start 2024-04-25T09:57:12.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.529+0000 7f55b37f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55ac0b9130 0x7f55ac149b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:12.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.529+0000 7f55b37f9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55ac0b9590 0x7f55ac0cba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:12.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.529+0000 7f55b37f9640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f55ac0d0780 0x7f55ac0cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:12.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.529+0000 7f55b37f9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac1611b0 con 0x7f55ac0b9590 2024-04-25T09:57:12.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.529+0000 7f55b37f9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac0b8a70 con 0x7f55ac0b9130 2024-04-25T09:57:12.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.529+0000 7f55b37f9640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac161330 con 0x7f55ac0d0780 2024-04-25T09:57:12.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.529+0000 7f55b0d94640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55ac0b9590 0x7f55ac0cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:12.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.529+0000 7f55b0d94640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55ac0b9590 0x7f55ac0cba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49118/0 (socket says 172.21.15.7:49118) 2024-04-25T09:57:12.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.529+0000 7f55b0d94640 1 -- 172.21.15.7:0/73054261 learned_addr learned my addr 172.21.15.7:0/73054261 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:12.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.529+0000 7f55b0d94640 1 -- 172.21.15.7:0/73054261 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f55ac0d0780 msgr2=0x7f55ac0cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:12.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.529+0000 7f55b0d94640 1 --2- 172.21.15.7:0/73054261 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f55ac0d0780 0x7f55ac0cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:12.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.529+0000 7f55b0d94640 1 -- 172.21.15.7:0/73054261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55ac0b9130 msgr2=0x7f55ac149b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:12.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.529+0000 7f55b0d94640 1 --2- 172.21.15.7:0/73054261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55ac0b9130 0x7f55ac149b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:12.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.529+0000 7f55b0d94640 1 -- 172.21.15.7:0/73054261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ac0c89e0 con 0x7f55ac0b9590 2024-04-25T09:57:12.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.529+0000 7f55b0d94640 1 --2- 172.21.15.7:0/73054261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55ac0b9590 0x7f55ac0cba40 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f559c000c00 tx=0x7f559c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:12.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.529+0000 7f55a1ffb640 1 -- 172.21.15.7:0/73054261 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559c041020 con 0x7f55ac0b9590 2024-04-25T09:57:12.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.529+0000 7f55a1ffb640 1 -- 172.21.15.7:0/73054261 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559c0306c0 con 0x7f55ac0b9590 2024-04-25T09:57:12.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.530+0000 7f55b37f9640 1 -- 172.21.15.7:0/73054261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55ac0c8cc0 con 0x7f55ac0b9590 2024-04-25T09:57:12.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.530+0000 7f55a1ffb640 1 -- 172.21.15.7:0/73054261 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559c037040 con 0x7f55ac0b9590 2024-04-25T09:57:12.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.530+0000 7f55b37f9640 1 -- 172.21.15.7:0/73054261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55ac0c9280 con 0x7f55ac0b9590 2024-04-25T09:57:12.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.531+0000 7f55b37f9640 1 -- 172.21.15.7:0/73054261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55ac0685d0 con 0x7f55ac0b9590 2024-04-25T09:57:12.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.531+0000 7f55a1ffb640 1 -- 172.21.15.7:0/73054261 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f559c044020 con 0x7f55ac0b9590 2024-04-25T09:57:12.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.532+0000 7f55a1ffb640 1 --2- 172.21.15.7:0/73054261 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f559006b4d0 0x7f559006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:12.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.532+0000 7f55a1ffb640 1 -- 172.21.15.7:0/73054261 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f559c0aa880 con 0x7f55ac0b9590 2024-04-25T09:57:12.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.532+0000 7f55b1595640 1 --2- 172.21.15.7:0/73054261 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f559006b4d0 0x7f559006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:12.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.532+0000 7f55b1595640 1 --2- 172.21.15.7:0/73054261 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f559006b4d0 0x7f559006d990 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f55a8006fd0 tx=0x7f55a8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:12.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.536+0000 7f55a1ffb640 1 -- 172.21.15.7:0/73054261 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f559c04b030 con 0x7f55ac0b9590 2024-04-25T09:57:12.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.716+0000 7f55b37f9640 1 -- 172.21.15.7:0/73054261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f55ac072ce0 con 0x7f55ac0b9590 2024-04-25T09:57:12.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.716+0000 7f55a1ffb640 1 -- 172.21.15.7:0/73054261 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7f559c0798b0 con 0x7f55ac0b9590 2024-04-25T09:57:12.720 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T09:57:12.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.718+0000 7f55b37f9640 1 -- 172.21.15.7:0/73054261 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f559006b4d0 msgr2=0x7f559006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:12.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.718+0000 7f55b37f9640 1 --2- 172.21.15.7:0/73054261 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f559006b4d0 0x7f559006d990 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f55a8006fd0 tx=0x7f55a8008040 comp rx=0 tx=0).stop 2024-04-25T09:57:12.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.718+0000 7f55b37f9640 1 -- 172.21.15.7:0/73054261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55ac0b9590 msgr2=0x7f55ac0cba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:12.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.718+0000 7f55b37f9640 1 --2- 172.21.15.7:0/73054261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55ac0b9590 0x7f55ac0cba40 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f559c000c00 tx=0x7f559c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:57:12.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.718+0000 7f55b37f9640 1 -- 172.21.15.7:0/73054261 shutdown_connections 2024-04-25T09:57:12.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.718+0000 7f55b37f9640 1 --2- 172.21.15.7:0/73054261 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f559006b4d0 0x7f559006d990 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:12.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.718+0000 7f55b37f9640 1 --2- 172.21.15.7:0/73054261 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f55ac0d0780 0x7f55ac0cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:12.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.718+0000 7f55b37f9640 1 --2- 172.21.15.7:0/73054261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55ac0b9590 0x7f55ac0cba40 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:12.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.718+0000 7f55b37f9640 1 --2- 172.21.15.7:0/73054261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55ac0b9130 0x7f55ac149b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:12.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.718+0000 7f55b37f9640 1 -- 172.21.15.7:0/73054261 >> 172.21.15.7:0/73054261 conn(0x7f55ac0726b0 msgr2=0x7f55ac15f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:12.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.719+0000 7f55b37f9640 1 -- 172.21.15.7:0/73054261 shutdown_connections 2024-04-25T09:57:12.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.719+0000 7f55b37f9640 1 -- 172.21.15.7:0/73054261 wait complete. 2024-04-25T09:57:12.733 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:57:12.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.830+0000 7fb4b56fc640 1 Processor -- start 2024-04-25T09:57:12.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.830+0000 7fb4b56fc640 1 -- start start 2024-04-25T09:57:12.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.831+0000 7fb4b56fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb4b00d0330 0x7fb4b00999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:12.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.831+0000 7fb4b56fc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb4b0099f30 0x7fb4b00b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:12.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.831+0000 7fb4b56fc640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4b00ccbc0 con 0x7fb4b015b8e0 2024-04-25T09:57:12.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.831+0000 7fb4b56fc640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4b009a380 con 0x7fb4b00d0330 2024-04-25T09:57:12.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.831+0000 7fb4b56fc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b00cd7d0 con 0x7fb4b0099f30 2024-04-25T09:57:12.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.831+0000 7fb4aeffd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb4b015b8e0 0x7fb4b00cc300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56078/0 (socket says 172.21.15.7:56078) 2024-04-25T09:57:12.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.831+0000 7fb4aeffd640 1 -- 172.21.15.7:0/933462282 learned_addr learned my addr 172.21.15.7:0/933462282 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:57:12.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.832+0000 7fb4ae7fc640 1 --2- 172.21.15.7:0/933462282 >> v2:172.21.15.55:3300/0 conn(0x7fb4b00d0330 0x7fb4b00999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:12.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.832+0000 7fb4af7fe640 1 --2- 172.21.15.7:0/933462282 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb4b0099f30 0x7fb4b00b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:12.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.832+0000 7fb4adffb640 1 -- 172.21.15.7:0/933462282 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1519010338 0 0) 0x7fb4b00ccbc0 con 0x7fb4b015b8e0 2024-04-25T09:57:12.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.832+0000 7fb4adffb640 1 -- 172.21.15.7:0/933462282 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb49c003520 con 0x7fb4b015b8e0 2024-04-25T09:57:12.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.832+0000 7fb4adffb640 1 -- 172.21.15.7:0/933462282 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3727738600 0 0) 0x7fb49c003520 con 0x7fb4b015b8e0 2024-04-25T09:57:12.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.832+0000 7fb4adffb640 1 -- 172.21.15.7:0/933462282 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb4b0099f30 msgr2=0x7fb4b00b0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:12.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.832+0000 7fb4adffb640 1 --2- 172.21.15.7:0/933462282 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb4b0099f30 0x7fb4b00b0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:12.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.832+0000 7fb4adffb640 1 -- 172.21.15.7:0/933462282 >> v2:172.21.15.55:3300/0 conn(0x7fb4b00d0330 msgr2=0x7fb4b00999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:12.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.832+0000 7fb4adffb640 1 --2- 172.21.15.7:0/933462282 >> v2:172.21.15.55:3300/0 conn(0x7fb4b00d0330 0x7fb4b00999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:12.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.832+0000 7fb4adffb640 1 -- 172.21.15.7:0/933462282 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b00ccea0 con 0x7fb4b015b8e0 2024-04-25T09:57:12.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.832+0000 7fb4adffb640 1 -- 172.21.15.7:0/933462282 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fb4a0001a10 con 0x7fb4b015b8e0 2024-04-25T09:57:12.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.832+0000 7fb4adffb640 1 -- 172.21.15.7:0/933462282 >> v1:172.21.15.7:6789/0 conn(0x7fb4b015b8e0 legacy=0x7fb4b00cc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:12.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.832+0000 7fb4adffb640 1 --2- 172.21.15.7:0/933462282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb49c0039b0 0x7fb49c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:12.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.832+0000 7fb4adffb640 1 --2- 172.21.15.7:0/933462282 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb4b0099f30 0x7fb49c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:12.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.832+0000 7fb4adffb640 1 --2- 172.21.15.7:0/933462282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb49c004d40 0x7fb49c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:12.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.832+0000 7fb4adffb640 1 -- 172.21.15.7:0/933462282 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b009a380 con 0x7fb49c004d40 2024-04-25T09:57:12.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.832+0000 7fb4adffb640 1 -- 172.21.15.7:0/933462282 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b00cd7d0 con 0x7fb49c0039b0 2024-04-25T09:57:12.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.832+0000 7fb4adffb640 1 -- 172.21.15.7:0/933462282 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb49c00b9c0 con 0x7fb4b0099f30 2024-04-25T09:57:12.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.832+0000 7fb4af7fe640 1 --2- 172.21.15.7:0/933462282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb49c004d40 0x7fb49c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:12.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.832+0000 7fb4aeffd640 1 --2- 172.21.15.7:0/933462282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb49c0039b0 0x7fb49c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:12.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.832+0000 7fb4ae7fc640 1 --2- 172.21.15.7:0/933462282 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb4b0099f30 0x7fb49c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:12.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.832+0000 7fb4af7fe640 1 -- 172.21.15.7:0/933462282 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb4b0099f30 msgr2=0x7fb49c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:12.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.832+0000 7fb4af7fe640 1 --2- 172.21.15.7:0/933462282 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb4b0099f30 0x7fb49c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:12.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.832+0000 7fb4af7fe640 1 -- 172.21.15.7:0/933462282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb49c0039b0 msgr2=0x7fb49c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:12.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.832+0000 7fb4af7fe640 1 --2- 172.21.15.7:0/933462282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb49c0039b0 0x7fb49c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:12.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.832+0000 7fb4af7fe640 1 -- 172.21.15.7:0/933462282 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49c003520 con 0x7fb49c004d40 2024-04-25T09:57:12.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.833+0000 7fb4af7fe640 1 --2- 172.21.15.7:0/933462282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb49c004d40 0x7fb49c0051c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8009ac0 tx=0x7fb49c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721465c2e9f9f0a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:12.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.833+0000 7fb4adffb640 1 -- 172.21.15.7:0/933462282 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a8036070 con 0x7fb49c004d40 2024-04-25T09:57:12.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.833+0000 7fb4adffb640 1 -- 172.21.15.7:0/933462282 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a8031400 con 0x7fb49c004d40 2024-04-25T09:57:12.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.833+0000 7fb4adffb640 1 -- 172.21.15.7:0/933462282 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a8009690 con 0x7fb49c004d40 2024-04-25T09:57:12.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.834+0000 7fb4b56fc640 1 -- 172.21.15.7:0/933462282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb49c004d40 msgr2=0x7fb49c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:12.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.834+0000 7fb4b56fc640 1 --2- 172.21.15.7:0/933462282 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb49c004d40 0x7fb49c0051c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8009ac0 tx=0x7fb49c005830 comp rx=0 tx=0).stop 2024-04-25T09:57:12.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.834+0000 7fb4af7fe640 1 -- 172.21.15.7:0/933462282 reap_dead start 2024-04-25T09:57:12.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.834+0000 7fb4b56fc640 1 -- 172.21.15.7:0/933462282 shutdown_connections 2024-04-25T09:57:12.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.834+0000 7fb4b56fc640 1 -- 172.21.15.7:0/933462282 >> 172.21.15.7:0/933462282 conn(0x7fb4b00b3130 msgr2=0x7fb4b00b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.834+0000 7fb4b56fc640 1 -- 172.21.15.7:0/933462282 shutdown_connections 2024-04-25T09:57:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.834+0000 7fb4b56fc640 1 -- 172.21.15.7:0/933462282 wait complete. 2024-04-25T09:57:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.835+0000 7fb4b56fc640 1 Processor -- start 2024-04-25T09:57:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.835+0000 7fb4b56fc640 1 -- start start 2024-04-25T09:57:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.836+0000 7fb4b56fc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb49c004d40 0x7fb4b0149070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.836+0000 7fb4b56fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4b0148700 0x7fb4b014a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.836+0000 7fb4b56fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4b0148b80 0x7fb4b014c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.836+0000 7fb4b56fc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b00cd460 con 0x7fb4b0148b80 2024-04-25T09:57:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.836+0000 7fb4b56fc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b00d07c0 con 0x7fb4b0148700 2024-04-25T09:57:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.836+0000 7fb4b56fc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b015bcc0 con 0x7fb49c004d40 2024-04-25T09:57:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.836+0000 7fb4af7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4b0148b80 0x7fb4b014c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.836+0000 7fb4af7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4b0148b80 0x7fb4b014c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49148/0 (socket says 172.21.15.7:49148) 2024-04-25T09:57:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.836+0000 7fb4af7fe640 1 -- 172.21.15.7:0/1612455134 learned_addr learned my addr 172.21.15.7:0/1612455134 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.836+0000 7fb4aeffd640 1 --2- 172.21.15.7:0/1612455134 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb49c004d40 0x7fb4b0149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.836+0000 7fb4ae7fc640 1 --2- 172.21.15.7:0/1612455134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4b0148700 0x7fb4b014a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.836+0000 7fb4af7fe640 1 -- 172.21.15.7:0/1612455134 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb49c004d40 msgr2=0x7fb4b0149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.836+0000 7fb4af7fe640 1 --2- 172.21.15.7:0/1612455134 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb49c004d40 0x7fb4b0149070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:12.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.836+0000 7fb4af7fe640 1 -- 172.21.15.7:0/1612455134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4b0148700 msgr2=0x7fb4b014a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:12.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.836+0000 7fb4af7fe640 1 --2- 172.21.15.7:0/1612455134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4b0148700 0x7fb4b014a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:12.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.836+0000 7fb4af7fe640 1 -- 172.21.15.7:0/1612455134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b0149650 con 0x7fb4b0148b80 2024-04-25T09:57:12.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.836+0000 7fb4ae7fc640 1 --2- 172.21.15.7:0/1612455134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4b0148700 0x7fb4b014a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:57:12.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.837+0000 7fb4af7fe640 1 --2- 172.21.15.7:0/1612455134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4b0148b80 0x7fb4b014c560 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8009be0 tx=0x7fb4a8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:12.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.837+0000 7fb4a77fe640 1 -- 172.21.15.7:0/1612455134 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a8036040 con 0x7fb4b0148b80 2024-04-25T09:57:12.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.837+0000 7fb4a77fe640 1 -- 172.21.15.7:0/1612455134 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a8041070 con 0x7fb4b0148b80 2024-04-25T09:57:12.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.837+0000 7fb4b56fc640 1 -- 172.21.15.7:0/1612455134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4b0149930 con 0x7fb4b0148b80 2024-04-25T09:57:12.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.837+0000 7fb4a77fe640 1 -- 172.21.15.7:0/1612455134 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a8009690 con 0x7fb4b0148b80 2024-04-25T09:57:12.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.837+0000 7fb4b56fc640 1 -- 172.21.15.7:0/1612455134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4b0149ef0 con 0x7fb4b0148b80 2024-04-25T09:57:12.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.838+0000 7fb4b56fc640 1 -- 172.21.15.7:0/1612455134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4b0068fd0 con 0x7fb4b0148b80 2024-04-25T09:57:12.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.839+0000 7fb4a77fe640 1 -- 172.21.15.7:0/1612455134 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb4a8039070 con 0x7fb4b0148b80 2024-04-25T09:57:12.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.839+0000 7fb4a77fe640 1 --2- 172.21.15.7:0/1612455134 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb49006b500 0x7fb49006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:12.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.839+0000 7fb4a77fe640 1 -- 172.21.15.7:0/1612455134 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fb4a80a9890 con 0x7fb4b0148b80 2024-04-25T09:57:12.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.839+0000 7fb4aeffd640 1 --2- 172.21.15.7:0/1612455134 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb49006b500 0x7fb49006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:12.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.839+0000 7fb4aeffd640 1 --2- 172.21.15.7:0/1612455134 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb49006b500 0x7fb49006d9c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0000f80 tx=0x7fb4a0006040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:12.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:12.843+0000 7fb4a77fe640 1 -- 172.21.15.7:0/1612455134 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb4a804a020 con 0x7fb4b0148b80 2024-04-25T09:57:13.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.024+0000 7fb4b56fc640 1 -- 172.21.15.7:0/1612455134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb4b015b0e0 con 0x7fb4b0148b80 2024-04-25T09:57:13.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.025+0000 7fb4a77fe640 1 -- 172.21.15.7:0/1612455134 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v58) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb4a8078840 con 0x7fb4b0148b80 2024-04-25T09:57:13.028 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:57:13.029 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2024-04-25T09:57:13.029 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:57:13.029 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2024-04-25T09:57:13.029 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2024-04-25T09:57:13.029 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:57:13.029 INFO:teuthology.orchestra.run.smithi007.stdout:] 2024-04-25T09:57:13.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.027+0000 7fb4b56fc640 1 -- 172.21.15.7:0/1612455134 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb49006b500 msgr2=0x7fb49006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:13.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.027+0000 7fb4b56fc640 1 --2- 172.21.15.7:0/1612455134 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb49006b500 0x7fb49006d9c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0000f80 tx=0x7fb4a0006040 comp rx=0 tx=0).stop 2024-04-25T09:57:13.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.027+0000 7fb4b56fc640 1 -- 172.21.15.7:0/1612455134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4b0148b80 msgr2=0x7fb4b014c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:13.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.027+0000 7fb4b56fc640 1 --2- 172.21.15.7:0/1612455134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4b0148b80 0x7fb4b014c560 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8009be0 tx=0x7fb4a8004730 comp rx=0 tx=0).stop 2024-04-25T09:57:13.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.027+0000 7fb4b56fc640 1 -- 172.21.15.7:0/1612455134 shutdown_connections 2024-04-25T09:57:13.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.027+0000 7fb4b56fc640 1 --2- 172.21.15.7:0/1612455134 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb49006b500 0x7fb49006d9c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:13.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.027+0000 7fb4b56fc640 1 --2- 172.21.15.7:0/1612455134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4b0148b80 0x7fb4b014c560 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:13.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.027+0000 7fb4b56fc640 1 --2- 172.21.15.7:0/1612455134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4b0148700 0x7fb4b014a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:13.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.027+0000 7fb4b56fc640 1 --2- 172.21.15.7:0/1612455134 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb49c004d40 0x7fb4b0149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:13.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.027+0000 7fb4b56fc640 1 -- 172.21.15.7:0/1612455134 >> 172.21.15.7:0/1612455134 conn(0x7fb4b00b3130 msgr2=0x7fb4b00b23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:13.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.027+0000 7fb4b56fc640 1 -- 172.21.15.7:0/1612455134 shutdown_connections 2024-04-25T09:57:13.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.027+0000 7fb4b56fc640 1 -- 172.21.15.7:0/1612455134 wait complete. 2024-04-25T09:57:13.041 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:57:13.041 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:57:13.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.142+0000 7f8ea9676640 1 Processor -- start 2024-04-25T09:57:13.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.142+0000 7f8ea9676640 1 -- start start 2024-04-25T09:57:13.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.143+0000 7f8ea9676640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8ea41582d0 0x7f8ea40ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:13.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.143+0000 7f8ea9676640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8ea40cd700 0x7f8ea406b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:13.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.143+0000 7f8ea9676640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea40cdd60 con 0x7f8ea406ab60 2024-04-25T09:57:13.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.143+0000 7f8ea9676640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea40cfaf0 con 0x7f8ea41582d0 2024-04-25T09:57:13.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.143+0000 7f8ea9676640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea40cfdd0 con 0x7f8ea40cd700 2024-04-25T09:57:13.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.143+0000 7f8ea2ffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8ea41582d0 0x7f8ea40ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:13.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.143+0000 7f8ea2ffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8ea41582d0 0x7f8ea40ad2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49162/0 (socket says 172.21.15.7:49162) 2024-04-25T09:57:13.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.143+0000 7f8ea2ffd640 1 -- 172.21.15.7:0/1595733523 learned_addr learned my addr 172.21.15.7:0/1595733523 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:13.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.144+0000 7f8ea37fe640 1 --2- 172.21.15.7:0/1595733523 >> v2:172.21.15.55:3300/0 conn(0x7f8ea40cd700 0x7f8ea406b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:13.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.144+0000 7f8ea2ffd640 1 -- 172.21.15.7:0/1595733523 >> v2:172.21.15.55:3300/0 conn(0x7f8ea40cd700 msgr2=0x7f8ea406b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:13.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.144+0000 7f8ea2ffd640 1 --2- 172.21.15.7:0/1595733523 >> v2:172.21.15.55:3300/0 conn(0x7f8ea40cd700 0x7f8ea406b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:13.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.144+0000 7f8ea2ffd640 1 -- 172.21.15.7:0/1595733523 >> v1:172.21.15.55:6789/0 conn(0x7f8ea406ab60 legacy=0x7f8ea40ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:13.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.144+0000 7f8ea2ffd640 1 -- 172.21.15.7:0/1595733523 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea40d00b0 con 0x7f8ea41582d0 2024-04-25T09:57:13.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.144+0000 7f8ea37fe640 1 --2- 172.21.15.7:0/1595733523 >> v2:172.21.15.55:3300/0 conn(0x7f8ea40cd700 0x7f8ea406b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:57:13.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.144+0000 7f8ea2ffd640 1 --2- 172.21.15.7:0/1595733523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ea41582d0 0x7f8ea40ad2c0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4072340 tx=0x7f8e9c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f64ab6f56d3c523c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:13.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.145+0000 7f8ea1ffb640 1 -- 172.21.15.7:0/1595733523 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c037070 con 0x7f8ea41582d0 2024-04-25T09:57:13.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.145+0000 7f8ea1ffb640 1 -- 172.21.15.7:0/1595733523 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9c032440 con 0x7f8ea41582d0 2024-04-25T09:57:13.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.145+0000 7f8ea1ffb640 1 -- 172.21.15.7:0/1595733523 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c032810 con 0x7f8ea41582d0 2024-04-25T09:57:13.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.145+0000 7f8ea9676640 1 -- 172.21.15.7:0/1595733523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ea41582d0 msgr2=0x7f8ea40ad2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:13.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.145+0000 7f8ea9676640 1 --2- 172.21.15.7:0/1595733523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ea41582d0 0x7f8ea40ad2c0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4072340 tx=0x7f8e9c02a1e0 comp rx=0 tx=0).stop 2024-04-25T09:57:13.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.145+0000 7f8ea9676640 1 -- 172.21.15.7:0/1595733523 shutdown_connections 2024-04-25T09:57:13.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.145+0000 7f8ea9676640 1 --2- 172.21.15.7:0/1595733523 >> v2:172.21.15.55:3300/0 conn(0x7f8ea40cd700 0x7f8ea406b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:13.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.145+0000 7f8ea9676640 1 --2- 172.21.15.7:0/1595733523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ea41582d0 0x7f8ea40ad2c0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:13.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.145+0000 7f8ea9676640 1 -- 172.21.15.7:0/1595733523 >> 172.21.15.7:0/1595733523 conn(0x7f8ea4072650 msgr2=0x7f8ea40999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:13.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.145+0000 7f8ea9676640 1 -- 172.21.15.7:0/1595733523 shutdown_connections 2024-04-25T09:57:13.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.145+0000 7f8ea9676640 1 -- 172.21.15.7:0/1595733523 wait complete. 2024-04-25T09:57:13.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.147+0000 7f8ea9676640 1 Processor -- start 2024-04-25T09:57:13.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.147+0000 7f8ea9676640 1 -- start start 2024-04-25T09:57:13.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.147+0000 7f8ea9676640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ea406ab60 0x7f8ea41e8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:13.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.147+0000 7f8ea9676640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ea40cd700 0x7f8ea40af730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:13.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.147+0000 7f8ea9676640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ea41582d0 0x7f8ea41508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:13.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.147+0000 7f8ea9676640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea40d0750 con 0x7f8ea41582d0 2024-04-25T09:57:13.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.147+0000 7f8ea9676640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea40d05d0 con 0x7f8ea40cd700 2024-04-25T09:57:13.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.147+0000 7f8ea9676640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea40d08d0 con 0x7f8ea406ab60 2024-04-25T09:57:13.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.148+0000 7f8ea37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ea41582d0 0x7f8ea41508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:13.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.148+0000 7f8ea37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ea41582d0 0x7f8ea41508c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49168/0 (socket says 172.21.15.7:49168) 2024-04-25T09:57:13.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.148+0000 7f8ea37fe640 1 -- 172.21.15.7:0/2588482207 learned_addr learned my addr 172.21.15.7:0/2588482207 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:13.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.148+0000 7f8ea27fc640 1 --2- 172.21.15.7:0/2588482207 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ea40cd700 0x7f8ea40af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:13.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.148+0000 7f8ea2ffd640 1 --2- 172.21.15.7:0/2588482207 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ea406ab60 0x7f8ea41e8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:13.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.148+0000 7f8ea37fe640 1 -- 172.21.15.7:0/2588482207 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ea406ab60 msgr2=0x7f8ea41e8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:13.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.148+0000 7f8ea37fe640 1 --2- 172.21.15.7:0/2588482207 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ea406ab60 0x7f8ea41e8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:13.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.148+0000 7f8ea37fe640 1 -- 172.21.15.7:0/2588482207 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ea40cd700 msgr2=0x7f8ea40af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:13.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.148+0000 7f8ea37fe640 1 --2- 172.21.15.7:0/2588482207 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ea40cd700 0x7f8ea40af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:13.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.148+0000 7f8ea37fe640 1 -- 172.21.15.7:0/2588482207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea41e9230 con 0x7f8ea41582d0 2024-04-25T09:57:13.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.148+0000 7f8ea37fe640 1 --2- 172.21.15.7:0/2588482207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ea41582d0 0x7f8ea41508c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f8e94007ef0 tx=0x7f8e9400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:13.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.148+0000 7f8e8b7fe640 1 -- 172.21.15.7:0/2588482207 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9401a070 con 0x7f8ea41582d0 2024-04-25T09:57:13.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.148+0000 7f8e8b7fe640 1 -- 172.21.15.7:0/2588482207 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e94003b90 con 0x7f8ea41582d0 2024-04-25T09:57:13.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.148+0000 7f8ea9676640 1 -- 172.21.15.7:0/2588482207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea41e86b0 con 0x7f8ea41582d0 2024-04-25T09:57:13.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.148+0000 7f8e8b7fe640 1 -- 172.21.15.7:0/2588482207 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e94004030 con 0x7f8ea41582d0 2024-04-25T09:57:13.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.148+0000 7f8ea9676640 1 -- 172.21.15.7:0/2588482207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea41e8c70 con 0x7f8ea41582d0 2024-04-25T09:57:13.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.149+0000 7f8ea9676640 1 -- 172.21.15.7:0/2588482207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea4069040 con 0x7f8ea41582d0 2024-04-25T09:57:13.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.150+0000 7f8e8b7fe640 1 -- 172.21.15.7:0/2588482207 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8e9401d070 con 0x7f8ea41582d0 2024-04-25T09:57:13.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.150+0000 7f8e8b7fe640 1 --2- 172.21.15.7:0/2588482207 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8e9006b4d0 0x7f8e9006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:13.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.150+0000 7f8e8b7fe640 1 -- 172.21.15.7:0/2588482207 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f8e9408a230 con 0x7f8ea41582d0 2024-04-25T09:57:13.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.150+0000 7f8ea2ffd640 1 --2- 172.21.15.7:0/2588482207 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8e9006b4d0 0x7f8e9006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:13.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.151+0000 7f8ea2ffd640 1 --2- 172.21.15.7:0/2588482207 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8e9006b4d0 0x7f8e9006d990 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c034000 tx=0x7f8e9c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:13.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.154+0000 7f8e8b7fe640 1 -- 172.21.15.7:0/2588482207 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8e94010070 con 0x7f8ea41582d0 2024-04-25T09:57:13.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.335+0000 7f8ea9676640 1 -- 172.21.15.7:0/2588482207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8ea4072d20 con 0x7f8ea41582d0 2024-04-25T09:57:13.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.722+0000 7f8e8b7fe640 1 -- 172.21.15.7:0/2588482207 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v59) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8e94058c20 con 0x7f8ea41582d0 2024-04-25T09:57:13.725 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2024-04-25T09:57:13.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.724+0000 7f8ea9676640 1 -- 172.21.15.7:0/2588482207 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8e9006b4d0 msgr2=0x7f8e9006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:13.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.724+0000 7f8ea9676640 1 --2- 172.21.15.7:0/2588482207 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8e9006b4d0 0x7f8e9006d990 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c034000 tx=0x7f8e9c02e000 comp rx=0 tx=0).stop 2024-04-25T09:57:13.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.724+0000 7f8ea9676640 1 -- 172.21.15.7:0/2588482207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ea41582d0 msgr2=0x7f8ea41508c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:13.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.724+0000 7f8ea9676640 1 --2- 172.21.15.7:0/2588482207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ea41582d0 0x7f8ea41508c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f8e94007ef0 tx=0x7f8e9400d4a0 comp rx=0 tx=0).stop 2024-04-25T09:57:13.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.725+0000 7f8ea9676640 1 -- 172.21.15.7:0/2588482207 shutdown_connections 2024-04-25T09:57:13.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.725+0000 7f8ea9676640 1 --2- 172.21.15.7:0/2588482207 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8e9006b4d0 0x7f8e9006d990 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:13.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.725+0000 7f8ea9676640 1 --2- 172.21.15.7:0/2588482207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ea41582d0 0x7f8ea41508c0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:13.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.725+0000 7f8ea9676640 1 --2- 172.21.15.7:0/2588482207 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ea40cd700 0x7f8ea40af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:13.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.725+0000 7f8ea9676640 1 --2- 172.21.15.7:0/2588482207 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ea406ab60 0x7f8ea41e8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:13.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.725+0000 7f8ea9676640 1 -- 172.21.15.7:0/2588482207 >> 172.21.15.7:0/2588482207 conn(0x7f8ea4072650 msgr2=0x7f8ea40d0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:13.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.725+0000 7f8ea9676640 1 -- 172.21.15.7:0/2588482207 shutdown_connections 2024-04-25T09:57:13.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.725+0000 7f8ea9676640 1 -- 172.21.15.7:0/2588482207 wait complete. 2024-04-25T09:57:13.743 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:57:13.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.850+0000 7f82e389a640 1 Processor -- start 2024-04-25T09:57:13.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.850+0000 7f82e389a640 1 -- start start 2024-04-25T09:57:13.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.851+0000 7f82e389a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f82dc0cda20 0x7f82dc0cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:13.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.851+0000 7f82e389a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f82dc06bf10 0x7f82dc0999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:13.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.851+0000 7f82e389a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f82dc099f30 0x7f82dc15d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:13.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.851+0000 7f82e389a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82dc0cde00 con 0x7f82dc06bf10 2024-04-25T09:57:13.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.851+0000 7f82e389a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82dc0d02f0 con 0x7f82dc099f30 2024-04-25T09:57:13.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.851+0000 7f82e389a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc0d05d0 con 0x7f82dc0cda20 2024-04-25T09:57:13.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.851+0000 7f82e0e35640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f82dc06bf10 0x7f82dc0999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:13.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.851+0000 7f82e0e35640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f82dc06bf10 0x7f82dc0999f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49184/0 (socket says 172.21.15.7:49184) 2024-04-25T09:57:13.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.851+0000 7f82e0e35640 1 -- 172.21.15.7:0/2629694377 learned_addr learned my addr 172.21.15.7:0/2629694377 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:13.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.851+0000 7f82e1e37640 1 --2- 172.21.15.7:0/2629694377 >> v2:172.21.15.55:3300/0 conn(0x7f82dc099f30 0x7f82dc15d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:13.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.851+0000 7f82e1636640 1 --2- 172.21.15.7:0/2629694377 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f82dc0cda20 0x7f82dc0cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:13.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.851+0000 7f82e0e35640 1 -- 172.21.15.7:0/2629694377 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f82dc0cda20 msgr2=0x7f82dc0cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:13.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.851+0000 7f82e0e35640 1 --2- 172.21.15.7:0/2629694377 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f82dc0cda20 0x7f82dc0cf9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:13.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.851+0000 7f82e0e35640 1 -- 172.21.15.7:0/2629694377 >> v2:172.21.15.55:3300/0 conn(0x7f82dc099f30 msgr2=0x7f82dc15d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:13.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.851+0000 7f82e0e35640 1 --2- 172.21.15.7:0/2629694377 >> v2:172.21.15.55:3300/0 conn(0x7f82dc099f30 0x7f82dc15d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:13.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.851+0000 7f82e0e35640 1 -- 172.21.15.7:0/2629694377 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82dc0d08b0 con 0x7f82dc06bf10 2024-04-25T09:57:13.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.851+0000 7f82e1636640 1 --2- 172.21.15.7:0/2629694377 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f82dc0cda20 0x7f82dc0cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:57:13.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.851+0000 7f82e1e37640 1 --2- 172.21.15.7:0/2629694377 >> v2:172.21.15.55:3300/0 conn(0x7f82dc099f30 0x7f82dc15d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:57:13.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.852+0000 7f82e0e35640 1 --2- 172.21.15.7:0/2629694377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82dc06bf10 0x7f82dc0999f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f82dc0c8680 tx=0x7f82cc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda7ca972f2fec9e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:13.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.852+0000 7f82d3fff640 1 -- 172.21.15.7:0/2629694377 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc037070 con 0x7f82dc06bf10 2024-04-25T09:57:13.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.852+0000 7f82d3fff640 1 -- 172.21.15.7:0/2629694377 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82cc032440 con 0x7f82dc06bf10 2024-04-25T09:57:13.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.852+0000 7f82d3fff640 1 -- 172.21.15.7:0/2629694377 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc032810 con 0x7f82dc06bf10 2024-04-25T09:57:13.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.853+0000 7f82e389a640 1 -- 172.21.15.7:0/2629694377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82dc06bf10 msgr2=0x7f82dc0999f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:13.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.853+0000 7f82e389a640 1 --2- 172.21.15.7:0/2629694377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82dc06bf10 0x7f82dc0999f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f82dc0c8680 tx=0x7f82cc02a1e0 comp rx=0 tx=0).stop 2024-04-25T09:57:13.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.853+0000 7f82e389a640 1 -- 172.21.15.7:0/2629694377 shutdown_connections 2024-04-25T09:57:13.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.853+0000 7f82e389a640 1 --2- 172.21.15.7:0/2629694377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82dc06bf10 0x7f82dc0999f0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:13.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.853+0000 7f82e389a640 1 --2- 172.21.15.7:0/2629694377 >> v2:172.21.15.55:3300/0 conn(0x7f82dc099f30 0x7f82dc15d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:13.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.853+0000 7f82e389a640 1 --2- 172.21.15.7:0/2629694377 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f82dc0cda20 0x7f82dc0cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:13.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.853+0000 7f82e389a640 1 -- 172.21.15.7:0/2629694377 >> 172.21.15.7:0/2629694377 conn(0x7f82dc0b3110 msgr2=0x7f82dc0b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:13.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.853+0000 7f82e389a640 1 -- 172.21.15.7:0/2629694377 shutdown_connections 2024-04-25T09:57:13.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.853+0000 7f82e389a640 1 -- 172.21.15.7:0/2629694377 wait complete. 2024-04-25T09:57:13.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.854+0000 7f82e389a640 1 Processor -- start 2024-04-25T09:57:13.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.854+0000 7f82e389a640 1 -- start start 2024-04-25T09:57:13.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.855+0000 7f82e389a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82dc06bf10 0x7f82dc0b5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:13.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.855+0000 7f82e389a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82dc099f30 0x7f82dc15ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:13.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.855+0000 7f82e389a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f82dc0cda20 0x7f82dc15cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:13.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.855+0000 7f82e389a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc0cff10 con 0x7f82dc06bf10 2024-04-25T09:57:13.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.855+0000 7f82e389a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc0d0e70 con 0x7f82dc099f30 2024-04-25T09:57:13.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.855+0000 7f82e389a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc0d0090 con 0x7f82dc0cda20 2024-04-25T09:57:13.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.855+0000 7f82e1636640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82dc06bf10 0x7f82dc0b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:13.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.855+0000 7f82e1636640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82dc06bf10 0x7f82dc0b5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49200/0 (socket says 172.21.15.7:49200) 2024-04-25T09:57:13.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.855+0000 7f82e1636640 1 -- 172.21.15.7:0/1590718897 learned_addr learned my addr 172.21.15.7:0/1590718897 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:13.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.855+0000 7f82e1636640 1 -- 172.21.15.7:0/1590718897 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f82dc0cda20 msgr2=0x7f82dc15cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:13.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.855+0000 7f82e1636640 1 --2- 172.21.15.7:0/1590718897 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f82dc0cda20 0x7f82dc15cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:13.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.855+0000 7f82e1636640 1 -- 172.21.15.7:0/1590718897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82dc099f30 msgr2=0x7f82dc15ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:13.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.855+0000 7f82e1636640 1 --2- 172.21.15.7:0/1590718897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82dc099f30 0x7f82dc15ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:13.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.855+0000 7f82e1636640 1 -- 172.21.15.7:0/1590718897 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82dc0c8a60 con 0x7f82dc06bf10 2024-04-25T09:57:13.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.855+0000 7f82e1636640 1 --2- 172.21.15.7:0/1590718897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82dc06bf10 0x7f82dc0b5300 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f82d800c820 tx=0x7f82d800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:13.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.855+0000 7f82d1ffb640 1 -- 172.21.15.7:0/1590718897 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d8015070 con 0x7f82dc06bf10 2024-04-25T09:57:13.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.855+0000 7f82d1ffb640 1 -- 172.21.15.7:0/1590718897 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d8007a30 con 0x7f82dc06bf10 2024-04-25T09:57:13.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.855+0000 7f82e389a640 1 -- 172.21.15.7:0/1590718897 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82dc0c8d40 con 0x7f82dc06bf10 2024-04-25T09:57:13.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.855+0000 7f82d1ffb640 1 -- 172.21.15.7:0/1590718897 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d8007de0 con 0x7f82dc06bf10 2024-04-25T09:57:13.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.856+0000 7f82e389a640 1 -- 172.21.15.7:0/1590718897 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82dc0c9300 con 0x7f82dc06bf10 2024-04-25T09:57:13.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.857+0000 7f82e389a640 1 -- 172.21.15.7:0/1590718897 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82dc06ef30 con 0x7f82dc06bf10 2024-04-25T09:57:13.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.857+0000 7f82d1ffb640 1 -- 172.21.15.7:0/1590718897 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f82d8018070 con 0x7f82dc06bf10 2024-04-25T09:57:13.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.858+0000 7f82d1ffb640 1 --2- 172.21.15.7:0/1590718897 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f82c006b4d0 0x7f82c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:13.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.858+0000 7f82d1ffb640 1 -- 172.21.15.7:0/1590718897 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5619+0+0 (secure 0 0 0) 0x7f82d808a110 con 0x7f82dc06bf10 2024-04-25T09:57:13.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.858+0000 7f82e0e35640 1 --2- 172.21.15.7:0/1590718897 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f82c006b4d0 0x7f82c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:13.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.858+0000 7f82e0e35640 1 --2- 172.21.15.7:0/1590718897 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f82c006b4d0 0x7f82c006d990 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f82cc034000 tx=0x7f82cc02c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:13.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:13.862+0000 7f82d1ffb640 1 -- 172.21.15.7:0/1590718897 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f82dc06ef30 con 0x7f82dc06bf10 2024-04-25T09:57:14.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.045+0000 7f82e389a640 1 -- 172.21.15.7:0/1590718897 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f82dc068f60 con 0x7f82dc06bf10 2024-04-25T09:57:14.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.727+0000 7f82d1ffb640 1 -- 172.21.15.7:0/1590718897 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v60) v1 ==== 170+0+0 (secure 0 0 0) 0x7f82d8059070 con 0x7f82dc06bf10 2024-04-25T09:57:14.731 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2024-04-25T09:57:14.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.731+0000 7f82e389a640 1 -- 172.21.15.7:0/1590718897 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f82c006b4d0 msgr2=0x7f82c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:14.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.731+0000 7f82e389a640 1 --2- 172.21.15.7:0/1590718897 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f82c006b4d0 0x7f82c006d990 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f82cc034000 tx=0x7f82cc02c000 comp rx=0 tx=0).stop 2024-04-25T09:57:14.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.731+0000 7f82e389a640 1 -- 172.21.15.7:0/1590718897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82dc06bf10 msgr2=0x7f82dc0b5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:14.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.731+0000 7f82e389a640 1 --2- 172.21.15.7:0/1590718897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82dc06bf10 0x7f82dc0b5300 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f82d800c820 tx=0x7f82d800cc20 comp rx=0 tx=0).stop 2024-04-25T09:57:14.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.731+0000 7f82e389a640 1 -- 172.21.15.7:0/1590718897 shutdown_connections 2024-04-25T09:57:14.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.731+0000 7f82e389a640 1 --2- 172.21.15.7:0/1590718897 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f82c006b4d0 0x7f82c006d990 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:14.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.731+0000 7f82e389a640 1 --2- 172.21.15.7:0/1590718897 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f82dc0cda20 0x7f82dc15cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:14.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.731+0000 7f82e389a640 1 --2- 172.21.15.7:0/1590718897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82dc099f30 0x7f82dc15ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:14.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.731+0000 7f82e389a640 1 --2- 172.21.15.7:0/1590718897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82dc06bf10 0x7f82dc0b5300 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:14.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.731+0000 7f82e389a640 1 -- 172.21.15.7:0/1590718897 >> 172.21.15.7:0/1590718897 conn(0x7f82dc0b3110 msgr2=0x7f82dc0cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:14.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.731+0000 7f82e389a640 1 -- 172.21.15.7:0/1590718897 shutdown_connections 2024-04-25T09:57:14.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.731+0000 7f82e389a640 1 -- 172.21.15.7:0/1590718897 wait complete. 2024-04-25T09:57:14.761 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:57:14.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.866+0000 7f8ec84c4640 1 Processor -- start 2024-04-25T09:57:14.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.866+0000 7f8ec84c4640 1 -- start start 2024-04-25T09:57:14.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.867+0000 7f8ec84c4640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ec00d0780 0x7f8ec00d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:14.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.867+0000 7f8ec84c4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8ec00b9590 0x7f8ec00b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:14.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.867+0000 7f8ec84c4640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ec00d10a0 con 0x7f8ec00b9130 2024-04-25T09:57:14.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.867+0000 7f8ec84c4640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec00b7ef0 con 0x7f8ec00b9590 2024-04-25T09:57:14.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.867+0000 7f8ec84c4640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec00b81d0 con 0x7f8ec00d0780 2024-04-25T09:57:14.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.867+0000 7f8ec5a5f640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f8ec00b9130 0x7f8ec00d1c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56088/0 (socket says 172.21.15.7:56088) 2024-04-25T09:57:14.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.867+0000 7f8ec5a5f640 1 -- 172.21.15.7:0/3801679448 learned_addr learned my addr 172.21.15.7:0/3801679448 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:57:14.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.867+0000 7f8ec6260640 1 --2- 172.21.15.7:0/3801679448 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ec00d0780 0x7f8ec00d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:14.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.867+0000 7f8ec6a61640 1 --2- 172.21.15.7:0/3801679448 >> v2:172.21.15.55:3300/0 conn(0x7f8ec00b9590 0x7f8ec00b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:14.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.867+0000 7f8ec525e640 1 -- 172.21.15.7:0/3801679448 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 580019713 0 0) 0x7f8ec00d10a0 con 0x7f8ec00b9130 2024-04-25T09:57:14.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.867+0000 7f8ec525e640 1 -- 172.21.15.7:0/3801679448 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8eac003520 con 0x7f8ec00b9130 2024-04-25T09:57:14.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.868+0000 7f8ec525e640 1 -- 172.21.15.7:0/3801679448 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 870426575 0 0) 0x7f8eac003520 con 0x7f8ec00b9130 2024-04-25T09:57:14.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.868+0000 7f8ec6260640 1 -- 172.21.15.7:0/3801679448 >> v2:172.21.15.55:3300/0 conn(0x7f8ec00b9590 msgr2=0x7f8ec00b78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:14.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.868+0000 7f8ec6260640 1 --2- 172.21.15.7:0/3801679448 >> v2:172.21.15.55:3300/0 conn(0x7f8ec00b9590 0x7f8ec00b78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:14.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.868+0000 7f8ec6260640 1 -- 172.21.15.7:0/3801679448 >> v1:172.21.15.7:6789/0 conn(0x7f8ec00b9130 legacy=0x7f8ec00d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:14.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.868+0000 7f8ec6260640 1 -- 172.21.15.7:0/3801679448 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec00b84b0 con 0x7f8ec00d0780 2024-04-25T09:57:14.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.868+0000 7f8ec6260640 1 --2- 172.21.15.7:0/3801679448 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ec00d0780 0x7f8ec00d0b60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc0097a0 tx=0x7f8ebc02a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b237da6098e74564 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:14.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.869+0000 7f8ec525e640 1 -- 172.21.15.7:0/3801679448 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc037070 con 0x7f8ec00d0780 2024-04-25T09:57:14.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.869+0000 7f8ec525e640 1 -- 172.21.15.7:0/3801679448 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ebc02aba0 con 0x7f8ec00d0780 2024-04-25T09:57:14.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.869+0000 7f8ec525e640 1 -- 172.21.15.7:0/3801679448 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0001670 con 0x7f8ec00d0780 2024-04-25T09:57:14.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.869+0000 7f8ec84c4640 1 -- 172.21.15.7:0/3801679448 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ec00d0780 msgr2=0x7f8ec00d0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:14.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.869+0000 7f8ec84c4640 1 --2- 172.21.15.7:0/3801679448 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ec00d0780 0x7f8ec00d0b60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc0097a0 tx=0x7f8ebc02a110 comp rx=0 tx=0).stop 2024-04-25T09:57:14.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.869+0000 7f8ec84c4640 1 -- 172.21.15.7:0/3801679448 shutdown_connections 2024-04-25T09:57:14.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.869+0000 7f8ec84c4640 1 --2- 172.21.15.7:0/3801679448 >> v2:172.21.15.55:3300/0 conn(0x7f8ec00b9590 0x7f8ec00b78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:14.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.869+0000 7f8ec84c4640 1 --2- 172.21.15.7:0/3801679448 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ec00d0780 0x7f8ec00d0b60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:14.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.869+0000 7f8ec84c4640 1 -- 172.21.15.7:0/3801679448 >> 172.21.15.7:0/3801679448 conn(0x7f8ec00726b0 msgr2=0x7f8ec0072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:14.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.869+0000 7f8ec84c4640 1 -- 172.21.15.7:0/3801679448 shutdown_connections 2024-04-25T09:57:14.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.869+0000 7f8ec84c4640 1 -- 172.21.15.7:0/3801679448 wait complete. 2024-04-25T09:57:14.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.870+0000 7f8ec84c4640 1 Processor -- start 2024-04-25T09:57:14.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.871+0000 7f8ec84c4640 1 -- start start 2024-04-25T09:57:14.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.871+0000 7f8ec84c4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ec00b9130 0x7f8ec014d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:14.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.871+0000 7f8ec84c4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ec00b9590 0x7f8ec014fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:14.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.871+0000 7f8ec84c4640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ec00d0780 0x7f8ec014c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:14.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.871+0000 7f8ec84c4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec01611b0 con 0x7f8ec00b9130 2024-04-25T09:57:14.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.871+0000 7f8ec84c4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec00b8a70 con 0x7f8ec00b9590 2024-04-25T09:57:14.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.871+0000 7f8ec84c4640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec0161330 con 0x7f8ec00d0780 2024-04-25T09:57:14.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.871+0000 7f8ec6260640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ec00b9130 0x7f8ec014d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:14.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.871+0000 7f8ec6260640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ec00b9130 0x7f8ec014d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49214/0 (socket says 172.21.15.7:49214) 2024-04-25T09:57:14.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.871+0000 7f8ec6260640 1 -- 172.21.15.7:0/1882521806 learned_addr learned my addr 172.21.15.7:0/1882521806 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:14.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.872+0000 7f8ec5a5f640 1 --2- 172.21.15.7:0/1882521806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ec00b9590 0x7f8ec014fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:14.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.872+0000 7f8ec6a61640 1 --2- 172.21.15.7:0/1882521806 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ec00d0780 0x7f8ec014c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:14.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.872+0000 7f8ec6260640 1 -- 172.21.15.7:0/1882521806 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ec00d0780 msgr2=0x7f8ec014c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:14.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.872+0000 7f8ec6260640 1 --2- 172.21.15.7:0/1882521806 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ec00d0780 0x7f8ec014c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:14.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.872+0000 7f8ec6260640 1 -- 172.21.15.7:0/1882521806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ec00b9590 msgr2=0x7f8ec014fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:14.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.872+0000 7f8ec6260640 1 --2- 172.21.15.7:0/1882521806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ec00b9590 0x7f8ec014fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:14.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.872+0000 7f8ec6260640 1 -- 172.21.15.7:0/1882521806 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec014d960 con 0x7f8ec00b9130 2024-04-25T09:57:14.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.872+0000 7f8ec6260640 1 --2- 172.21.15.7:0/1882521806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ec00b9130 0x7f8ec014d270 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc035040 tx=0x7f8ebc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:14.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.872+0000 7f8eb6ffd640 1 -- 172.21.15.7:0/1882521806 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc042020 con 0x7f8ec00b9130 2024-04-25T09:57:14.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.872+0000 7f8eb6ffd640 1 -- 172.21.15.7:0/1882521806 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ebc03d670 con 0x7f8ec00b9130 2024-04-25T09:57:14.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.872+0000 7f8ec84c4640 1 -- 172.21.15.7:0/1882521806 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec014dc40 con 0x7f8ec00b9130 2024-04-25T09:57:14.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.872+0000 7f8eb6ffd640 1 -- 172.21.15.7:0/1882521806 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc037040 con 0x7f8ec00b9130 2024-04-25T09:57:14.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.872+0000 7f8ec84c4640 1 -- 172.21.15.7:0/1882521806 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec014e200 con 0x7f8ec00b9130 2024-04-25T09:57:14.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.873+0000 7f8ec84c4640 1 -- 172.21.15.7:0/1882521806 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec00685d0 con 0x7f8ec00b9130 2024-04-25T09:57:14.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.874+0000 7f8eb6ffd640 1 -- 172.21.15.7:0/1882521806 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8ebc045020 con 0x7f8ec00b9130 2024-04-25T09:57:14.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.874+0000 7f8eb6ffd640 1 --2- 172.21.15.7:0/1882521806 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8ea406b4d0 0x7f8ea406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:14.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.874+0000 7f8eb6ffd640 1 -- 172.21.15.7:0/1882521806 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6001+0+0 (secure 0 0 0) 0x7f8ebc0aa9e0 con 0x7f8ec00b9130 2024-04-25T09:57:14.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.874+0000 7f8ec5a5f640 1 --2- 172.21.15.7:0/1882521806 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8ea406b4d0 0x7f8ea406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:14.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.875+0000 7f8ec5a5f640 1 --2- 172.21.15.7:0/1882521806 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8ea406b4d0 0x7f8ea406d990 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8ec00cbf40 tx=0x7f8eb00057f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:14.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:14.879+0000 7f8eb6ffd640 1 -- 172.21.15.7:0/1882521806 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8ebc04c030 con 0x7f8ec00b9130 2024-04-25T09:57:15.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.096+0000 7f8ec84c4640 1 -- 172.21.15.7:0/1882521806 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8ec0068f60 con 0x7f8ec00b9130 2024-04-25T09:57:15.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.729+0000 7f8eb6ffd640 1 -- 172.21.15.7:0/1882521806 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v26) v1 ==== 173+0+0 (secure 0 0 0) 0x7f8ebc079170 con 0x7f8ec00b9130 2024-04-25T09:57:15.733 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 9 and data pool 10 2024-04-25T09:57:15.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.735+0000 7f8ec84c4640 1 -- 172.21.15.7:0/1882521806 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8ea406b4d0 msgr2=0x7f8ea406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:15.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.735+0000 7f8ec84c4640 1 --2- 172.21.15.7:0/1882521806 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8ea406b4d0 0x7f8ea406d990 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8ec00cbf40 tx=0x7f8eb00057f0 comp rx=0 tx=0).stop 2024-04-25T09:57:15.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.735+0000 7f8ec84c4640 1 -- 172.21.15.7:0/1882521806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ec00b9130 msgr2=0x7f8ec014d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:15.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.735+0000 7f8ec84c4640 1 --2- 172.21.15.7:0/1882521806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ec00b9130 0x7f8ec014d270 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc035040 tx=0x7f8ebc0046c0 comp rx=0 tx=0).stop 2024-04-25T09:57:15.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.735+0000 7f8ec84c4640 1 -- 172.21.15.7:0/1882521806 shutdown_connections 2024-04-25T09:57:15.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.735+0000 7f8ec84c4640 1 --2- 172.21.15.7:0/1882521806 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8ea406b4d0 0x7f8ea406d990 secure :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8ec00cbf40 tx=0x7f8eb00057f0 comp rx=0 tx=0).stop 2024-04-25T09:57:15.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.735+0000 7f8ec84c4640 1 --2- 172.21.15.7:0/1882521806 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ec00d0780 0x7f8ec014c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:15.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.735+0000 7f8ec84c4640 1 --2- 172.21.15.7:0/1882521806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ec00b9590 0x7f8ec014fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:15.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.735+0000 7f8ec84c4640 1 --2- 172.21.15.7:0/1882521806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ec00b9130 0x7f8ec014d270 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:15.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.735+0000 7f8ec84c4640 1 -- 172.21.15.7:0/1882521806 >> 172.21.15.7:0/1882521806 conn(0x7f8ec00726b0 msgr2=0x7f8ec015f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:15.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.736+0000 7f8ec84c4640 1 -- 172.21.15.7:0/1882521806 shutdown_connections 2024-04-25T09:57:15.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.736+0000 7f8ec84c4640 1 -- 172.21.15.7:0/1882521806 wait complete. 2024-04-25T09:57:15.772 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:57:15.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.873+0000 7f095a370640 1 Processor -- start 2024-04-25T09:57:15.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.873+0000 7f095a370640 1 -- start start 2024-04-25T09:57:15.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.874+0000 7f095a370640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f09540b5e60 0x7f095406bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:15.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.874+0000 7f095a370640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f09540b6a40 0x7f095406c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:15.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.874+0000 7f095a370640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f095406ca30 con 0x7f095415dd00 2024-04-25T09:57:15.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.874+0000 7f095a370640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f095415e0e0 con 0x7f09540b5e60 2024-04-25T09:57:15.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.874+0000 7f095a370640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f095406cfe0 con 0x7f09540b6a40 2024-04-25T09:57:15.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.874+0000 7f09537fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f09540b5e60 0x7f095406bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:15.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.874+0000 7f09537fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f09540b5e60 0x7f095406bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49228/0 (socket says 172.21.15.7:49228) 2024-04-25T09:57:15.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.874+0000 7f0953fff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f095415dd00 0x7f09540b5750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56092/0 (socket says 172.21.15.7:56092) 2024-04-25T09:57:15.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.874+0000 7f09537fe640 1 -- 172.21.15.7:0/3779993179 learned_addr learned my addr 172.21.15.7:0/3779993179 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:15.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.875+0000 7f09537fe640 1 -- 172.21.15.7:0/3779993179 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f09540b6a40 msgr2=0x7f095406c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:15.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.875+0000 7f095890d640 1 --2- 172.21.15.7:0/3779993179 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f09540b6a40 0x7f095406c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:15.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.875+0000 7f0952ffd640 1 -- 172.21.15.7:0/3779993179 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3263715693 0 0) 0x7f095406ca30 con 0x7f095415dd00 2024-04-25T09:57:15.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.875+0000 7f09537fe640 1 --2- 172.21.15.7:0/3779993179 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f09540b6a40 0x7f095406c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:15.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.875+0000 7f09537fe640 1 -- 172.21.15.7:0/3779993179 >> v1:172.21.15.7:6789/0 conn(0x7f095415dd00 legacy=0x7f09540b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:15.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.875+0000 7f09537fe640 1 -- 172.21.15.7:0/3779993179 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f095406cd00 con 0x7f09540b5e60 2024-04-25T09:57:15.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.875+0000 7f095890d640 1 --2- 172.21.15.7:0/3779993179 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f09540b6a40 0x7f095406c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:57:15.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.875+0000 7f09537fe640 1 --2- 172.21.15.7:0/3779993179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09540b5e60 0x7f095406bfb0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f093c009870 tx=0x7f093c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f87a55ce6f1afc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:15.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.875+0000 7f0952ffd640 1 -- 172.21.15.7:0/3779993179 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c037070 con 0x7f09540b5e60 2024-04-25T09:57:15.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.875+0000 7f0952ffd640 1 -- 172.21.15.7:0/3779993179 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093c02ae50 con 0x7f09540b5e60 2024-04-25T09:57:15.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.875+0000 7f0952ffd640 1 -- 172.21.15.7:0/3779993179 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c032860 con 0x7f09540b5e60 2024-04-25T09:57:15.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.876+0000 7f095a370640 1 -- 172.21.15.7:0/3779993179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09540b5e60 msgr2=0x7f095406bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:15.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.876+0000 7f095a370640 1 --2- 172.21.15.7:0/3779993179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09540b5e60 0x7f095406bfb0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f093c009870 tx=0x7f093c02a300 comp rx=0 tx=0).stop 2024-04-25T09:57:15.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.876+0000 7f095a370640 1 -- 172.21.15.7:0/3779993179 shutdown_connections 2024-04-25T09:57:15.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.876+0000 7f095a370640 1 --2- 172.21.15.7:0/3779993179 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f09540b6a40 0x7f095406c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:15.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.876+0000 7f095a370640 1 --2- 172.21.15.7:0/3779993179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09540b5e60 0x7f095406bfb0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:15.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.876+0000 7f095a370640 1 -- 172.21.15.7:0/3779993179 >> 172.21.15.7:0/3779993179 conn(0x7f09540d07b0 msgr2=0x7f09540d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:15.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.876+0000 7f095a370640 1 -- 172.21.15.7:0/3779993179 shutdown_connections 2024-04-25T09:57:15.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.876+0000 7f095a370640 1 -- 172.21.15.7:0/3779993179 wait complete. 2024-04-25T09:57:15.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.877+0000 7f095a370640 1 Processor -- start 2024-04-25T09:57:15.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.877+0000 7f095a370640 1 -- start start 2024-04-25T09:57:15.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.878+0000 7f095a370640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f09540b5e60 0x7f095415e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:15.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.878+0000 7f095a370640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09540b6a40 0x7f09540c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:15.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.878+0000 7f095a370640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f095415dd00 0x7f095415a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:15.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.878+0000 7f095a370640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09540d2260 con 0x7f095415dd00 2024-04-25T09:57:15.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.878+0000 7f095a370640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09540d1f80 con 0x7f09540b6a40 2024-04-25T09:57:15.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.878+0000 7f095a370640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09540d2780 con 0x7f09540b5e60 2024-04-25T09:57:15.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.878+0000 7f095890d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f095415dd00 0x7f095415a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:15.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.878+0000 7f095890d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f095415dd00 0x7f095415a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49240/0 (socket says 172.21.15.7:49240) 2024-04-25T09:57:15.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.878+0000 7f095890d640 1 -- 172.21.15.7:0/3011013161 learned_addr learned my addr 172.21.15.7:0/3011013161 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:15.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.878+0000 7f09537fe640 1 --2- 172.21.15.7:0/3011013161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09540b6a40 0x7f09540c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:15.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.878+0000 7f0953fff640 1 --2- 172.21.15.7:0/3011013161 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f09540b5e60 0x7f095415e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:15.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.879+0000 7f095890d640 1 -- 172.21.15.7:0/3011013161 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f09540b5e60 msgr2=0x7f095415e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:15.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.879+0000 7f095890d640 1 --2- 172.21.15.7:0/3011013161 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f09540b5e60 0x7f095415e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:15.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.879+0000 7f095890d640 1 -- 172.21.15.7:0/3011013161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09540b6a40 msgr2=0x7f09540c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:15.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.879+0000 7f095890d640 1 --2- 172.21.15.7:0/3011013161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09540b6a40 0x7f09540c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:15.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.879+0000 7f095890d640 1 -- 172.21.15.7:0/3011013161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0954160890 con 0x7f095415dd00 2024-04-25T09:57:15.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.879+0000 7f095890d640 1 --2- 172.21.15.7:0/3011013161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f095415dd00 0x7f095415a500 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f094c00cef0 tx=0x7f094c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:15.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.879+0000 7f0950ff9640 1 -- 172.21.15.7:0/3011013161 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c01a070 con 0x7f095415dd00 2024-04-25T09:57:15.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.879+0000 7f0950ff9640 1 -- 172.21.15.7:0/3011013161 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094c00d860 con 0x7f095415dd00 2024-04-25T09:57:15.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.879+0000 7f095a370640 1 -- 172.21.15.7:0/3011013161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0954160b70 con 0x7f095415dd00 2024-04-25T09:57:15.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.879+0000 7f0950ff9640 1 -- 172.21.15.7:0/3011013161 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c00dc50 con 0x7f095415dd00 2024-04-25T09:57:15.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.879+0000 7f095a370640 1 -- 172.21.15.7:0/3011013161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09540c9350 con 0x7f095415dd00 2024-04-25T09:57:15.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.880+0000 7f095a370640 1 -- 172.21.15.7:0/3011013161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0954068fd0 con 0x7f095415dd00 2024-04-25T09:57:15.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.880+0000 7f0950ff9640 1 -- 172.21.15.7:0/3011013161 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f094c01d070 con 0x7f095415dd00 2024-04-25T09:57:15.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.881+0000 7f0950ff9640 1 --2- 172.21.15.7:0/3011013161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f093406b4d0 0x7f093406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:15.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.881+0000 7f0950ff9640 1 -- 172.21.15.7:0/3011013161 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f094c08abb0 con 0x7f095415dd00 2024-04-25T09:57:15.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.881+0000 7f0953fff640 1 --2- 172.21.15.7:0/3011013161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f093406b4d0 0x7f093406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:15.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.881+0000 7f0953fff640 1 --2- 172.21.15.7:0/3011013161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f093406b4d0 0x7f093406d990 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0944007fd0 tx=0x7f0944007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:15.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:15.885+0000 7f0950ff9640 1 -- 172.21.15.7:0/3011013161 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f094c059310 con 0x7f095415dd00 2024-04-25T09:57:16.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.065+0000 7f095a370640 1 -- 172.21.15.7:0/3011013161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0954161090 con 0x7f095415dd00 2024-04-25T09:57:16.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.066+0000 7f0950ff9640 1 -- 172.21.15.7:0/3011013161 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16801 (secure 0 0 0) 0x7f094c05d3b0 con 0x7f095415dd00 2024-04-25T09:57:16.070 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:57:16.070 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":61,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:57:15.097966+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:57:13.366946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T09:57:14.076493+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:57:16.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.068+0000 7f095a370640 1 -- 172.21.15.7:0/3011013161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f093406b4d0 msgr2=0x7f093406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:16.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.068+0000 7f095a370640 1 --2- 172.21.15.7:0/3011013161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f093406b4d0 0x7f093406d990 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0944007fd0 tx=0x7f0944007de0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.068+0000 7f095a370640 1 -- 172.21.15.7:0/3011013161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f095415dd00 msgr2=0x7f095415a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:16.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.068+0000 7f095a370640 1 --2- 172.21.15.7:0/3011013161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f095415dd00 0x7f095415a500 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f094c00cef0 tx=0x7f094c00a710 comp rx=0 tx=0).stop 2024-04-25T09:57:16.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.068+0000 7f095a370640 1 -- 172.21.15.7:0/3011013161 shutdown_connections 2024-04-25T09:57:16.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.068+0000 7f095a370640 1 --2- 172.21.15.7:0/3011013161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f093406b4d0 0x7f093406d990 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.068+0000 7f095a370640 1 --2- 172.21.15.7:0/3011013161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f095415dd00 0x7f095415a500 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.068+0000 7f095a370640 1 --2- 172.21.15.7:0/3011013161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09540b6a40 0x7f09540c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.068+0000 7f095a370640 1 --2- 172.21.15.7:0/3011013161 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f09540b5e60 0x7f095415e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.068+0000 7f095a370640 1 -- 172.21.15.7:0/3011013161 >> 172.21.15.7:0/3011013161 conn(0x7f09540d07b0 msgr2=0x7f09540c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:16.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.068+0000 7f095a370640 1 -- 172.21.15.7:0/3011013161 shutdown_connections 2024-04-25T09:57:16.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.068+0000 7f095a370640 1 -- 172.21.15.7:0/3011013161 wait complete. 2024-04-25T09:57:16.083 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:57:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.180+0000 7f7b4461b640 1 Processor -- start 2024-04-25T09:57:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.180+0000 7f7b4461b640 1 -- start start 2024-04-25T09:57:16.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.181+0000 7f7b4461b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7b3c15ee90 0x7f7b3c0ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:16.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.181+0000 7f7b4461b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7b3c15ced0 0x7f7b3c0ce890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:16.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.181+0000 7f7b4461b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7b3c0c5a10 0x7f7b3c0c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:16.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.181+0000 7f7b4461b640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b3c06d1f0 con 0x7f7b3c0c5a10 2024-04-25T09:57:16.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.181+0000 7f7b4461b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b3c06d4d0 con 0x7f7b3c15ee90 2024-04-25T09:57:16.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.181+0000 7f7b4461b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3c06d7b0 con 0x7f7b3c15ced0 2024-04-25T09:57:16.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.181+0000 7f7b42bb8640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7b3c0c5a10 0x7f7b3c0c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:16.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.181+0000 7f7b42bb8640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7b3c0c5a10 0x7f7b3c0c5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49242/0 (socket says 172.21.15.7:49242) 2024-04-25T09:57:16.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.181+0000 7f7b42bb8640 1 -- 172.21.15.7:0/2768829167 learned_addr learned my addr 172.21.15.7:0/2768829167 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:16.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.181+0000 7f7b423b7640 1 --2- 172.21.15.7:0/2768829167 >> v2:172.21.15.55:3300/0 conn(0x7f7b3c15ee90 0x7f7b3c0ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:16.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.181+0000 7f7b41bb6640 1 --2- 172.21.15.7:0/2768829167 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7b3c15ced0 0x7f7b3c0ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:16.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.181+0000 7f7b42bb8640 1 -- 172.21.15.7:0/2768829167 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7b3c15ced0 msgr2=0x7f7b3c0ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:16.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.181+0000 7f7b42bb8640 1 --2- 172.21.15.7:0/2768829167 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7b3c15ced0 0x7f7b3c0ce890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.181+0000 7f7b42bb8640 1 -- 172.21.15.7:0/2768829167 >> v2:172.21.15.55:3300/0 conn(0x7f7b3c15ee90 msgr2=0x7f7b3c0ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:16.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.181+0000 7f7b42bb8640 1 --2- 172.21.15.7:0/2768829167 >> v2:172.21.15.55:3300/0 conn(0x7f7b3c15ee90 0x7f7b3c0ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.181+0000 7f7b42bb8640 1 -- 172.21.15.7:0/2768829167 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3c06da90 con 0x7f7b3c0c5a10 2024-04-25T09:57:16.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.181+0000 7f7b423b7640 1 --2- 172.21.15.7:0/2768829167 >> v2:172.21.15.55:3300/0 conn(0x7f7b3c15ee90 0x7f7b3c0ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:57:16.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.182+0000 7f7b42bb8640 1 --2- 172.21.15.7:0/2768829167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b3c0c5a10 0x7f7b3c0c5e80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c0b58b0 tx=0x7f7b3402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7fb4b9306537f86 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:16.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.182+0000 7f7b413b5640 1 -- 172.21.15.7:0/2768829167 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b34036070 con 0x7f7b3c0c5a10 2024-04-25T09:57:16.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.182+0000 7f7b413b5640 1 -- 172.21.15.7:0/2768829167 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b34031600 con 0x7f7b3c0c5a10 2024-04-25T09:57:16.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.182+0000 7f7b413b5640 1 -- 172.21.15.7:0/2768829167 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b340319d0 con 0x7f7b3c0c5a10 2024-04-25T09:57:16.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.183+0000 7f7b4461b640 1 -- 172.21.15.7:0/2768829167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b3c0c5a10 msgr2=0x7f7b3c0c5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:16.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.183+0000 7f7b4461b640 1 --2- 172.21.15.7:0/2768829167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b3c0c5a10 0x7f7b3c0c5e80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c0b58b0 tx=0x7f7b3402a610 comp rx=0 tx=0).stop 2024-04-25T09:57:16.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.183+0000 7f7b4461b640 1 -- 172.21.15.7:0/2768829167 shutdown_connections 2024-04-25T09:57:16.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.183+0000 7f7b4461b640 1 --2- 172.21.15.7:0/2768829167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b3c0c5a10 0x7f7b3c0c5e80 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.183+0000 7f7b4461b640 1 --2- 172.21.15.7:0/2768829167 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7b3c15ced0 0x7f7b3c0ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.183+0000 7f7b4461b640 1 --2- 172.21.15.7:0/2768829167 >> v2:172.21.15.55:3300/0 conn(0x7f7b3c15ee90 0x7f7b3c0ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.183+0000 7f7b4461b640 1 -- 172.21.15.7:0/2768829167 >> 172.21.15.7:0/2768829167 conn(0x7f7b3c071150 msgr2=0x7f7b3c071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:16.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.183+0000 7f7b4461b640 1 -- 172.21.15.7:0/2768829167 shutdown_connections 2024-04-25T09:57:16.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.183+0000 7f7b4461b640 1 -- 172.21.15.7:0/2768829167 wait complete. 2024-04-25T09:57:16.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.184+0000 7f7b4461b640 1 Processor -- start 2024-04-25T09:57:16.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.184+0000 7f7b4461b640 1 -- start start 2024-04-25T09:57:16.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.185+0000 7f7b4461b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b3c0c5a10 0x7f7b3c150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:16.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.185+0000 7f7b4461b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b3c15ced0 0x7f7b3c158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:16.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.185+0000 7f7b4461b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7b3c15ee90 0x7f7b3c140030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:16.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.185+0000 7f7b4461b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3c0c4660 con 0x7f7b3c0c5a10 2024-04-25T09:57:16.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.185+0000 7f7b4461b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3c0c65d0 con 0x7f7b3c15ced0 2024-04-25T09:57:16.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.185+0000 7f7b4461b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3c0c47e0 con 0x7f7b3c15ee90 2024-04-25T09:57:16.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.185+0000 7f7b423b7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b3c0c5a10 0x7f7b3c150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:16.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.185+0000 7f7b423b7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b3c0c5a10 0x7f7b3c150500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49250/0 (socket says 172.21.15.7:49250) 2024-04-25T09:57:16.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.185+0000 7f7b423b7640 1 -- 172.21.15.7:0/662258463 learned_addr learned my addr 172.21.15.7:0/662258463 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:16.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.185+0000 7f7b41bb6640 1 --2- 172.21.15.7:0/662258463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b3c15ced0 0x7f7b3c158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:16.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.185+0000 7f7b42bb8640 1 --2- 172.21.15.7:0/662258463 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7b3c15ee90 0x7f7b3c140030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:16.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.185+0000 7f7b423b7640 1 -- 172.21.15.7:0/662258463 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7b3c15ee90 msgr2=0x7f7b3c140030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:16.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.185+0000 7f7b423b7640 1 --2- 172.21.15.7:0/662258463 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7b3c15ee90 0x7f7b3c140030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.185+0000 7f7b423b7640 1 -- 172.21.15.7:0/662258463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b3c15ced0 msgr2=0x7f7b3c158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:16.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.185+0000 7f7b423b7640 1 --2- 172.21.15.7:0/662258463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b3c15ced0 0x7f7b3c158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.185+0000 7f7b423b7640 1 -- 172.21.15.7:0/662258463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3c150bc0 con 0x7f7b3c0c5a10 2024-04-25T09:57:16.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.185+0000 7f7b41bb6640 1 --2- 172.21.15.7:0/662258463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b3c15ced0 0x7f7b3c158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:57:16.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.185+0000 7f7b42bb8640 1 --2- 172.21.15.7:0/662258463 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7b3c15ee90 0x7f7b3c140030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:57:16.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.185+0000 7f7b423b7640 1 --2- 172.21.15.7:0/662258463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b3c0c5a10 0x7f7b3c150500 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800c820 tx=0x7f7b3800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:16.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.186+0000 7f7b32ffd640 1 -- 172.21.15.7:0/662258463 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b38015070 con 0x7f7b3c0c5a10 2024-04-25T09:57:16.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.186+0000 7f7b32ffd640 1 -- 172.21.15.7:0/662258463 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b38007a30 con 0x7f7b3c0c5a10 2024-04-25T09:57:16.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.186+0000 7f7b4461b640 1 -- 172.21.15.7:0/662258463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b3c150ea0 con 0x7f7b3c0c5a10 2024-04-25T09:57:16.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.186+0000 7f7b32ffd640 1 -- 172.21.15.7:0/662258463 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b38007de0 con 0x7f7b3c0c5a10 2024-04-25T09:57:16.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.186+0000 7f7b4461b640 1 -- 172.21.15.7:0/662258463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b3c151460 con 0x7f7b3c0c5a10 2024-04-25T09:57:16.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.186+0000 7f7b4461b640 1 -- 172.21.15.7:0/662258463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b3c068fd0 con 0x7f7b3c0c5a10 2024-04-25T09:57:16.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.187+0000 7f7b32ffd640 1 -- 172.21.15.7:0/662258463 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7b38018070 con 0x7f7b3c0c5a10 2024-04-25T09:57:16.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.187+0000 7f7b32ffd640 1 --2- 172.21.15.7:0/662258463 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7b2006b4d0 0x7f7b2006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:16.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.188+0000 7f7b32ffd640 1 -- 172.21.15.7:0/662258463 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7b3808a2d0 con 0x7f7b3c0c5a10 2024-04-25T09:57:16.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.188+0000 7f7b41bb6640 1 --2- 172.21.15.7:0/662258463 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7b2006b4d0 0x7f7b2006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:16.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.188+0000 7f7b41bb6640 1 --2- 172.21.15.7:0/662258463 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7b2006b4d0 0x7f7b2006d990 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c155d80 tx=0x7f7b2c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:16.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.192+0000 7f7b32ffd640 1 -- 172.21.15.7:0/662258463 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7b38058f30 con 0x7f7b3c0c5a10 2024-04-25T09:57:16.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.371+0000 7f7b4461b640 1 -- 172.21.15.7:0/662258463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b3c15bf00 con 0x7f7b3c0c5a10 2024-04-25T09:57:16.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.373+0000 7f7b32ffd640 1 -- 172.21.15.7:0/662258463 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16801 (secure 0 0 0) 0x7f7b38058830 con 0x7f7b3c0c5a10 2024-04-25T09:57:16.376 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:57:16.377 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":61,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:57:15.097966+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:57:13.366946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T09:57:14.076493+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:57:16.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.374+0000 7f7b4461b640 1 -- 172.21.15.7:0/662258463 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7b2006b4d0 msgr2=0x7f7b2006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:16.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.374+0000 7f7b4461b640 1 --2- 172.21.15.7:0/662258463 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7b2006b4d0 0x7f7b2006d990 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c155d80 tx=0x7f7b2c008040 comp rx=0 tx=0).stop 2024-04-25T09:57:16.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.374+0000 7f7b4461b640 1 -- 172.21.15.7:0/662258463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b3c0c5a10 msgr2=0x7f7b3c150500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:16.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.374+0000 7f7b4461b640 1 --2- 172.21.15.7:0/662258463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b3c0c5a10 0x7f7b3c150500 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800c820 tx=0x7f7b3800cce0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.374+0000 7f7b4461b640 1 -- 172.21.15.7:0/662258463 shutdown_connections 2024-04-25T09:57:16.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.374+0000 7f7b4461b640 1 --2- 172.21.15.7:0/662258463 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7b2006b4d0 0x7f7b2006d990 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.374+0000 7f7b4461b640 1 --2- 172.21.15.7:0/662258463 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7b3c15ee90 0x7f7b3c140030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.374+0000 7f7b4461b640 1 --2- 172.21.15.7:0/662258463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b3c15ced0 0x7f7b3c158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.374+0000 7f7b4461b640 1 --2- 172.21.15.7:0/662258463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b3c0c5a10 0x7f7b3c150500 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.374+0000 7f7b4461b640 1 -- 172.21.15.7:0/662258463 >> 172.21.15.7:0/662258463 conn(0x7f7b3c071150 msgr2=0x7f7b3c0b44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:16.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.375+0000 7f7b4461b640 1 -- 172.21.15.7:0/662258463 shutdown_connections 2024-04-25T09:57:16.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.375+0000 7f7b4461b640 1 -- 172.21.15.7:0/662258463 wait complete. 2024-04-25T09:57:16.389 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:57:16.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.489+0000 7fe604cfc640 1 Processor -- start 2024-04-25T09:57:16.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.489+0000 7fe604cfc640 1 -- start start 2024-04-25T09:57:16.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.490+0000 7fe604cfc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6000cf9b0 0x7fe6000cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:16.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.490+0000 7fe604cfc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe6000b2820 0x7fe60015f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:16.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.490+0000 7fe604cfc640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6000cd0e0 con 0x7fe6000cd8a0 2024-04-25T09:57:16.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.490+0000 7fe604cfc640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6000ccd90 con 0x7fe6000b2820 2024-04-25T09:57:16.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.490+0000 7fe604cfc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6000cd410 con 0x7fe6000cf9b0 2024-04-25T09:57:16.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.490+0000 7fe5fed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe6000b2820 0x7fe60015f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:16.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.490+0000 7fe5fdd9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe6000cd8a0 0x7fe6000cfd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:38056/0 (socket says 172.21.15.7:38056) 2024-04-25T09:57:16.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.490+0000 7fe5fdd9b640 1 -- 172.21.15.7:0/4187513773 learned_addr learned my addr 172.21.15.7:0/4187513773 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:57:16.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.490+0000 7fe5fe59c640 1 --2- 172.21.15.7:0/4187513773 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6000cf9b0 0x7fe6000cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:16.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.491+0000 7fe5fe59c640 1 -- 172.21.15.7:0/4187513773 >> v2:172.21.15.55:3300/0 conn(0x7fe6000b2820 msgr2=0x7fe60015f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:16.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.491+0000 7fe5fe59c640 1 --2- 172.21.15.7:0/4187513773 >> v2:172.21.15.55:3300/0 conn(0x7fe6000b2820 0x7fe60015f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.491+0000 7fe5fe59c640 1 -- 172.21.15.7:0/4187513773 >> v1:172.21.15.55:6789/0 conn(0x7fe6000cd8a0 legacy=0x7fe6000cfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:16.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.491+0000 7fe5fe59c640 1 -- 172.21.15.7:0/4187513773 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6000cc7d0 con 0x7fe6000cf9b0 2024-04-25T09:57:16.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.491+0000 7fe5fe59c640 1 --2- 172.21.15.7:0/4187513773 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6000cf9b0 0x7fe6000cc1d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe5f80097a0 tx=0x7fe5f802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0f24dea23ec0655 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:16.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.492+0000 7fe5fd59a640 1 -- 172.21.15.7:0/4187513773 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8037070 con 0x7fe6000cf9b0 2024-04-25T09:57:16.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.492+0000 7fe5fd59a640 1 -- 172.21.15.7:0/4187513773 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f8032440 con 0x7fe6000cf9b0 2024-04-25T09:57:16.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.492+0000 7fe5fd59a640 1 -- 172.21.15.7:0/4187513773 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8032810 con 0x7fe6000cf9b0 2024-04-25T09:57:16.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.492+0000 7fe604cfc640 1 -- 172.21.15.7:0/4187513773 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6000cf9b0 msgr2=0x7fe6000cc1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:16.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.492+0000 7fe604cfc640 1 --2- 172.21.15.7:0/4187513773 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6000cf9b0 0x7fe6000cc1d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe5f80097a0 tx=0x7fe5f802a180 comp rx=0 tx=0).stop 2024-04-25T09:57:16.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.492+0000 7fe604cfc640 1 -- 172.21.15.7:0/4187513773 shutdown_connections 2024-04-25T09:57:16.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.492+0000 7fe604cfc640 1 --2- 172.21.15.7:0/4187513773 >> v2:172.21.15.55:3300/0 conn(0x7fe6000b2820 0x7fe60015f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.492+0000 7fe604cfc640 1 --2- 172.21.15.7:0/4187513773 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6000cf9b0 0x7fe6000cc1d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.492+0000 7fe604cfc640 1 -- 172.21.15.7:0/4187513773 >> 172.21.15.7:0/4187513773 conn(0x7fe6000999f0 msgr2=0x7fe6000b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:16.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.492+0000 7fe604cfc640 1 -- 172.21.15.7:0/4187513773 shutdown_connections 2024-04-25T09:57:16.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.492+0000 7fe604cfc640 1 -- 172.21.15.7:0/4187513773 wait complete. 2024-04-25T09:57:16.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.494+0000 7fe604cfc640 1 Processor -- start 2024-04-25T09:57:16.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.494+0000 7fe604cfc640 1 -- start start 2024-04-25T09:57:16.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.494+0000 7fe604cfc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6000b2820 0x7fe6000b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:16.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.494+0000 7fe604cfc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6000cd8a0 0x7fe6001ef350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:16.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.494+0000 7fe604cfc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6000cf9b0 0x7fe6001f54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:16.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.494+0000 7fe604cfc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60015ba80 con 0x7fe6000b2820 2024-04-25T09:57:16.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.494+0000 7fe604cfc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6000cdce0 con 0x7fe6000cd8a0 2024-04-25T09:57:16.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.495+0000 7fe604cfc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60015bc00 con 0x7fe6000cf9b0 2024-04-25T09:57:16.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.495+0000 7fe5fe59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6000b2820 0x7fe6000b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:16.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.495+0000 7fe5fe59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6000b2820 0x7fe6000b5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49264/0 (socket says 172.21.15.7:49264) 2024-04-25T09:57:16.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.495+0000 7fe5fe59c640 1 -- 172.21.15.7:0/3433744019 learned_addr learned my addr 172.21.15.7:0/3433744019 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:16.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.495+0000 7fe5fdd9b640 1 --2- 172.21.15.7:0/3433744019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6000cd8a0 0x7fe6001ef350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:16.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.495+0000 7fe5fed9d640 1 --2- 172.21.15.7:0/3433744019 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6000cf9b0 0x7fe6001f54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:16.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.495+0000 7fe5fe59c640 1 -- 172.21.15.7:0/3433744019 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6000cf9b0 msgr2=0x7fe6001f54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:16.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.495+0000 7fe5fe59c640 1 --2- 172.21.15.7:0/3433744019 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6000cf9b0 0x7fe6001f54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.495+0000 7fe5fe59c640 1 -- 172.21.15.7:0/3433744019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6000cd8a0 msgr2=0x7fe6001ef350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:16.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.495+0000 7fe5fe59c640 1 --2- 172.21.15.7:0/3433744019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6000cd8a0 0x7fe6001ef350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.495+0000 7fe5fe59c640 1 -- 172.21.15.7:0/3433744019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe600157920 con 0x7fe6000b2820 2024-04-25T09:57:16.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.495+0000 7fe5fe59c640 1 --2- 172.21.15.7:0/3433744019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6000b2820 0x7fe6000b5d50 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8000c00 tx=0x7fe5f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:16.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.495+0000 7fe5f6ffd640 1 -- 172.21.15.7:0/3433744019 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8037040 con 0x7fe6000b2820 2024-04-25T09:57:16.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.495+0000 7fe5f6ffd640 1 -- 172.21.15.7:0/3433744019 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f8042070 con 0x7fe6000b2820 2024-04-25T09:57:16.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.495+0000 7fe604cfc640 1 -- 172.21.15.7:0/3433744019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6000b6290 con 0x7fe6000b2820 2024-04-25T09:57:16.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.495+0000 7fe5f6ffd640 1 -- 172.21.15.7:0/3433744019 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8030900 con 0x7fe6000b2820 2024-04-25T09:57:16.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.496+0000 7fe604cfc640 1 -- 172.21.15.7:0/3433744019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe600157bc0 con 0x7fe6000b2820 2024-04-25T09:57:16.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.496+0000 7fe604cfc640 1 -- 172.21.15.7:0/3433744019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe600068f60 con 0x7fe6000b2820 2024-04-25T09:57:16.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.497+0000 7fe5f6ffd640 1 -- 172.21.15.7:0/3433744019 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe5f8030aa0 con 0x7fe6000b2820 2024-04-25T09:57:16.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.497+0000 7fe5f6ffd640 1 --2- 172.21.15.7:0/3433744019 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe5e006b4d0 0x7fe5e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:16.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.497+0000 7fe5f6ffd640 1 -- 172.21.15.7:0/3433744019 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe5f80aab80 con 0x7fe6000b2820 2024-04-25T09:57:16.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.498+0000 7fe5fdd9b640 1 --2- 172.21.15.7:0/3433744019 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe5e006b4d0 0x7fe5e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:16.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.498+0000 7fe5fdd9b640 1 --2- 172.21.15.7:0/3433744019 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe5e006b4d0 0x7fe5e006d990 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe6000c6e90 tx=0x7fe5e8007e80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:16.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.502+0000 7fe5f6ffd640 1 -- 172.21.15.7:0/3433744019 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe5f80792b0 con 0x7fe6000b2820 2024-04-25T09:57:16.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.719+0000 7fe604cfc640 1 -- 172.21.15.7:0/3433744019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe60015a100 con 0x7fe6000b2820 2024-04-25T09:57:16.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.752+0000 7fe5f6ffd640 1 -- 172.21.15.7:0/3433744019 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v27) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe5f807d350 con 0x7fe6000b2820 2024-04-25T09:57:16.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.755+0000 7fe604cfc640 1 -- 172.21.15.7:0/3433744019 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe5e006b4d0 msgr2=0x7fe5e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:16.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.755+0000 7fe604cfc640 1 --2- 172.21.15.7:0/3433744019 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe5e006b4d0 0x7fe5e006d990 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe6000c6e90 tx=0x7fe5e8007e80 comp rx=0 tx=0).stop 2024-04-25T09:57:16.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.755+0000 7fe604cfc640 1 -- 172.21.15.7:0/3433744019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6000b2820 msgr2=0x7fe6000b5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:16.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.755+0000 7fe604cfc640 1 --2- 172.21.15.7:0/3433744019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6000b2820 0x7fe6000b5d50 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8000c00 tx=0x7fe5f80046c0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.755+0000 7fe604cfc640 1 -- 172.21.15.7:0/3433744019 shutdown_connections 2024-04-25T09:57:16.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.755+0000 7fe604cfc640 1 --2- 172.21.15.7:0/3433744019 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe5e006b4d0 0x7fe5e006d990 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.755+0000 7fe604cfc640 1 --2- 172.21.15.7:0/3433744019 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6000cf9b0 0x7fe6001f54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.755+0000 7fe604cfc640 1 --2- 172.21.15.7:0/3433744019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6000cd8a0 0x7fe6001ef350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.755+0000 7fe604cfc640 1 --2- 172.21.15.7:0/3433744019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6000b2820 0x7fe6000b5d50 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.755+0000 7fe604cfc640 1 -- 172.21.15.7:0/3433744019 >> 172.21.15.7:0/3433744019 conn(0x7fe6000999f0 msgr2=0x7fe600154970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:16.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.756+0000 7fe604cfc640 1 -- 172.21.15.7:0/3433744019 shutdown_connections 2024-04-25T09:57:16.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.756+0000 7fe604cfc640 1 -- 172.21.15.7:0/3433744019 wait complete. 2024-04-25T09:57:16.770 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:57:16.770 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:57:16.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.870+0000 7f5c0c63a640 1 Processor -- start 2024-04-25T09:57:16.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.870+0000 7f5c0c63a640 1 -- start start 2024-04-25T09:57:16.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.871+0000 7f5c0c63a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5c04162240 0x7f5c0406fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:16.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.871+0000 7f5c0c63a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5c040b2cd0 0x7f5c0406ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:16.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.871+0000 7f5c0c63a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5c0406b0a0 0x7f5c0415d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:16.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.871+0000 7f5c0c63a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c040b2aa0 con 0x7f5c0406b0a0 2024-04-25T09:57:16.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.871+0000 7f5c0c63a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c0406b500 con 0x7f5c040b2cd0 2024-04-25T09:57:16.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.871+0000 7f5c0c63a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0406ff60 con 0x7f5c04162240 2024-04-25T09:57:16.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.871+0000 7f5c0abd7640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5c0406b0a0 0x7f5c0415d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:16.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.871+0000 7f5c0abd7640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5c0406b0a0 0x7f5c0415d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49268/0 (socket says 172.21.15.7:49268) 2024-04-25T09:57:16.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.871+0000 7f5c0abd7640 1 -- 172.21.15.7:0/2666020210 learned_addr learned my addr 172.21.15.7:0/2666020210 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:16.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.871+0000 7f5c09bd5640 1 --2- 172.21.15.7:0/2666020210 >> v2:172.21.15.55:3300/0 conn(0x7f5c040b2cd0 0x7f5c0406ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:16.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.871+0000 7f5c0a3d6640 1 --2- 172.21.15.7:0/2666020210 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5c04162240 0x7f5c0406fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:16.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.871+0000 7f5c0abd7640 1 -- 172.21.15.7:0/2666020210 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5c04162240 msgr2=0x7f5c0406fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:16.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.871+0000 7f5c0abd7640 1 --2- 172.21.15.7:0/2666020210 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5c04162240 0x7f5c0406fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.871+0000 7f5c0abd7640 1 -- 172.21.15.7:0/2666020210 >> v2:172.21.15.55:3300/0 conn(0x7f5c040b2cd0 msgr2=0x7f5c0406ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:16.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.871+0000 7f5c0abd7640 1 --2- 172.21.15.7:0/2666020210 >> v2:172.21.15.55:3300/0 conn(0x7f5c040b2cd0 0x7f5c0406ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.871+0000 7f5c0abd7640 1 -- 172.21.15.7:0/2666020210 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0415e150 con 0x7f5c0406b0a0 2024-04-25T09:57:16.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.872+0000 7f5c0abd7640 1 --2- 172.21.15.7:0/2666020210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c0406b0a0 0x7f5c0415d240 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f5c0409a2a0 tx=0x7f5bfc02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2802f07e91eaec68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:16.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.872+0000 7f5c093d4640 1 -- 172.21.15.7:0/2666020210 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc036070 con 0x7f5c0406b0a0 2024-04-25T09:57:16.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.872+0000 7f5c093d4640 1 -- 172.21.15.7:0/2666020210 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bfc031600 con 0x7f5c0406b0a0 2024-04-25T09:57:16.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.872+0000 7f5c093d4640 1 -- 172.21.15.7:0/2666020210 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc0319d0 con 0x7f5c0406b0a0 2024-04-25T09:57:16.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.873+0000 7f5c0c63a640 1 -- 172.21.15.7:0/2666020210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c0406b0a0 msgr2=0x7f5c0415d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:16.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.873+0000 7f5c0c63a640 1 --2- 172.21.15.7:0/2666020210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c0406b0a0 0x7f5c0415d240 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f5c0409a2a0 tx=0x7f5bfc02a6c0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.873+0000 7f5c0c63a640 1 -- 172.21.15.7:0/2666020210 shutdown_connections 2024-04-25T09:57:16.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.873+0000 7f5c0c63a640 1 --2- 172.21.15.7:0/2666020210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c0406b0a0 0x7f5c0415d240 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.873+0000 7f5c0c63a640 1 --2- 172.21.15.7:0/2666020210 >> v2:172.21.15.55:3300/0 conn(0x7f5c040b2cd0 0x7f5c0406ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.873+0000 7f5c0c63a640 1 --2- 172.21.15.7:0/2666020210 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5c04162240 0x7f5c0406fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.873+0000 7f5c0c63a640 1 -- 172.21.15.7:0/2666020210 >> 172.21.15.7:0/2666020210 conn(0x7f5c040999f0 msgr2=0x7f5c040b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:16.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.873+0000 7f5c0c63a640 1 -- 172.21.15.7:0/2666020210 shutdown_connections 2024-04-25T09:57:16.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.873+0000 7f5c0c63a640 1 -- 172.21.15.7:0/2666020210 wait complete. 2024-04-25T09:57:16.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.874+0000 7f5c0c63a640 1 Processor -- start 2024-04-25T09:57:16.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.874+0000 7f5c0c63a640 1 -- start start 2024-04-25T09:57:16.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.875+0000 7f5c0c63a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c0406b0a0 0x7f5c041f3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:16.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.875+0000 7f5c0c63a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c040b2cd0 0x7f5c040b3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:16.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.875+0000 7f5c0c63a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5c04162240 0x7f5c040b3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:16.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.875+0000 7f5c0c63a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0415e3f0 con 0x7f5c040b2cd0 2024-04-25T09:57:16.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.875+0000 7f5c0c63a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0415eed0 con 0x7f5c0406b0a0 2024-04-25T09:57:16.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.875+0000 7f5c0c63a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0415e6d0 con 0x7f5c04162240 2024-04-25T09:57:16.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.875+0000 7f5c09bd5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c040b2cd0 0x7f5c040b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:16.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.875+0000 7f5c09bd5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c040b2cd0 0x7f5c040b3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49270/0 (socket says 172.21.15.7:49270) 2024-04-25T09:57:16.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.875+0000 7f5c09bd5640 1 -- 172.21.15.7:0/3667837480 learned_addr learned my addr 172.21.15.7:0/3667837480 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:16.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.875+0000 7f5c0a3d6640 1 --2- 172.21.15.7:0/3667837480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c0406b0a0 0x7f5c041f3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:16.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.875+0000 7f5c0abd7640 1 --2- 172.21.15.7:0/3667837480 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5c04162240 0x7f5c040b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:16.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.876+0000 7f5c09bd5640 1 -- 172.21.15.7:0/3667837480 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5c04162240 msgr2=0x7f5c040b3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:16.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.876+0000 7f5c09bd5640 1 --2- 172.21.15.7:0/3667837480 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5c04162240 0x7f5c040b3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.876+0000 7f5c09bd5640 1 -- 172.21.15.7:0/3667837480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c0406b0a0 msgr2=0x7f5c041f3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:16.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.876+0000 7f5c09bd5640 1 --2- 172.21.15.7:0/3667837480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c0406b0a0 0x7f5c041f3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:16.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.876+0000 7f5c09bd5640 1 -- 172.21.15.7:0/3667837480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c041f3a20 con 0x7f5c040b2cd0 2024-04-25T09:57:16.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.876+0000 7f5c09bd5640 1 --2- 172.21.15.7:0/3667837480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c040b2cd0 0x7f5c040b3410 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f5bf400e890 tx=0x7f5bf400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:16.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.876+0000 7f5bfaffd640 1 -- 172.21.15.7:0/3667837480 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf4017070 con 0x7f5c040b2cd0 2024-04-25T09:57:16.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.876+0000 7f5bfaffd640 1 -- 172.21.15.7:0/3667837480 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf400c940 con 0x7f5c040b2cd0 2024-04-25T09:57:16.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.876+0000 7f5c0c63a640 1 -- 172.21.15.7:0/3667837480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c041f3c90 con 0x7f5c040b2cd0 2024-04-25T09:57:16.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.876+0000 7f5bfaffd640 1 -- 172.21.15.7:0/3667837480 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf400cd10 con 0x7f5c040b2cd0 2024-04-25T09:57:16.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.876+0000 7f5c0c63a640 1 -- 172.21.15.7:0/3667837480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c041f4250 con 0x7f5c040b2cd0 2024-04-25T09:57:16.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.877+0000 7f5c0c63a640 1 -- 172.21.15.7:0/3667837480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c04068f60 con 0x7f5c040b2cd0 2024-04-25T09:57:16.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.877+0000 7f5bfaffd640 1 -- 172.21.15.7:0/3667837480 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5bf401a070 con 0x7f5c040b2cd0 2024-04-25T09:57:16.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.878+0000 7f5bfaffd640 1 --2- 172.21.15.7:0/3667837480 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5be806b4d0 0x7f5be806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:16.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.878+0000 7f5bfaffd640 1 -- 172.21.15.7:0/3667837480 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5bf408a6a0 con 0x7f5c040b2cd0 2024-04-25T09:57:16.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.878+0000 7f5c0a3d6640 1 --2- 172.21.15.7:0/3667837480 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5be806b4d0 0x7f5be806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:16.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.878+0000 7f5c0a3d6640 1 --2- 172.21.15.7:0/3667837480 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5be806b4d0 0x7f5be806d990 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5c00006fd0 tx=0x7f5c00008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:16.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:16.882+0000 7f5bfaffd640 1 -- 172.21.15.7:0/3667837480 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5bf4058cc0 con 0x7f5c040b2cd0 2024-04-25T09:57:17.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.100+0000 7f5c0c63a640 1 -- 172.21.15.7:0/3667837480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5c0406b690 con 0x7f5c040b2cd0 2024-04-25T09:57:17.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.762+0000 7f5bfaffd640 1 -- 172.21.15.7:0/3667837480 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5bf405cd60 con 0x7f5c040b2cd0 2024-04-25T09:57:17.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.766+0000 7f5c0c63a640 1 -- 172.21.15.7:0/3667837480 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5be806b4d0 msgr2=0x7f5be806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:17.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.766+0000 7f5c0c63a640 1 --2- 172.21.15.7:0/3667837480 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5be806b4d0 0x7f5be806d990 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5c00006fd0 tx=0x7f5c00008040 comp rx=0 tx=0).stop 2024-04-25T09:57:17.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.766+0000 7f5c0c63a640 1 -- 172.21.15.7:0/3667837480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c040b2cd0 msgr2=0x7f5c040b3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:17.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.766+0000 7f5c0c63a640 1 --2- 172.21.15.7:0/3667837480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c040b2cd0 0x7f5c040b3410 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f5bf400e890 tx=0x7f5bf400ed50 comp rx=0 tx=0).stop 2024-04-25T09:57:17.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.766+0000 7f5c0c63a640 1 -- 172.21.15.7:0/3667837480 shutdown_connections 2024-04-25T09:57:17.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.766+0000 7f5c0c63a640 1 --2- 172.21.15.7:0/3667837480 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5be806b4d0 0x7f5be806d990 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:17.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.766+0000 7f5c0c63a640 1 --2- 172.21.15.7:0/3667837480 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5c04162240 0x7f5c040b3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:17.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.766+0000 7f5c0c63a640 1 --2- 172.21.15.7:0/3667837480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c040b2cd0 0x7f5c040b3410 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:17.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.766+0000 7f5c0c63a640 1 --2- 172.21.15.7:0/3667837480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c0406b0a0 0x7f5c041f3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:17.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.766+0000 7f5c0c63a640 1 -- 172.21.15.7:0/3667837480 >> 172.21.15.7:0/3667837480 conn(0x7f5c040999f0 msgr2=0x7f5c040b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:17.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.766+0000 7f5c0c63a640 1 -- 172.21.15.7:0/3667837480 shutdown_connections 2024-04-25T09:57:17.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.766+0000 7f5c0c63a640 1 -- 172.21.15.7:0/3667837480 wait complete. 2024-04-25T09:57:17.783 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:57:17.783 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:57:17.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.888+0000 7f93f833b640 1 Processor -- start 2024-04-25T09:57:17.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.888+0000 7f93f833b640 1 -- start start 2024-04-25T09:57:17.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.889+0000 7f93f833b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f00b3d30 0x7f93f00b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:17.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.889+0000 7f93f833b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f93f00b4960 0x7f93f006d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:17.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.889+0000 7f93f833b640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f00b2c90 con 0x7f93f01474f0 2024-04-25T09:57:17.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.889+0000 7f93f833b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f00b2a40 con 0x7f93f00b4960 2024-04-25T09:57:17.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.889+0000 7f93f833b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f00b38a0 con 0x7f93f00b3d30 2024-04-25T09:57:17.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.889+0000 7f93f60d7640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f93f01474f0 0x7f93f00ae820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56106/0 (socket says 172.21.15.7:56106) 2024-04-25T09:57:17.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.889+0000 7f93f60d7640 1 -- 172.21.15.7:0/638405606 learned_addr learned my addr 172.21.15.7:0/638405606 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:57:17.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.889+0000 7f93f58d6640 1 --2- 172.21.15.7:0/638405606 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f00b3d30 0x7f93f00b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:17.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.889+0000 7f93f68d8640 1 --2- 172.21.15.7:0/638405606 >> v2:172.21.15.55:3300/0 conn(0x7f93f00b4960 0x7f93f006d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:17.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.889+0000 7f93f50d5640 1 -- 172.21.15.7:0/638405606 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2217020572 0 0) 0x7f93f00b2c90 con 0x7f93f01474f0 2024-04-25T09:57:17.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.889+0000 7f93f50d5640 1 -- 172.21.15.7:0/638405606 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93dc003520 con 0x7f93f01474f0 2024-04-25T09:57:17.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.889+0000 7f93f68d8640 1 -- 172.21.15.7:0/638405606 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f00b3d30 msgr2=0x7f93f00b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:17.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.889+0000 7f93f68d8640 1 --2- 172.21.15.7:0/638405606 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f00b3d30 0x7f93f00b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:17.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.890+0000 7f93f50d5640 1 -- 172.21.15.7:0/638405606 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3162503338 0 0) 0x7f93dc003520 con 0x7f93f01474f0 2024-04-25T09:57:17.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.890+0000 7f93f68d8640 1 -- 172.21.15.7:0/638405606 >> v1:172.21.15.7:6789/0 conn(0x7f93f01474f0 legacy=0x7f93f00ae820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:17.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.890+0000 7f93f68d8640 1 -- 172.21.15.7:0/638405606 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f00b2f70 con 0x7f93f00b4960 2024-04-25T09:57:17.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.890+0000 7f93f58d6640 1 --2- 172.21.15.7:0/638405606 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f00b3d30 0x7f93f00b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:57:17.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.890+0000 7f93f68d8640 1 --2- 172.21.15.7:0/638405606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f00b4960 0x7f93f006d620 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f93e8009d90 tx=0x7f93e802a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bb7bcc148b55b95 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:17.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.891+0000 7f93f50d5640 1 -- 172.21.15.7:0/638405606 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ec001670 con 0x7f93f00b4960 2024-04-25T09:57:17.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.891+0000 7f93f50d5640 1 -- 172.21.15.7:0/638405606 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e8007540 con 0x7f93f00b4960 2024-04-25T09:57:17.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.891+0000 7f93f50d5640 1 -- 172.21.15.7:0/638405606 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e80078f0 con 0x7f93f00b4960 2024-04-25T09:57:17.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.891+0000 7f93f833b640 1 -- 172.21.15.7:0/638405606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f00b4960 msgr2=0x7f93f006d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:17.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.891+0000 7f93f833b640 1 --2- 172.21.15.7:0/638405606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f00b4960 0x7f93f006d620 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f93e8009d90 tx=0x7f93e802a5f0 comp rx=0 tx=0).stop 2024-04-25T09:57:17.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.891+0000 7f93f833b640 1 -- 172.21.15.7:0/638405606 shutdown_connections 2024-04-25T09:57:17.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.891+0000 7f93f833b640 1 --2- 172.21.15.7:0/638405606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f00b4960 0x7f93f006d620 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:17.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.891+0000 7f93f833b640 1 --2- 172.21.15.7:0/638405606 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f00b3d30 0x7f93f00b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:17.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.891+0000 7f93f833b640 1 -- 172.21.15.7:0/638405606 >> 172.21.15.7:0/638405606 conn(0x7f93f00b1740 msgr2=0x7f93f00b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.891+0000 7f93f833b640 1 -- 172.21.15.7:0/638405606 shutdown_connections 2024-04-25T09:57:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.891+0000 7f93f833b640 1 -- 172.21.15.7:0/638405606 wait complete. 2024-04-25T09:57:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.892+0000 7f93f833b640 1 Processor -- start 2024-04-25T09:57:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.892+0000 7f93f833b640 1 -- start start 2024-04-25T09:57:17.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.893+0000 7f93f833b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f00b3d30 0x7f93f013fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:17.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.893+0000 7f93f833b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f00b4960 0x7f93f01540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:17.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.893+0000 7f93f833b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93f01474f0 0x7f93f013e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:17.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.893+0000 7f93f833b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f00b3530 con 0x7f93f01474f0 2024-04-25T09:57:17.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.893+0000 7f93f833b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f00b4db0 con 0x7f93f00b4960 2024-04-25T09:57:17.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.893+0000 7f93f833b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f00aef30 con 0x7f93f00b3d30 2024-04-25T09:57:17.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.893+0000 7f93f68d8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93f01474f0 0x7f93f013e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:17.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.893+0000 7f93f68d8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93f01474f0 0x7f93f013e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49286/0 (socket says 172.21.15.7:49286) 2024-04-25T09:57:17.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.893+0000 7f93f68d8640 1 -- 172.21.15.7:0/742877895 learned_addr learned my addr 172.21.15.7:0/742877895 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:17.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.893+0000 7f93f58d6640 1 --2- 172.21.15.7:0/742877895 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f00b4960 0x7f93f01540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:17.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.893+0000 7f93f60d7640 1 --2- 172.21.15.7:0/742877895 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f00b3d30 0x7f93f013fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:17.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.894+0000 7f93f68d8640 1 -- 172.21.15.7:0/742877895 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f00b3d30 msgr2=0x7f93f013fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:17.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.894+0000 7f93f68d8640 1 --2- 172.21.15.7:0/742877895 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f00b3d30 0x7f93f013fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:17.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.894+0000 7f93f68d8640 1 -- 172.21.15.7:0/742877895 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f00b4960 msgr2=0x7f93f01540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:17.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.894+0000 7f93f68d8640 1 --2- 172.21.15.7:0/742877895 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f00b4960 0x7f93f01540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:17.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.894+0000 7f93f68d8640 1 -- 172.21.15.7:0/742877895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f0154630 con 0x7f93f01474f0 2024-04-25T09:57:17.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.894+0000 7f93f68d8640 1 --2- 172.21.15.7:0/742877895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93f01474f0 0x7f93f013e7c0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f93e8009eb0 tx=0x7f93e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:17.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.894+0000 7f93e6ffd640 1 -- 172.21.15.7:0/742877895 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e8040070 con 0x7f93f01474f0 2024-04-25T09:57:17.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.894+0000 7f93e6ffd640 1 -- 172.21.15.7:0/742877895 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e8031c40 con 0x7f93f01474f0 2024-04-25T09:57:17.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.894+0000 7f93f833b640 1 -- 172.21.15.7:0/742877895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f013d720 con 0x7f93f01474f0 2024-04-25T09:57:17.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.894+0000 7f93e6ffd640 1 -- 172.21.15.7:0/742877895 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e8009450 con 0x7f93f01474f0 2024-04-25T09:57:17.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.894+0000 7f93f833b640 1 -- 172.21.15.7:0/742877895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f013dce0 con 0x7f93f01474f0 2024-04-25T09:57:17.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.895+0000 7f93f833b640 1 -- 172.21.15.7:0/742877895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f0068fd0 con 0x7f93f01474f0 2024-04-25T09:57:17.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.895+0000 7f93e6ffd640 1 -- 172.21.15.7:0/742877895 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f93e8039040 con 0x7f93f01474f0 2024-04-25T09:57:17.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.896+0000 7f93e6ffd640 1 --2- 172.21.15.7:0/742877895 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f93d406b4d0 0x7f93d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:17.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.896+0000 7f93f60d7640 1 --2- 172.21.15.7:0/742877895 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f93d406b4d0 0x7f93d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:17.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.896+0000 7f93e6ffd640 1 -- 172.21.15.7:0/742877895 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f93e80ab5d0 con 0x7f93f01474f0 2024-04-25T09:57:17.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.897+0000 7f93f60d7640 1 --2- 172.21.15.7:0/742877895 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f93d406b4d0 0x7f93d406d990 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f93ec005880 tx=0x7f93ec0057f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:17.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:17.901+0000 7f93e6ffd640 1 -- 172.21.15.7:0/742877895 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f93e8079d00 con 0x7f93f01474f0 2024-04-25T09:57:18.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.124+0000 7f93f833b640 1 -- 172.21.15.7:0/742877895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93f00b05d0 con 0x7f93f01474f0 2024-04-25T09:57:18.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.125+0000 7f93e6ffd640 1 -- 172.21.15.7:0/742877895 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4933 (secure 0 0 0) 0x7f93e807dda0 con 0x7f93f01474f0 2024-04-25T09:57:18.128 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:57:18.129 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3706118852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3706118852},{"type":"v1","addr":"172.21.15.55:6833","nonce":3706118852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5354,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1513522793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1513522793},{"type":"v1","addr":"172.21.15.55:6835","nonce":1513522793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5782,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1231382839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1231382839},{"type":"v1","addr":"172.21.15.7:6837","nonce":1231382839}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:57:15.098282+0000","modified":"2024-04-25T09:57:17.101919+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6836/3057688863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3057688863},{"type":"v1","addr":"172.21.15.7:6836","nonce":3057688863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:57:18.129 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 28 2024-04-25T09:57:18.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.127+0000 7f93f833b640 1 -- 172.21.15.7:0/742877895 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f93d406b4d0 msgr2=0x7f93d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:18.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.127+0000 7f93f833b640 1 --2- 172.21.15.7:0/742877895 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f93d406b4d0 0x7f93d406d990 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f93ec005880 tx=0x7f93ec0057f0 comp rx=0 tx=0).stop 2024-04-25T09:57:18.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.127+0000 7f93f833b640 1 -- 172.21.15.7:0/742877895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93f01474f0 msgr2=0x7f93f013e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:18.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.127+0000 7f93f833b640 1 --2- 172.21.15.7:0/742877895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93f01474f0 0x7f93f013e7c0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f93e8009eb0 tx=0x7f93e8004a40 comp rx=0 tx=0).stop 2024-04-25T09:57:18.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.127+0000 7f93f833b640 1 -- 172.21.15.7:0/742877895 shutdown_connections 2024-04-25T09:57:18.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.127+0000 7f93f833b640 1 --2- 172.21.15.7:0/742877895 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f93d406b4d0 0x7f93d406d990 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:18.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.127+0000 7f93f833b640 1 --2- 172.21.15.7:0/742877895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93f01474f0 0x7f93f013e7c0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:18.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.127+0000 7f93f833b640 1 --2- 172.21.15.7:0/742877895 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f00b4960 0x7f93f01540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:18.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.127+0000 7f93f833b640 1 --2- 172.21.15.7:0/742877895 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f00b3d30 0x7f93f013fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:18.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.127+0000 7f93f833b640 1 -- 172.21.15.7:0/742877895 >> 172.21.15.7:0/742877895 conn(0x7f93f00b1740 msgr2=0x7f93f00b0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:18.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.127+0000 7f93f833b640 1 -- 172.21.15.7:0/742877895 shutdown_connections 2024-04-25T09:57:18.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.127+0000 7f93f833b640 1 -- 172.21.15.7:0/742877895 wait complete. 2024-04-25T09:57:18.141 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:57:18.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.238+0000 7fbc138c6640 1 Processor -- start 2024-04-25T09:57:18.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.238+0000 7fbc138c6640 1 -- start start 2024-04-25T09:57:18.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.239+0000 7fbc138c6640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbc0c15dd00 0x7fbc0c0b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:18.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.239+0000 7fbc138c6640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbc0c0b6a40 0x7fbc0c0b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:18.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.239+0000 7fbc138c6640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc0c06cd00 con 0x7fbc0c06bfb0 2024-04-25T09:57:18.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.239+0000 7fbc138c6640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc0c15e0e0 con 0x7fbc0c0b6a40 2024-04-25T09:57:18.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.239+0000 7fbc138c6640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0c06cfe0 con 0x7fbc0c15dd00 2024-04-25T09:57:18.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.239+0000 7fbc10e61640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbc0c0b6a40 0x7fbc0c0b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:18.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.239+0000 7fbc10e61640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbc0c0b6a40 0x7fbc0c0b5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49290/0 (socket says 172.21.15.7:49290) 2024-04-25T09:57:18.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.239+0000 7fbc10e61640 1 -- 172.21.15.7:0/1046360461 learned_addr learned my addr 172.21.15.7:0/1046360461 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:18.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.239+0000 7fbc11662640 1 --2- 172.21.15.7:0/1046360461 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbc0c15dd00 0x7fbc0c0b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:18.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.239+0000 7fbc10e61640 1 -- 172.21.15.7:0/1046360461 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbc0c15dd00 msgr2=0x7fbc0c0b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:18.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.239+0000 7fbc10e61640 1 --2- 172.21.15.7:0/1046360461 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbc0c15dd00 0x7fbc0c0b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:18.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.239+0000 7fbc10e61640 1 -- 172.21.15.7:0/1046360461 >> v1:172.21.15.55:6789/0 conn(0x7fbc0c06bfb0 legacy=0x7fbc0c06c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:18.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.239+0000 7fbc10e61640 1 -- 172.21.15.7:0/1046360461 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc0c0d1ca0 con 0x7fbc0c0b6a40 2024-04-25T09:57:18.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.240+0000 7fbc10e61640 1 --2- 172.21.15.7:0/1046360461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc0c0b6a40 0x7fbc0c0b5c90 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc009870 tx=0x7fbbfc02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dafbded62fec570 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:18.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.240+0000 7fbc03fff640 1 -- 172.21.15.7:0/1046360461 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc037070 con 0x7fbc0c0b6a40 2024-04-25T09:57:18.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.240+0000 7fbc03fff640 1 -- 172.21.15.7:0/1046360461 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbfc02ae50 con 0x7fbc0c0b6a40 2024-04-25T09:57:18.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.240+0000 7fbc03fff640 1 -- 172.21.15.7:0/1046360461 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc032860 con 0x7fbc0c0b6a40 2024-04-25T09:57:18.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.241+0000 7fbc138c6640 1 -- 172.21.15.7:0/1046360461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc0c0b6a40 msgr2=0x7fbc0c0b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:18.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.241+0000 7fbc138c6640 1 --2- 172.21.15.7:0/1046360461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc0c0b6a40 0x7fbc0c0b5c90 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc009870 tx=0x7fbbfc02a300 comp rx=0 tx=0).stop 2024-04-25T09:57:18.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.241+0000 7fbc138c6640 1 -- 172.21.15.7:0/1046360461 shutdown_connections 2024-04-25T09:57:18.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.241+0000 7fbc138c6640 1 --2- 172.21.15.7:0/1046360461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc0c0b6a40 0x7fbc0c0b5c90 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:18.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.241+0000 7fbc138c6640 1 --2- 172.21.15.7:0/1046360461 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbc0c15dd00 0x7fbc0c0b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:18.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.241+0000 7fbc138c6640 1 -- 172.21.15.7:0/1046360461 >> 172.21.15.7:0/1046360461 conn(0x7fbc0c0d07b0 msgr2=0x7fbc0c0d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:18.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.241+0000 7fbc138c6640 1 -- 172.21.15.7:0/1046360461 shutdown_connections 2024-04-25T09:57:18.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.241+0000 7fbc138c6640 1 -- 172.21.15.7:0/1046360461 wait complete. 2024-04-25T09:57:18.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.242+0000 7fbc138c6640 1 Processor -- start 2024-04-25T09:57:18.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.242+0000 7fbc138c6640 1 -- start start 2024-04-25T09:57:18.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.243+0000 7fbc138c6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc0c06bfb0 0x7fbc0c0c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:18.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.243+0000 7fbc138c6640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbc0c0b6a40 0x7fbc0c15ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:18.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.243+0000 7fbc138c6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc0c15dd00 0x7fbc0c15f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:18.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.243+0000 7fbc138c6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0c0d2780 con 0x7fbc0c15dd00 2024-04-25T09:57:18.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.243+0000 7fbc138c6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0c0d2260 con 0x7fbc0c06bfb0 2024-04-25T09:57:18.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.243+0000 7fbc138c6640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0c0d2900 con 0x7fbc0c0b6a40 2024-04-25T09:57:18.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.243+0000 7fbc11e63640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc0c15dd00 0x7fbc0c15f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:18.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.243+0000 7fbc11e63640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc0c15dd00 0x7fbc0c15f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49300/0 (socket says 172.21.15.7:49300) 2024-04-25T09:57:18.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.243+0000 7fbc11e63640 1 -- 172.21.15.7:0/1476553903 learned_addr learned my addr 172.21.15.7:0/1476553903 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:18.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.243+0000 7fbc11662640 1 --2- 172.21.15.7:0/1476553903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc0c06bfb0 0x7fbc0c0c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:18.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.243+0000 7fbc10e61640 1 --2- 172.21.15.7:0/1476553903 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbc0c0b6a40 0x7fbc0c15ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:18.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.243+0000 7fbc11e63640 1 -- 172.21.15.7:0/1476553903 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbc0c0b6a40 msgr2=0x7fbc0c15ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:18.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.243+0000 7fbc11e63640 1 --2- 172.21.15.7:0/1476553903 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbc0c0b6a40 0x7fbc0c15ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:18.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.243+0000 7fbc11e63640 1 -- 172.21.15.7:0/1476553903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc0c06bfb0 msgr2=0x7fbc0c0c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:18.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.243+0000 7fbc11e63640 1 --2- 172.21.15.7:0/1476553903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc0c06bfb0 0x7fbc0c0c9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:18.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.243+0000 7fbc11e63640 1 -- 172.21.15.7:0/1476553903 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc0c15f7e0 con 0x7fbc0c15dd00 2024-04-25T09:57:18.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.243+0000 7fbc11662640 1 --2- 172.21.15.7:0/1476553903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc0c06bfb0 0x7fbc0c0c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:57:18.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.243+0000 7fbc11e63640 1 --2- 172.21.15.7:0/1476553903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc0c15dd00 0x7fbc0c15f1b0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fbc0400c7a0 tx=0x7fbc0400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:18.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.243+0000 7fbc01ffb640 1 -- 172.21.15.7:0/1476553903 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc04003b70 con 0x7fbc0c15dd00 2024-04-25T09:57:18.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.243+0000 7fbc01ffb640 1 -- 172.21.15.7:0/1476553903 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc04003d30 con 0x7fbc0c15dd00 2024-04-25T09:57:18.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.243+0000 7fbc138c6640 1 -- 172.21.15.7:0/1476553903 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc0c15fac0 con 0x7fbc0c15dd00 2024-04-25T09:57:18.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.243+0000 7fbc01ffb640 1 -- 172.21.15.7:0/1476553903 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0400aa90 con 0x7fbc0c15dd00 2024-04-25T09:57:18.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.244+0000 7fbc138c6640 1 -- 172.21.15.7:0/1476553903 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc0c160080 con 0x7fbc0c15dd00 2024-04-25T09:57:18.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.245+0000 7fbc138c6640 1 -- 172.21.15.7:0/1476553903 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc0c068fd0 con 0x7fbc0c15dd00 2024-04-25T09:57:18.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.245+0000 7fbc01ffb640 1 -- 172.21.15.7:0/1476553903 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbc0400ac30 con 0x7fbc0c15dd00 2024-04-25T09:57:18.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.245+0000 7fbc01ffb640 1 --2- 172.21.15.7:0/1476553903 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbbf006b4d0 0x7fbbf006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:18.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.246+0000 7fbc01ffb640 1 -- 172.21.15.7:0/1476553903 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbc0408a450 con 0x7fbc0c15dd00 2024-04-25T09:57:18.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.246+0000 7fbc11662640 1 --2- 172.21.15.7:0/1476553903 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbbf006b4d0 0x7fbbf006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:18.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.246+0000 7fbc11662640 1 --2- 172.21.15.7:0/1476553903 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbbf006b4d0 0x7fbbf006d990 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbc08006fd0 tx=0x7fbc08008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:18.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.250+0000 7fbc01ffb640 1 -- 172.21.15.7:0/1476553903 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbc04058f90 con 0x7fbc0c15dd00 2024-04-25T09:57:18.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.428+0000 7fbc138c6640 1 -- 172.21.15.7:0/1476553903 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc0c0d1620 con 0x7fbc0c15dd00 2024-04-25T09:57:18.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.429+0000 7fbc01ffb640 1 -- 172.21.15.7:0/1476553903 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+16788 (secure 0 0 0) 0x7fbc04058890 con 0x7fbc0c15dd00 2024-04-25T09:57:18.433 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:57:18.433 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":62,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:57:16.742839+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:57:13.366946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T09:57:14.076493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:57:18.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.431+0000 7fbc138c6640 1 -- 172.21.15.7:0/1476553903 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbbf006b4d0 msgr2=0x7fbbf006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:18.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.431+0000 7fbc138c6640 1 --2- 172.21.15.7:0/1476553903 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbbf006b4d0 0x7fbbf006d990 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbc08006fd0 tx=0x7fbc08008040 comp rx=0 tx=0).stop 2024-04-25T09:57:18.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.431+0000 7fbc138c6640 1 -- 172.21.15.7:0/1476553903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc0c15dd00 msgr2=0x7fbc0c15f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:18.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.431+0000 7fbc138c6640 1 --2- 172.21.15.7:0/1476553903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc0c15dd00 0x7fbc0c15f1b0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fbc0400c7a0 tx=0x7fbc0400cc60 comp rx=0 tx=0).stop 2024-04-25T09:57:18.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.431+0000 7fbc138c6640 1 -- 172.21.15.7:0/1476553903 shutdown_connections 2024-04-25T09:57:18.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.431+0000 7fbc138c6640 1 --2- 172.21.15.7:0/1476553903 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbbf006b4d0 0x7fbbf006d990 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:18.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.431+0000 7fbc138c6640 1 --2- 172.21.15.7:0/1476553903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc0c15dd00 0x7fbc0c15f1b0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:18.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.431+0000 7fbc138c6640 1 --2- 172.21.15.7:0/1476553903 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbc0c0b6a40 0x7fbc0c15ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:18.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.431+0000 7fbc138c6640 1 --2- 172.21.15.7:0/1476553903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc0c06bfb0 0x7fbc0c0c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:18.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.431+0000 7fbc138c6640 1 -- 172.21.15.7:0/1476553903 >> 172.21.15.7:0/1476553903 conn(0x7fbc0c0d07b0 msgr2=0x7fbc0c0ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:18.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.431+0000 7fbc138c6640 1 -- 172.21.15.7:0/1476553903 shutdown_connections 2024-04-25T09:57:18.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.431+0000 7fbc138c6640 1 -- 172.21.15.7:0/1476553903 wait complete. 2024-04-25T09:57:18.446 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:57:18.446 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:57:18.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.544+0000 7fc630ae1640 1 Processor -- start 2024-04-25T09:57:18.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.544+0000 7fc630ae1640 1 -- start start 2024-04-25T09:57:18.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.545+0000 7fc630ae1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc62c0b2310 0x7fc62c0ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:18.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.545+0000 7fc630ae1640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc62c160020 con 0x7fc62c0cdc80 2024-04-25T09:57:18.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.545+0000 7fc630ae1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc62c160300 con 0x7fc62c15f450 2024-04-25T09:57:18.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.545+0000 7fc630ae1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc62c0cfd60 con 0x7fc62c0b2310 2024-04-25T09:57:18.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.545+0000 7fc629d9b640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc62c0cdc80 0x7fc62c0cc3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56114/0 (socket says 172.21.15.7:56114) 2024-04-25T09:57:18.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.545+0000 7fc629d9b640 1 -- 172.21.15.7:0/1962289423 learned_addr learned my addr 172.21.15.7:0/1962289423 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:57:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.545+0000 7fc62ad9d640 1 --2- 172.21.15.7:0/1962289423 >> v2:172.21.15.55:3300/0 conn(0x7fc62c0b2310 0x7fc62c0ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.545+0000 7fc62959a640 1 -- 172.21.15.7:0/1962289423 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3720577115 0 0) 0x7fc62c160020 con 0x7fc62c0cdc80 2024-04-25T09:57:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.545+0000 7fc62959a640 1 -- 172.21.15.7:0/1962289423 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc618003520 con 0x7fc62c0cdc80 2024-04-25T09:57:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.545+0000 7fc62959a640 1 -- 172.21.15.7:0/1962289423 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3227639507 0 0) 0x7fc62c160300 con 0x7fc62c15f450 2024-04-25T09:57:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.545+0000 7fc62959a640 1 -- 172.21.15.7:0/1962289423 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc62c160020 con 0x7fc62c15f450 2024-04-25T09:57:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.545+0000 7fc62959a640 1 -- 172.21.15.7:0/1962289423 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1510588228 0 0) 0x7fc618003520 con 0x7fc62c0cdc80 2024-04-25T09:57:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.545+0000 7fc62959a640 1 -- 172.21.15.7:0/1962289423 >> v2:172.21.15.55:3300/0 conn(0x7fc62c0b2310 msgr2=0x7fc62c0ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.545+0000 7fc62959a640 1 --2- 172.21.15.7:0/1962289423 >> v2:172.21.15.55:3300/0 conn(0x7fc62c0b2310 0x7fc62c0ccb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.545+0000 7fc62959a640 1 -- 172.21.15.7:0/1962289423 >> v1:172.21.15.55:6789/0 conn(0x7fc62c15f450 legacy=0x7fc62c15f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.545+0000 7fc62959a640 1 -- 172.21.15.7:0/1962289423 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62c0d0040 con 0x7fc62c0cdc80 2024-04-25T09:57:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.545+0000 7fc62959a640 1 -- 172.21.15.7:0/1962289423 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fc6140015f0 con 0x7fc62c0cdc80 2024-04-25T09:57:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.546+0000 7fc62959a640 1 -- 172.21.15.7:0/1962289423 >> v1:172.21.15.7:6789/0 conn(0x7fc62c0cdc80 legacy=0x7fc62c0cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.546+0000 7fc62959a640 1 --2- 172.21.15.7:0/1962289423 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc618003b90 0x7fc618003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.546+0000 7fc62959a640 1 --2- 172.21.15.7:0/1962289423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc618004800 0x7fc618004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.546+0000 7fc62959a640 1 --2- 172.21.15.7:0/1962289423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc618005280 0x7fc61800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.546+0000 7fc62959a640 1 -- 172.21.15.7:0/1962289423 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c0cfd60 con 0x7fc618005280 2024-04-25T09:57:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.546+0000 7fc62959a640 1 -- 172.21.15.7:0/1962289423 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61800c1c0 con 0x7fc618004800 2024-04-25T09:57:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.546+0000 7fc62959a640 1 -- 172.21.15.7:0/1962289423 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61800c3c0 con 0x7fc618003b90 2024-04-25T09:57:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.546+0000 7fc62ad9d640 1 --2- 172.21.15.7:0/1962289423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc618005280 0x7fc61800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.546+0000 7fc629d9b640 1 --2- 172.21.15.7:0/1962289423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc618004800 0x7fc618004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.546+0000 7fc62a59c640 1 --2- 172.21.15.7:0/1962289423 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc618003b90 0x7fc618003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.546+0000 7fc62ad9d640 1 -- 172.21.15.7:0/1962289423 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc618003b90 msgr2=0x7fc618003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.546+0000 7fc62ad9d640 1 --2- 172.21.15.7:0/1962289423 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc618003b90 0x7fc618003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.546+0000 7fc62ad9d640 1 -- 172.21.15.7:0/1962289423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc618004800 msgr2=0x7fc618004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.546+0000 7fc62ad9d640 1 --2- 172.21.15.7:0/1962289423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc618004800 0x7fc618004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.546+0000 7fc62ad9d640 1 -- 172.21.15.7:0/1962289423 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc618003520 con 0x7fc618005280 2024-04-25T09:57:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.547+0000 7fc62ad9d640 1 -- 172.21.15.7:0/1962289423 reap_dead start 2024-04-25T09:57:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.547+0000 7fc62ad9d640 1 --2- 172.21.15.7:0/1962289423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc618005280 0x7fc61800b9c0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fc61c009fa0 tx=0x7fc618005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f6a578d7fc4074 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.547+0000 7fc62959a640 1 -- 172.21.15.7:0/1962289423 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c009bf0 con 0x7fc618005280 2024-04-25T09:57:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.547+0000 7fc62959a640 1 -- 172.21.15.7:0/1962289423 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61c030460 con 0x7fc618005280 2024-04-25T09:57:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.547+0000 7fc62959a640 1 -- 172.21.15.7:0/1962289423 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c030830 con 0x7fc618005280 2024-04-25T09:57:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.547+0000 7fc630ae1640 1 -- 172.21.15.7:0/1962289423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc618005280 msgr2=0x7fc61800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.547+0000 7fc630ae1640 1 --2- 172.21.15.7:0/1962289423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc618005280 0x7fc61800b9c0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fc61c009fa0 tx=0x7fc618005830 comp rx=0 tx=0).stop 2024-04-25T09:57:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.548+0000 7fc630ae1640 1 -- 172.21.15.7:0/1962289423 shutdown_connections 2024-04-25T09:57:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.548+0000 7fc630ae1640 1 --2- 172.21.15.7:0/1962289423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc618005280 0x7fc61800b9c0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.548+0000 7fc630ae1640 1 -- 172.21.15.7:0/1962289423 >> 172.21.15.7:0/1962289423 conn(0x7fc62c0d16e0 msgr2=0x7fc62c0d1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.548+0000 7fc630ae1640 1 -- 172.21.15.7:0/1962289423 shutdown_connections 2024-04-25T09:57:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.548+0000 7fc630ae1640 1 -- 172.21.15.7:0/1962289423 wait complete. 2024-04-25T09:57:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.549+0000 7fc630ae1640 1 Processor -- start 2024-04-25T09:57:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.549+0000 7fc630ae1640 1 -- start start 2024-04-25T09:57:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.550+0000 7fc630ae1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc618005280 0x7fc62c0cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.550+0000 7fc630ae1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc62c0af4b0 0x7fc62c0b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.550+0000 7fc630ae1640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc62c14b240 0x7fc62c0b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.550+0000 7fc630ae1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c0c7f40 con 0x7fc62c0af4b0 2024-04-25T09:57:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.550+0000 7fc630ae1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c0b2a30 con 0x7fc618005280 2024-04-25T09:57:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.550+0000 7fc630ae1640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c0c80c0 con 0x7fc62c14b240 2024-04-25T09:57:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.550+0000 7fc629d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc62c0af4b0 0x7fc62c0b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.550+0000 7fc629d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc62c0af4b0 0x7fc62c0b0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49316/0 (socket says 172.21.15.7:49316) 2024-04-25T09:57:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.550+0000 7fc629d9b640 1 -- 172.21.15.7:0/2502803913 learned_addr learned my addr 172.21.15.7:0/2502803913 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.550+0000 7fc62a59c640 1 --2- 172.21.15.7:0/2502803913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc618005280 0x7fc62c0cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.550+0000 7fc62ad9d640 1 --2- 172.21.15.7:0/2502803913 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc62c14b240 0x7fc62c0b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.550+0000 7fc629d9b640 1 -- 172.21.15.7:0/2502803913 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc62c14b240 msgr2=0x7fc62c0b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.550+0000 7fc629d9b640 1 --2- 172.21.15.7:0/2502803913 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc62c14b240 0x7fc62c0b4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.550+0000 7fc629d9b640 1 -- 172.21.15.7:0/2502803913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc618005280 msgr2=0x7fc62c0cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:18.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.550+0000 7fc629d9b640 1 --2- 172.21.15.7:0/2502803913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc618005280 0x7fc62c0cb2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:18.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.550+0000 7fc629d9b640 1 -- 172.21.15.7:0/2502803913 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62c14e660 con 0x7fc62c0af4b0 2024-04-25T09:57:18.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.550+0000 7fc629d9b640 1 --2- 172.21.15.7:0/2502803913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc62c0af4b0 0x7fc62c0b0a10 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fc614001e80 tx=0x7fc614007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:18.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.550+0000 7fc622ffd640 1 -- 172.21.15.7:0/2502803913 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61400f780 con 0x7fc62c0af4b0 2024-04-25T09:57:18.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.551+0000 7fc622ffd640 1 -- 172.21.15.7:0/2502803913 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc614018070 con 0x7fc62c0af4b0 2024-04-25T09:57:18.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.551+0000 7fc630ae1640 1 -- 172.21.15.7:0/2502803913 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc62c0af970 con 0x7fc62c0af4b0 2024-04-25T09:57:18.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.551+0000 7fc622ffd640 1 -- 172.21.15.7:0/2502803913 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61400fb60 con 0x7fc62c0af4b0 2024-04-25T09:57:18.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.551+0000 7fc630ae1640 1 -- 172.21.15.7:0/2502803913 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc62c0aff30 con 0x7fc62c0af4b0 2024-04-25T09:57:18.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.552+0000 7fc630ae1640 1 -- 172.21.15.7:0/2502803913 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc62c068fd0 con 0x7fc62c0af4b0 2024-04-25T09:57:18.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.552+0000 7fc622ffd640 1 -- 172.21.15.7:0/2502803913 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc61400fd00 con 0x7fc62c0af4b0 2024-04-25T09:57:18.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.552+0000 7fc622ffd640 1 --2- 172.21.15.7:0/2502803913 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc60c06b4d0 0x7fc60c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:18.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.552+0000 7fc622ffd640 1 -- 172.21.15.7:0/2502803913 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc61408a140 con 0x7fc62c0af4b0 2024-04-25T09:57:18.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.552+0000 7fc62a59c640 1 --2- 172.21.15.7:0/2502803913 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc60c06b4d0 0x7fc60c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:18.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.553+0000 7fc62a59c640 1 --2- 172.21.15.7:0/2502803913 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc60c06b4d0 0x7fc60c06d990 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc624001830 tx=0x7fc624009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.557+0000 7fc622ffd640 1 -- 172.21.15.7:0/2502803913 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc62c14e660 con 0x7fc62c0af4b0 2024-04-25T09:57:18.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.734+0000 7fc630ae1640 1 -- 172.21.15.7:0/2502803913 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc62c0d24d0 con 0x7fc60c06b4d0 2024-04-25T09:57:18.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.740+0000 7fc622ffd640 1 -- 172.21.15.7:0/2502803913 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250066 (secure 0 0 0) 0x7fc62c0d24d0 con 0x7fc60c06b4d0 2024-04-25T09:57:18.747 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:57:18.748 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T09:57:18.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.743+0000 7fc630ae1640 1 -- 172.21.15.7:0/2502803913 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc60c06b4d0 msgr2=0x7fc60c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:18.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.743+0000 7fc630ae1640 1 --2- 172.21.15.7:0/2502803913 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc60c06b4d0 0x7fc60c06d990 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc624001830 tx=0x7fc624009040 comp rx=0 tx=0).stop 2024-04-25T09:57:18.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.743+0000 7fc630ae1640 1 -- 172.21.15.7:0/2502803913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc62c0af4b0 msgr2=0x7fc62c0b0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:18.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.743+0000 7fc630ae1640 1 --2- 172.21.15.7:0/2502803913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc62c0af4b0 0x7fc62c0b0a10 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fc614001e80 tx=0x7fc614007430 comp rx=0 tx=0).stop 2024-04-25T09:57:18.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.743+0000 7fc630ae1640 1 -- 172.21.15.7:0/2502803913 shutdown_connections 2024-04-25T09:57:18.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.743+0000 7fc630ae1640 1 --2- 172.21.15.7:0/2502803913 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc60c06b4d0 0x7fc60c06d990 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:18.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.743+0000 7fc630ae1640 1 --2- 172.21.15.7:0/2502803913 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc62c14b240 0x7fc62c0b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:18.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.743+0000 7fc630ae1640 1 --2- 172.21.15.7:0/2502803913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc62c0af4b0 0x7fc62c0b0a10 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:18.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.743+0000 7fc630ae1640 1 --2- 172.21.15.7:0/2502803913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc618005280 0x7fc62c0cb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:18.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.743+0000 7fc630ae1640 1 -- 172.21.15.7:0/2502803913 >> 172.21.15.7:0/2502803913 conn(0x7fc62c0d16e0 msgr2=0x7fc62c0999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:18.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.743+0000 7fc630ae1640 1 -- 172.21.15.7:0/2502803913 shutdown_connections 2024-04-25T09:57:18.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.743+0000 7fc630ae1640 1 -- 172.21.15.7:0/2502803913 wait complete. 2024-04-25T09:57:18.758 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2024-04-25T09:57:17.890316+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590584,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":186,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256224,"kb_used_data":6760,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718496,"statfs":{"total":773094113280,"available":772831739904,"internally_reserved":0,"allocated":6922240,"data_stored":3724769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":216,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.166772"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.739601+0000","last_change":"2024-04-25T09:57:14.739601+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.739601+0000","last_undegraded":"2024-04-25T09:57:14.739601+0000","last_fullsized":"2024-04-25T09:57:14.739601+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.736881+0000","last_change":"2024-04-25T09:57:14.736881+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.736881+0000","last_undegraded":"2024-04-25T09:57:14.736881+0000","last_fullsized":"2024-04-25T09:57:14.736881+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.771130+0000","last_change":"2024-04-25T09:57:15.768429+0000","last_active":"2024-04-25T09:57:15.771130+0000","last_peered":"2024-04-25T09:57:15.771130+0000","last_clean":"2024-04-25T09:57:15.771130+0000","last_became_active":"2024-04-25T09:57:15.767779+0000","last_became_peered":"2024-04-25T09:57:15.767779+0000","last_unstale":"2024-04-25T09:57:15.771130+0000","last_undegraded":"2024-04-25T09:57:15.771130+0000","last_fullsized":"2024-04-25T09:57:15.771130+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:43.170600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.749077+0000","last_change":"2024-04-25T09:57:15.743074+0000","last_active":"2024-04-25T09:57:15.749077+0000","last_peered":"2024-04-25T09:57:15.749077+0000","last_clean":"2024-04-25T09:57:15.749077+0000","last_became_active":"2024-04-25T09:57:15.742690+0000","last_became_peered":"2024-04-25T09:57:15.742690+0000","last_unstale":"2024-04-25T09:57:15.749077+0000","last_undegraded":"2024-04-25T09:57:15.749077+0000","last_fullsized":"2024-04-25T09:57:15.749077+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:16.623083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.756450+0000","last_change":"2024-04-25T09:57:15.753362+0000","last_active":"2024-04-25T09:57:15.756450+0000","last_peered":"2024-04-25T09:57:15.756450+0000","last_clean":"2024-04-25T09:57:15.756450+0000","last_became_active":"2024-04-25T09:57:15.752402+0000","last_became_peered":"2024-04-25T09:57:15.752402+0000","last_unstale":"2024-04-25T09:57:15.756450+0000","last_undegraded":"2024-04-25T09:57:15.756450+0000","last_fullsized":"2024-04-25T09:57:15.756450+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:05:54.427158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.740479+0000","last_change":"2024-04-25T09:57:14.740479+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.740479+0000","last_undegraded":"2024-04-25T09:57:14.740479+0000","last_fullsized":"2024-04-25T09:57:14.740479+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.735324+0000","last_change":"2024-04-25T09:57:14.735324+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.735324+0000","last_undegraded":"2024-04-25T09:57:14.735324+0000","last_fullsized":"2024-04-25T09:57:14.735324+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.765280+0000","last_change":"2024-04-25T09:57:15.764308+0000","last_active":"2024-04-25T09:57:15.765280+0000","last_peered":"2024-04-25T09:57:15.765280+0000","last_clean":"2024-04-25T09:57:15.765280+0000","last_became_active":"2024-04-25T09:57:15.763987+0000","last_became_peered":"2024-04-25T09:57:15.763987+0000","last_unstale":"2024-04-25T09:57:15.765280+0000","last_undegraded":"2024-04-25T09:57:15.765280+0000","last_fullsized":"2024-04-25T09:57:15.765280+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:38.035777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.771009+0000","last_change":"2024-04-25T09:57:15.768645+0000","last_active":"2024-04-25T09:57:15.771009+0000","last_peered":"2024-04-25T09:57:15.771009+0000","last_clean":"2024-04-25T09:57:15.771009+0000","last_became_active":"2024-04-25T09:57:15.768313+0000","last_became_peered":"2024-04-25T09:57:15.768313+0000","last_unstale":"2024-04-25T09:57:15.771009+0000","last_undegraded":"2024-04-25T09:57:15.771009+0000","last_fullsized":"2024-04-25T09:57:15.771009+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:38.035777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.768078+0000","last_change":"2024-04-25T09:57:15.765383+0000","last_active":"2024-04-25T09:57:15.768078+0000","last_peered":"2024-04-25T09:57:15.768078+0000","last_clean":"2024-04-25T09:57:15.768078+0000","last_became_active":"2024-04-25T09:57:15.763424+0000","last_became_peered":"2024-04-25T09:57:15.763424+0000","last_unstale":"2024-04-25T09:57:15.768078+0000","last_undegraded":"2024-04-25T09:57:15.768078+0000","last_fullsized":"2024-04-25T09:57:15.768078+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:56.030922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.763391+0000","last_change":"2024-04-25T09:57:15.755081+0000","last_active":"2024-04-25T09:57:15.763391+0000","last_peered":"2024-04-25T09:57:15.763391+0000","last_clean":"2024-04-25T09:57:15.763391+0000","last_became_active":"2024-04-25T09:57:15.754758+0000","last_became_peered":"2024-04-25T09:57:15.754758+0000","last_unstale":"2024-04-25T09:57:15.763391+0000","last_undegraded":"2024-04-25T09:57:15.763391+0000","last_fullsized":"2024-04-25T09:57:15.763391+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:51.634061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.768719+0000","last_change":"2024-04-25T09:57:15.767461+0000","last_active":"2024-04-25T09:57:15.768719+0000","last_peered":"2024-04-25T09:57:15.768719+0000","last_clean":"2024-04-25T09:57:15.768719+0000","last_became_active":"2024-04-25T09:57:15.767159+0000","last_became_peered":"2024-04-25T09:57:15.767159+0000","last_unstale":"2024-04-25T09:57:15.768719+0000","last_undegraded":"2024-04-25T09:57:15.768719+0000","last_fullsized":"2024-04-25T09:57:15.768719+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:43.170600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759834+0000","last_change":"2024-04-25T09:57:15.753129+0000","last_active":"2024-04-25T09:57:15.759834+0000","last_peered":"2024-04-25T09:57:15.759834+0000","last_clean":"2024-04-25T09:57:15.759834+0000","last_became_active":"2024-04-25T09:57:15.752135+0000","last_became_peered":"2024-04-25T09:57:15.752135+0000","last_unstale":"2024-04-25T09:57:15.759834+0000","last_undegraded":"2024-04-25T09:57:15.759834+0000","last_fullsized":"2024-04-25T09:57:15.759834+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:06:48.607407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.769297+0000","last_change":"2024-04-25T09:57:15.765918+0000","last_active":"2024-04-25T09:57:15.769297+0000","last_peered":"2024-04-25T09:57:15.769297+0000","last_clean":"2024-04-25T09:57:15.769297+0000","last_became_active":"2024-04-25T09:57:15.765586+0000","last_became_peered":"2024-04-25T09:57:15.765586+0000","last_unstale":"2024-04-25T09:57:15.769297+0000","last_undegraded":"2024-04-25T09:57:15.769297+0000","last_fullsized":"2024-04-25T09:57:15.769297+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:36.249678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.769126+0000","last_change":"2024-04-25T09:57:15.765729+0000","last_active":"2024-04-25T09:57:15.769126+0000","last_peered":"2024-04-25T09:57:15.769126+0000","last_clean":"2024-04-25T09:57:15.769126+0000","last_became_active":"2024-04-25T09:57:15.763401+0000","last_became_peered":"2024-04-25T09:57:15.763401+0000","last_unstale":"2024-04-25T09:57:15.769126+0000","last_undegraded":"2024-04-25T09:57:15.769126+0000","last_fullsized":"2024-04-25T09:57:15.769126+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:06:48.607407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.736209+0000","last_change":"2024-04-25T09:57:14.736209+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.736209+0000","last_undegraded":"2024-04-25T09:57:14.736209+0000","last_fullsized":"2024-04-25T09:57:14.736209+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.739137+0000","last_change":"2024-04-25T09:57:14.739137+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.739137+0000","last_undegraded":"2024-04-25T09:57:14.739137+0000","last_fullsized":"2024-04-25T09:57:14.739137+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.765663+0000","last_change":"2024-04-25T09:57:15.763231+0000","last_active":"2024-04-25T09:57:15.765663+0000","last_peered":"2024-04-25T09:57:15.765663+0000","last_clean":"2024-04-25T09:57:15.765663+0000","last_became_active":"2024-04-25T09:57:15.761219+0000","last_became_peered":"2024-04-25T09:57:15.761219+0000","last_unstale":"2024-04-25T09:57:15.765663+0000","last_undegraded":"2024-04-25T09:57:15.765663+0000","last_fullsized":"2024-04-25T09:57:15.765663+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:26.061064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.756512+0000","last_change":"2024-04-25T09:57:15.749906+0000","last_active":"2024-04-25T09:57:15.756512+0000","last_peered":"2024-04-25T09:57:15.756512+0000","last_clean":"2024-04-25T09:57:15.756512+0000","last_became_active":"2024-04-25T09:57:15.749556+0000","last_became_peered":"2024-04-25T09:57:15.749556+0000","last_unstale":"2024-04-25T09:57:15.756512+0000","last_undegraded":"2024-04-25T09:57:15.756512+0000","last_fullsized":"2024-04-25T09:57:15.756512+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:56.132114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.738072+0000","last_change":"2024-04-25T09:57:14.738072+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.738072+0000","last_undegraded":"2024-04-25T09:57:14.738072+0000","last_fullsized":"2024-04-25T09:57:14.738072+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759858+0000","last_change":"2024-04-25T09:57:15.756136+0000","last_active":"2024-04-25T09:57:15.759858+0000","last_peered":"2024-04-25T09:57:15.759858+0000","last_clean":"2024-04-25T09:57:15.759858+0000","last_became_active":"2024-04-25T09:57:15.755865+0000","last_became_peered":"2024-04-25T09:57:15.755865+0000","last_unstale":"2024-04-25T09:57:15.759858+0000","last_undegraded":"2024-04-25T09:57:15.759858+0000","last_fullsized":"2024-04-25T09:57:15.759858+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:47.721018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.735616+0000","last_change":"2024-04-25T09:57:14.735616+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.735616+0000","last_undegraded":"2024-04-25T09:57:14.735616+0000","last_fullsized":"2024-04-25T09:57:14.735616+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.735588+0000","last_change":"2024-04-25T09:57:14.735588+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.735588+0000","last_undegraded":"2024-04-25T09:57:14.735588+0000","last_fullsized":"2024-04-25T09:57:14.735588+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.769820+0000","last_change":"2024-04-25T09:57:15.766342+0000","last_active":"2024-04-25T09:57:15.769820+0000","last_peered":"2024-04-25T09:57:15.769820+0000","last_clean":"2024-04-25T09:57:15.769820+0000","last_became_active":"2024-04-25T09:57:15.766060+0000","last_became_peered":"2024-04-25T09:57:15.766060+0000","last_unstale":"2024-04-25T09:57:15.769820+0000","last_undegraded":"2024-04-25T09:57:15.769820+0000","last_fullsized":"2024-04-25T09:57:15.769820+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:57:22.599880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759309+0000","last_change":"2024-04-25T09:57:15.752044+0000","last_active":"2024-04-25T09:57:15.759309+0000","last_peered":"2024-04-25T09:57:15.759309+0000","last_clean":"2024-04-25T09:57:15.759309+0000","last_became_active":"2024-04-25T09:57:15.751759+0000","last_became_peered":"2024-04-25T09:57:15.751759+0000","last_unstale":"2024-04-25T09:57:15.759309+0000","last_undegraded":"2024-04-25T09:57:15.759309+0000","last_fullsized":"2024-04-25T09:57:15.759309+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:57:22.599880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759418+0000","last_change":"2024-04-25T09:57:15.751032+0000","last_active":"2024-04-25T09:57:15.759418+0000","last_peered":"2024-04-25T09:57:15.759418+0000","last_clean":"2024-04-25T09:57:15.759418+0000","last_became_active":"2024-04-25T09:57:15.750731+0000","last_became_peered":"2024-04-25T09:57:15.750731+0000","last_unstale":"2024-04-25T09:57:15.759418+0000","last_undegraded":"2024-04-25T09:57:15.759418+0000","last_fullsized":"2024-04-25T09:57:15.759418+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:13.286010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.755315+0000","last_change":"2024-04-25T09:57:15.752419+0000","last_active":"2024-04-25T09:57:15.755315+0000","last_peered":"2024-04-25T09:57:15.755315+0000","last_clean":"2024-04-25T09:57:15.755315+0000","last_became_active":"2024-04-25T09:57:15.752123+0000","last_became_peered":"2024-04-25T09:57:15.752123+0000","last_unstale":"2024-04-25T09:57:15.755315+0000","last_undegraded":"2024-04-25T09:57:15.755315+0000","last_fullsized":"2024-04-25T09:57:15.755315+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:03.777858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.740242+0000","last_change":"2024-04-25T09:57:14.740242+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.740242+0000","last_undegraded":"2024-04-25T09:57:14.740242+0000","last_fullsized":"2024-04-25T09:57:14.740242+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.771070+0000","last_change":"2024-04-25T09:57:15.769491+0000","last_active":"2024-04-25T09:57:15.771070+0000","last_peered":"2024-04-25T09:57:15.771070+0000","last_clean":"2024-04-25T09:57:15.771070+0000","last_became_active":"2024-04-25T09:57:15.768694+0000","last_became_peered":"2024-04-25T09:57:15.768694+0000","last_unstale":"2024-04-25T09:57:15.771070+0000","last_undegraded":"2024-04-25T09:57:15.771070+0000","last_fullsized":"2024-04-25T09:57:15.771070+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:08.997796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.767994+0000","last_change":"2024-04-25T09:57:15.767087+0000","last_active":"2024-04-25T09:57:15.767994+0000","last_peered":"2024-04-25T09:57:15.767994+0000","last_clean":"2024-04-25T09:57:15.767994+0000","last_became_active":"2024-04-25T09:57:15.766747+0000","last_became_peered":"2024-04-25T09:57:15.766747+0000","last_unstale":"2024-04-25T09:57:15.767994+0000","last_undegraded":"2024-04-25T09:57:15.767994+0000","last_fullsized":"2024-04-25T09:57:15.767994+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:35.319064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.749807+0000","last_change":"2024-04-25T09:57:15.745892+0000","last_active":"2024-04-25T09:57:15.749807+0000","last_peered":"2024-04-25T09:57:15.749807+0000","last_clean":"2024-04-25T09:57:15.749807+0000","last_became_active":"2024-04-25T09:57:15.745553+0000","last_became_peered":"2024-04-25T09:57:15.745553+0000","last_unstale":"2024-04-25T09:57:15.749807+0000","last_undegraded":"2024-04-25T09:57:15.749807+0000","last_fullsized":"2024-04-25T09:57:15.749807+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:21:58.966692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.739933+0000","last_change":"2024-04-25T09:57:14.739933+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.739933+0000","last_undegraded":"2024-04-25T09:57:14.739933+0000","last_fullsized":"2024-04-25T09:57:14.739933+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.757016+0000","last_change":"2024-04-25T09:57:15.754290+0000","last_active":"2024-04-25T09:57:15.757016+0000","last_peered":"2024-04-25T09:57:15.757016+0000","last_clean":"2024-04-25T09:57:15.757016+0000","last_became_active":"2024-04-25T09:57:15.753872+0000","last_became_peered":"2024-04-25T09:57:15.753872+0000","last_unstale":"2024-04-25T09:57:15.757016+0000","last_undegraded":"2024-04-25T09:57:15.757016+0000","last_fullsized":"2024-04-25T09:57:15.757016+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:26.061064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.758719+0000","last_change":"2024-04-25T09:57:14.758285+0000","last_active":"2024-04-25T09:57:14.758719+0000","last_peered":"2024-04-25T09:57:14.758719+0000","last_clean":"2024-04-25T09:57:14.758719+0000","last_became_active":"2024-04-25T09:57:14.757995+0000","last_became_peered":"2024-04-25T09:57:14.757995+0000","last_unstale":"2024-04-25T09:57:14.758719+0000","last_undegraded":"2024-04-25T09:57:14.758719+0000","last_fullsized":"2024-04-25T09:57:14.758719+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:01:30.387519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.766480+0000","last_change":"2024-04-25T09:57:15.762946+0000","last_active":"2024-04-25T09:57:15.766480+0000","last_peered":"2024-04-25T09:57:15.766480+0000","last_clean":"2024-04-25T09:57:15.766480+0000","last_became_active":"2024-04-25T09:57:15.761468+0000","last_became_peered":"2024-04-25T09:57:15.761468+0000","last_unstale":"2024-04-25T09:57:15.766480+0000","last_undegraded":"2024-04-25T09:57:15.766480+0000","last_fullsized":"2024-04-25T09:57:15.766480+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:05:54.427158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.750269+0000","last_change":"2024-04-25T09:57:14.747757+0000","last_active":"2024-04-25T09:57:14.750269+0000","last_peered":"2024-04-25T09:57:14.750269+0000","last_clean":"2024-04-25T09:57:14.750269+0000","last_became_active":"2024-04-25T09:57:14.747474+0000","last_became_peered":"2024-04-25T09:57:14.747474+0000","last_unstale":"2024-04-25T09:57:14.750269+0000","last_undegraded":"2024-04-25T09:57:14.750269+0000","last_fullsized":"2024-04-25T09:57:14.750269+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:57.049874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.738966+0000","last_change":"2024-04-25T09:57:14.738966+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.738966+0000","last_undegraded":"2024-04-25T09:57:14.738966+0000","last_fullsized":"2024-04-25T09:57:14.738966+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.750397+0000","last_change":"2024-04-25T09:57:14.746173+0000","last_active":"2024-04-25T09:57:14.750397+0000","last_peered":"2024-04-25T09:57:14.750397+0000","last_clean":"2024-04-25T09:57:14.750397+0000","last_became_active":"2024-04-25T09:57:14.744978+0000","last_became_peered":"2024-04-25T09:57:14.744978+0000","last_unstale":"2024-04-25T09:57:14.750397+0000","last_undegraded":"2024-04-25T09:57:14.750397+0000","last_fullsized":"2024-04-25T09:57:14.750397+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:26.411491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.771033+0000","last_change":"2024-04-25T09:57:15.768921+0000","last_active":"2024-04-25T09:57:15.771033+0000","last_peered":"2024-04-25T09:57:15.771033+0000","last_clean":"2024-04-25T09:57:15.771033+0000","last_became_active":"2024-04-25T09:57:15.768327+0000","last_became_peered":"2024-04-25T09:57:15.768327+0000","last_unstale":"2024-04-25T09:57:15.771033+0000","last_undegraded":"2024-04-25T09:57:15.771033+0000","last_fullsized":"2024-04-25T09:57:15.771033+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:35.319064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.751369+0000","last_change":"2024-04-25T09:57:14.750473+0000","last_active":"2024-04-25T09:57:14.751369+0000","last_peered":"2024-04-25T09:57:14.751369+0000","last_clean":"2024-04-25T09:57:14.751369+0000","last_became_active":"2024-04-25T09:57:14.750124+0000","last_became_peered":"2024-04-25T09:57:14.750124+0000","last_unstale":"2024-04-25T09:57:14.751369+0000","last_undegraded":"2024-04-25T09:57:14.751369+0000","last_fullsized":"2024-04-25T09:57:14.751369+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:04:07.820129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.735799+0000","last_change":"2024-04-25T09:57:14.735799+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.735799+0000","last_undegraded":"2024-04-25T09:57:14.735799+0000","last_fullsized":"2024-04-25T09:57:14.735799+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.747504+0000","last_change":"2024-04-25T09:57:14.744916+0000","last_active":"2024-04-25T09:57:14.747504+0000","last_peered":"2024-04-25T09:57:14.747504+0000","last_clean":"2024-04-25T09:57:14.747504+0000","last_became_active":"2024-04-25T09:57:14.744384+0000","last_became_peered":"2024-04-25T09:57:14.744384+0000","last_unstale":"2024-04-25T09:57:14.747504+0000","last_undegraded":"2024-04-25T09:57:14.747504+0000","last_fullsized":"2024-04-25T09:57:14.747504+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:36.216367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.738167+0000","last_change":"2024-04-25T09:57:14.738167+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.738167+0000","last_undegraded":"2024-04-25T09:57:14.738167+0000","last_fullsized":"2024-04-25T09:57:14.738167+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.746032+0000","last_change":"2024-04-25T09:57:14.742815+0000","last_active":"2024-04-25T09:57:14.746032+0000","last_peered":"2024-04-25T09:57:14.746032+0000","last_clean":"2024-04-25T09:57:14.746032+0000","last_became_active":"2024-04-25T09:57:14.742518+0000","last_became_peered":"2024-04-25T09:57:14.742518+0000","last_unstale":"2024-04-25T09:57:14.746032+0000","last_undegraded":"2024-04-25T09:57:14.746032+0000","last_fullsized":"2024-04-25T09:57:14.746032+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:34.316720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759262+0000","last_change":"2024-04-25T09:57:15.756573+0000","last_active":"2024-04-25T09:57:15.759262+0000","last_peered":"2024-04-25T09:57:15.759262+0000","last_clean":"2024-04-25T09:57:15.759262+0000","last_became_active":"2024-04-25T09:57:15.755701+0000","last_became_peered":"2024-04-25T09:57:15.755701+0000","last_unstale":"2024-04-25T09:57:15.759262+0000","last_undegraded":"2024-04-25T09:57:15.759262+0000","last_fullsized":"2024-04-25T09:57:15.759262+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:11.276834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.747563+0000","last_change":"2024-04-25T09:57:14.746062+0000","last_active":"2024-04-25T09:57:14.747563+0000","last_peered":"2024-04-25T09:57:14.747563+0000","last_clean":"2024-04-25T09:57:14.747563+0000","last_became_active":"2024-04-25T09:57:14.745664+0000","last_became_peered":"2024-04-25T09:57:14.745664+0000","last_unstale":"2024-04-25T09:57:14.747563+0000","last_undegraded":"2024-04-25T09:57:14.747563+0000","last_fullsized":"2024-04-25T09:57:14.747563+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:57.049874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.734950+0000","last_change":"2024-04-25T09:57:14.734950+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.734950+0000","last_undegraded":"2024-04-25T09:57:14.734950+0000","last_fullsized":"2024-04-25T09:57:14.734950+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.740713+0000","last_change":"2024-04-25T09:57:14.752874+0000","last_active":"2024-04-25T09:57:15.740713+0000","last_peered":"2024-04-25T09:57:15.740713+0000","last_clean":"2024-04-25T09:57:15.740713+0000","last_became_active":"2024-04-25T09:57:14.752542+0000","last_became_peered":"2024-04-25T09:57:14.752542+0000","last_unstale":"2024-04-25T09:57:15.740713+0000","last_undegraded":"2024-04-25T09:57:15.740713+0000","last_fullsized":"2024-04-25T09:57:15.740713+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:50.631716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.738121+0000","last_change":"2024-04-25T09:57:14.738121+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.738121+0000","last_undegraded":"2024-04-25T09:57:14.738121+0000","last_fullsized":"2024-04-25T09:57:14.738121+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.758067+0000","last_change":"2024-04-25T09:57:14.758286+0000","last_active":"2024-04-25T09:57:15.758067+0000","last_peered":"2024-04-25T09:57:15.758067+0000","last_clean":"2024-04-25T09:57:15.758067+0000","last_became_active":"2024-04-25T09:57:14.757885+0000","last_became_peered":"2024-04-25T09:57:14.757885+0000","last_unstale":"2024-04-25T09:57:15.758067+0000","last_undegraded":"2024-04-25T09:57:15.758067+0000","last_fullsized":"2024-04-25T09:57:15.758067+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:47.050365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.735099+0000","last_change":"2024-04-25T09:57:14.735099+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.735099+0000","last_undegraded":"2024-04-25T09:57:14.735099+0000","last_fullsized":"2024-04-25T09:57:14.735099+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.742873+0000","last_change":"2024-04-25T09:57:14.744998+0000","last_active":"2024-04-25T09:57:15.742873+0000","last_peered":"2024-04-25T09:57:15.742873+0000","last_clean":"2024-04-25T09:57:15.742873+0000","last_became_active":"2024-04-25T09:57:14.744717+0000","last_became_peered":"2024-04-25T09:57:14.744717+0000","last_unstale":"2024-04-25T09:57:15.742873+0000","last_undegraded":"2024-04-25T09:57:15.742873+0000","last_fullsized":"2024-04-25T09:57:15.742873+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:44.683150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.761689+0000","last_change":"2024-04-25T09:57:15.758927+0000","last_active":"2024-04-25T09:57:15.761689+0000","last_peered":"2024-04-25T09:57:15.761689+0000","last_clean":"2024-04-25T09:57:15.761689+0000","last_became_active":"2024-04-25T09:57:15.758613+0000","last_became_peered":"2024-04-25T09:57:15.758613+0000","last_unstale":"2024-04-25T09:57:15.761689+0000","last_undegraded":"2024-04-25T09:57:15.761689+0000","last_fullsized":"2024-04-25T09:57:15.761689+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:22.009595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"61'3","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.771456+0000","last_change":"2024-04-25T09:57:14.758891+0000","last_active":"2024-04-25T09:57:15.771456+0000","last_peered":"2024-04-25T09:57:15.771456+0000","last_clean":"2024-04-25T09:57:15.771456+0000","last_became_active":"2024-04-25T09:57:14.757957+0000","last_became_peered":"2024-04-25T09:57:14.757957+0000","last_unstale":"2024-04-25T09:57:15.771456+0000","last_undegraded":"2024-04-25T09:57:15.771456+0000","last_fullsized":"2024-04-25T09:57:15.771456+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:51.436833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.763214+0000","last_change":"2024-04-25T09:57:15.755461+0000","last_active":"2024-04-25T09:57:15.763214+0000","last_peered":"2024-04-25T09:57:15.763214+0000","last_clean":"2024-04-25T09:57:15.763214+0000","last_became_active":"2024-04-25T09:57:15.755099+0000","last_became_peered":"2024-04-25T09:57:15.755099+0000","last_unstale":"2024-04-25T09:57:15.763214+0000","last_undegraded":"2024-04-25T09:57:15.763214+0000","last_fullsized":"2024-04-25T09:57:15.763214+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:56.132114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.749740+0000","last_change":"2024-04-25T09:57:14.748332+0000","last_active":"2024-04-25T09:57:14.749740+0000","last_peered":"2024-04-25T09:57:14.749740+0000","last_clean":"2024-04-25T09:57:14.749740+0000","last_became_active":"2024-04-25T09:57:14.747993+0000","last_became_peered":"2024-04-25T09:57:14.747993+0000","last_unstale":"2024-04-25T09:57:14.749740+0000","last_undegraded":"2024-04-25T09:57:14.749740+0000","last_fullsized":"2024-04-25T09:57:14.749740+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:19.567964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.768739+0000","last_change":"2024-04-25T09:57:15.766168+0000","last_active":"2024-04-25T09:57:15.768739+0000","last_peered":"2024-04-25T09:57:15.768739+0000","last_clean":"2024-04-25T09:57:15.768739+0000","last_became_active":"2024-04-25T09:57:15.764964+0000","last_became_peered":"2024-04-25T09:57:15.764964+0000","last_unstale":"2024-04-25T09:57:15.768739+0000","last_undegraded":"2024-04-25T09:57:15.768739+0000","last_fullsized":"2024-04-25T09:57:15.768739+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:05.715956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.765921+0000","last_change":"2024-04-25T09:57:14.758611+0000","last_active":"2024-04-25T09:57:15.765921+0000","last_peered":"2024-04-25T09:57:15.765921+0000","last_clean":"2024-04-25T09:57:15.765921+0000","last_became_active":"2024-04-25T09:57:14.757880+0000","last_became_peered":"2024-04-25T09:57:14.757880+0000","last_unstale":"2024-04-25T09:57:15.765921+0000","last_undegraded":"2024-04-25T09:57:15.765921+0000","last_fullsized":"2024-04-25T09:57:15.765921+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:42.586862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.758828+0000","last_change":"2024-04-25T09:57:15.751535+0000","last_active":"2024-04-25T09:57:15.758828+0000","last_peered":"2024-04-25T09:57:15.758828+0000","last_clean":"2024-04-25T09:57:15.758828+0000","last_became_active":"2024-04-25T09:57:15.751257+0000","last_became_peered":"2024-04-25T09:57:15.751257+0000","last_unstale":"2024-04-25T09:57:15.758828+0000","last_undegraded":"2024-04-25T09:57:15.758828+0000","last_fullsized":"2024-04-25T09:57:15.758828+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:56.030922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.739411+0000","last_change":"2024-04-25T09:57:14.750136+0000","last_active":"2024-04-25T09:57:15.739411+0000","last_peered":"2024-04-25T09:57:15.739411+0000","last_clean":"2024-04-25T09:57:15.739411+0000","last_became_active":"2024-04-25T09:57:14.749841+0000","last_became_peered":"2024-04-25T09:57:14.749841+0000","last_unstale":"2024-04-25T09:57:15.739411+0000","last_undegraded":"2024-04-25T09:57:15.739411+0000","last_fullsized":"2024-04-25T09:57:15.739411+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:47.050365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759245+0000","last_change":"2024-04-25T09:57:15.756190+0000","last_active":"2024-04-25T09:57:15.759245+0000","last_peered":"2024-04-25T09:57:15.759245+0000","last_clean":"2024-04-25T09:57:15.759245+0000","last_became_active":"2024-04-25T09:57:15.755333+0000","last_became_peered":"2024-04-25T09:57:15.755333+0000","last_unstale":"2024-04-25T09:57:15.759245+0000","last_undegraded":"2024-04-25T09:57:15.759245+0000","last_fullsized":"2024-04-25T09:57:15.759245+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:43.991599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.756105+0000","last_change":"2024-04-25T09:57:14.758679+0000","last_active":"2024-04-25T09:57:15.756105+0000","last_peered":"2024-04-25T09:57:15.756105+0000","last_clean":"2024-04-25T09:57:15.756105+0000","last_became_active":"2024-04-25T09:57:14.758320+0000","last_became_peered":"2024-04-25T09:57:14.758320+0000","last_unstale":"2024-04-25T09:57:15.756105+0000","last_undegraded":"2024-04-25T09:57:15.756105+0000","last_fullsized":"2024-04-25T09:57:15.756105+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:25.679262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.737498+0000","last_change":"2024-04-25T09:57:14.737498+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.737498+0000","last_undegraded":"2024-04-25T09:57:14.737498+0000","last_fullsized":"2024-04-25T09:57:14.737498+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"61'8","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.769776+0000","last_change":"2024-04-25T09:57:14.749907+0000","last_active":"2024-04-25T09:57:15.769776+0000","last_peered":"2024-04-25T09:57:15.769776+0000","last_clean":"2024-04-25T09:57:15.769776+0000","last_became_active":"2024-04-25T09:57:14.748686+0000","last_became_peered":"2024-04-25T09:57:14.748686+0000","last_unstale":"2024-04-25T09:57:15.769776+0000","last_undegraded":"2024-04-25T09:57:15.769776+0000","last_fullsized":"2024-04-25T09:57:15.769776+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:26:09.170713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.769946+0000","last_change":"2024-04-25T09:57:15.767545+0000","last_active":"2024-04-25T09:57:15.769946+0000","last_peered":"2024-04-25T09:57:15.769946+0000","last_clean":"2024-04-25T09:57:15.769946+0000","last_became_active":"2024-04-25T09:57:15.767252+0000","last_became_peered":"2024-04-25T09:57:15.767252+0000","last_unstale":"2024-04-25T09:57:15.769946+0000","last_undegraded":"2024-04-25T09:57:15.769946+0000","last_fullsized":"2024-04-25T09:57:15.769946+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:47.721018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759249+0000","last_change":"2024-04-25T09:57:14.749754+0000","last_active":"2024-04-25T09:57:15.759249+0000","last_peered":"2024-04-25T09:57:15.759249+0000","last_clean":"2024-04-25T09:57:15.759249+0000","last_became_active":"2024-04-25T09:57:14.749258+0000","last_became_peered":"2024-04-25T09:57:14.749258+0000","last_unstale":"2024-04-25T09:57:15.759249+0000","last_undegraded":"2024-04-25T09:57:15.759249+0000","last_fullsized":"2024-04-25T09:57:15.759249+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:25.679262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.756532+0000","last_change":"2024-04-25T09:57:15.751259+0000","last_active":"2024-04-25T09:57:15.756532+0000","last_peered":"2024-04-25T09:57:15.756532+0000","last_clean":"2024-04-25T09:57:15.756532+0000","last_became_active":"2024-04-25T09:57:15.750979+0000","last_became_peered":"2024-04-25T09:57:15.750979+0000","last_unstale":"2024-04-25T09:57:15.756532+0000","last_undegraded":"2024-04-25T09:57:15.756532+0000","last_fullsized":"2024-04-25T09:57:15.756532+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:45.975880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.766274+0000","last_change":"2024-04-25T09:57:14.758286+0000","last_active":"2024-04-25T09:57:15.766274+0000","last_peered":"2024-04-25T09:57:15.766274+0000","last_clean":"2024-04-25T09:57:15.766274+0000","last_became_active":"2024-04-25T09:57:14.757970+0000","last_became_peered":"2024-04-25T09:57:14.757970+0000","last_unstale":"2024-04-25T09:57:15.766274+0000","last_undegraded":"2024-04-25T09:57:15.766274+0000","last_fullsized":"2024-04-25T09:57:15.766274+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:03.967389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.764468+0000","last_change":"2024-04-25T09:57:15.760819+0000","last_active":"2024-04-25T09:57:15.764468+0000","last_peered":"2024-04-25T09:57:15.764468+0000","last_clean":"2024-04-25T09:57:15.764468+0000","last_became_active":"2024-04-25T09:57:15.760488+0000","last_became_peered":"2024-04-25T09:57:15.760488+0000","last_unstale":"2024-04-25T09:57:15.764468+0000","last_undegraded":"2024-04-25T09:57:15.764468+0000","last_fullsized":"2024-04-25T09:57:15.764468+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:45.975880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.770372+0000","last_change":"2024-04-25T09:57:14.758906+0000","last_active":"2024-04-25T09:57:15.770372+0000","last_peered":"2024-04-25T09:57:15.770372+0000","last_clean":"2024-04-25T09:57:15.770372+0000","last_became_active":"2024-04-25T09:57:14.758479+0000","last_became_peered":"2024-04-25T09:57:14.758479+0000","last_unstale":"2024-04-25T09:57:15.770372+0000","last_undegraded":"2024-04-25T09:57:15.770372+0000","last_fullsized":"2024-04-25T09:57:15.770372+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:12.283665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.756716+0000","last_change":"2024-04-25T09:57:15.754377+0000","last_active":"2024-04-25T09:57:15.756716+0000","last_peered":"2024-04-25T09:57:15.756716+0000","last_clean":"2024-04-25T09:57:15.756716+0000","last_became_active":"2024-04-25T09:57:15.752933+0000","last_became_peered":"2024-04-25T09:57:15.752933+0000","last_unstale":"2024-04-25T09:57:15.756716+0000","last_undegraded":"2024-04-25T09:57:15.756716+0000","last_fullsized":"2024-04-25T09:57:15.756716+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:05.715956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.745810+0000","last_change":"2024-04-25T09:57:14.742625+0000","last_active":"2024-04-25T09:57:14.745810+0000","last_peered":"2024-04-25T09:57:14.745810+0000","last_clean":"2024-04-25T09:57:14.745810+0000","last_became_active":"2024-04-25T09:57:14.742323+0000","last_became_peered":"2024-04-25T09:57:14.742323+0000","last_unstale":"2024-04-25T09:57:14.745810+0000","last_undegraded":"2024-04-25T09:57:14.745810+0000","last_fullsized":"2024-04-25T09:57:14.745810+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:37.033433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.739509+0000","last_change":"2024-04-25T09:57:14.739509+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.739509+0000","last_undegraded":"2024-04-25T09:57:14.739509+0000","last_fullsized":"2024-04-25T09:57:14.739509+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.750253+0000","last_change":"2024-04-25T09:57:14.744916+0000","last_active":"2024-04-25T09:57:14.750253+0000","last_peered":"2024-04-25T09:57:14.750253+0000","last_clean":"2024-04-25T09:57:14.750253+0000","last_became_active":"2024-04-25T09:57:14.744621+0000","last_became_peered":"2024-04-25T09:57:14.744621+0000","last_unstale":"2024-04-25T09:57:14.750253+0000","last_undegraded":"2024-04-25T09:57:14.750253+0000","last_fullsized":"2024-04-25T09:57:14.750253+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:07.995451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.758804+0000","last_change":"2024-04-25T09:57:15.747249+0000","last_active":"2024-04-25T09:57:15.758804+0000","last_peered":"2024-04-25T09:57:15.758804+0000","last_clean":"2024-04-25T09:57:15.758804+0000","last_became_active":"2024-04-25T09:57:15.746876+0000","last_became_peered":"2024-04-25T09:57:15.746876+0000","last_unstale":"2024-04-25T09:57:15.758804+0000","last_undegraded":"2024-04-25T09:57:15.758804+0000","last_fullsized":"2024-04-25T09:57:15.758804+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:52.439177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.739655+0000","last_change":"2024-04-25T09:57:14.749773+0000","last_active":"2024-04-25T09:57:15.739655+0000","last_peered":"2024-04-25T09:57:15.739655+0000","last_clean":"2024-04-25T09:57:15.739655+0000","last_became_active":"2024-04-25T09:57:14.749207+0000","last_became_peered":"2024-04-25T09:57:14.749207+0000","last_unstale":"2024-04-25T09:57:15.739655+0000","last_undegraded":"2024-04-25T09:57:15.739655+0000","last_fullsized":"2024-04-25T09:57:15.739655+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:36.078016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759224+0000","last_change":"2024-04-25T09:57:15.755964+0000","last_active":"2024-04-25T09:57:15.759224+0000","last_peered":"2024-04-25T09:57:15.759224+0000","last_clean":"2024-04-25T09:57:15.759224+0000","last_became_active":"2024-04-25T09:57:15.755024+0000","last_became_peered":"2024-04-25T09:57:15.755024+0000","last_unstale":"2024-04-25T09:57:15.759224+0000","last_undegraded":"2024-04-25T09:57:15.759224+0000","last_fullsized":"2024-04-25T09:57:15.759224+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:01:31.389864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.750784+0000","last_change":"2024-04-25T09:57:14.748763+0000","last_active":"2024-04-25T09:57:14.750784+0000","last_peered":"2024-04-25T09:57:14.750784+0000","last_clean":"2024-04-25T09:57:14.750784+0000","last_became_active":"2024-04-25T09:57:14.748442+0000","last_became_peered":"2024-04-25T09:57:14.748442+0000","last_unstale":"2024-04-25T09:57:14.750784+0000","last_undegraded":"2024-04-25T09:57:14.750784+0000","last_fullsized":"2024-04-25T09:57:14.750784+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:13.126972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.739208+0000","last_change":"2024-04-25T09:57:14.739208+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.739208+0000","last_undegraded":"2024-04-25T09:57:14.739208+0000","last_fullsized":"2024-04-25T09:57:14.739208+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.754602+0000","last_change":"2024-04-25T09:57:14.752504+0000","last_active":"2024-04-25T09:57:15.754602+0000","last_peered":"2024-04-25T09:57:15.754602+0000","last_clean":"2024-04-25T09:57:15.754602+0000","last_became_active":"2024-04-25T09:57:14.752223+0000","last_became_peered":"2024-04-25T09:57:14.752223+0000","last_unstale":"2024-04-25T09:57:15.754602+0000","last_undegraded":"2024-04-25T09:57:15.754602+0000","last_fullsized":"2024-04-25T09:57:15.754602+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:42.586862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.735336+0000","last_change":"2024-04-25T09:57:14.735336+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.735336+0000","last_undegraded":"2024-04-25T09:57:14.735336+0000","last_fullsized":"2024-04-25T09:57:14.735336+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.738659+0000","last_change":"2024-04-25T09:57:14.742094+0000","last_active":"2024-04-25T09:57:15.738659+0000","last_peered":"2024-04-25T09:57:15.738659+0000","last_clean":"2024-04-25T09:57:15.738659+0000","last_became_active":"2024-04-25T09:57:14.741829+0000","last_became_peered":"2024-04-25T09:57:14.741829+0000","last_unstale":"2024-04-25T09:57:15.738659+0000","last_undegraded":"2024-04-25T09:57:15.738659+0000","last_fullsized":"2024-04-25T09:57:15.738659+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:03.967389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759441+0000","last_change":"2024-04-25T09:57:15.753721+0000","last_active":"2024-04-25T09:57:15.759441+0000","last_peered":"2024-04-25T09:57:15.759441+0000","last_clean":"2024-04-25T09:57:15.759441+0000","last_became_active":"2024-04-25T09:57:15.753367+0000","last_became_peered":"2024-04-25T09:57:15.753367+0000","last_unstale":"2024-04-25T09:57:15.759441+0000","last_undegraded":"2024-04-25T09:57:15.759441+0000","last_fullsized":"2024-04-25T09:57:15.759441+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:36.249678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.750376+0000","last_change":"2024-04-25T09:57:14.745936+0000","last_active":"2024-04-25T09:57:14.750376+0000","last_peered":"2024-04-25T09:57:14.750376+0000","last_clean":"2024-04-25T09:57:14.750376+0000","last_became_active":"2024-04-25T09:57:14.744599+0000","last_became_peered":"2024-04-25T09:57:14.744599+0000","last_unstale":"2024-04-25T09:57:14.750376+0000","last_undegraded":"2024-04-25T09:57:14.750376+0000","last_fullsized":"2024-04-25T09:57:14.750376+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:36.216367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.756736+0000","last_change":"2024-04-25T09:57:15.753219+0000","last_active":"2024-04-25T09:57:15.756736+0000","last_peered":"2024-04-25T09:57:15.756736+0000","last_clean":"2024-04-25T09:57:15.756736+0000","last_became_active":"2024-04-25T09:57:15.752526+0000","last_became_peered":"2024-04-25T09:57:15.752526+0000","last_unstale":"2024-04-25T09:57:15.756736+0000","last_undegraded":"2024-04-25T09:57:15.756736+0000","last_fullsized":"2024-04-25T09:57:15.756736+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:20.570308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.749715+0000","last_change":"2024-04-25T09:57:14.747370+0000","last_active":"2024-04-25T09:57:14.749715+0000","last_peered":"2024-04-25T09:57:14.749715+0000","last_clean":"2024-04-25T09:57:14.749715+0000","last_became_active":"2024-04-25T09:57:14.747109+0000","last_became_peered":"2024-04-25T09:57:14.747109+0000","last_unstale":"2024-04-25T09:57:14.749715+0000","last_undegraded":"2024-04-25T09:57:14.749715+0000","last_fullsized":"2024-04-25T09:57:14.749715+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:04.713611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759187+0000","last_change":"2024-04-25T09:57:15.757598+0000","last_active":"2024-04-25T09:57:15.759187+0000","last_peered":"2024-04-25T09:57:15.759187+0000","last_clean":"2024-04-25T09:57:15.759187+0000","last_became_active":"2024-04-25T09:57:15.757291+0000","last_became_peered":"2024-04-25T09:57:15.757291+0000","last_unstale":"2024-04-25T09:57:15.759187+0000","last_undegraded":"2024-04-25T09:57:15.759187+0000","last_fullsized":"2024-04-25T09:57:15.759187+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:14.414068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.758295+0000","last_change":"2024-04-25T09:57:14.758651+0000","last_active":"2024-04-25T09:57:15.758295+0000","last_peered":"2024-04-25T09:57:15.758295+0000","last_clean":"2024-04-25T09:57:15.758295+0000","last_became_active":"2024-04-25T09:57:14.758265+0000","last_became_peered":"2024-04-25T09:57:14.758265+0000","last_unstale":"2024-04-25T09:57:15.758295+0000","last_undegraded":"2024-04-25T09:57:15.758295+0000","last_fullsized":"2024-04-25T09:57:15.758295+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:36.078016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.768753+0000","last_change":"2024-04-25T09:57:15.766207+0000","last_active":"2024-04-25T09:57:15.768753+0000","last_peered":"2024-04-25T09:57:15.768753+0000","last_clean":"2024-04-25T09:57:15.768753+0000","last_became_active":"2024-04-25T09:57:15.765910+0000","last_became_peered":"2024-04-25T09:57:15.765910+0000","last_unstale":"2024-04-25T09:57:15.768753+0000","last_undegraded":"2024-04-25T09:57:15.768753+0000","last_fullsized":"2024-04-25T09:57:15.768753+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:20.570308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.746060+0000","last_change":"2024-04-25T09:57:14.743166+0000","last_active":"2024-04-25T09:57:14.746060+0000","last_peered":"2024-04-25T09:57:14.746060+0000","last_clean":"2024-04-25T09:57:14.746060+0000","last_became_active":"2024-04-25T09:57:14.742849+0000","last_became_peered":"2024-04-25T09:57:14.742849+0000","last_unstale":"2024-04-25T09:57:14.746060+0000","last_undegraded":"2024-04-25T09:57:14.746060+0000","last_fullsized":"2024-04-25T09:57:14.746060+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:42.168255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.736953+0000","last_change":"2024-04-25T09:57:14.736953+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.736953+0000","last_undegraded":"2024-04-25T09:57:14.736953+0000","last_fullsized":"2024-04-25T09:57:14.736953+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.747542+0000","last_change":"2024-04-25T09:57:14.745243+0000","last_active":"2024-04-25T09:57:14.747542+0000","last_peered":"2024-04-25T09:57:14.747542+0000","last_clean":"2024-04-25T09:57:14.747542+0000","last_became_active":"2024-04-25T09:57:14.744863+0000","last_became_peered":"2024-04-25T09:57:14.744863+0000","last_unstale":"2024-04-25T09:57:14.747542+0000","last_undegraded":"2024-04-25T09:57:14.747542+0000","last_fullsized":"2024-04-25T09:57:14.747542+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:26.411491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.735406+0000","last_change":"2024-04-25T09:57:14.735406+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.735406+0000","last_undegraded":"2024-04-25T09:57:14.735406+0000","last_fullsized":"2024-04-25T09:57:14.735406+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.746338+0000","last_change":"2024-04-25T09:57:14.745523+0000","last_active":"2024-04-25T09:57:14.746338+0000","last_peered":"2024-04-25T09:57:14.746338+0000","last_clean":"2024-04-25T09:57:14.746338+0000","last_became_active":"2024-04-25T09:57:14.745243+0000","last_became_peered":"2024-04-25T09:57:14.745243+0000","last_unstale":"2024-04-25T09:57:14.746338+0000","last_undegraded":"2024-04-25T09:57:14.746338+0000","last_fullsized":"2024-04-25T09:57:14.746338+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:25.058720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.762195+0000","last_change":"2024-04-25T09:57:15.759399+0000","last_active":"2024-04-25T09:57:15.762195+0000","last_peered":"2024-04-25T09:57:15.762195+0000","last_clean":"2024-04-25T09:57:15.762195+0000","last_became_active":"2024-04-25T09:57:15.758243+0000","last_became_peered":"2024-04-25T09:57:15.758243+0000","last_unstale":"2024-04-25T09:57:15.762195+0000","last_undegraded":"2024-04-25T09:57:15.762195+0000","last_fullsized":"2024-04-25T09:57:15.762195+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:04.969733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.747693+0000","last_change":"2024-04-25T09:57:14.744509+0000","last_active":"2024-04-25T09:57:14.747693+0000","last_peered":"2024-04-25T09:57:14.747693+0000","last_clean":"2024-04-25T09:57:14.747693+0000","last_became_active":"2024-04-25T09:57:14.744156+0000","last_became_peered":"2024-04-25T09:57:14.744156+0000","last_unstale":"2024-04-25T09:57:14.747693+0000","last_undegraded":"2024-04-25T09:57:14.747693+0000","last_fullsized":"2024-04-25T09:57:14.747693+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:07.995451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":243,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.758136+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T09:57:15.758136+0000","last_peered":"2024-04-25T09:57:15.758136+0000","last_clean":"2024-04-25T09:57:15.758136+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T09:57:15.758136+0000","last_undegraded":"2024-04-25T09:57:15.758136+0000","last_fullsized":"2024-04-25T09:57:15.758136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":216,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542183,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32468,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1314816,"data_stored":910803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542183,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":720896,"data_stored":320435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542185,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":737280,"data_stored":327624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542182,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":720896,"data_stored":320435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31872,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":708608,"data_stored":313776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31876,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339964,"statfs":{"total":96636764160,"available":96604123136,"internally_reserved":0,"allocated":708608,"data_stored":313776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31872,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":708608,"data_stored":313776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1302528,"data_stored":904144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:57:18.762 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:57:18.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.896+0000 7fc142815640 1 Processor -- start 2024-04-25T09:57:18.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.896+0000 7fc142815640 1 -- start start 2024-04-25T09:57:18.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.896+0000 7fc142815640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc13c0ced20 0x7fc13c0cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:18.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.896+0000 7fc142815640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc13c0cdbf0 con 0x7fc13c06e970 2024-04-25T09:57:18.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.896+0000 7fc142815640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc13c0cded0 con 0x7fc13c144100 2024-04-25T09:57:18.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.896+0000 7fc142815640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc13c1444e0 con 0x7fc13c0ced20 2024-04-25T09:57:18.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.897+0000 7fc140db2640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc13c0ced20 0x7fc13c0cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:18.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.897+0000 7fc140db2640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc13c0ced20 0x7fc13c0cd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49320/0 (socket says 172.21.15.7:49320) 2024-04-25T09:57:18.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.897+0000 7fc140db2640 1 -- 172.21.15.7:0/512234419 learned_addr learned my addr 172.21.15.7:0/512234419 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:18.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.897+0000 7fc13b7fe640 1 --1- 172.21.15.7:0/512234419 >> v1:172.21.15.7:6789/0 conn(0x7fc13c06e970 0x7fc13c15b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56116/0 (socket says 172.21.15.7:56116) 2024-04-25T09:57:18.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.897+0000 7fc140db2640 1 -- 172.21.15.7:0/512234419 >> v1:172.21.15.55:6789/0 conn(0x7fc13c144100 legacy=0x7fc13c06e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:18.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.897+0000 7fc140db2640 1 -- 172.21.15.7:0/512234419 >> v1:172.21.15.7:6789/0 conn(0x7fc13c06e970 legacy=0x7fc13c15b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:18.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.897+0000 7fc140db2640 1 -- 172.21.15.7:0/512234419 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13c0ce1b0 con 0x7fc13c0ced20 2024-04-25T09:57:18.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.897+0000 7fc13affd640 1 -- 172.21.15.7:0/512234419 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 484601786 0 0) 0x7fc13c0cdbf0 con 0x7fc13c06e970 2024-04-25T09:57:18.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.898+0000 7fc140db2640 1 --2- 172.21.15.7:0/512234419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc13c0ced20 0x7fc13c0cd610 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fc134009e50 tx=0x7fc13402a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c58cbd5d1f98af02 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:18.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.898+0000 7fc13affd640 1 -- 172.21.15.7:0/512234419 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc134036070 con 0x7fc13c0ced20 2024-04-25T09:57:18.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.898+0000 7fc13affd640 1 -- 172.21.15.7:0/512234419 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc134031600 con 0x7fc13c0ced20 2024-04-25T09:57:18.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.898+0000 7fc13affd640 1 -- 172.21.15.7:0/512234419 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1340319d0 con 0x7fc13c0ced20 2024-04-25T09:57:18.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.898+0000 7fc142815640 1 -- 172.21.15.7:0/512234419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc13c0ced20 msgr2=0x7fc13c0cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:18.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.898+0000 7fc142815640 1 --2- 172.21.15.7:0/512234419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc13c0ced20 0x7fc13c0cd610 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fc134009e50 tx=0x7fc13402a6d0 comp rx=0 tx=0).stop 2024-04-25T09:57:18.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.898+0000 7fc142815640 1 -- 172.21.15.7:0/512234419 shutdown_connections 2024-04-25T09:57:18.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.898+0000 7fc142815640 1 --2- 172.21.15.7:0/512234419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc13c0ced20 0x7fc13c0cd610 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:18.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.898+0000 7fc142815640 1 -- 172.21.15.7:0/512234419 >> 172.21.15.7:0/512234419 conn(0x7fc13c071150 msgr2=0x7fc13c071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:18.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.898+0000 7fc142815640 1 -- 172.21.15.7:0/512234419 shutdown_connections 2024-04-25T09:57:18.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.898+0000 7fc142815640 1 -- 172.21.15.7:0/512234419 wait complete. 2024-04-25T09:57:18.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.899+0000 7fc142815640 1 Processor -- start 2024-04-25T09:57:18.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.900+0000 7fc142815640 1 -- start start 2024-04-25T09:57:18.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.900+0000 7fc142815640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc13c06e970 0x7fc13c150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:18.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.900+0000 7fc142815640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc13c0ced20 0x7fc13c13dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:18.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.900+0000 7fc142815640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc13c144100 0x7fc13c1f02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:18.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.900+0000 7fc142815640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13c0cea00 con 0x7fc13c06e970 2024-04-25T09:57:18.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.900+0000 7fc142815640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13c15ac70 con 0x7fc13c144100 2024-04-25T09:57:18.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.900+0000 7fc142815640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc13c15b840 con 0x7fc13c0ced20 2024-04-25T09:57:18.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.900+0000 7fc13bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc13c06e970 0x7fc13c150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:18.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.901+0000 7fc13bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc13c06e970 0x7fc13c150f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49324/0 (socket says 172.21.15.7:49324) 2024-04-25T09:57:18.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.901+0000 7fc13bfff640 1 -- 172.21.15.7:0/260820780 learned_addr learned my addr 172.21.15.7:0/260820780 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:18.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.901+0000 7fc13bfff640 1 -- 172.21.15.7:0/260820780 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc13c0ced20 msgr2=0x7fc13c13dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:18.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.901+0000 7fc140db2640 1 --2- 172.21.15.7:0/260820780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc13c144100 0x7fc13c1f02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:18.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.901+0000 7fc13bfff640 1 --2- 172.21.15.7:0/260820780 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc13c0ced20 0x7fc13c13dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:18.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.901+0000 7fc13bfff640 1 -- 172.21.15.7:0/260820780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc13c144100 msgr2=0x7fc13c1f02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:18.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.901+0000 7fc13bfff640 1 --2- 172.21.15.7:0/260820780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc13c144100 0x7fc13c1f02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:18.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.901+0000 7fc13bfff640 1 -- 172.21.15.7:0/260820780 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13c13b850 con 0x7fc13c06e970 2024-04-25T09:57:18.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.901+0000 7fc13bfff640 1 --2- 172.21.15.7:0/260820780 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc13c06e970 0x7fc13c150f60 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fc13000b3f0 tx=0x7fc13000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:18.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.901+0000 7fc138ff9640 1 -- 172.21.15.7:0/260820780 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc130015020 con 0x7fc13c06e970 2024-04-25T09:57:18.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.901+0000 7fc138ff9640 1 -- 172.21.15.7:0/260820780 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc130011830 con 0x7fc13c06e970 2024-04-25T09:57:18.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.901+0000 7fc142815640 1 -- 172.21.15.7:0/260820780 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc13c13eab0 con 0x7fc13c06e970 2024-04-25T09:57:18.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.901+0000 7fc138ff9640 1 -- 172.21.15.7:0/260820780 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc130011c20 con 0x7fc13c06e970 2024-04-25T09:57:18.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.901+0000 7fc142815640 1 -- 172.21.15.7:0/260820780 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc13c13f070 con 0x7fc13c06e970 2024-04-25T09:57:18.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.902+0000 7fc142815640 1 -- 172.21.15.7:0/260820780 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc13c068fd0 con 0x7fc13c06e970 2024-04-25T09:57:18.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.903+0000 7fc138ff9640 1 -- 172.21.15.7:0/260820780 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc130018020 con 0x7fc13c06e970 2024-04-25T09:57:18.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.903+0000 7fc138ff9640 1 --2- 172.21.15.7:0/260820780 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc12806b4d0 0x7fc12806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:18.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.903+0000 7fc13b7fe640 1 --2- 172.21.15.7:0/260820780 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc12806b4d0 0x7fc12806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:18.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.903+0000 7fc138ff9640 1 -- 172.21.15.7:0/260820780 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc130089f40 con 0x7fc13c06e970 2024-04-25T09:57:18.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.904+0000 7fc13b7fe640 1 --2- 172.21.15.7:0/260820780 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc12806b4d0 0x7fc12806d990 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc12c007fd0 tx=0x7fc12c007920 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:18.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:18.908+0000 7fc138ff9640 1 -- 172.21.15.7:0/260820780 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc13001f030 con 0x7fc13c06e970 2024-04-25T09:57:19.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.082+0000 7fc142815640 1 -- 172.21.15.7:0/260820780 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc13c143440 con 0x7fc12806b4d0 2024-04-25T09:57:19.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.088+0000 7fc138ff9640 1 -- 172.21.15.7:0/260820780 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250066 (secure 0 0 0) 0x7fc13c143440 con 0x7fc12806b4d0 2024-04-25T09:57:19.094 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:57:19.095 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T09:57:19.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.091+0000 7fc142815640 1 -- 172.21.15.7:0/260820780 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc12806b4d0 msgr2=0x7fc12806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:19.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.091+0000 7fc142815640 1 --2- 172.21.15.7:0/260820780 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc12806b4d0 0x7fc12806d990 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc12c007fd0 tx=0x7fc12c007920 comp rx=0 tx=0).stop 2024-04-25T09:57:19.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.091+0000 7fc142815640 1 -- 172.21.15.7:0/260820780 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc13c06e970 msgr2=0x7fc13c150f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:19.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.091+0000 7fc142815640 1 --2- 172.21.15.7:0/260820780 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc13c06e970 0x7fc13c150f60 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fc13000b3f0 tx=0x7fc13000b8b0 comp rx=0 tx=0).stop 2024-04-25T09:57:19.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.091+0000 7fc142815640 1 -- 172.21.15.7:0/260820780 shutdown_connections 2024-04-25T09:57:19.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.091+0000 7fc142815640 1 --2- 172.21.15.7:0/260820780 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc12806b4d0 0x7fc12806d990 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:19.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.091+0000 7fc142815640 1 --2- 172.21.15.7:0/260820780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc13c144100 0x7fc13c1f02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:19.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.091+0000 7fc142815640 1 --2- 172.21.15.7:0/260820780 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc13c0ced20 0x7fc13c13dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:19.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.091+0000 7fc142815640 1 --2- 172.21.15.7:0/260820780 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc13c06e970 0x7fc13c150f60 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:19.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.091+0000 7fc142815640 1 -- 172.21.15.7:0/260820780 >> 172.21.15.7:0/260820780 conn(0x7fc13c071150 msgr2=0x7fc13c142370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:19.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.091+0000 7fc142815640 1 -- 172.21.15.7:0/260820780 shutdown_connections 2024-04-25T09:57:19.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.091+0000 7fc142815640 1 -- 172.21.15.7:0/260820780 wait complete. 2024-04-25T09:57:19.105 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2024-04-25T09:57:17.890316+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590584,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":186,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256224,"kb_used_data":6760,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718496,"statfs":{"total":773094113280,"available":772831739904,"internally_reserved":0,"allocated":6922240,"data_stored":3724769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":216,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.166772"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.739601+0000","last_change":"2024-04-25T09:57:14.739601+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.739601+0000","last_undegraded":"2024-04-25T09:57:14.739601+0000","last_fullsized":"2024-04-25T09:57:14.739601+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.736881+0000","last_change":"2024-04-25T09:57:14.736881+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.736881+0000","last_undegraded":"2024-04-25T09:57:14.736881+0000","last_fullsized":"2024-04-25T09:57:14.736881+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.771130+0000","last_change":"2024-04-25T09:57:15.768429+0000","last_active":"2024-04-25T09:57:15.771130+0000","last_peered":"2024-04-25T09:57:15.771130+0000","last_clean":"2024-04-25T09:57:15.771130+0000","last_became_active":"2024-04-25T09:57:15.767779+0000","last_became_peered":"2024-04-25T09:57:15.767779+0000","last_unstale":"2024-04-25T09:57:15.771130+0000","last_undegraded":"2024-04-25T09:57:15.771130+0000","last_fullsized":"2024-04-25T09:57:15.771130+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:43.170600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.749077+0000","last_change":"2024-04-25T09:57:15.743074+0000","last_active":"2024-04-25T09:57:15.749077+0000","last_peered":"2024-04-25T09:57:15.749077+0000","last_clean":"2024-04-25T09:57:15.749077+0000","last_became_active":"2024-04-25T09:57:15.742690+0000","last_became_peered":"2024-04-25T09:57:15.742690+0000","last_unstale":"2024-04-25T09:57:15.749077+0000","last_undegraded":"2024-04-25T09:57:15.749077+0000","last_fullsized":"2024-04-25T09:57:15.749077+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:16.623083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.756450+0000","last_change":"2024-04-25T09:57:15.753362+0000","last_active":"2024-04-25T09:57:15.756450+0000","last_peered":"2024-04-25T09:57:15.756450+0000","last_clean":"2024-04-25T09:57:15.756450+0000","last_became_active":"2024-04-25T09:57:15.752402+0000","last_became_peered":"2024-04-25T09:57:15.752402+0000","last_unstale":"2024-04-25T09:57:15.756450+0000","last_undegraded":"2024-04-25T09:57:15.756450+0000","last_fullsized":"2024-04-25T09:57:15.756450+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:05:54.427158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.740479+0000","last_change":"2024-04-25T09:57:14.740479+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.740479+0000","last_undegraded":"2024-04-25T09:57:14.740479+0000","last_fullsized":"2024-04-25T09:57:14.740479+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.735324+0000","last_change":"2024-04-25T09:57:14.735324+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.735324+0000","last_undegraded":"2024-04-25T09:57:14.735324+0000","last_fullsized":"2024-04-25T09:57:14.735324+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.765280+0000","last_change":"2024-04-25T09:57:15.764308+0000","last_active":"2024-04-25T09:57:15.765280+0000","last_peered":"2024-04-25T09:57:15.765280+0000","last_clean":"2024-04-25T09:57:15.765280+0000","last_became_active":"2024-04-25T09:57:15.763987+0000","last_became_peered":"2024-04-25T09:57:15.763987+0000","last_unstale":"2024-04-25T09:57:15.765280+0000","last_undegraded":"2024-04-25T09:57:15.765280+0000","last_fullsized":"2024-04-25T09:57:15.765280+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:38.035777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.771009+0000","last_change":"2024-04-25T09:57:15.768645+0000","last_active":"2024-04-25T09:57:15.771009+0000","last_peered":"2024-04-25T09:57:15.771009+0000","last_clean":"2024-04-25T09:57:15.771009+0000","last_became_active":"2024-04-25T09:57:15.768313+0000","last_became_peered":"2024-04-25T09:57:15.768313+0000","last_unstale":"2024-04-25T09:57:15.771009+0000","last_undegraded":"2024-04-25T09:57:15.771009+0000","last_fullsized":"2024-04-25T09:57:15.771009+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:38.035777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.768078+0000","last_change":"2024-04-25T09:57:15.765383+0000","last_active":"2024-04-25T09:57:15.768078+0000","last_peered":"2024-04-25T09:57:15.768078+0000","last_clean":"2024-04-25T09:57:15.768078+0000","last_became_active":"2024-04-25T09:57:15.763424+0000","last_became_peered":"2024-04-25T09:57:15.763424+0000","last_unstale":"2024-04-25T09:57:15.768078+0000","last_undegraded":"2024-04-25T09:57:15.768078+0000","last_fullsized":"2024-04-25T09:57:15.768078+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:56.030922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.763391+0000","last_change":"2024-04-25T09:57:15.755081+0000","last_active":"2024-04-25T09:57:15.763391+0000","last_peered":"2024-04-25T09:57:15.763391+0000","last_clean":"2024-04-25T09:57:15.763391+0000","last_became_active":"2024-04-25T09:57:15.754758+0000","last_became_peered":"2024-04-25T09:57:15.754758+0000","last_unstale":"2024-04-25T09:57:15.763391+0000","last_undegraded":"2024-04-25T09:57:15.763391+0000","last_fullsized":"2024-04-25T09:57:15.763391+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:51.634061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.768719+0000","last_change":"2024-04-25T09:57:15.767461+0000","last_active":"2024-04-25T09:57:15.768719+0000","last_peered":"2024-04-25T09:57:15.768719+0000","last_clean":"2024-04-25T09:57:15.768719+0000","last_became_active":"2024-04-25T09:57:15.767159+0000","last_became_peered":"2024-04-25T09:57:15.767159+0000","last_unstale":"2024-04-25T09:57:15.768719+0000","last_undegraded":"2024-04-25T09:57:15.768719+0000","last_fullsized":"2024-04-25T09:57:15.768719+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:43.170600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759834+0000","last_change":"2024-04-25T09:57:15.753129+0000","last_active":"2024-04-25T09:57:15.759834+0000","last_peered":"2024-04-25T09:57:15.759834+0000","last_clean":"2024-04-25T09:57:15.759834+0000","last_became_active":"2024-04-25T09:57:15.752135+0000","last_became_peered":"2024-04-25T09:57:15.752135+0000","last_unstale":"2024-04-25T09:57:15.759834+0000","last_undegraded":"2024-04-25T09:57:15.759834+0000","last_fullsized":"2024-04-25T09:57:15.759834+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:06:48.607407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.769297+0000","last_change":"2024-04-25T09:57:15.765918+0000","last_active":"2024-04-25T09:57:15.769297+0000","last_peered":"2024-04-25T09:57:15.769297+0000","last_clean":"2024-04-25T09:57:15.769297+0000","last_became_active":"2024-04-25T09:57:15.765586+0000","last_became_peered":"2024-04-25T09:57:15.765586+0000","last_unstale":"2024-04-25T09:57:15.769297+0000","last_undegraded":"2024-04-25T09:57:15.769297+0000","last_fullsized":"2024-04-25T09:57:15.769297+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:36.249678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.769126+0000","last_change":"2024-04-25T09:57:15.765729+0000","last_active":"2024-04-25T09:57:15.769126+0000","last_peered":"2024-04-25T09:57:15.769126+0000","last_clean":"2024-04-25T09:57:15.769126+0000","last_became_active":"2024-04-25T09:57:15.763401+0000","last_became_peered":"2024-04-25T09:57:15.763401+0000","last_unstale":"2024-04-25T09:57:15.769126+0000","last_undegraded":"2024-04-25T09:57:15.769126+0000","last_fullsized":"2024-04-25T09:57:15.769126+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:06:48.607407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.736209+0000","last_change":"2024-04-25T09:57:14.736209+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.736209+0000","last_undegraded":"2024-04-25T09:57:14.736209+0000","last_fullsized":"2024-04-25T09:57:14.736209+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.739137+0000","last_change":"2024-04-25T09:57:14.739137+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.739137+0000","last_undegraded":"2024-04-25T09:57:14.739137+0000","last_fullsized":"2024-04-25T09:57:14.739137+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.765663+0000","last_change":"2024-04-25T09:57:15.763231+0000","last_active":"2024-04-25T09:57:15.765663+0000","last_peered":"2024-04-25T09:57:15.765663+0000","last_clean":"2024-04-25T09:57:15.765663+0000","last_became_active":"2024-04-25T09:57:15.761219+0000","last_became_peered":"2024-04-25T09:57:15.761219+0000","last_unstale":"2024-04-25T09:57:15.765663+0000","last_undegraded":"2024-04-25T09:57:15.765663+0000","last_fullsized":"2024-04-25T09:57:15.765663+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:26.061064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.756512+0000","last_change":"2024-04-25T09:57:15.749906+0000","last_active":"2024-04-25T09:57:15.756512+0000","last_peered":"2024-04-25T09:57:15.756512+0000","last_clean":"2024-04-25T09:57:15.756512+0000","last_became_active":"2024-04-25T09:57:15.749556+0000","last_became_peered":"2024-04-25T09:57:15.749556+0000","last_unstale":"2024-04-25T09:57:15.756512+0000","last_undegraded":"2024-04-25T09:57:15.756512+0000","last_fullsized":"2024-04-25T09:57:15.756512+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:56.132114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.738072+0000","last_change":"2024-04-25T09:57:14.738072+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.738072+0000","last_undegraded":"2024-04-25T09:57:14.738072+0000","last_fullsized":"2024-04-25T09:57:14.738072+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759858+0000","last_change":"2024-04-25T09:57:15.756136+0000","last_active":"2024-04-25T09:57:15.759858+0000","last_peered":"2024-04-25T09:57:15.759858+0000","last_clean":"2024-04-25T09:57:15.759858+0000","last_became_active":"2024-04-25T09:57:15.755865+0000","last_became_peered":"2024-04-25T09:57:15.755865+0000","last_unstale":"2024-04-25T09:57:15.759858+0000","last_undegraded":"2024-04-25T09:57:15.759858+0000","last_fullsized":"2024-04-25T09:57:15.759858+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:47.721018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.735616+0000","last_change":"2024-04-25T09:57:14.735616+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.735616+0000","last_undegraded":"2024-04-25T09:57:14.735616+0000","last_fullsized":"2024-04-25T09:57:14.735616+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.735588+0000","last_change":"2024-04-25T09:57:14.735588+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.735588+0000","last_undegraded":"2024-04-25T09:57:14.735588+0000","last_fullsized":"2024-04-25T09:57:14.735588+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.769820+0000","last_change":"2024-04-25T09:57:15.766342+0000","last_active":"2024-04-25T09:57:15.769820+0000","last_peered":"2024-04-25T09:57:15.769820+0000","last_clean":"2024-04-25T09:57:15.769820+0000","last_became_active":"2024-04-25T09:57:15.766060+0000","last_became_peered":"2024-04-25T09:57:15.766060+0000","last_unstale":"2024-04-25T09:57:15.769820+0000","last_undegraded":"2024-04-25T09:57:15.769820+0000","last_fullsized":"2024-04-25T09:57:15.769820+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:57:22.599880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759309+0000","last_change":"2024-04-25T09:57:15.752044+0000","last_active":"2024-04-25T09:57:15.759309+0000","last_peered":"2024-04-25T09:57:15.759309+0000","last_clean":"2024-04-25T09:57:15.759309+0000","last_became_active":"2024-04-25T09:57:15.751759+0000","last_became_peered":"2024-04-25T09:57:15.751759+0000","last_unstale":"2024-04-25T09:57:15.759309+0000","last_undegraded":"2024-04-25T09:57:15.759309+0000","last_fullsized":"2024-04-25T09:57:15.759309+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:57:22.599880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759418+0000","last_change":"2024-04-25T09:57:15.751032+0000","last_active":"2024-04-25T09:57:15.759418+0000","last_peered":"2024-04-25T09:57:15.759418+0000","last_clean":"2024-04-25T09:57:15.759418+0000","last_became_active":"2024-04-25T09:57:15.750731+0000","last_became_peered":"2024-04-25T09:57:15.750731+0000","last_unstale":"2024-04-25T09:57:15.759418+0000","last_undegraded":"2024-04-25T09:57:15.759418+0000","last_fullsized":"2024-04-25T09:57:15.759418+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:13.286010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.755315+0000","last_change":"2024-04-25T09:57:15.752419+0000","last_active":"2024-04-25T09:57:15.755315+0000","last_peered":"2024-04-25T09:57:15.755315+0000","last_clean":"2024-04-25T09:57:15.755315+0000","last_became_active":"2024-04-25T09:57:15.752123+0000","last_became_peered":"2024-04-25T09:57:15.752123+0000","last_unstale":"2024-04-25T09:57:15.755315+0000","last_undegraded":"2024-04-25T09:57:15.755315+0000","last_fullsized":"2024-04-25T09:57:15.755315+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:03.777858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.740242+0000","last_change":"2024-04-25T09:57:14.740242+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.740242+0000","last_undegraded":"2024-04-25T09:57:14.740242+0000","last_fullsized":"2024-04-25T09:57:14.740242+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.771070+0000","last_change":"2024-04-25T09:57:15.769491+0000","last_active":"2024-04-25T09:57:15.771070+0000","last_peered":"2024-04-25T09:57:15.771070+0000","last_clean":"2024-04-25T09:57:15.771070+0000","last_became_active":"2024-04-25T09:57:15.768694+0000","last_became_peered":"2024-04-25T09:57:15.768694+0000","last_unstale":"2024-04-25T09:57:15.771070+0000","last_undegraded":"2024-04-25T09:57:15.771070+0000","last_fullsized":"2024-04-25T09:57:15.771070+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:08.997796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.767994+0000","last_change":"2024-04-25T09:57:15.767087+0000","last_active":"2024-04-25T09:57:15.767994+0000","last_peered":"2024-04-25T09:57:15.767994+0000","last_clean":"2024-04-25T09:57:15.767994+0000","last_became_active":"2024-04-25T09:57:15.766747+0000","last_became_peered":"2024-04-25T09:57:15.766747+0000","last_unstale":"2024-04-25T09:57:15.767994+0000","last_undegraded":"2024-04-25T09:57:15.767994+0000","last_fullsized":"2024-04-25T09:57:15.767994+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:35.319064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.749807+0000","last_change":"2024-04-25T09:57:15.745892+0000","last_active":"2024-04-25T09:57:15.749807+0000","last_peered":"2024-04-25T09:57:15.749807+0000","last_clean":"2024-04-25T09:57:15.749807+0000","last_became_active":"2024-04-25T09:57:15.745553+0000","last_became_peered":"2024-04-25T09:57:15.745553+0000","last_unstale":"2024-04-25T09:57:15.749807+0000","last_undegraded":"2024-04-25T09:57:15.749807+0000","last_fullsized":"2024-04-25T09:57:15.749807+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:21:58.966692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.739933+0000","last_change":"2024-04-25T09:57:14.739933+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.739933+0000","last_undegraded":"2024-04-25T09:57:14.739933+0000","last_fullsized":"2024-04-25T09:57:14.739933+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.757016+0000","last_change":"2024-04-25T09:57:15.754290+0000","last_active":"2024-04-25T09:57:15.757016+0000","last_peered":"2024-04-25T09:57:15.757016+0000","last_clean":"2024-04-25T09:57:15.757016+0000","last_became_active":"2024-04-25T09:57:15.753872+0000","last_became_peered":"2024-04-25T09:57:15.753872+0000","last_unstale":"2024-04-25T09:57:15.757016+0000","last_undegraded":"2024-04-25T09:57:15.757016+0000","last_fullsized":"2024-04-25T09:57:15.757016+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:26.061064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.758719+0000","last_change":"2024-04-25T09:57:14.758285+0000","last_active":"2024-04-25T09:57:14.758719+0000","last_peered":"2024-04-25T09:57:14.758719+0000","last_clean":"2024-04-25T09:57:14.758719+0000","last_became_active":"2024-04-25T09:57:14.757995+0000","last_became_peered":"2024-04-25T09:57:14.757995+0000","last_unstale":"2024-04-25T09:57:14.758719+0000","last_undegraded":"2024-04-25T09:57:14.758719+0000","last_fullsized":"2024-04-25T09:57:14.758719+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:01:30.387519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.766480+0000","last_change":"2024-04-25T09:57:15.762946+0000","last_active":"2024-04-25T09:57:15.766480+0000","last_peered":"2024-04-25T09:57:15.766480+0000","last_clean":"2024-04-25T09:57:15.766480+0000","last_became_active":"2024-04-25T09:57:15.761468+0000","last_became_peered":"2024-04-25T09:57:15.761468+0000","last_unstale":"2024-04-25T09:57:15.766480+0000","last_undegraded":"2024-04-25T09:57:15.766480+0000","last_fullsized":"2024-04-25T09:57:15.766480+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:05:54.427158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.750269+0000","last_change":"2024-04-25T09:57:14.747757+0000","last_active":"2024-04-25T09:57:14.750269+0000","last_peered":"2024-04-25T09:57:14.750269+0000","last_clean":"2024-04-25T09:57:14.750269+0000","last_became_active":"2024-04-25T09:57:14.747474+0000","last_became_peered":"2024-04-25T09:57:14.747474+0000","last_unstale":"2024-04-25T09:57:14.750269+0000","last_undegraded":"2024-04-25T09:57:14.750269+0000","last_fullsized":"2024-04-25T09:57:14.750269+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:57.049874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.738966+0000","last_change":"2024-04-25T09:57:14.738966+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.738966+0000","last_undegraded":"2024-04-25T09:57:14.738966+0000","last_fullsized":"2024-04-25T09:57:14.738966+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.750397+0000","last_change":"2024-04-25T09:57:14.746173+0000","last_active":"2024-04-25T09:57:14.750397+0000","last_peered":"2024-04-25T09:57:14.750397+0000","last_clean":"2024-04-25T09:57:14.750397+0000","last_became_active":"2024-04-25T09:57:14.744978+0000","last_became_peered":"2024-04-25T09:57:14.744978+0000","last_unstale":"2024-04-25T09:57:14.750397+0000","last_undegraded":"2024-04-25T09:57:14.750397+0000","last_fullsized":"2024-04-25T09:57:14.750397+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:26.411491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.771033+0000","last_change":"2024-04-25T09:57:15.768921+0000","last_active":"2024-04-25T09:57:15.771033+0000","last_peered":"2024-04-25T09:57:15.771033+0000","last_clean":"2024-04-25T09:57:15.771033+0000","last_became_active":"2024-04-25T09:57:15.768327+0000","last_became_peered":"2024-04-25T09:57:15.768327+0000","last_unstale":"2024-04-25T09:57:15.771033+0000","last_undegraded":"2024-04-25T09:57:15.771033+0000","last_fullsized":"2024-04-25T09:57:15.771033+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:35.319064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.751369+0000","last_change":"2024-04-25T09:57:14.750473+0000","last_active":"2024-04-25T09:57:14.751369+0000","last_peered":"2024-04-25T09:57:14.751369+0000","last_clean":"2024-04-25T09:57:14.751369+0000","last_became_active":"2024-04-25T09:57:14.750124+0000","last_became_peered":"2024-04-25T09:57:14.750124+0000","last_unstale":"2024-04-25T09:57:14.751369+0000","last_undegraded":"2024-04-25T09:57:14.751369+0000","last_fullsized":"2024-04-25T09:57:14.751369+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:04:07.820129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.735799+0000","last_change":"2024-04-25T09:57:14.735799+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.735799+0000","last_undegraded":"2024-04-25T09:57:14.735799+0000","last_fullsized":"2024-04-25T09:57:14.735799+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.747504+0000","last_change":"2024-04-25T09:57:14.744916+0000","last_active":"2024-04-25T09:57:14.747504+0000","last_peered":"2024-04-25T09:57:14.747504+0000","last_clean":"2024-04-25T09:57:14.747504+0000","last_became_active":"2024-04-25T09:57:14.744384+0000","last_became_peered":"2024-04-25T09:57:14.744384+0000","last_unstale":"2024-04-25T09:57:14.747504+0000","last_undegraded":"2024-04-25T09:57:14.747504+0000","last_fullsized":"2024-04-25T09:57:14.747504+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:36.216367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.738167+0000","last_change":"2024-04-25T09:57:14.738167+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.738167+0000","last_undegraded":"2024-04-25T09:57:14.738167+0000","last_fullsized":"2024-04-25T09:57:14.738167+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.746032+0000","last_change":"2024-04-25T09:57:14.742815+0000","last_active":"2024-04-25T09:57:14.746032+0000","last_peered":"2024-04-25T09:57:14.746032+0000","last_clean":"2024-04-25T09:57:14.746032+0000","last_became_active":"2024-04-25T09:57:14.742518+0000","last_became_peered":"2024-04-25T09:57:14.742518+0000","last_unstale":"2024-04-25T09:57:14.746032+0000","last_undegraded":"2024-04-25T09:57:14.746032+0000","last_fullsized":"2024-04-25T09:57:14.746032+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:34.316720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759262+0000","last_change":"2024-04-25T09:57:15.756573+0000","last_active":"2024-04-25T09:57:15.759262+0000","last_peered":"2024-04-25T09:57:15.759262+0000","last_clean":"2024-04-25T09:57:15.759262+0000","last_became_active":"2024-04-25T09:57:15.755701+0000","last_became_peered":"2024-04-25T09:57:15.755701+0000","last_unstale":"2024-04-25T09:57:15.759262+0000","last_undegraded":"2024-04-25T09:57:15.759262+0000","last_fullsized":"2024-04-25T09:57:15.759262+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:11.276834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.747563+0000","last_change":"2024-04-25T09:57:14.746062+0000","last_active":"2024-04-25T09:57:14.747563+0000","last_peered":"2024-04-25T09:57:14.747563+0000","last_clean":"2024-04-25T09:57:14.747563+0000","last_became_active":"2024-04-25T09:57:14.745664+0000","last_became_peered":"2024-04-25T09:57:14.745664+0000","last_unstale":"2024-04-25T09:57:14.747563+0000","last_undegraded":"2024-04-25T09:57:14.747563+0000","last_fullsized":"2024-04-25T09:57:14.747563+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:57.049874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.734950+0000","last_change":"2024-04-25T09:57:14.734950+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.734950+0000","last_undegraded":"2024-04-25T09:57:14.734950+0000","last_fullsized":"2024-04-25T09:57:14.734950+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.740713+0000","last_change":"2024-04-25T09:57:14.752874+0000","last_active":"2024-04-25T09:57:15.740713+0000","last_peered":"2024-04-25T09:57:15.740713+0000","last_clean":"2024-04-25T09:57:15.740713+0000","last_became_active":"2024-04-25T09:57:14.752542+0000","last_became_peered":"2024-04-25T09:57:14.752542+0000","last_unstale":"2024-04-25T09:57:15.740713+0000","last_undegraded":"2024-04-25T09:57:15.740713+0000","last_fullsized":"2024-04-25T09:57:15.740713+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:50.631716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.738121+0000","last_change":"2024-04-25T09:57:14.738121+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.738121+0000","last_undegraded":"2024-04-25T09:57:14.738121+0000","last_fullsized":"2024-04-25T09:57:14.738121+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.758067+0000","last_change":"2024-04-25T09:57:14.758286+0000","last_active":"2024-04-25T09:57:15.758067+0000","last_peered":"2024-04-25T09:57:15.758067+0000","last_clean":"2024-04-25T09:57:15.758067+0000","last_became_active":"2024-04-25T09:57:14.757885+0000","last_became_peered":"2024-04-25T09:57:14.757885+0000","last_unstale":"2024-04-25T09:57:15.758067+0000","last_undegraded":"2024-04-25T09:57:15.758067+0000","last_fullsized":"2024-04-25T09:57:15.758067+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:47.050365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.735099+0000","last_change":"2024-04-25T09:57:14.735099+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.735099+0000","last_undegraded":"2024-04-25T09:57:14.735099+0000","last_fullsized":"2024-04-25T09:57:14.735099+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.742873+0000","last_change":"2024-04-25T09:57:14.744998+0000","last_active":"2024-04-25T09:57:15.742873+0000","last_peered":"2024-04-25T09:57:15.742873+0000","last_clean":"2024-04-25T09:57:15.742873+0000","last_became_active":"2024-04-25T09:57:14.744717+0000","last_became_peered":"2024-04-25T09:57:14.744717+0000","last_unstale":"2024-04-25T09:57:15.742873+0000","last_undegraded":"2024-04-25T09:57:15.742873+0000","last_fullsized":"2024-04-25T09:57:15.742873+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:44.683150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.761689+0000","last_change":"2024-04-25T09:57:15.758927+0000","last_active":"2024-04-25T09:57:15.761689+0000","last_peered":"2024-04-25T09:57:15.761689+0000","last_clean":"2024-04-25T09:57:15.761689+0000","last_became_active":"2024-04-25T09:57:15.758613+0000","last_became_peered":"2024-04-25T09:57:15.758613+0000","last_unstale":"2024-04-25T09:57:15.761689+0000","last_undegraded":"2024-04-25T09:57:15.761689+0000","last_fullsized":"2024-04-25T09:57:15.761689+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:22.009595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"61'3","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.771456+0000","last_change":"2024-04-25T09:57:14.758891+0000","last_active":"2024-04-25T09:57:15.771456+0000","last_peered":"2024-04-25T09:57:15.771456+0000","last_clean":"2024-04-25T09:57:15.771456+0000","last_became_active":"2024-04-25T09:57:14.757957+0000","last_became_peered":"2024-04-25T09:57:14.757957+0000","last_unstale":"2024-04-25T09:57:15.771456+0000","last_undegraded":"2024-04-25T09:57:15.771456+0000","last_fullsized":"2024-04-25T09:57:15.771456+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:51.436833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.763214+0000","last_change":"2024-04-25T09:57:15.755461+0000","last_active":"2024-04-25T09:57:15.763214+0000","last_peered":"2024-04-25T09:57:15.763214+0000","last_clean":"2024-04-25T09:57:15.763214+0000","last_became_active":"2024-04-25T09:57:15.755099+0000","last_became_peered":"2024-04-25T09:57:15.755099+0000","last_unstale":"2024-04-25T09:57:15.763214+0000","last_undegraded":"2024-04-25T09:57:15.763214+0000","last_fullsized":"2024-04-25T09:57:15.763214+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:56.132114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.749740+0000","last_change":"2024-04-25T09:57:14.748332+0000","last_active":"2024-04-25T09:57:14.749740+0000","last_peered":"2024-04-25T09:57:14.749740+0000","last_clean":"2024-04-25T09:57:14.749740+0000","last_became_active":"2024-04-25T09:57:14.747993+0000","last_became_peered":"2024-04-25T09:57:14.747993+0000","last_unstale":"2024-04-25T09:57:14.749740+0000","last_undegraded":"2024-04-25T09:57:14.749740+0000","last_fullsized":"2024-04-25T09:57:14.749740+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:19.567964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.768739+0000","last_change":"2024-04-25T09:57:15.766168+0000","last_active":"2024-04-25T09:57:15.768739+0000","last_peered":"2024-04-25T09:57:15.768739+0000","last_clean":"2024-04-25T09:57:15.768739+0000","last_became_active":"2024-04-25T09:57:15.764964+0000","last_became_peered":"2024-04-25T09:57:15.764964+0000","last_unstale":"2024-04-25T09:57:15.768739+0000","last_undegraded":"2024-04-25T09:57:15.768739+0000","last_fullsized":"2024-04-25T09:57:15.768739+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:05.715956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.765921+0000","last_change":"2024-04-25T09:57:14.758611+0000","last_active":"2024-04-25T09:57:15.765921+0000","last_peered":"2024-04-25T09:57:15.765921+0000","last_clean":"2024-04-25T09:57:15.765921+0000","last_became_active":"2024-04-25T09:57:14.757880+0000","last_became_peered":"2024-04-25T09:57:14.757880+0000","last_unstale":"2024-04-25T09:57:15.765921+0000","last_undegraded":"2024-04-25T09:57:15.765921+0000","last_fullsized":"2024-04-25T09:57:15.765921+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:42.586862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.758828+0000","last_change":"2024-04-25T09:57:15.751535+0000","last_active":"2024-04-25T09:57:15.758828+0000","last_peered":"2024-04-25T09:57:15.758828+0000","last_clean":"2024-04-25T09:57:15.758828+0000","last_became_active":"2024-04-25T09:57:15.751257+0000","last_became_peered":"2024-04-25T09:57:15.751257+0000","last_unstale":"2024-04-25T09:57:15.758828+0000","last_undegraded":"2024-04-25T09:57:15.758828+0000","last_fullsized":"2024-04-25T09:57:15.758828+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:56.030922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.739411+0000","last_change":"2024-04-25T09:57:14.750136+0000","last_active":"2024-04-25T09:57:15.739411+0000","last_peered":"2024-04-25T09:57:15.739411+0000","last_clean":"2024-04-25T09:57:15.739411+0000","last_became_active":"2024-04-25T09:57:14.749841+0000","last_became_peered":"2024-04-25T09:57:14.749841+0000","last_unstale":"2024-04-25T09:57:15.739411+0000","last_undegraded":"2024-04-25T09:57:15.739411+0000","last_fullsized":"2024-04-25T09:57:15.739411+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:47.050365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759245+0000","last_change":"2024-04-25T09:57:15.756190+0000","last_active":"2024-04-25T09:57:15.759245+0000","last_peered":"2024-04-25T09:57:15.759245+0000","last_clean":"2024-04-25T09:57:15.759245+0000","last_became_active":"2024-04-25T09:57:15.755333+0000","last_became_peered":"2024-04-25T09:57:15.755333+0000","last_unstale":"2024-04-25T09:57:15.759245+0000","last_undegraded":"2024-04-25T09:57:15.759245+0000","last_fullsized":"2024-04-25T09:57:15.759245+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:43.991599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.756105+0000","last_change":"2024-04-25T09:57:14.758679+0000","last_active":"2024-04-25T09:57:15.756105+0000","last_peered":"2024-04-25T09:57:15.756105+0000","last_clean":"2024-04-25T09:57:15.756105+0000","last_became_active":"2024-04-25T09:57:14.758320+0000","last_became_peered":"2024-04-25T09:57:14.758320+0000","last_unstale":"2024-04-25T09:57:15.756105+0000","last_undegraded":"2024-04-25T09:57:15.756105+0000","last_fullsized":"2024-04-25T09:57:15.756105+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:25.679262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.737498+0000","last_change":"2024-04-25T09:57:14.737498+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.737498+0000","last_undegraded":"2024-04-25T09:57:14.737498+0000","last_fullsized":"2024-04-25T09:57:14.737498+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"61'8","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.769776+0000","last_change":"2024-04-25T09:57:14.749907+0000","last_active":"2024-04-25T09:57:15.769776+0000","last_peered":"2024-04-25T09:57:15.769776+0000","last_clean":"2024-04-25T09:57:15.769776+0000","last_became_active":"2024-04-25T09:57:14.748686+0000","last_became_peered":"2024-04-25T09:57:14.748686+0000","last_unstale":"2024-04-25T09:57:15.769776+0000","last_undegraded":"2024-04-25T09:57:15.769776+0000","last_fullsized":"2024-04-25T09:57:15.769776+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:26:09.170713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.769946+0000","last_change":"2024-04-25T09:57:15.767545+0000","last_active":"2024-04-25T09:57:15.769946+0000","last_peered":"2024-04-25T09:57:15.769946+0000","last_clean":"2024-04-25T09:57:15.769946+0000","last_became_active":"2024-04-25T09:57:15.767252+0000","last_became_peered":"2024-04-25T09:57:15.767252+0000","last_unstale":"2024-04-25T09:57:15.769946+0000","last_undegraded":"2024-04-25T09:57:15.769946+0000","last_fullsized":"2024-04-25T09:57:15.769946+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:47.721018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759249+0000","last_change":"2024-04-25T09:57:14.749754+0000","last_active":"2024-04-25T09:57:15.759249+0000","last_peered":"2024-04-25T09:57:15.759249+0000","last_clean":"2024-04-25T09:57:15.759249+0000","last_became_active":"2024-04-25T09:57:14.749258+0000","last_became_peered":"2024-04-25T09:57:14.749258+0000","last_unstale":"2024-04-25T09:57:15.759249+0000","last_undegraded":"2024-04-25T09:57:15.759249+0000","last_fullsized":"2024-04-25T09:57:15.759249+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:25.679262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.756532+0000","last_change":"2024-04-25T09:57:15.751259+0000","last_active":"2024-04-25T09:57:15.756532+0000","last_peered":"2024-04-25T09:57:15.756532+0000","last_clean":"2024-04-25T09:57:15.756532+0000","last_became_active":"2024-04-25T09:57:15.750979+0000","last_became_peered":"2024-04-25T09:57:15.750979+0000","last_unstale":"2024-04-25T09:57:15.756532+0000","last_undegraded":"2024-04-25T09:57:15.756532+0000","last_fullsized":"2024-04-25T09:57:15.756532+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:45.975880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.766274+0000","last_change":"2024-04-25T09:57:14.758286+0000","last_active":"2024-04-25T09:57:15.766274+0000","last_peered":"2024-04-25T09:57:15.766274+0000","last_clean":"2024-04-25T09:57:15.766274+0000","last_became_active":"2024-04-25T09:57:14.757970+0000","last_became_peered":"2024-04-25T09:57:14.757970+0000","last_unstale":"2024-04-25T09:57:15.766274+0000","last_undegraded":"2024-04-25T09:57:15.766274+0000","last_fullsized":"2024-04-25T09:57:15.766274+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:03.967389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.764468+0000","last_change":"2024-04-25T09:57:15.760819+0000","last_active":"2024-04-25T09:57:15.764468+0000","last_peered":"2024-04-25T09:57:15.764468+0000","last_clean":"2024-04-25T09:57:15.764468+0000","last_became_active":"2024-04-25T09:57:15.760488+0000","last_became_peered":"2024-04-25T09:57:15.760488+0000","last_unstale":"2024-04-25T09:57:15.764468+0000","last_undegraded":"2024-04-25T09:57:15.764468+0000","last_fullsized":"2024-04-25T09:57:15.764468+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:45.975880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.770372+0000","last_change":"2024-04-25T09:57:14.758906+0000","last_active":"2024-04-25T09:57:15.770372+0000","last_peered":"2024-04-25T09:57:15.770372+0000","last_clean":"2024-04-25T09:57:15.770372+0000","last_became_active":"2024-04-25T09:57:14.758479+0000","last_became_peered":"2024-04-25T09:57:14.758479+0000","last_unstale":"2024-04-25T09:57:15.770372+0000","last_undegraded":"2024-04-25T09:57:15.770372+0000","last_fullsized":"2024-04-25T09:57:15.770372+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:12.283665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.756716+0000","last_change":"2024-04-25T09:57:15.754377+0000","last_active":"2024-04-25T09:57:15.756716+0000","last_peered":"2024-04-25T09:57:15.756716+0000","last_clean":"2024-04-25T09:57:15.756716+0000","last_became_active":"2024-04-25T09:57:15.752933+0000","last_became_peered":"2024-04-25T09:57:15.752933+0000","last_unstale":"2024-04-25T09:57:15.756716+0000","last_undegraded":"2024-04-25T09:57:15.756716+0000","last_fullsized":"2024-04-25T09:57:15.756716+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:05.715956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.745810+0000","last_change":"2024-04-25T09:57:14.742625+0000","last_active":"2024-04-25T09:57:14.745810+0000","last_peered":"2024-04-25T09:57:14.745810+0000","last_clean":"2024-04-25T09:57:14.745810+0000","last_became_active":"2024-04-25T09:57:14.742323+0000","last_became_peered":"2024-04-25T09:57:14.742323+0000","last_unstale":"2024-04-25T09:57:14.745810+0000","last_undegraded":"2024-04-25T09:57:14.745810+0000","last_fullsized":"2024-04-25T09:57:14.745810+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:37.033433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.739509+0000","last_change":"2024-04-25T09:57:14.739509+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.739509+0000","last_undegraded":"2024-04-25T09:57:14.739509+0000","last_fullsized":"2024-04-25T09:57:14.739509+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.750253+0000","last_change":"2024-04-25T09:57:14.744916+0000","last_active":"2024-04-25T09:57:14.750253+0000","last_peered":"2024-04-25T09:57:14.750253+0000","last_clean":"2024-04-25T09:57:14.750253+0000","last_became_active":"2024-04-25T09:57:14.744621+0000","last_became_peered":"2024-04-25T09:57:14.744621+0000","last_unstale":"2024-04-25T09:57:14.750253+0000","last_undegraded":"2024-04-25T09:57:14.750253+0000","last_fullsized":"2024-04-25T09:57:14.750253+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:07.995451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.758804+0000","last_change":"2024-04-25T09:57:15.747249+0000","last_active":"2024-04-25T09:57:15.758804+0000","last_peered":"2024-04-25T09:57:15.758804+0000","last_clean":"2024-04-25T09:57:15.758804+0000","last_became_active":"2024-04-25T09:57:15.746876+0000","last_became_peered":"2024-04-25T09:57:15.746876+0000","last_unstale":"2024-04-25T09:57:15.758804+0000","last_undegraded":"2024-04-25T09:57:15.758804+0000","last_fullsized":"2024-04-25T09:57:15.758804+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:52.439177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.739655+0000","last_change":"2024-04-25T09:57:14.749773+0000","last_active":"2024-04-25T09:57:15.739655+0000","last_peered":"2024-04-25T09:57:15.739655+0000","last_clean":"2024-04-25T09:57:15.739655+0000","last_became_active":"2024-04-25T09:57:14.749207+0000","last_became_peered":"2024-04-25T09:57:14.749207+0000","last_unstale":"2024-04-25T09:57:15.739655+0000","last_undegraded":"2024-04-25T09:57:15.739655+0000","last_fullsized":"2024-04-25T09:57:15.739655+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:36.078016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759224+0000","last_change":"2024-04-25T09:57:15.755964+0000","last_active":"2024-04-25T09:57:15.759224+0000","last_peered":"2024-04-25T09:57:15.759224+0000","last_clean":"2024-04-25T09:57:15.759224+0000","last_became_active":"2024-04-25T09:57:15.755024+0000","last_became_peered":"2024-04-25T09:57:15.755024+0000","last_unstale":"2024-04-25T09:57:15.759224+0000","last_undegraded":"2024-04-25T09:57:15.759224+0000","last_fullsized":"2024-04-25T09:57:15.759224+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:01:31.389864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.750784+0000","last_change":"2024-04-25T09:57:14.748763+0000","last_active":"2024-04-25T09:57:14.750784+0000","last_peered":"2024-04-25T09:57:14.750784+0000","last_clean":"2024-04-25T09:57:14.750784+0000","last_became_active":"2024-04-25T09:57:14.748442+0000","last_became_peered":"2024-04-25T09:57:14.748442+0000","last_unstale":"2024-04-25T09:57:14.750784+0000","last_undegraded":"2024-04-25T09:57:14.750784+0000","last_fullsized":"2024-04-25T09:57:14.750784+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:13.126972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.739208+0000","last_change":"2024-04-25T09:57:14.739208+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.739208+0000","last_undegraded":"2024-04-25T09:57:14.739208+0000","last_fullsized":"2024-04-25T09:57:14.739208+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.754602+0000","last_change":"2024-04-25T09:57:14.752504+0000","last_active":"2024-04-25T09:57:15.754602+0000","last_peered":"2024-04-25T09:57:15.754602+0000","last_clean":"2024-04-25T09:57:15.754602+0000","last_became_active":"2024-04-25T09:57:14.752223+0000","last_became_peered":"2024-04-25T09:57:14.752223+0000","last_unstale":"2024-04-25T09:57:15.754602+0000","last_undegraded":"2024-04-25T09:57:15.754602+0000","last_fullsized":"2024-04-25T09:57:15.754602+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:42.586862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.735336+0000","last_change":"2024-04-25T09:57:14.735336+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.735336+0000","last_undegraded":"2024-04-25T09:57:14.735336+0000","last_fullsized":"2024-04-25T09:57:14.735336+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.738659+0000","last_change":"2024-04-25T09:57:14.742094+0000","last_active":"2024-04-25T09:57:15.738659+0000","last_peered":"2024-04-25T09:57:15.738659+0000","last_clean":"2024-04-25T09:57:15.738659+0000","last_became_active":"2024-04-25T09:57:14.741829+0000","last_became_peered":"2024-04-25T09:57:14.741829+0000","last_unstale":"2024-04-25T09:57:15.738659+0000","last_undegraded":"2024-04-25T09:57:15.738659+0000","last_fullsized":"2024-04-25T09:57:15.738659+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:03.967389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759441+0000","last_change":"2024-04-25T09:57:15.753721+0000","last_active":"2024-04-25T09:57:15.759441+0000","last_peered":"2024-04-25T09:57:15.759441+0000","last_clean":"2024-04-25T09:57:15.759441+0000","last_became_active":"2024-04-25T09:57:15.753367+0000","last_became_peered":"2024-04-25T09:57:15.753367+0000","last_unstale":"2024-04-25T09:57:15.759441+0000","last_undegraded":"2024-04-25T09:57:15.759441+0000","last_fullsized":"2024-04-25T09:57:15.759441+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:36.249678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.750376+0000","last_change":"2024-04-25T09:57:14.745936+0000","last_active":"2024-04-25T09:57:14.750376+0000","last_peered":"2024-04-25T09:57:14.750376+0000","last_clean":"2024-04-25T09:57:14.750376+0000","last_became_active":"2024-04-25T09:57:14.744599+0000","last_became_peered":"2024-04-25T09:57:14.744599+0000","last_unstale":"2024-04-25T09:57:14.750376+0000","last_undegraded":"2024-04-25T09:57:14.750376+0000","last_fullsized":"2024-04-25T09:57:14.750376+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:36.216367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.756736+0000","last_change":"2024-04-25T09:57:15.753219+0000","last_active":"2024-04-25T09:57:15.756736+0000","last_peered":"2024-04-25T09:57:15.756736+0000","last_clean":"2024-04-25T09:57:15.756736+0000","last_became_active":"2024-04-25T09:57:15.752526+0000","last_became_peered":"2024-04-25T09:57:15.752526+0000","last_unstale":"2024-04-25T09:57:15.756736+0000","last_undegraded":"2024-04-25T09:57:15.756736+0000","last_fullsized":"2024-04-25T09:57:15.756736+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:20.570308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.749715+0000","last_change":"2024-04-25T09:57:14.747370+0000","last_active":"2024-04-25T09:57:14.749715+0000","last_peered":"2024-04-25T09:57:14.749715+0000","last_clean":"2024-04-25T09:57:14.749715+0000","last_became_active":"2024-04-25T09:57:14.747109+0000","last_became_peered":"2024-04-25T09:57:14.747109+0000","last_unstale":"2024-04-25T09:57:14.749715+0000","last_undegraded":"2024-04-25T09:57:14.749715+0000","last_fullsized":"2024-04-25T09:57:14.749715+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:04.713611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759187+0000","last_change":"2024-04-25T09:57:15.757598+0000","last_active":"2024-04-25T09:57:15.759187+0000","last_peered":"2024-04-25T09:57:15.759187+0000","last_clean":"2024-04-25T09:57:15.759187+0000","last_became_active":"2024-04-25T09:57:15.757291+0000","last_became_peered":"2024-04-25T09:57:15.757291+0000","last_unstale":"2024-04-25T09:57:15.759187+0000","last_undegraded":"2024-04-25T09:57:15.759187+0000","last_fullsized":"2024-04-25T09:57:15.759187+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:14.414068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.758295+0000","last_change":"2024-04-25T09:57:14.758651+0000","last_active":"2024-04-25T09:57:15.758295+0000","last_peered":"2024-04-25T09:57:15.758295+0000","last_clean":"2024-04-25T09:57:15.758295+0000","last_became_active":"2024-04-25T09:57:14.758265+0000","last_became_peered":"2024-04-25T09:57:14.758265+0000","last_unstale":"2024-04-25T09:57:15.758295+0000","last_undegraded":"2024-04-25T09:57:15.758295+0000","last_fullsized":"2024-04-25T09:57:15.758295+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:36.078016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.768753+0000","last_change":"2024-04-25T09:57:15.766207+0000","last_active":"2024-04-25T09:57:15.768753+0000","last_peered":"2024-04-25T09:57:15.768753+0000","last_clean":"2024-04-25T09:57:15.768753+0000","last_became_active":"2024-04-25T09:57:15.765910+0000","last_became_peered":"2024-04-25T09:57:15.765910+0000","last_unstale":"2024-04-25T09:57:15.768753+0000","last_undegraded":"2024-04-25T09:57:15.768753+0000","last_fullsized":"2024-04-25T09:57:15.768753+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:20.570308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.746060+0000","last_change":"2024-04-25T09:57:14.743166+0000","last_active":"2024-04-25T09:57:14.746060+0000","last_peered":"2024-04-25T09:57:14.746060+0000","last_clean":"2024-04-25T09:57:14.746060+0000","last_became_active":"2024-04-25T09:57:14.742849+0000","last_became_peered":"2024-04-25T09:57:14.742849+0000","last_unstale":"2024-04-25T09:57:14.746060+0000","last_undegraded":"2024-04-25T09:57:14.746060+0000","last_fullsized":"2024-04-25T09:57:14.746060+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:42.168255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.736953+0000","last_change":"2024-04-25T09:57:14.736953+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.736953+0000","last_undegraded":"2024-04-25T09:57:14.736953+0000","last_fullsized":"2024-04-25T09:57:14.736953+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.747542+0000","last_change":"2024-04-25T09:57:14.745243+0000","last_active":"2024-04-25T09:57:14.747542+0000","last_peered":"2024-04-25T09:57:14.747542+0000","last_clean":"2024-04-25T09:57:14.747542+0000","last_became_active":"2024-04-25T09:57:14.744863+0000","last_became_peered":"2024-04-25T09:57:14.744863+0000","last_unstale":"2024-04-25T09:57:14.747542+0000","last_undegraded":"2024-04-25T09:57:14.747542+0000","last_fullsized":"2024-04-25T09:57:14.747542+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:26.411491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.735406+0000","last_change":"2024-04-25T09:57:14.735406+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.735406+0000","last_undegraded":"2024-04-25T09:57:14.735406+0000","last_fullsized":"2024-04-25T09:57:14.735406+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.746338+0000","last_change":"2024-04-25T09:57:14.745523+0000","last_active":"2024-04-25T09:57:14.746338+0000","last_peered":"2024-04-25T09:57:14.746338+0000","last_clean":"2024-04-25T09:57:14.746338+0000","last_became_active":"2024-04-25T09:57:14.745243+0000","last_became_peered":"2024-04-25T09:57:14.745243+0000","last_unstale":"2024-04-25T09:57:14.746338+0000","last_undegraded":"2024-04-25T09:57:14.746338+0000","last_fullsized":"2024-04-25T09:57:14.746338+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:25.058720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.762195+0000","last_change":"2024-04-25T09:57:15.759399+0000","last_active":"2024-04-25T09:57:15.762195+0000","last_peered":"2024-04-25T09:57:15.762195+0000","last_clean":"2024-04-25T09:57:15.762195+0000","last_became_active":"2024-04-25T09:57:15.758243+0000","last_became_peered":"2024-04-25T09:57:15.758243+0000","last_unstale":"2024-04-25T09:57:15.762195+0000","last_undegraded":"2024-04-25T09:57:15.762195+0000","last_fullsized":"2024-04-25T09:57:15.762195+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:04.969733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.747693+0000","last_change":"2024-04-25T09:57:14.744509+0000","last_active":"2024-04-25T09:57:14.747693+0000","last_peered":"2024-04-25T09:57:14.747693+0000","last_clean":"2024-04-25T09:57:14.747693+0000","last_became_active":"2024-04-25T09:57:14.744156+0000","last_became_peered":"2024-04-25T09:57:14.744156+0000","last_unstale":"2024-04-25T09:57:14.747693+0000","last_undegraded":"2024-04-25T09:57:14.747693+0000","last_fullsized":"2024-04-25T09:57:14.747693+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:07.995451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":243,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.758136+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T09:57:15.758136+0000","last_peered":"2024-04-25T09:57:15.758136+0000","last_clean":"2024-04-25T09:57:15.758136+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T09:57:15.758136+0000","last_undegraded":"2024-04-25T09:57:15.758136+0000","last_fullsized":"2024-04-25T09:57:15.758136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":216,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542183,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32468,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1314816,"data_stored":910803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542183,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":720896,"data_stored":320435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542185,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":737280,"data_stored":327624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542182,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":720896,"data_stored":320435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31872,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":708608,"data_stored":313776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31876,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339964,"statfs":{"total":96636764160,"available":96604123136,"internally_reserved":0,"allocated":708608,"data_stored":313776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31872,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":708608,"data_stored":313776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1302528,"data_stored":904144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:57:19.109 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:57:19.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.244+0000 7f2335169640 1 Processor -- start 2024-04-25T09:57:19.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.244+0000 7f2335169640 1 -- start start 2024-04-25T09:57:19.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.244+0000 7f2335169640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f233009a850 0x7f23300c5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:19.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.244+0000 7f2335169640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f23300c5780 0x7f233015f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:19.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.244+0000 7f2335169640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23300cd560 con 0x7f233015b990 2024-04-25T09:57:19.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.244+0000 7f2335169640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2330099a90 con 0x7f23300c5780 2024-04-25T09:57:19.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.244+0000 7f2335169640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2330099d70 con 0x7f233009a850 2024-04-25T09:57:19.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.245+0000 7f232f59e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f23300c5780 0x7f233015f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:19.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.245+0000 7f232ed9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f233015b990 0x7f23300ccd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:38086/0 (socket says 172.21.15.7:38086) 2024-04-25T09:57:19.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.245+0000 7f2327fff640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f233009a850 0x7f23300c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.245+0000 7f232ed9d640 1 -- 172.21.15.7:0/458381673 learned_addr learned my addr 172.21.15.7:0/458381673 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:57:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.245+0000 7f232e59c640 1 -- 172.21.15.7:0/458381673 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2617358641 0 0) 0x7f23300cd560 con 0x7f233015b990 2024-04-25T09:57:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.245+0000 7f232e59c640 1 -- 172.21.15.7:0/458381673 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f231c003520 con 0x7f233015b990 2024-04-25T09:57:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.245+0000 7f2327fff640 1 -- 172.21.15.7:0/458381673 >> v2:172.21.15.55:3300/0 conn(0x7f23300c5780 msgr2=0x7f233015f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.245+0000 7f2327fff640 1 --2- 172.21.15.7:0/458381673 >> v2:172.21.15.55:3300/0 conn(0x7f23300c5780 0x7f233015f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.245+0000 7f2327fff640 1 -- 172.21.15.7:0/458381673 >> v1:172.21.15.55:6789/0 conn(0x7f233015b990 legacy=0x7f23300ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.245+0000 7f2327fff640 1 -- 172.21.15.7:0/458381673 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233009a050 con 0x7f233009a850 2024-04-25T09:57:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.245+0000 7f232f59e640 1 --2- 172.21.15.7:0/458381673 >> v2:172.21.15.55:3300/0 conn(0x7f23300c5780 0x7f233015f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:57:19.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.246+0000 7f2327fff640 1 --2- 172.21.15.7:0/458381673 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f233009a850 0x7f23300c5240 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f23180097a0 tx=0x7f231802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b380e52dd88b8e9d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:19.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.246+0000 7f232e59c640 1 -- 172.21.15.7:0/458381673 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2318037070 con 0x7f233009a850 2024-04-25T09:57:19.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.246+0000 7f232e59c640 1 -- 172.21.15.7:0/458381673 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231802ae50 con 0x7f233009a850 2024-04-25T09:57:19.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.246+0000 7f232e59c640 1 -- 172.21.15.7:0/458381673 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2318032640 con 0x7f233009a850 2024-04-25T09:57:19.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.247+0000 7f2335169640 1 -- 172.21.15.7:0/458381673 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f233009a850 msgr2=0x7f23300c5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:19.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.247+0000 7f2335169640 1 --2- 172.21.15.7:0/458381673 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f233009a850 0x7f23300c5240 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f23180097a0 tx=0x7f231802a100 comp rx=0 tx=0).stop 2024-04-25T09:57:19.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.247+0000 7f2335169640 1 -- 172.21.15.7:0/458381673 shutdown_connections 2024-04-25T09:57:19.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.247+0000 7f2335169640 1 --2- 172.21.15.7:0/458381673 >> v2:172.21.15.55:3300/0 conn(0x7f23300c5780 0x7f233015f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:19.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.247+0000 7f2335169640 1 --2- 172.21.15.7:0/458381673 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f233009a850 0x7f23300c5240 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:19.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.247+0000 7f2335169640 1 -- 172.21.15.7:0/458381673 >> 172.21.15.7:0/458381673 conn(0x7f23300d16f0 msgr2=0x7f23300d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:19.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.247+0000 7f2335169640 1 -- 172.21.15.7:0/458381673 shutdown_connections 2024-04-25T09:57:19.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.247+0000 7f2335169640 1 -- 172.21.15.7:0/458381673 wait complete. 2024-04-25T09:57:19.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.248+0000 7f2335169640 1 Processor -- start 2024-04-25T09:57:19.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.248+0000 7f2335169640 1 -- start start 2024-04-25T09:57:19.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.249+0000 7f2335169640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f233009a850 0x7f233015db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:19.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.249+0000 7f2335169640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23300c5780 0x7f23301532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:19.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.249+0000 7f2335169640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f233015b990 0x7f2330153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:19.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.249+0000 7f2335169640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233009acb0 con 0x7f23300c5780 2024-04-25T09:57:19.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.249+0000 7f2335169640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233015bd70 con 0x7f233009a850 2024-04-25T09:57:19.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.249+0000 7f2335169640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23300c5c10 con 0x7f233015b990 2024-04-25T09:57:19.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.249+0000 7f2327fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23300c5780 0x7f23301532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:19.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.249+0000 7f2327fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23300c5780 0x7f23301532c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49326/0 (socket says 172.21.15.7:49326) 2024-04-25T09:57:19.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.249+0000 7f2327fff640 1 -- 172.21.15.7:0/2489814328 learned_addr learned my addr 172.21.15.7:0/2489814328 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:19.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.249+0000 7f232f59e640 1 --2- 172.21.15.7:0/2489814328 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f233015b990 0x7f2330153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:19.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.249+0000 7f232ed9d640 1 --2- 172.21.15.7:0/2489814328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f233009a850 0x7f233015db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:19.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.249+0000 7f2327fff640 1 -- 172.21.15.7:0/2489814328 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f233015b990 msgr2=0x7f2330153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:19.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.249+0000 7f2327fff640 1 --2- 172.21.15.7:0/2489814328 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f233015b990 0x7f2330153800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:19.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.249+0000 7f2327fff640 1 -- 172.21.15.7:0/2489814328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f233009a850 msgr2=0x7f233015db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:19.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.249+0000 7f2327fff640 1 --2- 172.21.15.7:0/2489814328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f233009a850 0x7f233015db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:19.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.250+0000 7f2327fff640 1 -- 172.21.15.7:0/2489814328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233015c2b0 con 0x7f23300c5780 2024-04-25T09:57:19.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.250+0000 7f2327fff640 1 --2- 172.21.15.7:0/2489814328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23300c5780 0x7f23301532c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f231802a140 tx=0x7f23180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:19.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.250+0000 7f23277fe640 1 -- 172.21.15.7:0/2489814328 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2318041070 con 0x7f23300c5780 2024-04-25T09:57:19.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.250+0000 7f23277fe640 1 -- 172.21.15.7:0/2489814328 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231803c460 con 0x7f23300c5780 2024-04-25T09:57:19.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.250+0000 7f2335169640 1 -- 172.21.15.7:0/2489814328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f233015c590 con 0x7f23300c5780 2024-04-25T09:57:19.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.250+0000 7f23277fe640 1 -- 172.21.15.7:0/2489814328 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2318037040 con 0x7f23300c5780 2024-04-25T09:57:19.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.250+0000 7f2335169640 1 -- 172.21.15.7:0/2489814328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f233015cb50 con 0x7f23300c5780 2024-04-25T09:57:19.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.251+0000 7f2335169640 1 -- 172.21.15.7:0/2489814328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23300b52a0 con 0x7f23300c5780 2024-04-25T09:57:19.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.251+0000 7f23277fe640 1 -- 172.21.15.7:0/2489814328 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2318044070 con 0x7f23300c5780 2024-04-25T09:57:19.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.252+0000 7f23277fe640 1 --2- 172.21.15.7:0/2489814328 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f231006b4d0 0x7f231006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:19.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.252+0000 7f23277fe640 1 -- 172.21.15.7:0/2489814328 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f23180aa8a0 con 0x7f23300c5780 2024-04-25T09:57:19.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.252+0000 7f232ed9d640 1 --2- 172.21.15.7:0/2489814328 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f231006b4d0 0x7f231006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:19.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.252+0000 7f232ed9d640 1 --2- 172.21.15.7:0/2489814328 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f231006b4d0 0x7f231006d990 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2320005880 tx=0x7f2320009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:19.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.256+0000 7f23277fe640 1 -- 172.21.15.7:0/2489814328 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2318079620 con 0x7f23300c5780 2024-04-25T09:57:19.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.431+0000 7f2335169640 1 -- 172.21.15.7:0/2489814328 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2330068fd0 con 0x7f231006b4d0 2024-04-25T09:57:19.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.437+0000 7f23277fe640 1 -- 172.21.15.7:0/2489814328 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250066 (secure 0 0 0) 0x7f2330068fd0 con 0x7f231006b4d0 2024-04-25T09:57:19.443 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:57:19.445 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T09:57:19.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.440+0000 7f2335169640 1 -- 172.21.15.7:0/2489814328 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f231006b4d0 msgr2=0x7f231006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:19.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.440+0000 7f2335169640 1 --2- 172.21.15.7:0/2489814328 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f231006b4d0 0x7f231006d990 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2320005880 tx=0x7f2320009040 comp rx=0 tx=0).stop 2024-04-25T09:57:19.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.440+0000 7f2335169640 1 -- 172.21.15.7:0/2489814328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23300c5780 msgr2=0x7f23301532c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:19.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.440+0000 7f2335169640 1 --2- 172.21.15.7:0/2489814328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23300c5780 0x7f23301532c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f231802a140 tx=0x7f23180046c0 comp rx=0 tx=0).stop 2024-04-25T09:57:19.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.440+0000 7f2335169640 1 -- 172.21.15.7:0/2489814328 shutdown_connections 2024-04-25T09:57:19.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.440+0000 7f2335169640 1 --2- 172.21.15.7:0/2489814328 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f231006b4d0 0x7f231006d990 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:19.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.440+0000 7f2335169640 1 --2- 172.21.15.7:0/2489814328 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f233015b990 0x7f2330153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:19.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.440+0000 7f2335169640 1 --2- 172.21.15.7:0/2489814328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23300c5780 0x7f23301532c0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:19.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.440+0000 7f2335169640 1 --2- 172.21.15.7:0/2489814328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f233009a850 0x7f233015db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:19.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.440+0000 7f2335169640 1 -- 172.21.15.7:0/2489814328 >> 172.21.15.7:0/2489814328 conn(0x7f23300d16f0 msgr2=0x7f23300ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:19.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.441+0000 7f2335169640 1 -- 172.21.15.7:0/2489814328 shutdown_connections 2024-04-25T09:57:19.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.441+0000 7f2335169640 1 -- 172.21.15.7:0/2489814328 wait complete. 2024-04-25T09:57:19.455 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2024-04-25T09:57:17.890316+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590584,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":186,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256224,"kb_used_data":6760,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718496,"statfs":{"total":773094113280,"available":772831739904,"internally_reserved":0,"allocated":6922240,"data_stored":3724769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":216,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.166772"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.739601+0000","last_change":"2024-04-25T09:57:14.739601+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.739601+0000","last_undegraded":"2024-04-25T09:57:14.739601+0000","last_fullsized":"2024-04-25T09:57:14.739601+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.736881+0000","last_change":"2024-04-25T09:57:14.736881+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.736881+0000","last_undegraded":"2024-04-25T09:57:14.736881+0000","last_fullsized":"2024-04-25T09:57:14.736881+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.771130+0000","last_change":"2024-04-25T09:57:15.768429+0000","last_active":"2024-04-25T09:57:15.771130+0000","last_peered":"2024-04-25T09:57:15.771130+0000","last_clean":"2024-04-25T09:57:15.771130+0000","last_became_active":"2024-04-25T09:57:15.767779+0000","last_became_peered":"2024-04-25T09:57:15.767779+0000","last_unstale":"2024-04-25T09:57:15.771130+0000","last_undegraded":"2024-04-25T09:57:15.771130+0000","last_fullsized":"2024-04-25T09:57:15.771130+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:43.170600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.749077+0000","last_change":"2024-04-25T09:57:15.743074+0000","last_active":"2024-04-25T09:57:15.749077+0000","last_peered":"2024-04-25T09:57:15.749077+0000","last_clean":"2024-04-25T09:57:15.749077+0000","last_became_active":"2024-04-25T09:57:15.742690+0000","last_became_peered":"2024-04-25T09:57:15.742690+0000","last_unstale":"2024-04-25T09:57:15.749077+0000","last_undegraded":"2024-04-25T09:57:15.749077+0000","last_fullsized":"2024-04-25T09:57:15.749077+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:16.623083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.756450+0000","last_change":"2024-04-25T09:57:15.753362+0000","last_active":"2024-04-25T09:57:15.756450+0000","last_peered":"2024-04-25T09:57:15.756450+0000","last_clean":"2024-04-25T09:57:15.756450+0000","last_became_active":"2024-04-25T09:57:15.752402+0000","last_became_peered":"2024-04-25T09:57:15.752402+0000","last_unstale":"2024-04-25T09:57:15.756450+0000","last_undegraded":"2024-04-25T09:57:15.756450+0000","last_fullsized":"2024-04-25T09:57:15.756450+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:05:54.427158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.740479+0000","last_change":"2024-04-25T09:57:14.740479+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.740479+0000","last_undegraded":"2024-04-25T09:57:14.740479+0000","last_fullsized":"2024-04-25T09:57:14.740479+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.735324+0000","last_change":"2024-04-25T09:57:14.735324+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.735324+0000","last_undegraded":"2024-04-25T09:57:14.735324+0000","last_fullsized":"2024-04-25T09:57:14.735324+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.765280+0000","last_change":"2024-04-25T09:57:15.764308+0000","last_active":"2024-04-25T09:57:15.765280+0000","last_peered":"2024-04-25T09:57:15.765280+0000","last_clean":"2024-04-25T09:57:15.765280+0000","last_became_active":"2024-04-25T09:57:15.763987+0000","last_became_peered":"2024-04-25T09:57:15.763987+0000","last_unstale":"2024-04-25T09:57:15.765280+0000","last_undegraded":"2024-04-25T09:57:15.765280+0000","last_fullsized":"2024-04-25T09:57:15.765280+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:38.035777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.771009+0000","last_change":"2024-04-25T09:57:15.768645+0000","last_active":"2024-04-25T09:57:15.771009+0000","last_peered":"2024-04-25T09:57:15.771009+0000","last_clean":"2024-04-25T09:57:15.771009+0000","last_became_active":"2024-04-25T09:57:15.768313+0000","last_became_peered":"2024-04-25T09:57:15.768313+0000","last_unstale":"2024-04-25T09:57:15.771009+0000","last_undegraded":"2024-04-25T09:57:15.771009+0000","last_fullsized":"2024-04-25T09:57:15.771009+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:38.035777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.768078+0000","last_change":"2024-04-25T09:57:15.765383+0000","last_active":"2024-04-25T09:57:15.768078+0000","last_peered":"2024-04-25T09:57:15.768078+0000","last_clean":"2024-04-25T09:57:15.768078+0000","last_became_active":"2024-04-25T09:57:15.763424+0000","last_became_peered":"2024-04-25T09:57:15.763424+0000","last_unstale":"2024-04-25T09:57:15.768078+0000","last_undegraded":"2024-04-25T09:57:15.768078+0000","last_fullsized":"2024-04-25T09:57:15.768078+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:56.030922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.763391+0000","last_change":"2024-04-25T09:57:15.755081+0000","last_active":"2024-04-25T09:57:15.763391+0000","last_peered":"2024-04-25T09:57:15.763391+0000","last_clean":"2024-04-25T09:57:15.763391+0000","last_became_active":"2024-04-25T09:57:15.754758+0000","last_became_peered":"2024-04-25T09:57:15.754758+0000","last_unstale":"2024-04-25T09:57:15.763391+0000","last_undegraded":"2024-04-25T09:57:15.763391+0000","last_fullsized":"2024-04-25T09:57:15.763391+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:51.634061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.768719+0000","last_change":"2024-04-25T09:57:15.767461+0000","last_active":"2024-04-25T09:57:15.768719+0000","last_peered":"2024-04-25T09:57:15.768719+0000","last_clean":"2024-04-25T09:57:15.768719+0000","last_became_active":"2024-04-25T09:57:15.767159+0000","last_became_peered":"2024-04-25T09:57:15.767159+0000","last_unstale":"2024-04-25T09:57:15.768719+0000","last_undegraded":"2024-04-25T09:57:15.768719+0000","last_fullsized":"2024-04-25T09:57:15.768719+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:43.170600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759834+0000","last_change":"2024-04-25T09:57:15.753129+0000","last_active":"2024-04-25T09:57:15.759834+0000","last_peered":"2024-04-25T09:57:15.759834+0000","last_clean":"2024-04-25T09:57:15.759834+0000","last_became_active":"2024-04-25T09:57:15.752135+0000","last_became_peered":"2024-04-25T09:57:15.752135+0000","last_unstale":"2024-04-25T09:57:15.759834+0000","last_undegraded":"2024-04-25T09:57:15.759834+0000","last_fullsized":"2024-04-25T09:57:15.759834+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:06:48.607407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.769297+0000","last_change":"2024-04-25T09:57:15.765918+0000","last_active":"2024-04-25T09:57:15.769297+0000","last_peered":"2024-04-25T09:57:15.769297+0000","last_clean":"2024-04-25T09:57:15.769297+0000","last_became_active":"2024-04-25T09:57:15.765586+0000","last_became_peered":"2024-04-25T09:57:15.765586+0000","last_unstale":"2024-04-25T09:57:15.769297+0000","last_undegraded":"2024-04-25T09:57:15.769297+0000","last_fullsized":"2024-04-25T09:57:15.769297+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:36.249678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.769126+0000","last_change":"2024-04-25T09:57:15.765729+0000","last_active":"2024-04-25T09:57:15.769126+0000","last_peered":"2024-04-25T09:57:15.769126+0000","last_clean":"2024-04-25T09:57:15.769126+0000","last_became_active":"2024-04-25T09:57:15.763401+0000","last_became_peered":"2024-04-25T09:57:15.763401+0000","last_unstale":"2024-04-25T09:57:15.769126+0000","last_undegraded":"2024-04-25T09:57:15.769126+0000","last_fullsized":"2024-04-25T09:57:15.769126+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:06:48.607407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.736209+0000","last_change":"2024-04-25T09:57:14.736209+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.736209+0000","last_undegraded":"2024-04-25T09:57:14.736209+0000","last_fullsized":"2024-04-25T09:57:14.736209+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.739137+0000","last_change":"2024-04-25T09:57:14.739137+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.739137+0000","last_undegraded":"2024-04-25T09:57:14.739137+0000","last_fullsized":"2024-04-25T09:57:14.739137+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.765663+0000","last_change":"2024-04-25T09:57:15.763231+0000","last_active":"2024-04-25T09:57:15.765663+0000","last_peered":"2024-04-25T09:57:15.765663+0000","last_clean":"2024-04-25T09:57:15.765663+0000","last_became_active":"2024-04-25T09:57:15.761219+0000","last_became_peered":"2024-04-25T09:57:15.761219+0000","last_unstale":"2024-04-25T09:57:15.765663+0000","last_undegraded":"2024-04-25T09:57:15.765663+0000","last_fullsized":"2024-04-25T09:57:15.765663+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:26.061064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.756512+0000","last_change":"2024-04-25T09:57:15.749906+0000","last_active":"2024-04-25T09:57:15.756512+0000","last_peered":"2024-04-25T09:57:15.756512+0000","last_clean":"2024-04-25T09:57:15.756512+0000","last_became_active":"2024-04-25T09:57:15.749556+0000","last_became_peered":"2024-04-25T09:57:15.749556+0000","last_unstale":"2024-04-25T09:57:15.756512+0000","last_undegraded":"2024-04-25T09:57:15.756512+0000","last_fullsized":"2024-04-25T09:57:15.756512+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:56.132114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.738072+0000","last_change":"2024-04-25T09:57:14.738072+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.738072+0000","last_undegraded":"2024-04-25T09:57:14.738072+0000","last_fullsized":"2024-04-25T09:57:14.738072+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759858+0000","last_change":"2024-04-25T09:57:15.756136+0000","last_active":"2024-04-25T09:57:15.759858+0000","last_peered":"2024-04-25T09:57:15.759858+0000","last_clean":"2024-04-25T09:57:15.759858+0000","last_became_active":"2024-04-25T09:57:15.755865+0000","last_became_peered":"2024-04-25T09:57:15.755865+0000","last_unstale":"2024-04-25T09:57:15.759858+0000","last_undegraded":"2024-04-25T09:57:15.759858+0000","last_fullsized":"2024-04-25T09:57:15.759858+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:47.721018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.735616+0000","last_change":"2024-04-25T09:57:14.735616+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.735616+0000","last_undegraded":"2024-04-25T09:57:14.735616+0000","last_fullsized":"2024-04-25T09:57:14.735616+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.735588+0000","last_change":"2024-04-25T09:57:14.735588+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.735588+0000","last_undegraded":"2024-04-25T09:57:14.735588+0000","last_fullsized":"2024-04-25T09:57:14.735588+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.769820+0000","last_change":"2024-04-25T09:57:15.766342+0000","last_active":"2024-04-25T09:57:15.769820+0000","last_peered":"2024-04-25T09:57:15.769820+0000","last_clean":"2024-04-25T09:57:15.769820+0000","last_became_active":"2024-04-25T09:57:15.766060+0000","last_became_peered":"2024-04-25T09:57:15.766060+0000","last_unstale":"2024-04-25T09:57:15.769820+0000","last_undegraded":"2024-04-25T09:57:15.769820+0000","last_fullsized":"2024-04-25T09:57:15.769820+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:57:22.599880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759309+0000","last_change":"2024-04-25T09:57:15.752044+0000","last_active":"2024-04-25T09:57:15.759309+0000","last_peered":"2024-04-25T09:57:15.759309+0000","last_clean":"2024-04-25T09:57:15.759309+0000","last_became_active":"2024-04-25T09:57:15.751759+0000","last_became_peered":"2024-04-25T09:57:15.751759+0000","last_unstale":"2024-04-25T09:57:15.759309+0000","last_undegraded":"2024-04-25T09:57:15.759309+0000","last_fullsized":"2024-04-25T09:57:15.759309+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:57:22.599880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759418+0000","last_change":"2024-04-25T09:57:15.751032+0000","last_active":"2024-04-25T09:57:15.759418+0000","last_peered":"2024-04-25T09:57:15.759418+0000","last_clean":"2024-04-25T09:57:15.759418+0000","last_became_active":"2024-04-25T09:57:15.750731+0000","last_became_peered":"2024-04-25T09:57:15.750731+0000","last_unstale":"2024-04-25T09:57:15.759418+0000","last_undegraded":"2024-04-25T09:57:15.759418+0000","last_fullsized":"2024-04-25T09:57:15.759418+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:13.286010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.755315+0000","last_change":"2024-04-25T09:57:15.752419+0000","last_active":"2024-04-25T09:57:15.755315+0000","last_peered":"2024-04-25T09:57:15.755315+0000","last_clean":"2024-04-25T09:57:15.755315+0000","last_became_active":"2024-04-25T09:57:15.752123+0000","last_became_peered":"2024-04-25T09:57:15.752123+0000","last_unstale":"2024-04-25T09:57:15.755315+0000","last_undegraded":"2024-04-25T09:57:15.755315+0000","last_fullsized":"2024-04-25T09:57:15.755315+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:03.777858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.740242+0000","last_change":"2024-04-25T09:57:14.740242+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.740242+0000","last_undegraded":"2024-04-25T09:57:14.740242+0000","last_fullsized":"2024-04-25T09:57:14.740242+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.771070+0000","last_change":"2024-04-25T09:57:15.769491+0000","last_active":"2024-04-25T09:57:15.771070+0000","last_peered":"2024-04-25T09:57:15.771070+0000","last_clean":"2024-04-25T09:57:15.771070+0000","last_became_active":"2024-04-25T09:57:15.768694+0000","last_became_peered":"2024-04-25T09:57:15.768694+0000","last_unstale":"2024-04-25T09:57:15.771070+0000","last_undegraded":"2024-04-25T09:57:15.771070+0000","last_fullsized":"2024-04-25T09:57:15.771070+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:08.997796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.767994+0000","last_change":"2024-04-25T09:57:15.767087+0000","last_active":"2024-04-25T09:57:15.767994+0000","last_peered":"2024-04-25T09:57:15.767994+0000","last_clean":"2024-04-25T09:57:15.767994+0000","last_became_active":"2024-04-25T09:57:15.766747+0000","last_became_peered":"2024-04-25T09:57:15.766747+0000","last_unstale":"2024-04-25T09:57:15.767994+0000","last_undegraded":"2024-04-25T09:57:15.767994+0000","last_fullsized":"2024-04-25T09:57:15.767994+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:35.319064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.749807+0000","last_change":"2024-04-25T09:57:15.745892+0000","last_active":"2024-04-25T09:57:15.749807+0000","last_peered":"2024-04-25T09:57:15.749807+0000","last_clean":"2024-04-25T09:57:15.749807+0000","last_became_active":"2024-04-25T09:57:15.745553+0000","last_became_peered":"2024-04-25T09:57:15.745553+0000","last_unstale":"2024-04-25T09:57:15.749807+0000","last_undegraded":"2024-04-25T09:57:15.749807+0000","last_fullsized":"2024-04-25T09:57:15.749807+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:21:58.966692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.739933+0000","last_change":"2024-04-25T09:57:14.739933+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.739933+0000","last_undegraded":"2024-04-25T09:57:14.739933+0000","last_fullsized":"2024-04-25T09:57:14.739933+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.757016+0000","last_change":"2024-04-25T09:57:15.754290+0000","last_active":"2024-04-25T09:57:15.757016+0000","last_peered":"2024-04-25T09:57:15.757016+0000","last_clean":"2024-04-25T09:57:15.757016+0000","last_became_active":"2024-04-25T09:57:15.753872+0000","last_became_peered":"2024-04-25T09:57:15.753872+0000","last_unstale":"2024-04-25T09:57:15.757016+0000","last_undegraded":"2024-04-25T09:57:15.757016+0000","last_fullsized":"2024-04-25T09:57:15.757016+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:26.061064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.758719+0000","last_change":"2024-04-25T09:57:14.758285+0000","last_active":"2024-04-25T09:57:14.758719+0000","last_peered":"2024-04-25T09:57:14.758719+0000","last_clean":"2024-04-25T09:57:14.758719+0000","last_became_active":"2024-04-25T09:57:14.757995+0000","last_became_peered":"2024-04-25T09:57:14.757995+0000","last_unstale":"2024-04-25T09:57:14.758719+0000","last_undegraded":"2024-04-25T09:57:14.758719+0000","last_fullsized":"2024-04-25T09:57:14.758719+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:01:30.387519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.766480+0000","last_change":"2024-04-25T09:57:15.762946+0000","last_active":"2024-04-25T09:57:15.766480+0000","last_peered":"2024-04-25T09:57:15.766480+0000","last_clean":"2024-04-25T09:57:15.766480+0000","last_became_active":"2024-04-25T09:57:15.761468+0000","last_became_peered":"2024-04-25T09:57:15.761468+0000","last_unstale":"2024-04-25T09:57:15.766480+0000","last_undegraded":"2024-04-25T09:57:15.766480+0000","last_fullsized":"2024-04-25T09:57:15.766480+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:05:54.427158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.750269+0000","last_change":"2024-04-25T09:57:14.747757+0000","last_active":"2024-04-25T09:57:14.750269+0000","last_peered":"2024-04-25T09:57:14.750269+0000","last_clean":"2024-04-25T09:57:14.750269+0000","last_became_active":"2024-04-25T09:57:14.747474+0000","last_became_peered":"2024-04-25T09:57:14.747474+0000","last_unstale":"2024-04-25T09:57:14.750269+0000","last_undegraded":"2024-04-25T09:57:14.750269+0000","last_fullsized":"2024-04-25T09:57:14.750269+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:57.049874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.738966+0000","last_change":"2024-04-25T09:57:14.738966+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.738966+0000","last_undegraded":"2024-04-25T09:57:14.738966+0000","last_fullsized":"2024-04-25T09:57:14.738966+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.750397+0000","last_change":"2024-04-25T09:57:14.746173+0000","last_active":"2024-04-25T09:57:14.750397+0000","last_peered":"2024-04-25T09:57:14.750397+0000","last_clean":"2024-04-25T09:57:14.750397+0000","last_became_active":"2024-04-25T09:57:14.744978+0000","last_became_peered":"2024-04-25T09:57:14.744978+0000","last_unstale":"2024-04-25T09:57:14.750397+0000","last_undegraded":"2024-04-25T09:57:14.750397+0000","last_fullsized":"2024-04-25T09:57:14.750397+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:26.411491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.771033+0000","last_change":"2024-04-25T09:57:15.768921+0000","last_active":"2024-04-25T09:57:15.771033+0000","last_peered":"2024-04-25T09:57:15.771033+0000","last_clean":"2024-04-25T09:57:15.771033+0000","last_became_active":"2024-04-25T09:57:15.768327+0000","last_became_peered":"2024-04-25T09:57:15.768327+0000","last_unstale":"2024-04-25T09:57:15.771033+0000","last_undegraded":"2024-04-25T09:57:15.771033+0000","last_fullsized":"2024-04-25T09:57:15.771033+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:35.319064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.751369+0000","last_change":"2024-04-25T09:57:14.750473+0000","last_active":"2024-04-25T09:57:14.751369+0000","last_peered":"2024-04-25T09:57:14.751369+0000","last_clean":"2024-04-25T09:57:14.751369+0000","last_became_active":"2024-04-25T09:57:14.750124+0000","last_became_peered":"2024-04-25T09:57:14.750124+0000","last_unstale":"2024-04-25T09:57:14.751369+0000","last_undegraded":"2024-04-25T09:57:14.751369+0000","last_fullsized":"2024-04-25T09:57:14.751369+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:04:07.820129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.735799+0000","last_change":"2024-04-25T09:57:14.735799+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.735799+0000","last_undegraded":"2024-04-25T09:57:14.735799+0000","last_fullsized":"2024-04-25T09:57:14.735799+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.747504+0000","last_change":"2024-04-25T09:57:14.744916+0000","last_active":"2024-04-25T09:57:14.747504+0000","last_peered":"2024-04-25T09:57:14.747504+0000","last_clean":"2024-04-25T09:57:14.747504+0000","last_became_active":"2024-04-25T09:57:14.744384+0000","last_became_peered":"2024-04-25T09:57:14.744384+0000","last_unstale":"2024-04-25T09:57:14.747504+0000","last_undegraded":"2024-04-25T09:57:14.747504+0000","last_fullsized":"2024-04-25T09:57:14.747504+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:36.216367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.738167+0000","last_change":"2024-04-25T09:57:14.738167+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.738167+0000","last_undegraded":"2024-04-25T09:57:14.738167+0000","last_fullsized":"2024-04-25T09:57:14.738167+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.746032+0000","last_change":"2024-04-25T09:57:14.742815+0000","last_active":"2024-04-25T09:57:14.746032+0000","last_peered":"2024-04-25T09:57:14.746032+0000","last_clean":"2024-04-25T09:57:14.746032+0000","last_became_active":"2024-04-25T09:57:14.742518+0000","last_became_peered":"2024-04-25T09:57:14.742518+0000","last_unstale":"2024-04-25T09:57:14.746032+0000","last_undegraded":"2024-04-25T09:57:14.746032+0000","last_fullsized":"2024-04-25T09:57:14.746032+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:34.316720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759262+0000","last_change":"2024-04-25T09:57:15.756573+0000","last_active":"2024-04-25T09:57:15.759262+0000","last_peered":"2024-04-25T09:57:15.759262+0000","last_clean":"2024-04-25T09:57:15.759262+0000","last_became_active":"2024-04-25T09:57:15.755701+0000","last_became_peered":"2024-04-25T09:57:15.755701+0000","last_unstale":"2024-04-25T09:57:15.759262+0000","last_undegraded":"2024-04-25T09:57:15.759262+0000","last_fullsized":"2024-04-25T09:57:15.759262+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:11.276834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.747563+0000","last_change":"2024-04-25T09:57:14.746062+0000","last_active":"2024-04-25T09:57:14.747563+0000","last_peered":"2024-04-25T09:57:14.747563+0000","last_clean":"2024-04-25T09:57:14.747563+0000","last_became_active":"2024-04-25T09:57:14.745664+0000","last_became_peered":"2024-04-25T09:57:14.745664+0000","last_unstale":"2024-04-25T09:57:14.747563+0000","last_undegraded":"2024-04-25T09:57:14.747563+0000","last_fullsized":"2024-04-25T09:57:14.747563+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:57.049874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.734950+0000","last_change":"2024-04-25T09:57:14.734950+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.734950+0000","last_undegraded":"2024-04-25T09:57:14.734950+0000","last_fullsized":"2024-04-25T09:57:14.734950+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.740713+0000","last_change":"2024-04-25T09:57:14.752874+0000","last_active":"2024-04-25T09:57:15.740713+0000","last_peered":"2024-04-25T09:57:15.740713+0000","last_clean":"2024-04-25T09:57:15.740713+0000","last_became_active":"2024-04-25T09:57:14.752542+0000","last_became_peered":"2024-04-25T09:57:14.752542+0000","last_unstale":"2024-04-25T09:57:15.740713+0000","last_undegraded":"2024-04-25T09:57:15.740713+0000","last_fullsized":"2024-04-25T09:57:15.740713+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:50.631716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.738121+0000","last_change":"2024-04-25T09:57:14.738121+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.738121+0000","last_undegraded":"2024-04-25T09:57:14.738121+0000","last_fullsized":"2024-04-25T09:57:14.738121+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.758067+0000","last_change":"2024-04-25T09:57:14.758286+0000","last_active":"2024-04-25T09:57:15.758067+0000","last_peered":"2024-04-25T09:57:15.758067+0000","last_clean":"2024-04-25T09:57:15.758067+0000","last_became_active":"2024-04-25T09:57:14.757885+0000","last_became_peered":"2024-04-25T09:57:14.757885+0000","last_unstale":"2024-04-25T09:57:15.758067+0000","last_undegraded":"2024-04-25T09:57:15.758067+0000","last_fullsized":"2024-04-25T09:57:15.758067+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:47.050365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.735099+0000","last_change":"2024-04-25T09:57:14.735099+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.735099+0000","last_undegraded":"2024-04-25T09:57:14.735099+0000","last_fullsized":"2024-04-25T09:57:14.735099+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.742873+0000","last_change":"2024-04-25T09:57:14.744998+0000","last_active":"2024-04-25T09:57:15.742873+0000","last_peered":"2024-04-25T09:57:15.742873+0000","last_clean":"2024-04-25T09:57:15.742873+0000","last_became_active":"2024-04-25T09:57:14.744717+0000","last_became_peered":"2024-04-25T09:57:14.744717+0000","last_unstale":"2024-04-25T09:57:15.742873+0000","last_undegraded":"2024-04-25T09:57:15.742873+0000","last_fullsized":"2024-04-25T09:57:15.742873+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:44.683150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.761689+0000","last_change":"2024-04-25T09:57:15.758927+0000","last_active":"2024-04-25T09:57:15.761689+0000","last_peered":"2024-04-25T09:57:15.761689+0000","last_clean":"2024-04-25T09:57:15.761689+0000","last_became_active":"2024-04-25T09:57:15.758613+0000","last_became_peered":"2024-04-25T09:57:15.758613+0000","last_unstale":"2024-04-25T09:57:15.761689+0000","last_undegraded":"2024-04-25T09:57:15.761689+0000","last_fullsized":"2024-04-25T09:57:15.761689+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:22.009595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"61'3","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.771456+0000","last_change":"2024-04-25T09:57:14.758891+0000","last_active":"2024-04-25T09:57:15.771456+0000","last_peered":"2024-04-25T09:57:15.771456+0000","last_clean":"2024-04-25T09:57:15.771456+0000","last_became_active":"2024-04-25T09:57:14.757957+0000","last_became_peered":"2024-04-25T09:57:14.757957+0000","last_unstale":"2024-04-25T09:57:15.771456+0000","last_undegraded":"2024-04-25T09:57:15.771456+0000","last_fullsized":"2024-04-25T09:57:15.771456+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:51.436833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.763214+0000","last_change":"2024-04-25T09:57:15.755461+0000","last_active":"2024-04-25T09:57:15.763214+0000","last_peered":"2024-04-25T09:57:15.763214+0000","last_clean":"2024-04-25T09:57:15.763214+0000","last_became_active":"2024-04-25T09:57:15.755099+0000","last_became_peered":"2024-04-25T09:57:15.755099+0000","last_unstale":"2024-04-25T09:57:15.763214+0000","last_undegraded":"2024-04-25T09:57:15.763214+0000","last_fullsized":"2024-04-25T09:57:15.763214+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:56.132114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.749740+0000","last_change":"2024-04-25T09:57:14.748332+0000","last_active":"2024-04-25T09:57:14.749740+0000","last_peered":"2024-04-25T09:57:14.749740+0000","last_clean":"2024-04-25T09:57:14.749740+0000","last_became_active":"2024-04-25T09:57:14.747993+0000","last_became_peered":"2024-04-25T09:57:14.747993+0000","last_unstale":"2024-04-25T09:57:14.749740+0000","last_undegraded":"2024-04-25T09:57:14.749740+0000","last_fullsized":"2024-04-25T09:57:14.749740+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:19.567964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.768739+0000","last_change":"2024-04-25T09:57:15.766168+0000","last_active":"2024-04-25T09:57:15.768739+0000","last_peered":"2024-04-25T09:57:15.768739+0000","last_clean":"2024-04-25T09:57:15.768739+0000","last_became_active":"2024-04-25T09:57:15.764964+0000","last_became_peered":"2024-04-25T09:57:15.764964+0000","last_unstale":"2024-04-25T09:57:15.768739+0000","last_undegraded":"2024-04-25T09:57:15.768739+0000","last_fullsized":"2024-04-25T09:57:15.768739+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:05.715956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.765921+0000","last_change":"2024-04-25T09:57:14.758611+0000","last_active":"2024-04-25T09:57:15.765921+0000","last_peered":"2024-04-25T09:57:15.765921+0000","last_clean":"2024-04-25T09:57:15.765921+0000","last_became_active":"2024-04-25T09:57:14.757880+0000","last_became_peered":"2024-04-25T09:57:14.757880+0000","last_unstale":"2024-04-25T09:57:15.765921+0000","last_undegraded":"2024-04-25T09:57:15.765921+0000","last_fullsized":"2024-04-25T09:57:15.765921+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:42.586862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.758828+0000","last_change":"2024-04-25T09:57:15.751535+0000","last_active":"2024-04-25T09:57:15.758828+0000","last_peered":"2024-04-25T09:57:15.758828+0000","last_clean":"2024-04-25T09:57:15.758828+0000","last_became_active":"2024-04-25T09:57:15.751257+0000","last_became_peered":"2024-04-25T09:57:15.751257+0000","last_unstale":"2024-04-25T09:57:15.758828+0000","last_undegraded":"2024-04-25T09:57:15.758828+0000","last_fullsized":"2024-04-25T09:57:15.758828+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:56.030922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.739411+0000","last_change":"2024-04-25T09:57:14.750136+0000","last_active":"2024-04-25T09:57:15.739411+0000","last_peered":"2024-04-25T09:57:15.739411+0000","last_clean":"2024-04-25T09:57:15.739411+0000","last_became_active":"2024-04-25T09:57:14.749841+0000","last_became_peered":"2024-04-25T09:57:14.749841+0000","last_unstale":"2024-04-25T09:57:15.739411+0000","last_undegraded":"2024-04-25T09:57:15.739411+0000","last_fullsized":"2024-04-25T09:57:15.739411+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:47.050365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759245+0000","last_change":"2024-04-25T09:57:15.756190+0000","last_active":"2024-04-25T09:57:15.759245+0000","last_peered":"2024-04-25T09:57:15.759245+0000","last_clean":"2024-04-25T09:57:15.759245+0000","last_became_active":"2024-04-25T09:57:15.755333+0000","last_became_peered":"2024-04-25T09:57:15.755333+0000","last_unstale":"2024-04-25T09:57:15.759245+0000","last_undegraded":"2024-04-25T09:57:15.759245+0000","last_fullsized":"2024-04-25T09:57:15.759245+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:43.991599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.756105+0000","last_change":"2024-04-25T09:57:14.758679+0000","last_active":"2024-04-25T09:57:15.756105+0000","last_peered":"2024-04-25T09:57:15.756105+0000","last_clean":"2024-04-25T09:57:15.756105+0000","last_became_active":"2024-04-25T09:57:14.758320+0000","last_became_peered":"2024-04-25T09:57:14.758320+0000","last_unstale":"2024-04-25T09:57:15.756105+0000","last_undegraded":"2024-04-25T09:57:15.756105+0000","last_fullsized":"2024-04-25T09:57:15.756105+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:25.679262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.737498+0000","last_change":"2024-04-25T09:57:14.737498+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.737498+0000","last_undegraded":"2024-04-25T09:57:14.737498+0000","last_fullsized":"2024-04-25T09:57:14.737498+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"61'8","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.769776+0000","last_change":"2024-04-25T09:57:14.749907+0000","last_active":"2024-04-25T09:57:15.769776+0000","last_peered":"2024-04-25T09:57:15.769776+0000","last_clean":"2024-04-25T09:57:15.769776+0000","last_became_active":"2024-04-25T09:57:14.748686+0000","last_became_peered":"2024-04-25T09:57:14.748686+0000","last_unstale":"2024-04-25T09:57:15.769776+0000","last_undegraded":"2024-04-25T09:57:15.769776+0000","last_fullsized":"2024-04-25T09:57:15.769776+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:26:09.170713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.769946+0000","last_change":"2024-04-25T09:57:15.767545+0000","last_active":"2024-04-25T09:57:15.769946+0000","last_peered":"2024-04-25T09:57:15.769946+0000","last_clean":"2024-04-25T09:57:15.769946+0000","last_became_active":"2024-04-25T09:57:15.767252+0000","last_became_peered":"2024-04-25T09:57:15.767252+0000","last_unstale":"2024-04-25T09:57:15.769946+0000","last_undegraded":"2024-04-25T09:57:15.769946+0000","last_fullsized":"2024-04-25T09:57:15.769946+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:47.721018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759249+0000","last_change":"2024-04-25T09:57:14.749754+0000","last_active":"2024-04-25T09:57:15.759249+0000","last_peered":"2024-04-25T09:57:15.759249+0000","last_clean":"2024-04-25T09:57:15.759249+0000","last_became_active":"2024-04-25T09:57:14.749258+0000","last_became_peered":"2024-04-25T09:57:14.749258+0000","last_unstale":"2024-04-25T09:57:15.759249+0000","last_undegraded":"2024-04-25T09:57:15.759249+0000","last_fullsized":"2024-04-25T09:57:15.759249+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:25.679262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.756532+0000","last_change":"2024-04-25T09:57:15.751259+0000","last_active":"2024-04-25T09:57:15.756532+0000","last_peered":"2024-04-25T09:57:15.756532+0000","last_clean":"2024-04-25T09:57:15.756532+0000","last_became_active":"2024-04-25T09:57:15.750979+0000","last_became_peered":"2024-04-25T09:57:15.750979+0000","last_unstale":"2024-04-25T09:57:15.756532+0000","last_undegraded":"2024-04-25T09:57:15.756532+0000","last_fullsized":"2024-04-25T09:57:15.756532+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:45.975880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.766274+0000","last_change":"2024-04-25T09:57:14.758286+0000","last_active":"2024-04-25T09:57:15.766274+0000","last_peered":"2024-04-25T09:57:15.766274+0000","last_clean":"2024-04-25T09:57:15.766274+0000","last_became_active":"2024-04-25T09:57:14.757970+0000","last_became_peered":"2024-04-25T09:57:14.757970+0000","last_unstale":"2024-04-25T09:57:15.766274+0000","last_undegraded":"2024-04-25T09:57:15.766274+0000","last_fullsized":"2024-04-25T09:57:15.766274+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:03.967389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.764468+0000","last_change":"2024-04-25T09:57:15.760819+0000","last_active":"2024-04-25T09:57:15.764468+0000","last_peered":"2024-04-25T09:57:15.764468+0000","last_clean":"2024-04-25T09:57:15.764468+0000","last_became_active":"2024-04-25T09:57:15.760488+0000","last_became_peered":"2024-04-25T09:57:15.760488+0000","last_unstale":"2024-04-25T09:57:15.764468+0000","last_undegraded":"2024-04-25T09:57:15.764468+0000","last_fullsized":"2024-04-25T09:57:15.764468+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:45.975880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.770372+0000","last_change":"2024-04-25T09:57:14.758906+0000","last_active":"2024-04-25T09:57:15.770372+0000","last_peered":"2024-04-25T09:57:15.770372+0000","last_clean":"2024-04-25T09:57:15.770372+0000","last_became_active":"2024-04-25T09:57:14.758479+0000","last_became_peered":"2024-04-25T09:57:14.758479+0000","last_unstale":"2024-04-25T09:57:15.770372+0000","last_undegraded":"2024-04-25T09:57:15.770372+0000","last_fullsized":"2024-04-25T09:57:15.770372+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:12.283665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.756716+0000","last_change":"2024-04-25T09:57:15.754377+0000","last_active":"2024-04-25T09:57:15.756716+0000","last_peered":"2024-04-25T09:57:15.756716+0000","last_clean":"2024-04-25T09:57:15.756716+0000","last_became_active":"2024-04-25T09:57:15.752933+0000","last_became_peered":"2024-04-25T09:57:15.752933+0000","last_unstale":"2024-04-25T09:57:15.756716+0000","last_undegraded":"2024-04-25T09:57:15.756716+0000","last_fullsized":"2024-04-25T09:57:15.756716+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:05.715956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.745810+0000","last_change":"2024-04-25T09:57:14.742625+0000","last_active":"2024-04-25T09:57:14.745810+0000","last_peered":"2024-04-25T09:57:14.745810+0000","last_clean":"2024-04-25T09:57:14.745810+0000","last_became_active":"2024-04-25T09:57:14.742323+0000","last_became_peered":"2024-04-25T09:57:14.742323+0000","last_unstale":"2024-04-25T09:57:14.745810+0000","last_undegraded":"2024-04-25T09:57:14.745810+0000","last_fullsized":"2024-04-25T09:57:14.745810+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:37.033433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.739509+0000","last_change":"2024-04-25T09:57:14.739509+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.739509+0000","last_undegraded":"2024-04-25T09:57:14.739509+0000","last_fullsized":"2024-04-25T09:57:14.739509+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.750253+0000","last_change":"2024-04-25T09:57:14.744916+0000","last_active":"2024-04-25T09:57:14.750253+0000","last_peered":"2024-04-25T09:57:14.750253+0000","last_clean":"2024-04-25T09:57:14.750253+0000","last_became_active":"2024-04-25T09:57:14.744621+0000","last_became_peered":"2024-04-25T09:57:14.744621+0000","last_unstale":"2024-04-25T09:57:14.750253+0000","last_undegraded":"2024-04-25T09:57:14.750253+0000","last_fullsized":"2024-04-25T09:57:14.750253+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:07.995451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.758804+0000","last_change":"2024-04-25T09:57:15.747249+0000","last_active":"2024-04-25T09:57:15.758804+0000","last_peered":"2024-04-25T09:57:15.758804+0000","last_clean":"2024-04-25T09:57:15.758804+0000","last_became_active":"2024-04-25T09:57:15.746876+0000","last_became_peered":"2024-04-25T09:57:15.746876+0000","last_unstale":"2024-04-25T09:57:15.758804+0000","last_undegraded":"2024-04-25T09:57:15.758804+0000","last_fullsized":"2024-04-25T09:57:15.758804+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:52.439177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.739655+0000","last_change":"2024-04-25T09:57:14.749773+0000","last_active":"2024-04-25T09:57:15.739655+0000","last_peered":"2024-04-25T09:57:15.739655+0000","last_clean":"2024-04-25T09:57:15.739655+0000","last_became_active":"2024-04-25T09:57:14.749207+0000","last_became_peered":"2024-04-25T09:57:14.749207+0000","last_unstale":"2024-04-25T09:57:15.739655+0000","last_undegraded":"2024-04-25T09:57:15.739655+0000","last_fullsized":"2024-04-25T09:57:15.739655+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:36.078016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759224+0000","last_change":"2024-04-25T09:57:15.755964+0000","last_active":"2024-04-25T09:57:15.759224+0000","last_peered":"2024-04-25T09:57:15.759224+0000","last_clean":"2024-04-25T09:57:15.759224+0000","last_became_active":"2024-04-25T09:57:15.755024+0000","last_became_peered":"2024-04-25T09:57:15.755024+0000","last_unstale":"2024-04-25T09:57:15.759224+0000","last_undegraded":"2024-04-25T09:57:15.759224+0000","last_fullsized":"2024-04-25T09:57:15.759224+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:01:31.389864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.750784+0000","last_change":"2024-04-25T09:57:14.748763+0000","last_active":"2024-04-25T09:57:14.750784+0000","last_peered":"2024-04-25T09:57:14.750784+0000","last_clean":"2024-04-25T09:57:14.750784+0000","last_became_active":"2024-04-25T09:57:14.748442+0000","last_became_peered":"2024-04-25T09:57:14.748442+0000","last_unstale":"2024-04-25T09:57:14.750784+0000","last_undegraded":"2024-04-25T09:57:14.750784+0000","last_fullsized":"2024-04-25T09:57:14.750784+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:13.126972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.739208+0000","last_change":"2024-04-25T09:57:14.739208+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.739208+0000","last_undegraded":"2024-04-25T09:57:14.739208+0000","last_fullsized":"2024-04-25T09:57:14.739208+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.754602+0000","last_change":"2024-04-25T09:57:14.752504+0000","last_active":"2024-04-25T09:57:15.754602+0000","last_peered":"2024-04-25T09:57:15.754602+0000","last_clean":"2024-04-25T09:57:15.754602+0000","last_became_active":"2024-04-25T09:57:14.752223+0000","last_became_peered":"2024-04-25T09:57:14.752223+0000","last_unstale":"2024-04-25T09:57:15.754602+0000","last_undegraded":"2024-04-25T09:57:15.754602+0000","last_fullsized":"2024-04-25T09:57:15.754602+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:42.586862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.735336+0000","last_change":"2024-04-25T09:57:14.735336+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.735336+0000","last_undegraded":"2024-04-25T09:57:14.735336+0000","last_fullsized":"2024-04-25T09:57:14.735336+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.738659+0000","last_change":"2024-04-25T09:57:14.742094+0000","last_active":"2024-04-25T09:57:15.738659+0000","last_peered":"2024-04-25T09:57:15.738659+0000","last_clean":"2024-04-25T09:57:15.738659+0000","last_became_active":"2024-04-25T09:57:14.741829+0000","last_became_peered":"2024-04-25T09:57:14.741829+0000","last_unstale":"2024-04-25T09:57:15.738659+0000","last_undegraded":"2024-04-25T09:57:15.738659+0000","last_fullsized":"2024-04-25T09:57:15.738659+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:03.967389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759441+0000","last_change":"2024-04-25T09:57:15.753721+0000","last_active":"2024-04-25T09:57:15.759441+0000","last_peered":"2024-04-25T09:57:15.759441+0000","last_clean":"2024-04-25T09:57:15.759441+0000","last_became_active":"2024-04-25T09:57:15.753367+0000","last_became_peered":"2024-04-25T09:57:15.753367+0000","last_unstale":"2024-04-25T09:57:15.759441+0000","last_undegraded":"2024-04-25T09:57:15.759441+0000","last_fullsized":"2024-04-25T09:57:15.759441+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:36.249678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.750376+0000","last_change":"2024-04-25T09:57:14.745936+0000","last_active":"2024-04-25T09:57:14.750376+0000","last_peered":"2024-04-25T09:57:14.750376+0000","last_clean":"2024-04-25T09:57:14.750376+0000","last_became_active":"2024-04-25T09:57:14.744599+0000","last_became_peered":"2024-04-25T09:57:14.744599+0000","last_unstale":"2024-04-25T09:57:14.750376+0000","last_undegraded":"2024-04-25T09:57:14.750376+0000","last_fullsized":"2024-04-25T09:57:14.750376+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:36.216367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.756736+0000","last_change":"2024-04-25T09:57:15.753219+0000","last_active":"2024-04-25T09:57:15.756736+0000","last_peered":"2024-04-25T09:57:15.756736+0000","last_clean":"2024-04-25T09:57:15.756736+0000","last_became_active":"2024-04-25T09:57:15.752526+0000","last_became_peered":"2024-04-25T09:57:15.752526+0000","last_unstale":"2024-04-25T09:57:15.756736+0000","last_undegraded":"2024-04-25T09:57:15.756736+0000","last_fullsized":"2024-04-25T09:57:15.756736+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:20.570308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.749715+0000","last_change":"2024-04-25T09:57:14.747370+0000","last_active":"2024-04-25T09:57:14.749715+0000","last_peered":"2024-04-25T09:57:14.749715+0000","last_clean":"2024-04-25T09:57:14.749715+0000","last_became_active":"2024-04-25T09:57:14.747109+0000","last_became_peered":"2024-04-25T09:57:14.747109+0000","last_unstale":"2024-04-25T09:57:14.749715+0000","last_undegraded":"2024-04-25T09:57:14.749715+0000","last_fullsized":"2024-04-25T09:57:14.749715+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:04.713611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759187+0000","last_change":"2024-04-25T09:57:15.757598+0000","last_active":"2024-04-25T09:57:15.759187+0000","last_peered":"2024-04-25T09:57:15.759187+0000","last_clean":"2024-04-25T09:57:15.759187+0000","last_became_active":"2024-04-25T09:57:15.757291+0000","last_became_peered":"2024-04-25T09:57:15.757291+0000","last_unstale":"2024-04-25T09:57:15.759187+0000","last_undegraded":"2024-04-25T09:57:15.759187+0000","last_fullsized":"2024-04-25T09:57:15.759187+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:14.414068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.758295+0000","last_change":"2024-04-25T09:57:14.758651+0000","last_active":"2024-04-25T09:57:15.758295+0000","last_peered":"2024-04-25T09:57:15.758295+0000","last_clean":"2024-04-25T09:57:15.758295+0000","last_became_active":"2024-04-25T09:57:14.758265+0000","last_became_peered":"2024-04-25T09:57:14.758265+0000","last_unstale":"2024-04-25T09:57:15.758295+0000","last_undegraded":"2024-04-25T09:57:15.758295+0000","last_fullsized":"2024-04-25T09:57:15.758295+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:36.078016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.768753+0000","last_change":"2024-04-25T09:57:15.766207+0000","last_active":"2024-04-25T09:57:15.768753+0000","last_peered":"2024-04-25T09:57:15.768753+0000","last_clean":"2024-04-25T09:57:15.768753+0000","last_became_active":"2024-04-25T09:57:15.765910+0000","last_became_peered":"2024-04-25T09:57:15.765910+0000","last_unstale":"2024-04-25T09:57:15.768753+0000","last_undegraded":"2024-04-25T09:57:15.768753+0000","last_fullsized":"2024-04-25T09:57:15.768753+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:20.570308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.746060+0000","last_change":"2024-04-25T09:57:14.743166+0000","last_active":"2024-04-25T09:57:14.746060+0000","last_peered":"2024-04-25T09:57:14.746060+0000","last_clean":"2024-04-25T09:57:14.746060+0000","last_became_active":"2024-04-25T09:57:14.742849+0000","last_became_peered":"2024-04-25T09:57:14.742849+0000","last_unstale":"2024-04-25T09:57:14.746060+0000","last_undegraded":"2024-04-25T09:57:14.746060+0000","last_fullsized":"2024-04-25T09:57:14.746060+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:42.168255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.736953+0000","last_change":"2024-04-25T09:57:14.736953+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.736953+0000","last_undegraded":"2024-04-25T09:57:14.736953+0000","last_fullsized":"2024-04-25T09:57:14.736953+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.747542+0000","last_change":"2024-04-25T09:57:14.745243+0000","last_active":"2024-04-25T09:57:14.747542+0000","last_peered":"2024-04-25T09:57:14.747542+0000","last_clean":"2024-04-25T09:57:14.747542+0000","last_became_active":"2024-04-25T09:57:14.744863+0000","last_became_peered":"2024-04-25T09:57:14.744863+0000","last_unstale":"2024-04-25T09:57:14.747542+0000","last_undegraded":"2024-04-25T09:57:14.747542+0000","last_fullsized":"2024-04-25T09:57:14.747542+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:26.411491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.735406+0000","last_change":"2024-04-25T09:57:14.735406+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.735406+0000","last_undegraded":"2024-04-25T09:57:14.735406+0000","last_fullsized":"2024-04-25T09:57:14.735406+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.746338+0000","last_change":"2024-04-25T09:57:14.745523+0000","last_active":"2024-04-25T09:57:14.746338+0000","last_peered":"2024-04-25T09:57:14.746338+0000","last_clean":"2024-04-25T09:57:14.746338+0000","last_became_active":"2024-04-25T09:57:14.745243+0000","last_became_peered":"2024-04-25T09:57:14.745243+0000","last_unstale":"2024-04-25T09:57:14.746338+0000","last_undegraded":"2024-04-25T09:57:14.746338+0000","last_fullsized":"2024-04-25T09:57:14.746338+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:25.058720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.762195+0000","last_change":"2024-04-25T09:57:15.759399+0000","last_active":"2024-04-25T09:57:15.762195+0000","last_peered":"2024-04-25T09:57:15.762195+0000","last_clean":"2024-04-25T09:57:15.762195+0000","last_became_active":"2024-04-25T09:57:15.758243+0000","last_became_peered":"2024-04-25T09:57:15.758243+0000","last_unstale":"2024-04-25T09:57:15.762195+0000","last_undegraded":"2024-04-25T09:57:15.762195+0000","last_fullsized":"2024-04-25T09:57:15.762195+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:04.969733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.747693+0000","last_change":"2024-04-25T09:57:14.744509+0000","last_active":"2024-04-25T09:57:14.747693+0000","last_peered":"2024-04-25T09:57:14.747693+0000","last_clean":"2024-04-25T09:57:14.747693+0000","last_became_active":"2024-04-25T09:57:14.744156+0000","last_became_peered":"2024-04-25T09:57:14.744156+0000","last_unstale":"2024-04-25T09:57:14.747693+0000","last_undegraded":"2024-04-25T09:57:14.747693+0000","last_fullsized":"2024-04-25T09:57:14.747693+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:07.995451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":243,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.758136+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T09:57:15.758136+0000","last_peered":"2024-04-25T09:57:15.758136+0000","last_clean":"2024-04-25T09:57:15.758136+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T09:57:15.758136+0000","last_undegraded":"2024-04-25T09:57:15.758136+0000","last_fullsized":"2024-04-25T09:57:15.758136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":216,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542183,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32468,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1314816,"data_stored":910803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542183,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":720896,"data_stored":320435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542185,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":737280,"data_stored":327624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542182,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":720896,"data_stored":320435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31872,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":708608,"data_stored":313776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31876,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339964,"statfs":{"total":96636764160,"available":96604123136,"internally_reserved":0,"allocated":708608,"data_stored":313776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31872,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":708608,"data_stored":313776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1302528,"data_stored":904144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:57:19.459 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3f is not active+clean 2024-04-25T09:57:19.459 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:57:14.739601+0000', 'last_change': '2024-04-25T09:57:14.739601+0000', 'last_active': '2024-04-25T09:57:14.723456+0000', 'last_peered': '2024-04-25T09:57:14.723456+0000', 'last_clean': '2024-04-25T09:57:14.723456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:57:14.739601+0000', 'last_undegraded': '2024-04-25T09:57:14.739601+0000', 'last_fullsized': '2024-04-25T09:57:14.739601+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_clean_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:57:19.460 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3e is not active+clean 2024-04-25T09:57:19.460 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:57:14.736881+0000', 'last_change': '2024-04-25T09:57:14.736881+0000', 'last_active': '2024-04-25T09:57:14.723456+0000', 'last_peered': '2024-04-25T09:57:14.723456+0000', 'last_clean': '2024-04-25T09:57:14.723456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:57:14.736881+0000', 'last_undegraded': '2024-04-25T09:57:14.736881+0000', 'last_fullsized': '2024-04-25T09:57:14.736881+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_clean_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:57:19.460 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3a is not active+clean 2024-04-25T09:57:19.460 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:57:14.740479+0000', 'last_change': '2024-04-25T09:57:14.740479+0000', 'last_active': '2024-04-25T09:57:14.723456+0000', 'last_peered': '2024-04-25T09:57:14.723456+0000', 'last_clean': '2024-04-25T09:57:14.723456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:57:14.740479+0000', 'last_undegraded': '2024-04-25T09:57:14.740479+0000', 'last_fullsized': '2024-04-25T09:57:14.740479+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_clean_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:57:19.460 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.39 is not active+clean 2024-04-25T09:57:19.460 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:57:14.735324+0000', 'last_change': '2024-04-25T09:57:14.735324+0000', 'last_active': '2024-04-25T09:57:14.723456+0000', 'last_peered': '2024-04-25T09:57:14.723456+0000', 'last_clean': '2024-04-25T09:57:14.723456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:57:14.735324+0000', 'last_undegraded': '2024-04-25T09:57:14.735324+0000', 'last_fullsized': '2024-04-25T09:57:14.735324+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_clean_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:57:19.460 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.30 is not active+clean 2024-04-25T09:57:19.460 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:57:14.736209+0000', 'last_change': '2024-04-25T09:57:14.736209+0000', 'last_active': '2024-04-25T09:57:14.723456+0000', 'last_peered': '2024-04-25T09:57:14.723456+0000', 'last_clean': '2024-04-25T09:57:14.723456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:57:14.736209+0000', 'last_undegraded': '2024-04-25T09:57:14.736209+0000', 'last_fullsized': '2024-04-25T09:57:14.736209+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_clean_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:57:19.461 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2f is not active+clean 2024-04-25T09:57:19.461 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:57:14.739137+0000', 'last_change': '2024-04-25T09:57:14.739137+0000', 'last_active': '2024-04-25T09:57:14.723456+0000', 'last_peered': '2024-04-25T09:57:14.723456+0000', 'last_clean': '2024-04-25T09:57:14.723456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:57:14.739137+0000', 'last_undegraded': '2024-04-25T09:57:14.739137+0000', 'last_fullsized': '2024-04-25T09:57:14.739137+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_clean_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:57:19.461 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2c is not active+clean 2024-04-25T09:57:19.461 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:57:14.738072+0000', 'last_change': '2024-04-25T09:57:14.738072+0000', 'last_active': '2024-04-25T09:57:14.723456+0000', 'last_peered': '2024-04-25T09:57:14.723456+0000', 'last_clean': '2024-04-25T09:57:14.723456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:57:14.738072+0000', 'last_undegraded': '2024-04-25T09:57:14.738072+0000', 'last_fullsized': '2024-04-25T09:57:14.738072+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_clean_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:57:19.461 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2a is not active+clean 2024-04-25T09:57:19.461 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:57:14.735616+0000', 'last_change': '2024-04-25T09:57:14.735616+0000', 'last_active': '2024-04-25T09:57:14.723456+0000', 'last_peered': '2024-04-25T09:57:14.723456+0000', 'last_clean': '2024-04-25T09:57:14.723456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:57:14.735616+0000', 'last_undegraded': '2024-04-25T09:57:14.735616+0000', 'last_fullsized': '2024-04-25T09:57:14.735616+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_clean_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:57:19.461 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.29 is not active+clean 2024-04-25T09:57:19.461 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:57:14.735588+0000', 'last_change': '2024-04-25T09:57:14.735588+0000', 'last_active': '2024-04-25T09:57:14.723456+0000', 'last_peered': '2024-04-25T09:57:14.723456+0000', 'last_clean': '2024-04-25T09:57:14.723456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:57:14.735588+0000', 'last_undegraded': '2024-04-25T09:57:14.735588+0000', 'last_fullsized': '2024-04-25T09:57:14.735588+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_clean_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:57:19.461 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.24 is not active+clean 2024-04-25T09:57:19.461 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:57:14.740242+0000', 'last_change': '2024-04-25T09:57:14.740242+0000', 'last_active': '2024-04-25T09:57:14.723456+0000', 'last_peered': '2024-04-25T09:57:14.723456+0000', 'last_clean': '2024-04-25T09:57:14.723456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:57:14.740242+0000', 'last_undegraded': '2024-04-25T09:57:14.740242+0000', 'last_fullsized': '2024-04-25T09:57:14.740242+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_clean_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:57:19.462 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.20 is not active+clean 2024-04-25T09:57:19.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:57:14.739933+0000', 'last_change': '2024-04-25T09:57:14.739933+0000', 'last_active': '2024-04-25T09:57:14.723456+0000', 'last_peered': '2024-04-25T09:57:14.723456+0000', 'last_clean': '2024-04-25T09:57:14.723456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:57:14.739933+0000', 'last_undegraded': '2024-04-25T09:57:14.739933+0000', 'last_fullsized': '2024-04-25T09:57:14.739933+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_clean_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:57:19.462 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1e is not active+clean 2024-04-25T09:57:19.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:57:14.738966+0000', 'last_change': '2024-04-25T09:57:14.738966+0000', 'last_active': '2024-04-25T09:57:14.723456+0000', 'last_peered': '2024-04-25T09:57:14.723456+0000', 'last_clean': '2024-04-25T09:57:14.723456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:57:14.738966+0000', 'last_undegraded': '2024-04-25T09:57:14.738966+0000', 'last_fullsized': '2024-04-25T09:57:14.738966+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_clean_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:57:19.462 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.18 is not active+clean 2024-04-25T09:57:19.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:57:14.735799+0000', 'last_change': '2024-04-25T09:57:14.735799+0000', 'last_active': '2024-04-25T09:57:14.723456+0000', 'last_peered': '2024-04-25T09:57:14.723456+0000', 'last_clean': '2024-04-25T09:57:14.723456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:57:14.735799+0000', 'last_undegraded': '2024-04-25T09:57:14.735799+0000', 'last_fullsized': '2024-04-25T09:57:14.735799+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_clean_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:57:19.462 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.19 is not active+clean 2024-04-25T09:57:19.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:57:14.738167+0000', 'last_change': '2024-04-25T09:57:14.738167+0000', 'last_active': '2024-04-25T09:57:14.723456+0000', 'last_peered': '2024-04-25T09:57:14.723456+0000', 'last_clean': '2024-04-25T09:57:14.723456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:57:14.738167+0000', 'last_undegraded': '2024-04-25T09:57:14.738167+0000', 'last_fullsized': '2024-04-25T09:57:14.738167+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_clean_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:57:19.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1b is not active+clean 2024-04-25T09:57:19.463 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:57:14.734950+0000', 'last_change': '2024-04-25T09:57:14.734950+0000', 'last_active': '2024-04-25T09:57:14.723456+0000', 'last_peered': '2024-04-25T09:57:14.723456+0000', 'last_clean': '2024-04-25T09:57:14.723456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:57:14.734950+0000', 'last_undegraded': '2024-04-25T09:57:14.734950+0000', 'last_fullsized': '2024-04-25T09:57:14.734950+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_clean_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:57:19.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.14 is not active+clean 2024-04-25T09:57:19.463 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:57:14.738121+0000', 'last_change': '2024-04-25T09:57:14.738121+0000', 'last_active': '2024-04-25T09:57:14.723456+0000', 'last_peered': '2024-04-25T09:57:14.723456+0000', 'last_clean': '2024-04-25T09:57:14.723456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:57:14.738121+0000', 'last_undegraded': '2024-04-25T09:57:14.738121+0000', 'last_fullsized': '2024-04-25T09:57:14.738121+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_clean_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:57:19.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.15 is not active+clean 2024-04-25T09:57:19.463 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:57:14.735099+0000', 'last_change': '2024-04-25T09:57:14.735099+0000', 'last_active': '2024-04-25T09:57:14.723456+0000', 'last_peered': '2024-04-25T09:57:14.723456+0000', 'last_clean': '2024-04-25T09:57:14.723456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:57:14.735099+0000', 'last_undegraded': '2024-04-25T09:57:14.735099+0000', 'last_fullsized': '2024-04-25T09:57:14.735099+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_clean_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:57:19.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.13 is not active+clean 2024-04-25T09:57:19.463 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:57:14.737498+0000', 'last_change': '2024-04-25T09:57:14.737498+0000', 'last_active': '2024-04-25T09:57:14.723456+0000', 'last_peered': '2024-04-25T09:57:14.723456+0000', 'last_clean': '2024-04-25T09:57:14.723456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:57:14.737498+0000', 'last_undegraded': '2024-04-25T09:57:14.737498+0000', 'last_fullsized': '2024-04-25T09:57:14.737498+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_clean_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:57:19.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.8 is not active+clean 2024-04-25T09:57:19.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:57:14.739509+0000', 'last_change': '2024-04-25T09:57:14.739509+0000', 'last_active': '2024-04-25T09:57:14.723456+0000', 'last_peered': '2024-04-25T09:57:14.723456+0000', 'last_clean': '2024-04-25T09:57:14.723456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:57:14.739509+0000', 'last_undegraded': '2024-04-25T09:57:14.739509+0000', 'last_fullsized': '2024-04-25T09:57:14.739509+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_clean_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:57:19.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.4 is not active+clean 2024-04-25T09:57:19.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:57:14.739208+0000', 'last_change': '2024-04-25T09:57:14.739208+0000', 'last_active': '2024-04-25T09:57:14.723456+0000', 'last_peered': '2024-04-25T09:57:14.723456+0000', 'last_clean': '2024-04-25T09:57:14.723456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:57:14.739208+0000', 'last_undegraded': '2024-04-25T09:57:14.739208+0000', 'last_fullsized': '2024-04-25T09:57:14.739208+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_clean_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:57:19.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.5 is not active+clean 2024-04-25T09:57:19.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:57:14.735336+0000', 'last_change': '2024-04-25T09:57:14.735336+0000', 'last_active': '2024-04-25T09:57:14.723456+0000', 'last_peered': '2024-04-25T09:57:14.723456+0000', 'last_clean': '2024-04-25T09:57:14.723456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:57:14.735336+0000', 'last_undegraded': '2024-04-25T09:57:14.735336+0000', 'last_fullsized': '2024-04-25T09:57:14.735336+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_clean_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:57:19.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2 is not active+clean 2024-04-25T09:57:19.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:57:14.736953+0000', 'last_change': '2024-04-25T09:57:14.736953+0000', 'last_active': '2024-04-25T09:57:14.723456+0000', 'last_peered': '2024-04-25T09:57:14.723456+0000', 'last_clean': '2024-04-25T09:57:14.723456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:57:14.736953+0000', 'last_undegraded': '2024-04-25T09:57:14.736953+0000', 'last_fullsized': '2024-04-25T09:57:14.736953+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_clean_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:57:19.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3 is not active+clean 2024-04-25T09:57:19.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:57:14.735406+0000', 'last_change': '2024-04-25T09:57:14.735406+0000', 'last_active': '2024-04-25T09:57:14.723456+0000', 'last_peered': '2024-04-25T09:57:14.723456+0000', 'last_clean': '2024-04-25T09:57:14.723456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:57:14.735406+0000', 'last_undegraded': '2024-04-25T09:57:14.735406+0000', 'last_fullsized': '2024-04-25T09:57:14.735406+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'last_clean_scrub_stamp': '2024-04-25T09:57:14.723456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:57:19.465 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:57:19.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.591+0000 7f39be710640 1 Processor -- start 2024-04-25T09:57:19.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.591+0000 7f39be710640 1 -- start start 2024-04-25T09:57:19.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.592+0000 7f39be710640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39b815dc40 0x7f39b809a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:19.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.592+0000 7f39be710640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f39b806cd90 0x7f39b80cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:19.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.592+0000 7f39be710640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b815e020 con 0x7f39b80d1060 2024-04-25T09:57:19.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.592+0000 7f39be710640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b80d0bd0 con 0x7f39b806cd90 2024-04-25T09:57:19.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.592+0000 7f39be710640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b80cffc0 con 0x7f39b815dc40 2024-04-25T09:57:19.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.592+0000 7f39bccad640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f39b806cd90 0x7f39b80cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:19.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.592+0000 7f39bccad640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f39b806cd90 0x7f39b80cf890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49336/0 (socket says 172.21.15.7:49336) 2024-04-25T09:57:19.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.592+0000 7f39b77fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f39b80d1060 0x7f39b806c680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:56122/0 (socket says 172.21.15.7:56122) 2024-04-25T09:57:19.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.592+0000 7f39bccad640 1 -- 172.21.15.7:0/102168889 learned_addr learned my addr 172.21.15.7:0/102168889 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:19.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.592+0000 7f39b7fff640 1 --2- 172.21.15.7:0/102168889 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39b815dc40 0x7f39b809a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:19.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.592+0000 7f39bccad640 1 -- 172.21.15.7:0/102168889 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39b815dc40 msgr2=0x7f39b809a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:19.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.592+0000 7f39bccad640 1 --2- 172.21.15.7:0/102168889 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39b815dc40 0x7f39b809a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:19.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.592+0000 7f39bccad640 1 -- 172.21.15.7:0/102168889 >> v1:172.21.15.7:6789/0 conn(0x7f39b80d1060 legacy=0x7f39b806c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:19.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.592+0000 7f39b6ffd640 1 -- 172.21.15.7:0/102168889 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1387280715 0 0) 0x7f39b815e020 con 0x7f39b80d1060 2024-04-25T09:57:19.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.592+0000 7f39bccad640 1 -- 172.21.15.7:0/102168889 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b80d02a0 con 0x7f39b806cd90 2024-04-25T09:57:19.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.593+0000 7f39bccad640 1 --2- 172.21.15.7:0/102168889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39b806cd90 0x7f39b80cf890 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f39b0009e50 tx=0x7f39b002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75fb699341b4c067 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:19.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.593+0000 7f39b6ffd640 1 -- 172.21.15.7:0/102168889 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0036070 con 0x7f39b806cd90 2024-04-25T09:57:19.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.593+0000 7f39b6ffd640 1 -- 172.21.15.7:0/102168889 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b0031600 con 0x7f39b806cd90 2024-04-25T09:57:19.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.593+0000 7f39b6ffd640 1 -- 172.21.15.7:0/102168889 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b00319d0 con 0x7f39b806cd90 2024-04-25T09:57:19.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.594+0000 7f39be710640 1 -- 172.21.15.7:0/102168889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39b806cd90 msgr2=0x7f39b80cf890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:19.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.594+0000 7f39be710640 1 --2- 172.21.15.7:0/102168889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39b806cd90 0x7f39b80cf890 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f39b0009e50 tx=0x7f39b002a680 comp rx=0 tx=0).stop 2024-04-25T09:57:19.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.594+0000 7f39be710640 1 -- 172.21.15.7:0/102168889 shutdown_connections 2024-04-25T09:57:19.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.594+0000 7f39be710640 1 --2- 172.21.15.7:0/102168889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39b806cd90 0x7f39b80cf890 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:19.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.594+0000 7f39be710640 1 --2- 172.21.15.7:0/102168889 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39b815dc40 0x7f39b809a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:19.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.594+0000 7f39be710640 1 -- 172.21.15.7:0/102168889 >> 172.21.15.7:0/102168889 conn(0x7f39b80d1650 msgr2=0x7f39b80d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:19.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.594+0000 7f39be710640 1 -- 172.21.15.7:0/102168889 shutdown_connections 2024-04-25T09:57:19.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.594+0000 7f39be710640 1 -- 172.21.15.7:0/102168889 wait complete. 2024-04-25T09:57:19.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.595+0000 7f39be710640 1 Processor -- start 2024-04-25T09:57:19.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.595+0000 7f39be710640 1 -- start start 2024-04-25T09:57:19.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.596+0000 7f39be710640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39b806cd90 0x7f39b80cb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:19.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.596+0000 7f39be710640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39b80d1060 0x7f39b81f6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:19.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.596+0000 7f39be710640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39b815dc40 0x7f39b80b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:19.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.596+0000 7f39be710640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b80cbca0 con 0x7f39b80d1060 2024-04-25T09:57:19.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.596+0000 7f39be710640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b80d0860 con 0x7f39b806cd90 2024-04-25T09:57:19.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.596+0000 7f39be710640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b80cbe20 con 0x7f39b815dc40 2024-04-25T09:57:19.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.596+0000 7f39b77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39b80d1060 0x7f39b81f6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:19.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.596+0000 7f39b77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39b80d1060 0x7f39b81f6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49344/0 (socket says 172.21.15.7:49344) 2024-04-25T09:57:19.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.596+0000 7f39b77fe640 1 -- 172.21.15.7:0/3677950318 learned_addr learned my addr 172.21.15.7:0/3677950318 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:19.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.596+0000 7f39b7fff640 1 --2- 172.21.15.7:0/3677950318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39b806cd90 0x7f39b80cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:19.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.596+0000 7f39b77fe640 1 -- 172.21.15.7:0/3677950318 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39b815dc40 msgr2=0x7f39b80b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:19.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.596+0000 7f39b77fe640 1 --2- 172.21.15.7:0/3677950318 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39b815dc40 0x7f39b80b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:19.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.596+0000 7f39b77fe640 1 -- 172.21.15.7:0/3677950318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39b806cd90 msgr2=0x7f39b80cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:19.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.596+0000 7f39b77fe640 1 --2- 172.21.15.7:0/3677950318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39b806cd90 0x7f39b80cb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:19.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.596+0000 7f39b77fe640 1 -- 172.21.15.7:0/3677950318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b81f7310 con 0x7f39b80d1060 2024-04-25T09:57:19.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.596+0000 7f39b77fe640 1 --2- 172.21.15.7:0/3677950318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39b80d1060 0x7f39b81f6dd0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f39a800c4d0 tx=0x7f39a800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:19.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.597+0000 7f39b4ff9640 1 -- 172.21.15.7:0/3677950318 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a8018070 con 0x7f39b80d1060 2024-04-25T09:57:19.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.597+0000 7f39b4ff9640 1 -- 172.21.15.7:0/3677950318 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a8007500 con 0x7f39b80d1060 2024-04-25T09:57:19.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.597+0000 7f39be710640 1 -- 172.21.15.7:0/3677950318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b81f7590 con 0x7f39b80d1060 2024-04-25T09:57:19.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.597+0000 7f39b4ff9640 1 -- 172.21.15.7:0/3677950318 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a8004a20 con 0x7f39b80d1060 2024-04-25T09:57:19.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.597+0000 7f39be710640 1 -- 172.21.15.7:0/3677950318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b80c9980 con 0x7f39b80d1060 2024-04-25T09:57:19.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.598+0000 7f39be710640 1 -- 172.21.15.7:0/3677950318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b80c9b80 con 0x7f39b80d1060 2024-04-25T09:57:19.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.598+0000 7f39b4ff9640 1 -- 172.21.15.7:0/3677950318 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f39a801b070 con 0x7f39b80d1060 2024-04-25T09:57:19.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.598+0000 7f39b4ff9640 1 --2- 172.21.15.7:0/3677950318 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f39a406b4d0 0x7f39a406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:19.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.599+0000 7f39b4ff9640 1 -- 172.21.15.7:0/3677950318 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f39a80896e0 con 0x7f39b80d1060 2024-04-25T09:57:19.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.599+0000 7f39b7fff640 1 --2- 172.21.15.7:0/3677950318 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f39a406b4d0 0x7f39a406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:19.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.599+0000 7f39b7fff640 1 --2- 172.21.15.7:0/3677950318 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f39a406b4d0 0x7f39a406d990 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f39ac006fd0 tx=0x7f39ac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:19.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.603+0000 7f39b4ff9640 1 -- 172.21.15.7:0/3677950318 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f39b80c9b80 con 0x7f39b80d1060 2024-04-25T09:57:19.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.857+0000 7f39be710640 1 -- 172.21.15.7:0/3677950318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f39b8074bb0 con 0x7f39b80d1060 2024-04-25T09:57:19.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.857+0000 7f39b4ff9640 1 -- 172.21.15.7:0/3677950318 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1390 (secure 0 0 0) 0x7f39b81f7310 con 0x7f39b80d1060 2024-04-25T09:57:19.861 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:57:19.861 INFO:teuthology.orchestra.run.smithi007.stdout:{"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":196,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":62,"num_osds":8,"num_up_osds":8,"osd_up_since":1714038855,"num_in_osds":8,"osd_in_since":1714038845,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":74},{"state_name":"creating+peering","count":23}],"num_pgs":97,"num_pools":3,"num_objects":14,"data_bytes":590584,"bytes_used":262373376,"bytes_avail":772831739904,"bytes_total":773094113280,"inactive_pgs_ratio":0.23711340129375458,"write_bytes_sec":2457,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":28,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":6285}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2024-04-25T09:57:11.889527+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:57:19.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.859+0000 7f39be710640 1 -- 172.21.15.7:0/3677950318 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f39a406b4d0 msgr2=0x7f39a406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:19.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.859+0000 7f39be710640 1 --2- 172.21.15.7:0/3677950318 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f39a406b4d0 0x7f39a406d990 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f39ac006fd0 tx=0x7f39ac008040 comp rx=0 tx=0).stop 2024-04-25T09:57:19.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.859+0000 7f39be710640 1 -- 172.21.15.7:0/3677950318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39b80d1060 msgr2=0x7f39b81f6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:19.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.859+0000 7f39be710640 1 --2- 172.21.15.7:0/3677950318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39b80d1060 0x7f39b81f6dd0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f39a800c4d0 tx=0x7f39a800c990 comp rx=0 tx=0).stop 2024-04-25T09:57:19.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.859+0000 7f39be710640 1 -- 172.21.15.7:0/3677950318 shutdown_connections 2024-04-25T09:57:19.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.859+0000 7f39be710640 1 --2- 172.21.15.7:0/3677950318 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f39a406b4d0 0x7f39a406d990 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:19.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.859+0000 7f39be710640 1 --2- 172.21.15.7:0/3677950318 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39b815dc40 0x7f39b80b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:19.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.859+0000 7f39be710640 1 --2- 172.21.15.7:0/3677950318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39b80d1060 0x7f39b81f6dd0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:19.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.859+0000 7f39be710640 1 --2- 172.21.15.7:0/3677950318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39b806cd90 0x7f39b80cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:19.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.859+0000 7f39be710640 1 -- 172.21.15.7:0/3677950318 >> 172.21.15.7:0/3677950318 conn(0x7f39b80d1650 msgr2=0x7f39b806fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:19.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.859+0000 7f39be710640 1 -- 172.21.15.7:0/3677950318 shutdown_connections 2024-04-25T09:57:19.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.859+0000 7f39be710640 1 -- 172.21.15.7:0/3677950318 wait complete. 2024-04-25T09:57:19.873 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T09:57:19.874 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:57:19.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.971+0000 7f7d8631b640 1 Processor -- start 2024-04-25T09:57:19.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.971+0000 7f7d8631b640 1 -- start start 2024-04-25T09:57:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.972+0000 7f7d8631b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d8015db00 0x7f7d800d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.972+0000 7f7d8631b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7d800ce2b0 0x7f7d800d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.972+0000 7f7d8631b640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d800d1e80 con 0x7f7d800b53b0 2024-04-25T09:57:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.972+0000 7f7d8631b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d800b5930 con 0x7f7d800ce2b0 2024-04-25T09:57:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.972+0000 7f7d8631b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d800b5c10 con 0x7f7d8015db00 2024-04-25T09:57:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.972+0000 7f7d7f7fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7d800b53b0 0x7f7d80161670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38180/0 (socket says 172.21.15.7:38180) 2024-04-25T09:57:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.972+0000 7f7d7f7fe640 1 -- 172.21.15.7:0/575213081 learned_addr learned my addr 172.21.15.7:0/575213081 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:57:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.973+0000 7f7d848b8640 1 --2- 172.21.15.7:0/575213081 >> v2:172.21.15.55:3300/0 conn(0x7f7d800ce2b0 0x7f7d800d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.973+0000 7f7d7effd640 1 -- 172.21.15.7:0/575213081 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1340492459 0 0) 0x7f7d800d1e80 con 0x7f7d800b53b0 2024-04-25T09:57:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.973+0000 7f7d7effd640 1 -- 172.21.15.7:0/575213081 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d68003520 con 0x7f7d800b53b0 2024-04-25T09:57:19.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.973+0000 7f7d7ffff640 1 --2- 172.21.15.7:0/575213081 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d8015db00 0x7f7d800d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:19.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.973+0000 7f7d7effd640 1 -- 172.21.15.7:0/575213081 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4292718968 0 0) 0x7f7d68003520 con 0x7f7d800b53b0 2024-04-25T09:57:19.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.973+0000 7f7d7effd640 1 -- 172.21.15.7:0/575213081 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d8015db00 msgr2=0x7f7d800d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:19.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.973+0000 7f7d7effd640 1 --2- 172.21.15.7:0/575213081 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d8015db00 0x7f7d800d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:19.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.973+0000 7f7d7effd640 1 -- 172.21.15.7:0/575213081 >> v2:172.21.15.55:3300/0 conn(0x7f7d800ce2b0 msgr2=0x7f7d800d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:19.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.973+0000 7f7d7effd640 1 --2- 172.21.15.7:0/575213081 >> v2:172.21.15.55:3300/0 conn(0x7f7d800ce2b0 0x7f7d800d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:19.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.973+0000 7f7d7effd640 1 -- 172.21.15.7:0/575213081 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d800b5ef0 con 0x7f7d800b53b0 2024-04-25T09:57:19.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.973+0000 7f7d7effd640 1 -- 172.21.15.7:0/575213081 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f7d74001670 con 0x7f7d800b53b0 2024-04-25T09:57:19.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.973+0000 7f7d7effd640 1 -- 172.21.15.7:0/575213081 >> v1:172.21.15.7:6789/0 conn(0x7f7d800b53b0 legacy=0x7f7d80161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:19.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.973+0000 7f7d7effd640 1 --2- 172.21.15.7:0/575213081 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d8015db00 0x7f7d680039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:19.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.973+0000 7f7d7effd640 1 --2- 172.21.15.7:0/575213081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d68003f30 0x7f7d68004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:19.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.973+0000 7f7d7effd640 1 --2- 172.21.15.7:0/575213081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d68004d40 0x7f7d680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:19.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.973+0000 7f7d7effd640 1 -- 172.21.15.7:0/575213081 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d800b5930 con 0x7f7d68004d40 2024-04-25T09:57:19.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.973+0000 7f7d7effd640 1 -- 172.21.15.7:0/575213081 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d800b5c10 con 0x7f7d68003f30 2024-04-25T09:57:19.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.973+0000 7f7d7effd640 1 -- 172.21.15.7:0/575213081 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6800b9c0 con 0x7f7d8015db00 2024-04-25T09:57:19.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.973+0000 7f7d848b8640 1 --2- 172.21.15.7:0/575213081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d68004d40 0x7f7d680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:19.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.973+0000 7f7d7ffff640 1 --2- 172.21.15.7:0/575213081 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d8015db00 0x7f7d680039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:19.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.973+0000 7f7d7f7fe640 1 --2- 172.21.15.7:0/575213081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d68003f30 0x7f7d68004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:19.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.973+0000 7f7d848b8640 1 -- 172.21.15.7:0/575213081 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d8015db00 msgr2=0x7f7d680039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:19.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.973+0000 7f7d848b8640 1 --2- 172.21.15.7:0/575213081 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d8015db00 0x7f7d680039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:19.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.973+0000 7f7d848b8640 1 -- 172.21.15.7:0/575213081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d68003f30 msgr2=0x7f7d68004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:19.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.973+0000 7f7d848b8640 1 --2- 172.21.15.7:0/575213081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d68003f30 0x7f7d68004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:19.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.973+0000 7f7d848b8640 1 -- 172.21.15.7:0/575213081 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d68003520 con 0x7f7d68004d40 2024-04-25T09:57:19.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.973+0000 7f7d7f7fe640 1 --2- 172.21.15.7:0/575213081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d68003f30 0x7f7d68004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:57:19.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.974+0000 7f7d848b8640 1 --2- 172.21.15.7:0/575213081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d68004d40 0x7f7d680051c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f7d78009fc0 tx=0x7f7d68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71fa36557c23325f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:19.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.974+0000 7f7d7effd640 1 -- 172.21.15.7:0/575213081 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d78009c10 con 0x7f7d68004d40 2024-04-25T09:57:19.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.974+0000 7f7d7effd640 1 -- 172.21.15.7:0/575213081 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d78036070 con 0x7f7d68004d40 2024-04-25T09:57:19.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.974+0000 7f7d7effd640 1 -- 172.21.15.7:0/575213081 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7802d070 con 0x7f7d68004d40 2024-04-25T09:57:19.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.975+0000 7f7d8631b640 1 -- 172.21.15.7:0/575213081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d68004d40 msgr2=0x7f7d680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:19.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.975+0000 7f7d8631b640 1 --2- 172.21.15.7:0/575213081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d68004d40 0x7f7d680051c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f7d78009fc0 tx=0x7f7d68005830 comp rx=0 tx=0).stop 2024-04-25T09:57:19.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.975+0000 7f7d848b8640 1 -- 172.21.15.7:0/575213081 reap_dead start 2024-04-25T09:57:19.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.975+0000 7f7d8631b640 1 -- 172.21.15.7:0/575213081 shutdown_connections 2024-04-25T09:57:19.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.975+0000 7f7d8631b640 1 -- 172.21.15.7:0/575213081 >> 172.21.15.7:0/575213081 conn(0x7f7d80072290 msgr2=0x7f7d800726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:19.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.975+0000 7f7d8631b640 1 -- 172.21.15.7:0/575213081 shutdown_connections 2024-04-25T09:57:19.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.975+0000 7f7d8631b640 1 -- 172.21.15.7:0/575213081 wait complete. 2024-04-25T09:57:19.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.976+0000 7f7d8631b640 1 Processor -- start 2024-04-25T09:57:19.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.976+0000 7f7d8631b640 1 -- start start 2024-04-25T09:57:19.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.977+0000 7f7d8631b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d68004d40 0x7f7d80160550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:19.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.977+0000 7f7d8631b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d80153770 0x7f7d80153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:19.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.977+0000 7f7d8631b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d80143c10 0x7f7d80144090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:19.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.977+0000 7f7d8631b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d800d3660 con 0x7f7d80153770 2024-04-25T09:57:19.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.977+0000 7f7d8631b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d800b61d0 con 0x7f7d80143c10 2024-04-25T09:57:19.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.977+0000 7f7d8631b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d800b6c10 con 0x7f7d68004d40 2024-04-25T09:57:19.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.977+0000 7f7d7f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d80153770 0x7f7d80153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:19.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.977+0000 7f7d7f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d80153770 0x7f7d80153bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50232/0 (socket says 172.21.15.7:50232) 2024-04-25T09:57:19.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.977+0000 7f7d7f7fe640 1 -- 172.21.15.7:0/3959421959 learned_addr learned my addr 172.21.15.7:0/3959421959 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:19.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.977+0000 7f7d7ffff640 1 --2- 172.21.15.7:0/3959421959 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d68004d40 0x7f7d80160550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:19.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.977+0000 7f7d848b8640 1 --2- 172.21.15.7:0/3959421959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d80143c10 0x7f7d80144090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:19.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.977+0000 7f7d7f7fe640 1 -- 172.21.15.7:0/3959421959 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d68004d40 msgr2=0x7f7d80160550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:19.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.977+0000 7f7d7f7fe640 1 --2- 172.21.15.7:0/3959421959 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d68004d40 0x7f7d80160550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:19.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.977+0000 7f7d7f7fe640 1 -- 172.21.15.7:0/3959421959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d80143c10 msgr2=0x7f7d80144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:19.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.977+0000 7f7d7f7fe640 1 --2- 172.21.15.7:0/3959421959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d80143c10 0x7f7d80144090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:19.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.977+0000 7f7d7f7fe640 1 -- 172.21.15.7:0/3959421959 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d80160a90 con 0x7f7d80153770 2024-04-25T09:57:19.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.977+0000 7f7d7ffff640 1 --2- 172.21.15.7:0/3959421959 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d68004d40 0x7f7d80160550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:57:19.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.977+0000 7f7d848b8640 1 --2- 172.21.15.7:0/3959421959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d80143c10 0x7f7d80144090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:57:19.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.978+0000 7f7d7f7fe640 1 --2- 172.21.15.7:0/3959421959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d80153770 0x7f7d80153bd0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f7d7400e840 tx=0x7f7d7400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:19.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.978+0000 7f7d7cff9640 1 -- 172.21.15.7:0/3959421959 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7400c870 con 0x7f7d80153770 2024-04-25T09:57:19.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.978+0000 7f7d7cff9640 1 -- 172.21.15.7:0/3959421959 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d74018070 con 0x7f7d80153770 2024-04-25T09:57:19.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.978+0000 7f7d8631b640 1 -- 172.21.15.7:0/3959421959 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d8015f4b0 con 0x7f7d80153770 2024-04-25T09:57:19.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.978+0000 7f7d7cff9640 1 -- 172.21.15.7:0/3959421959 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7400cc50 con 0x7f7d80153770 2024-04-25T09:57:19.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.978+0000 7f7d8631b640 1 -- 172.21.15.7:0/3959421959 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d8015fa70 con 0x7f7d80153770 2024-04-25T09:57:19.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.979+0000 7f7d8631b640 1 -- 172.21.15.7:0/3959421959 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d80068fd0 con 0x7f7d80153770 2024-04-25T09:57:19.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.979+0000 7f7d7cff9640 1 -- 172.21.15.7:0/3959421959 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7d74013420 con 0x7f7d80153770 2024-04-25T09:57:19.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.980+0000 7f7d7cff9640 1 --2- 172.21.15.7:0/3959421959 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7d6c06b500 0x7f7d6c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:19.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.980+0000 7f7d7cff9640 1 -- 172.21.15.7:0/3959421959 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7d7408a060 con 0x7f7d80153770 2024-04-25T09:57:19.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.980+0000 7f7d7ffff640 1 --2- 172.21.15.7:0/3959421959 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7d6c06b500 0x7f7d6c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:19.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.980+0000 7f7d7ffff640 1 --2- 172.21.15.7:0/3959421959 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7d6c06b500 0x7f7d6c06d9c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7d70009ab0 tx=0x7f7d70008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:19.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:19.984+0000 7f7d7cff9640 1 -- 172.21.15.7:0/3959421959 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7d74058670 con 0x7f7d80153770 2024-04-25T09:57:20.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:20.162+0000 7f7d8631b640 1 -- 172.21.15.7:0/3959421959 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7d800d16b0 con 0x7f7d6c06b500 2024-04-25T09:57:20.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:20.168+0000 7f7d7cff9640 1 -- 172.21.15.7:0/3959421959 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250066 (secure 0 0 0) 0x7f7d800d16b0 con 0x7f7d6c06b500 2024-04-25T09:57:20.175 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:57:20.176 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T09:57:20.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:20.171+0000 7f7d8631b640 1 -- 172.21.15.7:0/3959421959 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7d6c06b500 msgr2=0x7f7d6c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:20.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:20.171+0000 7f7d8631b640 1 --2- 172.21.15.7:0/3959421959 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7d6c06b500 0x7f7d6c06d9c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7d70009ab0 tx=0x7f7d70008040 comp rx=0 tx=0).stop 2024-04-25T09:57:20.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:20.171+0000 7f7d8631b640 1 -- 172.21.15.7:0/3959421959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d80153770 msgr2=0x7f7d80153bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:20.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:20.171+0000 7f7d8631b640 1 --2- 172.21.15.7:0/3959421959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d80153770 0x7f7d80153bd0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f7d7400e840 tx=0x7f7d7400ed00 comp rx=0 tx=0).stop 2024-04-25T09:57:20.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:20.171+0000 7f7d8631b640 1 -- 172.21.15.7:0/3959421959 shutdown_connections 2024-04-25T09:57:20.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:20.171+0000 7f7d8631b640 1 --2- 172.21.15.7:0/3959421959 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7d6c06b500 0x7f7d6c06d9c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:20.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:20.171+0000 7f7d8631b640 1 --2- 172.21.15.7:0/3959421959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d80143c10 0x7f7d80144090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:20.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:20.171+0000 7f7d8631b640 1 --2- 172.21.15.7:0/3959421959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d80153770 0x7f7d80153bd0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:20.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:20.171+0000 7f7d8631b640 1 --2- 172.21.15.7:0/3959421959 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d68004d40 0x7f7d80160550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:20.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:20.171+0000 7f7d8631b640 1 -- 172.21.15.7:0/3959421959 >> 172.21.15.7:0/3959421959 conn(0x7f7d80072290 msgr2=0x7f7d800b6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:20.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:20.171+0000 7f7d8631b640 1 -- 172.21.15.7:0/3959421959 shutdown_connections 2024-04-25T09:57:20.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:20.171+0000 7f7d8631b640 1 -- 172.21.15.7:0/3959421959 wait complete. 2024-04-25T09:57:20.186 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2024-04-25T09:57:19.890639+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590584,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":186,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256224,"kb_used_data":6760,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718496,"statfs":{"total":773094113280,"available":772831739904,"internally_reserved":0,"allocated":6922240,"data_stored":3724769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":216,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000870"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.739601+0000","last_change":"2024-04-25T09:57:14.739601+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.739601+0000","last_undegraded":"2024-04-25T09:57:14.739601+0000","last_fullsized":"2024-04-25T09:57:14.739601+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.736881+0000","last_change":"2024-04-25T09:57:14.736881+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.736881+0000","last_undegraded":"2024-04-25T09:57:14.736881+0000","last_fullsized":"2024-04-25T09:57:14.736881+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.771130+0000","last_change":"2024-04-25T09:57:15.768429+0000","last_active":"2024-04-25T09:57:15.771130+0000","last_peered":"2024-04-25T09:57:15.771130+0000","last_clean":"2024-04-25T09:57:15.771130+0000","last_became_active":"2024-04-25T09:57:15.767779+0000","last_became_peered":"2024-04-25T09:57:15.767779+0000","last_unstale":"2024-04-25T09:57:15.771130+0000","last_undegraded":"2024-04-25T09:57:15.771130+0000","last_fullsized":"2024-04-25T09:57:15.771130+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:43.170600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.749077+0000","last_change":"2024-04-25T09:57:15.743074+0000","last_active":"2024-04-25T09:57:15.749077+0000","last_peered":"2024-04-25T09:57:15.749077+0000","last_clean":"2024-04-25T09:57:15.749077+0000","last_became_active":"2024-04-25T09:57:15.742690+0000","last_became_peered":"2024-04-25T09:57:15.742690+0000","last_unstale":"2024-04-25T09:57:15.749077+0000","last_undegraded":"2024-04-25T09:57:15.749077+0000","last_fullsized":"2024-04-25T09:57:15.749077+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:16.623083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.756450+0000","last_change":"2024-04-25T09:57:15.753362+0000","last_active":"2024-04-25T09:57:15.756450+0000","last_peered":"2024-04-25T09:57:15.756450+0000","last_clean":"2024-04-25T09:57:15.756450+0000","last_became_active":"2024-04-25T09:57:15.752402+0000","last_became_peered":"2024-04-25T09:57:15.752402+0000","last_unstale":"2024-04-25T09:57:15.756450+0000","last_undegraded":"2024-04-25T09:57:15.756450+0000","last_fullsized":"2024-04-25T09:57:15.756450+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:05:54.427158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.740479+0000","last_change":"2024-04-25T09:57:14.740479+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.740479+0000","last_undegraded":"2024-04-25T09:57:14.740479+0000","last_fullsized":"2024-04-25T09:57:14.740479+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.735324+0000","last_change":"2024-04-25T09:57:14.735324+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.735324+0000","last_undegraded":"2024-04-25T09:57:14.735324+0000","last_fullsized":"2024-04-25T09:57:14.735324+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.765280+0000","last_change":"2024-04-25T09:57:15.764308+0000","last_active":"2024-04-25T09:57:15.765280+0000","last_peered":"2024-04-25T09:57:15.765280+0000","last_clean":"2024-04-25T09:57:15.765280+0000","last_became_active":"2024-04-25T09:57:15.763987+0000","last_became_peered":"2024-04-25T09:57:15.763987+0000","last_unstale":"2024-04-25T09:57:15.765280+0000","last_undegraded":"2024-04-25T09:57:15.765280+0000","last_fullsized":"2024-04-25T09:57:15.765280+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:38.035777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.771009+0000","last_change":"2024-04-25T09:57:15.768645+0000","last_active":"2024-04-25T09:57:15.771009+0000","last_peered":"2024-04-25T09:57:15.771009+0000","last_clean":"2024-04-25T09:57:15.771009+0000","last_became_active":"2024-04-25T09:57:15.768313+0000","last_became_peered":"2024-04-25T09:57:15.768313+0000","last_unstale":"2024-04-25T09:57:15.771009+0000","last_undegraded":"2024-04-25T09:57:15.771009+0000","last_fullsized":"2024-04-25T09:57:15.771009+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:38.035777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.768078+0000","last_change":"2024-04-25T09:57:15.765383+0000","last_active":"2024-04-25T09:57:15.768078+0000","last_peered":"2024-04-25T09:57:15.768078+0000","last_clean":"2024-04-25T09:57:15.768078+0000","last_became_active":"2024-04-25T09:57:15.763424+0000","last_became_peered":"2024-04-25T09:57:15.763424+0000","last_unstale":"2024-04-25T09:57:15.768078+0000","last_undegraded":"2024-04-25T09:57:15.768078+0000","last_fullsized":"2024-04-25T09:57:15.768078+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:56.030922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.763391+0000","last_change":"2024-04-25T09:57:15.755081+0000","last_active":"2024-04-25T09:57:15.763391+0000","last_peered":"2024-04-25T09:57:15.763391+0000","last_clean":"2024-04-25T09:57:15.763391+0000","last_became_active":"2024-04-25T09:57:15.754758+0000","last_became_peered":"2024-04-25T09:57:15.754758+0000","last_unstale":"2024-04-25T09:57:15.763391+0000","last_undegraded":"2024-04-25T09:57:15.763391+0000","last_fullsized":"2024-04-25T09:57:15.763391+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:51.634061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.768719+0000","last_change":"2024-04-25T09:57:15.767461+0000","last_active":"2024-04-25T09:57:15.768719+0000","last_peered":"2024-04-25T09:57:15.768719+0000","last_clean":"2024-04-25T09:57:15.768719+0000","last_became_active":"2024-04-25T09:57:15.767159+0000","last_became_peered":"2024-04-25T09:57:15.767159+0000","last_unstale":"2024-04-25T09:57:15.768719+0000","last_undegraded":"2024-04-25T09:57:15.768719+0000","last_fullsized":"2024-04-25T09:57:15.768719+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:43.170600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759834+0000","last_change":"2024-04-25T09:57:15.753129+0000","last_active":"2024-04-25T09:57:15.759834+0000","last_peered":"2024-04-25T09:57:15.759834+0000","last_clean":"2024-04-25T09:57:15.759834+0000","last_became_active":"2024-04-25T09:57:15.752135+0000","last_became_peered":"2024-04-25T09:57:15.752135+0000","last_unstale":"2024-04-25T09:57:15.759834+0000","last_undegraded":"2024-04-25T09:57:15.759834+0000","last_fullsized":"2024-04-25T09:57:15.759834+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:06:48.607407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.769297+0000","last_change":"2024-04-25T09:57:15.765918+0000","last_active":"2024-04-25T09:57:15.769297+0000","last_peered":"2024-04-25T09:57:15.769297+0000","last_clean":"2024-04-25T09:57:15.769297+0000","last_became_active":"2024-04-25T09:57:15.765586+0000","last_became_peered":"2024-04-25T09:57:15.765586+0000","last_unstale":"2024-04-25T09:57:15.769297+0000","last_undegraded":"2024-04-25T09:57:15.769297+0000","last_fullsized":"2024-04-25T09:57:15.769297+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:36.249678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.769126+0000","last_change":"2024-04-25T09:57:15.765729+0000","last_active":"2024-04-25T09:57:15.769126+0000","last_peered":"2024-04-25T09:57:15.769126+0000","last_clean":"2024-04-25T09:57:15.769126+0000","last_became_active":"2024-04-25T09:57:15.763401+0000","last_became_peered":"2024-04-25T09:57:15.763401+0000","last_unstale":"2024-04-25T09:57:15.769126+0000","last_undegraded":"2024-04-25T09:57:15.769126+0000","last_fullsized":"2024-04-25T09:57:15.769126+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:06:48.607407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.736209+0000","last_change":"2024-04-25T09:57:14.736209+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.736209+0000","last_undegraded":"2024-04-25T09:57:14.736209+0000","last_fullsized":"2024-04-25T09:57:14.736209+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.739137+0000","last_change":"2024-04-25T09:57:14.739137+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.739137+0000","last_undegraded":"2024-04-25T09:57:14.739137+0000","last_fullsized":"2024-04-25T09:57:14.739137+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.765663+0000","last_change":"2024-04-25T09:57:15.763231+0000","last_active":"2024-04-25T09:57:15.765663+0000","last_peered":"2024-04-25T09:57:15.765663+0000","last_clean":"2024-04-25T09:57:15.765663+0000","last_became_active":"2024-04-25T09:57:15.761219+0000","last_became_peered":"2024-04-25T09:57:15.761219+0000","last_unstale":"2024-04-25T09:57:15.765663+0000","last_undegraded":"2024-04-25T09:57:15.765663+0000","last_fullsized":"2024-04-25T09:57:15.765663+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:26.061064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.756512+0000","last_change":"2024-04-25T09:57:15.749906+0000","last_active":"2024-04-25T09:57:15.756512+0000","last_peered":"2024-04-25T09:57:15.756512+0000","last_clean":"2024-04-25T09:57:15.756512+0000","last_became_active":"2024-04-25T09:57:15.749556+0000","last_became_peered":"2024-04-25T09:57:15.749556+0000","last_unstale":"2024-04-25T09:57:15.756512+0000","last_undegraded":"2024-04-25T09:57:15.756512+0000","last_fullsized":"2024-04-25T09:57:15.756512+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:56.132114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.738072+0000","last_change":"2024-04-25T09:57:14.738072+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.738072+0000","last_undegraded":"2024-04-25T09:57:14.738072+0000","last_fullsized":"2024-04-25T09:57:14.738072+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759858+0000","last_change":"2024-04-25T09:57:15.756136+0000","last_active":"2024-04-25T09:57:15.759858+0000","last_peered":"2024-04-25T09:57:15.759858+0000","last_clean":"2024-04-25T09:57:15.759858+0000","last_became_active":"2024-04-25T09:57:15.755865+0000","last_became_peered":"2024-04-25T09:57:15.755865+0000","last_unstale":"2024-04-25T09:57:15.759858+0000","last_undegraded":"2024-04-25T09:57:15.759858+0000","last_fullsized":"2024-04-25T09:57:15.759858+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:47.721018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.735616+0000","last_change":"2024-04-25T09:57:14.735616+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.735616+0000","last_undegraded":"2024-04-25T09:57:14.735616+0000","last_fullsized":"2024-04-25T09:57:14.735616+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.735588+0000","last_change":"2024-04-25T09:57:14.735588+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.735588+0000","last_undegraded":"2024-04-25T09:57:14.735588+0000","last_fullsized":"2024-04-25T09:57:14.735588+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.769820+0000","last_change":"2024-04-25T09:57:15.766342+0000","last_active":"2024-04-25T09:57:15.769820+0000","last_peered":"2024-04-25T09:57:15.769820+0000","last_clean":"2024-04-25T09:57:15.769820+0000","last_became_active":"2024-04-25T09:57:15.766060+0000","last_became_peered":"2024-04-25T09:57:15.766060+0000","last_unstale":"2024-04-25T09:57:15.769820+0000","last_undegraded":"2024-04-25T09:57:15.769820+0000","last_fullsized":"2024-04-25T09:57:15.769820+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:57:22.599880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759309+0000","last_change":"2024-04-25T09:57:15.752044+0000","last_active":"2024-04-25T09:57:15.759309+0000","last_peered":"2024-04-25T09:57:15.759309+0000","last_clean":"2024-04-25T09:57:15.759309+0000","last_became_active":"2024-04-25T09:57:15.751759+0000","last_became_peered":"2024-04-25T09:57:15.751759+0000","last_unstale":"2024-04-25T09:57:15.759309+0000","last_undegraded":"2024-04-25T09:57:15.759309+0000","last_fullsized":"2024-04-25T09:57:15.759309+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:57:22.599880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759418+0000","last_change":"2024-04-25T09:57:15.751032+0000","last_active":"2024-04-25T09:57:15.759418+0000","last_peered":"2024-04-25T09:57:15.759418+0000","last_clean":"2024-04-25T09:57:15.759418+0000","last_became_active":"2024-04-25T09:57:15.750731+0000","last_became_peered":"2024-04-25T09:57:15.750731+0000","last_unstale":"2024-04-25T09:57:15.759418+0000","last_undegraded":"2024-04-25T09:57:15.759418+0000","last_fullsized":"2024-04-25T09:57:15.759418+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:13.286010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.755315+0000","last_change":"2024-04-25T09:57:15.752419+0000","last_active":"2024-04-25T09:57:15.755315+0000","last_peered":"2024-04-25T09:57:15.755315+0000","last_clean":"2024-04-25T09:57:15.755315+0000","last_became_active":"2024-04-25T09:57:15.752123+0000","last_became_peered":"2024-04-25T09:57:15.752123+0000","last_unstale":"2024-04-25T09:57:15.755315+0000","last_undegraded":"2024-04-25T09:57:15.755315+0000","last_fullsized":"2024-04-25T09:57:15.755315+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:03.777858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.740242+0000","last_change":"2024-04-25T09:57:14.740242+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.740242+0000","last_undegraded":"2024-04-25T09:57:14.740242+0000","last_fullsized":"2024-04-25T09:57:14.740242+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.771070+0000","last_change":"2024-04-25T09:57:15.769491+0000","last_active":"2024-04-25T09:57:15.771070+0000","last_peered":"2024-04-25T09:57:15.771070+0000","last_clean":"2024-04-25T09:57:15.771070+0000","last_became_active":"2024-04-25T09:57:15.768694+0000","last_became_peered":"2024-04-25T09:57:15.768694+0000","last_unstale":"2024-04-25T09:57:15.771070+0000","last_undegraded":"2024-04-25T09:57:15.771070+0000","last_fullsized":"2024-04-25T09:57:15.771070+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:08.997796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.767994+0000","last_change":"2024-04-25T09:57:15.767087+0000","last_active":"2024-04-25T09:57:15.767994+0000","last_peered":"2024-04-25T09:57:15.767994+0000","last_clean":"2024-04-25T09:57:15.767994+0000","last_became_active":"2024-04-25T09:57:15.766747+0000","last_became_peered":"2024-04-25T09:57:15.766747+0000","last_unstale":"2024-04-25T09:57:15.767994+0000","last_undegraded":"2024-04-25T09:57:15.767994+0000","last_fullsized":"2024-04-25T09:57:15.767994+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:35.319064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.749807+0000","last_change":"2024-04-25T09:57:15.745892+0000","last_active":"2024-04-25T09:57:15.749807+0000","last_peered":"2024-04-25T09:57:15.749807+0000","last_clean":"2024-04-25T09:57:15.749807+0000","last_became_active":"2024-04-25T09:57:15.745553+0000","last_became_peered":"2024-04-25T09:57:15.745553+0000","last_unstale":"2024-04-25T09:57:15.749807+0000","last_undegraded":"2024-04-25T09:57:15.749807+0000","last_fullsized":"2024-04-25T09:57:15.749807+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:21:58.966692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.739933+0000","last_change":"2024-04-25T09:57:14.739933+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.739933+0000","last_undegraded":"2024-04-25T09:57:14.739933+0000","last_fullsized":"2024-04-25T09:57:14.739933+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.757016+0000","last_change":"2024-04-25T09:57:15.754290+0000","last_active":"2024-04-25T09:57:15.757016+0000","last_peered":"2024-04-25T09:57:15.757016+0000","last_clean":"2024-04-25T09:57:15.757016+0000","last_became_active":"2024-04-25T09:57:15.753872+0000","last_became_peered":"2024-04-25T09:57:15.753872+0000","last_unstale":"2024-04-25T09:57:15.757016+0000","last_undegraded":"2024-04-25T09:57:15.757016+0000","last_fullsized":"2024-04-25T09:57:15.757016+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:26.061064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.758719+0000","last_change":"2024-04-25T09:57:14.758285+0000","last_active":"2024-04-25T09:57:14.758719+0000","last_peered":"2024-04-25T09:57:14.758719+0000","last_clean":"2024-04-25T09:57:14.758719+0000","last_became_active":"2024-04-25T09:57:14.757995+0000","last_became_peered":"2024-04-25T09:57:14.757995+0000","last_unstale":"2024-04-25T09:57:14.758719+0000","last_undegraded":"2024-04-25T09:57:14.758719+0000","last_fullsized":"2024-04-25T09:57:14.758719+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:01:30.387519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.766480+0000","last_change":"2024-04-25T09:57:15.762946+0000","last_active":"2024-04-25T09:57:15.766480+0000","last_peered":"2024-04-25T09:57:15.766480+0000","last_clean":"2024-04-25T09:57:15.766480+0000","last_became_active":"2024-04-25T09:57:15.761468+0000","last_became_peered":"2024-04-25T09:57:15.761468+0000","last_unstale":"2024-04-25T09:57:15.766480+0000","last_undegraded":"2024-04-25T09:57:15.766480+0000","last_fullsized":"2024-04-25T09:57:15.766480+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:05:54.427158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.750269+0000","last_change":"2024-04-25T09:57:14.747757+0000","last_active":"2024-04-25T09:57:14.750269+0000","last_peered":"2024-04-25T09:57:14.750269+0000","last_clean":"2024-04-25T09:57:14.750269+0000","last_became_active":"2024-04-25T09:57:14.747474+0000","last_became_peered":"2024-04-25T09:57:14.747474+0000","last_unstale":"2024-04-25T09:57:14.750269+0000","last_undegraded":"2024-04-25T09:57:14.750269+0000","last_fullsized":"2024-04-25T09:57:14.750269+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:57.049874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.738966+0000","last_change":"2024-04-25T09:57:14.738966+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.738966+0000","last_undegraded":"2024-04-25T09:57:14.738966+0000","last_fullsized":"2024-04-25T09:57:14.738966+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.750397+0000","last_change":"2024-04-25T09:57:14.746173+0000","last_active":"2024-04-25T09:57:14.750397+0000","last_peered":"2024-04-25T09:57:14.750397+0000","last_clean":"2024-04-25T09:57:14.750397+0000","last_became_active":"2024-04-25T09:57:14.744978+0000","last_became_peered":"2024-04-25T09:57:14.744978+0000","last_unstale":"2024-04-25T09:57:14.750397+0000","last_undegraded":"2024-04-25T09:57:14.750397+0000","last_fullsized":"2024-04-25T09:57:14.750397+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:26.411491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.771033+0000","last_change":"2024-04-25T09:57:15.768921+0000","last_active":"2024-04-25T09:57:15.771033+0000","last_peered":"2024-04-25T09:57:15.771033+0000","last_clean":"2024-04-25T09:57:15.771033+0000","last_became_active":"2024-04-25T09:57:15.768327+0000","last_became_peered":"2024-04-25T09:57:15.768327+0000","last_unstale":"2024-04-25T09:57:15.771033+0000","last_undegraded":"2024-04-25T09:57:15.771033+0000","last_fullsized":"2024-04-25T09:57:15.771033+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:35.319064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.751369+0000","last_change":"2024-04-25T09:57:14.750473+0000","last_active":"2024-04-25T09:57:14.751369+0000","last_peered":"2024-04-25T09:57:14.751369+0000","last_clean":"2024-04-25T09:57:14.751369+0000","last_became_active":"2024-04-25T09:57:14.750124+0000","last_became_peered":"2024-04-25T09:57:14.750124+0000","last_unstale":"2024-04-25T09:57:14.751369+0000","last_undegraded":"2024-04-25T09:57:14.751369+0000","last_fullsized":"2024-04-25T09:57:14.751369+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:04:07.820129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.735799+0000","last_change":"2024-04-25T09:57:14.735799+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.735799+0000","last_undegraded":"2024-04-25T09:57:14.735799+0000","last_fullsized":"2024-04-25T09:57:14.735799+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.747504+0000","last_change":"2024-04-25T09:57:14.744916+0000","last_active":"2024-04-25T09:57:14.747504+0000","last_peered":"2024-04-25T09:57:14.747504+0000","last_clean":"2024-04-25T09:57:14.747504+0000","last_became_active":"2024-04-25T09:57:14.744384+0000","last_became_peered":"2024-04-25T09:57:14.744384+0000","last_unstale":"2024-04-25T09:57:14.747504+0000","last_undegraded":"2024-04-25T09:57:14.747504+0000","last_fullsized":"2024-04-25T09:57:14.747504+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:36.216367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.738167+0000","last_change":"2024-04-25T09:57:14.738167+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.738167+0000","last_undegraded":"2024-04-25T09:57:14.738167+0000","last_fullsized":"2024-04-25T09:57:14.738167+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.746032+0000","last_change":"2024-04-25T09:57:14.742815+0000","last_active":"2024-04-25T09:57:14.746032+0000","last_peered":"2024-04-25T09:57:14.746032+0000","last_clean":"2024-04-25T09:57:14.746032+0000","last_became_active":"2024-04-25T09:57:14.742518+0000","last_became_peered":"2024-04-25T09:57:14.742518+0000","last_unstale":"2024-04-25T09:57:14.746032+0000","last_undegraded":"2024-04-25T09:57:14.746032+0000","last_fullsized":"2024-04-25T09:57:14.746032+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:34.316720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759262+0000","last_change":"2024-04-25T09:57:15.756573+0000","last_active":"2024-04-25T09:57:15.759262+0000","last_peered":"2024-04-25T09:57:15.759262+0000","last_clean":"2024-04-25T09:57:15.759262+0000","last_became_active":"2024-04-25T09:57:15.755701+0000","last_became_peered":"2024-04-25T09:57:15.755701+0000","last_unstale":"2024-04-25T09:57:15.759262+0000","last_undegraded":"2024-04-25T09:57:15.759262+0000","last_fullsized":"2024-04-25T09:57:15.759262+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:11.276834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.747563+0000","last_change":"2024-04-25T09:57:14.746062+0000","last_active":"2024-04-25T09:57:14.747563+0000","last_peered":"2024-04-25T09:57:14.747563+0000","last_clean":"2024-04-25T09:57:14.747563+0000","last_became_active":"2024-04-25T09:57:14.745664+0000","last_became_peered":"2024-04-25T09:57:14.745664+0000","last_unstale":"2024-04-25T09:57:14.747563+0000","last_undegraded":"2024-04-25T09:57:14.747563+0000","last_fullsized":"2024-04-25T09:57:14.747563+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:57.049874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.734950+0000","last_change":"2024-04-25T09:57:14.734950+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.734950+0000","last_undegraded":"2024-04-25T09:57:14.734950+0000","last_fullsized":"2024-04-25T09:57:14.734950+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.740713+0000","last_change":"2024-04-25T09:57:14.752874+0000","last_active":"2024-04-25T09:57:15.740713+0000","last_peered":"2024-04-25T09:57:15.740713+0000","last_clean":"2024-04-25T09:57:15.740713+0000","last_became_active":"2024-04-25T09:57:14.752542+0000","last_became_peered":"2024-04-25T09:57:14.752542+0000","last_unstale":"2024-04-25T09:57:15.740713+0000","last_undegraded":"2024-04-25T09:57:15.740713+0000","last_fullsized":"2024-04-25T09:57:15.740713+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:50.631716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.738121+0000","last_change":"2024-04-25T09:57:14.738121+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.738121+0000","last_undegraded":"2024-04-25T09:57:14.738121+0000","last_fullsized":"2024-04-25T09:57:14.738121+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.758067+0000","last_change":"2024-04-25T09:57:14.758286+0000","last_active":"2024-04-25T09:57:15.758067+0000","last_peered":"2024-04-25T09:57:15.758067+0000","last_clean":"2024-04-25T09:57:15.758067+0000","last_became_active":"2024-04-25T09:57:14.757885+0000","last_became_peered":"2024-04-25T09:57:14.757885+0000","last_unstale":"2024-04-25T09:57:15.758067+0000","last_undegraded":"2024-04-25T09:57:15.758067+0000","last_fullsized":"2024-04-25T09:57:15.758067+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:47.050365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.735099+0000","last_change":"2024-04-25T09:57:14.735099+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.735099+0000","last_undegraded":"2024-04-25T09:57:14.735099+0000","last_fullsized":"2024-04-25T09:57:14.735099+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.742873+0000","last_change":"2024-04-25T09:57:14.744998+0000","last_active":"2024-04-25T09:57:15.742873+0000","last_peered":"2024-04-25T09:57:15.742873+0000","last_clean":"2024-04-25T09:57:15.742873+0000","last_became_active":"2024-04-25T09:57:14.744717+0000","last_became_peered":"2024-04-25T09:57:14.744717+0000","last_unstale":"2024-04-25T09:57:15.742873+0000","last_undegraded":"2024-04-25T09:57:15.742873+0000","last_fullsized":"2024-04-25T09:57:15.742873+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:44.683150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.761689+0000","last_change":"2024-04-25T09:57:15.758927+0000","last_active":"2024-04-25T09:57:15.761689+0000","last_peered":"2024-04-25T09:57:15.761689+0000","last_clean":"2024-04-25T09:57:15.761689+0000","last_became_active":"2024-04-25T09:57:15.758613+0000","last_became_peered":"2024-04-25T09:57:15.758613+0000","last_unstale":"2024-04-25T09:57:15.761689+0000","last_undegraded":"2024-04-25T09:57:15.761689+0000","last_fullsized":"2024-04-25T09:57:15.761689+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:22.009595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"61'3","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.771456+0000","last_change":"2024-04-25T09:57:14.758891+0000","last_active":"2024-04-25T09:57:15.771456+0000","last_peered":"2024-04-25T09:57:15.771456+0000","last_clean":"2024-04-25T09:57:15.771456+0000","last_became_active":"2024-04-25T09:57:14.757957+0000","last_became_peered":"2024-04-25T09:57:14.757957+0000","last_unstale":"2024-04-25T09:57:15.771456+0000","last_undegraded":"2024-04-25T09:57:15.771456+0000","last_fullsized":"2024-04-25T09:57:15.771456+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:51.436833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.763214+0000","last_change":"2024-04-25T09:57:15.755461+0000","last_active":"2024-04-25T09:57:15.763214+0000","last_peered":"2024-04-25T09:57:15.763214+0000","last_clean":"2024-04-25T09:57:15.763214+0000","last_became_active":"2024-04-25T09:57:15.755099+0000","last_became_peered":"2024-04-25T09:57:15.755099+0000","last_unstale":"2024-04-25T09:57:15.763214+0000","last_undegraded":"2024-04-25T09:57:15.763214+0000","last_fullsized":"2024-04-25T09:57:15.763214+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:56.132114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.749740+0000","last_change":"2024-04-25T09:57:14.748332+0000","last_active":"2024-04-25T09:57:14.749740+0000","last_peered":"2024-04-25T09:57:14.749740+0000","last_clean":"2024-04-25T09:57:14.749740+0000","last_became_active":"2024-04-25T09:57:14.747993+0000","last_became_peered":"2024-04-25T09:57:14.747993+0000","last_unstale":"2024-04-25T09:57:14.749740+0000","last_undegraded":"2024-04-25T09:57:14.749740+0000","last_fullsized":"2024-04-25T09:57:14.749740+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:19.567964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.768739+0000","last_change":"2024-04-25T09:57:15.766168+0000","last_active":"2024-04-25T09:57:15.768739+0000","last_peered":"2024-04-25T09:57:15.768739+0000","last_clean":"2024-04-25T09:57:15.768739+0000","last_became_active":"2024-04-25T09:57:15.764964+0000","last_became_peered":"2024-04-25T09:57:15.764964+0000","last_unstale":"2024-04-25T09:57:15.768739+0000","last_undegraded":"2024-04-25T09:57:15.768739+0000","last_fullsized":"2024-04-25T09:57:15.768739+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:05.715956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.765921+0000","last_change":"2024-04-25T09:57:14.758611+0000","last_active":"2024-04-25T09:57:15.765921+0000","last_peered":"2024-04-25T09:57:15.765921+0000","last_clean":"2024-04-25T09:57:15.765921+0000","last_became_active":"2024-04-25T09:57:14.757880+0000","last_became_peered":"2024-04-25T09:57:14.757880+0000","last_unstale":"2024-04-25T09:57:15.765921+0000","last_undegraded":"2024-04-25T09:57:15.765921+0000","last_fullsized":"2024-04-25T09:57:15.765921+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:42.586862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.758828+0000","last_change":"2024-04-25T09:57:15.751535+0000","last_active":"2024-04-25T09:57:15.758828+0000","last_peered":"2024-04-25T09:57:15.758828+0000","last_clean":"2024-04-25T09:57:15.758828+0000","last_became_active":"2024-04-25T09:57:15.751257+0000","last_became_peered":"2024-04-25T09:57:15.751257+0000","last_unstale":"2024-04-25T09:57:15.758828+0000","last_undegraded":"2024-04-25T09:57:15.758828+0000","last_fullsized":"2024-04-25T09:57:15.758828+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:56.030922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.739411+0000","last_change":"2024-04-25T09:57:14.750136+0000","last_active":"2024-04-25T09:57:15.739411+0000","last_peered":"2024-04-25T09:57:15.739411+0000","last_clean":"2024-04-25T09:57:15.739411+0000","last_became_active":"2024-04-25T09:57:14.749841+0000","last_became_peered":"2024-04-25T09:57:14.749841+0000","last_unstale":"2024-04-25T09:57:15.739411+0000","last_undegraded":"2024-04-25T09:57:15.739411+0000","last_fullsized":"2024-04-25T09:57:15.739411+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:47.050365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759245+0000","last_change":"2024-04-25T09:57:15.756190+0000","last_active":"2024-04-25T09:57:15.759245+0000","last_peered":"2024-04-25T09:57:15.759245+0000","last_clean":"2024-04-25T09:57:15.759245+0000","last_became_active":"2024-04-25T09:57:15.755333+0000","last_became_peered":"2024-04-25T09:57:15.755333+0000","last_unstale":"2024-04-25T09:57:15.759245+0000","last_undegraded":"2024-04-25T09:57:15.759245+0000","last_fullsized":"2024-04-25T09:57:15.759245+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:43.991599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.756105+0000","last_change":"2024-04-25T09:57:14.758679+0000","last_active":"2024-04-25T09:57:15.756105+0000","last_peered":"2024-04-25T09:57:15.756105+0000","last_clean":"2024-04-25T09:57:15.756105+0000","last_became_active":"2024-04-25T09:57:14.758320+0000","last_became_peered":"2024-04-25T09:57:14.758320+0000","last_unstale":"2024-04-25T09:57:15.756105+0000","last_undegraded":"2024-04-25T09:57:15.756105+0000","last_fullsized":"2024-04-25T09:57:15.756105+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:25.679262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.737498+0000","last_change":"2024-04-25T09:57:14.737498+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.737498+0000","last_undegraded":"2024-04-25T09:57:14.737498+0000","last_fullsized":"2024-04-25T09:57:14.737498+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"61'8","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.769776+0000","last_change":"2024-04-25T09:57:14.749907+0000","last_active":"2024-04-25T09:57:15.769776+0000","last_peered":"2024-04-25T09:57:15.769776+0000","last_clean":"2024-04-25T09:57:15.769776+0000","last_became_active":"2024-04-25T09:57:14.748686+0000","last_became_peered":"2024-04-25T09:57:14.748686+0000","last_unstale":"2024-04-25T09:57:15.769776+0000","last_undegraded":"2024-04-25T09:57:15.769776+0000","last_fullsized":"2024-04-25T09:57:15.769776+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:26:09.170713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.769946+0000","last_change":"2024-04-25T09:57:15.767545+0000","last_active":"2024-04-25T09:57:15.769946+0000","last_peered":"2024-04-25T09:57:15.769946+0000","last_clean":"2024-04-25T09:57:15.769946+0000","last_became_active":"2024-04-25T09:57:15.767252+0000","last_became_peered":"2024-04-25T09:57:15.767252+0000","last_unstale":"2024-04-25T09:57:15.769946+0000","last_undegraded":"2024-04-25T09:57:15.769946+0000","last_fullsized":"2024-04-25T09:57:15.769946+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:47.721018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759249+0000","last_change":"2024-04-25T09:57:14.749754+0000","last_active":"2024-04-25T09:57:15.759249+0000","last_peered":"2024-04-25T09:57:15.759249+0000","last_clean":"2024-04-25T09:57:15.759249+0000","last_became_active":"2024-04-25T09:57:14.749258+0000","last_became_peered":"2024-04-25T09:57:14.749258+0000","last_unstale":"2024-04-25T09:57:15.759249+0000","last_undegraded":"2024-04-25T09:57:15.759249+0000","last_fullsized":"2024-04-25T09:57:15.759249+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:25.679262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.756532+0000","last_change":"2024-04-25T09:57:15.751259+0000","last_active":"2024-04-25T09:57:15.756532+0000","last_peered":"2024-04-25T09:57:15.756532+0000","last_clean":"2024-04-25T09:57:15.756532+0000","last_became_active":"2024-04-25T09:57:15.750979+0000","last_became_peered":"2024-04-25T09:57:15.750979+0000","last_unstale":"2024-04-25T09:57:15.756532+0000","last_undegraded":"2024-04-25T09:57:15.756532+0000","last_fullsized":"2024-04-25T09:57:15.756532+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:45.975880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.766274+0000","last_change":"2024-04-25T09:57:14.758286+0000","last_active":"2024-04-25T09:57:15.766274+0000","last_peered":"2024-04-25T09:57:15.766274+0000","last_clean":"2024-04-25T09:57:15.766274+0000","last_became_active":"2024-04-25T09:57:14.757970+0000","last_became_peered":"2024-04-25T09:57:14.757970+0000","last_unstale":"2024-04-25T09:57:15.766274+0000","last_undegraded":"2024-04-25T09:57:15.766274+0000","last_fullsized":"2024-04-25T09:57:15.766274+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:03.967389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.764468+0000","last_change":"2024-04-25T09:57:15.760819+0000","last_active":"2024-04-25T09:57:15.764468+0000","last_peered":"2024-04-25T09:57:15.764468+0000","last_clean":"2024-04-25T09:57:15.764468+0000","last_became_active":"2024-04-25T09:57:15.760488+0000","last_became_peered":"2024-04-25T09:57:15.760488+0000","last_unstale":"2024-04-25T09:57:15.764468+0000","last_undegraded":"2024-04-25T09:57:15.764468+0000","last_fullsized":"2024-04-25T09:57:15.764468+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:45.975880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.770372+0000","last_change":"2024-04-25T09:57:14.758906+0000","last_active":"2024-04-25T09:57:15.770372+0000","last_peered":"2024-04-25T09:57:15.770372+0000","last_clean":"2024-04-25T09:57:15.770372+0000","last_became_active":"2024-04-25T09:57:14.758479+0000","last_became_peered":"2024-04-25T09:57:14.758479+0000","last_unstale":"2024-04-25T09:57:15.770372+0000","last_undegraded":"2024-04-25T09:57:15.770372+0000","last_fullsized":"2024-04-25T09:57:15.770372+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:12.283665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.756716+0000","last_change":"2024-04-25T09:57:15.754377+0000","last_active":"2024-04-25T09:57:15.756716+0000","last_peered":"2024-04-25T09:57:15.756716+0000","last_clean":"2024-04-25T09:57:15.756716+0000","last_became_active":"2024-04-25T09:57:15.752933+0000","last_became_peered":"2024-04-25T09:57:15.752933+0000","last_unstale":"2024-04-25T09:57:15.756716+0000","last_undegraded":"2024-04-25T09:57:15.756716+0000","last_fullsized":"2024-04-25T09:57:15.756716+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:05.715956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.745810+0000","last_change":"2024-04-25T09:57:14.742625+0000","last_active":"2024-04-25T09:57:14.745810+0000","last_peered":"2024-04-25T09:57:14.745810+0000","last_clean":"2024-04-25T09:57:14.745810+0000","last_became_active":"2024-04-25T09:57:14.742323+0000","last_became_peered":"2024-04-25T09:57:14.742323+0000","last_unstale":"2024-04-25T09:57:14.745810+0000","last_undegraded":"2024-04-25T09:57:14.745810+0000","last_fullsized":"2024-04-25T09:57:14.745810+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:37.033433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.739509+0000","last_change":"2024-04-25T09:57:14.739509+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.739509+0000","last_undegraded":"2024-04-25T09:57:14.739509+0000","last_fullsized":"2024-04-25T09:57:14.739509+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.750253+0000","last_change":"2024-04-25T09:57:14.744916+0000","last_active":"2024-04-25T09:57:14.750253+0000","last_peered":"2024-04-25T09:57:14.750253+0000","last_clean":"2024-04-25T09:57:14.750253+0000","last_became_active":"2024-04-25T09:57:14.744621+0000","last_became_peered":"2024-04-25T09:57:14.744621+0000","last_unstale":"2024-04-25T09:57:14.750253+0000","last_undegraded":"2024-04-25T09:57:14.750253+0000","last_fullsized":"2024-04-25T09:57:14.750253+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:07.995451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.758804+0000","last_change":"2024-04-25T09:57:15.747249+0000","last_active":"2024-04-25T09:57:15.758804+0000","last_peered":"2024-04-25T09:57:15.758804+0000","last_clean":"2024-04-25T09:57:15.758804+0000","last_became_active":"2024-04-25T09:57:15.746876+0000","last_became_peered":"2024-04-25T09:57:15.746876+0000","last_unstale":"2024-04-25T09:57:15.758804+0000","last_undegraded":"2024-04-25T09:57:15.758804+0000","last_fullsized":"2024-04-25T09:57:15.758804+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:52.439177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.739655+0000","last_change":"2024-04-25T09:57:14.749773+0000","last_active":"2024-04-25T09:57:15.739655+0000","last_peered":"2024-04-25T09:57:15.739655+0000","last_clean":"2024-04-25T09:57:15.739655+0000","last_became_active":"2024-04-25T09:57:14.749207+0000","last_became_peered":"2024-04-25T09:57:14.749207+0000","last_unstale":"2024-04-25T09:57:15.739655+0000","last_undegraded":"2024-04-25T09:57:15.739655+0000","last_fullsized":"2024-04-25T09:57:15.739655+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:36.078016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759224+0000","last_change":"2024-04-25T09:57:15.755964+0000","last_active":"2024-04-25T09:57:15.759224+0000","last_peered":"2024-04-25T09:57:15.759224+0000","last_clean":"2024-04-25T09:57:15.759224+0000","last_became_active":"2024-04-25T09:57:15.755024+0000","last_became_peered":"2024-04-25T09:57:15.755024+0000","last_unstale":"2024-04-25T09:57:15.759224+0000","last_undegraded":"2024-04-25T09:57:15.759224+0000","last_fullsized":"2024-04-25T09:57:15.759224+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:01:31.389864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.750784+0000","last_change":"2024-04-25T09:57:14.748763+0000","last_active":"2024-04-25T09:57:14.750784+0000","last_peered":"2024-04-25T09:57:14.750784+0000","last_clean":"2024-04-25T09:57:14.750784+0000","last_became_active":"2024-04-25T09:57:14.748442+0000","last_became_peered":"2024-04-25T09:57:14.748442+0000","last_unstale":"2024-04-25T09:57:14.750784+0000","last_undegraded":"2024-04-25T09:57:14.750784+0000","last_fullsized":"2024-04-25T09:57:14.750784+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:13.126972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.739208+0000","last_change":"2024-04-25T09:57:14.739208+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.739208+0000","last_undegraded":"2024-04-25T09:57:14.739208+0000","last_fullsized":"2024-04-25T09:57:14.739208+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.754602+0000","last_change":"2024-04-25T09:57:14.752504+0000","last_active":"2024-04-25T09:57:15.754602+0000","last_peered":"2024-04-25T09:57:15.754602+0000","last_clean":"2024-04-25T09:57:15.754602+0000","last_became_active":"2024-04-25T09:57:14.752223+0000","last_became_peered":"2024-04-25T09:57:14.752223+0000","last_unstale":"2024-04-25T09:57:15.754602+0000","last_undegraded":"2024-04-25T09:57:15.754602+0000","last_fullsized":"2024-04-25T09:57:15.754602+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:42.586862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.735336+0000","last_change":"2024-04-25T09:57:14.735336+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.735336+0000","last_undegraded":"2024-04-25T09:57:14.735336+0000","last_fullsized":"2024-04-25T09:57:14.735336+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.738659+0000","last_change":"2024-04-25T09:57:14.742094+0000","last_active":"2024-04-25T09:57:15.738659+0000","last_peered":"2024-04-25T09:57:15.738659+0000","last_clean":"2024-04-25T09:57:15.738659+0000","last_became_active":"2024-04-25T09:57:14.741829+0000","last_became_peered":"2024-04-25T09:57:14.741829+0000","last_unstale":"2024-04-25T09:57:15.738659+0000","last_undegraded":"2024-04-25T09:57:15.738659+0000","last_fullsized":"2024-04-25T09:57:15.738659+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:03.967389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759441+0000","last_change":"2024-04-25T09:57:15.753721+0000","last_active":"2024-04-25T09:57:15.759441+0000","last_peered":"2024-04-25T09:57:15.759441+0000","last_clean":"2024-04-25T09:57:15.759441+0000","last_became_active":"2024-04-25T09:57:15.753367+0000","last_became_peered":"2024-04-25T09:57:15.753367+0000","last_unstale":"2024-04-25T09:57:15.759441+0000","last_undegraded":"2024-04-25T09:57:15.759441+0000","last_fullsized":"2024-04-25T09:57:15.759441+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:36.249678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.750376+0000","last_change":"2024-04-25T09:57:14.745936+0000","last_active":"2024-04-25T09:57:14.750376+0000","last_peered":"2024-04-25T09:57:14.750376+0000","last_clean":"2024-04-25T09:57:14.750376+0000","last_became_active":"2024-04-25T09:57:14.744599+0000","last_became_peered":"2024-04-25T09:57:14.744599+0000","last_unstale":"2024-04-25T09:57:14.750376+0000","last_undegraded":"2024-04-25T09:57:14.750376+0000","last_fullsized":"2024-04-25T09:57:14.750376+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:36.216367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.756736+0000","last_change":"2024-04-25T09:57:15.753219+0000","last_active":"2024-04-25T09:57:15.756736+0000","last_peered":"2024-04-25T09:57:15.756736+0000","last_clean":"2024-04-25T09:57:15.756736+0000","last_became_active":"2024-04-25T09:57:15.752526+0000","last_became_peered":"2024-04-25T09:57:15.752526+0000","last_unstale":"2024-04-25T09:57:15.756736+0000","last_undegraded":"2024-04-25T09:57:15.756736+0000","last_fullsized":"2024-04-25T09:57:15.756736+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:20.570308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.749715+0000","last_change":"2024-04-25T09:57:14.747370+0000","last_active":"2024-04-25T09:57:14.749715+0000","last_peered":"2024-04-25T09:57:14.749715+0000","last_clean":"2024-04-25T09:57:14.749715+0000","last_became_active":"2024-04-25T09:57:14.747109+0000","last_became_peered":"2024-04-25T09:57:14.747109+0000","last_unstale":"2024-04-25T09:57:14.749715+0000","last_undegraded":"2024-04-25T09:57:14.749715+0000","last_fullsized":"2024-04-25T09:57:14.749715+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:04.713611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.759187+0000","last_change":"2024-04-25T09:57:15.757598+0000","last_active":"2024-04-25T09:57:15.759187+0000","last_peered":"2024-04-25T09:57:15.759187+0000","last_clean":"2024-04-25T09:57:15.759187+0000","last_became_active":"2024-04-25T09:57:15.757291+0000","last_became_peered":"2024-04-25T09:57:15.757291+0000","last_unstale":"2024-04-25T09:57:15.759187+0000","last_undegraded":"2024-04-25T09:57:15.759187+0000","last_fullsized":"2024-04-25T09:57:15.759187+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:14.414068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.758295+0000","last_change":"2024-04-25T09:57:14.758651+0000","last_active":"2024-04-25T09:57:15.758295+0000","last_peered":"2024-04-25T09:57:15.758295+0000","last_clean":"2024-04-25T09:57:15.758295+0000","last_became_active":"2024-04-25T09:57:14.758265+0000","last_became_peered":"2024-04-25T09:57:14.758265+0000","last_unstale":"2024-04-25T09:57:15.758295+0000","last_undegraded":"2024-04-25T09:57:15.758295+0000","last_fullsized":"2024-04-25T09:57:15.758295+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:36.078016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.768753+0000","last_change":"2024-04-25T09:57:15.766207+0000","last_active":"2024-04-25T09:57:15.768753+0000","last_peered":"2024-04-25T09:57:15.768753+0000","last_clean":"2024-04-25T09:57:15.768753+0000","last_became_active":"2024-04-25T09:57:15.765910+0000","last_became_peered":"2024-04-25T09:57:15.765910+0000","last_unstale":"2024-04-25T09:57:15.768753+0000","last_undegraded":"2024-04-25T09:57:15.768753+0000","last_fullsized":"2024-04-25T09:57:15.768753+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:20.570308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.746060+0000","last_change":"2024-04-25T09:57:14.743166+0000","last_active":"2024-04-25T09:57:14.746060+0000","last_peered":"2024-04-25T09:57:14.746060+0000","last_clean":"2024-04-25T09:57:14.746060+0000","last_became_active":"2024-04-25T09:57:14.742849+0000","last_became_peered":"2024-04-25T09:57:14.742849+0000","last_unstale":"2024-04-25T09:57:14.746060+0000","last_undegraded":"2024-04-25T09:57:14.746060+0000","last_fullsized":"2024-04-25T09:57:14.746060+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:42.168255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.736953+0000","last_change":"2024-04-25T09:57:14.736953+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.736953+0000","last_undegraded":"2024-04-25T09:57:14.736953+0000","last_fullsized":"2024-04-25T09:57:14.736953+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.747542+0000","last_change":"2024-04-25T09:57:14.745243+0000","last_active":"2024-04-25T09:57:14.747542+0000","last_peered":"2024-04-25T09:57:14.747542+0000","last_clean":"2024-04-25T09:57:14.747542+0000","last_became_active":"2024-04-25T09:57:14.744863+0000","last_became_peered":"2024-04-25T09:57:14.744863+0000","last_unstale":"2024-04-25T09:57:14.747542+0000","last_undegraded":"2024-04-25T09:57:14.747542+0000","last_fullsized":"2024-04-25T09:57:14.747542+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:26.411491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-04-25T09:57:14.735406+0000","last_change":"2024-04-25T09:57:14.735406+0000","last_active":"2024-04-25T09:57:14.723456+0000","last_peered":"2024-04-25T09:57:14.723456+0000","last_clean":"2024-04-25T09:57:14.723456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:57:14.735406+0000","last_undegraded":"2024-04-25T09:57:14.735406+0000","last_fullsized":"2024-04-25T09:57:14.735406+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.746338+0000","last_change":"2024-04-25T09:57:14.745523+0000","last_active":"2024-04-25T09:57:14.746338+0000","last_peered":"2024-04-25T09:57:14.746338+0000","last_clean":"2024-04-25T09:57:14.746338+0000","last_became_active":"2024-04-25T09:57:14.745243+0000","last_became_peered":"2024-04-25T09:57:14.745243+0000","last_unstale":"2024-04-25T09:57:14.746338+0000","last_undegraded":"2024-04-25T09:57:14.746338+0000","last_fullsized":"2024-04-25T09:57:14.746338+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:58:25.058720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.762195+0000","last_change":"2024-04-25T09:57:15.759399+0000","last_active":"2024-04-25T09:57:15.762195+0000","last_peered":"2024-04-25T09:57:15.762195+0000","last_clean":"2024-04-25T09:57:15.762195+0000","last_became_active":"2024-04-25T09:57:15.758243+0000","last_became_peered":"2024-04-25T09:57:15.758243+0000","last_unstale":"2024-04-25T09:57:15.762195+0000","last_undegraded":"2024-04-25T09:57:15.762195+0000","last_fullsized":"2024-04-25T09:57:15.762195+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:04.969733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T09:57:14.747693+0000","last_change":"2024-04-25T09:57:14.744509+0000","last_active":"2024-04-25T09:57:14.747693+0000","last_peered":"2024-04-25T09:57:14.747693+0000","last_clean":"2024-04-25T09:57:14.747693+0000","last_became_active":"2024-04-25T09:57:14.744156+0000","last_became_peered":"2024-04-25T09:57:14.744156+0000","last_unstale":"2024-04-25T09:57:14.747693+0000","last_undegraded":"2024-04-25T09:57:14.747693+0000","last_fullsized":"2024-04-25T09:57:14.747693+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:07.995451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":243,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T09:57:15.758136+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T09:57:15.758136+0000","last_peered":"2024-04-25T09:57:15.758136+0000","last_clean":"2024-04-25T09:57:15.758136+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T09:57:15.758136+0000","last_undegraded":"2024-04-25T09:57:15.758136+0000","last_fullsized":"2024-04-25T09:57:15.758136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":216,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542183,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32468,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1314816,"data_stored":910803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542183,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":720896,"data_stored":320435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542185,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":737280,"data_stored":327624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542182,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":720896,"data_stored":320435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31872,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":708608,"data_stored":313776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31876,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339964,"statfs":{"total":96636764160,"available":96604123136,"internally_reserved":0,"allocated":708608,"data_stored":313776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31872,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":708608,"data_stored":313776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1302528,"data_stored":904144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:57:21.714 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-04-25T09:57:21.710+0000 7f7c2300e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:57:23.190 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:57:23.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.301+0000 7fa0325b7640 1 Processor -- start 2024-04-25T09:57:23.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.301+0000 7fa0325b7640 1 -- start start 2024-04-25T09:57:23.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.301+0000 7fa0325b7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa02c15a900 0x7fa02c0af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:23.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.301+0000 7fa0325b7640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa02c15eb70 0x7fa02c0b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:23.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.301+0000 7fa0325b7640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa02c0aeb70 con 0x7fa02c0ae710 2024-04-25T09:57:23.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.302+0000 7fa0325b7640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa02c0afa30 con 0x7fa02c15eb70 2024-04-25T09:57:23.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.302+0000 7fa0325b7640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa02c0b02d0 con 0x7fa02c15a900 2024-04-25T09:57:23.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.302+0000 7fa030b54640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa02c15eb70 0x7fa02c0b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:23.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.302+0000 7fa030b54640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa02c15eb70 0x7fa02c0b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50240/0 (socket says 172.21.15.7:50240) 2024-04-25T09:57:23.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.302+0000 7fa030b54640 1 -- 172.21.15.7:0/2286202028 learned_addr learned my addr 172.21.15.7:0/2286202028 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:23.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.302+0000 7fa02bfff640 1 --2- 172.21.15.7:0/2286202028 >> v2:172.21.15.55:3300/0 conn(0x7fa02c15a900 0x7fa02c0af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:23.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.302+0000 7fa030b54640 1 -- 172.21.15.7:0/2286202028 >> v2:172.21.15.55:3300/0 conn(0x7fa02c15a900 msgr2=0x7fa02c0af3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:23.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.302+0000 7fa030b54640 1 --2- 172.21.15.7:0/2286202028 >> v2:172.21.15.55:3300/0 conn(0x7fa02c15a900 0x7fa02c0af3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:23.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.302+0000 7fa030b54640 1 -- 172.21.15.7:0/2286202028 >> v1:172.21.15.55:6789/0 conn(0x7fa02c0ae710 legacy=0x7fa02c15e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:23.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.302+0000 7fa030b54640 1 -- 172.21.15.7:0/2286202028 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa02c0aee10 con 0x7fa02c15eb70 2024-04-25T09:57:23.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.303+0000 7fa030b54640 1 --2- 172.21.15.7:0/2286202028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa02c15eb70 0x7fa02c0b0760 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fa02c072c70 tx=0x7fa02402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2efe03e791a98e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:23.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.303+0000 7fa02affd640 1 -- 172.21.15.7:0/2286202028 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa024036070 con 0x7fa02c15eb70 2024-04-25T09:57:23.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.303+0000 7fa02affd640 1 -- 172.21.15.7:0/2286202028 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa024031600 con 0x7fa02c15eb70 2024-04-25T09:57:23.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.303+0000 7fa02affd640 1 -- 172.21.15.7:0/2286202028 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0240319d0 con 0x7fa02c15eb70 2024-04-25T09:57:23.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.303+0000 7fa0325b7640 1 -- 172.21.15.7:0/2286202028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa02c15eb70 msgr2=0x7fa02c0b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:23.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.303+0000 7fa0325b7640 1 --2- 172.21.15.7:0/2286202028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa02c15eb70 0x7fa02c0b0760 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fa02c072c70 tx=0x7fa02402a6c0 comp rx=0 tx=0).stop 2024-04-25T09:57:23.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.304+0000 7fa0325b7640 1 -- 172.21.15.7:0/2286202028 shutdown_connections 2024-04-25T09:57:23.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.304+0000 7fa0325b7640 1 --2- 172.21.15.7:0/2286202028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa02c15eb70 0x7fa02c0b0760 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:23.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.304+0000 7fa0325b7640 1 --2- 172.21.15.7:0/2286202028 >> v2:172.21.15.55:3300/0 conn(0x7fa02c15a900 0x7fa02c0af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:23.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.304+0000 7fa0325b7640 1 -- 172.21.15.7:0/2286202028 >> 172.21.15.7:0/2286202028 conn(0x7fa02c0b5c30 msgr2=0x7fa02c0999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:23.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.304+0000 7fa0325b7640 1 -- 172.21.15.7:0/2286202028 shutdown_connections 2024-04-25T09:57:23.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.304+0000 7fa0325b7640 1 -- 172.21.15.7:0/2286202028 wait complete. 2024-04-25T09:57:23.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.305+0000 7fa0325b7640 1 Processor -- start 2024-04-25T09:57:23.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.305+0000 7fa0325b7640 1 -- start start 2024-04-25T09:57:23.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.306+0000 7fa0325b7640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa02c0ae710 0x7fa02c0cc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:23.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.306+0000 7fa0325b7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa02c15a900 0x7fa02c1f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:23.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.306+0000 7fa0325b7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa02c15eb70 0x7fa02c154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:23.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.306+0000 7fa0325b7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c15ace0 con 0x7fa02c15eb70 2024-04-25T09:57:23.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.306+0000 7fa0325b7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c0aff60 con 0x7fa02c15a900 2024-04-25T09:57:23.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.306+0000 7fa0325b7640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c0b0ca0 con 0x7fa02c0ae710 2024-04-25T09:57:23.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.306+0000 7fa030b54640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa02c15eb70 0x7fa02c154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:23.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.306+0000 7fa030b54640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa02c15eb70 0x7fa02c154180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50248/0 (socket says 172.21.15.7:50248) 2024-04-25T09:57:23.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.306+0000 7fa030b54640 1 -- 172.21.15.7:0/888682755 learned_addr learned my addr 172.21.15.7:0/888682755 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:23.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.306+0000 7fa02b7fe640 1 --2- 172.21.15.7:0/888682755 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa02c15a900 0x7fa02c1f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:23.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.306+0000 7fa02bfff640 1 --2- 172.21.15.7:0/888682755 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa02c0ae710 0x7fa02c0cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:23.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.306+0000 7fa030b54640 1 -- 172.21.15.7:0/888682755 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa02c0ae710 msgr2=0x7fa02c0cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:23.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.306+0000 7fa030b54640 1 --2- 172.21.15.7:0/888682755 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa02c0ae710 0x7fa02c0cc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:23.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.306+0000 7fa030b54640 1 -- 172.21.15.7:0/888682755 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa02c15a900 msgr2=0x7fa02c1f5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:23.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.306+0000 7fa030b54640 1 --2- 172.21.15.7:0/888682755 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa02c15a900 0x7fa02c1f5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:23.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.306+0000 7fa030b54640 1 -- 172.21.15.7:0/888682755 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa02c09af90 con 0x7fa02c15eb70 2024-04-25T09:57:23.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.307+0000 7fa030b54640 1 --2- 172.21.15.7:0/888682755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa02c15eb70 0x7fa02c154180 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fa024009f10 tx=0x7fa024004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:23.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.307+0000 7fa028ff9640 1 -- 172.21.15.7:0/888682755 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa024036050 con 0x7fa02c15eb70 2024-04-25T09:57:23.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.307+0000 7fa028ff9640 1 -- 172.21.15.7:0/888682755 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa024042070 con 0x7fa02c15eb70 2024-04-25T09:57:23.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.307+0000 7fa0325b7640 1 -- 172.21.15.7:0/888682755 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa02c09b270 con 0x7fa02c15eb70 2024-04-25T09:57:23.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.307+0000 7fa028ff9640 1 -- 172.21.15.7:0/888682755 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa024009510 con 0x7fa02c15eb70 2024-04-25T09:57:23.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.307+0000 7fa0325b7640 1 -- 172.21.15.7:0/888682755 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa02c09cf30 con 0x7fa02c15eb70 2024-04-25T09:57:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.308+0000 7fa0325b7640 1 -- 172.21.15.7:0/888682755 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa02c09d130 con 0x7fa02c15eb70 2024-04-25T09:57:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.308+0000 7fa028ff9640 1 -- 172.21.15.7:0/888682755 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa024007bd0 con 0x7fa02c15eb70 2024-04-25T09:57:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.309+0000 7fa028ff9640 1 --2- 172.21.15.7:0/888682755 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa00c06b500 0x7fa00c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.309+0000 7fa02bfff640 1 --2- 172.21.15.7:0/888682755 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa00c06b500 0x7fa00c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.309+0000 7fa028ff9640 1 -- 172.21.15.7:0/888682755 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa0240ab0a0 con 0x7fa02c15eb70 2024-04-25T09:57:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.310+0000 7fa02bfff640 1 --2- 172.21.15.7:0/888682755 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa00c06b500 0x7fa00c06d9c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa014006fd0 tx=0x7fa014008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:23.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.313+0000 7fa028ff9640 1 -- 172.21.15.7:0/888682755 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa02c09d130 con 0x7fa02c15eb70 2024-04-25T09:57:23.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.490+0000 7fa0325b7640 1 -- 172.21.15.7:0/888682755 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa02c1f5ff0 con 0x7fa00c06b500 2024-04-25T09:57:23.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.496+0000 7fa028ff9640 1 -- 172.21.15.7:0/888682755 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251972 (secure 0 0 0) 0x7fa014010990 con 0x7fa00c06b500 2024-04-25T09:57:23.503 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:57:23.504 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T09:57:23.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.499+0000 7fa0325b7640 1 -- 172.21.15.7:0/888682755 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa00c06b500 msgr2=0x7fa00c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:23.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.499+0000 7fa0325b7640 1 --2- 172.21.15.7:0/888682755 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa00c06b500 0x7fa00c06d9c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa014006fd0 tx=0x7fa014008040 comp rx=0 tx=0).stop 2024-04-25T09:57:23.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.499+0000 7fa0325b7640 1 -- 172.21.15.7:0/888682755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa02c15eb70 msgr2=0x7fa02c154180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:23.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.499+0000 7fa0325b7640 1 --2- 172.21.15.7:0/888682755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa02c15eb70 0x7fa02c154180 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fa024009f10 tx=0x7fa024004a40 comp rx=0 tx=0).stop 2024-04-25T09:57:23.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.499+0000 7fa0325b7640 1 -- 172.21.15.7:0/888682755 shutdown_connections 2024-04-25T09:57:23.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.499+0000 7fa0325b7640 1 --2- 172.21.15.7:0/888682755 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa00c06b500 0x7fa00c06d9c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:23.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.499+0000 7fa0325b7640 1 --2- 172.21.15.7:0/888682755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa02c15eb70 0x7fa02c154180 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:23.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.499+0000 7fa0325b7640 1 --2- 172.21.15.7:0/888682755 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa02c15a900 0x7fa02c1f5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:23.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.499+0000 7fa0325b7640 1 --2- 172.21.15.7:0/888682755 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa02c0ae710 0x7fa02c0cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:23.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.499+0000 7fa0325b7640 1 -- 172.21.15.7:0/888682755 >> 172.21.15.7:0/888682755 conn(0x7fa02c0b5c30 msgr2=0x7fa02c06ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:23.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.499+0000 7fa0325b7640 1 -- 172.21.15.7:0/888682755 shutdown_connections 2024-04-25T09:57:23.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.499+0000 7fa0325b7640 1 -- 172.21.15.7:0/888682755 wait complete. 2024-04-25T09:57:23.513 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-04-25T09:57:21.891104+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256500,"kb_used_data":7048,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718220,"statfs":{"total":773094113280,"available":772831457280,"internally_reserved":0,"allocated":7217152,"data_stored":3859908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.161845"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:16.756454+0000","last_change":"2024-04-25T09:57:15.758336+0000","last_active":"2024-04-25T09:57:16.756454+0000","last_peered":"2024-04-25T09:57:16.756454+0000","last_clean":"2024-04-25T09:57:16.756454+0000","last_became_active":"2024-04-25T09:57:15.758003+0000","last_became_peered":"2024-04-25T09:57:15.758003+0000","last_unstale":"2024-04-25T09:57:16.756454+0000","last_undegraded":"2024-04-25T09:57:16.756454+0000","last_fullsized":"2024-04-25T09:57:16.756454+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:43.170600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:16.756261+0000","last_change":"2024-04-25T09:57:15.756007+0000","last_active":"2024-04-25T09:57:16.756261+0000","last_peered":"2024-04-25T09:57:16.756261+0000","last_clean":"2024-04-25T09:57:16.756261+0000","last_became_active":"2024-04-25T09:57:15.755381+0000","last_became_peered":"2024-04-25T09:57:15.755381+0000","last_unstale":"2024-04-25T09:57:16.756261+0000","last_undegraded":"2024-04-25T09:57:16.756261+0000","last_fullsized":"2024-04-25T09:57:16.756261+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:35.319064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045939+0000","last_change":"2024-04-25T09:57:15.768429+0000","last_active":"2024-04-25T09:57:18.045939+0000","last_peered":"2024-04-25T09:57:18.045939+0000","last_clean":"2024-04-25T09:57:18.045939+0000","last_became_active":"2024-04-25T09:57:15.767779+0000","last_became_peered":"2024-04-25T09:57:15.767779+0000","last_unstale":"2024-04-25T09:57:18.045939+0000","last_undegraded":"2024-04-25T09:57:18.045939+0000","last_fullsized":"2024-04-25T09:57:18.045939+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:53.832999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:17.433384+0000","last_change":"2024-04-25T09:57:15.743074+0000","last_active":"2024-04-25T09:57:17.433384+0000","last_peered":"2024-04-25T09:57:17.433384+0000","last_clean":"2024-04-25T09:57:17.433384+0000","last_became_active":"2024-04-25T09:57:15.742690+0000","last_became_peered":"2024-04-25T09:57:15.742690+0000","last_unstale":"2024-04-25T09:57:17.433384+0000","last_undegraded":"2024-04-25T09:57:17.433384+0000","last_fullsized":"2024-04-25T09:57:17.433384+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:04.969733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045373+0000","last_change":"2024-04-25T09:57:15.753362+0000","last_active":"2024-04-25T09:57:18.045373+0000","last_peered":"2024-04-25T09:57:18.045373+0000","last_clean":"2024-04-25T09:57:18.045373+0000","last_became_active":"2024-04-25T09:57:15.752402+0000","last_became_peered":"2024-04-25T09:57:15.752402+0000","last_unstale":"2024-04-25T09:57:18.045373+0000","last_undegraded":"2024-04-25T09:57:18.045373+0000","last_fullsized":"2024-04-25T09:57:18.045373+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:52.439177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045401+0000","last_change":"2024-04-25T09:57:15.766212+0000","last_active":"2024-04-25T09:57:18.045401+0000","last_peered":"2024-04-25T09:57:18.045401+0000","last_clean":"2024-04-25T09:57:18.045401+0000","last_became_active":"2024-04-25T09:57:15.765905+0000","last_became_peered":"2024-04-25T09:57:15.765905+0000","last_unstale":"2024-04-25T09:57:18.045401+0000","last_undegraded":"2024-04-25T09:57:18.045401+0000","last_fullsized":"2024-04-25T09:57:18.045401+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:18.371254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:17.331562+0000","last_change":"2024-04-25T09:57:15.764442+0000","last_active":"2024-04-25T09:57:17.331562+0000","last_peered":"2024-04-25T09:57:17.331562+0000","last_clean":"2024-04-25T09:57:17.331562+0000","last_became_active":"2024-04-25T09:57:15.764062+0000","last_became_peered":"2024-04-25T09:57:15.764062+0000","last_unstale":"2024-04-25T09:57:17.331562+0000","last_undegraded":"2024-04-25T09:57:17.331562+0000","last_fullsized":"2024-04-25T09:57:17.331562+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:52.999099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:16.766416+0000","last_change":"2024-04-25T09:57:15.764308+0000","last_active":"2024-04-25T09:57:16.766416+0000","last_peered":"2024-04-25T09:57:16.766416+0000","last_clean":"2024-04-25T09:57:16.766416+0000","last_became_active":"2024-04-25T09:57:15.763987+0000","last_became_peered":"2024-04-25T09:57:15.763987+0000","last_unstale":"2024-04-25T09:57:16.766416+0000","last_undegraded":"2024-04-25T09:57:16.766416+0000","last_fullsized":"2024-04-25T09:57:16.766416+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:29.304642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.046116+0000","last_change":"2024-04-25T09:57:15.768645+0000","last_active":"2024-04-25T09:57:18.046116+0000","last_peered":"2024-04-25T09:57:18.046116+0000","last_clean":"2024-04-25T09:57:18.046116+0000","last_became_active":"2024-04-25T09:57:15.768313+0000","last_became_peered":"2024-04-25T09:57:15.768313+0000","last_unstale":"2024-04-25T09:57:18.046116+0000","last_undegraded":"2024-04-25T09:57:18.046116+0000","last_fullsized":"2024-04-25T09:57:18.046116+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:38:59.679851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045461+0000","last_change":"2024-04-25T09:57:15.765383+0000","last_active":"2024-04-25T09:57:18.045461+0000","last_peered":"2024-04-25T09:57:18.045461+0000","last_clean":"2024-04-25T09:57:18.045461+0000","last_became_active":"2024-04-25T09:57:15.763424+0000","last_became_peered":"2024-04-25T09:57:15.763424+0000","last_unstale":"2024-04-25T09:57:18.045461+0000","last_undegraded":"2024-04-25T09:57:18.045461+0000","last_fullsized":"2024-04-25T09:57:18.045461+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:14.129316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:17.433277+0000","last_change":"2024-04-25T09:57:15.755081+0000","last_active":"2024-04-25T09:57:17.433277+0000","last_peered":"2024-04-25T09:57:17.433277+0000","last_clean":"2024-04-25T09:57:17.433277+0000","last_became_active":"2024-04-25T09:57:15.754758+0000","last_became_peered":"2024-04-25T09:57:15.754758+0000","last_unstale":"2024-04-25T09:57:17.433277+0000","last_undegraded":"2024-04-25T09:57:17.433277+0000","last_fullsized":"2024-04-25T09:57:17.433277+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:22.009595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:16.766316+0000","last_change":"2024-04-25T09:57:15.767461+0000","last_active":"2024-04-25T09:57:16.766316+0000","last_peered":"2024-04-25T09:57:16.766316+0000","last_clean":"2024-04-25T09:57:16.766316+0000","last_became_active":"2024-04-25T09:57:15.767159+0000","last_became_peered":"2024-04-25T09:57:15.767159+0000","last_unstale":"2024-04-25T09:57:16.766316+0000","last_undegraded":"2024-04-25T09:57:16.766316+0000","last_fullsized":"2024-04-25T09:57:16.766316+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:58.052218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:16.766607+0000","last_change":"2024-04-25T09:57:15.753129+0000","last_active":"2024-04-25T09:57:16.766607+0000","last_peered":"2024-04-25T09:57:16.766607+0000","last_clean":"2024-04-25T09:57:16.766607+0000","last_became_active":"2024-04-25T09:57:15.752135+0000","last_became_peered":"2024-04-25T09:57:15.752135+0000","last_unstale":"2024-04-25T09:57:16.766607+0000","last_undegraded":"2024-04-25T09:57:16.766607+0000","last_fullsized":"2024-04-25T09:57:16.766607+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:53.832999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045622+0000","last_change":"2024-04-25T09:57:15.765918+0000","last_active":"2024-04-25T09:57:18.045622+0000","last_peered":"2024-04-25T09:57:18.045622+0000","last_clean":"2024-04-25T09:57:18.045622+0000","last_became_active":"2024-04-25T09:57:15.765586+0000","last_became_peered":"2024-04-25T09:57:15.765586+0000","last_unstale":"2024-04-25T09:57:18.045622+0000","last_undegraded":"2024-04-25T09:57:18.045622+0000","last_fullsized":"2024-04-25T09:57:18.045622+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:04:08.822474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045273+0000","last_change":"2024-04-25T09:57:15.765729+0000","last_active":"2024-04-25T09:57:18.045273+0000","last_peered":"2024-04-25T09:57:18.045273+0000","last_clean":"2024-04-25T09:57:18.045273+0000","last_became_active":"2024-04-25T09:57:15.763401+0000","last_became_peered":"2024-04-25T09:57:15.763401+0000","last_unstale":"2024-04-25T09:57:18.045273+0000","last_undegraded":"2024-04-25T09:57:18.045273+0000","last_fullsized":"2024-04-25T09:57:18.045273+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:20.297122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:17.331503+0000","last_change":"2024-04-25T09:57:15.756556+0000","last_active":"2024-04-25T09:57:17.331503+0000","last_peered":"2024-04-25T09:57:17.331503+0000","last_clean":"2024-04-25T09:57:17.331503+0000","last_became_active":"2024-04-25T09:57:15.756236+0000","last_became_peered":"2024-04-25T09:57:15.756236+0000","last_unstale":"2024-04-25T09:57:17.331503+0000","last_undegraded":"2024-04-25T09:57:17.331503+0000","last_fullsized":"2024-04-25T09:57:17.331503+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:34.463512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:16.756518+0000","last_change":"2024-04-25T09:57:15.761802+0000","last_active":"2024-04-25T09:57:16.756518+0000","last_peered":"2024-04-25T09:57:16.756518+0000","last_clean":"2024-04-25T09:57:16.756518+0000","last_became_active":"2024-04-25T09:57:15.761500+0000","last_became_peered":"2024-04-25T09:57:15.761500+0000","last_unstale":"2024-04-25T09:57:16.756518+0000","last_undegraded":"2024-04-25T09:57:16.756518+0000","last_fullsized":"2024-04-25T09:57:16.756518+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:08.997796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:17.433411+0000","last_change":"2024-04-25T09:57:15.763231+0000","last_active":"2024-04-25T09:57:17.433411+0000","last_peered":"2024-04-25T09:57:17.433411+0000","last_clean":"2024-04-25T09:57:17.433411+0000","last_became_active":"2024-04-25T09:57:15.761219+0000","last_became_peered":"2024-04-25T09:57:15.761219+0000","last_unstale":"2024-04-25T09:57:17.433411+0000","last_undegraded":"2024-04-25T09:57:17.433411+0000","last_fullsized":"2024-04-25T09:57:17.433411+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:26.681606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045671+0000","last_change":"2024-04-25T09:57:15.749906+0000","last_active":"2024-04-25T09:57:18.045671+0000","last_peered":"2024-04-25T09:57:18.045671+0000","last_clean":"2024-04-25T09:57:18.045671+0000","last_became_active":"2024-04-25T09:57:15.749556+0000","last_became_peered":"2024-04-25T09:57:15.749556+0000","last_unstale":"2024-04-25T09:57:18.045671+0000","last_undegraded":"2024-04-25T09:57:18.045671+0000","last_fullsized":"2024-04-25T09:57:18.045671+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:06:48.607407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.044653+0000","last_change":"2024-04-25T09:57:15.750891+0000","last_active":"2024-04-25T09:57:18.044653+0000","last_peered":"2024-04-25T09:57:18.044653+0000","last_clean":"2024-04-25T09:57:18.044653+0000","last_became_active":"2024-04-25T09:57:15.750592+0000","last_became_peered":"2024-04-25T09:57:15.750592+0000","last_unstale":"2024-04-25T09:57:18.044653+0000","last_undegraded":"2024-04-25T09:57:18.044653+0000","last_fullsized":"2024-04-25T09:57:18.044653+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:25.717154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:16.766788+0000","last_change":"2024-04-25T09:57:15.756136+0000","last_active":"2024-04-25T09:57:16.766788+0000","last_peered":"2024-04-25T09:57:16.766788+0000","last_clean":"2024-04-25T09:57:16.766788+0000","last_became_active":"2024-04-25T09:57:15.755865+0000","last_became_peered":"2024-04-25T09:57:15.755865+0000","last_unstale":"2024-04-25T09:57:16.766788+0000","last_undegraded":"2024-04-25T09:57:16.766788+0000","last_fullsized":"2024-04-25T09:57:16.766788+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:38:59.679851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.044475+0000","last_change":"2024-04-25T09:57:15.769548+0000","last_active":"2024-04-25T09:57:18.044475+0000","last_peered":"2024-04-25T09:57:18.044475+0000","last_clean":"2024-04-25T09:57:18.044475+0000","last_became_active":"2024-04-25T09:57:15.769213+0000","last_became_peered":"2024-04-25T09:57:15.769213+0000","last_unstale":"2024-04-25T09:57:18.044475+0000","last_undegraded":"2024-04-25T09:57:18.044475+0000","last_fullsized":"2024-04-25T09:57:18.044475+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:46.479467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.044495+0000","last_change":"2024-04-25T09:57:15.765386+0000","last_active":"2024-04-25T09:57:18.044495+0000","last_peered":"2024-04-25T09:57:18.044495+0000","last_clean":"2024-04-25T09:57:18.044495+0000","last_became_active":"2024-04-25T09:57:15.765059+0000","last_became_peered":"2024-04-25T09:57:15.765059+0000","last_unstale":"2024-04-25T09:57:18.044495+0000","last_undegraded":"2024-04-25T09:57:18.044495+0000","last_fullsized":"2024-04-25T09:57:18.044495+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:48.475253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045279+0000","last_change":"2024-04-25T09:57:15.766342+0000","last_active":"2024-04-25T09:57:18.045279+0000","last_peered":"2024-04-25T09:57:18.045279+0000","last_clean":"2024-04-25T09:57:18.045279+0000","last_became_active":"2024-04-25T09:57:15.766060+0000","last_became_peered":"2024-04-25T09:57:15.766060+0000","last_unstale":"2024-04-25T09:57:18.045279+0000","last_undegraded":"2024-04-25T09:57:18.045279+0000","last_fullsized":"2024-04-25T09:57:18.045279+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:27.413836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:16.766771+0000","last_change":"2024-04-25T09:57:15.752044+0000","last_active":"2024-04-25T09:57:16.766771+0000","last_peered":"2024-04-25T09:57:16.766771+0000","last_clean":"2024-04-25T09:57:16.766771+0000","last_became_active":"2024-04-25T09:57:15.751759+0000","last_became_peered":"2024-04-25T09:57:15.751759+0000","last_unstale":"2024-04-25T09:57:16.766771+0000","last_undegraded":"2024-04-25T09:57:16.766771+0000","last_fullsized":"2024-04-25T09:57:16.766771+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:20.297122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:16.766629+0000","last_change":"2024-04-25T09:57:15.751032+0000","last_active":"2024-04-25T09:57:16.766629+0000","last_peered":"2024-04-25T09:57:16.766629+0000","last_clean":"2024-04-25T09:57:16.766629+0000","last_became_active":"2024-04-25T09:57:15.750731+0000","last_became_peered":"2024-04-25T09:57:15.750731+0000","last_unstale":"2024-04-25T09:57:16.766629+0000","last_undegraded":"2024-04-25T09:57:16.766629+0000","last_fullsized":"2024-04-25T09:57:16.766629+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:05:20.160082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:17.433417+0000","last_change":"2024-04-25T09:57:15.752419+0000","last_active":"2024-04-25T09:57:17.433417+0000","last_peered":"2024-04-25T09:57:17.433417+0000","last_clean":"2024-04-25T09:57:17.433417+0000","last_became_active":"2024-04-25T09:57:15.752123+0000","last_became_peered":"2024-04-25T09:57:15.752123+0000","last_unstale":"2024-04-25T09:57:17.433417+0000","last_undegraded":"2024-04-25T09:57:17.433417+0000","last_fullsized":"2024-04-25T09:57:17.433417+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:43.589207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:16.756112+0000","last_change":"2024-04-25T09:57:15.760124+0000","last_active":"2024-04-25T09:57:16.756112+0000","last_peered":"2024-04-25T09:57:16.756112+0000","last_clean":"2024-04-25T09:57:16.756112+0000","last_became_active":"2024-04-25T09:57:15.759261+0000","last_became_peered":"2024-04-25T09:57:15.759261+0000","last_unstale":"2024-04-25T09:57:16.756112+0000","last_undegraded":"2024-04-25T09:57:16.756112+0000","last_fullsized":"2024-04-25T09:57:16.756112+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:47.721018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045362+0000","last_change":"2024-04-25T09:57:15.769491+0000","last_active":"2024-04-25T09:57:18.045362+0000","last_peered":"2024-04-25T09:57:18.045362+0000","last_clean":"2024-04-25T09:57:18.045362+0000","last_became_active":"2024-04-25T09:57:15.768694+0000","last_became_peered":"2024-04-25T09:57:15.768694+0000","last_unstale":"2024-04-25T09:57:18.045362+0000","last_undegraded":"2024-04-25T09:57:18.045362+0000","last_fullsized":"2024-04-25T09:57:18.045362+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:58.052218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:16.766356+0000","last_change":"2024-04-25T09:57:15.767087+0000","last_active":"2024-04-25T09:57:16.766356+0000","last_peered":"2024-04-25T09:57:16.766356+0000","last_clean":"2024-04-25T09:57:16.766356+0000","last_became_active":"2024-04-25T09:57:15.766747+0000","last_became_peered":"2024-04-25T09:57:15.766747+0000","last_unstale":"2024-04-25T09:57:16.766356+0000","last_undegraded":"2024-04-25T09:57:16.766356+0000","last_fullsized":"2024-04-25T09:57:16.766356+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:04:08.822474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:17.432985+0000","last_change":"2024-04-25T09:57:15.745892+0000","last_active":"2024-04-25T09:57:17.432985+0000","last_peered":"2024-04-25T09:57:17.432985+0000","last_clean":"2024-04-25T09:57:17.432985+0000","last_became_active":"2024-04-25T09:57:15.745553+0000","last_became_peered":"2024-04-25T09:57:15.745553+0000","last_unstale":"2024-04-25T09:57:17.432985+0000","last_undegraded":"2024-04-25T09:57:17.432985+0000","last_fullsized":"2024-04-25T09:57:17.432985+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:11.276834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.044952+0000","last_change":"2024-04-25T09:57:15.745850+0000","last_active":"2024-04-25T09:57:18.044952+0000","last_peered":"2024-04-25T09:57:18.044952+0000","last_clean":"2024-04-25T09:57:18.044952+0000","last_became_active":"2024-04-25T09:57:15.745571+0000","last_became_peered":"2024-04-25T09:57:15.745571+0000","last_unstale":"2024-04-25T09:57:18.044952+0000","last_undegraded":"2024-04-25T09:57:18.044952+0000","last_fullsized":"2024-04-25T09:57:18.044952+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:19.808720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045561+0000","last_change":"2024-04-25T09:57:15.754290+0000","last_active":"2024-04-25T09:57:18.045561+0000","last_peered":"2024-04-25T09:57:18.045561+0000","last_clean":"2024-04-25T09:57:18.045561+0000","last_became_active":"2024-04-25T09:57:15.753872+0000","last_became_peered":"2024-04-25T09:57:15.753872+0000","last_unstale":"2024-04-25T09:57:18.045561+0000","last_undegraded":"2024-04-25T09:57:18.045561+0000","last_fullsized":"2024-04-25T09:57:18.045561+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:13.286010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"61'4","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:16.756545+0000","last_change":"2024-04-25T09:57:14.758285+0000","last_active":"2024-04-25T09:57:16.756545+0000","last_peered":"2024-04-25T09:57:16.756545+0000","last_clean":"2024-04-25T09:57:16.756545+0000","last_became_active":"2024-04-25T09:57:14.757995+0000","last_became_peered":"2024-04-25T09:57:14.757995+0000","last_unstale":"2024-04-25T09:57:16.756545+0000","last_undegraded":"2024-04-25T09:57:16.756545+0000","last_fullsized":"2024-04-25T09:57:16.756545+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:21.007250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:17.433540+0000","last_change":"2024-04-25T09:57:15.762946+0000","last_active":"2024-04-25T09:57:17.433540+0000","last_peered":"2024-04-25T09:57:17.433540+0000","last_clean":"2024-04-25T09:57:17.433540+0000","last_became_active":"2024-04-25T09:57:15.761468+0000","last_became_peered":"2024-04-25T09:57:15.761468+0000","last_unstale":"2024-04-25T09:57:17.433540+0000","last_undegraded":"2024-04-25T09:57:17.433540+0000","last_fullsized":"2024-04-25T09:57:17.433540+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:37.080361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045321+0000","last_change":"2024-04-25T09:57:14.747757+0000","last_active":"2024-04-25T09:57:18.045321+0000","last_peered":"2024-04-25T09:57:18.045321+0000","last_clean":"2024-04-25T09:57:18.045321+0000","last_became_active":"2024-04-25T09:57:14.747474+0000","last_became_peered":"2024-04-25T09:57:14.747474+0000","last_unstale":"2024-04-25T09:57:18.045321+0000","last_undegraded":"2024-04-25T09:57:18.045321+0000","last_fullsized":"2024-04-25T09:57:18.045321+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:48.562920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045155+0000","last_change":"2024-04-25T09:57:15.746573+0000","last_active":"2024-04-25T09:57:18.045155+0000","last_peered":"2024-04-25T09:57:18.045155+0000","last_clean":"2024-04-25T09:57:18.045155+0000","last_became_active":"2024-04-25T09:57:15.746288+0000","last_became_peered":"2024-04-25T09:57:15.746288+0000","last_unstale":"2024-04-25T09:57:18.045155+0000","last_undegraded":"2024-04-25T09:57:18.045155+0000","last_fullsized":"2024-04-25T09:57:18.045155+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:03.432875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045213+0000","last_change":"2024-04-25T09:57:14.746173+0000","last_active":"2024-04-25T09:57:18.045213+0000","last_peered":"2024-04-25T09:57:18.045213+0000","last_clean":"2024-04-25T09:57:18.045213+0000","last_became_active":"2024-04-25T09:57:14.744978+0000","last_became_peered":"2024-04-25T09:57:14.744978+0000","last_unstale":"2024-04-25T09:57:18.045213+0000","last_undegraded":"2024-04-25T09:57:18.045213+0000","last_fullsized":"2024-04-25T09:57:18.045213+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:38:58.677506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045962+0000","last_change":"2024-04-25T09:57:15.768921+0000","last_active":"2024-04-25T09:57:18.045962+0000","last_peered":"2024-04-25T09:57:18.045962+0000","last_clean":"2024-04-25T09:57:18.045962+0000","last_became_active":"2024-04-25T09:57:15.768327+0000","last_became_peered":"2024-04-25T09:57:15.768327+0000","last_unstale":"2024-04-25T09:57:18.045962+0000","last_undegraded":"2024-04-25T09:57:18.045962+0000","last_fullsized":"2024-04-25T09:57:18.045962+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:05:20.160082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045002+0000","last_change":"2024-04-25T09:57:14.750473+0000","last_active":"2024-04-25T09:57:18.045002+0000","last_peered":"2024-04-25T09:57:18.045002+0000","last_clean":"2024-04-25T09:57:18.045002+0000","last_became_active":"2024-04-25T09:57:14.750124+0000","last_became_peered":"2024-04-25T09:57:14.750124+0000","last_unstale":"2024-04-25T09:57:18.045002+0000","last_undegraded":"2024-04-25T09:57:18.045002+0000","last_fullsized":"2024-04-25T09:57:18.045002+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:19.294777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:17.331537+0000","last_change":"2024-04-25T09:57:15.752524+0000","last_active":"2024-04-25T09:57:17.331537+0000","last_peered":"2024-04-25T09:57:17.331537+0000","last_clean":"2024-04-25T09:57:17.331537+0000","last_became_active":"2024-04-25T09:57:15.752264+0000","last_became_peered":"2024-04-25T09:57:15.752264+0000","last_unstale":"2024-04-25T09:57:17.331537+0000","last_undegraded":"2024-04-25T09:57:17.331537+0000","last_fullsized":"2024-04-25T09:57:17.331537+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:40.866626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045076+0000","last_change":"2024-04-25T09:57:14.744916+0000","last_active":"2024-04-25T09:57:18.045076+0000","last_peered":"2024-04-25T09:57:18.045076+0000","last_clean":"2024-04-25T09:57:18.045076+0000","last_became_active":"2024-04-25T09:57:14.744384+0000","last_became_peered":"2024-04-25T09:57:14.744384+0000","last_unstale":"2024-04-25T09:57:18.045076+0000","last_undegraded":"2024-04-25T09:57:18.045076+0000","last_fullsized":"2024-04-25T09:57:18.045076+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:04:07.820129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:16.755875+0000","last_change":"2024-04-25T09:57:15.761860+0000","last_active":"2024-04-25T09:57:16.755875+0000","last_peered":"2024-04-25T09:57:16.755875+0000","last_clean":"2024-04-25T09:57:16.755875+0000","last_became_active":"2024-04-25T09:57:15.761382+0000","last_became_peered":"2024-04-25T09:57:15.761382+0000","last_unstale":"2024-04-25T09:57:16.755875+0000","last_undegraded":"2024-04-25T09:57:16.755875+0000","last_fullsized":"2024-04-25T09:57:16.755875+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:06:48.607407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.044423+0000","last_change":"2024-04-25T09:57:14.742815+0000","last_active":"2024-04-25T09:57:18.044423+0000","last_peered":"2024-04-25T09:57:18.044423+0000","last_clean":"2024-04-25T09:57:18.044423+0000","last_became_active":"2024-04-25T09:57:14.742518+0000","last_became_peered":"2024-04-25T09:57:14.742518+0000","last_unstale":"2024-04-25T09:57:18.044423+0000","last_undegraded":"2024-04-25T09:57:18.044423+0000","last_fullsized":"2024-04-25T09:57:18.044423+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:28.302298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.044986+0000","last_change":"2024-04-25T09:57:15.756573+0000","last_active":"2024-04-25T09:57:18.044986+0000","last_peered":"2024-04-25T09:57:18.044986+0000","last_clean":"2024-04-25T09:57:18.044986+0000","last_became_active":"2024-04-25T09:57:15.755701+0000","last_became_peered":"2024-04-25T09:57:15.755701+0000","last_unstale":"2024-04-25T09:57:18.044986+0000","last_undegraded":"2024-04-25T09:57:18.044986+0000","last_fullsized":"2024-04-25T09:57:18.044986+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:26.681606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.044592+0000","last_change":"2024-04-25T09:57:14.746062+0000","last_active":"2024-04-25T09:57:18.044592+0000","last_peered":"2024-04-25T09:57:18.044592+0000","last_clean":"2024-04-25T09:57:18.044592+0000","last_became_active":"2024-04-25T09:57:14.745664+0000","last_became_peered":"2024-04-25T09:57:14.745664+0000","last_unstale":"2024-04-25T09:57:18.044592+0000","last_undegraded":"2024-04-25T09:57:18.044592+0000","last_fullsized":"2024-04-25T09:57:18.044592+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:38:58.677506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.044978+0000","last_change":"2024-04-25T09:57:15.743701+0000","last_active":"2024-04-25T09:57:18.044978+0000","last_peered":"2024-04-25T09:57:18.044978+0000","last_clean":"2024-04-25T09:57:18.044978+0000","last_became_active":"2024-04-25T09:57:15.743392+0000","last_became_peered":"2024-04-25T09:57:15.743392+0000","last_unstale":"2024-04-25T09:57:18.044978+0000","last_undegraded":"2024-04-25T09:57:18.044978+0000","last_fullsized":"2024-04-25T09:57:18.044978+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:10.832158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.044983+0000","last_change":"2024-04-25T09:57:14.752874+0000","last_active":"2024-04-25T09:57:18.044983+0000","last_peered":"2024-04-25T09:57:18.044983+0000","last_clean":"2024-04-25T09:57:18.044983+0000","last_became_active":"2024-04-25T09:57:14.752542+0000","last_became_peered":"2024-04-25T09:57:14.752542+0000","last_unstale":"2024-04-25T09:57:18.044983+0000","last_undegraded":"2024-04-25T09:57:18.044983+0000","last_fullsized":"2024-04-25T09:57:18.044983+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:50.631716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:16.756156+0000","last_change":"2024-04-25T09:57:15.751884+0000","last_active":"2024-04-25T09:57:16.756156+0000","last_peered":"2024-04-25T09:57:16.756156+0000","last_clean":"2024-04-25T09:57:16.756156+0000","last_became_active":"2024-04-25T09:57:15.751491+0000","last_became_peered":"2024-04-25T09:57:15.751491+0000","last_unstale":"2024-04-25T09:57:16.756156+0000","last_undegraded":"2024-04-25T09:57:16.756156+0000","last_fullsized":"2024-04-25T09:57:16.756156+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:38.035777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.046094+0000","last_change":"2024-04-25T09:57:14.758286+0000","last_active":"2024-04-25T09:57:18.046094+0000","last_peered":"2024-04-25T09:57:18.046094+0000","last_clean":"2024-04-25T09:57:18.046094+0000","last_became_active":"2024-04-25T09:57:14.757885+0000","last_became_peered":"2024-04-25T09:57:14.757885+0000","last_unstale":"2024-04-25T09:57:18.046094+0000","last_undegraded":"2024-04-25T09:57:18.046094+0000","last_fullsized":"2024-04-25T09:57:18.046094+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:47.050365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.044910+0000","last_change":"2024-04-25T09:57:15.754920+0000","last_active":"2024-04-25T09:57:18.044910+0000","last_peered":"2024-04-25T09:57:18.044910+0000","last_clean":"2024-04-25T09:57:18.044910+0000","last_became_active":"2024-04-25T09:57:15.754580+0000","last_became_peered":"2024-04-25T09:57:15.754580+0000","last_unstale":"2024-04-25T09:57:18.044910+0000","last_undegraded":"2024-04-25T09:57:18.044910+0000","last_fullsized":"2024-04-25T09:57:18.044910+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:19.808720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:17.433565+0000","last_change":"2024-04-25T09:57:14.744998+0000","last_active":"2024-04-25T09:57:17.433565+0000","last_peered":"2024-04-25T09:57:17.433565+0000","last_clean":"2024-04-25T09:57:17.433565+0000","last_became_active":"2024-04-25T09:57:14.744717+0000","last_became_peered":"2024-04-25T09:57:14.744717+0000","last_unstale":"2024-04-25T09:57:17.433565+0000","last_undegraded":"2024-04-25T09:57:17.433565+0000","last_fullsized":"2024-04-25T09:57:17.433565+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:44.683150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045888+0000","last_change":"2024-04-25T09:57:15.758927+0000","last_active":"2024-04-25T09:57:18.045888+0000","last_peered":"2024-04-25T09:57:18.045888+0000","last_clean":"2024-04-25T09:57:18.045888+0000","last_became_active":"2024-04-25T09:57:15.758613+0000","last_became_peered":"2024-04-25T09:57:15.758613+0000","last_unstale":"2024-04-25T09:57:18.045888+0000","last_undegraded":"2024-04-25T09:57:18.045888+0000","last_fullsized":"2024-04-25T09:57:18.045888+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:47.721018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"61'3","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045841+0000","last_change":"2024-04-25T09:57:14.758891+0000","last_active":"2024-04-25T09:57:18.045841+0000","last_peered":"2024-04-25T09:57:18.045841+0000","last_clean":"2024-04-25T09:57:18.045841+0000","last_became_active":"2024-04-25T09:57:14.757957+0000","last_became_peered":"2024-04-25T09:57:14.757957+0000","last_unstale":"2024-04-25T09:57:18.045841+0000","last_undegraded":"2024-04-25T09:57:18.045841+0000","last_fullsized":"2024-04-25T09:57:18.045841+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:51.436833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:17.433561+0000","last_change":"2024-04-25T09:57:15.755461+0000","last_active":"2024-04-25T09:57:17.433561+0000","last_peered":"2024-04-25T09:57:17.433561+0000","last_clean":"2024-04-25T09:57:17.433561+0000","last_became_active":"2024-04-25T09:57:15.755099+0000","last_became_peered":"2024-04-25T09:57:15.755099+0000","last_unstale":"2024-04-25T09:57:17.433561+0000","last_undegraded":"2024-04-25T09:57:17.433561+0000","last_fullsized":"2024-04-25T09:57:17.433561+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:52.439177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"61'6","reported_seq":20,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:16.756218+0000","last_change":"2024-04-25T09:57:14.748332+0000","last_active":"2024-04-25T09:57:16.756218+0000","last_peered":"2024-04-25T09:57:16.756218+0000","last_clean":"2024-04-25T09:57:16.756218+0000","last_became_active":"2024-04-25T09:57:14.747993+0000","last_became_peered":"2024-04-25T09:57:14.747993+0000","last_unstale":"2024-04-25T09:57:16.756218+0000","last_undegraded":"2024-04-25T09:57:16.756218+0000","last_fullsized":"2024-04-25T09:57:16.756218+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:10.274490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:17.432968+0000","last_change":"2024-04-25T09:57:15.766168+0000","last_active":"2024-04-25T09:57:17.432968+0000","last_peered":"2024-04-25T09:57:17.432968+0000","last_clean":"2024-04-25T09:57:17.432968+0000","last_became_active":"2024-04-25T09:57:15.764964+0000","last_became_peered":"2024-04-25T09:57:15.764964+0000","last_unstale":"2024-04-25T09:57:17.432968+0000","last_undegraded":"2024-04-25T09:57:17.432968+0000","last_fullsized":"2024-04-25T09:57:17.432968+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:43.991599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045529+0000","last_change":"2024-04-25T09:57:14.758611+0000","last_active":"2024-04-25T09:57:18.045529+0000","last_peered":"2024-04-25T09:57:18.045529+0000","last_clean":"2024-04-25T09:57:18.045529+0000","last_became_active":"2024-04-25T09:57:14.757880+0000","last_became_peered":"2024-04-25T09:57:14.757880+0000","last_unstale":"2024-04-25T09:57:18.045529+0000","last_undegraded":"2024-04-25T09:57:18.045529+0000","last_fullsized":"2024-04-25T09:57:18.045529+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:42.586862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:16.766245+0000","last_change":"2024-04-25T09:57:15.751535+0000","last_active":"2024-04-25T09:57:16.766245+0000","last_peered":"2024-04-25T09:57:16.766245+0000","last_clean":"2024-04-25T09:57:16.766245+0000","last_became_active":"2024-04-25T09:57:15.751257+0000","last_became_peered":"2024-04-25T09:57:15.751257+0000","last_unstale":"2024-04-25T09:57:16.766245+0000","last_undegraded":"2024-04-25T09:57:16.766245+0000","last_fullsized":"2024-04-25T09:57:16.766245+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:27.413836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:16.766466+0000","last_change":"2024-04-25T09:57:14.750136+0000","last_active":"2024-04-25T09:57:16.766466+0000","last_peered":"2024-04-25T09:57:16.766466+0000","last_clean":"2024-04-25T09:57:16.766466+0000","last_became_active":"2024-04-25T09:57:14.749841+0000","last_became_peered":"2024-04-25T09:57:14.749841+0000","last_unstale":"2024-04-25T09:57:16.766466+0000","last_undegraded":"2024-04-25T09:57:16.766466+0000","last_fullsized":"2024-04-25T09:57:16.766466+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:47.050365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045140+0000","last_change":"2024-04-25T09:57:15.756190+0000","last_active":"2024-04-25T09:57:18.045140+0000","last_peered":"2024-04-25T09:57:18.045140+0000","last_clean":"2024-04-25T09:57:18.045140+0000","last_became_active":"2024-04-25T09:57:15.755333+0000","last_became_peered":"2024-04-25T09:57:15.755333+0000","last_unstale":"2024-04-25T09:57:18.045140+0000","last_undegraded":"2024-04-25T09:57:18.045140+0000","last_fullsized":"2024-04-25T09:57:18.045140+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:48.052710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045941+0000","last_change":"2024-04-25T09:57:14.758679+0000","last_active":"2024-04-25T09:57:18.045941+0000","last_peered":"2024-04-25T09:57:18.045941+0000","last_clean":"2024-04-25T09:57:18.045941+0000","last_became_active":"2024-04-25T09:57:14.758320+0000","last_became_peered":"2024-04-25T09:57:14.758320+0000","last_unstale":"2024-04-25T09:57:18.045941+0000","last_undegraded":"2024-04-25T09:57:18.045941+0000","last_fullsized":"2024-04-25T09:57:18.045941+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:25.679262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:16.756101+0000","last_change":"2024-04-25T09:57:15.769807+0000","last_active":"2024-04-25T09:57:16.756101+0000","last_peered":"2024-04-25T09:57:16.756101+0000","last_clean":"2024-04-25T09:57:16.756101+0000","last_became_active":"2024-04-25T09:57:15.769479+0000","last_became_peered":"2024-04-25T09:57:15.769479+0000","last_unstale":"2024-04-25T09:57:16.756101+0000","last_undegraded":"2024-04-25T09:57:16.756101+0000","last_fullsized":"2024-04-25T09:57:16.756101+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:57:22.599880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"61'8","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:17.432892+0000","last_change":"2024-04-25T09:57:14.749907+0000","last_active":"2024-04-25T09:57:17.432892+0000","last_peered":"2024-04-25T09:57:17.432892+0000","last_clean":"2024-04-25T09:57:17.432892+0000","last_became_active":"2024-04-25T09:57:14.748686+0000","last_became_peered":"2024-04-25T09:57:14.748686+0000","last_unstale":"2024-04-25T09:57:17.432892+0000","last_undegraded":"2024-04-25T09:57:17.432892+0000","last_fullsized":"2024-04-25T09:57:17.432892+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:26:09.170713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045798+0000","last_change":"2024-04-25T09:57:15.767545+0000","last_active":"2024-04-25T09:57:18.045798+0000","last_peered":"2024-04-25T09:57:18.045798+0000","last_clean":"2024-04-25T09:57:18.045798+0000","last_became_active":"2024-04-25T09:57:15.767252+0000","last_became_peered":"2024-04-25T09:57:15.767252+0000","last_unstale":"2024-04-25T09:57:18.045798+0000","last_undegraded":"2024-04-25T09:57:18.045798+0000","last_fullsized":"2024-04-25T09:57:18.045798+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:29.304642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:16.766885+0000","last_change":"2024-04-25T09:57:14.749754+0000","last_active":"2024-04-25T09:57:16.766885+0000","last_peered":"2024-04-25T09:57:16.766885+0000","last_clean":"2024-04-25T09:57:16.766885+0000","last_became_active":"2024-04-25T09:57:14.749258+0000","last_became_peered":"2024-04-25T09:57:14.749258+0000","last_unstale":"2024-04-25T09:57:16.766885+0000","last_undegraded":"2024-04-25T09:57:16.766885+0000","last_fullsized":"2024-04-25T09:57:16.766885+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:25.679262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045856+0000","last_change":"2024-04-25T09:57:15.751259+0000","last_active":"2024-04-25T09:57:18.045856+0000","last_peered":"2024-04-25T09:57:18.045856+0000","last_clean":"2024-04-25T09:57:18.045856+0000","last_became_active":"2024-04-25T09:57:15.750979+0000","last_became_peered":"2024-04-25T09:57:15.750979+0000","last_unstale":"2024-04-25T09:57:18.045856+0000","last_undegraded":"2024-04-25T09:57:18.045856+0000","last_fullsized":"2024-04-25T09:57:18.045856+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:36.249678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045669+0000","last_change":"2024-04-25T09:57:14.758286+0000","last_active":"2024-04-25T09:57:18.045669+0000","last_peered":"2024-04-25T09:57:18.045669+0000","last_clean":"2024-04-25T09:57:18.045669+0000","last_became_active":"2024-04-25T09:57:14.757970+0000","last_became_peered":"2024-04-25T09:57:14.757970+0000","last_unstale":"2024-04-25T09:57:18.045669+0000","last_undegraded":"2024-04-25T09:57:18.045669+0000","last_fullsized":"2024-04-25T09:57:18.045669+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:03.967389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:17.433528+0000","last_change":"2024-04-25T09:57:15.760819+0000","last_active":"2024-04-25T09:57:17.433528+0000","last_peered":"2024-04-25T09:57:17.433528+0000","last_clean":"2024-04-25T09:57:17.433528+0000","last_became_active":"2024-04-25T09:57:15.760488+0000","last_became_peered":"2024-04-25T09:57:15.760488+0000","last_unstale":"2024-04-25T09:57:17.433528+0000","last_undegraded":"2024-04-25T09:57:17.433528+0000","last_fullsized":"2024-04-25T09:57:17.433528+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:48.052710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.046094+0000","last_change":"2024-04-25T09:57:14.758906+0000","last_active":"2024-04-25T09:57:18.046094+0000","last_peered":"2024-04-25T09:57:18.046094+0000","last_clean":"2024-04-25T09:57:18.046094+0000","last_became_active":"2024-04-25T09:57:14.758479+0000","last_became_peered":"2024-04-25T09:57:14.758479+0000","last_unstale":"2024-04-25T09:57:18.046094+0000","last_undegraded":"2024-04-25T09:57:18.046094+0000","last_fullsized":"2024-04-25T09:57:18.046094+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:12.283665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045862+0000","last_change":"2024-04-25T09:57:15.754377+0000","last_active":"2024-04-25T09:57:18.045862+0000","last_peered":"2024-04-25T09:57:18.045862+0000","last_clean":"2024-04-25T09:57:18.045862+0000","last_became_active":"2024-04-25T09:57:15.752933+0000","last_became_peered":"2024-04-25T09:57:15.752933+0000","last_unstale":"2024-04-25T09:57:18.045862+0000","last_undegraded":"2024-04-25T09:57:18.045862+0000","last_fullsized":"2024-04-25T09:57:18.045862+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:57:22.599880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.044747+0000","last_change":"2024-04-25T09:57:14.742625+0000","last_active":"2024-04-25T09:57:18.044747+0000","last_peered":"2024-04-25T09:57:18.044747+0000","last_clean":"2024-04-25T09:57:18.044747+0000","last_became_active":"2024-04-25T09:57:14.742323+0000","last_became_peered":"2024-04-25T09:57:14.742323+0000","last_unstale":"2024-04-25T09:57:18.044747+0000","last_undegraded":"2024-04-25T09:57:18.044747+0000","last_fullsized":"2024-04-25T09:57:18.044747+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:19.294777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045082+0000","last_change":"2024-04-25T09:57:15.745162+0000","last_active":"2024-04-25T09:57:18.045082+0000","last_peered":"2024-04-25T09:57:18.045082+0000","last_clean":"2024-04-25T09:57:18.045082+0000","last_became_active":"2024-04-25T09:57:15.744899+0000","last_became_peered":"2024-04-25T09:57:15.744899+0000","last_unstale":"2024-04-25T09:57:18.045082+0000","last_undegraded":"2024-04-25T09:57:18.045082+0000","last_fullsized":"2024-04-25T09:57:18.045082+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:10.832158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.044732+0000","last_change":"2024-04-25T09:57:14.744916+0000","last_active":"2024-04-25T09:57:18.044732+0000","last_peered":"2024-04-25T09:57:18.044732+0000","last_clean":"2024-04-25T09:57:18.044732+0000","last_became_active":"2024-04-25T09:57:14.744621+0000","last_became_peered":"2024-04-25T09:57:14.744621+0000","last_unstale":"2024-04-25T09:57:18.044732+0000","last_undegraded":"2024-04-25T09:57:18.044732+0000","last_fullsized":"2024-04-25T09:57:18.044732+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:52.830654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:16.766296+0000","last_change":"2024-04-25T09:57:15.747249+0000","last_active":"2024-04-25T09:57:16.766296+0000","last_peered":"2024-04-25T09:57:16.766296+0000","last_clean":"2024-04-25T09:57:16.766296+0000","last_became_active":"2024-04-25T09:57:15.746876+0000","last_became_peered":"2024-04-25T09:57:15.746876+0000","last_unstale":"2024-04-25T09:57:16.766296+0000","last_undegraded":"2024-04-25T09:57:16.766296+0000","last_fullsized":"2024-04-25T09:57:16.766296+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:14.129316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:16.766565+0000","last_change":"2024-04-25T09:57:14.749773+0000","last_active":"2024-04-25T09:57:16.766565+0000","last_peered":"2024-04-25T09:57:16.766565+0000","last_clean":"2024-04-25T09:57:16.766565+0000","last_became_active":"2024-04-25T09:57:14.749207+0000","last_became_peered":"2024-04-25T09:57:14.749207+0000","last_unstale":"2024-04-25T09:57:16.766565+0000","last_undegraded":"2024-04-25T09:57:16.766565+0000","last_fullsized":"2024-04-25T09:57:16.766565+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:36.078016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045190+0000","last_change":"2024-04-25T09:57:15.755964+0000","last_active":"2024-04-25T09:57:18.045190+0000","last_peered":"2024-04-25T09:57:18.045190+0000","last_clean":"2024-04-25T09:57:18.045190+0000","last_became_active":"2024-04-25T09:57:15.755024+0000","last_became_peered":"2024-04-25T09:57:15.755024+0000","last_unstale":"2024-04-25T09:57:18.045190+0000","last_undegraded":"2024-04-25T09:57:18.045190+0000","last_fullsized":"2024-04-25T09:57:18.045190+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:37.080361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.044707+0000","last_change":"2024-04-25T09:57:14.748763+0000","last_active":"2024-04-25T09:57:18.044707+0000","last_peered":"2024-04-25T09:57:18.044707+0000","last_clean":"2024-04-25T09:57:18.044707+0000","last_became_active":"2024-04-25T09:57:14.748442+0000","last_became_peered":"2024-04-25T09:57:14.748442+0000","last_unstale":"2024-04-25T09:57:18.044707+0000","last_undegraded":"2024-04-25T09:57:18.044707+0000","last_fullsized":"2024-04-25T09:57:18.044707+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:05:19.157738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.044908+0000","last_change":"2024-04-25T09:57:15.750701+0000","last_active":"2024-04-25T09:57:18.044908+0000","last_peered":"2024-04-25T09:57:18.044908+0000","last_clean":"2024-04-25T09:57:18.044908+0000","last_became_active":"2024-04-25T09:57:15.750409+0000","last_became_peered":"2024-04-25T09:57:15.750409+0000","last_unstale":"2024-04-25T09:57:18.044908+0000","last_undegraded":"2024-04-25T09:57:18.044908+0000","last_fullsized":"2024-04-25T09:57:18.044908+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:25.717154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:16.767003+0000","last_change":"2024-04-25T09:57:14.752504+0000","last_active":"2024-04-25T09:57:16.767003+0000","last_peered":"2024-04-25T09:57:16.767003+0000","last_clean":"2024-04-25T09:57:16.767003+0000","last_became_active":"2024-04-25T09:57:14.752223+0000","last_became_peered":"2024-04-25T09:57:14.752223+0000","last_unstale":"2024-04-25T09:57:16.767003+0000","last_undegraded":"2024-04-25T09:57:16.767003+0000","last_fullsized":"2024-04-25T09:57:16.767003+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:42.586862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:17.331749+0000","last_change":"2024-04-25T09:57:15.746977+0000","last_active":"2024-04-25T09:57:17.331749+0000","last_peered":"2024-04-25T09:57:17.331749+0000","last_clean":"2024-04-25T09:57:17.331749+0000","last_became_active":"2024-04-25T09:57:15.746682+0000","last_became_peered":"2024-04-25T09:57:15.746682+0000","last_unstale":"2024-04-25T09:57:17.331749+0000","last_undegraded":"2024-04-25T09:57:17.331749+0000","last_fullsized":"2024-04-25T09:57:17.331749+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:24:05.429982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"62'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:16.767001+0000","last_change":"2024-04-25T09:57:14.742094+0000","last_active":"2024-04-25T09:57:16.767001+0000","last_peered":"2024-04-25T09:57:16.767001+0000","last_clean":"2024-04-25T09:57:16.767001+0000","last_became_active":"2024-04-25T09:57:14.741829+0000","last_became_peered":"2024-04-25T09:57:14.741829+0000","last_unstale":"2024-04-25T09:57:16.767001+0000","last_undegraded":"2024-04-25T09:57:16.767001+0000","last_fullsized":"2024-04-25T09:57:16.767001+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:03.967389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:16.766788+0000","last_change":"2024-04-25T09:57:15.753721+0000","last_active":"2024-04-25T09:57:16.766788+0000","last_peered":"2024-04-25T09:57:16.766788+0000","last_clean":"2024-04-25T09:57:16.766788+0000","last_became_active":"2024-04-25T09:57:15.753367+0000","last_became_peered":"2024-04-25T09:57:15.753367+0000","last_unstale":"2024-04-25T09:57:16.766788+0000","last_undegraded":"2024-04-25T09:57:16.766788+0000","last_fullsized":"2024-04-25T09:57:16.766788+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:36.826490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045278+0000","last_change":"2024-04-25T09:57:14.745936+0000","last_active":"2024-04-25T09:57:18.045278+0000","last_peered":"2024-04-25T09:57:18.045278+0000","last_clean":"2024-04-25T09:57:18.045278+0000","last_became_active":"2024-04-25T09:57:14.744599+0000","last_became_peered":"2024-04-25T09:57:14.744599+0000","last_unstale":"2024-04-25T09:57:18.045278+0000","last_undegraded":"2024-04-25T09:57:18.045278+0000","last_fullsized":"2024-04-25T09:57:18.045278+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:35.824146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.046026+0000","last_change":"2024-04-25T09:57:15.753219+0000","last_active":"2024-04-25T09:57:18.046026+0000","last_peered":"2024-04-25T09:57:18.046026+0000","last_clean":"2024-04-25T09:57:18.046026+0000","last_became_active":"2024-04-25T09:57:15.752526+0000","last_became_peered":"2024-04-25T09:57:15.752526+0000","last_unstale":"2024-04-25T09:57:18.046026+0000","last_undegraded":"2024-04-25T09:57:18.046026+0000","last_fullsized":"2024-04-25T09:57:18.046026+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:38.035777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:16.756223+0000","last_change":"2024-04-25T09:57:14.747370+0000","last_active":"2024-04-25T09:57:16.756223+0000","last_peered":"2024-04-25T09:57:16.756223+0000","last_clean":"2024-04-25T09:57:16.756223+0000","last_became_active":"2024-04-25T09:57:14.747109+0000","last_became_peered":"2024-04-25T09:57:14.747109+0000","last_unstale":"2024-04-25T09:57:16.756223+0000","last_undegraded":"2024-04-25T09:57:16.756223+0000","last_fullsized":"2024-04-25T09:57:16.756223+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:13.411724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045080+0000","last_change":"2024-04-25T09:57:15.757598+0000","last_active":"2024-04-25T09:57:18.045080+0000","last_peered":"2024-04-25T09:57:18.045080+0000","last_clean":"2024-04-25T09:57:18.045080+0000","last_became_active":"2024-04-25T09:57:15.757291+0000","last_became_peered":"2024-04-25T09:57:15.757291+0000","last_unstale":"2024-04-25T09:57:18.045080+0000","last_undegraded":"2024-04-25T09:57:18.045080+0000","last_fullsized":"2024-04-25T09:57:18.045080+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:43.589207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045677+0000","last_change":"2024-04-25T09:57:14.758651+0000","last_active":"2024-04-25T09:57:18.045677+0000","last_peered":"2024-04-25T09:57:18.045677+0000","last_clean":"2024-04-25T09:57:18.045677+0000","last_became_active":"2024-04-25T09:57:14.758265+0000","last_became_peered":"2024-04-25T09:57:14.758265+0000","last_unstale":"2024-04-25T09:57:18.045677+0000","last_undegraded":"2024-04-25T09:57:18.045677+0000","last_fullsized":"2024-04-25T09:57:18.045677+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:36.078016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:17.433212+0000","last_change":"2024-04-25T09:57:15.766207+0000","last_active":"2024-04-25T09:57:17.433212+0000","last_peered":"2024-04-25T09:57:17.433212+0000","last_clean":"2024-04-25T09:57:17.433212+0000","last_became_active":"2024-04-25T09:57:15.765910+0000","last_became_peered":"2024-04-25T09:57:15.765910+0000","last_unstale":"2024-04-25T09:57:17.433212+0000","last_undegraded":"2024-04-25T09:57:17.433212+0000","last_fullsized":"2024-04-25T09:57:17.433212+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:14.414068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.044543+0000","last_change":"2024-04-25T09:57:14.743166+0000","last_active":"2024-04-25T09:57:18.044543+0000","last_peered":"2024-04-25T09:57:18.044543+0000","last_clean":"2024-04-25T09:57:18.044543+0000","last_became_active":"2024-04-25T09:57:14.742849+0000","last_became_peered":"2024-04-25T09:57:14.742849+0000","last_unstale":"2024-04-25T09:57:18.044543+0000","last_undegraded":"2024-04-25T09:57:18.044543+0000","last_fullsized":"2024-04-25T09:57:18.044543+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:05:19.157738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:16.755925+0000","last_change":"2024-04-25T09:57:15.751298+0000","last_active":"2024-04-25T09:57:16.755925+0000","last_peered":"2024-04-25T09:57:16.755925+0000","last_clean":"2024-04-25T09:57:16.755925+0000","last_became_active":"2024-04-25T09:57:15.750976+0000","last_became_peered":"2024-04-25T09:57:15.750976+0000","last_unstale":"2024-04-25T09:57:16.755925+0000","last_undegraded":"2024-04-25T09:57:16.755925+0000","last_fullsized":"2024-04-25T09:57:16.755925+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:36.249678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.044701+0000","last_change":"2024-04-25T09:57:14.745243+0000","last_active":"2024-04-25T09:57:18.044701+0000","last_peered":"2024-04-25T09:57:18.044701+0000","last_clean":"2024-04-25T09:57:18.044701+0000","last_became_active":"2024-04-25T09:57:14.744863+0000","last_became_peered":"2024-04-25T09:57:14.744863+0000","last_unstale":"2024-04-25T09:57:18.044701+0000","last_undegraded":"2024-04-25T09:57:18.044701+0000","last_fullsized":"2024-04-25T09:57:18.044701+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:52.830654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:17.331537+0000","last_change":"2024-04-25T09:57:15.749669+0000","last_active":"2024-04-25T09:57:17.331537+0000","last_peered":"2024-04-25T09:57:17.331537+0000","last_clean":"2024-04-25T09:57:17.331537+0000","last_became_active":"2024-04-25T09:57:15.749385+0000","last_became_peered":"2024-04-25T09:57:15.749385+0000","last_unstale":"2024-04-25T09:57:17.331537+0000","last_undegraded":"2024-04-25T09:57:17.331537+0000","last_fullsized":"2024-04-25T09:57:17.331537+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:20.052275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:16.755802+0000","last_change":"2024-04-25T09:57:14.745523+0000","last_active":"2024-04-25T09:57:16.755802+0000","last_peered":"2024-04-25T09:57:16.755802+0000","last_clean":"2024-04-25T09:57:16.755802+0000","last_became_active":"2024-04-25T09:57:14.745243+0000","last_became_peered":"2024-04-25T09:57:14.745243+0000","last_unstale":"2024-04-25T09:57:16.755802+0000","last_undegraded":"2024-04-25T09:57:16.755802+0000","last_fullsized":"2024-04-25T09:57:16.755802+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:42.989254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045604+0000","last_change":"2024-04-25T09:57:15.759399+0000","last_active":"2024-04-25T09:57:18.045604+0000","last_peered":"2024-04-25T09:57:18.045604+0000","last_clean":"2024-04-25T09:57:18.045604+0000","last_became_active":"2024-04-25T09:57:15.758243+0000","last_became_peered":"2024-04-25T09:57:15.758243+0000","last_unstale":"2024-04-25T09:57:18.045604+0000","last_undegraded":"2024-04-25T09:57:18.045604+0000","last_fullsized":"2024-04-25T09:57:18.045604+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:14.723456+0000","last_clean_scrub_stamp":"2024-04-25T09:57:14.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:56.030922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.044369+0000","last_change":"2024-04-25T09:57:14.744509+0000","last_active":"2024-04-25T09:57:18.044369+0000","last_peered":"2024-04-25T09:57:18.044369+0000","last_clean":"2024-04-25T09:57:18.044369+0000","last_became_active":"2024-04-25T09:57:14.744156+0000","last_became_peered":"2024-04-25T09:57:14.744156+0000","last_unstale":"2024-04-25T09:57:18.044369+0000","last_undegraded":"2024-04-25T09:57:18.044369+0000","last_fullsized":"2024-04-25T09:57:18.044369+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:57:13.721111+0000","last_clean_scrub_stamp":"2024-04-25T09:57:13.721111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:13.126972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":245,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:57:18.045404+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T09:57:18.045404+0000","last_peered":"2024-04-25T09:57:18.045404+0000","last_clean":"2024-04-25T09:57:18.045404+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T09:57:18.045404+0000","last_undegraded":"2024-04-25T09:57:18.045404+0000","last_fullsized":"2024-04-25T09:57:18.045404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542184,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32504,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339336,"statfs":{"total":96636764160,"available":96603480064,"internally_reserved":0,"allocated":1355776,"data_stored":925438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542184,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":749568,"data_stored":334328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542186,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":749568,"data_stored":334316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542183,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":757760,"data_stored":335906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":745472,"data_stored":334294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":745472,"data_stored":334294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31940,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":774144,"data_stored":336670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32488,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339352,"statfs":{"total":96636764160,"available":96603496448,"internally_reserved":0,"allocated":1339392,"data_stored":924662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:57:23.517 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:57:23.518 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:57:23.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.658+0000 7f2138f5c640 1 Processor -- start 2024-04-25T09:57:23.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.658+0000 7f2138f5c640 1 -- start start 2024-04-25T09:57:23.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.659+0000 7f2138f5c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f21340d0a50 0x7f21340d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:23.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.659+0000 7f2138f5c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f21340b53b0 0x7f21340d2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:23.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.659+0000 7f2138f5c640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21340d1e80 con 0x7f213415db00 2024-04-25T09:57:23.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.659+0000 7f2138f5c640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21340b5930 con 0x7f21340d0a50 2024-04-25T09:57:23.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.659+0000 7f2138f5c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21340b5c10 con 0x7f21340b53b0 2024-04-25T09:57:23.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.659+0000 7f2131d9b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f21340d0a50 0x7f21340d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:23.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.659+0000 7f2131d9b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f21340d0a50 0x7f21340d2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50256/0 (socket says 172.21.15.7:50256) 2024-04-25T09:57:23.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.659+0000 7f2131d9b640 1 -- 172.21.15.7:0/4178653336 learned_addr learned my addr 172.21.15.7:0/4178653336 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:23.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.659+0000 7f213259c640 1 --1- 172.21.15.7:0/4178653336 >> v1:172.21.15.7:6789/0 conn(0x7f213415db00 0x7f21340d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38182/0 (socket says 172.21.15.7:38182) 2024-04-25T09:57:23.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.660+0000 7f2132d9d640 1 --2- 172.21.15.7:0/4178653336 >> v2:172.21.15.55:3300/0 conn(0x7f21340b53b0 0x7f21340d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:23.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.660+0000 7f2131d9b640 1 -- 172.21.15.7:0/4178653336 >> v2:172.21.15.55:3300/0 conn(0x7f21340b53b0 msgr2=0x7f21340d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:23.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.660+0000 7f2131d9b640 1 --2- 172.21.15.7:0/4178653336 >> v2:172.21.15.55:3300/0 conn(0x7f21340b53b0 0x7f21340d2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:23.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.660+0000 7f2131d9b640 1 -- 172.21.15.7:0/4178653336 >> v1:172.21.15.7:6789/0 conn(0x7f213415db00 legacy=0x7f21340d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:23.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.660+0000 7f2131d9b640 1 -- 172.21.15.7:0/4178653336 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21340b5ef0 con 0x7f21340d0a50 2024-04-25T09:57:23.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.660+0000 7f213159a640 1 -- 172.21.15.7:0/4178653336 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 914473636 0 0) 0x7f21340d1e80 con 0x7f213415db00 2024-04-25T09:57:23.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.660+0000 7f2132d9d640 1 --2- 172.21.15.7:0/4178653336 >> v2:172.21.15.55:3300/0 conn(0x7f21340b53b0 0x7f21340d2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:57:23.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.660+0000 7f2131d9b640 1 --2- 172.21.15.7:0/4178653336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21340d0a50 0x7f21340d2330 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f21340cdf10 tx=0x7f211c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=880f4af6a7ca25dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:23.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.661+0000 7f213159a640 1 -- 172.21.15.7:0/4178653336 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c037070 con 0x7f21340d0a50 2024-04-25T09:57:23.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.661+0000 7f213159a640 1 -- 172.21.15.7:0/4178653336 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211c032440 con 0x7f21340d0a50 2024-04-25T09:57:23.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.661+0000 7f213159a640 1 -- 172.21.15.7:0/4178653336 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c032810 con 0x7f21340d0a50 2024-04-25T09:57:23.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.661+0000 7f2138f5c640 1 -- 172.21.15.7:0/4178653336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21340d0a50 msgr2=0x7f21340d2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:23.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.661+0000 7f2138f5c640 1 --2- 172.21.15.7:0/4178653336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21340d0a50 0x7f21340d2330 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f21340cdf10 tx=0x7f211c02a270 comp rx=0 tx=0).stop 2024-04-25T09:57:23.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.661+0000 7f2138f5c640 1 -- 172.21.15.7:0/4178653336 shutdown_connections 2024-04-25T09:57:23.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.661+0000 7f2138f5c640 1 --2- 172.21.15.7:0/4178653336 >> v2:172.21.15.55:3300/0 conn(0x7f21340b53b0 0x7f21340d2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:23.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.661+0000 7f2138f5c640 1 --2- 172.21.15.7:0/4178653336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21340d0a50 0x7f21340d2330 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:23.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.661+0000 7f2138f5c640 1 -- 172.21.15.7:0/4178653336 >> 172.21.15.7:0/4178653336 conn(0x7f2134072290 msgr2=0x7f21340726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:23.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.661+0000 7f2138f5c640 1 -- 172.21.15.7:0/4178653336 shutdown_connections 2024-04-25T09:57:23.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.661+0000 7f2138f5c640 1 -- 172.21.15.7:0/4178653336 wait complete. 2024-04-25T09:57:23.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.663+0000 7f2138f5c640 1 Processor -- start 2024-04-25T09:57:23.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.663+0000 7f2138f5c640 1 -- start start 2024-04-25T09:57:23.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.663+0000 7f2138f5c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21340b53b0 0x7f21341f0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:23.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.663+0000 7f2138f5c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21340d0a50 0x7f21341f4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:23.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.663+0000 7f2138f5c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f213415db00 0x7f21340cb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:23.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.663+0000 7f2138f5c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21340d3660 con 0x7f21340d0a50 2024-04-25T09:57:23.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.663+0000 7f2138f5c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21340b61d0 con 0x7f21340b53b0 2024-04-25T09:57:23.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.663+0000 7f2138f5c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21340ce2b0 con 0x7f213415db00 2024-04-25T09:57:23.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.663+0000 7f2131d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21340d0a50 0x7f21341f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:23.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.663+0000 7f2131d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21340d0a50 0x7f21341f4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50270/0 (socket says 172.21.15.7:50270) 2024-04-25T09:57:23.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.663+0000 7f2131d9b640 1 -- 172.21.15.7:0/699141668 learned_addr learned my addr 172.21.15.7:0/699141668 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:23.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.664+0000 7f2132d9d640 1 --2- 172.21.15.7:0/699141668 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f213415db00 0x7f21340cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:23.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.663+0000 7f213259c640 1 --2- 172.21.15.7:0/699141668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21340b53b0 0x7f21341f0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:23.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.664+0000 7f2131d9b640 1 -- 172.21.15.7:0/699141668 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f213415db00 msgr2=0x7f21340cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:23.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.664+0000 7f2131d9b640 1 --2- 172.21.15.7:0/699141668 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f213415db00 0x7f21340cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:23.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.664+0000 7f2131d9b640 1 -- 172.21.15.7:0/699141668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21340b53b0 msgr2=0x7f21341f0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:23.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.664+0000 7f2131d9b640 1 --2- 172.21.15.7:0/699141668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21340b53b0 0x7f21341f0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:23.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.664+0000 7f2131d9b640 1 -- 172.21.15.7:0/699141668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213415e0f0 con 0x7f21340d0a50 2024-04-25T09:57:23.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.664+0000 7f2131d9b640 1 --2- 172.21.15.7:0/699141668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21340d0a50 0x7f21341f4610 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f211c000c00 tx=0x7f211c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:23.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.664+0000 7f212affd640 1 -- 172.21.15.7:0/699141668 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c041020 con 0x7f21340d0a50 2024-04-25T09:57:23.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.664+0000 7f212affd640 1 -- 172.21.15.7:0/699141668 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211c0306c0 con 0x7f21340d0a50 2024-04-25T09:57:23.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.664+0000 7f2138f5c640 1 -- 172.21.15.7:0/699141668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f213415e3d0 con 0x7f21340d0a50 2024-04-25T09:57:23.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.664+0000 7f212affd640 1 -- 172.21.15.7:0/699141668 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c037040 con 0x7f21340d0a50 2024-04-25T09:57:23.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.664+0000 7f2138f5c640 1 -- 172.21.15.7:0/699141668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f213415e990 con 0x7f21340d0a50 2024-04-25T09:57:23.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.665+0000 7f2138f5c640 1 -- 172.21.15.7:0/699141668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2134068fd0 con 0x7f21340d0a50 2024-04-25T09:57:23.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.666+0000 7f212affd640 1 -- 172.21.15.7:0/699141668 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f211c044020 con 0x7f21340d0a50 2024-04-25T09:57:23.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.666+0000 7f212affd640 1 --2- 172.21.15.7:0/699141668 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f211406b4d0 0x7f211406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:23.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.666+0000 7f212affd640 1 -- 172.21.15.7:0/699141668 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f211c0aa9e0 con 0x7f21340d0a50 2024-04-25T09:57:23.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.666+0000 7f213259c640 1 --2- 172.21.15.7:0/699141668 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f211406b4d0 0x7f211406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:23.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.666+0000 7f213259c640 1 --2- 172.21.15.7:0/699141668 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f211406b4d0 0x7f211406d990 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f21240012e0 tx=0x7f2124001630 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:23.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.670+0000 7f212affd640 1 -- 172.21.15.7:0/699141668 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f211c04b030 con 0x7f21340d0a50 2024-04-25T09:57:23.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.922+0000 7f2138f5c640 1 -- 172.21.15.7:0/699141668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f21340d16b0 con 0x7f21340d0a50 2024-04-25T09:57:23.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.924+0000 7f212affd640 1 -- 172.21.15.7:0/699141668 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f211c0790f0 con 0x7f21340d0a50 2024-04-25T09:57:23.928 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2024-04-25T09:57:23.928 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAYKCpmaJKeORAALxC5ZqLLEu0zJFG+SOGukQ== 2024-04-25T09:57:23.928 INFO:teuthology.orchestra.run.smithi007.stdout: caps mds = "allow" 2024-04-25T09:57:23.928 INFO:teuthology.orchestra.run.smithi007.stdout: caps mon = "allow r" 2024-04-25T09:57:23.928 INFO:teuthology.orchestra.run.smithi007.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:57:23.928 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2024-04-25T09:57:23.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.926+0000 7f2138f5c640 1 -- 172.21.15.7:0/699141668 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f211406b4d0 msgr2=0x7f211406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:23.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.926+0000 7f2138f5c640 1 --2- 172.21.15.7:0/699141668 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f211406b4d0 0x7f211406d990 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f21240012e0 tx=0x7f2124001630 comp rx=0 tx=0).stop 2024-04-25T09:57:23.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.926+0000 7f2138f5c640 1 -- 172.21.15.7:0/699141668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21340d0a50 msgr2=0x7f21341f4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:23.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.926+0000 7f2138f5c640 1 --2- 172.21.15.7:0/699141668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21340d0a50 0x7f21341f4610 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f211c000c00 tx=0x7f211c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:57:23.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.926+0000 7f2138f5c640 1 -- 172.21.15.7:0/699141668 shutdown_connections 2024-04-25T09:57:23.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.926+0000 7f2138f5c640 1 --2- 172.21.15.7:0/699141668 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f211406b4d0 0x7f211406d990 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:23.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.926+0000 7f2138f5c640 1 --2- 172.21.15.7:0/699141668 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f213415db00 0x7f21340cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:23.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.926+0000 7f2138f5c640 1 --2- 172.21.15.7:0/699141668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21340d0a50 0x7f21341f4610 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:23.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.926+0000 7f2138f5c640 1 --2- 172.21.15.7:0/699141668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21340b53b0 0x7f21341f0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:23.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.926+0000 7f2138f5c640 1 -- 172.21.15.7:0/699141668 >> 172.21.15.7:0/699141668 conn(0x7f2134072290 msgr2=0x7f213415b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:23.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.926+0000 7f2138f5c640 1 -- 172.21.15.7:0/699141668 shutdown_connections 2024-04-25T09:57:23.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:23.926+0000 7f2138f5c640 1 -- 172.21.15.7:0/699141668 wait complete. 2024-04-25T09:57:23.941 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:57:24.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.038+0000 7f30e377e640 1 Processor -- start 2024-04-25T09:57:24.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.038+0000 7f30e377e640 1 -- start start 2024-04-25T09:57:24.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.039+0000 7f30e377e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f30dc0b38b0 0x7f30dc06bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.039+0000 7f30e377e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30dc06c0b0 0x7f30dc06da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.039+0000 7f30e377e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30dc06c4c0 con 0x7f30dc15dbb0 2024-04-25T09:57:24.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.039+0000 7f30e377e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30dc0b3d20 con 0x7f30dc0b38b0 2024-04-25T09:57:24.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.039+0000 7f30e377e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc0cc290 con 0x7f30dc06c0b0 2024-04-25T09:57:24.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.039+0000 7f30e1d1b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30dc06c0b0 0x7f30dc06da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.039+0000 7f30e151a640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f30dc15dbb0 0x7f30dc161ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:53250/0 (socket says 172.21.15.7:53250) 2024-04-25T09:57:24.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.039+0000 7f30e0d19640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f30dc0b38b0 0x7f30dc06bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.039+0000 7f30e151a640 1 -- 172.21.15.7:0/2163961695 learned_addr learned my addr 172.21.15.7:0/2163961695 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:57:24.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.040+0000 7f30d3fff640 1 -- 172.21.15.7:0/2163961695 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2361089835 0 0) 0x7f30d4001110 con 0x7f30dc15dbb0 2024-04-25T09:57:24.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.040+0000 7f30d3fff640 1 -- 172.21.15.7:0/2163961695 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30c8003520 con 0x7f30dc15dbb0 2024-04-25T09:57:24.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.040+0000 7f30e1d1b640 1 -- 172.21.15.7:0/2163961695 >> v2:172.21.15.55:3300/0 conn(0x7f30dc0b38b0 msgr2=0x7f30dc06bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:24.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.040+0000 7f30e1d1b640 1 --2- 172.21.15.7:0/2163961695 >> v2:172.21.15.55:3300/0 conn(0x7f30dc0b38b0 0x7f30dc06bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.040+0000 7f30e1d1b640 1 -- 172.21.15.7:0/2163961695 >> v1:172.21.15.55:6789/0 conn(0x7f30dc15dbb0 legacy=0x7f30dc161ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:24.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.040+0000 7f30e1d1b640 1 -- 172.21.15.7:0/2163961695 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30dc072650 con 0x7f30dc06c0b0 2024-04-25T09:57:24.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.040+0000 7f30e0d19640 1 --2- 172.21.15.7:0/2163961695 >> v2:172.21.15.55:3300/0 conn(0x7f30dc0b38b0 0x7f30dc06bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:57:24.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.041+0000 7f30e1d1b640 1 --2- 172.21.15.7:0/2163961695 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30dc06c0b0 0x7f30dc06da00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f30d8009d90 tx=0x7f30d802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a96091c5e085302a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:24.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.041+0000 7f30d3fff640 1 -- 172.21.15.7:0/2163961695 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d8007740 con 0x7f30dc06c0b0 2024-04-25T09:57:24.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.041+0000 7f30d3fff640 1 -- 172.21.15.7:0/2163961695 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d80078e0 con 0x7f30dc06c0b0 2024-04-25T09:57:24.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.041+0000 7f30d3fff640 1 -- 172.21.15.7:0/2163961695 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d8007cb0 con 0x7f30dc06c0b0 2024-04-25T09:57:24.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.041+0000 7f30e377e640 1 -- 172.21.15.7:0/2163961695 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30dc06c0b0 msgr2=0x7f30dc06da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:24.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.041+0000 7f30e377e640 1 --2- 172.21.15.7:0/2163961695 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30dc06c0b0 0x7f30dc06da00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f30d8009d90 tx=0x7f30d802a660 comp rx=0 tx=0).stop 2024-04-25T09:57:24.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.041+0000 7f30e377e640 1 -- 172.21.15.7:0/2163961695 shutdown_connections 2024-04-25T09:57:24.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.041+0000 7f30e377e640 1 --2- 172.21.15.7:0/2163961695 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30dc06c0b0 0x7f30dc06da00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.041+0000 7f30e377e640 1 --2- 172.21.15.7:0/2163961695 >> v2:172.21.15.55:3300/0 conn(0x7f30dc0b38b0 0x7f30dc06bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.041+0000 7f30e377e640 1 -- 172.21.15.7:0/2163961695 >> 172.21.15.7:0/2163961695 conn(0x7f30dc0719c0 msgr2=0x7f30dc071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:24.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.041+0000 7f30e377e640 1 -- 172.21.15.7:0/2163961695 shutdown_connections 2024-04-25T09:57:24.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.041+0000 7f30e377e640 1 -- 172.21.15.7:0/2163961695 wait complete. 2024-04-25T09:57:24.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.042+0000 7f30e377e640 1 Processor -- start 2024-04-25T09:57:24.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.043+0000 7f30e377e640 1 -- start start 2024-04-25T09:57:24.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.043+0000 7f30e377e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30dc06c0b0 0x7f30dc1f49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.043+0000 7f30e377e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30dc0b38b0 0x7f30dc15cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.043+0000 7f30e377e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30dc15dbb0 0x7f30dc157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.043+0000 7f30e377e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc0cbed0 con 0x7f30dc0b38b0 2024-04-25T09:57:24.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.043+0000 7f30e377e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc066b80 con 0x7f30dc15dbb0 2024-04-25T09:57:24.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.043+0000 7f30e377e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc0cc050 con 0x7f30dc06c0b0 2024-04-25T09:57:24.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.043+0000 7f30e0d19640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30dc0b38b0 0x7f30dc15cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.043+0000 7f30e0d19640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30dc0b38b0 0x7f30dc15cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50280/0 (socket says 172.21.15.7:50280) 2024-04-25T09:57:24.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.043+0000 7f30e0d19640 1 -- 172.21.15.7:0/455550008 learned_addr learned my addr 172.21.15.7:0/455550008 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:24.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.043+0000 7f30e151a640 1 --2- 172.21.15.7:0/455550008 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30dc06c0b0 0x7f30dc1f49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.043+0000 7f30e1d1b640 1 --2- 172.21.15.7:0/455550008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30dc15dbb0 0x7f30dc157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.044+0000 7f30e0d19640 1 -- 172.21.15.7:0/455550008 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30dc06c0b0 msgr2=0x7f30dc1f49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:24.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.044+0000 7f30e0d19640 1 --2- 172.21.15.7:0/455550008 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30dc06c0b0 0x7f30dc1f49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.044+0000 7f30e0d19640 1 -- 172.21.15.7:0/455550008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30dc15dbb0 msgr2=0x7f30dc157ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:24.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.044+0000 7f30e0d19640 1 --2- 172.21.15.7:0/455550008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30dc15dbb0 0x7f30dc157ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.044+0000 7f30e0d19640 1 -- 172.21.15.7:0/455550008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30dc0ceba0 con 0x7f30dc0b38b0 2024-04-25T09:57:24.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.044+0000 7f30e0d19640 1 --2- 172.21.15.7:0/455550008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30dc0b38b0 0x7f30dc15cbb0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f30cc00ec10 tx=0x7f30cc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:24.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.044+0000 7f30d1ffb640 1 -- 172.21.15.7:0/455550008 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc017070 con 0x7f30dc0b38b0 2024-04-25T09:57:24.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.044+0000 7f30d1ffb640 1 -- 172.21.15.7:0/455550008 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30cc00cc30 con 0x7f30dc0b38b0 2024-04-25T09:57:24.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.044+0000 7f30e377e640 1 -- 172.21.15.7:0/455550008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30dc156780 con 0x7f30dc0b38b0 2024-04-25T09:57:24.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.044+0000 7f30d1ffb640 1 -- 172.21.15.7:0/455550008 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc013470 con 0x7f30dc0b38b0 2024-04-25T09:57:24.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.044+0000 7f30e377e640 1 -- 172.21.15.7:0/455550008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30dc157020 con 0x7f30dc0b38b0 2024-04-25T09:57:24.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.045+0000 7f30e377e640 1 -- 172.21.15.7:0/455550008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30dc068fd0 con 0x7f30dc0b38b0 2024-04-25T09:57:24.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.046+0000 7f30d1ffb640 1 -- 172.21.15.7:0/455550008 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f30cc01a070 con 0x7f30dc0b38b0 2024-04-25T09:57:24.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.046+0000 7f30d1ffb640 1 --2- 172.21.15.7:0/455550008 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f30c006b4d0 0x7f30c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.046+0000 7f30d1ffb640 1 -- 172.21.15.7:0/455550008 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f30cc08a1e0 con 0x7f30dc0b38b0 2024-04-25T09:57:24.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.046+0000 7f30e151a640 1 --2- 172.21.15.7:0/455550008 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f30c006b4d0 0x7f30c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.047+0000 7f30e151a640 1 --2- 172.21.15.7:0/455550008 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f30c006b4d0 0x7f30c006d990 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f30d4005880 tx=0x7f30d4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:24.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.051+0000 7f30d1ffb640 1 -- 172.21.15.7:0/455550008 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f30cc058910 con 0x7f30dc0b38b0 2024-04-25T09:57:24.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.266+0000 7f30e377e640 1 -- 172.21.15.7:0/455550008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30dc0ad520 con 0x7f30dc0b38b0 2024-04-25T09:57:24.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.267+0000 7f30d1ffb640 1 -- 172.21.15.7:0/455550008 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4933 (secure 0 0 0) 0x7f30cc05c9b0 con 0x7f30dc0b38b0 2024-04-25T09:57:24.270 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:57:24.271 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3706118852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3706118852},{"type":"v1","addr":"172.21.15.55:6833","nonce":3706118852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5354,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1513522793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1513522793},{"type":"v1","addr":"172.21.15.55:6835","nonce":1513522793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5782,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1231382839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1231382839},{"type":"v1","addr":"172.21.15.7:6837","nonce":1231382839}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:57:15.098282+0000","modified":"2024-04-25T09:57:17.101919+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6836/3057688863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3057688863},{"type":"v1","addr":"172.21.15.7:6836","nonce":3057688863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:57:24.271 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 28 2024-04-25T09:57:24.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.269+0000 7f30e377e640 1 -- 172.21.15.7:0/455550008 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f30c006b4d0 msgr2=0x7f30c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:24.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.269+0000 7f30e377e640 1 --2- 172.21.15.7:0/455550008 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f30c006b4d0 0x7f30c006d990 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f30d4005880 tx=0x7f30d4009040 comp rx=0 tx=0).stop 2024-04-25T09:57:24.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.269+0000 7f30e377e640 1 -- 172.21.15.7:0/455550008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30dc0b38b0 msgr2=0x7f30dc15cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:24.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.269+0000 7f30e377e640 1 --2- 172.21.15.7:0/455550008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30dc0b38b0 0x7f30dc15cbb0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f30cc00ec10 tx=0x7f30cc00c520 comp rx=0 tx=0).stop 2024-04-25T09:57:24.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.269+0000 7f30e377e640 1 -- 172.21.15.7:0/455550008 shutdown_connections 2024-04-25T09:57:24.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.269+0000 7f30e377e640 1 --2- 172.21.15.7:0/455550008 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f30c006b4d0 0x7f30c006d990 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.269+0000 7f30e377e640 1 --2- 172.21.15.7:0/455550008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30dc15dbb0 0x7f30dc157ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.269+0000 7f30e377e640 1 --2- 172.21.15.7:0/455550008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30dc0b38b0 0x7f30dc15cbb0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.269+0000 7f30e377e640 1 --2- 172.21.15.7:0/455550008 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30dc06c0b0 0x7f30dc1f49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.269+0000 7f30e377e640 1 -- 172.21.15.7:0/455550008 >> 172.21.15.7:0/455550008 conn(0x7f30dc0719c0 msgr2=0x7f30dc06ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:24.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.269+0000 7f30e377e640 1 -- 172.21.15.7:0/455550008 shutdown_connections 2024-04-25T09:57:24.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.269+0000 7f30e377e640 1 -- 172.21.15.7:0/455550008 wait complete. 2024-04-25T09:57:24.685 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:57:15.098282+0000', 'modified': '2024-04-25T09:57:17.101919+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6285': {'gid': 6285, 'name': 'a', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.7:6836/3057688863', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 3057688863}, {'type': 'v1', 'addr': '172.21.15.7:6836', 'nonce': 3057688863}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:57:24.686 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:57:24.686 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T09:57:24.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.789+0000 7f48eb638640 1 Processor -- start 2024-04-25T09:57:24.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.790+0000 7f48eb638640 1 -- start start 2024-04-25T09:57:24.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.790+0000 7f48eb638640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f48e406b270 0x7f48e40af760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.790+0000 7f48eb638640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f48e40d1010 0x7f48e40b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.790+0000 7f48eb638640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e40d1460 con 0x7f48e415dad0 2024-04-25T09:57:24.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.790+0000 7f48eb638640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e41616c0 con 0x7f48e40d1010 2024-04-25T09:57:24.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.790+0000 7f48eb638640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e41619a0 con 0x7f48e406b270 2024-04-25T09:57:24.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.791+0000 7f48e93d4640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f48e415dad0 0x7f48e406ab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38194/0 (socket says 172.21.15.7:38194) 2024-04-25T09:57:24.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.791+0000 7f48e93d4640 1 -- 172.21.15.7:0/3890503084 learned_addr learned my addr 172.21.15.7:0/3890503084 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:57:24.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.791+0000 7f48e9bd5640 1 --2- 172.21.15.7:0/3890503084 >> v2:172.21.15.55:3300/0 conn(0x7f48e40d1010 0x7f48e40b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.791+0000 7f48e8bd3640 1 --2- 172.21.15.7:0/3890503084 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f48e406b270 0x7f48e40af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.791+0000 7f48e3fff640 1 -- 172.21.15.7:0/3890503084 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1618991648 0 0) 0x7f48e40d1460 con 0x7f48e415dad0 2024-04-25T09:57:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.791+0000 7f48e3fff640 1 -- 172.21.15.7:0/3890503084 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48cc003520 con 0x7f48e415dad0 2024-04-25T09:57:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.791+0000 7f48e3fff640 1 -- 172.21.15.7:0/3890503084 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3924090081 0 0) 0x7f48cc003520 con 0x7f48e415dad0 2024-04-25T09:57:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.791+0000 7f48e3fff640 1 -- 172.21.15.7:0/3890503084 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f48e406b270 msgr2=0x7f48e40af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.791+0000 7f48e3fff640 1 --2- 172.21.15.7:0/3890503084 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f48e406b270 0x7f48e40af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.791+0000 7f48e3fff640 1 -- 172.21.15.7:0/3890503084 >> v2:172.21.15.55:3300/0 conn(0x7f48e40d1010 msgr2=0x7f48e40b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.791+0000 7f48e3fff640 1 --2- 172.21.15.7:0/3890503084 >> v2:172.21.15.55:3300/0 conn(0x7f48e40d1010 0x7f48e40b3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.791+0000 7f48e3fff640 1 -- 172.21.15.7:0/3890503084 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e4161c80 con 0x7f48e415dad0 2024-04-25T09:57:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.791+0000 7f48e3fff640 1 -- 172.21.15.7:0/3890503084 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f48d40019f0 con 0x7f48e415dad0 2024-04-25T09:57:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.791+0000 7f48e3fff640 1 -- 172.21.15.7:0/3890503084 >> v1:172.21.15.7:6789/0 conn(0x7f48e415dad0 legacy=0x7f48e406ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.791+0000 7f48e3fff640 1 --2- 172.21.15.7:0/3890503084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48cc0039b0 0x7f48cc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.791+0000 7f48e3fff640 1 --2- 172.21.15.7:0/3890503084 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f48e406b270 0x7f48cc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.791+0000 7f48e3fff640 1 --2- 172.21.15.7:0/3890503084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48cc004d40 0x7f48cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.791+0000 7f48e3fff640 1 -- 172.21.15.7:0/3890503084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e41616c0 con 0x7f48cc0039b0 2024-04-25T09:57:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.791+0000 7f48e3fff640 1 -- 172.21.15.7:0/3890503084 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e41619a0 con 0x7f48cc004d40 2024-04-25T09:57:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.791+0000 7f48e3fff640 1 -- 172.21.15.7:0/3890503084 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc00b9c0 con 0x7f48e406b270 2024-04-25T09:57:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.791+0000 7f48e93d4640 1 --2- 172.21.15.7:0/3890503084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48cc0039b0 0x7f48cc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.791+0000 7f48e8bd3640 1 --2- 172.21.15.7:0/3890503084 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f48e406b270 0x7f48cc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.791+0000 7f48e9bd5640 1 --2- 172.21.15.7:0/3890503084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48cc004d40 0x7f48cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.792+0000 7f48e93d4640 1 -- 172.21.15.7:0/3890503084 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f48e406b270 msgr2=0x7f48cc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.792+0000 7f48e93d4640 1 --2- 172.21.15.7:0/3890503084 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f48e406b270 0x7f48cc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.792+0000 7f48e93d4640 1 -- 172.21.15.7:0/3890503084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48cc004d40 msgr2=0x7f48cc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.792+0000 7f48e93d4640 1 --2- 172.21.15.7:0/3890503084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48cc004d40 0x7f48cc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.792+0000 7f48e93d4640 1 -- 172.21.15.7:0/3890503084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48cc003520 con 0x7f48cc0039b0 2024-04-25T09:57:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.792+0000 7f48e93d4640 1 --2- 172.21.15.7:0/3890503084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48cc0039b0 0x7f48cc003dd0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f48d400a870 tx=0x7f48cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2205090a69492e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.792+0000 7f48e3fff640 1 -- 172.21.15.7:0/3890503084 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d400a4c0 con 0x7f48cc0039b0 2024-04-25T09:57:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.793+0000 7f48e3fff640 1 -- 172.21.15.7:0/3890503084 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d402f070 con 0x7f48cc0039b0 2024-04-25T09:57:24.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.793+0000 7f48e3fff640 1 -- 172.21.15.7:0/3890503084 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d402bcc0 con 0x7f48cc0039b0 2024-04-25T09:57:24.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.793+0000 7f48eb638640 1 -- 172.21.15.7:0/3890503084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48cc0039b0 msgr2=0x7f48cc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:24.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.793+0000 7f48eb638640 1 --2- 172.21.15.7:0/3890503084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48cc0039b0 0x7f48cc003dd0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f48d400a870 tx=0x7f48cc005830 comp rx=0 tx=0).stop 2024-04-25T09:57:24.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.793+0000 7f48e9bd5640 1 -- 172.21.15.7:0/3890503084 reap_dead start 2024-04-25T09:57:24.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.793+0000 7f48eb638640 1 -- 172.21.15.7:0/3890503084 shutdown_connections 2024-04-25T09:57:24.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.793+0000 7f48eb638640 1 -- 172.21.15.7:0/3890503084 >> 172.21.15.7:0/3890503084 conn(0x7f48e40b2400 msgr2=0x7f48e40b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:24.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.793+0000 7f48eb638640 1 -- 172.21.15.7:0/3890503084 shutdown_connections 2024-04-25T09:57:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.793+0000 7f48eb638640 1 -- 172.21.15.7:0/3890503084 wait complete. 2024-04-25T09:57:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.794+0000 7f48eb638640 1 Processor -- start 2024-04-25T09:57:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.794+0000 7f48eb638640 1 -- start start 2024-04-25T09:57:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.795+0000 7f48eb638640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48cc0039b0 0x7f48e4148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.795+0000 7f48eb638640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f48e41530a0 0x7f48e415e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.795+0000 7f48eb638640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48e41e7d60 0x7f48e415e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.795+0000 7f48eb638640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e415deb0 con 0x7f48cc0039b0 2024-04-25T09:57:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.795+0000 7f48eb638640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e4162240 con 0x7f48e41e7d60 2024-04-25T09:57:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.795+0000 7f48eb638640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e40af760 con 0x7f48e41530a0 2024-04-25T09:57:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.795+0000 7f48e93d4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48cc0039b0 0x7f48e4148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.795+0000 7f48e93d4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48cc0039b0 0x7f48e4148180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50292/0 (socket says 172.21.15.7:50292) 2024-04-25T09:57:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.795+0000 7f48e93d4640 1 -- 172.21.15.7:0/519149552 learned_addr learned my addr 172.21.15.7:0/519149552 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.795+0000 7f48e8bd3640 1 --2- 172.21.15.7:0/519149552 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f48e41530a0 0x7f48e415e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.795+0000 7f48e9bd5640 1 --2- 172.21.15.7:0/519149552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48e41e7d60 0x7f48e415e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.795+0000 7f48e93d4640 1 -- 172.21.15.7:0/519149552 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f48e41530a0 msgr2=0x7f48e415e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.796+0000 7f48e93d4640 1 --2- 172.21.15.7:0/519149552 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f48e41530a0 0x7f48e415e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.796+0000 7f48e93d4640 1 -- 172.21.15.7:0/519149552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48e41e7d60 msgr2=0x7f48e415e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.796+0000 7f48e93d4640 1 --2- 172.21.15.7:0/519149552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48e41e7d60 0x7f48e415e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.796+0000 7f48e93d4640 1 -- 172.21.15.7:0/519149552 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e41603f0 con 0x7f48cc0039b0 2024-04-25T09:57:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.796+0000 7f48e93d4640 1 --2- 172.21.15.7:0/519149552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48cc0039b0 0x7f48e4148180 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f48d402b530 tx=0x7f48d4001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.796+0000 7f48e1ffb640 1 -- 172.21.15.7:0/519149552 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d402ba80 con 0x7f48cc0039b0 2024-04-25T09:57:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.796+0000 7f48e1ffb640 1 -- 172.21.15.7:0/519149552 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d402bc20 con 0x7f48cc0039b0 2024-04-25T09:57:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.796+0000 7f48eb638640 1 -- 172.21.15.7:0/519149552 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e41606d0 con 0x7f48cc0039b0 2024-04-25T09:57:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.796+0000 7f48e1ffb640 1 -- 172.21.15.7:0/519149552 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d4004e30 con 0x7f48cc0039b0 2024-04-25T09:57:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.796+0000 7f48eb638640 1 -- 172.21.15.7:0/519149552 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e41537f0 con 0x7f48cc0039b0 2024-04-25T09:57:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.798+0000 7f48e1ffb640 1 -- 172.21.15.7:0/519149552 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f48d4034470 con 0x7f48cc0039b0 2024-04-25T09:57:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.798+0000 7f48e1ffb640 1 --2- 172.21.15.7:0/519149552 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f48d006b4c0 0x7f48d006d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.798+0000 7f48e1ffb640 1 -- 172.21.15.7:0/519149552 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f48d40aa910 con 0x7f48cc0039b0 2024-04-25T09:57:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.798+0000 7f48e8bd3640 1 --2- 172.21.15.7:0/519149552 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f48d006b4c0 0x7f48d006d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.799+0000 7f48e8bd3640 1 --2- 172.21.15.7:0/519149552 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f48d006b4c0 0x7f48d006d980 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f48e40ccb30 tx=0x7f48d8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.799+0000 7f48ee41c740 1 Processor -- start 2024-04-25T09:57:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.799+0000 7f48ee41c740 1 -- start start 2024-04-25T09:57:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.800+0000 7f48ee41c740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d387b7230 0x556d387b7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.800+0000 7f48ee41c740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556d387d4ad0 0x556d387d5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.800+0000 7f48ee41c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d3878cf10 0x556d387d3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.800+0000 7f48ee41c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d386efa10 con 0x556d3878cf10 2024-04-25T09:57:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.800+0000 7f48ee41c740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d38698b30 con 0x556d387b7230 2024-04-25T09:57:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.800+0000 7f48ee41c740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x556d386ebc50 con 0x556d387d4ad0 2024-04-25T09:57:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.800+0000 7f48e9bd5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d3878cf10 0x556d387d3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.800+0000 7f48e9bd5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d3878cf10 0x556d387d3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50300/0 (socket says 172.21.15.7:50300) 2024-04-25T09:57:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.800+0000 7f48e9bd5640 1 -- 172.21.15.7:0/3769402475 learned_addr learned my addr 172.21.15.7:0/3769402475 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:24.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.800+0000 7f48e8bd3640 1 --2- 172.21.15.7:0/3769402475 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556d387d4ad0 0x556d387d5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.800+0000 7f48e93d4640 1 --2- 172.21.15.7:0/3769402475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d387b7230 0x556d387b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.800+0000 7f48e9bd5640 1 -- 172.21.15.7:0/3769402475 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556d387d4ad0 msgr2=0x556d387d5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:24.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.800+0000 7f48e9bd5640 1 --2- 172.21.15.7:0/3769402475 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556d387d4ad0 0x556d387d5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.800+0000 7f48e9bd5640 1 -- 172.21.15.7:0/3769402475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d387b7230 msgr2=0x556d387b7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:24.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.800+0000 7f48e9bd5640 1 --2- 172.21.15.7:0/3769402475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d387b7230 0x556d387b7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.800+0000 7f48e9bd5640 1 -- 172.21.15.7:0/3769402475 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d386ade10 con 0x556d3878cf10 2024-04-25T09:57:24.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.800+0000 7f48e9bd5640 1 --2- 172.21.15.7:0/3769402475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d3878cf10 0x556d387d3190 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f48e406cc50 tx=0x7f48dc009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55bd487b24cf4319 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:24.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.801+0000 7f48caffd640 1 -- 172.21.15.7:0/3769402475 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48dc014b50 con 0x556d3878cf10 2024-04-25T09:57:24.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.801+0000 7f48caffd640 1 -- 172.21.15.7:0/3769402475 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48dc014cf0 con 0x556d3878cf10 2024-04-25T09:57:24.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.801+0000 7f48caffd640 1 -- 172.21.15.7:0/3769402475 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48dc014ea0 con 0x556d3878cf10 2024-04-25T09:57:24.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.801+0000 7f48ee41c740 1 -- 172.21.15.7:0/3769402475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d3878cf10 msgr2=0x556d387d3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:24.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.801+0000 7f48ee41c740 1 --2- 172.21.15.7:0/3769402475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d3878cf10 0x556d387d3190 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f48e406cc50 tx=0x7f48dc009190 comp rx=0 tx=0).stop 2024-04-25T09:57:24.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.801+0000 7f48ee41c740 1 -- 172.21.15.7:0/3769402475 shutdown_connections 2024-04-25T09:57:24.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.801+0000 7f48ee41c740 1 --2- 172.21.15.7:0/3769402475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d3878cf10 0x556d387d3190 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.801+0000 7f48ee41c740 1 --2- 172.21.15.7:0/3769402475 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556d387d4ad0 0x556d387d5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.801+0000 7f48ee41c740 1 --2- 172.21.15.7:0/3769402475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d387b7230 0x556d387b7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.801+0000 7f48ee41c740 1 -- 172.21.15.7:0/3769402475 >> 172.21.15.7:0/3769402475 conn(0x556d38789840 msgr2=0x556d387d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:24.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.801+0000 7f48ee41c740 1 -- 172.21.15.7:0/3769402475 shutdown_connections 2024-04-25T09:57:24.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.801+0000 7f48ee41c740 1 -- 172.21.15.7:0/3769402475 wait complete. 2024-04-25T09:57:24.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.802+0000 7f48ee41c740 1 -- start start 2024-04-25T09:57:24.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.802+0000 7f48ee41c740 1 Processor -- start 2024-04-25T09:57:24.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.803+0000 7f48ee41c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d387b7230 0x556d387b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.803+0000 7f48ee41c740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d387d4ad0 0x556d387caf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.803+0000 7f48ee41c740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556d387864a0 0x556d38786920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.803+0000 7f48ee41c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d3878dcb0 con 0x556d387b7230 2024-04-25T09:57:24.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.803+0000 7f48ee41c740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d386ac0c0 con 0x556d387d4ad0 2024-04-25T09:57:24.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.803+0000 7f48ee41c740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x556d38787770 con 0x556d387864a0 2024-04-25T09:57:24.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.803+0000 7f48ee41c740 10 client.0 _ll_register_callbacks cb 0x556d3869fec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:57:24.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.803+0000 7f48e93d4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d387b7230 0x556d387b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.803+0000 7f48e93d4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d387b7230 0x556d387b3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50314/0 (socket says 172.21.15.7:50314) 2024-04-25T09:57:24.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.803+0000 7f48e93d4640 1 -- 172.21.15.7:0/2825859619 learned_addr learned my addr 172.21.15.7:0/2825859619 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:24.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.803+0000 7f48e8bd3640 1 --2- 172.21.15.7:0/2825859619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d387d4ad0 0x556d387caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.803+0000 7f48e9bd5640 1 --2- 172.21.15.7:0/2825859619 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556d387864a0 0x556d38786920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.803+0000 7f48e93d4640 1 -- 172.21.15.7:0/2825859619 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556d387864a0 msgr2=0x556d38786920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:24.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.803+0000 7f48e93d4640 1 --2- 172.21.15.7:0/2825859619 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556d387864a0 0x556d38786920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.803+0000 7f48e93d4640 1 -- 172.21.15.7:0/2825859619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d387d4ad0 msgr2=0x556d387caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:24.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.803+0000 7f48e93d4640 1 --2- 172.21.15.7:0/2825859619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d387d4ad0 0x556d387caf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.803+0000 7f48e93d4640 1 -- 172.21.15.7:0/2825859619 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556d384042d0 con 0x556d387b7230 2024-04-25T09:57:24.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.803+0000 7f48e9bd5640 1 --2- 172.21.15.7:0/2825859619 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556d387864a0 0x556d38786920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:57:24.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.803+0000 7f48e8bd3640 1 --2- 172.21.15.7:0/2825859619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d387d4ad0 0x556d387caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:57:24.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.803+0000 7f48e93d4640 1 --2- 172.21.15.7:0/2825859619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d387b7230 0x556d387b3bd0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f48d4078e90 tx=0x7f48d4033ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d43e1b6d2219c39 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:24.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.803+0000 7f48c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:57:24.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.803+0000 7f48c3fff640 1 -- 172.21.15.7:0/2825859619 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d407d050 con 0x556d387b7230 2024-04-25T09:57:24.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.804+0000 7f48c3fff640 1 -- 172.21.15.7:0/2825859619 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f48d4081180 con 0x556d387b7230 2024-04-25T09:57:24.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.804+0000 7f48ee41c740 1 -- 172.21.15.7:0/2825859619 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f48dc014cf0 con 0x556d387b7230 2024-04-25T09:57:24.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.804+0000 7f48c3fff640 1 -- 172.21.15.7:0/2825859619 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f48d4097050 con 0x556d387b7230 2024-04-25T09:57:24.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.804+0000 7f48ee41c740 10 client.6441 fetch_fsmap learned FSMap version 28 2024-04-25T09:57:24.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.804+0000 7f48ee41c740 1 -- 172.21.15.7:0/2825859619 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x556d384ce6b0 con 0x556d387b7230 2024-04-25T09:57:24.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.804+0000 7f48c3fff640 1 -- 172.21.15.7:0/2825859619 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48dc014cf0 con 0x556d387b7230 2024-04-25T09:57:24.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.804+0000 7f48c3fff640 1 -- 172.21.15.7:0/2825859619 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f48d4048030 con 0x556d387b7230 2024-04-25T09:57:24.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.804+0000 7f48ee41c740 10 client.6441 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T09:57:24.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.804+0000 7f48ee41c740 10 client.6441 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:57:24.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.804+0000 7f48ee41c740 20 client.6441 populate_metadata read hostname 'smithi007' 2024-04-25T09:57:24.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.804+0000 7f48ee41c740 1 --2- 172.21.15.7:0/2825859619 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x556d387b91c0 0x556d387b95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.804+0000 7f48ee41c740 4 client.6441 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:57:24.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.804+0000 7f48ee41c740 1 -- 172.21.15.7:0/2825859619 --> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556d3874e920 con 0x556d387b91c0 2024-04-25T09:57:24.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.804+0000 7f48e8bd3640 1 --2- 172.21.15.7:0/2825859619 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x556d387b91c0 0x556d387b95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.804+0000 7f48e8bd3640 1 --2- 172.21.15.7:0/2825859619 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x556d387b91c0 0x556d387b95a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa6444f4b04920cc server_cookie=6efc9728565f254c in_seq=0 out_seq=0 2024-04-25T09:57:24.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.804+0000 7f48c3fff640 10 client.6441 ms_handle_connect on v2:172.21.15.7:6834/3057688863 2024-04-25T09:57:24.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.805+0000 7f48c3fff640 1 -- 172.21.15.7:0/2825859619 <== mds.0 v2:172.21.15.7:6834/3057688863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556d3874e920 con 0x556d387b91c0 2024-04-25T09:57:24.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.805+0000 7f48c3fff640 10 client.6441 handle_command_reply: tid=0 2024-04-25T09:57:24.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.805+0000 7f48ee41c740 1 client.6441 shutdown 2024-04-25T09:57:24.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.805+0000 7f48ee41c740 1 -- 172.21.15.7:0/2825859619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d387b7230 msgr2=0x556d387b3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:24.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.805+0000 7f48ee41c740 1 --2- 172.21.15.7:0/2825859619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d387b7230 0x556d387b3bd0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f48d4078e90 tx=0x7f48d4033ff0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.805+0000 7f48ee41c740 1 -- 172.21.15.7:0/2825859619 shutdown_connections 2024-04-25T09:57:24.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.805+0000 7f48ee41c740 1 --2- 172.21.15.7:0/2825859619 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x556d387b91c0 0x556d387b95a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.805+0000 7f48ee41c740 1 --2- 172.21.15.7:0/2825859619 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556d387864a0 0x556d38786920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.805+0000 7f48ee41c740 1 --2- 172.21.15.7:0/2825859619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d387d4ad0 0x556d387caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.805+0000 7f48ee41c740 1 --2- 172.21.15.7:0/2825859619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d387b7230 0x556d387b3bd0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.805+0000 7f48ee41c740 1 -- 172.21.15.7:0/2825859619 >> 172.21.15.7:0/2825859619 conn(0x556d3878cf10 msgr2=0x556d387d55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:24.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.805+0000 7f48c3fff640 0 client.6441 ms_handle_reset on v2:172.21.15.7:6834/3057688863 2024-04-25T09:57:24.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.805+0000 7f48ee41c740 1 -- 172.21.15.7:0/2825859619 shutdown_connections 2024-04-25T09:57:24.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.805+0000 7f48ee41c740 1 -- 172.21.15.7:0/2825859619 wait complete. 2024-04-25T09:57:24.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.805+0000 7f48ee41c740 20 client.6441 trim_cache size 0 max 16384 2024-04-25T09:57:24.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.821+0000 7f48ee41c740 1 Processor -- start 2024-04-25T09:57:24.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.821+0000 7f48ee41c740 1 -- start start 2024-04-25T09:57:24.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.822+0000 7f48ee41c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d387864a0 0x556d387bab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.822+0000 7f48ee41c740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556d387b7230 0x556d387d2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.822+0000 7f48ee41c740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d387d4ad0 0x556d3878ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.822+0000 7f48ee41c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e41ffbd0 con 0x556d387864a0 2024-04-25T09:57:24.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.822+0000 7f48ee41c740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e4154f40 con 0x556d387d4ad0 2024-04-25T09:57:24.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.822+0000 7f48ee41c740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e41ff5d0 con 0x556d387b7230 2024-04-25T09:57:24.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.822+0000 7f48e93d4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d387864a0 0x556d387bab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.822+0000 7f48e93d4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d387864a0 0x556d387bab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50322/0 (socket says 172.21.15.7:50322) 2024-04-25T09:57:24.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.822+0000 7f48e93d4640 1 -- 172.21.15.7:0/722361144 learned_addr learned my addr 172.21.15.7:0/722361144 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:24.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.822+0000 7f48e8bd3640 1 --2- 172.21.15.7:0/722361144 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556d387b7230 0x556d387d2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.822+0000 7f48e9bd5640 1 --2- 172.21.15.7:0/722361144 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d387d4ad0 0x556d3878ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.822+0000 7f48e93d4640 1 -- 172.21.15.7:0/722361144 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556d387b7230 msgr2=0x556d387d2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:24.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.822+0000 7f48e93d4640 1 --2- 172.21.15.7:0/722361144 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556d387b7230 0x556d387d2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.822+0000 7f48e93d4640 1 -- 172.21.15.7:0/722361144 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d387d4ad0 msgr2=0x556d3878ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:24.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.822+0000 7f48e93d4640 1 --2- 172.21.15.7:0/722361144 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d387d4ad0 0x556d3878ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.822+0000 7f48e93d4640 1 -- 172.21.15.7:0/722361144 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d384ce6b0 con 0x556d387864a0 2024-04-25T09:57:24.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.822+0000 7f48e8bd3640 1 --2- 172.21.15.7:0/722361144 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556d387b7230 0x556d387d2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:57:24.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.822+0000 7f48e9bd5640 1 --2- 172.21.15.7:0/722361144 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d387d4ad0 0x556d3878ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:57:24.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.822+0000 7f48e93d4640 1 --2- 172.21.15.7:0/722361144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d387864a0 0x556d387bab20 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f48d4075310 tx=0x7f48d408e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92661b2b116d3d24 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:24.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.823+0000 7f48ca7fc640 1 -- 172.21.15.7:0/722361144 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d4078a40 con 0x556d387864a0 2024-04-25T09:57:24.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.823+0000 7f48ca7fc640 1 -- 172.21.15.7:0/722361144 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d40a7070 con 0x556d387864a0 2024-04-25T09:57:24.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.823+0000 7f48ca7fc640 1 -- 172.21.15.7:0/722361144 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d4081180 con 0x556d387864a0 2024-04-25T09:57:24.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.823+0000 7f48ee41c740 1 -- 172.21.15.7:0/722361144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d387864a0 msgr2=0x556d387bab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:24.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.823+0000 7f48ee41c740 1 --2- 172.21.15.7:0/722361144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d387864a0 0x556d387bab20 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f48d4075310 tx=0x7f48d408e000 comp rx=0 tx=0).stop 2024-04-25T09:57:24.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.823+0000 7f48ee41c740 1 -- 172.21.15.7:0/722361144 shutdown_connections 2024-04-25T09:57:24.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.823+0000 7f48ee41c740 1 --2- 172.21.15.7:0/722361144 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d387d4ad0 0x556d3878ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.823+0000 7f48ee41c740 1 --2- 172.21.15.7:0/722361144 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556d387b7230 0x556d387d2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.823+0000 7f48ee41c740 1 --2- 172.21.15.7:0/722361144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d387864a0 0x556d387bab20 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.823+0000 7f48ee41c740 1 -- 172.21.15.7:0/722361144 >> 172.21.15.7:0/722361144 conn(0x556d3878cf10 msgr2=0x556d387b2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:24.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.823+0000 7f48ee41c740 1 -- 172.21.15.7:0/722361144 shutdown_connections 2024-04-25T09:57:24.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.823+0000 7f48ee41c740 1 -- 172.21.15.7:0/722361144 wait complete. 2024-04-25T09:57:24.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.824+0000 7f48ee41c740 1 -- start start 2024-04-25T09:57:24.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.824+0000 7f48ee41c740 1 Processor -- start 2024-04-25T09:57:24.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.825+0000 7f48ee41c740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d387864a0 0x556d388374a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.825+0000 7f48ee41c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d387b7230 0x556d387cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.825+0000 7f48ee41c740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556d387d4ad0 0x556d3878ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.825+0000 7f48ee41c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d387e60d0 con 0x556d387b7230 2024-04-25T09:57:24.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.825+0000 7f48ee41c740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d3878dcb0 con 0x556d387864a0 2024-04-25T09:57:24.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.825+0000 7f48ee41c740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x556d387ca040 con 0x556d387d4ad0 2024-04-25T09:57:24.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.825+0000 7f48ee41c740 10 client.0 _ll_register_callbacks cb 0x556d38787c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:57:24.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.825+0000 7f48e8bd3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d387b7230 0x556d387cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.825+0000 7f48e8bd3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d387b7230 0x556d387cc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50338/0 (socket says 172.21.15.7:50338) 2024-04-25T09:57:24.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.825+0000 7f48e93d4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d387864a0 0x556d388374a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.825+0000 7f48e8bd3640 1 -- 172.21.15.7:0/3573532058 learned_addr learned my addr 172.21.15.7:0/3573532058 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:24.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.825+0000 7f48e9bd5640 1 --2- 172.21.15.7:0/3573532058 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556d387d4ad0 0x556d3878ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.825+0000 7f48e8bd3640 1 -- 172.21.15.7:0/3573532058 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556d387d4ad0 msgr2=0x556d3878ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:24.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.825+0000 7f48e8bd3640 1 --2- 172.21.15.7:0/3573532058 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556d387d4ad0 0x556d3878ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.825+0000 7f48e8bd3640 1 -- 172.21.15.7:0/3573532058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d387864a0 msgr2=0x556d388374a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:24.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.825+0000 7f48e8bd3640 1 --2- 172.21.15.7:0/3573532058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d387864a0 0x556d388374a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.825+0000 7f48e8bd3640 1 -- 172.21.15.7:0/3573532058 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556d387ccb20 con 0x556d387b7230 2024-04-25T09:57:24.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.825+0000 7f48e8bd3640 1 --2- 172.21.15.7:0/3573532058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d387b7230 0x556d387cc5e0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x556d387c9b20 tx=0x7f48d8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc58c74ddfc4006 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:24.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.825+0000 7f48c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:57:24.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.825+0000 7f48c3fff640 1 -- 172.21.15.7:0/3573532058 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d802c4e0 con 0x556d387b7230 2024-04-25T09:57:24.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.826+0000 7f48c3fff640 1 -- 172.21.15.7:0/3573532058 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f48d802c680 con 0x556d387b7230 2024-04-25T09:57:24.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.826+0000 7f48ee41c740 1 -- 172.21.15.7:0/3573532058 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f48d40a7070 con 0x556d387b7230 2024-04-25T09:57:24.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.826+0000 7f48c3fff640 1 -- 172.21.15.7:0/3573532058 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f48d803b050 con 0x556d387b7230 2024-04-25T09:57:24.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.826+0000 7f48ee41c740 10 client.6447 fetch_fsmap learned FSMap version 28 2024-04-25T09:57:24.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.826+0000 7f48ee41c740 1 -- 172.21.15.7:0/3573532058 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x556d387e16e0 con 0x556d387b7230 2024-04-25T09:57:24.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.826+0000 7f48c3fff640 1 -- 172.21.15.7:0/3573532058 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d40a7070 con 0x556d387b7230 2024-04-25T09:57:24.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.826+0000 7f48c3fff640 1 -- 172.21.15.7:0/3573532058 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f48d803e020 con 0x556d387b7230 2024-04-25T09:57:24.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.826+0000 7f48ee41c740 10 client.6447 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T09:57:24.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.826+0000 7f48ee41c740 10 client.6447 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:57:24.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.826+0000 7f48ee41c740 20 client.6447 populate_metadata read hostname 'smithi007' 2024-04-25T09:57:24.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.826+0000 7f48ee41c740 1 --2- 172.21.15.7:0/3573532058 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x556d387c8380 0x556d38840210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.826+0000 7f48ee41c740 4 client.6447 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:57:24.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.826+0000 7f48ee41c740 1 -- 172.21.15.7:0/3573532058 --> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556d386fcf50 con 0x556d387c8380 2024-04-25T09:57:24.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.826+0000 7f48e93d4640 1 --2- 172.21.15.7:0/3573532058 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x556d387c8380 0x556d38840210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.826+0000 7f48c3fff640 10 client.6447 ms_handle_connect on v2:172.21.15.7:6834/3057688863 2024-04-25T09:57:24.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.826+0000 7f48e93d4640 1 --2- 172.21.15.7:0/3573532058 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x556d387c8380 0x556d38840210 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec100242edccb4a5 server_cookie=4d46bbd1088f9347 in_seq=0 out_seq=0 2024-04-25T09:57:24.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.827+0000 7f48c3fff640 1 -- 172.21.15.7:0/3573532058 <== mds.0 v2:172.21.15.7:6834/3057688863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x556d386fcf50 con 0x556d387c8380 2024-04-25T09:57:24.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.827+0000 7f48c3fff640 10 client.6447 handle_command_reply: tid=0 2024-04-25T09:57:24.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.827+0000 7f48ee41c740 1 client.6447 shutdown 2024-04-25T09:57:24.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.827+0000 7f48ee41c740 1 -- 172.21.15.7:0/3573532058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d387b7230 msgr2=0x556d387cc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:24.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.827+0000 7f48ee41c740 1 --2- 172.21.15.7:0/3573532058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d387b7230 0x556d387cc5e0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x556d387c9b20 tx=0x7f48d8004730 comp rx=0 tx=0).stop 2024-04-25T09:57:24.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.827+0000 7f48ee41c740 1 -- 172.21.15.7:0/3573532058 shutdown_connections 2024-04-25T09:57:24.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.827+0000 7f48ee41c740 1 --2- 172.21.15.7:0/3573532058 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x556d387c8380 0x556d38840210 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.827+0000 7f48ee41c740 1 --2- 172.21.15.7:0/3573532058 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556d387d4ad0 0x556d3878ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.827+0000 7f48ee41c740 1 --2- 172.21.15.7:0/3573532058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d387b7230 0x556d387cc5e0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.827+0000 7f48ee41c740 1 --2- 172.21.15.7:0/3573532058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556d387864a0 0x556d388374a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.827+0000 7f48ee41c740 1 -- 172.21.15.7:0/3573532058 >> 172.21.15.7:0/3573532058 conn(0x556d3878cf10 msgr2=0x556d387d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:24.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.827+0000 7f48c3fff640 0 client.6447 ms_handle_reset on v2:172.21.15.7:6834/3057688863 2024-04-25T09:57:24.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.827+0000 7f48ee41c740 1 -- 172.21.15.7:0/3573532058 shutdown_connections 2024-04-25T09:57:24.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.827+0000 7f48ee41c740 1 -- 172.21.15.7:0/3573532058 wait complete. 2024-04-25T09:57:24.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.827+0000 7f48ee41c740 20 client.6447 trim_cache size 0 max 16384 2024-04-25T09:57:24.837 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T09:57:24.837 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "c03d0745-5946-49c3-ad88-1165c5b68b4e", 2024-04-25T09:57:24.837 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-04-25T09:57:24.837 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 6285, 2024-04-25T09:57:24.837 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-04-25T09:57:24.837 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-04-25T09:57:24.837 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-04-25T09:57:24.838 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 9.0966975130000005, 2024-04-25T09:57:24.838 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 28, 2024-04-25T09:57:24.838 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 62, 2024-04-25T09:57:24.838 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 62, 2024-04-25T09:57:24.838 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 14.127474466000001 2024-04-25T09:57:24.838 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T09:57:24.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.828+0000 7f48eb638640 1 -- 172.21.15.7:0/519149552 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f48d006b4c0 msgr2=0x7f48d006d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:24.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.828+0000 7f48eb638640 1 --2- 172.21.15.7:0/519149552 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f48d006b4c0 0x7f48d006d980 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f48e40ccb30 tx=0x7f48d8008040 comp rx=0 tx=0).stop 2024-04-25T09:57:24.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.828+0000 7f48eb638640 1 -- 172.21.15.7:0/519149552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48cc0039b0 msgr2=0x7f48e4148180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:24.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.828+0000 7f48eb638640 1 --2- 172.21.15.7:0/519149552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48cc0039b0 0x7f48e4148180 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f48d402b530 tx=0x7f48d4001360 comp rx=0 tx=0).stop 2024-04-25T09:57:24.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.828+0000 7f48eb638640 1 -- 172.21.15.7:0/519149552 shutdown_connections 2024-04-25T09:57:24.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.828+0000 7f48eb638640 1 --2- 172.21.15.7:0/519149552 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f48d006b4c0 0x7f48d006d980 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.828+0000 7f48eb638640 1 --2- 172.21.15.7:0/519149552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48e41e7d60 0x7f48e415e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.828+0000 7f48eb638640 1 --2- 172.21.15.7:0/519149552 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f48e41530a0 0x7f48e415e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.828+0000 7f48eb638640 1 --2- 172.21.15.7:0/519149552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48cc0039b0 0x7f48e4148180 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.828+0000 7f48eb638640 1 -- 172.21.15.7:0/519149552 >> 172.21.15.7:0/519149552 conn(0x7f48e40b2400 msgr2=0x7f48e406fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:24.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.828+0000 7f48eb638640 1 -- 172.21.15.7:0/519149552 shutdown_connections 2024-04-25T09:57:24.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.828+0000 7f48eb638640 1 -- 172.21.15.7:0/519149552 wait complete. 2024-04-25T09:57:24.842 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:57:24.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.940+0000 7f688884a640 1 Processor -- start 2024-04-25T09:57:24.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.940+0000 7f688884a640 1 -- start start 2024-04-25T09:57:24.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.941+0000 7f688884a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f688415da60 0x7f68840d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.941+0000 7f688884a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f688415e8a0 con 0x7f688415e2a0 2024-04-25T09:57:24.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.941+0000 7f688884a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f688415eb80 con 0x7f688415de40 2024-04-25T09:57:24.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.941+0000 7f688884a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f688415ee60 con 0x7f688415da60 2024-04-25T09:57:24.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.941+0000 7f6882d9d640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f688415e2a0 0x7f68840ce520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38204/0 (socket says 172.21.15.7:38204) 2024-04-25T09:57:24.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.941+0000 7f6882d9d640 1 -- 172.21.15.7:0/689834236 learned_addr learned my addr 172.21.15.7:0/689834236 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:57:24.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.941+0000 7f688259c640 1 --2- 172.21.15.7:0/689834236 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f688415da60 0x7f68840d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.941+0000 7f688159a640 1 -- 172.21.15.7:0/689834236 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3632802951 0 0) 0x7f688415e8a0 con 0x7f688415e2a0 2024-04-25T09:57:24.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.941+0000 7f688159a640 1 -- 172.21.15.7:0/689834236 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f686c003520 con 0x7f688415e2a0 2024-04-25T09:57:24.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.941+0000 7f688159a640 1 -- 172.21.15.7:0/689834236 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516939770 0 0) 0x7f688415eb80 con 0x7f688415de40 2024-04-25T09:57:24.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.941+0000 7f688259c640 1 -- 172.21.15.7:0/689834236 >> v1:172.21.15.55:6789/0 conn(0x7f688415de40 legacy=0x7f6884161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:24.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.941+0000 7f688259c640 1 -- 172.21.15.7:0/689834236 >> v1:172.21.15.7:6789/0 conn(0x7f688415e2a0 legacy=0x7f68840ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:24.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.941+0000 7f688259c640 1 -- 172.21.15.7:0/689834236 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6884161850 con 0x7f688415da60 2024-04-25T09:57:24.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.942+0000 7f688259c640 1 --2- 172.21.15.7:0/689834236 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f688415da60 0x7f68840d0aa0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f68740097d0 tx=0x7f687402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2014126b8b92f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:24.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.942+0000 7f688159a640 1 -- 172.21.15.7:0/689834236 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6874037070 con 0x7f688415da60 2024-04-25T09:57:24.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.942+0000 7f688159a640 1 -- 172.21.15.7:0/689834236 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6874032440 con 0x7f688415da60 2024-04-25T09:57:24.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.942+0000 7f688159a640 1 -- 172.21.15.7:0/689834236 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6874032810 con 0x7f688415da60 2024-04-25T09:57:24.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.943+0000 7f688884a640 1 -- 172.21.15.7:0/689834236 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f688415da60 msgr2=0x7f68840d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:24.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.943+0000 7f688884a640 1 --2- 172.21.15.7:0/689834236 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f688415da60 0x7f68840d0aa0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f68740097d0 tx=0x7f687402a180 comp rx=0 tx=0).stop 2024-04-25T09:57:24.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.943+0000 7f688884a640 1 -- 172.21.15.7:0/689834236 shutdown_connections 2024-04-25T09:57:24.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.943+0000 7f688884a640 1 --2- 172.21.15.7:0/689834236 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f688415da60 0x7f68840d0aa0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.943+0000 7f688884a640 1 -- 172.21.15.7:0/689834236 >> 172.21.15.7:0/689834236 conn(0x7f688406bfe0 msgr2=0x7f688406c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:24.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.943+0000 7f688884a640 1 -- 172.21.15.7:0/689834236 shutdown_connections 2024-04-25T09:57:24.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.943+0000 7f688884a640 1 -- 172.21.15.7:0/689834236 wait complete. 2024-04-25T09:57:24.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.944+0000 7f688884a640 1 Processor -- start 2024-04-25T09:57:24.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.944+0000 7f688884a640 1 -- start start 2024-04-25T09:57:24.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.945+0000 7f688884a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f688415da60 0x7f68840cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.945+0000 7f688884a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f688415de40 0x7f68840cb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.945+0000 7f688884a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f688415e2a0 0x7f68841f3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.945+0000 7f688884a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68840cedb0 con 0x7f688415de40 2024-04-25T09:57:24.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.945+0000 7f688884a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68840cec30 con 0x7f688415da60 2024-04-25T09:57:24.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.945+0000 7f688884a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68840d2ca0 con 0x7f688415e2a0 2024-04-25T09:57:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.945+0000 7f6881d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f688415de40 0x7f68840cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.945+0000 7f6881d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f688415de40 0x7f68840cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50342/0 (socket says 172.21.15.7:50342) 2024-04-25T09:57:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.945+0000 7f6881d9b640 1 -- 172.21.15.7:0/1380260643 learned_addr learned my addr 172.21.15.7:0/1380260643 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.945+0000 7f6882d9d640 1 --2- 172.21.15.7:0/1380260643 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f688415e2a0 0x7f68841f3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.945+0000 7f688259c640 1 --2- 172.21.15.7:0/1380260643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f688415da60 0x7f68840cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.945+0000 7f6881d9b640 1 -- 172.21.15.7:0/1380260643 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f688415e2a0 msgr2=0x7f68841f3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.945+0000 7f6881d9b640 1 --2- 172.21.15.7:0/1380260643 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f688415e2a0 0x7f68841f3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.945+0000 7f6881d9b640 1 -- 172.21.15.7:0/1380260643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f688415da60 msgr2=0x7f68840cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.945+0000 7f6881d9b640 1 --2- 172.21.15.7:0/1380260643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f688415da60 0x7f68840cd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.945+0000 7f6881d9b640 1 -- 172.21.15.7:0/1380260643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68840cc000 con 0x7f688415de40 2024-04-25T09:57:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.946+0000 7f6881d9b640 1 --2- 172.21.15.7:0/1380260643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f688415de40 0x7f68840cb970 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f687800c4e0 tx=0x7f687800c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.946+0000 7f6872ffd640 1 -- 172.21.15.7:0/1380260643 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878017070 con 0x7f688415de40 2024-04-25T09:57:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.946+0000 7f6872ffd640 1 -- 172.21.15.7:0/1380260643 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68780035f0 con 0x7f688415de40 2024-04-25T09:57:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.946+0000 7f688884a640 1 -- 172.21.15.7:0/1380260643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68840cc2e0 con 0x7f688415de40 2024-04-25T09:57:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.946+0000 7f6872ffd640 1 -- 172.21.15.7:0/1380260643 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68780039e0 con 0x7f688415de40 2024-04-25T09:57:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.946+0000 7f688884a640 1 -- 172.21.15.7:0/1380260643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68840cc8a0 con 0x7f688415de40 2024-04-25T09:57:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.947+0000 7f688884a640 1 -- 172.21.15.7:0/1380260643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68840d1560 con 0x7f688415de40 2024-04-25T09:57:24.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.947+0000 7f6872ffd640 1 -- 172.21.15.7:0/1380260643 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f687801a070 con 0x7f688415de40 2024-04-25T09:57:24.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.948+0000 7f6872ffd640 1 --2- 172.21.15.7:0/1380260643 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f686406b4d0 0x7f686406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:24.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.948+0000 7f688259c640 1 --2- 172.21.15.7:0/1380260643 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f686406b4d0 0x7f686406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:24.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.948+0000 7f6872ffd640 1 -- 172.21.15.7:0/1380260643 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6878089710 con 0x7f688415de40 2024-04-25T09:57:24.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.948+0000 7f688259c640 1 --2- 172.21.15.7:0/1380260643 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f686406b4d0 0x7f686406d990 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6874034000 tx=0x7f687402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:24.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:24.952+0000 7f6872ffd640 1 -- 172.21.15.7:0/1380260643 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6878057d10 con 0x7f688415de40 2024-04-25T09:57:25.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:25.178+0000 7f688884a640 1 -- 172.21.15.7:0/1380260643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6884068fb0 con 0x7f688415de40 2024-04-25T09:57:25.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:25.178+0000 7f6872ffd640 1 -- 172.21.15.7:0/1380260643 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) v1 ==== 53+0+73 (secure 0 0 0) 0x7f687805bdb0 con 0x7f688415de40 2024-04-25T09:57:25.182 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:57:25.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:25.180+0000 7f688884a640 1 -- 172.21.15.7:0/1380260643 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f686406b4d0 msgr2=0x7f686406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:25.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:25.180+0000 7f688884a640 1 --2- 172.21.15.7:0/1380260643 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f686406b4d0 0x7f686406d990 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6874034000 tx=0x7f687402e000 comp rx=0 tx=0).stop 2024-04-25T09:57:25.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:25.180+0000 7f688884a640 1 -- 172.21.15.7:0/1380260643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f688415de40 msgr2=0x7f68840cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:25.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:25.180+0000 7f688884a640 1 --2- 172.21.15.7:0/1380260643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f688415de40 0x7f68840cb970 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f687800c4e0 tx=0x7f687800c9a0 comp rx=0 tx=0).stop 2024-04-25T09:57:25.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:25.180+0000 7f688884a640 1 -- 172.21.15.7:0/1380260643 shutdown_connections 2024-04-25T09:57:25.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:25.180+0000 7f688884a640 1 --2- 172.21.15.7:0/1380260643 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f686406b4d0 0x7f686406d990 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:25.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:25.180+0000 7f688884a640 1 --2- 172.21.15.7:0/1380260643 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f688415e2a0 0x7f68841f3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:25.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:25.180+0000 7f688884a640 1 --2- 172.21.15.7:0/1380260643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f688415de40 0x7f68840cb970 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:25.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:25.180+0000 7f688884a640 1 --2- 172.21.15.7:0/1380260643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f688415da60 0x7f68840cd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:25.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:25.180+0000 7f688884a640 1 -- 172.21.15.7:0/1380260643 >> 172.21.15.7:0/1380260643 conn(0x7f688406bfe0 msgr2=0x7f6884160720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:25.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:25.180+0000 7f688884a640 1 -- 172.21.15.7:0/1380260643 shutdown_connections 2024-04-25T09:57:25.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:25.180+0000 7f688884a640 1 -- 172.21.15.7:0/1380260643 wait complete. 2024-04-25T09:57:25.195 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:57:25.195 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:57:25.195 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-04-25T09:57:25.195 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:57:25.195 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:57:25.195 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:57:25.195 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:57:25.195 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:57:25.195 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:57:25.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:57:25.195 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-04-25T09:57:25.211 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:57:25.211 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:57:25.211 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:57:25.211 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:57:25.211 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-04-25T09:57:25.211 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:57:25.211 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:57:25.211 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-04-25T09:57:25.211 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-04-25T09:57:25.211 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:57:25.211 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-04-25T09:57:25.212 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-04-25T09:57:25.212 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:57:25.212 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-04-25T09:57:25.212 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-04-25T09:57:25.212 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T09:57:25.212 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42554sec preferred_lft 42554sec 2024-04-25T09:57:25.212 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link noprefixroute 2024-04-25T09:57:25.212 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:57:25.212 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:57:25.212 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-04-25T09:57:25.212 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-04-25T09:57:25.212 INFO:teuthology.orchestra.run.smithi007.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:57:25.212 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 26:0c:99:53:12:e3 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:57:25.212 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:57:25.212 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:57:25.213 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::50aa:55ff:febc:5f67/64 scope link 2024-04-25T09:57:25.213 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:57:25.213 INFO:teuthology.orchestra.run.smithi007.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:57:25.213 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 6e:99:f1:00:a9:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:57:25.213 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6c99:f1ff:fe00:a95e/64 scope link 2024-04-25T09:57:25.213 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:57:25.213 INFO:teuthology.orchestra.run.smithi007.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:57:25.213 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 26:0c:99:53:12:e3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:57:25.213 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::240c:99ff:fe53:12e3/64 scope link 2024-04-25T09:57:25.213 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:57:25.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:57:25.214 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:57:25.274 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-04-25T09:57:25.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:57:25.276 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-04-25T09:57:25.331 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-04-25T09:57:25.331 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:57:25.331 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T09:57:25.331 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T09:57:25.331 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:57:25.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:57:25.332 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-04-25T09:57:25.332 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-25T09:57:25.332 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:57:25.332 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:57:25.332 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:57:25.332 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-25T09:57:25.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:57:25.417 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-04-25T09:57:25.432 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:57:25.432 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:57:25.432 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:57:25.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:57:25.433 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-04-25T09:57:25.496 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:57:25.496 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:57:25.551 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:57:25.551 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:57:25.551 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:57:25.606 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:57:25.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:57:25.606 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:57:25.689 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:57:25.689 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:57:25.689 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T09:57:25.697 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:57:25.697 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:57:25.697 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T09:57:25.698 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T09:57:25.698 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:57:25.703 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:57:25.703 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:57:25.703 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T09:57:25.703 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T09:57:25.703 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:57:25.703 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790" 2024-04-25T09:57:25.704 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790:/ 2024-04-25T09:57:25.704 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c03d0745-5946-49c3-ad88-1165c5b68b4e" will pass to kernel 2024-04-25T09:57:25.704 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T09:57:25.704 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-04-25T09:57:25.704 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T09:57:25.705 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T09:57:25.705 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T09:57:25.706 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:57:25.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:57:25.706 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:57:25.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:57:25.771 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:57:25.831 INFO:teuthology.orchestra.run.smithi007.stdout:client5929 2024-04-25T09:57:25.832 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:57:25.832 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:57:25.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:57:25.887 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir_test) 2024-04-25T09:57:25.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:57:25.947 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir_test/file) 2024-04-25T09:57:26.003 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T09:57:26.004 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T09:57:26.004 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T09:57:26.004 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T09:57:26.004 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir_test/file").st_ino) 2024-04-25T09:57:26.004 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T09:57:26.110 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627777 2024-04-25T09:57:26.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:57:26.119 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:57:26.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.256+0000 7f0a1477e640 1 Processor -- start 2024-04-25T09:57:26.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.256+0000 7f0a1477e640 1 -- start start 2024-04-25T09:57:26.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.257+0000 7f0a1477e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0a0c0d0aa0 0x7f0a0c161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:26.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.257+0000 7f0a1477e640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a0c15e8a0 con 0x7f0a0c1622b0 2024-04-25T09:57:26.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.257+0000 7f0a1477e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a0c15eb80 con 0x7f0a0c15da60 2024-04-25T09:57:26.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.257+0000 7f0a1477e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a0c15ee60 con 0x7f0a0c0d0aa0 2024-04-25T09:57:26.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.257+0000 7f0a12d1b640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0a0c1622b0 0x7f0a0c0ce520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38214/0 (socket says 172.21.15.7:38214) 2024-04-25T09:57:26.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.257+0000 7f0a12d1b640 1 -- 172.21.15.7:0/2264589740 learned_addr learned my addr 172.21.15.7:0/2264589740 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:57:26.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.258+0000 7f0a11d19640 1 --2- 172.21.15.7:0/2264589740 >> v2:172.21.15.55:3300/0 conn(0x7f0a0c0d0aa0 0x7f0a0c161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:26.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.258+0000 7f0a11518640 1 -- 172.21.15.7:0/2264589740 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4011287353 0 0) 0x7f0a0c15e8a0 con 0x7f0a0c1622b0 2024-04-25T09:57:26.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.258+0000 7f0a11518640 1 -- 172.21.15.7:0/2264589740 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09f8003520 con 0x7f0a0c1622b0 2024-04-25T09:57:26.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.258+0000 7f0a11518640 1 -- 172.21.15.7:0/2264589740 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3850258301 0 0) 0x7f09f8003520 con 0x7f0a0c1622b0 2024-04-25T09:57:26.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.258+0000 7f0a11518640 1 -- 172.21.15.7:0/2264589740 >> v2:172.21.15.55:3300/0 conn(0x7f0a0c0d0aa0 msgr2=0x7f0a0c161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:26.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.258+0000 7f0a11518640 1 --2- 172.21.15.7:0/2264589740 >> v2:172.21.15.55:3300/0 conn(0x7f0a0c0d0aa0 0x7f0a0c161d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:26.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.258+0000 7f0a11518640 1 -- 172.21.15.7:0/2264589740 >> v1:172.21.15.55:6789/0 conn(0x7f0a0c15da60 legacy=0x7f0a0c15de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:26.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.258+0000 7f0a11518640 1 -- 172.21.15.7:0/2264589740 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c161850 con 0x7f0a0c1622b0 2024-04-25T09:57:26.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.258+0000 7f0a11518640 1 -- 172.21.15.7:0/2264589740 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f0a040019f0 con 0x7f0a0c1622b0 2024-04-25T09:57:26.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.258+0000 7f0a11518640 1 -- 172.21.15.7:0/2264589740 >> v1:172.21.15.7:6789/0 conn(0x7f0a0c1622b0 legacy=0x7f0a0c0ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:26.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.258+0000 7f0a11518640 1 --2- 172.21.15.7:0/2264589740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f8003a00 0x7f09f8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:26.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.258+0000 7f0a11518640 1 --2- 172.21.15.7:0/2264589740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09f8004800 0x7f09f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:26.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.258+0000 7f0a11518640 1 --2- 172.21.15.7:0/2264589740 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f09f8005210 0x7f09f800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:26.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.258+0000 7f0a11518640 1 -- 172.21.15.7:0/2264589740 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c15ee60 con 0x7f09f8004800 2024-04-25T09:57:26.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.258+0000 7f0a11518640 1 -- 172.21.15.7:0/2264589740 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f800c160 con 0x7f09f8003a00 2024-04-25T09:57:26.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.258+0000 7f0a11518640 1 -- 172.21.15.7:0/2264589740 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f800c360 con 0x7f09f8005210 2024-04-25T09:57:26.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.258+0000 7f0a11d19640 1 --2- 172.21.15.7:0/2264589740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09f8004800 0x7f09f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:26.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.258+0000 7f0a1251a640 1 --2- 172.21.15.7:0/2264589740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f8003a00 0x7f09f8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:26.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.258+0000 7f0a12d1b640 1 --2- 172.21.15.7:0/2264589740 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f09f8005210 0x7f09f800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:26.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.258+0000 7f0a11d19640 1 -- 172.21.15.7:0/2264589740 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f09f8005210 msgr2=0x7f09f800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:26.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.258+0000 7f0a11d19640 1 --2- 172.21.15.7:0/2264589740 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f09f8005210 0x7f09f800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:26.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.258+0000 7f0a11d19640 1 -- 172.21.15.7:0/2264589740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f8003a00 msgr2=0x7f09f8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:26.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.258+0000 7f0a11d19640 1 --2- 172.21.15.7:0/2264589740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f8003a00 0x7f09f8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:26.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.258+0000 7f0a11d19640 1 -- 172.21.15.7:0/2264589740 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f8003520 con 0x7f09f8004800 2024-04-25T09:57:26.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.258+0000 7f0a12d1b640 1 -- 172.21.15.7:0/2264589740 reap_dead start 2024-04-25T09:57:26.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.259+0000 7f0a11d19640 1 --2- 172.21.15.7:0/2264589740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09f8004800 0x7f09f8004c80 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f09fc009a90 tx=0x7f09f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9338c80a9cc99517 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:26.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.259+0000 7f0a11518640 1 -- 172.21.15.7:0/2264589740 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc036070 con 0x7f09f8004800 2024-04-25T09:57:26.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.259+0000 7f0a11518640 1 -- 172.21.15.7:0/2264589740 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09fc031400 con 0x7f09f8004800 2024-04-25T09:57:26.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.259+0000 7f0a11518640 1 -- 172.21.15.7:0/2264589740 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc009690 con 0x7f09f8004800 2024-04-25T09:57:26.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.260+0000 7f0a1477e640 1 -- 172.21.15.7:0/2264589740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09f8004800 msgr2=0x7f09f8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:26.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.260+0000 7f0a1477e640 1 --2- 172.21.15.7:0/2264589740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09f8004800 0x7f09f8004c80 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f09fc009a90 tx=0x7f09f8005830 comp rx=0 tx=0).stop 2024-04-25T09:57:26.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.260+0000 7f0a1477e640 1 -- 172.21.15.7:0/2264589740 shutdown_connections 2024-04-25T09:57:26.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.260+0000 7f0a1477e640 1 --2- 172.21.15.7:0/2264589740 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09f8004800 0x7f09f8004c80 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:26.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.260+0000 7f0a1477e640 1 -- 172.21.15.7:0/2264589740 >> 172.21.15.7:0/2264589740 conn(0x7f0a0c06bfe0 msgr2=0x7f0a0c06c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:26.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.260+0000 7f0a1477e640 1 -- 172.21.15.7:0/2264589740 shutdown_connections 2024-04-25T09:57:26.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.260+0000 7f0a1477e640 1 -- 172.21.15.7:0/2264589740 wait complete. 2024-04-25T09:57:26.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.261+0000 7f0a1477e640 1 Processor -- start 2024-04-25T09:57:26.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.261+0000 7f0a1477e640 1 -- start start 2024-04-25T09:57:26.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.262+0000 7f0a1477e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09f8004800 0x7f0a0c1f41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:26.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.262+0000 7f0a1477e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a0c0cda80 0x7f0a0c0ac540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:26.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.262+0000 7f0a1477e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a0c15c7e0 0x7f0a0c15cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:26.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.262+0000 7f0a1477e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c162100 con 0x7f09f8004800 2024-04-25T09:57:26.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.262+0000 7f0a1477e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c161f80 con 0x7f0a0c0cda80 2024-04-25T09:57:26.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.262+0000 7f0a1477e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c15de40 con 0x7f0a0c15c7e0 2024-04-25T09:57:26.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.262+0000 7f0a1251a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09f8004800 0x7f0a0c1f41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:26.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.262+0000 7f0a1251a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09f8004800 0x7f0a0c1f41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50370/0 (socket says 172.21.15.7:50370) 2024-04-25T09:57:26.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.262+0000 7f0a1251a640 1 -- 172.21.15.7:0/1417841735 learned_addr learned my addr 172.21.15.7:0/1417841735 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:26.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.262+0000 7f0a11d19640 1 --2- 172.21.15.7:0/1417841735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a0c0cda80 0x7f0a0c0ac540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:26.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.262+0000 7f0a1251a640 1 -- 172.21.15.7:0/1417841735 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a0c15c7e0 msgr2=0x7f0a0c15cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:26.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.262+0000 7f0a12d1b640 1 --2- 172.21.15.7:0/1417841735 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a0c15c7e0 0x7f0a0c15cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:26.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.262+0000 7f0a1251a640 1 --2- 172.21.15.7:0/1417841735 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a0c15c7e0 0x7f0a0c15cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:26.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.262+0000 7f0a1251a640 1 -- 172.21.15.7:0/1417841735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a0c0cda80 msgr2=0x7f0a0c0ac540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:26.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.262+0000 7f0a1251a640 1 --2- 172.21.15.7:0/1417841735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a0c0cda80 0x7f0a0c0ac540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:26.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.262+0000 7f0a1251a640 1 -- 172.21.15.7:0/1417841735 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c1f4700 con 0x7f09f8004800 2024-04-25T09:57:26.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.262+0000 7f0a11d19640 1 --2- 172.21.15.7:0/1417841735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a0c0cda80 0x7f0a0c0ac540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:57:26.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.262+0000 7f0a12d1b640 1 --2- 172.21.15.7:0/1417841735 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a0c15c7e0 0x7f0a0c15cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:57:26.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.262+0000 7f0a1251a640 1 --2- 172.21.15.7:0/1417841735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09f8004800 0x7f0a0c1f41c0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f0a0800f620 tx=0x7f0a0800fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:26.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.262+0000 7f0a02ffd640 1 -- 172.21.15.7:0/1417841735 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a080052e0 con 0x7f09f8004800 2024-04-25T09:57:26.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.262+0000 7f0a02ffd640 1 -- 172.21.15.7:0/1417841735 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a08018070 con 0x7f09f8004800 2024-04-25T09:57:26.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.263+0000 7f0a1477e640 1 -- 172.21.15.7:0/1417841735 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a0c15d1d0 con 0x7f09f8004800 2024-04-25T09:57:26.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.263+0000 7f0a02ffd640 1 -- 172.21.15.7:0/1417841735 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a08003810 con 0x7f09f8004800 2024-04-25T09:57:26.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.263+0000 7f0a1477e640 1 -- 172.21.15.7:0/1417841735 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a0c0aab00 con 0x7f09f8004800 2024-04-25T09:57:26.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.264+0000 7f0a1477e640 1 -- 172.21.15.7:0/1417841735 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a0c068fd0 con 0x7f09f8004800 2024-04-25T09:57:26.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.264+0000 7f0a02ffd640 1 -- 172.21.15.7:0/1417841735 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0a080039b0 con 0x7f09f8004800 2024-04-25T09:57:26.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.265+0000 7f0a02ffd640 1 --2- 172.21.15.7:0/1417841735 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f09f006b500 0x7f09f006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:26.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.265+0000 7f0a11d19640 1 --2- 172.21.15.7:0/1417841735 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f09f006b500 0x7f09f006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:26.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.265+0000 7f0a02ffd640 1 -- 172.21.15.7:0/1417841735 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0a0808a190 con 0x7f09f8004800 2024-04-25T09:57:26.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.265+0000 7f0a11d19640 1 --2- 172.21.15.7:0/1417841735 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f09f006b500 0x7f09f006d9c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f09fc033000 tx=0x7f09fc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:26.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.269+0000 7f0a02ffd640 1 -- 172.21.15.7:0/1417841735 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0a0c1f4700 con 0x7f09f8004800 2024-04-25T09:57:26.466 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:57:26.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.485+0000 7f0a1477e640 1 -- 172.21.15.7:0/1417841735 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a0c0d1560 con 0x7f09f8004800 2024-04-25T09:57:26.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.486+0000 7f0a02ffd640 1 -- 172.21.15.7:0/1417841735 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4933 (secure 0 0 0) 0x7f0a08058f40 con 0x7f09f8004800 2024-04-25T09:57:26.492 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:57:26.492 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3706118852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3706118852},{"type":"v1","addr":"172.21.15.55:6833","nonce":3706118852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5354,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1513522793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1513522793},{"type":"v1","addr":"172.21.15.55:6835","nonce":1513522793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5782,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1231382839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1231382839},{"type":"v1","addr":"172.21.15.7:6837","nonce":1231382839}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:57:15.098282+0000","modified":"2024-04-25T09:57:17.101919+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6836/3057688863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3057688863},{"type":"v1","addr":"172.21.15.7:6836","nonce":3057688863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:57:26.493 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 28 2024-04-25T09:57:26.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.487+0000 7f0a1477e640 1 -- 172.21.15.7:0/1417841735 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f09f006b500 msgr2=0x7f09f006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:26.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.487+0000 7f0a1477e640 1 --2- 172.21.15.7:0/1417841735 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f09f006b500 0x7f09f006d9c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f09fc033000 tx=0x7f09fc008030 comp rx=0 tx=0).stop 2024-04-25T09:57:26.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.488+0000 7f0a1477e640 1 -- 172.21.15.7:0/1417841735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09f8004800 msgr2=0x7f0a0c1f41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:26.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.488+0000 7f0a1477e640 1 --2- 172.21.15.7:0/1417841735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09f8004800 0x7f0a0c1f41c0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f0a0800f620 tx=0x7f0a0800fae0 comp rx=0 tx=0).stop 2024-04-25T09:57:26.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.488+0000 7f0a1477e640 1 -- 172.21.15.7:0/1417841735 shutdown_connections 2024-04-25T09:57:26.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.488+0000 7f0a1477e640 1 --2- 172.21.15.7:0/1417841735 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f09f006b500 0x7f09f006d9c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:26.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.488+0000 7f0a1477e640 1 --2- 172.21.15.7:0/1417841735 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a0c15c7e0 0x7f0a0c15cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:26.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.488+0000 7f0a1477e640 1 --2- 172.21.15.7:0/1417841735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a0c0cda80 0x7f0a0c0ac540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:26.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.488+0000 7f0a1477e640 1 --2- 172.21.15.7:0/1417841735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09f8004800 0x7f0a0c1f41c0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:26.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.488+0000 7f0a1477e640 1 -- 172.21.15.7:0/1417841735 >> 172.21.15.7:0/1417841735 conn(0x7f0a0c06bfe0 msgr2=0x7f0a0c160670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:26.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.488+0000 7f0a1477e640 1 -- 172.21.15.7:0/1417841735 shutdown_connections 2024-04-25T09:57:26.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.488+0000 7f0a1477e640 1 -- 172.21.15.7:0/1417841735 wait complete. 2024-04-25T09:57:26.495 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:57:26.502 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-25T09:57:26.706 INFO:teuthology.orchestra.run.smithi007.stdout:{"message":"","return_code":0} 2024-04-25T09:57:26.706 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T09:57:26.706 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-04-25T09:57:26.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.746+0000 7f6ee9f28f40 1 Processor -- start 2024-04-25T09:57:26.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.746+0000 7f6ee9f28f40 1 -- start start 2024-04-25T09:57:26.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.747+0000 7f6ee9f28f40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555f3247ea20 0x555f3249dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:26.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.747+0000 7f6ee9f28f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f32494c00 0x555f32498fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:26.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.747+0000 7f6ee9f28f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f3247ee00 0x555f32499500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:26.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.747+0000 7f6ee9f28f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f3236adf0 con 0x555f3247ee00 2024-04-25T09:57:26.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.747+0000 7f6ee9f28f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f3236ed50 con 0x555f32494c00 2024-04-25T09:57:26.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.747+0000 7f6ee9f28f40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f32480980 con 0x555f3247ea20 2024-04-25T09:57:26.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.747+0000 7f6ee822c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f3247ee00 0x555f32499500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:26.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.747+0000 7f6ee822c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f3247ee00 0x555f32499500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50386/0 (socket says 172.21.15.7:50386) 2024-04-25T09:57:26.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.747+0000 7f6ee822c640 1 -- 172.21.15.7:0/2393590648 learned_addr learned my addr 172.21.15.7:0/2393590648 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:26.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.747+0000 7f6ee7a2b640 1 --2- 172.21.15.7:0/2393590648 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555f3247ea20 0x555f3249dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:26.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.747+0000 7f6ee722a640 1 --2- 172.21.15.7:0/2393590648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f32494c00 0x555f32498fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:26.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.747+0000 7f6ee822c640 1 -- 172.21.15.7:0/2393590648 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555f3247ea20 msgr2=0x555f3249dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:26.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.747+0000 7f6ee822c640 1 --2- 172.21.15.7:0/2393590648 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555f3247ea20 0x555f3249dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:26.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.747+0000 7f6ee822c640 1 -- 172.21.15.7:0/2393590648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f32494c00 msgr2=0x555f32498fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:26.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.747+0000 7f6ee822c640 1 --2- 172.21.15.7:0/2393590648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f32494c00 0x555f32498fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:26.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.747+0000 7f6ee822c640 1 -- 172.21.15.7:0/2393590648 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f323efc20 con 0x555f3247ee00 2024-04-25T09:57:26.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.748+0000 7f6ee822c640 1 --2- 172.21.15.7:0/2393590648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f3247ee00 0x555f32499500 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0059040 tx=0x7f6ee004f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=127b45376c0dbd27 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:26.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.748+0000 7f6ee6228640 1 -- 172.21.15.7:0/2393590648 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0005230 con 0x555f3247ee00 2024-04-25T09:57:26.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.748+0000 7f6ee6228640 1 -- 172.21.15.7:0/2393590648 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee0065070 con 0x555f3247ee00 2024-04-25T09:57:26.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.748+0000 7f6ee6228640 1 -- 172.21.15.7:0/2393590648 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee000e090 con 0x555f3247ee00 2024-04-25T09:57:26.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.748+0000 7f6ee9f28f40 1 -- 172.21.15.7:0/2393590648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f3247ee00 msgr2=0x555f32499500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:26.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.748+0000 7f6ee9f28f40 1 --2- 172.21.15.7:0/2393590648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f3247ee00 0x555f32499500 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0059040 tx=0x7f6ee004f000 comp rx=0 tx=0).stop 2024-04-25T09:57:26.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.748+0000 7f6ee9f28f40 1 -- 172.21.15.7:0/2393590648 shutdown_connections 2024-04-25T09:57:26.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.748+0000 7f6ee9f28f40 1 --2- 172.21.15.7:0/2393590648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f3247ee00 0x555f32499500 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:26.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.748+0000 7f6ee9f28f40 1 --2- 172.21.15.7:0/2393590648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f32494c00 0x555f32498fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:26.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.748+0000 7f6ee9f28f40 1 --2- 172.21.15.7:0/2393590648 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555f3247ea20 0x555f3249dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:26.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.748+0000 7f6ee9f28f40 1 -- 172.21.15.7:0/2393590648 >> 172.21.15.7:0/2393590648 conn(0x555f323c2a60 msgr2=0x555f323c5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:26.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.748+0000 7f6ee9f28f40 1 -- 172.21.15.7:0/2393590648 shutdown_connections 2024-04-25T09:57:26.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.748+0000 7f6ee9f28f40 1 -- 172.21.15.7:0/2393590648 wait complete. 2024-04-25T09:57:26.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.749+0000 7f6ee9f28f40 1 Processor -- start 2024-04-25T09:57:26.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.749+0000 7f6ee9f28f40 1 -- start start 2024-04-25T09:57:26.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.750+0000 7f6ee9f28f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f3247ea20 0x555f32494110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:26.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.750+0000 7f6ee9f28f40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555f3247ee00 0x555f3252a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:26.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.750+0000 7f6ee9f28f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f32494c00 0x555f3249c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:26.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.750+0000 7f6ee9f28f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f32499a40 con 0x555f32494c00 2024-04-25T09:57:26.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.750+0000 7f6ee9f28f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f3249edc0 con 0x555f3247ea20 2024-04-25T09:57:26.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.750+0000 7f6ee9f28f40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f3249f0a0 con 0x555f3247ee00 2024-04-25T09:57:26.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.750+0000 7f6ee822c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f32494c00 0x555f3249c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:26.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.750+0000 7f6ee822c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f32494c00 0x555f3249c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50402/0 (socket says 172.21.15.7:50402) 2024-04-25T09:57:26.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.750+0000 7f6ee822c640 1 -- 172.21.15.7:0/539934161 learned_addr learned my addr 172.21.15.7:0/539934161 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:26.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.750+0000 7f6ee7a2b640 1 --2- 172.21.15.7:0/539934161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f3247ea20 0x555f32494110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:26.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.750+0000 7f6ee722a640 1 --2- 172.21.15.7:0/539934161 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555f3247ee00 0x555f3252a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:26.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.750+0000 7f6ee822c640 1 -- 172.21.15.7:0/539934161 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555f3247ee00 msgr2=0x555f3252a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:26.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.750+0000 7f6ee822c640 1 --2- 172.21.15.7:0/539934161 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555f3247ee00 0x555f3252a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:26.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.750+0000 7f6ee822c640 1 -- 172.21.15.7:0/539934161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f3247ea20 msgr2=0x555f32494110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:26.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.750+0000 7f6ee822c640 1 --2- 172.21.15.7:0/539934161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f3247ea20 0x555f32494110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:26.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.750+0000 7f6ee822c640 1 -- 172.21.15.7:0/539934161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f3252ad40 con 0x555f32494c00 2024-04-25T09:57:26.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.750+0000 7f6ee722a640 1 --2- 172.21.15.7:0/539934161 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555f3247ee00 0x555f3252a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:57:26.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.750+0000 7f6ee822c640 1 --2- 172.21.15.7:0/539934161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f32494c00 0x555f3249c560 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0062040 tx=0x7f6ee00033a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:26.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.750+0000 7f6ee5226640 1 -- 172.21.15.7:0/539934161 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0072070 con 0x555f32494c00 2024-04-25T09:57:26.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.750+0000 7f6ee5226640 1 -- 172.21.15.7:0/539934161 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee004d910 con 0x555f32494c00 2024-04-25T09:57:26.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.750+0000 7f6ee9f28f40 1 -- 172.21.15.7:0/539934161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555f32529bd0 con 0x555f32494c00 2024-04-25T09:57:26.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.751+0000 7f6ee5226640 1 -- 172.21.15.7:0/539934161 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee004dce0 con 0x555f32494c00 2024-04-25T09:57:26.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.751+0000 7f6ee9f28f40 1 -- 172.21.15.7:0/539934161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555f32479f10 con 0x555f32494c00 2024-04-25T09:57:26.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.752+0000 7f6ee5226640 1 -- 172.21.15.7:0/539934161 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6ee0075070 con 0x555f32494c00 2024-04-25T09:57:26.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.752+0000 7f6ee5226640 1 --2- 172.21.15.7:0/539934161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6ed4069ee0 0x7f6ed406c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:26.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.752+0000 7f6ee5226640 1 -- 172.21.15.7:0/539934161 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6ee00cd240 con 0x555f32494c00 2024-04-25T09:57:26.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.752+0000 7f6ee7a2b640 1 --2- 172.21.15.7:0/539934161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6ed4069ee0 0x7f6ed406c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:26.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.752+0000 7f6ee9f28f40 1 --2- 172.21.15.7:0/539934161 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x555f323c5650 0x555f32497990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:26.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.752+0000 7f6ee9f28f40 1 -- 172.21.15.7:0/539934161 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:1 10.7 10:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62) v9 -- 0x555f32497ed0 con 0x555f323c5650 2024-04-25T09:57:26.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.753+0000 7f6ee7a2b640 1 --2- 172.21.15.7:0/539934161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6ed4069ee0 0x7f6ed406c3a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8001760 tx=0x7f6ed8001570 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:26.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.753+0000 7f6ee722a640 1 --2- 172.21.15.7:0/539934161 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x555f323c5650 0x555f32497990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:26.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.753+0000 7f6ee722a640 1 --2- 172.21.15.7:0/539934161 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x555f323c5650 0x555f32497990 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:26.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.754+0000 7f6ee722a640 1 -- 172.21.15.7:0/539934161 <== osd.6 v2:172.21.15.55:6824/4293769515 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (94) out=94b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+94 (crc 0 0 0) 0x7f6edc00cb00 con 0x555f323c5650 2024-04-25T09:57:26.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.754+0000 7f6ee9f28f40 1 -- 172.21.15.7:0/539934161 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x555f323c5650 msgr2=0x555f32497990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:26.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.754+0000 7f6ee9f28f40 1 --2- 172.21.15.7:0/539934161 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x555f323c5650 0x555f32497990 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:26.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.754+0000 7f6ee9f28f40 1 -- 172.21.15.7:0/539934161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6ed4069ee0 msgr2=0x7f6ed406c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:26.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.754+0000 7f6ee9f28f40 1 --2- 172.21.15.7:0/539934161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6ed4069ee0 0x7f6ed406c3a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8001760 tx=0x7f6ed8001570 comp rx=0 tx=0).stop 2024-04-25T09:57:26.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.754+0000 7f6ee9f28f40 1 -- 172.21.15.7:0/539934161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f32494c00 msgr2=0x555f3249c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:26.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.754+0000 7f6ee9f28f40 1 --2- 172.21.15.7:0/539934161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f32494c00 0x555f3249c560 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0062040 tx=0x7f6ee00033a0 comp rx=0 tx=0).stop 2024-04-25T09:57:26.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.754+0000 7f6ee822c640 1 -- 172.21.15.7:0/539934161 reap_dead start 2024-04-25T09:57:26.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.754+0000 7f6ee9f28f40 1 -- 172.21.15.7:0/539934161 shutdown_connections 2024-04-25T09:57:26.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.754+0000 7f6ee9f28f40 1 -- 172.21.15.7:0/539934161 >> 172.21.15.7:0/539934161 conn(0x555f323c2a60 msgr2=0x555f3249dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:26.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.754+0000 7f6ee9f28f40 1 -- 172.21.15.7:0/539934161 shutdown_connections 2024-04-25T09:57:26.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.754+0000 7f6ee9f28f40 1 -- 172.21.15.7:0/539934161 wait complete. 2024-04-25T09:57:26.762 INFO:teuthology.orchestra.run.smithi007.stdout:Xfiledir_test 2024-04-25T09:57:26.762 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:57:26.763 DEBUG:teuthology.orchestra.run.smithi007:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-04-25T09:57:26.849 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T09:57:26.850 INFO:teuthology.orchestra.run.smithi007.stdout: "ino": 1099511627777, 2024-04-25T09:57:26.850 INFO:teuthology.orchestra.run.smithi007.stdout: "ancestors": [ 2024-04-25T09:57:26.850 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:57:26.850 INFO:teuthology.orchestra.run.smithi007.stdout: "dirino": 1099511627776, 2024-04-25T09:57:26.850 INFO:teuthology.orchestra.run.smithi007.stdout: "dname": "file", 2024-04-25T09:57:26.850 INFO:teuthology.orchestra.run.smithi007.stdout: "version": 2 2024-04-25T09:57:26.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:57:26.850 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:57:26.850 INFO:teuthology.orchestra.run.smithi007.stdout: "dirino": 1, 2024-04-25T09:57:26.850 INFO:teuthology.orchestra.run.smithi007.stdout: "dname": "dir_test", 2024-04-25T09:57:26.850 INFO:teuthology.orchestra.run.smithi007.stdout: "version": 4 2024-04-25T09:57:26.850 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:57:26.850 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-25T09:57:26.851 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 10, 2024-04-25T09:57:26.851 INFO:teuthology.orchestra.run.smithi007.stdout: "old_pools": [] 2024-04-25T09:57:26.851 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T09:57:26.851 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:57:26.853 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'The backtrace is corrupted' 2024-04-25T09:57:26.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.933+0000 7f4211c5ef40 1 Processor -- start 2024-04-25T09:57:26.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.933+0000 7f4211c5ef40 1 -- start start 2024-04-25T09:57:26.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.934+0000 7f4211c5ef40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f5609dbe70 0x55f560aa0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:26.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.934+0000 7f4211c5ef40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55f560aa9ad0 0x55f560a25000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:26.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.934+0000 7f4211c5ef40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f560aa9eb0 0x55f560a25540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:26.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.934+0000 7f4211c5ef40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f560ab77f0 con 0x55f560aa9eb0 2024-04-25T09:57:26.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.934+0000 7f4211c5ef40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f560984df0 con 0x55f5609dbe70 2024-04-25T09:57:26.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.934+0000 7f4211c5ef40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f560ab72b0 con 0x55f560aa9ad0 2024-04-25T09:57:26.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.934+0000 7f420ff60640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f560aa9eb0 0x55f560a25540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:26.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.934+0000 7f420ff60640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f560aa9eb0 0x55f560a25540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50416/0 (socket says 172.21.15.7:50416) 2024-04-25T09:57:26.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.934+0000 7f420ff60640 1 -- 172.21.15.7:0/546949131 learned_addr learned my addr 172.21.15.7:0/546949131 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:26.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.934+0000 7f420f75f640 1 --2- 172.21.15.7:0/546949131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f5609dbe70 0x55f560aa0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:26.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.934+0000 7f420ef5e640 1 --2- 172.21.15.7:0/546949131 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55f560aa9ad0 0x55f560a25000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:26.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.934+0000 7f420ff60640 1 -- 172.21.15.7:0/546949131 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55f560aa9ad0 msgr2=0x55f560a25000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:26.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.934+0000 7f420ff60640 1 --2- 172.21.15.7:0/546949131 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55f560aa9ad0 0x55f560a25000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:26.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.934+0000 7f420ff60640 1 -- 172.21.15.7:0/546949131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f5609dbe70 msgr2=0x55f560aa0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:26.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.934+0000 7f420ff60640 1 --2- 172.21.15.7:0/546949131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f5609dbe70 0x55f560aa0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:26.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.934+0000 7f420ff60640 1 -- 172.21.15.7:0/546949131 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f56090ac50 con 0x55f560aa9eb0 2024-04-25T09:57:26.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.934+0000 7f420f75f640 1 --2- 172.21.15.7:0/546949131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f5609dbe70 0x55f560aa0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:57:26.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.935+0000 7f420ff60640 1 --2- 172.21.15.7:0/546949131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f560aa9eb0 0x55f560a25540 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f420000b5d0 tx=0x7f420000ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4aa0627da574b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:26.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.935+0000 7f420df5c640 1 -- 172.21.15.7:0/546949131 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4200014030 con 0x55f560aa9eb0 2024-04-25T09:57:26.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.935+0000 7f420df5c640 1 -- 172.21.15.7:0/546949131 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4200010620 con 0x55f560aa9eb0 2024-04-25T09:57:26.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.935+0000 7f420df5c640 1 -- 172.21.15.7:0/546949131 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42000109f0 con 0x55f560aa9eb0 2024-04-25T09:57:26.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.935+0000 7f4211c5ef40 1 -- 172.21.15.7:0/546949131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f560aa9eb0 msgr2=0x55f560a25540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:26.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.935+0000 7f4211c5ef40 1 --2- 172.21.15.7:0/546949131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f560aa9eb0 0x55f560a25540 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f420000b5d0 tx=0x7f420000ba90 comp rx=0 tx=0).stop 2024-04-25T09:57:26.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.935+0000 7f4211c5ef40 1 -- 172.21.15.7:0/546949131 shutdown_connections 2024-04-25T09:57:26.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.935+0000 7f4211c5ef40 1 --2- 172.21.15.7:0/546949131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f560aa9eb0 0x55f560a25540 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:26.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.935+0000 7f4211c5ef40 1 --2- 172.21.15.7:0/546949131 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55f560aa9ad0 0x55f560a25000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:26.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.935+0000 7f4211c5ef40 1 --2- 172.21.15.7:0/546949131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f5609dbe70 0x55f560aa0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:26.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.935+0000 7f4211c5ef40 1 -- 172.21.15.7:0/546949131 >> 172.21.15.7:0/546949131 conn(0x55f5609dca60 msgr2=0x55f5609dce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:26.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.935+0000 7f4211c5ef40 1 -- 172.21.15.7:0/546949131 shutdown_connections 2024-04-25T09:57:26.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.935+0000 7f4211c5ef40 1 -- 172.21.15.7:0/546949131 wait complete. 2024-04-25T09:57:26.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.936+0000 7f4211c5ef40 1 Processor -- start 2024-04-25T09:57:26.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.936+0000 7f4211c5ef40 1 -- start start 2024-04-25T09:57:26.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.937+0000 7f4211c5ef40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f5609dbe70 0x55f560b40cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:26.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.937+0000 7f4211c5ef40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f560aa9ad0 0x55f560ab42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:26.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.937+0000 7f4211c5ef40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55f560aa9eb0 0x55f560ab4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:26.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.937+0000 7f4211c5ef40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f560ab0e50 con 0x55f5609dbe70 2024-04-25T09:57:26.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.937+0000 7f4211c5ef40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f560ab6520 con 0x55f560aa9ad0 2024-04-25T09:57:26.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.937+0000 7f4211c5ef40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f560ab2310 con 0x55f560aa9eb0 2024-04-25T09:57:26.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.937+0000 7f420f75f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f5609dbe70 0x55f560b40cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:26.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.937+0000 7f420f75f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f5609dbe70 0x55f560b40cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50430/0 (socket says 172.21.15.7:50430) 2024-04-25T09:57:26.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.937+0000 7f420f75f640 1 -- 172.21.15.7:0/1808906639 learned_addr learned my addr 172.21.15.7:0/1808906639 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:26.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.937+0000 7f420ef5e640 1 --2- 172.21.15.7:0/1808906639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f560aa9ad0 0x55f560ab42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:26.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.937+0000 7f420ff60640 1 --2- 172.21.15.7:0/1808906639 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55f560aa9eb0 0x55f560ab4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:26.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.937+0000 7f420f75f640 1 -- 172.21.15.7:0/1808906639 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55f560aa9eb0 msgr2=0x55f560ab4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:26.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.937+0000 7f420f75f640 1 --2- 172.21.15.7:0/1808906639 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55f560aa9eb0 0x55f560ab4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:26.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.937+0000 7f420f75f640 1 -- 172.21.15.7:0/1808906639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f560aa9ad0 msgr2=0x55f560ab42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:26.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.937+0000 7f420f75f640 1 --2- 172.21.15.7:0/1808906639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f560aa9ad0 0x55f560ab42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:26.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.937+0000 7f420f75f640 1 -- 172.21.15.7:0/1808906639 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f560aa8a60 con 0x55f5609dbe70 2024-04-25T09:57:26.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.937+0000 7f420f75f640 1 --2- 172.21.15.7:0/1808906639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f5609dbe70 0x55f560b40cd0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f4208000c00 tx=0x7f4208002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:26.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.937+0000 7f420cf5a640 1 -- 172.21.15.7:0/1808906639 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420806b070 con 0x55f5609dbe70 2024-04-25T09:57:26.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.937+0000 7f420cf5a640 1 -- 172.21.15.7:0/1808906639 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4208052890 con 0x55f5609dbe70 2024-04-25T09:57:26.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.937+0000 7f4211c5ef40 1 -- 172.21.15.7:0/1808906639 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f560b416b0 con 0x55f5609dbe70 2024-04-25T09:57:26.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.937+0000 7f420cf5a640 1 -- 172.21.15.7:0/1808906639 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4208056070 con 0x55f5609dbe70 2024-04-25T09:57:26.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.937+0000 7f4211c5ef40 1 -- 172.21.15.7:0/1808906639 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f560a9d6a0 con 0x55f5609dbe70 2024-04-25T09:57:26.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.939+0000 7f420cf5a640 1 -- 172.21.15.7:0/1808906639 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f420806e070 con 0x55f5609dbe70 2024-04-25T09:57:26.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.939+0000 7f420cf5a640 1 --2- 172.21.15.7:0/1808906639 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f41fc069eb0 0x7f41fc06c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:26.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.939+0000 7f420cf5a640 1 -- 172.21.15.7:0/1808906639 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f42080ccb60 con 0x55f5609dbe70 2024-04-25T09:57:26.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.939+0000 7f420ef5e640 1 --2- 172.21.15.7:0/1808906639 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f41fc069eb0 0x7f41fc06c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:26.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.939+0000 7f4211c5ef40 1 --2- 172.21.15.7:0/1808906639 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x55f560b41210 0x55f560b585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:26.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.939+0000 7f4211c5ef40 1 -- 172.21.15.7:0/1808906639 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:1 10.7 10:e2e07930:::10000000001.00000000:head [setxattr parent (26) in=32b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62) v9 -- 0x55f560a27a00 con 0x55f560b41210 2024-04-25T09:57:26.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.940+0000 7f420ef5e640 1 --2- 172.21.15.7:0/1808906639 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f41fc069eb0 0x7f41fc06c370 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x55f5609dcf20 tx=0x7f420400e040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:26.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.940+0000 7f420ff60640 1 --2- 172.21.15.7:0/1808906639 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x55f560b41210 0x55f560b585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:26.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.940+0000 7f420ff60640 1 --2- 172.21.15.7:0/1808906639 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x55f560b41210 0x55f560b585d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:26.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.941+0000 7f420ff60640 1 -- 172.21.15.7:0/1808906639 <== osd.6 v2:172.21.15.55:6824/4293769515 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (26)] v62'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f4200010a30 con 0x55f560b41210 2024-04-25T09:57:26.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.941+0000 7f4211c5ef40 1 -- 172.21.15.7:0/1808906639 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x55f560b41210 msgr2=0x55f560b585d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:26.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.941+0000 7f4211c5ef40 1 --2- 172.21.15.7:0/1808906639 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x55f560b41210 0x55f560b585d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:26.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.941+0000 7f4211c5ef40 1 -- 172.21.15.7:0/1808906639 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f41fc069eb0 msgr2=0x7f41fc06c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:26.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.941+0000 7f4211c5ef40 1 --2- 172.21.15.7:0/1808906639 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f41fc069eb0 0x7f41fc06c370 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x55f5609dcf20 tx=0x7f420400e040 comp rx=0 tx=0).stop 2024-04-25T09:57:26.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.941+0000 7f4211c5ef40 1 -- 172.21.15.7:0/1808906639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f5609dbe70 msgr2=0x55f560b40cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:26.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.941+0000 7f4211c5ef40 1 --2- 172.21.15.7:0/1808906639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f5609dbe70 0x55f560b40cd0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f4208000c00 tx=0x7f4208002fb0 comp rx=0 tx=0).stop 2024-04-25T09:57:26.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.941+0000 7f420ff60640 1 -- 172.21.15.7:0/1808906639 reap_dead start 2024-04-25T09:57:26.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.942+0000 7f4211c5ef40 1 -- 172.21.15.7:0/1808906639 shutdown_connections 2024-04-25T09:57:26.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.942+0000 7f4211c5ef40 1 -- 172.21.15.7:0/1808906639 >> 172.21.15.7:0/1808906639 conn(0x55f5609dca60 msgr2=0x55f560ab1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:26.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.942+0000 7f4211c5ef40 1 -- 172.21.15.7:0/1808906639 shutdown_connections 2024-04-25T09:57:26.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:26.942+0000 7f4211c5ef40 1 -- 172.21.15.7:0/1808906639 wait complete. 2024-04-25T09:57:26.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:57:26.951 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start / recursive 2024-04-25T09:57:27.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.090+0000 7fc403acb640 1 Processor -- start 2024-04-25T09:57:27.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.091+0000 7fc403acb640 1 -- start start 2024-04-25T09:57:27.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.091+0000 7fc403acb640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc3fc1582d0 0x7fc3fc0ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.091+0000 7fc403acb640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3fc0cd700 0x7fc3fc06b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.091+0000 7fc403acb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3fc0cdd60 con 0x7fc3fc06ab60 2024-04-25T09:57:27.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.091+0000 7fc403acb640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3fc0cfaf0 con 0x7fc3fc1582d0 2024-04-25T09:57:27.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.091+0000 7fc403acb640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc0cfdd0 con 0x7fc3fc0cd700 2024-04-25T09:57:27.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.091+0000 7fc401867640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc3fc1582d0 0x7fc3fc0ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.091+0000 7fc401867640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc3fc1582d0 0x7fc3fc0ad2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50446/0 (socket says 172.21.15.7:50446) 2024-04-25T09:57:27.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.091+0000 7fc401867640 1 -- 172.21.15.7:0/1115312257 learned_addr learned my addr 172.21.15.7:0/1115312257 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:27.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.092+0000 7fc402068640 1 --2- 172.21.15.7:0/1115312257 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3fc0cd700 0x7fc3fc06b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.092+0000 7fc401867640 1 -- 172.21.15.7:0/1115312257 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3fc0cd700 msgr2=0x7fc3fc06b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:27.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.092+0000 7fc401867640 1 --2- 172.21.15.7:0/1115312257 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3fc0cd700 0x7fc3fc06b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.092+0000 7fc401867640 1 -- 172.21.15.7:0/1115312257 >> v1:172.21.15.55:6789/0 conn(0x7fc3fc06ab60 legacy=0x7fc3fc0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:27.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.092+0000 7fc401867640 1 -- 172.21.15.7:0/1115312257 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3fc0d00b0 con 0x7fc3fc1582d0 2024-04-25T09:57:27.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.092+0000 7fc401867640 1 --2- 172.21.15.7:0/1115312257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3fc1582d0 0x7fc3fc0ad2c0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec009e50 tx=0x7fc3ec02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1cb97c1d3bc6c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:27.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.093+0000 7fc400865640 1 -- 172.21.15.7:0/1115312257 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec036070 con 0x7fc3fc1582d0 2024-04-25T09:57:27.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.093+0000 7fc400865640 1 -- 172.21.15.7:0/1115312257 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ec031600 con 0x7fc3fc1582d0 2024-04-25T09:57:27.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.093+0000 7fc400865640 1 -- 172.21.15.7:0/1115312257 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec0319d0 con 0x7fc3fc1582d0 2024-04-25T09:57:27.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.093+0000 7fc403acb640 1 -- 172.21.15.7:0/1115312257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3fc1582d0 msgr2=0x7fc3fc0ad2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:27.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.093+0000 7fc403acb640 1 --2- 172.21.15.7:0/1115312257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3fc1582d0 0x7fc3fc0ad2c0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec009e50 tx=0x7fc3ec02a680 comp rx=0 tx=0).stop 2024-04-25T09:57:27.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.093+0000 7fc403acb640 1 -- 172.21.15.7:0/1115312257 shutdown_connections 2024-04-25T09:57:27.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.093+0000 7fc403acb640 1 --2- 172.21.15.7:0/1115312257 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3fc0cd700 0x7fc3fc06b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.093+0000 7fc403acb640 1 --2- 172.21.15.7:0/1115312257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3fc1582d0 0x7fc3fc0ad2c0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.093+0000 7fc403acb640 1 -- 172.21.15.7:0/1115312257 >> 172.21.15.7:0/1115312257 conn(0x7fc3fc072650 msgr2=0x7fc3fc0999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:27.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.093+0000 7fc403acb640 1 -- 172.21.15.7:0/1115312257 shutdown_connections 2024-04-25T09:57:27.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.093+0000 7fc403acb640 1 -- 172.21.15.7:0/1115312257 wait complete. 2024-04-25T09:57:27.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.094+0000 7fc403acb640 1 Processor -- start 2024-04-25T09:57:27.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.095+0000 7fc403acb640 1 -- start start 2024-04-25T09:57:27.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.095+0000 7fc403acb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3fc06ab60 0x7fc3fc155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.095+0000 7fc403acb640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3fc0cd700 0x7fc3fc153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.095+0000 7fc403acb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3fc1582d0 0x7fc3fc0b5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.095+0000 7fc403acb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc0d0750 con 0x7fc3fc06ab60 2024-04-25T09:57:27.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.095+0000 7fc403acb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc0d05d0 con 0x7fc3fc1582d0 2024-04-25T09:57:27.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.095+0000 7fc403acb640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc0d08d0 con 0x7fc3fc0cd700 2024-04-25T09:57:27.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.095+0000 7fc401867640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3fc06ab60 0x7fc3fc155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.095+0000 7fc401867640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3fc06ab60 0x7fc3fc155360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50460/0 (socket says 172.21.15.7:50460) 2024-04-25T09:57:27.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.095+0000 7fc401867640 1 -- 172.21.15.7:0/2215642074 learned_addr learned my addr 172.21.15.7:0/2215642074 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:27.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.095+0000 7fc401066640 1 --2- 172.21.15.7:0/2215642074 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3fc0cd700 0x7fc3fc153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.096+0000 7fc402068640 1 --2- 172.21.15.7:0/2215642074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3fc1582d0 0x7fc3fc0b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.096+0000 7fc401867640 1 -- 172.21.15.7:0/2215642074 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3fc0cd700 msgr2=0x7fc3fc153a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:27.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.096+0000 7fc401867640 1 --2- 172.21.15.7:0/2215642074 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3fc0cd700 0x7fc3fc153a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.096+0000 7fc401867640 1 -- 172.21.15.7:0/2215642074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3fc1582d0 msgr2=0x7fc3fc0b5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:27.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.096+0000 7fc401867640 1 --2- 172.21.15.7:0/2215642074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3fc1582d0 0x7fc3fc0b5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.096+0000 7fc401867640 1 -- 172.21.15.7:0/2215642074 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3fc0b5ab0 con 0x7fc3fc06ab60 2024-04-25T09:57:27.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.096+0000 7fc401066640 1 --2- 172.21.15.7:0/2215642074 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3fc0cd700 0x7fc3fc153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:57:27.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.096+0000 7fc402068640 1 --2- 172.21.15.7:0/2215642074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3fc1582d0 0x7fc3fc0b5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:57:27.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.096+0000 7fc401867640 1 --2- 172.21.15.7:0/2215642074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3fc06ab60 0x7fc3fc155360 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec034040 tx=0x7fc3ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:27.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.096+0000 7fc3fa7fc640 1 -- 172.21.15.7:0/2215642074 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec03f020 con 0x7fc3fc06ab60 2024-04-25T09:57:27.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.096+0000 7fc3fa7fc640 1 -- 172.21.15.7:0/2215642074 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ec037040 con 0x7fc3fc06ab60 2024-04-25T09:57:27.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.096+0000 7fc3fa7fc640 1 -- 172.21.15.7:0/2215642074 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec036070 con 0x7fc3fc06ab60 2024-04-25T09:57:27.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.096+0000 7fc403acb640 1 -- 172.21.15.7:0/2215642074 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3fc0b5d90 con 0x7fc3fc06ab60 2024-04-25T09:57:27.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.096+0000 7fc403acb640 1 -- 172.21.15.7:0/2215642074 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3fc159860 con 0x7fc3fc06ab60 2024-04-25T09:57:27.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.097+0000 7fc3fa7fc640 1 -- 172.21.15.7:0/2215642074 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc3ec042020 con 0x7fc3fc06ab60 2024-04-25T09:57:27.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.098+0000 7fc3fa7fc640 1 --2- 172.21.15.7:0/2215642074 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc3e806b500 0x7fc3e806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.098+0000 7fc3fa7fc640 1 -- 172.21.15.7:0/2215642074 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc3ec0aa8c0 con 0x7fc3fc06ab60 2024-04-25T09:57:27.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.098+0000 7fc401066640 1 --2- 172.21.15.7:0/2215642074 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc3e806b500 0x7fc3e806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.098+0000 7fc401066640 1 --2- 172.21.15.7:0/2215642074 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc3e806b500 0x7fc3e806d9c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc0aecb0 tx=0x7fc3f0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:27.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.099+0000 7fc4067d5740 1 Processor -- start 2024-04-25T09:57:27.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.099+0000 7fc4067d5740 1 -- start start 2024-04-25T09:57:27.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.100+0000 7fc4067d5740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5591ce06d080 0x5591ce06f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.100+0000 7fc4067d5740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5591ce06d460 0x5591ce06fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.100+0000 7fc4067d5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ce03fce0 0x5591ce0434f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.100+0000 7fc4067d5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591cdfa8af0 con 0x5591ce03fce0 2024-04-25T09:57:27.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.100+0000 7fc4067d5740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591cdf51de0 con 0x5591ce06d460 2024-04-25T09:57:27.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.100+0000 7fc4067d5740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5591cdfa4b90 con 0x5591ce06d080 2024-04-25T09:57:27.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.100+0000 7fc402068640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ce03fce0 0x5591ce0434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.100+0000 7fc402068640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ce03fce0 0x5591ce0434f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50464/0 (socket says 172.21.15.7:50464) 2024-04-25T09:57:27.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.100+0000 7fc402068640 1 -- 172.21.15.7:0/295081426 learned_addr learned my addr 172.21.15.7:0/295081426 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:27.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.100+0000 7fc401066640 1 --2- 172.21.15.7:0/295081426 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5591ce06d460 0x5591ce06fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.100+0000 7fc401867640 1 --2- 172.21.15.7:0/295081426 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5591ce06d080 0x5591ce06f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.100+0000 7fc402068640 1 -- 172.21.15.7:0/295081426 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5591ce06d080 msgr2=0x5591ce06f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:27.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.100+0000 7fc402068640 1 --2- 172.21.15.7:0/295081426 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5591ce06d080 0x5591ce06f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.100+0000 7fc402068640 1 -- 172.21.15.7:0/295081426 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5591ce06d460 msgr2=0x5591ce06fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:27.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.100+0000 7fc402068640 1 --2- 172.21.15.7:0/295081426 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5591ce06d460 0x5591ce06fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.100+0000 7fc402068640 1 -- 172.21.15.7:0/295081426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591cdd897b0 con 0x5591ce03fce0 2024-04-25T09:57:27.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.100+0000 7fc402068640 1 --2- 172.21.15.7:0/295081426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ce03fce0 0x5591ce0434f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fc3f400b950 tx=0x7fc3f400be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baabf27a72cb9394 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:27.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.101+0000 7fc3e37fe640 1 -- 172.21.15.7:0/295081426 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f4018020 con 0x5591ce03fce0 2024-04-25T09:57:27.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.101+0000 7fc3e37fe640 1 -- 172.21.15.7:0/295081426 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f400fa20 con 0x5591ce03fce0 2024-04-25T09:57:27.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.101+0000 7fc3e37fe640 1 -- 172.21.15.7:0/295081426 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f400fdd0 con 0x5591ce03fce0 2024-04-25T09:57:27.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.101+0000 7fc4067d5740 1 -- 172.21.15.7:0/295081426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ce03fce0 msgr2=0x5591ce0434f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:27.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.101+0000 7fc4067d5740 1 --2- 172.21.15.7:0/295081426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ce03fce0 0x5591ce0434f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fc3f400b950 tx=0x7fc3f400be10 comp rx=0 tx=0).stop 2024-04-25T09:57:27.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.101+0000 7fc4067d5740 1 -- 172.21.15.7:0/295081426 shutdown_connections 2024-04-25T09:57:27.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.101+0000 7fc4067d5740 1 --2- 172.21.15.7:0/295081426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ce03fce0 0x5591ce0434f0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.101+0000 7fc4067d5740 1 --2- 172.21.15.7:0/295081426 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5591ce06d460 0x5591ce06fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.101+0000 7fc4067d5740 1 --2- 172.21.15.7:0/295081426 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5591ce06d080 0x5591ce06f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.101+0000 7fc4067d5740 1 -- 172.21.15.7:0/295081426 >> 172.21.15.7:0/295081426 conn(0x5591ce041f50 msgr2=0x5591ce08a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:27.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.101+0000 7fc4067d5740 1 -- 172.21.15.7:0/295081426 shutdown_connections 2024-04-25T09:57:27.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.101+0000 7fc4067d5740 1 -- 172.21.15.7:0/295081426 wait complete. 2024-04-25T09:57:27.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.102+0000 7fc4067d5740 1 -- start start 2024-04-25T09:57:27.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.102+0000 7fc4067d5740 1 Processor -- start 2024-04-25T09:57:27.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.103+0000 7fc4067d5740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5591ce06d080 0x5591ce08e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.103+0000 7fc4067d5740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5591ce06d460 0x5591ce08b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.103+0000 7fc4067d5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ce066cf0 0x5591ce067170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.103+0000 7fc4067d5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ce045100 con 0x5591ce066cf0 2024-04-25T09:57:27.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.103+0000 7fc4067d5740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591cdf473e0 con 0x5591ce06d460 2024-04-25T09:57:27.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.103+0000 7fc4067d5740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5591ce0453e0 con 0x5591ce06d080 2024-04-25T09:57:27.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.103+0000 7fc4067d5740 10 client.0 _ll_register_callbacks cb 0x5591cdf64d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:57:27.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.103+0000 7fc402068640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ce066cf0 0x5591ce067170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.103+0000 7fc402068640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ce066cf0 0x5591ce067170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50472/0 (socket says 172.21.15.7:50472) 2024-04-25T09:57:27.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.103+0000 7fc402068640 1 -- 172.21.15.7:0/2455928160 learned_addr learned my addr 172.21.15.7:0/2455928160 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:27.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.103+0000 7fc401867640 1 --2- 172.21.15.7:0/2455928160 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5591ce06d080 0x5591ce08e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.103+0000 7fc401066640 1 --2- 172.21.15.7:0/2455928160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5591ce06d460 0x5591ce08b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.103+0000 7fc402068640 1 -- 172.21.15.7:0/2455928160 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5591ce06d080 msgr2=0x5591ce08e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:27.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.103+0000 7fc402068640 1 --2- 172.21.15.7:0/2455928160 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5591ce06d080 0x5591ce08e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.103+0000 7fc402068640 1 -- 172.21.15.7:0/2455928160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5591ce06d460 msgr2=0x5591ce08b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:27.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.103+0000 7fc402068640 1 --2- 172.21.15.7:0/2455928160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5591ce06d460 0x5591ce08b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.103+0000 7fc402068640 1 -- 172.21.15.7:0/2455928160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5591cdde9f40 con 0x5591ce066cf0 2024-04-25T09:57:27.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.104+0000 7fc402068640 1 --2- 172.21.15.7:0/2455928160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ce066cf0 0x5591ce067170 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4006a40 tx=0x7fc3f4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0abc7fa78ffc052 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:27.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.104+0000 7fc3e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:57:27.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.104+0000 7fc3e0ff9640 1 -- 172.21.15.7:0/2455928160 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f402b060 con 0x5591ce066cf0 2024-04-25T09:57:27.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.104+0000 7fc3e0ff9640 1 -- 172.21.15.7:0/2455928160 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc3f400f820 con 0x5591ce066cf0 2024-04-25T09:57:27.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.104+0000 7fc4067d5740 1 -- 172.21.15.7:0/2455928160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc3f400fa20 con 0x5591ce066cf0 2024-04-25T09:57:27.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.104+0000 7fc3e0ff9640 1 -- 172.21.15.7:0/2455928160 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3f4031050 con 0x5591ce066cf0 2024-04-25T09:57:27.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.104+0000 7fc4067d5740 10 client.6489 fetch_fsmap learned FSMap version 28 2024-04-25T09:57:27.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.104+0000 7fc4067d5740 1 -- 172.21.15.7:0/2455928160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x5591cdc7d0a0 con 0x5591ce066cf0 2024-04-25T09:57:27.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.104+0000 7fc3e0ff9640 1 -- 172.21.15.7:0/2455928160 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f400fa20 con 0x5591ce066cf0 2024-04-25T09:57:27.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.104+0000 7fc3e0ff9640 1 -- 172.21.15.7:0/2455928160 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc3f4034020 con 0x5591ce066cf0 2024-04-25T09:57:27.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.104+0000 7fc4067d5740 10 client.6489 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T09:57:27.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.104+0000 7fc4067d5740 10 client.6489 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:57:27.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.104+0000 7fc4067d5740 20 client.6489 populate_metadata read hostname 'smithi007' 2024-04-25T09:57:27.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.104+0000 7fc4067d5740 1 --2- 172.21.15.7:0/2455928160 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5591ce071430 0x5591ce071810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.104+0000 7fc4067d5740 4 client.6489 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:57:27.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.104+0000 7fc4067d5740 1 -- 172.21.15.7:0/2455928160 --> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5591cdfb6030 con 0x5591ce071430 2024-04-25T09:57:27.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.104+0000 7fc401867640 1 --2- 172.21.15.7:0/2455928160 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5591ce071430 0x5591ce071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.105+0000 7fc3e0ff9640 10 client.6489 ms_handle_connect on v2:172.21.15.7:6834/3057688863 2024-04-25T09:57:27.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.105+0000 7fc401867640 1 --2- 172.21.15.7:0/2455928160 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5591ce071430 0x5591ce071810 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1b3362e528adc88 server_cookie=ce09953df62741c1 in_seq=0 out_seq=0 2024-04-25T09:57:27.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.105+0000 7fc3e0ff9640 1 -- 172.21.15.7:0/2455928160 <== mds.0 v2:172.21.15.7:6834/3057688863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5591cdfb6030 con 0x5591ce071430 2024-04-25T09:57:27.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.105+0000 7fc3e0ff9640 10 client.6489 handle_command_reply: tid=0 2024-04-25T09:57:27.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.105+0000 7fc4067d5740 1 client.6489 shutdown 2024-04-25T09:57:27.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.105+0000 7fc4067d5740 1 -- 172.21.15.7:0/2455928160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ce066cf0 msgr2=0x5591ce067170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:27.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.105+0000 7fc4067d5740 1 --2- 172.21.15.7:0/2455928160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ce066cf0 0x5591ce067170 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4006a40 tx=0x7fc3f4004730 comp rx=0 tx=0).stop 2024-04-25T09:57:27.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.105+0000 7fc4067d5740 1 -- 172.21.15.7:0/2455928160 shutdown_connections 2024-04-25T09:57:27.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.105+0000 7fc4067d5740 1 --2- 172.21.15.7:0/2455928160 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5591ce071430 0x5591ce071810 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.105+0000 7fc4067d5740 1 --2- 172.21.15.7:0/2455928160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ce066cf0 0x5591ce067170 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.105+0000 7fc4067d5740 1 --2- 172.21.15.7:0/2455928160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5591ce06d460 0x5591ce08b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.105+0000 7fc3e0ff9640 0 client.6489 ms_handle_reset on v2:172.21.15.7:6834/3057688863 2024-04-25T09:57:27.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.105+0000 7fc4067d5740 1 --2- 172.21.15.7:0/2455928160 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5591ce06d080 0x5591ce08e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.105+0000 7fc4067d5740 1 -- 172.21.15.7:0/2455928160 >> 172.21.15.7:0/2455928160 conn(0x5591ce03fce0 msgr2=0x5591ce06c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:27.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.105+0000 7fc4067d5740 1 -- 172.21.15.7:0/2455928160 shutdown_connections 2024-04-25T09:57:27.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.105+0000 7fc4067d5740 1 -- 172.21.15.7:0/2455928160 wait complete. 2024-04-25T09:57:27.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.106+0000 7fc4067d5740 20 client.6489 trim_cache size 0 max 16384 2024-04-25T09:57:27.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.121+0000 7fc4067d5740 1 Processor -- start 2024-04-25T09:57:27.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.121+0000 7fc4067d5740 1 -- start start 2024-04-25T09:57:27.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.122+0000 7fc4067d5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ce066cf0 0x5591ce06f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.122+0000 7fc4067d5740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5591ce06d080 0x5591ce0ecba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.122+0000 7fc4067d5740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5591ce06d460 0x5591ce06c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.122+0000 7fc4067d5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc200530 con 0x5591ce066cf0 2024-04-25T09:57:27.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.122+0000 7fc4067d5740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc1ff6d0 con 0x5591ce06d460 2024-04-25T09:57:27.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.122+0000 7fc4067d5740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc15aea0 con 0x5591ce06d080 2024-04-25T09:57:27.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.122+0000 7fc401867640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ce066cf0 0x5591ce06f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.122+0000 7fc401867640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ce066cf0 0x5591ce06f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50488/0 (socket says 172.21.15.7:50488) 2024-04-25T09:57:27.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.122+0000 7fc401867640 1 -- 172.21.15.7:0/2342954451 learned_addr learned my addr 172.21.15.7:0/2342954451 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:27.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.122+0000 7fc401066640 1 --2- 172.21.15.7:0/2342954451 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5591ce06d080 0x5591ce0ecba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.122+0000 7fc402068640 1 --2- 172.21.15.7:0/2342954451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5591ce06d460 0x5591ce06c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.122+0000 7fc401867640 1 -- 172.21.15.7:0/2342954451 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5591ce06d080 msgr2=0x5591ce0ecba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:27.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.122+0000 7fc401867640 1 --2- 172.21.15.7:0/2342954451 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5591ce06d080 0x5591ce0ecba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.122+0000 7fc401867640 1 -- 172.21.15.7:0/2342954451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5591ce06d460 msgr2=0x5591ce06c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:27.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.122+0000 7fc401867640 1 --2- 172.21.15.7:0/2342954451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5591ce06d460 0x5591ce06c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.122+0000 7fc401867640 1 -- 172.21.15.7:0/2342954451 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591cdf64f00 con 0x5591ce066cf0 2024-04-25T09:57:27.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.122+0000 7fc401066640 1 --2- 172.21.15.7:0/2342954451 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5591ce06d080 0x5591ce0ecba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:57:27.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.122+0000 7fc402068640 1 --2- 172.21.15.7:0/2342954451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5591ce06d460 0x5591ce06c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:57:27.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.122+0000 7fc401867640 1 --2- 172.21.15.7:0/2342954451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ce066cf0 0x5591ce06f850 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec081000 tx=0x7fc3ec0aa040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4549a1e8b5241460 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:27.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.122+0000 7fc3e2ffd640 1 -- 172.21.15.7:0/2342954451 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec095070 con 0x5591ce066cf0 2024-04-25T09:57:27.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.122+0000 7fc3e2ffd640 1 -- 172.21.15.7:0/2342954451 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ec07cf70 con 0x5591ce066cf0 2024-04-25T09:57:27.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.122+0000 7fc3e2ffd640 1 -- 172.21.15.7:0/2342954451 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec081530 con 0x5591ce066cf0 2024-04-25T09:57:27.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.123+0000 7fc4067d5740 1 -- 172.21.15.7:0/2342954451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ce066cf0 msgr2=0x5591ce06f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:27.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.123+0000 7fc4067d5740 1 --2- 172.21.15.7:0/2342954451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ce066cf0 0x5591ce06f850 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec081000 tx=0x7fc3ec0aa040 comp rx=0 tx=0).stop 2024-04-25T09:57:27.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.123+0000 7fc4067d5740 1 -- 172.21.15.7:0/2342954451 shutdown_connections 2024-04-25T09:57:27.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.123+0000 7fc4067d5740 1 --2- 172.21.15.7:0/2342954451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5591ce06d460 0x5591ce06c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.123+0000 7fc4067d5740 1 --2- 172.21.15.7:0/2342954451 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5591ce06d080 0x5591ce0ecba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.123+0000 7fc4067d5740 1 --2- 172.21.15.7:0/2342954451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ce066cf0 0x5591ce06f850 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.123+0000 7fc4067d5740 1 -- 172.21.15.7:0/2342954451 >> 172.21.15.7:0/2342954451 conn(0x5591ce03fce0 msgr2=0x5591ce08e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:27.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.123+0000 7fc4067d5740 1 -- 172.21.15.7:0/2342954451 shutdown_connections 2024-04-25T09:57:27.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.123+0000 7fc4067d5740 1 -- 172.21.15.7:0/2342954451 wait complete. 2024-04-25T09:57:27.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.123+0000 7fc4067d5740 1 -- start start 2024-04-25T09:57:27.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.123+0000 7fc4067d5740 1 Processor -- start 2024-04-25T09:57:27.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.124+0000 7fc4067d5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ce066cf0 0x5591ce069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.124+0000 7fc4067d5740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5591ce06d080 0x5591ce06c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.124+0000 7fc4067d5740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5591ce06d460 0x5591ce06c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.124+0000 7fc4067d5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc1ff0d0 con 0x5591ce066cf0 2024-04-25T09:57:27.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.124+0000 7fc4067d5740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ce0470b0 con 0x5591ce06d080 2024-04-25T09:57:27.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.124+0000 7fc4067d5740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5591ce06a380 con 0x5591ce06d460 2024-04-25T09:57:27.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.124+0000 7fc4067d5740 10 client.0 _ll_register_callbacks cb 0x7fc3f400b7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:57:27.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.124+0000 7fc401867640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ce066cf0 0x5591ce069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.124+0000 7fc401867640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ce066cf0 0x5591ce069bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50492/0 (socket says 172.21.15.7:50492) 2024-04-25T09:57:27.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.125+0000 7fc401867640 1 -- 172.21.15.7:0/601486481 learned_addr learned my addr 172.21.15.7:0/601486481 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:27.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.125+0000 7fc402068640 1 --2- 172.21.15.7:0/601486481 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5591ce06d460 0x5591ce06c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.125+0000 7fc401066640 1 --2- 172.21.15.7:0/601486481 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5591ce06d080 0x5591ce06c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.125+0000 7fc401867640 1 -- 172.21.15.7:0/601486481 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5591ce06d460 msgr2=0x5591ce06c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:27.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.125+0000 7fc401867640 1 --2- 172.21.15.7:0/601486481 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5591ce06d460 0x5591ce06c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.125+0000 7fc401867640 1 -- 172.21.15.7:0/601486481 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5591ce06d080 msgr2=0x5591ce06c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:27.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.125+0000 7fc401867640 1 --2- 172.21.15.7:0/601486481 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5591ce06d080 0x5591ce06c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.125+0000 7fc401867640 1 -- 172.21.15.7:0/601486481 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5591ce06a5d0 con 0x5591ce066cf0 2024-04-25T09:57:27.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.125+0000 7fc402068640 1 --2- 172.21.15.7:0/601486481 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5591ce06d460 0x5591ce06c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:57:27.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.125+0000 7fc401066640 1 --2- 172.21.15.7:0/601486481 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5591ce06d080 0x5591ce06c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:57:27.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.125+0000 7fc401867640 1 --2- 172.21.15.7:0/601486481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ce066cf0 0x5591ce069bf0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec000f80 tx=0x7fc3f4009000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a2a9ab89d7f2a09 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:27.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.125+0000 7fc3e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:57:27.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.125+0000 7fc3e0ff9640 1 -- 172.21.15.7:0/601486481 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec095070 con 0x5591ce066cf0 2024-04-25T09:57:27.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.125+0000 7fc3e0ff9640 1 -- 172.21.15.7:0/601486481 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc3ec077120 con 0x5591ce066cf0 2024-04-25T09:57:27.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.125+0000 7fc4067d5740 1 -- 172.21.15.7:0/601486481 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc3ec07cf70 con 0x5591ce066cf0 2024-04-25T09:57:27.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.125+0000 7fc3e0ff9640 1 -- 172.21.15.7:0/601486481 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3ec0962b0 con 0x5591ce066cf0 2024-04-25T09:57:27.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.125+0000 7fc4067d5740 10 client.6495 fetch_fsmap learned FSMap version 28 2024-04-25T09:57:27.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.125+0000 7fc4067d5740 1 -- 172.21.15.7:0/601486481 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x5591ce0dc010 con 0x5591ce066cf0 2024-04-25T09:57:27.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.125+0000 7fc3e0ff9640 1 -- 172.21.15.7:0/601486481 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ec07cf70 con 0x5591ce066cf0 2024-04-25T09:57:27.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.126+0000 7fc3e0ff9640 1 -- 172.21.15.7:0/601486481 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc3ec075490 con 0x5591ce066cf0 2024-04-25T09:57:27.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.126+0000 7fc4067d5740 10 client.6495 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T09:57:27.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.126+0000 7fc4067d5740 10 client.6495 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:57:27.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.126+0000 7fc4067d5740 20 client.6495 populate_metadata read hostname 'smithi007' 2024-04-25T09:57:27.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.126+0000 7fc4067d5740 1 --2- 172.21.15.7:0/601486481 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5591ce080df0 0x5591ce0db1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.126+0000 7fc4067d5740 4 client.6495 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}] 2024-04-25T09:57:27.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.126+0000 7fc4067d5740 1 -- 172.21.15.7:0/601486481 --> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}) v1 -- 0x5591cdfb0380 con 0x5591ce080df0 2024-04-25T09:57:27.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.126+0000 7fc401066640 1 --2- 172.21.15.7:0/601486481 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5591ce080df0 0x5591ce0db1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.126+0000 7fc3e0ff9640 10 client.6495 ms_handle_connect on v2:172.21.15.7:6834/3057688863 2024-04-25T09:57:27.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.126+0000 7fc401066640 1 --2- 172.21.15.7:0/601486481 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5591ce080df0 0x5591ce0db1e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe680dea4936dc61 server_cookie=4628cf5e29ea59bc in_seq=0 out_seq=0 2024-04-25T09:57:27.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.127+0000 7fc3e0ff9640 1 -- 172.21.15.7:0/601486481 <== mds.0 v2:172.21.15.7:6834/3057688863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5591cdfb0380 con 0x5591ce080df0 2024-04-25T09:57:27.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.127+0000 7fc3e0ff9640 10 client.6495 handle_command_reply: tid=0 2024-04-25T09:57:27.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.127+0000 7fc4067d5740 1 client.6495 shutdown 2024-04-25T09:57:27.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.127+0000 7fc4067d5740 1 -- 172.21.15.7:0/601486481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ce066cf0 msgr2=0x5591ce069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:27.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.127+0000 7fc4067d5740 1 --2- 172.21.15.7:0/601486481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ce066cf0 0x5591ce069bf0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec000f80 tx=0x7fc3f4009000 comp rx=0 tx=0).stop 2024-04-25T09:57:27.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.127+0000 7fc4067d5740 1 -- 172.21.15.7:0/601486481 shutdown_connections 2024-04-25T09:57:27.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.127+0000 7fc4067d5740 1 --2- 172.21.15.7:0/601486481 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5591ce080df0 0x5591ce0db1e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.127+0000 7fc4067d5740 1 --2- 172.21.15.7:0/601486481 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5591ce06d460 0x5591ce06c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.127+0000 7fc4067d5740 1 --2- 172.21.15.7:0/601486481 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5591ce06d080 0x5591ce06c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.127+0000 7fc3e0ff9640 0 client.6495 ms_handle_reset on v2:172.21.15.7:6834/3057688863 2024-04-25T09:57:27.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.127+0000 7fc4067d5740 1 --2- 172.21.15.7:0/601486481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ce066cf0 0x5591ce069bf0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.127+0000 7fc4067d5740 1 -- 172.21.15.7:0/601486481 >> 172.21.15.7:0/601486481 conn(0x5591ce03fce0 msgr2=0x5591ce08e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:27.137 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-04-25T09:57:27.127+0000 7f7c1f006640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5929=0-4194304@1} caps={5929=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5929 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x557d03d9fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T09:57:27.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.127+0000 7fc4067d5740 1 -- 172.21.15.7:0/601486481 shutdown_connections 2024-04-25T09:57:27.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.127+0000 7fc4067d5740 1 -- 172.21.15.7:0/601486481 wait complete. 2024-04-25T09:57:27.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.127+0000 7fc4067d5740 20 client.6495 trim_cache size 0 max 16384 2024-04-25T09:57:27.138 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T09:57:27.138 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-04-25T09:57:27.138 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "fd3730ab-5684-49e7-8151-c1e7f4789dc2", 2024-04-25T09:57:27.138 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-04-25T09:57:27.138 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T09:57:27.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.128+0000 7fc403acb640 1 -- 172.21.15.7:0/2215642074 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc3e806b500 msgr2=0x7fc3e806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:27.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.128+0000 7fc403acb640 1 --2- 172.21.15.7:0/2215642074 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc3e806b500 0x7fc3e806d9c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc0aecb0 tx=0x7fc3f0009040 comp rx=0 tx=0).stop 2024-04-25T09:57:27.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.128+0000 7fc403acb640 1 -- 172.21.15.7:0/2215642074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3fc06ab60 msgr2=0x7fc3fc155360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:27.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.128+0000 7fc403acb640 1 --2- 172.21.15.7:0/2215642074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3fc06ab60 0x7fc3fc155360 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec034040 tx=0x7fc3ec004a40 comp rx=0 tx=0).stop 2024-04-25T09:57:27.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.128+0000 7fc403acb640 1 -- 172.21.15.7:0/2215642074 shutdown_connections 2024-04-25T09:57:27.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.128+0000 7fc403acb640 1 --2- 172.21.15.7:0/2215642074 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc3e806b500 0x7fc3e806d9c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.128+0000 7fc403acb640 1 --2- 172.21.15.7:0/2215642074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3fc1582d0 0x7fc3fc0b5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.128+0000 7fc403acb640 1 --2- 172.21.15.7:0/2215642074 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3fc0cd700 0x7fc3fc153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.128+0000 7fc403acb640 1 --2- 172.21.15.7:0/2215642074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3fc06ab60 0x7fc3fc155360 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.128+0000 7fc403acb640 1 -- 172.21.15.7:0/2215642074 >> 172.21.15.7:0/2215642074 conn(0x7fc3fc072650 msgr2=0x7fc3fc06f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:27.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.128+0000 7fc403acb640 1 -- 172.21.15.7:0/2215642074 shutdown_connections 2024-04-25T09:57:27.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.128+0000 7fc403acb640 1 -- 172.21.15.7:0/2215642074 wait complete. 2024-04-25T09:57:27.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:57:27.142 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-25T09:57:27.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.241+0000 7f87bed9e640 1 Processor -- start 2024-04-25T09:57:27.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.242+0000 7f87bed9e640 1 -- start start 2024-04-25T09:57:27.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.242+0000 7f87bed9e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87b815f1c0 0x7f87b815eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.242+0000 7f87bed9e640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b80ced10 con 0x7f87b80ce830 2024-04-25T09:57:27.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.242+0000 7f87bed9e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b80d1b40 con 0x7f87b80d3760 2024-04-25T09:57:27.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.242+0000 7f87bed9e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87b80ce380 con 0x7f87b815f1c0 2024-04-25T09:57:27.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.243+0000 7f87bd33b640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f87b80ce830 0x7f87b80b2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38228/0 (socket says 172.21.15.7:38228) 2024-04-25T09:57:27.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.243+0000 7f87bd33b640 1 -- 172.21.15.7:0/2444980877 learned_addr learned my addr 172.21.15.7:0/2444980877 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:57:27.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.243+0000 7f87b7fff640 1 --2- 172.21.15.7:0/2444980877 >> v2:172.21.15.55:3300/0 conn(0x7f87b815f1c0 0x7f87b815eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.243+0000 7f87b77fe640 1 -- 172.21.15.7:0/2444980877 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1423994258 0 0) 0x7f87b80ced10 con 0x7f87b80ce830 2024-04-25T09:57:27.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.243+0000 7f87b77fe640 1 -- 172.21.15.7:0/2444980877 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87a8003520 con 0x7f87b80ce830 2024-04-25T09:57:27.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.243+0000 7f87b7fff640 1 -- 172.21.15.7:0/2444980877 >> v1:172.21.15.55:6789/0 conn(0x7f87b80d3760 legacy=0x7f87b80d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:27.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.243+0000 7f87b7fff640 1 -- 172.21.15.7:0/2444980877 >> v1:172.21.15.7:6789/0 conn(0x7f87b80ce830 legacy=0x7f87b80b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:27.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.243+0000 7f87b7fff640 1 -- 172.21.15.7:0/2444980877 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b80d1e20 con 0x7f87b815f1c0 2024-04-25T09:57:27.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.244+0000 7f87b7fff640 1 --2- 172.21.15.7:0/2444980877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b815f1c0 0x7f87b815eac0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f87a40097a0 tx=0x7f87a402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3509788d2d6dfb1b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:27.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.244+0000 7f87b77fe640 1 -- 172.21.15.7:0/2444980877 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a4037070 con 0x7f87b815f1c0 2024-04-25T09:57:27.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.244+0000 7f87b77fe640 1 -- 172.21.15.7:0/2444980877 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a4032440 con 0x7f87b815f1c0 2024-04-25T09:57:27.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.244+0000 7f87b77fe640 1 -- 172.21.15.7:0/2444980877 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a4032810 con 0x7f87b815f1c0 2024-04-25T09:57:27.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.245+0000 7f87bed9e640 1 -- 172.21.15.7:0/2444980877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b815f1c0 msgr2=0x7f87b815eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:27.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.245+0000 7f87bed9e640 1 --2- 172.21.15.7:0/2444980877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b815f1c0 0x7f87b815eac0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f87a40097a0 tx=0x7f87a402a230 comp rx=0 tx=0).stop 2024-04-25T09:57:27.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.245+0000 7f87bed9e640 1 -- 172.21.15.7:0/2444980877 shutdown_connections 2024-04-25T09:57:27.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.245+0000 7f87bed9e640 1 --2- 172.21.15.7:0/2444980877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b815f1c0 0x7f87b815eac0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.245+0000 7f87bed9e640 1 -- 172.21.15.7:0/2444980877 >> 172.21.15.7:0/2444980877 conn(0x7f87b8072680 msgr2=0x7f87b8072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:27.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.245+0000 7f87bed9e640 1 -- 172.21.15.7:0/2444980877 shutdown_connections 2024-04-25T09:57:27.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.245+0000 7f87bed9e640 1 -- 172.21.15.7:0/2444980877 wait complete. 2024-04-25T09:57:27.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.246+0000 7f87bed9e640 1 Processor -- start 2024-04-25T09:57:27.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.246+0000 7f87bed9e640 1 -- start start 2024-04-25T09:57:27.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.247+0000 7f87bed9e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f87b80ce830 0x7f87b81e6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.247+0000 7f87bed9e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87b80d3760 0x7f87b80ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.247+0000 7f87bed9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b815f1c0 0x7f87b814f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.247+0000 7f87bed9e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b80d2190 con 0x7f87b80d3760 2024-04-25T09:57:27.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.247+0000 7f87bed9e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b815f000 con 0x7f87b815f1c0 2024-04-25T09:57:27.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.247+0000 7f87bed9e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b80b2950 con 0x7f87b80ce830 2024-04-25T09:57:27.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.247+0000 7f87b7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87b80d3760 0x7f87b80ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.247+0000 7f87b7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87b80d3760 0x7f87b80ccce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50504/0 (socket says 172.21.15.7:50504) 2024-04-25T09:57:27.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.247+0000 7f87b7fff640 1 -- 172.21.15.7:0/31399134 learned_addr learned my addr 172.21.15.7:0/31399134 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:27.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.247+0000 7f87b7fff640 1 -- 172.21.15.7:0/31399134 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f87b80ce830 msgr2=0x7f87b81e6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:27.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.247+0000 7f87bd33b640 1 --2- 172.21.15.7:0/31399134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b815f1c0 0x7f87b814f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.247+0000 7f87b7fff640 1 --2- 172.21.15.7:0/31399134 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f87b80ce830 0x7f87b81e6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.247+0000 7f87b7fff640 1 -- 172.21.15.7:0/31399134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b815f1c0 msgr2=0x7f87b814f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:27.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.247+0000 7f87b7fff640 1 --2- 172.21.15.7:0/31399134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b815f1c0 0x7f87b814f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.247+0000 7f87b7fff640 1 -- 172.21.15.7:0/31399134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b81e7010 con 0x7f87b80d3760 2024-04-25T09:57:27.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.247+0000 7f87bd33b640 1 --2- 172.21.15.7:0/31399134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b815f1c0 0x7f87b814f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:57:27.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.247+0000 7f87b7fff640 1 --2- 172.21.15.7:0/31399134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87b80d3760 0x7f87b80ccce0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f87a40098c0 tx=0x7f87a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:27.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.247+0000 7f87b57fa640 1 -- 172.21.15.7:0/31399134 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a4037040 con 0x7f87b80d3760 2024-04-25T09:57:27.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.247+0000 7f87b57fa640 1 -- 172.21.15.7:0/31399134 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a4042070 con 0x7f87b80d3760 2024-04-25T09:57:27.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.247+0000 7f87bed9e640 1 -- 172.21.15.7:0/31399134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87b80b4d20 con 0x7f87b80d3760 2024-04-25T09:57:27.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.247+0000 7f87b57fa640 1 -- 172.21.15.7:0/31399134 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a4030940 con 0x7f87b80d3760 2024-04-25T09:57:27.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.248+0000 7f87bed9e640 1 -- 172.21.15.7:0/31399134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87b80b52e0 con 0x7f87b80d3760 2024-04-25T09:57:27.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.249+0000 7f87b57fa640 1 -- 172.21.15.7:0/31399134 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f87a4030ae0 con 0x7f87b80d3760 2024-04-25T09:57:27.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.250+0000 7f87b57fa640 1 --2- 172.21.15.7:0/31399134 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f879c06b4d0 0x7f879c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.250+0000 7f87bcb3a640 1 --2- 172.21.15.7:0/31399134 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f879c06b4d0 0x7f879c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.250+0000 7f87b57fa640 1 -- 172.21.15.7:0/31399134 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f87a40aae00 con 0x7f87b80d3760 2024-04-25T09:57:27.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.250+0000 7f87bcb3a640 1 --2- 172.21.15.7:0/31399134 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f879c06b4d0 0x7f879c06d990 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f87ac000f60 tx=0x7f87ac0079d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:27.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.250+0000 7f87c1b79740 1 Processor -- start 2024-04-25T09:57:27.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.251+0000 7f87c1b79740 1 -- start start 2024-04-25T09:57:27.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.251+0000 7f87c1b79740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a75d85eb10 0x55a75d861320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.251+0000 7f87c1b79740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a75d85eef0 0x55a75d861860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.251+0000 7f87c1b79740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a75d831770 0x55a75d834f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.251+0000 7f87c1b79740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a75d79ada0 con 0x55a75d85eb10 2024-04-25T09:57:27.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.251+0000 7f87c1b79740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a75d743b80 con 0x55a75d831770 2024-04-25T09:57:27.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.251+0000 7f87c1b79740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a75d796e40 con 0x55a75d85eef0 2024-04-25T09:57:27.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.251+0000 7f87bcb3a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a75d85eb10 0x55a75d861320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.251+0000 7f87bcb3a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a75d85eb10 0x55a75d861320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50506/0 (socket says 172.21.15.7:50506) 2024-04-25T09:57:27.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.251+0000 7f87bcb3a640 1 -- 172.21.15.7:0/4185363432 learned_addr learned my addr 172.21.15.7:0/4185363432 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:27.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.252+0000 7f87b7fff640 1 --2- 172.21.15.7:0/4185363432 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a75d85eef0 0x55a75d861860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.252+0000 7f87bd33b640 1 --2- 172.21.15.7:0/4185363432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a75d831770 0x55a75d834f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.252+0000 7f87bcb3a640 1 -- 172.21.15.7:0/4185363432 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a75d85eef0 msgr2=0x55a75d861860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:27.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.252+0000 7f87bcb3a640 1 --2- 172.21.15.7:0/4185363432 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a75d85eef0 0x55a75d861860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.252+0000 7f87bcb3a640 1 -- 172.21.15.7:0/4185363432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a75d831770 msgr2=0x55a75d834f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:27.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.252+0000 7f87bcb3a640 1 --2- 172.21.15.7:0/4185363432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a75d831770 0x55a75d834f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.252+0000 7f87bcb3a640 1 -- 172.21.15.7:0/4185363432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a75d74df10 con 0x55a75d85eb10 2024-04-25T09:57:27.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.252+0000 7f87bd33b640 1 --2- 172.21.15.7:0/4185363432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a75d831770 0x55a75d834f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:57:27.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.252+0000 7f87bcb3a640 1 --2- 172.21.15.7:0/4185363432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a75d85eb10 0x55a75d861320 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f87ac016860 tx=0x7f87ac00f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ec57fb2f5af3b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:27.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.252+0000 7f87a27fc640 1 -- 172.21.15.7:0/4185363432 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ac0162e0 con 0x55a75d85eb10 2024-04-25T09:57:27.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.252+0000 7f87a27fc640 1 -- 172.21.15.7:0/4185363432 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ac005110 con 0x55a75d85eb10 2024-04-25T09:57:27.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.252+0000 7f87a27fc640 1 -- 172.21.15.7:0/4185363432 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ac0138b0 con 0x55a75d85eb10 2024-04-25T09:57:27.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.253+0000 7f87c1b79740 1 -- 172.21.15.7:0/4185363432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a75d85eb10 msgr2=0x55a75d861320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:27.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.253+0000 7f87c1b79740 1 --2- 172.21.15.7:0/4185363432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a75d85eb10 0x55a75d861320 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f87ac016860 tx=0x7f87ac00f000 comp rx=0 tx=0).stop 2024-04-25T09:57:27.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.253+0000 7f87c1b79740 1 -- 172.21.15.7:0/4185363432 shutdown_connections 2024-04-25T09:57:27.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.253+0000 7f87c1b79740 1 --2- 172.21.15.7:0/4185363432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a75d831770 0x55a75d834f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.253+0000 7f87c1b79740 1 --2- 172.21.15.7:0/4185363432 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a75d85eef0 0x55a75d861860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.253+0000 7f87c1b79740 1 --2- 172.21.15.7:0/4185363432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a75d85eb10 0x55a75d861320 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.253+0000 7f87c1b79740 1 -- 172.21.15.7:0/4185363432 >> 172.21.15.7:0/4185363432 conn(0x55a75d8339e0 msgr2=0x55a75d87c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:27.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.253+0000 7f87c1b79740 1 -- 172.21.15.7:0/4185363432 shutdown_connections 2024-04-25T09:57:27.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.253+0000 7f87c1b79740 1 -- 172.21.15.7:0/4185363432 wait complete. 2024-04-25T09:57:27.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.253+0000 7f87c1b79740 1 -- start start 2024-04-25T09:57:27.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.253+0000 7f87c1b79740 1 Processor -- start 2024-04-25T09:57:27.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.254+0000 7f87c1b79740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a75d85eb10 0x55a75d855690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.254+0000 7f87c1b79740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a75d85eef0 0x55a75d865110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.254+0000 7f87c1b79740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a75d88bf60 0x55a75d8608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.254+0000 7f87c1b79740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a75d836b90 con 0x55a75d85eef0 2024-04-25T09:57:27.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.254+0000 7f87c1b79740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a75d7394b0 con 0x55a75d85eb10 2024-04-25T09:57:27.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.254+0000 7f87c1b79740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a75d836e70 con 0x55a75d88bf60 2024-04-25T09:57:27.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.254+0000 7f87c1b79740 10 client.0 _ll_register_callbacks cb 0x55a75d779180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:57:27.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.254+0000 7f87b7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a75d85eef0 0x55a75d865110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.254+0000 7f87b7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a75d85eef0 0x55a75d865110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50522/0 (socket says 172.21.15.7:50522) 2024-04-25T09:57:27.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.254+0000 7f87b7fff640 1 -- 172.21.15.7:0/489650970 learned_addr learned my addr 172.21.15.7:0/489650970 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:27.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.254+0000 7f87bcb3a640 1 --2- 172.21.15.7:0/489650970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a75d85eb10 0x55a75d855690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.254+0000 7f87bd33b640 1 --2- 172.21.15.7:0/489650970 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a75d88bf60 0x55a75d8608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.255+0000 7f87b7fff640 1 -- 172.21.15.7:0/489650970 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a75d88bf60 msgr2=0x55a75d8608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:27.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.255+0000 7f87b7fff640 1 --2- 172.21.15.7:0/489650970 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a75d88bf60 0x55a75d8608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.255+0000 7f87b7fff640 1 -- 172.21.15.7:0/489650970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a75d85eb10 msgr2=0x55a75d855690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:27.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.255+0000 7f87b7fff640 1 --2- 172.21.15.7:0/489650970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a75d85eb10 0x55a75d855690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.255+0000 7f87b7fff640 1 -- 172.21.15.7:0/489650970 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a75d5797d0 con 0x55a75d85eef0 2024-04-25T09:57:27.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.255+0000 7f87b7fff640 1 --2- 172.21.15.7:0/489650970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a75d85eef0 0x55a75d865110 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f87a402a270 tx=0x7f87a4032500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=647edb51f6e80b08 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:27.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.255+0000 7f87977fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:57:27.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.255+0000 7f87977fe640 1 -- 172.21.15.7:0/489650970 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a40792c0 con 0x55a75d85eef0 2024-04-25T09:57:27.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.255+0000 7f87977fe640 1 -- 172.21.15.7:0/489650970 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f87a40775c0 con 0x55a75d85eef0 2024-04-25T09:57:27.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.255+0000 7f87c1b79740 1 -- 172.21.15.7:0/489650970 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f87ac005110 con 0x55a75d85eef0 2024-04-25T09:57:27.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.255+0000 7f87977fe640 1 -- 172.21.15.7:0/489650970 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87a407d410 con 0x55a75d85eef0 2024-04-25T09:57:27.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.255+0000 7f87c1b79740 10 client.6507 fetch_fsmap learned FSMap version 28 2024-04-25T09:57:27.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.255+0000 7f87c1b79740 1 -- 172.21.15.7:0/489650970 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x55a75d4af3f0 con 0x55a75d85eef0 2024-04-25T09:57:27.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.255+0000 7f87977fe640 1 -- 172.21.15.7:0/489650970 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ac005110 con 0x55a75d85eef0 2024-04-25T09:57:27.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.255+0000 7f87977fe640 1 -- 172.21.15.7:0/489650970 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f87a4096080 con 0x55a75d85eef0 2024-04-25T09:57:27.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.255+0000 7f87c1b79740 10 client.6507 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T09:57:27.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.255+0000 7f87c1b79740 10 client.6507 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:57:27.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.255+0000 7f87c1b79740 20 client.6507 populate_metadata read hostname 'smithi007' 2024-04-25T09:57:27.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.255+0000 7f87c1b79740 1 --2- 172.21.15.7:0/489650970 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x55a75d88c340 0x55a75d87ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.255+0000 7f87c1b79740 4 client.6507 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:57:27.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.255+0000 7f87c1b79740 1 -- 172.21.15.7:0/489650970 --> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a75d7a82e0 con 0x55a75d88c340 2024-04-25T09:57:27.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.255+0000 7f87bcb3a640 1 --2- 172.21.15.7:0/489650970 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x55a75d88c340 0x55a75d87ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.256+0000 7f87bcb3a640 1 --2- 172.21.15.7:0/489650970 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x55a75d88c340 0x55a75d87ff70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=265977aade44d9 server_cookie=d68f90f7fcb23c43 in_seq=0 out_seq=0 2024-04-25T09:57:27.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.256+0000 7f87977fe640 10 client.6507 ms_handle_connect on v2:172.21.15.7:6834/3057688863 2024-04-25T09:57:27.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.256+0000 7f87977fe640 1 -- 172.21.15.7:0/489650970 <== mds.0 v2:172.21.15.7:6834/3057688863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a75d7a82e0 con 0x55a75d88c340 2024-04-25T09:57:27.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.256+0000 7f87977fe640 10 client.6507 handle_command_reply: tid=0 2024-04-25T09:57:27.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.256+0000 7f87c1b79740 1 client.6507 shutdown 2024-04-25T09:57:27.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.256+0000 7f87c1b79740 1 -- 172.21.15.7:0/489650970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a75d85eef0 msgr2=0x55a75d865110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:27.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.256+0000 7f87c1b79740 1 --2- 172.21.15.7:0/489650970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a75d85eef0 0x55a75d865110 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f87a402a270 tx=0x7f87a4032500 comp rx=0 tx=0).stop 2024-04-25T09:57:27.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.256+0000 7f87c1b79740 1 -- 172.21.15.7:0/489650970 shutdown_connections 2024-04-25T09:57:27.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.256+0000 7f87c1b79740 1 --2- 172.21.15.7:0/489650970 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x55a75d88c340 0x55a75d87ff70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.256+0000 7f87c1b79740 1 --2- 172.21.15.7:0/489650970 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a75d88bf60 0x55a75d8608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.256+0000 7f87c1b79740 1 --2- 172.21.15.7:0/489650970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a75d85eef0 0x55a75d865110 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.256+0000 7f87977fe640 0 client.6507 ms_handle_reset on v2:172.21.15.7:6834/3057688863 2024-04-25T09:57:27.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.257+0000 7f87c1b79740 1 --2- 172.21.15.7:0/489650970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a75d85eb10 0x55a75d855690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.257+0000 7f87c1b79740 1 -- 172.21.15.7:0/489650970 >> 172.21.15.7:0/489650970 conn(0x55a75d831770 msgr2=0x55a75d832420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:27.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.257+0000 7f87c1b79740 1 -- 172.21.15.7:0/489650970 shutdown_connections 2024-04-25T09:57:27.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.257+0000 7f87c1b79740 1 -- 172.21.15.7:0/489650970 wait complete. 2024-04-25T09:57:27.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.257+0000 7f87c1b79740 20 client.6507 trim_cache size 0 max 16384 2024-04-25T09:57:27.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.272+0000 7f87c1b79740 1 Processor -- start 2024-04-25T09:57:27.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.272+0000 7f87c1b79740 1 -- start start 2024-04-25T09:57:27.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.272+0000 7f87c1b79740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a75d85eb10 0x55a75d85c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.272+0000 7f87c1b79740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a75d85eef0 0x55a75d85c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.272+0000 7f87c1b79740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a75d88bf60 0x55a75d895770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.272+0000 7f87c1b79740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b82002e0 con 0x55a75d88bf60 2024-04-25T09:57:27.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.272+0000 7f87c1b79740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b81ff4c0 con 0x55a75d85eef0 2024-04-25T09:57:27.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.272+0000 7f87c1b79740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b814df20 con 0x55a75d85eb10 2024-04-25T09:57:27.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.272+0000 7f87bd33b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a75d88bf60 0x55a75d895770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.273+0000 7f87bd33b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a75d88bf60 0x55a75d895770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50536/0 (socket says 172.21.15.7:50536) 2024-04-25T09:57:27.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.273+0000 7f87bd33b640 1 -- 172.21.15.7:0/2468559619 learned_addr learned my addr 172.21.15.7:0/2468559619 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:27.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.273+0000 7f87b7fff640 1 --2- 172.21.15.7:0/2468559619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a75d85eef0 0x55a75d85c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.273+0000 7f87bcb3a640 1 --2- 172.21.15.7:0/2468559619 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a75d85eb10 0x55a75d85c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.273+0000 7f87bd33b640 1 -- 172.21.15.7:0/2468559619 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a75d85eb10 msgr2=0x55a75d85c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:27.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.273+0000 7f87bd33b640 1 --2- 172.21.15.7:0/2468559619 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a75d85eb10 0x55a75d85c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.273+0000 7f87bd33b640 1 -- 172.21.15.7:0/2468559619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a75d85eef0 msgr2=0x55a75d85c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:27.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.273+0000 7f87bd33b640 1 --2- 172.21.15.7:0/2468559619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a75d85eef0 0x55a75d85c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.273+0000 7f87bd33b640 1 -- 172.21.15.7:0/2468559619 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a75d8797d0 con 0x55a75d88bf60 2024-04-25T09:57:27.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.273+0000 7f87bd33b640 1 --2- 172.21.15.7:0/2468559619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a75d88bf60 0x55a75d895770 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f87b0001f10 tx=0x7f87b0007410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620acdd35e7424cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:27.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.273+0000 7f87a1ffb640 1 -- 172.21.15.7:0/2468559619 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b0018020 con 0x55a75d88bf60 2024-04-25T09:57:27.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.273+0000 7f87a1ffb640 1 -- 172.21.15.7:0/2468559619 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b000c070 con 0x55a75d88bf60 2024-04-25T09:57:27.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.273+0000 7f87a1ffb640 1 -- 172.21.15.7:0/2468559619 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b0014630 con 0x55a75d88bf60 2024-04-25T09:57:27.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.274+0000 7f87c1b79740 1 -- 172.21.15.7:0/2468559619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a75d88bf60 msgr2=0x55a75d895770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:27.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.274+0000 7f87c1b79740 1 --2- 172.21.15.7:0/2468559619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a75d88bf60 0x55a75d895770 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f87b0001f10 tx=0x7f87b0007410 comp rx=0 tx=0).stop 2024-04-25T09:57:27.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.274+0000 7f87c1b79740 1 -- 172.21.15.7:0/2468559619 shutdown_connections 2024-04-25T09:57:27.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.274+0000 7f87c1b79740 1 --2- 172.21.15.7:0/2468559619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a75d88bf60 0x55a75d895770 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.274+0000 7f87c1b79740 1 --2- 172.21.15.7:0/2468559619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a75d85eef0 0x55a75d85c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.274+0000 7f87c1b79740 1 --2- 172.21.15.7:0/2468559619 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a75d85eb10 0x55a75d85c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.274+0000 7f87c1b79740 1 -- 172.21.15.7:0/2468559619 >> 172.21.15.7:0/2468559619 conn(0x55a75d831770 msgr2=0x55a75d864070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:27.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.274+0000 7f87c1b79740 1 -- 172.21.15.7:0/2468559619 shutdown_connections 2024-04-25T09:57:27.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.274+0000 7f87c1b79740 1 -- 172.21.15.7:0/2468559619 wait complete. 2024-04-25T09:57:27.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.274+0000 7f87c1b79740 1 -- start start 2024-04-25T09:57:27.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.275+0000 7f87c1b79740 1 Processor -- start 2024-04-25T09:57:27.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.275+0000 7f87c1b79740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a75d85eb10 0x55a75d8e68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.275+0000 7f87c1b79740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a75d85eef0 0x55a75d852cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.275+0000 7f87c1b79740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a75d88bf60 0x55a75d8623b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.275+0000 7f87c1b79740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a75d8650f0 con 0x55a75d85eef0 2024-04-25T09:57:27.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.275+0000 7f87c1b79740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b81fef50 con 0x55a75d88bf60 2024-04-25T09:57:27.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.275+0000 7f87c1b79740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a75d862fc0 con 0x55a75d85eb10 2024-04-25T09:57:27.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.275+0000 7f87c1b79740 10 client.0 _ll_register_callbacks cb 0x7f87ac0012a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:57:27.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.275+0000 7f87b7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a75d85eef0 0x55a75d852cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.275+0000 7f87b7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a75d85eef0 0x55a75d852cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50552/0 (socket says 172.21.15.7:50552) 2024-04-25T09:57:27.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.275+0000 7f87b7fff640 1 -- 172.21.15.7:0/2158924369 learned_addr learned my addr 172.21.15.7:0/2158924369 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:27.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.275+0000 7f87bcb3a640 1 --2- 172.21.15.7:0/2158924369 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a75d85eb10 0x55a75d8e68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.276+0000 7f87bd33b640 1 --2- 172.21.15.7:0/2158924369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a75d88bf60 0x55a75d8623b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.276+0000 7f87b7fff640 1 -- 172.21.15.7:0/2158924369 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a75d85eb10 msgr2=0x55a75d8e68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:27.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.276+0000 7f87b7fff640 1 --2- 172.21.15.7:0/2158924369 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a75d85eb10 0x55a75d8e68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.276+0000 7f87b7fff640 1 -- 172.21.15.7:0/2158924369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a75d88bf60 msgr2=0x55a75d8623b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:27.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.276+0000 7f87b7fff640 1 --2- 172.21.15.7:0/2158924369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a75d88bf60 0x55a75d8623b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.276+0000 7f87b7fff640 1 -- 172.21.15.7:0/2158924369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a75d46f0f0 con 0x55a75d85eef0 2024-04-25T09:57:27.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.276+0000 7f87b7fff640 1 --2- 172.21.15.7:0/2158924369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a75d85eef0 0x55a75d852cc0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f87a4075c40 tx=0x7f87a4009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff193e8fa85b0d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:27.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.276+0000 7f87977fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:57:27.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.276+0000 7f87977fe640 1 -- 172.21.15.7:0/2158924369 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a40a0060 con 0x55a75d85eef0 2024-04-25T09:57:27.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.276+0000 7f87977fe640 1 -- 172.21.15.7:0/2158924369 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f87a40775c0 con 0x55a75d85eef0 2024-04-25T09:57:27.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.276+0000 7f87c1b79740 1 -- 172.21.15.7:0/2158924369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f87b000c070 con 0x55a75d85eef0 2024-04-25T09:57:27.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.276+0000 7f87977fe640 1 -- 172.21.15.7:0/2158924369 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87a4086050 con 0x55a75d85eef0 2024-04-25T09:57:27.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.276+0000 7f87c1b79740 10 client.6513 fetch_fsmap learned FSMap version 28 2024-04-25T09:57:27.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.276+0000 7f87c1b79740 1 -- 172.21.15.7:0/2158924369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x55a75d862d00 con 0x55a75d85eef0 2024-04-25T09:57:27.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.276+0000 7f87977fe640 1 -- 172.21.15.7:0/2158924369 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b000c070 con 0x55a75d85eef0 2024-04-25T09:57:27.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.276+0000 7f87977fe640 1 -- 172.21.15.7:0/2158924369 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f87a403a070 con 0x55a75d85eef0 2024-04-25T09:57:27.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.276+0000 7f87c1b79740 10 client.6513 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T09:57:27.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.276+0000 7f87c1b79740 10 client.6513 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:57:27.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.276+0000 7f87c1b79740 20 client.6513 populate_metadata read hostname 'smithi007' 2024-04-25T09:57:27.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.276+0000 7f87c1b79740 1 --2- 172.21.15.7:0/2158924369 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x55a75d8628f0 0x55a75d88ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:27.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.276+0000 7f87c1b79740 4 client.6513 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:57:27.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.276+0000 7f87c1b79740 1 -- 172.21.15.7:0/2158924369 --> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a75d838a10 con 0x55a75d8628f0 2024-04-25T09:57:27.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.277+0000 7f87bcb3a640 1 --2- 172.21.15.7:0/2158924369 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x55a75d8628f0 0x55a75d88ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:27.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.277+0000 7f87977fe640 10 client.6513 ms_handle_connect on v2:172.21.15.7:6834/3057688863 2024-04-25T09:57:27.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.277+0000 7f87bcb3a640 1 --2- 172.21.15.7:0/2158924369 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x55a75d8628f0 0x55a75d88ac70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77fb3b963e1f0052 server_cookie=bc16722c5aec947c in_seq=0 out_seq=0 2024-04-25T09:57:27.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.277+0000 7f87977fe640 1 -- 172.21.15.7:0/2158924369 <== mds.0 v2:172.21.15.7:6834/3057688863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+253 (crc 0 0 0) 0x55a75d838a10 con 0x55a75d8628f0 2024-04-25T09:57:27.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.277+0000 7f87977fe640 10 client.6513 handle_command_reply: tid=0 2024-04-25T09:57:27.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.277+0000 7f87c1b79740 1 client.6513 shutdown 2024-04-25T09:57:27.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.277+0000 7f87c1b79740 1 -- 172.21.15.7:0/2158924369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a75d85eef0 msgr2=0x55a75d852cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:27.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.277+0000 7f87c1b79740 1 --2- 172.21.15.7:0/2158924369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a75d85eef0 0x55a75d852cc0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f87a4075c40 tx=0x7f87a4009190 comp rx=0 tx=0).stop 2024-04-25T09:57:27.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.277+0000 7f87c1b79740 1 -- 172.21.15.7:0/2158924369 shutdown_connections 2024-04-25T09:57:27.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.277+0000 7f87c1b79740 1 --2- 172.21.15.7:0/2158924369 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x55a75d8628f0 0x55a75d88ac70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.277+0000 7f87c1b79740 1 --2- 172.21.15.7:0/2158924369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a75d88bf60 0x55a75d8623b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.277+0000 7f87c1b79740 1 --2- 172.21.15.7:0/2158924369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a75d85eef0 0x55a75d852cc0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.277+0000 7f87977fe640 0 client.6513 ms_handle_reset on v2:172.21.15.7:6834/3057688863 2024-04-25T09:57:27.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.277+0000 7f87c1b79740 1 --2- 172.21.15.7:0/2158924369 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a75d85eb10 0x55a75d8e68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.277+0000 7f87c1b79740 1 -- 172.21.15.7:0/2158924369 >> 172.21.15.7:0/2158924369 conn(0x55a75d831770 msgr2=0x55a75d89e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:27.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.277+0000 7f87c1b79740 1 -- 172.21.15.7:0/2158924369 shutdown_connections 2024-04-25T09:57:27.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.277+0000 7f87c1b79740 1 -- 172.21.15.7:0/2158924369 wait complete. 2024-04-25T09:57:27.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.278+0000 7f87c1b79740 20 client.6513 trim_cache size 0 max 16384 2024-04-25T09:57:27.288 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T09:57:27.288 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:57:27.288 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-04-25T09:57:27.288 INFO:teuthology.orchestra.run.smithi007.stdout: "fd3730ab-5684-49e7-8151-c1e7f4789dc2": { 2024-04-25T09:57:27.288 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-04-25T09:57:27.288 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "fd3730ab-5684-49e7-8151-c1e7f4789dc2", 2024-04-25T09:57:27.288 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive" 2024-04-25T09:57:27.288 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:57:27.288 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:57:27.288 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T09:57:27.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.278+0000 7f87bed9e640 1 -- 172.21.15.7:0/31399134 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f879c06b4d0 msgr2=0x7f879c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:27.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.278+0000 7f87bed9e640 1 --2- 172.21.15.7:0/31399134 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f879c06b4d0 0x7f879c06d990 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f87ac000f60 tx=0x7f87ac0079d0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.278+0000 7f87bed9e640 1 -- 172.21.15.7:0/31399134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87b80d3760 msgr2=0x7f87b80ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:27.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.278+0000 7f87bed9e640 1 --2- 172.21.15.7:0/31399134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87b80d3760 0x7f87b80ccce0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f87a40098c0 tx=0x7f87a40046c0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.278+0000 7f87bed9e640 1 -- 172.21.15.7:0/31399134 shutdown_connections 2024-04-25T09:57:27.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.278+0000 7f87bed9e640 1 --2- 172.21.15.7:0/31399134 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f879c06b4d0 0x7f879c06d990 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.278+0000 7f87bed9e640 1 --2- 172.21.15.7:0/31399134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b815f1c0 0x7f87b814f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.278+0000 7f87bed9e640 1 --2- 172.21.15.7:0/31399134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87b80d3760 0x7f87b80ccce0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.278+0000 7f87bed9e640 1 --2- 172.21.15.7:0/31399134 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f87b80ce830 0x7f87b81e6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:27.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.278+0000 7f87bed9e640 1 -- 172.21.15.7:0/31399134 >> 172.21.15.7:0/31399134 conn(0x7f87b8072680 msgr2=0x7f87b80b7560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:27.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.278+0000 7f87bed9e640 1 -- 172.21.15.7:0/31399134 shutdown_connections 2024-04-25T09:57:27.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:27.278+0000 7f87bed9e640 1 -- 172.21.15.7:0/31399134 wait complete. 2024-04-25T09:57:27.292 INFO:tasks.cephfs.filesystem:scrub status for tag:fd3730ab-5684-49e7-8151-c1e7f4789dc2 - {'path': '/', 'tag': 'fd3730ab-5684-49e7-8151-c1e7f4789dc2', 'options': 'recursive'} 2024-04-25T09:57:31.978 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-04-25T09:57:31.975+0000 7f45afd77640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T09:57:56.553 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:57:56.557 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:57:57.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:57:57.293 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-25T09:57:57.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.405+0000 7fde2ba07640 1 Processor -- start 2024-04-25T09:57:57.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.405+0000 7fde2ba07640 1 -- start start 2024-04-25T09:57:57.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.406+0000 7fde2ba07640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fde240d0780 0x7fde240d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.406+0000 7fde2ba07640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fde240b9590 0x7fde240b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.406+0000 7fde2ba07640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde240d10a0 con 0x7fde240b9130 2024-04-25T09:57:57.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.406+0000 7fde2ba07640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde240b7ef0 con 0x7fde240d0780 2024-04-25T09:57:57.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.406+0000 7fde2ba07640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde240b81d0 con 0x7fde240b9590 2024-04-25T09:57:57.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.406+0000 7fde28fa2640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fde240b9130 0x7fde240d1c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52156/0 (socket says 172.21.15.7:52156) 2024-04-25T09:57:57.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.406+0000 7fde28fa2640 1 -- 172.21.15.7:0/2098260830 learned_addr learned my addr 172.21.15.7:0/2098260830 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:57:57.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.407+0000 7fde297a3640 1 --2- 172.21.15.7:0/2098260830 >> v2:172.21.15.55:3300/0 conn(0x7fde240d0780 0x7fde240d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.407+0000 7fde29fa4640 1 --2- 172.21.15.7:0/2098260830 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fde240b9590 0x7fde240b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.407+0000 7fde23fff640 1 -- 172.21.15.7:0/2098260830 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 42370944 0 0) 0x7fde240d10a0 con 0x7fde240b9130 2024-04-25T09:57:57.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.407+0000 7fde23fff640 1 -- 172.21.15.7:0/2098260830 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde0c003520 con 0x7fde240b9130 2024-04-25T09:57:57.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.407+0000 7fde23fff640 1 -- 172.21.15.7:0/2098260830 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2959890312 0 0) 0x7fde0c003520 con 0x7fde240b9130 2024-04-25T09:57:57.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.407+0000 7fde29fa4640 1 -- 172.21.15.7:0/2098260830 >> v2:172.21.15.55:3300/0 conn(0x7fde240d0780 msgr2=0x7fde240d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:57.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.407+0000 7fde29fa4640 1 --2- 172.21.15.7:0/2098260830 >> v2:172.21.15.55:3300/0 conn(0x7fde240d0780 0x7fde240d0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.407+0000 7fde29fa4640 1 -- 172.21.15.7:0/2098260830 >> v1:172.21.15.7:6789/0 conn(0x7fde240b9130 legacy=0x7fde240d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:57.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.407+0000 7fde29fa4640 1 -- 172.21.15.7:0/2098260830 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde240b84b0 con 0x7fde240b9590 2024-04-25T09:57:57.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.408+0000 7fde29fa4640 1 --2- 172.21.15.7:0/2098260830 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fde240b9590 0x7fde240b78c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fde14009d90 tx=0x7fde1402a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc9963d602702c81 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:57.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.408+0000 7fde23fff640 1 -- 172.21.15.7:0/2098260830 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde18001670 con 0x7fde240b9590 2024-04-25T09:57:57.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.408+0000 7fde23fff640 1 -- 172.21.15.7:0/2098260830 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde14007540 con 0x7fde240b9590 2024-04-25T09:57:57.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.408+0000 7fde23fff640 1 -- 172.21.15.7:0/2098260830 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde140078f0 con 0x7fde240b9590 2024-04-25T09:57:57.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.409+0000 7fde2ba07640 1 -- 172.21.15.7:0/2098260830 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fde240b9590 msgr2=0x7fde240b78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:57.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.409+0000 7fde2ba07640 1 --2- 172.21.15.7:0/2098260830 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fde240b9590 0x7fde240b78c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fde14009d90 tx=0x7fde1402a5f0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.409+0000 7fde2ba07640 1 -- 172.21.15.7:0/2098260830 shutdown_connections 2024-04-25T09:57:57.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.409+0000 7fde2ba07640 1 --2- 172.21.15.7:0/2098260830 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fde240b9590 0x7fde240b78c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.409+0000 7fde2ba07640 1 --2- 172.21.15.7:0/2098260830 >> v2:172.21.15.55:3300/0 conn(0x7fde240d0780 0x7fde240d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.409+0000 7fde2ba07640 1 -- 172.21.15.7:0/2098260830 >> 172.21.15.7:0/2098260830 conn(0x7fde240726b0 msgr2=0x7fde24072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:57.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.409+0000 7fde2ba07640 1 -- 172.21.15.7:0/2098260830 shutdown_connections 2024-04-25T09:57:57.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.409+0000 7fde2ba07640 1 -- 172.21.15.7:0/2098260830 wait complete. 2024-04-25T09:57:57.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.410+0000 7fde2ba07640 1 Processor -- start 2024-04-25T09:57:57.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.410+0000 7fde2ba07640 1 -- start start 2024-04-25T09:57:57.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.411+0000 7fde2ba07640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde240b9130 0x7fde24149af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.411+0000 7fde2ba07640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde240b9590 0x7fde241e61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.411+0000 7fde2ba07640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fde240d0780 0x7fde241e6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.411+0000 7fde2ba07640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde241611b0 con 0x7fde240b9130 2024-04-25T09:57:57.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.411+0000 7fde2ba07640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde240b8a70 con 0x7fde240b9590 2024-04-25T09:57:57.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.411+0000 7fde2ba07640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde24161330 con 0x7fde240d0780 2024-04-25T09:57:57.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.411+0000 7fde297a3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde240b9130 0x7fde24149af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.411+0000 7fde297a3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde240b9130 0x7fde24149af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52954/0 (socket says 172.21.15.7:52954) 2024-04-25T09:57:57.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.411+0000 7fde297a3640 1 -- 172.21.15.7:0/2078197043 learned_addr learned my addr 172.21.15.7:0/2078197043 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:57.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.411+0000 7fde29fa4640 1 --2- 172.21.15.7:0/2078197043 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fde240d0780 0x7fde241e6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.411+0000 7fde28fa2640 1 --2- 172.21.15.7:0/2078197043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde240b9590 0x7fde241e61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.411+0000 7fde297a3640 1 -- 172.21.15.7:0/2078197043 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fde240d0780 msgr2=0x7fde241e6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:57.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.411+0000 7fde297a3640 1 --2- 172.21.15.7:0/2078197043 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fde240d0780 0x7fde241e6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.411+0000 7fde297a3640 1 -- 172.21.15.7:0/2078197043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde240b9590 msgr2=0x7fde241e61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:57.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.411+0000 7fde297a3640 1 --2- 172.21.15.7:0/2078197043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde240b9590 0x7fde241e61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.411+0000 7fde297a3640 1 -- 172.21.15.7:0/2078197043 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde240cca60 con 0x7fde240b9130 2024-04-25T09:57:57.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.412+0000 7fde297a3640 1 --2- 172.21.15.7:0/2078197043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde240b9130 0x7fde24149af0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fde1c00e870 tx=0x7fde1c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:57.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.412+0000 7fde21ffb640 1 -- 172.21.15.7:0/2078197043 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c017070 con 0x7fde240b9130 2024-04-25T09:57:57.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.412+0000 7fde21ffb640 1 -- 172.21.15.7:0/2078197043 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1c00c940 con 0x7fde240b9130 2024-04-25T09:57:57.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.412+0000 7fde21ffb640 1 -- 172.21.15.7:0/2078197043 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c00cd30 con 0x7fde240b9130 2024-04-25T09:57:57.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.412+0000 7fde2ba07640 1 -- 172.21.15.7:0/2078197043 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde240ccd40 con 0x7fde240b9130 2024-04-25T09:57:57.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.412+0000 7fde2ba07640 1 -- 172.21.15.7:0/2078197043 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde240cd300 con 0x7fde240b9130 2024-04-25T09:57:57.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.414+0000 7fde21ffb640 1 -- 172.21.15.7:0/2078197043 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fde1c01a070 con 0x7fde240b9130 2024-04-25T09:57:57.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.414+0000 7fde21ffb640 1 --2- 172.21.15.7:0/2078197043 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fde1006b4d0 0x7fde1006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.414+0000 7fde21ffb640 1 -- 172.21.15.7:0/2078197043 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fde1c08a560 con 0x7fde240b9130 2024-04-25T09:57:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.414+0000 7fde28fa2640 1 --2- 172.21.15.7:0/2078197043 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fde1006b4d0 0x7fde1006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.415+0000 7fde28fa2640 1 --2- 172.21.15.7:0/2078197043 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fde1006b4d0 0x7fde1006d990 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fde240d3fe0 tx=0x7fde180057f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.415+0000 7fde2e7e6740 1 Processor -- start 2024-04-25T09:57:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.415+0000 7fde2e7e6740 1 -- start start 2024-04-25T09:57:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.416+0000 7fde2e7e6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b0f722b10 0x559b0f725320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.416+0000 7fde2e7e6740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559b0f722ef0 0x559b0f725860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.416+0000 7fde2e7e6740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559b0f6f5770 0x559b0f6f8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.416+0000 7fde2e7e6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b0f65eda0 con 0x559b0f722b10 2024-04-25T09:57:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.416+0000 7fde2e7e6740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b0f607b80 con 0x559b0f6f5770 2024-04-25T09:57:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.416+0000 7fde2e7e6740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x559b0f65ae40 con 0x559b0f722ef0 2024-04-25T09:57:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.416+0000 7fde297a3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b0f722b10 0x559b0f725320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.416+0000 7fde297a3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b0f722b10 0x559b0f725320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52964/0 (socket says 172.21.15.7:52964) 2024-04-25T09:57:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.416+0000 7fde297a3640 1 -- 172.21.15.7:0/3340281019 learned_addr learned my addr 172.21.15.7:0/3340281019 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.416+0000 7fde297a3640 1 -- 172.21.15.7:0/3340281019 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559b0f722ef0 msgr2=0x559b0f725860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.416+0000 7fde29fa4640 1 --2- 172.21.15.7:0/3340281019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559b0f6f5770 0x559b0f6f8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.416+0000 7fde28fa2640 1 --2- 172.21.15.7:0/3340281019 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559b0f722ef0 0x559b0f725860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.416+0000 7fde297a3640 1 --2- 172.21.15.7:0/3340281019 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559b0f722ef0 0x559b0f725860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.416+0000 7fde297a3640 1 -- 172.21.15.7:0/3340281019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559b0f6f5770 msgr2=0x559b0f6f8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.416+0000 7fde297a3640 1 --2- 172.21.15.7:0/3340281019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559b0f6f5770 0x559b0f6f8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.416+0000 7fde297a3640 1 -- 172.21.15.7:0/3340281019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b0f611f10 con 0x559b0f722b10 2024-04-25T09:57:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.416+0000 7fde28fa2640 1 --2- 172.21.15.7:0/3340281019 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559b0f722ef0 0x559b0f725860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:57:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.416+0000 7fde29fa4640 1 --2- 172.21.15.7:0/3340281019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559b0f6f5770 0x559b0f6f8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:57:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.416+0000 7fde297a3640 1 --2- 172.21.15.7:0/3340281019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b0f722b10 0x559b0f725320 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fde1c055060 tx=0x7fde1c058560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23701a7a1bf4bcea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.417+0000 7fde0affd640 1 -- 172.21.15.7:0/3340281019 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c021050 con 0x559b0f722b10 2024-04-25T09:57:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.417+0000 7fde0affd640 1 -- 172.21.15.7:0/3340281019 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1c061260 con 0x559b0f722b10 2024-04-25T09:57:57.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.417+0000 7fde0affd640 1 -- 172.21.15.7:0/3340281019 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c055270 con 0x559b0f722b10 2024-04-25T09:57:57.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.417+0000 7fde2e7e6740 1 -- 172.21.15.7:0/3340281019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b0f722b10 msgr2=0x559b0f725320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:57.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.417+0000 7fde2e7e6740 1 --2- 172.21.15.7:0/3340281019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b0f722b10 0x559b0f725320 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fde1c055060 tx=0x7fde1c058560 comp rx=0 tx=0).stop 2024-04-25T09:57:57.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.417+0000 7fde2e7e6740 1 -- 172.21.15.7:0/3340281019 shutdown_connections 2024-04-25T09:57:57.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.417+0000 7fde2e7e6740 1 --2- 172.21.15.7:0/3340281019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559b0f6f5770 0x559b0f6f8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.417+0000 7fde2e7e6740 1 --2- 172.21.15.7:0/3340281019 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559b0f722ef0 0x559b0f725860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.417+0000 7fde2e7e6740 1 --2- 172.21.15.7:0/3340281019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b0f722b10 0x559b0f725320 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.417+0000 7fde2e7e6740 1 -- 172.21.15.7:0/3340281019 >> 172.21.15.7:0/3340281019 conn(0x559b0f6f79e0 msgr2=0x559b0f740320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:57.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.417+0000 7fde2e7e6740 1 -- 172.21.15.7:0/3340281019 shutdown_connections 2024-04-25T09:57:57.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.417+0000 7fde2e7e6740 1 -- 172.21.15.7:0/3340281019 wait complete. 2024-04-25T09:57:57.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.418+0000 7fde2e7e6740 1 -- start start 2024-04-25T09:57:57.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.418+0000 7fde2e7e6740 1 Processor -- start 2024-04-25T09:57:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.419+0000 7fde2e7e6740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559b0f722b10 0x559b0f719940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.419+0000 7fde2e7e6740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559b0f722ef0 0x559b0f743f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.419+0000 7fde2e7e6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b0f726260 0x559b0f7500d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.419+0000 7fde2e7e6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b0f65eda0 con 0x559b0f726260 2024-04-25T09:57:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.419+0000 7fde2e7e6740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b0f5fd4b0 con 0x559b0f722ef0 2024-04-25T09:57:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.419+0000 7fde2e7e6740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x559b0f6fab90 con 0x559b0f722b10 2024-04-25T09:57:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.419+0000 7fde2e7e6740 10 client.0 _ll_register_callbacks cb 0x559b0f63d180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:57:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.419+0000 7fde29fa4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b0f726260 0x559b0f7500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.419+0000 7fde29fa4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b0f726260 0x559b0f7500d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52968/0 (socket says 172.21.15.7:52968) 2024-04-25T09:57:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.419+0000 7fde29fa4640 1 -- 172.21.15.7:0/2254464782 learned_addr learned my addr 172.21.15.7:0/2254464782 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.419+0000 7fde28fa2640 1 --2- 172.21.15.7:0/2254464782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559b0f722ef0 0x559b0f743f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.419+0000 7fde297a3640 1 --2- 172.21.15.7:0/2254464782 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559b0f722b10 0x559b0f719940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.419+0000 7fde29fa4640 1 -- 172.21.15.7:0/2254464782 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559b0f722b10 msgr2=0x559b0f719940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.419+0000 7fde29fa4640 1 --2- 172.21.15.7:0/2254464782 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559b0f722b10 0x559b0f719940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.419+0000 7fde29fa4640 1 -- 172.21.15.7:0/2254464782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559b0f722ef0 msgr2=0x559b0f743f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.419+0000 7fde29fa4640 1 --2- 172.21.15.7:0/2254464782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559b0f722ef0 0x559b0f743f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.419+0000 7fde29fa4640 1 -- 172.21.15.7:0/2254464782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559b0f43d7d0 con 0x559b0f726260 2024-04-25T09:57:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.420+0000 7fde29fa4640 1 --2- 172.21.15.7:0/2254464782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b0f726260 0x559b0f7500d0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fde1402a630 tx=0x7fde14004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13d218af3d5d4737 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.420+0000 7fddfffff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:57:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.420+0000 7fddfffff640 1 -- 172.21.15.7:0/2254464782 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde14004800 con 0x559b0f726260 2024-04-25T09:57:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.420+0000 7fddfffff640 1 -- 172.21.15.7:0/2254464782 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fde14007540 con 0x559b0f726260 2024-04-25T09:57:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.420+0000 7fde2e7e6740 1 -- 172.21.15.7:0/2254464782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fde1c061260 con 0x559b0f726260 2024-04-25T09:57:57.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.420+0000 7fddfffff640 1 -- 172.21.15.7:0/2254464782 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde1404e050 con 0x559b0f726260 2024-04-25T09:57:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.420+0000 7fde2e7e6740 10 client.6525 fetch_fsmap learned FSMap version 29 2024-04-25T09:57:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.420+0000 7fde2e7e6740 1 -- 172.21.15.7:0/2254464782 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x559b0f3733f0 con 0x559b0f726260 2024-04-25T09:57:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.420+0000 7fddfffff640 1 -- 172.21.15.7:0/2254464782 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1c061260 con 0x559b0f726260 2024-04-25T09:57:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.420+0000 7fddfffff640 1 -- 172.21.15.7:0/2254464782 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 29) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fde14051020 con 0x559b0f726260 2024-04-25T09:57:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.420+0000 7fde2e7e6740 10 client.6525 fetch_fsmap finished waiting for FSMap version 29 2024-04-25T09:57:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.420+0000 7fde2e7e6740 10 client.6525 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:57:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.420+0000 7fde2e7e6740 20 client.6525 populate_metadata read hostname 'smithi007' 2024-04-25T09:57:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.420+0000 7fde2e7e6740 1 --2- 172.21.15.7:0/2254464782 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x559b0f724d50 0x559b0f725160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.420+0000 7fde2e7e6740 4 client.6525 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:57:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.420+0000 7fde2e7e6740 1 -- 172.21.15.7:0/2254464782 --> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559b0f66c2e0 con 0x559b0f724d50 2024-04-25T09:57:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.420+0000 7fde297a3640 1 --2- 172.21.15.7:0/2254464782 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x559b0f724d50 0x559b0f725160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.421+0000 7fddfffff640 10 client.6525 ms_handle_connect on v2:172.21.15.7:6834/3057688863 2024-04-25T09:57:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.421+0000 7fde297a3640 1 --2- 172.21.15.7:0/2254464782 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x559b0f724d50 0x559b0f725160 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0c5d9b077995319 server_cookie=cd12f8067c6a6839 in_seq=0 out_seq=0 2024-04-25T09:57:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.421+0000 7fddfffff640 1 -- 172.21.15.7:0/2254464782 <== mds.0 v2:172.21.15.7:6834/3057688863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559b0f66c2e0 con 0x559b0f724d50 2024-04-25T09:57:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.421+0000 7fddfffff640 10 client.6525 handle_command_reply: tid=0 2024-04-25T09:57:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.421+0000 7fde2e7e6740 1 client.6525 shutdown 2024-04-25T09:57:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.421+0000 7fde2e7e6740 1 -- 172.21.15.7:0/2254464782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b0f726260 msgr2=0x559b0f7500d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.421+0000 7fde2e7e6740 1 --2- 172.21.15.7:0/2254464782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b0f726260 0x559b0f7500d0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fde1402a630 tx=0x7fde14004ab0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.421+0000 7fde2e7e6740 1 -- 172.21.15.7:0/2254464782 shutdown_connections 2024-04-25T09:57:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.421+0000 7fde2e7e6740 1 --2- 172.21.15.7:0/2254464782 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x559b0f724d50 0x559b0f725160 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.421+0000 7fde2e7e6740 1 --2- 172.21.15.7:0/2254464782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b0f726260 0x559b0f7500d0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.421+0000 7fde2e7e6740 1 --2- 172.21.15.7:0/2254464782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559b0f722ef0 0x559b0f743f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.421+0000 7fde2e7e6740 1 --2- 172.21.15.7:0/2254464782 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559b0f722b10 0x559b0f719940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.421+0000 7fddfffff640 0 client.6525 ms_handle_reset on v2:172.21.15.7:6834/3057688863 2024-04-25T09:57:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.421+0000 7fde2e7e6740 1 -- 172.21.15.7:0/2254464782 >> 172.21.15.7:0/2254464782 conn(0x559b0f6f5770 msgr2=0x559b0f6fa050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.422+0000 7fde2e7e6740 1 -- 172.21.15.7:0/2254464782 shutdown_connections 2024-04-25T09:57:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.422+0000 7fde2e7e6740 1 -- 172.21.15.7:0/2254464782 wait complete. 2024-04-25T09:57:57.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.422+0000 7fde2e7e6740 20 client.6525 trim_cache size 0 max 16384 2024-04-25T09:57:57.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.437+0000 7fde2e7e6740 1 Processor -- start 2024-04-25T09:57:57.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.437+0000 7fde2e7e6740 1 -- start start 2024-04-25T09:57:57.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.438+0000 7fde2e7e6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b0f722b10 0x559b0f73d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.438+0000 7fde2e7e6740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559b0f722ef0 0x559b0f7a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.438+0000 7fde2e7e6740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559b0f726260 0x559b0f6f9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.438+0000 7fde2e7e6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde242001d0 con 0x559b0f722b10 2024-04-25T09:57:57.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.438+0000 7fde2e7e6740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde241ff350 con 0x559b0f726260 2024-04-25T09:57:57.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.438+0000 7fde2e7e6740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde2414b5b0 con 0x559b0f722ef0 2024-04-25T09:57:57.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.438+0000 7fde297a3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b0f722b10 0x559b0f73d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.438+0000 7fde297a3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b0f722b10 0x559b0f73d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52984/0 (socket says 172.21.15.7:52984) 2024-04-25T09:57:57.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.438+0000 7fde297a3640 1 -- 172.21.15.7:0/1532550385 learned_addr learned my addr 172.21.15.7:0/1532550385 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:57.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.438+0000 7fde29fa4640 1 --2- 172.21.15.7:0/1532550385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559b0f726260 0x559b0f6f9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.438+0000 7fde297a3640 1 -- 172.21.15.7:0/1532550385 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559b0f722ef0 msgr2=0x559b0f7a0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:57.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.438+0000 7fde297a3640 1 --2- 172.21.15.7:0/1532550385 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559b0f722ef0 0x559b0f7a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.438+0000 7fde297a3640 1 -- 172.21.15.7:0/1532550385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559b0f726260 msgr2=0x559b0f6f9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:57.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.438+0000 7fde297a3640 1 --2- 172.21.15.7:0/1532550385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559b0f726260 0x559b0f6f9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.438+0000 7fde297a3640 1 -- 172.21.15.7:0/1532550385 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b0f3330f0 con 0x559b0f722b10 2024-04-25T09:57:57.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.438+0000 7fde297a3640 1 --2- 172.21.15.7:0/1532550385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b0f722b10 0x559b0f73d3e0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fde1c055060 tx=0x7fde1c05a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8bc3dda5a13cd68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:57.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.439+0000 7fde0a7fc640 1 -- 172.21.15.7:0/1532550385 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c021040 con 0x559b0f722b10 2024-04-25T09:57:57.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.439+0000 7fde0a7fc640 1 -- 172.21.15.7:0/1532550385 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1c055270 con 0x559b0f722b10 2024-04-25T09:57:57.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.439+0000 7fde0a7fc640 1 -- 172.21.15.7:0/1532550385 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c05de00 con 0x559b0f722b10 2024-04-25T09:57:57.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.439+0000 7fde2e7e6740 1 -- 172.21.15.7:0/1532550385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b0f722b10 msgr2=0x559b0f73d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:57.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.439+0000 7fde2e7e6740 1 --2- 172.21.15.7:0/1532550385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b0f722b10 0x559b0f73d3e0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fde1c055060 tx=0x7fde1c05a000 comp rx=0 tx=0).stop 2024-04-25T09:57:57.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.439+0000 7fde2e7e6740 1 -- 172.21.15.7:0/1532550385 shutdown_connections 2024-04-25T09:57:57.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.439+0000 7fde2e7e6740 1 --2- 172.21.15.7:0/1532550385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559b0f726260 0x559b0f6f9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.439+0000 7fde2e7e6740 1 --2- 172.21.15.7:0/1532550385 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559b0f722ef0 0x559b0f7a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.439+0000 7fde2e7e6740 1 --2- 172.21.15.7:0/1532550385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b0f722b10 0x559b0f73d3e0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.439+0000 7fde2e7e6740 1 -- 172.21.15.7:0/1532550385 >> 172.21.15.7:0/1532550385 conn(0x559b0f6f5770 msgr2=0x559b0f719750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:57.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.439+0000 7fde2e7e6740 1 -- 172.21.15.7:0/1532550385 shutdown_connections 2024-04-25T09:57:57.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.439+0000 7fde2e7e6740 1 -- 172.21.15.7:0/1532550385 wait complete. 2024-04-25T09:57:57.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.440+0000 7fde2e7e6740 1 -- start start 2024-04-25T09:57:57.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.440+0000 7fde2e7e6740 1 Processor -- start 2024-04-25T09:57:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.441+0000 7fde2e7e6740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559b0f722b10 0x559b0f7368c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.441+0000 7fde2e7e6740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559b0f722ef0 0x559b0f74ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.441+0000 7fde2e7e6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b0f726260 0x559b0f758f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.441+0000 7fde2e7e6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b0f724630 con 0x559b0f726260 2024-04-25T09:57:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.441+0000 7fde2e7e6740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde241fee70 con 0x559b0f722b10 2024-04-25T09:57:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.441+0000 7fde2e7e6740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x559b0f7502f0 con 0x559b0f722ef0 2024-04-25T09:57:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.441+0000 7fde2e7e6740 10 client.0 _ll_register_callbacks cb 0x7fde0c0036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:57:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.441+0000 7fde29fa4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b0f726260 0x559b0f758f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.441+0000 7fde29fa4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b0f726260 0x559b0f758f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52996/0 (socket says 172.21.15.7:52996) 2024-04-25T09:57:57.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.441+0000 7fde29fa4640 1 -- 172.21.15.7:0/1901451306 learned_addr learned my addr 172.21.15.7:0/1901451306 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:57.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.441+0000 7fde28fa2640 1 --2- 172.21.15.7:0/1901451306 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559b0f722ef0 0x559b0f74ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.441+0000 7fde297a3640 1 --2- 172.21.15.7:0/1901451306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559b0f722b10 0x559b0f7368c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.441+0000 7fde29fa4640 1 -- 172.21.15.7:0/1901451306 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559b0f722ef0 msgr2=0x559b0f74ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:57.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.441+0000 7fde29fa4640 1 --2- 172.21.15.7:0/1901451306 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559b0f722ef0 0x559b0f74ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.441+0000 7fde29fa4640 1 -- 172.21.15.7:0/1901451306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559b0f722b10 msgr2=0x559b0f7368c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:57.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.441+0000 7fde29fa4640 1 --2- 172.21.15.7:0/1901451306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559b0f722b10 0x559b0f7368c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.441+0000 7fde29fa4640 1 -- 172.21.15.7:0/1901451306 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559b0f73d9a0 con 0x559b0f726260 2024-04-25T09:57:57.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.441+0000 7fde28fa2640 1 --2- 172.21.15.7:0/1901451306 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559b0f722ef0 0x559b0f74ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:57:57.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.441+0000 7fde297a3640 1 --2- 172.21.15.7:0/1901451306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559b0f722b10 0x559b0f7368c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:57:57.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.441+0000 7fde29fa4640 1 --2- 172.21.15.7:0/1901451306 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b0f726260 0x559b0f758f40 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fde14004a10 tx=0x7fde14009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da02e9ec8299979 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:57.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.441+0000 7fddfffff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:57:57.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.441+0000 7fddfffff640 1 -- 172.21.15.7:0/1901451306 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde14004250 con 0x559b0f726260 2024-04-25T09:57:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.442+0000 7fddfffff640 1 -- 172.21.15.7:0/1901451306 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fde14007b80 con 0x559b0f726260 2024-04-25T09:57:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.442+0000 7fde2e7e6740 1 -- 172.21.15.7:0/1901451306 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fde1c055270 con 0x559b0f726260 2024-04-25T09:57:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.442+0000 7fddfffff640 1 -- 172.21.15.7:0/1901451306 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde1405f050 con 0x559b0f726260 2024-04-25T09:57:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.442+0000 7fde2e7e6740 10 client.6531 fetch_fsmap learned FSMap version 29 2024-04-25T09:57:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.442+0000 7fde2e7e6740 1 -- 172.21.15.7:0/1901451306 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x559b0f6fa440 con 0x559b0f726260 2024-04-25T09:57:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.442+0000 7fddfffff640 1 -- 172.21.15.7:0/1901451306 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1c055270 con 0x559b0f726260 2024-04-25T09:57:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.442+0000 7fddfffff640 1 -- 172.21.15.7:0/1901451306 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 29) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fde14062020 con 0x559b0f726260 2024-04-25T09:57:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.442+0000 7fde2e7e6740 10 client.6531 fetch_fsmap finished waiting for FSMap version 29 2024-04-25T09:57:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.442+0000 7fde2e7e6740 10 client.6531 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:57:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.442+0000 7fde2e7e6740 20 client.6531 populate_metadata read hostname 'smithi007' 2024-04-25T09:57:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.442+0000 7fde2e7e6740 1 --2- 172.21.15.7:0/1901451306 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x559b0f79dbd0 0x559b0f759480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.442+0000 7fde2e7e6740 4 client.6531 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:57:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.442+0000 7fde2e7e6740 1 -- 172.21.15.7:0/1901451306 --> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559b0f666630 con 0x559b0f79dbd0 2024-04-25T09:57:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.442+0000 7fde297a3640 1 --2- 172.21.15.7:0/1901451306 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x559b0f79dbd0 0x559b0f759480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.442+0000 7fddfffff640 10 client.6531 ms_handle_connect on v2:172.21.15.7:6834/3057688863 2024-04-25T09:57:57.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.442+0000 7fde297a3640 1 --2- 172.21.15.7:0/1901451306 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x559b0f79dbd0 0x559b0f759480 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9338809c7827a54b server_cookie=ee8fbd48836d9df in_seq=0 out_seq=0 2024-04-25T09:57:57.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.443+0000 7fddfffff640 1 -- 172.21.15.7:0/1901451306 <== mds.0 v2:172.21.15.7:6834/3057688863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x559b0f666630 con 0x559b0f79dbd0 2024-04-25T09:57:57.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.443+0000 7fddfffff640 10 client.6531 handle_command_reply: tid=0 2024-04-25T09:57:57.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.443+0000 7fde2e7e6740 1 client.6531 shutdown 2024-04-25T09:57:57.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.443+0000 7fde2e7e6740 1 -- 172.21.15.7:0/1901451306 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b0f726260 msgr2=0x559b0f758f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:57.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.443+0000 7fde2e7e6740 1 --2- 172.21.15.7:0/1901451306 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b0f726260 0x559b0f758f40 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fde14004a10 tx=0x7fde14009750 comp rx=0 tx=0).stop 2024-04-25T09:57:57.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.443+0000 7fde2e7e6740 1 -- 172.21.15.7:0/1901451306 shutdown_connections 2024-04-25T09:57:57.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.443+0000 7fde2e7e6740 1 --2- 172.21.15.7:0/1901451306 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x559b0f79dbd0 0x559b0f759480 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.443+0000 7fde2e7e6740 1 --2- 172.21.15.7:0/1901451306 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b0f726260 0x559b0f758f40 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.443+0000 7fde2e7e6740 1 --2- 172.21.15.7:0/1901451306 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559b0f722ef0 0x559b0f74ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.443+0000 7fddfffff640 0 client.6531 ms_handle_reset on v2:172.21.15.7:6834/3057688863 2024-04-25T09:57:57.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.443+0000 7fde2e7e6740 1 --2- 172.21.15.7:0/1901451306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559b0f722b10 0x559b0f7368c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.443+0000 7fde2e7e6740 1 -- 172.21.15.7:0/1901451306 >> 172.21.15.7:0/1901451306 conn(0x559b0f6f5770 msgr2=0x559b0f762b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:57.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.443+0000 7fde2e7e6740 1 -- 172.21.15.7:0/1901451306 shutdown_connections 2024-04-25T09:57:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.443+0000 7fde2e7e6740 1 -- 172.21.15.7:0/1901451306 wait complete. 2024-04-25T09:57:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.443+0000 7fde2e7e6740 20 client.6531 trim_cache size 0 max 16384 2024-04-25T09:57:57.453 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T09:57:57.453 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-04-25T09:57:57.453 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-04-25T09:57:57.453 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T09:57:57.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.444+0000 7fde2ba07640 1 -- 172.21.15.7:0/2078197043 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fde1006b4d0 msgr2=0x7fde1006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:57.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.444+0000 7fde2ba07640 1 --2- 172.21.15.7:0/2078197043 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fde1006b4d0 0x7fde1006d990 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fde240d3fe0 tx=0x7fde180057f0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.444+0000 7fde2ba07640 1 -- 172.21.15.7:0/2078197043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde240b9130 msgr2=0x7fde24149af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:57.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.444+0000 7fde2ba07640 1 --2- 172.21.15.7:0/2078197043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde240b9130 0x7fde24149af0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fde1c00e870 tx=0x7fde1c00ed30 comp rx=0 tx=0).stop 2024-04-25T09:57:57.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.444+0000 7fde2ba07640 1 -- 172.21.15.7:0/2078197043 shutdown_connections 2024-04-25T09:57:57.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.444+0000 7fde2ba07640 1 --2- 172.21.15.7:0/2078197043 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fde1006b4d0 0x7fde1006d990 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.444+0000 7fde2ba07640 1 --2- 172.21.15.7:0/2078197043 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fde240d0780 0x7fde241e6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.444+0000 7fde2ba07640 1 --2- 172.21.15.7:0/2078197043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde240b9590 0x7fde241e61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.444+0000 7fde2ba07640 1 --2- 172.21.15.7:0/2078197043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fde240b9130 0x7fde24149af0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.444+0000 7fde2ba07640 1 -- 172.21.15.7:0/2078197043 >> 172.21.15.7:0/2078197043 conn(0x7fde240726b0 msgr2=0x7fde240b7100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:57.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.444+0000 7fde2ba07640 1 -- 172.21.15.7:0/2078197043 shutdown_connections 2024-04-25T09:57:57.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.444+0000 7fde2ba07640 1 -- 172.21.15.7:0/2078197043 wait complete. 2024-04-25T09:57:57.458 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:57:57.458 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:57:57.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.555+0000 7f6a5f516640 1 Processor -- start 2024-04-25T09:57:57.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.555+0000 7f6a5f516640 1 -- start start 2024-04-25T09:57:57.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.556+0000 7f6a5f516640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6a580d0aa0 0x7f6a58161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.556+0000 7f6a5f516640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a5815e8a0 con 0x7f6a5815da60 2024-04-25T09:57:57.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.556+0000 7f6a5f516640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a5815eb80 con 0x7f6a581622b0 2024-04-25T09:57:57.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.556+0000 7f6a5f516640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5815ee60 con 0x7f6a580d0aa0 2024-04-25T09:57:57.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.556+0000 7f6a5d2b2640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f6a5815da60 0x7f6a5815de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52158/0 (socket says 172.21.15.7:52158) 2024-04-25T09:57:57.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.556+0000 7f6a5d2b2640 1 -- 172.21.15.7:0/511741400 learned_addr learned my addr 172.21.15.7:0/511741400 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:57:57.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.556+0000 7f6a5cab1640 1 --2- 172.21.15.7:0/511741400 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6a580d0aa0 0x7f6a58161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.556+0000 7f6a4ffff640 1 -- 172.21.15.7:0/511741400 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 168738858 0 0) 0x7f6a5815e8a0 con 0x7f6a5815da60 2024-04-25T09:57:57.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.556+0000 7f6a4ffff640 1 -- 172.21.15.7:0/511741400 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a44003520 con 0x7f6a5815da60 2024-04-25T09:57:57.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.557+0000 7f6a4ffff640 1 -- 172.21.15.7:0/511741400 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4048594974 0 0) 0x7f6a44003520 con 0x7f6a5815da60 2024-04-25T09:57:57.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.557+0000 7f6a5cab1640 1 -- 172.21.15.7:0/511741400 >> v1:172.21.15.55:6789/0 conn(0x7f6a581622b0 legacy=0x7f6a580ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:57.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.557+0000 7f6a5cab1640 1 -- 172.21.15.7:0/511741400 >> v1:172.21.15.7:6789/0 conn(0x7f6a5815da60 legacy=0x7f6a5815de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:57.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.557+0000 7f6a5cab1640 1 -- 172.21.15.7:0/511741400 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a58161850 con 0x7f6a580d0aa0 2024-04-25T09:57:57.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.557+0000 7f6a5cab1640 1 --2- 172.21.15.7:0/511741400 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6a580d0aa0 0x7f6a58161d70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6a480097d0 tx=0x7f6a4802a030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8747bc4d501a2b90 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:57.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.558+0000 7f6a4ffff640 1 -- 172.21.15.7:0/511741400 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a48037070 con 0x7f6a580d0aa0 2024-04-25T09:57:57.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.558+0000 7f6a4ffff640 1 -- 172.21.15.7:0/511741400 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4802aac0 con 0x7f6a580d0aa0 2024-04-25T09:57:57.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.558+0000 7f6a4ffff640 1 -- 172.21.15.7:0/511741400 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a54001670 con 0x7f6a580d0aa0 2024-04-25T09:57:57.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.558+0000 7f6a5f516640 1 -- 172.21.15.7:0/511741400 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6a580d0aa0 msgr2=0x7f6a58161d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:57.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.558+0000 7f6a5f516640 1 --2- 172.21.15.7:0/511741400 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6a580d0aa0 0x7f6a58161d70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6a480097d0 tx=0x7f6a4802a030 comp rx=0 tx=0).stop 2024-04-25T09:57:57.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.558+0000 7f6a5f516640 1 -- 172.21.15.7:0/511741400 shutdown_connections 2024-04-25T09:57:57.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.558+0000 7f6a5f516640 1 --2- 172.21.15.7:0/511741400 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6a580d0aa0 0x7f6a58161d70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.558+0000 7f6a5f516640 1 -- 172.21.15.7:0/511741400 >> 172.21.15.7:0/511741400 conn(0x7f6a5806bfe0 msgr2=0x7f6a5806c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:57.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.558+0000 7f6a5f516640 1 -- 172.21.15.7:0/511741400 shutdown_connections 2024-04-25T09:57:57.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.558+0000 7f6a5f516640 1 -- 172.21.15.7:0/511741400 wait complete. 2024-04-25T09:57:57.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.559+0000 7f6a5f516640 1 Processor -- start 2024-04-25T09:57:57.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.559+0000 7f6a5f516640 1 -- start start 2024-04-25T09:57:57.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.560+0000 7f6a5f516640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a580d0aa0 0x7f6a58158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.560+0000 7f6a5f516640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6a5815da60 0x7f6a580b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.560+0000 7f6a5f516640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a581622b0 0x7f6a580b8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.560+0000 7f6a5f516640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a580cedb0 con 0x7f6a580d0aa0 2024-04-25T09:57:57.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.560+0000 7f6a5f516640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a580cec30 con 0x7f6a581622b0 2024-04-25T09:57:57.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.560+0000 7f6a5f516640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a580d2ca0 con 0x7f6a5815da60 2024-04-25T09:57:57.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.560+0000 7f6a5d2b2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a580d0aa0 0x7f6a58158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.560+0000 7f6a5d2b2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a580d0aa0 0x7f6a58158ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53006/0 (socket says 172.21.15.7:53006) 2024-04-25T09:57:57.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.560+0000 7f6a5d2b2640 1 -- 172.21.15.7:0/1871497982 learned_addr learned my addr 172.21.15.7:0/1871497982 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:57.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.560+0000 7f6a5cab1640 1 --2- 172.21.15.7:0/1871497982 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6a5815da60 0x7f6a580b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.560+0000 7f6a5dab3640 1 --2- 172.21.15.7:0/1871497982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a581622b0 0x7f6a580b8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.561+0000 7f6a5d2b2640 1 -- 172.21.15.7:0/1871497982 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6a5815da60 msgr2=0x7f6a580b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:57.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.561+0000 7f6a5d2b2640 1 --2- 172.21.15.7:0/1871497982 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6a5815da60 0x7f6a580b42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.561+0000 7f6a5d2b2640 1 -- 172.21.15.7:0/1871497982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a581622b0 msgr2=0x7f6a580b8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:57.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.561+0000 7f6a5d2b2640 1 --2- 172.21.15.7:0/1871497982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a581622b0 0x7f6a580b8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.561+0000 7f6a5d2b2640 1 -- 172.21.15.7:0/1871497982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a580cb680 con 0x7f6a580d0aa0 2024-04-25T09:57:57.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.561+0000 7f6a5d2b2640 1 --2- 172.21.15.7:0/1871497982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a580d0aa0 0x7f6a58158ed0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400c750 tx=0x7f6a5400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:57.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.561+0000 7f6a4dffb640 1 -- 172.21.15.7:0/1871497982 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a54018070 con 0x7f6a580d0aa0 2024-04-25T09:57:57.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.561+0000 7f6a4dffb640 1 -- 172.21.15.7:0/1871497982 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a540072f0 con 0x7f6a580d0aa0 2024-04-25T09:57:57.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.561+0000 7f6a5f516640 1 -- 172.21.15.7:0/1871497982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a581e9010 con 0x7f6a580d0aa0 2024-04-25T09:57:57.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.561+0000 7f6a4dffb640 1 -- 172.21.15.7:0/1871497982 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a540047e0 con 0x7f6a580d0aa0 2024-04-25T09:57:57.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.561+0000 7f6a5f516640 1 -- 172.21.15.7:0/1871497982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a580b4cb0 con 0x7f6a580d0aa0 2024-04-25T09:57:57.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.562+0000 7f6a5f516640 1 -- 172.21.15.7:0/1871497982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a58068fd0 con 0x7f6a580d0aa0 2024-04-25T09:57:57.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.562+0000 7f6a4dffb640 1 -- 172.21.15.7:0/1871497982 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6a5401b070 con 0x7f6a580d0aa0 2024-04-25T09:57:57.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.563+0000 7f6a4dffb640 1 --2- 172.21.15.7:0/1871497982 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6a3c06b4d0 0x7f6a3c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.563+0000 7f6a4dffb640 1 -- 172.21.15.7:0/1871497982 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6a540896e0 con 0x7f6a580d0aa0 2024-04-25T09:57:57.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.563+0000 7f6a5cab1640 1 --2- 172.21.15.7:0/1871497982 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6a3c06b4d0 0x7f6a3c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.563+0000 7f6a5cab1640 1 --2- 172.21.15.7:0/1871497982 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6a3c06b4d0 0x7f6a3c06d990 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6a48034000 tx=0x7f6a4802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:57.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.567+0000 7f6a4dffb640 1 -- 172.21.15.7:0/1871497982 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6a54057d80 con 0x7f6a580d0aa0 2024-04-25T09:57:57.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.784+0000 7f6a5f516640 1 -- 172.21.15.7:0/1871497982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a580d1560 con 0x7f6a580d0aa0 2024-04-25T09:57:57.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.784+0000 7f6a4dffb640 1 -- 172.21.15.7:0/1871497982 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4933 (secure 0 0 0) 0x7f6a5405e0d0 con 0x7f6a580d0aa0 2024-04-25T09:57:57.788 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:57:57.788 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3706118852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3706118852},{"type":"v1","addr":"172.21.15.55:6833","nonce":3706118852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5354,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1513522793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1513522793},{"type":"v1","addr":"172.21.15.55:6835","nonce":1513522793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5782,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1231382839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1231382839},{"type":"v1","addr":"172.21.15.7:6837","nonce":1231382839}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:57:15.098282+0000","modified":"2024-04-25T09:57:31.772179+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.15.7:6836/3057688863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3057688863},{"type":"v1","addr":"172.21.15.7:6836","nonce":3057688863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:57:57.789 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 29 2024-04-25T09:57:57.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.786+0000 7f6a5f516640 1 -- 172.21.15.7:0/1871497982 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6a3c06b4d0 msgr2=0x7f6a3c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:57.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.786+0000 7f6a5f516640 1 --2- 172.21.15.7:0/1871497982 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6a3c06b4d0 0x7f6a3c06d990 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6a48034000 tx=0x7f6a4802e000 comp rx=0 tx=0).stop 2024-04-25T09:57:57.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.786+0000 7f6a5f516640 1 -- 172.21.15.7:0/1871497982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a580d0aa0 msgr2=0x7f6a58158ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:57.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.786+0000 7f6a5f516640 1 --2- 172.21.15.7:0/1871497982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a580d0aa0 0x7f6a58158ed0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400c750 tx=0x7f6a5400cc10 comp rx=0 tx=0).stop 2024-04-25T09:57:57.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.786+0000 7f6a5f516640 1 -- 172.21.15.7:0/1871497982 shutdown_connections 2024-04-25T09:57:57.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.786+0000 7f6a5f516640 1 --2- 172.21.15.7:0/1871497982 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6a3c06b4d0 0x7f6a3c06d990 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.786+0000 7f6a5f516640 1 --2- 172.21.15.7:0/1871497982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a581622b0 0x7f6a580b8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.786+0000 7f6a5f516640 1 --2- 172.21.15.7:0/1871497982 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6a5815da60 0x7f6a580b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.786+0000 7f6a5f516640 1 --2- 172.21.15.7:0/1871497982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a580d0aa0 0x7f6a58158ed0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.786+0000 7f6a5f516640 1 -- 172.21.15.7:0/1871497982 >> 172.21.15.7:0/1871497982 conn(0x7f6a5806bfe0 msgr2=0x7f6a5815f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:57.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.786+0000 7f6a5f516640 1 -- 172.21.15.7:0/1871497982 shutdown_connections 2024-04-25T09:57:57.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.786+0000 7f6a5f516640 1 -- 172.21.15.7:0/1871497982 wait complete. 2024-04-25T09:57:57.801 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-25T09:57:57.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.899+0000 7f0b09d6a640 1 Processor -- start 2024-04-25T09:57:57.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.899+0000 7f0b09d6a640 1 -- start start 2024-04-25T09:57:57.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.900+0000 7f0b09d6a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0b0415d990 0x7f0b040b1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.900+0000 7f0b09d6a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0b040d1c90 0x7f0b0406c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.900+0000 7f0b09d6a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b040cbcb0 con 0x7f0b040b29c0 2024-04-25T09:57:57.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.900+0000 7f0b09d6a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b040b1df0 con 0x7f0b040d1c90 2024-04-25T09:57:57.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.900+0000 7f0b09d6a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b040b20d0 con 0x7f0b0415d990 2024-04-25T09:57:57.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.900+0000 7f0b03fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0b040d1c90 0x7f0b0406c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.901+0000 7f0b03fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0b040d1c90 0x7f0b0406c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53020/0 (socket says 172.21.15.7:53020) 2024-04-25T09:57:57.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.901+0000 7f0b03fff640 1 -- 172.21.15.7:0/3199299622 learned_addr learned my addr 172.21.15.7:0/3199299622 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:57.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.901+0000 7f0b037fe640 1 --2- 172.21.15.7:0/3199299622 >> v2:172.21.15.55:3300/0 conn(0x7f0b0415d990 0x7f0b040b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.901+0000 7f0b03fff640 1 -- 172.21.15.7:0/3199299622 >> v2:172.21.15.55:3300/0 conn(0x7f0b0415d990 msgr2=0x7f0b040b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:57.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.901+0000 7f0b03fff640 1 --2- 172.21.15.7:0/3199299622 >> v2:172.21.15.55:3300/0 conn(0x7f0b0415d990 0x7f0b040b1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.901+0000 7f0b03fff640 1 -- 172.21.15.7:0/3199299622 >> v1:172.21.15.55:6789/0 conn(0x7f0b040b29c0 legacy=0x7f0b040d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:57.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.901+0000 7f0b03fff640 1 -- 172.21.15.7:0/3199299622 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b040b23b0 con 0x7f0b040d1c90 2024-04-25T09:57:57.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.901+0000 7f0b03fff640 1 --2- 172.21.15.7:0/3199299622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b040d1c90 0x7f0b0406c360 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f0b040cbc40 tx=0x7f0afc02a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f709f262ffec8927 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:57.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.902+0000 7f0b027fc640 1 -- 172.21.15.7:0/3199299622 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0afc036070 con 0x7f0b040d1c90 2024-04-25T09:57:57.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.902+0000 7f0b027fc640 1 -- 172.21.15.7:0/3199299622 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0afc031600 con 0x7f0b040d1c90 2024-04-25T09:57:57.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.902+0000 7f0b027fc640 1 -- 172.21.15.7:0/3199299622 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0afc0319d0 con 0x7f0b040d1c90 2024-04-25T09:57:57.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.902+0000 7f0b09d6a640 1 -- 172.21.15.7:0/3199299622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b040d1c90 msgr2=0x7f0b0406c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:57.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.902+0000 7f0b09d6a640 1 --2- 172.21.15.7:0/3199299622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b040d1c90 0x7f0b0406c360 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f0b040cbc40 tx=0x7f0afc02a640 comp rx=0 tx=0).stop 2024-04-25T09:57:57.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.902+0000 7f0b09d6a640 1 -- 172.21.15.7:0/3199299622 shutdown_connections 2024-04-25T09:57:57.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.902+0000 7f0b09d6a640 1 --2- 172.21.15.7:0/3199299622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b040d1c90 0x7f0b0406c360 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.902+0000 7f0b09d6a640 1 --2- 172.21.15.7:0/3199299622 >> v2:172.21.15.55:3300/0 conn(0x7f0b0415d990 0x7f0b040b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.902+0000 7f0b09d6a640 1 -- 172.21.15.7:0/3199299622 >> 172.21.15.7:0/3199299622 conn(0x7f0b0408af80 msgr2=0x7f0b0408b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:57.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.902+0000 7f0b09d6a640 1 -- 172.21.15.7:0/3199299622 shutdown_connections 2024-04-25T09:57:57.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.902+0000 7f0b09d6a640 1 -- 172.21.15.7:0/3199299622 wait complete. 2024-04-25T09:57:57.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.903+0000 7f0b09d6a640 1 Processor -- start 2024-04-25T09:57:57.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.904+0000 7f0b09d6a640 1 -- start start 2024-04-25T09:57:57.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.904+0000 7f0b09d6a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b040b29c0 0x7f0b040ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.904+0000 7f0b09d6a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b040d1c90 0x7f0b040b6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.904+0000 7f0b09d6a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b0415d990 0x7f0b0415f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.904+0000 7f0b09d6a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b040b19c0 con 0x7f0b040b29c0 2024-04-25T09:57:57.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.904+0000 7f0b09d6a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b040cf9d0 con 0x7f0b040d1c90 2024-04-25T09:57:57.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.904+0000 7f0b09d6a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b040b1b40 con 0x7f0b0415d990 2024-04-25T09:57:57.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.904+0000 7f0b037fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b040b29c0 0x7f0b040ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.905+0000 7f0b037fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b040b29c0 0x7f0b040ca110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53026/0 (socket says 172.21.15.7:53026) 2024-04-25T09:57:57.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.905+0000 7f0b037fe640 1 -- 172.21.15.7:0/3034269952 learned_addr learned my addr 172.21.15.7:0/3034269952 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:57.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.905+0000 7f0b03fff640 1 --2- 172.21.15.7:0/3034269952 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b0415d990 0x7f0b0415f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.905+0000 7f0b02ffd640 1 --2- 172.21.15.7:0/3034269952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b040d1c90 0x7f0b040b6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.905+0000 7f0b037fe640 1 -- 172.21.15.7:0/3034269952 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b0415d990 msgr2=0x7f0b0415f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:57.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.905+0000 7f0b037fe640 1 --2- 172.21.15.7:0/3034269952 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b0415d990 0x7f0b0415f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.905+0000 7f0b037fe640 1 -- 172.21.15.7:0/3034269952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b040d1c90 msgr2=0x7f0b040b6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:57.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.905+0000 7f0b037fe640 1 --2- 172.21.15.7:0/3034269952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b040d1c90 0x7f0b040b6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.905+0000 7f0b037fe640 1 -- 172.21.15.7:0/3034269952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b040c9350 con 0x7f0b040b29c0 2024-04-25T09:57:57.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.905+0000 7f0b02ffd640 1 --2- 172.21.15.7:0/3034269952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b040d1c90 0x7f0b040b6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:57:57.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.905+0000 7f0b037fe640 1 --2- 172.21.15.7:0/3034269952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b040b29c0 0x7f0b040ca110 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f0af400c820 tx=0x7f0af400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:57.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.905+0000 7f0aebfff640 1 -- 172.21.15.7:0/3034269952 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af4015070 con 0x7f0b040b29c0 2024-04-25T09:57:57.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.905+0000 7f0aebfff640 1 -- 172.21.15.7:0/3034269952 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af4004020 con 0x7f0b040b29c0 2024-04-25T09:57:57.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.905+0000 7f0b09d6a640 1 -- 172.21.15.7:0/3034269952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b040c9630 con 0x7f0b040b29c0 2024-04-25T09:57:57.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.905+0000 7f0aebfff640 1 -- 172.21.15.7:0/3034269952 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af40043f0 con 0x7f0b040b29c0 2024-04-25T09:57:57.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.905+0000 7f0b09d6a640 1 -- 172.21.15.7:0/3034269952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b040c9bf0 con 0x7f0b040b29c0 2024-04-25T09:57:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.907+0000 7f0aebfff640 1 -- 172.21.15.7:0/3034269952 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0af4007830 con 0x7f0b040b29c0 2024-04-25T09:57:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.907+0000 7f0aebfff640 1 --2- 172.21.15.7:0/3034269952 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0af006b4d0 0x7f0af006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.907+0000 7f0aebfff640 1 -- 172.21.15.7:0/3034269952 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0af408a100 con 0x7f0b040b29c0 2024-04-25T09:57:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.907+0000 7f0b02ffd640 1 --2- 172.21.15.7:0/3034269952 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0af006b4d0 0x7f0af006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.908+0000 7f0b02ffd640 1 --2- 172.21.15.7:0/3034269952 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0af006b4d0 0x7f0af006d990 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0b041601b0 tx=0x7f0af8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.908+0000 7f0b0ca74740 1 Processor -- start 2024-04-25T09:57:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.908+0000 7f0b0ca74740 1 -- start start 2024-04-25T09:57:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.909+0000 7f0b0ca74740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5637e7a93590 0x5637e7a956f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.909+0000 7f0b0ca74740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5637e7acfc60 0x5637e7a93970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.909+0000 7f0b0ca74740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637e7abe050 0x5637e7abe4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.909+0000 7f0b0ca74740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e79f6c60 con 0x5637e7a93590 2024-04-25T09:57:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.909+0000 7f0b0ca74740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e7995d80 con 0x5637e7abe050 2024-04-25T09:57:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.909+0000 7f0b0ca74740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5637e79f2d00 con 0x5637e7acfc60 2024-04-25T09:57:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.909+0000 7f0b037fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5637e7a93590 0x5637e7a956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.909+0000 7f0b037fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5637e7a93590 0x5637e7a956f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53034/0 (socket says 172.21.15.7:53034) 2024-04-25T09:57:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.909+0000 7f0b037fe640 1 -- 172.21.15.7:0/1753573495 learned_addr learned my addr 172.21.15.7:0/1753573495 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.909+0000 7f0b02ffd640 1 --2- 172.21.15.7:0/1753573495 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5637e7acfc60 0x5637e7a93970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.909+0000 7f0b03fff640 1 --2- 172.21.15.7:0/1753573495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637e7abe050 0x5637e7abe4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.910+0000 7f0b037fe640 1 -- 172.21.15.7:0/1753573495 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5637e7acfc60 msgr2=0x5637e7a93970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.910+0000 7f0b037fe640 1 --2- 172.21.15.7:0/1753573495 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5637e7acfc60 0x5637e7a93970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.910+0000 7f0b037fe640 1 -- 172.21.15.7:0/1753573495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637e7abe050 msgr2=0x5637e7abe4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.910+0000 7f0b037fe640 1 --2- 172.21.15.7:0/1753573495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637e7abe050 0x5637e7abe4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.910+0000 7f0b037fe640 1 -- 172.21.15.7:0/1753573495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637e77d77c0 con 0x5637e7a93590 2024-04-25T09:57:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.910+0000 7f0b037fe640 1 --2- 172.21.15.7:0/1753573495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5637e7a93590 0x5637e7a956f0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f0af40608d0 tx=0x7f0af40588e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971da7345b24993a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.910+0000 7f0ae97fa640 1 -- 172.21.15.7:0/1753573495 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af401e040 con 0x5637e7a93590 2024-04-25T09:57:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.910+0000 7f0ae97fa640 1 -- 172.21.15.7:0/1753573495 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af4056840 con 0x5637e7a93590 2024-04-25T09:57:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.910+0000 7f0ae97fa640 1 -- 172.21.15.7:0/1753573495 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af4070170 con 0x5637e7a93590 2024-04-25T09:57:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.911+0000 7f0b0ca74740 1 -- 172.21.15.7:0/1753573495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5637e7a93590 msgr2=0x5637e7a956f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.911+0000 7f0b0ca74740 1 --2- 172.21.15.7:0/1753573495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5637e7a93590 0x5637e7a956f0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f0af40608d0 tx=0x7f0af40588e0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.911+0000 7f0b0ca74740 1 -- 172.21.15.7:0/1753573495 shutdown_connections 2024-04-25T09:57:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.911+0000 7f0b0ca74740 1 --2- 172.21.15.7:0/1753573495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637e7abe050 0x5637e7abe4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.911+0000 7f0b0ca74740 1 --2- 172.21.15.7:0/1753573495 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5637e7acfc60 0x5637e7a93970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.911+0000 7f0b0ca74740 1 --2- 172.21.15.7:0/1753573495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5637e7a93590 0x5637e7a956f0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.911+0000 7f0b0ca74740 1 -- 172.21.15.7:0/1753573495 >> 172.21.15.7:0/1753573495 conn(0x5637e7a5b6e0 msgr2=0x5637e7ad9050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.911+0000 7f0b0ca74740 1 -- 172.21.15.7:0/1753573495 shutdown_connections 2024-04-25T09:57:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.911+0000 7f0b0ca74740 1 -- 172.21.15.7:0/1753573495 wait complete. 2024-04-25T09:57:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.911+0000 7f0b0ca74740 1 -- start start 2024-04-25T09:57:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.911+0000 7f0b0ca74740 1 Processor -- start 2024-04-25T09:57:57.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.912+0000 7f0b0ca74740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5637e7a93590 0x5637e7aea070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.912+0000 7f0b0ca74740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5637e7abe050 0x5637e7ac1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.912+0000 7f0b0ca74740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637e7acfc60 0x5637e7ad55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.912+0000 7f0b0ca74740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e7993840 con 0x5637e7a93590 2024-04-25T09:57:57.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.912+0000 7f0b0ca74740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e7abbba0 con 0x5637e7acfc60 2024-04-25T09:57:57.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.912+0000 7f0b0ca74740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5637e7abf9b0 con 0x5637e7abe050 2024-04-25T09:57:57.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.912+0000 7f0b0ca74740 10 client.0 _ll_register_callbacks cb 0x5637e79ad980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:57:57.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.912+0000 7f0b037fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5637e7a93590 0x5637e7aea070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.912+0000 7f0b037fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5637e7a93590 0x5637e7aea070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53040/0 (socket says 172.21.15.7:53040) 2024-04-25T09:57:57.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.912+0000 7f0b037fe640 1 -- 172.21.15.7:0/3347238382 learned_addr learned my addr 172.21.15.7:0/3347238382 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:57.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.912+0000 7f0b02ffd640 1 --2- 172.21.15.7:0/3347238382 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5637e7abe050 0x5637e7ac1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.912+0000 7f0b03fff640 1 --2- 172.21.15.7:0/3347238382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637e7acfc60 0x5637e7ad55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.913+0000 7f0b037fe640 1 -- 172.21.15.7:0/3347238382 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5637e7abe050 msgr2=0x5637e7ac1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:57.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.913+0000 7f0b037fe640 1 --2- 172.21.15.7:0/3347238382 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5637e7abe050 0x5637e7ac1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.913+0000 7f0b037fe640 1 -- 172.21.15.7:0/3347238382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637e7acfc60 msgr2=0x5637e7ad55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:57.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.913+0000 7f0b037fe640 1 --2- 172.21.15.7:0/3347238382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637e7acfc60 0x5637e7ad55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.913+0000 7f0b037fe640 1 -- 172.21.15.7:0/3347238382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5637e7837f50 con 0x5637e7a93590 2024-04-25T09:57:57.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.913+0000 7f0b037fe640 1 --2- 172.21.15.7:0/3347238382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5637e7a93590 0x5637e7aea070 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f0af400c7f0 tx=0x7f0af400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf6e7fd2e1895c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:57.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.913+0000 7f0ae27fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:57:57.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.913+0000 7f0ae27fc640 1 -- 172.21.15.7:0/3347238382 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af4087070 con 0x5637e7a93590 2024-04-25T09:57:57.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.913+0000 7f0ae27fc640 1 -- 172.21.15.7:0/3347238382 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0af4071cc0 con 0x5637e7a93590 2024-04-25T09:57:57.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.913+0000 7f0b0ca74740 1 -- 172.21.15.7:0/3347238382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0af4056840 con 0x5637e7a93590 2024-04-25T09:57:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.913+0000 7f0ae27fc640 1 -- 172.21.15.7:0/3347238382 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0af401e040 con 0x5637e7a93590 2024-04-25T09:57:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.913+0000 7f0b0ca74740 10 client.6549 fetch_fsmap learned FSMap version 29 2024-04-25T09:57:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.913+0000 7f0b0ca74740 1 -- 172.21.15.7:0/3347238382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x5637e76cb0b0 con 0x5637e7a93590 2024-04-25T09:57:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.913+0000 7f0ae27fc640 1 -- 172.21.15.7:0/3347238382 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af4056840 con 0x5637e7a93590 2024-04-25T09:57:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.913+0000 7f0ae27fc640 1 -- 172.21.15.7:0/3347238382 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 29) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0af4057bf0 con 0x5637e7a93590 2024-04-25T09:57:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.913+0000 7f0b0ca74740 10 client.6549 fetch_fsmap finished waiting for FSMap version 29 2024-04-25T09:57:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.913+0000 7f0b0ca74740 10 client.6549 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:57:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.913+0000 7f0b0ca74740 20 client.6549 populate_metadata read hostname 'smithi007' 2024-04-25T09:57:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.913+0000 7f0b0ca74740 1 --2- 172.21.15.7:0/3347238382 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5637e7abe930 0x5637e7abed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.913+0000 7f0b0ca74740 4 client.6549 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:57:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.913+0000 7f0b0ca74740 1 -- 172.21.15.7:0/3347238382 --> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5637e79b6e60 con 0x5637e7abe930 2024-04-25T09:57:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.914+0000 7f0b02ffd640 1 --2- 172.21.15.7:0/3347238382 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5637e7abe930 0x5637e7abed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.914+0000 7f0ae27fc640 10 client.6549 ms_handle_connect on v2:172.21.15.7:6834/3057688863 2024-04-25T09:57:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.914+0000 7f0b02ffd640 1 --2- 172.21.15.7:0/3347238382 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5637e7abe930 0x5637e7abed10 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a074eef5b817653e server_cookie=dd37b5a0740f154c in_seq=0 out_seq=0 2024-04-25T09:57:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.914+0000 7f0ae27fc640 1 -- 172.21.15.7:0/3347238382 <== mds.0 v2:172.21.15.7:6834/3057688863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5637e79b6e60 con 0x5637e7abe930 2024-04-25T09:57:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.914+0000 7f0ae27fc640 10 client.6549 handle_command_reply: tid=0 2024-04-25T09:57:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.914+0000 7f0b0ca74740 1 client.6549 shutdown 2024-04-25T09:57:57.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.914+0000 7f0b0ca74740 1 -- 172.21.15.7:0/3347238382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5637e7a93590 msgr2=0x5637e7aea070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:57.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.914+0000 7f0b0ca74740 1 --2- 172.21.15.7:0/3347238382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5637e7a93590 0x5637e7aea070 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f0af400c7f0 tx=0x7f0af400cf30 comp rx=0 tx=0).stop 2024-04-25T09:57:57.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.915+0000 7f0b0ca74740 1 -- 172.21.15.7:0/3347238382 shutdown_connections 2024-04-25T09:57:57.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.915+0000 7f0b0ca74740 1 --2- 172.21.15.7:0/3347238382 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5637e7abe930 0x5637e7abed10 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.915+0000 7f0b0ca74740 1 --2- 172.21.15.7:0/3347238382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637e7acfc60 0x5637e7ad55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.915+0000 7f0b0ca74740 1 --2- 172.21.15.7:0/3347238382 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5637e7abe050 0x5637e7ac1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.915+0000 7f0b0ca74740 1 --2- 172.21.15.7:0/3347238382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5637e7a93590 0x5637e7aea070 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.915+0000 7f0ae27fc640 0 client.6549 ms_handle_reset on v2:172.21.15.7:6834/3057688863 2024-04-25T09:57:57.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.915+0000 7f0b0ca74740 1 -- 172.21.15.7:0/3347238382 >> 172.21.15.7:0/3347238382 conn(0x5637e7a5b6e0 msgr2=0x5637e7abb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:57.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.915+0000 7f0b0ca74740 1 -- 172.21.15.7:0/3347238382 shutdown_connections 2024-04-25T09:57:57.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.915+0000 7f0b0ca74740 1 -- 172.21.15.7:0/3347238382 wait complete. 2024-04-25T09:57:57.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.915+0000 7f0b0ca74740 20 client.6549 trim_cache size 0 max 16384 2024-04-25T09:57:57.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.926+0000 7f0b0ca74740 1 Processor -- start 2024-04-25T09:57:57.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.926+0000 7f0b0ca74740 1 -- start start 2024-04-25T09:57:57.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.927+0000 7f0b0ca74740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5637e7a93590 0x5637e7a8d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.927+0000 7f0b0ca74740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5637e7abe050 0x5637e7a8d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.927+0000 7f0b0ca74740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637e7acfc60 0x5637e7adc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.927+0000 7f0b0ca74740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b041ff5d0 con 0x5637e7a93590 2024-04-25T09:57:57.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.927+0000 7f0b0ca74740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0415eae0 con 0x5637e7acfc60 2024-04-25T09:57:57.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.927+0000 7f0b0ca74740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b040b4e30 con 0x5637e7abe050 2024-04-25T09:57:57.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.927+0000 7f0b037fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5637e7a93590 0x5637e7a8d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.927+0000 7f0b037fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5637e7a93590 0x5637e7a8d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53048/0 (socket says 172.21.15.7:53048) 2024-04-25T09:57:57.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.927+0000 7f0b037fe640 1 -- 172.21.15.7:0/2606708803 learned_addr learned my addr 172.21.15.7:0/2606708803 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:57.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.928+0000 7f0b02ffd640 1 --2- 172.21.15.7:0/2606708803 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5637e7abe050 0x5637e7a8d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.928+0000 7f0b03fff640 1 --2- 172.21.15.7:0/2606708803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637e7acfc60 0x5637e7adc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.928+0000 7f0b037fe640 1 -- 172.21.15.7:0/2606708803 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5637e7abe050 msgr2=0x5637e7a8d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:57.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.928+0000 7f0b037fe640 1 --2- 172.21.15.7:0/2606708803 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5637e7abe050 0x5637e7a8d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.928+0000 7f0b037fe640 1 -- 172.21.15.7:0/2606708803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637e7acfc60 msgr2=0x5637e7adc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:57.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.928+0000 7f0b037fe640 1 --2- 172.21.15.7:0/2606708803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637e7acfc60 0x5637e7adc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.928+0000 7f0b037fe640 1 -- 172.21.15.7:0/2606708803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637e7ad5920 con 0x5637e7a93590 2024-04-25T09:57:57.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.928+0000 7f0b037fe640 1 --2- 172.21.15.7:0/2606708803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5637e7a93590 0x5637e7a8d490 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f0af4054c00 tx=0x7f0af406e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da79bc0d729360c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:57.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.928+0000 7f0ae8ff9640 1 -- 172.21.15.7:0/2606708803 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af4087070 con 0x5637e7a93590 2024-04-25T09:57:57.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.928+0000 7f0ae8ff9640 1 -- 172.21.15.7:0/2606708803 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af4057bf0 con 0x5637e7a93590 2024-04-25T09:57:57.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.928+0000 7f0ae8ff9640 1 -- 172.21.15.7:0/2606708803 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af4077300 con 0x5637e7a93590 2024-04-25T09:57:57.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.928+0000 7f0b0ca74740 1 -- 172.21.15.7:0/2606708803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5637e7a93590 msgr2=0x5637e7a8d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:57.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.928+0000 7f0b0ca74740 1 --2- 172.21.15.7:0/2606708803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5637e7a93590 0x5637e7a8d490 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f0af4054c00 tx=0x7f0af406e070 comp rx=0 tx=0).stop 2024-04-25T09:57:57.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.929+0000 7f0b0ca74740 1 -- 172.21.15.7:0/2606708803 shutdown_connections 2024-04-25T09:57:57.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.929+0000 7f0b0ca74740 1 --2- 172.21.15.7:0/2606708803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637e7acfc60 0x5637e7adc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.929+0000 7f0b0ca74740 1 --2- 172.21.15.7:0/2606708803 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5637e7abe050 0x5637e7a8d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.929+0000 7f0b0ca74740 1 --2- 172.21.15.7:0/2606708803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5637e7a93590 0x5637e7a8d490 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.929+0000 7f0b0ca74740 1 -- 172.21.15.7:0/2606708803 >> 172.21.15.7:0/2606708803 conn(0x5637e7a5b6e0 msgr2=0x5637e7ae9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:57.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.929+0000 7f0b0ca74740 1 -- 172.21.15.7:0/2606708803 shutdown_connections 2024-04-25T09:57:57.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.929+0000 7f0b0ca74740 1 -- 172.21.15.7:0/2606708803 wait complete. 2024-04-25T09:57:57.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.930+0000 7f0b0ca74740 1 -- start start 2024-04-25T09:57:57.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.930+0000 7f0b0ca74740 1 Processor -- start 2024-04-25T09:57:57.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.931+0000 7f0b0ca74740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5637e7a93590 0x5637e7ae91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.931+0000 7f0b0ca74740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637e7abe050 0x5637e7abf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.931+0000 7f0b0ca74740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5637e7acfc60 0x5637e7abf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.931+0000 7f0b0ca74740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e7ad48a0 con 0x5637e7acfc60 2024-04-25T09:57:57.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.931+0000 7f0b0ca74740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e7993840 con 0x5637e7abe050 2024-04-25T09:57:57.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.931+0000 7f0b0ca74740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5637e7aecd30 con 0x5637e7a93590 2024-04-25T09:57:57.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.931+0000 7f0b0ca74740 10 client.0 _ll_register_callbacks cb 0x7f0af400a430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:57:57.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.931+0000 7f0b03fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5637e7acfc60 0x5637e7abf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.931+0000 7f0b03fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5637e7acfc60 0x5637e7abf880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53064/0 (socket says 172.21.15.7:53064) 2024-04-25T09:57:57.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.931+0000 7f0b03fff640 1 -- 172.21.15.7:0/3490443828 learned_addr learned my addr 172.21.15.7:0/3490443828 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:57.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.931+0000 7f0b02ffd640 1 --2- 172.21.15.7:0/3490443828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637e7abe050 0x5637e7abf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.931+0000 7f0b037fe640 1 --2- 172.21.15.7:0/3490443828 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5637e7a93590 0x5637e7ae91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.931+0000 7f0b03fff640 1 -- 172.21.15.7:0/3490443828 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5637e7a93590 msgr2=0x5637e7ae91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:57.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.931+0000 7f0b03fff640 1 --2- 172.21.15.7:0/3490443828 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5637e7a93590 0x5637e7ae91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.931+0000 7f0b03fff640 1 -- 172.21.15.7:0/3490443828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637e7abe050 msgr2=0x5637e7abf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:57.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.931+0000 7f0b03fff640 1 --2- 172.21.15.7:0/3490443828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637e7abe050 0x5637e7abf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.931+0000 7f0b03fff640 1 -- 172.21.15.7:0/3490443828 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5637e7abeeb0 con 0x5637e7acfc60 2024-04-25T09:57:57.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.932+0000 7f0b03fff640 1 --2- 172.21.15.7:0/3490443828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5637e7acfc60 0x5637e7abf880 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f0afc0093e0 tx=0x7f0afc02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbbce85e6f875b2c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:57.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.932+0000 7f0ae27fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:57:57.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.932+0000 7f0ae27fc640 1 -- 172.21.15.7:0/3490443828 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0afc036040 con 0x5637e7acfc60 2024-04-25T09:57:57.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.932+0000 7f0ae27fc640 1 -- 172.21.15.7:0/3490443828 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0afc04ac30 con 0x5637e7acfc60 2024-04-25T09:57:57.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.932+0000 7f0b0ca74740 1 -- 172.21.15.7:0/3490443828 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0af4057bf0 con 0x5637e7acfc60 2024-04-25T09:57:57.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.932+0000 7f0ae27fc640 1 -- 172.21.15.7:0/3490443828 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0afc04ae30 con 0x5637e7acfc60 2024-04-25T09:57:57.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.932+0000 7f0b0ca74740 10 client.6555 fetch_fsmap learned FSMap version 29 2024-04-25T09:57:57.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.932+0000 7f0b0ca74740 1 -- 172.21.15.7:0/3490443828 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x5637e7b43db0 con 0x5637e7acfc60 2024-04-25T09:57:57.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.932+0000 7f0ae27fc640 1 -- 172.21.15.7:0/3490443828 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af4057bf0 con 0x5637e7acfc60 2024-04-25T09:57:57.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.932+0000 7f0ae27fc640 1 -- 172.21.15.7:0/3490443828 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 29) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0afc048070 con 0x5637e7acfc60 2024-04-25T09:57:57.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.932+0000 7f0b0ca74740 10 client.6555 fetch_fsmap finished waiting for FSMap version 29 2024-04-25T09:57:57.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.932+0000 7f0b0ca74740 10 client.6555 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:57:57.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.932+0000 7f0b0ca74740 20 client.6555 populate_metadata read hostname 'smithi007' 2024-04-25T09:57:57.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.932+0000 7f0b0ca74740 1 --2- 172.21.15.7:0/3490443828 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5637e7ad2c50 0x5637e7b42cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:57.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.932+0000 7f0b0ca74740 4 client.6555 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T09:57:57.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.932+0000 7f0b0ca74740 1 -- 172.21.15.7:0/3490443828 --> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x5637e7a041a0 con 0x5637e7ad2c50 2024-04-25T09:57:57.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.932+0000 7f0b037fe640 1 --2- 172.21.15.7:0/3490443828 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5637e7ad2c50 0x5637e7b42cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:57.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.933+0000 7f0ae27fc640 10 client.6555 ms_handle_connect on v2:172.21.15.7:6834/3057688863 2024-04-25T09:57:57.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.933+0000 7f0b037fe640 1 --2- 172.21.15.7:0/3490443828 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5637e7ad2c50 0x5637e7b42cc0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d593ac444dda44de server_cookie=c2b9e3e0695ad6fa in_seq=0 out_seq=0 2024-04-25T09:57:57.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.933+0000 7f0ae27fc640 1 -- 172.21.15.7:0/3490443828 <== mds.0 v2:172.21.15.7:6834/3057688863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+141 (crc 0 0 0) 0x5637e7a041a0 con 0x5637e7ad2c50 2024-04-25T09:57:57.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.933+0000 7f0ae27fc640 10 client.6555 handle_command_reply: tid=0 2024-04-25T09:57:57.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.933+0000 7f0b0ca74740 1 client.6555 shutdown 2024-04-25T09:57:57.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.933+0000 7f0b0ca74740 1 -- 172.21.15.7:0/3490443828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5637e7acfc60 msgr2=0x5637e7abf880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:57.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.933+0000 7f0b0ca74740 1 --2- 172.21.15.7:0/3490443828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5637e7acfc60 0x5637e7abf880 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f0afc0093e0 tx=0x7f0afc02c000 comp rx=0 tx=0).stop 2024-04-25T09:57:57.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.933+0000 7f0b0ca74740 1 -- 172.21.15.7:0/3490443828 shutdown_connections 2024-04-25T09:57:57.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.933+0000 7f0b0ca74740 1 --2- 172.21.15.7:0/3490443828 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5637e7ad2c50 0x5637e7b42cc0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.933+0000 7f0b0ca74740 1 --2- 172.21.15.7:0/3490443828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5637e7acfc60 0x5637e7abf880 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.933+0000 7f0b0ca74740 1 --2- 172.21.15.7:0/3490443828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637e7abe050 0x5637e7abf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.933+0000 7f0ae27fc640 0 client.6555 ms_handle_reset on v2:172.21.15.7:6834/3057688863 2024-04-25T09:57:57.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.933+0000 7f0b0ca74740 1 --2- 172.21.15.7:0/3490443828 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5637e7a93590 0x5637e7ae91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.933+0000 7f0b0ca74740 1 -- 172.21.15.7:0/3490443828 >> 172.21.15.7:0/3490443828 conn(0x5637e7a5b6e0 msgr2=0x5637e7a91350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:57.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.933+0000 7f0b0ca74740 1 -- 172.21.15.7:0/3490443828 shutdown_connections 2024-04-25T09:57:57.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.933+0000 7f0b0ca74740 1 -- 172.21.15.7:0/3490443828 wait complete. 2024-04-25T09:57:57.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.934+0000 7f0b0ca74740 20 client.6555 trim_cache size 0 max 16384 2024-04-25T09:57:57.942 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:57:57.943 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2024-04-25T09:57:57.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:57:57.943 INFO:teuthology.orchestra.run.smithi007.stdout: "damage_type": "backtrace", 2024-04-25T09:57:57.943 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 1011227148, 2024-04-25T09:57:57.943 INFO:teuthology.orchestra.run.smithi007.stdout: "ino": 1099511627777, 2024-04-25T09:57:57.943 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/dir_test/file" 2024-04-25T09:57:57.943 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:57:57.943 INFO:teuthology.orchestra.run.smithi007.stdout:] 2024-04-25T09:57:57.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.934+0000 7f0b09d6a640 1 -- 172.21.15.7:0/3034269952 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0af006b4d0 msgr2=0x7f0af006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:57.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.934+0000 7f0b09d6a640 1 --2- 172.21.15.7:0/3034269952 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0af006b4d0 0x7f0af006d990 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0b041601b0 tx=0x7f0af8009040 comp rx=0 tx=0).stop 2024-04-25T09:57:57.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.934+0000 7f0b09d6a640 1 -- 172.21.15.7:0/3034269952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b040b29c0 msgr2=0x7f0b040ca110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:57.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.934+0000 7f0b09d6a640 1 --2- 172.21.15.7:0/3034269952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b040b29c0 0x7f0b040ca110 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f0af400c820 tx=0x7f0af400cce0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.934+0000 7f0b09d6a640 1 -- 172.21.15.7:0/3034269952 shutdown_connections 2024-04-25T09:57:57.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.934+0000 7f0b09d6a640 1 --2- 172.21.15.7:0/3034269952 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0af006b4d0 0x7f0af006d990 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.934+0000 7f0b09d6a640 1 --2- 172.21.15.7:0/3034269952 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b0415d990 0x7f0b0415f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.934+0000 7f0b09d6a640 1 --2- 172.21.15.7:0/3034269952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b040d1c90 0x7f0b040b6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.934+0000 7f0b09d6a640 1 --2- 172.21.15.7:0/3034269952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b040b29c0 0x7f0b040ca110 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:57.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.934+0000 7f0b09d6a640 1 -- 172.21.15.7:0/3034269952 >> 172.21.15.7:0/3034269952 conn(0x7f0b0408af80 msgr2=0x7f0b040cdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:57.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.934+0000 7f0b09d6a640 1 -- 172.21.15.7:0/3034269952 shutdown_connections 2024-04-25T09:57:57.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:57.934+0000 7f0b09d6a640 1 -- 172.21.15.7:0/3034269952 wait complete. 2024-04-25T09:57:57.948 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T09:57:58.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.044+0000 7fe373be2640 1 Processor -- start 2024-04-25T09:57:58.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.044+0000 7fe373be2640 1 -- start start 2024-04-25T09:57:58.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.045+0000 7fe373be2640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe36c15dad0 0x7fe36c0d18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.045+0000 7fe373be2640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe36c0b9580 0x7fe36c0d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.045+0000 7fe373be2640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe36c0d2240 con 0x7fe36c0d32e0 2024-04-25T09:57:58.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.045+0000 7fe373be2640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe36c0b7990 con 0x7fe36c0b9580 2024-04-25T09:57:58.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.045+0000 7fe373be2640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c0d2520 con 0x7fe36c15dad0 2024-04-25T09:57:58.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.045+0000 7fe37117d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe36c0b9580 0x7fe36c0d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.045+0000 7fe37117d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe36c0b9580 0x7fe36c0d0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53074/0 (socket says 172.21.15.7:53074) 2024-04-25T09:57:58.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.045+0000 7fe37217f640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe36c0d32e0 0x7fe36c0b52d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52172/0 (socket says 172.21.15.7:52172) 2024-04-25T09:57:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.045+0000 7fe37117d640 1 -- 172.21.15.7:0/1994935693 learned_addr learned my addr 172.21.15.7:0/1994935693 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.045+0000 7fe37197e640 1 --2- 172.21.15.7:0/1994935693 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe36c15dad0 0x7fe36c0d18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.045+0000 7fe37117d640 1 -- 172.21.15.7:0/1994935693 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe36c15dad0 msgr2=0x7fe36c0d18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.045+0000 7fe37117d640 1 --2- 172.21.15.7:0/1994935693 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe36c15dad0 0x7fe36c0d18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.045+0000 7fe37117d640 1 -- 172.21.15.7:0/1994935693 >> v1:172.21.15.7:6789/0 conn(0x7fe36c0d32e0 legacy=0x7fe36c0b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.045+0000 7fe37097c640 1 -- 172.21.15.7:0/1994935693 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2890578782 0 0) 0x7fe36c0d2240 con 0x7fe36c0d32e0 2024-04-25T09:57:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.045+0000 7fe37117d640 1 -- 172.21.15.7:0/1994935693 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36c0d2800 con 0x7fe36c0b9580 2024-04-25T09:57:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.046+0000 7fe37117d640 1 --2- 172.21.15.7:0/1994935693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe36c0b9580 0x7fe36c0d0240 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fe360009870 tx=0x7fe36002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d3872a654fcb741 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.046+0000 7fe37097c640 1 -- 172.21.15.7:0/1994935693 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe360037070 con 0x7fe36c0b9580 2024-04-25T09:57:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.046+0000 7fe37097c640 1 -- 172.21.15.7:0/1994935693 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36002ae50 con 0x7fe36c0b9580 2024-04-25T09:57:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.046+0000 7fe37097c640 1 -- 172.21.15.7:0/1994935693 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe360032860 con 0x7fe36c0b9580 2024-04-25T09:57:58.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.047+0000 7fe373be2640 1 -- 172.21.15.7:0/1994935693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe36c0b9580 msgr2=0x7fe36c0d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.047+0000 7fe373be2640 1 --2- 172.21.15.7:0/1994935693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe36c0b9580 0x7fe36c0d0240 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fe360009870 tx=0x7fe36002a300 comp rx=0 tx=0).stop 2024-04-25T09:57:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.047+0000 7fe373be2640 1 -- 172.21.15.7:0/1994935693 shutdown_connections 2024-04-25T09:57:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.047+0000 7fe373be2640 1 --2- 172.21.15.7:0/1994935693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe36c0b9580 0x7fe36c0d0240 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.047+0000 7fe373be2640 1 --2- 172.21.15.7:0/1994935693 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe36c15dad0 0x7fe36c0d18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.047+0000 7fe373be2640 1 -- 172.21.15.7:0/1994935693 >> 172.21.15.7:0/1994935693 conn(0x7fe36c06bfe0 msgr2=0x7fe36c06c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.047+0000 7fe373be2640 1 -- 172.21.15.7:0/1994935693 shutdown_connections 2024-04-25T09:57:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.047+0000 7fe373be2640 1 -- 172.21.15.7:0/1994935693 wait complete. 2024-04-25T09:57:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.048+0000 7fe373be2640 1 Processor -- start 2024-04-25T09:57:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.048+0000 7fe373be2640 1 -- start start 2024-04-25T09:57:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.049+0000 7fe373be2640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe36c0b9580 0x7fe36c14d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.049+0000 7fe373be2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe36c0d32e0 0x7fe36c159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.049+0000 7fe373be2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe36c15dad0 0x7fe36c1508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.049+0000 7fe373be2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c15deb0 con 0x7fe36c15dad0 2024-04-25T09:57:58.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.049+0000 7fe373be2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c0d2dc0 con 0x7fe36c0d32e0 2024-04-25T09:57:58.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.049+0000 7fe373be2640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c15a2c0 con 0x7fe36c0b9580 2024-04-25T09:57:58.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.049+0000 7fe37217f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe36c15dad0 0x7fe36c1508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.049+0000 7fe37217f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe36c15dad0 0x7fe36c1508e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53080/0 (socket says 172.21.15.7:53080) 2024-04-25T09:57:58.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.049+0000 7fe37217f640 1 -- 172.21.15.7:0/1671600494 learned_addr learned my addr 172.21.15.7:0/1671600494 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:58.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.049+0000 7fe37197e640 1 --2- 172.21.15.7:0/1671600494 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe36c0b9580 0x7fe36c14d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.049+0000 7fe37117d640 1 --2- 172.21.15.7:0/1671600494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe36c0d32e0 0x7fe36c159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.049+0000 7fe37217f640 1 -- 172.21.15.7:0/1671600494 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe36c0b9580 msgr2=0x7fe36c14d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:58.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.049+0000 7fe37217f640 1 --2- 172.21.15.7:0/1671600494 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe36c0b9580 0x7fe36c14d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.049+0000 7fe37217f640 1 -- 172.21.15.7:0/1671600494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe36c0d32e0 msgr2=0x7fe36c159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:58.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.049+0000 7fe37217f640 1 --2- 172.21.15.7:0/1671600494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe36c0d32e0 0x7fe36c159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.049+0000 7fe37217f640 1 -- 172.21.15.7:0/1671600494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36c15a5a0 con 0x7fe36c15dad0 2024-04-25T09:57:58.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.049+0000 7fe37217f640 1 --2- 172.21.15.7:0/1671600494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe36c15dad0 0x7fe36c1508e0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fe35c00c7a0 tx=0x7fe35c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:58.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.050+0000 7fe36a7fc640 1 -- 172.21.15.7:0/1671600494 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35c018070 con 0x7fe36c15dad0 2024-04-25T09:57:58.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.050+0000 7fe36a7fc640 1 -- 172.21.15.7:0/1671600494 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe35c00a640 con 0x7fe36c15dad0 2024-04-25T09:57:58.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.050+0000 7fe36a7fc640 1 -- 172.21.15.7:0/1671600494 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35c00aab0 con 0x7fe36c15dad0 2024-04-25T09:57:58.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.050+0000 7fe373be2640 1 -- 172.21.15.7:0/1671600494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe36c15a880 con 0x7fe36c15dad0 2024-04-25T09:57:58.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.050+0000 7fe373be2640 1 -- 172.21.15.7:0/1671600494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe36c15b360 con 0x7fe36c15dad0 2024-04-25T09:57:58.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.051+0000 7fe373be2640 1 -- 172.21.15.7:0/1671600494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe36c074bb0 con 0x7fe36c15dad0 2024-04-25T09:57:58.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.051+0000 7fe36a7fc640 1 -- 172.21.15.7:0/1671600494 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe35c01b070 con 0x7fe36c15dad0 2024-04-25T09:57:58.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.052+0000 7fe36a7fc640 1 --2- 172.21.15.7:0/1671600494 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe35806b500 0x7fe35806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.052+0000 7fe36a7fc640 1 -- 172.21.15.7:0/1671600494 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe35c0898e0 con 0x7fe36c15dad0 2024-04-25T09:57:58.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.052+0000 7fe37197e640 1 --2- 172.21.15.7:0/1671600494 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe35806b500 0x7fe35806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.052+0000 7fe37197e640 1 --2- 172.21.15.7:0/1671600494 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe35806b500 0x7fe35806d9c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe364009aa0 tx=0x7fe364009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:58.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.056+0000 7fe36a7fc640 1 -- 172.21.15.7:0/1671600494 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe35c057f80 con 0x7fe36c15dad0 2024-04-25T09:57:58.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.274+0000 7fe373be2640 1 -- 172.21.15.7:0/1671600494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe36c151480 con 0x7fe36c15dad0 2024-04-25T09:57:58.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.274+0000 7fe36a7fc640 1 -- 172.21.15.7:0/1671600494 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7fe35c05c020 con 0x7fe36c15dad0 2024-04-25T09:57:58.278 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:57:58.279 INFO:teuthology.orchestra.run.smithi007.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-04-25T09:57:58.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.276+0000 7fe373be2640 1 -- 172.21.15.7:0/1671600494 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe35806b500 msgr2=0x7fe35806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:58.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.276+0000 7fe373be2640 1 --2- 172.21.15.7:0/1671600494 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe35806b500 0x7fe35806d9c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe364009aa0 tx=0x7fe364009190 comp rx=0 tx=0).stop 2024-04-25T09:57:58.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.276+0000 7fe373be2640 1 -- 172.21.15.7:0/1671600494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe36c15dad0 msgr2=0x7fe36c1508e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:58.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.276+0000 7fe373be2640 1 --2- 172.21.15.7:0/1671600494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe36c15dad0 0x7fe36c1508e0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fe35c00c7a0 tx=0x7fe35c00cc60 comp rx=0 tx=0).stop 2024-04-25T09:57:58.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.276+0000 7fe373be2640 1 -- 172.21.15.7:0/1671600494 shutdown_connections 2024-04-25T09:57:58.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.276+0000 7fe373be2640 1 --2- 172.21.15.7:0/1671600494 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe35806b500 0x7fe35806d9c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.276+0000 7fe373be2640 1 --2- 172.21.15.7:0/1671600494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe36c15dad0 0x7fe36c1508e0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.276+0000 7fe373be2640 1 --2- 172.21.15.7:0/1671600494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe36c0d32e0 0x7fe36c159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.276+0000 7fe373be2640 1 --2- 172.21.15.7:0/1671600494 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe36c0b9580 0x7fe36c14d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.276+0000 7fe373be2640 1 -- 172.21.15.7:0/1671600494 >> 172.21.15.7:0/1671600494 conn(0x7fe36c06bfe0 msgr2=0x7fe36c0d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:58.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.276+0000 7fe373be2640 1 -- 172.21.15.7:0/1671600494 shutdown_connections 2024-04-25T09:57:58.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.276+0000 7fe373be2640 1 -- 172.21.15.7:0/1671600494 wait complete. 2024-04-25T09:57:58.291 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T09:57:58.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:57:58.291 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start / repair,recursive,force 2024-04-25T09:57:58.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.392+0000 7f13561e0640 1 Processor -- start 2024-04-25T09:57:58.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.392+0000 7f13561e0640 1 -- start start 2024-04-25T09:57:58.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.393+0000 7f13561e0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1350161520 0x7f13500d1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.393+0000 7f13561e0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f13500d1f80 0x7f135015e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.393+0000 7f13561e0640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1350162450 con 0x7f135015d980 2024-04-25T09:57:58.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.393+0000 7f13561e0640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1350161bb0 con 0x7f13500d1f80 2024-04-25T09:57:58.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.393+0000 7f13561e0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1350161e90 con 0x7f1350161520 2024-04-25T09:57:58.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.393+0000 7f134ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f13500d1f80 0x7f135015e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.393+0000 7f134effd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1350161520 0x7f13500d1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.393+0000 7f134f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f135015d980 0x7f13500b9390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:34754/0 (socket says 172.21.15.7:34754) 2024-04-25T09:57:58.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.393+0000 7f134ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f13500d1f80 0x7f135015e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:56496/0 (socket says 172.21.15.7:56496) 2024-04-25T09:57:58.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.393+0000 7f134f7fe640 1 -- 172.21.15.7:0/1587594651 learned_addr learned my addr 172.21.15.7:0/1587594651 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:57:58.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.394+0000 7f134effd640 1 -- 172.21.15.7:0/1587594651 >> v2:172.21.15.55:3300/0 conn(0x7f13500d1f80 msgr2=0x7f135015e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:58.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.394+0000 7f134effd640 1 --2- 172.21.15.7:0/1587594651 >> v2:172.21.15.55:3300/0 conn(0x7f13500d1f80 0x7f135015e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.394+0000 7f134effd640 1 -- 172.21.15.7:0/1587594651 >> v1:172.21.15.55:6789/0 conn(0x7f135015d980 legacy=0x7f13500b9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:58.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.394+0000 7f134effd640 1 -- 172.21.15.7:0/1587594651 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1350162170 con 0x7f1350161520 2024-04-25T09:57:58.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.394+0000 7f134ffff640 1 --2- 172.21.15.7:0/1587594651 >> v2:172.21.15.55:3300/0 conn(0x7f13500d1f80 0x7f135015e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:57:58.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.395+0000 7f134effd640 1 --2- 172.21.15.7:0/1587594651 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1350161520 0x7f13500d1a40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f13440097a0 tx=0x7f134402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdc2b138fafb3be8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:58.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.395+0000 7f134e7fc640 1 -- 172.21.15.7:0/1587594651 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1344037070 con 0x7f1350161520 2024-04-25T09:57:58.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.395+0000 7f134e7fc640 1 -- 172.21.15.7:0/1587594651 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1344032440 con 0x7f1350161520 2024-04-25T09:57:58.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.395+0000 7f134e7fc640 1 -- 172.21.15.7:0/1587594651 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1344032810 con 0x7f1350161520 2024-04-25T09:57:58.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.395+0000 7f13561e0640 1 -- 172.21.15.7:0/1587594651 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1350161520 msgr2=0x7f13500d1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:58.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.395+0000 7f13561e0640 1 --2- 172.21.15.7:0/1587594651 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1350161520 0x7f13500d1a40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f13440097a0 tx=0x7f134402a180 comp rx=0 tx=0).stop 2024-04-25T09:57:58.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.395+0000 7f13561e0640 1 -- 172.21.15.7:0/1587594651 shutdown_connections 2024-04-25T09:57:58.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.395+0000 7f13561e0640 1 --2- 172.21.15.7:0/1587594651 >> v2:172.21.15.55:3300/0 conn(0x7f13500d1f80 0x7f135015e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.395+0000 7f13561e0640 1 --2- 172.21.15.7:0/1587594651 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1350161520 0x7f13500d1a40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.395+0000 7f13561e0640 1 -- 172.21.15.7:0/1587594651 >> 172.21.15.7:0/1587594651 conn(0x7f135006c3d0 msgr2=0x7f135006c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:58.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.395+0000 7f13561e0640 1 -- 172.21.15.7:0/1587594651 shutdown_connections 2024-04-25T09:57:58.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.395+0000 7f13561e0640 1 -- 172.21.15.7:0/1587594651 wait complete. 2024-04-25T09:57:58.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.396+0000 7f13561e0640 1 Processor -- start 2024-04-25T09:57:58.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.397+0000 7f13561e0640 1 -- start start 2024-04-25T09:57:58.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.397+0000 7f13561e0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13500d1f80 0x7f135014f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.397+0000 7f13561e0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f135015d980 0x7f1350144c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.397+0000 7f13561e0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1350161520 0x7f13501f37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.397+0000 7f13561e0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135015eb30 con 0x7f13500d1f80 2024-04-25T09:57:58.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.397+0000 7f13561e0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135015dd60 con 0x7f135015d980 2024-04-25T09:57:58.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.397+0000 7f13561e0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135015ecb0 con 0x7f1350161520 2024-04-25T09:57:58.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.397+0000 7f134f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13500d1f80 0x7f135014f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.398+0000 7f134f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13500d1f80 0x7f135014f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53084/0 (socket says 172.21.15.7:53084) 2024-04-25T09:57:58.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.398+0000 7f134f7fe640 1 -- 172.21.15.7:0/1062422607 learned_addr learned my addr 172.21.15.7:0/1062422607 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:58.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.398+0000 7f134effd640 1 --2- 172.21.15.7:0/1062422607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f135015d980 0x7f1350144c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.398+0000 7f134ffff640 1 --2- 172.21.15.7:0/1062422607 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1350161520 0x7f13501f37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.398+0000 7f134f7fe640 1 -- 172.21.15.7:0/1062422607 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1350161520 msgr2=0x7f13501f37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:58.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.398+0000 7f134f7fe640 1 --2- 172.21.15.7:0/1062422607 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1350161520 0x7f13501f37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.398+0000 7f134f7fe640 1 -- 172.21.15.7:0/1062422607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f135015d980 msgr2=0x7f1350144c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:58.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.398+0000 7f134f7fe640 1 --2- 172.21.15.7:0/1062422607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f135015d980 0x7f1350144c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.398+0000 7f134f7fe640 1 -- 172.21.15.7:0/1062422607 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13500caf90 con 0x7f13500d1f80 2024-04-25T09:57:58.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.398+0000 7f134f7fe640 1 --2- 172.21.15.7:0/1062422607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13500d1f80 0x7f135014f390 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f134000c400 tx=0x7f134000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:58.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.398+0000 7f1337fff640 1 -- 172.21.15.7:0/1062422607 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1340017070 con 0x7f13500d1f80 2024-04-25T09:57:58.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.398+0000 7f1337fff640 1 -- 172.21.15.7:0/1062422607 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1340005ce0 con 0x7f13500d1f80 2024-04-25T09:57:58.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.398+0000 7f13561e0640 1 -- 172.21.15.7:0/1062422607 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1350152fb0 con 0x7f13500d1f80 2024-04-25T09:57:58.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.398+0000 7f1337fff640 1 -- 172.21.15.7:0/1062422607 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13400072f0 con 0x7f13500d1f80 2024-04-25T09:57:58.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.398+0000 7f13561e0640 1 -- 172.21.15.7:0/1062422607 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135014f040 con 0x7f13500d1f80 2024-04-25T09:57:58.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.400+0000 7f1337fff640 1 -- 172.21.15.7:0/1062422607 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f134001a070 con 0x7f13500d1f80 2024-04-25T09:57:58.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.400+0000 7f1337fff640 1 --2- 172.21.15.7:0/1062422607 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f133c06b4d0 0x7f133c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.400+0000 7f1337fff640 1 -- 172.21.15.7:0/1062422607 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f13400895b0 con 0x7f13500d1f80 2024-04-25T09:57:58.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.400+0000 7f134effd640 1 --2- 172.21.15.7:0/1062422607 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f133c06b4d0 0x7f133c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.401+0000 7f134effd640 1 --2- 172.21.15.7:0/1062422607 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f133c06b4d0 0x7f133c06d990 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1344034000 tx=0x7f134402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:58.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.401+0000 7f1358fbe740 1 Processor -- start 2024-04-25T09:57:58.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.401+0000 7f1358fbe740 1 -- start start 2024-04-25T09:57:58.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.402+0000 7f1358fbe740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5587f06bb710 0x5587f06bdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.402+0000 7f1358fbe740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5587f06bbaf0 0x5587f06be460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.402+0000 7f1358fbe740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5587f068e370 0x5587f0691b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.402+0000 7f1358fbe740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587f05f6bc0 con 0x5587f068e370 2024-04-25T09:57:58.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.402+0000 7f1358fbe740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587f059fe70 con 0x5587f06bbaf0 2024-04-25T09:57:58.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.402+0000 7f1358fbe740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5587f05f2c60 con 0x5587f06bb710 2024-04-25T09:57:58.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.402+0000 7f134ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5587f068e370 0x5587f0691b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.402+0000 7f134ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5587f068e370 0x5587f0691b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53088/0 (socket says 172.21.15.7:53088) 2024-04-25T09:57:58.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.402+0000 7f134ffff640 1 -- 172.21.15.7:0/114193571 learned_addr learned my addr 172.21.15.7:0/114193571 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:58.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.402+0000 7f134f7fe640 1 --2- 172.21.15.7:0/114193571 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5587f06bb710 0x5587f06bdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.402+0000 7f134effd640 1 --2- 172.21.15.7:0/114193571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5587f06bbaf0 0x5587f06be460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.403+0000 7f134ffff640 1 -- 172.21.15.7:0/114193571 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5587f06bb710 msgr2=0x5587f06bdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:58.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.403+0000 7f134ffff640 1 --2- 172.21.15.7:0/114193571 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5587f06bb710 0x5587f06bdf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.403+0000 7f134ffff640 1 -- 172.21.15.7:0/114193571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5587f06bbaf0 msgr2=0x5587f06be460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:58.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.403+0000 7f134ffff640 1 --2- 172.21.15.7:0/114193571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5587f06bbaf0 0x5587f06be460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.403+0000 7f134ffff640 1 -- 172.21.15.7:0/114193571 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587f05c0ad0 con 0x5587f068e370 2024-04-25T09:57:58.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.403+0000 7f134ffff640 1 --2- 172.21.15.7:0/114193571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5587f068e370 0x5587f0691b80 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f1348011580 tx=0x7f1348009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20cd11976b47ff97 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:58.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.403+0000 7f13357fa640 1 -- 172.21.15.7:0/114193571 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348003b90 con 0x5587f068e370 2024-04-25T09:57:58.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.403+0000 7f13357fa640 1 -- 172.21.15.7:0/114193571 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1348003d30 con 0x5587f068e370 2024-04-25T09:57:58.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.403+0000 7f13357fa640 1 -- 172.21.15.7:0/114193571 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348015940 con 0x5587f068e370 2024-04-25T09:57:58.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.404+0000 7f1358fbe740 1 -- 172.21.15.7:0/114193571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5587f068e370 msgr2=0x5587f0691b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:58.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.404+0000 7f1358fbe740 1 --2- 172.21.15.7:0/114193571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5587f068e370 0x5587f0691b80 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f1348011580 tx=0x7f1348009750 comp rx=0 tx=0).stop 2024-04-25T09:57:58.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.404+0000 7f1358fbe740 1 -- 172.21.15.7:0/114193571 shutdown_connections 2024-04-25T09:57:58.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.404+0000 7f1358fbe740 1 --2- 172.21.15.7:0/114193571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5587f068e370 0x5587f0691b80 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.404+0000 7f1358fbe740 1 --2- 172.21.15.7:0/114193571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5587f06bbaf0 0x5587f06be460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.404+0000 7f1358fbe740 1 --2- 172.21.15.7:0/114193571 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5587f06bb710 0x5587f06bdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.404+0000 7f1358fbe740 1 -- 172.21.15.7:0/114193571 >> 172.21.15.7:0/114193571 conn(0x5587f06905e0 msgr2=0x5587f06d8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:58.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.404+0000 7f1358fbe740 1 -- 172.21.15.7:0/114193571 shutdown_connections 2024-04-25T09:57:58.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.404+0000 7f1358fbe740 1 -- 172.21.15.7:0/114193571 wait complete. 2024-04-25T09:57:58.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.404+0000 7f1358fbe740 1 -- start start 2024-04-25T09:57:58.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.404+0000 7f1358fbe740 1 Processor -- start 2024-04-25T09:57:58.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.405+0000 7f1358fbe740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5587f06bb710 0x5587f06dcc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.405+0000 7f1358fbe740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5587f06bbaf0 0x5587f06ba190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.405+0000 7f1358fbe740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5587f06b5380 0x5587f06b6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.405+0000 7f1358fbe740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587f0693790 con 0x5587f06bb710 2024-04-25T09:57:58.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.405+0000 7f1358fbe740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587f05954e0 con 0x5587f06bbaf0 2024-04-25T09:57:58.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.405+0000 7f1358fbe740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5587f0693a70 con 0x5587f06b5380 2024-04-25T09:57:58.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.405+0000 7f1358fbe740 10 client.0 _ll_register_callbacks cb 0x5587f05b2de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:57:58.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.405+0000 7f134f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5587f06bb710 0x5587f06dcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.405+0000 7f134f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5587f06bb710 0x5587f06dcc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53096/0 (socket says 172.21.15.7:53096) 2024-04-25T09:57:58.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.405+0000 7f134f7fe640 1 -- 172.21.15.7:0/2593319523 learned_addr learned my addr 172.21.15.7:0/2593319523 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:58.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.405+0000 7f134effd640 1 --2- 172.21.15.7:0/2593319523 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5587f06bbaf0 0x5587f06ba190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.405+0000 7f134ffff640 1 --2- 172.21.15.7:0/2593319523 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5587f06b5380 0x5587f06b6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.405+0000 7f134f7fe640 1 -- 172.21.15.7:0/2593319523 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5587f06b5380 msgr2=0x5587f06b6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:58.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.405+0000 7f134f7fe640 1 --2- 172.21.15.7:0/2593319523 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5587f06b5380 0x5587f06b6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.405+0000 7f134f7fe640 1 -- 172.21.15.7:0/2593319523 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5587f06bbaf0 msgr2=0x5587f06ba190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:58.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.406+0000 7f134f7fe640 1 --2- 172.21.15.7:0/2593319523 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5587f06bbaf0 0x5587f06ba190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.406+0000 7f134f7fe640 1 -- 172.21.15.7:0/2593319523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5587f03d7940 con 0x5587f06bb710 2024-04-25T09:57:58.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.406+0000 7f134ffff640 1 --2- 172.21.15.7:0/2593319523 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5587f06b5380 0x5587f06b6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:57:58.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.406+0000 7f134f7fe640 1 --2- 172.21.15.7:0/2593319523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5587f06bb710 0x5587f06dcc20 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f1340000fb0 tx=0x7f134005e110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d41af6c11c2a11f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:58.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.406+0000 7f132e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:57:58.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.406+0000 7f132e7fc640 1 -- 172.21.15.7:0/2593319523 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1340007690 con 0x5587f06bb710 2024-04-25T09:57:58.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.406+0000 7f132e7fc640 1 -- 172.21.15.7:0/2593319523 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f13400890f0 con 0x5587f06bb710 2024-04-25T09:57:58.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.406+0000 7f1358fbe740 1 -- 172.21.15.7:0/2593319523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1348003d30 con 0x5587f06bb710 2024-04-25T09:57:58.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.406+0000 7f132e7fc640 1 -- 172.21.15.7:0/2593319523 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1340060340 con 0x5587f06bb710 2024-04-25T09:57:58.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.406+0000 7f1358fbe740 10 client.6573 fetch_fsmap learned FSMap version 29 2024-04-25T09:57:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.406+0000 7f1358fbe740 1 -- 172.21.15.7:0/2593319523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x5587f04380d0 con 0x5587f06bb710 2024-04-25T09:57:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.406+0000 7f132e7fc640 1 -- 172.21.15.7:0/2593319523 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1348003d30 con 0x5587f06bb710 2024-04-25T09:57:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.406+0000 7f132e7fc640 1 -- 172.21.15.7:0/2593319523 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 29) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1340057130 con 0x5587f06bb710 2024-04-25T09:57:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.406+0000 7f1358fbe740 10 client.6573 fetch_fsmap finished waiting for FSMap version 29 2024-04-25T09:57:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.406+0000 7f1358fbe740 10 client.6573 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:57:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.406+0000 7f1358fbe740 20 client.6573 populate_metadata read hostname 'smithi007' 2024-04-25T09:57:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.406+0000 7f1358fbe740 1 --2- 172.21.15.7:0/2593319523 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5587f06b4e30 0x5587f06b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.406+0000 7f1358fbe740 4 client.6573 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:57:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.406+0000 7f1358fbe740 1 -- 172.21.15.7:0/2593319523 --> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5587f0604100 con 0x5587f06b4e30 2024-04-25T09:57:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.406+0000 7f134effd640 1 --2- 172.21.15.7:0/2593319523 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5587f06b4e30 0x5587f06b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.407+0000 7f132e7fc640 10 client.6573 ms_handle_connect on v2:172.21.15.7:6834/3057688863 2024-04-25T09:57:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.407+0000 7f134effd640 1 --2- 172.21.15.7:0/2593319523 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5587f06b4e30 0x5587f06b4270 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ca4d664a15d0dd3 server_cookie=9085e0bcc8b60d6c in_seq=0 out_seq=0 2024-04-25T09:57:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.407+0000 7f132e7fc640 1 -- 172.21.15.7:0/2593319523 <== mds.0 v2:172.21.15.7:6834/3057688863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5587f0604100 con 0x5587f06b4e30 2024-04-25T09:57:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.407+0000 7f132e7fc640 10 client.6573 handle_command_reply: tid=0 2024-04-25T09:57:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.407+0000 7f1358fbe740 1 client.6573 shutdown 2024-04-25T09:57:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.407+0000 7f1358fbe740 1 -- 172.21.15.7:0/2593319523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5587f06bb710 msgr2=0x5587f06dcc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.407+0000 7f1358fbe740 1 --2- 172.21.15.7:0/2593319523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5587f06bb710 0x5587f06dcc20 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f1340000fb0 tx=0x7f134005e110 comp rx=0 tx=0).stop 2024-04-25T09:57:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.407+0000 7f1358fbe740 1 -- 172.21.15.7:0/2593319523 shutdown_connections 2024-04-25T09:57:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.408+0000 7f1358fbe740 1 --2- 172.21.15.7:0/2593319523 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5587f06b4e30 0x5587f06b4270 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.408+0000 7f1358fbe740 1 --2- 172.21.15.7:0/2593319523 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5587f06b5380 0x5587f06b6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.408+0000 7f1358fbe740 1 --2- 172.21.15.7:0/2593319523 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5587f06bbaf0 0x5587f06ba190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.408+0000 7f132e7fc640 0 client.6573 ms_handle_reset on v2:172.21.15.7:6834/3057688863 2024-04-25T09:57:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.408+0000 7f1358fbe740 1 --2- 172.21.15.7:0/2593319523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5587f06bb710 0x5587f06dcc20 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.408+0000 7f1358fbe740 1 -- 172.21.15.7:0/2593319523 >> 172.21.15.7:0/2593319523 conn(0x5587f068e370 msgr2=0x5587f06b5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:58.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.408+0000 7f1358fbe740 1 -- 172.21.15.7:0/2593319523 shutdown_connections 2024-04-25T09:57:58.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.408+0000 7f1358fbe740 1 -- 172.21.15.7:0/2593319523 wait complete. 2024-04-25T09:57:58.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.408+0000 7f1358fbe740 20 client.6573 trim_cache size 0 max 16384 2024-04-25T09:57:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.423+0000 7f1358fbe740 1 Processor -- start 2024-04-25T09:57:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.423+0000 7f1358fbe740 1 -- start start 2024-04-25T09:57:58.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.424+0000 7f1358fbe740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5587f06b5380 0x5587f06b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.424+0000 7f1358fbe740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5587f06bb710 0x5587f06c1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.424+0000 7f1358fbe740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5587f06bbaf0 0x5587f068eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.424+0000 7f1358fbe740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1350200280 con 0x5587f06bb710 2024-04-25T09:57:58.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.424+0000 7f1358fbe740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13501ff420 con 0x5587f06b5380 2024-04-25T09:57:58.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.424+0000 7f1358fbe740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13501527f0 con 0x5587f06bbaf0 2024-04-25T09:57:58.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.424+0000 7f134effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5587f06bb710 0x5587f06c1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.424+0000 7f134effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5587f06bb710 0x5587f06c1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53108/0 (socket says 172.21.15.7:53108) 2024-04-25T09:57:58.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.424+0000 7f134effd640 1 -- 172.21.15.7:0/900711206 learned_addr learned my addr 172.21.15.7:0/900711206 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:58.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.424+0000 7f134f7fe640 1 --2- 172.21.15.7:0/900711206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5587f06b5380 0x5587f06b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.424+0000 7f134ffff640 1 --2- 172.21.15.7:0/900711206 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5587f06bbaf0 0x5587f068eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.424+0000 7f134effd640 1 -- 172.21.15.7:0/900711206 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5587f06bbaf0 msgr2=0x5587f068eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:58.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.424+0000 7f134effd640 1 --2- 172.21.15.7:0/900711206 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5587f06bbaf0 0x5587f068eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.424+0000 7f134effd640 1 -- 172.21.15.7:0/900711206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5587f06b5380 msgr2=0x5587f06b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:58.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.424+0000 7f134effd640 1 --2- 172.21.15.7:0/900711206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5587f06b5380 0x5587f06b46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.424+0000 7f134effd640 1 -- 172.21.15.7:0/900711206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587f02cb230 con 0x5587f06bb710 2024-04-25T09:57:58.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.424+0000 7f134f7fe640 1 --2- 172.21.15.7:0/900711206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5587f06b5380 0x5587f06b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:57:58.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.424+0000 7f134effd640 1 --2- 172.21.15.7:0/900711206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5587f06bb710 0x5587f06c1690 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f134402a770 tx=0x7f134402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82820e9ac7139992 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:58.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.425+0000 7f1334ff9640 1 -- 172.21.15.7:0/900711206 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1344054070 con 0x5587f06bb710 2024-04-25T09:57:58.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.425+0000 7f1334ff9640 1 -- 172.21.15.7:0/900711206 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1344050dc0 con 0x5587f06bb710 2024-04-25T09:57:58.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.425+0000 7f1334ff9640 1 -- 172.21.15.7:0/900711206 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1344037040 con 0x5587f06bb710 2024-04-25T09:57:58.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.425+0000 7f1358fbe740 1 -- 172.21.15.7:0/900711206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5587f06bb710 msgr2=0x5587f06c1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:58.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.425+0000 7f1358fbe740 1 --2- 172.21.15.7:0/900711206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5587f06bb710 0x5587f06c1690 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f134402a770 tx=0x7f134402c000 comp rx=0 tx=0).stop 2024-04-25T09:57:58.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.425+0000 7f1358fbe740 1 -- 172.21.15.7:0/900711206 shutdown_connections 2024-04-25T09:57:58.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.425+0000 7f1358fbe740 1 --2- 172.21.15.7:0/900711206 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5587f06bbaf0 0x5587f068eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.425+0000 7f1358fbe740 1 --2- 172.21.15.7:0/900711206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5587f06bb710 0x5587f06c1690 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.425+0000 7f1358fbe740 1 --2- 172.21.15.7:0/900711206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5587f06b5380 0x5587f06b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.425+0000 7f1358fbe740 1 -- 172.21.15.7:0/900711206 >> 172.21.15.7:0/900711206 conn(0x5587f068e370 msgr2=0x5587f06b9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:58.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.425+0000 7f1358fbe740 1 -- 172.21.15.7:0/900711206 shutdown_connections 2024-04-25T09:57:58.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.425+0000 7f1358fbe740 1 -- 172.21.15.7:0/900711206 wait complete. 2024-04-25T09:57:58.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.426+0000 7f1358fbe740 1 -- start start 2024-04-25T09:57:58.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.426+0000 7f1358fbe740 1 Processor -- start 2024-04-25T09:57:58.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.427+0000 7f1358fbe740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5587f06b5380 0x5587f0746c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.427+0000 7f1358fbe740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5587f06bb710 0x5587f068ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.427+0000 7f1358fbe740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5587f06bbaf0 0x5587f068efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.427+0000 7f1358fbe740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587f06ba5d0 con 0x5587f06bbaf0 2024-04-25T09:57:58.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.427+0000 7f1358fbe740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1350152df0 con 0x5587f06bb710 2024-04-25T09:57:58.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.427+0000 7f1358fbe740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5587f06d3150 con 0x5587f06b5380 2024-04-25T09:57:58.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.427+0000 7f1358fbe740 10 client.0 _ll_register_callbacks cb 0x7f1340005ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:57:58.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.427+0000 7f134ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5587f06bbaf0 0x5587f068efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.427+0000 7f134ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5587f06bbaf0 0x5587f068efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53110/0 (socket says 172.21.15.7:53110) 2024-04-25T09:57:58.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.427+0000 7f134ffff640 1 -- 172.21.15.7:0/507408163 learned_addr learned my addr 172.21.15.7:0/507408163 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:58.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.427+0000 7f134f7fe640 1 --2- 172.21.15.7:0/507408163 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5587f06b5380 0x5587f0746c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.427+0000 7f134effd640 1 --2- 172.21.15.7:0/507408163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5587f06bb710 0x5587f068ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.427+0000 7f134ffff640 1 -- 172.21.15.7:0/507408163 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5587f06b5380 msgr2=0x5587f0746c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:58.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.427+0000 7f134ffff640 1 --2- 172.21.15.7:0/507408163 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5587f06b5380 0x5587f0746c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.427+0000 7f134ffff640 1 -- 172.21.15.7:0/507408163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5587f06bb710 msgr2=0x5587f068ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:58.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.427+0000 7f134ffff640 1 --2- 172.21.15.7:0/507408163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5587f06bb710 0x5587f068ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.427+0000 7f134ffff640 1 -- 172.21.15.7:0/507408163 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5587f06ebc10 con 0x5587f06bbaf0 2024-04-25T09:57:58.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.427+0000 7f134ffff640 1 --2- 172.21.15.7:0/507408163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5587f06bbaf0 0x5587f068efc0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x5587f0695c70 tx=0x7f1348004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51efcc43e4d9324d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:58.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.427+0000 7f132e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:57:58.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.427+0000 7f132e7fc640 1 -- 172.21.15.7:0/507408163 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348015b10 con 0x5587f06bbaf0 2024-04-25T09:57:58.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.427+0000 7f132e7fc640 1 -- 172.21.15.7:0/507408163 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1348015cb0 con 0x5587f06bbaf0 2024-04-25T09:57:58.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.427+0000 7f1358fbe740 1 -- 172.21.15.7:0/507408163 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1344050dc0 con 0x5587f06bbaf0 2024-04-25T09:57:58.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.428+0000 7f132e7fc640 1 -- 172.21.15.7:0/507408163 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1348031050 con 0x5587f06bbaf0 2024-04-25T09:57:58.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.428+0000 7f1358fbe740 10 client.6579 fetch_fsmap learned FSMap version 29 2024-04-25T09:57:58.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.428+0000 7f1358fbe740 1 -- 172.21.15.7:0/507408163 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x5587f06be650 con 0x5587f06bbaf0 2024-04-25T09:57:58.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.428+0000 7f132e7fc640 1 -- 172.21.15.7:0/507408163 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1344050dc0 con 0x5587f06bbaf0 2024-04-25T09:57:58.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.428+0000 7f132e7fc640 1 -- 172.21.15.7:0/507408163 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 29) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1348034020 con 0x5587f06bbaf0 2024-04-25T09:57:58.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.428+0000 7f1358fbe740 10 client.6579 fetch_fsmap finished waiting for FSMap version 29 2024-04-25T09:57:58.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.428+0000 7f1358fbe740 10 client.6579 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:57:58.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.428+0000 7f1358fbe740 20 client.6579 populate_metadata read hostname 'smithi007' 2024-04-25T09:57:58.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.428+0000 7f1358fbe740 1 --2- 172.21.15.7:0/507408163 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5587f06da050 0x5587f06da460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.428+0000 7f1358fbe740 4 client.6579 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive", "force"]}] 2024-04-25T09:57:58.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.428+0000 7f1358fbe740 1 -- 172.21.15.7:0/507408163 --> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive", "force"]}) v1 -- 0x5587f05fe450 con 0x5587f06da050 2024-04-25T09:57:58.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.428+0000 7f134f7fe640 1 --2- 172.21.15.7:0/507408163 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5587f06da050 0x5587f06da460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.428+0000 7f132e7fc640 10 client.6579 ms_handle_connect on v2:172.21.15.7:6834/3057688863 2024-04-25T09:57:58.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.428+0000 7f134f7fe640 1 --2- 172.21.15.7:0/507408163 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5587f06da050 0x5587f06da460 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1b7842787afd186 server_cookie=bb4c24481a9663c5 in_seq=0 out_seq=0 2024-04-25T09:57:58.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.429+0000 7f132e7fc640 1 -- 172.21.15.7:0/507408163 <== mds.0 v2:172.21.15.7:6834/3057688863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5587f05fe450 con 0x5587f06da050 2024-04-25T09:57:58.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.429+0000 7f132e7fc640 10 client.6579 handle_command_reply: tid=0 2024-04-25T09:57:58.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.429+0000 7f1358fbe740 1 client.6579 shutdown 2024-04-25T09:57:58.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.429+0000 7f1358fbe740 1 -- 172.21.15.7:0/507408163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5587f06bbaf0 msgr2=0x5587f068efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:58.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.429+0000 7f1358fbe740 1 --2- 172.21.15.7:0/507408163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5587f06bbaf0 0x5587f068efc0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x5587f0695c70 tx=0x7f1348004ab0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.429+0000 7f1358fbe740 1 -- 172.21.15.7:0/507408163 shutdown_connections 2024-04-25T09:57:58.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.429+0000 7f1358fbe740 1 --2- 172.21.15.7:0/507408163 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5587f06da050 0x5587f06da460 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.429+0000 7f1358fbe740 1 --2- 172.21.15.7:0/507408163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5587f06bbaf0 0x5587f068efc0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.429+0000 7f1358fbe740 1 --2- 172.21.15.7:0/507408163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5587f06bb710 0x5587f068ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.429+0000 7f1358fbe740 1 --2- 172.21.15.7:0/507408163 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5587f06b5380 0x5587f0746c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.429+0000 7f132e7fc640 0 client.6579 ms_handle_reset on v2:172.21.15.7:6834/3057688863 2024-04-25T09:57:58.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.429+0000 7f1358fbe740 1 -- 172.21.15.7:0/507408163 >> 172.21.15.7:0/507408163 conn(0x5587f068e370 msgr2=0x5587f068d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:58.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.429+0000 7f1358fbe740 1 -- 172.21.15.7:0/507408163 shutdown_connections 2024-04-25T09:57:58.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.429+0000 7f1358fbe740 1 -- 172.21.15.7:0/507408163 wait complete. 2024-04-25T09:57:58.441 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-04-25T09:57:58.429+0000 7f7c1f006640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v4 ap=1 DIRTYPARENT s=0 n(v0 rc2024-04-25T09:57:26.000256+0000 1=1+0) (iversion lock) caps={5929=pAsLsXsFs/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 scrubqueue=0 0x557d03d9fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v4>,<0x1/dir_test v7>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T09:57:58.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.429+0000 7f1358fbe740 20 client.6579 trim_cache size 0 max 16384 2024-04-25T09:57:58.442 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T09:57:58.442 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-04-25T09:57:58.442 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "0541a36f-52a4-4cc6-8e53-6766d8d84fc0", 2024-04-25T09:57:58.442 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-04-25T09:57:58.442 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T09:57:58.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.430+0000 7f13561e0640 1 -- 172.21.15.7:0/1062422607 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f133c06b4d0 msgr2=0x7f133c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:58.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.430+0000 7f13561e0640 1 --2- 172.21.15.7:0/1062422607 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f133c06b4d0 0x7f133c06d990 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1344034000 tx=0x7f134402e000 comp rx=0 tx=0).stop 2024-04-25T09:57:58.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.430+0000 7f13561e0640 1 -- 172.21.15.7:0/1062422607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13500d1f80 msgr2=0x7f135014f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:58.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.430+0000 7f13561e0640 1 --2- 172.21.15.7:0/1062422607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13500d1f80 0x7f135014f390 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f134000c400 tx=0x7f134000c800 comp rx=0 tx=0).stop 2024-04-25T09:57:58.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.430+0000 7f13561e0640 1 -- 172.21.15.7:0/1062422607 shutdown_connections 2024-04-25T09:57:58.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.430+0000 7f13561e0640 1 --2- 172.21.15.7:0/1062422607 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f133c06b4d0 0x7f133c06d990 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.430+0000 7f13561e0640 1 --2- 172.21.15.7:0/1062422607 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1350161520 0x7f13501f37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.430+0000 7f13561e0640 1 --2- 172.21.15.7:0/1062422607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f135015d980 0x7f1350144c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.430+0000 7f13561e0640 1 --2- 172.21.15.7:0/1062422607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13500d1f80 0x7f135014f390 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.430+0000 7f13561e0640 1 -- 172.21.15.7:0/1062422607 >> 172.21.15.7:0/1062422607 conn(0x7f135006c3d0 msgr2=0x7f135015f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:58.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.430+0000 7f13561e0640 1 -- 172.21.15.7:0/1062422607 shutdown_connections 2024-04-25T09:57:58.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.430+0000 7f13561e0640 1 -- 172.21.15.7:0/1062422607 wait complete. 2024-04-25T09:57:58.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:57:58.445 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-25T09:57:58.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.544+0000 7f25ddba5640 1 Processor -- start 2024-04-25T09:57:58.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.544+0000 7f25ddba5640 1 -- start start 2024-04-25T09:57:58.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.545+0000 7f25ddba5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f25d8161200 0x7f25d80cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.545+0000 7f25ddba5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25d80d0a00 0x7f25d809a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.545+0000 7f25ddba5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25d81615e0 con 0x7f25d809a7d0 2024-04-25T09:57:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.545+0000 7f25ddba5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d806c9f0 con 0x7f25d8161200 2024-04-25T09:57:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.545+0000 7f25ddba5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d806ccd0 con 0x7f25d80d0a00 2024-04-25T09:57:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.545+0000 7f25d6ffd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25d80d0a00 0x7f25d809a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.545+0000 7f25d77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f25d8161200 0x7f25d80cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.545+0000 7f25d6ffd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25d80d0a00 0x7f25d809a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:52272/0 (socket says 172.21.15.7:52272) 2024-04-25T09:57:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.545+0000 7f25d6ffd640 1 -- 172.21.15.7:0/1776618984 learned_addr learned my addr 172.21.15.7:0/1776618984 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.546+0000 7f25d77fe640 1 -- 172.21.15.7:0/1776618984 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25d80d0a00 msgr2=0x7f25d809a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:58.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.546+0000 7f25d77fe640 1 --2- 172.21.15.7:0/1776618984 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25d80d0a00 0x7f25d809a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.546+0000 7f25d77fe640 1 -- 172.21.15.7:0/1776618984 >> v1:172.21.15.55:6789/0 conn(0x7f25d809a7d0 legacy=0x7f25d8161830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:58.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.546+0000 7f25d77fe640 1 -- 172.21.15.7:0/1776618984 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d8099a90 con 0x7f25d8161200 2024-04-25T09:57:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.547+0000 7f25d77fe640 1 --2- 172.21.15.7:0/1776618984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25d8161200 0x7f25d80cbd00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f25c80097a0 tx=0x7f25c802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77a0f12a6ff038bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.547+0000 7f25d67fc640 1 -- 172.21.15.7:0/1776618984 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c8037070 con 0x7f25d8161200 2024-04-25T09:57:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.547+0000 7f25d67fc640 1 -- 172.21.15.7:0/1776618984 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c8032440 con 0x7f25d8161200 2024-04-25T09:57:58.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.547+0000 7f25d67fc640 1 -- 172.21.15.7:0/1776618984 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c8032810 con 0x7f25d8161200 2024-04-25T09:57:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.547+0000 7f25ddba5640 1 -- 172.21.15.7:0/1776618984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25d8161200 msgr2=0x7f25d80cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.547+0000 7f25ddba5640 1 --2- 172.21.15.7:0/1776618984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25d8161200 0x7f25d80cbd00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f25c80097a0 tx=0x7f25c802a180 comp rx=0 tx=0).stop 2024-04-25T09:57:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.547+0000 7f25ddba5640 1 -- 172.21.15.7:0/1776618984 shutdown_connections 2024-04-25T09:57:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.547+0000 7f25ddba5640 1 --2- 172.21.15.7:0/1776618984 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25d80d0a00 0x7f25d809a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.547+0000 7f25ddba5640 1 --2- 172.21.15.7:0/1776618984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25d8161200 0x7f25d80cbd00 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.547+0000 7f25ddba5640 1 -- 172.21.15.7:0/1776618984 >> 172.21.15.7:0/1776618984 conn(0x7f25d80b31a0 msgr2=0x7f25d80b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.547+0000 7f25ddba5640 1 -- 172.21.15.7:0/1776618984 shutdown_connections 2024-04-25T09:57:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.547+0000 7f25ddba5640 1 -- 172.21.15.7:0/1776618984 wait complete. 2024-04-25T09:57:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.548+0000 7f25ddba5640 1 Processor -- start 2024-04-25T09:57:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.549+0000 7f25ddba5640 1 -- start start 2024-04-25T09:57:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.549+0000 7f25ddba5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25d809a7d0 0x7f25d81481d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.549+0000 7f25ddba5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25d80d0a00 0x7f25d8148a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.549+0000 7f25ddba5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25d8161200 0x7f25d80ca670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.549+0000 7f25ddba5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d806c680 con 0x7f25d8161200 2024-04-25T09:57:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.549+0000 7f25ddba5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d80cc240 con 0x7f25d809a7d0 2024-04-25T09:57:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.549+0000 7f25ddba5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d806cfb0 con 0x7f25d80d0a00 2024-04-25T09:57:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.549+0000 7f25d7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25d8161200 0x7f25d80ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.550+0000 7f25d7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25d8161200 0x7f25d80ca670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53116/0 (socket says 172.21.15.7:53116) 2024-04-25T09:57:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.550+0000 7f25d7fff640 1 -- 172.21.15.7:0/621697910 learned_addr learned my addr 172.21.15.7:0/621697910 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.550+0000 7f25d6ffd640 1 --2- 172.21.15.7:0/621697910 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25d80d0a00 0x7f25d8148a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.550+0000 7f25d77fe640 1 --2- 172.21.15.7:0/621697910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25d809a7d0 0x7f25d81481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.550+0000 7f25d7fff640 1 -- 172.21.15.7:0/621697910 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25d80d0a00 msgr2=0x7f25d8148a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.550+0000 7f25d7fff640 1 --2- 172.21.15.7:0/621697910 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25d80d0a00 0x7f25d8148a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.550+0000 7f25d7fff640 1 -- 172.21.15.7:0/621697910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25d809a7d0 msgr2=0x7f25d81481d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.550+0000 7f25d7fff640 1 --2- 172.21.15.7:0/621697910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25d809a7d0 0x7f25d81481d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.550+0000 7f25d7fff640 1 -- 172.21.15.7:0/621697910 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d80ca1c0 con 0x7f25d8161200 2024-04-25T09:57:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.550+0000 7f25d7fff640 1 --2- 172.21.15.7:0/621697910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25d8161200 0x7f25d80ca670 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f25d000c6b0 tx=0x7f25d000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:58.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.550+0000 7f25bffff640 1 -- 172.21.15.7:0/621697910 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d0003b70 con 0x7f25d8161200 2024-04-25T09:57:58.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.550+0000 7f25bffff640 1 -- 172.21.15.7:0/621697910 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d0003d30 con 0x7f25d8161200 2024-04-25T09:57:58.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.550+0000 7f25ddba5640 1 -- 172.21.15.7:0/621697910 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d80c5630 con 0x7f25d8161200 2024-04-25T09:57:58.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.550+0000 7f25bffff640 1 -- 172.21.15.7:0/621697910 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d0005310 con 0x7f25d8161200 2024-04-25T09:57:58.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.550+0000 7f25ddba5640 1 -- 172.21.15.7:0/621697910 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d80c8330 con 0x7f25d8161200 2024-04-25T09:57:58.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.552+0000 7f25bffff640 1 -- 172.21.15.7:0/621697910 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f25d00054b0 con 0x7f25d8161200 2024-04-25T09:57:58.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.552+0000 7f25bffff640 1 --2- 172.21.15.7:0/621697910 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f25c406b4d0 0x7f25c406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.552+0000 7f25bffff640 1 -- 172.21.15.7:0/621697910 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f25d008a0c0 con 0x7f25d8161200 2024-04-25T09:57:58.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.552+0000 7f25d77fe640 1 --2- 172.21.15.7:0/621697910 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f25c406b4d0 0x7f25c406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.553+0000 7f25d77fe640 1 --2- 172.21.15.7:0/621697910 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f25c406b4d0 0x7f25c406d990 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f25c8034000 tx=0x7f25c802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:58.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.553+0000 7f25e0983740 1 Processor -- start 2024-04-25T09:57:58.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.553+0000 7f25e0983740 1 -- start start 2024-04-25T09:57:58.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.554+0000 7f25e0983740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be45214b10 0x55be45217320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.554+0000 7f25e0983740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55be45214ef0 0x55be45217860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.554+0000 7f25e0983740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be451e7770 0x55be451eaf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.554+0000 7f25e0983740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be45150da0 con 0x55be45214b10 2024-04-25T09:57:58.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.554+0000 7f25e0983740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be450f9b80 con 0x55be451e7770 2024-04-25T09:57:58.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.554+0000 7f25e0983740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be4514ce40 con 0x55be45214ef0 2024-04-25T09:57:58.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.554+0000 7f25d77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be45214b10 0x55be45217320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.554+0000 7f25d77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be45214b10 0x55be45217320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53128/0 (socket says 172.21.15.7:53128) 2024-04-25T09:57:58.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.554+0000 7f25d77fe640 1 -- 172.21.15.7:0/1644453465 learned_addr learned my addr 172.21.15.7:0/1644453465 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.554+0000 7f25d6ffd640 1 --2- 172.21.15.7:0/1644453465 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55be45214ef0 0x55be45217860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.554+0000 7f25d7fff640 1 --2- 172.21.15.7:0/1644453465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be451e7770 0x55be451eaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.554+0000 7f25d77fe640 1 -- 172.21.15.7:0/1644453465 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55be45214ef0 msgr2=0x55be45217860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.554+0000 7f25d77fe640 1 --2- 172.21.15.7:0/1644453465 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55be45214ef0 0x55be45217860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.554+0000 7f25d77fe640 1 -- 172.21.15.7:0/1644453465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be451e7770 msgr2=0x55be451eaf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.554+0000 7f25d77fe640 1 --2- 172.21.15.7:0/1644453465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be451e7770 0x55be451eaf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.554+0000 7f25d77fe640 1 -- 172.21.15.7:0/1644453465 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be45103f10 con 0x55be45214b10 2024-04-25T09:57:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.554+0000 7f25d7fff640 1 --2- 172.21.15.7:0/1644453465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be451e7770 0x55be451eaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:57:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.555+0000 7f25d77fe640 1 --2- 172.21.15.7:0/1644453465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be45214b10 0x55be45217320 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f25c8035040 tx=0x7f25c802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3860cb85d42123dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.555+0000 7f25bd7fa640 1 -- 172.21.15.7:0/1644453465 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c8037040 con 0x55be45214b10 2024-04-25T09:57:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.555+0000 7f25bd7fa640 1 -- 172.21.15.7:0/1644453465 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c804c070 con 0x55be45214b10 2024-04-25T09:57:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.555+0000 7f25bd7fa640 1 -- 172.21.15.7:0/1644453465 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c8032dc0 con 0x55be45214b10 2024-04-25T09:57:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.555+0000 7f25e0983740 1 -- 172.21.15.7:0/1644453465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be45214b10 msgr2=0x55be45217320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.555+0000 7f25e0983740 1 --2- 172.21.15.7:0/1644453465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be45214b10 0x55be45217320 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f25c8035040 tx=0x7f25c802c000 comp rx=0 tx=0).stop 2024-04-25T09:57:58.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.556+0000 7f25e0983740 1 -- 172.21.15.7:0/1644453465 shutdown_connections 2024-04-25T09:57:58.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.556+0000 7f25e0983740 1 --2- 172.21.15.7:0/1644453465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be451e7770 0x55be451eaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.556+0000 7f25e0983740 1 --2- 172.21.15.7:0/1644453465 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55be45214ef0 0x55be45217860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.556+0000 7f25e0983740 1 --2- 172.21.15.7:0/1644453465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be45214b10 0x55be45217320 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.556+0000 7f25e0983740 1 -- 172.21.15.7:0/1644453465 >> 172.21.15.7:0/1644453465 conn(0x55be451e99e0 msgr2=0x55be45232320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:58.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.556+0000 7f25e0983740 1 -- 172.21.15.7:0/1644453465 shutdown_connections 2024-04-25T09:57:58.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.556+0000 7f25e0983740 1 -- 172.21.15.7:0/1644453465 wait complete. 2024-04-25T09:57:58.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.556+0000 7f25e0983740 1 -- start start 2024-04-25T09:57:58.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.556+0000 7f25e0983740 1 Processor -- start 2024-04-25T09:57:58.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.557+0000 7f25e0983740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be45214b10 0x55be4520abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.557+0000 7f25e0983740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55be45214ef0 0x55be452350b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.557+0000 7f25e0983740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be45245530 0x55be45245970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.557+0000 7f25e0983740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be451ecb90 con 0x55be45214b10 2024-04-25T09:57:58.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.557+0000 7f25e0983740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be450ef4b0 con 0x55be45245530 2024-04-25T09:57:58.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.557+0000 7f25e0983740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be451ece70 con 0x55be45214ef0 2024-04-25T09:57:58.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.557+0000 7f25e0983740 10 client.0 _ll_register_callbacks cb 0x55be4512f180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:57:58.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.557+0000 7f25d77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be45214b10 0x55be4520abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.557+0000 7f25d77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be45214b10 0x55be4520abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53144/0 (socket says 172.21.15.7:53144) 2024-04-25T09:57:58.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.557+0000 7f25d77fe640 1 -- 172.21.15.7:0/4223727840 learned_addr learned my addr 172.21.15.7:0/4223727840 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:58.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.557+0000 7f25d6ffd640 1 --2- 172.21.15.7:0/4223727840 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55be45214ef0 0x55be452350b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.557+0000 7f25d7fff640 1 --2- 172.21.15.7:0/4223727840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be45245530 0x55be45245970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.557+0000 7f25d77fe640 1 -- 172.21.15.7:0/4223727840 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55be45214ef0 msgr2=0x55be452350b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:58.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.557+0000 7f25d77fe640 1 --2- 172.21.15.7:0/4223727840 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55be45214ef0 0x55be452350b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.557+0000 7f25d77fe640 1 -- 172.21.15.7:0/4223727840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be45245530 msgr2=0x55be45245970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:58.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.557+0000 7f25d77fe640 1 --2- 172.21.15.7:0/4223727840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be45245530 0x55be45245970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.557+0000 7f25d77fe640 1 -- 172.21.15.7:0/4223727840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be44f2f7d0 con 0x55be45214b10 2024-04-25T09:57:58.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.557+0000 7f25d7fff640 1 --2- 172.21.15.7:0/4223727840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be45245530 0x55be45245970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:57:58.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.558+0000 7f25d77fe640 1 --2- 172.21.15.7:0/4223727840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be45214b10 0x55be4520abf0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f25c80098c0 tx=0x7f25c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7228e397ec8cbb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:58.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.558+0000 7f25b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:57:58.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.558+0000 7f25b67fc640 1 -- 172.21.15.7:0/4223727840 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c8037040 con 0x55be45214b10 2024-04-25T09:57:58.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.558+0000 7f25b67fc640 1 -- 172.21.15.7:0/4223727840 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f25c803c990 con 0x55be45214b10 2024-04-25T09:57:58.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.558+0000 7f25e0983740 1 -- 172.21.15.7:0/4223727840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f25c804c070 con 0x55be45214b10 2024-04-25T09:57:58.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.558+0000 7f25b67fc640 1 -- 172.21.15.7:0/4223727840 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25c805e050 con 0x55be45214b10 2024-04-25T09:57:58.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.558+0000 7f25e0983740 10 client.6588 fetch_fsmap learned FSMap version 29 2024-04-25T09:57:58.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.558+0000 7f25e0983740 1 -- 172.21.15.7:0/4223727840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x55be44e653f0 con 0x55be45214b10 2024-04-25T09:57:58.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.558+0000 7f25b67fc640 1 -- 172.21.15.7:0/4223727840 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c804c070 con 0x55be45214b10 2024-04-25T09:57:58.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.558+0000 7f25b67fc640 1 -- 172.21.15.7:0/4223727840 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 29) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f25c8061020 con 0x55be45214b10 2024-04-25T09:57:58.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.558+0000 7f25e0983740 10 client.6588 fetch_fsmap finished waiting for FSMap version 29 2024-04-25T09:57:58.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.558+0000 7f25e0983740 10 client.6588 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:57:58.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.558+0000 7f25e0983740 20 client.6588 populate_metadata read hostname 'smithi007' 2024-04-25T09:57:58.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.558+0000 7f25e0983740 1 --2- 172.21.15.7:0/4223727840 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x55be45233450 0x55be45233830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.558+0000 7f25e0983740 4 client.6588 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:57:58.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.558+0000 7f25e0983740 1 -- 172.21.15.7:0/4223727840 --> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55be4515e2e0 con 0x55be45233450 2024-04-25T09:57:58.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.558+0000 7f25d6ffd640 1 --2- 172.21.15.7:0/4223727840 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x55be45233450 0x55be45233830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.559+0000 7f25b67fc640 10 client.6588 ms_handle_connect on v2:172.21.15.7:6834/3057688863 2024-04-25T09:57:58.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.559+0000 7f25d6ffd640 1 --2- 172.21.15.7:0/4223727840 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x55be45233450 0x55be45233830 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84b28c10394b0048 server_cookie=1c2389d9d1d0c588 in_seq=0 out_seq=0 2024-04-25T09:57:58.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.559+0000 7f25b67fc640 1 -- 172.21.15.7:0/4223727840 <== mds.0 v2:172.21.15.7:6834/3057688863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55be4515e2e0 con 0x55be45233450 2024-04-25T09:57:58.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.559+0000 7f25b67fc640 10 client.6588 handle_command_reply: tid=0 2024-04-25T09:57:58.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.559+0000 7f25e0983740 1 client.6588 shutdown 2024-04-25T09:57:58.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.559+0000 7f25e0983740 1 -- 172.21.15.7:0/4223727840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be45214b10 msgr2=0x55be4520abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:58.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.559+0000 7f25e0983740 1 --2- 172.21.15.7:0/4223727840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be45214b10 0x55be4520abf0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f25c80098c0 tx=0x7f25c8004730 comp rx=0 tx=0).stop 2024-04-25T09:57:58.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.559+0000 7f25e0983740 1 -- 172.21.15.7:0/4223727840 shutdown_connections 2024-04-25T09:57:58.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.559+0000 7f25e0983740 1 --2- 172.21.15.7:0/4223727840 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x55be45233450 0x55be45233830 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.559+0000 7f25e0983740 1 --2- 172.21.15.7:0/4223727840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be45245530 0x55be45245970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.559+0000 7f25e0983740 1 --2- 172.21.15.7:0/4223727840 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55be45214ef0 0x55be452350b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.559+0000 7f25e0983740 1 --2- 172.21.15.7:0/4223727840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be45214b10 0x55be4520abf0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.559+0000 7f25b67fc640 0 client.6588 ms_handle_reset on v2:172.21.15.7:6834/3057688863 2024-04-25T09:57:58.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.559+0000 7f25e0983740 1 -- 172.21.15.7:0/4223727840 >> 172.21.15.7:0/4223727840 conn(0x55be451e7770 msgr2=0x55be451e8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:58.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.559+0000 7f25e0983740 1 -- 172.21.15.7:0/4223727840 shutdown_connections 2024-04-25T09:57:58.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.559+0000 7f25e0983740 1 -- 172.21.15.7:0/4223727840 wait complete. 2024-04-25T09:57:58.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.560+0000 7f25e0983740 20 client.6588 trim_cache size 0 max 16384 2024-04-25T09:57:58.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.575+0000 7f25e0983740 1 Processor -- start 2024-04-25T09:57:58.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.575+0000 7f25e0983740 1 -- start start 2024-04-25T09:57:58.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.576+0000 7f25e0983740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55be45214b10 0x55be4520b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.576+0000 7f25e0983740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be45214ef0 0x55be4520b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.576+0000 7f25e0983740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be45245530 0x55be45232320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.576+0000 7f25e0983740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d8200490 con 0x55be45245530 2024-04-25T09:57:58.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.576+0000 7f25e0983740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d81ff630 con 0x55be45214ef0 2024-04-25T09:57:58.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.576+0000 7f25e0983740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d80c7920 con 0x55be45214b10 2024-04-25T09:57:58.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.576+0000 7f25d7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be45245530 0x55be45232320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.576+0000 7f25d7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be45245530 0x55be45232320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53146/0 (socket says 172.21.15.7:53146) 2024-04-25T09:57:58.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.576+0000 7f25d7fff640 1 -- 172.21.15.7:0/253606012 learned_addr learned my addr 172.21.15.7:0/253606012 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:58.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.576+0000 7f25d6ffd640 1 --2- 172.21.15.7:0/253606012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be45214ef0 0x55be4520b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.576+0000 7f25d77fe640 1 --2- 172.21.15.7:0/253606012 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55be45214b10 0x55be4520b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.576+0000 7f25d7fff640 1 -- 172.21.15.7:0/253606012 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55be45214b10 msgr2=0x55be4520b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:58.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.576+0000 7f25d7fff640 1 --2- 172.21.15.7:0/253606012 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55be45214b10 0x55be4520b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.576+0000 7f25d7fff640 1 -- 172.21.15.7:0/253606012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be45214ef0 msgr2=0x55be4520b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:58.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.576+0000 7f25d7fff640 1 --2- 172.21.15.7:0/253606012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be45214ef0 0x55be4520b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.576+0000 7f25d7fff640 1 -- 172.21.15.7:0/253606012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be4522f7d0 con 0x55be45245530 2024-04-25T09:57:58.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.576+0000 7f25d7fff640 1 --2- 172.21.15.7:0/253606012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be45245530 0x55be45232320 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f25d000cfd0 tx=0x7f25d0058750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b926b012d14b699a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:58.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.576+0000 7f25bcff9640 1 -- 172.21.15.7:0/253606012 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d0086070 con 0x55be45245530 2024-04-25T09:57:58.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.576+0000 7f25bcff9640 1 -- 172.21.15.7:0/253606012 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d0060db0 con 0x55be45245530 2024-04-25T09:57:58.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.576+0000 7f25bcff9640 1 -- 172.21.15.7:0/253606012 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d0070030 con 0x55be45245530 2024-04-25T09:57:58.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.577+0000 7f25e0983740 1 -- 172.21.15.7:0/253606012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be45245530 msgr2=0x55be45232320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:58.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.577+0000 7f25e0983740 1 --2- 172.21.15.7:0/253606012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be45245530 0x55be45232320 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f25d000cfd0 tx=0x7f25d0058750 comp rx=0 tx=0).stop 2024-04-25T09:57:58.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.577+0000 7f25e0983740 1 -- 172.21.15.7:0/253606012 shutdown_connections 2024-04-25T09:57:58.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.577+0000 7f25e0983740 1 --2- 172.21.15.7:0/253606012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be45245530 0x55be45232320 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.577+0000 7f25e0983740 1 --2- 172.21.15.7:0/253606012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be45214ef0 0x55be4520b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.577+0000 7f25e0983740 1 --2- 172.21.15.7:0/253606012 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55be45214b10 0x55be4520b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.577+0000 7f25e0983740 1 -- 172.21.15.7:0/253606012 >> 172.21.15.7:0/253606012 conn(0x55be451e7770 msgr2=0x55be451e8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:58.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.577+0000 7f25e0983740 1 -- 172.21.15.7:0/253606012 shutdown_connections 2024-04-25T09:57:58.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.577+0000 7f25e0983740 1 -- 172.21.15.7:0/253606012 wait complete. 2024-04-25T09:57:58.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.578+0000 7f25e0983740 1 -- start start 2024-04-25T09:57:58.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.578+0000 7f25e0983740 1 Processor -- start 2024-04-25T09:57:58.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.578+0000 7f25e0983740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55be45214b10 0x55be452281e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.578+0000 7f25e0983740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be45214ef0 0x55be451ec440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.578+0000 7f25e0983740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be45245530 0x55be4520b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.578+0000 7f25e0983740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d81ff150 con 0x55be45214ef0 2024-04-25T09:57:58.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.578+0000 7f25e0983740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be451e2c80 con 0x55be45245530 2024-04-25T09:57:58.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.578+0000 7f25e0983740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be45239c40 con 0x55be45214b10 2024-04-25T09:57:58.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.579+0000 7f25e0983740 10 client.0 _ll_register_callbacks cb 0x7f25cc0090e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:57:58.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.579+0000 7f25d6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be45214ef0 0x55be451ec440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.579+0000 7f25d6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be45214ef0 0x55be451ec440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53162/0 (socket says 172.21.15.7:53162) 2024-04-25T09:57:58.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.579+0000 7f25d6ffd640 1 -- 172.21.15.7:0/1256252760 learned_addr learned my addr 172.21.15.7:0/1256252760 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:57:58.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.579+0000 7f25d7fff640 1 --2- 172.21.15.7:0/1256252760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be45245530 0x55be4520b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.579+0000 7f25d77fe640 1 --2- 172.21.15.7:0/1256252760 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55be45214b10 0x55be452281e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.579+0000 7f25d6ffd640 1 -- 172.21.15.7:0/1256252760 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55be45214b10 msgr2=0x55be452281e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:58.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.579+0000 7f25d6ffd640 1 --2- 172.21.15.7:0/1256252760 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55be45214b10 0x55be452281e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.579+0000 7f25d6ffd640 1 -- 172.21.15.7:0/1256252760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be45245530 msgr2=0x55be4520b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:57:58.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.579+0000 7f25d6ffd640 1 --2- 172.21.15.7:0/1256252760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be45245530 0x55be4520b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.579+0000 7f25d6ffd640 1 -- 172.21.15.7:0/1256252760 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be44e250f0 con 0x55be45214ef0 2024-04-25T09:57:58.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.579+0000 7f25d6ffd640 1 --2- 172.21.15.7:0/1256252760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be45214ef0 0x55be451ec440 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f25d814f180 tx=0x7f25cc009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e49340cf6cc75f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:57:58.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.579+0000 7f25b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:57:58.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.579+0000 7f25b67fc640 1 -- 172.21.15.7:0/1256252760 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc017d00 con 0x55be45214ef0 2024-04-25T09:57:58.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.579+0000 7f25b67fc640 1 -- 172.21.15.7:0/1256252760 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f25cc01f290 con 0x55be45214ef0 2024-04-25T09:57:58.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.579+0000 7f25e0983740 1 -- 172.21.15.7:0/1256252760 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f25d0060db0 con 0x55be45214ef0 2024-04-25T09:57:58.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.579+0000 7f25b67fc640 1 -- 172.21.15.7:0/1256252760 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25cc030050 con 0x55be45214ef0 2024-04-25T09:57:58.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.579+0000 7f25e0983740 10 client.6594 fetch_fsmap learned FSMap version 29 2024-04-25T09:57:58.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.579+0000 7f25e0983740 1 -- 172.21.15.7:0/1256252760 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x55be45239980 con 0x55be45214ef0 2024-04-25T09:57:58.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.580+0000 7f25b67fc640 1 -- 172.21.15.7:0/1256252760 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d0060db0 con 0x55be45214ef0 2024-04-25T09:57:58.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.580+0000 7f25b67fc640 1 -- 172.21.15.7:0/1256252760 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 29) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f25cc033020 con 0x55be45214ef0 2024-04-25T09:57:58.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.580+0000 7f25e0983740 10 client.6594 fetch_fsmap finished waiting for FSMap version 29 2024-04-25T09:57:58.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.580+0000 7f25e0983740 10 client.6594 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:57:58.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.580+0000 7f25e0983740 20 client.6594 populate_metadata read hostname 'smithi007' 2024-04-25T09:57:58.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.580+0000 7f25e0983740 1 --2- 172.21.15.7:0/1256252760 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x55be452960f0 0x55be4520b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:57:58.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.580+0000 7f25e0983740 4 client.6594 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:57:58.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.580+0000 7f25e0983740 1 -- 172.21.15.7:0/1256252760 --> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55be45158630 con 0x55be452960f0 2024-04-25T09:57:58.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.580+0000 7f25d77fe640 1 --2- 172.21.15.7:0/1256252760 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x55be452960f0 0x55be4520b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:57:58.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.580+0000 7f25b67fc640 10 client.6594 ms_handle_connect on v2:172.21.15.7:6834/3057688863 2024-04-25T09:57:58.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.580+0000 7f25d77fe640 1 --2- 172.21.15.7:0/1256252760 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x55be452960f0 0x55be4520b9e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a883d917ae368156 server_cookie=cb3330626e91c4e5 in_seq=0 out_seq=0 2024-04-25T09:57:58.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.580+0000 7f25b67fc640 1 -- 172.21.15.7:0/1256252760 <== mds.0 v2:172.21.15.7:6834/3057688863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+266 (crc 0 0 0) 0x55be45158630 con 0x55be452960f0 2024-04-25T09:57:58.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.580+0000 7f25b67fc640 10 client.6594 handle_command_reply: tid=0 2024-04-25T09:57:58.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.580+0000 7f25e0983740 1 client.6594 shutdown 2024-04-25T09:57:58.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.580+0000 7f25e0983740 1 -- 172.21.15.7:0/1256252760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be45214ef0 msgr2=0x55be451ec440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:58.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.580+0000 7f25e0983740 1 --2- 172.21.15.7:0/1256252760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be45214ef0 0x55be451ec440 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f25d814f180 tx=0x7f25cc009f70 comp rx=0 tx=0).stop 2024-04-25T09:57:58.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.580+0000 7f25e0983740 1 -- 172.21.15.7:0/1256252760 shutdown_connections 2024-04-25T09:57:58.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.580+0000 7f25e0983740 1 --2- 172.21.15.7:0/1256252760 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x55be452960f0 0x55be4520b9e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.580+0000 7f25e0983740 1 --2- 172.21.15.7:0/1256252760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be45245530 0x55be4520b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.580+0000 7f25e0983740 1 --2- 172.21.15.7:0/1256252760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55be45214ef0 0x55be451ec440 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.580+0000 7f25b67fc640 0 client.6594 ms_handle_reset on v2:172.21.15.7:6834/3057688863 2024-04-25T09:57:58.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.580+0000 7f25e0983740 1 --2- 172.21.15.7:0/1256252760 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55be45214b10 0x55be452281e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.580+0000 7f25e0983740 1 -- 172.21.15.7:0/1256252760 >> 172.21.15.7:0/1256252760 conn(0x55be451e7770 msgr2=0x55be452128b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:58.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.580+0000 7f25e0983740 1 -- 172.21.15.7:0/1256252760 shutdown_connections 2024-04-25T09:57:58.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.581+0000 7f25e0983740 1 -- 172.21.15.7:0/1256252760 wait complete. 2024-04-25T09:57:58.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.581+0000 7f25e0983740 20 client.6594 trim_cache size 0 max 16384 2024-04-25T09:57:58.591 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T09:57:58.591 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:57:58.591 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-04-25T09:57:58.591 INFO:teuthology.orchestra.run.smithi007.stdout: "0541a36f-52a4-4cc6-8e53-6766d8d84fc0": { 2024-04-25T09:57:58.591 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-04-25T09:57:58.591 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "0541a36f-52a4-4cc6-8e53-6766d8d84fc0", 2024-04-25T09:57:58.591 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,repair,force" 2024-04-25T09:57:58.591 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:57:58.591 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:57:58.591 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T09:57:58.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.581+0000 7f25ddba5640 1 -- 172.21.15.7:0/621697910 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f25c406b4d0 msgr2=0x7f25c406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:58.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.581+0000 7f25ddba5640 1 --2- 172.21.15.7:0/621697910 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f25c406b4d0 0x7f25c406d990 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f25c8034000 tx=0x7f25c802e000 comp rx=0 tx=0).stop 2024-04-25T09:57:58.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.581+0000 7f25ddba5640 1 -- 172.21.15.7:0/621697910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25d8161200 msgr2=0x7f25d80ca670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:57:58.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.581+0000 7f25ddba5640 1 --2- 172.21.15.7:0/621697910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25d8161200 0x7f25d80ca670 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f25d000c6b0 tx=0x7f25d000cb70 comp rx=0 tx=0).stop 2024-04-25T09:57:58.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.581+0000 7f25ddba5640 1 -- 172.21.15.7:0/621697910 shutdown_connections 2024-04-25T09:57:58.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.581+0000 7f25ddba5640 1 --2- 172.21.15.7:0/621697910 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f25c406b4d0 0x7f25c406d990 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.581+0000 7f25ddba5640 1 --2- 172.21.15.7:0/621697910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25d8161200 0x7f25d80ca670 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.581+0000 7f25ddba5640 1 --2- 172.21.15.7:0/621697910 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25d80d0a00 0x7f25d8148a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.581+0000 7f25ddba5640 1 --2- 172.21.15.7:0/621697910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25d809a7d0 0x7f25d81481d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:57:58.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.581+0000 7f25ddba5640 1 -- 172.21.15.7:0/621697910 >> 172.21.15.7:0/621697910 conn(0x7f25d80b31a0 msgr2=0x7f25d815d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:57:58.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.581+0000 7f25ddba5640 1 -- 172.21.15.7:0/621697910 shutdown_connections 2024-04-25T09:57:58.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:57:58.581+0000 7f25ddba5640 1 -- 172.21.15.7:0/621697910 wait complete. 2024-04-25T09:57:58.595 INFO:tasks.cephfs.filesystem:scrub status for tag:0541a36f-52a4-4cc6-8e53-6766d8d84fc0 - {'path': '/', 'tag': '0541a36f-52a4-4cc6-8e53-6766d8d84fc0', 'options': 'recursive,repair,force'} 2024-04-25T09:58:26.617 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:58:26.621 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:58:28.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:58:28.597 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-25T09:58:28.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.709+0000 7f0d7df5c640 1 Processor -- start 2024-04-25T09:58:28.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.709+0000 7f0d7df5c640 1 -- start start 2024-04-25T09:58:28.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.710+0000 7f0d7df5c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0d78144fe0 0x7f0d7806e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:28.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.710+0000 7f0d7df5c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0d7806d130 0x7f0d78071130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:28.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.710+0000 7f0d7df5c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d781453c0 con 0x7f0d78071670 2024-04-25T09:58:28.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.710+0000 7f0d7df5c640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d780a8560 con 0x7f0d7806d130 2024-04-25T09:58:28.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.710+0000 7f0d7df5c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d7806d6a0 con 0x7f0d78144fe0 2024-04-25T09:58:28.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.710+0000 7f0d76ffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0d7806d130 0x7f0d78071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:28.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.710+0000 7f0d76ffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0d7806d130 0x7f0d78071130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43226/0 (socket says 172.21.15.7:43226) 2024-04-25T09:58:28.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.710+0000 7f0d76ffd640 1 -- 172.21.15.7:0/21436292 learned_addr learned my addr 172.21.15.7:0/21436292 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:28.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.710+0000 7f0d777fe640 1 --2- 172.21.15.7:0/21436292 >> v2:172.21.15.55:3300/0 conn(0x7f0d78144fe0 0x7f0d7806e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:28.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.710+0000 7f0d76ffd640 1 -- 172.21.15.7:0/21436292 >> v2:172.21.15.55:3300/0 conn(0x7f0d78144fe0 msgr2=0x7f0d7806e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:28.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.710+0000 7f0d76ffd640 1 --2- 172.21.15.7:0/21436292 >> v2:172.21.15.55:3300/0 conn(0x7f0d78144fe0 0x7f0d7806e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.710+0000 7f0d76ffd640 1 -- 172.21.15.7:0/21436292 >> v1:172.21.15.55:6789/0 conn(0x7f0d78071670 legacy=0x7f0d780cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:28.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.710+0000 7f0d76ffd640 1 -- 172.21.15.7:0/21436292 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7806d980 con 0x7f0d7806d130 2024-04-25T09:58:28.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.711+0000 7f0d76ffd640 1 --2- 172.21.15.7:0/21436292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d7806d130 0x7f0d78071130 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f0d780728b0 tx=0x7f0d6802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd91cda3a899ab6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:28.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.711+0000 7f0d767fc640 1 -- 172.21.15.7:0/21436292 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d68037070 con 0x7f0d7806d130 2024-04-25T09:58:28.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.711+0000 7f0d767fc640 1 -- 172.21.15.7:0/21436292 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d68032440 con 0x7f0d7806d130 2024-04-25T09:58:28.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.711+0000 7f0d767fc640 1 -- 172.21.15.7:0/21436292 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d68032810 con 0x7f0d7806d130 2024-04-25T09:58:28.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.712+0000 7f0d7df5c640 1 -- 172.21.15.7:0/21436292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d7806d130 msgr2=0x7f0d78071130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:28.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.712+0000 7f0d7df5c640 1 --2- 172.21.15.7:0/21436292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d7806d130 0x7f0d78071130 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f0d780728b0 tx=0x7f0d6802a270 comp rx=0 tx=0).stop 2024-04-25T09:58:28.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.712+0000 7f0d7df5c640 1 -- 172.21.15.7:0/21436292 shutdown_connections 2024-04-25T09:58:28.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.712+0000 7f0d7df5c640 1 --2- 172.21.15.7:0/21436292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d7806d130 0x7f0d78071130 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.712+0000 7f0d7df5c640 1 --2- 172.21.15.7:0/21436292 >> v2:172.21.15.55:3300/0 conn(0x7f0d78144fe0 0x7f0d7806e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.712+0000 7f0d7df5c640 1 -- 172.21.15.7:0/21436292 >> 172.21.15.7:0/21436292 conn(0x7f0d7806ab60 msgr2=0x7f0d7806af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:28.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.712+0000 7f0d7df5c640 1 -- 172.21.15.7:0/21436292 shutdown_connections 2024-04-25T09:58:28.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.712+0000 7f0d7df5c640 1 -- 172.21.15.7:0/21436292 wait complete. 2024-04-25T09:58:28.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.713+0000 7f0d7df5c640 1 Processor -- start 2024-04-25T09:58:28.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.713+0000 7f0d7df5c640 1 -- start start 2024-04-25T09:58:28.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.714+0000 7f0d7df5c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d7806d130 0x7f0d780addf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:28.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.714+0000 7f0d7df5c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0d78071670 0x7f0d781e75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:28.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.714+0000 7f0d7df5c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d78144fe0 0x7f0d7815ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:28.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.714+0000 7f0d7df5c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7815be50 con 0x7f0d7806d130 2024-04-25T09:58:28.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.714+0000 7f0d7df5c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7806df40 con 0x7f0d78144fe0 2024-04-25T09:58:28.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.714+0000 7f0d7df5c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7806eaa0 con 0x7f0d78071670 2024-04-25T09:58:28.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.714+0000 7f0d777fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d7806d130 0x7f0d780addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:28.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.714+0000 7f0d777fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d7806d130 0x7f0d780addf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43228/0 (socket says 172.21.15.7:43228) 2024-04-25T09:58:28.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.714+0000 7f0d777fe640 1 -- 172.21.15.7:0/3891489854 learned_addr learned my addr 172.21.15.7:0/3891489854 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:28.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.714+0000 7f0d76ffd640 1 --2- 172.21.15.7:0/3891489854 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0d78071670 0x7f0d781e75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:28.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.714+0000 7f0d77fff640 1 --2- 172.21.15.7:0/3891489854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d78144fe0 0x7f0d7815ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:28.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.714+0000 7f0d777fe640 1 -- 172.21.15.7:0/3891489854 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0d78071670 msgr2=0x7f0d781e75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:28.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.714+0000 7f0d777fe640 1 --2- 172.21.15.7:0/3891489854 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0d78071670 0x7f0d781e75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.714+0000 7f0d777fe640 1 -- 172.21.15.7:0/3891489854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d78144fe0 msgr2=0x7f0d7815ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:28.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.714+0000 7f0d777fe640 1 --2- 172.21.15.7:0/3891489854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d78144fe0 0x7f0d7815ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.714+0000 7f0d777fe640 1 -- 172.21.15.7:0/3891489854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d780acd50 con 0x7f0d7806d130 2024-04-25T09:58:28.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.715+0000 7f0d777fe640 1 --2- 172.21.15.7:0/3891489854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d7806d130 0x7f0d780addf0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00d5f0 tx=0x7f0d6c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:28.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.715+0000 7f0d5ffff640 1 -- 172.21.15.7:0/3891489854 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c0125f0 con 0x7f0d7806d130 2024-04-25T09:58:28.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.715+0000 7f0d5ffff640 1 -- 172.21.15.7:0/3891489854 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6c019070 con 0x7f0d7806d130 2024-04-25T09:58:28.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.715+0000 7f0d7df5c640 1 -- 172.21.15.7:0/3891489854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d780ad030 con 0x7f0d7806d130 2024-04-25T09:58:28.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.715+0000 7f0d5ffff640 1 -- 172.21.15.7:0/3891489854 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c0129d0 con 0x7f0d7806d130 2024-04-25T09:58:28.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.715+0000 7f0d7df5c640 1 -- 172.21.15.7:0/3891489854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d780ad5f0 con 0x7f0d7806d130 2024-04-25T09:58:28.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.716+0000 7f0d5ffff640 1 -- 172.21.15.7:0/3891489854 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0d6c012b70 con 0x7f0d7806d130 2024-04-25T09:58:28.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.717+0000 7f0d5ffff640 1 --2- 172.21.15.7:0/3891489854 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0d6406b4d0 0x7f0d6406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:28.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.717+0000 7f0d5ffff640 1 -- 172.21.15.7:0/3891489854 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f0d6c08a810 con 0x7f0d7806d130 2024-04-25T09:58:28.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.717+0000 7f0d76ffd640 1 --2- 172.21.15.7:0/3891489854 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0d6406b4d0 0x7f0d6406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:28.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.717+0000 7f0d76ffd640 1 --2- 172.21.15.7:0/3891489854 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0d6406b4d0 0x7f0d6406d990 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0d68034000 tx=0x7f0d6802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:28.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.718+0000 7f0d80c5b740 1 Processor -- start 2024-04-25T09:58:28.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.718+0000 7f0d80c5b740 1 -- start start 2024-04-25T09:58:28.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.719+0000 7f0d80c5b740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f638c4b10 0x563f638c7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:28.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.719+0000 7f0d80c5b740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f638c4ef0 0x563f638c7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:28.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.719+0000 7f0d80c5b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f63897770 0x563f6389af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:28.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.719+0000 7f0d80c5b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f63800da0 con 0x563f63897770 2024-04-25T09:58:28.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.719+0000 7f0d80c5b740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f637a9b80 con 0x563f638c4b10 2024-04-25T09:58:28.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.719+0000 7f0d80c5b740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f637fce40 con 0x563f638c4ef0 2024-04-25T09:58:28.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.719+0000 7f0d77fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f63897770 0x563f6389af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:28.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.719+0000 7f0d77fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f63897770 0x563f6389af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43244/0 (socket says 172.21.15.7:43244) 2024-04-25T09:58:28.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.719+0000 7f0d77fff640 1 -- 172.21.15.7:0/1630631170 learned_addr learned my addr 172.21.15.7:0/1630631170 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:28.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.719+0000 7f0d777fe640 1 --2- 172.21.15.7:0/1630631170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f638c4b10 0x563f638c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:28.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.719+0000 7f0d76ffd640 1 --2- 172.21.15.7:0/1630631170 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f638c4ef0 0x563f638c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:28.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.719+0000 7f0d77fff640 1 -- 172.21.15.7:0/1630631170 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f638c4ef0 msgr2=0x563f638c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:28.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.719+0000 7f0d77fff640 1 --2- 172.21.15.7:0/1630631170 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f638c4ef0 0x563f638c7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.719+0000 7f0d77fff640 1 -- 172.21.15.7:0/1630631170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f638c4b10 msgr2=0x563f638c7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:28.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.719+0000 7f0d77fff640 1 --2- 172.21.15.7:0/1630631170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f638c4b10 0x563f638c7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.719+0000 7f0d77fff640 1 -- 172.21.15.7:0/1630631170 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f637b3f10 con 0x563f63897770 2024-04-25T09:58:28.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.719+0000 7f0d777fe640 1 --2- 172.21.15.7:0/1630631170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f638c4b10 0x563f638c7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:58:28.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.719+0000 7f0d76ffd640 1 --2- 172.21.15.7:0/1630631170 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f638c4ef0 0x563f638c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:58:28.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.719+0000 7f0d77fff640 1 --2- 172.21.15.7:0/1630631170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f63897770 0x563f6389af80 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f0d70001d90 tx=0x7f0d7000d150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a944c8e1221b91 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:28.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.720+0000 7f0d5d7fa640 1 -- 172.21.15.7:0/1630631170 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d70016020 con 0x563f63897770 2024-04-25T09:58:28.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.720+0000 7f0d5d7fa640 1 -- 172.21.15.7:0/1630631170 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7000dd30 con 0x563f63897770 2024-04-25T09:58:28.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.720+0000 7f0d5d7fa640 1 -- 172.21.15.7:0/1630631170 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d70012610 con 0x563f63897770 2024-04-25T09:58:28.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.720+0000 7f0d80c5b740 1 -- 172.21.15.7:0/1630631170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f63897770 msgr2=0x563f6389af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:28.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.720+0000 7f0d80c5b740 1 --2- 172.21.15.7:0/1630631170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f63897770 0x563f6389af80 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f0d70001d90 tx=0x7f0d7000d150 comp rx=0 tx=0).stop 2024-04-25T09:58:28.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.720+0000 7f0d80c5b740 1 -- 172.21.15.7:0/1630631170 shutdown_connections 2024-04-25T09:58:28.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.720+0000 7f0d80c5b740 1 --2- 172.21.15.7:0/1630631170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f63897770 0x563f6389af80 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.720+0000 7f0d80c5b740 1 --2- 172.21.15.7:0/1630631170 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f638c4ef0 0x563f638c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.720+0000 7f0d80c5b740 1 --2- 172.21.15.7:0/1630631170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f638c4b10 0x563f638c7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.720+0000 7f0d80c5b740 1 -- 172.21.15.7:0/1630631170 >> 172.21.15.7:0/1630631170 conn(0x563f638999e0 msgr2=0x563f638e2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:28.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.720+0000 7f0d80c5b740 1 -- 172.21.15.7:0/1630631170 shutdown_connections 2024-04-25T09:58:28.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.720+0000 7f0d80c5b740 1 -- 172.21.15.7:0/1630631170 wait complete. 2024-04-25T09:58:28.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.721+0000 7f0d80c5b740 1 -- start start 2024-04-25T09:58:28.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.721+0000 7f0d80c5b740 1 Processor -- start 2024-04-25T09:58:28.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.722+0000 7f0d80c5b740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f638c4b10 0x563f638bbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:28.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.722+0000 7f0d80c5b740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f638c4ef0 0x563f638e5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:28.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.722+0000 7f0d80c5b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f638f55a0 0x563f638f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:28.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.722+0000 7f0d80c5b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f6389cb90 con 0x563f638f55a0 2024-04-25T09:58:28.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.722+0000 7f0d80c5b740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f6379f4b0 con 0x563f638c4b10 2024-04-25T09:58:28.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.722+0000 7f0d80c5b740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f6389ce70 con 0x563f638c4ef0 2024-04-25T09:58:28.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.722+0000 7f0d80c5b740 10 client.0 _ll_register_callbacks cb 0x563f637df180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:58:28.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.722+0000 7f0d77fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f638f55a0 0x563f638f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:28.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.722+0000 7f0d77fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f638f55a0 0x563f638f5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43258/0 (socket says 172.21.15.7:43258) 2024-04-25T09:58:28.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.722+0000 7f0d77fff640 1 -- 172.21.15.7:0/3183579758 learned_addr learned my addr 172.21.15.7:0/3183579758 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:28.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.722+0000 7f0d777fe640 1 --2- 172.21.15.7:0/3183579758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f638c4b10 0x563f638bbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:28.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.722+0000 7f0d77fff640 1 -- 172.21.15.7:0/3183579758 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f638c4ef0 msgr2=0x563f638e5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:28.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.722+0000 7f0d76ffd640 1 --2- 172.21.15.7:0/3183579758 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f638c4ef0 0x563f638e5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:28.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.722+0000 7f0d77fff640 1 --2- 172.21.15.7:0/3183579758 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f638c4ef0 0x563f638e5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.722+0000 7f0d77fff640 1 -- 172.21.15.7:0/3183579758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f638c4b10 msgr2=0x563f638bbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:28.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.722+0000 7f0d77fff640 1 --2- 172.21.15.7:0/3183579758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f638c4b10 0x563f638bbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.722+0000 7f0d77fff640 1 -- 172.21.15.7:0/3183579758 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563f635df7d0 con 0x563f638f55a0 2024-04-25T09:58:28.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.722+0000 7f0d777fe640 1 --2- 172.21.15.7:0/3183579758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f638c4b10 0x563f638bbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:58:28.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.722+0000 7f0d76ffd640 1 --2- 172.21.15.7:0/3183579758 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f638c4ef0 0x563f638e5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:58:28.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.722+0000 7f0d77fff640 1 --2- 172.21.15.7:0/3183579758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f638f55a0 0x563f638f5a20 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f0d70012af0 tx=0x7f0d70001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=271b6626d331e60a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:28.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.722+0000 7f0d567fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:58:28.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.723+0000 7f0d567fc640 1 -- 172.21.15.7:0/3183579758 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d70016040 con 0x563f638f55a0 2024-04-25T09:58:28.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.723+0000 7f0d567fc640 1 -- 172.21.15.7:0/3183579758 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(64..64 src has 1..64) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f0d70006b50 con 0x563f638f55a0 2024-04-25T09:58:28.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.723+0000 7f0d80c5b740 1 -- 172.21.15.7:0/3183579758 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0d7000dd30 con 0x563f638f55a0 2024-04-25T09:58:28.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.723+0000 7f0d567fc640 1 -- 172.21.15.7:0/3183579758 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d7002b050 con 0x563f638f55a0 2024-04-25T09:58:28.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.723+0000 7f0d80c5b740 10 client.6606 fetch_fsmap learned FSMap version 30 2024-04-25T09:58:28.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.723+0000 7f0d80c5b740 1 -- 172.21.15.7:0/3183579758 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x563f635153f0 con 0x563f638f55a0 2024-04-25T09:58:28.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.723+0000 7f0d567fc640 1 -- 172.21.15.7:0/3183579758 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7000dd30 con 0x563f638f55a0 2024-04-25T09:58:28.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.723+0000 7f0d567fc640 1 -- 172.21.15.7:0/3183579758 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0d7002e020 con 0x563f638f55a0 2024-04-25T09:58:28.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.723+0000 7f0d80c5b740 10 client.6606 fetch_fsmap finished waiting for FSMap version 30 2024-04-25T09:58:28.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.723+0000 7f0d80c5b740 10 client.6606 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:58:28.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.723+0000 7f0d80c5b740 20 client.6606 populate_metadata read hostname 'smithi007' 2024-04-25T09:58:28.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.723+0000 7f0d80c5b740 1 --2- 172.21.15.7:0/3183579758 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x563f638c2320 0x563f638c2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:28.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.723+0000 7f0d80c5b740 4 client.6606 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:58:28.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.723+0000 7f0d80c5b740 1 -- 172.21.15.7:0/3183579758 --> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563f6380e2e0 con 0x563f638c2320 2024-04-25T09:58:28.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.723+0000 7f0d777fe640 1 --2- 172.21.15.7:0/3183579758 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x563f638c2320 0x563f638c2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:28.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.724+0000 7f0d777fe640 1 --2- 172.21.15.7:0/3183579758 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x563f638c2320 0x563f638c2700 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6dde48f281cecdf server_cookie=e6700b9772559ecd in_seq=0 out_seq=0 2024-04-25T09:58:28.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.724+0000 7f0d567fc640 10 client.6606 ms_handle_connect on v2:172.21.15.7:6834/3057688863 2024-04-25T09:58:28.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.724+0000 7f0d567fc640 1 -- 172.21.15.7:0/3183579758 <== mds.0 v2:172.21.15.7:6834/3057688863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563f6380e2e0 con 0x563f638c2320 2024-04-25T09:58:28.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.724+0000 7f0d567fc640 10 client.6606 handle_command_reply: tid=0 2024-04-25T09:58:28.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.724+0000 7f0d80c5b740 1 client.6606 shutdown 2024-04-25T09:58:28.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.724+0000 7f0d80c5b740 1 -- 172.21.15.7:0/3183579758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f638f55a0 msgr2=0x563f638f5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:28.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.724+0000 7f0d80c5b740 1 --2- 172.21.15.7:0/3183579758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f638f55a0 0x563f638f5a20 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f0d70012af0 tx=0x7f0d70001250 comp rx=0 tx=0).stop 2024-04-25T09:58:28.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.724+0000 7f0d80c5b740 1 -- 172.21.15.7:0/3183579758 shutdown_connections 2024-04-25T09:58:28.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.724+0000 7f0d80c5b740 1 --2- 172.21.15.7:0/3183579758 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x563f638c2320 0x563f638c2700 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.724+0000 7f0d80c5b740 1 --2- 172.21.15.7:0/3183579758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f638f55a0 0x563f638f5a20 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.724+0000 7f0d80c5b740 1 --2- 172.21.15.7:0/3183579758 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f638c4ef0 0x563f638e5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.724+0000 7f0d80c5b740 1 --2- 172.21.15.7:0/3183579758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f638c4b10 0x563f638bbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.724+0000 7f0d567fc640 0 client.6606 ms_handle_reset on v2:172.21.15.7:6834/3057688863 2024-04-25T09:58:28.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.724+0000 7f0d80c5b740 1 -- 172.21.15.7:0/3183579758 >> 172.21.15.7:0/3183579758 conn(0x563f63897770 msgr2=0x563f638c3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:28.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.724+0000 7f0d80c5b740 1 -- 172.21.15.7:0/3183579758 shutdown_connections 2024-04-25T09:58:28.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.724+0000 7f0d80c5b740 1 -- 172.21.15.7:0/3183579758 wait complete. 2024-04-25T09:58:28.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.725+0000 7f0d80c5b740 20 client.6606 trim_cache size 0 max 16384 2024-04-25T09:58:28.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.740+0000 7f0d80c5b740 1 Processor -- start 2024-04-25T09:58:28.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.740+0000 7f0d80c5b740 1 -- start start 2024-04-25T09:58:28.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.741+0000 7f0d80c5b740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f638c4b10 0x563f63904d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:28.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.741+0000 7f0d80c5b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f638c4ef0 0x563f6389ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:28.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.741+0000 7f0d80c5b740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f638f55a0 0x563f63896a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:28.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.741+0000 7f0d80c5b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d78200500 con 0x563f638c4ef0 2024-04-25T09:58:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.741+0000 7f0d80c5b740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d781ff6e0 con 0x563f638c4b10 2024-04-25T09:58:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.741+0000 7f0d80c5b740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d781e4830 con 0x563f638f55a0 2024-04-25T09:58:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.741+0000 7f0d76ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f638c4ef0 0x563f6389ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.741+0000 7f0d76ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f638c4ef0 0x563f6389ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43274/0 (socket says 172.21.15.7:43274) 2024-04-25T09:58:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.741+0000 7f0d76ffd640 1 -- 172.21.15.7:0/3147174588 learned_addr learned my addr 172.21.15.7:0/3147174588 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.741+0000 7f0d77fff640 1 --2- 172.21.15.7:0/3147174588 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f638f55a0 0x563f63896a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.741+0000 7f0d777fe640 1 --2- 172.21.15.7:0/3147174588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f638c4b10 0x563f63904d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.741+0000 7f0d76ffd640 1 -- 172.21.15.7:0/3147174588 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f638f55a0 msgr2=0x563f63896a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.741+0000 7f0d76ffd640 1 --2- 172.21.15.7:0/3147174588 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f638f55a0 0x563f63896a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.741+0000 7f0d76ffd640 1 -- 172.21.15.7:0/3147174588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f638c4b10 msgr2=0x563f63904d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.741+0000 7f0d76ffd640 1 --2- 172.21.15.7:0/3147174588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f638c4b10 0x563f63904d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.741+0000 7f0d76ffd640 1 -- 172.21.15.7:0/3147174588 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f634d50f0 con 0x563f638c4ef0 2024-04-25T09:58:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.741+0000 7f0d76ffd640 1 --2- 172.21.15.7:0/3147174588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f638c4ef0 0x563f6389ce70 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f0d68009630 tx=0x7f0d68008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=495424fd414179f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.741+0000 7f0d5cff9640 1 -- 172.21.15.7:0/3147174588 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d68037040 con 0x563f638c4ef0 2024-04-25T09:58:28.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.741+0000 7f0d5cff9640 1 -- 172.21.15.7:0/3147174588 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6804d070 con 0x563f638c4ef0 2024-04-25T09:58:28.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.741+0000 7f0d5cff9640 1 -- 172.21.15.7:0/3147174588 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6803c680 con 0x563f638c4ef0 2024-04-25T09:58:28.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.742+0000 7f0d80c5b740 1 -- 172.21.15.7:0/3147174588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f638c4ef0 msgr2=0x563f6389ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:28.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.742+0000 7f0d80c5b740 1 --2- 172.21.15.7:0/3147174588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f638c4ef0 0x563f6389ce70 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f0d68009630 tx=0x7f0d68008030 comp rx=0 tx=0).stop 2024-04-25T09:58:28.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.742+0000 7f0d80c5b740 1 -- 172.21.15.7:0/3147174588 shutdown_connections 2024-04-25T09:58:28.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.742+0000 7f0d80c5b740 1 --2- 172.21.15.7:0/3147174588 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f638f55a0 0x563f63896a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.742+0000 7f0d80c5b740 1 --2- 172.21.15.7:0/3147174588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f638c4ef0 0x563f6389ce70 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.742+0000 7f0d80c5b740 1 --2- 172.21.15.7:0/3147174588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f638c4b10 0x563f63904d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.742+0000 7f0d80c5b740 1 -- 172.21.15.7:0/3147174588 >> 172.21.15.7:0/3147174588 conn(0x563f63897770 msgr2=0x563f638f5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:28.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.742+0000 7f0d80c5b740 1 -- 172.21.15.7:0/3147174588 shutdown_connections 2024-04-25T09:58:28.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.742+0000 7f0d80c5b740 1 -- 172.21.15.7:0/3147174588 wait complete. 2024-04-25T09:58:28.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.743+0000 7f0d80c5b740 1 -- start start 2024-04-25T09:58:28.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.743+0000 7f0d80c5b740 1 Processor -- start 2024-04-25T09:58:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.743+0000 7f0d80c5b740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f638c4b10 0x563f638fc070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.743+0000 7f0d80c5b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f638c4ef0 0x563f638e2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.744+0000 7f0d80c5b740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f638f55a0 0x563f638e2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.744+0000 7f0d80c5b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f638c7510 con 0x563f638c4ef0 2024-04-25T09:58:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.744+0000 7f0d80c5b740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d781ff0e0 con 0x563f638c4b10 2024-04-25T09:58:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.744+0000 7f0d80c5b740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f638933f0 con 0x563f638f55a0 2024-04-25T09:58:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.744+0000 7f0d80c5b740 10 client.0 _ll_register_callbacks cb 0x7f0d700015e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:58:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.744+0000 7f0d76ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f638c4ef0 0x563f638e2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.744+0000 7f0d76ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f638c4ef0 0x563f638e2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43284/0 (socket says 172.21.15.7:43284) 2024-04-25T09:58:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.744+0000 7f0d76ffd640 1 -- 172.21.15.7:0/2176920788 learned_addr learned my addr 172.21.15.7:0/2176920788 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.744+0000 7f0d77fff640 1 --2- 172.21.15.7:0/2176920788 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f638f55a0 0x563f638e2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.744+0000 7f0d777fe640 1 --2- 172.21.15.7:0/2176920788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f638c4b10 0x563f638fc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.744+0000 7f0d76ffd640 1 -- 172.21.15.7:0/2176920788 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f638f55a0 msgr2=0x563f638e2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.744+0000 7f0d76ffd640 1 --2- 172.21.15.7:0/2176920788 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f638f55a0 0x563f638e2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.744+0000 7f0d76ffd640 1 -- 172.21.15.7:0/2176920788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f638c4b10 msgr2=0x563f638fc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:28.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.744+0000 7f0d76ffd640 1 --2- 172.21.15.7:0/2176920788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f638c4b10 0x563f638fc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.744+0000 7f0d76ffd640 1 -- 172.21.15.7:0/2176920788 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563f63897c90 con 0x563f638c4ef0 2024-04-25T09:58:28.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.744+0000 7f0d76ffd640 1 --2- 172.21.15.7:0/2176920788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f638c4ef0 0x563f638e2230 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f0d680090b0 tx=0x7f0d68004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aac6b2010a90652 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:28.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.744+0000 7f0d567fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:58:28.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.744+0000 7f0d567fc640 1 -- 172.21.15.7:0/2176920788 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d68055030 con 0x563f638c4ef0 2024-04-25T09:58:28.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.744+0000 7f0d567fc640 1 -- 172.21.15.7:0/2176920788 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(64..64 src has 1..64) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f0d6803cd40 con 0x563f638c4ef0 2024-04-25T09:58:28.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.744+0000 7f0d80c5b740 1 -- 172.21.15.7:0/2176920788 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0d6804d070 con 0x563f638c4ef0 2024-04-25T09:58:28.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.744+0000 7f0d567fc640 1 -- 172.21.15.7:0/2176920788 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d68061050 con 0x563f638c4ef0 2024-04-25T09:58:28.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.745+0000 7f0d80c5b740 10 client.6612 fetch_fsmap learned FSMap version 30 2024-04-25T09:58:28.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.745+0000 7f0d80c5b740 1 -- 172.21.15.7:0/2176920788 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x563f638f89a0 con 0x563f638c4ef0 2024-04-25T09:58:28.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.745+0000 7f0d567fc640 1 -- 172.21.15.7:0/2176920788 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6804d070 con 0x563f638c4ef0 2024-04-25T09:58:28.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.745+0000 7f0d567fc640 1 -- 172.21.15.7:0/2176920788 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0d68064020 con 0x563f638c4ef0 2024-04-25T09:58:28.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.745+0000 7f0d80c5b740 10 client.6612 fetch_fsmap finished waiting for FSMap version 30 2024-04-25T09:58:28.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.745+0000 7f0d80c5b740 10 client.6612 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:58:28.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.745+0000 7f0d80c5b740 20 client.6612 populate_metadata read hostname 'smithi007' 2024-04-25T09:58:28.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.745+0000 7f0d80c5b740 1 --2- 172.21.15.7:0/2176920788 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x563f639545d0 0x563f638bf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:28.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.745+0000 7f0d80c5b740 4 client.6612 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:58:28.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.745+0000 7f0d80c5b740 1 -- 172.21.15.7:0/2176920788 --> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563f63808630 con 0x563f639545d0 2024-04-25T09:58:28.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.745+0000 7f0d777fe640 1 --2- 172.21.15.7:0/2176920788 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x563f639545d0 0x563f638bf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:28.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.745+0000 7f0d567fc640 10 client.6612 ms_handle_connect on v2:172.21.15.7:6834/3057688863 2024-04-25T09:58:28.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.745+0000 7f0d777fe640 1 --2- 172.21.15.7:0/2176920788 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x563f639545d0 0x563f638bf2f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a8814a84dea9c43 server_cookie=5052828970a9c02 in_seq=0 out_seq=0 2024-04-25T09:58:28.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.745+0000 7f0d567fc640 1 -- 172.21.15.7:0/2176920788 <== mds.0 v2:172.21.15.7:6834/3057688863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x563f63808630 con 0x563f639545d0 2024-04-25T09:58:28.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.745+0000 7f0d567fc640 10 client.6612 handle_command_reply: tid=0 2024-04-25T09:58:28.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.745+0000 7f0d80c5b740 1 client.6612 shutdown 2024-04-25T09:58:28.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.745+0000 7f0d80c5b740 1 -- 172.21.15.7:0/2176920788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f638c4ef0 msgr2=0x563f638e2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:28.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.745+0000 7f0d80c5b740 1 --2- 172.21.15.7:0/2176920788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f638c4ef0 0x563f638e2230 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f0d680090b0 tx=0x7f0d68004730 comp rx=0 tx=0).stop 2024-04-25T09:58:28.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.746+0000 7f0d80c5b740 1 -- 172.21.15.7:0/2176920788 shutdown_connections 2024-04-25T09:58:28.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.746+0000 7f0d80c5b740 1 --2- 172.21.15.7:0/2176920788 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x563f639545d0 0x563f638bf2f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.746+0000 7f0d80c5b740 1 --2- 172.21.15.7:0/2176920788 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f638f55a0 0x563f638e2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.746+0000 7f0d80c5b740 1 --2- 172.21.15.7:0/2176920788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f638c4ef0 0x563f638e2230 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.746+0000 7f0d80c5b740 1 --2- 172.21.15.7:0/2176920788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f638c4b10 0x563f638fc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.746+0000 7f0d567fc640 0 client.6612 ms_handle_reset on v2:172.21.15.7:6834/3057688863 2024-04-25T09:58:28.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.746+0000 7f0d80c5b740 1 -- 172.21.15.7:0/2176920788 >> 172.21.15.7:0/2176920788 conn(0x563f63897770 msgr2=0x563f638e5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:28.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.746+0000 7f0d80c5b740 1 -- 172.21.15.7:0/2176920788 shutdown_connections 2024-04-25T09:58:28.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.746+0000 7f0d80c5b740 1 -- 172.21.15.7:0/2176920788 wait complete. 2024-04-25T09:58:28.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.746+0000 7f0d80c5b740 20 client.6612 trim_cache size 0 max 16384 2024-04-25T09:58:28.755 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T09:58:28.756 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-04-25T09:58:28.756 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-04-25T09:58:28.756 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T09:58:28.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.746+0000 7f0d7df5c640 1 -- 172.21.15.7:0/3891489854 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0d6406b4d0 msgr2=0x7f0d6406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:28.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.746+0000 7f0d7df5c640 1 --2- 172.21.15.7:0/3891489854 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0d6406b4d0 0x7f0d6406d990 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0d68034000 tx=0x7f0d6802e000 comp rx=0 tx=0).stop 2024-04-25T09:58:28.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.746+0000 7f0d7df5c640 1 -- 172.21.15.7:0/3891489854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d7806d130 msgr2=0x7f0d780addf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:28.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.746+0000 7f0d7df5c640 1 --2- 172.21.15.7:0/3891489854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d7806d130 0x7f0d780addf0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00d5f0 tx=0x7f0d6c00dab0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.746+0000 7f0d7df5c640 1 -- 172.21.15.7:0/3891489854 shutdown_connections 2024-04-25T09:58:28.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.746+0000 7f0d7df5c640 1 --2- 172.21.15.7:0/3891489854 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0d6406b4d0 0x7f0d6406d990 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.746+0000 7f0d7df5c640 1 --2- 172.21.15.7:0/3891489854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d78144fe0 0x7f0d7815ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.746+0000 7f0d7df5c640 1 --2- 172.21.15.7:0/3891489854 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0d78071670 0x7f0d781e75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.746+0000 7f0d7df5c640 1 --2- 172.21.15.7:0/3891489854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0d7806d130 0x7f0d780addf0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.746+0000 7f0d7df5c640 1 -- 172.21.15.7:0/3891489854 >> 172.21.15.7:0/3891489854 conn(0x7f0d7806ab60 msgr2=0x7f0d780af2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:28.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.746+0000 7f0d7df5c640 1 -- 172.21.15.7:0/3891489854 shutdown_connections 2024-04-25T09:58:28.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.746+0000 7f0d7df5c640 1 -- 172.21.15.7:0/3891489854 wait complete. 2024-04-25T09:58:28.761 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:58:28.761 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:58:28.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.858+0000 7fed9e5b7640 1 Processor -- start 2024-04-25T09:58:28.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.858+0000 7fed9e5b7640 1 -- start start 2024-04-25T09:58:28.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.859+0000 7fed9e5b7640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fed9806c680 0x7fed9806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:28.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.859+0000 7fed9e5b7640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed98099b90 con 0x7fed980cbc90 2024-04-25T09:58:28.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.859+0000 7fed9e5b7640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed98099e70 con 0x7fed980cd740 2024-04-25T09:58:28.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.859+0000 7fed9e5b7640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed980cdb20 con 0x7fed9806c680 2024-04-25T09:58:28.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.859+0000 7fed977fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fed9806c680 0x7fed9806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:28.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.859+0000 7fed9cb54640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fed980cbc90 0x7fed980cc0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48108/0 (socket says 172.21.15.7:48108) 2024-04-25T09:58:28.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.859+0000 7fed9cb54640 1 -- 172.21.15.7:0/2136382263 learned_addr learned my addr 172.21.15.7:0/2136382263 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:28.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.860+0000 7fed977fe640 1 -- 172.21.15.7:0/2136382263 >> v1:172.21.15.55:6789/0 conn(0x7fed980cd740 legacy=0x7fed980d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:28.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.860+0000 7fed977fe640 1 -- 172.21.15.7:0/2136382263 >> v1:172.21.15.7:6789/0 conn(0x7fed980cbc90 legacy=0x7fed980cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:28.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.860+0000 7fed977fe640 1 -- 172.21.15.7:0/2136382263 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9809a150 con 0x7fed9806c680 2024-04-25T09:58:28.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.860+0000 7fed977fe640 1 --2- 172.21.15.7:0/2136382263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed9806c680 0x7fed9806cb10 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fed800097a0 tx=0x7fed8002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca4d3d3600a9b39c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:28.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.861+0000 7fed96ffd640 1 -- 172.21.15.7:0/2136382263 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed80037070 con 0x7fed9806c680 2024-04-25T09:58:28.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.861+0000 7fed96ffd640 1 -- 172.21.15.7:0/2136382263 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed80032440 con 0x7fed9806c680 2024-04-25T09:58:28.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.861+0000 7fed96ffd640 1 -- 172.21.15.7:0/2136382263 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed80032810 con 0x7fed9806c680 2024-04-25T09:58:28.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.861+0000 7fed9e5b7640 1 -- 172.21.15.7:0/2136382263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed9806c680 msgr2=0x7fed9806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:28.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.861+0000 7fed9e5b7640 1 --2- 172.21.15.7:0/2136382263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed9806c680 0x7fed9806cb10 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fed800097a0 tx=0x7fed8002a230 comp rx=0 tx=0).stop 2024-04-25T09:58:28.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.861+0000 7fed9e5b7640 1 -- 172.21.15.7:0/2136382263 shutdown_connections 2024-04-25T09:58:28.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.861+0000 7fed9e5b7640 1 --2- 172.21.15.7:0/2136382263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed9806c680 0x7fed9806cb10 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.861+0000 7fed9e5b7640 1 -- 172.21.15.7:0/2136382263 >> 172.21.15.7:0/2136382263 conn(0x7fed980b3130 msgr2=0x7fed980b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:28.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.861+0000 7fed9e5b7640 1 -- 172.21.15.7:0/2136382263 shutdown_connections 2024-04-25T09:58:28.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.861+0000 7fed9e5b7640 1 -- 172.21.15.7:0/2136382263 wait complete. 2024-04-25T09:58:28.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.862+0000 7fed9e5b7640 1 Processor -- start 2024-04-25T09:58:28.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.863+0000 7fed9e5b7640 1 -- start start 2024-04-25T09:58:28.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.863+0000 7fed9e5b7640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fed9806c680 0x7fed98158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:28.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.863+0000 7fed9e5b7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed980cbc90 0x7fed980caac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:28.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.863+0000 7fed9e5b7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed980cd740 0x7fed980b6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:28.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.863+0000 7fed9e5b7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9809ac30 con 0x7fed980cd740 2024-04-25T09:58:28.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.863+0000 7fed9e5b7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9809a710 con 0x7fed980cbc90 2024-04-25T09:58:28.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.863+0000 7fed9e5b7640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9809adb0 con 0x7fed9806c680 2024-04-25T09:58:28.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.863+0000 7fed9cb54640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed980cd740 0x7fed980b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:28.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.863+0000 7fed9cb54640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed980cd740 0x7fed980b6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43300/0 (socket says 172.21.15.7:43300) 2024-04-25T09:58:28.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.863+0000 7fed9cb54640 1 -- 172.21.15.7:0/3553352229 learned_addr learned my addr 172.21.15.7:0/3553352229 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:28.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.863+0000 7fed97fff640 1 --2- 172.21.15.7:0/3553352229 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fed9806c680 0x7fed98158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:28.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.863+0000 7fed977fe640 1 --2- 172.21.15.7:0/3553352229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed980cbc90 0x7fed980caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:28.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.864+0000 7fed9cb54640 1 -- 172.21.15.7:0/3553352229 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fed9806c680 msgr2=0x7fed98158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:28.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.864+0000 7fed9cb54640 1 --2- 172.21.15.7:0/3553352229 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fed9806c680 0x7fed98158dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.864+0000 7fed9cb54640 1 -- 172.21.15.7:0/3553352229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed980cbc90 msgr2=0x7fed980caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:28.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.864+0000 7fed9cb54640 1 --2- 172.21.15.7:0/3553352229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed980cbc90 0x7fed980caac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:28.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.864+0000 7fed9cb54640 1 -- 172.21.15.7:0/3553352229 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed980c6f90 con 0x7fed980cd740 2024-04-25T09:58:28.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.864+0000 7fed9cb54640 1 --2- 172.21.15.7:0/3553352229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed980cd740 0x7fed980b6440 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fed9000cbf0 tx=0x7fed9000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:28.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.864+0000 7fed94ff9640 1 -- 172.21.15.7:0/3553352229 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed90017070 con 0x7fed980cd740 2024-04-25T09:58:28.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.864+0000 7fed94ff9640 1 -- 172.21.15.7:0/3553352229 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9000ad40 con 0x7fed980cd740 2024-04-25T09:58:28.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.864+0000 7fed9e5b7640 1 -- 172.21.15.7:0/3553352229 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed980c5f50 con 0x7fed980cd740 2024-04-25T09:58:28.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.864+0000 7fed94ff9640 1 -- 172.21.15.7:0/3553352229 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed90012600 con 0x7fed980cd740 2024-04-25T09:58:28.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.864+0000 7fed9e5b7640 1 -- 172.21.15.7:0/3553352229 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed980c6790 con 0x7fed980cd740 2024-04-25T09:58:28.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.865+0000 7fed9e5b7640 1 -- 172.21.15.7:0/3553352229 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed98068fd0 con 0x7fed980cd740 2024-04-25T09:58:28.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.866+0000 7fed94ff9640 1 -- 172.21.15.7:0/3553352229 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fed9001a070 con 0x7fed980cd740 2024-04-25T09:58:28.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.866+0000 7fed94ff9640 1 --2- 172.21.15.7:0/3553352229 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fed7806b4d0 0x7fed7806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:28.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.866+0000 7fed94ff9640 1 -- 172.21.15.7:0/3553352229 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6217+0+0 (secure 0 0 0) 0x7fed90089fc0 con 0x7fed980cd740 2024-04-25T09:58:28.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.866+0000 7fed97fff640 1 --2- 172.21.15.7:0/3553352229 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fed7806b4d0 0x7fed7806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:28.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.866+0000 7fed97fff640 1 --2- 172.21.15.7:0/3553352229 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fed7806b4d0 0x7fed7806d990 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fed980ca3c0 tx=0x7fed88009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:28.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:28.871+0000 7fed94ff9640 1 -- 172.21.15.7:0/3553352229 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fed980c5f50 con 0x7fed980cd740 2024-04-25T09:58:29.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.086+0000 7fed9e5b7640 1 -- 172.21.15.7:0/3553352229 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed980b4040 con 0x7fed980cd740 2024-04-25T09:58:29.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.086+0000 7fed94ff9640 1 -- 172.21.15.7:0/3553352229 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4934 (secure 0 0 0) 0x7fed90058680 con 0x7fed980cd740 2024-04-25T09:58:29.090 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:58:29.090 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3706118852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3706118852},{"type":"v1","addr":"172.21.15.55:6833","nonce":3706118852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5354,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1513522793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1513522793},{"type":"v1","addr":"172.21.15.55:6835","nonce":1513522793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5782,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1231382839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1231382839},{"type":"v1","addr":"172.21.15.7:6837","nonce":1231382839}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:57:15.098282+0000","modified":"2024-04-25T09:58:03.772256+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":15,"addr":"172.21.15.7:6836/3057688863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3057688863},{"type":"v1","addr":"172.21.15.7:6836","nonce":3057688863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:58:29.091 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 30 2024-04-25T09:58:29.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.088+0000 7fed9e5b7640 1 -- 172.21.15.7:0/3553352229 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fed7806b4d0 msgr2=0x7fed7806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:29.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.088+0000 7fed9e5b7640 1 --2- 172.21.15.7:0/3553352229 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fed7806b4d0 0x7fed7806d990 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fed980ca3c0 tx=0x7fed88009040 comp rx=0 tx=0).stop 2024-04-25T09:58:29.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.088+0000 7fed9e5b7640 1 -- 172.21.15.7:0/3553352229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed980cd740 msgr2=0x7fed980b6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:29.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.088+0000 7fed9e5b7640 1 --2- 172.21.15.7:0/3553352229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed980cd740 0x7fed980b6440 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fed9000cbf0 tx=0x7fed9000a430 comp rx=0 tx=0).stop 2024-04-25T09:58:29.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.088+0000 7fed9e5b7640 1 -- 172.21.15.7:0/3553352229 shutdown_connections 2024-04-25T09:58:29.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.088+0000 7fed9e5b7640 1 --2- 172.21.15.7:0/3553352229 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fed7806b4d0 0x7fed7806d990 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.088+0000 7fed9e5b7640 1 --2- 172.21.15.7:0/3553352229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed980cd740 0x7fed980b6440 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.088+0000 7fed9e5b7640 1 --2- 172.21.15.7:0/3553352229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed980cbc90 0x7fed980caac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.088+0000 7fed9e5b7640 1 --2- 172.21.15.7:0/3553352229 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fed9806c680 0x7fed98158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.088+0000 7fed9e5b7640 1 -- 172.21.15.7:0/3553352229 >> 172.21.15.7:0/3553352229 conn(0x7fed980b3130 msgr2=0x7fed98070bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:29.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.088+0000 7fed9e5b7640 1 -- 172.21.15.7:0/3553352229 shutdown_connections 2024-04-25T09:58:29.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.088+0000 7fed9e5b7640 1 -- 172.21.15.7:0/3553352229 wait complete. 2024-04-25T09:58:29.103 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-25T09:58:29.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.202+0000 7ff96005a640 1 Processor -- start 2024-04-25T09:58:29.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.202+0000 7ff96005a640 1 -- start start 2024-04-25T09:58:29.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.203+0000 7ff96005a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff95815deb0 0x7ff9580b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.203+0000 7ff96005a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9580ce030 0x7ff9580b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.203+0000 7ff96005a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff9580b6f20 0x7ff9580d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.203+0000 7ff96005a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9580d1a40 con 0x7ff9580b6f20 2024-04-25T09:58:29.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.203+0000 7ff96005a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9580d1d20 con 0x7ff95815deb0 2024-04-25T09:58:29.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.203+0000 7ff96005a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9580d2000 con 0x7ff9580ce030 2024-04-25T09:58:29.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.203+0000 7ff95e5f7640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff9580b6f20 0x7ff9580d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.203+0000 7ff95e5f7640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff9580b6f20 0x7ff9580d3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43312/0 (socket says 172.21.15.7:43312) 2024-04-25T09:58:29.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.203+0000 7ff95e5f7640 1 -- 172.21.15.7:0/24834488 learned_addr learned my addr 172.21.15.7:0/24834488 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:29.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.203+0000 7ff95d5f5640 1 --2- 172.21.15.7:0/24834488 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9580ce030 0x7ff9580b69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.203+0000 7ff95ddf6640 1 --2- 172.21.15.7:0/24834488 >> v2:172.21.15.55:3300/0 conn(0x7ff95815deb0 0x7ff9580b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.203+0000 7ff95e5f7640 1 -- 172.21.15.7:0/24834488 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9580ce030 msgr2=0x7ff9580b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:29.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.203+0000 7ff95e5f7640 1 --2- 172.21.15.7:0/24834488 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9580ce030 0x7ff9580b69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.203+0000 7ff95e5f7640 1 -- 172.21.15.7:0/24834488 >> v2:172.21.15.55:3300/0 conn(0x7ff95815deb0 msgr2=0x7ff9580b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:29.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.203+0000 7ff95e5f7640 1 --2- 172.21.15.7:0/24834488 >> v2:172.21.15.55:3300/0 conn(0x7ff95815deb0 0x7ff9580b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.203+0000 7ff95e5f7640 1 -- 172.21.15.7:0/24834488 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9580d22e0 con 0x7ff9580b6f20 2024-04-25T09:58:29.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.203+0000 7ff95ddf6640 1 --2- 172.21.15.7:0/24834488 >> v2:172.21.15.55:3300/0 conn(0x7ff95815deb0 0x7ff9580b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:29.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.204+0000 7ff95e5f7640 1 --2- 172.21.15.7:0/24834488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9580b6f20 0x7ff9580d3760 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7ff9580d43f0 tx=0x7ff95002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29547528aa5e44e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:29.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.204+0000 7ff95cdf4640 1 -- 172.21.15.7:0/24834488 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff950036070 con 0x7ff9580b6f20 2024-04-25T09:58:29.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.204+0000 7ff95cdf4640 1 -- 172.21.15.7:0/24834488 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff950031600 con 0x7ff9580b6f20 2024-04-25T09:58:29.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.204+0000 7ff95cdf4640 1 -- 172.21.15.7:0/24834488 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9500319d0 con 0x7ff9580b6f20 2024-04-25T09:58:29.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.205+0000 7ff96005a640 1 -- 172.21.15.7:0/24834488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9580b6f20 msgr2=0x7ff9580d3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:29.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.205+0000 7ff96005a640 1 --2- 172.21.15.7:0/24834488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9580b6f20 0x7ff9580d3760 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7ff9580d43f0 tx=0x7ff95002a6a0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.205+0000 7ff96005a640 1 -- 172.21.15.7:0/24834488 shutdown_connections 2024-04-25T09:58:29.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.205+0000 7ff96005a640 1 --2- 172.21.15.7:0/24834488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9580b6f20 0x7ff9580d3760 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.205+0000 7ff96005a640 1 --2- 172.21.15.7:0/24834488 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9580ce030 0x7ff9580b69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.205+0000 7ff96005a640 1 --2- 172.21.15.7:0/24834488 >> v2:172.21.15.55:3300/0 conn(0x7ff95815deb0 0x7ff9580b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.205+0000 7ff96005a640 1 -- 172.21.15.7:0/24834488 >> 172.21.15.7:0/24834488 conn(0x7ff9580726b0 msgr2=0x7ff958072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:29.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.205+0000 7ff96005a640 1 -- 172.21.15.7:0/24834488 shutdown_connections 2024-04-25T09:58:29.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.205+0000 7ff96005a640 1 -- 172.21.15.7:0/24834488 wait complete. 2024-04-25T09:58:29.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.206+0000 7ff96005a640 1 Processor -- start 2024-04-25T09:58:29.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.206+0000 7ff96005a640 1 -- start start 2024-04-25T09:58:29.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.207+0000 7ff96005a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9580b6f20 0x7ff958159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.207+0000 7ff96005a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9580ce030 0x7ff9580b5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.207+0000 7ff96005a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff95815deb0 0x7ff9580c9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.207+0000 7ff96005a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9580d3ca0 con 0x7ff95815deb0 2024-04-25T09:58:29.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.207+0000 7ff96005a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9580ce490 con 0x7ff9580ce030 2024-04-25T09:58:29.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.207+0000 7ff96005a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9580d3e20 con 0x7ff9580b6f20 2024-04-25T09:58:29.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.207+0000 7ff95e5f7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff95815deb0 0x7ff9580c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.207+0000 7ff95e5f7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff95815deb0 0x7ff9580c9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43318/0 (socket says 172.21.15.7:43318) 2024-04-25T09:58:29.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.207+0000 7ff95e5f7640 1 -- 172.21.15.7:0/3855974498 learned_addr learned my addr 172.21.15.7:0/3855974498 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:29.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.207+0000 7ff95d5f5640 1 --2- 172.21.15.7:0/3855974498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9580ce030 0x7ff9580b5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.207+0000 7ff95ddf6640 1 --2- 172.21.15.7:0/3855974498 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9580b6f20 0x7ff958159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.207+0000 7ff95e5f7640 1 -- 172.21.15.7:0/3855974498 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9580b6f20 msgr2=0x7ff958159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:29.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.207+0000 7ff95e5f7640 1 --2- 172.21.15.7:0/3855974498 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9580b6f20 0x7ff958159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.207+0000 7ff95e5f7640 1 -- 172.21.15.7:0/3855974498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9580ce030 msgr2=0x7ff9580b5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:29.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.207+0000 7ff95e5f7640 1 --2- 172.21.15.7:0/3855974498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9580ce030 0x7ff9580b5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.207+0000 7ff95e5f7640 1 -- 172.21.15.7:0/3855974498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff958159d80 con 0x7ff95815deb0 2024-04-25T09:58:29.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.208+0000 7ff95e5f7640 1 --2- 172.21.15.7:0/3855974498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff95815deb0 0x7ff9580c9150 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7ff950009f40 tx=0x7ff950004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:29.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.208+0000 7ff94e7fc640 1 -- 172.21.15.7:0/3855974498 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95003f020 con 0x7ff95815deb0 2024-04-25T09:58:29.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.208+0000 7ff94e7fc640 1 -- 172.21.15.7:0/3855974498 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff950037040 con 0x7ff95815deb0 2024-04-25T09:58:29.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.208+0000 7ff94e7fc640 1 -- 172.21.15.7:0/3855974498 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff950036070 con 0x7ff95815deb0 2024-04-25T09:58:29.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.208+0000 7ff96005a640 1 -- 172.21.15.7:0/3855974498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff958160740 con 0x7ff95815deb0 2024-04-25T09:58:29.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.208+0000 7ff96005a640 1 -- 172.21.15.7:0/3855974498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff958160d00 con 0x7ff95815deb0 2024-04-25T09:58:29.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.209+0000 7ff94e7fc640 1 -- 172.21.15.7:0/3855974498 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff950042020 con 0x7ff95815deb0 2024-04-25T09:58:29.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.210+0000 7ff94e7fc640 1 --2- 172.21.15.7:0/3855974498 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff93c06b500 0x7ff93c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.210+0000 7ff94e7fc640 1 -- 172.21.15.7:0/3855974498 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6217+0+0 (secure 0 0 0) 0x7ff9500aa7e0 con 0x7ff95815deb0 2024-04-25T09:58:29.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.210+0000 7ff95ddf6640 1 --2- 172.21.15.7:0/3855974498 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff93c06b500 0x7ff93c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.210+0000 7ff95ddf6640 1 --2- 172.21.15.7:0/3855974498 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff93c06b500 0x7ff93c06d9c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff954006fd0 tx=0x7ff954008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:29.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.211+0000 7ff962e34740 1 Processor -- start 2024-04-25T09:58:29.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.211+0000 7ff962e34740 1 -- start start 2024-04-25T09:58:29.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.211+0000 7ff962e34740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621c4d20590 0x5621c4d226f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.211+0000 7ff962e34740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621c4d5cc60 0x5621c4d20970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.211+0000 7ff962e34740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621c4d4b050 0x5621c4d4b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.211+0000 7ff962e34740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621c4c83c60 con 0x5621c4d4b050 2024-04-25T09:58:29.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.211+0000 7ff962e34740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621c4c22d80 con 0x5621c4d5cc60 2024-04-25T09:58:29.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.211+0000 7ff962e34740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5621c4c7fd00 con 0x5621c4d20590 2024-04-25T09:58:29.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.211+0000 7ff95e5f7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621c4d4b050 0x5621c4d4b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.212+0000 7ff95e5f7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621c4d4b050 0x5621c4d4b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43330/0 (socket says 172.21.15.7:43330) 2024-04-25T09:58:29.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.212+0000 7ff95e5f7640 1 -- 172.21.15.7:0/4187166942 learned_addr learned my addr 172.21.15.7:0/4187166942 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:29.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.212+0000 7ff95ddf6640 1 --2- 172.21.15.7:0/4187166942 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621c4d20590 0x5621c4d226f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.212+0000 7ff95d5f5640 1 --2- 172.21.15.7:0/4187166942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621c4d5cc60 0x5621c4d20970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.212+0000 7ff95e5f7640 1 -- 172.21.15.7:0/4187166942 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621c4d20590 msgr2=0x5621c4d226f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:29.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.212+0000 7ff95e5f7640 1 --2- 172.21.15.7:0/4187166942 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621c4d20590 0x5621c4d226f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.212+0000 7ff95e5f7640 1 -- 172.21.15.7:0/4187166942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621c4d5cc60 msgr2=0x5621c4d20970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:29.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.212+0000 7ff95e5f7640 1 --2- 172.21.15.7:0/4187166942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621c4d5cc60 0x5621c4d20970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.212+0000 7ff95e5f7640 1 -- 172.21.15.7:0/4187166942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621c4a647c0 con 0x5621c4d4b050 2024-04-25T09:58:29.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.212+0000 7ff95ddf6640 1 --2- 172.21.15.7:0/4187166942 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621c4d20590 0x5621c4d226f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:29.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.212+0000 7ff95d5f5640 1 --2- 172.21.15.7:0/4187166942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621c4d5cc60 0x5621c4d20970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:29.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.212+0000 7ff95e5f7640 1 --2- 172.21.15.7:0/4187166942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621c4d4b050 0x5621c4d4b4d0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7ff950034040 tx=0x7ff950009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56150cab27928953 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:29.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.212+0000 7ff93b7fe640 1 -- 172.21.15.7:0/4187166942 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95007ce20 con 0x5621c4d4b050 2024-04-25T09:58:29.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.212+0000 7ff93b7fe640 1 -- 172.21.15.7:0/4187166942 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff950081470 con 0x5621c4d4b050 2024-04-25T09:58:29.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.212+0000 7ff93b7fe640 1 -- 172.21.15.7:0/4187166942 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff950007bd0 con 0x5621c4d4b050 2024-04-25T09:58:29.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.213+0000 7ff962e34740 1 -- 172.21.15.7:0/4187166942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621c4d4b050 msgr2=0x5621c4d4b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:29.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.213+0000 7ff962e34740 1 --2- 172.21.15.7:0/4187166942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621c4d4b050 0x5621c4d4b4d0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7ff950034040 tx=0x7ff950009510 comp rx=0 tx=0).stop 2024-04-25T09:58:29.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.213+0000 7ff962e34740 1 -- 172.21.15.7:0/4187166942 shutdown_connections 2024-04-25T09:58:29.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.213+0000 7ff962e34740 1 --2- 172.21.15.7:0/4187166942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621c4d4b050 0x5621c4d4b4d0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.213+0000 7ff962e34740 1 --2- 172.21.15.7:0/4187166942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621c4d5cc60 0x5621c4d20970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.213+0000 7ff962e34740 1 --2- 172.21.15.7:0/4187166942 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621c4d20590 0x5621c4d226f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.213+0000 7ff962e34740 1 -- 172.21.15.7:0/4187166942 >> 172.21.15.7:0/4187166942 conn(0x5621c4ce86e0 msgr2=0x5621c4d66050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:29.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.213+0000 7ff962e34740 1 -- 172.21.15.7:0/4187166942 shutdown_connections 2024-04-25T09:58:29.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.213+0000 7ff962e34740 1 -- 172.21.15.7:0/4187166942 wait complete. 2024-04-25T09:58:29.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.213+0000 7ff962e34740 1 -- start start 2024-04-25T09:58:29.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.213+0000 7ff962e34740 1 Processor -- start 2024-04-25T09:58:29.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.214+0000 7ff962e34740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621c4d20590 0x5621c4d61850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.214+0000 7ff962e34740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621c4d4b050 0x5621c4d46b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.214+0000 7ff962e34740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621c4d5cc60 0x5621c4d4de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.214+0000 7ff962e34740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621c4c22d80 con 0x5621c4d20590 2024-04-25T09:58:29.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.214+0000 7ff962e34740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621c4c20840 con 0x5621c4d4b050 2024-04-25T09:58:29.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.214+0000 7ff962e34740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5621c4c83c60 con 0x5621c4d5cc60 2024-04-25T09:58:29.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.214+0000 7ff962e34740 10 client.0 _ll_register_callbacks cb 0x5621c4c3a980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:58:29.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.214+0000 7ff95ddf6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621c4d20590 0x5621c4d61850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.214+0000 7ff95ddf6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621c4d20590 0x5621c4d61850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43342/0 (socket says 172.21.15.7:43342) 2024-04-25T09:58:29.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.214+0000 7ff95ddf6640 1 -- 172.21.15.7:0/535710043 learned_addr learned my addr 172.21.15.7:0/535710043 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:29.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.215+0000 7ff95ddf6640 1 -- 172.21.15.7:0/535710043 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621c4d5cc60 msgr2=0x5621c4d4de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:29.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.215+0000 7ff95d5f5640 1 --2- 172.21.15.7:0/535710043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621c4d4b050 0x5621c4d46b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.215+0000 7ff95e5f7640 1 --2- 172.21.15.7:0/535710043 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621c4d5cc60 0x5621c4d4de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.215+0000 7ff95ddf6640 1 --2- 172.21.15.7:0/535710043 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621c4d5cc60 0x5621c4d4de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.215+0000 7ff95ddf6640 1 -- 172.21.15.7:0/535710043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621c4d4b050 msgr2=0x5621c4d46b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:29.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.215+0000 7ff95ddf6640 1 --2- 172.21.15.7:0/535710043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621c4d4b050 0x5621c4d46b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.215+0000 7ff95ddf6640 1 -- 172.21.15.7:0/535710043 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621c4ac4f50 con 0x5621c4d20590 2024-04-25T09:58:29.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.215+0000 7ff95d5f5640 1 --2- 172.21.15.7:0/535710043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621c4d4b050 0x5621c4d46b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:58:29.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.215+0000 7ff95ddf6640 1 --2- 172.21.15.7:0/535710043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621c4d20590 0x5621c4d61850 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7ff954006a70 tx=0x7ff954013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5077d899967c8202 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:29.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.215+0000 7ff938ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:58:29.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.215+0000 7ff938ff9640 1 -- 172.21.15.7:0/535710043 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95401c070 con 0x5621c4d20590 2024-04-25T09:58:29.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.215+0000 7ff938ff9640 1 -- 172.21.15.7:0/535710043 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(64..64 src has 1..64) v4 ==== 6217+0+0 (secure 0 0 0) 0x7ff954014780 con 0x5621c4d20590 2024-04-25T09:58:29.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.215+0000 7ff962e34740 1 -- 172.21.15.7:0/535710043 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff950081470 con 0x5621c4d20590 2024-04-25T09:58:29.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.215+0000 7ff938ff9640 1 -- 172.21.15.7:0/535710043 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff95402f050 con 0x5621c4d20590 2024-04-25T09:58:29.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.215+0000 7ff962e34740 10 client.6633 fetch_fsmap learned FSMap version 30 2024-04-25T09:58:29.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.215+0000 7ff962e34740 1 -- 172.21.15.7:0/535710043 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x5621c49580b0 con 0x5621c4d20590 2024-04-25T09:58:29.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.215+0000 7ff938ff9640 1 -- 172.21.15.7:0/535710043 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff950081470 con 0x5621c4d20590 2024-04-25T09:58:29.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.216+0000 7ff938ff9640 1 -- 172.21.15.7:0/535710043 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff954032020 con 0x5621c4d20590 2024-04-25T09:58:29.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.216+0000 7ff962e34740 10 client.6633 fetch_fsmap finished waiting for FSMap version 30 2024-04-25T09:58:29.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.216+0000 7ff962e34740 10 client.6633 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:58:29.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.216+0000 7ff962e34740 20 client.6633 populate_metadata read hostname 'smithi007' 2024-04-25T09:58:29.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.216+0000 7ff962e34740 1 --2- 172.21.15.7:0/535710043 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5621c4d5f990 0x5621c4d4b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.216+0000 7ff962e34740 4 client.6633 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:58:29.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.216+0000 7ff962e34740 1 -- 172.21.15.7:0/535710043 --> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5621c4c43e60 con 0x5621c4d5f990 2024-04-25T09:58:29.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.216+0000 7ff95d5f5640 1 --2- 172.21.15.7:0/535710043 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5621c4d5f990 0x5621c4d4b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.216+0000 7ff95d5f5640 1 --2- 172.21.15.7:0/535710043 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5621c4d5f990 0x5621c4d4b490 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c126815909554557 server_cookie=1174a905be37414b in_seq=0 out_seq=0 2024-04-25T09:58:29.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.216+0000 7ff938ff9640 10 client.6633 ms_handle_connect on v2:172.21.15.7:6834/3057688863 2024-04-25T09:58:29.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.217+0000 7ff938ff9640 1 -- 172.21.15.7:0/535710043 <== mds.0 v2:172.21.15.7:6834/3057688863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5621c4c43e60 con 0x5621c4d5f990 2024-04-25T09:58:29.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.217+0000 7ff938ff9640 10 client.6633 handle_command_reply: tid=0 2024-04-25T09:58:29.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.217+0000 7ff962e34740 1 client.6633 shutdown 2024-04-25T09:58:29.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.217+0000 7ff962e34740 1 -- 172.21.15.7:0/535710043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621c4d20590 msgr2=0x5621c4d61850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:29.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.217+0000 7ff962e34740 1 --2- 172.21.15.7:0/535710043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621c4d20590 0x5621c4d61850 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7ff954006a70 tx=0x7ff954013000 comp rx=0 tx=0).stop 2024-04-25T09:58:29.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.217+0000 7ff962e34740 1 -- 172.21.15.7:0/535710043 shutdown_connections 2024-04-25T09:58:29.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.217+0000 7ff962e34740 1 --2- 172.21.15.7:0/535710043 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5621c4d5f990 0x5621c4d4b490 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.217+0000 7ff962e34740 1 --2- 172.21.15.7:0/535710043 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621c4d5cc60 0x5621c4d4de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.217+0000 7ff938ff9640 0 client.6633 ms_handle_reset on v2:172.21.15.7:6834/3057688863 2024-04-25T09:58:29.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.217+0000 7ff962e34740 1 --2- 172.21.15.7:0/535710043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621c4d4b050 0x5621c4d46b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.217+0000 7ff962e34740 1 --2- 172.21.15.7:0/535710043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621c4d20590 0x5621c4d61850 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.217+0000 7ff962e34740 1 -- 172.21.15.7:0/535710043 >> 172.21.15.7:0/535710043 conn(0x5621c4ce86e0 msgr2=0x5621c4d695d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:29.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.217+0000 7ff962e34740 1 -- 172.21.15.7:0/535710043 shutdown_connections 2024-04-25T09:58:29.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.217+0000 7ff962e34740 1 -- 172.21.15.7:0/535710043 wait complete. 2024-04-25T09:58:29.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.217+0000 7ff962e34740 20 client.6633 trim_cache size 0 max 16384 2024-04-25T09:58:29.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.229+0000 7ff962e34740 1 Processor -- start 2024-04-25T09:58:29.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.229+0000 7ff962e34740 1 -- start start 2024-04-25T09:58:29.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.230+0000 7ff962e34740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621c4d20590 0x5621c4d4ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.230+0000 7ff962e34740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621c4d4b050 0x5621c4d4c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.230+0000 7ff962e34740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621c4d5cc60 0x5621c4d1ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.230+0000 7ff962e34740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9581ff760 con 0x5621c4d4b050 2024-04-25T09:58:29.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.230+0000 7ff962e34740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9580cccc0 con 0x5621c4d5cc60 2024-04-25T09:58:29.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.230+0000 7ff962e34740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9581ff160 con 0x5621c4d20590 2024-04-25T09:58:29.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.230+0000 7ff95d5f5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621c4d4b050 0x5621c4d4c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.230+0000 7ff95d5f5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621c4d4b050 0x5621c4d4c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43350/0 (socket says 172.21.15.7:43350) 2024-04-25T09:58:29.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.230+0000 7ff95d5f5640 1 -- 172.21.15.7:0/4055576102 learned_addr learned my addr 172.21.15.7:0/4055576102 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:29.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.230+0000 7ff95e5f7640 1 --2- 172.21.15.7:0/4055576102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621c4d5cc60 0x5621c4d1ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.230+0000 7ff95ddf6640 1 --2- 172.21.15.7:0/4055576102 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621c4d20590 0x5621c4d4ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.230+0000 7ff95d5f5640 1 -- 172.21.15.7:0/4055576102 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621c4d20590 msgr2=0x5621c4d4ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:29.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.230+0000 7ff95d5f5640 1 --2- 172.21.15.7:0/4055576102 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621c4d20590 0x5621c4d4ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.230+0000 7ff95d5f5640 1 -- 172.21.15.7:0/4055576102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621c4d5cc60 msgr2=0x5621c4d1ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:29.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.230+0000 7ff95d5f5640 1 --2- 172.21.15.7:0/4055576102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621c4d5cc60 0x5621c4d1ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.230+0000 7ff95d5f5640 1 -- 172.21.15.7:0/4055576102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621c4d44700 con 0x5621c4d4b050 2024-04-25T09:58:29.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.230+0000 7ff95e5f7640 1 --2- 172.21.15.7:0/4055576102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621c4d5cc60 0x5621c4d1ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:29.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.230+0000 7ff95d5f5640 1 --2- 172.21.15.7:0/4055576102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621c4d4b050 0x5621c4d4c750 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7ff94800b4b0 tx=0x7ff948003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef62624c8ad4d4a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:29.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.230+0000 7ff93affd640 1 -- 172.21.15.7:0/4055576102 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff948003e40 con 0x5621c4d4b050 2024-04-25T09:58:29.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.231+0000 7ff93affd640 1 -- 172.21.15.7:0/4055576102 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94800b970 con 0x5621c4d4b050 2024-04-25T09:58:29.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.231+0000 7ff93affd640 1 -- 172.21.15.7:0/4055576102 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94800bd20 con 0x5621c4d4b050 2024-04-25T09:58:29.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.231+0000 7ff962e34740 1 -- 172.21.15.7:0/4055576102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621c4d4b050 msgr2=0x5621c4d4c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:29.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.231+0000 7ff962e34740 1 --2- 172.21.15.7:0/4055576102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621c4d4b050 0x5621c4d4c750 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7ff94800b4b0 tx=0x7ff948003b90 comp rx=0 tx=0).stop 2024-04-25T09:58:29.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.231+0000 7ff962e34740 1 -- 172.21.15.7:0/4055576102 shutdown_connections 2024-04-25T09:58:29.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.231+0000 7ff962e34740 1 --2- 172.21.15.7:0/4055576102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621c4d5cc60 0x5621c4d1ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.231+0000 7ff962e34740 1 --2- 172.21.15.7:0/4055576102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621c4d4b050 0x5621c4d4c750 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.231+0000 7ff962e34740 1 --2- 172.21.15.7:0/4055576102 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621c4d20590 0x5621c4d4ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.231+0000 7ff962e34740 1 -- 172.21.15.7:0/4055576102 >> 172.21.15.7:0/4055576102 conn(0x5621c4ce86e0 msgr2=0x5621c4d46a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:29.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.231+0000 7ff962e34740 1 -- 172.21.15.7:0/4055576102 shutdown_connections 2024-04-25T09:58:29.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.231+0000 7ff962e34740 1 -- 172.21.15.7:0/4055576102 wait complete. 2024-04-25T09:58:29.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.232+0000 7ff962e34740 1 -- start start 2024-04-25T09:58:29.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.232+0000 7ff962e34740 1 Processor -- start 2024-04-25T09:58:29.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.233+0000 7ff962e34740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621c4d20590 0x5621c4db5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.233+0000 7ff962e34740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621c4d4b050 0x5621c4d1a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.233+0000 7ff962e34740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621c4d5cc60 0x5621c4d4b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.233+0000 7ff962e34740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621c4d5f810 con 0x5621c4d20590 2024-04-25T09:58:29.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.233+0000 7ff962e34740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621c4d4e340 con 0x5621c4d5cc60 2024-04-25T09:58:29.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.233+0000 7ff962e34740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5621c4d75980 con 0x5621c4d4b050 2024-04-25T09:58:29.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.233+0000 7ff962e34740 10 client.0 _ll_register_callbacks cb 0x7ff95002abe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:58:29.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.233+0000 7ff95ddf6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621c4d20590 0x5621c4db5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.233+0000 7ff95ddf6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621c4d20590 0x5621c4db5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43358/0 (socket says 172.21.15.7:43358) 2024-04-25T09:58:29.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.233+0000 7ff95ddf6640 1 -- 172.21.15.7:0/4089038876 learned_addr learned my addr 172.21.15.7:0/4089038876 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:29.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.233+0000 7ff95e5f7640 1 --2- 172.21.15.7:0/4089038876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621c4d5cc60 0x5621c4d4b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.233+0000 7ff95d5f5640 1 --2- 172.21.15.7:0/4089038876 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621c4d4b050 0x5621c4d1a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.233+0000 7ff95ddf6640 1 -- 172.21.15.7:0/4089038876 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621c4d4b050 msgr2=0x5621c4d1a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:29.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.233+0000 7ff95ddf6640 1 --2- 172.21.15.7:0/4089038876 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621c4d4b050 0x5621c4d1a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.233+0000 7ff95ddf6640 1 -- 172.21.15.7:0/4089038876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621c4d5cc60 msgr2=0x5621c4d4b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:29.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.233+0000 7ff95ddf6640 1 --2- 172.21.15.7:0/4089038876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621c4d5cc60 0x5621c4d4b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.233+0000 7ff95ddf6640 1 -- 172.21.15.7:0/4089038876 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621c4d46b40 con 0x5621c4d20590 2024-04-25T09:58:29.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.233+0000 7ff95e5f7640 1 --2- 172.21.15.7:0/4089038876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621c4d5cc60 0x5621c4d4b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:29.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.233+0000 7ff95ddf6640 1 --2- 172.21.15.7:0/4089038876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621c4d20590 0x5621c4db5580 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7ff95400c010 tx=0x7ff954004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44064032dcab7e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:29.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.233+0000 7ff938ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:58:29.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.233+0000 7ff938ff9640 1 -- 172.21.15.7:0/4089038876 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95401c070 con 0x5621c4d20590 2024-04-25T09:58:29.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.233+0000 7ff938ff9640 1 -- 172.21.15.7:0/4089038876 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(64..64 src has 1..64) v4 ==== 6217+0+0 (secure 0 0 0) 0x7ff954014d30 con 0x5621c4d20590 2024-04-25T09:58:29.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.233+0000 7ff962e34740 1 -- 172.21.15.7:0/4089038876 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff94800b970 con 0x5621c4d20590 2024-04-25T09:58:29.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.233+0000 7ff938ff9640 1 -- 172.21.15.7:0/4089038876 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff954044050 con 0x5621c4d20590 2024-04-25T09:58:29.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.233+0000 7ff962e34740 10 client.6639 fetch_fsmap learned FSMap version 30 2024-04-25T09:58:29.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.233+0000 7ff962e34740 1 -- 172.21.15.7:0/4089038876 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x5621c4d1f1d0 con 0x5621c4d20590 2024-04-25T09:58:29.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.234+0000 7ff938ff9640 1 -- 172.21.15.7:0/4089038876 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94800b970 con 0x5621c4d20590 2024-04-25T09:58:29.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.234+0000 7ff938ff9640 1 -- 172.21.15.7:0/4089038876 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 30) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff954047020 con 0x5621c4d20590 2024-04-25T09:58:29.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.234+0000 7ff962e34740 10 client.6639 fetch_fsmap finished waiting for FSMap version 30 2024-04-25T09:58:29.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.234+0000 7ff962e34740 10 client.6639 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:58:29.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.234+0000 7ff962e34740 20 client.6639 populate_metadata read hostname 'smithi007' 2024-04-25T09:58:29.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.234+0000 7ff962e34740 1 --2- 172.21.15.7:0/4089038876 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5621c4d5c600 0x5621c4d49810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.234+0000 7ff962e34740 4 client.6639 mds_command: new command op to 6285 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T09:58:29.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.234+0000 7ff962e34740 1 -- 172.21.15.7:0/4089038876 --> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x5621c4c911a0 con 0x5621c4d5c600 2024-04-25T09:58:29.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.234+0000 7ff95d5f5640 1 --2- 172.21.15.7:0/4089038876 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5621c4d5c600 0x5621c4d49810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.234+0000 7ff938ff9640 10 client.6639 ms_handle_connect on v2:172.21.15.7:6834/3057688863 2024-04-25T09:58:29.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.234+0000 7ff95d5f5640 1 --2- 172.21.15.7:0/4089038876 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5621c4d5c600 0x5621c4d49810 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1cdb07a86c76caa server_cookie=7e49af9fb62d6e09 in_seq=0 out_seq=0 2024-04-25T09:58:29.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.234+0000 7ff938ff9640 1 -- 172.21.15.7:0/4089038876 <== mds.0 v2:172.21.15.7:6834/3057688863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5621c4c911a0 con 0x5621c4d5c600 2024-04-25T09:58:29.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.234+0000 7ff938ff9640 10 client.6639 handle_command_reply: tid=0 2024-04-25T09:58:29.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.234+0000 7ff962e34740 1 client.6639 shutdown 2024-04-25T09:58:29.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.234+0000 7ff962e34740 1 -- 172.21.15.7:0/4089038876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621c4d20590 msgr2=0x5621c4db5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:29.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.234+0000 7ff962e34740 1 --2- 172.21.15.7:0/4089038876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621c4d20590 0x5621c4db5580 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7ff95400c010 tx=0x7ff954004730 comp rx=0 tx=0).stop 2024-04-25T09:58:29.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.235+0000 7ff962e34740 1 -- 172.21.15.7:0/4089038876 shutdown_connections 2024-04-25T09:58:29.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.235+0000 7ff962e34740 1 --2- 172.21.15.7:0/4089038876 >> [v2:172.21.15.7:6834/3057688863,v1:172.21.15.7:6836/3057688863] conn(0x5621c4d5c600 0x5621c4d49810 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.235+0000 7ff962e34740 1 --2- 172.21.15.7:0/4089038876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621c4d5cc60 0x5621c4d4b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.235+0000 7ff962e34740 1 --2- 172.21.15.7:0/4089038876 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621c4d4b050 0x5621c4d1a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.235+0000 7ff938ff9640 0 client.6639 ms_handle_reset on v2:172.21.15.7:6834/3057688863 2024-04-25T09:58:29.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.235+0000 7ff962e34740 1 --2- 172.21.15.7:0/4089038876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621c4d20590 0x5621c4db5580 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.235+0000 7ff962e34740 1 -- 172.21.15.7:0/4089038876 >> 172.21.15.7:0/4089038876 conn(0x5621c4ce86e0 msgr2=0x5621c4d1bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:29.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.235+0000 7ff962e34740 1 -- 172.21.15.7:0/4089038876 shutdown_connections 2024-04-25T09:58:29.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.235+0000 7ff962e34740 1 -- 172.21.15.7:0/4089038876 wait complete. 2024-04-25T09:58:29.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.235+0000 7ff962e34740 20 client.6639 trim_cache size 0 max 16384 2024-04-25T09:58:29.245 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:58:29.245 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-04-25T09:58:29.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.235+0000 7ff96005a640 1 -- 172.21.15.7:0/3855974498 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff93c06b500 msgr2=0x7ff93c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:29.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.235+0000 7ff96005a640 1 --2- 172.21.15.7:0/3855974498 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff93c06b500 0x7ff93c06d9c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff954006fd0 tx=0x7ff954008040 comp rx=0 tx=0).stop 2024-04-25T09:58:29.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.235+0000 7ff96005a640 1 -- 172.21.15.7:0/3855974498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff95815deb0 msgr2=0x7ff9580c9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:29.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.235+0000 7ff96005a640 1 --2- 172.21.15.7:0/3855974498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff95815deb0 0x7ff9580c9150 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7ff950009f40 tx=0x7ff950004a40 comp rx=0 tx=0).stop 2024-04-25T09:58:29.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.235+0000 7ff96005a640 1 -- 172.21.15.7:0/3855974498 shutdown_connections 2024-04-25T09:58:29.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.235+0000 7ff96005a640 1 --2- 172.21.15.7:0/3855974498 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff93c06b500 0x7ff93c06d9c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.235+0000 7ff96005a640 1 --2- 172.21.15.7:0/3855974498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff95815deb0 0x7ff9580c9150 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.235+0000 7ff96005a640 1 --2- 172.21.15.7:0/3855974498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9580ce030 0x7ff9580b5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.235+0000 7ff96005a640 1 --2- 172.21.15.7:0/3855974498 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9580b6f20 0x7ff958159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.235+0000 7ff96005a640 1 -- 172.21.15.7:0/3855974498 >> 172.21.15.7:0/3855974498 conn(0x7ff9580726b0 msgr2=0x7ff9580c7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:29.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.235+0000 7ff96005a640 1 -- 172.21.15.7:0/3855974498 shutdown_connections 2024-04-25T09:58:29.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.235+0000 7ff96005a640 1 -- 172.21.15.7:0/3855974498 wait complete. 2024-04-25T09:58:29.250 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T09:58:29.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.345+0000 7f83cbbe0640 1 Processor -- start 2024-04-25T09:58:29.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.345+0000 7f83cbbe0640 1 -- start start 2024-04-25T09:58:29.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.346+0000 7f83cbbe0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f83c415dad0 0x7f83c40d18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.346+0000 7f83cbbe0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f83c40b9580 0x7f83c40d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.346+0000 7f83cbbe0640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c40d2240 con 0x7f83c40d32e0 2024-04-25T09:58:29.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.346+0000 7f83cbbe0640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83c40b7990 con 0x7f83c40b9580 2024-04-25T09:58:29.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.346+0000 7f83cbbe0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c40d2520 con 0x7f83c415dad0 2024-04-25T09:58:29.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.346+0000 7f83c917b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f83c40b9580 0x7f83c40d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.346+0000 7f83c997c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f83c415dad0 0x7f83c40d18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.347+0000 7f83ca17d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f83c40d32e0 0x7f83c40b52d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:46086/0 (socket says 172.21.15.7:46086) 2024-04-25T09:58:29.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.347+0000 7f83ca17d640 1 -- 172.21.15.7:0/2693817313 learned_addr learned my addr 172.21.15.7:0/2693817313 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:29.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.347+0000 7f83c897a640 1 -- 172.21.15.7:0/2693817313 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3842579172 0 0) 0x7f83c40d2240 con 0x7f83c40d32e0 2024-04-25T09:58:29.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.347+0000 7f83c997c640 1 -- 172.21.15.7:0/2693817313 >> v2:172.21.15.55:3300/0 conn(0x7f83c40b9580 msgr2=0x7f83c40d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:29.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.347+0000 7f83c997c640 1 --2- 172.21.15.7:0/2693817313 >> v2:172.21.15.55:3300/0 conn(0x7f83c40b9580 0x7f83c40d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.347+0000 7f83c997c640 1 -- 172.21.15.7:0/2693817313 >> v1:172.21.15.55:6789/0 conn(0x7f83c40d32e0 legacy=0x7f83c40b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:29.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.347+0000 7f83c997c640 1 -- 172.21.15.7:0/2693817313 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c40d2800 con 0x7f83c415dad0 2024-04-25T09:58:29.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.348+0000 7f83c997c640 1 --2- 172.21.15.7:0/2693817313 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f83c415dad0 0x7f83c40d18d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f83bc0097a0 tx=0x7f83bc02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db0080660fdcc09d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:29.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.348+0000 7f83c897a640 1 -- 172.21.15.7:0/2693817313 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc037070 con 0x7f83c415dad0 2024-04-25T09:58:29.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.348+0000 7f83c897a640 1 -- 172.21.15.7:0/2693817313 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83bc032440 con 0x7f83c415dad0 2024-04-25T09:58:29.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.348+0000 7f83c897a640 1 -- 172.21.15.7:0/2693817313 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc032810 con 0x7f83c415dad0 2024-04-25T09:58:29.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.348+0000 7f83cbbe0640 1 -- 172.21.15.7:0/2693817313 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f83c415dad0 msgr2=0x7f83c40d18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:29.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.348+0000 7f83cbbe0640 1 --2- 172.21.15.7:0/2693817313 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f83c415dad0 0x7f83c40d18d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f83bc0097a0 tx=0x7f83bc02a210 comp rx=0 tx=0).stop 2024-04-25T09:58:29.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.348+0000 7f83cbbe0640 1 -- 172.21.15.7:0/2693817313 shutdown_connections 2024-04-25T09:58:29.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.348+0000 7f83cbbe0640 1 --2- 172.21.15.7:0/2693817313 >> v2:172.21.15.55:3300/0 conn(0x7f83c40b9580 0x7f83c40d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.348+0000 7f83cbbe0640 1 --2- 172.21.15.7:0/2693817313 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f83c415dad0 0x7f83c40d18d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.348+0000 7f83cbbe0640 1 -- 172.21.15.7:0/2693817313 >> 172.21.15.7:0/2693817313 conn(0x7f83c406bfe0 msgr2=0x7f83c406c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:29.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.349+0000 7f83cbbe0640 1 -- 172.21.15.7:0/2693817313 shutdown_connections 2024-04-25T09:58:29.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.349+0000 7f83cbbe0640 1 -- 172.21.15.7:0/2693817313 wait complete. 2024-04-25T09:58:29.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.350+0000 7f83cbbe0640 1 Processor -- start 2024-04-25T09:58:29.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.350+0000 7f83cbbe0640 1 -- start start 2024-04-25T09:58:29.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.350+0000 7f83cbbe0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83c40b9580 0x7f83c4160340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.350+0000 7f83cbbe0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83c40d32e0 0x7f83c415ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.350+0000 7f83cbbe0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f83c415dad0 0x7f83c4147560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.350+0000 7f83cbbe0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c415deb0 con 0x7f83c40b9580 2024-04-25T09:58:29.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.351+0000 7f83cbbe0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c40d2dc0 con 0x7f83c40d32e0 2024-04-25T09:58:29.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.351+0000 7f83cbbe0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c40ca920 con 0x7f83c415dad0 2024-04-25T09:58:29.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.351+0000 7f83c997c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83c40b9580 0x7f83c4160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.351+0000 7f83c997c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83c40b9580 0x7f83c4160340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43360/0 (socket says 172.21.15.7:43360) 2024-04-25T09:58:29.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.351+0000 7f83c997c640 1 -- 172.21.15.7:0/2459833353 learned_addr learned my addr 172.21.15.7:0/2459833353 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:29.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.351+0000 7f83c917b640 1 --2- 172.21.15.7:0/2459833353 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83c40d32e0 0x7f83c415ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.351+0000 7f83ca17d640 1 --2- 172.21.15.7:0/2459833353 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f83c415dad0 0x7f83c4147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.351+0000 7f83c997c640 1 -- 172.21.15.7:0/2459833353 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f83c415dad0 msgr2=0x7f83c4147560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:29.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.351+0000 7f83c997c640 1 --2- 172.21.15.7:0/2459833353 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f83c415dad0 0x7f83c4147560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.351+0000 7f83c997c640 1 -- 172.21.15.7:0/2459833353 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83c40d32e0 msgr2=0x7f83c415ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:29.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.351+0000 7f83c997c640 1 --2- 172.21.15.7:0/2459833353 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83c40d32e0 0x7f83c415ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.351+0000 7f83c997c640 1 -- 172.21.15.7:0/2459833353 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c40cab70 con 0x7f83c40b9580 2024-04-25T09:58:29.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.351+0000 7f83c997c640 1 --2- 172.21.15.7:0/2459833353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83c40b9580 0x7f83c4160340 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f83bc000c00 tx=0x7f83bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:29.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.351+0000 7f83c27fc640 1 -- 172.21.15.7:0/2459833353 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc037050 con 0x7f83c40b9580 2024-04-25T09:58:29.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.351+0000 7f83c27fc640 1 -- 172.21.15.7:0/2459833353 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83bc038040 con 0x7f83c40b9580 2024-04-25T09:58:29.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.351+0000 7f83cbbe0640 1 -- 172.21.15.7:0/2459833353 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c40cae50 con 0x7f83c40b9580 2024-04-25T09:58:29.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.351+0000 7f83c27fc640 1 -- 172.21.15.7:0/2459833353 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc004470 con 0x7f83c40b9580 2024-04-25T09:58:29.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.351+0000 7f83cbbe0640 1 -- 172.21.15.7:0/2459833353 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c40cd350 con 0x7f83c40b9580 2024-04-25T09:58:29.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.352+0000 7f83cbbe0640 1 -- 172.21.15.7:0/2459833353 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c4074bb0 con 0x7f83c40b9580 2024-04-25T09:58:29.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.353+0000 7f83c27fc640 1 -- 172.21.15.7:0/2459833353 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f83bc03c6d0 con 0x7f83c40b9580 2024-04-25T09:58:29.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.353+0000 7f83c27fc640 1 --2- 172.21.15.7:0/2459833353 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f83b006b4d0 0x7f83b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.353+0000 7f83c27fc640 1 -- 172.21.15.7:0/2459833353 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f83bc0aad60 con 0x7f83c40b9580 2024-04-25T09:58:29.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.353+0000 7f83c917b640 1 --2- 172.21.15.7:0/2459833353 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f83b006b4d0 0x7f83b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.354+0000 7f83c917b640 1 --2- 172.21.15.7:0/2459833353 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f83b006b4d0 0x7f83b006d990 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f83c40c9ac0 tx=0x7f83b8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:29.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.358+0000 7f83c27fc640 1 -- 172.21.15.7:0/2459833353 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f83bc079a70 con 0x7f83c40b9580 2024-04-25T09:58:29.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.577+0000 7f83cbbe0640 1 -- 172.21.15.7:0/2459833353 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f83c40d4270 con 0x7f83c40b9580 2024-04-25T09:58:29.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.577+0000 7f83c27fc640 1 -- 172.21.15.7:0/2459833353 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f83bc079370 con 0x7f83c40b9580 2024-04-25T09:58:29.582 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:58:29.582 INFO:teuthology.orchestra.run.smithi007.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T09:58:29.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.579+0000 7f83cbbe0640 1 -- 172.21.15.7:0/2459833353 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f83b006b4d0 msgr2=0x7f83b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:29.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.579+0000 7f83cbbe0640 1 --2- 172.21.15.7:0/2459833353 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f83b006b4d0 0x7f83b006d990 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f83c40c9ac0 tx=0x7f83b8009190 comp rx=0 tx=0).stop 2024-04-25T09:58:29.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.579+0000 7f83cbbe0640 1 -- 172.21.15.7:0/2459833353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83c40b9580 msgr2=0x7f83c4160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:29.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.579+0000 7f83cbbe0640 1 --2- 172.21.15.7:0/2459833353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83c40b9580 0x7f83c4160340 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f83bc000c00 tx=0x7f83bc0046c0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.579+0000 7f83cbbe0640 1 -- 172.21.15.7:0/2459833353 shutdown_connections 2024-04-25T09:58:29.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.579+0000 7f83cbbe0640 1 --2- 172.21.15.7:0/2459833353 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f83b006b4d0 0x7f83b006d990 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.579+0000 7f83cbbe0640 1 --2- 172.21.15.7:0/2459833353 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f83c415dad0 0x7f83c4147560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.579+0000 7f83cbbe0640 1 --2- 172.21.15.7:0/2459833353 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83c40d32e0 0x7f83c415ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.579+0000 7f83cbbe0640 1 --2- 172.21.15.7:0/2459833353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83c40b9580 0x7f83c4160340 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.579+0000 7f83cbbe0640 1 -- 172.21.15.7:0/2459833353 >> 172.21.15.7:0/2459833353 conn(0x7f83c406bfe0 msgr2=0x7f83c415adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:29.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.580+0000 7f83cbbe0640 1 -- 172.21.15.7:0/2459833353 shutdown_connections 2024-04-25T09:58:29.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.580+0000 7f83cbbe0640 1 -- 172.21.15.7:0/2459833353 wait complete. 2024-04-25T09:58:29.594 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T09:58:29.594 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:58:29.594 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:58:29.634 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:58:29.677 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:58:29.677 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:58:29.677 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:58:29.693 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:58:29.693 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:58:29.750 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:58:29.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.886+0000 7f943b0ee640 1 Processor -- start 2024-04-25T09:58:29.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.887+0000 7f943b0ee640 1 -- start start 2024-04-25T09:58:29.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.887+0000 7f943b0ee640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f943406cb10 0x7f94340cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.887+0000 7f943b0ee640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9434099b90 con 0x7f943406c680 2024-04-25T09:58:29.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.887+0000 7f943b0ee640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9434099e70 con 0x7f94340cd740 2024-04-25T09:58:29.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.887+0000 7f943b0ee640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94340cdb20 con 0x7f943406cb10 2024-04-25T09:58:29.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.888+0000 7f9433fff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f943406c680 0x7f94340cbc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45618/0 (socket says 172.21.15.7:45618) 2024-04-25T09:58:29.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.888+0000 7f9433fff640 1 -- 172.21.15.7:0/3205018692 learned_addr learned my addr 172.21.15.7:0/3205018692 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:29.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.888+0000 7f943968b640 1 --2- 172.21.15.7:0/3205018692 >> v2:172.21.15.55:3300/0 conn(0x7f943406cb10 0x7f94340cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.888+0000 7f94337fe640 1 -- 172.21.15.7:0/3205018692 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4088702267 0 0) 0x7f9434099b90 con 0x7f943406c680 2024-04-25T09:58:29.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.888+0000 7f94337fe640 1 -- 172.21.15.7:0/3205018692 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9424003520 con 0x7f943406c680 2024-04-25T09:58:29.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.888+0000 7f94337fe640 1 -- 172.21.15.7:0/3205018692 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1633784190 0 0) 0x7f9434099e70 con 0x7f94340cd740 2024-04-25T09:58:29.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.888+0000 7f94337fe640 1 -- 172.21.15.7:0/3205018692 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9434099b90 con 0x7f94340cd740 2024-04-25T09:58:29.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.888+0000 7f94337fe640 1 -- 172.21.15.7:0/3205018692 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2014471406 0 0) 0x7f9424003520 con 0x7f943406c680 2024-04-25T09:58:29.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.888+0000 7f94337fe640 1 -- 172.21.15.7:0/3205018692 >> v2:172.21.15.55:3300/0 conn(0x7f943406cb10 msgr2=0x7f94340cc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:29.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.888+0000 7f94337fe640 1 --2- 172.21.15.7:0/3205018692 >> v2:172.21.15.55:3300/0 conn(0x7f943406cb10 0x7f94340cc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.888+0000 7f94337fe640 1 -- 172.21.15.7:0/3205018692 >> v1:172.21.15.55:6789/0 conn(0x7f94340cd740 legacy=0x7f94340d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:29.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.888+0000 7f94337fe640 1 -- 172.21.15.7:0/3205018692 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943409a150 con 0x7f943406c680 2024-04-25T09:58:29.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.888+0000 7f94337fe640 1 -- 172.21.15.7:0/3205018692 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f9420001670 con 0x7f943406c680 2024-04-25T09:58:29.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.888+0000 7f94337fe640 1 -- 172.21.15.7:0/3205018692 >> v1:172.21.15.7:6789/0 conn(0x7f943406c680 legacy=0x7f94340cbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:29.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.888+0000 7f94337fe640 1 --2- 172.21.15.7:0/3205018692 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9424003b90 0x7f9424003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.888+0000 7f94337fe640 1 --2- 172.21.15.7:0/3205018692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9424004800 0x7f9424004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.888+0000 7f94337fe640 1 --2- 172.21.15.7:0/3205018692 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f94240051c0 0x7f942400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.888+0000 7f94337fe640 1 -- 172.21.15.7:0/3205018692 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942400c090 con 0x7f9424004800 2024-04-25T09:58:29.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.888+0000 7f94337fe640 1 -- 172.21.15.7:0/3205018692 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942400c210 con 0x7f9424003b90 2024-04-25T09:58:29.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.888+0000 7f94337fe640 1 -- 172.21.15.7:0/3205018692 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f942400c410 con 0x7f94240051c0 2024-04-25T09:58:29.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.888+0000 7f9433fff640 1 --2- 172.21.15.7:0/3205018692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9424004800 0x7f9424004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.888+0000 7f9438e8a640 1 --2- 172.21.15.7:0/3205018692 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9424003b90 0x7f9424003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.888+0000 7f943968b640 1 --2- 172.21.15.7:0/3205018692 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f94240051c0 0x7f942400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.889+0000 7f9433fff640 1 -- 172.21.15.7:0/3205018692 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f94240051c0 msgr2=0x7f942400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:29.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.889+0000 7f9433fff640 1 --2- 172.21.15.7:0/3205018692 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f94240051c0 0x7f942400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.889+0000 7f9433fff640 1 -- 172.21.15.7:0/3205018692 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9424003b90 msgr2=0x7f9424003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:29.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.889+0000 7f9433fff640 1 --2- 172.21.15.7:0/3205018692 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9424003b90 0x7f9424003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.889+0000 7f9433fff640 1 -- 172.21.15.7:0/3205018692 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9424003520 con 0x7f9424004800 2024-04-25T09:58:29.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.889+0000 7f943968b640 1 -- 172.21.15.7:0/3205018692 reap_dead start 2024-04-25T09:58:29.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.889+0000 7f9433fff640 1 --2- 172.21.15.7:0/3205018692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9424004800 0x7f9424004c80 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f9420007fd0 tx=0x7f9424005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f801342c4ea04d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:29.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.889+0000 7f94337fe640 1 -- 172.21.15.7:0/3205018692 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9420007c20 con 0x7f9424004800 2024-04-25T09:58:29.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.889+0000 7f94337fe640 1 -- 172.21.15.7:0/3205018692 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9420005af0 con 0x7f9424004800 2024-04-25T09:58:29.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.889+0000 7f94337fe640 1 -- 172.21.15.7:0/3205018692 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9420007070 con 0x7f9424004800 2024-04-25T09:58:29.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.890+0000 7f943b0ee640 1 -- 172.21.15.7:0/3205018692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9424004800 msgr2=0x7f9424004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:29.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.890+0000 7f943b0ee640 1 --2- 172.21.15.7:0/3205018692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9424004800 0x7f9424004c80 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f9420007fd0 tx=0x7f9424005830 comp rx=0 tx=0).stop 2024-04-25T09:58:29.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.890+0000 7f943b0ee640 1 -- 172.21.15.7:0/3205018692 shutdown_connections 2024-04-25T09:58:29.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.890+0000 7f943b0ee640 1 --2- 172.21.15.7:0/3205018692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9424004800 0x7f9424004c80 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.890+0000 7f943b0ee640 1 -- 172.21.15.7:0/3205018692 >> 172.21.15.7:0/3205018692 conn(0x7f94340b3130 msgr2=0x7f94340b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:29.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.890+0000 7f943b0ee640 1 -- 172.21.15.7:0/3205018692 shutdown_connections 2024-04-25T09:58:29.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.890+0000 7f943b0ee640 1 -- 172.21.15.7:0/3205018692 wait complete. 2024-04-25T09:58:29.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.891+0000 7f943b0ee640 1 Processor -- start 2024-04-25T09:58:29.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.891+0000 7f943b0ee640 1 -- start start 2024-04-25T09:58:29.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.892+0000 7f943b0ee640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9424004800 0x7f9434156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.892+0000 7f943b0ee640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94341f4950 0x7f94340c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.892+0000 7f943b0ee640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9434159150 0x7f9434159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.892+0000 7f943b0ee640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943406cf40 con 0x7f9424004800 2024-04-25T09:58:29.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.892+0000 7f943b0ee640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943409a710 con 0x7f94341f4950 2024-04-25T09:58:29.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.892+0000 7f943b0ee640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943409ac30 con 0x7f9434159150 2024-04-25T09:58:29.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.892+0000 7f9438e8a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9424004800 0x7f9434156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.892+0000 7f9438e8a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9424004800 0x7f9434156ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48394/0 (socket says 172.21.15.7:48394) 2024-04-25T09:58:29.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.892+0000 7f9438e8a640 1 -- 172.21.15.7:0/3287291625 learned_addr learned my addr 172.21.15.7:0/3287291625 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:29.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.892+0000 7f9433fff640 1 --2- 172.21.15.7:0/3287291625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94341f4950 0x7f94340c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.892+0000 7f943968b640 1 --2- 172.21.15.7:0/3287291625 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9434159150 0x7f9434159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.893+0000 7f9438e8a640 1 -- 172.21.15.7:0/3287291625 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9434159150 msgr2=0x7f9434159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:29.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.893+0000 7f9438e8a640 1 --2- 172.21.15.7:0/3287291625 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9434159150 0x7f9434159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.893+0000 7f9438e8a640 1 -- 172.21.15.7:0/3287291625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94341f4950 msgr2=0x7f94340c8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:29.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.893+0000 7f9438e8a640 1 --2- 172.21.15.7:0/3287291625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94341f4950 0x7f94340c8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:29.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.893+0000 7f9438e8a640 1 -- 172.21.15.7:0/3287291625 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94340c8340 con 0x7f9424004800 2024-04-25T09:58:29.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.893+0000 7f9438e8a640 1 --2- 172.21.15.7:0/3287291625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9424004800 0x7f9434156ff0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f942800f7d0 tx=0x7f942800fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:29.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.893+0000 7f94317fa640 1 -- 172.21.15.7:0/3287291625 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942801a070 con 0x7f9424004800 2024-04-25T09:58:29.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.893+0000 7f94317fa640 1 -- 172.21.15.7:0/3287291625 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942800fe80 con 0x7f9424004800 2024-04-25T09:58:29.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.893+0000 7f943b0ee640 1 -- 172.21.15.7:0/3287291625 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94341f3dd0 con 0x7f9424004800 2024-04-25T09:58:29.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.893+0000 7f94317fa640 1 -- 172.21.15.7:0/3287291625 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9428007050 con 0x7f9424004800 2024-04-25T09:58:29.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.893+0000 7f943b0ee640 1 -- 172.21.15.7:0/3287291625 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94341f4390 con 0x7f9424004800 2024-04-25T09:58:29.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.894+0000 7f943b0ee640 1 -- 172.21.15.7:0/3287291625 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9434068fd0 con 0x7f9424004800 2024-04-25T09:58:29.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.894+0000 7f94317fa640 1 -- 172.21.15.7:0/3287291625 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f942801d070 con 0x7f9424004800 2024-04-25T09:58:29.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.895+0000 7f94317fa640 1 --2- 172.21.15.7:0/3287291625 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f941806b4d0 0x7f941806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:29.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.895+0000 7f94317fa640 1 -- 172.21.15.7:0/3287291625 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f9428089ab0 con 0x7f9424004800 2024-04-25T09:58:29.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.895+0000 7f9433fff640 1 --2- 172.21.15.7:0/3287291625 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f941806b4d0 0x7f941806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:29.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.895+0000 7f9433fff640 1 --2- 172.21.15.7:0/3287291625 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f941806b4d0 0x7f941806d990 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9420032000 tx=0x7f942002d000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:29.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:29.899+0000 7f94317fa640 1 -- 172.21.15.7:0/3287291625 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f94280580e0 con 0x7f9424004800 2024-04-25T09:58:30.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.085+0000 7f943b0ee640 1 -- 172.21.15.7:0/3287291625 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94340cc960 con 0x7f9424004800 2024-04-25T09:58:30.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.086+0000 7f94317fa640 1 -- 172.21.15.7:0/3287291625 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16980 (secure 0 0 0) 0x7f942805c180 con 0x7f9424004800 2024-04-25T09:58:30.091 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:58:30.091 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":64,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:58:10.114788+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:57:13.366946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T09:57:14.076493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.1e","mappings":[{"from":7,"to":2}]},{"pgid":"10.d","mappings":[{"from":4,"to":3}]},{"pgid":"10.2e","mappings":[{"from":4,"to":3}]},{"pgid":"10.3d","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:58:30.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.089+0000 7f943b0ee640 1 -- 172.21.15.7:0/3287291625 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f941806b4d0 msgr2=0x7f941806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:30.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.089+0000 7f943b0ee640 1 --2- 172.21.15.7:0/3287291625 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f941806b4d0 0x7f941806d990 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9420032000 tx=0x7f942002d000 comp rx=0 tx=0).stop 2024-04-25T09:58:30.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.089+0000 7f943b0ee640 1 -- 172.21.15.7:0/3287291625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9424004800 msgr2=0x7f9434156ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:30.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.089+0000 7f943b0ee640 1 --2- 172.21.15.7:0/3287291625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9424004800 0x7f9434156ff0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f942800f7d0 tx=0x7f942800fc90 comp rx=0 tx=0).stop 2024-04-25T09:58:30.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.089+0000 7f943b0ee640 1 -- 172.21.15.7:0/3287291625 shutdown_connections 2024-04-25T09:58:30.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.089+0000 7f943b0ee640 1 --2- 172.21.15.7:0/3287291625 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f941806b4d0 0x7f941806d990 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:30.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.089+0000 7f943b0ee640 1 --2- 172.21.15.7:0/3287291625 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9434159150 0x7f9434159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:30.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.089+0000 7f943b0ee640 1 --2- 172.21.15.7:0/3287291625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94341f4950 0x7f94340c8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:30.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.089+0000 7f943b0ee640 1 --2- 172.21.15.7:0/3287291625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9424004800 0x7f9434156ff0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:30.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.089+0000 7f943b0ee640 1 -- 172.21.15.7:0/3287291625 >> 172.21.15.7:0/3287291625 conn(0x7f94340b3130 msgr2=0x7f94340cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:30.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.089+0000 7f943b0ee640 1 -- 172.21.15.7:0/3287291625 shutdown_connections 2024-04-25T09:58:30.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.089+0000 7f943b0ee640 1 -- 172.21.15.7:0/3287291625 wait complete. 2024-04-25T09:58:30.103 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:57:13.366946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:57:14.076493+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:58:30.104 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:58:30.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.204+0000 7f5655aee640 1 Processor -- start 2024-04-25T09:58:30.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.204+0000 7f5655aee640 1 -- start start 2024-04-25T09:58:30.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.205+0000 7f5655aee640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f565015deb0 0x7f56500b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:30.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.205+0000 7f5655aee640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f56500d3760 0x7f56500d3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:30.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.205+0000 7f5655aee640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56500ce4c0 con 0x7f56500ce030 2024-04-25T09:58:30.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.205+0000 7f5655aee640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56500d4110 con 0x7f56500d3760 2024-04-25T09:58:30.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.205+0000 7f5655aee640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56500d1a40 con 0x7f565015deb0 2024-04-25T09:58:30.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.205+0000 7f564ffff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f56500d3760 0x7f56500d3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:30.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.205+0000 7f564effd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f56500ce030 0x7f56500b69e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45630/0 (socket says 172.21.15.7:45630) 2024-04-25T09:58:30.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.205+0000 7f564ffff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f56500d3760 0x7f56500d3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48400/0 (socket says 172.21.15.7:48400) 2024-04-25T09:58:30.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.205+0000 7f564ffff640 1 -- 172.21.15.7:0/4291067096 learned_addr learned my addr 172.21.15.7:0/4291067096 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:30.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.205+0000 7f564f7fe640 1 --2- 172.21.15.7:0/4291067096 >> v2:172.21.15.55:3300/0 conn(0x7f565015deb0 0x7f56500b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:30.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.205+0000 7f564ffff640 1 -- 172.21.15.7:0/4291067096 >> v2:172.21.15.55:3300/0 conn(0x7f565015deb0 msgr2=0x7f56500b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:30.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.205+0000 7f564ffff640 1 --2- 172.21.15.7:0/4291067096 >> v2:172.21.15.55:3300/0 conn(0x7f565015deb0 0x7f56500b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:30.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.205+0000 7f564ffff640 1 -- 172.21.15.7:0/4291067096 >> v1:172.21.15.7:6789/0 conn(0x7f56500ce030 legacy=0x7f56500b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:30.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.205+0000 7f564e7fc640 1 -- 172.21.15.7:0/4291067096 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1912455067 0 0) 0x7f56500ce4c0 con 0x7f56500ce030 2024-04-25T09:58:30.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.205+0000 7f564ffff640 1 -- 172.21.15.7:0/4291067096 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56500d1d20 con 0x7f56500d3760 2024-04-25T09:58:30.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.206+0000 7f564ffff640 1 --2- 172.21.15.7:0/4291067096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56500d3760 0x7f56500d3bd0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f56500d43f0 tx=0x7f564802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d708709b7a19727 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:30.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.206+0000 7f564e7fc640 1 -- 172.21.15.7:0/4291067096 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5648036070 con 0x7f56500d3760 2024-04-25T09:58:30.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.206+0000 7f564e7fc640 1 -- 172.21.15.7:0/4291067096 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5648031600 con 0x7f56500d3760 2024-04-25T09:58:30.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.206+0000 7f564e7fc640 1 -- 172.21.15.7:0/4291067096 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56480319d0 con 0x7f56500d3760 2024-04-25T09:58:30.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.207+0000 7f5655aee640 1 -- 172.21.15.7:0/4291067096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56500d3760 msgr2=0x7f56500d3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:30.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.207+0000 7f5655aee640 1 --2- 172.21.15.7:0/4291067096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56500d3760 0x7f56500d3bd0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f56500d43f0 tx=0x7f564802a730 comp rx=0 tx=0).stop 2024-04-25T09:58:30.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.207+0000 7f5655aee640 1 -- 172.21.15.7:0/4291067096 shutdown_connections 2024-04-25T09:58:30.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.207+0000 7f5655aee640 1 --2- 172.21.15.7:0/4291067096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56500d3760 0x7f56500d3bd0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:30.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.207+0000 7f5655aee640 1 --2- 172.21.15.7:0/4291067096 >> v2:172.21.15.55:3300/0 conn(0x7f565015deb0 0x7f56500b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:30.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.207+0000 7f5655aee640 1 -- 172.21.15.7:0/4291067096 >> 172.21.15.7:0/4291067096 conn(0x7f56500726b0 msgr2=0x7f5650072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:30.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.207+0000 7f5655aee640 1 -- 172.21.15.7:0/4291067096 shutdown_connections 2024-04-25T09:58:30.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.207+0000 7f5655aee640 1 -- 172.21.15.7:0/4291067096 wait complete. 2024-04-25T09:58:30.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.208+0000 7f5655aee640 1 Processor -- start 2024-04-25T09:58:30.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.208+0000 7f5655aee640 1 -- start start 2024-04-25T09:58:30.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.209+0000 7f5655aee640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56500ce030 0x7f565015f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:30.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.209+0000 7f5655aee640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56500d3760 0x7f565014de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:30.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.209+0000 7f5655aee640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f565015deb0 0x7f565015ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:30.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.209+0000 7f5655aee640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56500d25c0 con 0x7f56500ce030 2024-04-25T09:58:30.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.209+0000 7f5655aee640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56500d22e0 con 0x7f56500d3760 2024-04-25T09:58:30.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.209+0000 7f5655aee640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56500b70f0 con 0x7f565015deb0 2024-04-25T09:58:30.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.209+0000 7f564f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56500ce030 0x7f565015f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:30.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.209+0000 7f564f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56500ce030 0x7f565015f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48408/0 (socket says 172.21.15.7:48408) 2024-04-25T09:58:30.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.209+0000 7f564f7fe640 1 -- 172.21.15.7:0/2199112663 learned_addr learned my addr 172.21.15.7:0/2199112663 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:30.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.209+0000 7f564effd640 1 --2- 172.21.15.7:0/2199112663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56500d3760 0x7f565014de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:30.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.209+0000 7f564ffff640 1 --2- 172.21.15.7:0/2199112663 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f565015deb0 0x7f565015ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:30.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.209+0000 7f564f7fe640 1 -- 172.21.15.7:0/2199112663 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f565015deb0 msgr2=0x7f565015ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:30.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.209+0000 7f564f7fe640 1 --2- 172.21.15.7:0/2199112663 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f565015deb0 0x7f565015ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.209+0000 7f564f7fe640 1 -- 172.21.15.7:0/2199112663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56500d3760 msgr2=0x7f565014de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.209+0000 7f564f7fe640 1 --2- 172.21.15.7:0/2199112663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56500d3760 0x7f565014de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.209+0000 7f564f7fe640 1 -- 172.21.15.7:0/2199112663 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56500ca9d0 con 0x7f56500ce030 2024-04-25T09:58:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.209+0000 7f564f7fe640 1 --2- 172.21.15.7:0/2199112663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56500ce030 0x7f565015f400 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f564000d5f0 tx=0x7f564000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.210+0000 7f5637fff640 1 -- 172.21.15.7:0/2199112663 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56400125f0 con 0x7f56500ce030 2024-04-25T09:58:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.210+0000 7f5637fff640 1 -- 172.21.15.7:0/2199112663 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5640019070 con 0x7f56500ce030 2024-04-25T09:58:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.210+0000 7f5655aee640 1 -- 172.21.15.7:0/2199112663 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56500cacb0 con 0x7f56500ce030 2024-04-25T09:58:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.210+0000 7f5637fff640 1 -- 172.21.15.7:0/2199112663 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56400129d0 con 0x7f56500ce030 2024-04-25T09:58:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.210+0000 7f5655aee640 1 -- 172.21.15.7:0/2199112663 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56500cb270 con 0x7f56500ce030 2024-04-25T09:58:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.211+0000 7f5655aee640 1 -- 172.21.15.7:0/2199112663 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5650068f60 con 0x7f56500ce030 2024-04-25T09:58:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.211+0000 7f5637fff640 1 -- 172.21.15.7:0/2199112663 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5640012b70 con 0x7f56500ce030 2024-04-25T09:58:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.212+0000 7f5637fff640 1 --2- 172.21.15.7:0/2199112663 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f563c06b4d0 0x7f563c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.212+0000 7f5637fff640 1 -- 172.21.15.7:0/2199112663 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f564008a820 con 0x7f56500ce030 2024-04-25T09:58:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.212+0000 7f564effd640 1 --2- 172.21.15.7:0/2199112663 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f563c06b4d0 0x7f563c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.212+0000 7f564effd640 1 --2- 172.21.15.7:0/2199112663 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f563c06b4d0 0x7f563c06d990 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f56500cec20 tx=0x7f5644007b50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:30.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.216+0000 7f5637fff640 1 -- 172.21.15.7:0/2199112663 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5640059490 con 0x7f56500ce030 2024-04-25T09:58:30.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.395+0000 7f5655aee640 1 -- 172.21.15.7:0/2199112663 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f56500cee40 con 0x7f56500ce030 2024-04-25T09:58:30.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.396+0000 7f5637fff640 1 -- 172.21.15.7:0/2199112663 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5640058d90 con 0x7f56500ce030 2024-04-25T09:58:30.400 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T09:58:30.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.398+0000 7f5655aee640 1 -- 172.21.15.7:0/2199112663 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f563c06b4d0 msgr2=0x7f563c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:30.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.398+0000 7f5655aee640 1 --2- 172.21.15.7:0/2199112663 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f563c06b4d0 0x7f563c06d990 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f56500cec20 tx=0x7f5644007b50 comp rx=0 tx=0).stop 2024-04-25T09:58:30.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.398+0000 7f5655aee640 1 -- 172.21.15.7:0/2199112663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56500ce030 msgr2=0x7f565015f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:30.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.398+0000 7f5655aee640 1 --2- 172.21.15.7:0/2199112663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56500ce030 0x7f565015f400 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f564000d5f0 tx=0x7f564000dab0 comp rx=0 tx=0).stop 2024-04-25T09:58:30.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.398+0000 7f5655aee640 1 -- 172.21.15.7:0/2199112663 shutdown_connections 2024-04-25T09:58:30.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.398+0000 7f5655aee640 1 --2- 172.21.15.7:0/2199112663 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f563c06b4d0 0x7f563c06d990 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:30.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.398+0000 7f5655aee640 1 --2- 172.21.15.7:0/2199112663 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f565015deb0 0x7f565015ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:30.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.398+0000 7f5655aee640 1 --2- 172.21.15.7:0/2199112663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56500d3760 0x7f565014de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:30.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.398+0000 7f5655aee640 1 --2- 172.21.15.7:0/2199112663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56500ce030 0x7f565015f400 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:30.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.398+0000 7f5655aee640 1 -- 172.21.15.7:0/2199112663 >> 172.21.15.7:0/2199112663 conn(0x7f56500726b0 msgr2=0x7f565015d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:30.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.398+0000 7f5655aee640 1 -- 172.21.15.7:0/2199112663 shutdown_connections 2024-04-25T09:58:30.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.398+0000 7f5655aee640 1 -- 172.21.15.7:0/2199112663 wait complete. 2024-04-25T09:58:30.412 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:58:30.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.512+0000 7f4e98e12640 1 Processor -- start 2024-04-25T09:58:30.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.512+0000 7f4e98e12640 1 -- start start 2024-04-25T09:58:30.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.513+0000 7f4e98e12640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e940d2c40 0x7f4e940b9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:30.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.513+0000 7f4e98e12640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e940b7ef0 con 0x7f4e940b68b0 2024-04-25T09:58:30.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.513+0000 7f4e98e12640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e940b81d0 con 0x7f4e940d0780 2024-04-25T09:58:30.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.513+0000 7f4e98e12640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e940b84b0 con 0x7f4e940d2c40 2024-04-25T09:58:30.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.513+0000 7f4e92d9d640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f4e940b68b0 0x7f4e940b6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45636/0 (socket says 172.21.15.7:45636) 2024-04-25T09:58:30.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.513+0000 7f4e92d9d640 1 -- 172.21.15.7:0/1450843865 learned_addr learned my addr 172.21.15.7:0/1450843865 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:30.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.513+0000 7f4e8bfff640 1 --2- 172.21.15.7:0/1450843865 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e940d2c40 0x7f4e940b9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:30.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.513+0000 7f4e91d9b640 1 -- 172.21.15.7:0/1450843865 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2651004799 0 0) 0x7f4e940b7ef0 con 0x7f4e940b68b0 2024-04-25T09:58:30.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.513+0000 7f4e91d9b640 1 -- 172.21.15.7:0/1450843865 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e80003520 con 0x7f4e940b68b0 2024-04-25T09:58:30.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.513+0000 7f4e91d9b640 1 -- 172.21.15.7:0/1450843865 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4228224162 0 0) 0x7f4e940b81d0 con 0x7f4e940d0780 2024-04-25T09:58:30.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.513+0000 7f4e91d9b640 1 -- 172.21.15.7:0/1450843865 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e940b7ef0 con 0x7f4e940d0780 2024-04-25T09:58:30.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.513+0000 7f4e91d9b640 1 -- 172.21.15.7:0/1450843865 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1563559534 0 0) 0x7f4e80003520 con 0x7f4e940b68b0 2024-04-25T09:58:30.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.513+0000 7f4e91d9b640 1 -- 172.21.15.7:0/1450843865 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e940d2c40 msgr2=0x7f4e940b9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:30.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.514+0000 7f4e91d9b640 1 --2- 172.21.15.7:0/1450843865 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e940d2c40 0x7f4e940b9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:30.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.514+0000 7f4e91d9b640 1 -- 172.21.15.7:0/1450843865 >> v1:172.21.15.55:6789/0 conn(0x7f4e940d0780 legacy=0x7f4e940d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:30.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.514+0000 7f4e91d9b640 1 -- 172.21.15.7:0/1450843865 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e940b8790 con 0x7f4e940b68b0 2024-04-25T09:58:30.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.514+0000 7f4e91d9b640 1 -- 172.21.15.7:0/1450843865 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f4e8c0019f0 con 0x7f4e940b68b0 2024-04-25T09:58:30.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.514+0000 7f4e91d9b640 1 -- 172.21.15.7:0/1450843865 >> v1:172.21.15.7:6789/0 conn(0x7f4e940b68b0 legacy=0x7f4e940b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:30.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.514+0000 7f4e91d9b640 1 --2- 172.21.15.7:0/1450843865 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e940d2c40 0x7f4e80003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:30.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.514+0000 7f4e91d9b640 1 --2- 172.21.15.7:0/1450843865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e800040d0 0x7f4e80004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:30.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.514+0000 7f4e91d9b640 1 --2- 172.21.15.7:0/1450843865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e80004d40 0x7f4e800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:30.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.514+0000 7f4e91d9b640 1 -- 172.21.15.7:0/1450843865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e940b84b0 con 0x7f4e800040d0 2024-04-25T09:58:30.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.514+0000 7f4e91d9b640 1 -- 172.21.15.7:0/1450843865 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8000baa0 con 0x7f4e80004d40 2024-04-25T09:58:30.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.514+0000 7f4e91d9b640 1 -- 172.21.15.7:0/1450843865 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8000bca0 con 0x7f4e940d2c40 2024-04-25T09:58:30.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.514+0000 7f4e8bfff640 1 --2- 172.21.15.7:0/1450843865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e800040d0 0x7f4e80004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:30.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.514+0000 7f4e9259c640 1 --2- 172.21.15.7:0/1450843865 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e940d2c40 0x7f4e80003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:30.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.514+0000 7f4e92d9d640 1 --2- 172.21.15.7:0/1450843865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e80004d40 0x7f4e800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:30.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.514+0000 7f4e8bfff640 1 -- 172.21.15.7:0/1450843865 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e940d2c40 msgr2=0x7f4e80003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:30.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.514+0000 7f4e8bfff640 1 --2- 172.21.15.7:0/1450843865 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e940d2c40 0x7f4e80003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:30.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.514+0000 7f4e8bfff640 1 -- 172.21.15.7:0/1450843865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e80004d40 msgr2=0x7f4e800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:30.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.514+0000 7f4e8bfff640 1 --2- 172.21.15.7:0/1450843865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e80004d40 0x7f4e800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:30.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.514+0000 7f4e8bfff640 1 -- 172.21.15.7:0/1450843865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e80003520 con 0x7f4e800040d0 2024-04-25T09:58:30.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.515+0000 7f4e8bfff640 1 --2- 172.21.15.7:0/1450843865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e800040d0 0x7f4e80004800 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c009ac0 tx=0x7f4e80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c92ed95d23a21b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:30.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.515+0000 7f4e91d9b640 1 -- 172.21.15.7:0/1450843865 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c036070 con 0x7f4e800040d0 2024-04-25T09:58:30.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.515+0000 7f4e91d9b640 1 -- 172.21.15.7:0/1450843865 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7c031400 con 0x7f4e800040d0 2024-04-25T09:58:30.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.515+0000 7f4e91d9b640 1 -- 172.21.15.7:0/1450843865 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c009690 con 0x7f4e800040d0 2024-04-25T09:58:30.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.515+0000 7f4e98e12640 1 -- 172.21.15.7:0/1450843865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e800040d0 msgr2=0x7f4e80004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:30.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.515+0000 7f4e98e12640 1 --2- 172.21.15.7:0/1450843865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e800040d0 0x7f4e80004800 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c009ac0 tx=0x7f4e80005830 comp rx=0 tx=0).stop 2024-04-25T09:58:30.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.515+0000 7f4e92d9d640 1 -- 172.21.15.7:0/1450843865 reap_dead start 2024-04-25T09:58:30.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.515+0000 7f4e98e12640 1 -- 172.21.15.7:0/1450843865 shutdown_connections 2024-04-25T09:58:30.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.515+0000 7f4e98e12640 1 -- 172.21.15.7:0/1450843865 >> 172.21.15.7:0/1450843865 conn(0x7f4e940726b0 msgr2=0x7f4e94072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:30.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.515+0000 7f4e98e12640 1 -- 172.21.15.7:0/1450843865 shutdown_connections 2024-04-25T09:58:30.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.515+0000 7f4e98e12640 1 -- 172.21.15.7:0/1450843865 wait complete. 2024-04-25T09:58:30.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.517+0000 7f4e98e12640 1 Processor -- start 2024-04-25T09:58:30.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.517+0000 7f4e98e12640 1 -- start start 2024-04-25T09:58:30.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.517+0000 7f4e98e12640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e800040d0 0x7f4e94153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:30.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.517+0000 7f4e98e12640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e940cb500 0x7f4e940c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:30.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.517+0000 7f4e98e12640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e940c9540 0x7f4e9415fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:30.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.517+0000 7f4e98e12640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e94161330 con 0x7f4e800040d0 2024-04-25T09:58:30.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.517+0000 7f4e98e12640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e941611b0 con 0x7f4e940c9540 2024-04-25T09:58:30.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.517+0000 7f4e98e12640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e940b9130 con 0x7f4e940cb500 2024-04-25T09:58:30.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.518+0000 7f4e9259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e800040d0 0x7f4e94153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:30.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.518+0000 7f4e9259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e800040d0 0x7f4e94153a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48436/0 (socket says 172.21.15.7:48436) 2024-04-25T09:58:30.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.518+0000 7f4e9259c640 1 -- 172.21.15.7:0/1624257306 learned_addr learned my addr 172.21.15.7:0/1624257306 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:30.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.518+0000 7f4e92d9d640 1 --2- 172.21.15.7:0/1624257306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e940c9540 0x7f4e9415fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:30.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.518+0000 7f4e8bfff640 1 --2- 172.21.15.7:0/1624257306 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e940cb500 0x7f4e940c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:30.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.518+0000 7f4e9259c640 1 -- 172.21.15.7:0/1624257306 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e940cb500 msgr2=0x7f4e940c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:30.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.518+0000 7f4e9259c640 1 --2- 172.21.15.7:0/1624257306 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e940cb500 0x7f4e940c9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:30.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.518+0000 7f4e9259c640 1 -- 172.21.15.7:0/1624257306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e940c9540 msgr2=0x7f4e9415fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:30.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.518+0000 7f4e9259c640 1 --2- 172.21.15.7:0/1624257306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e940c9540 0x7f4e9415fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:30.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.518+0000 7f4e9259c640 1 -- 172.21.15.7:0/1624257306 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e940c9a50 con 0x7f4e800040d0 2024-04-25T09:58:30.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.518+0000 7f4e9259c640 1 --2- 172.21.15.7:0/1624257306 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e800040d0 0x7f4e94153a90 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f4e8400e810 tx=0x7f4e8400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:30.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.518+0000 7f4e8affd640 1 -- 172.21.15.7:0/1624257306 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e840050d0 con 0x7f4e800040d0 2024-04-25T09:58:30.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.518+0000 7f4e8affd640 1 -- 172.21.15.7:0/1624257306 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e84018070 con 0x7f4e800040d0 2024-04-25T09:58:30.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.518+0000 7f4e8affd640 1 -- 172.21.15.7:0/1624257306 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8400c6c0 con 0x7f4e800040d0 2024-04-25T09:58:30.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.518+0000 7f4e98e12640 1 -- 172.21.15.7:0/1624257306 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e940caa20 con 0x7f4e800040d0 2024-04-25T09:58:30.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.518+0000 7f4e98e12640 1 -- 172.21.15.7:0/1624257306 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e940cafe0 con 0x7f4e800040d0 2024-04-25T09:58:30.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.519+0000 7f4e98e12640 1 -- 172.21.15.7:0/1624257306 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e940685d0 con 0x7f4e800040d0 2024-04-25T09:58:30.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.520+0000 7f4e8affd640 1 -- 172.21.15.7:0/1624257306 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4e8400c860 con 0x7f4e800040d0 2024-04-25T09:58:30.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.520+0000 7f4e8affd640 1 --2- 172.21.15.7:0/1624257306 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4e7406b500 0x7f4e7406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:30.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.521+0000 7f4e8bfff640 1 --2- 172.21.15.7:0/1624257306 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4e7406b500 0x7f4e7406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:30.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.521+0000 7f4e8affd640 1 -- 172.21.15.7:0/1624257306 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f4e8408a120 con 0x7f4e800040d0 2024-04-25T09:58:30.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.521+0000 7f4e8bfff640 1 --2- 172.21.15.7:0/1624257306 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4e7406b500 0x7f4e7406d9c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c033000 tx=0x7f4e7c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:30.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.525+0000 7f4e8affd640 1 -- 172.21.15.7:0/1624257306 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4e84058d90 con 0x7f4e800040d0 2024-04-25T09:58:30.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.706+0000 7f4e98e12640 1 -- 172.21.15.7:0/1624257306 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4e94068f60 con 0x7f4e800040d0 2024-04-25T09:58:30.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.707+0000 7f4e8affd640 1 -- 172.21.15.7:0/1624257306 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v64) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4e84058690 con 0x7f4e800040d0 2024-04-25T09:58:30.711 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:58:30.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.708+0000 7f4e98e12640 1 -- 172.21.15.7:0/1624257306 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4e7406b500 msgr2=0x7f4e7406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:30.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.708+0000 7f4e98e12640 1 --2- 172.21.15.7:0/1624257306 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4e7406b500 0x7f4e7406d9c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c033000 tx=0x7f4e7c008030 comp rx=0 tx=0).stop 2024-04-25T09:58:30.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.708+0000 7f4e98e12640 1 -- 172.21.15.7:0/1624257306 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e800040d0 msgr2=0x7f4e94153a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:30.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.708+0000 7f4e98e12640 1 --2- 172.21.15.7:0/1624257306 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e800040d0 0x7f4e94153a90 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f4e8400e810 tx=0x7f4e8400ec10 comp rx=0 tx=0).stop 2024-04-25T09:58:30.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.709+0000 7f4e98e12640 1 -- 172.21.15.7:0/1624257306 shutdown_connections 2024-04-25T09:58:30.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.709+0000 7f4e98e12640 1 --2- 172.21.15.7:0/1624257306 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4e7406b500 0x7f4e7406d9c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:30.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.709+0000 7f4e98e12640 1 --2- 172.21.15.7:0/1624257306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e940c9540 0x7f4e9415fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:30.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.709+0000 7f4e98e12640 1 --2- 172.21.15.7:0/1624257306 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e940cb500 0x7f4e940c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:30.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.709+0000 7f4e98e12640 1 --2- 172.21.15.7:0/1624257306 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e800040d0 0x7f4e94153a90 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:30.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.709+0000 7f4e98e12640 1 -- 172.21.15.7:0/1624257306 >> 172.21.15.7:0/1624257306 conn(0x7f4e940726b0 msgr2=0x7f4e940ce280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:30.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.709+0000 7f4e98e12640 1 -- 172.21.15.7:0/1624257306 shutdown_connections 2024-04-25T09:58:30.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.709+0000 7f4e98e12640 1 -- 172.21.15.7:0/1624257306 wait complete. 2024-04-25T09:58:30.723 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:58:30.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.823+0000 7f965b79d640 1 Processor -- start 2024-04-25T09:58:30.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.823+0000 7f965b79d640 1 -- start start 2024-04-25T09:58:30.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.824+0000 7f965b79d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f96541475e0 0x7f965406dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:30.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.824+0000 7f965b79d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f965406e500 0x7f9654071550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:30.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.824+0000 7f965b79d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9654071a90 0x7f96540b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:30.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.824+0000 7f965b79d640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96540acd40 con 0x7f965406e500 2024-04-25T09:58:30.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.824+0000 7f965b79d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f965406ea60 con 0x7f96541475e0 2024-04-25T09:58:30.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.824+0000 7f965b79d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f965406ed40 con 0x7f9654071a90 2024-04-25T09:58:30.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.824+0000 7f9658d38640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f965406e500 0x7f9654071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:30.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.824+0000 7f9658d38640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f965406e500 0x7f9654071550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48438/0 (socket says 172.21.15.7:48438) 2024-04-25T09:58:30.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.824+0000 7f9658d38640 1 -- 172.21.15.7:0/1080039663 learned_addr learned my addr 172.21.15.7:0/1080039663 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:30.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.824+0000 7f9659d3a640 1 --2- 172.21.15.7:0/1080039663 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9654071a90 0x7f96540b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:30.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.824+0000 7f9659539640 1 --2- 172.21.15.7:0/1080039663 >> v2:172.21.15.55:3300/0 conn(0x7f96541475e0 0x7f965406dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:30.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.825+0000 7f9658d38640 1 -- 172.21.15.7:0/1080039663 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9654071a90 msgr2=0x7f96540b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:30.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.825+0000 7f9658d38640 1 --2- 172.21.15.7:0/1080039663 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9654071a90 0x7f96540b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:30.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.825+0000 7f9658d38640 1 -- 172.21.15.7:0/1080039663 >> v2:172.21.15.55:3300/0 conn(0x7f96541475e0 msgr2=0x7f965406dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:30.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.825+0000 7f9658d38640 1 --2- 172.21.15.7:0/1080039663 >> v2:172.21.15.55:3300/0 conn(0x7f96541475e0 0x7f965406dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:30.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.825+0000 7f9658d38640 1 -- 172.21.15.7:0/1080039663 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f965406f020 con 0x7f965406e500 2024-04-25T09:58:30.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.825+0000 7f9658d38640 1 --2- 172.21.15.7:0/1080039663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f965406e500 0x7f9654071550 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f965406ba80 tx=0x7f964802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3056a5484fa09557 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:30.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.825+0000 7f9653fff640 1 -- 172.21.15.7:0/1080039663 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9648037070 con 0x7f965406e500 2024-04-25T09:58:30.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.826+0000 7f9653fff640 1 -- 172.21.15.7:0/1080039663 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9648032440 con 0x7f965406e500 2024-04-25T09:58:30.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.826+0000 7f9653fff640 1 -- 172.21.15.7:0/1080039663 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9648032810 con 0x7f965406e500 2024-04-25T09:58:30.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.826+0000 7f965b79d640 1 -- 172.21.15.7:0/1080039663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f965406e500 msgr2=0x7f9654071550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:30.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.826+0000 7f965b79d640 1 --2- 172.21.15.7:0/1080039663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f965406e500 0x7f9654071550 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f965406ba80 tx=0x7f964802a1e0 comp rx=0 tx=0).stop 2024-04-25T09:58:30.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.826+0000 7f965b79d640 1 -- 172.21.15.7:0/1080039663 shutdown_connections 2024-04-25T09:58:30.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.826+0000 7f965b79d640 1 --2- 172.21.15.7:0/1080039663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f965406e500 0x7f9654071550 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:30.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.826+0000 7f965b79d640 1 --2- 172.21.15.7:0/1080039663 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9654071a90 0x7f96540b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:30.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.826+0000 7f965b79d640 1 --2- 172.21.15.7:0/1080039663 >> v2:172.21.15.55:3300/0 conn(0x7f96541475e0 0x7f965406dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:30.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.826+0000 7f965b79d640 1 -- 172.21.15.7:0/1080039663 >> 172.21.15.7:0/1080039663 conn(0x7f96540b16d0 msgr2=0x7f96540b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:30.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.826+0000 7f965b79d640 1 -- 172.21.15.7:0/1080039663 shutdown_connections 2024-04-25T09:58:30.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.826+0000 7f965b79d640 1 -- 172.21.15.7:0/1080039663 wait complete. 2024-04-25T09:58:30.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.827+0000 7f965b79d640 1 Processor -- start 2024-04-25T09:58:30.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.827+0000 7f965b79d640 1 -- start start 2024-04-25T09:58:30.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.828+0000 7f965b79d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f965406e500 0x7f96540c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:30.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.828+0000 7f965b79d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9654071a90 0x7f96541f4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:30.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.828+0000 7f965b79d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96541475e0 0x7f96541417a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:30.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.828+0000 7f965b79d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96540b3600 con 0x7f965406e500 2024-04-25T09:58:30.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.828+0000 7f965b79d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96540724c0 con 0x7f96541475e0 2024-04-25T09:58:30.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.828+0000 7f965b79d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96540b3780 con 0x7f9654071a90 2024-04-25T09:58:30.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.828+0000 7f9659539640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f965406e500 0x7f96540c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:30.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.828+0000 7f9659539640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f965406e500 0x7f96540c59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48452/0 (socket says 172.21.15.7:48452) 2024-04-25T09:58:30.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.828+0000 7f9659539640 1 -- 172.21.15.7:0/4270221601 learned_addr learned my addr 172.21.15.7:0/4270221601 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:30.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.828+0000 7f9658d38640 1 --2- 172.21.15.7:0/4270221601 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9654071a90 0x7f96541f4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:30.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.828+0000 7f9659d3a640 1 --2- 172.21.15.7:0/4270221601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96541475e0 0x7f96541417a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:30.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.829+0000 7f9659539640 1 -- 172.21.15.7:0/4270221601 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9654071a90 msgr2=0x7f96541f4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:30.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.829+0000 7f9659539640 1 --2- 172.21.15.7:0/4270221601 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9654071a90 0x7f96541f4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:30.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.829+0000 7f9659539640 1 -- 172.21.15.7:0/4270221601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96541475e0 msgr2=0x7f96541417a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:30.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.829+0000 7f9659539640 1 --2- 172.21.15.7:0/4270221601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96541475e0 0x7f96541417a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:30.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.829+0000 7f9659539640 1 -- 172.21.15.7:0/4270221601 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9654140ce0 con 0x7f965406e500 2024-04-25T09:58:30.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.829+0000 7f9659539640 1 --2- 172.21.15.7:0/4270221601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f965406e500 0x7f96540c59b0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f964c00e8a0 tx=0x7f964c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:30.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.829+0000 7f9651ffb640 1 -- 172.21.15.7:0/4270221601 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c017070 con 0x7f965406e500 2024-04-25T09:58:30.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.829+0000 7f9651ffb640 1 -- 172.21.15.7:0/4270221601 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964c00c940 con 0x7f965406e500 2024-04-25T09:58:30.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.829+0000 7f965b79d640 1 -- 172.21.15.7:0/4270221601 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96541f4000 con 0x7f965406e500 2024-04-25T09:58:30.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.829+0000 7f9651ffb640 1 -- 172.21.15.7:0/4270221601 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c00cd30 con 0x7f965406e500 2024-04-25T09:58:30.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.829+0000 7f965b79d640 1 -- 172.21.15.7:0/4270221601 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9654141280 con 0x7f965406e500 2024-04-25T09:58:30.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.830+0000 7f965b79d640 1 -- 172.21.15.7:0/4270221601 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9654068f60 con 0x7f965406e500 2024-04-25T09:58:30.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.831+0000 7f9651ffb640 1 -- 172.21.15.7:0/4270221601 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f964c01a070 con 0x7f965406e500 2024-04-25T09:58:30.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.831+0000 7f9651ffb640 1 --2- 172.21.15.7:0/4270221601 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f964006b4d0 0x7f964006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:30.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.831+0000 7f9651ffb640 1 -- 172.21.15.7:0/4270221601 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f964c08a4f0 con 0x7f965406e500 2024-04-25T09:58:30.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.831+0000 7f9658d38640 1 --2- 172.21.15.7:0/4270221601 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f964006b4d0 0x7f964006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:30.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.832+0000 7f9658d38640 1 --2- 172.21.15.7:0/4270221601 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f964006b4d0 0x7f964006d990 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9648034000 tx=0x7f964802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:30.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:30.835+0000 7f9651ffb640 1 -- 172.21.15.7:0/4270221601 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f964c058bb0 con 0x7f965406e500 2024-04-25T09:58:31.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.014+0000 7f965b79d640 1 -- 172.21.15.7:0/4270221601 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f965406c530 con 0x7f965406e500 2024-04-25T09:58:31.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.015+0000 7f9651ffb640 1 -- 172.21.15.7:0/4270221601 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v64) v1 ==== 100+0+11 (secure 0 0 0) 0x7f964c05cc50 con 0x7f965406e500 2024-04-25T09:58:31.019 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T09:58:31.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.017+0000 7f965b79d640 1 -- 172.21.15.7:0/4270221601 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f964006b4d0 msgr2=0x7f964006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:31.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.017+0000 7f965b79d640 1 --2- 172.21.15.7:0/4270221601 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f964006b4d0 0x7f964006d990 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9648034000 tx=0x7f964802e000 comp rx=0 tx=0).stop 2024-04-25T09:58:31.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.017+0000 7f965b79d640 1 -- 172.21.15.7:0/4270221601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f965406e500 msgr2=0x7f96540c59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:31.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.017+0000 7f965b79d640 1 --2- 172.21.15.7:0/4270221601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f965406e500 0x7f96540c59b0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f964c00e8a0 tx=0x7f964c00ed60 comp rx=0 tx=0).stop 2024-04-25T09:58:31.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.017+0000 7f965b79d640 1 -- 172.21.15.7:0/4270221601 shutdown_connections 2024-04-25T09:58:31.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.017+0000 7f965b79d640 1 --2- 172.21.15.7:0/4270221601 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f964006b4d0 0x7f964006d990 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:31.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.017+0000 7f965b79d640 1 --2- 172.21.15.7:0/4270221601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96541475e0 0x7f96541417a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:31.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.017+0000 7f965b79d640 1 --2- 172.21.15.7:0/4270221601 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9654071a90 0x7f96541f4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:31.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.017+0000 7f965b79d640 1 --2- 172.21.15.7:0/4270221601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f965406e500 0x7f96540c59b0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:31.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.017+0000 7f965b79d640 1 -- 172.21.15.7:0/4270221601 >> 172.21.15.7:0/4270221601 conn(0x7f96540b16d0 msgr2=0x7f96540af540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:31.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.017+0000 7f965b79d640 1 -- 172.21.15.7:0/4270221601 shutdown_connections 2024-04-25T09:58:31.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.017+0000 7f965b79d640 1 -- 172.21.15.7:0/4270221601 wait complete. 2024-04-25T09:58:31.035 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:58:31.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.135+0000 7f4a520cb640 1 Processor -- start 2024-04-25T09:58:31.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.135+0000 7f4a520cb640 1 -- start start 2024-04-25T09:58:31.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.136+0000 7f4a520cb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4a4c06c250 0x7f4a4c09a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:31.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.136+0000 7f4a520cb640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4a4c0d0360 0x7f4a4c0cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:31.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.136+0000 7f4a520cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a4c099b20 con 0x7f4a4c06bce0 2024-04-25T09:58:31.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.136+0000 7f4a520cb640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a4c09ae20 con 0x7f4a4c0d0360 2024-04-25T09:58:31.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.136+0000 7f4a520cb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a4c09a450 con 0x7f4a4c06c250 2024-04-25T09:58:31.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.136+0000 7f4a4bfff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4a4c0d0360 0x7f4a4c0cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:31.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.136+0000 7f4a4bfff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4a4c0d0360 0x7f4a4c0cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48456/0 (socket says 172.21.15.7:48456) 2024-04-25T09:58:31.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.136+0000 7f4a4bfff640 1 -- 172.21.15.7:0/2594422735 learned_addr learned my addr 172.21.15.7:0/2594422735 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:31.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.136+0000 7f4a4b7fe640 1 --2- 172.21.15.7:0/2594422735 >> v2:172.21.15.55:3300/0 conn(0x7f4a4c06c250 0x7f4a4c09a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:31.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.137+0000 7f4a4bfff640 1 -- 172.21.15.7:0/2594422735 >> v2:172.21.15.55:3300/0 conn(0x7f4a4c06c250 msgr2=0x7f4a4c09a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:31.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.137+0000 7f4a4bfff640 1 --2- 172.21.15.7:0/2594422735 >> v2:172.21.15.55:3300/0 conn(0x7f4a4c06c250 0x7f4a4c09a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:31.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.137+0000 7f4a4bfff640 1 -- 172.21.15.7:0/2594422735 >> v1:172.21.15.55:6789/0 conn(0x7f4a4c06bce0 legacy=0x7f4a4c06c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:31.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.137+0000 7f4a4bfff640 1 -- 172.21.15.7:0/2594422735 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4c099e00 con 0x7f4a4c0d0360 2024-04-25T09:58:31.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.137+0000 7f4a4b7fe640 1 --2- 172.21.15.7:0/2594422735 >> v2:172.21.15.55:3300/0 conn(0x7f4a4c06c250 0x7f4a4c09a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:31.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.137+0000 7f4a4bfff640 1 --2- 172.21.15.7:0/2594422735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a4c0d0360 0x7f4a4c0cbd30 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c0d27e0 tx=0x7f4a4402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a60c2e3bbb308736 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:31.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.137+0000 7f4a4a7fc640 1 -- 172.21.15.7:0/2594422735 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a44036070 con 0x7f4a4c0d0360 2024-04-25T09:58:31.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.138+0000 7f4a4a7fc640 1 -- 172.21.15.7:0/2594422735 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a44031600 con 0x7f4a4c0d0360 2024-04-25T09:58:31.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.138+0000 7f4a4a7fc640 1 -- 172.21.15.7:0/2594422735 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a440319d0 con 0x7f4a4c0d0360 2024-04-25T09:58:31.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.138+0000 7f4a520cb640 1 -- 172.21.15.7:0/2594422735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a4c0d0360 msgr2=0x7f4a4c0cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:31.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.138+0000 7f4a520cb640 1 --2- 172.21.15.7:0/2594422735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a4c0d0360 0x7f4a4c0cbd30 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c0d27e0 tx=0x7f4a4402a610 comp rx=0 tx=0).stop 2024-04-25T09:58:31.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.138+0000 7f4a520cb640 1 -- 172.21.15.7:0/2594422735 shutdown_connections 2024-04-25T09:58:31.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.138+0000 7f4a520cb640 1 --2- 172.21.15.7:0/2594422735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a4c0d0360 0x7f4a4c0cbd30 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:31.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.138+0000 7f4a520cb640 1 --2- 172.21.15.7:0/2594422735 >> v2:172.21.15.55:3300/0 conn(0x7f4a4c06c250 0x7f4a4c09a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:31.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.138+0000 7f4a520cb640 1 -- 172.21.15.7:0/2594422735 >> 172.21.15.7:0/2594422735 conn(0x7f4a4c0d16e0 msgr2=0x7f4a4c0d1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:31.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.138+0000 7f4a520cb640 1 -- 172.21.15.7:0/2594422735 shutdown_connections 2024-04-25T09:58:31.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.138+0000 7f4a520cb640 1 -- 172.21.15.7:0/2594422735 wait complete. 2024-04-25T09:58:31.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.139+0000 7f4a520cb640 1 Processor -- start 2024-04-25T09:58:31.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.139+0000 7f4a520cb640 1 -- start start 2024-04-25T09:58:31.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.140+0000 7f4a520cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a4c06bce0 0x7f4a4c1f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:31.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.140+0000 7f4a520cb640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4a4c06c250 0x7f4a4c159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:31.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.140+0000 7f4a520cb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a4c0d0360 0x7f4a4c1f5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:31.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.140+0000 7f4a520cb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c15f000 con 0x7f4a4c0d0360 2024-04-25T09:58:31.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.140+0000 7f4a520cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c0d0c60 con 0x7f4a4c06bce0 2024-04-25T09:58:31.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.140+0000 7f4a520cb640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c15f180 con 0x7f4a4c06c250 2024-04-25T09:58:31.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.140+0000 7f4a4bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a4c0d0360 0x7f4a4c1f5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:31.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.140+0000 7f4a4bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a4c0d0360 0x7f4a4c1f5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48468/0 (socket says 172.21.15.7:48468) 2024-04-25T09:58:31.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.140+0000 7f4a4bfff640 1 -- 172.21.15.7:0/2696626317 learned_addr learned my addr 172.21.15.7:0/2696626317 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:31.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.140+0000 7f4a4b7fe640 1 --2- 172.21.15.7:0/2696626317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a4c06bce0 0x7f4a4c1f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:31.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.140+0000 7f4a4affd640 1 --2- 172.21.15.7:0/2696626317 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4a4c06c250 0x7f4a4c159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:31.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.141+0000 7f4a4bfff640 1 -- 172.21.15.7:0/2696626317 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4a4c06c250 msgr2=0x7f4a4c159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:31.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.141+0000 7f4a4bfff640 1 --2- 172.21.15.7:0/2696626317 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4a4c06c250 0x7f4a4c159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:31.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.141+0000 7f4a4bfff640 1 -- 172.21.15.7:0/2696626317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a4c06bce0 msgr2=0x7f4a4c1f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:31.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.141+0000 7f4a4bfff640 1 --2- 172.21.15.7:0/2696626317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a4c06bce0 0x7f4a4c1f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:31.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.141+0000 7f4a4bfff640 1 -- 172.21.15.7:0/2696626317 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4c15a260 con 0x7f4a4c0d0360 2024-04-25T09:58:31.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.141+0000 7f4a4affd640 1 --2- 172.21.15.7:0/2696626317 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4a4c06c250 0x7f4a4c159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:31.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.141+0000 7f4a4bfff640 1 --2- 172.21.15.7:0/2696626317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a4c0d0360 0x7f4a4c1f5710 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f4a44009f40 tx=0x7f4a44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:31.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.141+0000 7f4a33fff640 1 -- 172.21.15.7:0/2696626317 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a44036050 con 0x7f4a4c0d0360 2024-04-25T09:58:31.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.141+0000 7f4a33fff640 1 -- 172.21.15.7:0/2696626317 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a44042070 con 0x7f4a4c0d0360 2024-04-25T09:58:31.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.141+0000 7f4a520cb640 1 -- 172.21.15.7:0/2696626317 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a4c15f650 con 0x7f4a4c0d0360 2024-04-25T09:58:31.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.141+0000 7f4a33fff640 1 -- 172.21.15.7:0/2696626317 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a44007c50 con 0x7f4a4c0d0360 2024-04-25T09:58:31.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.141+0000 7f4a520cb640 1 -- 172.21.15.7:0/2696626317 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a4c15fc10 con 0x7f4a4c0d0360 2024-04-25T09:58:31.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.142+0000 7f4a520cb640 1 -- 172.21.15.7:0/2696626317 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a4c068fd0 con 0x7f4a4c0d0360 2024-04-25T09:58:31.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.142+0000 7f4a33fff640 1 -- 172.21.15.7:0/2696626317 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4a44047460 con 0x7f4a4c0d0360 2024-04-25T09:58:31.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.143+0000 7f4a33fff640 1 --2- 172.21.15.7:0/2696626317 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4a3806b500 0x7f4a3806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:31.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.143+0000 7f4a33fff640 1 -- 172.21.15.7:0/2696626317 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f4a440ab320 con 0x7f4a4c0d0360 2024-04-25T09:58:31.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.143+0000 7f4a4b7fe640 1 --2- 172.21.15.7:0/2696626317 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4a3806b500 0x7f4a3806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:31.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.143+0000 7f4a4b7fe640 1 --2- 172.21.15.7:0/2696626317 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4a3806b500 0x7f4a3806d9c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c006fd0 tx=0x7f4a3c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:31.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.147+0000 7f4a33fff640 1 -- 172.21.15.7:0/2696626317 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4a44079fa0 con 0x7f4a4c0d0360 2024-04-25T09:58:31.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.338+0000 7f4a520cb640 1 -- 172.21.15.7:0/2696626317 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4a4c0d1150 con 0x7f4a4c0d0360 2024-04-25T09:58:31.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.338+0000 7f4a33fff640 1 -- 172.21.15.7:0/2696626317 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v64) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4a440798a0 con 0x7f4a4c0d0360 2024-04-25T09:58:31.342 INFO:teuthology.orchestra.run.smithi007.stderr:listed 0 entries 2024-04-25T09:58:31.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.340+0000 7f4a520cb640 1 -- 172.21.15.7:0/2696626317 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4a3806b500 msgr2=0x7f4a3806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:31.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.340+0000 7f4a520cb640 1 --2- 172.21.15.7:0/2696626317 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4a3806b500 0x7f4a3806d9c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c006fd0 tx=0x7f4a3c008040 comp rx=0 tx=0).stop 2024-04-25T09:58:31.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.340+0000 7f4a520cb640 1 -- 172.21.15.7:0/2696626317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a4c0d0360 msgr2=0x7f4a4c1f5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:31.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.340+0000 7f4a520cb640 1 --2- 172.21.15.7:0/2696626317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a4c0d0360 0x7f4a4c1f5710 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f4a44009f40 tx=0x7f4a44004a40 comp rx=0 tx=0).stop 2024-04-25T09:58:31.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.340+0000 7f4a520cb640 1 -- 172.21.15.7:0/2696626317 shutdown_connections 2024-04-25T09:58:31.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.340+0000 7f4a520cb640 1 --2- 172.21.15.7:0/2696626317 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4a3806b500 0x7f4a3806d9c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:31.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.340+0000 7f4a520cb640 1 --2- 172.21.15.7:0/2696626317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a4c0d0360 0x7f4a4c1f5710 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:31.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.340+0000 7f4a520cb640 1 --2- 172.21.15.7:0/2696626317 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4a4c06c250 0x7f4a4c159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:31.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.340+0000 7f4a520cb640 1 --2- 172.21.15.7:0/2696626317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a4c06bce0 0x7f4a4c1f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:31.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.340+0000 7f4a520cb640 1 -- 172.21.15.7:0/2696626317 >> 172.21.15.7:0/2696626317 conn(0x7f4a4c0d16e0 msgr2=0x7f4a4c15ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:31.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.340+0000 7f4a520cb640 1 -- 172.21.15.7:0/2696626317 shutdown_connections 2024-04-25T09:58:31.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.340+0000 7f4a520cb640 1 -- 172.21.15.7:0/2696626317 wait complete. 2024-04-25T09:58:31.354 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:58:31.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:58:31.355 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:58:31.395 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-04-25T09:58:31.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:58:31.396 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:58:31.451 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:58:31.451 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:58:31.469 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19023 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:58:31.469 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:58:31.469 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:58:31.507 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13704 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:58:31.507 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:58:31.507 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:58:31.525 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19023 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:58:31.526 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:58:31.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.644+0000 7fdf105d5640 1 Processor -- start 2024-04-25T09:58:31.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.644+0000 7fdf105d5640 1 -- start start 2024-04-25T09:58:31.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.645+0000 7fdf105d5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdf0815da60 0x7fdf080d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:31.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.645+0000 7fdf105d5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf0815e2d0 0x7fdf080ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:31.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.645+0000 7fdf105d5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf0815e8a0 con 0x7fdf0815de40 2024-04-25T09:58:31.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.645+0000 7fdf105d5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf0815eb80 con 0x7fdf0815da60 2024-04-25T09:58:31.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.645+0000 7fdf105d5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0815ee60 con 0x7fdf0815e2d0 2024-04-25T09:58:31.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.645+0000 7fdf0e371640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdf0815da60 0x7fdf080d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:31.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.645+0000 7fdf0eb72640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf0815e2d0 0x7fdf080ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:31.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.645+0000 7fdf0db70640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdf0815de40 0x7fdf08161d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:57156/0 (socket says 172.21.15.7:57156) 2024-04-25T09:58:31.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.645+0000 7fdf0db70640 1 -- 172.21.15.7:0/265832674 learned_addr learned my addr 172.21.15.7:0/265832674 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:31.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.646+0000 7fdf0e371640 1 -- 172.21.15.7:0/265832674 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf0815e2d0 msgr2=0x7fdf080ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:31.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.646+0000 7fdf0e371640 1 --2- 172.21.15.7:0/265832674 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf0815e2d0 0x7fdf080ce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:31.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.646+0000 7fdf0e371640 1 -- 172.21.15.7:0/265832674 >> v1:172.21.15.55:6789/0 conn(0x7fdf0815de40 legacy=0x7fdf08161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:31.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.646+0000 7fdf0e371640 1 -- 172.21.15.7:0/265832674 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf08161850 con 0x7fdf0815da60 2024-04-25T09:58:31.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.646+0000 7fdf0e371640 1 --2- 172.21.15.7:0/265832674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf0815da60 0x7fdf080d0aa0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdf040097a0 tx=0x7fdf0402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bbb96b9225aeca2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:31.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.647+0000 7fdf0d36f640 1 -- 172.21.15.7:0/265832674 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf04037070 con 0x7fdf0815da60 2024-04-25T09:58:31.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.647+0000 7fdf0d36f640 1 -- 172.21.15.7:0/265832674 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0402ae50 con 0x7fdf0815da60 2024-04-25T09:58:31.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.647+0000 7fdf0d36f640 1 -- 172.21.15.7:0/265832674 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf04032660 con 0x7fdf0815da60 2024-04-25T09:58:31.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.647+0000 7fdf105d5640 1 -- 172.21.15.7:0/265832674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf0815da60 msgr2=0x7fdf080d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:31.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.647+0000 7fdf105d5640 1 --2- 172.21.15.7:0/265832674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf0815da60 0x7fdf080d0aa0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdf040097a0 tx=0x7fdf0402a100 comp rx=0 tx=0).stop 2024-04-25T09:58:31.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.647+0000 7fdf105d5640 1 -- 172.21.15.7:0/265832674 shutdown_connections 2024-04-25T09:58:31.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.647+0000 7fdf105d5640 1 --2- 172.21.15.7:0/265832674 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf0815e2d0 0x7fdf080ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:31.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.647+0000 7fdf105d5640 1 --2- 172.21.15.7:0/265832674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf0815da60 0x7fdf080d0aa0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:31.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.647+0000 7fdf105d5640 1 -- 172.21.15.7:0/265832674 >> 172.21.15.7:0/265832674 conn(0x7fdf0806bfe0 msgr2=0x7fdf0806c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:31.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.647+0000 7fdf105d5640 1 -- 172.21.15.7:0/265832674 shutdown_connections 2024-04-25T09:58:31.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.647+0000 7fdf105d5640 1 -- 172.21.15.7:0/265832674 wait complete. 2024-04-25T09:58:31.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.648+0000 7fdf105d5640 1 Processor -- start 2024-04-25T09:58:31.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.648+0000 7fdf105d5640 1 -- start start 2024-04-25T09:58:31.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.649+0000 7fdf105d5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf0815da60 0x7fdf08156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:31.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.649+0000 7fdf105d5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf0815de40 0x7fdf081595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:31.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.649+0000 7fdf105d5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf0815e2d0 0x7fdf080b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:31.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.649+0000 7fdf105d5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf080cebe0 con 0x7fdf0815de40 2024-04-25T09:58:31.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.649+0000 7fdf105d5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf080cea60 con 0x7fdf0815e2d0 2024-04-25T09:58:31.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.649+0000 7fdf105d5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf080ced60 con 0x7fdf0815da60 2024-04-25T09:58:31.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.649+0000 7fdf0db70640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf0815de40 0x7fdf081595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:31.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.649+0000 7fdf0db70640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf0815de40 0x7fdf081595a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48470/0 (socket says 172.21.15.7:48470) 2024-04-25T09:58:31.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.649+0000 7fdf0db70640 1 -- 172.21.15.7:0/1142744589 learned_addr learned my addr 172.21.15.7:0/1142744589 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:31.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.649+0000 7fdf0eb72640 1 --2- 172.21.15.7:0/1142744589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf0815e2d0 0x7fdf080b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:31.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.649+0000 7fdf0e371640 1 --2- 172.21.15.7:0/1142744589 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf0815da60 0x7fdf08156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:31.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.650+0000 7fdf0db70640 1 -- 172.21.15.7:0/1142744589 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf0815da60 msgr2=0x7fdf08156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:31.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.650+0000 7fdf0db70640 1 --2- 172.21.15.7:0/1142744589 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf0815da60 0x7fdf08156d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:31.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.650+0000 7fdf0db70640 1 -- 172.21.15.7:0/1142744589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf0815e2d0 msgr2=0x7fdf080b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:31.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.650+0000 7fdf0db70640 1 --2- 172.21.15.7:0/1142744589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf0815e2d0 0x7fdf080b5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:31.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.650+0000 7fdf0db70640 1 -- 172.21.15.7:0/1142744589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0815a920 con 0x7fdf0815de40 2024-04-25T09:58:31.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.650+0000 7fdf0eb72640 1 --2- 172.21.15.7:0/1142744589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf0815e2d0 0x7fdf080b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:58:31.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.650+0000 7fdf0db70640 1 --2- 172.21.15.7:0/1142744589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf0815de40 0x7fdf081595a0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fdef800c3c0 tx=0x7fdef800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:31.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.650+0000 7fdefeffd640 1 -- 172.21.15.7:0/1142744589 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef8017070 con 0x7fdf0815de40 2024-04-25T09:58:31.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.650+0000 7fdefeffd640 1 -- 172.21.15.7:0/1142744589 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef8005ce0 con 0x7fdf0815de40 2024-04-25T09:58:31.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.650+0000 7fdf105d5640 1 -- 172.21.15.7:0/1142744589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf0815a080 con 0x7fdf0815de40 2024-04-25T09:58:31.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.650+0000 7fdefeffd640 1 -- 172.21.15.7:0/1142744589 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef80072f0 con 0x7fdf0815de40 2024-04-25T09:58:31.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.650+0000 7fdf105d5640 1 -- 172.21.15.7:0/1142744589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0815a640 con 0x7fdf0815de40 2024-04-25T09:58:31.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.651+0000 7fdf105d5640 1 -- 172.21.15.7:0/1142744589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf08068fd0 con 0x7fdf0815de40 2024-04-25T09:58:31.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.652+0000 7fdefeffd640 1 -- 172.21.15.7:0/1142744589 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdef801a070 con 0x7fdf0815de40 2024-04-25T09:58:31.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.652+0000 7fdefeffd640 1 --2- 172.21.15.7:0/1142744589 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdeec06b500 0x7fdeec06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:31.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.652+0000 7fdefeffd640 1 -- 172.21.15.7:0/1142744589 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6217+0+0 (secure 0 0 0) 0x7fdef8089620 con 0x7fdf0815de40 2024-04-25T09:58:31.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.652+0000 7fdf0e371640 1 --2- 172.21.15.7:0/1142744589 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdeec06b500 0x7fdeec06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:31.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.653+0000 7fdf0e371640 1 --2- 172.21.15.7:0/1142744589 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdeec06b500 0x7fdeec06d9c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fdf04034000 tx=0x7fdf0402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:31.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.656+0000 7fdefeffd640 1 -- 172.21.15.7:0/1142744589 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdef8057ce0 con 0x7fdf0815de40 2024-04-25T09:58:31.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.879+0000 7fdf105d5640 1 -- 172.21.15.7:0/1142744589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf080d1560 con 0x7fdf0815de40 2024-04-25T09:58:31.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.880+0000 7fdefeffd640 1 -- 172.21.15.7:0/1142744589 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4934 (secure 0 0 0) 0x7fdef805bd80 con 0x7fdf0815de40 2024-04-25T09:58:31.884 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:58:31.884 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3706118852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3706118852},{"type":"v1","addr":"172.21.15.55:6833","nonce":3706118852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5354,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1513522793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1513522793},{"type":"v1","addr":"172.21.15.55:6835","nonce":1513522793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5782,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1231382839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1231382839},{"type":"v1","addr":"172.21.15.7:6837","nonce":1231382839}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:57:15.098282+0000","modified":"2024-04-25T09:58:03.772256+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":15,"addr":"172.21.15.7:6836/3057688863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3057688863},{"type":"v1","addr":"172.21.15.7:6836","nonce":3057688863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:58:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 30 2024-04-25T09:58:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.882+0000 7fdf105d5640 1 -- 172.21.15.7:0/1142744589 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdeec06b500 msgr2=0x7fdeec06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.882+0000 7fdf105d5640 1 --2- 172.21.15.7:0/1142744589 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdeec06b500 0x7fdeec06d9c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fdf04034000 tx=0x7fdf0402e000 comp rx=0 tx=0).stop 2024-04-25T09:58:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.882+0000 7fdf105d5640 1 -- 172.21.15.7:0/1142744589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf0815de40 msgr2=0x7fdf081595a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.882+0000 7fdf105d5640 1 --2- 172.21.15.7:0/1142744589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf0815de40 0x7fdf081595a0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fdef800c3c0 tx=0x7fdef800c880 comp rx=0 tx=0).stop 2024-04-25T09:58:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.882+0000 7fdf105d5640 1 -- 172.21.15.7:0/1142744589 shutdown_connections 2024-04-25T09:58:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.882+0000 7fdf105d5640 1 --2- 172.21.15.7:0/1142744589 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdeec06b500 0x7fdeec06d9c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.882+0000 7fdf105d5640 1 --2- 172.21.15.7:0/1142744589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf0815e2d0 0x7fdf080b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.882+0000 7fdf105d5640 1 --2- 172.21.15.7:0/1142744589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf0815de40 0x7fdf081595a0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.882+0000 7fdf105d5640 1 --2- 172.21.15.7:0/1142744589 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf0815da60 0x7fdf08156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.882+0000 7fdf105d5640 1 -- 172.21.15.7:0/1142744589 >> 172.21.15.7:0/1142744589 conn(0x7fdf0806bfe0 msgr2=0x7fdf08160d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.882+0000 7fdf105d5640 1 -- 172.21.15.7:0/1142744589 shutdown_connections 2024-04-25T09:58:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.882+0000 7fdf105d5640 1 -- 172.21.15.7:0/1142744589 wait complete. 2024-04-25T09:58:31.897 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:58:31.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.993+0000 7f18e106b640 1 Processor -- start 2024-04-25T09:58:31.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.994+0000 7f18e106b640 1 -- start start 2024-04-25T09:58:32.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.994+0000 7f18e106b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f18dc0cd740 0x7f18dc0d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:32.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.994+0000 7f18e106b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f18dc0d08d0 0x7f18dc06c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:32.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.994+0000 7f18e106b640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18dc099b90 con 0x7f18dc06cbc0 2024-04-25T09:58:32.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.994+0000 7f18e106b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18dc0cdb20 con 0x7f18dc0d08d0 2024-04-25T09:58:32.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.994+0000 7f18e106b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc0ccca0 con 0x7f18dc0cd740 2024-04-25T09:58:32.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.994+0000 7f18db59e640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f18dc06cbc0 0x7f18dc161830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45650/0 (socket says 172.21.15.7:45650) 2024-04-25T09:58:32.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.994+0000 7f18db59e640 1 -- 172.21.15.7:0/1078144125 learned_addr learned my addr 172.21.15.7:0/1078144125 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:32.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.995+0000 7f18da59c640 1 --2- 172.21.15.7:0/1078144125 >> v2:172.21.15.55:3300/0 conn(0x7f18dc0d08d0 0x7f18dc06c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:32.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.995+0000 7f18dad9d640 1 --2- 172.21.15.7:0/1078144125 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f18dc0cd740 0x7f18dc0d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.995+0000 7f18d9d9b640 1 -- 172.21.15.7:0/1078144125 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 228850903 0 0) 0x7f18dc099b90 con 0x7f18dc06cbc0 2024-04-25T09:58:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.995+0000 7f18d9d9b640 1 -- 172.21.15.7:0/1078144125 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18c4003520 con 0x7f18dc06cbc0 2024-04-25T09:58:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.995+0000 7f18d9d9b640 1 -- 172.21.15.7:0/1078144125 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 577737170 0 0) 0x7f18c4003520 con 0x7f18dc06cbc0 2024-04-25T09:58:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.995+0000 7f18d9d9b640 1 -- 172.21.15.7:0/1078144125 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f18dc0cd740 msgr2=0x7f18dc0d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.995+0000 7f18d9d9b640 1 --2- 172.21.15.7:0/1078144125 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f18dc0cd740 0x7f18dc0d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.995+0000 7f18d9d9b640 1 -- 172.21.15.7:0/1078144125 >> v2:172.21.15.55:3300/0 conn(0x7f18dc0d08d0 msgr2=0x7f18dc06c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.995+0000 7f18d9d9b640 1 --2- 172.21.15.7:0/1078144125 >> v2:172.21.15.55:3300/0 conn(0x7f18dc0d08d0 0x7f18dc06c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.995+0000 7f18d9d9b640 1 -- 172.21.15.7:0/1078144125 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18dc099e70 con 0x7f18dc06cbc0 2024-04-25T09:58:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.995+0000 7f18d9d9b640 1 -- 172.21.15.7:0/1078144125 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f18cc0019f0 con 0x7f18dc06cbc0 2024-04-25T09:58:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.995+0000 7f18d9d9b640 1 -- 172.21.15.7:0/1078144125 >> v1:172.21.15.7:6789/0 conn(0x7f18dc06cbc0 legacy=0x7f18dc161830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.995+0000 7f18d9d9b640 1 --2- 172.21.15.7:0/1078144125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18c40039b0 0x7f18c4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.995+0000 7f18d9d9b640 1 --2- 172.21.15.7:0/1078144125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18c4004800 0x7f18c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.995+0000 7f18d9d9b640 1 --2- 172.21.15.7:0/1078144125 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f18dc0cd740 0x7f18c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:32.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.995+0000 7f18d9d9b640 1 -- 172.21.15.7:0/1078144125 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc0ccca0 con 0x7f18c4004800 2024-04-25T09:58:32.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.995+0000 7f18d9d9b640 1 -- 172.21.15.7:0/1078144125 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c400b9c0 con 0x7f18c40039b0 2024-04-25T09:58:32.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.995+0000 7f18d9d9b640 1 -- 172.21.15.7:0/1078144125 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c400bb40 con 0x7f18dc0cd740 2024-04-25T09:58:32.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.995+0000 7f18da59c640 1 --2- 172.21.15.7:0/1078144125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18c4004800 0x7f18c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:32.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.995+0000 7f18dad9d640 1 --2- 172.21.15.7:0/1078144125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18c40039b0 0x7f18c4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:32.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.995+0000 7f18db59e640 1 --2- 172.21.15.7:0/1078144125 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f18dc0cd740 0x7f18c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:32.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.995+0000 7f18da59c640 1 -- 172.21.15.7:0/1078144125 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f18dc0cd740 msgr2=0x7f18c40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:32.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.995+0000 7f18da59c640 1 --2- 172.21.15.7:0/1078144125 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f18dc0cd740 0x7f18c40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.995+0000 7f18da59c640 1 -- 172.21.15.7:0/1078144125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18c40039b0 msgr2=0x7f18c4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:32.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.995+0000 7f18da59c640 1 --2- 172.21.15.7:0/1078144125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18c40039b0 0x7f18c4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.996+0000 7f18da59c640 1 -- 172.21.15.7:0/1078144125 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c4003520 con 0x7f18c4004800 2024-04-25T09:58:32.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.996+0000 7f18da59c640 1 --2- 172.21.15.7:0/1078144125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18c4004800 0x7f18c4004c80 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f18d0009ac0 tx=0x7f18c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2301df5e93d89406 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:32.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.996+0000 7f18d9d9b640 1 -- 172.21.15.7:0/1078144125 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d0036070 con 0x7f18c4004800 2024-04-25T09:58:32.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.996+0000 7f18d9d9b640 1 -- 172.21.15.7:0/1078144125 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d0031400 con 0x7f18c4004800 2024-04-25T09:58:32.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.996+0000 7f18d9d9b640 1 -- 172.21.15.7:0/1078144125 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d0009690 con 0x7f18c4004800 2024-04-25T09:58:32.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.997+0000 7f18e106b640 1 -- 172.21.15.7:0/1078144125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18c4004800 msgr2=0x7f18c4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:32.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.997+0000 7f18e106b640 1 --2- 172.21.15.7:0/1078144125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18c4004800 0x7f18c4004c80 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f18d0009ac0 tx=0x7f18c4005830 comp rx=0 tx=0).stop 2024-04-25T09:58:32.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.997+0000 7f18db59e640 1 -- 172.21.15.7:0/1078144125 reap_dead start 2024-04-25T09:58:32.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.997+0000 7f18e106b640 1 -- 172.21.15.7:0/1078144125 shutdown_connections 2024-04-25T09:58:32.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.997+0000 7f18e106b640 1 -- 172.21.15.7:0/1078144125 >> 172.21.15.7:0/1078144125 conn(0x7f18dc0b3130 msgr2=0x7f18dc0b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:32.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.997+0000 7f18e106b640 1 -- 172.21.15.7:0/1078144125 shutdown_connections 2024-04-25T09:58:32.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.997+0000 7f18e106b640 1 -- 172.21.15.7:0/1078144125 wait complete. 2024-04-25T09:58:32.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.998+0000 7f18e106b640 1 Processor -- start 2024-04-25T09:58:32.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.998+0000 7f18e106b640 1 -- start start 2024-04-25T09:58:32.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.999+0000 7f18e106b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18c4004800 0x7f18dc1f3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:32.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.999+0000 7f18e106b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18dc158f50 0x7f18dc0ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:32.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.999+0000 7f18e106b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f18dc15ace0 0x7f18dc15b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:32.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.999+0000 7f18e106b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc09a710 con 0x7f18dc158f50 2024-04-25T09:58:32.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.999+0000 7f18e106b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc09a430 con 0x7f18c4004800 2024-04-25T09:58:32.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.999+0000 7f18e106b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc09ac30 con 0x7f18dc15ace0 2024-04-25T09:58:32.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.999+0000 7f18da59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18dc158f50 0x7f18dc0ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:32.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.999+0000 7f18da59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18dc158f50 0x7f18dc0ca660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48502/0 (socket says 172.21.15.7:48502) 2024-04-25T09:58:32.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.999+0000 7f18da59c640 1 -- 172.21.15.7:0/879770892 learned_addr learned my addr 172.21.15.7:0/879770892 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:32.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.999+0000 7f18dad9d640 1 --2- 172.21.15.7:0/879770892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18c4004800 0x7f18dc1f3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:32.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:31.999+0000 7f18db59e640 1 --2- 172.21.15.7:0/879770892 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f18dc15ace0 0x7f18dc15b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:32.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.000+0000 7f18da59c640 1 -- 172.21.15.7:0/879770892 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f18dc15ace0 msgr2=0x7f18dc15b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:32.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.000+0000 7f18da59c640 1 --2- 172.21.15.7:0/879770892 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f18dc15ace0 0x7f18dc15b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.000+0000 7f18da59c640 1 -- 172.21.15.7:0/879770892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18c4004800 msgr2=0x7f18dc1f3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:32.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.000+0000 7f18da59c640 1 --2- 172.21.15.7:0/879770892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18c4004800 0x7f18dc1f3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.000+0000 7f18da59c640 1 -- 172.21.15.7:0/879770892 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18dc159420 con 0x7f18dc158f50 2024-04-25T09:58:32.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.000+0000 7f18da59c640 1 --2- 172.21.15.7:0/879770892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18dc158f50 0x7f18dc0ca660 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f18d0034040 tx=0x7f18d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:32.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.000+0000 7f18c37fe640 1 -- 172.21.15.7:0/879770892 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d0040020 con 0x7f18dc158f50 2024-04-25T09:58:32.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.000+0000 7f18c37fe640 1 -- 172.21.15.7:0/879770892 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d0003890 con 0x7f18dc158f50 2024-04-25T09:58:32.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.000+0000 7f18e106b640 1 -- 172.21.15.7:0/879770892 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18dc159700 con 0x7f18dc158f50 2024-04-25T09:58:32.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.000+0000 7f18c37fe640 1 -- 172.21.15.7:0/879770892 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d0036040 con 0x7f18dc158f50 2024-04-25T09:58:32.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.000+0000 7f18e106b640 1 -- 172.21.15.7:0/879770892 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18dc159cc0 con 0x7f18dc158f50 2024-04-25T09:58:32.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.001+0000 7f18e106b640 1 -- 172.21.15.7:0/879770892 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18dc099b90 con 0x7f18dc158f50 2024-04-25T09:58:32.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.001+0000 7f18c37fe640 1 -- 172.21.15.7:0/879770892 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f18d0043020 con 0x7f18dc158f50 2024-04-25T09:58:32.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.002+0000 7f18c37fe640 1 --2- 172.21.15.7:0/879770892 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f18c806b4d0 0x7f18c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:32.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.002+0000 7f18c37fe640 1 -- 172.21.15.7:0/879770892 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f18d00aa470 con 0x7f18dc158f50 2024-04-25T09:58:32.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.002+0000 7f18dad9d640 1 --2- 172.21.15.7:0/879770892 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f18c806b4d0 0x7f18c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:32.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.002+0000 7f18dad9d640 1 --2- 172.21.15.7:0/879770892 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f18c806b4d0 0x7f18c806d990 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f18d4009ae0 tx=0x7f18d4009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:32.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.006+0000 7f18c37fe640 1 -- 172.21.15.7:0/879770892 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f18dc099b90 con 0x7f18dc158f50 2024-04-25T09:58:32.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.187+0000 7f18e106b640 1 -- 172.21.15.7:0/879770892 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18dc068fd0 con 0x7f18dc158f50 2024-04-25T09:58:32.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.188+0000 7f18c37fe640 1 -- 172.21.15.7:0/879770892 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16980 (secure 0 0 0) 0x7f18d004a070 con 0x7f18dc158f50 2024-04-25T09:58:32.192 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:58:32.193 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":64,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:58:10.114788+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:57:13.366946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T09:57:14.076493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.1e","mappings":[{"from":7,"to":2}]},{"pgid":"10.d","mappings":[{"from":4,"to":3}]},{"pgid":"10.2e","mappings":[{"from":4,"to":3}]},{"pgid":"10.3d","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:58:32.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.190+0000 7f18e106b640 1 -- 172.21.15.7:0/879770892 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f18c806b4d0 msgr2=0x7f18c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:32.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.190+0000 7f18e106b640 1 --2- 172.21.15.7:0/879770892 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f18c806b4d0 0x7f18c806d990 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f18d4009ae0 tx=0x7f18d4009190 comp rx=0 tx=0).stop 2024-04-25T09:58:32.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.190+0000 7f18e106b640 1 -- 172.21.15.7:0/879770892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18dc158f50 msgr2=0x7f18dc0ca660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:32.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.190+0000 7f18e106b640 1 --2- 172.21.15.7:0/879770892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18dc158f50 0x7f18dc0ca660 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f18d0034040 tx=0x7f18d0004730 comp rx=0 tx=0).stop 2024-04-25T09:58:32.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.190+0000 7f18e106b640 1 -- 172.21.15.7:0/879770892 shutdown_connections 2024-04-25T09:58:32.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.190+0000 7f18e106b640 1 --2- 172.21.15.7:0/879770892 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f18c806b4d0 0x7f18c806d990 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.190+0000 7f18e106b640 1 --2- 172.21.15.7:0/879770892 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f18dc15ace0 0x7f18dc15b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.190+0000 7f18e106b640 1 --2- 172.21.15.7:0/879770892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18dc158f50 0x7f18dc0ca660 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.190+0000 7f18e106b640 1 --2- 172.21.15.7:0/879770892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18c4004800 0x7f18dc1f3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.190+0000 7f18e106b640 1 -- 172.21.15.7:0/879770892 >> 172.21.15.7:0/879770892 conn(0x7f18dc0b3130 msgr2=0x7f18dc0b4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:32.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.190+0000 7f18e106b640 1 -- 172.21.15.7:0/879770892 shutdown_connections 2024-04-25T09:58:32.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.190+0000 7f18e106b640 1 -- 172.21.15.7:0/879770892 wait complete. 2024-04-25T09:58:32.205 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:57:13.366946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:57:14.076493+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:58:32.205 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:58:32.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.305+0000 7fe7632d8640 1 Processor -- start 2024-04-25T09:58:32.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.305+0000 7fe7632d8640 1 -- start start 2024-04-25T09:58:32.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.306+0000 7fe7632d8640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe75c15deb0 0x7fe75c0b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:32.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.306+0000 7fe7632d8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe75c0ce030 0x7fe75c0b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:32.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.306+0000 7fe7632d8640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe75c0b6f20 0x7fe75c0d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:32.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.306+0000 7fe7632d8640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe75c0ce4c0 con 0x7fe75c15deb0 2024-04-25T09:58:32.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.306+0000 7fe7632d8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe75c0d1a40 con 0x7fe75c0ce030 2024-04-25T09:58:32.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.306+0000 7fe7632d8640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c0d1d20 con 0x7fe75c0b6f20 2024-04-25T09:58:32.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.306+0000 7fe761074640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe75c15deb0 0x7fe75c0b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:32.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.306+0000 7fe761074640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe75c15deb0 0x7fe75c0b2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48510/0 (socket says 172.21.15.7:48510) 2024-04-25T09:58:32.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.306+0000 7fe761074640 1 -- 172.21.15.7:0/2313325045 learned_addr learned my addr 172.21.15.7:0/2313325045 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:32.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.306+0000 7fe760873640 1 --2- 172.21.15.7:0/2313325045 >> v2:172.21.15.55:3300/0 conn(0x7fe75c0ce030 0x7fe75c0b69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:32.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.306+0000 7fe761875640 1 --2- 172.21.15.7:0/2313325045 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe75c0b6f20 0x7fe75c0d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:32.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.306+0000 7fe761074640 1 -- 172.21.15.7:0/2313325045 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe75c0b6f20 msgr2=0x7fe75c0d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:32.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.306+0000 7fe761074640 1 --2- 172.21.15.7:0/2313325045 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe75c0b6f20 0x7fe75c0d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.306+0000 7fe761074640 1 -- 172.21.15.7:0/2313325045 >> v2:172.21.15.55:3300/0 conn(0x7fe75c0ce030 msgr2=0x7fe75c0b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:32.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.306+0000 7fe761074640 1 --2- 172.21.15.7:0/2313325045 >> v2:172.21.15.55:3300/0 conn(0x7fe75c0ce030 0x7fe75c0b69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.306+0000 7fe761074640 1 -- 172.21.15.7:0/2313325045 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75c0d2000 con 0x7fe75c15deb0 2024-04-25T09:58:32.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.307+0000 7fe761074640 1 --2- 172.21.15.7:0/2313325045 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe75c15deb0 0x7fe75c0b2c30 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fe75c0d48d0 tx=0x7fe74c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f229c4eb5fdb391c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:32.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.307+0000 7fe75bfff640 1 -- 172.21.15.7:0/2313325045 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c036070 con 0x7fe75c15deb0 2024-04-25T09:58:32.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.307+0000 7fe75bfff640 1 -- 172.21.15.7:0/2313325045 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74c031600 con 0x7fe75c15deb0 2024-04-25T09:58:32.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.307+0000 7fe75bfff640 1 -- 172.21.15.7:0/2313325045 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c0319d0 con 0x7fe75c15deb0 2024-04-25T09:58:32.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.308+0000 7fe7632d8640 1 -- 172.21.15.7:0/2313325045 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe75c15deb0 msgr2=0x7fe75c0b2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:32.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.308+0000 7fe7632d8640 1 --2- 172.21.15.7:0/2313325045 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe75c15deb0 0x7fe75c0b2c30 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fe75c0d48d0 tx=0x7fe74c02a6a0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.308+0000 7fe7632d8640 1 -- 172.21.15.7:0/2313325045 shutdown_connections 2024-04-25T09:58:32.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.308+0000 7fe7632d8640 1 --2- 172.21.15.7:0/2313325045 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe75c0b6f20 0x7fe75c0d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.308+0000 7fe7632d8640 1 --2- 172.21.15.7:0/2313325045 >> v2:172.21.15.55:3300/0 conn(0x7fe75c0ce030 0x7fe75c0b69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.308+0000 7fe7632d8640 1 --2- 172.21.15.7:0/2313325045 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe75c15deb0 0x7fe75c0b2c30 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.308+0000 7fe7632d8640 1 -- 172.21.15.7:0/2313325045 >> 172.21.15.7:0/2313325045 conn(0x7fe75c0726b0 msgr2=0x7fe75c072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:32.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.308+0000 7fe7632d8640 1 -- 172.21.15.7:0/2313325045 shutdown_connections 2024-04-25T09:58:32.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.308+0000 7fe7632d8640 1 -- 172.21.15.7:0/2313325045 wait complete. 2024-04-25T09:58:32.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.309+0000 7fe7632d8640 1 Processor -- start 2024-04-25T09:58:32.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.309+0000 7fe7632d8640 1 -- start start 2024-04-25T09:58:32.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.310+0000 7fe7632d8640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe75c0b6f20 0x7fe75c0cd820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:32.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.310+0000 7fe7632d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe75c0ce030 0x7fe75c159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:32.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.310+0000 7fe7632d8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe75c15deb0 0x7fe75c0cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:32.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.310+0000 7fe7632d8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c0d3ca0 con 0x7fe75c15deb0 2024-04-25T09:58:32.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.310+0000 7fe7632d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c0d25c0 con 0x7fe75c0ce030 2024-04-25T09:58:32.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.310+0000 7fe7632d8640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c0d3e20 con 0x7fe75c0b6f20 2024-04-25T09:58:32.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.310+0000 7fe761875640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe75c15deb0 0x7fe75c0cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:32.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.310+0000 7fe761875640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe75c15deb0 0x7fe75c0cb7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48522/0 (socket says 172.21.15.7:48522) 2024-04-25T09:58:32.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.310+0000 7fe761875640 1 -- 172.21.15.7:0/1459918415 learned_addr learned my addr 172.21.15.7:0/1459918415 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:32.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.310+0000 7fe760873640 1 --2- 172.21.15.7:0/1459918415 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe75c0ce030 0x7fe75c159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:32.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.310+0000 7fe761074640 1 --2- 172.21.15.7:0/1459918415 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe75c0b6f20 0x7fe75c0cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:32.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.310+0000 7fe761875640 1 -- 172.21.15.7:0/1459918415 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe75c0b6f20 msgr2=0x7fe75c0cd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:32.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.310+0000 7fe761875640 1 --2- 172.21.15.7:0/1459918415 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe75c0b6f20 0x7fe75c0cd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.310+0000 7fe761875640 1 -- 172.21.15.7:0/1459918415 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe75c0ce030 msgr2=0x7fe75c159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:32.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.310+0000 7fe761875640 1 --2- 172.21.15.7:0/1459918415 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe75c0ce030 0x7fe75c159fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.310+0000 7fe761875640 1 -- 172.21.15.7:0/1459918415 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75c0b2b80 con 0x7fe75c15deb0 2024-04-25T09:58:32.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.310+0000 7fe761875640 1 --2- 172.21.15.7:0/1459918415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe75c15deb0 0x7fe75c0cb7c0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fe75400d5f0 tx=0x7fe75400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:32.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.311+0000 7fe759ffb640 1 -- 172.21.15.7:0/1459918415 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7540125f0 con 0x7fe75c15deb0 2024-04-25T09:58:32.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.311+0000 7fe759ffb640 1 -- 172.21.15.7:0/1459918415 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe754019070 con 0x7fe75c15deb0 2024-04-25T09:58:32.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.311+0000 7fe759ffb640 1 -- 172.21.15.7:0/1459918415 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe754012a10 con 0x7fe75c15deb0 2024-04-25T09:58:32.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.311+0000 7fe7632d8640 1 -- 172.21.15.7:0/1459918415 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe75c0b2e20 con 0x7fe75c15deb0 2024-04-25T09:58:32.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.311+0000 7fe7632d8640 1 -- 172.21.15.7:0/1459918415 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe75c0b33e0 con 0x7fe75c15deb0 2024-04-25T09:58:32.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.312+0000 7fe7632d8640 1 -- 172.21.15.7:0/1459918415 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe75c068f60 con 0x7fe75c15deb0 2024-04-25T09:58:32.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.312+0000 7fe759ffb640 1 -- 172.21.15.7:0/1459918415 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe754012bb0 con 0x7fe75c15deb0 2024-04-25T09:58:32.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.312+0000 7fe759ffb640 1 --2- 172.21.15.7:0/1459918415 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe74806b4d0 0x7fe74806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:32.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.313+0000 7fe759ffb640 1 -- 172.21.15.7:0/1459918415 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6217+0+0 (secure 0 0 0) 0x7fe75408a690 con 0x7fe75c15deb0 2024-04-25T09:58:32.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.313+0000 7fe761074640 1 --2- 172.21.15.7:0/1459918415 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe74806b4d0 0x7fe74806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:32.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.313+0000 7fe761074640 1 --2- 172.21.15.7:0/1459918415 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe74806b4d0 0x7fe74806d990 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe74c033000 tx=0x7fe74c009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:32.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.317+0000 7fe759ffb640 1 -- 172.21.15.7:0/1459918415 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe754058cc0 con 0x7fe75c15deb0 2024-04-25T09:58:32.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.495+0000 7fe7632d8640 1 -- 172.21.15.7:0/1459918415 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe75c15d380 con 0x7fe75c15deb0 2024-04-25T09:58:32.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.495+0000 7fe759ffb640 1 -- 172.21.15.7:0/1459918415 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe75405cd60 con 0x7fe75c15deb0 2024-04-25T09:58:32.499 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T09:58:32.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.497+0000 7fe7632d8640 1 -- 172.21.15.7:0/1459918415 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe74806b4d0 msgr2=0x7fe74806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:32.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.497+0000 7fe7632d8640 1 --2- 172.21.15.7:0/1459918415 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe74806b4d0 0x7fe74806d990 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe74c033000 tx=0x7fe74c009000 comp rx=0 tx=0).stop 2024-04-25T09:58:32.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.497+0000 7fe7632d8640 1 -- 172.21.15.7:0/1459918415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe75c15deb0 msgr2=0x7fe75c0cb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:32.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.497+0000 7fe7632d8640 1 --2- 172.21.15.7:0/1459918415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe75c15deb0 0x7fe75c0cb7c0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fe75400d5f0 tx=0x7fe75400dab0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.497+0000 7fe7632d8640 1 -- 172.21.15.7:0/1459918415 shutdown_connections 2024-04-25T09:58:32.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.497+0000 7fe7632d8640 1 --2- 172.21.15.7:0/1459918415 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe74806b4d0 0x7fe74806d990 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.497+0000 7fe7632d8640 1 --2- 172.21.15.7:0/1459918415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe75c15deb0 0x7fe75c0cb7c0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.497+0000 7fe7632d8640 1 --2- 172.21.15.7:0/1459918415 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe75c0ce030 0x7fe75c159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.497+0000 7fe7632d8640 1 --2- 172.21.15.7:0/1459918415 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe75c0b6f20 0x7fe75c0cd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.497+0000 7fe7632d8640 1 -- 172.21.15.7:0/1459918415 >> 172.21.15.7:0/1459918415 conn(0x7fe75c0726b0 msgr2=0x7fe75c0c98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:32.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.497+0000 7fe7632d8640 1 -- 172.21.15.7:0/1459918415 shutdown_connections 2024-04-25T09:58:32.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.497+0000 7fe7632d8640 1 -- 172.21.15.7:0/1459918415 wait complete. 2024-04-25T09:58:32.511 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:58:32.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.612+0000 7f86e72ac640 1 Processor -- start 2024-04-25T09:58:32.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.612+0000 7f86e72ac640 1 -- start start 2024-04-25T09:58:32.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.613+0000 7f86e72ac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f86e00cf9b0 0x7f86e00cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:32.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.613+0000 7f86e72ac640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f86e00b2820 0x7f86e015f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:32.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.613+0000 7f86e72ac640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e00cd0e0 con 0x7f86e00cd8a0 2024-04-25T09:58:32.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.613+0000 7f86e72ac640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e00ccd90 con 0x7f86e00b2820 2024-04-25T09:58:32.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.613+0000 7f86e72ac640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e00cd410 con 0x7f86e00cf9b0 2024-04-25T09:58:32.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.613+0000 7f86e5849640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f86e00b2820 0x7f86e015f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:32.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.613+0000 7f86e5849640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f86e00b2820 0x7f86e015f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48536/0 (socket says 172.21.15.7:48536) 2024-04-25T09:58:32.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.613+0000 7f86e5849640 1 -- 172.21.15.7:0/645456775 learned_addr learned my addr 172.21.15.7:0/645456775 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:32.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.613+0000 7f86e4847640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f86e00cd8a0 0x7f86e00cfd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45666/0 (socket says 172.21.15.7:45666) 2024-04-25T09:58:32.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.613+0000 7f86e5048640 1 --2- 172.21.15.7:0/645456775 >> v2:172.21.15.55:3300/0 conn(0x7f86e00cf9b0 0x7f86e00cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:32.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.613+0000 7f86e5849640 1 -- 172.21.15.7:0/645456775 >> v2:172.21.15.55:3300/0 conn(0x7f86e00cf9b0 msgr2=0x7f86e00cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:32.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.613+0000 7f86e5849640 1 --2- 172.21.15.7:0/645456775 >> v2:172.21.15.55:3300/0 conn(0x7f86e00cf9b0 0x7f86e00cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.613+0000 7f86e5849640 1 -- 172.21.15.7:0/645456775 >> v1:172.21.15.7:6789/0 conn(0x7f86e00cd8a0 legacy=0x7f86e00cfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:32.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.613+0000 7f86d7fff640 1 -- 172.21.15.7:0/645456775 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1412583628 0 0) 0x7f86e00cd0e0 con 0x7f86e00cd8a0 2024-04-25T09:58:32.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.613+0000 7f86e5849640 1 -- 172.21.15.7:0/645456775 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e00cc7d0 con 0x7f86e00b2820 2024-04-25T09:58:32.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.613+0000 7f86e5048640 1 --2- 172.21.15.7:0/645456775 >> v2:172.21.15.55:3300/0 conn(0x7f86e00cf9b0 0x7f86e00cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:32.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.614+0000 7f86e5849640 1 --2- 172.21.15.7:0/645456775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86e00b2820 0x7f86e015f3b0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f86e00ccf10 tx=0x7f86d802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5110f30b1b463bee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:32.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.614+0000 7f86d7fff640 1 -- 172.21.15.7:0/645456775 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d8036070 con 0x7f86e00b2820 2024-04-25T09:58:32.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.614+0000 7f86d7fff640 1 -- 172.21.15.7:0/645456775 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d8031600 con 0x7f86e00b2820 2024-04-25T09:58:32.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.614+0000 7f86d7fff640 1 -- 172.21.15.7:0/645456775 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d80319d0 con 0x7f86e00b2820 2024-04-25T09:58:32.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.615+0000 7f86e72ac640 1 -- 172.21.15.7:0/645456775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86e00b2820 msgr2=0x7f86e015f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:32.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.615+0000 7f86e72ac640 1 --2- 172.21.15.7:0/645456775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86e00b2820 0x7f86e015f3b0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f86e00ccf10 tx=0x7f86d802a730 comp rx=0 tx=0).stop 2024-04-25T09:58:32.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.615+0000 7f86e72ac640 1 -- 172.21.15.7:0/645456775 shutdown_connections 2024-04-25T09:58:32.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.615+0000 7f86e72ac640 1 --2- 172.21.15.7:0/645456775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86e00b2820 0x7f86e015f3b0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.615+0000 7f86e72ac640 1 --2- 172.21.15.7:0/645456775 >> v2:172.21.15.55:3300/0 conn(0x7f86e00cf9b0 0x7f86e00cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.615+0000 7f86e72ac640 1 -- 172.21.15.7:0/645456775 >> 172.21.15.7:0/645456775 conn(0x7f86e00999f0 msgr2=0x7f86e00b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:32.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.615+0000 7f86e72ac640 1 -- 172.21.15.7:0/645456775 shutdown_connections 2024-04-25T09:58:32.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.615+0000 7f86e72ac640 1 -- 172.21.15.7:0/645456775 wait complete. 2024-04-25T09:58:32.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.616+0000 7f86e72ac640 1 Processor -- start 2024-04-25T09:58:32.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.616+0000 7f86e72ac640 1 -- start start 2024-04-25T09:58:32.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.617+0000 7f86e72ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86e00b2820 0x7f86e01f5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:32.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.617+0000 7f86e72ac640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f86e00cd8a0 0x7f86e0157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:32.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.617+0000 7f86e72ac640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86e00cf9b0 0x7f86e0157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:32.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.617+0000 7f86e72ac640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e015ba80 con 0x7f86e00cf9b0 2024-04-25T09:58:32.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.617+0000 7f86e72ac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e00cdce0 con 0x7f86e00b2820 2024-04-25T09:58:32.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.617+0000 7f86e72ac640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e015bc00 con 0x7f86e00cd8a0 2024-04-25T09:58:32.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.617+0000 7f86e5849640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86e00cf9b0 0x7f86e0157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:32.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.617+0000 7f86e5849640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86e00cf9b0 0x7f86e0157dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48544/0 (socket says 172.21.15.7:48544) 2024-04-25T09:58:32.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.617+0000 7f86e5849640 1 -- 172.21.15.7:0/2512611934 learned_addr learned my addr 172.21.15.7:0/2512611934 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:32.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.617+0000 7f86e4847640 1 --2- 172.21.15.7:0/2512611934 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f86e00cd8a0 0x7f86e0157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:32.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.617+0000 7f86e5048640 1 --2- 172.21.15.7:0/2512611934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86e00b2820 0x7f86e01f5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:32.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.617+0000 7f86e5849640 1 -- 172.21.15.7:0/2512611934 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f86e00cd8a0 msgr2=0x7f86e0157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:32.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.617+0000 7f86e5849640 1 --2- 172.21.15.7:0/2512611934 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f86e00cd8a0 0x7f86e0157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.617+0000 7f86e5849640 1 -- 172.21.15.7:0/2512611934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86e00b2820 msgr2=0x7f86e01f5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:32.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.617+0000 7f86e5849640 1 --2- 172.21.15.7:0/2512611934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86e00b2820 0x7f86e01f5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.617+0000 7f86e5849640 1 -- 172.21.15.7:0/2512611934 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e00b4fb0 con 0x7f86e00cf9b0 2024-04-25T09:58:32.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.617+0000 7f86e5849640 1 --2- 172.21.15.7:0/2512611934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86e00cf9b0 0x7f86e0157dd0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f86d8034040 tx=0x7f86d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:32.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.617+0000 7f86d5ffb640 1 -- 172.21.15.7:0/2512611934 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d8036050 con 0x7f86e00cf9b0 2024-04-25T09:58:32.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.617+0000 7f86d5ffb640 1 -- 172.21.15.7:0/2512611934 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d8042070 con 0x7f86e00cf9b0 2024-04-25T09:58:32.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.617+0000 7f86e72ac640 1 -- 172.21.15.7:0/2512611934 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e00c6a30 con 0x7f86e00cf9b0 2024-04-25T09:58:32.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.618+0000 7f86d5ffb640 1 -- 172.21.15.7:0/2512611934 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d8009510 con 0x7f86e00cf9b0 2024-04-25T09:58:32.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.618+0000 7f86e72ac640 1 -- 172.21.15.7:0/2512611934 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e01f4e30 con 0x7f86e00cf9b0 2024-04-25T09:58:32.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.619+0000 7f86e72ac640 1 -- 172.21.15.7:0/2512611934 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e00b51b0 con 0x7f86e00cf9b0 2024-04-25T09:58:32.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.619+0000 7f86d5ffb640 1 -- 172.21.15.7:0/2512611934 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f86d8007bf0 con 0x7f86e00cf9b0 2024-04-25T09:58:32.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.619+0000 7f86d5ffb640 1 --2- 172.21.15.7:0/2512611934 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f86c406b500 0x7f86c406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:32.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.620+0000 7f86d5ffb640 1 -- 172.21.15.7:0/2512611934 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f86d80ab170 con 0x7f86e00cf9b0 2024-04-25T09:58:32.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.620+0000 7f86e5048640 1 --2- 172.21.15.7:0/2512611934 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f86c406b500 0x7f86c406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:32.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.620+0000 7f86e5048640 1 --2- 172.21.15.7:0/2512611934 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f86c406b500 0x7f86c406d9c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f86e00b1330 tx=0x7f86dc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:32.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.624+0000 7f86d5ffb640 1 -- 172.21.15.7:0/2512611934 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f86d8079fa0 con 0x7f86e00cf9b0 2024-04-25T09:58:32.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.803+0000 7f86e72ac640 1 -- 172.21.15.7:0/2512611934 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f86e0068f60 con 0x7f86e00cf9b0 2024-04-25T09:58:32.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.804+0000 7f86d5ffb640 1 -- 172.21.15.7:0/2512611934 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v64) v1 ==== 104+0+11 (secure 0 0 0) 0x7f86d80798a0 con 0x7f86e00cf9b0 2024-04-25T09:58:32.808 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:58:32.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.806+0000 7f86e72ac640 1 -- 172.21.15.7:0/2512611934 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f86c406b500 msgr2=0x7f86c406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:32.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.806+0000 7f86e72ac640 1 --2- 172.21.15.7:0/2512611934 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f86c406b500 0x7f86c406d9c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f86e00b1330 tx=0x7f86dc008040 comp rx=0 tx=0).stop 2024-04-25T09:58:32.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.806+0000 7f86e72ac640 1 -- 172.21.15.7:0/2512611934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86e00cf9b0 msgr2=0x7f86e0157dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:32.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.806+0000 7f86e72ac640 1 --2- 172.21.15.7:0/2512611934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86e00cf9b0 0x7f86e0157dd0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f86d8034040 tx=0x7f86d8004a40 comp rx=0 tx=0).stop 2024-04-25T09:58:32.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.806+0000 7f86e72ac640 1 -- 172.21.15.7:0/2512611934 shutdown_connections 2024-04-25T09:58:32.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.806+0000 7f86e72ac640 1 --2- 172.21.15.7:0/2512611934 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f86c406b500 0x7f86c406d9c0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.806+0000 7f86e72ac640 1 --2- 172.21.15.7:0/2512611934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86e00cf9b0 0x7f86e0157dd0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.806+0000 7f86e72ac640 1 --2- 172.21.15.7:0/2512611934 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f86e00cd8a0 0x7f86e0157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.806+0000 7f86e72ac640 1 --2- 172.21.15.7:0/2512611934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86e00b2820 0x7f86e01f5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.806+0000 7f86e72ac640 1 -- 172.21.15.7:0/2512611934 >> 172.21.15.7:0/2512611934 conn(0x7f86e00999f0 msgr2=0x7f86e00ad360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:32.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.806+0000 7f86e72ac640 1 -- 172.21.15.7:0/2512611934 shutdown_connections 2024-04-25T09:58:32.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.806+0000 7f86e72ac640 1 -- 172.21.15.7:0/2512611934 wait complete. 2024-04-25T09:58:32.821 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:58:32.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.921+0000 7f6caa3d5640 1 Processor -- start 2024-04-25T09:58:32.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.921+0000 7f6caa3d5640 1 -- start start 2024-04-25T09:58:32.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.922+0000 7f6caa3d5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6ca415db30 0x7f6ca40d0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:32.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.922+0000 7f6caa3d5640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6ca40ced90 0x7f6ca40b6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:32.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.922+0000 7f6caa3d5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca415df10 con 0x7f6ca40d0980 2024-04-25T09:58:32.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.922+0000 7f6caa3d5640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca40d1780 con 0x7f6ca40ced90 2024-04-25T09:58:32.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.922+0000 7f6caa3d5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca40d1a60 con 0x7f6ca415db30 2024-04-25T09:58:32.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.922+0000 7f6ca8972640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6ca40ced90 0x7f6ca40b6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:32.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.922+0000 7f6ca8972640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6ca40ced90 0x7f6ca40b6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48548/0 (socket says 172.21.15.7:48548) 2024-04-25T09:58:32.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.922+0000 7f6ca8972640 1 -- 172.21.15.7:0/1940591814 learned_addr learned my addr 172.21.15.7:0/1940591814 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:32.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.922+0000 7f6ca3fff640 1 --2- 172.21.15.7:0/1940591814 >> v2:172.21.15.55:3300/0 conn(0x7f6ca415db30 0x7f6ca40d0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:32.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.922+0000 7f6ca8972640 1 -- 172.21.15.7:0/1940591814 >> v2:172.21.15.55:3300/0 conn(0x7f6ca415db30 msgr2=0x7f6ca40d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:32.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.922+0000 7f6ca8972640 1 --2- 172.21.15.7:0/1940591814 >> v2:172.21.15.55:3300/0 conn(0x7f6ca415db30 0x7f6ca40d0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.922+0000 7f6ca8972640 1 -- 172.21.15.7:0/1940591814 >> v1:172.21.15.55:6789/0 conn(0x7f6ca40d0980 legacy=0x7f6ca40ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:32.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.922+0000 7f6ca8972640 1 -- 172.21.15.7:0/1940591814 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca40d1d40 con 0x7f6ca40ced90 2024-04-25T09:58:32.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.923+0000 7f6ca8972640 1 --2- 172.21.15.7:0/1940591814 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ca40ced90 0x7f6ca40b6a70 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f6ca40d0fa0 tx=0x7f6c9c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb2db61c5f9f4d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:32.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.923+0000 7f6ca2ffd640 1 -- 172.21.15.7:0/1940591814 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c036070 con 0x7f6ca40ced90 2024-04-25T09:58:32.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.923+0000 7f6ca2ffd640 1 -- 172.21.15.7:0/1940591814 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9c031600 con 0x7f6ca40ced90 2024-04-25T09:58:32.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.923+0000 7f6ca2ffd640 1 -- 172.21.15.7:0/1940591814 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c0319d0 con 0x7f6ca40ced90 2024-04-25T09:58:32.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.923+0000 7f6caa3d5640 1 -- 172.21.15.7:0/1940591814 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ca40ced90 msgr2=0x7f6ca40b6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:32.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.923+0000 7f6caa3d5640 1 --2- 172.21.15.7:0/1940591814 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ca40ced90 0x7f6ca40b6a70 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f6ca40d0fa0 tx=0x7f6c9c02a730 comp rx=0 tx=0).stop 2024-04-25T09:58:32.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.923+0000 7f6caa3d5640 1 -- 172.21.15.7:0/1940591814 shutdown_connections 2024-04-25T09:58:32.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.923+0000 7f6caa3d5640 1 --2- 172.21.15.7:0/1940591814 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ca40ced90 0x7f6ca40b6a70 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.923+0000 7f6caa3d5640 1 --2- 172.21.15.7:0/1940591814 >> v2:172.21.15.55:3300/0 conn(0x7f6ca415db30 0x7f6ca40d0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.923+0000 7f6caa3d5640 1 -- 172.21.15.7:0/1940591814 >> 172.21.15.7:0/1940591814 conn(0x7f6ca40728c0 msgr2=0x7f6ca406bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:32.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.923+0000 7f6caa3d5640 1 -- 172.21.15.7:0/1940591814 shutdown_connections 2024-04-25T09:58:32.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.924+0000 7f6caa3d5640 1 -- 172.21.15.7:0/1940591814 wait complete. 2024-04-25T09:58:32.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.925+0000 7f6caa3d5640 1 Processor -- start 2024-04-25T09:58:32.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.925+0000 7f6caa3d5640 1 -- start start 2024-04-25T09:58:32.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.926+0000 7f6caa3d5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ca40ced90 0x7f6ca414ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:32.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.926+0000 7f6caa3d5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6ca40d0980 0x7f6ca40c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:32.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.926+0000 7f6caa3d5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ca415db30 0x7f6ca4156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:32.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.926+0000 7f6caa3d5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca40b6fb0 con 0x7f6ca415db30 2024-04-25T09:58:32.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.926+0000 7f6caa3d5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca40d1410 con 0x7f6ca40ced90 2024-04-25T09:58:32.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.926+0000 7f6caa3d5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca40b7130 con 0x7f6ca40d0980 2024-04-25T09:58:32.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.926+0000 7f6ca8972640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ca415db30 0x7f6ca4156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:32.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.926+0000 7f6ca8972640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ca415db30 0x7f6ca4156da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48552/0 (socket says 172.21.15.7:48552) 2024-04-25T09:58:32.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.926+0000 7f6ca8972640 1 -- 172.21.15.7:0/3290877299 learned_addr learned my addr 172.21.15.7:0/3290877299 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:32.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.926+0000 7f6ca3fff640 1 --2- 172.21.15.7:0/3290877299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ca40ced90 0x7f6ca414ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:32.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.926+0000 7f6ca37fe640 1 --2- 172.21.15.7:0/3290877299 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6ca40d0980 0x7f6ca40c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:32.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.926+0000 7f6ca8972640 1 -- 172.21.15.7:0/3290877299 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6ca40d0980 msgr2=0x7f6ca40c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:32.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.926+0000 7f6ca8972640 1 --2- 172.21.15.7:0/3290877299 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6ca40d0980 0x7f6ca40c8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.926+0000 7f6ca8972640 1 -- 172.21.15.7:0/3290877299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ca40ced90 msgr2=0x7f6ca414ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:32.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.926+0000 7f6ca8972640 1 --2- 172.21.15.7:0/3290877299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ca40ced90 0x7f6ca414ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:32.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.926+0000 7f6ca8972640 1 -- 172.21.15.7:0/3290877299 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca40c7470 con 0x7f6ca415db30 2024-04-25T09:58:32.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.926+0000 7f6ca3fff640 1 --2- 172.21.15.7:0/3290877299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ca40ced90 0x7f6ca414ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:58:32.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.926+0000 7f6ca8972640 1 --2- 172.21.15.7:0/3290877299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ca415db30 0x7f6ca4156da0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c02ad20 tx=0x7f6c9c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:32.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.926+0000 7f6ca0ff9640 1 -- 172.21.15.7:0/3290877299 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c03f020 con 0x7f6ca415db30 2024-04-25T09:58:32.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.926+0000 7f6ca0ff9640 1 -- 172.21.15.7:0/3290877299 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9c037040 con 0x7f6ca415db30 2024-04-25T09:58:32.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.926+0000 7f6ca0ff9640 1 -- 172.21.15.7:0/3290877299 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c036070 con 0x7f6ca415db30 2024-04-25T09:58:32.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.927+0000 7f6caa3d5640 1 -- 172.21.15.7:0/3290877299 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca414d3d0 con 0x7f6ca415db30 2024-04-25T09:58:32.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.927+0000 7f6caa3d5640 1 -- 172.21.15.7:0/3290877299 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca40c79f0 con 0x7f6ca415db30 2024-04-25T09:58:32.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.927+0000 7f6caa3d5640 1 -- 172.21.15.7:0/3290877299 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca4068f60 con 0x7f6ca415db30 2024-04-25T09:58:32.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.928+0000 7f6ca0ff9640 1 -- 172.21.15.7:0/3290877299 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6c9c042020 con 0x7f6ca415db30 2024-04-25T09:58:32.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.928+0000 7f6ca0ff9640 1 --2- 172.21.15.7:0/3290877299 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6c9006b4d0 0x7f6c9006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:32.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.928+0000 7f6ca0ff9640 1 -- 172.21.15.7:0/3290877299 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f6c9c0aa7a0 con 0x7f6ca415db30 2024-04-25T09:58:32.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.928+0000 7f6ca3fff640 1 --2- 172.21.15.7:0/3290877299 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6c9006b4d0 0x7f6c9006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:32.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.929+0000 7f6ca3fff640 1 --2- 172.21.15.7:0/3290877299 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6c9006b4d0 0x7f6c9006d990 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6c94006fd0 tx=0x7f6c94008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:32.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:32.933+0000 7f6ca0ff9640 1 -- 172.21.15.7:0/3290877299 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6c9c049030 con 0x7f6ca415db30 2024-04-25T09:58:33.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.111+0000 7f6caa3d5640 1 -- 172.21.15.7:0/3290877299 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6ca415baa0 con 0x7f6ca415db30 2024-04-25T09:58:33.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.111+0000 7f6ca0ff9640 1 -- 172.21.15.7:0/3290877299 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v64) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6c9c07de20 con 0x7f6ca415db30 2024-04-25T09:58:33.115 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T09:58:33.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.113+0000 7f6caa3d5640 1 -- 172.21.15.7:0/3290877299 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6c9006b4d0 msgr2=0x7f6c9006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:33.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.113+0000 7f6caa3d5640 1 --2- 172.21.15.7:0/3290877299 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6c9006b4d0 0x7f6c9006d990 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6c94006fd0 tx=0x7f6c94008040 comp rx=0 tx=0).stop 2024-04-25T09:58:33.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.113+0000 7f6caa3d5640 1 -- 172.21.15.7:0/3290877299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ca415db30 msgr2=0x7f6ca4156da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:33.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.113+0000 7f6caa3d5640 1 --2- 172.21.15.7:0/3290877299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ca415db30 0x7f6ca4156da0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c02ad20 tx=0x7f6c9c004a40 comp rx=0 tx=0).stop 2024-04-25T09:58:33.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.113+0000 7f6caa3d5640 1 -- 172.21.15.7:0/3290877299 shutdown_connections 2024-04-25T09:58:33.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.113+0000 7f6caa3d5640 1 --2- 172.21.15.7:0/3290877299 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6c9006b4d0 0x7f6c9006d990 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:33.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.113+0000 7f6caa3d5640 1 --2- 172.21.15.7:0/3290877299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ca415db30 0x7f6ca4156da0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:33.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.113+0000 7f6caa3d5640 1 --2- 172.21.15.7:0/3290877299 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6ca40d0980 0x7f6ca40c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:33.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.113+0000 7f6caa3d5640 1 --2- 172.21.15.7:0/3290877299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ca40ced90 0x7f6ca414ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:33.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.113+0000 7f6caa3d5640 1 -- 172.21.15.7:0/3290877299 >> 172.21.15.7:0/3290877299 conn(0x7f6ca40728c0 msgr2=0x7f6ca415ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:33.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.113+0000 7f6caa3d5640 1 -- 172.21.15.7:0/3290877299 shutdown_connections 2024-04-25T09:58:33.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.113+0000 7f6caa3d5640 1 -- 172.21.15.7:0/3290877299 wait complete. 2024-04-25T09:58:33.128 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:58:33.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.225+0000 7f20d293b640 1 Processor -- start 2024-04-25T09:58:33.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.225+0000 7f20d293b640 1 -- start start 2024-04-25T09:58:33.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.226+0000 7f20d293b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f20cc0b53b0 0x7f20cc0d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:33.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.226+0000 7f20d293b640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20cc0d1e80 con 0x7f20cc0d0a50 2024-04-25T09:58:33.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.226+0000 7f20d293b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20cc0b5930 con 0x7f20cc15db00 2024-04-25T09:58:33.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.226+0000 7f20d293b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc0b5c10 con 0x7f20cc0b53b0 2024-04-25T09:58:33.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.226+0000 7f20cb7fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f20cc0d0a50 0x7f20cc0d2330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45682/0 (socket says 172.21.15.7:45682) 2024-04-25T09:58:33.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.226+0000 7f20cb7fe640 1 -- 172.21.15.7:0/2819759067 learned_addr learned my addr 172.21.15.7:0/2819759067 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:33.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.227+0000 7f20d0ed8640 1 --2- 172.21.15.7:0/2819759067 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f20cc0b53b0 0x7f20cc0d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:33.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.227+0000 7f20caffd640 1 -- 172.21.15.7:0/2819759067 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1826714087 0 0) 0x7f20cc0d1e80 con 0x7f20cc0d0a50 2024-04-25T09:58:33.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.227+0000 7f20caffd640 1 -- 172.21.15.7:0/2819759067 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20b4003520 con 0x7f20cc0d0a50 2024-04-25T09:58:33.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.227+0000 7f20caffd640 1 -- 172.21.15.7:0/2819759067 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2371088018 0 0) 0x7f20b4003520 con 0x7f20cc0d0a50 2024-04-25T09:58:33.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.227+0000 7f20caffd640 1 -- 172.21.15.7:0/2819759067 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f20cc0b53b0 msgr2=0x7f20cc0d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:33.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.227+0000 7f20caffd640 1 --2- 172.21.15.7:0/2819759067 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f20cc0b53b0 0x7f20cc0d2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:33.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.227+0000 7f20caffd640 1 -- 172.21.15.7:0/2819759067 >> v1:172.21.15.55:6789/0 conn(0x7f20cc15db00 legacy=0x7f20cc0d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:33.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.227+0000 7f20caffd640 1 -- 172.21.15.7:0/2819759067 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20cc0b5ef0 con 0x7f20cc0d0a50 2024-04-25T09:58:33.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.227+0000 7f20caffd640 1 -- 172.21.15.7:0/2819759067 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f20c0001670 con 0x7f20cc0d0a50 2024-04-25T09:58:33.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.227+0000 7f20caffd640 1 -- 172.21.15.7:0/2819759067 >> v1:172.21.15.7:6789/0 conn(0x7f20cc0d0a50 legacy=0x7f20cc0d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:33.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.227+0000 7f20caffd640 1 --2- 172.21.15.7:0/2819759067 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f20cc0b53b0 0x7f20b40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:33.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.227+0000 7f20caffd640 1 --2- 172.21.15.7:0/2819759067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20b4003f60 0x7f20b4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:33.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.227+0000 7f20caffd640 1 --2- 172.21.15.7:0/2819759067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20b4004d40 0x7f20b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:33.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.227+0000 7f20caffd640 1 -- 172.21.15.7:0/2819759067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc0b5c10 con 0x7f20b4004d40 2024-04-25T09:58:33.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.227+0000 7f20caffd640 1 -- 172.21.15.7:0/2819759067 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b400baa0 con 0x7f20b4003f60 2024-04-25T09:58:33.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.227+0000 7f20caffd640 1 -- 172.21.15.7:0/2819759067 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b400bca0 con 0x7f20cc0b53b0 2024-04-25T09:58:33.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.227+0000 7f20d0ed8640 1 --2- 172.21.15.7:0/2819759067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20b4004d40 0x7f20b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:33.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.227+0000 7f20cbfff640 1 --2- 172.21.15.7:0/2819759067 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f20cc0b53b0 0x7f20b40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:33.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.227+0000 7f20cb7fe640 1 --2- 172.21.15.7:0/2819759067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20b4003f60 0x7f20b4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:33.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.228+0000 7f20d0ed8640 1 -- 172.21.15.7:0/2819759067 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f20cc0b53b0 msgr2=0x7f20b40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:33.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.228+0000 7f20d0ed8640 1 --2- 172.21.15.7:0/2819759067 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f20cc0b53b0 0x7f20b40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:33.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.228+0000 7f20d0ed8640 1 -- 172.21.15.7:0/2819759067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20b4003f60 msgr2=0x7f20b4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:33.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.228+0000 7f20d0ed8640 1 --2- 172.21.15.7:0/2819759067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20b4003f60 0x7f20b4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:33.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.228+0000 7f20d0ed8640 1 -- 172.21.15.7:0/2819759067 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b4003520 con 0x7f20b4004d40 2024-04-25T09:58:33.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.228+0000 7f20cbfff640 1 --2- 172.21.15.7:0/2819759067 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f20cc0b53b0 0x7f20b40039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:33.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.228+0000 7f20cb7fe640 1 --2- 172.21.15.7:0/2819759067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20b4003f60 0x7f20b4004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:33.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.228+0000 7f20d0ed8640 1 --2- 172.21.15.7:0/2819759067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20b4004d40 0x7f20b40051c0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f20c4009f90 tx=0x7f20b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb15cd621c8013c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:33.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.228+0000 7f20caffd640 1 -- 172.21.15.7:0/2819759067 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c4009c10 con 0x7f20b4004d40 2024-04-25T09:58:33.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.228+0000 7f20caffd640 1 -- 172.21.15.7:0/2819759067 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c4036070 con 0x7f20b4004d40 2024-04-25T09:58:33.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.228+0000 7f20caffd640 1 -- 172.21.15.7:0/2819759067 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c4031810 con 0x7f20b4004d40 2024-04-25T09:58:33.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.229+0000 7f20d293b640 1 -- 172.21.15.7:0/2819759067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20b4004d40 msgr2=0x7f20b40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:33.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.229+0000 7f20d293b640 1 --2- 172.21.15.7:0/2819759067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20b4004d40 0x7f20b40051c0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f20c4009f90 tx=0x7f20b4005830 comp rx=0 tx=0).stop 2024-04-25T09:58:33.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.229+0000 7f20d0ed8640 1 -- 172.21.15.7:0/2819759067 reap_dead start 2024-04-25T09:58:33.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.229+0000 7f20d293b640 1 -- 172.21.15.7:0/2819759067 shutdown_connections 2024-04-25T09:58:33.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.229+0000 7f20d293b640 1 -- 172.21.15.7:0/2819759067 >> 172.21.15.7:0/2819759067 conn(0x7f20cc072290 msgr2=0x7f20cc0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:33.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.229+0000 7f20d293b640 1 -- 172.21.15.7:0/2819759067 shutdown_connections 2024-04-25T09:58:33.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.229+0000 7f20d293b640 1 -- 172.21.15.7:0/2819759067 wait complete. 2024-04-25T09:58:33.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.230+0000 7f20d293b640 1 Processor -- start 2024-04-25T09:58:33.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.230+0000 7f20d293b640 1 -- start start 2024-04-25T09:58:33.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.231+0000 7f20d293b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20b4004d40 0x7f20cc0cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:33.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.231+0000 7f20d293b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20cc160370 0x7f20cc0cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:33.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.231+0000 7f20d293b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f20cc1607f0 0x7f20cc0cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:33.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.231+0000 7f20d293b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc0d3660 con 0x7f20cc160370 2024-04-25T09:58:33.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.231+0000 7f20d293b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc0b61d0 con 0x7f20b4004d40 2024-04-25T09:58:33.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.231+0000 7f20d293b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc0ce2b0 con 0x7f20cc1607f0 2024-04-25T09:58:33.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.231+0000 7f20cb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20cc160370 0x7f20cc0cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:33.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.231+0000 7f20cb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20cc160370 0x7f20cc0cb4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48574/0 (socket says 172.21.15.7:48574) 2024-04-25T09:58:33.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.231+0000 7f20cb7fe640 1 -- 172.21.15.7:0/1668268516 learned_addr learned my addr 172.21.15.7:0/1668268516 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:33.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.231+0000 7f20cbfff640 1 --2- 172.21.15.7:0/1668268516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20b4004d40 0x7f20cc0cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:33.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.231+0000 7f20d0ed8640 1 --2- 172.21.15.7:0/1668268516 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f20cc1607f0 0x7f20cc0cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:33.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.231+0000 7f20cb7fe640 1 -- 172.21.15.7:0/1668268516 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f20cc1607f0 msgr2=0x7f20cc0cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:33.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.231+0000 7f20cb7fe640 1 --2- 172.21.15.7:0/1668268516 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f20cc1607f0 0x7f20cc0cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:33.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.231+0000 7f20cb7fe640 1 -- 172.21.15.7:0/1668268516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20b4004d40 msgr2=0x7f20cc0cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:33.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.231+0000 7f20cb7fe640 1 --2- 172.21.15.7:0/1668268516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20b4004d40 0x7f20cc0cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:33.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.231+0000 7f20cb7fe640 1 -- 172.21.15.7:0/1668268516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20cc0cc350 con 0x7f20cc160370 2024-04-25T09:58:33.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.231+0000 7f20cbfff640 1 --2- 172.21.15.7:0/1668268516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20b4004d40 0x7f20cc0cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:58:33.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.231+0000 7f20d0ed8640 1 --2- 172.21.15.7:0/1668268516 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f20cc1607f0 0x7f20cc0cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:58:33.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.232+0000 7f20cb7fe640 1 --2- 172.21.15.7:0/1668268516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20cc160370 0x7f20cc0cb4a0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f20c000e7c0 tx=0x7f20c000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:33.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.232+0000 7f20c8ff9640 1 -- 172.21.15.7:0/1668268516 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c000c8d0 con 0x7f20cc160370 2024-04-25T09:58:33.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.232+0000 7f20c8ff9640 1 -- 172.21.15.7:0/1668268516 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c0018070 con 0x7f20cc160370 2024-04-25T09:58:33.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.232+0000 7f20c8ff9640 1 -- 172.21.15.7:0/1668268516 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c000cc90 con 0x7f20cc160370 2024-04-25T09:58:33.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.232+0000 7f20d293b640 1 -- 172.21.15.7:0/1668268516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20cc0cc630 con 0x7f20cc160370 2024-04-25T09:58:33.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.232+0000 7f20d293b640 1 -- 172.21.15.7:0/1668268516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20cc0ccbf0 con 0x7f20cc160370 2024-04-25T09:58:33.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.233+0000 7f20d293b640 1 -- 172.21.15.7:0/1668268516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20cc068fd0 con 0x7f20cc160370 2024-04-25T09:58:33.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.233+0000 7f20c8ff9640 1 -- 172.21.15.7:0/1668268516 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f20c001d460 con 0x7f20cc160370 2024-04-25T09:58:33.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.234+0000 7f20c8ff9640 1 --2- 172.21.15.7:0/1668268516 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f20b806b500 0x7f20b806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:33.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.234+0000 7f20c8ff9640 1 -- 172.21.15.7:0/1668268516 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f20c008a340 con 0x7f20cc160370 2024-04-25T09:58:33.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.234+0000 7f20cbfff640 1 --2- 172.21.15.7:0/1668268516 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f20b806b500 0x7f20b806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:33.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.234+0000 7f20cbfff640 1 --2- 172.21.15.7:0/1668268516 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f20b806b500 0x7f20b806d9c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f20bc001730 tx=0x7f20bc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:33.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.238+0000 7f20c8ff9640 1 -- 172.21.15.7:0/1668268516 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f20c0058fc0 con 0x7f20cc160370 2024-04-25T09:58:33.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.457+0000 7f20d293b640 1 -- 172.21.15.7:0/1668268516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20cc0d16b0 con 0x7f20cc160370 2024-04-25T09:58:33.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.457+0000 7f20c8ff9640 1 -- 172.21.15.7:0/1668268516 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4934 (secure 0 0 0) 0x7f20c00588c0 con 0x7f20cc160370 2024-04-25T09:58:33.461 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:58:33.462 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3706118852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3706118852},{"type":"v1","addr":"172.21.15.55:6833","nonce":3706118852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5354,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1513522793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1513522793},{"type":"v1","addr":"172.21.15.55:6835","nonce":1513522793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5782,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1231382839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1231382839},{"type":"v1","addr":"172.21.15.7:6837","nonce":1231382839}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:57:15.098282+0000","modified":"2024-04-25T09:58:03.772256+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":15,"addr":"172.21.15.7:6836/3057688863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3057688863},{"type":"v1","addr":"172.21.15.7:6836","nonce":3057688863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:58:33.462 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 30 2024-04-25T09:58:33.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.459+0000 7f20d293b640 1 -- 172.21.15.7:0/1668268516 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f20b806b500 msgr2=0x7f20b806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:33.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.459+0000 7f20d293b640 1 --2- 172.21.15.7:0/1668268516 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f20b806b500 0x7f20b806d9c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f20bc001730 tx=0x7f20bc009040 comp rx=0 tx=0).stop 2024-04-25T09:58:33.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.459+0000 7f20d293b640 1 -- 172.21.15.7:0/1668268516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20cc160370 msgr2=0x7f20cc0cb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:33.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.459+0000 7f20d293b640 1 --2- 172.21.15.7:0/1668268516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20cc160370 0x7f20cc0cb4a0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f20c000e7c0 tx=0x7f20c000ec80 comp rx=0 tx=0).stop 2024-04-25T09:58:33.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.460+0000 7f20d293b640 1 -- 172.21.15.7:0/1668268516 shutdown_connections 2024-04-25T09:58:33.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.460+0000 7f20d293b640 1 --2- 172.21.15.7:0/1668268516 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f20b806b500 0x7f20b806d9c0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:33.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.460+0000 7f20d293b640 1 --2- 172.21.15.7:0/1668268516 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f20cc1607f0 0x7f20cc0cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:33.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.460+0000 7f20d293b640 1 --2- 172.21.15.7:0/1668268516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20cc160370 0x7f20cc0cb4a0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:33.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.460+0000 7f20d293b640 1 --2- 172.21.15.7:0/1668268516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20b4004d40 0x7f20cc0cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:33.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.460+0000 7f20d293b640 1 -- 172.21.15.7:0/1668268516 >> 172.21.15.7:0/1668268516 conn(0x7f20cc072290 msgr2=0x7f20cc0b7700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:33.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.460+0000 7f20d293b640 1 -- 172.21.15.7:0/1668268516 shutdown_connections 2024-04-25T09:58:33.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.460+0000 7f20d293b640 1 -- 172.21.15.7:0/1668268516 wait complete. 2024-04-25T09:58:33.474 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:58:33.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.571+0000 7fdf21334640 1 Processor -- start 2024-04-25T09:58:33.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.571+0000 7fdf21334640 1 -- start start 2024-04-25T09:58:33.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.572+0000 7fdf21334640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdf1c0d2ca0 0x7fdf1c0d30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:33.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.572+0000 7fdf21334640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf1c15e8a0 con 0x7fdf1c0d0aa0 2024-04-25T09:58:33.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.572+0000 7fdf21334640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf1c15eb80 con 0x7fdf1c15da60 2024-04-25T09:58:33.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.572+0000 7fdf21334640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf1c15ee60 con 0x7fdf1c0d2ca0 2024-04-25T09:58:33.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.572+0000 7fdf13fff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fdf1c0d0aa0 0x7fdf1c161d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45694/0 (socket says 172.21.15.7:45694) 2024-04-25T09:58:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.572+0000 7fdf13fff640 1 -- 172.21.15.7:0/1974607180 learned_addr learned my addr 172.21.15.7:0/1974607180 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.572+0000 7fdf1b7fe640 1 --2- 172.21.15.7:0/1974607180 >> v2:172.21.15.55:3300/0 conn(0x7fdf1c0d2ca0 0x7fdf1c0d30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.572+0000 7fdf1a7fc640 1 -- 172.21.15.7:0/1974607180 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1390400074 0 0) 0x7fdf1c15e8a0 con 0x7fdf1c0d0aa0 2024-04-25T09:58:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.572+0000 7fdf1a7fc640 1 -- 172.21.15.7:0/1974607180 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf08003520 con 0x7fdf1c0d0aa0 2024-04-25T09:58:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.572+0000 7fdf1a7fc640 1 -- 172.21.15.7:0/1974607180 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1989889760 0 0) 0x7fdf08003520 con 0x7fdf1c0d0aa0 2024-04-25T09:58:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.572+0000 7fdf1a7fc640 1 -- 172.21.15.7:0/1974607180 >> v2:172.21.15.55:3300/0 conn(0x7fdf1c0d2ca0 msgr2=0x7fdf1c0d30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.572+0000 7fdf1a7fc640 1 --2- 172.21.15.7:0/1974607180 >> v2:172.21.15.55:3300/0 conn(0x7fdf1c0d2ca0 0x7fdf1c0d30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.572+0000 7fdf1a7fc640 1 -- 172.21.15.7:0/1974607180 >> v1:172.21.15.55:6789/0 conn(0x7fdf1c15da60 legacy=0x7fdf1c15de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.572+0000 7fdf1a7fc640 1 -- 172.21.15.7:0/1974607180 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf1c161850 con 0x7fdf1c0d0aa0 2024-04-25T09:58:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.572+0000 7fdf1a7fc640 1 -- 172.21.15.7:0/1974607180 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fdf04001670 con 0x7fdf1c0d0aa0 2024-04-25T09:58:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.572+0000 7fdf1a7fc640 1 -- 172.21.15.7:0/1974607180 >> v1:172.21.15.7:6789/0 conn(0x7fdf1c0d0aa0 legacy=0x7fdf1c161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.572+0000 7fdf1a7fc640 1 --2- 172.21.15.7:0/1974607180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf080039b0 0x7fdf08003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.572+0000 7fdf1a7fc640 1 --2- 172.21.15.7:0/1974607180 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf08004800 0x7fdf08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.573+0000 7fdf1a7fc640 1 --2- 172.21.15.7:0/1974607180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf080051c0 0x7fdf0800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.573+0000 7fdf1a7fc640 1 -- 172.21.15.7:0/1974607180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c15ee60 con 0x7fdf080051c0 2024-04-25T09:58:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.573+0000 7fdf1a7fc640 1 -- 172.21.15.7:0/1974607180 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0800c160 con 0x7fdf080039b0 2024-04-25T09:58:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.573+0000 7fdf1a7fc640 1 -- 172.21.15.7:0/1974607180 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0800c360 con 0x7fdf08004800 2024-04-25T09:58:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.573+0000 7fdf1b7fe640 1 --2- 172.21.15.7:0/1974607180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf080051c0 0x7fdf0800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.573+0000 7fdf1affd640 1 --2- 172.21.15.7:0/1974607180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf080039b0 0x7fdf08003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.573+0000 7fdf13fff640 1 --2- 172.21.15.7:0/1974607180 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf08004800 0x7fdf08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.573+0000 7fdf1b7fe640 1 -- 172.21.15.7:0/1974607180 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf08004800 msgr2=0x7fdf08004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.573+0000 7fdf1b7fe640 1 --2- 172.21.15.7:0/1974607180 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf08004800 0x7fdf08004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.573+0000 7fdf1b7fe640 1 -- 172.21.15.7:0/1974607180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf080039b0 msgr2=0x7fdf08003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.573+0000 7fdf1b7fe640 1 --2- 172.21.15.7:0/1974607180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf080039b0 0x7fdf08003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.573+0000 7fdf1b7fe640 1 -- 172.21.15.7:0/1974607180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf08003520 con 0x7fdf080051c0 2024-04-25T09:58:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.573+0000 7fdf13fff640 1 --2- 172.21.15.7:0/1974607180 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf08004800 0x7fdf08004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.574+0000 7fdf1b7fe640 1 -- 172.21.15.7:0/1974607180 reap_dead start 2024-04-25T09:58:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.574+0000 7fdf1b7fe640 1 --2- 172.21.15.7:0/1974607180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf080051c0 0x7fdf0800b9c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fdf14009fc0 tx=0x7fdf08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=524046512a912161 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.574+0000 7fdf1a7fc640 1 -- 172.21.15.7:0/1974607180 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf14035020 con 0x7fdf080051c0 2024-04-25T09:58:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.574+0000 7fdf1a7fc640 1 -- 172.21.15.7:0/1974607180 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf14003bd0 con 0x7fdf080051c0 2024-04-25T09:58:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.574+0000 7fdf1a7fc640 1 -- 172.21.15.7:0/1974607180 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf14009c10 con 0x7fdf080051c0 2024-04-25T09:58:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.574+0000 7fdf21334640 1 -- 172.21.15.7:0/1974607180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf080051c0 msgr2=0x7fdf0800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.574+0000 7fdf21334640 1 --2- 172.21.15.7:0/1974607180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf080051c0 0x7fdf0800b9c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fdf14009fc0 tx=0x7fdf08005830 comp rx=0 tx=0).stop 2024-04-25T09:58:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.574+0000 7fdf21334640 1 -- 172.21.15.7:0/1974607180 shutdown_connections 2024-04-25T09:58:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.574+0000 7fdf21334640 1 --2- 172.21.15.7:0/1974607180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf080051c0 0x7fdf0800b9c0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.574+0000 7fdf21334640 1 -- 172.21.15.7:0/1974607180 >> 172.21.15.7:0/1974607180 conn(0x7fdf1c06bfe0 msgr2=0x7fdf1c06c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.574+0000 7fdf21334640 1 -- 172.21.15.7:0/1974607180 shutdown_connections 2024-04-25T09:58:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.575+0000 7fdf21334640 1 -- 172.21.15.7:0/1974607180 wait complete. 2024-04-25T09:58:33.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.576+0000 7fdf21334640 1 Processor -- start 2024-04-25T09:58:33.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.576+0000 7fdf21334640 1 -- start start 2024-04-25T09:58:33.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.576+0000 7fdf21334640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf080051c0 0x7fdf1c154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:33.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.576+0000 7fdf21334640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf1c0cd150 0x7fdf1c15fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:33.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.576+0000 7fdf21334640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf1c1569f0 0x7fdf1c156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:33.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.576+0000 7fdf21334640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c0d3440 con 0x7fdf1c0cd150 2024-04-25T09:58:33.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.576+0000 7fdf21334640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c0d32c0 con 0x7fdf1c1569f0 2024-04-25T09:58:33.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.576+0000 7fdf21334640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c0d35c0 con 0x7fdf080051c0 2024-04-25T09:58:33.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.576+0000 7fdf13fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf1c0cd150 0x7fdf1c15fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:33.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.577+0000 7fdf13fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf1c0cd150 0x7fdf1c15fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48592/0 (socket says 172.21.15.7:48592) 2024-04-25T09:58:33.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.577+0000 7fdf13fff640 1 -- 172.21.15.7:0/4120793577 learned_addr learned my addr 172.21.15.7:0/4120793577 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:33.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.577+0000 7fdf1affd640 1 --2- 172.21.15.7:0/4120793577 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf080051c0 0x7fdf1c154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:33.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.577+0000 7fdf1b7fe640 1 --2- 172.21.15.7:0/4120793577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf1c1569f0 0x7fdf1c156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:33.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.577+0000 7fdf13fff640 1 -- 172.21.15.7:0/4120793577 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf080051c0 msgr2=0x7fdf1c154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:33.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.577+0000 7fdf13fff640 1 --2- 172.21.15.7:0/4120793577 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf080051c0 0x7fdf1c154d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:33.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.577+0000 7fdf13fff640 1 -- 172.21.15.7:0/4120793577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf1c1569f0 msgr2=0x7fdf1c156e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:33.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.577+0000 7fdf13fff640 1 --2- 172.21.15.7:0/4120793577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf1c1569f0 0x7fdf1c156e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:33.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.577+0000 7fdf13fff640 1 -- 172.21.15.7:0/4120793577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf1c155240 con 0x7fdf1c0cd150 2024-04-25T09:58:33.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.577+0000 7fdf13fff640 1 --2- 172.21.15.7:0/4120793577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf1c0cd150 0x7fdf1c15fbe0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fdf0400e730 tx=0x7fdf0400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:33.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.577+0000 7fdf137fe640 1 -- 172.21.15.7:0/4120793577 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0400c6c0 con 0x7fdf1c0cd150 2024-04-25T09:58:33.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.577+0000 7fdf137fe640 1 -- 172.21.15.7:0/4120793577 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf04018070 con 0x7fdf1c0cd150 2024-04-25T09:58:33.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.577+0000 7fdf137fe640 1 -- 172.21.15.7:0/4120793577 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0400caa0 con 0x7fdf1c0cd150 2024-04-25T09:58:33.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.577+0000 7fdf21334640 1 -- 172.21.15.7:0/4120793577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf1c0cc0b0 con 0x7fdf1c0cd150 2024-04-25T09:58:33.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.577+0000 7fdf21334640 1 -- 172.21.15.7:0/4120793577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf1c0cc670 con 0x7fdf1c0cd150 2024-04-25T09:58:33.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.578+0000 7fdf21334640 1 -- 172.21.15.7:0/4120793577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf1c1573b0 con 0x7fdf1c0cd150 2024-04-25T09:58:33.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.579+0000 7fdf137fe640 1 -- 172.21.15.7:0/4120793577 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdf0401d460 con 0x7fdf1c0cd150 2024-04-25T09:58:33.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.579+0000 7fdf137fe640 1 --2- 172.21.15.7:0/4120793577 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdefc06b4d0 0x7fdefc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:33.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.579+0000 7fdf137fe640 1 -- 172.21.15.7:0/4120793577 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6217+0+0 (secure 0 0 0) 0x7fdf0408a400 con 0x7fdf1c0cd150 2024-04-25T09:58:33.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.579+0000 7fdf1affd640 1 --2- 172.21.15.7:0/4120793577 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdefc06b4d0 0x7fdefc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:33.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.579+0000 7fdf1affd640 1 --2- 172.21.15.7:0/4120793577 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdefc06b4d0 0x7fdefc06d990 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c000c00 tx=0x7fdf0c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:33.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.583+0000 7fdf137fe640 1 -- 172.21.15.7:0/4120793577 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdf04059080 con 0x7fdf1c0cd150 2024-04-25T09:58:33.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.762+0000 7fdf21334640 1 -- 172.21.15.7:0/4120793577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf1c068fd0 con 0x7fdf1c0cd150 2024-04-25T09:58:33.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.764+0000 7fdf137fe640 1 -- 172.21.15.7:0/4120793577 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16980 (secure 0 0 0) 0x7fdf04058980 con 0x7fdf1c0cd150 2024-04-25T09:58:33.768 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:58:33.768 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":64,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:58:10.114788+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:57:13.366946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T09:57:14.076493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.1e","mappings":[{"from":7,"to":2}]},{"pgid":"10.d","mappings":[{"from":4,"to":3}]},{"pgid":"10.2e","mappings":[{"from":4,"to":3}]},{"pgid":"10.3d","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:58:33.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.766+0000 7fdf21334640 1 -- 172.21.15.7:0/4120793577 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdefc06b4d0 msgr2=0x7fdefc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:33.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.766+0000 7fdf21334640 1 --2- 172.21.15.7:0/4120793577 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdefc06b4d0 0x7fdefc06d990 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c000c00 tx=0x7fdf0c009040 comp rx=0 tx=0).stop 2024-04-25T09:58:33.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.766+0000 7fdf21334640 1 -- 172.21.15.7:0/4120793577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf1c0cd150 msgr2=0x7fdf1c15fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:33.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.766+0000 7fdf21334640 1 --2- 172.21.15.7:0/4120793577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf1c0cd150 0x7fdf1c15fbe0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fdf0400e730 tx=0x7fdf0400ebf0 comp rx=0 tx=0).stop 2024-04-25T09:58:33.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.766+0000 7fdf21334640 1 -- 172.21.15.7:0/4120793577 shutdown_connections 2024-04-25T09:58:33.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.766+0000 7fdf21334640 1 --2- 172.21.15.7:0/4120793577 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdefc06b4d0 0x7fdefc06d990 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:33.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.766+0000 7fdf21334640 1 --2- 172.21.15.7:0/4120793577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf1c1569f0 0x7fdf1c156e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:33.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.766+0000 7fdf21334640 1 --2- 172.21.15.7:0/4120793577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf1c0cd150 0x7fdf1c15fbe0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:33.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.766+0000 7fdf21334640 1 --2- 172.21.15.7:0/4120793577 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf080051c0 0x7fdf1c154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:33.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.766+0000 7fdf21334640 1 -- 172.21.15.7:0/4120793577 >> 172.21.15.7:0/4120793577 conn(0x7fdf1c06bfe0 msgr2=0x7fdf1c159340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:33.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.766+0000 7fdf21334640 1 -- 172.21.15.7:0/4120793577 shutdown_connections 2024-04-25T09:58:33.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.766+0000 7fdf21334640 1 -- 172.21.15.7:0/4120793577 wait complete. 2024-04-25T09:58:33.781 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:58:33.781 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:58:33.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.878+0000 7fb8b60b3640 1 Processor -- start 2024-04-25T09:58:33.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.878+0000 7fb8b60b3640 1 -- start start 2024-04-25T09:58:33.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.879+0000 7fb8b60b3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8b015dd00 0x7fb8b00b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:33.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.879+0000 7fb8b60b3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb8b006c6c0 0x7fb8b00b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:33.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.879+0000 7fb8b60b3640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b006cd00 con 0x7fb8b00b6a40 2024-04-25T09:58:33.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.879+0000 7fb8b60b3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b015e0e0 con 0x7fb8b006c6c0 2024-04-25T09:58:33.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.879+0000 7fb8b60b3640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b006cfe0 con 0x7fb8b015dd00 2024-04-25T09:58:33.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.879+0000 7fb8aeffd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb8b00b6a40 0x7fb8b006bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45704/0 (socket says 172.21.15.7:45704) 2024-04-25T09:58:33.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.879+0000 7fb8aeffd640 1 -- 172.21.15.7:0/2229217208 learned_addr learned my addr 172.21.15.7:0/2229217208 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:33.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.879+0000 7fb8affff640 1 --2- 172.21.15.7:0/2229217208 >> v2:172.21.15.55:3300/0 conn(0x7fb8b006c6c0 0x7fb8b00b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:33.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.879+0000 7fb8af7fe640 1 --2- 172.21.15.7:0/2229217208 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8b015dd00 0x7fb8b00b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:33.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.879+0000 7fb8ae7fc640 1 -- 172.21.15.7:0/2229217208 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 72758804 0 0) 0x7fb8b006cd00 con 0x7fb8b00b6a40 2024-04-25T09:58:33.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.879+0000 7fb8ae7fc640 1 -- 172.21.15.7:0/2229217208 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb898003520 con 0x7fb8b00b6a40 2024-04-25T09:58:33.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.880+0000 7fb8affff640 1 -- 172.21.15.7:0/2229217208 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8b015dd00 msgr2=0x7fb8b00b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:33.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.880+0000 7fb8affff640 1 --2- 172.21.15.7:0/2229217208 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8b015dd00 0x7fb8b00b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:33.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.880+0000 7fb8affff640 1 -- 172.21.15.7:0/2229217208 >> v1:172.21.15.7:6789/0 conn(0x7fb8b00b6a40 legacy=0x7fb8b006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:33.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.880+0000 7fb8affff640 1 -- 172.21.15.7:0/2229217208 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b00d1ca0 con 0x7fb8b006c6c0 2024-04-25T09:58:33.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.880+0000 7fb8affff640 1 --2- 172.21.15.7:0/2229217208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8b006c6c0 0x7fb8b00b5c90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009d90 tx=0x7fb8a802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5b94e33ba97ac91 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:33.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.880+0000 7fb8ae7fc640 1 -- 172.21.15.7:0/2229217208 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8007740 con 0x7fb8b006c6c0 2024-04-25T09:58:33.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.880+0000 7fb8ae7fc640 1 -- 172.21.15.7:0/2229217208 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a80078e0 con 0x7fb8b006c6c0 2024-04-25T09:58:33.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.880+0000 7fb8ae7fc640 1 -- 172.21.15.7:0/2229217208 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8007c90 con 0x7fb8b006c6c0 2024-04-25T09:58:33.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.881+0000 7fb8b60b3640 1 -- 172.21.15.7:0/2229217208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8b006c6c0 msgr2=0x7fb8b00b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:33.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.881+0000 7fb8b60b3640 1 --2- 172.21.15.7:0/2229217208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8b006c6c0 0x7fb8b00b5c90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009d90 tx=0x7fb8a802a6f0 comp rx=0 tx=0).stop 2024-04-25T09:58:33.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.881+0000 7fb8b60b3640 1 -- 172.21.15.7:0/2229217208 shutdown_connections 2024-04-25T09:58:33.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.881+0000 7fb8b60b3640 1 --2- 172.21.15.7:0/2229217208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8b006c6c0 0x7fb8b00b5c90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:33.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.881+0000 7fb8b60b3640 1 --2- 172.21.15.7:0/2229217208 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8b015dd00 0x7fb8b00b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:33.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.881+0000 7fb8b60b3640 1 -- 172.21.15.7:0/2229217208 >> 172.21.15.7:0/2229217208 conn(0x7fb8b00d07b0 msgr2=0x7fb8b00d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:33.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.881+0000 7fb8b60b3640 1 -- 172.21.15.7:0/2229217208 shutdown_connections 2024-04-25T09:58:33.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.881+0000 7fb8b60b3640 1 -- 172.21.15.7:0/2229217208 wait complete. 2024-04-25T09:58:33.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.882+0000 7fb8b60b3640 1 Processor -- start 2024-04-25T09:58:33.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.882+0000 7fb8b60b3640 1 -- start start 2024-04-25T09:58:33.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.883+0000 7fb8b60b3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8b006c6c0 0x7fb8b0152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:33.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.883+0000 7fb8b60b3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8b00b6a40 0x7fb8b00cb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:33.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.883+0000 7fb8b60b3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8b015dd00 0x7fb8b0160100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:33.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.883+0000 7fb8b60b3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b00d2780 con 0x7fb8b00b6a40 2024-04-25T09:58:33.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.883+0000 7fb8b60b3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b00d2260 con 0x7fb8b015dd00 2024-04-25T09:58:33.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.883+0000 7fb8b60b3640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b00d2900 con 0x7fb8b006c6c0 2024-04-25T09:58:33.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.883+0000 7fb8aeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8b00b6a40 0x7fb8b00cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:33.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.883+0000 7fb8aeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8b00b6a40 0x7fb8b00cb610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48598/0 (socket says 172.21.15.7:48598) 2024-04-25T09:58:33.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.883+0000 7fb8aeffd640 1 -- 172.21.15.7:0/391575945 learned_addr learned my addr 172.21.15.7:0/391575945 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:33.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.883+0000 7fb8affff640 1 --2- 172.21.15.7:0/391575945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8b015dd00 0x7fb8b0160100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:33.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.883+0000 7fb8af7fe640 1 --2- 172.21.15.7:0/391575945 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8b006c6c0 0x7fb8b0152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:33.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.884+0000 7fb8aeffd640 1 -- 172.21.15.7:0/391575945 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8b006c6c0 msgr2=0x7fb8b0152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:33.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.884+0000 7fb8aeffd640 1 --2- 172.21.15.7:0/391575945 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8b006c6c0 0x7fb8b0152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:33.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.884+0000 7fb8aeffd640 1 -- 172.21.15.7:0/391575945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8b015dd00 msgr2=0x7fb8b0160100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:33.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.884+0000 7fb8aeffd640 1 --2- 172.21.15.7:0/391575945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8b015dd00 0x7fb8b0160100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:33.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.884+0000 7fb8aeffd640 1 -- 172.21.15.7:0/391575945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b01f6ed0 con 0x7fb8b00b6a40 2024-04-25T09:58:33.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.884+0000 7fb8aeffd640 1 --2- 172.21.15.7:0/391575945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8b00b6a40 0x7fb8b00cb610 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fb8a400c430 tx=0x7fb8a400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:33.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.884+0000 7fb897fff640 1 -- 172.21.15.7:0/391575945 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4017070 con 0x7fb8b00b6a40 2024-04-25T09:58:33.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.884+0000 7fb897fff640 1 -- 172.21.15.7:0/391575945 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a4005ce0 con 0x7fb8b00b6a40 2024-04-25T09:58:33.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.884+0000 7fb8b60b3640 1 -- 172.21.15.7:0/391575945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b01f71b0 con 0x7fb8b00b6a40 2024-04-25T09:58:33.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.884+0000 7fb897fff640 1 -- 172.21.15.7:0/391575945 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a40072f0 con 0x7fb8b00b6a40 2024-04-25T09:58:33.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.884+0000 7fb8b60b3640 1 -- 172.21.15.7:0/391575945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b01f7770 con 0x7fb8b00b6a40 2024-04-25T09:58:33.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.885+0000 7fb8b60b3640 1 -- 172.21.15.7:0/391575945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b0068fd0 con 0x7fb8b00b6a40 2024-04-25T09:58:33.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.885+0000 7fb897fff640 1 -- 172.21.15.7:0/391575945 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb8a401a070 con 0x7fb8b00b6a40 2024-04-25T09:58:33.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.886+0000 7fb897fff640 1 --2- 172.21.15.7:0/391575945 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb89c06b4d0 0x7fb89c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:33.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.886+0000 7fb897fff640 1 -- 172.21.15.7:0/391575945 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6217+0+0 (secure 0 0 0) 0x7fb8a4089790 con 0x7fb8b00b6a40 2024-04-25T09:58:33.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.886+0000 7fb8af7fe640 1 --2- 172.21.15.7:0/391575945 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb89c06b4d0 0x7fb89c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:33.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.886+0000 7fb8af7fe640 1 --2- 172.21.15.7:0/391575945 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb89c06b4d0 0x7fb89c06d990 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0009aa0 tx=0x7fb8a0009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:33.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:33.890+0000 7fb897fff640 1 -- 172.21.15.7:0/391575945 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb8a4057e50 con 0x7fb8b00b6a40 2024-04-25T09:58:34.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.110+0000 7fb8b60b3640 1 -- 172.21.15.7:0/391575945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8b00680a0 con 0x7fb8b00b6a40 2024-04-25T09:58:34.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.110+0000 7fb897fff640 1 -- 172.21.15.7:0/391575945 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4934 (secure 0 0 0) 0x7fb8b00680a0 con 0x7fb8b00b6a40 2024-04-25T09:58:34.114 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:58:34.115 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3706118852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3706118852},{"type":"v1","addr":"172.21.15.55:6833","nonce":3706118852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5354,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1513522793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1513522793},{"type":"v1","addr":"172.21.15.55:6835","nonce":1513522793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5782,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1231382839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1231382839},{"type":"v1","addr":"172.21.15.7:6837","nonce":1231382839}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:57:15.098282+0000","modified":"2024-04-25T09:58:03.772256+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":15,"addr":"172.21.15.7:6836/3057688863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3057688863},{"type":"v1","addr":"172.21.15.7:6836","nonce":3057688863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:58:34.115 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 30 2024-04-25T09:58:34.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.112+0000 7fb8b60b3640 1 -- 172.21.15.7:0/391575945 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb89c06b4d0 msgr2=0x7fb89c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:34.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.112+0000 7fb8b60b3640 1 --2- 172.21.15.7:0/391575945 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb89c06b4d0 0x7fb89c06d990 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0009aa0 tx=0x7fb8a0009190 comp rx=0 tx=0).stop 2024-04-25T09:58:34.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.112+0000 7fb8b60b3640 1 -- 172.21.15.7:0/391575945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8b00b6a40 msgr2=0x7fb8b00cb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:34.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.112+0000 7fb8b60b3640 1 --2- 172.21.15.7:0/391575945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8b00b6a40 0x7fb8b00cb610 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fb8a400c430 tx=0x7fb8a400c8f0 comp rx=0 tx=0).stop 2024-04-25T09:58:34.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.112+0000 7fb8b60b3640 1 -- 172.21.15.7:0/391575945 shutdown_connections 2024-04-25T09:58:34.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.112+0000 7fb8b60b3640 1 --2- 172.21.15.7:0/391575945 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb89c06b4d0 0x7fb89c06d990 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:34.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.112+0000 7fb8b60b3640 1 --2- 172.21.15.7:0/391575945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8b015dd00 0x7fb8b0160100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:34.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.112+0000 7fb8b60b3640 1 --2- 172.21.15.7:0/391575945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8b00b6a40 0x7fb8b00cb610 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:34.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.112+0000 7fb8b60b3640 1 --2- 172.21.15.7:0/391575945 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8b006c6c0 0x7fb8b0152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:34.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.112+0000 7fb8b60b3640 1 -- 172.21.15.7:0/391575945 >> 172.21.15.7:0/391575945 conn(0x7fb8b00d07b0 msgr2=0x7fb8b015b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:34.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.112+0000 7fb8b60b3640 1 -- 172.21.15.7:0/391575945 shutdown_connections 2024-04-25T09:58:34.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.112+0000 7fb8b60b3640 1 -- 172.21.15.7:0/391575945 wait complete. 2024-04-25T09:58:34.127 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:58:34.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.224+0000 7fcc376f5640 1 Processor -- start 2024-04-25T09:58:34.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.224+0000 7fcc376f5640 1 -- start start 2024-04-25T09:58:34.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.225+0000 7fcc376f5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcc3015dd00 0x7fcc300b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:34.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.225+0000 7fcc376f5640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcc3006c6c0 0x7fcc300b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:34.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.225+0000 7fcc376f5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc3006cd00 con 0x7fcc300b6a40 2024-04-25T09:58:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.225+0000 7fcc376f5640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc3015e0e0 con 0x7fcc3006c6c0 2024-04-25T09:58:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.225+0000 7fcc376f5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3006cfe0 con 0x7fcc3015dd00 2024-04-25T09:58:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.225+0000 7fcc35c92640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcc3006c6c0 0x7fcc300b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.225+0000 7fcc35c92640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcc3006c6c0 0x7fcc300b5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48614/0 (socket says 172.21.15.7:48614) 2024-04-25T09:58:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.225+0000 7fcc35c92640 1 -- 172.21.15.7:0/1675079862 learned_addr learned my addr 172.21.15.7:0/1675079862 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.225+0000 7fcc35491640 1 --2- 172.21.15.7:0/1675079862 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcc3015dd00 0x7fcc300b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.225+0000 7fcc35c92640 1 -- 172.21.15.7:0/1675079862 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcc3015dd00 msgr2=0x7fcc300b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.225+0000 7fcc35c92640 1 --2- 172.21.15.7:0/1675079862 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcc3015dd00 0x7fcc300b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.225+0000 7fcc35c92640 1 -- 172.21.15.7:0/1675079862 >> v1:172.21.15.55:6789/0 conn(0x7fcc300b6a40 legacy=0x7fcc3006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:34.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.225+0000 7fcc35c92640 1 -- 172.21.15.7:0/1675079862 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc300d1ca0 con 0x7fcc3006c6c0 2024-04-25T09:58:34.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.226+0000 7fcc35c92640 1 --2- 172.21.15.7:0/1675079862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc3006c6c0 0x7fcc300b5c90 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fcc28009e50 tx=0x7fcc2802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=710ba48722906039 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:34.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.226+0000 7fcc27fff640 1 -- 172.21.15.7:0/1675079862 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc28036070 con 0x7fcc3006c6c0 2024-04-25T09:58:34.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.226+0000 7fcc27fff640 1 -- 172.21.15.7:0/1675079862 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc28031600 con 0x7fcc3006c6c0 2024-04-25T09:58:34.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.226+0000 7fcc27fff640 1 -- 172.21.15.7:0/1675079862 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc280319d0 con 0x7fcc3006c6c0 2024-04-25T09:58:34.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.227+0000 7fcc376f5640 1 -- 172.21.15.7:0/1675079862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc3006c6c0 msgr2=0x7fcc300b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:34.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.227+0000 7fcc376f5640 1 --2- 172.21.15.7:0/1675079862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc3006c6c0 0x7fcc300b5c90 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fcc28009e50 tx=0x7fcc2802a7a0 comp rx=0 tx=0).stop 2024-04-25T09:58:34.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.227+0000 7fcc376f5640 1 -- 172.21.15.7:0/1675079862 shutdown_connections 2024-04-25T09:58:34.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.227+0000 7fcc376f5640 1 --2- 172.21.15.7:0/1675079862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc3006c6c0 0x7fcc300b5c90 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:34.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.227+0000 7fcc376f5640 1 --2- 172.21.15.7:0/1675079862 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcc3015dd00 0x7fcc300b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:34.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.227+0000 7fcc376f5640 1 -- 172.21.15.7:0/1675079862 >> 172.21.15.7:0/1675079862 conn(0x7fcc300d07b0 msgr2=0x7fcc300d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:34.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.227+0000 7fcc376f5640 1 -- 172.21.15.7:0/1675079862 shutdown_connections 2024-04-25T09:58:34.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.227+0000 7fcc376f5640 1 -- 172.21.15.7:0/1675079862 wait complete. 2024-04-25T09:58:34.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.228+0000 7fcc376f5640 1 Processor -- start 2024-04-25T09:58:34.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.228+0000 7fcc376f5640 1 -- start start 2024-04-25T09:58:34.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.229+0000 7fcc376f5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc3006c6c0 0x7fcc301f68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:34.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.229+0000 7fcc376f5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcc300b6a40 0x7fcc300ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:34.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.229+0000 7fcc376f5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc3015dd00 0x7fcc300cd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:34.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.229+0000 7fcc376f5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc300d2780 con 0x7fcc3006c6c0 2024-04-25T09:58:34.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.229+0000 7fcc376f5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc300d2260 con 0x7fcc3015dd00 2024-04-25T09:58:34.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.229+0000 7fcc376f5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc300d2900 con 0x7fcc300b6a40 2024-04-25T09:58:34.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.229+0000 7fcc35491640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc3006c6c0 0x7fcc301f68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:34.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.229+0000 7fcc35491640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc3006c6c0 0x7fcc301f68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48620/0 (socket says 172.21.15.7:48620) 2024-04-25T09:58:34.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.229+0000 7fcc35491640 1 -- 172.21.15.7:0/1158963733 learned_addr learned my addr 172.21.15.7:0/1158963733 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:34.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.229+0000 7fcc35c92640 1 --2- 172.21.15.7:0/1158963733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc3015dd00 0x7fcc300cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:34.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.229+0000 7fcc34c90640 1 --2- 172.21.15.7:0/1158963733 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcc300b6a40 0x7fcc300ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:34.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.229+0000 7fcc35491640 1 -- 172.21.15.7:0/1158963733 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcc300b6a40 msgr2=0x7fcc300ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:34.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.229+0000 7fcc35491640 1 --2- 172.21.15.7:0/1158963733 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcc300b6a40 0x7fcc300ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:34.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.229+0000 7fcc35491640 1 -- 172.21.15.7:0/1158963733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc3015dd00 msgr2=0x7fcc300cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:34.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.229+0000 7fcc35491640 1 --2- 172.21.15.7:0/1158963733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc3015dd00 0x7fcc300cd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:34.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.229+0000 7fcc35491640 1 -- 172.21.15.7:0/1158963733 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc301f6de0 con 0x7fcc3006c6c0 2024-04-25T09:58:34.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.229+0000 7fcc35c92640 1 --2- 172.21.15.7:0/1158963733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc3015dd00 0x7fcc300cd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:34.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.229+0000 7fcc35491640 1 --2- 172.21.15.7:0/1158963733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc3006c6c0 0x7fcc301f68a0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c00d620 tx=0x7fcc2c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:34.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.230+0000 7fcc25ffb640 1 -- 172.21.15.7:0/1158963733 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c00b620 con 0x7fcc3006c6c0 2024-04-25T09:58:34.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.230+0000 7fcc25ffb640 1 -- 172.21.15.7:0/1158963733 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2c019070 con 0x7fcc3006c6c0 2024-04-25T09:58:34.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.230+0000 7fcc25ffb640 1 -- 172.21.15.7:0/1158963733 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c00ba00 con 0x7fcc3006c6c0 2024-04-25T09:58:34.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.230+0000 7fcc376f5640 1 -- 172.21.15.7:0/1158963733 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc3015ec70 con 0x7fcc3006c6c0 2024-04-25T09:58:34.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.230+0000 7fcc376f5640 1 -- 172.21.15.7:0/1158963733 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc3015f230 con 0x7fcc3006c6c0 2024-04-25T09:58:34.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.231+0000 7fcc376f5640 1 -- 172.21.15.7:0/1158963733 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc30068fd0 con 0x7fcc3006c6c0 2024-04-25T09:58:34.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.231+0000 7fcc25ffb640 1 -- 172.21.15.7:0/1158963733 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcc2c00bba0 con 0x7fcc3006c6c0 2024-04-25T09:58:34.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.231+0000 7fcc25ffb640 1 --2- 172.21.15.7:0/1158963733 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcc1406b4d0 0x7fcc1406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:34.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.232+0000 7fcc25ffb640 1 -- 172.21.15.7:0/1158963733 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6217+0+0 (secure 0 0 0) 0x7fcc2c08a840 con 0x7fcc3006c6c0 2024-04-25T09:58:34.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.232+0000 7fcc34c90640 1 --2- 172.21.15.7:0/1158963733 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcc1406b4d0 0x7fcc1406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:34.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.232+0000 7fcc34c90640 1 --2- 172.21.15.7:0/1158963733 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcc1406b4d0 0x7fcc1406d990 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcc3015b180 tx=0x7fcc20009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:34.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.236+0000 7fcc25ffb640 1 -- 172.21.15.7:0/1158963733 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcc301f6de0 con 0x7fcc3006c6c0 2024-04-25T09:58:34.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.451+0000 7fcc376f5640 1 -- 172.21.15.7:0/1158963733 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc300d1620 con 0x7fcc3006c6c0 2024-04-25T09:58:34.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.452+0000 7fcc25ffb640 1 -- 172.21.15.7:0/1158963733 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4934 (secure 0 0 0) 0x7fcc2c0594c0 con 0x7fcc3006c6c0 2024-04-25T09:58:34.456 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:58:34.456 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3706118852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3706118852},{"type":"v1","addr":"172.21.15.55:6833","nonce":3706118852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5354,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1513522793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1513522793},{"type":"v1","addr":"172.21.15.55:6835","nonce":1513522793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5782,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1231382839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1231382839},{"type":"v1","addr":"172.21.15.7:6837","nonce":1231382839}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:57:15.098282+0000","modified":"2024-04-25T09:58:03.772256+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6285":{"gid":6285,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":15,"addr":"172.21.15.7:6836/3057688863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3057688863},{"type":"v1","addr":"172.21.15.7:6836","nonce":3057688863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:58:34.456 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 30 2024-04-25T09:58:34.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.454+0000 7fcc376f5640 1 -- 172.21.15.7:0/1158963733 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcc1406b4d0 msgr2=0x7fcc1406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:34.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.454+0000 7fcc376f5640 1 --2- 172.21.15.7:0/1158963733 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcc1406b4d0 0x7fcc1406d990 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcc3015b180 tx=0x7fcc20009040 comp rx=0 tx=0).stop 2024-04-25T09:58:34.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.454+0000 7fcc376f5640 1 -- 172.21.15.7:0/1158963733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc3006c6c0 msgr2=0x7fcc301f68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:34.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.454+0000 7fcc376f5640 1 --2- 172.21.15.7:0/1158963733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc3006c6c0 0x7fcc301f68a0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c00d620 tx=0x7fcc2c00dae0 comp rx=0 tx=0).stop 2024-04-25T09:58:34.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.454+0000 7fcc376f5640 1 -- 172.21.15.7:0/1158963733 shutdown_connections 2024-04-25T09:58:34.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.454+0000 7fcc376f5640 1 --2- 172.21.15.7:0/1158963733 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcc1406b4d0 0x7fcc1406d990 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:34.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.454+0000 7fcc376f5640 1 --2- 172.21.15.7:0/1158963733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc3015dd00 0x7fcc300cd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:34.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.454+0000 7fcc376f5640 1 --2- 172.21.15.7:0/1158963733 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcc300b6a40 0x7fcc300ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:34.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.454+0000 7fcc376f5640 1 --2- 172.21.15.7:0/1158963733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc3006c6c0 0x7fcc301f68a0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:34.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.454+0000 7fcc376f5640 1 -- 172.21.15.7:0/1158963733 >> 172.21.15.7:0/1158963733 conn(0x7fcc300d07b0 msgr2=0x7fcc300b56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:34.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.454+0000 7fcc376f5640 1 -- 172.21.15.7:0/1158963733 shutdown_connections 2024-04-25T09:58:34.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.454+0000 7fcc376f5640 1 -- 172.21.15.7:0/1158963733 wait complete. 2024-04-25T09:58:34.468 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:58:34.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.566+0000 7f114656a640 1 Processor -- start 2024-04-25T09:58:34.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.566+0000 7f114656a640 1 -- start start 2024-04-25T09:58:34.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.567+0000 7f114656a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f114015dd00 0x7f11400b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:34.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.567+0000 7f114656a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f114006c6c0 0x7f11400b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:34.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.567+0000 7f114656a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f114006cd00 con 0x7f11400b6a40 2024-04-25T09:58:34.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.567+0000 7f114656a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f114015e0e0 con 0x7f114006c6c0 2024-04-25T09:58:34.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.567+0000 7f114656a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114006cfe0 con 0x7f114015dd00 2024-04-25T09:58:34.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.567+0000 7f113f7fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f11400b6a40 0x7f114006bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45710/0 (socket says 172.21.15.7:45710) 2024-04-25T09:58:34.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.567+0000 7f113f7fe640 1 -- 172.21.15.7:0/281139492 learned_addr learned my addr 172.21.15.7:0/281139492 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:34.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.567+0000 7f1144b07640 1 --2- 172.21.15.7:0/281139492 >> v2:172.21.15.55:3300/0 conn(0x7f114006c6c0 0x7f11400b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:34.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.567+0000 7f113effd640 1 -- 172.21.15.7:0/281139492 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3752192349 0 0) 0x7f114006cd00 con 0x7f11400b6a40 2024-04-25T09:58:34.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.567+0000 7f113ffff640 1 --2- 172.21.15.7:0/281139492 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f114015dd00 0x7f11400b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:34.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.567+0000 7f113effd640 1 -- 172.21.15.7:0/281139492 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f112c003520 con 0x7f11400b6a40 2024-04-25T09:58:34.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.567+0000 7f113effd640 1 -- 172.21.15.7:0/281139492 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2823999257 0 0) 0x7f112c003520 con 0x7f11400b6a40 2024-04-25T09:58:34.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.567+0000 7f113effd640 1 -- 172.21.15.7:0/281139492 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f114015dd00 msgr2=0x7f11400b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:34.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.567+0000 7f113effd640 1 --2- 172.21.15.7:0/281139492 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f114015dd00 0x7f11400b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:34.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.567+0000 7f113effd640 1 -- 172.21.15.7:0/281139492 >> v2:172.21.15.55:3300/0 conn(0x7f114006c6c0 msgr2=0x7f11400b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:34.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.567+0000 7f113effd640 1 --2- 172.21.15.7:0/281139492 >> v2:172.21.15.55:3300/0 conn(0x7f114006c6c0 0x7f11400b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:34.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.568+0000 7f113effd640 1 -- 172.21.15.7:0/281139492 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11400d1ca0 con 0x7f11400b6a40 2024-04-25T09:58:34.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.568+0000 7f113effd640 1 -- 172.21.15.7:0/281139492 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f1128001670 con 0x7f11400b6a40 2024-04-25T09:58:34.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.568+0000 7f113effd640 1 -- 172.21.15.7:0/281139492 >> v1:172.21.15.7:6789/0 conn(0x7f11400b6a40 legacy=0x7f114006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:34.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.568+0000 7f113effd640 1 --2- 172.21.15.7:0/281139492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f112c0039b0 0x7f112c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:34.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.568+0000 7f113effd640 1 --2- 172.21.15.7:0/281139492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f112c004800 0x7f112c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:34.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.568+0000 7f113effd640 1 --2- 172.21.15.7:0/281139492 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f114015dd00 0x7f112c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:34.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.568+0000 7f113effd640 1 -- 172.21.15.7:0/281139492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114015e0e0 con 0x7f112c004800 2024-04-25T09:58:34.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.568+0000 7f113effd640 1 -- 172.21.15.7:0/281139492 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114006cfe0 con 0x7f112c0039b0 2024-04-25T09:58:34.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.568+0000 7f113effd640 1 -- 172.21.15.7:0/281139492 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112c00b9c0 con 0x7f114015dd00 2024-04-25T09:58:34.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.568+0000 7f113f7fe640 1 --2- 172.21.15.7:0/281139492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f112c004800 0x7f112c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:34.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.568+0000 7f113ffff640 1 --2- 172.21.15.7:0/281139492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f112c0039b0 0x7f112c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:34.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.568+0000 7f1144b07640 1 --2- 172.21.15.7:0/281139492 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f114015dd00 0x7f112c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:34.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.568+0000 7f113f7fe640 1 -- 172.21.15.7:0/281139492 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f114015dd00 msgr2=0x7f112c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:34.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.568+0000 7f113f7fe640 1 --2- 172.21.15.7:0/281139492 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f114015dd00 0x7f112c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:34.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.568+0000 7f113f7fe640 1 -- 172.21.15.7:0/281139492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f112c0039b0 msgr2=0x7f112c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:34.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.568+0000 7f113f7fe640 1 --2- 172.21.15.7:0/281139492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f112c0039b0 0x7f112c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:34.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.568+0000 7f113f7fe640 1 -- 172.21.15.7:0/281139492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112c003520 con 0x7f112c004800 2024-04-25T09:58:34.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.569+0000 7f113f7fe640 1 --2- 172.21.15.7:0/281139492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f112c004800 0x7f112c004c80 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f112800c240 tx=0x7f112c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce943f799359af0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:34.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.569+0000 7f113effd640 1 -- 172.21.15.7:0/281139492 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1128007d60 con 0x7f112c004800 2024-04-25T09:58:34.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.569+0000 7f113effd640 1 -- 172.21.15.7:0/281139492 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1128005ad0 con 0x7f112c004800 2024-04-25T09:58:34.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.569+0000 7f113effd640 1 -- 172.21.15.7:0/281139492 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1128007070 con 0x7f112c004800 2024-04-25T09:58:34.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.569+0000 7f114656a640 1 -- 172.21.15.7:0/281139492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f112c004800 msgr2=0x7f112c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:34.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.569+0000 7f114656a640 1 --2- 172.21.15.7:0/281139492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f112c004800 0x7f112c004c80 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f112800c240 tx=0x7f112c005830 comp rx=0 tx=0).stop 2024-04-25T09:58:34.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.570+0000 7f1144b07640 1 -- 172.21.15.7:0/281139492 reap_dead start 2024-04-25T09:58:34.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.570+0000 7f114656a640 1 -- 172.21.15.7:0/281139492 shutdown_connections 2024-04-25T09:58:34.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.570+0000 7f114656a640 1 -- 172.21.15.7:0/281139492 >> 172.21.15.7:0/281139492 conn(0x7f11400d07b0 msgr2=0x7f11400d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:34.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.570+0000 7f114656a640 1 -- 172.21.15.7:0/281139492 shutdown_connections 2024-04-25T09:58:34.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.570+0000 7f114656a640 1 -- 172.21.15.7:0/281139492 wait complete. 2024-04-25T09:58:34.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.571+0000 7f114656a640 1 Processor -- start 2024-04-25T09:58:34.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.571+0000 7f114656a640 1 -- start start 2024-04-25T09:58:34.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.572+0000 7f114656a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f112c004800 0x7f11400ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:34.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.572+0000 7f114656a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f11400cd100 0x7f114015c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:34.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.572+0000 7f114656a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f114015cd00 0x7f114015b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:34.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.572+0000 7f114656a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11400b5750 con 0x7f112c004800 2024-04-25T09:58:34.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.572+0000 7f114656a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11400d2260 con 0x7f114015cd00 2024-04-25T09:58:34.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.572+0000 7f114656a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11400b58d0 con 0x7f11400cd100 2024-04-25T09:58:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.572+0000 7f113ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f112c004800 0x7f11400ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.572+0000 7f113ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f112c004800 0x7f11400ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48630/0 (socket says 172.21.15.7:48630) 2024-04-25T09:58:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.572+0000 7f113ffff640 1 -- 172.21.15.7:0/4182296158 learned_addr learned my addr 172.21.15.7:0/4182296158 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.572+0000 7f1144b07640 1 --2- 172.21.15.7:0/4182296158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f114015cd00 0x7f114015b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.572+0000 7f113f7fe640 1 --2- 172.21.15.7:0/4182296158 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f11400cd100 0x7f114015c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.572+0000 7f113ffff640 1 -- 172.21.15.7:0/4182296158 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f11400cd100 msgr2=0x7f114015c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.572+0000 7f113ffff640 1 --2- 172.21.15.7:0/4182296158 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f11400cd100 0x7f114015c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.572+0000 7f113ffff640 1 -- 172.21.15.7:0/4182296158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f114015cd00 msgr2=0x7f114015b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.572+0000 7f113ffff640 1 --2- 172.21.15.7:0/4182296158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f114015cd00 0x7f114015b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.572+0000 7f113ffff640 1 -- 172.21.15.7:0/4182296158 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11400cbb60 con 0x7f112c004800 2024-04-25T09:58:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.572+0000 7f113ffff640 1 --2- 172.21.15.7:0/4182296158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f112c004800 0x7f11400ccbc0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f11300118e0 tx=0x7f1130011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.572+0000 7f113cff9640 1 -- 172.21.15.7:0/4182296158 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113000fa90 con 0x7f112c004800 2024-04-25T09:58:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.572+0000 7f113cff9640 1 -- 172.21.15.7:0/4182296158 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113000fc30 con 0x7f112c004800 2024-04-25T09:58:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.572+0000 7f113cff9640 1 -- 172.21.15.7:0/4182296158 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130014440 con 0x7f112c004800 2024-04-25T09:58:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.572+0000 7f114656a640 1 -- 172.21.15.7:0/4182296158 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11400cbe00 con 0x7f112c004800 2024-04-25T09:58:34.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.573+0000 7f114656a640 1 -- 172.21.15.7:0/4182296158 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11400cc3c0 con 0x7f112c004800 2024-04-25T09:58:34.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.573+0000 7f114656a640 1 -- 172.21.15.7:0/4182296158 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1140068fd0 con 0x7f112c004800 2024-04-25T09:58:34.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.574+0000 7f113cff9640 1 -- 172.21.15.7:0/4182296158 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1130012040 con 0x7f112c004800 2024-04-25T09:58:34.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.574+0000 7f113cff9640 1 --2- 172.21.15.7:0/4182296158 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f112006b500 0x7f112006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:34.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.574+0000 7f113cff9640 1 -- 172.21.15.7:0/4182296158 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f113008a9b0 con 0x7f112c004800 2024-04-25T09:58:34.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.574+0000 7f113f7fe640 1 --2- 172.21.15.7:0/4182296158 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f112006b500 0x7f112006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:34.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.575+0000 7f113f7fe640 1 --2- 172.21.15.7:0/4182296158 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f112006b500 0x7f112006d9c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1128033000 tx=0x7f112802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:34.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.578+0000 7f113cff9640 1 -- 172.21.15.7:0/4182296158 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1130019030 con 0x7f112c004800 2024-04-25T09:58:34.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.760+0000 7f114656a640 1 -- 172.21.15.7:0/4182296158 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f114015d0e0 con 0x7f112c004800 2024-04-25T09:58:34.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.761+0000 7f113cff9640 1 -- 172.21.15.7:0/4182296158 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16980 (secure 0 0 0) 0x7f1130059620 con 0x7f112c004800 2024-04-25T09:58:34.765 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:58:34.765 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":64,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:58:10.114788+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:57:13.366946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T09:57:14.076493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.1e","mappings":[{"from":7,"to":2}]},{"pgid":"10.d","mappings":[{"from":4,"to":3}]},{"pgid":"10.2e","mappings":[{"from":4,"to":3}]},{"pgid":"10.3d","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:58:34.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.763+0000 7f114656a640 1 -- 172.21.15.7:0/4182296158 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f112006b500 msgr2=0x7f112006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:34.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.763+0000 7f114656a640 1 --2- 172.21.15.7:0/4182296158 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f112006b500 0x7f112006d9c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1128033000 tx=0x7f112802e000 comp rx=0 tx=0).stop 2024-04-25T09:58:34.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.763+0000 7f114656a640 1 -- 172.21.15.7:0/4182296158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f112c004800 msgr2=0x7f11400ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:34.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.763+0000 7f114656a640 1 --2- 172.21.15.7:0/4182296158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f112c004800 0x7f11400ccbc0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f11300118e0 tx=0x7f1130011da0 comp rx=0 tx=0).stop 2024-04-25T09:58:34.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.763+0000 7f114656a640 1 -- 172.21.15.7:0/4182296158 shutdown_connections 2024-04-25T09:58:34.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.763+0000 7f114656a640 1 --2- 172.21.15.7:0/4182296158 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f112006b500 0x7f112006d9c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:34.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.763+0000 7f114656a640 1 --2- 172.21.15.7:0/4182296158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f114015cd00 0x7f114015b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:34.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.763+0000 7f114656a640 1 --2- 172.21.15.7:0/4182296158 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f11400cd100 0x7f114015c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:34.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.763+0000 7f114656a640 1 --2- 172.21.15.7:0/4182296158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f112c004800 0x7f11400ccbc0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:34.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.763+0000 7f114656a640 1 -- 172.21.15.7:0/4182296158 >> 172.21.15.7:0/4182296158 conn(0x7f11400d07b0 msgr2=0x7f11400b7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:34.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.763+0000 7f114656a640 1 -- 172.21.15.7:0/4182296158 shutdown_connections 2024-04-25T09:58:34.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.763+0000 7f114656a640 1 -- 172.21.15.7:0/4182296158 wait complete. 2024-04-25T09:58:34.778 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:58:34.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.875+0000 7fc3effe0640 1 Processor -- start 2024-04-25T09:58:34.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.876+0000 7fc3effe0640 1 -- start start 2024-04-25T09:58:34.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.876+0000 7fc3effe0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc3e815da60 0x7fc3e80d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:34.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.876+0000 7fc3effe0640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3e815e8a0 con 0x7fc3e815de40 2024-04-25T09:58:34.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.876+0000 7fc3effe0640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3e815eb80 con 0x7fc3e815e2d0 2024-04-25T09:58:34.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.876+0000 7fc3effe0640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e815ee60 con 0x7fc3e815da60 2024-04-25T09:58:34.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.877+0000 7fc3ed57b640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc3e815de40 0x7fc3e8161d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45726/0 (socket says 172.21.15.7:45726) 2024-04-25T09:58:34.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.877+0000 7fc3ed57b640 1 -- 172.21.15.7:0/2315146032 learned_addr learned my addr 172.21.15.7:0/2315146032 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:34.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.877+0000 7fc3edd7c640 1 --2- 172.21.15.7:0/2315146032 >> v2:172.21.15.55:3300/0 conn(0x7fc3e815da60 0x7fc3e80d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:34.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.877+0000 7fc3ecd7a640 1 -- 172.21.15.7:0/2315146032 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804057752 0 0) 0x7fc3e815e8a0 con 0x7fc3e815de40 2024-04-25T09:58:34.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.877+0000 7fc3ecd7a640 1 -- 172.21.15.7:0/2315146032 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3d4003520 con 0x7fc3e815de40 2024-04-25T09:58:34.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.877+0000 7fc3edd7c640 1 -- 172.21.15.7:0/2315146032 >> v1:172.21.15.55:6789/0 conn(0x7fc3e815e2d0 legacy=0x7fc3e80ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:34.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.877+0000 7fc3ecd7a640 1 -- 172.21.15.7:0/2315146032 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1843618476 0 0) 0x7fc3d4003520 con 0x7fc3e815de40 2024-04-25T09:58:34.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.877+0000 7fc3edd7c640 1 -- 172.21.15.7:0/2315146032 >> v1:172.21.15.7:6789/0 conn(0x7fc3e815de40 legacy=0x7fc3e8161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:34.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.877+0000 7fc3edd7c640 1 -- 172.21.15.7:0/2315146032 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e8161850 con 0x7fc3e815da60 2024-04-25T09:58:34.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.878+0000 7fc3edd7c640 1 --2- 172.21.15.7:0/2315146032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3e815da60 0x7fc3e80d0aa0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40097a0 tx=0x7fc3e402a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e9aefae61715e0d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:34.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.878+0000 7fc3ecd7a640 1 -- 172.21.15.7:0/2315146032 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e4037070 con 0x7fc3e815da60 2024-04-25T09:58:34.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.878+0000 7fc3ecd7a640 1 -- 172.21.15.7:0/2315146032 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e402abc0 con 0x7fc3e815da60 2024-04-25T09:58:34.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.878+0000 7fc3ecd7a640 1 -- 172.21.15.7:0/2315146032 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8001670 con 0x7fc3e815da60 2024-04-25T09:58:34.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.879+0000 7fc3effe0640 1 -- 172.21.15.7:0/2315146032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3e815da60 msgr2=0x7fc3e80d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:34.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.879+0000 7fc3effe0640 1 --2- 172.21.15.7:0/2315146032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3e815da60 0x7fc3e80d0aa0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40097a0 tx=0x7fc3e402a130 comp rx=0 tx=0).stop 2024-04-25T09:58:34.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.879+0000 7fc3effe0640 1 -- 172.21.15.7:0/2315146032 shutdown_connections 2024-04-25T09:58:34.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.879+0000 7fc3effe0640 1 --2- 172.21.15.7:0/2315146032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3e815da60 0x7fc3e80d0aa0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:34.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.879+0000 7fc3effe0640 1 -- 172.21.15.7:0/2315146032 >> 172.21.15.7:0/2315146032 conn(0x7fc3e806bfe0 msgr2=0x7fc3e806c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:34.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.879+0000 7fc3effe0640 1 -- 172.21.15.7:0/2315146032 shutdown_connections 2024-04-25T09:58:34.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.879+0000 7fc3effe0640 1 -- 172.21.15.7:0/2315146032 wait complete. 2024-04-25T09:58:34.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.880+0000 7fc3effe0640 1 Processor -- start 2024-04-25T09:58:34.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.880+0000 7fc3effe0640 1 -- start start 2024-04-25T09:58:34.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.881+0000 7fc3effe0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3e815da60 0x7fc3e814c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:34.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.881+0000 7fc3effe0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3e815de40 0x7fc3e80cde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:34.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.881+0000 7fc3effe0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3e815e2d0 0x7fc3e80c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:34.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.881+0000 7fc3effe0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e80cedb0 con 0x7fc3e815de40 2024-04-25T09:58:34.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.881+0000 7fc3effe0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e80cec30 con 0x7fc3e815da60 2024-04-25T09:58:34.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.881+0000 7fc3effe0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e80d2ca0 con 0x7fc3e815e2d0 2024-04-25T09:58:34.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.881+0000 7fc3ed57b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3e815de40 0x7fc3e80cde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:34.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.881+0000 7fc3ed57b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3e815de40 0x7fc3e80cde40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48638/0 (socket says 172.21.15.7:48638) 2024-04-25T09:58:34.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.881+0000 7fc3ed57b640 1 -- 172.21.15.7:0/747812977 learned_addr learned my addr 172.21.15.7:0/747812977 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:34.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.881+0000 7fc3edd7c640 1 --2- 172.21.15.7:0/747812977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3e815da60 0x7fc3e814c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:34.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.881+0000 7fc3ed57b640 1 -- 172.21.15.7:0/747812977 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3e815e2d0 msgr2=0x7fc3e80c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:34.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.881+0000 7fc3ed57b640 1 --2- 172.21.15.7:0/747812977 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3e815e2d0 0x7fc3e80c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:34.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.881+0000 7fc3ed57b640 1 -- 172.21.15.7:0/747812977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3e815da60 msgr2=0x7fc3e814c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:34.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.881+0000 7fc3ed57b640 1 --2- 172.21.15.7:0/747812977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3e815da60 0x7fc3e814c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:34.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.881+0000 7fc3ed57b640 1 -- 172.21.15.7:0/747812977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e814cdd0 con 0x7fc3e815de40 2024-04-25T09:58:34.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.881+0000 7fc3ed57b640 1 --2- 172.21.15.7:0/747812977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3e815de40 0x7fc3e80cde40 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800c750 tx=0x7fc3d800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:34.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.881+0000 7fc3de7fc640 1 -- 172.21.15.7:0/747812977 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8017070 con 0x7fc3e815de40 2024-04-25T09:58:34.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.881+0000 7fc3de7fc640 1 -- 172.21.15.7:0/747812977 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d8005ad0 con 0x7fc3e815de40 2024-04-25T09:58:34.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.881+0000 7fc3effe0640 1 -- 172.21.15.7:0/747812977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e80aa720 con 0x7fc3e815de40 2024-04-25T09:58:34.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.881+0000 7fc3de7fc640 1 -- 172.21.15.7:0/747812977 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8007070 con 0x7fc3e815de40 2024-04-25T09:58:34.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.882+0000 7fc3effe0640 1 -- 172.21.15.7:0/747812977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e80b3720 con 0x7fc3e815de40 2024-04-25T09:58:34.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.882+0000 7fc3effe0640 1 -- 172.21.15.7:0/747812977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3e8068fd0 con 0x7fc3e815de40 2024-04-25T09:58:34.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.883+0000 7fc3de7fc640 1 -- 172.21.15.7:0/747812977 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc3d801a070 con 0x7fc3e815de40 2024-04-25T09:58:34.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.883+0000 7fc3de7fc640 1 --2- 172.21.15.7:0/747812977 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc3cc06b4d0 0x7fc3cc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:34.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.883+0000 7fc3de7fc640 1 -- 172.21.15.7:0/747812977 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6217+0+0 (secure 0 0 0) 0x7fc3d8089960 con 0x7fc3e815de40 2024-04-25T09:58:34.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.883+0000 7fc3edd7c640 1 --2- 172.21.15.7:0/747812977 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc3cc06b4d0 0x7fc3cc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:34.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.884+0000 7fc3edd7c640 1 --2- 172.21.15.7:0/747812977 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc3cc06b4d0 0x7fc3cc06d990 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4034000 tx=0x7fc3e402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:34.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:34.888+0000 7fc3de7fc640 1 -- 172.21.15.7:0/747812977 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc3d80585e0 con 0x7fc3e815de40 2024-04-25T09:58:35.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.104+0000 7fc3effe0640 1 -- 172.21.15.7:0/747812977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc3e80d1560 con 0x7fc3e815de40 2024-04-25T09:58:35.108 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-04-25T09:58:35.104+0000 7f45ad572640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:58:35.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.106+0000 7fc3de7fc640 1 -- 172.21.15.7:0/747812977 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc3d8057ee0 con 0x7fc3e815de40 2024-04-25T09:58:35.110 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:58:35.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.109+0000 7fc3effe0640 1 -- 172.21.15.7:0/747812977 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc3cc06b4d0 msgr2=0x7fc3cc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:35.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.109+0000 7fc3effe0640 1 --2- 172.21.15.7:0/747812977 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc3cc06b4d0 0x7fc3cc06d990 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4034000 tx=0x7fc3e402e000 comp rx=0 tx=0).stop 2024-04-25T09:58:35.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.109+0000 7fc3effe0640 1 -- 172.21.15.7:0/747812977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3e815de40 msgr2=0x7fc3e80cde40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:35.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.109+0000 7fc3effe0640 1 --2- 172.21.15.7:0/747812977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3e815de40 0x7fc3e80cde40 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800c750 tx=0x7fc3d800cc10 comp rx=0 tx=0).stop 2024-04-25T09:58:35.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.109+0000 7fc3effe0640 1 -- 172.21.15.7:0/747812977 shutdown_connections 2024-04-25T09:58:35.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.109+0000 7fc3effe0640 1 --2- 172.21.15.7:0/747812977 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc3cc06b4d0 0x7fc3cc06d990 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:35.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.109+0000 7fc3effe0640 1 --2- 172.21.15.7:0/747812977 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3e815e2d0 0x7fc3e80c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:35.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.109+0000 7fc3effe0640 1 --2- 172.21.15.7:0/747812977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3e815de40 0x7fc3e80cde40 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:35.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.109+0000 7fc3effe0640 1 --2- 172.21.15.7:0/747812977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3e815da60 0x7fc3e814c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:35.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.109+0000 7fc3effe0640 1 -- 172.21.15.7:0/747812977 >> 172.21.15.7:0/747812977 conn(0x7fc3e806bfe0 msgr2=0x7fc3e8161100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:35.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.109+0000 7fc3effe0640 1 -- 172.21.15.7:0/747812977 shutdown_connections 2024-04-25T09:58:35.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.109+0000 7fc3effe0640 1 -- 172.21.15.7:0/747812977 wait complete. 2024-04-25T09:58:35.118 INFO:tasks.ceph.mds.a.smithi007.stderr: -7504> 2024-04-25T09:57:21.710+0000 7f7c2300e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:58:35.122 INFO:tasks.ceph.mds.a.smithi007.stderr: -4830> 2024-04-25T09:57:27.127+0000 7f7c1f006640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5929=0-4194304@1} caps={5929=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5929 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x557d03d9fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T09:58:35.125 INFO:tasks.ceph.mds.a.smithi007.stderr: -2922> 2024-04-25T09:57:58.429+0000 7f7c1f006640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v4 ap=1 DIRTYPARENT s=0 n(v0 rc2024-04-25T09:57:26.000256+0000 1=1+0) (iversion lock) caps={5929=pAsLsXsFs/-@2},l=5929(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 scrubqueue=0 0x557d03d9fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v4>,<0x1/dir_test v7>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T09:58:35.128 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:58:35.155 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-04-25T09:58:35.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.229+0000 7f2d3531d640 1 Processor -- start 2024-04-25T09:58:35.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.229+0000 7f2d3531d640 1 -- start start 2024-04-25T09:58:35.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.230+0000 7f2d3531d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2d3015d990 0x7f2d300b1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:35.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.230+0000 7f2d3531d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d300b29c0 0x7f2d300d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:35.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.230+0000 7f2d3531d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d300cbcb0 con 0x7f2d300d1ac0 2024-04-25T09:58:35.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.230+0000 7f2d3531d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d300b1df0 con 0x7f2d3015d990 2024-04-25T09:58:35.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.230+0000 7f2d3531d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d300b20d0 con 0x7f2d300b29c0 2024-04-25T09:58:35.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.230+0000 7f2d2e7fc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d300b29c0 0x7f2d300d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:35.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.230+0000 7f2d2effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2d3015d990 0x7f2d300b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:35.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.230+0000 7f2d2f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2d300d1ac0 0x7f2d3006c360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:57208/0 (socket says 172.21.15.7:57208) 2024-04-25T09:58:35.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.230+0000 7f2d2e7fc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d300b29c0 0x7f2d300d1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:33428/0 (socket says 172.21.15.7:33428) 2024-04-25T09:58:35.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.231+0000 7f2d2f7fe640 1 -- 172.21.15.7:0/1341300061 learned_addr learned my addr 172.21.15.7:0/1341300061 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:35.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.231+0000 7f2d2effd640 1 -- 172.21.15.7:0/1341300061 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d300b29c0 msgr2=0x7f2d300d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:35.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.231+0000 7f2d2effd640 1 --2- 172.21.15.7:0/1341300061 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d300b29c0 0x7f2d300d1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:35.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.231+0000 7f2d2effd640 1 -- 172.21.15.7:0/1341300061 >> v1:172.21.15.55:6789/0 conn(0x7f2d300d1ac0 legacy=0x7f2d3006c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:35.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.231+0000 7f2d2effd640 1 -- 172.21.15.7:0/1341300061 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d300b23b0 con 0x7f2d3015d990 2024-04-25T09:58:35.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.231+0000 7f2d2e7fc640 1 --2- 172.21.15.7:0/1341300061 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d300b29c0 0x7f2d300d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:58:35.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.232+0000 7f2d2effd640 1 --2- 172.21.15.7:0/1341300061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d3015d990 0x7f2d300b1480 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2d280097a0 tx=0x7f2d2802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e3ab238c62e65a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:35.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.232+0000 7f2d2dffb640 1 -- 172.21.15.7:0/1341300061 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d28037070 con 0x7f2d3015d990 2024-04-25T09:58:35.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.232+0000 7f2d2dffb640 1 -- 172.21.15.7:0/1341300061 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2802ae50 con 0x7f2d3015d990 2024-04-25T09:58:35.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.232+0000 7f2d2dffb640 1 -- 172.21.15.7:0/1341300061 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d28032660 con 0x7f2d3015d990 2024-04-25T09:58:35.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.232+0000 7f2d3531d640 1 -- 172.21.15.7:0/1341300061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d3015d990 msgr2=0x7f2d300b1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:35.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.232+0000 7f2d3531d640 1 --2- 172.21.15.7:0/1341300061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d3015d990 0x7f2d300b1480 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2d280097a0 tx=0x7f2d2802a100 comp rx=0 tx=0).stop 2024-04-25T09:58:35.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.232+0000 7f2d3531d640 1 -- 172.21.15.7:0/1341300061 shutdown_connections 2024-04-25T09:58:35.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.232+0000 7f2d3531d640 1 --2- 172.21.15.7:0/1341300061 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d300b29c0 0x7f2d300d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:35.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.232+0000 7f2d3531d640 1 --2- 172.21.15.7:0/1341300061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d3015d990 0x7f2d300b1480 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:35.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.232+0000 7f2d3531d640 1 -- 172.21.15.7:0/1341300061 >> 172.21.15.7:0/1341300061 conn(0x7f2d3008af80 msgr2=0x7f2d3008b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:35.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.232+0000 7f2d3531d640 1 -- 172.21.15.7:0/1341300061 shutdown_connections 2024-04-25T09:58:35.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.232+0000 7f2d3531d640 1 -- 172.21.15.7:0/1341300061 wait complete. 2024-04-25T09:58:35.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.234+0000 7f2d3531d640 1 Processor -- start 2024-04-25T09:58:35.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.234+0000 7f2d3531d640 1 -- start start 2024-04-25T09:58:35.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.234+0000 7f2d3531d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d300b29c0 0x7f2d301f33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:35.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.234+0000 7f2d3531d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d300d1ac0 0x7f2d300b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:35.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.234+0000 7f2d3531d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d3015d990 0x7f2d3015c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:35.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.234+0000 7f2d3531d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d300b19c0 con 0x7f2d3015d990 2024-04-25T09:58:35.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.234+0000 7f2d3531d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d300cf9d0 con 0x7f2d300d1ac0 2024-04-25T09:58:35.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.234+0000 7f2d3531d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d300b1b40 con 0x7f2d300b29c0 2024-04-25T09:58:35.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.235+0000 7f2d2f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d3015d990 0x7f2d3015c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:35.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.235+0000 7f2d2f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d3015d990 0x7f2d3015c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48682/0 (socket says 172.21.15.7:48682) 2024-04-25T09:58:35.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.235+0000 7f2d2f7fe640 1 -- 172.21.15.7:0/807256015 learned_addr learned my addr 172.21.15.7:0/807256015 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:35.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.235+0000 7f2d2e7fc640 1 --2- 172.21.15.7:0/807256015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d300d1ac0 0x7f2d300b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:35.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.235+0000 7f2d2effd640 1 --2- 172.21.15.7:0/807256015 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d300b29c0 0x7f2d301f33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:35.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.235+0000 7f2d2f7fe640 1 -- 172.21.15.7:0/807256015 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d300b29c0 msgr2=0x7f2d301f33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:35.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.235+0000 7f2d2f7fe640 1 --2- 172.21.15.7:0/807256015 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d300b29c0 0x7f2d301f33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:35.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.235+0000 7f2d2f7fe640 1 -- 172.21.15.7:0/807256015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d300d1ac0 msgr2=0x7f2d300b4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:35.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.235+0000 7f2d2f7fe640 1 --2- 172.21.15.7:0/807256015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d300d1ac0 0x7f2d300b4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:35.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.235+0000 7f2d2f7fe640 1 -- 172.21.15.7:0/807256015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d300b72f0 con 0x7f2d3015d990 2024-04-25T09:58:35.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.235+0000 7f2d2f7fe640 1 --2- 172.21.15.7:0/807256015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d3015d990 0x7f2d3015c2c0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000cad0 tx=0x7f2d2000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:35.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.235+0000 7f2d277fe640 1 -- 172.21.15.7:0/807256015 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d20017070 con 0x7f2d3015d990 2024-04-25T09:58:35.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.235+0000 7f2d277fe640 1 -- 172.21.15.7:0/807256015 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2000ac30 con 0x7f2d3015d990 2024-04-25T09:58:35.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.235+0000 7f2d3531d640 1 -- 172.21.15.7:0/807256015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d300b5380 con 0x7f2d3015d990 2024-04-25T09:58:35.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.235+0000 7f2d277fe640 1 -- 172.21.15.7:0/807256015 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d20012620 con 0x7f2d3015d990 2024-04-25T09:58:35.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.236+0000 7f2d3531d640 1 -- 172.21.15.7:0/807256015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d300b5940 con 0x7f2d3015d990 2024-04-25T09:58:35.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.237+0000 7f2d3531d640 1 -- 172.21.15.7:0/807256015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d30068f60 con 0x7f2d3015d990 2024-04-25T09:58:35.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.237+0000 7f2d277fe640 1 -- 172.21.15.7:0/807256015 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2d2001a070 con 0x7f2d3015d990 2024-04-25T09:58:35.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.238+0000 7f2d277fe640 1 --2- 172.21.15.7:0/807256015 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d1006b4d0 0x7f2d1006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:35.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.238+0000 7f2d2effd640 1 --2- 172.21.15.7:0/807256015 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d1006b4d0 0x7f2d1006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:35.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.238+0000 7f2d277fe640 1 -- 172.21.15.7:0/807256015 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f2d2008a050 con 0x7f2d3015d990 2024-04-25T09:58:35.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.238+0000 7f2d2effd640 1 --2- 172.21.15.7:0/807256015 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d1006b4d0 0x7f2d1006d990 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2d28034000 tx=0x7f2d2802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:35.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.242+0000 7f2d277fe640 1 -- 172.21.15.7:0/807256015 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2d2000ae20 con 0x7f2d3015d990 2024-04-25T09:58:35.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:35.464+0000 7f2d3531d640 1 -- 172.21.15.7:0/807256015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2d3006e130 con 0x7f2d3015d990 2024-04-25T09:58:36.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.108+0000 7f2d277fe640 1 -- 172.21.15.7:0/807256015 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2d200586c0 con 0x7f2d3015d990 2024-04-25T09:58:36.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.110+0000 7f2d3531d640 1 -- 172.21.15.7:0/807256015 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d1006b4d0 msgr2=0x7f2d1006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:36.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.110+0000 7f2d3531d640 1 --2- 172.21.15.7:0/807256015 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d1006b4d0 0x7f2d1006d990 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2d28034000 tx=0x7f2d2802e000 comp rx=0 tx=0).stop 2024-04-25T09:58:36.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.110+0000 7f2d3531d640 1 -- 172.21.15.7:0/807256015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d3015d990 msgr2=0x7f2d3015c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:36.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.110+0000 7f2d3531d640 1 --2- 172.21.15.7:0/807256015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d3015d990 0x7f2d3015c2c0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000cad0 tx=0x7f2d2000cf90 comp rx=0 tx=0).stop 2024-04-25T09:58:36.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.110+0000 7f2d3531d640 1 -- 172.21.15.7:0/807256015 shutdown_connections 2024-04-25T09:58:36.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.110+0000 7f2d3531d640 1 --2- 172.21.15.7:0/807256015 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d1006b4d0 0x7f2d1006d990 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:36.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.110+0000 7f2d3531d640 1 --2- 172.21.15.7:0/807256015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d3015d990 0x7f2d3015c2c0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:36.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.110+0000 7f2d3531d640 1 --2- 172.21.15.7:0/807256015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d300d1ac0 0x7f2d300b4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:36.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.110+0000 7f2d3531d640 1 --2- 172.21.15.7:0/807256015 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d300b29c0 0x7f2d301f33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:36.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.110+0000 7f2d3531d640 1 -- 172.21.15.7:0/807256015 >> 172.21.15.7:0/807256015 conn(0x7f2d3008af80 msgr2=0x7f2d300cdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:36.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.110+0000 7f2d3531d640 1 -- 172.21.15.7:0/807256015 shutdown_connections 2024-04-25T09:58:36.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.110+0000 7f2d3531d640 1 -- 172.21.15.7:0/807256015 wait complete. 2024-04-25T09:58:36.127 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:58:36.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.277+0000 7f4773876640 1 Processor -- start 2024-04-25T09:58:36.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.277+0000 7f4773876640 1 -- start start 2024-04-25T09:58:36.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.278+0000 7f4773876640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f476c15d780 0x7f476c0b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:36.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.278+0000 7f4773876640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f476c15db60 0x7f476c0b3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:36.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.278+0000 7f4773876640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f476c071740 con 0x7f476c06ab60 2024-04-25T09:58:36.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.278+0000 7f4773876640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f476c0714f0 con 0x7f476c15db60 2024-04-25T09:58:36.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.278+0000 7f4773876640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476c071a20 con 0x7f476c15d780 2024-04-25T09:58:36.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.278+0000 7f4770e11640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f476c15db60 0x7f476c0b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:36.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.278+0000 7f4771612640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f476c15d780 0x7f476c0b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:36.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.278+0000 7f4771e13640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f476c06ab60 0x7f476c161550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:57212/0 (socket says 172.21.15.7:57212) 2024-04-25T09:58:36.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.278+0000 7f4771e13640 1 -- 172.21.15.7:0/2233728661 learned_addr learned my addr 172.21.15.7:0/2233728661 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:36.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.279+0000 7f4770e11640 1 -- 172.21.15.7:0/2233728661 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f476c15d780 msgr2=0x7f476c0b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:36.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.279+0000 7f4770e11640 1 --2- 172.21.15.7:0/2233728661 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f476c15d780 0x7f476c0b33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:36.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.279+0000 7f4770e11640 1 -- 172.21.15.7:0/2233728661 >> v1:172.21.15.55:6789/0 conn(0x7f476c06ab60 legacy=0x7f476c161550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:36.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.279+0000 7f4770e11640 1 -- 172.21.15.7:0/2233728661 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476c071d00 con 0x7f476c15db60 2024-04-25T09:58:36.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.279+0000 7f4771612640 1 --2- 172.21.15.7:0/2233728661 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f476c15d780 0x7f476c0b33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:58:36.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.279+0000 7f4770e11640 1 --2- 172.21.15.7:0/2233728661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f476c15db60 0x7f476c0b3920 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f475c0097a0 tx=0x7f475c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f4943c868df8ffa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:36.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.280+0000 7f4763fff640 1 -- 172.21.15.7:0/2233728661 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c037070 con 0x7f476c15db60 2024-04-25T09:58:36.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.280+0000 7f4763fff640 1 -- 172.21.15.7:0/2233728661 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475c032440 con 0x7f476c15db60 2024-04-25T09:58:36.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.280+0000 7f4763fff640 1 -- 172.21.15.7:0/2233728661 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c032810 con 0x7f476c15db60 2024-04-25T09:58:36.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.280+0000 7f4773876640 1 -- 172.21.15.7:0/2233728661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f476c15db60 msgr2=0x7f476c0b3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:36.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.280+0000 7f4773876640 1 --2- 172.21.15.7:0/2233728661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f476c15db60 0x7f476c0b3920 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f475c0097a0 tx=0x7f475c02a180 comp rx=0 tx=0).stop 2024-04-25T09:58:36.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.280+0000 7f4773876640 1 -- 172.21.15.7:0/2233728661 shutdown_connections 2024-04-25T09:58:36.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.280+0000 7f4773876640 1 --2- 172.21.15.7:0/2233728661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f476c15db60 0x7f476c0b3920 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:36.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.280+0000 7f4773876640 1 --2- 172.21.15.7:0/2233728661 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f476c15d780 0x7f476c0b33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:36.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.280+0000 7f4773876640 1 -- 172.21.15.7:0/2233728661 >> 172.21.15.7:0/2233728661 conn(0x7f476c0b1660 msgr2=0x7f476c0b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:36.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.280+0000 7f4773876640 1 -- 172.21.15.7:0/2233728661 shutdown_connections 2024-04-25T09:58:36.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.280+0000 7f4773876640 1 -- 172.21.15.7:0/2233728661 wait complete. 2024-04-25T09:58:36.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.281+0000 7f4773876640 1 Processor -- start 2024-04-25T09:58:36.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.282+0000 7f4773876640 1 -- start start 2024-04-25T09:58:36.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.282+0000 7f4773876640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f476c06ab60 0x7f476c14c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:36.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.282+0000 7f4773876640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f476c15d780 0x7f476c15df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:36.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.282+0000 7f4773876640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f476c15db60 0x7f476c15e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:36.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.282+0000 7f4773876640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476c06ecf0 con 0x7f476c15d780 2024-04-25T09:58:36.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.282+0000 7f4773876640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476c06eb70 con 0x7f476c15db60 2024-04-25T09:58:36.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.282+0000 7f4773876640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476c06b010 con 0x7f476c06ab60 2024-04-25T09:58:36.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.282+0000 7f4770e11640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f476c15d780 0x7f476c15df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:36.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.282+0000 7f4770e11640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f476c15d780 0x7f476c15df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48692/0 (socket says 172.21.15.7:48692) 2024-04-25T09:58:36.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.282+0000 7f4770e11640 1 -- 172.21.15.7:0/27295898 learned_addr learned my addr 172.21.15.7:0/27295898 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:36.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.282+0000 7f4771612640 1 --2- 172.21.15.7:0/27295898 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f476c06ab60 0x7f476c14c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:36.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.282+0000 7f4771e13640 1 --2- 172.21.15.7:0/27295898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f476c15db60 0x7f476c15e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:36.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.283+0000 7f4770e11640 1 -- 172.21.15.7:0/27295898 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f476c06ab60 msgr2=0x7f476c14c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:36.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.283+0000 7f4770e11640 1 --2- 172.21.15.7:0/27295898 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f476c06ab60 0x7f476c14c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:36.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.283+0000 7f4770e11640 1 -- 172.21.15.7:0/27295898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f476c15db60 msgr2=0x7f476c15e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:36.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.283+0000 7f4770e11640 1 --2- 172.21.15.7:0/27295898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f476c15db60 0x7f476c15e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:36.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.283+0000 7f4770e11640 1 -- 172.21.15.7:0/27295898 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476c151c70 con 0x7f476c15d780 2024-04-25T09:58:36.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.283+0000 7f4770e11640 1 --2- 172.21.15.7:0/27295898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f476c15d780 0x7f476c15df80 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f475c035040 tx=0x7f475c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:36.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.283+0000 7f4761ffb640 1 -- 172.21.15.7:0/27295898 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c037040 con 0x7f476c15d780 2024-04-25T09:58:36.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.283+0000 7f4761ffb640 1 -- 172.21.15.7:0/27295898 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475c030500 con 0x7f476c15d780 2024-04-25T09:58:36.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.283+0000 7f4773876640 1 -- 172.21.15.7:0/27295898 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f476c151f50 con 0x7f476c15d780 2024-04-25T09:58:36.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.283+0000 7f4761ffb640 1 -- 172.21.15.7:0/27295898 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c0308d0 con 0x7f476c15d780 2024-04-25T09:58:36.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.283+0000 7f4773876640 1 -- 172.21.15.7:0/27295898 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f476c14cbd0 con 0x7f476c15d780 2024-04-25T09:58:36.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.284+0000 7f4773876640 1 -- 172.21.15.7:0/27295898 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f476c0b4d30 con 0x7f476c15d780 2024-04-25T09:58:36.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.285+0000 7f4761ffb640 1 -- 172.21.15.7:0/27295898 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f475c044020 con 0x7f476c15d780 2024-04-25T09:58:36.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.285+0000 7f4761ffb640 1 --2- 172.21.15.7:0/27295898 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f475006b4d0 0x7f475006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:36.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.285+0000 7f4761ffb640 1 -- 172.21.15.7:0/27295898 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f475c0aa510 con 0x7f476c15d780 2024-04-25T09:58:36.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.285+0000 7f4771612640 1 --2- 172.21.15.7:0/27295898 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f475006b4d0 0x7f475006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:36.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.286+0000 7f4771612640 1 --2- 172.21.15.7:0/27295898 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f475006b4d0 0x7f475006d990 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4768009560 tx=0x7f4768009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:36.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.290+0000 7f4761ffb640 1 -- 172.21.15.7:0/27295898 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f476c0b4d30 con 0x7f476c15d780 2024-04-25T09:58:36.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:36.469+0000 7f4773876640 1 -- 172.21.15.7:0/27295898 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f476c069040 con 0x7f476c15d780 2024-04-25T09:58:37.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.223+0000 7f4761ffb640 1 -- 172.21.15.7:0/27295898 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v66) v1 ==== 181+0+0 (secure 0 0 0) 0x7f475c078b80 con 0x7f476c15d780 2024-04-25T09:58:37.227 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:58:37.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.227+0000 7f4773876640 1 -- 172.21.15.7:0/27295898 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f475006b4d0 msgr2=0x7f475006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:37.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.227+0000 7f4773876640 1 --2- 172.21.15.7:0/27295898 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f475006b4d0 0x7f475006d990 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4768009560 tx=0x7f4768009190 comp rx=0 tx=0).stop 2024-04-25T09:58:37.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.227+0000 7f4773876640 1 -- 172.21.15.7:0/27295898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f476c15d780 msgr2=0x7f476c15df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:37.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.227+0000 7f4773876640 1 --2- 172.21.15.7:0/27295898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f476c15d780 0x7f476c15df80 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f475c035040 tx=0x7f475c0046c0 comp rx=0 tx=0).stop 2024-04-25T09:58:37.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.227+0000 7f4773876640 1 -- 172.21.15.7:0/27295898 shutdown_connections 2024-04-25T09:58:37.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.227+0000 7f4773876640 1 --2- 172.21.15.7:0/27295898 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f475006b4d0 0x7f475006d990 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:37.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.227+0000 7f4773876640 1 --2- 172.21.15.7:0/27295898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f476c15db60 0x7f476c15e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:37.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.227+0000 7f4773876640 1 --2- 172.21.15.7:0/27295898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f476c15d780 0x7f476c15df80 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:37.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.227+0000 7f4773876640 1 --2- 172.21.15.7:0/27295898 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f476c06ab60 0x7f476c14c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:37.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.227+0000 7f4773876640 1 -- 172.21.15.7:0/27295898 >> 172.21.15.7:0/27295898 conn(0x7f476c0b1660 msgr2=0x7f476c0b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:37.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.227+0000 7f4773876640 1 -- 172.21.15.7:0/27295898 shutdown_connections 2024-04-25T09:58:37.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.227+0000 7f4773876640 1 -- 172.21.15.7:0/27295898 wait complete. 2024-04-25T09:58:37.245 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:58:37.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.353+0000 7f9629a9e640 1 Processor -- start 2024-04-25T09:58:37.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.353+0000 7f9629a9e640 1 -- start start 2024-04-25T09:58:37.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.353+0000 7f9629a9e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96240cf360 0x7f96240cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:37.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.353+0000 7f9629a9e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f96240ccd30 0x7f96240cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:37.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.353+0000 7f9629a9e640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f962415d2b0 con 0x7f96240999f0 2024-04-25T09:58:37.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.353+0000 7f9629a9e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96240d00d0 con 0x7f96240ccd30 2024-04-25T09:58:37.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.353+0000 7f9629a9e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96240d03b0 con 0x7f96240cf360 2024-04-25T09:58:37.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.354+0000 7f96237fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f96240999f0 0x7f9624099dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45742/0 (socket says 172.21.15.7:45742) 2024-04-25T09:58:37.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.354+0000 7f96237fe640 1 -- 172.21.15.7:0/3518209157 learned_addr learned my addr 172.21.15.7:0/3518209157 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:37.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.354+0000 7f9623fff640 1 --2- 172.21.15.7:0/3518209157 >> v2:172.21.15.55:3300/0 conn(0x7f96240ccd30 0x7f96240cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:37.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.354+0000 7f9622ffd640 1 --2- 172.21.15.7:0/3518209157 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96240cf360 0x7f96240cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:37.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.354+0000 7f96227fc640 1 -- 172.21.15.7:0/3518209157 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1585562829 0 0) 0x7f962415d2b0 con 0x7f96240999f0 2024-04-25T09:58:37.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.354+0000 7f96227fc640 1 -- 172.21.15.7:0/3518209157 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f960c003520 con 0x7f96240999f0 2024-04-25T09:58:37.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.354+0000 7f9623fff640 1 -- 172.21.15.7:0/3518209157 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96240cf360 msgr2=0x7f96240cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:37.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.354+0000 7f9623fff640 1 --2- 172.21.15.7:0/3518209157 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96240cf360 0x7f96240cf7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:37.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.354+0000 7f96227fc640 1 -- 172.21.15.7:0/3518209157 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2247049152 0 0) 0x7f960c003520 con 0x7f96240999f0 2024-04-25T09:58:37.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.354+0000 7f9623fff640 1 -- 172.21.15.7:0/3518209157 >> v1:172.21.15.7:6789/0 conn(0x7f96240999f0 legacy=0x7f9624099dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:37.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.354+0000 7f9623fff640 1 -- 172.21.15.7:0/3518209157 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96240d0690 con 0x7f96240ccd30 2024-04-25T09:58:37.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.355+0000 7f9623fff640 1 --2- 172.21.15.7:0/3518209157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96240ccd30 0x7f96240cd1c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f961c009d90 tx=0x7f961c02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c71a70861560df9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:37.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.355+0000 7f96227fc640 1 -- 172.21.15.7:0/3518209157 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9614001670 con 0x7f96240ccd30 2024-04-25T09:58:37.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.355+0000 7f96227fc640 1 -- 172.21.15.7:0/3518209157 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961c007540 con 0x7f96240ccd30 2024-04-25T09:58:37.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.355+0000 7f96227fc640 1 -- 172.21.15.7:0/3518209157 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961c007910 con 0x7f96240ccd30 2024-04-25T09:58:37.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.356+0000 7f9629a9e640 1 -- 172.21.15.7:0/3518209157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96240ccd30 msgr2=0x7f96240cd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:37.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.356+0000 7f9629a9e640 1 --2- 172.21.15.7:0/3518209157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96240ccd30 0x7f96240cd1c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f961c009d90 tx=0x7f961c02a5f0 comp rx=0 tx=0).stop 2024-04-25T09:58:37.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.356+0000 7f9629a9e640 1 -- 172.21.15.7:0/3518209157 shutdown_connections 2024-04-25T09:58:37.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.356+0000 7f9629a9e640 1 --2- 172.21.15.7:0/3518209157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96240ccd30 0x7f96240cd1c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:37.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.356+0000 7f9629a9e640 1 --2- 172.21.15.7:0/3518209157 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96240cf360 0x7f96240cf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:37.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.356+0000 7f9629a9e640 1 -- 172.21.15.7:0/3518209157 >> 172.21.15.7:0/3518209157 conn(0x7f96240b3130 msgr2=0x7f96240b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:37.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.356+0000 7f9629a9e640 1 -- 172.21.15.7:0/3518209157 shutdown_connections 2024-04-25T09:58:37.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.356+0000 7f9629a9e640 1 -- 172.21.15.7:0/3518209157 wait complete. 2024-04-25T09:58:37.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.357+0000 7f9629a9e640 1 Processor -- start 2024-04-25T09:58:37.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.357+0000 7f9629a9e640 1 -- start start 2024-04-25T09:58:37.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.358+0000 7f9629a9e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96240999f0 0x7f96241f5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:37.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.358+0000 7f9629a9e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96240ccd30 0x7f96240b6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:37.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.358+0000 7f9629a9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96240cf360 0x7f96241f1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:37.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.358+0000 7f9629a9e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96240cfe80 con 0x7f96240999f0 2024-04-25T09:58:37.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.358+0000 7f9629a9e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96240cfd00 con 0x7f96240cf360 2024-04-25T09:58:37.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.358+0000 7f9629a9e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96240cc430 con 0x7f96240ccd30 2024-04-25T09:58:37.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.358+0000 7f96237fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96240999f0 0x7f96241f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:37.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.358+0000 7f96237fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96240999f0 0x7f96241f5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48706/0 (socket says 172.21.15.7:48706) 2024-04-25T09:58:37.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.358+0000 7f96237fe640 1 -- 172.21.15.7:0/1244807509 learned_addr learned my addr 172.21.15.7:0/1244807509 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:37.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.358+0000 7f9623fff640 1 --2- 172.21.15.7:0/1244807509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96240cf360 0x7f96241f1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:37.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.358+0000 7f9622ffd640 1 --2- 172.21.15.7:0/1244807509 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96240ccd30 0x7f96240b6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:37.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.358+0000 7f96237fe640 1 -- 172.21.15.7:0/1244807509 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96240ccd30 msgr2=0x7f96240b6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:37.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.358+0000 7f96237fe640 1 --2- 172.21.15.7:0/1244807509 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96240ccd30 0x7f96240b6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:37.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.358+0000 7f96237fe640 1 -- 172.21.15.7:0/1244807509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96240cf360 msgr2=0x7f96241f1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:37.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.358+0000 7f96237fe640 1 --2- 172.21.15.7:0/1244807509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96240cf360 0x7f96241f1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:37.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.358+0000 7f96237fe640 1 -- 172.21.15.7:0/1244807509 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96241f22c0 con 0x7f96240999f0 2024-04-25T09:58:37.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.358+0000 7f9623fff640 1 --2- 172.21.15.7:0/1244807509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96240cf360 0x7f96241f1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:37.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.358+0000 7f9622ffd640 1 --2- 172.21.15.7:0/1244807509 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96240ccd30 0x7f96240b6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:37.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.359+0000 7f96237fe640 1 --2- 172.21.15.7:0/1244807509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96240999f0 0x7f96241f5a70 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f961400c780 tx=0x7f961400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:37.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.359+0000 7f960bfff640 1 -- 172.21.15.7:0/1244807509 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9614017070 con 0x7f96240999f0 2024-04-25T09:58:37.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.359+0000 7f960bfff640 1 -- 172.21.15.7:0/1244807509 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9614005ad0 con 0x7f96240999f0 2024-04-25T09:58:37.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.359+0000 7f9629a9e640 1 -- 172.21.15.7:0/1244807509 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96241f25a0 con 0x7f96240999f0 2024-04-25T09:58:37.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.359+0000 7f960bfff640 1 -- 172.21.15.7:0/1244807509 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9614007070 con 0x7f96240999f0 2024-04-25T09:58:37.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.359+0000 7f9629a9e640 1 -- 172.21.15.7:0/1244807509 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96240b7100 con 0x7f96240999f0 2024-04-25T09:58:37.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.360+0000 7f9629a9e640 1 -- 172.21.15.7:0/1244807509 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f962409f1a0 con 0x7f96240999f0 2024-04-25T09:58:37.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.360+0000 7f960bfff640 1 -- 172.21.15.7:0/1244807509 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f961401a070 con 0x7f96240999f0 2024-04-25T09:58:37.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.361+0000 7f960bfff640 1 --2- 172.21.15.7:0/1244807509 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f961006b500 0x7f961006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:37.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.361+0000 7f960bfff640 1 -- 172.21.15.7:0/1244807509 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5836+0+0 (secure 0 0 0) 0x7f9614089740 con 0x7f96240999f0 2024-04-25T09:58:37.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.361+0000 7f9622ffd640 1 --2- 172.21.15.7:0/1244807509 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f961006b500 0x7f961006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:37.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.361+0000 7f9622ffd640 1 --2- 172.21.15.7:0/1244807509 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f961006b500 0x7f961006d9c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f96240c8270 tx=0x7f9618008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:37.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.365+0000 7f960bfff640 1 -- 172.21.15.7:0/1244807509 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f96140585d0 con 0x7f96240999f0 2024-04-25T09:58:37.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:37.548+0000 7f9629a9e640 1 -- 172.21.15.7:0/1244807509 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9624069040 con 0x7f96240999f0 2024-04-25T09:58:38.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.229+0000 7f960bfff640 1 -- 172.21.15.7:0/1244807509 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v67) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9614057ed0 con 0x7f96240999f0 2024-04-25T09:58:38.233 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2024-04-25T09:58:38.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.233+0000 7f9629a9e640 1 -- 172.21.15.7:0/1244807509 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f961006b500 msgr2=0x7f961006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:38.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.233+0000 7f9629a9e640 1 --2- 172.21.15.7:0/1244807509 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f961006b500 0x7f961006d9c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f96240c8270 tx=0x7f9618008040 comp rx=0 tx=0).stop 2024-04-25T09:58:38.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.233+0000 7f9629a9e640 1 -- 172.21.15.7:0/1244807509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96240999f0 msgr2=0x7f96241f5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:38.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.233+0000 7f9629a9e640 1 --2- 172.21.15.7:0/1244807509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96240999f0 0x7f96241f5a70 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f961400c780 tx=0x7f961400cc40 comp rx=0 tx=0).stop 2024-04-25T09:58:38.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.234+0000 7f9629a9e640 1 -- 172.21.15.7:0/1244807509 shutdown_connections 2024-04-25T09:58:38.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.234+0000 7f9629a9e640 1 --2- 172.21.15.7:0/1244807509 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f961006b500 0x7f961006d9c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:38.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.234+0000 7f9629a9e640 1 --2- 172.21.15.7:0/1244807509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96240cf360 0x7f96241f1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:38.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.234+0000 7f9629a9e640 1 --2- 172.21.15.7:0/1244807509 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96240ccd30 0x7f96240b6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:38.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.234+0000 7f9629a9e640 1 --2- 172.21.15.7:0/1244807509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96240999f0 0x7f96241f5a70 secure :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f961400c780 tx=0x7f961400cc40 comp rx=0 tx=0).stop 2024-04-25T09:58:38.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.234+0000 7f9629a9e640 1 -- 172.21.15.7:0/1244807509 >> 172.21.15.7:0/1244807509 conn(0x7f96240b3130 msgr2=0x7f962406f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:38.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.235+0000 7f9629a9e640 1 -- 172.21.15.7:0/1244807509 shutdown_connections 2024-04-25T09:58:38.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.235+0000 7f9629a9e640 1 -- 172.21.15.7:0/1244807509 wait complete. 2024-04-25T09:58:38.259 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:58:38.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.363+0000 7f8b62ccb640 1 Processor -- start 2024-04-25T09:58:38.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.363+0000 7f8b62ccb640 1 -- start start 2024-04-25T09:58:38.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.364+0000 7f8b62ccb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8b5c0cfc40 0x7f8b5c0d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:38.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.364+0000 7f8b62ccb640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8b5c0cc580 0x7f8b5c0cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:38.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.364+0000 7f8b62ccb640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b5c0b25e0 con 0x7f8b5c0b1480 2024-04-25T09:58:38.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.364+0000 7f8b62ccb640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b5c15bec0 con 0x7f8b5c0cc580 2024-04-25T09:58:38.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.364+0000 7f8b62ccb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b5c0d0560 con 0x7f8b5c0cfc40 2024-04-25T09:58:38.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.364+0000 7f8b61268640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8b5c0cc580 0x7f8b5c0cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:38.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.365+0000 7f8b61268640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8b5c0cc580 0x7f8b5c0cc9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48710/0 (socket says 172.21.15.7:48710) 2024-04-25T09:58:38.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.365+0000 7f8b61268640 1 -- 172.21.15.7:0/2234231833 learned_addr learned my addr 172.21.15.7:0/2234231833 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:38.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.365+0000 7f8b60a67640 1 --2- 172.21.15.7:0/2234231833 >> v2:172.21.15.55:3300/0 conn(0x7f8b5c0cfc40 0x7f8b5c0d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:38.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.365+0000 7f8b61268640 1 -- 172.21.15.7:0/2234231833 >> v2:172.21.15.55:3300/0 conn(0x7f8b5c0cfc40 msgr2=0x7f8b5c0d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:38.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.365+0000 7f8b61268640 1 --2- 172.21.15.7:0/2234231833 >> v2:172.21.15.55:3300/0 conn(0x7f8b5c0cfc40 0x7f8b5c0d0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:38.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.365+0000 7f8b61268640 1 -- 172.21.15.7:0/2234231833 >> v1:172.21.15.7:6789/0 conn(0x7f8b5c0b1480 legacy=0x7f8b5c0b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:38.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.365+0000 7f8b5b7fe640 1 -- 172.21.15.7:0/2234231833 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776786195 0 0) 0x7f8b5c0b25e0 con 0x7f8b5c0b1480 2024-04-25T09:58:38.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.365+0000 7f8b61268640 1 -- 172.21.15.7:0/2234231833 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b5c0b19d0 con 0x7f8b5c0cc580 2024-04-25T09:58:38.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.366+0000 7f8b61268640 1 --2- 172.21.15.7:0/2234231833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b5c0cc580 0x7f8b5c0cc9d0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c0cf110 tx=0x7f8b4c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d383f875ae010d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:38.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.366+0000 7f8b5b7fe640 1 -- 172.21.15.7:0/2234231833 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c037070 con 0x7f8b5c0cc580 2024-04-25T09:58:38.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.366+0000 7f8b5b7fe640 1 -- 172.21.15.7:0/2234231833 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4c032440 con 0x7f8b5c0cc580 2024-04-25T09:58:38.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.366+0000 7f8b5b7fe640 1 -- 172.21.15.7:0/2234231833 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c032810 con 0x7f8b5c0cc580 2024-04-25T09:58:38.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.366+0000 7f8b62ccb640 1 -- 172.21.15.7:0/2234231833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b5c0cc580 msgr2=0x7f8b5c0cc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:38.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.366+0000 7f8b62ccb640 1 --2- 172.21.15.7:0/2234231833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b5c0cc580 0x7f8b5c0cc9d0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c0cf110 tx=0x7f8b4c02a1e0 comp rx=0 tx=0).stop 2024-04-25T09:58:38.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.366+0000 7f8b62ccb640 1 -- 172.21.15.7:0/2234231833 shutdown_connections 2024-04-25T09:58:38.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.366+0000 7f8b62ccb640 1 --2- 172.21.15.7:0/2234231833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b5c0cc580 0x7f8b5c0cc9d0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:38.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.366+0000 7f8b62ccb640 1 --2- 172.21.15.7:0/2234231833 >> v2:172.21.15.55:3300/0 conn(0x7f8b5c0cfc40 0x7f8b5c0d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:38.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.366+0000 7f8b62ccb640 1 -- 172.21.15.7:0/2234231833 >> 172.21.15.7:0/2234231833 conn(0x7f8b5c08af80 msgr2=0x7f8b5c08b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:38.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.366+0000 7f8b62ccb640 1 -- 172.21.15.7:0/2234231833 shutdown_connections 2024-04-25T09:58:38.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.366+0000 7f8b62ccb640 1 -- 172.21.15.7:0/2234231833 wait complete. 2024-04-25T09:58:38.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.367+0000 7f8b62ccb640 1 Processor -- start 2024-04-25T09:58:38.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.368+0000 7f8b62ccb640 1 -- start start 2024-04-25T09:58:38.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.368+0000 7f8b62ccb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b5c0b1480 0x7f8b5c1e68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:38.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.368+0000 7f8b62ccb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b5c0cc580 0x7f8b5c1e6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:38.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.368+0000 7f8b62ccb640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8b5c0cfc40 0x7f8b5c1e0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:38.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.368+0000 7f8b62ccb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c0b2270 con 0x7f8b5c0cc580 2024-04-25T09:58:38.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.368+0000 7f8b62ccb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c0b1f90 con 0x7f8b5c0b1480 2024-04-25T09:58:38.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.368+0000 7f8b62ccb640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c0ccf10 con 0x7f8b5c0cfc40 2024-04-25T09:58:38.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.369+0000 7f8b5bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b5c0cc580 0x7f8b5c1e6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:38.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.369+0000 7f8b5bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b5c0cc580 0x7f8b5c1e6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48712/0 (socket says 172.21.15.7:48712) 2024-04-25T09:58:38.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.369+0000 7f8b5bfff640 1 -- 172.21.15.7:0/1644003333 learned_addr learned my addr 172.21.15.7:0/1644003333 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:38.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.369+0000 7f8b60a67640 1 --2- 172.21.15.7:0/1644003333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b5c0b1480 0x7f8b5c1e68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:38.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.369+0000 7f8b61268640 1 --2- 172.21.15.7:0/1644003333 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8b5c0cfc40 0x7f8b5c1e0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:38.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.369+0000 7f8b5bfff640 1 -- 172.21.15.7:0/1644003333 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8b5c0cfc40 msgr2=0x7f8b5c1e0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:38.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.369+0000 7f8b5bfff640 1 --2- 172.21.15.7:0/1644003333 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8b5c0cfc40 0x7f8b5c1e0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:38.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.369+0000 7f8b5bfff640 1 -- 172.21.15.7:0/1644003333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b5c0b1480 msgr2=0x7f8b5c1e68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:38.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.369+0000 7f8b5bfff640 1 --2- 172.21.15.7:0/1644003333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b5c0b1480 0x7f8b5c1e68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:38.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.369+0000 7f8b5bfff640 1 -- 172.21.15.7:0/1644003333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b5c1e1960 con 0x7f8b5c0cc580 2024-04-25T09:58:38.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.369+0000 7f8b60a67640 1 --2- 172.21.15.7:0/1644003333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b5c0b1480 0x7f8b5c1e68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:58:38.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.369+0000 7f8b5bfff640 1 --2- 172.21.15.7:0/1644003333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b5c0cc580 0x7f8b5c1e6e10 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000c4e0 tx=0x7f8b5000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:38.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.369+0000 7f8b597fa640 1 -- 172.21.15.7:0/1644003333 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b50017070 con 0x7f8b5c0cc580 2024-04-25T09:58:38.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.369+0000 7f8b597fa640 1 -- 172.21.15.7:0/1644003333 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b500035f0 con 0x7f8b5c0cc580 2024-04-25T09:58:38.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.369+0000 7f8b62ccb640 1 -- 172.21.15.7:0/1644003333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b5c0ca2d0 con 0x7f8b5c0cc580 2024-04-25T09:58:38.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.369+0000 7f8b597fa640 1 -- 172.21.15.7:0/1644003333 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b500039e0 con 0x7f8b5c0cc580 2024-04-25T09:58:38.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.369+0000 7f8b62ccb640 1 -- 172.21.15.7:0/1644003333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b5c0ca890 con 0x7f8b5c0cc580 2024-04-25T09:58:38.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.370+0000 7f8b62ccb640 1 -- 172.21.15.7:0/1644003333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b5c153e90 con 0x7f8b5c0cc580 2024-04-25T09:58:38.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.371+0000 7f8b597fa640 1 -- 172.21.15.7:0/1644003333 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8b5001a070 con 0x7f8b5c0cc580 2024-04-25T09:58:38.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.371+0000 7f8b597fa640 1 --2- 172.21.15.7:0/1644003333 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8b4806b4d0 0x7f8b4806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:38.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.371+0000 7f8b60a67640 1 --2- 172.21.15.7:0/1644003333 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8b4806b4d0 0x7f8b4806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:38.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.371+0000 7f8b597fa640 1 -- 172.21.15.7:0/1644003333 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f8b500892e0 con 0x7f8b5c0cc580 2024-04-25T09:58:38.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.372+0000 7f8b60a67640 1 --2- 172.21.15.7:0/1644003333 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8b4806b4d0 0x7f8b4806d990 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c1f4c70 tx=0x7f8b5400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:38.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.376+0000 7f8b597fa640 1 -- 172.21.15.7:0/1644003333 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8b50057d10 con 0x7f8b5c0cc580 2024-04-25T09:58:38.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.556+0000 7f8b62ccb640 1 -- 172.21.15.7:0/1644003333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8b5c068f60 con 0x7f8b5c0cc580 2024-04-25T09:58:38.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.559+0000 7f8b597fa640 1 -- 172.21.15.7:0/1644003333 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8b5005bdb0 con 0x7f8b5c0cc580 2024-04-25T09:58:38.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.561+0000 7f8b62ccb640 1 -- 172.21.15.7:0/1644003333 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8b4806b4d0 msgr2=0x7f8b4806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:38.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.561+0000 7f8b62ccb640 1 --2- 172.21.15.7:0/1644003333 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8b4806b4d0 0x7f8b4806d990 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c1f4c70 tx=0x7f8b5400b040 comp rx=0 tx=0).stop 2024-04-25T09:58:38.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.561+0000 7f8b62ccb640 1 -- 172.21.15.7:0/1644003333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b5c0cc580 msgr2=0x7f8b5c1e6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:38.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.561+0000 7f8b62ccb640 1 --2- 172.21.15.7:0/1644003333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b5c0cc580 0x7f8b5c1e6e10 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000c4e0 tx=0x7f8b5000c9a0 comp rx=0 tx=0).stop 2024-04-25T09:58:38.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.561+0000 7f8b62ccb640 1 -- 172.21.15.7:0/1644003333 shutdown_connections 2024-04-25T09:58:38.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.561+0000 7f8b62ccb640 1 --2- 172.21.15.7:0/1644003333 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8b4806b4d0 0x7f8b4806d990 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:38.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.561+0000 7f8b62ccb640 1 --2- 172.21.15.7:0/1644003333 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8b5c0cfc40 0x7f8b5c1e0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:38.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.561+0000 7f8b62ccb640 1 --2- 172.21.15.7:0/1644003333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b5c0cc580 0x7f8b5c1e6e10 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:38.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.561+0000 7f8b62ccb640 1 --2- 172.21.15.7:0/1644003333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b5c0b1480 0x7f8b5c1e68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:38.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.561+0000 7f8b62ccb640 1 -- 172.21.15.7:0/1644003333 >> 172.21.15.7:0/1644003333 conn(0x7f8b5c08af80 msgr2=0x7f8b5c0afe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:38.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.561+0000 7f8b62ccb640 1 -- 172.21.15.7:0/1644003333 shutdown_connections 2024-04-25T09:58:38.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.561+0000 7f8b62ccb640 1 -- 172.21.15.7:0/1644003333 wait complete. 2024-04-25T09:58:38.576 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2024-04-25T09:58:38.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.674+0000 7fbd6e48f640 1 Processor -- start 2024-04-25T09:58:38.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.674+0000 7fbd6e48f640 1 -- start start 2024-04-25T09:58:38.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.675+0000 7fbd6e48f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbd6815dd00 0x7fbd680b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:38.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.675+0000 7fbd6e48f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbd6806c6c0 0x7fbd680b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:38.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.675+0000 7fbd6e48f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd6806cd00 con 0x7fbd680b6a40 2024-04-25T09:58:38.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.675+0000 7fbd6e48f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd6815e0e0 con 0x7fbd6815dd00 2024-04-25T09:58:38.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.675+0000 7fbd6e48f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6806cfe0 con 0x7fbd6806c6c0 2024-04-25T09:58:38.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.675+0000 7fbd6ca2c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbd6806c6c0 0x7fbd680b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:38.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.675+0000 7fbd67fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbd6815dd00 0x7fbd680b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:38.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.676+0000 7fbd677fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbd680b6a40 0x7fbd6806bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:57220/0 (socket says 172.21.15.7:57220) 2024-04-25T09:58:38.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.676+0000 7fbd677fe640 1 -- 172.21.15.7:0/2792588557 learned_addr learned my addr 172.21.15.7:0/2792588557 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:38.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.676+0000 7fbd66ffd640 1 -- 172.21.15.7:0/2792588557 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1542242036 0 0) 0x7fbd6806cd00 con 0x7fbd680b6a40 2024-04-25T09:58:38.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.676+0000 7fbd66ffd640 1 -- 172.21.15.7:0/2792588557 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd54003520 con 0x7fbd680b6a40 2024-04-25T09:58:38.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.676+0000 7fbd6ca2c640 1 -- 172.21.15.7:0/2792588557 >> v2:172.21.15.55:3300/0 conn(0x7fbd6815dd00 msgr2=0x7fbd680b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:38.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.676+0000 7fbd6ca2c640 1 --2- 172.21.15.7:0/2792588557 >> v2:172.21.15.55:3300/0 conn(0x7fbd6815dd00 0x7fbd680b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:38.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.676+0000 7fbd6ca2c640 1 -- 172.21.15.7:0/2792588557 >> v1:172.21.15.55:6789/0 conn(0x7fbd680b6a40 legacy=0x7fbd6806bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:38.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.676+0000 7fbd6ca2c640 1 -- 172.21.15.7:0/2792588557 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd680d1ca0 con 0x7fbd6806c6c0 2024-04-25T09:58:38.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.677+0000 7fbd6ca2c640 1 --2- 172.21.15.7:0/2792588557 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbd6806c6c0 0x7fbd680b5c90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbd60009d90 tx=0x7fbd6002a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57a7bbbd2b8f9dca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:38.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.677+0000 7fbd66ffd640 1 -- 172.21.15.7:0/2792588557 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd60007740 con 0x7fbd6806c6c0 2024-04-25T09:58:38.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.677+0000 7fbd66ffd640 1 -- 172.21.15.7:0/2792588557 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd600078e0 con 0x7fbd6806c6c0 2024-04-25T09:58:38.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.677+0000 7fbd66ffd640 1 -- 172.21.15.7:0/2792588557 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd60007cb0 con 0x7fbd6806c6c0 2024-04-25T09:58:38.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.677+0000 7fbd6e48f640 1 -- 172.21.15.7:0/2792588557 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbd6806c6c0 msgr2=0x7fbd680b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:38.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.677+0000 7fbd6e48f640 1 --2- 172.21.15.7:0/2792588557 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbd6806c6c0 0x7fbd680b5c90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbd60009d90 tx=0x7fbd6002a6f0 comp rx=0 tx=0).stop 2024-04-25T09:58:38.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.678+0000 7fbd6e48f640 1 -- 172.21.15.7:0/2792588557 shutdown_connections 2024-04-25T09:58:38.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.678+0000 7fbd6e48f640 1 --2- 172.21.15.7:0/2792588557 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbd6806c6c0 0x7fbd680b5c90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:38.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.678+0000 7fbd6e48f640 1 --2- 172.21.15.7:0/2792588557 >> v2:172.21.15.55:3300/0 conn(0x7fbd6815dd00 0x7fbd680b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:38.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.678+0000 7fbd6e48f640 1 -- 172.21.15.7:0/2792588557 >> 172.21.15.7:0/2792588557 conn(0x7fbd680d07b0 msgr2=0x7fbd680d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:38.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.678+0000 7fbd6e48f640 1 -- 172.21.15.7:0/2792588557 shutdown_connections 2024-04-25T09:58:38.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.678+0000 7fbd6e48f640 1 -- 172.21.15.7:0/2792588557 wait complete. 2024-04-25T09:58:38.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.679+0000 7fbd6e48f640 1 Processor -- start 2024-04-25T09:58:38.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.679+0000 7fbd6e48f640 1 -- start start 2024-04-25T09:58:38.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.680+0000 7fbd6e48f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd6806c6c0 0x7fbd680cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:38.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.680+0000 7fbd6e48f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd680b6a40 0x7fbd6815f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:38.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.680+0000 7fbd6e48f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbd6815dd00 0x7fbd6815f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:38.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.680+0000 7fbd6e48f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd680d2780 con 0x7fbd6806c6c0 2024-04-25T09:58:38.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.680+0000 7fbd6e48f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd680d2260 con 0x7fbd680b6a40 2024-04-25T09:58:38.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.680+0000 7fbd6e48f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd680d2900 con 0x7fbd6815dd00 2024-04-25T09:58:38.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.680+0000 7fbd67fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd6806c6c0 0x7fbd680cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:38.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.680+0000 7fbd67fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd6806c6c0 0x7fbd680cb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48716/0 (socket says 172.21.15.7:48716) 2024-04-25T09:58:38.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.680+0000 7fbd67fff640 1 -- 172.21.15.7:0/77455624 learned_addr learned my addr 172.21.15.7:0/77455624 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:38.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.680+0000 7fbd677fe640 1 --2- 172.21.15.7:0/77455624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd680b6a40 0x7fbd6815f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:38.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.680+0000 7fbd6ca2c640 1 --2- 172.21.15.7:0/77455624 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbd6815dd00 0x7fbd6815f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:38.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.680+0000 7fbd67fff640 1 -- 172.21.15.7:0/77455624 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbd6815dd00 msgr2=0x7fbd6815f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:38.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.680+0000 7fbd67fff640 1 --2- 172.21.15.7:0/77455624 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbd6815dd00 0x7fbd6815f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:38.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.680+0000 7fbd67fff640 1 -- 172.21.15.7:0/77455624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd680b6a40 msgr2=0x7fbd6815f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:38.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.680+0000 7fbd67fff640 1 --2- 172.21.15.7:0/77455624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd680b6a40 0x7fbd6815f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:38.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.680+0000 7fbd67fff640 1 -- 172.21.15.7:0/77455624 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6815e400 con 0x7fbd6806c6c0 2024-04-25T09:58:38.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.680+0000 7fbd67fff640 1 --2- 172.21.15.7:0/77455624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd6806c6c0 0x7fbd680cb9d0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fbd5000e8a0 tx=0x7fbd5000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:38.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.680+0000 7fbd64ff9640 1 -- 172.21.15.7:0/77455624 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd50017070 con 0x7fbd6806c6c0 2024-04-25T09:58:38.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.680+0000 7fbd64ff9640 1 -- 172.21.15.7:0/77455624 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5000c940 con 0x7fbd6806c6c0 2024-04-25T09:58:38.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.680+0000 7fbd6e48f640 1 -- 172.21.15.7:0/77455624 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd6815e6e0 con 0x7fbd6806c6c0 2024-04-25T09:58:38.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.680+0000 7fbd64ff9640 1 -- 172.21.15.7:0/77455624 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5000cd30 con 0x7fbd6806c6c0 2024-04-25T09:58:38.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.681+0000 7fbd6e48f640 1 -- 172.21.15.7:0/77455624 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd6815eca0 con 0x7fbd6806c6c0 2024-04-25T09:58:38.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.681+0000 7fbd6e48f640 1 -- 172.21.15.7:0/77455624 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd68068fd0 con 0x7fbd6806c6c0 2024-04-25T09:58:38.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.682+0000 7fbd64ff9640 1 -- 172.21.15.7:0/77455624 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbd5001a070 con 0x7fbd6806c6c0 2024-04-25T09:58:38.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.682+0000 7fbd64ff9640 1 --2- 172.21.15.7:0/77455624 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbd4806b500 0x7fbd4806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:38.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.682+0000 7fbd64ff9640 1 -- 172.21.15.7:0/77455624 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fbd5008a230 con 0x7fbd6806c6c0 2024-04-25T09:58:38.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.682+0000 7fbd677fe640 1 --2- 172.21.15.7:0/77455624 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbd4806b500 0x7fbd4806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:38.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.683+0000 7fbd677fe640 1 --2- 172.21.15.7:0/77455624 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbd4806b500 0x7fbd4806d9c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fbd680ca220 tx=0x7fbd58009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:38.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.687+0000 7fbd64ff9640 1 -- 172.21.15.7:0/77455624 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbd500592b0 con 0x7fbd6806c6c0 2024-04-25T09:58:38.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:38.944+0000 7fbd6e48f640 1 -- 172.21.15.7:0/77455624 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) v1 -- 0x7fbd68161090 con 0x7fbd6806c6c0 2024-04-25T09:58:39.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.231+0000 7fbd64ff9640 1 -- 172.21.15.7:0/77455624 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v224) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbd50058bb0 con 0x7fbd6806c6c0 2024-04-25T09:58:39.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.233+0000 7fbd6e48f640 1 -- 172.21.15.7:0/77455624 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbd4806b500 msgr2=0x7fbd4806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:39.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.233+0000 7fbd6e48f640 1 --2- 172.21.15.7:0/77455624 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbd4806b500 0x7fbd4806d9c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fbd680ca220 tx=0x7fbd58009040 comp rx=0 tx=0).stop 2024-04-25T09:58:39.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.233+0000 7fbd6e48f640 1 -- 172.21.15.7:0/77455624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd6806c6c0 msgr2=0x7fbd680cb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:39.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.233+0000 7fbd6e48f640 1 --2- 172.21.15.7:0/77455624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd6806c6c0 0x7fbd680cb9d0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fbd5000e8a0 tx=0x7fbd5000ed60 comp rx=0 tx=0).stop 2024-04-25T09:58:39.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.233+0000 7fbd6e48f640 1 -- 172.21.15.7:0/77455624 shutdown_connections 2024-04-25T09:58:39.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.233+0000 7fbd6e48f640 1 --2- 172.21.15.7:0/77455624 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbd4806b500 0x7fbd4806d9c0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:39.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.233+0000 7fbd6e48f640 1 --2- 172.21.15.7:0/77455624 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbd6815dd00 0x7fbd6815f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:39.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.233+0000 7fbd6e48f640 1 --2- 172.21.15.7:0/77455624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd680b6a40 0x7fbd6815f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:39.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.233+0000 7fbd6e48f640 1 --2- 172.21.15.7:0/77455624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd6806c6c0 0x7fbd680cb9d0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:39.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.233+0000 7fbd6e48f640 1 -- 172.21.15.7:0/77455624 >> 172.21.15.7:0/77455624 conn(0x7fbd680d07b0 msgr2=0x7fbd6815bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:39.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.233+0000 7fbd6e48f640 1 -- 172.21.15.7:0/77455624 shutdown_connections 2024-04-25T09:58:39.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.233+0000 7fbd6e48f640 1 -- 172.21.15.7:0/77455624 wait complete. 2024-04-25T09:58:39.248 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-04-25T09:58:39.249 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_dentry_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-04-25T09:58:39.249 INFO:tasks.cephfs_test_runner:test_health_status_after_dentry_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T09:58:39.249 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:58:39.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.347+0000 7f2ca9683640 1 Processor -- start 2024-04-25T09:58:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.348+0000 7f2ca9683640 1 -- start start 2024-04-25T09:58:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.348+0000 7f2ca9683640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2ca40d0330 0x7f2ca40999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.348+0000 7f2ca9683640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ca4099f30 0x7f2ca40b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.348+0000 7f2ca9683640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca40ccbc0 con 0x7f2ca415b8e0 2024-04-25T09:58:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.348+0000 7f2ca9683640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ca409a380 con 0x7f2ca40d0330 2024-04-25T09:58:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.348+0000 7f2ca9683640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca40cd7d0 con 0x7f2ca4099f30 2024-04-25T09:58:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.349+0000 7f2ca37fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ca4099f30 0x7f2ca40b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.349+0000 7f2ca27fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2ca40d0330 0x7f2ca40999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.349+0000 7f2ca27fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2ca40d0330 0x7f2ca40999f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:57840/0 (socket says 172.21.15.7:57840) 2024-04-25T09:58:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.349+0000 7f2ca37fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ca4099f30 0x7f2ca40b0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:33518/0 (socket says 172.21.15.7:33518) 2024-04-25T09:58:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.349+0000 7f2ca27fc640 1 -- 172.21.15.7:0/2074244226 learned_addr learned my addr 172.21.15.7:0/2074244226 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.349+0000 7f2ca2ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2ca415b8e0 0x7f2ca40cc300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:57234/0 (socket says 172.21.15.7:57234) 2024-04-25T09:58:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.349+0000 7f2ca37fe640 1 -- 172.21.15.7:0/2074244226 >> v2:172.21.15.55:3300/0 conn(0x7f2ca40d0330 msgr2=0x7f2ca40999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.349+0000 7f2ca37fe640 1 --2- 172.21.15.7:0/2074244226 >> v2:172.21.15.55:3300/0 conn(0x7f2ca40d0330 0x7f2ca40999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.349+0000 7f2ca37fe640 1 -- 172.21.15.7:0/2074244226 >> v1:172.21.15.55:6789/0 conn(0x7f2ca415b8e0 legacy=0x7f2ca40cc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.349+0000 7f2ca37fe640 1 -- 172.21.15.7:0/2074244226 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca40ccea0 con 0x7f2ca4099f30 2024-04-25T09:58:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.349+0000 7f2ca27fc640 1 --2- 172.21.15.7:0/2074244226 >> v2:172.21.15.55:3300/0 conn(0x7f2ca40d0330 0x7f2ca40999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:58:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.350+0000 7f2ca37fe640 1 --2- 172.21.15.7:0/2074244226 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ca4099f30 0x7f2ca40b0a50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2c94009d90 tx=0x7f2c9402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1985775f2caabbf0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.350+0000 7f2ca1ffb640 1 -- 172.21.15.7:0/2074244226 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c94007740 con 0x7f2ca4099f30 2024-04-25T09:58:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.350+0000 7f2ca1ffb640 1 -- 172.21.15.7:0/2074244226 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c940078e0 con 0x7f2ca4099f30 2024-04-25T09:58:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.350+0000 7f2ca1ffb640 1 -- 172.21.15.7:0/2074244226 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c94007cb0 con 0x7f2ca4099f30 2024-04-25T09:58:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.351+0000 7f2ca9683640 1 -- 172.21.15.7:0/2074244226 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ca4099f30 msgr2=0x7f2ca40b0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.351+0000 7f2ca9683640 1 --2- 172.21.15.7:0/2074244226 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ca4099f30 0x7f2ca40b0a50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2c94009d90 tx=0x7f2c9402a660 comp rx=0 tx=0).stop 2024-04-25T09:58:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.351+0000 7f2ca9683640 1 -- 172.21.15.7:0/2074244226 shutdown_connections 2024-04-25T09:58:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.351+0000 7f2ca9683640 1 --2- 172.21.15.7:0/2074244226 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ca4099f30 0x7f2ca40b0a50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.351+0000 7f2ca9683640 1 --2- 172.21.15.7:0/2074244226 >> v2:172.21.15.55:3300/0 conn(0x7f2ca40d0330 0x7f2ca40999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.351+0000 7f2ca9683640 1 -- 172.21.15.7:0/2074244226 >> 172.21.15.7:0/2074244226 conn(0x7f2ca40b3130 msgr2=0x7f2ca40b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.351+0000 7f2ca9683640 1 -- 172.21.15.7:0/2074244226 shutdown_connections 2024-04-25T09:58:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.351+0000 7f2ca9683640 1 -- 172.21.15.7:0/2074244226 wait complete. 2024-04-25T09:58:39.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.352+0000 7f2ca9683640 1 Processor -- start 2024-04-25T09:58:39.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.352+0000 7f2ca9683640 1 -- start start 2024-04-25T09:58:39.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.353+0000 7f2ca9683640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ca4099f30 0x7f2ca415a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:39.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.353+0000 7f2ca9683640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ca40d0330 0x7f2ca409ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:39.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.353+0000 7f2ca9683640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ca415b8e0 0x7f2ca4070400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:39.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.353+0000 7f2ca9683640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca40cd460 con 0x7f2ca40d0330 2024-04-25T09:58:39.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.353+0000 7f2ca9683640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca40d07c0 con 0x7f2ca4099f30 2024-04-25T09:58:39.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.353+0000 7f2ca9683640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca415bcc0 con 0x7f2ca415b8e0 2024-04-25T09:58:39.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.353+0000 7f2ca27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ca40d0330 0x7f2ca409ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:39.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.353+0000 7f2ca27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ca40d0330 0x7f2ca409ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48728/0 (socket says 172.21.15.7:48728) 2024-04-25T09:58:39.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.353+0000 7f2ca27fc640 1 -- 172.21.15.7:0/925783103 learned_addr learned my addr 172.21.15.7:0/925783103 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:39.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.353+0000 7f2ca2ffd640 1 --2- 172.21.15.7:0/925783103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ca4099f30 0x7f2ca415a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:39.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.353+0000 7f2ca37fe640 1 --2- 172.21.15.7:0/925783103 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ca415b8e0 0x7f2ca4070400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.353+0000 7f2ca27fc640 1 -- 172.21.15.7:0/925783103 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ca415b8e0 msgr2=0x7f2ca4070400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.353+0000 7f2ca27fc640 1 --2- 172.21.15.7:0/925783103 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ca415b8e0 0x7f2ca4070400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.353+0000 7f2ca27fc640 1 -- 172.21.15.7:0/925783103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ca4099f30 msgr2=0x7f2ca415a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.353+0000 7f2ca27fc640 1 --2- 172.21.15.7:0/925783103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ca4099f30 0x7f2ca415a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.353+0000 7f2ca27fc640 1 -- 172.21.15.7:0/925783103 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca40c9400 con 0x7f2ca40d0330 2024-04-25T09:58:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.354+0000 7f2ca27fc640 1 --2- 172.21.15.7:0/925783103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ca40d0330 0x7f2ca409ed20 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c00ea00 tx=0x7f2c8c00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.354+0000 7f2c9b7fe640 1 -- 172.21.15.7:0/925783103 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c017070 con 0x7f2ca40d0330 2024-04-25T09:58:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.354+0000 7f2c9b7fe640 1 -- 172.21.15.7:0/925783103 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8c00ca60 con 0x7f2ca40d0330 2024-04-25T09:58:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.354+0000 7f2ca9683640 1 -- 172.21.15.7:0/925783103 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca40c96e0 con 0x7f2ca40d0330 2024-04-25T09:58:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.354+0000 7f2c9b7fe640 1 -- 172.21.15.7:0/925783103 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c00ce10 con 0x7f2ca40d0330 2024-04-25T09:58:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.354+0000 7f2ca9683640 1 -- 172.21.15.7:0/925783103 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca40b5810 con 0x7f2ca40d0330 2024-04-25T09:58:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.355+0000 7f2ca9683640 1 -- 172.21.15.7:0/925783103 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca4068fd0 con 0x7f2ca40d0330 2024-04-25T09:58:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.356+0000 7f2c9b7fe640 1 -- 172.21.15.7:0/925783103 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2c8c01a070 con 0x7f2ca40d0330 2024-04-25T09:58:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.356+0000 7f2c9b7fe640 1 --2- 172.21.15.7:0/925783103 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2c8406b500 0x7f2c8406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.356+0000 7f2c9b7fe640 1 -- 172.21.15.7:0/925783103 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f2c8c08a2f0 con 0x7f2ca40d0330 2024-04-25T09:58:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.356+0000 7f2ca2ffd640 1 --2- 172.21.15.7:0/925783103 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2c8406b500 0x7f2c8406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.356+0000 7f2ca2ffd640 1 --2- 172.21.15.7:0/925783103 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2c8406b500 0x7f2c8406d9c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c000f60 tx=0x7f2c9c007e20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.360+0000 7f2c9b7fe640 1 -- 172.21.15.7:0/925783103 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2c8c058c90 con 0x7f2ca40d0330 2024-04-25T09:58:39.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.543+0000 7f2ca9683640 1 -- 172.21.15.7:0/925783103 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ca40b0810 con 0x7f2ca40d0330 2024-04-25T09:58:39.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.544+0000 7f2c9b7fe640 1 -- 172.21.15.7:0/925783103 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+13196 (secure 0 0 0) 0x7f2c8c05cd30 con 0x7f2ca40d0330 2024-04-25T09:58:39.548 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:58:39.549 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":67,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:58:38.224715+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6836/3057688863":"2024-04-26T09:58:35.105553+0000","172.21.15.7:6834/3057688863":"2024-04-26T09:58:35.105553+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:58:39.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.546+0000 7f2ca9683640 1 -- 172.21.15.7:0/925783103 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2c8406b500 msgr2=0x7f2c8406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:39.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.546+0000 7f2ca9683640 1 --2- 172.21.15.7:0/925783103 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2c8406b500 0x7f2c8406d9c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c000f60 tx=0x7f2c9c007e20 comp rx=0 tx=0).stop 2024-04-25T09:58:39.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.546+0000 7f2ca9683640 1 -- 172.21.15.7:0/925783103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ca40d0330 msgr2=0x7f2ca409ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:39.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.546+0000 7f2ca9683640 1 --2- 172.21.15.7:0/925783103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ca40d0330 0x7f2ca409ed20 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c00ea00 tx=0x7f2c8c00eec0 comp rx=0 tx=0).stop 2024-04-25T09:58:39.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.546+0000 7f2ca9683640 1 -- 172.21.15.7:0/925783103 shutdown_connections 2024-04-25T09:58:39.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.546+0000 7f2ca9683640 1 --2- 172.21.15.7:0/925783103 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2c8406b500 0x7f2c8406d9c0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:39.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.546+0000 7f2ca9683640 1 --2- 172.21.15.7:0/925783103 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ca415b8e0 0x7f2ca4070400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:39.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.546+0000 7f2ca9683640 1 --2- 172.21.15.7:0/925783103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ca40d0330 0x7f2ca409ed20 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:39.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.546+0000 7f2ca9683640 1 --2- 172.21.15.7:0/925783103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ca4099f30 0x7f2ca415a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:39.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.546+0000 7f2ca9683640 1 -- 172.21.15.7:0/925783103 >> 172.21.15.7:0/925783103 conn(0x7f2ca40b3130 msgr2=0x7f2ca40b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:39.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.547+0000 7f2ca9683640 1 -- 172.21.15.7:0/925783103 shutdown_connections 2024-04-25T09:58:39.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.547+0000 7f2ca9683640 1 -- 172.21.15.7:0/925783103 wait complete. 2024-04-25T09:58:39.561 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:58:39.562 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:58:39.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.662+0000 7f59e2f9d640 1 Processor -- start 2024-04-25T09:58:39.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.662+0000 7f59e2f9d640 1 -- start start 2024-04-25T09:58:39.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.663+0000 7f59e2f9d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59dc0cda20 0x7f59dc0cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:39.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.663+0000 7f59e2f9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f59dc09a100 0x7f59dc15d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:39.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.663+0000 7f59e2f9d640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59dc0d02f0 con 0x7f59dc06bf10 2024-04-25T09:58:39.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.663+0000 7f59e2f9d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59dc0cde00 con 0x7f59dc09a100 2024-04-25T09:58:39.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.663+0000 7f59e2f9d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0d05d0 con 0x7f59dc0cda20 2024-04-25T09:58:39.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.663+0000 7f59dbfff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f59dc06bf10 0x7f59dc0999f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45750/0 (socket says 172.21.15.7:45750) 2024-04-25T09:58:39.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.663+0000 7f59dbfff640 1 -- 172.21.15.7:0/1814784086 learned_addr learned my addr 172.21.15.7:0/1814784086 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:39.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.664+0000 7f59e0d39640 1 --2- 172.21.15.7:0/1814784086 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59dc0cda20 0x7f59dc0cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:39.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.664+0000 7f59e153a640 1 --2- 172.21.15.7:0/1814784086 >> v2:172.21.15.55:3300/0 conn(0x7f59dc09a100 0x7f59dc15d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:39.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.664+0000 7f59db7fe640 1 -- 172.21.15.7:0/1814784086 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2548421607 0 0) 0x7f59dc0d02f0 con 0x7f59dc06bf10 2024-04-25T09:58:39.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.664+0000 7f59db7fe640 1 -- 172.21.15.7:0/1814784086 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59c4003520 con 0x7f59dc06bf10 2024-04-25T09:58:39.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.664+0000 7f59db7fe640 1 -- 172.21.15.7:0/1814784086 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4074695455 0 0) 0x7f59c4003520 con 0x7f59dc06bf10 2024-04-25T09:58:39.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.664+0000 7f59db7fe640 1 -- 172.21.15.7:0/1814784086 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59dc0cda20 msgr2=0x7f59dc0cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:39.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.664+0000 7f59db7fe640 1 --2- 172.21.15.7:0/1814784086 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59dc0cda20 0x7f59dc0cf9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:39.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.664+0000 7f59db7fe640 1 -- 172.21.15.7:0/1814784086 >> v2:172.21.15.55:3300/0 conn(0x7f59dc09a100 msgr2=0x7f59dc15d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:39.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.664+0000 7f59db7fe640 1 --2- 172.21.15.7:0/1814784086 >> v2:172.21.15.55:3300/0 conn(0x7f59dc09a100 0x7f59dc15d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:39.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.664+0000 7f59db7fe640 1 -- 172.21.15.7:0/1814784086 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59dc0d08b0 con 0x7f59dc06bf10 2024-04-25T09:58:39.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.664+0000 7f59db7fe640 1 -- 172.21.15.7:0/1814784086 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f59d0001670 con 0x7f59dc06bf10 2024-04-25T09:58:39.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.664+0000 7f59db7fe640 1 -- 172.21.15.7:0/1814784086 >> v1:172.21.15.7:6789/0 conn(0x7f59dc06bf10 legacy=0x7f59dc0999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:39.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.664+0000 7f59db7fe640 1 --2- 172.21.15.7:0/1814784086 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c40039b0 0x7f59c4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:39.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.664+0000 7f59db7fe640 1 --2- 172.21.15.7:0/1814784086 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59dc0cda20 0x7f59c4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:39.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.664+0000 7f59db7fe640 1 --2- 172.21.15.7:0/1814784086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c4004d40 0x7f59c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:39.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.664+0000 7f59db7fe640 1 -- 172.21.15.7:0/1814784086 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0cde00 con 0x7f59c40039b0 2024-04-25T09:58:39.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.664+0000 7f59db7fe640 1 -- 172.21.15.7:0/1814784086 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0d05d0 con 0x7f59c4004d40 2024-04-25T09:58:39.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.664+0000 7f59db7fe640 1 -- 172.21.15.7:0/1814784086 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c400b9c0 con 0x7f59dc0cda20 2024-04-25T09:58:39.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.664+0000 7f59e0d39640 1 --2- 172.21.15.7:0/1814784086 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c40039b0 0x7f59c4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:39.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.664+0000 7f59dbfff640 1 --2- 172.21.15.7:0/1814784086 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59dc0cda20 0x7f59c4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:39.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.664+0000 7f59e153a640 1 --2- 172.21.15.7:0/1814784086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c4004d40 0x7f59c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:39.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.664+0000 7f59e0d39640 1 -- 172.21.15.7:0/1814784086 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59dc0cda20 msgr2=0x7f59c4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:39.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.664+0000 7f59e0d39640 1 --2- 172.21.15.7:0/1814784086 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59dc0cda20 0x7f59c4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:39.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.664+0000 7f59e0d39640 1 -- 172.21.15.7:0/1814784086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c4004d40 msgr2=0x7f59c40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:39.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.664+0000 7f59e0d39640 1 --2- 172.21.15.7:0/1814784086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c4004d40 0x7f59c40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:39.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.664+0000 7f59e0d39640 1 -- 172.21.15.7:0/1814784086 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c4003520 con 0x7f59c40039b0 2024-04-25T09:58:39.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.665+0000 7f59e0d39640 1 --2- 172.21.15.7:0/1814784086 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c40039b0 0x7f59c4003dd0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f59cc009ac0 tx=0x7f59c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e00f74baad4c6fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:39.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.665+0000 7f59db7fe640 1 -- 172.21.15.7:0/1814784086 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59cc036070 con 0x7f59c40039b0 2024-04-25T09:58:39.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.665+0000 7f59db7fe640 1 -- 172.21.15.7:0/1814784086 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59cc031400 con 0x7f59c40039b0 2024-04-25T09:58:39.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.665+0000 7f59db7fe640 1 -- 172.21.15.7:0/1814784086 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59cc009690 con 0x7f59c40039b0 2024-04-25T09:58:39.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.666+0000 7f59e2f9d640 1 -- 172.21.15.7:0/1814784086 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c40039b0 msgr2=0x7f59c4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:39.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.666+0000 7f59e2f9d640 1 --2- 172.21.15.7:0/1814784086 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59c40039b0 0x7f59c4003dd0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f59cc009ac0 tx=0x7f59c4005830 comp rx=0 tx=0).stop 2024-04-25T09:58:39.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.666+0000 7f59e153a640 1 -- 172.21.15.7:0/1814784086 reap_dead start 2024-04-25T09:58:39.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.666+0000 7f59e2f9d640 1 -- 172.21.15.7:0/1814784086 shutdown_connections 2024-04-25T09:58:39.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.666+0000 7f59e2f9d640 1 -- 172.21.15.7:0/1814784086 >> 172.21.15.7:0/1814784086 conn(0x7f59dc0b3110 msgr2=0x7f59dc0b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:39.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.666+0000 7f59e2f9d640 1 -- 172.21.15.7:0/1814784086 shutdown_connections 2024-04-25T09:58:39.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.666+0000 7f59e2f9d640 1 -- 172.21.15.7:0/1814784086 wait complete. 2024-04-25T09:58:39.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.667+0000 7f59e2f9d640 1 Processor -- start 2024-04-25T09:58:39.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.667+0000 7f59e2f9d640 1 -- start start 2024-04-25T09:58:39.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.668+0000 7f59e2f9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c40039b0 0x7f59dc1f48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:39.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.668+0000 7f59e2f9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59dc1f3810 0x7f59dc15e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:39.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.668+0000 7f59e2f9d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59dc0b4240 0x7f59dc0b1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:39.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.668+0000 7f59e2f9d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0cf9d0 con 0x7f59dc1f3810 2024-04-25T09:58:39.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.668+0000 7f59e2f9d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0d0e70 con 0x7f59c40039b0 2024-04-25T09:58:39.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.668+0000 7f59e2f9d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0cfb50 con 0x7f59dc0b4240 2024-04-25T09:58:39.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.668+0000 7f59dbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59dc1f3810 0x7f59dc15e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:39.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.668+0000 7f59dbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59dc1f3810 0x7f59dc15e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48740/0 (socket says 172.21.15.7:48740) 2024-04-25T09:58:39.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.668+0000 7f59dbfff640 1 -- 172.21.15.7:0/1561675102 learned_addr learned my addr 172.21.15.7:0/1561675102 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:39.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.668+0000 7f59e0d39640 1 --2- 172.21.15.7:0/1561675102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c40039b0 0x7f59dc1f48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:39.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.668+0000 7f59e153a640 1 --2- 172.21.15.7:0/1561675102 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59dc0b4240 0x7f59dc0b1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:39.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.668+0000 7f59dbfff640 1 -- 172.21.15.7:0/1561675102 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59dc0b4240 msgr2=0x7f59dc0b1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:39.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.668+0000 7f59dbfff640 1 --2- 172.21.15.7:0/1561675102 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59dc0b4240 0x7f59dc0b1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:39.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.668+0000 7f59dbfff640 1 -- 172.21.15.7:0/1561675102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c40039b0 msgr2=0x7f59dc1f48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:39.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.668+0000 7f59dbfff640 1 --2- 172.21.15.7:0/1561675102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c40039b0 0x7f59dc1f48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:39.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.668+0000 7f59dbfff640 1 -- 172.21.15.7:0/1561675102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59dc0b4b40 con 0x7f59dc1f3810 2024-04-25T09:58:39.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.668+0000 7f59e153a640 1 --2- 172.21.15.7:0/1561675102 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59dc0b4240 0x7f59dc0b1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:58:39.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.668+0000 7f59e0d39640 1 --2- 172.21.15.7:0/1561675102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c40039b0 0x7f59dc1f48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:58:39.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.669+0000 7f59dbfff640 1 --2- 172.21.15.7:0/1561675102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59dc1f3810 0x7f59dc15e510 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f59d0007310 tx=0x7f59d00077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:39.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.669+0000 7f59d97fa640 1 -- 172.21.15.7:0/1561675102 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d000f960 con 0x7f59dc1f3810 2024-04-25T09:58:39.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.669+0000 7f59d97fa640 1 -- 172.21.15.7:0/1561675102 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d0018070 con 0x7f59dc1f3810 2024-04-25T09:58:39.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.669+0000 7f59e2f9d640 1 -- 172.21.15.7:0/1561675102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59dc0b4e20 con 0x7f59dc1f3810 2024-04-25T09:58:39.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.669+0000 7f59d97fa640 1 -- 172.21.15.7:0/1561675102 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d000fd80 con 0x7f59dc1f3810 2024-04-25T09:58:39.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.669+0000 7f59e2f9d640 1 -- 172.21.15.7:0/1561675102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59dc0c5750 con 0x7f59dc1f3810 2024-04-25T09:58:39.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.670+0000 7f59e2f9d640 1 -- 172.21.15.7:0/1561675102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59dc068f60 con 0x7f59dc1f3810 2024-04-25T09:58:39.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.670+0000 7f59d97fa640 1 -- 172.21.15.7:0/1561675102 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f59d001d460 con 0x7f59dc1f3810 2024-04-25T09:58:39.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.671+0000 7f59d97fa640 1 --2- 172.21.15.7:0/1561675102 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f59c806b4d0 0x7f59c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:39.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.671+0000 7f59d97fa640 1 -- 172.21.15.7:0/1561675102 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f59d008a210 con 0x7f59dc1f3810 2024-04-25T09:58:39.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.671+0000 7f59e0d39640 1 --2- 172.21.15.7:0/1561675102 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f59c806b4d0 0x7f59c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:39.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.671+0000 7f59e0d39640 1 --2- 172.21.15.7:0/1561675102 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f59c806b4d0 0x7f59c806d990 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f59cc033000 tx=0x7f59cc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:39.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.675+0000 7f59d97fa640 1 -- 172.21.15.7:0/1561675102 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f59d0059200 con 0x7f59dc1f3810 2024-04-25T09:58:39.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.854+0000 7f59e2f9d640 1 -- 172.21.15.7:0/1561675102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f59dc070e50 con 0x7f59dc1f3810 2024-04-25T09:58:39.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.855+0000 7f59d97fa640 1 -- 172.21.15.7:0/1561675102 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) v1 ==== 93+0+10 (secure 0 0 0) 0x7f59d0058b00 con 0x7f59dc1f3810 2024-04-25T09:58:39.859 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T09:58:39.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.857+0000 7f59e2f9d640 1 -- 172.21.15.7:0/1561675102 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f59c806b4d0 msgr2=0x7f59c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:39.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.857+0000 7f59e2f9d640 1 --2- 172.21.15.7:0/1561675102 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f59c806b4d0 0x7f59c806d990 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f59cc033000 tx=0x7f59cc008030 comp rx=0 tx=0).stop 2024-04-25T09:58:39.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.857+0000 7f59e2f9d640 1 -- 172.21.15.7:0/1561675102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59dc1f3810 msgr2=0x7f59dc15e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:39.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.857+0000 7f59e2f9d640 1 --2- 172.21.15.7:0/1561675102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59dc1f3810 0x7f59dc15e510 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f59d0007310 tx=0x7f59d00077d0 comp rx=0 tx=0).stop 2024-04-25T09:58:39.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.857+0000 7f59e2f9d640 1 -- 172.21.15.7:0/1561675102 shutdown_connections 2024-04-25T09:58:39.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.857+0000 7f59e2f9d640 1 --2- 172.21.15.7:0/1561675102 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f59c806b4d0 0x7f59c806d990 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:39.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.857+0000 7f59e2f9d640 1 --2- 172.21.15.7:0/1561675102 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59dc0b4240 0x7f59dc0b1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:39.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.857+0000 7f59e2f9d640 1 --2- 172.21.15.7:0/1561675102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59dc1f3810 0x7f59dc15e510 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:39.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.857+0000 7f59e2f9d640 1 --2- 172.21.15.7:0/1561675102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c40039b0 0x7f59dc1f48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:39.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.857+0000 7f59e2f9d640 1 -- 172.21.15.7:0/1561675102 >> 172.21.15.7:0/1561675102 conn(0x7f59dc0b3110 msgr2=0x7f59dc06fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:39.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.857+0000 7f59e2f9d640 1 -- 172.21.15.7:0/1561675102 shutdown_connections 2024-04-25T09:58:39.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.857+0000 7f59e2f9d640 1 -- 172.21.15.7:0/1561675102 wait complete. 2024-04-25T09:58:39.872 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair' 2024-04-25T09:58:39.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.970+0000 7f1afc06b640 1 Processor -- start 2024-04-25T09:58:39.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.970+0000 7f1afc06b640 1 -- start start 2024-04-25T09:58:39.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.971+0000 7f1afc06b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1af415dd00 0x7f1af40b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:39.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.971+0000 7f1afc06b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1af406c6c0 0x7f1af40b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:39.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.971+0000 7f1afc06b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1af406cd00 con 0x7f1af40b6a40 2024-04-25T09:58:39.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.971+0000 7f1afc06b640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af415e0e0 con 0x7f1af406c6c0 2024-04-25T09:58:39.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.971+0000 7f1afc06b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af406cfe0 con 0x7f1af415dd00 2024-04-25T09:58:39.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.971+0000 7f1afa608640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1af406c6c0 0x7f1af40b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:39.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.971+0000 7f1afa608640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1af406c6c0 0x7f1af40b5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36626/0 (socket says 172.21.15.7:36626) 2024-04-25T09:58:39.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.971+0000 7f1afa608640 1 -- 172.21.15.7:0/3584713536 learned_addr learned my addr 172.21.15.7:0/3584713536 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:39.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.971+0000 7f1afa608640 1 -- 172.21.15.7:0/3584713536 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1af415dd00 msgr2=0x7f1af40b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:39.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.971+0000 7f1af9e07640 1 --2- 172.21.15.7:0/3584713536 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1af415dd00 0x7f1af40b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:39.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.971+0000 7f1afa608640 1 --2- 172.21.15.7:0/3584713536 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1af415dd00 0x7f1af40b5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:39.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.971+0000 7f1afa608640 1 -- 172.21.15.7:0/3584713536 >> v1:172.21.15.55:6789/0 conn(0x7f1af40b6a40 legacy=0x7f1af406bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:39.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.971+0000 7f1afa608640 1 -- 172.21.15.7:0/3584713536 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af40d1ca0 con 0x7f1af406c6c0 2024-04-25T09:58:39.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.972+0000 7f1afa608640 1 --2- 172.21.15.7:0/3584713536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1af406c6c0 0x7f1af40b5c90 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f1aec009870 tx=0x7f1aec02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476e854c3429bbd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:39.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.972+0000 7f1af8e05640 1 -- 172.21.15.7:0/3584713536 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec037070 con 0x7f1af406c6c0 2024-04-25T09:58:39.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.972+0000 7f1af8e05640 1 -- 172.21.15.7:0/3584713536 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aec032440 con 0x7f1af406c6c0 2024-04-25T09:58:39.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.972+0000 7f1af8e05640 1 -- 172.21.15.7:0/3584713536 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec032810 con 0x7f1af406c6c0 2024-04-25T09:58:39.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.973+0000 7f1afc06b640 1 -- 172.21.15.7:0/3584713536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1af406c6c0 msgr2=0x7f1af40b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:39.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.973+0000 7f1afc06b640 1 --2- 172.21.15.7:0/3584713536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1af406c6c0 0x7f1af40b5c90 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f1aec009870 tx=0x7f1aec02a2a0 comp rx=0 tx=0).stop 2024-04-25T09:58:39.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.973+0000 7f1afc06b640 1 -- 172.21.15.7:0/3584713536 shutdown_connections 2024-04-25T09:58:39.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.973+0000 7f1afc06b640 1 --2- 172.21.15.7:0/3584713536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1af406c6c0 0x7f1af40b5c90 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:39.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.973+0000 7f1afc06b640 1 --2- 172.21.15.7:0/3584713536 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1af415dd00 0x7f1af40b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:39.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.973+0000 7f1afc06b640 1 -- 172.21.15.7:0/3584713536 >> 172.21.15.7:0/3584713536 conn(0x7f1af40d07b0 msgr2=0x7f1af40d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:39.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.973+0000 7f1afc06b640 1 -- 172.21.15.7:0/3584713536 shutdown_connections 2024-04-25T09:58:39.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.973+0000 7f1afc06b640 1 -- 172.21.15.7:0/3584713536 wait complete. 2024-04-25T09:58:39.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.974+0000 7f1afc06b640 1 Processor -- start 2024-04-25T09:58:39.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.974+0000 7f1afc06b640 1 -- start start 2024-04-25T09:58:39.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.975+0000 7f1afc06b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1af406c6c0 0x7f1af40c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:39.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.975+0000 7f1afc06b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1af40b6a40 0x7f1af41f3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:39.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.975+0000 7f1afc06b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1af415dd00 0x7f1af41f4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:39.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.975+0000 7f1afc06b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af40d2780 con 0x7f1af406c6c0 2024-04-25T09:58:39.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.975+0000 7f1afc06b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af40d2260 con 0x7f1af40b6a40 2024-04-25T09:58:39.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.975+0000 7f1afc06b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af40d2900 con 0x7f1af415dd00 2024-04-25T09:58:39.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.975+0000 7f1af9e07640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1af406c6c0 0x7f1af40c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:39.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.975+0000 7f1af9e07640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1af406c6c0 0x7f1af40c9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36638/0 (socket says 172.21.15.7:36638) 2024-04-25T09:58:39.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.975+0000 7f1af9e07640 1 -- 172.21.15.7:0/3496724013 learned_addr learned my addr 172.21.15.7:0/3496724013 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:39.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.975+0000 7f1af9e07640 1 -- 172.21.15.7:0/3496724013 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1af415dd00 msgr2=0x7f1af41f4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:39.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.975+0000 7f1af9e07640 1 --2- 172.21.15.7:0/3496724013 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1af415dd00 0x7f1af41f4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:39.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.975+0000 7f1af9e07640 1 -- 172.21.15.7:0/3496724013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1af40b6a40 msgr2=0x7f1af41f3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:39.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.975+0000 7f1af9e07640 1 --2- 172.21.15.7:0/3496724013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1af40b6a40 0x7f1af41f3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:39.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.975+0000 7f1af9e07640 1 -- 172.21.15.7:0/3496724013 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af41f4670 con 0x7f1af406c6c0 2024-04-25T09:58:39.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.975+0000 7f1af9e07640 1 --2- 172.21.15.7:0/3496724013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1af406c6c0 0x7f1af40c9ec0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f1af000cd00 tx=0x7f1af000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:39.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.975+0000 7f1aea7fc640 1 -- 172.21.15.7:0/3496724013 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af0003990 con 0x7f1af406c6c0 2024-04-25T09:58:39.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.976+0000 7f1aea7fc640 1 -- 172.21.15.7:0/3496724013 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af0003b30 con 0x7f1af406c6c0 2024-04-25T09:58:39.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.976+0000 7f1aea7fc640 1 -- 172.21.15.7:0/3496724013 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af0004020 con 0x7f1af406c6c0 2024-04-25T09:58:39.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.976+0000 7f1afc06b640 1 -- 172.21.15.7:0/3496724013 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af41f4950 con 0x7f1af406c6c0 2024-04-25T09:58:39.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.976+0000 7f1afc06b640 1 -- 172.21.15.7:0/3496724013 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af4157630 con 0x7f1af406c6c0 2024-04-25T09:58:39.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.976+0000 7f1afc06b640 1 -- 172.21.15.7:0/3496724013 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af4068fd0 con 0x7f1af406c6c0 2024-04-25T09:58:39.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.977+0000 7f1aea7fc640 1 -- 172.21.15.7:0/3496724013 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1af00041c0 con 0x7f1af406c6c0 2024-04-25T09:58:39.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.977+0000 7f1aea7fc640 1 --2- 172.21.15.7:0/3496724013 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1ad806b4d0 0x7f1ad806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:39.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.978+0000 7f1aea7fc640 1 -- 172.21.15.7:0/3496724013 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f1af008a4c0 con 0x7f1af406c6c0 2024-04-25T09:58:39.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.978+0000 7f1af9606640 1 --2- 172.21.15.7:0/3496724013 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1ad806b4d0 0x7f1ad806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:39.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.978+0000 7f1af9606640 1 --2- 172.21.15.7:0/3496724013 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1ad806b4d0 0x7f1ad806d990 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1af41f1770 tx=0x7f1ae40079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:39.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:39.982+0000 7f1aea7fc640 1 -- 172.21.15.7:0/3496724013 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1af0014030 con 0x7f1af406c6c0 2024-04-25T09:58:40.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.230+0000 7f1afc06b640 1 -- 172.21.15.7:0/3496724013 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]} v 0) v1 -- 0x7f1af40d1620 con 0x7f1af406c6c0 2024-04-25T09:58:40.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.236+0000 7f1aea7fc640 1 -- 172.21.15.7:0/3496724013 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]}]=0 v225) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1af0059540 con 0x7f1af406c6c0 2024-04-25T09:58:40.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.238+0000 7f1afc06b640 1 -- 172.21.15.7:0/3496724013 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1ad806b4d0 msgr2=0x7f1ad806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:40.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.238+0000 7f1afc06b640 1 --2- 172.21.15.7:0/3496724013 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1ad806b4d0 0x7f1ad806d990 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1af41f1770 tx=0x7f1ae40079b0 comp rx=0 tx=0).stop 2024-04-25T09:58:40.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.238+0000 7f1afc06b640 1 -- 172.21.15.7:0/3496724013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1af406c6c0 msgr2=0x7f1af40c9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:40.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.238+0000 7f1afc06b640 1 --2- 172.21.15.7:0/3496724013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1af406c6c0 0x7f1af40c9ec0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f1af000cd00 tx=0x7f1af000a5c0 comp rx=0 tx=0).stop 2024-04-25T09:58:40.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.238+0000 7f1afc06b640 1 -- 172.21.15.7:0/3496724013 shutdown_connections 2024-04-25T09:58:40.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.238+0000 7f1afc06b640 1 --2- 172.21.15.7:0/3496724013 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1ad806b4d0 0x7f1ad806d990 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:40.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.238+0000 7f1afc06b640 1 --2- 172.21.15.7:0/3496724013 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1af415dd00 0x7f1af41f4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:40.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.238+0000 7f1afc06b640 1 --2- 172.21.15.7:0/3496724013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1af40b6a40 0x7f1af41f3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:40.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.238+0000 7f1afc06b640 1 --2- 172.21.15.7:0/3496724013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1af406c6c0 0x7f1af40c9ec0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:40.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.238+0000 7f1afc06b640 1 -- 172.21.15.7:0/3496724013 >> 172.21.15.7:0/3496724013 conn(0x7f1af40d07b0 msgr2=0x7f1af40ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:40.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.238+0000 7f1afc06b640 1 -- 172.21.15.7:0/3496724013 shutdown_connections 2024-04-25T09:58:40.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.238+0000 7f1afc06b640 1 -- 172.21.15.7:0/3496724013 wait complete. 2024-04-25T09:58:40.253 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:58:40.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.353+0000 7fb87829e640 1 Processor -- start 2024-04-25T09:58:40.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.353+0000 7fb87829e640 1 -- start start 2024-04-25T09:58:40.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.354+0000 7fb87829e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb870071840 0x7fb870166370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:40.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.354+0000 7fb87829e640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8701453c0 con 0x7fb87006d130 2024-04-25T09:58:40.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.354+0000 7fb87829e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb87006d6a0 con 0x7fb870144fe0 2024-04-25T09:58:40.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.354+0000 7fb87829e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8700a8560 con 0x7fb870071840 2024-04-25T09:58:40.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.354+0000 7fb875839640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb87006d130 0x7fb870071130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58076/0 (socket says 172.21.15.7:58076) 2024-04-25T09:58:40.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.354+0000 7fb875839640 1 -- 172.21.15.7:0/1078890228 learned_addr learned my addr 172.21.15.7:0/1078890228 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:40.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.354+0000 7fb875038640 1 -- 172.21.15.7:0/1078890228 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1174218207 0 0) 0x7fb8701453c0 con 0x7fb87006d130 2024-04-25T09:58:40.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.354+0000 7fb87683b640 1 --2- 172.21.15.7:0/1078890228 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb870071840 0x7fb870166370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:40.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.354+0000 7fb875038640 1 -- 172.21.15.7:0/1078890228 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb85c003520 con 0x7fb87006d130 2024-04-25T09:58:40.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.354+0000 7fb875038640 1 -- 172.21.15.7:0/1078890228 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1548495078 0 0) 0x7fb85c003520 con 0x7fb87006d130 2024-04-25T09:58:40.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.355+0000 7fb875038640 1 -- 172.21.15.7:0/1078890228 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb870071840 msgr2=0x7fb870166370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:40.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.355+0000 7fb875038640 1 --2- 172.21.15.7:0/1078890228 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb870071840 0x7fb870166370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:40.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.355+0000 7fb875038640 1 -- 172.21.15.7:0/1078890228 >> v1:172.21.15.55:6789/0 conn(0x7fb870144fe0 legacy=0x7fb87006e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:40.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.355+0000 7fb875038640 1 -- 172.21.15.7:0/1078890228 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb87006d980 con 0x7fb87006d130 2024-04-25T09:58:40.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.355+0000 7fb875038640 1 -- 172.21.15.7:0/1078890228 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fb860001670 con 0x7fb87006d130 2024-04-25T09:58:40.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.355+0000 7fb875038640 1 -- 172.21.15.7:0/1078890228 >> v1:172.21.15.7:6789/0 conn(0x7fb87006d130 legacy=0x7fb870071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:40.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.355+0000 7fb875038640 1 --2- 172.21.15.7:0/1078890228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb85c0039e0 0x7fb85c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:40.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.355+0000 7fb875038640 1 --2- 172.21.15.7:0/1078890228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb85c004800 0x7fb85c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:40.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.355+0000 7fb875038640 1 --2- 172.21.15.7:0/1078890228 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb870071840 0x7fb85c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:40.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.355+0000 7fb875038640 1 -- 172.21.15.7:0/1078890228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c00ba70 con 0x7fb85c004800 2024-04-25T09:58:40.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.355+0000 7fb875038640 1 -- 172.21.15.7:0/1078890228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c00bc20 con 0x7fb85c0039e0 2024-04-25T09:58:40.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.355+0000 7fb875038640 1 -- 172.21.15.7:0/1078890228 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c00be20 con 0x7fb870071840 2024-04-25T09:58:40.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.355+0000 7fb875839640 1 --2- 172.21.15.7:0/1078890228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb85c004800 0x7fb85c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:40.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.355+0000 7fb87603a640 1 --2- 172.21.15.7:0/1078890228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb85c0039e0 0x7fb85c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:40.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.355+0000 7fb87683b640 1 --2- 172.21.15.7:0/1078890228 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb870071840 0x7fb85c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:40.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.355+0000 7fb875839640 1 -- 172.21.15.7:0/1078890228 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb870071840 msgr2=0x7fb85c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:40.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.355+0000 7fb875839640 1 --2- 172.21.15.7:0/1078890228 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb870071840 0x7fb85c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.355+0000 7fb875839640 1 -- 172.21.15.7:0/1078890228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb85c0039e0 msgr2=0x7fb85c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.355+0000 7fb875839640 1 --2- 172.21.15.7:0/1078890228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb85c0039e0 0x7fb85c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.355+0000 7fb875839640 1 -- 172.21.15.7:0/1078890228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c003520 con 0x7fb85c004800 2024-04-25T09:58:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.355+0000 7fb87603a640 1 --2- 172.21.15.7:0/1078890228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb85c0039e0 0x7fb85c003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.355+0000 7fb87683b640 1 --2- 172.21.15.7:0/1078890228 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb870071840 0x7fb85c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.356+0000 7fb875839640 1 --2- 172.21.15.7:0/1078890228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb85c004800 0x7fb85c004c80 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fb86000c240 tx=0x7fb85c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35d57b29cdf7cdd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.356+0000 7fb875038640 1 -- 172.21.15.7:0/1078890228 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb860007cf0 con 0x7fb85c004800 2024-04-25T09:58:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.356+0000 7fb875038640 1 -- 172.21.15.7:0/1078890228 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8600058d0 con 0x7fb85c004800 2024-04-25T09:58:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.356+0000 7fb875038640 1 -- 172.21.15.7:0/1078890228 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb860005ca0 con 0x7fb85c004800 2024-04-25T09:58:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.356+0000 7fb87829e640 1 -- 172.21.15.7:0/1078890228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb85c004800 msgr2=0x7fb85c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.356+0000 7fb87829e640 1 --2- 172.21.15.7:0/1078890228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb85c004800 0x7fb85c004c80 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fb86000c240 tx=0x7fb85c005830 comp rx=0 tx=0).stop 2024-04-25T09:58:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.356+0000 7fb87683b640 1 -- 172.21.15.7:0/1078890228 reap_dead start 2024-04-25T09:58:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.356+0000 7fb87829e640 1 -- 172.21.15.7:0/1078890228 shutdown_connections 2024-04-25T09:58:40.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.356+0000 7fb87829e640 1 -- 172.21.15.7:0/1078890228 >> 172.21.15.7:0/1078890228 conn(0x7fb87006ab60 msgr2=0x7fb87006af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:40.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.357+0000 7fb87829e640 1 -- 172.21.15.7:0/1078890228 shutdown_connections 2024-04-25T09:58:40.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.357+0000 7fb87829e640 1 -- 172.21.15.7:0/1078890228 wait complete. 2024-04-25T09:58:40.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.358+0000 7fb87829e640 1 Processor -- start 2024-04-25T09:58:40.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.358+0000 7fb87829e640 1 -- start start 2024-04-25T09:58:40.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.358+0000 7fb87829e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb85c004800 0x7fb870142020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:40.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.358+0000 7fb87829e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8700aa110 0x7fb8700b0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:40.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.358+0000 7fb87829e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8700aa590 0x7fb8700b0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:40.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.358+0000 7fb87829e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87015be50 con 0x7fb8700aa110 2024-04-25T09:58:40.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.358+0000 7fb87829e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87006df40 con 0x7fb85c004800 2024-04-25T09:58:40.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.358+0000 7fb87829e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87015d380 con 0x7fb8700aa590 2024-04-25T09:58:40.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.359+0000 7fb875839640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8700aa110 0x7fb8700b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:40.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.359+0000 7fb875839640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8700aa110 0x7fb8700b0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36650/0 (socket says 172.21.15.7:36650) 2024-04-25T09:58:40.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.359+0000 7fb875839640 1 -- 172.21.15.7:0/1637538648 learned_addr learned my addr 172.21.15.7:0/1637538648 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:40.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.359+0000 7fb87603a640 1 --2- 172.21.15.7:0/1637538648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb85c004800 0x7fb870142020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:40.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.359+0000 7fb87683b640 1 --2- 172.21.15.7:0/1637538648 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8700aa590 0x7fb8700b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:40.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.359+0000 7fb875839640 1 -- 172.21.15.7:0/1637538648 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8700aa590 msgr2=0x7fb8700b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:40.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.359+0000 7fb875839640 1 --2- 172.21.15.7:0/1637538648 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8700aa590 0x7fb8700b0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:40.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.359+0000 7fb875839640 1 -- 172.21.15.7:0/1637538648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb85c004800 msgr2=0x7fb870142020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:40.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.359+0000 7fb875839640 1 --2- 172.21.15.7:0/1637538648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb85c004800 0x7fb870142020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:40.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.359+0000 7fb875839640 1 -- 172.21.15.7:0/1637538648 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8700aab60 con 0x7fb8700aa110 2024-04-25T09:58:40.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.359+0000 7fb875839640 1 --2- 172.21.15.7:0/1637538648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8700aa110 0x7fb8700b0310 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fb86000c240 tx=0x7fb87006db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:40.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.359+0000 7fb866ffd640 1 -- 172.21.15.7:0/1637538648 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb860038040 con 0x7fb8700aa110 2024-04-25T09:58:40.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.359+0000 7fb866ffd640 1 -- 172.21.15.7:0/1637538648 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb860042070 con 0x7fb8700aa110 2024-04-25T09:58:40.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.359+0000 7fb87829e640 1 -- 172.21.15.7:0/1637538648 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8700aae40 con 0x7fb8700aa110 2024-04-25T09:58:40.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.359+0000 7fb866ffd640 1 -- 172.21.15.7:0/1637538648 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb860007270 con 0x7fb8700aa110 2024-04-25T09:58:40.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.359+0000 7fb87829e640 1 -- 172.21.15.7:0/1637538648 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8700ab400 con 0x7fb8700aa110 2024-04-25T09:58:40.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.360+0000 7fb87829e640 1 -- 172.21.15.7:0/1637538648 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb870068f60 con 0x7fb8700aa110 2024-04-25T09:58:40.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.361+0000 7fb866ffd640 1 -- 172.21.15.7:0/1637538648 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb860007410 con 0x7fb8700aa110 2024-04-25T09:58:40.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.361+0000 7fb866ffd640 1 --2- 172.21.15.7:0/1637538648 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb85406b500 0x7fb85406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:40.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.361+0000 7fb866ffd640 1 -- 172.21.15.7:0/1637538648 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fb8600a9e10 con 0x7fb8700aa110 2024-04-25T09:58:40.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.361+0000 7fb87603a640 1 --2- 172.21.15.7:0/1637538648 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb85406b500 0x7fb85406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:40.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.362+0000 7fb87603a640 1 --2- 172.21.15.7:0/1637538648 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb85406b500 0x7fb85406d9c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb868007fd0 tx=0x7fb868009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:40.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.365+0000 7fb866ffd640 1 -- 172.21.15.7:0/1637538648 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb860078750 con 0x7fb8700aa110 2024-04-25T09:58:40.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.546+0000 7fb87829e640 1 -- 172.21.15.7:0/1637538648 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb87006b110 con 0x7fb8700aa110 2024-04-25T09:58:40.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.549+0000 7fb866ffd640 1 -- 172.21.15.7:0/1637538648 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb86007c7f0 con 0x7fb8700aa110 2024-04-25T09:58:40.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.551+0000 7fb87829e640 1 -- 172.21.15.7:0/1637538648 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb85406b500 msgr2=0x7fb85406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:40.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.551+0000 7fb87829e640 1 --2- 172.21.15.7:0/1637538648 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb85406b500 0x7fb85406d9c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb868007fd0 tx=0x7fb868009040 comp rx=0 tx=0).stop 2024-04-25T09:58:40.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.551+0000 7fb87829e640 1 -- 172.21.15.7:0/1637538648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8700aa110 msgr2=0x7fb8700b0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:40.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.551+0000 7fb87829e640 1 --2- 172.21.15.7:0/1637538648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8700aa110 0x7fb8700b0310 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fb86000c240 tx=0x7fb87006db50 comp rx=0 tx=0).stop 2024-04-25T09:58:40.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.551+0000 7fb87829e640 1 -- 172.21.15.7:0/1637538648 shutdown_connections 2024-04-25T09:58:40.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.551+0000 7fb87829e640 1 --2- 172.21.15.7:0/1637538648 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb85406b500 0x7fb85406d9c0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:40.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.551+0000 7fb87829e640 1 --2- 172.21.15.7:0/1637538648 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8700aa590 0x7fb8700b0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:40.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.551+0000 7fb87829e640 1 --2- 172.21.15.7:0/1637538648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8700aa110 0x7fb8700b0310 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:40.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.551+0000 7fb87829e640 1 --2- 172.21.15.7:0/1637538648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb85c004800 0x7fb870142020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:40.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.551+0000 7fb87829e640 1 -- 172.21.15.7:0/1637538648 >> 172.21.15.7:0/1637538648 conn(0x7fb87006ab60 msgr2=0x7fb870143da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:40.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.551+0000 7fb87829e640 1 -- 172.21.15.7:0/1637538648 shutdown_connections 2024-04-25T09:58:40.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.551+0000 7fb87829e640 1 -- 172.21.15.7:0/1637538648 wait complete. 2024-04-25T09:58:40.566 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:58:40.566 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:58:40.604 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:58:40.651 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:58:40.651 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:58:40.651 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:58:40.667 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13704 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:58:40.667 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:58:40.667 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:58:40.685 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19023 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:58:40.685 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:58:40.685 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:58:40.723 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13704 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:58:40.723 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T09:58:40.723 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:58:40.743 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19023 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:58:40.743 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:58:40.743 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:58:40.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.859+0000 7f780f10a640 1 Processor -- start 2024-04-25T09:58:40.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.859+0000 7f780f10a640 1 -- start start 2024-04-25T09:58:40.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.860+0000 7f780f10a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f78080b3d30 0x7f78080b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:40.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.860+0000 7f780f10a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f78080b4960 0x7f780806d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:40.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.860+0000 7f780f10a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78080b2c90 con 0x7f78081474f0 2024-04-25T09:58:40.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.860+0000 7f780f10a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78080b2a40 con 0x7f78080b4960 2024-04-25T09:58:40.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.860+0000 7f780f10a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78080b38a0 con 0x7f78080b3d30 2024-04-25T09:58:40.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.860+0000 7f780cea6640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f78081474f0 0x7f78080ae820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58092/0 (socket says 172.21.15.7:58092) 2024-04-25T09:58:40.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.860+0000 7f780cea6640 1 -- 172.21.15.7:0/868800082 learned_addr learned my addr 172.21.15.7:0/868800082 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:40.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.860+0000 7f78077fe640 1 -- 172.21.15.7:0/868800082 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1851624106 0 0) 0x7f78080b2c90 con 0x7f78081474f0 2024-04-25T09:58:40.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.860+0000 7f78077fe640 1 -- 172.21.15.7:0/868800082 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77f0003520 con 0x7f78081474f0 2024-04-25T09:58:40.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.860+0000 7f780d6a7640 1 --2- 172.21.15.7:0/868800082 >> v2:172.21.15.55:3300/0 conn(0x7f78080b4960 0x7f780806d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:40.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.860+0000 7f7807fff640 1 --2- 172.21.15.7:0/868800082 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f78080b3d30 0x7f78080b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:40.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.861+0000 7f78077fe640 1 -- 172.21.15.7:0/868800082 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 8149647 0 0) 0x7f77f0003520 con 0x7f78081474f0 2024-04-25T09:58:40.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.861+0000 7f78077fe640 1 -- 172.21.15.7:0/868800082 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f78080b3d30 msgr2=0x7f78080b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:40.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.861+0000 7f78077fe640 1 --2- 172.21.15.7:0/868800082 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f78080b3d30 0x7f78080b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:40.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.861+0000 7f78077fe640 1 -- 172.21.15.7:0/868800082 >> v2:172.21.15.55:3300/0 conn(0x7f78080b4960 msgr2=0x7f780806d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:40.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.861+0000 7f78077fe640 1 --2- 172.21.15.7:0/868800082 >> v2:172.21.15.55:3300/0 conn(0x7f78080b4960 0x7f780806d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:40.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.861+0000 7f78077fe640 1 -- 172.21.15.7:0/868800082 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78080b2f70 con 0x7f78081474f0 2024-04-25T09:58:40.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.861+0000 7f78077fe640 1 -- 172.21.15.7:0/868800082 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f78000019f0 con 0x7f78081474f0 2024-04-25T09:58:40.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.861+0000 7f7807fff640 1 --2- 172.21.15.7:0/868800082 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f78080b3d30 0x7f78080b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:40.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.861+0000 7f78077fe640 1 -- 172.21.15.7:0/868800082 >> v1:172.21.15.7:6789/0 conn(0x7f78081474f0 legacy=0x7f78080ae820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:40.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.861+0000 7f78077fe640 1 --2- 172.21.15.7:0/868800082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77f00039b0 0x7f77f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:40.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.861+0000 7f78077fe640 1 --2- 172.21.15.7:0/868800082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77f0004800 0x7f77f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:40.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.861+0000 7f78077fe640 1 --2- 172.21.15.7:0/868800082 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f78080b3d30 0x7f77f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:40.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.861+0000 7f78077fe640 1 -- 172.21.15.7:0/868800082 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78080b2a40 con 0x7f77f0004800 2024-04-25T09:58:40.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.861+0000 7f78077fe640 1 -- 172.21.15.7:0/868800082 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78080b38a0 con 0x7f77f00039b0 2024-04-25T09:58:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.861+0000 7f78077fe640 1 -- 172.21.15.7:0/868800082 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f000b9c0 con 0x7f78080b3d30 2024-04-25T09:58:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.861+0000 7f7807fff640 1 --2- 172.21.15.7:0/868800082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77f0004800 0x7f77f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.861+0000 7f780cea6640 1 --2- 172.21.15.7:0/868800082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77f00039b0 0x7f77f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.861+0000 7f780d6a7640 1 --2- 172.21.15.7:0/868800082 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f78080b3d30 0x7f77f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.861+0000 7f7807fff640 1 -- 172.21.15.7:0/868800082 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f78080b3d30 msgr2=0x7f77f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.861+0000 7f7807fff640 1 --2- 172.21.15.7:0/868800082 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f78080b3d30 0x7f77f00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.861+0000 7f7807fff640 1 -- 172.21.15.7:0/868800082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77f00039b0 msgr2=0x7f77f0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.861+0000 7f7807fff640 1 --2- 172.21.15.7:0/868800082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77f00039b0 0x7f77f0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.861+0000 7f7807fff640 1 -- 172.21.15.7:0/868800082 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f0003520 con 0x7f77f0004800 2024-04-25T09:58:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.862+0000 7f7807fff640 1 --2- 172.21.15.7:0/868800082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77f0004800 0x7f77f0004c80 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0098d0 tx=0x7f77f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35a83f5a9b721c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.862+0000 7f78077fe640 1 -- 172.21.15.7:0/868800082 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc00f040 con 0x7f77f0004800 2024-04-25T09:58:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.862+0000 7f78077fe640 1 -- 172.21.15.7:0/868800082 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc02ad00 con 0x7f77f0004800 2024-04-25T09:58:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.862+0000 7f78077fe640 1 -- 172.21.15.7:0/868800082 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc004250 con 0x7f77f0004800 2024-04-25T09:58:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.863+0000 7f780f10a640 1 -- 172.21.15.7:0/868800082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77f0004800 msgr2=0x7f77f0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.863+0000 7f780f10a640 1 --2- 172.21.15.7:0/868800082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77f0004800 0x7f77f0004c80 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0098d0 tx=0x7f77f0005830 comp rx=0 tx=0).stop 2024-04-25T09:58:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.863+0000 7f780d6a7640 1 -- 172.21.15.7:0/868800082 reap_dead start 2024-04-25T09:58:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.863+0000 7f780f10a640 1 -- 172.21.15.7:0/868800082 shutdown_connections 2024-04-25T09:58:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.863+0000 7f780f10a640 1 -- 172.21.15.7:0/868800082 >> 172.21.15.7:0/868800082 conn(0x7f78080b1740 msgr2=0x7f78080b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.863+0000 7f780f10a640 1 -- 172.21.15.7:0/868800082 shutdown_connections 2024-04-25T09:58:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.863+0000 7f780f10a640 1 -- 172.21.15.7:0/868800082 wait complete. 2024-04-25T09:58:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.864+0000 7f780f10a640 1 Processor -- start 2024-04-25T09:58:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.864+0000 7f780f10a640 1 -- start start 2024-04-25T09:58:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.865+0000 7f780f10a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77f0004800 0x7f780813cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.865+0000 7f780f10a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7808154590 0x7f7808152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.865+0000 7f780f10a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7808153ce0 0x7f7808160800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.865+0000 7f780f10a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78080b3530 con 0x7f77f0004800 2024-04-25T09:58:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.865+0000 7f780f10a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78080b4db0 con 0x7f7808153ce0 2024-04-25T09:58:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.865+0000 7f780f10a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78080aef30 con 0x7f7808154590 2024-04-25T09:58:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.865+0000 7f780cea6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77f0004800 0x7f780813cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:40.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.865+0000 7f780cea6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77f0004800 0x7f780813cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36674/0 (socket says 172.21.15.7:36674) 2024-04-25T09:58:40.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.865+0000 7f780cea6640 1 -- 172.21.15.7:0/3373745658 learned_addr learned my addr 172.21.15.7:0/3373745658 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:40.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.865+0000 7f780cea6640 1 -- 172.21.15.7:0/3373745658 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7808154590 msgr2=0x7f7808152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:40.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.865+0000 7f780cea6640 1 --2- 172.21.15.7:0/3373745658 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7808154590 0x7f7808152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:40.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.865+0000 7f780cea6640 1 -- 172.21.15.7:0/3373745658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7808153ce0 msgr2=0x7f7808160800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:40.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.865+0000 7f780cea6640 1 --2- 172.21.15.7:0/3373745658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7808153ce0 0x7f7808160800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:40.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.865+0000 7f780cea6640 1 -- 172.21.15.7:0/3373745658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78081529c0 con 0x7f77f0004800 2024-04-25T09:58:40.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.865+0000 7f780cea6640 1 --2- 172.21.15.7:0/3373745658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77f0004800 0x7f780813cbd0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f7800007a50 tx=0x7f780000a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:40.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.865+0000 7f78057fa640 1 -- 172.21.15.7:0/3373745658 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7800001a30 con 0x7f77f0004800 2024-04-25T09:58:40.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.865+0000 7f78057fa640 1 -- 172.21.15.7:0/3373745658 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7800018070 con 0x7f77f0004800 2024-04-25T09:58:40.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.866+0000 7f780f10a640 1 -- 172.21.15.7:0/3373745658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7808152c40 con 0x7f77f0004800 2024-04-25T09:58:40.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.866+0000 7f78057fa640 1 -- 172.21.15.7:0/3373745658 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7800012560 con 0x7f77f0004800 2024-04-25T09:58:40.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.866+0000 7f780f10a640 1 -- 172.21.15.7:0/3373745658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7808153200 con 0x7f77f0004800 2024-04-25T09:58:40.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.866+0000 7f780f10a640 1 -- 172.21.15.7:0/3373745658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7808068fd0 con 0x7f77f0004800 2024-04-25T09:58:40.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.867+0000 7f78057fa640 1 -- 172.21.15.7:0/3373745658 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7800012700 con 0x7f77f0004800 2024-04-25T09:58:40.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.867+0000 7f78057fa640 1 --2- 172.21.15.7:0/3373745658 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f77f406b500 0x7f77f406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:40.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.867+0000 7f78057fa640 1 -- 172.21.15.7:0/3373745658 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f780008a900 con 0x7f77f0004800 2024-04-25T09:58:40.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.867+0000 7f7807fff640 1 --2- 172.21.15.7:0/3373745658 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f77f406b500 0x7f77f406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:40.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.868+0000 7f7807fff640 1 --2- 172.21.15.7:0/3373745658 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f77f406b500 0x7f77f406d9c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f77fc033000 tx=0x7f77fc02c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:40.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:40.872+0000 7f78057fa640 1 -- 172.21.15.7:0/3373745658 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f78081529c0 con 0x7f77f0004800 2024-04-25T09:58:41.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.092+0000 7f780f10a640 1 -- 172.21.15.7:0/3373745658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78080726a0 con 0x7f77f0004800 2024-04-25T09:58:41.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.092+0000 7f78057fa640 1 -- 172.21.15.7:0/3373745658 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+3693 (secure 0 0 0) 0x7f78000598f0 con 0x7f77f0004800 2024-04-25T09:58:41.097 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:58:41.097 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":32,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3706118852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3706118852},{"type":"v1","addr":"172.21.15.55:6833","nonce":3706118852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5354,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1513522793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1513522793},{"type":"v1","addr":"172.21.15.55:6835","nonce":1513522793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5782,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1231382839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1231382839},{"type":"v1","addr":"172.21.15.7:6837","nonce":1231382839}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6750,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/1230113044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1230113044},{"type":"v1","addr":"172.21.15.7:6836","nonce":1230113044}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[]} 2024-04-25T09:58:41.097 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 32 2024-04-25T09:58:41.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.094+0000 7f780f10a640 1 -- 172.21.15.7:0/3373745658 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f77f406b500 msgr2=0x7f77f406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:41.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.094+0000 7f780f10a640 1 --2- 172.21.15.7:0/3373745658 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f77f406b500 0x7f77f406d9c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f77fc033000 tx=0x7f77fc02c000 comp rx=0 tx=0).stop 2024-04-25T09:58:41.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.094+0000 7f780f10a640 1 -- 172.21.15.7:0/3373745658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77f0004800 msgr2=0x7f780813cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:41.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.094+0000 7f780f10a640 1 --2- 172.21.15.7:0/3373745658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77f0004800 0x7f780813cbd0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f7800007a50 tx=0x7f780000a750 comp rx=0 tx=0).stop 2024-04-25T09:58:41.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.094+0000 7f780f10a640 1 -- 172.21.15.7:0/3373745658 shutdown_connections 2024-04-25T09:58:41.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.094+0000 7f780f10a640 1 --2- 172.21.15.7:0/3373745658 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f77f406b500 0x7f77f406d9c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:41.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.094+0000 7f780f10a640 1 --2- 172.21.15.7:0/3373745658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7808153ce0 0x7f7808160800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:41.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.094+0000 7f780f10a640 1 --2- 172.21.15.7:0/3373745658 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7808154590 0x7f7808152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:41.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.094+0000 7f780f10a640 1 --2- 172.21.15.7:0/3373745658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77f0004800 0x7f780813cbd0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:41.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.094+0000 7f780f10a640 1 -- 172.21.15.7:0/3373745658 >> 172.21.15.7:0/3373745658 conn(0x7f78080b1740 msgr2=0x7f780806de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:41.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.095+0000 7f780f10a640 1 -- 172.21.15.7:0/3373745658 shutdown_connections 2024-04-25T09:58:41.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.095+0000 7f780f10a640 1 -- 172.21.15.7:0/3373745658 wait complete. 2024-04-25T09:58:41.109 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:58:41.110 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:58:41.110 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:58:41.110 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:58:41.110 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:58:41.110 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:58:41.110 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:58:41.111 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:58:41.111 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:58:41.111 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:58:41.111 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:58:41.111 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:58:41.111 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:58:41.111 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:58:41.111 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:58:41.112 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:58:41.120 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:58:41.120 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:58:41.121 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:58:41.121 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:58:41.124 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:58:41.124 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:58:41.125 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:58:41.125 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:58:41.162 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:58:41.162 DEBUG:teuthology.parallel:result is None 2024-04-25T09:58:41.163 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:58:41.163 DEBUG:teuthology.parallel:result is None 2024-04-25T09:58:41.167 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:58:41.167 DEBUG:teuthology.parallel:result is None 2024-04-25T09:58:41.167 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:58:41.168 DEBUG:teuthology.parallel:result is None 2024-04-25T09:58:41.168 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:58:41.237 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-04-25T09:58:41.239 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-04-25T09:58:41.253 INFO:tasks.ceph.mds.b.smithi055.stdout:starting mds.b at 2024-04-25T09:58:41.253 INFO:tasks.ceph.mds.d.smithi055.stdout:starting mds.d at 2024-04-25T09:58:41.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.269+0000 7fc9e2f5c640 1 Processor -- start 2024-04-25T09:58:41.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.269+0000 7fc9e2f5c640 1 -- start start 2024-04-25T09:58:41.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.270+0000 7fc9e2f5c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9dc15dc60 0x7fc9dc0b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:41.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.270+0000 7fc9e2f5c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc9dc0afc00 0x7fc9dc0b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:41.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.270+0000 7fc9e2f5c640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9dc0b5a20 con 0x7fc9dc06ab60 2024-04-25T09:58:41.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.270+0000 7fc9e2f5c640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9dc0b0160 con 0x7fc9dc0afc00 2024-04-25T09:58:41.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.270+0000 7fc9e2f5c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc0b5740 con 0x7fc9dc15dc60 2024-04-25T09:58:41.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.270+0000 7fc9e0cf8640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc9dc06ab60 0x7fc9dc06af40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58100/0 (socket says 172.21.15.7:58100) 2024-04-25T09:58:41.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.270+0000 7fc9e0cf8640 1 -- 172.21.15.7:0/3613685023 learned_addr learned my addr 172.21.15.7:0/3613685023 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:41.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.270+0000 7fc9e14f9640 1 --2- 172.21.15.7:0/3613685023 >> v2:172.21.15.7:3300/0 conn(0x7fc9dc0afc00 0x7fc9dc0b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:41.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.271+0000 7fc9dbfff640 1 --2- 172.21.15.7:0/3613685023 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9dc15dc60 0x7fc9dc0b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:41.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.271+0000 7fc9db7fe640 1 -- 172.21.15.7:0/3613685023 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 382382090 0 0) 0x7fc9dc0b5a20 con 0x7fc9dc06ab60 2024-04-25T09:58:41.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.271+0000 7fc9db7fe640 1 -- 172.21.15.7:0/3613685023 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9cc003520 con 0x7fc9dc06ab60 2024-04-25T09:58:41.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.271+0000 7fc9e14f9640 1 -- 172.21.15.7:0/3613685023 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9dc15dc60 msgr2=0x7fc9dc0b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:41.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.271+0000 7fc9e14f9640 1 --2- 172.21.15.7:0/3613685023 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9dc15dc60 0x7fc9dc0b1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:41.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.271+0000 7fc9e14f9640 1 -- 172.21.15.7:0/3613685023 >> v1:172.21.15.7:6789/0 conn(0x7fc9dc06ab60 legacy=0x7fc9dc06af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:41.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.271+0000 7fc9e14f9640 1 -- 172.21.15.7:0/3613685023 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9dc0b0400 con 0x7fc9dc0afc00 2024-04-25T09:58:41.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.271+0000 7fc9e14f9640 1 --2- 172.21.15.7:0/3613685023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9dc0afc00 0x7fc9dc0b0c00 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4009d90 tx=0x7fc9d402a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa665200bd9a17c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:41.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.272+0000 7fc9db7fe640 1 -- 172.21.15.7:0/3613685023 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4007740 con 0x7fc9dc0afc00 2024-04-25T09:58:41.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.272+0000 7fc9db7fe640 1 -- 172.21.15.7:0/3613685023 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d40078e0 con 0x7fc9dc0afc00 2024-04-25T09:58:41.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.272+0000 7fc9db7fe640 1 -- 172.21.15.7:0/3613685023 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4007cf0 con 0x7fc9dc0afc00 2024-04-25T09:58:41.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.272+0000 7fc9e2f5c640 1 -- 172.21.15.7:0/3613685023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9dc0afc00 msgr2=0x7fc9dc0b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:41.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.272+0000 7fc9e2f5c640 1 --2- 172.21.15.7:0/3613685023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9dc0afc00 0x7fc9dc0b0c00 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4009d90 tx=0x7fc9d402a560 comp rx=0 tx=0).stop 2024-04-25T09:58:41.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.272+0000 7fc9e2f5c640 1 -- 172.21.15.7:0/3613685023 shutdown_connections 2024-04-25T09:58:41.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.272+0000 7fc9e2f5c640 1 --2- 172.21.15.7:0/3613685023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9dc0afc00 0x7fc9dc0b0c00 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:41.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.272+0000 7fc9e2f5c640 1 --2- 172.21.15.7:0/3613685023 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9dc15dc60 0x7fc9dc0b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:41.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.272+0000 7fc9e2f5c640 1 -- 172.21.15.7:0/3613685023 >> 172.21.15.7:0/3613685023 conn(0x7fc9dc0b5c30 msgr2=0x7fc9dc0999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:41.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.272+0000 7fc9e2f5c640 1 -- 172.21.15.7:0/3613685023 shutdown_connections 2024-04-25T09:58:41.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.272+0000 7fc9e2f5c640 1 -- 172.21.15.7:0/3613685023 wait complete. 2024-04-25T09:58:41.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.273+0000 7fc9e2f5c640 1 Processor -- start 2024-04-25T09:58:41.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.273+0000 7fc9e2f5c640 1 -- start start 2024-04-25T09:58:41.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.274+0000 7fc9e2f5c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9dc06ab60 0x7fc9dc1526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:41.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.274+0000 7fc9e2f5c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9dc0afc00 0x7fc9dc09cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:41.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.274+0000 7fc9e2f5c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9dc15dc60 0x7fc9dc09a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:41.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.274+0000 7fc9e2f5c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc0b5260 con 0x7fc9dc0afc00 2024-04-25T09:58:41.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.274+0000 7fc9e2f5c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc0b1350 con 0x7fc9dc15dc60 2024-04-25T09:58:41.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.274+0000 7fc9e2f5c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc0b53e0 con 0x7fc9dc06ab60 2024-04-25T09:58:41.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.274+0000 7fc9dbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9dc0afc00 0x7fc9dc09cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:41.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.274+0000 7fc9dbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9dc0afc00 0x7fc9dc09cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36720/0 (socket says 172.21.15.7:36720) 2024-04-25T09:58:41.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.274+0000 7fc9dbfff640 1 -- 172.21.15.7:0/2346898486 learned_addr learned my addr 172.21.15.7:0/2346898486 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:41.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.274+0000 7fc9e14f9640 1 --2- 172.21.15.7:0/2346898486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9dc15dc60 0x7fc9dc09a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:41.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.274+0000 7fc9e0cf8640 1 --2- 172.21.15.7:0/2346898486 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9dc06ab60 0x7fc9dc1526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:41.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.275+0000 7fc9dbfff640 1 -- 172.21.15.7:0/2346898486 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9dc06ab60 msgr2=0x7fc9dc1526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:41.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.275+0000 7fc9dbfff640 1 --2- 172.21.15.7:0/2346898486 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9dc06ab60 0x7fc9dc1526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:41.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.275+0000 7fc9dbfff640 1 -- 172.21.15.7:0/2346898486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9dc15dc60 msgr2=0x7fc9dc09a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:41.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.275+0000 7fc9dbfff640 1 --2- 172.21.15.7:0/2346898486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9dc15dc60 0x7fc9dc09a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:41.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.275+0000 7fc9dbfff640 1 -- 172.21.15.7:0/2346898486 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9dc09db80 con 0x7fc9dc0afc00 2024-04-25T09:58:41.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.275+0000 7fc9e0cf8640 1 --2- 172.21.15.7:0/2346898486 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9dc06ab60 0x7fc9dc1526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:41.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.275+0000 7fc9dbfff640 1 --2- 172.21.15.7:0/2346898486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9dc0afc00 0x7fc9dc09cfc0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800e8a0 tx=0x7fc9c800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:41.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.275+0000 7fc9d97fa640 1 -- 172.21.15.7:0/2346898486 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c8017070 con 0x7fc9dc0afc00 2024-04-25T09:58:41.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.275+0000 7fc9d97fa640 1 -- 172.21.15.7:0/2346898486 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c800c940 con 0x7fc9dc0afc00 2024-04-25T09:58:41.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.275+0000 7fc9e2f5c640 1 -- 172.21.15.7:0/2346898486 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9dc09d8a0 con 0x7fc9dc0afc00 2024-04-25T09:58:41.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.275+0000 7fc9d97fa640 1 -- 172.21.15.7:0/2346898486 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c800cd30 con 0x7fc9dc0afc00 2024-04-25T09:58:41.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.275+0000 7fc9e2f5c640 1 -- 172.21.15.7:0/2346898486 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9dc1f40d0 con 0x7fc9dc0afc00 2024-04-25T09:58:41.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.276+0000 7fc9e2f5c640 1 -- 172.21.15.7:0/2346898486 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9dc068fd0 con 0x7fc9dc0afc00 2024-04-25T09:58:41.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.276+0000 7fc9d97fa640 1 -- 172.21.15.7:0/2346898486 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc9c801a070 con 0x7fc9dc0afc00 2024-04-25T09:58:41.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.277+0000 7fc9d97fa640 1 --2- 172.21.15.7:0/2346898486 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc9c006b4d0 0x7fc9c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:41.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.277+0000 7fc9d97fa640 1 -- 172.21.15.7:0/2346898486 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fc9c8089e70 con 0x7fc9dc0afc00 2024-04-25T09:58:41.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.277+0000 7fc9e0cf8640 1 --2- 172.21.15.7:0/2346898486 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc9c006b4d0 0x7fc9c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:41.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.277+0000 7fc9e0cf8640 1 --2- 172.21.15.7:0/2346898486 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc9c006b4d0 0x7fc9c006d990 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc9d0007fd0 tx=0x7fc9d0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:41.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.281+0000 7fc9d97fa640 1 -- 172.21.15.7:0/2346898486 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc9c8058810 con 0x7fc9dc0afc00 2024-04-25T09:58:41.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:41.473+0000 7fc9e2f5c640 1 -- 172.21.15.7:0/2346898486 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc9dc070a20 con 0x7fc9dc0afc00 2024-04-25T09:58:42.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.252+0000 7fc9d97fa640 1 -- 172.21.15.7:0/2346898486 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v69) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc9c805c8b0 con 0x7fc9dc0afc00 2024-04-25T09:58:42.256 INFO:teuthology.orchestra.run.smithi007.stderr: removed all blocklist entries 2024-04-25T09:58:42.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.255+0000 7fc9e2f5c640 1 -- 172.21.15.7:0/2346898486 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc9c006b4d0 msgr2=0x7fc9c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:42.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.255+0000 7fc9e2f5c640 1 --2- 172.21.15.7:0/2346898486 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc9c006b4d0 0x7fc9c006d990 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc9d0007fd0 tx=0x7fc9d0009040 comp rx=0 tx=0).stop 2024-04-25T09:58:42.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.255+0000 7fc9e2f5c640 1 -- 172.21.15.7:0/2346898486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9dc0afc00 msgr2=0x7fc9dc09cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:42.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.255+0000 7fc9e2f5c640 1 --2- 172.21.15.7:0/2346898486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9dc0afc00 0x7fc9dc09cfc0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800e8a0 tx=0x7fc9c800ed60 comp rx=0 tx=0).stop 2024-04-25T09:58:42.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.255+0000 7fc9e2f5c640 1 -- 172.21.15.7:0/2346898486 shutdown_connections 2024-04-25T09:58:42.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.255+0000 7fc9e2f5c640 1 --2- 172.21.15.7:0/2346898486 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc9c006b4d0 0x7fc9c006d990 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:42.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.255+0000 7fc9e2f5c640 1 --2- 172.21.15.7:0/2346898486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9dc15dc60 0x7fc9dc09a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:42.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.255+0000 7fc9e2f5c640 1 --2- 172.21.15.7:0/2346898486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc9dc0afc00 0x7fc9dc09cfc0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:42.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.255+0000 7fc9e2f5c640 1 --2- 172.21.15.7:0/2346898486 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9dc06ab60 0x7fc9dc1526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:42.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.255+0000 7fc9e2f5c640 1 -- 172.21.15.7:0/2346898486 >> 172.21.15.7:0/2346898486 conn(0x7fc9dc0b5c30 msgr2=0x7fc9dc1561e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:42.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.256+0000 7fc9e2f5c640 1 -- 172.21.15.7:0/2346898486 shutdown_connections 2024-04-25T09:58:42.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.256+0000 7fc9e2f5c640 1 -- 172.21.15.7:0/2346898486 wait complete. 2024-04-25T09:58:42.275 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:58:42.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.378+0000 7f91f8db0640 1 Processor -- start 2024-04-25T09:58:42.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.378+0000 7f91f8db0640 1 -- start start 2024-04-25T09:58:42.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.379+0000 7f91f8db0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f91f406bc70 0x7f91f409a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:42.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.379+0000 7f91f8db0640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f91f406c330 0x7f91f406c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:42.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.379+0000 7f91f8db0640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f40cfad0 con 0x7f91f415da20 2024-04-25T09:58:42.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.379+0000 7f91f8db0640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f40d06e0 con 0x7f91f406c330 2024-04-25T09:58:42.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.379+0000 7f91f8db0640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f409a940 con 0x7f91f406bc70 2024-04-25T09:58:42.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.379+0000 7f91f2d9d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f91f406c330 0x7f91f406c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:42.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.379+0000 7f91f2d9d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f91f406c330 0x7f91f406c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36736/0 (socket says 172.21.15.7:36736) 2024-04-25T09:58:42.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.379+0000 7f91f2d9d640 1 -- 172.21.15.7:0/2294971239 learned_addr learned my addr 172.21.15.7:0/2294971239 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:42.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.379+0000 7f91f1d9b640 1 --2- 172.21.15.7:0/2294971239 >> v2:172.21.15.55:3300/0 conn(0x7f91f406bc70 0x7f91f409a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:42.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.380+0000 7f91f2d9d640 1 -- 172.21.15.7:0/2294971239 >> v2:172.21.15.55:3300/0 conn(0x7f91f406bc70 msgr2=0x7f91f409a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:42.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.380+0000 7f91f2d9d640 1 --2- 172.21.15.7:0/2294971239 >> v2:172.21.15.55:3300/0 conn(0x7f91f406bc70 0x7f91f409a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:42.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.380+0000 7f91f2d9d640 1 -- 172.21.15.7:0/2294971239 >> v1:172.21.15.55:6789/0 conn(0x7f91f415da20 legacy=0x7f91f40d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:42.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.380+0000 7f91f2d9d640 1 -- 172.21.15.7:0/2294971239 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f40cfdb0 con 0x7f91f406c330 2024-04-25T09:58:42.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.380+0000 7f91f1d9b640 1 --2- 172.21.15.7:0/2294971239 >> v2:172.21.15.55:3300/0 conn(0x7f91f406bc70 0x7f91f409a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.380+0000 7f91f2d9d640 1 --2- 172.21.15.7:0/2294971239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91f406c330 0x7f91f406c7e0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f91f4072c10 tx=0x7f91dc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d292014b14e12929 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.380+0000 7f91f159a640 1 -- 172.21.15.7:0/2294971239 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc037070 con 0x7f91f406c330 2024-04-25T09:58:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.380+0000 7f91f159a640 1 -- 172.21.15.7:0/2294971239 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91dc032440 con 0x7f91f406c330 2024-04-25T09:58:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.381+0000 7f91f159a640 1 -- 172.21.15.7:0/2294971239 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc032810 con 0x7f91f406c330 2024-04-25T09:58:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.381+0000 7f91f8db0640 1 -- 172.21.15.7:0/2294971239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91f406c330 msgr2=0x7f91f406c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.381+0000 7f91f8db0640 1 --2- 172.21.15.7:0/2294971239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91f406c330 0x7f91f406c7e0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f91f4072c10 tx=0x7f91dc02a270 comp rx=0 tx=0).stop 2024-04-25T09:58:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.381+0000 7f91f8db0640 1 -- 172.21.15.7:0/2294971239 shutdown_connections 2024-04-25T09:58:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.381+0000 7f91f8db0640 1 --2- 172.21.15.7:0/2294971239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91f406c330 0x7f91f406c7e0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.381+0000 7f91f8db0640 1 --2- 172.21.15.7:0/2294971239 >> v2:172.21.15.55:3300/0 conn(0x7f91f406bc70 0x7f91f409a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.381+0000 7f91f8db0640 1 -- 172.21.15.7:0/2294971239 >> 172.21.15.7:0/2294971239 conn(0x7f91f40d16f0 msgr2=0x7f91f40d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.381+0000 7f91f8db0640 1 -- 172.21.15.7:0/2294971239 shutdown_connections 2024-04-25T09:58:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.381+0000 7f91f8db0640 1 -- 172.21.15.7:0/2294971239 wait complete. 2024-04-25T09:58:42.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.382+0000 7f91f8db0640 1 Processor -- start 2024-04-25T09:58:42.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.383+0000 7f91f8db0640 1 -- start start 2024-04-25T09:58:42.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.383+0000 7f91f8db0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91f406bc70 0x7f91f41f39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:42.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.383+0000 7f91f8db0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91f406c330 0x7f91f41598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:42.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.383+0000 7f91f8db0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f91f415da20 0x7f91f41e7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:42.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.383+0000 7f91f8db0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f40d1280 con 0x7f91f406c330 2024-04-25T09:58:42.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.383+0000 7f91f8db0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f40d0370 con 0x7f91f406bc70 2024-04-25T09:58:42.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.383+0000 7f91f8db0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f415de00 con 0x7f91f415da20 2024-04-25T09:58:42.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.383+0000 7f91f1d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91f406c330 0x7f91f41598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:42.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.383+0000 7f91f1d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91f406c330 0x7f91f41598e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36744/0 (socket says 172.21.15.7:36744) 2024-04-25T09:58:42.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.383+0000 7f91f1d9b640 1 -- 172.21.15.7:0/2017126401 learned_addr learned my addr 172.21.15.7:0/2017126401 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:42.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.383+0000 7f91f259c640 1 --2- 172.21.15.7:0/2017126401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91f406bc70 0x7f91f41f39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:42.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.384+0000 7f91f2d9d640 1 --2- 172.21.15.7:0/2017126401 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f91f415da20 0x7f91f41e7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:42.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.384+0000 7f91f1d9b640 1 -- 172.21.15.7:0/2017126401 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f91f415da20 msgr2=0x7f91f41e7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:42.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.384+0000 7f91f1d9b640 1 --2- 172.21.15.7:0/2017126401 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f91f415da20 0x7f91f41e7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:42.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.384+0000 7f91f1d9b640 1 -- 172.21.15.7:0/2017126401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91f406bc70 msgr2=0x7f91f41f39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:42.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.384+0000 7f91f1d9b640 1 --2- 172.21.15.7:0/2017126401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91f406bc70 0x7f91f41f39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:42.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.384+0000 7f91f1d9b640 1 -- 172.21.15.7:0/2017126401 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f4159e20 con 0x7f91f406c330 2024-04-25T09:58:42.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.384+0000 7f91f1d9b640 1 --2- 172.21.15.7:0/2017126401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91f406c330 0x7f91f41598e0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f91e400d800 tx=0x7f91e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.384+0000 7f91eaffd640 1 -- 172.21.15.7:0/2017126401 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e400b6c0 con 0x7f91f406c330 2024-04-25T09:58:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.384+0000 7f91eaffd640 1 -- 172.21.15.7:0/2017126401 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e4019070 con 0x7f91f406c330 2024-04-25T09:58:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.384+0000 7f91f8db0640 1 -- 172.21.15.7:0/2017126401 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f41e3370 con 0x7f91f406c330 2024-04-25T09:58:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.384+0000 7f91eaffd640 1 -- 172.21.15.7:0/2017126401 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e400baa0 con 0x7f91f406c330 2024-04-25T09:58:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.384+0000 7f91f8db0640 1 -- 172.21.15.7:0/2017126401 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f41e6030 con 0x7f91f406c330 2024-04-25T09:58:42.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.385+0000 7f91f8db0640 1 -- 172.21.15.7:0/2017126401 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f4068fd0 con 0x7f91f406c330 2024-04-25T09:58:42.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.385+0000 7f91eaffd640 1 -- 172.21.15.7:0/2017126401 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f91e400bc40 con 0x7f91f406c330 2024-04-25T09:58:42.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.386+0000 7f91eaffd640 1 --2- 172.21.15.7:0/2017126401 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f91d406b4d0 0x7f91d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:42.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.386+0000 7f91eaffd640 1 -- 172.21.15.7:0/2017126401 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f91e408a370 con 0x7f91f406c330 2024-04-25T09:58:42.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.386+0000 7f91f259c640 1 --2- 172.21.15.7:0/2017126401 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f91d406b4d0 0x7f91d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:42.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.386+0000 7f91f259c640 1 --2- 172.21.15.7:0/2017126401 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f91d406b4d0 0x7f91d406d990 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f91ec001f10 tx=0x7f91ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:42.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.390+0000 7f91eaffd640 1 -- 172.21.15.7:0/2017126401 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f91e4058cd0 con 0x7f91f406c330 2024-04-25T09:58:42.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.643+0000 7f91f8db0640 1 -- 172.21.15.7:0/2017126401 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f91f40d2500 con 0x7f91f406c330 2024-04-25T09:58:42.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.643+0000 7f91eaffd640 1 -- 172.21.15.7:0/2017126401 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f91e405cd70 con 0x7f91f406c330 2024-04-25T09:58:42.647 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:58:42.647 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T09:58:42.647 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_dump": [ 2024-04-25T09:58:42.648 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:58:42.648 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.a", 2024-04-25T09:58:42.648 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmDER5IhAA2ih+YNPXKaTRN6KeMKiDaA==", 2024-04-25T09:58:42.648 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:58:42.648 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:58:42.648 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T09:58:42.648 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T09:58:42.648 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:58:42.648 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:58:42.648 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:58:42.648 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:58:42.648 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.b", 2024-04-25T09:58:42.648 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmp55aLhAAD3pB8YjSzrpU6DfjQTVHPw==", 2024-04-25T09:58:42.649 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:58:42.649 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:58:42.649 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T09:58:42.649 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T09:58:42.649 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:58:42.649 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:58:42.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:58:42.649 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:58:42.649 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.c", 2024-04-25T09:58:42.649 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpm8jBtKRAAiDZo8S/z1fE588t8tiuX8Q==", 2024-04-25T09:58:42.649 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:58:42.649 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:58:42.649 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T09:58:42.649 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T09:58:42.650 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:58:42.650 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:58:42.650 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:58:42.650 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:58:42.650 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.d", 2024-04-25T09:58:42.650 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmZWyRNRAA6tdquR+Hh8Lhx7LATegX6g==", 2024-04-25T09:58:42.650 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:58:42.650 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:58:42.650 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T09:58:42.650 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T09:58:42.650 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:58:42.650 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:58:42.650 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:58:42.650 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:58:42.651 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.0", 2024-04-25T09:58:42.651 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAaKCpmfHZ9HBAA9FYBJbc1QdNt1a9qtFhgBw==", 2024-04-25T09:58:42.651 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:58:42.651 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:58:42.651 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:58:42.651 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:58:42.651 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:58:42.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:58:42.651 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:58:42.651 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.1", 2024-04-25T09:58:42.651 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAdKCpmtYOgGhAAbM8XXG5fT+UNSvzvijeJ9Q==", 2024-04-25T09:58:42.651 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:58:42.651 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:58:42.651 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:58:42.652 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:58:42.652 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:58:42.652 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:58:42.652 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:58:42.652 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.2", 2024-04-25T09:58:42.652 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAgKCpmz4uZGBAA6JD3UWZ/8l12y4lJg0kH0A==", 2024-04-25T09:58:42.652 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:58:42.652 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:58:42.652 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:58:42.652 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:58:42.652 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:58:42.652 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:58:42.653 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:58:42.653 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.3", 2024-04-25T09:58:42.653 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAjKCpmcbXXFhAAsK64H4YqdiD1VJKQtn46OQ==", 2024-04-25T09:58:42.653 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:58:42.653 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:58:42.653 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:58:42.653 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:58:42.653 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:58:42.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:58:42.653 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:58:42.653 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.4", 2024-04-25T09:58:42.653 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAsKCpmzEDuKxAAmzxdcdVZIq2bGfG0rYcBBg==", 2024-04-25T09:58:42.653 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:58:42.653 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:58:42.654 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:58:42.654 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:58:42.654 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:58:42.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:58:42.654 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:58:42.654 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.5", 2024-04-25T09:58:42.654 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAvKCpmfyC4KxAAl6QUtdlRRaRNZpECSoHLJQ==", 2024-04-25T09:58:42.654 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:58:42.654 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:58:42.654 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:58:42.654 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:58:42.654 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:58:42.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:58:42.654 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:58:42.655 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.6", 2024-04-25T09:58:42.655 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAyKCpmBrUsKxAAH5IlxYRXUtPKYWDdTqBp3w==", 2024-04-25T09:58:42.655 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:58:42.655 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:58:42.655 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:58:42.655 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:58:42.655 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:58:42.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:58:42.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:58:42.655 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.7", 2024-04-25T09:58:42.655 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQA1KCpmmwTSKhAAdzw/c0Xc6KCQHssqUI910g==", 2024-04-25T09:58:42.655 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:58:42.655 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T09:58:42.655 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T09:58:42.655 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:58:42.656 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:58:42.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:58:42.656 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:58:42.656 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.0", 2024-04-25T09:58:42.656 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmaJKeORAALxC5ZqLLEu0zJFG+SOGukQ==", 2024-04-25T09:58:42.656 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:58:42.656 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:58:42.656 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow r", 2024-04-25T09:58:42.656 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:58:42.656 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:58:42.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:58:42.656 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:58:42.656 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.1", 2024-04-25T09:58:42.656 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAZKCpmC2i6BhAAtKmpTNs/Tga7NtOkm7jSOg==", 2024-04-25T09:58:42.656 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:58:42.657 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:58:42.657 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-04-25T09:58:42.657 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-04-25T09:58:42.657 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-04-25T09:58:42.657 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:58:42.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:58:42.657 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:58:42.657 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.2", 2024-04-25T09:58:42.657 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAZKCpmytCIAxAAhP2UjagzGbz1ySErw1cw3Q==", 2024-04-25T09:58:42.657 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:58:42.657 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:58:42.657 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-04-25T09:58:42.657 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-04-25T09:58:42.657 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-04-25T09:58:42.657 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:58:42.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:58:42.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:58:42.658 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.3", 2024-04-25T09:58:42.658 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAZKCpmSj88DBAAg+N3XDyc3H6fUBqkScD/9Q==", 2024-04-25T09:58:42.658 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:58:42.658 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T09:58:42.658 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-04-25T09:58:42.658 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-04-25T09:58:42.658 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-04-25T09:58:42.658 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:58:42.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:58:42.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:58:42.658 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.admin", 2024-04-25T09:58:42.658 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpm8SYpBhAACl5SVNaaKZV7rIIFaFlmvw==", 2024-04-25T09:58:42.659 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:58:42.659 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-04-25T09:58:42.659 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T09:58:42.659 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T09:58:42.659 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:58:42.659 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:58:42.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:58:42.659 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:58:42.659 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.x", 2024-04-25T09:58:42.659 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmqIdPHxAACc5SoI1y74ickl2cPjfGIg==", 2024-04-25T09:58:42.659 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:58:42.659 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-04-25T09:58:42.660 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2024-04-25T09:58:42.660 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:58:42.660 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:58:42.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T09:58:42.660 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:58:42.660 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.y", 2024-04-25T09:58:42.660 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmCvpDGxAAYsxd6zUjxUgY0sYwR4VvAQ==", 2024-04-25T09:58:42.660 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T09:58:42.660 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-04-25T09:58:42.660 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2024-04-25T09:58:42.660 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T09:58:42.660 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:58:42.660 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:58:42.660 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-25T09:58:42.660 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T09:58:42.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.645+0000 7f91f8db0640 1 -- 172.21.15.7:0/2017126401 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f91d406b4d0 msgr2=0x7f91d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:42.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.645+0000 7f91f8db0640 1 --2- 172.21.15.7:0/2017126401 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f91d406b4d0 0x7f91d406d990 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f91ec001f10 tx=0x7f91ec009040 comp rx=0 tx=0).stop 2024-04-25T09:58:42.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.645+0000 7f91f8db0640 1 -- 172.21.15.7:0/2017126401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91f406c330 msgr2=0x7f91f41598e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:42.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.645+0000 7f91f8db0640 1 --2- 172.21.15.7:0/2017126401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91f406c330 0x7f91f41598e0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f91e400d800 tx=0x7f91e400dcc0 comp rx=0 tx=0).stop 2024-04-25T09:58:42.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.645+0000 7f91f8db0640 1 -- 172.21.15.7:0/2017126401 shutdown_connections 2024-04-25T09:58:42.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.645+0000 7f91f8db0640 1 --2- 172.21.15.7:0/2017126401 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f91d406b4d0 0x7f91d406d990 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:42.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.645+0000 7f91f8db0640 1 --2- 172.21.15.7:0/2017126401 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f91f415da20 0x7f91f41e7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:42.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.645+0000 7f91f8db0640 1 --2- 172.21.15.7:0/2017126401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91f406c330 0x7f91f41598e0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:42.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.645+0000 7f91f8db0640 1 --2- 172.21.15.7:0/2017126401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91f406bc70 0x7f91f41f39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:42.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.645+0000 7f91f8db0640 1 -- 172.21.15.7:0/2017126401 >> 172.21.15.7:0/2017126401 conn(0x7f91f40d16f0 msgr2=0x7f91f406f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:42.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.645+0000 7f91f8db0640 1 -- 172.21.15.7:0/2017126401 shutdown_connections 2024-04-25T09:58:42.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.645+0000 7f91f8db0640 1 -- 172.21.15.7:0/2017126401 wait complete. 2024-04-25T09:58:42.663 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:58:42.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.761+0000 7fb16a94c640 1 Processor -- start 2024-04-25T09:58:42.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.761+0000 7fb16a94c640 1 -- start start 2024-04-25T09:58:42.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.762+0000 7fb16a94c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb16415dd00 0x7fb1640b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:42.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.762+0000 7fb16a94c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb16406c6c0 0x7fb1640b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:42.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.762+0000 7fb16a94c640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb16406cd00 con 0x7fb1640b6a40 2024-04-25T09:58:42.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.762+0000 7fb16a94c640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb16415e0e0 con 0x7fb16415dd00 2024-04-25T09:58:42.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.762+0000 7fb16a94c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb16406cfe0 con 0x7fb16406c6c0 2024-04-25T09:58:42.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.762+0000 7fb163fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb16415dd00 0x7fb1640b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:42.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.762+0000 7fb1637fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb1640b6a40 0x7fb16406bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58112/0 (socket says 172.21.15.7:58112) 2024-04-25T09:58:42.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.762+0000 7fb1637fe640 1 -- 172.21.15.7:0/1361432922 learned_addr learned my addr 172.21.15.7:0/1361432922 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:42.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.762+0000 7fb163fff640 1 -- 172.21.15.7:0/1361432922 >> v2:172.21.15.55:3300/0 conn(0x7fb16406c6c0 msgr2=0x7fb1640b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:42.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.762+0000 7fb163fff640 1 --2- 172.21.15.7:0/1361432922 >> v2:172.21.15.55:3300/0 conn(0x7fb16406c6c0 0x7fb1640b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:42.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.762+0000 7fb163fff640 1 -- 172.21.15.7:0/1361432922 >> v1:172.21.15.7:6789/0 conn(0x7fb1640b6a40 legacy=0x7fb16406bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:42.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.762+0000 7fb163fff640 1 -- 172.21.15.7:0/1361432922 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1640d1ca0 con 0x7fb16415dd00 2024-04-25T09:58:42.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.763+0000 7fb163fff640 1 --2- 172.21.15.7:0/1361432922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb16415dd00 0x7fb1640b5750 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fb1640d0270 tx=0x7fb15402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7eb547eb646859f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:42.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.763+0000 7fb162ffd640 1 -- 172.21.15.7:0/1361432922 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb154037070 con 0x7fb16415dd00 2024-04-25T09:58:42.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.763+0000 7fb162ffd640 1 -- 172.21.15.7:0/1361432922 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb154032440 con 0x7fb16415dd00 2024-04-25T09:58:42.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.763+0000 7fb162ffd640 1 -- 172.21.15.7:0/1361432922 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb154032810 con 0x7fb16415dd00 2024-04-25T09:58:42.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.763+0000 7fb16a94c640 1 -- 172.21.15.7:0/1361432922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb16415dd00 msgr2=0x7fb1640b5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:42.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.763+0000 7fb16a94c640 1 --2- 172.21.15.7:0/1361432922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb16415dd00 0x7fb1640b5750 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fb1640d0270 tx=0x7fb15402a230 comp rx=0 tx=0).stop 2024-04-25T09:58:42.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.763+0000 7fb16a94c640 1 -- 172.21.15.7:0/1361432922 shutdown_connections 2024-04-25T09:58:42.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.763+0000 7fb16a94c640 1 --2- 172.21.15.7:0/1361432922 >> v2:172.21.15.55:3300/0 conn(0x7fb16406c6c0 0x7fb1640b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:42.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.763+0000 7fb16a94c640 1 --2- 172.21.15.7:0/1361432922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb16415dd00 0x7fb1640b5750 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:42.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.763+0000 7fb16a94c640 1 -- 172.21.15.7:0/1361432922 >> 172.21.15.7:0/1361432922 conn(0x7fb1640d07b0 msgr2=0x7fb1640d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:42.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.763+0000 7fb16a94c640 1 -- 172.21.15.7:0/1361432922 shutdown_connections 2024-04-25T09:58:42.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.764+0000 7fb16a94c640 1 -- 172.21.15.7:0/1361432922 wait complete. 2024-04-25T09:58:42.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.765+0000 7fb16a94c640 1 Processor -- start 2024-04-25T09:58:42.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.765+0000 7fb16a94c640 1 -- start start 2024-04-25T09:58:42.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.766+0000 7fb16a94c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb16406c6c0 0x7fb16414e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:42.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.766+0000 7fb16a94c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1640b6a40 0x7fb1640cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:42.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.766+0000 7fb16a94c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb16415dd00 0x7fb164144b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:42.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.766+0000 7fb16a94c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1640d2780 con 0x7fb1640b6a40 2024-04-25T09:58:42.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.766+0000 7fb16a94c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1640d2260 con 0x7fb16406c6c0 2024-04-25T09:58:42.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.766+0000 7fb16a94c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1640d2900 con 0x7fb16415dd00 2024-04-25T09:58:42.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.766+0000 7fb1637fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1640b6a40 0x7fb1640cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:42.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.766+0000 7fb1637fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1640b6a40 0x7fb1640cd4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36760/0 (socket says 172.21.15.7:36760) 2024-04-25T09:58:42.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.766+0000 7fb1637fe640 1 -- 172.21.15.7:0/2402351987 learned_addr learned my addr 172.21.15.7:0/2402351987 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:42.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.766+0000 7fb163fff640 1 --2- 172.21.15.7:0/2402351987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb16406c6c0 0x7fb16414e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:42.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.766+0000 7fb1637fe640 1 -- 172.21.15.7:0/2402351987 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb16415dd00 msgr2=0x7fb164144b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:42.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.766+0000 7fb1637fe640 1 --2- 172.21.15.7:0/2402351987 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb16415dd00 0x7fb164144b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:42.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.766+0000 7fb1637fe640 1 -- 172.21.15.7:0/2402351987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb16406c6c0 msgr2=0x7fb16414e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:42.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.766+0000 7fb1637fe640 1 --2- 172.21.15.7:0/2402351987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb16406c6c0 0x7fb16414e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:42.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.766+0000 7fb1637fe640 1 -- 172.21.15.7:0/2402351987 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1640cc390 con 0x7fb1640b6a40 2024-04-25T09:58:42.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.766+0000 7fb163fff640 1 --2- 172.21.15.7:0/2402351987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb16406c6c0 0x7fb16414e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:58:42.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.766+0000 7fb1637fe640 1 --2- 172.21.15.7:0/2402351987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1640b6a40 0x7fb1640cd4f0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fb15800c400 tx=0x7fb15800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:42.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.766+0000 7fb160ff9640 1 -- 172.21.15.7:0/2402351987 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158017070 con 0x7fb1640b6a40 2024-04-25T09:58:42.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.766+0000 7fb160ff9640 1 -- 172.21.15.7:0/2402351987 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb158005ce0 con 0x7fb1640b6a40 2024-04-25T09:58:42.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.766+0000 7fb16a94c640 1 -- 172.21.15.7:0/2402351987 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1640cca10 con 0x7fb1640b6a40 2024-04-25T09:58:42.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.766+0000 7fb160ff9640 1 -- 172.21.15.7:0/2402351987 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1580072f0 con 0x7fb1640b6a40 2024-04-25T09:58:42.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.766+0000 7fb16a94c640 1 -- 172.21.15.7:0/2402351987 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1640ccfd0 con 0x7fb1640b6a40 2024-04-25T09:58:42.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.767+0000 7fb16a94c640 1 -- 172.21.15.7:0/2402351987 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb164068fd0 con 0x7fb1640b6a40 2024-04-25T09:58:42.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.768+0000 7fb160ff9640 1 -- 172.21.15.7:0/2402351987 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb15801a070 con 0x7fb1640b6a40 2024-04-25T09:58:42.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.768+0000 7fb160ff9640 1 --2- 172.21.15.7:0/2402351987 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb15006b4d0 0x7fb15006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:42.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.768+0000 7fb160ff9640 1 -- 172.21.15.7:0/2402351987 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fb1580894c0 con 0x7fb1640b6a40 2024-04-25T09:58:42.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.768+0000 7fb163fff640 1 --2- 172.21.15.7:0/2402351987 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb15006b4d0 0x7fb15006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:42.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.769+0000 7fb163fff640 1 --2- 172.21.15.7:0/2402351987 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb15006b4d0 0x7fb15006d990 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb154034000 tx=0x7fb15402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:42.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.772+0000 7fb160ff9640 1 -- 172.21.15.7:0/2402351987 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb158058470 con 0x7fb1640b6a40 2024-04-25T09:58:42.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.956+0000 7fb16a94c640 1 -- 172.21.15.7:0/2402351987 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1640d1620 con 0x7fb1640b6a40 2024-04-25T09:58:42.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.957+0000 7fb160ff9640 1 -- 172.21.15.7:0/2402351987 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+13069 (secure 0 0 0) 0x7fb158057d70 con 0x7fb1640b6a40 2024-04-25T09:58:42.961 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:58:42.961 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":71,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:58:42.260438+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:58:42.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.959+0000 7fb16a94c640 1 -- 172.21.15.7:0/2402351987 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb15006b4d0 msgr2=0x7fb15006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:42.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.959+0000 7fb16a94c640 1 --2- 172.21.15.7:0/2402351987 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb15006b4d0 0x7fb15006d990 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb154034000 tx=0x7fb15402e000 comp rx=0 tx=0).stop 2024-04-25T09:58:42.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.959+0000 7fb16a94c640 1 -- 172.21.15.7:0/2402351987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1640b6a40 msgr2=0x7fb1640cd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:42.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.959+0000 7fb16a94c640 1 --2- 172.21.15.7:0/2402351987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1640b6a40 0x7fb1640cd4f0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fb15800c400 tx=0x7fb15800c8c0 comp rx=0 tx=0).stop 2024-04-25T09:58:42.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.959+0000 7fb16a94c640 1 -- 172.21.15.7:0/2402351987 shutdown_connections 2024-04-25T09:58:42.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.959+0000 7fb16a94c640 1 --2- 172.21.15.7:0/2402351987 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb15006b4d0 0x7fb15006d990 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:42.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.959+0000 7fb16a94c640 1 --2- 172.21.15.7:0/2402351987 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb16415dd00 0x7fb164144b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:42.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.959+0000 7fb16a94c640 1 --2- 172.21.15.7:0/2402351987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1640b6a40 0x7fb1640cd4f0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:42.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.959+0000 7fb16a94c640 1 --2- 172.21.15.7:0/2402351987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb16406c6c0 0x7fb16414e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:42.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.959+0000 7fb16a94c640 1 -- 172.21.15.7:0/2402351987 >> 172.21.15.7:0/2402351987 conn(0x7fb1640d07b0 msgr2=0x7fb1640b3370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:42.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.959+0000 7fb16a94c640 1 -- 172.21.15.7:0/2402351987 shutdown_connections 2024-04-25T09:58:42.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:42.959+0000 7fb16a94c640 1 -- 172.21.15.7:0/2402351987 wait complete. 2024-04-25T09:58:42.974 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:58:42.974 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:58:43.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.075+0000 7f78c5134640 1 Processor -- start 2024-04-25T09:58:43.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.075+0000 7f78c5134640 1 -- start start 2024-04-25T09:58:43.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.076+0000 7f78c5134640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f78c00d3e70 0x7f78c00ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:43.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.076+0000 7f78c5134640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c00d1a40 con 0x7f78c00b2c30 2024-04-25T09:58:43.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.076+0000 7f78c5134640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c00d1d20 con 0x7f78c015deb0 2024-04-25T09:58:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.076+0000 7f78c5134640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c00d2000 con 0x7f78c00d3e70 2024-04-25T09:58:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.076+0000 7f78be59c640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f78c00b2c30 0x7f78c00d3760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58120/0 (socket says 172.21.15.7:58120) 2024-04-25T09:58:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.076+0000 7f78be59c640 1 -- 172.21.15.7:0/769970830 learned_addr learned my addr 172.21.15.7:0/769970830 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.076+0000 7f78bdd9b640 1 -- 172.21.15.7:0/769970830 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 544305737 0 0) 0x7f78c00d1a40 con 0x7f78c00b2c30 2024-04-25T09:58:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.076+0000 7f78bdd9b640 1 -- 172.21.15.7:0/769970830 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78a8003520 con 0x7f78c00b2c30 2024-04-25T09:58:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.076+0000 7f78bf59e640 1 --2- 172.21.15.7:0/769970830 >> v2:172.21.15.55:3300/0 conn(0x7f78c00d3e70 0x7f78c00ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.076+0000 7f78bdd9b640 1 -- 172.21.15.7:0/769970830 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4030107115 0 0) 0x7f78a8003520 con 0x7f78c00b2c30 2024-04-25T09:58:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.076+0000 7f78bdd9b640 1 -- 172.21.15.7:0/769970830 >> v2:172.21.15.55:3300/0 conn(0x7f78c00d3e70 msgr2=0x7f78c00ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.076+0000 7f78bdd9b640 1 --2- 172.21.15.7:0/769970830 >> v2:172.21.15.55:3300/0 conn(0x7f78c00d3e70 0x7f78c00ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.076+0000 7f78bdd9b640 1 -- 172.21.15.7:0/769970830 >> v1:172.21.15.55:6789/0 conn(0x7f78c015deb0 legacy=0x7f78c00b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.076+0000 7f78bdd9b640 1 -- 172.21.15.7:0/769970830 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c00d22e0 con 0x7f78c00b2c30 2024-04-25T09:58:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.076+0000 7f78bdd9b640 1 -- 172.21.15.7:0/769970830 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f78b4001670 con 0x7f78c00b2c30 2024-04-25T09:58:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.076+0000 7f78bdd9b640 1 -- 172.21.15.7:0/769970830 >> v1:172.21.15.7:6789/0 conn(0x7f78c00b2c30 legacy=0x7f78c00d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.076+0000 7f78bdd9b640 1 --2- 172.21.15.7:0/769970830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78a80039b0 0x7f78a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.076+0000 7f78bdd9b640 1 --2- 172.21.15.7:0/769970830 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78a8004800 0x7f78a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.077+0000 7f78bdd9b640 1 --2- 172.21.15.7:0/769970830 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f78a80051c0 0x7f78a800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.077+0000 7f78bdd9b640 1 -- 172.21.15.7:0/769970830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c00d2000 con 0x7f78a80039b0 2024-04-25T09:58:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.077+0000 7f78bdd9b640 1 -- 172.21.15.7:0/769970830 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a800c060 con 0x7f78a8004800 2024-04-25T09:58:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.077+0000 7f78bdd9b640 1 -- 172.21.15.7:0/769970830 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a800c260 con 0x7f78a80051c0 2024-04-25T09:58:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.077+0000 7f78bed9d640 1 --2- 172.21.15.7:0/769970830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78a80039b0 0x7f78a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.077+0000 7f78be59c640 1 --2- 172.21.15.7:0/769970830 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78a8004800 0x7f78a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.077+0000 7f78bf59e640 1 --2- 172.21.15.7:0/769970830 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f78a80051c0 0x7f78a800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.077+0000 7f78bed9d640 1 -- 172.21.15.7:0/769970830 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f78a80051c0 msgr2=0x7f78a800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.077+0000 7f78bed9d640 1 --2- 172.21.15.7:0/769970830 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f78a80051c0 0x7f78a800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.077+0000 7f78bed9d640 1 -- 172.21.15.7:0/769970830 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78a8004800 msgr2=0x7f78a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.077+0000 7f78bed9d640 1 --2- 172.21.15.7:0/769970830 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78a8004800 0x7f78a8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.077+0000 7f78bed9d640 1 -- 172.21.15.7:0/769970830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a8003520 con 0x7f78a80039b0 2024-04-25T09:58:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.077+0000 7f78bf59e640 1 -- 172.21.15.7:0/769970830 reap_dead start 2024-04-25T09:58:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.078+0000 7f78bed9d640 1 --2- 172.21.15.7:0/769970830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78a80039b0 0x7f78a8003dd0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f78b0001750 tx=0x7f78a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85491332ebf4fa01 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.078+0000 7f78bdd9b640 1 -- 172.21.15.7:0/769970830 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b0001370 con 0x7f78a80039b0 2024-04-25T09:58:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.078+0000 7f78bdd9b640 1 -- 172.21.15.7:0/769970830 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b00052d0 con 0x7f78a80039b0 2024-04-25T09:58:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.078+0000 7f78bdd9b640 1 -- 172.21.15.7:0/769970830 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b002abe0 con 0x7f78a80039b0 2024-04-25T09:58:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.078+0000 7f78c5134640 1 -- 172.21.15.7:0/769970830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78a80039b0 msgr2=0x7f78a8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.078+0000 7f78c5134640 1 --2- 172.21.15.7:0/769970830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78a80039b0 0x7f78a8003dd0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f78b0001750 tx=0x7f78a8005830 comp rx=0 tx=0).stop 2024-04-25T09:58:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.078+0000 7f78c5134640 1 -- 172.21.15.7:0/769970830 shutdown_connections 2024-04-25T09:58:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.078+0000 7f78c5134640 1 --2- 172.21.15.7:0/769970830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78a80039b0 0x7f78a8003dd0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.078+0000 7f78c5134640 1 -- 172.21.15.7:0/769970830 >> 172.21.15.7:0/769970830 conn(0x7f78c00726b0 msgr2=0x7f78c0072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.078+0000 7f78c5134640 1 -- 172.21.15.7:0/769970830 shutdown_connections 2024-04-25T09:58:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.078+0000 7f78c5134640 1 -- 172.21.15.7:0/769970830 wait complete. 2024-04-25T09:58:43.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.080+0000 7f78c5134640 1 Processor -- start 2024-04-25T09:58:43.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.080+0000 7f78c5134640 1 -- start start 2024-04-25T09:58:43.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.080+0000 7f78c5134640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f78a80039b0 0x7f78c00b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:43.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.080+0000 7f78c5134640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78c00b41f0 0x7f78c00cd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:43.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.080+0000 7f78c5134640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78c00cd6c0 0x7f78c00c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:43.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.080+0000 7f78c5134640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c00ce1b0 con 0x7f78c00b41f0 2024-04-25T09:58:43.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.080+0000 7f78c5134640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c00ce030 con 0x7f78c00cd6c0 2024-04-25T09:58:43.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.080+0000 7f78c5134640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c00ce330 con 0x7f78a80039b0 2024-04-25T09:58:43.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.081+0000 7f78be59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78c00b41f0 0x7f78c00cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:43.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.081+0000 7f78be59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78c00b41f0 0x7f78c00cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36766/0 (socket says 172.21.15.7:36766) 2024-04-25T09:58:43.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.081+0000 7f78be59c640 1 -- 172.21.15.7:0/1227751865 learned_addr learned my addr 172.21.15.7:0/1227751865 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:43.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.081+0000 7f78bf59e640 1 --2- 172.21.15.7:0/1227751865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78c00cd6c0 0x7f78c00c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:43.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.081+0000 7f78bed9d640 1 --2- 172.21.15.7:0/1227751865 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f78a80039b0 0x7f78c00b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:43.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.081+0000 7f78be59c640 1 -- 172.21.15.7:0/1227751865 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f78a80039b0 msgr2=0x7f78c00b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:43.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.081+0000 7f78be59c640 1 --2- 172.21.15.7:0/1227751865 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f78a80039b0 0x7f78c00b5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:43.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.081+0000 7f78be59c640 1 -- 172.21.15.7:0/1227751865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78c00cd6c0 msgr2=0x7f78c00c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:43.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.081+0000 7f78be59c640 1 --2- 172.21.15.7:0/1227751865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78c00cd6c0 0x7f78c00c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:43.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.081+0000 7f78be59c640 1 -- 172.21.15.7:0/1227751865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c01f6d00 con 0x7f78c00b41f0 2024-04-25T09:58:43.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.081+0000 7f78be59c640 1 --2- 172.21.15.7:0/1227751865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78c00b41f0 0x7f78c00cd180 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f78b400e730 tx=0x7f78b400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:43.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.081+0000 7f78a77fe640 1 -- 172.21.15.7:0/1227751865 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b400ee40 con 0x7f78c00b41f0 2024-04-25T09:58:43.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.081+0000 7f78a77fe640 1 -- 172.21.15.7:0/1227751865 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b4018070 con 0x7f78c00b41f0 2024-04-25T09:58:43.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.081+0000 7f78c5134640 1 -- 172.21.15.7:0/1227751865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c01f6fa0 con 0x7f78c00b41f0 2024-04-25T09:58:43.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.081+0000 7f78a77fe640 1 -- 172.21.15.7:0/1227751865 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b400cab0 con 0x7f78c00b41f0 2024-04-25T09:58:43.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.081+0000 7f78c5134640 1 -- 172.21.15.7:0/1227751865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c01f7560 con 0x7f78c00b41f0 2024-04-25T09:58:43.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.082+0000 7f78c5134640 1 -- 172.21.15.7:0/1227751865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c0068f60 con 0x7f78c00b41f0 2024-04-25T09:58:43.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.083+0000 7f78a77fe640 1 -- 172.21.15.7:0/1227751865 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f78b400cc50 con 0x7f78c00b41f0 2024-04-25T09:58:43.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.083+0000 7f78a77fe640 1 --2- 172.21.15.7:0/1227751865 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f78ac06b4d0 0x7f78ac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:43.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.083+0000 7f78a77fe640 1 -- 172.21.15.7:0/1227751865 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f78b4089da0 con 0x7f78c00b41f0 2024-04-25T09:58:43.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.083+0000 7f78bed9d640 1 --2- 172.21.15.7:0/1227751865 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f78ac06b4d0 0x7f78ac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:43.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.084+0000 7f78bed9d640 1 --2- 172.21.15.7:0/1227751865 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f78ac06b4d0 0x7f78ac06d990 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f78b0032000 tx=0x7f78b002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:43.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.087+0000 7f78a77fe640 1 -- 172.21.15.7:0/1227751865 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f78b4058e70 con 0x7f78c00b41f0 2024-04-25T09:58:43.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.272+0000 7f78c5134640 1 -- 172.21.15.7:0/1227751865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f78c0072c30 con 0x7f78c00b41f0 2024-04-25T09:58:43.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.272+0000 7f78a77fe640 1 -- 172.21.15.7:0/1227751865 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) v1 ==== 93+0+10 (secure 0 0 0) 0x7f78b4058770 con 0x7f78c00b41f0 2024-04-25T09:58:43.276 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T09:58:43.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.274+0000 7f78c5134640 1 -- 172.21.15.7:0/1227751865 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f78ac06b4d0 msgr2=0x7f78ac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:43.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.274+0000 7f78c5134640 1 --2- 172.21.15.7:0/1227751865 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f78ac06b4d0 0x7f78ac06d990 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f78b0032000 tx=0x7f78b002e000 comp rx=0 tx=0).stop 2024-04-25T09:58:43.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.274+0000 7f78c5134640 1 -- 172.21.15.7:0/1227751865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78c00b41f0 msgr2=0x7f78c00cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:43.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.274+0000 7f78c5134640 1 --2- 172.21.15.7:0/1227751865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78c00b41f0 0x7f78c00cd180 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f78b400e730 tx=0x7f78b400ebf0 comp rx=0 tx=0).stop 2024-04-25T09:58:43.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.274+0000 7f78c5134640 1 -- 172.21.15.7:0/1227751865 shutdown_connections 2024-04-25T09:58:43.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.274+0000 7f78c5134640 1 --2- 172.21.15.7:0/1227751865 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f78ac06b4d0 0x7f78ac06d990 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:43.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.274+0000 7f78c5134640 1 --2- 172.21.15.7:0/1227751865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78c00cd6c0 0x7f78c00c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:43.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.274+0000 7f78c5134640 1 --2- 172.21.15.7:0/1227751865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78c00b41f0 0x7f78c00cd180 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:43.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.274+0000 7f78c5134640 1 --2- 172.21.15.7:0/1227751865 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f78a80039b0 0x7f78c00b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:43.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.274+0000 7f78c5134640 1 -- 172.21.15.7:0/1227751865 >> 172.21.15.7:0/1227751865 conn(0x7f78c00726b0 msgr2=0x7f78c00c7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:43.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.274+0000 7f78c5134640 1 -- 172.21.15.7:0/1227751865 shutdown_connections 2024-04-25T09:58:43.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.274+0000 7f78c5134640 1 -- 172.21.15.7:0/1227751865 wait complete. 2024-04-25T09:58:43.289 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:58:43.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.387+0000 7f30c5837640 1 Processor -- start 2024-04-25T09:58:43.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.387+0000 7f30c5837640 1 -- start start 2024-04-25T09:58:43.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.387+0000 7f30c5837640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f30c015ef70 0x7f30c00c51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:43.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.387+0000 7f30c5837640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30c009ab50 0x7f30c00cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:43.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.387+0000 7f30c5837640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c00cd0b0 con 0x7f30c00cf220 2024-04-25T09:58:43.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.387+0000 7f30c5837640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c00999f0 con 0x7f30c015ef70 2024-04-25T09:58:43.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.387+0000 7f30c5837640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c015f350 con 0x7f30c009ab50 2024-04-25T09:58:43.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.388+0000 7f30beffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f30c015ef70 0x7f30c00c51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:43.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.388+0000 7f30be7fc640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f30c00cf220 0x7f30c009a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58122/0 (socket says 172.21.15.7:58122) 2024-04-25T09:58:43.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.388+0000 7f30be7fc640 1 -- 172.21.15.7:0/3975469232 learned_addr learned my addr 172.21.15.7:0/3975469232 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:43.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.388+0000 7f30bf7fe640 1 --2- 172.21.15.7:0/3975469232 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30c009ab50 0x7f30c00cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:43.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.388+0000 7f30beffd640 1 -- 172.21.15.7:0/3975469232 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30c009ab50 msgr2=0x7f30c00cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:43.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.388+0000 7f30beffd640 1 --2- 172.21.15.7:0/3975469232 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30c009ab50 0x7f30c00cf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:43.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.388+0000 7f30beffd640 1 -- 172.21.15.7:0/3975469232 >> v1:172.21.15.7:6789/0 conn(0x7f30c00cf220 legacy=0x7f30c009a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:43.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.388+0000 7f30beffd640 1 -- 172.21.15.7:0/3975469232 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c00cd330 con 0x7f30c015ef70 2024-04-25T09:58:43.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.388+0000 7f30bdffb640 1 -- 172.21.15.7:0/3975469232 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2785360207 0 0) 0x7f30b4001110 con 0x7f30c00cf220 2024-04-25T09:58:43.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.388+0000 7f30bf7fe640 1 --2- 172.21.15.7:0/3975469232 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30c009ab50 0x7f30c00cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:58:43.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.389+0000 7f30beffd640 1 --2- 172.21.15.7:0/3975469232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30c015ef70 0x7f30c00c51a0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f30b80097a0 tx=0x7f30b802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c159ba56ce4d7752 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:43.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.389+0000 7f30bdffb640 1 -- 172.21.15.7:0/3975469232 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b8037070 con 0x7f30c015ef70 2024-04-25T09:58:43.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.389+0000 7f30bdffb640 1 -- 172.21.15.7:0/3975469232 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b802ae50 con 0x7f30c015ef70 2024-04-25T09:58:43.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.389+0000 7f30bdffb640 1 -- 172.21.15.7:0/3975469232 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b8032660 con 0x7f30c015ef70 2024-04-25T09:58:43.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.389+0000 7f30c5837640 1 -- 172.21.15.7:0/3975469232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30c015ef70 msgr2=0x7f30c00c51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:43.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.389+0000 7f30c5837640 1 --2- 172.21.15.7:0/3975469232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30c015ef70 0x7f30c00c51a0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f30b80097a0 tx=0x7f30b802a100 comp rx=0 tx=0).stop 2024-04-25T09:58:43.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.389+0000 7f30c5837640 1 -- 172.21.15.7:0/3975469232 shutdown_connections 2024-04-25T09:58:43.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.389+0000 7f30c5837640 1 --2- 172.21.15.7:0/3975469232 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30c009ab50 0x7f30c00cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:43.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.389+0000 7f30c5837640 1 --2- 172.21.15.7:0/3975469232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30c015ef70 0x7f30c00c51a0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:43.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.389+0000 7f30c5837640 1 -- 172.21.15.7:0/3975469232 >> 172.21.15.7:0/3975469232 conn(0x7f30c00b3140 msgr2=0x7f30c00b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:43.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.389+0000 7f30c5837640 1 -- 172.21.15.7:0/3975469232 shutdown_connections 2024-04-25T09:58:43.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.389+0000 7f30c5837640 1 -- 172.21.15.7:0/3975469232 wait complete. 2024-04-25T09:58:43.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.390+0000 7f30c5837640 1 Processor -- start 2024-04-25T09:58:43.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.391+0000 7f30c5837640 1 -- start start 2024-04-25T09:58:43.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.391+0000 7f30c5837640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30c009ab50 0x7f30c015bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:43.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.391+0000 7f30c5837640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30c00cf220 0x7f30c0155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:43.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.391+0000 7f30c5837640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30c015ef70 0x7f30c015d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:43.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.391+0000 7f30c5837640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c00cc0c0 con 0x7f30c009ab50 2024-04-25T09:58:43.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.391+0000 7f30c5837640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c0099f20 con 0x7f30c015ef70 2024-04-25T09:58:43.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.391+0000 7f30c5837640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c00cc240 con 0x7f30c00cf220 2024-04-25T09:58:43.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.391+0000 7f30beffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30c009ab50 0x7f30c015bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:43.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.391+0000 7f30beffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30c009ab50 0x7f30c015bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36778/0 (socket says 172.21.15.7:36778) 2024-04-25T09:58:43.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.392+0000 7f30beffd640 1 -- 172.21.15.7:0/3982588815 learned_addr learned my addr 172.21.15.7:0/3982588815 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:43.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.392+0000 7f30bf7fe640 1 --2- 172.21.15.7:0/3982588815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30c015ef70 0x7f30c015d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:43.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.392+0000 7f30be7fc640 1 --2- 172.21.15.7:0/3982588815 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30c00cf220 0x7f30c0155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:43.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.392+0000 7f30beffd640 1 -- 172.21.15.7:0/3982588815 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30c00cf220 msgr2=0x7f30c0155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:43.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.392+0000 7f30beffd640 1 --2- 172.21.15.7:0/3982588815 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30c00cf220 0x7f30c0155ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:43.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.392+0000 7f30beffd640 1 -- 172.21.15.7:0/3982588815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30c015ef70 msgr2=0x7f30c015d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:43.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.392+0000 7f30beffd640 1 --2- 172.21.15.7:0/3982588815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30c015ef70 0x7f30c015d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:43.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.392+0000 7f30beffd640 1 -- 172.21.15.7:0/3982588815 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c015c600 con 0x7f30c009ab50 2024-04-25T09:58:43.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.392+0000 7f30be7fc640 1 --2- 172.21.15.7:0/3982588815 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30c00cf220 0x7f30c0155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:58:43.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.392+0000 7f30beffd640 1 --2- 172.21.15.7:0/3982588815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30c009ab50 0x7f30c015bdb0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f30b80098c0 tx=0x7f30b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:43.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.392+0000 7f30a7fff640 1 -- 172.21.15.7:0/3982588815 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b8041030 con 0x7f30c009ab50 2024-04-25T09:58:43.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.392+0000 7f30a7fff640 1 -- 172.21.15.7:0/3982588815 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b802ac50 con 0x7f30c009ab50 2024-04-25T09:58:43.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.392+0000 7f30c5837640 1 -- 172.21.15.7:0/3982588815 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c015c8e0 con 0x7f30c009ab50 2024-04-25T09:58:43.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.392+0000 7f30a7fff640 1 -- 172.21.15.7:0/3982588815 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b8037040 con 0x7f30c009ab50 2024-04-25T09:58:43.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.392+0000 7f30c5837640 1 -- 172.21.15.7:0/3982588815 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c015c2f0 con 0x7f30c009ab50 2024-04-25T09:58:43.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.393+0000 7f30c5837640 1 -- 172.21.15.7:0/3982588815 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c00cd9e0 con 0x7f30c009ab50 2024-04-25T09:58:43.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.394+0000 7f30a7fff640 1 -- 172.21.15.7:0/3982588815 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f30b8044070 con 0x7f30c009ab50 2024-04-25T09:58:43.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.394+0000 7f30a7fff640 1 --2- 172.21.15.7:0/3982588815 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f30ac06b4d0 0x7f30ac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:43.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.394+0000 7f30be7fc640 1 --2- 172.21.15.7:0/3982588815 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f30ac06b4d0 0x7f30ac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:43.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.394+0000 7f30a7fff640 1 -- 172.21.15.7:0/3982588815 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f30b802ae00 con 0x7f30c009ab50 2024-04-25T09:58:43.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.395+0000 7f30be7fc640 1 --2- 172.21.15.7:0/3982588815 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f30ac06b4d0 0x7f30ac06d990 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f30c00ca090 tx=0x7f30b4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:43.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.398+0000 7f30a7fff640 1 -- 172.21.15.7:0/3982588815 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f30c00cd9e0 con 0x7f30c009ab50 2024-04-25T09:58:43.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.584+0000 7f30c5837640 1 -- 172.21.15.7:0/3982588815 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f30c00b48c0 con 0x7f30c009ab50 2024-04-25T09:58:43.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.584+0000 7f30a7fff640 1 -- 172.21.15.7:0/3982588815 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v71) v1 ==== 84+0+65 (secure 0 0 0) 0x7f30b804b070 con 0x7f30c009ab50 2024-04-25T09:58:43.588 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:58:43.588 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2024-04-25T09:58:43.588 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:58:43.588 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2024-04-25T09:58:43.588 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2024-04-25T09:58:43.588 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:58:43.588 INFO:teuthology.orchestra.run.smithi007.stdout:] 2024-04-25T09:58:43.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.586+0000 7f30c5837640 1 -- 172.21.15.7:0/3982588815 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f30ac06b4d0 msgr2=0x7f30ac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:43.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.586+0000 7f30c5837640 1 --2- 172.21.15.7:0/3982588815 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f30ac06b4d0 0x7f30ac06d990 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f30c00ca090 tx=0x7f30b4009040 comp rx=0 tx=0).stop 2024-04-25T09:58:43.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.586+0000 7f30c5837640 1 -- 172.21.15.7:0/3982588815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30c009ab50 msgr2=0x7f30c015bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:43.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.586+0000 7f30c5837640 1 --2- 172.21.15.7:0/3982588815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30c009ab50 0x7f30c015bdb0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f30b80098c0 tx=0x7f30b80046c0 comp rx=0 tx=0).stop 2024-04-25T09:58:43.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.586+0000 7f30c5837640 1 -- 172.21.15.7:0/3982588815 shutdown_connections 2024-04-25T09:58:43.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.586+0000 7f30c5837640 1 --2- 172.21.15.7:0/3982588815 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f30ac06b4d0 0x7f30ac06d990 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:43.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.586+0000 7f30c5837640 1 --2- 172.21.15.7:0/3982588815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30c015ef70 0x7f30c015d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:43.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.586+0000 7f30c5837640 1 --2- 172.21.15.7:0/3982588815 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30c00cf220 0x7f30c0155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:43.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.586+0000 7f30c5837640 1 --2- 172.21.15.7:0/3982588815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30c009ab50 0x7f30c015bdb0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:43.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.586+0000 7f30c5837640 1 -- 172.21.15.7:0/3982588815 >> 172.21.15.7:0/3982588815 conn(0x7f30c00b3140 msgr2=0x7f30c0073720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:43.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.586+0000 7f30c5837640 1 -- 172.21.15.7:0/3982588815 shutdown_connections 2024-04-25T09:58:43.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.586+0000 7f30c5837640 1 -- 172.21.15.7:0/3982588815 wait complete. 2024-04-25T09:58:43.601 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:58:43.601 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:58:43.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.701+0000 7effc43fe640 1 Processor -- start 2024-04-25T09:58:43.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.701+0000 7effc43fe640 1 -- start start 2024-04-25T09:58:43.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.702+0000 7effc43fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7effbc15d980 0x7effbc161520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:43.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.702+0000 7effc43fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7effbc15e5f0 0x7effbc15ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:43.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.702+0000 7effc43fe640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effbc162450 con 0x7effbc0b9390 2024-04-25T09:58:43.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.702+0000 7effc43fe640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effbc161bb0 con 0x7effbc15d980 2024-04-25T09:58:43.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.702+0000 7effc43fe640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effbc161e90 con 0x7effbc15e5f0 2024-04-25T09:58:43.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.702+0000 7effc219a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7effbc15d980 0x7effbc161520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:43.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.702+0000 7effc219a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7effbc15d980 0x7effbc161520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36782/0 (socket says 172.21.15.7:36782) 2024-04-25T09:58:43.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.702+0000 7effc219a640 1 -- 172.21.15.7:0/2641343696 learned_addr learned my addr 172.21.15.7:0/2641343696 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:43.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.702+0000 7effc299b640 1 --2- 172.21.15.7:0/2641343696 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7effbc15e5f0 0x7effbc15ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:43.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.702+0000 7effc219a640 1 -- 172.21.15.7:0/2641343696 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7effbc15e5f0 msgr2=0x7effbc15ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:43.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.702+0000 7effc219a640 1 --2- 172.21.15.7:0/2641343696 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7effbc15e5f0 0x7effbc15ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:43.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.702+0000 7effc219a640 1 -- 172.21.15.7:0/2641343696 >> v1:172.21.15.55:6789/0 conn(0x7effbc0b9390 legacy=0x7effbc0d1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:43.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.702+0000 7effc219a640 1 -- 172.21.15.7:0/2641343696 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc162170 con 0x7effbc15d980 2024-04-25T09:58:43.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.703+0000 7effc219a640 1 --2- 172.21.15.7:0/2641343696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effbc15d980 0x7effbc161520 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7effb4009e50 tx=0x7effb402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=504825ada0240599 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:43.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.703+0000 7effc1198640 1 -- 172.21.15.7:0/2641343696 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb4036070 con 0x7effbc15d980 2024-04-25T09:58:43.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.703+0000 7effc1198640 1 -- 172.21.15.7:0/2641343696 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb4031600 con 0x7effbc15d980 2024-04-25T09:58:43.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.703+0000 7effc1198640 1 -- 172.21.15.7:0/2641343696 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb40319d0 con 0x7effbc15d980 2024-04-25T09:58:43.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.704+0000 7effc43fe640 1 -- 172.21.15.7:0/2641343696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effbc15d980 msgr2=0x7effbc161520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:43.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.704+0000 7effc43fe640 1 --2- 172.21.15.7:0/2641343696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effbc15d980 0x7effbc161520 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7effb4009e50 tx=0x7effb402a6c0 comp rx=0 tx=0).stop 2024-04-25T09:58:43.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.704+0000 7effc43fe640 1 -- 172.21.15.7:0/2641343696 shutdown_connections 2024-04-25T09:58:43.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.704+0000 7effc43fe640 1 --2- 172.21.15.7:0/2641343696 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7effbc15e5f0 0x7effbc15ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:43.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.704+0000 7effc43fe640 1 --2- 172.21.15.7:0/2641343696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effbc15d980 0x7effbc161520 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:43.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.704+0000 7effc43fe640 1 -- 172.21.15.7:0/2641343696 >> 172.21.15.7:0/2641343696 conn(0x7effbc06c3d0 msgr2=0x7effbc06c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:43.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.704+0000 7effc43fe640 1 -- 172.21.15.7:0/2641343696 shutdown_connections 2024-04-25T09:58:43.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.704+0000 7effc43fe640 1 -- 172.21.15.7:0/2641343696 wait complete. 2024-04-25T09:58:43.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.705+0000 7effc43fe640 1 Processor -- start 2024-04-25T09:58:43.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.705+0000 7effc43fe640 1 -- start start 2024-04-25T09:58:43.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.706+0000 7effc43fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effbc0b9390 0x7effbc0c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:43.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.706+0000 7effc43fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effbc15d980 0x7effbc0cc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:43.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.706+0000 7effc43fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7effbc15e5f0 0x7effbc0b7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:43.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.706+0000 7effc43fe640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc15dd60 con 0x7effbc15d980 2024-04-25T09:58:43.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.706+0000 7effc43fe640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc0b9820 con 0x7effbc0b9390 2024-04-25T09:58:43.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.706+0000 7effc43fe640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effbc0d2150 con 0x7effbc15e5f0 2024-04-25T09:58:43.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.706+0000 7effc1999640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effbc15d980 0x7effbc0cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:43.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.706+0000 7effc1999640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effbc15d980 0x7effbc0cc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36792/0 (socket says 172.21.15.7:36792) 2024-04-25T09:58:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.706+0000 7effc1999640 1 -- 172.21.15.7:0/4291587486 learned_addr learned my addr 172.21.15.7:0/4291587486 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.706+0000 7effc219a640 1 --2- 172.21.15.7:0/4291587486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effbc0b9390 0x7effbc0c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.706+0000 7effc1999640 1 -- 172.21.15.7:0/4291587486 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7effbc15e5f0 msgr2=0x7effbc0b7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.706+0000 7effc1999640 1 --2- 172.21.15.7:0/4291587486 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7effbc15e5f0 0x7effbc0b7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.706+0000 7effc1999640 1 -- 172.21.15.7:0/4291587486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effbc0b9390 msgr2=0x7effbc0c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.706+0000 7effc1999640 1 --2- 172.21.15.7:0/4291587486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effbc0b9390 0x7effbc0c9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.706+0000 7effc1999640 1 -- 172.21.15.7:0/4291587486 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc0cc6b0 con 0x7effbc15d980 2024-04-25T09:58:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.706+0000 7effc1999640 1 --2- 172.21.15.7:0/4291587486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effbc15d980 0x7effbc0cc170 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7effb000c430 tx=0x7effb000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.707+0000 7effbaffd640 1 -- 172.21.15.7:0/4291587486 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb0011790 con 0x7effbc15d980 2024-04-25T09:58:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.707+0000 7effbaffd640 1 -- 172.21.15.7:0/4291587486 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb0017070 con 0x7effbc15d980 2024-04-25T09:58:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.707+0000 7effc43fe640 1 -- 172.21.15.7:0/4291587486 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effbc0cc950 con 0x7effbc15d980 2024-04-25T09:58:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.707+0000 7effbaffd640 1 -- 172.21.15.7:0/4291587486 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb0011bb0 con 0x7effbc15d980 2024-04-25T09:58:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.707+0000 7effc43fe640 1 -- 172.21.15.7:0/4291587486 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effbc0ccf10 con 0x7effbc15d980 2024-04-25T09:58:43.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.708+0000 7effc43fe640 1 -- 172.21.15.7:0/4291587486 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effbc069040 con 0x7effbc15d980 2024-04-25T09:58:43.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.708+0000 7effbaffd640 1 -- 172.21.15.7:0/4291587486 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7effb001c460 con 0x7effbc15d980 2024-04-25T09:58:43.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.709+0000 7effbaffd640 1 --2- 172.21.15.7:0/4291587486 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7effa806b4d0 0x7effa806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:43.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.709+0000 7effc219a640 1 --2- 172.21.15.7:0/4291587486 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7effa806b4d0 0x7effa806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:43.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.709+0000 7effbaffd640 1 -- 172.21.15.7:0/4291587486 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5249+0+0 (secure 0 0 0) 0x7effb0089ff0 con 0x7effbc15d980 2024-04-25T09:58:43.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.709+0000 7effc219a640 1 --2- 172.21.15.7:0/4291587486 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7effa806b4d0 0x7effa806d990 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7effb4033000 tx=0x7effb4009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:43.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.713+0000 7effbaffd640 1 -- 172.21.15.7:0/4291587486 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7effb0058f60 con 0x7effbc15d980 2024-04-25T09:58:43.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:43.897+0000 7effc43fe640 1 -- 172.21.15.7:0/4291587486 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7effbc1582d0 con 0x7effbc15d980 2024-04-25T09:58:44.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.260+0000 7effbaffd640 1 -- 172.21.15.7:0/4291587486 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v72) v1 ==== 138+0+0 (secure 0 0 0) 0x7effb0058860 con 0x7effbc15d980 2024-04-25T09:58:44.264 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2024-04-25T09:58:44.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.262+0000 7effc43fe640 1 -- 172.21.15.7:0/4291587486 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7effa806b4d0 msgr2=0x7effa806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:44.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.262+0000 7effc43fe640 1 --2- 172.21.15.7:0/4291587486 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7effa806b4d0 0x7effa806d990 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7effb4033000 tx=0x7effb4009000 comp rx=0 tx=0).stop 2024-04-25T09:58:44.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.262+0000 7effc43fe640 1 -- 172.21.15.7:0/4291587486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effbc15d980 msgr2=0x7effbc0cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:44.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.262+0000 7effc43fe640 1 --2- 172.21.15.7:0/4291587486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effbc15d980 0x7effbc0cc170 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7effb000c430 tx=0x7effb000c8f0 comp rx=0 tx=0).stop 2024-04-25T09:58:44.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.262+0000 7effc43fe640 1 -- 172.21.15.7:0/4291587486 shutdown_connections 2024-04-25T09:58:44.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.262+0000 7effc43fe640 1 --2- 172.21.15.7:0/4291587486 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7effa806b4d0 0x7effa806d990 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:44.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.262+0000 7effc43fe640 1 --2- 172.21.15.7:0/4291587486 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7effbc15e5f0 0x7effbc0b7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:44.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.262+0000 7effc43fe640 1 --2- 172.21.15.7:0/4291587486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effbc15d980 0x7effbc0cc170 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:44.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.262+0000 7effc43fe640 1 --2- 172.21.15.7:0/4291587486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effbc0b9390 0x7effbc0c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:44.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.262+0000 7effc43fe640 1 -- 172.21.15.7:0/4291587486 >> 172.21.15.7:0/4291587486 conn(0x7effbc06c3d0 msgr2=0x7effbc1587d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:44.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.263+0000 7effc43fe640 1 -- 172.21.15.7:0/4291587486 shutdown_connections 2024-04-25T09:58:44.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.263+0000 7effc43fe640 1 -- 172.21.15.7:0/4291587486 wait complete. 2024-04-25T09:58:44.280 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:58:44.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.385+0000 7f8cefcbd640 1 Processor -- start 2024-04-25T09:58:44.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.385+0000 7f8cefcbd640 1 -- start start 2024-04-25T09:58:44.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.386+0000 7f8cefcbd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8ce80d0780 0x7f8ce80d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:44.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.386+0000 7f8cefcbd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8ce80b9130 0x7f8ce80d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:44.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.386+0000 7f8cefcbd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ce80b9590 0x7f8ce80d2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:44.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.386+0000 7f8cefcbd640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce80d10a0 con 0x7f8ce80b9130 2024-04-25T09:58:44.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.386+0000 7f8cefcbd640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce80b7ef0 con 0x7f8ce80d0780 2024-04-25T09:58:44.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.386+0000 7f8cefcbd640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce80b81d0 con 0x7f8ce80b9590 2024-04-25T09:58:44.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.386+0000 7f8ced258640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8ce80b9130 0x7f8ce80d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:44.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.386+0000 7f8ced258640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8ce80b9130 0x7f8ce80d1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36800/0 (socket says 172.21.15.7:36800) 2024-04-25T09:58:44.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.386+0000 7f8ced258640 1 -- 172.21.15.7:0/3654656755 learned_addr learned my addr 172.21.15.7:0/3654656755 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:44.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.386+0000 7f8ceda59640 1 --2- 172.21.15.7:0/3654656755 >> v2:172.21.15.55:3300/0 conn(0x7f8ce80d0780 0x7f8ce80d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:44.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.386+0000 7f8cee25a640 1 --2- 172.21.15.7:0/3654656755 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ce80b9590 0x7f8ce80d2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:44.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.386+0000 7f8ced258640 1 -- 172.21.15.7:0/3654656755 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ce80b9590 msgr2=0x7f8ce80d2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:44.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.386+0000 7f8ced258640 1 --2- 172.21.15.7:0/3654656755 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ce80b9590 0x7f8ce80d2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:44.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.386+0000 7f8ced258640 1 -- 172.21.15.7:0/3654656755 >> v2:172.21.15.55:3300/0 conn(0x7f8ce80d0780 msgr2=0x7f8ce80d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:44.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.386+0000 7f8ced258640 1 --2- 172.21.15.7:0/3654656755 >> v2:172.21.15.55:3300/0 conn(0x7f8ce80d0780 0x7f8ce80d0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:44.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.386+0000 7f8ced258640 1 -- 172.21.15.7:0/3654656755 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce80b84b0 con 0x7f8ce80b9130 2024-04-25T09:58:44.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.386+0000 7f8ceda59640 1 --2- 172.21.15.7:0/3654656755 >> v2:172.21.15.55:3300/0 conn(0x7f8ce80d0780 0x7f8ce80d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:44.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.387+0000 7f8ced258640 1 --2- 172.21.15.7:0/3654656755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce80b9130 0x7f8ce80d1c30 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f8ce80b6180 tx=0x7f8cd802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c2397caf909e90 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:44.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.387+0000 7f8ceca57640 1 -- 172.21.15.7:0/3654656755 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8037070 con 0x7f8ce80b9130 2024-04-25T09:58:44.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.387+0000 7f8ceca57640 1 -- 172.21.15.7:0/3654656755 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd8032440 con 0x7f8ce80b9130 2024-04-25T09:58:44.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.387+0000 7f8ceca57640 1 -- 172.21.15.7:0/3654656755 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8032810 con 0x7f8ce80b9130 2024-04-25T09:58:44.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.388+0000 7f8cefcbd640 1 -- 172.21.15.7:0/3654656755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce80b9130 msgr2=0x7f8ce80d1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:44.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.388+0000 7f8cefcbd640 1 --2- 172.21.15.7:0/3654656755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce80b9130 0x7f8ce80d1c30 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f8ce80b6180 tx=0x7f8cd802a1e0 comp rx=0 tx=0).stop 2024-04-25T09:58:44.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.388+0000 7f8cefcbd640 1 -- 172.21.15.7:0/3654656755 shutdown_connections 2024-04-25T09:58:44.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.388+0000 7f8cefcbd640 1 --2- 172.21.15.7:0/3654656755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce80b9130 0x7f8ce80d1c30 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:44.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.388+0000 7f8cefcbd640 1 --2- 172.21.15.7:0/3654656755 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ce80b9590 0x7f8ce80d2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:44.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.388+0000 7f8cefcbd640 1 --2- 172.21.15.7:0/3654656755 >> v2:172.21.15.55:3300/0 conn(0x7f8ce80d0780 0x7f8ce80d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:44.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.388+0000 7f8cefcbd640 1 -- 172.21.15.7:0/3654656755 >> 172.21.15.7:0/3654656755 conn(0x7f8ce80726b0 msgr2=0x7f8ce8072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:44.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.388+0000 7f8cefcbd640 1 -- 172.21.15.7:0/3654656755 shutdown_connections 2024-04-25T09:58:44.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.388+0000 7f8cefcbd640 1 -- 172.21.15.7:0/3654656755 wait complete. 2024-04-25T09:58:44.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.389+0000 7f8cefcbd640 1 Processor -- start 2024-04-25T09:58:44.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.389+0000 7f8cefcbd640 1 -- start start 2024-04-25T09:58:44.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.390+0000 7f8cefcbd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ce80b9130 0x7f8ce8159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:44.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.390+0000 7f8cefcbd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce80b9590 0x7f8ce81e61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:44.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.390+0000 7f8cefcbd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ce80d0780 0x7f8ce80d3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:44.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.390+0000 7f8cefcbd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce81611b0 con 0x7f8ce80b9590 2024-04-25T09:58:44.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.390+0000 7f8cefcbd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce80b8a70 con 0x7f8ce80d0780 2024-04-25T09:58:44.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.390+0000 7f8cefcbd640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce8161330 con 0x7f8ce80b9130 2024-04-25T09:58:44.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.390+0000 7f8ced258640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce80b9590 0x7f8ce81e61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:44.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.390+0000 7f8ced258640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce80b9590 0x7f8ce81e61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36804/0 (socket says 172.21.15.7:36804) 2024-04-25T09:58:44.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.390+0000 7f8ced258640 1 -- 172.21.15.7:0/1255832035 learned_addr learned my addr 172.21.15.7:0/1255832035 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:44.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.390+0000 7f8ceda59640 1 --2- 172.21.15.7:0/1255832035 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ce80b9130 0x7f8ce8159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:44.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.390+0000 7f8cee25a640 1 --2- 172.21.15.7:0/1255832035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ce80d0780 0x7f8ce80d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:44.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.390+0000 7f8ced258640 1 -- 172.21.15.7:0/1255832035 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ce80b9130 msgr2=0x7f8ce8159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:44.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.390+0000 7f8ced258640 1 --2- 172.21.15.7:0/1255832035 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ce80b9130 0x7f8ce8159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:44.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.390+0000 7f8ced258640 1 -- 172.21.15.7:0/1255832035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ce80d0780 msgr2=0x7f8ce80d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:44.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.390+0000 7f8ced258640 1 --2- 172.21.15.7:0/1255832035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ce80d0780 0x7f8ce80d3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:44.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.390+0000 7f8ced258640 1 -- 172.21.15.7:0/1255832035 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce80cd870 con 0x7f8ce80b9590 2024-04-25T09:58:44.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.390+0000 7f8ceda59640 1 --2- 172.21.15.7:0/1255832035 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ce80b9130 0x7f8ce8159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:44.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.390+0000 7f8cee25a640 1 --2- 172.21.15.7:0/1255832035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ce80d0780 0x7f8ce80d3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:44.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.390+0000 7f8ced258640 1 --2- 172.21.15.7:0/1255832035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce80b9590 0x7f8ce81e61c0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f8cd802a220 tx=0x7f8cd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:44.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.391+0000 7f8cde7fc640 1 -- 172.21.15.7:0/1255832035 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8041020 con 0x7f8ce80b9590 2024-04-25T09:58:44.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.391+0000 7f8cde7fc640 1 -- 172.21.15.7:0/1255832035 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd80306c0 con 0x7f8ce80b9590 2024-04-25T09:58:44.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.391+0000 7f8cefcbd640 1 -- 172.21.15.7:0/1255832035 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce815a4d0 con 0x7f8ce80b9590 2024-04-25T09:58:44.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.391+0000 7f8cde7fc640 1 -- 172.21.15.7:0/1255832035 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8037040 con 0x7f8ce80b9590 2024-04-25T09:58:44.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.391+0000 7f8cefcbd640 1 -- 172.21.15.7:0/1255832035 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce80c73e0 con 0x7f8ce80b9590 2024-04-25T09:58:44.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.392+0000 7f8cefcbd640 1 -- 172.21.15.7:0/1255832035 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce8068f60 con 0x7f8ce80b9590 2024-04-25T09:58:44.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.392+0000 7f8cde7fc640 1 -- 172.21.15.7:0/1255832035 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8cd8044020 con 0x7f8ce80b9590 2024-04-25T09:58:44.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.393+0000 7f8cde7fc640 1 --2- 172.21.15.7:0/1255832035 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8ccc06b4d0 0x7f8ccc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:44.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.393+0000 7f8cde7fc640 1 -- 172.21.15.7:0/1255832035 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5619+0+0 (secure 0 0 0) 0x7f8cd80aa9e0 con 0x7f8ce80b9590 2024-04-25T09:58:44.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.393+0000 7f8ceda59640 1 --2- 172.21.15.7:0/1255832035 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8ccc06b4d0 0x7f8ccc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:44.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.393+0000 7f8ceda59640 1 --2- 172.21.15.7:0/1255832035 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8ccc06b4d0 0x7f8ccc06d990 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4006fd0 tx=0x7f8ce4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:44.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.397+0000 7f8cde7fc640 1 -- 172.21.15.7:0/1255832035 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8cd804b030 con 0x7f8ce80b9590 2024-04-25T09:58:44.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:44.578+0000 7f8cefcbd640 1 -- 172.21.15.7:0/1255832035 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8ce806aef0 con 0x7f8ce80b9590 2024-04-25T09:58:45.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.262+0000 7f8cde7fc640 1 -- 172.21.15.7:0/1255832035 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v73) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8ce815a4d0 con 0x7f8ce80b9590 2024-04-25T09:58:45.266 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2024-04-25T09:58:45.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.265+0000 7f8cefcbd640 1 -- 172.21.15.7:0/1255832035 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8ccc06b4d0 msgr2=0x7f8ccc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:45.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.265+0000 7f8cefcbd640 1 --2- 172.21.15.7:0/1255832035 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8ccc06b4d0 0x7f8ccc06d990 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4006fd0 tx=0x7f8ce4008040 comp rx=0 tx=0).stop 2024-04-25T09:58:45.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.265+0000 7f8cefcbd640 1 -- 172.21.15.7:0/1255832035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce80b9590 msgr2=0x7f8ce81e61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:45.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.265+0000 7f8cefcbd640 1 --2- 172.21.15.7:0/1255832035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce80b9590 0x7f8ce81e61c0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f8cd802a220 tx=0x7f8cd80046c0 comp rx=0 tx=0).stop 2024-04-25T09:58:45.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.265+0000 7f8cefcbd640 1 -- 172.21.15.7:0/1255832035 shutdown_connections 2024-04-25T09:58:45.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.265+0000 7f8cefcbd640 1 --2- 172.21.15.7:0/1255832035 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8ccc06b4d0 0x7f8ccc06d990 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:45.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.265+0000 7f8cefcbd640 1 --2- 172.21.15.7:0/1255832035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ce80d0780 0x7f8ce80d3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:45.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.265+0000 7f8cefcbd640 1 --2- 172.21.15.7:0/1255832035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ce80b9590 0x7f8ce81e61c0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:45.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.265+0000 7f8cefcbd640 1 --2- 172.21.15.7:0/1255832035 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ce80b9130 0x7f8ce8159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:45.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.265+0000 7f8cefcbd640 1 -- 172.21.15.7:0/1255832035 >> 172.21.15.7:0/1255832035 conn(0x7f8ce80726b0 msgr2=0x7f8ce80b2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:45.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.265+0000 7f8cefcbd640 1 -- 172.21.15.7:0/1255832035 shutdown_connections 2024-04-25T09:58:45.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.265+0000 7f8cefcbd640 1 -- 172.21.15.7:0/1255832035 wait complete. 2024-04-25T09:58:45.295 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:58:45.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.398+0000 7f1439e3a640 1 Processor -- start 2024-04-25T09:58:45.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.399+0000 7f1439e3a640 1 -- start start 2024-04-25T09:58:45.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.399+0000 7f1439e3a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f14340b78c0 0x7f14341685d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:45.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.399+0000 7f1439e3a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14340b7ef0 con 0x7f14340d0780 2024-04-25T09:58:45.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.399+0000 7f1439e3a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14340b81d0 con 0x7f14340d2c40 2024-04-25T09:58:45.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.399+0000 7f1439e3a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14340b9840 con 0x7f14340b78c0 2024-04-25T09:58:45.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.400+0000 7f14337fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f14340d0780 0x7f14340d0b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58136/0 (socket says 172.21.15.7:58136) 2024-04-25T09:58:45.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.400+0000 7f14337fe640 1 -- 172.21.15.7:0/3334892573 learned_addr learned my addr 172.21.15.7:0/3334892573 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:45.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.400+0000 7f1433fff640 1 --2- 172.21.15.7:0/3334892573 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f14340b78c0 0x7f14341685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:45.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.400+0000 7f14327fc640 1 -- 172.21.15.7:0/3334892573 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 250076998 0 0) 0x7f14340b7ef0 con 0x7f14340d0780 2024-04-25T09:58:45.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.400+0000 7f14327fc640 1 -- 172.21.15.7:0/3334892573 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f141c003520 con 0x7f14340d0780 2024-04-25T09:58:45.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.400+0000 7f14327fc640 1 -- 172.21.15.7:0/3334892573 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3640733870 0 0) 0x7f14340b81d0 con 0x7f14340d2c40 2024-04-25T09:58:45.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.400+0000 7f14327fc640 1 -- 172.21.15.7:0/3334892573 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14340b7ef0 con 0x7f14340d2c40 2024-04-25T09:58:45.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.400+0000 7f1433fff640 1 -- 172.21.15.7:0/3334892573 >> v1:172.21.15.55:6789/0 conn(0x7f14340d2c40 legacy=0x7f14340b9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:45.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.400+0000 7f14327fc640 1 -- 172.21.15.7:0/3334892573 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 709683643 0 0) 0x7f141c003520 con 0x7f14340d0780 2024-04-25T09:58:45.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.400+0000 7f1433fff640 1 -- 172.21.15.7:0/3334892573 >> v1:172.21.15.7:6789/0 conn(0x7f14340d0780 legacy=0x7f14340d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:45.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.400+0000 7f1433fff640 1 -- 172.21.15.7:0/3334892573 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14340b84b0 con 0x7f14340b78c0 2024-04-25T09:58:45.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.401+0000 7f1433fff640 1 --2- 172.21.15.7:0/3334892573 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f14340b78c0 0x7f14341685d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f142c009dc0 tx=0x7f142c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56f4901ec872e5c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:45.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.401+0000 7f14327fc640 1 -- 172.21.15.7:0/3334892573 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1424001670 con 0x7f14340b78c0 2024-04-25T09:58:45.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.401+0000 7f14327fc640 1 -- 172.21.15.7:0/3334892573 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142c007540 con 0x7f14340b78c0 2024-04-25T09:58:45.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.401+0000 7f14327fc640 1 -- 172.21.15.7:0/3334892573 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c0078f0 con 0x7f14340b78c0 2024-04-25T09:58:45.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.402+0000 7f1439e3a640 1 -- 172.21.15.7:0/3334892573 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f14340b78c0 msgr2=0x7f14341685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:45.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.402+0000 7f1439e3a640 1 --2- 172.21.15.7:0/3334892573 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f14340b78c0 0x7f14341685d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f142c009dc0 tx=0x7f142c02a660 comp rx=0 tx=0).stop 2024-04-25T09:58:45.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.402+0000 7f1439e3a640 1 -- 172.21.15.7:0/3334892573 shutdown_connections 2024-04-25T09:58:45.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.402+0000 7f1439e3a640 1 --2- 172.21.15.7:0/3334892573 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f14340b78c0 0x7f14341685d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:45.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.402+0000 7f1439e3a640 1 -- 172.21.15.7:0/3334892573 >> 172.21.15.7:0/3334892573 conn(0x7f14340726b0 msgr2=0x7f1434072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:45.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.402+0000 7f1439e3a640 1 -- 172.21.15.7:0/3334892573 shutdown_connections 2024-04-25T09:58:45.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.402+0000 7f1439e3a640 1 -- 172.21.15.7:0/3334892573 wait complete. 2024-04-25T09:58:45.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.403+0000 7f1439e3a640 1 Processor -- start 2024-04-25T09:58:45.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.403+0000 7f1439e3a640 1 -- start start 2024-04-25T09:58:45.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.405+0000 7f1439e3a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f14340b78c0 0x7f1434149af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:45.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.405+0000 7f1439e3a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14340d0780 0x7f14340ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:45.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.405+0000 7f1439e3a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14340d2c40 0x7f1434148ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:45.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.405+0000 7f1439e3a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14341611b0 con 0x7f14340d2c40 2024-04-25T09:58:45.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.405+0000 7f1439e3a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14340b8a70 con 0x7f14340d0780 2024-04-25T09:58:45.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.405+0000 7f1439e3a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1434161330 con 0x7f14340b78c0 2024-04-25T09:58:45.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.405+0000 7f1433fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14340d2c40 0x7f1434148ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:45.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.405+0000 7f1433fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14340d2c40 0x7f1434148ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36808/0 (socket says 172.21.15.7:36808) 2024-04-25T09:58:45.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.405+0000 7f1433fff640 1 -- 172.21.15.7:0/2282014469 learned_addr learned my addr 172.21.15.7:0/2282014469 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:45.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.405+0000 7f14337fe640 1 --2- 172.21.15.7:0/2282014469 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f14340b78c0 0x7f1434149af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:45.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.405+0000 7f1432ffd640 1 --2- 172.21.15.7:0/2282014469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14340d0780 0x7f14340ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:45.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.405+0000 7f1433fff640 1 -- 172.21.15.7:0/2282014469 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f14340b78c0 msgr2=0x7f1434149af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:45.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.405+0000 7f1433fff640 1 --2- 172.21.15.7:0/2282014469 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f14340b78c0 0x7f1434149af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:45.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.405+0000 7f1433fff640 1 -- 172.21.15.7:0/2282014469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14340d0780 msgr2=0x7f14340ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:45.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.405+0000 7f1433fff640 1 --2- 172.21.15.7:0/2282014469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14340d0780 0x7f14340ca8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:45.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.405+0000 7f1433fff640 1 -- 172.21.15.7:0/2282014469 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1434146bd0 con 0x7f14340d2c40 2024-04-25T09:58:45.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.405+0000 7f1433fff640 1 --2- 172.21.15.7:0/2282014469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14340d2c40 0x7f1434148ed0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f142c009ee0 tx=0x7f142c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:45.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.405+0000 7f141bfff640 1 -- 172.21.15.7:0/2282014469 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c040070 con 0x7f14340d2c40 2024-04-25T09:58:45.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.405+0000 7f141bfff640 1 -- 172.21.15.7:0/2282014469 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142c031c40 con 0x7f14340d2c40 2024-04-25T09:58:45.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.405+0000 7f1439e3a640 1 -- 172.21.15.7:0/2282014469 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14340cae30 con 0x7f14340d2c40 2024-04-25T09:58:45.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.405+0000 7f141bfff640 1 -- 172.21.15.7:0/2282014469 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c009450 con 0x7f14340d2c40 2024-04-25T09:58:45.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.405+0000 7f1439e3a640 1 -- 172.21.15.7:0/2282014469 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f143415c370 con 0x7f14340d2c40 2024-04-25T09:58:45.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.405+0000 7f1439e3a640 1 -- 172.21.15.7:0/2282014469 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14340685d0 con 0x7f14340d2c40 2024-04-25T09:58:45.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.406+0000 7f141bfff640 1 -- 172.21.15.7:0/2282014469 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f142c039040 con 0x7f14340d2c40 2024-04-25T09:58:45.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.407+0000 7f141bfff640 1 --2- 172.21.15.7:0/2282014469 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f142006b4d0 0x7f142006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:45.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.407+0000 7f141bfff640 1 -- 172.21.15.7:0/2282014469 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6001+0+0 (secure 0 0 0) 0x7f142c0ab6c0 con 0x7f14340d2c40 2024-04-25T09:58:45.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.407+0000 7f14337fe640 1 --2- 172.21.15.7:0/2282014469 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f142006b4d0 0x7f142006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:45.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.407+0000 7f14337fe640 1 --2- 172.21.15.7:0/2282014469 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f142006b4d0 0x7f142006d990 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f14240017e0 tx=0x7f1424001610 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:45.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.411+0000 7f141bfff640 1 -- 172.21.15.7:0/2282014469 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f142c079f70 con 0x7f14340d2c40 2024-04-25T09:58:45.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:45.626+0000 7f1439e3a640 1 -- 172.21.15.7:0/2282014469 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f14340d3c50 con 0x7f14340d2c40 2024-04-25T09:58:46.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.298+0000 7f141bfff640 1 -- 172.21.15.7:0/2282014469 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v35) v1 ==== 174+0+0 (secure 0 0 0) 0x7f142c07e010 con 0x7f14340d2c40 2024-04-25T09:58:46.302 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 11 and data pool 12 2024-04-25T09:58:46.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.305+0000 7f1439e3a640 1 -- 172.21.15.7:0/2282014469 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f142006b4d0 msgr2=0x7f142006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:46.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.305+0000 7f1439e3a640 1 --2- 172.21.15.7:0/2282014469 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f142006b4d0 0x7f142006d990 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f14240017e0 tx=0x7f1424001610 comp rx=0 tx=0).stop 2024-04-25T09:58:46.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.305+0000 7f1439e3a640 1 -- 172.21.15.7:0/2282014469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14340d2c40 msgr2=0x7f1434148ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:46.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.305+0000 7f1439e3a640 1 --2- 172.21.15.7:0/2282014469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14340d2c40 0x7f1434148ed0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f142c009ee0 tx=0x7f142c004a40 comp rx=0 tx=0).stop 2024-04-25T09:58:46.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.307+0000 7f1439e3a640 1 -- 172.21.15.7:0/2282014469 shutdown_connections 2024-04-25T09:58:46.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.307+0000 7f1439e3a640 1 --2- 172.21.15.7:0/2282014469 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f142006b4d0 0x7f142006d990 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:46.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.307+0000 7f1439e3a640 1 --2- 172.21.15.7:0/2282014469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14340d2c40 0x7f1434148ed0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:46.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.307+0000 7f1439e3a640 1 --2- 172.21.15.7:0/2282014469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14340d0780 0x7f14340ca8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:46.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.307+0000 7f1439e3a640 1 --2- 172.21.15.7:0/2282014469 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f14340b78c0 0x7f1434149af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:46.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.307+0000 7f1439e3a640 1 -- 172.21.15.7:0/2282014469 >> 172.21.15.7:0/2282014469 conn(0x7f14340726b0 msgr2=0x7f143415ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:46.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.308+0000 7f1439e3a640 1 -- 172.21.15.7:0/2282014469 shutdown_connections 2024-04-25T09:58:46.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.309+0000 7f1439e3a640 1 -- 172.21.15.7:0/2282014469 wait complete. 2024-04-25T09:58:46.333 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:58:46.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.434+0000 7fc17e37e640 1 Processor -- start 2024-04-25T09:58:46.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.434+0000 7fc17e37e640 1 -- start start 2024-04-25T09:58:46.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.435+0000 7fc17e37e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc1780d2ca0 0x7fc1780d30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:46.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.435+0000 7fc17e37e640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17815e8a0 con 0x7fc1780d0aa0 2024-04-25T09:58:46.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.435+0000 7fc17e37e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17815eb80 con 0x7fc17815da60 2024-04-25T09:58:46.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.435+0000 7fc17e37e640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc17815ee60 con 0x7fc1780d2ca0 2024-04-25T09:58:46.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.435+0000 7fc17c91b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc1780d2ca0 0x7fc1780d30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:46.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.435+0000 7fc1777fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc1780d0aa0 0x7fc178161d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58152/0 (socket says 172.21.15.7:58152) 2024-04-25T09:58:46.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.435+0000 7fc1777fe640 1 -- 172.21.15.7:0/2920695333 learned_addr learned my addr 172.21.15.7:0/2920695333 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:46.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.435+0000 7fc176ffd640 1 -- 172.21.15.7:0/2920695333 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 567554279 0 0) 0x7fc17815e8a0 con 0x7fc1780d0aa0 2024-04-25T09:58:46.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.435+0000 7fc176ffd640 1 -- 172.21.15.7:0/2920695333 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc164003520 con 0x7fc1780d0aa0 2024-04-25T09:58:46.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.435+0000 7fc17c91b640 1 -- 172.21.15.7:0/2920695333 >> v1:172.21.15.55:6789/0 conn(0x7fc17815da60 legacy=0x7fc17815de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:46.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.435+0000 7fc17c91b640 1 -- 172.21.15.7:0/2920695333 >> v1:172.21.15.7:6789/0 conn(0x7fc1780d0aa0 legacy=0x7fc178161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:46.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.435+0000 7fc17c91b640 1 -- 172.21.15.7:0/2920695333 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc178161850 con 0x7fc1780d2ca0 2024-04-25T09:58:46.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.436+0000 7fc17c91b640 1 --2- 172.21.15.7:0/2920695333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1780d2ca0 0x7fc1780d30b0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fc170009d90 tx=0x7fc17002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e24a83458adda06 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:46.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.436+0000 7fc176ffd640 1 -- 172.21.15.7:0/2920695333 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc170007740 con 0x7fc1780d2ca0 2024-04-25T09:58:46.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.436+0000 7fc176ffd640 1 -- 172.21.15.7:0/2920695333 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1700078e0 con 0x7fc1780d2ca0 2024-04-25T09:58:46.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.436+0000 7fc176ffd640 1 -- 172.21.15.7:0/2920695333 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc170007cb0 con 0x7fc1780d2ca0 2024-04-25T09:58:46.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.437+0000 7fc17e37e640 1 -- 172.21.15.7:0/2920695333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1780d2ca0 msgr2=0x7fc1780d30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:46.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.437+0000 7fc17e37e640 1 --2- 172.21.15.7:0/2920695333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1780d2ca0 0x7fc1780d30b0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fc170009d90 tx=0x7fc17002a660 comp rx=0 tx=0).stop 2024-04-25T09:58:46.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.437+0000 7fc17e37e640 1 -- 172.21.15.7:0/2920695333 shutdown_connections 2024-04-25T09:58:46.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.437+0000 7fc17e37e640 1 --2- 172.21.15.7:0/2920695333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1780d2ca0 0x7fc1780d30b0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:46.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.437+0000 7fc17e37e640 1 -- 172.21.15.7:0/2920695333 >> 172.21.15.7:0/2920695333 conn(0x7fc17806bfe0 msgr2=0x7fc17806c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:46.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.437+0000 7fc17e37e640 1 -- 172.21.15.7:0/2920695333 shutdown_connections 2024-04-25T09:58:46.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.437+0000 7fc17e37e640 1 -- 172.21.15.7:0/2920695333 wait complete. 2024-04-25T09:58:46.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.438+0000 7fc17e37e640 1 Processor -- start 2024-04-25T09:58:46.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.438+0000 7fc17e37e640 1 -- start start 2024-04-25T09:58:46.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.439+0000 7fc17e37e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1780d0aa0 0x7fc1781f1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:46.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.439+0000 7fc17e37e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1780d2ca0 0x7fc1781f3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:46.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.439+0000 7fc17e37e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc17815da60 0x7fc1780b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:46.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.439+0000 7fc17e37e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc178162480 con 0x7fc1780d0aa0 2024-04-25T09:58:46.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.439+0000 7fc17e37e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1780ce520 con 0x7fc1780d2ca0 2024-04-25T09:58:46.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.439+0000 7fc17e37e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1781f4380 con 0x7fc17815da60 2024-04-25T09:58:46.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.439+0000 7fc177fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1780d0aa0 0x7fc1781f1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:46.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.439+0000 7fc177fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1780d0aa0 0x7fc1781f1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36822/0 (socket says 172.21.15.7:36822) 2024-04-25T09:58:46.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.439+0000 7fc177fff640 1 -- 172.21.15.7:0/3990408808 learned_addr learned my addr 172.21.15.7:0/3990408808 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:46.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.439+0000 7fc17c91b640 1 --2- 172.21.15.7:0/3990408808 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc17815da60 0x7fc1780b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:46.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.439+0000 7fc1777fe640 1 --2- 172.21.15.7:0/3990408808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1780d2ca0 0x7fc1781f3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:46.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.439+0000 7fc177fff640 1 -- 172.21.15.7:0/3990408808 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc17815da60 msgr2=0x7fc1780b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:46.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.439+0000 7fc177fff640 1 --2- 172.21.15.7:0/3990408808 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc17815da60 0x7fc1780b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:46.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.439+0000 7fc177fff640 1 -- 172.21.15.7:0/3990408808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1780d2ca0 msgr2=0x7fc1781f3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:46.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.439+0000 7fc177fff640 1 --2- 172.21.15.7:0/3990408808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1780d2ca0 0x7fc1781f3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:46.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.439+0000 7fc177fff640 1 -- 172.21.15.7:0/3990408808 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1781f48f0 con 0x7fc1780d0aa0 2024-04-25T09:58:46.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.439+0000 7fc17c91b640 1 --2- 172.21.15.7:0/3990408808 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc17815da60 0x7fc1780b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:58:46.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.439+0000 7fc1777fe640 1 --2- 172.21.15.7:0/3990408808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1780d2ca0 0x7fc1781f3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:58:46.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.439+0000 7fc177fff640 1 --2- 172.21.15.7:0/3990408808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1780d0aa0 0x7fc1781f1000 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fc16000c3c0 tx=0x7fc16000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:46.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.440+0000 7fc174ff9640 1 -- 172.21.15.7:0/3990408808 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1600052d0 con 0x7fc1780d0aa0 2024-04-25T09:58:46.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.440+0000 7fc174ff9640 1 -- 172.21.15.7:0/3990408808 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc160005490 con 0x7fc1780d0aa0 2024-04-25T09:58:46.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.440+0000 7fc174ff9640 1 -- 172.21.15.7:0/3990408808 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc160007260 con 0x7fc1780d0aa0 2024-04-25T09:58:46.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.440+0000 7fc17e37e640 1 -- 172.21.15.7:0/3990408808 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1781f4bd0 con 0x7fc1780d0aa0 2024-04-25T09:58:46.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.440+0000 7fc17e37e640 1 -- 172.21.15.7:0/3990408808 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1781f5190 con 0x7fc1780d0aa0 2024-04-25T09:58:46.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.441+0000 7fc17e37e640 1 -- 172.21.15.7:0/3990408808 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc178068fd0 con 0x7fc1780d0aa0 2024-04-25T09:58:46.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.441+0000 7fc174ff9640 1 -- 172.21.15.7:0/3990408808 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc160007400 con 0x7fc1780d0aa0 2024-04-25T09:58:46.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.441+0000 7fc174ff9640 1 --2- 172.21.15.7:0/3990408808 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc15806b4d0 0x7fc15806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:46.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.442+0000 7fc174ff9640 1 -- 172.21.15.7:0/3990408808 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc160089880 con 0x7fc1780d0aa0 2024-04-25T09:58:46.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.442+0000 7fc1777fe640 1 --2- 172.21.15.7:0/3990408808 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc15806b4d0 0x7fc15806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:46.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.442+0000 7fc1777fe640 1 --2- 172.21.15.7:0/3990408808 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc15806b4d0 0x7fc15806d990 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc1780ca150 tx=0x7fc168009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:46.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.446+0000 7fc174ff9640 1 -- 172.21.15.7:0/3990408808 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc160058570 con 0x7fc1780d0aa0 2024-04-25T09:58:46.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.628+0000 7fc17e37e640 1 -- 172.21.15.7:0/3990408808 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1780d1560 con 0x7fc1780d0aa0 2024-04-25T09:58:46.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.629+0000 7fc174ff9640 1 -- 172.21.15.7:0/3990408808 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+16862 (secure 0 0 0) 0x7fc160057e70 con 0x7fc1780d0aa0 2024-04-25T09:58:46.632 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:58:46.632 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":74,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:58:45.628091+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:58:43.929184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T09:58:44.609970+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:58:46.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.631+0000 7fc17e37e640 1 -- 172.21.15.7:0/3990408808 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc15806b4d0 msgr2=0x7fc15806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:46.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.631+0000 7fc17e37e640 1 --2- 172.21.15.7:0/3990408808 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc15806b4d0 0x7fc15806d990 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc1780ca150 tx=0x7fc168009040 comp rx=0 tx=0).stop 2024-04-25T09:58:46.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.631+0000 7fc17e37e640 1 -- 172.21.15.7:0/3990408808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1780d0aa0 msgr2=0x7fc1781f1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:46.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.631+0000 7fc17e37e640 1 --2- 172.21.15.7:0/3990408808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1780d0aa0 0x7fc1781f1000 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fc16000c3c0 tx=0x7fc16000c880 comp rx=0 tx=0).stop 2024-04-25T09:58:46.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.631+0000 7fc17e37e640 1 -- 172.21.15.7:0/3990408808 shutdown_connections 2024-04-25T09:58:46.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.631+0000 7fc17e37e640 1 --2- 172.21.15.7:0/3990408808 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc15806b4d0 0x7fc15806d990 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:46.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.631+0000 7fc17e37e640 1 --2- 172.21.15.7:0/3990408808 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc17815da60 0x7fc1780b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:46.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.631+0000 7fc17e37e640 1 --2- 172.21.15.7:0/3990408808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1780d2ca0 0x7fc1781f3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:46.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.631+0000 7fc17e37e640 1 --2- 172.21.15.7:0/3990408808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1780d0aa0 0x7fc1781f1000 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:46.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.631+0000 7fc17e37e640 1 -- 172.21.15.7:0/3990408808 >> 172.21.15.7:0/3990408808 conn(0x7fc17806bfe0 msgr2=0x7fc17806c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:46.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.631+0000 7fc17e37e640 1 -- 172.21.15.7:0/3990408808 shutdown_connections 2024-04-25T09:58:46.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.631+0000 7fc17e37e640 1 -- 172.21.15.7:0/3990408808 wait complete. 2024-04-25T09:58:46.646 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:58:46.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.744+0000 7f865d3c8640 1 Processor -- start 2024-04-25T09:58:46.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.744+0000 7f865d3c8640 1 -- start start 2024-04-25T09:58:46.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.744+0000 7f865d3c8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f865815dd00 0x7f86580b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:46.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.744+0000 7f865d3c8640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f86580b6a40 0x7f86580b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:46.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.744+0000 7f865d3c8640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f865806cd00 con 0x7f865806bfb0 2024-04-25T09:58:46.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.744+0000 7f865d3c8640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f865815e0e0 con 0x7f86580b6a40 2024-04-25T09:58:46.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.744+0000 7f865d3c8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f865806cfe0 con 0x7f865815dd00 2024-04-25T09:58:46.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.745+0000 7f864ffff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f86580b6a40 0x7f86580b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:46.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.745+0000 7f86577fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f865806bfb0 0x7f865806c420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58164/0 (socket says 172.21.15.7:58164) 2024-04-25T09:58:46.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.745+0000 7f86577fe640 1 -- 172.21.15.7:0/3629579908 learned_addr learned my addr 172.21.15.7:0/3629579908 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:46.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.745+0000 7f8656ffd640 1 --2- 172.21.15.7:0/3629579908 >> v2:172.21.15.55:3300/0 conn(0x7f865815dd00 0x7f86580b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:46.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.745+0000 7f864ffff640 1 -- 172.21.15.7:0/3629579908 >> v2:172.21.15.55:3300/0 conn(0x7f865815dd00 msgr2=0x7f86580b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:46.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.745+0000 7f864ffff640 1 --2- 172.21.15.7:0/3629579908 >> v2:172.21.15.55:3300/0 conn(0x7f865815dd00 0x7f86580b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:46.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.745+0000 7f864ffff640 1 -- 172.21.15.7:0/3629579908 >> v1:172.21.15.7:6789/0 conn(0x7f865806bfb0 legacy=0x7f865806c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:46.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.745+0000 7f864ffff640 1 -- 172.21.15.7:0/3629579908 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86580d1ca0 con 0x7f86580b6a40 2024-04-25T09:58:46.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.745+0000 7f86567fc640 1 -- 172.21.15.7:0/3629579908 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2432031306 0 0) 0x7f865806cd00 con 0x7f865806bfb0 2024-04-25T09:58:46.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.746+0000 7f864ffff640 1 --2- 172.21.15.7:0/3629579908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86580b6a40 0x7f86580b5c90 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f86580d4920 tx=0x7f864002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb6a54399600d56 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:46.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.746+0000 7f86567fc640 1 -- 172.21.15.7:0/3629579908 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8640037070 con 0x7f86580b6a40 2024-04-25T09:58:46.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.746+0000 7f86567fc640 1 -- 172.21.15.7:0/3629579908 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8640032440 con 0x7f86580b6a40 2024-04-25T09:58:46.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.746+0000 7f86567fc640 1 -- 172.21.15.7:0/3629579908 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8640032810 con 0x7f86580b6a40 2024-04-25T09:58:46.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.746+0000 7f865d3c8640 1 -- 172.21.15.7:0/3629579908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86580b6a40 msgr2=0x7f86580b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:46.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.746+0000 7f865d3c8640 1 --2- 172.21.15.7:0/3629579908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86580b6a40 0x7f86580b5c90 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f86580d4920 tx=0x7f864002a230 comp rx=0 tx=0).stop 2024-04-25T09:58:46.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.746+0000 7f865d3c8640 1 -- 172.21.15.7:0/3629579908 shutdown_connections 2024-04-25T09:58:46.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.746+0000 7f865d3c8640 1 --2- 172.21.15.7:0/3629579908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86580b6a40 0x7f86580b5c90 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:46.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.746+0000 7f865d3c8640 1 --2- 172.21.15.7:0/3629579908 >> v2:172.21.15.55:3300/0 conn(0x7f865815dd00 0x7f86580b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:46.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.746+0000 7f865d3c8640 1 -- 172.21.15.7:0/3629579908 >> 172.21.15.7:0/3629579908 conn(0x7f86580d07b0 msgr2=0x7f86580d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:46.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.747+0000 7f865d3c8640 1 -- 172.21.15.7:0/3629579908 shutdown_connections 2024-04-25T09:58:46.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.747+0000 7f865d3c8640 1 -- 172.21.15.7:0/3629579908 wait complete. 2024-04-25T09:58:46.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.748+0000 7f865d3c8640 1 Processor -- start 2024-04-25T09:58:46.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.748+0000 7f865d3c8640 1 -- start start 2024-04-25T09:58:46.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.748+0000 7f865d3c8640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f865806bfb0 0x7f86581f09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:46.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.748+0000 7f865d3c8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86580b6a40 0x7f86581f4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:46.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.748+0000 7f865d3c8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f865815dd00 0x7f8658160520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:46.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.748+0000 7f865d3c8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86580d2780 con 0x7f865815dd00 2024-04-25T09:58:46.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.748+0000 7f865d3c8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86580d2260 con 0x7f86580b6a40 2024-04-25T09:58:46.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.748+0000 7f865d3c8640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86580d2900 con 0x7f865806bfb0 2024-04-25T09:58:46.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.749+0000 7f86577fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f865815dd00 0x7f8658160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:46.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.749+0000 7f86577fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f865815dd00 0x7f8658160520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36840/0 (socket says 172.21.15.7:36840) 2024-04-25T09:58:46.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.749+0000 7f86577fe640 1 -- 172.21.15.7:0/1706256883 learned_addr learned my addr 172.21.15.7:0/1706256883 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:46.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.749+0000 7f864ffff640 1 --2- 172.21.15.7:0/1706256883 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86580b6a40 0x7f86581f4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:46.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.749+0000 7f8656ffd640 1 --2- 172.21.15.7:0/1706256883 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f865806bfb0 0x7f86581f09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:46.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.749+0000 7f86577fe640 1 -- 172.21.15.7:0/1706256883 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f865806bfb0 msgr2=0x7f86581f09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:46.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.749+0000 7f86577fe640 1 --2- 172.21.15.7:0/1706256883 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f865806bfb0 0x7f86581f09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:46.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.749+0000 7f86577fe640 1 -- 172.21.15.7:0/1706256883 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86580b6a40 msgr2=0x7f86581f4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:46.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.749+0000 7f86577fe640 1 --2- 172.21.15.7:0/1706256883 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86580b6a40 0x7f86581f4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:46.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.749+0000 7f86577fe640 1 -- 172.21.15.7:0/1706256883 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865815e4b0 con 0x7f865815dd00 2024-04-25T09:58:46.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.749+0000 7f864ffff640 1 --2- 172.21.15.7:0/1706256883 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86580b6a40 0x7f86581f4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:46.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.749+0000 7f8656ffd640 1 --2- 172.21.15.7:0/1706256883 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f865806bfb0 0x7f86581f09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:46.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.749+0000 7f86577fe640 1 --2- 172.21.15.7:0/1706256883 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f865815dd00 0x7f8658160520 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f865000c7a0 tx=0x7f865000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:46.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.749+0000 7f864f7fe640 1 -- 172.21.15.7:0/1706256883 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8650018070 con 0x7f865815dd00 2024-04-25T09:58:46.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.749+0000 7f864f7fe640 1 -- 172.21.15.7:0/1706256883 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865000a640 con 0x7f865815dd00 2024-04-25T09:58:46.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.749+0000 7f865d3c8640 1 -- 172.21.15.7:0/1706256883 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f865815e790 con 0x7f865815dd00 2024-04-25T09:58:46.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.749+0000 7f864f7fe640 1 -- 172.21.15.7:0/1706256883 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865000aab0 con 0x7f865815dd00 2024-04-25T09:58:46.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.749+0000 7f865d3c8640 1 -- 172.21.15.7:0/1706256883 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f865815ed50 con 0x7f865815dd00 2024-04-25T09:58:46.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.750+0000 7f865d3c8640 1 -- 172.21.15.7:0/1706256883 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8658068fd0 con 0x7f865815dd00 2024-04-25T09:58:46.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.751+0000 7f864f7fe640 1 -- 172.21.15.7:0/1706256883 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f865001b070 con 0x7f865815dd00 2024-04-25T09:58:46.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.751+0000 7f864f7fe640 1 --2- 172.21.15.7:0/1706256883 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f863806b4d0 0x7f863806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:46.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.751+0000 7f864f7fe640 1 -- 172.21.15.7:0/1706256883 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f86500898f0 con 0x7f865815dd00 2024-04-25T09:58:46.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.751+0000 7f8656ffd640 1 --2- 172.21.15.7:0/1706256883 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f863806b4d0 0x7f863806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:46.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.752+0000 7f8656ffd640 1 --2- 172.21.15.7:0/1706256883 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f863806b4d0 0x7f863806d990 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8648009af0 tx=0x7f8648008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:46.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.755+0000 7f864f7fe640 1 -- 172.21.15.7:0/1706256883 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8650058670 con 0x7f865815dd00 2024-04-25T09:58:46.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.936+0000 7f865d3c8640 1 -- 172.21.15.7:0/1706256883 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86581f0f20 con 0x7f865815dd00 2024-04-25T09:58:46.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.937+0000 7f864f7fe640 1 -- 172.21.15.7:0/1706256883 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+16862 (secure 0 0 0) 0x7f8650057f70 con 0x7f865815dd00 2024-04-25T09:58:46.940 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:58:46.941 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":74,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:58:45.628091+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:58:43.929184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T09:58:44.609970+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:58:46.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.939+0000 7f865d3c8640 1 -- 172.21.15.7:0/1706256883 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f863806b4d0 msgr2=0x7f863806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:46.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.939+0000 7f865d3c8640 1 --2- 172.21.15.7:0/1706256883 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f863806b4d0 0x7f863806d990 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8648009af0 tx=0x7f8648008040 comp rx=0 tx=0).stop 2024-04-25T09:58:46.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.939+0000 7f865d3c8640 1 -- 172.21.15.7:0/1706256883 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f865815dd00 msgr2=0x7f8658160520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:46.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.939+0000 7f865d3c8640 1 --2- 172.21.15.7:0/1706256883 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f865815dd00 0x7f8658160520 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f865000c7a0 tx=0x7f865000cc60 comp rx=0 tx=0).stop 2024-04-25T09:58:46.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.939+0000 7f865d3c8640 1 -- 172.21.15.7:0/1706256883 shutdown_connections 2024-04-25T09:58:46.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.939+0000 7f865d3c8640 1 --2- 172.21.15.7:0/1706256883 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f863806b4d0 0x7f863806d990 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:46.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.939+0000 7f865d3c8640 1 --2- 172.21.15.7:0/1706256883 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f865815dd00 0x7f8658160520 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:46.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.939+0000 7f865d3c8640 1 --2- 172.21.15.7:0/1706256883 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86580b6a40 0x7f86581f4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:46.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.939+0000 7f865d3c8640 1 --2- 172.21.15.7:0/1706256883 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f865806bfb0 0x7f86581f09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:46.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.939+0000 7f865d3c8640 1 -- 172.21.15.7:0/1706256883 >> 172.21.15.7:0/1706256883 conn(0x7f86580d07b0 msgr2=0x7f86580b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:46.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.939+0000 7f865d3c8640 1 -- 172.21.15.7:0/1706256883 shutdown_connections 2024-04-25T09:58:46.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:46.939+0000 7f865d3c8640 1 -- 172.21.15.7:0/1706256883 wait complete. 2024-04-25T09:58:46.953 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:58:47.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.055+0000 7fd28c328640 1 Processor -- start 2024-04-25T09:58:47.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.055+0000 7fd28c328640 1 -- start start 2024-04-25T09:58:47.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.056+0000 7fd28c328640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd28415f1c0 0x7fd28415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:47.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.056+0000 7fd28c328640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd2840ce830 0x7fd2840b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:47.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.056+0000 7fd28c328640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2840ced10 con 0x7fd2840d3760 2024-04-25T09:58:47.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.056+0000 7fd28c328640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2840ce380 con 0x7fd2840ce830 2024-04-25T09:58:47.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.056+0000 7fd28c328640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28415f000 con 0x7fd28415f1c0 2024-04-25T09:58:47.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.056+0000 7fd28a0c4640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd2840d3760 0x7fd2840d3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58176/0 (socket says 172.21.15.7:58176) 2024-04-25T09:58:47.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.056+0000 7fd28a0c4640 1 -- 172.21.15.7:0/1246287147 learned_addr learned my addr 172.21.15.7:0/1246287147 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:47.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.056+0000 7fd2890c2640 1 -- 172.21.15.7:0/1246287147 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1981111012 0 0) 0x7fd2840ced10 con 0x7fd2840d3760 2024-04-25T09:58:47.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.056+0000 7fd2890c2640 1 -- 172.21.15.7:0/1246287147 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd270003520 con 0x7fd2840d3760 2024-04-25T09:58:47.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.056+0000 7fd28a8c5640 1 --2- 172.21.15.7:0/1246287147 >> v2:172.21.15.55:3300/0 conn(0x7fd2840ce830 0x7fd2840b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:47.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.056+0000 7fd2898c3640 1 --2- 172.21.15.7:0/1246287147 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd28415f1c0 0x7fd28415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:47.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.056+0000 7fd2890c2640 1 -- 172.21.15.7:0/1246287147 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2532233907 0 0) 0x7fd270003520 con 0x7fd2840d3760 2024-04-25T09:58:47.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.056+0000 7fd2890c2640 1 -- 172.21.15.7:0/1246287147 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd28415f1c0 msgr2=0x7fd28415eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:47.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.056+0000 7fd2890c2640 1 --2- 172.21.15.7:0/1246287147 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd28415f1c0 0x7fd28415eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:47.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.056+0000 7fd2890c2640 1 -- 172.21.15.7:0/1246287147 >> v2:172.21.15.55:3300/0 conn(0x7fd2840ce830 msgr2=0x7fd2840b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:47.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.056+0000 7fd2890c2640 1 --2- 172.21.15.7:0/1246287147 >> v2:172.21.15.55:3300/0 conn(0x7fd2840ce830 0x7fd2840b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:47.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.056+0000 7fd2890c2640 1 -- 172.21.15.7:0/1246287147 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2840d1b40 con 0x7fd2840d3760 2024-04-25T09:58:47.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.056+0000 7fd2890c2640 1 -- 172.21.15.7:0/1246287147 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fd280001670 con 0x7fd2840d3760 2024-04-25T09:58:47.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.056+0000 7fd28a8c5640 1 --2- 172.21.15.7:0/1246287147 >> v2:172.21.15.55:3300/0 conn(0x7fd2840ce830 0x7fd2840b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:47.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.056+0000 7fd2890c2640 1 -- 172.21.15.7:0/1246287147 >> v1:172.21.15.7:6789/0 conn(0x7fd2840d3760 legacy=0x7fd2840d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:47.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.057+0000 7fd2890c2640 1 --2- 172.21.15.7:0/1246287147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2700039b0 0x7fd270003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:47.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.057+0000 7fd2890c2640 1 --2- 172.21.15.7:0/1246287147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd270004800 0x7fd270004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:47.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.057+0000 7fd2890c2640 1 --2- 172.21.15.7:0/1246287147 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd28415f1c0 0x7fd2700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:47.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.057+0000 7fd2890c2640 1 -- 172.21.15.7:0/1246287147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28415f000 con 0x7fd2700039b0 2024-04-25T09:58:47.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.057+0000 7fd2890c2640 1 -- 172.21.15.7:0/1246287147 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27000b9c0 con 0x7fd270004800 2024-04-25T09:58:47.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.057+0000 7fd2890c2640 1 -- 172.21.15.7:0/1246287147 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27000bb40 con 0x7fd28415f1c0 2024-04-25T09:58:47.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.057+0000 7fd28a0c4640 1 --2- 172.21.15.7:0/1246287147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2700039b0 0x7fd270003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:47.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.057+0000 7fd2898c3640 1 --2- 172.21.15.7:0/1246287147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd270004800 0x7fd270004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:47.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.057+0000 7fd28a8c5640 1 --2- 172.21.15.7:0/1246287147 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd28415f1c0 0x7fd2700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:47.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.057+0000 7fd28a0c4640 1 -- 172.21.15.7:0/1246287147 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd28415f1c0 msgr2=0x7fd2700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:47.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.057+0000 7fd28a0c4640 1 --2- 172.21.15.7:0/1246287147 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd28415f1c0 0x7fd2700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:47.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.057+0000 7fd28a0c4640 1 -- 172.21.15.7:0/1246287147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd270004800 msgr2=0x7fd270004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:47.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.057+0000 7fd28a0c4640 1 --2- 172.21.15.7:0/1246287147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd270004800 0x7fd270004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:47.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.057+0000 7fd28a0c4640 1 -- 172.21.15.7:0/1246287147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd270003520 con 0x7fd2700039b0 2024-04-25T09:58:47.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.057+0000 7fd2898c3640 1 --2- 172.21.15.7:0/1246287147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd270004800 0x7fd270004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:47.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.058+0000 7fd28a0c4640 1 --2- 172.21.15.7:0/1246287147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2700039b0 0x7fd270003dd0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fd28000c240 tx=0x7fd270005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d5083edaccb59b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:47.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.058+0000 7fd2890c2640 1 -- 172.21.15.7:0/1246287147 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28002e070 con 0x7fd2700039b0 2024-04-25T09:58:47.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.058+0000 7fd2890c2640 1 -- 172.21.15.7:0/1246287147 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd280005af0 con 0x7fd2700039b0 2024-04-25T09:58:47.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.058+0000 7fd2890c2640 1 -- 172.21.15.7:0/1246287147 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd280007d30 con 0x7fd2700039b0 2024-04-25T09:58:47.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.058+0000 7fd28c328640 1 -- 172.21.15.7:0/1246287147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2700039b0 msgr2=0x7fd270003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.058+0000 7fd28c328640 1 --2- 172.21.15.7:0/1246287147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2700039b0 0x7fd270003dd0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fd28000c240 tx=0x7fd270005830 comp rx=0 tx=0).stop 2024-04-25T09:58:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.058+0000 7fd28a8c5640 1 -- 172.21.15.7:0/1246287147 reap_dead start 2024-04-25T09:58:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.058+0000 7fd28c328640 1 -- 172.21.15.7:0/1246287147 shutdown_connections 2024-04-25T09:58:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.058+0000 7fd28c328640 1 -- 172.21.15.7:0/1246287147 >> 172.21.15.7:0/1246287147 conn(0x7fd284072680 msgr2=0x7fd284072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.058+0000 7fd28c328640 1 -- 172.21.15.7:0/1246287147 shutdown_connections 2024-04-25T09:58:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.058+0000 7fd28c328640 1 -- 172.21.15.7:0/1246287147 wait complete. 2024-04-25T09:58:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.060+0000 7fd28c328640 1 Processor -- start 2024-04-25T09:58:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.060+0000 7fd28c328640 1 -- start start 2024-04-25T09:58:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.060+0000 7fd28c328640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2700039b0 0x7fd28414d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.060+0000 7fd28c328640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2840c8740 0x7fd2840c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.060+0000 7fd28c328640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2840caad0 0x7fd2840caf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.060+0000 7fd28c328640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28415de10 con 0x7fd2840caad0 2024-04-25T09:58:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.060+0000 7fd28c328640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2840d2190 con 0x7fd2840c8740 2024-04-25T09:58:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.060+0000 7fd28c328640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28415eac0 con 0x7fd2700039b0 2024-04-25T09:58:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.060+0000 7fd28a8c5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2840caad0 0x7fd2840caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.060+0000 7fd28a8c5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2840caad0 0x7fd2840caf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36860/0 (socket says 172.21.15.7:36860) 2024-04-25T09:58:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.060+0000 7fd28a8c5640 1 -- 172.21.15.7:0/3717685748 learned_addr learned my addr 172.21.15.7:0/3717685748 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.061+0000 7fd28a0c4640 1 --2- 172.21.15.7:0/3717685748 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2700039b0 0x7fd28414d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.061+0000 7fd2898c3640 1 --2- 172.21.15.7:0/3717685748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2840c8740 0x7fd2840c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.061+0000 7fd28a8c5640 1 -- 172.21.15.7:0/3717685748 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2700039b0 msgr2=0x7fd28414d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.061+0000 7fd28a8c5640 1 --2- 172.21.15.7:0/3717685748 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2700039b0 0x7fd28414d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.061+0000 7fd28a8c5640 1 -- 172.21.15.7:0/3717685748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2840c8740 msgr2=0x7fd2840c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.061+0000 7fd28a8c5640 1 --2- 172.21.15.7:0/3717685748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2840c8740 0x7fd2840c8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.061+0000 7fd28a8c5640 1 -- 172.21.15.7:0/3717685748 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2840cb800 con 0x7fd2840caad0 2024-04-25T09:58:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.061+0000 7fd28a0c4640 1 --2- 172.21.15.7:0/3717685748 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2700039b0 0x7fd28414d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.061+0000 7fd28a8c5640 1 --2- 172.21.15.7:0/3717685748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2840caad0 0x7fd2840caf50 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fd27c0045e0 tx=0x7fd27c007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.061+0000 7fd27affd640 1 -- 172.21.15.7:0/3717685748 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c003ea0 con 0x7fd2840caad0 2024-04-25T09:58:47.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.061+0000 7fd27affd640 1 -- 172.21.15.7:0/3717685748 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27c019070 con 0x7fd2840caad0 2024-04-25T09:58:47.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.061+0000 7fd28c328640 1 -- 172.21.15.7:0/3717685748 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2841576a0 con 0x7fd2840caad0 2024-04-25T09:58:47.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.061+0000 7fd27affd640 1 -- 172.21.15.7:0/3717685748 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c014630 con 0x7fd2840caad0 2024-04-25T09:58:47.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.061+0000 7fd28c328640 1 -- 172.21.15.7:0/3717685748 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2840cb490 con 0x7fd2840caad0 2024-04-25T09:58:47.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.062+0000 7fd28c328640 1 -- 172.21.15.7:0/3717685748 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2840c9100 con 0x7fd2840caad0 2024-04-25T09:58:47.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.063+0000 7fd27affd640 1 -- 172.21.15.7:0/3717685748 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd27c0147d0 con 0x7fd2840caad0 2024-04-25T09:58:47.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.063+0000 7fd27affd640 1 --2- 172.21.15.7:0/3717685748 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd26806b4d0 0x7fd26806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:47.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.063+0000 7fd27affd640 1 -- 172.21.15.7:0/3717685748 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd27c08a800 con 0x7fd2840caad0 2024-04-25T09:58:47.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.063+0000 7fd28a0c4640 1 --2- 172.21.15.7:0/3717685748 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd26806b4d0 0x7fd26806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:47.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.063+0000 7fd28a0c4640 1 --2- 172.21.15.7:0/3717685748 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd26806b4d0 0x7fd26806d990 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd280033000 tx=0x7fd280009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:47.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.067+0000 7fd27affd640 1 -- 172.21.15.7:0/3717685748 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd27c0594f0 con 0x7fd2840caad0 2024-04-25T09:58:47.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.285+0000 7fd28c328640 1 -- 172.21.15.7:0/3717685748 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd284160a40 con 0x7fd2840caad0 2024-04-25T09:58:47.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.304+0000 7fd27affd640 1 -- 172.21.15.7:0/3717685748 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v36) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd27c058df0 con 0x7fd2840caad0 2024-04-25T09:58:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.306+0000 7fd28c328640 1 -- 172.21.15.7:0/3717685748 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd26806b4d0 msgr2=0x7fd26806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.306+0000 7fd28c328640 1 --2- 172.21.15.7:0/3717685748 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd26806b4d0 0x7fd26806d990 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd280033000 tx=0x7fd280009030 comp rx=0 tx=0).stop 2024-04-25T09:58:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.306+0000 7fd28c328640 1 -- 172.21.15.7:0/3717685748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2840caad0 msgr2=0x7fd2840caf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.306+0000 7fd28c328640 1 --2- 172.21.15.7:0/3717685748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2840caad0 0x7fd2840caf50 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fd27c0045e0 tx=0x7fd27c007700 comp rx=0 tx=0).stop 2024-04-25T09:58:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.306+0000 7fd28c328640 1 -- 172.21.15.7:0/3717685748 shutdown_connections 2024-04-25T09:58:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.306+0000 7fd28c328640 1 --2- 172.21.15.7:0/3717685748 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd26806b4d0 0x7fd26806d990 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.306+0000 7fd28c328640 1 --2- 172.21.15.7:0/3717685748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2840caad0 0x7fd2840caf50 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:47.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.306+0000 7fd28c328640 1 --2- 172.21.15.7:0/3717685748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2840c8740 0x7fd2840c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:47.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.306+0000 7fd28c328640 1 --2- 172.21.15.7:0/3717685748 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2700039b0 0x7fd28414d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:47.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.306+0000 7fd28c328640 1 -- 172.21.15.7:0/3717685748 >> 172.21.15.7:0/3717685748 conn(0x7fd284072680 msgr2=0x7fd2840b7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:47.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.306+0000 7fd28c328640 1 -- 172.21.15.7:0/3717685748 shutdown_connections 2024-04-25T09:58:47.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.306+0000 7fd28c328640 1 -- 172.21.15.7:0/3717685748 wait complete. 2024-04-25T09:58:47.319 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:58:47.320 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:58:47.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.420+0000 7fc02d6f5640 1 Processor -- start 2024-04-25T09:58:47.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.420+0000 7fc02d6f5640 1 -- start start 2024-04-25T09:58:47.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.421+0000 7fc02d6f5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc02815f1c0 0x7fc02815eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:47.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.421+0000 7fc02d6f5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc0280ce830 0x7fc0280b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:47.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.421+0000 7fc02d6f5640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0280ced10 con 0x7fc0280d3760 2024-04-25T09:58:47.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.421+0000 7fc02d6f5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0280ce380 con 0x7fc02815f1c0 2024-04-25T09:58:47.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.421+0000 7fc02d6f5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc02815f000 con 0x7fc0280ce830 2024-04-25T09:58:47.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.421+0000 7fc026ffd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc0280d3760 0x7fc0280d3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58182/0 (socket says 172.21.15.7:58182) 2024-04-25T09:58:47.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.421+0000 7fc026ffd640 1 -- 172.21.15.7:0/2094156624 learned_addr learned my addr 172.21.15.7:0/2094156624 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:47.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.421+0000 7fc0267fc640 1 --2- 172.21.15.7:0/2094156624 >> v2:172.21.15.55:3300/0 conn(0x7fc02815f1c0 0x7fc02815eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:47.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.421+0000 7fc0277fe640 1 --2- 172.21.15.7:0/2094156624 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc0280ce830 0x7fc0280b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:47.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.421+0000 7fc025ffb640 1 -- 172.21.15.7:0/2094156624 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2607370722 0 0) 0x7fc0280ced10 con 0x7fc0280d3760 2024-04-25T09:58:47.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.421+0000 7fc025ffb640 1 -- 172.21.15.7:0/2094156624 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc010003520 con 0x7fc0280d3760 2024-04-25T09:58:47.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.421+0000 7fc025ffb640 1 -- 172.21.15.7:0/2094156624 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1885461158 0 0) 0x7fc010003520 con 0x7fc0280d3760 2024-04-25T09:58:47.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.421+0000 7fc025ffb640 1 -- 172.21.15.7:0/2094156624 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc0280ce830 msgr2=0x7fc0280b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:47.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.421+0000 7fc025ffb640 1 --2- 172.21.15.7:0/2094156624 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc0280ce830 0x7fc0280b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:47.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.422+0000 7fc025ffb640 1 -- 172.21.15.7:0/2094156624 >> v2:172.21.15.55:3300/0 conn(0x7fc02815f1c0 msgr2=0x7fc02815eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:47.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.422+0000 7fc025ffb640 1 --2- 172.21.15.7:0/2094156624 >> v2:172.21.15.55:3300/0 conn(0x7fc02815f1c0 0x7fc02815eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:47.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.422+0000 7fc025ffb640 1 -- 172.21.15.7:0/2094156624 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0280d1b40 con 0x7fc0280d3760 2024-04-25T09:58:47.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.422+0000 7fc025ffb640 1 -- 172.21.15.7:0/2094156624 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fc0180019f0 con 0x7fc0280d3760 2024-04-25T09:58:47.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.422+0000 7fc025ffb640 1 -- 172.21.15.7:0/2094156624 >> v1:172.21.15.7:6789/0 conn(0x7fc0280d3760 legacy=0x7fc0280d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:47.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.422+0000 7fc025ffb640 1 --2- 172.21.15.7:0/2094156624 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc0280ce830 0x7fc0100039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:47.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.422+0000 7fc025ffb640 1 --2- 172.21.15.7:0/2094156624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc010003f30 0x7fc010004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:47.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.422+0000 7fc025ffb640 1 --2- 172.21.15.7:0/2094156624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc010004d40 0x7fc0100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:47.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.422+0000 7fc025ffb640 1 -- 172.21.15.7:0/2094156624 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02815f000 con 0x7fc010004d40 2024-04-25T09:58:47.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.422+0000 7fc025ffb640 1 -- 172.21.15.7:0/2094156624 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01000b9c0 con 0x7fc010003f30 2024-04-25T09:58:47.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.422+0000 7fc025ffb640 1 -- 172.21.15.7:0/2094156624 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01000bb40 con 0x7fc0280ce830 2024-04-25T09:58:47.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.422+0000 7fc0277fe640 1 --2- 172.21.15.7:0/2094156624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc010004d40 0x7fc0100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:47.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.422+0000 7fc026ffd640 1 --2- 172.21.15.7:0/2094156624 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc0280ce830 0x7fc0100039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:47.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.422+0000 7fc0267fc640 1 --2- 172.21.15.7:0/2094156624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc010003f30 0x7fc010004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:47.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.422+0000 7fc0277fe640 1 -- 172.21.15.7:0/2094156624 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc0280ce830 msgr2=0x7fc0100039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:47.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.422+0000 7fc0277fe640 1 --2- 172.21.15.7:0/2094156624 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc0280ce830 0x7fc0100039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:47.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.422+0000 7fc0277fe640 1 -- 172.21.15.7:0/2094156624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc010003f30 msgr2=0x7fc010004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:47.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.422+0000 7fc0277fe640 1 --2- 172.21.15.7:0/2094156624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc010003f30 0x7fc010004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:47.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.422+0000 7fc0277fe640 1 -- 172.21.15.7:0/2094156624 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc010003520 con 0x7fc010004d40 2024-04-25T09:58:47.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.423+0000 7fc0277fe640 1 --2- 172.21.15.7:0/2094156624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc010004d40 0x7fc0100051c0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fc020009a90 tx=0x7fc010005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f0f3c40e63e67f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:47.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.423+0000 7fc025ffb640 1 -- 172.21.15.7:0/2094156624 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc020036070 con 0x7fc010004d40 2024-04-25T09:58:47.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.423+0000 7fc025ffb640 1 -- 172.21.15.7:0/2094156624 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc020031400 con 0x7fc010004d40 2024-04-25T09:58:47.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.423+0000 7fc025ffb640 1 -- 172.21.15.7:0/2094156624 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc020009690 con 0x7fc010004d40 2024-04-25T09:58:47.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.423+0000 7fc02d6f5640 1 -- 172.21.15.7:0/2094156624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc010004d40 msgr2=0x7fc0100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:47.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.423+0000 7fc02d6f5640 1 --2- 172.21.15.7:0/2094156624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc010004d40 0x7fc0100051c0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fc020009a90 tx=0x7fc010005830 comp rx=0 tx=0).stop 2024-04-25T09:58:47.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.423+0000 7fc0277fe640 1 -- 172.21.15.7:0/2094156624 reap_dead start 2024-04-25T09:58:47.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.423+0000 7fc02d6f5640 1 -- 172.21.15.7:0/2094156624 shutdown_connections 2024-04-25T09:58:47.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.423+0000 7fc02d6f5640 1 -- 172.21.15.7:0/2094156624 >> 172.21.15.7:0/2094156624 conn(0x7fc028072680 msgr2=0x7fc028072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:47.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.424+0000 7fc02d6f5640 1 -- 172.21.15.7:0/2094156624 shutdown_connections 2024-04-25T09:58:47.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.424+0000 7fc02d6f5640 1 -- 172.21.15.7:0/2094156624 wait complete. 2024-04-25T09:58:47.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.425+0000 7fc02d6f5640 1 Processor -- start 2024-04-25T09:58:47.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.425+0000 7fc02d6f5640 1 -- start start 2024-04-25T09:58:47.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.426+0000 7fc02d6f5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc02814cc90 0x7fc0280b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:47.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.426+0000 7fc02d6f5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0280b2790 0x7fc0280cb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:47.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.426+0000 7fc02d6f5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0280b2fe0 0x7fc0280b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:47.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.426+0000 7fc02d6f5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02815de10 con 0x7fc0280b2fe0 2024-04-25T09:58:47.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.426+0000 7fc02d6f5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0280d2190 con 0x7fc0280b2790 2024-04-25T09:58:47.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.426+0000 7fc02d6f5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0280b2240 con 0x7fc02814cc90 2024-04-25T09:58:47.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.426+0000 7fc0277fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0280b2fe0 0x7fc0280b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:47.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.426+0000 7fc0277fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0280b2fe0 0x7fc0280b3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36878/0 (socket says 172.21.15.7:36878) 2024-04-25T09:58:47.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.426+0000 7fc0277fe640 1 -- 172.21.15.7:0/4185880332 learned_addr learned my addr 172.21.15.7:0/4185880332 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:47.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.426+0000 7fc0267fc640 1 --2- 172.21.15.7:0/4185880332 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0280b2790 0x7fc0280cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:47.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.426+0000 7fc026ffd640 1 --2- 172.21.15.7:0/4185880332 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc02814cc90 0x7fc0280b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:47.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.426+0000 7fc0277fe640 1 -- 172.21.15.7:0/4185880332 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc02814cc90 msgr2=0x7fc0280b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:47.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.426+0000 7fc0277fe640 1 --2- 172.21.15.7:0/4185880332 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc02814cc90 0x7fc0280b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:47.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.426+0000 7fc0277fe640 1 -- 172.21.15.7:0/4185880332 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0280b2790 msgr2=0x7fc0280cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:47.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.426+0000 7fc0277fe640 1 --2- 172.21.15.7:0/4185880332 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0280b2790 0x7fc0280cb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:47.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.426+0000 7fc0277fe640 1 -- 172.21.15.7:0/4185880332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0280b5600 con 0x7fc0280b2fe0 2024-04-25T09:58:47.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.426+0000 7fc0277fe640 1 --2- 172.21.15.7:0/4185880332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0280b2fe0 0x7fc0280b3490 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fc020034040 tx=0x7fc020004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:47.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.427+0000 7fc00f7fe640 1 -- 172.21.15.7:0/4185880332 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc020041070 con 0x7fc0280b2fe0 2024-04-25T09:58:47.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.427+0000 7fc00f7fe640 1 -- 172.21.15.7:0/4185880332 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc020037040 con 0x7fc0280b2fe0 2024-04-25T09:58:47.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.427+0000 7fc02d6f5640 1 -- 172.21.15.7:0/4185880332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0280b58e0 con 0x7fc0280b2fe0 2024-04-25T09:58:47.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.427+0000 7fc00f7fe640 1 -- 172.21.15.7:0/4185880332 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc020036070 con 0x7fc0280b2fe0 2024-04-25T09:58:47.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.427+0000 7fc02d6f5640 1 -- 172.21.15.7:0/4185880332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0280cad20 con 0x7fc0280b2fe0 2024-04-25T09:58:47.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.428+0000 7fc02d6f5640 1 -- 172.21.15.7:0/4185880332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc028068f60 con 0x7fc0280b2fe0 2024-04-25T09:58:47.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.428+0000 7fc00f7fe640 1 -- 172.21.15.7:0/4185880332 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc020044070 con 0x7fc0280b2fe0 2024-04-25T09:58:47.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.429+0000 7fc00f7fe640 1 --2- 172.21.15.7:0/4185880332 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc01406b500 0x7fc01406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:47.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.429+0000 7fc026ffd640 1 --2- 172.21.15.7:0/4185880332 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc01406b500 0x7fc01406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:47.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.429+0000 7fc00f7fe640 1 -- 172.21.15.7:0/4185880332 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc0200a99a0 con 0x7fc0280b2fe0 2024-04-25T09:58:47.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.429+0000 7fc026ffd640 1 --2- 172.21.15.7:0/4185880332 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc01406b500 0x7fc01406d9c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc0280c9670 tx=0x7fc018006040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:47.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.433+0000 7fc00f7fe640 1 -- 172.21.15.7:0/4185880332 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc020078070 con 0x7fc0280b2fe0 2024-04-25T09:58:47.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:47.654+0000 7fc02d6f5640 1 -- 172.21.15.7:0/4185880332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc0280ce610 con 0x7fc0280b2fe0 2024-04-25T09:58:48.260 INFO:tasks.ceph.mds.b.smithi055.stderr:2024-04-25T09:58:48.256+0000 7f9b2b5ae640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:58:48.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.311+0000 7fc00f7fe640 1 -- 172.21.15.7:0/4185880332 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v37) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc02007c110 con 0x7fc0280b2fe0 2024-04-25T09:58:48.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.314+0000 7fc02d6f5640 1 -- 172.21.15.7:0/4185880332 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc01406b500 msgr2=0x7fc01406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:48.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.314+0000 7fc02d6f5640 1 --2- 172.21.15.7:0/4185880332 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc01406b500 0x7fc01406d9c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc0280c9670 tx=0x7fc018006040 comp rx=0 tx=0).stop 2024-04-25T09:58:48.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.314+0000 7fc02d6f5640 1 -- 172.21.15.7:0/4185880332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0280b2fe0 msgr2=0x7fc0280b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:48.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.314+0000 7fc02d6f5640 1 --2- 172.21.15.7:0/4185880332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0280b2fe0 0x7fc0280b3490 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fc020034040 tx=0x7fc020004730 comp rx=0 tx=0).stop 2024-04-25T09:58:48.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.314+0000 7fc02d6f5640 1 -- 172.21.15.7:0/4185880332 shutdown_connections 2024-04-25T09:58:48.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.314+0000 7fc02d6f5640 1 --2- 172.21.15.7:0/4185880332 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc01406b500 0x7fc01406d9c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:48.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.314+0000 7fc02d6f5640 1 --2- 172.21.15.7:0/4185880332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0280b2fe0 0x7fc0280b3490 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:48.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.314+0000 7fc02d6f5640 1 --2- 172.21.15.7:0/4185880332 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0280b2790 0x7fc0280cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:48.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.314+0000 7fc02d6f5640 1 --2- 172.21.15.7:0/4185880332 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc02814cc90 0x7fc0280b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:48.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.314+0000 7fc02d6f5640 1 -- 172.21.15.7:0/4185880332 >> 172.21.15.7:0/4185880332 conn(0x7fc028072680 msgr2=0x7fc0280b8820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:48.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.314+0000 7fc02d6f5640 1 -- 172.21.15.7:0/4185880332 shutdown_connections 2024-04-25T09:58:48.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.314+0000 7fc02d6f5640 1 -- 172.21.15.7:0/4185880332 wait complete. 2024-04-25T09:58:48.331 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:58:48.331 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:58:48.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.436+0000 7ff421122640 1 Processor -- start 2024-04-25T09:58:48.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.436+0000 7ff421122640 1 -- start start 2024-04-25T09:58:48.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.437+0000 7ff421122640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff41c0d0a50 0x7ff41c0d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:48.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.437+0000 7ff421122640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff41c0b53b0 0x7ff41c0d2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:48.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.437+0000 7ff421122640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff41c0d1e80 con 0x7ff41c15db00 2024-04-25T09:58:48.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.437+0000 7ff421122640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff41c0b5930 con 0x7ff41c0b53b0 2024-04-25T09:58:48.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.437+0000 7ff421122640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c0b5c10 con 0x7ff41c0d0a50 2024-04-25T09:58:48.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.437+0000 7ff41b59e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff41c0b53b0 0x7ff41c0d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:48.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.437+0000 7ff41ad9d640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff41c15db00 0x7ff41c0d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58184/0 (socket says 172.21.15.7:58184) 2024-04-25T09:58:48.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.437+0000 7ff41ad9d640 1 -- 172.21.15.7:0/3467222745 learned_addr learned my addr 172.21.15.7:0/3467222745 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:48.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.437+0000 7ff413fff640 1 --2- 172.21.15.7:0/3467222745 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff41c0d0a50 0x7ff41c0d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:48.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.437+0000 7ff41b59e640 1 -- 172.21.15.7:0/3467222745 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff41c0d0a50 msgr2=0x7ff41c0d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:48.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.437+0000 7ff41b59e640 1 --2- 172.21.15.7:0/3467222745 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff41c0d0a50 0x7ff41c0d2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:48.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.437+0000 7ff41b59e640 1 -- 172.21.15.7:0/3467222745 >> v1:172.21.15.7:6789/0 conn(0x7ff41c15db00 legacy=0x7ff41c0d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:48.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.437+0000 7ff41a59c640 1 -- 172.21.15.7:0/3467222745 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2834065356 0 0) 0x7ff41c0d1e80 con 0x7ff41c15db00 2024-04-25T09:58:48.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.437+0000 7ff41b59e640 1 -- 172.21.15.7:0/3467222745 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41c0b5ef0 con 0x7ff41c0b53b0 2024-04-25T09:58:48.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.437+0000 7ff413fff640 1 --2- 172.21.15.7:0/3467222745 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff41c0d0a50 0x7ff41c0d2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:58:48.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.438+0000 7ff41b59e640 1 --2- 172.21.15.7:0/3467222745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff41c0b53b0 0x7ff41c0d2870 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7ff414009d90 tx=0x7ff41402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c19c613cfd1e972 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:48.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.438+0000 7ff41a59c640 1 -- 172.21.15.7:0/3467222745 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff414007740 con 0x7ff41c0b53b0 2024-04-25T09:58:48.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.438+0000 7ff41a59c640 1 -- 172.21.15.7:0/3467222745 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4140078e0 con 0x7ff41c0b53b0 2024-04-25T09:58:48.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.438+0000 7ff41a59c640 1 -- 172.21.15.7:0/3467222745 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff414007cb0 con 0x7ff41c0b53b0 2024-04-25T09:58:48.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.439+0000 7ff421122640 1 -- 172.21.15.7:0/3467222745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff41c0b53b0 msgr2=0x7ff41c0d2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:48.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.439+0000 7ff421122640 1 --2- 172.21.15.7:0/3467222745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff41c0b53b0 0x7ff41c0d2870 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7ff414009d90 tx=0x7ff41402a660 comp rx=0 tx=0).stop 2024-04-25T09:58:48.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.439+0000 7ff421122640 1 -- 172.21.15.7:0/3467222745 shutdown_connections 2024-04-25T09:58:48.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.439+0000 7ff421122640 1 --2- 172.21.15.7:0/3467222745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff41c0b53b0 0x7ff41c0d2870 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:48.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.439+0000 7ff421122640 1 --2- 172.21.15.7:0/3467222745 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff41c0d0a50 0x7ff41c0d2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:48.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.439+0000 7ff421122640 1 -- 172.21.15.7:0/3467222745 >> 172.21.15.7:0/3467222745 conn(0x7ff41c072290 msgr2=0x7ff41c0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:48.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.439+0000 7ff421122640 1 -- 172.21.15.7:0/3467222745 shutdown_connections 2024-04-25T09:58:48.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.439+0000 7ff421122640 1 -- 172.21.15.7:0/3467222745 wait complete. 2024-04-25T09:58:48.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.440+0000 7ff421122640 1 Processor -- start 2024-04-25T09:58:48.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.440+0000 7ff421122640 1 -- start start 2024-04-25T09:58:48.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.441+0000 7ff421122640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff41c0b53b0 0x7ff41c149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:48.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.441+0000 7ff421122640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff41c0d0a50 0x7ff41c1602c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:48.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.441+0000 7ff421122640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff41c15db00 0x7ff41c160800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:48.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.441+0000 7ff421122640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c0d3660 con 0x7ff41c15db00 2024-04-25T09:58:48.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.441+0000 7ff421122640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c0b61d0 con 0x7ff41c0b53b0 2024-04-25T09:58:48.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.441+0000 7ff421122640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c0ce2b0 con 0x7ff41c0d0a50 2024-04-25T09:58:48.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.441+0000 7ff41b59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff41c15db00 0x7ff41c160800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:48.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.441+0000 7ff41b59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff41c15db00 0x7ff41c160800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36894/0 (socket says 172.21.15.7:36894) 2024-04-25T09:58:48.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.441+0000 7ff41b59e640 1 -- 172.21.15.7:0/2722982161 learned_addr learned my addr 172.21.15.7:0/2722982161 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:48.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.441+0000 7ff41ad9d640 1 --2- 172.21.15.7:0/2722982161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff41c0b53b0 0x7ff41c149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:48.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.441+0000 7ff413fff640 1 --2- 172.21.15.7:0/2722982161 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff41c0d0a50 0x7ff41c1602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:48.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.441+0000 7ff41b59e640 1 -- 172.21.15.7:0/2722982161 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff41c0d0a50 msgr2=0x7ff41c1602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:48.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.441+0000 7ff41b59e640 1 --2- 172.21.15.7:0/2722982161 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff41c0d0a50 0x7ff41c1602c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:48.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.441+0000 7ff41b59e640 1 -- 172.21.15.7:0/2722982161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff41c0b53b0 msgr2=0x7ff41c149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:48.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.441+0000 7ff41b59e640 1 --2- 172.21.15.7:0/2722982161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff41c0b53b0 0x7ff41c149f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:48.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.441+0000 7ff41b59e640 1 -- 172.21.15.7:0/2722982161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41c0d3e30 con 0x7ff41c15db00 2024-04-25T09:58:48.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.441+0000 7ff413fff640 1 --2- 172.21.15.7:0/2722982161 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff41c0d0a50 0x7ff41c1602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:58:48.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.441+0000 7ff41ad9d640 1 --2- 172.21.15.7:0/2722982161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff41c0b53b0 0x7ff41c149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:58:48.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.441+0000 7ff41b59e640 1 --2- 172.21.15.7:0/2722982161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff41c15db00 0x7ff41c160800 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7ff414009eb0 tx=0x7ff414004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:48.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.442+0000 7ff4137fe640 1 -- 172.21.15.7:0/2722982161 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff414040070 con 0x7ff41c15db00 2024-04-25T09:58:48.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.442+0000 7ff4137fe640 1 -- 172.21.15.7:0/2722982161 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff414031c40 con 0x7ff41c15db00 2024-04-25T09:58:48.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.442+0000 7ff421122640 1 -- 172.21.15.7:0/2722982161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff41c0d3b50 con 0x7ff41c15db00 2024-04-25T09:58:48.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.442+0000 7ff4137fe640 1 -- 172.21.15.7:0/2722982161 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff414003990 con 0x7ff41c15db00 2024-04-25T09:58:48.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.442+0000 7ff421122640 1 -- 172.21.15.7:0/2722982161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff41c0c7040 con 0x7ff41c15db00 2024-04-25T09:58:48.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.443+0000 7ff421122640 1 -- 172.21.15.7:0/2722982161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff41c0c7740 con 0x7ff41c15db00 2024-04-25T09:58:48.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.443+0000 7ff4137fe640 1 -- 172.21.15.7:0/2722982161 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff414039040 con 0x7ff41c15db00 2024-04-25T09:58:48.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.443+0000 7ff4137fe640 1 --2- 172.21.15.7:0/2722982161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff3fc06b4d0 0x7ff3fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:48.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.444+0000 7ff4137fe640 1 -- 172.21.15.7:0/2722982161 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff4140ab320 con 0x7ff41c15db00 2024-04-25T09:58:48.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.444+0000 7ff41ad9d640 1 --2- 172.21.15.7:0/2722982161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff3fc06b4d0 0x7ff3fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:48.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.444+0000 7ff41ad9d640 1 --2- 172.21.15.7:0/2722982161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff3fc06b4d0 0x7ff3fc06d990 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff40c000f60 tx=0x7ff40c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:48.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.448+0000 7ff4137fe640 1 -- 172.21.15.7:0/2722982161 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff41c0c7740 con 0x7ff41c15db00 2024-04-25T09:58:48.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.667+0000 7ff421122640 1 -- 172.21.15.7:0/2722982161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff41c0b7540 con 0x7ff41c15db00 2024-04-25T09:58:48.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.668+0000 7ff4137fe640 1 -- 172.21.15.7:0/2722982161 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4934 (secure 0 0 0) 0x7ff41c0b7540 con 0x7ff41c15db00 2024-04-25T09:58:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:58:48.671 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":37,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1781470369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1781470369},{"type":"v1","addr":"172.21.15.55:6835","nonce":1781470369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6810,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1839614891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1839614891},{"type":"v1","addr":"172.21.15.7:6835","nonce":1839614891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6813,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3690076929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3690076929},{"type":"v1","addr":"172.21.15.7:6837","nonce":3690076929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:58:45.628406+0000","modified":"2024-04-25T09:58:47.654904+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6819},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6819":{"gid":6819,"name":"b","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6834/1012943595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1012943595},{"type":"v1","addr":"172.21.15.55:6834","nonce":1012943595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:58:48.671 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 37 2024-04-25T09:58:48.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.670+0000 7ff421122640 1 -- 172.21.15.7:0/2722982161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff3fc06b4d0 msgr2=0x7ff3fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:48.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.670+0000 7ff421122640 1 --2- 172.21.15.7:0/2722982161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff3fc06b4d0 0x7ff3fc06d990 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff40c000f60 tx=0x7ff40c009040 comp rx=0 tx=0).stop 2024-04-25T09:58:48.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.670+0000 7ff421122640 1 -- 172.21.15.7:0/2722982161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff41c15db00 msgr2=0x7ff41c160800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:48.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.670+0000 7ff421122640 1 --2- 172.21.15.7:0/2722982161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff41c15db00 0x7ff41c160800 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7ff414009eb0 tx=0x7ff414004a40 comp rx=0 tx=0).stop 2024-04-25T09:58:48.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.670+0000 7ff421122640 1 -- 172.21.15.7:0/2722982161 shutdown_connections 2024-04-25T09:58:48.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.670+0000 7ff421122640 1 --2- 172.21.15.7:0/2722982161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff3fc06b4d0 0x7ff3fc06d990 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:48.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.670+0000 7ff421122640 1 --2- 172.21.15.7:0/2722982161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff41c15db00 0x7ff41c160800 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:48.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.670+0000 7ff421122640 1 --2- 172.21.15.7:0/2722982161 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff41c0d0a50 0x7ff41c1602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:48.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.670+0000 7ff421122640 1 --2- 172.21.15.7:0/2722982161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff41c0b53b0 0x7ff41c149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:48.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.670+0000 7ff421122640 1 -- 172.21.15.7:0/2722982161 >> 172.21.15.7:0/2722982161 conn(0x7ff41c072290 msgr2=0x7ff41c15b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:48.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.670+0000 7ff421122640 1 -- 172.21.15.7:0/2722982161 shutdown_connections 2024-04-25T09:58:48.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.670+0000 7ff421122640 1 -- 172.21.15.7:0/2722982161 wait complete. 2024-04-25T09:58:48.684 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:58:48.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.781+0000 7fce7203a640 1 Processor -- start 2024-04-25T09:58:48.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.781+0000 7fce7203a640 1 -- start start 2024-04-25T09:58:48.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.782+0000 7fce7203a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fce6c15da50 0x7fce6c0cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:48.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.782+0000 7fce7203a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fce6c15de30 0x7fce6c15e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:48.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.782+0000 7fce7203a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fce6c0d0280 0x7fce6c0d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:48.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.782+0000 7fce7203a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce6c0d0c50 con 0x7fce6c0d0280 2024-04-25T09:58:48.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.782+0000 7fce7203a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce6c0ce2b0 con 0x7fce6c15da50 2024-04-25T09:58:48.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.782+0000 7fce7203a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c15e960 con 0x7fce6c15de30 2024-04-25T09:58:48.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.782+0000 7fce6bfff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fce6c0d0280 0x7fce6c0d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:48.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.782+0000 7fce6bfff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fce6c0d0280 0x7fce6c0d0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36898/0 (socket says 172.21.15.7:36898) 2024-04-25T09:58:48.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.782+0000 7fce6bfff640 1 -- 172.21.15.7:0/774292409 learned_addr learned my addr 172.21.15.7:0/774292409 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:48.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.782+0000 7fce6affd640 1 --2- 172.21.15.7:0/774292409 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fce6c15de30 0x7fce6c15e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:48.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.782+0000 7fce6b7fe640 1 --2- 172.21.15.7:0/774292409 >> v2:172.21.15.55:3300/0 conn(0x7fce6c15da50 0x7fce6c0cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:48.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.783+0000 7fce6bfff640 1 -- 172.21.15.7:0/774292409 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fce6c15de30 msgr2=0x7fce6c15e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:48.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.783+0000 7fce6bfff640 1 --2- 172.21.15.7:0/774292409 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fce6c15de30 0x7fce6c15e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:48.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.783+0000 7fce6bfff640 1 -- 172.21.15.7:0/774292409 >> v2:172.21.15.55:3300/0 conn(0x7fce6c15da50 msgr2=0x7fce6c0cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:48.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.783+0000 7fce6bfff640 1 --2- 172.21.15.7:0/774292409 >> v2:172.21.15.55:3300/0 conn(0x7fce6c15da50 0x7fce6c0cea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:48.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.783+0000 7fce6bfff640 1 -- 172.21.15.7:0/774292409 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6c15ec40 con 0x7fce6c0d0280 2024-04-25T09:58:48.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.783+0000 7fce6b7fe640 1 --2- 172.21.15.7:0/774292409 >> v2:172.21.15.55:3300/0 conn(0x7fce6c15da50 0x7fce6c0cea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:48.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.783+0000 7fce6affd640 1 --2- 172.21.15.7:0/774292409 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fce6c15de30 0x7fce6c15e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:48.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.783+0000 7fce6bfff640 1 --2- 172.21.15.7:0/774292409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce6c0d0280 0x7fce6c0d0710 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fce6c08b970 tx=0x7fce6402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=269b7576360c0102 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:48.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.783+0000 7fce6a7fc640 1 -- 172.21.15.7:0/774292409 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce64036070 con 0x7fce6c0d0280 2024-04-25T09:58:48.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.784+0000 7fce6a7fc640 1 -- 172.21.15.7:0/774292409 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce64031600 con 0x7fce6c0d0280 2024-04-25T09:58:48.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.784+0000 7fce6a7fc640 1 -- 172.21.15.7:0/774292409 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce640319d0 con 0x7fce6c0d0280 2024-04-25T09:58:48.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.784+0000 7fce7203a640 1 -- 172.21.15.7:0/774292409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce6c0d0280 msgr2=0x7fce6c0d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:48.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.784+0000 7fce7203a640 1 --2- 172.21.15.7:0/774292409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce6c0d0280 0x7fce6c0d0710 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fce6c08b970 tx=0x7fce6402a6a0 comp rx=0 tx=0).stop 2024-04-25T09:58:48.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.784+0000 7fce7203a640 1 -- 172.21.15.7:0/774292409 shutdown_connections 2024-04-25T09:58:48.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.784+0000 7fce7203a640 1 --2- 172.21.15.7:0/774292409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce6c0d0280 0x7fce6c0d0710 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:48.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.784+0000 7fce7203a640 1 --2- 172.21.15.7:0/774292409 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fce6c15de30 0x7fce6c15e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:48.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.784+0000 7fce7203a640 1 --2- 172.21.15.7:0/774292409 >> v2:172.21.15.55:3300/0 conn(0x7fce6c15da50 0x7fce6c0cea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:48.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.784+0000 7fce7203a640 1 -- 172.21.15.7:0/774292409 >> 172.21.15.7:0/774292409 conn(0x7fce6c072290 msgr2=0x7fce6c072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:48.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.784+0000 7fce7203a640 1 -- 172.21.15.7:0/774292409 shutdown_connections 2024-04-25T09:58:48.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.784+0000 7fce7203a640 1 -- 172.21.15.7:0/774292409 wait complete. 2024-04-25T09:58:48.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.785+0000 7fce7203a640 1 Processor -- start 2024-04-25T09:58:48.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.786+0000 7fce7203a640 1 -- start start 2024-04-25T09:58:48.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.786+0000 7fce7203a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fce6c0d0280 0x7fce6c14ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:48.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.786+0000 7fce7203a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce6c15da50 0x7fce6c156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:48.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.786+0000 7fce7203a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce6c15de30 0x7fce6c0ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:48.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.786+0000 7fce7203a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c0cf150 con 0x7fce6c15de30 2024-04-25T09:58:48.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.786+0000 7fce7203a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c0cefd0 con 0x7fce6c15da50 2024-04-25T09:58:48.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.786+0000 7fce7203a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c161640 con 0x7fce6c0d0280 2024-04-25T09:58:48.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.786+0000 7fce6bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce6c15de30 0x7fce6c0ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:48.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.786+0000 7fce6bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce6c15de30 0x7fce6c0ccb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36906/0 (socket says 172.21.15.7:36906) 2024-04-25T09:58:48.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.786+0000 7fce6bfff640 1 -- 172.21.15.7:0/3933554011 learned_addr learned my addr 172.21.15.7:0/3933554011 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:48.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.787+0000 7fce6affd640 1 --2- 172.21.15.7:0/3933554011 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce6c15da50 0x7fce6c156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:48.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.787+0000 7fce6b7fe640 1 --2- 172.21.15.7:0/3933554011 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fce6c0d0280 0x7fce6c14ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:48.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.787+0000 7fce6bfff640 1 -- 172.21.15.7:0/3933554011 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fce6c0d0280 msgr2=0x7fce6c14ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:48.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.787+0000 7fce6bfff640 1 --2- 172.21.15.7:0/3933554011 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fce6c0d0280 0x7fce6c14ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:48.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.787+0000 7fce6bfff640 1 -- 172.21.15.7:0/3933554011 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce6c15da50 msgr2=0x7fce6c156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:48.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.787+0000 7fce6bfff640 1 --2- 172.21.15.7:0/3933554011 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce6c15da50 0x7fce6c156060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:48.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.787+0000 7fce6bfff640 1 -- 172.21.15.7:0/3933554011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6c1f6ee0 con 0x7fce6c15de30 2024-04-25T09:58:48.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.787+0000 7fce6affd640 1 --2- 172.21.15.7:0/3933554011 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce6c15da50 0x7fce6c156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:48.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.787+0000 7fce6bfff640 1 --2- 172.21.15.7:0/3933554011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce6c15de30 0x7fce6c0ccb20 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fce64034040 tx=0x7fce64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:48.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.787+0000 7fce53fff640 1 -- 172.21.15.7:0/3933554011 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce64041020 con 0x7fce6c15de30 2024-04-25T09:58:48.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.787+0000 7fce53fff640 1 -- 172.21.15.7:0/3933554011 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce640077a0 con 0x7fce6c15de30 2024-04-25T09:58:48.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.787+0000 7fce7203a640 1 -- 172.21.15.7:0/3933554011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce6c1f71c0 con 0x7fce6c15de30 2024-04-25T09:58:48.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.787+0000 7fce53fff640 1 -- 172.21.15.7:0/3933554011 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce64036040 con 0x7fce6c15de30 2024-04-25T09:58:48.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.787+0000 7fce7203a640 1 -- 172.21.15.7:0/3933554011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce6c1f7780 con 0x7fce6c15de30 2024-04-25T09:58:48.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.788+0000 7fce7203a640 1 -- 172.21.15.7:0/3933554011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce6c068fd0 con 0x7fce6c15de30 2024-04-25T09:58:48.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.789+0000 7fce53fff640 1 -- 172.21.15.7:0/3933554011 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fce64044020 con 0x7fce6c15de30 2024-04-25T09:58:48.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.789+0000 7fce53fff640 1 --2- 172.21.15.7:0/3933554011 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fce5806b4d0 0x7fce5806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:48.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.789+0000 7fce53fff640 1 -- 172.21.15.7:0/3933554011 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fce640ab060 con 0x7fce6c15de30 2024-04-25T09:58:48.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.789+0000 7fce6b7fe640 1 --2- 172.21.15.7:0/3933554011 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fce5806b4d0 0x7fce5806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:48.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.790+0000 7fce6b7fe640 1 --2- 172.21.15.7:0/3933554011 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fce5806b4d0 0x7fce5806d990 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fce5c006fd0 tx=0x7fce5c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:48.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.793+0000 7fce53fff640 1 -- 172.21.15.7:0/3933554011 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fce6404b030 con 0x7fce6c15de30 2024-04-25T09:58:48.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.976+0000 7fce7203a640 1 -- 172.21.15.7:0/3933554011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce6c0d1610 con 0x7fce6c15de30 2024-04-25T09:58:48.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.977+0000 7fce53fff640 1 -- 172.21.15.7:0/3933554011 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16849 (secure 0 0 0) 0x7fce64079de0 con 0x7fce6c15de30 2024-04-25T09:58:48.981 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:58:48.981 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":75,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:58:47.285541+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:58:43.929184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T09:58:44.609970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:58:48.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.980+0000 7fce7203a640 1 -- 172.21.15.7:0/3933554011 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fce5806b4d0 msgr2=0x7fce5806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:48.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.980+0000 7fce7203a640 1 --2- 172.21.15.7:0/3933554011 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fce5806b4d0 0x7fce5806d990 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fce5c006fd0 tx=0x7fce5c008040 comp rx=0 tx=0).stop 2024-04-25T09:58:48.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.980+0000 7fce7203a640 1 -- 172.21.15.7:0/3933554011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce6c15de30 msgr2=0x7fce6c0ccb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:48.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.980+0000 7fce7203a640 1 --2- 172.21.15.7:0/3933554011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce6c15de30 0x7fce6c0ccb20 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fce64034040 tx=0x7fce64004a40 comp rx=0 tx=0).stop 2024-04-25T09:58:48.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.980+0000 7fce7203a640 1 -- 172.21.15.7:0/3933554011 shutdown_connections 2024-04-25T09:58:48.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.980+0000 7fce7203a640 1 --2- 172.21.15.7:0/3933554011 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fce5806b4d0 0x7fce5806d990 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:48.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.980+0000 7fce7203a640 1 --2- 172.21.15.7:0/3933554011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fce6c15de30 0x7fce6c0ccb20 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:48.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.980+0000 7fce7203a640 1 --2- 172.21.15.7:0/3933554011 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce6c15da50 0x7fce6c156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:48.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.980+0000 7fce7203a640 1 --2- 172.21.15.7:0/3933554011 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fce6c0d0280 0x7fce6c14ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:48.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.980+0000 7fce7203a640 1 -- 172.21.15.7:0/3933554011 >> 172.21.15.7:0/3933554011 conn(0x7fce6c072290 msgr2=0x7fce6c072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:48.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.980+0000 7fce7203a640 1 -- 172.21.15.7:0/3933554011 shutdown_connections 2024-04-25T09:58:48.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:48.980+0000 7fce7203a640 1 -- 172.21.15.7:0/3933554011 wait complete. 2024-04-25T09:58:48.994 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:58:48.994 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:58:49.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.092+0000 7eff5543f640 1 Processor -- start 2024-04-25T09:58:49.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.092+0000 7eff5543f640 1 -- start start 2024-04-25T09:58:49.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.093+0000 7eff5543f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7eff5015db00 0x7eff500d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:49.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.093+0000 7eff5543f640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7eff500b53b0 0x7eff500d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:49.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.093+0000 7eff5543f640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff500d1e80 con 0x7eff500ce2b0 2024-04-25T09:58:49.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.093+0000 7eff5543f640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff500b5930 con 0x7eff500b53b0 2024-04-25T09:58:49.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.093+0000 7eff5543f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff500b5c10 con 0x7eff5015db00 2024-04-25T09:58:49.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.093+0000 7eff4e7fc640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7eff500b53b0 0x7eff500d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:49.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.093+0000 7eff4f7fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7eff500ce2b0 0x7eff50161670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58198/0 (socket says 172.21.15.7:58198) 2024-04-25T09:58:49.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.093+0000 7eff4f7fe640 1 -- 172.21.15.7:0/3303736963 learned_addr learned my addr 172.21.15.7:0/3303736963 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:49.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.093+0000 7eff4e7fc640 1 --2- 172.21.15.7:0/3303736963 >> v2:172.21.15.7:3300/0 conn(0x7eff500b53b0 0x7eff500d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36920/0 (socket says 172.21.15.7:36920) 2024-04-25T09:58:49.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.093+0000 7eff4effd640 1 --2- 172.21.15.7:0/3303736963 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7eff5015db00 0x7eff500d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:49.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.093+0000 7eff4e7fc640 1 -- 172.21.15.7:0/3303736963 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7eff5015db00 msgr2=0x7eff500d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:49.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.093+0000 7eff4e7fc640 1 --2- 172.21.15.7:0/3303736963 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7eff5015db00 0x7eff500d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:49.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.093+0000 7eff4e7fc640 1 -- 172.21.15.7:0/3303736963 >> v1:172.21.15.7:6789/0 conn(0x7eff500ce2b0 legacy=0x7eff50161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:49.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.093+0000 7eff4dffb640 1 -- 172.21.15.7:0/3303736963 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 819215928 0 0) 0x7eff500d1e80 con 0x7eff500ce2b0 2024-04-25T09:58:49.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.093+0000 7eff4e7fc640 1 -- 172.21.15.7:0/3303736963 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff500b5ef0 con 0x7eff500b53b0 2024-04-25T09:58:49.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.094+0000 7eff4e7fc640 1 --2- 172.21.15.7:0/3303736963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff500b53b0 0x7eff500d0880 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7eff440097a0 tx=0x7eff4402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7cea4005faa7360 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:49.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.094+0000 7eff4dffb640 1 -- 172.21.15.7:0/3303736963 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44037070 con 0x7eff500b53b0 2024-04-25T09:58:49.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.094+0000 7eff4dffb640 1 -- 172.21.15.7:0/3303736963 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff44032440 con 0x7eff500b53b0 2024-04-25T09:58:49.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.094+0000 7eff4dffb640 1 -- 172.21.15.7:0/3303736963 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44032810 con 0x7eff500b53b0 2024-04-25T09:58:49.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.095+0000 7eff5543f640 1 -- 172.21.15.7:0/3303736963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff500b53b0 msgr2=0x7eff500d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:49.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.095+0000 7eff5543f640 1 --2- 172.21.15.7:0/3303736963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff500b53b0 0x7eff500d0880 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7eff440097a0 tx=0x7eff4402a180 comp rx=0 tx=0).stop 2024-04-25T09:58:49.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.095+0000 7eff5543f640 1 -- 172.21.15.7:0/3303736963 shutdown_connections 2024-04-25T09:58:49.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.095+0000 7eff5543f640 1 --2- 172.21.15.7:0/3303736963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff500b53b0 0x7eff500d0880 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:49.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.095+0000 7eff5543f640 1 --2- 172.21.15.7:0/3303736963 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7eff5015db00 0x7eff500d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:49.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.095+0000 7eff5543f640 1 -- 172.21.15.7:0/3303736963 >> 172.21.15.7:0/3303736963 conn(0x7eff50072290 msgr2=0x7eff500726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:49.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.095+0000 7eff5543f640 1 -- 172.21.15.7:0/3303736963 shutdown_connections 2024-04-25T09:58:49.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.095+0000 7eff5543f640 1 -- 172.21.15.7:0/3303736963 wait complete. 2024-04-25T09:58:49.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.096+0000 7eff5543f640 1 Processor -- start 2024-04-25T09:58:49.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.096+0000 7eff5543f640 1 -- start start 2024-04-25T09:58:49.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.097+0000 7eff5543f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7eff500b53b0 0x7eff500c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:49.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.097+0000 7eff5543f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff500ce2b0 0x7eff500b8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:49.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.097+0000 7eff5543f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff5015db00 0x7eff500b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:49.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.097+0000 7eff5543f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff500d3660 con 0x7eff5015db00 2024-04-25T09:58:49.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.097+0000 7eff5543f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff500b61d0 con 0x7eff500ce2b0 2024-04-25T09:58:49.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.097+0000 7eff5543f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff500b6c10 con 0x7eff500b53b0 2024-04-25T09:58:49.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.097+0000 7eff4f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff5015db00 0x7eff500b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:49.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.097+0000 7eff4f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff5015db00 0x7eff500b8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36936/0 (socket says 172.21.15.7:36936) 2024-04-25T09:58:49.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.097+0000 7eff4f7fe640 1 -- 172.21.15.7:0/4128475821 learned_addr learned my addr 172.21.15.7:0/4128475821 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:49.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.097+0000 7eff4e7fc640 1 --2- 172.21.15.7:0/4128475821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff500ce2b0 0x7eff500b8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:49.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.097+0000 7eff4effd640 1 --2- 172.21.15.7:0/4128475821 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7eff500b53b0 0x7eff500c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:49.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.097+0000 7eff4f7fe640 1 -- 172.21.15.7:0/4128475821 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7eff500b53b0 msgr2=0x7eff500c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:49.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.097+0000 7eff4f7fe640 1 --2- 172.21.15.7:0/4128475821 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7eff500b53b0 0x7eff500c9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:49.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.097+0000 7eff4f7fe640 1 -- 172.21.15.7:0/4128475821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff500ce2b0 msgr2=0x7eff500b8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:49.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.097+0000 7eff4f7fe640 1 --2- 172.21.15.7:0/4128475821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff500ce2b0 0x7eff500b8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:49.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.097+0000 7eff4f7fe640 1 -- 172.21.15.7:0/4128475821 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5015e190 con 0x7eff5015db00 2024-04-25T09:58:49.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.097+0000 7eff4e7fc640 1 --2- 172.21.15.7:0/4128475821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff500ce2b0 0x7eff500b8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:49.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.098+0000 7eff4f7fe640 1 --2- 172.21.15.7:0/4128475821 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff5015db00 0x7eff500b8aa0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7eff4800c7d0 tx=0x7eff4800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:49.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.098+0000 7eff377fe640 1 -- 172.21.15.7:0/4128475821 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff48018070 con 0x7eff5015db00 2024-04-25T09:58:49.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.098+0000 7eff377fe640 1 -- 172.21.15.7:0/4128475821 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4800a640 con 0x7eff5015db00 2024-04-25T09:58:49.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.098+0000 7eff5543f640 1 -- 172.21.15.7:0/4128475821 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff5015e400 con 0x7eff5015db00 2024-04-25T09:58:49.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.098+0000 7eff377fe640 1 -- 172.21.15.7:0/4128475821 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4800aa70 con 0x7eff5015db00 2024-04-25T09:58:49.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.098+0000 7eff5543f640 1 -- 172.21.15.7:0/4128475821 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff5015e9c0 con 0x7eff5015db00 2024-04-25T09:58:49.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.099+0000 7eff5543f640 1 -- 172.21.15.7:0/4128475821 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff500cdcf0 con 0x7eff5015db00 2024-04-25T09:58:49.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.099+0000 7eff377fe640 1 -- 172.21.15.7:0/4128475821 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7eff4801b070 con 0x7eff5015db00 2024-04-25T09:58:49.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.100+0000 7eff377fe640 1 --2- 172.21.15.7:0/4128475821 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7eff3c06b500 0x7eff3c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:49.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.100+0000 7eff377fe640 1 -- 172.21.15.7:0/4128475821 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6101+0+0 (secure 0 0 0) 0x7eff48089980 con 0x7eff5015db00 2024-04-25T09:58:49.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.100+0000 7eff4effd640 1 --2- 172.21.15.7:0/4128475821 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7eff3c06b500 0x7eff3c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:49.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.100+0000 7eff4effd640 1 --2- 172.21.15.7:0/4128475821 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7eff3c06b500 0x7eff3c06d9c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7eff40006fd0 tx=0x7eff40008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:49.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.104+0000 7eff377fe640 1 -- 172.21.15.7:0/4128475821 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7eff500cdcf0 con 0x7eff5015db00 2024-04-25T09:58:49.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.280+0000 7eff5543f640 1 -- 172.21.15.7:0/4128475821 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7eff50068fd0 con 0x7eff3c06b500 2024-04-25T09:58:49.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.285+0000 7eff377fe640 1 -- 172.21.15.7:0/4128475821 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243395 (secure 0 0 0) 0x7eff50068fd0 con 0x7eff3c06b500 2024-04-25T09:58:49.292 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:58:49.293 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T09:58:49.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.288+0000 7eff5543f640 1 -- 172.21.15.7:0/4128475821 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7eff3c06b500 msgr2=0x7eff3c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:49.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.288+0000 7eff5543f640 1 --2- 172.21.15.7:0/4128475821 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7eff3c06b500 0x7eff3c06d9c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7eff40006fd0 tx=0x7eff40008040 comp rx=0 tx=0).stop 2024-04-25T09:58:49.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.288+0000 7eff5543f640 1 -- 172.21.15.7:0/4128475821 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff5015db00 msgr2=0x7eff500b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:49.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.288+0000 7eff5543f640 1 --2- 172.21.15.7:0/4128475821 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff5015db00 0x7eff500b8aa0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7eff4800c7d0 tx=0x7eff4800cc90 comp rx=0 tx=0).stop 2024-04-25T09:58:49.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.288+0000 7eff5543f640 1 -- 172.21.15.7:0/4128475821 shutdown_connections 2024-04-25T09:58:49.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.288+0000 7eff5543f640 1 --2- 172.21.15.7:0/4128475821 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7eff3c06b500 0x7eff3c06d9c0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:49.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.288+0000 7eff5543f640 1 --2- 172.21.15.7:0/4128475821 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff5015db00 0x7eff500b8aa0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:49.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.288+0000 7eff5543f640 1 --2- 172.21.15.7:0/4128475821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff500ce2b0 0x7eff500b8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:49.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.288+0000 7eff5543f640 1 --2- 172.21.15.7:0/4128475821 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7eff500b53b0 0x7eff500c9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:49.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.288+0000 7eff5543f640 1 -- 172.21.15.7:0/4128475821 >> 172.21.15.7:0/4128475821 conn(0x7eff50072290 msgr2=0x7eff5015c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:49.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.288+0000 7eff5543f640 1 -- 172.21.15.7:0/4128475821 shutdown_connections 2024-04-25T09:58:49.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.288+0000 7eff5543f640 1 -- 172.21.15.7:0/4128475821 wait complete. 2024-04-25T09:58:49.303 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2024-04-25T09:58:47.912846+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":124,"acting":124,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257448,"kb_used_data":7996,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754717272,"statfs":{"total":773094113280,"available":772830486528,"internally_reserved":0,"allocated":8187904,"data_stored":4331185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000766"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.278800+0000","last_change":"2024-04-25T09:58:45.278800+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.278800+0000","last_undegraded":"2024-04-25T09:58:45.278800+0000","last_fullsized":"2024-04-25T09:58:45.278800+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.279868+0000","last_change":"2024-04-25T09:58:45.279868+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.279868+0000","last_undegraded":"2024-04-25T09:58:45.279868+0000","last_fullsized":"2024-04-25T09:58:45.279868+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.283616+0000","last_change":"2024-04-25T09:58:45.283616+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.283616+0000","last_undegraded":"2024-04-25T09:58:45.283616+0000","last_fullsized":"2024-04-25T09:58:45.283616+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.276247+0000","last_change":"2024-04-25T09:58:45.276247+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.276247+0000","last_undegraded":"2024-04-25T09:58:45.276247+0000","last_fullsized":"2024-04-25T09:58:45.276247+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.282126+0000","last_change":"2024-04-25T09:58:45.282126+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.282126+0000","last_undegraded":"2024-04-25T09:58:45.282126+0000","last_fullsized":"2024-04-25T09:58:45.282126+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.279452+0000","last_change":"2024-04-25T09:58:45.279452+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.279452+0000","last_undegraded":"2024-04-25T09:58:45.279452+0000","last_fullsized":"2024-04-25T09:58:45.279452+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.281660+0000","last_change":"2024-04-25T09:58:45.281660+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.281660+0000","last_undegraded":"2024-04-25T09:58:45.281660+0000","last_fullsized":"2024-04-25T09:58:45.281660+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.276219+0000","last_change":"2024-04-25T09:58:45.276219+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.276219+0000","last_undegraded":"2024-04-25T09:58:45.276219+0000","last_fullsized":"2024-04-25T09:58:45.276219+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.275561+0000","last_change":"2024-04-25T09:58:45.275561+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.275561+0000","last_undegraded":"2024-04-25T09:58:45.275561+0000","last_fullsized":"2024-04-25T09:58:45.275561+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.281719+0000","last_change":"2024-04-25T09:58:45.281719+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.281719+0000","last_undegraded":"2024-04-25T09:58:45.281719+0000","last_fullsized":"2024-04-25T09:58:45.281719+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.280101+0000","last_change":"2024-04-25T09:58:45.280101+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.280101+0000","last_undegraded":"2024-04-25T09:58:45.280101+0000","last_fullsized":"2024-04-25T09:58:45.280101+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.278275+0000","last_change":"2024-04-25T09:58:45.278275+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.278275+0000","last_undegraded":"2024-04-25T09:58:45.278275+0000","last_fullsized":"2024-04-25T09:58:45.278275+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.279531+0000","last_change":"2024-04-25T09:58:45.279531+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.279531+0000","last_undegraded":"2024-04-25T09:58:45.279531+0000","last_fullsized":"2024-04-25T09:58:45.279531+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T09:58:44.267740+0000","last_change":"2024-04-25T09:58:44.267740+0000","last_active":"2024-04-25T09:58:44.251439+0000","last_peered":"2024-04-25T09:58:44.251439+0000","last_clean":"2024-04-25T09:58:44.251439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:44.267740+0000","last_undegraded":"2024-04-25T09:58:44.267740+0000","last_fullsized":"2024-04-25T09:58:44.267740+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300470+0000","last_change":"2024-04-25T09:58:45.295953+0000","last_active":"2024-04-25T09:58:45.300470+0000","last_peered":"2024-04-25T09:58:45.300470+0000","last_clean":"2024-04-25T09:58:45.300470+0000","last_became_active":"2024-04-25T09:58:45.295589+0000","last_became_peered":"2024-04-25T09:58:45.295589+0000","last_unstale":"2024-04-25T09:58:45.300470+0000","last_undegraded":"2024-04-25T09:58:45.300470+0000","last_fullsized":"2024-04-25T09:58:45.300470+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:49.372377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.275001+0000","last_change":"2024-04-25T09:58:45.275001+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.275001+0000","last_undegraded":"2024-04-25T09:58:45.275001+0000","last_fullsized":"2024-04-25T09:58:45.275001+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.295423+0000","last_change":"2024-04-25T09:58:45.289498+0000","last_active":"2024-04-25T09:58:45.295423+0000","last_peered":"2024-04-25T09:58:45.295423+0000","last_clean":"2024-04-25T09:58:45.295423+0000","last_became_active":"2024-04-25T09:58:45.289150+0000","last_became_peered":"2024-04-25T09:58:45.289150+0000","last_unstale":"2024-04-25T09:58:45.295423+0000","last_undegraded":"2024-04-25T09:58:45.295423+0000","last_fullsized":"2024-04-25T09:58:45.295423+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:17.616346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.275587+0000","last_change":"2024-04-25T09:58:45.275587+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.275587+0000","last_undegraded":"2024-04-25T09:58:45.275587+0000","last_fullsized":"2024-04-25T09:58:45.275587+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300955+0000","last_change":"2024-04-25T09:58:45.291351+0000","last_active":"2024-04-25T09:58:45.300955+0000","last_peered":"2024-04-25T09:58:45.300955+0000","last_clean":"2024-04-25T09:58:45.300955+0000","last_became_active":"2024-04-25T09:58:45.290998+0000","last_became_peered":"2024-04-25T09:58:45.290998+0000","last_unstale":"2024-04-25T09:58:45.300955+0000","last_undegraded":"2024-04-25T09:58:45.300955+0000","last_fullsized":"2024-04-25T09:58:45.300955+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:50.139600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.295535+0000","last_change":"2024-04-25T09:58:45.288538+0000","last_active":"2024-04-25T09:58:45.295535+0000","last_peered":"2024-04-25T09:58:45.295535+0000","last_clean":"2024-04-25T09:58:45.295535+0000","last_became_active":"2024-04-25T09:58:45.288234+0000","last_became_peered":"2024-04-25T09:58:45.288234+0000","last_unstale":"2024-04-25T09:58:45.295535+0000","last_undegraded":"2024-04-25T09:58:45.295535+0000","last_fullsized":"2024-04-25T09:58:45.295535+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:47.899238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300052+0000","last_change":"2024-04-25T09:58:45.289545+0000","last_active":"2024-04-25T09:58:45.300052+0000","last_peered":"2024-04-25T09:58:45.300052+0000","last_clean":"2024-04-25T09:58:45.300052+0000","last_became_active":"2024-04-25T09:58:45.289245+0000","last_became_peered":"2024-04-25T09:58:45.289245+0000","last_unstale":"2024-04-25T09:58:45.300052+0000","last_undegraded":"2024-04-25T09:58:45.300052+0000","last_fullsized":"2024-04-25T09:58:45.300052+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:05.337524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.275591+0000","last_change":"2024-04-25T09:58:45.275591+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.275591+0000","last_undegraded":"2024-04-25T09:58:45.275591+0000","last_fullsized":"2024-04-25T09:58:45.275591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T09:58:44.277485+0000","last_change":"2024-04-25T09:58:44.277485+0000","last_active":"2024-04-25T09:58:44.251439+0000","last_peered":"2024-04-25T09:58:44.251439+0000","last_clean":"2024-04-25T09:58:44.251439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:44.277485+0000","last_undegraded":"2024-04-25T09:58:44.277485+0000","last_fullsized":"2024-04-25T09:58:44.277485+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.282321+0000","last_change":"2024-04-25T09:58:45.282321+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.282321+0000","last_undegraded":"2024-04-25T09:58:45.282321+0000","last_fullsized":"2024-04-25T09:58:45.282321+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T09:58:44.267735+0000","last_change":"2024-04-25T09:58:44.267735+0000","last_active":"2024-04-25T09:58:44.251439+0000","last_peered":"2024-04-25T09:58:44.251439+0000","last_clean":"2024-04-25T09:58:44.251439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:44.267735+0000","last_undegraded":"2024-04-25T09:58:44.267735+0000","last_fullsized":"2024-04-25T09:58:44.267735+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300162+0000","last_change":"2024-04-25T09:58:45.290559+0000","last_active":"2024-04-25T09:58:45.300162+0000","last_peered":"2024-04-25T09:58:45.300162+0000","last_clean":"2024-04-25T09:58:45.300162+0000","last_became_active":"2024-04-25T09:58:45.290260+0000","last_became_peered":"2024-04-25T09:58:45.290260+0000","last_unstale":"2024-04-25T09:58:45.300162+0000","last_undegraded":"2024-04-25T09:58:45.300162+0000","last_fullsized":"2024-04-25T09:58:45.300162+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:04.412202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.278455+0000","last_change":"2024-04-25T09:58:45.278455+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.278455+0000","last_undegraded":"2024-04-25T09:58:45.278455+0000","last_fullsized":"2024-04-25T09:58:45.278455+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300874+0000","last_change":"2024-04-25T09:58:45.296555+0000","last_active":"2024-04-25T09:58:45.300874+0000","last_peered":"2024-04-25T09:58:45.300874+0000","last_clean":"2024-04-25T09:58:45.300874+0000","last_became_active":"2024-04-25T09:58:45.296256+0000","last_became_peered":"2024-04-25T09:58:45.296256+0000","last_unstale":"2024-04-25T09:58:45.300874+0000","last_undegraded":"2024-04-25T09:58:45.300874+0000","last_fullsized":"2024-04-25T09:58:45.300874+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:47.465452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T09:58:44.267628+0000","last_change":"2024-04-25T09:58:44.267628+0000","last_active":"2024-04-25T09:58:44.251439+0000","last_peered":"2024-04-25T09:58:44.251439+0000","last_clean":"2024-04-25T09:58:44.251439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:44.267628+0000","last_undegraded":"2024-04-25T09:58:44.267628+0000","last_fullsized":"2024-04-25T09:58:44.267628+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300599+0000","last_change":"2024-04-25T09:58:45.288248+0000","last_active":"2024-04-25T09:58:45.300599+0000","last_peered":"2024-04-25T09:58:45.300599+0000","last_clean":"2024-04-25T09:58:45.300599+0000","last_became_active":"2024-04-25T09:58:45.287736+0000","last_became_peered":"2024-04-25T09:58:45.287736+0000","last_unstale":"2024-04-25T09:58:45.300599+0000","last_undegraded":"2024-04-25T09:58:45.300599+0000","last_fullsized":"2024-04-25T09:58:45.300599+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:39.842372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.279062+0000","last_change":"2024-04-25T09:58:45.279062+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.279062+0000","last_undegraded":"2024-04-25T09:58:45.279062+0000","last_fullsized":"2024-04-25T09:58:45.279062+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300866+0000","last_change":"2024-04-25T09:58:45.296232+0000","last_active":"2024-04-25T09:58:45.300866+0000","last_peered":"2024-04-25T09:58:45.300866+0000","last_clean":"2024-04-25T09:58:45.300866+0000","last_became_active":"2024-04-25T09:58:45.295916+0000","last_became_peered":"2024-04-25T09:58:45.295916+0000","last_unstale":"2024-04-25T09:58:45.300866+0000","last_undegraded":"2024-04-25T09:58:45.300866+0000","last_fullsized":"2024-04-25T09:58:45.300866+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:04.412202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.281278+0000","last_change":"2024-04-25T09:58:45.281278+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.281278+0000","last_undegraded":"2024-04-25T09:58:45.281278+0000","last_fullsized":"2024-04-25T09:58:45.281278+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.295341+0000","last_change":"2024-04-25T09:58:45.287147+0000","last_active":"2024-04-25T09:58:45.295341+0000","last_peered":"2024-04-25T09:58:45.295341+0000","last_clean":"2024-04-25T09:58:45.295341+0000","last_became_active":"2024-04-25T09:58:45.286871+0000","last_became_peered":"2024-04-25T09:58:45.286871+0000","last_unstale":"2024-04-25T09:58:45.295341+0000","last_undegraded":"2024-04-25T09:58:45.295341+0000","last_fullsized":"2024-04-25T09:58:45.295341+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:42.618575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.279089+0000","last_change":"2024-04-25T09:58:45.279089+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.279089+0000","last_undegraded":"2024-04-25T09:58:45.279089+0000","last_fullsized":"2024-04-25T09:58:45.279089+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T09:58:44.267149+0000","last_change":"2024-04-25T09:58:44.267149+0000","last_active":"2024-04-25T09:58:44.251439+0000","last_peered":"2024-04-25T09:58:44.251439+0000","last_clean":"2024-04-25T09:58:44.251439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:44.267149+0000","last_undegraded":"2024-04-25T09:58:44.267149+0000","last_fullsized":"2024-04-25T09:58:44.267149+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.281886+0000","last_change":"2024-04-25T09:58:45.281886+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.281886+0000","last_undegraded":"2024-04-25T09:58:45.281886+0000","last_fullsized":"2024-04-25T09:58:45.281886+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T09:58:44.277485+0000","last_change":"2024-04-25T09:58:44.277485+0000","last_active":"2024-04-25T09:58:44.251439+0000","last_peered":"2024-04-25T09:58:44.251439+0000","last_clean":"2024-04-25T09:58:44.251439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:44.277485+0000","last_undegraded":"2024-04-25T09:58:44.277485+0000","last_fullsized":"2024-04-25T09:58:44.277485+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.295316+0000","last_change":"2024-04-25T09:58:45.288097+0000","last_active":"2024-04-25T09:58:45.295316+0000","last_peered":"2024-04-25T09:58:45.295316+0000","last_clean":"2024-04-25T09:58:45.295316+0000","last_became_active":"2024-04-25T09:58:45.287801+0000","last_became_peered":"2024-04-25T09:58:45.287801+0000","last_unstale":"2024-04-25T09:58:45.295316+0000","last_undegraded":"2024-04-25T09:58:45.295316+0000","last_fullsized":"2024-04-25T09:58:45.295316+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:05.337524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.283476+0000","last_change":"2024-04-25T09:58:45.282174+0000","last_active":"2024-04-25T09:58:45.283476+0000","last_peered":"2024-04-25T09:58:45.283476+0000","last_clean":"2024-04-25T09:58:45.283476+0000","last_became_active":"2024-04-25T09:58:45.281632+0000","last_became_peered":"2024-04-25T09:58:45.281632+0000","last_unstale":"2024-04-25T09:58:45.283476+0000","last_undegraded":"2024-04-25T09:58:45.283476+0000","last_fullsized":"2024-04-25T09:58:45.283476+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:32.960859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T09:58:44.267142+0000","last_change":"2024-04-25T09:58:44.267142+0000","last_active":"2024-04-25T09:58:44.251439+0000","last_peered":"2024-04-25T09:58:44.251439+0000","last_clean":"2024-04-25T09:58:44.251439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:44.267142+0000","last_undegraded":"2024-04-25T09:58:44.267142+0000","last_fullsized":"2024-04-25T09:58:44.267142+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T09:58:44.264556+0000","last_change":"2024-04-25T09:58:44.264556+0000","last_active":"2024-04-25T09:58:44.251439+0000","last_peered":"2024-04-25T09:58:44.251439+0000","last_clean":"2024-04-25T09:58:44.251439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:44.264556+0000","last_undegraded":"2024-04-25T09:58:44.264556+0000","last_fullsized":"2024-04-25T09:58:44.264556+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T09:58:44.266222+0000","last_change":"2024-04-25T09:58:44.266222+0000","last_active":"2024-04-25T09:58:44.251439+0000","last_peered":"2024-04-25T09:58:44.251439+0000","last_clean":"2024-04-25T09:58:44.251439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:44.266222+0000","last_undegraded":"2024-04-25T09:58:44.266222+0000","last_fullsized":"2024-04-25T09:58:44.266222+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T09:58:44.266135+0000","last_change":"2024-04-25T09:58:44.266135+0000","last_active":"2024-04-25T09:58:44.251439+0000","last_peered":"2024-04-25T09:58:44.251439+0000","last_clean":"2024-04-25T09:58:44.251439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:44.266135+0000","last_undegraded":"2024-04-25T09:58:44.266135+0000","last_fullsized":"2024-04-25T09:58:44.266135+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.279931+0000","last_change":"2024-04-25T09:58:45.279931+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.279931+0000","last_undegraded":"2024-04-25T09:58:45.279931+0000","last_fullsized":"2024-04-25T09:58:45.279931+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T09:58:44.266132+0000","last_change":"2024-04-25T09:58:44.266132+0000","last_active":"2024-04-25T09:58:44.251439+0000","last_peered":"2024-04-25T09:58:44.251439+0000","last_clean":"2024-04-25T09:58:44.251439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:44.266132+0000","last_undegraded":"2024-04-25T09:58:44.266132+0000","last_fullsized":"2024-04-25T09:58:44.266132+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.274336+0000","last_change":"2024-04-25T09:58:45.274336+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.274336+0000","last_undegraded":"2024-04-25T09:58:45.274336+0000","last_fullsized":"2024-04-25T09:58:45.274336+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300179+0000","last_change":"2024-04-25T09:58:45.289571+0000","last_active":"2024-04-25T09:58:45.300179+0000","last_peered":"2024-04-25T09:58:45.300179+0000","last_clean":"2024-04-25T09:58:45.300179+0000","last_became_active":"2024-04-25T09:58:45.289229+0000","last_became_peered":"2024-04-25T09:58:45.289229+0000","last_unstale":"2024-04-25T09:58:45.300179+0000","last_undegraded":"2024-04-25T09:58:45.300179+0000","last_fullsized":"2024-04-25T09:58:45.300179+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:17.616346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.280116+0000","last_change":"2024-04-25T09:58:45.280116+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.280116+0000","last_undegraded":"2024-04-25T09:58:45.280116+0000","last_fullsized":"2024-04-25T09:58:45.280116+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T09:58:44.277643+0000","last_change":"2024-04-25T09:58:44.277643+0000","last_active":"2024-04-25T09:58:44.251439+0000","last_peered":"2024-04-25T09:58:44.251439+0000","last_clean":"2024-04-25T09:58:44.251439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:44.277643+0000","last_undegraded":"2024-04-25T09:58:44.277643+0000","last_fullsized":"2024-04-25T09:58:44.277643+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.274498+0000","last_change":"2024-04-25T09:58:45.274498+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.274498+0000","last_undegraded":"2024-04-25T09:58:45.274498+0000","last_fullsized":"2024-04-25T09:58:45.274498+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.305714+0000","last_change":"2024-04-25T09:58:45.300947+0000","last_active":"2024-04-25T09:58:45.305714+0000","last_peered":"2024-04-25T09:58:45.305714+0000","last_clean":"2024-04-25T09:58:45.305714+0000","last_became_active":"2024-04-25T09:58:45.300453+0000","last_became_peered":"2024-04-25T09:58:45.300453+0000","last_unstale":"2024-04-25T09:58:45.305714+0000","last_undegraded":"2024-04-25T09:58:45.305714+0000","last_fullsized":"2024-04-25T09:58:45.305714+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:38.163978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300237+0000","last_change":"2024-04-25T09:58:45.291060+0000","last_active":"2024-04-25T09:58:45.300237+0000","last_peered":"2024-04-25T09:58:45.300237+0000","last_clean":"2024-04-25T09:58:45.300237+0000","last_became_active":"2024-04-25T09:58:45.290776+0000","last_became_peered":"2024-04-25T09:58:45.290776+0000","last_unstale":"2024-04-25T09:58:45.300237+0000","last_undegraded":"2024-04-25T09:58:45.300237+0000","last_fullsized":"2024-04-25T09:58:45.300237+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:47.465452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.282910+0000","last_change":"2024-04-25T09:58:45.282910+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.282910+0000","last_undegraded":"2024-04-25T09:58:45.282910+0000","last_fullsized":"2024-04-25T09:58:45.282910+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300912+0000","last_change":"2024-04-25T09:58:45.291324+0000","last_active":"2024-04-25T09:58:45.300912+0000","last_peered":"2024-04-25T09:58:45.300912+0000","last_clean":"2024-04-25T09:58:45.300912+0000","last_became_active":"2024-04-25T09:58:45.291012+0000","last_became_peered":"2024-04-25T09:58:45.291012+0000","last_unstale":"2024-04-25T09:58:45.300912+0000","last_undegraded":"2024-04-25T09:58:45.300912+0000","last_fullsized":"2024-04-25T09:58:45.300912+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:32.737781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.279610+0000","last_change":"2024-04-25T09:58:45.279610+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.279610+0000","last_undegraded":"2024-04-25T09:58:45.279610+0000","last_fullsized":"2024-04-25T09:58:45.279610+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T09:58:44.267173+0000","last_change":"2024-04-25T09:58:44.267173+0000","last_active":"2024-04-25T09:58:44.251439+0000","last_peered":"2024-04-25T09:58:44.251439+0000","last_clean":"2024-04-25T09:58:44.251439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:44.267173+0000","last_undegraded":"2024-04-25T09:58:44.267173+0000","last_fullsized":"2024-04-25T09:58:44.267173+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.295217+0000","last_change":"2024-04-25T09:58:45.286219+0000","last_active":"2024-04-25T09:58:45.295217+0000","last_peered":"2024-04-25T09:58:45.295217+0000","last_clean":"2024-04-25T09:58:45.295217+0000","last_became_active":"2024-04-25T09:58:45.285943+0000","last_became_peered":"2024-04-25T09:58:45.285943+0000","last_unstale":"2024-04-25T09:58:45.295217+0000","last_undegraded":"2024-04-25T09:58:45.295217+0000","last_fullsized":"2024-04-25T09:58:45.295217+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:29.543991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T09:58:44.264536+0000","last_change":"2024-04-25T09:58:44.264536+0000","last_active":"2024-04-25T09:58:44.251439+0000","last_peered":"2024-04-25T09:58:44.251439+0000","last_clean":"2024-04-25T09:58:44.251439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:44.264536+0000","last_undegraded":"2024-04-25T09:58:44.264536+0000","last_fullsized":"2024-04-25T09:58:44.264536+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.278615+0000","last_change":"2024-04-25T09:58:45.278615+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.278615+0000","last_undegraded":"2024-04-25T09:58:45.278615+0000","last_fullsized":"2024-04-25T09:58:45.278615+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T09:58:44.266104+0000","last_change":"2024-04-25T09:58:44.266104+0000","last_active":"2024-04-25T09:58:44.251439+0000","last_peered":"2024-04-25T09:58:44.251439+0000","last_clean":"2024-04-25T09:58:44.251439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:44.266104+0000","last_undegraded":"2024-04-25T09:58:44.266104+0000","last_fullsized":"2024-04-25T09:58:44.266104+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":266,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.283215+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T09:58:45.283215+0000","last_peered":"2024-04-25T09:58:45.283215+0000","last_clean":"2024-04-25T09:58:45.283215+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T09:58:45.283215+0000","last_undegraded":"2024-04-25T09:58:45.283215+0000","last_fullsized":"2024-04-25T09:58:45.283215+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":58,"acting":58,"num_store_stats":4},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542201,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1470464,"data_stored":984893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542201,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":876544,"data_stored":394525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542203,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":876544,"data_stored":394525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542200,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":888832,"data_stored":401192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":876544,"data_stored":394525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":876544,"data_stored":394525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":864256,"data_stored":388316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1458176,"data_stored":978684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:58:49.308 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:58:49.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.441+0000 7f42346bd640 1 Processor -- start 2024-04-25T09:58:49.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.441+0000 7f42346bd640 1 -- start start 2024-04-25T09:58:49.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.442+0000 7f42346bd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f422c0d0aa0 0x7f422c161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:49.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.442+0000 7f42346bd640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f422c15e8a0 con 0x7f422c15da60 2024-04-25T09:58:49.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.442+0000 7f42346bd640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f422c15eb80 con 0x7f422c1622b0 2024-04-25T09:58:49.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.442+0000 7f42346bd640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422c15ee60 con 0x7f422c0d0aa0 2024-04-25T09:58:49.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.442+0000 7f4232459640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f422c15da60 0x7f422c15de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58204/0 (socket says 172.21.15.7:58204) 2024-04-25T09:58:49.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.442+0000 7f4232459640 1 -- 172.21.15.7:0/3328136019 learned_addr learned my addr 172.21.15.7:0/3328136019 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:49.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.442+0000 7f4231457640 1 -- 172.21.15.7:0/3328136019 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1329618266 0 0) 0x7f422c15e8a0 con 0x7f422c15da60 2024-04-25T09:58:49.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.442+0000 7f4231457640 1 -- 172.21.15.7:0/3328136019 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4218003520 con 0x7f422c15da60 2024-04-25T09:58:49.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.442+0000 7f4231c58640 1 --2- 172.21.15.7:0/3328136019 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f422c0d0aa0 0x7f422c161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:49.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.442+0000 7f4231457640 1 -- 172.21.15.7:0/3328136019 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4264815393 0 0) 0x7f4218003520 con 0x7f422c15da60 2024-04-25T09:58:49.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.442+0000 7f4231457640 1 -- 172.21.15.7:0/3328136019 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f422c0d0aa0 msgr2=0x7f422c161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:49.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.442+0000 7f4231457640 1 --2- 172.21.15.7:0/3328136019 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f422c0d0aa0 0x7f422c161d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:49.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.442+0000 7f4231457640 1 -- 172.21.15.7:0/3328136019 >> v1:172.21.15.55:6789/0 conn(0x7f422c1622b0 legacy=0x7f422c0ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:49.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.442+0000 7f4231457640 1 -- 172.21.15.7:0/3328136019 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422c161850 con 0x7f422c15da60 2024-04-25T09:58:49.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.442+0000 7f4231457640 1 -- 172.21.15.7:0/3328136019 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f4228001670 con 0x7f422c15da60 2024-04-25T09:58:49.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.443+0000 7f4231457640 1 -- 172.21.15.7:0/3328136019 >> v1:172.21.15.7:6789/0 conn(0x7f422c15da60 legacy=0x7f422c15de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:49.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.443+0000 7f4231457640 1 --2- 172.21.15.7:0/3328136019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42180039e0 0x7f4218003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:49.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.443+0000 7f4231457640 1 --2- 172.21.15.7:0/3328136019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4218004800 0x7f4218004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:49.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.443+0000 7f4231457640 1 --2- 172.21.15.7:0/3328136019 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f422c0d0aa0 0x7f421800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:49.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.443+0000 7f4231457640 1 -- 172.21.15.7:0/3328136019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422c15ee60 con 0x7f4218004800 2024-04-25T09:58:49.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.443+0000 7f4231457640 1 -- 172.21.15.7:0/3328136019 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4218005550 con 0x7f42180039e0 2024-04-25T09:58:49.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.443+0000 7f4231457640 1 -- 172.21.15.7:0/3328136019 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f421800bf00 con 0x7f422c0d0aa0 2024-04-25T09:58:49.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.443+0000 7f4231c58640 1 --2- 172.21.15.7:0/3328136019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4218004800 0x7f4218004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:49.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.443+0000 7f4232459640 1 --2- 172.21.15.7:0/3328136019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42180039e0 0x7f4218003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:49.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.443+0000 7f4232c5a640 1 --2- 172.21.15.7:0/3328136019 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f422c0d0aa0 0x7f421800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:49.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.443+0000 7f4231c58640 1 -- 172.21.15.7:0/3328136019 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f422c0d0aa0 msgr2=0x7f421800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:49.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.443+0000 7f4231c58640 1 --2- 172.21.15.7:0/3328136019 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f422c0d0aa0 0x7f421800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:49.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.443+0000 7f4231c58640 1 -- 172.21.15.7:0/3328136019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42180039e0 msgr2=0x7f4218003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:49.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.443+0000 7f4231c58640 1 --2- 172.21.15.7:0/3328136019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42180039e0 0x7f4218003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:49.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.443+0000 7f4231c58640 1 -- 172.21.15.7:0/3328136019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4218003520 con 0x7f4218004800 2024-04-25T09:58:49.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.443+0000 7f4232459640 1 --2- 172.21.15.7:0/3328136019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42180039e0 0x7f4218003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:49.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.444+0000 7f4231c58640 1 --2- 172.21.15.7:0/3328136019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4218004800 0x7f4218004c80 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f421c00ba10 tx=0x7f4218005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de2de78eb6c690ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:49.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.444+0000 7f4231457640 1 -- 172.21.15.7:0/3328136019 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c030070 con 0x7f4218004800 2024-04-25T09:58:49.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.444+0000 7f4231457640 1 -- 172.21.15.7:0/3328136019 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421c02add0 con 0x7f4218004800 2024-04-25T09:58:49.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.444+0000 7f4231457640 1 -- 172.21.15.7:0/3328136019 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c00b5e0 con 0x7f4218004800 2024-04-25T09:58:49.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.444+0000 7f42346bd640 1 -- 172.21.15.7:0/3328136019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4218004800 msgr2=0x7f4218004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:49.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.444+0000 7f42346bd640 1 --2- 172.21.15.7:0/3328136019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4218004800 0x7f4218004c80 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f421c00ba10 tx=0x7f4218005830 comp rx=0 tx=0).stop 2024-04-25T09:58:49.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.444+0000 7f4232c5a640 1 -- 172.21.15.7:0/3328136019 reap_dead start 2024-04-25T09:58:49.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.444+0000 7f42346bd640 1 -- 172.21.15.7:0/3328136019 shutdown_connections 2024-04-25T09:58:49.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.444+0000 7f42346bd640 1 -- 172.21.15.7:0/3328136019 >> 172.21.15.7:0/3328136019 conn(0x7f422c06bfe0 msgr2=0x7f422c06c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:49.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.444+0000 7f42346bd640 1 -- 172.21.15.7:0/3328136019 shutdown_connections 2024-04-25T09:58:49.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.444+0000 7f42346bd640 1 -- 172.21.15.7:0/3328136019 wait complete. 2024-04-25T09:58:49.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.446+0000 7f42346bd640 1 Processor -- start 2024-04-25T09:58:49.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.446+0000 7f42346bd640 1 -- start start 2024-04-25T09:58:49.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.446+0000 7f42346bd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4218004800 0x7f422c0ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:49.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.446+0000 7f42346bd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f422c0caed0 0x7f422c0cb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:49.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.446+0000 7f42346bd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f422c0aaf50 0x7f422c0ab3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:49.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.446+0000 7f42346bd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422c0cedb0 con 0x7f422c0aaf50 2024-04-25T09:58:49.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.446+0000 7f42346bd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422c0cec30 con 0x7f4218004800 2024-04-25T09:58:49.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.446+0000 7f42346bd640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422c161d70 con 0x7f422c0caed0 2024-04-25T09:58:49.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.446+0000 7f4232c5a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f422c0aaf50 0x7f422c0ab3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:49.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.446+0000 7f4232c5a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f422c0aaf50 0x7f422c0ab3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36952/0 (socket says 172.21.15.7:36952) 2024-04-25T09:58:49.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.447+0000 7f4232c5a640 1 -- 172.21.15.7:0/1252103599 learned_addr learned my addr 172.21.15.7:0/1252103599 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:49.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.447+0000 7f4232459640 1 --2- 172.21.15.7:0/1252103599 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4218004800 0x7f422c0ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:49.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.447+0000 7f4231c58640 1 --2- 172.21.15.7:0/1252103599 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f422c0caed0 0x7f422c0cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:49.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.447+0000 7f4232c5a640 1 -- 172.21.15.7:0/1252103599 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f422c0caed0 msgr2=0x7f422c0cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:49.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.447+0000 7f4232c5a640 1 --2- 172.21.15.7:0/1252103599 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f422c0caed0 0x7f422c0cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:49.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.447+0000 7f4232c5a640 1 -- 172.21.15.7:0/1252103599 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4218004800 msgr2=0x7f422c0ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:49.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.447+0000 7f4232c5a640 1 --2- 172.21.15.7:0/1252103599 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4218004800 0x7f422c0ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:49.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.447+0000 7f4232c5a640 1 -- 172.21.15.7:0/1252103599 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422c0ce910 con 0x7f422c0aaf50 2024-04-25T09:58:49.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.447+0000 7f4232459640 1 --2- 172.21.15.7:0/1252103599 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4218004800 0x7f422c0ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:58:49.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.447+0000 7f4231c58640 1 --2- 172.21.15.7:0/1252103599 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f422c0caed0 0x7f422c0cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:58:49.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.447+0000 7f4232c5a640 1 --2- 172.21.15.7:0/1252103599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f422c0aaf50 0x7f422c0ab3d0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f422c161580 tx=0x7f422400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:49.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.447+0000 7f4222ffd640 1 -- 172.21.15.7:0/1252103599 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4224003970 con 0x7f422c0aaf50 2024-04-25T09:58:49.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.447+0000 7f4222ffd640 1 -- 172.21.15.7:0/1252103599 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4224018070 con 0x7f422c0aaf50 2024-04-25T09:58:49.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.447+0000 7f42346bd640 1 -- 172.21.15.7:0/1252103599 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f422c1f4300 con 0x7f422c0aaf50 2024-04-25T09:58:49.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.447+0000 7f4222ffd640 1 -- 172.21.15.7:0/1252103599 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4224003d50 con 0x7f422c0aaf50 2024-04-25T09:58:49.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.447+0000 7f42346bd640 1 -- 172.21.15.7:0/1252103599 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f422c0aa750 con 0x7f422c0aaf50 2024-04-25T09:58:49.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.448+0000 7f42346bd640 1 -- 172.21.15.7:0/1252103599 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f422c068fd0 con 0x7f422c0aaf50 2024-04-25T09:58:49.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.448+0000 7f4222ffd640 1 -- 172.21.15.7:0/1252103599 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f42240050d0 con 0x7f422c0aaf50 2024-04-25T09:58:49.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.449+0000 7f4222ffd640 1 --2- 172.21.15.7:0/1252103599 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f421006b4d0 0x7f421006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:49.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.449+0000 7f4222ffd640 1 -- 172.21.15.7:0/1252103599 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4224089ff0 con 0x7f422c0aaf50 2024-04-25T09:58:49.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.449+0000 7f4232459640 1 --2- 172.21.15.7:0/1252103599 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f421006b4d0 0x7f421006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:49.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.449+0000 7f4232459640 1 --2- 172.21.15.7:0/1252103599 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f421006b4d0 0x7f421006d990 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4228000c00 tx=0x7f4228001150 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:49.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.453+0000 7f4222ffd640 1 -- 172.21.15.7:0/1252103599 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4224058d70 con 0x7f422c0aaf50 2024-04-25T09:58:49.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.628+0000 7f42346bd640 1 -- 172.21.15.7:0/1252103599 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f422c0d1560 con 0x7f421006b4d0 2024-04-25T09:58:49.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.634+0000 7f4222ffd640 1 -- 172.21.15.7:0/1252103599 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243395 (secure 0 0 0) 0x7f422c0d1560 con 0x7f421006b4d0 2024-04-25T09:58:49.640 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:58:49.641 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T09:58:49.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.637+0000 7f42346bd640 1 -- 172.21.15.7:0/1252103599 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f421006b4d0 msgr2=0x7f421006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:49.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.637+0000 7f42346bd640 1 --2- 172.21.15.7:0/1252103599 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f421006b4d0 0x7f421006d990 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4228000c00 tx=0x7f4228001150 comp rx=0 tx=0).stop 2024-04-25T09:58:49.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.637+0000 7f42346bd640 1 -- 172.21.15.7:0/1252103599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f422c0aaf50 msgr2=0x7f422c0ab3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:49.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.637+0000 7f42346bd640 1 --2- 172.21.15.7:0/1252103599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f422c0aaf50 0x7f422c0ab3d0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f422c161580 tx=0x7f422400eb90 comp rx=0 tx=0).stop 2024-04-25T09:58:49.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.637+0000 7f42346bd640 1 -- 172.21.15.7:0/1252103599 shutdown_connections 2024-04-25T09:58:49.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.637+0000 7f42346bd640 1 --2- 172.21.15.7:0/1252103599 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f421006b4d0 0x7f421006d990 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:49.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.637+0000 7f42346bd640 1 --2- 172.21.15.7:0/1252103599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f422c0aaf50 0x7f422c0ab3d0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:49.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.637+0000 7f42346bd640 1 --2- 172.21.15.7:0/1252103599 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f422c0caed0 0x7f422c0cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:49.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.637+0000 7f42346bd640 1 --2- 172.21.15.7:0/1252103599 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4218004800 0x7f422c0ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:49.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.637+0000 7f42346bd640 1 -- 172.21.15.7:0/1252103599 >> 172.21.15.7:0/1252103599 conn(0x7f422c06bfe0 msgr2=0x7f422c15f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:49.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.637+0000 7f42346bd640 1 -- 172.21.15.7:0/1252103599 shutdown_connections 2024-04-25T09:58:49.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.637+0000 7f42346bd640 1 -- 172.21.15.7:0/1252103599 wait complete. 2024-04-25T09:58:49.651 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2024-04-25T09:58:47.912846+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":124,"acting":124,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257448,"kb_used_data":7996,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754717272,"statfs":{"total":773094113280,"available":772830486528,"internally_reserved":0,"allocated":8187904,"data_stored":4331185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000766"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.278800+0000","last_change":"2024-04-25T09:58:45.278800+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.278800+0000","last_undegraded":"2024-04-25T09:58:45.278800+0000","last_fullsized":"2024-04-25T09:58:45.278800+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.279868+0000","last_change":"2024-04-25T09:58:45.279868+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.279868+0000","last_undegraded":"2024-04-25T09:58:45.279868+0000","last_fullsized":"2024-04-25T09:58:45.279868+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.283616+0000","last_change":"2024-04-25T09:58:45.283616+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.283616+0000","last_undegraded":"2024-04-25T09:58:45.283616+0000","last_fullsized":"2024-04-25T09:58:45.283616+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.276247+0000","last_change":"2024-04-25T09:58:45.276247+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.276247+0000","last_undegraded":"2024-04-25T09:58:45.276247+0000","last_fullsized":"2024-04-25T09:58:45.276247+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.282126+0000","last_change":"2024-04-25T09:58:45.282126+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.282126+0000","last_undegraded":"2024-04-25T09:58:45.282126+0000","last_fullsized":"2024-04-25T09:58:45.282126+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.279452+0000","last_change":"2024-04-25T09:58:45.279452+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.279452+0000","last_undegraded":"2024-04-25T09:58:45.279452+0000","last_fullsized":"2024-04-25T09:58:45.279452+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.281660+0000","last_change":"2024-04-25T09:58:45.281660+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.281660+0000","last_undegraded":"2024-04-25T09:58:45.281660+0000","last_fullsized":"2024-04-25T09:58:45.281660+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.276219+0000","last_change":"2024-04-25T09:58:45.276219+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.276219+0000","last_undegraded":"2024-04-25T09:58:45.276219+0000","last_fullsized":"2024-04-25T09:58:45.276219+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.275561+0000","last_change":"2024-04-25T09:58:45.275561+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.275561+0000","last_undegraded":"2024-04-25T09:58:45.275561+0000","last_fullsized":"2024-04-25T09:58:45.275561+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.281719+0000","last_change":"2024-04-25T09:58:45.281719+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.281719+0000","last_undegraded":"2024-04-25T09:58:45.281719+0000","last_fullsized":"2024-04-25T09:58:45.281719+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.280101+0000","last_change":"2024-04-25T09:58:45.280101+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.280101+0000","last_undegraded":"2024-04-25T09:58:45.280101+0000","last_fullsized":"2024-04-25T09:58:45.280101+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.278275+0000","last_change":"2024-04-25T09:58:45.278275+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.278275+0000","last_undegraded":"2024-04-25T09:58:45.278275+0000","last_fullsized":"2024-04-25T09:58:45.278275+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.279531+0000","last_change":"2024-04-25T09:58:45.279531+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.279531+0000","last_undegraded":"2024-04-25T09:58:45.279531+0000","last_fullsized":"2024-04-25T09:58:45.279531+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T09:58:44.267740+0000","last_change":"2024-04-25T09:58:44.267740+0000","last_active":"2024-04-25T09:58:44.251439+0000","last_peered":"2024-04-25T09:58:44.251439+0000","last_clean":"2024-04-25T09:58:44.251439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:44.267740+0000","last_undegraded":"2024-04-25T09:58:44.267740+0000","last_fullsized":"2024-04-25T09:58:44.267740+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300470+0000","last_change":"2024-04-25T09:58:45.295953+0000","last_active":"2024-04-25T09:58:45.300470+0000","last_peered":"2024-04-25T09:58:45.300470+0000","last_clean":"2024-04-25T09:58:45.300470+0000","last_became_active":"2024-04-25T09:58:45.295589+0000","last_became_peered":"2024-04-25T09:58:45.295589+0000","last_unstale":"2024-04-25T09:58:45.300470+0000","last_undegraded":"2024-04-25T09:58:45.300470+0000","last_fullsized":"2024-04-25T09:58:45.300470+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:49.372377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.275001+0000","last_change":"2024-04-25T09:58:45.275001+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.275001+0000","last_undegraded":"2024-04-25T09:58:45.275001+0000","last_fullsized":"2024-04-25T09:58:45.275001+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.295423+0000","last_change":"2024-04-25T09:58:45.289498+0000","last_active":"2024-04-25T09:58:45.295423+0000","last_peered":"2024-04-25T09:58:45.295423+0000","last_clean":"2024-04-25T09:58:45.295423+0000","last_became_active":"2024-04-25T09:58:45.289150+0000","last_became_peered":"2024-04-25T09:58:45.289150+0000","last_unstale":"2024-04-25T09:58:45.295423+0000","last_undegraded":"2024-04-25T09:58:45.295423+0000","last_fullsized":"2024-04-25T09:58:45.295423+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:17.616346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.275587+0000","last_change":"2024-04-25T09:58:45.275587+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.275587+0000","last_undegraded":"2024-04-25T09:58:45.275587+0000","last_fullsized":"2024-04-25T09:58:45.275587+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300955+0000","last_change":"2024-04-25T09:58:45.291351+0000","last_active":"2024-04-25T09:58:45.300955+0000","last_peered":"2024-04-25T09:58:45.300955+0000","last_clean":"2024-04-25T09:58:45.300955+0000","last_became_active":"2024-04-25T09:58:45.290998+0000","last_became_peered":"2024-04-25T09:58:45.290998+0000","last_unstale":"2024-04-25T09:58:45.300955+0000","last_undegraded":"2024-04-25T09:58:45.300955+0000","last_fullsized":"2024-04-25T09:58:45.300955+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:50.139600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.295535+0000","last_change":"2024-04-25T09:58:45.288538+0000","last_active":"2024-04-25T09:58:45.295535+0000","last_peered":"2024-04-25T09:58:45.295535+0000","last_clean":"2024-04-25T09:58:45.295535+0000","last_became_active":"2024-04-25T09:58:45.288234+0000","last_became_peered":"2024-04-25T09:58:45.288234+0000","last_unstale":"2024-04-25T09:58:45.295535+0000","last_undegraded":"2024-04-25T09:58:45.295535+0000","last_fullsized":"2024-04-25T09:58:45.295535+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:47.899238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300052+0000","last_change":"2024-04-25T09:58:45.289545+0000","last_active":"2024-04-25T09:58:45.300052+0000","last_peered":"2024-04-25T09:58:45.300052+0000","last_clean":"2024-04-25T09:58:45.300052+0000","last_became_active":"2024-04-25T09:58:45.289245+0000","last_became_peered":"2024-04-25T09:58:45.289245+0000","last_unstale":"2024-04-25T09:58:45.300052+0000","last_undegraded":"2024-04-25T09:58:45.300052+0000","last_fullsized":"2024-04-25T09:58:45.300052+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:05.337524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.275591+0000","last_change":"2024-04-25T09:58:45.275591+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.275591+0000","last_undegraded":"2024-04-25T09:58:45.275591+0000","last_fullsized":"2024-04-25T09:58:45.275591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T09:58:44.277485+0000","last_change":"2024-04-25T09:58:44.277485+0000","last_active":"2024-04-25T09:58:44.251439+0000","last_peered":"2024-04-25T09:58:44.251439+0000","last_clean":"2024-04-25T09:58:44.251439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:44.277485+0000","last_undegraded":"2024-04-25T09:58:44.277485+0000","last_fullsized":"2024-04-25T09:58:44.277485+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.282321+0000","last_change":"2024-04-25T09:58:45.282321+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.282321+0000","last_undegraded":"2024-04-25T09:58:45.282321+0000","last_fullsized":"2024-04-25T09:58:45.282321+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T09:58:44.267735+0000","last_change":"2024-04-25T09:58:44.267735+0000","last_active":"2024-04-25T09:58:44.251439+0000","last_peered":"2024-04-25T09:58:44.251439+0000","last_clean":"2024-04-25T09:58:44.251439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:44.267735+0000","last_undegraded":"2024-04-25T09:58:44.267735+0000","last_fullsized":"2024-04-25T09:58:44.267735+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300162+0000","last_change":"2024-04-25T09:58:45.290559+0000","last_active":"2024-04-25T09:58:45.300162+0000","last_peered":"2024-04-25T09:58:45.300162+0000","last_clean":"2024-04-25T09:58:45.300162+0000","last_became_active":"2024-04-25T09:58:45.290260+0000","last_became_peered":"2024-04-25T09:58:45.290260+0000","last_unstale":"2024-04-25T09:58:45.300162+0000","last_undegraded":"2024-04-25T09:58:45.300162+0000","last_fullsized":"2024-04-25T09:58:45.300162+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:04.412202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.278455+0000","last_change":"2024-04-25T09:58:45.278455+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.278455+0000","last_undegraded":"2024-04-25T09:58:45.278455+0000","last_fullsized":"2024-04-25T09:58:45.278455+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300874+0000","last_change":"2024-04-25T09:58:45.296555+0000","last_active":"2024-04-25T09:58:45.300874+0000","last_peered":"2024-04-25T09:58:45.300874+0000","last_clean":"2024-04-25T09:58:45.300874+0000","last_became_active":"2024-04-25T09:58:45.296256+0000","last_became_peered":"2024-04-25T09:58:45.296256+0000","last_unstale":"2024-04-25T09:58:45.300874+0000","last_undegraded":"2024-04-25T09:58:45.300874+0000","last_fullsized":"2024-04-25T09:58:45.300874+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:47.465452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T09:58:44.267628+0000","last_change":"2024-04-25T09:58:44.267628+0000","last_active":"2024-04-25T09:58:44.251439+0000","last_peered":"2024-04-25T09:58:44.251439+0000","last_clean":"2024-04-25T09:58:44.251439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:44.267628+0000","last_undegraded":"2024-04-25T09:58:44.267628+0000","last_fullsized":"2024-04-25T09:58:44.267628+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300599+0000","last_change":"2024-04-25T09:58:45.288248+0000","last_active":"2024-04-25T09:58:45.300599+0000","last_peered":"2024-04-25T09:58:45.300599+0000","last_clean":"2024-04-25T09:58:45.300599+0000","last_became_active":"2024-04-25T09:58:45.287736+0000","last_became_peered":"2024-04-25T09:58:45.287736+0000","last_unstale":"2024-04-25T09:58:45.300599+0000","last_undegraded":"2024-04-25T09:58:45.300599+0000","last_fullsized":"2024-04-25T09:58:45.300599+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:39.842372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.279062+0000","last_change":"2024-04-25T09:58:45.279062+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.279062+0000","last_undegraded":"2024-04-25T09:58:45.279062+0000","last_fullsized":"2024-04-25T09:58:45.279062+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300866+0000","last_change":"2024-04-25T09:58:45.296232+0000","last_active":"2024-04-25T09:58:45.300866+0000","last_peered":"2024-04-25T09:58:45.300866+0000","last_clean":"2024-04-25T09:58:45.300866+0000","last_became_active":"2024-04-25T09:58:45.295916+0000","last_became_peered":"2024-04-25T09:58:45.295916+0000","last_unstale":"2024-04-25T09:58:45.300866+0000","last_undegraded":"2024-04-25T09:58:45.300866+0000","last_fullsized":"2024-04-25T09:58:45.300866+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:04.412202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.281278+0000","last_change":"2024-04-25T09:58:45.281278+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.281278+0000","last_undegraded":"2024-04-25T09:58:45.281278+0000","last_fullsized":"2024-04-25T09:58:45.281278+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.295341+0000","last_change":"2024-04-25T09:58:45.287147+0000","last_active":"2024-04-25T09:58:45.295341+0000","last_peered":"2024-04-25T09:58:45.295341+0000","last_clean":"2024-04-25T09:58:45.295341+0000","last_became_active":"2024-04-25T09:58:45.286871+0000","last_became_peered":"2024-04-25T09:58:45.286871+0000","last_unstale":"2024-04-25T09:58:45.295341+0000","last_undegraded":"2024-04-25T09:58:45.295341+0000","last_fullsized":"2024-04-25T09:58:45.295341+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:42.618575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.279089+0000","last_change":"2024-04-25T09:58:45.279089+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.279089+0000","last_undegraded":"2024-04-25T09:58:45.279089+0000","last_fullsized":"2024-04-25T09:58:45.279089+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T09:58:44.267149+0000","last_change":"2024-04-25T09:58:44.267149+0000","last_active":"2024-04-25T09:58:44.251439+0000","last_peered":"2024-04-25T09:58:44.251439+0000","last_clean":"2024-04-25T09:58:44.251439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:44.267149+0000","last_undegraded":"2024-04-25T09:58:44.267149+0000","last_fullsized":"2024-04-25T09:58:44.267149+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.281886+0000","last_change":"2024-04-25T09:58:45.281886+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.281886+0000","last_undegraded":"2024-04-25T09:58:45.281886+0000","last_fullsized":"2024-04-25T09:58:45.281886+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T09:58:44.277485+0000","last_change":"2024-04-25T09:58:44.277485+0000","last_active":"2024-04-25T09:58:44.251439+0000","last_peered":"2024-04-25T09:58:44.251439+0000","last_clean":"2024-04-25T09:58:44.251439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:44.277485+0000","last_undegraded":"2024-04-25T09:58:44.277485+0000","last_fullsized":"2024-04-25T09:58:44.277485+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.295316+0000","last_change":"2024-04-25T09:58:45.288097+0000","last_active":"2024-04-25T09:58:45.295316+0000","last_peered":"2024-04-25T09:58:45.295316+0000","last_clean":"2024-04-25T09:58:45.295316+0000","last_became_active":"2024-04-25T09:58:45.287801+0000","last_became_peered":"2024-04-25T09:58:45.287801+0000","last_unstale":"2024-04-25T09:58:45.295316+0000","last_undegraded":"2024-04-25T09:58:45.295316+0000","last_fullsized":"2024-04-25T09:58:45.295316+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:05.337524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.283476+0000","last_change":"2024-04-25T09:58:45.282174+0000","last_active":"2024-04-25T09:58:45.283476+0000","last_peered":"2024-04-25T09:58:45.283476+0000","last_clean":"2024-04-25T09:58:45.283476+0000","last_became_active":"2024-04-25T09:58:45.281632+0000","last_became_peered":"2024-04-25T09:58:45.281632+0000","last_unstale":"2024-04-25T09:58:45.283476+0000","last_undegraded":"2024-04-25T09:58:45.283476+0000","last_fullsized":"2024-04-25T09:58:45.283476+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:32.960859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T09:58:44.267142+0000","last_change":"2024-04-25T09:58:44.267142+0000","last_active":"2024-04-25T09:58:44.251439+0000","last_peered":"2024-04-25T09:58:44.251439+0000","last_clean":"2024-04-25T09:58:44.251439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:44.267142+0000","last_undegraded":"2024-04-25T09:58:44.267142+0000","last_fullsized":"2024-04-25T09:58:44.267142+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T09:58:44.264556+0000","last_change":"2024-04-25T09:58:44.264556+0000","last_active":"2024-04-25T09:58:44.251439+0000","last_peered":"2024-04-25T09:58:44.251439+0000","last_clean":"2024-04-25T09:58:44.251439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:44.264556+0000","last_undegraded":"2024-04-25T09:58:44.264556+0000","last_fullsized":"2024-04-25T09:58:44.264556+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T09:58:44.266222+0000","last_change":"2024-04-25T09:58:44.266222+0000","last_active":"2024-04-25T09:58:44.251439+0000","last_peered":"2024-04-25T09:58:44.251439+0000","last_clean":"2024-04-25T09:58:44.251439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:44.266222+0000","last_undegraded":"2024-04-25T09:58:44.266222+0000","last_fullsized":"2024-04-25T09:58:44.266222+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T09:58:44.266135+0000","last_change":"2024-04-25T09:58:44.266135+0000","last_active":"2024-04-25T09:58:44.251439+0000","last_peered":"2024-04-25T09:58:44.251439+0000","last_clean":"2024-04-25T09:58:44.251439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:44.266135+0000","last_undegraded":"2024-04-25T09:58:44.266135+0000","last_fullsized":"2024-04-25T09:58:44.266135+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.279931+0000","last_change":"2024-04-25T09:58:45.279931+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.279931+0000","last_undegraded":"2024-04-25T09:58:45.279931+0000","last_fullsized":"2024-04-25T09:58:45.279931+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T09:58:44.266132+0000","last_change":"2024-04-25T09:58:44.266132+0000","last_active":"2024-04-25T09:58:44.251439+0000","last_peered":"2024-04-25T09:58:44.251439+0000","last_clean":"2024-04-25T09:58:44.251439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:44.266132+0000","last_undegraded":"2024-04-25T09:58:44.266132+0000","last_fullsized":"2024-04-25T09:58:44.266132+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.274336+0000","last_change":"2024-04-25T09:58:45.274336+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.274336+0000","last_undegraded":"2024-04-25T09:58:45.274336+0000","last_fullsized":"2024-04-25T09:58:45.274336+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300179+0000","last_change":"2024-04-25T09:58:45.289571+0000","last_active":"2024-04-25T09:58:45.300179+0000","last_peered":"2024-04-25T09:58:45.300179+0000","last_clean":"2024-04-25T09:58:45.300179+0000","last_became_active":"2024-04-25T09:58:45.289229+0000","last_became_peered":"2024-04-25T09:58:45.289229+0000","last_unstale":"2024-04-25T09:58:45.300179+0000","last_undegraded":"2024-04-25T09:58:45.300179+0000","last_fullsized":"2024-04-25T09:58:45.300179+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:17.616346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.280116+0000","last_change":"2024-04-25T09:58:45.280116+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.280116+0000","last_undegraded":"2024-04-25T09:58:45.280116+0000","last_fullsized":"2024-04-25T09:58:45.280116+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T09:58:44.277643+0000","last_change":"2024-04-25T09:58:44.277643+0000","last_active":"2024-04-25T09:58:44.251439+0000","last_peered":"2024-04-25T09:58:44.251439+0000","last_clean":"2024-04-25T09:58:44.251439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:44.277643+0000","last_undegraded":"2024-04-25T09:58:44.277643+0000","last_fullsized":"2024-04-25T09:58:44.277643+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.274498+0000","last_change":"2024-04-25T09:58:45.274498+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.274498+0000","last_undegraded":"2024-04-25T09:58:45.274498+0000","last_fullsized":"2024-04-25T09:58:45.274498+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.305714+0000","last_change":"2024-04-25T09:58:45.300947+0000","last_active":"2024-04-25T09:58:45.305714+0000","last_peered":"2024-04-25T09:58:45.305714+0000","last_clean":"2024-04-25T09:58:45.305714+0000","last_became_active":"2024-04-25T09:58:45.300453+0000","last_became_peered":"2024-04-25T09:58:45.300453+0000","last_unstale":"2024-04-25T09:58:45.305714+0000","last_undegraded":"2024-04-25T09:58:45.305714+0000","last_fullsized":"2024-04-25T09:58:45.305714+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:38.163978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300237+0000","last_change":"2024-04-25T09:58:45.291060+0000","last_active":"2024-04-25T09:58:45.300237+0000","last_peered":"2024-04-25T09:58:45.300237+0000","last_clean":"2024-04-25T09:58:45.300237+0000","last_became_active":"2024-04-25T09:58:45.290776+0000","last_became_peered":"2024-04-25T09:58:45.290776+0000","last_unstale":"2024-04-25T09:58:45.300237+0000","last_undegraded":"2024-04-25T09:58:45.300237+0000","last_fullsized":"2024-04-25T09:58:45.300237+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:47.465452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.282910+0000","last_change":"2024-04-25T09:58:45.282910+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.282910+0000","last_undegraded":"2024-04-25T09:58:45.282910+0000","last_fullsized":"2024-04-25T09:58:45.282910+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300912+0000","last_change":"2024-04-25T09:58:45.291324+0000","last_active":"2024-04-25T09:58:45.300912+0000","last_peered":"2024-04-25T09:58:45.300912+0000","last_clean":"2024-04-25T09:58:45.300912+0000","last_became_active":"2024-04-25T09:58:45.291012+0000","last_became_peered":"2024-04-25T09:58:45.291012+0000","last_unstale":"2024-04-25T09:58:45.300912+0000","last_undegraded":"2024-04-25T09:58:45.300912+0000","last_fullsized":"2024-04-25T09:58:45.300912+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:32.737781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.279610+0000","last_change":"2024-04-25T09:58:45.279610+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.279610+0000","last_undegraded":"2024-04-25T09:58:45.279610+0000","last_fullsized":"2024-04-25T09:58:45.279610+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T09:58:44.267173+0000","last_change":"2024-04-25T09:58:44.267173+0000","last_active":"2024-04-25T09:58:44.251439+0000","last_peered":"2024-04-25T09:58:44.251439+0000","last_clean":"2024-04-25T09:58:44.251439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:44.267173+0000","last_undegraded":"2024-04-25T09:58:44.267173+0000","last_fullsized":"2024-04-25T09:58:44.267173+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.295217+0000","last_change":"2024-04-25T09:58:45.286219+0000","last_active":"2024-04-25T09:58:45.295217+0000","last_peered":"2024-04-25T09:58:45.295217+0000","last_clean":"2024-04-25T09:58:45.295217+0000","last_became_active":"2024-04-25T09:58:45.285943+0000","last_became_peered":"2024-04-25T09:58:45.285943+0000","last_unstale":"2024-04-25T09:58:45.295217+0000","last_undegraded":"2024-04-25T09:58:45.295217+0000","last_fullsized":"2024-04-25T09:58:45.295217+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:29.543991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:58:45.261143+0000","last_change":"2024-04-25T09:58:45.261143+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.261143+0000","last_undegraded":"2024-04-25T09:58:45.261143+0000","last_fullsized":"2024-04-25T09:58:45.261143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T09:58:44.264536+0000","last_change":"2024-04-25T09:58:44.264536+0000","last_active":"2024-04-25T09:58:44.251439+0000","last_peered":"2024-04-25T09:58:44.251439+0000","last_clean":"2024-04-25T09:58:44.251439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:44.264536+0000","last_undegraded":"2024-04-25T09:58:44.264536+0000","last_fullsized":"2024-04-25T09:58:44.264536+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.278615+0000","last_change":"2024-04-25T09:58:45.278615+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.278615+0000","last_undegraded":"2024-04-25T09:58:45.278615+0000","last_fullsized":"2024-04-25T09:58:45.278615+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-04-25T09:58:44.266104+0000","last_change":"2024-04-25T09:58:44.266104+0000","last_active":"2024-04-25T09:58:44.251439+0000","last_peered":"2024-04-25T09:58:44.251439+0000","last_clean":"2024-04-25T09:58:44.251439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:44.266104+0000","last_undegraded":"2024-04-25T09:58:44.266104+0000","last_fullsized":"2024-04-25T09:58:44.266104+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":266,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.283215+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T09:58:45.283215+0000","last_peered":"2024-04-25T09:58:45.283215+0000","last_clean":"2024-04-25T09:58:45.283215+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T09:58:45.283215+0000","last_undegraded":"2024-04-25T09:58:45.283215+0000","last_fullsized":"2024-04-25T09:58:45.283215+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":58,"acting":58,"num_store_stats":4},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542201,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1470464,"data_stored":984893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542201,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":876544,"data_stored":394525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542203,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":876544,"data_stored":394525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542200,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":888832,"data_stored":401192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":876544,"data_stored":394525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":876544,"data_stored":394525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":864256,"data_stored":388316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1458176,"data_stored":978684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:58:49.655 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:58:49.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.788+0000 7f6d503e7640 1 Processor -- start 2024-04-25T09:58:49.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.788+0000 7f6d503e7640 1 -- start start 2024-04-25T09:58:49.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.789+0000 7f6d503e7640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d4815db00 0x7f6d480d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:49.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.789+0000 7f6d503e7640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d480d1e80 con 0x7f6d480ce2b0 2024-04-25T09:58:49.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.789+0000 7f6d503e7640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d48162490 con 0x7f6d480b53b0 2024-04-25T09:58:49.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.789+0000 7f6d503e7640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d480b5930 con 0x7f6d4815db00 2024-04-25T09:58:49.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.789+0000 7f6d4e984640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f6d480ce2b0 0x7f6d48161d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:59972/0 (socket says 172.21.15.7:59972) 2024-04-25T09:58:49.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.789+0000 7f6d4e984640 1 -- 172.21.15.7:0/1913353584 learned_addr learned my addr 172.21.15.7:0/1913353584 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:49.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.790+0000 7f6d4e183640 1 --2- 172.21.15.7:0/1913353584 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d4815db00 0x7f6d480d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:49.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.790+0000 7f6d4d181640 1 -- 172.21.15.7:0/1913353584 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2671133608 0 0) 0x7f6d480d1e80 con 0x7f6d480ce2b0 2024-04-25T09:58:49.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.790+0000 7f6d4d181640 1 -- 172.21.15.7:0/1913353584 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d34003520 con 0x7f6d480ce2b0 2024-04-25T09:58:49.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.790+0000 7f6d4d181640 1 -- 172.21.15.7:0/1913353584 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 217478476 0 0) 0x7f6d48162490 con 0x7f6d480b53b0 2024-04-25T09:58:49.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.790+0000 7f6d4d181640 1 -- 172.21.15.7:0/1913353584 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d480d1e80 con 0x7f6d480b53b0 2024-04-25T09:58:49.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.790+0000 7f6d4e183640 1 -- 172.21.15.7:0/1913353584 >> v1:172.21.15.55:6789/0 conn(0x7f6d480b53b0 legacy=0x7f6d48161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:49.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.790+0000 7f6d4e183640 1 -- 172.21.15.7:0/1913353584 >> v1:172.21.15.7:6789/0 conn(0x7f6d480ce2b0 legacy=0x7f6d48161d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:49.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.790+0000 7f6d4d181640 1 -- 172.21.15.7:0/1913353584 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1357758568 0 0) 0x7f6d34003520 con 0x7f6d480ce2b0 2024-04-25T09:58:49.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.790+0000 7f6d4e183640 1 -- 172.21.15.7:0/1913353584 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d480b5c10 con 0x7f6d4815db00 2024-04-25T09:58:49.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.791+0000 7f6d4e183640 1 --2- 172.21.15.7:0/1913353584 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d4815db00 0x7f6d480d0340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6d400097d0 tx=0x7f6d4002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8285cbd031faab8d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:49.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.791+0000 7f6d4d181640 1 -- 172.21.15.7:0/1913353584 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d40037070 con 0x7f6d4815db00 2024-04-25T09:58:49.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.791+0000 7f6d4d181640 1 -- 172.21.15.7:0/1913353584 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4002ac30 con 0x7f6d4815db00 2024-04-25T09:58:49.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.791+0000 7f6d4d181640 1 -- 172.21.15.7:0/1913353584 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d440019f0 con 0x7f6d4815db00 2024-04-25T09:58:49.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.791+0000 7f6d503e7640 1 -- 172.21.15.7:0/1913353584 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d4815db00 msgr2=0x7f6d480d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:49.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.791+0000 7f6d503e7640 1 --2- 172.21.15.7:0/1913353584 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d4815db00 0x7f6d480d0340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6d400097d0 tx=0x7f6d4002a1a0 comp rx=0 tx=0).stop 2024-04-25T09:58:49.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.792+0000 7f6d503e7640 1 -- 172.21.15.7:0/1913353584 shutdown_connections 2024-04-25T09:58:49.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.792+0000 7f6d503e7640 1 --2- 172.21.15.7:0/1913353584 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d4815db00 0x7f6d480d0340 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:49.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.792+0000 7f6d503e7640 1 -- 172.21.15.7:0/1913353584 >> 172.21.15.7:0/1913353584 conn(0x7f6d48072290 msgr2=0x7f6d480726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:49.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.792+0000 7f6d503e7640 1 -- 172.21.15.7:0/1913353584 shutdown_connections 2024-04-25T09:58:49.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.792+0000 7f6d503e7640 1 -- 172.21.15.7:0/1913353584 wait complete. 2024-04-25T09:58:49.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.793+0000 7f6d503e7640 1 Processor -- start 2024-04-25T09:58:49.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.793+0000 7f6d503e7640 1 -- start start 2024-04-25T09:58:49.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.793+0000 7f6d503e7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d480b53b0 0x7f6d481f3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:49.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.793+0000 7f6d503e7640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d480ce2b0 0x7f6d480ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:49.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.793+0000 7f6d503e7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d4815db00 0x7f6d4815cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:49.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.793+0000 7f6d503e7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d480b61d0 con 0x7f6d4815db00 2024-04-25T09:58:49.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.793+0000 7f6d503e7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4815dee0 con 0x7f6d480b53b0 2024-04-25T09:58:49.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.793+0000 7f6d503e7640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d480d3660 con 0x7f6d480ce2b0 2024-04-25T09:58:49.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.794+0000 7f6d4e984640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d4815db00 0x7f6d4815cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:49.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.794+0000 7f6d4e984640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d4815db00 0x7f6d4815cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34626/0 (socket says 172.21.15.7:34626) 2024-04-25T09:58:49.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.794+0000 7f6d4e984640 1 -- 172.21.15.7:0/47468661 learned_addr learned my addr 172.21.15.7:0/47468661 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:49.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.794+0000 7f6d4e183640 1 --2- 172.21.15.7:0/47468661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d480b53b0 0x7f6d481f3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:49.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.794+0000 7f6d4e984640 1 -- 172.21.15.7:0/47468661 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d480ce2b0 msgr2=0x7f6d480ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:49.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.794+0000 7f6d4d982640 1 --2- 172.21.15.7:0/47468661 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d480ce2b0 0x7f6d480ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:49.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.794+0000 7f6d4e984640 1 --2- 172.21.15.7:0/47468661 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d480ce2b0 0x7f6d480ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:49.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.794+0000 7f6d4e984640 1 -- 172.21.15.7:0/47468661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d480b53b0 msgr2=0x7f6d481f3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:49.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.794+0000 7f6d4e984640 1 --2- 172.21.15.7:0/47468661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d480b53b0 0x7f6d481f3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:49.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.794+0000 7f6d4e984640 1 -- 172.21.15.7:0/47468661 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d480cbb80 con 0x7f6d4815db00 2024-04-25T09:58:49.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.794+0000 7f6d4e183640 1 --2- 172.21.15.7:0/47468661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d480b53b0 0x7f6d481f3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:58:49.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.794+0000 7f6d4e984640 1 --2- 172.21.15.7:0/47468661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d4815db00 0x7f6d4815cbd0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f6d44001350 tx=0x7f6d4400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:49.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.794+0000 7f6d3effd640 1 -- 172.21.15.7:0/47468661 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d44017070 con 0x7f6d4815db00 2024-04-25T09:58:49.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.794+0000 7f6d3effd640 1 -- 172.21.15.7:0/47468661 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4400ad40 con 0x7f6d4815db00 2024-04-25T09:58:49.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.794+0000 7f6d503e7640 1 -- 172.21.15.7:0/47468661 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d480cbe60 con 0x7f6d4815db00 2024-04-25T09:58:49.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.794+0000 7f6d3effd640 1 -- 172.21.15.7:0/47468661 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d44012640 con 0x7f6d4815db00 2024-04-25T09:58:49.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.794+0000 7f6d503e7640 1 -- 172.21.15.7:0/47468661 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d480cc420 con 0x7f6d4815db00 2024-04-25T09:58:49.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.795+0000 7f6d503e7640 1 -- 172.21.15.7:0/47468661 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d48068fd0 con 0x7f6d4815db00 2024-04-25T09:58:49.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.796+0000 7f6d3effd640 1 -- 172.21.15.7:0/47468661 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6d4401a070 con 0x7f6d4815db00 2024-04-25T09:58:49.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.796+0000 7f6d3effd640 1 --2- 172.21.15.7:0/47468661 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6d2c06b500 0x7f6d2c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:49.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.796+0000 7f6d3effd640 1 -- 172.21.15.7:0/47468661 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6d4408a300 con 0x7f6d4815db00 2024-04-25T09:58:49.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.796+0000 7f6d4e183640 1 --2- 172.21.15.7:0/47468661 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6d2c06b500 0x7f6d2c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:49.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.797+0000 7f6d4e183640 1 --2- 172.21.15.7:0/47468661 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6d2c06b500 0x7f6d2c06d9c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6d40034000 tx=0x7f6d4002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:49.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.801+0000 7f6d3effd640 1 -- 172.21.15.7:0/47468661 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6d44058f70 con 0x7f6d4815db00 2024-04-25T09:58:49.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.977+0000 7f6d503e7640 1 -- 172.21.15.7:0/47468661 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6d480c7b80 con 0x7f6d2c06b500 2024-04-25T09:58:49.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.983+0000 7f6d3effd640 1 -- 172.21.15.7:0/47468661 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249658 (secure 0 0 0) 0x7f6d480c7b80 con 0x7f6d2c06b500 2024-04-25T09:58:49.989 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:58:49.990 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T09:58:49.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.985+0000 7f6d503e7640 1 -- 172.21.15.7:0/47468661 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6d2c06b500 msgr2=0x7f6d2c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:49.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.985+0000 7f6d503e7640 1 --2- 172.21.15.7:0/47468661 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6d2c06b500 0x7f6d2c06d9c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6d40034000 tx=0x7f6d4002e000 comp rx=0 tx=0).stop 2024-04-25T09:58:49.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.985+0000 7f6d503e7640 1 -- 172.21.15.7:0/47468661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d4815db00 msgr2=0x7f6d4815cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:49.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.985+0000 7f6d503e7640 1 --2- 172.21.15.7:0/47468661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d4815db00 0x7f6d4815cbd0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f6d44001350 tx=0x7f6d4400a430 comp rx=0 tx=0).stop 2024-04-25T09:58:49.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.985+0000 7f6d503e7640 1 -- 172.21.15.7:0/47468661 shutdown_connections 2024-04-25T09:58:49.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.985+0000 7f6d503e7640 1 --2- 172.21.15.7:0/47468661 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6d2c06b500 0x7f6d2c06d9c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:49.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.985+0000 7f6d503e7640 1 --2- 172.21.15.7:0/47468661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d4815db00 0x7f6d4815cbd0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:49.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.985+0000 7f6d503e7640 1 --2- 172.21.15.7:0/47468661 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d480ce2b0 0x7f6d480ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:49.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.985+0000 7f6d503e7640 1 --2- 172.21.15.7:0/47468661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d480b53b0 0x7f6d481f3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:49.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.985+0000 7f6d503e7640 1 -- 172.21.15.7:0/47468661 >> 172.21.15.7:0/47468661 conn(0x7f6d48072290 msgr2=0x7f6d480b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:49.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.986+0000 7f6d503e7640 1 -- 172.21.15.7:0/47468661 shutdown_connections 2024-04-25T09:58:49.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:49.986+0000 7f6d503e7640 1 -- 172.21.15.7:0/47468661 wait complete. 2024-04-25T09:58:50.000 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2024-04-25T09:58:49.913145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591110,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":182,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":103,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257644,"kb_used_data":8188,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754717076,"statfs":{"total":773094113280,"available":772830285824,"internally_reserved":0,"allocated":8384512,"data_stored":4427143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":742,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.651583"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.278800+0000","last_change":"2024-04-25T09:58:45.278800+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.278800+0000","last_undegraded":"2024-04-25T09:58:45.278800+0000","last_fullsized":"2024-04-25T09:58:45.278800+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487843+0000","last_change":"2024-04-25T09:58:46.309867+0000","last_active":"2024-04-25T09:58:47.487843+0000","last_peered":"2024-04-25T09:58:47.487843+0000","last_clean":"2024-04-25T09:58:47.487843+0000","last_became_active":"2024-04-25T09:58:46.309570+0000","last_became_peered":"2024-04-25T09:58:46.309570+0000","last_unstale":"2024-04-25T09:58:47.487843+0000","last_undegraded":"2024-04-25T09:58:47.487843+0000","last_fullsized":"2024-04-25T09:58:47.487843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:56.849551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.756528+0000","last_change":"2024-04-25T09:58:46.295586+0000","last_active":"2024-04-25T09:58:47.756528+0000","last_peered":"2024-04-25T09:58:47.756528+0000","last_clean":"2024-04-25T09:58:47.756528+0000","last_became_active":"2024-04-25T09:58:46.294637+0000","last_became_peered":"2024-04-25T09:58:46.294637+0000","last_unstale":"2024-04-25T09:58:47.756528+0000","last_undegraded":"2024-04-25T09:58:47.756528+0000","last_fullsized":"2024-04-25T09:58:47.756528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:18.626049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.279868+0000","last_change":"2024-04-25T09:58:45.279868+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.279868+0000","last_undegraded":"2024-04-25T09:58:45.279868+0000","last_fullsized":"2024-04-25T09:58:45.279868+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257215+0000","last_change":"2024-04-25T09:58:46.303476+0000","last_active":"2024-04-25T09:58:48.257215+0000","last_peered":"2024-04-25T09:58:48.257215+0000","last_clean":"2024-04-25T09:58:48.257215+0000","last_became_active":"2024-04-25T09:58:46.303184+0000","last_became_peered":"2024-04-25T09:58:46.303184+0000","last_unstale":"2024-04-25T09:58:48.257215+0000","last_undegraded":"2024-04-25T09:58:48.257215+0000","last_fullsized":"2024-04-25T09:58:48.257215+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:39.535483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.288750+0000","last_change":"2024-04-25T09:58:46.303826+0000","last_active":"2024-04-25T09:58:47.288750+0000","last_peered":"2024-04-25T09:58:47.288750+0000","last_clean":"2024-04-25T09:58:47.288750+0000","last_became_active":"2024-04-25T09:58:46.303558+0000","last_became_peered":"2024-04-25T09:58:46.303558+0000","last_unstale":"2024-04-25T09:58:47.288750+0000","last_undegraded":"2024-04-25T09:58:47.288750+0000","last_fullsized":"2024-04-25T09:58:47.288750+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:14.220665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.283616+0000","last_change":"2024-04-25T09:58:45.283616+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.283616+0000","last_undegraded":"2024-04-25T09:58:45.283616+0000","last_fullsized":"2024-04-25T09:58:45.283616+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257122+0000","last_change":"2024-04-25T09:58:46.302356+0000","last_active":"2024-04-25T09:58:48.257122+0000","last_peered":"2024-04-25T09:58:48.257122+0000","last_clean":"2024-04-25T09:58:48.257122+0000","last_became_active":"2024-04-25T09:58:46.302045+0000","last_became_peered":"2024-04-25T09:58:46.302045+0000","last_unstale":"2024-04-25T09:58:48.257122+0000","last_undegraded":"2024-04-25T09:58:48.257122+0000","last_fullsized":"2024-04-25T09:58:48.257122+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:05.856751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.276247+0000","last_change":"2024-04-25T09:58:45.276247+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.276247+0000","last_undegraded":"2024-04-25T09:58:45.276247+0000","last_fullsized":"2024-04-25T09:58:45.276247+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.282126+0000","last_change":"2024-04-25T09:58:45.282126+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.282126+0000","last_undegraded":"2024-04-25T09:58:45.282126+0000","last_fullsized":"2024-04-25T09:58:45.282126+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487756+0000","last_change":"2024-04-25T09:58:46.311381+0000","last_active":"2024-04-25T09:58:47.487756+0000","last_peered":"2024-04-25T09:58:47.487756+0000","last_clean":"2024-04-25T09:58:47.487756+0000","last_became_active":"2024-04-25T09:58:46.310880+0000","last_became_peered":"2024-04-25T09:58:46.310880+0000","last_unstale":"2024-04-25T09:58:47.487756+0000","last_undegraded":"2024-04-25T09:58:47.487756+0000","last_fullsized":"2024-04-25T09:58:47.487756+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:44.119671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.279452+0000","last_change":"2024-04-25T09:58:45.279452+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.279452+0000","last_undegraded":"2024-04-25T09:58:45.279452+0000","last_fullsized":"2024-04-25T09:58:45.279452+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257232+0000","last_change":"2024-04-25T09:58:46.309893+0000","last_active":"2024-04-25T09:58:48.257232+0000","last_peered":"2024-04-25T09:58:48.257232+0000","last_clean":"2024-04-25T09:58:48.257232+0000","last_became_active":"2024-04-25T09:58:46.309213+0000","last_became_peered":"2024-04-25T09:58:46.309213+0000","last_unstale":"2024-04-25T09:58:48.257232+0000","last_undegraded":"2024-04-25T09:58:48.257232+0000","last_fullsized":"2024-04-25T09:58:48.257232+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:07.756398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.288771+0000","last_change":"2024-04-25T09:58:46.302828+0000","last_active":"2024-04-25T09:58:47.288771+0000","last_peered":"2024-04-25T09:58:47.288771+0000","last_clean":"2024-04-25T09:58:47.288771+0000","last_became_active":"2024-04-25T09:58:46.302511+0000","last_became_peered":"2024-04-25T09:58:46.302511+0000","last_unstale":"2024-04-25T09:58:47.288771+0000","last_undegraded":"2024-04-25T09:58:47.288771+0000","last_fullsized":"2024-04-25T09:58:47.288771+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:48.540478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487364+0000","last_change":"2024-04-25T09:58:46.292920+0000","last_active":"2024-04-25T09:58:47.487364+0000","last_peered":"2024-04-25T09:58:47.487364+0000","last_clean":"2024-04-25T09:58:47.487364+0000","last_became_active":"2024-04-25T09:58:46.292615+0000","last_became_peered":"2024-04-25T09:58:46.292615+0000","last_unstale":"2024-04-25T09:58:47.487364+0000","last_undegraded":"2024-04-25T09:58:47.487364+0000","last_fullsized":"2024-04-25T09:58:47.487364+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:37.291630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.281660+0000","last_change":"2024-04-25T09:58:45.281660+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.281660+0000","last_undegraded":"2024-04-25T09:58:45.281660+0000","last_fullsized":"2024-04-25T09:58:45.281660+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257538+0000","last_change":"2024-04-25T09:58:46.315825+0000","last_active":"2024-04-25T09:58:48.257538+0000","last_peered":"2024-04-25T09:58:48.257538+0000","last_clean":"2024-04-25T09:58:48.257538+0000","last_became_active":"2024-04-25T09:58:46.315414+0000","last_became_peered":"2024-04-25T09:58:46.315414+0000","last_unstale":"2024-04-25T09:58:48.257538+0000","last_undegraded":"2024-04-25T09:58:48.257538+0000","last_fullsized":"2024-04-25T09:58:48.257538+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:44.667003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.756503+0000","last_change":"2024-04-25T09:58:46.303789+0000","last_active":"2024-04-25T09:58:47.756503+0000","last_peered":"2024-04-25T09:58:47.756503+0000","last_clean":"2024-04-25T09:58:47.756503+0000","last_became_active":"2024-04-25T09:58:46.303513+0000","last_became_peered":"2024-04-25T09:58:46.303513+0000","last_unstale":"2024-04-25T09:58:47.756503+0000","last_undegraded":"2024-04-25T09:58:47.756503+0000","last_fullsized":"2024-04-25T09:58:47.756503+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:06.347228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.289041+0000","last_change":"2024-04-25T09:58:46.309950+0000","last_active":"2024-04-25T09:58:47.289041+0000","last_peered":"2024-04-25T09:58:47.289041+0000","last_clean":"2024-04-25T09:58:47.289041+0000","last_became_active":"2024-04-25T09:58:46.309665+0000","last_became_peered":"2024-04-25T09:58:46.309665+0000","last_unstale":"2024-04-25T09:58:47.289041+0000","last_undegraded":"2024-04-25T09:58:47.289041+0000","last_fullsized":"2024-04-25T09:58:47.289041+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:09.626543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257279+0000","last_change":"2024-04-25T09:58:46.306991+0000","last_active":"2024-04-25T09:58:48.257279+0000","last_peered":"2024-04-25T09:58:48.257279+0000","last_clean":"2024-04-25T09:58:48.257279+0000","last_became_active":"2024-04-25T09:58:46.306718+0000","last_became_peered":"2024-04-25T09:58:46.306718+0000","last_unstale":"2024-04-25T09:58:48.257279+0000","last_undegraded":"2024-04-25T09:58:48.257279+0000","last_fullsized":"2024-04-25T09:58:48.257279+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:57.951523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.276219+0000","last_change":"2024-04-25T09:58:45.276219+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.276219+0000","last_undegraded":"2024-04-25T09:58:45.276219+0000","last_fullsized":"2024-04-25T09:58:45.276219+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257066+0000","last_change":"2024-04-25T09:58:46.304713+0000","last_active":"2024-04-25T09:58:48.257066+0000","last_peered":"2024-04-25T09:58:48.257066+0000","last_clean":"2024-04-25T09:58:48.257066+0000","last_became_active":"2024-04-25T09:58:46.304414+0000","last_became_peered":"2024-04-25T09:58:46.304414+0000","last_unstale":"2024-04-25T09:58:48.257066+0000","last_undegraded":"2024-04-25T09:58:48.257066+0000","last_fullsized":"2024-04-25T09:58:48.257066+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:08.573464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.275561+0000","last_change":"2024-04-25T09:58:45.275561+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.275561+0000","last_undegraded":"2024-04-25T09:58:45.275561+0000","last_fullsized":"2024-04-25T09:58:45.275561+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487344+0000","last_change":"2024-04-25T09:58:46.297754+0000","last_active":"2024-04-25T09:58:47.487344+0000","last_peered":"2024-04-25T09:58:47.487344+0000","last_clean":"2024-04-25T09:58:47.487344+0000","last_became_active":"2024-04-25T09:58:46.297467+0000","last_became_peered":"2024-04-25T09:58:46.297467+0000","last_unstale":"2024-04-25T09:58:47.487344+0000","last_undegraded":"2024-04-25T09:58:47.487344+0000","last_fullsized":"2024-04-25T09:58:47.487344+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:41:12.840555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487777+0000","last_change":"2024-04-25T09:58:46.295732+0000","last_active":"2024-04-25T09:58:47.487777+0000","last_peered":"2024-04-25T09:58:47.487777+0000","last_clean":"2024-04-25T09:58:47.487777+0000","last_became_active":"2024-04-25T09:58:46.295406+0000","last_became_peered":"2024-04-25T09:58:46.295406+0000","last_unstale":"2024-04-25T09:58:47.487777+0000","last_undegraded":"2024-04-25T09:58:47.487777+0000","last_fullsized":"2024-04-25T09:58:47.487777+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:40.379753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.281719+0000","last_change":"2024-04-25T09:58:45.281719+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.281719+0000","last_undegraded":"2024-04-25T09:58:45.281719+0000","last_fullsized":"2024-04-25T09:58:45.281719+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.280101+0000","last_change":"2024-04-25T09:58:45.280101+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.280101+0000","last_undegraded":"2024-04-25T09:58:45.280101+0000","last_fullsized":"2024-04-25T09:58:45.280101+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257313+0000","last_change":"2024-04-25T09:58:46.314339+0000","last_active":"2024-04-25T09:58:48.257313+0000","last_peered":"2024-04-25T09:58:48.257313+0000","last_clean":"2024-04-25T09:58:48.257313+0000","last_became_active":"2024-04-25T09:58:46.314085+0000","last_became_peered":"2024-04-25T09:58:46.314085+0000","last_unstale":"2024-04-25T09:58:48.257313+0000","last_undegraded":"2024-04-25T09:58:48.257313+0000","last_fullsized":"2024-04-25T09:58:48.257313+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:28.589905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487443+0000","last_change":"2024-04-25T09:58:46.301429+0000","last_active":"2024-04-25T09:58:47.487443+0000","last_peered":"2024-04-25T09:58:47.487443+0000","last_clean":"2024-04-25T09:58:47.487443+0000","last_became_active":"2024-04-25T09:58:46.301118+0000","last_became_peered":"2024-04-25T09:58:46.301118+0000","last_unstale":"2024-04-25T09:58:47.487443+0000","last_undegraded":"2024-04-25T09:58:47.487443+0000","last_fullsized":"2024-04-25T09:58:47.487443+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:47.497812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.278275+0000","last_change":"2024-04-25T09:58:45.278275+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.278275+0000","last_undegraded":"2024-04-25T09:58:45.278275+0000","last_fullsized":"2024-04-25T09:58:45.278275+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.756291+0000","last_change":"2024-04-25T09:58:46.301841+0000","last_active":"2024-04-25T09:58:47.756291+0000","last_peered":"2024-04-25T09:58:47.756291+0000","last_clean":"2024-04-25T09:58:47.756291+0000","last_became_active":"2024-04-25T09:58:46.301509+0000","last_became_peered":"2024-04-25T09:58:46.301509+0000","last_unstale":"2024-04-25T09:58:47.756291+0000","last_undegraded":"2024-04-25T09:58:47.756291+0000","last_fullsized":"2024-04-25T09:58:47.756291+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:37.116316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.279531+0000","last_change":"2024-04-25T09:58:45.279531+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.279531+0000","last_undegraded":"2024-04-25T09:58:45.279531+0000","last_fullsized":"2024-04-25T09:58:45.279531+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.756265+0000","last_change":"2024-04-25T09:58:46.301020+0000","last_active":"2024-04-25T09:58:47.756265+0000","last_peered":"2024-04-25T09:58:47.756265+0000","last_clean":"2024-04-25T09:58:47.756265+0000","last_became_active":"2024-04-25T09:58:46.300707+0000","last_became_peered":"2024-04-25T09:58:46.300707+0000","last_unstale":"2024-04-25T09:58:47.756265+0000","last_undegraded":"2024-04-25T09:58:47.756265+0000","last_fullsized":"2024-04-25T09:58:47.756265+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:31.505419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"74'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257537+0000","last_change":"2024-04-25T09:58:45.283736+0000","last_active":"2024-04-25T09:58:48.257537+0000","last_peered":"2024-04-25T09:58:48.257537+0000","last_clean":"2024-04-25T09:58:48.257537+0000","last_became_active":"2024-04-25T09:58:45.283451+0000","last_became_peered":"2024-04-25T09:58:45.283451+0000","last_unstale":"2024-04-25T09:58:48.257537+0000","last_undegraded":"2024-04-25T09:58:48.257537+0000","last_fullsized":"2024-04-25T09:58:48.257537+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:13.117190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487410+0000","last_change":"2024-04-25T09:58:46.319812+0000","last_active":"2024-04-25T09:58:47.487410+0000","last_peered":"2024-04-25T09:58:47.487410+0000","last_clean":"2024-04-25T09:58:47.487410+0000","last_became_active":"2024-04-25T09:58:46.319517+0000","last_became_peered":"2024-04-25T09:58:46.319517+0000","last_unstale":"2024-04-25T09:58:47.487410+0000","last_undegraded":"2024-04-25T09:58:47.487410+0000","last_fullsized":"2024-04-25T09:58:47.487410+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:26.661081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300470+0000","last_change":"2024-04-25T09:58:45.295953+0000","last_active":"2024-04-25T09:58:45.300470+0000","last_peered":"2024-04-25T09:58:45.300470+0000","last_clean":"2024-04-25T09:58:45.300470+0000","last_became_active":"2024-04-25T09:58:45.295589+0000","last_became_peered":"2024-04-25T09:58:45.295589+0000","last_unstale":"2024-04-25T09:58:45.300470+0000","last_undegraded":"2024-04-25T09:58:45.300470+0000","last_fullsized":"2024-04-25T09:58:45.300470+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:49.372377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.275001+0000","last_change":"2024-04-25T09:58:45.275001+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.275001+0000","last_undegraded":"2024-04-25T09:58:45.275001+0000","last_fullsized":"2024-04-25T09:58:45.275001+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.295423+0000","last_change":"2024-04-25T09:58:45.289498+0000","last_active":"2024-04-25T09:58:45.295423+0000","last_peered":"2024-04-25T09:58:45.295423+0000","last_clean":"2024-04-25T09:58:45.295423+0000","last_became_active":"2024-04-25T09:58:45.289150+0000","last_became_peered":"2024-04-25T09:58:45.289150+0000","last_unstale":"2024-04-25T09:58:45.295423+0000","last_undegraded":"2024-04-25T09:58:45.295423+0000","last_fullsized":"2024-04-25T09:58:45.295423+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:17.616346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.275587+0000","last_change":"2024-04-25T09:58:45.275587+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.275587+0000","last_undegraded":"2024-04-25T09:58:45.275587+0000","last_fullsized":"2024-04-25T09:58:45.275587+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300955+0000","last_change":"2024-04-25T09:58:45.291351+0000","last_active":"2024-04-25T09:58:45.300955+0000","last_peered":"2024-04-25T09:58:45.300955+0000","last_clean":"2024-04-25T09:58:45.300955+0000","last_became_active":"2024-04-25T09:58:45.290998+0000","last_became_peered":"2024-04-25T09:58:45.290998+0000","last_unstale":"2024-04-25T09:58:45.300955+0000","last_undegraded":"2024-04-25T09:58:45.300955+0000","last_fullsized":"2024-04-25T09:58:45.300955+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:50.139600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487647+0000","last_change":"2024-04-25T09:58:46.309881+0000","last_active":"2024-04-25T09:58:47.487647+0000","last_peered":"2024-04-25T09:58:47.487647+0000","last_clean":"2024-04-25T09:58:47.487647+0000","last_became_active":"2024-04-25T09:58:46.309523+0000","last_became_peered":"2024-04-25T09:58:46.309523+0000","last_unstale":"2024-04-25T09:58:47.487647+0000","last_undegraded":"2024-04-25T09:58:47.487647+0000","last_fullsized":"2024-04-25T09:58:47.487647+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:29.965375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.295535+0000","last_change":"2024-04-25T09:58:45.288538+0000","last_active":"2024-04-25T09:58:45.295535+0000","last_peered":"2024-04-25T09:58:45.295535+0000","last_clean":"2024-04-25T09:58:45.295535+0000","last_became_active":"2024-04-25T09:58:45.288234+0000","last_became_peered":"2024-04-25T09:58:45.288234+0000","last_unstale":"2024-04-25T09:58:45.295535+0000","last_undegraded":"2024-04-25T09:58:45.295535+0000","last_fullsized":"2024-04-25T09:58:45.295535+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:47.899238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487772+0000","last_change":"2024-04-25T09:58:46.311147+0000","last_active":"2024-04-25T09:58:47.487772+0000","last_peered":"2024-04-25T09:58:47.487772+0000","last_clean":"2024-04-25T09:58:47.487772+0000","last_became_active":"2024-04-25T09:58:46.310517+0000","last_became_peered":"2024-04-25T09:58:46.310517+0000","last_unstale":"2024-04-25T09:58:47.487772+0000","last_undegraded":"2024-04-25T09:58:47.487772+0000","last_fullsized":"2024-04-25T09:58:47.487772+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:29:55.475855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300052+0000","last_change":"2024-04-25T09:58:45.289545+0000","last_active":"2024-04-25T09:58:45.300052+0000","last_peered":"2024-04-25T09:58:45.300052+0000","last_clean":"2024-04-25T09:58:45.300052+0000","last_became_active":"2024-04-25T09:58:45.289245+0000","last_became_peered":"2024-04-25T09:58:45.289245+0000","last_unstale":"2024-04-25T09:58:45.300052+0000","last_undegraded":"2024-04-25T09:58:45.300052+0000","last_fullsized":"2024-04-25T09:58:45.300052+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:05.337524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.275591+0000","last_change":"2024-04-25T09:58:45.275591+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.275591+0000","last_undegraded":"2024-04-25T09:58:45.275591+0000","last_fullsized":"2024-04-25T09:58:45.275591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487422+0000","last_change":"2024-04-25T09:58:45.285684+0000","last_active":"2024-04-25T09:58:47.487422+0000","last_peered":"2024-04-25T09:58:47.487422+0000","last_clean":"2024-04-25T09:58:47.487422+0000","last_became_active":"2024-04-25T09:58:45.285412+0000","last_became_peered":"2024-04-25T09:58:45.285412+0000","last_unstale":"2024-04-25T09:58:47.487422+0000","last_undegraded":"2024-04-25T09:58:47.487422+0000","last_fullsized":"2024-04-25T09:58:47.487422+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:11.765762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.282321+0000","last_change":"2024-04-25T09:58:45.282321+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.282321+0000","last_undegraded":"2024-04-25T09:58:45.282321+0000","last_fullsized":"2024-04-25T09:58:45.282321+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.256965+0000","last_change":"2024-04-25T09:58:45.281544+0000","last_active":"2024-04-25T09:58:48.256965+0000","last_peered":"2024-04-25T09:58:48.256965+0000","last_clean":"2024-04-25T09:58:48.256965+0000","last_became_active":"2024-04-25T09:58:45.281187+0000","last_became_peered":"2024-04-25T09:58:45.281187+0000","last_unstale":"2024-04-25T09:58:48.256965+0000","last_undegraded":"2024-04-25T09:58:48.256965+0000","last_fullsized":"2024-04-25T09:58:48.256965+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:43.942052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487415+0000","last_change":"2024-04-25T09:58:46.308264+0000","last_active":"2024-04-25T09:58:47.487415+0000","last_peered":"2024-04-25T09:58:47.487415+0000","last_clean":"2024-04-25T09:58:47.487415+0000","last_became_active":"2024-04-25T09:58:46.307975+0000","last_became_peered":"2024-04-25T09:58:46.307975+0000","last_unstale":"2024-04-25T09:58:47.487415+0000","last_undegraded":"2024-04-25T09:58:47.487415+0000","last_fullsized":"2024-04-25T09:58:47.487415+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:03:27.048245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300162+0000","last_change":"2024-04-25T09:58:45.290559+0000","last_active":"2024-04-25T09:58:45.300162+0000","last_peered":"2024-04-25T09:58:45.300162+0000","last_clean":"2024-04-25T09:58:45.300162+0000","last_became_active":"2024-04-25T09:58:45.290260+0000","last_became_peered":"2024-04-25T09:58:45.290260+0000","last_unstale":"2024-04-25T09:58:45.300162+0000","last_undegraded":"2024-04-25T09:58:45.300162+0000","last_fullsized":"2024-04-25T09:58:45.300162+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:04.412202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.278455+0000","last_change":"2024-04-25T09:58:45.278455+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.278455+0000","last_undegraded":"2024-04-25T09:58:45.278455+0000","last_fullsized":"2024-04-25T09:58:45.278455+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300874+0000","last_change":"2024-04-25T09:58:45.296555+0000","last_active":"2024-04-25T09:58:45.300874+0000","last_peered":"2024-04-25T09:58:45.300874+0000","last_clean":"2024-04-25T09:58:45.300874+0000","last_became_active":"2024-04-25T09:58:45.296256+0000","last_became_peered":"2024-04-25T09:58:45.296256+0000","last_unstale":"2024-04-25T09:58:45.300874+0000","last_undegraded":"2024-04-25T09:58:45.300874+0000","last_fullsized":"2024-04-25T09:58:45.300874+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:47.465452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.288927+0000","last_change":"2024-04-25T09:58:46.298913+0000","last_active":"2024-04-25T09:58:47.288927+0000","last_peered":"2024-04-25T09:58:47.288927+0000","last_clean":"2024-04-25T09:58:47.288927+0000","last_became_active":"2024-04-25T09:58:46.298592+0000","last_became_peered":"2024-04-25T09:58:46.298592+0000","last_unstale":"2024-04-25T09:58:47.288927+0000","last_undegraded":"2024-04-25T09:58:47.288927+0000","last_fullsized":"2024-04-25T09:58:47.288927+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:12.587780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"74'3","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257332+0000","last_change":"2024-04-25T09:58:45.282436+0000","last_active":"2024-04-25T09:58:48.257332+0000","last_peered":"2024-04-25T09:58:48.257332+0000","last_clean":"2024-04-25T09:58:48.257332+0000","last_became_active":"2024-04-25T09:58:45.282098+0000","last_became_peered":"2024-04-25T09:58:45.282098+0000","last_unstale":"2024-04-25T09:58:48.257332+0000","last_undegraded":"2024-04-25T09:58:48.257332+0000","last_fullsized":"2024-04-25T09:58:48.257332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:17.580693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.756372+0000","last_change":"2024-04-25T09:58:46.295920+0000","last_active":"2024-04-25T09:58:47.756372+0000","last_peered":"2024-04-25T09:58:47.756372+0000","last_clean":"2024-04-25T09:58:47.756372+0000","last_became_active":"2024-04-25T09:58:46.294687+0000","last_became_peered":"2024-04-25T09:58:46.294687+0000","last_unstale":"2024-04-25T09:58:47.756372+0000","last_undegraded":"2024-04-25T09:58:47.756372+0000","last_fullsized":"2024-04-25T09:58:47.756372+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:43.628278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300599+0000","last_change":"2024-04-25T09:58:45.288248+0000","last_active":"2024-04-25T09:58:45.300599+0000","last_peered":"2024-04-25T09:58:45.300599+0000","last_clean":"2024-04-25T09:58:45.300599+0000","last_became_active":"2024-04-25T09:58:45.287736+0000","last_became_peered":"2024-04-25T09:58:45.287736+0000","last_unstale":"2024-04-25T09:58:45.300599+0000","last_undegraded":"2024-04-25T09:58:45.300599+0000","last_fullsized":"2024-04-25T09:58:45.300599+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:39.842372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.279062+0000","last_change":"2024-04-25T09:58:45.279062+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.279062+0000","last_undegraded":"2024-04-25T09:58:45.279062+0000","last_fullsized":"2024-04-25T09:58:45.279062+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300866+0000","last_change":"2024-04-25T09:58:45.296232+0000","last_active":"2024-04-25T09:58:45.300866+0000","last_peered":"2024-04-25T09:58:45.300866+0000","last_clean":"2024-04-25T09:58:45.300866+0000","last_became_active":"2024-04-25T09:58:45.295916+0000","last_became_peered":"2024-04-25T09:58:45.295916+0000","last_unstale":"2024-04-25T09:58:45.300866+0000","last_undegraded":"2024-04-25T09:58:45.300866+0000","last_fullsized":"2024-04-25T09:58:45.300866+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:04.412202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.281278+0000","last_change":"2024-04-25T09:58:45.281278+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.281278+0000","last_undegraded":"2024-04-25T09:58:45.281278+0000","last_fullsized":"2024-04-25T09:58:45.281278+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.295341+0000","last_change":"2024-04-25T09:58:45.287147+0000","last_active":"2024-04-25T09:58:45.295341+0000","last_peered":"2024-04-25T09:58:45.295341+0000","last_clean":"2024-04-25T09:58:45.295341+0000","last_became_active":"2024-04-25T09:58:45.286871+0000","last_became_peered":"2024-04-25T09:58:45.286871+0000","last_unstale":"2024-04-25T09:58:45.295341+0000","last_undegraded":"2024-04-25T09:58:45.295341+0000","last_fullsized":"2024-04-25T09:58:45.295341+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:42.618575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.279089+0000","last_change":"2024-04-25T09:58:45.279089+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.279089+0000","last_undegraded":"2024-04-25T09:58:45.279089+0000","last_fullsized":"2024-04-25T09:58:45.279089+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.256966+0000","last_change":"2024-04-25T09:58:45.282926+0000","last_active":"2024-04-25T09:58:48.256966+0000","last_peered":"2024-04-25T09:58:48.256966+0000","last_clean":"2024-04-25T09:58:48.256966+0000","last_became_active":"2024-04-25T09:58:45.282629+0000","last_became_peered":"2024-04-25T09:58:45.282629+0000","last_unstale":"2024-04-25T09:58:48.256966+0000","last_undegraded":"2024-04-25T09:58:48.256966+0000","last_fullsized":"2024-04-25T09:58:48.256966+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:51.537578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.281886+0000","last_change":"2024-04-25T09:58:45.281886+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.281886+0000","last_undegraded":"2024-04-25T09:58:45.281886+0000","last_fullsized":"2024-04-25T09:58:45.281886+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"74'8","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487408+0000","last_change":"2024-04-25T09:58:45.288815+0000","last_active":"2024-04-25T09:58:47.487408+0000","last_peered":"2024-04-25T09:58:47.487408+0000","last_clean":"2024-04-25T09:58:47.487408+0000","last_became_active":"2024-04-25T09:58:45.288472+0000","last_became_peered":"2024-04-25T09:58:45.288472+0000","last_unstale":"2024-04-25T09:58:47.487408+0000","last_undegraded":"2024-04-25T09:58:47.487408+0000","last_fullsized":"2024-04-25T09:58:47.487408+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:02.869500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.288507+0000","last_change":"2024-04-25T09:58:46.301930+0000","last_active":"2024-04-25T09:58:47.288507+0000","last_peered":"2024-04-25T09:58:47.288507+0000","last_clean":"2024-04-25T09:58:47.288507+0000","last_became_active":"2024-04-25T09:58:46.301671+0000","last_became_peered":"2024-04-25T09:58:46.301671+0000","last_unstale":"2024-04-25T09:58:47.288507+0000","last_undegraded":"2024-04-25T09:58:47.288507+0000","last_fullsized":"2024-04-25T09:58:47.288507+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:08:06.950633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.295316+0000","last_change":"2024-04-25T09:58:45.288097+0000","last_active":"2024-04-25T09:58:45.295316+0000","last_peered":"2024-04-25T09:58:45.295316+0000","last_clean":"2024-04-25T09:58:45.295316+0000","last_became_active":"2024-04-25T09:58:45.287801+0000","last_became_peered":"2024-04-25T09:58:45.287801+0000","last_unstale":"2024-04-25T09:58:45.295316+0000","last_undegraded":"2024-04-25T09:58:45.295316+0000","last_fullsized":"2024-04-25T09:58:45.295316+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:05.337524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.256975+0000","last_change":"2024-04-25T09:58:46.308348+0000","last_active":"2024-04-25T09:58:48.256975+0000","last_peered":"2024-04-25T09:58:48.256975+0000","last_clean":"2024-04-25T09:58:48.256975+0000","last_became_active":"2024-04-25T09:58:46.308044+0000","last_became_peered":"2024-04-25T09:58:46.308044+0000","last_unstale":"2024-04-25T09:58:48.256975+0000","last_undegraded":"2024-04-25T09:58:48.256975+0000","last_fullsized":"2024-04-25T09:58:48.256975+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:10:18.258705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.283476+0000","last_change":"2024-04-25T09:58:45.282174+0000","last_active":"2024-04-25T09:58:45.283476+0000","last_peered":"2024-04-25T09:58:45.283476+0000","last_clean":"2024-04-25T09:58:45.283476+0000","last_became_active":"2024-04-25T09:58:45.281632+0000","last_became_peered":"2024-04-25T09:58:45.281632+0000","last_unstale":"2024-04-25T09:58:45.283476+0000","last_undegraded":"2024-04-25T09:58:45.283476+0000","last_fullsized":"2024-04-25T09:58:45.283476+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:32.960859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257202+0000","last_change":"2024-04-25T09:58:46.309129+0000","last_active":"2024-04-25T09:58:48.257202+0000","last_peered":"2024-04-25T09:58:48.257202+0000","last_clean":"2024-04-25T09:58:48.257202+0000","last_became_active":"2024-04-25T09:58:46.308393+0000","last_became_peered":"2024-04-25T09:58:46.308393+0000","last_unstale":"2024-04-25T09:58:48.257202+0000","last_undegraded":"2024-04-25T09:58:48.257202+0000","last_fullsized":"2024-04-25T09:58:48.257202+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:13.708287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257445+0000","last_change":"2024-04-25T09:58:45.281780+0000","last_active":"2024-04-25T09:58:48.257445+0000","last_peered":"2024-04-25T09:58:48.257445+0000","last_clean":"2024-04-25T09:58:48.257445+0000","last_became_active":"2024-04-25T09:58:45.281456+0000","last_became_peered":"2024-04-25T09:58:45.281456+0000","last_unstale":"2024-04-25T09:58:48.257445+0000","last_undegraded":"2024-04-25T09:58:48.257445+0000","last_fullsized":"2024-04-25T09:58:48.257445+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:06.608344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.288919+0000","last_change":"2024-04-25T09:58:46.301496+0000","last_active":"2024-04-25T09:58:47.288919+0000","last_peered":"2024-04-25T09:58:47.288919+0000","last_clean":"2024-04-25T09:58:47.288919+0000","last_became_active":"2024-04-25T09:58:46.300180+0000","last_became_peered":"2024-04-25T09:58:46.300180+0000","last_unstale":"2024-04-25T09:58:47.288919+0000","last_undegraded":"2024-04-25T09:58:47.288919+0000","last_fullsized":"2024-04-25T09:58:47.288919+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:58.805827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.756309+0000","last_change":"2024-04-25T09:58:45.278954+0000","last_active":"2024-04-25T09:58:47.756309+0000","last_peered":"2024-04-25T09:58:47.756309+0000","last_clean":"2024-04-25T09:58:47.756309+0000","last_became_active":"2024-04-25T09:58:45.278670+0000","last_became_peered":"2024-04-25T09:58:45.278670+0000","last_unstale":"2024-04-25T09:58:47.756309+0000","last_undegraded":"2024-04-25T09:58:47.756309+0000","last_fullsized":"2024-04-25T09:58:47.756309+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:08.289516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487720+0000","last_change":"2024-04-25T09:58:46.314327+0000","last_active":"2024-04-25T09:58:47.487720+0000","last_peered":"2024-04-25T09:58:47.487720+0000","last_clean":"2024-04-25T09:58:47.487720+0000","last_became_active":"2024-04-25T09:58:46.314045+0000","last_became_peered":"2024-04-25T09:58:46.314045+0000","last_unstale":"2024-04-25T09:58:47.487720+0000","last_undegraded":"2024-04-25T09:58:47.487720+0000","last_fullsized":"2024-04-25T09:58:47.487720+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:01.351792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.288758+0000","last_change":"2024-04-25T09:58:45.274234+0000","last_active":"2024-04-25T09:58:47.288758+0000","last_peered":"2024-04-25T09:58:47.288758+0000","last_clean":"2024-04-25T09:58:47.288758+0000","last_became_active":"2024-04-25T09:58:45.273957+0000","last_became_peered":"2024-04-25T09:58:45.273957+0000","last_unstale":"2024-04-25T09:58:47.288758+0000","last_undegraded":"2024-04-25T09:58:47.288758+0000","last_fullsized":"2024-04-25T09:58:47.288758+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:02.869500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487881+0000","last_change":"2024-04-25T09:58:46.300913+0000","last_active":"2024-04-25T09:58:47.487881+0000","last_peered":"2024-04-25T09:58:47.487881+0000","last_clean":"2024-04-25T09:58:47.487881+0000","last_became_active":"2024-04-25T09:58:46.300612+0000","last_became_peered":"2024-04-25T09:58:46.300612+0000","last_unstale":"2024-04-25T09:58:47.487881+0000","last_undegraded":"2024-04-25T09:58:47.487881+0000","last_fullsized":"2024-04-25T09:58:47.487881+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:16.577248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.288520+0000","last_change":"2024-04-25T09:58:45.287605+0000","last_active":"2024-04-25T09:58:47.288520+0000","last_peered":"2024-04-25T09:58:47.288520+0000","last_clean":"2024-04-25T09:58:47.288520+0000","last_became_active":"2024-04-25T09:58:45.287270+0000","last_became_peered":"2024-04-25T09:58:45.287270+0000","last_unstale":"2024-04-25T09:58:47.288520+0000","last_undegraded":"2024-04-25T09:58:47.288520+0000","last_fullsized":"2024-04-25T09:58:47.288520+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:56:29.390909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.279931+0000","last_change":"2024-04-25T09:58:45.279931+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.279931+0000","last_undegraded":"2024-04-25T09:58:45.279931+0000","last_fullsized":"2024-04-25T09:58:45.279931+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.288533+0000","last_change":"2024-04-25T09:58:45.287684+0000","last_active":"2024-04-25T09:58:47.288533+0000","last_peered":"2024-04-25T09:58:47.288533+0000","last_clean":"2024-04-25T09:58:47.288533+0000","last_became_active":"2024-04-25T09:58:45.287393+0000","last_became_peered":"2024-04-25T09:58:45.287393+0000","last_unstale":"2024-04-25T09:58:47.288533+0000","last_undegraded":"2024-04-25T09:58:47.288533+0000","last_fullsized":"2024-04-25T09:58:47.288533+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:11.765762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.274336+0000","last_change":"2024-04-25T09:58:45.274336+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.274336+0000","last_undegraded":"2024-04-25T09:58:45.274336+0000","last_fullsized":"2024-04-25T09:58:45.274336+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300179+0000","last_change":"2024-04-25T09:58:45.289571+0000","last_active":"2024-04-25T09:58:45.300179+0000","last_peered":"2024-04-25T09:58:45.300179+0000","last_clean":"2024-04-25T09:58:45.300179+0000","last_became_active":"2024-04-25T09:58:45.289229+0000","last_became_peered":"2024-04-25T09:58:45.289229+0000","last_unstale":"2024-04-25T09:58:45.300179+0000","last_undegraded":"2024-04-25T09:58:45.300179+0000","last_fullsized":"2024-04-25T09:58:45.300179+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:17.616346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.280116+0000","last_change":"2024-04-25T09:58:45.280116+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.280116+0000","last_undegraded":"2024-04-25T09:58:45.280116+0000","last_fullsized":"2024-04-25T09:58:45.280116+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487895+0000","last_change":"2024-04-25T09:58:45.276375+0000","last_active":"2024-04-25T09:58:47.487895+0000","last_peered":"2024-04-25T09:58:47.487895+0000","last_clean":"2024-04-25T09:58:47.487895+0000","last_became_active":"2024-04-25T09:58:45.276101+0000","last_became_peered":"2024-04-25T09:58:45.276101+0000","last_unstale":"2024-04-25T09:58:47.487895+0000","last_undegraded":"2024-04-25T09:58:47.487895+0000","last_fullsized":"2024-04-25T09:58:47.487895+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:56:29.390909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.274498+0000","last_change":"2024-04-25T09:58:45.274498+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.274498+0000","last_undegraded":"2024-04-25T09:58:45.274498+0000","last_fullsized":"2024-04-25T09:58:45.274498+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.305714+0000","last_change":"2024-04-25T09:58:45.300947+0000","last_active":"2024-04-25T09:58:45.305714+0000","last_peered":"2024-04-25T09:58:45.305714+0000","last_clean":"2024-04-25T09:58:45.305714+0000","last_became_active":"2024-04-25T09:58:45.300453+0000","last_became_peered":"2024-04-25T09:58:45.300453+0000","last_unstale":"2024-04-25T09:58:45.305714+0000","last_undegraded":"2024-04-25T09:58:45.305714+0000","last_fullsized":"2024-04-25T09:58:45.305714+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:38.163978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487643+0000","last_change":"2024-04-25T09:58:46.307307+0000","last_active":"2024-04-25T09:58:47.487643+0000","last_peered":"2024-04-25T09:58:47.487643+0000","last_clean":"2024-04-25T09:58:47.487643+0000","last_became_active":"2024-04-25T09:58:46.307010+0000","last_became_peered":"2024-04-25T09:58:46.307010+0000","last_unstale":"2024-04-25T09:58:47.487643+0000","last_undegraded":"2024-04-25T09:58:47.487643+0000","last_fullsized":"2024-04-25T09:58:47.487643+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:16.682302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300237+0000","last_change":"2024-04-25T09:58:45.291060+0000","last_active":"2024-04-25T09:58:45.300237+0000","last_peered":"2024-04-25T09:58:45.300237+0000","last_clean":"2024-04-25T09:58:45.300237+0000","last_became_active":"2024-04-25T09:58:45.290776+0000","last_became_peered":"2024-04-25T09:58:45.290776+0000","last_unstale":"2024-04-25T09:58:45.300237+0000","last_undegraded":"2024-04-25T09:58:45.300237+0000","last_fullsized":"2024-04-25T09:58:45.300237+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:47.465452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.282910+0000","last_change":"2024-04-25T09:58:45.282910+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.282910+0000","last_undegraded":"2024-04-25T09:58:45.282910+0000","last_fullsized":"2024-04-25T09:58:45.282910+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300912+0000","last_change":"2024-04-25T09:58:45.291324+0000","last_active":"2024-04-25T09:58:45.300912+0000","last_peered":"2024-04-25T09:58:45.300912+0000","last_clean":"2024-04-25T09:58:45.300912+0000","last_became_active":"2024-04-25T09:58:45.291012+0000","last_became_peered":"2024-04-25T09:58:45.291012+0000","last_unstale":"2024-04-25T09:58:45.300912+0000","last_undegraded":"2024-04-25T09:58:45.300912+0000","last_fullsized":"2024-04-25T09:58:45.300912+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:32.737781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.279610+0000","last_change":"2024-04-25T09:58:45.279610+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.279610+0000","last_undegraded":"2024-04-25T09:58:45.279610+0000","last_fullsized":"2024-04-25T09:58:45.279610+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257137+0000","last_change":"2024-04-25T09:58:45.281366+0000","last_active":"2024-04-25T09:58:48.257137+0000","last_peered":"2024-04-25T09:58:48.257137+0000","last_clean":"2024-04-25T09:58:48.257137+0000","last_became_active":"2024-04-25T09:58:45.281068+0000","last_became_peered":"2024-04-25T09:58:45.281068+0000","last_unstale":"2024-04-25T09:58:48.257137+0000","last_undegraded":"2024-04-25T09:58:48.257137+0000","last_fullsized":"2024-04-25T09:58:48.257137+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:08:34.497717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.756591+0000","last_change":"2024-04-25T09:58:46.295242+0000","last_active":"2024-04-25T09:58:47.756591+0000","last_peered":"2024-04-25T09:58:47.756591+0000","last_clean":"2024-04-25T09:58:47.756591+0000","last_became_active":"2024-04-25T09:58:46.294939+0000","last_became_peered":"2024-04-25T09:58:46.294939+0000","last_unstale":"2024-04-25T09:58:47.756591+0000","last_undegraded":"2024-04-25T09:58:47.756591+0000","last_fullsized":"2024-04-25T09:58:47.756591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:05.421905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.295217+0000","last_change":"2024-04-25T09:58:45.286219+0000","last_active":"2024-04-25T09:58:45.295217+0000","last_peered":"2024-04-25T09:58:45.295217+0000","last_clean":"2024-04-25T09:58:45.295217+0000","last_became_active":"2024-04-25T09:58:45.285943+0000","last_became_peered":"2024-04-25T09:58:45.285943+0000","last_unstale":"2024-04-25T09:58:45.295217+0000","last_undegraded":"2024-04-25T09:58:45.295217+0000","last_fullsized":"2024-04-25T09:58:45.295217+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:29.543991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.756596+0000","last_change":"2024-04-25T09:58:46.314207+0000","last_active":"2024-04-25T09:58:47.756596+0000","last_peered":"2024-04-25T09:58:47.756596+0000","last_clean":"2024-04-25T09:58:47.756596+0000","last_became_active":"2024-04-25T09:58:46.313924+0000","last_became_peered":"2024-04-25T09:58:46.313924+0000","last_unstale":"2024-04-25T09:58:47.756596+0000","last_undegraded":"2024-04-25T09:58:47.756596+0000","last_fullsized":"2024-04-25T09:58:47.756596+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:48.475155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.756143+0000","last_change":"2024-04-25T09:58:45.277849+0000","last_active":"2024-04-25T09:58:47.756143+0000","last_peered":"2024-04-25T09:58:47.756143+0000","last_clean":"2024-04-25T09:58:47.756143+0000","last_became_active":"2024-04-25T09:58:45.277563+0000","last_became_peered":"2024-04-25T09:58:45.277563+0000","last_unstale":"2024-04-25T09:58:47.756143+0000","last_undegraded":"2024-04-25T09:58:47.756143+0000","last_fullsized":"2024-04-25T09:58:47.756143+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:27.012121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.278615+0000","last_change":"2024-04-25T09:58:45.278615+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.278615+0000","last_undegraded":"2024-04-25T09:58:45.278615+0000","last_fullsized":"2024-04-25T09:58:45.278615+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.288977+0000","last_change":"2024-04-25T09:58:45.288630+0000","last_active":"2024-04-25T09:58:47.288977+0000","last_peered":"2024-04-25T09:58:47.288977+0000","last_clean":"2024-04-25T09:58:47.288977+0000","last_became_active":"2024-04-25T09:58:45.288346+0000","last_became_peered":"2024-04-25T09:58:45.288346+0000","last_unstale":"2024-04-25T09:58:47.288977+0000","last_undegraded":"2024-04-25T09:58:47.288977+0000","last_fullsized":"2024-04-25T09:58:47.288977+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:54.526464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":266,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.283215+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T09:58:45.283215+0000","last_peered":"2024-04-25T09:58:45.283215+0000","last_clean":"2024-04-25T09:58:45.283215+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T09:58:45.283215+0000","last_undegraded":"2024-04-25T09:58:45.283215+0000","last_fullsized":"2024-04-25T09:58:45.283215+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":742,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542201,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1470464,"data_stored":984893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542201,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":876544,"data_stored":394525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542203,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":876544,"data_stored":394525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542200,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":888832,"data_stored":401192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574906,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":917504,"data_stored":415633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574906,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":925696,"data_stored":415793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":921600,"data_stored":415163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32652,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339188,"statfs":{"total":96636764160,"available":96603328512,"internally_reserved":0,"allocated":1507328,"data_stored":1005419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:58:50.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3f is not active+clean 2024-04-25T09:58:50.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:58:45.278800+0000', 'last_change': '2024-04-25T09:58:45.278800+0000', 'last_active': '2024-04-25T09:58:45.261143+0000', 'last_peered': '2024-04-25T09:58:45.261143+0000', 'last_clean': '2024-04-25T09:58:45.261143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:58:45.278800+0000', 'last_undegraded': '2024-04-25T09:58:45.278800+0000', 'last_fullsized': '2024-04-25T09:58:45.278800+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_clean_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:58:50.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3c is not active+clean 2024-04-25T09:58:50.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:58:45.279868+0000', 'last_change': '2024-04-25T09:58:45.279868+0000', 'last_active': '2024-04-25T09:58:45.261143+0000', 'last_peered': '2024-04-25T09:58:45.261143+0000', 'last_clean': '2024-04-25T09:58:45.261143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:58:45.279868+0000', 'last_undegraded': '2024-04-25T09:58:45.279868+0000', 'last_fullsized': '2024-04-25T09:58:45.279868+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_clean_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:58:50.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.39 is not active+clean 2024-04-25T09:58:50.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:58:45.283616+0000', 'last_change': '2024-04-25T09:58:45.283616+0000', 'last_active': '2024-04-25T09:58:45.261143+0000', 'last_peered': '2024-04-25T09:58:45.261143+0000', 'last_clean': '2024-04-25T09:58:45.261143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:58:45.283616+0000', 'last_undegraded': '2024-04-25T09:58:45.283616+0000', 'last_fullsized': '2024-04-25T09:58:45.283616+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_clean_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:58:50.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.37 is not active+clean 2024-04-25T09:58:50.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:58:45.276247+0000', 'last_change': '2024-04-25T09:58:45.276247+0000', 'last_active': '2024-04-25T09:58:45.261143+0000', 'last_peered': '2024-04-25T09:58:45.261143+0000', 'last_clean': '2024-04-25T09:58:45.261143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:58:45.276247+0000', 'last_undegraded': '2024-04-25T09:58:45.276247+0000', 'last_fullsized': '2024-04-25T09:58:45.276247+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_clean_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:58:50.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.36 is not active+clean 2024-04-25T09:58:50.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:58:45.282126+0000', 'last_change': '2024-04-25T09:58:45.282126+0000', 'last_active': '2024-04-25T09:58:45.261143+0000', 'last_peered': '2024-04-25T09:58:45.261143+0000', 'last_clean': '2024-04-25T09:58:45.261143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:58:45.282126+0000', 'last_undegraded': '2024-04-25T09:58:45.282126+0000', 'last_fullsized': '2024-04-25T09:58:45.282126+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_clean_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:58:50.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.34 is not active+clean 2024-04-25T09:58:50.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:58:45.279452+0000', 'last_change': '2024-04-25T09:58:45.279452+0000', 'last_active': '2024-04-25T09:58:45.261143+0000', 'last_peered': '2024-04-25T09:58:45.261143+0000', 'last_clean': '2024-04-25T09:58:45.261143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:58:45.279452+0000', 'last_undegraded': '2024-04-25T09:58:45.279452+0000', 'last_fullsized': '2024-04-25T09:58:45.279452+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_clean_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:58:50.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.30 is not active+clean 2024-04-25T09:58:50.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:58:45.281660+0000', 'last_change': '2024-04-25T09:58:45.281660+0000', 'last_active': '2024-04-25T09:58:45.261143+0000', 'last_peered': '2024-04-25T09:58:45.261143+0000', 'last_clean': '2024-04-25T09:58:45.261143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:58:45.281660+0000', 'last_undegraded': '2024-04-25T09:58:45.281660+0000', 'last_fullsized': '2024-04-25T09:58:45.281660+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_clean_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:58:50.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2b is not active+clean 2024-04-25T09:58:50.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:58:45.276219+0000', 'last_change': '2024-04-25T09:58:45.276219+0000', 'last_active': '2024-04-25T09:58:45.261143+0000', 'last_peered': '2024-04-25T09:58:45.261143+0000', 'last_clean': '2024-04-25T09:58:45.261143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:58:45.276219+0000', 'last_undegraded': '2024-04-25T09:58:45.276219+0000', 'last_fullsized': '2024-04-25T09:58:45.276219+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_clean_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:58:50.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.29 is not active+clean 2024-04-25T09:58:50.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:58:45.275561+0000', 'last_change': '2024-04-25T09:58:45.275561+0000', 'last_active': '2024-04-25T09:58:45.261143+0000', 'last_peered': '2024-04-25T09:58:45.261143+0000', 'last_clean': '2024-04-25T09:58:45.261143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:58:45.275561+0000', 'last_undegraded': '2024-04-25T09:58:45.275561+0000', 'last_fullsized': '2024-04-25T09:58:45.275561+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_clean_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:58:50.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.26 is not active+clean 2024-04-25T09:58:50.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:58:45.281719+0000', 'last_change': '2024-04-25T09:58:45.281719+0000', 'last_active': '2024-04-25T09:58:45.261143+0000', 'last_peered': '2024-04-25T09:58:45.261143+0000', 'last_clean': '2024-04-25T09:58:45.261143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:58:45.281719+0000', 'last_undegraded': '2024-04-25T09:58:45.281719+0000', 'last_fullsized': '2024-04-25T09:58:45.281719+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_clean_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:58:50.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.25 is not active+clean 2024-04-25T09:58:50.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:58:45.280101+0000', 'last_change': '2024-04-25T09:58:45.280101+0000', 'last_active': '2024-04-25T09:58:45.261143+0000', 'last_peered': '2024-04-25T09:58:45.261143+0000', 'last_clean': '2024-04-25T09:58:45.261143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:58:45.280101+0000', 'last_undegraded': '2024-04-25T09:58:45.280101+0000', 'last_fullsized': '2024-04-25T09:58:45.280101+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_clean_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:58:50.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.22 is not active+clean 2024-04-25T09:58:50.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:58:45.278275+0000', 'last_change': '2024-04-25T09:58:45.278275+0000', 'last_active': '2024-04-25T09:58:45.261143+0000', 'last_peered': '2024-04-25T09:58:45.261143+0000', 'last_clean': '2024-04-25T09:58:45.261143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:58:45.278275+0000', 'last_undegraded': '2024-04-25T09:58:45.278275+0000', 'last_fullsized': '2024-04-25T09:58:45.278275+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_clean_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:58:50.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.20 is not active+clean 2024-04-25T09:58:50.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:58:45.279531+0000', 'last_change': '2024-04-25T09:58:45.279531+0000', 'last_active': '2024-04-25T09:58:45.261143+0000', 'last_peered': '2024-04-25T09:58:45.261143+0000', 'last_clean': '2024-04-25T09:58:45.261143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:58:45.279531+0000', 'last_undegraded': '2024-04-25T09:58:45.279531+0000', 'last_fullsized': '2024-04-25T09:58:45.279531+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_clean_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:58:50.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1a is not active+clean 2024-04-25T09:58:50.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:58:45.275001+0000', 'last_change': '2024-04-25T09:58:45.275001+0000', 'last_active': '2024-04-25T09:58:45.261143+0000', 'last_peered': '2024-04-25T09:58:45.261143+0000', 'last_clean': '2024-04-25T09:58:45.261143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:58:45.275001+0000', 'last_undegraded': '2024-04-25T09:58:45.275001+0000', 'last_fullsized': '2024-04-25T09:58:45.275001+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_clean_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:58:50.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1b is not active+clean 2024-04-25T09:58:50.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:58:45.275587+0000', 'last_change': '2024-04-25T09:58:45.275587+0000', 'last_active': '2024-04-25T09:58:45.261143+0000', 'last_peered': '2024-04-25T09:58:45.261143+0000', 'last_clean': '2024-04-25T09:58:45.261143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:58:45.275587+0000', 'last_undegraded': '2024-04-25T09:58:45.275587+0000', 'last_fullsized': '2024-04-25T09:58:45.275587+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_clean_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:58:50.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1e is not active+clean 2024-04-25T09:58:50.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:58:45.275591+0000', 'last_change': '2024-04-25T09:58:45.275591+0000', 'last_active': '2024-04-25T09:58:45.261143+0000', 'last_peered': '2024-04-25T09:58:45.261143+0000', 'last_clean': '2024-04-25T09:58:45.261143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:58:45.275591+0000', 'last_undegraded': '2024-04-25T09:58:45.275591+0000', 'last_fullsized': '2024-04-25T09:58:45.275591+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_clean_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:58:50.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1f is not active+clean 2024-04-25T09:58:50.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:58:45.282321+0000', 'last_change': '2024-04-25T09:58:45.282321+0000', 'last_active': '2024-04-25T09:58:45.261143+0000', 'last_peered': '2024-04-25T09:58:45.261143+0000', 'last_clean': '2024-04-25T09:58:45.261143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:58:45.282321+0000', 'last_undegraded': '2024-04-25T09:58:45.282321+0000', 'last_fullsized': '2024-04-25T09:58:45.282321+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_clean_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:58:50.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.11 is not active+clean 2024-04-25T09:58:50.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:58:45.278455+0000', 'last_change': '2024-04-25T09:58:45.278455+0000', 'last_active': '2024-04-25T09:58:45.261143+0000', 'last_peered': '2024-04-25T09:58:45.261143+0000', 'last_clean': '2024-04-25T09:58:45.261143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:58:45.278455+0000', 'last_undegraded': '2024-04-25T09:58:45.278455+0000', 'last_fullsized': '2024-04-25T09:58:45.278455+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_clean_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:58:50.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.14 is not active+clean 2024-04-25T09:58:50.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:58:45.279062+0000', 'last_change': '2024-04-25T09:58:45.279062+0000', 'last_active': '2024-04-25T09:58:45.261143+0000', 'last_peered': '2024-04-25T09:58:45.261143+0000', 'last_clean': '2024-04-25T09:58:45.261143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:58:45.279062+0000', 'last_undegraded': '2024-04-25T09:58:45.279062+0000', 'last_fullsized': '2024-04-25T09:58:45.279062+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_clean_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:58:50.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.15 is not active+clean 2024-04-25T09:58:50.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:58:45.281278+0000', 'last_change': '2024-04-25T09:58:45.281278+0000', 'last_active': '2024-04-25T09:58:45.261143+0000', 'last_peered': '2024-04-25T09:58:45.261143+0000', 'last_clean': '2024-04-25T09:58:45.261143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:58:45.281278+0000', 'last_undegraded': '2024-04-25T09:58:45.281278+0000', 'last_fullsized': '2024-04-25T09:58:45.281278+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_clean_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:58:50.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.16 is not active+clean 2024-04-25T09:58:50.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:58:45.279089+0000', 'last_change': '2024-04-25T09:58:45.279089+0000', 'last_active': '2024-04-25T09:58:45.261143+0000', 'last_peered': '2024-04-25T09:58:45.261143+0000', 'last_clean': '2024-04-25T09:58:45.261143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:58:45.279089+0000', 'last_undegraded': '2024-04-25T09:58:45.279089+0000', 'last_fullsized': '2024-04-25T09:58:45.279089+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_clean_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:58:50.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.17 is not active+clean 2024-04-25T09:58:50.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:58:45.281886+0000', 'last_change': '2024-04-25T09:58:45.281886+0000', 'last_active': '2024-04-25T09:58:45.261143+0000', 'last_peered': '2024-04-25T09:58:45.261143+0000', 'last_clean': '2024-04-25T09:58:45.261143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:58:45.281886+0000', 'last_undegraded': '2024-04-25T09:58:45.281886+0000', 'last_fullsized': '2024-04-25T09:58:45.281886+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_clean_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:58:50.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.f is not active+clean 2024-04-25T09:58:50.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:58:45.279931+0000', 'last_change': '2024-04-25T09:58:45.279931+0000', 'last_active': '2024-04-25T09:58:45.261143+0000', 'last_peered': '2024-04-25T09:58:45.261143+0000', 'last_clean': '2024-04-25T09:58:45.261143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:58:45.279931+0000', 'last_undegraded': '2024-04-25T09:58:45.279931+0000', 'last_fullsized': '2024-04-25T09:58:45.279931+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_clean_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:58:50.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.0 is not active+clean 2024-04-25T09:58:50.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:58:45.274336+0000', 'last_change': '2024-04-25T09:58:45.274336+0000', 'last_active': '2024-04-25T09:58:45.261143+0000', 'last_peered': '2024-04-25T09:58:45.261143+0000', 'last_clean': '2024-04-25T09:58:45.261143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:58:45.274336+0000', 'last_undegraded': '2024-04-25T09:58:45.274336+0000', 'last_fullsized': '2024-04-25T09:58:45.274336+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_clean_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:58:50.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1 is not active+clean 2024-04-25T09:58:50.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:58:45.280116+0000', 'last_change': '2024-04-25T09:58:45.280116+0000', 'last_active': '2024-04-25T09:58:45.261143+0000', 'last_peered': '2024-04-25T09:58:45.261143+0000', 'last_clean': '2024-04-25T09:58:45.261143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:58:45.280116+0000', 'last_undegraded': '2024-04-25T09:58:45.280116+0000', 'last_fullsized': '2024-04-25T09:58:45.280116+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_clean_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:58:50.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2 is not active+clean 2024-04-25T09:58:50.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:58:45.274498+0000', 'last_change': '2024-04-25T09:58:45.274498+0000', 'last_active': '2024-04-25T09:58:45.261143+0000', 'last_peered': '2024-04-25T09:58:45.261143+0000', 'last_clean': '2024-04-25T09:58:45.261143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:58:45.274498+0000', 'last_undegraded': '2024-04-25T09:58:45.274498+0000', 'last_fullsized': '2024-04-25T09:58:45.274498+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_clean_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:58:50.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.4 is not active+clean 2024-04-25T09:58:50.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:58:45.282910+0000', 'last_change': '2024-04-25T09:58:45.282910+0000', 'last_active': '2024-04-25T09:58:45.261143+0000', 'last_peered': '2024-04-25T09:58:45.261143+0000', 'last_clean': '2024-04-25T09:58:45.261143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:58:45.282910+0000', 'last_undegraded': '2024-04-25T09:58:45.282910+0000', 'last_fullsized': '2024-04-25T09:58:45.282910+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_clean_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:58:50.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.5 is not active+clean 2024-04-25T09:58:50.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:58:45.279610+0000', 'last_change': '2024-04-25T09:58:45.279610+0000', 'last_active': '2024-04-25T09:58:45.261143+0000', 'last_peered': '2024-04-25T09:58:45.261143+0000', 'last_clean': '2024-04-25T09:58:45.261143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:58:45.279610+0000', 'last_undegraded': '2024-04-25T09:58:45.279610+0000', 'last_fullsized': '2024-04-25T09:58:45.279610+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_clean_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:58:50.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.d is not active+clean 2024-04-25T09:58:50.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:58:45.278615+0000', 'last_change': '2024-04-25T09:58:45.278615+0000', 'last_active': '2024-04-25T09:58:45.261143+0000', 'last_peered': '2024-04-25T09:58:45.261143+0000', 'last_clean': '2024-04-25T09:58:45.261143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:58:45.278615+0000', 'last_undegraded': '2024-04-25T09:58:45.278615+0000', 'last_fullsized': '2024-04-25T09:58:45.278615+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'last_clean_scrub_stamp': '2024-04-25T09:58:45.261143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:58:50.010 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:58:50.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.136+0000 7f92576a1640 1 Processor -- start 2024-04-25T09:58:50.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.137+0000 7f92576a1640 1 -- start start 2024-04-25T09:58:50.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.137+0000 7f92576a1640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f925015dad0 0x7f92500d18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:50.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.137+0000 7f92576a1640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92500b9580 0x7f92500d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:50.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.137+0000 7f92576a1640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92500d2240 con 0x7f92500d32e0 2024-04-25T09:58:50.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.137+0000 7f92576a1640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92500b7990 con 0x7f925015dad0 2024-04-25T09:58:50.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.137+0000 7f92576a1640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92500d2520 con 0x7f92500b9580 2024-04-25T09:58:50.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.138+0000 7f925543d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f925015dad0 0x7f92500d18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:50.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.138+0000 7f9255c3e640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f92500d32e0 0x7f92500b52d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:59980/0 (socket says 172.21.15.7:59980) 2024-04-25T09:58:50.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.138+0000 7f9255c3e640 1 -- 172.21.15.7:0/1484285001 learned_addr learned my addr 172.21.15.7:0/1484285001 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:50.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.138+0000 7f9254c3c640 1 --2- 172.21.15.7:0/1484285001 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92500b9580 0x7f92500d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:50.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.138+0000 7f925543d640 1 -- 172.21.15.7:0/1484285001 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92500b9580 msgr2=0x7f92500d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:50.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.138+0000 7f925543d640 1 --2- 172.21.15.7:0/1484285001 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92500b9580 0x7f92500d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:50.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.138+0000 7f925543d640 1 -- 172.21.15.7:0/1484285001 >> v1:172.21.15.7:6789/0 conn(0x7f92500d32e0 legacy=0x7f92500b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:50.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.138+0000 7f925543d640 1 -- 172.21.15.7:0/1484285001 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92500d2800 con 0x7f925015dad0 2024-04-25T09:58:50.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.139+0000 7f925543d640 1 --2- 172.21.15.7:0/1484285001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f925015dad0 0x7f92500d18d0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f92480097a0 tx=0x7f924802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b15559cfefad649 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:50.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.139+0000 7f9247fff640 1 -- 172.21.15.7:0/1484285001 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9248037070 con 0x7f925015dad0 2024-04-25T09:58:50.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.139+0000 7f9247fff640 1 -- 172.21.15.7:0/1484285001 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9248032440 con 0x7f925015dad0 2024-04-25T09:58:50.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.139+0000 7f9247fff640 1 -- 172.21.15.7:0/1484285001 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9248032810 con 0x7f925015dad0 2024-04-25T09:58:50.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.139+0000 7f92576a1640 1 -- 172.21.15.7:0/1484285001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f925015dad0 msgr2=0x7f92500d18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:50.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.139+0000 7f92576a1640 1 --2- 172.21.15.7:0/1484285001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f925015dad0 0x7f92500d18d0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f92480097a0 tx=0x7f924802a210 comp rx=0 tx=0).stop 2024-04-25T09:58:50.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.139+0000 7f92576a1640 1 -- 172.21.15.7:0/1484285001 shutdown_connections 2024-04-25T09:58:50.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.139+0000 7f92576a1640 1 --2- 172.21.15.7:0/1484285001 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92500b9580 0x7f92500d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:50.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.139+0000 7f92576a1640 1 --2- 172.21.15.7:0/1484285001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f925015dad0 0x7f92500d18d0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:50.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.139+0000 7f92576a1640 1 -- 172.21.15.7:0/1484285001 >> 172.21.15.7:0/1484285001 conn(0x7f925006bfe0 msgr2=0x7f925006c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:50.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.139+0000 7f92576a1640 1 -- 172.21.15.7:0/1484285001 shutdown_connections 2024-04-25T09:58:50.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.139+0000 7f92576a1640 1 -- 172.21.15.7:0/1484285001 wait complete. 2024-04-25T09:58:50.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.140+0000 7f92576a1640 1 Processor -- start 2024-04-25T09:58:50.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.141+0000 7f92576a1640 1 -- start start 2024-04-25T09:58:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.141+0000 7f92576a1640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92500b9580 0x7f925015a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.141+0000 7f92576a1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92500d32e0 0x7f92501514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.141+0000 7f92576a1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f925015dad0 0x7f92501519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.141+0000 7f92576a1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925015deb0 con 0x7f92500d32e0 2024-04-25T09:58:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.141+0000 7f92576a1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92500d2dc0 con 0x7f925015dad0 2024-04-25T09:58:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.141+0000 7f92576a1640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92500cd7c0 con 0x7f92500b9580 2024-04-25T09:58:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.141+0000 7f9254c3c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92500d32e0 0x7f92501514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.141+0000 7f9254c3c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92500d32e0 0x7f92501514b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34636/0 (socket says 172.21.15.7:34636) 2024-04-25T09:58:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.141+0000 7f9254c3c640 1 -- 172.21.15.7:0/2454668839 learned_addr learned my addr 172.21.15.7:0/2454668839 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.142+0000 7f925543d640 1 --2- 172.21.15.7:0/2454668839 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92500b9580 0x7f925015a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.142+0000 7f9255c3e640 1 --2- 172.21.15.7:0/2454668839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f925015dad0 0x7f92501519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.142+0000 7f9254c3c640 1 -- 172.21.15.7:0/2454668839 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92500b9580 msgr2=0x7f925015a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.142+0000 7f9254c3c640 1 --2- 172.21.15.7:0/2454668839 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92500b9580 0x7f925015a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.142+0000 7f9254c3c640 1 -- 172.21.15.7:0/2454668839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f925015dad0 msgr2=0x7f92501519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:50.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.142+0000 7f9254c3c640 1 --2- 172.21.15.7:0/2454668839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f925015dad0 0x7f92501519f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:50.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.142+0000 7f9254c3c640 1 -- 172.21.15.7:0/2454668839 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92500cb1b0 con 0x7f92500d32e0 2024-04-25T09:58:50.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.142+0000 7f9254c3c640 1 --2- 172.21.15.7:0/2454668839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92500d32e0 0x7f92501514b0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f924000d830 tx=0x7f924000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:50.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.142+0000 7f9245ffb640 1 -- 172.21.15.7:0/2454668839 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924000b6c0 con 0x7f92500d32e0 2024-04-25T09:58:50.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.142+0000 7f9245ffb640 1 -- 172.21.15.7:0/2454668839 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9240019070 con 0x7f92500d32e0 2024-04-25T09:58:50.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.142+0000 7f92576a1640 1 -- 172.21.15.7:0/2454668839 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92500cda00 con 0x7f92500d32e0 2024-04-25T09:58:50.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.142+0000 7f9245ffb640 1 -- 172.21.15.7:0/2454668839 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924000ba80 con 0x7f92500d32e0 2024-04-25T09:58:50.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.142+0000 7f92576a1640 1 -- 172.21.15.7:0/2454668839 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92500cadd0 con 0x7f92500d32e0 2024-04-25T09:58:50.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.143+0000 7f92576a1640 1 -- 172.21.15.7:0/2454668839 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92500cdec0 con 0x7f92500d32e0 2024-04-25T09:58:50.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.143+0000 7f9245ffb640 1 -- 172.21.15.7:0/2454668839 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f924001e460 con 0x7f92500d32e0 2024-04-25T09:58:50.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.144+0000 7f9245ffb640 1 --2- 172.21.15.7:0/2454668839 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f923406b500 0x7f923406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:50.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.144+0000 7f9245ffb640 1 -- 172.21.15.7:0/2454668839 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f924008aae0 con 0x7f92500d32e0 2024-04-25T09:58:50.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.144+0000 7f925543d640 1 --2- 172.21.15.7:0/2454668839 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f923406b500 0x7f923406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:50.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.144+0000 7f925543d640 1 --2- 172.21.15.7:0/2454668839 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f923406b500 0x7f923406d9c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9248034000 tx=0x7f924802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:50.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.148+0000 7f9245ffb640 1 -- 172.21.15.7:0/2454668839 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9240059740 con 0x7f92500d32e0 2024-04-25T09:58:50.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.397+0000 7f92576a1640 1 -- 172.21.15.7:0/2454668839 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f9250074bb0 con 0x7f92500d32e0 2024-04-25T09:58:50.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.397+0000 7f9245ffb640 1 -- 172.21.15.7:0/2454668839 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1099 (secure 0 0 0) 0x7f9240059040 con 0x7f92500d32e0 2024-04-25T09:58:50.402 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:58:50.402 INFO:teuthology.orchestra.run.smithi007.stdout:{"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":286,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":75,"num_osds":8,"num_up_osds":8,"osd_up_since":1714038855,"num_in_osds":8,"osd_in_since":1714038845,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":68},{"state_name":"creating+peering","count":29}],"num_pgs":97,"num_pools":3,"num_objects":13,"data_bytes":591110,"bytes_used":263827456,"bytes_avail":772830285824,"bytes_total":773094113280,"inactive_pgs_ratio":0.29896906018257141,"write_bytes_sec":543,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":37,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"b","status":"up:active","gid":6819}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":18,"modified":"2024-04-25T09:58:35.910366+0000","services":{}},"progress_events":{}} 2024-04-25T09:58:50.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.400+0000 7f92576a1640 1 -- 172.21.15.7:0/2454668839 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f923406b500 msgr2=0x7f923406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:50.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.400+0000 7f92576a1640 1 --2- 172.21.15.7:0/2454668839 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f923406b500 0x7f923406d9c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9248034000 tx=0x7f924802e000 comp rx=0 tx=0).stop 2024-04-25T09:58:50.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.400+0000 7f92576a1640 1 -- 172.21.15.7:0/2454668839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92500d32e0 msgr2=0x7f92501514b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:50.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.400+0000 7f92576a1640 1 --2- 172.21.15.7:0/2454668839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92500d32e0 0x7f92501514b0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f924000d830 tx=0x7f924000dcf0 comp rx=0 tx=0).stop 2024-04-25T09:58:50.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.400+0000 7f92576a1640 1 -- 172.21.15.7:0/2454668839 shutdown_connections 2024-04-25T09:58:50.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.400+0000 7f92576a1640 1 --2- 172.21.15.7:0/2454668839 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f923406b500 0x7f923406d9c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:50.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.400+0000 7f92576a1640 1 --2- 172.21.15.7:0/2454668839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f925015dad0 0x7f92501519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:50.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.400+0000 7f92576a1640 1 --2- 172.21.15.7:0/2454668839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92500d32e0 0x7f92501514b0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:50.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.400+0000 7f92576a1640 1 --2- 172.21.15.7:0/2454668839 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92500b9580 0x7f925015a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:50.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.400+0000 7f92576a1640 1 -- 172.21.15.7:0/2454668839 >> 172.21.15.7:0/2454668839 conn(0x7f925006bfe0 msgr2=0x7f92500ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:50.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.400+0000 7f92576a1640 1 -- 172.21.15.7:0/2454668839 shutdown_connections 2024-04-25T09:58:50.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.400+0000 7f92576a1640 1 -- 172.21.15.7:0/2454668839 wait complete. 2024-04-25T09:58:50.414 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T09:58:50.414 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:58:50.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.511+0000 7fcfa7f4c640 1 Processor -- start 2024-04-25T09:58:50.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.511+0000 7fcfa7f4c640 1 -- start start 2024-04-25T09:58:50.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.512+0000 7fcfa7f4c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcfa00b6b90 0x7fcfa00d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:50.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.512+0000 7fcfa7f4c640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa0162040 con 0x7fcfa00d0780 2024-04-25T09:58:50.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.512+0000 7fcfa7f4c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa0162320 con 0x7fcfa015dc10 2024-04-25T09:58:50.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.512+0000 7fcfa7f4c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa00d1d90 con 0x7fcfa00b6b90 2024-04-25T09:58:50.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.512+0000 7fcfa64e9640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fcfa00d0780 0x7fcfa00d27e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:59994/0 (socket says 172.21.15.7:59994) 2024-04-25T09:58:50.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.512+0000 7fcfa64e9640 1 -- 172.21.15.7:0/3512074030 learned_addr learned my addr 172.21.15.7:0/3512074030 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:50.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.512+0000 7fcfa54e7640 1 --2- 172.21.15.7:0/3512074030 >> v2:172.21.15.55:3300/0 conn(0x7fcfa00b6b90 0x7fcfa00d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:50.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.512+0000 7fcfa4ce6640 1 -- 172.21.15.7:0/3512074030 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3979965209 0 0) 0x7fcfa0162040 con 0x7fcfa00d0780 2024-04-25T09:58:50.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.512+0000 7fcfa4ce6640 1 -- 172.21.15.7:0/3512074030 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf88003520 con 0x7fcfa00d0780 2024-04-25T09:58:50.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.513+0000 7fcfa4ce6640 1 -- 172.21.15.7:0/3512074030 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 804457484 0 0) 0x7fcf88003520 con 0x7fcfa00d0780 2024-04-25T09:58:50.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.513+0000 7fcfa4ce6640 1 -- 172.21.15.7:0/3512074030 >> v2:172.21.15.55:3300/0 conn(0x7fcfa00b6b90 msgr2=0x7fcfa00d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:50.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.513+0000 7fcfa4ce6640 1 --2- 172.21.15.7:0/3512074030 >> v2:172.21.15.55:3300/0 conn(0x7fcfa00b6b90 0x7fcfa00d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:50.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.513+0000 7fcfa4ce6640 1 -- 172.21.15.7:0/3512074030 >> v1:172.21.15.55:6789/0 conn(0x7fcfa015dc10 legacy=0x7fcfa01615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:50.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.513+0000 7fcfa4ce6640 1 -- 172.21.15.7:0/3512074030 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa00d1fe0 con 0x7fcfa00d0780 2024-04-25T09:58:50.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.513+0000 7fcfa4ce6640 1 -- 172.21.15.7:0/3512074030 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fcf98001670 con 0x7fcfa00d0780 2024-04-25T09:58:50.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.513+0000 7fcfa4ce6640 1 -- 172.21.15.7:0/3512074030 >> v1:172.21.15.7:6789/0 conn(0x7fcfa00d0780 legacy=0x7fcfa00d27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:50.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.513+0000 7fcfa4ce6640 1 --2- 172.21.15.7:0/3512074030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf880039b0 0x7fcf88003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:50.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.513+0000 7fcfa4ce6640 1 --2- 172.21.15.7:0/3512074030 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcf88004800 0x7fcf88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:50.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.513+0000 7fcfa4ce6640 1 --2- 172.21.15.7:0/3512074030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf880052e0 0x7fcf8800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:50.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.513+0000 7fcfa4ce6640 1 -- 172.21.15.7:0/3512074030 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa00d1d90 con 0x7fcf880052e0 2024-04-25T09:58:50.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.513+0000 7fcfa4ce6640 1 -- 172.21.15.7:0/3512074030 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8800c1b0 con 0x7fcf880039b0 2024-04-25T09:58:50.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.513+0000 7fcfa4ce6640 1 -- 172.21.15.7:0/3512074030 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8800c3b0 con 0x7fcf88004800 2024-04-25T09:58:50.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.513+0000 7fcfa64e9640 1 --2- 172.21.15.7:0/3512074030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf880052e0 0x7fcf8800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:50.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.513+0000 7fcfa5ce8640 1 --2- 172.21.15.7:0/3512074030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf880039b0 0x7fcf88003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:50.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.513+0000 7fcfa54e7640 1 --2- 172.21.15.7:0/3512074030 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcf88004800 0x7fcf88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:50.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.513+0000 7fcfa64e9640 1 -- 172.21.15.7:0/3512074030 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcf88004800 msgr2=0x7fcf88004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:50.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.513+0000 7fcfa64e9640 1 --2- 172.21.15.7:0/3512074030 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcf88004800 0x7fcf88004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:50.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.513+0000 7fcfa64e9640 1 -- 172.21.15.7:0/3512074030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf880039b0 msgr2=0x7fcf88003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:50.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.513+0000 7fcfa64e9640 1 --2- 172.21.15.7:0/3512074030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf880039b0 0x7fcf88003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:50.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.513+0000 7fcfa64e9640 1 -- 172.21.15.7:0/3512074030 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf88003520 con 0x7fcf880052e0 2024-04-25T09:58:50.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.514+0000 7fcfa64e9640 1 -- 172.21.15.7:0/3512074030 reap_dead start 2024-04-25T09:58:50.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.514+0000 7fcfa64e9640 1 --2- 172.21.15.7:0/3512074030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf880052e0 0x7fcf8800b9c0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800c210 tx=0x7fcf88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bde5890d5982b27 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:50.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.514+0000 7fcfa4ce6640 1 -- 172.21.15.7:0/3512074030 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf98007d10 con 0x7fcf880052e0 2024-04-25T09:58:50.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.514+0000 7fcfa4ce6640 1 -- 172.21.15.7:0/3512074030 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf980058d0 con 0x7fcf880052e0 2024-04-25T09:58:50.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.514+0000 7fcfa4ce6640 1 -- 172.21.15.7:0/3512074030 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf98005cc0 con 0x7fcf880052e0 2024-04-25T09:58:50.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.515+0000 7fcfa7f4c640 1 -- 172.21.15.7:0/3512074030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf880052e0 msgr2=0x7fcf8800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:50.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.515+0000 7fcfa7f4c640 1 --2- 172.21.15.7:0/3512074030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf880052e0 0x7fcf8800b9c0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800c210 tx=0x7fcf88005830 comp rx=0 tx=0).stop 2024-04-25T09:58:50.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.515+0000 7fcfa7f4c640 1 -- 172.21.15.7:0/3512074030 shutdown_connections 2024-04-25T09:58:50.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.515+0000 7fcfa7f4c640 1 --2- 172.21.15.7:0/3512074030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf880052e0 0x7fcf8800b9c0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:50.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.515+0000 7fcfa7f4c640 1 -- 172.21.15.7:0/3512074030 >> 172.21.15.7:0/3512074030 conn(0x7fcfa0072290 msgr2=0x7fcfa00726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:50.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.515+0000 7fcfa7f4c640 1 -- 172.21.15.7:0/3512074030 shutdown_connections 2024-04-25T09:58:50.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.515+0000 7fcfa7f4c640 1 -- 172.21.15.7:0/3512074030 wait complete. 2024-04-25T09:58:50.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.516+0000 7fcfa7f4c640 1 Processor -- start 2024-04-25T09:58:50.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.516+0000 7fcfa7f4c640 1 -- start start 2024-04-25T09:58:50.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.517+0000 7fcfa7f4c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf880052e0 0x7fcfa0149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:50.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.517+0000 7fcfa7f4c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcfa014ecc0 0x7fcfa014f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:50.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.517+0000 7fcfa7f4c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa00b3d20 0x7fcfa00b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:50.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.517+0000 7fcfa7f4c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa00d0240 con 0x7fcfa00b3d20 2024-04-25T09:58:50.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.517+0000 7fcfa7f4c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa00d0c30 con 0x7fcf880052e0 2024-04-25T09:58:50.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.517+0000 7fcfa7f4c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa00d03c0 con 0x7fcfa014ecc0 2024-04-25T09:58:50.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.517+0000 7fcfa64e9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa00b3d20 0x7fcfa00b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:50.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.517+0000 7fcfa64e9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa00b3d20 0x7fcfa00b41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34652/0 (socket says 172.21.15.7:34652) 2024-04-25T09:58:50.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.517+0000 7fcfa64e9640 1 -- 172.21.15.7:0/928752931 learned_addr learned my addr 172.21.15.7:0/928752931 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:50.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.517+0000 7fcfa5ce8640 1 --2- 172.21.15.7:0/928752931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf880052e0 0x7fcfa0149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:50.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.517+0000 7fcfa54e7640 1 --2- 172.21.15.7:0/928752931 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcfa014ecc0 0x7fcfa014f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:50.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.517+0000 7fcfa64e9640 1 -- 172.21.15.7:0/928752931 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcfa014ecc0 msgr2=0x7fcfa014f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:50.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.517+0000 7fcfa64e9640 1 --2- 172.21.15.7:0/928752931 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcfa014ecc0 0x7fcfa014f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:50.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.517+0000 7fcfa64e9640 1 -- 172.21.15.7:0/928752931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf880052e0 msgr2=0x7fcfa0149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:50.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.517+0000 7fcfa64e9640 1 --2- 172.21.15.7:0/928752931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf880052e0 0x7fcfa0149fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:50.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.517+0000 7fcfa64e9640 1 -- 172.21.15.7:0/928752931 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa014f990 con 0x7fcfa00b3d20 2024-04-25T09:58:50.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.517+0000 7fcfa64e9640 1 --2- 172.21.15.7:0/928752931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa00b3d20 0x7fcfa00b41a0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800c210 tx=0x7fcfa0162210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:50.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.517+0000 7fcf9e7fc640 1 -- 172.21.15.7:0/928752931 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf98042070 con 0x7fcfa00b3d20 2024-04-25T09:58:50.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.517+0000 7fcf9e7fc640 1 -- 172.21.15.7:0/928752931 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf98005e10 con 0x7fcfa00b3d20 2024-04-25T09:58:50.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.517+0000 7fcfa7f4c640 1 -- 172.21.15.7:0/928752931 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa014fc70 con 0x7fcfa00b3d20 2024-04-25T09:58:50.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.517+0000 7fcf9e7fc640 1 -- 172.21.15.7:0/928752931 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf98007d10 con 0x7fcfa00b3d20 2024-04-25T09:58:50.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.517+0000 7fcfa7f4c640 1 -- 172.21.15.7:0/928752931 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa00b5e60 con 0x7fcfa00b3d20 2024-04-25T09:58:50.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.519+0000 7fcfa7f4c640 1 -- 172.21.15.7:0/928752931 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa00b6060 con 0x7fcfa00b3d20 2024-04-25T09:58:50.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.519+0000 7fcf9e7fc640 1 -- 172.21.15.7:0/928752931 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcf98045070 con 0x7fcfa00b3d20 2024-04-25T09:58:50.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.519+0000 7fcf9e7fc640 1 --2- 172.21.15.7:0/928752931 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcf8c06b4d0 0x7fcf8c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:50.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.519+0000 7fcf9e7fc640 1 -- 172.21.15.7:0/928752931 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcf980a9510 con 0x7fcfa00b3d20 2024-04-25T09:58:50.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.519+0000 7fcfa5ce8640 1 --2- 172.21.15.7:0/928752931 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcf8c06b4d0 0x7fcf8c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:50.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.520+0000 7fcfa5ce8640 1 --2- 172.21.15.7:0/928752931 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcf8c06b4d0 0x7fcf8c06d990 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fcf90000f80 tx=0x7fcf90009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:50.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.524+0000 7fcf9e7fc640 1 -- 172.21.15.7:0/928752931 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcfa00b6060 con 0x7fcfa00b3d20 2024-04-25T09:58:50.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.702+0000 7fcfa7f4c640 1 -- 172.21.15.7:0/928752931 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcfa0068fd0 con 0x7fcf8c06b4d0 2024-04-25T09:58:50.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.708+0000 7fcf9e7fc640 1 -- 172.21.15.7:0/928752931 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249658 (secure 0 0 0) 0x7fcfa0068fd0 con 0x7fcf8c06b4d0 2024-04-25T09:58:50.714 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:58:50.716 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T09:58:50.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.711+0000 7fcfa7f4c640 1 -- 172.21.15.7:0/928752931 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcf8c06b4d0 msgr2=0x7fcf8c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:50.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.711+0000 7fcfa7f4c640 1 --2- 172.21.15.7:0/928752931 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcf8c06b4d0 0x7fcf8c06d990 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fcf90000f80 tx=0x7fcf90009040 comp rx=0 tx=0).stop 2024-04-25T09:58:50.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.711+0000 7fcfa7f4c640 1 -- 172.21.15.7:0/928752931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa00b3d20 msgr2=0x7fcfa00b41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:50.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.711+0000 7fcfa7f4c640 1 --2- 172.21.15.7:0/928752931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa00b3d20 0x7fcfa00b41a0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800c210 tx=0x7fcfa0162210 comp rx=0 tx=0).stop 2024-04-25T09:58:50.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.711+0000 7fcfa7f4c640 1 -- 172.21.15.7:0/928752931 shutdown_connections 2024-04-25T09:58:50.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.711+0000 7fcfa7f4c640 1 --2- 172.21.15.7:0/928752931 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcf8c06b4d0 0x7fcf8c06d990 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:50.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.711+0000 7fcfa7f4c640 1 --2- 172.21.15.7:0/928752931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa00b3d20 0x7fcfa00b41a0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:50.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.711+0000 7fcfa7f4c640 1 --2- 172.21.15.7:0/928752931 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcfa014ecc0 0x7fcfa014f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:50.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.711+0000 7fcfa7f4c640 1 --2- 172.21.15.7:0/928752931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf880052e0 0x7fcfa0149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:50.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.711+0000 7fcfa7f4c640 1 -- 172.21.15.7:0/928752931 >> 172.21.15.7:0/928752931 conn(0x7fcfa0072290 msgr2=0x7fcfa00c8600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:50.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.711+0000 7fcfa7f4c640 1 -- 172.21.15.7:0/928752931 shutdown_connections 2024-04-25T09:58:50.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:50.711+0000 7fcfa7f4c640 1 -- 172.21.15.7:0/928752931 wait complete. 2024-04-25T09:58:50.726 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2024-04-25T09:58:49.913145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591110,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":182,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":103,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257644,"kb_used_data":8188,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754717076,"statfs":{"total":773094113280,"available":772830285824,"internally_reserved":0,"allocated":8384512,"data_stored":4427143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":742,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.651583"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.278800+0000","last_change":"2024-04-25T09:58:45.278800+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.278800+0000","last_undegraded":"2024-04-25T09:58:45.278800+0000","last_fullsized":"2024-04-25T09:58:45.278800+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487843+0000","last_change":"2024-04-25T09:58:46.309867+0000","last_active":"2024-04-25T09:58:47.487843+0000","last_peered":"2024-04-25T09:58:47.487843+0000","last_clean":"2024-04-25T09:58:47.487843+0000","last_became_active":"2024-04-25T09:58:46.309570+0000","last_became_peered":"2024-04-25T09:58:46.309570+0000","last_unstale":"2024-04-25T09:58:47.487843+0000","last_undegraded":"2024-04-25T09:58:47.487843+0000","last_fullsized":"2024-04-25T09:58:47.487843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:56.849551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.756528+0000","last_change":"2024-04-25T09:58:46.295586+0000","last_active":"2024-04-25T09:58:47.756528+0000","last_peered":"2024-04-25T09:58:47.756528+0000","last_clean":"2024-04-25T09:58:47.756528+0000","last_became_active":"2024-04-25T09:58:46.294637+0000","last_became_peered":"2024-04-25T09:58:46.294637+0000","last_unstale":"2024-04-25T09:58:47.756528+0000","last_undegraded":"2024-04-25T09:58:47.756528+0000","last_fullsized":"2024-04-25T09:58:47.756528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:18.626049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.279868+0000","last_change":"2024-04-25T09:58:45.279868+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.279868+0000","last_undegraded":"2024-04-25T09:58:45.279868+0000","last_fullsized":"2024-04-25T09:58:45.279868+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257215+0000","last_change":"2024-04-25T09:58:46.303476+0000","last_active":"2024-04-25T09:58:48.257215+0000","last_peered":"2024-04-25T09:58:48.257215+0000","last_clean":"2024-04-25T09:58:48.257215+0000","last_became_active":"2024-04-25T09:58:46.303184+0000","last_became_peered":"2024-04-25T09:58:46.303184+0000","last_unstale":"2024-04-25T09:58:48.257215+0000","last_undegraded":"2024-04-25T09:58:48.257215+0000","last_fullsized":"2024-04-25T09:58:48.257215+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:39.535483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.288750+0000","last_change":"2024-04-25T09:58:46.303826+0000","last_active":"2024-04-25T09:58:47.288750+0000","last_peered":"2024-04-25T09:58:47.288750+0000","last_clean":"2024-04-25T09:58:47.288750+0000","last_became_active":"2024-04-25T09:58:46.303558+0000","last_became_peered":"2024-04-25T09:58:46.303558+0000","last_unstale":"2024-04-25T09:58:47.288750+0000","last_undegraded":"2024-04-25T09:58:47.288750+0000","last_fullsized":"2024-04-25T09:58:47.288750+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:14.220665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.283616+0000","last_change":"2024-04-25T09:58:45.283616+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.283616+0000","last_undegraded":"2024-04-25T09:58:45.283616+0000","last_fullsized":"2024-04-25T09:58:45.283616+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257122+0000","last_change":"2024-04-25T09:58:46.302356+0000","last_active":"2024-04-25T09:58:48.257122+0000","last_peered":"2024-04-25T09:58:48.257122+0000","last_clean":"2024-04-25T09:58:48.257122+0000","last_became_active":"2024-04-25T09:58:46.302045+0000","last_became_peered":"2024-04-25T09:58:46.302045+0000","last_unstale":"2024-04-25T09:58:48.257122+0000","last_undegraded":"2024-04-25T09:58:48.257122+0000","last_fullsized":"2024-04-25T09:58:48.257122+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:05.856751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.276247+0000","last_change":"2024-04-25T09:58:45.276247+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.276247+0000","last_undegraded":"2024-04-25T09:58:45.276247+0000","last_fullsized":"2024-04-25T09:58:45.276247+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.282126+0000","last_change":"2024-04-25T09:58:45.282126+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.282126+0000","last_undegraded":"2024-04-25T09:58:45.282126+0000","last_fullsized":"2024-04-25T09:58:45.282126+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487756+0000","last_change":"2024-04-25T09:58:46.311381+0000","last_active":"2024-04-25T09:58:47.487756+0000","last_peered":"2024-04-25T09:58:47.487756+0000","last_clean":"2024-04-25T09:58:47.487756+0000","last_became_active":"2024-04-25T09:58:46.310880+0000","last_became_peered":"2024-04-25T09:58:46.310880+0000","last_unstale":"2024-04-25T09:58:47.487756+0000","last_undegraded":"2024-04-25T09:58:47.487756+0000","last_fullsized":"2024-04-25T09:58:47.487756+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:44.119671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.279452+0000","last_change":"2024-04-25T09:58:45.279452+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.279452+0000","last_undegraded":"2024-04-25T09:58:45.279452+0000","last_fullsized":"2024-04-25T09:58:45.279452+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257232+0000","last_change":"2024-04-25T09:58:46.309893+0000","last_active":"2024-04-25T09:58:48.257232+0000","last_peered":"2024-04-25T09:58:48.257232+0000","last_clean":"2024-04-25T09:58:48.257232+0000","last_became_active":"2024-04-25T09:58:46.309213+0000","last_became_peered":"2024-04-25T09:58:46.309213+0000","last_unstale":"2024-04-25T09:58:48.257232+0000","last_undegraded":"2024-04-25T09:58:48.257232+0000","last_fullsized":"2024-04-25T09:58:48.257232+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:07.756398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.288771+0000","last_change":"2024-04-25T09:58:46.302828+0000","last_active":"2024-04-25T09:58:47.288771+0000","last_peered":"2024-04-25T09:58:47.288771+0000","last_clean":"2024-04-25T09:58:47.288771+0000","last_became_active":"2024-04-25T09:58:46.302511+0000","last_became_peered":"2024-04-25T09:58:46.302511+0000","last_unstale":"2024-04-25T09:58:47.288771+0000","last_undegraded":"2024-04-25T09:58:47.288771+0000","last_fullsized":"2024-04-25T09:58:47.288771+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:48.540478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487364+0000","last_change":"2024-04-25T09:58:46.292920+0000","last_active":"2024-04-25T09:58:47.487364+0000","last_peered":"2024-04-25T09:58:47.487364+0000","last_clean":"2024-04-25T09:58:47.487364+0000","last_became_active":"2024-04-25T09:58:46.292615+0000","last_became_peered":"2024-04-25T09:58:46.292615+0000","last_unstale":"2024-04-25T09:58:47.487364+0000","last_undegraded":"2024-04-25T09:58:47.487364+0000","last_fullsized":"2024-04-25T09:58:47.487364+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:37.291630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.281660+0000","last_change":"2024-04-25T09:58:45.281660+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.281660+0000","last_undegraded":"2024-04-25T09:58:45.281660+0000","last_fullsized":"2024-04-25T09:58:45.281660+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257538+0000","last_change":"2024-04-25T09:58:46.315825+0000","last_active":"2024-04-25T09:58:48.257538+0000","last_peered":"2024-04-25T09:58:48.257538+0000","last_clean":"2024-04-25T09:58:48.257538+0000","last_became_active":"2024-04-25T09:58:46.315414+0000","last_became_peered":"2024-04-25T09:58:46.315414+0000","last_unstale":"2024-04-25T09:58:48.257538+0000","last_undegraded":"2024-04-25T09:58:48.257538+0000","last_fullsized":"2024-04-25T09:58:48.257538+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:44.667003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.756503+0000","last_change":"2024-04-25T09:58:46.303789+0000","last_active":"2024-04-25T09:58:47.756503+0000","last_peered":"2024-04-25T09:58:47.756503+0000","last_clean":"2024-04-25T09:58:47.756503+0000","last_became_active":"2024-04-25T09:58:46.303513+0000","last_became_peered":"2024-04-25T09:58:46.303513+0000","last_unstale":"2024-04-25T09:58:47.756503+0000","last_undegraded":"2024-04-25T09:58:47.756503+0000","last_fullsized":"2024-04-25T09:58:47.756503+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:06.347228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.289041+0000","last_change":"2024-04-25T09:58:46.309950+0000","last_active":"2024-04-25T09:58:47.289041+0000","last_peered":"2024-04-25T09:58:47.289041+0000","last_clean":"2024-04-25T09:58:47.289041+0000","last_became_active":"2024-04-25T09:58:46.309665+0000","last_became_peered":"2024-04-25T09:58:46.309665+0000","last_unstale":"2024-04-25T09:58:47.289041+0000","last_undegraded":"2024-04-25T09:58:47.289041+0000","last_fullsized":"2024-04-25T09:58:47.289041+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:09.626543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257279+0000","last_change":"2024-04-25T09:58:46.306991+0000","last_active":"2024-04-25T09:58:48.257279+0000","last_peered":"2024-04-25T09:58:48.257279+0000","last_clean":"2024-04-25T09:58:48.257279+0000","last_became_active":"2024-04-25T09:58:46.306718+0000","last_became_peered":"2024-04-25T09:58:46.306718+0000","last_unstale":"2024-04-25T09:58:48.257279+0000","last_undegraded":"2024-04-25T09:58:48.257279+0000","last_fullsized":"2024-04-25T09:58:48.257279+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:57.951523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.276219+0000","last_change":"2024-04-25T09:58:45.276219+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.276219+0000","last_undegraded":"2024-04-25T09:58:45.276219+0000","last_fullsized":"2024-04-25T09:58:45.276219+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257066+0000","last_change":"2024-04-25T09:58:46.304713+0000","last_active":"2024-04-25T09:58:48.257066+0000","last_peered":"2024-04-25T09:58:48.257066+0000","last_clean":"2024-04-25T09:58:48.257066+0000","last_became_active":"2024-04-25T09:58:46.304414+0000","last_became_peered":"2024-04-25T09:58:46.304414+0000","last_unstale":"2024-04-25T09:58:48.257066+0000","last_undegraded":"2024-04-25T09:58:48.257066+0000","last_fullsized":"2024-04-25T09:58:48.257066+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:08.573464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.275561+0000","last_change":"2024-04-25T09:58:45.275561+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.275561+0000","last_undegraded":"2024-04-25T09:58:45.275561+0000","last_fullsized":"2024-04-25T09:58:45.275561+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487344+0000","last_change":"2024-04-25T09:58:46.297754+0000","last_active":"2024-04-25T09:58:47.487344+0000","last_peered":"2024-04-25T09:58:47.487344+0000","last_clean":"2024-04-25T09:58:47.487344+0000","last_became_active":"2024-04-25T09:58:46.297467+0000","last_became_peered":"2024-04-25T09:58:46.297467+0000","last_unstale":"2024-04-25T09:58:47.487344+0000","last_undegraded":"2024-04-25T09:58:47.487344+0000","last_fullsized":"2024-04-25T09:58:47.487344+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:41:12.840555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487777+0000","last_change":"2024-04-25T09:58:46.295732+0000","last_active":"2024-04-25T09:58:47.487777+0000","last_peered":"2024-04-25T09:58:47.487777+0000","last_clean":"2024-04-25T09:58:47.487777+0000","last_became_active":"2024-04-25T09:58:46.295406+0000","last_became_peered":"2024-04-25T09:58:46.295406+0000","last_unstale":"2024-04-25T09:58:47.487777+0000","last_undegraded":"2024-04-25T09:58:47.487777+0000","last_fullsized":"2024-04-25T09:58:47.487777+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:40.379753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.281719+0000","last_change":"2024-04-25T09:58:45.281719+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.281719+0000","last_undegraded":"2024-04-25T09:58:45.281719+0000","last_fullsized":"2024-04-25T09:58:45.281719+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.280101+0000","last_change":"2024-04-25T09:58:45.280101+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.280101+0000","last_undegraded":"2024-04-25T09:58:45.280101+0000","last_fullsized":"2024-04-25T09:58:45.280101+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257313+0000","last_change":"2024-04-25T09:58:46.314339+0000","last_active":"2024-04-25T09:58:48.257313+0000","last_peered":"2024-04-25T09:58:48.257313+0000","last_clean":"2024-04-25T09:58:48.257313+0000","last_became_active":"2024-04-25T09:58:46.314085+0000","last_became_peered":"2024-04-25T09:58:46.314085+0000","last_unstale":"2024-04-25T09:58:48.257313+0000","last_undegraded":"2024-04-25T09:58:48.257313+0000","last_fullsized":"2024-04-25T09:58:48.257313+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:28.589905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487443+0000","last_change":"2024-04-25T09:58:46.301429+0000","last_active":"2024-04-25T09:58:47.487443+0000","last_peered":"2024-04-25T09:58:47.487443+0000","last_clean":"2024-04-25T09:58:47.487443+0000","last_became_active":"2024-04-25T09:58:46.301118+0000","last_became_peered":"2024-04-25T09:58:46.301118+0000","last_unstale":"2024-04-25T09:58:47.487443+0000","last_undegraded":"2024-04-25T09:58:47.487443+0000","last_fullsized":"2024-04-25T09:58:47.487443+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:47.497812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.278275+0000","last_change":"2024-04-25T09:58:45.278275+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.278275+0000","last_undegraded":"2024-04-25T09:58:45.278275+0000","last_fullsized":"2024-04-25T09:58:45.278275+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.756291+0000","last_change":"2024-04-25T09:58:46.301841+0000","last_active":"2024-04-25T09:58:47.756291+0000","last_peered":"2024-04-25T09:58:47.756291+0000","last_clean":"2024-04-25T09:58:47.756291+0000","last_became_active":"2024-04-25T09:58:46.301509+0000","last_became_peered":"2024-04-25T09:58:46.301509+0000","last_unstale":"2024-04-25T09:58:47.756291+0000","last_undegraded":"2024-04-25T09:58:47.756291+0000","last_fullsized":"2024-04-25T09:58:47.756291+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:37.116316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.279531+0000","last_change":"2024-04-25T09:58:45.279531+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.279531+0000","last_undegraded":"2024-04-25T09:58:45.279531+0000","last_fullsized":"2024-04-25T09:58:45.279531+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.756265+0000","last_change":"2024-04-25T09:58:46.301020+0000","last_active":"2024-04-25T09:58:47.756265+0000","last_peered":"2024-04-25T09:58:47.756265+0000","last_clean":"2024-04-25T09:58:47.756265+0000","last_became_active":"2024-04-25T09:58:46.300707+0000","last_became_peered":"2024-04-25T09:58:46.300707+0000","last_unstale":"2024-04-25T09:58:47.756265+0000","last_undegraded":"2024-04-25T09:58:47.756265+0000","last_fullsized":"2024-04-25T09:58:47.756265+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:31.505419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"74'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257537+0000","last_change":"2024-04-25T09:58:45.283736+0000","last_active":"2024-04-25T09:58:48.257537+0000","last_peered":"2024-04-25T09:58:48.257537+0000","last_clean":"2024-04-25T09:58:48.257537+0000","last_became_active":"2024-04-25T09:58:45.283451+0000","last_became_peered":"2024-04-25T09:58:45.283451+0000","last_unstale":"2024-04-25T09:58:48.257537+0000","last_undegraded":"2024-04-25T09:58:48.257537+0000","last_fullsized":"2024-04-25T09:58:48.257537+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:13.117190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487410+0000","last_change":"2024-04-25T09:58:46.319812+0000","last_active":"2024-04-25T09:58:47.487410+0000","last_peered":"2024-04-25T09:58:47.487410+0000","last_clean":"2024-04-25T09:58:47.487410+0000","last_became_active":"2024-04-25T09:58:46.319517+0000","last_became_peered":"2024-04-25T09:58:46.319517+0000","last_unstale":"2024-04-25T09:58:47.487410+0000","last_undegraded":"2024-04-25T09:58:47.487410+0000","last_fullsized":"2024-04-25T09:58:47.487410+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:26.661081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300470+0000","last_change":"2024-04-25T09:58:45.295953+0000","last_active":"2024-04-25T09:58:45.300470+0000","last_peered":"2024-04-25T09:58:45.300470+0000","last_clean":"2024-04-25T09:58:45.300470+0000","last_became_active":"2024-04-25T09:58:45.295589+0000","last_became_peered":"2024-04-25T09:58:45.295589+0000","last_unstale":"2024-04-25T09:58:45.300470+0000","last_undegraded":"2024-04-25T09:58:45.300470+0000","last_fullsized":"2024-04-25T09:58:45.300470+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:49.372377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.275001+0000","last_change":"2024-04-25T09:58:45.275001+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.275001+0000","last_undegraded":"2024-04-25T09:58:45.275001+0000","last_fullsized":"2024-04-25T09:58:45.275001+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.295423+0000","last_change":"2024-04-25T09:58:45.289498+0000","last_active":"2024-04-25T09:58:45.295423+0000","last_peered":"2024-04-25T09:58:45.295423+0000","last_clean":"2024-04-25T09:58:45.295423+0000","last_became_active":"2024-04-25T09:58:45.289150+0000","last_became_peered":"2024-04-25T09:58:45.289150+0000","last_unstale":"2024-04-25T09:58:45.295423+0000","last_undegraded":"2024-04-25T09:58:45.295423+0000","last_fullsized":"2024-04-25T09:58:45.295423+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:17.616346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.275587+0000","last_change":"2024-04-25T09:58:45.275587+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.275587+0000","last_undegraded":"2024-04-25T09:58:45.275587+0000","last_fullsized":"2024-04-25T09:58:45.275587+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300955+0000","last_change":"2024-04-25T09:58:45.291351+0000","last_active":"2024-04-25T09:58:45.300955+0000","last_peered":"2024-04-25T09:58:45.300955+0000","last_clean":"2024-04-25T09:58:45.300955+0000","last_became_active":"2024-04-25T09:58:45.290998+0000","last_became_peered":"2024-04-25T09:58:45.290998+0000","last_unstale":"2024-04-25T09:58:45.300955+0000","last_undegraded":"2024-04-25T09:58:45.300955+0000","last_fullsized":"2024-04-25T09:58:45.300955+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:50.139600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487647+0000","last_change":"2024-04-25T09:58:46.309881+0000","last_active":"2024-04-25T09:58:47.487647+0000","last_peered":"2024-04-25T09:58:47.487647+0000","last_clean":"2024-04-25T09:58:47.487647+0000","last_became_active":"2024-04-25T09:58:46.309523+0000","last_became_peered":"2024-04-25T09:58:46.309523+0000","last_unstale":"2024-04-25T09:58:47.487647+0000","last_undegraded":"2024-04-25T09:58:47.487647+0000","last_fullsized":"2024-04-25T09:58:47.487647+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:29.965375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.295535+0000","last_change":"2024-04-25T09:58:45.288538+0000","last_active":"2024-04-25T09:58:45.295535+0000","last_peered":"2024-04-25T09:58:45.295535+0000","last_clean":"2024-04-25T09:58:45.295535+0000","last_became_active":"2024-04-25T09:58:45.288234+0000","last_became_peered":"2024-04-25T09:58:45.288234+0000","last_unstale":"2024-04-25T09:58:45.295535+0000","last_undegraded":"2024-04-25T09:58:45.295535+0000","last_fullsized":"2024-04-25T09:58:45.295535+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:47.899238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487772+0000","last_change":"2024-04-25T09:58:46.311147+0000","last_active":"2024-04-25T09:58:47.487772+0000","last_peered":"2024-04-25T09:58:47.487772+0000","last_clean":"2024-04-25T09:58:47.487772+0000","last_became_active":"2024-04-25T09:58:46.310517+0000","last_became_peered":"2024-04-25T09:58:46.310517+0000","last_unstale":"2024-04-25T09:58:47.487772+0000","last_undegraded":"2024-04-25T09:58:47.487772+0000","last_fullsized":"2024-04-25T09:58:47.487772+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:29:55.475855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300052+0000","last_change":"2024-04-25T09:58:45.289545+0000","last_active":"2024-04-25T09:58:45.300052+0000","last_peered":"2024-04-25T09:58:45.300052+0000","last_clean":"2024-04-25T09:58:45.300052+0000","last_became_active":"2024-04-25T09:58:45.289245+0000","last_became_peered":"2024-04-25T09:58:45.289245+0000","last_unstale":"2024-04-25T09:58:45.300052+0000","last_undegraded":"2024-04-25T09:58:45.300052+0000","last_fullsized":"2024-04-25T09:58:45.300052+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:05.337524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.275591+0000","last_change":"2024-04-25T09:58:45.275591+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.275591+0000","last_undegraded":"2024-04-25T09:58:45.275591+0000","last_fullsized":"2024-04-25T09:58:45.275591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487422+0000","last_change":"2024-04-25T09:58:45.285684+0000","last_active":"2024-04-25T09:58:47.487422+0000","last_peered":"2024-04-25T09:58:47.487422+0000","last_clean":"2024-04-25T09:58:47.487422+0000","last_became_active":"2024-04-25T09:58:45.285412+0000","last_became_peered":"2024-04-25T09:58:45.285412+0000","last_unstale":"2024-04-25T09:58:47.487422+0000","last_undegraded":"2024-04-25T09:58:47.487422+0000","last_fullsized":"2024-04-25T09:58:47.487422+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:11.765762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.282321+0000","last_change":"2024-04-25T09:58:45.282321+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.282321+0000","last_undegraded":"2024-04-25T09:58:45.282321+0000","last_fullsized":"2024-04-25T09:58:45.282321+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.256965+0000","last_change":"2024-04-25T09:58:45.281544+0000","last_active":"2024-04-25T09:58:48.256965+0000","last_peered":"2024-04-25T09:58:48.256965+0000","last_clean":"2024-04-25T09:58:48.256965+0000","last_became_active":"2024-04-25T09:58:45.281187+0000","last_became_peered":"2024-04-25T09:58:45.281187+0000","last_unstale":"2024-04-25T09:58:48.256965+0000","last_undegraded":"2024-04-25T09:58:48.256965+0000","last_fullsized":"2024-04-25T09:58:48.256965+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:43.942052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487415+0000","last_change":"2024-04-25T09:58:46.308264+0000","last_active":"2024-04-25T09:58:47.487415+0000","last_peered":"2024-04-25T09:58:47.487415+0000","last_clean":"2024-04-25T09:58:47.487415+0000","last_became_active":"2024-04-25T09:58:46.307975+0000","last_became_peered":"2024-04-25T09:58:46.307975+0000","last_unstale":"2024-04-25T09:58:47.487415+0000","last_undegraded":"2024-04-25T09:58:47.487415+0000","last_fullsized":"2024-04-25T09:58:47.487415+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:03:27.048245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300162+0000","last_change":"2024-04-25T09:58:45.290559+0000","last_active":"2024-04-25T09:58:45.300162+0000","last_peered":"2024-04-25T09:58:45.300162+0000","last_clean":"2024-04-25T09:58:45.300162+0000","last_became_active":"2024-04-25T09:58:45.290260+0000","last_became_peered":"2024-04-25T09:58:45.290260+0000","last_unstale":"2024-04-25T09:58:45.300162+0000","last_undegraded":"2024-04-25T09:58:45.300162+0000","last_fullsized":"2024-04-25T09:58:45.300162+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:04.412202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.278455+0000","last_change":"2024-04-25T09:58:45.278455+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.278455+0000","last_undegraded":"2024-04-25T09:58:45.278455+0000","last_fullsized":"2024-04-25T09:58:45.278455+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300874+0000","last_change":"2024-04-25T09:58:45.296555+0000","last_active":"2024-04-25T09:58:45.300874+0000","last_peered":"2024-04-25T09:58:45.300874+0000","last_clean":"2024-04-25T09:58:45.300874+0000","last_became_active":"2024-04-25T09:58:45.296256+0000","last_became_peered":"2024-04-25T09:58:45.296256+0000","last_unstale":"2024-04-25T09:58:45.300874+0000","last_undegraded":"2024-04-25T09:58:45.300874+0000","last_fullsized":"2024-04-25T09:58:45.300874+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:47.465452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.288927+0000","last_change":"2024-04-25T09:58:46.298913+0000","last_active":"2024-04-25T09:58:47.288927+0000","last_peered":"2024-04-25T09:58:47.288927+0000","last_clean":"2024-04-25T09:58:47.288927+0000","last_became_active":"2024-04-25T09:58:46.298592+0000","last_became_peered":"2024-04-25T09:58:46.298592+0000","last_unstale":"2024-04-25T09:58:47.288927+0000","last_undegraded":"2024-04-25T09:58:47.288927+0000","last_fullsized":"2024-04-25T09:58:47.288927+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:12.587780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"74'3","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257332+0000","last_change":"2024-04-25T09:58:45.282436+0000","last_active":"2024-04-25T09:58:48.257332+0000","last_peered":"2024-04-25T09:58:48.257332+0000","last_clean":"2024-04-25T09:58:48.257332+0000","last_became_active":"2024-04-25T09:58:45.282098+0000","last_became_peered":"2024-04-25T09:58:45.282098+0000","last_unstale":"2024-04-25T09:58:48.257332+0000","last_undegraded":"2024-04-25T09:58:48.257332+0000","last_fullsized":"2024-04-25T09:58:48.257332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:17.580693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.756372+0000","last_change":"2024-04-25T09:58:46.295920+0000","last_active":"2024-04-25T09:58:47.756372+0000","last_peered":"2024-04-25T09:58:47.756372+0000","last_clean":"2024-04-25T09:58:47.756372+0000","last_became_active":"2024-04-25T09:58:46.294687+0000","last_became_peered":"2024-04-25T09:58:46.294687+0000","last_unstale":"2024-04-25T09:58:47.756372+0000","last_undegraded":"2024-04-25T09:58:47.756372+0000","last_fullsized":"2024-04-25T09:58:47.756372+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:43.628278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300599+0000","last_change":"2024-04-25T09:58:45.288248+0000","last_active":"2024-04-25T09:58:45.300599+0000","last_peered":"2024-04-25T09:58:45.300599+0000","last_clean":"2024-04-25T09:58:45.300599+0000","last_became_active":"2024-04-25T09:58:45.287736+0000","last_became_peered":"2024-04-25T09:58:45.287736+0000","last_unstale":"2024-04-25T09:58:45.300599+0000","last_undegraded":"2024-04-25T09:58:45.300599+0000","last_fullsized":"2024-04-25T09:58:45.300599+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:39.842372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.279062+0000","last_change":"2024-04-25T09:58:45.279062+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.279062+0000","last_undegraded":"2024-04-25T09:58:45.279062+0000","last_fullsized":"2024-04-25T09:58:45.279062+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300866+0000","last_change":"2024-04-25T09:58:45.296232+0000","last_active":"2024-04-25T09:58:45.300866+0000","last_peered":"2024-04-25T09:58:45.300866+0000","last_clean":"2024-04-25T09:58:45.300866+0000","last_became_active":"2024-04-25T09:58:45.295916+0000","last_became_peered":"2024-04-25T09:58:45.295916+0000","last_unstale":"2024-04-25T09:58:45.300866+0000","last_undegraded":"2024-04-25T09:58:45.300866+0000","last_fullsized":"2024-04-25T09:58:45.300866+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:04.412202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.281278+0000","last_change":"2024-04-25T09:58:45.281278+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.281278+0000","last_undegraded":"2024-04-25T09:58:45.281278+0000","last_fullsized":"2024-04-25T09:58:45.281278+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.295341+0000","last_change":"2024-04-25T09:58:45.287147+0000","last_active":"2024-04-25T09:58:45.295341+0000","last_peered":"2024-04-25T09:58:45.295341+0000","last_clean":"2024-04-25T09:58:45.295341+0000","last_became_active":"2024-04-25T09:58:45.286871+0000","last_became_peered":"2024-04-25T09:58:45.286871+0000","last_unstale":"2024-04-25T09:58:45.295341+0000","last_undegraded":"2024-04-25T09:58:45.295341+0000","last_fullsized":"2024-04-25T09:58:45.295341+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:42.618575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.279089+0000","last_change":"2024-04-25T09:58:45.279089+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.279089+0000","last_undegraded":"2024-04-25T09:58:45.279089+0000","last_fullsized":"2024-04-25T09:58:45.279089+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.256966+0000","last_change":"2024-04-25T09:58:45.282926+0000","last_active":"2024-04-25T09:58:48.256966+0000","last_peered":"2024-04-25T09:58:48.256966+0000","last_clean":"2024-04-25T09:58:48.256966+0000","last_became_active":"2024-04-25T09:58:45.282629+0000","last_became_peered":"2024-04-25T09:58:45.282629+0000","last_unstale":"2024-04-25T09:58:48.256966+0000","last_undegraded":"2024-04-25T09:58:48.256966+0000","last_fullsized":"2024-04-25T09:58:48.256966+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:51.537578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.281886+0000","last_change":"2024-04-25T09:58:45.281886+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.281886+0000","last_undegraded":"2024-04-25T09:58:45.281886+0000","last_fullsized":"2024-04-25T09:58:45.281886+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"74'8","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487408+0000","last_change":"2024-04-25T09:58:45.288815+0000","last_active":"2024-04-25T09:58:47.487408+0000","last_peered":"2024-04-25T09:58:47.487408+0000","last_clean":"2024-04-25T09:58:47.487408+0000","last_became_active":"2024-04-25T09:58:45.288472+0000","last_became_peered":"2024-04-25T09:58:45.288472+0000","last_unstale":"2024-04-25T09:58:47.487408+0000","last_undegraded":"2024-04-25T09:58:47.487408+0000","last_fullsized":"2024-04-25T09:58:47.487408+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:02.869500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.288507+0000","last_change":"2024-04-25T09:58:46.301930+0000","last_active":"2024-04-25T09:58:47.288507+0000","last_peered":"2024-04-25T09:58:47.288507+0000","last_clean":"2024-04-25T09:58:47.288507+0000","last_became_active":"2024-04-25T09:58:46.301671+0000","last_became_peered":"2024-04-25T09:58:46.301671+0000","last_unstale":"2024-04-25T09:58:47.288507+0000","last_undegraded":"2024-04-25T09:58:47.288507+0000","last_fullsized":"2024-04-25T09:58:47.288507+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:08:06.950633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.295316+0000","last_change":"2024-04-25T09:58:45.288097+0000","last_active":"2024-04-25T09:58:45.295316+0000","last_peered":"2024-04-25T09:58:45.295316+0000","last_clean":"2024-04-25T09:58:45.295316+0000","last_became_active":"2024-04-25T09:58:45.287801+0000","last_became_peered":"2024-04-25T09:58:45.287801+0000","last_unstale":"2024-04-25T09:58:45.295316+0000","last_undegraded":"2024-04-25T09:58:45.295316+0000","last_fullsized":"2024-04-25T09:58:45.295316+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:05.337524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.256975+0000","last_change":"2024-04-25T09:58:46.308348+0000","last_active":"2024-04-25T09:58:48.256975+0000","last_peered":"2024-04-25T09:58:48.256975+0000","last_clean":"2024-04-25T09:58:48.256975+0000","last_became_active":"2024-04-25T09:58:46.308044+0000","last_became_peered":"2024-04-25T09:58:46.308044+0000","last_unstale":"2024-04-25T09:58:48.256975+0000","last_undegraded":"2024-04-25T09:58:48.256975+0000","last_fullsized":"2024-04-25T09:58:48.256975+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:10:18.258705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.283476+0000","last_change":"2024-04-25T09:58:45.282174+0000","last_active":"2024-04-25T09:58:45.283476+0000","last_peered":"2024-04-25T09:58:45.283476+0000","last_clean":"2024-04-25T09:58:45.283476+0000","last_became_active":"2024-04-25T09:58:45.281632+0000","last_became_peered":"2024-04-25T09:58:45.281632+0000","last_unstale":"2024-04-25T09:58:45.283476+0000","last_undegraded":"2024-04-25T09:58:45.283476+0000","last_fullsized":"2024-04-25T09:58:45.283476+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:32.960859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257202+0000","last_change":"2024-04-25T09:58:46.309129+0000","last_active":"2024-04-25T09:58:48.257202+0000","last_peered":"2024-04-25T09:58:48.257202+0000","last_clean":"2024-04-25T09:58:48.257202+0000","last_became_active":"2024-04-25T09:58:46.308393+0000","last_became_peered":"2024-04-25T09:58:46.308393+0000","last_unstale":"2024-04-25T09:58:48.257202+0000","last_undegraded":"2024-04-25T09:58:48.257202+0000","last_fullsized":"2024-04-25T09:58:48.257202+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:13.708287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257445+0000","last_change":"2024-04-25T09:58:45.281780+0000","last_active":"2024-04-25T09:58:48.257445+0000","last_peered":"2024-04-25T09:58:48.257445+0000","last_clean":"2024-04-25T09:58:48.257445+0000","last_became_active":"2024-04-25T09:58:45.281456+0000","last_became_peered":"2024-04-25T09:58:45.281456+0000","last_unstale":"2024-04-25T09:58:48.257445+0000","last_undegraded":"2024-04-25T09:58:48.257445+0000","last_fullsized":"2024-04-25T09:58:48.257445+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:06.608344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.288919+0000","last_change":"2024-04-25T09:58:46.301496+0000","last_active":"2024-04-25T09:58:47.288919+0000","last_peered":"2024-04-25T09:58:47.288919+0000","last_clean":"2024-04-25T09:58:47.288919+0000","last_became_active":"2024-04-25T09:58:46.300180+0000","last_became_peered":"2024-04-25T09:58:46.300180+0000","last_unstale":"2024-04-25T09:58:47.288919+0000","last_undegraded":"2024-04-25T09:58:47.288919+0000","last_fullsized":"2024-04-25T09:58:47.288919+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:58.805827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.756309+0000","last_change":"2024-04-25T09:58:45.278954+0000","last_active":"2024-04-25T09:58:47.756309+0000","last_peered":"2024-04-25T09:58:47.756309+0000","last_clean":"2024-04-25T09:58:47.756309+0000","last_became_active":"2024-04-25T09:58:45.278670+0000","last_became_peered":"2024-04-25T09:58:45.278670+0000","last_unstale":"2024-04-25T09:58:47.756309+0000","last_undegraded":"2024-04-25T09:58:47.756309+0000","last_fullsized":"2024-04-25T09:58:47.756309+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:08.289516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487720+0000","last_change":"2024-04-25T09:58:46.314327+0000","last_active":"2024-04-25T09:58:47.487720+0000","last_peered":"2024-04-25T09:58:47.487720+0000","last_clean":"2024-04-25T09:58:47.487720+0000","last_became_active":"2024-04-25T09:58:46.314045+0000","last_became_peered":"2024-04-25T09:58:46.314045+0000","last_unstale":"2024-04-25T09:58:47.487720+0000","last_undegraded":"2024-04-25T09:58:47.487720+0000","last_fullsized":"2024-04-25T09:58:47.487720+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:01.351792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.288758+0000","last_change":"2024-04-25T09:58:45.274234+0000","last_active":"2024-04-25T09:58:47.288758+0000","last_peered":"2024-04-25T09:58:47.288758+0000","last_clean":"2024-04-25T09:58:47.288758+0000","last_became_active":"2024-04-25T09:58:45.273957+0000","last_became_peered":"2024-04-25T09:58:45.273957+0000","last_unstale":"2024-04-25T09:58:47.288758+0000","last_undegraded":"2024-04-25T09:58:47.288758+0000","last_fullsized":"2024-04-25T09:58:47.288758+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:02.869500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487881+0000","last_change":"2024-04-25T09:58:46.300913+0000","last_active":"2024-04-25T09:58:47.487881+0000","last_peered":"2024-04-25T09:58:47.487881+0000","last_clean":"2024-04-25T09:58:47.487881+0000","last_became_active":"2024-04-25T09:58:46.300612+0000","last_became_peered":"2024-04-25T09:58:46.300612+0000","last_unstale":"2024-04-25T09:58:47.487881+0000","last_undegraded":"2024-04-25T09:58:47.487881+0000","last_fullsized":"2024-04-25T09:58:47.487881+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:16.577248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.288520+0000","last_change":"2024-04-25T09:58:45.287605+0000","last_active":"2024-04-25T09:58:47.288520+0000","last_peered":"2024-04-25T09:58:47.288520+0000","last_clean":"2024-04-25T09:58:47.288520+0000","last_became_active":"2024-04-25T09:58:45.287270+0000","last_became_peered":"2024-04-25T09:58:45.287270+0000","last_unstale":"2024-04-25T09:58:47.288520+0000","last_undegraded":"2024-04-25T09:58:47.288520+0000","last_fullsized":"2024-04-25T09:58:47.288520+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:56:29.390909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.279931+0000","last_change":"2024-04-25T09:58:45.279931+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.279931+0000","last_undegraded":"2024-04-25T09:58:45.279931+0000","last_fullsized":"2024-04-25T09:58:45.279931+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.288533+0000","last_change":"2024-04-25T09:58:45.287684+0000","last_active":"2024-04-25T09:58:47.288533+0000","last_peered":"2024-04-25T09:58:47.288533+0000","last_clean":"2024-04-25T09:58:47.288533+0000","last_became_active":"2024-04-25T09:58:45.287393+0000","last_became_peered":"2024-04-25T09:58:45.287393+0000","last_unstale":"2024-04-25T09:58:47.288533+0000","last_undegraded":"2024-04-25T09:58:47.288533+0000","last_fullsized":"2024-04-25T09:58:47.288533+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:11.765762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.274336+0000","last_change":"2024-04-25T09:58:45.274336+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.274336+0000","last_undegraded":"2024-04-25T09:58:45.274336+0000","last_fullsized":"2024-04-25T09:58:45.274336+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300179+0000","last_change":"2024-04-25T09:58:45.289571+0000","last_active":"2024-04-25T09:58:45.300179+0000","last_peered":"2024-04-25T09:58:45.300179+0000","last_clean":"2024-04-25T09:58:45.300179+0000","last_became_active":"2024-04-25T09:58:45.289229+0000","last_became_peered":"2024-04-25T09:58:45.289229+0000","last_unstale":"2024-04-25T09:58:45.300179+0000","last_undegraded":"2024-04-25T09:58:45.300179+0000","last_fullsized":"2024-04-25T09:58:45.300179+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:17.616346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.280116+0000","last_change":"2024-04-25T09:58:45.280116+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.280116+0000","last_undegraded":"2024-04-25T09:58:45.280116+0000","last_fullsized":"2024-04-25T09:58:45.280116+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487895+0000","last_change":"2024-04-25T09:58:45.276375+0000","last_active":"2024-04-25T09:58:47.487895+0000","last_peered":"2024-04-25T09:58:47.487895+0000","last_clean":"2024-04-25T09:58:47.487895+0000","last_became_active":"2024-04-25T09:58:45.276101+0000","last_became_peered":"2024-04-25T09:58:45.276101+0000","last_unstale":"2024-04-25T09:58:47.487895+0000","last_undegraded":"2024-04-25T09:58:47.487895+0000","last_fullsized":"2024-04-25T09:58:47.487895+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:56:29.390909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.274498+0000","last_change":"2024-04-25T09:58:45.274498+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.274498+0000","last_undegraded":"2024-04-25T09:58:45.274498+0000","last_fullsized":"2024-04-25T09:58:45.274498+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.305714+0000","last_change":"2024-04-25T09:58:45.300947+0000","last_active":"2024-04-25T09:58:45.305714+0000","last_peered":"2024-04-25T09:58:45.305714+0000","last_clean":"2024-04-25T09:58:45.305714+0000","last_became_active":"2024-04-25T09:58:45.300453+0000","last_became_peered":"2024-04-25T09:58:45.300453+0000","last_unstale":"2024-04-25T09:58:45.305714+0000","last_undegraded":"2024-04-25T09:58:45.305714+0000","last_fullsized":"2024-04-25T09:58:45.305714+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:38.163978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487643+0000","last_change":"2024-04-25T09:58:46.307307+0000","last_active":"2024-04-25T09:58:47.487643+0000","last_peered":"2024-04-25T09:58:47.487643+0000","last_clean":"2024-04-25T09:58:47.487643+0000","last_became_active":"2024-04-25T09:58:46.307010+0000","last_became_peered":"2024-04-25T09:58:46.307010+0000","last_unstale":"2024-04-25T09:58:47.487643+0000","last_undegraded":"2024-04-25T09:58:47.487643+0000","last_fullsized":"2024-04-25T09:58:47.487643+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:16.682302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300237+0000","last_change":"2024-04-25T09:58:45.291060+0000","last_active":"2024-04-25T09:58:45.300237+0000","last_peered":"2024-04-25T09:58:45.300237+0000","last_clean":"2024-04-25T09:58:45.300237+0000","last_became_active":"2024-04-25T09:58:45.290776+0000","last_became_peered":"2024-04-25T09:58:45.290776+0000","last_unstale":"2024-04-25T09:58:45.300237+0000","last_undegraded":"2024-04-25T09:58:45.300237+0000","last_fullsized":"2024-04-25T09:58:45.300237+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:47.465452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.282910+0000","last_change":"2024-04-25T09:58:45.282910+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.282910+0000","last_undegraded":"2024-04-25T09:58:45.282910+0000","last_fullsized":"2024-04-25T09:58:45.282910+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.300912+0000","last_change":"2024-04-25T09:58:45.291324+0000","last_active":"2024-04-25T09:58:45.300912+0000","last_peered":"2024-04-25T09:58:45.300912+0000","last_clean":"2024-04-25T09:58:45.300912+0000","last_became_active":"2024-04-25T09:58:45.291012+0000","last_became_peered":"2024-04-25T09:58:45.291012+0000","last_unstale":"2024-04-25T09:58:45.300912+0000","last_undegraded":"2024-04-25T09:58:45.300912+0000","last_fullsized":"2024-04-25T09:58:45.300912+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:32.737781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.279610+0000","last_change":"2024-04-25T09:58:45.279610+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.279610+0000","last_undegraded":"2024-04-25T09:58:45.279610+0000","last_fullsized":"2024-04-25T09:58:45.279610+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257137+0000","last_change":"2024-04-25T09:58:45.281366+0000","last_active":"2024-04-25T09:58:48.257137+0000","last_peered":"2024-04-25T09:58:48.257137+0000","last_clean":"2024-04-25T09:58:48.257137+0000","last_became_active":"2024-04-25T09:58:45.281068+0000","last_became_peered":"2024-04-25T09:58:45.281068+0000","last_unstale":"2024-04-25T09:58:48.257137+0000","last_undegraded":"2024-04-25T09:58:48.257137+0000","last_fullsized":"2024-04-25T09:58:48.257137+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:08:34.497717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.756591+0000","last_change":"2024-04-25T09:58:46.295242+0000","last_active":"2024-04-25T09:58:47.756591+0000","last_peered":"2024-04-25T09:58:47.756591+0000","last_clean":"2024-04-25T09:58:47.756591+0000","last_became_active":"2024-04-25T09:58:46.294939+0000","last_became_peered":"2024-04-25T09:58:46.294939+0000","last_unstale":"2024-04-25T09:58:47.756591+0000","last_undegraded":"2024-04-25T09:58:47.756591+0000","last_fullsized":"2024-04-25T09:58:47.756591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:05.421905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.295217+0000","last_change":"2024-04-25T09:58:45.286219+0000","last_active":"2024-04-25T09:58:45.295217+0000","last_peered":"2024-04-25T09:58:45.295217+0000","last_clean":"2024-04-25T09:58:45.295217+0000","last_became_active":"2024-04-25T09:58:45.285943+0000","last_became_peered":"2024-04-25T09:58:45.285943+0000","last_unstale":"2024-04-25T09:58:45.295217+0000","last_undegraded":"2024-04-25T09:58:45.295217+0000","last_fullsized":"2024-04-25T09:58:45.295217+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:29.543991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.756596+0000","last_change":"2024-04-25T09:58:46.314207+0000","last_active":"2024-04-25T09:58:47.756596+0000","last_peered":"2024-04-25T09:58:47.756596+0000","last_clean":"2024-04-25T09:58:47.756596+0000","last_became_active":"2024-04-25T09:58:46.313924+0000","last_became_peered":"2024-04-25T09:58:46.313924+0000","last_unstale":"2024-04-25T09:58:47.756596+0000","last_undegraded":"2024-04-25T09:58:47.756596+0000","last_fullsized":"2024-04-25T09:58:47.756596+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:48.475155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.756143+0000","last_change":"2024-04-25T09:58:45.277849+0000","last_active":"2024-04-25T09:58:47.756143+0000","last_peered":"2024-04-25T09:58:47.756143+0000","last_clean":"2024-04-25T09:58:47.756143+0000","last_became_active":"2024-04-25T09:58:45.277563+0000","last_became_peered":"2024-04-25T09:58:45.277563+0000","last_unstale":"2024-04-25T09:58:47.756143+0000","last_undegraded":"2024-04-25T09:58:47.756143+0000","last_fullsized":"2024-04-25T09:58:47.756143+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:27.012121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-04-25T09:58:45.278615+0000","last_change":"2024-04-25T09:58:45.278615+0000","last_active":"2024-04-25T09:58:45.261143+0000","last_peered":"2024-04-25T09:58:45.261143+0000","last_clean":"2024-04-25T09:58:45.261143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:58:45.278615+0000","last_undegraded":"2024-04-25T09:58:45.278615+0000","last_fullsized":"2024-04-25T09:58:45.278615+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.288977+0000","last_change":"2024-04-25T09:58:45.288630+0000","last_active":"2024-04-25T09:58:47.288977+0000","last_peered":"2024-04-25T09:58:47.288977+0000","last_clean":"2024-04-25T09:58:47.288977+0000","last_became_active":"2024-04-25T09:58:45.288346+0000","last_became_peered":"2024-04-25T09:58:45.288346+0000","last_unstale":"2024-04-25T09:58:47.288977+0000","last_undegraded":"2024-04-25T09:58:47.288977+0000","last_fullsized":"2024-04-25T09:58:47.288977+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:54.526464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":266,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:58:45.283215+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T09:58:45.283215+0000","last_peered":"2024-04-25T09:58:45.283215+0000","last_clean":"2024-04-25T09:58:45.283215+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T09:58:45.283215+0000","last_undegraded":"2024-04-25T09:58:45.283215+0000","last_fullsized":"2024-04-25T09:58:45.283215+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":742,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542201,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1470464,"data_stored":984893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542201,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":876544,"data_stored":394525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542203,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":876544,"data_stored":394525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542200,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":888832,"data_stored":401192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574906,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":917504,"data_stored":415633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574906,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":925696,"data_stored":415793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":921600,"data_stored":415163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32652,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339188,"statfs":{"total":96636764160,"available":96603328512,"internally_reserved":0,"allocated":1507328,"data_stored":1005419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:58:53.732 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:58:53.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.842+0000 7fa85c729640 1 Processor -- start 2024-04-25T09:58:53.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.842+0000 7fa85c729640 1 -- start start 2024-04-25T09:58:53.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.843+0000 7fa85c729640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa8540b3d30 0x7fa8540b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:53.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.843+0000 7fa85c729640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8540b4960 0x7fa85406d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:53.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.843+0000 7fa85c729640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8540b2c90 con 0x7fa8541474f0 2024-04-25T09:58:53.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.843+0000 7fa85c729640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8540b2a40 con 0x7fa8540b3d30 2024-04-25T09:58:53.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.843+0000 7fa85c729640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8540b38a0 con 0x7fa8540b4960 2024-04-25T09:58:53.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.843+0000 7fa85acc6640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8540b4960 0x7fa85406d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:53.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.843+0000 7fa859cc4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa8540b3d30 0x7fa8540b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:53.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.843+0000 7fa85a4c5640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa8541474f0 0x7fa8540ae820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:37710/0 (socket says 172.21.15.7:37710) 2024-04-25T09:58:53.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.843+0000 7fa859cc4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa8540b3d30 0x7fa8540b4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:42156/0 (socket says 172.21.15.7:42156) 2024-04-25T09:58:53.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.843+0000 7fa85a4c5640 1 -- 172.21.15.7:0/3846851563 learned_addr learned my addr 172.21.15.7:0/3846851563 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:53.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.843+0000 7fa85acc6640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8540b4960 0x7fa85406d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:54838/0 (socket says 172.21.15.7:54838) 2024-04-25T09:58:53.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.843+0000 7fa85acc6640 1 -- 172.21.15.7:0/3846851563 >> v2:172.21.15.55:3300/0 conn(0x7fa8540b3d30 msgr2=0x7fa8540b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:53.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.843+0000 7fa85acc6640 1 --2- 172.21.15.7:0/3846851563 >> v2:172.21.15.55:3300/0 conn(0x7fa8540b3d30 0x7fa8540b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:53.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.843+0000 7fa85acc6640 1 -- 172.21.15.7:0/3846851563 >> v1:172.21.15.55:6789/0 conn(0x7fa8541474f0 legacy=0x7fa8540ae820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:53.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.843+0000 7fa85acc6640 1 -- 172.21.15.7:0/3846851563 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8540b2f70 con 0x7fa8540b4960 2024-04-25T09:58:53.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.843+0000 7fa859cc4640 1 --2- 172.21.15.7:0/3846851563 >> v2:172.21.15.55:3300/0 conn(0x7fa8540b3d30 0x7fa8540b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:58:53.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.844+0000 7fa85acc6640 1 --2- 172.21.15.7:0/3846851563 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8540b4960 0x7fa85406d620 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa84c009d90 tx=0x7fa84c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cec84b264481f9b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:53.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.844+0000 7fa8594c3640 1 -- 172.21.15.7:0/3846851563 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84c007740 con 0x7fa8540b4960 2024-04-25T09:58:53.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.844+0000 7fa8594c3640 1 -- 172.21.15.7:0/3846851563 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84c0078e0 con 0x7fa8540b4960 2024-04-25T09:58:53.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.844+0000 7fa8594c3640 1 -- 172.21.15.7:0/3846851563 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84c007cb0 con 0x7fa8540b4960 2024-04-25T09:58:53.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.845+0000 7fa85c729640 1 -- 172.21.15.7:0/3846851563 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8540b4960 msgr2=0x7fa85406d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:53.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.845+0000 7fa85c729640 1 --2- 172.21.15.7:0/3846851563 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8540b4960 0x7fa85406d620 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa84c009d90 tx=0x7fa84c02a660 comp rx=0 tx=0).stop 2024-04-25T09:58:53.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.845+0000 7fa85c729640 1 -- 172.21.15.7:0/3846851563 shutdown_connections 2024-04-25T09:58:53.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.845+0000 7fa85c729640 1 --2- 172.21.15.7:0/3846851563 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8540b4960 0x7fa85406d620 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:53.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.845+0000 7fa85c729640 1 --2- 172.21.15.7:0/3846851563 >> v2:172.21.15.55:3300/0 conn(0x7fa8540b3d30 0x7fa8540b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:53.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.845+0000 7fa85c729640 1 -- 172.21.15.7:0/3846851563 >> 172.21.15.7:0/3846851563 conn(0x7fa8540b1740 msgr2=0x7fa8540b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:53.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.845+0000 7fa85c729640 1 -- 172.21.15.7:0/3846851563 shutdown_connections 2024-04-25T09:58:53.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.845+0000 7fa85c729640 1 -- 172.21.15.7:0/3846851563 wait complete. 2024-04-25T09:58:53.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.846+0000 7fa85c729640 1 Processor -- start 2024-04-25T09:58:53.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.846+0000 7fa85c729640 1 -- start start 2024-04-25T09:58:53.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.847+0000 7fa85c729640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8540b3d30 0x7fa854140220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:53.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.847+0000 7fa85c729640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8540b4960 0x7fa854151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:53.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.847+0000 7fa85c729640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8541474f0 0x7fa8541f71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:53.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.847+0000 7fa85c729640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8540b3530 con 0x7fa8540b4960 2024-04-25T09:58:53.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.847+0000 7fa85c729640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8540b4db0 con 0x7fa8541474f0 2024-04-25T09:58:53.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.847+0000 7fa85c729640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8540aef30 con 0x7fa8540b3d30 2024-04-25T09:58:53.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.847+0000 7fa859cc4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8540b4960 0x7fa854151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:53.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.847+0000 7fa859cc4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8540b4960 0x7fa854151d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34660/0 (socket says 172.21.15.7:34660) 2024-04-25T09:58:53.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.847+0000 7fa859cc4640 1 -- 172.21.15.7:0/923244980 learned_addr learned my addr 172.21.15.7:0/923244980 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:53.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.847+0000 7fa85acc6640 1 --2- 172.21.15.7:0/923244980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8541474f0 0x7fa8541f71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:53.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.847+0000 7fa85a4c5640 1 --2- 172.21.15.7:0/923244980 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8540b3d30 0x7fa854140220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:53.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.847+0000 7fa859cc4640 1 -- 172.21.15.7:0/923244980 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8540b3d30 msgr2=0x7fa854140220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:53.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.847+0000 7fa859cc4640 1 --2- 172.21.15.7:0/923244980 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8540b3d30 0x7fa854140220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:53.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.847+0000 7fa859cc4640 1 -- 172.21.15.7:0/923244980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8541474f0 msgr2=0x7fa8541f71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:53.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.847+0000 7fa859cc4640 1 --2- 172.21.15.7:0/923244980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8541474f0 0x7fa8541f71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:53.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.847+0000 7fa859cc4640 1 -- 172.21.15.7:0/923244980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa854140760 con 0x7fa8540b4960 2024-04-25T09:58:53.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.848+0000 7fa859cc4640 1 --2- 172.21.15.7:0/923244980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8540b4960 0x7fa854151d30 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fa84400ec10 tx=0x7fa84400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:53.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.848+0000 7fa84affd640 1 -- 172.21.15.7:0/923244980 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa844017070 con 0x7fa8540b4960 2024-04-25T09:58:53.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.848+0000 7fa84affd640 1 -- 172.21.15.7:0/923244980 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84400cc30 con 0x7fa8540b4960 2024-04-25T09:58:53.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.848+0000 7fa85c729640 1 -- 172.21.15.7:0/923244980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa85413ad50 con 0x7fa8540b4960 2024-04-25T09:58:53.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.848+0000 7fa84affd640 1 -- 172.21.15.7:0/923244980 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa844013470 con 0x7fa8540b4960 2024-04-25T09:58:53.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.848+0000 7fa85c729640 1 -- 172.21.15.7:0/923244980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa85413b310 con 0x7fa8540b4960 2024-04-25T09:58:53.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.849+0000 7fa85c729640 1 -- 172.21.15.7:0/923244980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa854073ce0 con 0x7fa8540b4960 2024-04-25T09:58:53.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.849+0000 7fa84affd640 1 -- 172.21.15.7:0/923244980 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa84401a070 con 0x7fa8540b4960 2024-04-25T09:58:53.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.850+0000 7fa84affd640 1 --2- 172.21.15.7:0/923244980 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa83806b4d0 0x7fa83806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:53.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.850+0000 7fa84affd640 1 -- 172.21.15.7:0/923244980 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa84408a290 con 0x7fa8540b4960 2024-04-25T09:58:53.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.850+0000 7fa85a4c5640 1 --2- 172.21.15.7:0/923244980 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa83806b4d0 0x7fa83806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:53.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.850+0000 7fa85a4c5640 1 --2- 172.21.15.7:0/923244980 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa83806b4d0 0x7fa83806d990 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa850000f60 tx=0x7fa850009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:53.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:53.854+0000 7fa84affd640 1 -- 172.21.15.7:0/923244980 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa854073ce0 con 0x7fa8540b4960 2024-04-25T09:58:54.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.033+0000 7fa85c729640 1 -- 172.21.15.7:0/923244980 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa8540726a0 con 0x7fa83806b4d0 2024-04-25T09:58:54.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.039+0000 7fa84affd640 1 -- 172.21.15.7:0/923244980 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252073 (secure 0 0 0) 0x7fa8540726a0 con 0x7fa83806b4d0 2024-04-25T09:58:54.046 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:58:54.047 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T09:58:54.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.042+0000 7fa85c729640 1 -- 172.21.15.7:0/923244980 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa83806b4d0 msgr2=0x7fa83806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:54.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.042+0000 7fa85c729640 1 --2- 172.21.15.7:0/923244980 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa83806b4d0 0x7fa83806d990 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa850000f60 tx=0x7fa850009040 comp rx=0 tx=0).stop 2024-04-25T09:58:54.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.042+0000 7fa85c729640 1 -- 172.21.15.7:0/923244980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8540b4960 msgr2=0x7fa854151d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:54.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.042+0000 7fa85c729640 1 --2- 172.21.15.7:0/923244980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8540b4960 0x7fa854151d30 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fa84400ec10 tx=0x7fa84400c520 comp rx=0 tx=0).stop 2024-04-25T09:58:54.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.042+0000 7fa85c729640 1 -- 172.21.15.7:0/923244980 shutdown_connections 2024-04-25T09:58:54.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.042+0000 7fa85c729640 1 --2- 172.21.15.7:0/923244980 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa83806b4d0 0x7fa83806d990 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:54.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.042+0000 7fa85c729640 1 --2- 172.21.15.7:0/923244980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8541474f0 0x7fa8541f71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:54.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.042+0000 7fa85c729640 1 --2- 172.21.15.7:0/923244980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8540b4960 0x7fa854151d30 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:54.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.042+0000 7fa85c729640 1 --2- 172.21.15.7:0/923244980 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8540b3d30 0x7fa854140220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:54.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.042+0000 7fa85c729640 1 -- 172.21.15.7:0/923244980 >> 172.21.15.7:0/923244980 conn(0x7fa8540b1740 msgr2=0x7fa8541421c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:54.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.042+0000 7fa85c729640 1 -- 172.21.15.7:0/923244980 shutdown_connections 2024-04-25T09:58:54.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.042+0000 7fa85c729640 1 -- 172.21.15.7:0/923244980 wait complete. 2024-04-25T09:58:54.057 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2024-04-25T09:58:53.914021+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257812,"kb_used_data":8360,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716908,"statfs":{"total":773094113280,"available":772830113792,"internally_reserved":0,"allocated":8560640,"data_stored":4505964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001521"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.290264+0000","last_change":"2024-04-25T09:58:46.312593+0000","last_active":"2024-04-25T09:58:47.290264+0000","last_peered":"2024-04-25T09:58:47.290264+0000","last_clean":"2024-04-25T09:58:47.290264+0000","last_became_active":"2024-04-25T09:58:46.312325+0000","last_became_peered":"2024-04-25T09:58:46.312325+0000","last_unstale":"2024-04-25T09:58:47.290264+0000","last_undegraded":"2024-04-25T09:58:47.290264+0000","last_fullsized":"2024-04-25T09:58:47.290264+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:02.296182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487843+0000","last_change":"2024-04-25T09:58:46.309867+0000","last_active":"2024-04-25T09:58:47.487843+0000","last_peered":"2024-04-25T09:58:47.487843+0000","last_clean":"2024-04-25T09:58:47.487843+0000","last_became_active":"2024-04-25T09:58:46.309570+0000","last_became_peered":"2024-04-25T09:58:46.309570+0000","last_unstale":"2024-04-25T09:58:47.487843+0000","last_undegraded":"2024-04-25T09:58:47.487843+0000","last_fullsized":"2024-04-25T09:58:47.487843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:56.849551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.756528+0000","last_change":"2024-04-25T09:58:46.295586+0000","last_active":"2024-04-25T09:58:47.756528+0000","last_peered":"2024-04-25T09:58:47.756528+0000","last_clean":"2024-04-25T09:58:47.756528+0000","last_became_active":"2024-04-25T09:58:46.294637+0000","last_became_peered":"2024-04-25T09:58:46.294637+0000","last_unstale":"2024-04-25T09:58:47.756528+0000","last_undegraded":"2024-04-25T09:58:47.756528+0000","last_fullsized":"2024-04-25T09:58:47.756528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:18.626049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.589707+0000","last_change":"2024-04-25T09:58:46.316205+0000","last_active":"2024-04-25T09:58:47.589707+0000","last_peered":"2024-04-25T09:58:47.589707+0000","last_clean":"2024-04-25T09:58:47.589707+0000","last_became_active":"2024-04-25T09:58:46.315893+0000","last_became_peered":"2024-04-25T09:58:46.315893+0000","last_unstale":"2024-04-25T09:58:47.589707+0000","last_undegraded":"2024-04-25T09:58:47.589707+0000","last_fullsized":"2024-04-25T09:58:47.589707+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:12.775465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257215+0000","last_change":"2024-04-25T09:58:46.303476+0000","last_active":"2024-04-25T09:58:48.257215+0000","last_peered":"2024-04-25T09:58:48.257215+0000","last_clean":"2024-04-25T09:58:48.257215+0000","last_became_active":"2024-04-25T09:58:46.303184+0000","last_became_peered":"2024-04-25T09:58:46.303184+0000","last_unstale":"2024-04-25T09:58:48.257215+0000","last_undegraded":"2024-04-25T09:58:48.257215+0000","last_fullsized":"2024-04-25T09:58:48.257215+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:39.535483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.288750+0000","last_change":"2024-04-25T09:58:46.303826+0000","last_active":"2024-04-25T09:58:47.288750+0000","last_peered":"2024-04-25T09:58:47.288750+0000","last_clean":"2024-04-25T09:58:47.288750+0000","last_became_active":"2024-04-25T09:58:46.303558+0000","last_became_peered":"2024-04-25T09:58:46.303558+0000","last_unstale":"2024-04-25T09:58:47.288750+0000","last_undegraded":"2024-04-25T09:58:47.288750+0000","last_fullsized":"2024-04-25T09:58:47.288750+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:14.220665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.453462+0000","last_change":"2024-04-25T09:58:46.311707+0000","last_active":"2024-04-25T09:58:47.453462+0000","last_peered":"2024-04-25T09:58:47.453462+0000","last_clean":"2024-04-25T09:58:47.453462+0000","last_became_active":"2024-04-25T09:58:46.311427+0000","last_became_peered":"2024-04-25T09:58:46.311427+0000","last_unstale":"2024-04-25T09:58:47.453462+0000","last_undegraded":"2024-04-25T09:58:47.453462+0000","last_fullsized":"2024-04-25T09:58:47.453462+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:18.626049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257122+0000","last_change":"2024-04-25T09:58:46.302356+0000","last_active":"2024-04-25T09:58:48.257122+0000","last_peered":"2024-04-25T09:58:48.257122+0000","last_clean":"2024-04-25T09:58:48.257122+0000","last_became_active":"2024-04-25T09:58:46.302045+0000","last_became_peered":"2024-04-25T09:58:46.302045+0000","last_unstale":"2024-04-25T09:58:48.257122+0000","last_undegraded":"2024-04-25T09:58:48.257122+0000","last_fullsized":"2024-04-25T09:58:48.257122+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:05.856751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.947869+0000","last_change":"2024-04-25T09:58:46.306012+0000","last_active":"2024-04-25T09:58:47.947869+0000","last_peered":"2024-04-25T09:58:47.947869+0000","last_clean":"2024-04-25T09:58:47.947869+0000","last_became_active":"2024-04-25T09:58:46.305691+0000","last_became_peered":"2024-04-25T09:58:46.305691+0000","last_unstale":"2024-04-25T09:58:47.947869+0000","last_undegraded":"2024-04-25T09:58:47.947869+0000","last_fullsized":"2024-04-25T09:58:47.947869+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:52.159921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.589805+0000","last_change":"2024-04-25T09:58:46.319066+0000","last_active":"2024-04-25T09:58:47.589805+0000","last_peered":"2024-04-25T09:58:47.589805+0000","last_clean":"2024-04-25T09:58:47.589805+0000","last_became_active":"2024-04-25T09:58:46.318782+0000","last_became_peered":"2024-04-25T09:58:46.318782+0000","last_unstale":"2024-04-25T09:58:47.589805+0000","last_undegraded":"2024-04-25T09:58:47.589805+0000","last_fullsized":"2024-04-25T09:58:47.589805+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:56:30.400612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487756+0000","last_change":"2024-04-25T09:58:46.311381+0000","last_active":"2024-04-25T09:58:47.487756+0000","last_peered":"2024-04-25T09:58:47.487756+0000","last_clean":"2024-04-25T09:58:47.487756+0000","last_became_active":"2024-04-25T09:58:46.310880+0000","last_became_peered":"2024-04-25T09:58:46.310880+0000","last_unstale":"2024-04-25T09:58:47.487756+0000","last_undegraded":"2024-04-25T09:58:47.487756+0000","last_fullsized":"2024-04-25T09:58:47.487756+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:44.119671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.589808+0000","last_change":"2024-04-25T09:58:46.313405+0000","last_active":"2024-04-25T09:58:47.589808+0000","last_peered":"2024-04-25T09:58:47.589808+0000","last_clean":"2024-04-25T09:58:47.589808+0000","last_became_active":"2024-04-25T09:58:46.313105+0000","last_became_peered":"2024-04-25T09:58:46.313105+0000","last_unstale":"2024-04-25T09:58:47.589808+0000","last_undegraded":"2024-04-25T09:58:47.589808+0000","last_fullsized":"2024-04-25T09:58:47.589808+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:55.536167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257232+0000","last_change":"2024-04-25T09:58:46.309893+0000","last_active":"2024-04-25T09:58:48.257232+0000","last_peered":"2024-04-25T09:58:48.257232+0000","last_clean":"2024-04-25T09:58:48.257232+0000","last_became_active":"2024-04-25T09:58:46.309213+0000","last_became_peered":"2024-04-25T09:58:46.309213+0000","last_unstale":"2024-04-25T09:58:48.257232+0000","last_undegraded":"2024-04-25T09:58:48.257232+0000","last_fullsized":"2024-04-25T09:58:48.257232+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:07.756398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.288771+0000","last_change":"2024-04-25T09:58:46.302828+0000","last_active":"2024-04-25T09:58:47.288771+0000","last_peered":"2024-04-25T09:58:47.288771+0000","last_clean":"2024-04-25T09:58:47.288771+0000","last_became_active":"2024-04-25T09:58:46.302511+0000","last_became_peered":"2024-04-25T09:58:46.302511+0000","last_unstale":"2024-04-25T09:58:47.288771+0000","last_undegraded":"2024-04-25T09:58:47.288771+0000","last_fullsized":"2024-04-25T09:58:47.288771+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:48.540478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487364+0000","last_change":"2024-04-25T09:58:46.292920+0000","last_active":"2024-04-25T09:58:47.487364+0000","last_peered":"2024-04-25T09:58:47.487364+0000","last_clean":"2024-04-25T09:58:47.487364+0000","last_became_active":"2024-04-25T09:58:46.292615+0000","last_became_peered":"2024-04-25T09:58:46.292615+0000","last_unstale":"2024-04-25T09:58:47.487364+0000","last_undegraded":"2024-04-25T09:58:47.487364+0000","last_fullsized":"2024-04-25T09:58:47.487364+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:37.291630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.289660+0000","last_change":"2024-04-25T09:58:46.314200+0000","last_active":"2024-04-25T09:58:47.289660+0000","last_peered":"2024-04-25T09:58:47.289660+0000","last_clean":"2024-04-25T09:58:47.289660+0000","last_became_active":"2024-04-25T09:58:46.313908+0000","last_became_peered":"2024-04-25T09:58:46.313908+0000","last_unstale":"2024-04-25T09:58:47.289660+0000","last_undegraded":"2024-04-25T09:58:47.289660+0000","last_fullsized":"2024-04-25T09:58:47.289660+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:32.262599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257538+0000","last_change":"2024-04-25T09:58:46.315825+0000","last_active":"2024-04-25T09:58:48.257538+0000","last_peered":"2024-04-25T09:58:48.257538+0000","last_clean":"2024-04-25T09:58:48.257538+0000","last_became_active":"2024-04-25T09:58:46.315414+0000","last_became_peered":"2024-04-25T09:58:46.315414+0000","last_unstale":"2024-04-25T09:58:48.257538+0000","last_undegraded":"2024-04-25T09:58:48.257538+0000","last_fullsized":"2024-04-25T09:58:48.257538+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:44.667003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.756503+0000","last_change":"2024-04-25T09:58:46.303789+0000","last_active":"2024-04-25T09:58:47.756503+0000","last_peered":"2024-04-25T09:58:47.756503+0000","last_clean":"2024-04-25T09:58:47.756503+0000","last_became_active":"2024-04-25T09:58:46.303513+0000","last_became_peered":"2024-04-25T09:58:46.303513+0000","last_unstale":"2024-04-25T09:58:47.756503+0000","last_undegraded":"2024-04-25T09:58:47.756503+0000","last_fullsized":"2024-04-25T09:58:47.756503+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:06.347228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.289041+0000","last_change":"2024-04-25T09:58:46.309950+0000","last_active":"2024-04-25T09:58:47.289041+0000","last_peered":"2024-04-25T09:58:47.289041+0000","last_clean":"2024-04-25T09:58:47.289041+0000","last_became_active":"2024-04-25T09:58:46.309665+0000","last_became_peered":"2024-04-25T09:58:46.309665+0000","last_unstale":"2024-04-25T09:58:47.289041+0000","last_undegraded":"2024-04-25T09:58:47.289041+0000","last_fullsized":"2024-04-25T09:58:47.289041+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:09.626543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257279+0000","last_change":"2024-04-25T09:58:46.306991+0000","last_active":"2024-04-25T09:58:48.257279+0000","last_peered":"2024-04-25T09:58:48.257279+0000","last_clean":"2024-04-25T09:58:48.257279+0000","last_became_active":"2024-04-25T09:58:46.306718+0000","last_became_peered":"2024-04-25T09:58:46.306718+0000","last_unstale":"2024-04-25T09:58:48.257279+0000","last_undegraded":"2024-04-25T09:58:48.257279+0000","last_fullsized":"2024-04-25T09:58:48.257279+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:57.951523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.947935+0000","last_change":"2024-04-25T09:58:46.309474+0000","last_active":"2024-04-25T09:58:47.947935+0000","last_peered":"2024-04-25T09:58:47.947935+0000","last_clean":"2024-04-25T09:58:47.947935+0000","last_became_active":"2024-04-25T09:58:46.309209+0000","last_became_peered":"2024-04-25T09:58:46.309209+0000","last_unstale":"2024-04-25T09:58:47.947935+0000","last_undegraded":"2024-04-25T09:58:47.947935+0000","last_fullsized":"2024-04-25T09:58:47.947935+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:21.525244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257066+0000","last_change":"2024-04-25T09:58:46.304713+0000","last_active":"2024-04-25T09:58:48.257066+0000","last_peered":"2024-04-25T09:58:48.257066+0000","last_clean":"2024-04-25T09:58:48.257066+0000","last_became_active":"2024-04-25T09:58:46.304414+0000","last_became_peered":"2024-04-25T09:58:46.304414+0000","last_unstale":"2024-04-25T09:58:48.257066+0000","last_undegraded":"2024-04-25T09:58:48.257066+0000","last_fullsized":"2024-04-25T09:58:48.257066+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:08.573464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.947573+0000","last_change":"2024-04-25T09:58:46.316310+0000","last_active":"2024-04-25T09:58:47.947573+0000","last_peered":"2024-04-25T09:58:47.947573+0000","last_clean":"2024-04-25T09:58:47.947573+0000","last_became_active":"2024-04-25T09:58:46.316002+0000","last_became_peered":"2024-04-25T09:58:46.316002+0000","last_unstale":"2024-04-25T09:58:47.947573+0000","last_undegraded":"2024-04-25T09:58:47.947573+0000","last_fullsized":"2024-04-25T09:58:47.947573+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:11.350567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487344+0000","last_change":"2024-04-25T09:58:46.297754+0000","last_active":"2024-04-25T09:58:47.487344+0000","last_peered":"2024-04-25T09:58:47.487344+0000","last_clean":"2024-04-25T09:58:47.487344+0000","last_became_active":"2024-04-25T09:58:46.297467+0000","last_became_peered":"2024-04-25T09:58:46.297467+0000","last_unstale":"2024-04-25T09:58:47.487344+0000","last_undegraded":"2024-04-25T09:58:47.487344+0000","last_fullsized":"2024-04-25T09:58:47.487344+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:41:12.840555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487777+0000","last_change":"2024-04-25T09:58:46.295732+0000","last_active":"2024-04-25T09:58:47.487777+0000","last_peered":"2024-04-25T09:58:47.487777+0000","last_clean":"2024-04-25T09:58:47.487777+0000","last_became_active":"2024-04-25T09:58:46.295406+0000","last_became_peered":"2024-04-25T09:58:46.295406+0000","last_unstale":"2024-04-25T09:58:47.487777+0000","last_undegraded":"2024-04-25T09:58:47.487777+0000","last_fullsized":"2024-04-25T09:58:47.487777+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:40.379753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.589917+0000","last_change":"2024-04-25T09:58:46.313359+0000","last_active":"2024-04-25T09:58:47.589917+0000","last_peered":"2024-04-25T09:58:47.589917+0000","last_clean":"2024-04-25T09:58:47.589917+0000","last_became_active":"2024-04-25T09:58:46.313041+0000","last_became_peered":"2024-04-25T09:58:46.313041+0000","last_unstale":"2024-04-25T09:58:47.589917+0000","last_undegraded":"2024-04-25T09:58:47.589917+0000","last_fullsized":"2024-04-25T09:58:47.589917+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:32.262599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.289748+0000","last_change":"2024-04-25T09:58:46.320169+0000","last_active":"2024-04-25T09:58:47.289748+0000","last_peered":"2024-04-25T09:58:47.289748+0000","last_clean":"2024-04-25T09:58:47.289748+0000","last_became_active":"2024-04-25T09:58:46.319776+0000","last_became_peered":"2024-04-25T09:58:46.319776+0000","last_unstale":"2024-04-25T09:58:47.289748+0000","last_undegraded":"2024-04-25T09:58:47.289748+0000","last_fullsized":"2024-04-25T09:58:47.289748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:34:07.129069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257313+0000","last_change":"2024-04-25T09:58:46.314339+0000","last_active":"2024-04-25T09:58:48.257313+0000","last_peered":"2024-04-25T09:58:48.257313+0000","last_clean":"2024-04-25T09:58:48.257313+0000","last_became_active":"2024-04-25T09:58:46.314085+0000","last_became_peered":"2024-04-25T09:58:46.314085+0000","last_unstale":"2024-04-25T09:58:48.257313+0000","last_undegraded":"2024-04-25T09:58:48.257313+0000","last_fullsized":"2024-04-25T09:58:48.257313+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:28.589905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487443+0000","last_change":"2024-04-25T09:58:46.301429+0000","last_active":"2024-04-25T09:58:47.487443+0000","last_peered":"2024-04-25T09:58:47.487443+0000","last_clean":"2024-04-25T09:58:47.487443+0000","last_became_active":"2024-04-25T09:58:46.301118+0000","last_became_peered":"2024-04-25T09:58:46.301118+0000","last_unstale":"2024-04-25T09:58:47.487443+0000","last_undegraded":"2024-04-25T09:58:47.487443+0000","last_fullsized":"2024-04-25T09:58:47.487443+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:47.497812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.290019+0000","last_change":"2024-04-25T09:58:46.317906+0000","last_active":"2024-04-25T09:58:47.290019+0000","last_peered":"2024-04-25T09:58:47.290019+0000","last_clean":"2024-04-25T09:58:47.290019+0000","last_became_active":"2024-04-25T09:58:46.317627+0000","last_became_peered":"2024-04-25T09:58:46.317627+0000","last_unstale":"2024-04-25T09:58:47.290019+0000","last_undegraded":"2024-04-25T09:58:47.290019+0000","last_fullsized":"2024-04-25T09:58:47.290019+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:18:37.956563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.756291+0000","last_change":"2024-04-25T09:58:46.301841+0000","last_active":"2024-04-25T09:58:47.756291+0000","last_peered":"2024-04-25T09:58:47.756291+0000","last_clean":"2024-04-25T09:58:47.756291+0000","last_became_active":"2024-04-25T09:58:46.301509+0000","last_became_peered":"2024-04-25T09:58:46.301509+0000","last_unstale":"2024-04-25T09:58:47.756291+0000","last_undegraded":"2024-04-25T09:58:47.756291+0000","last_fullsized":"2024-04-25T09:58:47.756291+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:37.116316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.289858+0000","last_change":"2024-04-25T09:58:46.311913+0000","last_active":"2024-04-25T09:58:47.289858+0000","last_peered":"2024-04-25T09:58:47.289858+0000","last_clean":"2024-04-25T09:58:47.289858+0000","last_became_active":"2024-04-25T09:58:46.311628+0000","last_became_peered":"2024-04-25T09:58:46.311628+0000","last_unstale":"2024-04-25T09:58:47.289858+0000","last_undegraded":"2024-04-25T09:58:47.289858+0000","last_fullsized":"2024-04-25T09:58:47.289858+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:21.625571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.756265+0000","last_change":"2024-04-25T09:58:46.301020+0000","last_active":"2024-04-25T09:58:47.756265+0000","last_peered":"2024-04-25T09:58:47.756265+0000","last_clean":"2024-04-25T09:58:47.756265+0000","last_became_active":"2024-04-25T09:58:46.300707+0000","last_became_peered":"2024-04-25T09:58:46.300707+0000","last_unstale":"2024-04-25T09:58:47.756265+0000","last_undegraded":"2024-04-25T09:58:47.756265+0000","last_fullsized":"2024-04-25T09:58:47.756265+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:31.505419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"74'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257537+0000","last_change":"2024-04-25T09:58:45.283736+0000","last_active":"2024-04-25T09:58:48.257537+0000","last_peered":"2024-04-25T09:58:48.257537+0000","last_clean":"2024-04-25T09:58:48.257537+0000","last_became_active":"2024-04-25T09:58:45.283451+0000","last_became_peered":"2024-04-25T09:58:45.283451+0000","last_unstale":"2024-04-25T09:58:48.257537+0000","last_undegraded":"2024-04-25T09:58:48.257537+0000","last_fullsized":"2024-04-25T09:58:48.257537+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:13.117190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487410+0000","last_change":"2024-04-25T09:58:46.319812+0000","last_active":"2024-04-25T09:58:47.487410+0000","last_peered":"2024-04-25T09:58:47.487410+0000","last_clean":"2024-04-25T09:58:47.487410+0000","last_became_active":"2024-04-25T09:58:46.319517+0000","last_became_peered":"2024-04-25T09:58:46.319517+0000","last_unstale":"2024-04-25T09:58:47.487410+0000","last_undegraded":"2024-04-25T09:58:47.487410+0000","last_fullsized":"2024-04-25T09:58:47.487410+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:26.661081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.290139+0000","last_change":"2024-04-25T09:58:45.295953+0000","last_active":"2024-04-25T09:58:47.290139+0000","last_peered":"2024-04-25T09:58:47.290139+0000","last_clean":"2024-04-25T09:58:47.290139+0000","last_became_active":"2024-04-25T09:58:45.295589+0000","last_became_peered":"2024-04-25T09:58:45.295589+0000","last_unstale":"2024-04-25T09:58:47.290139+0000","last_undegraded":"2024-04-25T09:58:47.290139+0000","last_fullsized":"2024-04-25T09:58:47.290139+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:47.168549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.947776+0000","last_change":"2024-04-25T09:58:46.306702+0000","last_active":"2024-04-25T09:58:47.947776+0000","last_peered":"2024-04-25T09:58:47.947776+0000","last_clean":"2024-04-25T09:58:47.947776+0000","last_became_active":"2024-04-25T09:58:46.306357+0000","last_became_peered":"2024-04-25T09:58:46.306357+0000","last_unstale":"2024-04-25T09:58:47.947776+0000","last_undegraded":"2024-04-25T09:58:47.947776+0000","last_fullsized":"2024-04-25T09:58:47.947776+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:16.088617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.289757+0000","last_change":"2024-04-25T09:58:45.289498+0000","last_active":"2024-04-25T09:58:47.289757+0000","last_peered":"2024-04-25T09:58:47.289757+0000","last_clean":"2024-04-25T09:58:47.289757+0000","last_became_active":"2024-04-25T09:58:45.289150+0000","last_became_peered":"2024-04-25T09:58:45.289150+0000","last_unstale":"2024-04-25T09:58:47.289757+0000","last_undegraded":"2024-04-25T09:58:47.289757+0000","last_fullsized":"2024-04-25T09:58:47.289757+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:11.688808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.948029+0000","last_change":"2024-04-25T09:58:46.298422+0000","last_active":"2024-04-25T09:58:47.948029+0000","last_peered":"2024-04-25T09:58:47.948029+0000","last_clean":"2024-04-25T09:58:47.948029+0000","last_became_active":"2024-04-25T09:58:46.298097+0000","last_became_peered":"2024-04-25T09:58:46.298097+0000","last_unstale":"2024-04-25T09:58:47.948029+0000","last_undegraded":"2024-04-25T09:58:47.948029+0000","last_fullsized":"2024-04-25T09:58:47.948029+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:31.505419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.453758+0000","last_change":"2024-04-25T09:58:45.291351+0000","last_active":"2024-04-25T09:58:47.453758+0000","last_peered":"2024-04-25T09:58:47.453758+0000","last_clean":"2024-04-25T09:58:47.453758+0000","last_became_active":"2024-04-25T09:58:45.290998+0000","last_became_peered":"2024-04-25T09:58:45.290998+0000","last_unstale":"2024-04-25T09:58:47.453758+0000","last_undegraded":"2024-04-25T09:58:47.453758+0000","last_fullsized":"2024-04-25T09:58:47.453758+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:27.012121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487647+0000","last_change":"2024-04-25T09:58:46.309881+0000","last_active":"2024-04-25T09:58:47.487647+0000","last_peered":"2024-04-25T09:58:47.487647+0000","last_clean":"2024-04-25T09:58:47.487647+0000","last_became_active":"2024-04-25T09:58:46.309523+0000","last_became_peered":"2024-04-25T09:58:46.309523+0000","last_unstale":"2024-04-25T09:58:47.487647+0000","last_undegraded":"2024-04-25T09:58:47.487647+0000","last_fullsized":"2024-04-25T09:58:47.487647+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:29.965375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.948035+0000","last_change":"2024-04-25T09:58:45.288538+0000","last_active":"2024-04-25T09:58:47.948035+0000","last_peered":"2024-04-25T09:58:47.948035+0000","last_clean":"2024-04-25T09:58:47.948035+0000","last_became_active":"2024-04-25T09:58:45.288234+0000","last_became_peered":"2024-04-25T09:58:45.288234+0000","last_unstale":"2024-04-25T09:58:47.948035+0000","last_undegraded":"2024-04-25T09:58:47.948035+0000","last_fullsized":"2024-04-25T09:58:47.948035+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:39:06.844810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487772+0000","last_change":"2024-04-25T09:58:46.311147+0000","last_active":"2024-04-25T09:58:47.487772+0000","last_peered":"2024-04-25T09:58:47.487772+0000","last_clean":"2024-04-25T09:58:47.487772+0000","last_became_active":"2024-04-25T09:58:46.310517+0000","last_became_peered":"2024-04-25T09:58:46.310517+0000","last_unstale":"2024-04-25T09:58:47.487772+0000","last_undegraded":"2024-04-25T09:58:47.487772+0000","last_fullsized":"2024-04-25T09:58:47.487772+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:29:55.475855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.589511+0000","last_change":"2024-04-25T09:58:45.289545+0000","last_active":"2024-04-25T09:58:47.589511+0000","last_peered":"2024-04-25T09:58:47.589511+0000","last_clean":"2024-04-25T09:58:47.589511+0000","last_became_active":"2024-04-25T09:58:45.289245+0000","last_became_peered":"2024-04-25T09:58:45.289245+0000","last_unstale":"2024-04-25T09:58:47.589511+0000","last_undegraded":"2024-04-25T09:58:47.589511+0000","last_fullsized":"2024-04-25T09:58:47.589511+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:38.163978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.948051+0000","last_change":"2024-04-25T09:58:46.306402+0000","last_active":"2024-04-25T09:58:47.948051+0000","last_peered":"2024-04-25T09:58:47.948051+0000","last_clean":"2024-04-25T09:58:47.948051+0000","last_became_active":"2024-04-25T09:58:46.306123+0000","last_became_peered":"2024-04-25T09:58:46.306123+0000","last_unstale":"2024-04-25T09:58:47.948051+0000","last_undegraded":"2024-04-25T09:58:47.948051+0000","last_fullsized":"2024-04-25T09:58:47.948051+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:37.116316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487422+0000","last_change":"2024-04-25T09:58:45.285684+0000","last_active":"2024-04-25T09:58:47.487422+0000","last_peered":"2024-04-25T09:58:47.487422+0000","last_clean":"2024-04-25T09:58:47.487422+0000","last_became_active":"2024-04-25T09:58:45.285412+0000","last_became_peered":"2024-04-25T09:58:45.285412+0000","last_unstale":"2024-04-25T09:58:47.487422+0000","last_undegraded":"2024-04-25T09:58:47.487422+0000","last_fullsized":"2024-04-25T09:58:47.487422+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:11.765762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.453973+0000","last_change":"2024-04-25T09:58:46.316383+0000","last_active":"2024-04-25T09:58:47.453973+0000","last_peered":"2024-04-25T09:58:47.453973+0000","last_clean":"2024-04-25T09:58:47.453973+0000","last_became_active":"2024-04-25T09:58:46.315889+0000","last_became_peered":"2024-04-25T09:58:46.315889+0000","last_unstale":"2024-04-25T09:58:47.453973+0000","last_undegraded":"2024-04-25T09:58:47.453973+0000","last_fullsized":"2024-04-25T09:58:47.453973+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:55.467325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.256965+0000","last_change":"2024-04-25T09:58:45.281544+0000","last_active":"2024-04-25T09:58:48.256965+0000","last_peered":"2024-04-25T09:58:48.256965+0000","last_clean":"2024-04-25T09:58:48.256965+0000","last_became_active":"2024-04-25T09:58:45.281187+0000","last_became_peered":"2024-04-25T09:58:45.281187+0000","last_unstale":"2024-04-25T09:58:48.256965+0000","last_undegraded":"2024-04-25T09:58:48.256965+0000","last_fullsized":"2024-04-25T09:58:48.256965+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:43.942052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487415+0000","last_change":"2024-04-25T09:58:46.308264+0000","last_active":"2024-04-25T09:58:47.487415+0000","last_peered":"2024-04-25T09:58:47.487415+0000","last_clean":"2024-04-25T09:58:47.487415+0000","last_became_active":"2024-04-25T09:58:46.307975+0000","last_became_peered":"2024-04-25T09:58:46.307975+0000","last_unstale":"2024-04-25T09:58:47.487415+0000","last_undegraded":"2024-04-25T09:58:47.487415+0000","last_fullsized":"2024-04-25T09:58:47.487415+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:03:27.048245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.290374+0000","last_change":"2024-04-25T09:58:45.290559+0000","last_active":"2024-04-25T09:58:47.290374+0000","last_peered":"2024-04-25T09:58:47.290374+0000","last_clean":"2024-04-25T09:58:47.290374+0000","last_became_active":"2024-04-25T09:58:45.290260+0000","last_became_peered":"2024-04-25T09:58:45.290260+0000","last_unstale":"2024-04-25T09:58:47.290374+0000","last_undegraded":"2024-04-25T09:58:47.290374+0000","last_fullsized":"2024-04-25T09:58:47.290374+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:30:34.272660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.589785+0000","last_change":"2024-04-25T09:58:46.316476+0000","last_active":"2024-04-25T09:58:47.589785+0000","last_peered":"2024-04-25T09:58:47.589785+0000","last_clean":"2024-04-25T09:58:47.589785+0000","last_became_active":"2024-04-25T09:58:46.315964+0000","last_became_peered":"2024-04-25T09:58:46.315964+0000","last_unstale":"2024-04-25T09:58:47.589785+0000","last_undegraded":"2024-04-25T09:58:47.589785+0000","last_fullsized":"2024-04-25T09:58:47.589785+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:03.879204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.589938+0000","last_change":"2024-04-25T09:58:45.296555+0000","last_active":"2024-04-25T09:58:47.589938+0000","last_peered":"2024-04-25T09:58:47.589938+0000","last_clean":"2024-04-25T09:58:47.589938+0000","last_became_active":"2024-04-25T09:58:45.296256+0000","last_became_peered":"2024-04-25T09:58:45.296256+0000","last_unstale":"2024-04-25T09:58:47.589938+0000","last_undegraded":"2024-04-25T09:58:47.589938+0000","last_fullsized":"2024-04-25T09:58:47.589938+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:54.457621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.288927+0000","last_change":"2024-04-25T09:58:46.298913+0000","last_active":"2024-04-25T09:58:47.288927+0000","last_peered":"2024-04-25T09:58:47.288927+0000","last_clean":"2024-04-25T09:58:47.288927+0000","last_became_active":"2024-04-25T09:58:46.298592+0000","last_became_peered":"2024-04-25T09:58:46.298592+0000","last_unstale":"2024-04-25T09:58:47.288927+0000","last_undegraded":"2024-04-25T09:58:47.288927+0000","last_fullsized":"2024-04-25T09:58:47.288927+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:12.587780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"74'3","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257332+0000","last_change":"2024-04-25T09:58:45.282436+0000","last_active":"2024-04-25T09:58:48.257332+0000","last_peered":"2024-04-25T09:58:48.257332+0000","last_clean":"2024-04-25T09:58:48.257332+0000","last_became_active":"2024-04-25T09:58:45.282098+0000","last_became_peered":"2024-04-25T09:58:45.282098+0000","last_unstale":"2024-04-25T09:58:48.257332+0000","last_undegraded":"2024-04-25T09:58:48.257332+0000","last_fullsized":"2024-04-25T09:58:48.257332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:17.580693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.756372+0000","last_change":"2024-04-25T09:58:46.295920+0000","last_active":"2024-04-25T09:58:47.756372+0000","last_peered":"2024-04-25T09:58:47.756372+0000","last_clean":"2024-04-25T09:58:47.756372+0000","last_became_active":"2024-04-25T09:58:46.294687+0000","last_became_peered":"2024-04-25T09:58:46.294687+0000","last_unstale":"2024-04-25T09:58:47.756372+0000","last_undegraded":"2024-04-25T09:58:47.756372+0000","last_fullsized":"2024-04-25T09:58:47.756372+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:43.628278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"74'6","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.453858+0000","last_change":"2024-04-25T09:58:45.288248+0000","last_active":"2024-04-25T09:58:47.453858+0000","last_peered":"2024-04-25T09:58:47.453858+0000","last_clean":"2024-04-25T09:58:47.453858+0000","last_became_active":"2024-04-25T09:58:45.287736+0000","last_became_peered":"2024-04-25T09:58:45.287736+0000","last_unstale":"2024-04-25T09:58:47.453858+0000","last_undegraded":"2024-04-25T09:58:47.453858+0000","last_fullsized":"2024-04-25T09:58:47.453858+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:12.634835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.589934+0000","last_change":"2024-04-25T09:58:46.311262+0000","last_active":"2024-04-25T09:58:47.589934+0000","last_peered":"2024-04-25T09:58:47.589934+0000","last_clean":"2024-04-25T09:58:47.589934+0000","last_became_active":"2024-04-25T09:58:46.310851+0000","last_became_peered":"2024-04-25T09:58:46.310851+0000","last_unstale":"2024-04-25T09:58:47.589934+0000","last_undegraded":"2024-04-25T09:58:47.589934+0000","last_fullsized":"2024-04-25T09:58:47.589934+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:34:07.129069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.589511+0000","last_change":"2024-04-25T09:58:45.296232+0000","last_active":"2024-04-25T09:58:47.589511+0000","last_peered":"2024-04-25T09:58:47.589511+0000","last_clean":"2024-04-25T09:58:47.589511+0000","last_became_active":"2024-04-25T09:58:45.295916+0000","last_became_peered":"2024-04-25T09:58:45.295916+0000","last_unstale":"2024-04-25T09:58:47.589511+0000","last_undegraded":"2024-04-25T09:58:47.589511+0000","last_fullsized":"2024-04-25T09:58:47.589511+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:49.372377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.453686+0000","last_change":"2024-04-25T09:58:46.307629+0000","last_active":"2024-04-25T09:58:47.453686+0000","last_peered":"2024-04-25T09:58:47.453686+0000","last_clean":"2024-04-25T09:58:47.453686+0000","last_became_active":"2024-04-25T09:58:46.307341+0000","last_became_peered":"2024-04-25T09:58:46.307341+0000","last_unstale":"2024-04-25T09:58:47.453686+0000","last_undegraded":"2024-04-25T09:58:47.453686+0000","last_fullsized":"2024-04-25T09:58:47.453686+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:50.382080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.289682+0000","last_change":"2024-04-25T09:58:45.287147+0000","last_active":"2024-04-25T09:58:47.289682+0000","last_peered":"2024-04-25T09:58:47.289682+0000","last_clean":"2024-04-25T09:58:47.289682+0000","last_became_active":"2024-04-25T09:58:45.286871+0000","last_became_peered":"2024-04-25T09:58:45.286871+0000","last_unstale":"2024-04-25T09:58:47.289682+0000","last_undegraded":"2024-04-25T09:58:47.289682+0000","last_fullsized":"2024-04-25T09:58:47.289682+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:54.457621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.453880+0000","last_change":"2024-04-25T09:58:46.316810+0000","last_active":"2024-04-25T09:58:47.453880+0000","last_peered":"2024-04-25T09:58:47.453880+0000","last_clean":"2024-04-25T09:58:47.453880+0000","last_became_active":"2024-04-25T09:58:46.316495+0000","last_became_peered":"2024-04-25T09:58:46.316495+0000","last_unstale":"2024-04-25T09:58:47.453880+0000","last_undegraded":"2024-04-25T09:58:47.453880+0000","last_fullsized":"2024-04-25T09:58:47.453880+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:20:59.468833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.256966+0000","last_change":"2024-04-25T09:58:45.282926+0000","last_active":"2024-04-25T09:58:48.256966+0000","last_peered":"2024-04-25T09:58:48.256966+0000","last_clean":"2024-04-25T09:58:48.256966+0000","last_became_active":"2024-04-25T09:58:45.282629+0000","last_became_peered":"2024-04-25T09:58:45.282629+0000","last_unstale":"2024-04-25T09:58:48.256966+0000","last_undegraded":"2024-04-25T09:58:48.256966+0000","last_fullsized":"2024-04-25T09:58:48.256966+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:51.537578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.453973+0000","last_change":"2024-04-25T09:58:46.308465+0000","last_active":"2024-04-25T09:58:47.453973+0000","last_peered":"2024-04-25T09:58:47.453973+0000","last_clean":"2024-04-25T09:58:47.453973+0000","last_became_active":"2024-04-25T09:58:46.308183+0000","last_became_peered":"2024-04-25T09:58:46.308183+0000","last_unstale":"2024-04-25T09:58:47.453973+0000","last_undegraded":"2024-04-25T09:58:47.453973+0000","last_fullsized":"2024-04-25T09:58:47.453973+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:30:35.282364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"74'8","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487408+0000","last_change":"2024-04-25T09:58:45.288815+0000","last_active":"2024-04-25T09:58:47.487408+0000","last_peered":"2024-04-25T09:58:47.487408+0000","last_clean":"2024-04-25T09:58:47.487408+0000","last_became_active":"2024-04-25T09:58:45.288472+0000","last_became_peered":"2024-04-25T09:58:45.288472+0000","last_unstale":"2024-04-25T09:58:47.487408+0000","last_undegraded":"2024-04-25T09:58:47.487408+0000","last_fullsized":"2024-04-25T09:58:47.487408+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:02.869500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.288507+0000","last_change":"2024-04-25T09:58:46.301930+0000","last_active":"2024-04-25T09:58:47.288507+0000","last_peered":"2024-04-25T09:58:47.288507+0000","last_clean":"2024-04-25T09:58:47.288507+0000","last_became_active":"2024-04-25T09:58:46.301671+0000","last_became_peered":"2024-04-25T09:58:46.301671+0000","last_unstale":"2024-04-25T09:58:47.288507+0000","last_undegraded":"2024-04-25T09:58:47.288507+0000","last_fullsized":"2024-04-25T09:58:47.288507+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:08:06.950633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.290380+0000","last_change":"2024-04-25T09:58:45.288097+0000","last_active":"2024-04-25T09:58:47.290380+0000","last_peered":"2024-04-25T09:58:47.290380+0000","last_clean":"2024-04-25T09:58:47.290380+0000","last_became_active":"2024-04-25T09:58:45.287801+0000","last_became_peered":"2024-04-25T09:58:45.287801+0000","last_unstale":"2024-04-25T09:58:47.290380+0000","last_undegraded":"2024-04-25T09:58:47.290380+0000","last_fullsized":"2024-04-25T09:58:47.290380+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:58.105420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.256975+0000","last_change":"2024-04-25T09:58:46.308348+0000","last_active":"2024-04-25T09:58:48.256975+0000","last_peered":"2024-04-25T09:58:48.256975+0000","last_clean":"2024-04-25T09:58:48.256975+0000","last_became_active":"2024-04-25T09:58:46.308044+0000","last_became_peered":"2024-04-25T09:58:46.308044+0000","last_unstale":"2024-04-25T09:58:48.256975+0000","last_undegraded":"2024-04-25T09:58:48.256975+0000","last_fullsized":"2024-04-25T09:58:48.256975+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:10:18.258705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.948038+0000","last_change":"2024-04-25T09:58:45.282174+0000","last_active":"2024-04-25T09:58:47.948038+0000","last_peered":"2024-04-25T09:58:47.948038+0000","last_clean":"2024-04-25T09:58:47.948038+0000","last_became_active":"2024-04-25T09:58:45.281632+0000","last_became_peered":"2024-04-25T09:58:45.281632+0000","last_unstale":"2024-04-25T09:58:47.948038+0000","last_undegraded":"2024-04-25T09:58:47.948038+0000","last_fullsized":"2024-04-25T09:58:47.948038+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:21.667587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257202+0000","last_change":"2024-04-25T09:58:46.309129+0000","last_active":"2024-04-25T09:58:48.257202+0000","last_peered":"2024-04-25T09:58:48.257202+0000","last_clean":"2024-04-25T09:58:48.257202+0000","last_became_active":"2024-04-25T09:58:46.308393+0000","last_became_peered":"2024-04-25T09:58:46.308393+0000","last_unstale":"2024-04-25T09:58:48.257202+0000","last_undegraded":"2024-04-25T09:58:48.257202+0000","last_fullsized":"2024-04-25T09:58:48.257202+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:13.708287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257445+0000","last_change":"2024-04-25T09:58:45.281780+0000","last_active":"2024-04-25T09:58:48.257445+0000","last_peered":"2024-04-25T09:58:48.257445+0000","last_clean":"2024-04-25T09:58:48.257445+0000","last_became_active":"2024-04-25T09:58:45.281456+0000","last_became_peered":"2024-04-25T09:58:45.281456+0000","last_unstale":"2024-04-25T09:58:48.257445+0000","last_undegraded":"2024-04-25T09:58:48.257445+0000","last_fullsized":"2024-04-25T09:58:48.257445+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:06.608344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.288919+0000","last_change":"2024-04-25T09:58:46.301496+0000","last_active":"2024-04-25T09:58:47.288919+0000","last_peered":"2024-04-25T09:58:47.288919+0000","last_clean":"2024-04-25T09:58:47.288919+0000","last_became_active":"2024-04-25T09:58:46.300180+0000","last_became_peered":"2024-04-25T09:58:46.300180+0000","last_unstale":"2024-04-25T09:58:47.288919+0000","last_undegraded":"2024-04-25T09:58:47.288919+0000","last_fullsized":"2024-04-25T09:58:47.288919+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:58.805827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.756309+0000","last_change":"2024-04-25T09:58:45.278954+0000","last_active":"2024-04-25T09:58:47.756309+0000","last_peered":"2024-04-25T09:58:47.756309+0000","last_clean":"2024-04-25T09:58:47.756309+0000","last_became_active":"2024-04-25T09:58:45.278670+0000","last_became_peered":"2024-04-25T09:58:45.278670+0000","last_unstale":"2024-04-25T09:58:47.756309+0000","last_undegraded":"2024-04-25T09:58:47.756309+0000","last_fullsized":"2024-04-25T09:58:47.756309+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:08.289516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487720+0000","last_change":"2024-04-25T09:58:46.314327+0000","last_active":"2024-04-25T09:58:47.487720+0000","last_peered":"2024-04-25T09:58:47.487720+0000","last_clean":"2024-04-25T09:58:47.487720+0000","last_became_active":"2024-04-25T09:58:46.314045+0000","last_became_peered":"2024-04-25T09:58:46.314045+0000","last_unstale":"2024-04-25T09:58:47.487720+0000","last_undegraded":"2024-04-25T09:58:47.487720+0000","last_fullsized":"2024-04-25T09:58:47.487720+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:01.351792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.288758+0000","last_change":"2024-04-25T09:58:45.274234+0000","last_active":"2024-04-25T09:58:47.288758+0000","last_peered":"2024-04-25T09:58:47.288758+0000","last_clean":"2024-04-25T09:58:47.288758+0000","last_became_active":"2024-04-25T09:58:45.273957+0000","last_became_peered":"2024-04-25T09:58:45.273957+0000","last_unstale":"2024-04-25T09:58:47.288758+0000","last_undegraded":"2024-04-25T09:58:47.288758+0000","last_fullsized":"2024-04-25T09:58:47.288758+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:02.869500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487881+0000","last_change":"2024-04-25T09:58:46.300913+0000","last_active":"2024-04-25T09:58:47.487881+0000","last_peered":"2024-04-25T09:58:47.487881+0000","last_clean":"2024-04-25T09:58:47.487881+0000","last_became_active":"2024-04-25T09:58:46.300612+0000","last_became_peered":"2024-04-25T09:58:46.300612+0000","last_unstale":"2024-04-25T09:58:47.487881+0000","last_undegraded":"2024-04-25T09:58:47.487881+0000","last_fullsized":"2024-04-25T09:58:47.487881+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:16.577248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.288520+0000","last_change":"2024-04-25T09:58:45.287605+0000","last_active":"2024-04-25T09:58:47.288520+0000","last_peered":"2024-04-25T09:58:47.288520+0000","last_clean":"2024-04-25T09:58:47.288520+0000","last_became_active":"2024-04-25T09:58:45.287270+0000","last_became_peered":"2024-04-25T09:58:45.287270+0000","last_unstale":"2024-04-25T09:58:47.288520+0000","last_undegraded":"2024-04-25T09:58:47.288520+0000","last_fullsized":"2024-04-25T09:58:47.288520+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:56:29.390909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.454125+0000","last_change":"2024-04-25T09:58:46.316154+0000","last_active":"2024-04-25T09:58:47.454125+0000","last_peered":"2024-04-25T09:58:47.454125+0000","last_clean":"2024-04-25T09:58:47.454125+0000","last_became_active":"2024-04-25T09:58:46.315518+0000","last_became_peered":"2024-04-25T09:58:46.315518+0000","last_unstale":"2024-04-25T09:58:47.454125+0000","last_undegraded":"2024-04-25T09:58:47.454125+0000","last_fullsized":"2024-04-25T09:58:47.454125+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:48.178253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.288533+0000","last_change":"2024-04-25T09:58:45.287684+0000","last_active":"2024-04-25T09:58:47.288533+0000","last_peered":"2024-04-25T09:58:47.288533+0000","last_clean":"2024-04-25T09:58:47.288533+0000","last_became_active":"2024-04-25T09:58:45.287393+0000","last_became_peered":"2024-04-25T09:58:45.287393+0000","last_unstale":"2024-04-25T09:58:47.288533+0000","last_undegraded":"2024-04-25T09:58:47.288533+0000","last_fullsized":"2024-04-25T09:58:47.288533+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:11.765762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.947786+0000","last_change":"2024-04-25T09:58:46.302025+0000","last_active":"2024-04-25T09:58:47.947786+0000","last_peered":"2024-04-25T09:58:47.947786+0000","last_clean":"2024-04-25T09:58:47.947786+0000","last_became_active":"2024-04-25T09:58:46.301763+0000","last_became_peered":"2024-04-25T09:58:46.301763+0000","last_unstale":"2024-04-25T09:58:47.947786+0000","last_undegraded":"2024-04-25T09:58:47.947786+0000","last_fullsized":"2024-04-25T09:58:47.947786+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:13.050399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.589746+0000","last_change":"2024-04-25T09:58:45.289571+0000","last_active":"2024-04-25T09:58:47.589746+0000","last_peered":"2024-04-25T09:58:47.589746+0000","last_clean":"2024-04-25T09:58:47.589746+0000","last_became_active":"2024-04-25T09:58:45.289229+0000","last_became_peered":"2024-04-25T09:58:45.289229+0000","last_unstale":"2024-04-25T09:58:47.589746+0000","last_undegraded":"2024-04-25T09:58:47.589746+0000","last_fullsized":"2024-04-25T09:58:47.589746+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:20:58.459130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.453659+0000","last_change":"2024-04-25T09:58:46.304285+0000","last_active":"2024-04-25T09:58:47.453659+0000","last_peered":"2024-04-25T09:58:47.453659+0000","last_clean":"2024-04-25T09:58:47.453659+0000","last_became_active":"2024-04-25T09:58:46.303960+0000","last_became_peered":"2024-04-25T09:58:46.303960+0000","last_unstale":"2024-04-25T09:58:47.453659+0000","last_undegraded":"2024-04-25T09:58:47.453659+0000","last_fullsized":"2024-04-25T09:58:47.453659+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:48.475155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487895+0000","last_change":"2024-04-25T09:58:45.276375+0000","last_active":"2024-04-25T09:58:47.487895+0000","last_peered":"2024-04-25T09:58:47.487895+0000","last_clean":"2024-04-25T09:58:47.487895+0000","last_became_active":"2024-04-25T09:58:45.276101+0000","last_became_peered":"2024-04-25T09:58:45.276101+0000","last_unstale":"2024-04-25T09:58:47.487895+0000","last_undegraded":"2024-04-25T09:58:47.487895+0000","last_fullsized":"2024-04-25T09:58:47.487895+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:56:29.390909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.947763+0000","last_change":"2024-04-25T09:58:46.306553+0000","last_active":"2024-04-25T09:58:47.947763+0000","last_peered":"2024-04-25T09:58:47.947763+0000","last_clean":"2024-04-25T09:58:47.947763+0000","last_became_active":"2024-04-25T09:58:46.305750+0000","last_became_peered":"2024-04-25T09:58:46.305750+0000","last_unstale":"2024-04-25T09:58:47.947763+0000","last_undegraded":"2024-04-25T09:58:47.947763+0000","last_fullsized":"2024-04-25T09:58:47.947763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:58:25.931753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.290133+0000","last_change":"2024-04-25T09:58:45.300947+0000","last_active":"2024-04-25T09:58:47.290133+0000","last_peered":"2024-04-25T09:58:47.290133+0000","last_clean":"2024-04-25T09:58:47.290133+0000","last_became_active":"2024-04-25T09:58:45.300453+0000","last_became_peered":"2024-04-25T09:58:45.300453+0000","last_unstale":"2024-04-25T09:58:47.290133+0000","last_undegraded":"2024-04-25T09:58:47.290133+0000","last_fullsized":"2024-04-25T09:58:47.290133+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:09.761919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.487643+0000","last_change":"2024-04-25T09:58:46.307307+0000","last_active":"2024-04-25T09:58:47.487643+0000","last_peered":"2024-04-25T09:58:47.487643+0000","last_clean":"2024-04-25T09:58:47.487643+0000","last_became_active":"2024-04-25T09:58:46.307010+0000","last_became_peered":"2024-04-25T09:58:46.307010+0000","last_unstale":"2024-04-25T09:58:47.487643+0000","last_undegraded":"2024-04-25T09:58:47.487643+0000","last_fullsized":"2024-04-25T09:58:47.487643+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:16.682302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.289896+0000","last_change":"2024-04-25T09:58:45.291060+0000","last_active":"2024-04-25T09:58:47.289896+0000","last_peered":"2024-04-25T09:58:47.289896+0000","last_clean":"2024-04-25T09:58:47.289896+0000","last_became_active":"2024-04-25T09:58:45.290776+0000","last_became_peered":"2024-04-25T09:58:45.290776+0000","last_unstale":"2024-04-25T09:58:47.289896+0000","last_undegraded":"2024-04-25T09:58:47.289896+0000","last_fullsized":"2024-04-25T09:58:47.289896+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:20:58.459130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.453624+0000","last_change":"2024-04-25T09:58:46.303877+0000","last_active":"2024-04-25T09:58:47.453624+0000","last_peered":"2024-04-25T09:58:47.453624+0000","last_clean":"2024-04-25T09:58:47.453624+0000","last_became_active":"2024-04-25T09:58:46.303602+0000","last_became_peered":"2024-04-25T09:58:46.303602+0000","last_unstale":"2024-04-25T09:58:47.453624+0000","last_undegraded":"2024-04-25T09:58:47.453624+0000","last_fullsized":"2024-04-25T09:58:47.453624+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:05.421905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.453538+0000","last_change":"2024-04-25T09:58:45.291324+0000","last_active":"2024-04-25T09:58:47.453538+0000","last_peered":"2024-04-25T09:58:47.453538+0000","last_clean":"2024-04-25T09:58:47.453538+0000","last_became_active":"2024-04-25T09:58:45.291012+0000","last_became_peered":"2024-04-25T09:58:45.291012+0000","last_unstale":"2024-04-25T09:58:47.453538+0000","last_undegraded":"2024-04-25T09:58:47.453538+0000","last_fullsized":"2024-04-25T09:58:47.453538+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:08.289516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.453723+0000","last_change":"2024-04-25T09:58:46.315256+0000","last_active":"2024-04-25T09:58:47.453723+0000","last_peered":"2024-04-25T09:58:47.453723+0000","last_clean":"2024-04-25T09:58:47.453723+0000","last_became_active":"2024-04-25T09:58:46.314895+0000","last_became_peered":"2024-04-25T09:58:46.314895+0000","last_unstale":"2024-04-25T09:58:47.453723+0000","last_undegraded":"2024-04-25T09:58:47.453723+0000","last_fullsized":"2024-04-25T09:58:47.453723+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:39.173682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:48.257137+0000","last_change":"2024-04-25T09:58:45.281366+0000","last_active":"2024-04-25T09:58:48.257137+0000","last_peered":"2024-04-25T09:58:48.257137+0000","last_clean":"2024-04-25T09:58:48.257137+0000","last_became_active":"2024-04-25T09:58:45.281068+0000","last_became_peered":"2024-04-25T09:58:45.281068+0000","last_unstale":"2024-04-25T09:58:48.257137+0000","last_undegraded":"2024-04-25T09:58:48.257137+0000","last_fullsized":"2024-04-25T09:58:48.257137+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:08:34.497717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.756591+0000","last_change":"2024-04-25T09:58:46.295242+0000","last_active":"2024-04-25T09:58:47.756591+0000","last_peered":"2024-04-25T09:58:47.756591+0000","last_clean":"2024-04-25T09:58:47.756591+0000","last_became_active":"2024-04-25T09:58:46.294939+0000","last_became_peered":"2024-04-25T09:58:46.294939+0000","last_unstale":"2024-04-25T09:58:47.756591+0000","last_undegraded":"2024-04-25T09:58:47.756591+0000","last_fullsized":"2024-04-25T09:58:47.756591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:05.421905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.453823+0000","last_change":"2024-04-25T09:58:45.286219+0000","last_active":"2024-04-25T09:58:47.453823+0000","last_peered":"2024-04-25T09:58:47.453823+0000","last_clean":"2024-04-25T09:58:47.453823+0000","last_became_active":"2024-04-25T09:58:45.285943+0000","last_became_peered":"2024-04-25T09:58:45.285943+0000","last_unstale":"2024-04-25T09:58:47.453823+0000","last_undegraded":"2024-04-25T09:58:47.453823+0000","last_fullsized":"2024-04-25T09:58:47.453823+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:20.979896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.756596+0000","last_change":"2024-04-25T09:58:46.314207+0000","last_active":"2024-04-25T09:58:47.756596+0000","last_peered":"2024-04-25T09:58:47.756596+0000","last_clean":"2024-04-25T09:58:47.756596+0000","last_became_active":"2024-04-25T09:58:46.313924+0000","last_became_peered":"2024-04-25T09:58:46.313924+0000","last_unstale":"2024-04-25T09:58:47.756596+0000","last_undegraded":"2024-04-25T09:58:47.756596+0000","last_fullsized":"2024-04-25T09:58:47.756596+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:48.475155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.756143+0000","last_change":"2024-04-25T09:58:45.277849+0000","last_active":"2024-04-25T09:58:47.756143+0000","last_peered":"2024-04-25T09:58:47.756143+0000","last_clean":"2024-04-25T09:58:47.756143+0000","last_became_active":"2024-04-25T09:58:45.277563+0000","last_became_peered":"2024-04-25T09:58:45.277563+0000","last_unstale":"2024-04-25T09:58:47.756143+0000","last_undegraded":"2024-04-25T09:58:47.756143+0000","last_fullsized":"2024-04-25T09:58:47.756143+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:27.012121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.289999+0000","last_change":"2024-04-25T09:58:46.308114+0000","last_active":"2024-04-25T09:58:47.289999+0000","last_peered":"2024-04-25T09:58:47.289999+0000","last_clean":"2024-04-25T09:58:47.289999+0000","last_became_active":"2024-04-25T09:58:46.307803+0000","last_became_peered":"2024-04-25T09:58:46.307803+0000","last_unstale":"2024-04-25T09:58:47.289999+0000","last_undegraded":"2024-04-25T09:58:47.289999+0000","last_fullsized":"2024-04-25T09:58:47.289999+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:45.261143+0000","last_clean_scrub_stamp":"2024-04-25T09:58:45.261143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:00.051875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.288977+0000","last_change":"2024-04-25T09:58:45.288630+0000","last_active":"2024-04-25T09:58:47.288977+0000","last_peered":"2024-04-25T09:58:47.288977+0000","last_clean":"2024-04-25T09:58:47.288977+0000","last_became_active":"2024-04-25T09:58:45.288346+0000","last_became_peered":"2024-04-25T09:58:45.288346+0000","last_unstale":"2024-04-25T09:58:47.288977+0000","last_undegraded":"2024-04-25T09:58:47.288977+0000","last_fullsized":"2024-04-25T09:58:47.288977+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:58:44.251439+0000","last_clean_scrub_stamp":"2024-04-25T09:58:44.251439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:54.526464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":270,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-25T09:58:47.289974+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T09:58:47.289974+0000","last_peered":"2024-04-25T09:58:47.289974+0000","last_clean":"2024-04-25T09:58:47.289974+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T09:58:47.289974+0000","last_undegraded":"2024-04-25T09:58:47.289974+0000","last_fullsized":"2024-04-25T09:58:47.289974+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542202,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32656,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339184,"statfs":{"total":96636764160,"available":96603324416,"internally_reserved":0,"allocated":1511424,"data_stored":1005441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542202,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":925696,"data_stored":416663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542204,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":917504,"data_stored":415085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542201,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":933888,"data_stored":416767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574906,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":917504,"data_stored":415633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574906,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":925696,"data_stored":415793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":921600,"data_stored":415163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32652,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339188,"statfs":{"total":96636764160,"available":96603328512,"internally_reserved":0,"allocated":1507328,"data_stored":1005419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:58:54.061 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:58:54.061 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:58:54.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.201+0000 7f920075c640 1 Processor -- start 2024-04-25T09:58:54.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.201+0000 7f920075c640 1 -- start start 2024-04-25T09:58:54.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.202+0000 7f920075c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f91f80d0a50 0x7f91f80d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:54.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.202+0000 7f920075c640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f80d1e80 con 0x7f91f80b53b0 2024-04-25T09:58:54.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.202+0000 7f920075c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f80b5930 con 0x7f91f815db00 2024-04-25T09:58:54.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.202+0000 7f920075c640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f80b5c10 con 0x7f91f80d0a50 2024-04-25T09:58:54.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.202+0000 7f91fdcf7640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f91f80d0a50 0x7f91f80d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:54.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.202+0000 7f91fecf9640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f91f80b53b0 0x7f91f80d2870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60008/0 (socket says 172.21.15.7:60008) 2024-04-25T09:58:54.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.202+0000 7f91fecf9640 1 -- 172.21.15.7:0/3890765286 learned_addr learned my addr 172.21.15.7:0/3890765286 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:54.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.203+0000 7f91fdcf7640 1 -- 172.21.15.7:0/3890765286 >> v1:172.21.15.55:6789/0 conn(0x7f91f815db00 legacy=0x7f91f80d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:54.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.203+0000 7f91fdcf7640 1 -- 172.21.15.7:0/3890765286 >> v1:172.21.15.7:6789/0 conn(0x7f91f80b53b0 legacy=0x7f91f80d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:54.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.203+0000 7f91fd4f6640 1 -- 172.21.15.7:0/3890765286 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4292421538 0 0) 0x7f91f80d1e80 con 0x7f91f80b53b0 2024-04-25T09:58:54.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.203+0000 7f91fdcf7640 1 -- 172.21.15.7:0/3890765286 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f80b5ef0 con 0x7f91f80d0a50 2024-04-25T09:58:54.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.204+0000 7f91fdcf7640 1 --2- 172.21.15.7:0/3890765286 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91f80d0a50 0x7f91f80d2330 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f91ec0097a0 tx=0x7f91ec02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8cde39586fcb897 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:54.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.204+0000 7f91fd4f6640 1 -- 172.21.15.7:0/3890765286 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec037070 con 0x7f91f80d0a50 2024-04-25T09:58:54.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.204+0000 7f91fd4f6640 1 -- 172.21.15.7:0/3890765286 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ec032440 con 0x7f91f80d0a50 2024-04-25T09:58:54.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.204+0000 7f91fd4f6640 1 -- 172.21.15.7:0/3890765286 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec032810 con 0x7f91f80d0a50 2024-04-25T09:58:54.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.204+0000 7f920075c640 1 -- 172.21.15.7:0/3890765286 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91f80d0a50 msgr2=0x7f91f80d2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:54.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.204+0000 7f920075c640 1 --2- 172.21.15.7:0/3890765286 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91f80d0a50 0x7f91f80d2330 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f91ec0097a0 tx=0x7f91ec02a230 comp rx=0 tx=0).stop 2024-04-25T09:58:54.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.204+0000 7f920075c640 1 -- 172.21.15.7:0/3890765286 shutdown_connections 2024-04-25T09:58:54.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.204+0000 7f920075c640 1 --2- 172.21.15.7:0/3890765286 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91f80d0a50 0x7f91f80d2330 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:54.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.204+0000 7f920075c640 1 -- 172.21.15.7:0/3890765286 >> 172.21.15.7:0/3890765286 conn(0x7f91f8072290 msgr2=0x7f91f80726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:54.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.204+0000 7f920075c640 1 -- 172.21.15.7:0/3890765286 shutdown_connections 2024-04-25T09:58:54.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.204+0000 7f920075c640 1 -- 172.21.15.7:0/3890765286 wait complete. 2024-04-25T09:58:54.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.205+0000 7f920075c640 1 Processor -- start 2024-04-25T09:58:54.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.206+0000 7f920075c640 1 -- start start 2024-04-25T09:58:54.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.206+0000 7f920075c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91f80b53b0 0x7f91f8156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:54.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.206+0000 7f920075c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91f80d0a50 0x7f91f81f3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:54.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.206+0000 7f920075c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f91f815db00 0x7f91f80c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:54.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.206+0000 7f920075c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f80d3660 con 0x7f91f80b53b0 2024-04-25T09:58:54.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.206+0000 7f920075c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f80b61d0 con 0x7f91f80d0a50 2024-04-25T09:58:54.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.206+0000 7f920075c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f80d2f80 con 0x7f91f815db00 2024-04-25T09:58:54.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.206+0000 7f91fe4f8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91f80b53b0 0x7f91f8156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:54.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.206+0000 7f91fe4f8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91f80b53b0 0x7f91f8156c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34676/0 (socket says 172.21.15.7:34676) 2024-04-25T09:58:54.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.206+0000 7f91fe4f8640 1 -- 172.21.15.7:0/2676762432 learned_addr learned my addr 172.21.15.7:0/2676762432 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:54.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.207+0000 7f91fdcf7640 1 --2- 172.21.15.7:0/2676762432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91f80d0a50 0x7f91f81f3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:54.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.207+0000 7f91fecf9640 1 --2- 172.21.15.7:0/2676762432 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f91f815db00 0x7f91f80c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:54.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.207+0000 7f91fe4f8640 1 -- 172.21.15.7:0/2676762432 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f91f815db00 msgr2=0x7f91f80c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:54.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.207+0000 7f91fe4f8640 1 --2- 172.21.15.7:0/2676762432 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f91f815db00 0x7f91f80c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:54.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.207+0000 7f91fe4f8640 1 -- 172.21.15.7:0/2676762432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91f80d0a50 msgr2=0x7f91f81f3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:54.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.207+0000 7f91fe4f8640 1 --2- 172.21.15.7:0/2676762432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91f80d0a50 0x7f91f81f3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:54.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.207+0000 7f91fe4f8640 1 -- 172.21.15.7:0/2676762432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f81f4650 con 0x7f91f80b53b0 2024-04-25T09:58:54.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.207+0000 7f91fdcf7640 1 --2- 172.21.15.7:0/2676762432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91f80d0a50 0x7f91f81f3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:58:54.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.207+0000 7f91fecf9640 1 --2- 172.21.15.7:0/2676762432 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f91f815db00 0x7f91f80c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:58:54.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.207+0000 7f91fe4f8640 1 --2- 172.21.15.7:0/2676762432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91f80b53b0 0x7f91f8156c90 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f91e800c760 tx=0x7f91e800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:54.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.207+0000 7f91f6ffd640 1 -- 172.21.15.7:0/2676762432 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e8003b70 con 0x7f91f80b53b0 2024-04-25T09:58:54.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.207+0000 7f91f6ffd640 1 -- 172.21.15.7:0/2676762432 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e8003d30 con 0x7f91f80b53b0 2024-04-25T09:58:54.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.207+0000 7f920075c640 1 -- 172.21.15.7:0/2676762432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f8155500 con 0x7f91f80b53b0 2024-04-25T09:58:54.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.207+0000 7f91f6ffd640 1 -- 172.21.15.7:0/2676762432 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e800aa90 con 0x7f91f80b53b0 2024-04-25T09:58:54.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.207+0000 7f920075c640 1 -- 172.21.15.7:0/2676762432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f81f4090 con 0x7f91f80b53b0 2024-04-25T09:58:54.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.208+0000 7f920075c640 1 -- 172.21.15.7:0/2676762432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f8068fd0 con 0x7f91f80b53b0 2024-04-25T09:58:54.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.208+0000 7f91f6ffd640 1 -- 172.21.15.7:0/2676762432 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f91e800ac30 con 0x7f91f80b53b0 2024-04-25T09:58:54.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.209+0000 7f91f6ffd640 1 --2- 172.21.15.7:0/2676762432 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f91e406b4d0 0x7f91e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:54.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.209+0000 7f91f6ffd640 1 -- 172.21.15.7:0/2676762432 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f91e808a2b0 con 0x7f91f80b53b0 2024-04-25T09:58:54.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.209+0000 7f91fdcf7640 1 --2- 172.21.15.7:0/2676762432 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f91e406b4d0 0x7f91e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:54.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.209+0000 7f91fdcf7640 1 --2- 172.21.15.7:0/2676762432 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f91e406b4d0 0x7f91e406d990 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f91ec034000 tx=0x7f91ec02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:54.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.213+0000 7f91f6ffd640 1 -- 172.21.15.7:0/2676762432 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f91f8155500 con 0x7f91f80b53b0 2024-04-25T09:58:54.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.464+0000 7f920075c640 1 -- 172.21.15.7:0/2676762432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f91f80d16b0 con 0x7f91f80b53b0 2024-04-25T09:58:54.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.466+0000 7f91f6ffd640 1 -- 172.21.15.7:0/2676762432 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+147 (secure 0 0 0) 0x7f91e8058fa0 con 0x7f91f80b53b0 2024-04-25T09:58:54.470 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2024-04-25T09:58:54.470 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAYKCpmaJKeORAALxC5ZqLLEu0zJFG+SOGukQ== 2024-04-25T09:58:54.470 INFO:teuthology.orchestra.run.smithi007.stdout: caps mds = "allow" 2024-04-25T09:58:54.470 INFO:teuthology.orchestra.run.smithi007.stdout: caps mon = "allow r" 2024-04-25T09:58:54.470 INFO:teuthology.orchestra.run.smithi007.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:58:54.471 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2024-04-25T09:58:54.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.468+0000 7f920075c640 1 -- 172.21.15.7:0/2676762432 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f91e406b4d0 msgr2=0x7f91e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:54.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.468+0000 7f920075c640 1 --2- 172.21.15.7:0/2676762432 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f91e406b4d0 0x7f91e406d990 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f91ec034000 tx=0x7f91ec02e000 comp rx=0 tx=0).stop 2024-04-25T09:58:54.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.468+0000 7f920075c640 1 -- 172.21.15.7:0/2676762432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91f80b53b0 msgr2=0x7f91f8156c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:54.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.468+0000 7f920075c640 1 --2- 172.21.15.7:0/2676762432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91f80b53b0 0x7f91f8156c90 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f91e800c760 tx=0x7f91e800cc20 comp rx=0 tx=0).stop 2024-04-25T09:58:54.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.468+0000 7f920075c640 1 -- 172.21.15.7:0/2676762432 shutdown_connections 2024-04-25T09:58:54.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.468+0000 7f920075c640 1 --2- 172.21.15.7:0/2676762432 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f91e406b4d0 0x7f91e406d990 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:54.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.468+0000 7f920075c640 1 --2- 172.21.15.7:0/2676762432 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f91f815db00 0x7f91f80c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:54.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.468+0000 7f920075c640 1 --2- 172.21.15.7:0/2676762432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91f80d0a50 0x7f91f81f3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:54.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.468+0000 7f920075c640 1 --2- 172.21.15.7:0/2676762432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91f80b53b0 0x7f91f8156c90 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:54.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.468+0000 7f920075c640 1 -- 172.21.15.7:0/2676762432 >> 172.21.15.7:0/2676762432 conn(0x7f91f8072290 msgr2=0x7f91f80d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:54.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.468+0000 7f920075c640 1 -- 172.21.15.7:0/2676762432 shutdown_connections 2024-04-25T09:58:54.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.468+0000 7f920075c640 1 -- 172.21.15.7:0/2676762432 wait complete. 2024-04-25T09:58:54.483 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:58:54.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.580+0000 7fe1a64cb640 1 Processor -- start 2024-04-25T09:58:54.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.580+0000 7fe1a64cb640 1 -- start start 2024-04-25T09:58:54.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.581+0000 7fe1a64cb640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe1a015da60 0x7fe1a00d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:54.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.581+0000 7fe1a64cb640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe1a015e2d0 0x7fe1a00ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:54.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.581+0000 7fe1a64cb640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a015e8a0 con 0x7fe1a015de40 2024-04-25T09:58:54.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.581+0000 7fe1a64cb640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1a015eb80 con 0x7fe1a015da60 2024-04-25T09:58:54.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.581+0000 7fe1a64cb640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a015ee60 con 0x7fe1a015e2d0 2024-04-25T09:58:54.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.581+0000 7fe19f7fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe1a015de40 0x7fe1a0161d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60014/0 (socket says 172.21.15.7:60014) 2024-04-25T09:58:54.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.581+0000 7fe19f7fe640 1 -- 172.21.15.7:0/389752527 learned_addr learned my addr 172.21.15.7:0/389752527 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:54.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.581+0000 7fe19ffff640 1 --2- 172.21.15.7:0/389752527 >> v2:172.21.15.7:3300/0 conn(0x7fe1a015da60 0x7fe1a00d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:54.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.581+0000 7fe1a4a68640 1 --2- 172.21.15.7:0/389752527 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe1a015e2d0 0x7fe1a00ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:54.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.582+0000 7fe19ffff640 1 -- 172.21.15.7:0/389752527 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe1a015e2d0 msgr2=0x7fe1a00ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:54.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.582+0000 7fe19ffff640 1 --2- 172.21.15.7:0/389752527 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe1a015e2d0 0x7fe1a00ce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:54.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.582+0000 7fe19ffff640 1 -- 172.21.15.7:0/389752527 >> v1:172.21.15.7:6789/0 conn(0x7fe1a015de40 legacy=0x7fe1a0161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:54.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.582+0000 7fe19effd640 1 -- 172.21.15.7:0/389752527 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3647362572 0 0) 0x7fe1a015e8a0 con 0x7fe1a015de40 2024-04-25T09:58:54.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.582+0000 7fe19ffff640 1 -- 172.21.15.7:0/389752527 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a0161850 con 0x7fe1a015da60 2024-04-25T09:58:54.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.582+0000 7fe19ffff640 1 --2- 172.21.15.7:0/389752527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1a015da60 0x7fe1a00d0aa0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fe1880097a0 tx=0x7fe18802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e19214fb74fa3b11 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:54.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.582+0000 7fe19effd640 1 -- 172.21.15.7:0/389752527 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe188037070 con 0x7fe1a015da60 2024-04-25T09:58:54.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.582+0000 7fe19effd640 1 -- 172.21.15.7:0/389752527 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18802ae50 con 0x7fe1a015da60 2024-04-25T09:58:54.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.582+0000 7fe19effd640 1 -- 172.21.15.7:0/389752527 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe188032660 con 0x7fe1a015da60 2024-04-25T09:58:54.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.583+0000 7fe1a64cb640 1 -- 172.21.15.7:0/389752527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1a015da60 msgr2=0x7fe1a00d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:54.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.583+0000 7fe1a64cb640 1 --2- 172.21.15.7:0/389752527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1a015da60 0x7fe1a00d0aa0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fe1880097a0 tx=0x7fe18802a100 comp rx=0 tx=0).stop 2024-04-25T09:58:54.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.583+0000 7fe1a64cb640 1 -- 172.21.15.7:0/389752527 shutdown_connections 2024-04-25T09:58:54.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.583+0000 7fe1a64cb640 1 --2- 172.21.15.7:0/389752527 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe1a015e2d0 0x7fe1a00ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:54.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.583+0000 7fe1a64cb640 1 --2- 172.21.15.7:0/389752527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1a015da60 0x7fe1a00d0aa0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:54.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.583+0000 7fe1a64cb640 1 -- 172.21.15.7:0/389752527 >> 172.21.15.7:0/389752527 conn(0x7fe1a006bfe0 msgr2=0x7fe1a006c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:54.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.583+0000 7fe1a64cb640 1 -- 172.21.15.7:0/389752527 shutdown_connections 2024-04-25T09:58:54.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.583+0000 7fe1a64cb640 1 -- 172.21.15.7:0/389752527 wait complete. 2024-04-25T09:58:54.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.584+0000 7fe1a64cb640 1 Processor -- start 2024-04-25T09:58:54.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.584+0000 7fe1a64cb640 1 -- start start 2024-04-25T09:58:54.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.585+0000 7fe1a64cb640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe1a015da60 0x7fe1a01f0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:54.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.585+0000 7fe1a64cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1a015de40 0x7fe1a01f74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:54.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.585+0000 7fe1a64cb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1a015e2d0 0x7fe1a00cfd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:54.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.585+0000 7fe1a64cb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a00cebe0 con 0x7fe1a015e2d0 2024-04-25T09:58:54.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.585+0000 7fe1a64cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a00cea60 con 0x7fe1a015de40 2024-04-25T09:58:54.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.585+0000 7fe1a64cb640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a00ced60 con 0x7fe1a015da60 2024-04-25T09:58:54.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.585+0000 7fe1a4a68640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1a015e2d0 0x7fe1a00cfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:54.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.585+0000 7fe1a4a68640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1a015e2d0 0x7fe1a00cfd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34694/0 (socket says 172.21.15.7:34694) 2024-04-25T09:58:54.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.585+0000 7fe1a4a68640 1 -- 172.21.15.7:0/902728495 learned_addr learned my addr 172.21.15.7:0/902728495 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:54.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.585+0000 7fe19f7fe640 1 --2- 172.21.15.7:0/902728495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1a015de40 0x7fe1a01f74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:54.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.585+0000 7fe19ffff640 1 --2- 172.21.15.7:0/902728495 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe1a015da60 0x7fe1a01f0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:54.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.586+0000 7fe1a4a68640 1 -- 172.21.15.7:0/902728495 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe1a015da60 msgr2=0x7fe1a01f0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:54.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.586+0000 7fe1a4a68640 1 --2- 172.21.15.7:0/902728495 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe1a015da60 0x7fe1a01f0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:54.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.586+0000 7fe1a4a68640 1 -- 172.21.15.7:0/902728495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1a015de40 msgr2=0x7fe1a01f74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:54.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.586+0000 7fe1a4a68640 1 --2- 172.21.15.7:0/902728495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1a015de40 0x7fe1a01f74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:54.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.586+0000 7fe1a4a68640 1 -- 172.21.15.7:0/902728495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a01f79e0 con 0x7fe1a015e2d0 2024-04-25T09:58:54.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.586+0000 7fe19f7fe640 1 --2- 172.21.15.7:0/902728495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1a015de40 0x7fe1a01f74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:54.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.586+0000 7fe1a4a68640 1 --2- 172.21.15.7:0/902728495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1a015e2d0 0x7fe1a00cfd90 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fe198007e40 tx=0x7fe19800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:54.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.586+0000 7fe19cff9640 1 -- 172.21.15.7:0/902728495 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe198014620 con 0x7fe1a015e2d0 2024-04-25T09:58:54.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.586+0000 7fe19cff9640 1 -- 172.21.15.7:0/902728495 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe198019070 con 0x7fe1a015e2d0 2024-04-25T09:58:54.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.586+0000 7fe19cff9640 1 -- 172.21.15.7:0/902728495 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe198014a20 con 0x7fe1a015e2d0 2024-04-25T09:58:54.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.586+0000 7fe1a64cb640 1 -- 172.21.15.7:0/902728495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a01f3840 con 0x7fe1a015e2d0 2024-04-25T09:58:54.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.586+0000 7fe1a64cb640 1 -- 172.21.15.7:0/902728495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a01f3e00 con 0x7fe1a015e2d0 2024-04-25T09:58:54.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.587+0000 7fe1a64cb640 1 -- 172.21.15.7:0/902728495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a00d0eb0 con 0x7fe1a015e2d0 2024-04-25T09:58:54.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.587+0000 7fe19cff9640 1 -- 172.21.15.7:0/902728495 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe198014bc0 con 0x7fe1a015e2d0 2024-04-25T09:58:54.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.588+0000 7fe19cff9640 1 --2- 172.21.15.7:0/902728495 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe18006b4d0 0x7fe18006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:54.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.588+0000 7fe19cff9640 1 -- 172.21.15.7:0/902728495 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe19808ac40 con 0x7fe1a015e2d0 2024-04-25T09:58:54.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.588+0000 7fe19ffff640 1 --2- 172.21.15.7:0/902728495 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe18006b4d0 0x7fe18006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:54.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.588+0000 7fe19ffff640 1 --2- 172.21.15.7:0/902728495 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe18006b4d0 0x7fe18006d990 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe188034000 tx=0x7fe18802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:54.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.592+0000 7fe19cff9640 1 -- 172.21.15.7:0/902728495 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe1a01f79e0 con 0x7fe1a015e2d0 2024-04-25T09:58:54.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.811+0000 7fe1a64cb640 1 -- 172.21.15.7:0/902728495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1a0068fd0 con 0x7fe1a015e2d0 2024-04-25T09:58:54.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.811+0000 7fe19cff9640 1 -- 172.21.15.7:0/902728495 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4934 (secure 0 0 0) 0x7fe1980599c0 con 0x7fe1a015e2d0 2024-04-25T09:58:54.816 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:58:54.816 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":37,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1781470369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1781470369},{"type":"v1","addr":"172.21.15.55:6835","nonce":1781470369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6810,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1839614891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1839614891},{"type":"v1","addr":"172.21.15.7:6835","nonce":1839614891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6813,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3690076929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3690076929},{"type":"v1","addr":"172.21.15.7:6837","nonce":3690076929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:58:45.628406+0000","modified":"2024-04-25T09:58:47.654904+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6819},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6819":{"gid":6819,"name":"b","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6834/1012943595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1012943595},{"type":"v1","addr":"172.21.15.55:6834","nonce":1012943595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:58:54.816 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 37 2024-04-25T09:58:54.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.813+0000 7fe1a64cb640 1 -- 172.21.15.7:0/902728495 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe18006b4d0 msgr2=0x7fe18006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:54.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.813+0000 7fe1a64cb640 1 --2- 172.21.15.7:0/902728495 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe18006b4d0 0x7fe18006d990 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe188034000 tx=0x7fe18802e000 comp rx=0 tx=0).stop 2024-04-25T09:58:54.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.813+0000 7fe1a64cb640 1 -- 172.21.15.7:0/902728495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1a015e2d0 msgr2=0x7fe1a00cfd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:54.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.813+0000 7fe1a64cb640 1 --2- 172.21.15.7:0/902728495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1a015e2d0 0x7fe1a00cfd90 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fe198007e40 tx=0x7fe19800e4b0 comp rx=0 tx=0).stop 2024-04-25T09:58:54.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.813+0000 7fe1a64cb640 1 -- 172.21.15.7:0/902728495 shutdown_connections 2024-04-25T09:58:54.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.813+0000 7fe1a64cb640 1 --2- 172.21.15.7:0/902728495 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe18006b4d0 0x7fe18006d990 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:54.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.813+0000 7fe1a64cb640 1 --2- 172.21.15.7:0/902728495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1a015e2d0 0x7fe1a00cfd90 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:54.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.813+0000 7fe1a64cb640 1 --2- 172.21.15.7:0/902728495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1a015de40 0x7fe1a01f74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:54.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.813+0000 7fe1a64cb640 1 --2- 172.21.15.7:0/902728495 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe1a015da60 0x7fe1a01f0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:54.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.813+0000 7fe1a64cb640 1 -- 172.21.15.7:0/902728495 >> 172.21.15.7:0/902728495 conn(0x7fe1a006bfe0 msgr2=0x7fe1a0160440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:54.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.813+0000 7fe1a64cb640 1 -- 172.21.15.7:0/902728495 shutdown_connections 2024-04-25T09:58:54.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:54.813+0000 7fe1a64cb640 1 -- 172.21.15.7:0/902728495 wait complete. 2024-04-25T09:58:55.231 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 37, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:58:45.628406+0000', 'modified': '2024-04-25T09:58:47.654904+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6819}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6819': {'gid': 6819, 'name': 'b', 'rank': 0, 'incarnation': 35, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6834/1012943595', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6832', 'nonce': 1012943595}, {'type': 'v1', 'addr': '172.21.15.55:6834', 'nonce': 1012943595}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:58:55.232 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:58:55.232 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T09:58:55.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.334+0000 7f3b9e170640 1 Processor -- start 2024-04-25T09:58:55.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.334+0000 7f3b9e170640 1 -- start start 2024-04-25T09:58:55.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.335+0000 7f3b9e170640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3b9815b8e0 0x7f3b980d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:55.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.335+0000 7f3b9e170640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3b980cc300 0x7f3b980999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:55.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.335+0000 7f3b9e170640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b9809a330 con 0x7f3b98099f30 2024-04-25T09:58:55.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.335+0000 7f3b9e170640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b980cd7d0 con 0x7f3b9815b8e0 2024-04-25T09:58:55.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.335+0000 7f3b9e170640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b980ccbc0 con 0x7f3b980cc300 2024-04-25T09:58:55.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.335+0000 7f3b977fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3b9815b8e0 0x7f3b980d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:55.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.335+0000 7f3b97fff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3b98099f30 0x7f3b9815f520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60022/0 (socket says 172.21.15.7:60022) 2024-04-25T09:58:55.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.335+0000 7f3b97fff640 1 -- 172.21.15.7:0/1597493938 learned_addr learned my addr 172.21.15.7:0/1597493938 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:55.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.335+0000 7f3b96ffd640 1 --2- 172.21.15.7:0/1597493938 >> v2:172.21.15.55:3300/0 conn(0x7f3b980cc300 0x7f3b980999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:55.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.335+0000 7f3b977fe640 1 -- 172.21.15.7:0/1597493938 >> v2:172.21.15.55:3300/0 conn(0x7f3b980cc300 msgr2=0x7f3b980999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:55.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.335+0000 7f3b977fe640 1 --2- 172.21.15.7:0/1597493938 >> v2:172.21.15.55:3300/0 conn(0x7f3b980cc300 0x7f3b980999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.335+0000 7f3b977fe640 1 -- 172.21.15.7:0/1597493938 >> v1:172.21.15.7:6789/0 conn(0x7f3b98099f30 legacy=0x7f3b9815f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:55.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.335+0000 7f3b977fe640 1 -- 172.21.15.7:0/1597493938 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b980ccea0 con 0x7f3b9815b8e0 2024-04-25T09:58:55.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.335+0000 7f3b967fc640 1 -- 172.21.15.7:0/1597493938 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2956792134 0 0) 0x7f3b9809a330 con 0x7f3b98099f30 2024-04-25T09:58:55.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.335+0000 7f3b96ffd640 1 --2- 172.21.15.7:0/1597493938 >> v2:172.21.15.55:3300/0 conn(0x7f3b980cc300 0x7f3b980999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:58:55.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.336+0000 7f3b977fe640 1 --2- 172.21.15.7:0/1597493938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b9815b8e0 0x7f3b980d0330 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f3b98072f90 tx=0x7f3b8802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e174ce4ff16bfe5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:55.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.336+0000 7f3b967fc640 1 -- 172.21.15.7:0/1597493938 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b88037070 con 0x7f3b9815b8e0 2024-04-25T09:58:55.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.336+0000 7f3b967fc640 1 -- 172.21.15.7:0/1597493938 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b88032440 con 0x7f3b9815b8e0 2024-04-25T09:58:55.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.336+0000 7f3b967fc640 1 -- 172.21.15.7:0/1597493938 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b88032810 con 0x7f3b9815b8e0 2024-04-25T09:58:55.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.336+0000 7f3b9e170640 1 -- 172.21.15.7:0/1597493938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b9815b8e0 msgr2=0x7f3b980d0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:55.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.336+0000 7f3b9e170640 1 --2- 172.21.15.7:0/1597493938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b9815b8e0 0x7f3b980d0330 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f3b98072f90 tx=0x7f3b8802a1a0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.337+0000 7f3b9e170640 1 -- 172.21.15.7:0/1597493938 shutdown_connections 2024-04-25T09:58:55.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.337+0000 7f3b9e170640 1 --2- 172.21.15.7:0/1597493938 >> v2:172.21.15.55:3300/0 conn(0x7f3b980cc300 0x7f3b980999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.337+0000 7f3b9e170640 1 --2- 172.21.15.7:0/1597493938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b9815b8e0 0x7f3b980d0330 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.337+0000 7f3b9e170640 1 -- 172.21.15.7:0/1597493938 >> 172.21.15.7:0/1597493938 conn(0x7f3b980b3130 msgr2=0x7f3b980b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:55.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.337+0000 7f3b9e170640 1 -- 172.21.15.7:0/1597493938 shutdown_connections 2024-04-25T09:58:55.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.337+0000 7f3b9e170640 1 -- 172.21.15.7:0/1597493938 wait complete. 2024-04-25T09:58:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.338+0000 7f3b9e170640 1 Processor -- start 2024-04-25T09:58:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.338+0000 7f3b9e170640 1 -- start start 2024-04-25T09:58:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.339+0000 7f3b9e170640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b98099f30 0x7f3b981554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.339+0000 7f3b9e170640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b980cc300 0x7f3b980aed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.339+0000 7f3b9e170640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3b9815b8e0 0x7f3b9806f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.339+0000 7f3b9e170640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9815bcc0 con 0x7f3b98099f30 2024-04-25T09:58:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.339+0000 7f3b9e170640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b980cd460 con 0x7f3b980cc300 2024-04-25T09:58:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.339+0000 7f3b9e170640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9815be40 con 0x7f3b9815b8e0 2024-04-25T09:58:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.339+0000 7f3b977fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b98099f30 0x7f3b981554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.339+0000 7f3b977fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b98099f30 0x7f3b981554a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34718/0 (socket says 172.21.15.7:34718) 2024-04-25T09:58:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.339+0000 7f3b977fe640 1 -- 172.21.15.7:0/2611107749 learned_addr learned my addr 172.21.15.7:0/2611107749 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.339+0000 7f3b96ffd640 1 --2- 172.21.15.7:0/2611107749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b980cc300 0x7f3b980aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.339+0000 7f3b97fff640 1 --2- 172.21.15.7:0/2611107749 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3b9815b8e0 0x7f3b9806f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:55.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.339+0000 7f3b977fe640 1 -- 172.21.15.7:0/2611107749 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3b9815b8e0 msgr2=0x7f3b9806f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:55.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.339+0000 7f3b977fe640 1 --2- 172.21.15.7:0/2611107749 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3b9815b8e0 0x7f3b9806f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.339+0000 7f3b977fe640 1 -- 172.21.15.7:0/2611107749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b980cc300 msgr2=0x7f3b980aed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:55.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.339+0000 7f3b977fe640 1 --2- 172.21.15.7:0/2611107749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b980cc300 0x7f3b980aed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.339+0000 7f3b977fe640 1 -- 172.21.15.7:0/2611107749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b980b6140 con 0x7f3b98099f30 2024-04-25T09:58:55.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.339+0000 7f3b977fe640 1 --2- 172.21.15.7:0/2611107749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b98099f30 0x7f3b981554a0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f3b88000c00 tx=0x7f3b880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:55.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.339+0000 7f3b7ffff640 1 -- 172.21.15.7:0/2611107749 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b88037040 con 0x7f3b98099f30 2024-04-25T09:58:55.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.339+0000 7f3b9e170640 1 -- 172.21.15.7:0/2611107749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b980b6420 con 0x7f3b98099f30 2024-04-25T09:58:55.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.339+0000 7f3b7ffff640 1 -- 172.21.15.7:0/2611107749 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b88042070 con 0x7f3b98099f30 2024-04-25T09:58:55.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.339+0000 7f3b7ffff640 1 -- 172.21.15.7:0/2611107749 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b88030a50 con 0x7f3b98099f30 2024-04-25T09:58:55.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.340+0000 7f3b9e170640 1 -- 172.21.15.7:0/2611107749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b980b69e0 con 0x7f3b98099f30 2024-04-25T09:58:55.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.341+0000 7f3b7ffff640 1 -- 172.21.15.7:0/2611107749 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3b88030bf0 con 0x7f3b98099f30 2024-04-25T09:58:55.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.342+0000 7f3b7ffff640 1 --2- 172.21.15.7:0/2611107749 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3b8406b4d0 0x7f3b8406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:55.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.342+0000 7f3b7ffff640 1 -- 172.21.15.7:0/2611107749 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3b880aae10 con 0x7f3b98099f30 2024-04-25T09:58:55.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.342+0000 7f3b96ffd640 1 --2- 172.21.15.7:0/2611107749 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3b8406b4d0 0x7f3b8406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:55.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.342+0000 7f3b96ffd640 1 --2- 172.21.15.7:0/2611107749 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3b8406b4d0 0x7f3b8406d990 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3b98070540 tx=0x7f3b8c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:55.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.342+0000 7f3ba0e7c740 1 Processor -- start 2024-04-25T09:58:55.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.342+0000 7f3ba0e7c740 1 -- start start 2024-04-25T09:58:55.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.343+0000 7f3ba0e7c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dc6726230 0x562dc6726610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:55.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.343+0000 7f3ba0e7c740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562dc6743ad0 0x562dc6744020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:55.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.343+0000 7f3ba0e7c740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc66fbf10 0x562dc6742190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:55.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.343+0000 7f3ba0e7c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc665ea10 con 0x562dc6726230 2024-04-25T09:58:55.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.343+0000 7f3ba0e7c740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc6607b30 con 0x562dc66fbf10 2024-04-25T09:58:55.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.343+0000 7f3ba0e7c740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x562dc665ac50 con 0x562dc6743ad0 2024-04-25T09:58:55.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.343+0000 7f3b977fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dc6726230 0x562dc6726610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:55.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.343+0000 7f3b977fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dc6726230 0x562dc6726610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34728/0 (socket says 172.21.15.7:34728) 2024-04-25T09:58:55.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.343+0000 7f3b977fe640 1 -- 172.21.15.7:0/3341422756 learned_addr learned my addr 172.21.15.7:0/3341422756 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:55.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.344+0000 7f3b977fe640 1 -- 172.21.15.7:0/3341422756 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562dc6743ad0 msgr2=0x562dc6744020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:55.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.344+0000 7f3b977fe640 1 --2- 172.21.15.7:0/3341422756 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562dc6743ad0 0x562dc6744020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.344+0000 7f3b977fe640 1 -- 172.21.15.7:0/3341422756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc66fbf10 msgr2=0x562dc6742190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:55.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.344+0000 7f3b97fff640 1 --2- 172.21.15.7:0/3341422756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc66fbf10 0x562dc6742190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:55.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.344+0000 7f3b977fe640 1 --2- 172.21.15.7:0/3341422756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc66fbf10 0x562dc6742190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.344+0000 7f3b977fe640 1 -- 172.21.15.7:0/3341422756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562dc661ce10 con 0x562dc6726230 2024-04-25T09:58:55.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.344+0000 7f3b97fff640 1 --2- 172.21.15.7:0/3341422756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc66fbf10 0x562dc6742190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:58:55.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.344+0000 7f3b977fe640 1 --2- 172.21.15.7:0/3341422756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dc6726230 0x562dc6726610 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f3b88081710 tx=0x7f3b88078e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5888e2b7a3cb62f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:55.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.344+0000 7f3b7d7fa640 1 -- 172.21.15.7:0/3341422756 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b88079530 con 0x562dc6726230 2024-04-25T09:58:55.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.344+0000 7f3b7d7fa640 1 -- 172.21.15.7:0/3341422756 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8807d680 con 0x562dc6726230 2024-04-25T09:58:55.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.344+0000 7f3b7d7fa640 1 -- 172.21.15.7:0/3341422756 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b88081c40 con 0x562dc6726230 2024-04-25T09:58:55.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.345+0000 7f3ba0e7c740 1 -- 172.21.15.7:0/3341422756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dc6726230 msgr2=0x562dc6726610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.345+0000 7f3ba0e7c740 1 --2- 172.21.15.7:0/3341422756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dc6726230 0x562dc6726610 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f3b88081710 tx=0x7f3b88078e90 comp rx=0 tx=0).stop 2024-04-25T09:58:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.345+0000 7f3ba0e7c740 1 -- 172.21.15.7:0/3341422756 shutdown_connections 2024-04-25T09:58:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.345+0000 7f3ba0e7c740 1 --2- 172.21.15.7:0/3341422756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc66fbf10 0x562dc6742190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.345+0000 7f3ba0e7c740 1 --2- 172.21.15.7:0/3341422756 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562dc6743ad0 0x562dc6744020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.345+0000 7f3ba0e7c740 1 --2- 172.21.15.7:0/3341422756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dc6726230 0x562dc6726610 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.345+0000 7f3ba0e7c740 1 -- 172.21.15.7:0/3341422756 >> 172.21.15.7:0/3341422756 conn(0x562dc66f8840 msgr2=0x562dc6741040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.345+0000 7f3ba0e7c740 1 -- 172.21.15.7:0/3341422756 shutdown_connections 2024-04-25T09:58:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.345+0000 7f3ba0e7c740 1 -- 172.21.15.7:0/3341422756 wait complete. 2024-04-25T09:58:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.345+0000 7f3ba0e7c740 1 -- start start 2024-04-25T09:58:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.345+0000 7f3ba0e7c740 1 Processor -- start 2024-04-25T09:58:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.346+0000 7f3ba0e7c740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562dc6726230 0x562dc6729f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.346+0000 7f3ba0e7c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dc6743ad0 0x562dc671e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.346+0000 7f3ba0e7c740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc6754160 0x562dc67396d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.346+0000 7f3ba0e7c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc665ea10 con 0x562dc6743ad0 2024-04-25T09:58:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.346+0000 7f3ba0e7c740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc661b0c0 con 0x562dc6754160 2024-04-25T09:58:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.346+0000 7f3ba0e7c740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x562dc66fccb0 con 0x562dc6726230 2024-04-25T09:58:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.346+0000 7f3ba0e7c740 10 client.0 _ll_register_callbacks cb 0x562dc660eec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:58:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.346+0000 7f3b96ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dc6743ad0 0x562dc671e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.346+0000 7f3b96ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dc6743ad0 0x562dc671e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34734/0 (socket says 172.21.15.7:34734) 2024-04-25T09:58:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.346+0000 7f3b96ffd640 1 -- 172.21.15.7:0/1869126671 learned_addr learned my addr 172.21.15.7:0/1869126671 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.346+0000 7f3b977fe640 1 --2- 172.21.15.7:0/1869126671 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562dc6726230 0x562dc6729f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.346+0000 7f3b97fff640 1 --2- 172.21.15.7:0/1869126671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc6754160 0x562dc67396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.347+0000 7f3b96ffd640 1 -- 172.21.15.7:0/1869126671 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562dc6726230 msgr2=0x562dc6729f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.347+0000 7f3b96ffd640 1 --2- 172.21.15.7:0/1869126671 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562dc6726230 0x562dc6729f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.347+0000 7f3b96ffd640 1 -- 172.21.15.7:0/1869126671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc6754160 msgr2=0x562dc67396d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.347+0000 7f3b96ffd640 1 --2- 172.21.15.7:0/1869126671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc6754160 0x562dc67396d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.347+0000 7f3b96ffd640 1 -- 172.21.15.7:0/1869126671 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562dc63732d0 con 0x562dc6743ad0 2024-04-25T09:58:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.347+0000 7f3b96ffd640 1 --2- 172.21.15.7:0/1869126671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dc6743ad0 0x562dc671e440 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00ffc0 tx=0x7f3b8c014830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc8065fb717c79c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.347+0000 7f3b767fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:58:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.347+0000 7f3b767fc640 1 -- 172.21.15.7:0/1869126671 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c025060 con 0x562dc6743ad0 2024-04-25T09:58:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.347+0000 7f3b767fc640 1 -- 172.21.15.7:0/1869126671 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3b8c015820 con 0x562dc6743ad0 2024-04-25T09:58:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.347+0000 7f3ba0e7c740 1 -- 172.21.15.7:0/1869126671 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3b8807d680 con 0x562dc6743ad0 2024-04-25T09:58:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.347+0000 7f3b767fc640 1 -- 172.21.15.7:0/1869126671 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b8c02b050 con 0x562dc6743ad0 2024-04-25T09:58:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.347+0000 7f3ba0e7c740 10 client.6996 fetch_fsmap learned FSMap version 37 2024-04-25T09:58:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.347+0000 7f3ba0e7c740 1 -- 172.21.15.7:0/1869126671 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x562dc643d6b0 con 0x562dc6743ad0 2024-04-25T09:58:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.347+0000 7f3b767fc640 1 -- 172.21.15.7:0/1869126671 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8807d680 con 0x562dc6743ad0 2024-04-25T09:58:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.347+0000 7f3b767fc640 1 -- 172.21.15.7:0/1869126671 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 37) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3b8c02e020 con 0x562dc6743ad0 2024-04-25T09:58:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.347+0000 7f3ba0e7c740 10 client.6996 fetch_fsmap finished waiting for FSMap version 37 2024-04-25T09:58:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.347+0000 7f3ba0e7c740 10 client.6996 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T09:58:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.347+0000 7f3ba0e7c740 20 client.6996 populate_metadata read hostname 'smithi007' 2024-04-25T09:58:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.347+0000 7f3ba0e7c740 1 --2- 172.21.15.7:0/1869126671 >> [v2:172.21.15.55:6832/1012943595,v1:172.21.15.55:6834/1012943595] conn(0x562dc67274a0 0x562dc6727880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.347+0000 7f3ba0e7c740 4 client.6996 mds_command: new command op to 6819 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:58:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.347+0000 7f3ba0e7c740 1 -- 172.21.15.7:0/1869126671 --> [v2:172.21.15.55:6832/1012943595,v1:172.21.15.55:6834/1012943595] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562dc66bd920 con 0x562dc67274a0 2024-04-25T09:58:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.348+0000 7f3b977fe640 1 --2- 172.21.15.7:0/1869126671 >> [v2:172.21.15.55:6832/1012943595,v1:172.21.15.55:6834/1012943595] conn(0x562dc67274a0 0x562dc6727880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.348+0000 7f3b977fe640 1 --2- 172.21.15.7:0/1869126671 >> [v2:172.21.15.55:6832/1012943595,v1:172.21.15.55:6834/1012943595] conn(0x562dc67274a0 0x562dc6727880 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea27d5ff92095cad server_cookie=f8dec6d770299235 in_seq=0 out_seq=0 2024-04-25T09:58:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.348+0000 7f3b767fc640 10 client.6996 ms_handle_connect on v2:172.21.15.55:6832/1012943595 2024-04-25T09:58:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.349+0000 7f3b767fc640 1 -- 172.21.15.7:0/1869126671 <== mds.0 v2:172.21.15.55:6832/1012943595 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562dc66bd920 con 0x562dc67274a0 2024-04-25T09:58:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.349+0000 7f3b767fc640 10 client.6996 handle_command_reply: tid=0 2024-04-25T09:58:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.349+0000 7f3ba0e7c740 1 client.6996 shutdown 2024-04-25T09:58:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.349+0000 7f3ba0e7c740 1 -- 172.21.15.7:0/1869126671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dc6743ad0 msgr2=0x562dc671e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.349+0000 7f3ba0e7c740 1 --2- 172.21.15.7:0/1869126671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dc6743ad0 0x562dc671e440 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00ffc0 tx=0x7f3b8c014830 comp rx=0 tx=0).stop 2024-04-25T09:58:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.349+0000 7f3ba0e7c740 1 -- 172.21.15.7:0/1869126671 shutdown_connections 2024-04-25T09:58:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.349+0000 7f3ba0e7c740 1 --2- 172.21.15.7:0/1869126671 >> [v2:172.21.15.55:6832/1012943595,v1:172.21.15.55:6834/1012943595] conn(0x562dc67274a0 0x562dc6727880 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.349+0000 7f3ba0e7c740 1 --2- 172.21.15.7:0/1869126671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc6754160 0x562dc67396d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.349+0000 7f3ba0e7c740 1 --2- 172.21.15.7:0/1869126671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dc6743ad0 0x562dc671e440 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.349+0000 7f3ba0e7c740 1 --2- 172.21.15.7:0/1869126671 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562dc6726230 0x562dc6729f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.349+0000 7f3b767fc640 0 client.6996 ms_handle_reset on v2:172.21.15.55:6832/1012943595 2024-04-25T09:58:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.349+0000 7f3ba0e7c740 1 -- 172.21.15.7:0/1869126671 >> 172.21.15.7:0/1869126671 conn(0x562dc66fbf10 msgr2=0x562dc66fb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.349+0000 7f3ba0e7c740 1 -- 172.21.15.7:0/1869126671 shutdown_connections 2024-04-25T09:58:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.349+0000 7f3ba0e7c740 1 -- 172.21.15.7:0/1869126671 wait complete. 2024-04-25T09:58:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.349+0000 7f3ba0e7c740 20 client.6996 trim_cache size 0 max 16384 2024-04-25T09:58:55.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.365+0000 7f3ba0e7c740 1 Processor -- start 2024-04-25T09:58:55.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.365+0000 7f3ba0e7c740 1 -- start start 2024-04-25T09:58:55.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.366+0000 7f3ba0e7c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dc6726230 0x562dc66fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:55.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.366+0000 7f3ba0e7c740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562dc6743ad0 0x562dc66fc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:55.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.366+0000 7f3ba0e7c740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc6754160 0x562dc6729550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:55.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.366+0000 7f3ba0e7c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b981fd130 con 0x562dc6726230 2024-04-25T09:58:55.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.366+0000 7f3ba0e7c740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9815cbd0 con 0x562dc6754160 2024-04-25T09:58:55.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.366+0000 7f3ba0e7c740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9815d1d0 con 0x562dc6743ad0 2024-04-25T09:58:55.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.366+0000 7f3b977fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dc6726230 0x562dc66fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:55.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.366+0000 7f3b977fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dc6726230 0x562dc66fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34744/0 (socket says 172.21.15.7:34744) 2024-04-25T09:58:55.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.366+0000 7f3b977fe640 1 -- 172.21.15.7:0/375911888 learned_addr learned my addr 172.21.15.7:0/375911888 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:55.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.366+0000 7f3b97fff640 1 --2- 172.21.15.7:0/375911888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc6754160 0x562dc6729550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:55.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.366+0000 7f3b96ffd640 1 --2- 172.21.15.7:0/375911888 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562dc6743ad0 0x562dc66fc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:55.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.366+0000 7f3b977fe640 1 -- 172.21.15.7:0/375911888 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562dc6743ad0 msgr2=0x562dc66fc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:55.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.366+0000 7f3b977fe640 1 --2- 172.21.15.7:0/375911888 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562dc6743ad0 0x562dc66fc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.366+0000 7f3b977fe640 1 -- 172.21.15.7:0/375911888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc6754160 msgr2=0x562dc6729550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:55.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.366+0000 7f3b977fe640 1 --2- 172.21.15.7:0/375911888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc6754160 0x562dc6729550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.366+0000 7f3b977fe640 1 -- 172.21.15.7:0/375911888 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562dc66f8e60 con 0x562dc6726230 2024-04-25T09:58:55.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.366+0000 7f3b97fff640 1 --2- 172.21.15.7:0/375911888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc6754160 0x562dc6729550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:58:55.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.366+0000 7f3b96ffd640 1 --2- 172.21.15.7:0/375911888 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562dc6743ad0 0x562dc66fc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:58:55.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.367+0000 7f3b977fe640 1 --2- 172.21.15.7:0/375911888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dc6726230 0x562dc66fc2f0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f3b880a9210 tx=0x7f3b88078fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec2b6ca07d5eb06 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:55.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.367+0000 7f3b7cff9640 1 -- 172.21.15.7:0/375911888 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8807d680 con 0x562dc6726230 2024-04-25T09:58:55.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.367+0000 7f3b7cff9640 1 -- 172.21.15.7:0/375911888 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b88079530 con 0x562dc6726230 2024-04-25T09:58:55.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.367+0000 7f3b7cff9640 1 -- 172.21.15.7:0/375911888 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b88075ba0 con 0x562dc6726230 2024-04-25T09:58:55.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.367+0000 7f3ba0e7c740 1 -- 172.21.15.7:0/375911888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dc6726230 msgr2=0x562dc66fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:55.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.367+0000 7f3ba0e7c740 1 --2- 172.21.15.7:0/375911888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dc6726230 0x562dc66fc2f0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f3b880a9210 tx=0x7f3b88078fc0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.367+0000 7f3ba0e7c740 1 -- 172.21.15.7:0/375911888 shutdown_connections 2024-04-25T09:58:55.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.367+0000 7f3ba0e7c740 1 --2- 172.21.15.7:0/375911888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc6754160 0x562dc6729550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.367+0000 7f3ba0e7c740 1 --2- 172.21.15.7:0/375911888 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562dc6743ad0 0x562dc66fc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.367+0000 7f3ba0e7c740 1 --2- 172.21.15.7:0/375911888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dc6726230 0x562dc66fc2f0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.367+0000 7f3ba0e7c740 1 -- 172.21.15.7:0/375911888 >> 172.21.15.7:0/375911888 conn(0x562dc66fbf10 msgr2=0x562dc67281b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:55.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.367+0000 7f3ba0e7c740 1 -- 172.21.15.7:0/375911888 shutdown_connections 2024-04-25T09:58:55.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.367+0000 7f3ba0e7c740 1 -- 172.21.15.7:0/375911888 wait complete. 2024-04-25T09:58:55.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.368+0000 7f3ba0e7c740 1 -- start start 2024-04-25T09:58:55.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.368+0000 7f3ba0e7c740 1 Processor -- start 2024-04-25T09:58:55.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.369+0000 7f3ba0e7c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dc6726230 0x562dc6729930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:55.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.369+0000 7f3ba0e7c740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562dc6743ad0 0x562dc6729e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:55.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.369+0000 7f3ba0e7c740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc6754160 0x562dc66fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:55.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.369+0000 7f3ba0e7c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc672a480 con 0x562dc6726230 2024-04-25T09:58:55.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.369+0000 7f3ba0e7c740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc67391b0 con 0x562dc6754160 2024-04-25T09:58:55.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.369+0000 7f3ba0e7c740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x562dc6725130 con 0x562dc6743ad0 2024-04-25T09:58:55.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.369+0000 7f3ba0e7c740 10 client.0 _ll_register_callbacks cb 0x562dc66f6c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:58:55.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.369+0000 7f3b977fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dc6726230 0x562dc6729930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:55.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.369+0000 7f3b977fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dc6726230 0x562dc6729930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34748/0 (socket says 172.21.15.7:34748) 2024-04-25T09:58:55.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.369+0000 7f3b977fe640 1 -- 172.21.15.7:0/1059950531 learned_addr learned my addr 172.21.15.7:0/1059950531 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:55.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.369+0000 7f3b97fff640 1 --2- 172.21.15.7:0/1059950531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc6754160 0x562dc66fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:55.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.369+0000 7f3b96ffd640 1 --2- 172.21.15.7:0/1059950531 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562dc6743ad0 0x562dc6729e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:55.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.369+0000 7f3b977fe640 1 -- 172.21.15.7:0/1059950531 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562dc6743ad0 msgr2=0x562dc6729e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:55.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.369+0000 7f3b977fe640 1 --2- 172.21.15.7:0/1059950531 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562dc6743ad0 0x562dc6729e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.369+0000 7f3b977fe640 1 -- 172.21.15.7:0/1059950531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc6754160 msgr2=0x562dc66fc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:55.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.369+0000 7f3b977fe640 1 --2- 172.21.15.7:0/1059950531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc6754160 0x562dc66fc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.369+0000 7f3b977fe640 1 -- 172.21.15.7:0/1059950531 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562dc6740e40 con 0x562dc6726230 2024-04-25T09:58:55.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.369+0000 7f3b977fe640 1 --2- 172.21.15.7:0/1059950531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dc6726230 0x562dc6729930 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f3b880794c0 tx=0x7f3b88049070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17599ecf9c68f52 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:55.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.369+0000 7f3b767fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:58:55.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.369+0000 7f3b767fc640 1 -- 172.21.15.7:0/1059950531 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b88079790 con 0x562dc6726230 2024-04-25T09:58:55.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.369+0000 7f3b767fc640 1 -- 172.21.15.7:0/1059950531 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3b88079930 con 0x562dc6726230 2024-04-25T09:58:55.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.369+0000 7f3ba0e7c740 1 -- 172.21.15.7:0/1059950531 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3b88079530 con 0x562dc6726230 2024-04-25T09:58:55.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.369+0000 7f3b767fc640 1 -- 172.21.15.7:0/1059950531 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b880817b0 con 0x562dc6726230 2024-04-25T09:58:55.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.369+0000 7f3ba0e7c740 10 client.7002 fetch_fsmap learned FSMap version 37 2024-04-25T09:58:55.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.370+0000 7f3ba0e7c740 1 -- 172.21.15.7:0/1059950531 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x562dc6724880 con 0x562dc6726230 2024-04-25T09:58:55.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.370+0000 7f3b767fc640 1 -- 172.21.15.7:0/1059950531 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b88079530 con 0x562dc6726230 2024-04-25T09:58:55.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.370+0000 7f3b767fc640 1 -- 172.21.15.7:0/1059950531 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 37) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3b8803a030 con 0x562dc6726230 2024-04-25T09:58:55.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.370+0000 7f3ba0e7c740 10 client.7002 fetch_fsmap finished waiting for FSMap version 37 2024-04-25T09:58:55.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.370+0000 7f3ba0e7c740 10 client.7002 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T09:58:55.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.370+0000 7f3ba0e7c740 20 client.7002 populate_metadata read hostname 'smithi007' 2024-04-25T09:58:55.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.370+0000 7f3ba0e7c740 1 --2- 172.21.15.7:0/1059950531 >> [v2:172.21.15.55:6832/1012943595,v1:172.21.15.55:6834/1012943595] conn(0x562dc67ac010 0x562dc67ac3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:55.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.370+0000 7f3ba0e7c740 4 client.7002 mds_command: new command op to 6819 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:58:55.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.370+0000 7f3ba0e7c740 1 -- 172.21.15.7:0/1059950531 --> [v2:172.21.15.55:6832/1012943595,v1:172.21.15.55:6834/1012943595] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562dc666bf50 con 0x562dc67ac010 2024-04-25T09:58:55.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.370+0000 7f3b96ffd640 1 --2- 172.21.15.7:0/1059950531 >> [v2:172.21.15.55:6832/1012943595,v1:172.21.15.55:6834/1012943595] conn(0x562dc67ac010 0x562dc67ac3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:55.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.370+0000 7f3b767fc640 10 client.7002 ms_handle_connect on v2:172.21.15.55:6832/1012943595 2024-04-25T09:58:55.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.370+0000 7f3b96ffd640 1 --2- 172.21.15.7:0/1059950531 >> [v2:172.21.15.55:6832/1012943595,v1:172.21.15.55:6834/1012943595] conn(0x562dc67ac010 0x562dc67ac3f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3baf3c87ecdcd30 server_cookie=e67a4106aea0dded in_seq=0 out_seq=0 2024-04-25T09:58:55.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.371+0000 7f3b767fc640 1 -- 172.21.15.7:0/1059950531 <== mds.0 v2:172.21.15.55:6832/1012943595 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x562dc666bf50 con 0x562dc67ac010 2024-04-25T09:58:55.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.371+0000 7f3b767fc640 10 client.7002 handle_command_reply: tid=0 2024-04-25T09:58:55.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.371+0000 7f3ba0e7c740 1 client.7002 shutdown 2024-04-25T09:58:55.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.371+0000 7f3ba0e7c740 1 -- 172.21.15.7:0/1059950531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dc6726230 msgr2=0x562dc6729930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:55.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.371+0000 7f3ba0e7c740 1 --2- 172.21.15.7:0/1059950531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dc6726230 0x562dc6729930 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f3b880794c0 tx=0x7f3b88049070 comp rx=0 tx=0).stop 2024-04-25T09:58:55.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.371+0000 7f3ba0e7c740 1 -- 172.21.15.7:0/1059950531 shutdown_connections 2024-04-25T09:58:55.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.371+0000 7f3ba0e7c740 1 --2- 172.21.15.7:0/1059950531 >> [v2:172.21.15.55:6832/1012943595,v1:172.21.15.55:6834/1012943595] conn(0x562dc67ac010 0x562dc67ac3f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.371+0000 7f3ba0e7c740 1 --2- 172.21.15.7:0/1059950531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562dc6754160 0x562dc66fc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.371+0000 7f3b767fc640 0 client.7002 ms_handle_reset on v2:172.21.15.55:6832/1012943595 2024-04-25T09:58:55.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.371+0000 7f3ba0e7c740 1 --2- 172.21.15.7:0/1059950531 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562dc6743ad0 0x562dc6729e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.371+0000 7f3ba0e7c740 1 --2- 172.21.15.7:0/1059950531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dc6726230 0x562dc6729930 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.371+0000 7f3ba0e7c740 1 -- 172.21.15.7:0/1059950531 >> 172.21.15.7:0/1059950531 conn(0x562dc66fbf10 msgr2=0x562dc66f1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:55.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.371+0000 7f3ba0e7c740 1 -- 172.21.15.7:0/1059950531 shutdown_connections 2024-04-25T09:58:55.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.371+0000 7f3ba0e7c740 1 -- 172.21.15.7:0/1059950531 wait complete. 2024-04-25T09:58:55.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.371+0000 7f3ba0e7c740 20 client.7002 trim_cache size 0 max 16384 2024-04-25T09:58:55.382 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T09:58:55.382 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "c03d0745-5946-49c3-ad88-1165c5b68b4e", 2024-04-25T09:58:55.382 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-04-25T09:58:55.382 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 6819, 2024-04-25T09:58:55.382 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-04-25T09:58:55.382 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-04-25T09:58:55.382 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-04-25T09:58:55.382 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 9.0733352739999997, 2024-04-25T09:58:55.382 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 37, 2024-04-25T09:58:55.382 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 75, 2024-04-25T09:58:55.382 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 75, 2024-04-25T09:58:55.382 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 14.119220537 2024-04-25T09:58:55.383 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T09:58:55.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.371+0000 7f3b9e170640 1 -- 172.21.15.7:0/2611107749 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3b8406b4d0 msgr2=0x7f3b8406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:55.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.371+0000 7f3b9e170640 1 --2- 172.21.15.7:0/2611107749 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3b8406b4d0 0x7f3b8406d990 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3b98070540 tx=0x7f3b8c008040 comp rx=0 tx=0).stop 2024-04-25T09:58:55.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.371+0000 7f3b9e170640 1 -- 172.21.15.7:0/2611107749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b98099f30 msgr2=0x7f3b981554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:55.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.371+0000 7f3b9e170640 1 --2- 172.21.15.7:0/2611107749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b98099f30 0x7f3b981554a0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f3b88000c00 tx=0x7f3b880046c0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.371+0000 7f3b9e170640 1 -- 172.21.15.7:0/2611107749 shutdown_connections 2024-04-25T09:58:55.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.371+0000 7f3b9e170640 1 --2- 172.21.15.7:0/2611107749 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3b8406b4d0 0x7f3b8406d990 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.371+0000 7f3b9e170640 1 --2- 172.21.15.7:0/2611107749 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3b9815b8e0 0x7f3b9806f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.371+0000 7f3b9e170640 1 --2- 172.21.15.7:0/2611107749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b980cc300 0x7f3b980aed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.371+0000 7f3b9e170640 1 --2- 172.21.15.7:0/2611107749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b98099f30 0x7f3b981554a0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.371+0000 7f3b9e170640 1 -- 172.21.15.7:0/2611107749 >> 172.21.15.7:0/2611107749 conn(0x7f3b980b3130 msgr2=0x7f3b980ce050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:55.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.372+0000 7f3b9e170640 1 -- 172.21.15.7:0/2611107749 shutdown_connections 2024-04-25T09:58:55.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.372+0000 7f3b9e170640 1 -- 172.21.15.7:0/2611107749 wait complete. 2024-04-25T09:58:55.386 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:58:55.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.482+0000 7fe093d28640 1 Processor -- start 2024-04-25T09:58:55.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.483+0000 7fe093d28640 1 -- start start 2024-04-25T09:58:55.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.483+0000 7fe093d28640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe08c15b8e0 0x7fe08c0d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:55.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.483+0000 7fe093d28640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe08c09a100 0x7fe08c0b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:55.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.483+0000 7fe093d28640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe08c0ccbc0 con 0x7fe08c0cc300 2024-04-25T09:58:55.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.483+0000 7fe093d28640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe08c0cd7d0 con 0x7fe08c15b8e0 2024-04-25T09:58:55.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.483+0000 7fe093d28640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe08c0ccea0 con 0x7fe08c09a100 2024-04-25T09:58:55.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.484+0000 7fe091ac4640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe08c15b8e0 0x7fe08c0d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:55.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.484+0000 7fe0912c3640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe08c0cc300 0x7fe08c0999f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60032/0 (socket says 172.21.15.7:60032) 2024-04-25T09:58:55.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.484+0000 7fe0912c3640 1 -- 172.21.15.7:0/2981524206 learned_addr learned my addr 172.21.15.7:0/2981524206 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:55.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.484+0000 7fe0922c5640 1 --2- 172.21.15.7:0/2981524206 >> v2:172.21.15.55:3300/0 conn(0x7fe08c09a100 0x7fe08c0b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:55.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.484+0000 7fe091ac4640 1 -- 172.21.15.7:0/2981524206 >> v2:172.21.15.55:3300/0 conn(0x7fe08c09a100 msgr2=0x7fe08c0b0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:55.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.484+0000 7fe091ac4640 1 --2- 172.21.15.7:0/2981524206 >> v2:172.21.15.55:3300/0 conn(0x7fe08c09a100 0x7fe08c0b0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.484+0000 7fe091ac4640 1 -- 172.21.15.7:0/2981524206 >> v1:172.21.15.7:6789/0 conn(0x7fe08c0cc300 legacy=0x7fe08c0999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:55.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.484+0000 7fe091ac4640 1 -- 172.21.15.7:0/2981524206 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08c0cd180 con 0x7fe08c15b8e0 2024-04-25T09:58:55.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.484+0000 7fe090ac2640 1 -- 172.21.15.7:0/2981524206 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 826902886 0 0) 0x7fe08c0ccbc0 con 0x7fe08c0cc300 2024-04-25T09:58:55.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.485+0000 7fe091ac4640 1 --2- 172.21.15.7:0/2981524206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe08c15b8e0 0x7fe08c0d0330 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0b3f70 tx=0x7fe08402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39065592399f71a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:55.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.485+0000 7fe090ac2640 1 -- 172.21.15.7:0/2981524206 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe084037070 con 0x7fe08c15b8e0 2024-04-25T09:58:55.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.485+0000 7fe090ac2640 1 -- 172.21.15.7:0/2981524206 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe084032440 con 0x7fe08c15b8e0 2024-04-25T09:58:55.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.485+0000 7fe090ac2640 1 -- 172.21.15.7:0/2981524206 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe084032810 con 0x7fe08c15b8e0 2024-04-25T09:58:55.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.485+0000 7fe093d28640 1 -- 172.21.15.7:0/2981524206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe08c15b8e0 msgr2=0x7fe08c0d0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:55.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.485+0000 7fe093d28640 1 --2- 172.21.15.7:0/2981524206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe08c15b8e0 0x7fe08c0d0330 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0b3f70 tx=0x7fe08402a1a0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.485+0000 7fe093d28640 1 -- 172.21.15.7:0/2981524206 shutdown_connections 2024-04-25T09:58:55.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.485+0000 7fe093d28640 1 --2- 172.21.15.7:0/2981524206 >> v2:172.21.15.55:3300/0 conn(0x7fe08c09a100 0x7fe08c0b0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.485+0000 7fe093d28640 1 --2- 172.21.15.7:0/2981524206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe08c15b8e0 0x7fe08c0d0330 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.485+0000 7fe093d28640 1 -- 172.21.15.7:0/2981524206 >> 172.21.15.7:0/2981524206 conn(0x7fe08c0b3130 msgr2=0x7fe08c0b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:55.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.485+0000 7fe093d28640 1 -- 172.21.15.7:0/2981524206 shutdown_connections 2024-04-25T09:58:55.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.486+0000 7fe093d28640 1 -- 172.21.15.7:0/2981524206 wait complete. 2024-04-25T09:58:55.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.487+0000 7fe093d28640 1 Processor -- start 2024-04-25T09:58:55.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.487+0000 7fe093d28640 1 -- start start 2024-04-25T09:58:55.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.487+0000 7fe093d28640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe08c09a100 0x7fe08c0c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:55.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.487+0000 7fe093d28640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe08c0cc300 0x7fe08c0c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:55.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.487+0000 7fe093d28640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe08c15b8e0 0x7fe08c152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:55.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.487+0000 7fe093d28640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c15be40 con 0x7fe08c09a100 2024-04-25T09:58:55.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.487+0000 7fe093d28640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c15bcc0 con 0x7fe08c0cc300 2024-04-25T09:58:55.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.487+0000 7fe093d28640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c0cc790 con 0x7fe08c15b8e0 2024-04-25T09:58:55.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.487+0000 7fe091ac4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe08c09a100 0x7fe08c0c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:55.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.488+0000 7fe091ac4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe08c09a100 0x7fe08c0c8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34778/0 (socket says 172.21.15.7:34778) 2024-04-25T09:58:55.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.488+0000 7fe091ac4640 1 -- 172.21.15.7:0/1708774167 learned_addr learned my addr 172.21.15.7:0/1708774167 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:55.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.488+0000 7fe0922c5640 1 --2- 172.21.15.7:0/1708774167 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe08c15b8e0 0x7fe08c152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:55.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.488+0000 7fe0912c3640 1 --2- 172.21.15.7:0/1708774167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe08c0cc300 0x7fe08c0c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:55.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.488+0000 7fe091ac4640 1 -- 172.21.15.7:0/1708774167 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe08c15b8e0 msgr2=0x7fe08c152300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:55.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.488+0000 7fe091ac4640 1 --2- 172.21.15.7:0/1708774167 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe08c15b8e0 0x7fe08c152300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.488+0000 7fe091ac4640 1 -- 172.21.15.7:0/1708774167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe08c0cc300 msgr2=0x7fe08c0c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:55.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.488+0000 7fe091ac4640 1 --2- 172.21.15.7:0/1708774167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe08c0cc300 0x7fe08c0c97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.488+0000 7fe091ac4640 1 -- 172.21.15.7:0/1708774167 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08c0c8c50 con 0x7fe08c09a100 2024-04-25T09:58:55.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.488+0000 7fe0912c3640 1 --2- 172.21.15.7:0/1708774167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe08c0cc300 0x7fe08c0c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:55.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.488+0000 7fe091ac4640 1 --2- 172.21.15.7:0/1708774167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe08c09a100 0x7fe08c0c8710 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fe084009890 tx=0x7fe0840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:55.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.488+0000 7fe08a7fc640 1 -- 172.21.15.7:0/1708774167 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe084037040 con 0x7fe08c09a100 2024-04-25T09:58:55.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.488+0000 7fe08a7fc640 1 -- 172.21.15.7:0/1708774167 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe084042070 con 0x7fe08c09a100 2024-04-25T09:58:55.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.488+0000 7fe08a7fc640 1 -- 172.21.15.7:0/1708774167 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe084030bd0 con 0x7fe08c09a100 2024-04-25T09:58:55.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.488+0000 7fe093d28640 1 -- 172.21.15.7:0/1708774167 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe08c0c8ed0 con 0x7fe08c09a100 2024-04-25T09:58:55.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.488+0000 7fe093d28640 1 -- 172.21.15.7:0/1708774167 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe08c0b64f0 con 0x7fe08c09a100 2024-04-25T09:58:55.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.489+0000 7fe093d28640 1 -- 172.21.15.7:0/1708774167 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe08c068fd0 con 0x7fe08c09a100 2024-04-25T09:58:55.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.490+0000 7fe08a7fc640 1 -- 172.21.15.7:0/1708774167 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe084047460 con 0x7fe08c09a100 2024-04-25T09:58:55.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.490+0000 7fe08a7fc640 1 --2- 172.21.15.7:0/1708774167 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe07806b4d0 0x7fe07806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:55.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.490+0000 7fe08a7fc640 1 -- 172.21.15.7:0/1708774167 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe0840aaf90 con 0x7fe08c09a100 2024-04-25T09:58:55.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.490+0000 7fe0912c3640 1 --2- 172.21.15.7:0/1708774167 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe07806b4d0 0x7fe07806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:55.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.491+0000 7fe0912c3640 1 --2- 172.21.15.7:0/1708774167 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe07806b4d0 0x7fe07806d990 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe08c1f8010 tx=0x7fe080007c30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:55.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.495+0000 7fe08a7fc640 1 -- 172.21.15.7:0/1708774167 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe08c0c8c50 con 0x7fe08c09a100 2024-04-25T09:58:55.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.711+0000 7fe093d28640 1 -- 172.21.15.7:0/1708774167 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe08c0b0810 con 0x7fe08c09a100 2024-04-25T09:58:55.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.711+0000 7fe08a7fc640 1 -- 172.21.15.7:0/1708774167 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v37) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe084032e20 con 0x7fe08c09a100 2024-04-25T09:58:55.715 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:58:55.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.713+0000 7fe093d28640 1 -- 172.21.15.7:0/1708774167 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe07806b4d0 msgr2=0x7fe07806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:55.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.713+0000 7fe093d28640 1 --2- 172.21.15.7:0/1708774167 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe07806b4d0 0x7fe07806d990 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe08c1f8010 tx=0x7fe080007c30 comp rx=0 tx=0).stop 2024-04-25T09:58:55.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.713+0000 7fe093d28640 1 -- 172.21.15.7:0/1708774167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe08c09a100 msgr2=0x7fe08c0c8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:55.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.713+0000 7fe093d28640 1 --2- 172.21.15.7:0/1708774167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe08c09a100 0x7fe08c0c8710 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fe084009890 tx=0x7fe0840046c0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.713+0000 7fe093d28640 1 -- 172.21.15.7:0/1708774167 shutdown_connections 2024-04-25T09:58:55.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.713+0000 7fe093d28640 1 --2- 172.21.15.7:0/1708774167 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe07806b4d0 0x7fe07806d990 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.713+0000 7fe093d28640 1 --2- 172.21.15.7:0/1708774167 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe08c15b8e0 0x7fe08c152300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.713+0000 7fe093d28640 1 --2- 172.21.15.7:0/1708774167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe08c0cc300 0x7fe08c0c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.713+0000 7fe093d28640 1 --2- 172.21.15.7:0/1708774167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe08c09a100 0x7fe08c0c8710 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:55.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.713+0000 7fe093d28640 1 -- 172.21.15.7:0/1708774167 >> 172.21.15.7:0/1708774167 conn(0x7fe08c0b3130 msgr2=0x7fe08c0cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:55.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.713+0000 7fe093d28640 1 -- 172.21.15.7:0/1708774167 shutdown_connections 2024-04-25T09:58:55.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:55.713+0000 7fe093d28640 1 -- 172.21.15.7:0/1708774167 wait complete. 2024-04-25T09:58:55.728 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:58:55.728 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:58:55.728 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-04-25T09:58:55.728 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:58:55.728 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:58:55.728 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:58:55.728 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:58:55.728 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:58:55.728 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:58:55.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:58:55.729 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-04-25T09:58:55.744 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:58:55.744 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:58:55.745 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:58:55.745 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:58:55.745 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-04-25T09:58:55.745 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:58:55.745 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:58:55.745 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-04-25T09:58:55.745 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-04-25T09:58:55.745 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:58:55.745 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-04-25T09:58:55.745 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-04-25T09:58:55.745 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:58:55.745 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-04-25T09:58:55.745 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-04-25T09:58:55.745 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T09:58:55.745 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42464sec preferred_lft 42464sec 2024-04-25T09:58:55.746 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link noprefixroute 2024-04-25T09:58:55.746 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:58:55.746 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:58:55.746 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-04-25T09:58:55.746 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-04-25T09:58:55.746 INFO:teuthology.orchestra.run.smithi007.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:58:55.746 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 26:0c:99:53:12:e3 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:58:55.746 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:58:55.746 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:58:55.746 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::50aa:55ff:febc:5f67/64 scope link 2024-04-25T09:58:55.746 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:58:55.746 INFO:teuthology.orchestra.run.smithi007.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:58:55.746 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 6e:99:f1:00:a9:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:58:55.746 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6c99:f1ff:fe00:a95e/64 scope link 2024-04-25T09:58:55.747 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:58:55.747 INFO:teuthology.orchestra.run.smithi007.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:58:55.747 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 26:0c:99:53:12:e3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:58:55.747 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::240c:99ff:fe53:12e3/64 scope link 2024-04-25T09:58:55.747 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:58:55.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:58:55.747 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:58:55.808 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-04-25T09:58:55.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:58:55.809 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-04-25T09:58:55.866 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-04-25T09:58:55.866 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:58:55.866 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T09:58:55.866 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T09:58:55.866 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:58:55.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:58:55.867 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-04-25T09:58:55.867 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-25T09:58:55.867 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:58:55.867 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:58:55.867 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:58:55.867 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-25T09:58:55.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:58:55.952 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-04-25T09:58:55.967 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:58:55.967 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:58:55.968 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:58:55.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:58:55.968 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-04-25T09:58:56.032 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:58:56.032 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:58:56.088 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:58:56.088 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:58:56.088 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:58:56.143 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:58:56.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:58:56.143 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:58:56.225 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:58:56.225 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:58:56.225 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T09:58:56.233 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:58:56.234 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:58:56.234 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T09:58:56.234 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T09:58:56.234 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:58:56.239 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:58:56.239 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:58:56.239 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T09:58:56.239 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T09:58:56.239 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:58:56.239 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790" 2024-04-25T09:58:56.239 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790:/ 2024-04-25T09:58:56.239 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c03d0745-5946-49c3-ad88-1165c5b68b4e" will pass to kernel 2024-04-25T09:58:56.240 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T09:58:56.240 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-04-25T09:58:56.240 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T09:58:56.240 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T09:58:56.240 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T09:58:56.241 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:58:56.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:58:56.241 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:58:56.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:58:56.307 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:58:56.374 INFO:teuthology.orchestra.run.smithi007.stdout:client7014 2024-04-25T09:58:56.374 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:58:56.374 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:58:56.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:58:56.430 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir/) 2024-04-25T09:58:56.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:58:56.492 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_undamaged) 2024-04-25T09:58:56.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:58:56.549 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_to_be_damaged) 2024-04-25T09:58:56.604 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T09:58:56.604 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T09:58:56.604 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T09:58:56.604 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T09:58:56.605 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir").st_ino) 2024-04-25T09:58:56.605 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T09:58:56.682 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:58:56.685 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:58:56.712 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627776 2024-04-25T09:58:56.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:58:56.721 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:58:56.721 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:58:56.792 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:58:56.792 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:58:56.849 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:58:56.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.985+0000 7f0e9e563640 1 Processor -- start 2024-04-25T09:58:56.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.985+0000 7f0e9e563640 1 -- start start 2024-04-25T09:58:56.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.986+0000 7f0e9e563640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0e9815da20 0x7f0e9809a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:56.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.986+0000 7f0e9e563640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e980cfad0 con 0x7f0e9806c330 2024-04-25T09:58:56.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.986+0000 7f0e9e563640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e980cfdb0 con 0x7f0e9806bc70 2024-04-25T09:58:56.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.986+0000 7f0e9e563640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e980d06e0 con 0x7f0e9815da20 2024-04-25T09:58:56.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.986+0000 7f0e97fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0e9815da20 0x7f0e9809a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:56.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.986+0000 7f0e97fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0e9815da20 0x7f0e9809a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34780/0 (socket says 172.21.15.7:34780) 2024-04-25T09:58:56.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.986+0000 7f0e97fff640 1 -- 172.21.15.7:0/807875117 learned_addr learned my addr 172.21.15.7:0/807875117 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:56.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.986+0000 7f0e9cb00640 1 --1- 172.21.15.7:0/807875117 >> v1:172.21.15.7:6789/0 conn(0x7f0e9806c330 0x7f0e980cbd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60038/0 (socket says 172.21.15.7:60038) 2024-04-25T09:58:56.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.986+0000 7f0e97fff640 1 -- 172.21.15.7:0/807875117 >> v1:172.21.15.55:6789/0 conn(0x7f0e9806bc70 legacy=0x7f0e980d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:56.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.986+0000 7f0e97fff640 1 -- 172.21.15.7:0/807875117 >> v1:172.21.15.7:6789/0 conn(0x7f0e9806c330 legacy=0x7f0e980cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:56.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.986+0000 7f0e97fff640 1 -- 172.21.15.7:0/807875117 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e980d0090 con 0x7f0e9815da20 2024-04-25T09:58:56.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.986+0000 7f0e96ffd640 1 -- 172.21.15.7:0/807875117 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3368494283 0 0) 0x7f0e980cfad0 con 0x7f0e9806c330 2024-04-25T09:58:56.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.987+0000 7f0e97fff640 1 --2- 172.21.15.7:0/807875117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e9815da20 0x7f0e9809a400 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f0e88009870 tx=0x7f0e8802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea9376d1c4714fcf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:56.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.987+0000 7f0e96ffd640 1 -- 172.21.15.7:0/807875117 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e88037070 con 0x7f0e9815da20 2024-04-25T09:58:56.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.987+0000 7f0e96ffd640 1 -- 172.21.15.7:0/807875117 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8802ae50 con 0x7f0e9815da20 2024-04-25T09:58:56.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.987+0000 7f0e96ffd640 1 -- 172.21.15.7:0/807875117 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e88032860 con 0x7f0e9815da20 2024-04-25T09:58:56.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.987+0000 7f0e9e563640 1 -- 172.21.15.7:0/807875117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e9815da20 msgr2=0x7f0e9809a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:56.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.988+0000 7f0e9e563640 1 --2- 172.21.15.7:0/807875117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e9815da20 0x7f0e9809a400 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f0e88009870 tx=0x7f0e8802a300 comp rx=0 tx=0).stop 2024-04-25T09:58:56.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.988+0000 7f0e9e563640 1 -- 172.21.15.7:0/807875117 shutdown_connections 2024-04-25T09:58:56.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.988+0000 7f0e9e563640 1 --2- 172.21.15.7:0/807875117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e9815da20 0x7f0e9809a400 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:56.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.988+0000 7f0e9e563640 1 -- 172.21.15.7:0/807875117 >> 172.21.15.7:0/807875117 conn(0x7f0e980d16f0 msgr2=0x7f0e980d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:56.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.988+0000 7f0e9e563640 1 -- 172.21.15.7:0/807875117 shutdown_connections 2024-04-25T09:58:56.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.988+0000 7f0e9e563640 1 -- 172.21.15.7:0/807875117 wait complete. 2024-04-25T09:58:56.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.989+0000 7f0e9e563640 1 Processor -- start 2024-04-25T09:58:56.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.989+0000 7f0e9e563640 1 -- start start 2024-04-25T09:58:56.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.990+0000 7f0e9e563640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0e9806bc70 0x7f0e9814baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:56.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.990+0000 7f0e9e563640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e9806c330 0x7f0e980caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:56.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.990+0000 7f0e9e563640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e9815da20 0x7f0e980cd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:56.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.990+0000 7f0e9e563640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e980d1280 con 0x7f0e9815da20 2024-04-25T09:58:56.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.990+0000 7f0e9e563640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9809a940 con 0x7f0e9806c330 2024-04-25T09:58:56.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.990+0000 7f0e9e563640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9815de00 con 0x7f0e9806bc70 2024-04-25T09:58:56.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.990+0000 7f0e9cb00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e9815da20 0x7f0e980cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:56.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.990+0000 7f0e9cb00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e9815da20 0x7f0e980cd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34794/0 (socket says 172.21.15.7:34794) 2024-04-25T09:58:56.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.990+0000 7f0e9cb00640 1 -- 172.21.15.7:0/3308205514 learned_addr learned my addr 172.21.15.7:0/3308205514 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:56.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.990+0000 7f0e977fe640 1 --2- 172.21.15.7:0/3308205514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e9806c330 0x7f0e980caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:56.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.990+0000 7f0e97fff640 1 --2- 172.21.15.7:0/3308205514 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0e9806bc70 0x7f0e9814baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:56.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.990+0000 7f0e9cb00640 1 -- 172.21.15.7:0/3308205514 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0e9806bc70 msgr2=0x7f0e9814baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:56.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.990+0000 7f0e9cb00640 1 --2- 172.21.15.7:0/3308205514 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0e9806bc70 0x7f0e9814baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:56.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.990+0000 7f0e9cb00640 1 -- 172.21.15.7:0/3308205514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e9806c330 msgr2=0x7f0e980caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:56.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.990+0000 7f0e9cb00640 1 --2- 172.21.15.7:0/3308205514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e9806c330 0x7f0e980caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:56.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.990+0000 7f0e9cb00640 1 -- 172.21.15.7:0/3308205514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e980b5490 con 0x7f0e9815da20 2024-04-25T09:58:56.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.990+0000 7f0e9cb00640 1 --2- 172.21.15.7:0/3308205514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e9815da20 0x7f0e980cd020 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000c700 tx=0x7f0e9000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:56.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.990+0000 7f0e94ff9640 1 -- 172.21.15.7:0/3308205514 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e90018070 con 0x7f0e9815da20 2024-04-25T09:58:56.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.990+0000 7f0e94ff9640 1 -- 172.21.15.7:0/3308205514 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9000ce10 con 0x7f0e9815da20 2024-04-25T09:58:56.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.990+0000 7f0e9e563640 1 -- 172.21.15.7:0/3308205514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e980b43f0 con 0x7f0e9815da20 2024-04-25T09:58:56.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.990+0000 7f0e94ff9640 1 -- 172.21.15.7:0/3308205514 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9000a880 con 0x7f0e9815da20 2024-04-25T09:58:56.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.991+0000 7f0e9e563640 1 -- 172.21.15.7:0/3308205514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e980b49b0 con 0x7f0e9815da20 2024-04-25T09:58:56.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.992+0000 7f0e9e563640 1 -- 172.21.15.7:0/3308205514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e98068fd0 con 0x7f0e9815da20 2024-04-25T09:58:56.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.992+0000 7f0e94ff9640 1 -- 172.21.15.7:0/3308205514 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0e9001b070 con 0x7f0e9815da20 2024-04-25T09:58:56.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.992+0000 7f0e94ff9640 1 --2- 172.21.15.7:0/3308205514 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0e8406b4d0 0x7f0e8406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:56.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.992+0000 7f0e94ff9640 1 -- 172.21.15.7:0/3308205514 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0e900897e0 con 0x7f0e9815da20 2024-04-25T09:58:56.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.992+0000 7f0e97fff640 1 --2- 172.21.15.7:0/3308205514 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0e8406b4d0 0x7f0e8406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:56.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.993+0000 7f0e97fff640 1 --2- 172.21.15.7:0/3308205514 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0e8406b4d0 0x7f0e8406d990 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0e88034000 tx=0x7f0e8802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:57.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:56.997+0000 7f0e94ff9640 1 -- 172.21.15.7:0/3308205514 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0e90057f10 con 0x7f0e9815da20 2024-04-25T09:58:57.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.177+0000 7f0e9e563640 1 -- 172.21.15.7:0/3308205514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e980d2500 con 0x7f0e9815da20 2024-04-25T09:58:57.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.178+0000 7f0e94ff9640 1 -- 172.21.15.7:0/3308205514 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16849 (secure 0 0 0) 0x7f0e9005bfb0 con 0x7f0e9815da20 2024-04-25T09:58:57.182 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:58:57.183 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":75,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:58:47.285541+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:58:43.929184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T09:58:44.609970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:58:57.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.180+0000 7f0e9e563640 1 -- 172.21.15.7:0/3308205514 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0e8406b4d0 msgr2=0x7f0e8406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:57.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.180+0000 7f0e9e563640 1 --2- 172.21.15.7:0/3308205514 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0e8406b4d0 0x7f0e8406d990 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0e88034000 tx=0x7f0e8802e000 comp rx=0 tx=0).stop 2024-04-25T09:58:57.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.180+0000 7f0e9e563640 1 -- 172.21.15.7:0/3308205514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e9815da20 msgr2=0x7f0e980cd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:57.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.180+0000 7f0e9e563640 1 --2- 172.21.15.7:0/3308205514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e9815da20 0x7f0e980cd020 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000c700 tx=0x7f0e9000cbc0 comp rx=0 tx=0).stop 2024-04-25T09:58:57.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.180+0000 7f0e9e563640 1 -- 172.21.15.7:0/3308205514 shutdown_connections 2024-04-25T09:58:57.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.180+0000 7f0e9e563640 1 --2- 172.21.15.7:0/3308205514 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0e8406b4d0 0x7f0e8406d990 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:57.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.180+0000 7f0e9e563640 1 --2- 172.21.15.7:0/3308205514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e9815da20 0x7f0e980cd020 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:57.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.180+0000 7f0e9e563640 1 --2- 172.21.15.7:0/3308205514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e9806c330 0x7f0e980caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:57.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.180+0000 7f0e9e563640 1 --2- 172.21.15.7:0/3308205514 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0e9806bc70 0x7f0e9814baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:57.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.180+0000 7f0e9e563640 1 -- 172.21.15.7:0/3308205514 >> 172.21.15.7:0/3308205514 conn(0x7f0e980d16f0 msgr2=0x7f0e980d0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:57.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.180+0000 7f0e9e563640 1 -- 172.21.15.7:0/3308205514 shutdown_connections 2024-04-25T09:58:57.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.180+0000 7f0e9e563640 1 -- 172.21.15.7:0/3308205514 wait complete. 2024-04-25T09:58:57.195 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:58:43.929184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:58:44.609970+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:58:57.195 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:58:57.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.296+0000 7fac2ec3a640 1 Processor -- start 2024-04-25T09:58:57.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.296+0000 7fac2ec3a640 1 -- start start 2024-04-25T09:58:57.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.297+0000 7fac2ec3a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fac2815bad0 0x7fac280cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:57.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.297+0000 7fac2ec3a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fac2809a100 0x7fac280b4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:57.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.297+0000 7fac2ec3a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac280cf440 con 0x7fac280cd210 2024-04-25T09:58:57.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.297+0000 7fac2ec3a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac280cf1f0 con 0x7fac2809a100 2024-04-25T09:58:57.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.297+0000 7fac2ec3a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac280cf720 con 0x7fac2815bad0 2024-04-25T09:58:57.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.297+0000 7fac2d1d7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fac2809a100 0x7fac280b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:57.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.297+0000 7fac2c9d6640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fac2815bad0 0x7fac280cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:57.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.297+0000 7fac27fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fac280cd210 0x7fac280999f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:37730/0 (socket says 172.21.15.7:37730) 2024-04-25T09:58:57.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.297+0000 7fac27fff640 1 -- 172.21.15.7:0/2450677142 learned_addr learned my addr 172.21.15.7:0/2450677142 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:57.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.297+0000 7fac2d1d7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fac2809a100 0x7fac280b4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:42306/0 (socket says 172.21.15.7:42306) 2024-04-25T09:58:57.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.298+0000 7fac277fe640 1 -- 172.21.15.7:0/2450677142 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3502168467 0 0) 0x7fac280cf440 con 0x7fac280cd210 2024-04-25T09:58:57.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.298+0000 7fac277fe640 1 -- 172.21.15.7:0/2450677142 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac10003520 con 0x7fac280cd210 2024-04-25T09:58:57.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.298+0000 7fac2d1d7640 1 -- 172.21.15.7:0/2450677142 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fac2815bad0 msgr2=0x7fac280cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:57.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.298+0000 7fac2d1d7640 1 --2- 172.21.15.7:0/2450677142 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fac2815bad0 0x7fac280cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:57.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.298+0000 7fac2d1d7640 1 -- 172.21.15.7:0/2450677142 >> v1:172.21.15.55:6789/0 conn(0x7fac280cd210 legacy=0x7fac280999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:57.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.298+0000 7fac2d1d7640 1 -- 172.21.15.7:0/2450677142 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac280cfa00 con 0x7fac2809a100 2024-04-25T09:58:57.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.298+0000 7fac2c9d6640 1 --2- 172.21.15.7:0/2450677142 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fac2815bad0 0x7fac280cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:58:57.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.298+0000 7fac2d1d7640 1 --2- 172.21.15.7:0/2450677142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2809a100 0x7fac280b4470 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fac20009d90 tx=0x7fac2002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=562628f76dffdd02 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:57.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.299+0000 7fac277fe640 1 -- 172.21.15.7:0/2450677142 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac20007740 con 0x7fac2809a100 2024-04-25T09:58:57.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.299+0000 7fac277fe640 1 -- 172.21.15.7:0/2450677142 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac200078e0 con 0x7fac2809a100 2024-04-25T09:58:57.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.299+0000 7fac277fe640 1 -- 172.21.15.7:0/2450677142 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac20007c90 con 0x7fac2809a100 2024-04-25T09:58:57.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.299+0000 7fac2ec3a640 1 -- 172.21.15.7:0/2450677142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2809a100 msgr2=0x7fac280b4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:57.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.299+0000 7fac2ec3a640 1 --2- 172.21.15.7:0/2450677142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2809a100 0x7fac280b4470 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fac20009d90 tx=0x7fac2002a660 comp rx=0 tx=0).stop 2024-04-25T09:58:57.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.299+0000 7fac2ec3a640 1 -- 172.21.15.7:0/2450677142 shutdown_connections 2024-04-25T09:58:57.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.299+0000 7fac2ec3a640 1 --2- 172.21.15.7:0/2450677142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2809a100 0x7fac280b4470 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:57.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.299+0000 7fac2ec3a640 1 --2- 172.21.15.7:0/2450677142 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fac2815bad0 0x7fac280cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:57.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.299+0000 7fac2ec3a640 1 -- 172.21.15.7:0/2450677142 >> 172.21.15.7:0/2450677142 conn(0x7fac280b3110 msgr2=0x7fac280b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:57.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.299+0000 7fac2ec3a640 1 -- 172.21.15.7:0/2450677142 shutdown_connections 2024-04-25T09:58:57.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.299+0000 7fac2ec3a640 1 -- 172.21.15.7:0/2450677142 wait complete. 2024-04-25T09:58:57.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.301+0000 7fac2ec3a640 1 Processor -- start 2024-04-25T09:58:57.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.301+0000 7fac2ec3a640 1 -- start start 2024-04-25T09:58:57.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.301+0000 7fac2ec3a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2809a100 0x7fac2815c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:57.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.301+0000 7fac2ec3a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fac280cd210 0x7fac280c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:57.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.301+0000 7fac2ec3a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac2815bad0 0x7fac280c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:57.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.301+0000 7fac2ec3a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac280d04e0 con 0x7fac2815bad0 2024-04-25T09:58:57.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.301+0000 7fac2ec3a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac280cffc0 con 0x7fac2809a100 2024-04-25T09:58:57.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.301+0000 7fac2ec3a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac280d0660 con 0x7fac280cd210 2024-04-25T09:58:57.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.302+0000 7fac2d1d7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac2815bad0 0x7fac280c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:57.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.302+0000 7fac2d1d7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac2815bad0 0x7fac280c77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34810/0 (socket says 172.21.15.7:34810) 2024-04-25T09:58:57.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.302+0000 7fac2d1d7640 1 -- 172.21.15.7:0/4221314088 learned_addr learned my addr 172.21.15.7:0/4221314088 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:57.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.302+0000 7fac2c9d6640 1 --2- 172.21.15.7:0/4221314088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2809a100 0x7fac2815c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:57.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.302+0000 7fac27fff640 1 --2- 172.21.15.7:0/4221314088 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fac280cd210 0x7fac280c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:57.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.302+0000 7fac2d1d7640 1 -- 172.21.15.7:0/4221314088 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fac280cd210 msgr2=0x7fac280c72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:57.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.302+0000 7fac2d1d7640 1 --2- 172.21.15.7:0/4221314088 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fac280cd210 0x7fac280c72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:57.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.302+0000 7fac2d1d7640 1 -- 172.21.15.7:0/4221314088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2809a100 msgr2=0x7fac2815c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:57.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.302+0000 7fac2d1d7640 1 --2- 172.21.15.7:0/4221314088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2809a100 0x7fac2815c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:57.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.302+0000 7fac2d1d7640 1 -- 172.21.15.7:0/4221314088 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2815eea0 con 0x7fac2815bad0 2024-04-25T09:58:57.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.302+0000 7fac2d1d7640 1 --2- 172.21.15.7:0/4221314088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac2815bad0 0x7fac280c77e0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fac2002ac50 tx=0x7fac20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:57.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.302+0000 7fac257fa640 1 -- 172.21.15.7:0/4221314088 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2003f070 con 0x7fac2815bad0 2024-04-25T09:58:57.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.302+0000 7fac257fa640 1 -- 172.21.15.7:0/4221314088 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac20031c60 con 0x7fac2815bad0 2024-04-25T09:58:57.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.302+0000 7fac2ec3a640 1 -- 172.21.15.7:0/4221314088 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac2806bda0 con 0x7fac2815bad0 2024-04-25T09:58:57.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.302+0000 7fac257fa640 1 -- 172.21.15.7:0/4221314088 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac20009450 con 0x7fac2815bad0 2024-04-25T09:58:57.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.302+0000 7fac2ec3a640 1 -- 172.21.15.7:0/4221314088 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac2806c360 con 0x7fac2815bad0 2024-04-25T09:58:57.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.304+0000 7fac2ec3a640 1 -- 172.21.15.7:0/4221314088 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2806c560 con 0x7fac2815bad0 2024-04-25T09:58:57.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.304+0000 7fac257fa640 1 -- 172.21.15.7:0/4221314088 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fac2003b410 con 0x7fac2815bad0 2024-04-25T09:58:57.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.304+0000 7fac257fa640 1 --2- 172.21.15.7:0/4221314088 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fac1406b4d0 0x7fac1406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:57.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.305+0000 7fac257fa640 1 -- 172.21.15.7:0/4221314088 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fac200ab500 con 0x7fac2815bad0 2024-04-25T09:58:57.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.305+0000 7fac2c9d6640 1 --2- 172.21.15.7:0/4221314088 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fac1406b4d0 0x7fac1406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:57.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.305+0000 7fac2c9d6640 1 --2- 172.21.15.7:0/4221314088 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fac1406b4d0 0x7fac1406d990 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fac2815ddb0 tx=0x7fac18009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:57.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.309+0000 7fac257fa640 1 -- 172.21.15.7:0/4221314088 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fac2806c560 con 0x7fac2815bad0 2024-04-25T09:58:57.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.488+0000 7fac2ec3a640 1 -- 172.21.15.7:0/4221314088 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac28068f60 con 0x7fac2815bad0 2024-04-25T09:58:57.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.489+0000 7fac257fa640 1 -- 172.21.15.7:0/4221314088 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7fac20079c30 con 0x7fac2815bad0 2024-04-25T09:58:57.493 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T09:58:57.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.490+0000 7fac2ec3a640 1 -- 172.21.15.7:0/4221314088 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fac1406b4d0 msgr2=0x7fac1406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:57.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.490+0000 7fac2ec3a640 1 --2- 172.21.15.7:0/4221314088 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fac1406b4d0 0x7fac1406d990 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fac2815ddb0 tx=0x7fac18009190 comp rx=0 tx=0).stop 2024-04-25T09:58:57.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.490+0000 7fac2ec3a640 1 -- 172.21.15.7:0/4221314088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac2815bad0 msgr2=0x7fac280c77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:57.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.490+0000 7fac2ec3a640 1 --2- 172.21.15.7:0/4221314088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac2815bad0 0x7fac280c77e0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fac2002ac50 tx=0x7fac20004a40 comp rx=0 tx=0).stop 2024-04-25T09:58:57.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.490+0000 7fac2ec3a640 1 -- 172.21.15.7:0/4221314088 shutdown_connections 2024-04-25T09:58:57.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.491+0000 7fac2ec3a640 1 --2- 172.21.15.7:0/4221314088 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fac1406b4d0 0x7fac1406d990 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:57.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.491+0000 7fac2ec3a640 1 --2- 172.21.15.7:0/4221314088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac2815bad0 0x7fac280c77e0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:57.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.491+0000 7fac2ec3a640 1 --2- 172.21.15.7:0/4221314088 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fac280cd210 0x7fac280c72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:57.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.491+0000 7fac2ec3a640 1 --2- 172.21.15.7:0/4221314088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2809a100 0x7fac2815c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:57.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.491+0000 7fac2ec3a640 1 -- 172.21.15.7:0/4221314088 >> 172.21.15.7:0/4221314088 conn(0x7fac280b3110 msgr2=0x7fac28070b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:57.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.491+0000 7fac2ec3a640 1 -- 172.21.15.7:0/4221314088 shutdown_connections 2024-04-25T09:58:57.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.491+0000 7fac2ec3a640 1 -- 172.21.15.7:0/4221314088 wait complete. 2024-04-25T09:58:57.505 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:58:57.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.605+0000 7fa16cbc8640 1 Processor -- start 2024-04-25T09:58:57.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.605+0000 7fa16cbc8640 1 -- start start 2024-04-25T09:58:57.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.606+0000 7fa16cbc8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa1680ce830 0x7fa16815eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:57.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.606+0000 7fa16cbc8640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1680ced10 con 0x7fa16815f1c0 2024-04-25T09:58:57.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.606+0000 7fa16cbc8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1680d1b40 con 0x7fa1680d3760 2024-04-25T09:58:57.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.606+0000 7fa16cbc8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1680ce380 con 0x7fa1680ce830 2024-04-25T09:58:57.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.606+0000 7fa165d9b640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa16815f1c0 0x7fa1680b2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60054/0 (socket says 172.21.15.7:60054) 2024-04-25T09:58:57.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.606+0000 7fa165d9b640 1 -- 172.21.15.7:0/1498171080 learned_addr learned my addr 172.21.15.7:0/1498171080 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:57.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.607+0000 7fa166d9d640 1 --2- 172.21.15.7:0/1498171080 >> v2:172.21.15.55:3300/0 conn(0x7fa1680ce830 0x7fa16815eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:57.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.607+0000 7fa16559a640 1 -- 172.21.15.7:0/1498171080 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2374164820 0 0) 0x7fa1680ced10 con 0x7fa16815f1c0 2024-04-25T09:58:57.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.607+0000 7fa16559a640 1 -- 172.21.15.7:0/1498171080 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa154003520 con 0x7fa16815f1c0 2024-04-25T09:58:57.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.607+0000 7fa166d9d640 1 -- 172.21.15.7:0/1498171080 >> v1:172.21.15.55:6789/0 conn(0x7fa1680d3760 legacy=0x7fa1680d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:57.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.607+0000 7fa166d9d640 1 -- 172.21.15.7:0/1498171080 >> v1:172.21.15.7:6789/0 conn(0x7fa16815f1c0 legacy=0x7fa1680b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:57.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.607+0000 7fa16559a640 1 -- 172.21.15.7:0/1498171080 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2658171683 0 0) 0x7fa154003520 con 0x7fa16815f1c0 2024-04-25T09:58:57.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.607+0000 7fa166d9d640 1 -- 172.21.15.7:0/1498171080 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1680d1e20 con 0x7fa1680ce830 2024-04-25T09:58:57.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.608+0000 7fa166d9d640 1 --2- 172.21.15.7:0/1498171080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1680ce830 0x7fa16815eac0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa158009d90 tx=0x7fa15802a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b06be41435277f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:57.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.608+0000 7fa16559a640 1 -- 172.21.15.7:0/1498171080 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa150001670 con 0x7fa1680ce830 2024-04-25T09:58:57.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.608+0000 7fa16559a640 1 -- 172.21.15.7:0/1498171080 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa158007540 con 0x7fa1680ce830 2024-04-25T09:58:57.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.608+0000 7fa16559a640 1 -- 172.21.15.7:0/1498171080 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1580078f0 con 0x7fa1680ce830 2024-04-25T09:58:57.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.608+0000 7fa16cbc8640 1 -- 172.21.15.7:0/1498171080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1680ce830 msgr2=0x7fa16815eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:57.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.608+0000 7fa16cbc8640 1 --2- 172.21.15.7:0/1498171080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1680ce830 0x7fa16815eac0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa158009d90 tx=0x7fa15802a680 comp rx=0 tx=0).stop 2024-04-25T09:58:57.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.609+0000 7fa16cbc8640 1 -- 172.21.15.7:0/1498171080 shutdown_connections 2024-04-25T09:58:57.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.609+0000 7fa16cbc8640 1 --2- 172.21.15.7:0/1498171080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1680ce830 0x7fa16815eac0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:57.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.609+0000 7fa16cbc8640 1 -- 172.21.15.7:0/1498171080 >> 172.21.15.7:0/1498171080 conn(0x7fa168072680 msgr2=0x7fa168072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:57.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.609+0000 7fa16cbc8640 1 -- 172.21.15.7:0/1498171080 shutdown_connections 2024-04-25T09:58:57.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.609+0000 7fa16cbc8640 1 -- 172.21.15.7:0/1498171080 wait complete. 2024-04-25T09:58:57.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.610+0000 7fa16cbc8640 1 Processor -- start 2024-04-25T09:58:57.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.610+0000 7fa16cbc8640 1 -- start start 2024-04-25T09:58:57.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.611+0000 7fa16cbc8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1680ce830 0x7fa16814fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:57.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.611+0000 7fa16cbc8640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa1680d3760 0x7fa1681e6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:57.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.611+0000 7fa16cbc8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa16815f1c0 0x7fa1680b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:57.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.611+0000 7fa16cbc8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1680d2190 con 0x7fa1680ce830 2024-04-25T09:58:57.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.611+0000 7fa16cbc8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16815f000 con 0x7fa16815f1c0 2024-04-25T09:58:57.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.611+0000 7fa16cbc8640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1680b2950 con 0x7fa1680d3760 2024-04-25T09:58:57.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.611+0000 7fa16659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1680ce830 0x7fa16814fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:57.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.611+0000 7fa16659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1680ce830 0x7fa16814fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34814/0 (socket says 172.21.15.7:34814) 2024-04-25T09:58:57.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.611+0000 7fa16659c640 1 -- 172.21.15.7:0/2718290270 learned_addr learned my addr 172.21.15.7:0/2718290270 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:57.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.611+0000 7fa166d9d640 1 --2- 172.21.15.7:0/2718290270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa16815f1c0 0x7fa1680b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:57.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.611+0000 7fa16659c640 1 -- 172.21.15.7:0/2718290270 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa1680d3760 msgr2=0x7fa1681e6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:57.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.611+0000 7fa16659c640 1 --2- 172.21.15.7:0/2718290270 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa1680d3760 0x7fa1681e6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:57.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.611+0000 7fa16659c640 1 -- 172.21.15.7:0/2718290270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa16815f1c0 msgr2=0x7fa1680b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:57.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.611+0000 7fa16659c640 1 --2- 172.21.15.7:0/2718290270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa16815f1c0 0x7fa1680b4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:57.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.611+0000 7fa16659c640 1 -- 172.21.15.7:0/2718290270 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa168150280 con 0x7fa1680ce830 2024-04-25T09:58:57.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.611+0000 7fa16659c640 1 --2- 172.21.15.7:0/2718290270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1680ce830 0x7fa16814fd40 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fa16000c450 tx=0x7fa16000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:57.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.611+0000 7fa15effd640 1 -- 172.21.15.7:0/2718290270 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1600052d0 con 0x7fa1680ce830 2024-04-25T09:58:57.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.611+0000 7fa15effd640 1 -- 172.21.15.7:0/2718290270 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa160005470 con 0x7fa1680ce830 2024-04-25T09:58:57.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.611+0000 7fa16cbc8640 1 -- 172.21.15.7:0/2718290270 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1680ccce0 con 0x7fa1680ce830 2024-04-25T09:58:57.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.611+0000 7fa15effd640 1 -- 172.21.15.7:0/2718290270 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa160012870 con 0x7fa1680ce830 2024-04-25T09:58:57.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.612+0000 7fa16cbc8640 1 -- 172.21.15.7:0/2718290270 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1680cd580 con 0x7fa1680ce830 2024-04-25T09:58:57.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.613+0000 7fa16cbc8640 1 -- 172.21.15.7:0/2718290270 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa168068f60 con 0x7fa1680ce830 2024-04-25T09:58:57.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.613+0000 7fa15effd640 1 -- 172.21.15.7:0/2718290270 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa160012a10 con 0x7fa1680ce830 2024-04-25T09:58:57.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.613+0000 7fa15effd640 1 --2- 172.21.15.7:0/2718290270 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa14806b500 0x7fa14806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:57.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.613+0000 7fa15effd640 1 -- 172.21.15.7:0/2718290270 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa16008a070 con 0x7fa1680ce830 2024-04-25T09:58:57.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.613+0000 7fa165d9b640 1 --2- 172.21.15.7:0/2718290270 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa14806b500 0x7fa14806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:57.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.614+0000 7fa165d9b640 1 --2- 172.21.15.7:0/2718290270 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa14806b500 0x7fa14806d9c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa1500011e0 tx=0x7fa150001130 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:57.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.618+0000 7fa15effd640 1 -- 172.21.15.7:0/2718290270 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa160058cd0 con 0x7fa1680ce830 2024-04-25T09:58:57.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.798+0000 7fa16cbc8640 1 -- 172.21.15.7:0/2718290270 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa1680ce610 con 0x7fa1680ce830 2024-04-25T09:58:57.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.798+0000 7fa15effd640 1 -- 172.21.15.7:0/2718290270 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa1600585d0 con 0x7fa1680ce830 2024-04-25T09:58:57.803 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:58:57.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.800+0000 7fa16cbc8640 1 -- 172.21.15.7:0/2718290270 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa14806b500 msgr2=0x7fa14806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:57.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.800+0000 7fa16cbc8640 1 --2- 172.21.15.7:0/2718290270 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa14806b500 0x7fa14806d9c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa1500011e0 tx=0x7fa150001130 comp rx=0 tx=0).stop 2024-04-25T09:58:57.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.800+0000 7fa16cbc8640 1 -- 172.21.15.7:0/2718290270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1680ce830 msgr2=0x7fa16814fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:57.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.800+0000 7fa16cbc8640 1 --2- 172.21.15.7:0/2718290270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1680ce830 0x7fa16814fd40 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fa16000c450 tx=0x7fa16000c910 comp rx=0 tx=0).stop 2024-04-25T09:58:57.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.800+0000 7fa16cbc8640 1 -- 172.21.15.7:0/2718290270 shutdown_connections 2024-04-25T09:58:57.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.800+0000 7fa16cbc8640 1 --2- 172.21.15.7:0/2718290270 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa14806b500 0x7fa14806d9c0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:57.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.800+0000 7fa16cbc8640 1 --2- 172.21.15.7:0/2718290270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa16815f1c0 0x7fa1680b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:57.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.800+0000 7fa16cbc8640 1 --2- 172.21.15.7:0/2718290270 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa1680d3760 0x7fa1681e6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:57.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.800+0000 7fa16cbc8640 1 --2- 172.21.15.7:0/2718290270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1680ce830 0x7fa16814fd40 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:57.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.800+0000 7fa16cbc8640 1 -- 172.21.15.7:0/2718290270 >> 172.21.15.7:0/2718290270 conn(0x7fa168072680 msgr2=0x7fa168073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:57.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.800+0000 7fa16cbc8640 1 -- 172.21.15.7:0/2718290270 shutdown_connections 2024-04-25T09:58:57.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.800+0000 7fa16cbc8640 1 -- 172.21.15.7:0/2718290270 wait complete. 2024-04-25T09:58:57.815 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:58:57.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.915+0000 7f48e3f89640 1 Processor -- start 2024-04-25T09:58:57.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.915+0000 7f48e3f89640 1 -- start start 2024-04-25T09:58:57.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.916+0000 7f48e3f89640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f48dc0d3760 0x7f48dc15eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:57.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.916+0000 7f48e3f89640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f48dc0ce830 0x7f48dc0b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:57.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.916+0000 7f48e3f89640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48dc0ced10 con 0x7f48dc15f1c0 2024-04-25T09:58:57.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.916+0000 7f48e3f89640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48dc0ce380 con 0x7f48dc0ce830 2024-04-25T09:58:57.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.916+0000 7f48e3f89640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc15f000 con 0x7f48dc0d3760 2024-04-25T09:58:57.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.916+0000 7f48e2526640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f48dc0ce830 0x7f48dc0b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:57.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.916+0000 7f48e2526640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f48dc0ce830 0x7f48dc0b2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34816/0 (socket says 172.21.15.7:34816) 2024-04-25T09:58:57.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.916+0000 7f48e2526640 1 -- 172.21.15.7:0/3912779113 learned_addr learned my addr 172.21.15.7:0/3912779113 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:57.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.916+0000 7f48e1d25640 1 --2- 172.21.15.7:0/3912779113 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f48dc0d3760 0x7f48dc15eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:57.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.916+0000 7f48e2526640 1 -- 172.21.15.7:0/3912779113 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f48dc0d3760 msgr2=0x7f48dc15eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:57.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.916+0000 7f48e2526640 1 --2- 172.21.15.7:0/3912779113 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f48dc0d3760 0x7f48dc15eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:57.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.916+0000 7f48e2526640 1 -- 172.21.15.7:0/3912779113 >> v1:172.21.15.55:6789/0 conn(0x7f48dc15f1c0 legacy=0x7f48dc0d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:57.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.916+0000 7f48e2526640 1 -- 172.21.15.7:0/3912779113 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48dc0d1b40 con 0x7f48dc0ce830 2024-04-25T09:58:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.917+0000 7f48e2526640 1 --2- 172.21.15.7:0/3912779113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48dc0ce830 0x7f48dc0b2240 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f48d4009e50 tx=0x7f48d402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79e2a7b0378857 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.917+0000 7f48e0d23640 1 -- 172.21.15.7:0/3912779113 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d4036070 con 0x7f48dc0ce830 2024-04-25T09:58:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.917+0000 7f48e0d23640 1 -- 172.21.15.7:0/3912779113 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d4031600 con 0x7f48dc0ce830 2024-04-25T09:58:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.917+0000 7f48e0d23640 1 -- 172.21.15.7:0/3912779113 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d40319d0 con 0x7f48dc0ce830 2024-04-25T09:58:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.918+0000 7f48e3f89640 1 -- 172.21.15.7:0/3912779113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48dc0ce830 msgr2=0x7f48dc0b2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.918+0000 7f48e3f89640 1 --2- 172.21.15.7:0/3912779113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48dc0ce830 0x7f48dc0b2240 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f48d4009e50 tx=0x7f48d402a710 comp rx=0 tx=0).stop 2024-04-25T09:58:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.918+0000 7f48e3f89640 1 -- 172.21.15.7:0/3912779113 shutdown_connections 2024-04-25T09:58:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.918+0000 7f48e3f89640 1 --2- 172.21.15.7:0/3912779113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48dc0ce830 0x7f48dc0b2240 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.918+0000 7f48e3f89640 1 --2- 172.21.15.7:0/3912779113 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f48dc0d3760 0x7f48dc15eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.918+0000 7f48e3f89640 1 -- 172.21.15.7:0/3912779113 >> 172.21.15.7:0/3912779113 conn(0x7f48dc072680 msgr2=0x7f48dc072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.918+0000 7f48e3f89640 1 -- 172.21.15.7:0/3912779113 shutdown_connections 2024-04-25T09:58:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.918+0000 7f48e3f89640 1 -- 172.21.15.7:0/3912779113 wait complete. 2024-04-25T09:58:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.919+0000 7f48e3f89640 1 Processor -- start 2024-04-25T09:58:57.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.919+0000 7f48e3f89640 1 -- start start 2024-04-25T09:58:57.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.920+0000 7f48e3f89640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f48dc0ce830 0x7f48dc150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:57.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.920+0000 7f48e3f89640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48dc0d3760 0x7f48dc0b3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:57.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.920+0000 7f48e3f89640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48dc15f1c0 0x7f48dc15b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:57.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.920+0000 7f48e3f89640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc15de10 con 0x7f48dc15f1c0 2024-04-25T09:58:57.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.920+0000 7f48e3f89640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc0d2190 con 0x7f48dc0d3760 2024-04-25T09:58:57.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.920+0000 7f48e3f89640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc0b2780 con 0x7f48dc0ce830 2024-04-25T09:58:57.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.920+0000 7f48e2526640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48dc15f1c0 0x7f48dc15b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:57.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.920+0000 7f48e2526640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48dc15f1c0 0x7f48dc15b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34824/0 (socket says 172.21.15.7:34824) 2024-04-25T09:58:57.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.920+0000 7f48e2526640 1 -- 172.21.15.7:0/2768315715 learned_addr learned my addr 172.21.15.7:0/2768315715 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:57.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.920+0000 7f48e1d25640 1 --2- 172.21.15.7:0/2768315715 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f48dc0ce830 0x7f48dc150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:57.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.920+0000 7f48e1524640 1 --2- 172.21.15.7:0/2768315715 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48dc0d3760 0x7f48dc0b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:57.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.920+0000 7f48e2526640 1 -- 172.21.15.7:0/2768315715 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f48dc0ce830 msgr2=0x7f48dc150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:57.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.920+0000 7f48e2526640 1 --2- 172.21.15.7:0/2768315715 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f48dc0ce830 0x7f48dc150cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:57.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.920+0000 7f48e2526640 1 -- 172.21.15.7:0/2768315715 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48dc0d3760 msgr2=0x7f48dc0b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:57.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.920+0000 7f48e2526640 1 --2- 172.21.15.7:0/2768315715 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48dc0d3760 0x7f48dc0b3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:57.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.920+0000 7f48e2526640 1 -- 172.21.15.7:0/2768315715 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48dc1561f0 con 0x7f48dc15f1c0 2024-04-25T09:58:57.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.920+0000 7f48e2526640 1 --2- 172.21.15.7:0/2768315715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48dc15f1c0 0x7f48dc15b260 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f48d4009f70 tx=0x7f48d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:57.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.920+0000 7f48d27fc640 1 -- 172.21.15.7:0/2768315715 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d403f020 con 0x7f48dc15f1c0 2024-04-25T09:58:57.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.920+0000 7f48d27fc640 1 -- 172.21.15.7:0/2768315715 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d4037040 con 0x7f48dc15f1c0 2024-04-25T09:58:57.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.920+0000 7f48e3f89640 1 -- 172.21.15.7:0/2768315715 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48dc1564d0 con 0x7f48dc15f1c0 2024-04-25T09:58:57.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.920+0000 7f48d27fc640 1 -- 172.21.15.7:0/2768315715 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d4036070 con 0x7f48dc15f1c0 2024-04-25T09:58:57.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.921+0000 7f48e3f89640 1 -- 172.21.15.7:0/2768315715 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48dc156d70 con 0x7f48dc15f1c0 2024-04-25T09:58:57.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.922+0000 7f48e3f89640 1 -- 172.21.15.7:0/2768315715 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48dc1566a0 con 0x7f48dc15f1c0 2024-04-25T09:58:57.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.922+0000 7f48d27fc640 1 -- 172.21.15.7:0/2768315715 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f48d4042020 con 0x7f48dc15f1c0 2024-04-25T09:58:57.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.923+0000 7f48d27fc640 1 --2- 172.21.15.7:0/2768315715 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f48c006b4d0 0x7f48c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:57.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.923+0000 7f48e1d25640 1 --2- 172.21.15.7:0/2768315715 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f48c006b4d0 0x7f48c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:57.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.923+0000 7f48d27fc640 1 -- 172.21.15.7:0/2768315715 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f48d40aa700 con 0x7f48dc15f1c0 2024-04-25T09:58:57.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.923+0000 7f48e1d25640 1 --2- 172.21.15.7:0/2768315715 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f48c006b4d0 0x7f48c006d990 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f48d8006fd0 tx=0x7f48d8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:57.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:57.927+0000 7f48d27fc640 1 -- 172.21.15.7:0/2768315715 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f48d4049030 con 0x7f48dc15f1c0 2024-04-25T09:58:58.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.108+0000 7f48e3f89640 1 -- 172.21.15.7:0/2768315715 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f48dc068f60 con 0x7f48dc15f1c0 2024-04-25T09:58:58.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.108+0000 7f48d27fc640 1 -- 172.21.15.7:0/2768315715 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) v1 ==== 100+0+11 (secure 0 0 0) 0x7f48d4078da0 con 0x7f48dc15f1c0 2024-04-25T09:58:58.112 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T09:58:58.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.110+0000 7f48e3f89640 1 -- 172.21.15.7:0/2768315715 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f48c006b4d0 msgr2=0x7f48c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:58.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.110+0000 7f48e3f89640 1 --2- 172.21.15.7:0/2768315715 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f48c006b4d0 0x7f48c006d990 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f48d8006fd0 tx=0x7f48d8008040 comp rx=0 tx=0).stop 2024-04-25T09:58:58.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.110+0000 7f48e3f89640 1 -- 172.21.15.7:0/2768315715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48dc15f1c0 msgr2=0x7f48dc15b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:58.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.110+0000 7f48e3f89640 1 --2- 172.21.15.7:0/2768315715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48dc15f1c0 0x7f48dc15b260 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f48d4009f70 tx=0x7f48d4004a40 comp rx=0 tx=0).stop 2024-04-25T09:58:58.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.110+0000 7f48e3f89640 1 -- 172.21.15.7:0/2768315715 shutdown_connections 2024-04-25T09:58:58.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.110+0000 7f48e3f89640 1 --2- 172.21.15.7:0/2768315715 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f48c006b4d0 0x7f48c006d990 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:58.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.110+0000 7f48e3f89640 1 --2- 172.21.15.7:0/2768315715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48dc15f1c0 0x7f48dc15b260 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:58.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.110+0000 7f48e3f89640 1 --2- 172.21.15.7:0/2768315715 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48dc0d3760 0x7f48dc0b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:58.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.110+0000 7f48e3f89640 1 --2- 172.21.15.7:0/2768315715 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f48dc0ce830 0x7f48dc150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:58.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.110+0000 7f48e3f89640 1 -- 172.21.15.7:0/2768315715 >> 172.21.15.7:0/2768315715 conn(0x7f48dc072680 msgr2=0x7f48dc0b6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:58.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.110+0000 7f48e3f89640 1 -- 172.21.15.7:0/2768315715 shutdown_connections 2024-04-25T09:58:58.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.110+0000 7f48e3f89640 1 -- 172.21.15.7:0/2768315715 wait complete. 2024-04-25T09:58:58.125 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:58:58.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.223+0000 7f03e8253640 1 Processor -- start 2024-04-25T09:58:58.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.223+0000 7f03e8253640 1 -- start start 2024-04-25T09:58:58.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.224+0000 7f03e8253640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f03e00b2260 0x7f03e015be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:58.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.224+0000 7f03e8253640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03e00ce680 con 0x7f03e0145240 2024-04-25T09:58:58.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.224+0000 7f03e8253640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03e006d6c0 con 0x7f03e00ce080 2024-04-25T09:58:58.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.224+0000 7f03e8253640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e00a8560 con 0x7f03e00b2260 2024-04-25T09:58:58.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.224+0000 7f03e5fef640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f03e0145240 0x7f03e00cd970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60066/0 (socket says 172.21.15.7:60066) 2024-04-25T09:58:58.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.224+0000 7f03e5fef640 1 -- 172.21.15.7:0/2703060369 learned_addr learned my addr 172.21.15.7:0/2703060369 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:58.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.224+0000 7f03e67f0640 1 --2- 172.21.15.7:0/2703060369 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f03e00b2260 0x7f03e015be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:58.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.224+0000 7f03e4fed640 1 -- 172.21.15.7:0/2703060369 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2551672004 0 0) 0x7f03dc001110 con 0x7f03e0145240 2024-04-25T09:58:58.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.224+0000 7f03e4fed640 1 -- 172.21.15.7:0/2703060369 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03cc003520 con 0x7f03e0145240 2024-04-25T09:58:58.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.224+0000 7f03e4fed640 1 -- 172.21.15.7:0/2703060369 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 874642889 0 0) 0x7f03e006d6c0 con 0x7f03e00ce080 2024-04-25T09:58:58.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.224+0000 7f03e4fed640 1 -- 172.21.15.7:0/2703060369 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03dc001110 con 0x7f03e00ce080 2024-04-25T09:58:58.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.225+0000 7f03e67f0640 1 -- 172.21.15.7:0/2703060369 >> v1:172.21.15.55:6789/0 conn(0x7f03e00ce080 legacy=0x7f03e006e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:58.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.225+0000 7f03e67f0640 1 -- 172.21.15.7:0/2703060369 >> v1:172.21.15.7:6789/0 conn(0x7f03e0145240 legacy=0x7f03e00cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:58.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.225+0000 7f03e67f0640 1 -- 172.21.15.7:0/2703060369 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e006d9a0 con 0x7f03e00b2260 2024-04-25T09:58:58.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.225+0000 7f03e67f0640 1 --2- 172.21.15.7:0/2703060369 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f03e00b2260 0x7f03e015be40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f03d8009dc0 tx=0x7f03d802a760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc081a283fbdbb65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:58.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.225+0000 7f03e4fed640 1 -- 172.21.15.7:0/2703060369 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d8007740 con 0x7f03e00b2260 2024-04-25T09:58:58.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.225+0000 7f03e4fed640 1 -- 172.21.15.7:0/2703060369 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d80078e0 con 0x7f03e00b2260 2024-04-25T09:58:58.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.225+0000 7f03e4fed640 1 -- 172.21.15.7:0/2703060369 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d8007c90 con 0x7f03e00b2260 2024-04-25T09:58:58.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.226+0000 7f03e8253640 1 -- 172.21.15.7:0/2703060369 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f03e00b2260 msgr2=0x7f03e015be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:58.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.226+0000 7f03e8253640 1 --2- 172.21.15.7:0/2703060369 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f03e00b2260 0x7f03e015be40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f03d8009dc0 tx=0x7f03d802a760 comp rx=0 tx=0).stop 2024-04-25T09:58:58.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.226+0000 7f03e8253640 1 -- 172.21.15.7:0/2703060369 shutdown_connections 2024-04-25T09:58:58.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.226+0000 7f03e8253640 1 --2- 172.21.15.7:0/2703060369 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f03e00b2260 0x7f03e015be40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:58.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.226+0000 7f03e8253640 1 -- 172.21.15.7:0/2703060369 >> 172.21.15.7:0/2703060369 conn(0x7f03e00b1740 msgr2=0x7f03e00b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:58.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.226+0000 7f03e8253640 1 -- 172.21.15.7:0/2703060369 shutdown_connections 2024-04-25T09:58:58.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.226+0000 7f03e8253640 1 -- 172.21.15.7:0/2703060369 wait complete. 2024-04-25T09:58:58.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.227+0000 7f03e8253640 1 Processor -- start 2024-04-25T09:58:58.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.227+0000 7f03e8253640 1 -- start start 2024-04-25T09:58:58.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.228+0000 7f03e8253640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03e00b2260 0x7f03e0141440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:58.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.228+0000 7f03e8253640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f03e00ce080 0x7f03e013b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:58.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.228+0000 7f03e8253640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03e0145240 0x7f03e00b2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:58.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.228+0000 7f03e8253640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e006df60 con 0x7f03e00b2260 2024-04-25T09:58:58.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.228+0000 7f03e8253640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e006e2d0 con 0x7f03e0145240 2024-04-25T09:58:58.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.228+0000 7f03e8253640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e0145620 con 0x7f03e00ce080 2024-04-25T09:58:58.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.228+0000 7f03e5fef640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03e00b2260 0x7f03e0141440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:58.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.228+0000 7f03e5fef640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03e00b2260 0x7f03e0141440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34834/0 (socket says 172.21.15.7:34834) 2024-04-25T09:58:58.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.228+0000 7f03e5fef640 1 -- 172.21.15.7:0/1019662149 learned_addr learned my addr 172.21.15.7:0/1019662149 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:58.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.228+0000 7f03e67f0640 1 --2- 172.21.15.7:0/1019662149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03e0145240 0x7f03e00b2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:58.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.228+0000 7f03e57ee640 1 --2- 172.21.15.7:0/1019662149 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f03e00ce080 0x7f03e013b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:58.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.228+0000 7f03e5fef640 1 -- 172.21.15.7:0/1019662149 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f03e00ce080 msgr2=0x7f03e013b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:58.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.228+0000 7f03e5fef640 1 --2- 172.21.15.7:0/1019662149 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f03e00ce080 0x7f03e013b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:58.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.228+0000 7f03e5fef640 1 -- 172.21.15.7:0/1019662149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03e0145240 msgr2=0x7f03e00b2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:58.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.228+0000 7f03e5fef640 1 --2- 172.21.15.7:0/1019662149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03e0145240 0x7f03e00b2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:58.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.229+0000 7f03e5fef640 1 -- 172.21.15.7:0/1019662149 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e0144190 con 0x7f03e00b2260 2024-04-25T09:58:58.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.229+0000 7f03e5fef640 1 --2- 172.21.15.7:0/1019662149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03e00b2260 0x7f03e0141440 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f03dc00c760 tx=0x7f03dc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:58.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.229+0000 7f03d67fc640 1 -- 172.21.15.7:0/1019662149 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc017070 con 0x7f03e00b2260 2024-04-25T09:58:58.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.229+0000 7f03d67fc640 1 -- 172.21.15.7:0/1019662149 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03dc005ab0 con 0x7f03e00b2260 2024-04-25T09:58:58.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.229+0000 7f03e8253640 1 -- 172.21.15.7:0/1019662149 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e00c90e0 con 0x7f03e00b2260 2024-04-25T09:58:58.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.229+0000 7f03d67fc640 1 -- 172.21.15.7:0/1019662149 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc007070 con 0x7f03e00b2260 2024-04-25T09:58:58.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.229+0000 7f03e8253640 1 -- 172.21.15.7:0/1019662149 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e00c96a0 con 0x7f03e00b2260 2024-04-25T09:58:58.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.230+0000 7f03e8253640 1 -- 172.21.15.7:0/1019662149 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03e00c98a0 con 0x7f03e00b2260 2024-04-25T09:58:58.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.230+0000 7f03d67fc640 1 -- 172.21.15.7:0/1019662149 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f03dc01a070 con 0x7f03e00b2260 2024-04-25T09:58:58.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.231+0000 7f03d67fc640 1 --2- 172.21.15.7:0/1019662149 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f03c406b4d0 0x7f03c406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:58.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.231+0000 7f03e57ee640 1 --2- 172.21.15.7:0/1019662149 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f03c406b4d0 0x7f03c406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:58.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.231+0000 7f03d67fc640 1 -- 172.21.15.7:0/1019662149 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f03dc089760 con 0x7f03e00b2260 2024-04-25T09:58:58.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.231+0000 7f03e57ee640 1 --2- 172.21.15.7:0/1019662149 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f03c406b4d0 0x7f03c406d990 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f03d0007fd0 tx=0x7f03d0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:58.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.235+0000 7f03d67fc640 1 -- 172.21.15.7:0/1019662149 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f03e00c98a0 con 0x7f03e00b2260 2024-04-25T09:58:58.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.429+0000 7f03e8253640 1 -- 172.21.15.7:0/1019662149 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f03e00cde60 con 0x7f03e00b2260 2024-04-25T09:58:58.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.429+0000 7f03d67fc640 1 -- 172.21.15.7:0/1019662149 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v75) v1 ==== 80+0+0 (secure 0 0 0) 0x7f03e00ce680 con 0x7f03e00b2260 2024-04-25T09:58:58.433 INFO:teuthology.orchestra.run.smithi007.stderr:listed 0 entries 2024-04-25T09:58:58.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.431+0000 7f03e8253640 1 -- 172.21.15.7:0/1019662149 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f03c406b4d0 msgr2=0x7f03c406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:58.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.431+0000 7f03e8253640 1 --2- 172.21.15.7:0/1019662149 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f03c406b4d0 0x7f03c406d990 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f03d0007fd0 tx=0x7f03d0009040 comp rx=0 tx=0).stop 2024-04-25T09:58:58.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.431+0000 7f03e8253640 1 -- 172.21.15.7:0/1019662149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03e00b2260 msgr2=0x7f03e0141440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:58.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.431+0000 7f03e8253640 1 --2- 172.21.15.7:0/1019662149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03e00b2260 0x7f03e0141440 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f03dc00c760 tx=0x7f03dc00cc20 comp rx=0 tx=0).stop 2024-04-25T09:58:58.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.432+0000 7f03e8253640 1 -- 172.21.15.7:0/1019662149 shutdown_connections 2024-04-25T09:58:58.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.432+0000 7f03e8253640 1 --2- 172.21.15.7:0/1019662149 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f03c406b4d0 0x7f03c406d990 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:58.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.432+0000 7f03e8253640 1 --2- 172.21.15.7:0/1019662149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03e0145240 0x7f03e00b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:58.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.432+0000 7f03e8253640 1 --2- 172.21.15.7:0/1019662149 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f03e00ce080 0x7f03e013b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:58.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.432+0000 7f03e8253640 1 --2- 172.21.15.7:0/1019662149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03e00b2260 0x7f03e0141440 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:58.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.432+0000 7f03e8253640 1 -- 172.21.15.7:0/1019662149 >> 172.21.15.7:0/1019662149 conn(0x7f03e00b1740 msgr2=0x7f03e00cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:58.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.432+0000 7f03e8253640 1 -- 172.21.15.7:0/1019662149 shutdown_connections 2024-04-25T09:58:58.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.432+0000 7f03e8253640 1 -- 172.21.15.7:0/1019662149 wait complete. 2024-04-25T09:58:58.447 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:58:58.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:58:58.447 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:58:58.497 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-04-25T09:58:58.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:58:58.497 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:58:58.523 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:58:58.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.660+0000 7f5c8019d640 1 Processor -- start 2024-04-25T09:58:58.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.660+0000 7f5c8019d640 1 -- start start 2024-04-25T09:58:58.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.661+0000 7f5c8019d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5c7806c250 0x7f5c7809a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:58.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.661+0000 7f5c8019d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5c7806bce0 0x7f5c7806c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:58.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.661+0000 7f5c8019d640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c7806cb70 con 0x7f5c780d0360 2024-04-25T09:58:58.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.661+0000 7f5c8019d640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c7809ae20 con 0x7f5c7806bce0 2024-04-25T09:58:58.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.661+0000 7f5c8019d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c7809a450 con 0x7f5c7806c250 2024-04-25T09:58:58.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.661+0000 7f5c7d738640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5c7806bce0 0x7f5c7806c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:58.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.661+0000 7f5c7d738640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5c7806bce0 0x7f5c7806c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34842/0 (socket says 172.21.15.7:34842) 2024-04-25T09:58:58.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.661+0000 7f5c7d738640 1 -- 172.21.15.7:0/873828498 learned_addr learned my addr 172.21.15.7:0/873828498 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:58.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.661+0000 7f5c7df39640 1 --2- 172.21.15.7:0/873828498 >> v2:172.21.15.55:3300/0 conn(0x7f5c7806c250 0x7f5c7809a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:58.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.662+0000 7f5c7d738640 1 -- 172.21.15.7:0/873828498 >> v2:172.21.15.55:3300/0 conn(0x7f5c7806c250 msgr2=0x7f5c7809a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:58.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.662+0000 7f5c7d738640 1 --2- 172.21.15.7:0/873828498 >> v2:172.21.15.55:3300/0 conn(0x7f5c7806c250 0x7f5c7809a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:58.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.662+0000 7f5c7d738640 1 -- 172.21.15.7:0/873828498 >> v1:172.21.15.7:6789/0 conn(0x7f5c780d0360 legacy=0x7f5c780cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:58.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.662+0000 7f5c7d738640 1 -- 172.21.15.7:0/873828498 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c78099b20 con 0x7f5c7806bce0 2024-04-25T09:58:58.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.662+0000 7f5c7d738640 1 --2- 172.21.15.7:0/873828498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c7806bce0 0x7f5c7806c630 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f5c780d27e0 tx=0x7f5c6802a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e5e396cdef13e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:58.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.663+0000 7f5c7cf37640 1 -- 172.21.15.7:0/873828498 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c68037070 con 0x7f5c7806bce0 2024-04-25T09:58:58.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.663+0000 7f5c7cf37640 1 -- 172.21.15.7:0/873828498 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c68032440 con 0x7f5c7806bce0 2024-04-25T09:58:58.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.663+0000 7f5c7cf37640 1 -- 172.21.15.7:0/873828498 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c68032810 con 0x7f5c7806bce0 2024-04-25T09:58:58.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.663+0000 7f5c8019d640 1 -- 172.21.15.7:0/873828498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c7806bce0 msgr2=0x7f5c7806c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:58.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.663+0000 7f5c8019d640 1 --2- 172.21.15.7:0/873828498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c7806bce0 0x7f5c7806c630 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f5c780d27e0 tx=0x7f5c6802a160 comp rx=0 tx=0).stop 2024-04-25T09:58:58.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.663+0000 7f5c8019d640 1 -- 172.21.15.7:0/873828498 shutdown_connections 2024-04-25T09:58:58.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.663+0000 7f5c8019d640 1 --2- 172.21.15.7:0/873828498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c7806bce0 0x7f5c7806c630 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:58.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.663+0000 7f5c8019d640 1 --2- 172.21.15.7:0/873828498 >> v2:172.21.15.55:3300/0 conn(0x7f5c7806c250 0x7f5c7809a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:58.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.663+0000 7f5c8019d640 1 -- 172.21.15.7:0/873828498 >> 172.21.15.7:0/873828498 conn(0x7f5c780d16e0 msgr2=0x7f5c780d1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:58.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.663+0000 7f5c8019d640 1 -- 172.21.15.7:0/873828498 shutdown_connections 2024-04-25T09:58:58.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.663+0000 7f5c8019d640 1 -- 172.21.15.7:0/873828498 wait complete. 2024-04-25T09:58:58.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.665+0000 7f5c8019d640 1 Processor -- start 2024-04-25T09:58:58.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.665+0000 7f5c8019d640 1 -- start start 2024-04-25T09:58:58.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.665+0000 7f5c8019d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5c7806bce0 0x7f5c78159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:58.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.665+0000 7f5c8019d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c7806c250 0x7f5c781f8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:58.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.665+0000 7f5c8019d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c780d0360 0x7f5c780c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:58.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.665+0000 7f5c8019d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7809a0e0 con 0x7f5c780d0360 2024-04-25T09:58:58.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.665+0000 7f5c8019d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c780d0c60 con 0x7f5c7806c250 2024-04-25T09:58:58.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.665+0000 7f5c8019d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7815f000 con 0x7f5c7806bce0 2024-04-25T09:58:58.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.665+0000 7f5c7e73a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c780d0360 0x7f5c780c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:58.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.665+0000 7f5c7e73a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c780d0360 0x7f5c780c63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34850/0 (socket says 172.21.15.7:34850) 2024-04-25T09:58:58.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.665+0000 7f5c7e73a640 1 -- 172.21.15.7:0/2043594324 learned_addr learned my addr 172.21.15.7:0/2043594324 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:58.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.666+0000 7f5c7d738640 1 --2- 172.21.15.7:0/2043594324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c7806c250 0x7f5c781f8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:58.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.666+0000 7f5c7df39640 1 --2- 172.21.15.7:0/2043594324 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5c7806bce0 0x7f5c78159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:58.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.666+0000 7f5c7e73a640 1 -- 172.21.15.7:0/2043594324 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5c7806bce0 msgr2=0x7f5c78159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:58.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.666+0000 7f5c7e73a640 1 --2- 172.21.15.7:0/2043594324 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5c7806bce0 0x7f5c78159010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:58.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.666+0000 7f5c7e73a640 1 -- 172.21.15.7:0/2043594324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c7806c250 msgr2=0x7f5c781f8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:58.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.666+0000 7f5c7e73a640 1 --2- 172.21.15.7:0/2043594324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c7806c250 0x7f5c781f8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:58.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.666+0000 7f5c7e73a640 1 -- 172.21.15.7:0/2043594324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c780c5340 con 0x7f5c780d0360 2024-04-25T09:58:58.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.666+0000 7f5c7e73a640 1 --2- 172.21.15.7:0/2043594324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c780d0360 0x7f5c780c63e0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f5c7000c740 tx=0x7f5c7000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:58.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.666+0000 7f5c6e7fc640 1 -- 172.21.15.7:0/2043594324 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c70016020 con 0x7f5c780d0360 2024-04-25T09:58:58.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.666+0000 7f5c6e7fc640 1 -- 172.21.15.7:0/2043594324 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7000ce50 con 0x7f5c780d0360 2024-04-25T09:58:58.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.666+0000 7f5c6e7fc640 1 -- 172.21.15.7:0/2043594324 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c70003970 con 0x7f5c780d0360 2024-04-25T09:58:58.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.666+0000 7f5c8019d640 1 -- 172.21.15.7:0/2043594324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c780c5620 con 0x7f5c780d0360 2024-04-25T09:58:58.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.666+0000 7f5c8019d640 1 -- 172.21.15.7:0/2043594324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c780c5be0 con 0x7f5c780d0360 2024-04-25T09:58:58.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.667+0000 7f5c8019d640 1 -- 172.21.15.7:0/2043594324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c78073ce0 con 0x7f5c780d0360 2024-04-25T09:58:58.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.668+0000 7f5c6e7fc640 1 -- 172.21.15.7:0/2043594324 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5c70003b10 con 0x7f5c780d0360 2024-04-25T09:58:58.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.668+0000 7f5c6e7fc640 1 --2- 172.21.15.7:0/2043594324 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5c5c06b4d0 0x7f5c5c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:58.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.668+0000 7f5c6e7fc640 1 -- 172.21.15.7:0/2043594324 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5c70089e90 con 0x7f5c780d0360 2024-04-25T09:58:58.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.668+0000 7f5c7df39640 1 --2- 172.21.15.7:0/2043594324 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5c5c06b4d0 0x7f5c5c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:58.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.669+0000 7f5c7df39640 1 --2- 172.21.15.7:0/2043594324 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5c5c06b4d0 0x7f5c5c06d990 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5c74009aa0 tx=0x7f5c74009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:58.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.672+0000 7f5c6e7fc640 1 -- 172.21.15.7:0/2043594324 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5c78073ce0 con 0x7f5c780d0360 2024-04-25T09:58:58.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.888+0000 7f5c8019d640 1 -- 172.21.15.7:0/2043594324 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c78068fd0 con 0x7f5c780d0360 2024-04-25T09:58:58.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.888+0000 7f5c6e7fc640 1 -- 172.21.15.7:0/2043594324 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4934 (secure 0 0 0) 0x7f5c70020020 con 0x7f5c780d0360 2024-04-25T09:58:58.892 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:58:58.892 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":37,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1781470369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1781470369},{"type":"v1","addr":"172.21.15.55:6835","nonce":1781470369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6810,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1839614891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1839614891},{"type":"v1","addr":"172.21.15.7:6835","nonce":1839614891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6813,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3690076929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3690076929},{"type":"v1","addr":"172.21.15.7:6837","nonce":3690076929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:58:45.628406+0000","modified":"2024-04-25T09:58:47.654904+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6819},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6819":{"gid":6819,"name":"b","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6834/1012943595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1012943595},{"type":"v1","addr":"172.21.15.55:6834","nonce":1012943595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:58:58.893 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 37 2024-04-25T09:58:58.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.890+0000 7f5c8019d640 1 -- 172.21.15.7:0/2043594324 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5c5c06b4d0 msgr2=0x7f5c5c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:58.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.890+0000 7f5c8019d640 1 --2- 172.21.15.7:0/2043594324 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5c5c06b4d0 0x7f5c5c06d990 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5c74009aa0 tx=0x7f5c74009190 comp rx=0 tx=0).stop 2024-04-25T09:58:58.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.890+0000 7f5c8019d640 1 -- 172.21.15.7:0/2043594324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c780d0360 msgr2=0x7f5c780c63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:58.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.890+0000 7f5c8019d640 1 --2- 172.21.15.7:0/2043594324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c780d0360 0x7f5c780c63e0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f5c7000c740 tx=0x7f5c7000cc00 comp rx=0 tx=0).stop 2024-04-25T09:58:58.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.890+0000 7f5c8019d640 1 -- 172.21.15.7:0/2043594324 shutdown_connections 2024-04-25T09:58:58.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.890+0000 7f5c8019d640 1 --2- 172.21.15.7:0/2043594324 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5c5c06b4d0 0x7f5c5c06d990 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:58.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.890+0000 7f5c8019d640 1 --2- 172.21.15.7:0/2043594324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c780d0360 0x7f5c780c63e0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:58.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.890+0000 7f5c8019d640 1 --2- 172.21.15.7:0/2043594324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c7806c250 0x7f5c781f8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:58.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.890+0000 7f5c8019d640 1 --2- 172.21.15.7:0/2043594324 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5c7806bce0 0x7f5c78159010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:58.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.890+0000 7f5c8019d640 1 -- 172.21.15.7:0/2043594324 >> 172.21.15.7:0/2043594324 conn(0x7f5c780d16e0 msgr2=0x7f5c7815ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:58.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.890+0000 7f5c8019d640 1 -- 172.21.15.7:0/2043594324 shutdown_connections 2024-04-25T09:58:58.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:58.890+0000 7f5c8019d640 1 -- 172.21.15.7:0/2043594324 wait complete. 2024-04-25T09:58:58.905 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-04-25T09:58:59.042 INFO:teuthology.orchestra.run.smithi055.stdout:{"message":"","return_code":0} 2024-04-25T09:58:59.043 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T09:58:59.043 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:58:59.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.142+0000 7f6e26563640 1 Processor -- start 2024-04-25T09:58:59.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.142+0000 7f6e26563640 1 -- start start 2024-04-25T09:58:59.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.142+0000 7f6e26563640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e200d0a50 0x7f6e200d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:59.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.142+0000 7f6e26563640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e200d1e80 con 0x7f6e2015db00 2024-04-25T09:58:59.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.142+0000 7f6e26563640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e200b5930 con 0x7f6e200b53b0 2024-04-25T09:58:59.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.142+0000 7f6e26563640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e200b5c10 con 0x7f6e200d0a50 2024-04-25T09:58:59.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.143+0000 7f6e1ffff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f6e2015db00 0x7f6e200d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60070/0 (socket says 172.21.15.7:60070) 2024-04-25T09:58:59.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.143+0000 7f6e1ffff640 1 -- 172.21.15.7:0/848017928 learned_addr learned my addr 172.21.15.7:0/848017928 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:58:59.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.143+0000 7f6e1f7fe640 1 --2- 172.21.15.7:0/848017928 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e200d0a50 0x7f6e200d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:59.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.143+0000 7f6e1effd640 1 -- 172.21.15.7:0/848017928 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668060078 0 0) 0x7f6e200d1e80 con 0x7f6e2015db00 2024-04-25T09:58:59.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.143+0000 7f6e1effd640 1 -- 172.21.15.7:0/848017928 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e08003520 con 0x7f6e2015db00 2024-04-25T09:58:59.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.143+0000 7f6e1effd640 1 -- 172.21.15.7:0/848017928 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1610900948 0 0) 0x7f6e200b5930 con 0x7f6e200b53b0 2024-04-25T09:58:59.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.143+0000 7f6e1effd640 1 -- 172.21.15.7:0/848017928 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e200d1e80 con 0x7f6e200b53b0 2024-04-25T09:58:59.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.143+0000 7f6e1effd640 1 -- 172.21.15.7:0/848017928 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3477103207 0 0) 0x7f6e08003520 con 0x7f6e2015db00 2024-04-25T09:58:59.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.143+0000 7f6e1effd640 1 -- 172.21.15.7:0/848017928 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e200d0a50 msgr2=0x7f6e200d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:59.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.143+0000 7f6e1effd640 1 --2- 172.21.15.7:0/848017928 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e200d0a50 0x7f6e200d2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:59.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.143+0000 7f6e1effd640 1 -- 172.21.15.7:0/848017928 >> v1:172.21.15.55:6789/0 conn(0x7f6e200b53b0 legacy=0x7f6e200d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:59.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.143+0000 7f6e1effd640 1 -- 172.21.15.7:0/848017928 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e200b5ef0 con 0x7f6e2015db00 2024-04-25T09:58:59.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.143+0000 7f6e1effd640 1 -- 172.21.15.7:0/848017928 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f6e10001670 con 0x7f6e2015db00 2024-04-25T09:58:59.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.143+0000 7f6e1effd640 1 -- 172.21.15.7:0/848017928 >> v1:172.21.15.7:6789/0 conn(0x7f6e2015db00 legacy=0x7f6e200d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:59.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.143+0000 7f6e1effd640 1 --2- 172.21.15.7:0/848017928 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e200d0a50 0x7f6e08003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:59.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.143+0000 7f6e1effd640 1 --2- 172.21.15.7:0/848017928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e080040d0 0x7f6e08004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:59.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.143+0000 7f6e1effd640 1 --2- 172.21.15.7:0/848017928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e08004d40 0x7f6e080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:59.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.143+0000 7f6e1effd640 1 -- 172.21.15.7:0/848017928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e200b5c10 con 0x7f6e08004d40 2024-04-25T09:58:59.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.143+0000 7f6e1effd640 1 -- 172.21.15.7:0/848017928 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0800baa0 con 0x7f6e080040d0 2024-04-25T09:58:59.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.143+0000 7f6e1effd640 1 -- 172.21.15.7:0/848017928 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0800bca0 con 0x7f6e200d0a50 2024-04-25T09:58:59.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.143+0000 7f6e24b00640 1 --2- 172.21.15.7:0/848017928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e08004d40 0x7f6e080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:59.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.143+0000 7f6e1f7fe640 1 --2- 172.21.15.7:0/848017928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e080040d0 0x7f6e08004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:59.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.143+0000 7f6e1ffff640 1 --2- 172.21.15.7:0/848017928 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e200d0a50 0x7f6e08003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:59.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.144+0000 7f6e24b00640 1 -- 172.21.15.7:0/848017928 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e200d0a50 msgr2=0x7f6e08003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:59.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.144+0000 7f6e24b00640 1 --2- 172.21.15.7:0/848017928 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e200d0a50 0x7f6e08003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:59.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.144+0000 7f6e24b00640 1 -- 172.21.15.7:0/848017928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e080040d0 msgr2=0x7f6e08004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:59.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.144+0000 7f6e24b00640 1 --2- 172.21.15.7:0/848017928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e080040d0 0x7f6e08004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:59.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.144+0000 7f6e24b00640 1 -- 172.21.15.7:0/848017928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e08003520 con 0x7f6e08004d40 2024-04-25T09:58:59.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.144+0000 7f6e24b00640 1 --2- 172.21.15.7:0/848017928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e08004d40 0x7f6e080051c0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f6e18001fa0 tx=0x7f6e08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d66fee994376f152 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:59.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.145+0000 7f6e1effd640 1 -- 172.21.15.7:0/848017928 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e18001bf0 con 0x7f6e08004d40 2024-04-25T09:58:59.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.145+0000 7f6e1effd640 1 -- 172.21.15.7:0/848017928 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e18003b70 con 0x7f6e08004d40 2024-04-25T09:58:59.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.145+0000 7f6e1effd640 1 -- 172.21.15.7:0/848017928 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e180050d0 con 0x7f6e08004d40 2024-04-25T09:58:59.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.145+0000 7f6e26563640 1 -- 172.21.15.7:0/848017928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e08004d40 msgr2=0x7f6e080051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:59.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.145+0000 7f6e26563640 1 --2- 172.21.15.7:0/848017928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e08004d40 0x7f6e080051c0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f6e18001fa0 tx=0x7f6e08005830 comp rx=0 tx=0).stop 2024-04-25T09:58:59.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.145+0000 7f6e24b00640 1 -- 172.21.15.7:0/848017928 reap_dead start 2024-04-25T09:58:59.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.145+0000 7f6e26563640 1 -- 172.21.15.7:0/848017928 shutdown_connections 2024-04-25T09:58:59.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.145+0000 7f6e26563640 1 -- 172.21.15.7:0/848017928 >> 172.21.15.7:0/848017928 conn(0x7f6e20072290 msgr2=0x7f6e200726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:59.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.145+0000 7f6e26563640 1 -- 172.21.15.7:0/848017928 shutdown_connections 2024-04-25T09:58:59.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.145+0000 7f6e26563640 1 -- 172.21.15.7:0/848017928 wait complete. 2024-04-25T09:58:59.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.146+0000 7f6e26563640 1 Processor -- start 2024-04-25T09:58:59.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.147+0000 7f6e26563640 1 -- start start 2024-04-25T09:58:59.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.147+0000 7f6e26563640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e200d24a0 0x7f6e201f7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:59.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.147+0000 7f6e26563640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e200cc6a0 0x7f6e201524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:59.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.147+0000 7f6e26563640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e200d2880 0x7f6e20152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:59.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.147+0000 7f6e26563640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e200d3660 con 0x7f6e200cc6a0 2024-04-25T09:58:59.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.147+0000 7f6e26563640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e200b61d0 con 0x7f6e200d24a0 2024-04-25T09:58:59.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.147+0000 7f6e26563640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e200d2f80 con 0x7f6e200d2880 2024-04-25T09:58:59.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.147+0000 7f6e1f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e200cc6a0 0x7f6e201524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:59.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.147+0000 7f6e1f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e200cc6a0 0x7f6e201524d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34860/0 (socket says 172.21.15.7:34860) 2024-04-25T09:58:59.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.147+0000 7f6e1f7fe640 1 -- 172.21.15.7:0/2533971771 learned_addr learned my addr 172.21.15.7:0/2533971771 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:59.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.147+0000 7f6e1ffff640 1 --2- 172.21.15.7:0/2533971771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e200d24a0 0x7f6e201f7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:59.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.147+0000 7f6e24b00640 1 --2- 172.21.15.7:0/2533971771 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e200d2880 0x7f6e20152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:59.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.148+0000 7f6e1f7fe640 1 -- 172.21.15.7:0/2533971771 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e200d2880 msgr2=0x7f6e20152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:59.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.148+0000 7f6e1f7fe640 1 --2- 172.21.15.7:0/2533971771 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e200d2880 0x7f6e20152a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:59.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.148+0000 7f6e1f7fe640 1 -- 172.21.15.7:0/2533971771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e200d24a0 msgr2=0x7f6e201f7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:59.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.148+0000 7f6e1f7fe640 1 --2- 172.21.15.7:0/2533971771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e200d24a0 0x7f6e201f7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:59.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.148+0000 7f6e1f7fe640 1 -- 172.21.15.7:0/2533971771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e201f38f0 con 0x7f6e200cc6a0 2024-04-25T09:58:59.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.148+0000 7f6e1ffff640 1 --2- 172.21.15.7:0/2533971771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e200d24a0 0x7f6e201f7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:58:59.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.148+0000 7f6e1f7fe640 1 --2- 172.21.15.7:0/2533971771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e200cc6a0 0x7f6e201524d0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f6e14011a00 tx=0x7f6e14011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:59.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.148+0000 7f6e1cff9640 1 -- 172.21.15.7:0/2533971771 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1400fa90 con 0x7f6e200cc6a0 2024-04-25T09:58:59.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.148+0000 7f6e1cff9640 1 -- 172.21.15.7:0/2533971771 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1400fc30 con 0x7f6e200cc6a0 2024-04-25T09:58:59.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.148+0000 7f6e26563640 1 -- 172.21.15.7:0/2533971771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e201f3bd0 con 0x7f6e200cc6a0 2024-04-25T09:58:59.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.148+0000 7f6e1cff9640 1 -- 172.21.15.7:0/2533971771 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e14014440 con 0x7f6e200cc6a0 2024-04-25T09:58:59.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.148+0000 7f6e26563640 1 -- 172.21.15.7:0/2533971771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e201f4190 con 0x7f6e200cc6a0 2024-04-25T09:58:59.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.149+0000 7f6e26563640 1 -- 172.21.15.7:0/2533971771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e20068fd0 con 0x7f6e200cc6a0 2024-04-25T09:58:59.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.149+0000 7f6e1cff9640 1 -- 172.21.15.7:0/2533971771 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6e14012040 con 0x7f6e200cc6a0 2024-04-25T09:58:59.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.150+0000 7f6e1cff9640 1 --2- 172.21.15.7:0/2533971771 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6e0c06b4d0 0x7f6e0c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:59.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.150+0000 7f6e1cff9640 1 -- 172.21.15.7:0/2533971771 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6e1408a7e0 con 0x7f6e200cc6a0 2024-04-25T09:58:59.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.150+0000 7f6e1ffff640 1 --2- 172.21.15.7:0/2533971771 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6e0c06b4d0 0x7f6e0c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:59.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.150+0000 7f6e1ffff640 1 --2- 172.21.15.7:0/2533971771 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6e0c06b4d0 0x7f6e0c06d990 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6e10004840 tx=0x7f6e10001e40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:59.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.154+0000 7f6e1cff9640 1 -- 172.21.15.7:0/2533971771 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6e14019030 con 0x7f6e200cc6a0 2024-04-25T09:58:59.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.372+0000 7f6e26563640 1 -- 172.21.15.7:0/2533971771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6e200d16b0 con 0x7f6e200cc6a0 2024-04-25T09:58:59.377 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-04-25T09:58:59.373+0000 7f45ad572640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:58:59.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.374+0000 7f6e1cff9640 1 -- 172.21.15.7:0/2533971771 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6e14058e80 con 0x7f6e200cc6a0 2024-04-25T09:58:59.378 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:58:59.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.377+0000 7f6e26563640 1 -- 172.21.15.7:0/2533971771 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6e0c06b4d0 msgr2=0x7f6e0c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:59.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.377+0000 7f6e26563640 1 --2- 172.21.15.7:0/2533971771 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6e0c06b4d0 0x7f6e0c06d990 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6e10004840 tx=0x7f6e10001e40 comp rx=0 tx=0).stop 2024-04-25T09:58:59.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.377+0000 7f6e26563640 1 -- 172.21.15.7:0/2533971771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e200cc6a0 msgr2=0x7f6e201524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:59.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.377+0000 7f6e26563640 1 --2- 172.21.15.7:0/2533971771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e200cc6a0 0x7f6e201524d0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f6e14011a00 tx=0x7f6e14011ec0 comp rx=0 tx=0).stop 2024-04-25T09:58:59.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.377+0000 7f6e26563640 1 -- 172.21.15.7:0/2533971771 shutdown_connections 2024-04-25T09:58:59.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.377+0000 7f6e26563640 1 --2- 172.21.15.7:0/2533971771 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6e0c06b4d0 0x7f6e0c06d990 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:59.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.377+0000 7f6e26563640 1 --2- 172.21.15.7:0/2533971771 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e200d2880 0x7f6e20152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:59.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.377+0000 7f6e26563640 1 --2- 172.21.15.7:0/2533971771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e200cc6a0 0x7f6e201524d0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:59.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.377+0000 7f6e26563640 1 --2- 172.21.15.7:0/2533971771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e200d24a0 0x7f6e201f7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:59.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.377+0000 7f6e26563640 1 -- 172.21.15.7:0/2533971771 >> 172.21.15.7:0/2533971771 conn(0x7f6e20072290 msgr2=0x7f6e200cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:59.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.377+0000 7f6e26563640 1 -- 172.21.15.7:0/2533971771 shutdown_connections 2024-04-25T09:58:59.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.377+0000 7f6e26563640 1 -- 172.21.15.7:0/2533971771 wait complete. 2024-04-25T09:58:59.383 INFO:tasks.ceph.mds.b.smithi055.stderr: -4555> 2024-04-25T09:58:48.256+0000 7f9b2b5ae640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:58:59.393 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-04-25T09:58:59.415 INFO:tasks.ceph.mds.b.smithi055.stdout:starting mds.b at 2024-04-25T09:58:59.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.433+0000 7f5945483f40 1 Processor -- start 2024-04-25T09:58:59.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.433+0000 7f5945483f40 1 -- start start 2024-04-25T09:58:59.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.433+0000 7f5945483f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ccbf30cca0 0x55ccbf3ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:59.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.433+0000 7f5945483f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ccbf3cae90 0x55ccbf3c6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:59.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.433+0000 7f5945483f40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55ccbf3ea430 0x55ccbf3c6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:59.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.433+0000 7f5945483f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccbf3cb980 con 0x55ccbf30cca0 2024-04-25T09:58:59.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.433+0000 7f5945483f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccbf2b5df0 con 0x55ccbf3cae90 2024-04-25T09:58:59.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.433+0000 7f5945483f40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ccbf30d0b0 con 0x55ccbf3ea430 2024-04-25T09:58:59.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.433+0000 7f5942f84640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ccbf30cca0 0x55ccbf3ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:59.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.433+0000 7f5942f84640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ccbf30cca0 0x55ccbf3ca280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34872/0 (socket says 172.21.15.7:34872) 2024-04-25T09:58:59.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.433+0000 7f5942f84640 1 -- 172.21.15.7:0/2874318461 learned_addr learned my addr 172.21.15.7:0/2874318461 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:59.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.434+0000 7f5942783640 1 --2- 172.21.15.7:0/2874318461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ccbf3cae90 0x55ccbf3c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:59.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.434+0000 7f5943785640 1 --2- 172.21.15.7:0/2874318461 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55ccbf3ea430 0x55ccbf3c6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:59.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.434+0000 7f5942f84640 1 -- 172.21.15.7:0/2874318461 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55ccbf3ea430 msgr2=0x55ccbf3c6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:59.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.434+0000 7f5942f84640 1 --2- 172.21.15.7:0/2874318461 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55ccbf3ea430 0x55ccbf3c6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:59.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.434+0000 7f5942f84640 1 -- 172.21.15.7:0/2874318461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ccbf3cae90 msgr2=0x55ccbf3c6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:59.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.434+0000 7f5942f84640 1 --2- 172.21.15.7:0/2874318461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ccbf3cae90 0x55ccbf3c6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:59.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.434+0000 7f5942f84640 1 -- 172.21.15.7:0/2874318461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ccbf23bc50 con 0x55ccbf30cca0 2024-04-25T09:58:59.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.434+0000 7f5942783640 1 --2- 172.21.15.7:0/2874318461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ccbf3cae90 0x55ccbf3c6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:59.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.434+0000 7f5943785640 1 --2- 172.21.15.7:0/2874318461 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55ccbf3ea430 0x55ccbf3c6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:58:59.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.434+0000 7f5942f84640 1 --2- 172.21.15.7:0/2874318461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ccbf30cca0 0x55ccbf3ca280 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f5934002740 tx=0x7f5934002c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7ea2c45fe750cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:59.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.434+0000 7f5941781640 1 -- 172.21.15.7:0/2874318461 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5934010790 con 0x55ccbf30cca0 2024-04-25T09:58:59.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.434+0000 7f5941781640 1 -- 172.21.15.7:0/2874318461 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5934016070 con 0x55ccbf30cca0 2024-04-25T09:58:59.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.434+0000 7f5941781640 1 -- 172.21.15.7:0/2874318461 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5934010b50 con 0x55ccbf30cca0 2024-04-25T09:58:59.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.434+0000 7f5945483f40 1 -- 172.21.15.7:0/2874318461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ccbf30cca0 msgr2=0x55ccbf3ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:59.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.434+0000 7f5945483f40 1 --2- 172.21.15.7:0/2874318461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ccbf30cca0 0x55ccbf3ca280 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f5934002740 tx=0x7f5934002c00 comp rx=0 tx=0).stop 2024-04-25T09:58:59.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.434+0000 7f5945483f40 1 -- 172.21.15.7:0/2874318461 shutdown_connections 2024-04-25T09:58:59.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.434+0000 7f5945483f40 1 --2- 172.21.15.7:0/2874318461 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55ccbf3ea430 0x55ccbf3c6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:59.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.434+0000 7f5945483f40 1 --2- 172.21.15.7:0/2874318461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ccbf3cae90 0x55ccbf3c6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:59.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.434+0000 7f5945483f40 1 --2- 172.21.15.7:0/2874318461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ccbf30cca0 0x55ccbf3ca280 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:59.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.434+0000 7f5945483f40 1 -- 172.21.15.7:0/2874318461 >> 172.21.15.7:0/2874318461 conn(0x55ccbf30da60 msgr2=0x55ccbf30ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:59.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.435+0000 7f5945483f40 1 -- 172.21.15.7:0/2874318461 shutdown_connections 2024-04-25T09:58:59.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.435+0000 7f5945483f40 1 -- 172.21.15.7:0/2874318461 wait complete. 2024-04-25T09:58:59.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.435+0000 7f5945483f40 1 Processor -- start 2024-04-25T09:58:59.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.435+0000 7f5945483f40 1 -- start start 2024-04-25T09:58:59.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.436+0000 7f5945483f40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55ccbf30cca0 0x55ccbf3c4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:59.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.436+0000 7f5945483f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ccbf3cae90 0x55ccbf33d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:59.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.436+0000 7f5945483f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ccbf3ea430 0x55ccbf33d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:59.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.436+0000 7f5945483f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccbf3e9e20 con 0x55ccbf3ea430 2024-04-25T09:58:59.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.436+0000 7f5945483f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccbf3c8d30 con 0x55ccbf3cae90 2024-04-25T09:58:59.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.436+0000 7f5945483f40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ccbf3c8a50 con 0x55ccbf30cca0 2024-04-25T09:58:59.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.436+0000 7f5943785640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ccbf3ea430 0x55ccbf33d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:59.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.436+0000 7f5943785640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ccbf3ea430 0x55ccbf33d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34886/0 (socket says 172.21.15.7:34886) 2024-04-25T09:58:59.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.436+0000 7f5943785640 1 -- 172.21.15.7:0/3228480761 learned_addr learned my addr 172.21.15.7:0/3228480761 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:59.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.436+0000 7f5942783640 1 --2- 172.21.15.7:0/3228480761 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ccbf3cae90 0x55ccbf33d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:59.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.436+0000 7f5942f84640 1 --2- 172.21.15.7:0/3228480761 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55ccbf30cca0 0x55ccbf3c4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:59.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.436+0000 7f5943785640 1 -- 172.21.15.7:0/3228480761 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55ccbf30cca0 msgr2=0x55ccbf3c4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:59.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.436+0000 7f5943785640 1 --2- 172.21.15.7:0/3228480761 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55ccbf30cca0 0x55ccbf3c4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:59.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.436+0000 7f5943785640 1 -- 172.21.15.7:0/3228480761 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ccbf3cae90 msgr2=0x55ccbf33d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:59.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.436+0000 7f5943785640 1 --2- 172.21.15.7:0/3228480761 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ccbf3cae90 0x55ccbf33d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:59.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.436+0000 7f5943785640 1 -- 172.21.15.7:0/3228480761 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ccbf3dd710 con 0x55ccbf3ea430 2024-04-25T09:58:59.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.436+0000 7f5943785640 1 --2- 172.21.15.7:0/3228480761 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ccbf3ea430 0x55ccbf33d540 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f593c025dc0 tx=0x7f593c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:59.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.436+0000 7f592bfff640 1 -- 172.21.15.7:0/3228480761 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c06a070 con 0x55ccbf3ea430 2024-04-25T09:58:59.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.437+0000 7f592bfff640 1 -- 172.21.15.7:0/3228480761 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593c052930 con 0x55ccbf3ea430 2024-04-25T09:58:59.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.437+0000 7f592bfff640 1 -- 172.21.15.7:0/3228480761 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c056040 con 0x55ccbf3ea430 2024-04-25T09:58:59.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.437+0000 7f5945483f40 1 -- 172.21.15.7:0/3228480761 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ccbf3dfb60 con 0x55ccbf3ea430 2024-04-25T09:58:59.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.437+0000 7f5945483f40 1 -- 172.21.15.7:0/3228480761 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ccbf3dd9f0 con 0x55ccbf3ea430 2024-04-25T09:58:59.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.438+0000 7f592bfff640 1 -- 172.21.15.7:0/3228480761 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f593c06d070 con 0x55ccbf3ea430 2024-04-25T09:58:59.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.438+0000 7f592bfff640 1 --2- 172.21.15.7:0/3228480761 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5930069eb0 0x7f593006c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:59.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.438+0000 7f592bfff640 1 -- 172.21.15.7:0/3228480761 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f593c0cc9b0 con 0x55ccbf3ea430 2024-04-25T09:58:59.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.438+0000 7f5942f84640 1 --2- 172.21.15.7:0/3228480761 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5930069eb0 0x7f593006c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:59.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.439+0000 7f5945483f40 1 --2- 172.21.15.7:0/3228480761 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x55ccbf310420 0x55ccbf3c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:59.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.439+0000 7f5945483f40 1 -- 172.21.15.7:0/3228480761 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:1 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76) v9 -- 0x55ccbf3e3ca0 con 0x55ccbf310420 2024-04-25T09:58:59.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.439+0000 7f5942783640 1 --2- 172.21.15.7:0/3228480761 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x55ccbf310420 0x55ccbf3c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:59.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.439+0000 7f5942f84640 1 --2- 172.21.15.7:0/3228480761 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5930069eb0 0x7f593006c370 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5934002740 tx=0x7f5934008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:59.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.439+0000 7f5942783640 1 --2- 172.21.15.7:0/3228480761 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x55ccbf310420 0x55ccbf3c6540 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:59.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.441+0000 7f5942783640 1 -- 172.21.15.7:0/3228480761 <== osd.0 v2:172.21.15.7:6800/4167741236 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v76'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f59380079c0 con 0x55ccbf310420 2024-04-25T09:58:59.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.441+0000 7f5945483f40 1 -- 172.21.15.7:0/3228480761 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x55ccbf310420 msgr2=0x55ccbf3c6540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:59.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.441+0000 7f5945483f40 1 --2- 172.21.15.7:0/3228480761 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x55ccbf310420 0x55ccbf3c6540 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:59.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.441+0000 7f5945483f40 1 -- 172.21.15.7:0/3228480761 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5930069eb0 msgr2=0x7f593006c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:59.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.441+0000 7f5945483f40 1 --2- 172.21.15.7:0/3228480761 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5930069eb0 0x7f593006c370 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5934002740 tx=0x7f5934008030 comp rx=0 tx=0).stop 2024-04-25T09:58:59.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.441+0000 7f5945483f40 1 -- 172.21.15.7:0/3228480761 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ccbf3ea430 msgr2=0x55ccbf33d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:59.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.441+0000 7f5945483f40 1 --2- 172.21.15.7:0/3228480761 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ccbf3ea430 0x55ccbf33d540 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f593c025dc0 tx=0x7f593c002fb0 comp rx=0 tx=0).stop 2024-04-25T09:58:59.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.441+0000 7f5943785640 1 -- 172.21.15.7:0/3228480761 reap_dead start 2024-04-25T09:58:59.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.441+0000 7f5945483f40 1 -- 172.21.15.7:0/3228480761 shutdown_connections 2024-04-25T09:58:59.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.441+0000 7f5945483f40 1 -- 172.21.15.7:0/3228480761 >> 172.21.15.7:0/3228480761 conn(0x55ccbf30da60 msgr2=0x55ccbf3ca280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:59.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.441+0000 7f5945483f40 1 -- 172.21.15.7:0/3228480761 shutdown_connections 2024-04-25T09:58:59.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.441+0000 7f5945483f40 1 -- 172.21.15.7:0/3228480761 wait complete. 2024-04-25T09:58:59.449 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T09:58:59.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.589+0000 7fa2ac4d8640 1 Processor -- start 2024-04-25T09:58:59.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.589+0000 7fa2ac4d8640 1 -- start start 2024-04-25T09:58:59.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.590+0000 7fa2ac4d8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa2a4161200 0x7fa2a40cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:59.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.590+0000 7fa2ac4d8640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa2a409a9a0 0x7fa2a40cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:59.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.590+0000 7fa2ac4d8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a409ae10 con 0x7fa2a40d0a00 2024-04-25T09:58:59.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.590+0000 7fa2ac4d8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a41615e0 con 0x7fa2a4161200 2024-04-25T09:58:59.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.590+0000 7fa2ac4d8640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a406c9f0 con 0x7fa2a409a9a0 2024-04-25T09:58:59.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.591+0000 7fa2aaa75640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa2a409a9a0 0x7fa2a40cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:59.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.591+0000 7fa2aa274640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa2a4161200 0x7fa2a40cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:59.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.591+0000 7fa2aaa75640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa2a409a9a0 0x7fa2a40cf840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:55078/0 (socket says 172.21.15.7:55078) 2024-04-25T09:58:59.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.591+0000 7fa2aaa75640 1 -- 172.21.15.7:0/1201908988 learned_addr learned my addr 172.21.15.7:0/1201908988 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:59.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.591+0000 7fa2a9a73640 1 --1- 172.21.15.7:0/1201908988 >> v1:172.21.15.55:6789/0 conn(0x7fa2a40d0a00 0x7fa2a409a290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:37782/0 (socket says 172.21.15.7:37782) 2024-04-25T09:58:59.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.591+0000 7fa2aaa75640 1 -- 172.21.15.7:0/1201908988 >> v2:172.21.15.55:3300/0 conn(0x7fa2a4161200 msgr2=0x7fa2a40cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:58:59.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.591+0000 7fa2aaa75640 1 --2- 172.21.15.7:0/1201908988 >> v2:172.21.15.55:3300/0 conn(0x7fa2a4161200 0x7fa2a40cbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:59.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.591+0000 7fa2aaa75640 1 -- 172.21.15.7:0/1201908988 >> v1:172.21.15.55:6789/0 conn(0x7fa2a40d0a00 legacy=0x7fa2a409a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:59.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.591+0000 7fa2aaa75640 1 -- 172.21.15.7:0/1201908988 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a406ccd0 con 0x7fa2a409a9a0 2024-04-25T09:58:59.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.591+0000 7fa2aa274640 1 --2- 172.21.15.7:0/1201908988 >> v2:172.21.15.55:3300/0 conn(0x7fa2a4161200 0x7fa2a40cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:58:59.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.592+0000 7fa2aaa75640 1 --2- 172.21.15.7:0/1201908988 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa2a409a9a0 0x7fa2a40cf840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa29c009e50 tx=0x7fa29c02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4fb25ccb4f34908 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:59.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.592+0000 7fa2a9272640 1 -- 172.21.15.7:0/1201908988 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c036070 con 0x7fa2a409a9a0 2024-04-25T09:58:59.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.592+0000 7fa2a9272640 1 -- 172.21.15.7:0/1201908988 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29c031600 con 0x7fa2a409a9a0 2024-04-25T09:58:59.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.592+0000 7fa2a9272640 1 -- 172.21.15.7:0/1201908988 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c0319d0 con 0x7fa2a409a9a0 2024-04-25T09:58:59.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.592+0000 7fa2ac4d8640 1 -- 172.21.15.7:0/1201908988 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa2a409a9a0 msgr2=0x7fa2a40cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:59.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.592+0000 7fa2ac4d8640 1 --2- 172.21.15.7:0/1201908988 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa2a409a9a0 0x7fa2a40cf840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa29c009e50 tx=0x7fa29c02a710 comp rx=0 tx=0).stop 2024-04-25T09:58:59.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.593+0000 7fa2ac4d8640 1 -- 172.21.15.7:0/1201908988 shutdown_connections 2024-04-25T09:58:59.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.593+0000 7fa2ac4d8640 1 --2- 172.21.15.7:0/1201908988 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa2a409a9a0 0x7fa2a40cf840 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:59.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.593+0000 7fa2ac4d8640 1 --2- 172.21.15.7:0/1201908988 >> v2:172.21.15.55:3300/0 conn(0x7fa2a4161200 0x7fa2a40cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:59.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.593+0000 7fa2ac4d8640 1 -- 172.21.15.7:0/1201908988 >> 172.21.15.7:0/1201908988 conn(0x7fa2a40b31a0 msgr2=0x7fa2a40b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:58:59.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.593+0000 7fa2ac4d8640 1 -- 172.21.15.7:0/1201908988 shutdown_connections 2024-04-25T09:58:59.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.593+0000 7fa2ac4d8640 1 -- 172.21.15.7:0/1201908988 wait complete. 2024-04-25T09:58:59.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.594+0000 7fa2ac4d8640 1 Processor -- start 2024-04-25T09:58:59.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.594+0000 7fa2ac4d8640 1 -- start start 2024-04-25T09:58:59.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.594+0000 7fa2ac4d8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2a409a9a0 0x7fa2a40b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:59.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.594+0000 7fa2ac4d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2a40d0a00 0x7fa2a415bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:59.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.594+0000 7fa2ac4d8640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa2a4161200 0x7fa2a415bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:59.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.594+0000 7fa2ac4d8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a40cc240 con 0x7fa2a409a9a0 2024-04-25T09:58:59.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.595+0000 7fa2ac4d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a4099d70 con 0x7fa2a40d0a00 2024-04-25T09:58:59.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.595+0000 7fa2ac4d8640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a406c680 con 0x7fa2a4161200 2024-04-25T09:58:59.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.595+0000 7fa2aa274640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2a409a9a0 0x7fa2a40b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:59.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.595+0000 7fa2aa274640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2a409a9a0 0x7fa2a40b54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34902/0 (socket says 172.21.15.7:34902) 2024-04-25T09:58:59.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.595+0000 7fa2aa274640 1 -- 172.21.15.7:0/3325103165 learned_addr learned my addr 172.21.15.7:0/3325103165 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:58:59.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.595+0000 7fa2aaa75640 1 --2- 172.21.15.7:0/3325103165 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa2a4161200 0x7fa2a415bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:59.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.595+0000 7fa2a9a73640 1 --2- 172.21.15.7:0/3325103165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2a40d0a00 0x7fa2a415bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:59.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.595+0000 7fa2aa274640 1 -- 172.21.15.7:0/3325103165 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa2a4161200 msgr2=0x7fa2a415bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:59.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.595+0000 7fa2aa274640 1 --2- 172.21.15.7:0/3325103165 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa2a4161200 0x7fa2a415bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:59.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.595+0000 7fa2aa274640 1 -- 172.21.15.7:0/3325103165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2a40d0a00 msgr2=0x7fa2a415bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:58:59.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.595+0000 7fa2aa274640 1 --2- 172.21.15.7:0/3325103165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2a40d0a00 0x7fa2a415bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:58:59.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.595+0000 7fa2aa274640 1 -- 172.21.15.7:0/3325103165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a41f6ea0 con 0x7fa2a409a9a0 2024-04-25T09:58:59.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.595+0000 7fa2aa274640 1 --2- 172.21.15.7:0/3325103165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2a409a9a0 0x7fa2a40b54e0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000ebe0 tx=0x7fa2a000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:59.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.595+0000 7fa29affd640 1 -- 172.21.15.7:0/3325103165 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0017070 con 0x7fa2a409a9a0 2024-04-25T09:58:59.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.595+0000 7fa29affd640 1 -- 172.21.15.7:0/3325103165 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a000cbd0 con 0x7fa2a409a9a0 2024-04-25T09:58:59.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.595+0000 7fa2ac4d8640 1 -- 172.21.15.7:0/3325103165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a41f7180 con 0x7fa2a409a9a0 2024-04-25T09:58:59.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.595+0000 7fa29affd640 1 -- 172.21.15.7:0/3325103165 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0013470 con 0x7fa2a409a9a0 2024-04-25T09:58:59.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.595+0000 7fa2ac4d8640 1 -- 172.21.15.7:0/3325103165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a41f7740 con 0x7fa2a409a9a0 2024-04-25T09:58:59.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.596+0000 7fa2ac4d8640 1 -- 172.21.15.7:0/3325103165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a4068f60 con 0x7fa2a409a9a0 2024-04-25T09:58:59.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.597+0000 7fa29affd640 1 -- 172.21.15.7:0/3325103165 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa2a001a070 con 0x7fa2a409a9a0 2024-04-25T09:58:59.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.597+0000 7fa29affd640 1 --2- 172.21.15.7:0/3325103165 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa28806b4d0 0x7fa28806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:58:59.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.597+0000 7fa29affd640 1 -- 172.21.15.7:0/3325103165 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fa2a008a6b0 con 0x7fa2a409a9a0 2024-04-25T09:58:59.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.597+0000 7fa2a9a73640 1 --2- 172.21.15.7:0/3325103165 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa28806b4d0 0x7fa28806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:58:59.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.598+0000 7fa2a9a73640 1 --2- 172.21.15.7:0/3325103165 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa28806b4d0 0x7fa28806d990 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40c82f0 tx=0x7fa294009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:58:59.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.602+0000 7fa29affd640 1 -- 172.21.15.7:0/3325103165 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa2a0059350 con 0x7fa2a409a9a0 2024-04-25T09:58:59.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:58:59.820+0000 7fa2ac4d8640 1 -- 172.21.15.7:0/3325103165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fa2a40c8320 con 0x7fa2a409a9a0 2024-04-25T09:59:00.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.379+0000 7fa29affd640 1 -- 172.21.15.7:0/3325103165 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v39) v1 ==== 162+0+0 (secure 0 0 0) 0x7fa2a0088e20 con 0x7fa2a409a9a0 2024-04-25T09:59:00.383 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T09:59:00.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.383+0000 7fa2ac4d8640 1 -- 172.21.15.7:0/3325103165 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa28806b4d0 msgr2=0x7fa28806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:00.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.383+0000 7fa2ac4d8640 1 --2- 172.21.15.7:0/3325103165 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa28806b4d0 0x7fa28806d990 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40c82f0 tx=0x7fa294009040 comp rx=0 tx=0).stop 2024-04-25T09:59:00.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.383+0000 7fa2ac4d8640 1 -- 172.21.15.7:0/3325103165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2a409a9a0 msgr2=0x7fa2a40b54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:00.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.383+0000 7fa2ac4d8640 1 --2- 172.21.15.7:0/3325103165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2a409a9a0 0x7fa2a40b54e0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000ebe0 tx=0x7fa2a000c520 comp rx=0 tx=0).stop 2024-04-25T09:59:00.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.383+0000 7fa2ac4d8640 1 -- 172.21.15.7:0/3325103165 shutdown_connections 2024-04-25T09:59:00.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.383+0000 7fa2ac4d8640 1 --2- 172.21.15.7:0/3325103165 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa28806b4d0 0x7fa28806d990 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:00.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.383+0000 7fa2ac4d8640 1 --2- 172.21.15.7:0/3325103165 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa2a4161200 0x7fa2a415bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:00.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.383+0000 7fa2ac4d8640 1 --2- 172.21.15.7:0/3325103165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2a40d0a00 0x7fa2a415bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:00.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.383+0000 7fa2ac4d8640 1 --2- 172.21.15.7:0/3325103165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2a409a9a0 0x7fa2a40b54e0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:00.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.383+0000 7fa2ac4d8640 1 -- 172.21.15.7:0/3325103165 >> 172.21.15.7:0/3325103165 conn(0x7fa2a40b31a0 msgr2=0x7fa2a41617c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:00.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.383+0000 7fa2ac4d8640 1 -- 172.21.15.7:0/3325103165 shutdown_connections 2024-04-25T09:59:00.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.383+0000 7fa2ac4d8640 1 -- 172.21.15.7:0/3325103165 wait complete. 2024-04-25T09:59:00.403 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:59:00.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.505+0000 7fa81253b640 1 Processor -- start 2024-04-25T09:59:00.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.505+0000 7fa81253b640 1 -- start start 2024-04-25T09:59:00.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.506+0000 7fa81253b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa80c15da60 0x7fa80c0d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:00.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.506+0000 7fa81253b640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa80c15e8a0 con 0x7fa80c15e2d0 2024-04-25T09:59:00.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.506+0000 7fa81253b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa80c15eb80 con 0x7fa80c15de40 2024-04-25T09:59:00.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.506+0000 7fa81253b640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa80c15ee60 con 0x7fa80c15da60 2024-04-25T09:59:00.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.506+0000 7fa80bfff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa80c15da60 0x7fa80c0d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:00.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.506+0000 7fa810ad8640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa80c15e2d0 0x7fa80c0ce520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33648/0 (socket says 172.21.15.7:33648) 2024-04-25T09:59:00.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.506+0000 7fa810ad8640 1 -- 172.21.15.7:0/2479622644 learned_addr learned my addr 172.21.15.7:0/2479622644 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:59:00.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.506+0000 7fa80bfff640 1 -- 172.21.15.7:0/2479622644 >> v1:172.21.15.55:6789/0 conn(0x7fa80c15de40 legacy=0x7fa80c161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:00.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.506+0000 7fa80affd640 1 -- 172.21.15.7:0/2479622644 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105911024 0 0) 0x7fa80c15e8a0 con 0x7fa80c15e2d0 2024-04-25T09:59:00.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.506+0000 7fa80bfff640 1 -- 172.21.15.7:0/2479622644 >> v1:172.21.15.7:6789/0 conn(0x7fa80c15e2d0 legacy=0x7fa80c0ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:00.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.506+0000 7fa80bfff640 1 -- 172.21.15.7:0/2479622644 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80c161850 con 0x7fa80c15da60 2024-04-25T09:59:00.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.507+0000 7fa80bfff640 1 --2- 172.21.15.7:0/2479622644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa80c15da60 0x7fa80c0d0aa0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc0097a0 tx=0x7fa7fc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e8b6e14cda3441d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:00.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.507+0000 7fa80affd640 1 -- 172.21.15.7:0/2479622644 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc037070 con 0x7fa80c15da60 2024-04-25T09:59:00.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.507+0000 7fa80affd640 1 -- 172.21.15.7:0/2479622644 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7fc02ae50 con 0x7fa80c15da60 2024-04-25T09:59:00.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.507+0000 7fa80affd640 1 -- 172.21.15.7:0/2479622644 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc032660 con 0x7fa80c15da60 2024-04-25T09:59:00.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.508+0000 7fa81253b640 1 -- 172.21.15.7:0/2479622644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa80c15da60 msgr2=0x7fa80c0d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:00.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.508+0000 7fa81253b640 1 --2- 172.21.15.7:0/2479622644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa80c15da60 0x7fa80c0d0aa0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc0097a0 tx=0x7fa7fc02a140 comp rx=0 tx=0).stop 2024-04-25T09:59:00.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.508+0000 7fa81253b640 1 -- 172.21.15.7:0/2479622644 shutdown_connections 2024-04-25T09:59:00.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.508+0000 7fa81253b640 1 --2- 172.21.15.7:0/2479622644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa80c15da60 0x7fa80c0d0aa0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:00.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.508+0000 7fa81253b640 1 -- 172.21.15.7:0/2479622644 >> 172.21.15.7:0/2479622644 conn(0x7fa80c06bfe0 msgr2=0x7fa80c06c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:00.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.508+0000 7fa81253b640 1 -- 172.21.15.7:0/2479622644 shutdown_connections 2024-04-25T09:59:00.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.508+0000 7fa81253b640 1 -- 172.21.15.7:0/2479622644 wait complete. 2024-04-25T09:59:00.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.509+0000 7fa81253b640 1 Processor -- start 2024-04-25T09:59:00.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.509+0000 7fa81253b640 1 -- start start 2024-04-25T09:59:00.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.510+0000 7fa81253b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa80c15da60 0x7fa80c0aa220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:00.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.510+0000 7fa81253b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa80c15de40 0x7fa80c1f3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:00.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.510+0000 7fa81253b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa80c15e2d0 0x7fa80c1f0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:00.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.510+0000 7fa81253b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80c0cedb0 con 0x7fa80c15de40 2024-04-25T09:59:00.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.510+0000 7fa81253b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80c0cec30 con 0x7fa80c15da60 2024-04-25T09:59:00.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.510+0000 7fa81253b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa80c0d2ca0 con 0x7fa80c15e2d0 2024-04-25T09:59:00.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.510+0000 7fa80b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa80c15de40 0x7fa80c1f3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:00.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.510+0000 7fa80b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa80c15de40 0x7fa80c1f3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33722/0 (socket says 172.21.15.7:33722) 2024-04-25T09:59:00.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.510+0000 7fa80b7fe640 1 -- 172.21.15.7:0/2712799407 learned_addr learned my addr 172.21.15.7:0/2712799407 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:00.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.510+0000 7fa80bfff640 1 --2- 172.21.15.7:0/2712799407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa80c15da60 0x7fa80c0aa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:00.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.510+0000 7fa810ad8640 1 --2- 172.21.15.7:0/2712799407 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa80c15e2d0 0x7fa80c1f0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:00.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.510+0000 7fa80b7fe640 1 -- 172.21.15.7:0/2712799407 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa80c15e2d0 msgr2=0x7fa80c1f0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:00.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.510+0000 7fa80b7fe640 1 --2- 172.21.15.7:0/2712799407 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa80c15e2d0 0x7fa80c1f0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:00.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.510+0000 7fa80b7fe640 1 -- 172.21.15.7:0/2712799407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa80c15da60 msgr2=0x7fa80c0aa220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:00.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.510+0000 7fa80b7fe640 1 --2- 172.21.15.7:0/2712799407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa80c15da60 0x7fa80c0aa220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:00.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.510+0000 7fa80b7fe640 1 -- 172.21.15.7:0/2712799407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80c1f44f0 con 0x7fa80c15de40 2024-04-25T09:59:00.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.510+0000 7fa80bfff640 1 --2- 172.21.15.7:0/2712799407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa80c15da60 0x7fa80c0aa220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:59:00.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.511+0000 7fa80b7fe640 1 --2- 172.21.15.7:0/2712799407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa80c15de40 0x7fa80c1f3fb0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400c460 tx=0x7fa7f400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:00.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.511+0000 7fa808ff9640 1 -- 172.21.15.7:0/2712799407 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4016020 con 0x7fa80c15de40 2024-04-25T09:59:00.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.511+0000 7fa808ff9640 1 -- 172.21.15.7:0/2712799407 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f4012870 con 0x7fa80c15de40 2024-04-25T09:59:00.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.511+0000 7fa808ff9640 1 -- 172.21.15.7:0/2712799407 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4012c60 con 0x7fa80c15de40 2024-04-25T09:59:00.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.511+0000 7fa81253b640 1 -- 172.21.15.7:0/2712799407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa80c0aa800 con 0x7fa80c15de40 2024-04-25T09:59:00.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.511+0000 7fa81253b640 1 -- 172.21.15.7:0/2712799407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa80c0aadc0 con 0x7fa80c15de40 2024-04-25T09:59:00.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.512+0000 7fa81253b640 1 -- 172.21.15.7:0/2712799407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa80c068fd0 con 0x7fa80c15de40 2024-04-25T09:59:00.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.512+0000 7fa808ff9640 1 -- 172.21.15.7:0/2712799407 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa7f4019020 con 0x7fa80c15de40 2024-04-25T09:59:00.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.513+0000 7fa808ff9640 1 --2- 172.21.15.7:0/2712799407 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa7ec06b4d0 0x7fa7ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:00.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.513+0000 7fa808ff9640 1 -- 172.21.15.7:0/2712799407 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fa7f4089e30 con 0x7fa80c15de40 2024-04-25T09:59:00.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.513+0000 7fa80bfff640 1 --2- 172.21.15.7:0/2712799407 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa7ec06b4d0 0x7fa7ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:00.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.513+0000 7fa80bfff640 1 --2- 172.21.15.7:0/2712799407 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa7ec06b4d0 0x7fa7ec06d990 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc034000 tx=0x7fa7fc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:00.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.517+0000 7fa808ff9640 1 -- 172.21.15.7:0/2712799407 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa7f4020070 con 0x7fa80c15de40 2024-04-25T09:59:00.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.733+0000 7fa81253b640 1 -- 172.21.15.7:0/2712799407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa80c0d1560 con 0x7fa80c15de40 2024-04-25T09:59:00.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.734+0000 7fa808ff9640 1 -- 172.21.15.7:0/2712799407 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4935 (secure 0 0 0) 0x7fa80c1f44f0 con 0x7fa80c15de40 2024-04-25T09:59:00.738 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:59:00.738 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1781470369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1781470369},{"type":"v1","addr":"172.21.15.55:6835","nonce":1781470369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6442,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1406578404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1406578404},{"type":"v1","addr":"172.21.15.55:6834","nonce":1406578404}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6810,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1839614891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1839614891},{"type":"v1","addr":"172.21.15.7:6835","nonce":1839614891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:58:45.628406+0000","modified":"2024-04-25T09:59:00.382891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6813},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6813":{"gid":6813,"name":"c","rank":0,"incarnation":40,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6837/3690076929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3690076929},{"type":"v1","addr":"172.21.15.7:6837","nonce":3690076929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:59:00.739 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 40 2024-04-25T09:59:00.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.736+0000 7fa81253b640 1 -- 172.21.15.7:0/2712799407 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa7ec06b4d0 msgr2=0x7fa7ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:00.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.736+0000 7fa81253b640 1 --2- 172.21.15.7:0/2712799407 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa7ec06b4d0 0x7fa7ec06d990 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc034000 tx=0x7fa7fc02e000 comp rx=0 tx=0).stop 2024-04-25T09:59:00.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.736+0000 7fa81253b640 1 -- 172.21.15.7:0/2712799407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa80c15de40 msgr2=0x7fa80c1f3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:00.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.736+0000 7fa81253b640 1 --2- 172.21.15.7:0/2712799407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa80c15de40 0x7fa80c1f3fb0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400c460 tx=0x7fa7f400c920 comp rx=0 tx=0).stop 2024-04-25T09:59:00.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.736+0000 7fa81253b640 1 -- 172.21.15.7:0/2712799407 shutdown_connections 2024-04-25T09:59:00.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.736+0000 7fa81253b640 1 --2- 172.21.15.7:0/2712799407 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa7ec06b4d0 0x7fa7ec06d990 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:00.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.736+0000 7fa81253b640 1 --2- 172.21.15.7:0/2712799407 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa80c15e2d0 0x7fa80c1f0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:00.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.736+0000 7fa81253b640 1 --2- 172.21.15.7:0/2712799407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa80c15de40 0x7fa80c1f3fb0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:00.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.736+0000 7fa81253b640 1 --2- 172.21.15.7:0/2712799407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa80c15da60 0x7fa80c0aa220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:00.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.736+0000 7fa81253b640 1 -- 172.21.15.7:0/2712799407 >> 172.21.15.7:0/2712799407 conn(0x7fa80c06bfe0 msgr2=0x7fa80c0b6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:00.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.736+0000 7fa81253b640 1 -- 172.21.15.7:0/2712799407 shutdown_connections 2024-04-25T09:59:00.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:00.736+0000 7fa81253b640 1 -- 172.21.15.7:0/2712799407 wait complete. 2024-04-25T09:59:01.154 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:58:45.628406+0000', 'modified': '2024-04-25T09:59:00.382891+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 76, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6813}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6813': {'gid': 6813, 'name': 'c', 'rank': 0, 'incarnation': 40, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.7:6837/3690076929', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6836', 'nonce': 3690076929}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 3690076929}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:59:01.154 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6813:up:replay 2024-04-25T09:59:02.155 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:59:02.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.265+0000 7f0117ef5640 1 Processor -- start 2024-04-25T09:59:02.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.265+0000 7f0117ef5640 1 -- start start 2024-04-25T09:59:02.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.266+0000 7f0117ef5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f011015dd00 0x7f01100b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:02.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.266+0000 7f0117ef5640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f011006c6c0 0x7f01100b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:02.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.266+0000 7f0117ef5640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f011006cd00 con 0x7f01100b6a40 2024-04-25T09:59:02.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.266+0000 7f0117ef5640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f011015e0e0 con 0x7f011006c6c0 2024-04-25T09:59:02.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.266+0000 7f0117ef5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f011006cfe0 con 0x7f011015dd00 2024-04-25T09:59:02.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.266+0000 7f0116492640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f011006c6c0 0x7f01100b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:02.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.266+0000 7f0115490640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f01100b6a40 0x7f011006bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33662/0 (socket says 172.21.15.7:33662) 2024-04-25T09:59:02.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.266+0000 7f0115490640 1 -- 172.21.15.7:0/3486069016 learned_addr learned my addr 172.21.15.7:0/3486069016 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:59:02.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.266+0000 7f0116492640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f011006c6c0 0x7f01100b5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33726/0 (socket says 172.21.15.7:33726) 2024-04-25T09:59:02.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.266+0000 7f0115c91640 1 --2- 172.21.15.7:0/3486069016 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f011015dd00 0x7f01100b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:02.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.266+0000 7f0116492640 1 -- 172.21.15.7:0/3486069016 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f011015dd00 msgr2=0x7f01100b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:02.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.266+0000 7f0116492640 1 --2- 172.21.15.7:0/3486069016 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f011015dd00 0x7f01100b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:02.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.266+0000 7f0116492640 1 -- 172.21.15.7:0/3486069016 >> v1:172.21.15.7:6789/0 conn(0x7f01100b6a40 legacy=0x7f011006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:02.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.266+0000 7f0116492640 1 -- 172.21.15.7:0/3486069016 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01100d1ca0 con 0x7f011006c6c0 2024-04-25T09:59:02.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.267+0000 7f0116492640 1 --2- 172.21.15.7:0/3486069016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f011006c6c0 0x7f01100b5c90 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f0108009d90 tx=0x7f010802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c96320bef06c9346 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:02.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.267+0000 7f0114c8f640 1 -- 172.21.15.7:0/3486069016 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0108007740 con 0x7f011006c6c0 2024-04-25T09:59:02.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.267+0000 7f0114c8f640 1 -- 172.21.15.7:0/3486069016 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01080078e0 con 0x7f011006c6c0 2024-04-25T09:59:02.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.267+0000 7f0114c8f640 1 -- 172.21.15.7:0/3486069016 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0108007cb0 con 0x7f011006c6c0 2024-04-25T09:59:02.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.268+0000 7f0117ef5640 1 -- 172.21.15.7:0/3486069016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f011006c6c0 msgr2=0x7f01100b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:02.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.268+0000 7f0117ef5640 1 --2- 172.21.15.7:0/3486069016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f011006c6c0 0x7f01100b5c90 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f0108009d90 tx=0x7f010802a6f0 comp rx=0 tx=0).stop 2024-04-25T09:59:02.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.268+0000 7f0117ef5640 1 -- 172.21.15.7:0/3486069016 shutdown_connections 2024-04-25T09:59:02.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.268+0000 7f0117ef5640 1 --2- 172.21.15.7:0/3486069016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f011006c6c0 0x7f01100b5c90 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:02.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.268+0000 7f0117ef5640 1 --2- 172.21.15.7:0/3486069016 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f011015dd00 0x7f01100b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:02.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.268+0000 7f0117ef5640 1 -- 172.21.15.7:0/3486069016 >> 172.21.15.7:0/3486069016 conn(0x7f01100d07b0 msgr2=0x7f01100d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:02.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.268+0000 7f0117ef5640 1 -- 172.21.15.7:0/3486069016 shutdown_connections 2024-04-25T09:59:02.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.268+0000 7f0117ef5640 1 -- 172.21.15.7:0/3486069016 wait complete. 2024-04-25T09:59:02.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.269+0000 7f0117ef5640 1 Processor -- start 2024-04-25T09:59:02.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.269+0000 7f0117ef5640 1 -- start start 2024-04-25T09:59:02.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.270+0000 7f0117ef5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f011006c6c0 0x7f011015f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:02.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.270+0000 7f0117ef5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01100b6a40 0x7f0110159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:02.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.270+0000 7f0117ef5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f011015dd00 0x7f0110159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:02.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.270+0000 7f0117ef5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01100d2780 con 0x7f011006c6c0 2024-04-25T09:59:02.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.270+0000 7f0117ef5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01100d2260 con 0x7f01100b6a40 2024-04-25T09:59:02.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.270+0000 7f0117ef5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01100d2900 con 0x7f011015dd00 2024-04-25T09:59:02.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.270+0000 7f0115c91640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f011006c6c0 0x7f011015f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:02.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.270+0000 7f0115c91640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f011006c6c0 0x7f011015f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33742/0 (socket says 172.21.15.7:33742) 2024-04-25T09:59:02.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.270+0000 7f0115c91640 1 -- 172.21.15.7:0/1636353498 learned_addr learned my addr 172.21.15.7:0/1636353498 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:02.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.270+0000 7f0116492640 1 --2- 172.21.15.7:0/1636353498 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f011015dd00 0x7f0110159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:02.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.270+0000 7f0115490640 1 --2- 172.21.15.7:0/1636353498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01100b6a40 0x7f0110159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:02.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.270+0000 7f0115c91640 1 -- 172.21.15.7:0/1636353498 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f011015dd00 msgr2=0x7f0110159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:02.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.270+0000 7f0115c91640 1 --2- 172.21.15.7:0/1636353498 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f011015dd00 0x7f0110159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:02.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.270+0000 7f0115c91640 1 -- 172.21.15.7:0/1636353498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01100b6a40 msgr2=0x7f0110159350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:02.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.270+0000 7f0115c91640 1 --2- 172.21.15.7:0/1636353498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01100b6a40 0x7f0110159350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:02.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.270+0000 7f0115c91640 1 -- 172.21.15.7:0/1636353498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f011015a2b0 con 0x7f011006c6c0 2024-04-25T09:59:02.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.271+0000 7f0115c91640 1 --2- 172.21.15.7:0/1636353498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f011006c6c0 0x7f011015f780 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f010c00d620 tx=0x7f010c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:02.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.271+0000 7f01067fc640 1 -- 172.21.15.7:0/1636353498 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c00b620 con 0x7f011006c6c0 2024-04-25T09:59:02.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.271+0000 7f01067fc640 1 -- 172.21.15.7:0/1636353498 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010c019070 con 0x7f011006c6c0 2024-04-25T09:59:02.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.271+0000 7f0117ef5640 1 -- 172.21.15.7:0/1636353498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f011015a590 con 0x7f011006c6c0 2024-04-25T09:59:02.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.271+0000 7f01067fc640 1 -- 172.21.15.7:0/1636353498 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c00ba00 con 0x7f011006c6c0 2024-04-25T09:59:02.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.271+0000 7f0117ef5640 1 -- 172.21.15.7:0/1636353498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0110159dd0 con 0x7f011006c6c0 2024-04-25T09:59:02.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.272+0000 7f0117ef5640 1 -- 172.21.15.7:0/1636353498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0110068fd0 con 0x7f011006c6c0 2024-04-25T09:59:02.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.272+0000 7f01067fc640 1 -- 172.21.15.7:0/1636353498 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f010c00bba0 con 0x7f011006c6c0 2024-04-25T09:59:02.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.273+0000 7f01067fc640 1 --2- 172.21.15.7:0/1636353498 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f00f406b500 0x7f00f406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:02.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.273+0000 7f0115490640 1 --2- 172.21.15.7:0/1636353498 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f00f406b500 0x7f00f406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:02.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.273+0000 7f01067fc640 1 -- 172.21.15.7:0/1636353498 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f010c08a820 con 0x7f011006c6c0 2024-04-25T09:59:02.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.273+0000 7f0115490640 1 --2- 172.21.15.7:0/1636353498 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f00f406b500 0x7f00f406d9c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f01100cc110 tx=0x7f0100009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:02.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.277+0000 7f01067fc640 1 -- 172.21.15.7:0/1636353498 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f010c0594c0 con 0x7f011006c6c0 2024-04-25T09:59:02.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.501+0000 7f0117ef5640 1 -- 172.21.15.7:0/1636353498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01100d1620 con 0x7f011006c6c0 2024-04-25T09:59:02.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.501+0000 7f01067fc640 1 -- 172.21.15.7:0/1636353498 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f010c058dc0 con 0x7f011006c6c0 2024-04-25T09:59:02.506 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:59:02.506 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1781470369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1781470369},{"type":"v1","addr":"172.21.15.55:6835","nonce":1781470369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6442,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1406578404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1406578404},{"type":"v1","addr":"172.21.15.55:6834","nonce":1406578404}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6810,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1839614891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1839614891},{"type":"v1","addr":"172.21.15.7:6835","nonce":1839614891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:58:45.628406+0000","modified":"2024-04-25T09:59:01.396161+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6813},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6813":{"gid":6813,"name":"c","rank":0,"incarnation":40,"state":"up:rejoin","state_seq":7,"addr":"172.21.15.7:6837/3690076929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3690076929},{"type":"v1","addr":"172.21.15.7:6837","nonce":3690076929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:59:02.506 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 42 2024-04-25T09:59:02.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.503+0000 7f0117ef5640 1 -- 172.21.15.7:0/1636353498 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f00f406b500 msgr2=0x7f00f406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:02.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.503+0000 7f0117ef5640 1 --2- 172.21.15.7:0/1636353498 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f00f406b500 0x7f00f406d9c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f01100cc110 tx=0x7f0100009040 comp rx=0 tx=0).stop 2024-04-25T09:59:02.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.503+0000 7f0117ef5640 1 -- 172.21.15.7:0/1636353498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f011006c6c0 msgr2=0x7f011015f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:02.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.503+0000 7f0117ef5640 1 --2- 172.21.15.7:0/1636353498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f011006c6c0 0x7f011015f780 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f010c00d620 tx=0x7f010c00dae0 comp rx=0 tx=0).stop 2024-04-25T09:59:02.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.503+0000 7f0117ef5640 1 -- 172.21.15.7:0/1636353498 shutdown_connections 2024-04-25T09:59:02.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.503+0000 7f0117ef5640 1 --2- 172.21.15.7:0/1636353498 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f00f406b500 0x7f00f406d9c0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:02.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.503+0000 7f0117ef5640 1 --2- 172.21.15.7:0/1636353498 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f011015dd00 0x7f0110159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:02.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.503+0000 7f0117ef5640 1 --2- 172.21.15.7:0/1636353498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01100b6a40 0x7f0110159350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:02.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.503+0000 7f0117ef5640 1 --2- 172.21.15.7:0/1636353498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f011006c6c0 0x7f011015f780 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:02.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.503+0000 7f0117ef5640 1 -- 172.21.15.7:0/1636353498 >> 172.21.15.7:0/1636353498 conn(0x7f01100d07b0 msgr2=0x7f01100b7880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:02.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.504+0000 7f0117ef5640 1 -- 172.21.15.7:0/1636353498 shutdown_connections 2024-04-25T09:59:02.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:02.504+0000 7f0117ef5640 1 -- 172.21.15.7:0/1636353498 wait complete. 2024-04-25T09:59:02.921 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 42, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:58:45.628406+0000', 'modified': '2024-04-25T09:59:01.396161+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 76, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6813}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6813': {'gid': 6813, 'name': 'c', 'rank': 0, 'incarnation': 40, 'state': 'up:rejoin', 'state_seq': 7, 'addr': '172.21.15.7:6837/3690076929', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6836', 'nonce': 3690076929}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 3690076929}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:59:02.922 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6813:up:rejoin 2024-04-25T09:59:03.922 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:59:04.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.031+0000 7fa18379e640 1 Processor -- start 2024-04-25T09:59:04.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.031+0000 7fa18379e640 1 -- start start 2024-04-25T09:59:04.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.032+0000 7fa18379e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa17c15d7b0 0x7fa17c06fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.032+0000 7fa18379e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa17c0b53c0 0x7fa17c06ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.032+0000 7fa18379e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa17c0b5850 0x7fa17c06b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.032+0000 7fa18379e640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa17c1618f0 con 0x7fa17c0b53c0 2024-04-25T09:59:04.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.032+0000 7fa18379e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa17c161bd0 con 0x7fa17c15d7b0 2024-04-25T09:59:04.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.032+0000 7fa18379e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c161eb0 con 0x7fa17c0b5850 2024-04-25T09:59:04.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.032+0000 7fa180d39640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa17c0b53c0 0x7fa17c06ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:04.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.032+0000 7fa180d39640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa17c0b53c0 0x7fa17c06ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33746/0 (socket says 172.21.15.7:33746) 2024-04-25T09:59:04.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.032+0000 7fa180d39640 1 -- 172.21.15.7:0/1893325150 learned_addr learned my addr 172.21.15.7:0/1893325150 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:04.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.033+0000 7fa181d3b640 1 --2- 172.21.15.7:0/1893325150 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa17c0b5850 0x7fa17c06b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:04.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.033+0000 7fa18153a640 1 --2- 172.21.15.7:0/1893325150 >> v2:172.21.15.55:3300/0 conn(0x7fa17c15d7b0 0x7fa17c06fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:04.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.033+0000 7fa180d39640 1 -- 172.21.15.7:0/1893325150 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa17c0b5850 msgr2=0x7fa17c06b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:04.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.033+0000 7fa180d39640 1 --2- 172.21.15.7:0/1893325150 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa17c0b5850 0x7fa17c06b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.033+0000 7fa180d39640 1 -- 172.21.15.7:0/1893325150 >> v2:172.21.15.55:3300/0 conn(0x7fa17c15d7b0 msgr2=0x7fa17c06fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:04.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.033+0000 7fa180d39640 1 --2- 172.21.15.7:0/1893325150 >> v2:172.21.15.55:3300/0 conn(0x7fa17c15d7b0 0x7fa17c06fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.033+0000 7fa180d39640 1 -- 172.21.15.7:0/1893325150 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa17c162190 con 0x7fa17c0b53c0 2024-04-25T09:59:04.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.033+0000 7fa18153a640 1 --2- 172.21.15.7:0/1893325150 >> v2:172.21.15.55:3300/0 conn(0x7fa17c15d7b0 0x7fa17c06fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:59:04.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.033+0000 7fa180d39640 1 --2- 172.21.15.7:0/1893325150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa17c0b53c0 0x7fa17c06ab60 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fa17c06dd00 tx=0x7fa17002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f769fb4cc03edb2e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:04.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.034+0000 7fa17bfff640 1 -- 172.21.15.7:0/1893325150 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa170037070 con 0x7fa17c0b53c0 2024-04-25T09:59:04.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.034+0000 7fa17bfff640 1 -- 172.21.15.7:0/1893325150 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa170032440 con 0x7fa17c0b53c0 2024-04-25T09:59:04.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.034+0000 7fa17bfff640 1 -- 172.21.15.7:0/1893325150 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa170032810 con 0x7fa17c0b53c0 2024-04-25T09:59:04.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.034+0000 7fa18379e640 1 -- 172.21.15.7:0/1893325150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa17c0b53c0 msgr2=0x7fa17c06ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:04.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.034+0000 7fa18379e640 1 --2- 172.21.15.7:0/1893325150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa17c0b53c0 0x7fa17c06ab60 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fa17c06dd00 tx=0x7fa17002a1e0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.034+0000 7fa18379e640 1 -- 172.21.15.7:0/1893325150 shutdown_connections 2024-04-25T09:59:04.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.034+0000 7fa18379e640 1 --2- 172.21.15.7:0/1893325150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa17c0b53c0 0x7fa17c06ab60 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.034+0000 7fa18379e640 1 --2- 172.21.15.7:0/1893325150 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa17c0b5850 0x7fa17c06b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.034+0000 7fa18379e640 1 --2- 172.21.15.7:0/1893325150 >> v2:172.21.15.55:3300/0 conn(0x7fa17c15d7b0 0x7fa17c06fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.034+0000 7fa18379e640 1 -- 172.21.15.7:0/1893325150 >> 172.21.15.7:0/1893325150 conn(0x7fa17c0b2390 msgr2=0x7fa17c0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:04.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.034+0000 7fa18379e640 1 -- 172.21.15.7:0/1893325150 shutdown_connections 2024-04-25T09:59:04.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.034+0000 7fa18379e640 1 -- 172.21.15.7:0/1893325150 wait complete. 2024-04-25T09:59:04.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.035+0000 7fa18379e640 1 Processor -- start 2024-04-25T09:59:04.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.036+0000 7fa18379e640 1 -- start start 2024-04-25T09:59:04.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.036+0000 7fa18379e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa17c0b53c0 0x7fa17c0c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.036+0000 7fa18379e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa17c0b5850 0x7fa17c0aa540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.036+0000 7fa18379e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa17c15d7b0 0x7fa17c0aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.036+0000 7fa18379e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c0b3bf0 con 0x7fa17c15d7b0 2024-04-25T09:59:04.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.036+0000 7fa18379e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c0b3a70 con 0x7fa17c0b5850 2024-04-25T09:59:04.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.036+0000 7fa18379e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c0b3d70 con 0x7fa17c0b53c0 2024-04-25T09:59:04.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.036+0000 7fa181d3b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa17c15d7b0 0x7fa17c0aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:04.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.036+0000 7fa18153a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa17c0b53c0 0x7fa17c0c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:04.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.036+0000 7fa181d3b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa17c15d7b0 0x7fa17c0aaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33748/0 (socket says 172.21.15.7:33748) 2024-04-25T09:59:04.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.036+0000 7fa181d3b640 1 -- 172.21.15.7:0/1337767275 learned_addr learned my addr 172.21.15.7:0/1337767275 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:04.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.036+0000 7fa180d39640 1 --2- 172.21.15.7:0/1337767275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa17c0b5850 0x7fa17c0aa540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:04.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.037+0000 7fa181d3b640 1 -- 172.21.15.7:0/1337767275 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa17c0b53c0 msgr2=0x7fa17c0c9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:04.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.037+0000 7fa181d3b640 1 --2- 172.21.15.7:0/1337767275 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa17c0b53c0 0x7fa17c0c9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.037+0000 7fa181d3b640 1 -- 172.21.15.7:0/1337767275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa17c0b5850 msgr2=0x7fa17c0aa540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:04.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.037+0000 7fa181d3b640 1 --2- 172.21.15.7:0/1337767275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa17c0b5850 0x7fa17c0aa540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.037+0000 7fa181d3b640 1 -- 172.21.15.7:0/1337767275 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa17c0ca310 con 0x7fa17c15d7b0 2024-04-25T09:59:04.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.037+0000 7fa181d3b640 1 --2- 172.21.15.7:0/1337767275 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa17c15d7b0 0x7fa17c0aaa80 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fa16c00cd70 tx=0x7fa16c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:04.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.037+0000 7fa179ffb640 1 -- 172.21.15.7:0/1337767275 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c003b90 con 0x7fa17c15d7b0 2024-04-25T09:59:04.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.037+0000 7fa179ffb640 1 -- 172.21.15.7:0/1337767275 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa16c003d30 con 0x7fa17c15d7b0 2024-04-25T09:59:04.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.037+0000 7fa18379e640 1 -- 172.21.15.7:0/1337767275 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa17c0ca5f0 con 0x7fa17c15d7b0 2024-04-25T09:59:04.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.037+0000 7fa179ffb640 1 -- 172.21.15.7:0/1337767275 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c004240 con 0x7fa17c15d7b0 2024-04-25T09:59:04.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.037+0000 7fa18379e640 1 -- 172.21.15.7:0/1337767275 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa17c0cabb0 con 0x7fa17c15d7b0 2024-04-25T09:59:04.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.038+0000 7fa18379e640 1 -- 172.21.15.7:0/1337767275 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa17c0a9fd0 con 0x7fa17c15d7b0 2024-04-25T09:59:04.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.039+0000 7fa179ffb640 1 -- 172.21.15.7:0/1337767275 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa16c0043e0 con 0x7fa17c15d7b0 2024-04-25T09:59:04.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.039+0000 7fa179ffb640 1 --2- 172.21.15.7:0/1337767275 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa16806b500 0x7fa16806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.040+0000 7fa179ffb640 1 -- 172.21.15.7:0/1337767275 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fa16c08adc0 con 0x7fa17c15d7b0 2024-04-25T09:59:04.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.040+0000 7fa18153a640 1 --2- 172.21.15.7:0/1337767275 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa16806b500 0x7fa16806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:04.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.040+0000 7fa18153a640 1 --2- 172.21.15.7:0/1337767275 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa16806b500 0x7fa16806d9c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa17400aae0 tx=0x7fa174008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:04.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.044+0000 7fa179ffb640 1 -- 172.21.15.7:0/1337767275 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa17c0a9fd0 con 0x7fa17c15d7b0 2024-04-25T09:59:04.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.260+0000 7fa18379e640 1 -- 172.21.15.7:0/1337767275 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa17c068fd0 con 0x7fa17c15d7b0 2024-04-25T09:59:04.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.261+0000 7fa179ffb640 1 -- 172.21.15.7:0/1337767275 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4935 (secure 0 0 0) 0x7fa16c059410 con 0x7fa17c15d7b0 2024-04-25T09:59:04.265 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:59:04.266 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1781470369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1781470369},{"type":"v1","addr":"172.21.15.55:6835","nonce":1781470369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6442,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1406578404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1406578404},{"type":"v1","addr":"172.21.15.55:6834","nonce":1406578404}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6810,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1839614891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1839614891},{"type":"v1","addr":"172.21.15.7:6835","nonce":1839614891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:58:45.628406+0000","modified":"2024-04-25T09:59:02.407774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6813},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6813":{"gid":6813,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":8,"addr":"172.21.15.7:6837/3690076929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3690076929},{"type":"v1","addr":"172.21.15.7:6837","nonce":3690076929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:59:04.266 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 43 2024-04-25T09:59:04.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.263+0000 7fa18379e640 1 -- 172.21.15.7:0/1337767275 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa16806b500 msgr2=0x7fa16806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:04.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.263+0000 7fa18379e640 1 --2- 172.21.15.7:0/1337767275 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa16806b500 0x7fa16806d9c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa17400aae0 tx=0x7fa174008040 comp rx=0 tx=0).stop 2024-04-25T09:59:04.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.263+0000 7fa18379e640 1 -- 172.21.15.7:0/1337767275 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa17c15d7b0 msgr2=0x7fa17c0aaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:04.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.263+0000 7fa18379e640 1 --2- 172.21.15.7:0/1337767275 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa17c15d7b0 0x7fa17c0aaa80 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fa16c00cd70 tx=0x7fa16c00a660 comp rx=0 tx=0).stop 2024-04-25T09:59:04.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.263+0000 7fa18379e640 1 -- 172.21.15.7:0/1337767275 shutdown_connections 2024-04-25T09:59:04.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.263+0000 7fa18379e640 1 --2- 172.21.15.7:0/1337767275 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa16806b500 0x7fa16806d9c0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.263+0000 7fa18379e640 1 --2- 172.21.15.7:0/1337767275 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa17c15d7b0 0x7fa17c0aaa80 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.263+0000 7fa18379e640 1 --2- 172.21.15.7:0/1337767275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa17c0b5850 0x7fa17c0aa540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.263+0000 7fa18379e640 1 --2- 172.21.15.7:0/1337767275 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa17c0b53c0 0x7fa17c0c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.263+0000 7fa18379e640 1 -- 172.21.15.7:0/1337767275 >> 172.21.15.7:0/1337767275 conn(0x7fa17c0b2390 msgr2=0x7fa17c06ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:04.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.263+0000 7fa18379e640 1 -- 172.21.15.7:0/1337767275 shutdown_connections 2024-04-25T09:59:04.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.263+0000 7fa18379e640 1 -- 172.21.15.7:0/1337767275 wait complete. 2024-04-25T09:59:04.680 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:58:45.628406+0000', 'modified': '2024-04-25T09:59:02.407774+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 76, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6813}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6813': {'gid': 6813, 'name': 'c', 'rank': 0, 'incarnation': 40, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.7:6837/3690076929', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6836', 'nonce': 3690076929}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 3690076929}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:59:04.680 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:59:04.680 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T09:59:04.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.783+0000 7f7698688640 1 Processor -- start 2024-04-25T09:59:04.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.783+0000 7f7698688640 1 -- start start 2024-04-25T09:59:04.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.784+0000 7f7698688640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f76900d0a50 0x7f76900d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.784+0000 7f7698688640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76900d1e80 con 0x7f769015db00 2024-04-25T09:59:04.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.784+0000 7f7698688640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76900b5930 con 0x7f76900b53b0 2024-04-25T09:59:04.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.784+0000 7f7698688640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76900b5c10 con 0x7f76900d0a50 2024-04-25T09:59:04.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.784+0000 7f7695c23640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f76900d0a50 0x7f76900d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:04.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.784+0000 7f7695c23640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f76900d0a50 0x7f76900d2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33752/0 (socket says 172.21.15.7:33752) 2024-04-25T09:59:04.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.784+0000 7f7695c23640 1 -- 172.21.15.7:0/74155889 learned_addr learned my addr 172.21.15.7:0/74155889 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:04.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.784+0000 7f7696424640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f769015db00 0x7f76900d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33678/0 (socket says 172.21.15.7:33678) 2024-04-25T09:59:04.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.784+0000 7f7695c23640 1 -- 172.21.15.7:0/74155889 >> v1:172.21.15.55:6789/0 conn(0x7f76900b53b0 legacy=0x7f76900d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:04.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.784+0000 7f7695c23640 1 -- 172.21.15.7:0/74155889 >> v1:172.21.15.7:6789/0 conn(0x7f769015db00 legacy=0x7f76900d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:04.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.784+0000 7f7695c23640 1 -- 172.21.15.7:0/74155889 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76900b5ef0 con 0x7f76900d0a50 2024-04-25T09:59:04.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.784+0000 7f7695422640 1 -- 172.21.15.7:0/74155889 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1763740296 0 0) 0x7f76900d1e80 con 0x7f769015db00 2024-04-25T09:59:04.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.785+0000 7f7695c23640 1 --2- 172.21.15.7:0/74155889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76900d0a50 0x7f76900d2330 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f7680009870 tx=0x7f768002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e9f48443c29e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:04.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.785+0000 7f7695422640 1 -- 172.21.15.7:0/74155889 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7680037070 con 0x7f76900d0a50 2024-04-25T09:59:04.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.785+0000 7f7695422640 1 -- 172.21.15.7:0/74155889 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768002ae50 con 0x7f76900d0a50 2024-04-25T09:59:04.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.785+0000 7f7695422640 1 -- 172.21.15.7:0/74155889 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7680032860 con 0x7f76900d0a50 2024-04-25T09:59:04.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.786+0000 7f7698688640 1 -- 172.21.15.7:0/74155889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76900d0a50 msgr2=0x7f76900d2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:04.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.786+0000 7f7698688640 1 --2- 172.21.15.7:0/74155889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76900d0a50 0x7f76900d2330 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f7680009870 tx=0x7f768002a300 comp rx=0 tx=0).stop 2024-04-25T09:59:04.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.786+0000 7f7698688640 1 -- 172.21.15.7:0/74155889 shutdown_connections 2024-04-25T09:59:04.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.786+0000 7f7698688640 1 --2- 172.21.15.7:0/74155889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76900d0a50 0x7f76900d2330 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.786+0000 7f7698688640 1 -- 172.21.15.7:0/74155889 >> 172.21.15.7:0/74155889 conn(0x7f7690072290 msgr2=0x7f76900726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:04.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.786+0000 7f7698688640 1 -- 172.21.15.7:0/74155889 shutdown_connections 2024-04-25T09:59:04.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.786+0000 7f7698688640 1 -- 172.21.15.7:0/74155889 wait complete. 2024-04-25T09:59:04.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.787+0000 7f7698688640 1 Processor -- start 2024-04-25T09:59:04.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.787+0000 7f7698688640 1 -- start start 2024-04-25T09:59:04.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.788+0000 7f7698688640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76900b53b0 0x7f769014e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.788+0000 7f7698688640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76900d0a50 0x7f76900c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.788+0000 7f7698688640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f769015db00 0x7f76900d2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.788+0000 7f7698688640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76900d3660 con 0x7f76900b53b0 2024-04-25T09:59:04.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.788+0000 7f7698688640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76900b61d0 con 0x7f76900d0a50 2024-04-25T09:59:04.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.788+0000 7f7698688640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76900d2f80 con 0x7f769015db00 2024-04-25T09:59:04.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.788+0000 7f7696424640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76900b53b0 0x7f769014e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:04.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.788+0000 7f7696424640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76900b53b0 0x7f769014e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33756/0 (socket says 172.21.15.7:33756) 2024-04-25T09:59:04.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.788+0000 7f7696424640 1 -- 172.21.15.7:0/3484243926 learned_addr learned my addr 172.21.15.7:0/3484243926 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:04.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.788+0000 7f7695c23640 1 --2- 172.21.15.7:0/3484243926 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76900d0a50 0x7f76900c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:04.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.788+0000 7f7696c25640 1 --2- 172.21.15.7:0/3484243926 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f769015db00 0x7f76900d2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:04.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.788+0000 7f7696424640 1 -- 172.21.15.7:0/3484243926 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f769015db00 msgr2=0x7f76900d2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:04.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.788+0000 7f7696424640 1 --2- 172.21.15.7:0/3484243926 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f769015db00 0x7f76900d2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.788+0000 7f7696424640 1 -- 172.21.15.7:0/3484243926 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76900d0a50 msgr2=0x7f76900c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:04.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.788+0000 7f7696424640 1 --2- 172.21.15.7:0/3484243926 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76900d0a50 0x7f76900c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.788+0000 7f7696424640 1 -- 172.21.15.7:0/3484243926 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76900caf00 con 0x7f76900b53b0 2024-04-25T09:59:04.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.788+0000 7f7695c23640 1 --2- 172.21.15.7:0/3484243926 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76900d0a50 0x7f76900c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:59:04.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.788+0000 7f7696c25640 1 --2- 172.21.15.7:0/3484243926 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f769015db00 0x7f76900d2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:59:04.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.788+0000 7f7696424640 1 --2- 172.21.15.7:0/3484243926 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76900b53b0 0x7f769014e910 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f768c00c3f0 tx=0x7f768c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:04.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.789+0000 7f7686ffd640 1 -- 172.21.15.7:0/3484243926 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c0074e0 con 0x7f76900b53b0 2024-04-25T09:59:04.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.789+0000 7f7686ffd640 1 -- 172.21.15.7:0/3484243926 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768c0047e0 con 0x7f76900b53b0 2024-04-25T09:59:04.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.789+0000 7f7698688640 1 -- 172.21.15.7:0/3484243926 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76900cb1e0 con 0x7f76900b53b0 2024-04-25T09:59:04.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.789+0000 7f7686ffd640 1 -- 172.21.15.7:0/3484243926 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c004bd0 con 0x7f76900b53b0 2024-04-25T09:59:04.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.789+0000 7f7698688640 1 -- 172.21.15.7:0/3484243926 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76900cb7a0 con 0x7f76900b53b0 2024-04-25T09:59:04.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.791+0000 7f7686ffd640 1 -- 172.21.15.7:0/3484243926 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f768c011070 con 0x7f76900b53b0 2024-04-25T09:59:04.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.791+0000 7f7686ffd640 1 --2- 172.21.15.7:0/3484243926 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f767406b4d0 0x7f767406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.791+0000 7f7686ffd640 1 -- 172.21.15.7:0/3484243926 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f768c089f80 con 0x7f76900b53b0 2024-04-25T09:59:04.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.791+0000 7f7695c23640 1 --2- 172.21.15.7:0/3484243926 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f767406b4d0 0x7f767406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:04.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.792+0000 7f7695c23640 1 --2- 172.21.15.7:0/3484243926 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f767406b4d0 0x7f767406d990 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7680034000 tx=0x7f768002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:04.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.792+0000 7f769b388740 1 Processor -- start 2024-04-25T09:59:04.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.792+0000 7f769b388740 1 -- start start 2024-04-25T09:59:04.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.793+0000 7f769b388740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c0aabd230 0x556c0aabd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.793+0000 7f769b388740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556c0aadaad0 0x556c0aadb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.793+0000 7f769b388740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556c0aa92f10 0x556c0aad9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.793+0000 7f769b388740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c0a9f5a10 con 0x556c0aabd230 2024-04-25T09:59:04.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.793+0000 7f769b388740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c0a99eb30 con 0x556c0aa92f10 2024-04-25T09:59:04.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.793+0000 7f769b388740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c0a9f1c50 con 0x556c0aadaad0 2024-04-25T09:59:04.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.793+0000 7f7696424640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c0aabd230 0x556c0aabd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:04.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.793+0000 7f7696424640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c0aabd230 0x556c0aabd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33760/0 (socket says 172.21.15.7:33760) 2024-04-25T09:59:04.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.793+0000 7f7696424640 1 -- 172.21.15.7:0/2293563402 learned_addr learned my addr 172.21.15.7:0/2293563402 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:04.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.793+0000 7f7696424640 1 -- 172.21.15.7:0/2293563402 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556c0aadaad0 msgr2=0x556c0aadb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:04.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.793+0000 7f7696424640 1 --2- 172.21.15.7:0/2293563402 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556c0aadaad0 0x556c0aadb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.793+0000 7f7696424640 1 -- 172.21.15.7:0/2293563402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556c0aa92f10 msgr2=0x556c0aad9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:04.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.793+0000 7f7696c25640 1 --2- 172.21.15.7:0/2293563402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556c0aa92f10 0x556c0aad9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:04.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.793+0000 7f7696424640 1 --2- 172.21.15.7:0/2293563402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556c0aa92f10 0x556c0aad9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.793+0000 7f7696424640 1 -- 172.21.15.7:0/2293563402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c0a9b3e10 con 0x556c0aabd230 2024-04-25T09:59:04.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.793+0000 7f7696c25640 1 --2- 172.21.15.7:0/2293563402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556c0aa92f10 0x556c0aad9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:59:04.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.793+0000 7f7696424640 1 --2- 172.21.15.7:0/2293563402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c0aabd230 0x556c0aabd610 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f768c088300 tx=0x7f768c058010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=102fbd889bc9f536 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:04.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.793+0000 7f7673fff640 1 -- 172.21.15.7:0/2293563402 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c060cc0 con 0x556c0aabd230 2024-04-25T09:59:04.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.793+0000 7f7673fff640 1 -- 172.21.15.7:0/2293563402 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768c010da0 con 0x556c0aabd230 2024-04-25T09:59:04.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.793+0000 7f7673fff640 1 -- 172.21.15.7:0/2293563402 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c004d70 con 0x556c0aabd230 2024-04-25T09:59:04.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.794+0000 7f769b388740 1 -- 172.21.15.7:0/2293563402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c0aabd230 msgr2=0x556c0aabd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:04.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.794+0000 7f769b388740 1 --2- 172.21.15.7:0/2293563402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c0aabd230 0x556c0aabd610 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f768c088300 tx=0x7f768c058010 comp rx=0 tx=0).stop 2024-04-25T09:59:04.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.794+0000 7f769b388740 1 -- 172.21.15.7:0/2293563402 shutdown_connections 2024-04-25T09:59:04.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.794+0000 7f769b388740 1 --2- 172.21.15.7:0/2293563402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556c0aa92f10 0x556c0aad9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.794+0000 7f769b388740 1 --2- 172.21.15.7:0/2293563402 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556c0aadaad0 0x556c0aadb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.794+0000 7f769b388740 1 --2- 172.21.15.7:0/2293563402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c0aabd230 0x556c0aabd610 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.794+0000 7f769b388740 1 -- 172.21.15.7:0/2293563402 >> 172.21.15.7:0/2293563402 conn(0x556c0aa8f840 msgr2=0x556c0aad8040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:04.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.794+0000 7f769b388740 1 -- 172.21.15.7:0/2293563402 shutdown_connections 2024-04-25T09:59:04.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.794+0000 7f769b388740 1 -- 172.21.15.7:0/2293563402 wait complete. 2024-04-25T09:59:04.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.795+0000 7f769b388740 1 -- start start 2024-04-25T09:59:04.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.795+0000 7f769b388740 1 Processor -- start 2024-04-25T09:59:04.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.796+0000 7f769b388740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c0aabd230 0x556c0aacf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.796+0000 7f769b388740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556c0aadaad0 0x556c0aac0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.796+0000 7f769b388740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556c0aad08c0 0x556c0aad0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.796+0000 7f769b388740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c0aa93cb0 con 0x556c0aabd230 2024-04-25T09:59:04.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.796+0000 7f769b388740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c0a9b20c0 con 0x556c0aadaad0 2024-04-25T09:59:04.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.796+0000 7f769b388740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c0aa8d770 con 0x556c0aad08c0 2024-04-25T09:59:04.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.796+0000 7f769b388740 10 client.0 _ll_register_callbacks cb 0x556c0a9a5ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:59:04.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.796+0000 7f7696424640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c0aabd230 0x556c0aacf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:04.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.796+0000 7f7696424640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c0aabd230 0x556c0aacf0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33768/0 (socket says 172.21.15.7:33768) 2024-04-25T09:59:04.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.796+0000 7f7696424640 1 -- 172.21.15.7:0/3711739655 learned_addr learned my addr 172.21.15.7:0/3711739655 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:04.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.796+0000 7f7696c25640 1 --2- 172.21.15.7:0/3711739655 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556c0aad08c0 0x556c0aad0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:04.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.796+0000 7f7695c23640 1 --2- 172.21.15.7:0/3711739655 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556c0aadaad0 0x556c0aac0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:04.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.796+0000 7f7696424640 1 -- 172.21.15.7:0/3711739655 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556c0aad08c0 msgr2=0x556c0aad0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:04.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.796+0000 7f7696424640 1 --2- 172.21.15.7:0/3711739655 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556c0aad08c0 0x556c0aad0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.796+0000 7f7696424640 1 -- 172.21.15.7:0/3711739655 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556c0aadaad0 msgr2=0x556c0aac0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:04.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.796+0000 7f7696424640 1 --2- 172.21.15.7:0/3711739655 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556c0aadaad0 0x556c0aac0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.796+0000 7f7696424640 1 -- 172.21.15.7:0/3711739655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556c0a70a2d0 con 0x556c0aabd230 2024-04-25T09:59:04.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.796+0000 7f7696c25640 1 --2- 172.21.15.7:0/3711739655 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556c0aad08c0 0x556c0aad0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:59:04.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.796+0000 7f7695c23640 1 --2- 172.21.15.7:0/3711739655 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556c0aadaad0 0x556c0aac0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:59:04.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.796+0000 7f7696424640 1 --2- 172.21.15.7:0/3711739655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c0aabd230 0x556c0aacf0f0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f768c0582b0 tx=0x7f768c05b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d740c63a5e3833e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:04.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.796+0000 7f76717fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:59:04.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.796+0000 7f76717fa640 1 -- 172.21.15.7:0/3711739655 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c077060 con 0x556c0aabd230 2024-04-25T09:59:04.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.796+0000 7f76717fa640 1 -- 172.21.15.7:0/3711739655 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f768c004d70 con 0x556c0aabd230 2024-04-25T09:59:04.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.796+0000 7f769b388740 1 -- 172.21.15.7:0/3711739655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f768c010da0 con 0x556c0aabd230 2024-04-25T09:59:04.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.796+0000 7f76717fa640 1 -- 172.21.15.7:0/3711739655 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f768c07d050 con 0x556c0aabd230 2024-04-25T09:59:04.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.796+0000 7f769b388740 10 client.7119 fetch_fsmap learned FSMap version 43 2024-04-25T09:59:04.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.796+0000 7f769b388740 1 -- 172.21.15.7:0/3711739655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x556c0a7d46b0 con 0x556c0aabd230 2024-04-25T09:59:04.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.797+0000 7f76717fa640 1 -- 172.21.15.7:0/3711739655 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768c010da0 con 0x556c0aabd230 2024-04-25T09:59:04.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.797+0000 7f76717fa640 1 -- 172.21.15.7:0/3711739655 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 43) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f768c080020 con 0x556c0aabd230 2024-04-25T09:59:04.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.797+0000 7f769b388740 10 client.7119 fetch_fsmap finished waiting for FSMap version 43 2024-04-25T09:59:04.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.797+0000 7f769b388740 10 client.7119 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:59:04.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.797+0000 7f769b388740 20 client.7119 populate_metadata read hostname 'smithi007' 2024-04-25T09:59:04.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.797+0000 7f769b388740 1 --2- 172.21.15.7:0/3711739655 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x556c0aaf3da0 0x556c0aaf6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.797+0000 7f769b388740 4 client.7119 mds_command: new command op to 6813 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:59:04.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.797+0000 7f769b388740 1 -- 172.21.15.7:0/3711739655 --> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556c0aa54920 con 0x556c0aaf3da0 2024-04-25T09:59:04.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.797+0000 7f7695c23640 1 --2- 172.21.15.7:0/3711739655 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x556c0aaf3da0 0x556c0aaf6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:04.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.797+0000 7f7695c23640 1 --2- 172.21.15.7:0/3711739655 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x556c0aaf3da0 0x556c0aaf6190 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a77e0a9ee9e127f5 server_cookie=98bd85d3a2469380 in_seq=0 out_seq=0 2024-04-25T09:59:04.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.797+0000 7f76717fa640 10 client.7119 ms_handle_connect on v2:172.21.15.7:6836/3690076929 2024-04-25T09:59:04.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.798+0000 7f76717fa640 1 -- 172.21.15.7:0/3711739655 <== mds.0 v2:172.21.15.7:6836/3690076929 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556c0aa54920 con 0x556c0aaf3da0 2024-04-25T09:59:04.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.798+0000 7f76717fa640 10 client.7119 handle_command_reply: tid=0 2024-04-25T09:59:04.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.798+0000 7f769b388740 1 client.7119 shutdown 2024-04-25T09:59:04.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.798+0000 7f769b388740 1 -- 172.21.15.7:0/3711739655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c0aabd230 msgr2=0x556c0aacf0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:04.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.798+0000 7f769b388740 1 --2- 172.21.15.7:0/3711739655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c0aabd230 0x556c0aacf0f0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f768c0582b0 tx=0x7f768c05b040 comp rx=0 tx=0).stop 2024-04-25T09:59:04.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.798+0000 7f769b388740 1 -- 172.21.15.7:0/3711739655 shutdown_connections 2024-04-25T09:59:04.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.798+0000 7f769b388740 1 --2- 172.21.15.7:0/3711739655 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556c0aad08c0 0x556c0aad0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.798+0000 7f769b388740 1 --2- 172.21.15.7:0/3711739655 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x556c0aaf3da0 0x556c0aaf6190 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.798+0000 7f769b388740 1 --2- 172.21.15.7:0/3711739655 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556c0aadaad0 0x556c0aac0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.798+0000 7f769b388740 1 --2- 172.21.15.7:0/3711739655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c0aabd230 0x556c0aacf0f0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.798+0000 7f76717fa640 0 client.7119 ms_handle_reset on v2:172.21.15.7:6836/3690076929 2024-04-25T09:59:04.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.798+0000 7f769b388740 1 -- 172.21.15.7:0/3711739655 >> 172.21.15.7:0/3711739655 conn(0x556c0aa92f10 msgr2=0x556c0aadb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:04.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.798+0000 7f769b388740 1 -- 172.21.15.7:0/3711739655 shutdown_connections 2024-04-25T09:59:04.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.798+0000 7f769b388740 1 -- 172.21.15.7:0/3711739655 wait complete. 2024-04-25T09:59:04.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.798+0000 7f769b388740 20 client.7119 trim_cache size 0 max 16384 2024-04-25T09:59:04.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.814+0000 7f769b388740 1 Processor -- start 2024-04-25T09:59:04.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.814+0000 7f769b388740 1 -- start start 2024-04-25T09:59:04.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.815+0000 7f769b388740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556c0aabd230 0x556c0aad87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.815+0000 7f769b388740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c0aad08c0 0x556c0aabb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.815+0000 7f769b388740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556c0aadaad0 0x556c0aabb950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.815+0000 7f769b388740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76901ff5e0 con 0x556c0aad08c0 2024-04-25T09:59:04.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.815+0000 7f769b388740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7690155e20 con 0x556c0aabd230 2024-04-25T09:59:04.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.815+0000 7f769b388740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76901ff010 con 0x556c0aadaad0 2024-04-25T09:59:04.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.815+0000 7f7695c23640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c0aad08c0 0x556c0aabb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:04.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.815+0000 7f7695c23640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c0aad08c0 0x556c0aabb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33778/0 (socket says 172.21.15.7:33778) 2024-04-25T09:59:04.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.815+0000 7f7695c23640 1 -- 172.21.15.7:0/2637650717 learned_addr learned my addr 172.21.15.7:0/2637650717 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:04.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.815+0000 7f7695c23640 1 -- 172.21.15.7:0/2637650717 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556c0aadaad0 msgr2=0x556c0aabb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:04.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.815+0000 7f7695c23640 1 --2- 172.21.15.7:0/2637650717 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556c0aadaad0 0x556c0aabb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.815+0000 7f7695c23640 1 -- 172.21.15.7:0/2637650717 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556c0aabd230 msgr2=0x556c0aad87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:04.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.815+0000 7f7695c23640 1 --2- 172.21.15.7:0/2637650717 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556c0aabd230 0x556c0aad87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.815+0000 7f7695c23640 1 -- 172.21.15.7:0/2637650717 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c0aaf17d0 con 0x556c0aad08c0 2024-04-25T09:59:04.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.815+0000 7f7695c23640 1 --2- 172.21.15.7:0/2637650717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c0aad08c0 0x556c0aabb410 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f768002a340 tx=0x7f768002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6805a7d976888451 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:04.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.815+0000 7f76737fe640 1 -- 172.21.15.7:0/2637650717 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7680037040 con 0x556c0aad08c0 2024-04-25T09:59:04.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.815+0000 7f76737fe640 1 -- 172.21.15.7:0/2637650717 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768002ae50 con 0x556c0aad08c0 2024-04-25T09:59:04.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.815+0000 7f76737fe640 1 -- 172.21.15.7:0/2637650717 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768004b530 con 0x556c0aad08c0 2024-04-25T09:59:04.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.816+0000 7f769b388740 1 -- 172.21.15.7:0/2637650717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c0aad08c0 msgr2=0x556c0aabb410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:04.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.816+0000 7f769b388740 1 --2- 172.21.15.7:0/2637650717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c0aad08c0 0x556c0aabb410 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f768002a340 tx=0x7f768002c000 comp rx=0 tx=0).stop 2024-04-25T09:59:04.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.816+0000 7f769b388740 1 -- 172.21.15.7:0/2637650717 shutdown_connections 2024-04-25T09:59:04.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.816+0000 7f769b388740 1 --2- 172.21.15.7:0/2637650717 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556c0aadaad0 0x556c0aabb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.816+0000 7f769b388740 1 --2- 172.21.15.7:0/2637650717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c0aad08c0 0x556c0aabb410 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.816+0000 7f769b388740 1 --2- 172.21.15.7:0/2637650717 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556c0aabd230 0x556c0aad87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.816+0000 7f769b388740 1 -- 172.21.15.7:0/2637650717 >> 172.21.15.7:0/2637650717 conn(0x556c0aa92f10 msgr2=0x556c0aad1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:04.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.816+0000 7f769b388740 1 -- 172.21.15.7:0/2637650717 shutdown_connections 2024-04-25T09:59:04.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.816+0000 7f769b388740 1 -- 172.21.15.7:0/2637650717 wait complete. 2024-04-25T09:59:04.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.816+0000 7f769b388740 1 -- start start 2024-04-25T09:59:04.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.816+0000 7f769b388740 1 Processor -- start 2024-04-25T09:59:04.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.817+0000 7f769b388740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556c0aabd230 0x556c0aabb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.817+0000 7f769b388740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c0aad08c0 0x556c0aabb950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.817+0000 7f769b388740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556c0aadaad0 0x556c0aac0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.817+0000 7f769b388740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c0aa93cb0 con 0x556c0aad08c0 2024-04-25T09:59:04.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.817+0000 7f769b388740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c0aa8d770 con 0x556c0aadaad0 2024-04-25T09:59:04.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.817+0000 7f769b388740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c0a9b20c0 con 0x556c0aabd230 2024-04-25T09:59:04.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.817+0000 7f769b388740 10 client.0 _ll_register_callbacks cb 0x556c0aa8dc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:59:04.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.817+0000 7f7695c23640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c0aad08c0 0x556c0aabb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:04.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.817+0000 7f7695c23640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c0aad08c0 0x556c0aabb950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33788/0 (socket says 172.21.15.7:33788) 2024-04-25T09:59:04.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.817+0000 7f7695c23640 1 -- 172.21.15.7:0/3366198134 learned_addr learned my addr 172.21.15.7:0/3366198134 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:04.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.818+0000 7f7696c25640 1 --2- 172.21.15.7:0/3366198134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556c0aadaad0 0x556c0aac0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:04.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.818+0000 7f7696424640 1 --2- 172.21.15.7:0/3366198134 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556c0aabd230 0x556c0aabb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:04.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.818+0000 7f7695c23640 1 -- 172.21.15.7:0/3366198134 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556c0aabd230 msgr2=0x556c0aabb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:04.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.818+0000 7f7695c23640 1 --2- 172.21.15.7:0/3366198134 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556c0aabd230 0x556c0aabb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.818+0000 7f7695c23640 1 -- 172.21.15.7:0/3366198134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556c0aadaad0 msgr2=0x556c0aac0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:04.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.818+0000 7f7695c23640 1 --2- 172.21.15.7:0/3366198134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556c0aadaad0 0x556c0aac0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.818+0000 7f7695c23640 1 -- 172.21.15.7:0/3366198134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556c0aad6270 con 0x556c0aad08c0 2024-04-25T09:59:04.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.818+0000 7f76717fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:59:04.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.818+0000 7f7695c23640 1 --2- 172.21.15.7:0/3366198134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c0aad08c0 0x556c0aabb950 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f768004d040 tx=0x7f7680004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab4b4aa30af7b903 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:04.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.818+0000 7f76717fa640 1 -- 172.21.15.7:0/3366198134 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7680037040 con 0x556c0aad08c0 2024-04-25T09:59:04.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.818+0000 7f76717fa640 1 -- 172.21.15.7:0/3366198134 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f7680004230 con 0x556c0aad08c0 2024-04-25T09:59:04.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.818+0000 7f769b388740 1 -- 172.21.15.7:0/3366198134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f768002ae50 con 0x556c0aad08c0 2024-04-25T09:59:04.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.818+0000 7f76717fa640 1 -- 172.21.15.7:0/3366198134 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7680063050 con 0x556c0aad08c0 2024-04-25T09:59:04.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.818+0000 7f769b388740 10 client.7125 fetch_fsmap learned FSMap version 43 2024-04-25T09:59:04.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.818+0000 7f769b388740 1 -- 172.21.15.7:0/3366198134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x556c0aafa530 con 0x556c0aad08c0 2024-04-25T09:59:04.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.818+0000 7f76717fa640 1 -- 172.21.15.7:0/3366198134 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768002ae50 con 0x556c0aad08c0 2024-04-25T09:59:04.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.819+0000 7f76717fa640 1 -- 172.21.15.7:0/3366198134 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 43) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7680066020 con 0x556c0aad08c0 2024-04-25T09:59:04.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.819+0000 7f769b388740 10 client.7125 fetch_fsmap finished waiting for FSMap version 43 2024-04-25T09:59:04.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.819+0000 7f769b388740 10 client.7125 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:59:04.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.819+0000 7f769b388740 20 client.7125 populate_metadata read hostname 'smithi007' 2024-04-25T09:59:04.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.819+0000 7f769b388740 1 --2- 172.21.15.7:0/3366198134 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x556c0ab420e0 0x556c0ab424c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.819+0000 7f769b388740 4 client.7125 mds_command: new command op to 6813 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:59:04.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.819+0000 7f769b388740 1 -- 172.21.15.7:0/3366198134 --> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556c0aa02f50 con 0x556c0ab420e0 2024-04-25T09:59:04.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.819+0000 7f7696424640 1 --2- 172.21.15.7:0/3366198134 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x556c0ab420e0 0x556c0ab424c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:04.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.819+0000 7f76717fa640 10 client.7125 ms_handle_connect on v2:172.21.15.7:6836/3690076929 2024-04-25T09:59:04.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.819+0000 7f7696424640 1 --2- 172.21.15.7:0/3366198134 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x556c0ab420e0 0x556c0ab424c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ba4c7f10ff3e5bc server_cookie=ff090f3d5b6eb804 in_seq=0 out_seq=0 2024-04-25T09:59:04.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.819+0000 7f76717fa640 1 -- 172.21.15.7:0/3366198134 <== mds.0 v2:172.21.15.7:6836/3690076929 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x556c0aa02f50 con 0x556c0ab420e0 2024-04-25T09:59:04.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.819+0000 7f76717fa640 10 client.7125 handle_command_reply: tid=0 2024-04-25T09:59:04.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.819+0000 7f769b388740 1 client.7125 shutdown 2024-04-25T09:59:04.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.819+0000 7f769b388740 1 -- 172.21.15.7:0/3366198134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c0aad08c0 msgr2=0x556c0aabb950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:04.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.819+0000 7f769b388740 1 --2- 172.21.15.7:0/3366198134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c0aad08c0 0x556c0aabb950 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f768004d040 tx=0x7f7680004730 comp rx=0 tx=0).stop 2024-04-25T09:59:04.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.819+0000 7f769b388740 1 -- 172.21.15.7:0/3366198134 shutdown_connections 2024-04-25T09:59:04.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.819+0000 7f769b388740 1 --2- 172.21.15.7:0/3366198134 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x556c0ab420e0 0x556c0ab424c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.819+0000 7f769b388740 1 --2- 172.21.15.7:0/3366198134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556c0aadaad0 0x556c0aac0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.819+0000 7f769b388740 1 --2- 172.21.15.7:0/3366198134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556c0aad08c0 0x556c0aabb950 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.819+0000 7f76717fa640 0 client.7125 ms_handle_reset on v2:172.21.15.7:6836/3690076929 2024-04-25T09:59:04.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.819+0000 7f769b388740 1 --2- 172.21.15.7:0/3366198134 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556c0aabd230 0x556c0aabb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.819+0000 7f769b388740 1 -- 172.21.15.7:0/3366198134 >> 172.21.15.7:0/3366198134 conn(0x556c0aa92f10 msgr2=0x556c0aa88bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:04.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.819+0000 7f769b388740 1 -- 172.21.15.7:0/3366198134 shutdown_connections 2024-04-25T09:59:04.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.819+0000 7f769b388740 1 -- 172.21.15.7:0/3366198134 wait complete. 2024-04-25T09:59:04.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.820+0000 7f769b388740 20 client.7125 trim_cache size 0 max 16384 2024-04-25T09:59:04.832 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T09:59:04.832 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "c03d0745-5946-49c3-ad88-1165c5b68b4e", 2024-04-25T09:59:04.832 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-04-25T09:59:04.832 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 6813, 2024-04-25T09:59:04.832 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-04-25T09:59:04.832 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-04-25T09:59:04.832 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-04-25T09:59:04.832 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 4.4356337999999997, 2024-04-25T09:59:04.832 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 43, 2024-04-25T09:59:04.832 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 76, 2024-04-25T09:59:04.832 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 76, 2024-04-25T09:59:04.832 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 23.581789382 2024-04-25T09:59:04.833 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T09:59:04.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.820+0000 7f7698688640 1 -- 172.21.15.7:0/3484243926 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f767406b4d0 msgr2=0x7f767406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:04.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.820+0000 7f7698688640 1 --2- 172.21.15.7:0/3484243926 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f767406b4d0 0x7f767406d990 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7680034000 tx=0x7f768002e000 comp rx=0 tx=0).stop 2024-04-25T09:59:04.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.820+0000 7f7698688640 1 -- 172.21.15.7:0/3484243926 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76900b53b0 msgr2=0x7f769014e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:04.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.820+0000 7f7698688640 1 --2- 172.21.15.7:0/3484243926 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76900b53b0 0x7f769014e910 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f768c00c3f0 tx=0x7f768c00c8b0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.820+0000 7f7698688640 1 -- 172.21.15.7:0/3484243926 shutdown_connections 2024-04-25T09:59:04.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.820+0000 7f7698688640 1 --2- 172.21.15.7:0/3484243926 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f767406b4d0 0x7f767406d990 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.820+0000 7f7698688640 1 --2- 172.21.15.7:0/3484243926 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f769015db00 0x7f76900d2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.820+0000 7f7698688640 1 --2- 172.21.15.7:0/3484243926 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76900d0a50 0x7f76900c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.820+0000 7f7698688640 1 --2- 172.21.15.7:0/3484243926 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76900b53b0 0x7f769014e910 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.820+0000 7f7698688640 1 -- 172.21.15.7:0/3484243926 >> 172.21.15.7:0/3484243926 conn(0x7f7690072290 msgr2=0x7f76900d4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:04.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.820+0000 7f7698688640 1 -- 172.21.15.7:0/3484243926 shutdown_connections 2024-04-25T09:59:04.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.820+0000 7f7698688640 1 -- 172.21.15.7:0/3484243926 wait complete. 2024-04-25T09:59:04.835 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:59:04.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.933+0000 7f98d9530640 1 Processor -- start 2024-04-25T09:59:04.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.933+0000 7f98d9530640 1 -- start start 2024-04-25T09:59:04.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.933+0000 7f98d9530640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98d406bce0 0x7f98d409a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.933+0000 7f98d9530640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d4099b20 con 0x7f98d406c250 2024-04-25T09:59:04.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.933+0000 7f98d9530640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d4099e00 con 0x7f98d40d0360 2024-04-25T09:59:04.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.933+0000 7f98d9530640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d409ae20 con 0x7f98d406bce0 2024-04-25T09:59:04.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.934+0000 7f98d2ffd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f98d406c250 0x7f98d406c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33688/0 (socket says 172.21.15.7:33688) 2024-04-25T09:59:04.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.934+0000 7f98d2ffd640 1 -- 172.21.15.7:0/347056297 learned_addr learned my addr 172.21.15.7:0/347056297 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:59:04.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.934+0000 7f98d27fc640 1 --2- 172.21.15.7:0/347056297 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98d406bce0 0x7f98d409a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:04.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.934+0000 7f98d1ffb640 1 -- 172.21.15.7:0/347056297 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 379560498 0 0) 0x7f98d4099b20 con 0x7f98d406c250 2024-04-25T09:59:04.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.934+0000 7f98d1ffb640 1 -- 172.21.15.7:0/347056297 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98bc003520 con 0x7f98d406c250 2024-04-25T09:59:04.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.934+0000 7f98d1ffb640 1 -- 172.21.15.7:0/347056297 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188252299 0 0) 0x7f98d4099e00 con 0x7f98d40d0360 2024-04-25T09:59:04.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.934+0000 7f98d1ffb640 1 -- 172.21.15.7:0/347056297 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98d4099b20 con 0x7f98d40d0360 2024-04-25T09:59:04.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.934+0000 7f98d1ffb640 1 -- 172.21.15.7:0/347056297 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3514328883 0 0) 0x7f98bc003520 con 0x7f98d406c250 2024-04-25T09:59:04.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.934+0000 7f98d1ffb640 1 -- 172.21.15.7:0/347056297 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98d406bce0 msgr2=0x7f98d409a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:04.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.934+0000 7f98d1ffb640 1 --2- 172.21.15.7:0/347056297 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98d406bce0 0x7f98d409a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.934+0000 7f98d1ffb640 1 -- 172.21.15.7:0/347056297 >> v1:172.21.15.55:6789/0 conn(0x7f98d40d0360 legacy=0x7f98d40cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:04.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.934+0000 7f98d1ffb640 1 -- 172.21.15.7:0/347056297 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d409a0e0 con 0x7f98d406c250 2024-04-25T09:59:04.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.934+0000 7f98d1ffb640 1 -- 172.21.15.7:0/347056297 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f98c4001670 con 0x7f98d406c250 2024-04-25T09:59:04.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.934+0000 7f98d1ffb640 1 -- 172.21.15.7:0/347056297 >> v1:172.21.15.7:6789/0 conn(0x7f98d406c250 legacy=0x7f98d406c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:04.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.934+0000 7f98d1ffb640 1 --2- 172.21.15.7:0/347056297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98bc003b70 0x7f98bc003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.934+0000 7f98d1ffb640 1 --2- 172.21.15.7:0/347056297 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98d406bce0 0x7f98bc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.934+0000 7f98d1ffb640 1 --2- 172.21.15.7:0/347056297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98bc004d40 0x7f98bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.934+0000 7f98d1ffb640 1 -- 172.21.15.7:0/347056297 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d409ae20 con 0x7f98bc004d40 2024-04-25T09:59:04.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.934+0000 7f98d1ffb640 1 -- 172.21.15.7:0/347056297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98bc00bb80 con 0x7f98bc003b70 2024-04-25T09:59:04.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.934+0000 7f98d1ffb640 1 -- 172.21.15.7:0/347056297 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98bc00bd80 con 0x7f98d406bce0 2024-04-25T09:59:04.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.934+0000 7f98d37fe640 1 --2- 172.21.15.7:0/347056297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98bc004d40 0x7f98bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:04.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.934+0000 7f98d2ffd640 1 --2- 172.21.15.7:0/347056297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98bc003b70 0x7f98bc003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:04.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.934+0000 7f98d27fc640 1 --2- 172.21.15.7:0/347056297 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98d406bce0 0x7f98bc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:04.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.935+0000 7f98d37fe640 1 -- 172.21.15.7:0/347056297 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98d406bce0 msgr2=0x7f98bc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:04.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.935+0000 7f98d37fe640 1 --2- 172.21.15.7:0/347056297 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98d406bce0 0x7f98bc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.935+0000 7f98d37fe640 1 -- 172.21.15.7:0/347056297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98bc003b70 msgr2=0x7f98bc003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:04.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.935+0000 7f98d37fe640 1 --2- 172.21.15.7:0/347056297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98bc003b70 0x7f98bc003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.935+0000 7f98d37fe640 1 -- 172.21.15.7:0/347056297 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98bc003520 con 0x7f98bc004d40 2024-04-25T09:59:04.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.935+0000 7f98d37fe640 1 --2- 172.21.15.7:0/347056297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98bc004d40 0x7f98bc0051c0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f98cc001fd0 tx=0x7f98bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff28e407aebe868 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:04.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.936+0000 7f98d1ffb640 1 -- 172.21.15.7:0/347056297 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc001bf0 con 0x7f98bc004d40 2024-04-25T09:59:04.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.936+0000 7f98d1ffb640 1 -- 172.21.15.7:0/347056297 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98cc003b70 con 0x7f98bc004d40 2024-04-25T09:59:04.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.936+0000 7f98d1ffb640 1 -- 172.21.15.7:0/347056297 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc0050d0 con 0x7f98bc004d40 2024-04-25T09:59:04.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.936+0000 7f98d9530640 1 -- 172.21.15.7:0/347056297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98bc004d40 msgr2=0x7f98bc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:04.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.936+0000 7f98d9530640 1 --2- 172.21.15.7:0/347056297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98bc004d40 0x7f98bc0051c0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f98cc001fd0 tx=0x7f98bc005830 comp rx=0 tx=0).stop 2024-04-25T09:59:04.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.936+0000 7f98d37fe640 1 -- 172.21.15.7:0/347056297 reap_dead start 2024-04-25T09:59:04.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.936+0000 7f98d9530640 1 -- 172.21.15.7:0/347056297 shutdown_connections 2024-04-25T09:59:04.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.936+0000 7f98d9530640 1 -- 172.21.15.7:0/347056297 >> 172.21.15.7:0/347056297 conn(0x7f98d40d16e0 msgr2=0x7f98d40d1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:04.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.936+0000 7f98d9530640 1 -- 172.21.15.7:0/347056297 shutdown_connections 2024-04-25T09:59:04.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.936+0000 7f98d9530640 1 -- 172.21.15.7:0/347056297 wait complete. 2024-04-25T09:59:04.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.937+0000 7f98d9530640 1 Processor -- start 2024-04-25T09:59:04.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.938+0000 7f98d9530640 1 -- start start 2024-04-25T09:59:04.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.938+0000 7f98d9530640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98bc004d40 0x7f98d4151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.938+0000 7f98d9530640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98d40b68d0 0x7f98d40b6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.938+0000 7f98d9530640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98d4161510 0x7f98d4161990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.938+0000 7f98d9530640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d40d0c60 con 0x7f98d40b68d0 2024-04-25T09:59:04.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.938+0000 7f98d9530640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d409a450 con 0x7f98d4161510 2024-04-25T09:59:04.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.938+0000 7f98d9530640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d40d0810 con 0x7f98bc004d40 2024-04-25T09:59:04.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.938+0000 7f98d27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98d40b68d0 0x7f98d40b6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:04.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.938+0000 7f98d27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98d40b68d0 0x7f98d40b6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33808/0 (socket says 172.21.15.7:33808) 2024-04-25T09:59:04.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.938+0000 7f98d27fc640 1 -- 172.21.15.7:0/3346739295 learned_addr learned my addr 172.21.15.7:0/3346739295 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:04.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.939+0000 7f98d37fe640 1 --2- 172.21.15.7:0/3346739295 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98d4161510 0x7f98d4161990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:04.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.939+0000 7f98d2ffd640 1 --2- 172.21.15.7:0/3346739295 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98bc004d40 0x7f98d4151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:04.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.939+0000 7f98d27fc640 1 -- 172.21.15.7:0/3346739295 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98bc004d40 msgr2=0x7f98d4151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:04.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.939+0000 7f98d27fc640 1 --2- 172.21.15.7:0/3346739295 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98bc004d40 0x7f98d4151fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.939+0000 7f98d27fc640 1 -- 172.21.15.7:0/3346739295 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98d4161510 msgr2=0x7f98d4161990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:04.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.939+0000 7f98d27fc640 1 --2- 172.21.15.7:0/3346739295 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98d4161510 0x7f98d4161990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:04.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.939+0000 7f98d27fc640 1 -- 172.21.15.7:0/3346739295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d40c52b0 con 0x7f98d40b68d0 2024-04-25T09:59:04.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.939+0000 7f98d27fc640 1 --2- 172.21.15.7:0/3346739295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98d40b68d0 0x7f98d40b6d50 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f98c8011910 tx=0x7f98c8011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:04.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.939+0000 7f98bb7fe640 1 -- 172.21.15.7:0/3346739295 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c8019070 con 0x7f98d40b68d0 2024-04-25T09:59:04.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.939+0000 7f98bb7fe640 1 -- 172.21.15.7:0/3346739295 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c8004240 con 0x7f98d40b68d0 2024-04-25T09:59:04.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.939+0000 7f98d9530640 1 -- 172.21.15.7:0/3346739295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d40c5590 con 0x7f98d40b68d0 2024-04-25T09:59:04.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.939+0000 7f98bb7fe640 1 -- 172.21.15.7:0/3346739295 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c800f8e0 con 0x7f98d40b68d0 2024-04-25T09:59:04.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.939+0000 7f98d9530640 1 -- 172.21.15.7:0/3346739295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d40c5b50 con 0x7f98d40b68d0 2024-04-25T09:59:04.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.940+0000 7f98d9530640 1 -- 172.21.15.7:0/3346739295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d4068fd0 con 0x7f98d40b68d0 2024-04-25T09:59:04.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.941+0000 7f98bb7fe640 1 -- 172.21.15.7:0/3346739295 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f98c801c070 con 0x7f98d40b68d0 2024-04-25T09:59:04.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.941+0000 7f98bb7fe640 1 --2- 172.21.15.7:0/3346739295 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f98c006b500 0x7f98c006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:04.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.941+0000 7f98bb7fe640 1 -- 172.21.15.7:0/3346739295 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f98c808a920 con 0x7f98d40b68d0 2024-04-25T09:59:04.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.941+0000 7f98d2ffd640 1 --2- 172.21.15.7:0/3346739295 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f98c006b500 0x7f98c006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:04.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.942+0000 7f98d2ffd640 1 --2- 172.21.15.7:0/3346739295 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f98c006b500 0x7f98c006d9c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f98c4001eb0 tx=0x7f98c4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:04.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:04.946+0000 7f98bb7fe640 1 -- 172.21.15.7:0/3346739295 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f98c8059520 con 0x7f98d40b68d0 2024-04-25T09:59:05.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:05.163+0000 7f98d9530640 1 -- 172.21.15.7:0/3346739295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f98d40d1150 con 0x7f98d40b68d0 2024-04-25T09:59:05.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:05.163+0000 7f98bb7fe640 1 -- 172.21.15.7:0/3346739295 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v43) v1 ==== 53+0+73 (secure 0 0 0) 0x7f98c8058e20 con 0x7f98d40b68d0 2024-04-25T09:59:05.167 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:59:05.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:05.165+0000 7f98d9530640 1 -- 172.21.15.7:0/3346739295 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f98c006b500 msgr2=0x7f98c006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:05.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:05.165+0000 7f98d9530640 1 --2- 172.21.15.7:0/3346739295 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f98c006b500 0x7f98c006d9c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f98c4001eb0 tx=0x7f98c4009040 comp rx=0 tx=0).stop 2024-04-25T09:59:05.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:05.165+0000 7f98d9530640 1 -- 172.21.15.7:0/3346739295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98d40b68d0 msgr2=0x7f98d40b6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:05.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:05.165+0000 7f98d9530640 1 --2- 172.21.15.7:0/3346739295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98d40b68d0 0x7f98d40b6d50 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f98c8011910 tx=0x7f98c8011dd0 comp rx=0 tx=0).stop 2024-04-25T09:59:05.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:05.165+0000 7f98d9530640 1 -- 172.21.15.7:0/3346739295 shutdown_connections 2024-04-25T09:59:05.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:05.165+0000 7f98d9530640 1 --2- 172.21.15.7:0/3346739295 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f98c006b500 0x7f98c006d9c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:05.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:05.165+0000 7f98d9530640 1 --2- 172.21.15.7:0/3346739295 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98d4161510 0x7f98d4161990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:05.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:05.165+0000 7f98d9530640 1 --2- 172.21.15.7:0/3346739295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98d40b68d0 0x7f98d40b6d50 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:05.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:05.165+0000 7f98d9530640 1 --2- 172.21.15.7:0/3346739295 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98bc004d40 0x7f98d4151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:05.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:05.165+0000 7f98d9530640 1 -- 172.21.15.7:0/3346739295 >> 172.21.15.7:0/3346739295 conn(0x7f98d40d16e0 msgr2=0x7f98d40b45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:05.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:05.165+0000 7f98d9530640 1 -- 172.21.15.7:0/3346739295 shutdown_connections 2024-04-25T09:59:05.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:05.165+0000 7f98d9530640 1 -- 172.21.15.7:0/3346739295 wait complete. 2024-04-25T09:59:05.179 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:59:05.179 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:59:05.180 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-04-25T09:59:05.180 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:59:05.180 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:59:05.180 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:59:05.180 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:59:05.180 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:59:05.180 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:59:05.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:59:05.180 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-04-25T09:59:05.196 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:59:05.196 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:59:05.196 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:59:05.196 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:59:05.196 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-04-25T09:59:05.196 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:59:05.196 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:59:05.196 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-04-25T09:59:05.196 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-04-25T09:59:05.196 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:59:05.196 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-04-25T09:59:05.196 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-04-25T09:59:05.197 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:59:05.197 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-04-25T09:59:05.197 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-04-25T09:59:05.197 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T09:59:05.197 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42454sec preferred_lft 42454sec 2024-04-25T09:59:05.197 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link noprefixroute 2024-04-25T09:59:05.197 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:59:05.197 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T09:59:05.197 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-04-25T09:59:05.197 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-04-25T09:59:05.197 INFO:teuthology.orchestra.run.smithi007.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:59:05.197 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 26:0c:99:53:12:e3 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:59:05.197 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:59:05.197 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:59:05.197 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::50aa:55ff:febc:5f67/64 scope link 2024-04-25T09:59:05.197 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:59:05.198 INFO:teuthology.orchestra.run.smithi007.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:59:05.198 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 6e:99:f1:00:a9:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:59:05.198 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6c99:f1ff:fe00:a95e/64 scope link 2024-04-25T09:59:05.198 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:59:05.198 INFO:teuthology.orchestra.run.smithi007.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:59:05.198 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 26:0c:99:53:12:e3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:59:05.198 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::240c:99ff:fe53:12e3/64 scope link 2024-04-25T09:59:05.198 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:59:05.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:59:05.198 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:59:05.259 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-04-25T09:59:05.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:59:05.260 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-04-25T09:59:05.317 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-04-25T09:59:05.317 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:59:05.317 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T09:59:05.317 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T09:59:05.317 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:59:05.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:59:05.317 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-04-25T09:59:05.318 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-25T09:59:05.318 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:59:05.318 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:59:05.318 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:59:05.318 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-25T09:59:05.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:59:05.403 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-04-25T09:59:05.418 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:59:05.418 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:59:05.418 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:59:05.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:59:05.418 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-04-25T09:59:05.482 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:59:05.482 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:59:05.538 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:59:05.538 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:59:05.542 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:59:05.593 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:59:05.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:59:05.594 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:59:05.676 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:59:05.676 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:59:05.676 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T09:59:05.685 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:59:05.685 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:59:05.685 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T09:59:05.685 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T09:59:05.685 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:59:05.689 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:59:05.689 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:59:05.690 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T09:59:05.690 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T09:59:05.690 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:59:05.690 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790" 2024-04-25T09:59:05.690 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790:/ 2024-04-25T09:59:05.690 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c03d0745-5946-49c3-ad88-1165c5b68b4e" will pass to kernel 2024-04-25T09:59:05.690 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T09:59:05.690 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-04-25T09:59:05.691 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T09:59:05.691 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T09:59:05.691 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T09:59:05.692 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:59:05.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:59:05.692 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:59:05.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:59:05.758 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:59:05.814 INFO:teuthology.orchestra.run.smithi007.stdout:client7134 2024-04-25T09:59:05.815 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:59:05.815 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:59:05.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:59:05.870 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls subdir/) 2024-04-25T09:59:05.928 INFO:teuthology.orchestra.run.smithi007.stdout:file_undamaged 2024-04-25T09:59:05.929 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T09:59:05.929 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T09:59:05.929 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T09:59:05.929 DEBUG:teuthology.orchestra.run.smithi007:> import json 2024-04-25T09:59:05.929 DEBUG:teuthology.orchestra.run.smithi007:> import sys 2024-04-25T09:59:05.929 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T09:59:05.929 DEBUG:teuthology.orchestra.run.smithi007:> try: 2024-04-25T09:59:05.929 DEBUG:teuthology.orchestra.run.smithi007:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/file_to_be_damaged'"'"') 2024-04-25T09:59:05.930 DEBUG:teuthology.orchestra.run.smithi007:> except OSError as e: 2024-04-25T09:59:05.930 DEBUG:teuthology.orchestra.run.smithi007:> sys.exit(e.errno) 2024-04-25T09:59:05.930 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T09:59:05.930 DEBUG:teuthology.orchestra.run.smithi007:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-04-25T09:59:05.930 DEBUG:teuthology.orchestra.run.smithi007:> print(json.dumps( 2024-04-25T09:59:05.930 DEBUG:teuthology.orchestra.run.smithi007:> dict([(a, getattr(s, a)) for a in attrs]), 2024-04-25T09:59:05.930 DEBUG:teuthology.orchestra.run.smithi007:> indent=2)) 2024-04-25T09:59:05.930 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T09:59:06.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06 stdin-killer INFO: command exited with status 2: exiting normally with same code! 2024-04-25T09:59:06.046 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-25T09:59:06.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:59:06.047 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2024-04-25T09:59:06.104 INFO:teuthology.orchestra.run.smithi007.stdout:2 2024-04-25T09:59:06.104 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:59:06.104 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:59:06.163 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T09:59:06.163 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:59:06.220 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:59:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.356+0000 7f3c56c5a640 1 Processor -- start 2024-04-25T09:59:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.356+0000 7f3c56c5a640 1 -- start start 2024-04-25T09:59:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.357+0000 7f3c56c5a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c5006c250 0x7f3c5009a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.357+0000 7f3c56c5a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c50099b20 con 0x7f3c500d0360 2024-04-25T09:59:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.357+0000 7f3c56c5a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c50099e00 con 0x7f3c5006bce0 2024-04-25T09:59:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.357+0000 7f3c56c5a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5009ae20 con 0x7f3c5006c250 2024-04-25T09:59:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.357+0000 7f3c551f7640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3c500d0360 0x7f3c500cbd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33704/0 (socket says 172.21.15.7:33704) 2024-04-25T09:59:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.357+0000 7f3c551f7640 1 -- 172.21.15.7:0/2352804299 learned_addr learned my addr 172.21.15.7:0/2352804299 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:59:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.357+0000 7f3c4f7fe640 1 -- 172.21.15.7:0/2352804299 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2961833361 0 0) 0x7f3c50099b20 con 0x7f3c500d0360 2024-04-25T09:59:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.357+0000 7f3c4f7fe640 1 -- 172.21.15.7:0/2352804299 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c38003520 con 0x7f3c500d0360 2024-04-25T09:59:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.357+0000 7f3c549f6640 1 --2- 172.21.15.7:0/2352804299 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c5006c250 0x7f3c5009a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.358+0000 7f3c4f7fe640 1 -- 172.21.15.7:0/2352804299 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3700712926 0 0) 0x7f3c38003520 con 0x7f3c500d0360 2024-04-25T09:59:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.358+0000 7f3c4f7fe640 1 -- 172.21.15.7:0/2352804299 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c5006c250 msgr2=0x7f3c5009a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:06.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.358+0000 7f3c4f7fe640 1 --2- 172.21.15.7:0/2352804299 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c5006c250 0x7f3c5009a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:06.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.358+0000 7f3c4f7fe640 1 -- 172.21.15.7:0/2352804299 >> v1:172.21.15.55:6789/0 conn(0x7f3c5006bce0 legacy=0x7f3c5006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:06.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.358+0000 7f3c4f7fe640 1 -- 172.21.15.7:0/2352804299 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5009a0e0 con 0x7f3c500d0360 2024-04-25T09:59:06.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.358+0000 7f3c4f7fe640 1 -- 172.21.15.7:0/2352804299 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f3c480019f0 con 0x7f3c500d0360 2024-04-25T09:59:06.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.358+0000 7f3c4f7fe640 1 -- 172.21.15.7:0/2352804299 >> v1:172.21.15.7:6789/0 conn(0x7f3c500d0360 legacy=0x7f3c500cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:06.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.358+0000 7f3c4f7fe640 1 --2- 172.21.15.7:0/2352804299 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c5006c250 0x7f3c380039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:06.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.358+0000 7f3c4f7fe640 1 --2- 172.21.15.7:0/2352804299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c38003f60 0x7f3c38004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:06.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.358+0000 7f3c4f7fe640 1 --2- 172.21.15.7:0/2352804299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c38004d40 0x7f3c380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:06.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.358+0000 7f3c4f7fe640 1 -- 172.21.15.7:0/2352804299 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5009ae20 con 0x7f3c38004d40 2024-04-25T09:59:06.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.358+0000 7f3c4f7fe640 1 -- 172.21.15.7:0/2352804299 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3800bc00 con 0x7f3c38003f60 2024-04-25T09:59:06.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.358+0000 7f3c4f7fe640 1 -- 172.21.15.7:0/2352804299 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3800be00 con 0x7f3c5006c250 2024-04-25T09:59:06.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.358+0000 7f3c551f7640 1 --2- 172.21.15.7:0/2352804299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c38004d40 0x7f3c380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:06.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.358+0000 7f3c549f6640 1 --2- 172.21.15.7:0/2352804299 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c5006c250 0x7f3c380039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:06.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.358+0000 7f3c4ffff640 1 --2- 172.21.15.7:0/2352804299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c38003f60 0x7f3c38004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:06.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.358+0000 7f3c551f7640 1 -- 172.21.15.7:0/2352804299 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c5006c250 msgr2=0x7f3c380039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:06.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.358+0000 7f3c551f7640 1 --2- 172.21.15.7:0/2352804299 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c5006c250 0x7f3c380039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:06.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.358+0000 7f3c551f7640 1 -- 172.21.15.7:0/2352804299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c38003f60 msgr2=0x7f3c38004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:06.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.358+0000 7f3c551f7640 1 --2- 172.21.15.7:0/2352804299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c38003f60 0x7f3c38004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:06.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.358+0000 7f3c551f7640 1 -- 172.21.15.7:0/2352804299 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c38003520 con 0x7f3c38004d40 2024-04-25T09:59:06.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.359+0000 7f3c551f7640 1 --2- 172.21.15.7:0/2352804299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c38004d40 0x7f3c380051c0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f3c4800a850 tx=0x7f3c38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec25d6239f97bb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:06.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.359+0000 7f3c4f7fe640 1 -- 172.21.15.7:0/2352804299 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4800a4a0 con 0x7f3c38004d40 2024-04-25T09:59:06.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.359+0000 7f3c4f7fe640 1 -- 172.21.15.7:0/2352804299 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4802f070 con 0x7f3c38004d40 2024-04-25T09:59:06.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.359+0000 7f3c4f7fe640 1 -- 172.21.15.7:0/2352804299 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4802bd20 con 0x7f3c38004d40 2024-04-25T09:59:06.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.360+0000 7f3c56c5a640 1 -- 172.21.15.7:0/2352804299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c38004d40 msgr2=0x7f3c380051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:06.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.360+0000 7f3c56c5a640 1 --2- 172.21.15.7:0/2352804299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c38004d40 0x7f3c380051c0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f3c4800a850 tx=0x7f3c38005830 comp rx=0 tx=0).stop 2024-04-25T09:59:06.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.360+0000 7f3c551f7640 1 -- 172.21.15.7:0/2352804299 reap_dead start 2024-04-25T09:59:06.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.360+0000 7f3c56c5a640 1 -- 172.21.15.7:0/2352804299 shutdown_connections 2024-04-25T09:59:06.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.360+0000 7f3c56c5a640 1 -- 172.21.15.7:0/2352804299 >> 172.21.15.7:0/2352804299 conn(0x7f3c500d16e0 msgr2=0x7f3c500d1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:06.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.360+0000 7f3c56c5a640 1 -- 172.21.15.7:0/2352804299 shutdown_connections 2024-04-25T09:59:06.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.360+0000 7f3c56c5a640 1 -- 172.21.15.7:0/2352804299 wait complete. 2024-04-25T09:59:06.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.361+0000 7f3c56c5a640 1 Processor -- start 2024-04-25T09:59:06.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.361+0000 7f3c56c5a640 1 -- start start 2024-04-25T09:59:06.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.362+0000 7f3c56c5a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c50159c90 0x7f3c50070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:06.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.362+0000 7f3c56c5a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c50070990 0x7f3c5015f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:06.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.362+0000 7f3c56c5a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c5015f750 0x7f3c5015bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:06.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.362+0000 7f3c56c5a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c500d0c60 con 0x7f3c50159c90 2024-04-25T09:59:06.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.362+0000 7f3c56c5a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5009a450 con 0x7f3c50070990 2024-04-25T09:59:06.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.362+0000 7f3c56c5a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c500d0810 con 0x7f3c5015f750 2024-04-25T09:59:06.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.362+0000 7f3c549f6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c50159c90 0x7f3c50070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:06.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.362+0000 7f3c549f6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c50159c90 0x7f3c50070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33830/0 (socket says 172.21.15.7:33830) 2024-04-25T09:59:06.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.362+0000 7f3c549f6640 1 -- 172.21.15.7:0/1780864787 learned_addr learned my addr 172.21.15.7:0/1780864787 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:06.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.362+0000 7f3c549f6640 1 -- 172.21.15.7:0/1780864787 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c5015f750 msgr2=0x7f3c5015bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:06.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.362+0000 7f3c549f6640 1 --2- 172.21.15.7:0/1780864787 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c5015f750 0x7f3c5015bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:06.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.362+0000 7f3c549f6640 1 -- 172.21.15.7:0/1780864787 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c50070990 msgr2=0x7f3c5015f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:06.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.362+0000 7f3c549f6640 1 --2- 172.21.15.7:0/1780864787 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c50070990 0x7f3c5015f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:06.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.362+0000 7f3c549f6640 1 -- 172.21.15.7:0/1780864787 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5015fdf0 con 0x7f3c50159c90 2024-04-25T09:59:06.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.362+0000 7f3c549f6640 1 --2- 172.21.15.7:0/1780864787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c50159c90 0x7f3c50070450 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f3c40011a00 tx=0x7f3c40011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:06.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.362+0000 7f3c4d7fa640 1 -- 172.21.15.7:0/1780864787 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4000fad0 con 0x7f3c50159c90 2024-04-25T09:59:06.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.362+0000 7f3c4d7fa640 1 -- 172.21.15.7:0/1780864787 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4000fc70 con 0x7f3c50159c90 2024-04-25T09:59:06.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.362+0000 7f3c4d7fa640 1 -- 172.21.15.7:0/1780864787 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c40014440 con 0x7f3c50159c90 2024-04-25T09:59:06.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.362+0000 7f3c56c5a640 1 -- 172.21.15.7:0/1780864787 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c501600d0 con 0x7f3c50159c90 2024-04-25T09:59:06.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.362+0000 7f3c56c5a640 1 -- 172.21.15.7:0/1780864787 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c5015b6a0 con 0x7f3c50159c90 2024-04-25T09:59:06.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.364+0000 7f3c56c5a640 1 -- 172.21.15.7:0/1780864787 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c5015fb70 con 0x7f3c50159c90 2024-04-25T09:59:06.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.364+0000 7f3c4d7fa640 1 -- 172.21.15.7:0/1780864787 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3c40012040 con 0x7f3c50159c90 2024-04-25T09:59:06.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.364+0000 7f3c4d7fa640 1 --2- 172.21.15.7:0/1780864787 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3c3c06b4d0 0x7f3c3c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:06.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.364+0000 7f3c4d7fa640 1 -- 172.21.15.7:0/1780864787 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f3c4008aa70 con 0x7f3c50159c90 2024-04-25T09:59:06.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.364+0000 7f3c4ffff640 1 --2- 172.21.15.7:0/1780864787 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3c3c06b4d0 0x7f3c3c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:06.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.365+0000 7f3c4ffff640 1 --2- 172.21.15.7:0/1780864787 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3c3c06b4d0 0x7f3c3c06d990 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3c501f75a0 tx=0x7f3c44009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:06.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.368+0000 7f3c4d7fa640 1 -- 172.21.15.7:0/1780864787 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3c5015fb70 con 0x7f3c50159c90 2024-04-25T09:59:06.420 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-04-25T09:59:06.417+0000 7f45afd77640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T09:59:06.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.551+0000 7f3c56c5a640 1 -- 172.21.15.7:0/1780864787 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c50068fd0 con 0x7f3c50159c90 2024-04-25T09:59:06.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.552+0000 7f3c4d7fa640 1 -- 172.21.15.7:0/1780864787 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16978 (secure 0 0 0) 0x7f3c40019030 con 0x7f3c50159c90 2024-04-25T09:59:06.556 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:59:06.557 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":76,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:58:59.374212+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:58:43.929184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T09:58:44.609970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6834/1012943595":"2024-04-26T09:58:59.374192+0000","172.21.15.55:6832/1012943595":"2024-04-26T09:58:59.374192+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:59:06.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.554+0000 7f3c56c5a640 1 -- 172.21.15.7:0/1780864787 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3c3c06b4d0 msgr2=0x7f3c3c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:06.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.554+0000 7f3c56c5a640 1 --2- 172.21.15.7:0/1780864787 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3c3c06b4d0 0x7f3c3c06d990 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3c501f75a0 tx=0x7f3c44009040 comp rx=0 tx=0).stop 2024-04-25T09:59:06.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.554+0000 7f3c56c5a640 1 -- 172.21.15.7:0/1780864787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c50159c90 msgr2=0x7f3c50070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:06.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.554+0000 7f3c56c5a640 1 --2- 172.21.15.7:0/1780864787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c50159c90 0x7f3c50070450 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f3c40011a00 tx=0x7f3c40011ec0 comp rx=0 tx=0).stop 2024-04-25T09:59:06.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.554+0000 7f3c56c5a640 1 -- 172.21.15.7:0/1780864787 shutdown_connections 2024-04-25T09:59:06.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.554+0000 7f3c56c5a640 1 --2- 172.21.15.7:0/1780864787 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3c3c06b4d0 0x7f3c3c06d990 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:06.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.554+0000 7f3c56c5a640 1 --2- 172.21.15.7:0/1780864787 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c5015f750 0x7f3c5015bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:06.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.554+0000 7f3c56c5a640 1 --2- 172.21.15.7:0/1780864787 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c50070990 0x7f3c5015f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:06.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.554+0000 7f3c56c5a640 1 --2- 172.21.15.7:0/1780864787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c50159c90 0x7f3c50070450 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:06.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.554+0000 7f3c56c5a640 1 -- 172.21.15.7:0/1780864787 >> 172.21.15.7:0/1780864787 conn(0x7f3c500d16e0 msgr2=0x7f3c5015aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:06.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.554+0000 7f3c56c5a640 1 -- 172.21.15.7:0/1780864787 shutdown_connections 2024-04-25T09:59:06.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.554+0000 7f3c56c5a640 1 -- 172.21.15.7:0/1780864787 wait complete. 2024-04-25T09:59:06.571 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:58:43.929184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:58:44.609970+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:59:06.571 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:59:06.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.671+0000 7ff77b7d5640 1 Processor -- start 2024-04-25T09:59:06.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.671+0000 7ff77b7d5640 1 -- start start 2024-04-25T09:59:06.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.672+0000 7ff77b7d5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff7740d2c40 0x7ff7740b9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:06.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.672+0000 7ff77b7d5640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff7740b68b0 0x7ff7740b6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:06.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.672+0000 7ff77b7d5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7740b7ef0 con 0x7ff7740d0780 2024-04-25T09:59:06.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.672+0000 7ff77b7d5640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7740b81d0 con 0x7ff7740b68b0 2024-04-25T09:59:06.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.672+0000 7ff77b7d5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7740b84b0 con 0x7ff7740d2c40 2024-04-25T09:59:06.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.672+0000 7ff779d72640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff7740b68b0 0x7ff7740b6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:06.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.672+0000 7ff779d72640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff7740b68b0 0x7ff7740b6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33844/0 (socket says 172.21.15.7:33844) 2024-04-25T09:59:06.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.672+0000 7ff779d72640 1 -- 172.21.15.7:0/1601277087 learned_addr learned my addr 172.21.15.7:0/1601277087 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:06.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.672+0000 7ff778d70640 1 --2- 172.21.15.7:0/1601277087 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff7740d2c40 0x7ff7740b9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:06.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.672+0000 7ff779d72640 1 -- 172.21.15.7:0/1601277087 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff7740d2c40 msgr2=0x7ff7740b9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:06.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.672+0000 7ff779d72640 1 --2- 172.21.15.7:0/1601277087 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff7740d2c40 0x7ff7740b9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:06.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.672+0000 7ff779d72640 1 -- 172.21.15.7:0/1601277087 >> v1:172.21.15.55:6789/0 conn(0x7ff7740d0780 legacy=0x7ff7740d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:06.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.673+0000 7ff779d72640 1 -- 172.21.15.7:0/1601277087 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7740b8790 con 0x7ff7740b68b0 2024-04-25T09:59:06.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.673+0000 7ff779d72640 1 --2- 172.21.15.7:0/1601277087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7740b68b0 0x7ff7740b6d40 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7ff76c009e50 tx=0x7ff76c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3417088cdb66fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:06.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.673+0000 7ff76bfff640 1 -- 172.21.15.7:0/1601277087 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c036070 con 0x7ff7740b68b0 2024-04-25T09:59:06.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.673+0000 7ff76bfff640 1 -- 172.21.15.7:0/1601277087 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76c031600 con 0x7ff7740b68b0 2024-04-25T09:59:06.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.673+0000 7ff76bfff640 1 -- 172.21.15.7:0/1601277087 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c0319d0 con 0x7ff7740b68b0 2024-04-25T09:59:06.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.674+0000 7ff77b7d5640 1 -- 172.21.15.7:0/1601277087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7740b68b0 msgr2=0x7ff7740b6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:06.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.674+0000 7ff77b7d5640 1 --2- 172.21.15.7:0/1601277087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7740b68b0 0x7ff7740b6d40 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7ff76c009e50 tx=0x7ff76c02a710 comp rx=0 tx=0).stop 2024-04-25T09:59:06.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.674+0000 7ff77b7d5640 1 -- 172.21.15.7:0/1601277087 shutdown_connections 2024-04-25T09:59:06.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.674+0000 7ff77b7d5640 1 --2- 172.21.15.7:0/1601277087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7740b68b0 0x7ff7740b6d40 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:06.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.674+0000 7ff77b7d5640 1 --2- 172.21.15.7:0/1601277087 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff7740d2c40 0x7ff7740b9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:06.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.674+0000 7ff77b7d5640 1 -- 172.21.15.7:0/1601277087 >> 172.21.15.7:0/1601277087 conn(0x7ff7740726b0 msgr2=0x7ff774072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:06.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.674+0000 7ff77b7d5640 1 -- 172.21.15.7:0/1601277087 shutdown_connections 2024-04-25T09:59:06.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.674+0000 7ff77b7d5640 1 -- 172.21.15.7:0/1601277087 wait complete. 2024-04-25T09:59:06.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.675+0000 7ff77b7d5640 1 Processor -- start 2024-04-25T09:59:06.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.675+0000 7ff77b7d5640 1 -- start start 2024-04-25T09:59:06.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.676+0000 7ff77b7d5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7740b68b0 0x7ff7740c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:06.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.676+0000 7ff77b7d5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7740d0780 0x7ff7741530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:06.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.676+0000 7ff77b7d5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff7740d2c40 0x7ff7740cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:06.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.676+0000 7ff77b7d5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7740b97f0 con 0x7ff7740b68b0 2024-04-25T09:59:06.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.676+0000 7ff77b7d5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7740b9670 con 0x7ff7740d0780 2024-04-25T09:59:06.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.676+0000 7ff77b7d5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7741611b0 con 0x7ff7740d2c40 2024-04-25T09:59:06.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.676+0000 7ff779571640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7740b68b0 0x7ff7740c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:06.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.676+0000 7ff779571640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7740b68b0 0x7ff7740c9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33852/0 (socket says 172.21.15.7:33852) 2024-04-25T09:59:06.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.676+0000 7ff779571640 1 -- 172.21.15.7:0/4202458002 learned_addr learned my addr 172.21.15.7:0/4202458002 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:06.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.676+0000 7ff779d72640 1 --2- 172.21.15.7:0/4202458002 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff7740d2c40 0x7ff7740cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:06.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.676+0000 7ff778d70640 1 --2- 172.21.15.7:0/4202458002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7740d0780 0x7ff7741530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:06.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.676+0000 7ff779571640 1 -- 172.21.15.7:0/4202458002 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff7740d2c40 msgr2=0x7ff7740cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:06.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.676+0000 7ff779571640 1 --2- 172.21.15.7:0/4202458002 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff7740d2c40 0x7ff7740cbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:06.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.676+0000 7ff779571640 1 -- 172.21.15.7:0/4202458002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7740d0780 msgr2=0x7ff7741530d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:06.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.676+0000 7ff779571640 1 --2- 172.21.15.7:0/4202458002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7740d0780 0x7ff7741530d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:06.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.676+0000 7ff779571640 1 -- 172.21.15.7:0/4202458002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7740ca990 con 0x7ff7740b68b0 2024-04-25T09:59:06.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.676+0000 7ff779571640 1 --2- 172.21.15.7:0/4202458002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7740b68b0 0x7ff7740c9610 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7ff77000c400 tx=0x7ff77000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:06.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.677+0000 7ff769ffb640 1 -- 172.21.15.7:0/4202458002 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7700052d0 con 0x7ff7740b68b0 2024-04-25T09:59:06.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.677+0000 7ff769ffb640 1 -- 172.21.15.7:0/4202458002 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff770005490 con 0x7ff7740b68b0 2024-04-25T09:59:06.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.677+0000 7ff77b7d5640 1 -- 172.21.15.7:0/4202458002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7740cc810 con 0x7ff7740b68b0 2024-04-25T09:59:06.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.677+0000 7ff769ffb640 1 -- 172.21.15.7:0/4202458002 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff770007260 con 0x7ff7740b68b0 2024-04-25T09:59:06.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.677+0000 7ff77b7d5640 1 -- 172.21.15.7:0/4202458002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7740caf10 con 0x7ff7740b68b0 2024-04-25T09:59:06.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.678+0000 7ff77b7d5640 1 -- 172.21.15.7:0/4202458002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7740685d0 con 0x7ff7740b68b0 2024-04-25T09:59:06.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.678+0000 7ff769ffb640 1 -- 172.21.15.7:0/4202458002 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff770007400 con 0x7ff7740b68b0 2024-04-25T09:59:06.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.679+0000 7ff769ffb640 1 --2- 172.21.15.7:0/4202458002 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff75806b4d0 0x7ff75806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:06.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.679+0000 7ff769ffb640 1 -- 172.21.15.7:0/4202458002 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7ff7700898a0 con 0x7ff7740b68b0 2024-04-25T09:59:06.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.679+0000 7ff778d70640 1 --2- 172.21.15.7:0/4202458002 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff75806b4d0 0x7ff75806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:06.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.679+0000 7ff778d70640 1 --2- 172.21.15.7:0/4202458002 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff75806b4d0 0x7ff75806d990 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff7740cdd00 tx=0x7ff764008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:06.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.683+0000 7ff769ffb640 1 -- 172.21.15.7:0/4202458002 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff7700585d0 con 0x7ff7740b68b0 2024-04-25T09:59:06.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.863+0000 7ff77b7d5640 1 -- 172.21.15.7:0/4202458002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff77415ec90 con 0x7ff7740b68b0 2024-04-25T09:59:06.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.863+0000 7ff769ffb640 1 -- 172.21.15.7:0/4202458002 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff770057ed0 con 0x7ff7740b68b0 2024-04-25T09:59:06.867 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T09:59:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.865+0000 7ff77b7d5640 1 -- 172.21.15.7:0/4202458002 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff75806b4d0 msgr2=0x7ff75806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.865+0000 7ff77b7d5640 1 --2- 172.21.15.7:0/4202458002 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff75806b4d0 0x7ff75806d990 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff7740cdd00 tx=0x7ff764008040 comp rx=0 tx=0).stop 2024-04-25T09:59:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.865+0000 7ff77b7d5640 1 -- 172.21.15.7:0/4202458002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7740b68b0 msgr2=0x7ff7740c9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.865+0000 7ff77b7d5640 1 --2- 172.21.15.7:0/4202458002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7740b68b0 0x7ff7740c9610 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7ff77000c400 tx=0x7ff77000c8c0 comp rx=0 tx=0).stop 2024-04-25T09:59:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.865+0000 7ff77b7d5640 1 -- 172.21.15.7:0/4202458002 shutdown_connections 2024-04-25T09:59:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.865+0000 7ff77b7d5640 1 --2- 172.21.15.7:0/4202458002 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff75806b4d0 0x7ff75806d990 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.865+0000 7ff77b7d5640 1 --2- 172.21.15.7:0/4202458002 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff7740d2c40 0x7ff7740cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.865+0000 7ff77b7d5640 1 --2- 172.21.15.7:0/4202458002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7740d0780 0x7ff7741530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.865+0000 7ff77b7d5640 1 --2- 172.21.15.7:0/4202458002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7740b68b0 0x7ff7740c9610 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.865+0000 7ff77b7d5640 1 -- 172.21.15.7:0/4202458002 >> 172.21.15.7:0/4202458002 conn(0x7ff7740726b0 msgr2=0x7ff774160150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.865+0000 7ff77b7d5640 1 -- 172.21.15.7:0/4202458002 shutdown_connections 2024-04-25T09:59:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.865+0000 7ff77b7d5640 1 -- 172.21.15.7:0/4202458002 wait complete. 2024-04-25T09:59:06.880 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:59:06.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.979+0000 7f6fe5142640 1 Processor -- start 2024-04-25T09:59:06.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.979+0000 7f6fe5142640 1 -- start start 2024-04-25T09:59:06.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.980+0000 7f6fe5142640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6fe00d0a00 0x7f6fe009a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:06.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.980+0000 7f6fe5142640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6fe009a7d0 0x7f6fe00cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:06.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.980+0000 7f6fe5142640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe01615e0 con 0x7f6fe0161200 2024-04-25T09:59:06.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.980+0000 7f6fe5142640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe006c9f0 con 0x7f6fe009a7d0 2024-04-25T09:59:06.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.980+0000 7f6fe5142640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe006ccd0 con 0x7f6fe00d0a00 2024-04-25T09:59:06.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.980+0000 7f6fdf59e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6fe009a7d0 0x7f6fe00cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:06.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.980+0000 7f6fdf59e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6fe009a7d0 0x7f6fe00cf840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33866/0 (socket says 172.21.15.7:33866) 2024-04-25T09:59:06.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.980+0000 7f6fdf59e640 1 -- 172.21.15.7:0/1790742433 learned_addr learned my addr 172.21.15.7:0/1790742433 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:06.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.980+0000 7f6fd659c640 1 --2- 172.21.15.7:0/1790742433 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6fe00d0a00 0x7f6fe009a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:06.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.980+0000 7f6fdf59e640 1 -- 172.21.15.7:0/1790742433 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6fe00d0a00 msgr2=0x7f6fe009a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:06.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.980+0000 7f6fdf59e640 1 --2- 172.21.15.7:0/1790742433 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6fe00d0a00 0x7f6fe009a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:06.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.980+0000 7f6fdf59e640 1 -- 172.21.15.7:0/1790742433 >> v1:172.21.15.55:6789/0 conn(0x7f6fe0161200 legacy=0x7f6fe00cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:06.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.980+0000 7f6fdf59e640 1 -- 172.21.15.7:0/1790742433 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe0099a90 con 0x7f6fe009a7d0 2024-04-25T09:59:06.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.981+0000 7f6fdf59e640 1 --2- 172.21.15.7:0/1790742433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fe009a7d0 0x7f6fe00cf840 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8009e50 tx=0x7f6fd802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd8e50069e2c80b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:06.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.981+0000 7f6fde59c640 1 -- 172.21.15.7:0/1790742433 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd8036070 con 0x7f6fe009a7d0 2024-04-25T09:59:06.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.981+0000 7f6fde59c640 1 -- 172.21.15.7:0/1790742433 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd8031600 con 0x7f6fe009a7d0 2024-04-25T09:59:06.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.981+0000 7f6fde59c640 1 -- 172.21.15.7:0/1790742433 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd80319d0 con 0x7f6fe009a7d0 2024-04-25T09:59:06.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.981+0000 7f6fe5142640 1 -- 172.21.15.7:0/1790742433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fe009a7d0 msgr2=0x7f6fe00cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:06.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.981+0000 7f6fe5142640 1 --2- 172.21.15.7:0/1790742433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fe009a7d0 0x7f6fe00cf840 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8009e50 tx=0x7f6fd802a710 comp rx=0 tx=0).stop 2024-04-25T09:59:06.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.982+0000 7f6fe5142640 1 -- 172.21.15.7:0/1790742433 shutdown_connections 2024-04-25T09:59:06.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.982+0000 7f6fe5142640 1 --2- 172.21.15.7:0/1790742433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fe009a7d0 0x7f6fe00cf840 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:06.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.982+0000 7f6fe5142640 1 --2- 172.21.15.7:0/1790742433 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6fe00d0a00 0x7f6fe009a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:06.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.982+0000 7f6fe5142640 1 -- 172.21.15.7:0/1790742433 >> 172.21.15.7:0/1790742433 conn(0x7f6fe00b31a0 msgr2=0x7f6fe00b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:06.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.982+0000 7f6fe5142640 1 -- 172.21.15.7:0/1790742433 shutdown_connections 2024-04-25T09:59:06.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.982+0000 7f6fe5142640 1 -- 172.21.15.7:0/1790742433 wait complete. 2024-04-25T09:59:06.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.983+0000 7f6fe5142640 1 Processor -- start 2024-04-25T09:59:06.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.983+0000 7f6fe5142640 1 -- start start 2024-04-25T09:59:06.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.984+0000 7f6fe5142640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fe009a7d0 0x7f6fe00c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:06.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.984+0000 7f6fe5142640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fe00d0a00 0x7f6fe00c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:06.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.984+0000 7f6fe5142640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6fe0161200 0x7f6fe0157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:06.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.984+0000 7f6fe5142640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe006cfb0 con 0x7f6fe00d0a00 2024-04-25T09:59:06.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.984+0000 7f6fe5142640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe006c680 con 0x7f6fe009a7d0 2024-04-25T09:59:06.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.984+0000 7f6fe5142640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe006d130 con 0x7f6fe0161200 2024-04-25T09:59:06.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.984+0000 7f6fd659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fe00d0a00 0x7f6fe00c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:06.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.984+0000 7f6fd659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fe00d0a00 0x7f6fe00c7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33872/0 (socket says 172.21.15.7:33872) 2024-04-25T09:59:06.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.984+0000 7f6fd659c640 1 -- 172.21.15.7:0/3696255021 learned_addr learned my addr 172.21.15.7:0/3696255021 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:06.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.984+0000 7f6fded9d640 1 --2- 172.21.15.7:0/3696255021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fe009a7d0 0x7f6fe00c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:06.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.984+0000 7f6fdf59e640 1 --2- 172.21.15.7:0/3696255021 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6fe0161200 0x7f6fe0157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:06.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.984+0000 7f6fd659c640 1 -- 172.21.15.7:0/3696255021 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6fe0161200 msgr2=0x7f6fe0157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:06.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.984+0000 7f6fd659c640 1 --2- 172.21.15.7:0/3696255021 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6fe0161200 0x7f6fe0157a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:06.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.984+0000 7f6fd659c640 1 -- 172.21.15.7:0/3696255021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fe009a7d0 msgr2=0x7f6fe00c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:06.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.984+0000 7f6fd659c640 1 --2- 172.21.15.7:0/3696255021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fe009a7d0 0x7f6fe00c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:06.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.984+0000 7f6fd659c640 1 -- 172.21.15.7:0/3696255021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe00c8320 con 0x7f6fe00d0a00 2024-04-25T09:59:06.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.984+0000 7f6fded9d640 1 --2- 172.21.15.7:0/3696255021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fe009a7d0 0x7f6fe00c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:59:06.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.984+0000 7f6fd659c640 1 --2- 172.21.15.7:0/3696255021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fe00d0a00 0x7f6fe00c7de0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f6fc800e9b0 tx=0x7f6fc800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:06.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.985+0000 7f6fd7fff640 1 -- 172.21.15.7:0/3696255021 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8017070 con 0x7f6fe00d0a00 2024-04-25T09:59:06.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.985+0000 7f6fd7fff640 1 -- 172.21.15.7:0/3696255021 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc800c9a0 con 0x7f6fe00d0a00 2024-04-25T09:59:06.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.985+0000 7f6fe5142640 1 -- 172.21.15.7:0/3696255021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe00c6dc0 con 0x7f6fe00d0a00 2024-04-25T09:59:06.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.985+0000 7f6fd7fff640 1 -- 172.21.15.7:0/3696255021 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc800cd90 con 0x7f6fe00d0a00 2024-04-25T09:59:06.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.985+0000 7f6fe5142640 1 -- 172.21.15.7:0/3696255021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe00c7380 con 0x7f6fe00d0a00 2024-04-25T09:59:06.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.986+0000 7f6fe5142640 1 -- 172.21.15.7:0/3696255021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe01625b0 con 0x7f6fe00d0a00 2024-04-25T09:59:06.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.986+0000 7f6fd7fff640 1 -- 172.21.15.7:0/3696255021 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6fc801a070 con 0x7f6fe00d0a00 2024-04-25T09:59:06.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.987+0000 7f6fd7fff640 1 --2- 172.21.15.7:0/3696255021 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6fc006b4d0 0x7f6fc006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:06.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.987+0000 7f6fded9d640 1 --2- 172.21.15.7:0/3696255021 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6fc006b4d0 0x7f6fc006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:06.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.987+0000 7f6fd7fff640 1 -- 172.21.15.7:0/3696255021 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f6fc808a490 con 0x7f6fe00d0a00 2024-04-25T09:59:06.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.987+0000 7f6fded9d640 1 --2- 172.21.15.7:0/3696255021 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6fc006b4d0 0x7f6fc006d990 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6fd00015e0 tx=0x7f6fd0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:06.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:06.991+0000 7f6fd7fff640 1 -- 172.21.15.7:0/3696255021 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6fe01625b0 con 0x7f6fe00d0a00 2024-04-25T09:59:07.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.169+0000 7f6fe5142640 1 -- 172.21.15.7:0/3696255021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6fe0068f60 con 0x7f6fe00d0a00 2024-04-25T09:59:07.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.169+0000 7f6fd7fff640 1 -- 172.21.15.7:0/3696255021 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v76) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6fc80590b0 con 0x7f6fe00d0a00 2024-04-25T09:59:07.173 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T09:59:07.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.171+0000 7f6fe5142640 1 -- 172.21.15.7:0/3696255021 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6fc006b4d0 msgr2=0x7f6fc006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:07.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.171+0000 7f6fe5142640 1 --2- 172.21.15.7:0/3696255021 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6fc006b4d0 0x7f6fc006d990 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6fd00015e0 tx=0x7f6fd0009040 comp rx=0 tx=0).stop 2024-04-25T09:59:07.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.171+0000 7f6fe5142640 1 -- 172.21.15.7:0/3696255021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fe00d0a00 msgr2=0x7f6fe00c7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:07.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.171+0000 7f6fe5142640 1 --2- 172.21.15.7:0/3696255021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fe00d0a00 0x7f6fe00c7de0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f6fc800e9b0 tx=0x7f6fc800ee70 comp rx=0 tx=0).stop 2024-04-25T09:59:07.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.171+0000 7f6fe5142640 1 -- 172.21.15.7:0/3696255021 shutdown_connections 2024-04-25T09:59:07.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.171+0000 7f6fe5142640 1 --2- 172.21.15.7:0/3696255021 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6fc006b4d0 0x7f6fc006d990 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:07.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.171+0000 7f6fe5142640 1 --2- 172.21.15.7:0/3696255021 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6fe0161200 0x7f6fe0157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:07.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.171+0000 7f6fe5142640 1 --2- 172.21.15.7:0/3696255021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fe00d0a00 0x7f6fe00c7de0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:07.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.171+0000 7f6fe5142640 1 --2- 172.21.15.7:0/3696255021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fe009a7d0 0x7f6fe00c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:07.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.171+0000 7f6fe5142640 1 -- 172.21.15.7:0/3696255021 >> 172.21.15.7:0/3696255021 conn(0x7f6fe00b31a0 msgr2=0x7f6fe00cfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:07.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.171+0000 7f6fe5142640 1 -- 172.21.15.7:0/3696255021 shutdown_connections 2024-04-25T09:59:07.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.171+0000 7f6fe5142640 1 -- 172.21.15.7:0/3696255021 wait complete. 2024-04-25T09:59:07.186 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:59:07.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.286+0000 7fdbaeecb640 1 Processor -- start 2024-04-25T09:59:07.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.286+0000 7fdbaeecb640 1 -- start start 2024-04-25T09:59:07.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.287+0000 7fdbaeecb640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdba80cc1d0 0x7fdba80cfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:07.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.287+0000 7fdbaeecb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdba80b2820 0x7fdba815f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:07.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.287+0000 7fdbaeecb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba80cd0e0 con 0x7fdba80cf9b0 2024-04-25T09:59:07.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.287+0000 7fdbaeecb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba80ccd90 con 0x7fdba80b2820 2024-04-25T09:59:07.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.287+0000 7fdbaeecb640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba80cd410 con 0x7fdba80cc1d0 2024-04-25T09:59:07.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.287+0000 7fdbad468640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdba80b2820 0x7fdba815f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:07.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.287+0000 7fdba7fff640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdba80cc1d0 0x7fdba80cfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:07.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.287+0000 7fdba7fff640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdba80cc1d0 0x7fdba80cfd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:48968/0 (socket says 172.21.15.7:48968) 2024-04-25T09:59:07.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.287+0000 7fdba7fff640 1 -- 172.21.15.7:0/4181354554 learned_addr learned my addr 172.21.15.7:0/4181354554 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:07.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.287+0000 7fdbacc67640 1 --1- 172.21.15.7:0/4181354554 >> v1:172.21.15.55:6789/0 conn(0x7fdba80cf9b0 0x7fdba80cd8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:36958/0 (socket says 172.21.15.7:36958) 2024-04-25T09:59:07.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.287+0000 7fdba7fff640 1 -- 172.21.15.7:0/4181354554 >> v2:172.21.15.55:3300/0 conn(0x7fdba80b2820 msgr2=0x7fdba815f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:07.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.287+0000 7fdba7fff640 1 --2- 172.21.15.7:0/4181354554 >> v2:172.21.15.55:3300/0 conn(0x7fdba80b2820 0x7fdba815f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:07.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.287+0000 7fdba7fff640 1 -- 172.21.15.7:0/4181354554 >> v1:172.21.15.55:6789/0 conn(0x7fdba80cf9b0 legacy=0x7fdba80cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:07.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.287+0000 7fdba7fff640 1 -- 172.21.15.7:0/4181354554 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba80d02d0 con 0x7fdba80cc1d0 2024-04-25T09:59:07.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.288+0000 7fdba7fff640 1 --2- 172.21.15.7:0/4181354554 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdba80cc1d0 0x7fdba80cfd90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdba80cd590 tx=0x7fdb9402a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3febfa083b5df6d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:07.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.288+0000 7fdba77fe640 1 -- 172.21.15.7:0/4181354554 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb94037070 con 0x7fdba80cc1d0 2024-04-25T09:59:07.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.288+0000 7fdba77fe640 1 -- 172.21.15.7:0/4181354554 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb94032440 con 0x7fdba80cc1d0 2024-04-25T09:59:07.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.288+0000 7fdba77fe640 1 -- 172.21.15.7:0/4181354554 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb94032810 con 0x7fdba80cc1d0 2024-04-25T09:59:07.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.289+0000 7fdbaeecb640 1 -- 172.21.15.7:0/4181354554 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdba80cc1d0 msgr2=0x7fdba80cfd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:07.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.289+0000 7fdbaeecb640 1 --2- 172.21.15.7:0/4181354554 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdba80cc1d0 0x7fdba80cfd90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdba80cd590 tx=0x7fdb9402a250 comp rx=0 tx=0).stop 2024-04-25T09:59:07.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.289+0000 7fdbaeecb640 1 -- 172.21.15.7:0/4181354554 shutdown_connections 2024-04-25T09:59:07.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.289+0000 7fdbaeecb640 1 --2- 172.21.15.7:0/4181354554 >> v2:172.21.15.55:3300/0 conn(0x7fdba80b2820 0x7fdba815f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:07.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.289+0000 7fdbaeecb640 1 --2- 172.21.15.7:0/4181354554 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdba80cc1d0 0x7fdba80cfd90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:07.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.289+0000 7fdbaeecb640 1 -- 172.21.15.7:0/4181354554 >> 172.21.15.7:0/4181354554 conn(0x7fdba80999f0 msgr2=0x7fdba80b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:07.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.289+0000 7fdbaeecb640 1 -- 172.21.15.7:0/4181354554 shutdown_connections 2024-04-25T09:59:07.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.289+0000 7fdbaeecb640 1 -- 172.21.15.7:0/4181354554 wait complete. 2024-04-25T09:59:07.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.290+0000 7fdbaeecb640 1 Processor -- start 2024-04-25T09:59:07.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.290+0000 7fdbaeecb640 1 -- start start 2024-04-25T09:59:07.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.291+0000 7fdbaeecb640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdba80b2820 0x7fdba80aef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:07.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.291+0000 7fdbaeecb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdba80cc1d0 0x7fdba8152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:07.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.291+0000 7fdbaeecb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdba80cf9b0 0x7fdba80c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:07.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.291+0000 7fdbaeecb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba815ba80 con 0x7fdba80cf9b0 2024-04-25T09:59:07.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.291+0000 7fdbaeecb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba80ccab0 con 0x7fdba80cc1d0 2024-04-25T09:59:07.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.291+0000 7fdbaeecb640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba815bc00 con 0x7fdba80b2820 2024-04-25T09:59:07.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.291+0000 7fdbad468640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdba80cf9b0 0x7fdba80c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:07.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.291+0000 7fdba7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdba80cc1d0 0x7fdba8152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:07.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.291+0000 7fdbacc67640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdba80b2820 0x7fdba80aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:07.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.291+0000 7fdbad468640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdba80cf9b0 0x7fdba80c8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33886/0 (socket says 172.21.15.7:33886) 2024-04-25T09:59:07.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.291+0000 7fdbad468640 1 -- 172.21.15.7:0/1546238685 learned_addr learned my addr 172.21.15.7:0/1546238685 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:07.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.292+0000 7fdba7fff640 1 -- 172.21.15.7:0/1546238685 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdba80b2820 msgr2=0x7fdba80aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:07.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.292+0000 7fdba7fff640 1 --2- 172.21.15.7:0/1546238685 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdba80b2820 0x7fdba80aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:07.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.292+0000 7fdba7fff640 1 -- 172.21.15.7:0/1546238685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdba80cf9b0 msgr2=0x7fdba80c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:07.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.292+0000 7fdba7fff640 1 --2- 172.21.15.7:0/1546238685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdba80cf9b0 0x7fdba80c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:07.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.292+0000 7fdba7fff640 1 -- 172.21.15.7:0/1546238685 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba80af610 con 0x7fdba80cc1d0 2024-04-25T09:59:07.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.292+0000 7fdbad468640 1 --2- 172.21.15.7:0/1546238685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdba80cf9b0 0x7fdba80c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:59:07.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.292+0000 7fdba7fff640 1 --2- 172.21.15.7:0/1546238685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdba80cc1d0 0x7fdba8152c10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdb94031000 tx=0x7fdb940046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:07.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.292+0000 7fdba57fa640 1 -- 172.21.15.7:0/1546238685 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb94041030 con 0x7fdba80cc1d0 2024-04-25T09:59:07.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.292+0000 7fdba57fa640 1 -- 172.21.15.7:0/1546238685 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb94030440 con 0x7fdba80cc1d0 2024-04-25T09:59:07.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.292+0000 7fdbaeecb640 1 -- 172.21.15.7:0/1546238685 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba80c7950 con 0x7fdba80cc1d0 2024-04-25T09:59:07.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.292+0000 7fdba57fa640 1 -- 172.21.15.7:0/1546238685 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb94037040 con 0x7fdba80cc1d0 2024-04-25T09:59:07.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.292+0000 7fdbaeecb640 1 -- 172.21.15.7:0/1546238685 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba80c4830 con 0x7fdba80cc1d0 2024-04-25T09:59:07.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.293+0000 7fdbaeecb640 1 -- 172.21.15.7:0/1546238685 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba8068f60 con 0x7fdba80cc1d0 2024-04-25T09:59:07.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.294+0000 7fdba57fa640 1 -- 172.21.15.7:0/1546238685 <== mon.1 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdb94044070 con 0x7fdba80cc1d0 2024-04-25T09:59:07.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.294+0000 7fdba57fa640 1 --2- 172.21.15.7:0/1546238685 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdb8c06b4d0 0x7fdb8c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:07.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.294+0000 7fdba57fa640 1 -- 172.21.15.7:0/1546238685 <== mon.1 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fdb940aa8d0 con 0x7fdba80cc1d0 2024-04-25T09:59:07.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.294+0000 7fdbacc67640 1 --2- 172.21.15.7:0/1546238685 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdb8c06b4d0 0x7fdb8c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:07.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.295+0000 7fdbacc67640 1 --2- 172.21.15.7:0/1546238685 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdb8c06b4d0 0x7fdb8c06d990 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c007fd0 tx=0x7fdb9c007e80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:07.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.299+0000 7fdba57fa640 1 -- 172.21.15.7:0/1546238685 <== mon.1 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdb94079030 con 0x7fdba80cc1d0 2024-04-25T09:59:07.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.478+0000 7fdbaeecb640 1 -- 172.21.15.7:0/1546238685 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdba81596b0 con 0x7fdba80cc1d0 2024-04-25T09:59:07.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.479+0000 7fdba57fa640 1 -- 172.21.15.7:0/1546238685 <== mon.1 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdb9407d0d0 con 0x7fdba80cc1d0 2024-04-25T09:59:07.483 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T09:59:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.481+0000 7fdbaeecb640 1 -- 172.21.15.7:0/1546238685 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdb8c06b4d0 msgr2=0x7fdb8c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.481+0000 7fdbaeecb640 1 --2- 172.21.15.7:0/1546238685 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdb8c06b4d0 0x7fdb8c06d990 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c007fd0 tx=0x7fdb9c007e80 comp rx=0 tx=0).stop 2024-04-25T09:59:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.481+0000 7fdbaeecb640 1 -- 172.21.15.7:0/1546238685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdba80cc1d0 msgr2=0x7fdba8152c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.481+0000 7fdbaeecb640 1 --2- 172.21.15.7:0/1546238685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdba80cc1d0 0x7fdba8152c10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdb94031000 tx=0x7fdb940046c0 comp rx=0 tx=0).stop 2024-04-25T09:59:07.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.481+0000 7fdbaeecb640 1 -- 172.21.15.7:0/1546238685 shutdown_connections 2024-04-25T09:59:07.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.481+0000 7fdbaeecb640 1 --2- 172.21.15.7:0/1546238685 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdb8c06b4d0 0x7fdb8c06d990 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:07.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.481+0000 7fdbaeecb640 1 --2- 172.21.15.7:0/1546238685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdba80cf9b0 0x7fdba80c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:07.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.481+0000 7fdbaeecb640 1 --2- 172.21.15.7:0/1546238685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdba80cc1d0 0x7fdba8152c10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:07.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.481+0000 7fdbaeecb640 1 --2- 172.21.15.7:0/1546238685 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdba80b2820 0x7fdba80aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:07.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.481+0000 7fdbaeecb640 1 -- 172.21.15.7:0/1546238685 >> 172.21.15.7:0/1546238685 conn(0x7fdba80999f0 msgr2=0x7fdba80b07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:07.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.481+0000 7fdbaeecb640 1 -- 172.21.15.7:0/1546238685 shutdown_connections 2024-04-25T09:59:07.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.481+0000 7fdbaeecb640 1 -- 172.21.15.7:0/1546238685 wait complete. 2024-04-25T09:59:07.496 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:59:07.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.594+0000 7f03a2acb640 1 Processor -- start 2024-04-25T09:59:07.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.594+0000 7f03a2acb640 1 -- start start 2024-04-25T09:59:07.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.595+0000 7f03a2acb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f039c0b5e60 0x7f039c06bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:07.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.595+0000 7f03a2acb640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f039c06cd00 con 0x7f039c15dd00 2024-04-25T09:59:07.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.595+0000 7f03a2acb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f039c0d1ca0 con 0x7f039c0b6a40 2024-04-25T09:59:07.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.595+0000 7f03a2acb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f039c15e0e0 con 0x7f039c0b5e60 2024-04-25T09:59:07.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.595+0000 7f03a0867640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f039c15dd00 0x7f039c0b5750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33708/0 (socket says 172.21.15.7:33708) 2024-04-25T09:59:07.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.595+0000 7f03a0867640 1 -- 172.21.15.7:0/2329102898 learned_addr learned my addr 172.21.15.7:0/2329102898 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:59:07.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.595+0000 7f039bfff640 1 --2- 172.21.15.7:0/2329102898 >> v2:172.21.15.55:3300/0 conn(0x7f039c0b5e60 0x7f039c06bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:07.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.595+0000 7f039b7fe640 1 -- 172.21.15.7:0/2329102898 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1931507900 0 0) 0x7f039c06cd00 con 0x7f039c15dd00 2024-04-25T09:59:07.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.595+0000 7f039b7fe640 1 -- 172.21.15.7:0/2329102898 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f038c003520 con 0x7f039c15dd00 2024-04-25T09:59:07.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.595+0000 7f039b7fe640 1 -- 172.21.15.7:0/2329102898 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3464925880 0 0) 0x7f038c003520 con 0x7f039c15dd00 2024-04-25T09:59:07.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.595+0000 7f039b7fe640 1 -- 172.21.15.7:0/2329102898 >> v2:172.21.15.55:3300/0 conn(0x7f039c0b5e60 msgr2=0x7f039c06bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:07.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.595+0000 7f039b7fe640 1 --2- 172.21.15.7:0/2329102898 >> v2:172.21.15.55:3300/0 conn(0x7f039c0b5e60 0x7f039c06bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:07.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.595+0000 7f039b7fe640 1 -- 172.21.15.7:0/2329102898 >> v1:172.21.15.55:6789/0 conn(0x7f039c0b6a40 legacy=0x7f039c06c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:07.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.596+0000 7f039b7fe640 1 -- 172.21.15.7:0/2329102898 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039c0d1f80 con 0x7f039c15dd00 2024-04-25T09:59:07.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.596+0000 7f039b7fe640 1 -- 172.21.15.7:0/2329102898 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f0390001670 con 0x7f039c15dd00 2024-04-25T09:59:07.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.596+0000 7f039bfff640 1 --2- 172.21.15.7:0/2329102898 >> v2:172.21.15.55:3300/0 conn(0x7f039c0b5e60 0x7f039c06bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:59:07.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.596+0000 7f039b7fe640 1 -- 172.21.15.7:0/2329102898 >> v1:172.21.15.7:6789/0 conn(0x7f039c15dd00 legacy=0x7f039c0b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:07.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.596+0000 7f039b7fe640 1 --2- 172.21.15.7:0/2329102898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f038c0039b0 0x7f038c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:07.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.596+0000 7f039b7fe640 1 --2- 172.21.15.7:0/2329102898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f038c004800 0x7f038c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:07.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.596+0000 7f039b7fe640 1 --2- 172.21.15.7:0/2329102898 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f038c0051c0 0x7f038c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:07.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.596+0000 7f039b7fe640 1 -- 172.21.15.7:0/2329102898 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039c15e0e0 con 0x7f038c004800 2024-04-25T09:59:07.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.596+0000 7f039b7fe640 1 -- 172.21.15.7:0/2329102898 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038c00c060 con 0x7f038c0039b0 2024-04-25T09:59:07.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.596+0000 7f039b7fe640 1 -- 172.21.15.7:0/2329102898 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f038c00c260 con 0x7f038c0051c0 2024-04-25T09:59:07.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.596+0000 7f039bfff640 1 --2- 172.21.15.7:0/2329102898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f038c004800 0x7f038c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:07.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.596+0000 7f03a0867640 1 --2- 172.21.15.7:0/2329102898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f038c0039b0 0x7f038c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:07.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.596+0000 7f03a1068640 1 --2- 172.21.15.7:0/2329102898 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f038c0051c0 0x7f038c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:07.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.596+0000 7f039bfff640 1 -- 172.21.15.7:0/2329102898 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f038c0051c0 msgr2=0x7f038c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:07.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.596+0000 7f039bfff640 1 --2- 172.21.15.7:0/2329102898 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f038c0051c0 0x7f038c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:07.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.596+0000 7f039bfff640 1 -- 172.21.15.7:0/2329102898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f038c0039b0 msgr2=0x7f038c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:07.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.596+0000 7f039bfff640 1 --2- 172.21.15.7:0/2329102898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f038c0039b0 0x7f038c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:07.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.596+0000 7f039bfff640 1 -- 172.21.15.7:0/2329102898 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038c003520 con 0x7f038c004800 2024-04-25T09:59:07.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.596+0000 7f03a1068640 1 --2- 172.21.15.7:0/2329102898 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f038c0051c0 0x7f038c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:59:07.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.596+0000 7f03a1068640 1 -- 172.21.15.7:0/2329102898 reap_dead start 2024-04-25T09:59:07.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.597+0000 7f039bfff640 1 --2- 172.21.15.7:0/2329102898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f038c004800 0x7f038c004c80 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f0388009c90 tx=0x7f038c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435496143f40e971 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:07.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.597+0000 7f039b7fe640 1 -- 172.21.15.7:0/2329102898 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0388036070 con 0x7f038c004800 2024-04-25T09:59:07.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.597+0000 7f039b7fe640 1 -- 172.21.15.7:0/2329102898 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0388031400 con 0x7f038c004800 2024-04-25T09:59:07.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.597+0000 7f039b7fe640 1 -- 172.21.15.7:0/2329102898 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0388009860 con 0x7f038c004800 2024-04-25T09:59:07.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.597+0000 7f03a2acb640 1 -- 172.21.15.7:0/2329102898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f038c004800 msgr2=0x7f038c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:07.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.597+0000 7f03a2acb640 1 --2- 172.21.15.7:0/2329102898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f038c004800 0x7f038c004c80 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f0388009c90 tx=0x7f038c005830 comp rx=0 tx=0).stop 2024-04-25T09:59:07.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.598+0000 7f03a2acb640 1 -- 172.21.15.7:0/2329102898 shutdown_connections 2024-04-25T09:59:07.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.598+0000 7f03a2acb640 1 --2- 172.21.15.7:0/2329102898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f038c004800 0x7f038c004c80 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:07.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.598+0000 7f03a2acb640 1 -- 172.21.15.7:0/2329102898 >> 172.21.15.7:0/2329102898 conn(0x7f039c0d07b0 msgr2=0x7f039c0d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:07.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.598+0000 7f03a2acb640 1 -- 172.21.15.7:0/2329102898 shutdown_connections 2024-04-25T09:59:07.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.598+0000 7f03a2acb640 1 -- 172.21.15.7:0/2329102898 wait complete. 2024-04-25T09:59:07.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.599+0000 7f03a2acb640 1 Processor -- start 2024-04-25T09:59:07.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.599+0000 7f03a2acb640 1 -- start start 2024-04-25T09:59:07.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.600+0000 7f03a2acb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f038c004800 0x7f039c150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:07.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.600+0000 7f03a2acb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f039c0cafa0 0x7f039c1f3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:07.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.600+0000 7f03a2acb640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f039c1f3bc0 0x7f039c159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:07.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.600+0000 7f03a2acb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039c0b5750 con 0x7f039c0cafa0 2024-04-25T09:59:07.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.600+0000 7f03a2acb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039c06cfe0 con 0x7f038c004800 2024-04-25T09:59:07.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.600+0000 7f03a2acb640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f039c0b58d0 con 0x7f039c1f3bc0 2024-04-25T09:59:07.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.600+0000 7f039bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f039c0cafa0 0x7f039c1f3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:07.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.600+0000 7f039bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f039c0cafa0 0x7f039c1f3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33912/0 (socket says 172.21.15.7:33912) 2024-04-25T09:59:07.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.600+0000 7f039bfff640 1 -- 172.21.15.7:0/2485637094 learned_addr learned my addr 172.21.15.7:0/2485637094 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:07.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.600+0000 7f03a0867640 1 --2- 172.21.15.7:0/2485637094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f038c004800 0x7f039c150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:07.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.600+0000 7f03a1068640 1 --2- 172.21.15.7:0/2485637094 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f039c1f3bc0 0x7f039c159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:07.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.600+0000 7f039bfff640 1 -- 172.21.15.7:0/2485637094 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f039c1f3bc0 msgr2=0x7f039c159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:07.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.600+0000 7f039bfff640 1 --2- 172.21.15.7:0/2485637094 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f039c1f3bc0 0x7f039c159fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:07.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.600+0000 7f039bfff640 1 -- 172.21.15.7:0/2485637094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f038c004800 msgr2=0x7f039c150aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:07.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.600+0000 7f039bfff640 1 --2- 172.21.15.7:0/2485637094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f038c004800 0x7f039c150aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:07.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.600+0000 7f039bfff640 1 -- 172.21.15.7:0/2485637094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039c1f4100 con 0x7f039c0cafa0 2024-04-25T09:59:07.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.600+0000 7f039bfff640 1 --2- 172.21.15.7:0/2485637094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f039c0cafa0 0x7f039c1f3680 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f0388009c90 tx=0x7f0388004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:07.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.600+0000 7f03997fa640 1 -- 172.21.15.7:0/2485637094 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0388040070 con 0x7f039c0cafa0 2024-04-25T09:59:07.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.600+0000 7f03997fa640 1 -- 172.21.15.7:0/2485637094 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038803b680 con 0x7f039c0cafa0 2024-04-25T09:59:07.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.600+0000 7f03a2acb640 1 -- 172.21.15.7:0/2485637094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f039c1f43e0 con 0x7f039c0cafa0 2024-04-25T09:59:07.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.600+0000 7f03997fa640 1 -- 172.21.15.7:0/2485637094 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0388036040 con 0x7f039c0cafa0 2024-04-25T09:59:07.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.600+0000 7f03a2acb640 1 -- 172.21.15.7:0/2485637094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f039c1f4cd0 con 0x7f039c0cafa0 2024-04-25T09:59:07.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.601+0000 7f03a2acb640 1 -- 172.21.15.7:0/2485637094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f039c068fd0 con 0x7f039c0cafa0 2024-04-25T09:59:07.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.602+0000 7f03997fa640 1 -- 172.21.15.7:0/2485637094 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0388043070 con 0x7f039c0cafa0 2024-04-25T09:59:07.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.602+0000 7f03997fa640 1 --2- 172.21.15.7:0/2485637094 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f038006b4d0 0x7f038006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:07.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.602+0000 7f03997fa640 1 -- 172.21.15.7:0/2485637094 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f03880aac50 con 0x7f039c0cafa0 2024-04-25T09:59:07.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.602+0000 7f03a0867640 1 --2- 172.21.15.7:0/2485637094 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f038006b4d0 0x7f038006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:07.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.603+0000 7f03a0867640 1 --2- 172.21.15.7:0/2485637094 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f038006b4d0 0x7f038006d990 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0390001eb0 tx=0x7f0390009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:07.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.606+0000 7f03997fa640 1 -- 172.21.15.7:0/2485637094 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0388079320 con 0x7f039c0cafa0 2024-04-25T09:59:07.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.798+0000 7f03a2acb640 1 -- 172.21.15.7:0/2485637094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f039c0d1620 con 0x7f039c0cafa0 2024-04-25T09:59:07.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.799+0000 7f03997fa640 1 -- 172.21.15.7:0/2485637094 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v76) v1 ==== 80+0+122 (secure 0 0 0) 0x7f038807d3c0 con 0x7f039c0cafa0 2024-04-25T09:59:07.803 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.55:6834/1012943595 2024-04-26T09:58:59.374192+0000 2024-04-25T09:59:07.803 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.55:6832/1012943595 2024-04-26T09:58:59.374192+0000 2024-04-25T09:59:07.803 INFO:teuthology.orchestra.run.smithi007.stderr:listed 2 entries 2024-04-25T09:59:07.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.801+0000 7f03a2acb640 1 -- 172.21.15.7:0/2485637094 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f038006b4d0 msgr2=0x7f038006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:07.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.801+0000 7f03a2acb640 1 --2- 172.21.15.7:0/2485637094 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f038006b4d0 0x7f038006d990 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0390001eb0 tx=0x7f0390009040 comp rx=0 tx=0).stop 2024-04-25T09:59:07.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.801+0000 7f03a2acb640 1 -- 172.21.15.7:0/2485637094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f039c0cafa0 msgr2=0x7f039c1f3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:07.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.801+0000 7f03a2acb640 1 --2- 172.21.15.7:0/2485637094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f039c0cafa0 0x7f039c1f3680 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f0388009c90 tx=0x7f0388004730 comp rx=0 tx=0).stop 2024-04-25T09:59:07.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.801+0000 7f03a2acb640 1 -- 172.21.15.7:0/2485637094 shutdown_connections 2024-04-25T09:59:07.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.801+0000 7f03a2acb640 1 --2- 172.21.15.7:0/2485637094 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f038006b4d0 0x7f038006d990 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:07.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.801+0000 7f03a2acb640 1 --2- 172.21.15.7:0/2485637094 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f039c1f3bc0 0x7f039c159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:07.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.801+0000 7f03a2acb640 1 --2- 172.21.15.7:0/2485637094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f039c0cafa0 0x7f039c1f3680 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:07.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.801+0000 7f03a2acb640 1 --2- 172.21.15.7:0/2485637094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f038c004800 0x7f039c150aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:07.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.801+0000 7f03a2acb640 1 -- 172.21.15.7:0/2485637094 >> 172.21.15.7:0/2485637094 conn(0x7f039c0d07b0 msgr2=0x7f039c0b4910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:07.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.801+0000 7f03a2acb640 1 -- 172.21.15.7:0/2485637094 shutdown_connections 2024-04-25T09:59:07.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:07.801+0000 7f03a2acb640 1 -- 172.21.15.7:0/2485637094 wait complete. 2024-04-25T09:59:07.816 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:59:07.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:59:07.816 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:59:07.844 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-04-25T09:59:07.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:59:07.844 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:59:07.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:59:07.900 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub start /subdir recursive 2024-04-25T09:59:08.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.041+0000 7f3619cb3640 1 Processor -- start 2024-04-25T09:59:08.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.041+0000 7f3619cb3640 1 -- start start 2024-04-25T09:59:08.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.041+0000 7f3619cb3640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f361415dba0 0x7f36140b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.041+0000 7f3619cb3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36140b6a40 0x7f36140d0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.041+0000 7f3619cb3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36140d1a10 con 0x7f361415df80 2024-04-25T09:59:08.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.041+0000 7f3619cb3640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36140d1cb0 con 0x7f361415dba0 2024-04-25T09:59:08.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.041+0000 7f3619cb3640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36140d1f90 con 0x7f36140b6a40 2024-04-25T09:59:08.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.042+0000 7f36137fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f361415dba0 0x7f36140b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.042+0000 7f36137fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f361415dba0 0x7f36140b2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33916/0 (socket says 172.21.15.7:33916) 2024-04-25T09:59:08.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.042+0000 7f36137fe640 1 -- 172.21.15.7:0/2897872764 learned_addr learned my addr 172.21.15.7:0/2897872764 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:08.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.042+0000 7f3613fff640 1 --2- 172.21.15.7:0/2897872764 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36140b6a40 0x7f36140d0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.042+0000 7f36137fe640 1 -- 172.21.15.7:0/2897872764 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36140b6a40 msgr2=0x7f36140d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:08.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.042+0000 7f36137fe640 1 --2- 172.21.15.7:0/2897872764 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36140b6a40 0x7f36140d0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.042+0000 7f36137fe640 1 -- 172.21.15.7:0/2897872764 >> v1:172.21.15.55:6789/0 conn(0x7f361415df80 legacy=0x7f36140cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:08.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.042+0000 7f36137fe640 1 -- 172.21.15.7:0/2897872764 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36140d2270 con 0x7f361415dba0 2024-04-25T09:59:08.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.043+0000 7f36137fe640 1 --2- 172.21.15.7:0/2897872764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f361415dba0 0x7f36140b2c00 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f3608009870 tx=0x7f360802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44d36200107c191 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:08.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.043+0000 7f36127fc640 1 -- 172.21.15.7:0/2897872764 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3608037070 con 0x7f361415dba0 2024-04-25T09:59:08.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.043+0000 7f36127fc640 1 -- 172.21.15.7:0/2897872764 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3608032440 con 0x7f361415dba0 2024-04-25T09:59:08.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.043+0000 7f36127fc640 1 -- 172.21.15.7:0/2897872764 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3608032810 con 0x7f361415dba0 2024-04-25T09:59:08.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.043+0000 7f3619cb3640 1 -- 172.21.15.7:0/2897872764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f361415dba0 msgr2=0x7f36140b2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:08.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.043+0000 7f3619cb3640 1 --2- 172.21.15.7:0/2897872764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f361415dba0 0x7f36140b2c00 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f3608009870 tx=0x7f360802a210 comp rx=0 tx=0).stop 2024-04-25T09:59:08.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.043+0000 7f3619cb3640 1 -- 172.21.15.7:0/2897872764 shutdown_connections 2024-04-25T09:59:08.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.043+0000 7f3619cb3640 1 --2- 172.21.15.7:0/2897872764 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36140b6a40 0x7f36140d0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.043+0000 7f3619cb3640 1 --2- 172.21.15.7:0/2897872764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f361415dba0 0x7f36140b2c00 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.043+0000 7f3619cb3640 1 -- 172.21.15.7:0/2897872764 >> 172.21.15.7:0/2897872764 conn(0x7f361406c530 msgr2=0x7f3614072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:08.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.043+0000 7f3619cb3640 1 -- 172.21.15.7:0/2897872764 shutdown_connections 2024-04-25T09:59:08.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.043+0000 7f3619cb3640 1 -- 172.21.15.7:0/2897872764 wait complete. 2024-04-25T09:59:08.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.045+0000 7f3619cb3640 1 Processor -- start 2024-04-25T09:59:08.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.045+0000 7f3619cb3640 1 -- start start 2024-04-25T09:59:08.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.045+0000 7f3619cb3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36140b6a40 0x7f36140cb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.045+0000 7f3619cb3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f361415dba0 0x7f361414cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.045+0000 7f3619cb3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f361415df80 0x7f36141f76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.045+0000 7f3619cb3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36140b7030 con 0x7f361415dba0 2024-04-25T09:59:08.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.045+0000 7f3619cb3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36140b6eb0 con 0x7f361415df80 2024-04-25T09:59:08.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.045+0000 7f3619cb3640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36140b71b0 con 0x7f36140b6a40 2024-04-25T09:59:08.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.046+0000 7f3612ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f361415dba0 0x7f361414cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.046+0000 7f3612ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f361415dba0 0x7f361414cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33932/0 (socket says 172.21.15.7:33932) 2024-04-25T09:59:08.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.046+0000 7f3612ffd640 1 -- 172.21.15.7:0/2075281519 learned_addr learned my addr 172.21.15.7:0/2075281519 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:08.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.046+0000 7f36137fe640 1 --2- 172.21.15.7:0/2075281519 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36140b6a40 0x7f36140cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.046+0000 7f3612ffd640 1 -- 172.21.15.7:0/2075281519 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36140b6a40 msgr2=0x7f36140cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:08.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.046+0000 7f3613fff640 1 --2- 172.21.15.7:0/2075281519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f361415df80 0x7f36141f76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.046+0000 7f3612ffd640 1 --2- 172.21.15.7:0/2075281519 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36140b6a40 0x7f36140cb210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.046+0000 7f3612ffd640 1 -- 172.21.15.7:0/2075281519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f361415df80 msgr2=0x7f36141f76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:08.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.046+0000 7f3612ffd640 1 --2- 172.21.15.7:0/2075281519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f361415df80 0x7f36141f76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.046+0000 7f3612ffd640 1 -- 172.21.15.7:0/2075281519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361414de10 con 0x7f361415dba0 2024-04-25T09:59:08.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.046+0000 7f3612ffd640 1 --2- 172.21.15.7:0/2075281519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f361415dba0 0x7f361414cea0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f360400b3f0 tx=0x7f360400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:08.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.046+0000 7f35fbfff640 1 -- 172.21.15.7:0/2075281519 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3604015020 con 0x7f361415dba0 2024-04-25T09:59:08.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.046+0000 7f35fbfff640 1 -- 172.21.15.7:0/2075281519 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3604011830 con 0x7f361415dba0 2024-04-25T09:59:08.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.046+0000 7f3619cb3640 1 -- 172.21.15.7:0/2075281519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f361414d850 con 0x7f361415dba0 2024-04-25T09:59:08.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.046+0000 7f35fbfff640 1 -- 172.21.15.7:0/2075281519 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3604011c20 con 0x7f361415dba0 2024-04-25T09:59:08.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.046+0000 7f3619cb3640 1 -- 172.21.15.7:0/2075281519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36140caa10 con 0x7f361415dba0 2024-04-25T09:59:08.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.048+0000 7f35fbfff640 1 -- 172.21.15.7:0/2075281519 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3604018020 con 0x7f361415dba0 2024-04-25T09:59:08.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.048+0000 7f35fbfff640 1 --2- 172.21.15.7:0/2075281519 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f360006b4d0 0x7f360006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.048+0000 7f35fbfff640 1 -- 172.21.15.7:0/2075281519 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f360408a2d0 con 0x7f361415dba0 2024-04-25T09:59:08.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.048+0000 7f36137fe640 1 --2- 172.21.15.7:0/2075281519 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f360006b4d0 0x7f360006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.049+0000 7f36137fe640 1 --2- 172.21.15.7:0/2075281519 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f360006b4d0 0x7f360006d990 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3608034000 tx=0x7f360802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:08.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.049+0000 7f361c9b5740 1 Processor -- start 2024-04-25T09:59:08.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.049+0000 7f361c9b5740 1 -- start start 2024-04-25T09:59:08.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.050+0000 7f361c9b5740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d553e03080 0x55d553e03460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.050+0000 7f361c9b5740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55d553e03aa0 0x55d553dd3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.050+0000 7f361c9b5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d553dd3740 0x55d553dfb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.050+0000 7f361c9b5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d553d3c0a0 con 0x55d553dd3740 2024-04-25T09:59:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.050+0000 7f361c9b5740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d553ce4d40 con 0x55d553e03080 2024-04-25T09:59:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.050+0000 7f361c9b5740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d553d38140 con 0x55d553e03aa0 2024-04-25T09:59:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.050+0000 7f3613fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d553dd3740 0x55d553dfb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.050+0000 7f3613fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d553dd3740 0x55d553dfb500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33938/0 (socket says 172.21.15.7:33938) 2024-04-25T09:59:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.050+0000 7f3613fff640 1 -- 172.21.15.7:0/615030720 learned_addr learned my addr 172.21.15.7:0/615030720 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.050+0000 7f3612ffd640 1 --2- 172.21.15.7:0/615030720 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55d553e03aa0 0x55d553dd3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.050+0000 7f36137fe640 1 --2- 172.21.15.7:0/615030720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d553e03080 0x55d553e03460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.050+0000 7f3613fff640 1 -- 172.21.15.7:0/615030720 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55d553e03aa0 msgr2=0x55d553dd3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.050+0000 7f3613fff640 1 --2- 172.21.15.7:0/615030720 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55d553e03aa0 0x55d553dd3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.050+0000 7f3613fff640 1 -- 172.21.15.7:0/615030720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d553e03080 msgr2=0x55d553e03460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:08.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.050+0000 7f3613fff640 1 --2- 172.21.15.7:0/615030720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d553e03080 0x55d553e03460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.050+0000 7f3613fff640 1 -- 172.21.15.7:0/615030720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d553b1ca20 con 0x55d553dd3740 2024-04-25T09:59:08.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.050+0000 7f36137fe640 1 --2- 172.21.15.7:0/615030720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d553e03080 0x55d553e03460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:59:08.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.051+0000 7f3613fff640 1 --2- 172.21.15.7:0/615030720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d553dd3740 0x55d553dfb500 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f360c008fa0 tx=0x7f360c00d810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ad46776728fd05 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:08.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.051+0000 7f35f97fa640 1 -- 172.21.15.7:0/615030720 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c003da0 con 0x55d553dd3740 2024-04-25T09:59:08.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.051+0000 7f35f97fa640 1 -- 172.21.15.7:0/615030720 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360c004030 con 0x55d553dd3740 2024-04-25T09:59:08.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.051+0000 7f35f97fa640 1 -- 172.21.15.7:0/615030720 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c004400 con 0x55d553dd3740 2024-04-25T09:59:08.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.051+0000 7f361c9b5740 1 -- 172.21.15.7:0/615030720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d553dd3740 msgr2=0x55d553dfb500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:08.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.051+0000 7f361c9b5740 1 --2- 172.21.15.7:0/615030720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d553dd3740 0x55d553dfb500 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f360c008fa0 tx=0x7f360c00d810 comp rx=0 tx=0).stop 2024-04-25T09:59:08.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.051+0000 7f361c9b5740 1 -- 172.21.15.7:0/615030720 shutdown_connections 2024-04-25T09:59:08.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.051+0000 7f361c9b5740 1 --2- 172.21.15.7:0/615030720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d553dd3740 0x55d553dfb500 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.051+0000 7f361c9b5740 1 --2- 172.21.15.7:0/615030720 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55d553e03aa0 0x55d553dd3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.051+0000 7f361c9b5740 1 --2- 172.21.15.7:0/615030720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d553e03080 0x55d553e03460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.051+0000 7f361c9b5740 1 -- 172.21.15.7:0/615030720 >> 172.21.15.7:0/615030720 conn(0x55d553dd5470 msgr2=0x55d553e1de90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:08.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.052+0000 7f361c9b5740 1 -- 172.21.15.7:0/615030720 shutdown_connections 2024-04-25T09:59:08.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.052+0000 7f361c9b5740 1 -- 172.21.15.7:0/615030720 wait complete. 2024-04-25T09:59:08.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.052+0000 7f361c9b5740 1 -- start start 2024-04-25T09:59:08.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.052+0000 7f361c9b5740 1 Processor -- start 2024-04-25T09:59:08.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.053+0000 7f361c9b5740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55d553e03080 0x55d553e2ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.053+0000 7f361c9b5740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d553e03aa0 0x55d553dfd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.053+0000 7f361c9b5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d553dfda50 0x55d553dfb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.053+0000 7f361c9b5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d553dff7d0 con 0x55d553dfda50 2024-04-25T09:59:08.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.053+0000 7f361c9b5740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d553cda3d0 con 0x55d553e03aa0 2024-04-25T09:59:08.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.053+0000 7f361c9b5740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d553dffa70 con 0x55d553e03080 2024-04-25T09:59:08.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.053+0000 7f361c9b5740 10 client.0 _ll_register_callbacks cb 0x55d553a4fe00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:59:08.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.053+0000 7f3613fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d553dfda50 0x55d553dfb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.053+0000 7f3613fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d553dfda50 0x55d553dfb2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33954/0 (socket says 172.21.15.7:33954) 2024-04-25T09:59:08.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.053+0000 7f3613fff640 1 -- 172.21.15.7:0/1218517989 learned_addr learned my addr 172.21.15.7:0/1218517989 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:08.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.053+0000 7f36137fe640 1 --2- 172.21.15.7:0/1218517989 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55d553e03080 0x55d553e2ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.053+0000 7f3612ffd640 1 --2- 172.21.15.7:0/1218517989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d553e03aa0 0x55d553dfd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.053+0000 7f3613fff640 1 -- 172.21.15.7:0/1218517989 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55d553e03080 msgr2=0x55d553e2ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:08.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.053+0000 7f3613fff640 1 --2- 172.21.15.7:0/1218517989 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55d553e03080 0x55d553e2ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.053+0000 7f3613fff640 1 -- 172.21.15.7:0/1218517989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d553e03aa0 msgr2=0x55d553dfd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.053+0000 7f3613fff640 1 --2- 172.21.15.7:0/1218517989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d553e03aa0 0x55d553dfd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.053+0000 7f3613fff640 1 -- 172.21.15.7:0/1218517989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d553a10310 con 0x55d553dfda50 2024-04-25T09:59:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.054+0000 7f3613fff640 1 --2- 172.21.15.7:0/1218517989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d553dfda50 0x55d553dfb2d0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x55d553dd4910 tx=0x7f360c010070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf90cfc7da5c377 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.054+0000 7f35f27fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:59:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.054+0000 7f35f27fc640 1 -- 172.21.15.7:0/1218517989 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c028060 con 0x55d553dfda50 2024-04-25T09:59:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.054+0000 7f35f27fc640 1 -- 172.21.15.7:0/1218517989 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f360c0045f0 con 0x55d553dfda50 2024-04-25T09:59:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.054+0000 7f361c9b5740 1 -- 172.21.15.7:0/1218517989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f360c004030 con 0x55d553dfda50 2024-04-25T09:59:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.054+0000 7f35f27fc640 1 -- 172.21.15.7:0/1218517989 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f360c02e050 con 0x55d553dfda50 2024-04-25T09:59:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.054+0000 7f361c9b5740 10 client.7173 fetch_fsmap learned FSMap version 44 2024-04-25T09:59:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.054+0000 7f361c9b5740 1 -- 172.21.15.7:0/1218517989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x55d553b7d1b0 con 0x55d553dfda50 2024-04-25T09:59:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.054+0000 7f35f27fc640 1 -- 172.21.15.7:0/1218517989 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360c004030 con 0x55d553dfda50 2024-04-25T09:59:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.054+0000 7f35f27fc640 1 -- 172.21.15.7:0/1218517989 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 44) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f360c00e4b0 con 0x55d553dfda50 2024-04-25T09:59:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.054+0000 7f361c9b5740 10 client.7173 fetch_fsmap finished waiting for FSMap version 44 2024-04-25T09:59:08.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.054+0000 7f361c9b5740 10 client.7173 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T09:59:08.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.054+0000 7f361c9b5740 20 client.7173 populate_metadata read hostname 'smithi007' 2024-04-25T09:59:08.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.054+0000 7f361c9b5740 1 --2- 172.21.15.7:0/1218517989 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x55d553e314d0 0x55d553e318e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.054+0000 7f361c9b5740 4 client.7173 mds_command: new command op to 6813 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:59:08.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.054+0000 7f361c9b5740 1 -- 172.21.15.7:0/1218517989 --> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d553d495e0 con 0x55d553e314d0 2024-04-25T09:59:08.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.054+0000 7f36137fe640 1 --2- 172.21.15.7:0/1218517989 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x55d553e314d0 0x55d553e318e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.055+0000 7f35f27fc640 10 client.7173 ms_handle_connect on v2:172.21.15.7:6836/3690076929 2024-04-25T09:59:08.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.055+0000 7f36137fe640 1 --2- 172.21.15.7:0/1218517989 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x55d553e314d0 0x55d553e318e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed4c59f42a1da213 server_cookie=fc358434ca232b29 in_seq=0 out_seq=0 2024-04-25T09:59:08.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.055+0000 7f35f27fc640 1 -- 172.21.15.7:0/1218517989 <== mds.0 v2:172.21.15.7:6836/3690076929 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d553d495e0 con 0x55d553e314d0 2024-04-25T09:59:08.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.055+0000 7f35f27fc640 10 client.7173 handle_command_reply: tid=0 2024-04-25T09:59:08.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.055+0000 7f361c9b5740 1 client.7173 shutdown 2024-04-25T09:59:08.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.055+0000 7f361c9b5740 1 -- 172.21.15.7:0/1218517989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d553dfda50 msgr2=0x55d553dfb2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:08.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.055+0000 7f361c9b5740 1 --2- 172.21.15.7:0/1218517989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d553dfda50 0x55d553dfb2d0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x55d553dd4910 tx=0x7f360c010070 comp rx=0 tx=0).stop 2024-04-25T09:59:08.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.055+0000 7f361c9b5740 1 -- 172.21.15.7:0/1218517989 shutdown_connections 2024-04-25T09:59:08.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.055+0000 7f361c9b5740 1 --2- 172.21.15.7:0/1218517989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d553dfda50 0x55d553dfb2d0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.055+0000 7f361c9b5740 1 --2- 172.21.15.7:0/1218517989 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x55d553e314d0 0x55d553e318e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.055+0000 7f361c9b5740 1 --2- 172.21.15.7:0/1218517989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d553e03aa0 0x55d553dfd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.055+0000 7f361c9b5740 1 --2- 172.21.15.7:0/1218517989 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55d553e03080 0x55d553e2ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.055+0000 7f35f27fc640 0 client.7173 ms_handle_reset on v2:172.21.15.7:6836/3690076929 2024-04-25T09:59:08.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.055+0000 7f361c9b5740 1 -- 172.21.15.7:0/1218517989 >> 172.21.15.7:0/1218517989 conn(0x55d553dd3740 msgr2=0x55d553dd28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:08.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.056+0000 7f361c9b5740 1 -- 172.21.15.7:0/1218517989 shutdown_connections 2024-04-25T09:59:08.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.056+0000 7f361c9b5740 1 -- 172.21.15.7:0/1218517989 wait complete. 2024-04-25T09:59:08.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.056+0000 7f361c9b5740 20 client.7173 trim_cache size 0 max 16384 2024-04-25T09:59:08.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.071+0000 7f361c9b5740 1 Processor -- start 2024-04-25T09:59:08.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.071+0000 7f361c9b5740 1 -- start start 2024-04-25T09:59:08.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.072+0000 7f361c9b5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d553dfda50 0x55d553dfec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.072+0000 7f361c9b5740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55d553e03080 0x55d553e40920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.072+0000 7f361c9b5740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d553e03aa0 0x55d553e1dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.072+0000 7f361c9b5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36142003a0 con 0x55d553dfda50 2024-04-25T09:59:08.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.072+0000 7f361c9b5740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36141ff560 con 0x55d553e03aa0 2024-04-25T09:59:08.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.072+0000 7f361c9b5740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36140aaf50 con 0x55d553e03080 2024-04-25T09:59:08.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.072+0000 7f36137fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d553dfda50 0x55d553dfec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.072+0000 7f36137fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d553dfda50 0x55d553dfec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33962/0 (socket says 172.21.15.7:33962) 2024-04-25T09:59:08.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.072+0000 7f36137fe640 1 -- 172.21.15.7:0/1982521759 learned_addr learned my addr 172.21.15.7:0/1982521759 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:08.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.072+0000 7f36137fe640 1 -- 172.21.15.7:0/1982521759 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55d553e03080 msgr2=0x55d553e40920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:08.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.072+0000 7f36137fe640 1 --2- 172.21.15.7:0/1982521759 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55d553e03080 0x55d553e40920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.072+0000 7f36137fe640 1 -- 172.21.15.7:0/1982521759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d553e03aa0 msgr2=0x55d553e1dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:08.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.072+0000 7f36137fe640 1 --2- 172.21.15.7:0/1982521759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d553e03aa0 0x55d553e1dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.072+0000 7f36137fe640 1 -- 172.21.15.7:0/1982521759 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5539e9490 con 0x55d553dfda50 2024-04-25T09:59:08.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.072+0000 7f36137fe640 1 --2- 172.21.15.7:0/1982521759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d553dfda50 0x55d553dfec90 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f3608000c00 tx=0x7f360802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42132ac5e86eb7f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:08.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.072+0000 7f35f8ff9640 1 -- 172.21.15.7:0/1982521759 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3608053030 con 0x55d553dfda50 2024-04-25T09:59:08.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.073+0000 7f35f8ff9640 1 -- 172.21.15.7:0/1982521759 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360804e160 con 0x55d553dfda50 2024-04-25T09:59:08.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.073+0000 7f35f8ff9640 1 -- 172.21.15.7:0/1982521759 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3608037040 con 0x55d553dfda50 2024-04-25T09:59:08.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.073+0000 7f361c9b5740 1 -- 172.21.15.7:0/1982521759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d553dfda50 msgr2=0x55d553dfec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:08.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.073+0000 7f361c9b5740 1 --2- 172.21.15.7:0/1982521759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d553dfda50 0x55d553dfec90 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f3608000c00 tx=0x7f360802c000 comp rx=0 tx=0).stop 2024-04-25T09:59:08.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.073+0000 7f361c9b5740 1 -- 172.21.15.7:0/1982521759 shutdown_connections 2024-04-25T09:59:08.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.073+0000 7f361c9b5740 1 --2- 172.21.15.7:0/1982521759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d553e03aa0 0x55d553e1dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.073+0000 7f361c9b5740 1 --2- 172.21.15.7:0/1982521759 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55d553e03080 0x55d553e40920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.073+0000 7f361c9b5740 1 --2- 172.21.15.7:0/1982521759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d553dfda50 0x55d553dfec90 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.073+0000 7f361c9b5740 1 -- 172.21.15.7:0/1982521759 >> 172.21.15.7:0/1982521759 conn(0x55d553dd3740 msgr2=0x55d553dfb090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:08.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.073+0000 7f361c9b5740 1 -- 172.21.15.7:0/1982521759 shutdown_connections 2024-04-25T09:59:08.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.073+0000 7f361c9b5740 1 -- 172.21.15.7:0/1982521759 wait complete. 2024-04-25T09:59:08.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.074+0000 7f361c9b5740 1 -- start start 2024-04-25T09:59:08.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.074+0000 7f361c9b5740 1 Processor -- start 2024-04-25T09:59:08.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.075+0000 7f361c9b5740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55d553dfda50 0x55d553df9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.075+0000 7f361c9b5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d553e03080 0x55d553e1d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.075+0000 7f361c9b5740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d553e03aa0 0x55d553e1de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.075+0000 7f361c9b5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d553dfd4a0 con 0x55d553e03080 2024-04-25T09:59:08.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.075+0000 7f361c9b5740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361414b6e0 con 0x55d553e03aa0 2024-04-25T09:59:08.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.075+0000 7f361c9b5740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d553e00220 con 0x55d553dfda50 2024-04-25T09:59:08.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.075+0000 7f361c9b5740 10 client.0 _ll_register_callbacks cb 0x7f360c008700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:59:08.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.075+0000 7f3612ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d553e03080 0x55d553e1d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.075+0000 7f3612ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d553e03080 0x55d553e1d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33978/0 (socket says 172.21.15.7:33978) 2024-04-25T09:59:08.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.075+0000 7f3612ffd640 1 -- 172.21.15.7:0/2531070969 learned_addr learned my addr 172.21.15.7:0/2531070969 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:08.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.075+0000 7f3612ffd640 1 -- 172.21.15.7:0/2531070969 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55d553dfda50 msgr2=0x55d553df9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:08.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.075+0000 7f3612ffd640 1 --2- 172.21.15.7:0/2531070969 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55d553dfda50 0x55d553df9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.075+0000 7f3612ffd640 1 -- 172.21.15.7:0/2531070969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d553e03aa0 msgr2=0x55d553e1de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:08.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.075+0000 7f3612ffd640 1 --2- 172.21.15.7:0/2531070969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d553e03aa0 0x55d553e1de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.075+0000 7f3612ffd640 1 -- 172.21.15.7:0/2531070969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d553e6d4e0 con 0x55d553e03080 2024-04-25T09:59:08.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.075+0000 7f3612ffd640 1 --2- 172.21.15.7:0/2531070969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d553e03080 0x55d553e1d8d0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f360400b3c0 tx=0x7f3604017400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d6154324c7305c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:08.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.075+0000 7f35f27fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:59:08.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.075+0000 7f35f27fc640 1 -- 172.21.15.7:0/2531070969 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3604056b60 con 0x55d553e03080 2024-04-25T09:59:08.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.075+0000 7f35f27fc640 1 -- 172.21.15.7:0/2531070969 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f3604054ed0 con 0x55d553e03080 2024-04-25T09:59:08.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.075+0000 7f361c9b5740 1 -- 172.21.15.7:0/2531070969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f360804e160 con 0x55d553e03080 2024-04-25T09:59:08.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.075+0000 7f35f27fc640 1 -- 172.21.15.7:0/2531070969 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3604088300 con 0x55d553e03080 2024-04-25T09:59:08.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.075+0000 7f361c9b5740 10 client.7179 fetch_fsmap learned FSMap version 44 2024-04-25T09:59:08.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.075+0000 7f361c9b5740 1 -- 172.21.15.7:0/2531070969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x55d553e6e280 con 0x55d553e03080 2024-04-25T09:59:08.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.075+0000 7f35f27fc640 1 -- 172.21.15.7:0/2531070969 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360804e160 con 0x55d553e03080 2024-04-25T09:59:08.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.076+0000 7f35f27fc640 1 -- 172.21.15.7:0/2531070969 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 44) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f36040701f0 con 0x55d553e03080 2024-04-25T09:59:08.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.076+0000 7f361c9b5740 10 client.7179 fetch_fsmap finished waiting for FSMap version 44 2024-04-25T09:59:08.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.076+0000 7f361c9b5740 10 client.7179 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T09:59:08.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.076+0000 7f361c9b5740 20 client.7179 populate_metadata read hostname 'smithi007' 2024-04-25T09:59:08.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.076+0000 7f361c9b5740 1 --2- 172.21.15.7:0/2531070969 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x55d553e01980 0x55d553e88320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.076+0000 7f361c9b5740 4 client.7179 mds_command: new command op to 6813 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/subdir", "scrubops": ["recursive"]}] 2024-04-25T09:59:08.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.076+0000 7f361c9b5740 1 -- 172.21.15.7:0/2531070969 --> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] -- command(tid 0: {"prefix": "scrub start", "path": "/subdir", "scrubops": ["recursive"]}) v1 -- 0x55d553d43930 con 0x55d553e01980 2024-04-25T09:59:08.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.076+0000 7f36137fe640 1 --2- 172.21.15.7:0/2531070969 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x55d553e01980 0x55d553e88320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.076+0000 7f35f27fc640 10 client.7179 ms_handle_connect on v2:172.21.15.7:6836/3690076929 2024-04-25T09:59:08.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.076+0000 7f36137fe640 1 --2- 172.21.15.7:0/2531070969 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x55d553e01980 0x55d553e88320 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7986fdceb4e80fbd server_cookie=b297efd4dfa816f4 in_seq=0 out_seq=0 2024-04-25T09:59:08.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.077+0000 7f35f27fc640 1 -- 172.21.15.7:0/2531070969 <== mds.0 v2:172.21.15.7:6836/3690076929 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55d553d43930 con 0x55d553e01980 2024-04-25T09:59:08.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.077+0000 7f35f27fc640 10 client.7179 handle_command_reply: tid=0 2024-04-25T09:59:08.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.077+0000 7f361c9b5740 1 client.7179 shutdown 2024-04-25T09:59:08.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.077+0000 7f361c9b5740 1 -- 172.21.15.7:0/2531070969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d553e03080 msgr2=0x55d553e1d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:08.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.077+0000 7f361c9b5740 1 --2- 172.21.15.7:0/2531070969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d553e03080 0x55d553e1d8d0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f360400b3c0 tx=0x7f3604017400 comp rx=0 tx=0).stop 2024-04-25T09:59:08.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.077+0000 7f361c9b5740 1 -- 172.21.15.7:0/2531070969 shutdown_connections 2024-04-25T09:59:08.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.077+0000 7f361c9b5740 1 --2- 172.21.15.7:0/2531070969 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x55d553e01980 0x55d553e88320 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.077+0000 7f361c9b5740 1 --2- 172.21.15.7:0/2531070969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d553e03aa0 0x55d553e1de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.077+0000 7f361c9b5740 1 --2- 172.21.15.7:0/2531070969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d553e03080 0x55d553e1d8d0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.077+0000 7f35f27fc640 0 client.7179 ms_handle_reset on v2:172.21.15.7:6836/3690076929 2024-04-25T09:59:08.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.077+0000 7f361c9b5740 1 --2- 172.21.15.7:0/2531070969 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55d553dfda50 0x55d553df9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.077+0000 7f361c9b5740 1 -- 172.21.15.7:0/2531070969 >> 172.21.15.7:0/2531070969 conn(0x55d553dd3740 msgr2=0x55d553dfb090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:08.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.077+0000 7f361c9b5740 1 -- 172.21.15.7:0/2531070969 shutdown_connections 2024-04-25T09:59:08.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.077+0000 7f361c9b5740 1 -- 172.21.15.7:0/2531070969 wait complete. 2024-04-25T09:59:08.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.077+0000 7f361c9b5740 20 client.7179 trim_cache size 0 max 16384 2024-04-25T09:59:08.087 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T09:59:08.087 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-04-25T09:59:08.087 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "806d52c5-7f2d-4932-b395-a8ea62198dfa", 2024-04-25T09:59:08.087 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-04-25T09:59:08.088 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T09:59:08.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.078+0000 7f3619cb3640 1 -- 172.21.15.7:0/2075281519 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f360006b4d0 msgr2=0x7f360006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:08.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.078+0000 7f3619cb3640 1 --2- 172.21.15.7:0/2075281519 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f360006b4d0 0x7f360006d990 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3608034000 tx=0x7f360802e000 comp rx=0 tx=0).stop 2024-04-25T09:59:08.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.078+0000 7f3619cb3640 1 -- 172.21.15.7:0/2075281519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f361415dba0 msgr2=0x7f361414cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:08.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.078+0000 7f3619cb3640 1 --2- 172.21.15.7:0/2075281519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f361415dba0 0x7f361414cea0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f360400b3f0 tx=0x7f360400b8b0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.078+0000 7f3619cb3640 1 -- 172.21.15.7:0/2075281519 shutdown_connections 2024-04-25T09:59:08.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.078+0000 7f3619cb3640 1 --2- 172.21.15.7:0/2075281519 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f360006b4d0 0x7f360006d990 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.078+0000 7f3619cb3640 1 --2- 172.21.15.7:0/2075281519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f361415df80 0x7f36141f76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.078+0000 7f3619cb3640 1 --2- 172.21.15.7:0/2075281519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f361415dba0 0x7f361414cea0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.078+0000 7f3619cb3640 1 --2- 172.21.15.7:0/2075281519 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36140b6a40 0x7f36140cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.078+0000 7f3619cb3640 1 -- 172.21.15.7:0/2075281519 >> 172.21.15.7:0/2075281519 conn(0x7f361406c530 msgr2=0x7f36141609d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:08.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.078+0000 7f3619cb3640 1 -- 172.21.15.7:0/2075281519 shutdown_connections 2024-04-25T09:59:08.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.078+0000 7f3619cb3640 1 -- 172.21.15.7:0/2075281519 wait complete. 2024-04-25T09:59:08.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:59:08.093 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-25T09:59:08.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.192+0000 7fd7ab207640 1 Processor -- start 2024-04-25T09:59:08.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.192+0000 7fd7ab207640 1 -- start start 2024-04-25T09:59:08.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.193+0000 7fd7ab207640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd7a4143fb0 0x7fd7a40b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.193+0000 7fd7ab207640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd7a406e240 0x7fd7a406e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.193+0000 7fd7ab207640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a40b2ee0 con 0x7fd7a40ce610 2024-04-25T09:59:08.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.193+0000 7fd7ab207640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7a406ebe0 con 0x7fd7a406e240 2024-04-25T09:59:08.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.193+0000 7fd7ab207640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a40b3150 con 0x7fd7a4143fb0 2024-04-25T09:59:08.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.193+0000 7fd7a3fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd7a406e240 0x7fd7a406e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.193+0000 7fd7a97a4640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd7a40ce610 0x7fd7a40cea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33722/0 (socket says 172.21.15.7:33722) 2024-04-25T09:59:08.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.193+0000 7fd7a97a4640 1 -- 172.21.15.7:0/2983968866 learned_addr learned my addr 172.21.15.7:0/2983968866 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:59:08.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.193+0000 7fd7a8fa3640 1 --2- 172.21.15.7:0/2983968866 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd7a4143fb0 0x7fd7a40b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.193+0000 7fd7a3fff640 1 -- 172.21.15.7:0/2983968866 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd7a4143fb0 msgr2=0x7fd7a40b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:08.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.193+0000 7fd7a3fff640 1 --2- 172.21.15.7:0/2983968866 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd7a4143fb0 0x7fd7a40b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.193+0000 7fd7a3fff640 1 -- 172.21.15.7:0/2983968866 >> v1:172.21.15.7:6789/0 conn(0x7fd7a40ce610 legacy=0x7fd7a40cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:08.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.193+0000 7fd7a3fff640 1 -- 172.21.15.7:0/2983968866 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a40b3430 con 0x7fd7a406e240 2024-04-25T09:59:08.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.193+0000 7fd7a8fa3640 1 --2- 172.21.15.7:0/2983968866 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd7a4143fb0 0x7fd7a40b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:59:08.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.193+0000 7fd7a37fe640 1 -- 172.21.15.7:0/2983968866 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3175802892 0 0) 0x7fd7a40b2ee0 con 0x7fd7a40ce610 2024-04-25T09:59:08.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.194+0000 7fd7a3fff640 1 --2- 172.21.15.7:0/2983968866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7a406e240 0x7fd7a406e6a0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fd7900097a0 tx=0x7fd79002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7729843db0adb666 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:08.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.194+0000 7fd7a37fe640 1 -- 172.21.15.7:0/2983968866 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd790037070 con 0x7fd7a406e240 2024-04-25T09:59:08.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.194+0000 7fd7a37fe640 1 -- 172.21.15.7:0/2983968866 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd790032440 con 0x7fd7a406e240 2024-04-25T09:59:08.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.194+0000 7fd7a37fe640 1 -- 172.21.15.7:0/2983968866 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd790032810 con 0x7fd7a406e240 2024-04-25T09:59:08.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.194+0000 7fd7ab207640 1 -- 172.21.15.7:0/2983968866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7a406e240 msgr2=0x7fd7a406e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:08.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.194+0000 7fd7ab207640 1 --2- 172.21.15.7:0/2983968866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7a406e240 0x7fd7a406e6a0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fd7900097a0 tx=0x7fd79002a180 comp rx=0 tx=0).stop 2024-04-25T09:59:08.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.195+0000 7fd7ab207640 1 -- 172.21.15.7:0/2983968866 shutdown_connections 2024-04-25T09:59:08.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.195+0000 7fd7ab207640 1 --2- 172.21.15.7:0/2983968866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7a406e240 0x7fd7a406e6a0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.195+0000 7fd7ab207640 1 --2- 172.21.15.7:0/2983968866 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd7a4143fb0 0x7fd7a40b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.195+0000 7fd7ab207640 1 -- 172.21.15.7:0/2983968866 >> 172.21.15.7:0/2983968866 conn(0x7fd7a406ab60 msgr2=0x7fd7a406af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:08.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.195+0000 7fd7ab207640 1 -- 172.21.15.7:0/2983968866 shutdown_connections 2024-04-25T09:59:08.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.195+0000 7fd7ab207640 1 -- 172.21.15.7:0/2983968866 wait complete. 2024-04-25T09:59:08.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.196+0000 7fd7ab207640 1 Processor -- start 2024-04-25T09:59:08.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.196+0000 7fd7ab207640 1 -- start start 2024-04-25T09:59:08.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.197+0000 7fd7ab207640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd7a406e240 0x7fd7a413d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.197+0000 7fd7ab207640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7a40ce610 0x7fd7a413b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.197+0000 7fd7ab207640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7a4143fb0 0x7fd7a41e7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.197+0000 7fd7ab207640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a40cf2f0 con 0x7fd7a40ce610 2024-04-25T09:59:08.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.197+0000 7fd7ab207640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a4144390 con 0x7fd7a4143fb0 2024-04-25T09:59:08.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.197+0000 7fd7ab207640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a415ac70 con 0x7fd7a406e240 2024-04-25T09:59:08.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.197+0000 7fd7a3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7a40ce610 0x7fd7a413b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.197+0000 7fd7a3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7a40ce610 0x7fd7a413b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33992/0 (socket says 172.21.15.7:33992) 2024-04-25T09:59:08.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.197+0000 7fd7a3fff640 1 -- 172.21.15.7:0/4037797542 learned_addr learned my addr 172.21.15.7:0/4037797542 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:08.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.197+0000 7fd7a8fa3640 1 --2- 172.21.15.7:0/4037797542 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd7a406e240 0x7fd7a413d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.197+0000 7fd7a97a4640 1 --2- 172.21.15.7:0/4037797542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7a4143fb0 0x7fd7a41e7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.197+0000 7fd7a3fff640 1 -- 172.21.15.7:0/4037797542 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd7a406e240 msgr2=0x7fd7a413d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:08.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.197+0000 7fd7a3fff640 1 --2- 172.21.15.7:0/4037797542 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd7a406e240 0x7fd7a413d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.197+0000 7fd7a3fff640 1 -- 172.21.15.7:0/4037797542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7a4143fb0 msgr2=0x7fd7a41e7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:08.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.197+0000 7fd7a3fff640 1 --2- 172.21.15.7:0/4037797542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7a4143fb0 0x7fd7a41e7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.197+0000 7fd7a3fff640 1 -- 172.21.15.7:0/4037797542 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a415b750 con 0x7fd7a40ce610 2024-04-25T09:59:08.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.197+0000 7fd7a3fff640 1 --2- 172.21.15.7:0/4037797542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7a40ce610 0x7fd7a413b640 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fd7900098c0 tx=0x7fd7900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:08.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.198+0000 7fd7a17fa640 1 -- 172.21.15.7:0/4037797542 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd790037040 con 0x7fd7a40ce610 2024-04-25T09:59:08.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.198+0000 7fd7a17fa640 1 -- 172.21.15.7:0/4037797542 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd790030770 con 0x7fd7a40ce610 2024-04-25T09:59:08.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.198+0000 7fd7ab207640 1 -- 172.21.15.7:0/4037797542 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a413bb80 con 0x7fd7a40ce610 2024-04-25T09:59:08.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.198+0000 7fd7a17fa640 1 -- 172.21.15.7:0/4037797542 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd790030b40 con 0x7fd7a40ce610 2024-04-25T09:59:08.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.198+0000 7fd7ab207640 1 -- 172.21.15.7:0/4037797542 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a415bca0 con 0x7fd7a40ce610 2024-04-25T09:59:08.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.199+0000 7fd7a17fa640 1 -- 172.21.15.7:0/4037797542 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd790044020 con 0x7fd7a40ce610 2024-04-25T09:59:08.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.199+0000 7fd7a17fa640 1 --2- 172.21.15.7:0/4037797542 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd78806b4d0 0x7fd78806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.199+0000 7fd7a17fa640 1 -- 172.21.15.7:0/4037797542 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fd7900aa950 con 0x7fd7a40ce610 2024-04-25T09:59:08.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.200+0000 7fd7a8fa3640 1 --2- 172.21.15.7:0/4037797542 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd78806b4d0 0x7fd78806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.200+0000 7fd7a8fa3640 1 --2- 172.21.15.7:0/4037797542 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd78806b4d0 0x7fd78806d990 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd798006fd0 tx=0x7fd798008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:08.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.200+0000 7fd7adfe2740 1 Processor -- start 2024-04-25T09:59:08.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.200+0000 7fd7adfe2740 1 -- start start 2024-04-25T09:59:08.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.201+0000 7fd7adfe2740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b843caab10 0x55b843cad320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.201+0000 7fd7adfe2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b843caaef0 0x55b843cad860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.201+0000 7fd7adfe2740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b843c7d770 0x55b843c80f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.201+0000 7fd7adfe2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b843be6da0 con 0x55b843caaef0 2024-04-25T09:59:08.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.201+0000 7fd7adfe2740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b843b8fb80 con 0x55b843caab10 2024-04-25T09:59:08.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.201+0000 7fd7adfe2740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b843be2e40 con 0x55b843c7d770 2024-04-25T09:59:08.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.201+0000 7fd7a3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b843caaef0 0x55b843cad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.201+0000 7fd7a3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b843caaef0 0x55b843cad860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33994/0 (socket says 172.21.15.7:33994) 2024-04-25T09:59:08.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.201+0000 7fd7a3fff640 1 -- 172.21.15.7:0/1836690287 learned_addr learned my addr 172.21.15.7:0/1836690287 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:08.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.201+0000 7fd7a8fa3640 1 --2- 172.21.15.7:0/1836690287 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b843caab10 0x55b843cad320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.201+0000 7fd7a97a4640 1 --2- 172.21.15.7:0/1836690287 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b843c7d770 0x55b843c80f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.202+0000 7fd7a3fff640 1 -- 172.21.15.7:0/1836690287 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b843c7d770 msgr2=0x55b843c80f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:08.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.202+0000 7fd7a3fff640 1 --2- 172.21.15.7:0/1836690287 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b843c7d770 0x55b843c80f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.202+0000 7fd7a3fff640 1 -- 172.21.15.7:0/1836690287 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b843caab10 msgr2=0x55b843cad320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:08.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.202+0000 7fd7a3fff640 1 --2- 172.21.15.7:0/1836690287 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b843caab10 0x55b843cad320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.202+0000 7fd7a3fff640 1 -- 172.21.15.7:0/1836690287 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b843b99f10 con 0x55b843caaef0 2024-04-25T09:59:08.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.202+0000 7fd7a8fa3640 1 --2- 172.21.15.7:0/1836690287 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b843caab10 0x55b843cad320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:59:08.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.202+0000 7fd7a3fff640 1 --2- 172.21.15.7:0/1836690287 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b843caaef0 0x55b843cad860 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fd790035040 tx=0x7fd790078af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aeac01a482b2f8d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:08.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.202+0000 7fd78e7fc640 1 -- 172.21.15.7:0/1836690287 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79007d040 con 0x55b843caaef0 2024-04-25T09:59:08.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.202+0000 7fd78e7fc640 1 -- 172.21.15.7:0/1836690287 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd790081600 con 0x55b843caaef0 2024-04-25T09:59:08.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.202+0000 7fd78e7fc640 1 -- 172.21.15.7:0/1836690287 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79003adc0 con 0x55b843caaef0 2024-04-25T09:59:08.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.202+0000 7fd7adfe2740 1 -- 172.21.15.7:0/1836690287 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b843caaef0 msgr2=0x55b843cad860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:08.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.202+0000 7fd7adfe2740 1 --2- 172.21.15.7:0/1836690287 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b843caaef0 0x55b843cad860 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fd790035040 tx=0x7fd790078af0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.202+0000 7fd7adfe2740 1 -- 172.21.15.7:0/1836690287 shutdown_connections 2024-04-25T09:59:08.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.202+0000 7fd7adfe2740 1 --2- 172.21.15.7:0/1836690287 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b843c7d770 0x55b843c80f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.202+0000 7fd7adfe2740 1 --2- 172.21.15.7:0/1836690287 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b843caaef0 0x55b843cad860 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.202+0000 7fd7adfe2740 1 --2- 172.21.15.7:0/1836690287 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b843caab10 0x55b843cad320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.202+0000 7fd7adfe2740 1 -- 172.21.15.7:0/1836690287 >> 172.21.15.7:0/1836690287 conn(0x55b843c7f9e0 msgr2=0x55b843cc8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:08.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.203+0000 7fd7adfe2740 1 -- 172.21.15.7:0/1836690287 shutdown_connections 2024-04-25T09:59:08.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.203+0000 7fd7adfe2740 1 -- 172.21.15.7:0/1836690287 wait complete. 2024-04-25T09:59:08.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.203+0000 7fd7adfe2740 1 -- start start 2024-04-25T09:59:08.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.203+0000 7fd7adfe2740 1 Processor -- start 2024-04-25T09:59:08.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.204+0000 7fd7adfe2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b843caab10 0x55b843ca1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.204+0000 7fd7adfe2740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b843caaef0 0x55b843cc9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.204+0000 7fd7adfe2740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b843cc3b00 0x55b843cc3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.204+0000 7fd7adfe2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b843c82b90 con 0x55b843caab10 2024-04-25T09:59:08.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.204+0000 7fd7adfe2740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b843b854b0 con 0x55b843caaef0 2024-04-25T09:59:08.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.204+0000 7fd7adfe2740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b843c82e70 con 0x55b843cc3b00 2024-04-25T09:59:08.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.204+0000 7fd7adfe2740 10 client.0 _ll_register_callbacks cb 0x55b843bc5180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:59:08.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.204+0000 7fd7a8fa3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b843caab10 0x55b843ca1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.204+0000 7fd7a8fa3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b843caab10 0x55b843ca1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34006/0 (socket says 172.21.15.7:34006) 2024-04-25T09:59:08.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.204+0000 7fd7a8fa3640 1 -- 172.21.15.7:0/1127578878 learned_addr learned my addr 172.21.15.7:0/1127578878 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:08.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.204+0000 7fd7a3fff640 1 --2- 172.21.15.7:0/1127578878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b843caaef0 0x55b843cc9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.204+0000 7fd7a97a4640 1 --2- 172.21.15.7:0/1127578878 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b843cc3b00 0x55b843cc3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.204+0000 7fd7a8fa3640 1 -- 172.21.15.7:0/1127578878 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b843cc3b00 msgr2=0x55b843cc3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:08.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.204+0000 7fd7a8fa3640 1 --2- 172.21.15.7:0/1127578878 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b843cc3b00 0x55b843cc3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.204+0000 7fd7a8fa3640 1 -- 172.21.15.7:0/1127578878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b843caaef0 msgr2=0x55b843cc9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:08.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.204+0000 7fd7a8fa3640 1 --2- 172.21.15.7:0/1127578878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b843caaef0 0x55b843cc9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.204+0000 7fd7a8fa3640 1 -- 172.21.15.7:0/1127578878 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b8439c57d0 con 0x55b843caab10 2024-04-25T09:59:08.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.205+0000 7fd7a8fa3640 1 --2- 172.21.15.7:0/1127578878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b843caab10 0x55b843ca1970 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fd798014590 tx=0x7fd798004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e011a339cee0a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:08.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.205+0000 7fd7837fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:59:08.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.205+0000 7fd7837fe640 1 -- 172.21.15.7:0/1127578878 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd798025020 con 0x55b843caab10 2024-04-25T09:59:08.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.205+0000 7fd7837fe640 1 -- 172.21.15.7:0/1127578878 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fd7980158e0 con 0x55b843caab10 2024-04-25T09:59:08.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.205+0000 7fd7adfe2740 1 -- 172.21.15.7:0/1127578878 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd790081600 con 0x55b843caab10 2024-04-25T09:59:08.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.205+0000 7fd7837fe640 1 -- 172.21.15.7:0/1127578878 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd79802f050 con 0x55b843caab10 2024-04-25T09:59:08.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.205+0000 7fd7adfe2740 10 client.7194 fetch_fsmap learned FSMap version 44 2024-04-25T09:59:08.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.205+0000 7fd7adfe2740 1 -- 172.21.15.7:0/1127578878 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x55b8438fb3f0 con 0x55b843caab10 2024-04-25T09:59:08.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.205+0000 7fd7837fe640 1 -- 172.21.15.7:0/1127578878 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd790081600 con 0x55b843caab10 2024-04-25T09:59:08.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.205+0000 7fd7837fe640 1 -- 172.21.15.7:0/1127578878 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 44) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd798032020 con 0x55b843caab10 2024-04-25T09:59:08.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.205+0000 7fd7adfe2740 10 client.7194 fetch_fsmap finished waiting for FSMap version 44 2024-04-25T09:59:08.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.205+0000 7fd7adfe2740 10 client.7194 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T09:59:08.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.205+0000 7fd7adfe2740 20 client.7194 populate_metadata read hostname 'smithi007' 2024-04-25T09:59:08.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.205+0000 7fd7adfe2740 1 --2- 172.21.15.7:0/1127578878 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x55b843caf540 0x55b843caf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.205+0000 7fd7adfe2740 4 client.7194 mds_command: new command op to 6813 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:59:08.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.205+0000 7fd7adfe2740 1 -- 172.21.15.7:0/1127578878 --> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b843bf42e0 con 0x55b843caf540 2024-04-25T09:59:08.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.206+0000 7fd7a3fff640 1 --2- 172.21.15.7:0/1127578878 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x55b843caf540 0x55b843caf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.206+0000 7fd7a3fff640 1 --2- 172.21.15.7:0/1127578878 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x55b843caf540 0x55b843caf970 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b75d72a7d2b1e5d7 server_cookie=c4e09d8d59900c31 in_seq=0 out_seq=0 2024-04-25T09:59:08.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.206+0000 7fd7837fe640 10 client.7194 ms_handle_connect on v2:172.21.15.7:6836/3690076929 2024-04-25T09:59:08.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.206+0000 7fd7837fe640 1 -- 172.21.15.7:0/1127578878 <== mds.0 v2:172.21.15.7:6836/3690076929 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b843bf42e0 con 0x55b843caf540 2024-04-25T09:59:08.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.206+0000 7fd7837fe640 10 client.7194 handle_command_reply: tid=0 2024-04-25T09:59:08.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.206+0000 7fd7adfe2740 1 client.7194 shutdown 2024-04-25T09:59:08.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.206+0000 7fd7adfe2740 1 -- 172.21.15.7:0/1127578878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b843caab10 msgr2=0x55b843ca1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:08.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.206+0000 7fd7adfe2740 1 --2- 172.21.15.7:0/1127578878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b843caab10 0x55b843ca1970 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fd798014590 tx=0x7fd798004730 comp rx=0 tx=0).stop 2024-04-25T09:59:08.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.206+0000 7fd7adfe2740 1 -- 172.21.15.7:0/1127578878 shutdown_connections 2024-04-25T09:59:08.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.206+0000 7fd7adfe2740 1 --2- 172.21.15.7:0/1127578878 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b843cc3b00 0x55b843cc3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.206+0000 7fd7adfe2740 1 --2- 172.21.15.7:0/1127578878 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x55b843caf540 0x55b843caf970 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.207+0000 7fd7adfe2740 1 --2- 172.21.15.7:0/1127578878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b843caaef0 0x55b843cc9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.207+0000 7fd7adfe2740 1 --2- 172.21.15.7:0/1127578878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b843caab10 0x55b843ca1970 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.207+0000 7fd7adfe2740 1 -- 172.21.15.7:0/1127578878 >> 172.21.15.7:0/1127578878 conn(0x55b843c7d770 msgr2=0x55b843ca9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:08.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.207+0000 7fd7837fe640 0 client.7194 ms_handle_reset on v2:172.21.15.7:6836/3690076929 2024-04-25T09:59:08.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.207+0000 7fd7adfe2740 1 -- 172.21.15.7:0/1127578878 shutdown_connections 2024-04-25T09:59:08.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.207+0000 7fd7adfe2740 1 -- 172.21.15.7:0/1127578878 wait complete. 2024-04-25T09:59:08.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.207+0000 7fd7adfe2740 20 client.7194 trim_cache size 0 max 16384 2024-04-25T09:59:08.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.222+0000 7fd7adfe2740 1 Processor -- start 2024-04-25T09:59:08.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.222+0000 7fd7adfe2740 1 -- start start 2024-04-25T09:59:08.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.223+0000 7fd7adfe2740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b843caab10 0x55b843cb0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.223+0000 7fd7adfe2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b843caaef0 0x55b843cb13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.223+0000 7fd7adfe2740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b843cc3b00 0x55b843c81f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.223+0000 7fd7adfe2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a42003d0 con 0x55b843caaef0 2024-04-25T09:59:08.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.223+0000 7fd7adfe2740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a41ff5d0 con 0x55b843caab10 2024-04-25T09:59:08.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.223+0000 7fd7adfe2740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a415ce60 con 0x55b843cc3b00 2024-04-25T09:59:08.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.223+0000 7fd7a3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b843caaef0 0x55b843cb13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.223+0000 7fd7a3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b843caaef0 0x55b843cb13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34018/0 (socket says 172.21.15.7:34018) 2024-04-25T09:59:08.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.223+0000 7fd7a3fff640 1 -- 172.21.15.7:0/3411567422 learned_addr learned my addr 172.21.15.7:0/3411567422 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:08.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.223+0000 7fd7a3fff640 1 -- 172.21.15.7:0/3411567422 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b843cc3b00 msgr2=0x55b843c81f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:08.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.223+0000 7fd7a3fff640 1 --2- 172.21.15.7:0/3411567422 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b843cc3b00 0x55b843c81f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.223+0000 7fd7a3fff640 1 -- 172.21.15.7:0/3411567422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b843caab10 msgr2=0x55b843cb0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:08.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.223+0000 7fd7a3fff640 1 --2- 172.21.15.7:0/3411567422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b843caab10 0x55b843cb0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.223+0000 7fd7a3fff640 1 -- 172.21.15.7:0/3411567422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8438bb0f0 con 0x55b843caaef0 2024-04-25T09:59:08.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.223+0000 7fd7a3fff640 1 --2- 172.21.15.7:0/3411567422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b843caaef0 0x55b843cb13e0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fd79002a1c0 tx=0x7fd79007b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9016b72f4650a193 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:08.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.223+0000 7fd78dffb640 1 -- 172.21.15.7:0/3411567422 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd790081600 con 0x55b843caaef0 2024-04-25T09:59:08.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.223+0000 7fd78dffb640 1 -- 172.21.15.7:0/3411567422 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd790095070 con 0x55b843caaef0 2024-04-25T09:59:08.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.223+0000 7fd78dffb640 1 -- 172.21.15.7:0/3411567422 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79003adc0 con 0x55b843caaef0 2024-04-25T09:59:08.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.224+0000 7fd7adfe2740 1 -- 172.21.15.7:0/3411567422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b843caaef0 msgr2=0x55b843cb13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:08.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.224+0000 7fd7adfe2740 1 --2- 172.21.15.7:0/3411567422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b843caaef0 0x55b843cb13e0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fd79002a1c0 tx=0x7fd79007b000 comp rx=0 tx=0).stop 2024-04-25T09:59:08.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.224+0000 7fd7adfe2740 1 -- 172.21.15.7:0/3411567422 shutdown_connections 2024-04-25T09:59:08.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.224+0000 7fd7adfe2740 1 --2- 172.21.15.7:0/3411567422 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b843cc3b00 0x55b843c81f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.224+0000 7fd7adfe2740 1 --2- 172.21.15.7:0/3411567422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b843caaef0 0x55b843cb13e0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.224+0000 7fd7adfe2740 1 --2- 172.21.15.7:0/3411567422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b843caab10 0x55b843cb0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.224+0000 7fd7adfe2740 1 -- 172.21.15.7:0/3411567422 >> 172.21.15.7:0/3411567422 conn(0x55b843c7d770 msgr2=0x55b843cad2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:08.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.224+0000 7fd7adfe2740 1 -- 172.21.15.7:0/3411567422 shutdown_connections 2024-04-25T09:59:08.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.224+0000 7fd7adfe2740 1 -- 172.21.15.7:0/3411567422 wait complete. 2024-04-25T09:59:08.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.224+0000 7fd7adfe2740 1 -- start start 2024-04-25T09:59:08.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.225+0000 7fd7adfe2740 1 Processor -- start 2024-04-25T09:59:08.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.225+0000 7fd7adfe2740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b843caab10 0x55b843ca8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.225+0000 7fd7adfe2740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b843caaef0 0x55b843ccdb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.225+0000 7fd7adfe2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b843cc3b00 0x55b843cc1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.225+0000 7fd7adfe2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b843c78b80 con 0x55b843cc3b00 2024-04-25T09:59:08.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.225+0000 7fd7adfe2740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a41fefd0 con 0x55b843caab10 2024-04-25T09:59:08.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.225+0000 7fd7adfe2740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b843b87010 con 0x55b843caaef0 2024-04-25T09:59:08.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.225+0000 7fd7adfe2740 10 client.0 _ll_register_callbacks cb 0x7fd790009400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:59:08.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.225+0000 7fd7a97a4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b843cc3b00 0x55b843cc1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.225+0000 7fd7a97a4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b843cc3b00 0x55b843cc1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34026/0 (socket says 172.21.15.7:34026) 2024-04-25T09:59:08.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.225+0000 7fd7a97a4640 1 -- 172.21.15.7:0/1720460044 learned_addr learned my addr 172.21.15.7:0/1720460044 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:08.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.226+0000 7fd7a8fa3640 1 --2- 172.21.15.7:0/1720460044 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b843caab10 0x55b843ca8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.226+0000 7fd7a3fff640 1 --2- 172.21.15.7:0/1720460044 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b843caaef0 0x55b843ccdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.226+0000 7fd7a97a4640 1 -- 172.21.15.7:0/1720460044 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b843caaef0 msgr2=0x55b843ccdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:08.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.226+0000 7fd7a97a4640 1 --2- 172.21.15.7:0/1720460044 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b843caaef0 0x55b843ccdb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.226+0000 7fd7a97a4640 1 -- 172.21.15.7:0/1720460044 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b843caab10 msgr2=0x55b843ca8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:08.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.226+0000 7fd7a97a4640 1 --2- 172.21.15.7:0/1720460044 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b843caab10 0x55b843ca8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.226+0000 7fd7a97a4640 1 -- 172.21.15.7:0/1720460044 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b843ca9fa0 con 0x55b843cc3b00 2024-04-25T09:59:08.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.226+0000 7fd7a8fa3640 1 --2- 172.21.15.7:0/1720460044 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b843caab10 0x55b843ca8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:59:08.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.226+0000 7fd7a97a4640 1 --2- 172.21.15.7:0/1720460044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b843cc3b00 0x55b843cc1b40 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fd79c005fd0 tx=0x7fd79c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef5e489670a337f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:08.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.226+0000 7fd7837fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:59:08.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.226+0000 7fd7837fe640 1 -- 172.21.15.7:0/1720460044 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79c0155c0 con 0x55b843cc3b00 2024-04-25T09:59:08.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.226+0000 7fd7837fe640 1 -- 172.21.15.7:0/1720460044 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fd79c015760 con 0x55b843cc3b00 2024-04-25T09:59:08.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.226+0000 7fd7adfe2740 1 -- 172.21.15.7:0/1720460044 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd790095070 con 0x55b843cc3b00 2024-04-25T09:59:08.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.226+0000 7fd7837fe640 1 -- 172.21.15.7:0/1720460044 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd79c023050 con 0x55b843cc3b00 2024-04-25T09:59:08.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.226+0000 7fd7adfe2740 10 client.7200 fetch_fsmap learned FSMap version 44 2024-04-25T09:59:08.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.226+0000 7fd7adfe2740 1 -- 172.21.15.7:0/1720460044 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x55b843cce490 con 0x55b843cc3b00 2024-04-25T09:59:08.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.226+0000 7fd7837fe640 1 -- 172.21.15.7:0/1720460044 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd790095070 con 0x55b843cc3b00 2024-04-25T09:59:08.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.226+0000 7fd7837fe640 1 -- 172.21.15.7:0/1720460044 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 44) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd79c026020 con 0x55b843cc3b00 2024-04-25T09:59:08.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.226+0000 7fd7adfe2740 10 client.7200 fetch_fsmap finished waiting for FSMap version 44 2024-04-25T09:59:08.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.226+0000 7fd7adfe2740 10 client.7200 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T09:59:08.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.226+0000 7fd7adfe2740 20 client.7200 populate_metadata read hostname 'smithi007' 2024-04-25T09:59:08.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.226+0000 7fd7adfe2740 1 --2- 172.21.15.7:0/1720460044 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x55b843d32520 0x55b843cb0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:08.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.227+0000 7fd7adfe2740 4 client.7200 mds_command: new command op to 6813 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:59:08.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.227+0000 7fd7adfe2740 1 -- 172.21.15.7:0/1720460044 --> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b843bee630 con 0x55b843d32520 2024-04-25T09:59:08.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.227+0000 7fd7a8fa3640 1 --2- 172.21.15.7:0/1720460044 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x55b843d32520 0x55b843cb0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:08.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.227+0000 7fd7837fe640 10 client.7200 ms_handle_connect on v2:172.21.15.7:6836/3690076929 2024-04-25T09:59:08.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.227+0000 7fd7a8fa3640 1 --2- 172.21.15.7:0/1720460044 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x55b843d32520 0x55b843cb0ea0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a951e707db0c820 server_cookie=c464a1e743f35bb6 in_seq=0 out_seq=0 2024-04-25T09:59:08.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.227+0000 7fd7837fe640 1 -- 172.21.15.7:0/1720460044 <== mds.0 v2:172.21.15.7:6836/3690076929 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55b843bee630 con 0x55b843d32520 2024-04-25T09:59:08.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.227+0000 7fd7837fe640 10 client.7200 handle_command_reply: tid=0 2024-04-25T09:59:08.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.227+0000 7fd7adfe2740 1 client.7200 shutdown 2024-04-25T09:59:08.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.227+0000 7fd7adfe2740 1 -- 172.21.15.7:0/1720460044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b843cc3b00 msgr2=0x55b843cc1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:08.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.227+0000 7fd7adfe2740 1 --2- 172.21.15.7:0/1720460044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b843cc3b00 0x55b843cc1b40 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fd79c005fd0 tx=0x7fd79c001a00 comp rx=0 tx=0).stop 2024-04-25T09:59:08.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.227+0000 7fd7adfe2740 1 -- 172.21.15.7:0/1720460044 shutdown_connections 2024-04-25T09:59:08.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.227+0000 7fd7adfe2740 1 --2- 172.21.15.7:0/1720460044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b843cc3b00 0x55b843cc1b40 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.227+0000 7fd7adfe2740 1 --2- 172.21.15.7:0/1720460044 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b843caaef0 0x55b843ccdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.227+0000 7fd7adfe2740 1 --2- 172.21.15.7:0/1720460044 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x55b843d32520 0x55b843cb0ea0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.227+0000 7fd7adfe2740 1 --2- 172.21.15.7:0/1720460044 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b843caab10 0x55b843ca8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.227+0000 7fd7837fe640 0 client.7200 ms_handle_reset on v2:172.21.15.7:6836/3690076929 2024-04-25T09:59:08.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.227+0000 7fd7adfe2740 1 -- 172.21.15.7:0/1720460044 >> 172.21.15.7:0/1720460044 conn(0x55b843c7d770 msgr2=0x55b843c7c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:08.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.227+0000 7fd7adfe2740 1 -- 172.21.15.7:0/1720460044 shutdown_connections 2024-04-25T09:59:08.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.227+0000 7fd7adfe2740 1 -- 172.21.15.7:0/1720460044 wait complete. 2024-04-25T09:59:08.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.228+0000 7fd7adfe2740 20 client.7200 trim_cache size 0 max 16384 2024-04-25T09:59:08.238 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T09:59:08.238 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:59:08.238 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-04-25T09:59:08.238 INFO:teuthology.orchestra.run.smithi007.stdout: "806d52c5-7f2d-4932-b395-a8ea62198dfa": { 2024-04-25T09:59:08.238 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/subdir", 2024-04-25T09:59:08.238 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "806d52c5-7f2d-4932-b395-a8ea62198dfa", 2024-04-25T09:59:08.238 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive" 2024-04-25T09:59:08.239 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:59:08.239 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:59:08.239 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T09:59:08.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.228+0000 7fd7ab207640 1 -- 172.21.15.7:0/4037797542 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd78806b4d0 msgr2=0x7fd78806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:08.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.228+0000 7fd7ab207640 1 --2- 172.21.15.7:0/4037797542 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd78806b4d0 0x7fd78806d990 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd798006fd0 tx=0x7fd798008040 comp rx=0 tx=0).stop 2024-04-25T09:59:08.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.228+0000 7fd7ab207640 1 -- 172.21.15.7:0/4037797542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7a40ce610 msgr2=0x7fd7a413b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:08.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.228+0000 7fd7ab207640 1 --2- 172.21.15.7:0/4037797542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7a40ce610 0x7fd7a413b640 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fd7900098c0 tx=0x7fd7900046c0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.228+0000 7fd7ab207640 1 -- 172.21.15.7:0/4037797542 shutdown_connections 2024-04-25T09:59:08.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.228+0000 7fd7ab207640 1 --2- 172.21.15.7:0/4037797542 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd78806b4d0 0x7fd78806d990 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.228+0000 7fd7ab207640 1 --2- 172.21.15.7:0/4037797542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7a4143fb0 0x7fd7a41e7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.228+0000 7fd7ab207640 1 --2- 172.21.15.7:0/4037797542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7a40ce610 0x7fd7a413b640 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.228+0000 7fd7ab207640 1 --2- 172.21.15.7:0/4037797542 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd7a406e240 0x7fd7a413d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:08.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.228+0000 7fd7ab207640 1 -- 172.21.15.7:0/4037797542 >> 172.21.15.7:0/4037797542 conn(0x7fd7a406ab60 msgr2=0x7fd7a40af2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:08.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.228+0000 7fd7ab207640 1 -- 172.21.15.7:0/4037797542 shutdown_connections 2024-04-25T09:59:08.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:08.228+0000 7fd7ab207640 1 -- 172.21.15.7:0/4037797542 wait complete. 2024-04-25T09:59:08.243 INFO:tasks.cephfs.filesystem:scrub status for tag:806d52c5-7f2d-4932-b395-a8ea62198dfa - {'path': '/subdir', 'tag': '806d52c5-7f2d-4932-b395-a8ea62198dfa', 'options': 'recursive'} 2024-04-25T09:59:08.259 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-04-25T09:59:08.256+0000 7f68754b1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:59:26.747 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:59:26.750 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:59:38.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:59:38.244 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-25T09:59:38.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.356+0000 7f2213934640 1 Processor -- start 2024-04-25T09:59:38.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.356+0000 7f2213934640 1 -- start start 2024-04-25T09:59:38.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.357+0000 7f2213934640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f220c0cf9b0 0x7f220c0cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.357+0000 7f2213934640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f220c0cd8a0 0x7f220c0cfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.357+0000 7f2213934640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f220c0cd0e0 con 0x7f220c0b2820 2024-04-25T09:59:38.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.357+0000 7f2213934640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f220c0ccd90 con 0x7f220c0cd8a0 2024-04-25T09:59:38.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.357+0000 7f2213934640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220c0cd410 con 0x7f220c0cf9b0 2024-04-25T09:59:38.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.357+0000 7f2210ecf640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f220c0cd8a0 0x7f220c0cfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.357+0000 7f2211ed1640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f220c0b2820 0x7f220c15f3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54184/0 (socket says 172.21.15.7:54184) 2024-04-25T09:59:38.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.357+0000 7f2211ed1640 1 -- 172.21.15.7:0/2874511864 learned_addr learned my addr 172.21.15.7:0/2874511864 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:59:38.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.357+0000 7f22116d0640 1 --2- 172.21.15.7:0/2874511864 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f220c0cf9b0 0x7f220c0cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.357+0000 7f2210ecf640 1 -- 172.21.15.7:0/2874511864 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f220c0cf9b0 msgr2=0x7f220c0cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:38.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.357+0000 7f2210ecf640 1 --2- 172.21.15.7:0/2874511864 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f220c0cf9b0 0x7f220c0cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.357+0000 7f2210ecf640 1 -- 172.21.15.7:0/2874511864 >> v1:172.21.15.7:6789/0 conn(0x7f220c0b2820 legacy=0x7f220c15f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:38.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.357+0000 7f2210ecf640 1 -- 172.21.15.7:0/2874511864 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f220c0d02d0 con 0x7f220c0cd8a0 2024-04-25T09:59:38.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.357+0000 7f22116d0640 1 --2- 172.21.15.7:0/2874511864 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f220c0cf9b0 0x7f220c0cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:59:38.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.358+0000 7f2210ecf640 1 --2- 172.21.15.7:0/2874511864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f220c0cd8a0 0x7f220c0cfd90 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f220c0cd590 tx=0x7f21fc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3843c0feef5903b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:38.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.358+0000 7f2203fff640 1 -- 172.21.15.7:0/2874511864 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc037070 con 0x7f220c0cd8a0 2024-04-25T09:59:38.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.358+0000 7f2203fff640 1 -- 172.21.15.7:0/2874511864 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21fc032440 con 0x7f220c0cd8a0 2024-04-25T09:59:38.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.358+0000 7f2203fff640 1 -- 172.21.15.7:0/2874511864 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc032810 con 0x7f220c0cd8a0 2024-04-25T09:59:38.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.359+0000 7f2213934640 1 -- 172.21.15.7:0/2874511864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f220c0cd8a0 msgr2=0x7f220c0cfd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:38.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.359+0000 7f2213934640 1 --2- 172.21.15.7:0/2874511864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f220c0cd8a0 0x7f220c0cfd90 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f220c0cd590 tx=0x7f21fc02a180 comp rx=0 tx=0).stop 2024-04-25T09:59:38.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.359+0000 7f2213934640 1 -- 172.21.15.7:0/2874511864 shutdown_connections 2024-04-25T09:59:38.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.359+0000 7f2213934640 1 --2- 172.21.15.7:0/2874511864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f220c0cd8a0 0x7f220c0cfd90 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.359+0000 7f2213934640 1 --2- 172.21.15.7:0/2874511864 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f220c0cf9b0 0x7f220c0cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.359+0000 7f2213934640 1 -- 172.21.15.7:0/2874511864 >> 172.21.15.7:0/2874511864 conn(0x7f220c0999f0 msgr2=0x7f220c0b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:38.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.359+0000 7f2213934640 1 -- 172.21.15.7:0/2874511864 shutdown_connections 2024-04-25T09:59:38.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.359+0000 7f2213934640 1 -- 172.21.15.7:0/2874511864 wait complete. 2024-04-25T09:59:38.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.360+0000 7f2213934640 1 Processor -- start 2024-04-25T09:59:38.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.360+0000 7f2213934640 1 -- start start 2024-04-25T09:59:38.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.361+0000 7f2213934640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f220c0b2820 0x7f220c0af250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.361+0000 7f2213934640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f220c0cd8a0 0x7f220c0c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.361+0000 7f2213934640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f220c0cf9b0 0x7f220c0c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.361+0000 7f2213934640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c0cdce0 con 0x7f220c0cf9b0 2024-04-25T09:59:38.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.361+0000 7f2213934640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c0ccab0 con 0x7f220c0cd8a0 2024-04-25T09:59:38.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.361+0000 7f2213934640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220c15ba80 con 0x7f220c0b2820 2024-04-25T09:59:38.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.361+0000 7f2211ed1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f220c0cf9b0 0x7f220c0c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.361+0000 7f2211ed1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f220c0cf9b0 0x7f220c0c64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41774/0 (socket says 172.21.15.7:41774) 2024-04-25T09:59:38.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.361+0000 7f2211ed1640 1 -- 172.21.15.7:0/3377328267 learned_addr learned my addr 172.21.15.7:0/3377328267 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:38.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.361+0000 7f22116d0640 1 --2- 172.21.15.7:0/3377328267 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f220c0b2820 0x7f220c0af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.361+0000 7f2211ed1640 1 -- 172.21.15.7:0/3377328267 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f220c0b2820 msgr2=0x7f220c0af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:38.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.361+0000 7f2210ecf640 1 --2- 172.21.15.7:0/3377328267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f220c0cd8a0 0x7f220c0c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.361+0000 7f2211ed1640 1 --2- 172.21.15.7:0/3377328267 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f220c0b2820 0x7f220c0af250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.361+0000 7f2211ed1640 1 -- 172.21.15.7:0/3377328267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f220c0cd8a0 msgr2=0x7f220c0c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:38.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.361+0000 7f2211ed1640 1 --2- 172.21.15.7:0/3377328267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f220c0cd8a0 0x7f220c0c5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.361+0000 7f2211ed1640 1 -- 172.21.15.7:0/3377328267 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f220c0c73b0 con 0x7f220c0cf9b0 2024-04-25T09:59:38.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.362+0000 7f2211ed1640 1 --2- 172.21.15.7:0/3377328267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f220c0cf9b0 0x7f220c0c64b0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f220400cbc0 tx=0x7f220400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:38.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.362+0000 7f2201ffb640 1 -- 172.21.15.7:0/3377328267 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2204017070 con 0x7f220c0cf9b0 2024-04-25T09:59:38.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.362+0000 7f2201ffb640 1 -- 172.21.15.7:0/3377328267 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220400ad40 con 0x7f220c0cf9b0 2024-04-25T09:59:38.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.362+0000 7f2201ffb640 1 -- 172.21.15.7:0/3377328267 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2204012600 con 0x7f220c0cf9b0 2024-04-25T09:59:38.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.362+0000 7f2213934640 1 -- 172.21.15.7:0/3377328267 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f220c0c6b10 con 0x7f220c0cf9b0 2024-04-25T09:59:38.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.362+0000 7f2213934640 1 -- 172.21.15.7:0/3377328267 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f220c0c70d0 con 0x7f220c0cf9b0 2024-04-25T09:59:38.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.363+0000 7f2201ffb640 1 -- 172.21.15.7:0/3377328267 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f220401a070 con 0x7f220c0cf9b0 2024-04-25T09:59:38.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.364+0000 7f2201ffb640 1 --2- 172.21.15.7:0/3377328267 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f21f006b500 0x7f21f006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.364+0000 7f22116d0640 1 --2- 172.21.15.7:0/3377328267 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f21f006b500 0x7f21f006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.364+0000 7f2201ffb640 1 -- 172.21.15.7:0/3377328267 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f2204089ff0 con 0x7f220c0cf9b0 2024-04-25T09:59:38.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.365+0000 7f22116d0640 1 --2- 172.21.15.7:0/3377328267 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f21f006b500 0x7f21f006d9c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f2208006fd0 tx=0x7f2208008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:38.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.365+0000 7f221663b740 1 Processor -- start 2024-04-25T09:59:38.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.365+0000 7f221663b740 1 -- start start 2024-04-25T09:59:38.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.366+0000 7f221663b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561b11ad510 0x5561b11ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.366+0000 7f221663b740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5561b117d770 0x5561b11837a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.366+0000 7f221663b740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561b11c9470 0x5561b11c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.366+0000 7f221663b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561b10e6da0 con 0x5561b11ad510 2024-04-25T09:59:38.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.366+0000 7f221663b740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561b108fb80 con 0x5561b11c9470 2024-04-25T09:59:38.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.366+0000 7f221663b740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561b10e2e40 con 0x5561b117d770 2024-04-25T09:59:38.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.366+0000 7f22116d0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561b11ad510 0x5561b11ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.366+0000 7f22116d0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561b11ad510 0x5561b11ad8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41780/0 (socket says 172.21.15.7:41780) 2024-04-25T09:59:38.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.366+0000 7f22116d0640 1 -- 172.21.15.7:0/1391289165 learned_addr learned my addr 172.21.15.7:0/1391289165 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:38.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.366+0000 7f2211ed1640 1 --2- 172.21.15.7:0/1391289165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561b11c9470 0x5561b11c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.366+0000 7f2210ecf640 1 --2- 172.21.15.7:0/1391289165 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5561b117d770 0x5561b11837a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.366+0000 7f22116d0640 1 -- 172.21.15.7:0/1391289165 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5561b117d770 msgr2=0x5561b11837a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:38.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.366+0000 7f22116d0640 1 --2- 172.21.15.7:0/1391289165 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5561b117d770 0x5561b11837a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.366+0000 7f22116d0640 1 -- 172.21.15.7:0/1391289165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561b11c9470 msgr2=0x5561b11c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:38.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.366+0000 7f22116d0640 1 --2- 172.21.15.7:0/1391289165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561b11c9470 0x5561b11c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.366+0000 7f22116d0640 1 -- 172.21.15.7:0/1391289165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561b1099f10 con 0x5561b11ad510 2024-04-25T09:59:38.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.367+0000 7f22116d0640 1 --2- 172.21.15.7:0/1391289165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561b11ad510 0x5561b11ad8f0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f220800e880 tx=0x7f2208011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=632544593ac0faab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:38.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.367+0000 7f21eeffd640 1 -- 172.21.15.7:0/1391289165 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2208025070 con 0x5561b11ad510 2024-04-25T09:59:38.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.367+0000 7f21eeffd640 1 -- 172.21.15.7:0/1391289165 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2208015700 con 0x5561b11ad510 2024-04-25T09:59:38.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.367+0000 7f21eeffd640 1 -- 172.21.15.7:0/1391289165 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220800f040 con 0x5561b11ad510 2024-04-25T09:59:38.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.367+0000 7f221663b740 1 -- 172.21.15.7:0/1391289165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561b11ad510 msgr2=0x5561b11ad8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:38.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.367+0000 7f221663b740 1 --2- 172.21.15.7:0/1391289165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561b11ad510 0x5561b11ad8f0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f220800e880 tx=0x7f2208011000 comp rx=0 tx=0).stop 2024-04-25T09:59:38.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.367+0000 7f221663b740 1 -- 172.21.15.7:0/1391289165 shutdown_connections 2024-04-25T09:59:38.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.367+0000 7f221663b740 1 --2- 172.21.15.7:0/1391289165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561b11c9470 0x5561b11c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.367+0000 7f221663b740 1 --2- 172.21.15.7:0/1391289165 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5561b117d770 0x5561b11837a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.367+0000 7f221663b740 1 --2- 172.21.15.7:0/1391289165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561b11ad510 0x5561b11ad8f0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.367+0000 7f221663b740 1 -- 172.21.15.7:0/1391289165 >> 172.21.15.7:0/1391289165 conn(0x5561b117f9e0 msgr2=0x5561b11c8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:38.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.367+0000 7f221663b740 1 -- 172.21.15.7:0/1391289165 shutdown_connections 2024-04-25T09:59:38.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.367+0000 7f221663b740 1 -- 172.21.15.7:0/1391289165 wait complete. 2024-04-25T09:59:38.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.368+0000 7f221663b740 1 -- start start 2024-04-25T09:59:38.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.368+0000 7f221663b740 1 Processor -- start 2024-04-25T09:59:38.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.369+0000 7f221663b740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5561b11ad510 0x5561b11b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.369+0000 7f221663b740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561b11c9470 0x5561b11a91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.369+0000 7f221663b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561b11aeea0 0x5561b11af320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.369+0000 7f221663b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561b1183ce0 con 0x5561b11aeea0 2024-04-25T09:59:38.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.369+0000 7f221663b740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561b10854b0 con 0x5561b11c9470 2024-04-25T09:59:38.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.369+0000 7f221663b740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561b1183310 con 0x5561b11ad510 2024-04-25T09:59:38.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.369+0000 7f221663b740 10 client.0 _ll_register_callbacks cb 0x5561b10c5180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:59:38.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.369+0000 7f2211ed1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561b11aeea0 0x5561b11af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.369+0000 7f2211ed1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561b11aeea0 0x5561b11af320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41786/0 (socket says 172.21.15.7:41786) 2024-04-25T09:59:38.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.369+0000 7f2211ed1640 1 -- 172.21.15.7:0/3263032215 learned_addr learned my addr 172.21.15.7:0/3263032215 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:38.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.369+0000 7f2210ecf640 1 --2- 172.21.15.7:0/3263032215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561b11c9470 0x5561b11a91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.369+0000 7f22116d0640 1 --2- 172.21.15.7:0/3263032215 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5561b11ad510 0x5561b11b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.369+0000 7f2211ed1640 1 -- 172.21.15.7:0/3263032215 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5561b11ad510 msgr2=0x5561b11b11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:38.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.369+0000 7f2211ed1640 1 --2- 172.21.15.7:0/3263032215 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5561b11ad510 0x5561b11b11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.369+0000 7f2211ed1640 1 -- 172.21.15.7:0/3263032215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561b11c9470 msgr2=0x5561b11a91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:38.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.369+0000 7f2211ed1640 1 --2- 172.21.15.7:0/3263032215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561b11c9470 0x5561b11a91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.370+0000 7f2211ed1640 1 -- 172.21.15.7:0/3263032215 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5561b0ec57d0 con 0x5561b11aeea0 2024-04-25T09:59:38.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.370+0000 7f2210ecf640 1 --2- 172.21.15.7:0/3263032215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561b11c9470 0x5561b11a91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:59:38.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.370+0000 7f2211ed1640 1 --2- 172.21.15.7:0/3263032215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561b11aeea0 0x5561b11af320 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f2204001330 tx=0x7f220405c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f00e03ce9081b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:38.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.370+0000 7f21e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:59:38.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.370+0000 7f21e7fff640 1 -- 172.21.15.7:0/3263032215 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2204004b60 con 0x5561b11aeea0 2024-04-25T09:59:38.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.370+0000 7f21e7fff640 1 -- 172.21.15.7:0/3263032215 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f2204004d00 con 0x5561b11aeea0 2024-04-25T09:59:38.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.370+0000 7f221663b740 1 -- 172.21.15.7:0/3263032215 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2208015700 con 0x5561b11aeea0 2024-04-25T09:59:38.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.370+0000 7f21e7fff640 1 -- 172.21.15.7:0/3263032215 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2204088050 con 0x5561b11aeea0 2024-04-25T09:59:38.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.370+0000 7f221663b740 10 client.7215 fetch_fsmap learned FSMap version 44 2024-04-25T09:59:38.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.370+0000 7f221663b740 1 -- 172.21.15.7:0/3263032215 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x5561b0dfb3f0 con 0x5561b11aeea0 2024-04-25T09:59:38.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.370+0000 7f21e7fff640 1 -- 172.21.15.7:0/3263032215 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2208015700 con 0x5561b11aeea0 2024-04-25T09:59:38.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.370+0000 7f21e7fff640 1 -- 172.21.15.7:0/3263032215 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 44) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2204057aa0 con 0x5561b11aeea0 2024-04-25T09:59:38.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.370+0000 7f221663b740 10 client.7215 fetch_fsmap finished waiting for FSMap version 44 2024-04-25T09:59:38.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.370+0000 7f221663b740 10 client.7215 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T09:59:38.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.370+0000 7f221663b740 20 client.7215 populate_metadata read hostname 'smithi007' 2024-04-25T09:59:38.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.371+0000 7f221663b740 1 --2- 172.21.15.7:0/3263032215 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5561b11a66e0 0x5561b11e9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.371+0000 7f221663b740 4 client.7215 mds_command: new command op to 6813 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:59:38.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.371+0000 7f221663b740 1 -- 172.21.15.7:0/3263032215 --> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5561b10f42e0 con 0x5561b11a66e0 2024-04-25T09:59:38.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.371+0000 7f22116d0640 1 --2- 172.21.15.7:0/3263032215 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5561b11a66e0 0x5561b11e9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.371+0000 7f21e7fff640 10 client.7215 ms_handle_connect on v2:172.21.15.7:6836/3690076929 2024-04-25T09:59:38.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.371+0000 7f22116d0640 1 --2- 172.21.15.7:0/3263032215 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5561b11a66e0 0x5561b11e9a70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=632dc8a298e8d473 server_cookie=aa311b8cd34d97e0 in_seq=0 out_seq=0 2024-04-25T09:59:38.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.372+0000 7f21e7fff640 1 -- 172.21.15.7:0/3263032215 <== mds.0 v2:172.21.15.7:6836/3690076929 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5561b10f42e0 con 0x5561b11a66e0 2024-04-25T09:59:38.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.372+0000 7f21e7fff640 10 client.7215 handle_command_reply: tid=0 2024-04-25T09:59:38.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.372+0000 7f221663b740 1 client.7215 shutdown 2024-04-25T09:59:38.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.372+0000 7f221663b740 1 -- 172.21.15.7:0/3263032215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561b11aeea0 msgr2=0x5561b11af320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:38.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.372+0000 7f221663b740 1 --2- 172.21.15.7:0/3263032215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561b11aeea0 0x5561b11af320 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f2204001330 tx=0x7f220405c830 comp rx=0 tx=0).stop 2024-04-25T09:59:38.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.372+0000 7f221663b740 1 -- 172.21.15.7:0/3263032215 shutdown_connections 2024-04-25T09:59:38.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.372+0000 7f221663b740 1 --2- 172.21.15.7:0/3263032215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561b11aeea0 0x5561b11af320 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.372+0000 7f221663b740 1 --2- 172.21.15.7:0/3263032215 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5561b11a66e0 0x5561b11e9a70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.372+0000 7f221663b740 1 --2- 172.21.15.7:0/3263032215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561b11c9470 0x5561b11a91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.372+0000 7f221663b740 1 --2- 172.21.15.7:0/3263032215 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5561b11ad510 0x5561b11b11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.372+0000 7f21e7fff640 0 client.7215 ms_handle_reset on v2:172.21.15.7:6836/3690076929 2024-04-25T09:59:38.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.372+0000 7f221663b740 1 -- 172.21.15.7:0/3263032215 >> 172.21.15.7:0/3263032215 conn(0x5561b117d770 msgr2=0x5561b117ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:38.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.372+0000 7f221663b740 1 -- 172.21.15.7:0/3263032215 shutdown_connections 2024-04-25T09:59:38.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.372+0000 7f221663b740 1 -- 172.21.15.7:0/3263032215 wait complete. 2024-04-25T09:59:38.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.372+0000 7f221663b740 20 client.7215 trim_cache size 0 max 16384 2024-04-25T09:59:38.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.387+0000 7f221663b740 1 Processor -- start 2024-04-25T09:59:38.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.387+0000 7f221663b740 1 -- start start 2024-04-25T09:59:38.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.388+0000 7f221663b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561b11ad510 0x5561b11cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.388+0000 7f221663b740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561b11aeea0 0x5561b11cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.388+0000 7f221663b740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5561b11c9470 0x5561b11c9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.388+0000 7f221663b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c1fc110 con 0x5561b11ad510 2024-04-25T09:59:38.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.388+0000 7f221663b740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c06f890 con 0x5561b11aeea0 2024-04-25T09:59:38.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.388+0000 7f221663b740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220c144ca0 con 0x5561b11c9470 2024-04-25T09:59:38.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.388+0000 7f22116d0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561b11ad510 0x5561b11cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.388+0000 7f22116d0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561b11ad510 0x5561b11cb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41798/0 (socket says 172.21.15.7:41798) 2024-04-25T09:59:38.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.388+0000 7f22116d0640 1 -- 172.21.15.7:0/1843852397 learned_addr learned my addr 172.21.15.7:0/1843852397 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:38.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.388+0000 7f22116d0640 1 -- 172.21.15.7:0/1843852397 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5561b11c9470 msgr2=0x5561b11c9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:38.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.388+0000 7f22116d0640 1 --2- 172.21.15.7:0/1843852397 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5561b11c9470 0x5561b11c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.388+0000 7f2210ecf640 1 --2- 172.21.15.7:0/1843852397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561b11aeea0 0x5561b11cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.388+0000 7f22116d0640 1 -- 172.21.15.7:0/1843852397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561b11aeea0 msgr2=0x5561b11cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:38.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.388+0000 7f22116d0640 1 --2- 172.21.15.7:0/1843852397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561b11aeea0 0x5561b11cbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.388+0000 7f22116d0640 1 -- 172.21.15.7:0/1843852397 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561b0dbb0f0 con 0x5561b11ad510 2024-04-25T09:59:38.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.389+0000 7f22116d0640 1 --2- 172.21.15.7:0/1843852397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561b11ad510 0x5561b11cb830 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f2208009fd0 tx=0x7f2208013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3696760ac63057 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:38.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.389+0000 7f21ee7fc640 1 -- 172.21.15.7:0/1843852397 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2208034070 con 0x5561b11ad510 2024-04-25T09:59:38.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.389+0000 7f21ee7fc640 1 -- 172.21.15.7:0/1843852397 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2208004250 con 0x5561b11ad510 2024-04-25T09:59:38.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.389+0000 7f21ee7fc640 1 -- 172.21.15.7:0/1843852397 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2208025040 con 0x5561b11ad510 2024-04-25T09:59:38.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.389+0000 7f221663b740 1 -- 172.21.15.7:0/1843852397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561b11ad510 msgr2=0x5561b11cb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:38.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.389+0000 7f221663b740 1 --2- 172.21.15.7:0/1843852397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561b11ad510 0x5561b11cb830 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f2208009fd0 tx=0x7f2208013000 comp rx=0 tx=0).stop 2024-04-25T09:59:38.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.389+0000 7f221663b740 1 -- 172.21.15.7:0/1843852397 shutdown_connections 2024-04-25T09:59:38.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.389+0000 7f221663b740 1 --2- 172.21.15.7:0/1843852397 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5561b11c9470 0x5561b11c9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.389+0000 7f221663b740 1 --2- 172.21.15.7:0/1843852397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561b11aeea0 0x5561b11cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.389+0000 7f221663b740 1 --2- 172.21.15.7:0/1843852397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561b11ad510 0x5561b11cb830 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.389+0000 7f221663b740 1 -- 172.21.15.7:0/1843852397 >> 172.21.15.7:0/1843852397 conn(0x5561b117d770 msgr2=0x5561b11b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:38.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.389+0000 7f221663b740 1 -- 172.21.15.7:0/1843852397 shutdown_connections 2024-04-25T09:59:38.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.389+0000 7f221663b740 1 -- 172.21.15.7:0/1843852397 wait complete. 2024-04-25T09:59:38.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.390+0000 7f221663b740 1 -- start start 2024-04-25T09:59:38.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.390+0000 7f221663b740 1 Processor -- start 2024-04-25T09:59:38.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.391+0000 7f221663b740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561b11ad510 0x5561b121c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.391+0000 7f221663b740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5561b11aeea0 0x5561b11aa600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.391+0000 7f221663b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561b11c9470 0x5561b11cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.391+0000 7f221663b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c1452a0 con 0x5561b11c9470 2024-04-25T09:59:38.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.391+0000 7f221663b740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561b11e65c0 con 0x5561b11ad510 2024-04-25T09:59:38.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.391+0000 7f221663b740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561b11ec050 con 0x5561b11aeea0 2024-04-25T09:59:38.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.391+0000 7f221663b740 10 client.0 _ll_register_callbacks cb 0x7f2208009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:59:38.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.391+0000 7f2211ed1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561b11c9470 0x5561b11cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.391+0000 7f2211ed1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561b11c9470 0x5561b11cb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41804/0 (socket says 172.21.15.7:41804) 2024-04-25T09:59:38.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.391+0000 7f2211ed1640 1 -- 172.21.15.7:0/485400158 learned_addr learned my addr 172.21.15.7:0/485400158 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:38.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.391+0000 7f22116d0640 1 --2- 172.21.15.7:0/485400158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561b11ad510 0x5561b121c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.391+0000 7f2210ecf640 1 --2- 172.21.15.7:0/485400158 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5561b11aeea0 0x5561b11aa600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.391+0000 7f2211ed1640 1 -- 172.21.15.7:0/485400158 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5561b11aeea0 msgr2=0x5561b11aa600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:38.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.391+0000 7f2211ed1640 1 --2- 172.21.15.7:0/485400158 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5561b11aeea0 0x5561b11aa600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.391+0000 7f2211ed1640 1 -- 172.21.15.7:0/485400158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561b11ad510 msgr2=0x5561b121c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:38.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.391+0000 7f2211ed1640 1 --2- 172.21.15.7:0/485400158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561b11ad510 0x5561b121c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.391+0000 7f2211ed1640 1 -- 172.21.15.7:0/485400158 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5561b11a7660 con 0x5561b11c9470 2024-04-25T09:59:38.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.392+0000 7f2211ed1640 1 --2- 172.21.15.7:0/485400158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561b11c9470 0x5561b11cb830 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f2204058350 tx=0x7f2204001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69e453aa72d223a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:38.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.392+0000 7f21e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:59:38.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.392+0000 7f21e7fff640 1 -- 172.21.15.7:0/485400158 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2204076030 con 0x5561b11c9470 2024-04-25T09:59:38.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.392+0000 7f21e7fff640 1 -- 172.21.15.7:0/485400158 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f22040543a0 con 0x5561b11c9470 2024-04-25T09:59:38.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.392+0000 7f221663b740 1 -- 172.21.15.7:0/485400158 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2208004250 con 0x5561b11c9470 2024-04-25T09:59:38.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.392+0000 7f21e7fff640 1 -- 172.21.15.7:0/485400158 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f220407f050 con 0x5561b11c9470 2024-04-25T09:59:38.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.392+0000 7f221663b740 10 client.7221 fetch_fsmap learned FSMap version 44 2024-04-25T09:59:38.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.392+0000 7f221663b740 1 -- 172.21.15.7:0/485400158 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x5561b11ebcc0 con 0x5561b11c9470 2024-04-25T09:59:38.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.392+0000 7f21e7fff640 1 -- 172.21.15.7:0/485400158 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2208004250 con 0x5561b11c9470 2024-04-25T09:59:38.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.392+0000 7f21e7fff640 1 -- 172.21.15.7:0/485400158 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 44) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f220405c160 con 0x5561b11c9470 2024-04-25T09:59:38.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.392+0000 7f221663b740 10 client.7221 fetch_fsmap finished waiting for FSMap version 44 2024-04-25T09:59:38.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.392+0000 7f221663b740 10 client.7221 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T09:59:38.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.392+0000 7f221663b740 20 client.7221 populate_metadata read hostname 'smithi007' 2024-04-25T09:59:38.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.392+0000 7f221663b740 1 --2- 172.21.15.7:0/485400158 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5561b11cbd70 0x5561b11a3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.392+0000 7f221663b740 4 client.7221 mds_command: new command op to 6813 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:59:38.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.392+0000 7f221663b740 1 -- 172.21.15.7:0/485400158 --> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5561b10ee630 con 0x5561b11cbd70 2024-04-25T09:59:38.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.392+0000 7f22116d0640 1 --2- 172.21.15.7:0/485400158 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5561b11cbd70 0x5561b11a3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.393+0000 7f21e7fff640 10 client.7221 ms_handle_connect on v2:172.21.15.7:6836/3690076929 2024-04-25T09:59:38.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.393+0000 7f22116d0640 1 --2- 172.21.15.7:0/485400158 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5561b11cbd70 0x5561b11a3270 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16aa2957a05812b1 server_cookie=270a003066fd8add in_seq=0 out_seq=0 2024-04-25T09:59:38.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.393+0000 7f21e7fff640 1 -- 172.21.15.7:0/485400158 <== mds.0 v2:172.21.15.7:6836/3690076929 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5561b10ee630 con 0x5561b11cbd70 2024-04-25T09:59:38.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.393+0000 7f21e7fff640 10 client.7221 handle_command_reply: tid=0 2024-04-25T09:59:38.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.393+0000 7f221663b740 1 client.7221 shutdown 2024-04-25T09:59:38.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.393+0000 7f221663b740 1 -- 172.21.15.7:0/485400158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561b11c9470 msgr2=0x5561b11cb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:38.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.393+0000 7f221663b740 1 --2- 172.21.15.7:0/485400158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561b11c9470 0x5561b11cb830 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f2204058350 tx=0x7f2204001250 comp rx=0 tx=0).stop 2024-04-25T09:59:38.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.393+0000 7f221663b740 1 -- 172.21.15.7:0/485400158 shutdown_connections 2024-04-25T09:59:38.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.393+0000 7f221663b740 1 --2- 172.21.15.7:0/485400158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5561b11c9470 0x5561b11cb830 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.393+0000 7f221663b740 1 --2- 172.21.15.7:0/485400158 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5561b11aeea0 0x5561b11aa600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.393+0000 7f221663b740 1 --2- 172.21.15.7:0/485400158 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5561b11cbd70 0x5561b11a3270 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.393+0000 7f221663b740 1 --2- 172.21.15.7:0/485400158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561b11ad510 0x5561b121c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.393+0000 7f21e7fff640 0 client.7221 ms_handle_reset on v2:172.21.15.7:6836/3690076929 2024-04-25T09:59:38.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.393+0000 7f221663b740 1 -- 172.21.15.7:0/485400158 >> 172.21.15.7:0/485400158 conn(0x5561b117d770 msgr2=0x5561b11c85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:38.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.393+0000 7f221663b740 1 -- 172.21.15.7:0/485400158 shutdown_connections 2024-04-25T09:59:38.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.393+0000 7f221663b740 1 -- 172.21.15.7:0/485400158 wait complete. 2024-04-25T09:59:38.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.393+0000 7f221663b740 20 client.7221 trim_cache size 0 max 16384 2024-04-25T09:59:38.403 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T09:59:38.403 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-04-25T09:59:38.403 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-04-25T09:59:38.403 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T09:59:38.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.394+0000 7f2213934640 1 -- 172.21.15.7:0/3377328267 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f21f006b500 msgr2=0x7f21f006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:38.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.394+0000 7f2213934640 1 --2- 172.21.15.7:0/3377328267 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f21f006b500 0x7f21f006d9c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f2208006fd0 tx=0x7f2208008040 comp rx=0 tx=0).stop 2024-04-25T09:59:38.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.394+0000 7f2213934640 1 -- 172.21.15.7:0/3377328267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f220c0cf9b0 msgr2=0x7f220c0c64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:38.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.394+0000 7f2213934640 1 --2- 172.21.15.7:0/3377328267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f220c0cf9b0 0x7f220c0c64b0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f220400cbc0 tx=0x7f220400a430 comp rx=0 tx=0).stop 2024-04-25T09:59:38.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.394+0000 7f2213934640 1 -- 172.21.15.7:0/3377328267 shutdown_connections 2024-04-25T09:59:38.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.394+0000 7f2213934640 1 --2- 172.21.15.7:0/3377328267 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f21f006b500 0x7f21f006d9c0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.394+0000 7f2213934640 1 --2- 172.21.15.7:0/3377328267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f220c0cf9b0 0x7f220c0c64b0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.394+0000 7f2213934640 1 --2- 172.21.15.7:0/3377328267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f220c0cd8a0 0x7f220c0c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.394+0000 7f2213934640 1 --2- 172.21.15.7:0/3377328267 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f220c0b2820 0x7f220c0af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.394+0000 7f2213934640 1 -- 172.21.15.7:0/3377328267 >> 172.21.15.7:0/3377328267 conn(0x7f220c0999f0 msgr2=0x7f220c0b0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:38.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.394+0000 7f2213934640 1 -- 172.21.15.7:0/3377328267 shutdown_connections 2024-04-25T09:59:38.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.394+0000 7f2213934640 1 -- 172.21.15.7:0/3377328267 wait complete. 2024-04-25T09:59:38.409 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:59:38.409 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:59:38.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.506+0000 7ff7023ab640 1 Processor -- start 2024-04-25T09:59:38.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.506+0000 7ff7023ab640 1 -- start start 2024-04-25T09:59:38.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.506+0000 7ff7023ab640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff6fc06bc70 0x7ff6fc09a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.507+0000 7ff7023ab640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6fc0cfad0 con 0x7ff6fc06c330 2024-04-25T09:59:38.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.507+0000 7ff7023ab640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6fc0cfdb0 con 0x7ff6fc15da20 2024-04-25T09:59:38.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.507+0000 7ff7023ab640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6fc0d06e0 con 0x7ff6fc06bc70 2024-04-25T09:59:38.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.507+0000 7ff6fb7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff6fc06bc70 0x7ff6fc09a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.507+0000 7ff700948640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff6fc06c330 0x7ff6fc0cbd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54194/0 (socket says 172.21.15.7:54194) 2024-04-25T09:59:38.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.507+0000 7ff6fb7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff6fc06bc70 0x7ff6fc09a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41820/0 (socket says 172.21.15.7:41820) 2024-04-25T09:59:38.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.507+0000 7ff700948640 1 -- 172.21.15.7:0/2950391574 learned_addr learned my addr 172.21.15.7:0/2950391574 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:59:38.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.507+0000 7ff6fb7fe640 1 -- 172.21.15.7:0/2950391574 >> v1:172.21.15.55:6789/0 conn(0x7ff6fc15da20 legacy=0x7ff6fc0d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:38.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.507+0000 7ff6fb7fe640 1 -- 172.21.15.7:0/2950391574 >> v1:172.21.15.7:6789/0 conn(0x7ff6fc06c330 legacy=0x7ff6fc0cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:38.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.507+0000 7ff6fb7fe640 1 -- 172.21.15.7:0/2950391574 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc0d0090 con 0x7ff6fc06bc70 2024-04-25T09:59:38.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.507+0000 7ff6faffd640 1 -- 172.21.15.7:0/2950391574 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3237698787 0 0) 0x7ff6fc0cfad0 con 0x7ff6fc06c330 2024-04-25T09:59:38.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.508+0000 7ff6fb7fe640 1 --2- 172.21.15.7:0/2950391574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6fc06bc70 0x7ff6fc09a400 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7ff6f00097a0 tx=0x7ff6f002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26225066151019e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:38.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.508+0000 7ff6faffd640 1 -- 172.21.15.7:0/2950391574 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0037070 con 0x7ff6fc06bc70 2024-04-25T09:59:38.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.508+0000 7ff6faffd640 1 -- 172.21.15.7:0/2950391574 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f0032440 con 0x7ff6fc06bc70 2024-04-25T09:59:38.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.508+0000 7ff6faffd640 1 -- 172.21.15.7:0/2950391574 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0032810 con 0x7ff6fc06bc70 2024-04-25T09:59:38.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.508+0000 7ff7023ab640 1 -- 172.21.15.7:0/2950391574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6fc06bc70 msgr2=0x7ff6fc09a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:38.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.508+0000 7ff7023ab640 1 --2- 172.21.15.7:0/2950391574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6fc06bc70 0x7ff6fc09a400 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7ff6f00097a0 tx=0x7ff6f002a1e0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.508+0000 7ff7023ab640 1 -- 172.21.15.7:0/2950391574 shutdown_connections 2024-04-25T09:59:38.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.508+0000 7ff7023ab640 1 --2- 172.21.15.7:0/2950391574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6fc06bc70 0x7ff6fc09a400 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.508+0000 7ff7023ab640 1 -- 172.21.15.7:0/2950391574 >> 172.21.15.7:0/2950391574 conn(0x7ff6fc0d16f0 msgr2=0x7ff6fc0d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:38.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.508+0000 7ff7023ab640 1 -- 172.21.15.7:0/2950391574 shutdown_connections 2024-04-25T09:59:38.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.509+0000 7ff7023ab640 1 -- 172.21.15.7:0/2950391574 wait complete. 2024-04-25T09:59:38.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.510+0000 7ff7023ab640 1 Processor -- start 2024-04-25T09:59:38.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.510+0000 7ff7023ab640 1 -- start start 2024-04-25T09:59:38.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.510+0000 7ff7023ab640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6fc06bc70 0x7ff6fc1f37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.510+0000 7ff7023ab640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff6fc06c330 0x7ff6fc15ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.510+0000 7ff7023ab640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6fc15da20 0x7ff6fc15bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.510+0000 7ff7023ab640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0d1280 con 0x7ff6fc15da20 2024-04-25T09:59:38.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.510+0000 7ff7023ab640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc09a940 con 0x7ff6fc06bc70 2024-04-25T09:59:38.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.510+0000 7ff7023ab640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc15de00 con 0x7ff6fc06c330 2024-04-25T09:59:38.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.511+0000 7ff700948640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6fc15da20 0x7ff6fc15bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.511+0000 7ff700948640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6fc15da20 0x7ff6fc15bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41834/0 (socket says 172.21.15.7:41834) 2024-04-25T09:59:38.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.511+0000 7ff700948640 1 -- 172.21.15.7:0/778614391 learned_addr learned my addr 172.21.15.7:0/778614391 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:38.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.511+0000 7ff700948640 1 -- 172.21.15.7:0/778614391 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff6fc06c330 msgr2=0x7ff6fc15ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:38.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.511+0000 7ff6fbfff640 1 --2- 172.21.15.7:0/778614391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6fc06bc70 0x7ff6fc1f37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.511+0000 7ff700948640 1 --2- 172.21.15.7:0/778614391 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff6fc06c330 0x7ff6fc15ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.511+0000 7ff700948640 1 -- 172.21.15.7:0/778614391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6fc06bc70 msgr2=0x7ff6fc1f37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:38.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.511+0000 7ff700948640 1 --2- 172.21.15.7:0/778614391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6fc06bc70 0x7ff6fc1f37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.511+0000 7ff700948640 1 -- 172.21.15.7:0/778614391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc0b4950 con 0x7ff6fc15da20 2024-04-25T09:59:38.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.511+0000 7ff700948640 1 --2- 172.21.15.7:0/778614391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6fc15da20 0x7ff6fc15bf90 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7ff6f400c700 tx=0x7ff6f400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:38.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.511+0000 7ff6f8ff9640 1 -- 172.21.15.7:0/778614391 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4018070 con 0x7ff6fc15da20 2024-04-25T09:59:38.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.511+0000 7ff6f8ff9640 1 -- 172.21.15.7:0/778614391 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f400ce10 con 0x7ff6fc15da20 2024-04-25T09:59:38.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.511+0000 7ff7023ab640 1 -- 172.21.15.7:0/778614391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6fc0b4c30 con 0x7ff6fc15da20 2024-04-25T09:59:38.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.511+0000 7ff6f8ff9640 1 -- 172.21.15.7:0/778614391 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f400a860 con 0x7ff6fc15da20 2024-04-25T09:59:38.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.511+0000 7ff7023ab640 1 -- 172.21.15.7:0/778614391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6fc0b51f0 con 0x7ff6fc15da20 2024-04-25T09:59:38.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.512+0000 7ff7023ab640 1 -- 172.21.15.7:0/778614391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6fc068fd0 con 0x7ff6fc15da20 2024-04-25T09:59:38.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.513+0000 7ff6f8ff9640 1 -- 172.21.15.7:0/778614391 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff6f401b070 con 0x7ff6fc15da20 2024-04-25T09:59:38.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.513+0000 7ff6f8ff9640 1 --2- 172.21.15.7:0/778614391 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff6e806b4d0 0x7ff6e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.513+0000 7ff6f8ff9640 1 -- 172.21.15.7:0/778614391 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7ff6f4089950 con 0x7ff6fc15da20 2024-04-25T09:59:38.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.513+0000 7ff6fbfff640 1 --2- 172.21.15.7:0/778614391 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff6e806b4d0 0x7ff6e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.514+0000 7ff6fbfff640 1 --2- 172.21.15.7:0/778614391 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff6e806b4d0 0x7ff6e806d990 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc1463f0 tx=0x7ff6ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:38.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.518+0000 7ff6f8ff9640 1 -- 172.21.15.7:0/778614391 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff6f4058680 con 0x7ff6fc15da20 2024-04-25T09:59:38.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.736+0000 7ff7023ab640 1 -- 172.21.15.7:0/778614391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6fc0d2500 con 0x7ff6fc15da20 2024-04-25T09:59:38.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.736+0000 7ff6f8ff9640 1 -- 172.21.15.7:0/778614391 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4935 (secure 0 0 0) 0x7ff6f4057f80 con 0x7ff6fc15da20 2024-04-25T09:59:38.741 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:59:38.741 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1781470369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1781470369},{"type":"v1","addr":"172.21.15.55:6835","nonce":1781470369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6442,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1406578404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1406578404},{"type":"v1","addr":"172.21.15.55:6834","nonce":1406578404}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6810,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1839614891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1839614891},{"type":"v1","addr":"172.21.15.7:6835","nonce":1839614891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:58:45.628406+0000","modified":"2024-04-25T09:59:06.405640+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6813},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6813":{"gid":6813,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":9,"addr":"172.21.15.7:6837/3690076929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3690076929},{"type":"v1","addr":"172.21.15.7:6837","nonce":3690076929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:59:38.741 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 44 2024-04-25T09:59:38.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.738+0000 7ff7023ab640 1 -- 172.21.15.7:0/778614391 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff6e806b4d0 msgr2=0x7ff6e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:38.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.738+0000 7ff7023ab640 1 --2- 172.21.15.7:0/778614391 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff6e806b4d0 0x7ff6e806d990 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc1463f0 tx=0x7ff6ec009040 comp rx=0 tx=0).stop 2024-04-25T09:59:38.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.738+0000 7ff7023ab640 1 -- 172.21.15.7:0/778614391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6fc15da20 msgr2=0x7ff6fc15bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:38.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.738+0000 7ff7023ab640 1 --2- 172.21.15.7:0/778614391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6fc15da20 0x7ff6fc15bf90 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7ff6f400c700 tx=0x7ff6f400cbc0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.738+0000 7ff7023ab640 1 -- 172.21.15.7:0/778614391 shutdown_connections 2024-04-25T09:59:38.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.738+0000 7ff7023ab640 1 --2- 172.21.15.7:0/778614391 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff6e806b4d0 0x7ff6e806d990 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.738+0000 7ff7023ab640 1 --2- 172.21.15.7:0/778614391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6fc15da20 0x7ff6fc15bf90 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.738+0000 7ff7023ab640 1 --2- 172.21.15.7:0/778614391 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff6fc06c330 0x7ff6fc15ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.738+0000 7ff7023ab640 1 --2- 172.21.15.7:0/778614391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6fc06bc70 0x7ff6fc1f37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.738+0000 7ff7023ab640 1 -- 172.21.15.7:0/778614391 >> 172.21.15.7:0/778614391 conn(0x7ff6fc0d16f0 msgr2=0x7ff6fc0cd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:38.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.738+0000 7ff7023ab640 1 -- 172.21.15.7:0/778614391 shutdown_connections 2024-04-25T09:59:38.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.738+0000 7ff7023ab640 1 -- 172.21.15.7:0/778614391 wait complete. 2024-04-25T09:59:38.753 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-04-25T09:59:38.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.852+0000 7f25c5b09640 1 Processor -- start 2024-04-25T09:59:38.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.852+0000 7f25c5b09640 1 -- start start 2024-04-25T09:59:38.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.852+0000 7f25c5b09640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f25c00cf9b0 0x7f25c00cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.852+0000 7f25c5b09640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25c00b2820 0x7f25c015f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.852+0000 7f25c5b09640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c00cd0e0 con 0x7f25c00cd8a0 2024-04-25T09:59:38.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.852+0000 7f25c5b09640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c00ccd90 con 0x7f25c00cf9b0 2024-04-25T09:59:38.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.852+0000 7f25c5b09640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c00cd410 con 0x7f25c00b2820 2024-04-25T09:59:38.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.853+0000 7f25bf7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f25c00cf9b0 0x7f25c00cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.853+0000 7f25bffff640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25c00b2820 0x7f25c015f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.853+0000 7f25bf7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f25c00cf9b0 0x7f25c00cc1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:36392/0 (socket says 172.21.15.7:36392) 2024-04-25T09:59:38.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.853+0000 7f25bf7fe640 1 -- 172.21.15.7:0/447930257 learned_addr learned my addr 172.21.15.7:0/447930257 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:38.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.853+0000 7f25beffd640 1 --1- 172.21.15.7:0/447930257 >> v1:172.21.15.55:6789/0 conn(0x7f25c00cd8a0 0x7f25c00cfd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:56068/0 (socket says 172.21.15.7:56068) 2024-04-25T09:59:38.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.853+0000 7f25bffff640 1 -- 172.21.15.7:0/447930257 >> v2:172.21.15.55:3300/0 conn(0x7f25c00cf9b0 msgr2=0x7f25c00cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:38.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.853+0000 7f25bffff640 1 --2- 172.21.15.7:0/447930257 >> v2:172.21.15.55:3300/0 conn(0x7f25c00cf9b0 0x7f25c00cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.853+0000 7f25bffff640 1 -- 172.21.15.7:0/447930257 >> v1:172.21.15.55:6789/0 conn(0x7f25c00cd8a0 legacy=0x7f25c00cfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:38.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.853+0000 7f25bffff640 1 -- 172.21.15.7:0/447930257 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c00cc7d0 con 0x7f25c00b2820 2024-04-25T09:59:38.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.853+0000 7f25bf7fe640 1 --2- 172.21.15.7:0/447930257 >> v2:172.21.15.55:3300/0 conn(0x7f25c00cf9b0 0x7f25c00cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:59:38.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.854+0000 7f25bffff640 1 --2- 172.21.15.7:0/447930257 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25c00b2820 0x7f25c015f3b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f25b8009d90 tx=0x7f25b802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c234fc394076db5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:38.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.854+0000 7f25be7fc640 1 -- 172.21.15.7:0/447930257 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b8007740 con 0x7f25c00b2820 2024-04-25T09:59:38.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.854+0000 7f25be7fc640 1 -- 172.21.15.7:0/447930257 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b80078e0 con 0x7f25c00b2820 2024-04-25T09:59:38.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.854+0000 7f25be7fc640 1 -- 172.21.15.7:0/447930257 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b8007cb0 con 0x7f25c00b2820 2024-04-25T09:59:38.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.855+0000 7f25c5b09640 1 -- 172.21.15.7:0/447930257 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25c00b2820 msgr2=0x7f25c015f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:38.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.855+0000 7f25c5b09640 1 --2- 172.21.15.7:0/447930257 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25c00b2820 0x7f25c015f3b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f25b8009d90 tx=0x7f25b802a660 comp rx=0 tx=0).stop 2024-04-25T09:59:38.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.855+0000 7f25c5b09640 1 -- 172.21.15.7:0/447930257 shutdown_connections 2024-04-25T09:59:38.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.855+0000 7f25c5b09640 1 --2- 172.21.15.7:0/447930257 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25c00b2820 0x7f25c015f3b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.855+0000 7f25c5b09640 1 --2- 172.21.15.7:0/447930257 >> v2:172.21.15.55:3300/0 conn(0x7f25c00cf9b0 0x7f25c00cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.855+0000 7f25c5b09640 1 -- 172.21.15.7:0/447930257 >> 172.21.15.7:0/447930257 conn(0x7f25c00999f0 msgr2=0x7f25c00b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:38.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.855+0000 7f25c5b09640 1 -- 172.21.15.7:0/447930257 shutdown_connections 2024-04-25T09:59:38.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.855+0000 7f25c5b09640 1 -- 172.21.15.7:0/447930257 wait complete. 2024-04-25T09:59:38.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.856+0000 7f25c5b09640 1 Processor -- start 2024-04-25T09:59:38.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.856+0000 7f25c5b09640 1 -- start start 2024-04-25T09:59:38.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.857+0000 7f25c5b09640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25c00b2820 0x7f25c00c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.857+0000 7f25c5b09640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25c00cd8a0 0x7f25c00c9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.857+0000 7f25c5b09640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25c00cf9b0 0x7f25c01416d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.857+0000 7f25c5b09640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c015ba80 con 0x7f25c00b2820 2024-04-25T09:59:38.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.857+0000 7f25c5b09640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c00cdce0 con 0x7f25c00cd8a0 2024-04-25T09:59:38.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.857+0000 7f25c5b09640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c015bc00 con 0x7f25c00cf9b0 2024-04-25T09:59:38.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.857+0000 7f25bf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25c00b2820 0x7f25c00c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.857+0000 7f25bf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25c00b2820 0x7f25c00c6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41836/0 (socket says 172.21.15.7:41836) 2024-04-25T09:59:38.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.857+0000 7f25bf7fe640 1 -- 172.21.15.7:0/1348098123 learned_addr learned my addr 172.21.15.7:0/1348098123 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:38.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.857+0000 7f25beffd640 1 --2- 172.21.15.7:0/1348098123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25c00cd8a0 0x7f25c00c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.857+0000 7f25bffff640 1 --2- 172.21.15.7:0/1348098123 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25c00cf9b0 0x7f25c01416d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.857+0000 7f25bf7fe640 1 -- 172.21.15.7:0/1348098123 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25c00cf9b0 msgr2=0x7f25c01416d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:38.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.857+0000 7f25bf7fe640 1 --2- 172.21.15.7:0/1348098123 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25c00cf9b0 0x7f25c01416d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.857+0000 7f25bf7fe640 1 -- 172.21.15.7:0/1348098123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25c00cd8a0 msgr2=0x7f25c00c9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:38.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.857+0000 7f25bf7fe640 1 --2- 172.21.15.7:0/1348098123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25c00cd8a0 0x7f25c00c9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.857+0000 7f25bf7fe640 1 -- 172.21.15.7:0/1348098123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c00c8170 con 0x7f25c00b2820 2024-04-25T09:59:38.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.857+0000 7f25bffff640 1 --2- 172.21.15.7:0/1348098123 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25c00cf9b0 0x7f25c01416d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:59:38.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.858+0000 7f25bf7fe640 1 --2- 172.21.15.7:0/1348098123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25c00b2820 0x7f25c00c6ca0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f25b400e9b0 tx=0x7f25b400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:38.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.858+0000 7f25a7fff640 1 -- 172.21.15.7:0/1348098123 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4017070 con 0x7f25c00b2820 2024-04-25T09:59:38.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.858+0000 7f25a7fff640 1 -- 172.21.15.7:0/1348098123 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b400c9a0 con 0x7f25c00b2820 2024-04-25T09:59:38.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.858+0000 7f25c5b09640 1 -- 172.21.15.7:0/1348098123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c00c8450 con 0x7f25c00b2820 2024-04-25T09:59:38.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.858+0000 7f25a7fff640 1 -- 172.21.15.7:0/1348098123 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b400cd50 con 0x7f25c00b2820 2024-04-25T09:59:38.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.858+0000 7f25c5b09640 1 -- 172.21.15.7:0/1348098123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c00c8a10 con 0x7f25c00b2820 2024-04-25T09:59:38.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.860+0000 7f25a7fff640 1 -- 172.21.15.7:0/1348098123 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f25b401a070 con 0x7f25c00b2820 2024-04-25T09:59:38.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.860+0000 7f25a7fff640 1 --2- 172.21.15.7:0/1348098123 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f25ac06b4d0 0x7f25ac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.860+0000 7f25a7fff640 1 -- 172.21.15.7:0/1348098123 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f25b408a630 con 0x7f25c00b2820 2024-04-25T09:59:38.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.860+0000 7f25beffd640 1 --2- 172.21.15.7:0/1348098123 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f25ac06b4d0 0x7f25ac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.861+0000 7f25beffd640 1 --2- 172.21.15.7:0/1348098123 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f25ac06b4d0 0x7f25ac06d990 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f25c00ca590 tx=0x7f25b0007cc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:38.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.861+0000 7f25c8811740 1 Processor -- start 2024-04-25T09:59:38.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.861+0000 7f25c8811740 1 -- start start 2024-04-25T09:59:38.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.862+0000 7f25c8811740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x558e57467590 0x558e574696f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.862+0000 7f25c8811740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e574a3c60 0x558e57467970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.862+0000 7f25c8811740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e57492050 0x558e574924d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.862+0000 7f25c8811740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e573cac60 con 0x558e57492050 2024-04-25T09:59:38.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.862+0000 7f25c8811740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e57369d80 con 0x558e574a3c60 2024-04-25T09:59:38.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.862+0000 7f25c8811740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e573c6d00 con 0x558e57467590 2024-04-25T09:59:38.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.862+0000 7f25bffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e57492050 0x558e574924d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.862+0000 7f25bffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e57492050 0x558e574924d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41850/0 (socket says 172.21.15.7:41850) 2024-04-25T09:59:38.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.862+0000 7f25bffff640 1 -- 172.21.15.7:0/968567257 learned_addr learned my addr 172.21.15.7:0/968567257 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:38.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.862+0000 7f25bffff640 1 -- 172.21.15.7:0/968567257 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x558e57467590 msgr2=0x558e574696f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:38.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.862+0000 7f25beffd640 1 --2- 172.21.15.7:0/968567257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e574a3c60 0x558e57467970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.862+0000 7f25bf7fe640 1 --2- 172.21.15.7:0/968567257 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x558e57467590 0x558e574696f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.862+0000 7f25bffff640 1 --2- 172.21.15.7:0/968567257 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x558e57467590 0x558e574696f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.862+0000 7f25bffff640 1 -- 172.21.15.7:0/968567257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e574a3c60 msgr2=0x558e57467970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:38.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.862+0000 7f25bffff640 1 --2- 172.21.15.7:0/968567257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e574a3c60 0x558e57467970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.862+0000 7f25bffff640 1 -- 172.21.15.7:0/968567257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e571ab7c0 con 0x558e57492050 2024-04-25T09:59:38.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.862+0000 7f25bf7fe640 1 --2- 172.21.15.7:0/968567257 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x558e57467590 0x558e574696f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:59:38.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.862+0000 7f25beffd640 1 --2- 172.21.15.7:0/968567257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e574a3c60 0x558e57467970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:59:38.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.862+0000 7f25bffff640 1 --2- 172.21.15.7:0/968567257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e57492050 0x558e574924d0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f25b802ac50 tx=0x7f25b802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31328e2b175dcf31 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:38.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.863+0000 7f25a57fa640 1 -- 172.21.15.7:0/968567257 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b8007840 con 0x558e57492050 2024-04-25T09:59:38.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.863+0000 7f25a57fa640 1 -- 172.21.15.7:0/968567257 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b80079e0 con 0x558e57492050 2024-04-25T09:59:38.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.863+0000 7f25a57fa640 1 -- 172.21.15.7:0/968567257 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b8007db0 con 0x558e57492050 2024-04-25T09:59:38.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.863+0000 7f25c8811740 1 -- 172.21.15.7:0/968567257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e57492050 msgr2=0x558e574924d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:38.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.863+0000 7f25c8811740 1 --2- 172.21.15.7:0/968567257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e57492050 0x558e574924d0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f25b802ac50 tx=0x7f25b802e000 comp rx=0 tx=0).stop 2024-04-25T09:59:38.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.863+0000 7f25c8811740 1 -- 172.21.15.7:0/968567257 shutdown_connections 2024-04-25T09:59:38.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.863+0000 7f25c8811740 1 --2- 172.21.15.7:0/968567257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e57492050 0x558e574924d0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.863+0000 7f25c8811740 1 --2- 172.21.15.7:0/968567257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e574a3c60 0x558e57467970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.863+0000 7f25c8811740 1 --2- 172.21.15.7:0/968567257 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x558e57467590 0x558e574696f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.863+0000 7f25c8811740 1 -- 172.21.15.7:0/968567257 >> 172.21.15.7:0/968567257 conn(0x558e5742f6e0 msgr2=0x558e574ad050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:38.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.863+0000 7f25c8811740 1 -- 172.21.15.7:0/968567257 shutdown_connections 2024-04-25T09:59:38.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.863+0000 7f25c8811740 1 -- 172.21.15.7:0/968567257 wait complete. 2024-04-25T09:59:38.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.864+0000 7f25c8811740 1 -- start start 2024-04-25T09:59:38.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.864+0000 7f25c8811740 1 Processor -- start 2024-04-25T09:59:38.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.865+0000 7f25c8811740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e57467590 0x558e574af820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.865+0000 7f25c8811740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x558e57492050 0x558e5747d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.865+0000 7f25c8811740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e574a3c60 0x558e574a7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.865+0000 7f25c8811740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e57367840 con 0x558e57467590 2024-04-25T09:59:38.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.865+0000 7f25c8811740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e5748fba0 con 0x558e574a3c60 2024-04-25T09:59:38.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.865+0000 7f25c8811740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e5747eb00 con 0x558e57492050 2024-04-25T09:59:38.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.865+0000 7f25c8811740 10 client.0 _ll_register_callbacks cb 0x558e57381980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:59:38.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.865+0000 7f25bf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e57467590 0x558e574af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.865+0000 7f25bf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e57467590 0x558e574af820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41864/0 (socket says 172.21.15.7:41864) 2024-04-25T09:59:38.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.865+0000 7f25bf7fe640 1 -- 172.21.15.7:0/1678975534 learned_addr learned my addr 172.21.15.7:0/1678975534 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:38.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.865+0000 7f25beffd640 1 --2- 172.21.15.7:0/1678975534 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x558e57492050 0x558e5747d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.865+0000 7f25bffff640 1 --2- 172.21.15.7:0/1678975534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e574a3c60 0x558e574a7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.865+0000 7f25bf7fe640 1 -- 172.21.15.7:0/1678975534 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x558e57492050 msgr2=0x558e5747d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:38.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.865+0000 7f25bf7fe640 1 --2- 172.21.15.7:0/1678975534 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x558e57492050 0x558e5747d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.865+0000 7f25bf7fe640 1 -- 172.21.15.7:0/1678975534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e574a3c60 msgr2=0x558e574a7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:38.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.865+0000 7f25bf7fe640 1 --2- 172.21.15.7:0/1678975534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e574a3c60 0x558e574a7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.865+0000 7f25bf7fe640 1 -- 172.21.15.7:0/1678975534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e5720bf50 con 0x558e57467590 2024-04-25T09:59:38.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.865+0000 7f25bf7fe640 1 --2- 172.21.15.7:0/1678975534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e57467590 0x558e574af820 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f25b400e980 tx=0x7f25b40585f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbde9332b3ac73a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:38.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.865+0000 7f259e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:59:38.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.865+0000 7f259e7fc640 1 -- 172.21.15.7:0/1678975534 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4021040 con 0x558e57467590 2024-04-25T09:59:38.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.866+0000 7f259e7fc640 1 -- 172.21.15.7:0/1678975534 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f25b406cd90 con 0x558e57467590 2024-04-25T09:59:38.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.866+0000 7f25c8811740 1 -- 172.21.15.7:0/1678975534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f25b80079e0 con 0x558e57467590 2024-04-25T09:59:38.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.866+0000 7f259e7fc640 1 -- 172.21.15.7:0/1678975534 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25b40612e0 con 0x558e57467590 2024-04-25T09:59:38.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.866+0000 7f25c8811740 10 client.7239 fetch_fsmap learned FSMap version 44 2024-04-25T09:59:38.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.866+0000 7f25c8811740 1 -- 172.21.15.7:0/1678975534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x558e5709f0b0 con 0x558e57467590 2024-04-25T09:59:38.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.866+0000 7f259e7fc640 1 -- 172.21.15.7:0/1678975534 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b80079e0 con 0x558e57467590 2024-04-25T09:59:38.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.866+0000 7f259e7fc640 1 -- 172.21.15.7:0/1678975534 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 44) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f25b4058020 con 0x558e57467590 2024-04-25T09:59:38.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.866+0000 7f25c8811740 10 client.7239 fetch_fsmap finished waiting for FSMap version 44 2024-04-25T09:59:38.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.866+0000 7f25c8811740 10 client.7239 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:59:38.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.866+0000 7f25c8811740 20 client.7239 populate_metadata read hostname 'smithi007' 2024-04-25T09:59:38.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.866+0000 7f25c8811740 1 --2- 172.21.15.7:0/1678975534 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x558e5747e6c0 0x558e574bceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.866+0000 7f25c8811740 4 client.7239 mds_command: new command op to 6813 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:59:38.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.866+0000 7f25c8811740 1 -- 172.21.15.7:0/1678975534 --> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558e5738ae60 con 0x558e5747e6c0 2024-04-25T09:59:38.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.866+0000 7f25beffd640 1 --2- 172.21.15.7:0/1678975534 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x558e5747e6c0 0x558e574bceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.866+0000 7f259e7fc640 10 client.7239 ms_handle_connect on v2:172.21.15.7:6836/3690076929 2024-04-25T09:59:38.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.866+0000 7f25beffd640 1 --2- 172.21.15.7:0/1678975534 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x558e5747e6c0 0x558e574bceb0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff90a8c0662f216d server_cookie=207d711d95256fa7 in_seq=0 out_seq=0 2024-04-25T09:59:38.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.867+0000 7f259e7fc640 1 -- 172.21.15.7:0/1678975534 <== mds.0 v2:172.21.15.7:6836/3690076929 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558e5738ae60 con 0x558e5747e6c0 2024-04-25T09:59:38.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.867+0000 7f259e7fc640 10 client.7239 handle_command_reply: tid=0 2024-04-25T09:59:38.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.867+0000 7f25c8811740 1 client.7239 shutdown 2024-04-25T09:59:38.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.867+0000 7f25c8811740 1 -- 172.21.15.7:0/1678975534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e57467590 msgr2=0x558e574af820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:38.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.867+0000 7f25c8811740 1 --2- 172.21.15.7:0/1678975534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e57467590 0x558e574af820 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f25b400e980 tx=0x7f25b40585f0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.867+0000 7f25c8811740 1 -- 172.21.15.7:0/1678975534 shutdown_connections 2024-04-25T09:59:38.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.867+0000 7f25c8811740 1 --2- 172.21.15.7:0/1678975534 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x558e5747e6c0 0x558e574bceb0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.867+0000 7f25c8811740 1 --2- 172.21.15.7:0/1678975534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e574a3c60 0x558e574a7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.867+0000 7f25c8811740 1 --2- 172.21.15.7:0/1678975534 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x558e57492050 0x558e5747d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.867+0000 7f259e7fc640 0 client.7239 ms_handle_reset on v2:172.21.15.7:6836/3690076929 2024-04-25T09:59:38.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.867+0000 7f25c8811740 1 --2- 172.21.15.7:0/1678975534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e57467590 0x558e574af820 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.867+0000 7f25c8811740 1 -- 172.21.15.7:0/1678975534 >> 172.21.15.7:0/1678975534 conn(0x558e5742f6e0 msgr2=0x558e5748f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:38.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.867+0000 7f25c8811740 1 -- 172.21.15.7:0/1678975534 shutdown_connections 2024-04-25T09:59:38.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.867+0000 7f25c8811740 1 -- 172.21.15.7:0/1678975534 wait complete. 2024-04-25T09:59:38.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.867+0000 7f25c8811740 20 client.7239 trim_cache size 0 max 16384 2024-04-25T09:59:38.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.879+0000 7f25c8811740 1 Processor -- start 2024-04-25T09:59:38.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.879+0000 7f25c8811740 1 -- start start 2024-04-25T09:59:38.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.880+0000 7f25c8811740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e57467590 0x558e574c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.880+0000 7f25c8811740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x558e57492050 0x558e574af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.880+0000 7f25c8811740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e574a3c60 0x558e574957c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.880+0000 7f25c8811740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c0144710 con 0x558e57467590 2024-04-25T09:59:38.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.880+0000 7f25c8811740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c0143b10 con 0x558e574a3c60 2024-04-25T09:59:38.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.880+0000 7f25c8811740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c0144110 con 0x558e57492050 2024-04-25T09:59:38.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.880+0000 7f25bf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e57467590 0x558e574c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.880+0000 7f25bf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e57467590 0x558e574c6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41876/0 (socket says 172.21.15.7:41876) 2024-04-25T09:59:38.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.880+0000 7f25bf7fe640 1 -- 172.21.15.7:0/716185550 learned_addr learned my addr 172.21.15.7:0/716185550 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:38.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.881+0000 7f25bf7fe640 1 -- 172.21.15.7:0/716185550 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x558e57492050 msgr2=0x558e574af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:38.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.881+0000 7f25bf7fe640 1 --2- 172.21.15.7:0/716185550 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x558e57492050 0x558e574af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.881+0000 7f25bf7fe640 1 -- 172.21.15.7:0/716185550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e574a3c60 msgr2=0x558e574957c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:38.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.881+0000 7f25bf7fe640 1 --2- 172.21.15.7:0/716185550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e574a3c60 0x558e574957c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.881+0000 7f25bf7fe640 1 -- 172.21.15.7:0/716185550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e57491e50 con 0x558e57467590 2024-04-25T09:59:38.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.881+0000 7f25bf7fe640 1 --2- 172.21.15.7:0/716185550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e57467590 0x558e574c6f20 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f25b4060db0 tx=0x7f25b408a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efac98b09a0a3c80 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:38.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.881+0000 7f25a4ff9640 1 -- 172.21.15.7:0/716185550 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b407c070 con 0x558e57467590 2024-04-25T09:59:38.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.881+0000 7f25a4ff9640 1 -- 172.21.15.7:0/716185550 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b406cb90 con 0x558e57467590 2024-04-25T09:59:38.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.881+0000 7f25a4ff9640 1 -- 172.21.15.7:0/716185550 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4021040 con 0x558e57467590 2024-04-25T09:59:38.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.881+0000 7f25c8811740 1 -- 172.21.15.7:0/716185550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e57467590 msgr2=0x558e574c6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:38.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.881+0000 7f25c8811740 1 --2- 172.21.15.7:0/716185550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e57467590 0x558e574c6f20 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f25b4060db0 tx=0x7f25b408a000 comp rx=0 tx=0).stop 2024-04-25T09:59:38.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.882+0000 7f25c8811740 1 -- 172.21.15.7:0/716185550 shutdown_connections 2024-04-25T09:59:38.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.882+0000 7f25c8811740 1 --2- 172.21.15.7:0/716185550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e574a3c60 0x558e574957c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.882+0000 7f25c8811740 1 --2- 172.21.15.7:0/716185550 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x558e57492050 0x558e574af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.882+0000 7f25c8811740 1 --2- 172.21.15.7:0/716185550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e57467590 0x558e574c6f20 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.882+0000 7f25c8811740 1 -- 172.21.15.7:0/716185550 >> 172.21.15.7:0/716185550 conn(0x558e5742f6e0 msgr2=0x558e574cf7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:38.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.882+0000 7f25c8811740 1 -- 172.21.15.7:0/716185550 shutdown_connections 2024-04-25T09:59:38.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.882+0000 7f25c8811740 1 -- 172.21.15.7:0/716185550 wait complete. 2024-04-25T09:59:38.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.882+0000 7f25c8811740 1 -- start start 2024-04-25T09:59:38.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.882+0000 7f25c8811740 1 Processor -- start 2024-04-25T09:59:38.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.883+0000 7f25c8811740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e57467590 0x558e574c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.883+0000 7f25c8811740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e57492050 0x558e57491540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.883+0000 7f25c8811740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x558e574a3c60 0x558e57495470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.883+0000 7f25c8811740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e574807a0 con 0x558e57492050 2024-04-25T09:59:38.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.883+0000 7f25c8811740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e574b0d10 con 0x558e57467590 2024-04-25T09:59:38.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.883+0000 7f25c8811740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e5747db10 con 0x558e574a3c60 2024-04-25T09:59:38.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.883+0000 7f25c8811740 10 client.0 _ll_register_callbacks cb 0x7f25b40090e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:59:38.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.883+0000 7f25beffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e57492050 0x558e57491540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.883+0000 7f25beffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e57492050 0x558e57491540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41880/0 (socket says 172.21.15.7:41880) 2024-04-25T09:59:38.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.883+0000 7f25beffd640 1 -- 172.21.15.7:0/3180746425 learned_addr learned my addr 172.21.15.7:0/3180746425 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:38.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.883+0000 7f25bf7fe640 1 --2- 172.21.15.7:0/3180746425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e57467590 0x558e574c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.883+0000 7f25bffff640 1 --2- 172.21.15.7:0/3180746425 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x558e574a3c60 0x558e57495470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.883+0000 7f25beffd640 1 -- 172.21.15.7:0/3180746425 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x558e574a3c60 msgr2=0x558e57495470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:38.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.883+0000 7f25beffd640 1 --2- 172.21.15.7:0/3180746425 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x558e574a3c60 0x558e57495470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.883+0000 7f25beffd640 1 -- 172.21.15.7:0/3180746425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e57467590 msgr2=0x558e574c6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:38.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.883+0000 7f25beffd640 1 --2- 172.21.15.7:0/3180746425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e57467590 0x558e574c6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.883+0000 7f25beffd640 1 -- 172.21.15.7:0/3180746425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e5751b210 con 0x558e57492050 2024-04-25T09:59:38.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.884+0000 7f25beffd640 1 --2- 172.21.15.7:0/3180746425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e57492050 0x558e57491540 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f25c01534e0 tx=0x7f25b0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9212e896e67ee207 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:38.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.884+0000 7f259e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:59:38.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.884+0000 7f259e7fc640 1 -- 172.21.15.7:0/3180746425 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b0024630 con 0x558e57492050 2024-04-25T09:59:38.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.884+0000 7f259e7fc640 1 -- 172.21.15.7:0/3180746425 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f25b001e040 con 0x558e57492050 2024-04-25T09:59:38.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.884+0000 7f25c8811740 1 -- 172.21.15.7:0/3180746425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f25b406cb90 con 0x558e57492050 2024-04-25T09:59:38.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.884+0000 7f259e7fc640 1 -- 172.21.15.7:0/3180746425 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25b00247d0 con 0x558e57492050 2024-04-25T09:59:38.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.884+0000 7f25c8811740 10 client.7245 fetch_fsmap learned FSMap version 44 2024-04-25T09:59:38.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.884+0000 7f25c8811740 1 -- 172.21.15.7:0/3180746425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x558e57490a60 con 0x558e57492050 2024-04-25T09:59:38.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.884+0000 7f259e7fc640 1 -- 172.21.15.7:0/3180746425 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b406cb90 con 0x558e57492050 2024-04-25T09:59:38.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.884+0000 7f259e7fc640 1 -- 172.21.15.7:0/3180746425 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 44) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f25b0014900 con 0x558e57492050 2024-04-25T09:59:38.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.884+0000 7f25c8811740 10 client.7245 fetch_fsmap finished waiting for FSMap version 44 2024-04-25T09:59:38.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.884+0000 7f25c8811740 10 client.7245 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:59:38.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.884+0000 7f25c8811740 20 client.7245 populate_metadata read hostname 'smithi007' 2024-04-25T09:59:38.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.884+0000 7f25c8811740 1 --2- 172.21.15.7:0/3180746425 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x558e5751f1b0 0x558e574ae180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:38.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.884+0000 7f25c8811740 4 client.7245 mds_command: new command op to 6813 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T09:59:38.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.884+0000 7f25c8811740 1 -- 172.21.15.7:0/3180746425 --> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x558e573d81a0 con 0x558e5751f1b0 2024-04-25T09:59:38.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.884+0000 7f25bf7fe640 1 --2- 172.21.15.7:0/3180746425 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x558e5751f1b0 0x558e574ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:38.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.885+0000 7f259e7fc640 10 client.7245 ms_handle_connect on v2:172.21.15.7:6836/3690076929 2024-04-25T09:59:38.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.885+0000 7f25bf7fe640 1 --2- 172.21.15.7:0/3180746425 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x558e5751f1b0 0x558e574ae180 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf1b19329bbd32f6 server_cookie=fdb601a77979074c in_seq=0 out_seq=0 2024-04-25T09:59:38.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.885+0000 7f259e7fc640 1 -- 172.21.15.7:0/3180746425 <== mds.0 v2:172.21.15.7:6836/3690076929 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+237 (crc 0 0 0) 0x558e573d81a0 con 0x558e5751f1b0 2024-04-25T09:59:38.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.885+0000 7f259e7fc640 10 client.7245 handle_command_reply: tid=0 2024-04-25T09:59:38.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.885+0000 7f25c8811740 1 client.7245 shutdown 2024-04-25T09:59:38.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.885+0000 7f25c8811740 1 -- 172.21.15.7:0/3180746425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e57492050 msgr2=0x558e57491540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:38.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.885+0000 7f25c8811740 1 --2- 172.21.15.7:0/3180746425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e57492050 0x558e57491540 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f25c01534e0 tx=0x7f25b0000ed0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.885+0000 7f25c8811740 1 -- 172.21.15.7:0/3180746425 shutdown_connections 2024-04-25T09:59:38.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.885+0000 7f25c8811740 1 --2- 172.21.15.7:0/3180746425 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x558e574a3c60 0x558e57495470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.885+0000 7f25c8811740 1 --2- 172.21.15.7:0/3180746425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e57492050 0x558e57491540 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.885+0000 7f25c8811740 1 --2- 172.21.15.7:0/3180746425 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x558e5751f1b0 0x558e574ae180 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.885+0000 7f25c8811740 1 --2- 172.21.15.7:0/3180746425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558e57467590 0x558e574c6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.885+0000 7f259e7fc640 0 client.7245 ms_handle_reset on v2:172.21.15.7:6836/3690076929 2024-04-25T09:59:38.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.885+0000 7f25c8811740 1 -- 172.21.15.7:0/3180746425 >> 172.21.15.7:0/3180746425 conn(0x558e5742f6e0 msgr2=0x558e574b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:38.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.885+0000 7f25c8811740 1 -- 172.21.15.7:0/3180746425 shutdown_connections 2024-04-25T09:59:38.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.885+0000 7f25c8811740 1 -- 172.21.15.7:0/3180746425 wait complete. 2024-04-25T09:59:38.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.885+0000 7f25c8811740 20 client.7245 trim_cache size 0 max 16384 2024-04-25T09:59:38.896 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:59:38.896 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2024-04-25T09:59:38.896 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T09:59:38.896 INFO:teuthology.orchestra.run.smithi007.stdout: "damage_type": "dentry", 2024-04-25T09:59:38.896 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 2193213531, 2024-04-25T09:59:38.896 INFO:teuthology.orchestra.run.smithi007.stdout: "ino": 1099511627776, 2024-04-25T09:59:38.896 INFO:teuthology.orchestra.run.smithi007.stdout: "frag": "*", 2024-04-25T09:59:38.896 INFO:teuthology.orchestra.run.smithi007.stdout: "dname": "file_to_be_damaged", 2024-04-25T09:59:38.896 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_id": "head", 2024-04-25T09:59:38.896 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/subdir/file_to_be_damaged" 2024-04-25T09:59:38.896 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:59:38.897 INFO:teuthology.orchestra.run.smithi007.stdout:] 2024-04-25T09:59:38.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.886+0000 7f25c5b09640 1 -- 172.21.15.7:0/1348098123 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f25ac06b4d0 msgr2=0x7f25ac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:38.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.886+0000 7f25c5b09640 1 --2- 172.21.15.7:0/1348098123 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f25ac06b4d0 0x7f25ac06d990 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f25c00ca590 tx=0x7f25b0007cc0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.886+0000 7f25c5b09640 1 -- 172.21.15.7:0/1348098123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25c00b2820 msgr2=0x7f25c00c6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:38.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.886+0000 7f25c5b09640 1 --2- 172.21.15.7:0/1348098123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25c00b2820 0x7f25c00c6ca0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f25b400e9b0 tx=0x7f25b400ee70 comp rx=0 tx=0).stop 2024-04-25T09:59:38.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.886+0000 7f25c5b09640 1 -- 172.21.15.7:0/1348098123 shutdown_connections 2024-04-25T09:59:38.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.886+0000 7f25c5b09640 1 --2- 172.21.15.7:0/1348098123 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f25ac06b4d0 0x7f25ac06d990 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.886+0000 7f25c5b09640 1 --2- 172.21.15.7:0/1348098123 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25c00cf9b0 0x7f25c01416d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.886+0000 7f25c5b09640 1 --2- 172.21.15.7:0/1348098123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25c00cd8a0 0x7f25c00c9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.886+0000 7f25c5b09640 1 --2- 172.21.15.7:0/1348098123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25c00b2820 0x7f25c00c6ca0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:38.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.886+0000 7f25c5b09640 1 -- 172.21.15.7:0/1348098123 >> 172.21.15.7:0/1348098123 conn(0x7f25c00999f0 msgr2=0x7f25c0154c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:38.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.886+0000 7f25c5b09640 1 -- 172.21.15.7:0/1348098123 shutdown_connections 2024-04-25T09:59:38.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.886+0000 7f25c5b09640 1 -- 172.21.15.7:0/1348098123 wait complete. 2024-04-25T09:59:38.900 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T09:59:39.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.996+0000 7f92eb3c4640 1 Processor -- start 2024-04-25T09:59:39.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.996+0000 7f92eb3c4640 1 -- start start 2024-04-25T09:59:39.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.997+0000 7f92eb3c4640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f92e415dad0 0x7f92e40d18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.997+0000 7f92eb3c4640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92e40d0950 0x7f92e40b6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.997+0000 7f92eb3c4640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92e40d2240 con 0x7f92e40b9580 2024-04-25T09:59:39.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.997+0000 7f92eb3c4640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92e40d2520 con 0x7f92e415dad0 2024-04-25T09:59:39.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.997+0000 7f92eb3c4640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e40d2800 con 0x7f92e40d0950 2024-04-25T09:59:39.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.997+0000 7f92e9160640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f92e415dad0 0x7f92e40d18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.997+0000 7f92e895f640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f92e40b9580 0x7f92e40d0240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54206/0 (socket says 172.21.15.7:54206) 2024-04-25T09:59:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.997+0000 7f92e895f640 1 -- 172.21.15.7:0/3215895065 learned_addr learned my addr 172.21.15.7:0/3215895065 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:59:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.997+0000 7f92e9961640 1 --2- 172.21.15.7:0/3215895065 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92e40d0950 0x7f92e40b6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.997+0000 7f92dbfff640 1 -- 172.21.15.7:0/3215895065 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4120016179 0 0) 0x7f92e40d2240 con 0x7f92e40b9580 2024-04-25T09:59:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.997+0000 7f92dbfff640 1 -- 172.21.15.7:0/3215895065 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92d0003520 con 0x7f92e40b9580 2024-04-25T09:59:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.997+0000 7f92e9160640 1 -- 172.21.15.7:0/3215895065 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92e40d0950 msgr2=0x7f92e40b6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.997+0000 7f92e9160640 1 --2- 172.21.15.7:0/3215895065 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92e40d0950 0x7f92e40b6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.997+0000 7f92e9160640 1 -- 172.21.15.7:0/3215895065 >> v1:172.21.15.7:6789/0 conn(0x7f92e40b9580 legacy=0x7f92e40d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.997+0000 7f92e9160640 1 -- 172.21.15.7:0/3215895065 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e40d2ae0 con 0x7f92e415dad0 2024-04-25T09:59:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.998+0000 7f92e9160640 1 --2- 172.21.15.7:0/3215895065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92e415dad0 0x7f92e40d18d0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f92e00097a0 tx=0x7f92e002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b6801c384f8e0f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.998+0000 7f92dbfff640 1 -- 172.21.15.7:0/3215895065 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e0037070 con 0x7f92e415dad0 2024-04-25T09:59:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.998+0000 7f92dbfff640 1 -- 172.21.15.7:0/3215895065 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e0032440 con 0x7f92e415dad0 2024-04-25T09:59:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.998+0000 7f92dbfff640 1 -- 172.21.15.7:0/3215895065 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e0032810 con 0x7f92e415dad0 2024-04-25T09:59:39.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.999+0000 7f92eb3c4640 1 -- 172.21.15.7:0/3215895065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92e415dad0 msgr2=0x7f92e40d18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:39.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.999+0000 7f92eb3c4640 1 --2- 172.21.15.7:0/3215895065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92e415dad0 0x7f92e40d18d0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f92e00097a0 tx=0x7f92e002a210 comp rx=0 tx=0).stop 2024-04-25T09:59:39.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.999+0000 7f92eb3c4640 1 -- 172.21.15.7:0/3215895065 shutdown_connections 2024-04-25T09:59:39.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.999+0000 7f92eb3c4640 1 --2- 172.21.15.7:0/3215895065 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92e40d0950 0x7f92e40b6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.999+0000 7f92eb3c4640 1 --2- 172.21.15.7:0/3215895065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92e415dad0 0x7f92e40d18d0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.999+0000 7f92eb3c4640 1 -- 172.21.15.7:0/3215895065 >> 172.21.15.7:0/3215895065 conn(0x7f92e406bfe0 msgr2=0x7f92e406c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:39.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.999+0000 7f92eb3c4640 1 -- 172.21.15.7:0/3215895065 shutdown_connections 2024-04-25T09:59:39.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:38.999+0000 7f92eb3c4640 1 -- 172.21.15.7:0/3215895065 wait complete. 2024-04-25T09:59:39.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.000+0000 7f92eb3c4640 1 Processor -- start 2024-04-25T09:59:39.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.000+0000 7f92eb3c4640 1 -- start start 2024-04-25T09:59:39.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.001+0000 7f92eb3c4640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92e40b9580 0x7f92e40c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.001+0000 7f92eb3c4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92e40d0950 0x7f92e415f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.001+0000 7f92eb3c4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92e415dad0 0x7f92e40b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.001+0000 7f92eb3c4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e415deb0 con 0x7f92e40d0950 2024-04-25T09:59:39.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.001+0000 7f92eb3c4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e40d1e10 con 0x7f92e415dad0 2024-04-25T09:59:39.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.001+0000 7f92eb3c4640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e4160240 con 0x7f92e40b9580 2024-04-25T09:59:39.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.001+0000 7f92e895f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92e40d0950 0x7f92e415f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.001+0000 7f92e895f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92e40d0950 0x7f92e415f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41896/0 (socket says 172.21.15.7:41896) 2024-04-25T09:59:39.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.001+0000 7f92e895f640 1 -- 172.21.15.7:0/956714861 learned_addr learned my addr 172.21.15.7:0/956714861 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:39.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.001+0000 7f92e9160640 1 --2- 172.21.15.7:0/956714861 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92e40b9580 0x7f92e40c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.001+0000 7f92e9961640 1 --2- 172.21.15.7:0/956714861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92e415dad0 0x7f92e40b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.001+0000 7f92e895f640 1 -- 172.21.15.7:0/956714861 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92e40b9580 msgr2=0x7f92e40c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:39.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.001+0000 7f92e895f640 1 --2- 172.21.15.7:0/956714861 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92e40b9580 0x7f92e40c98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.001+0000 7f92e895f640 1 -- 172.21.15.7:0/956714861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92e415dad0 msgr2=0x7f92e40b7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:39.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.001+0000 7f92e895f640 1 --2- 172.21.15.7:0/956714861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92e415dad0 0x7f92e40b7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.001+0000 7f92e895f640 1 -- 172.21.15.7:0/956714861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e4160520 con 0x7f92e40d0950 2024-04-25T09:59:39.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.001+0000 7f92e895f640 1 --2- 172.21.15.7:0/956714861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92e40d0950 0x7f92e415f7c0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f92d400c500 tx=0x7f92d400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:39.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.002+0000 7f92d9ffb640 1 -- 172.21.15.7:0/956714861 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d4017070 con 0x7f92e40d0950 2024-04-25T09:59:39.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.002+0000 7f92d9ffb640 1 -- 172.21.15.7:0/956714861 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d4005ce0 con 0x7f92e40d0950 2024-04-25T09:59:39.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.002+0000 7f92eb3c4640 1 -- 172.21.15.7:0/956714861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e4160800 con 0x7f92e40d0950 2024-04-25T09:59:39.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.002+0000 7f92d9ffb640 1 -- 172.21.15.7:0/956714861 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d4007330 con 0x7f92e40d0950 2024-04-25T09:59:39.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.002+0000 7f92eb3c4640 1 -- 172.21.15.7:0/956714861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e4160dc0 con 0x7f92e40d0950 2024-04-25T09:59:39.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.003+0000 7f92eb3c4640 1 -- 172.21.15.7:0/956714861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e4160fc0 con 0x7f92e40d0950 2024-04-25T09:59:39.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.003+0000 7f92d9ffb640 1 -- 172.21.15.7:0/956714861 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f92d401a070 con 0x7f92e40d0950 2024-04-25T09:59:39.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.004+0000 7f92d9ffb640 1 --2- 172.21.15.7:0/956714861 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f92c806b4d0 0x7f92c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.004+0000 7f92d9ffb640 1 -- 172.21.15.7:0/956714861 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f92d40897a0 con 0x7f92e40d0950 2024-04-25T09:59:39.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.004+0000 7f92e9160640 1 --2- 172.21.15.7:0/956714861 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f92c806b4d0 0x7f92c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.004+0000 7f92e9160640 1 --2- 172.21.15.7:0/956714861 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f92c806b4d0 0x7f92c806d990 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f92e0034000 tx=0x7f92e002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:39.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.008+0000 7f92d9ffb640 1 -- 172.21.15.7:0/956714861 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f92e4160fc0 con 0x7f92e40d0950 2024-04-25T09:59:39.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.226+0000 7f92eb3c4640 1 -- 172.21.15.7:0/956714861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f92e4074bb0 con 0x7f92e40d0950 2024-04-25T09:59:39.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.226+0000 7f92d9ffb640 1 -- 172.21.15.7:0/956714861 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f92d4058590 con 0x7f92e40d0950 2024-04-25T09:59:39.231 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T09:59:39.231 INFO:teuthology.orchestra.run.smithi007.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-04-25T09:59:39.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.229+0000 7f92eb3c4640 1 -- 172.21.15.7:0/956714861 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f92c806b4d0 msgr2=0x7f92c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:39.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.229+0000 7f92eb3c4640 1 --2- 172.21.15.7:0/956714861 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f92c806b4d0 0x7f92c806d990 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f92e0034000 tx=0x7f92e002e000 comp rx=0 tx=0).stop 2024-04-25T09:59:39.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.229+0000 7f92eb3c4640 1 -- 172.21.15.7:0/956714861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92e40d0950 msgr2=0x7f92e415f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:39.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.229+0000 7f92eb3c4640 1 --2- 172.21.15.7:0/956714861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92e40d0950 0x7f92e415f7c0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f92d400c500 tx=0x7f92d400c9c0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.229+0000 7f92eb3c4640 1 -- 172.21.15.7:0/956714861 shutdown_connections 2024-04-25T09:59:39.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.229+0000 7f92eb3c4640 1 --2- 172.21.15.7:0/956714861 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f92c806b4d0 0x7f92c806d990 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.229+0000 7f92eb3c4640 1 --2- 172.21.15.7:0/956714861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92e415dad0 0x7f92e40b7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.229+0000 7f92eb3c4640 1 --2- 172.21.15.7:0/956714861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92e40d0950 0x7f92e415f7c0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.229+0000 7f92eb3c4640 1 --2- 172.21.15.7:0/956714861 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92e40b9580 0x7f92e40c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.229+0000 7f92eb3c4640 1 -- 172.21.15.7:0/956714861 >> 172.21.15.7:0/956714861 conn(0x7f92e406bfe0 msgr2=0x7f92e415b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:39.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.229+0000 7f92eb3c4640 1 -- 172.21.15.7:0/956714861 shutdown_connections 2024-04-25T09:59:39.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.229+0000 7f92eb3c4640 1 -- 172.21.15.7:0/956714861 wait complete. 2024-04-25T09:59:39.243 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T09:59:39.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:59:39.244 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub start /subdir repair,recursive 2024-04-25T09:59:39.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.344+0000 7f77a36ee640 1 Processor -- start 2024-04-25T09:59:39.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.344+0000 7f77a36ee640 1 -- start start 2024-04-25T09:59:39.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.345+0000 7f77a36ee640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f779c15de70 0x7f779c0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.345+0000 7f77a36ee640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f779c0d2290 con 0x7f779c0d3f10 2024-04-25T09:59:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.345+0000 7f77a36ee640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f779c0d2570 con 0x7f779c0d3330 2024-04-25T09:59:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.345+0000 7f77a36ee640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f779c0d2850 con 0x7f779c15de70 2024-04-25T09:59:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.345+0000 7f77a1c8b640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f779c0d3f10 0x7f779c0b6a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54208/0 (socket says 172.21.15.7:54208) 2024-04-25T09:59:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.345+0000 7f77a1c8b640 1 -- 172.21.15.7:0/872774518 learned_addr learned my addr 172.21.15.7:0/872774518 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:59:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.345+0000 7f77a148a640 1 --2- 172.21.15.7:0/872774518 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f779c15de70 0x7f779c0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.345+0000 7f7793fff640 1 -- 172.21.15.7:0/872774518 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1603058609 0 0) 0x7f779c0d2290 con 0x7f779c0d3f10 2024-04-25T09:59:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.345+0000 7f7793fff640 1 -- 172.21.15.7:0/872774518 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7788003520 con 0x7f779c0d3f10 2024-04-25T09:59:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.345+0000 7f7793fff640 1 -- 172.21.15.7:0/872774518 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2162601471 0 0) 0x7f779c0d2570 con 0x7f779c0d3330 2024-04-25T09:59:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.345+0000 7f7793fff640 1 -- 172.21.15.7:0/872774518 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f779c0d2290 con 0x7f779c0d3330 2024-04-25T09:59:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.346+0000 7f7793fff640 1 -- 172.21.15.7:0/872774518 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 166173889 0 0) 0x7f7788003520 con 0x7f779c0d3f10 2024-04-25T09:59:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.346+0000 7f7793fff640 1 -- 172.21.15.7:0/872774518 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f779c15de70 msgr2=0x7f779c0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.346+0000 7f7793fff640 1 --2- 172.21.15.7:0/872774518 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f779c15de70 0x7f779c0d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.346+0000 7f7793fff640 1 -- 172.21.15.7:0/872774518 >> v1:172.21.15.55:6789/0 conn(0x7f779c0d3330 legacy=0x7f779c0d3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.346+0000 7f7793fff640 1 -- 172.21.15.7:0/872774518 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779c0d2b30 con 0x7f779c0d3f10 2024-04-25T09:59:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.346+0000 7f7793fff640 1 -- 172.21.15.7:0/872774518 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f77940019f0 con 0x7f779c0d3f10 2024-04-25T09:59:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.346+0000 7f7793fff640 1 -- 172.21.15.7:0/872774518 >> v1:172.21.15.7:6789/0 conn(0x7f779c0d3f10 legacy=0x7f779c0b6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.346+0000 7f7793fff640 1 --2- 172.21.15.7:0/872774518 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f779c15de70 0x7f7788003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.346+0000 7f7793fff640 1 --2- 172.21.15.7:0/872774518 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77880040d0 0x7f7788004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.346+0000 7f7793fff640 1 --2- 172.21.15.7:0/872774518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7788004d40 0x7f77880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.346+0000 7f7793fff640 1 -- 172.21.15.7:0/872774518 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c0d2850 con 0x7f77880040d0 2024-04-25T09:59:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.346+0000 7f7793fff640 1 -- 172.21.15.7:0/872774518 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778800baa0 con 0x7f7788004d40 2024-04-25T09:59:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.346+0000 7f7793fff640 1 -- 172.21.15.7:0/872774518 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778800bca0 con 0x7f779c15de70 2024-04-25T09:59:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.346+0000 7f77a0c89640 1 --2- 172.21.15.7:0/872774518 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77880040d0 0x7f7788004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.346+0000 7f77a148a640 1 --2- 172.21.15.7:0/872774518 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f779c15de70 0x7f7788003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.346+0000 7f77a1c8b640 1 --2- 172.21.15.7:0/872774518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7788004d40 0x7f77880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.346+0000 7f77a0c89640 1 -- 172.21.15.7:0/872774518 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f779c15de70 msgr2=0x7f7788003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.346+0000 7f77a0c89640 1 --2- 172.21.15.7:0/872774518 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f779c15de70 0x7f7788003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.346+0000 7f77a0c89640 1 -- 172.21.15.7:0/872774518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7788004d40 msgr2=0x7f77880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.346+0000 7f77a0c89640 1 --2- 172.21.15.7:0/872774518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7788004d40 0x7f77880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.346+0000 7f77a0c89640 1 -- 172.21.15.7:0/872774518 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7788003520 con 0x7f77880040d0 2024-04-25T09:59:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.347+0000 7f77a0c89640 1 --2- 172.21.15.7:0/872774518 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77880040d0 0x7f7788004800 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f778c0018a0 tx=0x7f7788005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beaf755e67ca199a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.347+0000 7f7793fff640 1 -- 172.21.15.7:0/872774518 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778c0014f0 con 0x7f77880040d0 2024-04-25T09:59:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.347+0000 7f7793fff640 1 -- 172.21.15.7:0/872774518 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778c0052d0 con 0x7f77880040d0 2024-04-25T09:59:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.347+0000 7f7793fff640 1 -- 172.21.15.7:0/872774518 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778c02ac60 con 0x7f77880040d0 2024-04-25T09:59:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.347+0000 7f77a36ee640 1 -- 172.21.15.7:0/872774518 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77880040d0 msgr2=0x7f7788004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.347+0000 7f77a36ee640 1 --2- 172.21.15.7:0/872774518 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77880040d0 0x7f7788004800 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f778c0018a0 tx=0x7f7788005830 comp rx=0 tx=0).stop 2024-04-25T09:59:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.347+0000 7f77a1c8b640 1 -- 172.21.15.7:0/872774518 reap_dead start 2024-04-25T09:59:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.348+0000 7f77a36ee640 1 -- 172.21.15.7:0/872774518 shutdown_connections 2024-04-25T09:59:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.348+0000 7f77a36ee640 1 -- 172.21.15.7:0/872774518 >> 172.21.15.7:0/872774518 conn(0x7f779c0726b0 msgr2=0x7f779c072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.348+0000 7f77a36ee640 1 -- 172.21.15.7:0/872774518 shutdown_connections 2024-04-25T09:59:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.348+0000 7f77a36ee640 1 -- 172.21.15.7:0/872774518 wait complete. 2024-04-25T09:59:39.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.349+0000 7f77a36ee640 1 Processor -- start 2024-04-25T09:59:39.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.349+0000 7f77a36ee640 1 -- start start 2024-04-25T09:59:39.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.350+0000 7f77a36ee640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77880040d0 0x7f779c0b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.350+0000 7f77a36ee640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f779c154fb0 0x7f779c14b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.350+0000 7f77a36ee640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f779c14baf0 0x7f779c14bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.350+0000 7f77a36ee640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c0b9410 con 0x7f779c154fb0 2024-04-25T09:59:39.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.350+0000 7f77a36ee640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c0b9290 con 0x7f77880040d0 2024-04-25T09:59:39.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.350+0000 7f77a36ee640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f779c0d1920 con 0x7f779c14baf0 2024-04-25T09:59:39.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.350+0000 7f77a0c89640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f779c154fb0 0x7f779c14b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.350+0000 7f77a0c89640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f779c154fb0 0x7f779c14b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41920/0 (socket says 172.21.15.7:41920) 2024-04-25T09:59:39.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.350+0000 7f77a0c89640 1 -- 172.21.15.7:0/416715983 learned_addr learned my addr 172.21.15.7:0/416715983 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:39.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.350+0000 7f77a1c8b640 1 --2- 172.21.15.7:0/416715983 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f779c14baf0 0x7f779c14bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.350+0000 7f77a148a640 1 --2- 172.21.15.7:0/416715983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77880040d0 0x7f779c0b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.350+0000 7f77a0c89640 1 -- 172.21.15.7:0/416715983 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f779c14baf0 msgr2=0x7f779c14bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.350+0000 7f77a0c89640 1 --2- 172.21.15.7:0/416715983 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f779c14baf0 0x7f779c14bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.350+0000 7f77a0c89640 1 -- 172.21.15.7:0/416715983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77880040d0 msgr2=0x7f779c0b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.350+0000 7f77a0c89640 1 --2- 172.21.15.7:0/416715983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77880040d0 0x7f779c0b55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.350+0000 7f77a0c89640 1 -- 172.21.15.7:0/416715983 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779c156280 con 0x7f779c154fb0 2024-04-25T09:59:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.350+0000 7f77a148a640 1 --2- 172.21.15.7:0/416715983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77880040d0 0x7f779c0b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:59:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.350+0000 7f77a0c89640 1 --2- 172.21.15.7:0/416715983 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f779c154fb0 0x7f779c14b5b0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f778c0019c0 tx=0x7f778c0012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.350+0000 7f7791ffb640 1 -- 172.21.15.7:0/416715983 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778c03f020 con 0x7f779c154fb0 2024-04-25T09:59:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.350+0000 7f7791ffb640 1 -- 172.21.15.7:0/416715983 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778c006e50 con 0x7f779c154fb0 2024-04-25T09:59:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.350+0000 7f77a36ee640 1 -- 172.21.15.7:0/416715983 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f779c0aa3c0 con 0x7f779c154fb0 2024-04-25T09:59:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.350+0000 7f7791ffb640 1 -- 172.21.15.7:0/416715983 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778c037040 con 0x7f779c154fb0 2024-04-25T09:59:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.351+0000 7f77a36ee640 1 -- 172.21.15.7:0/416715983 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f779c155f10 con 0x7f779c154fb0 2024-04-25T09:59:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.352+0000 7f7791ffb640 1 -- 172.21.15.7:0/416715983 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f778c042020 con 0x7f779c154fb0 2024-04-25T09:59:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.353+0000 7f7791ffb640 1 --2- 172.21.15.7:0/416715983 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f778006b500 0x7f778006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.353+0000 7f7791ffb640 1 -- 172.21.15.7:0/416715983 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f778c0aa260 con 0x7f779c154fb0 2024-04-25T09:59:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.353+0000 7f77a148a640 1 --2- 172.21.15.7:0/416715983 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f778006b500 0x7f778006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.353+0000 7f77a148a640 1 --2- 172.21.15.7:0/416715983 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f778006b500 0x7f778006d9c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f77980099e0 tx=0x7f7798008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.353+0000 7f77a63ef740 1 Processor -- start 2024-04-25T09:59:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.353+0000 7f77a63ef740 1 -- start start 2024-04-25T09:59:39.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.354+0000 7f77a63ef740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5576b6742f70 0x5576b6743350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.354+0000 7f77a63ef740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5576b6743990 0x5576b6712ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.354+0000 7f77a63ef740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576b6713420 0x5576b673b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.354+0000 7f77a63ef740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576b667bc90 con 0x5576b6713420 2024-04-25T09:59:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.354+0000 7f77a63ef740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576b6624f50 con 0x5576b6742f70 2024-04-25T09:59:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.354+0000 7f77a63ef740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5576b6677d30 con 0x5576b6743990 2024-04-25T09:59:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.354+0000 7f77a1c8b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576b6713420 0x5576b673b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.354+0000 7f77a1c8b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576b6713420 0x5576b673b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41932/0 (socket says 172.21.15.7:41932) 2024-04-25T09:59:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.354+0000 7f77a1c8b640 1 -- 172.21.15.7:0/1760855938 learned_addr learned my addr 172.21.15.7:0/1760855938 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.354+0000 7f77a148a640 1 --2- 172.21.15.7:0/1760855938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5576b6742f70 0x5576b6743350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.354+0000 7f77a0c89640 1 --2- 172.21.15.7:0/1760855938 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5576b6743990 0x5576b6712ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.355+0000 7f77a1c8b640 1 -- 172.21.15.7:0/1760855938 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5576b6743990 msgr2=0x5576b6712ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.355+0000 7f77a1c8b640 1 --2- 172.21.15.7:0/1760855938 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5576b6743990 0x5576b6712ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.355+0000 7f77a1c8b640 1 -- 172.21.15.7:0/1760855938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5576b6742f70 msgr2=0x5576b6743350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.355+0000 7f77a1c8b640 1 --2- 172.21.15.7:0/1760855938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5576b6742f70 0x5576b6743350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.355+0000 7f77a1c8b640 1 -- 172.21.15.7:0/1760855938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576b6458a50 con 0x5576b6713420 2024-04-25T09:59:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.355+0000 7f77a1c8b640 1 --2- 172.21.15.7:0/1760855938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576b6713420 0x5576b673b3f0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f779c0d0860 tx=0x7f77940021a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4dc910125f93a97 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.355+0000 7f7786ffd640 1 -- 172.21.15.7:0/1760855938 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77940075f0 con 0x5576b6713420 2024-04-25T09:59:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.355+0000 7f7786ffd640 1 -- 172.21.15.7:0/1760855938 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7794019070 con 0x5576b6713420 2024-04-25T09:59:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.355+0000 7f7786ffd640 1 -- 172.21.15.7:0/1760855938 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77940079d0 con 0x5576b6713420 2024-04-25T09:59:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.355+0000 7f77a63ef740 1 -- 172.21.15.7:0/1760855938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576b6713420 msgr2=0x5576b673b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.355+0000 7f77a63ef740 1 --2- 172.21.15.7:0/1760855938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576b6713420 0x5576b673b3f0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f779c0d0860 tx=0x7f77940021a0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.355+0000 7f77a63ef740 1 -- 172.21.15.7:0/1760855938 shutdown_connections 2024-04-25T09:59:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.355+0000 7f77a63ef740 1 --2- 172.21.15.7:0/1760855938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576b6713420 0x5576b673b3f0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.355+0000 7f77a63ef740 1 --2- 172.21.15.7:0/1760855938 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5576b6743990 0x5576b6712ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.355+0000 7f77a63ef740 1 --2- 172.21.15.7:0/1760855938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5576b6742f70 0x5576b6743350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.355+0000 7f77a63ef740 1 -- 172.21.15.7:0/1760855938 >> 172.21.15.7:0/1760855938 conn(0x5576b6715360 msgr2=0x5576b675dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.356+0000 7f77a63ef740 1 -- 172.21.15.7:0/1760855938 shutdown_connections 2024-04-25T09:59:39.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.356+0000 7f77a63ef740 1 -- 172.21.15.7:0/1760855938 wait complete. 2024-04-25T09:59:39.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.356+0000 7f77a63ef740 1 -- start start 2024-04-25T09:59:39.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.356+0000 7f77a63ef740 1 Processor -- start 2024-04-25T09:59:39.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.357+0000 7f77a63ef740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5576b6742f70 0x5576b6743fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.357+0000 7f77a63ef740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5576b6743990 0x5576b6734740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.357+0000 7f77a63ef740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576b673b1c0 0x5576b67417d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.357+0000 7f77a63ef740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576b673f6c0 con 0x5576b673b1c0 2024-04-25T09:59:39.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.357+0000 7f77a63ef740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576b661a700 con 0x5576b6742f70 2024-04-25T09:59:39.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.357+0000 7f77a63ef740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5576b673f960 con 0x5576b6743990 2024-04-25T09:59:39.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.357+0000 7f77a63ef740 10 client.0 _ll_register_callbacks cb 0x5576b6672150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:59:39.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.357+0000 7f77a1c8b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576b673b1c0 0x5576b67417d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.357+0000 7f77a1c8b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576b673b1c0 0x5576b67417d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41946/0 (socket says 172.21.15.7:41946) 2024-04-25T09:59:39.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.357+0000 7f77a1c8b640 1 -- 172.21.15.7:0/1381046390 learned_addr learned my addr 172.21.15.7:0/1381046390 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:39.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.357+0000 7f77a148a640 1 --2- 172.21.15.7:0/1381046390 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5576b6742f70 0x5576b6743fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.357+0000 7f77a0c89640 1 --2- 172.21.15.7:0/1381046390 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5576b6743990 0x5576b6734740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.358+0000 7f77a1c8b640 1 -- 172.21.15.7:0/1381046390 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5576b6743990 msgr2=0x5576b6734740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:39.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.358+0000 7f77a1c8b640 1 --2- 172.21.15.7:0/1381046390 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5576b6743990 0x5576b6734740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.358+0000 7f77a1c8b640 1 -- 172.21.15.7:0/1381046390 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5576b6742f70 msgr2=0x5576b6743fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:39.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.358+0000 7f77a1c8b640 1 --2- 172.21.15.7:0/1381046390 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5576b6742f70 0x5576b6743fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.358+0000 7f77a1c8b640 1 -- 172.21.15.7:0/1381046390 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5576b63503e0 con 0x5576b673b1c0 2024-04-25T09:59:39.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.358+0000 7f77a1c8b640 1 --2- 172.21.15.7:0/1381046390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576b673b1c0 0x5576b67417d0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x5576b67145f0 tx=0x7f779c0d2460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319532a9ae0e17a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:39.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.358+0000 7f777bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:59:39.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.358+0000 7f777bfff640 1 -- 172.21.15.7:0/1381046390 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7794014890 con 0x5576b673b1c0 2024-04-25T09:59:39.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.358+0000 7f777bfff640 1 -- 172.21.15.7:0/1381046390 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f7794014a30 con 0x5576b673b1c0 2024-04-25T09:59:39.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.358+0000 7f77a63ef740 1 -- 172.21.15.7:0/1381046390 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7794019070 con 0x5576b673b1c0 2024-04-25T09:59:39.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.358+0000 7f777bfff640 1 -- 172.21.15.7:0/1381046390 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f779402f050 con 0x5576b673b1c0 2024-04-25T09:59:39.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.358+0000 7f77a63ef740 10 client.7266 fetch_fsmap learned FSMap version 44 2024-04-25T09:59:39.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.358+0000 7f77a63ef740 1 -- 172.21.15.7:0/1381046390 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x5576b64b91e0 con 0x5576b673b1c0 2024-04-25T09:59:39.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.358+0000 7f777bfff640 1 -- 172.21.15.7:0/1381046390 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7794019070 con 0x5576b673b1c0 2024-04-25T09:59:39.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.358+0000 7f777bfff640 1 -- 172.21.15.7:0/1381046390 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 44) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7794032020 con 0x5576b673b1c0 2024-04-25T09:59:39.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.358+0000 7f77a63ef740 10 client.7266 fetch_fsmap finished waiting for FSMap version 44 2024-04-25T09:59:39.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.358+0000 7f77a63ef740 10 client.7266 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T09:59:39.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.358+0000 7f77a63ef740 20 client.7266 populate_metadata read hostname 'smithi007' 2024-04-25T09:59:39.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.358+0000 7f77a63ef740 1 --2- 172.21.15.7:0/1381046390 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5576b6741d10 0x5576b6738840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.358+0000 7f77a63ef740 4 client.7266 mds_command: new command op to 6813 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:59:39.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.358+0000 7f77a63ef740 1 -- 172.21.15.7:0/1381046390 --> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5576b66891d0 con 0x5576b6741d10 2024-04-25T09:59:39.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.359+0000 7f77a148a640 1 --2- 172.21.15.7:0/1381046390 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5576b6741d10 0x5576b6738840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.359+0000 7f777bfff640 10 client.7266 ms_handle_connect on v2:172.21.15.7:6836/3690076929 2024-04-25T09:59:39.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.359+0000 7f77a148a640 1 --2- 172.21.15.7:0/1381046390 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5576b6741d10 0x5576b6738840 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6e618009ccf0109 server_cookie=eac739b250208669 in_seq=0 out_seq=0 2024-04-25T09:59:39.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.359+0000 7f777bfff640 1 -- 172.21.15.7:0/1381046390 <== mds.0 v2:172.21.15.7:6836/3690076929 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5576b66891d0 con 0x5576b6741d10 2024-04-25T09:59:39.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.359+0000 7f777bfff640 10 client.7266 handle_command_reply: tid=0 2024-04-25T09:59:39.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.359+0000 7f77a63ef740 1 client.7266 shutdown 2024-04-25T09:59:39.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.359+0000 7f77a63ef740 1 -- 172.21.15.7:0/1381046390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576b673b1c0 msgr2=0x5576b67417d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:39.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.359+0000 7f77a63ef740 1 --2- 172.21.15.7:0/1381046390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576b673b1c0 0x5576b67417d0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x5576b67145f0 tx=0x7f779c0d2460 comp rx=0 tx=0).stop 2024-04-25T09:59:39.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.359+0000 7f77a63ef740 1 -- 172.21.15.7:0/1381046390 shutdown_connections 2024-04-25T09:59:39.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.359+0000 7f77a63ef740 1 --2- 172.21.15.7:0/1381046390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576b673b1c0 0x5576b67417d0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.359+0000 7f77a63ef740 1 --2- 172.21.15.7:0/1381046390 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5576b6743990 0x5576b6734740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.360+0000 7f77a63ef740 1 --2- 172.21.15.7:0/1381046390 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5576b6741d10 0x5576b6738840 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.360+0000 7f77a63ef740 1 --2- 172.21.15.7:0/1381046390 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5576b6742f70 0x5576b6743fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.360+0000 7f777bfff640 0 client.7266 ms_handle_reset on v2:172.21.15.7:6836/3690076929 2024-04-25T09:59:39.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.360+0000 7f77a63ef740 1 -- 172.21.15.7:0/1381046390 >> 172.21.15.7:0/1381046390 conn(0x5576b6713420 msgr2=0x5576b6712680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:39.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.360+0000 7f77a63ef740 1 -- 172.21.15.7:0/1381046390 shutdown_connections 2024-04-25T09:59:39.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.360+0000 7f77a63ef740 1 -- 172.21.15.7:0/1381046390 wait complete. 2024-04-25T09:59:39.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.360+0000 7f77a63ef740 20 client.7266 trim_cache size 0 max 16384 2024-04-25T09:59:39.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.375+0000 7f77a63ef740 1 Processor -- start 2024-04-25T09:59:39.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.375+0000 7f77a63ef740 1 -- start start 2024-04-25T09:59:39.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.376+0000 7f77a63ef740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5576b673b1c0 0x5576b675cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.376+0000 7f77a63ef740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576b6742f70 0x5576b675d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.376+0000 7f77a63ef740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5576b6743990 0x5576b67329f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.376+0000 7f77a63ef740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c200c00 con 0x5576b6742f70 2024-04-25T09:59:39.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.376+0000 7f77a63ef740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c1ffe00 con 0x5576b673b1c0 2024-04-25T09:59:39.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.376+0000 7f77a63ef740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f779c1ff260 con 0x5576b6743990 2024-04-25T09:59:39.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.376+0000 7f77a0c89640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576b6742f70 0x5576b675d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.376+0000 7f77a0c89640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576b6742f70 0x5576b675d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41960/0 (socket says 172.21.15.7:41960) 2024-04-25T09:59:39.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.376+0000 7f77a0c89640 1 -- 172.21.15.7:0/2085264331 learned_addr learned my addr 172.21.15.7:0/2085264331 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:39.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.376+0000 7f77a148a640 1 --2- 172.21.15.7:0/2085264331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5576b673b1c0 0x5576b675cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.376+0000 7f77a1c8b640 1 --2- 172.21.15.7:0/2085264331 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5576b6743990 0x5576b67329f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.376+0000 7f77a0c89640 1 -- 172.21.15.7:0/2085264331 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5576b6743990 msgr2=0x5576b67329f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:39.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.376+0000 7f77a0c89640 1 --2- 172.21.15.7:0/2085264331 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5576b6743990 0x5576b67329f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.376+0000 7f77a0c89640 1 -- 172.21.15.7:0/2085264331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5576b673b1c0 msgr2=0x5576b675cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:39.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.376+0000 7f77a0c89640 1 --2- 172.21.15.7:0/2085264331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5576b673b1c0 0x5576b675cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.376+0000 7f77a0c89640 1 -- 172.21.15.7:0/2085264331 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576b673ca80 con 0x5576b6742f70 2024-04-25T09:59:39.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.376+0000 7f77a1c8b640 1 --2- 172.21.15.7:0/2085264331 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5576b6743990 0x5576b67329f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:59:39.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.376+0000 7f77a0c89640 1 --2- 172.21.15.7:0/2085264331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576b6742f70 0x5576b675d250 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f778c0786b0 tx=0x7f778c046040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4f15e67316b56 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:39.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.376+0000 7f77867fc640 1 -- 172.21.15.7:0/2085264331 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778c0a6070 con 0x5576b6742f70 2024-04-25T09:59:39.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.376+0000 7f77867fc640 1 -- 172.21.15.7:0/2085264331 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778c0790b0 con 0x5576b6742f70 2024-04-25T09:59:39.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.376+0000 7f77867fc640 1 -- 172.21.15.7:0/2085264331 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778c0789b0 con 0x5576b6742f70 2024-04-25T09:59:39.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.377+0000 7f77a63ef740 1 -- 172.21.15.7:0/2085264331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576b6742f70 msgr2=0x5576b675d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:39.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.377+0000 7f77a63ef740 1 --2- 172.21.15.7:0/2085264331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576b6742f70 0x5576b675d250 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f778c0786b0 tx=0x7f778c046040 comp rx=0 tx=0).stop 2024-04-25T09:59:39.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.377+0000 7f77a63ef740 1 -- 172.21.15.7:0/2085264331 shutdown_connections 2024-04-25T09:59:39.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.377+0000 7f77a63ef740 1 --2- 172.21.15.7:0/2085264331 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5576b6743990 0x5576b67329f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.377+0000 7f77a63ef740 1 --2- 172.21.15.7:0/2085264331 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576b6742f70 0x5576b675d250 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.377+0000 7f77a63ef740 1 --2- 172.21.15.7:0/2085264331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5576b673b1c0 0x5576b675cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.377+0000 7f77a63ef740 1 -- 172.21.15.7:0/2085264331 >> 172.21.15.7:0/2085264331 conn(0x5576b6713420 msgr2=0x5576b6746d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:39.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.377+0000 7f77a63ef740 1 -- 172.21.15.7:0/2085264331 shutdown_connections 2024-04-25T09:59:39.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.377+0000 7f77a63ef740 1 -- 172.21.15.7:0/2085264331 wait complete. 2024-04-25T09:59:39.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.377+0000 7f77a63ef740 1 -- start start 2024-04-25T09:59:39.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.378+0000 7f77a63ef740 1 Processor -- start 2024-04-25T09:59:39.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.378+0000 7f77a63ef740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5576b673b1c0 0x5576b67c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.378+0000 7f77a63ef740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5576b6742f70 0x5576b673d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.378+0000 7f77a63ef740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576b6743990 0x5576b673d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.378+0000 7f77a63ef740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576b673bd40 con 0x5576b6743990 2024-04-25T09:59:39.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.378+0000 7f77a63ef740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c1ff800 con 0x5576b673b1c0 2024-04-25T09:59:39.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.378+0000 7f77a63ef740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5576b6732cb0 con 0x5576b6742f70 2024-04-25T09:59:39.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.378+0000 7f77a63ef740 10 client.0 _ll_register_callbacks cb 0x7f7794001250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:59:39.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.379+0000 7f77a1c8b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576b6743990 0x5576b673d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.379+0000 7f77a1c8b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576b6743990 0x5576b673d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41970/0 (socket says 172.21.15.7:41970) 2024-04-25T09:59:39.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.379+0000 7f77a1c8b640 1 -- 172.21.15.7:0/3001813116 learned_addr learned my addr 172.21.15.7:0/3001813116 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:39.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.379+0000 7f77a0c89640 1 --2- 172.21.15.7:0/3001813116 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5576b6742f70 0x5576b673d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.379+0000 7f77a148a640 1 --2- 172.21.15.7:0/3001813116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5576b673b1c0 0x5576b67c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.379+0000 7f77a1c8b640 1 -- 172.21.15.7:0/3001813116 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5576b6742f70 msgr2=0x5576b673d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:39.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.379+0000 7f77a1c8b640 1 --2- 172.21.15.7:0/3001813116 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5576b6742f70 0x5576b673d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.379+0000 7f77a1c8b640 1 -- 172.21.15.7:0/3001813116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5576b673b1c0 msgr2=0x5576b67c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:39.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.379+0000 7f77a1c8b640 1 --2- 172.21.15.7:0/3001813116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5576b673b1c0 0x5576b67c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.379+0000 7f77a1c8b640 1 -- 172.21.15.7:0/3001813116 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5576b63294a0 con 0x5576b6743990 2024-04-25T09:59:39.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.379+0000 7f77a0c89640 1 --2- 172.21.15.7:0/3001813116 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5576b6742f70 0x5576b673d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:59:39.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.379+0000 7f77a1c8b640 1 --2- 172.21.15.7:0/3001813116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576b6743990 0x5576b673d920 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x5576b67145f0 tx=0x7f7794006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea8f11000311acbc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:39.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.379+0000 7f777bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:59:39.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.379+0000 7f777bfff640 1 -- 172.21.15.7:0/3001813116 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779401fd10 con 0x5576b6743990 2024-04-25T09:59:39.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.379+0000 7f777bfff640 1 -- 172.21.15.7:0/3001813116 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f7794027400 con 0x5576b6743990 2024-04-25T09:59:39.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.379+0000 7f77a63ef740 1 -- 172.21.15.7:0/3001813116 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f778c0790b0 con 0x5576b6743990 2024-04-25T09:59:39.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.379+0000 7f777bfff640 1 -- 172.21.15.7:0/3001813116 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7794041050 con 0x5576b6743990 2024-04-25T09:59:39.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.379+0000 7f77a63ef740 10 client.7272 fetch_fsmap learned FSMap version 44 2024-04-25T09:59:39.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.379+0000 7f77a63ef740 1 -- 172.21.15.7:0/3001813116 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x5576b67370f0 con 0x5576b6743990 2024-04-25T09:59:39.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.379+0000 7f777bfff640 1 -- 172.21.15.7:0/3001813116 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778c0790b0 con 0x5576b6743990 2024-04-25T09:59:39.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.380+0000 7f777bfff640 1 -- 172.21.15.7:0/3001813116 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 44) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7794044020 con 0x5576b6743990 2024-04-25T09:59:39.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.380+0000 7f77a63ef740 10 client.7272 fetch_fsmap finished waiting for FSMap version 44 2024-04-25T09:59:39.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.380+0000 7f77a63ef740 10 client.7272 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T09:59:39.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.380+0000 7f77a63ef740 20 client.7272 populate_metadata read hostname 'smithi007' 2024-04-25T09:59:39.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.380+0000 7f77a63ef740 1 --2- 172.21.15.7:0/3001813116 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5576b6719230 0x5576b676c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.380+0000 7f77a63ef740 4 client.7272 mds_command: new command op to 6813 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair", "recursive"]}] 2024-04-25T09:59:39.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.380+0000 7f77a63ef740 1 -- 172.21.15.7:0/3001813116 --> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] -- command(tid 0: {"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair", "recursive"]}) v1 -- 0x5576b6683520 con 0x5576b6719230 2024-04-25T09:59:39.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.380+0000 7f77a148a640 1 --2- 172.21.15.7:0/3001813116 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5576b6719230 0x5576b676c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.380+0000 7f777bfff640 10 client.7272 ms_handle_connect on v2:172.21.15.7:6836/3690076929 2024-04-25T09:59:39.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.380+0000 7f77a148a640 1 --2- 172.21.15.7:0/3001813116 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5576b6719230 0x5576b676c690 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=426b6eba2cb87a7e server_cookie=eaa2032dba78f676 in_seq=0 out_seq=0 2024-04-25T09:59:39.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.381+0000 7f777bfff640 1 -- 172.21.15.7:0/3001813116 <== mds.0 v2:172.21.15.7:6836/3690076929 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5576b6683520 con 0x5576b6719230 2024-04-25T09:59:39.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.381+0000 7f777bfff640 10 client.7272 handle_command_reply: tid=0 2024-04-25T09:59:39.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.381+0000 7f77a63ef740 1 client.7272 shutdown 2024-04-25T09:59:39.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.381+0000 7f77a63ef740 1 -- 172.21.15.7:0/3001813116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576b6743990 msgr2=0x5576b673d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:39.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.381+0000 7f77a63ef740 1 --2- 172.21.15.7:0/3001813116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576b6743990 0x5576b673d920 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x5576b67145f0 tx=0x7f7794006040 comp rx=0 tx=0).stop 2024-04-25T09:59:39.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.381+0000 7f77a63ef740 1 -- 172.21.15.7:0/3001813116 shutdown_connections 2024-04-25T09:59:39.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.381+0000 7f77a63ef740 1 --2- 172.21.15.7:0/3001813116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576b6743990 0x5576b673d920 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.381+0000 7f77a63ef740 1 --2- 172.21.15.7:0/3001813116 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5576b6742f70 0x5576b673d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.381+0000 7f77a63ef740 1 --2- 172.21.15.7:0/3001813116 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5576b6719230 0x5576b676c690 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.381+0000 7f77a63ef740 1 --2- 172.21.15.7:0/3001813116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5576b673b1c0 0x5576b67c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.381+0000 7f777bfff640 0 client.7272 ms_handle_reset on v2:172.21.15.7:6836/3690076929 2024-04-25T09:59:39.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.381+0000 7f77a63ef740 1 -- 172.21.15.7:0/3001813116 >> 172.21.15.7:0/3001813116 conn(0x5576b6713420 msgr2=0x5576b6734550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:39.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.381+0000 7f77a63ef740 1 -- 172.21.15.7:0/3001813116 shutdown_connections 2024-04-25T09:59:39.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.381+0000 7f77a63ef740 1 -- 172.21.15.7:0/3001813116 wait complete. 2024-04-25T09:59:39.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.381+0000 7f77a63ef740 20 client.7272 trim_cache size 0 max 16384 2024-04-25T09:59:39.392 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T09:59:39.392 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-04-25T09:59:39.392 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "0af515b4-6e20-41c2-8e56-8877a0ae385f", 2024-04-25T09:59:39.392 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-04-25T09:59:39.392 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T09:59:39.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.382+0000 7f77a36ee640 1 -- 172.21.15.7:0/416715983 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f778006b500 msgr2=0x7f778006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:39.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.382+0000 7f77a36ee640 1 --2- 172.21.15.7:0/416715983 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f778006b500 0x7f778006d9c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f77980099e0 tx=0x7f7798008040 comp rx=0 tx=0).stop 2024-04-25T09:59:39.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.382+0000 7f77a36ee640 1 -- 172.21.15.7:0/416715983 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f779c154fb0 msgr2=0x7f779c14b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:39.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.382+0000 7f77a36ee640 1 --2- 172.21.15.7:0/416715983 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f779c154fb0 0x7f779c14b5b0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f778c0019c0 tx=0x7f778c0012d0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.382+0000 7f77a36ee640 1 -- 172.21.15.7:0/416715983 shutdown_connections 2024-04-25T09:59:39.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.382+0000 7f77a36ee640 1 --2- 172.21.15.7:0/416715983 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f778006b500 0x7f778006d9c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.382+0000 7f77a36ee640 1 --2- 172.21.15.7:0/416715983 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f779c14baf0 0x7f779c14bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.382+0000 7f77a36ee640 1 --2- 172.21.15.7:0/416715983 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f779c154fb0 0x7f779c14b5b0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.382+0000 7f77a36ee640 1 --2- 172.21.15.7:0/416715983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77880040d0 0x7f779c0b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.382+0000 7f77a36ee640 1 -- 172.21.15.7:0/416715983 >> 172.21.15.7:0/416715983 conn(0x7f779c0726b0 msgr2=0x7f779c0b8050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:39.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.382+0000 7f77a36ee640 1 -- 172.21.15.7:0/416715983 shutdown_connections 2024-04-25T09:59:39.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.382+0000 7f77a36ee640 1 -- 172.21.15.7:0/416715983 wait complete. 2024-04-25T09:59:39.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:59:39.396 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-25T09:59:39.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.495+0000 7f2ac2b53640 1 Processor -- start 2024-04-25T09:59:39.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.495+0000 7f2ac2b53640 1 -- start start 2024-04-25T09:59:39.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.496+0000 7f2ac2b53640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2abc06d130 0x7f2abc071130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.496+0000 7f2ac2b53640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2abc1453c0 con 0x7f2abc071670 2024-04-25T09:59:39.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.496+0000 7f2ac2b53640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2abc06d6a0 con 0x7f2abc144fe0 2024-04-25T09:59:39.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.496+0000 7f2ac2b53640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc0a8560 con 0x7f2abc06d130 2024-04-25T09:59:39.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.496+0000 7f2ac10f0640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2abc071670 0x7f2abc15c370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54218/0 (socket says 172.21.15.7:54218) 2024-04-25T09:59:39.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.496+0000 7f2ac10f0640 1 -- 172.21.15.7:0/284731559 learned_addr learned my addr 172.21.15.7:0/284731559 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T09:59:39.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.496+0000 7f2abbfff640 1 --2- 172.21.15.7:0/284731559 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2abc06d130 0x7f2abc071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.496+0000 7f2abb7fe640 1 -- 172.21.15.7:0/284731559 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 233367274 0 0) 0x7f2abc1453c0 con 0x7f2abc071670 2024-04-25T09:59:39.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.496+0000 7f2abb7fe640 1 -- 172.21.15.7:0/284731559 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2aac003520 con 0x7f2abc071670 2024-04-25T09:59:39.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.496+0000 7f2abb7fe640 1 -- 172.21.15.7:0/284731559 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 981512508 0 0) 0x7f2aac003520 con 0x7f2abc071670 2024-04-25T09:59:39.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.496+0000 7f2abb7fe640 1 -- 172.21.15.7:0/284731559 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2abc06d130 msgr2=0x7f2abc071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:39.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.496+0000 7f2abb7fe640 1 --2- 172.21.15.7:0/284731559 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2abc06d130 0x7f2abc071130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.496+0000 7f2abb7fe640 1 -- 172.21.15.7:0/284731559 >> v1:172.21.15.55:6789/0 conn(0x7f2abc144fe0 legacy=0x7f2abc06e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:39.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.497+0000 7f2abb7fe640 1 -- 172.21.15.7:0/284731559 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2abc06d980 con 0x7f2abc071670 2024-04-25T09:59:39.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.497+0000 7f2abb7fe640 1 -- 172.21.15.7:0/284731559 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f2ab40019f0 con 0x7f2abc071670 2024-04-25T09:59:39.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.497+0000 7f2abb7fe640 1 -- 172.21.15.7:0/284731559 >> v1:172.21.15.7:6789/0 conn(0x7f2abc071670 legacy=0x7f2abc15c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:39.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.497+0000 7f2abb7fe640 1 --2- 172.21.15.7:0/284731559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2aac0039e0 0x7f2aac003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.497+0000 7f2abb7fe640 1 --2- 172.21.15.7:0/284731559 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2aac004800 0x7f2aac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.497+0000 7f2abb7fe640 1 --2- 172.21.15.7:0/284731559 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2abc06d130 0x7f2aac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.497+0000 7f2abb7fe640 1 -- 172.21.15.7:0/284731559 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac00ba70 con 0x7f2aac004800 2024-04-25T09:59:39.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.497+0000 7f2abb7fe640 1 -- 172.21.15.7:0/284731559 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac00bc20 con 0x7f2aac0039e0 2024-04-25T09:59:39.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.497+0000 7f2abb7fe640 1 -- 172.21.15.7:0/284731559 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac00be20 con 0x7f2abc06d130 2024-04-25T09:59:39.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.497+0000 7f2abbfff640 1 --2- 172.21.15.7:0/284731559 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2aac004800 0x7f2aac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.497+0000 7f2ac08ef640 1 --2- 172.21.15.7:0/284731559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2aac0039e0 0x7f2aac003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.497+0000 7f2ac10f0640 1 --2- 172.21.15.7:0/284731559 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2abc06d130 0x7f2aac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.497+0000 7f2abbfff640 1 -- 172.21.15.7:0/284731559 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2abc06d130 msgr2=0x7f2aac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:39.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.497+0000 7f2abbfff640 1 --2- 172.21.15.7:0/284731559 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2abc06d130 0x7f2aac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.497+0000 7f2abbfff640 1 -- 172.21.15.7:0/284731559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2aac0039e0 msgr2=0x7f2aac003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:39.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.497+0000 7f2abbfff640 1 --2- 172.21.15.7:0/284731559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2aac0039e0 0x7f2aac003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.497+0000 7f2abbfff640 1 -- 172.21.15.7:0/284731559 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aac003520 con 0x7f2aac004800 2024-04-25T09:59:39.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.498+0000 7f2abbfff640 1 --2- 172.21.15.7:0/284731559 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2aac004800 0x7f2aac004c80 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009a90 tx=0x7f2aac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=808c9fb19e604d36 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:39.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.498+0000 7f2abb7fe640 1 -- 172.21.15.7:0/284731559 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8036070 con 0x7f2aac004800 2024-04-25T09:59:39.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.498+0000 7f2abb7fe640 1 -- 172.21.15.7:0/284731559 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa8031400 con 0x7f2aac004800 2024-04-25T09:59:39.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.498+0000 7f2abb7fe640 1 -- 172.21.15.7:0/284731559 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8009690 con 0x7f2aac004800 2024-04-25T09:59:39.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.498+0000 7f2ac2b53640 1 -- 172.21.15.7:0/284731559 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2aac004800 msgr2=0x7f2aac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:39.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.498+0000 7f2ac2b53640 1 --2- 172.21.15.7:0/284731559 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2aac004800 0x7f2aac004c80 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009a90 tx=0x7f2aac005830 comp rx=0 tx=0).stop 2024-04-25T09:59:39.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.498+0000 7f2ac10f0640 1 -- 172.21.15.7:0/284731559 reap_dead start 2024-04-25T09:59:39.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.498+0000 7f2ac2b53640 1 -- 172.21.15.7:0/284731559 shutdown_connections 2024-04-25T09:59:39.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.498+0000 7f2ac2b53640 1 -- 172.21.15.7:0/284731559 >> 172.21.15.7:0/284731559 conn(0x7f2abc06ab60 msgr2=0x7f2abc06af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:39.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.499+0000 7f2ac2b53640 1 -- 172.21.15.7:0/284731559 shutdown_connections 2024-04-25T09:59:39.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.499+0000 7f2ac2b53640 1 -- 172.21.15.7:0/284731559 wait complete. 2024-04-25T09:59:39.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.500+0000 7f2ac2b53640 1 Processor -- start 2024-04-25T09:59:39.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.500+0000 7f2ac2b53640 1 -- start start 2024-04-25T09:59:39.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.501+0000 7f2ac2b53640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2aac004800 0x7f2abc138030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.501+0000 7f2ac2b53640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2abc13ff40 0x7f2abc141950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.501+0000 7f2ac2b53640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2abc141e90 0x7f2abc142320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.501+0000 7f2ac2b53640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc15be50 con 0x7f2abc13ff40 2024-04-25T09:59:39.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.501+0000 7f2ac2b53640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc06df40 con 0x7f2abc141e90 2024-04-25T09:59:39.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.501+0000 7f2ac2b53640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc071130 con 0x7f2aac004800 2024-04-25T09:59:39.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.501+0000 7f2abbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2abc13ff40 0x7f2abc141950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.501+0000 7f2abbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2abc13ff40 0x7f2abc141950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41974/0 (socket says 172.21.15.7:41974) 2024-04-25T09:59:39.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.501+0000 7f2abbfff640 1 -- 172.21.15.7:0/3482539424 learned_addr learned my addr 172.21.15.7:0/3482539424 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:39.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.501+0000 7f2ac10f0640 1 --2- 172.21.15.7:0/3482539424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2abc141e90 0x7f2abc142320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.501+0000 7f2ac08ef640 1 --2- 172.21.15.7:0/3482539424 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2aac004800 0x7f2abc138030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.501+0000 7f2abbfff640 1 -- 172.21.15.7:0/3482539424 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2aac004800 msgr2=0x7f2abc138030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:39.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.501+0000 7f2abbfff640 1 --2- 172.21.15.7:0/3482539424 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2aac004800 0x7f2abc138030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.501+0000 7f2abbfff640 1 -- 172.21.15.7:0/3482539424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2abc141e90 msgr2=0x7f2abc142320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:39.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.501+0000 7f2abbfff640 1 --2- 172.21.15.7:0/3482539424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2abc141e90 0x7f2abc142320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.501+0000 7f2abbfff640 1 -- 172.21.15.7:0/3482539424 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2abc1e5570 con 0x7f2abc13ff40 2024-04-25T09:59:39.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.501+0000 7f2abbfff640 1 --2- 172.21.15.7:0/3482539424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2abc13ff40 0x7f2abc141950 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8034040 tx=0x7f2aa8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:39.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.501+0000 7f2ab97fa640 1 -- 172.21.15.7:0/3482539424 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8041020 con 0x7f2abc13ff40 2024-04-25T09:59:39.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.501+0000 7f2ab97fa640 1 -- 172.21.15.7:0/3482539424 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa803c470 con 0x7f2abc13ff40 2024-04-25T09:59:39.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.501+0000 7f2ac2b53640 1 -- 172.21.15.7:0/3482539424 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2abc142860 con 0x7f2abc13ff40 2024-04-25T09:59:39.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.501+0000 7f2ab97fa640 1 -- 172.21.15.7:0/3482539424 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8036040 con 0x7f2abc13ff40 2024-04-25T09:59:39.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.502+0000 7f2ac2b53640 1 -- 172.21.15.7:0/3482539424 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2abc0af720 con 0x7f2abc13ff40 2024-04-25T09:59:39.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.503+0000 7f2ab97fa640 1 -- 172.21.15.7:0/3482539424 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2aa8044020 con 0x7f2abc13ff40 2024-04-25T09:59:39.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.504+0000 7f2ab97fa640 1 --2- 172.21.15.7:0/3482539424 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2aa006b4d0 0x7f2aa006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.504+0000 7f2ac08ef640 1 --2- 172.21.15.7:0/3482539424 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2aa006b4d0 0x7f2aa006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.504+0000 7f2ab97fa640 1 -- 172.21.15.7:0/3482539424 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f2aa80aa780 con 0x7f2abc13ff40 2024-04-25T09:59:39.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.504+0000 7f2ac08ef640 1 --2- 172.21.15.7:0/3482539424 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2aa006b4d0 0x7f2aa006d990 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2abc143470 tx=0x7f2ab0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:39.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.505+0000 7f2ac5851740 1 Processor -- start 2024-04-25T09:59:39.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.505+0000 7f2ac5851740 1 -- start start 2024-04-25T09:59:39.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.505+0000 7f2ac5851740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5563b175ab10 0x5563b175d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.505+0000 7f2ac5851740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5563b175aef0 0x5563b175d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.505+0000 7f2ac5851740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563b172d770 0x5563b1730f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.505+0000 7f2ac5851740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563b1696da0 con 0x5563b172d770 2024-04-25T09:59:39.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.505+0000 7f2ac5851740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563b163fb80 con 0x5563b175ab10 2024-04-25T09:59:39.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.505+0000 7f2ac5851740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5563b1692e40 con 0x5563b175aef0 2024-04-25T09:59:39.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.506+0000 7f2ac10f0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563b172d770 0x5563b1730f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.506+0000 7f2ac10f0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563b172d770 0x5563b1730f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41988/0 (socket says 172.21.15.7:41988) 2024-04-25T09:59:39.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.506+0000 7f2ac10f0640 1 -- 172.21.15.7:0/4241360488 learned_addr learned my addr 172.21.15.7:0/4241360488 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:39.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.506+0000 7f2ac08ef640 1 --2- 172.21.15.7:0/4241360488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5563b175ab10 0x5563b175d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.506+0000 7f2abbfff640 1 --2- 172.21.15.7:0/4241360488 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5563b175aef0 0x5563b175d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.506+0000 7f2ac10f0640 1 -- 172.21.15.7:0/4241360488 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5563b175aef0 msgr2=0x5563b175d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:39.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.506+0000 7f2ac10f0640 1 --2- 172.21.15.7:0/4241360488 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5563b175aef0 0x5563b175d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.506+0000 7f2ac10f0640 1 -- 172.21.15.7:0/4241360488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5563b175ab10 msgr2=0x5563b175d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:39.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.506+0000 7f2ac10f0640 1 --2- 172.21.15.7:0/4241360488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5563b175ab10 0x5563b175d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.506+0000 7f2ac10f0640 1 -- 172.21.15.7:0/4241360488 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563b1649f10 con 0x5563b172d770 2024-04-25T09:59:39.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.506+0000 7f2ac08ef640 1 --2- 172.21.15.7:0/4241360488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5563b175ab10 0x5563b175d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:59:39.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.506+0000 7f2abbfff640 1 --2- 172.21.15.7:0/4241360488 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5563b175aef0 0x5563b175d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:59:39.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.506+0000 7f2ac10f0640 1 --2- 172.21.15.7:0/4241360488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563b172d770 0x5563b1730f80 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f2abc072180 tx=0x7f2ab400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f4e8406fa4389da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:39.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.506+0000 7f2aa67fc640 1 -- 172.21.15.7:0/4241360488 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab401a030 con 0x5563b172d770 2024-04-25T09:59:39.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.506+0000 7f2aa67fc640 1 -- 172.21.15.7:0/4241360488 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab4015440 con 0x5563b172d770 2024-04-25T09:59:39.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.506+0000 7f2aa67fc640 1 -- 172.21.15.7:0/4241360488 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4015610 con 0x5563b172d770 2024-04-25T09:59:39.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.507+0000 7f2ac5851740 1 -- 172.21.15.7:0/4241360488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563b172d770 msgr2=0x5563b1730f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:39.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.507+0000 7f2ac5851740 1 --2- 172.21.15.7:0/4241360488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563b172d770 0x5563b1730f80 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f2abc072180 tx=0x7f2ab400a060 comp rx=0 tx=0).stop 2024-04-25T09:59:39.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.507+0000 7f2ac5851740 1 -- 172.21.15.7:0/4241360488 shutdown_connections 2024-04-25T09:59:39.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.507+0000 7f2ac5851740 1 --2- 172.21.15.7:0/4241360488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563b172d770 0x5563b1730f80 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.507+0000 7f2ac5851740 1 --2- 172.21.15.7:0/4241360488 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5563b175aef0 0x5563b175d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.507+0000 7f2ac5851740 1 --2- 172.21.15.7:0/4241360488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5563b175ab10 0x5563b175d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.507+0000 7f2ac5851740 1 -- 172.21.15.7:0/4241360488 >> 172.21.15.7:0/4241360488 conn(0x5563b172f9e0 msgr2=0x5563b1778320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:39.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.507+0000 7f2ac5851740 1 -- 172.21.15.7:0/4241360488 shutdown_connections 2024-04-25T09:59:39.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.507+0000 7f2ac5851740 1 -- 172.21.15.7:0/4241360488 wait complete. 2024-04-25T09:59:39.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.507+0000 7f2ac5851740 1 -- start start 2024-04-25T09:59:39.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.508+0000 7f2ac5851740 1 Processor -- start 2024-04-25T09:59:39.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.508+0000 7f2ac5851740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563b175ab10 0x5563b1754910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.508+0000 7f2ac5851740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5563b175aef0 0x5563b1779870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.508+0000 7f2ac5851740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5563b1775200 0x5563b1759190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.508+0000 7f2ac5851740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563b1732b90 con 0x5563b175ab10 2024-04-25T09:59:39.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.508+0000 7f2ac5851740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563b16354b0 con 0x5563b175aef0 2024-04-25T09:59:39.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.508+0000 7f2ac5851740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5563b1732e70 con 0x5563b1775200 2024-04-25T09:59:39.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.508+0000 7f2ac5851740 10 client.0 _ll_register_callbacks cb 0x5563b1675180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:59:39.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.509+0000 7f2ac08ef640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563b175ab10 0x5563b1754910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.509+0000 7f2ac08ef640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563b175ab10 0x5563b1754910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42000/0 (socket says 172.21.15.7:42000) 2024-04-25T09:59:39.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.509+0000 7f2ac08ef640 1 -- 172.21.15.7:0/2127808851 learned_addr learned my addr 172.21.15.7:0/2127808851 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:39.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.509+0000 7f2abbfff640 1 --2- 172.21.15.7:0/2127808851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5563b175aef0 0x5563b1779870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.509+0000 7f2ac10f0640 1 --2- 172.21.15.7:0/2127808851 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5563b1775200 0x5563b1759190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.509+0000 7f2ac08ef640 1 -- 172.21.15.7:0/2127808851 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5563b1775200 msgr2=0x5563b1759190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:39.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.509+0000 7f2ac08ef640 1 --2- 172.21.15.7:0/2127808851 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5563b1775200 0x5563b1759190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.509+0000 7f2ac08ef640 1 -- 172.21.15.7:0/2127808851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5563b175aef0 msgr2=0x5563b1779870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:39.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.509+0000 7f2ac08ef640 1 --2- 172.21.15.7:0/2127808851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5563b175aef0 0x5563b1779870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.509+0000 7f2ac08ef640 1 -- 172.21.15.7:0/2127808851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5563b14757d0 con 0x5563b175ab10 2024-04-25T09:59:39.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.509+0000 7f2ac08ef640 1 --2- 172.21.15.7:0/2127808851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563b175ab10 0x5563b1754910 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f2ab00156a0 tx=0x7f2ab0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906374f9a19ddc45 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:39.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.509+0000 7f2a9b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:59:39.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.509+0000 7f2a9b7fe640 1 -- 172.21.15.7:0/2127808851 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab0019070 con 0x5563b175ab10 2024-04-25T09:59:39.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.509+0000 7f2a9b7fe640 1 -- 172.21.15.7:0/2127808851 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f2ab0007240 con 0x5563b175ab10 2024-04-25T09:59:39.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.509+0000 7f2ac5851740 1 -- 172.21.15.7:0/2127808851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2ab4015440 con 0x5563b175ab10 2024-04-25T09:59:39.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.509+0000 7f2a9b7fe640 1 -- 172.21.15.7:0/2127808851 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ab002f050 con 0x5563b175ab10 2024-04-25T09:59:39.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.509+0000 7f2ac5851740 10 client.7284 fetch_fsmap learned FSMap version 44 2024-04-25T09:59:39.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.509+0000 7f2ac5851740 1 -- 172.21.15.7:0/2127808851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x5563b13ab3f0 con 0x5563b175ab10 2024-04-25T09:59:39.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.510+0000 7f2a9b7fe640 1 -- 172.21.15.7:0/2127808851 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab4015440 con 0x5563b175ab10 2024-04-25T09:59:39.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.510+0000 7f2a9b7fe640 1 -- 172.21.15.7:0/2127808851 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 44) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2ab0032020 con 0x5563b175ab10 2024-04-25T09:59:39.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.510+0000 7f2ac5851740 10 client.7284 fetch_fsmap finished waiting for FSMap version 44 2024-04-25T09:59:39.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.510+0000 7f2ac5851740 10 client.7284 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T09:59:39.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.510+0000 7f2ac5851740 20 client.7284 populate_metadata read hostname 'smithi007' 2024-04-25T09:59:39.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.510+0000 7f2ac5851740 1 --2- 172.21.15.7:0/2127808851 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5563b1770920 0x5563b1772950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.510+0000 7f2ac5851740 4 client.7284 mds_command: new command op to 6813 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:59:39.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.510+0000 7f2ac5851740 1 -- 172.21.15.7:0/2127808851 --> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5563b16a42e0 con 0x5563b1770920 2024-04-25T09:59:39.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.510+0000 7f2abbfff640 1 --2- 172.21.15.7:0/2127808851 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5563b1770920 0x5563b1772950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.510+0000 7f2abbfff640 1 --2- 172.21.15.7:0/2127808851 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5563b1770920 0x5563b1772950 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=222cd205d06e2c71 server_cookie=583a2d17c5e5b209 in_seq=0 out_seq=0 2024-04-25T09:59:39.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.510+0000 7f2a9b7fe640 10 client.7284 ms_handle_connect on v2:172.21.15.7:6836/3690076929 2024-04-25T09:59:39.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.511+0000 7f2a9b7fe640 1 -- 172.21.15.7:0/2127808851 <== mds.0 v2:172.21.15.7:6836/3690076929 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5563b16a42e0 con 0x5563b1770920 2024-04-25T09:59:39.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.511+0000 7f2a9b7fe640 10 client.7284 handle_command_reply: tid=0 2024-04-25T09:59:39.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.511+0000 7f2ac5851740 1 client.7284 shutdown 2024-04-25T09:59:39.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.511+0000 7f2ac5851740 1 -- 172.21.15.7:0/2127808851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563b175ab10 msgr2=0x5563b1754910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:39.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.511+0000 7f2ac5851740 1 --2- 172.21.15.7:0/2127808851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563b175ab10 0x5563b1754910 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f2ab00156a0 tx=0x7f2ab0001120 comp rx=0 tx=0).stop 2024-04-25T09:59:39.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.511+0000 7f2ac5851740 1 -- 172.21.15.7:0/2127808851 shutdown_connections 2024-04-25T09:59:39.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.511+0000 7f2ac5851740 1 --2- 172.21.15.7:0/2127808851 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5563b1775200 0x5563b1759190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.511+0000 7f2ac5851740 1 --2- 172.21.15.7:0/2127808851 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5563b1770920 0x5563b1772950 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.511+0000 7f2ac5851740 1 --2- 172.21.15.7:0/2127808851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5563b175aef0 0x5563b1779870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.511+0000 7f2ac5851740 1 --2- 172.21.15.7:0/2127808851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563b175ab10 0x5563b1754910 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.511+0000 7f2ac5851740 1 -- 172.21.15.7:0/2127808851 >> 172.21.15.7:0/2127808851 conn(0x5563b172d770 msgr2=0x5563b1755380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:39.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.511+0000 7f2a9b7fe640 0 client.7284 ms_handle_reset on v2:172.21.15.7:6836/3690076929 2024-04-25T09:59:39.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.511+0000 7f2ac5851740 1 -- 172.21.15.7:0/2127808851 shutdown_connections 2024-04-25T09:59:39.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.511+0000 7f2ac5851740 1 -- 172.21.15.7:0/2127808851 wait complete. 2024-04-25T09:59:39.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.511+0000 7f2ac5851740 20 client.7284 trim_cache size 0 max 16384 2024-04-25T09:59:39.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.526+0000 7f2ac5851740 1 Processor -- start 2024-04-25T09:59:39.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.526+0000 7f2ac5851740 1 -- start start 2024-04-25T09:59:39.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.527+0000 7f2ac5851740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5563b175ab10 0x5563b17746e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.527+0000 7f2ac5851740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5563b175aef0 0x5563b1773b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.527+0000 7f2ac5851740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563b1775200 0x5563b1778320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.527+0000 7f2ac5851740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc200c10 con 0x5563b1775200 2024-04-25T09:59:39.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.527+0000 7f2ac5851740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc1ffda0 con 0x5563b175aef0 2024-04-25T09:59:39.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.527+0000 7f2ac5851740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc0b0ee0 con 0x5563b175ab10 2024-04-25T09:59:39.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.527+0000 7f2ac10f0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563b1775200 0x5563b1778320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.527+0000 7f2ac10f0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563b1775200 0x5563b1778320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42002/0 (socket says 172.21.15.7:42002) 2024-04-25T09:59:39.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.527+0000 7f2ac10f0640 1 -- 172.21.15.7:0/4022763508 learned_addr learned my addr 172.21.15.7:0/4022763508 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:39.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.527+0000 7f2abbfff640 1 --2- 172.21.15.7:0/4022763508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5563b175aef0 0x5563b1773b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.527+0000 7f2ac08ef640 1 --2- 172.21.15.7:0/4022763508 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5563b175ab10 0x5563b17746e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.527+0000 7f2ac10f0640 1 -- 172.21.15.7:0/4022763508 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5563b175ab10 msgr2=0x5563b17746e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:39.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.527+0000 7f2ac10f0640 1 --2- 172.21.15.7:0/4022763508 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5563b175ab10 0x5563b17746e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.527+0000 7f2ac10f0640 1 -- 172.21.15.7:0/4022763508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5563b175aef0 msgr2=0x5563b1773b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:39.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.527+0000 7f2ac10f0640 1 --2- 172.21.15.7:0/4022763508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5563b175aef0 0x5563b1773b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.527+0000 7f2ac10f0640 1 -- 172.21.15.7:0/4022763508 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563b136b0f0 con 0x5563b1775200 2024-04-25T09:59:39.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.528+0000 7f2ac10f0640 1 --2- 172.21.15.7:0/4022763508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563b1775200 0x5563b1778320 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f2abc0af290 tx=0x7f2ab400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7475f7058782f7cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:39.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.528+0000 7f2aa5ffb640 1 -- 172.21.15.7:0/4022763508 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4016860 con 0x5563b1775200 2024-04-25T09:59:39.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.528+0000 7f2aa5ffb640 1 -- 172.21.15.7:0/4022763508 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab4016a20 con 0x5563b1775200 2024-04-25T09:59:39.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.528+0000 7f2aa5ffb640 1 -- 172.21.15.7:0/4022763508 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4016e10 con 0x5563b1775200 2024-04-25T09:59:39.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.528+0000 7f2ac5851740 1 -- 172.21.15.7:0/4022763508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563b1775200 msgr2=0x5563b1778320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:39.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.528+0000 7f2ac5851740 1 --2- 172.21.15.7:0/4022763508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563b1775200 0x5563b1778320 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f2abc0af290 tx=0x7f2ab400f000 comp rx=0 tx=0).stop 2024-04-25T09:59:39.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.528+0000 7f2ac5851740 1 -- 172.21.15.7:0/4022763508 shutdown_connections 2024-04-25T09:59:39.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.528+0000 7f2ac5851740 1 --2- 172.21.15.7:0/4022763508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563b1775200 0x5563b1778320 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.528+0000 7f2ac5851740 1 --2- 172.21.15.7:0/4022763508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5563b175aef0 0x5563b1773b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.528+0000 7f2ac5851740 1 --2- 172.21.15.7:0/4022763508 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5563b175ab10 0x5563b17746e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.528+0000 7f2ac5851740 1 -- 172.21.15.7:0/4022763508 >> 172.21.15.7:0/4022763508 conn(0x5563b172d770 msgr2=0x5563b1754720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:39.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.528+0000 7f2ac5851740 1 -- 172.21.15.7:0/4022763508 shutdown_connections 2024-04-25T09:59:39.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.528+0000 7f2ac5851740 1 -- 172.21.15.7:0/4022763508 wait complete. 2024-04-25T09:59:39.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.529+0000 7f2ac5851740 1 -- start start 2024-04-25T09:59:39.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.529+0000 7f2ac5851740 1 Processor -- start 2024-04-25T09:59:39.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.530+0000 7f2ac5851740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5563b175ab10 0x5563b17e1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.530+0000 7f2ac5851740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563b175aef0 0x5563b1759a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.530+0000 7f2ac5851740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5563b1775200 0x5563b1759fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.530+0000 7f2ac5851740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563b1734ba0 con 0x5563b175aef0 2024-04-25T09:59:39.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.530+0000 7f2ac5851740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc1ff7a0 con 0x5563b1775200 2024-04-25T09:59:39.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.530+0000 7f2ac5851740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5563b172d170 con 0x5563b175ab10 2024-04-25T09:59:39.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.530+0000 7f2ac5851740 10 client.0 _ll_register_callbacks cb 0x7f2ab0001600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:59:39.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.530+0000 7f2abbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563b175aef0 0x5563b1759a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.530+0000 7f2abbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563b175aef0 0x5563b1759a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42012/0 (socket says 172.21.15.7:42012) 2024-04-25T09:59:39.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.530+0000 7f2abbfff640 1 -- 172.21.15.7:0/1045989834 learned_addr learned my addr 172.21.15.7:0/1045989834 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T09:59:39.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.530+0000 7f2ac08ef640 1 --2- 172.21.15.7:0/1045989834 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5563b175ab10 0x5563b17e1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.530+0000 7f2ac10f0640 1 --2- 172.21.15.7:0/1045989834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5563b1775200 0x5563b1759fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.530+0000 7f2abbfff640 1 -- 172.21.15.7:0/1045989834 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5563b175ab10 msgr2=0x5563b17e1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:39.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.530+0000 7f2abbfff640 1 --2- 172.21.15.7:0/1045989834 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5563b175ab10 0x5563b17e1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.530+0000 7f2abbfff640 1 -- 172.21.15.7:0/1045989834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5563b1775200 msgr2=0x5563b1759fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:59:39.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.530+0000 7f2abbfff640 1 --2- 172.21.15.7:0/1045989834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5563b1775200 0x5563b1759fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.530+0000 7f2abbfff640 1 -- 172.21.15.7:0/1045989834 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5563b1771460 con 0x5563b175aef0 2024-04-25T09:59:39.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.530+0000 7f2ac08ef640 1 --2- 172.21.15.7:0/1045989834 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5563b175ab10 0x5563b17e1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:59:39.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.530+0000 7f2ac10f0640 1 --2- 172.21.15.7:0/1045989834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5563b1775200 0x5563b1759fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:59:39.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.530+0000 7f2abbfff640 1 --2- 172.21.15.7:0/1045989834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563b175aef0 0x5563b1759a60 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8078d60 tx=0x7f2aa80aa040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87804084cc18ca55 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:59:39.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.530+0000 7f2a9b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T09:59:39.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.531+0000 7f2a9b7fe640 1 -- 172.21.15.7:0/1045989834 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8095060 con 0x5563b175aef0 2024-04-25T09:59:39.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.531+0000 7f2a9b7fe640 1 -- 172.21.15.7:0/1045989834 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f2aa8009690 con 0x5563b175aef0 2024-04-25T09:59:39.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.531+0000 7f2ac5851740 1 -- 172.21.15.7:0/1045989834 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2ab4016a20 con 0x5563b175aef0 2024-04-25T09:59:39.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.531+0000 7f2a9b7fe640 1 -- 172.21.15.7:0/1045989834 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2aa809c050 con 0x5563b175aef0 2024-04-25T09:59:39.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.531+0000 7f2ac5851740 10 client.7290 fetch_fsmap learned FSMap version 44 2024-04-25T09:59:39.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.531+0000 7f2ac5851740 1 -- 172.21.15.7:0/1045989834 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x5563b178b260 con 0x5563b175aef0 2024-04-25T09:59:39.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.531+0000 7f2a9b7fe640 1 -- 172.21.15.7:0/1045989834 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab4016a20 con 0x5563b175aef0 2024-04-25T09:59:39.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.531+0000 7f2a9b7fe640 1 -- 172.21.15.7:0/1045989834 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 44) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2aa808cce0 con 0x5563b175aef0 2024-04-25T09:59:39.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.531+0000 7f2ac5851740 10 client.7290 fetch_fsmap finished waiting for FSMap version 44 2024-04-25T09:59:39.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.531+0000 7f2ac5851740 10 client.7290 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T09:59:39.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.531+0000 7f2ac5851740 20 client.7290 populate_metadata read hostname 'smithi007' 2024-04-25T09:59:39.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.531+0000 7f2ac5851740 1 --2- 172.21.15.7:0/1045989834 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5563b17916d0 0x5563b177a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:59:39.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.531+0000 7f2ac5851740 4 client.7290 mds_command: new command op to 6813 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:59:39.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.531+0000 7f2ac5851740 1 -- 172.21.15.7:0/1045989834 --> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5563b1733b10 con 0x5563b17916d0 2024-04-25T09:59:39.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.531+0000 7f2ac08ef640 1 --2- 172.21.15.7:0/1045989834 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5563b17916d0 0x5563b177a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:59:39.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.531+0000 7f2a9b7fe640 10 client.7290 ms_handle_connect on v2:172.21.15.7:6836/3690076929 2024-04-25T09:59:39.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.531+0000 7f2ac08ef640 1 --2- 172.21.15.7:0/1045989834 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5563b17916d0 0x5563b177a300 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4dcef5a365af450 server_cookie=9fddef29478bce06 in_seq=0 out_seq=0 2024-04-25T09:59:39.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.532+0000 7f2a9b7fe640 1 -- 172.21.15.7:0/1045989834 <== mds.0 v2:172.21.15.7:6836/3690076929 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+266 (crc 0 0 0) 0x5563b1733b10 con 0x5563b17916d0 2024-04-25T09:59:39.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.532+0000 7f2a9b7fe640 10 client.7290 handle_command_reply: tid=0 2024-04-25T09:59:39.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.532+0000 7f2ac5851740 1 client.7290 shutdown 2024-04-25T09:59:39.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.532+0000 7f2ac5851740 1 -- 172.21.15.7:0/1045989834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563b175aef0 msgr2=0x5563b1759a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:39.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.532+0000 7f2ac5851740 1 --2- 172.21.15.7:0/1045989834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563b175aef0 0x5563b1759a60 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8078d60 tx=0x7f2aa80aa040 comp rx=0 tx=0).stop 2024-04-25T09:59:39.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.532+0000 7f2ac5851740 1 -- 172.21.15.7:0/1045989834 shutdown_connections 2024-04-25T09:59:39.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.532+0000 7f2ac5851740 1 --2- 172.21.15.7:0/1045989834 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5563b17916d0 0x5563b177a300 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.532+0000 7f2ac5851740 1 --2- 172.21.15.7:0/1045989834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5563b1775200 0x5563b1759fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.532+0000 7f2ac5851740 1 --2- 172.21.15.7:0/1045989834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5563b175aef0 0x5563b1759a60 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.532+0000 7f2a9b7fe640 0 client.7290 ms_handle_reset on v2:172.21.15.7:6836/3690076929 2024-04-25T09:59:39.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.532+0000 7f2ac5851740 1 --2- 172.21.15.7:0/1045989834 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5563b175ab10 0x5563b17e1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.532+0000 7f2ac5851740 1 -- 172.21.15.7:0/1045989834 >> 172.21.15.7:0/1045989834 conn(0x5563b172d770 msgr2=0x5563b1772050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:39.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.532+0000 7f2ac5851740 1 -- 172.21.15.7:0/1045989834 shutdown_connections 2024-04-25T09:59:39.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.532+0000 7f2ac5851740 1 -- 172.21.15.7:0/1045989834 wait complete. 2024-04-25T09:59:39.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.532+0000 7f2ac5851740 20 client.7290 trim_cache size 0 max 16384 2024-04-25T09:59:39.543 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T09:59:39.543 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:59:39.543 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-04-25T09:59:39.543 INFO:teuthology.orchestra.run.smithi007.stdout: "0af515b4-6e20-41c2-8e56-8877a0ae385f": { 2024-04-25T09:59:39.543 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/subdir", 2024-04-25T09:59:39.544 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "0af515b4-6e20-41c2-8e56-8877a0ae385f", 2024-04-25T09:59:39.544 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,repair" 2024-04-25T09:59:39.544 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:59:39.544 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T09:59:39.544 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T09:59:39.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.532+0000 7f2ac2b53640 1 -- 172.21.15.7:0/3482539424 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2aa006b4d0 msgr2=0x7f2aa006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:39.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.532+0000 7f2ac2b53640 1 --2- 172.21.15.7:0/3482539424 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2aa006b4d0 0x7f2aa006d990 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2abc143470 tx=0x7f2ab0009040 comp rx=0 tx=0).stop 2024-04-25T09:59:39.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.532+0000 7f2ac2b53640 1 -- 172.21.15.7:0/3482539424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2abc13ff40 msgr2=0x7f2abc141950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:59:39.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.532+0000 7f2ac2b53640 1 --2- 172.21.15.7:0/3482539424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2abc13ff40 0x7f2abc141950 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8034040 tx=0x7f2aa8004730 comp rx=0 tx=0).stop 2024-04-25T09:59:39.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.533+0000 7f2ac2b53640 1 -- 172.21.15.7:0/3482539424 shutdown_connections 2024-04-25T09:59:39.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.533+0000 7f2ac2b53640 1 --2- 172.21.15.7:0/3482539424 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2aa006b4d0 0x7f2aa006d990 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.533+0000 7f2ac2b53640 1 --2- 172.21.15.7:0/3482539424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2abc141e90 0x7f2abc142320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.533+0000 7f2ac2b53640 1 --2- 172.21.15.7:0/3482539424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2abc13ff40 0x7f2abc141950 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.533+0000 7f2ac2b53640 1 --2- 172.21.15.7:0/3482539424 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2aac004800 0x7f2abc138030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:59:39.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.533+0000 7f2ac2b53640 1 -- 172.21.15.7:0/3482539424 >> 172.21.15.7:0/3482539424 conn(0x7f2abc06ab60 msgr2=0x7f2abc06af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:59:39.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.533+0000 7f2ac2b53640 1 -- 172.21.15.7:0/3482539424 shutdown_connections 2024-04-25T09:59:39.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T09:59:39.533+0000 7f2ac2b53640 1 -- 172.21.15.7:0/3482539424 wait complete. 2024-04-25T09:59:39.550 INFO:tasks.cephfs.filesystem:scrub status for tag:0af515b4-6e20-41c2-8e56-8877a0ae385f - {'path': '/subdir', 'tag': '0af515b4-6e20-41c2-8e56-8877a0ae385f', 'options': 'recursive,repair'} 2024-04-25T09:59:56.811 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:59:56.815 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:00:09.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:09.551 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-25T10:00:09.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.663+0000 7f4b9843f640 1 Processor -- start 2024-04-25T10:00:09.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.663+0000 7f4b9843f640 1 -- start start 2024-04-25T10:00:09.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.664+0000 7f4b9843f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4b900d3760 0x7f4b9015eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:09.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.664+0000 7f4b9843f640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4b900ce830 0x7f4b900b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:09.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.664+0000 7f4b9843f640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b900ced10 con 0x7f4b9015f1c0 2024-04-25T10:00:09.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.664+0000 7f4b9843f640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b900ce380 con 0x7f4b900ce830 2024-04-25T10:00:09.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.664+0000 7f4b9843f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9015f000 con 0x7f4b900d3760 2024-04-25T10:00:09.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.665+0000 7f4b969dc640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4b900ce830 0x7f4b900b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:09.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.665+0000 7f4b959da640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f4b9015f1c0 0x7f4b900d3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40616/0 (socket says 172.21.15.7:40616) 2024-04-25T10:00:09.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.665+0000 7f4b959da640 1 -- 172.21.15.7:0/2231426955 learned_addr learned my addr 172.21.15.7:0/2231426955 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:09.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.665+0000 7f4b969dc640 1 -- 172.21.15.7:0/2231426955 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4b900d3760 msgr2=0x7f4b9015eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:09.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.665+0000 7f4b961db640 1 --2- 172.21.15.7:0/2231426955 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4b900d3760 0x7f4b9015eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:09.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.665+0000 7f4b969dc640 1 --2- 172.21.15.7:0/2231426955 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4b900d3760 0x7f4b9015eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.665+0000 7f4b969dc640 1 -- 172.21.15.7:0/2231426955 >> v1:172.21.15.7:6789/0 conn(0x7f4b9015f1c0 legacy=0x7f4b900d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:09.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.665+0000 7f4b969dc640 1 -- 172.21.15.7:0/2231426955 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b900d1b40 con 0x7f4b900ce830 2024-04-25T10:00:09.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.665+0000 7f4b951d9640 1 -- 172.21.15.7:0/2231426955 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4224927831 0 0) 0x7f4b900ced10 con 0x7f4b9015f1c0 2024-04-25T10:00:09.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.665+0000 7f4b961db640 1 --2- 172.21.15.7:0/2231426955 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4b900d3760 0x7f4b9015eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:00:09.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.666+0000 7f4b969dc640 1 --2- 172.21.15.7:0/2231426955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b900ce830 0x7f4b900b2240 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009d90 tx=0x7f4b8002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3cf0b846cc0e76e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.666+0000 7f4b951d9640 1 -- 172.21.15.7:0/2231426955 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b80007740 con 0x7f4b900ce830 2024-04-25T10:00:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.666+0000 7f4b951d9640 1 -- 172.21.15.7:0/2231426955 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b800078e0 con 0x7f4b900ce830 2024-04-25T10:00:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.666+0000 7f4b951d9640 1 -- 172.21.15.7:0/2231426955 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b80007cb0 con 0x7f4b900ce830 2024-04-25T10:00:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.666+0000 7f4b9843f640 1 -- 172.21.15.7:0/2231426955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b900ce830 msgr2=0x7f4b900b2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.666+0000 7f4b9843f640 1 --2- 172.21.15.7:0/2231426955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b900ce830 0x7f4b900b2240 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009d90 tx=0x7f4b8002a660 comp rx=0 tx=0).stop 2024-04-25T10:00:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.667+0000 7f4b9843f640 1 -- 172.21.15.7:0/2231426955 shutdown_connections 2024-04-25T10:00:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.667+0000 7f4b9843f640 1 --2- 172.21.15.7:0/2231426955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b900ce830 0x7f4b900b2240 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.667+0000 7f4b9843f640 1 --2- 172.21.15.7:0/2231426955 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4b900d3760 0x7f4b9015eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.667+0000 7f4b9843f640 1 -- 172.21.15.7:0/2231426955 >> 172.21.15.7:0/2231426955 conn(0x7f4b90072680 msgr2=0x7f4b90072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.667+0000 7f4b9843f640 1 -- 172.21.15.7:0/2231426955 shutdown_connections 2024-04-25T10:00:09.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.667+0000 7f4b9843f640 1 -- 172.21.15.7:0/2231426955 wait complete. 2024-04-25T10:00:09.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.668+0000 7f4b9843f640 1 Processor -- start 2024-04-25T10:00:09.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.668+0000 7f4b9843f640 1 -- start start 2024-04-25T10:00:09.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.669+0000 7f4b9843f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b900ce830 0x7f4b901f78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:09.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.669+0000 7f4b9843f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4b900d3760 0x7f4b900c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:09.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.669+0000 7f4b9843f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b9015f1c0 0x7f4b9014c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:09.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.669+0000 7f4b9843f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9015de10 con 0x7f4b9015f1c0 2024-04-25T10:00:09.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.669+0000 7f4b9843f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900d2190 con 0x7f4b900ce830 2024-04-25T10:00:09.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.669+0000 7f4b9843f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900b2780 con 0x7f4b900d3760 2024-04-25T10:00:09.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.669+0000 7f4b969dc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b9015f1c0 0x7f4b9014c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:09.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.669+0000 7f4b969dc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b9015f1c0 0x7f4b9014c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52198/0 (socket says 172.21.15.7:52198) 2024-04-25T10:00:09.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.669+0000 7f4b969dc640 1 -- 172.21.15.7:0/4242994688 learned_addr learned my addr 172.21.15.7:0/4242994688 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:09.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.669+0000 7f4b959da640 1 --2- 172.21.15.7:0/4242994688 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4b900d3760 0x7f4b900c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:09.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.669+0000 7f4b961db640 1 --2- 172.21.15.7:0/4242994688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b900ce830 0x7f4b901f78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:09.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.670+0000 7f4b969dc640 1 -- 172.21.15.7:0/4242994688 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4b900d3760 msgr2=0x7f4b900c79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.670+0000 7f4b969dc640 1 --2- 172.21.15.7:0/4242994688 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4b900d3760 0x7f4b900c79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.670+0000 7f4b969dc640 1 -- 172.21.15.7:0/4242994688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b900ce830 msgr2=0x7f4b901f78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.670+0000 7f4b969dc640 1 --2- 172.21.15.7:0/4242994688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b900ce830 0x7f4b901f78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.670+0000 7f4b969dc640 1 -- 172.21.15.7:0/4242994688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b901f7df0 con 0x7f4b9015f1c0 2024-04-25T10:00:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.670+0000 7f4b969dc640 1 --2- 172.21.15.7:0/4242994688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b9015f1c0 0x7f4b9014c7d0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009d90 tx=0x7f4b80004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.670+0000 7f4b8effd640 1 -- 172.21.15.7:0/4242994688 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b80040070 con 0x7f4b9015f1c0 2024-04-25T10:00:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.670+0000 7f4b8effd640 1 -- 172.21.15.7:0/4242994688 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b80031c90 con 0x7f4b9015f1c0 2024-04-25T10:00:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.670+0000 7f4b8effd640 1 -- 172.21.15.7:0/4242994688 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8003c640 con 0x7f4b9015f1c0 2024-04-25T10:00:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.670+0000 7f4b9843f640 1 -- 172.21.15.7:0/4242994688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b90150590 con 0x7f4b9015f1c0 2024-04-25T10:00:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.670+0000 7f4b9843f640 1 -- 172.21.15.7:0/4242994688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b900b3fb0 con 0x7f4b9015f1c0 2024-04-25T10:00:09.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.672+0000 7f4b8effd640 1 -- 172.21.15.7:0/4242994688 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4b80039040 con 0x7f4b9015f1c0 2024-04-25T10:00:09.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.672+0000 7f4b8effd640 1 --2- 172.21.15.7:0/4242994688 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4b7c06b4d0 0x7f4b7c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:09.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.672+0000 7f4b8effd640 1 -- 172.21.15.7:0/4242994688 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f4b800ab8a0 con 0x7f4b9015f1c0 2024-04-25T10:00:09.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.672+0000 7f4b961db640 1 --2- 172.21.15.7:0/4242994688 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4b7c06b4d0 0x7f4b7c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:09.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.673+0000 7f4b961db640 1 --2- 172.21.15.7:0/4242994688 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4b7c06b4d0 0x7f4b7c06d990 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4b8800ab60 tx=0x7f4b88008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:09.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.673+0000 7f4b9b21d740 1 Processor -- start 2024-04-25T10:00:09.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.673+0000 7f4b9b21d740 1 -- start start 2024-04-25T10:00:09.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.674+0000 7f4b9b21d740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55f315a94b10 0x55f315a97320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:09.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.674+0000 7f4b9b21d740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f315a94ef0 0x55f315a97860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:09.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.674+0000 7f4b9b21d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f315a67770 0x55f315a6af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:09.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.674+0000 7f4b9b21d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3159d0da0 con 0x55f315a67770 2024-04-25T10:00:09.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.674+0000 7f4b9b21d740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f315979b80 con 0x55f315a94ef0 2024-04-25T10:00:09.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.674+0000 7f4b9b21d740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f3159cce40 con 0x55f315a94b10 2024-04-25T10:00:09.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.674+0000 7f4b969dc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f315a67770 0x55f315a6af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:09.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.674+0000 7f4b969dc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f315a67770 0x55f315a6af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52202/0 (socket says 172.21.15.7:52202) 2024-04-25T10:00:09.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.674+0000 7f4b969dc640 1 -- 172.21.15.7:0/179051484 learned_addr learned my addr 172.21.15.7:0/179051484 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.674+0000 7f4b961db640 1 --2- 172.21.15.7:0/179051484 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55f315a94b10 0x55f315a97320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.674+0000 7f4b959da640 1 --2- 172.21.15.7:0/179051484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f315a94ef0 0x55f315a97860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.674+0000 7f4b969dc640 1 -- 172.21.15.7:0/179051484 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55f315a94b10 msgr2=0x55f315a97320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.674+0000 7f4b969dc640 1 --2- 172.21.15.7:0/179051484 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55f315a94b10 0x55f315a97320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.675+0000 7f4b969dc640 1 -- 172.21.15.7:0/179051484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f315a94ef0 msgr2=0x55f315a97860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.675+0000 7f4b969dc640 1 --2- 172.21.15.7:0/179051484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f315a94ef0 0x55f315a97860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.675+0000 7f4b969dc640 1 -- 172.21.15.7:0/179051484 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f315983f10 con 0x55f315a67770 2024-04-25T10:00:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.675+0000 7f4b961db640 1 --2- 172.21.15.7:0/179051484 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55f315a94b10 0x55f315a97320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.675+0000 7f4b959da640 1 --2- 172.21.15.7:0/179051484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f315a94ef0 0x55f315a97860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.675+0000 7f4b969dc640 1 --2- 172.21.15.7:0/179051484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f315a67770 0x55f315a6af80 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f4b800820e0 tx=0x7f4b80031f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a044d6b38ddc682 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.675+0000 7f4b77fff640 1 -- 172.21.15.7:0/179051484 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b80082610 con 0x55f315a67770 2024-04-25T10:00:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.675+0000 7f4b77fff640 1 -- 172.21.15.7:0/179051484 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b80007840 con 0x55f315a67770 2024-04-25T10:00:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.675+0000 7f4b77fff640 1 -- 172.21.15.7:0/179051484 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b80076620 con 0x55f315a67770 2024-04-25T10:00:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.676+0000 7f4b9b21d740 1 -- 172.21.15.7:0/179051484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f315a67770 msgr2=0x55f315a6af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.676+0000 7f4b9b21d740 1 --2- 172.21.15.7:0/179051484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f315a67770 0x55f315a6af80 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f4b800820e0 tx=0x7f4b80031f00 comp rx=0 tx=0).stop 2024-04-25T10:00:09.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.676+0000 7f4b9b21d740 1 -- 172.21.15.7:0/179051484 shutdown_connections 2024-04-25T10:00:09.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.676+0000 7f4b9b21d740 1 --2- 172.21.15.7:0/179051484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f315a67770 0x55f315a6af80 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.676+0000 7f4b9b21d740 1 --2- 172.21.15.7:0/179051484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f315a94ef0 0x55f315a97860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.676+0000 7f4b9b21d740 1 --2- 172.21.15.7:0/179051484 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55f315a94b10 0x55f315a97320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.676+0000 7f4b9b21d740 1 -- 172.21.15.7:0/179051484 >> 172.21.15.7:0/179051484 conn(0x55f315a699e0 msgr2=0x55f315ab2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:09.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.676+0000 7f4b9b21d740 1 -- 172.21.15.7:0/179051484 shutdown_connections 2024-04-25T10:00:09.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.676+0000 7f4b9b21d740 1 -- 172.21.15.7:0/179051484 wait complete. 2024-04-25T10:00:09.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.676+0000 7f4b9b21d740 1 -- start start 2024-04-25T10:00:09.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.676+0000 7f4b9b21d740 1 Processor -- start 2024-04-25T10:00:09.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.677+0000 7f4b9b21d740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55f315a94b10 0x55f315ab4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:09.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.677+0000 7f4b9b21d740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f315a94ef0 0x55f315a96880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:09.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.677+0000 7f4b9b21d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f315a8ee40 0x55f315a96dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:09.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.677+0000 7f4b9b21d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3159d0da0 con 0x55f315a8ee40 2024-04-25T10:00:09.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.677+0000 7f4b9b21d740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f31596f4b0 con 0x55f315a94ef0 2024-04-25T10:00:09.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.677+0000 7f4b9b21d740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f315a6cb90 con 0x55f315a94b10 2024-04-25T10:00:09.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.677+0000 7f4b9b21d740 10 client.0 _ll_register_callbacks cb 0x55f3159af180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:00:09.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.677+0000 7f4b969dc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f315a8ee40 0x55f315a96dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:09.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.678+0000 7f4b969dc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f315a8ee40 0x55f315a96dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52216/0 (socket says 172.21.15.7:52216) 2024-04-25T10:00:09.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.678+0000 7f4b969dc640 1 -- 172.21.15.7:0/4030758181 learned_addr learned my addr 172.21.15.7:0/4030758181 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:09.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.678+0000 7f4b961db640 1 --2- 172.21.15.7:0/4030758181 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55f315a94b10 0x55f315ab4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:09.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.678+0000 7f4b959da640 1 --2- 172.21.15.7:0/4030758181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f315a94ef0 0x55f315a96880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:09.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.678+0000 7f4b969dc640 1 -- 172.21.15.7:0/4030758181 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55f315a94b10 msgr2=0x55f315ab4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:09.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.678+0000 7f4b969dc640 1 --2- 172.21.15.7:0/4030758181 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55f315a94b10 0x55f315ab4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.678+0000 7f4b969dc640 1 -- 172.21.15.7:0/4030758181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f315a94ef0 msgr2=0x55f315a96880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:09.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.678+0000 7f4b969dc640 1 --2- 172.21.15.7:0/4030758181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f315a94ef0 0x55f315a96880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.678+0000 7f4b969dc640 1 -- 172.21.15.7:0/4030758181 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f3157af7d0 con 0x55f315a8ee40 2024-04-25T10:00:09.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.678+0000 7f4b969dc640 1 --2- 172.21.15.7:0/4030758181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f315a8ee40 0x55f315a96dc0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f4b80079cb0 tx=0x7f4b80009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b927f86ef9d5d25 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:09.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.678+0000 7f4b757fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:00:09.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.678+0000 7f4b757fa640 1 -- 172.21.15.7:0/4030758181 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b80091dd0 con 0x55f315a8ee40 2024-04-25T10:00:09.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.678+0000 7f4b757fa640 1 -- 172.21.15.7:0/4030758181 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f4b80082180 con 0x55f315a8ee40 2024-04-25T10:00:09.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.678+0000 7f4b9b21d740 1 -- 172.21.15.7:0/4030758181 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4b80007840 con 0x55f315a8ee40 2024-04-25T10:00:09.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.678+0000 7f4b757fa640 1 -- 172.21.15.7:0/4030758181 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b80082610 con 0x55f315a8ee40 2024-04-25T10:00:09.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.678+0000 7f4b9b21d740 10 client.7305 fetch_fsmap learned FSMap version 45 2024-04-25T10:00:09.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.678+0000 7f4b9b21d740 1 -- 172.21.15.7:0/4030758181 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) v3 -- 0x55f3156e53f0 con 0x55f315a8ee40 2024-04-25T10:00:09.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.678+0000 7f4b757fa640 1 -- 172.21.15.7:0/4030758181 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b80007840 con 0x55f315a8ee40 2024-04-25T10:00:09.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.679+0000 7f4b757fa640 1 -- 172.21.15.7:0/4030758181 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 45) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4b80080070 con 0x55f315a8ee40 2024-04-25T10:00:09.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.679+0000 7f4b9b21d740 10 client.7305 fetch_fsmap finished waiting for FSMap version 45 2024-04-25T10:00:09.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.679+0000 7f4b9b21d740 10 client.7305 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T10:00:09.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.679+0000 7f4b9b21d740 20 client.7305 populate_metadata read hostname 'smithi007' 2024-04-25T10:00:09.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.679+0000 7f4b9b21d740 1 --2- 172.21.15.7:0/4030758181 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x55f315a900e0 0x55f315a904f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:09.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.679+0000 7f4b9b21d740 4 client.7305 mds_command: new command op to 6813 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:00:09.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.679+0000 7f4b9b21d740 1 -- 172.21.15.7:0/4030758181 --> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f3159de2e0 con 0x55f315a900e0 2024-04-25T10:00:09.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.679+0000 7f4b961db640 1 --2- 172.21.15.7:0/4030758181 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x55f315a900e0 0x55f315a904f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:09.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.679+0000 7f4b757fa640 10 client.7305 ms_handle_connect on v2:172.21.15.7:6836/3690076929 2024-04-25T10:00:09.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.679+0000 7f4b961db640 1 --2- 172.21.15.7:0/4030758181 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x55f315a900e0 0x55f315a904f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f70627b08e1a9a0a server_cookie=b1c8d3afa862c2c8 in_seq=0 out_seq=0 2024-04-25T10:00:09.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.680+0000 7f4b757fa640 1 -- 172.21.15.7:0/4030758181 <== mds.0 v2:172.21.15.7:6836/3690076929 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f3159de2e0 con 0x55f315a900e0 2024-04-25T10:00:09.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.680+0000 7f4b757fa640 10 client.7305 handle_command_reply: tid=0 2024-04-25T10:00:09.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.680+0000 7f4b9b21d740 1 client.7305 shutdown 2024-04-25T10:00:09.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.680+0000 7f4b9b21d740 1 -- 172.21.15.7:0/4030758181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f315a8ee40 msgr2=0x55f315a96dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:09.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.680+0000 7f4b9b21d740 1 --2- 172.21.15.7:0/4030758181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f315a8ee40 0x55f315a96dc0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f4b80079cb0 tx=0x7f4b80009750 comp rx=0 tx=0).stop 2024-04-25T10:00:09.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.680+0000 7f4b9b21d740 1 -- 172.21.15.7:0/4030758181 shutdown_connections 2024-04-25T10:00:09.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.680+0000 7f4b9b21d740 1 --2- 172.21.15.7:0/4030758181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f315a8ee40 0x55f315a96dc0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.680+0000 7f4b9b21d740 1 --2- 172.21.15.7:0/4030758181 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x55f315a900e0 0x55f315a904f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.680+0000 7f4b9b21d740 1 --2- 172.21.15.7:0/4030758181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f315a94ef0 0x55f315a96880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.680+0000 7f4b9b21d740 1 --2- 172.21.15.7:0/4030758181 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55f315a94b10 0x55f315ab4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.680+0000 7f4b9b21d740 1 -- 172.21.15.7:0/4030758181 >> 172.21.15.7:0/4030758181 conn(0x55f315a67770 msgr2=0x55f315a68730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:09.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.680+0000 7f4b757fa640 0 client.7305 ms_handle_reset on v2:172.21.15.7:6836/3690076929 2024-04-25T10:00:09.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.680+0000 7f4b9b21d740 1 -- 172.21.15.7:0/4030758181 shutdown_connections 2024-04-25T10:00:09.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.680+0000 7f4b9b21d740 1 -- 172.21.15.7:0/4030758181 wait complete. 2024-04-25T10:00:09.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.680+0000 7f4b9b21d740 20 client.7305 trim_cache size 0 max 16384 2024-04-25T10:00:09.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.695+0000 7f4b9b21d740 1 Processor -- start 2024-04-25T10:00:09.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.695+0000 7f4b9b21d740 1 -- start start 2024-04-25T10:00:09.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.696+0000 7f4b9b21d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f315a8ee40 0x55f315a6cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:09.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.696+0000 7f4b9b21d740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f315a94b10 0x55f315a6e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:09.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.696+0000 7f4b9b21d740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55f315a94ef0 0x55f315a90b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:09.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.696+0000 7f4b9b21d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b902000e0 con 0x55f315a8ee40 2024-04-25T10:00:09.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.696+0000 7f4b9b21d740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b901ff320 con 0x55f315a94b10 2024-04-25T10:00:09.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.696+0000 7f4b9b21d740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900b5470 con 0x55f315a94ef0 2024-04-25T10:00:09.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.696+0000 7f4b961db640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f315a8ee40 0x55f315a6cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:09.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.696+0000 7f4b961db640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f315a8ee40 0x55f315a6cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52222/0 (socket says 172.21.15.7:52222) 2024-04-25T10:00:09.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.696+0000 7f4b961db640 1 -- 172.21.15.7:0/3769980137 learned_addr learned my addr 172.21.15.7:0/3769980137 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:09.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.696+0000 7f4b961db640 1 -- 172.21.15.7:0/3769980137 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55f315a94ef0 msgr2=0x55f315a90b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:09.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.696+0000 7f4b961db640 1 --2- 172.21.15.7:0/3769980137 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55f315a94ef0 0x55f315a90b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.696+0000 7f4b961db640 1 -- 172.21.15.7:0/3769980137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f315a94b10 msgr2=0x55f315a6e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:09.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.696+0000 7f4b961db640 1 --2- 172.21.15.7:0/3769980137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f315a94b10 0x55f315a6e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.696+0000 7f4b961db640 1 -- 172.21.15.7:0/3769980137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3156a50f0 con 0x55f315a8ee40 2024-04-25T10:00:09.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.697+0000 7f4b961db640 1 --2- 172.21.15.7:0/3769980137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f315a8ee40 0x55f315a6cfe0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x55f315a90ac0 tx=0x7f4b88018040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46fa95603ee09d27 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:09.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.697+0000 7f4b777fe640 1 -- 172.21.15.7:0/3769980137 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8801b040 con 0x55f315a8ee40 2024-04-25T10:00:09.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.697+0000 7f4b777fe640 1 -- 172.21.15.7:0/3769980137 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8802e070 con 0x55f315a8ee40 2024-04-25T10:00:09.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.697+0000 7f4b777fe640 1 -- 172.21.15.7:0/3769980137 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b88003ae0 con 0x55f315a8ee40 2024-04-25T10:00:09.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.697+0000 7f4b9b21d740 1 -- 172.21.15.7:0/3769980137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f315a8ee40 msgr2=0x55f315a6cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:09.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.697+0000 7f4b9b21d740 1 --2- 172.21.15.7:0/3769980137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f315a8ee40 0x55f315a6cfe0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x55f315a90ac0 tx=0x7f4b88018040 comp rx=0 tx=0).stop 2024-04-25T10:00:09.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.697+0000 7f4b9b21d740 1 -- 172.21.15.7:0/3769980137 shutdown_connections 2024-04-25T10:00:09.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.697+0000 7f4b9b21d740 1 --2- 172.21.15.7:0/3769980137 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55f315a94ef0 0x55f315a90b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.697+0000 7f4b9b21d740 1 --2- 172.21.15.7:0/3769980137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f315a94b10 0x55f315a6e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.697+0000 7f4b9b21d740 1 --2- 172.21.15.7:0/3769980137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f315a8ee40 0x55f315a6cfe0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.697+0000 7f4b9b21d740 1 -- 172.21.15.7:0/3769980137 >> 172.21.15.7:0/3769980137 conn(0x55f315a67770 msgr2=0x55f315ab4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:09.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.697+0000 7f4b9b21d740 1 -- 172.21.15.7:0/3769980137 shutdown_connections 2024-04-25T10:00:09.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.697+0000 7f4b9b21d740 1 -- 172.21.15.7:0/3769980137 wait complete. 2024-04-25T10:00:09.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.698+0000 7f4b9b21d740 1 -- start start 2024-04-25T10:00:09.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.698+0000 7f4b9b21d740 1 Processor -- start 2024-04-25T10:00:09.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.699+0000 7f4b9b21d740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55f315a8ee40 0x55f315ab2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:09.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.699+0000 7f4b9b21d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f315a94b10 0x55f315a93cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:09.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.699+0000 7f4b9b21d740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f315a94ef0 0x55f315aa7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:09.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.699+0000 7f4b9b21d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f315a67c50 con 0x55f315a94b10 2024-04-25T10:00:09.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.699+0000 7f4b9b21d740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900b5a70 con 0x55f315a94ef0 2024-04-25T10:00:09.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.699+0000 7f4b9b21d740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f3159d32b0 con 0x55f315a8ee40 2024-04-25T10:00:09.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.699+0000 7f4b9b21d740 10 client.0 _ll_register_callbacks cb 0x7f4b80076250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:00:09.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.699+0000 7f4b959da640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f315a94b10 0x55f315a93cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:09.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.699+0000 7f4b959da640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f315a94b10 0x55f315a93cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52238/0 (socket says 172.21.15.7:52238) 2024-04-25T10:00:09.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.699+0000 7f4b959da640 1 -- 172.21.15.7:0/138167419 learned_addr learned my addr 172.21.15.7:0/138167419 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:09.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.699+0000 7f4b961db640 1 --2- 172.21.15.7:0/138167419 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55f315a8ee40 0x55f315ab2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:09.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.699+0000 7f4b969dc640 1 --2- 172.21.15.7:0/138167419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f315a94ef0 0x55f315aa7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:09.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.699+0000 7f4b959da640 1 -- 172.21.15.7:0/138167419 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55f315a8ee40 msgr2=0x55f315ab2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:09.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.699+0000 7f4b959da640 1 --2- 172.21.15.7:0/138167419 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55f315a8ee40 0x55f315ab2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.699+0000 7f4b959da640 1 -- 172.21.15.7:0/138167419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f315a94ef0 msgr2=0x55f315aa7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:09.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.699+0000 7f4b959da640 1 --2- 172.21.15.7:0/138167419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f315a94ef0 0x55f315aa7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.699+0000 7f4b959da640 1 -- 172.21.15.7:0/138167419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f315a8c9b0 con 0x55f315a94b10 2024-04-25T10:00:09.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.699+0000 7f4b969dc640 1 --2- 172.21.15.7:0/138167419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f315a94ef0 0x55f315aa7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:09.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.700+0000 7f4b959da640 1 --2- 172.21.15.7:0/138167419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f315a94b10 0x55f315a93cb0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f4b9015f5a0 tx=0x7f4b84014710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=591fcf020a213e98 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:09.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.700+0000 7f4b757fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:00:09.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.700+0000 7f4b757fa640 1 -- 172.21.15.7:0/138167419 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8401a070 con 0x55f315a94b10 2024-04-25T10:00:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.700+0000 7f4b757fa640 1 -- 172.21.15.7:0/138167419 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f4b8401baa0 con 0x55f315a94b10 2024-04-25T10:00:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.700+0000 7f4b9b21d740 1 -- 172.21.15.7:0/138167419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4b8802e070 con 0x55f315a94b10 2024-04-25T10:00:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.700+0000 7f4b757fa640 1 -- 172.21.15.7:0/138167419 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b84026050 con 0x55f315a94b10 2024-04-25T10:00:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.700+0000 7f4b9b21d740 10 client.7311 fetch_fsmap learned FSMap version 45 2024-04-25T10:00:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.700+0000 7f4b9b21d740 1 -- 172.21.15.7:0/138167419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) v3 -- 0x55f315aa81f0 con 0x55f315a94b10 2024-04-25T10:00:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.700+0000 7f4b757fa640 1 -- 172.21.15.7:0/138167419 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8802e070 con 0x55f315a94b10 2024-04-25T10:00:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.700+0000 7f4b757fa640 1 -- 172.21.15.7:0/138167419 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 45) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4b84029020 con 0x55f315a94b10 2024-04-25T10:00:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.700+0000 7f4b9b21d740 10 client.7311 fetch_fsmap finished waiting for FSMap version 45 2024-04-25T10:00:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.700+0000 7f4b9b21d740 10 client.7311 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T10:00:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.700+0000 7f4b9b21d740 20 client.7311 populate_metadata read hostname 'smithi007' 2024-04-25T10:00:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.700+0000 7f4b9b21d740 1 --2- 172.21.15.7:0/138167419 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x55f315a671a0 0x55f315a90b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.700+0000 7f4b9b21d740 4 client.7311 mds_command: new command op to 6813 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T10:00:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.700+0000 7f4b9b21d740 1 -- 172.21.15.7:0/138167419 --> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f3159d8630 con 0x55f315a671a0 2024-04-25T10:00:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.700+0000 7f4b961db640 1 --2- 172.21.15.7:0/138167419 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x55f315a671a0 0x55f315a90b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:09.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.701+0000 7f4b961db640 1 --2- 172.21.15.7:0/138167419 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x55f315a671a0 0x55f315a90b20 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ded0c6473dd35c36 server_cookie=8d1e491cca2d1408 in_seq=0 out_seq=0 2024-04-25T10:00:09.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.701+0000 7f4b757fa640 10 client.7311 ms_handle_connect on v2:172.21.15.7:6836/3690076929 2024-04-25T10:00:09.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.701+0000 7f4b757fa640 1 -- 172.21.15.7:0/138167419 <== mds.0 v2:172.21.15.7:6836/3690076929 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55f3159d8630 con 0x55f315a671a0 2024-04-25T10:00:09.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.701+0000 7f4b757fa640 10 client.7311 handle_command_reply: tid=0 2024-04-25T10:00:09.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.701+0000 7f4b9b21d740 1 client.7311 shutdown 2024-04-25T10:00:09.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.701+0000 7f4b9b21d740 1 -- 172.21.15.7:0/138167419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f315a94b10 msgr2=0x55f315a93cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:09.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.701+0000 7f4b9b21d740 1 --2- 172.21.15.7:0/138167419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f315a94b10 0x55f315a93cb0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f4b9015f5a0 tx=0x7f4b84014710 comp rx=0 tx=0).stop 2024-04-25T10:00:09.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.701+0000 7f4b9b21d740 1 -- 172.21.15.7:0/138167419 shutdown_connections 2024-04-25T10:00:09.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.701+0000 7f4b9b21d740 1 --2- 172.21.15.7:0/138167419 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x55f315a671a0 0x55f315a90b20 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.701+0000 7f4b9b21d740 1 --2- 172.21.15.7:0/138167419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f315a94ef0 0x55f315aa7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.701+0000 7f4b9b21d740 1 --2- 172.21.15.7:0/138167419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f315a94b10 0x55f315a93cb0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.701+0000 7f4b757fa640 0 client.7311 ms_handle_reset on v2:172.21.15.7:6836/3690076929 2024-04-25T10:00:09.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.701+0000 7f4b9b21d740 1 --2- 172.21.15.7:0/138167419 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55f315a8ee40 0x55f315ab2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.701+0000 7f4b9b21d740 1 -- 172.21.15.7:0/138167419 >> 172.21.15.7:0/138167419 conn(0x55f315a67770 msgr2=0x55f315ab4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:09.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.701+0000 7f4b9b21d740 1 -- 172.21.15.7:0/138167419 shutdown_connections 2024-04-25T10:00:09.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.701+0000 7f4b9b21d740 1 -- 172.21.15.7:0/138167419 wait complete. 2024-04-25T10:00:09.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.701+0000 7f4b9b21d740 20 client.7311 trim_cache size 0 max 16384 2024-04-25T10:00:09.713 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:00:09.713 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-04-25T10:00:09.713 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-04-25T10:00:09.713 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:00:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.702+0000 7f4b9843f640 1 -- 172.21.15.7:0/4242994688 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4b7c06b4d0 msgr2=0x7f4b7c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:09.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.702+0000 7f4b9843f640 1 --2- 172.21.15.7:0/4242994688 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4b7c06b4d0 0x7f4b7c06d990 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4b8800ab60 tx=0x7f4b88008040 comp rx=0 tx=0).stop 2024-04-25T10:00:09.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.702+0000 7f4b9843f640 1 -- 172.21.15.7:0/4242994688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b9015f1c0 msgr2=0x7f4b9014c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:09.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.702+0000 7f4b9843f640 1 --2- 172.21.15.7:0/4242994688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b9015f1c0 0x7f4b9014c7d0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009d90 tx=0x7f4b80004a40 comp rx=0 tx=0).stop 2024-04-25T10:00:09.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.702+0000 7f4b9843f640 1 -- 172.21.15.7:0/4242994688 shutdown_connections 2024-04-25T10:00:09.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.702+0000 7f4b9843f640 1 --2- 172.21.15.7:0/4242994688 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4b7c06b4d0 0x7f4b7c06d990 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.702+0000 7f4b9843f640 1 --2- 172.21.15.7:0/4242994688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b9015f1c0 0x7f4b9014c7d0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.702+0000 7f4b9843f640 1 --2- 172.21.15.7:0/4242994688 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4b900d3760 0x7f4b900c79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.702+0000 7f4b9843f640 1 --2- 172.21.15.7:0/4242994688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b900ce830 0x7f4b901f78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.702+0000 7f4b9843f640 1 -- 172.21.15.7:0/4242994688 >> 172.21.15.7:0/4242994688 conn(0x7f4b90072680 msgr2=0x7f4b90072a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:09.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.702+0000 7f4b9843f640 1 -- 172.21.15.7:0/4242994688 shutdown_connections 2024-04-25T10:00:09.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.702+0000 7f4b9843f640 1 -- 172.21.15.7:0/4242994688 wait complete. 2024-04-25T10:00:09.717 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T10:00:09.718 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:00:09.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.815+0000 7fc92999e640 1 Processor -- start 2024-04-25T10:00:09.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.815+0000 7fc92999e640 1 -- start start 2024-04-25T10:00:09.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.816+0000 7fc92999e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc92406c250 0x7fc92409a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:09.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.816+0000 7fc92999e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9240d0360 0x7fc9240cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:09.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.816+0000 7fc92999e640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc924099b20 con 0x7fc92406bce0 2024-04-25T10:00:09.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.816+0000 7fc92999e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc92409ae20 con 0x7fc92406c250 2024-04-25T10:00:09.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.816+0000 7fc92999e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92409a450 con 0x7fc9240d0360 2024-04-25T10:00:09.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.816+0000 7fc91bfff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc92406bce0 0x7fc92406c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60224/0 (socket says 172.21.15.7:60224) 2024-04-25T10:00:09.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.816+0000 7fc91bfff640 1 -- 172.21.15.7:0/3025015685 learned_addr learned my addr 172.21.15.7:0/3025015685 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:09.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.816+0000 7fc9237fe640 1 --2- 172.21.15.7:0/3025015685 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9240d0360 0x7fc9240cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:09.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.816+0000 7fc922ffd640 1 --2- 172.21.15.7:0/3025015685 >> v2:172.21.15.55:3300/0 conn(0x7fc92406c250 0x7fc92409a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:09.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.816+0000 7fc9227fc640 1 -- 172.21.15.7:0/3025015685 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 350529320 0 0) 0x7fc924099b20 con 0x7fc92406bce0 2024-04-25T10:00:09.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.816+0000 7fc9227fc640 1 -- 172.21.15.7:0/3025015685 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc910003520 con 0x7fc92406bce0 2024-04-25T10:00:09.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.816+0000 7fc9227fc640 1 -- 172.21.15.7:0/3025015685 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 548916624 0 0) 0x7fc910003520 con 0x7fc92406bce0 2024-04-25T10:00:09.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.816+0000 7fc9227fc640 1 -- 172.21.15.7:0/3025015685 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9240d0360 msgr2=0x7fc9240cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:09.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.816+0000 7fc9227fc640 1 --2- 172.21.15.7:0/3025015685 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9240d0360 0x7fc9240cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.816+0000 7fc9227fc640 1 -- 172.21.15.7:0/3025015685 >> v2:172.21.15.55:3300/0 conn(0x7fc92406c250 msgr2=0x7fc92409a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:09.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.816+0000 7fc9227fc640 1 --2- 172.21.15.7:0/3025015685 >> v2:172.21.15.55:3300/0 conn(0x7fc92406c250 0x7fc92409a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.816+0000 7fc9227fc640 1 -- 172.21.15.7:0/3025015685 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc924099e00 con 0x7fc92406bce0 2024-04-25T10:00:09.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.816+0000 7fc9227fc640 1 -- 172.21.15.7:0/3025015685 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fc90c001670 con 0x7fc92406bce0 2024-04-25T10:00:09.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.816+0000 7fc9227fc640 1 -- 172.21.15.7:0/3025015685 >> v1:172.21.15.7:6789/0 conn(0x7fc92406bce0 legacy=0x7fc92406c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:09.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.816+0000 7fc9227fc640 1 --2- 172.21.15.7:0/3025015685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9100039b0 0x7fc910003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:09.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.816+0000 7fc9227fc640 1 --2- 172.21.15.7:0/3025015685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc910004800 0x7fc910004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:09.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.816+0000 7fc9227fc640 1 --2- 172.21.15.7:0/3025015685 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9240d0360 0x7fc9100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:09.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.816+0000 7fc9227fc640 1 -- 172.21.15.7:0/3025015685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92409ae20 con 0x7fc910004800 2024-04-25T10:00:09.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.816+0000 7fc9227fc640 1 -- 172.21.15.7:0/3025015685 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92409a450 con 0x7fc9100039b0 2024-04-25T10:00:09.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.816+0000 7fc9227fc640 1 -- 172.21.15.7:0/3025015685 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc91000ba40 con 0x7fc9240d0360 2024-04-25T10:00:09.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.817+0000 7fc91bfff640 1 --2- 172.21.15.7:0/3025015685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc910004800 0x7fc910004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:09.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.817+0000 7fc922ffd640 1 --2- 172.21.15.7:0/3025015685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9100039b0 0x7fc910003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:09.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.817+0000 7fc9237fe640 1 --2- 172.21.15.7:0/3025015685 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9240d0360 0x7fc9100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:09.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.817+0000 7fc91bfff640 1 -- 172.21.15.7:0/3025015685 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9240d0360 msgr2=0x7fc9100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:09.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.817+0000 7fc91bfff640 1 --2- 172.21.15.7:0/3025015685 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9240d0360 0x7fc9100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.817+0000 7fc91bfff640 1 -- 172.21.15.7:0/3025015685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9100039b0 msgr2=0x7fc910003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:09.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.817+0000 7fc91bfff640 1 --2- 172.21.15.7:0/3025015685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9100039b0 0x7fc910003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.817+0000 7fc91bfff640 1 -- 172.21.15.7:0/3025015685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc910003520 con 0x7fc910004800 2024-04-25T10:00:09.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.817+0000 7fc91bfff640 1 --2- 172.21.15.7:0/3025015685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc910004800 0x7fc910004c80 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fc90c00c210 tx=0x7fc910005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba654952b5cf7761 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:09.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.818+0000 7fc9227fc640 1 -- 172.21.15.7:0/3025015685 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c007d70 con 0x7fc910004800 2024-04-25T10:00:09.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.818+0000 7fc9227fc640 1 -- 172.21.15.7:0/3025015685 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90c005ad0 con 0x7fc910004800 2024-04-25T10:00:09.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.818+0000 7fc9227fc640 1 -- 172.21.15.7:0/3025015685 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c007070 con 0x7fc910004800 2024-04-25T10:00:09.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.818+0000 7fc92999e640 1 -- 172.21.15.7:0/3025015685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc910004800 msgr2=0x7fc910004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:09.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.818+0000 7fc92999e640 1 --2- 172.21.15.7:0/3025015685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc910004800 0x7fc910004c80 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fc90c00c210 tx=0x7fc910005830 comp rx=0 tx=0).stop 2024-04-25T10:00:09.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.818+0000 7fc9237fe640 1 -- 172.21.15.7:0/3025015685 reap_dead start 2024-04-25T10:00:09.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.818+0000 7fc92999e640 1 -- 172.21.15.7:0/3025015685 shutdown_connections 2024-04-25T10:00:09.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.818+0000 7fc92999e640 1 -- 172.21.15.7:0/3025015685 >> 172.21.15.7:0/3025015685 conn(0x7fc9240d16e0 msgr2=0x7fc9240d1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:09.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.818+0000 7fc92999e640 1 -- 172.21.15.7:0/3025015685 shutdown_connections 2024-04-25T10:00:09.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.818+0000 7fc92999e640 1 -- 172.21.15.7:0/3025015685 wait complete. 2024-04-25T10:00:09.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.819+0000 7fc92999e640 1 Processor -- start 2024-04-25T10:00:09.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.819+0000 7fc92999e640 1 -- start start 2024-04-25T10:00:09.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.820+0000 7fc92999e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc910004800 0x7fc9241e7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:09.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.820+0000 7fc92999e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc92414b560 0x7fc92415b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:09.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.820+0000 7fc92999e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc92415bee0 0x7fc92415c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:09.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.820+0000 7fc92999e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92415f000 con 0x7fc92415bee0 2024-04-25T10:00:09.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.820+0000 7fc92999e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9240d0c60 con 0x7fc910004800 2024-04-25T10:00:09.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.820+0000 7fc92999e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92415f180 con 0x7fc92414b560 2024-04-25T10:00:09.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.820+0000 7fc9237fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc92415bee0 0x7fc92415c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:09.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.820+0000 7fc9237fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc92415bee0 0x7fc92415c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42602/0 (socket says 172.21.15.7:42602) 2024-04-25T10:00:09.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.820+0000 7fc9237fe640 1 -- 172.21.15.7:0/91564793 learned_addr learned my addr 172.21.15.7:0/91564793 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:09.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.820+0000 7fc922ffd640 1 --2- 172.21.15.7:0/91564793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc910004800 0x7fc9241e7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:09.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.820+0000 7fc91bfff640 1 --2- 172.21.15.7:0/91564793 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc92414b560 0x7fc92415b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:09.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.821+0000 7fc9237fe640 1 -- 172.21.15.7:0/91564793 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc92414b560 msgr2=0x7fc92415b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:09.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.821+0000 7fc9237fe640 1 --2- 172.21.15.7:0/91564793 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc92414b560 0x7fc92415b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.821+0000 7fc9237fe640 1 -- 172.21.15.7:0/91564793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc910004800 msgr2=0x7fc9241e7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:09.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.821+0000 7fc9237fe640 1 --2- 172.21.15.7:0/91564793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc910004800 0x7fc9241e7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:09.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.821+0000 7fc9237fe640 1 -- 172.21.15.7:0/91564793 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92415f6f0 con 0x7fc92415bee0 2024-04-25T10:00:09.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.821+0000 7fc9237fe640 1 --2- 172.21.15.7:0/91564793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc92415bee0 0x7fc92415c360 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fc92409f7b0 tx=0x7fc91c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:09.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.821+0000 7fc920ff9640 1 -- 172.21.15.7:0/91564793 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c011e60 con 0x7fc92415bee0 2024-04-25T10:00:09.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.821+0000 7fc920ff9640 1 -- 172.21.15.7:0/91564793 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91c015430 con 0x7fc92415bee0 2024-04-25T10:00:09.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.821+0000 7fc92999e640 1 -- 172.21.15.7:0/91564793 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc92414bd70 con 0x7fc92415bee0 2024-04-25T10:00:09.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.821+0000 7fc920ff9640 1 -- 172.21.15.7:0/91564793 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c015800 con 0x7fc92415bee0 2024-04-25T10:00:09.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.821+0000 7fc92999e640 1 -- 172.21.15.7:0/91564793 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc92414c330 con 0x7fc92415bee0 2024-04-25T10:00:09.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.822+0000 7fc92999e640 1 -- 172.21.15.7:0/91564793 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc92415d430 con 0x7fc92415bee0 2024-04-25T10:00:09.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.822+0000 7fc920ff9640 1 -- 172.21.15.7:0/91564793 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc91c0159a0 con 0x7fc92415bee0 2024-04-25T10:00:09.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.823+0000 7fc920ff9640 1 --2- 172.21.15.7:0/91564793 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc90406b500 0x7fc90406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:09.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.823+0000 7fc920ff9640 1 -- 172.21.15.7:0/91564793 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fc91c08afd0 con 0x7fc92415bee0 2024-04-25T10:00:09.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.823+0000 7fc922ffd640 1 --2- 172.21.15.7:0/91564793 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc90406b500 0x7fc90406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:09.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.823+0000 7fc922ffd640 1 --2- 172.21.15.7:0/91564793 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc90406b500 0x7fc90406d9c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc914009b40 tx=0x7fc914009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:09.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:09.827+0000 7fc920ff9640 1 -- 172.21.15.7:0/91564793 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc91c019030 con 0x7fc92415bee0 2024-04-25T10:00:10.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.043+0000 7fc92999e640 1 -- 172.21.15.7:0/91564793 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9240cba10 con 0x7fc92415bee0 2024-04-25T10:00:10.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.044+0000 7fc920ff9640 1 -- 172.21.15.7:0/91564793 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4936 (secure 0 0 0) 0x7fc91c010040 con 0x7fc92415bee0 2024-04-25T10:00:10.048 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:00:10.049 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":45,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1781470369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1781470369},{"type":"v1","addr":"172.21.15.55:6835","nonce":1781470369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6442,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1406578404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1406578404},{"type":"v1","addr":"172.21.15.55:6834","nonce":1406578404}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6810,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1839614891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1839614891},{"type":"v1","addr":"172.21.15.7:6835","nonce":1839614891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:58:45.628406+0000","modified":"2024-04-25T09:59:42.407854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6813},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6813":{"gid":6813,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":18,"addr":"172.21.15.7:6837/3690076929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3690076929},{"type":"v1","addr":"172.21.15.7:6837","nonce":3690076929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T10:00:10.049 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 45 2024-04-25T10:00:10.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.046+0000 7fc92999e640 1 -- 172.21.15.7:0/91564793 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc90406b500 msgr2=0x7fc90406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:10.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.046+0000 7fc92999e640 1 --2- 172.21.15.7:0/91564793 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc90406b500 0x7fc90406d9c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc914009b40 tx=0x7fc914009190 comp rx=0 tx=0).stop 2024-04-25T10:00:10.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.046+0000 7fc92999e640 1 -- 172.21.15.7:0/91564793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc92415bee0 msgr2=0x7fc92415c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:10.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.046+0000 7fc92999e640 1 --2- 172.21.15.7:0/91564793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc92415bee0 0x7fc92415c360 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fc92409f7b0 tx=0x7fc91c00f580 comp rx=0 tx=0).stop 2024-04-25T10:00:10.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.046+0000 7fc92999e640 1 -- 172.21.15.7:0/91564793 shutdown_connections 2024-04-25T10:00:10.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.046+0000 7fc92999e640 1 --2- 172.21.15.7:0/91564793 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc90406b500 0x7fc90406d9c0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.046+0000 7fc92999e640 1 --2- 172.21.15.7:0/91564793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc92415bee0 0x7fc92415c360 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.046+0000 7fc92999e640 1 --2- 172.21.15.7:0/91564793 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc92414b560 0x7fc92415b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.046+0000 7fc92999e640 1 --2- 172.21.15.7:0/91564793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc910004800 0x7fc9241e7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.046+0000 7fc92999e640 1 -- 172.21.15.7:0/91564793 >> 172.21.15.7:0/91564793 conn(0x7fc9240d16e0 msgr2=0x7fc92406f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:10.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.046+0000 7fc92999e640 1 -- 172.21.15.7:0/91564793 shutdown_connections 2024-04-25T10:00:10.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.046+0000 7fc92999e640 1 -- 172.21.15.7:0/91564793 wait complete. 2024-04-25T10:00:10.061 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-04-25T10:00:10.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.160+0000 7f109a542640 1 Processor -- start 2024-04-25T10:00:10.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.160+0000 7f109a542640 1 -- start start 2024-04-25T10:00:10.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.161+0000 7f109a542640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f10940d0a00 0x7f109409a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:10.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.161+0000 7f109a542640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10941615e0 con 0x7f109409a7d0 2024-04-25T10:00:10.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.161+0000 7f109a542640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f109406c9f0 con 0x7f1094161200 2024-04-25T10:00:10.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.161+0000 7f109a542640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f109406ccd0 con 0x7f10940d0a00 2024-04-25T10:00:10.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.161+0000 7f1098adf640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f109409a7d0 0x7f10940cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60240/0 (socket says 172.21.15.7:60240) 2024-04-25T10:00:10.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.161+0000 7f1098adf640 1 -- 172.21.15.7:0/2764636698 learned_addr learned my addr 172.21.15.7:0/2764636698 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:10.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.161+0000 7f10937fe640 1 --2- 172.21.15.7:0/2764636698 >> v2:172.21.15.55:3300/0 conn(0x7f10940d0a00 0x7f109409a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:10.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.161+0000 7f1092ffd640 1 -- 172.21.15.7:0/2764636698 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1366851755 0 0) 0x7f108c001490 con 0x7f109409a7d0 2024-04-25T10:00:10.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.161+0000 7f1092ffd640 1 -- 172.21.15.7:0/2764636698 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1080003520 con 0x7f109409a7d0 2024-04-25T10:00:10.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.161+0000 7f10937fe640 1 -- 172.21.15.7:0/2764636698 >> v1:172.21.15.55:6789/0 conn(0x7f1094161200 legacy=0x7f10940cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:10.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.161+0000 7f10937fe640 1 -- 172.21.15.7:0/2764636698 >> v1:172.21.15.7:6789/0 conn(0x7f109409a7d0 legacy=0x7f10940cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:10.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.161+0000 7f10937fe640 1 -- 172.21.15.7:0/2764636698 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1094099a90 con 0x7f10940d0a00 2024-04-25T10:00:10.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.162+0000 7f10937fe640 1 --2- 172.21.15.7:0/2764636698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10940d0a00 0x7f109409a290 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f10840097a0 tx=0x7f108402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5185be658118540f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:10.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.162+0000 7f1092ffd640 1 -- 172.21.15.7:0/2764636698 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1084037070 con 0x7f10940d0a00 2024-04-25T10:00:10.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.163+0000 7f1092ffd640 1 -- 172.21.15.7:0/2764636698 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1084032440 con 0x7f10940d0a00 2024-04-25T10:00:10.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.163+0000 7f1092ffd640 1 -- 172.21.15.7:0/2764636698 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10840327f0 con 0x7f10940d0a00 2024-04-25T10:00:10.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.163+0000 7f109a542640 1 -- 172.21.15.7:0/2764636698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10940d0a00 msgr2=0x7f109409a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:10.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.163+0000 7f109a542640 1 --2- 172.21.15.7:0/2764636698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10940d0a00 0x7f109409a290 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f10840097a0 tx=0x7f108402a230 comp rx=0 tx=0).stop 2024-04-25T10:00:10.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.163+0000 7f109a542640 1 -- 172.21.15.7:0/2764636698 shutdown_connections 2024-04-25T10:00:10.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.163+0000 7f109a542640 1 --2- 172.21.15.7:0/2764636698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10940d0a00 0x7f109409a290 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.163+0000 7f109a542640 1 -- 172.21.15.7:0/2764636698 >> 172.21.15.7:0/2764636698 conn(0x7f10940b31a0 msgr2=0x7f10940b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:10.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.163+0000 7f109a542640 1 -- 172.21.15.7:0/2764636698 shutdown_connections 2024-04-25T10:00:10.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.163+0000 7f109a542640 1 -- 172.21.15.7:0/2764636698 wait complete. 2024-04-25T10:00:10.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.164+0000 7f109a542640 1 Processor -- start 2024-04-25T10:00:10.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.164+0000 7f109a542640 1 -- start start 2024-04-25T10:00:10.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.165+0000 7f109a542640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f109409a7d0 0x7f10940b4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:10.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.165+0000 7f109a542640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10940d0a00 0x7f10940ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:10.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.165+0000 7f109a542640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1094161200 0x7f10941e75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:10.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.165+0000 7f109a542640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109406cfb0 con 0x7f10940d0a00 2024-04-25T10:00:10.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.165+0000 7f109a542640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109406c680 con 0x7f1094161200 2024-04-25T10:00:10.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.165+0000 7f109a542640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f109406d130 con 0x7f109409a7d0 2024-04-25T10:00:10.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.165+0000 7f10937fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10940d0a00 0x7f10940ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:10.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.165+0000 7f10937fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10940d0a00 0x7f10940ca4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42608/0 (socket says 172.21.15.7:42608) 2024-04-25T10:00:10.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.165+0000 7f10937fe640 1 -- 172.21.15.7:0/882338424 learned_addr learned my addr 172.21.15.7:0/882338424 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:10.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.165+0000 7f1098adf640 1 --2- 172.21.15.7:0/882338424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1094161200 0x7f10941e75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:10.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.165+0000 7f1093fff640 1 --2- 172.21.15.7:0/882338424 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f109409a7d0 0x7f10940b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:10.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.166+0000 7f10937fe640 1 -- 172.21.15.7:0/882338424 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f109409a7d0 msgr2=0x7f10940b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:10.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.166+0000 7f10937fe640 1 --2- 172.21.15.7:0/882338424 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f109409a7d0 0x7f10940b4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.166+0000 7f10937fe640 1 -- 172.21.15.7:0/882338424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1094161200 msgr2=0x7f10941e75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:10.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.166+0000 7f10937fe640 1 --2- 172.21.15.7:0/882338424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1094161200 0x7f10941e75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.166+0000 7f10937fe640 1 -- 172.21.15.7:0/882338424 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10940b47b0 con 0x7f10940d0a00 2024-04-25T10:00:10.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.166+0000 7f1098adf640 1 --2- 172.21.15.7:0/882338424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1094161200 0x7f10941e75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:10.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.166+0000 7f10937fe640 1 --2- 172.21.15.7:0/882338424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10940d0a00 0x7f10940ca4f0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f10840097a0 tx=0x7f10840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:10.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.166+0000 7f1090ff9640 1 -- 172.21.15.7:0/882338424 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1084037050 con 0x7f10940d0a00 2024-04-25T10:00:10.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.166+0000 7f1090ff9640 1 -- 172.21.15.7:0/882338424 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1084043070 con 0x7f10940d0a00 2024-04-25T10:00:10.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.166+0000 7f109a542640 1 -- 172.21.15.7:0/882338424 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10940c6420 con 0x7f10940d0a00 2024-04-25T10:00:10.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.166+0000 7f1090ff9640 1 -- 172.21.15.7:0/882338424 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1084032810 con 0x7f10940d0a00 2024-04-25T10:00:10.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.166+0000 7f109a542640 1 -- 172.21.15.7:0/882338424 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10940c69e0 con 0x7f10940d0a00 2024-04-25T10:00:10.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.168+0000 7f1090ff9640 1 -- 172.21.15.7:0/882338424 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f10840329b0 con 0x7f10940d0a00 2024-04-25T10:00:10.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.168+0000 7f1090ff9640 1 --2- 172.21.15.7:0/882338424 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f107406b4d0 0x7f107406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:10.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.168+0000 7f1090ff9640 1 -- 172.21.15.7:0/882338424 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f10840aad80 con 0x7f10940d0a00 2024-04-25T10:00:10.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.168+0000 7f1093fff640 1 --2- 172.21.15.7:0/882338424 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f107406b4d0 0x7f107406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:10.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.169+0000 7f1093fff640 1 --2- 172.21.15.7:0/882338424 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f107406b4d0 0x7f107406d990 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f107c001780 tx=0x7f107c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:10.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.169+0000 7f109d247740 1 Processor -- start 2024-04-25T10:00:10.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.169+0000 7f109d247740 1 -- start start 2024-04-25T10:00:10.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.170+0000 7f109d247740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5641ba6b9590 0x5641ba6bb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:10.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.170+0000 7f109d247740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5641ba6f5c60 0x5641ba6b9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:10.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.170+0000 7f109d247740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5641ba6e4050 0x5641ba6e44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:10.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.170+0000 7f109d247740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641ba61cc60 con 0x5641ba6e4050 2024-04-25T10:00:10.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.170+0000 7f109d247740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641ba5bbd80 con 0x5641ba6b9590 2024-04-25T10:00:10.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.170+0000 7f109d247740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641ba618d00 con 0x5641ba6f5c60 2024-04-25T10:00:10.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.170+0000 7f1098adf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5641ba6e4050 0x5641ba6e44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:10.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.170+0000 7f1098adf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5641ba6e4050 0x5641ba6e44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42620/0 (socket says 172.21.15.7:42620) 2024-04-25T10:00:10.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.170+0000 7f1098adf640 1 -- 172.21.15.7:0/3981453658 learned_addr learned my addr 172.21.15.7:0/3981453658 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:10.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.170+0000 7f10937fe640 1 --2- 172.21.15.7:0/3981453658 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5641ba6f5c60 0x5641ba6b9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:10.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.170+0000 7f1093fff640 1 --2- 172.21.15.7:0/3981453658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5641ba6b9590 0x5641ba6bb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:10.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.170+0000 7f1098adf640 1 -- 172.21.15.7:0/3981453658 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5641ba6f5c60 msgr2=0x5641ba6b9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:10.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.170+0000 7f1098adf640 1 --2- 172.21.15.7:0/3981453658 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5641ba6f5c60 0x5641ba6b9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.170+0000 7f1098adf640 1 -- 172.21.15.7:0/3981453658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5641ba6b9590 msgr2=0x5641ba6bb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:10.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.170+0000 7f1098adf640 1 --2- 172.21.15.7:0/3981453658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5641ba6b9590 0x5641ba6bb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.170+0000 7f1098adf640 1 -- 172.21.15.7:0/3981453658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641ba3fd7c0 con 0x5641ba6e4050 2024-04-25T10:00:10.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.170+0000 7f1098adf640 1 --2- 172.21.15.7:0/3981453658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5641ba6e4050 0x5641ba6e44d0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f108c002060 tx=0x7f108c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64dcdd082cf4ac04 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:10.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.171+0000 7f1089ffb640 1 -- 172.21.15.7:0/3981453658 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c019070 con 0x5641ba6e4050 2024-04-25T10:00:10.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.171+0000 7f1089ffb640 1 -- 172.21.15.7:0/3981453658 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108c014480 con 0x5641ba6e4050 2024-04-25T10:00:10.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.171+0000 7f1089ffb640 1 -- 172.21.15.7:0/3981453658 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c014830 con 0x5641ba6e4050 2024-04-25T10:00:10.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.171+0000 7f109d247740 1 -- 172.21.15.7:0/3981453658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5641ba6e4050 msgr2=0x5641ba6e44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:10.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.171+0000 7f109d247740 1 --2- 172.21.15.7:0/3981453658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5641ba6e4050 0x5641ba6e44d0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f108c002060 tx=0x7f108c00e530 comp rx=0 tx=0).stop 2024-04-25T10:00:10.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.171+0000 7f109d247740 1 -- 172.21.15.7:0/3981453658 shutdown_connections 2024-04-25T10:00:10.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.171+0000 7f109d247740 1 --2- 172.21.15.7:0/3981453658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5641ba6e4050 0x5641ba6e44d0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.171+0000 7f109d247740 1 --2- 172.21.15.7:0/3981453658 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5641ba6f5c60 0x5641ba6b9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.171+0000 7f109d247740 1 --2- 172.21.15.7:0/3981453658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5641ba6b9590 0x5641ba6bb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.171+0000 7f109d247740 1 -- 172.21.15.7:0/3981453658 >> 172.21.15.7:0/3981453658 conn(0x5641ba6816e0 msgr2=0x5641ba6ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:10.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.171+0000 7f109d247740 1 -- 172.21.15.7:0/3981453658 shutdown_connections 2024-04-25T10:00:10.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.171+0000 7f109d247740 1 -- 172.21.15.7:0/3981453658 wait complete. 2024-04-25T10:00:10.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.172+0000 7f109d247740 1 -- start start 2024-04-25T10:00:10.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.172+0000 7f109d247740 1 Processor -- start 2024-04-25T10:00:10.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.173+0000 7f109d247740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5641ba6b9590 0x5641ba6f60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:10.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.173+0000 7f109d247740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5641ba6e4050 0x5641ba6d38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:10.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.173+0000 7f109d247740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5641ba6f5c60 0x5641ba6f6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:10.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.173+0000 7f109d247740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641ba5b9840 con 0x5641ba6f5c60 2024-04-25T10:00:10.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.173+0000 7f109d247740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641ba6e1ba0 con 0x5641ba6e4050 2024-04-25T10:00:10.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.173+0000 7f109d247740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641ba6d3e20 con 0x5641ba6b9590 2024-04-25T10:00:10.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.173+0000 7f109d247740 10 client.0 _ll_register_callbacks cb 0x5641ba5d3980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:00:10.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.173+0000 7f1098adf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5641ba6f5c60 0x5641ba6f6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:10.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.173+0000 7f1098adf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5641ba6f5c60 0x5641ba6f6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42630/0 (socket says 172.21.15.7:42630) 2024-04-25T10:00:10.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.173+0000 7f1098adf640 1 -- 172.21.15.7:0/27575959 learned_addr learned my addr 172.21.15.7:0/27575959 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:10.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.173+0000 7f10937fe640 1 --2- 172.21.15.7:0/27575959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5641ba6e4050 0x5641ba6d38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:10.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.173+0000 7f1093fff640 1 --2- 172.21.15.7:0/27575959 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5641ba6b9590 0x5641ba6f60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:10.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.173+0000 7f1098adf640 1 -- 172.21.15.7:0/27575959 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5641ba6b9590 msgr2=0x5641ba6f60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:10.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.173+0000 7f1098adf640 1 --2- 172.21.15.7:0/27575959 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5641ba6b9590 0x5641ba6f60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.173+0000 7f1098adf640 1 -- 172.21.15.7:0/27575959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5641ba6e4050 msgr2=0x5641ba6d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:10.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.173+0000 7f1098adf640 1 --2- 172.21.15.7:0/27575959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5641ba6e4050 0x5641ba6d38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.173+0000 7f1098adf640 1 -- 172.21.15.7:0/27575959 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5641ba45df50 con 0x5641ba6f5c60 2024-04-25T10:00:10.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.173+0000 7f1098adf640 1 --2- 172.21.15.7:0/27575959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5641ba6f5c60 0x5641ba6f6f00 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f108c017040 tx=0x7f108c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64633a04cb60c204 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:10.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.173+0000 7f1072ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:00:10.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.174+0000 7f1072ffd640 1 -- 172.21.15.7:0/27575959 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c022020 con 0x5641ba6f5c60 2024-04-25T10:00:10.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.174+0000 7f1072ffd640 1 -- 172.21.15.7:0/27575959 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f108c014be0 con 0x5641ba6f5c60 2024-04-25T10:00:10.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.174+0000 7f109d247740 1 -- 172.21.15.7:0/27575959 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f108c014480 con 0x5641ba6f5c60 2024-04-25T10:00:10.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.174+0000 7f1072ffd640 1 -- 172.21.15.7:0/27575959 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f108c02c050 con 0x5641ba6f5c60 2024-04-25T10:00:10.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.174+0000 7f109d247740 10 client.7329 fetch_fsmap learned FSMap version 45 2024-04-25T10:00:10.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.174+0000 7f109d247740 1 -- 172.21.15.7:0/27575959 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) v3 -- 0x5641ba2f10b0 con 0x5641ba6f5c60 2024-04-25T10:00:10.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.174+0000 7f1072ffd640 1 -- 172.21.15.7:0/27575959 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108c014480 con 0x5641ba6f5c60 2024-04-25T10:00:10.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.174+0000 7f1072ffd640 1 -- 172.21.15.7:0/27575959 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 45) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f108c02f020 con 0x5641ba6f5c60 2024-04-25T10:00:10.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.174+0000 7f109d247740 10 client.7329 fetch_fsmap finished waiting for FSMap version 45 2024-04-25T10:00:10.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.174+0000 7f109d247740 10 client.7329 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T10:00:10.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.174+0000 7f109d247740 20 client.7329 populate_metadata read hostname 'smithi007' 2024-04-25T10:00:10.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.174+0000 7f109d247740 1 --2- 172.21.15.7:0/27575959 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5641ba6f75c0 0x5641ba6e68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:10.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.174+0000 7f109d247740 4 client.7329 mds_command: new command op to 6813 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:00:10.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.174+0000 7f109d247740 1 -- 172.21.15.7:0/27575959 --> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5641ba5dce60 con 0x5641ba6f75c0 2024-04-25T10:00:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.174+0000 7f1093fff640 1 --2- 172.21.15.7:0/27575959 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5641ba6f75c0 0x5641ba6e68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.175+0000 7f1093fff640 1 --2- 172.21.15.7:0/27575959 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5641ba6f75c0 0x5641ba6e68f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4550567a25b532d server_cookie=e84eb2cdec42d9f9 in_seq=0 out_seq=0 2024-04-25T10:00:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.175+0000 7f1072ffd640 10 client.7329 ms_handle_connect on v2:172.21.15.7:6836/3690076929 2024-04-25T10:00:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.175+0000 7f1072ffd640 1 -- 172.21.15.7:0/27575959 <== mds.0 v2:172.21.15.7:6836/3690076929 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5641ba5dce60 con 0x5641ba6f75c0 2024-04-25T10:00:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.175+0000 7f1072ffd640 10 client.7329 handle_command_reply: tid=0 2024-04-25T10:00:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.175+0000 7f109d247740 1 client.7329 shutdown 2024-04-25T10:00:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.175+0000 7f109d247740 1 -- 172.21.15.7:0/27575959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5641ba6f5c60 msgr2=0x5641ba6f6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.175+0000 7f109d247740 1 --2- 172.21.15.7:0/27575959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5641ba6f5c60 0x5641ba6f6f00 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f108c017040 tx=0x7f108c001250 comp rx=0 tx=0).stop 2024-04-25T10:00:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.175+0000 7f109d247740 1 -- 172.21.15.7:0/27575959 shutdown_connections 2024-04-25T10:00:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.175+0000 7f109d247740 1 --2- 172.21.15.7:0/27575959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5641ba6f5c60 0x5641ba6f6f00 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.175+0000 7f109d247740 1 --2- 172.21.15.7:0/27575959 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5641ba6f75c0 0x5641ba6e68f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.175+0000 7f109d247740 1 --2- 172.21.15.7:0/27575959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5641ba6e4050 0x5641ba6d38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.175+0000 7f109d247740 1 --2- 172.21.15.7:0/27575959 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5641ba6b9590 0x5641ba6f60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.175+0000 7f109d247740 1 -- 172.21.15.7:0/27575959 >> 172.21.15.7:0/27575959 conn(0x5641ba6816e0 msgr2=0x5641ba6e1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.175+0000 7f1072ffd640 0 client.7329 ms_handle_reset on v2:172.21.15.7:6836/3690076929 2024-04-25T10:00:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.175+0000 7f109d247740 1 -- 172.21.15.7:0/27575959 shutdown_connections 2024-04-25T10:00:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.176+0000 7f109d247740 1 -- 172.21.15.7:0/27575959 wait complete. 2024-04-25T10:00:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.176+0000 7f109d247740 20 client.7329 trim_cache size 0 max 16384 2024-04-25T10:00:10.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.187+0000 7f109d247740 1 Processor -- start 2024-04-25T10:00:10.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.187+0000 7f109d247740 1 -- start start 2024-04-25T10:00:10.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.188+0000 7f109d247740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5641ba6b9590 0x5641ba7605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:10.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.188+0000 7f109d247740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5641ba6e4050 0x5641ba6feec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:10.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.188+0000 7f109d247740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5641ba6f5c60 0x5641ba6ff400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:10.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.188+0000 7f109d247740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10941ff7a0 con 0x5641ba6b9590 2024-04-25T10:00:10.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.188+0000 7f109d247740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10940c5d00 con 0x5641ba6e4050 2024-04-25T10:00:10.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.188+0000 7f109d247740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10941ff1a0 con 0x5641ba6f5c60 2024-04-25T10:00:10.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.188+0000 7f1093fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5641ba6b9590 0x5641ba7605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:10.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.188+0000 7f1093fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5641ba6b9590 0x5641ba7605d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42646/0 (socket says 172.21.15.7:42646) 2024-04-25T10:00:10.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.188+0000 7f1093fff640 1 -- 172.21.15.7:0/1303534212 learned_addr learned my addr 172.21.15.7:0/1303534212 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:10.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.188+0000 7f1098adf640 1 --2- 172.21.15.7:0/1303534212 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5641ba6f5c60 0x5641ba6ff400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:10.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.188+0000 7f10937fe640 1 --2- 172.21.15.7:0/1303534212 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5641ba6e4050 0x5641ba6feec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:10.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.188+0000 7f1093fff640 1 -- 172.21.15.7:0/1303534212 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5641ba6f5c60 msgr2=0x5641ba6ff400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:10.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.188+0000 7f1093fff640 1 --2- 172.21.15.7:0/1303534212 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5641ba6f5c60 0x5641ba6ff400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.188+0000 7f1093fff640 1 -- 172.21.15.7:0/1303534212 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5641ba6e4050 msgr2=0x5641ba6feec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:10.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.188+0000 7f1093fff640 1 --2- 172.21.15.7:0/1303534212 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5641ba6e4050 0x5641ba6feec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.188+0000 7f1093fff640 1 -- 172.21.15.7:0/1303534212 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641ba6b69e0 con 0x5641ba6b9590 2024-04-25T10:00:10.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.188+0000 7f1098adf640 1 --2- 172.21.15.7:0/1303534212 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5641ba6f5c60 0x5641ba6ff400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:10.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.188+0000 7f10937fe640 1 --2- 172.21.15.7:0/1303534212 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5641ba6e4050 0x5641ba6feec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:10.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.189+0000 7f1093fff640 1 --2- 172.21.15.7:0/1303534212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5641ba6b9590 0x5641ba7605d0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f107c00fd90 tx=0x7f107c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b18bdee5e5a4caa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:10.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.189+0000 7f10897fa640 1 -- 172.21.15.7:0/1303534212 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c019030 con 0x5641ba6b9590 2024-04-25T10:00:10.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.189+0000 7f10897fa640 1 -- 172.21.15.7:0/1303534212 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107c02a020 con 0x5641ba6b9590 2024-04-25T10:00:10.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.189+0000 7f10897fa640 1 -- 172.21.15.7:0/1303534212 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c007030 con 0x5641ba6b9590 2024-04-25T10:00:10.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.189+0000 7f109d247740 1 -- 172.21.15.7:0/1303534212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5641ba6b9590 msgr2=0x5641ba7605d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:10.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.189+0000 7f109d247740 1 --2- 172.21.15.7:0/1303534212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5641ba6b9590 0x5641ba7605d0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f107c00fd90 tx=0x7f107c012000 comp rx=0 tx=0).stop 2024-04-25T10:00:10.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.189+0000 7f109d247740 1 -- 172.21.15.7:0/1303534212 shutdown_connections 2024-04-25T10:00:10.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.189+0000 7f109d247740 1 --2- 172.21.15.7:0/1303534212 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5641ba6f5c60 0x5641ba6ff400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.189+0000 7f109d247740 1 --2- 172.21.15.7:0/1303534212 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5641ba6e4050 0x5641ba6feec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.189+0000 7f109d247740 1 --2- 172.21.15.7:0/1303534212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5641ba6b9590 0x5641ba7605d0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.189+0000 7f109d247740 1 -- 172.21.15.7:0/1303534212 >> 172.21.15.7:0/1303534212 conn(0x5641ba6816e0 msgr2=0x5641ba6ba470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:10.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.189+0000 7f109d247740 1 -- 172.21.15.7:0/1303534212 shutdown_connections 2024-04-25T10:00:10.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.189+0000 7f109d247740 1 -- 172.21.15.7:0/1303534212 wait complete. 2024-04-25T10:00:10.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.190+0000 7f109d247740 1 -- start start 2024-04-25T10:00:10.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.190+0000 7f109d247740 1 Processor -- start 2024-04-25T10:00:10.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.191+0000 7f109d247740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5641ba6b9590 0x5641ba758a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:10.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.191+0000 7f109d247740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5641ba6e4050 0x5641ba769910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:10.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.191+0000 7f109d247740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5641ba6f5c60 0x5641ba6b7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:10.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.191+0000 7f109d247740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641ba6f7440 con 0x5641ba6b9590 2024-04-25T10:00:10.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.191+0000 7f109d247740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641ba70f9a0 con 0x5641ba6e4050 2024-04-25T10:00:10.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.191+0000 7f109d247740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641ba70eda0 con 0x5641ba6f5c60 2024-04-25T10:00:10.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.191+0000 7f109d247740 10 client.0 _ll_register_callbacks cb 0x7f108c001aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:00:10.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.191+0000 7f1093fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5641ba6b9590 0x5641ba758a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:10.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.191+0000 7f1093fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5641ba6b9590 0x5641ba758a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42654/0 (socket says 172.21.15.7:42654) 2024-04-25T10:00:10.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.191+0000 7f1093fff640 1 -- 172.21.15.7:0/966498323 learned_addr learned my addr 172.21.15.7:0/966498323 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:10.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.191+0000 7f1098adf640 1 --2- 172.21.15.7:0/966498323 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5641ba6f5c60 0x5641ba6b7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:10.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.191+0000 7f10937fe640 1 --2- 172.21.15.7:0/966498323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5641ba6e4050 0x5641ba769910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:10.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.191+0000 7f1093fff640 1 -- 172.21.15.7:0/966498323 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5641ba6f5c60 msgr2=0x5641ba6b7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:10.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.191+0000 7f1093fff640 1 --2- 172.21.15.7:0/966498323 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5641ba6f5c60 0x5641ba6b7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.191+0000 7f1093fff640 1 -- 172.21.15.7:0/966498323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5641ba6e4050 msgr2=0x5641ba769910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:10.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.191+0000 7f1093fff640 1 --2- 172.21.15.7:0/966498323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5641ba6e4050 0x5641ba769910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.191+0000 7f1093fff640 1 -- 172.21.15.7:0/966498323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5641ba769e50 con 0x5641ba6b9590 2024-04-25T10:00:10.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.191+0000 7f10937fe640 1 --2- 172.21.15.7:0/966498323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5641ba6e4050 0x5641ba769910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:10.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.191+0000 7f1093fff640 1 --2- 172.21.15.7:0/966498323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5641ba6b9590 0x5641ba758a00 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f107c00f5a0 tx=0x7f107c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87426baa16861fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:10.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.191+0000 7f1072ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:00:10.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.192+0000 7f1072ffd640 1 -- 172.21.15.7:0/966498323 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c033060 con 0x5641ba6b9590 2024-04-25T10:00:10.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.192+0000 7f1072ffd640 1 -- 172.21.15.7:0/966498323 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f107c007670 con 0x5641ba6b9590 2024-04-25T10:00:10.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.192+0000 7f109d247740 1 -- 172.21.15.7:0/966498323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f107c02a020 con 0x5641ba6b9590 2024-04-25T10:00:10.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.192+0000 7f1072ffd640 1 -- 172.21.15.7:0/966498323 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f107c039050 con 0x5641ba6b9590 2024-04-25T10:00:10.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.192+0000 7f109d247740 10 client.7335 fetch_fsmap learned FSMap version 45 2024-04-25T10:00:10.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.192+0000 7f109d247740 1 -- 172.21.15.7:0/966498323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) v3 -- 0x5641ba76a060 con 0x5641ba6b9590 2024-04-25T10:00:10.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.192+0000 7f1072ffd640 1 -- 172.21.15.7:0/966498323 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107c02a020 con 0x5641ba6b9590 2024-04-25T10:00:10.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.192+0000 7f1072ffd640 1 -- 172.21.15.7:0/966498323 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 45) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f107c03c020 con 0x5641ba6b9590 2024-04-25T10:00:10.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.192+0000 7f109d247740 10 client.7335 fetch_fsmap finished waiting for FSMap version 45 2024-04-25T10:00:10.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.192+0000 7f109d247740 10 client.7335 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T10:00:10.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.192+0000 7f109d247740 20 client.7335 populate_metadata read hostname 'smithi007' 2024-04-25T10:00:10.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.192+0000 7f109d247740 1 --2- 172.21.15.7:0/966498323 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5641ba718a60 0x5641ba70d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:10.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.192+0000 7f109d247740 4 client.7335 mds_command: new command op to 6813 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T10:00:10.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.192+0000 7f109d247740 1 -- 172.21.15.7:0/966498323 --> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x5641ba6e1d60 con 0x5641ba718a60 2024-04-25T10:00:10.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.192+0000 7f10937fe640 1 --2- 172.21.15.7:0/966498323 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5641ba718a60 0x5641ba70d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:10.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.193+0000 7f1072ffd640 10 client.7335 ms_handle_connect on v2:172.21.15.7:6836/3690076929 2024-04-25T10:00:10.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.193+0000 7f10937fe640 1 --2- 172.21.15.7:0/966498323 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5641ba718a60 0x5641ba70d770 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a551c9bda3e3000b server_cookie=9f948f99a66fbfc0 in_seq=0 out_seq=0 2024-04-25T10:00:10.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.193+0000 7f1072ffd640 1 -- 172.21.15.7:0/966498323 <== mds.0 v2:172.21.15.7:6836/3690076929 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5641ba6e1d60 con 0x5641ba718a60 2024-04-25T10:00:10.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.193+0000 7f1072ffd640 10 client.7335 handle_command_reply: tid=0 2024-04-25T10:00:10.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.193+0000 7f109d247740 1 client.7335 shutdown 2024-04-25T10:00:10.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.193+0000 7f109d247740 1 -- 172.21.15.7:0/966498323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5641ba6b9590 msgr2=0x5641ba758a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:10.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.193+0000 7f109d247740 1 --2- 172.21.15.7:0/966498323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5641ba6b9590 0x5641ba758a00 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f107c00f5a0 tx=0x7f107c000ed0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.193+0000 7f109d247740 1 -- 172.21.15.7:0/966498323 shutdown_connections 2024-04-25T10:00:10.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.193+0000 7f109d247740 1 --2- 172.21.15.7:0/966498323 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5641ba6f5c60 0x5641ba6b7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.193+0000 7f109d247740 1 --2- 172.21.15.7:0/966498323 >> [v2:172.21.15.7:6836/3690076929,v1:172.21.15.7:6837/3690076929] conn(0x5641ba718a60 0x5641ba70d770 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.193+0000 7f109d247740 1 --2- 172.21.15.7:0/966498323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5641ba6e4050 0x5641ba769910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.193+0000 7f109d247740 1 --2- 172.21.15.7:0/966498323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5641ba6b9590 0x5641ba758a00 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.193+0000 7f1072ffd640 0 client.7335 ms_handle_reset on v2:172.21.15.7:6836/3690076929 2024-04-25T10:00:10.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.193+0000 7f109d247740 1 -- 172.21.15.7:0/966498323 >> 172.21.15.7:0/966498323 conn(0x5641ba6816e0 msgr2=0x5641ba7638a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:10.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.193+0000 7f109d247740 1 -- 172.21.15.7:0/966498323 shutdown_connections 2024-04-25T10:00:10.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.193+0000 7f109d247740 1 -- 172.21.15.7:0/966498323 wait complete. 2024-04-25T10:00:10.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.193+0000 7f109d247740 20 client.7335 trim_cache size 0 max 16384 2024-04-25T10:00:10.204 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:00:10.204 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-04-25T10:00:10.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.194+0000 7f109a542640 1 -- 172.21.15.7:0/882338424 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f107406b4d0 msgr2=0x7f107406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:10.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.194+0000 7f109a542640 1 --2- 172.21.15.7:0/882338424 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f107406b4d0 0x7f107406d990 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f107c001780 tx=0x7f107c009040 comp rx=0 tx=0).stop 2024-04-25T10:00:10.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.194+0000 7f109a542640 1 -- 172.21.15.7:0/882338424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10940d0a00 msgr2=0x7f10940ca4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:10.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.194+0000 7f109a542640 1 --2- 172.21.15.7:0/882338424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10940d0a00 0x7f10940ca4f0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f10840097a0 tx=0x7f10840046c0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.194+0000 7f109a542640 1 -- 172.21.15.7:0/882338424 shutdown_connections 2024-04-25T10:00:10.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.194+0000 7f109a542640 1 --2- 172.21.15.7:0/882338424 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f107406b4d0 0x7f107406d990 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.194+0000 7f109a542640 1 --2- 172.21.15.7:0/882338424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1094161200 0x7f10941e75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.194+0000 7f109a542640 1 --2- 172.21.15.7:0/882338424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10940d0a00 0x7f10940ca4f0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.194+0000 7f109a542640 1 --2- 172.21.15.7:0/882338424 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f109409a7d0 0x7f10940b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.194+0000 7f109a542640 1 -- 172.21.15.7:0/882338424 >> 172.21.15.7:0/882338424 conn(0x7f10940b31a0 msgr2=0x7f10941617c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:10.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.194+0000 7f109a542640 1 -- 172.21.15.7:0/882338424 shutdown_connections 2024-04-25T10:00:10.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.194+0000 7f109a542640 1 -- 172.21.15.7:0/882338424 wait complete. 2024-04-25T10:00:10.208 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T10:00:10.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.304+0000 7f4afd2e2640 1 Processor -- start 2024-04-25T10:00:10.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.304+0000 7f4afd2e2640 1 -- start start 2024-04-25T10:00:10.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.305+0000 7f4afd2e2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4af80b9580 0x7f4af80d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:10.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.305+0000 7f4afd2e2640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4af80d32e0 0x7f4af80d0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:10.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.305+0000 7f4afd2e2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af80d2240 con 0x7f4af815dad0 2024-04-25T10:00:10.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.305+0000 7f4afd2e2640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af80b7990 con 0x7f4af80d32e0 2024-04-25T10:00:10.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.305+0000 7f4afd2e2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af80d1fe0 con 0x7f4af80b9580 2024-04-25T10:00:10.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.305+0000 7f4af77fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4af80d32e0 0x7f4af80d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:10.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.305+0000 7f4af77fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4af80d32e0 0x7f4af80d0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42670/0 (socket says 172.21.15.7:42670) 2024-04-25T10:00:10.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.305+0000 7f4af77fe640 1 -- 172.21.15.7:0/1385068721 learned_addr learned my addr 172.21.15.7:0/1385068721 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:10.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.305+0000 7f4aeffff640 1 --2- 172.21.15.7:0/1385068721 >> v2:172.21.15.55:3300/0 conn(0x7f4af80b9580 0x7f4af80d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:10.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.305+0000 7f4af77fe640 1 -- 172.21.15.7:0/1385068721 >> v2:172.21.15.55:3300/0 conn(0x7f4af80b9580 msgr2=0x7f4af80d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:10.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.305+0000 7f4af77fe640 1 --2- 172.21.15.7:0/1385068721 >> v2:172.21.15.55:3300/0 conn(0x7f4af80b9580 0x7f4af80d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.305+0000 7f4af77fe640 1 -- 172.21.15.7:0/1385068721 >> v1:172.21.15.55:6789/0 conn(0x7f4af815dad0 legacy=0x7f4af80d18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:10.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.305+0000 7f4af77fe640 1 -- 172.21.15.7:0/1385068721 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af80d2520 con 0x7f4af80d32e0 2024-04-25T10:00:10.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.305+0000 7f4aeffff640 1 --2- 172.21.15.7:0/1385068721 >> v2:172.21.15.55:3300/0 conn(0x7f4af80b9580 0x7f4af80d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:00:10.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.306+0000 7f4af77fe640 1 --2- 172.21.15.7:0/1385068721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4af80d32e0 0x7f4af80d0780 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f4af80b8f00 tx=0x7f4af002a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ff8e618bbbb7fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:10.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.306+0000 7f4af67fc640 1 -- 172.21.15.7:0/1385068721 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af0036070 con 0x7f4af80d32e0 2024-04-25T10:00:10.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.306+0000 7f4af67fc640 1 -- 172.21.15.7:0/1385068721 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af0031600 con 0x7f4af80d32e0 2024-04-25T10:00:10.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.306+0000 7f4af67fc640 1 -- 172.21.15.7:0/1385068721 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af00319d0 con 0x7f4af80d32e0 2024-04-25T10:00:10.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.306+0000 7f4afd2e2640 1 -- 172.21.15.7:0/1385068721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4af80d32e0 msgr2=0x7f4af80d0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:10.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.306+0000 7f4afd2e2640 1 --2- 172.21.15.7:0/1385068721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4af80d32e0 0x7f4af80d0780 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f4af80b8f00 tx=0x7f4af002a780 comp rx=0 tx=0).stop 2024-04-25T10:00:10.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.306+0000 7f4afd2e2640 1 -- 172.21.15.7:0/1385068721 shutdown_connections 2024-04-25T10:00:10.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.306+0000 7f4afd2e2640 1 --2- 172.21.15.7:0/1385068721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4af80d32e0 0x7f4af80d0780 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.306+0000 7f4afd2e2640 1 --2- 172.21.15.7:0/1385068721 >> v2:172.21.15.55:3300/0 conn(0x7f4af80b9580 0x7f4af80d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.306+0000 7f4afd2e2640 1 -- 172.21.15.7:0/1385068721 >> 172.21.15.7:0/1385068721 conn(0x7f4af806bfe0 msgr2=0x7f4af806c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:10.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.307+0000 7f4afd2e2640 1 -- 172.21.15.7:0/1385068721 shutdown_connections 2024-04-25T10:00:10.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.307+0000 7f4afd2e2640 1 -- 172.21.15.7:0/1385068721 wait complete. 2024-04-25T10:00:10.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.308+0000 7f4afd2e2640 1 Processor -- start 2024-04-25T10:00:10.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.308+0000 7f4afd2e2640 1 -- start start 2024-04-25T10:00:10.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.308+0000 7f4afd2e2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4af80b9580 0x7f4af814aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:10.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.308+0000 7f4afd2e2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4af80d32e0 0x7f4af81555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:10.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.308+0000 7f4afd2e2640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4af815dad0 0x7f4af8155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:10.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.308+0000 7f4afd2e2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af80d2dc0 con 0x7f4af80b9580 2024-04-25T10:00:10.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.308+0000 7f4afd2e2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af80d2ae0 con 0x7f4af80d32e0 2024-04-25T10:00:10.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.308+0000 7f4afd2e2640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af815deb0 con 0x7f4af815dad0 2024-04-25T10:00:10.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.308+0000 7f4af6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4af80b9580 0x7f4af814aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:10.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.309+0000 7f4af6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4af80b9580 0x7f4af814aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42678/0 (socket says 172.21.15.7:42678) 2024-04-25T10:00:10.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.309+0000 7f4af6ffd640 1 -- 172.21.15.7:0/1320687576 learned_addr learned my addr 172.21.15.7:0/1320687576 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:10.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.309+0000 7f4af77fe640 1 --2- 172.21.15.7:0/1320687576 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4af815dad0 0x7f4af8155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:10.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.309+0000 7f4aeffff640 1 --2- 172.21.15.7:0/1320687576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4af80d32e0 0x7f4af81555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:10.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.309+0000 7f4af6ffd640 1 -- 172.21.15.7:0/1320687576 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4af815dad0 msgr2=0x7f4af8155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:10.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.309+0000 7f4af6ffd640 1 --2- 172.21.15.7:0/1320687576 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4af815dad0 0x7f4af8155b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.309+0000 7f4af6ffd640 1 -- 172.21.15.7:0/1320687576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4af80d32e0 msgr2=0x7f4af81555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:10.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.309+0000 7f4af6ffd640 1 --2- 172.21.15.7:0/1320687576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4af80d32e0 0x7f4af81555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.309+0000 7f4af6ffd640 1 -- 172.21.15.7:0/1320687576 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af80cb970 con 0x7f4af80b9580 2024-04-25T10:00:10.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.309+0000 7f4af77fe640 1 --2- 172.21.15.7:0/1320687576 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4af815dad0 0x7f4af8155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:10.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.309+0000 7f4af6ffd640 1 --2- 172.21.15.7:0/1320687576 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4af80b9580 0x7f4af814aff0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f4ae800c430 tx=0x7f4ae800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:10.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.309+0000 7f4aef7fe640 1 -- 172.21.15.7:0/1320687576 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8011790 con 0x7f4af80b9580 2024-04-25T10:00:10.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.309+0000 7f4aef7fe640 1 -- 172.21.15.7:0/1320687576 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae8017070 con 0x7f4af80b9580 2024-04-25T10:00:10.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.309+0000 7f4afd2e2640 1 -- 172.21.15.7:0/1320687576 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af8159c90 con 0x7f4af80b9580 2024-04-25T10:00:10.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.309+0000 7f4aef7fe640 1 -- 172.21.15.7:0/1320687576 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8011b70 con 0x7f4af80b9580 2024-04-25T10:00:10.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.309+0000 7f4afd2e2640 1 -- 172.21.15.7:0/1320687576 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af8156400 con 0x7f4af80b9580 2024-04-25T10:00:10.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.310+0000 7f4afd2e2640 1 -- 172.21.15.7:0/1320687576 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af8074bb0 con 0x7f4af80b9580 2024-04-25T10:00:10.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.311+0000 7f4aef7fe640 1 -- 172.21.15.7:0/1320687576 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4ae8011d10 con 0x7f4af80b9580 2024-04-25T10:00:10.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.311+0000 7f4aef7fe640 1 --2- 172.21.15.7:0/1320687576 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4ad806b4d0 0x7f4ad806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:10.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.311+0000 7f4aef7fe640 1 -- 172.21.15.7:0/1320687576 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f4ae808a2a0 con 0x7f4af80b9580 2024-04-25T10:00:10.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.311+0000 7f4aeffff640 1 --2- 172.21.15.7:0/1320687576 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4ad806b4d0 0x7f4ad806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:10.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.312+0000 7f4aeffff640 1 --2- 172.21.15.7:0/1320687576 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4ad806b4d0 0x7f4ad806d990 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4af806ca00 tx=0x7f4ae0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:10.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.316+0000 7f4aef7fe640 1 -- 172.21.15.7:0/1320687576 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4af80cb970 con 0x7f4af80b9580 2024-04-25T10:00:10.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.533+0000 7f4afd2e2640 1 -- 172.21.15.7:0/1320687576 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4af80b8f80 con 0x7f4af80b9580 2024-04-25T10:00:10.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.533+0000 7f4aef7fe640 1 -- 172.21.15.7:0/1320687576 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f4ae8058f40 con 0x7f4af80b9580 2024-04-25T10:00:10.538 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:00:10.538 INFO:teuthology.orchestra.run.smithi007.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T10:00:10.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.535+0000 7f4afd2e2640 1 -- 172.21.15.7:0/1320687576 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4ad806b4d0 msgr2=0x7f4ad806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:10.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.535+0000 7f4afd2e2640 1 --2- 172.21.15.7:0/1320687576 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4ad806b4d0 0x7f4ad806d990 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4af806ca00 tx=0x7f4ae0008040 comp rx=0 tx=0).stop 2024-04-25T10:00:10.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.535+0000 7f4afd2e2640 1 -- 172.21.15.7:0/1320687576 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4af80b9580 msgr2=0x7f4af814aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:10.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.535+0000 7f4afd2e2640 1 --2- 172.21.15.7:0/1320687576 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4af80b9580 0x7f4af814aff0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f4ae800c430 tx=0x7f4ae800c8f0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.535+0000 7f4afd2e2640 1 -- 172.21.15.7:0/1320687576 shutdown_connections 2024-04-25T10:00:10.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.535+0000 7f4afd2e2640 1 --2- 172.21.15.7:0/1320687576 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4ad806b4d0 0x7f4ad806d990 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.535+0000 7f4afd2e2640 1 --2- 172.21.15.7:0/1320687576 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4af815dad0 0x7f4af8155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.535+0000 7f4afd2e2640 1 --2- 172.21.15.7:0/1320687576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4af80d32e0 0x7f4af81555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.535+0000 7f4afd2e2640 1 --2- 172.21.15.7:0/1320687576 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4af80b9580 0x7f4af814aff0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.535+0000 7f4afd2e2640 1 -- 172.21.15.7:0/1320687576 >> 172.21.15.7:0/1320687576 conn(0x7f4af806bfe0 msgr2=0x7f4af815c160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:10.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.535+0000 7f4afd2e2640 1 -- 172.21.15.7:0/1320687576 shutdown_connections 2024-04-25T10:00:10.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.535+0000 7f4afd2e2640 1 -- 172.21.15.7:0/1320687576 wait complete. 2024-04-25T10:00:10.550 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T10:00:10.551 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:00:10.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.648+0000 7f19466b6640 1 Processor -- start 2024-04-25T10:00:10.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.648+0000 7f19466b6640 1 -- start start 2024-04-25T10:00:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.649+0000 7f19466b6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f19400b6b90 0x7f19400d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.649+0000 7f19466b6640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f19400d0780 0x7f19400d27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.649+0000 7f19466b6640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1940162040 con 0x7f194015dc10 2024-04-25T10:00:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.649+0000 7f19466b6640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19400d1d90 con 0x7f19400d0780 2024-04-25T10:00:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.649+0000 7f19466b6640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19400d0c30 con 0x7f19400b6b90 2024-04-25T10:00:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.649+0000 7f1944c53640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f19400d0780 0x7f19400d27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.649+0000 7f1944c53640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f19400d0780 0x7f19400d27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42682/0 (socket says 172.21.15.7:42682) 2024-04-25T10:00:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.649+0000 7f1944c53640 1 -- 172.21.15.7:0/2608598543 learned_addr learned my addr 172.21.15.7:0/2608598543 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.650+0000 7f193f7fe640 1 --2- 172.21.15.7:0/2608598543 >> v2:172.21.15.55:3300/0 conn(0x7f19400b6b90 0x7f19400d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.650+0000 7f1944c53640 1 -- 172.21.15.7:0/2608598543 >> v2:172.21.15.55:3300/0 conn(0x7f19400b6b90 msgr2=0x7f19400d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:10.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.650+0000 7f1944c53640 1 --2- 172.21.15.7:0/2608598543 >> v2:172.21.15.55:3300/0 conn(0x7f19400b6b90 0x7f19400d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.650+0000 7f1944c53640 1 -- 172.21.15.7:0/2608598543 >> v1:172.21.15.55:6789/0 conn(0x7f194015dc10 legacy=0x7f19401615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:10.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.650+0000 7f1944c53640 1 -- 172.21.15.7:0/2608598543 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1940162320 con 0x7f19400d0780 2024-04-25T10:00:10.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.650+0000 7f1944c53640 1 --2- 172.21.15.7:0/2608598543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19400d0780 0x7f19400d27e0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f19400cfda0 tx=0x7f193802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c006e9990d2a8f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:10.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.651+0000 7f193effd640 1 -- 172.21.15.7:0/2608598543 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1938036070 con 0x7f19400d0780 2024-04-25T10:00:10.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.651+0000 7f193effd640 1 -- 172.21.15.7:0/2608598543 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1938031600 con 0x7f19400d0780 2024-04-25T10:00:10.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.651+0000 7f193effd640 1 -- 172.21.15.7:0/2608598543 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19380319d0 con 0x7f19400d0780 2024-04-25T10:00:10.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.651+0000 7f19466b6640 1 -- 172.21.15.7:0/2608598543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19400d0780 msgr2=0x7f19400d27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:10.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.651+0000 7f19466b6640 1 --2- 172.21.15.7:0/2608598543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19400d0780 0x7f19400d27e0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f19400cfda0 tx=0x7f193802a610 comp rx=0 tx=0).stop 2024-04-25T10:00:10.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.651+0000 7f19466b6640 1 -- 172.21.15.7:0/2608598543 shutdown_connections 2024-04-25T10:00:10.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.651+0000 7f19466b6640 1 --2- 172.21.15.7:0/2608598543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19400d0780 0x7f19400d27e0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.651+0000 7f19466b6640 1 --2- 172.21.15.7:0/2608598543 >> v2:172.21.15.55:3300/0 conn(0x7f19400b6b90 0x7f19400d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.651+0000 7f19466b6640 1 -- 172.21.15.7:0/2608598543 >> 172.21.15.7:0/2608598543 conn(0x7f1940072290 msgr2=0x7f19400726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:10.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.651+0000 7f19466b6640 1 -- 172.21.15.7:0/2608598543 shutdown_connections 2024-04-25T10:00:10.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.651+0000 7f19466b6640 1 -- 172.21.15.7:0/2608598543 wait complete. 2024-04-25T10:00:10.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.652+0000 7f19466b6640 1 Processor -- start 2024-04-25T10:00:10.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.653+0000 7f19466b6640 1 -- start start 2024-04-25T10:00:10.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.653+0000 7f19466b6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19400b6b90 0x7f1940157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:10.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.653+0000 7f19466b6640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19400d0780 0x7f19400ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:10.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.653+0000 7f19466b6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f194015dc10 0x7f19400b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:10.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.653+0000 7f19466b6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19400ce3e0 con 0x7f19400b6b90 2024-04-25T10:00:10.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.653+0000 7f19466b6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1940161d00 con 0x7f194015dc10 2024-04-25T10:00:10.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.653+0000 7f19466b6640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19400ce560 con 0x7f19400d0780 2024-04-25T10:00:10.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.653+0000 7f193ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19400b6b90 0x7f1940157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:10.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.653+0000 7f193ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19400b6b90 0x7f1940157c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42694/0 (socket says 172.21.15.7:42694) 2024-04-25T10:00:10.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.653+0000 7f193ffff640 1 -- 172.21.15.7:0/4257460922 learned_addr learned my addr 172.21.15.7:0/4257460922 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:10.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.653+0000 7f193f7fe640 1 --2- 172.21.15.7:0/4257460922 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19400d0780 0x7f19400ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:10.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.653+0000 7f1944c53640 1 --2- 172.21.15.7:0/4257460922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f194015dc10 0x7f19400b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:10.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.654+0000 7f193ffff640 1 -- 172.21.15.7:0/4257460922 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19400d0780 msgr2=0x7f19400ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:10.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.654+0000 7f193ffff640 1 --2- 172.21.15.7:0/4257460922 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19400d0780 0x7f19400ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.654+0000 7f193ffff640 1 -- 172.21.15.7:0/4257460922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f194015dc10 msgr2=0x7f19400b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:10.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.654+0000 7f193ffff640 1 --2- 172.21.15.7:0/4257460922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f194015dc10 0x7f19400b50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.654+0000 7f193ffff640 1 -- 172.21.15.7:0/4257460922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19401f3af0 con 0x7f19400b6b90 2024-04-25T10:00:10.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.654+0000 7f1944c53640 1 --2- 172.21.15.7:0/4257460922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f194015dc10 0x7f19400b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:10.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.654+0000 7f193ffff640 1 --2- 172.21.15.7:0/4257460922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19400b6b90 0x7f1940157c80 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f193000c430 tx=0x7f193000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:10.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.654+0000 7f193cff9640 1 -- 172.21.15.7:0/4257460922 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19300052d0 con 0x7f19400b6b90 2024-04-25T10:00:10.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.654+0000 7f193cff9640 1 -- 172.21.15.7:0/4257460922 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1930005490 con 0x7f19400b6b90 2024-04-25T10:00:10.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.654+0000 7f19466b6640 1 -- 172.21.15.7:0/4257460922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19401f3dd0 con 0x7f19400b6b90 2024-04-25T10:00:10.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.654+0000 7f193cff9640 1 -- 172.21.15.7:0/4257460922 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1930007260 con 0x7f19400b6b90 2024-04-25T10:00:10.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.654+0000 7f19466b6640 1 -- 172.21.15.7:0/4257460922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19401f4390 con 0x7f19400b6b90 2024-04-25T10:00:10.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.655+0000 7f19466b6640 1 -- 172.21.15.7:0/4257460922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1940068fd0 con 0x7f19400b6b90 2024-04-25T10:00:10.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.656+0000 7f193cff9640 1 -- 172.21.15.7:0/4257460922 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1930007400 con 0x7f19400b6b90 2024-04-25T10:00:10.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.656+0000 7f193cff9640 1 --2- 172.21.15.7:0/4257460922 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f192c06b4d0 0x7f192c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:10.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.656+0000 7f193cff9640 1 -- 172.21.15.7:0/4257460922 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f1930089820 con 0x7f19400b6b90 2024-04-25T10:00:10.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.656+0000 7f193f7fe640 1 --2- 172.21.15.7:0/4257460922 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f192c06b4d0 0x7f192c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:10.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.657+0000 7f193f7fe640 1 --2- 172.21.15.7:0/4257460922 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f192c06b4d0 0x7f192c06d990 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f19400c72f0 tx=0x7f1934008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:10.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.660+0000 7f193cff9640 1 -- 172.21.15.7:0/4257460922 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1930057e70 con 0x7f19400b6b90 2024-04-25T10:00:10.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.879+0000 7f19466b6640 1 -- 172.21.15.7:0/4257460922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f194015a640 con 0x7f19400b6b90 2024-04-25T10:00:10.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.879+0000 7f193cff9640 1 -- 172.21.15.7:0/4257460922 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v45) v1 ==== 53+0+73 (secure 0 0 0) 0x7f193005bf10 con 0x7f19400b6b90 2024-04-25T10:00:10.884 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T10:00:10.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.881+0000 7f19466b6640 1 -- 172.21.15.7:0/4257460922 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f192c06b4d0 msgr2=0x7f192c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:10.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.881+0000 7f19466b6640 1 --2- 172.21.15.7:0/4257460922 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f192c06b4d0 0x7f192c06d990 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f19400c72f0 tx=0x7f1934008040 comp rx=0 tx=0).stop 2024-04-25T10:00:10.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.881+0000 7f19466b6640 1 -- 172.21.15.7:0/4257460922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19400b6b90 msgr2=0x7f1940157c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:10.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.881+0000 7f19466b6640 1 --2- 172.21.15.7:0/4257460922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19400b6b90 0x7f1940157c80 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f193000c430 tx=0x7f193000c8f0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.881+0000 7f19466b6640 1 -- 172.21.15.7:0/4257460922 shutdown_connections 2024-04-25T10:00:10.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.881+0000 7f19466b6640 1 --2- 172.21.15.7:0/4257460922 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f192c06b4d0 0x7f192c06d990 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.881+0000 7f19466b6640 1 --2- 172.21.15.7:0/4257460922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f194015dc10 0x7f19400b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.881+0000 7f19466b6640 1 --2- 172.21.15.7:0/4257460922 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f19400d0780 0x7f19400ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.881+0000 7f19466b6640 1 --2- 172.21.15.7:0/4257460922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19400b6b90 0x7f1940157c80 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:10.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.881+0000 7f19466b6640 1 -- 172.21.15.7:0/4257460922 >> 172.21.15.7:0/4257460922 conn(0x7f1940072290 msgr2=0x7f194015b530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:10.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.881+0000 7f19466b6640 1 -- 172.21.15.7:0/4257460922 shutdown_connections 2024-04-25T10:00:10.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:10.881+0000 7f19466b6640 1 -- 172.21.15.7:0/4257460922 wait complete. 2024-04-25T10:00:10.896 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T10:00:10.896 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:00:10.896 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-04-25T10:00:10.896 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T10:00:10.896 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T10:00:10.896 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T10:00:10.897 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T10:00:10.897 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:00:10.897 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:00:10.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:10.897 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-04-25T10:00:10.915 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:00:10.915 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:00:10.915 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:00:10.915 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:00:10.915 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-04-25T10:00:10.915 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:00:10.915 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:00:10.915 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-04-25T10:00:10.915 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-04-25T10:00:10.915 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:00:10.915 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-04-25T10:00:10.916 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-04-25T10:00:10.916 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:00:10.916 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-04-25T10:00:10.916 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-04-25T10:00:10.916 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T10:00:10.916 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42389sec preferred_lft 42389sec 2024-04-25T10:00:10.916 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link noprefixroute 2024-04-25T10:00:10.916 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:00:10.916 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:00:10.916 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-04-25T10:00:10.916 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-04-25T10:00:10.916 INFO:teuthology.orchestra.run.smithi007.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T10:00:10.916 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 26:0c:99:53:12:e3 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:00:10.916 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T10:00:10.916 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:00:10.917 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::50aa:55ff:febc:5f67/64 scope link 2024-04-25T10:00:10.917 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:00:10.917 INFO:teuthology.orchestra.run.smithi007.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:00:10.917 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 6e:99:f1:00:a9:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:00:10.917 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6c99:f1ff:fe00:a95e/64 scope link 2024-04-25T10:00:10.917 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:00:10.917 INFO:teuthology.orchestra.run.smithi007.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:00:10.917 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 26:0c:99:53:12:e3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T10:00:10.917 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::240c:99ff:fe53:12e3/64 scope link 2024-04-25T10:00:10.917 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:00:10.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:10.918 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:00:10.978 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-04-25T10:00:10.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:10.980 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-04-25T10:00:11.036 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-04-25T10:00:11.036 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:00:11.036 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T10:00:11.036 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T10:00:11.036 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:00:11.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:11.036 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-04-25T10:00:11.036 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-25T10:00:11.036 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:00:11.037 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:00:11.037 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:00:11.037 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-25T10:00:11.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:11.122 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-04-25T10:00:11.137 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T10:00:11.137 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T10:00:11.137 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:00:11.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:11.138 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-04-25T10:00:11.201 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:00:11.202 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T10:00:11.257 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:00:11.258 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:00:11.258 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:00:11.313 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T10:00:11.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:11.313 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:00:11.395 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:00:11.395 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T10:00:11.395 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T10:00:11.403 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:00:11.404 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T10:00:11.404 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T10:00:11.404 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T10:00:11.404 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T10:00:11.409 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:00:11.409 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T10:00:11.409 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T10:00:11.409 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T10:00:11.409 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T10:00:11.409 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790" 2024-04-25T10:00:11.410 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790:/ 2024-04-25T10:00:11.410 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c03d0745-5946-49c3-ad88-1165c5b68b4e" will pass to kernel 2024-04-25T10:00:11.410 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T10:00:11.410 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-04-25T10:00:11.410 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T10:00:11.410 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T10:00:11.410 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T10:00:11.411 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T10:00:11.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:11.411 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:00:11.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:11.477 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:00:11.534 INFO:teuthology.orchestra.run.smithi007.stdout:client6011 2024-04-25T10:00:11.534 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:00:11.534 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:00:11.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:11.590 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2024-04-25T10:00:11.646 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-04-25T10:00:11.647 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-04-25T10:00:11.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.727+0000 7f2239a0ef40 1 Processor -- start 2024-04-25T10:00:11.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.727+0000 7f2239a0ef40 1 -- start start 2024-04-25T10:00:11.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.728+0000 7f2239a0ef40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556b422ec8f0 0x556b423b7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:11.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.728+0000 7f2239a0ef40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b422eccd0 0x556b423b7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:11.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.728+0000 7f2239a0ef40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556b423b04c0 0x556b423b8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:11.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.728+0000 7f2239a0ef40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b42332c60 con 0x556b422ec8f0 2024-04-25T10:00:11.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.728+0000 7f2239a0ef40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b42291df0 con 0x556b422eccd0 2024-04-25T10:00:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.728+0000 7f2239a0ef40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x556b42332f00 con 0x556b423b04c0 2024-04-25T10:00:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.728+0000 7f22368bf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556b422ec8f0 0x556b423b7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.728+0000 7f22368bf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556b422ec8f0 0x556b423b7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42706/0 (socket says 172.21.15.7:42706) 2024-04-25T10:00:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.728+0000 7f22368bf640 1 -- 172.21.15.7:0/510433230 learned_addr learned my addr 172.21.15.7:0/510433230 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.728+0000 7f22360be640 1 --2- 172.21.15.7:0/510433230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b422eccd0 0x556b423b7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.728+0000 7f22370c0640 1 --2- 172.21.15.7:0/510433230 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556b423b04c0 0x556b423b8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.728+0000 7f22368bf640 1 -- 172.21.15.7:0/510433230 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556b423b04c0 msgr2=0x556b423b8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.728+0000 7f22368bf640 1 --2- 172.21.15.7:0/510433230 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556b423b04c0 0x556b423b8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.728+0000 7f22368bf640 1 -- 172.21.15.7:0/510433230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b422eccd0 msgr2=0x556b423b7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.728+0000 7f22368bf640 1 --2- 172.21.15.7:0/510433230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b422eccd0 0x556b423b7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.728+0000 7f22368bf640 1 -- 172.21.15.7:0/510433230 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b42217c50 con 0x556b422ec8f0 2024-04-25T10:00:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.728+0000 7f22370c0640 1 --2- 172.21.15.7:0/510433230 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556b423b04c0 0x556b423b8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:00:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.728+0000 7f22360be640 1 --2- 172.21.15.7:0/510433230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b422eccd0 0x556b423b7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:00:11.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.729+0000 7f22368bf640 1 --2- 172.21.15.7:0/510433230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556b422ec8f0 0x556b423b7580 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f222800a830 tx=0x7f2228005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e0e2b2f5034277d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:11.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.729+0000 7f22350bc640 1 -- 172.21.15.7:0/510433230 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2228017030 con 0x556b422ec8f0 2024-04-25T10:00:11.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.729+0000 7f22350bc640 1 -- 172.21.15.7:0/510433230 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2228010a50 con 0x556b422ec8f0 2024-04-25T10:00:11.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.729+0000 7f22350bc640 1 -- 172.21.15.7:0/510433230 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2228010c00 con 0x556b422ec8f0 2024-04-25T10:00:11.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.729+0000 7f2239a0ef40 1 -- 172.21.15.7:0/510433230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556b422ec8f0 msgr2=0x556b423b7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:11.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.729+0000 7f2239a0ef40 1 --2- 172.21.15.7:0/510433230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556b422ec8f0 0x556b423b7580 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f222800a830 tx=0x7f2228005d80 comp rx=0 tx=0).stop 2024-04-25T10:00:11.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.729+0000 7f2239a0ef40 1 -- 172.21.15.7:0/510433230 shutdown_connections 2024-04-25T10:00:11.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.729+0000 7f2239a0ef40 1 --2- 172.21.15.7:0/510433230 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556b423b04c0 0x556b423b8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:11.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.729+0000 7f2239a0ef40 1 --2- 172.21.15.7:0/510433230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b422eccd0 0x556b423b7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:11.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.729+0000 7f2239a0ef40 1 --2- 172.21.15.7:0/510433230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556b422ec8f0 0x556b423b7580 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:11.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.729+0000 7f2239a0ef40 1 -- 172.21.15.7:0/510433230 >> 172.21.15.7:0/510433230 conn(0x556b422e9a60 msgr2=0x556b423be630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:11.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.729+0000 7f2239a0ef40 1 -- 172.21.15.7:0/510433230 shutdown_connections 2024-04-25T10:00:11.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.729+0000 7f2239a0ef40 1 -- 172.21.15.7:0/510433230 wait complete. 2024-04-25T10:00:11.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.730+0000 7f2239a0ef40 1 Processor -- start 2024-04-25T10:00:11.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.730+0000 7f2239a0ef40 1 -- start start 2024-04-25T10:00:11.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.730+0000 7f2239a0ef40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556b422ec8f0 0x556b423b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:11.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.730+0000 7f2239a0ef40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556b422eccd0 0x556b423afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:11.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.730+0000 7f2239a0ef40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b423b04c0 0x556b423c1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:11.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.730+0000 7f2239a0ef40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b423bcef0 con 0x556b422ec8f0 2024-04-25T10:00:11.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.731+0000 7f2239a0ef40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b423bc9c0 con 0x556b423b04c0 2024-04-25T10:00:11.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.731+0000 7f2239a0ef40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x556b423b9c20 con 0x556b422eccd0 2024-04-25T10:00:11.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.731+0000 7f22368bf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556b422ec8f0 0x556b423b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:11.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.731+0000 7f22368bf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556b422ec8f0 0x556b423b1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42720/0 (socket says 172.21.15.7:42720) 2024-04-25T10:00:11.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.731+0000 7f22368bf640 1 -- 172.21.15.7:0/934530967 learned_addr learned my addr 172.21.15.7:0/934530967 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:11.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.731+0000 7f22368bf640 1 -- 172.21.15.7:0/934530967 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556b422eccd0 msgr2=0x556b423afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:11.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.731+0000 7f22368bf640 1 --2- 172.21.15.7:0/934530967 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x556b422eccd0 0x556b423afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:11.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.731+0000 7f22368bf640 1 -- 172.21.15.7:0/934530967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b423b04c0 msgr2=0x556b423c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:11.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.731+0000 7f22368bf640 1 --2- 172.21.15.7:0/934530967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b423b04c0 0x556b423c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:11.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.731+0000 7f22368bf640 1 -- 172.21.15.7:0/934530967 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b423ba770 con 0x556b422ec8f0 2024-04-25T10:00:11.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.731+0000 7f22368bf640 1 --2- 172.21.15.7:0/934530967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556b422ec8f0 0x556b423b1fb0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f2228010690 tx=0x7f2228003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:11.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.731+0000 7f222ffff640 1 -- 172.21.15.7:0/934530967 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222801c410 con 0x556b422ec8f0 2024-04-25T10:00:11.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.731+0000 7f222ffff640 1 -- 172.21.15.7:0/934530967 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222801c5b0 con 0x556b422ec8f0 2024-04-25T10:00:11.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.731+0000 7f2239a0ef40 1 -- 172.21.15.7:0/934530967 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556b423b02b0 con 0x556b422ec8f0 2024-04-25T10:00:11.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.731+0000 7f222ffff640 1 -- 172.21.15.7:0/934530967 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222801c9e0 con 0x556b422ec8f0 2024-04-25T10:00:11.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.731+0000 7f2239a0ef40 1 -- 172.21.15.7:0/934530967 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556b423b17b0 con 0x556b422ec8f0 2024-04-25T10:00:11.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.733+0000 7f222ffff640 1 -- 172.21.15.7:0/934530967 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f222801a030 con 0x556b422ec8f0 2024-04-25T10:00:11.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.733+0000 7f222ffff640 1 --2- 172.21.15.7:0/934530967 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2218069ee0 0x7f221806c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:11.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.733+0000 7f222ffff640 1 -- 172.21.15.7:0/934530967 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f222808aa70 con 0x556b422ec8f0 2024-04-25T10:00:11.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.733+0000 7f22360be640 1 --2- 172.21.15.7:0/934530967 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2218069ee0 0x7f221806c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.733+0000 7f2239a0ef40 1 --2- 172.21.15.7:0/934530967 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x556b423c1d90 0x556b42459410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.733+0000 7f2239a0ef40 1 -- 172.21.15.7:0/934530967 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:1 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76) v9 -- 0x556b42459950 con 0x556b423c1d90 2024-04-25T10:00:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.733+0000 7f22370c0640 1 --2- 172.21.15.7:0/934530967 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x556b423c1d90 0x556b42459410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.734+0000 7f22360be640 1 --2- 172.21.15.7:0/934530967 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2218069ee0 0x7f221806c3a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2220005870 tx=0x7f2220005a00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.734+0000 7f22370c0640 1 --2- 172.21.15.7:0/934530967 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x556b423c1d90 0x556b42459410 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.735+0000 7f22370c0640 1 -- 172.21.15.7:0/934530967 <== osd.0 v2:172.21.15.7:6800/4167741236 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v76'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f22300013b0 con 0x556b423c1d90 2024-04-25T10:00:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.735+0000 7f2239a0ef40 1 -- 172.21.15.7:0/934530967 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x556b423c1d90 msgr2=0x556b42459410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.735+0000 7f2239a0ef40 1 --2- 172.21.15.7:0/934530967 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x556b423c1d90 0x556b42459410 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.735+0000 7f2239a0ef40 1 -- 172.21.15.7:0/934530967 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2218069ee0 msgr2=0x7f221806c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.735+0000 7f2239a0ef40 1 --2- 172.21.15.7:0/934530967 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2218069ee0 0x7f221806c3a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2220005870 tx=0x7f2220005a00 comp rx=0 tx=0).stop 2024-04-25T10:00:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.735+0000 7f2239a0ef40 1 -- 172.21.15.7:0/934530967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556b422ec8f0 msgr2=0x556b423b1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.735+0000 7f2239a0ef40 1 --2- 172.21.15.7:0/934530967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556b422ec8f0 0x556b423b1fb0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f2228010690 tx=0x7f2228003330 comp rx=0 tx=0).stop 2024-04-25T10:00:11.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.735+0000 7f22370c0640 1 -- 172.21.15.7:0/934530967 reap_dead start 2024-04-25T10:00:11.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.736+0000 7f2239a0ef40 1 -- 172.21.15.7:0/934530967 shutdown_connections 2024-04-25T10:00:11.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.736+0000 7f2239a0ef40 1 -- 172.21.15.7:0/934530967 >> 172.21.15.7:0/934530967 conn(0x556b422e9a60 msgr2=0x556b423bd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:11.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.736+0000 7f2239a0ef40 1 -- 172.21.15.7:0/934530967 shutdown_connections 2024-04-25T10:00:11.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:11.736+0000 7f2239a0ef40 1 -- 172.21.15.7:0/934530967 wait complete. 2024-04-25T10:00:11.745 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T10:00:11.745 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:00:11.781 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:00:11.840 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T10:00:11.841 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:00:11.841 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:00:11.856 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:00:11.857 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:00:11.913 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:00:12.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.049+0000 7f2a16330640 1 Processor -- start 2024-04-25T10:00:12.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.049+0000 7f2a16330640 1 -- start start 2024-04-25T10:00:12.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.050+0000 7f2a16330640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2a100cd740 0x7f2a100d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:12.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.050+0000 7f2a16330640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a10099b90 con 0x7f2a1006cd90 2024-04-25T10:00:12.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.050+0000 7f2a16330640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a10099e70 con 0x7f2a100d08d0 2024-04-25T10:00:12.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.050+0000 7f2a16330640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a100cdb20 con 0x7f2a100cd740 2024-04-25T10:00:12.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.050+0000 7f2a148cd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2a1006cd90 0x7f2a100cbc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60264/0 (socket says 172.21.15.7:60264) 2024-04-25T10:00:12.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.050+0000 7f2a148cd640 1 -- 172.21.15.7:0/952193337 learned_addr learned my addr 172.21.15.7:0/952193337 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:12.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.051+0000 7f2a0ffff640 1 --2- 172.21.15.7:0/952193337 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2a100cd740 0x7f2a100d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:12.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.051+0000 7f2a0effd640 1 -- 172.21.15.7:0/952193337 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424569721 0 0) 0x7f2a10099b90 con 0x7f2a1006cd90 2024-04-25T10:00:12.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.051+0000 7f2a0effd640 1 -- 172.21.15.7:0/952193337 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29f8003520 con 0x7f2a1006cd90 2024-04-25T10:00:12.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.051+0000 7f2a0effd640 1 -- 172.21.15.7:0/952193337 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3884460490 0 0) 0x7f2a10099e70 con 0x7f2a100d08d0 2024-04-25T10:00:12.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.051+0000 7f2a0effd640 1 -- 172.21.15.7:0/952193337 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a10099b90 con 0x7f2a100d08d0 2024-04-25T10:00:12.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.051+0000 7f2a0effd640 1 -- 172.21.15.7:0/952193337 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3670188052 0 0) 0x7f29f8003520 con 0x7f2a1006cd90 2024-04-25T10:00:12.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.051+0000 7f2a0ffff640 1 -- 172.21.15.7:0/952193337 >> v1:172.21.15.55:6789/0 conn(0x7f2a100d08d0 legacy=0x7f2a1006c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:12.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.051+0000 7f2a0ffff640 1 -- 172.21.15.7:0/952193337 >> v1:172.21.15.7:6789/0 conn(0x7f2a1006cd90 legacy=0x7f2a100cbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:12.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.051+0000 7f2a0ffff640 1 -- 172.21.15.7:0/952193337 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1009a150 con 0x7f2a100cd740 2024-04-25T10:00:12.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.052+0000 7f2a0ffff640 1 --2- 172.21.15.7:0/952193337 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2a100cd740 0x7f2a100d0390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2a000097d0 tx=0x7f2a0002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64454e5c7323ab56 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:12.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.052+0000 7f2a0effd640 1 -- 172.21.15.7:0/952193337 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a00037070 con 0x7f2a100cd740 2024-04-25T10:00:12.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.052+0000 7f2a0effd640 1 -- 172.21.15.7:0/952193337 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0002ac30 con 0x7f2a100cd740 2024-04-25T10:00:12.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.052+0000 7f2a0effd640 1 -- 172.21.15.7:0/952193337 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a080019f0 con 0x7f2a100cd740 2024-04-25T10:00:12.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.053+0000 7f2a16330640 1 -- 172.21.15.7:0/952193337 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2a100cd740 msgr2=0x7f2a100d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:12.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.053+0000 7f2a16330640 1 --2- 172.21.15.7:0/952193337 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2a100cd740 0x7f2a100d0390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2a000097d0 tx=0x7f2a0002a1a0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.053+0000 7f2a16330640 1 -- 172.21.15.7:0/952193337 shutdown_connections 2024-04-25T10:00:12.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.053+0000 7f2a16330640 1 --2- 172.21.15.7:0/952193337 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2a100cd740 0x7f2a100d0390 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.053+0000 7f2a16330640 1 -- 172.21.15.7:0/952193337 >> 172.21.15.7:0/952193337 conn(0x7f2a100b3130 msgr2=0x7f2a100b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:12.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.053+0000 7f2a16330640 1 -- 172.21.15.7:0/952193337 shutdown_connections 2024-04-25T10:00:12.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.053+0000 7f2a16330640 1 -- 172.21.15.7:0/952193337 wait complete. 2024-04-25T10:00:12.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.054+0000 7f2a16330640 1 Processor -- start 2024-04-25T10:00:12.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.054+0000 7f2a16330640 1 -- start start 2024-04-25T10:00:12.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.055+0000 7f2a16330640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a1006cd90 0x7f2a100c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:12.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.055+0000 7f2a16330640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a100cd740 0x7f2a1015c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:12.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.055+0000 7f2a16330640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2a100d08d0 0x7f2a101f6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:12.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.055+0000 7f2a16330640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1009ac30 con 0x7f2a1006cd90 2024-04-25T10:00:12.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.055+0000 7f2a16330640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1009a710 con 0x7f2a100cd740 2024-04-25T10:00:12.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.055+0000 7f2a16330640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1009adb0 con 0x7f2a100d08d0 2024-04-25T10:00:12.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.055+0000 7f2a0ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a1006cd90 0x7f2a100c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:12.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.055+0000 7f2a0ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a1006cd90 0x7f2a100c8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42730/0 (socket says 172.21.15.7:42730) 2024-04-25T10:00:12.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.055+0000 7f2a0ffff640 1 -- 172.21.15.7:0/1898784236 learned_addr learned my addr 172.21.15.7:0/1898784236 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:12.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.055+0000 7f2a148cd640 1 --2- 172.21.15.7:0/1898784236 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2a100d08d0 0x7f2a101f6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:12.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.055+0000 7f2a0f7fe640 1 --2- 172.21.15.7:0/1898784236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a100cd740 0x7f2a1015c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:12.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.056+0000 7f2a0ffff640 1 -- 172.21.15.7:0/1898784236 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2a100d08d0 msgr2=0x7f2a101f6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:12.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.056+0000 7f2a0ffff640 1 --2- 172.21.15.7:0/1898784236 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2a100d08d0 0x7f2a101f6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.056+0000 7f2a0ffff640 1 -- 172.21.15.7:0/1898784236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a100cd740 msgr2=0x7f2a1015c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:12.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.056+0000 7f2a0ffff640 1 --2- 172.21.15.7:0/1898784236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a100cd740 0x7f2a1015c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.056+0000 7f2a0ffff640 1 -- 172.21.15.7:0/1898784236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1015c6b0 con 0x7f2a1006cd90 2024-04-25T10:00:12.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.056+0000 7f2a148cd640 1 --2- 172.21.15.7:0/1898784236 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2a100d08d0 0x7f2a101f6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:12.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.056+0000 7f2a0ffff640 1 --2- 172.21.15.7:0/1898784236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a1006cd90 0x7f2a100c8710 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f2a00035040 tx=0x7f2a000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:12.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.056+0000 7f2a0cff9640 1 -- 172.21.15.7:0/1898784236 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a00037050 con 0x7f2a1006cd90 2024-04-25T10:00:12.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.056+0000 7f2a0cff9640 1 -- 172.21.15.7:0/1898784236 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a00043070 con 0x7f2a1006cd90 2024-04-25T10:00:12.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.056+0000 7f2a16330640 1 -- 172.21.15.7:0/1898784236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a100c8cf0 con 0x7f2a1006cd90 2024-04-25T10:00:12.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.056+0000 7f2a0cff9640 1 -- 172.21.15.7:0/1898784236 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a00006e10 con 0x7f2a1006cd90 2024-04-25T10:00:12.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.056+0000 7f2a16330640 1 -- 172.21.15.7:0/1898784236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a100c92b0 con 0x7f2a1006cd90 2024-04-25T10:00:12.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.057+0000 7f2a16330640 1 -- 172.21.15.7:0/1898784236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a10068fd0 con 0x7f2a1006cd90 2024-04-25T10:00:12.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.058+0000 7f2a0cff9640 1 -- 172.21.15.7:0/1898784236 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2a0003e670 con 0x7f2a1006cd90 2024-04-25T10:00:12.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.058+0000 7f2a0cff9640 1 --2- 172.21.15.7:0/1898784236 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f29fc06b4d0 0x7f29fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:12.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.058+0000 7f2a0cff9640 1 -- 172.21.15.7:0/1898784236 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f2a000aad20 con 0x7f2a1006cd90 2024-04-25T10:00:12.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.058+0000 7f2a0f7fe640 1 --2- 172.21.15.7:0/1898784236 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f29fc06b4d0 0x7f29fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:12.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.059+0000 7f2a0f7fe640 1 --2- 172.21.15.7:0/1898784236 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f29fc06b4d0 0x7f29fc06d990 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2a1006ffe0 tx=0x7f2a04009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:12.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.062+0000 7f2a0cff9640 1 -- 172.21.15.7:0/1898784236 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2a00079940 con 0x7f2a1006cd90 2024-04-25T10:00:12.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.241+0000 7f2a16330640 1 -- 172.21.15.7:0/1898784236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a100b4040 con 0x7f2a1006cd90 2024-04-25T10:00:12.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.243+0000 7f2a0cff9640 1 -- 172.21.15.7:0/1898784236 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16978 (secure 0 0 0) 0x7f2a00079240 con 0x7f2a1006cd90 2024-04-25T10:00:12.248 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:00:12.248 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":76,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:58:59.374212+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:58:43.929184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T09:58:44.609970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6834/1012943595":"2024-04-26T09:58:59.374192+0000","172.21.15.55:6832/1012943595":"2024-04-26T09:58:59.374192+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:00:12.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.245+0000 7f2a16330640 1 -- 172.21.15.7:0/1898784236 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f29fc06b4d0 msgr2=0x7f29fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:12.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.245+0000 7f2a16330640 1 --2- 172.21.15.7:0/1898784236 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f29fc06b4d0 0x7f29fc06d990 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2a1006ffe0 tx=0x7f2a04009040 comp rx=0 tx=0).stop 2024-04-25T10:00:12.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.245+0000 7f2a16330640 1 -- 172.21.15.7:0/1898784236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a1006cd90 msgr2=0x7f2a100c8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:12.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.245+0000 7f2a16330640 1 --2- 172.21.15.7:0/1898784236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a1006cd90 0x7f2a100c8710 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f2a00035040 tx=0x7f2a000046c0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.245+0000 7f2a16330640 1 -- 172.21.15.7:0/1898784236 shutdown_connections 2024-04-25T10:00:12.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.245+0000 7f2a16330640 1 --2- 172.21.15.7:0/1898784236 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f29fc06b4d0 0x7f29fc06d990 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.245+0000 7f2a16330640 1 --2- 172.21.15.7:0/1898784236 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2a100d08d0 0x7f2a101f6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.245+0000 7f2a16330640 1 --2- 172.21.15.7:0/1898784236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a100cd740 0x7f2a1015c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.245+0000 7f2a16330640 1 --2- 172.21.15.7:0/1898784236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a1006cd90 0x7f2a100c8710 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.245+0000 7f2a16330640 1 -- 172.21.15.7:0/1898784236 >> 172.21.15.7:0/1898784236 conn(0x7f2a100b3130 msgr2=0x7f2a10070530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:12.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.245+0000 7f2a16330640 1 -- 172.21.15.7:0/1898784236 shutdown_connections 2024-04-25T10:00:12.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.245+0000 7f2a16330640 1 -- 172.21.15.7:0/1898784236 wait complete. 2024-04-25T10:00:12.260 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:58:43.929184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:58:44.609970+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:00:12.260 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:00:12.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.360+0000 7f8db8116640 1 Processor -- start 2024-04-25T10:00:12.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.360+0000 7f8db8116640 1 -- start start 2024-04-25T10:00:12.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.361+0000 7f8db8116640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8db015db30 0x7f8db00d0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:12.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.361+0000 7f8db8116640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8db00d0980 0x7f8db00ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:12.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.361+0000 7f8db8116640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8db015df10 con 0x7f8db00cebc0 2024-04-25T10:00:12.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.361+0000 7f8db8116640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8db00d1780 con 0x7f8db00d0980 2024-04-25T10:00:12.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.361+0000 7f8db8116640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db00d1a60 con 0x7f8db015db30 2024-04-25T10:00:12.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.362+0000 7f8db5eb2640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8db015db30 0x7f8db00d0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:12.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.362+0000 7f8db56b1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8db00d0980 0x7f8db00ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:12.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.362+0000 7f8db5eb2640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8db015db30 0x7f8db00d0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:49108/0 (socket says 172.21.15.7:49108) 2024-04-25T10:00:12.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.362+0000 7f8db5eb2640 1 -- 172.21.15.7:0/3351006188 learned_addr learned my addr 172.21.15.7:0/3351006188 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:12.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.362+0000 7f8db66b3640 1 --1- 172.21.15.7:0/3351006188 >> v1:172.21.15.55:6789/0 conn(0x7f8db00cebc0 0x7f8db00b52c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:58442/0 (socket says 172.21.15.7:58442) 2024-04-25T10:00:12.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.362+0000 7f8db5eb2640 1 -- 172.21.15.7:0/3351006188 >> v2:172.21.15.55:3300/0 conn(0x7f8db00d0980 msgr2=0x7f8db00ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:12.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.362+0000 7f8db5eb2640 1 --2- 172.21.15.7:0/3351006188 >> v2:172.21.15.55:3300/0 conn(0x7f8db00d0980 0x7f8db00ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.362+0000 7f8db5eb2640 1 -- 172.21.15.7:0/3351006188 >> v1:172.21.15.55:6789/0 conn(0x7f8db00cebc0 legacy=0x7f8db00b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:12.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.362+0000 7f8db5eb2640 1 -- 172.21.15.7:0/3351006188 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db00d1d40 con 0x7f8db015db30 2024-04-25T10:00:12.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.362+0000 7f8db56b1640 1 --2- 172.21.15.7:0/3351006188 >> v2:172.21.15.55:3300/0 conn(0x7f8db00d0980 0x7f8db00ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:00:12.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.363+0000 7f8db5eb2640 1 --2- 172.21.15.7:0/3351006188 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8db015db30 0x7f8db00d0440 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8da8009870 tx=0x7f8da802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c639c6425d2a70e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:12.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.363+0000 7f8db4eb0640 1 -- 172.21.15.7:0/3351006188 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da8037070 con 0x7f8db015db30 2024-04-25T10:00:12.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.363+0000 7f8db4eb0640 1 -- 172.21.15.7:0/3351006188 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da8032440 con 0x7f8db015db30 2024-04-25T10:00:12.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.363+0000 7f8db4eb0640 1 -- 172.21.15.7:0/3351006188 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da8032810 con 0x7f8db015db30 2024-04-25T10:00:12.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.363+0000 7f8db8116640 1 -- 172.21.15.7:0/3351006188 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8db015db30 msgr2=0x7f8db00d0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:12.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.363+0000 7f8db8116640 1 --2- 172.21.15.7:0/3351006188 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8db015db30 0x7f8db00d0440 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8da8009870 tx=0x7f8da802a270 comp rx=0 tx=0).stop 2024-04-25T10:00:12.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.363+0000 7f8db8116640 1 -- 172.21.15.7:0/3351006188 shutdown_connections 2024-04-25T10:00:12.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.363+0000 7f8db8116640 1 --2- 172.21.15.7:0/3351006188 >> v2:172.21.15.55:3300/0 conn(0x7f8db00d0980 0x7f8db00ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.363+0000 7f8db8116640 1 --2- 172.21.15.7:0/3351006188 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8db015db30 0x7f8db00d0440 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.363+0000 7f8db8116640 1 -- 172.21.15.7:0/3351006188 >> 172.21.15.7:0/3351006188 conn(0x7f8db00728c0 msgr2=0x7f8db006bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:12.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.364+0000 7f8db8116640 1 -- 172.21.15.7:0/3351006188 shutdown_connections 2024-04-25T10:00:12.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.364+0000 7f8db8116640 1 -- 172.21.15.7:0/3351006188 wait complete. 2024-04-25T10:00:12.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.365+0000 7f8db8116640 1 Processor -- start 2024-04-25T10:00:12.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.365+0000 7f8db8116640 1 -- start start 2024-04-25T10:00:12.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.365+0000 7f8db8116640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8db00cebc0 0x7f8db00c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:12.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.365+0000 7f8db8116640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8db00d0980 0x7f8db014c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:12.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.365+0000 7f8db8116640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db015db30 0x7f8db00c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:12.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.365+0000 7f8db8116640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db00d1410 con 0x7f8db00d0980 2024-04-25T10:00:12.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.365+0000 7f8db8116640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db00cf010 con 0x7f8db015db30 2024-04-25T10:00:12.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.365+0000 7f8db8116640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db00b7a80 con 0x7f8db00cebc0 2024-04-25T10:00:12.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.366+0000 7f8db56b1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8db00d0980 0x7f8db014c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:12.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.366+0000 7f8db56b1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8db00d0980 0x7f8db014c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42738/0 (socket says 172.21.15.7:42738) 2024-04-25T10:00:12.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.366+0000 7f8db56b1640 1 -- 172.21.15.7:0/2045991237 learned_addr learned my addr 172.21.15.7:0/2045991237 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:12.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.366+0000 7f8db5eb2640 1 --2- 172.21.15.7:0/2045991237 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8db00cebc0 0x7f8db00c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:12.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.366+0000 7f8db66b3640 1 --2- 172.21.15.7:0/2045991237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db015db30 0x7f8db00c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:12.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.366+0000 7f8db56b1640 1 -- 172.21.15.7:0/2045991237 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8db00cebc0 msgr2=0x7f8db00c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:12.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.366+0000 7f8db56b1640 1 --2- 172.21.15.7:0/2045991237 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8db00cebc0 0x7f8db00c8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.366+0000 7f8db56b1640 1 -- 172.21.15.7:0/2045991237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db015db30 msgr2=0x7f8db00c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:12.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.366+0000 7f8db56b1640 1 --2- 172.21.15.7:0/2045991237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db015db30 0x7f8db00c9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.366+0000 7f8db56b1640 1 -- 172.21.15.7:0/2045991237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db00ca2a0 con 0x7f8db00d0980 2024-04-25T10:00:12.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.366+0000 7f8db66b3640 1 --2- 172.21.15.7:0/2045991237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db015db30 0x7f8db00c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:12.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.366+0000 7f8db56b1640 1 --2- 172.21.15.7:0/2045991237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8db00d0980 0x7f8db014c1b0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f8da000ec10 tx=0x7f8da000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:12.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.366+0000 7f8da67fc640 1 -- 172.21.15.7:0/2045991237 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da0017070 con 0x7f8db00d0980 2024-04-25T10:00:12.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.366+0000 7f8da67fc640 1 -- 172.21.15.7:0/2045991237 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da000cc30 con 0x7f8db00d0980 2024-04-25T10:00:12.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.366+0000 7f8db8116640 1 -- 172.21.15.7:0/2045991237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8db00b33b0 con 0x7f8db00d0980 2024-04-25T10:00:12.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.366+0000 7f8da67fc640 1 -- 172.21.15.7:0/2045991237 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da0013470 con 0x7f8db00d0980 2024-04-25T10:00:12.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.366+0000 7f8db8116640 1 -- 172.21.15.7:0/2045991237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8db00b3930 con 0x7f8db00d0980 2024-04-25T10:00:12.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.367+0000 7f8db8116640 1 -- 172.21.15.7:0/2045991237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8db0068f60 con 0x7f8db00d0980 2024-04-25T10:00:12.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.368+0000 7f8da67fc640 1 -- 172.21.15.7:0/2045991237 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8da001a070 con 0x7f8db00d0980 2024-04-25T10:00:12.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.368+0000 7f8da67fc640 1 --2- 172.21.15.7:0/2045991237 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8d9406b4d0 0x7f8d9406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:12.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.368+0000 7f8da67fc640 1 -- 172.21.15.7:0/2045991237 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f8da008a2c0 con 0x7f8db00d0980 2024-04-25T10:00:12.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.368+0000 7f8db5eb2640 1 --2- 172.21.15.7:0/2045991237 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8d9406b4d0 0x7f8d9406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:12.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.369+0000 7f8db5eb2640 1 --2- 172.21.15.7:0/2045991237 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8d9406b4d0 0x7f8d9406d990 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8da8034000 tx=0x7f8da802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:12.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.372+0000 7f8da67fc640 1 -- 172.21.15.7:0/2045991237 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8da0058900 con 0x7f8db00d0980 2024-04-25T10:00:12.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.553+0000 7f8db8116640 1 -- 172.21.15.7:0/2045991237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8db00d0540 con 0x7f8db00d0980 2024-04-25T10:00:12.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.554+0000 7f8da67fc640 1 -- 172.21.15.7:0/2045991237 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8da005c9a0 con 0x7f8db00d0980 2024-04-25T10:00:12.558 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T10:00:12.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.556+0000 7f8db8116640 1 -- 172.21.15.7:0/2045991237 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8d9406b4d0 msgr2=0x7f8d9406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:12.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.556+0000 7f8db8116640 1 --2- 172.21.15.7:0/2045991237 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8d9406b4d0 0x7f8d9406d990 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8da8034000 tx=0x7f8da802e000 comp rx=0 tx=0).stop 2024-04-25T10:00:12.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.556+0000 7f8db8116640 1 -- 172.21.15.7:0/2045991237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8db00d0980 msgr2=0x7f8db014c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:12.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.556+0000 7f8db8116640 1 --2- 172.21.15.7:0/2045991237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8db00d0980 0x7f8db014c1b0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f8da000ec10 tx=0x7f8da000c520 comp rx=0 tx=0).stop 2024-04-25T10:00:12.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.556+0000 7f8db8116640 1 -- 172.21.15.7:0/2045991237 shutdown_connections 2024-04-25T10:00:12.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.556+0000 7f8db8116640 1 --2- 172.21.15.7:0/2045991237 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8d9406b4d0 0x7f8d9406d990 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.556+0000 7f8db8116640 1 --2- 172.21.15.7:0/2045991237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db015db30 0x7f8db00c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.556+0000 7f8db8116640 1 --2- 172.21.15.7:0/2045991237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8db00d0980 0x7f8db014c1b0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.556+0000 7f8db8116640 1 --2- 172.21.15.7:0/2045991237 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8db00cebc0 0x7f8db00c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.556+0000 7f8db8116640 1 -- 172.21.15.7:0/2045991237 >> 172.21.15.7:0/2045991237 conn(0x7f8db00728c0 msgr2=0x7f8db015ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:12.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.556+0000 7f8db8116640 1 -- 172.21.15.7:0/2045991237 shutdown_connections 2024-04-25T10:00:12.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.556+0000 7f8db8116640 1 -- 172.21.15.7:0/2045991237 wait complete. 2024-04-25T10:00:12.571 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:00:12.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.671+0000 7ff8796cb640 1 Processor -- start 2024-04-25T10:00:12.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.671+0000 7ff8796cb640 1 -- start start 2024-04-25T10:00:12.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.672+0000 7ff8796cb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff874144fe0 0x7ff87406e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:12.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.672+0000 7ff8796cb640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff874071840 0x7ff87415c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:12.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.672+0000 7ff8796cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8741453c0 con 0x7ff87406d130 2024-04-25T10:00:12.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.672+0000 7ff8796cb640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8740a8560 con 0x7ff874071840 2024-04-25T10:00:12.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.672+0000 7ff8796cb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff87406d6a0 con 0x7ff874144fe0 2024-04-25T10:00:12.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.672+0000 7ff8737fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff874071840 0x7ff87415c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:12.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.672+0000 7ff8737fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff874071840 0x7ff87415c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42746/0 (socket says 172.21.15.7:42746) 2024-04-25T10:00:12.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.672+0000 7ff8737fe640 1 -- 172.21.15.7:0/1216543371 learned_addr learned my addr 172.21.15.7:0/1216543371 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:12.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.672+0000 7ff872ffd640 1 --2- 172.21.15.7:0/1216543371 >> v2:172.21.15.55:3300/0 conn(0x7ff874144fe0 0x7ff87406e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:12.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.672+0000 7ff8737fe640 1 -- 172.21.15.7:0/1216543371 >> v2:172.21.15.55:3300/0 conn(0x7ff874144fe0 msgr2=0x7ff87406e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:12.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.672+0000 7ff8737fe640 1 --2- 172.21.15.7:0/1216543371 >> v2:172.21.15.55:3300/0 conn(0x7ff874144fe0 0x7ff87406e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.672+0000 7ff8737fe640 1 -- 172.21.15.7:0/1216543371 >> v1:172.21.15.55:6789/0 conn(0x7ff87406d130 legacy=0x7ff874071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:12.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.672+0000 7ff8737fe640 1 -- 172.21.15.7:0/1216543371 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff87406d980 con 0x7ff874071840 2024-04-25T10:00:12.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.673+0000 7ff8737fe640 1 --2- 172.21.15.7:0/1216543371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff874071840 0x7ff87415c370 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7ff8740728b0 tx=0x7ff86c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c8736d9102796b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:12.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.673+0000 7ff871ffb640 1 -- 172.21.15.7:0/1216543371 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c037070 con 0x7ff874071840 2024-04-25T10:00:12.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.673+0000 7ff871ffb640 1 -- 172.21.15.7:0/1216543371 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86c032440 con 0x7ff874071840 2024-04-25T10:00:12.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.673+0000 7ff871ffb640 1 -- 172.21.15.7:0/1216543371 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c032810 con 0x7ff874071840 2024-04-25T10:00:12.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.674+0000 7ff8796cb640 1 -- 172.21.15.7:0/1216543371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff874071840 msgr2=0x7ff87415c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:12.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.674+0000 7ff8796cb640 1 --2- 172.21.15.7:0/1216543371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff874071840 0x7ff87415c370 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7ff8740728b0 tx=0x7ff86c02a270 comp rx=0 tx=0).stop 2024-04-25T10:00:12.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.674+0000 7ff8796cb640 1 -- 172.21.15.7:0/1216543371 shutdown_connections 2024-04-25T10:00:12.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.674+0000 7ff8796cb640 1 --2- 172.21.15.7:0/1216543371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff874071840 0x7ff87415c370 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.674+0000 7ff8796cb640 1 --2- 172.21.15.7:0/1216543371 >> v2:172.21.15.55:3300/0 conn(0x7ff874144fe0 0x7ff87406e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.674+0000 7ff8796cb640 1 -- 172.21.15.7:0/1216543371 >> 172.21.15.7:0/1216543371 conn(0x7ff87406ab60 msgr2=0x7ff87406af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:12.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.674+0000 7ff8796cb640 1 -- 172.21.15.7:0/1216543371 shutdown_connections 2024-04-25T10:00:12.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.674+0000 7ff8796cb640 1 -- 172.21.15.7:0/1216543371 wait complete. 2024-04-25T10:00:12.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.675+0000 7ff8796cb640 1 Processor -- start 2024-04-25T10:00:12.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.675+0000 7ff8796cb640 1 -- start start 2024-04-25T10:00:12.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.676+0000 7ff8796cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff87406d130 0x7ff87412c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:12.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.676+0000 7ff8796cb640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff874071840 0x7ff87412cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:12.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.676+0000 7ff8796cb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff874144fe0 0x7ff8741f4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:12.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.676+0000 7ff8796cb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87415be50 con 0x7ff874144fe0 2024-04-25T10:00:12.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.676+0000 7ff8796cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87406df40 con 0x7ff87406d130 2024-04-25T10:00:12.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.676+0000 7ff8796cb640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff87406eaa0 con 0x7ff874071840 2024-04-25T10:00:12.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.676+0000 7ff8737fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff874144fe0 0x7ff8741f4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:12.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.676+0000 7ff8737fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff874144fe0 0x7ff8741f4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42760/0 (socket says 172.21.15.7:42760) 2024-04-25T10:00:12.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.676+0000 7ff8737fe640 1 -- 172.21.15.7:0/3214843792 learned_addr learned my addr 172.21.15.7:0/3214843792 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:12.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.676+0000 7ff8727fc640 1 --2- 172.21.15.7:0/3214843792 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff874071840 0x7ff87412cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:12.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.676+0000 7ff8737fe640 1 -- 172.21.15.7:0/3214843792 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff874071840 msgr2=0x7ff87412cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:12.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.676+0000 7ff872ffd640 1 --2- 172.21.15.7:0/3214843792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff87406d130 0x7ff87412c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:12.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.676+0000 7ff8737fe640 1 --2- 172.21.15.7:0/3214843792 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff874071840 0x7ff87412cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.676+0000 7ff8737fe640 1 -- 172.21.15.7:0/3214843792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff87406d130 msgr2=0x7ff87412c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:12.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.676+0000 7ff8737fe640 1 --2- 172.21.15.7:0/3214843792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff87406d130 0x7ff87412c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.676+0000 7ff8737fe640 1 -- 172.21.15.7:0/3214843792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff874140d40 con 0x7ff874144fe0 2024-04-25T10:00:12.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.676+0000 7ff8737fe640 1 --2- 172.21.15.7:0/3214843792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff874144fe0 0x7ff8741f4900 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7ff86c0090b0 tx=0x7ff86c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:12.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.677+0000 7ff86b7fe640 1 -- 172.21.15.7:0/3214843792 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c041020 con 0x7ff874144fe0 2024-04-25T10:00:12.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.677+0000 7ff86b7fe640 1 -- 172.21.15.7:0/3214843792 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86c03d640 con 0x7ff874144fe0 2024-04-25T10:00:12.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.677+0000 7ff8796cb640 1 -- 172.21.15.7:0/3214843792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff87412a6f0 con 0x7ff874144fe0 2024-04-25T10:00:12.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.677+0000 7ff86b7fe640 1 -- 172.21.15.7:0/3214843792 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c037040 con 0x7ff874144fe0 2024-04-25T10:00:12.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.677+0000 7ff8796cb640 1 -- 172.21.15.7:0/3214843792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff87412acb0 con 0x7ff874144fe0 2024-04-25T10:00:12.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.678+0000 7ff8796cb640 1 -- 172.21.15.7:0/3214843792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff874068f60 con 0x7ff874144fe0 2024-04-25T10:00:12.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.678+0000 7ff86b7fe640 1 -- 172.21.15.7:0/3214843792 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff86c044020 con 0x7ff874144fe0 2024-04-25T10:00:12.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.678+0000 7ff86b7fe640 1 --2- 172.21.15.7:0/3214843792 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff85406b4d0 0x7ff85406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:12.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.679+0000 7ff86b7fe640 1 -- 172.21.15.7:0/3214843792 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7ff86c0aab00 con 0x7ff874144fe0 2024-04-25T10:00:12.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.679+0000 7ff872ffd640 1 --2- 172.21.15.7:0/3214843792 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff85406b4d0 0x7ff85406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:12.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.679+0000 7ff872ffd640 1 --2- 172.21.15.7:0/3214843792 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff85406b4d0 0x7ff85406d990 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff864007380 tx=0x7ff86400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:12.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.683+0000 7ff86b7fe640 1 -- 172.21.15.7:0/3214843792 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff86c04b030 con 0x7ff874144fe0 2024-04-25T10:00:12.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.862+0000 7ff8796cb640 1 -- 172.21.15.7:0/3214843792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff87406c1a0 con 0x7ff874144fe0 2024-04-25T10:00:12.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.862+0000 7ff86b7fe640 1 -- 172.21.15.7:0/3214843792 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v76) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff86c0797b0 con 0x7ff874144fe0 2024-04-25T10:00:12.867 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T10:00:12.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.864+0000 7ff8796cb640 1 -- 172.21.15.7:0/3214843792 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff85406b4d0 msgr2=0x7ff85406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:12.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.864+0000 7ff8796cb640 1 --2- 172.21.15.7:0/3214843792 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff85406b4d0 0x7ff85406d990 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff864007380 tx=0x7ff86400b040 comp rx=0 tx=0).stop 2024-04-25T10:00:12.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.864+0000 7ff8796cb640 1 -- 172.21.15.7:0/3214843792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff874144fe0 msgr2=0x7ff8741f4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:12.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.864+0000 7ff8796cb640 1 --2- 172.21.15.7:0/3214843792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff874144fe0 0x7ff8741f4900 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7ff86c0090b0 tx=0x7ff86c0046c0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.865+0000 7ff8796cb640 1 -- 172.21.15.7:0/3214843792 shutdown_connections 2024-04-25T10:00:12.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.865+0000 7ff8796cb640 1 --2- 172.21.15.7:0/3214843792 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff85406b4d0 0x7ff85406d990 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.865+0000 7ff8796cb640 1 --2- 172.21.15.7:0/3214843792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff874144fe0 0x7ff8741f4900 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.865+0000 7ff8796cb640 1 --2- 172.21.15.7:0/3214843792 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff874071840 0x7ff87412cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.865+0000 7ff8796cb640 1 --2- 172.21.15.7:0/3214843792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff87406d130 0x7ff87412c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.865+0000 7ff8796cb640 1 -- 172.21.15.7:0/3214843792 >> 172.21.15.7:0/3214843792 conn(0x7ff87406ab60 msgr2=0x7ff87415e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:12.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.865+0000 7ff8796cb640 1 -- 172.21.15.7:0/3214843792 shutdown_connections 2024-04-25T10:00:12.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.865+0000 7ff8796cb640 1 -- 172.21.15.7:0/3214843792 wait complete. 2024-04-25T10:00:12.879 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:00:12.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.978+0000 7f2edf5a5640 1 Processor -- start 2024-04-25T10:00:12.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.979+0000 7f2edf5a5640 1 -- start start 2024-04-25T10:00:12.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.979+0000 7f2edf5a5640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2ed80d3760 0x7f2ed815eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:12.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.979+0000 7f2edf5a5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ed80ce830 0x7f2ed80b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:12.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.979+0000 7f2edf5a5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed80ced10 con 0x7f2ed815f1c0 2024-04-25T10:00:12.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.979+0000 7f2edf5a5640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed80ce380 con 0x7f2ed80d3760 2024-04-25T10:00:12.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.979+0000 7f2edf5a5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed815f000 con 0x7f2ed80ce830 2024-04-25T10:00:12.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.979+0000 7f2edd341640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2ed80d3760 0x7f2ed815eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:12.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.979+0000 7f2edd341640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2ed80d3760 0x7f2ed815eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42768/0 (socket says 172.21.15.7:42768) 2024-04-25T10:00:12.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.979+0000 7f2edd341640 1 -- 172.21.15.7:0/4039208530 learned_addr learned my addr 172.21.15.7:0/4039208530 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:12.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.980+0000 7f2eddb42640 1 --2- 172.21.15.7:0/4039208530 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ed80ce830 0x7f2ed80b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:12.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.980+0000 7f2edd341640 1 -- 172.21.15.7:0/4039208530 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ed80ce830 msgr2=0x7f2ed80b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:12.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.980+0000 7f2edd341640 1 --2- 172.21.15.7:0/4039208530 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ed80ce830 0x7f2ed80b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.980+0000 7f2edd341640 1 -- 172.21.15.7:0/4039208530 >> v1:172.21.15.55:6789/0 conn(0x7f2ed815f1c0 legacy=0x7f2ed80d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:12.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.980+0000 7f2edd341640 1 -- 172.21.15.7:0/4039208530 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed80d1b40 con 0x7f2ed80d3760 2024-04-25T10:00:12.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.980+0000 7f2eddb42640 1 --2- 172.21.15.7:0/4039208530 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ed80ce830 0x7f2ed80b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:00:12.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.980+0000 7f2edd341640 1 --2- 172.21.15.7:0/4039208530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ed80d3760 0x7f2ed815eac0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4009870 tx=0x7f2ed402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20539a96a0465776 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:12.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.981+0000 7f2ecffff640 1 -- 172.21.15.7:0/4039208530 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4037070 con 0x7f2ed80d3760 2024-04-25T10:00:12.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.981+0000 7f2ecffff640 1 -- 172.21.15.7:0/4039208530 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed4032440 con 0x7f2ed80d3760 2024-04-25T10:00:12.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.981+0000 7f2ecffff640 1 -- 172.21.15.7:0/4039208530 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4032810 con 0x7f2ed80d3760 2024-04-25T10:00:12.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.981+0000 7f2edf5a5640 1 -- 172.21.15.7:0/4039208530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ed80d3760 msgr2=0x7f2ed815eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:12.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.981+0000 7f2edf5a5640 1 --2- 172.21.15.7:0/4039208530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ed80d3760 0x7f2ed815eac0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4009870 tx=0x7f2ed402a210 comp rx=0 tx=0).stop 2024-04-25T10:00:12.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.981+0000 7f2edf5a5640 1 -- 172.21.15.7:0/4039208530 shutdown_connections 2024-04-25T10:00:12.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.981+0000 7f2edf5a5640 1 --2- 172.21.15.7:0/4039208530 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ed80ce830 0x7f2ed80b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.981+0000 7f2edf5a5640 1 --2- 172.21.15.7:0/4039208530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ed80d3760 0x7f2ed815eac0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.981+0000 7f2edf5a5640 1 -- 172.21.15.7:0/4039208530 >> 172.21.15.7:0/4039208530 conn(0x7f2ed8072680 msgr2=0x7f2ed8072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:12.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.981+0000 7f2edf5a5640 1 -- 172.21.15.7:0/4039208530 shutdown_connections 2024-04-25T10:00:12.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.981+0000 7f2edf5a5640 1 -- 172.21.15.7:0/4039208530 wait complete. 2024-04-25T10:00:12.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.982+0000 7f2edf5a5640 1 Processor -- start 2024-04-25T10:00:12.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.982+0000 7f2edf5a5640 1 -- start start 2024-04-25T10:00:12.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.983+0000 7f2edf5a5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ed80ce830 0x7f2ed814a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:12.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.983+0000 7f2edf5a5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ed80d3760 0x7f2ed8149cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:12.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.983+0000 7f2edf5a5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ed815f1c0 0x7f2ed814bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:12.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.983+0000 7f2edf5a5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed815de10 con 0x7f2ed815f1c0 2024-04-25T10:00:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.983+0000 7f2edf5a5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed80d2190 con 0x7f2ed80d3760 2024-04-25T10:00:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.983+0000 7f2edf5a5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed80b2780 con 0x7f2ed80ce830 2024-04-25T10:00:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.983+0000 7f2eddb42640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ed815f1c0 0x7f2ed814bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.983+0000 7f2eddb42640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ed815f1c0 0x7f2ed814bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42780/0 (socket says 172.21.15.7:42780) 2024-04-25T10:00:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.983+0000 7f2eddb42640 1 -- 172.21.15.7:0/3128369509 learned_addr learned my addr 172.21.15.7:0/3128369509 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.983+0000 7f2edd341640 1 --2- 172.21.15.7:0/3128369509 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ed80ce830 0x7f2ed814a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.983+0000 7f2edcb40640 1 --2- 172.21.15.7:0/3128369509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ed80d3760 0x7f2ed8149cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.984+0000 7f2eddb42640 1 -- 172.21.15.7:0/3128369509 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ed80ce830 msgr2=0x7f2ed814a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.984+0000 7f2eddb42640 1 --2- 172.21.15.7:0/3128369509 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ed80ce830 0x7f2ed814a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.984+0000 7f2eddb42640 1 -- 172.21.15.7:0/3128369509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ed80d3760 msgr2=0x7f2ed8149cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.984+0000 7f2eddb42640 1 --2- 172.21.15.7:0/3128369509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ed80d3760 0x7f2ed8149cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.984+0000 7f2eddb42640 1 -- 172.21.15.7:0/3128369509 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed814aa60 con 0x7f2ed815f1c0 2024-04-25T10:00:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.984+0000 7f2eddb42640 1 --2- 172.21.15.7:0/3128369509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ed815f1c0 0x7f2ed814bda0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000ce80 tx=0x7f2ed000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:12.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.984+0000 7f2ecdffb640 1 -- 172.21.15.7:0/3128369509 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed001a070 con 0x7f2ed815f1c0 2024-04-25T10:00:12.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.984+0000 7f2ecdffb640 1 -- 172.21.15.7:0/3128369509 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed000d880 con 0x7f2ed815f1c0 2024-04-25T10:00:12.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.984+0000 7f2edf5a5640 1 -- 172.21.15.7:0/3128369509 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed814a210 con 0x7f2ed815f1c0 2024-04-25T10:00:12.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.984+0000 7f2ecdffb640 1 -- 172.21.15.7:0/3128369509 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed000dc70 con 0x7f2ed815f1c0 2024-04-25T10:00:12.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.984+0000 7f2edf5a5640 1 -- 172.21.15.7:0/3128369509 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed814afe0 con 0x7f2ed815f1c0 2024-04-25T10:00:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.985+0000 7f2edf5a5640 1 -- 172.21.15.7:0/3128369509 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed8068f60 con 0x7f2ed815f1c0 2024-04-25T10:00:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.985+0000 7f2ecdffb640 1 -- 172.21.15.7:0/3128369509 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2ed001d070 con 0x7f2ed815f1c0 2024-04-25T10:00:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.986+0000 7f2ecdffb640 1 --2- 172.21.15.7:0/3128369509 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2ebc06b4d0 0x7f2ebc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.986+0000 7f2ecdffb640 1 -- 172.21.15.7:0/3128369509 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f2ed008aaf0 con 0x7f2ed815f1c0 2024-04-25T10:00:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.986+0000 7f2edd341640 1 --2- 172.21.15.7:0/3128369509 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2ebc06b4d0 0x7f2ebc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.986+0000 7f2edd341640 1 --2- 172.21.15.7:0/3128369509 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2ebc06b4d0 0x7f2ebc06d990 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4034000 tx=0x7f2ed402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:12.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:12.990+0000 7f2ecdffb640 1 -- 172.21.15.7:0/3128369509 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2ed0059140 con 0x7f2ed815f1c0 2024-04-25T10:00:13.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.169+0000 7f2edf5a5640 1 -- 172.21.15.7:0/3128369509 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2ed80c93e0 con 0x7f2ed815f1c0 2024-04-25T10:00:13.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.170+0000 7f2ecdffb640 1 -- 172.21.15.7:0/3128369509 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2ed005d1e0 con 0x7f2ed815f1c0 2024-04-25T10:00:13.174 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T10:00:13.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.172+0000 7f2edf5a5640 1 -- 172.21.15.7:0/3128369509 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2ebc06b4d0 msgr2=0x7f2ebc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:13.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.172+0000 7f2edf5a5640 1 --2- 172.21.15.7:0/3128369509 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2ebc06b4d0 0x7f2ebc06d990 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4034000 tx=0x7f2ed402e000 comp rx=0 tx=0).stop 2024-04-25T10:00:13.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.172+0000 7f2edf5a5640 1 -- 172.21.15.7:0/3128369509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ed815f1c0 msgr2=0x7f2ed814bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:13.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.172+0000 7f2edf5a5640 1 --2- 172.21.15.7:0/3128369509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ed815f1c0 0x7f2ed814bda0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000ce80 tx=0x7f2ed000a710 comp rx=0 tx=0).stop 2024-04-25T10:00:13.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.172+0000 7f2edf5a5640 1 -- 172.21.15.7:0/3128369509 shutdown_connections 2024-04-25T10:00:13.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.172+0000 7f2edf5a5640 1 --2- 172.21.15.7:0/3128369509 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2ebc06b4d0 0x7f2ebc06d990 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:13.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.172+0000 7f2edf5a5640 1 --2- 172.21.15.7:0/3128369509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ed815f1c0 0x7f2ed814bda0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:13.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.172+0000 7f2edf5a5640 1 --2- 172.21.15.7:0/3128369509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ed80d3760 0x7f2ed8149cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:13.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.172+0000 7f2edf5a5640 1 --2- 172.21.15.7:0/3128369509 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ed80ce830 0x7f2ed814a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:13.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.172+0000 7f2edf5a5640 1 -- 172.21.15.7:0/3128369509 >> 172.21.15.7:0/3128369509 conn(0x7f2ed8072680 msgr2=0x7f2ed80d2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:13.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.172+0000 7f2edf5a5640 1 -- 172.21.15.7:0/3128369509 shutdown_connections 2024-04-25T10:00:13.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.172+0000 7f2edf5a5640 1 -- 172.21.15.7:0/3128369509 wait complete. 2024-04-25T10:00:13.187 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:00:13.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.285+0000 7fafa184a640 1 Processor -- start 2024-04-25T10:00:13.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.285+0000 7fafa184a640 1 -- start start 2024-04-25T10:00:13.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.286+0000 7fafa184a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faf9c0cd740 0x7faf9c0d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:13.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.286+0000 7fafa184a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faf9c0d08d0 0x7faf9c06c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:13.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.286+0000 7fafa184a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf9c099b90 con 0x7faf9c06cbc0 2024-04-25T10:00:13.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.286+0000 7fafa184a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf9c0cdb20 con 0x7faf9c0d08d0 2024-04-25T10:00:13.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.286+0000 7fafa184a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c0ccca0 con 0x7faf9c0cd740 2024-04-25T10:00:13.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.286+0000 7faf9affd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faf9c0cd740 0x7faf9c0d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:13.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.286+0000 7faf93fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faf9c0d08d0 0x7faf9c06c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:13.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.286+0000 7faf93fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faf9c0d08d0 0x7faf9c06c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:54592/0 (socket says 172.21.15.7:54592) 2024-04-25T10:00:13.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.286+0000 7faf9affd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faf9c0cd740 0x7faf9c0d0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:49134/0 (socket says 172.21.15.7:49134) 2024-04-25T10:00:13.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.286+0000 7faf9b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7faf9c06cbc0 0x7faf9c161830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:58464/0 (socket says 172.21.15.7:58464) 2024-04-25T10:00:13.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.286+0000 7faf93fff640 1 -- 172.21.15.7:0/1841560293 learned_addr learned my addr 172.21.15.7:0/1841560293 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:13.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.286+0000 7faf93fff640 1 -- 172.21.15.7:0/1841560293 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faf9c0cd740 msgr2=0x7faf9c0d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:13.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.286+0000 7faf93fff640 1 --2- 172.21.15.7:0/1841560293 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faf9c0cd740 0x7faf9c0d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:13.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.286+0000 7faf93fff640 1 -- 172.21.15.7:0/1841560293 >> v1:172.21.15.55:6789/0 conn(0x7faf9c06cbc0 legacy=0x7faf9c161830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:13.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.286+0000 7faf93fff640 1 -- 172.21.15.7:0/1841560293 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9c099e70 con 0x7faf9c0d08d0 2024-04-25T10:00:13.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.287+0000 7faf93fff640 1 --2- 172.21.15.7:0/1841560293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf9c0d08d0 0x7faf9c06c680 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7faf84009870 tx=0x7faf8402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32a724deac2f3b12 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:13.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.287+0000 7faf9a7fc640 1 -- 172.21.15.7:0/1841560293 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf84037070 con 0x7faf9c0d08d0 2024-04-25T10:00:13.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.288+0000 7faf9a7fc640 1 -- 172.21.15.7:0/1841560293 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf84032440 con 0x7faf9c0d08d0 2024-04-25T10:00:13.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.288+0000 7faf9a7fc640 1 -- 172.21.15.7:0/1841560293 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf84032810 con 0x7faf9c0d08d0 2024-04-25T10:00:13.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.288+0000 7fafa184a640 1 -- 172.21.15.7:0/1841560293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf9c0d08d0 msgr2=0x7faf9c06c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:13.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.288+0000 7fafa184a640 1 --2- 172.21.15.7:0/1841560293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf9c0d08d0 0x7faf9c06c680 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7faf84009870 tx=0x7faf8402a270 comp rx=0 tx=0).stop 2024-04-25T10:00:13.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.288+0000 7fafa184a640 1 -- 172.21.15.7:0/1841560293 shutdown_connections 2024-04-25T10:00:13.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.288+0000 7fafa184a640 1 --2- 172.21.15.7:0/1841560293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf9c0d08d0 0x7faf9c06c680 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:13.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.288+0000 7fafa184a640 1 --2- 172.21.15.7:0/1841560293 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faf9c0cd740 0x7faf9c0d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:13.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.288+0000 7fafa184a640 1 -- 172.21.15.7:0/1841560293 >> 172.21.15.7:0/1841560293 conn(0x7faf9c0b3130 msgr2=0x7faf9c0b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:13.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.288+0000 7fafa184a640 1 -- 172.21.15.7:0/1841560293 shutdown_connections 2024-04-25T10:00:13.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.288+0000 7fafa184a640 1 -- 172.21.15.7:0/1841560293 wait complete. 2024-04-25T10:00:13.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.290+0000 7fafa184a640 1 Processor -- start 2024-04-25T10:00:13.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.290+0000 7fafa184a640 1 -- start start 2024-04-25T10:00:13.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.290+0000 7fafa184a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faf9c06cbc0 0x7faf9c158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:13.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.290+0000 7fafa184a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf9c0cd740 0x7faf9c15bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:13.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.290+0000 7fafa184a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf9c0d08d0 0x7faf9c158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:13.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.290+0000 7fafa184a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c09a710 con 0x7faf9c0cd740 2024-04-25T10:00:13.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.290+0000 7fafa184a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c09a430 con 0x7faf9c0d08d0 2024-04-25T10:00:13.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.290+0000 7fafa184a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c09ac30 con 0x7faf9c06cbc0 2024-04-25T10:00:13.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.291+0000 7faf93fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf9c0cd740 0x7faf9c15bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:13.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.291+0000 7faf9affd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faf9c06cbc0 0x7faf9c158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:13.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.291+0000 7faf93fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf9c0cd740 0x7faf9c15bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42796/0 (socket says 172.21.15.7:42796) 2024-04-25T10:00:13.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.291+0000 7faf93fff640 1 -- 172.21.15.7:0/3656157146 learned_addr learned my addr 172.21.15.7:0/3656157146 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:13.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.291+0000 7faf9b7fe640 1 --2- 172.21.15.7:0/3656157146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf9c0d08d0 0x7faf9c158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:13.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.291+0000 7faf93fff640 1 -- 172.21.15.7:0/3656157146 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faf9c06cbc0 msgr2=0x7faf9c158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:13.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.291+0000 7faf93fff640 1 --2- 172.21.15.7:0/3656157146 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faf9c06cbc0 0x7faf9c158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:13.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.291+0000 7faf93fff640 1 -- 172.21.15.7:0/3656157146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf9c0d08d0 msgr2=0x7faf9c158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:13.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.291+0000 7faf93fff640 1 --2- 172.21.15.7:0/3656157146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf9c0d08d0 0x7faf9c158260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:13.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.291+0000 7faf93fff640 1 -- 172.21.15.7:0/3656157146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9c0cb4b0 con 0x7faf9c0cd740 2024-04-25T10:00:13.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.291+0000 7faf93fff640 1 --2- 172.21.15.7:0/3656157146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf9c0cd740 0x7faf9c15bbf0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7faf8402a2b0 tx=0x7faf840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:13.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.291+0000 7faf98ff9640 1 -- 172.21.15.7:0/3656157146 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf84041030 con 0x7faf9c0cd740 2024-04-25T10:00:13.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.291+0000 7faf98ff9640 1 -- 172.21.15.7:0/3656157146 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf84030440 con 0x7faf9c0cd740 2024-04-25T10:00:13.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.291+0000 7faf98ff9640 1 -- 172.21.15.7:0/3656157146 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf84037040 con 0x7faf9c0cd740 2024-04-25T10:00:13.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.291+0000 7fafa184a640 1 -- 172.21.15.7:0/3656157146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf9c0ca490 con 0x7faf9c0cd740 2024-04-25T10:00:13.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.291+0000 7fafa184a640 1 -- 172.21.15.7:0/3656157146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf9c0cacd0 con 0x7faf9c0cd740 2024-04-25T10:00:13.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.292+0000 7fafa184a640 1 -- 172.21.15.7:0/3656157146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf9c068fd0 con 0x7faf9c0cd740 2024-04-25T10:00:13.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.293+0000 7faf98ff9640 1 -- 172.21.15.7:0/3656157146 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faf84044070 con 0x7faf9c0cd740 2024-04-25T10:00:13.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.293+0000 7faf98ff9640 1 --2- 172.21.15.7:0/3656157146 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faf7c06b4d0 0x7faf7c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:13.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.293+0000 7faf98ff9640 1 -- 172.21.15.7:0/3656157146 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7faf840aa700 con 0x7faf9c0cd740 2024-04-25T10:00:13.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.293+0000 7faf9affd640 1 --2- 172.21.15.7:0/3656157146 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faf7c06b4d0 0x7faf7c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:13.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.294+0000 7faf9affd640 1 --2- 172.21.15.7:0/3656157146 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faf7c06b4d0 0x7faf7c06d990 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009aa0 tx=0x7faf8c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:13.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.297+0000 7faf98ff9640 1 -- 172.21.15.7:0/3656157146 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faf8404b070 con 0x7faf9c0cd740 2024-04-25T10:00:13.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.491+0000 7fafa184a640 1 -- 172.21.15.7:0/3656157146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7faf9c0b4040 con 0x7faf9c0cd740 2024-04-25T10:00:13.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.492+0000 7faf98ff9640 1 -- 172.21.15.7:0/3656157146 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v76) v1 ==== 80+0+122 (secure 0 0 0) 0x7faf9c0ca490 con 0x7faf9c0cd740 2024-04-25T10:00:13.496 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.55:6834/1012943595 2024-04-26T09:58:59.374192+0000 2024-04-25T10:00:13.496 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.55:6832/1012943595 2024-04-26T09:58:59.374192+0000 2024-04-25T10:00:13.496 INFO:teuthology.orchestra.run.smithi007.stderr:listed 2 entries 2024-04-25T10:00:13.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.494+0000 7fafa184a640 1 -- 172.21.15.7:0/3656157146 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faf7c06b4d0 msgr2=0x7faf7c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:13.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.494+0000 7fafa184a640 1 --2- 172.21.15.7:0/3656157146 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faf7c06b4d0 0x7faf7c06d990 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009aa0 tx=0x7faf8c009190 comp rx=0 tx=0).stop 2024-04-25T10:00:13.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.494+0000 7fafa184a640 1 -- 172.21.15.7:0/3656157146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf9c0cd740 msgr2=0x7faf9c15bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:13.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.494+0000 7fafa184a640 1 --2- 172.21.15.7:0/3656157146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf9c0cd740 0x7faf9c15bbf0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7faf8402a2b0 tx=0x7faf840046c0 comp rx=0 tx=0).stop 2024-04-25T10:00:13.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.494+0000 7fafa184a640 1 -- 172.21.15.7:0/3656157146 shutdown_connections 2024-04-25T10:00:13.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.494+0000 7fafa184a640 1 --2- 172.21.15.7:0/3656157146 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faf7c06b4d0 0x7faf7c06d990 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:13.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.494+0000 7fafa184a640 1 --2- 172.21.15.7:0/3656157146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf9c0d08d0 0x7faf9c158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:13.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.494+0000 7fafa184a640 1 --2- 172.21.15.7:0/3656157146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf9c0cd740 0x7faf9c15bbf0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:13.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.494+0000 7fafa184a640 1 --2- 172.21.15.7:0/3656157146 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faf9c06cbc0 0x7faf9c158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:13.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.494+0000 7fafa184a640 1 -- 172.21.15.7:0/3656157146 >> 172.21.15.7:0/3656157146 conn(0x7faf9c0b3130 msgr2=0x7faf9c15ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:13.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.494+0000 7fafa184a640 1 -- 172.21.15.7:0/3656157146 shutdown_connections 2024-04-25T10:00:13.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.494+0000 7fafa184a640 1 -- 172.21.15.7:0/3656157146 wait complete. 2024-04-25T10:00:13.509 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T10:00:13.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:13.509 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T10:00:13.537 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-04-25T10:00:13.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:13.537 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T10:00:13.592 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T10:00:13.593 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:00:13.612 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19023 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:00:13.612 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:00:13.613 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:00:13.648 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13704 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:00:13.648 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T10:00:13.649 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:00:13.671 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19023 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:00:13.671 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:00:13.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.786+0000 7f51920fc640 1 Processor -- start 2024-04-25T10:00:13.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.786+0000 7f51920fc640 1 -- start start 2024-04-25T10:00:13.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.786+0000 7f51920fc640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f518c06e970 0x7f518c15be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:13.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.786+0000 7f51920fc640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f518c0cd510 con 0x7f518c0c4900 2024-04-25T10:00:13.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.786+0000 7f51920fc640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f518c0cd7f0 con 0x7f518c151720 2024-04-25T10:00:13.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.786+0000 7f51920fc640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f518c0cdad0 con 0x7f518c06e970 2024-04-25T10:00:13.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.787+0000 7f518affd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f518c06e970 0x7f518c15be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:13.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.787+0000 7f518bfff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f518c0c4900 0x7f518c0c4d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60280/0 (socket says 172.21.15.7:60280) 2024-04-25T10:00:13.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.787+0000 7f518bfff640 1 -- 172.21.15.7:0/3356700193 learned_addr learned my addr 172.21.15.7:0/3356700193 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:13.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.787+0000 7f518affd640 1 -- 172.21.15.7:0/3356700193 >> v1:172.21.15.55:6789/0 conn(0x7f518c151720 legacy=0x7f518c06e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:13.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.787+0000 7f518affd640 1 -- 172.21.15.7:0/3356700193 >> v1:172.21.15.7:6789/0 conn(0x7f518c0c4900 legacy=0x7f518c0c4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:13.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.787+0000 7f518affd640 1 -- 172.21.15.7:0/3356700193 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f518c0cddb0 con 0x7f518c06e970 2024-04-25T10:00:13.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.788+0000 7f518affd640 1 --2- 172.21.15.7:0/3356700193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f518c06e970 0x7f518c15be70 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f51800097a0 tx=0x7f518002c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a09e7edb88bdafe5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:13.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.788+0000 7f518a7fc640 1 -- 172.21.15.7:0/3356700193 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5180038070 con 0x7f518c06e970 2024-04-25T10:00:13.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.788+0000 7f518a7fc640 1 -- 172.21.15.7:0/3356700193 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5180031710 con 0x7f518c06e970 2024-04-25T10:00:13.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.788+0000 7f518a7fc640 1 -- 172.21.15.7:0/3356700193 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5180031ae0 con 0x7f518c06e970 2024-04-25T10:00:13.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.788+0000 7f51920fc640 1 -- 172.21.15.7:0/3356700193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f518c06e970 msgr2=0x7f518c15be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:13.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.788+0000 7f51920fc640 1 --2- 172.21.15.7:0/3356700193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f518c06e970 0x7f518c15be70 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f51800097a0 tx=0x7f518002c440 comp rx=0 tx=0).stop 2024-04-25T10:00:13.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.788+0000 7f51920fc640 1 -- 172.21.15.7:0/3356700193 shutdown_connections 2024-04-25T10:00:13.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.788+0000 7f51920fc640 1 --2- 172.21.15.7:0/3356700193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f518c06e970 0x7f518c15be70 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:13.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.788+0000 7f51920fc640 1 -- 172.21.15.7:0/3356700193 >> 172.21.15.7:0/3356700193 conn(0x7f518c071150 msgr2=0x7f518c071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:13.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.788+0000 7f51920fc640 1 -- 172.21.15.7:0/3356700193 shutdown_connections 2024-04-25T10:00:13.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.788+0000 7f51920fc640 1 -- 172.21.15.7:0/3356700193 wait complete. 2024-04-25T10:00:13.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.789+0000 7f51920fc640 1 Processor -- start 2024-04-25T10:00:13.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.790+0000 7f51920fc640 1 -- start start 2024-04-25T10:00:13.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.790+0000 7f51920fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f518c06e970 0x7f518c154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:13.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.790+0000 7f51920fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f518c0c4900 0x7f518c146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:13.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.790+0000 7f51920fc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f518c151720 0x7f518c1470a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:13.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.790+0000 7f51920fc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518c0ce5b0 con 0x7f518c06e970 2024-04-25T10:00:13.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.790+0000 7f51920fc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518c151b00 con 0x7f518c0c4900 2024-04-25T10:00:13.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.790+0000 7f51920fc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f518c0ce730 con 0x7f518c151720 2024-04-25T10:00:13.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.790+0000 7f518b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f518c06e970 0x7f518c154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:13.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.791+0000 7f518b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f518c06e970 0x7f518c154560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42812/0 (socket says 172.21.15.7:42812) 2024-04-25T10:00:13.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.791+0000 7f518b7fe640 1 -- 172.21.15.7:0/1764101835 learned_addr learned my addr 172.21.15.7:0/1764101835 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:13.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.791+0000 7f518bfff640 1 --2- 172.21.15.7:0/1764101835 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f518c151720 0x7f518c1470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:13.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.791+0000 7f518affd640 1 --2- 172.21.15.7:0/1764101835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f518c0c4900 0x7f518c146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:13.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.791+0000 7f518b7fe640 1 -- 172.21.15.7:0/1764101835 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f518c151720 msgr2=0x7f518c1470a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:13.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.791+0000 7f518b7fe640 1 --2- 172.21.15.7:0/1764101835 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f518c151720 0x7f518c1470a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:13.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.791+0000 7f518b7fe640 1 -- 172.21.15.7:0/1764101835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f518c0c4900 msgr2=0x7f518c146b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:13.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.791+0000 7f518b7fe640 1 --2- 172.21.15.7:0/1764101835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f518c0c4900 0x7f518c146b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:13.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.791+0000 7f518b7fe640 1 -- 172.21.15.7:0/1764101835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f518c1534c0 con 0x7f518c06e970 2024-04-25T10:00:13.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.791+0000 7f518b7fe640 1 --2- 172.21.15.7:0/1764101835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f518c06e970 0x7f518c154560 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f517c00c3f0 tx=0x7f517c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:13.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.791+0000 7f5173fff640 1 -- 172.21.15.7:0/1764101835 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c0052d0 con 0x7f518c06e970 2024-04-25T10:00:13.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.791+0000 7f5173fff640 1 -- 172.21.15.7:0/1764101835 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517c005490 con 0x7f518c06e970 2024-04-25T10:00:13.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.791+0000 7f5173fff640 1 -- 172.21.15.7:0/1764101835 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c007260 con 0x7f518c06e970 2024-04-25T10:00:13.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.791+0000 7f51920fc640 1 -- 172.21.15.7:0/1764101835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f518c1537a0 con 0x7f518c06e970 2024-04-25T10:00:13.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.791+0000 7f51920fc640 1 -- 172.21.15.7:0/1764101835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f518c153d60 con 0x7f518c06e970 2024-04-25T10:00:13.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.792+0000 7f51920fc640 1 -- 172.21.15.7:0/1764101835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f518c068fd0 con 0x7f518c06e970 2024-04-25T10:00:13.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.793+0000 7f5173fff640 1 -- 172.21.15.7:0/1764101835 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f517c007400 con 0x7f518c06e970 2024-04-25T10:00:13.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.793+0000 7f5173fff640 1 --2- 172.21.15.7:0/1764101835 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f517806b4d0 0x7f517806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:13.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.794+0000 7f5173fff640 1 -- 172.21.15.7:0/1764101835 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f517c0898b0 con 0x7f518c06e970 2024-04-25T10:00:13.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.794+0000 7f518affd640 1 --2- 172.21.15.7:0/1764101835 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f517806b4d0 0x7f517806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:13.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.794+0000 7f518affd640 1 --2- 172.21.15.7:0/1764101835 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f517806b4d0 0x7f517806d990 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5180035000 tx=0x7f5180008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:13.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:13.798+0000 7f5173fff640 1 -- 172.21.15.7:0/1764101835 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f517c057e60 con 0x7f518c06e970 2024-04-25T10:00:14.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.019+0000 7f51920fc640 1 -- 172.21.15.7:0/1764101835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f518c15c010 con 0x7f518c06e970 2024-04-25T10:00:14.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.019+0000 7f5173fff640 1 -- 172.21.15.7:0/1764101835 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4936 (secure 0 0 0) 0x7f517c05ce20 con 0x7f518c06e970 2024-04-25T10:00:14.024 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:00:14.024 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":45,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1781470369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1781470369},{"type":"v1","addr":"172.21.15.55:6835","nonce":1781470369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6442,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1406578404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1406578404},{"type":"v1","addr":"172.21.15.55:6834","nonce":1406578404}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6810,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1839614891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1839614891},{"type":"v1","addr":"172.21.15.7:6835","nonce":1839614891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:58:45.628406+0000","modified":"2024-04-25T09:59:42.407854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6813},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6813":{"gid":6813,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":18,"addr":"172.21.15.7:6837/3690076929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3690076929},{"type":"v1","addr":"172.21.15.7:6837","nonce":3690076929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T10:00:14.024 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 45 2024-04-25T10:00:14.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.021+0000 7f51920fc640 1 -- 172.21.15.7:0/1764101835 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f517806b4d0 msgr2=0x7f517806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:14.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.021+0000 7f51920fc640 1 --2- 172.21.15.7:0/1764101835 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f517806b4d0 0x7f517806d990 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5180035000 tx=0x7f5180008030 comp rx=0 tx=0).stop 2024-04-25T10:00:14.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.021+0000 7f51920fc640 1 -- 172.21.15.7:0/1764101835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f518c06e970 msgr2=0x7f518c154560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:14.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.021+0000 7f51920fc640 1 --2- 172.21.15.7:0/1764101835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f518c06e970 0x7f518c154560 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f517c00c3f0 tx=0x7f517c00c8b0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.021+0000 7f51920fc640 1 -- 172.21.15.7:0/1764101835 shutdown_connections 2024-04-25T10:00:14.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.021+0000 7f51920fc640 1 --2- 172.21.15.7:0/1764101835 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f517806b4d0 0x7f517806d990 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.021+0000 7f51920fc640 1 --2- 172.21.15.7:0/1764101835 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f518c151720 0x7f518c1470a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.021+0000 7f51920fc640 1 --2- 172.21.15.7:0/1764101835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f518c0c4900 0x7f518c146b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.021+0000 7f51920fc640 1 --2- 172.21.15.7:0/1764101835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f518c06e970 0x7f518c154560 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.021+0000 7f51920fc640 1 -- 172.21.15.7:0/1764101835 >> 172.21.15.7:0/1764101835 conn(0x7f518c071150 msgr2=0x7f518c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:14.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.021+0000 7f51920fc640 1 -- 172.21.15.7:0/1764101835 shutdown_connections 2024-04-25T10:00:14.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.021+0000 7f51920fc640 1 -- 172.21.15.7:0/1764101835 wait complete. 2024-04-25T10:00:14.036 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:00:14.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.134+0000 7f74b230a640 1 Processor -- start 2024-04-25T10:00:14.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.134+0000 7f74b230a640 1 -- start start 2024-04-25T10:00:14.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.134+0000 7f74b230a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74ac15b8e0 0x7f74ac0d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:14.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.134+0000 7f74b230a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f74ac0cc300 0x7f74ac0999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:14.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.134+0000 7f74b230a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74ac09a340 con 0x7f74ac099f30 2024-04-25T10:00:14.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.134+0000 7f74b230a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74ac0cd7d0 con 0x7f74ac0cc300 2024-04-25T10:00:14.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.134+0000 7f74b230a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac0ccbc0 con 0x7f74ac15b8e0 2024-04-25T10:00:14.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.135+0000 7f74b08a7640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f74ac099f30 0x7f74ac15f520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60290/0 (socket says 172.21.15.7:60290) 2024-04-25T10:00:14.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.135+0000 7f74b08a7640 1 -- 172.21.15.7:0/1615839601 learned_addr learned my addr 172.21.15.7:0/1615839601 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:14.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.135+0000 7f74aaffd640 1 -- 172.21.15.7:0/1615839601 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1769731377 0 0) 0x7f74a4001490 con 0x7f74ac099f30 2024-04-25T10:00:14.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.135+0000 7f74ab7fe640 1 --2- 172.21.15.7:0/1615839601 >> v2:172.21.15.55:3300/0 conn(0x7f74ac0cc300 0x7f74ac0999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:14.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.135+0000 7f74abfff640 1 --2- 172.21.15.7:0/1615839601 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74ac15b8e0 0x7f74ac0d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:14.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.135+0000 7f74aaffd640 1 -- 172.21.15.7:0/1615839601 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7494003520 con 0x7f74ac099f30 2024-04-25T10:00:14.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.135+0000 7f74aaffd640 1 -- 172.21.15.7:0/1615839601 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3661879273 0 0) 0x7f7494003520 con 0x7f74ac099f30 2024-04-25T10:00:14.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.135+0000 7f74aaffd640 1 -- 172.21.15.7:0/1615839601 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74ac15b8e0 msgr2=0x7f74ac0d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:14.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.135+0000 7f74aaffd640 1 --2- 172.21.15.7:0/1615839601 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74ac15b8e0 0x7f74ac0d0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.135+0000 7f74aaffd640 1 -- 172.21.15.7:0/1615839601 >> v2:172.21.15.55:3300/0 conn(0x7f74ac0cc300 msgr2=0x7f74ac0999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:14.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.135+0000 7f74aaffd640 1 --2- 172.21.15.7:0/1615839601 >> v2:172.21.15.55:3300/0 conn(0x7f74ac0cc300 0x7f74ac0999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.135+0000 7f74aaffd640 1 -- 172.21.15.7:0/1615839601 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ac0ccea0 con 0x7f74ac099f30 2024-04-25T10:00:14.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.135+0000 7f74aaffd640 1 -- 172.21.15.7:0/1615839601 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f74a4001bc0 con 0x7f74ac099f30 2024-04-25T10:00:14.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.135+0000 7f74aaffd640 1 -- 172.21.15.7:0/1615839601 >> v1:172.21.15.7:6789/0 conn(0x7f74ac099f30 legacy=0x7f74ac15f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:14.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.135+0000 7f74aaffd640 1 --2- 172.21.15.7:0/1615839601 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74ac15b8e0 0x7f74940039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:14.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.135+0000 7f74aaffd640 1 --2- 172.21.15.7:0/1615839601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7494003f30 0x7f7494004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:14.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.135+0000 7f74aaffd640 1 --2- 172.21.15.7:0/1615839601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7494004d40 0x7f74940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:14.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.135+0000 7f74aaffd640 1 -- 172.21.15.7:0/1615839601 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac0cd7d0 con 0x7f7494004d40 2024-04-25T10:00:14.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.135+0000 7f74aaffd640 1 -- 172.21.15.7:0/1615839601 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac0ccbc0 con 0x7f7494003f30 2024-04-25T10:00:14.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.135+0000 7f74aaffd640 1 -- 172.21.15.7:0/1615839601 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749400b9c0 con 0x7f74ac15b8e0 2024-04-25T10:00:14.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.135+0000 7f74b08a7640 1 --2- 172.21.15.7:0/1615839601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7494004d40 0x7f74940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:14.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.136+0000 7f74ab7fe640 1 --2- 172.21.15.7:0/1615839601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7494003f30 0x7f7494004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:14.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.136+0000 7f74abfff640 1 --2- 172.21.15.7:0/1615839601 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74ac15b8e0 0x7f74940039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:14.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.136+0000 7f74b08a7640 1 -- 172.21.15.7:0/1615839601 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74ac15b8e0 msgr2=0x7f74940039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:14.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.136+0000 7f74b08a7640 1 --2- 172.21.15.7:0/1615839601 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74ac15b8e0 0x7f74940039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.136+0000 7f74b08a7640 1 -- 172.21.15.7:0/1615839601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7494003f30 msgr2=0x7f7494004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:14.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.136+0000 7f74b08a7640 1 --2- 172.21.15.7:0/1615839601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7494003f30 0x7f7494004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.136+0000 7f74b08a7640 1 -- 172.21.15.7:0/1615839601 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7494003520 con 0x7f7494004d40 2024-04-25T10:00:14.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.136+0000 7f74ab7fe640 1 --2- 172.21.15.7:0/1615839601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7494003f30 0x7f7494004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:14.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.136+0000 7f74b08a7640 1 --2- 172.21.15.7:0/1615839601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7494004d40 0x7f74940051c0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f74a400aa70 tx=0x7f7494005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d049dae20324a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:14.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.137+0000 7f74aaffd640 1 -- 172.21.15.7:0/1615839601 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a400a690 con 0x7f7494004d40 2024-04-25T10:00:14.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.137+0000 7f74aaffd640 1 -- 172.21.15.7:0/1615839601 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a402f070 con 0x7f7494004d40 2024-04-25T10:00:14.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.137+0000 7f74aaffd640 1 -- 172.21.15.7:0/1615839601 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a4034470 con 0x7f7494004d40 2024-04-25T10:00:14.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.137+0000 7f74b230a640 1 -- 172.21.15.7:0/1615839601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7494004d40 msgr2=0x7f74940051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:14.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.137+0000 7f74b230a640 1 --2- 172.21.15.7:0/1615839601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7494004d40 0x7f74940051c0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f74a400aa70 tx=0x7f7494005830 comp rx=0 tx=0).stop 2024-04-25T10:00:14.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.137+0000 7f74b08a7640 1 -- 172.21.15.7:0/1615839601 reap_dead start 2024-04-25T10:00:14.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.137+0000 7f74b230a640 1 -- 172.21.15.7:0/1615839601 shutdown_connections 2024-04-25T10:00:14.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.137+0000 7f74b230a640 1 -- 172.21.15.7:0/1615839601 >> 172.21.15.7:0/1615839601 conn(0x7f74ac0b3130 msgr2=0x7f74ac0b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:14.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.137+0000 7f74b230a640 1 -- 172.21.15.7:0/1615839601 shutdown_connections 2024-04-25T10:00:14.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.137+0000 7f74b230a640 1 -- 172.21.15.7:0/1615839601 wait complete. 2024-04-25T10:00:14.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.138+0000 7f74b230a640 1 Processor -- start 2024-04-25T10:00:14.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.138+0000 7f74b230a640 1 -- start start 2024-04-25T10:00:14.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.139+0000 7f74b230a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74ac155e40 0x7f74ac0c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:14.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.139+0000 7f74b230a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74ac0ca190 0x7f74ac159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:14.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.139+0000 7f74b230a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74ac159d40 0x7f74ac15c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:14.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.139+0000 7f74b230a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac15bcc0 con 0x7f74ac155e40 2024-04-25T10:00:14.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.139+0000 7f74b230a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac0cd460 con 0x7f74ac159d40 2024-04-25T10:00:14.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.139+0000 7f74b230a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac15be40 con 0x7f74ac0ca190 2024-04-25T10:00:14.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.139+0000 7f74abfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74ac155e40 0x7f74ac0c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:14.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.139+0000 7f74abfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74ac155e40 0x7f74ac0c8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42842/0 (socket says 172.21.15.7:42842) 2024-04-25T10:00:14.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.139+0000 7f74abfff640 1 -- 172.21.15.7:0/3759437329 learned_addr learned my addr 172.21.15.7:0/3759437329 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:14.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.139+0000 7f74b08a7640 1 --2- 172.21.15.7:0/3759437329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74ac159d40 0x7f74ac15c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:14.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.139+0000 7f74ab7fe640 1 --2- 172.21.15.7:0/3759437329 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74ac0ca190 0x7f74ac159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:14.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.140+0000 7f74abfff640 1 -- 172.21.15.7:0/3759437329 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74ac0ca190 msgr2=0x7f74ac159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:14.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.140+0000 7f74abfff640 1 --2- 172.21.15.7:0/3759437329 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74ac0ca190 0x7f74ac159800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.140+0000 7f74abfff640 1 -- 172.21.15.7:0/3759437329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74ac159d40 msgr2=0x7f74ac15c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:14.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.140+0000 7f74abfff640 1 --2- 172.21.15.7:0/3759437329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74ac159d40 0x7f74ac15c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.140+0000 7f74abfff640 1 -- 172.21.15.7:0/3759437329 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ac0b4260 con 0x7f74ac155e40 2024-04-25T10:00:14.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.140+0000 7f74b08a7640 1 --2- 172.21.15.7:0/3759437329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74ac159d40 0x7f74ac15c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:14.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.140+0000 7f74ab7fe640 1 --2- 172.21.15.7:0/3759437329 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74ac0ca190 0x7f74ac159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:14.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.140+0000 7f74abfff640 1 --2- 172.21.15.7:0/3759437329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74ac155e40 0x7f74ac0c8710 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f749c0119d0 tx=0x7f749c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:14.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.140+0000 7f74a8ff9640 1 -- 172.21.15.7:0/3759437329 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c00fb50 con 0x7f74ac155e40 2024-04-25T10:00:14.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.140+0000 7f74a8ff9640 1 -- 172.21.15.7:0/3759437329 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749c00fcf0 con 0x7f74ac155e40 2024-04-25T10:00:14.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.140+0000 7f74a8ff9640 1 -- 172.21.15.7:0/3759437329 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c00fea0 con 0x7f74ac155e40 2024-04-25T10:00:14.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.140+0000 7f74b230a640 1 -- 172.21.15.7:0/3759437329 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74ac0c8cf0 con 0x7f74ac155e40 2024-04-25T10:00:14.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.140+0000 7f74b230a640 1 -- 172.21.15.7:0/3759437329 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74ac0c92b0 con 0x7f74ac155e40 2024-04-25T10:00:14.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.141+0000 7f74b230a640 1 -- 172.21.15.7:0/3759437329 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74ac068fd0 con 0x7f74ac155e40 2024-04-25T10:00:14.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.141+0000 7f74a8ff9640 1 -- 172.21.15.7:0/3759437329 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f749c012040 con 0x7f74ac155e40 2024-04-25T10:00:14.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.142+0000 7f74a8ff9640 1 --2- 172.21.15.7:0/3759437329 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f749806b500 0x7f749806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:14.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.142+0000 7f74a8ff9640 1 -- 172.21.15.7:0/3759437329 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f749c08aa50 con 0x7f74ac155e40 2024-04-25T10:00:14.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.142+0000 7f74ab7fe640 1 --2- 172.21.15.7:0/3759437329 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f749806b500 0x7f749806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:14.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.142+0000 7f74ab7fe640 1 --2- 172.21.15.7:0/3759437329 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f749806b500 0x7f749806d9c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f74ac0b7440 tx=0x7f74a0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:14.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.146+0000 7f74a8ff9640 1 -- 172.21.15.7:0/3759437329 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f749c019030 con 0x7f74ac155e40 2024-04-25T10:00:14.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.329+0000 7f74b230a640 1 -- 172.21.15.7:0/3759437329 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74ac0b3fd0 con 0x7f74ac155e40 2024-04-25T10:00:14.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.330+0000 7f74a8ff9640 1 -- 172.21.15.7:0/3759437329 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16978 (secure 0 0 0) 0x7f749c0596e0 con 0x7f74ac155e40 2024-04-25T10:00:14.335 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:00:14.335 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":76,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:58:59.374212+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:58:43.929184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T09:58:44.609970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6834/1012943595":"2024-04-26T09:58:59.374192+0000","172.21.15.55:6832/1012943595":"2024-04-26T09:58:59.374192+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:00:14.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.332+0000 7f74b230a640 1 -- 172.21.15.7:0/3759437329 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f749806b500 msgr2=0x7f749806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:14.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.332+0000 7f74b230a640 1 --2- 172.21.15.7:0/3759437329 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f749806b500 0x7f749806d9c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f74ac0b7440 tx=0x7f74a0008040 comp rx=0 tx=0).stop 2024-04-25T10:00:14.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.332+0000 7f74b230a640 1 -- 172.21.15.7:0/3759437329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74ac155e40 msgr2=0x7f74ac0c8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:14.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.332+0000 7f74b230a640 1 --2- 172.21.15.7:0/3759437329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74ac155e40 0x7f74ac0c8710 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f749c0119d0 tx=0x7f749c011e90 comp rx=0 tx=0).stop 2024-04-25T10:00:14.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.333+0000 7f74b230a640 1 -- 172.21.15.7:0/3759437329 shutdown_connections 2024-04-25T10:00:14.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.333+0000 7f74b230a640 1 --2- 172.21.15.7:0/3759437329 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f749806b500 0x7f749806d9c0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.333+0000 7f74b230a640 1 --2- 172.21.15.7:0/3759437329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74ac159d40 0x7f74ac15c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.333+0000 7f74b230a640 1 --2- 172.21.15.7:0/3759437329 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74ac0ca190 0x7f74ac159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.333+0000 7f74b230a640 1 --2- 172.21.15.7:0/3759437329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74ac155e40 0x7f74ac0c8710 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.333+0000 7f74b230a640 1 -- 172.21.15.7:0/3759437329 >> 172.21.15.7:0/3759437329 conn(0x7f74ac0b3130 msgr2=0x7f74ac0ae8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.333+0000 7f74b230a640 1 -- 172.21.15.7:0/3759437329 shutdown_connections 2024-04-25T10:00:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.333+0000 7f74b230a640 1 -- 172.21.15.7:0/3759437329 wait complete. 2024-04-25T10:00:14.348 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:58:43.929184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:58:44.609970+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:00:14.348 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:00:14.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.448+0000 7f893e1f4640 1 Processor -- start 2024-04-25T10:00:14.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.448+0000 7f893e1f4640 1 -- start start 2024-04-25T10:00:14.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.448+0000 7f893e1f4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f89380d0940 0x7f8938165720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:14.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.448+0000 7f893e1f4640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f893815ec40 con 0x7f893815a820 2024-04-25T10:00:14.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.448+0000 7f893e1f4640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f893815ef20 con 0x7f89380ccf90 2024-04-25T10:00:14.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.448+0000 7f893e1f4640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89380c40d0 con 0x7f89380d0940 2024-04-25T10:00:14.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.449+0000 7f89377fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f893815a820 0x7f893815e3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60302/0 (socket says 172.21.15.7:60302) 2024-04-25T10:00:14.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.449+0000 7f89377fe640 1 -- 172.21.15.7:0/1056322204 learned_addr learned my addr 172.21.15.7:0/1056322204 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:14.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.449+0000 7f8937fff640 1 --2- 172.21.15.7:0/1056322204 >> v2:172.21.15.55:3300/0 conn(0x7f89380d0940 0x7f8938165720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:14.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.449+0000 7f89367fc640 1 -- 172.21.15.7:0/1056322204 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 816959397 0 0) 0x7f893815ec40 con 0x7f893815a820 2024-04-25T10:00:14.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.449+0000 7f89367fc640 1 -- 172.21.15.7:0/1056322204 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8920003520 con 0x7f893815a820 2024-04-25T10:00:14.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.449+0000 7f89367fc640 1 -- 172.21.15.7:0/1056322204 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 893979754 0 0) 0x7f8920003520 con 0x7f893815a820 2024-04-25T10:00:14.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.449+0000 7f89367fc640 1 -- 172.21.15.7:0/1056322204 >> v2:172.21.15.55:3300/0 conn(0x7f89380d0940 msgr2=0x7f8938165720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:14.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.449+0000 7f89367fc640 1 --2- 172.21.15.7:0/1056322204 >> v2:172.21.15.55:3300/0 conn(0x7f89380d0940 0x7f8938165720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.449+0000 7f89367fc640 1 -- 172.21.15.7:0/1056322204 >> v1:172.21.15.55:6789/0 conn(0x7f89380ccf90 legacy=0x7f89380d0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:14.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.449+0000 7f89367fc640 1 -- 172.21.15.7:0/1056322204 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893815f200 con 0x7f893815a820 2024-04-25T10:00:14.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.449+0000 7f89367fc640 1 -- 172.21.15.7:0/1056322204 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f8928001670 con 0x7f893815a820 2024-04-25T10:00:14.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.449+0000 7f89367fc640 1 -- 172.21.15.7:0/1056322204 >> v1:172.21.15.7:6789/0 conn(0x7f893815a820 legacy=0x7f893815e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:14.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.449+0000 7f89367fc640 1 --2- 172.21.15.7:0/1056322204 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89200039b0 0x7f8920003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:14.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.449+0000 7f89367fc640 1 --2- 172.21.15.7:0/1056322204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89200043b0 0x7f8920004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:14.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.449+0000 7f89367fc640 1 --2- 172.21.15.7:0/1056322204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8920005080 0x7f892000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:14.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.449+0000 7f89367fc640 1 -- 172.21.15.7:0/1056322204 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892000bfb0 con 0x7f8920005080 2024-04-25T10:00:14.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.449+0000 7f89367fc640 1 -- 172.21.15.7:0/1056322204 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892000c160 con 0x7f89200043b0 2024-04-25T10:00:14.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.449+0000 7f89367fc640 1 -- 172.21.15.7:0/1056322204 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f892000c360 con 0x7f89200039b0 2024-04-25T10:00:14.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.449+0000 7f8937fff640 1 --2- 172.21.15.7:0/1056322204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8920005080 0x7f892000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:14.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.449+0000 7f89377fe640 1 --2- 172.21.15.7:0/1056322204 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89200039b0 0x7f8920003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:14.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.449+0000 7f8936ffd640 1 --2- 172.21.15.7:0/1056322204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89200043b0 0x7f8920004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:14.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.450+0000 7f8937fff640 1 -- 172.21.15.7:0/1056322204 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89200039b0 msgr2=0x7f8920003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:14.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.450+0000 7f8937fff640 1 --2- 172.21.15.7:0/1056322204 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89200039b0 0x7f8920003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.450+0000 7f8937fff640 1 -- 172.21.15.7:0/1056322204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89200043b0 msgr2=0x7f8920004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:14.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.450+0000 7f8937fff640 1 --2- 172.21.15.7:0/1056322204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89200043b0 0x7f8920004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.450+0000 7f8937fff640 1 -- 172.21.15.7:0/1056322204 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8920003520 con 0x7f8920005080 2024-04-25T10:00:14.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.450+0000 7f89377fe640 1 --2- 172.21.15.7:0/1056322204 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89200039b0 0x7f8920003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:14.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.450+0000 7f8936ffd640 1 --2- 172.21.15.7:0/1056322204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89200043b0 0x7f8920004880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:14.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.450+0000 7f8937fff640 1 -- 172.21.15.7:0/1056322204 reap_dead start 2024-04-25T10:00:14.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.450+0000 7f8937fff640 1 --2- 172.21.15.7:0/1056322204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8920005080 0x7f892000b9c0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f8930009f90 tx=0x7f8920005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40cd52784c8e87c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:14.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.450+0000 7f89367fc640 1 -- 172.21.15.7:0/1056322204 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8930009c10 con 0x7f8920005080 2024-04-25T10:00:14.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.451+0000 7f89367fc640 1 -- 172.21.15.7:0/1056322204 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8930031440 con 0x7f8920005080 2024-04-25T10:00:14.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.451+0000 7f89367fc640 1 -- 172.21.15.7:0/1056322204 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8930031810 con 0x7f8920005080 2024-04-25T10:00:14.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.451+0000 7f893e1f4640 1 -- 172.21.15.7:0/1056322204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8920005080 msgr2=0x7f892000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:14.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.451+0000 7f893e1f4640 1 --2- 172.21.15.7:0/1056322204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8920005080 0x7f892000b9c0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f8930009f90 tx=0x7f8920005830 comp rx=0 tx=0).stop 2024-04-25T10:00:14.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.451+0000 7f893e1f4640 1 -- 172.21.15.7:0/1056322204 shutdown_connections 2024-04-25T10:00:14.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.451+0000 7f893e1f4640 1 --2- 172.21.15.7:0/1056322204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8920005080 0x7f892000b9c0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.451+0000 7f893e1f4640 1 -- 172.21.15.7:0/1056322204 >> 172.21.15.7:0/1056322204 conn(0x7f89380725e0 msgr2=0x7f89380999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:14.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.451+0000 7f893e1f4640 1 -- 172.21.15.7:0/1056322204 shutdown_connections 2024-04-25T10:00:14.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.451+0000 7f893e1f4640 1 -- 172.21.15.7:0/1056322204 wait complete. 2024-04-25T10:00:14.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.452+0000 7f893e1f4640 1 Processor -- start 2024-04-25T10:00:14.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.452+0000 7f893e1f4640 1 -- start start 2024-04-25T10:00:14.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.453+0000 7f893e1f4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8920005080 0x7f893815d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:14.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.453+0000 7f893e1f4640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89381eefa0 0x7f8938159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:14.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.453+0000 7f893e1f4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89380b5870 0x7f89380b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:14.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.453+0000 7f893e1f4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89380cb090 con 0x7f89380b5870 2024-04-25T10:00:14.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.453+0000 7f893e1f4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893815ac00 con 0x7f8920005080 2024-04-25T10:00:14.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.453+0000 7f893e1f4640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89380cb210 con 0x7f89381eefa0 2024-04-25T10:00:14.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.453+0000 7f8937fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89380b5870 0x7f89380b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:14.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.453+0000 7f8937fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89380b5870 0x7f89380b5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42866/0 (socket says 172.21.15.7:42866) 2024-04-25T10:00:14.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.453+0000 7f8937fff640 1 -- 172.21.15.7:0/2208411315 learned_addr learned my addr 172.21.15.7:0/2208411315 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:14.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.453+0000 7f8936ffd640 1 --2- 172.21.15.7:0/2208411315 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89381eefa0 0x7f8938159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:14.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.453+0000 7f89377fe640 1 --2- 172.21.15.7:0/2208411315 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8920005080 0x7f893815d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:14.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.454+0000 7f8937fff640 1 -- 172.21.15.7:0/2208411315 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89381eefa0 msgr2=0x7f8938159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:14.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.454+0000 7f8937fff640 1 --2- 172.21.15.7:0/2208411315 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89381eefa0 0x7f8938159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.454+0000 7f8937fff640 1 -- 172.21.15.7:0/2208411315 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8920005080 msgr2=0x7f893815d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:14.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.454+0000 7f8937fff640 1 --2- 172.21.15.7:0/2208411315 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8920005080 0x7f893815d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.454+0000 7f8937fff640 1 -- 172.21.15.7:0/2208411315 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89381ef710 con 0x7f89380b5870 2024-04-25T10:00:14.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.454+0000 7f8937fff640 1 --2- 172.21.15.7:0/2208411315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89380b5870 0x7f89380b5d20 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f8930033040 tx=0x7f8930009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:14.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.454+0000 7f891ffff640 1 -- 172.21.15.7:0/2208411315 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8930009c10 con 0x7f89380b5870 2024-04-25T10:00:14.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.454+0000 7f891ffff640 1 -- 172.21.15.7:0/2208411315 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8930043070 con 0x7f89380b5870 2024-04-25T10:00:14.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.454+0000 7f893e1f4640 1 -- 172.21.15.7:0/2208411315 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89381ef9f0 con 0x7f89380b5870 2024-04-25T10:00:14.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.454+0000 7f891ffff640 1 -- 172.21.15.7:0/2208411315 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893003c8b0 con 0x7f89380b5870 2024-04-25T10:00:14.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.454+0000 7f893e1f4640 1 -- 172.21.15.7:0/2208411315 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89381ef420 con 0x7f89380b5870 2024-04-25T10:00:14.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.455+0000 7f893e1f4640 1 -- 172.21.15.7:0/2208411315 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8938068f60 con 0x7f89380b5870 2024-04-25T10:00:14.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.455+0000 7f891ffff640 1 -- 172.21.15.7:0/2208411315 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8930005d10 con 0x7f89380b5870 2024-04-25T10:00:14.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.456+0000 7f891ffff640 1 --2- 172.21.15.7:0/2208411315 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f892406b4d0 0x7f892406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:14.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.456+0000 7f891ffff640 1 -- 172.21.15.7:0/2208411315 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f89300aad70 con 0x7f89380b5870 2024-04-25T10:00:14.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.456+0000 7f89377fe640 1 --2- 172.21.15.7:0/2208411315 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f892406b4d0 0x7f892406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:14.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.457+0000 7f89377fe640 1 --2- 172.21.15.7:0/2208411315 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f892406b4d0 0x7f892406d990 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f8928000c00 tx=0x7f8928007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:14.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.460+0000 7f891ffff640 1 -- 172.21.15.7:0/2208411315 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f89300793c0 con 0x7f89380b5870 2024-04-25T10:00:14.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.639+0000 7f893e1f4640 1 -- 172.21.15.7:0/2208411315 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f89380b6500 con 0x7f89380b5870 2024-04-25T10:00:14.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.639+0000 7f891ffff640 1 -- 172.21.15.7:0/2208411315 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7f893007d460 con 0x7f89380b5870 2024-04-25T10:00:14.643 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T10:00:14.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.641+0000 7f893e1f4640 1 -- 172.21.15.7:0/2208411315 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f892406b4d0 msgr2=0x7f892406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:14.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.641+0000 7f893e1f4640 1 --2- 172.21.15.7:0/2208411315 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f892406b4d0 0x7f892406d990 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f8928000c00 tx=0x7f8928007040 comp rx=0 tx=0).stop 2024-04-25T10:00:14.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.641+0000 7f893e1f4640 1 -- 172.21.15.7:0/2208411315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89380b5870 msgr2=0x7f89380b5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:14.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.641+0000 7f893e1f4640 1 --2- 172.21.15.7:0/2208411315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89380b5870 0x7f89380b5d20 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f8930033040 tx=0x7f8930009750 comp rx=0 tx=0).stop 2024-04-25T10:00:14.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.641+0000 7f893e1f4640 1 -- 172.21.15.7:0/2208411315 shutdown_connections 2024-04-25T10:00:14.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.641+0000 7f893e1f4640 1 --2- 172.21.15.7:0/2208411315 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f892406b4d0 0x7f892406d990 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.641+0000 7f893e1f4640 1 --2- 172.21.15.7:0/2208411315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89380b5870 0x7f89380b5d20 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.641+0000 7f893e1f4640 1 --2- 172.21.15.7:0/2208411315 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89381eefa0 0x7f8938159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.641+0000 7f893e1f4640 1 --2- 172.21.15.7:0/2208411315 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8920005080 0x7f893815d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.641+0000 7f893e1f4640 1 -- 172.21.15.7:0/2208411315 >> 172.21.15.7:0/2208411315 conn(0x7f89380725e0 msgr2=0x7f893806e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:14.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.641+0000 7f893e1f4640 1 -- 172.21.15.7:0/2208411315 shutdown_connections 2024-04-25T10:00:14.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.641+0000 7f893e1f4640 1 -- 172.21.15.7:0/2208411315 wait complete. 2024-04-25T10:00:14.656 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:00:14.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.756+0000 7f1a22607640 1 Processor -- start 2024-04-25T10:00:14.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.756+0000 7f1a22607640 1 -- start start 2024-04-25T10:00:14.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.757+0000 7f1a22607640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1a1c0d0780 0x7f1a1c0d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:14.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.757+0000 7f1a22607640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1a1c0b9130 0x7f1a1c0d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:14.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.757+0000 7f1a22607640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a1c0d10a0 con 0x7f1a1c0b9590 2024-04-25T10:00:14.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.757+0000 7f1a22607640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a1c0b7ef0 con 0x7f1a1c0d0780 2024-04-25T10:00:14.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.757+0000 7f1a22607640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a1c0b81d0 con 0x7f1a1c0b9130 2024-04-25T10:00:14.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.757+0000 7f1a1bfff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1a1c0d0780 0x7f1a1c0d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:14.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.757+0000 7f1a1bfff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1a1c0d0780 0x7f1a1c0d0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42874/0 (socket says 172.21.15.7:42874) 2024-04-25T10:00:14.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.757+0000 7f1a1bfff640 1 -- 172.21.15.7:0/1525954517 learned_addr learned my addr 172.21.15.7:0/1525954517 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:14.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.757+0000 7f1a1b7fe640 1 --2- 172.21.15.7:0/1525954517 >> v2:172.21.15.55:3300/0 conn(0x7f1a1c0b9130 0x7f1a1c0d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:14.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.757+0000 7f1a1bfff640 1 -- 172.21.15.7:0/1525954517 >> v2:172.21.15.55:3300/0 conn(0x7f1a1c0b9130 msgr2=0x7f1a1c0d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:14.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.757+0000 7f1a1bfff640 1 --2- 172.21.15.7:0/1525954517 >> v2:172.21.15.55:3300/0 conn(0x7f1a1c0b9130 0x7f1a1c0d1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.757+0000 7f1a1bfff640 1 -- 172.21.15.7:0/1525954517 >> v1:172.21.15.55:6789/0 conn(0x7f1a1c0b9590 legacy=0x7f1a1c0d2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:14.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.757+0000 7f1a1bfff640 1 -- 172.21.15.7:0/1525954517 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1c0b84b0 con 0x7f1a1c0d0780 2024-04-25T10:00:14.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.758+0000 7f1a1bfff640 1 --2- 172.21.15.7:0/1525954517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a1c0d0780 0x7f1a1c0d0b60 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0b61b0 tx=0x7f1a0402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c732835c6f4005 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:14.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.758+0000 7f1a1affd640 1 -- 172.21.15.7:0/1525954517 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a04037070 con 0x7f1a1c0d0780 2024-04-25T10:00:14.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.758+0000 7f1a1affd640 1 -- 172.21.15.7:0/1525954517 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a04032440 con 0x7f1a1c0d0780 2024-04-25T10:00:14.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.758+0000 7f1a1affd640 1 -- 172.21.15.7:0/1525954517 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a04032810 con 0x7f1a1c0d0780 2024-04-25T10:00:14.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.758+0000 7f1a22607640 1 -- 172.21.15.7:0/1525954517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a1c0d0780 msgr2=0x7f1a1c0d0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:14.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.758+0000 7f1a22607640 1 --2- 172.21.15.7:0/1525954517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a1c0d0780 0x7f1a1c0d0b60 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0b61b0 tx=0x7f1a0402a230 comp rx=0 tx=0).stop 2024-04-25T10:00:14.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.758+0000 7f1a22607640 1 -- 172.21.15.7:0/1525954517 shutdown_connections 2024-04-25T10:00:14.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.758+0000 7f1a22607640 1 --2- 172.21.15.7:0/1525954517 >> v2:172.21.15.55:3300/0 conn(0x7f1a1c0b9130 0x7f1a1c0d1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.758+0000 7f1a22607640 1 --2- 172.21.15.7:0/1525954517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a1c0d0780 0x7f1a1c0d0b60 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.758+0000 7f1a22607640 1 -- 172.21.15.7:0/1525954517 >> 172.21.15.7:0/1525954517 conn(0x7f1a1c0726b0 msgr2=0x7f1a1c072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:14.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.759+0000 7f1a22607640 1 -- 172.21.15.7:0/1525954517 shutdown_connections 2024-04-25T10:00:14.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.759+0000 7f1a22607640 1 -- 172.21.15.7:0/1525954517 wait complete. 2024-04-25T10:00:14.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.760+0000 7f1a22607640 1 Processor -- start 2024-04-25T10:00:14.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.760+0000 7f1a22607640 1 -- start start 2024-04-25T10:00:14.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.761+0000 7f1a22607640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1a1c0b9130 0x7f1a1c0c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:14.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.761+0000 7f1a22607640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a1c0b9590 0x7f1a1c15ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:14.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.761+0000 7f1a22607640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a1c0d0780 0x7f1a1c1f3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:14.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.761+0000 7f1a22607640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c1611b0 con 0x7f1a1c0b9590 2024-04-25T10:00:14.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.761+0000 7f1a22607640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c0b8a70 con 0x7f1a1c0d0780 2024-04-25T10:00:14.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.761+0000 7f1a22607640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c161330 con 0x7f1a1c0b9130 2024-04-25T10:00:14.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.761+0000 7f1a1b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a1c0b9590 0x7f1a1c15ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:14.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.761+0000 7f1a1b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a1c0b9590 0x7f1a1c15ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42878/0 (socket says 172.21.15.7:42878) 2024-04-25T10:00:14.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.761+0000 7f1a1b7fe640 1 -- 172.21.15.7:0/3389312041 learned_addr learned my addr 172.21.15.7:0/3389312041 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:14.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.761+0000 7f1a1bfff640 1 --2- 172.21.15.7:0/3389312041 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1a1c0b9130 0x7f1a1c0c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:14.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.761+0000 7f1a20ba4640 1 --2- 172.21.15.7:0/3389312041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a1c0d0780 0x7f1a1c1f3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:14.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.761+0000 7f1a1b7fe640 1 -- 172.21.15.7:0/3389312041 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1a1c0b9130 msgr2=0x7f1a1c0c8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:14.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.761+0000 7f1a1b7fe640 1 --2- 172.21.15.7:0/3389312041 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1a1c0b9130 0x7f1a1c0c8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.761+0000 7f1a1b7fe640 1 -- 172.21.15.7:0/3389312041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a1c0d0780 msgr2=0x7f1a1c1f3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:14.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.761+0000 7f1a1b7fe640 1 --2- 172.21.15.7:0/3389312041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a1c0d0780 0x7f1a1c1f3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.761+0000 7f1a1b7fe640 1 -- 172.21.15.7:0/3389312041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1c15b2c0 con 0x7f1a1c0b9590 2024-04-25T10:00:14.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.761+0000 7f1a1b7fe640 1 --2- 172.21.15.7:0/3389312041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a1c0b9590 0x7f1a1c15ad80 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c00d830 tx=0x7f1a0c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:14.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.761+0000 7f1a18ff9640 1 -- 172.21.15.7:0/3389312041 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c00b6c0 con 0x7f1a1c0b9590 2024-04-25T10:00:14.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.761+0000 7f1a18ff9640 1 -- 172.21.15.7:0/3389312041 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0c019070 con 0x7f1a1c0b9590 2024-04-25T10:00:14.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.761+0000 7f1a22607640 1 -- 172.21.15.7:0/3389312041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a1c1f3b70 con 0x7f1a1c0b9590 2024-04-25T10:00:14.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.761+0000 7f1a18ff9640 1 -- 172.21.15.7:0/3389312041 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c00ba80 con 0x7f1a1c0b9590 2024-04-25T10:00:14.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.762+0000 7f1a22607640 1 -- 172.21.15.7:0/3389312041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a1c1f4130 con 0x7f1a1c0b9590 2024-04-25T10:00:14.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.763+0000 7f1a22607640 1 -- 172.21.15.7:0/3389312041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a1c068f60 con 0x7f1a1c0b9590 2024-04-25T10:00:14.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.763+0000 7f1a18ff9640 1 -- 172.21.15.7:0/3389312041 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1a0c01e460 con 0x7f1a1c0b9590 2024-04-25T10:00:14.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.763+0000 7f1a18ff9640 1 --2- 172.21.15.7:0/3389312041 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f19fc06b4d0 0x7f19fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:14.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.763+0000 7f1a18ff9640 1 -- 172.21.15.7:0/3389312041 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f1a0c08aa00 con 0x7f1a1c0b9590 2024-04-25T10:00:14.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.763+0000 7f1a1bfff640 1 --2- 172.21.15.7:0/3389312041 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f19fc06b4d0 0x7f19fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:14.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.764+0000 7f1a1bfff640 1 --2- 172.21.15.7:0/3389312041 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f19fc06b4d0 0x7f19fc06d990 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1a04034000 tx=0x7f1a0402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:14.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.767+0000 7f1a18ff9640 1 -- 172.21.15.7:0/3389312041 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1a0c059730 con 0x7f1a1c0b9590 2024-04-25T10:00:14.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.949+0000 7f1a22607640 1 -- 172.21.15.7:0/3389312041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1a1c1f3860 con 0x7f1a1c0b9590 2024-04-25T10:00:14.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.950+0000 7f1a18ff9640 1 -- 172.21.15.7:0/3389312041 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v76) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1a0c059030 con 0x7f1a1c0b9590 2024-04-25T10:00:14.954 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T10:00:14.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.952+0000 7f1a22607640 1 -- 172.21.15.7:0/3389312041 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f19fc06b4d0 msgr2=0x7f19fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:14.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.952+0000 7f1a22607640 1 --2- 172.21.15.7:0/3389312041 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f19fc06b4d0 0x7f19fc06d990 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1a04034000 tx=0x7f1a0402e000 comp rx=0 tx=0).stop 2024-04-25T10:00:14.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.952+0000 7f1a22607640 1 -- 172.21.15.7:0/3389312041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a1c0b9590 msgr2=0x7f1a1c15ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:14.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.952+0000 7f1a22607640 1 --2- 172.21.15.7:0/3389312041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a1c0b9590 0x7f1a1c15ad80 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c00d830 tx=0x7f1a0c00dcf0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.952+0000 7f1a22607640 1 -- 172.21.15.7:0/3389312041 shutdown_connections 2024-04-25T10:00:14.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.952+0000 7f1a22607640 1 --2- 172.21.15.7:0/3389312041 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f19fc06b4d0 0x7f19fc06d990 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.952+0000 7f1a22607640 1 --2- 172.21.15.7:0/3389312041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a1c0d0780 0x7f1a1c1f3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.952+0000 7f1a22607640 1 --2- 172.21.15.7:0/3389312041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a1c0b9590 0x7f1a1c15ad80 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.952+0000 7f1a22607640 1 --2- 172.21.15.7:0/3389312041 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1a1c0b9130 0x7f1a1c0c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:14.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.952+0000 7f1a22607640 1 -- 172.21.15.7:0/3389312041 >> 172.21.15.7:0/3389312041 conn(0x7f1a1c0726b0 msgr2=0x7f1a1c15e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:14.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.952+0000 7f1a22607640 1 -- 172.21.15.7:0/3389312041 shutdown_connections 2024-04-25T10:00:14.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:14.952+0000 7f1a22607640 1 -- 172.21.15.7:0/3389312041 wait complete. 2024-04-25T10:00:14.967 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:00:15.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.065+0000 7f9bd3b09640 1 Processor -- start 2024-04-25T10:00:15.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.066+0000 7f9bd3b09640 1 -- start start 2024-04-25T10:00:15.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.066+0000 7f9bd3b09640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9bcc0d0a00 0x7f9bcc09a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:15.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.066+0000 7f9bd3b09640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9bcc09a7d0 0x7f9bcc0cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:15.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.066+0000 7f9bd3b09640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bcc1615e0 con 0x7f9bcc161200 2024-04-25T10:00:15.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.066+0000 7f9bd3b09640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bcc06c9f0 con 0x7f9bcc09a7d0 2024-04-25T10:00:15.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.066+0000 7f9bd3b09640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc06ccd0 con 0x7f9bcc0d0a00 2024-04-25T10:00:15.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.067+0000 7f9bd20a6640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9bcc09a7d0 0x7f9bcc0cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:15.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.067+0000 7f9bd18a5640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9bcc161200 0x7f9bcc0cbd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60318/0 (socket says 172.21.15.7:60318) 2024-04-25T10:00:15.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.067+0000 7f9bd18a5640 1 -- 172.21.15.7:0/387241119 learned_addr learned my addr 172.21.15.7:0/387241119 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:15.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.067+0000 7f9bd20a6640 1 -- 172.21.15.7:0/387241119 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9bcc0d0a00 msgr2=0x7f9bcc09a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:15.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.067+0000 7f9bd10a4640 1 --2- 172.21.15.7:0/387241119 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9bcc0d0a00 0x7f9bcc09a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:15.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.067+0000 7f9bd20a6640 1 --2- 172.21.15.7:0/387241119 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9bcc0d0a00 0x7f9bcc09a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.067+0000 7f9bd20a6640 1 -- 172.21.15.7:0/387241119 >> v1:172.21.15.7:6789/0 conn(0x7f9bcc161200 legacy=0x7f9bcc0cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:15.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.067+0000 7f9bd08a3640 1 -- 172.21.15.7:0/387241119 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933001873 0 0) 0x7f9bc8001110 con 0x7f9bcc161200 2024-04-25T10:00:15.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.067+0000 7f9bd20a6640 1 -- 172.21.15.7:0/387241119 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bcc099a90 con 0x7f9bcc09a7d0 2024-04-25T10:00:15.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.067+0000 7f9bd10a4640 1 --2- 172.21.15.7:0/387241119 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9bcc0d0a00 0x7f9bcc09a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:00:15.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.068+0000 7f9bd20a6640 1 --2- 172.21.15.7:0/387241119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bcc09a7d0 0x7f9bcc0cf840 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4009d90 tx=0x7f9bc402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb320049929d7522 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:15.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.068+0000 7f9bd08a3640 1 -- 172.21.15.7:0/387241119 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4007740 con 0x7f9bcc09a7d0 2024-04-25T10:00:15.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.068+0000 7f9bd08a3640 1 -- 172.21.15.7:0/387241119 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc40078e0 con 0x7f9bcc09a7d0 2024-04-25T10:00:15.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.068+0000 7f9bd08a3640 1 -- 172.21.15.7:0/387241119 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4007cb0 con 0x7f9bcc09a7d0 2024-04-25T10:00:15.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.068+0000 7f9bd3b09640 1 -- 172.21.15.7:0/387241119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bcc09a7d0 msgr2=0x7f9bcc0cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:15.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.068+0000 7f9bd3b09640 1 --2- 172.21.15.7:0/387241119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bcc09a7d0 0x7f9bcc0cf840 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4009d90 tx=0x7f9bc402a660 comp rx=0 tx=0).stop 2024-04-25T10:00:15.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.068+0000 7f9bd3b09640 1 -- 172.21.15.7:0/387241119 shutdown_connections 2024-04-25T10:00:15.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.068+0000 7f9bd3b09640 1 --2- 172.21.15.7:0/387241119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bcc09a7d0 0x7f9bcc0cf840 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.068+0000 7f9bd3b09640 1 --2- 172.21.15.7:0/387241119 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9bcc0d0a00 0x7f9bcc09a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.068+0000 7f9bd3b09640 1 -- 172.21.15.7:0/387241119 >> 172.21.15.7:0/387241119 conn(0x7f9bcc0b31a0 msgr2=0x7f9bcc0b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:15.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.069+0000 7f9bd3b09640 1 -- 172.21.15.7:0/387241119 shutdown_connections 2024-04-25T10:00:15.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.069+0000 7f9bd3b09640 1 -- 172.21.15.7:0/387241119 wait complete. 2024-04-25T10:00:15.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.070+0000 7f9bd3b09640 1 Processor -- start 2024-04-25T10:00:15.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.070+0000 7f9bd3b09640 1 -- start start 2024-04-25T10:00:15.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.070+0000 7f9bd3b09640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bcc09a7d0 0x7f9bcc14fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:15.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.070+0000 7f9bd3b09640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bcc0d0a00 0x7f9bcc1f6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:15.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.070+0000 7f9bd3b09640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9bcc161200 0x7f9bcc1f4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:15.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.070+0000 7f9bd3b09640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc06cfb0 con 0x7f9bcc09a7d0 2024-04-25T10:00:15.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.070+0000 7f9bd3b09640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc06c680 con 0x7f9bcc0d0a00 2024-04-25T10:00:15.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.070+0000 7f9bd3b09640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc06d130 con 0x7f9bcc161200 2024-04-25T10:00:15.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.071+0000 7f9bd18a5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bcc09a7d0 0x7f9bcc14fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:15.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.071+0000 7f9bd18a5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bcc09a7d0 0x7f9bcc14fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42888/0 (socket says 172.21.15.7:42888) 2024-04-25T10:00:15.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.071+0000 7f9bd18a5640 1 -- 172.21.15.7:0/3578332712 learned_addr learned my addr 172.21.15.7:0/3578332712 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:15.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.071+0000 7f9bd18a5640 1 -- 172.21.15.7:0/3578332712 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9bcc161200 msgr2=0x7f9bcc1f4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:15.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.071+0000 7f9bd18a5640 1 --2- 172.21.15.7:0/3578332712 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9bcc161200 0x7f9bcc1f4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.071+0000 7f9bd18a5640 1 -- 172.21.15.7:0/3578332712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bcc0d0a00 msgr2=0x7f9bcc1f6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:15.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.071+0000 7f9bd18a5640 1 --2- 172.21.15.7:0/3578332712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bcc0d0a00 0x7f9bcc1f6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.071+0000 7f9bd18a5640 1 -- 172.21.15.7:0/3578332712 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bcc1f75c0 con 0x7f9bcc09a7d0 2024-04-25T10:00:15.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.071+0000 7f9bd18a5640 1 --2- 172.21.15.7:0/3578332712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bcc09a7d0 0x7f9bcc14fc50 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f9bc800c430 tx=0x7f9bc800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:15.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.071+0000 7f9bc27fc640 1 -- 172.21.15.7:0/3578332712 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc80074e0 con 0x7f9bcc09a7d0 2024-04-25T10:00:15.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.071+0000 7f9bc27fc640 1 -- 172.21.15.7:0/3578332712 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc80047e0 con 0x7f9bcc09a7d0 2024-04-25T10:00:15.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.071+0000 7f9bd3b09640 1 -- 172.21.15.7:0/3578332712 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bcc1f78a0 con 0x7f9bcc09a7d0 2024-04-25T10:00:15.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.071+0000 7f9bc27fc640 1 -- 172.21.15.7:0/3578332712 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc8004bd0 con 0x7f9bcc09a7d0 2024-04-25T10:00:15.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.071+0000 7f9bd3b09640 1 -- 172.21.15.7:0/3578332712 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bcc1f3800 con 0x7f9bcc09a7d0 2024-04-25T10:00:15.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.072+0000 7f9bd3b09640 1 -- 172.21.15.7:0/3578332712 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bcc068f60 con 0x7f9bcc09a7d0 2024-04-25T10:00:15.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.073+0000 7f9bc27fc640 1 -- 172.21.15.7:0/3578332712 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9bc8011070 con 0x7f9bcc09a7d0 2024-04-25T10:00:15.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.073+0000 7f9bc27fc640 1 --2- 172.21.15.7:0/3578332712 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9bb006b4d0 0x7f9bb006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:15.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.073+0000 7f9bc27fc640 1 -- 172.21.15.7:0/3578332712 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f9bc808a070 con 0x7f9bcc09a7d0 2024-04-25T10:00:15.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.073+0000 7f9bd10a4640 1 --2- 172.21.15.7:0/3578332712 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9bb006b4d0 0x7f9bb006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:15.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.073+0000 7f9bd10a4640 1 --2- 172.21.15.7:0/3578332712 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9bb006b4d0 0x7f9bb006d990 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc006fd0 tx=0x7f9bbc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:15.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.077+0000 7f9bc27fc640 1 -- 172.21.15.7:0/3578332712 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9bcc1615e0 con 0x7f9bcc09a7d0 2024-04-25T10:00:15.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.257+0000 7f9bd3b09640 1 -- 172.21.15.7:0/3578332712 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9bcc0b4050 con 0x7f9bcc09a7d0 2024-04-25T10:00:15.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.257+0000 7f9bc27fc640 1 -- 172.21.15.7:0/3578332712 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9bc8058d10 con 0x7f9bcc09a7d0 2024-04-25T10:00:15.262 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T10:00:15.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.259+0000 7f9bd3b09640 1 -- 172.21.15.7:0/3578332712 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9bb006b4d0 msgr2=0x7f9bb006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:15.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.259+0000 7f9bd3b09640 1 --2- 172.21.15.7:0/3578332712 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9bb006b4d0 0x7f9bb006d990 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc006fd0 tx=0x7f9bbc008040 comp rx=0 tx=0).stop 2024-04-25T10:00:15.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.259+0000 7f9bd3b09640 1 -- 172.21.15.7:0/3578332712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bcc09a7d0 msgr2=0x7f9bcc14fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:15.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.259+0000 7f9bd3b09640 1 --2- 172.21.15.7:0/3578332712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bcc09a7d0 0x7f9bcc14fc50 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f9bc800c430 tx=0x7f9bc800c8f0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.259+0000 7f9bd3b09640 1 -- 172.21.15.7:0/3578332712 shutdown_connections 2024-04-25T10:00:15.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.259+0000 7f9bd3b09640 1 --2- 172.21.15.7:0/3578332712 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9bb006b4d0 0x7f9bb006d990 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.259+0000 7f9bd3b09640 1 --2- 172.21.15.7:0/3578332712 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9bcc161200 0x7f9bcc1f4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.259+0000 7f9bd3b09640 1 --2- 172.21.15.7:0/3578332712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bcc0d0a00 0x7f9bcc1f6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.259+0000 7f9bd3b09640 1 --2- 172.21.15.7:0/3578332712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bcc09a7d0 0x7f9bcc14fc50 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.259+0000 7f9bd3b09640 1 -- 172.21.15.7:0/3578332712 >> 172.21.15.7:0/3578332712 conn(0x7f9bcc0b31a0 msgr2=0x7f9bcc0ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:15.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.259+0000 7f9bd3b09640 1 -- 172.21.15.7:0/3578332712 shutdown_connections 2024-04-25T10:00:15.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.259+0000 7f9bd3b09640 1 -- 172.21.15.7:0/3578332712 wait complete. 2024-04-25T10:00:15.274 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:00:15.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.370+0000 7fe8ef891640 1 Processor -- start 2024-04-25T10:00:15.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.370+0000 7fe8ef891640 1 -- start start 2024-04-25T10:00:15.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.371+0000 7fe8ef891640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe8e81529e0 0x7fe8e80c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:15.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.371+0000 7fe8ef891640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe8e80c6410 0x7fe8e80ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:15.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.371+0000 7fe8ef891640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe8e8071ed0 0x7fe8e80ce890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:15.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.371+0000 7fe8ef891640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e80b2340 con 0x7fe8e81529e0 2024-04-25T10:00:15.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.371+0000 7fe8ef891640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e815bdc0 con 0x7fe8e8071ed0 2024-04-25T10:00:15.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.371+0000 7fe8ef891640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e815c060 con 0x7fe8e80c6410 2024-04-25T10:00:15.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.371+0000 7fe8ed62d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe8e81529e0 0x7fe8e80c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:15.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.371+0000 7fe8ed62d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe8e81529e0 0x7fe8e80c5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42900/0 (socket says 172.21.15.7:42900) 2024-04-25T10:00:15.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.371+0000 7fe8ed62d640 1 -- 172.21.15.7:0/202589900 learned_addr learned my addr 172.21.15.7:0/202589900 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:15.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.372+0000 7fe8ece2c640 1 --2- 172.21.15.7:0/202589900 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe8e80c6410 0x7fe8e80ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:15.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.372+0000 7fe8ed62d640 1 -- 172.21.15.7:0/202589900 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe8e80c6410 msgr2=0x7fe8e80ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:15.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.372+0000 7fe8ed62d640 1 --2- 172.21.15.7:0/202589900 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe8e80c6410 0x7fe8e80ce350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.372+0000 7fe8ed62d640 1 -- 172.21.15.7:0/202589900 >> v2:172.21.15.55:3300/0 conn(0x7fe8e8071ed0 msgr2=0x7fe8e80ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:15.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.372+0000 7fe8ede2e640 1 --2- 172.21.15.7:0/202589900 >> v2:172.21.15.55:3300/0 conn(0x7fe8e8071ed0 0x7fe8e80ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:15.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.372+0000 7fe8ed62d640 1 --2- 172.21.15.7:0/202589900 >> v2:172.21.15.55:3300/0 conn(0x7fe8e8071ed0 0x7fe8e80ce890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.372+0000 7fe8ed62d640 1 -- 172.21.15.7:0/202589900 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e815c340 con 0x7fe8e81529e0 2024-04-25T10:00:15.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.372+0000 7fe8ede2e640 1 --2- 172.21.15.7:0/202589900 >> v2:172.21.15.55:3300/0 conn(0x7fe8e8071ed0 0x7fe8e80ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:00:15.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.372+0000 7fe8ed62d640 1 --2- 172.21.15.7:0/202589900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e81529e0 0x7fe8e80c5ed0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8071cd0 tx=0x7fe8e002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd2227ebc6506f7a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:15.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.373+0000 7fe8dffff640 1 -- 172.21.15.7:0/202589900 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0037070 con 0x7fe8e81529e0 2024-04-25T10:00:15.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.373+0000 7fe8dffff640 1 -- 172.21.15.7:0/202589900 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e0032440 con 0x7fe8e81529e0 2024-04-25T10:00:15.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.373+0000 7fe8dffff640 1 -- 172.21.15.7:0/202589900 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0032810 con 0x7fe8e81529e0 2024-04-25T10:00:15.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.373+0000 7fe8ef891640 1 -- 172.21.15.7:0/202589900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e81529e0 msgr2=0x7fe8e80c5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:15.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.373+0000 7fe8ef891640 1 --2- 172.21.15.7:0/202589900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e81529e0 0x7fe8e80c5ed0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8071cd0 tx=0x7fe8e002a1e0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.373+0000 7fe8ef891640 1 -- 172.21.15.7:0/202589900 shutdown_connections 2024-04-25T10:00:15.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.373+0000 7fe8ef891640 1 --2- 172.21.15.7:0/202589900 >> v2:172.21.15.55:3300/0 conn(0x7fe8e8071ed0 0x7fe8e80ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.373+0000 7fe8ef891640 1 --2- 172.21.15.7:0/202589900 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe8e80c6410 0x7fe8e80ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.373+0000 7fe8ef891640 1 --2- 172.21.15.7:0/202589900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e81529e0 0x7fe8e80c5ed0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.373+0000 7fe8ef891640 1 -- 172.21.15.7:0/202589900 >> 172.21.15.7:0/202589900 conn(0x7fe8e8071150 msgr2=0x7fe8e8071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:15.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.373+0000 7fe8ef891640 1 -- 172.21.15.7:0/202589900 shutdown_connections 2024-04-25T10:00:15.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.373+0000 7fe8ef891640 1 -- 172.21.15.7:0/202589900 wait complete. 2024-04-25T10:00:15.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.374+0000 7fe8ef891640 1 Processor -- start 2024-04-25T10:00:15.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.374+0000 7fe8ef891640 1 -- start start 2024-04-25T10:00:15.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.375+0000 7fe8ef891640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8e8071ed0 0x7fe8e81480b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:15.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.375+0000 7fe8ef891640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e80c6410 0x7fe8e8156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:15.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.375+0000 7fe8ef891640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe8e8156870 0x7fe8e80b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:15.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.375+0000 7fe8ef891640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80c4660 con 0x7fe8e80c6410 2024-04-25T10:00:15.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.375+0000 7fe8ef891640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e815c900 con 0x7fe8e8071ed0 2024-04-25T10:00:15.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.375+0000 7fe8ef891640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80c47e0 con 0x7fe8e8156870 2024-04-25T10:00:15.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.375+0000 7fe8ece2c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e80c6410 0x7fe8e8156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:15.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.375+0000 7fe8ece2c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e80c6410 0x7fe8e8156330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42916/0 (socket says 172.21.15.7:42916) 2024-04-25T10:00:15.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.375+0000 7fe8ece2c640 1 -- 172.21.15.7:0/3951563993 learned_addr learned my addr 172.21.15.7:0/3951563993 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:15.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.375+0000 7fe8ede2e640 1 --2- 172.21.15.7:0/3951563993 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe8e8156870 0x7fe8e80b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:15.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.375+0000 7fe8ed62d640 1 --2- 172.21.15.7:0/3951563993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8e8071ed0 0x7fe8e81480b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:15.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.376+0000 7fe8ece2c640 1 -- 172.21.15.7:0/3951563993 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe8e8156870 msgr2=0x7fe8e80b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:15.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.376+0000 7fe8ece2c640 1 --2- 172.21.15.7:0/3951563993 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe8e8156870 0x7fe8e80b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.376+0000 7fe8ece2c640 1 -- 172.21.15.7:0/3951563993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8e8071ed0 msgr2=0x7fe8e81480b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:15.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.376+0000 7fe8ece2c640 1 --2- 172.21.15.7:0/3951563993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8e8071ed0 0x7fe8e81480b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.376+0000 7fe8ece2c640 1 -- 172.21.15.7:0/3951563993 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e8156db0 con 0x7fe8e80c6410 2024-04-25T10:00:15.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.376+0000 7fe8ed62d640 1 --2- 172.21.15.7:0/3951563993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8e8071ed0 0x7fe8e81480b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:15.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.376+0000 7fe8ece2c640 1 --2- 172.21.15.7:0/3951563993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e80c6410 0x7fe8e8156330 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fe8d800c7f0 tx=0x7fe8d800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:15.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.376+0000 7fe8ddffb640 1 -- 172.21.15.7:0/3951563993 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8015070 con 0x7fe8e80c6410 2024-04-25T10:00:15.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.376+0000 7fe8ddffb640 1 -- 172.21.15.7:0/3951563993 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d8004240 con 0x7fe8e80c6410 2024-04-25T10:00:15.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.376+0000 7fe8ef891640 1 -- 172.21.15.7:0/3951563993 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e8157090 con 0x7fe8e80c6410 2024-04-25T10:00:15.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.376+0000 7fe8ddffb640 1 -- 172.21.15.7:0/3951563993 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8007620 con 0x7fe8e80c6410 2024-04-25T10:00:15.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.376+0000 7fe8ef891640 1 -- 172.21.15.7:0/3951563993 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e8157650 con 0x7fe8e80c6410 2024-04-25T10:00:15.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.377+0000 7fe8ef891640 1 -- 172.21.15.7:0/3951563993 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e8068fd0 con 0x7fe8e80c6410 2024-04-25T10:00:15.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.377+0000 7fe8ddffb640 1 -- 172.21.15.7:0/3951563993 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe8d80079d0 con 0x7fe8e80c6410 2024-04-25T10:00:15.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.378+0000 7fe8ddffb640 1 --2- 172.21.15.7:0/3951563993 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe8cc06b4d0 0x7fe8cc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:15.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.378+0000 7fe8ddffb640 1 -- 172.21.15.7:0/3951563993 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fe8d808a420 con 0x7fe8e80c6410 2024-04-25T10:00:15.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.378+0000 7fe8ed62d640 1 --2- 172.21.15.7:0/3951563993 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe8cc06b4d0 0x7fe8cc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:15.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.378+0000 7fe8ed62d640 1 --2- 172.21.15.7:0/3951563993 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe8cc06b4d0 0x7fe8cc06d990 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0034000 tx=0x7fe8e002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:15.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.382+0000 7fe8ddffb640 1 -- 172.21.15.7:0/3951563993 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe8d80590c0 con 0x7fe8e80c6410 2024-04-25T10:00:15.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.602+0000 7fe8ef891640 1 -- 172.21.15.7:0/3951563993 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8e80c5e40 con 0x7fe8e80c6410 2024-04-25T10:00:15.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.602+0000 7fe8ddffb640 1 -- 172.21.15.7:0/3951563993 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4936 (secure 0 0 0) 0x7fe8d80589c0 con 0x7fe8e80c6410 2024-04-25T10:00:15.607 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:00:15.607 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":45,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1781470369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1781470369},{"type":"v1","addr":"172.21.15.55:6835","nonce":1781470369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6442,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1406578404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1406578404},{"type":"v1","addr":"172.21.15.55:6834","nonce":1406578404}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6810,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1839614891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1839614891},{"type":"v1","addr":"172.21.15.7:6835","nonce":1839614891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:58:45.628406+0000","modified":"2024-04-25T09:59:42.407854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6813},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6813":{"gid":6813,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":18,"addr":"172.21.15.7:6837/3690076929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3690076929},{"type":"v1","addr":"172.21.15.7:6837","nonce":3690076929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T10:00:15.607 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 45 2024-04-25T10:00:15.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.605+0000 7fe8ef891640 1 -- 172.21.15.7:0/3951563993 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe8cc06b4d0 msgr2=0x7fe8cc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:15.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.605+0000 7fe8ef891640 1 --2- 172.21.15.7:0/3951563993 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe8cc06b4d0 0x7fe8cc06d990 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0034000 tx=0x7fe8e002e000 comp rx=0 tx=0).stop 2024-04-25T10:00:15.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.605+0000 7fe8ef891640 1 -- 172.21.15.7:0/3951563993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e80c6410 msgr2=0x7fe8e8156330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:15.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.605+0000 7fe8ef891640 1 --2- 172.21.15.7:0/3951563993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e80c6410 0x7fe8e8156330 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fe8d800c7f0 tx=0x7fe8d800ccb0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.605+0000 7fe8ef891640 1 -- 172.21.15.7:0/3951563993 shutdown_connections 2024-04-25T10:00:15.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.605+0000 7fe8ef891640 1 --2- 172.21.15.7:0/3951563993 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe8cc06b4d0 0x7fe8cc06d990 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.605+0000 7fe8ef891640 1 --2- 172.21.15.7:0/3951563993 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe8e8156870 0x7fe8e80b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.605+0000 7fe8ef891640 1 --2- 172.21.15.7:0/3951563993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e80c6410 0x7fe8e8156330 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.605+0000 7fe8ef891640 1 --2- 172.21.15.7:0/3951563993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8e8071ed0 0x7fe8e81480b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.605+0000 7fe8ef891640 1 -- 172.21.15.7:0/3951563993 >> 172.21.15.7:0/3951563993 conn(0x7fe8e8071150 msgr2=0x7fe8e8159ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:15.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.605+0000 7fe8ef891640 1 -- 172.21.15.7:0/3951563993 shutdown_connections 2024-04-25T10:00:15.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.605+0000 7fe8ef891640 1 -- 172.21.15.7:0/3951563993 wait complete. 2024-04-25T10:00:15.620 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:00:15.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.716+0000 7f66b7c22640 1 Processor -- start 2024-04-25T10:00:15.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.717+0000 7f66b7c22640 1 -- start start 2024-04-25T10:00:15.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.717+0000 7f66b7c22640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f66b00d0990 0x7f66b015e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:15.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.717+0000 7f66b7c22640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66b00ce2b0 con 0x7f66b015da50 2024-04-25T10:00:15.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.717+0000 7f66b7c22640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66b015e960 con 0x7f66b015de30 2024-04-25T10:00:15.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.717+0000 7f66b7c22640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66b00cf1a0 con 0x7f66b00d0990 2024-04-25T10:00:15.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.717+0000 7f66b59be640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f66b015da50 0x7f66b00cea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60326/0 (socket says 172.21.15.7:60326) 2024-04-25T10:00:15.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.717+0000 7f66b59be640 1 -- 172.21.15.7:0/249520954 learned_addr learned my addr 172.21.15.7:0/249520954 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:15.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.718+0000 7f66b61bf640 1 --2- 172.21.15.7:0/249520954 >> v2:172.21.15.55:3300/0 conn(0x7f66b00d0990 0x7f66b015e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:15.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.718+0000 7f66b49bc640 1 -- 172.21.15.7:0/249520954 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2864008996 0 0) 0x7f66b00ce2b0 con 0x7f66b015da50 2024-04-25T10:00:15.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.718+0000 7f66b49bc640 1 -- 172.21.15.7:0/249520954 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f669c003520 con 0x7f66b015da50 2024-04-25T10:00:15.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.718+0000 7f66b49bc640 1 -- 172.21.15.7:0/249520954 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 999586913 0 0) 0x7f669c003520 con 0x7f66b015da50 2024-04-25T10:00:15.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.718+0000 7f66b49bc640 1 -- 172.21.15.7:0/249520954 >> v2:172.21.15.55:3300/0 conn(0x7f66b00d0990 msgr2=0x7f66b015e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:15.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.718+0000 7f66b49bc640 1 --2- 172.21.15.7:0/249520954 >> v2:172.21.15.55:3300/0 conn(0x7f66b00d0990 0x7f66b015e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.718+0000 7f66b49bc640 1 -- 172.21.15.7:0/249520954 >> v1:172.21.15.55:6789/0 conn(0x7f66b015de30 legacy=0x7f66b00d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:15.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.718+0000 7f66b49bc640 1 -- 172.21.15.7:0/249520954 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b015ec40 con 0x7f66b015da50 2024-04-25T10:00:15.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.718+0000 7f66b49bc640 1 -- 172.21.15.7:0/249520954 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f66ac001670 con 0x7f66b015da50 2024-04-25T10:00:15.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.718+0000 7f66b49bc640 1 -- 172.21.15.7:0/249520954 >> v1:172.21.15.7:6789/0 conn(0x7f66b015da50 legacy=0x7f66b00cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:15.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.718+0000 7f66b49bc640 1 --2- 172.21.15.7:0/249520954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f669c0039b0 0x7f669c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:15.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.718+0000 7f66b49bc640 1 --2- 172.21.15.7:0/249520954 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f669c004800 0x7f669c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:15.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.718+0000 7f66b49bc640 1 --2- 172.21.15.7:0/249520954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f669c0051c0 0x7f669c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:15.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.718+0000 7f66b49bc640 1 -- 172.21.15.7:0/249520954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b00cf1a0 con 0x7f669c0051c0 2024-04-25T10:00:15.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.718+0000 7f66b49bc640 1 -- 172.21.15.7:0/249520954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c00c060 con 0x7f669c0039b0 2024-04-25T10:00:15.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.718+0000 7f66b49bc640 1 -- 172.21.15.7:0/249520954 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669c00c260 con 0x7f669c004800 2024-04-25T10:00:15.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.718+0000 7f66b61bf640 1 --2- 172.21.15.7:0/249520954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f669c0051c0 0x7f669c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:15.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.718+0000 7f66b51bd640 1 --2- 172.21.15.7:0/249520954 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f669c004800 0x7f669c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:15.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.718+0000 7f66b59be640 1 --2- 172.21.15.7:0/249520954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f669c0039b0 0x7f669c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:15.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.719+0000 7f66b61bf640 1 -- 172.21.15.7:0/249520954 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f669c004800 msgr2=0x7f669c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:15.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.719+0000 7f66b61bf640 1 --2- 172.21.15.7:0/249520954 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f669c004800 0x7f669c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.719+0000 7f66b61bf640 1 -- 172.21.15.7:0/249520954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f669c0039b0 msgr2=0x7f669c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:15.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.719+0000 7f66b61bf640 1 --2- 172.21.15.7:0/249520954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f669c0039b0 0x7f669c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.719+0000 7f66b61bf640 1 -- 172.21.15.7:0/249520954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669c003520 con 0x7f669c0051c0 2024-04-25T10:00:15.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.719+0000 7f66b61bf640 1 -- 172.21.15.7:0/249520954 reap_dead start 2024-04-25T10:00:15.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.719+0000 7f66b61bf640 1 --2- 172.21.15.7:0/249520954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f669c0051c0 0x7f669c00b9c0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f66a8009f90 tx=0x7f669c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8db6a1e36bd1320 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:15.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.719+0000 7f66b49bc640 1 -- 172.21.15.7:0/249520954 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a8035020 con 0x7f669c0051c0 2024-04-25T10:00:15.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.719+0000 7f66b49bc640 1 -- 172.21.15.7:0/249520954 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a8003b90 con 0x7f669c0051c0 2024-04-25T10:00:15.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.719+0000 7f66b49bc640 1 -- 172.21.15.7:0/249520954 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a8009c10 con 0x7f669c0051c0 2024-04-25T10:00:15.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.720+0000 7f66b7c22640 1 -- 172.21.15.7:0/249520954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f669c0051c0 msgr2=0x7f669c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:15.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.720+0000 7f66b7c22640 1 --2- 172.21.15.7:0/249520954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f669c0051c0 0x7f669c00b9c0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f66a8009f90 tx=0x7f669c005830 comp rx=0 tx=0).stop 2024-04-25T10:00:15.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.720+0000 7f66b7c22640 1 -- 172.21.15.7:0/249520954 shutdown_connections 2024-04-25T10:00:15.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.720+0000 7f66b7c22640 1 --2- 172.21.15.7:0/249520954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f669c0051c0 0x7f669c00b9c0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.720+0000 7f66b7c22640 1 -- 172.21.15.7:0/249520954 >> 172.21.15.7:0/249520954 conn(0x7f66b0072290 msgr2=0x7f66b0072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:15.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.720+0000 7f66b7c22640 1 -- 172.21.15.7:0/249520954 shutdown_connections 2024-04-25T10:00:15.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.720+0000 7f66b7c22640 1 -- 172.21.15.7:0/249520954 wait complete. 2024-04-25T10:00:15.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.721+0000 7f66b7c22640 1 Processor -- start 2024-04-25T10:00:15.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.721+0000 7f66b7c22640 1 -- start start 2024-04-25T10:00:15.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.722+0000 7f66b7c22640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f669c0051c0 0x7f66b0158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:15.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.722+0000 7f66b7c22640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66b0156a00 0x7f66b00c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:15.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.722+0000 7f66b7c22640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66b00c87a0 0x7f66b0154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:15.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.722+0000 7f66b7c22640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b01617c0 con 0x7f66b0156a00 2024-04-25T10:00:15.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.722+0000 7f66b7c22640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b0161640 con 0x7f66b00c87a0 2024-04-25T10:00:15.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.722+0000 7f66b7c22640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b015e2c0 con 0x7f669c0051c0 2024-04-25T10:00:15.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.722+0000 7f66b51bd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66b0156a00 0x7f66b00c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:15.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.722+0000 7f66b51bd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66b0156a00 0x7f66b00c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42932/0 (socket says 172.21.15.7:42932) 2024-04-25T10:00:15.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.722+0000 7f66b51bd640 1 -- 172.21.15.7:0/1027762796 learned_addr learned my addr 172.21.15.7:0/1027762796 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:15.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.722+0000 7f66b59be640 1 --2- 172.21.15.7:0/1027762796 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f669c0051c0 0x7f66b0158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:15.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.722+0000 7f66b61bf640 1 --2- 172.21.15.7:0/1027762796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66b00c87a0 0x7f66b0154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.722+0000 7f66b51bd640 1 -- 172.21.15.7:0/1027762796 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f669c0051c0 msgr2=0x7f66b0158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.722+0000 7f66b51bd640 1 --2- 172.21.15.7:0/1027762796 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f669c0051c0 0x7f66b0158d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.722+0000 7f66b51bd640 1 -- 172.21.15.7:0/1027762796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66b00c87a0 msgr2=0x7f66b0154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.722+0000 7f66b51bd640 1 --2- 172.21.15.7:0/1027762796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66b00c87a0 0x7f66b0154890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.722+0000 7f66b51bd640 1 -- 172.21.15.7:0/1027762796 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b0157250 con 0x7f66b0156a00 2024-04-25T10:00:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.723+0000 7f66b51bd640 1 --2- 172.21.15.7:0/1027762796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66b0156a00 0x7f66b00c8260 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f66a000f620 tx=0x7f66a000fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.723+0000 7f66a67fc640 1 -- 172.21.15.7:0/1027762796 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a00052e0 con 0x7f66b0156a00 2024-04-25T10:00:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.723+0000 7f66a67fc640 1 -- 172.21.15.7:0/1027762796 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a0018070 con 0x7f66b0156a00 2024-04-25T10:00:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.723+0000 7f66b7c22640 1 -- 172.21.15.7:0/1027762796 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66b00c74a0 con 0x7f66b0156a00 2024-04-25T10:00:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.723+0000 7f66a67fc640 1 -- 172.21.15.7:0/1027762796 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a0003810 con 0x7f66b0156a00 2024-04-25T10:00:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.723+0000 7f66b7c22640 1 -- 172.21.15.7:0/1027762796 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66b00c7a60 con 0x7f66b0156a00 2024-04-25T10:00:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.724+0000 7f66b7c22640 1 -- 172.21.15.7:0/1027762796 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66b0068fd0 con 0x7f66b0156a00 2024-04-25T10:00:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.724+0000 7f66a67fc640 1 -- 172.21.15.7:0/1027762796 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f66a00039b0 con 0x7f66b0156a00 2024-04-25T10:00:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.725+0000 7f66a67fc640 1 --2- 172.21.15.7:0/1027762796 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f669406b4d0 0x7f669406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.725+0000 7f66a67fc640 1 -- 172.21.15.7:0/1027762796 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f66a008a1a0 con 0x7f66b0156a00 2024-04-25T10:00:15.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.725+0000 7f66b59be640 1 --2- 172.21.15.7:0/1027762796 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f669406b4d0 0x7f669406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:15.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.725+0000 7f66b59be640 1 --2- 172.21.15.7:0/1027762796 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f669406b4d0 0x7f669406d990 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f66ac001050 tx=0x7f66ac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:15.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.729+0000 7f66a67fc640 1 -- 172.21.15.7:0/1027762796 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f66a0058e30 con 0x7f66b0156a00 2024-04-25T10:00:15.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.911+0000 7f66b7c22640 1 -- 172.21.15.7:0/1027762796 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66b00d1610 con 0x7f66b0156a00 2024-04-25T10:00:15.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.912+0000 7f66a67fc640 1 -- 172.21.15.7:0/1027762796 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16978 (secure 0 0 0) 0x7f66a0058730 con 0x7f66b0156a00 2024-04-25T10:00:15.916 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:00:15.916 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":76,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:58:59.374212+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:58:43.929184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T09:58:44.609970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6834/1012943595":"2024-04-26T09:58:59.374192+0000","172.21.15.55:6832/1012943595":"2024-04-26T09:58:59.374192+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:00:15.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.914+0000 7f66b7c22640 1 -- 172.21.15.7:0/1027762796 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f669406b4d0 msgr2=0x7f669406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:15.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.914+0000 7f66b7c22640 1 --2- 172.21.15.7:0/1027762796 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f669406b4d0 0x7f669406d990 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f66ac001050 tx=0x7f66ac009040 comp rx=0 tx=0).stop 2024-04-25T10:00:15.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.914+0000 7f66b7c22640 1 -- 172.21.15.7:0/1027762796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66b0156a00 msgr2=0x7f66b00c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:15.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.914+0000 7f66b7c22640 1 --2- 172.21.15.7:0/1027762796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66b0156a00 0x7f66b00c8260 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f66a000f620 tx=0x7f66a000fae0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.914+0000 7f66b7c22640 1 -- 172.21.15.7:0/1027762796 shutdown_connections 2024-04-25T10:00:15.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.914+0000 7f66b7c22640 1 --2- 172.21.15.7:0/1027762796 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f669406b4d0 0x7f669406d990 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.914+0000 7f66b7c22640 1 --2- 172.21.15.7:0/1027762796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66b00c87a0 0x7f66b0154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.914+0000 7f66b7c22640 1 --2- 172.21.15.7:0/1027762796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66b0156a00 0x7f66b00c8260 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.914+0000 7f66b7c22640 1 --2- 172.21.15.7:0/1027762796 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f669c0051c0 0x7f66b0158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:15.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.914+0000 7f66b7c22640 1 -- 172.21.15.7:0/1027762796 >> 172.21.15.7:0/1027762796 conn(0x7f66b0072290 msgr2=0x7f66b015ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:15.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.914+0000 7f66b7c22640 1 -- 172.21.15.7:0/1027762796 shutdown_connections 2024-04-25T10:00:15.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:15.914+0000 7f66b7c22640 1 -- 172.21.15.7:0/1027762796 wait complete. 2024-04-25T10:00:15.929 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T10:00:15.929 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:00:16.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.025+0000 7fd341b30640 1 Processor -- start 2024-04-25T10:00:16.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.025+0000 7fd341b30640 1 -- start start 2024-04-25T10:00:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.026+0000 7fd341b30640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd33c0b53b0 0x7fd33c0d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.026+0000 7fd341b30640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd33c0d1e80 con 0x7fd33c15db00 2024-04-25T10:00:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.026+0000 7fd341b30640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd33c0b5930 con 0x7fd33c0d0a50 2024-04-25T10:00:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.026+0000 7fd341b30640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd33c0b5c10 con 0x7fd33c0b53b0 2024-04-25T10:00:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.026+0000 7fd33b7fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd33c15db00 0x7fd33c0d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60330/0 (socket says 172.21.15.7:60330) 2024-04-25T10:00:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.026+0000 7fd33b7fe640 1 -- 172.21.15.7:0/748268436 learned_addr learned my addr 172.21.15.7:0/748268436 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.026+0000 7fd33bfff640 1 --2- 172.21.15.7:0/748268436 >> v2:172.21.15.55:3300/0 conn(0x7fd33c0b53b0 0x7fd33c0d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.027+0000 7fd33a7fc640 1 -- 172.21.15.7:0/748268436 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 631557893 0 0) 0x7fd33c0d1e80 con 0x7fd33c15db00 2024-04-25T10:00:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.027+0000 7fd33a7fc640 1 -- 172.21.15.7:0/748268436 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd324003520 con 0x7fd33c15db00 2024-04-25T10:00:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.027+0000 7fd33a7fc640 1 -- 172.21.15.7:0/748268436 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3305449859 0 0) 0x7fd33c0b5930 con 0x7fd33c0d0a50 2024-04-25T10:00:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.027+0000 7fd33a7fc640 1 -- 172.21.15.7:0/748268436 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd33c0d1e80 con 0x7fd33c0d0a50 2024-04-25T10:00:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.027+0000 7fd33a7fc640 1 -- 172.21.15.7:0/748268436 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1061644760 0 0) 0x7fd324003520 con 0x7fd33c15db00 2024-04-25T10:00:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.027+0000 7fd33a7fc640 1 -- 172.21.15.7:0/748268436 >> v2:172.21.15.55:3300/0 conn(0x7fd33c0b53b0 msgr2=0x7fd33c0d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.027+0000 7fd33a7fc640 1 --2- 172.21.15.7:0/748268436 >> v2:172.21.15.55:3300/0 conn(0x7fd33c0b53b0 0x7fd33c0d2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.027+0000 7fd33a7fc640 1 -- 172.21.15.7:0/748268436 >> v1:172.21.15.55:6789/0 conn(0x7fd33c0d0a50 legacy=0x7fd33c0d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.027+0000 7fd33a7fc640 1 -- 172.21.15.7:0/748268436 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c0b5ef0 con 0x7fd33c15db00 2024-04-25T10:00:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.027+0000 7fd33a7fc640 1 -- 172.21.15.7:0/748268436 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fd32c001670 con 0x7fd33c15db00 2024-04-25T10:00:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.027+0000 7fd33a7fc640 1 -- 172.21.15.7:0/748268436 >> v1:172.21.15.7:6789/0 conn(0x7fd33c15db00 legacy=0x7fd33c0d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.027+0000 7fd33a7fc640 1 --2- 172.21.15.7:0/748268436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd324003b90 0x7fd324003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.027+0000 7fd33a7fc640 1 --2- 172.21.15.7:0/748268436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd324004800 0x7fd324004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.027+0000 7fd33a7fc640 1 --2- 172.21.15.7:0/748268436 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd3240051c0 0x7fd32400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.027+0000 7fd33a7fc640 1 -- 172.21.15.7:0/748268436 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c0b5c10 con 0x7fd324003b90 2024-04-25T10:00:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.027+0000 7fd33a7fc640 1 -- 172.21.15.7:0/748268436 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32400c090 con 0x7fd324004800 2024-04-25T10:00:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.027+0000 7fd33a7fc640 1 -- 172.21.15.7:0/748268436 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32400c290 con 0x7fd3240051c0 2024-04-25T10:00:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.027+0000 7fd33b7fe640 1 --2- 172.21.15.7:0/748268436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd324003b90 0x7fd324003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.027+0000 7fd33affd640 1 --2- 172.21.15.7:0/748268436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd324004800 0x7fd324004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.027+0000 7fd33bfff640 1 --2- 172.21.15.7:0/748268436 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd3240051c0 0x7fd32400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.027+0000 7fd33b7fe640 1 -- 172.21.15.7:0/748268436 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd3240051c0 msgr2=0x7fd32400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.027+0000 7fd33b7fe640 1 --2- 172.21.15.7:0/748268436 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd3240051c0 0x7fd32400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.027+0000 7fd33b7fe640 1 -- 172.21.15.7:0/748268436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd324004800 msgr2=0x7fd324004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.027+0000 7fd33b7fe640 1 --2- 172.21.15.7:0/748268436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd324004800 0x7fd324004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.027+0000 7fd33b7fe640 1 -- 172.21.15.7:0/748268436 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd324003520 con 0x7fd324003b90 2024-04-25T10:00:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.027+0000 7fd33bfff640 1 --2- 172.21.15.7:0/748268436 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd3240051c0 0x7fd32400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.027+0000 7fd33bfff640 1 -- 172.21.15.7:0/748268436 reap_dead start 2024-04-25T10:00:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.028+0000 7fd33b7fe640 1 --2- 172.21.15.7:0/748268436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd324003b90 0x7fd324003f90 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fd32c00c0e0 tx=0x7fd324005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc3d7d39210af20 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.028+0000 7fd33a7fc640 1 -- 172.21.15.7:0/748268436 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c007c40 con 0x7fd324003b90 2024-04-25T10:00:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.028+0000 7fd33a7fc640 1 -- 172.21.15.7:0/748268436 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32c005ad0 con 0x7fd324003b90 2024-04-25T10:00:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.028+0000 7fd33a7fc640 1 -- 172.21.15.7:0/748268436 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c007070 con 0x7fd324003b90 2024-04-25T10:00:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.029+0000 7fd341b30640 1 -- 172.21.15.7:0/748268436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd324003b90 msgr2=0x7fd324003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.029+0000 7fd341b30640 1 --2- 172.21.15.7:0/748268436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd324003b90 0x7fd324003f90 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fd32c00c0e0 tx=0x7fd324005830 comp rx=0 tx=0).stop 2024-04-25T10:00:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.029+0000 7fd341b30640 1 -- 172.21.15.7:0/748268436 shutdown_connections 2024-04-25T10:00:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.029+0000 7fd341b30640 1 --2- 172.21.15.7:0/748268436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd324003b90 0x7fd324003f90 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.029+0000 7fd341b30640 1 -- 172.21.15.7:0/748268436 >> 172.21.15.7:0/748268436 conn(0x7fd33c072290 msgr2=0x7fd33c0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.029+0000 7fd341b30640 1 -- 172.21.15.7:0/748268436 shutdown_connections 2024-04-25T10:00:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.029+0000 7fd341b30640 1 -- 172.21.15.7:0/748268436 wait complete. 2024-04-25T10:00:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.030+0000 7fd341b30640 1 Processor -- start 2024-04-25T10:00:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.030+0000 7fd341b30640 1 -- start start 2024-04-25T10:00:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.031+0000 7fd341b30640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd324003b90 0x7fd33c1f72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.031+0000 7fd341b30640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd33c0c74c0 0x7fd33c160100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.031+0000 7fd341b30640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd33c0b6f40 0x7fd33c160640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.031+0000 7fd341b30640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c0d3660 con 0x7fd33c0c74c0 2024-04-25T10:00:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.031+0000 7fd341b30640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c0b61d0 con 0x7fd33c0b6f40 2024-04-25T10:00:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.031+0000 7fd341b30640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c0ce2b0 con 0x7fd324003b90 2024-04-25T10:00:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.031+0000 7fd33affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd33c0c74c0 0x7fd33c160100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.031+0000 7fd33affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd33c0c74c0 0x7fd33c160100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42958/0 (socket says 172.21.15.7:42958) 2024-04-25T10:00:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.031+0000 7fd33affd640 1 -- 172.21.15.7:0/3922611593 learned_addr learned my addr 172.21.15.7:0/3922611593 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:16.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.031+0000 7fd33bfff640 1 --2- 172.21.15.7:0/3922611593 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd33c0b6f40 0x7fd33c160640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:16.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.031+0000 7fd33b7fe640 1 --2- 172.21.15.7:0/3922611593 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd324003b90 0x7fd33c1f72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:16.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.031+0000 7fd33affd640 1 -- 172.21.15.7:0/3922611593 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd324003b90 msgr2=0x7fd33c1f72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:16.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.031+0000 7fd33affd640 1 --2- 172.21.15.7:0/3922611593 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd324003b90 0x7fd33c1f72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:16.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.031+0000 7fd33affd640 1 -- 172.21.15.7:0/3922611593 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd33c0b6f40 msgr2=0x7fd33c160640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:16.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.031+0000 7fd33affd640 1 --2- 172.21.15.7:0/3922611593 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd33c0b6f40 0x7fd33c160640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:16.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.031+0000 7fd33affd640 1 -- 172.21.15.7:0/3922611593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c1515e0 con 0x7fd33c0c74c0 2024-04-25T10:00:16.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.031+0000 7fd33bfff640 1 --2- 172.21.15.7:0/3922611593 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd33c0b6f40 0x7fd33c160640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:00:16.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.032+0000 7fd33affd640 1 --2- 172.21.15.7:0/3922611593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd33c0c74c0 0x7fd33c160100 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fd33000f820 tx=0x7fd33000fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:16.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.032+0000 7fd323fff640 1 -- 172.21.15.7:0/3922611593 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33001a070 con 0x7fd33c0c74c0 2024-04-25T10:00:16.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.032+0000 7fd323fff640 1 -- 172.21.15.7:0/3922611593 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd330005110 con 0x7fd33c0c74c0 2024-04-25T10:00:16.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.032+0000 7fd341b30640 1 -- 172.21.15.7:0/3922611593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd33c0cab30 con 0x7fd33c0c74c0 2024-04-25T10:00:16.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.032+0000 7fd323fff640 1 -- 172.21.15.7:0/3922611593 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd330007050 con 0x7fd33c0c74c0 2024-04-25T10:00:16.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.032+0000 7fd341b30640 1 -- 172.21.15.7:0/3922611593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd33c0cb0f0 con 0x7fd33c0c74c0 2024-04-25T10:00:16.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.033+0000 7fd341b30640 1 -- 172.21.15.7:0/3922611593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd33c0c6f40 con 0x7fd33c0c74c0 2024-04-25T10:00:16.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.033+0000 7fd323fff640 1 -- 172.21.15.7:0/3922611593 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd3300071f0 con 0x7fd33c0c74c0 2024-04-25T10:00:16.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.034+0000 7fd323fff640 1 --2- 172.21.15.7:0/3922611593 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd32806b4d0 0x7fd32806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.034+0000 7fd323fff640 1 -- 172.21.15.7:0/3922611593 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fd330089b60 con 0x7fd33c0c74c0 2024-04-25T10:00:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.034+0000 7fd33b7fe640 1 --2- 172.21.15.7:0/3922611593 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd32806b4d0 0x7fd32806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.034+0000 7fd33b7fe640 1 --2- 172.21.15.7:0/3922611593 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd32806b4d0 0x7fd32806d990 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd32c032000 tx=0x7fd32c02d000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.038+0000 7fd323fff640 1 -- 172.21.15.7:0/3922611593 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd33c0c6f40 con 0x7fd33c0c74c0 2024-04-25T10:00:16.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.256+0000 7fd341b30640 1 -- 172.21.15.7:0/3922611593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd33c0cb2f0 con 0x7fd33c0c74c0 2024-04-25T10:00:16.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.256+0000 7fd323fff640 1 -- 172.21.15.7:0/3922611593 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4936 (secure 0 0 0) 0x7fd33c0cb2f0 con 0x7fd33c0c74c0 2024-04-25T10:00:16.261 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:00:16.261 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":45,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1781470369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1781470369},{"type":"v1","addr":"172.21.15.55:6835","nonce":1781470369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6442,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1406578404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1406578404},{"type":"v1","addr":"172.21.15.55:6834","nonce":1406578404}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6810,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1839614891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1839614891},{"type":"v1","addr":"172.21.15.7:6835","nonce":1839614891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:58:45.628406+0000","modified":"2024-04-25T09:59:42.407854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6813},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6813":{"gid":6813,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":18,"addr":"172.21.15.7:6837/3690076929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3690076929},{"type":"v1","addr":"172.21.15.7:6837","nonce":3690076929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T10:00:16.261 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 45 2024-04-25T10:00:16.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.258+0000 7fd341b30640 1 -- 172.21.15.7:0/3922611593 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd32806b4d0 msgr2=0x7fd32806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:16.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.258+0000 7fd341b30640 1 --2- 172.21.15.7:0/3922611593 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd32806b4d0 0x7fd32806d990 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd32c032000 tx=0x7fd32c02d000 comp rx=0 tx=0).stop 2024-04-25T10:00:16.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.258+0000 7fd341b30640 1 -- 172.21.15.7:0/3922611593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd33c0c74c0 msgr2=0x7fd33c160100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:16.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.258+0000 7fd341b30640 1 --2- 172.21.15.7:0/3922611593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd33c0c74c0 0x7fd33c160100 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fd33000f820 tx=0x7fd33000fce0 comp rx=0 tx=0).stop 2024-04-25T10:00:16.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.258+0000 7fd341b30640 1 -- 172.21.15.7:0/3922611593 shutdown_connections 2024-04-25T10:00:16.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.258+0000 7fd341b30640 1 --2- 172.21.15.7:0/3922611593 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd32806b4d0 0x7fd32806d990 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:16.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.258+0000 7fd341b30640 1 --2- 172.21.15.7:0/3922611593 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd33c0b6f40 0x7fd33c160640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:16.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.258+0000 7fd341b30640 1 --2- 172.21.15.7:0/3922611593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd33c0c74c0 0x7fd33c160100 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:16.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.258+0000 7fd341b30640 1 --2- 172.21.15.7:0/3922611593 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd324003b90 0x7fd33c1f72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:16.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.258+0000 7fd341b30640 1 -- 172.21.15.7:0/3922611593 >> 172.21.15.7:0/3922611593 conn(0x7fd33c072290 msgr2=0x7fd33c15c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:16.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.258+0000 7fd341b30640 1 -- 172.21.15.7:0/3922611593 shutdown_connections 2024-04-25T10:00:16.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.258+0000 7fd341b30640 1 -- 172.21.15.7:0/3922611593 wait complete. 2024-04-25T10:00:16.274 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:00:16.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.370+0000 7f84a2116640 1 Processor -- start 2024-04-25T10:00:16.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.370+0000 7f84a2116640 1 -- start start 2024-04-25T10:00:16.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.371+0000 7f84a2116640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f849c15dc10 0x7f849c1615f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:16.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.371+0000 7f84a2116640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f849c161b30 0x7f849c0d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:16.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.371+0000 7f84a2116640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f849c162040 con 0x7f849c0b6b90 2024-04-25T10:00:16.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.371+0000 7f84a2116640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f849c0d1d90 con 0x7f849c161b30 2024-04-25T10:00:16.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.371+0000 7f84a2116640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f849c162320 con 0x7f849c15dc10 2024-04-25T10:00:16.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.371+0000 7f849affd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f849c161b30 0x7f849c0d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:16.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.371+0000 7f849affd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f849c161b30 0x7f849c0d0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42966/0 (socket says 172.21.15.7:42966) 2024-04-25T10:00:16.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.371+0000 7f849affd640 1 -- 172.21.15.7:0/676455554 learned_addr learned my addr 172.21.15.7:0/676455554 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:16.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.371+0000 7f849b7fe640 1 --2- 172.21.15.7:0/676455554 >> v2:172.21.15.55:3300/0 conn(0x7f849c15dc10 0x7f849c1615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:16.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.371+0000 7f849affd640 1 -- 172.21.15.7:0/676455554 >> v2:172.21.15.55:3300/0 conn(0x7f849c15dc10 msgr2=0x7f849c1615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:16.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.371+0000 7f849affd640 1 --2- 172.21.15.7:0/676455554 >> v2:172.21.15.55:3300/0 conn(0x7f849c15dc10 0x7f849c1615f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:16.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.371+0000 7f849affd640 1 -- 172.21.15.7:0/676455554 >> v1:172.21.15.7:6789/0 conn(0x7f849c0b6b90 legacy=0x7f849c0b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:16.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.371+0000 7f849a7fc640 1 -- 172.21.15.7:0/676455554 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349374721 0 0) 0x7f849c162040 con 0x7f849c0b6b90 2024-04-25T10:00:16.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.371+0000 7f849affd640 1 -- 172.21.15.7:0/676455554 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849c0d1fe0 con 0x7f849c161b30 2024-04-25T10:00:16.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.371+0000 7f849b7fe640 1 --2- 172.21.15.7:0/676455554 >> v2:172.21.15.55:3300/0 conn(0x7f849c15dc10 0x7f849c1615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:00:16.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.372+0000 7f849affd640 1 --2- 172.21.15.7:0/676455554 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f849c161b30 0x7f849c0d0240 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f849c0b9370 tx=0x7f849002a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=622866fa8c61a0d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:16.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.372+0000 7f849a7fc640 1 -- 172.21.15.7:0/676455554 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8490037070 con 0x7f849c161b30 2024-04-25T10:00:16.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.372+0000 7f849a7fc640 1 -- 172.21.15.7:0/676455554 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8490032440 con 0x7f849c161b30 2024-04-25T10:00:16.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.372+0000 7f849a7fc640 1 -- 172.21.15.7:0/676455554 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8490032810 con 0x7f849c161b30 2024-04-25T10:00:16.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.373+0000 7f84a2116640 1 -- 172.21.15.7:0/676455554 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f849c161b30 msgr2=0x7f849c0d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:16.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.373+0000 7f84a2116640 1 --2- 172.21.15.7:0/676455554 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f849c161b30 0x7f849c0d0240 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f849c0b9370 tx=0x7f849002a150 comp rx=0 tx=0).stop 2024-04-25T10:00:16.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.373+0000 7f84a2116640 1 -- 172.21.15.7:0/676455554 shutdown_connections 2024-04-25T10:00:16.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.373+0000 7f84a2116640 1 --2- 172.21.15.7:0/676455554 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f849c161b30 0x7f849c0d0240 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:16.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.373+0000 7f84a2116640 1 --2- 172.21.15.7:0/676455554 >> v2:172.21.15.55:3300/0 conn(0x7f849c15dc10 0x7f849c1615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:16.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.373+0000 7f84a2116640 1 -- 172.21.15.7:0/676455554 >> 172.21.15.7:0/676455554 conn(0x7f849c072290 msgr2=0x7f849c0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:16.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.373+0000 7f84a2116640 1 -- 172.21.15.7:0/676455554 shutdown_connections 2024-04-25T10:00:16.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.373+0000 7f84a2116640 1 -- 172.21.15.7:0/676455554 wait complete. 2024-04-25T10:00:16.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.374+0000 7f84a2116640 1 Processor -- start 2024-04-25T10:00:16.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.374+0000 7f84a2116640 1 -- start start 2024-04-25T10:00:16.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.375+0000 7f84a2116640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f849c0b6b90 0x7f849c14da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:16.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.375+0000 7f84a2116640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f849c15dc10 0x7f849c0cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:16.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.375+0000 7f84a2116640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f849c161b30 0x7f849c0b4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:16.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.375+0000 7f84a2116640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849c0d0900 con 0x7f849c0b6b90 2024-04-25T10:00:16.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.375+0000 7f84a2116640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849c0d0780 con 0x7f849c15dc10 2024-04-25T10:00:16.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.375+0000 7f84a2116640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849c0d0a80 con 0x7f849c161b30 2024-04-25T10:00:16.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.375+0000 7f849b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f849c0b6b90 0x7f849c14da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:16.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.375+0000 7f849b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f849c0b6b90 0x7f849c14da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42978/0 (socket says 172.21.15.7:42978) 2024-04-25T10:00:16.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.375+0000 7f849b7fe640 1 -- 172.21.15.7:0/17009166 learned_addr learned my addr 172.21.15.7:0/17009166 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:16.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.375+0000 7f849affd640 1 --2- 172.21.15.7:0/17009166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f849c15dc10 0x7f849c0cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:16.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.375+0000 7f849bfff640 1 --2- 172.21.15.7:0/17009166 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f849c161b30 0x7f849c0b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:16.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.375+0000 7f849b7fe640 1 -- 172.21.15.7:0/17009166 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f849c161b30 msgr2=0x7f849c0b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:16.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.375+0000 7f849b7fe640 1 --2- 172.21.15.7:0/17009166 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f849c161b30 0x7f849c0b4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:16.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.375+0000 7f849b7fe640 1 -- 172.21.15.7:0/17009166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f849c15dc10 msgr2=0x7f849c0cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:16.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.375+0000 7f849b7fe640 1 --2- 172.21.15.7:0/17009166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f849c15dc10 0x7f849c0cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:16.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.375+0000 7f849b7fe640 1 -- 172.21.15.7:0/17009166 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849c0b38d0 con 0x7f849c0b6b90 2024-04-25T10:00:16.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.375+0000 7f849b7fe640 1 --2- 172.21.15.7:0/17009166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f849c0b6b90 0x7f849c14da30 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f848c00c7f0 tx=0x7f848c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:16.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.375+0000 7f8483fff640 1 -- 172.21.15.7:0/17009166 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c015070 con 0x7f849c0b6b90 2024-04-25T10:00:16.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.375+0000 7f8483fff640 1 -- 172.21.15.7:0/17009166 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848c007820 con 0x7f849c0b6b90 2024-04-25T10:00:16.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.375+0000 7f84a2116640 1 -- 172.21.15.7:0/17009166 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f849c0b3bb0 con 0x7f849c0b6b90 2024-04-25T10:00:16.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.375+0000 7f8483fff640 1 -- 172.21.15.7:0/17009166 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c007bd0 con 0x7f849c0b6b90 2024-04-25T10:00:16.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.376+0000 7f84a2116640 1 -- 172.21.15.7:0/17009166 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f849c0b4170 con 0x7f849c0b6b90 2024-04-25T10:00:16.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.377+0000 7f84a2116640 1 -- 172.21.15.7:0/17009166 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f849c068fd0 con 0x7f849c0b6b90 2024-04-25T10:00:16.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.377+0000 7f8483fff640 1 -- 172.21.15.7:0/17009166 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f848c018070 con 0x7f849c0b6b90 2024-04-25T10:00:16.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.377+0000 7f8483fff640 1 --2- 172.21.15.7:0/17009166 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f848806b4d0 0x7f848806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:16.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.378+0000 7f849affd640 1 --2- 172.21.15.7:0/17009166 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f848806b4d0 0x7f848806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:16.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.378+0000 7f8483fff640 1 -- 172.21.15.7:0/17009166 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f848c08a510 con 0x7f849c0b6b90 2024-04-25T10:00:16.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.378+0000 7f849affd640 1 --2- 172.21.15.7:0/17009166 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f848806b4d0 0x7f848806d990 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8490034000 tx=0x7f849002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:16.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.382+0000 7f8483fff640 1 -- 172.21.15.7:0/17009166 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f848c0591b0 con 0x7f849c0b6b90 2024-04-25T10:00:16.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.599+0000 7f84a2116640 1 -- 172.21.15.7:0/17009166 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f849c0d1660 con 0x7f849c0b6b90 2024-04-25T10:00:16.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.600+0000 7f8483fff640 1 -- 172.21.15.7:0/17009166 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4936 (secure 0 0 0) 0x7f848c058ab0 con 0x7f849c0b6b90 2024-04-25T10:00:16.604 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:00:16.605 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":45,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1781470369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1781470369},{"type":"v1","addr":"172.21.15.55:6835","nonce":1781470369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6442,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1406578404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1406578404},{"type":"v1","addr":"172.21.15.55:6834","nonce":1406578404}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6810,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1839614891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1839614891},{"type":"v1","addr":"172.21.15.7:6835","nonce":1839614891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:58:45.628406+0000","modified":"2024-04-25T09:59:42.407854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6813},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6813":{"gid":6813,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":18,"addr":"172.21.15.7:6837/3690076929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3690076929},{"type":"v1","addr":"172.21.15.7:6837","nonce":3690076929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T10:00:16.605 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 45 2024-04-25T10:00:16.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.602+0000 7f84a2116640 1 -- 172.21.15.7:0/17009166 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f848806b4d0 msgr2=0x7f848806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:16.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.602+0000 7f84a2116640 1 --2- 172.21.15.7:0/17009166 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f848806b4d0 0x7f848806d990 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8490034000 tx=0x7f849002e000 comp rx=0 tx=0).stop 2024-04-25T10:00:16.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.602+0000 7f84a2116640 1 -- 172.21.15.7:0/17009166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f849c0b6b90 msgr2=0x7f849c14da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:16.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.602+0000 7f84a2116640 1 --2- 172.21.15.7:0/17009166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f849c0b6b90 0x7f849c14da30 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f848c00c7f0 tx=0x7f848c00ccb0 comp rx=0 tx=0).stop 2024-04-25T10:00:16.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.602+0000 7f84a2116640 1 -- 172.21.15.7:0/17009166 shutdown_connections 2024-04-25T10:00:16.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.602+0000 7f84a2116640 1 --2- 172.21.15.7:0/17009166 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f848806b4d0 0x7f848806d990 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:16.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.602+0000 7f84a2116640 1 --2- 172.21.15.7:0/17009166 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f849c161b30 0x7f849c0b4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:16.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.602+0000 7f84a2116640 1 --2- 172.21.15.7:0/17009166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f849c15dc10 0x7f849c0cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:16.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.602+0000 7f84a2116640 1 --2- 172.21.15.7:0/17009166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f849c0b6b90 0x7f849c14da30 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:16.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.602+0000 7f84a2116640 1 -- 172.21.15.7:0/17009166 >> 172.21.15.7:0/17009166 conn(0x7f849c072290 msgr2=0x7f849c0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:16.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.602+0000 7f84a2116640 1 -- 172.21.15.7:0/17009166 shutdown_connections 2024-04-25T10:00:16.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.602+0000 7f84a2116640 1 -- 172.21.15.7:0/17009166 wait complete. 2024-04-25T10:00:16.617 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:00:16.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.714+0000 7f56ffa9a640 1 Processor -- start 2024-04-25T10:00:16.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.714+0000 7f56ffa9a640 1 -- start start 2024-04-25T10:00:16.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.715+0000 7f56ffa9a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f56f80d0a50 0x7f56f80d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:16.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.715+0000 7f56ffa9a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56f80d1e80 con 0x7f56f815db00 2024-04-25T10:00:16.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.715+0000 7f56ffa9a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56f80b5930 con 0x7f56f80b53b0 2024-04-25T10:00:16.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.715+0000 7f56ffa9a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56f80b5c10 con 0x7f56f80d0a50 2024-04-25T10:00:16.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.715+0000 7f56fd836640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f56f815db00 0x7f56f80d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60342/0 (socket says 172.21.15.7:60342) 2024-04-25T10:00:16.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.715+0000 7f56fd836640 1 -- 172.21.15.7:0/638256835 learned_addr learned my addr 172.21.15.7:0/638256835 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:16.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.715+0000 7f56fc834640 1 -- 172.21.15.7:0/638256835 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3043652659 0 0) 0x7f56f80d1e80 con 0x7f56f815db00 2024-04-25T10:00:16.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.715+0000 7f56fc834640 1 -- 172.21.15.7:0/638256835 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56e4003520 con 0x7f56f815db00 2024-04-25T10:00:16.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.715+0000 7f56fd035640 1 --2- 172.21.15.7:0/638256835 >> v2:172.21.15.55:3300/0 conn(0x7f56f80d0a50 0x7f56f80d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:16.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.715+0000 7f56fc834640 1 -- 172.21.15.7:0/638256835 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 463153123 0 0) 0x7f56e4003520 con 0x7f56f815db00 2024-04-25T10:00:16.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.715+0000 7f56fc834640 1 -- 172.21.15.7:0/638256835 >> v2:172.21.15.55:3300/0 conn(0x7f56f80d0a50 msgr2=0x7f56f80d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:16.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.715+0000 7f56fc834640 1 --2- 172.21.15.7:0/638256835 >> v2:172.21.15.55:3300/0 conn(0x7f56f80d0a50 0x7f56f80d2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:16.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.715+0000 7f56fc834640 1 -- 172.21.15.7:0/638256835 >> v1:172.21.15.55:6789/0 conn(0x7f56f80b53b0 legacy=0x7f56f80d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:16.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.715+0000 7f56fc834640 1 -- 172.21.15.7:0/638256835 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f80b5ef0 con 0x7f56f815db00 2024-04-25T10:00:16.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.715+0000 7f56fc834640 1 -- 172.21.15.7:0/638256835 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f56f4001670 con 0x7f56f815db00 2024-04-25T10:00:16.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.716+0000 7f56fc834640 1 -- 172.21.15.7:0/638256835 >> v1:172.21.15.7:6789/0 conn(0x7f56f815db00 legacy=0x7f56f80d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:16.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.716+0000 7f56fc834640 1 --2- 172.21.15.7:0/638256835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56e40039b0 0x7f56e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:16.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.716+0000 7f56fc834640 1 --2- 172.21.15.7:0/638256835 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f56e4004800 0x7f56e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:16.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.716+0000 7f56fc834640 1 --2- 172.21.15.7:0/638256835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56e40051c0 0x7f56e400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:16.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.716+0000 7f56fc834640 1 -- 172.21.15.7:0/638256835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f80b5c10 con 0x7f56e40051c0 2024-04-25T10:00:16.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.716+0000 7f56fc834640 1 -- 172.21.15.7:0/638256835 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e400c060 con 0x7f56e40039b0 2024-04-25T10:00:16.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.716+0000 7f56fc834640 1 -- 172.21.15.7:0/638256835 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e400c260 con 0x7f56e4004800 2024-04-25T10:00:16.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.716+0000 7f56fe037640 1 --2- 172.21.15.7:0/638256835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56e40051c0 0x7f56e400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:16.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.716+0000 7f56fd836640 1 --2- 172.21.15.7:0/638256835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56e40039b0 0x7f56e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:16.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.716+0000 7f56fd035640 1 --2- 172.21.15.7:0/638256835 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f56e4004800 0x7f56e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:16.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.716+0000 7f56fe037640 1 -- 172.21.15.7:0/638256835 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f56e4004800 msgr2=0x7f56e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:16.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.716+0000 7f56fe037640 1 --2- 172.21.15.7:0/638256835 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f56e4004800 0x7f56e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:16.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.716+0000 7f56fe037640 1 -- 172.21.15.7:0/638256835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56e40039b0 msgr2=0x7f56e4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:16.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.716+0000 7f56fe037640 1 --2- 172.21.15.7:0/638256835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56e40039b0 0x7f56e4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:16.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.716+0000 7f56fe037640 1 -- 172.21.15.7:0/638256835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e4003520 con 0x7f56e40051c0 2024-04-25T10:00:16.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.717+0000 7f56fe037640 1 -- 172.21.15.7:0/638256835 reap_dead start 2024-04-25T10:00:16.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.717+0000 7f56fe037640 1 --2- 172.21.15.7:0/638256835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56e40051c0 0x7f56e400b9c0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f56f0001e20 tx=0x7f56e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd11ebec12ebab1e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:16.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.717+0000 7f56fc834640 1 -- 172.21.15.7:0/638256835 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f0001a70 con 0x7f56e40051c0 2024-04-25T10:00:16.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.717+0000 7f56fc834640 1 -- 172.21.15.7:0/638256835 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f002ae40 con 0x7f56e40051c0 2024-04-25T10:00:16.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.717+0000 7f56fc834640 1 -- 172.21.15.7:0/638256835 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f0003bb0 con 0x7f56e40051c0 2024-04-25T10:00:16.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.717+0000 7f56ffa9a640 1 -- 172.21.15.7:0/638256835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56e40051c0 msgr2=0x7f56e400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:16.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.717+0000 7f56ffa9a640 1 --2- 172.21.15.7:0/638256835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56e40051c0 0x7f56e400b9c0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f56f0001e20 tx=0x7f56e4005830 comp rx=0 tx=0).stop 2024-04-25T10:00:16.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.717+0000 7f56ffa9a640 1 -- 172.21.15.7:0/638256835 shutdown_connections 2024-04-25T10:00:16.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.717+0000 7f56ffa9a640 1 --2- 172.21.15.7:0/638256835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56e40051c0 0x7f56e400b9c0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:16.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.717+0000 7f56ffa9a640 1 -- 172.21.15.7:0/638256835 >> 172.21.15.7:0/638256835 conn(0x7f56f8072290 msgr2=0x7f56f80726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:16.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.718+0000 7f56ffa9a640 1 -- 172.21.15.7:0/638256835 shutdown_connections 2024-04-25T10:00:16.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.718+0000 7f56ffa9a640 1 -- 172.21.15.7:0/638256835 wait complete. 2024-04-25T10:00:16.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.719+0000 7f56ffa9a640 1 Processor -- start 2024-04-25T10:00:16.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.719+0000 7f56ffa9a640 1 -- start start 2024-04-25T10:00:16.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.719+0000 7f56ffa9a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56e40051c0 0x7f56f80c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:16.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.719+0000 7f56ffa9a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56f80caa00 0x7f56f814aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:16.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.719+0000 7f56ffa9a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f56f81f3600 0x7f56f81f3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:16.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.719+0000 7f56ffa9a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f80d3660 con 0x7f56e40051c0 2024-04-25T10:00:16.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.719+0000 7f56ffa9a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f80b61d0 con 0x7f56f80caa00 2024-04-25T10:00:16.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.719+0000 7f56ffa9a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f80ce2b0 con 0x7f56f81f3600 2024-04-25T10:00:16.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.720+0000 7f56fd836640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56e40051c0 0x7f56f80c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:16.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.720+0000 7f56fd836640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56e40051c0 0x7f56f80c9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42994/0 (socket says 172.21.15.7:42994) 2024-04-25T10:00:16.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.720+0000 7f56fd836640 1 -- 172.21.15.7:0/3501446263 learned_addr learned my addr 172.21.15.7:0/3501446263 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:16.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.720+0000 7f56fe037640 1 --2- 172.21.15.7:0/3501446263 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f56f81f3600 0x7f56f81f3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:16.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.720+0000 7f56fd035640 1 --2- 172.21.15.7:0/3501446263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56f80caa00 0x7f56f814aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:16.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.720+0000 7f56fd836640 1 -- 172.21.15.7:0/3501446263 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f56f81f3600 msgr2=0x7f56f81f3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:16.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.720+0000 7f56fd836640 1 --2- 172.21.15.7:0/3501446263 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f56f81f3600 0x7f56f81f3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:16.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.720+0000 7f56fd836640 1 -- 172.21.15.7:0/3501446263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56f80caa00 msgr2=0x7f56f814aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:16.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.720+0000 7f56fd836640 1 --2- 172.21.15.7:0/3501446263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56f80caa00 0x7f56f814aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:16.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.720+0000 7f56fd836640 1 -- 172.21.15.7:0/3501446263 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f81f3fc0 con 0x7f56e40051c0 2024-04-25T10:00:16.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.720+0000 7f56fd836640 1 --2- 172.21.15.7:0/3501446263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56e40051c0 0x7f56f80c9e20 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f56f40011e0 tx=0x7f56f4007660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:16.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.720+0000 7f56ee7fc640 1 -- 172.21.15.7:0/3501446263 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f400f960 con 0x7f56e40051c0 2024-04-25T10:00:16.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.720+0000 7f56ee7fc640 1 -- 172.21.15.7:0/3501446263 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f4018070 con 0x7f56e40051c0 2024-04-25T10:00:16.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.720+0000 7f56ffa9a640 1 -- 172.21.15.7:0/3501446263 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f81600f0 con 0x7f56e40051c0 2024-04-25T10:00:16.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.720+0000 7f56ee7fc640 1 -- 172.21.15.7:0/3501446263 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f400fd60 con 0x7f56e40051c0 2024-04-25T10:00:16.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.720+0000 7f56ffa9a640 1 -- 172.21.15.7:0/3501446263 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f81606b0 con 0x7f56e40051c0 2024-04-25T10:00:16.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.721+0000 7f56ffa9a640 1 -- 172.21.15.7:0/3501446263 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56f8068fd0 con 0x7f56e40051c0 2024-04-25T10:00:16.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.722+0000 7f56ee7fc640 1 -- 172.21.15.7:0/3501446263 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f56f401d460 con 0x7f56e40051c0 2024-04-25T10:00:16.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.722+0000 7f56ee7fc640 1 --2- 172.21.15.7:0/3501446263 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f56dc06b4d0 0x7f56dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:16.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.723+0000 7f56fd035640 1 --2- 172.21.15.7:0/3501446263 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f56dc06b4d0 0x7f56dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:16.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.723+0000 7f56ee7fc640 1 -- 172.21.15.7:0/3501446263 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f56f408a2c0 con 0x7f56e40051c0 2024-04-25T10:00:16.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.723+0000 7f56fd035640 1 --2- 172.21.15.7:0/3501446263 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f56dc06b4d0 0x7f56dc06d990 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f56f8153f40 tx=0x7f56e8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:16.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.727+0000 7f56ee7fc640 1 -- 172.21.15.7:0/3501446263 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f56f4058f50 con 0x7f56e40051c0 2024-04-25T10:00:16.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.909+0000 7f56ffa9a640 1 -- 172.21.15.7:0/3501446263 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56f80d16b0 con 0x7f56e40051c0 2024-04-25T10:00:16.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.910+0000 7f56ee7fc640 1 -- 172.21.15.7:0/3501446263 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16978 (secure 0 0 0) 0x7f56f4058850 con 0x7f56e40051c0 2024-04-25T10:00:16.914 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:00:16.915 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":76,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T09:58:59.374212+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:58:43.929184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T09:58:44.609970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6834/1012943595":"2024-04-26T09:58:59.374192+0000","172.21.15.55:6832/1012943595":"2024-04-26T09:58:59.374192+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:00:16.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.912+0000 7f56ffa9a640 1 -- 172.21.15.7:0/3501446263 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f56dc06b4d0 msgr2=0x7f56dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:16.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.912+0000 7f56ffa9a640 1 --2- 172.21.15.7:0/3501446263 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f56dc06b4d0 0x7f56dc06d990 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f56f8153f40 tx=0x7f56e8009190 comp rx=0 tx=0).stop 2024-04-25T10:00:16.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.912+0000 7f56ffa9a640 1 -- 172.21.15.7:0/3501446263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56e40051c0 msgr2=0x7f56f80c9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:16.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.912+0000 7f56ffa9a640 1 --2- 172.21.15.7:0/3501446263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56e40051c0 0x7f56f80c9e20 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f56f40011e0 tx=0x7f56f4007660 comp rx=0 tx=0).stop 2024-04-25T10:00:16.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.912+0000 7f56ffa9a640 1 -- 172.21.15.7:0/3501446263 shutdown_connections 2024-04-25T10:00:16.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.912+0000 7f56ffa9a640 1 --2- 172.21.15.7:0/3501446263 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f56dc06b4d0 0x7f56dc06d990 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:16.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.912+0000 7f56ffa9a640 1 --2- 172.21.15.7:0/3501446263 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f56f81f3600 0x7f56f81f3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:16.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.912+0000 7f56ffa9a640 1 --2- 172.21.15.7:0/3501446263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56f80caa00 0x7f56f814aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:16.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.912+0000 7f56ffa9a640 1 --2- 172.21.15.7:0/3501446263 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56e40051c0 0x7f56f80c9e20 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:16.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.912+0000 7f56ffa9a640 1 -- 172.21.15.7:0/3501446263 >> 172.21.15.7:0/3501446263 conn(0x7f56f8072290 msgr2=0x7f56f815b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:16.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.912+0000 7f56ffa9a640 1 -- 172.21.15.7:0/3501446263 shutdown_connections 2024-04-25T10:00:16.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:16.912+0000 7f56ffa9a640 1 -- 172.21.15.7:0/3501446263 wait complete. 2024-04-25T10:00:16.927 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T10:00:17.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.024+0000 7fd1e38ac640 1 Processor -- start 2024-04-25T10:00:17.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.025+0000 7fd1e38ac640 1 -- start start 2024-04-25T10:00:17.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.025+0000 7fd1e38ac640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd1dc1529e0 0x7fd1dc0c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:17.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.025+0000 7fd1e38ac640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd1dc0cea60 0x7fd1dc06d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:17.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.025+0000 7fd1e38ac640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1dc15bdc0 con 0x7fd1dc0c6410 2024-04-25T10:00:17.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.025+0000 7fd1e38ac640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1dc0b2340 con 0x7fd1dc0cea60 2024-04-25T10:00:17.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.025+0000 7fd1e38ac640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc15c060 con 0x7fd1dc1529e0 2024-04-25T10:00:17.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.025+0000 7fd1e1e49640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd1dc0cea60 0x7fd1dc06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:17.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.026+0000 7fd1e1e49640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd1dc0cea60 0x7fd1dc06d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43008/0 (socket says 172.21.15.7:43008) 2024-04-25T10:00:17.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.026+0000 7fd1e1e49640 1 -- 172.21.15.7:0/52852012 learned_addr learned my addr 172.21.15.7:0/52852012 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:17.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.026+0000 7fd1e1648640 1 --2- 172.21.15.7:0/52852012 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd1dc1529e0 0x7fd1dc0c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:17.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.026+0000 7fd1e1e49640 1 -- 172.21.15.7:0/52852012 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd1dc1529e0 msgr2=0x7fd1dc0c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:17.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.026+0000 7fd1e1e49640 1 --2- 172.21.15.7:0/52852012 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd1dc1529e0 0x7fd1dc0c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:17.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.026+0000 7fd1e1e49640 1 -- 172.21.15.7:0/52852012 >> v1:172.21.15.55:6789/0 conn(0x7fd1dc0c6410 legacy=0x7fd1dc0ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:17.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.026+0000 7fd1e1e49640 1 -- 172.21.15.7:0/52852012 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1dc15c340 con 0x7fd1dc0cea60 2024-04-25T10:00:17.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.027+0000 7fd1e1e49640 1 --2- 172.21.15.7:0/52852012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1dc0cea60 0x7fd1dc06d150 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4009e50 tx=0x7fd1d402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7218f41ac0221e16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:17.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.027+0000 7fd1d3fff640 1 -- 172.21.15.7:0/52852012 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d4036070 con 0x7fd1dc0cea60 2024-04-25T10:00:17.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.027+0000 7fd1d3fff640 1 -- 172.21.15.7:0/52852012 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d4031600 con 0x7fd1dc0cea60 2024-04-25T10:00:17.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.027+0000 7fd1d3fff640 1 -- 172.21.15.7:0/52852012 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d40319d0 con 0x7fd1dc0cea60 2024-04-25T10:00:17.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.027+0000 7fd1e38ac640 1 -- 172.21.15.7:0/52852012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1dc0cea60 msgr2=0x7fd1dc06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:17.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.027+0000 7fd1e38ac640 1 --2- 172.21.15.7:0/52852012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1dc0cea60 0x7fd1dc06d150 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4009e50 tx=0x7fd1d402a710 comp rx=0 tx=0).stop 2024-04-25T10:00:17.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.027+0000 7fd1e38ac640 1 -- 172.21.15.7:0/52852012 shutdown_connections 2024-04-25T10:00:17.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.027+0000 7fd1e38ac640 1 --2- 172.21.15.7:0/52852012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1dc0cea60 0x7fd1dc06d150 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:17.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.027+0000 7fd1e38ac640 1 --2- 172.21.15.7:0/52852012 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd1dc1529e0 0x7fd1dc0c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:17.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.027+0000 7fd1e38ac640 1 -- 172.21.15.7:0/52852012 >> 172.21.15.7:0/52852012 conn(0x7fd1dc071150 msgr2=0x7fd1dc071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:17.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.027+0000 7fd1e38ac640 1 -- 172.21.15.7:0/52852012 shutdown_connections 2024-04-25T10:00:17.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.027+0000 7fd1e38ac640 1 -- 172.21.15.7:0/52852012 wait complete. 2024-04-25T10:00:17.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.028+0000 7fd1e38ac640 1 Processor -- start 2024-04-25T10:00:17.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.029+0000 7fd1e38ac640 1 -- start start 2024-04-25T10:00:17.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.029+0000 7fd1e38ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1dc0c6410 0x7fd1dc0b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:17.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.029+0000 7fd1e38ac640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1dc0cea60 0x7fd1dc0b3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:17.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.029+0000 7fd1e38ac640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd1dc14dd60 0x7fd1dc0b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:17.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.029+0000 7fd1e38ac640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc071ed0 con 0x7fd1dc0cea60 2024-04-25T10:00:17.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.029+0000 7fd1e38ac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc15c900 con 0x7fd1dc0c6410 2024-04-25T10:00:17.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.029+0000 7fd1e38ac640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc072050 con 0x7fd1dc14dd60 2024-04-25T10:00:17.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.029+0000 7fd1e0e47640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1dc0cea60 0x7fd1dc0b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:17.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.029+0000 7fd1e0e47640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1dc0cea60 0x7fd1dc0b3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43012/0 (socket says 172.21.15.7:43012) 2024-04-25T10:00:17.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.029+0000 7fd1e0e47640 1 -- 172.21.15.7:0/3817987889 learned_addr learned my addr 172.21.15.7:0/3817987889 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:17.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.029+0000 7fd1e1648640 1 --2- 172.21.15.7:0/3817987889 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1dc0c6410 0x7fd1dc0b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:17.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.029+0000 7fd1e1e49640 1 --2- 172.21.15.7:0/3817987889 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd1dc14dd60 0x7fd1dc0b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:17.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.030+0000 7fd1e0e47640 1 -- 172.21.15.7:0/3817987889 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd1dc14dd60 msgr2=0x7fd1dc0b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:17.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.030+0000 7fd1e0e47640 1 --2- 172.21.15.7:0/3817987889 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd1dc14dd60 0x7fd1dc0b37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:17.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.030+0000 7fd1e0e47640 1 -- 172.21.15.7:0/3817987889 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1dc0c6410 msgr2=0x7fd1dc0b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:17.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.030+0000 7fd1e0e47640 1 --2- 172.21.15.7:0/3817987889 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1dc0c6410 0x7fd1dc0b2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:17.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.030+0000 7fd1e0e47640 1 -- 172.21.15.7:0/3817987889 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1dc150050 con 0x7fd1dc0cea60 2024-04-25T10:00:17.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.030+0000 7fd1e1648640 1 --2- 172.21.15.7:0/3817987889 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1dc0c6410 0x7fd1dc0b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:17.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.030+0000 7fd1e0e47640 1 --2- 172.21.15.7:0/3817987889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1dc0cea60 0x7fd1dc0b3270 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc00c340 tx=0x7fd1cc00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:17.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.030+0000 7fd1d1ffb640 1 -- 172.21.15.7:0/3817987889 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc017070 con 0x7fd1dc0cea60 2024-04-25T10:00:17.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.030+0000 7fd1d1ffb640 1 -- 172.21.15.7:0/3817987889 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1cc0052d0 con 0x7fd1dc0cea60 2024-04-25T10:00:17.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.030+0000 7fd1e38ac640 1 -- 172.21.15.7:0/3817987889 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1dc14e280 con 0x7fd1dc0cea60 2024-04-25T10:00:17.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.030+0000 7fd1d1ffb640 1 -- 172.21.15.7:0/3817987889 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc003850 con 0x7fd1dc0cea60 2024-04-25T10:00:17.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.030+0000 7fd1e38ac640 1 -- 172.21.15.7:0/3817987889 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1dc1505f0 con 0x7fd1dc0cea60 2024-04-25T10:00:17.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.031+0000 7fd1e38ac640 1 -- 172.21.15.7:0/3817987889 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1dc1507f0 con 0x7fd1dc0cea60 2024-04-25T10:00:17.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.032+0000 7fd1d1ffb640 1 -- 172.21.15.7:0/3817987889 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd1cc01a070 con 0x7fd1dc0cea60 2024-04-25T10:00:17.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.032+0000 7fd1d1ffb640 1 --2- 172.21.15.7:0/3817987889 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd1c006b4d0 0x7fd1c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:17.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.032+0000 7fd1d1ffb640 1 -- 172.21.15.7:0/3817987889 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fd1cc089560 con 0x7fd1dc0cea60 2024-04-25T10:00:17.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.032+0000 7fd1e1648640 1 --2- 172.21.15.7:0/3817987889 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd1c006b4d0 0x7fd1c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:17.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.033+0000 7fd1e1648640 1 --2- 172.21.15.7:0/3817987889 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd1c006b4d0 0x7fd1c006d990 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8006fd0 tx=0x7fd1d8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:17.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.037+0000 7fd1d1ffb640 1 -- 172.21.15.7:0/3817987889 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd1dc1507f0 con 0x7fd1dc0cea60 2024-04-25T10:00:17.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.253+0000 7fd1e38ac640 1 -- 172.21.15.7:0/3817987889 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd1dc068fd0 con 0x7fd1dc0cea60 2024-04-25T10:00:17.258 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-04-25T10:00:17.254+0000 7f45ad572640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T10:00:17.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.256+0000 7fd1d1ffb640 1 -- 172.21.15.7:0/3817987889 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v46) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd1cc057c40 con 0x7fd1dc0cea60 2024-04-25T10:00:17.260 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T10:00:17.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.258+0000 7fd1e38ac640 1 -- 172.21.15.7:0/3817987889 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd1c006b4d0 msgr2=0x7fd1c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:17.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.258+0000 7fd1e38ac640 1 --2- 172.21.15.7:0/3817987889 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd1c006b4d0 0x7fd1c006d990 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8006fd0 tx=0x7fd1d8008040 comp rx=0 tx=0).stop 2024-04-25T10:00:17.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.258+0000 7fd1e38ac640 1 -- 172.21.15.7:0/3817987889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1dc0cea60 msgr2=0x7fd1dc0b3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:17.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.258+0000 7fd1e38ac640 1 --2- 172.21.15.7:0/3817987889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1dc0cea60 0x7fd1dc0b3270 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc00c340 tx=0x7fd1cc00c800 comp rx=0 tx=0).stop 2024-04-25T10:00:17.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.258+0000 7fd1e38ac640 1 -- 172.21.15.7:0/3817987889 shutdown_connections 2024-04-25T10:00:17.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.258+0000 7fd1e38ac640 1 --2- 172.21.15.7:0/3817987889 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd1c006b4d0 0x7fd1c006d990 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:17.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.258+0000 7fd1e38ac640 1 --2- 172.21.15.7:0/3817987889 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd1dc14dd60 0x7fd1dc0b37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:17.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.258+0000 7fd1e38ac640 1 --2- 172.21.15.7:0/3817987889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1dc0cea60 0x7fd1dc0b3270 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:17.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.258+0000 7fd1e38ac640 1 --2- 172.21.15.7:0/3817987889 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1dc0c6410 0x7fd1dc0b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:17.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.258+0000 7fd1e38ac640 1 -- 172.21.15.7:0/3817987889 >> 172.21.15.7:0/3817987889 conn(0x7fd1dc071150 msgr2=0x7fd1dc152f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:17.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.259+0000 7fd1e38ac640 1 -- 172.21.15.7:0/3817987889 shutdown_connections 2024-04-25T10:00:17.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.259+0000 7fd1e38ac640 1 -- 172.21.15.7:0/3817987889 wait complete. 2024-04-25T10:00:17.266 INFO:tasks.ceph.mds.c.smithi007.stderr: -3128> 2024-04-25T09:59:08.256+0000 7f68754b1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:00:17.275 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T10:00:17.295 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-04-25T10:00:17.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.375+0000 7f5ce1a1b640 1 Processor -- start 2024-04-25T10:00:17.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.375+0000 7f5ce1a1b640 1 -- start start 2024-04-25T10:00:17.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.376+0000 7f5ce1a1b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5cdc161200 0x7f5cdc0cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:17.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.376+0000 7f5ce1a1b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5cdc0d0a00 0x7f5cdc09a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:17.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.376+0000 7f5ce1a1b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cdc1615e0 con 0x7f5cdc09a7d0 2024-04-25T10:00:17.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.376+0000 7f5ce1a1b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cdc06c9f0 con 0x7f5cdc0d0a00 2024-04-25T10:00:17.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.376+0000 7f5ce1a1b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc06ccd0 con 0x7f5cdc161200 2024-04-25T10:00:17.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.376+0000 7f5cda7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5cdc0d0a00 0x7f5cdc09a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:17.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.376+0000 7f5cdaffd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5cdc161200 0x7f5cdc0cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:17.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.376+0000 7f5cdb7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5cdc09a7d0 0x7f5cdc161830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:58528/0 (socket says 172.21.15.7:58528) 2024-04-25T10:00:17.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.376+0000 7f5cdb7fe640 1 -- 172.21.15.7:0/4071986321 learned_addr learned my addr 172.21.15.7:0/4071986321 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:17.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.377+0000 7f5cd9ffb640 1 -- 172.21.15.7:0/4071986321 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693624214 0 0) 0x7f5cd4001490 con 0x7f5cdc09a7d0 2024-04-25T10:00:17.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.377+0000 7f5cd9ffb640 1 -- 172.21.15.7:0/4071986321 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cc4003520 con 0x7f5cdc09a7d0 2024-04-25T10:00:17.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.377+0000 7f5cdaffd640 1 -- 172.21.15.7:0/4071986321 >> v2:172.21.15.55:3300/0 conn(0x7f5cdc0d0a00 msgr2=0x7f5cdc09a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:17.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.377+0000 7f5cdaffd640 1 --2- 172.21.15.7:0/4071986321 >> v2:172.21.15.55:3300/0 conn(0x7f5cdc0d0a00 0x7f5cdc09a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:17.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.377+0000 7f5cdaffd640 1 -- 172.21.15.7:0/4071986321 >> v1:172.21.15.55:6789/0 conn(0x7f5cdc09a7d0 legacy=0x7f5cdc161830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:17.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.377+0000 7f5cdaffd640 1 -- 172.21.15.7:0/4071986321 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc099a90 con 0x7f5cdc161200 2024-04-25T10:00:17.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.377+0000 7f5cda7fc640 1 --2- 172.21.15.7:0/4071986321 >> v2:172.21.15.55:3300/0 conn(0x7f5cdc0d0a00 0x7f5cdc09a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:00:17.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.377+0000 7f5cdaffd640 1 --2- 172.21.15.7:0/4071986321 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5cdc161200 0x7f5cdc0cbd00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc0097a0 tx=0x7f5ccc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59fab49d4ce672a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:17.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.378+0000 7f5cd9ffb640 1 -- 172.21.15.7:0/4071986321 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc037070 con 0x7f5cdc161200 2024-04-25T10:00:17.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.378+0000 7f5cd9ffb640 1 -- 172.21.15.7:0/4071986321 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ccc032440 con 0x7f5cdc161200 2024-04-25T10:00:17.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.378+0000 7f5cd9ffb640 1 -- 172.21.15.7:0/4071986321 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc0327f0 con 0x7f5cdc161200 2024-04-25T10:00:17.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.378+0000 7f5ce1a1b640 1 -- 172.21.15.7:0/4071986321 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5cdc161200 msgr2=0x7f5cdc0cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:17.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.378+0000 7f5ce1a1b640 1 --2- 172.21.15.7:0/4071986321 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5cdc161200 0x7f5cdc0cbd00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc0097a0 tx=0x7f5ccc02a180 comp rx=0 tx=0).stop 2024-04-25T10:00:17.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.378+0000 7f5ce1a1b640 1 -- 172.21.15.7:0/4071986321 shutdown_connections 2024-04-25T10:00:17.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.378+0000 7f5ce1a1b640 1 --2- 172.21.15.7:0/4071986321 >> v2:172.21.15.55:3300/0 conn(0x7f5cdc0d0a00 0x7f5cdc09a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:17.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.378+0000 7f5ce1a1b640 1 --2- 172.21.15.7:0/4071986321 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5cdc161200 0x7f5cdc0cbd00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:17.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.378+0000 7f5ce1a1b640 1 -- 172.21.15.7:0/4071986321 >> 172.21.15.7:0/4071986321 conn(0x7f5cdc0b31a0 msgr2=0x7f5cdc0b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:17.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.378+0000 7f5ce1a1b640 1 -- 172.21.15.7:0/4071986321 shutdown_connections 2024-04-25T10:00:17.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.378+0000 7f5ce1a1b640 1 -- 172.21.15.7:0/4071986321 wait complete. 2024-04-25T10:00:17.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.379+0000 7f5ce1a1b640 1 Processor -- start 2024-04-25T10:00:17.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.380+0000 7f5ce1a1b640 1 -- start start 2024-04-25T10:00:17.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.380+0000 7f5ce1a1b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5cdc09a7d0 0x7f5cdc070d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:17.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.380+0000 7f5ce1a1b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cdc0d0a00 0x7f5cdc14fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:17.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.380+0000 7f5ce1a1b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cdc161200 0x7f5cdc0c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:17.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.380+0000 7f5ce1a1b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc06c680 con 0x7f5cdc161200 2024-04-25T10:00:17.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.380+0000 7f5ce1a1b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc0cc240 con 0x7f5cdc0d0a00 2024-04-25T10:00:17.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.380+0000 7f5ce1a1b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc06cfb0 con 0x7f5cdc09a7d0 2024-04-25T10:00:17.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.380+0000 7f5cdb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cdc161200 0x7f5cdc0c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:17.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.380+0000 7f5cdb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cdc161200 0x7f5cdc0c7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43040/0 (socket says 172.21.15.7:43040) 2024-04-25T10:00:17.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.380+0000 7f5cdb7fe640 1 -- 172.21.15.7:0/59708524 learned_addr learned my addr 172.21.15.7:0/59708524 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:17.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.380+0000 7f5cda7fc640 1 --2- 172.21.15.7:0/59708524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cdc0d0a00 0x7f5cdc14fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:17.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.380+0000 7f5cdaffd640 1 --2- 172.21.15.7:0/59708524 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5cdc09a7d0 0x7f5cdc070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:17.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.381+0000 7f5cdb7fe640 1 -- 172.21.15.7:0/59708524 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5cdc09a7d0 msgr2=0x7f5cdc070d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:17.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.381+0000 7f5cdb7fe640 1 --2- 172.21.15.7:0/59708524 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5cdc09a7d0 0x7f5cdc070d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:17.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.381+0000 7f5cdb7fe640 1 -- 172.21.15.7:0/59708524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cdc0d0a00 msgr2=0x7f5cdc14fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:17.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.381+0000 7f5cdb7fe640 1 --2- 172.21.15.7:0/59708524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cdc0d0a00 0x7f5cdc14fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:17.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.381+0000 7f5cdb7fe640 1 -- 172.21.15.7:0/59708524 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc1500c0 con 0x7f5cdc161200 2024-04-25T10:00:17.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.381+0000 7f5cdb7fe640 1 --2- 172.21.15.7:0/59708524 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cdc161200 0x7f5cdc0c7b30 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f5cd400ca60 tx=0x7f5cd400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:17.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.381+0000 7f5cc3fff640 1 -- 172.21.15.7:0/59708524 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd4017070 con 0x7f5cdc161200 2024-04-25T10:00:17.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.381+0000 7f5cc3fff640 1 -- 172.21.15.7:0/59708524 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd400abd0 con 0x7f5cdc161200 2024-04-25T10:00:17.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.381+0000 7f5ce1a1b640 1 -- 172.21.15.7:0/59708524 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cdc0c55e0 con 0x7f5cdc161200 2024-04-25T10:00:17.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.381+0000 7f5cc3fff640 1 -- 172.21.15.7:0/59708524 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd4012400 con 0x7f5cdc161200 2024-04-25T10:00:17.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.381+0000 7f5ce1a1b640 1 -- 172.21.15.7:0/59708524 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cdc070500 con 0x7f5cdc161200 2024-04-25T10:00:17.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.382+0000 7f5ce1a1b640 1 -- 172.21.15.7:0/59708524 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cdc070010 con 0x7f5cdc161200 2024-04-25T10:00:17.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.383+0000 7f5cc3fff640 1 -- 172.21.15.7:0/59708524 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5cd401a070 con 0x7f5cdc161200 2024-04-25T10:00:17.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.383+0000 7f5cc3fff640 1 --2- 172.21.15.7:0/59708524 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5cc806b500 0x7f5cc806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:17.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.383+0000 7f5cc3fff640 1 -- 172.21.15.7:0/59708524 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f5cd408a080 con 0x7f5cdc161200 2024-04-25T10:00:17.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.383+0000 7f5cdaffd640 1 --2- 172.21.15.7:0/59708524 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5cc806b500 0x7f5cc806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:17.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.384+0000 7f5cdaffd640 1 --2- 172.21.15.7:0/59708524 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5cc806b500 0x7f5cc806d9c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc034000 tx=0x7f5ccc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:17.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.387+0000 7f5cc3fff640 1 -- 172.21.15.7:0/59708524 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5cdc1615e0 con 0x7f5cdc161200 2024-04-25T10:00:17.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:17.605+0000 7f5ce1a1b640 1 -- 172.21.15.7:0/59708524 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5cdc068f60 con 0x7f5cdc161200 2024-04-25T10:00:18.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.257+0000 7f5cc3fff640 1 -- 172.21.15.7:0/59708524 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v47) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5cd4058670 con 0x7f5cdc161200 2024-04-25T10:00:18.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.260+0000 7f5ce1a1b640 1 -- 172.21.15.7:0/59708524 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5cc806b500 msgr2=0x7f5cc806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:18.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.260+0000 7f5ce1a1b640 1 --2- 172.21.15.7:0/59708524 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5cc806b500 0x7f5cc806d9c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc034000 tx=0x7f5ccc02e000 comp rx=0 tx=0).stop 2024-04-25T10:00:18.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.260+0000 7f5ce1a1b640 1 -- 172.21.15.7:0/59708524 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cdc161200 msgr2=0x7f5cdc0c7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:18.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.260+0000 7f5ce1a1b640 1 --2- 172.21.15.7:0/59708524 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cdc161200 0x7f5cdc0c7b30 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f5cd400ca60 tx=0x7f5cd400cf20 comp rx=0 tx=0).stop 2024-04-25T10:00:18.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.260+0000 7f5ce1a1b640 1 -- 172.21.15.7:0/59708524 shutdown_connections 2024-04-25T10:00:18.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.260+0000 7f5ce1a1b640 1 --2- 172.21.15.7:0/59708524 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5cc806b500 0x7f5cc806d9c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:18.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.260+0000 7f5ce1a1b640 1 --2- 172.21.15.7:0/59708524 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cdc161200 0x7f5cdc0c7b30 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:18.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.260+0000 7f5ce1a1b640 1 --2- 172.21.15.7:0/59708524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cdc0d0a00 0x7f5cdc14fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:18.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.260+0000 7f5ce1a1b640 1 --2- 172.21.15.7:0/59708524 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5cdc09a7d0 0x7f5cdc070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:18.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.260+0000 7f5ce1a1b640 1 -- 172.21.15.7:0/59708524 >> 172.21.15.7:0/59708524 conn(0x7f5cdc0b31a0 msgr2=0x7f5cdc0cd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:18.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.261+0000 7f5ce1a1b640 1 -- 172.21.15.7:0/59708524 shutdown_connections 2024-04-25T10:00:18.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.261+0000 7f5ce1a1b640 1 -- 172.21.15.7:0/59708524 wait complete. 2024-04-25T10:00:18.280 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T10:00:18.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.427+0000 7fe71343f640 1 Processor -- start 2024-04-25T10:00:18.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.428+0000 7fe71343f640 1 -- start start 2024-04-25T10:00:18.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.428+0000 7fe71343f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe70c0d3f10 0x7fe70c168830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:18.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.428+0000 7fe71343f640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70c0d2290 con 0x7fe70c15de70 2024-04-25T10:00:18.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.428+0000 7fe71343f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70c0d2570 con 0x7fe70c0d3330 2024-04-25T10:00:18.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.428+0000 7fe71343f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe70c0d2030 con 0x7fe70c0d3f10 2024-04-25T10:00:18.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.429+0000 7fe7111db640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe70c15de70 0x7fe70c0d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:60346/0 (socket says 172.21.15.7:60346) 2024-04-25T10:00:18.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.429+0000 7fe7111db640 1 -- 172.21.15.7:0/2801110519 learned_addr learned my addr 172.21.15.7:0/2801110519 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:18.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.429+0000 7fe7119dc640 1 --2- 172.21.15.7:0/2801110519 >> v2:172.21.15.55:3300/0 conn(0x7fe70c0d3f10 0x7fe70c168830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:18.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.429+0000 7fe703fff640 1 -- 172.21.15.7:0/2801110519 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462924707 0 0) 0x7fe70c0d2290 con 0x7fe70c15de70 2024-04-25T10:00:18.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.429+0000 7fe703fff640 1 -- 172.21.15.7:0/2801110519 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6f8003520 con 0x7fe70c15de70 2024-04-25T10:00:18.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.429+0000 7fe703fff640 1 -- 172.21.15.7:0/2801110519 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 474965664 0 0) 0x7fe70c0d2570 con 0x7fe70c0d3330 2024-04-25T10:00:18.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.429+0000 7fe703fff640 1 -- 172.21.15.7:0/2801110519 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe70c0d2290 con 0x7fe70c0d3330 2024-04-25T10:00:18.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.429+0000 7fe703fff640 1 -- 172.21.15.7:0/2801110519 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2240496158 0 0) 0x7fe6f8003520 con 0x7fe70c15de70 2024-04-25T10:00:18.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.429+0000 7fe703fff640 1 -- 172.21.15.7:0/2801110519 >> v2:172.21.15.55:3300/0 conn(0x7fe70c0d3f10 msgr2=0x7fe70c168830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:18.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.429+0000 7fe703fff640 1 --2- 172.21.15.7:0/2801110519 >> v2:172.21.15.55:3300/0 conn(0x7fe70c0d3f10 0x7fe70c168830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:18.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.429+0000 7fe703fff640 1 -- 172.21.15.7:0/2801110519 >> v1:172.21.15.55:6789/0 conn(0x7fe70c0d3330 legacy=0x7fe70c0d3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:18.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.429+0000 7fe703fff640 1 -- 172.21.15.7:0/2801110519 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70c0d2850 con 0x7fe70c15de70 2024-04-25T10:00:18.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.429+0000 7fe703fff640 1 -- 172.21.15.7:0/2801110519 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fe708001670 con 0x7fe70c15de70 2024-04-25T10:00:18.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.429+0000 7fe7119dc640 1 --2- 172.21.15.7:0/2801110519 >> v2:172.21.15.55:3300/0 conn(0x7fe70c0d3f10 0x7fe70c168830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:00:18.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.429+0000 7fe703fff640 1 -- 172.21.15.7:0/2801110519 >> v1:172.21.15.7:6789/0 conn(0x7fe70c15de70 legacy=0x7fe70c0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:18.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.429+0000 7fe703fff640 1 --2- 172.21.15.7:0/2801110519 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6f8003b40 0x7fe6f8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:18.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.429+0000 7fe703fff640 1 --2- 172.21.15.7:0/2801110519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6f8004800 0x7fe6f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:18.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.429+0000 7fe703fff640 1 --2- 172.21.15.7:0/2801110519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f80051c0 0x7fe6f800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:18.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.429+0000 7fe703fff640 1 -- 172.21.15.7:0/2801110519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0d2030 con 0x7fe6f8004800 2024-04-25T10:00:18.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.429+0000 7fe703fff640 1 -- 172.21.15.7:0/2801110519 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f800c040 con 0x7fe6f80051c0 2024-04-25T10:00:18.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.429+0000 7fe703fff640 1 -- 172.21.15.7:0/2801110519 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f8014a50 con 0x7fe6f8003b40 2024-04-25T10:00:18.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.429+0000 7fe7109da640 1 --2- 172.21.15.7:0/2801110519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6f8004800 0x7fe6f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:18.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.429+0000 7fe7111db640 1 --2- 172.21.15.7:0/2801110519 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6f8003b40 0x7fe6f8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:18.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.429+0000 7fe7119dc640 1 --2- 172.21.15.7:0/2801110519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f80051c0 0x7fe6f800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:18.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.430+0000 7fe7109da640 1 -- 172.21.15.7:0/2801110519 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6f8003b40 msgr2=0x7fe6f8003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:18.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.430+0000 7fe7109da640 1 --2- 172.21.15.7:0/2801110519 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6f8003b40 0x7fe6f8003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:18.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.430+0000 7fe7109da640 1 -- 172.21.15.7:0/2801110519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f80051c0 msgr2=0x7fe6f800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:18.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.430+0000 7fe7109da640 1 --2- 172.21.15.7:0/2801110519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f80051c0 0x7fe6f800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:18.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.430+0000 7fe7119dc640 1 -- 172.21.15.7:0/2801110519 reap_dead start 2024-04-25T10:00:18.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.430+0000 7fe7109da640 1 -- 172.21.15.7:0/2801110519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f8003520 con 0x7fe6f8004800 2024-04-25T10:00:18.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.430+0000 7fe7109da640 1 --2- 172.21.15.7:0/2801110519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6f8004800 0x7fe6f8004c80 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc0018a0 tx=0x7fe6f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d2b0e73f6f0876 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:18.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.431+0000 7fe703fff640 1 -- 172.21.15.7:0/2801110519 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc0014f0 con 0x7fe6f8004800 2024-04-25T10:00:18.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.431+0000 7fe703fff640 1 -- 172.21.15.7:0/2801110519 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6fc0052d0 con 0x7fe6f8004800 2024-04-25T10:00:18.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.431+0000 7fe703fff640 1 -- 172.21.15.7:0/2801110519 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc02ac00 con 0x7fe6f8004800 2024-04-25T10:00:18.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.431+0000 7fe71343f640 1 -- 172.21.15.7:0/2801110519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6f8004800 msgr2=0x7fe6f8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:18.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.431+0000 7fe71343f640 1 --2- 172.21.15.7:0/2801110519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6f8004800 0x7fe6f8004c80 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc0018a0 tx=0x7fe6f8005830 comp rx=0 tx=0).stop 2024-04-25T10:00:18.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.431+0000 7fe71343f640 1 -- 172.21.15.7:0/2801110519 shutdown_connections 2024-04-25T10:00:18.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.431+0000 7fe71343f640 1 --2- 172.21.15.7:0/2801110519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6f8004800 0x7fe6f8004c80 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:18.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.431+0000 7fe71343f640 1 -- 172.21.15.7:0/2801110519 >> 172.21.15.7:0/2801110519 conn(0x7fe70c0726b0 msgr2=0x7fe70c072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:18.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.431+0000 7fe71343f640 1 -- 172.21.15.7:0/2801110519 shutdown_connections 2024-04-25T10:00:18.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.431+0000 7fe71343f640 1 -- 172.21.15.7:0/2801110519 wait complete. 2024-04-25T10:00:18.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.432+0000 7fe71343f640 1 Processor -- start 2024-04-25T10:00:18.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.432+0000 7fe71343f640 1 -- start start 2024-04-25T10:00:18.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.433+0000 7fe71343f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6f8004800 0x7fe70c150060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:18.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.433+0000 7fe71343f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe70c0cb730 0x7fe70c0cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:18.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.433+0000 7fe71343f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe70c15fd80 0x7fe70c160200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:18.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.433+0000 7fe71343f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0b9290 con 0x7fe70c15fd80 2024-04-25T10:00:18.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.433+0000 7fe71343f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0d2e10 con 0x7fe70c0cb730 2024-04-25T10:00:18.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.433+0000 7fe71343f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0b9410 con 0x7fe6f8004800 2024-04-25T10:00:18.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.433+0000 7fe7119dc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe70c15fd80 0x7fe70c160200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:18.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.433+0000 7fe7119dc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe70c15fd80 0x7fe70c160200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43052/0 (socket says 172.21.15.7:43052) 2024-04-25T10:00:18.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.433+0000 7fe7119dc640 1 -- 172.21.15.7:0/71635617 learned_addr learned my addr 172.21.15.7:0/71635617 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:18.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.433+0000 7fe7111db640 1 --2- 172.21.15.7:0/71635617 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6f8004800 0x7fe70c150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.433+0000 7fe7109da640 1 --2- 172.21.15.7:0/71635617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe70c0cb730 0x7fe70c0cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.434+0000 7fe7119dc640 1 -- 172.21.15.7:0/71635617 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6f8004800 msgr2=0x7fe70c150060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.434+0000 7fe7119dc640 1 --2- 172.21.15.7:0/71635617 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6f8004800 0x7fe70c150060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.434+0000 7fe7119dc640 1 -- 172.21.15.7:0/71635617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe70c0cb730 msgr2=0x7fe70c0cbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.434+0000 7fe7119dc640 1 --2- 172.21.15.7:0/71635617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe70c0cb730 0x7fe70c0cbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.434+0000 7fe7119dc640 1 -- 172.21.15.7:0/71635617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70c0cc2f0 con 0x7fe70c15fd80 2024-04-25T10:00:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.434+0000 7fe7119dc640 1 --2- 172.21.15.7:0/71635617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe70c15fd80 0x7fe70c160200 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8004780 tx=0x7fe70400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.434+0000 7fe701ffb640 1 -- 172.21.15.7:0/71635617 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70400fdc0 con 0x7fe70c15fd80 2024-04-25T10:00:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.434+0000 7fe701ffb640 1 -- 172.21.15.7:0/71635617 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe704003990 con 0x7fe70c15fd80 2024-04-25T10:00:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.434+0000 7fe71343f640 1 -- 172.21.15.7:0/71635617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe70c0cc5d0 con 0x7fe70c15fd80 2024-04-25T10:00:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.434+0000 7fe701ffb640 1 -- 172.21.15.7:0/71635617 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe704003d80 con 0x7fe70c15fd80 2024-04-25T10:00:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.434+0000 7fe71343f640 1 -- 172.21.15.7:0/71635617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe70c0ccb90 con 0x7fe70c15fd80 2024-04-25T10:00:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.435+0000 7fe71343f640 1 -- 172.21.15.7:0/71635617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe70c069040 con 0x7fe70c15fd80 2024-04-25T10:00:18.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.436+0000 7fe701ffb640 1 -- 172.21.15.7:0/71635617 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe70401f020 con 0x7fe70c15fd80 2024-04-25T10:00:18.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.436+0000 7fe701ffb640 1 --2- 172.21.15.7:0/71635617 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe6f006b500 0x7fe6f006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:18.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.436+0000 7fe701ffb640 1 -- 172.21.15.7:0/71635617 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fe70408a680 con 0x7fe70c15fd80 2024-04-25T10:00:18.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.436+0000 7fe7111db640 1 --2- 172.21.15.7:0/71635617 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe6f006b500 0x7fe6f006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:18.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.437+0000 7fe7111db640 1 --2- 172.21.15.7:0/71635617 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe6f006b500 0x7fe6f006d9c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe708001050 tx=0x7fe708001e20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:18.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.441+0000 7fe701ffb640 1 -- 172.21.15.7:0/71635617 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe704010040 con 0x7fe70c15fd80 2024-04-25T10:00:18.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:18.621+0000 7fe71343f640 1 -- 172.21.15.7:0/71635617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe70c1519e0 con 0x7fe70c15fd80 2024-04-25T10:00:19.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.610+0000 7fe701ffb640 1 -- 172.21.15.7:0/71635617 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v78) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe704059350 con 0x7fe70c15fd80 2024-04-25T10:00:19.615 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2024-04-25T10:00:19.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.614+0000 7fe71343f640 1 -- 172.21.15.7:0/71635617 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe6f006b500 msgr2=0x7fe6f006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:19.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.614+0000 7fe71343f640 1 --2- 172.21.15.7:0/71635617 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe6f006b500 0x7fe6f006d9c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe708001050 tx=0x7fe708001e20 comp rx=0 tx=0).stop 2024-04-25T10:00:19.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.614+0000 7fe71343f640 1 -- 172.21.15.7:0/71635617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe70c15fd80 msgr2=0x7fe70c160200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:19.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.614+0000 7fe71343f640 1 --2- 172.21.15.7:0/71635617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe70c15fd80 0x7fe70c160200 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8004780 tx=0x7fe70400f580 comp rx=0 tx=0).stop 2024-04-25T10:00:19.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.615+0000 7fe71343f640 1 -- 172.21.15.7:0/71635617 shutdown_connections 2024-04-25T10:00:19.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.615+0000 7fe71343f640 1 --2- 172.21.15.7:0/71635617 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe6f006b500 0x7fe6f006d9c0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:19.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.615+0000 7fe71343f640 1 --2- 172.21.15.7:0/71635617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe70c15fd80 0x7fe70c160200 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:19.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.615+0000 7fe71343f640 1 --2- 172.21.15.7:0/71635617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe70c0cb730 0x7fe70c0cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:19.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.615+0000 7fe71343f640 1 --2- 172.21.15.7:0/71635617 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6f8004800 0x7fe70c150060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:19.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.615+0000 7fe71343f640 1 -- 172.21.15.7:0/71635617 >> 172.21.15.7:0/71635617 conn(0x7fe70c0726b0 msgr2=0x7fe70c072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:19.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.615+0000 7fe71343f640 1 -- 172.21.15.7:0/71635617 shutdown_connections 2024-04-25T10:00:19.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.615+0000 7fe71343f640 1 -- 172.21.15.7:0/71635617 wait complete. 2024-04-25T10:00:19.633 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T10:00:19.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.742+0000 7f5f0c4c4640 1 Processor -- start 2024-04-25T10:00:19.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.742+0000 7f5f0c4c4640 1 -- start start 2024-04-25T10:00:19.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.743+0000 7f5f0c4c4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5f0415dba0 0x7f5f040b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:19.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.743+0000 7f5f0c4c4640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5f040b6a40 0x7f5f040d0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:19.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.743+0000 7f5f0c4c4640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f040d1a10 con 0x7f5f0415df80 2024-04-25T10:00:19.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.743+0000 7f5f0c4c4640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f040d1cb0 con 0x7f5f0415dba0 2024-04-25T10:00:19.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.743+0000 7f5f0c4c4640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f040d1f90 con 0x7f5f040b6a40 2024-04-25T10:00:19.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.743+0000 7f5f0a260640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5f0415dba0 0x7f5f040b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:19.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.743+0000 7f5f0aa61640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5f040b6a40 0x7f5f040d0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:19.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.743+0000 7f5f0a260640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5f0415dba0 0x7f5f040b2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:52798/0 (socket says 172.21.15.7:52798) 2024-04-25T10:00:19.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.743+0000 7f5f09a5f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5f0415df80 0x7f5f040cea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:53360/0 (socket says 172.21.15.7:53360) 2024-04-25T10:00:19.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.743+0000 7f5f0a260640 1 -- 172.21.15.7:0/259316007 learned_addr learned my addr 172.21.15.7:0/259316007 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:19.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.743+0000 7f5f0aa61640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5f040b6a40 0x7f5f040d0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:54622/0 (socket says 172.21.15.7:54622) 2024-04-25T10:00:19.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.744+0000 7f5f0a260640 1 -- 172.21.15.7:0/259316007 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5f040b6a40 msgr2=0x7f5f040d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:19.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.744+0000 7f5f0a260640 1 --2- 172.21.15.7:0/259316007 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5f040b6a40 0x7f5f040d0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:19.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.744+0000 7f5f0a260640 1 -- 172.21.15.7:0/259316007 >> v1:172.21.15.55:6789/0 conn(0x7f5f0415df80 legacy=0x7f5f040cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:19.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.744+0000 7f5f0a260640 1 -- 172.21.15.7:0/259316007 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f040d2270 con 0x7f5f0415dba0 2024-04-25T10:00:19.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.744+0000 7f5f0aa61640 1 --2- 172.21.15.7:0/259316007 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5f040b6a40 0x7f5f040d0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:00:19.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.744+0000 7f5f0a260640 1 --2- 172.21.15.7:0/259316007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f0415dba0 0x7f5f040b2c00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5efc009870 tx=0x7f5efc02a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3ceff6186881006 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.745+0000 7f5f0925e640 1 -- 172.21.15.7:0/259316007 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc037070 con 0x7f5f0415dba0 2024-04-25T10:00:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.745+0000 7f5f0925e640 1 -- 172.21.15.7:0/259316007 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5efc032440 con 0x7f5f0415dba0 2024-04-25T10:00:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.745+0000 7f5f0925e640 1 -- 172.21.15.7:0/259316007 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc032810 con 0x7f5f0415dba0 2024-04-25T10:00:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.745+0000 7f5f0c4c4640 1 -- 172.21.15.7:0/259316007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f0415dba0 msgr2=0x7f5f040b2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.745+0000 7f5f0c4c4640 1 --2- 172.21.15.7:0/259316007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f0415dba0 0x7f5f040b2c00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5efc009870 tx=0x7f5efc02a250 comp rx=0 tx=0).stop 2024-04-25T10:00:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.745+0000 7f5f0c4c4640 1 -- 172.21.15.7:0/259316007 shutdown_connections 2024-04-25T10:00:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.745+0000 7f5f0c4c4640 1 --2- 172.21.15.7:0/259316007 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5f040b6a40 0x7f5f040d0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.745+0000 7f5f0c4c4640 1 --2- 172.21.15.7:0/259316007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f0415dba0 0x7f5f040b2c00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.745+0000 7f5f0c4c4640 1 -- 172.21.15.7:0/259316007 >> 172.21.15.7:0/259316007 conn(0x7f5f0406c530 msgr2=0x7f5f04072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.745+0000 7f5f0c4c4640 1 -- 172.21.15.7:0/259316007 shutdown_connections 2024-04-25T10:00:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.745+0000 7f5f0c4c4640 1 -- 172.21.15.7:0/259316007 wait complete. 2024-04-25T10:00:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.746+0000 7f5f0c4c4640 1 Processor -- start 2024-04-25T10:00:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.747+0000 7f5f0c4c4640 1 -- start start 2024-04-25T10:00:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.747+0000 7f5f0c4c4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f040b6a40 0x7f5f04154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.747+0000 7f5f0c4c4640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5f0415dba0 0x7f5f04157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.747+0000 7f5f0c4c4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f0415df80 0x7f5f041583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.747+0000 7f5f0c4c4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f040b7030 con 0x7f5f040b6a40 2024-04-25T10:00:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.747+0000 7f5f0c4c4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f040b6eb0 con 0x7f5f0415df80 2024-04-25T10:00:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.747+0000 7f5f0c4c4640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f040b71b0 con 0x7f5f0415dba0 2024-04-25T10:00:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.747+0000 7f5f0a260640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f040b6a40 0x7f5f04154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.747+0000 7f5f0a260640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f040b6a40 0x7f5f04154b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38360/0 (socket says 172.21.15.7:38360) 2024-04-25T10:00:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.747+0000 7f5f0a260640 1 -- 172.21.15.7:0/3142866525 learned_addr learned my addr 172.21.15.7:0/3142866525 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.748+0000 7f5f0aa61640 1 --2- 172.21.15.7:0/3142866525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f0415df80 0x7f5f041583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.748+0000 7f5f09a5f640 1 --2- 172.21.15.7:0/3142866525 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5f0415dba0 0x7f5f04157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.748+0000 7f5f0a260640 1 -- 172.21.15.7:0/3142866525 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5f0415dba0 msgr2=0x7f5f04157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.748+0000 7f5f0a260640 1 --2- 172.21.15.7:0/3142866525 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5f0415dba0 0x7f5f04157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.748+0000 7f5f0a260640 1 -- 172.21.15.7:0/3142866525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f0415df80 msgr2=0x7f5f041583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.748+0000 7f5f0a260640 1 --2- 172.21.15.7:0/3142866525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f0415df80 0x7f5f041583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.748+0000 7f5f0a260640 1 -- 172.21.15.7:0/3142866525 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f04156460 con 0x7f5f040b6a40 2024-04-25T10:00:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.748+0000 7f5f09a5f640 1 --2- 172.21.15.7:0/3142866525 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5f0415dba0 0x7f5f04157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.748+0000 7f5f0a260640 1 --2- 172.21.15.7:0/3142866525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f040b6a40 0x7f5f04154b60 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f5efc000c00 tx=0x7f5efc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:19.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.748+0000 7f5f02ffd640 1 -- 172.21.15.7:0/3142866525 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc037040 con 0x7f5f040b6a40 2024-04-25T10:00:19.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.748+0000 7f5f02ffd640 1 -- 172.21.15.7:0/3142866525 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5efc042070 con 0x7f5f040b6a40 2024-04-25T10:00:19.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.748+0000 7f5f0c4c4640 1 -- 172.21.15.7:0/3142866525 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f04156740 con 0x7f5f040b6a40 2024-04-25T10:00:19.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.748+0000 7f5f02ffd640 1 -- 172.21.15.7:0/3142866525 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc0308a0 con 0x7f5f040b6a40 2024-04-25T10:00:19.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.748+0000 7f5f0c4c4640 1 -- 172.21.15.7:0/3142866525 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f04156d00 con 0x7f5f040b6a40 2024-04-25T10:00:19.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.749+0000 7f5f0c4c4640 1 -- 172.21.15.7:0/3142866525 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f04069040 con 0x7f5f040b6a40 2024-04-25T10:00:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.750+0000 7f5f02ffd640 1 -- 172.21.15.7:0/3142866525 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5efc030a40 con 0x7f5f040b6a40 2024-04-25T10:00:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.750+0000 7f5f02ffd640 1 --2- 172.21.15.7:0/3142866525 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5ef006b4d0 0x7f5ef006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.750+0000 7f5f02ffd640 1 -- 172.21.15.7:0/3142866525 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5835+0+0 (secure 0 0 0) 0x7f5efc0aa9b0 con 0x7f5f040b6a40 2024-04-25T10:00:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.750+0000 7f5f09a5f640 1 --2- 172.21.15.7:0/3142866525 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5ef006b4d0 0x7f5ef006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.751+0000 7f5f09a5f640 1 --2- 172.21.15.7:0/3142866525 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5ef006b4d0 0x7f5ef006d990 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8007fd0 tx=0x7f5ef8007d60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:19.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.754+0000 7f5f02ffd640 1 -- 172.21.15.7:0/3142866525 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5efc079960 con 0x7f5f040b6a40 2024-04-25T10:00:19.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:19.935+0000 7f5f0c4c4640 1 -- 172.21.15.7:0/3142866525 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5f040b25c0 con 0x7f5f040b6a40 2024-04-25T10:00:20.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.615+0000 7f5f02ffd640 1 -- 172.21.15.7:0/3142866525 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v79) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5efc079260 con 0x7f5f040b6a40 2024-04-25T10:00:20.620 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2024-04-25T10:00:20.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.622+0000 7f5f0c4c4640 1 -- 172.21.15.7:0/3142866525 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5ef006b4d0 msgr2=0x7f5ef006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:20.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.622+0000 7f5f0c4c4640 1 --2- 172.21.15.7:0/3142866525 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5ef006b4d0 0x7f5ef006d990 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8007fd0 tx=0x7f5ef8007d60 comp rx=0 tx=0).stop 2024-04-25T10:00:20.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.623+0000 7f5f0c4c4640 1 -- 172.21.15.7:0/3142866525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f040b6a40 msgr2=0x7f5f04154b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:20.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.623+0000 7f5f0c4c4640 1 --2- 172.21.15.7:0/3142866525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f040b6a40 0x7f5f04154b60 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f5efc000c00 tx=0x7f5efc0046c0 comp rx=0 tx=0).stop 2024-04-25T10:00:20.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.624+0000 7f5f0c4c4640 1 -- 172.21.15.7:0/3142866525 shutdown_connections 2024-04-25T10:00:20.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.624+0000 7f5f0c4c4640 1 --2- 172.21.15.7:0/3142866525 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5ef006b4d0 0x7f5ef006d990 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:20.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.624+0000 7f5f0c4c4640 1 --2- 172.21.15.7:0/3142866525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f0415df80 0x7f5f041583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:20.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.624+0000 7f5f0c4c4640 1 --2- 172.21.15.7:0/3142866525 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5f0415dba0 0x7f5f04157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:20.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.624+0000 7f5f0c4c4640 1 --2- 172.21.15.7:0/3142866525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f040b6a40 0x7f5f04154b60 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:20.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.624+0000 7f5f0c4c4640 1 -- 172.21.15.7:0/3142866525 >> 172.21.15.7:0/3142866525 conn(0x7f5f0406c530 msgr2=0x7f5f040b8620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:20.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.624+0000 7f5f0c4c4640 1 -- 172.21.15.7:0/3142866525 shutdown_connections 2024-04-25T10:00:20.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.624+0000 7f5f0c4c4640 1 -- 172.21.15.7:0/3142866525 wait complete. 2024-04-25T10:00:20.646 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T10:00:20.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.749+0000 7f3921329640 1 Processor -- start 2024-04-25T10:00:20.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.749+0000 7f3921329640 1 -- start start 2024-04-25T10:00:20.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.750+0000 7f3921329640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f391c0b1480 0x7f391c0b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:20.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.750+0000 7f3921329640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f391c0cc580 0x7f391c0cca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:20.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.750+0000 7f3921329640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f391c0b25e0 con 0x7f391c0cfc40 2024-04-25T10:00:20.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.750+0000 7f3921329640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f391c15bec0 con 0x7f391c0b1480 2024-04-25T10:00:20.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.750+0000 7f3921329640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0b19d0 con 0x7f391c0cc580 2024-04-25T10:00:20.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.751+0000 7f391a7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f391c0b1480 0x7f391c0b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:20.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.751+0000 7f391b7fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f391c0cc580 0x7f391c0cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:20.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.751+0000 7f391b7fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f391c0cc580 0x7f391c0cca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:54642/0 (socket says 172.21.15.7:54642) 2024-04-25T10:00:20.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.751+0000 7f391affd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f391c0cfc40 0x7f391c0d0020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:53374/0 (socket says 172.21.15.7:53374) 2024-04-25T10:00:20.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.751+0000 7f391b7fe640 1 -- 172.21.15.7:0/661387267 learned_addr learned my addr 172.21.15.7:0/661387267 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:20.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.751+0000 7f391a7fc640 1 -- 172.21.15.7:0/661387267 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f391c0cc580 msgr2=0x7f391c0cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:20.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.751+0000 7f391a7fc640 1 --2- 172.21.15.7:0/661387267 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f391c0cc580 0x7f391c0cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:20.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.751+0000 7f391a7fc640 1 -- 172.21.15.7:0/661387267 >> v1:172.21.15.55:6789/0 conn(0x7f391c0cfc40 legacy=0x7f391c0d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:20.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.751+0000 7f391a7fc640 1 -- 172.21.15.7:0/661387267 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c0b1cb0 con 0x7f391c0b1480 2024-04-25T10:00:20.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.751+0000 7f391b7fe640 1 --2- 172.21.15.7:0/661387267 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f391c0cc580 0x7f391c0cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:00:20.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.752+0000 7f391a7fc640 1 --2- 172.21.15.7:0/661387267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f391c0b1480 0x7f391c0b0ad0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f39040097a0 tx=0x7f390402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c82476d883765b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:20.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.752+0000 7f3919ffb640 1 -- 172.21.15.7:0/661387267 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3904037070 con 0x7f391c0b1480 2024-04-25T10:00:20.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.752+0000 7f3919ffb640 1 -- 172.21.15.7:0/661387267 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3904032440 con 0x7f391c0b1480 2024-04-25T10:00:20.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.752+0000 7f3919ffb640 1 -- 172.21.15.7:0/661387267 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3904032810 con 0x7f391c0b1480 2024-04-25T10:00:20.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.752+0000 7f3921329640 1 -- 172.21.15.7:0/661387267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f391c0b1480 msgr2=0x7f391c0b0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:20.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.752+0000 7f3921329640 1 --2- 172.21.15.7:0/661387267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f391c0b1480 0x7f391c0b0ad0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f39040097a0 tx=0x7f390402a180 comp rx=0 tx=0).stop 2024-04-25T10:00:20.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.753+0000 7f3921329640 1 -- 172.21.15.7:0/661387267 shutdown_connections 2024-04-25T10:00:20.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.753+0000 7f3921329640 1 --2- 172.21.15.7:0/661387267 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f391c0cc580 0x7f391c0cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:20.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.753+0000 7f3921329640 1 --2- 172.21.15.7:0/661387267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f391c0b1480 0x7f391c0b0ad0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:20.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.753+0000 7f3921329640 1 -- 172.21.15.7:0/661387267 >> 172.21.15.7:0/661387267 conn(0x7f391c08af80 msgr2=0x7f391c08b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:20.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.753+0000 7f3921329640 1 -- 172.21.15.7:0/661387267 shutdown_connections 2024-04-25T10:00:20.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.753+0000 7f3921329640 1 -- 172.21.15.7:0/661387267 wait complete. 2024-04-25T10:00:20.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.754+0000 7f3921329640 1 Processor -- start 2024-04-25T10:00:20.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.754+0000 7f3921329640 1 -- start start 2024-04-25T10:00:20.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.755+0000 7f3921329640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f391c0b1480 0x7f391c148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:20.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.755+0000 7f3921329640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f391c0cc580 0x7f391c1f0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:20.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.755+0000 7f3921329640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f391c0cfc40 0x7f391c0b4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:20.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.755+0000 7f3921329640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0b1010 con 0x7f391c0cfc40 2024-04-25T10:00:20.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.755+0000 7f3921329640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0b2270 con 0x7f391c0b1480 2024-04-25T10:00:20.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.755+0000 7f3921329640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0ccf50 con 0x7f391c0cc580 2024-04-25T10:00:20.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.755+0000 7f391b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f391c0cfc40 0x7f391c0b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:20.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.755+0000 7f391b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f391c0cfc40 0x7f391c0b4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38362/0 (socket says 172.21.15.7:38362) 2024-04-25T10:00:20.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.755+0000 7f391b7fe640 1 -- 172.21.15.7:0/2024470958 learned_addr learned my addr 172.21.15.7:0/2024470958 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:20.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.755+0000 7f391affd640 1 --2- 172.21.15.7:0/2024470958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f391c0b1480 0x7f391c148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:20.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.755+0000 7f391a7fc640 1 --2- 172.21.15.7:0/2024470958 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f391c0cc580 0x7f391c1f0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:20.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.755+0000 7f391b7fe640 1 -- 172.21.15.7:0/2024470958 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f391c0cc580 msgr2=0x7f391c1f0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:20.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.755+0000 7f391b7fe640 1 --2- 172.21.15.7:0/2024470958 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f391c0cc580 0x7f391c1f0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:20.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.755+0000 7f391b7fe640 1 -- 172.21.15.7:0/2024470958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f391c0b1480 msgr2=0x7f391c148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:20.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.755+0000 7f391b7fe640 1 --2- 172.21.15.7:0/2024470958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f391c0b1480 0x7f391c148d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:20.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.755+0000 7f391b7fe640 1 -- 172.21.15.7:0/2024470958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c1f1390 con 0x7f391c0cfc40 2024-04-25T10:00:20.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.755+0000 7f391b7fe640 1 --2- 172.21.15.7:0/2024470958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f391c0cfc40 0x7f391c0b4280 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f390c00efc0 tx=0x7f390c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:20.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.755+0000 7f39137fe640 1 -- 172.21.15.7:0/2024470958 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c00cbe0 con 0x7f391c0cfc40 2024-04-25T10:00:20.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.756+0000 7f39137fe640 1 -- 172.21.15.7:0/2024470958 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390c00cd80 con 0x7f391c0cfc40 2024-04-25T10:00:20.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.756+0000 7f39137fe640 1 -- 172.21.15.7:0/2024470958 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c003bb0 con 0x7f391c0cfc40 2024-04-25T10:00:20.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.756+0000 7f3921329640 1 -- 172.21.15.7:0/2024470958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f391c0b7360 con 0x7f391c0cfc40 2024-04-25T10:00:20.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.756+0000 7f3921329640 1 -- 172.21.15.7:0/2024470958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f391c0c9c40 con 0x7f391c0cfc40 2024-04-25T10:00:20.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.757+0000 7f3921329640 1 -- 172.21.15.7:0/2024470958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f391c0c9780 con 0x7f391c0cfc40 2024-04-25T10:00:20.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.757+0000 7f39137fe640 1 -- 172.21.15.7:0/2024470958 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f390c01b030 con 0x7f391c0cfc40 2024-04-25T10:00:20.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.757+0000 7f39137fe640 1 --2- 172.21.15.7:0/2024470958 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f38fc06b4d0 0x7f38fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:20.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.757+0000 7f39137fe640 1 -- 172.21.15.7:0/2024470958 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f390c08a410 con 0x7f391c0cfc40 2024-04-25T10:00:20.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.758+0000 7f391affd640 1 --2- 172.21.15.7:0/2024470958 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f38fc06b4d0 0x7f38fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:20.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.758+0000 7f391affd640 1 --2- 172.21.15.7:0/2024470958 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f38fc06b4d0 0x7f38fc06d990 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f391c1f4a00 tx=0x7f3914007e80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:20.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.762+0000 7f39137fe640 1 -- 172.21.15.7:0/2024470958 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f391c0c9780 con 0x7f391c0cfc40 2024-04-25T10:00:20.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.941+0000 7f3921329640 1 -- 172.21.15.7:0/2024470958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f391c068f60 con 0x7f391c0cfc40 2024-04-25T10:00:20.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.944+0000 7f39137fe640 1 -- 172.21.15.7:0/2024470958 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f390c022020 con 0x7f391c0cfc40 2024-04-25T10:00:20.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.946+0000 7f3921329640 1 -- 172.21.15.7:0/2024470958 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f38fc06b4d0 msgr2=0x7f38fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:20.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.946+0000 7f3921329640 1 --2- 172.21.15.7:0/2024470958 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f38fc06b4d0 0x7f38fc06d990 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f391c1f4a00 tx=0x7f3914007e80 comp rx=0 tx=0).stop 2024-04-25T10:00:20.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.946+0000 7f3921329640 1 -- 172.21.15.7:0/2024470958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f391c0cfc40 msgr2=0x7f391c0b4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:20.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.946+0000 7f3921329640 1 --2- 172.21.15.7:0/2024470958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f391c0cfc40 0x7f391c0b4280 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f390c00efc0 tx=0x7f390c00c490 comp rx=0 tx=0).stop 2024-04-25T10:00:20.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.946+0000 7f3921329640 1 -- 172.21.15.7:0/2024470958 shutdown_connections 2024-04-25T10:00:20.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.946+0000 7f3921329640 1 --2- 172.21.15.7:0/2024470958 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f38fc06b4d0 0x7f38fc06d990 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:20.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.946+0000 7f3921329640 1 --2- 172.21.15.7:0/2024470958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f391c0cfc40 0x7f391c0b4280 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:20.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.946+0000 7f3921329640 1 --2- 172.21.15.7:0/2024470958 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f391c0cc580 0x7f391c1f0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:20.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.946+0000 7f3921329640 1 --2- 172.21.15.7:0/2024470958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f391c0b1480 0x7f391c148d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:20.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.946+0000 7f3921329640 1 -- 172.21.15.7:0/2024470958 >> 172.21.15.7:0/2024470958 conn(0x7f391c08af80 msgr2=0x7f391c0d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:20.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.946+0000 7f3921329640 1 -- 172.21.15.7:0/2024470958 shutdown_connections 2024-04-25T10:00:20.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:20.947+0000 7f3921329640 1 -- 172.21.15.7:0/2024470958 wait complete. 2024-04-25T10:00:20.962 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair' 2024-04-25T10:00:21.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.059+0000 7f36cbb42640 1 Processor -- start 2024-04-25T10:00:21.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.059+0000 7f36cbb42640 1 -- start start 2024-04-25T10:00:21.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.060+0000 7f36cbb42640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f36c415dc60 0x7f36c40b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:21.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.060+0000 7f36cbb42640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f36c40afc00 0x7f36c40b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:21.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.060+0000 7f36cbb42640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36c40b5a20 con 0x7f36c406ab60 2024-04-25T10:00:21.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.060+0000 7f36cbb42640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36c40b0160 con 0x7f36c40afc00 2024-04-25T10:00:21.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.060+0000 7f36cbb42640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36c40b5740 con 0x7f36c415dc60 2024-04-25T10:00:21.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.060+0000 7f36ca0df640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f36c40afc00 0x7f36c40b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:21.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.060+0000 7f36ca0df640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f36c40afc00 0x7f36c40b0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38372/0 (socket says 172.21.15.7:38372) 2024-04-25T10:00:21.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.060+0000 7f36ca0df640 1 -- 172.21.15.7:0/3275785465 learned_addr learned my addr 172.21.15.7:0/3275785465 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:21.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.061+0000 7f36c90dd640 1 --2- 172.21.15.7:0/3275785465 >> v2:172.21.15.55:3300/0 conn(0x7f36c415dc60 0x7f36c40b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:21.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.061+0000 7f36ca0df640 1 -- 172.21.15.7:0/3275785465 >> v2:172.21.15.55:3300/0 conn(0x7f36c415dc60 msgr2=0x7f36c40b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:21.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.061+0000 7f36ca0df640 1 --2- 172.21.15.7:0/3275785465 >> v2:172.21.15.55:3300/0 conn(0x7f36c415dc60 0x7f36c40b1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:21.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.061+0000 7f36ca0df640 1 -- 172.21.15.7:0/3275785465 >> v1:172.21.15.55:6789/0 conn(0x7f36c406ab60 legacy=0x7f36c406af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:21.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.061+0000 7f36ca0df640 1 -- 172.21.15.7:0/3275785465 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c40b0400 con 0x7f36c40afc00 2024-04-25T10:00:21.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.061+0000 7f36ca0df640 1 --2- 172.21.15.7:0/3275785465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36c40afc00 0x7f36c40b0c00 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f36c4161520 tx=0x7f36b402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=332cadfd27f379ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:21.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.062+0000 7f36c88dc640 1 -- 172.21.15.7:0/3275785465 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b4036070 con 0x7f36c40afc00 2024-04-25T10:00:21.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.062+0000 7f36c88dc640 1 -- 172.21.15.7:0/3275785465 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b4031600 con 0x7f36c40afc00 2024-04-25T10:00:21.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.062+0000 7f36c88dc640 1 -- 172.21.15.7:0/3275785465 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b40319d0 con 0x7f36c40afc00 2024-04-25T10:00:21.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.062+0000 7f36cbb42640 1 -- 172.21.15.7:0/3275785465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36c40afc00 msgr2=0x7f36c40b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:21.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.062+0000 7f36cbb42640 1 --2- 172.21.15.7:0/3275785465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36c40afc00 0x7f36c40b0c00 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f36c4161520 tx=0x7f36b402a5d0 comp rx=0 tx=0).stop 2024-04-25T10:00:21.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.062+0000 7f36cbb42640 1 -- 172.21.15.7:0/3275785465 shutdown_connections 2024-04-25T10:00:21.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.062+0000 7f36cbb42640 1 --2- 172.21.15.7:0/3275785465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36c40afc00 0x7f36c40b0c00 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:21.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.062+0000 7f36cbb42640 1 --2- 172.21.15.7:0/3275785465 >> v2:172.21.15.55:3300/0 conn(0x7f36c415dc60 0x7f36c40b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:21.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.062+0000 7f36cbb42640 1 -- 172.21.15.7:0/3275785465 >> 172.21.15.7:0/3275785465 conn(0x7f36c40b5c30 msgr2=0x7f36c40999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:21.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.062+0000 7f36cbb42640 1 -- 172.21.15.7:0/3275785465 shutdown_connections 2024-04-25T10:00:21.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.062+0000 7f36cbb42640 1 -- 172.21.15.7:0/3275785465 wait complete. 2024-04-25T10:00:21.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.063+0000 7f36cbb42640 1 Processor -- start 2024-04-25T10:00:21.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.064+0000 7f36cbb42640 1 -- start start 2024-04-25T10:00:21.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.064+0000 7f36cbb42640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36c406ab60 0x7f36c4157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:21.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.064+0000 7f36cbb42640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36c40afc00 0x7f36c414ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:21.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.064+0000 7f36cbb42640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36c415dc60 0x7f36c4156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:21.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.064+0000 7f36cbb42640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c40b53e0 con 0x7f36c40afc00 2024-04-25T10:00:21.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.064+0000 7f36cbb42640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c40b5260 con 0x7f36c406ab60 2024-04-25T10:00:21.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.064+0000 7f36cbb42640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c40ad460 con 0x7f36c415dc60 2024-04-25T10:00:21.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.064+0000 7f36c90dd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36c40afc00 0x7f36c414ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:21.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.064+0000 7f36c90dd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36c40afc00 0x7f36c414ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38374/0 (socket says 172.21.15.7:38374) 2024-04-25T10:00:21.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.064+0000 7f36c90dd640 1 -- 172.21.15.7:0/462387102 learned_addr learned my addr 172.21.15.7:0/462387102 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:21.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.064+0000 7f36ca0df640 1 --2- 172.21.15.7:0/462387102 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36c415dc60 0x7f36c4156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:21.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.064+0000 7f36c98de640 1 --2- 172.21.15.7:0/462387102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36c406ab60 0x7f36c4157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:21.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.065+0000 7f36c90dd640 1 -- 172.21.15.7:0/462387102 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36c415dc60 msgr2=0x7f36c4156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:21.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.065+0000 7f36c90dd640 1 --2- 172.21.15.7:0/462387102 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36c415dc60 0x7f36c4156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:21.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.065+0000 7f36c90dd640 1 -- 172.21.15.7:0/462387102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36c406ab60 msgr2=0x7f36c4157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:21.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.065+0000 7f36c90dd640 1 --2- 172.21.15.7:0/462387102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36c406ab60 0x7f36c4157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:21.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.065+0000 7f36c90dd640 1 -- 172.21.15.7:0/462387102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c4158210 con 0x7f36c40afc00 2024-04-25T10:00:21.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.065+0000 7f36c90dd640 1 --2- 172.21.15.7:0/462387102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36c40afc00 0x7f36c414ec90 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f36b800c7f0 tx=0x7f36b800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:21.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.065+0000 7f36c27fc640 1 -- 172.21.15.7:0/462387102 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b8015070 con 0x7f36c40afc00 2024-04-25T10:00:21.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.065+0000 7f36c27fc640 1 -- 172.21.15.7:0/462387102 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b8004220 con 0x7f36c40afc00 2024-04-25T10:00:21.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.065+0000 7f36cbb42640 1 -- 172.21.15.7:0/462387102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c414f790 con 0x7f36c40afc00 2024-04-25T10:00:21.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.065+0000 7f36c27fc640 1 -- 172.21.15.7:0/462387102 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b8007620 con 0x7f36c40afc00 2024-04-25T10:00:21.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.065+0000 7f36cbb42640 1 -- 172.21.15.7:0/462387102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c415aa10 con 0x7f36c40afc00 2024-04-25T10:00:21.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.066+0000 7f36cbb42640 1 -- 172.21.15.7:0/462387102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c4068fd0 con 0x7f36c40afc00 2024-04-25T10:00:21.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.066+0000 7f36c27fc640 1 -- 172.21.15.7:0/462387102 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f36b80079d0 con 0x7f36c40afc00 2024-04-25T10:00:21.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.067+0000 7f36c27fc640 1 --2- 172.21.15.7:0/462387102 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f36b006b4d0 0x7f36b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:21.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.067+0000 7f36c27fc640 1 -- 172.21.15.7:0/462387102 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f36b808a410 con 0x7f36c40afc00 2024-04-25T10:00:21.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.067+0000 7f36c98de640 1 --2- 172.21.15.7:0/462387102 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f36b006b4d0 0x7f36b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:21.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.067+0000 7f36c98de640 1 --2- 172.21.15.7:0/462387102 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f36b006b4d0 0x7f36b006d990 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f36bc007fd0 tx=0x7f36bc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:21.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.071+0000 7f36c27fc640 1 -- 172.21.15.7:0/462387102 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f36b80593b0 con 0x7f36c40afc00 2024-04-25T10:00:21.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.320+0000 7f36cbb42640 1 -- 172.21.15.7:0/462387102 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]} v 0) v1 -- 0x7f36c415d480 con 0x7f36c40afc00 2024-04-25T10:00:21.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.616+0000 7f36c27fc640 1 -- 172.21.15.7:0/462387102 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]}]=0 v300) v1 ==== 166+0+0 (secure 0 0 0) 0x7f36b8058cb0 con 0x7f36c40afc00 2024-04-25T10:00:21.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.618+0000 7f36cbb42640 1 -- 172.21.15.7:0/462387102 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f36b006b4d0 msgr2=0x7f36b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:21.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.618+0000 7f36cbb42640 1 --2- 172.21.15.7:0/462387102 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f36b006b4d0 0x7f36b006d990 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f36bc007fd0 tx=0x7f36bc009040 comp rx=0 tx=0).stop 2024-04-25T10:00:21.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.618+0000 7f36cbb42640 1 -- 172.21.15.7:0/462387102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36c40afc00 msgr2=0x7f36c414ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:21.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.619+0000 7f36cbb42640 1 --2- 172.21.15.7:0/462387102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36c40afc00 0x7f36c414ec90 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f36b800c7f0 tx=0x7f36b800ccb0 comp rx=0 tx=0).stop 2024-04-25T10:00:21.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.619+0000 7f36cbb42640 1 -- 172.21.15.7:0/462387102 shutdown_connections 2024-04-25T10:00:21.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.619+0000 7f36cbb42640 1 --2- 172.21.15.7:0/462387102 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f36b006b4d0 0x7f36b006d990 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:21.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.619+0000 7f36cbb42640 1 --2- 172.21.15.7:0/462387102 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36c415dc60 0x7f36c4156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:21.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.619+0000 7f36cbb42640 1 --2- 172.21.15.7:0/462387102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36c40afc00 0x7f36c414ec90 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:21.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.619+0000 7f36cbb42640 1 --2- 172.21.15.7:0/462387102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36c406ab60 0x7f36c4157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:21.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.619+0000 7f36cbb42640 1 -- 172.21.15.7:0/462387102 >> 172.21.15.7:0/462387102 conn(0x7f36c40b5c30 msgr2=0x7f36c4073800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:21.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.619+0000 7f36cbb42640 1 -- 172.21.15.7:0/462387102 shutdown_connections 2024-04-25T10:00:21.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.619+0000 7f36cbb42640 1 -- 172.21.15.7:0/462387102 wait complete. 2024-04-25T10:00:21.634 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-04-25T10:00:21.634 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_dirfrag_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-04-25T10:00:21.634 INFO:tasks.cephfs_test_runner:test_health_status_after_dirfrag_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T10:00:21.635 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:00:21.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.732+0000 7f563dafc640 1 Processor -- start 2024-04-25T10:00:21.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.732+0000 7f563dafc640 1 -- start start 2024-04-25T10:00:21.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.733+0000 7f563dafc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f563815da60 0x7f56380d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:21.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.733+0000 7f563dafc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f563815e2a0 0x7f56380ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:21.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.733+0000 7f563dafc640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f563815e8a0 con 0x7f563815de40 2024-04-25T10:00:21.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.733+0000 7f563dafc640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f563815eb80 con 0x7f563815e2a0 2024-04-25T10:00:21.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.733+0000 7f563dafc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563815ee60 con 0x7f563815da60 2024-04-25T10:00:21.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.733+0000 7f5636ffd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f563815de40 0x7f5638161d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44948/0 (socket says 172.21.15.7:44948) 2024-04-25T10:00:21.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.733+0000 7f5636ffd640 1 -- 172.21.15.7:0/1159009515 learned_addr learned my addr 172.21.15.7:0/1159009515 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:21.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.733+0000 7f56367fc640 1 -- 172.21.15.7:0/1159009515 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1890905803 0 0) 0x7f563815e8a0 con 0x7f563815de40 2024-04-25T10:00:21.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.733+0000 7f56377fe640 1 --2- 172.21.15.7:0/1159009515 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f563815da60 0x7f56380d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:21.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.733+0000 7f56367fc640 1 -- 172.21.15.7:0/1159009515 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5620003520 con 0x7f563815de40 2024-04-25T10:00:21.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.733+0000 7f5637fff640 1 --2- 172.21.15.7:0/1159009515 >> v2:172.21.15.55:3300/0 conn(0x7f563815e2a0 0x7f56380ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:21.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.733+0000 7f56367fc640 1 -- 172.21.15.7:0/1159009515 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 94011521 0 0) 0x7f5620003520 con 0x7f563815de40 2024-04-25T10:00:21.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.733+0000 7f56367fc640 1 -- 172.21.15.7:0/1159009515 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f563815da60 msgr2=0x7f56380d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:21.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.733+0000 7f56367fc640 1 --2- 172.21.15.7:0/1159009515 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f563815da60 0x7f56380d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:21.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.733+0000 7f56367fc640 1 -- 172.21.15.7:0/1159009515 >> v2:172.21.15.55:3300/0 conn(0x7f563815e2a0 msgr2=0x7f56380ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:21.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.733+0000 7f56367fc640 1 --2- 172.21.15.7:0/1159009515 >> v2:172.21.15.55:3300/0 conn(0x7f563815e2a0 0x7f56380ce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:21.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.733+0000 7f56367fc640 1 -- 172.21.15.7:0/1159009515 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5638161850 con 0x7f563815de40 2024-04-25T10:00:21.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.733+0000 7f56367fc640 1 -- 172.21.15.7:0/1159009515 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f562c001670 con 0x7f563815de40 2024-04-25T10:00:21.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.733+0000 7f56367fc640 1 -- 172.21.15.7:0/1159009515 >> v1:172.21.15.7:6789/0 conn(0x7f563815de40 legacy=0x7f5638161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:21.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.733+0000 7f56367fc640 1 --2- 172.21.15.7:0/1159009515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56200039b0 0x7f5620003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:21.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.733+0000 7f56367fc640 1 --2- 172.21.15.7:0/1159009515 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f563815da60 0x7f5620004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:21.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.733+0000 7f56367fc640 1 --2- 172.21.15.7:0/1159009515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5620004d40 0x7f56200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:21.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.733+0000 7f56367fc640 1 -- 172.21.15.7:0/1159009515 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563815eb80 con 0x7f56200039b0 2024-04-25T10:00:21.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.733+0000 7f56367fc640 1 -- 172.21.15.7:0/1159009515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563815ee60 con 0x7f5620004d40 2024-04-25T10:00:21.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.733+0000 7f56367fc640 1 -- 172.21.15.7:0/1159009515 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f562000b9c0 con 0x7f563815da60 2024-04-25T10:00:21.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.734+0000 7f56377fe640 1 --2- 172.21.15.7:0/1159009515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56200039b0 0x7f5620003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:21.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.734+0000 7f5636ffd640 1 --2- 172.21.15.7:0/1159009515 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f563815da60 0x7f5620004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:21.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.734+0000 7f5637fff640 1 --2- 172.21.15.7:0/1159009515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5620004d40 0x7f56200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:21.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.734+0000 7f56377fe640 1 -- 172.21.15.7:0/1159009515 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f563815da60 msgr2=0x7f5620004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:21.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.734+0000 7f56377fe640 1 --2- 172.21.15.7:0/1159009515 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f563815da60 0x7f5620004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:21.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.734+0000 7f56377fe640 1 -- 172.21.15.7:0/1159009515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5620004d40 msgr2=0x7f56200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:21.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.734+0000 7f56377fe640 1 --2- 172.21.15.7:0/1159009515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5620004d40 0x7f56200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:21.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.734+0000 7f56377fe640 1 -- 172.21.15.7:0/1159009515 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5620003520 con 0x7f56200039b0 2024-04-25T10:00:21.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.734+0000 7f5637fff640 1 --2- 172.21.15.7:0/1159009515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5620004d40 0x7f56200051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:21.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.735+0000 7f56377fe640 1 --2- 172.21.15.7:0/1159009515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56200039b0 0x7f5620003dd0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f5628009ac0 tx=0x7f5620005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c0e998f34cd40d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:21.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.735+0000 7f56367fc640 1 -- 172.21.15.7:0/1159009515 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5628036070 con 0x7f56200039b0 2024-04-25T10:00:21.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.735+0000 7f56367fc640 1 -- 172.21.15.7:0/1159009515 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5628031400 con 0x7f56200039b0 2024-04-25T10:00:21.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.735+0000 7f56367fc640 1 -- 172.21.15.7:0/1159009515 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5628009690 con 0x7f56200039b0 2024-04-25T10:00:21.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.735+0000 7f563dafc640 1 -- 172.21.15.7:0/1159009515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56200039b0 msgr2=0x7f5620003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:21.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.735+0000 7f563dafc640 1 --2- 172.21.15.7:0/1159009515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56200039b0 0x7f5620003dd0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f5628009ac0 tx=0x7f5620005830 comp rx=0 tx=0).stop 2024-04-25T10:00:21.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.735+0000 7f5637fff640 1 -- 172.21.15.7:0/1159009515 reap_dead start 2024-04-25T10:00:21.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.735+0000 7f563dafc640 1 -- 172.21.15.7:0/1159009515 shutdown_connections 2024-04-25T10:00:21.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.735+0000 7f563dafc640 1 -- 172.21.15.7:0/1159009515 >> 172.21.15.7:0/1159009515 conn(0x7f563806bfe0 msgr2=0x7f563806c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:21.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.735+0000 7f563dafc640 1 -- 172.21.15.7:0/1159009515 shutdown_connections 2024-04-25T10:00:21.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.735+0000 7f563dafc640 1 -- 172.21.15.7:0/1159009515 wait complete. 2024-04-25T10:00:21.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.736+0000 7f563dafc640 1 Processor -- start 2024-04-25T10:00:21.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.737+0000 7f563dafc640 1 -- start start 2024-04-25T10:00:21.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.737+0000 7f563dafc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56200039b0 0x7f56380c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:21.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.737+0000 7f563dafc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f56380cc210 0x7f56380cc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:21.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.737+0000 7f563dafc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56380d38b0 0x7f56380d3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:21.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.737+0000 7f563dafc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56380d0c20 con 0x7f56380d38b0 2024-04-25T10:00:21.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.737+0000 7f563dafc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56380d0aa0 con 0x7f56200039b0 2024-04-25T10:00:21.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.737+0000 7f563dafc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56380d0da0 con 0x7f56380cc210 2024-04-25T10:00:21.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.738+0000 7f5637fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56380d38b0 0x7f56380d3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:21.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.738+0000 7f5637fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56380d38b0 0x7f56380d3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38398/0 (socket says 172.21.15.7:38398) 2024-04-25T10:00:21.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.738+0000 7f5637fff640 1 -- 172.21.15.7:0/3119501268 learned_addr learned my addr 172.21.15.7:0/3119501268 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:21.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.738+0000 7f56377fe640 1 --2- 172.21.15.7:0/3119501268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56200039b0 0x7f56380c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:21.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.738+0000 7f5636ffd640 1 --2- 172.21.15.7:0/3119501268 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f56380cc210 0x7f56380cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:21.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.738+0000 7f5637fff640 1 -- 172.21.15.7:0/3119501268 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f56380cc210 msgr2=0x7f56380cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:21.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.738+0000 7f5637fff640 1 --2- 172.21.15.7:0/3119501268 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f56380cc210 0x7f56380cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:21.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.738+0000 7f5637fff640 1 -- 172.21.15.7:0/3119501268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56200039b0 msgr2=0x7f56380c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:21.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.738+0000 7f5637fff640 1 --2- 172.21.15.7:0/3119501268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56200039b0 0x7f56380c94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:21.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.738+0000 7f5637fff640 1 -- 172.21.15.7:0/3119501268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56380ccdd0 con 0x7f56380d38b0 2024-04-25T10:00:21.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.738+0000 7f5636ffd640 1 --2- 172.21.15.7:0/3119501268 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f56380cc210 0x7f56380cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:21.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.738+0000 7f56377fe640 1 --2- 172.21.15.7:0/3119501268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56200039b0 0x7f56380c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:21.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.738+0000 7f5637fff640 1 --2- 172.21.15.7:0/3119501268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56380d38b0 0x7f56380d3d30 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f563815e680 tx=0x7f5630010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:21.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.738+0000 7f561ffff640 1 -- 172.21.15.7:0/3119501268 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5630010d20 con 0x7f56380d38b0 2024-04-25T10:00:21.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.738+0000 7f561ffff640 1 -- 172.21.15.7:0/3119501268 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5630003990 con 0x7f56380d38b0 2024-04-25T10:00:21.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.738+0000 7f561ffff640 1 -- 172.21.15.7:0/3119501268 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5630003dc0 con 0x7f56380d38b0 2024-04-25T10:00:21.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.738+0000 7f563dafc640 1 -- 172.21.15.7:0/3119501268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56380cd0b0 con 0x7f56380d38b0 2024-04-25T10:00:21.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.738+0000 7f563dafc640 1 -- 172.21.15.7:0/3119501268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56380cd670 con 0x7f56380d38b0 2024-04-25T10:00:21.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.739+0000 7f563dafc640 1 -- 172.21.15.7:0/3119501268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5638068fd0 con 0x7f56380d38b0 2024-04-25T10:00:21.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.740+0000 7f561ffff640 1 -- 172.21.15.7:0/3119501268 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5630005d10 con 0x7f56380d38b0 2024-04-25T10:00:21.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.740+0000 7f561ffff640 1 --2- 172.21.15.7:0/3119501268 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f562406b500 0x7f562406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:21.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.740+0000 7f561ffff640 1 -- 172.21.15.7:0/3119501268 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f563008a700 con 0x7f56380d38b0 2024-04-25T10:00:21.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.740+0000 7f56377fe640 1 --2- 172.21.15.7:0/3119501268 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f562406b500 0x7f562406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:21.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.741+0000 7f56377fe640 1 --2- 172.21.15.7:0/3119501268 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f562406b500 0x7f562406d9c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5628033000 tx=0x7f5628008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:21.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.744+0000 7f561ffff640 1 -- 172.21.15.7:0/3119501268 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5630025020 con 0x7f56380d38b0 2024-04-25T10:00:21.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.923+0000 7f563dafc640 1 -- 172.21.15.7:0/3119501268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56380d1560 con 0x7f56380d38b0 2024-04-25T10:00:21.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.924+0000 7f561ffff640 1 -- 172.21.15.7:0/3119501268 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+13326 (secure 0 0 0) 0x7f56300596a0 con 0x7f56380d38b0 2024-04-25T10:00:21.929 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:00:21.929 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":79,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:00:20.612303+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6836/3690076929":"2024-04-26T10:00:17.255232+0000","172.21.15.7:6837/3690076929":"2024-04-26T10:00:17.255232+0000","172.21.15.55:6834/1012943595":"2024-04-26T09:58:59.374192+0000","172.21.15.55:6832/1012943595":"2024-04-26T09:58:59.374192+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:00:21.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.926+0000 7f563dafc640 1 -- 172.21.15.7:0/3119501268 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f562406b500 msgr2=0x7f562406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:21.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.926+0000 7f563dafc640 1 --2- 172.21.15.7:0/3119501268 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f562406b500 0x7f562406d9c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5628033000 tx=0x7f5628008030 comp rx=0 tx=0).stop 2024-04-25T10:00:21.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.926+0000 7f563dafc640 1 -- 172.21.15.7:0/3119501268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56380d38b0 msgr2=0x7f56380d3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:21.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.926+0000 7f563dafc640 1 --2- 172.21.15.7:0/3119501268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56380d38b0 0x7f56380d3d30 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f563815e680 tx=0x7f5630010590 comp rx=0 tx=0).stop 2024-04-25T10:00:21.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.926+0000 7f563dafc640 1 -- 172.21.15.7:0/3119501268 shutdown_connections 2024-04-25T10:00:21.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.926+0000 7f563dafc640 1 --2- 172.21.15.7:0/3119501268 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f562406b500 0x7f562406d9c0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:21.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.926+0000 7f563dafc640 1 --2- 172.21.15.7:0/3119501268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56380d38b0 0x7f56380d3d30 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:21.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.926+0000 7f563dafc640 1 --2- 172.21.15.7:0/3119501268 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f56380cc210 0x7f56380cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:21.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.926+0000 7f563dafc640 1 --2- 172.21.15.7:0/3119501268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56200039b0 0x7f56380c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:21.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.926+0000 7f563dafc640 1 -- 172.21.15.7:0/3119501268 >> 172.21.15.7:0/3119501268 conn(0x7f563806bfe0 msgr2=0x7f5638161d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:21.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.926+0000 7f563dafc640 1 -- 172.21.15.7:0/3119501268 shutdown_connections 2024-04-25T10:00:21.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:21.926+0000 7f563dafc640 1 -- 172.21.15.7:0/3119501268 wait complete. 2024-04-25T10:00:21.942 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:00:21.943 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:00:22.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.042+0000 7f769e517640 1 Processor -- start 2024-04-25T10:00:22.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.042+0000 7f769e517640 1 -- start start 2024-04-25T10:00:22.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.043+0000 7f769e517640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f76980cda20 0x7f76980cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:22.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.043+0000 7f769e517640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f769809a100 0x7f769815d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:22.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.043+0000 7f769e517640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76980d02f0 con 0x7f769806bf10 2024-04-25T10:00:22.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.043+0000 7f769e517640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76980cde00 con 0x7f769809a100 2024-04-25T10:00:22.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.043+0000 7f769e517640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76980d05d0 con 0x7f76980cda20 2024-04-25T10:00:22.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.043+0000 7f769cab4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f769809a100 0x7f769815d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:22.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.043+0000 7f7697fff640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f76980cda20 0x7f76980cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:22.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.043+0000 7f76977fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f769806bf10 0x7f76980999f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:53384/0 (socket says 172.21.15.7:53384) 2024-04-25T10:00:22.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.043+0000 7f769cab4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f769809a100 0x7f769815d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:52896/0 (socket says 172.21.15.7:52896) 2024-04-25T10:00:22.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.043+0000 7f76977fe640 1 -- 172.21.15.7:0/3592608316 learned_addr learned my addr 172.21.15.7:0/3592608316 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:22.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.043+0000 7f7697fff640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f76980cda20 0x7f76980cf9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:54702/0 (socket says 172.21.15.7:54702) 2024-04-25T10:00:22.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.043+0000 7f7697fff640 1 -- 172.21.15.7:0/3592608316 >> v2:172.21.15.55:3300/0 conn(0x7f769809a100 msgr2=0x7f769815d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:22.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.043+0000 7f7697fff640 1 --2- 172.21.15.7:0/3592608316 >> v2:172.21.15.55:3300/0 conn(0x7f769809a100 0x7f769815d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:22.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.043+0000 7f7697fff640 1 -- 172.21.15.7:0/3592608316 >> v1:172.21.15.55:6789/0 conn(0x7f769806bf10 legacy=0x7f76980999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:22.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.043+0000 7f7697fff640 1 -- 172.21.15.7:0/3592608316 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76980d08b0 con 0x7f76980cda20 2024-04-25T10:00:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.044+0000 7f7697fff640 1 --2- 172.21.15.7:0/3592608316 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f76980cda20 0x7f76980cf9d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f768c0097a0 tx=0x7f768c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6179c8877ed2f9e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.044+0000 7f7696ffd640 1 -- 172.21.15.7:0/3592608316 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c037070 con 0x7f76980cda20 2024-04-25T10:00:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.044+0000 7f7696ffd640 1 -- 172.21.15.7:0/3592608316 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768c032440 con 0x7f76980cda20 2024-04-25T10:00:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.044+0000 7f7696ffd640 1 -- 172.21.15.7:0/3592608316 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c032810 con 0x7f76980cda20 2024-04-25T10:00:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.045+0000 7f769e517640 1 -- 172.21.15.7:0/3592608316 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f76980cda20 msgr2=0x7f76980cf9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.045+0000 7f769e517640 1 --2- 172.21.15.7:0/3592608316 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f76980cda20 0x7f76980cf9d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f768c0097a0 tx=0x7f768c02a180 comp rx=0 tx=0).stop 2024-04-25T10:00:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.045+0000 7f769e517640 1 -- 172.21.15.7:0/3592608316 shutdown_connections 2024-04-25T10:00:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.045+0000 7f769e517640 1 --2- 172.21.15.7:0/3592608316 >> v2:172.21.15.55:3300/0 conn(0x7f769809a100 0x7f769815d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.045+0000 7f769e517640 1 --2- 172.21.15.7:0/3592608316 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f76980cda20 0x7f76980cf9d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.045+0000 7f769e517640 1 -- 172.21.15.7:0/3592608316 >> 172.21.15.7:0/3592608316 conn(0x7f76980b3110 msgr2=0x7f76980b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:22.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.045+0000 7f769e517640 1 -- 172.21.15.7:0/3592608316 shutdown_connections 2024-04-25T10:00:22.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.045+0000 7f769e517640 1 -- 172.21.15.7:0/3592608316 wait complete. 2024-04-25T10:00:22.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.046+0000 7f769e517640 1 Processor -- start 2024-04-25T10:00:22.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.046+0000 7f769e517640 1 -- start start 2024-04-25T10:00:22.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.047+0000 7f769e517640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f769806bf10 0x7f76980b6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:22.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.047+0000 7f769e517640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f769809a100 0x7f7698155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:22.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.047+0000 7f769e517640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76980cda20 0x7f76980c7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:22.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.047+0000 7f769e517640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76980cff10 con 0x7f76980cda20 2024-04-25T10:00:22.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.047+0000 7f769e517640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76980d0e70 con 0x7f769806bf10 2024-04-25T10:00:22.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.047+0000 7f769e517640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76980d0090 con 0x7f769809a100 2024-04-25T10:00:22.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.047+0000 7f769cab4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76980cda20 0x7f76980c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:22.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.047+0000 7f769cab4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76980cda20 0x7f76980c7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38410/0 (socket says 172.21.15.7:38410) 2024-04-25T10:00:22.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.047+0000 7f769cab4640 1 -- 172.21.15.7:0/1857401084 learned_addr learned my addr 172.21.15.7:0/1857401084 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:22.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.047+0000 7f7697fff640 1 --2- 172.21.15.7:0/1857401084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f769806bf10 0x7f76980b6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:22.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.047+0000 7f76977fe640 1 --2- 172.21.15.7:0/1857401084 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f769809a100 0x7f7698155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:22.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.047+0000 7f769cab4640 1 -- 172.21.15.7:0/1857401084 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f769809a100 msgr2=0x7f7698155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:22.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.047+0000 7f769cab4640 1 --2- 172.21.15.7:0/1857401084 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f769809a100 0x7f7698155b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:22.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.047+0000 7f769cab4640 1 -- 172.21.15.7:0/1857401084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f769806bf10 msgr2=0x7f76980b6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:22.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.047+0000 7f769cab4640 1 --2- 172.21.15.7:0/1857401084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f769806bf10 0x7f76980b6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:22.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.047+0000 7f769cab4640 1 -- 172.21.15.7:0/1857401084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76980b71b0 con 0x7f76980cda20 2024-04-25T10:00:22.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.048+0000 7f769cab4640 1 --2- 172.21.15.7:0/1857401084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76980cda20 0x7f76980c7320 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f769000ef90 tx=0x7f769000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:22.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.048+0000 7f7694ff9640 1 -- 172.21.15.7:0/1857401084 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7690018020 con 0x7f76980cda20 2024-04-25T10:00:22.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.048+0000 7f7694ff9640 1 -- 172.21.15.7:0/1857401084 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7690014480 con 0x7f76980cda20 2024-04-25T10:00:22.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.048+0000 7f769e517640 1 -- 172.21.15.7:0/1857401084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7698157220 con 0x7f76980cda20 2024-04-25T10:00:22.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.048+0000 7f7694ff9640 1 -- 172.21.15.7:0/1857401084 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7690009e60 con 0x7f76980cda20 2024-04-25T10:00:22.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.048+0000 7f769e517640 1 -- 172.21.15.7:0/1857401084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76981577e0 con 0x7f76980cda20 2024-04-25T10:00:22.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.049+0000 7f769e517640 1 -- 172.21.15.7:0/1857401084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7698068f60 con 0x7f76980cda20 2024-04-25T10:00:22.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.049+0000 7f7694ff9640 1 -- 172.21.15.7:0/1857401084 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7690005d10 con 0x7f76980cda20 2024-04-25T10:00:22.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.050+0000 7f7694ff9640 1 --2- 172.21.15.7:0/1857401084 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f768406b4d0 0x7f768406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:22.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.050+0000 7f7694ff9640 1 -- 172.21.15.7:0/1857401084 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f769008ae20 con 0x7f76980cda20 2024-04-25T10:00:22.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.050+0000 7f7697fff640 1 --2- 172.21.15.7:0/1857401084 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f768406b4d0 0x7f768406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:22.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.050+0000 7f7697fff640 1 --2- 172.21.15.7:0/1857401084 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f768406b4d0 0x7f768406d990 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f768c034000 tx=0x7f768c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.054+0000 7f7694ff9640 1 -- 172.21.15.7:0/1857401084 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7690022030 con 0x7f76980cda20 2024-04-25T10:00:22.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.233+0000 7f769e517640 1 -- 172.21.15.7:0/1857401084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f76980cfa40 con 0x7f76980cda20 2024-04-25T10:00:22.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.233+0000 7f7694ff9640 1 -- 172.21.15.7:0/1857401084 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7690010040 con 0x7f76980cda20 2024-04-25T10:00:22.238 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T10:00:22.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.235+0000 7f769e517640 1 -- 172.21.15.7:0/1857401084 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f768406b4d0 msgr2=0x7f768406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:22.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.235+0000 7f769e517640 1 --2- 172.21.15.7:0/1857401084 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f768406b4d0 0x7f768406d990 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f768c034000 tx=0x7f768c02e000 comp rx=0 tx=0).stop 2024-04-25T10:00:22.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.235+0000 7f769e517640 1 -- 172.21.15.7:0/1857401084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76980cda20 msgr2=0x7f76980c7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:22.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.235+0000 7f769e517640 1 --2- 172.21.15.7:0/1857401084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76980cda20 0x7f76980c7320 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f769000ef90 tx=0x7f769000c490 comp rx=0 tx=0).stop 2024-04-25T10:00:22.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.235+0000 7f769e517640 1 -- 172.21.15.7:0/1857401084 shutdown_connections 2024-04-25T10:00:22.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.235+0000 7f769e517640 1 --2- 172.21.15.7:0/1857401084 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f768406b4d0 0x7f768406d990 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:22.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.235+0000 7f769e517640 1 --2- 172.21.15.7:0/1857401084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f76980cda20 0x7f76980c7320 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:22.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.235+0000 7f769e517640 1 --2- 172.21.15.7:0/1857401084 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f769809a100 0x7f7698155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:22.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.235+0000 7f769e517640 1 --2- 172.21.15.7:0/1857401084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f769806bf10 0x7f76980b6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:22.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.235+0000 7f769e517640 1 -- 172.21.15.7:0/1857401084 >> 172.21.15.7:0/1857401084 conn(0x7f76980b3110 msgr2=0x7f76980b0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:22.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.235+0000 7f769e517640 1 -- 172.21.15.7:0/1857401084 shutdown_connections 2024-04-25T10:00:22.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.235+0000 7f769e517640 1 -- 172.21.15.7:0/1857401084 wait complete. 2024-04-25T10:00:22.251 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair' 2024-04-25T10:00:22.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.348+0000 7f4de705d640 1 Processor -- start 2024-04-25T10:00:22.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.348+0000 7f4de705d640 1 -- start start 2024-04-25T10:00:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.349+0000 7f4de705d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4de0145240 0x7f4de015be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.349+0000 7f4de705d640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de00ce680 con 0x7f4de00b2260 2024-04-25T10:00:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.349+0000 7f4de705d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de006d6c0 con 0x7f4de00ce080 2024-04-25T10:00:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.349+0000 7f4de705d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de00a8560 con 0x7f4de0145240 2024-04-25T10:00:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.349+0000 7f4ddffff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f4de00b2260 0x7f4de00cd970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44954/0 (socket says 172.21.15.7:44954) 2024-04-25T10:00:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.349+0000 7f4ddffff640 1 -- 172.21.15.7:0/344753510 learned_addr learned my addr 172.21.15.7:0/344753510 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.349+0000 7f4de4df9640 1 --2- 172.21.15.7:0/344753510 >> v2:172.21.15.55:3300/0 conn(0x7f4de0145240 0x7f4de015be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.349+0000 7f4ddf7fe640 1 -- 172.21.15.7:0/344753510 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 309783637 0 0) 0x7f4dcc001110 con 0x7f4de00b2260 2024-04-25T10:00:22.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.349+0000 7f4ddf7fe640 1 -- 172.21.15.7:0/344753510 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dd0003520 con 0x7f4de00b2260 2024-04-25T10:00:22.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.349+0000 7f4de4df9640 1 -- 172.21.15.7:0/344753510 >> v1:172.21.15.55:6789/0 conn(0x7f4de00ce080 legacy=0x7f4de006e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:22.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.349+0000 7f4de4df9640 1 -- 172.21.15.7:0/344753510 >> v1:172.21.15.7:6789/0 conn(0x7f4de00b2260 legacy=0x7f4de00cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:22.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.350+0000 7f4de4df9640 1 -- 172.21.15.7:0/344753510 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de006d9a0 con 0x7f4de0145240 2024-04-25T10:00:22.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.350+0000 7f4de4df9640 1 --2- 172.21.15.7:0/344753510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4de0145240 0x7f4de015be40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40097a0 tx=0x7f4dd402a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e18af9154fca245 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:22.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.351+0000 7f4ddf7fe640 1 -- 172.21.15.7:0/344753510 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4037070 con 0x7f4de0145240 2024-04-25T10:00:22.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.351+0000 7f4ddf7fe640 1 -- 172.21.15.7:0/344753510 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd4032640 con 0x7f4de0145240 2024-04-25T10:00:22.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.351+0000 7f4ddf7fe640 1 -- 172.21.15.7:0/344753510 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd40329f0 con 0x7f4de0145240 2024-04-25T10:00:22.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.351+0000 7f4de705d640 1 -- 172.21.15.7:0/344753510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4de0145240 msgr2=0x7f4de015be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:22.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.351+0000 7f4de705d640 1 --2- 172.21.15.7:0/344753510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4de0145240 0x7f4de015be40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40097a0 tx=0x7f4dd402a2c0 comp rx=0 tx=0).stop 2024-04-25T10:00:22.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.351+0000 7f4de705d640 1 -- 172.21.15.7:0/344753510 shutdown_connections 2024-04-25T10:00:22.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.351+0000 7f4de705d640 1 --2- 172.21.15.7:0/344753510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4de0145240 0x7f4de015be40 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:22.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.351+0000 7f4de705d640 1 -- 172.21.15.7:0/344753510 >> 172.21.15.7:0/344753510 conn(0x7f4de00b1740 msgr2=0x7f4de00b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:22.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.351+0000 7f4de705d640 1 -- 172.21.15.7:0/344753510 shutdown_connections 2024-04-25T10:00:22.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.351+0000 7f4de705d640 1 -- 172.21.15.7:0/344753510 wait complete. 2024-04-25T10:00:22.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.352+0000 7f4de705d640 1 Processor -- start 2024-04-25T10:00:22.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.352+0000 7f4de705d640 1 -- start start 2024-04-25T10:00:22.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.353+0000 7f4de705d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4de00b2260 0x7f4de01f3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:22.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.353+0000 7f4de705d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4de00ce080 0x7f4de00c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:22.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.353+0000 7f4de705d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4de0145240 0x7f4de00c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:22.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.353+0000 7f4de705d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de006df60 con 0x7f4de00b2260 2024-04-25T10:00:22.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.353+0000 7f4de705d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de006e2d0 con 0x7f4de0145240 2024-04-25T10:00:22.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.353+0000 7f4de705d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de0145620 con 0x7f4de00ce080 2024-04-25T10:00:22.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.353+0000 7f4de4df9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4de00b2260 0x7f4de01f3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:22.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.353+0000 7f4de4df9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4de00b2260 0x7f4de01f3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38426/0 (socket says 172.21.15.7:38426) 2024-04-25T10:00:22.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.353+0000 7f4de4df9640 1 -- 172.21.15.7:0/1052713595 learned_addr learned my addr 172.21.15.7:0/1052713595 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:22.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.353+0000 7f4de55fa640 1 --2- 172.21.15.7:0/1052713595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4de0145240 0x7f4de00c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:22.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.353+0000 7f4ddffff640 1 --2- 172.21.15.7:0/1052713595 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4de00ce080 0x7f4de00c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:22.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.354+0000 7f4de4df9640 1 -- 172.21.15.7:0/1052713595 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4de00ce080 msgr2=0x7f4de00c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:22.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.354+0000 7f4de4df9640 1 --2- 172.21.15.7:0/1052713595 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4de00ce080 0x7f4de00c9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:22.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.354+0000 7f4de4df9640 1 -- 172.21.15.7:0/1052713595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4de0145240 msgr2=0x7f4de00c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:22.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.354+0000 7f4de4df9640 1 --2- 172.21.15.7:0/1052713595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4de0145240 0x7f4de00c99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:22.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.354+0000 7f4de4df9640 1 -- 172.21.15.7:0/1052713595 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de00b3950 con 0x7f4de00b2260 2024-04-25T10:00:22.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.354+0000 7f4ddffff640 1 --2- 172.21.15.7:0/1052713595 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4de00ce080 0x7f4de00c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:22.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.354+0000 7f4de4df9640 1 --2- 172.21.15.7:0/1052713595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4de00b2260 0x7f4de01f3120 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40097a0 tx=0x7f4dd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:22.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.354+0000 7f4ddd7fa640 1 -- 172.21.15.7:0/1052713595 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4037050 con 0x7f4de00b2260 2024-04-25T10:00:22.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.354+0000 7f4ddd7fa640 1 -- 172.21.15.7:0/1052713595 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd4038040 con 0x7f4de00b2260 2024-04-25T10:00:22.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.354+0000 7f4de705d640 1 -- 172.21.15.7:0/1052713595 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de00b3c30 con 0x7f4de00b2260 2024-04-25T10:00:22.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.354+0000 7f4ddd7fa640 1 -- 172.21.15.7:0/1052713595 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4004250 con 0x7f4de00b2260 2024-04-25T10:00:22.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.354+0000 7f4de705d640 1 -- 172.21.15.7:0/1052713595 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de00b41f0 con 0x7f4de00b2260 2024-04-25T10:00:22.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.355+0000 7f4de705d640 1 -- 172.21.15.7:0/1052713595 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de0068fd0 con 0x7f4de00b2260 2024-04-25T10:00:22.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.356+0000 7f4ddd7fa640 1 -- 172.21.15.7:0/1052713595 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4dd4030900 con 0x7f4de00b2260 2024-04-25T10:00:22.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.356+0000 7f4ddd7fa640 1 --2- 172.21.15.7:0/1052713595 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4dc406b4d0 0x7f4dc406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:22.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.356+0000 7f4ddd7fa640 1 -- 172.21.15.7:0/1052713595 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f4dd40aab70 con 0x7f4de00b2260 2024-04-25T10:00:22.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.356+0000 7f4ddffff640 1 --2- 172.21.15.7:0/1052713595 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4dc406b4d0 0x7f4dc406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:22.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.356+0000 7f4ddffff640 1 --2- 172.21.15.7:0/1052713595 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4dc406b4d0 0x7f4dc406d990 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc007fd0 tx=0x7f4dcc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:22.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.360+0000 7f4ddd7fa640 1 -- 172.21.15.7:0/1052713595 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4dd4079cc0 con 0x7f4de00b2260 2024-04-25T10:00:22.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.614+0000 7f4de705d640 1 -- 172.21.15.7:0/1052713595 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]} v 0) v1 -- 0x7f4de01438d0 con 0x7f4de00b2260 2024-04-25T10:00:22.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.629+0000 7f4ddd7fa640 1 -- 172.21.15.7:0/1052713595 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]}]=0 v301) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4dd40795c0 con 0x7f4de00b2260 2024-04-25T10:00:22.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.631+0000 7f4de705d640 1 -- 172.21.15.7:0/1052713595 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4dc406b4d0 msgr2=0x7f4dc406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:22.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.631+0000 7f4de705d640 1 --2- 172.21.15.7:0/1052713595 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4dc406b4d0 0x7f4dc406d990 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc007fd0 tx=0x7f4dcc009040 comp rx=0 tx=0).stop 2024-04-25T10:00:22.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.631+0000 7f4de705d640 1 -- 172.21.15.7:0/1052713595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4de00b2260 msgr2=0x7f4de01f3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:22.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.631+0000 7f4de705d640 1 --2- 172.21.15.7:0/1052713595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4de00b2260 0x7f4de01f3120 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40097a0 tx=0x7f4dd40046c0 comp rx=0 tx=0).stop 2024-04-25T10:00:22.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.631+0000 7f4de705d640 1 -- 172.21.15.7:0/1052713595 shutdown_connections 2024-04-25T10:00:22.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.631+0000 7f4de705d640 1 --2- 172.21.15.7:0/1052713595 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4dc406b4d0 0x7f4dc406d990 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:22.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.631+0000 7f4de705d640 1 --2- 172.21.15.7:0/1052713595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4de0145240 0x7f4de00c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:22.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.631+0000 7f4de705d640 1 --2- 172.21.15.7:0/1052713595 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4de00ce080 0x7f4de00c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:22.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.631+0000 7f4de705d640 1 --2- 172.21.15.7:0/1052713595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4de00b2260 0x7f4de01f3120 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:22.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.631+0000 7f4de705d640 1 -- 172.21.15.7:0/1052713595 >> 172.21.15.7:0/1052713595 conn(0x7f4de00b1740 msgr2=0x7f4de015f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:22.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.631+0000 7f4de705d640 1 -- 172.21.15.7:0/1052713595 shutdown_connections 2024-04-25T10:00:22.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.631+0000 7f4de705d640 1 -- 172.21.15.7:0/1052713595 wait complete. 2024-04-25T10:00:22.646 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T10:00:22.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.745+0000 7fc5b59d5640 1 Processor -- start 2024-04-25T10:00:22.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.746+0000 7fc5b59d5640 1 -- start start 2024-04-25T10:00:22.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.746+0000 7fc5b59d5640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc5b015db70 0x7fc5b00ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:22.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.746+0000 7fc5b59d5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc5b00cede0 0x7fc5b00d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:22.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.746+0000 7fc5b59d5640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b00d29c0 con 0x7fc5b00d21b0 2024-04-25T10:00:22.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.746+0000 7fc5b59d5640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b00b6ce0 con 0x7fc5b015db70 2024-04-25T10:00:22.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.746+0000 7fc5b59d5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b00d2f80 con 0x7fc5b00cede0 2024-04-25T10:00:22.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.746+0000 7fc5aeffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc5b015db70 0x7fc5b00ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:22.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.746+0000 7fc5af7fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc5b00d21b0 0x7fc5b006bb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44968/0 (socket says 172.21.15.7:44968) 2024-04-25T10:00:22.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.746+0000 7fc5af7fe640 1 -- 172.21.15.7:0/4199334155 learned_addr learned my addr 172.21.15.7:0/4199334155 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:22.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.746+0000 7fc5aeffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc5b015db70 0x7fc5b00ce8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38440/0 (socket says 172.21.15.7:38440) 2024-04-25T10:00:22.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.747+0000 7fc5aeffd640 1 -- 172.21.15.7:0/4199334155 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc5b00cede0 msgr2=0x7fc5b00d1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:22.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.747+0000 7fc5aeffd640 1 --2- 172.21.15.7:0/4199334155 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc5b00cede0 0x7fc5b00d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:22.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.747+0000 7fc5aeffd640 1 -- 172.21.15.7:0/4199334155 >> v1:172.21.15.7:6789/0 conn(0x7fc5b00d21b0 legacy=0x7fc5b006bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:22.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.747+0000 7fc5aeffd640 1 -- 172.21.15.7:0/4199334155 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b00d2ca0 con 0x7fc5b015db70 2024-04-25T10:00:22.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.747+0000 7fc5aeffd640 1 --2- 172.21.15.7:0/4199334155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5b015db70 0x7fc5b00ce8a0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fc5a80097a0 tx=0x7fc5a802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a8dc94c3b3cc17 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:22.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.748+0000 7fc5adffb640 1 -- 172.21.15.7:0/4199334155 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8037070 con 0x7fc5b015db70 2024-04-25T10:00:22.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.748+0000 7fc5adffb640 1 -- 172.21.15.7:0/4199334155 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a8032440 con 0x7fc5b015db70 2024-04-25T10:00:22.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.748+0000 7fc5adffb640 1 -- 172.21.15.7:0/4199334155 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8032810 con 0x7fc5b015db70 2024-04-25T10:00:22.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.748+0000 7fc5b59d5640 1 -- 172.21.15.7:0/4199334155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5b015db70 msgr2=0x7fc5b00ce8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:22.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.748+0000 7fc5b59d5640 1 --2- 172.21.15.7:0/4199334155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5b015db70 0x7fc5b00ce8a0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fc5a80097a0 tx=0x7fc5a802a180 comp rx=0 tx=0).stop 2024-04-25T10:00:22.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.748+0000 7fc5b59d5640 1 -- 172.21.15.7:0/4199334155 shutdown_connections 2024-04-25T10:00:22.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.748+0000 7fc5b59d5640 1 --2- 172.21.15.7:0/4199334155 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc5b00cede0 0x7fc5b00d1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:22.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.748+0000 7fc5b59d5640 1 --2- 172.21.15.7:0/4199334155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5b015db70 0x7fc5b00ce8a0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:22.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.748+0000 7fc5b59d5640 1 -- 172.21.15.7:0/4199334155 >> 172.21.15.7:0/4199334155 conn(0x7fc5b00b5370 msgr2=0x7fc5b00b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:22.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.748+0000 7fc5b59d5640 1 -- 172.21.15.7:0/4199334155 shutdown_connections 2024-04-25T10:00:22.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.748+0000 7fc5b59d5640 1 -- 172.21.15.7:0/4199334155 wait complete. 2024-04-25T10:00:22.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.749+0000 7fc5b59d5640 1 Processor -- start 2024-04-25T10:00:22.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.750+0000 7fc5b59d5640 1 -- start start 2024-04-25T10:00:22.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.750+0000 7fc5b59d5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5b00cede0 0x7fc5b01f3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:22.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.750+0000 7fc5b59d5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5b00d21b0 0x7fc5b014a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:22.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.750+0000 7fc5b59d5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc5b015db70 0x7fc5b014ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:22.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.750+0000 7fc5b59d5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b00cf220 con 0x7fc5b00cede0 2024-04-25T10:00:22.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.750+0000 7fc5b59d5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b00b7280 con 0x7fc5b00d21b0 2024-04-25T10:00:22.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.750+0000 7fc5b59d5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b00d2620 con 0x7fc5b015db70 2024-04-25T10:00:22.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.750+0000 7fc5aeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5b00cede0 0x7fc5b01f3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:22.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.750+0000 7fc5aeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5b00cede0 0x7fc5b01f3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38442/0 (socket says 172.21.15.7:38442) 2024-04-25T10:00:22.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.750+0000 7fc5aeffd640 1 -- 172.21.15.7:0/2370172226 learned_addr learned my addr 172.21.15.7:0/2370172226 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:22.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.750+0000 7fc5af7fe640 1 --2- 172.21.15.7:0/2370172226 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc5b015db70 0x7fc5b014ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:22.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.751+0000 7fc5ae7fc640 1 --2- 172.21.15.7:0/2370172226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5b00d21b0 0x7fc5b014a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:22.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.751+0000 7fc5aeffd640 1 -- 172.21.15.7:0/2370172226 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc5b015db70 msgr2=0x7fc5b014ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:22.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.751+0000 7fc5aeffd640 1 --2- 172.21.15.7:0/2370172226 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc5b015db70 0x7fc5b014ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:22.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.751+0000 7fc5aeffd640 1 -- 172.21.15.7:0/2370172226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5b00d21b0 msgr2=0x7fc5b014a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:22.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.751+0000 7fc5aeffd640 1 --2- 172.21.15.7:0/2370172226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5b00d21b0 0x7fc5b014a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:22.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.751+0000 7fc5aeffd640 1 -- 172.21.15.7:0/2370172226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b015b220 con 0x7fc5b00cede0 2024-04-25T10:00:22.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.751+0000 7fc5aeffd640 1 --2- 172.21.15.7:0/2370172226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5b00cede0 0x7fc5b01f3460 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8000c00 tx=0x7fc5a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:22.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.751+0000 7fc5a7fff640 1 -- 172.21.15.7:0/2370172226 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8037040 con 0x7fc5b00cede0 2024-04-25T10:00:22.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.751+0000 7fc5a7fff640 1 -- 172.21.15.7:0/2370172226 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a8042070 con 0x7fc5b00cede0 2024-04-25T10:00:22.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.751+0000 7fc5b59d5640 1 -- 172.21.15.7:0/2370172226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b015a180 con 0x7fc5b00cede0 2024-04-25T10:00:22.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.751+0000 7fc5a7fff640 1 -- 172.21.15.7:0/2370172226 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8030a70 con 0x7fc5b00cede0 2024-04-25T10:00:22.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.751+0000 7fc5b59d5640 1 -- 172.21.15.7:0/2370172226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b015aa20 con 0x7fc5b00cede0 2024-04-25T10:00:22.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.752+0000 7fc5b59d5640 1 -- 172.21.15.7:0/2370172226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b0068f60 con 0x7fc5b00cede0 2024-04-25T10:00:22.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.752+0000 7fc5a7fff640 1 -- 172.21.15.7:0/2370172226 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc5a8030c10 con 0x7fc5b00cede0 2024-04-25T10:00:22.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.753+0000 7fc5a7fff640 1 --2- 172.21.15.7:0/2370172226 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc59006b4d0 0x7fc59006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:22.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.753+0000 7fc5a7fff640 1 -- 172.21.15.7:0/2370172226 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5421+0+0 (secure 0 0 0) 0x7fc5a80aabc0 con 0x7fc5b00cede0 2024-04-25T10:00:22.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.753+0000 7fc5ae7fc640 1 --2- 172.21.15.7:0/2370172226 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc59006b4d0 0x7fc59006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:22.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.753+0000 7fc5ae7fc640 1 --2- 172.21.15.7:0/2370172226 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc59006b4d0 0x7fc59006d990 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0148710 tx=0x7fc598008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:22.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.757+0000 7fc5a7fff640 1 -- 172.21.15.7:0/2370172226 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc5a8045360 con 0x7fc5b00cede0 2024-04-25T10:00:22.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.935+0000 7fc5b59d5640 1 -- 172.21.15.7:0/2370172226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc5b00b8e10 con 0x7fc5b00cede0 2024-04-25T10:00:22.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.938+0000 7fc5a7fff640 1 -- 172.21.15.7:0/2370172226 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc5a8079b60 con 0x7fc5b00cede0 2024-04-25T10:00:22.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.940+0000 7fc5b59d5640 1 -- 172.21.15.7:0/2370172226 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc59006b4d0 msgr2=0x7fc59006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:22.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.940+0000 7fc5b59d5640 1 --2- 172.21.15.7:0/2370172226 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc59006b4d0 0x7fc59006d990 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0148710 tx=0x7fc598008040 comp rx=0 tx=0).stop 2024-04-25T10:00:22.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.940+0000 7fc5b59d5640 1 -- 172.21.15.7:0/2370172226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5b00cede0 msgr2=0x7fc5b01f3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:22.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.940+0000 7fc5b59d5640 1 --2- 172.21.15.7:0/2370172226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5b00cede0 0x7fc5b01f3460 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8000c00 tx=0x7fc5a80046c0 comp rx=0 tx=0).stop 2024-04-25T10:00:22.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.940+0000 7fc5b59d5640 1 -- 172.21.15.7:0/2370172226 shutdown_connections 2024-04-25T10:00:22.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.940+0000 7fc5b59d5640 1 --2- 172.21.15.7:0/2370172226 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc59006b4d0 0x7fc59006d990 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:22.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.940+0000 7fc5b59d5640 1 --2- 172.21.15.7:0/2370172226 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc5b015db70 0x7fc5b014ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:22.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.940+0000 7fc5b59d5640 1 --2- 172.21.15.7:0/2370172226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5b00d21b0 0x7fc5b014a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:22.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.940+0000 7fc5b59d5640 1 --2- 172.21.15.7:0/2370172226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5b00cede0 0x7fc5b01f3460 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:22.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.940+0000 7fc5b59d5640 1 -- 172.21.15.7:0/2370172226 >> 172.21.15.7:0/2370172226 conn(0x7fc5b00b5370 msgr2=0x7fc5b00b37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:22.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.940+0000 7fc5b59d5640 1 -- 172.21.15.7:0/2370172226 shutdown_connections 2024-04-25T10:00:22.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:22.940+0000 7fc5b59d5640 1 -- 172.21.15.7:0/2370172226 wait complete. 2024-04-25T10:00:22.956 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T10:00:22.956 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:00:22.997 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:00:23.039 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T10:00:23.040 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:00:23.040 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:00:23.055 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13704 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:00:23.056 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T10:00:23.056 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:00:23.098 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19023 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:00:23.098 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:00:23.098 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:00:23.114 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13704 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:00:23.115 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T10:00:23.115 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:00:23.155 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19023 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:00:23.156 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T10:00:23.156 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:00:23.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.252+0000 7f2b88293640 1 Processor -- start 2024-04-25T10:00:23.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.252+0000 7f2b88293640 1 -- start start 2024-04-25T10:00:23.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.253+0000 7f2b88293640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b800b53b0 0x7f2b800d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:23.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.253+0000 7f2b88293640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b800d1e80 con 0x7f2b800d0a50 2024-04-25T10:00:23.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.253+0000 7f2b88293640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b800b5930 con 0x7f2b8015db00 2024-04-25T10:00:23.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.253+0000 7f2b88293640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b800b5c10 con 0x7f2b800b53b0 2024-04-25T10:00:23.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.253+0000 7f2b8582e640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2b800d0a50 0x7f2b800d2330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44972/0 (socket says 172.21.15.7:44972) 2024-04-25T10:00:23.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.253+0000 7f2b8582e640 1 -- 172.21.15.7:0/2548291015 learned_addr learned my addr 172.21.15.7:0/2548291015 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:23.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.253+0000 7f2b86830640 1 --2- 172.21.15.7:0/2548291015 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b800b53b0 0x7f2b800d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:23.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.253+0000 7f2b8502d640 1 -- 172.21.15.7:0/2548291015 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3365406442 0 0) 0x7f2b800d1e80 con 0x7f2b800d0a50 2024-04-25T10:00:23.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.253+0000 7f2b8502d640 1 -- 172.21.15.7:0/2548291015 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b68003520 con 0x7f2b800d0a50 2024-04-25T10:00:23.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.254+0000 7f2b8502d640 1 -- 172.21.15.7:0/2548291015 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3463258329 0 0) 0x7f2b68003520 con 0x7f2b800d0a50 2024-04-25T10:00:23.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.254+0000 7f2b8502d640 1 -- 172.21.15.7:0/2548291015 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b800b53b0 msgr2=0x7f2b800d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:23.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.254+0000 7f2b8502d640 1 --2- 172.21.15.7:0/2548291015 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b800b53b0 0x7f2b800d2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:23.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.254+0000 7f2b8502d640 1 -- 172.21.15.7:0/2548291015 >> v1:172.21.15.55:6789/0 conn(0x7f2b8015db00 legacy=0x7f2b800d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:23.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.254+0000 7f2b8502d640 1 -- 172.21.15.7:0/2548291015 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b800b5ef0 con 0x7f2b800d0a50 2024-04-25T10:00:23.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.254+0000 7f2b8502d640 1 -- 172.21.15.7:0/2548291015 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f2b74001670 con 0x7f2b800d0a50 2024-04-25T10:00:23.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.254+0000 7f2b8502d640 1 -- 172.21.15.7:0/2548291015 >> v1:172.21.15.7:6789/0 conn(0x7f2b800d0a50 legacy=0x7f2b800d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:23.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.254+0000 7f2b8502d640 1 --2- 172.21.15.7:0/2548291015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b680039e0 0x7f2b68003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:23.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.254+0000 7f2b8502d640 1 --2- 172.21.15.7:0/2548291015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b68004390 0x7f2b68004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:23.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.254+0000 7f2b8502d640 1 --2- 172.21.15.7:0/2548291015 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b68005060 0x7f2b6800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:23.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.254+0000 7f2b8502d640 1 -- 172.21.15.7:0/2548291015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b800b5c10 con 0x7f2b680039e0 2024-04-25T10:00:23.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.254+0000 7f2b8502d640 1 -- 172.21.15.7:0/2548291015 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6800bf30 con 0x7f2b68004390 2024-04-25T10:00:23.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.254+0000 7f2b8502d640 1 -- 172.21.15.7:0/2548291015 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6800c130 con 0x7f2b68005060 2024-04-25T10:00:23.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.254+0000 7f2b86830640 1 --2- 172.21.15.7:0/2548291015 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b800b53b0 0x7f2b800d2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:00:23.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.254+0000 7f2b8602f640 1 --2- 172.21.15.7:0/2548291015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b680039e0 0x7f2b68003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:23.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.254+0000 7f2b8582e640 1 --2- 172.21.15.7:0/2548291015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b68004390 0x7f2b68004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:23.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.254+0000 7f2b86830640 1 --2- 172.21.15.7:0/2548291015 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b68005060 0x7f2b6800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:23.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.254+0000 7f2b8602f640 1 -- 172.21.15.7:0/2548291015 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b68005060 msgr2=0x7f2b6800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:23.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.254+0000 7f2b8602f640 1 --2- 172.21.15.7:0/2548291015 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b68005060 0x7f2b6800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:23.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.254+0000 7f2b8602f640 1 -- 172.21.15.7:0/2548291015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b68004390 msgr2=0x7f2b68004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:23.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.254+0000 7f2b8602f640 1 --2- 172.21.15.7:0/2548291015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b68004390 0x7f2b68004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:23.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.254+0000 7f2b8602f640 1 -- 172.21.15.7:0/2548291015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b68003520 con 0x7f2b680039e0 2024-04-25T10:00:23.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.254+0000 7f2b8582e640 1 --2- 172.21.15.7:0/2548291015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b68004390 0x7f2b68004860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:23.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.255+0000 7f2b8602f640 1 --2- 172.21.15.7:0/2548291015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b680039e0 0x7f2b68003dc0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f2b70001f60 tx=0x7f2b68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53127e3bf9f28d27 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:23.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.255+0000 7f2b8502d640 1 -- 172.21.15.7:0/2548291015 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b70001b30 con 0x7f2b680039e0 2024-04-25T10:00:23.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.255+0000 7f2b8502d640 1 -- 172.21.15.7:0/2548291015 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b70031620 con 0x7f2b680039e0 2024-04-25T10:00:23.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.255+0000 7f2b8502d640 1 -- 172.21.15.7:0/2548291015 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b70031a10 con 0x7f2b680039e0 2024-04-25T10:00:23.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.255+0000 7f2b88293640 1 -- 172.21.15.7:0/2548291015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b680039e0 msgr2=0x7f2b68003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:23.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.255+0000 7f2b88293640 1 --2- 172.21.15.7:0/2548291015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b680039e0 0x7f2b68003dc0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f2b70001f60 tx=0x7f2b68005830 comp rx=0 tx=0).stop 2024-04-25T10:00:23.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.255+0000 7f2b86830640 1 -- 172.21.15.7:0/2548291015 reap_dead start 2024-04-25T10:00:23.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.256+0000 7f2b88293640 1 -- 172.21.15.7:0/2548291015 shutdown_connections 2024-04-25T10:00:23.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.256+0000 7f2b88293640 1 -- 172.21.15.7:0/2548291015 >> 172.21.15.7:0/2548291015 conn(0x7f2b80072290 msgr2=0x7f2b800726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:23.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.256+0000 7f2b88293640 1 -- 172.21.15.7:0/2548291015 shutdown_connections 2024-04-25T10:00:23.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.256+0000 7f2b88293640 1 -- 172.21.15.7:0/2548291015 wait complete. 2024-04-25T10:00:23.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.257+0000 7f2b88293640 1 Processor -- start 2024-04-25T10:00:23.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.257+0000 7f2b88293640 1 -- start start 2024-04-25T10:00:23.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.257+0000 7f2b88293640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b680039e0 0x7f2b80160440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:23.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.257+0000 7f2b88293640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b800cd5d0 0x7f2b80140920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:23.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.257+0000 7f2b88293640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b800cda30 0x7f2b80140e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:23.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.257+0000 7f2b88293640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b800d3660 con 0x7f2b800cda30 2024-04-25T10:00:23.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.257+0000 7f2b88293640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b800b61d0 con 0x7f2b680039e0 2024-04-25T10:00:23.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.257+0000 7f2b88293640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b800ce2b0 con 0x7f2b800cd5d0 2024-04-25T10:00:23.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.258+0000 7f2b86830640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b800cda30 0x7f2b80140e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:23.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.258+0000 7f2b86830640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b800cda30 0x7f2b80140e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38462/0 (socket says 172.21.15.7:38462) 2024-04-25T10:00:23.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.258+0000 7f2b86830640 1 -- 172.21.15.7:0/2365890079 learned_addr learned my addr 172.21.15.7:0/2365890079 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:23.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.258+0000 7f2b8602f640 1 --2- 172.21.15.7:0/2365890079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b680039e0 0x7f2b80160440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:23.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.258+0000 7f2b8582e640 1 --2- 172.21.15.7:0/2365890079 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b800cd5d0 0x7f2b80140920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:23.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.258+0000 7f2b86830640 1 -- 172.21.15.7:0/2365890079 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b800cd5d0 msgr2=0x7f2b80140920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:23.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.258+0000 7f2b86830640 1 --2- 172.21.15.7:0/2365890079 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b800cd5d0 0x7f2b80140920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:23.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.258+0000 7f2b86830640 1 -- 172.21.15.7:0/2365890079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b680039e0 msgr2=0x7f2b80160440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:23.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.258+0000 7f2b86830640 1 --2- 172.21.15.7:0/2365890079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b680039e0 0x7f2b80160440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:23.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.258+0000 7f2b86830640 1 -- 172.21.15.7:0/2365890079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b80153fa0 con 0x7f2b800cda30 2024-04-25T10:00:23.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.258+0000 7f2b86830640 1 --2- 172.21.15.7:0/2365890079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b800cda30 0x7f2b80140e60 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f2b800b5860 tx=0x7f2b78011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:23.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.258+0000 7f2b7effd640 1 -- 172.21.15.7:0/2365890079 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b78004440 con 0x7f2b800cda30 2024-04-25T10:00:23.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.258+0000 7f2b7effd640 1 -- 172.21.15.7:0/2365890079 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7801c070 con 0x7f2b800cda30 2024-04-25T10:00:23.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.258+0000 7f2b88293640 1 -- 172.21.15.7:0/2365890079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b8015fc80 con 0x7f2b800cda30 2024-04-25T10:00:23.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.258+0000 7f2b7effd640 1 -- 172.21.15.7:0/2365890079 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b78003850 con 0x7f2b800cda30 2024-04-25T10:00:23.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.258+0000 7f2b88293640 1 -- 172.21.15.7:0/2365890079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b80153cc0 con 0x7f2b800cda30 2024-04-25T10:00:23.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.259+0000 7f2b88293640 1 -- 172.21.15.7:0/2365890079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b80068fd0 con 0x7f2b800cda30 2024-04-25T10:00:23.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.260+0000 7f2b7effd640 1 -- 172.21.15.7:0/2365890079 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2b780039f0 con 0x7f2b800cda30 2024-04-25T10:00:23.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.260+0000 7f2b7effd640 1 --2- 172.21.15.7:0/2365890079 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2b6c06b500 0x7f2b6c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:23.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.260+0000 7f2b8602f640 1 --2- 172.21.15.7:0/2365890079 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2b6c06b500 0x7f2b6c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:23.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.260+0000 7f2b7effd640 1 -- 172.21.15.7:0/2365890079 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f2b78089ae0 con 0x7f2b800cda30 2024-04-25T10:00:23.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.261+0000 7f2b8602f640 1 --2- 172.21.15.7:0/2365890079 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2b6c06b500 0x7f2b6c06d9c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f2b70034000 tx=0x7f2b7002f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:23.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.265+0000 7f2b7effd640 1 -- 172.21.15.7:0/2365890079 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2b78025020 con 0x7f2b800cda30 2024-04-25T10:00:23.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.483+0000 7f2b88293640 1 -- 172.21.15.7:0/2365890079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b800d16b0 con 0x7f2b800cda30 2024-04-25T10:00:23.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.484+0000 7f2b7effd640 1 -- 172.21.15.7:0/2365890079 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+3693 (secure 0 0 0) 0x7f2b780584c0 con 0x7f2b800cda30 2024-04-25T10:00:23.488 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:00:23.488 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":47,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1781470369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1781470369},{"type":"v1","addr":"172.21.15.55:6835","nonce":1781470369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":6442,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1406578404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1406578404},{"type":"v1","addr":"172.21.15.55:6834","nonce":1406578404}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6810,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1839614891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1839614891},{"type":"v1","addr":"172.21.15.7:6835","nonce":1839614891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":7461,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/4164341791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":4164341791},{"type":"v1","addr":"172.21.15.7:6837","nonce":4164341791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[]} 2024-04-25T10:00:23.489 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 47 2024-04-25T10:00:23.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.485+0000 7f2b88293640 1 -- 172.21.15.7:0/2365890079 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2b6c06b500 msgr2=0x7f2b6c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:23.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.485+0000 7f2b88293640 1 --2- 172.21.15.7:0/2365890079 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2b6c06b500 0x7f2b6c06d9c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f2b70034000 tx=0x7f2b7002f000 comp rx=0 tx=0).stop 2024-04-25T10:00:23.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.485+0000 7f2b88293640 1 -- 172.21.15.7:0/2365890079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b800cda30 msgr2=0x7f2b80140e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:23.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.485+0000 7f2b88293640 1 --2- 172.21.15.7:0/2365890079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b800cda30 0x7f2b80140e60 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f2b800b5860 tx=0x7f2b78011a80 comp rx=0 tx=0).stop 2024-04-25T10:00:23.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.485+0000 7f2b88293640 1 -- 172.21.15.7:0/2365890079 shutdown_connections 2024-04-25T10:00:23.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.485+0000 7f2b88293640 1 --2- 172.21.15.7:0/2365890079 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2b6c06b500 0x7f2b6c06d9c0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:23.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.485+0000 7f2b88293640 1 --2- 172.21.15.7:0/2365890079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b800cda30 0x7f2b80140e60 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:23.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.485+0000 7f2b88293640 1 --2- 172.21.15.7:0/2365890079 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b800cd5d0 0x7f2b80140920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:23.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.485+0000 7f2b88293640 1 --2- 172.21.15.7:0/2365890079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b680039e0 0x7f2b80160440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:23.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.485+0000 7f2b88293640 1 -- 172.21.15.7:0/2365890079 >> 172.21.15.7:0/2365890079 conn(0x7f2b80072290 msgr2=0x7f2b800c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:23.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.486+0000 7f2b88293640 1 -- 172.21.15.7:0/2365890079 shutdown_connections 2024-04-25T10:00:23.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:23.486+0000 7f2b88293640 1 -- 172.21.15.7:0/2365890079 wait complete. 2024-04-25T10:00:23.501 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T10:00:23.501 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T10:00:23.501 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T10:00:23.501 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:00:23.502 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T10:00:23.502 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T10:00:23.502 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T10:00:23.502 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:00:23.502 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T10:00:23.502 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T10:00:23.502 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T10:00:23.503 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:00:23.503 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T10:00:23.503 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T10:00:23.503 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T10:00:23.503 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:00:23.511 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T10:00:23.512 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T10:00:23.519 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T10:00:23.519 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T10:00:23.520 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T10:00:23.520 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T10:00:23.554 INFO:tasks.ceph.mds.c:Started 2024-04-25T10:00:23.555 DEBUG:teuthology.parallel:result is None 2024-04-25T10:00:23.561 INFO:tasks.ceph.mds.b:Started 2024-04-25T10:00:23.561 DEBUG:teuthology.parallel:result is None 2024-04-25T10:00:23.562 INFO:tasks.ceph.mds.d:Started 2024-04-25T10:00:23.562 DEBUG:teuthology.parallel:result is None 2024-04-25T10:00:23.627 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-04-25T10:00:23.652 INFO:tasks.ceph.mds.b.smithi055.stdout:starting mds.b at 2024-04-25T10:00:23.652 INFO:tasks.ceph.mds.d.smithi055.stdout:starting mds.d at 2024-04-25T10:00:26.875 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:00:26.879 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:00:29.511 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T10:00:29.512 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T10:00:29.515 INFO:tasks.ceph.mds.a:Started 2024-04-25T10:00:29.515 DEBUG:teuthology.parallel:result is None 2024-04-25T10:00:29.516 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T10:00:29.600 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-04-25T10:00:29.625 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-04-25T10:00:29.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.626+0000 7f05bf953640 1 Processor -- start 2024-04-25T10:00:29.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.627+0000 7f05bf953640 1 -- start start 2024-04-25T10:00:29.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.627+0000 7f05bf953640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05b815de30 0x7f05b815e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:29.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.627+0000 7f05bf953640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f05b80d0280 0x7f05b80d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:29.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.627+0000 7f05bf953640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05b80ce2b0 con 0x7f05b815da50 2024-04-25T10:00:29.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.627+0000 7f05bf953640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b80cf1a0 con 0x7f05b80d0280 2024-04-25T10:00:29.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.627+0000 7f05bf953640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b80d0c50 con 0x7f05b815de30 2024-04-25T10:00:29.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.628+0000 7f05bdef0640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f05b80d0280 0x7f05b80d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:29.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.628+0000 7f05bd6ef640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f05b815da50 0x7f05b80cea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44978/0 (socket says 172.21.15.7:44978) 2024-04-25T10:00:29.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.628+0000 7f05bdef0640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f05b80d0280 0x7f05b80d0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38518/0 (socket says 172.21.15.7:38518) 2024-04-25T10:00:29.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.628+0000 7f05bd6ef640 1 -- 172.21.15.7:0/3748545853 learned_addr learned my addr 172.21.15.7:0/3748545853 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:29.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.628+0000 7f05bceee640 1 --2- 172.21.15.7:0/3748545853 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05b815de30 0x7f05b815e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:29.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.628+0000 7f05bdef0640 1 -- 172.21.15.7:0/3748545853 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05b815de30 msgr2=0x7f05b815e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:29.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.628+0000 7f05bdef0640 1 --2- 172.21.15.7:0/3748545853 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05b815de30 0x7f05b815e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:29.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.628+0000 7f05bdef0640 1 -- 172.21.15.7:0/3748545853 >> v1:172.21.15.7:6789/0 conn(0x7f05b815da50 legacy=0x7f05b80cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:29.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.628+0000 7f05affff640 1 -- 172.21.15.7:0/3748545853 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 328293797 0 0) 0x7f05b80ce2b0 con 0x7f05b815da50 2024-04-25T10:00:29.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.628+0000 7f05bdef0640 1 -- 172.21.15.7:0/3748545853 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b815e960 con 0x7f05b80d0280 2024-04-25T10:00:29.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.628+0000 7f05bceee640 1 --2- 172.21.15.7:0/3748545853 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05b815de30 0x7f05b815e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:29.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.629+0000 7f05bdef0640 1 --2- 172.21.15.7:0/3748545853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b80d0280 0x7f05b80d0710 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f05b0009d90 tx=0x7f05b002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36af53730662b3a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:29.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.629+0000 7f05affff640 1 -- 172.21.15.7:0/3748545853 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b0007740 con 0x7f05b80d0280 2024-04-25T10:00:29.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.629+0000 7f05affff640 1 -- 172.21.15.7:0/3748545853 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b00078e0 con 0x7f05b80d0280 2024-04-25T10:00:29.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.629+0000 7f05affff640 1 -- 172.21.15.7:0/3748545853 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b0007cb0 con 0x7f05b80d0280 2024-04-25T10:00:29.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.629+0000 7f05bf953640 1 -- 172.21.15.7:0/3748545853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b80d0280 msgr2=0x7f05b80d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:29.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.629+0000 7f05bf953640 1 --2- 172.21.15.7:0/3748545853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b80d0280 0x7f05b80d0710 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f05b0009d90 tx=0x7f05b002a660 comp rx=0 tx=0).stop 2024-04-25T10:00:29.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.629+0000 7f05bf953640 1 -- 172.21.15.7:0/3748545853 shutdown_connections 2024-04-25T10:00:29.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.629+0000 7f05bf953640 1 --2- 172.21.15.7:0/3748545853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b80d0280 0x7f05b80d0710 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:29.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.629+0000 7f05bf953640 1 --2- 172.21.15.7:0/3748545853 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05b815de30 0x7f05b815e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:29.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.629+0000 7f05bf953640 1 -- 172.21.15.7:0/3748545853 >> 172.21.15.7:0/3748545853 conn(0x7f05b8072290 msgr2=0x7f05b8072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:29.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.629+0000 7f05bf953640 1 -- 172.21.15.7:0/3748545853 shutdown_connections 2024-04-25T10:00:29.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.630+0000 7f05bf953640 1 -- 172.21.15.7:0/3748545853 wait complete. 2024-04-25T10:00:29.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.631+0000 7f05bf953640 1 Processor -- start 2024-04-25T10:00:29.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.631+0000 7f05bf953640 1 -- start start 2024-04-25T10:00:29.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.631+0000 7f05bf953640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05b80d0280 0x7f05b80ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:29.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.631+0000 7f05bf953640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05b815da50 0x7f05b80b82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:29.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.631+0000 7f05bf953640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b815de30 0x7f05b80b87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:29.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.631+0000 7f05bf953640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b8161640 con 0x7f05b815de30 2024-04-25T10:00:29.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.631+0000 7f05bf953640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b80ce570 con 0x7f05b80d0280 2024-04-25T10:00:29.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.631+0000 7f05bf953640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b81617c0 con 0x7f05b815da50 2024-04-25T10:00:29.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.632+0000 7f05bdef0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b815de30 0x7f05b80b87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:29.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.632+0000 7f05bdef0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b815de30 0x7f05b80b87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38520/0 (socket says 172.21.15.7:38520) 2024-04-25T10:00:29.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.632+0000 7f05bdef0640 1 -- 172.21.15.7:0/3339796150 learned_addr learned my addr 172.21.15.7:0/3339796150 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:29.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.632+0000 7f05bceee640 1 --2- 172.21.15.7:0/3339796150 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05b815da50 0x7f05b80b82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:29.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.632+0000 7f05bd6ef640 1 --2- 172.21.15.7:0/3339796150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05b80d0280 0x7f05b80ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:29.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.632+0000 7f05bdef0640 1 -- 172.21.15.7:0/3339796150 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05b815da50 msgr2=0x7f05b80b82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:29.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.632+0000 7f05bdef0640 1 --2- 172.21.15.7:0/3339796150 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05b815da50 0x7f05b80b82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:29.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.632+0000 7f05bdef0640 1 -- 172.21.15.7:0/3339796150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05b80d0280 msgr2=0x7f05b80ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:29.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.632+0000 7f05bdef0640 1 --2- 172.21.15.7:0/3339796150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05b80d0280 0x7f05b80ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:29.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.632+0000 7f05bdef0640 1 -- 172.21.15.7:0/3339796150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b80cd630 con 0x7f05b815de30 2024-04-25T10:00:29.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.632+0000 7f05bd6ef640 1 --2- 172.21.15.7:0/3339796150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05b80d0280 0x7f05b80ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:29.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.632+0000 7f05bdef0640 1 --2- 172.21.15.7:0/3339796150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b815de30 0x7f05b80b87e0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f05b0009eb0 tx=0x7f05b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:29.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.632+0000 7f05adffb640 1 -- 172.21.15.7:0/3339796150 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b0040070 con 0x7f05b815de30 2024-04-25T10:00:29.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.632+0000 7f05adffb640 1 -- 172.21.15.7:0/3339796150 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b0031bc0 con 0x7f05b815de30 2024-04-25T10:00:29.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.632+0000 7f05bf953640 1 -- 172.21.15.7:0/3339796150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b80cd910 con 0x7f05b815de30 2024-04-25T10:00:29.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.632+0000 7f05adffb640 1 -- 172.21.15.7:0/3339796150 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b0045460 con 0x7f05b815de30 2024-04-25T10:00:29.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.633+0000 7f05bf953640 1 -- 172.21.15.7:0/3339796150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b80cded0 con 0x7f05b815de30 2024-04-25T10:00:29.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.634+0000 7f05bf953640 1 -- 172.21.15.7:0/3339796150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b8068fd0 con 0x7f05b815de30 2024-04-25T10:00:29.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.634+0000 7f05adffb640 1 -- 172.21.15.7:0/3339796150 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f05b0039040 con 0x7f05b815de30 2024-04-25T10:00:29.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.635+0000 7f05adffb640 1 --2- 172.21.15.7:0/3339796150 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f059c06b4d0 0x7f059c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:29.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.635+0000 7f05adffb640 1 -- 172.21.15.7:0/3339796150 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f05b00aba60 con 0x7f05b815de30 2024-04-25T10:00:29.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.635+0000 7f05bd6ef640 1 --2- 172.21.15.7:0/3339796150 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f059c06b4d0 0x7f059c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:29.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.635+0000 7f05bd6ef640 1 --2- 172.21.15.7:0/3339796150 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f059c06b4d0 0x7f059c06d990 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f05b4000f60 tx=0x7f05b4007c10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:29.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.639+0000 7f05adffb640 1 -- 172.21.15.7:0/3339796150 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f05b007a960 con 0x7f05b815de30 2024-04-25T10:00:29.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:29.832+0000 7f05bf953640 1 -- 172.21.15.7:0/3339796150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f05b80d1610 con 0x7f05b815de30 2024-04-25T10:00:30.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.661+0000 7f05adffb640 1 -- 172.21.15.7:0/3339796150 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v84) v1 ==== 97+0+0 (secure 0 0 0) 0x7f05b007a260 con 0x7f05b815de30 2024-04-25T10:00:30.666 INFO:teuthology.orchestra.run.smithi007.stderr: removed all blocklist entries 2024-04-25T10:00:30.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.664+0000 7f05bf953640 1 -- 172.21.15.7:0/3339796150 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f059c06b4d0 msgr2=0x7f059c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:30.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.664+0000 7f05bf953640 1 --2- 172.21.15.7:0/3339796150 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f059c06b4d0 0x7f059c06d990 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f05b4000f60 tx=0x7f05b4007c10 comp rx=0 tx=0).stop 2024-04-25T10:00:30.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.664+0000 7f05bf953640 1 -- 172.21.15.7:0/3339796150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b815de30 msgr2=0x7f05b80b87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:30.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.664+0000 7f05bf953640 1 --2- 172.21.15.7:0/3339796150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b815de30 0x7f05b80b87e0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f05b0009eb0 tx=0x7f05b0004a40 comp rx=0 tx=0).stop 2024-04-25T10:00:30.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.664+0000 7f05bf953640 1 -- 172.21.15.7:0/3339796150 shutdown_connections 2024-04-25T10:00:30.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.664+0000 7f05bf953640 1 --2- 172.21.15.7:0/3339796150 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f059c06b4d0 0x7f059c06d990 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:30.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.664+0000 7f05bf953640 1 --2- 172.21.15.7:0/3339796150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b815de30 0x7f05b80b87e0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:30.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.664+0000 7f05bf953640 1 --2- 172.21.15.7:0/3339796150 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05b815da50 0x7f05b80b82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:30.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.664+0000 7f05bf953640 1 --2- 172.21.15.7:0/3339796150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05b80d0280 0x7f05b80ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:30.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.664+0000 7f05bf953640 1 -- 172.21.15.7:0/3339796150 >> 172.21.15.7:0/3339796150 conn(0x7f05b8072290 msgr2=0x7f05b815c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:30.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.664+0000 7f05bf953640 1 -- 172.21.15.7:0/3339796150 shutdown_connections 2024-04-25T10:00:30.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.664+0000 7f05bf953640 1 -- 172.21.15.7:0/3339796150 wait complete. 2024-04-25T10:00:30.682 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T10:00:30.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.785+0000 7f0cfc09a640 1 Processor -- start 2024-04-25T10:00:30.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.785+0000 7f0cfc09a640 1 -- start start 2024-04-25T10:00:30.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.786+0000 7f0cfc09a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0cf415da60 0x7f0cf40d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:30.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.786+0000 7f0cfc09a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0cf415de40 0x7f0cf4161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:30.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.786+0000 7f0cfc09a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf415e8a0 con 0x7f0cf41622b0 2024-04-25T10:00:30.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.786+0000 7f0cfc09a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf415eb80 con 0x7f0cf415de40 2024-04-25T10:00:30.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.786+0000 7f0cfc09a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf415ee60 con 0x7f0cf415da60 2024-04-25T10:00:30.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.786+0000 7f0cf9635640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0cf415de40 0x7f0cf4161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:30.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.786+0000 7f0cf9635640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0cf415de40 0x7f0cf4161d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51002/0 (socket says 172.21.15.7:51002) 2024-04-25T10:00:30.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.786+0000 7f0cf9635640 1 -- 172.21.15.7:0/2265569510 learned_addr learned my addr 172.21.15.7:0/2265569510 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:30.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.786+0000 7f0cf9e36640 1 --2- 172.21.15.7:0/2265569510 >> v2:172.21.15.55:3300/0 conn(0x7f0cf415da60 0x7f0cf40d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:30.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.786+0000 7f0cf9635640 1 -- 172.21.15.7:0/2265569510 >> v2:172.21.15.55:3300/0 conn(0x7f0cf415da60 msgr2=0x7f0cf40d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:30.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.786+0000 7f0cf9635640 1 --2- 172.21.15.7:0/2265569510 >> v2:172.21.15.55:3300/0 conn(0x7f0cf415da60 0x7f0cf40d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:30.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.786+0000 7f0cf9635640 1 -- 172.21.15.7:0/2265569510 >> v1:172.21.15.7:6789/0 conn(0x7f0cf41622b0 legacy=0x7f0cf40ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:30.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.787+0000 7f0cf9635640 1 -- 172.21.15.7:0/2265569510 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf4161850 con 0x7f0cf415de40 2024-04-25T10:00:30.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.787+0000 7f0cf8e34640 1 -- 172.21.15.7:0/2265569510 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1209890175 0 0) 0x7f0cf415e8a0 con 0x7f0cf41622b0 2024-04-25T10:00:30.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.787+0000 7f0cf9635640 1 --2- 172.21.15.7:0/2265569510 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cf415de40 0x7f0cf4161d70 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f0cf406db00 tx=0x7f0ce402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d5b3aeb0b869ee0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:30.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.787+0000 7f0cf8e34640 1 -- 172.21.15.7:0/2265569510 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4037070 con 0x7f0cf415de40 2024-04-25T10:00:30.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.787+0000 7f0cf8e34640 1 -- 172.21.15.7:0/2265569510 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce4032440 con 0x7f0cf415de40 2024-04-25T10:00:30.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.787+0000 7f0cf8e34640 1 -- 172.21.15.7:0/2265569510 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4032810 con 0x7f0cf415de40 2024-04-25T10:00:30.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.788+0000 7f0cfc09a640 1 -- 172.21.15.7:0/2265569510 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cf415de40 msgr2=0x7f0cf4161d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:30.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.788+0000 7f0cfc09a640 1 --2- 172.21.15.7:0/2265569510 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cf415de40 0x7f0cf4161d70 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f0cf406db00 tx=0x7f0ce402a1e0 comp rx=0 tx=0).stop 2024-04-25T10:00:30.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.788+0000 7f0cfc09a640 1 -- 172.21.15.7:0/2265569510 shutdown_connections 2024-04-25T10:00:30.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.788+0000 7f0cfc09a640 1 --2- 172.21.15.7:0/2265569510 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cf415de40 0x7f0cf4161d70 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:30.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.788+0000 7f0cfc09a640 1 --2- 172.21.15.7:0/2265569510 >> v2:172.21.15.55:3300/0 conn(0x7f0cf415da60 0x7f0cf40d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:30.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.788+0000 7f0cfc09a640 1 -- 172.21.15.7:0/2265569510 >> 172.21.15.7:0/2265569510 conn(0x7f0cf406bfe0 msgr2=0x7f0cf406c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:30.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.788+0000 7f0cfc09a640 1 -- 172.21.15.7:0/2265569510 shutdown_connections 2024-04-25T10:00:30.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.788+0000 7f0cfc09a640 1 -- 172.21.15.7:0/2265569510 wait complete. 2024-04-25T10:00:30.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.789+0000 7f0cfc09a640 1 Processor -- start 2024-04-25T10:00:30.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.789+0000 7f0cfc09a640 1 -- start start 2024-04-25T10:00:30.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.790+0000 7f0cfc09a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cf415da60 0x7f0cf40c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:30.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.790+0000 7f0cfc09a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf415de40 0x7f0cf41f4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:30.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.790+0000 7f0cfc09a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0cf41622b0 0x7f0cf40cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:30.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.790+0000 7f0cfc09a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf415e2d0 con 0x7f0cf415da60 2024-04-25T10:00:30.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.790+0000 7f0cfc09a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf40cee40 con 0x7f0cf415de40 2024-04-25T10:00:30.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.790+0000 7f0cfc09a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf415e450 con 0x7f0cf41622b0 2024-04-25T10:00:30.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.790+0000 7f0cf9e36640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cf415da60 0x7f0cf40c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:30.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.790+0000 7f0cf9e36640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cf415da60 0x7f0cf40c9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51018/0 (socket says 172.21.15.7:51018) 2024-04-25T10:00:30.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.790+0000 7f0cf9e36640 1 -- 172.21.15.7:0/2630052693 learned_addr learned my addr 172.21.15.7:0/2630052693 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:30.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.790+0000 7f0cfa637640 1 --2- 172.21.15.7:0/2630052693 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0cf41622b0 0x7f0cf40cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:30.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.790+0000 7f0cf9635640 1 --2- 172.21.15.7:0/2630052693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf415de40 0x7f0cf41f4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:30.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.790+0000 7f0cf9e36640 1 -- 172.21.15.7:0/2630052693 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0cf41622b0 msgr2=0x7f0cf40cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:30.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.790+0000 7f0cf9e36640 1 --2- 172.21.15.7:0/2630052693 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0cf41622b0 0x7f0cf40cbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:30.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.790+0000 7f0cf9e36640 1 -- 172.21.15.7:0/2630052693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf415de40 msgr2=0x7f0cf41f4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:30.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.790+0000 7f0cf9e36640 1 --2- 172.21.15.7:0/2630052693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf415de40 0x7f0cf41f4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:30.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.790+0000 7f0cf9e36640 1 -- 172.21.15.7:0/2630052693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf40ca130 con 0x7f0cf415da60 2024-04-25T10:00:30.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.791+0000 7f0cf9e36640 1 --2- 172.21.15.7:0/2630052693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cf415da60 0x7f0cf40c9bf0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f0cf000d830 tx=0x7f0cf000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:30.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.791+0000 7f0cea7fc640 1 -- 172.21.15.7:0/2630052693 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf000b6c0 con 0x7f0cf415da60 2024-04-25T10:00:30.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.791+0000 7f0cea7fc640 1 -- 172.21.15.7:0/2630052693 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf0019070 con 0x7f0cf415da60 2024-04-25T10:00:30.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.791+0000 7f0cfc09a640 1 -- 172.21.15.7:0/2630052693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf41f3b00 con 0x7f0cf415da60 2024-04-25T10:00:30.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.791+0000 7f0cea7fc640 1 -- 172.21.15.7:0/2630052693 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf000ba80 con 0x7f0cf415da60 2024-04-25T10:00:30.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.791+0000 7f0cfc09a640 1 -- 172.21.15.7:0/2630052693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf41f40c0 con 0x7f0cf415da60 2024-04-25T10:00:30.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.792+0000 7f0cfc09a640 1 -- 172.21.15.7:0/2630052693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf4068fd0 con 0x7f0cf415da60 2024-04-25T10:00:30.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.792+0000 7f0cea7fc640 1 -- 172.21.15.7:0/2630052693 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0cf000bc20 con 0x7f0cf415da60 2024-04-25T10:00:30.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.793+0000 7f0cea7fc640 1 --2- 172.21.15.7:0/2630052693 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0cd806b4d0 0x7f0cd806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:30.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.793+0000 7f0cea7fc640 1 -- 172.21.15.7:0/2630052693 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f0cf008a3b0 con 0x7f0cf415da60 2024-04-25T10:00:30.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.793+0000 7f0cf9635640 1 --2- 172.21.15.7:0/2630052693 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0cd806b4d0 0x7f0cd806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:30.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.793+0000 7f0cf9635640 1 --2- 172.21.15.7:0/2630052693 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0cd806b4d0 0x7f0cd806d990 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4034000 tx=0x7f0ce402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:30.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:30.797+0000 7f0cea7fc640 1 -- 172.21.15.7:0/2630052693 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0cf0058d90 con 0x7f0cf415da60 2024-04-25T10:00:31.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.054+0000 7f0cfc09a640 1 -- 172.21.15.7:0/2630052693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f0cf40d1560 con 0x7f0cf415da60 2024-04-25T10:00:31.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.055+0000 7f0cea7fc640 1 -- 172.21.15.7:0/2630052693 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f0cf0088e20 con 0x7f0cf415da60 2024-04-25T10:00:31.060 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:00:31.060 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:00:31.061 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_dump": [ 2024-04-25T10:00:31.061 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:00:31.061 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.a", 2024-04-25T10:00:31.061 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmDER5IhAA2ih+YNPXKaTRN6KeMKiDaA==", 2024-04-25T10:00:31.061 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:00:31.061 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T10:00:31.061 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T10:00:31.061 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T10:00:31.061 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:00:31.061 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:00:31.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:00:31.061 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:00:31.061 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.b", 2024-04-25T10:00:31.062 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmp55aLhAAD3pB8YjSzrpU6DfjQTVHPw==", 2024-04-25T10:00:31.062 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:00:31.062 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T10:00:31.062 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T10:00:31.062 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T10:00:31.062 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:00:31.062 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:00:31.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:00:31.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:00:31.062 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.c", 2024-04-25T10:00:31.063 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpm8jBtKRAAiDZo8S/z1fE588t8tiuX8Q==", 2024-04-25T10:00:31.063 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:00:31.063 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T10:00:31.063 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T10:00:31.063 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T10:00:31.063 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:00:31.063 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:00:31.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:00:31.063 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:00:31.063 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.d", 2024-04-25T10:00:31.063 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmZWyRNRAA6tdquR+Hh8Lhx7LATegX6g==", 2024-04-25T10:00:31.064 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:00:31.064 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T10:00:31.064 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T10:00:31.064 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T10:00:31.064 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:00:31.064 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:00:31.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:00:31.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:00:31.064 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.0", 2024-04-25T10:00:31.064 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAaKCpmfHZ9HBAA9FYBJbc1QdNt1a9qtFhgBw==", 2024-04-25T10:00:31.064 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:00:31.065 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T10:00:31.065 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T10:00:31.065 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:00:31.065 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:00:31.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:00:31.065 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:00:31.065 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.1", 2024-04-25T10:00:31.065 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAdKCpmtYOgGhAAbM8XXG5fT+UNSvzvijeJ9Q==", 2024-04-25T10:00:31.065 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:00:31.065 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T10:00:31.066 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T10:00:31.066 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:00:31.066 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:00:31.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:00:31.066 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:00:31.066 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.2", 2024-04-25T10:00:31.066 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAgKCpmz4uZGBAA6JD3UWZ/8l12y4lJg0kH0A==", 2024-04-25T10:00:31.066 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:00:31.066 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T10:00:31.067 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T10:00:31.067 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:00:31.067 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:00:31.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:00:31.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:00:31.067 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.3", 2024-04-25T10:00:31.067 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAjKCpmcbXXFhAAsK64H4YqdiD1VJKQtn46OQ==", 2024-04-25T10:00:31.067 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:00:31.067 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T10:00:31.067 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T10:00:31.067 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:00:31.067 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:00:31.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:00:31.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:00:31.068 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.4", 2024-04-25T10:00:31.068 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAsKCpmzEDuKxAAmzxdcdVZIq2bGfG0rYcBBg==", 2024-04-25T10:00:31.068 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:00:31.068 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T10:00:31.068 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T10:00:31.068 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:00:31.068 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:00:31.068 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:00:31.068 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:00:31.068 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.5", 2024-04-25T10:00:31.068 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAvKCpmfyC4KxAAl6QUtdlRRaRNZpECSoHLJQ==", 2024-04-25T10:00:31.068 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:00:31.068 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T10:00:31.069 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T10:00:31.069 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:00:31.069 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:00:31.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:00:31.069 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:00:31.069 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.6", 2024-04-25T10:00:31.069 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAyKCpmBrUsKxAAH5IlxYRXUtPKYWDdTqBp3w==", 2024-04-25T10:00:31.069 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:00:31.069 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T10:00:31.069 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T10:00:31.069 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:00:31.069 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:00:31.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:00:31.069 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:00:31.069 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.7", 2024-04-25T10:00:31.070 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQA1KCpmmwTSKhAAdzw/c0Xc6KCQHssqUI910g==", 2024-04-25T10:00:31.070 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:00:31.070 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T10:00:31.070 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T10:00:31.070 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:00:31.070 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:00:31.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:00:31.070 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:00:31.070 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.0", 2024-04-25T10:00:31.070 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmaJKeORAALxC5ZqLLEu0zJFG+SOGukQ==", 2024-04-25T10:00:31.070 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:00:31.070 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T10:00:31.070 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow r", 2024-04-25T10:00:31.070 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T10:00:31.071 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:00:31.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:00:31.071 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:00:31.071 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.1", 2024-04-25T10:00:31.071 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAZKCpmC2i6BhAAtKmpTNs/Tga7NtOkm7jSOg==", 2024-04-25T10:00:31.071 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:00:31.071 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T10:00:31.071 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-04-25T10:00:31.071 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-04-25T10:00:31.071 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-04-25T10:00:31.071 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:00:31.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:00:31.071 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:00:31.071 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.2", 2024-04-25T10:00:31.072 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAZKCpmytCIAxAAhP2UjagzGbz1ySErw1cw3Q==", 2024-04-25T10:00:31.072 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:00:31.072 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T10:00:31.072 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-04-25T10:00:31.072 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-04-25T10:00:31.072 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-04-25T10:00:31.072 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:00:31.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:00:31.072 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:00:31.072 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.3", 2024-04-25T10:00:31.072 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAZKCpmSj88DBAAg+N3XDyc3H6fUBqkScD/9Q==", 2024-04-25T10:00:31.072 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:00:31.072 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T10:00:31.072 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-04-25T10:00:31.072 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-04-25T10:00:31.073 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-04-25T10:00:31.073 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:00:31.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:00:31.073 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:00:31.073 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.admin", 2024-04-25T10:00:31.073 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpm8SYpBhAACl5SVNaaKZV7rIIFaFlmvw==", 2024-04-25T10:00:31.073 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:00:31.073 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-04-25T10:00:31.073 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T10:00:31.073 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T10:00:31.073 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:00:31.073 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:00:31.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:00:31.073 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:00:31.073 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.x", 2024-04-25T10:00:31.073 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmqIdPHxAACc5SoI1y74ickl2cPjfGIg==", 2024-04-25T10:00:31.073 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:00:31.074 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-04-25T10:00:31.074 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2024-04-25T10:00:31.074 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:00:31.074 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:00:31.074 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:00:31.074 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:00:31.074 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.y", 2024-04-25T10:00:31.074 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmCvpDGxAAYsxd6zUjxUgY0sYwR4VvAQ==", 2024-04-25T10:00:31.074 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:00:31.074 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-04-25T10:00:31.074 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2024-04-25T10:00:31.074 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:00:31.074 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:00:31.074 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:00:31.075 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-25T10:00:31.075 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:00:31.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.057+0000 7f0cfc09a640 1 -- 172.21.15.7:0/2630052693 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0cd806b4d0 msgr2=0x7f0cd806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:31.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.057+0000 7f0cfc09a640 1 --2- 172.21.15.7:0/2630052693 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0cd806b4d0 0x7f0cd806d990 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4034000 tx=0x7f0ce402e000 comp rx=0 tx=0).stop 2024-04-25T10:00:31.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.057+0000 7f0cfc09a640 1 -- 172.21.15.7:0/2630052693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cf415da60 msgr2=0x7f0cf40c9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:31.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.057+0000 7f0cfc09a640 1 --2- 172.21.15.7:0/2630052693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cf415da60 0x7f0cf40c9bf0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f0cf000d830 tx=0x7f0cf000dcf0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.057+0000 7f0cfc09a640 1 -- 172.21.15.7:0/2630052693 shutdown_connections 2024-04-25T10:00:31.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.057+0000 7f0cfc09a640 1 --2- 172.21.15.7:0/2630052693 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0cd806b4d0 0x7f0cd806d990 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.057+0000 7f0cfc09a640 1 --2- 172.21.15.7:0/2630052693 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0cf41622b0 0x7f0cf40cbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.057+0000 7f0cfc09a640 1 --2- 172.21.15.7:0/2630052693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf415de40 0x7f0cf41f4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.057+0000 7f0cfc09a640 1 --2- 172.21.15.7:0/2630052693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0cf415da60 0x7f0cf40c9bf0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.057+0000 7f0cfc09a640 1 -- 172.21.15.7:0/2630052693 >> 172.21.15.7:0/2630052693 conn(0x7f0cf406bfe0 msgr2=0x7f0cf415f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:31.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.058+0000 7f0cfc09a640 1 -- 172.21.15.7:0/2630052693 shutdown_connections 2024-04-25T10:00:31.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.058+0000 7f0cfc09a640 1 -- 172.21.15.7:0/2630052693 wait complete. 2024-04-25T10:00:31.079 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:00:31.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.175+0000 7fc57b44a640 1 Processor -- start 2024-04-25T10:00:31.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.175+0000 7fc57b44a640 1 -- start start 2024-04-25T10:00:31.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.176+0000 7fc57b44a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc57406c680 0x7fc57406cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:31.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.176+0000 7fc57b44a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc5740cbc90 0x7fc5740cc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:31.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.176+0000 7fc57b44a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc574099b90 con 0x7fc5740cd740 2024-04-25T10:00:31.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.177+0000 7fc57b44a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5740cdb20 con 0x7fc5740cbc90 2024-04-25T10:00:31.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.177+0000 7fc57b44a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57406d020 con 0x7fc57406c680 2024-04-25T10:00:31.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.177+0000 7fc5799e7640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc5740cbc90 0x7fc5740cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:31.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.177+0000 7fc5799e7640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc5740cbc90 0x7fc5740cc120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51022/0 (socket says 172.21.15.7:51022) 2024-04-25T10:00:31.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.177+0000 7fc5799e7640 1 -- 172.21.15.7:0/3845552236 learned_addr learned my addr 172.21.15.7:0/3845552236 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:31.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.177+0000 7fc5789e5640 1 --2- 172.21.15.7:0/3845552236 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc57406c680 0x7fc57406cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:31.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.177+0000 7fc5799e7640 1 -- 172.21.15.7:0/3845552236 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc57406c680 msgr2=0x7fc57406cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:31.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.177+0000 7fc5799e7640 1 --2- 172.21.15.7:0/3845552236 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc57406c680 0x7fc57406cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.177+0000 7fc5799e7640 1 -- 172.21.15.7:0/3845552236 >> v1:172.21.15.55:6789/0 conn(0x7fc5740cd740 legacy=0x7fc5740d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:31.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.177+0000 7fc5799e7640 1 -- 172.21.15.7:0/3845552236 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc574099e70 con 0x7fc5740cbc90 2024-04-25T10:00:31.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.178+0000 7fc5799e7640 1 --2- 172.21.15.7:0/3845552236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5740cbc90 0x7fc5740cc120 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fc564009e50 tx=0x7fc56402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d205298759c1bf96 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:31.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.178+0000 7fc573fff640 1 -- 172.21.15.7:0/3845552236 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc564036070 con 0x7fc5740cbc90 2024-04-25T10:00:31.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.178+0000 7fc573fff640 1 -- 172.21.15.7:0/3845552236 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc564031600 con 0x7fc5740cbc90 2024-04-25T10:00:31.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.178+0000 7fc573fff640 1 -- 172.21.15.7:0/3845552236 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5640319d0 con 0x7fc5740cbc90 2024-04-25T10:00:31.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.178+0000 7fc57b44a640 1 -- 172.21.15.7:0/3845552236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5740cbc90 msgr2=0x7fc5740cc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:31.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.178+0000 7fc57b44a640 1 --2- 172.21.15.7:0/3845552236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5740cbc90 0x7fc5740cc120 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fc564009e50 tx=0x7fc56402a6c0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.178+0000 7fc57b44a640 1 -- 172.21.15.7:0/3845552236 shutdown_connections 2024-04-25T10:00:31.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.178+0000 7fc57b44a640 1 --2- 172.21.15.7:0/3845552236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5740cbc90 0x7fc5740cc120 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.178+0000 7fc57b44a640 1 --2- 172.21.15.7:0/3845552236 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc57406c680 0x7fc57406cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.178+0000 7fc57b44a640 1 -- 172.21.15.7:0/3845552236 >> 172.21.15.7:0/3845552236 conn(0x7fc5740b3130 msgr2=0x7fc5740b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:31.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.178+0000 7fc57b44a640 1 -- 172.21.15.7:0/3845552236 shutdown_connections 2024-04-25T10:00:31.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.178+0000 7fc57b44a640 1 -- 172.21.15.7:0/3845552236 wait complete. 2024-04-25T10:00:31.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.180+0000 7fc57b44a640 1 Processor -- start 2024-04-25T10:00:31.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.180+0000 7fc57b44a640 1 -- start start 2024-04-25T10:00:31.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.180+0000 7fc57b44a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc57406c680 0x7fc5741f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:31.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.180+0000 7fc57b44a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5740cbc90 0x7fc5740c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:31.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.180+0000 7fc57b44a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5740cd740 0x7fc5740b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:31.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.180+0000 7fc57b44a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57409a710 con 0x7fc5740cbc90 2024-04-25T10:00:31.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.180+0000 7fc57b44a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57409a430 con 0x7fc5740cd740 2024-04-25T10:00:31.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.180+0000 7fc57b44a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57409ac30 con 0x7fc57406c680 2024-04-25T10:00:31.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.180+0000 7fc5789e5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5740cbc90 0x7fc5740c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:31.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.180+0000 7fc5789e5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5740cbc90 0x7fc5740c9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51038/0 (socket says 172.21.15.7:51038) 2024-04-25T10:00:31.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.180+0000 7fc5789e5640 1 -- 172.21.15.7:0/4223092359 learned_addr learned my addr 172.21.15.7:0/4223092359 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:31.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.181+0000 7fc5791e6640 1 --2- 172.21.15.7:0/4223092359 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc57406c680 0x7fc5741f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:31.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.181+0000 7fc5799e7640 1 --2- 172.21.15.7:0/4223092359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5740cd740 0x7fc5740b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:31.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.181+0000 7fc5789e5640 1 -- 172.21.15.7:0/4223092359 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc57406c680 msgr2=0x7fc5741f7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:31.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.181+0000 7fc5789e5640 1 --2- 172.21.15.7:0/4223092359 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc57406c680 0x7fc5741f7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.181+0000 7fc5789e5640 1 -- 172.21.15.7:0/4223092359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5740cd740 msgr2=0x7fc5740b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:31.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.181+0000 7fc5789e5640 1 --2- 172.21.15.7:0/4223092359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5740cd740 0x7fc5740b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.181+0000 7fc5789e5640 1 -- 172.21.15.7:0/4223092359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5740c8960 con 0x7fc5740cbc90 2024-04-25T10:00:31.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.181+0000 7fc5789e5640 1 --2- 172.21.15.7:0/4223092359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5740cbc90 0x7fc5740c9a00 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fc56800d830 tx=0x7fc56800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:31.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.181+0000 7fc571ffb640 1 -- 172.21.15.7:0/4223092359 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56800b6c0 con 0x7fc5740cbc90 2024-04-25T10:00:31.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.181+0000 7fc571ffb640 1 -- 172.21.15.7:0/4223092359 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc568019070 con 0x7fc5740cbc90 2024-04-25T10:00:31.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.181+0000 7fc57b44a640 1 -- 172.21.15.7:0/4223092359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5740c8c40 con 0x7fc5740cbc90 2024-04-25T10:00:31.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.181+0000 7fc571ffb640 1 -- 172.21.15.7:0/4223092359 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56800ba80 con 0x7fc5740cbc90 2024-04-25T10:00:31.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.181+0000 7fc57b44a640 1 -- 172.21.15.7:0/4223092359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5740c9200 con 0x7fc5740cbc90 2024-04-25T10:00:31.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.182+0000 7fc57b44a640 1 -- 172.21.15.7:0/4223092359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5740c86f0 con 0x7fc5740cbc90 2024-04-25T10:00:31.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.183+0000 7fc571ffb640 1 -- 172.21.15.7:0/4223092359 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc56801e460 con 0x7fc5740cbc90 2024-04-25T10:00:31.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.183+0000 7fc571ffb640 1 --2- 172.21.15.7:0/4223092359 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc56006b4d0 0x7fc56006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:31.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.183+0000 7fc571ffb640 1 -- 172.21.15.7:0/4223092359 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fc56808a560 con 0x7fc5740cbc90 2024-04-25T10:00:31.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.183+0000 7fc5791e6640 1 --2- 172.21.15.7:0/4223092359 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc56006b4d0 0x7fc56006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:31.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.184+0000 7fc5791e6640 1 --2- 172.21.15.7:0/4223092359 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc56006b4d0 0x7fc56006d990 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc56c006fd0 tx=0x7fc56c009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:31.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.188+0000 7fc571ffb640 1 -- 172.21.15.7:0/4223092359 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc568058fe0 con 0x7fc5740cbc90 2024-04-25T10:00:31.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.368+0000 7fc57b44a640 1 -- 172.21.15.7:0/4223092359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc574068fd0 con 0x7fc5740cbc90 2024-04-25T10:00:31.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.369+0000 7fc571ffb640 1 -- 172.21.15.7:0/4223092359 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+13069 (secure 0 0 0) 0x7fc56805d080 con 0x7fc5740cbc90 2024-04-25T10:00:31.373 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:00:31.373 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":84,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:00:30.657988+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:00:31.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.370+0000 7fc57b44a640 1 -- 172.21.15.7:0/4223092359 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc56006b4d0 msgr2=0x7fc56006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:31.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.370+0000 7fc57b44a640 1 --2- 172.21.15.7:0/4223092359 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc56006b4d0 0x7fc56006d990 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc56c006fd0 tx=0x7fc56c009060 comp rx=0 tx=0).stop 2024-04-25T10:00:31.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.370+0000 7fc57b44a640 1 -- 172.21.15.7:0/4223092359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5740cbc90 msgr2=0x7fc5740c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:31.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.370+0000 7fc57b44a640 1 --2- 172.21.15.7:0/4223092359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5740cbc90 0x7fc5740c9a00 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fc56800d830 tx=0x7fc56800dcf0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.371+0000 7fc57b44a640 1 -- 172.21.15.7:0/4223092359 shutdown_connections 2024-04-25T10:00:31.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.371+0000 7fc57b44a640 1 --2- 172.21.15.7:0/4223092359 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc56006b4d0 0x7fc56006d990 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.371+0000 7fc57b44a640 1 --2- 172.21.15.7:0/4223092359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5740cd740 0x7fc5740b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.371+0000 7fc57b44a640 1 --2- 172.21.15.7:0/4223092359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5740cbc90 0x7fc5740c9a00 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.371+0000 7fc57b44a640 1 --2- 172.21.15.7:0/4223092359 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc57406c680 0x7fc5741f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.371+0000 7fc57b44a640 1 -- 172.21.15.7:0/4223092359 >> 172.21.15.7:0/4223092359 conn(0x7fc5740b3130 msgr2=0x7fc5740708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:31.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.371+0000 7fc57b44a640 1 -- 172.21.15.7:0/4223092359 shutdown_connections 2024-04-25T10:00:31.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.371+0000 7fc57b44a640 1 -- 172.21.15.7:0/4223092359 wait complete. 2024-04-25T10:00:31.386 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:00:31.387 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:00:31.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.487+0000 7f064245a640 1 Processor -- start 2024-04-25T10:00:31.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.487+0000 7f064245a640 1 -- start start 2024-04-25T10:00:31.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.488+0000 7f064245a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f063c15deb0 0x7f063c0b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:31.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.488+0000 7f064245a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f063c0ce030 0x7f063c0b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:31.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.488+0000 7f064245a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063c0d1a40 con 0x7f063c0b6f20 2024-04-25T10:00:31.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.488+0000 7f064245a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063c0d1d20 con 0x7f063c0ce030 2024-04-25T10:00:31.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.488+0000 7f064245a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0d2000 con 0x7f063c15deb0 2024-04-25T10:00:31.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.488+0000 7f063b7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f063c0ce030 0x7f063c0b69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:31.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.488+0000 7f063b7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f063c0ce030 0x7f063c0b69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51044/0 (socket says 172.21.15.7:51044) 2024-04-25T10:00:31.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.488+0000 7f063b7fe640 1 -- 172.21.15.7:0/1368618428 learned_addr learned my addr 172.21.15.7:0/1368618428 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:31.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.488+0000 7f063b7fe640 1 -- 172.21.15.7:0/1368618428 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f063c15deb0 msgr2=0x7f063c0b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:31.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.488+0000 7f063b7fe640 1 --2- 172.21.15.7:0/1368618428 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f063c15deb0 0x7f063c0b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.488+0000 7f063b7fe640 1 -- 172.21.15.7:0/1368618428 >> v1:172.21.15.55:6789/0 conn(0x7f063c0b6f20 legacy=0x7f063c0d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:31.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.488+0000 7f063b7fe640 1 -- 172.21.15.7:0/1368618428 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c0d22e0 con 0x7f063c0ce030 2024-04-25T10:00:31.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.489+0000 7f063b7fe640 1 --2- 172.21.15.7:0/1368618428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f063c0ce030 0x7f063c0b69e0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f0630009870 tx=0x7f063002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c74954f821b0d498 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:31.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.489+0000 7f063affd640 1 -- 172.21.15.7:0/1368618428 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0630037070 con 0x7f063c0ce030 2024-04-25T10:00:31.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.489+0000 7f063affd640 1 -- 172.21.15.7:0/1368618428 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0630032440 con 0x7f063c0ce030 2024-04-25T10:00:31.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.489+0000 7f063affd640 1 -- 172.21.15.7:0/1368618428 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0630032810 con 0x7f063c0ce030 2024-04-25T10:00:31.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.490+0000 7f064245a640 1 -- 172.21.15.7:0/1368618428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f063c0ce030 msgr2=0x7f063c0b69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:31.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.490+0000 7f064245a640 1 --2- 172.21.15.7:0/1368618428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f063c0ce030 0x7f063c0b69e0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f0630009870 tx=0x7f063002a210 comp rx=0 tx=0).stop 2024-04-25T10:00:31.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.490+0000 7f064245a640 1 -- 172.21.15.7:0/1368618428 shutdown_connections 2024-04-25T10:00:31.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.490+0000 7f064245a640 1 --2- 172.21.15.7:0/1368618428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f063c0ce030 0x7f063c0b69e0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.490+0000 7f064245a640 1 --2- 172.21.15.7:0/1368618428 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f063c15deb0 0x7f063c0b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.490+0000 7f064245a640 1 -- 172.21.15.7:0/1368618428 >> 172.21.15.7:0/1368618428 conn(0x7f063c0726b0 msgr2=0x7f063c072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:31.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.490+0000 7f064245a640 1 -- 172.21.15.7:0/1368618428 shutdown_connections 2024-04-25T10:00:31.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.490+0000 7f064245a640 1 -- 172.21.15.7:0/1368618428 wait complete. 2024-04-25T10:00:31.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.491+0000 7f064245a640 1 Processor -- start 2024-04-25T10:00:31.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.491+0000 7f064245a640 1 -- start start 2024-04-25T10:00:31.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.492+0000 7f064245a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f063c0b6f20 0x7f063c151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:31.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.492+0000 7f064245a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f063c0ce030 0x7f063c0cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:31.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.492+0000 7f064245a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f063c15deb0 0x7f063c0b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:31.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.492+0000 7f064245a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0d3e70 con 0x7f063c0b6f20 2024-04-25T10:00:31.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.492+0000 7f064245a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0ce490 con 0x7f063c15deb0 2024-04-25T10:00:31.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.492+0000 7f064245a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0d3ff0 con 0x7f063c0ce030 2024-04-25T10:00:31.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.492+0000 7f063bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f063c0b6f20 0x7f063c151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:31.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.492+0000 7f063bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f063c0b6f20 0x7f063c151df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51060/0 (socket says 172.21.15.7:51060) 2024-04-25T10:00:31.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.492+0000 7f063bfff640 1 -- 172.21.15.7:0/967553025 learned_addr learned my addr 172.21.15.7:0/967553025 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:31.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.492+0000 7f063b7fe640 1 --2- 172.21.15.7:0/967553025 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f063c0ce030 0x7f063c0cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:31.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.492+0000 7f06409f7640 1 --2- 172.21.15.7:0/967553025 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f063c15deb0 0x7f063c0b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:31.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.492+0000 7f063bfff640 1 -- 172.21.15.7:0/967553025 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f063c0ce030 msgr2=0x7f063c0cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:31.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.492+0000 7f063bfff640 1 --2- 172.21.15.7:0/967553025 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f063c0ce030 0x7f063c0cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.492+0000 7f063bfff640 1 -- 172.21.15.7:0/967553025 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f063c15deb0 msgr2=0x7f063c0b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:31.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.492+0000 7f063bfff640 1 --2- 172.21.15.7:0/967553025 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f063c15deb0 0x7f063c0b39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.492+0000 7f063bfff640 1 -- 172.21.15.7:0/967553025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c157690 con 0x7f063c0b6f20 2024-04-25T10:00:31.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.492+0000 7f063b7fe640 1 --2- 172.21.15.7:0/967553025 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f063c0ce030 0x7f063c0cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:00:31.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.492+0000 7f063bfff640 1 --2- 172.21.15.7:0/967553025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f063c0b6f20 0x7f063c151df0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f062c00b410 tx=0x7f062c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:31.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.493+0000 7f0638ff9640 1 -- 172.21.15.7:0/967553025 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c015020 con 0x7f063c0b6f20 2024-04-25T10:00:31.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.493+0000 7f0638ff9640 1 -- 172.21.15.7:0/967553025 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062c011850 con 0x7f063c0b6f20 2024-04-25T10:00:31.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.493+0000 7f064245a640 1 -- 172.21.15.7:0/967553025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f063c1579d0 con 0x7f063c0b6f20 2024-04-25T10:00:31.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.493+0000 7f0638ff9640 1 -- 172.21.15.7:0/967553025 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c011c40 con 0x7f063c0b6f20 2024-04-25T10:00:31.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.493+0000 7f064245a640 1 -- 172.21.15.7:0/967553025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063c158210 con 0x7f063c0b6f20 2024-04-25T10:00:31.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.494+0000 7f064245a640 1 -- 172.21.15.7:0/967553025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063c158410 con 0x7f063c0b6f20 2024-04-25T10:00:31.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.494+0000 7f0638ff9640 1 -- 172.21.15.7:0/967553025 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f062c018020 con 0x7f063c0b6f20 2024-04-25T10:00:31.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.495+0000 7f0638ff9640 1 --2- 172.21.15.7:0/967553025 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f062806b4d0 0x7f062806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:31.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.495+0000 7f0638ff9640 1 -- 172.21.15.7:0/967553025 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f062c08a080 con 0x7f063c0b6f20 2024-04-25T10:00:31.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.495+0000 7f063b7fe640 1 --2- 172.21.15.7:0/967553025 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f062806b4d0 0x7f062806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:31.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.495+0000 7f063b7fe640 1 --2- 172.21.15.7:0/967553025 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f062806b4d0 0x7f062806d990 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0630034000 tx=0x7f063002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:31.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.499+0000 7f0638ff9640 1 -- 172.21.15.7:0/967553025 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f063c158410 con 0x7f063c0b6f20 2024-04-25T10:00:31.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.681+0000 7f064245a640 1 -- 172.21.15.7:0/967553025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f063c0ccea0 con 0x7f063c0b6f20 2024-04-25T10:00:31.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.681+0000 7f0638ff9640 1 -- 172.21.15.7:0/967553025 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f062c01f020 con 0x7f063c0b6f20 2024-04-25T10:00:31.686 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T10:00:31.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.683+0000 7f064245a640 1 -- 172.21.15.7:0/967553025 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f062806b4d0 msgr2=0x7f062806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:31.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.683+0000 7f064245a640 1 --2- 172.21.15.7:0/967553025 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f062806b4d0 0x7f062806d990 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0630034000 tx=0x7f063002e000 comp rx=0 tx=0).stop 2024-04-25T10:00:31.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.683+0000 7f064245a640 1 -- 172.21.15.7:0/967553025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f063c0b6f20 msgr2=0x7f063c151df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:31.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.683+0000 7f064245a640 1 --2- 172.21.15.7:0/967553025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f063c0b6f20 0x7f063c151df0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f062c00b410 tx=0x7f062c00b8d0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.683+0000 7f064245a640 1 -- 172.21.15.7:0/967553025 shutdown_connections 2024-04-25T10:00:31.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.683+0000 7f064245a640 1 --2- 172.21.15.7:0/967553025 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f062806b4d0 0x7f062806d990 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.683+0000 7f064245a640 1 --2- 172.21.15.7:0/967553025 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f063c15deb0 0x7f063c0b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.683+0000 7f064245a640 1 --2- 172.21.15.7:0/967553025 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f063c0ce030 0x7f063c0cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.683+0000 7f064245a640 1 --2- 172.21.15.7:0/967553025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f063c0b6f20 0x7f063c151df0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.683+0000 7f064245a640 1 -- 172.21.15.7:0/967553025 >> 172.21.15.7:0/967553025 conn(0x7f063c0726b0 msgr2=0x7f063c0d3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:31.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.683+0000 7f064245a640 1 -- 172.21.15.7:0/967553025 shutdown_connections 2024-04-25T10:00:31.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.683+0000 7f064245a640 1 -- 172.21.15.7:0/967553025 wait complete. 2024-04-25T10:00:31.699 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T10:00:31.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.795+0000 7f775c5ce640 1 Processor -- start 2024-04-25T10:00:31.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.795+0000 7f775c5ce640 1 -- start start 2024-04-25T10:00:31.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.796+0000 7f775c5ce640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f775415da60 0x7f77540d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:31.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.796+0000 7f775c5ce640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f775415de40 0x7f775415e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:31.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.796+0000 7f775c5ce640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f775415e8a0 con 0x7f7754161d70 2024-04-25T10:00:31.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.796+0000 7f775c5ce640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f775415eb80 con 0x7f775415da60 2024-04-25T10:00:31.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.796+0000 7f775c5ce640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f775415ee60 con 0x7f775415de40 2024-04-25T10:00:31.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.796+0000 7f775ab6b640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7754161d70 0x7f77540ce520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40548/0 (socket says 172.21.15.7:40548) 2024-04-25T10:00:31.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.796+0000 7f775ab6b640 1 -- 172.21.15.7:0/314338904 learned_addr learned my addr 172.21.15.7:0/314338904 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:31.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.796+0000 7f775a36a640 1 --2- 172.21.15.7:0/314338904 >> v2:172.21.15.55:3300/0 conn(0x7f775415da60 0x7f77540d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:31.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.796+0000 7f7759b69640 1 --2- 172.21.15.7:0/314338904 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f775415de40 0x7f775415e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:31.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.796+0000 7f7759368640 1 -- 172.21.15.7:0/314338904 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 22064934 0 0) 0x7f775415e8a0 con 0x7f7754161d70 2024-04-25T10:00:31.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.796+0000 7f7759368640 1 -- 172.21.15.7:0/314338904 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7740003520 con 0x7f7754161d70 2024-04-25T10:00:31.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.796+0000 7f7759368640 1 -- 172.21.15.7:0/314338904 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2823983366 0 0) 0x7f7740003520 con 0x7f7754161d70 2024-04-25T10:00:31.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.796+0000 7f7759368640 1 -- 172.21.15.7:0/314338904 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f775415de40 msgr2=0x7f775415e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:31.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.796+0000 7f7759368640 1 --2- 172.21.15.7:0/314338904 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f775415de40 0x7f775415e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.796+0000 7f7759368640 1 -- 172.21.15.7:0/314338904 >> v2:172.21.15.55:3300/0 conn(0x7f775415da60 msgr2=0x7f77540d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:31.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.796+0000 7f7759368640 1 --2- 172.21.15.7:0/314338904 >> v2:172.21.15.55:3300/0 conn(0x7f775415da60 0x7f77540d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.796+0000 7f7759368640 1 -- 172.21.15.7:0/314338904 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7754161850 con 0x7f7754161d70 2024-04-25T10:00:31.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.796+0000 7f7759368640 1 -- 172.21.15.7:0/314338904 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f774c0019f0 con 0x7f7754161d70 2024-04-25T10:00:31.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.796+0000 7f775a36a640 1 --2- 172.21.15.7:0/314338904 >> v2:172.21.15.55:3300/0 conn(0x7f775415da60 0x7f77540d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:00:31.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.796+0000 7f7759368640 1 -- 172.21.15.7:0/314338904 >> v1:172.21.15.7:6789/0 conn(0x7f7754161d70 legacy=0x7f77540ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:31.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.796+0000 7f7759368640 1 --2- 172.21.15.7:0/314338904 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f775415de40 0x7f77400039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:31.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.796+0000 7f7759368640 1 --2- 172.21.15.7:0/314338904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7740003f30 0x7f7740004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:31.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.797+0000 7f7759368640 1 --2- 172.21.15.7:0/314338904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7740004d40 0x7f77400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:31.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.797+0000 7f7759368640 1 -- 172.21.15.7:0/314338904 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775415eb80 con 0x7f7740003f30 2024-04-25T10:00:31.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.797+0000 7f7759368640 1 -- 172.21.15.7:0/314338904 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775415ee60 con 0x7f7740004d40 2024-04-25T10:00:31.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.797+0000 7f7759368640 1 -- 172.21.15.7:0/314338904 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f774000ba10 con 0x7f775415de40 2024-04-25T10:00:31.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.797+0000 7f7759b69640 1 --2- 172.21.15.7:0/314338904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7740003f30 0x7f7740004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:31.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.797+0000 7f775ab6b640 1 --2- 172.21.15.7:0/314338904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7740004d40 0x7f77400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:31.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.797+0000 7f775a36a640 1 --2- 172.21.15.7:0/314338904 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f775415de40 0x7f77400039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:31.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.797+0000 7f7759b69640 1 -- 172.21.15.7:0/314338904 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f775415de40 msgr2=0x7f77400039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:31.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.797+0000 7f7759b69640 1 --2- 172.21.15.7:0/314338904 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f775415de40 0x7f77400039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.797+0000 7f7759b69640 1 -- 172.21.15.7:0/314338904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7740004d40 msgr2=0x7f77400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:31.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.797+0000 7f7759b69640 1 --2- 172.21.15.7:0/314338904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7740004d40 0x7f77400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.797+0000 7f7759b69640 1 -- 172.21.15.7:0/314338904 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7740003520 con 0x7f7740003f30 2024-04-25T10:00:31.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.797+0000 7f775a36a640 1 --2- 172.21.15.7:0/314338904 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f775415de40 0x7f77400039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:31.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.798+0000 7f7759b69640 1 --2- 172.21.15.7:0/314338904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7740003f30 0x7f7740004800 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f7744009af0 tx=0x7f7740005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d38c0227cd3b94 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:31.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.798+0000 7f7759368640 1 -- 172.21.15.7:0/314338904 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7744036070 con 0x7f7740003f30 2024-04-25T10:00:31.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.798+0000 7f7759368640 1 -- 172.21.15.7:0/314338904 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7744031400 con 0x7f7740003f30 2024-04-25T10:00:31.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.798+0000 7f7759368640 1 -- 172.21.15.7:0/314338904 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7744009690 con 0x7f7740003f30 2024-04-25T10:00:31.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.798+0000 7f775c5ce640 1 -- 172.21.15.7:0/314338904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7740003f30 msgr2=0x7f7740004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:31.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.798+0000 7f775c5ce640 1 --2- 172.21.15.7:0/314338904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7740003f30 0x7f7740004800 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f7744009af0 tx=0x7f7740005830 comp rx=0 tx=0).stop 2024-04-25T10:00:31.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.798+0000 7f775ab6b640 1 -- 172.21.15.7:0/314338904 reap_dead start 2024-04-25T10:00:31.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.798+0000 7f775c5ce640 1 -- 172.21.15.7:0/314338904 shutdown_connections 2024-04-25T10:00:31.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.798+0000 7f775c5ce640 1 -- 172.21.15.7:0/314338904 >> 172.21.15.7:0/314338904 conn(0x7f775406bfe0 msgr2=0x7f775406c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:31.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.798+0000 7f775c5ce640 1 -- 172.21.15.7:0/314338904 shutdown_connections 2024-04-25T10:00:31.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.798+0000 7f775c5ce640 1 -- 172.21.15.7:0/314338904 wait complete. 2024-04-25T10:00:31.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.800+0000 7f775c5ce640 1 Processor -- start 2024-04-25T10:00:31.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.800+0000 7f775c5ce640 1 -- start start 2024-04-25T10:00:31.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.800+0000 7f775c5ce640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7740003f30 0x7f775414f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:31.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.800+0000 7f775c5ce640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77540cc510 0x7f77540ca920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:31.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.800+0000 7f775c5ce640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77540cae60 0x7f77540b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:31.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.800+0000 7f775c5ce640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775415e2a0 con 0x7f77540cc510 2024-04-25T10:00:31.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.800+0000 7f775c5ce640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77540cee40 con 0x7f77540cae60 2024-04-25T10:00:31.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.800+0000 7f775c5ce640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f775415e420 con 0x7f7740003f30 2024-04-25T10:00:31.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.800+0000 7f7759b69640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77540cc510 0x7f77540ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:31.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.801+0000 7f7759b69640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77540cc510 0x7f77540ca920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51076/0 (socket says 172.21.15.7:51076) 2024-04-25T10:00:31.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.801+0000 7f7759b69640 1 -- 172.21.15.7:0/2699127339 learned_addr learned my addr 172.21.15.7:0/2699127339 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:31.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.801+0000 7f7759b69640 1 -- 172.21.15.7:0/2699127339 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7740003f30 msgr2=0x7f775414f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:31.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.801+0000 7f7759b69640 1 --2- 172.21.15.7:0/2699127339 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7740003f30 0x7f775414f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.801+0000 7f7759b69640 1 -- 172.21.15.7:0/2699127339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77540cae60 msgr2=0x7f77540b7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:31.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.801+0000 7f7759b69640 1 --2- 172.21.15.7:0/2699127339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77540cae60 0x7f77540b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.801+0000 7f7759b69640 1 -- 172.21.15.7:0/2699127339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77540b2240 con 0x7f77540cc510 2024-04-25T10:00:31.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.801+0000 7f7759b69640 1 --2- 172.21.15.7:0/2699127339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77540cc510 0x7f77540ca920 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f7744009c10 tx=0x7f7744004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:31.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.801+0000 7f774affd640 1 -- 172.21.15.7:0/2699127339 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7744040020 con 0x7f77540cc510 2024-04-25T10:00:31.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.801+0000 7f774affd640 1 -- 172.21.15.7:0/2699127339 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77440038d0 con 0x7f77540cc510 2024-04-25T10:00:31.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.801+0000 7f775c5ce640 1 -- 172.21.15.7:0/2699127339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7754150200 con 0x7f77540cc510 2024-04-25T10:00:31.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.801+0000 7f774affd640 1 -- 172.21.15.7:0/2699127339 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7744036040 con 0x7f77540cc510 2024-04-25T10:00:31.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.801+0000 7f775c5ce640 1 -- 172.21.15.7:0/2699127339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77540cb750 con 0x7f77540cc510 2024-04-25T10:00:31.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.802+0000 7f775c5ce640 1 -- 172.21.15.7:0/2699127339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7754160380 con 0x7f77540cc510 2024-04-25T10:00:31.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.803+0000 7f774affd640 1 -- 172.21.15.7:0/2699127339 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7744043020 con 0x7f77540cc510 2024-04-25T10:00:31.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.803+0000 7f774affd640 1 --2- 172.21.15.7:0/2699127339 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f773806b4d0 0x7f773806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:31.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.803+0000 7f774affd640 1 -- 172.21.15.7:0/2699127339 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f77440a9fe0 con 0x7f77540cc510 2024-04-25T10:00:31.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.803+0000 7f775a36a640 1 --2- 172.21.15.7:0/2699127339 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f773806b4d0 0x7f773806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:31.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.804+0000 7f775a36a640 1 --2- 172.21.15.7:0/2699127339 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f773806b4d0 0x7f773806d990 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7750009ac0 tx=0x7f7750008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:31.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.807+0000 7f774affd640 1 -- 172.21.15.7:0/2699127339 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7754160380 con 0x7f77540cc510 2024-04-25T10:00:31.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.987+0000 7f775c5ce640 1 -- 172.21.15.7:0/2699127339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7754068fd0 con 0x7f77540cc510 2024-04-25T10:00:31.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.988+0000 7f774affd640 1 -- 172.21.15.7:0/2699127339 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v84) v1 ==== 84+0+65 (secure 0 0 0) 0x7f774404a070 con 0x7f77540cc510 2024-04-25T10:00:31.993 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:00:31.993 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2024-04-25T10:00:31.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:00:31.993 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2024-04-25T10:00:31.993 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2024-04-25T10:00:31.993 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:00:31.993 INFO:teuthology.orchestra.run.smithi007.stdout:] 2024-04-25T10:00:31.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.990+0000 7f775c5ce640 1 -- 172.21.15.7:0/2699127339 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f773806b4d0 msgr2=0x7f773806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:31.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.990+0000 7f775c5ce640 1 --2- 172.21.15.7:0/2699127339 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f773806b4d0 0x7f773806d990 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7750009ac0 tx=0x7f7750008040 comp rx=0 tx=0).stop 2024-04-25T10:00:31.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.990+0000 7f775c5ce640 1 -- 172.21.15.7:0/2699127339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77540cc510 msgr2=0x7f77540ca920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:31.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.990+0000 7f775c5ce640 1 --2- 172.21.15.7:0/2699127339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77540cc510 0x7f77540ca920 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f7744009c10 tx=0x7f7744004730 comp rx=0 tx=0).stop 2024-04-25T10:00:31.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.990+0000 7f775c5ce640 1 -- 172.21.15.7:0/2699127339 shutdown_connections 2024-04-25T10:00:31.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.990+0000 7f775c5ce640 1 --2- 172.21.15.7:0/2699127339 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f773806b4d0 0x7f773806d990 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.990+0000 7f775c5ce640 1 --2- 172.21.15.7:0/2699127339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77540cae60 0x7f77540b7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.990+0000 7f775c5ce640 1 --2- 172.21.15.7:0/2699127339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77540cc510 0x7f77540ca920 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.990+0000 7f775c5ce640 1 --2- 172.21.15.7:0/2699127339 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7740003f30 0x7f775414f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:31.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.990+0000 7f775c5ce640 1 -- 172.21.15.7:0/2699127339 >> 172.21.15.7:0/2699127339 conn(0x7f775406bfe0 msgr2=0x7f775415fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:31.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.990+0000 7f775c5ce640 1 -- 172.21.15.7:0/2699127339 shutdown_connections 2024-04-25T10:00:31.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:31.990+0000 7f775c5ce640 1 -- 172.21.15.7:0/2699127339 wait complete. 2024-04-25T10:00:32.005 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T10:00:32.005 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T10:00:32.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.106+0000 7fc5a3aac640 1 Processor -- start 2024-04-25T10:00:32.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.106+0000 7fc5a3aac640 1 -- start start 2024-04-25T10:00:32.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.107+0000 7fc5a3aac640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc59c06da00 0x7fc59c0b3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:32.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.107+0000 7fc5a3aac640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc59c161600 0x7fc59c0b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:32.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.107+0000 7fc5a3aac640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc59c06adb0 con 0x7fc59c15da20 2024-04-25T10:00:32.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.107+0000 7fc5a3aac640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc59c06ab60 con 0x7fc59c06da00 2024-04-25T10:00:32.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.107+0000 7fc5a3aac640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c06c560 con 0x7fc59c161600 2024-04-25T10:00:32.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.107+0000 7fc5a1047640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc59c06da00 0x7fc59c0b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:32.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.107+0000 7fc5a1848640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc59c15da20 0x7fc59c06be50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40564/0 (socket says 172.21.15.7:40564) 2024-04-25T10:00:32.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.107+0000 7fc5a1848640 1 -- 172.21.15.7:0/3778053468 learned_addr learned my addr 172.21.15.7:0/3778053468 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:32.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.107+0000 7fc5a1047640 1 -- 172.21.15.7:0/3778053468 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc59c161600 msgr2=0x7fc59c0b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:32.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.107+0000 7fc5a1047640 1 --2- 172.21.15.7:0/3778053468 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc59c161600 0x7fc59c0b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:32.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.107+0000 7fc5a1047640 1 -- 172.21.15.7:0/3778053468 >> v1:172.21.15.7:6789/0 conn(0x7fc59c15da20 legacy=0x7fc59c06be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:32.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.107+0000 7fc5a1047640 1 -- 172.21.15.7:0/3778053468 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59c06b090 con 0x7fc59c06da00 2024-04-25T10:00:32.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.107+0000 7fc5a0846640 1 -- 172.21.15.7:0/3778053468 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2166913476 0 0) 0x7fc59c06adb0 con 0x7fc59c15da20 2024-04-25T10:00:32.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.108+0000 7fc5a1047640 1 --2- 172.21.15.7:0/3778053468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc59c06da00 0x7fc59c0b3060 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0097a0 tx=0x7fc58c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65796e03786747d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:32.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.108+0000 7fc5a0846640 1 -- 172.21.15.7:0/3778053468 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c037070 con 0x7fc59c06da00 2024-04-25T10:00:32.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.108+0000 7fc5a0846640 1 -- 172.21.15.7:0/3778053468 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58c02ae50 con 0x7fc59c06da00 2024-04-25T10:00:32.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.108+0000 7fc5a0846640 1 -- 172.21.15.7:0/3778053468 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c032660 con 0x7fc59c06da00 2024-04-25T10:00:32.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.108+0000 7fc5a3aac640 1 -- 172.21.15.7:0/3778053468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc59c06da00 msgr2=0x7fc59c0b3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:32.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.108+0000 7fc5a3aac640 1 --2- 172.21.15.7:0/3778053468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc59c06da00 0x7fc59c0b3060 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0097a0 tx=0x7fc58c02a100 comp rx=0 tx=0).stop 2024-04-25T10:00:32.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.109+0000 7fc5a3aac640 1 -- 172.21.15.7:0/3778053468 shutdown_connections 2024-04-25T10:00:32.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.109+0000 7fc5a3aac640 1 --2- 172.21.15.7:0/3778053468 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc59c161600 0x7fc59c0b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:32.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.109+0000 7fc5a3aac640 1 --2- 172.21.15.7:0/3778053468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc59c06da00 0x7fc59c0b3060 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:32.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.109+0000 7fc5a3aac640 1 -- 172.21.15.7:0/3778053468 >> 172.21.15.7:0/3778053468 conn(0x7fc59c0b2300 msgr2=0x7fc59c0cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:32.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.109+0000 7fc5a3aac640 1 -- 172.21.15.7:0/3778053468 shutdown_connections 2024-04-25T10:00:32.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.109+0000 7fc5a3aac640 1 -- 172.21.15.7:0/3778053468 wait complete. 2024-04-25T10:00:32.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.110+0000 7fc5a3aac640 1 Processor -- start 2024-04-25T10:00:32.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.110+0000 7fc5a3aac640 1 -- start start 2024-04-25T10:00:32.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.110+0000 7fc5a3aac640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc59c06da00 0x7fc59c153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:32.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.110+0000 7fc5a3aac640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc59c15da20 0x7fc59c0b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:32.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.110+0000 7fc5a3aac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc59c161600 0x7fc59c0b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:32.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.111+0000 7fc5a3aac640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c06b930 con 0x7fc59c15da20 2024-04-25T10:00:32.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.111+0000 7fc5a3aac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c06b650 con 0x7fc59c161600 2024-04-25T10:00:32.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.111+0000 7fc5a3aac640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c15de00 con 0x7fc59c06da00 2024-04-25T10:00:32.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.111+0000 7fc5a1047640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc59c15da20 0x7fc59c0b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:32.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.111+0000 7fc5a1047640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc59c15da20 0x7fc59c0b2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51086/0 (socket says 172.21.15.7:51086) 2024-04-25T10:00:32.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.111+0000 7fc5a1047640 1 -- 172.21.15.7:0/4108909492 learned_addr learned my addr 172.21.15.7:0/4108909492 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:32.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.111+0000 7fc5a2049640 1 --2- 172.21.15.7:0/4108909492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc59c161600 0x7fc59c0b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:32.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.111+0000 7fc5a1848640 1 --2- 172.21.15.7:0/4108909492 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc59c06da00 0x7fc59c153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:32.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.111+0000 7fc5a1047640 1 -- 172.21.15.7:0/4108909492 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc59c06da00 msgr2=0x7fc59c153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:32.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.111+0000 7fc5a1047640 1 --2- 172.21.15.7:0/4108909492 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc59c06da00 0x7fc59c153810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:32.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.111+0000 7fc5a1047640 1 -- 172.21.15.7:0/4108909492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc59c161600 msgr2=0x7fc59c0b3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:32.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.111+0000 7fc5a1047640 1 --2- 172.21.15.7:0/4108909492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc59c161600 0x7fc59c0b3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:32.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.111+0000 7fc5a1047640 1 -- 172.21.15.7:0/4108909492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59c0cdd20 con 0x7fc59c15da20 2024-04-25T10:00:32.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.111+0000 7fc5a2049640 1 --2- 172.21.15.7:0/4108909492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc59c161600 0x7fc59c0b3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:32.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.111+0000 7fc5a1047640 1 --2- 172.21.15.7:0/4108909492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc59c15da20 0x7fc59c0b2e30 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0097a0 tx=0x7fc58c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:32.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.111+0000 7fc5927fc640 1 -- 172.21.15.7:0/4108909492 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c037040 con 0x7fc59c15da20 2024-04-25T10:00:32.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.111+0000 7fc5927fc640 1 -- 172.21.15.7:0/4108909492 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58c004030 con 0x7fc59c15da20 2024-04-25T10:00:32.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.111+0000 7fc5a3aac640 1 -- 172.21.15.7:0/4108909492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc59c0ce000 con 0x7fc59c15da20 2024-04-25T10:00:32.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.111+0000 7fc5927fc640 1 -- 172.21.15.7:0/4108909492 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c006e10 con 0x7fc59c15da20 2024-04-25T10:00:32.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.111+0000 7fc5a3aac640 1 -- 172.21.15.7:0/4108909492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc59c14deb0 con 0x7fc59c15da20 2024-04-25T10:00:32.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.112+0000 7fc5a3aac640 1 -- 172.21.15.7:0/4108909492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc59c069040 con 0x7fc59c15da20 2024-04-25T10:00:32.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.113+0000 7fc5927fc640 1 -- 172.21.15.7:0/4108909492 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc58c03d650 con 0x7fc59c15da20 2024-04-25T10:00:32.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.113+0000 7fc5927fc640 1 --2- 172.21.15.7:0/4108909492 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc58006b4d0 0x7fc58006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:32.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.113+0000 7fc5927fc640 1 -- 172.21.15.7:0/4108909492 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fc58c0aa870 con 0x7fc59c15da20 2024-04-25T10:00:32.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.113+0000 7fc5a1848640 1 --2- 172.21.15.7:0/4108909492 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc58006b4d0 0x7fc58006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:32.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.114+0000 7fc5a1848640 1 --2- 172.21.15.7:0/4108909492 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc58006b4d0 0x7fc58006d990 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc598000f60 tx=0x7fc598007b50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:32.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.117+0000 7fc5927fc640 1 -- 172.21.15.7:0/4108909492 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc58c042020 con 0x7fc59c15da20 2024-04-25T10:00:32.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.299+0000 7fc5a3aac640 1 -- 172.21.15.7:0/4108909492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc59c160e60 con 0x7fc59c15da20 2024-04-25T10:00:32.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.674+0000 7fc5927fc640 1 -- 172.21.15.7:0/4108909492 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v85) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc58c079940 con 0x7fc59c15da20 2024-04-25T10:00:32.679 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2024-04-25T10:00:32.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.677+0000 7fc5a3aac640 1 -- 172.21.15.7:0/4108909492 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc58006b4d0 msgr2=0x7fc58006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:32.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.677+0000 7fc5a3aac640 1 --2- 172.21.15.7:0/4108909492 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc58006b4d0 0x7fc58006d990 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc598000f60 tx=0x7fc598007b50 comp rx=0 tx=0).stop 2024-04-25T10:00:32.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.677+0000 7fc5a3aac640 1 -- 172.21.15.7:0/4108909492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc59c15da20 msgr2=0x7fc59c0b2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:32.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.677+0000 7fc5a3aac640 1 --2- 172.21.15.7:0/4108909492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc59c15da20 0x7fc59c0b2e30 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0097a0 tx=0x7fc58c0046c0 comp rx=0 tx=0).stop 2024-04-25T10:00:32.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.677+0000 7fc5a3aac640 1 -- 172.21.15.7:0/4108909492 shutdown_connections 2024-04-25T10:00:32.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.677+0000 7fc5a3aac640 1 --2- 172.21.15.7:0/4108909492 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc58006b4d0 0x7fc58006d990 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:32.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.677+0000 7fc5a3aac640 1 --2- 172.21.15.7:0/4108909492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc59c161600 0x7fc59c0b3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:32.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.677+0000 7fc5a3aac640 1 --2- 172.21.15.7:0/4108909492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc59c15da20 0x7fc59c0b2e30 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:32.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.677+0000 7fc5a3aac640 1 --2- 172.21.15.7:0/4108909492 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc59c06da00 0x7fc59c153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:32.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.677+0000 7fc5a3aac640 1 -- 172.21.15.7:0/4108909492 >> 172.21.15.7:0/4108909492 conn(0x7fc59c0b2300 msgr2=0x7fc59c15c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:32.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.677+0000 7fc5a3aac640 1 -- 172.21.15.7:0/4108909492 shutdown_connections 2024-04-25T10:00:32.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.678+0000 7fc5a3aac640 1 -- 172.21.15.7:0/4108909492 wait complete. 2024-04-25T10:00:32.697 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T10:00:32.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.803+0000 7fc4929d5640 1 Processor -- start 2024-04-25T10:00:32.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.803+0000 7fc4929d5640 1 -- start start 2024-04-25T10:00:32.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.804+0000 7fc4929d5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc48c15deb0 0x7fc48c0b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:32.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.804+0000 7fc4929d5640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc48c0d1a40 con 0x7fc48c0ce030 2024-04-25T10:00:32.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.804+0000 7fc4929d5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc48c0d1d20 con 0x7fc48c0d3760 2024-04-25T10:00:32.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.804+0000 7fc4929d5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0d2000 con 0x7fc48c15deb0 2024-04-25T10:00:32.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.804+0000 7fc48b7fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc48c0ce030 0x7fc48c0b69e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40574/0 (socket says 172.21.15.7:40574) 2024-04-25T10:00:32.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.804+0000 7fc48b7fe640 1 -- 172.21.15.7:0/1425343901 learned_addr learned my addr 172.21.15.7:0/1425343901 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:32.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.804+0000 7fc48affd640 1 -- 172.21.15.7:0/1425343901 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2666464385 0 0) 0x7fc48c0d1a40 con 0x7fc48c0ce030 2024-04-25T10:00:32.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.804+0000 7fc48affd640 1 -- 172.21.15.7:0/1425343901 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc474003520 con 0x7fc48c0ce030 2024-04-25T10:00:32.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.804+0000 7fc48bfff640 1 --2- 172.21.15.7:0/1425343901 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc48c15deb0 0x7fc48c0b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:32.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.804+0000 7fc48affd640 1 -- 172.21.15.7:0/1425343901 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2549215472 0 0) 0x7fc474003520 con 0x7fc48c0ce030 2024-04-25T10:00:32.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.804+0000 7fc48affd640 1 -- 172.21.15.7:0/1425343901 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc48c15deb0 msgr2=0x7fc48c0b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:32.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.804+0000 7fc48affd640 1 --2- 172.21.15.7:0/1425343901 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc48c15deb0 0x7fc48c0b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:32.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.804+0000 7fc48affd640 1 -- 172.21.15.7:0/1425343901 >> v1:172.21.15.55:6789/0 conn(0x7fc48c0d3760 legacy=0x7fc48c0d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:32.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.804+0000 7fc48affd640 1 -- 172.21.15.7:0/1425343901 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48c0d22e0 con 0x7fc48c0ce030 2024-04-25T10:00:32.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.804+0000 7fc48affd640 1 -- 172.21.15.7:0/1425343901 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fc47c001670 con 0x7fc48c0ce030 2024-04-25T10:00:32.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.805+0000 7fc48affd640 1 -- 172.21.15.7:0/1425343901 >> v1:172.21.15.7:6789/0 conn(0x7fc48c0ce030 legacy=0x7fc48c0b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:32.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.805+0000 7fc48affd640 1 --2- 172.21.15.7:0/1425343901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4740039e0 0x7fc474003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:32.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.805+0000 7fc48affd640 1 --2- 172.21.15.7:0/1425343901 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc48c15deb0 0x7fc474004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:32.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.805+0000 7fc48affd640 1 --2- 172.21.15.7:0/1425343901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc474004d40 0x7fc4740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:32.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.805+0000 7fc48affd640 1 -- 172.21.15.7:0/1425343901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0d2000 con 0x7fc474004d40 2024-04-25T10:00:32.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.805+0000 7fc48affd640 1 -- 172.21.15.7:0/1425343901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47400ba70 con 0x7fc4740039e0 2024-04-25T10:00:32.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.805+0000 7fc48affd640 1 -- 172.21.15.7:0/1425343901 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47400bc70 con 0x7fc48c15deb0 2024-04-25T10:00:32.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.805+0000 7fc490f72640 1 --2- 172.21.15.7:0/1425343901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc474004d40 0x7fc4740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:32.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.805+0000 7fc48bfff640 1 --2- 172.21.15.7:0/1425343901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4740039e0 0x7fc474003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:32.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.805+0000 7fc48b7fe640 1 --2- 172.21.15.7:0/1425343901 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc48c15deb0 0x7fc474004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:32.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.805+0000 7fc490f72640 1 -- 172.21.15.7:0/1425343901 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc48c15deb0 msgr2=0x7fc474004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:32.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.805+0000 7fc490f72640 1 --2- 172.21.15.7:0/1425343901 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc48c15deb0 0x7fc474004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:32.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.805+0000 7fc490f72640 1 -- 172.21.15.7:0/1425343901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4740039e0 msgr2=0x7fc474003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:32.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.805+0000 7fc490f72640 1 --2- 172.21.15.7:0/1425343901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4740039e0 0x7fc474003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:32.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.805+0000 7fc490f72640 1 -- 172.21.15.7:0/1425343901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc474003520 con 0x7fc474004d40 2024-04-25T10:00:32.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.806+0000 7fc490f72640 1 --2- 172.21.15.7:0/1425343901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc474004d40 0x7fc4740051c0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fc484001e20 tx=0x7fc474005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a5ccbdc5b2688ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:32.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.806+0000 7fc48affd640 1 -- 172.21.15.7:0/1425343901 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc484001a70 con 0x7fc474004d40 2024-04-25T10:00:32.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.806+0000 7fc48affd640 1 -- 172.21.15.7:0/1425343901 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48402ae40 con 0x7fc474004d40 2024-04-25T10:00:32.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.806+0000 7fc48affd640 1 -- 172.21.15.7:0/1425343901 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc484003bb0 con 0x7fc474004d40 2024-04-25T10:00:32.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.806+0000 7fc4929d5640 1 -- 172.21.15.7:0/1425343901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc474004d40 msgr2=0x7fc4740051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:32.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.806+0000 7fc4929d5640 1 --2- 172.21.15.7:0/1425343901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc474004d40 0x7fc4740051c0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fc484001e20 tx=0x7fc474005830 comp rx=0 tx=0).stop 2024-04-25T10:00:32.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.806+0000 7fc490f72640 1 -- 172.21.15.7:0/1425343901 reap_dead start 2024-04-25T10:00:32.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.806+0000 7fc4929d5640 1 -- 172.21.15.7:0/1425343901 shutdown_connections 2024-04-25T10:00:32.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.806+0000 7fc4929d5640 1 -- 172.21.15.7:0/1425343901 >> 172.21.15.7:0/1425343901 conn(0x7fc48c0726b0 msgr2=0x7fc48c072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:32.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.807+0000 7fc4929d5640 1 -- 172.21.15.7:0/1425343901 shutdown_connections 2024-04-25T10:00:32.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.807+0000 7fc4929d5640 1 -- 172.21.15.7:0/1425343901 wait complete. 2024-04-25T10:00:32.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.808+0000 7fc4929d5640 1 Processor -- start 2024-04-25T10:00:32.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.808+0000 7fc4929d5640 1 -- start start 2024-04-25T10:00:32.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.809+0000 7fc4929d5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48c159520 0x7fc48c0b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:32.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.809+0000 7fc4929d5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc48c0b1b80 0x7fc48c0b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:32.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.809+0000 7fc4929d5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc48c0b33d0 0x7fc48c1f3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:32.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.809+0000 7fc4929d5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0b70f0 con 0x7fc48c0b33d0 2024-04-25T10:00:32.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.809+0000 7fc4929d5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0ce490 con 0x7fc48c159520 2024-04-25T10:00:32.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.809+0000 7fc4929d5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0d31f0 con 0x7fc48c0b1b80 2024-04-25T10:00:32.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.809+0000 7fc490f72640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc48c0b33d0 0x7fc48c1f3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:32.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.809+0000 7fc490f72640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc48c0b33d0 0x7fc48c1f3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51108/0 (socket says 172.21.15.7:51108) 2024-04-25T10:00:32.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.809+0000 7fc490f72640 1 -- 172.21.15.7:0/471911065 learned_addr learned my addr 172.21.15.7:0/471911065 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:32.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.809+0000 7fc48bfff640 1 --2- 172.21.15.7:0/471911065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48c159520 0x7fc48c0b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:32.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.809+0000 7fc48b7fe640 1 --2- 172.21.15.7:0/471911065 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc48c0b1b80 0x7fc48c0b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:32.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.809+0000 7fc490f72640 1 -- 172.21.15.7:0/471911065 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc48c0b1b80 msgr2=0x7fc48c0b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:32.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.809+0000 7fc490f72640 1 --2- 172.21.15.7:0/471911065 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc48c0b1b80 0x7fc48c0b2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:32.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.809+0000 7fc490f72640 1 -- 172.21.15.7:0/471911065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48c159520 msgr2=0x7fc48c0b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:32.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.809+0000 7fc490f72640 1 --2- 172.21.15.7:0/471911065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48c159520 0x7fc48c0b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:32.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.809+0000 7fc490f72640 1 -- 172.21.15.7:0/471911065 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48c0b60e0 con 0x7fc48c0b33d0 2024-04-25T10:00:32.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.809+0000 7fc48b7fe640 1 --2- 172.21.15.7:0/471911065 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc48c0b1b80 0x7fc48c0b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:32.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.809+0000 7fc490f72640 1 --2- 172.21.15.7:0/471911065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc48c0b33d0 0x7fc48c1f3740 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fc484005040 tx=0x7fc4840014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:32.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.809+0000 7fc488ff9640 1 -- 172.21.15.7:0/471911065 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc484042070 con 0x7fc48c0b33d0 2024-04-25T10:00:32.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.809+0000 7fc488ff9640 1 -- 172.21.15.7:0/471911065 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc484003e10 con 0x7fc48c0b33d0 2024-04-25T10:00:32.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.809+0000 7fc4929d5640 1 -- 172.21.15.7:0/471911065 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc48c0b5040 con 0x7fc48c0b33d0 2024-04-25T10:00:32.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.809+0000 7fc488ff9640 1 -- 172.21.15.7:0/471911065 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc484037040 con 0x7fc48c0b33d0 2024-04-25T10:00:32.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.809+0000 7fc4929d5640 1 -- 172.21.15.7:0/471911065 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc48c0b5600 con 0x7fc48c0b33d0 2024-04-25T10:00:32.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.810+0000 7fc4929d5640 1 -- 172.21.15.7:0/471911065 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc48c068f60 con 0x7fc48c0b33d0 2024-04-25T10:00:32.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.811+0000 7fc488ff9640 1 -- 172.21.15.7:0/471911065 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc484045070 con 0x7fc48c0b33d0 2024-04-25T10:00:32.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.811+0000 7fc488ff9640 1 --2- 172.21.15.7:0/471911065 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc47806b500 0x7fc47806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:32.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.812+0000 7fc488ff9640 1 -- 172.21.15.7:0/471911065 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5619+0+0 (secure 0 0 0) 0x7fc4840a9790 con 0x7fc48c0b33d0 2024-04-25T10:00:32.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.812+0000 7fc48bfff640 1 --2- 172.21.15.7:0/471911065 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc47806b500 0x7fc47806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:32.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.812+0000 7fc48bfff640 1 --2- 172.21.15.7:0/471911065 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc47806b500 0x7fc47806d9c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc480009bc0 tx=0x7fc480009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:32.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.816+0000 7fc488ff9640 1 -- 172.21.15.7:0/471911065 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc484078720 con 0x7fc48c0b33d0 2024-04-25T10:00:33.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:32.999+0000 7fc4929d5640 1 -- 172.21.15.7:0/471911065 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc48c0b1f60 con 0x7fc48c0b33d0 2024-04-25T10:00:33.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.677+0000 7fc488ff9640 1 -- 172.21.15.7:0/471911065 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v86) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc484078020 con 0x7fc48c0b33d0 2024-04-25T10:00:33.682 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2024-04-25T10:00:33.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.681+0000 7fc4929d5640 1 -- 172.21.15.7:0/471911065 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc47806b500 msgr2=0x7fc47806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:33.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.681+0000 7fc4929d5640 1 --2- 172.21.15.7:0/471911065 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc47806b500 0x7fc47806d9c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc480009bc0 tx=0x7fc480009190 comp rx=0 tx=0).stop 2024-04-25T10:00:33.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.681+0000 7fc4929d5640 1 -- 172.21.15.7:0/471911065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc48c0b33d0 msgr2=0x7fc48c1f3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:33.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.681+0000 7fc4929d5640 1 --2- 172.21.15.7:0/471911065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc48c0b33d0 0x7fc48c1f3740 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fc484005040 tx=0x7fc4840014a0 comp rx=0 tx=0).stop 2024-04-25T10:00:33.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.681+0000 7fc4929d5640 1 -- 172.21.15.7:0/471911065 shutdown_connections 2024-04-25T10:00:33.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.681+0000 7fc4929d5640 1 --2- 172.21.15.7:0/471911065 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc47806b500 0x7fc47806d9c0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:33.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.681+0000 7fc4929d5640 1 --2- 172.21.15.7:0/471911065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc48c0b33d0 0x7fc48c1f3740 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:33.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.681+0000 7fc4929d5640 1 --2- 172.21.15.7:0/471911065 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc48c0b1b80 0x7fc48c0b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:33.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.681+0000 7fc4929d5640 1 --2- 172.21.15.7:0/471911065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48c159520 0x7fc48c0b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:33.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.681+0000 7fc4929d5640 1 -- 172.21.15.7:0/471911065 >> 172.21.15.7:0/471911065 conn(0x7fc48c0726b0 msgr2=0x7fc48c15d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:33.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.682+0000 7fc4929d5640 1 -- 172.21.15.7:0/471911065 shutdown_connections 2024-04-25T10:00:33.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.683+0000 7fc4929d5640 1 -- 172.21.15.7:0/471911065 wait complete. 2024-04-25T10:00:33.715 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T10:00:33.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.820+0000 7f288985d640 1 Processor -- start 2024-04-25T10:00:33.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.820+0000 7f288985d640 1 -- start start 2024-04-25T10:00:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.821+0000 7f288985d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28840d3760 0x7f288415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.821+0000 7f288985d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f288415f1c0 0x7f28840d3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.821+0000 7f288985d640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28840d4080 con 0x7f28840ce830 2024-04-25T10:00:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.821+0000 7f288985d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28840ce380 con 0x7f288415f1c0 2024-04-25T10:00:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.821+0000 7f288985d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288415f000 con 0x7f28840d3760 2024-04-25T10:00:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.821+0000 7f28837fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f28840ce830 0x7f28840b2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40580/0 (socket says 172.21.15.7:40580) 2024-04-25T10:00:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.821+0000 7f28837fe640 1 -- 172.21.15.7:0/2331961026 learned_addr learned my addr 172.21.15.7:0/2331961026 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.821+0000 7f28827fc640 1 --2- 172.21.15.7:0/2331961026 >> v2:172.21.15.55:3300/0 conn(0x7f288415f1c0 0x7f28840d3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.821+0000 7f2881ffb640 1 -- 172.21.15.7:0/2331961026 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513973512 0 0) 0x7f28840d4080 con 0x7f28840ce830 2024-04-25T10:00:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.821+0000 7f2882ffd640 1 --2- 172.21.15.7:0/2331961026 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28840d3760 0x7f288415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.821+0000 7f2881ffb640 1 -- 172.21.15.7:0/2331961026 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f286c003520 con 0x7f28840ce830 2024-04-25T10:00:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.821+0000 7f2881ffb640 1 -- 172.21.15.7:0/2331961026 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2835234106 0 0) 0x7f286c003520 con 0x7f28840ce830 2024-04-25T10:00:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.821+0000 7f2881ffb640 1 -- 172.21.15.7:0/2331961026 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28840d3760 msgr2=0x7f288415eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.821+0000 7f2881ffb640 1 --2- 172.21.15.7:0/2331961026 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28840d3760 0x7f288415eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.821+0000 7f2881ffb640 1 -- 172.21.15.7:0/2331961026 >> v2:172.21.15.55:3300/0 conn(0x7f288415f1c0 msgr2=0x7f28840d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.821+0000 7f2881ffb640 1 --2- 172.21.15.7:0/2331961026 >> v2:172.21.15.55:3300/0 conn(0x7f288415f1c0 0x7f28840d3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.822+0000 7f2881ffb640 1 -- 172.21.15.7:0/2331961026 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28840ced10 con 0x7f28840ce830 2024-04-25T10:00:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.822+0000 7f2881ffb640 1 -- 172.21.15.7:0/2331961026 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f287c0019f0 con 0x7f28840ce830 2024-04-25T10:00:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.822+0000 7f2881ffb640 1 -- 172.21.15.7:0/2331961026 >> v1:172.21.15.7:6789/0 conn(0x7f28840ce830 legacy=0x7f28840b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.822+0000 7f2881ffb640 1 --2- 172.21.15.7:0/2331961026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f286c0039e0 0x7f286c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.822+0000 7f2881ffb640 1 --2- 172.21.15.7:0/2331961026 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28840d3760 0x7f286c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.822+0000 7f2881ffb640 1 --2- 172.21.15.7:0/2331961026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f286c004d40 0x7f286c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.822+0000 7f2881ffb640 1 -- 172.21.15.7:0/2331961026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288415f000 con 0x7f286c004d40 2024-04-25T10:00:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.822+0000 7f2881ffb640 1 -- 172.21.15.7:0/2331961026 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286c00b9c0 con 0x7f286c0039e0 2024-04-25T10:00:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.822+0000 7f2881ffb640 1 -- 172.21.15.7:0/2331961026 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286c00bb40 con 0x7f28840d3760 2024-04-25T10:00:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.822+0000 7f28837fe640 1 --2- 172.21.15.7:0/2331961026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f286c004d40 0x7f286c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.822+0000 7f2882ffd640 1 --2- 172.21.15.7:0/2331961026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f286c0039e0 0x7f286c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.822+0000 7f28827fc640 1 --2- 172.21.15.7:0/2331961026 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28840d3760 0x7f286c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.822+0000 7f28837fe640 1 -- 172.21.15.7:0/2331961026 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28840d3760 msgr2=0x7f286c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.822+0000 7f28837fe640 1 --2- 172.21.15.7:0/2331961026 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28840d3760 0x7f286c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.822+0000 7f28837fe640 1 -- 172.21.15.7:0/2331961026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f286c0039e0 msgr2=0x7f286c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.822+0000 7f28837fe640 1 --2- 172.21.15.7:0/2331961026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f286c0039e0 0x7f286c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.822+0000 7f28837fe640 1 -- 172.21.15.7:0/2331961026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c003520 con 0x7f286c004d40 2024-04-25T10:00:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.822+0000 7f28827fc640 1 --2- 172.21.15.7:0/2331961026 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28840d3760 0x7f286c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.823+0000 7f28837fe640 1 --2- 172.21.15.7:0/2331961026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f286c004d40 0x7f286c0051c0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f287c00a840 tx=0x7f286c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=331d223faef31c95 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.823+0000 7f2881ffb640 1 -- 172.21.15.7:0/2331961026 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c00a460 con 0x7f286c004d40 2024-04-25T10:00:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.823+0000 7f2881ffb640 1 -- 172.21.15.7:0/2331961026 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c02f070 con 0x7f286c004d40 2024-04-25T10:00:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.823+0000 7f2881ffb640 1 -- 172.21.15.7:0/2331961026 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c02bc70 con 0x7f286c004d40 2024-04-25T10:00:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.823+0000 7f288985d640 1 -- 172.21.15.7:0/2331961026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f286c004d40 msgr2=0x7f286c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.823+0000 7f288985d640 1 --2- 172.21.15.7:0/2331961026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f286c004d40 0x7f286c0051c0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f287c00a840 tx=0x7f286c005830 comp rx=0 tx=0).stop 2024-04-25T10:00:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.823+0000 7f28837fe640 1 -- 172.21.15.7:0/2331961026 reap_dead start 2024-04-25T10:00:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.824+0000 7f288985d640 1 -- 172.21.15.7:0/2331961026 shutdown_connections 2024-04-25T10:00:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.824+0000 7f288985d640 1 -- 172.21.15.7:0/2331961026 >> 172.21.15.7:0/2331961026 conn(0x7f2884072680 msgr2=0x7f2884072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.824+0000 7f288985d640 1 -- 172.21.15.7:0/2331961026 shutdown_connections 2024-04-25T10:00:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.824+0000 7f288985d640 1 -- 172.21.15.7:0/2331961026 wait complete. 2024-04-25T10:00:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.825+0000 7f288985d640 1 Processor -- start 2024-04-25T10:00:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.825+0000 7f288985d640 1 -- start start 2024-04-25T10:00:33.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.826+0000 7f288985d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28841f3290 0x7f2884159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:33.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.826+0000 7f288985d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28841f3670 0x7f288415a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:33.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.826+0000 7f288985d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2884157e60 0x7f2884158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:33.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.826+0000 7f288985d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28840d1e20 con 0x7f28841f3670 2024-04-25T10:00:33.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.826+0000 7f288985d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28840d2190 con 0x7f2884157e60 2024-04-25T10:00:33.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.826+0000 7f288985d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288415de10 con 0x7f28841f3290 2024-04-25T10:00:33.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.826+0000 7f28827fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28841f3670 0x7f288415a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.826+0000 7f28827fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28841f3670 0x7f288415a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51130/0 (socket says 172.21.15.7:51130) 2024-04-25T10:00:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.826+0000 7f28827fc640 1 -- 172.21.15.7:0/1757749189 learned_addr learned my addr 172.21.15.7:0/1757749189 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.826+0000 7f2882ffd640 1 --2- 172.21.15.7:0/1757749189 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28841f3290 0x7f2884159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.826+0000 7f28827fc640 1 -- 172.21.15.7:0/1757749189 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28841f3290 msgr2=0x7f2884159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.826+0000 7f28837fe640 1 --2- 172.21.15.7:0/1757749189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2884157e60 0x7f2884158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.826+0000 7f28827fc640 1 --2- 172.21.15.7:0/1757749189 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28841f3290 0x7f2884159ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.826+0000 7f28827fc640 1 -- 172.21.15.7:0/1757749189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2884157e60 msgr2=0x7f2884158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.826+0000 7f28827fc640 1 --2- 172.21.15.7:0/1757749189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2884157e60 0x7f2884158310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.826+0000 7f28827fc640 1 -- 172.21.15.7:0/1757749189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2884158b90 con 0x7f28841f3670 2024-04-25T10:00:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.826+0000 7f28827fc640 1 --2- 172.21.15.7:0/1757749189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28841f3670 0x7f288415a410 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f28780115e0 tx=0x7f2878011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.826+0000 7f286bfff640 1 -- 172.21.15.7:0/1757749189 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287800f8f0 con 0x7f28841f3670 2024-04-25T10:00:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.826+0000 7f286bfff640 1 -- 172.21.15.7:0/1757749189 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287800fa90 con 0x7f28841f3670 2024-04-25T10:00:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.826+0000 7f288985d640 1 -- 172.21.15.7:0/1757749189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2884158e70 con 0x7f28841f3670 2024-04-25T10:00:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.826+0000 7f286bfff640 1 -- 172.21.15.7:0/1757749189 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287800fe40 con 0x7f28841f3670 2024-04-25T10:00:33.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.826+0000 7f288985d640 1 -- 172.21.15.7:0/1757749189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2884159430 con 0x7f28841f3670 2024-04-25T10:00:33.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.827+0000 7f288985d640 1 -- 172.21.15.7:0/1757749189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2884068f60 con 0x7f28841f3670 2024-04-25T10:00:33.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.828+0000 7f286bfff640 1 -- 172.21.15.7:0/1757749189 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2878015460 con 0x7f28841f3670 2024-04-25T10:00:33.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.829+0000 7f286bfff640 1 --2- 172.21.15.7:0/1757749189 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f287006b4d0 0x7f287006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:33.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.829+0000 7f286bfff640 1 -- 172.21.15.7:0/1757749189 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6001+0+0 (secure 0 0 0) 0x7f287808ad30 con 0x7f28841f3670 2024-04-25T10:00:33.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.829+0000 7f2882ffd640 1 --2- 172.21.15.7:0/1757749189 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f287006b4d0 0x7f287006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:33.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.829+0000 7f2882ffd640 1 --2- 172.21.15.7:0/1757749189 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f287006b4d0 0x7f287006d990 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2874009980 tx=0x7f2874008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:33.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:33.833+0000 7f286bfff640 1 -- 172.21.15.7:0/1757749189 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2878019030 con 0x7f28841f3670 2024-04-25T10:00:34.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.053+0000 7f288985d640 1 -- 172.21.15.7:0/1757749189 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f28840ce610 con 0x7f28841f3670 2024-04-25T10:00:34.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.690+0000 7f286bfff640 1 -- 172.21.15.7:0/1757749189 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v51) v1 ==== 174+0+0 (secure 0 0 0) 0x7f2878059a80 con 0x7f28841f3670 2024-04-25T10:00:34.695 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 13 and data pool 14 2024-04-25T10:00:34.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.700+0000 7f288985d640 1 -- 172.21.15.7:0/1757749189 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f287006b4d0 msgr2=0x7f287006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:34.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.700+0000 7f288985d640 1 --2- 172.21.15.7:0/1757749189 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f287006b4d0 0x7f287006d990 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2874009980 tx=0x7f2874008040 comp rx=0 tx=0).stop 2024-04-25T10:00:34.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.700+0000 7f288985d640 1 -- 172.21.15.7:0/1757749189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28841f3670 msgr2=0x7f288415a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:34.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.700+0000 7f288985d640 1 --2- 172.21.15.7:0/1757749189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28841f3670 0x7f288415a410 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f28780115e0 tx=0x7f2878011aa0 comp rx=0 tx=0).stop 2024-04-25T10:00:34.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.702+0000 7f288985d640 1 -- 172.21.15.7:0/1757749189 shutdown_connections 2024-04-25T10:00:34.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.702+0000 7f288985d640 1 --2- 172.21.15.7:0/1757749189 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f287006b4d0 0x7f287006d990 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:34.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.703+0000 7f288985d640 1 --2- 172.21.15.7:0/1757749189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2884157e60 0x7f2884158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:34.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.703+0000 7f288985d640 1 --2- 172.21.15.7:0/1757749189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28841f3670 0x7f288415a410 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:34.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.703+0000 7f288985d640 1 --2- 172.21.15.7:0/1757749189 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28841f3290 0x7f2884159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:34.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.703+0000 7f288985d640 1 -- 172.21.15.7:0/1757749189 >> 172.21.15.7:0/1757749189 conn(0x7f2884072680 msgr2=0x7f28840c97d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:34.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.706+0000 7f288985d640 1 -- 172.21.15.7:0/1757749189 shutdown_connections 2024-04-25T10:00:34.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.706+0000 7f288985d640 1 -- 172.21.15.7:0/1757749189 wait complete. 2024-04-25T10:00:34.730 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:00:34.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.831+0000 7fe64189e640 1 Processor -- start 2024-04-25T10:00:34.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.831+0000 7fe64189e640 1 -- start start 2024-04-25T10:00:34.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.832+0000 7fe64189e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe63c144100 0x7fe63c0cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:34.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.832+0000 7fe64189e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe63c0ced20 0x7fe63c06e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:34.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.832+0000 7fe64189e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe63c06e7a0 0x7fe63c15e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:34.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.832+0000 7fe64189e640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe63c1444e0 con 0x7fe63c144100 2024-04-25T10:00:34.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.832+0000 7fe64189e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe63c15ac70 con 0x7fe63c0ced20 2024-04-25T10:00:34.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.832+0000 7fe64189e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c0cdbf0 con 0x7fe63c06e7a0 2024-04-25T10:00:34.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.832+0000 7fe63affd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe63c144100 0x7fe63c0cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:34.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.832+0000 7fe63affd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe63c144100 0x7fe63c0cd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51140/0 (socket says 172.21.15.7:51140) 2024-04-25T10:00:34.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.832+0000 7fe63affd640 1 -- 172.21.15.7:0/3231049945 learned_addr learned my addr 172.21.15.7:0/3231049945 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:34.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.832+0000 7fe63affd640 1 -- 172.21.15.7:0/3231049945 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe63c06e7a0 msgr2=0x7fe63c15e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:34.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.832+0000 7fe63affd640 1 --2- 172.21.15.7:0/3231049945 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe63c06e7a0 0x7fe63c15e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:34.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.832+0000 7fe63affd640 1 -- 172.21.15.7:0/3231049945 >> v2:172.21.15.55:3300/0 conn(0x7fe63c0ced20 msgr2=0x7fe63c06e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:34.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.832+0000 7fe63a7fc640 1 --2- 172.21.15.7:0/3231049945 >> v2:172.21.15.55:3300/0 conn(0x7fe63c0ced20 0x7fe63c06e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:34.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.833+0000 7fe63affd640 1 --2- 172.21.15.7:0/3231049945 >> v2:172.21.15.55:3300/0 conn(0x7fe63c0ced20 0x7fe63c06e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:34.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.833+0000 7fe63affd640 1 -- 172.21.15.7:0/3231049945 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63c0cded0 con 0x7fe63c144100 2024-04-25T10:00:34.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.833+0000 7fe63affd640 1 --2- 172.21.15.7:0/3231049945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe63c144100 0x7fe63c0cd610 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fe63c0c6790 tx=0x7fe63402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81669f4b6b2fbcf4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:34.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.833+0000 7fe639ffb640 1 -- 172.21.15.7:0/3231049945 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe634037070 con 0x7fe63c144100 2024-04-25T10:00:34.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.833+0000 7fe639ffb640 1 -- 172.21.15.7:0/3231049945 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe634032440 con 0x7fe63c144100 2024-04-25T10:00:34.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.833+0000 7fe639ffb640 1 -- 172.21.15.7:0/3231049945 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe634032810 con 0x7fe63c144100 2024-04-25T10:00:34.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.834+0000 7fe64189e640 1 -- 172.21.15.7:0/3231049945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe63c144100 msgr2=0x7fe63c0cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:34.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.834+0000 7fe64189e640 1 --2- 172.21.15.7:0/3231049945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe63c144100 0x7fe63c0cd610 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fe63c0c6790 tx=0x7fe63402a1e0 comp rx=0 tx=0).stop 2024-04-25T10:00:34.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.834+0000 7fe64189e640 1 -- 172.21.15.7:0/3231049945 shutdown_connections 2024-04-25T10:00:34.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.834+0000 7fe64189e640 1 --2- 172.21.15.7:0/3231049945 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe63c06e7a0 0x7fe63c15e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:34.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.834+0000 7fe64189e640 1 --2- 172.21.15.7:0/3231049945 >> v2:172.21.15.55:3300/0 conn(0x7fe63c0ced20 0x7fe63c06e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:34.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.834+0000 7fe64189e640 1 --2- 172.21.15.7:0/3231049945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe63c144100 0x7fe63c0cd610 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:34.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.834+0000 7fe64189e640 1 -- 172.21.15.7:0/3231049945 >> 172.21.15.7:0/3231049945 conn(0x7fe63c071150 msgr2=0x7fe63c071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:34.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.834+0000 7fe64189e640 1 -- 172.21.15.7:0/3231049945 shutdown_connections 2024-04-25T10:00:34.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.834+0000 7fe64189e640 1 -- 172.21.15.7:0/3231049945 wait complete. 2024-04-25T10:00:34.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.835+0000 7fe64189e640 1 Processor -- start 2024-04-25T10:00:34.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.835+0000 7fe64189e640 1 -- start start 2024-04-25T10:00:34.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.836+0000 7fe64189e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe63c06e7a0 0x7fe63c164560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:34.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.836+0000 7fe64189e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe63c0ced20 0x7fe63c13cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:34.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.836+0000 7fe64189e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe63c144100 0x7fe63c13d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:34.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.836+0000 7fe64189e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c0cea00 con 0x7fe63c144100 2024-04-25T10:00:34.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.836+0000 7fe64189e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c0ce490 con 0x7fe63c06e7a0 2024-04-25T10:00:34.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.836+0000 7fe64189e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c15e7a0 con 0x7fe63c0ced20 2024-04-25T10:00:34.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.836+0000 7fe63b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe63c144100 0x7fe63c13d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:34.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.836+0000 7fe63b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe63c144100 0x7fe63c13d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51150/0 (socket says 172.21.15.7:51150) 2024-04-25T10:00:34.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.836+0000 7fe63b7fe640 1 -- 172.21.15.7:0/3549158092 learned_addr learned my addr 172.21.15.7:0/3549158092 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:34.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.836+0000 7fe63affd640 1 --2- 172.21.15.7:0/3549158092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe63c06e7a0 0x7fe63c164560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:34.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.836+0000 7fe63a7fc640 1 --2- 172.21.15.7:0/3549158092 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe63c0ced20 0x7fe63c13cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:34.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.837+0000 7fe63b7fe640 1 -- 172.21.15.7:0/3549158092 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe63c0ced20 msgr2=0x7fe63c13cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:34.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.837+0000 7fe63b7fe640 1 --2- 172.21.15.7:0/3549158092 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe63c0ced20 0x7fe63c13cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:34.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.837+0000 7fe63b7fe640 1 -- 172.21.15.7:0/3549158092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe63c06e7a0 msgr2=0x7fe63c164560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:34.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.837+0000 7fe63b7fe640 1 --2- 172.21.15.7:0/3549158092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe63c06e7a0 0x7fe63c164560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:34.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.837+0000 7fe63b7fe640 1 -- 172.21.15.7:0/3549158092 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63c164aa0 con 0x7fe63c144100 2024-04-25T10:00:34.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.837+0000 7fe63b7fe640 1 --2- 172.21.15.7:0/3549158092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe63c144100 0x7fe63c13d3e0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fe62c00b970 tx=0x7fe62c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:34.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.837+0000 7fe623fff640 1 -- 172.21.15.7:0/3549158092 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c019070 con 0x7fe63c144100 2024-04-25T10:00:34.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.837+0000 7fe623fff640 1 -- 172.21.15.7:0/3549158092 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62c00cb60 con 0x7fe63c144100 2024-04-25T10:00:34.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.837+0000 7fe64189e640 1 -- 172.21.15.7:0/3549158092 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe63c1448b0 con 0x7fe63c144100 2024-04-25T10:00:34.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.837+0000 7fe623fff640 1 -- 172.21.15.7:0/3549158092 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c014440 con 0x7fe63c144100 2024-04-25T10:00:34.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.837+0000 7fe64189e640 1 -- 172.21.15.7:0/3549158092 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe63c144e70 con 0x7fe63c144100 2024-04-25T10:00:34.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.838+0000 7fe64189e640 1 -- 172.21.15.7:0/3549158092 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe63c068fd0 con 0x7fe63c144100 2024-04-25T10:00:34.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.839+0000 7fe623fff640 1 -- 172.21.15.7:0/3549158092 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe62c01c070 con 0x7fe63c144100 2024-04-25T10:00:34.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.839+0000 7fe623fff640 1 --2- 172.21.15.7:0/3549158092 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe62806b4d0 0x7fe62806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:34.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.839+0000 7fe623fff640 1 -- 172.21.15.7:0/3549158092 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe62c08a000 con 0x7fe63c144100 2024-04-25T10:00:34.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.839+0000 7fe63affd640 1 --2- 172.21.15.7:0/3549158092 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe62806b4d0 0x7fe62806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:34.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.840+0000 7fe63affd640 1 --2- 172.21.15.7:0/3549158092 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe62806b4d0 0x7fe62806d990 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fe634034000 tx=0x7fe63402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:34.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:34.843+0000 7fe623fff640 1 -- 172.21.15.7:0/3549158092 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe63c164aa0 con 0x7fe63c144100 2024-04-25T10:00:35.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.025+0000 7fe64189e640 1 -- 172.21.15.7:0/3549158092 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe63c06f470 con 0x7fe63c144100 2024-04-25T10:00:35.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.027+0000 7fe623fff640 1 -- 172.21.15.7:0/3549158092 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+16802 (secure 0 0 0) 0x7fe62c0586a0 con 0x7fe63c144100 2024-04-25T10:00:35.031 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:00:35.031 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":87,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:00:34.054449+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:00:32.330930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T10:00:33.030728+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:00:35.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.029+0000 7fe64189e640 1 -- 172.21.15.7:0/3549158092 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe62806b4d0 msgr2=0x7fe62806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:35.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.029+0000 7fe64189e640 1 --2- 172.21.15.7:0/3549158092 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe62806b4d0 0x7fe62806d990 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fe634034000 tx=0x7fe63402e000 comp rx=0 tx=0).stop 2024-04-25T10:00:35.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.029+0000 7fe64189e640 1 -- 172.21.15.7:0/3549158092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe63c144100 msgr2=0x7fe63c13d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:35.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.029+0000 7fe64189e640 1 --2- 172.21.15.7:0/3549158092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe63c144100 0x7fe63c13d3e0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fe62c00b970 tx=0x7fe62c00be30 comp rx=0 tx=0).stop 2024-04-25T10:00:35.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.029+0000 7fe64189e640 1 -- 172.21.15.7:0/3549158092 shutdown_connections 2024-04-25T10:00:35.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.029+0000 7fe64189e640 1 --2- 172.21.15.7:0/3549158092 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe62806b4d0 0x7fe62806d990 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:35.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.029+0000 7fe64189e640 1 --2- 172.21.15.7:0/3549158092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe63c144100 0x7fe63c13d3e0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:35.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.029+0000 7fe64189e640 1 --2- 172.21.15.7:0/3549158092 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe63c0ced20 0x7fe63c13cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:35.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.029+0000 7fe64189e640 1 --2- 172.21.15.7:0/3549158092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe63c06e7a0 0x7fe63c164560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:35.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.029+0000 7fe64189e640 1 -- 172.21.15.7:0/3549158092 >> 172.21.15.7:0/3549158092 conn(0x7fe63c071150 msgr2=0x7fe63c15b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:35.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.029+0000 7fe64189e640 1 -- 172.21.15.7:0/3549158092 shutdown_connections 2024-04-25T10:00:35.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.029+0000 7fe64189e640 1 -- 172.21.15.7:0/3549158092 wait complete. 2024-04-25T10:00:35.044 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:00:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.140+0000 7efdf54d8640 1 Processor -- start 2024-04-25T10:00:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.140+0000 7efdf54d8640 1 -- start start 2024-04-25T10:00:35.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.141+0000 7efdf54d8640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efdf00cd740 0x7efdf00d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:35.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.141+0000 7efdf54d8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efdf006cd90 0x7efdf00cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:35.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.141+0000 7efdf54d8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf0099b90 con 0x7efdf00d08d0 2024-04-25T10:00:35.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.141+0000 7efdf54d8640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf00cdb20 con 0x7efdf00cd740 2024-04-25T10:00:35.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.141+0000 7efdf54d8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf0099e70 con 0x7efdf006cd90 2024-04-25T10:00:35.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.141+0000 7efdeeffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efdf00cd740 0x7efdf00d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:35.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.141+0000 7efdeeffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efdf00cd740 0x7efdf00d0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51154/0 (socket says 172.21.15.7:51154) 2024-04-25T10:00:35.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.141+0000 7efdeeffd640 1 -- 172.21.15.7:0/400769245 learned_addr learned my addr 172.21.15.7:0/400769245 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:35.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.141+0000 7efdeeffd640 1 -- 172.21.15.7:0/400769245 >> v2:172.21.15.55:3300/0 conn(0x7efdf006cd90 msgr2=0x7efdf00cbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:35.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.141+0000 7efdef7fe640 1 --2- 172.21.15.7:0/400769245 >> v2:172.21.15.55:3300/0 conn(0x7efdf006cd90 0x7efdf00cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:35.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.141+0000 7efdeeffd640 1 --2- 172.21.15.7:0/400769245 >> v2:172.21.15.55:3300/0 conn(0x7efdf006cd90 0x7efdf00cbc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:35.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.141+0000 7efdeeffd640 1 -- 172.21.15.7:0/400769245 >> v1:172.21.15.55:6789/0 conn(0x7efdf00d08d0 legacy=0x7efdf006c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:35.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.141+0000 7efdeeffd640 1 -- 172.21.15.7:0/400769245 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf009a150 con 0x7efdf00cd740 2024-04-25T10:00:35.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.142+0000 7efdeeffd640 1 --2- 172.21.15.7:0/400769245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdf00cd740 0x7efdf00d0390 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7efdf00cdfe0 tx=0x7efde802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81636b3946d7aff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:35.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.142+0000 7efdedffb640 1 -- 172.21.15.7:0/400769245 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde8037070 con 0x7efdf00cd740 2024-04-25T10:00:35.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.142+0000 7efdedffb640 1 -- 172.21.15.7:0/400769245 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde8032440 con 0x7efdf00cd740 2024-04-25T10:00:35.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.142+0000 7efdedffb640 1 -- 172.21.15.7:0/400769245 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde8032810 con 0x7efdf00cd740 2024-04-25T10:00:35.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.143+0000 7efdf54d8640 1 -- 172.21.15.7:0/400769245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdf00cd740 msgr2=0x7efdf00d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:35.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.143+0000 7efdf54d8640 1 --2- 172.21.15.7:0/400769245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdf00cd740 0x7efdf00d0390 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7efdf00cdfe0 tx=0x7efde802a230 comp rx=0 tx=0).stop 2024-04-25T10:00:35.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.143+0000 7efdf54d8640 1 -- 172.21.15.7:0/400769245 shutdown_connections 2024-04-25T10:00:35.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.143+0000 7efdf54d8640 1 --2- 172.21.15.7:0/400769245 >> v2:172.21.15.55:3300/0 conn(0x7efdf006cd90 0x7efdf00cbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:35.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.143+0000 7efdf54d8640 1 --2- 172.21.15.7:0/400769245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdf00cd740 0x7efdf00d0390 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:35.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.143+0000 7efdf54d8640 1 -- 172.21.15.7:0/400769245 >> 172.21.15.7:0/400769245 conn(0x7efdf00b3130 msgr2=0x7efdf00b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:35.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.143+0000 7efdf54d8640 1 -- 172.21.15.7:0/400769245 shutdown_connections 2024-04-25T10:00:35.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.143+0000 7efdf54d8640 1 -- 172.21.15.7:0/400769245 wait complete. 2024-04-25T10:00:35.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.144+0000 7efdf54d8640 1 Processor -- start 2024-04-25T10:00:35.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.144+0000 7efdf54d8640 1 -- start start 2024-04-25T10:00:35.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.145+0000 7efdf54d8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdf006cd90 0x7efdf01f4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:35.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.145+0000 7efdf54d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdf00cd740 0x7efdf01f5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:35.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.145+0000 7efdf54d8640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efdf00d08d0 0x7efdf00cc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:35.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.145+0000 7efdf54d8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf009ac30 con 0x7efdf006cd90 2024-04-25T10:00:35.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.145+0000 7efdf54d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf009a710 con 0x7efdf00cd740 2024-04-25T10:00:35.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.145+0000 7efdf54d8640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf009adb0 con 0x7efdf00d08d0 2024-04-25T10:00:35.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.145+0000 7efdeeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdf006cd90 0x7efdf01f4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:35.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.145+0000 7efdeeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdf006cd90 0x7efdf01f4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51156/0 (socket says 172.21.15.7:51156) 2024-04-25T10:00:35.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.145+0000 7efdeeffd640 1 -- 172.21.15.7:0/4088654901 learned_addr learned my addr 172.21.15.7:0/4088654901 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:35.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.145+0000 7efdeeffd640 1 -- 172.21.15.7:0/4088654901 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efdf00d08d0 msgr2=0x7efdf00cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:35.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.145+0000 7efdeeffd640 1 --2- 172.21.15.7:0/4088654901 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efdf00d08d0 0x7efdf00cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:35.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.145+0000 7efdeeffd640 1 -- 172.21.15.7:0/4088654901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdf00cd740 msgr2=0x7efdf01f5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:35.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.145+0000 7efdeeffd640 1 --2- 172.21.15.7:0/4088654901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdf00cd740 0x7efdf01f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:35.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.145+0000 7efdeeffd640 1 -- 172.21.15.7:0/4088654901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf0159ec0 con 0x7efdf006cd90 2024-04-25T10:00:35.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.146+0000 7efdeeffd640 1 --2- 172.21.15.7:0/4088654901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdf006cd90 0x7efdf01f4e50 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7efde8000c00 tx=0x7efde80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:35.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.146+0000 7efde77fe640 1 -- 172.21.15.7:0/4088654901 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde8037040 con 0x7efdf006cd90 2024-04-25T10:00:35.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.146+0000 7efde77fe640 1 -- 172.21.15.7:0/4088654901 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde8042070 con 0x7efdf006cd90 2024-04-25T10:00:35.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.146+0000 7efdf54d8640 1 -- 172.21.15.7:0/4088654901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf015a160 con 0x7efdf006cd90 2024-04-25T10:00:35.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.146+0000 7efde77fe640 1 -- 172.21.15.7:0/4088654901 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde8030bb0 con 0x7efdf006cd90 2024-04-25T10:00:35.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.146+0000 7efdf54d8640 1 -- 172.21.15.7:0/4088654901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf015a720 con 0x7efdf006cd90 2024-04-25T10:00:35.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.147+0000 7efdf54d8640 1 -- 172.21.15.7:0/4088654901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf0068fd0 con 0x7efdf006cd90 2024-04-25T10:00:35.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.147+0000 7efde77fe640 1 -- 172.21.15.7:0/4088654901 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efde8047460 con 0x7efdf006cd90 2024-04-25T10:00:35.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.148+0000 7efde77fe640 1 --2- 172.21.15.7:0/4088654901 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efdd006b500 0x7efdd006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:35.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.148+0000 7efde77fe640 1 -- 172.21.15.7:0/4088654901 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6101+0+0 (secure 0 0 0) 0x7efde80aaf10 con 0x7efdf006cd90 2024-04-25T10:00:35.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.148+0000 7efdee7fc640 1 --2- 172.21.15.7:0/4088654901 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efdd006b500 0x7efdd006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:35.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.148+0000 7efdee7fc640 1 --2- 172.21.15.7:0/4088654901 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efdd006b500 0x7efdd006d9c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7efdf015c460 tx=0x7efdd80079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:35.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.152+0000 7efde77fe640 1 -- 172.21.15.7:0/4088654901 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efde8045360 con 0x7efdf006cd90 2024-04-25T10:00:35.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.334+0000 7efdf54d8640 1 -- 172.21.15.7:0/4088654901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efdf00b4040 con 0x7efdf006cd90 2024-04-25T10:00:35.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.335+0000 7efde77fe640 1 -- 172.21.15.7:0/4088654901 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+16802 (secure 0 0 0) 0x7efde8079c90 con 0x7efdf006cd90 2024-04-25T10:00:35.339 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:00:35.340 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":87,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:00:34.054449+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:00:32.330930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T10:00:33.030728+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:00:35.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.337+0000 7efdf54d8640 1 -- 172.21.15.7:0/4088654901 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efdd006b500 msgr2=0x7efdd006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:35.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.337+0000 7efdf54d8640 1 --2- 172.21.15.7:0/4088654901 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efdd006b500 0x7efdd006d9c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7efdf015c460 tx=0x7efdd80079b0 comp rx=0 tx=0).stop 2024-04-25T10:00:35.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.337+0000 7efdf54d8640 1 -- 172.21.15.7:0/4088654901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdf006cd90 msgr2=0x7efdf01f4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:35.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.337+0000 7efdf54d8640 1 --2- 172.21.15.7:0/4088654901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdf006cd90 0x7efdf01f4e50 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7efde8000c00 tx=0x7efde80046c0 comp rx=0 tx=0).stop 2024-04-25T10:00:35.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.337+0000 7efdf54d8640 1 -- 172.21.15.7:0/4088654901 shutdown_connections 2024-04-25T10:00:35.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.337+0000 7efdf54d8640 1 --2- 172.21.15.7:0/4088654901 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efdd006b500 0x7efdd006d9c0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:35.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.337+0000 7efdf54d8640 1 --2- 172.21.15.7:0/4088654901 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efdf00d08d0 0x7efdf00cc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:35.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.337+0000 7efdf54d8640 1 --2- 172.21.15.7:0/4088654901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdf00cd740 0x7efdf01f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:35.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.337+0000 7efdf54d8640 1 --2- 172.21.15.7:0/4088654901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdf006cd90 0x7efdf01f4e50 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:35.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.337+0000 7efdf54d8640 1 -- 172.21.15.7:0/4088654901 >> 172.21.15.7:0/4088654901 conn(0x7efdf00b3130 msgr2=0x7efdf00b5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:35.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.337+0000 7efdf54d8640 1 -- 172.21.15.7:0/4088654901 shutdown_connections 2024-04-25T10:00:35.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.337+0000 7efdf54d8640 1 -- 172.21.15.7:0/4088654901 wait complete. 2024-04-25T10:00:35.352 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T10:00:35.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.451+0000 7f4391322640 1 Processor -- start 2024-04-25T10:00:35.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.452+0000 7f4391322640 1 -- start start 2024-04-25T10:00:35.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.452+0000 7f4391322640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f438c15f1c0 0x7f438c15eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:35.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.452+0000 7f4391322640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f438c0ced10 con 0x7f438c0d3760 2024-04-25T10:00:35.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.452+0000 7f4391322640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f438c0d1b40 con 0x7f438c0ce830 2024-04-25T10:00:35.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.452+0000 7f4391322640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438c0ce380 con 0x7f438c15f1c0 2024-04-25T10:00:35.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.452+0000 7f438affd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f438c0d3760 0x7f438c0d3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40588/0 (socket says 172.21.15.7:40588) 2024-04-25T10:00:35.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.452+0000 7f438affd640 1 -- 172.21.15.7:0/788624562 learned_addr learned my addr 172.21.15.7:0/788624562 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:35.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.453+0000 7f438a7fc640 1 --2- 172.21.15.7:0/788624562 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f438c15f1c0 0x7f438c15eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:35.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.453+0000 7f4389ffb640 1 -- 172.21.15.7:0/788624562 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1239853641 0 0) 0x7f438c0ced10 con 0x7f438c0d3760 2024-04-25T10:00:35.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.453+0000 7f4389ffb640 1 -- 172.21.15.7:0/788624562 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4378003520 con 0x7f438c0d3760 2024-04-25T10:00:35.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.453+0000 7f4389ffb640 1 -- 172.21.15.7:0/788624562 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2651585174 0 0) 0x7f438c0d1b40 con 0x7f438c0ce830 2024-04-25T10:00:35.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.453+0000 7f4389ffb640 1 -- 172.21.15.7:0/788624562 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f438c0ced10 con 0x7f438c0ce830 2024-04-25T10:00:35.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.453+0000 7f4389ffb640 1 -- 172.21.15.7:0/788624562 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1352411089 0 0) 0x7f4378003520 con 0x7f438c0d3760 2024-04-25T10:00:35.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.453+0000 7f4389ffb640 1 -- 172.21.15.7:0/788624562 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f438c15f1c0 msgr2=0x7f438c15eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:35.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.453+0000 7f4389ffb640 1 --2- 172.21.15.7:0/788624562 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f438c15f1c0 0x7f438c15eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:35.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.453+0000 7f4389ffb640 1 -- 172.21.15.7:0/788624562 >> v1:172.21.15.55:6789/0 conn(0x7f438c0ce830 legacy=0x7f438c0b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:35.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.453+0000 7f4389ffb640 1 -- 172.21.15.7:0/788624562 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438c0d1e20 con 0x7f438c0d3760 2024-04-25T10:00:35.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.453+0000 7f4389ffb640 1 -- 172.21.15.7:0/788624562 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f43840015f0 con 0x7f438c0d3760 2024-04-25T10:00:35.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.453+0000 7f4389ffb640 1 -- 172.21.15.7:0/788624562 >> v1:172.21.15.7:6789/0 conn(0x7f438c0d3760 legacy=0x7f438c0d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:35.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.453+0000 7f4389ffb640 1 --2- 172.21.15.7:0/788624562 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4378003b70 0x7f4378003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:35.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.453+0000 7f4389ffb640 1 --2- 172.21.15.7:0/788624562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4378004800 0x7f4378004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:35.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.453+0000 7f4389ffb640 1 --2- 172.21.15.7:0/788624562 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f438c15f1c0 0x7f43780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:35.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.453+0000 7f4389ffb640 1 -- 172.21.15.7:0/788624562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437800ba70 con 0x7f4378004800 2024-04-25T10:00:35.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.453+0000 7f4389ffb640 1 -- 172.21.15.7:0/788624562 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437800bbf0 con 0x7f4378003b70 2024-04-25T10:00:35.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.453+0000 7f4389ffb640 1 -- 172.21.15.7:0/788624562 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f437800bdf0 con 0x7f438c15f1c0 2024-04-25T10:00:35.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.453+0000 7f438a7fc640 1 --2- 172.21.15.7:0/788624562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4378004800 0x7f4378004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:35.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.453+0000 7f438affd640 1 --2- 172.21.15.7:0/788624562 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4378003b70 0x7f4378003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:35.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.453+0000 7f438b7fe640 1 --2- 172.21.15.7:0/788624562 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f438c15f1c0 0x7f43780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:35.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.454+0000 7f438a7fc640 1 -- 172.21.15.7:0/788624562 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f438c15f1c0 msgr2=0x7f43780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:35.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.454+0000 7f438a7fc640 1 --2- 172.21.15.7:0/788624562 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f438c15f1c0 0x7f43780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:35.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.454+0000 7f438a7fc640 1 -- 172.21.15.7:0/788624562 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4378003b70 msgr2=0x7f4378003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:35.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.454+0000 7f438a7fc640 1 --2- 172.21.15.7:0/788624562 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4378003b70 0x7f4378003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:35.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.454+0000 7f438a7fc640 1 -- 172.21.15.7:0/788624562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4378003520 con 0x7f4378004800 2024-04-25T10:00:35.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.454+0000 7f438b7fe640 1 --2- 172.21.15.7:0/788624562 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f438c15f1c0 0x7f43780051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:35.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.454+0000 7f438affd640 1 --2- 172.21.15.7:0/788624562 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4378003b70 0x7f4378003f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:35.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.454+0000 7f438a7fc640 1 --2- 172.21.15.7:0/788624562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4378004800 0x7f4378004c80 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f4374009a90 tx=0x7f4378005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a614563e6b82f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:35.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.454+0000 7f4389ffb640 1 -- 172.21.15.7:0/788624562 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4374036070 con 0x7f4378004800 2024-04-25T10:00:35.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.454+0000 7f4389ffb640 1 -- 172.21.15.7:0/788624562 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4374031400 con 0x7f4378004800 2024-04-25T10:00:35.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.454+0000 7f4389ffb640 1 -- 172.21.15.7:0/788624562 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4374009690 con 0x7f4378004800 2024-04-25T10:00:35.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.455+0000 7f4391322640 1 -- 172.21.15.7:0/788624562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4378004800 msgr2=0x7f4378004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:35.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.455+0000 7f4391322640 1 --2- 172.21.15.7:0/788624562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4378004800 0x7f4378004c80 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f4374009a90 tx=0x7f4378005830 comp rx=0 tx=0).stop 2024-04-25T10:00:35.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.455+0000 7f438b7fe640 1 -- 172.21.15.7:0/788624562 reap_dead start 2024-04-25T10:00:35.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.455+0000 7f4391322640 1 -- 172.21.15.7:0/788624562 shutdown_connections 2024-04-25T10:00:35.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.455+0000 7f4391322640 1 -- 172.21.15.7:0/788624562 >> 172.21.15.7:0/788624562 conn(0x7f438c072680 msgr2=0x7f438c072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:35.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.455+0000 7f4391322640 1 -- 172.21.15.7:0/788624562 shutdown_connections 2024-04-25T10:00:35.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.455+0000 7f4391322640 1 -- 172.21.15.7:0/788624562 wait complete. 2024-04-25T10:00:35.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.456+0000 7f4391322640 1 Processor -- start 2024-04-25T10:00:35.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.456+0000 7f4391322640 1 -- start start 2024-04-25T10:00:35.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.457+0000 7f4391322640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4378004800 0x7f438c1e80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:35.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.457+0000 7f4391322640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f438c159490 0x7f438c1e6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:35.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.457+0000 7f4391322640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f438c1e67b0 0x7f438c1479b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:35.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.457+0000 7f4391322640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c15eac0 con 0x7f438c1e67b0 2024-04-25T10:00:35.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.457+0000 7f4391322640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c0d2190 con 0x7f438c159490 2024-04-25T10:00:35.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.457+0000 7f4391322640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438c15ec40 con 0x7f4378004800 2024-04-25T10:00:35.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.457+0000 7f438b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f438c1e67b0 0x7f438c1479b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:35.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.457+0000 7f438b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f438c1e67b0 0x7f438c1479b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51164/0 (socket says 172.21.15.7:51164) 2024-04-25T10:00:35.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.457+0000 7f438b7fe640 1 -- 172.21.15.7:0/1610003537 learned_addr learned my addr 172.21.15.7:0/1610003537 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:35.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.457+0000 7f438a7fc640 1 --2- 172.21.15.7:0/1610003537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f438c159490 0x7f438c1e6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:35.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.457+0000 7f438affd640 1 --2- 172.21.15.7:0/1610003537 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4378004800 0x7f438c1e80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:35.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.457+0000 7f438b7fe640 1 -- 172.21.15.7:0/1610003537 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4378004800 msgr2=0x7f438c1e80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:35.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.457+0000 7f438b7fe640 1 --2- 172.21.15.7:0/1610003537 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4378004800 0x7f438c1e80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:35.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.457+0000 7f438b7fe640 1 -- 172.21.15.7:0/1610003537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f438c159490 msgr2=0x7f438c1e6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:35.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.457+0000 7f438b7fe640 1 --2- 172.21.15.7:0/1610003537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f438c159490 0x7f438c1e6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:35.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.457+0000 7f438b7fe640 1 -- 172.21.15.7:0/1610003537 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438c1ea2c0 con 0x7f438c1e67b0 2024-04-25T10:00:35.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.457+0000 7f438affd640 1 --2- 172.21.15.7:0/1610003537 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4378004800 0x7f438c1e80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:00:35.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.458+0000 7f438b7fe640 1 --2- 172.21.15.7:0/1610003537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f438c1e67b0 0x7f438c1479b0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f438c0d0b70 tx=0x7f437c00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:35.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.458+0000 7f43837fe640 1 -- 172.21.15.7:0/1610003537 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437c00ee70 con 0x7f438c1e67b0 2024-04-25T10:00:35.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.458+0000 7f43837fe640 1 -- 172.21.15.7:0/1610003537 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437c003b80 con 0x7f438c1e67b0 2024-04-25T10:00:35.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.458+0000 7f43837fe640 1 -- 172.21.15.7:0/1610003537 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437c003db0 con 0x7f438c1e67b0 2024-04-25T10:00:35.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.458+0000 7f4391322640 1 -- 172.21.15.7:0/1610003537 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f438c1455d0 con 0x7f438c1e67b0 2024-04-25T10:00:35.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.458+0000 7f4391322640 1 -- 172.21.15.7:0/1610003537 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f438c145b50 con 0x7f438c1e67b0 2024-04-25T10:00:35.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.459+0000 7f4391322640 1 -- 172.21.15.7:0/1610003537 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f438c068f60 con 0x7f438c1e67b0 2024-04-25T10:00:35.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.459+0000 7f43837fe640 1 -- 172.21.15.7:0/1610003537 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f437c01a020 con 0x7f438c1e67b0 2024-04-25T10:00:35.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.460+0000 7f43837fe640 1 --2- 172.21.15.7:0/1610003537 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f436c06b500 0x7f436c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:35.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.460+0000 7f43837fe640 1 -- 172.21.15.7:0/1610003537 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f437c089910 con 0x7f438c1e67b0 2024-04-25T10:00:35.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.460+0000 7f438affd640 1 --2- 172.21.15.7:0/1610003537 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f436c06b500 0x7f436c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:35.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.460+0000 7f438affd640 1 --2- 172.21.15.7:0/1610003537 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f436c06b500 0x7f436c06d9c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4384001eb0 tx=0x7f4384001a80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:35.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.464+0000 7f43837fe640 1 -- 172.21.15.7:0/1610003537 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f437c021020 con 0x7f438c1e67b0 2024-04-25T10:00:35.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.681+0000 7f4391322640 1 -- 172.21.15.7:0/1610003537 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f438c0d3470 con 0x7f438c1e67b0 2024-04-25T10:00:35.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.690+0000 7f43837fe640 1 -- 172.21.15.7:0/1610003537 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v52) v1 ==== 118+0+0 (secure 0 0 0) 0x7f437c058600 con 0x7f438c1e67b0 2024-04-25T10:00:35.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.692+0000 7f4391322640 1 -- 172.21.15.7:0/1610003537 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f436c06b500 msgr2=0x7f436c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:35.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.692+0000 7f4391322640 1 --2- 172.21.15.7:0/1610003537 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f436c06b500 0x7f436c06d9c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4384001eb0 tx=0x7f4384001a80 comp rx=0 tx=0).stop 2024-04-25T10:00:35.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.692+0000 7f4391322640 1 -- 172.21.15.7:0/1610003537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f438c1e67b0 msgr2=0x7f438c1479b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:35.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.692+0000 7f4391322640 1 --2- 172.21.15.7:0/1610003537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f438c1e67b0 0x7f438c1479b0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f438c0d0b70 tx=0x7f437c00ec20 comp rx=0 tx=0).stop 2024-04-25T10:00:35.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.692+0000 7f4391322640 1 -- 172.21.15.7:0/1610003537 shutdown_connections 2024-04-25T10:00:35.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.692+0000 7f4391322640 1 --2- 172.21.15.7:0/1610003537 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f436c06b500 0x7f436c06d9c0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:35.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.692+0000 7f4391322640 1 --2- 172.21.15.7:0/1610003537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f438c1e67b0 0x7f438c1479b0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:35.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.692+0000 7f4391322640 1 --2- 172.21.15.7:0/1610003537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f438c159490 0x7f438c1e6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:35.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.692+0000 7f4391322640 1 --2- 172.21.15.7:0/1610003537 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4378004800 0x7f438c1e80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:35.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.692+0000 7f4391322640 1 -- 172.21.15.7:0/1610003537 >> 172.21.15.7:0/1610003537 conn(0x7f438c072680 msgr2=0x7f438c0b78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:35.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.692+0000 7f4391322640 1 -- 172.21.15.7:0/1610003537 shutdown_connections 2024-04-25T10:00:35.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.692+0000 7f4391322640 1 -- 172.21.15.7:0/1610003537 wait complete. 2024-04-25T10:00:35.709 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T10:00:35.709 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T10:00:35.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.809+0000 7fa0c506b640 1 Processor -- start 2024-04-25T10:00:35.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.809+0000 7fa0c506b640 1 -- start start 2024-04-25T10:00:35.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.810+0000 7fa0c506b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa0c00d0780 0x7fa0c00d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:35.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.810+0000 7fa0c506b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0c00b9590 0x7fa0c00b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:35.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.810+0000 7fa0c506b640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c00d10a0 con 0x7fa0c00b9130 2024-04-25T10:00:35.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.810+0000 7fa0c506b640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c00b7ef0 con 0x7fa0c00d0780 2024-04-25T10:00:35.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.810+0000 7fa0c506b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c00b81d0 con 0x7fa0c00b9590 2024-04-25T10:00:35.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.810+0000 7fa0bed9d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa0c00d0780 0x7fa0c00d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:35.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.810+0000 7fa0be59c640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa0c00b9130 0x7fa0c00d1c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40594/0 (socket says 172.21.15.7:40594) 2024-04-25T10:00:35.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.810+0000 7fa0be59c640 1 -- 172.21.15.7:0/1959174442 learned_addr learned my addr 172.21.15.7:0/1959174442 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:35.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.810+0000 7fa0bf59e640 1 --2- 172.21.15.7:0/1959174442 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0c00b9590 0x7fa0c00b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:35.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.810+0000 7fa0bed9d640 1 -- 172.21.15.7:0/1959174442 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0c00b9590 msgr2=0x7fa0c00b78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:35.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.810+0000 7fa0bed9d640 1 --2- 172.21.15.7:0/1959174442 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0c00b9590 0x7fa0c00b78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:35.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.810+0000 7fa0bed9d640 1 -- 172.21.15.7:0/1959174442 >> v1:172.21.15.7:6789/0 conn(0x7fa0c00b9130 legacy=0x7fa0c00d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:35.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.810+0000 7fa0bed9d640 1 -- 172.21.15.7:0/1959174442 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c00b84b0 con 0x7fa0c00d0780 2024-04-25T10:00:35.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.811+0000 7fa0bed9d640 1 --2- 172.21.15.7:0/1959174442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0c00d0780 0x7fa0c00d0b60 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fa0b00097a0 tx=0x7fa0b002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e342a626cc60f33 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:35.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.811+0000 7fa0bdd9b640 1 -- 172.21.15.7:0/1959174442 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0037070 con 0x7fa0c00d0780 2024-04-25T10:00:35.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.811+0000 7fa0bdd9b640 1 -- 172.21.15.7:0/1959174442 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b0032440 con 0x7fa0c00d0780 2024-04-25T10:00:35.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.811+0000 7fa0bdd9b640 1 -- 172.21.15.7:0/1959174442 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0032810 con 0x7fa0c00d0780 2024-04-25T10:00:35.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.812+0000 7fa0c506b640 1 -- 172.21.15.7:0/1959174442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0c00d0780 msgr2=0x7fa0c00d0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:35.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.812+0000 7fa0c506b640 1 --2- 172.21.15.7:0/1959174442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0c00d0780 0x7fa0c00d0b60 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fa0b00097a0 tx=0x7fa0b002a180 comp rx=0 tx=0).stop 2024-04-25T10:00:35.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.812+0000 7fa0c506b640 1 -- 172.21.15.7:0/1959174442 shutdown_connections 2024-04-25T10:00:35.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.812+0000 7fa0c506b640 1 --2- 172.21.15.7:0/1959174442 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0c00b9590 0x7fa0c00b78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:35.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.812+0000 7fa0c506b640 1 --2- 172.21.15.7:0/1959174442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0c00d0780 0x7fa0c00d0b60 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:35.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.812+0000 7fa0c506b640 1 -- 172.21.15.7:0/1959174442 >> 172.21.15.7:0/1959174442 conn(0x7fa0c00726b0 msgr2=0x7fa0c0072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:35.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.812+0000 7fa0c506b640 1 -- 172.21.15.7:0/1959174442 shutdown_connections 2024-04-25T10:00:35.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.812+0000 7fa0c506b640 1 -- 172.21.15.7:0/1959174442 wait complete. 2024-04-25T10:00:35.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.813+0000 7fa0c506b640 1 Processor -- start 2024-04-25T10:00:35.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.813+0000 7fa0c506b640 1 -- start start 2024-04-25T10:00:35.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.814+0000 7fa0c506b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0c00b9130 0x7fa0c00c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:35.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.814+0000 7fa0c506b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0c00b9590 0x7fa0c00ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:35.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.814+0000 7fa0c506b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0c00d0780 0x7fa0c015fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:35.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.814+0000 7fa0c506b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c01611b0 con 0x7fa0c00b9590 2024-04-25T10:00:35.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.814+0000 7fa0c506b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c00b8a70 con 0x7fa0c00b9130 2024-04-25T10:00:35.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.814+0000 7fa0c506b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c0161330 con 0x7fa0c00d0780 2024-04-25T10:00:35.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.814+0000 7fa0be59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0c00b9590 0x7fa0c00ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:35.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.814+0000 7fa0be59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0c00b9590 0x7fa0c00ca8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51182/0 (socket says 172.21.15.7:51182) 2024-04-25T10:00:35.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.814+0000 7fa0be59c640 1 -- 172.21.15.7:0/15748976 learned_addr learned my addr 172.21.15.7:0/15748976 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:35.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.814+0000 7fa0bf59e640 1 --2- 172.21.15.7:0/15748976 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0c00d0780 0x7fa0c015fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:35.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.814+0000 7fa0bed9d640 1 --2- 172.21.15.7:0/15748976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0c00b9130 0x7fa0c00c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:35.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.814+0000 7fa0be59c640 1 -- 172.21.15.7:0/15748976 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0c00d0780 msgr2=0x7fa0c015fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:35.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.815+0000 7fa0be59c640 1 --2- 172.21.15.7:0/15748976 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0c00d0780 0x7fa0c015fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:35.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.815+0000 7fa0be59c640 1 -- 172.21.15.7:0/15748976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0c00b9130 msgr2=0x7fa0c00c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:35.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.815+0000 7fa0be59c640 1 --2- 172.21.15.7:0/15748976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0c00b9130 0x7fa0c00c9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:35.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.815+0000 7fa0be59c640 1 -- 172.21.15.7:0/15748976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c01f3420 con 0x7fa0c00b9590 2024-04-25T10:00:35.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.815+0000 7fa0be59c640 1 --2- 172.21.15.7:0/15748976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0c00b9590 0x7fa0c00ca8f0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400c400 tx=0x7fa0b400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:35.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.815+0000 7fa0a77fe640 1 -- 172.21.15.7:0/15748976 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4017070 con 0x7fa0c00b9590 2024-04-25T10:00:35.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.815+0000 7fa0a77fe640 1 -- 172.21.15.7:0/15748976 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b4005ce0 con 0x7fa0c00b9590 2024-04-25T10:00:35.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.815+0000 7fa0c506b640 1 -- 172.21.15.7:0/15748976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c00cc9b0 con 0x7fa0c00b9590 2024-04-25T10:00:35.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.815+0000 7fa0a77fe640 1 -- 172.21.15.7:0/15748976 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b40072f0 con 0x7fa0c00b9590 2024-04-25T10:00:35.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.815+0000 7fa0c506b640 1 -- 172.21.15.7:0/15748976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c00ccf70 con 0x7fa0c00b9590 2024-04-25T10:00:35.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.816+0000 7fa0c506b640 1 -- 172.21.15.7:0/15748976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c0068f60 con 0x7fa0c00b9590 2024-04-25T10:00:35.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.817+0000 7fa0a77fe640 1 -- 172.21.15.7:0/15748976 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa0b401a070 con 0x7fa0c00b9590 2024-04-25T10:00:35.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.817+0000 7fa0a77fe640 1 --2- 172.21.15.7:0/15748976 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa0ac06b500 0x7fa0ac06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:35.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.817+0000 7fa0a77fe640 1 -- 172.21.15.7:0/15748976 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa0b4089640 con 0x7fa0c00b9590 2024-04-25T10:00:35.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.817+0000 7fa0bed9d640 1 --2- 172.21.15.7:0/15748976 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa0ac06b500 0x7fa0ac06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:35.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.818+0000 7fa0bed9d640 1 --2- 172.21.15.7:0/15748976 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa0ac06b500 0x7fa0ac06d9c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0034000 tx=0x7fa0b002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:35.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:35.821+0000 7fa0a77fe640 1 -- 172.21.15.7:0/15748976 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa0b4057d70 con 0x7fa0c00b9590 2024-04-25T10:00:36.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.042+0000 7fa0c506b640 1 -- 172.21.15.7:0/15748976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa0c006aef0 con 0x7fa0c00b9590 2024-04-25T10:00:36.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-04-25T10:00:36.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.699+0000 7fa0a77fe640 1 -- 172.21.15.7:0/15748976 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v53) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa0b405e0c0 con 0x7fa0c00b9590 2024-04-25T10:00:36.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.702+0000 7fa0c506b640 1 -- 172.21.15.7:0/15748976 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa0ac06b500 msgr2=0x7fa0ac06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:36.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.702+0000 7fa0c506b640 1 --2- 172.21.15.7:0/15748976 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa0ac06b500 0x7fa0ac06d9c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0034000 tx=0x7fa0b002e000 comp rx=0 tx=0).stop 2024-04-25T10:00:36.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.702+0000 7fa0c506b640 1 -- 172.21.15.7:0/15748976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0c00b9590 msgr2=0x7fa0c00ca8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:36.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.702+0000 7fa0c506b640 1 --2- 172.21.15.7:0/15748976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0c00b9590 0x7fa0c00ca8f0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400c400 tx=0x7fa0b400c8c0 comp rx=0 tx=0).stop 2024-04-25T10:00:36.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.702+0000 7fa0c506b640 1 -- 172.21.15.7:0/15748976 shutdown_connections 2024-04-25T10:00:36.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.702+0000 7fa0c506b640 1 --2- 172.21.15.7:0/15748976 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa0ac06b500 0x7fa0ac06d9c0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:36.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.702+0000 7fa0c506b640 1 --2- 172.21.15.7:0/15748976 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0c00d0780 0x7fa0c015fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:36.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.702+0000 7fa0c506b640 1 --2- 172.21.15.7:0/15748976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0c00b9590 0x7fa0c00ca8f0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:36.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.702+0000 7fa0c506b640 1 --2- 172.21.15.7:0/15748976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0c00b9130 0x7fa0c00c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:36.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.702+0000 7fa0c506b640 1 -- 172.21.15.7:0/15748976 >> 172.21.15.7:0/15748976 conn(0x7fa0c00726b0 msgr2=0x7fa0c015e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:36.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.702+0000 7fa0c506b640 1 -- 172.21.15.7:0/15748976 shutdown_connections 2024-04-25T10:00:36.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.702+0000 7fa0c506b640 1 -- 172.21.15.7:0/15748976 wait complete. 2024-04-25T10:00:36.720 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T10:00:36.720 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:00:36.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.822+0000 7f83eab63640 1 Processor -- start 2024-04-25T10:00:36.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.822+0000 7f83eab63640 1 -- start start 2024-04-25T10:00:36.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.823+0000 7f83eab63640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f83e40cd740 0x7f83e40d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:36.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.823+0000 7f83eab63640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f83e406cd90 0x7f83e40cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:36.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.823+0000 7f83eab63640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e4099b90 con 0x7f83e40d08d0 2024-04-25T10:00:36.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.823+0000 7f83eab63640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e40cdb20 con 0x7f83e40cd740 2024-04-25T10:00:36.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.823+0000 7f83eab63640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e4099e70 con 0x7f83e406cd90 2024-04-25T10:00:36.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.823+0000 7f83e88ff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f83e40cd740 0x7f83e40d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:36.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.823+0000 7f83e3fff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f83e40d08d0 0x7f83e406c680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40608/0 (socket says 172.21.15.7:40608) 2024-04-25T10:00:36.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.824+0000 7f83e88ff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f83e40cd740 0x7f83e40d0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51196/0 (socket says 172.21.15.7:51196) 2024-04-25T10:00:36.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.824+0000 7f83e3fff640 1 -- 172.21.15.7:0/1876594944 learned_addr learned my addr 172.21.15.7:0/1876594944 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.824+0000 7f83e9100640 1 --2- 172.21.15.7:0/1876594944 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f83e406cd90 0x7f83e40cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.824+0000 7f83e88ff640 1 -- 172.21.15.7:0/1876594944 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f83e406cd90 msgr2=0x7f83e40cbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.824+0000 7f83e88ff640 1 --2- 172.21.15.7:0/1876594944 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f83e406cd90 0x7f83e40cbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.824+0000 7f83e88ff640 1 -- 172.21.15.7:0/1876594944 >> v1:172.21.15.7:6789/0 conn(0x7f83e40d08d0 legacy=0x7f83e406c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.824+0000 7f83e37fe640 1 -- 172.21.15.7:0/1876594944 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3110531293 0 0) 0x7f83e4099b90 con 0x7f83e40d08d0 2024-04-25T10:00:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.824+0000 7f83e88ff640 1 -- 172.21.15.7:0/1876594944 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e409a150 con 0x7f83e40cd740 2024-04-25T10:00:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.824+0000 7f83e9100640 1 --2- 172.21.15.7:0/1876594944 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f83e406cd90 0x7f83e40cbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:00:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.825+0000 7f83e88ff640 1 --2- 172.21.15.7:0/1876594944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83e40cd740 0x7f83e40d0390 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f83dc009d90 tx=0x7f83dc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905ba876a1b5b55f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.825+0000 7f83e37fe640 1 -- 172.21.15.7:0/1876594944 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc007740 con 0x7f83e40cd740 2024-04-25T10:00:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.825+0000 7f83e37fe640 1 -- 172.21.15.7:0/1876594944 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83dc0078e0 con 0x7f83e40cd740 2024-04-25T10:00:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.825+0000 7f83e37fe640 1 -- 172.21.15.7:0/1876594944 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc007cb0 con 0x7f83e40cd740 2024-04-25T10:00:36.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.825+0000 7f83eab63640 1 -- 172.21.15.7:0/1876594944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83e40cd740 msgr2=0x7f83e40d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:36.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.825+0000 7f83eab63640 1 --2- 172.21.15.7:0/1876594944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83e40cd740 0x7f83e40d0390 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f83dc009d90 tx=0x7f83dc02a660 comp rx=0 tx=0).stop 2024-04-25T10:00:36.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.825+0000 7f83eab63640 1 -- 172.21.15.7:0/1876594944 shutdown_connections 2024-04-25T10:00:36.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.825+0000 7f83eab63640 1 --2- 172.21.15.7:0/1876594944 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f83e406cd90 0x7f83e40cbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:36.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.825+0000 7f83eab63640 1 --2- 172.21.15.7:0/1876594944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83e40cd740 0x7f83e40d0390 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:36.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.825+0000 7f83eab63640 1 -- 172.21.15.7:0/1876594944 >> 172.21.15.7:0/1876594944 conn(0x7f83e40b3130 msgr2=0x7f83e40b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:36.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.825+0000 7f83eab63640 1 -- 172.21.15.7:0/1876594944 shutdown_connections 2024-04-25T10:00:36.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.825+0000 7f83eab63640 1 -- 172.21.15.7:0/1876594944 wait complete. 2024-04-25T10:00:36.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.827+0000 7f83eab63640 1 Processor -- start 2024-04-25T10:00:36.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.827+0000 7f83eab63640 1 -- start start 2024-04-25T10:00:36.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.828+0000 7f83eab63640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f83e406cd90 0x7f83e40c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:36.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.828+0000 7f83eab63640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83e40cd740 0x7f83e409da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:36.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.828+0000 7f83eab63640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83e40d08d0 0x7f83e409df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:36.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.828+0000 7f83eab63640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e409ac30 con 0x7f83e40cd740 2024-04-25T10:00:36.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.828+0000 7f83eab63640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e409a710 con 0x7f83e40d08d0 2024-04-25T10:00:36.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.828+0000 7f83eab63640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e409adb0 con 0x7f83e406cd90 2024-04-25T10:00:36.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.828+0000 7f83e3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83e40cd740 0x7f83e409da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:36.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.828+0000 7f83e3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83e40cd740 0x7f83e409da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51200/0 (socket says 172.21.15.7:51200) 2024-04-25T10:00:36.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.828+0000 7f83e3fff640 1 -- 172.21.15.7:0/4249938425 learned_addr learned my addr 172.21.15.7:0/4249938425 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:36.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.828+0000 7f83e88ff640 1 --2- 172.21.15.7:0/4249938425 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f83e406cd90 0x7f83e40c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:36.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.828+0000 7f83e9100640 1 --2- 172.21.15.7:0/4249938425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83e40d08d0 0x7f83e409df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:36.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.828+0000 7f83e3fff640 1 -- 172.21.15.7:0/4249938425 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f83e406cd90 msgr2=0x7f83e40c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:36.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.828+0000 7f83e3fff640 1 --2- 172.21.15.7:0/4249938425 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f83e406cd90 0x7f83e40c73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:36.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.828+0000 7f83e3fff640 1 -- 172.21.15.7:0/4249938425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83e40d08d0 msgr2=0x7f83e409df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:36.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.828+0000 7f83e3fff640 1 --2- 172.21.15.7:0/4249938425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83e40d08d0 0x7f83e409df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:36.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.828+0000 7f83e3fff640 1 -- 172.21.15.7:0/4249938425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e40b1510 con 0x7f83e40cd740 2024-04-25T10:00:36.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.828+0000 7f83e3fff640 1 --2- 172.21.15.7:0/4249938425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83e40cd740 0x7f83e409da50 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f83d800c4d0 tx=0x7f83d800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:36.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.828+0000 7f83e17fa640 1 -- 172.21.15.7:0/4249938425 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d8018070 con 0x7f83e40cd740 2024-04-25T10:00:36.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.828+0000 7f83e17fa640 1 -- 172.21.15.7:0/4249938425 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d8007500 con 0x7f83e40cd740 2024-04-25T10:00:36.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.828+0000 7f83eab63640 1 -- 172.21.15.7:0/4249938425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e409e5c0 con 0x7f83e40cd740 2024-04-25T10:00:36.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.828+0000 7f83e17fa640 1 -- 172.21.15.7:0/4249938425 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d8004a20 con 0x7f83e40cd740 2024-04-25T10:00:36.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.828+0000 7f83eab63640 1 -- 172.21.15.7:0/4249938425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e409b8c0 con 0x7f83e40cd740 2024-04-25T10:00:36.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.830+0000 7f83eab63640 1 -- 172.21.15.7:0/4249938425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e4068fd0 con 0x7f83e40cd740 2024-04-25T10:00:36.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.830+0000 7f83e17fa640 1 -- 172.21.15.7:0/4249938425 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f83d801b070 con 0x7f83e40cd740 2024-04-25T10:00:36.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.830+0000 7f83e17fa640 1 --2- 172.21.15.7:0/4249938425 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f83d006b4d0 0x7f83d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:36.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.831+0000 7f83e17fa640 1 -- 172.21.15.7:0/4249938425 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f83d80896e0 con 0x7f83e40cd740 2024-04-25T10:00:36.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.831+0000 7f83e88ff640 1 --2- 172.21.15.7:0/4249938425 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f83d006b4d0 0x7f83d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:36.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.831+0000 7f83e88ff640 1 --2- 172.21.15.7:0/4249938425 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f83d006b4d0 0x7f83d006d990 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f83dc034000 tx=0x7f83dc02f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:36.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:36.835+0000 7f83e17fa640 1 -- 172.21.15.7:0/4249938425 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f83d80583d0 con 0x7f83e40cd740 2024-04-25T10:00:37.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.052+0000 7f83eab63640 1 -- 172.21.15.7:0/4249938425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83e40b4040 con 0x7f83e40cd740 2024-04-25T10:00:37.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.052+0000 7f83e17fa640 1 -- 172.21.15.7:0/4249938425 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4934 (secure 0 0 0) 0x7f83d805e0d0 con 0x7f83e40cd740 2024-04-25T10:00:37.057 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:00:37.057 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2505539422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2505539422},{"type":"v1","addr":"172.21.15.55:6834","nonce":2505539422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2808857776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2808857776},{"type":"v1","addr":"172.21.15.55:6835","nonce":2808857776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7518,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1796103144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1796103144},{"type":"v1","addr":"172.21.15.7:6835","nonce":1796103144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:00:34.054759+0000","modified":"2024-04-25T10:00:36.044190+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7533":{"gid":7533,"name":"a","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6837/2878753733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2878753733},{"type":"v1","addr":"172.21.15.7:6837","nonce":2878753733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:00:37.057 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 53 2024-04-25T10:00:37.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.054+0000 7f83eab63640 1 -- 172.21.15.7:0/4249938425 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f83d006b4d0 msgr2=0x7f83d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:37.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.054+0000 7f83eab63640 1 --2- 172.21.15.7:0/4249938425 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f83d006b4d0 0x7f83d006d990 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f83dc034000 tx=0x7f83dc02f000 comp rx=0 tx=0).stop 2024-04-25T10:00:37.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.054+0000 7f83eab63640 1 -- 172.21.15.7:0/4249938425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83e40cd740 msgr2=0x7f83e409da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:37.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.054+0000 7f83eab63640 1 --2- 172.21.15.7:0/4249938425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83e40cd740 0x7f83e409da50 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f83d800c4d0 tx=0x7f83d800c990 comp rx=0 tx=0).stop 2024-04-25T10:00:37.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.054+0000 7f83eab63640 1 -- 172.21.15.7:0/4249938425 shutdown_connections 2024-04-25T10:00:37.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.054+0000 7f83eab63640 1 --2- 172.21.15.7:0/4249938425 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f83d006b4d0 0x7f83d006d990 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:37.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.054+0000 7f83eab63640 1 --2- 172.21.15.7:0/4249938425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83e40d08d0 0x7f83e409df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:37.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.054+0000 7f83eab63640 1 --2- 172.21.15.7:0/4249938425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83e40cd740 0x7f83e409da50 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:37.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.054+0000 7f83eab63640 1 --2- 172.21.15.7:0/4249938425 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f83e406cd90 0x7f83e40c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:37.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.054+0000 7f83eab63640 1 -- 172.21.15.7:0/4249938425 >> 172.21.15.7:0/4249938425 conn(0x7f83e40b3130 msgr2=0x7f83e40b4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:37.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.054+0000 7f83eab63640 1 -- 172.21.15.7:0/4249938425 shutdown_connections 2024-04-25T10:00:37.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.054+0000 7f83eab63640 1 -- 172.21.15.7:0/4249938425 wait complete. 2024-04-25T10:00:37.070 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:00:37.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.166+0000 7f7b80fe0640 1 Processor -- start 2024-04-25T10:00:37.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.166+0000 7f7b80fe0640 1 -- start start 2024-04-25T10:00:37.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.167+0000 7f7b80fe0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7b7c0d0aa0 0x7f7b7c161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:37.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.167+0000 7f7b80fe0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7b7c1622b0 0x7f7b7c0ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:37.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.167+0000 7f7b80fe0640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b7c15e8a0 con 0x7f7b7c15da60 2024-04-25T10:00:37.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.167+0000 7f7b80fe0640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b7c15eb80 con 0x7f7b7c0d0aa0 2024-04-25T10:00:37.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.167+0000 7f7b80fe0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c15ee60 con 0x7f7b7c1622b0 2024-04-25T10:00:37.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.167+0000 7f7b7a59c640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7b7c15da60 0x7f7b7c15de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40618/0 (socket says 172.21.15.7:40618) 2024-04-25T10:00:37.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.167+0000 7f7b7a59c640 1 -- 172.21.15.7:0/2044050571 learned_addr learned my addr 172.21.15.7:0/2044050571 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:37.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.167+0000 7f7b79d9b640 1 --2- 172.21.15.7:0/2044050571 >> v2:172.21.15.55:3300/0 conn(0x7f7b7c0d0aa0 0x7f7b7c161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:37.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.167+0000 7f7b7ad9d640 1 --2- 172.21.15.7:0/2044050571 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7b7c1622b0 0x7f7b7c0ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:37.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.167+0000 7f7b7959a640 1 -- 172.21.15.7:0/2044050571 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 950899642 0 0) 0x7f7b7c15e8a0 con 0x7f7b7c15da60 2024-04-25T10:00:37.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.167+0000 7f7b7959a640 1 -- 172.21.15.7:0/2044050571 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b64003520 con 0x7f7b7c15da60 2024-04-25T10:00:37.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.168+0000 7f7b7959a640 1 -- 172.21.15.7:0/2044050571 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3261104178 0 0) 0x7f7b64003520 con 0x7f7b7c15da60 2024-04-25T10:00:37.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.168+0000 7f7b7959a640 1 -- 172.21.15.7:0/2044050571 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7b7c1622b0 msgr2=0x7f7b7c0ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:37.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.168+0000 7f7b7959a640 1 --2- 172.21.15.7:0/2044050571 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7b7c1622b0 0x7f7b7c0ce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:37.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.168+0000 7f7b7959a640 1 -- 172.21.15.7:0/2044050571 >> v2:172.21.15.55:3300/0 conn(0x7f7b7c0d0aa0 msgr2=0x7f7b7c161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:37.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.168+0000 7f7b7959a640 1 --2- 172.21.15.7:0/2044050571 >> v2:172.21.15.55:3300/0 conn(0x7f7b7c0d0aa0 0x7f7b7c161d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:37.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.168+0000 7f7b7959a640 1 -- 172.21.15.7:0/2044050571 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7c161850 con 0x7f7b7c15da60 2024-04-25T10:00:37.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.168+0000 7f7b7959a640 1 -- 172.21.15.7:0/2044050571 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f7b6c001670 con 0x7f7b7c15da60 2024-04-25T10:00:37.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.168+0000 7f7b7959a640 1 -- 172.21.15.7:0/2044050571 >> v1:172.21.15.7:6789/0 conn(0x7f7b7c15da60 legacy=0x7f7b7c15de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:37.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.168+0000 7f7b7959a640 1 --2- 172.21.15.7:0/2044050571 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7b7c1622b0 0x7f7b640039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:37.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.168+0000 7f7b7959a640 1 --2- 172.21.15.7:0/2044050571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b64003f30 0x7f7b64004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:37.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.168+0000 7f7b7959a640 1 --2- 172.21.15.7:0/2044050571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b64004d40 0x7f7b640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:37.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.168+0000 7f7b7959a640 1 -- 172.21.15.7:0/2044050571 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c15eb80 con 0x7f7b64004d40 2024-04-25T10:00:37.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.168+0000 7f7b7959a640 1 -- 172.21.15.7:0/2044050571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c15ee60 con 0x7f7b64003f30 2024-04-25T10:00:37.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.168+0000 7f7b7959a640 1 -- 172.21.15.7:0/2044050571 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6400ba10 con 0x7f7b7c1622b0 2024-04-25T10:00:37.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.168+0000 7f7b7ad9d640 1 --2- 172.21.15.7:0/2044050571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b64004d40 0x7f7b640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:37.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.168+0000 7f7b7a59c640 1 --2- 172.21.15.7:0/2044050571 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7b7c1622b0 0x7f7b640039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:37.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.168+0000 7f7b79d9b640 1 --2- 172.21.15.7:0/2044050571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b64003f30 0x7f7b64004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:37.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.168+0000 7f7b7ad9d640 1 -- 172.21.15.7:0/2044050571 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7b7c1622b0 msgr2=0x7f7b640039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:37.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.168+0000 7f7b7ad9d640 1 --2- 172.21.15.7:0/2044050571 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7b7c1622b0 0x7f7b640039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:37.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.168+0000 7f7b7ad9d640 1 -- 172.21.15.7:0/2044050571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b64003f30 msgr2=0x7f7b64004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:37.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.168+0000 7f7b7ad9d640 1 --2- 172.21.15.7:0/2044050571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b64003f30 0x7f7b64004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:37.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.168+0000 7f7b7ad9d640 1 -- 172.21.15.7:0/2044050571 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b64003520 con 0x7f7b64004d40 2024-04-25T10:00:37.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.169+0000 7f7b7ad9d640 1 --2- 172.21.15.7:0/2044050571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b64004d40 0x7f7b640051c0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400e170 tx=0x7f7b64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8547d030464d1221 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:37.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.169+0000 7f7b7959a640 1 -- 172.21.15.7:0/2044050571 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b74034020 con 0x7f7b64004d40 2024-04-25T10:00:37.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.169+0000 7f7b7959a640 1 -- 172.21.15.7:0/2044050571 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b740305f0 con 0x7f7b64004d40 2024-04-25T10:00:37.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.169+0000 7f7b7959a640 1 -- 172.21.15.7:0/2044050571 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b74009c10 con 0x7f7b64004d40 2024-04-25T10:00:37.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.169+0000 7f7b80fe0640 1 -- 172.21.15.7:0/2044050571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b64004d40 msgr2=0x7f7b640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:37.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.169+0000 7f7b80fe0640 1 --2- 172.21.15.7:0/2044050571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b64004d40 0x7f7b640051c0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400e170 tx=0x7f7b64005830 comp rx=0 tx=0).stop 2024-04-25T10:00:37.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.170+0000 7f7b7ad9d640 1 -- 172.21.15.7:0/2044050571 reap_dead start 2024-04-25T10:00:37.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.170+0000 7f7b80fe0640 1 -- 172.21.15.7:0/2044050571 shutdown_connections 2024-04-25T10:00:37.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.170+0000 7f7b80fe0640 1 -- 172.21.15.7:0/2044050571 >> 172.21.15.7:0/2044050571 conn(0x7f7b7c06bfe0 msgr2=0x7f7b7c06c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:37.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.170+0000 7f7b80fe0640 1 -- 172.21.15.7:0/2044050571 shutdown_connections 2024-04-25T10:00:37.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.170+0000 7f7b80fe0640 1 -- 172.21.15.7:0/2044050571 wait complete. 2024-04-25T10:00:37.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.171+0000 7f7b80fe0640 1 Processor -- start 2024-04-25T10:00:37.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.171+0000 7f7b80fe0640 1 -- start start 2024-04-25T10:00:37.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.172+0000 7f7b80fe0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b64004d40 0x7f7b7c0b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:37.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.172+0000 7f7b80fe0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7b7c0cc130 0x7f7b7c0cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:37.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.172+0000 7f7b80fe0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b7c1f3650 0x7f7b7c1f3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:37.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.172+0000 7f7b80fe0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c0ce6a0 con 0x7f7b64004d40 2024-04-25T10:00:37.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.172+0000 7f7b80fe0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c0ce520 con 0x7f7b7c1f3650 2024-04-25T10:00:37.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.172+0000 7f7b80fe0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c0ce820 con 0x7f7b7c0cc130 2024-04-25T10:00:37.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.172+0000 7f7b7a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b64004d40 0x7f7b7c0b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:37.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.172+0000 7f7b7a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b64004d40 0x7f7b7c0b5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51222/0 (socket says 172.21.15.7:51222) 2024-04-25T10:00:37.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.172+0000 7f7b7a59c640 1 -- 172.21.15.7:0/3661292403 learned_addr learned my addr 172.21.15.7:0/3661292403 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:37.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.172+0000 7f7b79d9b640 1 --2- 172.21.15.7:0/3661292403 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7b7c0cc130 0x7f7b7c0cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:37.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.172+0000 7f7b7ad9d640 1 --2- 172.21.15.7:0/3661292403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b7c1f3650 0x7f7b7c1f3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:37.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.172+0000 7f7b7a59c640 1 -- 172.21.15.7:0/3661292403 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7b7c0cc130 msgr2=0x7f7b7c0cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:37.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.172+0000 7f7b7a59c640 1 --2- 172.21.15.7:0/3661292403 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7b7c0cc130 0x7f7b7c0cc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:37.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.172+0000 7f7b7a59c640 1 -- 172.21.15.7:0/3661292403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b7c1f3650 msgr2=0x7f7b7c1f3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:37.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.172+0000 7f7b7a59c640 1 --2- 172.21.15.7:0/3661292403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b7c1f3650 0x7f7b7c1f3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:37.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.172+0000 7f7b7a59c640 1 -- 172.21.15.7:0/3661292403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7c0ccbb0 con 0x7f7b64004d40 2024-04-25T10:00:37.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.172+0000 7f7b79d9b640 1 --2- 172.21.15.7:0/3661292403 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7b7c0cc130 0x7f7b7c0cc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:00:37.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.172+0000 7f7b7ad9d640 1 --2- 172.21.15.7:0/3661292403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b7c1f3650 0x7f7b7c1f3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:00:37.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.172+0000 7f7b7a59c640 1 --2- 172.21.15.7:0/3661292403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b64004d40 0x7f7b7c0b5f10 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c007340 tx=0x7f7b6c007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:37.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.172+0000 7f7b6affd640 1 -- 172.21.15.7:0/3661292403 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c01a070 con 0x7f7b64004d40 2024-04-25T10:00:37.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.173+0000 7f7b6affd640 1 -- 172.21.15.7:0/3661292403 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6c00f9a0 con 0x7f7b64004d40 2024-04-25T10:00:37.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.173+0000 7f7b80fe0640 1 -- 172.21.15.7:0/3661292403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b7c0cce90 con 0x7f7b64004d40 2024-04-25T10:00:37.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.173+0000 7f7b6affd640 1 -- 172.21.15.7:0/3661292403 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c00fd90 con 0x7f7b64004d40 2024-04-25T10:00:37.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.173+0000 7f7b80fe0640 1 -- 172.21.15.7:0/3661292403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b7c0b3620 con 0x7f7b64004d40 2024-04-25T10:00:37.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.174+0000 7f7b80fe0640 1 -- 172.21.15.7:0/3661292403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b7c0b3820 con 0x7f7b64004d40 2024-04-25T10:00:37.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.174+0000 7f7b6affd640 1 -- 172.21.15.7:0/3661292403 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7b6c01d070 con 0x7f7b64004d40 2024-04-25T10:00:37.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.174+0000 7f7b6affd640 1 --2- 172.21.15.7:0/3661292403 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7b5c06b500 0x7f7b5c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:37.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.175+0000 7f7b6affd640 1 -- 172.21.15.7:0/3661292403 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7b6c089dd0 con 0x7f7b64004d40 2024-04-25T10:00:37.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.175+0000 7f7b79d9b640 1 --2- 172.21.15.7:0/3661292403 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7b5c06b500 0x7f7b5c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:37.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.175+0000 7f7b79d9b640 1 --2- 172.21.15.7:0/3661292403 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7b5c06b500 0x7f7b5c06d9c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7b70009ab0 tx=0x7f7b70008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:37.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.179+0000 7f7b6affd640 1 -- 172.21.15.7:0/3661292403 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7b7c0b3820 con 0x7f7b64004d40 2024-04-25T10:00:37.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.359+0000 7f7b80fe0640 1 -- 172.21.15.7:0/3661292403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b7c068fd0 con 0x7f7b64004d40 2024-04-25T10:00:37.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.360+0000 7f7b6affd640 1 -- 172.21.15.7:0/3661292403 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+16789 (secure 0 0 0) 0x7f7b6c08b020 con 0x7f7b64004d40 2024-04-25T10:00:37.365 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:00:37.365 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":88,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:00:35.690122+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:00:32.330930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T10:00:33.030728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:00:37.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.362+0000 7f7b80fe0640 1 -- 172.21.15.7:0/3661292403 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7b5c06b500 msgr2=0x7f7b5c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:37.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.362+0000 7f7b80fe0640 1 --2- 172.21.15.7:0/3661292403 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7b5c06b500 0x7f7b5c06d9c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7b70009ab0 tx=0x7f7b70008040 comp rx=0 tx=0).stop 2024-04-25T10:00:37.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.362+0000 7f7b80fe0640 1 -- 172.21.15.7:0/3661292403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b64004d40 msgr2=0x7f7b7c0b5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:37.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.362+0000 7f7b80fe0640 1 --2- 172.21.15.7:0/3661292403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b64004d40 0x7f7b7c0b5f10 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c007340 tx=0x7f7b6c007800 comp rx=0 tx=0).stop 2024-04-25T10:00:37.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.362+0000 7f7b80fe0640 1 -- 172.21.15.7:0/3661292403 shutdown_connections 2024-04-25T10:00:37.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.362+0000 7f7b80fe0640 1 --2- 172.21.15.7:0/3661292403 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7b5c06b500 0x7f7b5c06d9c0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:37.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.362+0000 7f7b80fe0640 1 --2- 172.21.15.7:0/3661292403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b7c1f3650 0x7f7b7c1f3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:37.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.362+0000 7f7b80fe0640 1 --2- 172.21.15.7:0/3661292403 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7b7c0cc130 0x7f7b7c0cc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:37.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.362+0000 7f7b80fe0640 1 --2- 172.21.15.7:0/3661292403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b64004d40 0x7f7b7c0b5f10 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:37.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.362+0000 7f7b80fe0640 1 -- 172.21.15.7:0/3661292403 >> 172.21.15.7:0/3661292403 conn(0x7f7b7c06bfe0 msgr2=0x7f7b7c0d1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:37.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.362+0000 7f7b80fe0640 1 -- 172.21.15.7:0/3661292403 shutdown_connections 2024-04-25T10:00:37.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.362+0000 7f7b80fe0640 1 -- 172.21.15.7:0/3661292403 wait complete. 2024-04-25T10:00:37.378 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T10:00:37.378 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:00:37.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.474+0000 7f3c9408f640 1 Processor -- start 2024-04-25T10:00:37.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.474+0000 7f3c9408f640 1 -- start start 2024-04-25T10:00:37.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.475+0000 7f3c9408f640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3c8c0d0a50 0x7f3c8c0d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:37.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.475+0000 7f3c9408f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c8c0b53b0 0x7f3c8c0d2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:37.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.475+0000 7f3c9408f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8c0d1e80 con 0x7f3c8c15db00 2024-04-25T10:00:37.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.475+0000 7f3c9408f640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c8c0b5930 con 0x7f3c8c0d0a50 2024-04-25T10:00:37.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.475+0000 7f3c9408f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c0b5c10 con 0x7f3c8c0b53b0 2024-04-25T10:00:37.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.475+0000 7f3c9162a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3c8c0d0a50 0x7f3c8c0d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:37.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.475+0000 7f3c9162a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3c8c0d0a50 0x7f3c8c0d2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51224/0 (socket says 172.21.15.7:51224) 2024-04-25T10:00:37.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.475+0000 7f3c9162a640 1 -- 172.21.15.7:0/2277307681 learned_addr learned my addr 172.21.15.7:0/2277307681 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:37.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.475+0000 7f3c9262c640 1 --2- 172.21.15.7:0/2277307681 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c8c0b53b0 0x7f3c8c0d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:37.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.475+0000 7f3c9162a640 1 -- 172.21.15.7:0/2277307681 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c8c0b53b0 msgr2=0x7f3c8c0d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:37.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.475+0000 7f3c9162a640 1 --2- 172.21.15.7:0/2277307681 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c8c0b53b0 0x7f3c8c0d2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:37.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.475+0000 7f3c9162a640 1 -- 172.21.15.7:0/2277307681 >> v1:172.21.15.55:6789/0 conn(0x7f3c8c15db00 legacy=0x7f3c8c0d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:37.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.475+0000 7f3c9162a640 1 -- 172.21.15.7:0/2277307681 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8c0b5ef0 con 0x7f3c8c0d0a50 2024-04-25T10:00:37.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.475+0000 7f3c90e29640 1 -- 172.21.15.7:0/2277307681 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2134790753 0 0) 0x7f3c8c0d1e80 con 0x7f3c8c15db00 2024-04-25T10:00:37.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.476+0000 7f3c9162a640 1 --2- 172.21.15.7:0/2277307681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c8c0d0a50 0x7f3c8c0d2330 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c009870 tx=0x7f3c7c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de95bada75e94777 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:37.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.476+0000 7f3c90e29640 1 -- 172.21.15.7:0/2277307681 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c037070 con 0x7f3c8c0d0a50 2024-04-25T10:00:37.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.476+0000 7f3c90e29640 1 -- 172.21.15.7:0/2277307681 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7c032440 con 0x7f3c8c0d0a50 2024-04-25T10:00:37.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.476+0000 7f3c90e29640 1 -- 172.21.15.7:0/2277307681 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c032810 con 0x7f3c8c0d0a50 2024-04-25T10:00:37.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.477+0000 7f3c9408f640 1 -- 172.21.15.7:0/2277307681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c8c0d0a50 msgr2=0x7f3c8c0d2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:37.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.477+0000 7f3c9408f640 1 --2- 172.21.15.7:0/2277307681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c8c0d0a50 0x7f3c8c0d2330 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c009870 tx=0x7f3c7c02a270 comp rx=0 tx=0).stop 2024-04-25T10:00:37.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.477+0000 7f3c9408f640 1 -- 172.21.15.7:0/2277307681 shutdown_connections 2024-04-25T10:00:37.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.477+0000 7f3c9408f640 1 --2- 172.21.15.7:0/2277307681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c8c0d0a50 0x7f3c8c0d2330 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:37.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.477+0000 7f3c9408f640 1 --2- 172.21.15.7:0/2277307681 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c8c0b53b0 0x7f3c8c0d2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:37.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.477+0000 7f3c9408f640 1 -- 172.21.15.7:0/2277307681 >> 172.21.15.7:0/2277307681 conn(0x7f3c8c072290 msgr2=0x7f3c8c0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:37.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.477+0000 7f3c9408f640 1 -- 172.21.15.7:0/2277307681 shutdown_connections 2024-04-25T10:00:37.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.477+0000 7f3c9408f640 1 -- 172.21.15.7:0/2277307681 wait complete. 2024-04-25T10:00:37.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.478+0000 7f3c9408f640 1 Processor -- start 2024-04-25T10:00:37.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.478+0000 7f3c9408f640 1 -- start start 2024-04-25T10:00:37.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.479+0000 7f3c9408f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c8c0b53b0 0x7f3c8c160900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:37.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.479+0000 7f3c9408f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c8c0d0a50 0x7f3c8c0cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:37.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.479+0000 7f3c9408f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c8c15db00 0x7f3c8c14dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:37.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.479+0000 7f3c9408f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c0d3660 con 0x7f3c8c0d0a50 2024-04-25T10:00:37.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.479+0000 7f3c9408f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c0b61d0 con 0x7f3c8c0b53b0 2024-04-25T10:00:37.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.479+0000 7f3c9408f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c0ce2b0 con 0x7f3c8c15db00 2024-04-25T10:00:37.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.479+0000 7f3c9162a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c8c0d0a50 0x7f3c8c0cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:37.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.479+0000 7f3c9162a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c8c0d0a50 0x7f3c8c0cbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51238/0 (socket says 172.21.15.7:51238) 2024-04-25T10:00:37.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.479+0000 7f3c9162a640 1 -- 172.21.15.7:0/3281394335 learned_addr learned my addr 172.21.15.7:0/3281394335 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:37.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.479+0000 7f3c9162a640 1 -- 172.21.15.7:0/3281394335 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c8c15db00 msgr2=0x7f3c8c14dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:37.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.479+0000 7f3c9162a640 1 --2- 172.21.15.7:0/3281394335 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c8c15db00 0x7f3c8c14dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:37.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.479+0000 7f3c9162a640 1 -- 172.21.15.7:0/3281394335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c8c0b53b0 msgr2=0x7f3c8c160900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:37.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.479+0000 7f3c91e2b640 1 --2- 172.21.15.7:0/3281394335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c8c0b53b0 0x7f3c8c160900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:37.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.479+0000 7f3c9162a640 1 --2- 172.21.15.7:0/3281394335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c8c0b53b0 0x7f3c8c160900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:37.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.479+0000 7f3c9162a640 1 -- 172.21.15.7:0/3281394335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8c0ccff0 con 0x7f3c8c0d0a50 2024-04-25T10:00:37.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.479+0000 7f3c9162a640 1 --2- 172.21.15.7:0/3281394335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c8c0d0a50 0x7f3c8c0cbf60 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c000c00 tx=0x7f3c7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:37.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.479+0000 7f3c827fc640 1 -- 172.21.15.7:0/3281394335 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c037040 con 0x7f3c8c0d0a50 2024-04-25T10:00:37.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.479+0000 7f3c827fc640 1 -- 172.21.15.7:0/3281394335 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7c042070 con 0x7f3c8c0d0a50 2024-04-25T10:00:37.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.479+0000 7f3c9408f640 1 -- 172.21.15.7:0/3281394335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c8c0cca30 con 0x7f3c8c0d0a50 2024-04-25T10:00:37.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.479+0000 7f3c827fc640 1 -- 172.21.15.7:0/3281394335 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c03b870 con 0x7f3c8c0d0a50 2024-04-25T10:00:37.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.479+0000 7f3c9408f640 1 -- 172.21.15.7:0/3281394335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c8c0c7570 con 0x7f3c8c0d0a50 2024-04-25T10:00:37.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.480+0000 7f3c9408f640 1 -- 172.21.15.7:0/3281394335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c8c068fd0 con 0x7f3c8c0d0a50 2024-04-25T10:00:37.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.481+0000 7f3c827fc640 1 -- 172.21.15.7:0/3281394335 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3c7c03ba10 con 0x7f3c8c0d0a50 2024-04-25T10:00:37.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.481+0000 7f3c827fc640 1 --2- 172.21.15.7:0/3281394335 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3c7006b4d0 0x7f3c7006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:37.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.481+0000 7f3c827fc640 1 -- 172.21.15.7:0/3281394335 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3c7c0aaaf0 con 0x7f3c8c0d0a50 2024-04-25T10:00:37.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.481+0000 7f3c91e2b640 1 --2- 172.21.15.7:0/3281394335 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3c7006b4d0 0x7f3c7006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:37.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.482+0000 7f3c91e2b640 1 --2- 172.21.15.7:0/3281394335 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3c7006b4d0 0x7f3c7006d990 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3c88000f60 tx=0x7f3c88009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:37.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.486+0000 7f3c827fc640 1 -- 172.21.15.7:0/3281394335 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3c7c079870 con 0x7f3c8c0d0a50 2024-04-25T10:00:37.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.662+0000 7f3c9408f640 1 -- 172.21.15.7:0/3281394335 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3c8c0d16b0 con 0x7f3c7006b4d0 2024-04-25T10:00:37.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.668+0000 7f3c827fc640 1 -- 172.21.15.7:0/3281394335 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252028 (secure 0 0 0) 0x7f3c8c0d16b0 con 0x7f3c7006b4d0 2024-04-25T10:00:37.679 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:00:37.681 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T10:00:37.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.671+0000 7f3c9408f640 1 -- 172.21.15.7:0/3281394335 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3c7006b4d0 msgr2=0x7f3c7006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:37.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.671+0000 7f3c9408f640 1 --2- 172.21.15.7:0/3281394335 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3c7006b4d0 0x7f3c7006d990 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3c88000f60 tx=0x7f3c88009040 comp rx=0 tx=0).stop 2024-04-25T10:00:37.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.671+0000 7f3c9408f640 1 -- 172.21.15.7:0/3281394335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c8c0d0a50 msgr2=0x7f3c8c0cbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:37.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.671+0000 7f3c9408f640 1 --2- 172.21.15.7:0/3281394335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c8c0d0a50 0x7f3c8c0cbf60 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c000c00 tx=0x7f3c7c0046c0 comp rx=0 tx=0).stop 2024-04-25T10:00:37.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.671+0000 7f3c9408f640 1 -- 172.21.15.7:0/3281394335 shutdown_connections 2024-04-25T10:00:37.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.671+0000 7f3c9408f640 1 --2- 172.21.15.7:0/3281394335 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3c7006b4d0 0x7f3c7006d990 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:37.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.671+0000 7f3c9408f640 1 --2- 172.21.15.7:0/3281394335 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c8c15db00 0x7f3c8c14dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:37.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.671+0000 7f3c9408f640 1 --2- 172.21.15.7:0/3281394335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c8c0d0a50 0x7f3c8c0cbf60 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:37.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.671+0000 7f3c9408f640 1 --2- 172.21.15.7:0/3281394335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c8c0b53b0 0x7f3c8c160900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:37.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.671+0000 7f3c9408f640 1 -- 172.21.15.7:0/3281394335 >> 172.21.15.7:0/3281394335 conn(0x7f3c8c072290 msgr2=0x7f3c8c072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:37.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.671+0000 7f3c9408f640 1 -- 172.21.15.7:0/3281394335 shutdown_connections 2024-04-25T10:00:37.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.671+0000 7f3c9408f640 1 -- 172.21.15.7:0/3281394335 wait complete. 2024-04-25T10:00:37.688 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":272,"stamp":"2024-04-25T10:00:35.938076+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259020,"kb_used_data":9516,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715700,"statfs":{"total":773094113280,"available":772828876800,"internally_reserved":0,"allocated":9744384,"data_stored":5071521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000632"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.712288+0000","last_change":"2024-04-25T10:00:34.705564+0000","last_active":"2024-04-25T10:00:34.712288+0000","last_peered":"2024-04-25T10:00:34.712288+0000","last_clean":"2024-04-25T10:00:34.712288+0000","last_became_active":"2024-04-25T10:00:34.705224+0000","last_became_peered":"2024-04-25T10:00:34.705224+0000","last_unstale":"2024-04-25T10:00:34.712288+0000","last_undegraded":"2024-04-25T10:00:34.712288+0000","last_fullsized":"2024-04-25T10:00:34.712288+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:41.942475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.706686+0000","last_change":"2024-04-25T10:00:34.699540+0000","last_active":"2024-04-25T10:00:35.706686+0000","last_peered":"2024-04-25T10:00:35.706686+0000","last_clean":"2024-04-25T10:00:35.706686+0000","last_became_active":"2024-04-25T10:00:34.699204+0000","last_became_peered":"2024-04-25T10:00:34.699204+0000","last_unstale":"2024-04-25T10:00:35.706686+0000","last_undegraded":"2024-04-25T10:00:35.706686+0000","last_fullsized":"2024-04-25T10:00:35.706686+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:53:55.927303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.707255+0000","last_change":"2024-04-25T10:00:34.699749+0000","last_active":"2024-04-25T10:00:34.707255+0000","last_peered":"2024-04-25T10:00:34.707255+0000","last_clean":"2024-04-25T10:00:34.707255+0000","last_became_active":"2024-04-25T10:00:34.699451+0000","last_became_peered":"2024-04-25T10:00:34.699451+0000","last_unstale":"2024-04-25T10:00:34.707255+0000","last_undegraded":"2024-04-25T10:00:34.707255+0000","last_fullsized":"2024-04-25T10:00:34.707255+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:53:55.927303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.704506+0000","last_change":"2024-04-25T10:00:34.698579+0000","last_active":"2024-04-25T10:00:34.704506+0000","last_peered":"2024-04-25T10:00:34.704506+0000","last_clean":"2024-04-25T10:00:34.704506+0000","last_became_active":"2024-04-25T10:00:34.698274+0000","last_became_peered":"2024-04-25T10:00:34.698274+0000","last_unstale":"2024-04-25T10:00:34.704506+0000","last_undegraded":"2024-04-25T10:00:34.704506+0000","last_fullsized":"2024-04-25T10:00:34.704506+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:28.794183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.703935+0000","last_change":"2024-04-25T10:00:34.698889+0000","last_active":"2024-04-25T10:00:35.703935+0000","last_peered":"2024-04-25T10:00:35.703935+0000","last_clean":"2024-04-25T10:00:35.703935+0000","last_became_active":"2024-04-25T10:00:34.697889+0000","last_became_peered":"2024-04-25T10:00:34.697889+0000","last_unstale":"2024-04-25T10:00:35.703935+0000","last_undegraded":"2024-04-25T10:00:35.703935+0000","last_fullsized":"2024-04-25T10:00:35.703935+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:27.363721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.709708+0000","last_change":"2024-04-25T10:00:34.707025+0000","last_active":"2024-04-25T10:00:34.709708+0000","last_peered":"2024-04-25T10:00:34.709708+0000","last_clean":"2024-04-25T10:00:34.709708+0000","last_became_active":"2024-04-25T10:00:34.706708+0000","last_became_peered":"2024-04-25T10:00:34.706708+0000","last_unstale":"2024-04-25T10:00:34.709708+0000","last_undegraded":"2024-04-25T10:00:34.709708+0000","last_fullsized":"2024-04-25T10:00:34.709708+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:12.385289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.687301+0000","last_change":"2024-04-25T10:00:34.686819+0000","last_active":"2024-04-25T10:00:34.687301+0000","last_peered":"2024-04-25T10:00:34.687301+0000","last_clean":"2024-04-25T10:00:34.687301+0000","last_became_active":"2024-04-25T10:00:34.686459+0000","last_became_peered":"2024-04-25T10:00:34.686459+0000","last_unstale":"2024-04-25T10:00:34.687301+0000","last_undegraded":"2024-04-25T10:00:34.687301+0000","last_fullsized":"2024-04-25T10:00:34.687301+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:53:55.927303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.710794+0000","last_change":"2024-04-25T10:00:34.708607+0000","last_active":"2024-04-25T10:00:34.710794+0000","last_peered":"2024-04-25T10:00:34.710794+0000","last_clean":"2024-04-25T10:00:34.710794+0000","last_became_active":"2024-04-25T10:00:34.706064+0000","last_became_peered":"2024-04-25T10:00:34.706064+0000","last_unstale":"2024-04-25T10:00:34.710794+0000","last_undegraded":"2024-04-25T10:00:34.710794+0000","last_fullsized":"2024-04-25T10:00:34.710794+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:21:03.882042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.704244+0000","last_change":"2024-04-25T10:00:34.700929+0000","last_active":"2024-04-25T10:00:35.704244+0000","last_peered":"2024-04-25T10:00:35.704244+0000","last_clean":"2024-04-25T10:00:35.704244+0000","last_became_active":"2024-04-25T10:00:34.699354+0000","last_became_peered":"2024-04-25T10:00:34.699354+0000","last_unstale":"2024-04-25T10:00:35.704244+0000","last_undegraded":"2024-04-25T10:00:35.704244+0000","last_fullsized":"2024-04-25T10:00:35.704244+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:48.467992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.712749+0000","last_change":"2024-04-25T10:00:34.708668+0000","last_active":"2024-04-25T10:00:34.712749+0000","last_peered":"2024-04-25T10:00:34.712749+0000","last_clean":"2024-04-25T10:00:34.712749+0000","last_became_active":"2024-04-25T10:00:34.708388+0000","last_became_peered":"2024-04-25T10:00:34.708388+0000","last_unstale":"2024-04-25T10:00:34.712749+0000","last_undegraded":"2024-04-25T10:00:34.712749+0000","last_fullsized":"2024-04-25T10:00:34.712749+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:47.883264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.704182+0000","last_change":"2024-04-25T10:00:34.705470+0000","last_active":"2024-04-25T10:00:35.704182+0000","last_peered":"2024-04-25T10:00:35.704182+0000","last_clean":"2024-04-25T10:00:35.704182+0000","last_became_active":"2024-04-25T10:00:34.705128+0000","last_became_peered":"2024-04-25T10:00:34.705128+0000","last_unstale":"2024-04-25T10:00:35.704182+0000","last_undegraded":"2024-04-25T10:00:35.704182+0000","last_fullsized":"2024-04-25T10:00:35.704182+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:03.262312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.712630+0000","last_change":"2024-04-25T10:00:34.705017+0000","last_active":"2024-04-25T10:00:34.712630+0000","last_peered":"2024-04-25T10:00:34.712630+0000","last_clean":"2024-04-25T10:00:34.712630+0000","last_became_active":"2024-04-25T10:00:34.704711+0000","last_became_peered":"2024-04-25T10:00:34.704711+0000","last_unstale":"2024-04-25T10:00:34.712630+0000","last_undegraded":"2024-04-25T10:00:34.712630+0000","last_fullsized":"2024-04-25T10:00:34.712630+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:27.588112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.707908+0000","last_change":"2024-04-25T10:00:34.705330+0000","last_active":"2024-04-25T10:00:34.707908+0000","last_peered":"2024-04-25T10:00:34.707908+0000","last_clean":"2024-04-25T10:00:34.707908+0000","last_became_active":"2024-04-25T10:00:34.704960+0000","last_became_peered":"2024-04-25T10:00:34.704960+0000","last_unstale":"2024-04-25T10:00:34.707908+0000","last_undegraded":"2024-04-25T10:00:34.707908+0000","last_fullsized":"2024-04-25T10:00:34.707908+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:04.991679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.703761+0000","last_change":"2024-04-25T10:00:34.705945+0000","last_active":"2024-04-25T10:00:35.703761+0000","last_peered":"2024-04-25T10:00:35.703761+0000","last_clean":"2024-04-25T10:00:35.703761+0000","last_became_active":"2024-04-25T10:00:34.705668+0000","last_became_peered":"2024-04-25T10:00:34.705668+0000","last_unstale":"2024-04-25T10:00:35.703761+0000","last_undegraded":"2024-04-25T10:00:35.703761+0000","last_fullsized":"2024-04-25T10:00:35.703761+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:59.982997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.719999+0000","last_change":"2024-04-25T10:00:34.716173+0000","last_active":"2024-04-25T10:00:34.719999+0000","last_peered":"2024-04-25T10:00:34.719999+0000","last_clean":"2024-04-25T10:00:34.719999+0000","last_became_active":"2024-04-25T10:00:34.715895+0000","last_became_peered":"2024-04-25T10:00:34.715895+0000","last_unstale":"2024-04-25T10:00:34.719999+0000","last_undegraded":"2024-04-25T10:00:34.719999+0000","last_fullsized":"2024-04-25T10:00:34.719999+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:50.883519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.706262+0000","last_change":"2024-04-25T10:00:34.700332+0000","last_active":"2024-04-25T10:00:34.706262+0000","last_peered":"2024-04-25T10:00:34.706262+0000","last_clean":"2024-04-25T10:00:34.706262+0000","last_became_active":"2024-04-25T10:00:34.699651+0000","last_became_peered":"2024-04-25T10:00:34.699651+0000","last_unstale":"2024-04-25T10:00:34.706262+0000","last_undegraded":"2024-04-25T10:00:34.706262+0000","last_fullsized":"2024-04-25T10:00:34.706262+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:04.415028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.707581+0000","last_change":"2024-04-25T10:00:34.701342+0000","last_active":"2024-04-25T10:00:34.707581+0000","last_peered":"2024-04-25T10:00:34.707581+0000","last_clean":"2024-04-25T10:00:34.707581+0000","last_became_active":"2024-04-25T10:00:34.700955+0000","last_became_peered":"2024-04-25T10:00:34.700955+0000","last_unstale":"2024-04-25T10:00:34.707581+0000","last_undegraded":"2024-04-25T10:00:34.707581+0000","last_fullsized":"2024-04-25T10:00:34.707581+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:11.103055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.697039+0000","last_change":"2024-04-25T10:00:34.690820+0000","last_active":"2024-04-25T10:00:34.697039+0000","last_peered":"2024-04-25T10:00:34.697039+0000","last_clean":"2024-04-25T10:00:34.697039+0000","last_became_active":"2024-04-25T10:00:34.690513+0000","last_became_peered":"2024-04-25T10:00:34.690513+0000","last_unstale":"2024-04-25T10:00:34.697039+0000","last_undegraded":"2024-04-25T10:00:34.697039+0000","last_fullsized":"2024-04-25T10:00:34.697039+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:11.735986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.704356+0000","last_change":"2024-04-25T10:00:34.707650+0000","last_active":"2024-04-25T10:00:35.704356+0000","last_peered":"2024-04-25T10:00:35.704356+0000","last_clean":"2024-04-25T10:00:35.704356+0000","last_became_active":"2024-04-25T10:00:34.707343+0000","last_became_peered":"2024-04-25T10:00:34.707343+0000","last_unstale":"2024-04-25T10:00:35.704356+0000","last_undegraded":"2024-04-25T10:00:35.704356+0000","last_fullsized":"2024-04-25T10:00:35.704356+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:55.207124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.719045+0000","last_change":"2024-04-25T10:00:34.715348+0000","last_active":"2024-04-25T10:00:34.719045+0000","last_peered":"2024-04-25T10:00:34.719045+0000","last_clean":"2024-04-25T10:00:34.719045+0000","last_became_active":"2024-04-25T10:00:34.715056+0000","last_became_peered":"2024-04-25T10:00:34.715056+0000","last_unstale":"2024-04-25T10:00:34.719045+0000","last_undegraded":"2024-04-25T10:00:34.719045+0000","last_fullsized":"2024-04-25T10:00:34.719045+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:06.583530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.703971+0000","last_change":"2024-04-25T10:00:34.694233+0000","last_active":"2024-04-25T10:00:35.703971+0000","last_peered":"2024-04-25T10:00:35.703971+0000","last_clean":"2024-04-25T10:00:35.703971+0000","last_became_active":"2024-04-25T10:00:34.693960+0000","last_became_peered":"2024-04-25T10:00:34.693960+0000","last_unstale":"2024-04-25T10:00:35.703971+0000","last_undegraded":"2024-04-25T10:00:35.703971+0000","last_fullsized":"2024-04-25T10:00:35.703971+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:33.653996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.703749+0000","last_change":"2024-04-25T10:00:34.703229+0000","last_active":"2024-04-25T10:00:35.703749+0000","last_peered":"2024-04-25T10:00:35.703749+0000","last_clean":"2024-04-25T10:00:35.703749+0000","last_became_active":"2024-04-25T10:00:34.702928+0000","last_became_peered":"2024-04-25T10:00:34.702928+0000","last_unstale":"2024-04-25T10:00:35.703749+0000","last_undegraded":"2024-04-25T10:00:35.703749+0000","last_fullsized":"2024-04-25T10:00:35.703749+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:04.694494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.868938+0000","last_change":"2024-04-25T10:00:34.701271+0000","last_active":"2024-04-25T10:00:35.868938+0000","last_peered":"2024-04-25T10:00:35.868938+0000","last_clean":"2024-04-25T10:00:35.868938+0000","last_became_active":"2024-04-25T10:00:34.700937+0000","last_became_peered":"2024-04-25T10:00:34.700937+0000","last_unstale":"2024-04-25T10:00:35.868938+0000","last_undegraded":"2024-04-25T10:00:35.868938+0000","last_fullsized":"2024-04-25T10:00:35.868938+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:27.363721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.697218+0000","last_change":"2024-04-25T10:00:34.692224+0000","last_active":"2024-04-25T10:00:34.697218+0000","last_peered":"2024-04-25T10:00:34.697218+0000","last_clean":"2024-04-25T10:00:34.697218+0000","last_became_active":"2024-04-25T10:00:34.691933+0000","last_became_peered":"2024-04-25T10:00:34.691933+0000","last_unstale":"2024-04-25T10:00:34.697218+0000","last_undegraded":"2024-04-25T10:00:34.697218+0000","last_fullsized":"2024-04-25T10:00:34.697218+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:03.229236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.706720+0000","last_change":"2024-04-25T10:00:34.693176+0000","last_active":"2024-04-25T10:00:35.706720+0000","last_peered":"2024-04-25T10:00:35.706720+0000","last_clean":"2024-04-25T10:00:35.706720+0000","last_became_active":"2024-04-25T10:00:34.692883+0000","last_became_peered":"2024-04-25T10:00:34.692883+0000","last_unstale":"2024-04-25T10:00:35.706720+0000","last_undegraded":"2024-04-25T10:00:35.706720+0000","last_fullsized":"2024-04-25T10:00:35.706720+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:41.942475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.704124+0000","last_change":"2024-04-25T10:00:34.705996+0000","last_active":"2024-04-25T10:00:35.704124+0000","last_peered":"2024-04-25T10:00:35.704124+0000","last_clean":"2024-04-25T10:00:35.704124+0000","last_became_active":"2024-04-25T10:00:34.705642+0000","last_became_peered":"2024-04-25T10:00:34.705642+0000","last_unstale":"2024-04-25T10:00:35.704124+0000","last_undegraded":"2024-04-25T10:00:35.704124+0000","last_fullsized":"2024-04-25T10:00:35.704124+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:40.908385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.704203+0000","last_change":"2024-04-25T10:00:34.696530+0000","last_active":"2024-04-25T10:00:34.704203+0000","last_peered":"2024-04-25T10:00:34.704203+0000","last_clean":"2024-04-25T10:00:34.704203+0000","last_became_active":"2024-04-25T10:00:34.696264+0000","last_became_peered":"2024-04-25T10:00:34.696264+0000","last_unstale":"2024-04-25T10:00:34.704203+0000","last_undegraded":"2024-04-25T10:00:34.704203+0000","last_fullsized":"2024-04-25T10:00:34.704203+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:36.889585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.707876+0000","last_change":"2024-04-25T10:00:34.705999+0000","last_active":"2024-04-25T10:00:34.707876+0000","last_peered":"2024-04-25T10:00:34.707876+0000","last_clean":"2024-04-25T10:00:34.707876+0000","last_became_active":"2024-04-25T10:00:34.705727+0000","last_became_peered":"2024-04-25T10:00:34.705727+0000","last_unstale":"2024-04-25T10:00:34.707876+0000","last_undegraded":"2024-04-25T10:00:34.707876+0000","last_fullsized":"2024-04-25T10:00:34.707876+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:56.308526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.698231+0000","last_change":"2024-04-25T10:00:34.697553+0000","last_active":"2024-04-25T10:00:34.698231+0000","last_peered":"2024-04-25T10:00:34.698231+0000","last_clean":"2024-04-25T10:00:34.698231+0000","last_became_active":"2024-04-25T10:00:34.697197+0000","last_became_peered":"2024-04-25T10:00:34.697197+0000","last_unstale":"2024-04-25T10:00:34.698231+0000","last_undegraded":"2024-04-25T10:00:34.698231+0000","last_fullsized":"2024-04-25T10:00:34.698231+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:28.835260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.704134+0000","last_change":"2024-04-25T10:00:34.693663+0000","last_active":"2024-04-25T10:00:35.704134+0000","last_peered":"2024-04-25T10:00:35.704134+0000","last_clean":"2024-04-25T10:00:35.704134+0000","last_became_active":"2024-04-25T10:00:34.691860+0000","last_became_peered":"2024-04-25T10:00:34.691860+0000","last_unstale":"2024-04-25T10:00:35.704134+0000","last_undegraded":"2024-04-25T10:00:35.704134+0000","last_fullsized":"2024-04-25T10:00:35.704134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:58:27.627712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.706308+0000","last_change":"2024-04-25T10:00:34.700315+0000","last_active":"2024-04-25T10:00:35.706308+0000","last_peered":"2024-04-25T10:00:35.706308+0000","last_clean":"2024-04-25T10:00:35.706308+0000","last_became_active":"2024-04-25T10:00:34.699454+0000","last_became_peered":"2024-04-25T10:00:34.699454+0000","last_unstale":"2024-04-25T10:00:35.706308+0000","last_undegraded":"2024-04-25T10:00:35.706308+0000","last_fullsized":"2024-04-25T10:00:35.706308+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:10:33.294371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.706242+0000","last_change":"2024-04-25T10:00:34.699961+0000","last_active":"2024-04-25T10:00:34.706242+0000","last_peered":"2024-04-25T10:00:34.706242+0000","last_clean":"2024-04-25T10:00:34.706242+0000","last_became_active":"2024-04-25T10:00:34.699278+0000","last_became_peered":"2024-04-25T10:00:34.699278+0000","last_unstale":"2024-04-25T10:00:34.706242+0000","last_undegraded":"2024-04-25T10:00:34.706242+0000","last_fullsized":"2024-04-25T10:00:34.706242+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:29.027193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.707042+0000","last_change":"2024-04-25T10:00:34.700626+0000","last_active":"2024-04-25T10:00:34.707042+0000","last_peered":"2024-04-25T10:00:34.707042+0000","last_clean":"2024-04-25T10:00:34.707042+0000","last_became_active":"2024-04-25T10:00:34.700260+0000","last_became_peered":"2024-04-25T10:00:34.700260+0000","last_unstale":"2024-04-25T10:00:34.707042+0000","last_undegraded":"2024-04-25T10:00:34.707042+0000","last_fullsized":"2024-04-25T10:00:34.707042+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:34.001767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"87'4","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.869309+0000","last_change":"2024-04-25T10:00:33.700311+0000","last_active":"2024-04-25T10:00:35.869309+0000","last_peered":"2024-04-25T10:00:35.869309+0000","last_clean":"2024-04-25T10:00:35.869309+0000","last_became_active":"2024-04-25T10:00:33.700024+0000","last_became_peered":"2024-04-25T10:00:33.700024+0000","last_unstale":"2024-04-25T10:00:35.869309+0000","last_undegraded":"2024-04-25T10:00:35.869309+0000","last_fullsized":"2024-04-25T10:00:35.869309+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:55.297097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.713345+0000","last_change":"2024-04-25T10:00:34.710180+0000","last_active":"2024-04-25T10:00:34.713345+0000","last_peered":"2024-04-25T10:00:34.713345+0000","last_clean":"2024-04-25T10:00:34.713345+0000","last_became_active":"2024-04-25T10:00:34.709806+0000","last_became_peered":"2024-04-25T10:00:34.709806+0000","last_unstale":"2024-04-25T10:00:34.713345+0000","last_undegraded":"2024-04-25T10:00:34.713345+0000","last_fullsized":"2024-04-25T10:00:34.713345+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:07.295413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.704273+0000","last_change":"2024-04-25T10:00:33.699647+0000","last_active":"2024-04-25T10:00:35.704273+0000","last_peered":"2024-04-25T10:00:35.704273+0000","last_clean":"2024-04-25T10:00:35.704273+0000","last_became_active":"2024-04-25T10:00:33.699370+0000","last_became_peered":"2024-04-25T10:00:33.699370+0000","last_unstale":"2024-04-25T10:00:35.704273+0000","last_undegraded":"2024-04-25T10:00:35.704273+0000","last_fullsized":"2024-04-25T10:00:35.704273+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:14.451247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.705040+0000","last_change":"2024-04-25T10:00:34.703408+0000","last_active":"2024-04-25T10:00:34.705040+0000","last_peered":"2024-04-25T10:00:34.705040+0000","last_clean":"2024-04-25T10:00:34.705040+0000","last_became_active":"2024-04-25T10:00:34.703039+0000","last_became_peered":"2024-04-25T10:00:34.703039+0000","last_unstale":"2024-04-25T10:00:34.705040+0000","last_undegraded":"2024-04-25T10:00:34.705040+0000","last_fullsized":"2024-04-25T10:00:34.705040+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:59.150420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"87'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.714730+0000","last_change":"2024-04-25T10:00:33.699984+0000","last_active":"2024-04-25T10:00:34.714730+0000","last_peered":"2024-04-25T10:00:34.714730+0000","last_clean":"2024-04-25T10:00:34.714730+0000","last_became_active":"2024-04-25T10:00:33.699605+0000","last_became_peered":"2024-04-25T10:00:33.699605+0000","last_unstale":"2024-04-25T10:00:34.714730+0000","last_undegraded":"2024-04-25T10:00:34.714730+0000","last_fullsized":"2024-04-25T10:00:34.714730+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:10:32.282942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.707561+0000","last_change":"2024-04-25T10:00:34.702183+0000","last_active":"2024-04-25T10:00:34.707561+0000","last_peered":"2024-04-25T10:00:34.707561+0000","last_clean":"2024-04-25T10:00:34.707561+0000","last_became_active":"2024-04-25T10:00:34.701900+0000","last_became_peered":"2024-04-25T10:00:34.701900+0000","last_unstale":"2024-04-25T10:00:34.707561+0000","last_undegraded":"2024-04-25T10:00:34.707561+0000","last_fullsized":"2024-04-25T10:00:34.707561+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:27.953906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.869294+0000","last_change":"2024-04-25T10:00:33.695107+0000","last_active":"2024-04-25T10:00:35.869294+0000","last_peered":"2024-04-25T10:00:35.869294+0000","last_clean":"2024-04-25T10:00:35.869294+0000","last_became_active":"2024-04-25T10:00:33.694819+0000","last_became_peered":"2024-04-25T10:00:33.694819+0000","last_unstale":"2024-04-25T10:00:35.869294+0000","last_undegraded":"2024-04-25T10:00:35.869294+0000","last_fullsized":"2024-04-25T10:00:35.869294+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:49.119719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.720414+0000","last_change":"2024-04-25T10:00:34.717865+0000","last_active":"2024-04-25T10:00:34.720414+0000","last_peered":"2024-04-25T10:00:34.720414+0000","last_clean":"2024-04-25T10:00:34.720414+0000","last_became_active":"2024-04-25T10:00:34.717420+0000","last_became_peered":"2024-04-25T10:00:34.717420+0000","last_unstale":"2024-04-25T10:00:34.720414+0000","last_undegraded":"2024-04-25T10:00:34.720414+0000","last_fullsized":"2024-04-25T10:00:34.720414+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:11.999074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.704232+0000","last_change":"2024-04-25T10:00:33.701828+0000","last_active":"2024-04-25T10:00:35.704232+0000","last_peered":"2024-04-25T10:00:35.704232+0000","last_clean":"2024-04-25T10:00:35.704232+0000","last_became_active":"2024-04-25T10:00:33.701537+0000","last_became_peered":"2024-04-25T10:00:33.701537+0000","last_unstale":"2024-04-25T10:00:35.704232+0000","last_undegraded":"2024-04-25T10:00:35.704232+0000","last_fullsized":"2024-04-25T10:00:35.704232+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:08:14.064083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.868975+0000","last_change":"2024-04-25T10:00:34.704591+0000","last_active":"2024-04-25T10:00:35.868975+0000","last_peered":"2024-04-25T10:00:35.868975+0000","last_clean":"2024-04-25T10:00:35.868975+0000","last_became_active":"2024-04-25T10:00:34.704106+0000","last_became_peered":"2024-04-25T10:00:34.704106+0000","last_unstale":"2024-04-25T10:00:35.868975+0000","last_undegraded":"2024-04-25T10:00:35.868975+0000","last_fullsized":"2024-04-25T10:00:35.868975+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:33.653996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"87'1","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.720621+0000","last_change":"2024-04-25T10:00:33.700400+0000","last_active":"2024-04-25T10:00:34.720621+0000","last_peered":"2024-04-25T10:00:34.720621+0000","last_clean":"2024-04-25T10:00:34.720621+0000","last_became_active":"2024-04-25T10:00:33.699563+0000","last_became_peered":"2024-04-25T10:00:33.699563+0000","last_unstale":"2024-04-25T10:00:34.720621+0000","last_undegraded":"2024-04-25T10:00:34.720621+0000","last_fullsized":"2024-04-25T10:00:34.720621+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:48.754794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.707489+0000","last_change":"2024-04-25T10:00:34.701679+0000","last_active":"2024-04-25T10:00:34.707489+0000","last_peered":"2024-04-25T10:00:34.707489+0000","last_clean":"2024-04-25T10:00:34.707489+0000","last_became_active":"2024-04-25T10:00:34.701390+0000","last_became_peered":"2024-04-25T10:00:34.701390+0000","last_unstale":"2024-04-25T10:00:34.707489+0000","last_undegraded":"2024-04-25T10:00:34.707489+0000","last_fullsized":"2024-04-25T10:00:34.707489+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:56.310636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.682583+0000","last_change":"2024-04-25T10:00:33.694964+0000","last_active":"2024-04-25T10:00:34.682583+0000","last_peered":"2024-04-25T10:00:34.682583+0000","last_clean":"2024-04-25T10:00:34.682583+0000","last_became_active":"2024-04-25T10:00:33.694666+0000","last_became_peered":"2024-04-25T10:00:33.694666+0000","last_unstale":"2024-04-25T10:00:34.682583+0000","last_undegraded":"2024-04-25T10:00:34.682583+0000","last_fullsized":"2024-04-25T10:00:34.682583+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:30.901702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.704424+0000","last_change":"2024-04-25T10:00:34.699684+0000","last_active":"2024-04-25T10:00:34.704424+0000","last_peered":"2024-04-25T10:00:34.704424+0000","last_clean":"2024-04-25T10:00:34.704424+0000","last_became_active":"2024-04-25T10:00:34.699420+0000","last_became_peered":"2024-04-25T10:00:34.699420+0000","last_unstale":"2024-04-25T10:00:34.704424+0000","last_undegraded":"2024-04-25T10:00:34.704424+0000","last_fullsized":"2024-04-25T10:00:34.704424+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:45.263981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.683686+0000","last_change":"2024-04-25T10:00:33.698203+0000","last_active":"2024-04-25T10:00:34.683686+0000","last_peered":"2024-04-25T10:00:34.683686+0000","last_clean":"2024-04-25T10:00:34.683686+0000","last_became_active":"2024-04-25T10:00:33.697876+0000","last_became_peered":"2024-04-25T10:00:33.697876+0000","last_unstale":"2024-04-25T10:00:34.683686+0000","last_undegraded":"2024-04-25T10:00:34.683686+0000","last_fullsized":"2024-04-25T10:00:34.683686+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:10.724557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.704129+0000","last_change":"2024-04-25T10:00:34.698157+0000","last_active":"2024-04-25T10:00:35.704129+0000","last_peered":"2024-04-25T10:00:35.704129+0000","last_clean":"2024-04-25T10:00:35.704129+0000","last_became_active":"2024-04-25T10:00:34.697850+0000","last_became_peered":"2024-04-25T10:00:34.697850+0000","last_unstale":"2024-04-25T10:00:35.704129+0000","last_undegraded":"2024-04-25T10:00:35.704129+0000","last_fullsized":"2024-04-25T10:00:35.704129+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:00.980613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.706792+0000","last_change":"2024-04-25T10:00:33.695775+0000","last_active":"2024-04-25T10:00:35.706792+0000","last_peered":"2024-04-25T10:00:35.706792+0000","last_clean":"2024-04-25T10:00:35.706792+0000","last_became_active":"2024-04-25T10:00:33.695454+0000","last_became_peered":"2024-04-25T10:00:33.695454+0000","last_unstale":"2024-04-25T10:00:35.706792+0000","last_undegraded":"2024-04-25T10:00:35.706792+0000","last_fullsized":"2024-04-25T10:00:35.706792+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:35.982797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.696655+0000","last_change":"2024-04-25T10:00:34.696111+0000","last_active":"2024-04-25T10:00:34.696655+0000","last_peered":"2024-04-25T10:00:34.696655+0000","last_clean":"2024-04-25T10:00:34.696655+0000","last_became_active":"2024-04-25T10:00:34.695837+0000","last_became_peered":"2024-04-25T10:00:34.695837+0000","last_unstale":"2024-04-25T10:00:34.696655+0000","last_undegraded":"2024-04-25T10:00:34.696655+0000","last_fullsized":"2024-04-25T10:00:34.696655+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:19.684811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.683226+0000","last_change":"2024-04-25T10:00:33.689604+0000","last_active":"2024-04-25T10:00:34.683226+0000","last_peered":"2024-04-25T10:00:34.683226+0000","last_clean":"2024-04-25T10:00:34.683226+0000","last_became_active":"2024-04-25T10:00:33.689287+0000","last_became_peered":"2024-04-25T10:00:33.689287+0000","last_unstale":"2024-04-25T10:00:34.683226+0000","last_undegraded":"2024-04-25T10:00:34.683226+0000","last_fullsized":"2024-04-25T10:00:34.683226+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:10:32.282942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.712263+0000","last_change":"2024-04-25T10:00:34.705880+0000","last_active":"2024-04-25T10:00:34.712263+0000","last_peered":"2024-04-25T10:00:34.712263+0000","last_clean":"2024-04-25T10:00:34.712263+0000","last_became_active":"2024-04-25T10:00:34.705575+0000","last_became_peered":"2024-04-25T10:00:34.705575+0000","last_unstale":"2024-04-25T10:00:34.712263+0000","last_undegraded":"2024-04-25T10:00:34.712263+0000","last_fullsized":"2024-04-25T10:00:34.712263+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:19.684811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"87'3","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.704476+0000","last_change":"2024-04-25T10:00:33.704000+0000","last_active":"2024-04-25T10:00:35.704476+0000","last_peered":"2024-04-25T10:00:35.704476+0000","last_clean":"2024-04-25T10:00:35.704476+0000","last_became_active":"2024-04-25T10:00:33.703359+0000","last_became_peered":"2024-04-25T10:00:33.703359+0000","last_unstale":"2024-04-25T10:00:35.704476+0000","last_undegraded":"2024-04-25T10:00:35.704476+0000","last_fullsized":"2024-04-25T10:00:35.704476+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:04.085303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.697399+0000","last_change":"2024-04-25T10:00:34.696172+0000","last_active":"2024-04-25T10:00:34.697399+0000","last_peered":"2024-04-25T10:00:34.697399+0000","last_clean":"2024-04-25T10:00:34.697399+0000","last_became_active":"2024-04-25T10:00:34.694685+0000","last_became_peered":"2024-04-25T10:00:34.694685+0000","last_unstale":"2024-04-25T10:00:34.697399+0000","last_undegraded":"2024-04-25T10:00:34.697399+0000","last_fullsized":"2024-04-25T10:00:34.697399+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:31:43.890286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"87'6","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.720721+0000","last_change":"2024-04-25T10:00:33.695810+0000","last_active":"2024-04-25T10:00:34.720721+0000","last_peered":"2024-04-25T10:00:34.720721+0000","last_clean":"2024-04-25T10:00:34.720721+0000","last_became_active":"2024-04-25T10:00:33.695521+0000","last_became_peered":"2024-04-25T10:00:33.695521+0000","last_unstale":"2024-04-25T10:00:34.720721+0000","last_undegraded":"2024-04-25T10:00:34.720721+0000","last_fullsized":"2024-04-25T10:00:34.720721+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:37.096195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.710815+0000","last_change":"2024-04-25T10:00:34.708908+0000","last_active":"2024-04-25T10:00:34.710815+0000","last_peered":"2024-04-25T10:00:34.710815+0000","last_clean":"2024-04-25T10:00:34.710815+0000","last_became_active":"2024-04-25T10:00:34.705668+0000","last_became_peered":"2024-04-25T10:00:34.705668+0000","last_unstale":"2024-04-25T10:00:34.710815+0000","last_undegraded":"2024-04-25T10:00:34.710815+0000","last_fullsized":"2024-04-25T10:00:34.710815+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:50.131148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"87'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.719645+0000","last_change":"2024-04-25T10:00:33.699290+0000","last_active":"2024-04-25T10:00:34.719645+0000","last_peered":"2024-04-25T10:00:34.719645+0000","last_clean":"2024-04-25T10:00:34.719645+0000","last_became_active":"2024-04-25T10:00:33.699005+0000","last_became_peered":"2024-04-25T10:00:33.699005+0000","last_unstale":"2024-04-25T10:00:34.719645+0000","last_undegraded":"2024-04-25T10:00:34.719645+0000","last_fullsized":"2024-04-25T10:00:34.719645+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:02.217807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.703759+0000","last_change":"2024-04-25T10:00:34.694978+0000","last_active":"2024-04-25T10:00:35.703759+0000","last_peered":"2024-04-25T10:00:35.703759+0000","last_clean":"2024-04-25T10:00:35.703759+0000","last_became_active":"2024-04-25T10:00:34.694707+0000","last_became_peered":"2024-04-25T10:00:34.694707+0000","last_unstale":"2024-04-25T10:00:35.703759+0000","last_undegraded":"2024-04-25T10:00:35.703759+0000","last_fullsized":"2024-04-25T10:00:35.703759+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:05.674231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.689404+0000","last_change":"2024-04-25T10:00:33.703607+0000","last_active":"2024-04-25T10:00:34.689404+0000","last_peered":"2024-04-25T10:00:34.689404+0000","last_clean":"2024-04-25T10:00:34.689404+0000","last_became_active":"2024-04-25T10:00:33.703274+0000","last_became_peered":"2024-04-25T10:00:33.703274+0000","last_unstale":"2024-04-25T10:00:34.689404+0000","last_undegraded":"2024-04-25T10:00:34.689404+0000","last_fullsized":"2024-04-25T10:00:34.689404+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:56.996863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.712719+0000","last_change":"2024-04-25T10:00:34.710945+0000","last_active":"2024-04-25T10:00:34.712719+0000","last_peered":"2024-04-25T10:00:34.712719+0000","last_clean":"2024-04-25T10:00:34.712719+0000","last_became_active":"2024-04-25T10:00:34.710647+0000","last_became_peered":"2024-04-25T10:00:34.710647+0000","last_unstale":"2024-04-25T10:00:34.712719+0000","last_undegraded":"2024-04-25T10:00:34.712719+0000","last_fullsized":"2024-04-25T10:00:34.712719+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:23.696794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.690193+0000","last_change":"2024-04-25T10:00:33.696209+0000","last_active":"2024-04-25T10:00:34.690193+0000","last_peered":"2024-04-25T10:00:34.690193+0000","last_clean":"2024-04-25T10:00:34.690193+0000","last_became_active":"2024-04-25T10:00:33.695862+0000","last_became_peered":"2024-04-25T10:00:33.695862+0000","last_unstale":"2024-04-25T10:00:34.690193+0000","last_undegraded":"2024-04-25T10:00:34.690193+0000","last_fullsized":"2024-04-25T10:00:34.690193+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:17.368377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.702711+0000","last_change":"2024-04-25T10:00:34.701981+0000","last_active":"2024-04-25T10:00:34.702711+0000","last_peered":"2024-04-25T10:00:34.702711+0000","last_clean":"2024-04-25T10:00:34.702711+0000","last_became_active":"2024-04-25T10:00:34.701705+0000","last_became_peered":"2024-04-25T10:00:34.701705+0000","last_unstale":"2024-04-25T10:00:34.702711+0000","last_undegraded":"2024-04-25T10:00:34.702711+0000","last_fullsized":"2024-04-25T10:00:34.702711+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:38.796511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"87'8","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.721597+0000","last_change":"2024-04-25T10:00:33.699541+0000","last_active":"2024-04-25T10:00:34.721597+0000","last_peered":"2024-04-25T10:00:34.721597+0000","last_clean":"2024-04-25T10:00:34.721597+0000","last_became_active":"2024-04-25T10:00:33.699231+0000","last_became_peered":"2024-04-25T10:00:33.699231+0000","last_unstale":"2024-04-25T10:00:34.721597+0000","last_undegraded":"2024-04-25T10:00:34.721597+0000","last_fullsized":"2024-04-25T10:00:34.721597+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:31.522672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.706948+0000","last_change":"2024-04-25T10:00:34.700455+0000","last_active":"2024-04-25T10:00:34.706948+0000","last_peered":"2024-04-25T10:00:34.706948+0000","last_clean":"2024-04-25T10:00:34.706948+0000","last_became_active":"2024-04-25T10:00:34.699819+0000","last_became_peered":"2024-04-25T10:00:34.699819+0000","last_unstale":"2024-04-25T10:00:34.706948+0000","last_undegraded":"2024-04-25T10:00:34.706948+0000","last_fullsized":"2024-04-25T10:00:34.706948+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:29.005616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.869372+0000","last_change":"2024-04-25T10:00:33.697547+0000","last_active":"2024-04-25T10:00:35.869372+0000","last_peered":"2024-04-25T10:00:35.869372+0000","last_clean":"2024-04-25T10:00:35.869372+0000","last_became_active":"2024-04-25T10:00:33.697282+0000","last_became_peered":"2024-04-25T10:00:33.697282+0000","last_unstale":"2024-04-25T10:00:35.869372+0000","last_undegraded":"2024-04-25T10:00:35.869372+0000","last_fullsized":"2024-04-25T10:00:35.869372+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:21:02.870613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.869223+0000","last_change":"2024-04-25T10:00:34.692487+0000","last_active":"2024-04-25T10:00:35.869223+0000","last_peered":"2024-04-25T10:00:35.869223+0000","last_clean":"2024-04-25T10:00:35.869223+0000","last_became_active":"2024-04-25T10:00:34.692184+0000","last_became_peered":"2024-04-25T10:00:34.692184+0000","last_unstale":"2024-04-25T10:00:35.869223+0000","last_undegraded":"2024-04-25T10:00:35.869223+0000","last_fullsized":"2024-04-25T10:00:35.869223+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:00.980613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"87'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.715268+0000","last_change":"2024-04-25T10:00:33.699569+0000","last_active":"2024-04-25T10:00:34.715268+0000","last_peered":"2024-04-25T10:00:34.715268+0000","last_clean":"2024-04-25T10:00:34.715268+0000","last_became_active":"2024-04-25T10:00:33.698528+0000","last_became_peered":"2024-04-25T10:00:33.698528+0000","last_unstale":"2024-04-25T10:00:34.715268+0000","last_undegraded":"2024-04-25T10:00:34.715268+0000","last_fullsized":"2024-04-25T10:00:34.715268+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:30:37.164312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.704167+0000","last_change":"2024-04-25T10:00:34.703058+0000","last_active":"2024-04-25T10:00:35.704167+0000","last_peered":"2024-04-25T10:00:35.704167+0000","last_clean":"2024-04-25T10:00:35.704167+0000","last_became_active":"2024-04-25T10:00:34.702598+0000","last_became_peered":"2024-04-25T10:00:34.702598+0000","last_unstale":"2024-04-25T10:00:35.704167+0000","last_undegraded":"2024-04-25T10:00:35.704167+0000","last_fullsized":"2024-04-25T10:00:35.704167+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:27.817975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.704504+0000","last_change":"2024-04-25T10:00:33.704158+0000","last_active":"2024-04-25T10:00:35.704504+0000","last_peered":"2024-04-25T10:00:35.704504+0000","last_clean":"2024-04-25T10:00:35.704504+0000","last_became_active":"2024-04-25T10:00:33.703829+0000","last_became_peered":"2024-04-25T10:00:33.703829+0000","last_unstale":"2024-04-25T10:00:35.704504+0000","last_undegraded":"2024-04-25T10:00:35.704504+0000","last_fullsized":"2024-04-25T10:00:35.704504+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:17.368377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.707450+0000","last_change":"2024-04-25T10:00:34.701001+0000","last_active":"2024-04-25T10:00:34.707450+0000","last_peered":"2024-04-25T10:00:34.707450+0000","last_clean":"2024-04-25T10:00:34.707450+0000","last_became_active":"2024-04-25T10:00:34.700695+0000","last_became_peered":"2024-04-25T10:00:34.700695+0000","last_unstale":"2024-04-25T10:00:34.707450+0000","last_undegraded":"2024-04-25T10:00:34.707450+0000","last_fullsized":"2024-04-25T10:00:34.707450+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:27:32.070038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.706556+0000","last_change":"2024-04-25T10:00:33.696464+0000","last_active":"2024-04-25T10:00:35.706556+0000","last_peered":"2024-04-25T10:00:35.706556+0000","last_clean":"2024-04-25T10:00:35.706556+0000","last_became_active":"2024-04-25T10:00:33.696138+0000","last_became_peered":"2024-04-25T10:00:33.696138+0000","last_unstale":"2024-04-25T10:00:35.706556+0000","last_undegraded":"2024-04-25T10:00:35.706556+0000","last_fullsized":"2024-04-25T10:00:35.706556+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:28.856482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.706417+0000","last_change":"2024-04-25T10:00:34.700342+0000","last_active":"2024-04-25T10:00:35.706417+0000","last_peered":"2024-04-25T10:00:35.706417+0000","last_clean":"2024-04-25T10:00:35.706417+0000","last_became_active":"2024-04-25T10:00:34.699919+0000","last_became_peered":"2024-04-25T10:00:34.699919+0000","last_unstale":"2024-04-25T10:00:35.706417+0000","last_undegraded":"2024-04-25T10:00:35.706417+0000","last_fullsized":"2024-04-25T10:00:35.706417+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:11.735986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.692263+0000","last_change":"2024-04-25T10:00:33.701060+0000","last_active":"2024-04-25T10:00:34.692263+0000","last_peered":"2024-04-25T10:00:34.692263+0000","last_clean":"2024-04-25T10:00:34.692263+0000","last_became_active":"2024-04-25T10:00:33.700447+0000","last_became_peered":"2024-04-25T10:00:33.700447+0000","last_unstale":"2024-04-25T10:00:34.692263+0000","last_undegraded":"2024-04-25T10:00:34.692263+0000","last_fullsized":"2024-04-25T10:00:34.692263+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:06.029051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.706499+0000","last_change":"2024-04-25T10:00:34.706727+0000","last_active":"2024-04-25T10:00:35.706499+0000","last_peered":"2024-04-25T10:00:35.706499+0000","last_clean":"2024-04-25T10:00:35.706499+0000","last_became_active":"2024-04-25T10:00:34.706431+0000","last_became_peered":"2024-04-25T10:00:34.706431+0000","last_unstale":"2024-04-25T10:00:35.706499+0000","last_undegraded":"2024-04-25T10:00:35.706499+0000","last_fullsized":"2024-04-25T10:00:35.706499+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:03.229236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.706459+0000","last_change":"2024-04-25T10:00:33.697946+0000","last_active":"2024-04-25T10:00:35.706459+0000","last_peered":"2024-04-25T10:00:35.706459+0000","last_clean":"2024-04-25T10:00:35.706459+0000","last_became_active":"2024-04-25T10:00:33.697660+0000","last_became_peered":"2024-04-25T10:00:33.697660+0000","last_unstale":"2024-04-25T10:00:35.706459+0000","last_undegraded":"2024-04-25T10:00:35.706459+0000","last_fullsized":"2024-04-25T10:00:35.706459+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:54.195695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.716166+0000","last_change":"2024-04-25T10:00:34.712588+0000","last_active":"2024-04-25T10:00:34.716166+0000","last_peered":"2024-04-25T10:00:34.716166+0000","last_clean":"2024-04-25T10:00:34.716166+0000","last_became_active":"2024-04-25T10:00:34.711418+0000","last_became_peered":"2024-04-25T10:00:34.711418+0000","last_unstale":"2024-04-25T10:00:34.716166+0000","last_undegraded":"2024-04-25T10:00:34.716166+0000","last_fullsized":"2024-04-25T10:00:34.716166+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:52.804110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.694547+0000","last_change":"2024-04-25T10:00:33.695497+0000","last_active":"2024-04-25T10:00:34.694547+0000","last_peered":"2024-04-25T10:00:34.694547+0000","last_clean":"2024-04-25T10:00:34.694547+0000","last_became_active":"2024-04-25T10:00:33.695186+0000","last_became_peered":"2024-04-25T10:00:33.695186+0000","last_unstale":"2024-04-25T10:00:34.694547+0000","last_undegraded":"2024-04-25T10:00:34.694547+0000","last_fullsized":"2024-04-25T10:00:34.694547+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:52.824906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.869014+0000","last_change":"2024-04-25T10:00:34.691035+0000","last_active":"2024-04-25T10:00:35.869014+0000","last_peered":"2024-04-25T10:00:35.869014+0000","last_clean":"2024-04-25T10:00:35.869014+0000","last_became_active":"2024-04-25T10:00:34.690745+0000","last_became_peered":"2024-04-25T10:00:34.690745+0000","last_unstale":"2024-04-25T10:00:35.869014+0000","last_undegraded":"2024-04-25T10:00:35.869014+0000","last_fullsized":"2024-04-25T10:00:35.869014+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:40.908385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"87'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.714975+0000","last_change":"2024-04-25T10:00:33.701838+0000","last_active":"2024-04-25T10:00:34.714975+0000","last_peered":"2024-04-25T10:00:34.714975+0000","last_clean":"2024-04-25T10:00:34.714975+0000","last_became_active":"2024-04-25T10:00:33.701358+0000","last_became_peered":"2024-04-25T10:00:33.701358+0000","last_unstale":"2024-04-25T10:00:34.714975+0000","last_undegraded":"2024-04-25T10:00:34.714975+0000","last_fullsized":"2024-04-25T10:00:34.714975+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:30.901702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.707505+0000","last_change":"2024-04-25T10:00:34.701211+0000","last_active":"2024-04-25T10:00:34.707505+0000","last_peered":"2024-04-25T10:00:34.707505+0000","last_clean":"2024-04-25T10:00:34.707505+0000","last_became_active":"2024-04-25T10:00:34.700797+0000","last_became_peered":"2024-04-25T10:00:34.700797+0000","last_unstale":"2024-04-25T10:00:34.707505+0000","last_undegraded":"2024-04-25T10:00:34.707505+0000","last_fullsized":"2024-04-25T10:00:34.707505+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:26.212420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"88'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.705662+0000","last_change":"2024-04-25T10:00:33.700497+0000","last_active":"2024-04-25T10:00:35.705662+0000","last_peered":"2024-04-25T10:00:35.705662+0000","last_clean":"2024-04-25T10:00:35.705662+0000","last_became_active":"2024-04-25T10:00:33.700215+0000","last_became_peered":"2024-04-25T10:00:33.700215+0000","last_unstale":"2024-04-25T10:00:35.705662+0000","last_undegraded":"2024-04-25T10:00:35.705662+0000","last_fullsized":"2024-04-25T10:00:35.705662+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:42:34.900813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.706292+0000","last_change":"2024-04-25T10:00:34.700422+0000","last_active":"2024-04-25T10:00:34.706292+0000","last_peered":"2024-04-25T10:00:34.706292+0000","last_clean":"2024-04-25T10:00:34.706292+0000","last_became_active":"2024-04-25T10:00:34.699997+0000","last_became_peered":"2024-04-25T10:00:34.699997+0000","last_unstale":"2024-04-25T10:00:34.706292+0000","last_undegraded":"2024-04-25T10:00:34.706292+0000","last_fullsized":"2024-04-25T10:00:34.706292+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:24.837206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.704543+0000","last_change":"2024-04-25T10:00:33.702808+0000","last_active":"2024-04-25T10:00:35.704543+0000","last_peered":"2024-04-25T10:00:35.704543+0000","last_clean":"2024-04-25T10:00:35.704543+0000","last_became_active":"2024-04-25T10:00:33.702533+0000","last_became_peered":"2024-04-25T10:00:33.702533+0000","last_unstale":"2024-04-25T10:00:35.704543+0000","last_undegraded":"2024-04-25T10:00:35.704543+0000","last_fullsized":"2024-04-25T10:00:35.704543+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:48.754794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.706751+0000","last_change":"2024-04-25T10:00:34.698875+0000","last_active":"2024-04-25T10:00:35.706751+0000","last_peered":"2024-04-25T10:00:35.706751+0000","last_clean":"2024-04-25T10:00:35.706751+0000","last_became_active":"2024-04-25T10:00:34.698538+0000","last_became_peered":"2024-04-25T10:00:34.698538+0000","last_unstale":"2024-04-25T10:00:35.706751+0000","last_undegraded":"2024-04-25T10:00:35.706751+0000","last_fullsized":"2024-04-25T10:00:35.706751+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:19.684811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.869221+0000","last_change":"2024-04-25T10:00:33.699468+0000","last_active":"2024-04-25T10:00:35.869221+0000","last_peered":"2024-04-25T10:00:35.869221+0000","last_clean":"2024-04-25T10:00:35.869221+0000","last_became_active":"2024-04-25T10:00:33.699196+0000","last_became_peered":"2024-04-25T10:00:33.699196+0000","last_unstale":"2024-04-25T10:00:35.869221+0000","last_undegraded":"2024-04-25T10:00:35.869221+0000","last_fullsized":"2024-04-25T10:00:35.869221+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:05.572101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.712671+0000","last_change":"2024-04-25T10:00:34.710372+0000","last_active":"2024-04-25T10:00:34.712671+0000","last_peered":"2024-04-25T10:00:34.712671+0000","last_clean":"2024-04-25T10:00:34.712671+0000","last_became_active":"2024-04-25T10:00:34.710077+0000","last_became_peered":"2024-04-25T10:00:34.710077+0000","last_unstale":"2024-04-25T10:00:34.712671+0000","last_undegraded":"2024-04-25T10:00:34.712671+0000","last_fullsized":"2024-04-25T10:00:34.712671+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:43.881755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.692578+0000","last_change":"2024-04-25T10:00:33.703938+0000","last_active":"2024-04-25T10:00:34.692578+0000","last_peered":"2024-04-25T10:00:34.692578+0000","last_clean":"2024-04-25T10:00:34.692578+0000","last_became_active":"2024-04-25T10:00:33.703296+0000","last_became_peered":"2024-04-25T10:00:33.703296+0000","last_unstale":"2024-04-25T10:00:34.692578+0000","last_undegraded":"2024-04-25T10:00:34.692578+0000","last_fullsized":"2024-04-25T10:00:34.692578+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:30.137629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.713673+0000","last_change":"2024-04-25T10:00:34.709661+0000","last_active":"2024-04-25T10:00:34.713673+0000","last_peered":"2024-04-25T10:00:34.713673+0000","last_clean":"2024-04-25T10:00:34.713673+0000","last_became_active":"2024-04-25T10:00:34.709330+0000","last_became_peered":"2024-04-25T10:00:34.709330+0000","last_unstale":"2024-04-25T10:00:34.713673+0000","last_undegraded":"2024-04-25T10:00:34.713673+0000","last_fullsized":"2024-04-25T10:00:34.713673+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:28.835260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.706510+0000","last_change":"2024-04-25T10:00:33.697208+0000","last_active":"2024-04-25T10:00:35.706510+0000","last_peered":"2024-04-25T10:00:35.706510+0000","last_clean":"2024-04-25T10:00:35.706510+0000","last_became_active":"2024-04-25T10:00:33.696914+0000","last_became_peered":"2024-04-25T10:00:33.696914+0000","last_unstale":"2024-04-25T10:00:35.706510+0000","last_undegraded":"2024-04-25T10:00:35.706510+0000","last_fullsized":"2024-04-25T10:00:35.706510+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:24:18.837013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.868988+0000","last_change":"2024-04-25T10:00:34.701114+0000","last_active":"2024-04-25T10:00:35.868988+0000","last_peered":"2024-04-25T10:00:35.868988+0000","last_clean":"2024-04-25T10:00:35.868988+0000","last_became_active":"2024-04-25T10:00:34.700795+0000","last_became_peered":"2024-04-25T10:00:34.700795+0000","last_unstale":"2024-04-25T10:00:35.868988+0000","last_undegraded":"2024-04-25T10:00:35.868988+0000","last_fullsized":"2024-04-25T10:00:35.868988+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:03.262312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.869108+0000","last_change":"2024-04-25T10:00:33.695464+0000","last_active":"2024-04-25T10:00:35.869108+0000","last_peered":"2024-04-25T10:00:35.869108+0000","last_clean":"2024-04-25T10:00:35.869108+0000","last_became_active":"2024-04-25T10:00:33.695055+0000","last_became_peered":"2024-04-25T10:00:33.695055+0000","last_unstale":"2024-04-25T10:00:35.869108+0000","last_undegraded":"2024-04-25T10:00:35.869108+0000","last_fullsized":"2024-04-25T10:00:35.869108+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:03.980250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.707612+0000","last_change":"2024-04-25T10:00:34.703076+0000","last_active":"2024-04-25T10:00:34.707612+0000","last_peered":"2024-04-25T10:00:34.707612+0000","last_clean":"2024-04-25T10:00:34.707612+0000","last_became_active":"2024-04-25T10:00:34.702795+0000","last_became_peered":"2024-04-25T10:00:34.702795+0000","last_unstale":"2024-04-25T10:00:34.707612+0000","last_undegraded":"2024-04-25T10:00:34.707612+0000","last_fullsized":"2024-04-25T10:00:34.707612+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:49.485457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.683557+0000","last_change":"2024-04-25T10:00:33.700907+0000","last_active":"2024-04-25T10:00:34.683557+0000","last_peered":"2024-04-25T10:00:34.683557+0000","last_clean":"2024-04-25T10:00:34.683557+0000","last_became_active":"2024-04-25T10:00:33.700570+0000","last_became_peered":"2024-04-25T10:00:33.700570+0000","last_unstale":"2024-04-25T10:00:34.683557+0000","last_undegraded":"2024-04-25T10:00:34.683557+0000","last_fullsized":"2024-04-25T10:00:34.683557+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:59.136168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.688634+0000","last_change":"2024-04-25T10:00:34.686884+0000","last_active":"2024-04-25T10:00:34.688634+0000","last_peered":"2024-04-25T10:00:34.688634+0000","last_clean":"2024-04-25T10:00:34.688634+0000","last_became_active":"2024-04-25T10:00:34.686510+0000","last_became_peered":"2024-04-25T10:00:34.686510+0000","last_unstale":"2024-04-25T10:00:34.688634+0000","last_undegraded":"2024-04-25T10:00:34.688634+0000","last_fullsized":"2024-04-25T10:00:34.688634+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:41.942475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.690086+0000","last_change":"2024-04-25T10:00:33.690904+0000","last_active":"2024-04-25T10:00:34.690086+0000","last_peered":"2024-04-25T10:00:34.690086+0000","last_clean":"2024-04-25T10:00:34.690086+0000","last_became_active":"2024-04-25T10:00:33.690591+0000","last_became_peered":"2024-04-25T10:00:33.690591+0000","last_unstale":"2024-04-25T10:00:34.690086+0000","last_undegraded":"2024-04-25T10:00:34.690086+0000","last_fullsized":"2024-04-25T10:00:34.690086+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:04.085303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":293,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.683633+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T10:00:34.683633+0000","last_peered":"2024-04-25T10:00:34.683633+0000","last_clean":"2024-04-25T10:00:34.683633+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T10:00:34.683633+0000","last_undegraded":"2024-04-25T10:00:34.683633+0000","last_fullsized":"2024-04-25T10:00:34.683633+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542223,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32824,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339016,"statfs":{"total":96636764160,"available":96603152384,"internally_reserved":0,"allocated":1671168,"data_stored":1079147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542223,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1089536,"data_stored":490939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542225,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1069056,"data_stored":488723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542222,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32244,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1077248,"data_stored":488883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1056768,"data_stored":481556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1056768,"data_stored":481556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1073152,"data_stored":488793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32800,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339040,"statfs":{"total":96636764160,"available":96603176960,"internally_reserved":0,"allocated":1650688,"data_stored":1071924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:00:37.697 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:00:37.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.825+0000 7f84758ea640 1 Processor -- start 2024-04-25T10:00:37.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.825+0000 7f84758ea640 1 -- start start 2024-04-25T10:00:37.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.826+0000 7f84758ea640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f84700b5e60 0x7f847006bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:37.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.826+0000 7f84758ea640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f84700b6a40 0x7f847006c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:37.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.826+0000 7f84758ea640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f847006ca30 con 0x7f847015dd00 2024-04-25T10:00:37.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.826+0000 7f84758ea640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f847015e0e0 con 0x7f84700b5e60 2024-04-25T10:00:37.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.826+0000 7f84758ea640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f847006cfe0 con 0x7f84700b6a40 2024-04-25T10:00:37.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.826+0000 7f846e7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f84700b5e60 0x7f847006bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:37.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.826+0000 7f846f7fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f84700b6a40 0x7f847006c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:37.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.826+0000 7f846e7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f84700b5e60 0x7f847006bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:37790/0 (socket says 172.21.15.7:37790) 2024-04-25T10:00:37.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.826+0000 7f846f7fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f84700b6a40 0x7f847006c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:39270/0 (socket says 172.21.15.7:39270) 2024-04-25T10:00:37.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.826+0000 7f846e7fc640 1 -- 172.21.15.7:0/2910397514 learned_addr learned my addr 172.21.15.7:0/2910397514 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:37.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.826+0000 7f846effd640 1 --1- 172.21.15.7:0/2910397514 >> v1:172.21.15.55:6789/0 conn(0x7f847015dd00 0x7f84700b5750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:56682/0 (socket says 172.21.15.7:56682) 2024-04-25T10:00:37.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.827+0000 7f846e7fc640 1 -- 172.21.15.7:0/2910397514 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f84700b6a40 msgr2=0x7f847006c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:37.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.827+0000 7f846e7fc640 1 --2- 172.21.15.7:0/2910397514 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f84700b6a40 0x7f847006c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:37.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.827+0000 7f846e7fc640 1 -- 172.21.15.7:0/2910397514 >> v1:172.21.15.55:6789/0 conn(0x7f847015dd00 legacy=0x7f84700b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:37.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.827+0000 7f846e7fc640 1 -- 172.21.15.7:0/2910397514 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f847006cd00 con 0x7f84700b5e60 2024-04-25T10:00:37.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.827+0000 7f846f7fe640 1 --2- 172.21.15.7:0/2910397514 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f84700b6a40 0x7f847006c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:00:37.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.828+0000 7f846e7fc640 1 --2- 172.21.15.7:0/2910397514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84700b5e60 0x7f847006bfb0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8458009870 tx=0x7f845802a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2539824030470ffb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:37.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.828+0000 7f846dffb640 1 -- 172.21.15.7:0/2910397514 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8458037070 con 0x7f84700b5e60 2024-04-25T10:00:37.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.828+0000 7f846dffb640 1 -- 172.21.15.7:0/2910397514 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845802ae50 con 0x7f84700b5e60 2024-04-25T10:00:37.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.828+0000 7f846dffb640 1 -- 172.21.15.7:0/2910397514 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8458032860 con 0x7f84700b5e60 2024-04-25T10:00:37.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.828+0000 7f84758ea640 1 -- 172.21.15.7:0/2910397514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84700b5e60 msgr2=0x7f847006bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:37.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.828+0000 7f84758ea640 1 --2- 172.21.15.7:0/2910397514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84700b5e60 0x7f847006bfb0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8458009870 tx=0x7f845802a300 comp rx=0 tx=0).stop 2024-04-25T10:00:37.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.828+0000 7f84758ea640 1 -- 172.21.15.7:0/2910397514 shutdown_connections 2024-04-25T10:00:37.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.828+0000 7f84758ea640 1 --2- 172.21.15.7:0/2910397514 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f84700b6a40 0x7f847006c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:37.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.828+0000 7f84758ea640 1 --2- 172.21.15.7:0/2910397514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84700b5e60 0x7f847006bfb0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:37.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.828+0000 7f84758ea640 1 -- 172.21.15.7:0/2910397514 >> 172.21.15.7:0/2910397514 conn(0x7f84700d07b0 msgr2=0x7f84700d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:37.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.828+0000 7f84758ea640 1 -- 172.21.15.7:0/2910397514 shutdown_connections 2024-04-25T10:00:37.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.828+0000 7f84758ea640 1 -- 172.21.15.7:0/2910397514 wait complete. 2024-04-25T10:00:37.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.830+0000 7f84758ea640 1 Processor -- start 2024-04-25T10:00:37.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.830+0000 7f84758ea640 1 -- start start 2024-04-25T10:00:37.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.830+0000 7f84758ea640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84700b5e60 0x7f8470152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:37.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.830+0000 7f84758ea640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84700b6a40 0x7f847014cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:37.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.830+0000 7f84758ea640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f847015dd00 0x7f847014d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:37.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.830+0000 7f84758ea640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84700d2260 con 0x7f84700b5e60 2024-04-25T10:00:37.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.830+0000 7f84758ea640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84700d1f80 con 0x7f84700b6a40 2024-04-25T10:00:37.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.830+0000 7f84758ea640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84700d2780 con 0x7f847015dd00 2024-04-25T10:00:37.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.831+0000 7f846effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84700b5e60 0x7f8470152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:37.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.831+0000 7f846effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84700b5e60 0x7f8470152e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51244/0 (socket says 172.21.15.7:51244) 2024-04-25T10:00:37.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.831+0000 7f846effd640 1 -- 172.21.15.7:0/2131069298 learned_addr learned my addr 172.21.15.7:0/2131069298 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:37.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.831+0000 7f846f7fe640 1 --2- 172.21.15.7:0/2131069298 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f847015dd00 0x7f847014d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:37.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.831+0000 7f846e7fc640 1 --2- 172.21.15.7:0/2131069298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84700b6a40 0x7f847014cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:37.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.831+0000 7f846effd640 1 -- 172.21.15.7:0/2131069298 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f847015dd00 msgr2=0x7f847014d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:37.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.831+0000 7f846effd640 1 --2- 172.21.15.7:0/2131069298 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f847015dd00 0x7f847014d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:37.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.831+0000 7f846effd640 1 -- 172.21.15.7:0/2131069298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84700b6a40 msgr2=0x7f847014cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:37.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.831+0000 7f846effd640 1 --2- 172.21.15.7:0/2131069298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84700b6a40 0x7f847014cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:37.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.831+0000 7f846effd640 1 -- 172.21.15.7:0/2131069298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84701547f0 con 0x7f84700b5e60 2024-04-25T10:00:37.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.831+0000 7f846effd640 1 --2- 172.21.15.7:0/2131069298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84700b5e60 0x7f8470152e20 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f846800c3f0 tx=0x7f846800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:37.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.831+0000 7f8467fff640 1 -- 172.21.15.7:0/2131069298 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84680074e0 con 0x7f84700b5e60 2024-04-25T10:00:37.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.831+0000 7f8467fff640 1 -- 172.21.15.7:0/2131069298 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8468007680 con 0x7f84700b5e60 2024-04-25T10:00:37.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.831+0000 7f8467fff640 1 -- 172.21.15.7:0/2131069298 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8468004a00 con 0x7f84700b5e60 2024-04-25T10:00:37.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.831+0000 7f84758ea640 1 -- 172.21.15.7:0/2131069298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8470156500 con 0x7f84700b5e60 2024-04-25T10:00:37.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.831+0000 7f84758ea640 1 -- 172.21.15.7:0/2131069298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8470156a80 con 0x7f84700b5e60 2024-04-25T10:00:37.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.832+0000 7f84758ea640 1 -- 172.21.15.7:0/2131069298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8470068fd0 con 0x7f84700b5e60 2024-04-25T10:00:37.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.833+0000 7f8467fff640 1 -- 172.21.15.7:0/2131069298 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f846801a020 con 0x7f84700b5e60 2024-04-25T10:00:37.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.834+0000 7f8467fff640 1 --2- 172.21.15.7:0/2131069298 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f845006b4d0 0x7f845006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:37.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.834+0000 7f846e7fc640 1 --2- 172.21.15.7:0/2131069298 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f845006b4d0 0x7f845006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:37.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.834+0000 7f8467fff640 1 -- 172.21.15.7:0/2131069298 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8468089a60 con 0x7f84700b5e60 2024-04-25T10:00:37.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.834+0000 7f846e7fc640 1 --2- 172.21.15.7:0/2131069298 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f845006b4d0 0x7f845006d990 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8458034000 tx=0x7f845802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:37.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:37.838+0000 7f8467fff640 1 -- 172.21.15.7:0/2131069298 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f84701547f0 con 0x7f84700b5e60 2024-04-25T10:00:38.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.017+0000 7f84758ea640 1 -- 172.21.15.7:0/2131069298 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f84700d1620 con 0x7f845006b4d0 2024-04-25T10:00:38.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.023+0000 7f8467fff640 1 -- 172.21.15.7:0/2131069298 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252028 (secure 0 0 0) 0x7f84700d1620 con 0x7f845006b4d0 2024-04-25T10:00:38.031 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:00:38.033 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T10:00:38.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.026+0000 7f84758ea640 1 -- 172.21.15.7:0/2131069298 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f845006b4d0 msgr2=0x7f845006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:38.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.026+0000 7f84758ea640 1 --2- 172.21.15.7:0/2131069298 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f845006b4d0 0x7f845006d990 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8458034000 tx=0x7f845802e000 comp rx=0 tx=0).stop 2024-04-25T10:00:38.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.026+0000 7f84758ea640 1 -- 172.21.15.7:0/2131069298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84700b5e60 msgr2=0x7f8470152e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:38.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.026+0000 7f84758ea640 1 --2- 172.21.15.7:0/2131069298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84700b5e60 0x7f8470152e20 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f846800c3f0 tx=0x7f846800c7f0 comp rx=0 tx=0).stop 2024-04-25T10:00:38.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.026+0000 7f84758ea640 1 -- 172.21.15.7:0/2131069298 shutdown_connections 2024-04-25T10:00:38.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.026+0000 7f84758ea640 1 --2- 172.21.15.7:0/2131069298 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f845006b4d0 0x7f845006d990 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:38.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.026+0000 7f84758ea640 1 --2- 172.21.15.7:0/2131069298 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f847015dd00 0x7f847014d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:38.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.026+0000 7f84758ea640 1 --2- 172.21.15.7:0/2131069298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84700b6a40 0x7f847014cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:38.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.026+0000 7f84758ea640 1 --2- 172.21.15.7:0/2131069298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84700b5e60 0x7f8470152e20 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:38.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.026+0000 7f84758ea640 1 -- 172.21.15.7:0/2131069298 >> 172.21.15.7:0/2131069298 conn(0x7f84700d07b0 msgr2=0x7f84700d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:38.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.027+0000 7f84758ea640 1 -- 172.21.15.7:0/2131069298 shutdown_connections 2024-04-25T10:00:38.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.027+0000 7f84758ea640 1 -- 172.21.15.7:0/2131069298 wait complete. 2024-04-25T10:00:38.042 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":273,"stamp":"2024-04-25T10:00:37.938408+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259020,"kb_used_data":9516,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715700,"statfs":{"total":773094113280,"available":772828876800,"internally_reserved":0,"allocated":9744384,"data_stored":5071521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.262312"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.712288+0000","last_change":"2024-04-25T10:00:34.705564+0000","last_active":"2024-04-25T10:00:34.712288+0000","last_peered":"2024-04-25T10:00:34.712288+0000","last_clean":"2024-04-25T10:00:34.712288+0000","last_became_active":"2024-04-25T10:00:34.705224+0000","last_became_peered":"2024-04-25T10:00:34.705224+0000","last_unstale":"2024-04-25T10:00:34.712288+0000","last_undegraded":"2024-04-25T10:00:34.712288+0000","last_fullsized":"2024-04-25T10:00:34.712288+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:41.942475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.706686+0000","last_change":"2024-04-25T10:00:34.699540+0000","last_active":"2024-04-25T10:00:35.706686+0000","last_peered":"2024-04-25T10:00:35.706686+0000","last_clean":"2024-04-25T10:00:35.706686+0000","last_became_active":"2024-04-25T10:00:34.699204+0000","last_became_peered":"2024-04-25T10:00:34.699204+0000","last_unstale":"2024-04-25T10:00:35.706686+0000","last_undegraded":"2024-04-25T10:00:35.706686+0000","last_fullsized":"2024-04-25T10:00:35.706686+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:53:55.927303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.707255+0000","last_change":"2024-04-25T10:00:34.699749+0000","last_active":"2024-04-25T10:00:34.707255+0000","last_peered":"2024-04-25T10:00:34.707255+0000","last_clean":"2024-04-25T10:00:34.707255+0000","last_became_active":"2024-04-25T10:00:34.699451+0000","last_became_peered":"2024-04-25T10:00:34.699451+0000","last_unstale":"2024-04-25T10:00:34.707255+0000","last_undegraded":"2024-04-25T10:00:34.707255+0000","last_fullsized":"2024-04-25T10:00:34.707255+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:53:55.927303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.704506+0000","last_change":"2024-04-25T10:00:34.698579+0000","last_active":"2024-04-25T10:00:34.704506+0000","last_peered":"2024-04-25T10:00:34.704506+0000","last_clean":"2024-04-25T10:00:34.704506+0000","last_became_active":"2024-04-25T10:00:34.698274+0000","last_became_peered":"2024-04-25T10:00:34.698274+0000","last_unstale":"2024-04-25T10:00:34.704506+0000","last_undegraded":"2024-04-25T10:00:34.704506+0000","last_fullsized":"2024-04-25T10:00:34.704506+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:28.794183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.703935+0000","last_change":"2024-04-25T10:00:34.698889+0000","last_active":"2024-04-25T10:00:35.703935+0000","last_peered":"2024-04-25T10:00:35.703935+0000","last_clean":"2024-04-25T10:00:35.703935+0000","last_became_active":"2024-04-25T10:00:34.697889+0000","last_became_peered":"2024-04-25T10:00:34.697889+0000","last_unstale":"2024-04-25T10:00:35.703935+0000","last_undegraded":"2024-04-25T10:00:35.703935+0000","last_fullsized":"2024-04-25T10:00:35.703935+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:27.363721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.709708+0000","last_change":"2024-04-25T10:00:34.707025+0000","last_active":"2024-04-25T10:00:34.709708+0000","last_peered":"2024-04-25T10:00:34.709708+0000","last_clean":"2024-04-25T10:00:34.709708+0000","last_became_active":"2024-04-25T10:00:34.706708+0000","last_became_peered":"2024-04-25T10:00:34.706708+0000","last_unstale":"2024-04-25T10:00:34.709708+0000","last_undegraded":"2024-04-25T10:00:34.709708+0000","last_fullsized":"2024-04-25T10:00:34.709708+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:12.385289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.687301+0000","last_change":"2024-04-25T10:00:34.686819+0000","last_active":"2024-04-25T10:00:34.687301+0000","last_peered":"2024-04-25T10:00:34.687301+0000","last_clean":"2024-04-25T10:00:34.687301+0000","last_became_active":"2024-04-25T10:00:34.686459+0000","last_became_peered":"2024-04-25T10:00:34.686459+0000","last_unstale":"2024-04-25T10:00:34.687301+0000","last_undegraded":"2024-04-25T10:00:34.687301+0000","last_fullsized":"2024-04-25T10:00:34.687301+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:53:55.927303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.710794+0000","last_change":"2024-04-25T10:00:34.708607+0000","last_active":"2024-04-25T10:00:34.710794+0000","last_peered":"2024-04-25T10:00:34.710794+0000","last_clean":"2024-04-25T10:00:34.710794+0000","last_became_active":"2024-04-25T10:00:34.706064+0000","last_became_peered":"2024-04-25T10:00:34.706064+0000","last_unstale":"2024-04-25T10:00:34.710794+0000","last_undegraded":"2024-04-25T10:00:34.710794+0000","last_fullsized":"2024-04-25T10:00:34.710794+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:21:03.882042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.704244+0000","last_change":"2024-04-25T10:00:34.700929+0000","last_active":"2024-04-25T10:00:35.704244+0000","last_peered":"2024-04-25T10:00:35.704244+0000","last_clean":"2024-04-25T10:00:35.704244+0000","last_became_active":"2024-04-25T10:00:34.699354+0000","last_became_peered":"2024-04-25T10:00:34.699354+0000","last_unstale":"2024-04-25T10:00:35.704244+0000","last_undegraded":"2024-04-25T10:00:35.704244+0000","last_fullsized":"2024-04-25T10:00:35.704244+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:48.467992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.712749+0000","last_change":"2024-04-25T10:00:34.708668+0000","last_active":"2024-04-25T10:00:34.712749+0000","last_peered":"2024-04-25T10:00:34.712749+0000","last_clean":"2024-04-25T10:00:34.712749+0000","last_became_active":"2024-04-25T10:00:34.708388+0000","last_became_peered":"2024-04-25T10:00:34.708388+0000","last_unstale":"2024-04-25T10:00:34.712749+0000","last_undegraded":"2024-04-25T10:00:34.712749+0000","last_fullsized":"2024-04-25T10:00:34.712749+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:47.883264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.704182+0000","last_change":"2024-04-25T10:00:34.705470+0000","last_active":"2024-04-25T10:00:35.704182+0000","last_peered":"2024-04-25T10:00:35.704182+0000","last_clean":"2024-04-25T10:00:35.704182+0000","last_became_active":"2024-04-25T10:00:34.705128+0000","last_became_peered":"2024-04-25T10:00:34.705128+0000","last_unstale":"2024-04-25T10:00:35.704182+0000","last_undegraded":"2024-04-25T10:00:35.704182+0000","last_fullsized":"2024-04-25T10:00:35.704182+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:03.262312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.712630+0000","last_change":"2024-04-25T10:00:34.705017+0000","last_active":"2024-04-25T10:00:34.712630+0000","last_peered":"2024-04-25T10:00:34.712630+0000","last_clean":"2024-04-25T10:00:34.712630+0000","last_became_active":"2024-04-25T10:00:34.704711+0000","last_became_peered":"2024-04-25T10:00:34.704711+0000","last_unstale":"2024-04-25T10:00:34.712630+0000","last_undegraded":"2024-04-25T10:00:34.712630+0000","last_fullsized":"2024-04-25T10:00:34.712630+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:27.588112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.707908+0000","last_change":"2024-04-25T10:00:34.705330+0000","last_active":"2024-04-25T10:00:34.707908+0000","last_peered":"2024-04-25T10:00:34.707908+0000","last_clean":"2024-04-25T10:00:34.707908+0000","last_became_active":"2024-04-25T10:00:34.704960+0000","last_became_peered":"2024-04-25T10:00:34.704960+0000","last_unstale":"2024-04-25T10:00:34.707908+0000","last_undegraded":"2024-04-25T10:00:34.707908+0000","last_fullsized":"2024-04-25T10:00:34.707908+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:04.991679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.703761+0000","last_change":"2024-04-25T10:00:34.705945+0000","last_active":"2024-04-25T10:00:35.703761+0000","last_peered":"2024-04-25T10:00:35.703761+0000","last_clean":"2024-04-25T10:00:35.703761+0000","last_became_active":"2024-04-25T10:00:34.705668+0000","last_became_peered":"2024-04-25T10:00:34.705668+0000","last_unstale":"2024-04-25T10:00:35.703761+0000","last_undegraded":"2024-04-25T10:00:35.703761+0000","last_fullsized":"2024-04-25T10:00:35.703761+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:59.982997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.719999+0000","last_change":"2024-04-25T10:00:34.716173+0000","last_active":"2024-04-25T10:00:34.719999+0000","last_peered":"2024-04-25T10:00:34.719999+0000","last_clean":"2024-04-25T10:00:34.719999+0000","last_became_active":"2024-04-25T10:00:34.715895+0000","last_became_peered":"2024-04-25T10:00:34.715895+0000","last_unstale":"2024-04-25T10:00:34.719999+0000","last_undegraded":"2024-04-25T10:00:34.719999+0000","last_fullsized":"2024-04-25T10:00:34.719999+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:50.883519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.706262+0000","last_change":"2024-04-25T10:00:34.700332+0000","last_active":"2024-04-25T10:00:34.706262+0000","last_peered":"2024-04-25T10:00:34.706262+0000","last_clean":"2024-04-25T10:00:34.706262+0000","last_became_active":"2024-04-25T10:00:34.699651+0000","last_became_peered":"2024-04-25T10:00:34.699651+0000","last_unstale":"2024-04-25T10:00:34.706262+0000","last_undegraded":"2024-04-25T10:00:34.706262+0000","last_fullsized":"2024-04-25T10:00:34.706262+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:04.415028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.707581+0000","last_change":"2024-04-25T10:00:34.701342+0000","last_active":"2024-04-25T10:00:34.707581+0000","last_peered":"2024-04-25T10:00:34.707581+0000","last_clean":"2024-04-25T10:00:34.707581+0000","last_became_active":"2024-04-25T10:00:34.700955+0000","last_became_peered":"2024-04-25T10:00:34.700955+0000","last_unstale":"2024-04-25T10:00:34.707581+0000","last_undegraded":"2024-04-25T10:00:34.707581+0000","last_fullsized":"2024-04-25T10:00:34.707581+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:11.103055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.697039+0000","last_change":"2024-04-25T10:00:34.690820+0000","last_active":"2024-04-25T10:00:34.697039+0000","last_peered":"2024-04-25T10:00:34.697039+0000","last_clean":"2024-04-25T10:00:34.697039+0000","last_became_active":"2024-04-25T10:00:34.690513+0000","last_became_peered":"2024-04-25T10:00:34.690513+0000","last_unstale":"2024-04-25T10:00:34.697039+0000","last_undegraded":"2024-04-25T10:00:34.697039+0000","last_fullsized":"2024-04-25T10:00:34.697039+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:11.735986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.704356+0000","last_change":"2024-04-25T10:00:34.707650+0000","last_active":"2024-04-25T10:00:35.704356+0000","last_peered":"2024-04-25T10:00:35.704356+0000","last_clean":"2024-04-25T10:00:35.704356+0000","last_became_active":"2024-04-25T10:00:34.707343+0000","last_became_peered":"2024-04-25T10:00:34.707343+0000","last_unstale":"2024-04-25T10:00:35.704356+0000","last_undegraded":"2024-04-25T10:00:35.704356+0000","last_fullsized":"2024-04-25T10:00:35.704356+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:55.207124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.719045+0000","last_change":"2024-04-25T10:00:34.715348+0000","last_active":"2024-04-25T10:00:34.719045+0000","last_peered":"2024-04-25T10:00:34.719045+0000","last_clean":"2024-04-25T10:00:34.719045+0000","last_became_active":"2024-04-25T10:00:34.715056+0000","last_became_peered":"2024-04-25T10:00:34.715056+0000","last_unstale":"2024-04-25T10:00:34.719045+0000","last_undegraded":"2024-04-25T10:00:34.719045+0000","last_fullsized":"2024-04-25T10:00:34.719045+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:06.583530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.703971+0000","last_change":"2024-04-25T10:00:34.694233+0000","last_active":"2024-04-25T10:00:35.703971+0000","last_peered":"2024-04-25T10:00:35.703971+0000","last_clean":"2024-04-25T10:00:35.703971+0000","last_became_active":"2024-04-25T10:00:34.693960+0000","last_became_peered":"2024-04-25T10:00:34.693960+0000","last_unstale":"2024-04-25T10:00:35.703971+0000","last_undegraded":"2024-04-25T10:00:35.703971+0000","last_fullsized":"2024-04-25T10:00:35.703971+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:33.653996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.703749+0000","last_change":"2024-04-25T10:00:34.703229+0000","last_active":"2024-04-25T10:00:35.703749+0000","last_peered":"2024-04-25T10:00:35.703749+0000","last_clean":"2024-04-25T10:00:35.703749+0000","last_became_active":"2024-04-25T10:00:34.702928+0000","last_became_peered":"2024-04-25T10:00:34.702928+0000","last_unstale":"2024-04-25T10:00:35.703749+0000","last_undegraded":"2024-04-25T10:00:35.703749+0000","last_fullsized":"2024-04-25T10:00:35.703749+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:04.694494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.868938+0000","last_change":"2024-04-25T10:00:34.701271+0000","last_active":"2024-04-25T10:00:35.868938+0000","last_peered":"2024-04-25T10:00:35.868938+0000","last_clean":"2024-04-25T10:00:35.868938+0000","last_became_active":"2024-04-25T10:00:34.700937+0000","last_became_peered":"2024-04-25T10:00:34.700937+0000","last_unstale":"2024-04-25T10:00:35.868938+0000","last_undegraded":"2024-04-25T10:00:35.868938+0000","last_fullsized":"2024-04-25T10:00:35.868938+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:27.363721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.697218+0000","last_change":"2024-04-25T10:00:34.692224+0000","last_active":"2024-04-25T10:00:34.697218+0000","last_peered":"2024-04-25T10:00:34.697218+0000","last_clean":"2024-04-25T10:00:34.697218+0000","last_became_active":"2024-04-25T10:00:34.691933+0000","last_became_peered":"2024-04-25T10:00:34.691933+0000","last_unstale":"2024-04-25T10:00:34.697218+0000","last_undegraded":"2024-04-25T10:00:34.697218+0000","last_fullsized":"2024-04-25T10:00:34.697218+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:03.229236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.706720+0000","last_change":"2024-04-25T10:00:34.693176+0000","last_active":"2024-04-25T10:00:35.706720+0000","last_peered":"2024-04-25T10:00:35.706720+0000","last_clean":"2024-04-25T10:00:35.706720+0000","last_became_active":"2024-04-25T10:00:34.692883+0000","last_became_peered":"2024-04-25T10:00:34.692883+0000","last_unstale":"2024-04-25T10:00:35.706720+0000","last_undegraded":"2024-04-25T10:00:35.706720+0000","last_fullsized":"2024-04-25T10:00:35.706720+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:41.942475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.704124+0000","last_change":"2024-04-25T10:00:34.705996+0000","last_active":"2024-04-25T10:00:35.704124+0000","last_peered":"2024-04-25T10:00:35.704124+0000","last_clean":"2024-04-25T10:00:35.704124+0000","last_became_active":"2024-04-25T10:00:34.705642+0000","last_became_peered":"2024-04-25T10:00:34.705642+0000","last_unstale":"2024-04-25T10:00:35.704124+0000","last_undegraded":"2024-04-25T10:00:35.704124+0000","last_fullsized":"2024-04-25T10:00:35.704124+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:40.908385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.704203+0000","last_change":"2024-04-25T10:00:34.696530+0000","last_active":"2024-04-25T10:00:34.704203+0000","last_peered":"2024-04-25T10:00:34.704203+0000","last_clean":"2024-04-25T10:00:34.704203+0000","last_became_active":"2024-04-25T10:00:34.696264+0000","last_became_peered":"2024-04-25T10:00:34.696264+0000","last_unstale":"2024-04-25T10:00:34.704203+0000","last_undegraded":"2024-04-25T10:00:34.704203+0000","last_fullsized":"2024-04-25T10:00:34.704203+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:36.889585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.707876+0000","last_change":"2024-04-25T10:00:34.705999+0000","last_active":"2024-04-25T10:00:34.707876+0000","last_peered":"2024-04-25T10:00:34.707876+0000","last_clean":"2024-04-25T10:00:34.707876+0000","last_became_active":"2024-04-25T10:00:34.705727+0000","last_became_peered":"2024-04-25T10:00:34.705727+0000","last_unstale":"2024-04-25T10:00:34.707876+0000","last_undegraded":"2024-04-25T10:00:34.707876+0000","last_fullsized":"2024-04-25T10:00:34.707876+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:56.308526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.698231+0000","last_change":"2024-04-25T10:00:34.697553+0000","last_active":"2024-04-25T10:00:34.698231+0000","last_peered":"2024-04-25T10:00:34.698231+0000","last_clean":"2024-04-25T10:00:34.698231+0000","last_became_active":"2024-04-25T10:00:34.697197+0000","last_became_peered":"2024-04-25T10:00:34.697197+0000","last_unstale":"2024-04-25T10:00:34.698231+0000","last_undegraded":"2024-04-25T10:00:34.698231+0000","last_fullsized":"2024-04-25T10:00:34.698231+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:28.835260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.704134+0000","last_change":"2024-04-25T10:00:34.693663+0000","last_active":"2024-04-25T10:00:35.704134+0000","last_peered":"2024-04-25T10:00:35.704134+0000","last_clean":"2024-04-25T10:00:35.704134+0000","last_became_active":"2024-04-25T10:00:34.691860+0000","last_became_peered":"2024-04-25T10:00:34.691860+0000","last_unstale":"2024-04-25T10:00:35.704134+0000","last_undegraded":"2024-04-25T10:00:35.704134+0000","last_fullsized":"2024-04-25T10:00:35.704134+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:58:27.627712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.706308+0000","last_change":"2024-04-25T10:00:34.700315+0000","last_active":"2024-04-25T10:00:35.706308+0000","last_peered":"2024-04-25T10:00:35.706308+0000","last_clean":"2024-04-25T10:00:35.706308+0000","last_became_active":"2024-04-25T10:00:34.699454+0000","last_became_peered":"2024-04-25T10:00:34.699454+0000","last_unstale":"2024-04-25T10:00:35.706308+0000","last_undegraded":"2024-04-25T10:00:35.706308+0000","last_fullsized":"2024-04-25T10:00:35.706308+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:10:33.294371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.706242+0000","last_change":"2024-04-25T10:00:34.699961+0000","last_active":"2024-04-25T10:00:34.706242+0000","last_peered":"2024-04-25T10:00:34.706242+0000","last_clean":"2024-04-25T10:00:34.706242+0000","last_became_active":"2024-04-25T10:00:34.699278+0000","last_became_peered":"2024-04-25T10:00:34.699278+0000","last_unstale":"2024-04-25T10:00:34.706242+0000","last_undegraded":"2024-04-25T10:00:34.706242+0000","last_fullsized":"2024-04-25T10:00:34.706242+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:29.027193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.707042+0000","last_change":"2024-04-25T10:00:34.700626+0000","last_active":"2024-04-25T10:00:34.707042+0000","last_peered":"2024-04-25T10:00:34.707042+0000","last_clean":"2024-04-25T10:00:34.707042+0000","last_became_active":"2024-04-25T10:00:34.700260+0000","last_became_peered":"2024-04-25T10:00:34.700260+0000","last_unstale":"2024-04-25T10:00:34.707042+0000","last_undegraded":"2024-04-25T10:00:34.707042+0000","last_fullsized":"2024-04-25T10:00:34.707042+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:34.001767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"87'4","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.869309+0000","last_change":"2024-04-25T10:00:33.700311+0000","last_active":"2024-04-25T10:00:35.869309+0000","last_peered":"2024-04-25T10:00:35.869309+0000","last_clean":"2024-04-25T10:00:35.869309+0000","last_became_active":"2024-04-25T10:00:33.700024+0000","last_became_peered":"2024-04-25T10:00:33.700024+0000","last_unstale":"2024-04-25T10:00:35.869309+0000","last_undegraded":"2024-04-25T10:00:35.869309+0000","last_fullsized":"2024-04-25T10:00:35.869309+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:55.297097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.713345+0000","last_change":"2024-04-25T10:00:34.710180+0000","last_active":"2024-04-25T10:00:34.713345+0000","last_peered":"2024-04-25T10:00:34.713345+0000","last_clean":"2024-04-25T10:00:34.713345+0000","last_became_active":"2024-04-25T10:00:34.709806+0000","last_became_peered":"2024-04-25T10:00:34.709806+0000","last_unstale":"2024-04-25T10:00:34.713345+0000","last_undegraded":"2024-04-25T10:00:34.713345+0000","last_fullsized":"2024-04-25T10:00:34.713345+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:07.295413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.704273+0000","last_change":"2024-04-25T10:00:33.699647+0000","last_active":"2024-04-25T10:00:35.704273+0000","last_peered":"2024-04-25T10:00:35.704273+0000","last_clean":"2024-04-25T10:00:35.704273+0000","last_became_active":"2024-04-25T10:00:33.699370+0000","last_became_peered":"2024-04-25T10:00:33.699370+0000","last_unstale":"2024-04-25T10:00:35.704273+0000","last_undegraded":"2024-04-25T10:00:35.704273+0000","last_fullsized":"2024-04-25T10:00:35.704273+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:14.451247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.705040+0000","last_change":"2024-04-25T10:00:34.703408+0000","last_active":"2024-04-25T10:00:34.705040+0000","last_peered":"2024-04-25T10:00:34.705040+0000","last_clean":"2024-04-25T10:00:34.705040+0000","last_became_active":"2024-04-25T10:00:34.703039+0000","last_became_peered":"2024-04-25T10:00:34.703039+0000","last_unstale":"2024-04-25T10:00:34.705040+0000","last_undegraded":"2024-04-25T10:00:34.705040+0000","last_fullsized":"2024-04-25T10:00:34.705040+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:59.150420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"87'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.714730+0000","last_change":"2024-04-25T10:00:33.699984+0000","last_active":"2024-04-25T10:00:34.714730+0000","last_peered":"2024-04-25T10:00:34.714730+0000","last_clean":"2024-04-25T10:00:34.714730+0000","last_became_active":"2024-04-25T10:00:33.699605+0000","last_became_peered":"2024-04-25T10:00:33.699605+0000","last_unstale":"2024-04-25T10:00:34.714730+0000","last_undegraded":"2024-04-25T10:00:34.714730+0000","last_fullsized":"2024-04-25T10:00:34.714730+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:10:32.282942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.707561+0000","last_change":"2024-04-25T10:00:34.702183+0000","last_active":"2024-04-25T10:00:34.707561+0000","last_peered":"2024-04-25T10:00:34.707561+0000","last_clean":"2024-04-25T10:00:34.707561+0000","last_became_active":"2024-04-25T10:00:34.701900+0000","last_became_peered":"2024-04-25T10:00:34.701900+0000","last_unstale":"2024-04-25T10:00:34.707561+0000","last_undegraded":"2024-04-25T10:00:34.707561+0000","last_fullsized":"2024-04-25T10:00:34.707561+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:27.953906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.869294+0000","last_change":"2024-04-25T10:00:33.695107+0000","last_active":"2024-04-25T10:00:35.869294+0000","last_peered":"2024-04-25T10:00:35.869294+0000","last_clean":"2024-04-25T10:00:35.869294+0000","last_became_active":"2024-04-25T10:00:33.694819+0000","last_became_peered":"2024-04-25T10:00:33.694819+0000","last_unstale":"2024-04-25T10:00:35.869294+0000","last_undegraded":"2024-04-25T10:00:35.869294+0000","last_fullsized":"2024-04-25T10:00:35.869294+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:49.119719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.720414+0000","last_change":"2024-04-25T10:00:34.717865+0000","last_active":"2024-04-25T10:00:34.720414+0000","last_peered":"2024-04-25T10:00:34.720414+0000","last_clean":"2024-04-25T10:00:34.720414+0000","last_became_active":"2024-04-25T10:00:34.717420+0000","last_became_peered":"2024-04-25T10:00:34.717420+0000","last_unstale":"2024-04-25T10:00:34.720414+0000","last_undegraded":"2024-04-25T10:00:34.720414+0000","last_fullsized":"2024-04-25T10:00:34.720414+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:11.999074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.704232+0000","last_change":"2024-04-25T10:00:33.701828+0000","last_active":"2024-04-25T10:00:35.704232+0000","last_peered":"2024-04-25T10:00:35.704232+0000","last_clean":"2024-04-25T10:00:35.704232+0000","last_became_active":"2024-04-25T10:00:33.701537+0000","last_became_peered":"2024-04-25T10:00:33.701537+0000","last_unstale":"2024-04-25T10:00:35.704232+0000","last_undegraded":"2024-04-25T10:00:35.704232+0000","last_fullsized":"2024-04-25T10:00:35.704232+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:08:14.064083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.868975+0000","last_change":"2024-04-25T10:00:34.704591+0000","last_active":"2024-04-25T10:00:35.868975+0000","last_peered":"2024-04-25T10:00:35.868975+0000","last_clean":"2024-04-25T10:00:35.868975+0000","last_became_active":"2024-04-25T10:00:34.704106+0000","last_became_peered":"2024-04-25T10:00:34.704106+0000","last_unstale":"2024-04-25T10:00:35.868975+0000","last_undegraded":"2024-04-25T10:00:35.868975+0000","last_fullsized":"2024-04-25T10:00:35.868975+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:33.653996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"87'1","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.720621+0000","last_change":"2024-04-25T10:00:33.700400+0000","last_active":"2024-04-25T10:00:34.720621+0000","last_peered":"2024-04-25T10:00:34.720621+0000","last_clean":"2024-04-25T10:00:34.720621+0000","last_became_active":"2024-04-25T10:00:33.699563+0000","last_became_peered":"2024-04-25T10:00:33.699563+0000","last_unstale":"2024-04-25T10:00:34.720621+0000","last_undegraded":"2024-04-25T10:00:34.720621+0000","last_fullsized":"2024-04-25T10:00:34.720621+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:48.754794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.707489+0000","last_change":"2024-04-25T10:00:34.701679+0000","last_active":"2024-04-25T10:00:34.707489+0000","last_peered":"2024-04-25T10:00:34.707489+0000","last_clean":"2024-04-25T10:00:34.707489+0000","last_became_active":"2024-04-25T10:00:34.701390+0000","last_became_peered":"2024-04-25T10:00:34.701390+0000","last_unstale":"2024-04-25T10:00:34.707489+0000","last_undegraded":"2024-04-25T10:00:34.707489+0000","last_fullsized":"2024-04-25T10:00:34.707489+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:56.310636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.682583+0000","last_change":"2024-04-25T10:00:33.694964+0000","last_active":"2024-04-25T10:00:34.682583+0000","last_peered":"2024-04-25T10:00:34.682583+0000","last_clean":"2024-04-25T10:00:34.682583+0000","last_became_active":"2024-04-25T10:00:33.694666+0000","last_became_peered":"2024-04-25T10:00:33.694666+0000","last_unstale":"2024-04-25T10:00:34.682583+0000","last_undegraded":"2024-04-25T10:00:34.682583+0000","last_fullsized":"2024-04-25T10:00:34.682583+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:30.901702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.704424+0000","last_change":"2024-04-25T10:00:34.699684+0000","last_active":"2024-04-25T10:00:34.704424+0000","last_peered":"2024-04-25T10:00:34.704424+0000","last_clean":"2024-04-25T10:00:34.704424+0000","last_became_active":"2024-04-25T10:00:34.699420+0000","last_became_peered":"2024-04-25T10:00:34.699420+0000","last_unstale":"2024-04-25T10:00:34.704424+0000","last_undegraded":"2024-04-25T10:00:34.704424+0000","last_fullsized":"2024-04-25T10:00:34.704424+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:45.263981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.683686+0000","last_change":"2024-04-25T10:00:33.698203+0000","last_active":"2024-04-25T10:00:34.683686+0000","last_peered":"2024-04-25T10:00:34.683686+0000","last_clean":"2024-04-25T10:00:34.683686+0000","last_became_active":"2024-04-25T10:00:33.697876+0000","last_became_peered":"2024-04-25T10:00:33.697876+0000","last_unstale":"2024-04-25T10:00:34.683686+0000","last_undegraded":"2024-04-25T10:00:34.683686+0000","last_fullsized":"2024-04-25T10:00:34.683686+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:10.724557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.704129+0000","last_change":"2024-04-25T10:00:34.698157+0000","last_active":"2024-04-25T10:00:35.704129+0000","last_peered":"2024-04-25T10:00:35.704129+0000","last_clean":"2024-04-25T10:00:35.704129+0000","last_became_active":"2024-04-25T10:00:34.697850+0000","last_became_peered":"2024-04-25T10:00:34.697850+0000","last_unstale":"2024-04-25T10:00:35.704129+0000","last_undegraded":"2024-04-25T10:00:35.704129+0000","last_fullsized":"2024-04-25T10:00:35.704129+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:00.980613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.706792+0000","last_change":"2024-04-25T10:00:33.695775+0000","last_active":"2024-04-25T10:00:35.706792+0000","last_peered":"2024-04-25T10:00:35.706792+0000","last_clean":"2024-04-25T10:00:35.706792+0000","last_became_active":"2024-04-25T10:00:33.695454+0000","last_became_peered":"2024-04-25T10:00:33.695454+0000","last_unstale":"2024-04-25T10:00:35.706792+0000","last_undegraded":"2024-04-25T10:00:35.706792+0000","last_fullsized":"2024-04-25T10:00:35.706792+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:35.982797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.696655+0000","last_change":"2024-04-25T10:00:34.696111+0000","last_active":"2024-04-25T10:00:34.696655+0000","last_peered":"2024-04-25T10:00:34.696655+0000","last_clean":"2024-04-25T10:00:34.696655+0000","last_became_active":"2024-04-25T10:00:34.695837+0000","last_became_peered":"2024-04-25T10:00:34.695837+0000","last_unstale":"2024-04-25T10:00:34.696655+0000","last_undegraded":"2024-04-25T10:00:34.696655+0000","last_fullsized":"2024-04-25T10:00:34.696655+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:19.684811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.683226+0000","last_change":"2024-04-25T10:00:33.689604+0000","last_active":"2024-04-25T10:00:34.683226+0000","last_peered":"2024-04-25T10:00:34.683226+0000","last_clean":"2024-04-25T10:00:34.683226+0000","last_became_active":"2024-04-25T10:00:33.689287+0000","last_became_peered":"2024-04-25T10:00:33.689287+0000","last_unstale":"2024-04-25T10:00:34.683226+0000","last_undegraded":"2024-04-25T10:00:34.683226+0000","last_fullsized":"2024-04-25T10:00:34.683226+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:10:32.282942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.712263+0000","last_change":"2024-04-25T10:00:34.705880+0000","last_active":"2024-04-25T10:00:34.712263+0000","last_peered":"2024-04-25T10:00:34.712263+0000","last_clean":"2024-04-25T10:00:34.712263+0000","last_became_active":"2024-04-25T10:00:34.705575+0000","last_became_peered":"2024-04-25T10:00:34.705575+0000","last_unstale":"2024-04-25T10:00:34.712263+0000","last_undegraded":"2024-04-25T10:00:34.712263+0000","last_fullsized":"2024-04-25T10:00:34.712263+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:19.684811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"87'3","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.704476+0000","last_change":"2024-04-25T10:00:33.704000+0000","last_active":"2024-04-25T10:00:35.704476+0000","last_peered":"2024-04-25T10:00:35.704476+0000","last_clean":"2024-04-25T10:00:35.704476+0000","last_became_active":"2024-04-25T10:00:33.703359+0000","last_became_peered":"2024-04-25T10:00:33.703359+0000","last_unstale":"2024-04-25T10:00:35.704476+0000","last_undegraded":"2024-04-25T10:00:35.704476+0000","last_fullsized":"2024-04-25T10:00:35.704476+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:04.085303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.697399+0000","last_change":"2024-04-25T10:00:34.696172+0000","last_active":"2024-04-25T10:00:34.697399+0000","last_peered":"2024-04-25T10:00:34.697399+0000","last_clean":"2024-04-25T10:00:34.697399+0000","last_became_active":"2024-04-25T10:00:34.694685+0000","last_became_peered":"2024-04-25T10:00:34.694685+0000","last_unstale":"2024-04-25T10:00:34.697399+0000","last_undegraded":"2024-04-25T10:00:34.697399+0000","last_fullsized":"2024-04-25T10:00:34.697399+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:31:43.890286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"87'6","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.720721+0000","last_change":"2024-04-25T10:00:33.695810+0000","last_active":"2024-04-25T10:00:34.720721+0000","last_peered":"2024-04-25T10:00:34.720721+0000","last_clean":"2024-04-25T10:00:34.720721+0000","last_became_active":"2024-04-25T10:00:33.695521+0000","last_became_peered":"2024-04-25T10:00:33.695521+0000","last_unstale":"2024-04-25T10:00:34.720721+0000","last_undegraded":"2024-04-25T10:00:34.720721+0000","last_fullsized":"2024-04-25T10:00:34.720721+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:37.096195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.710815+0000","last_change":"2024-04-25T10:00:34.708908+0000","last_active":"2024-04-25T10:00:34.710815+0000","last_peered":"2024-04-25T10:00:34.710815+0000","last_clean":"2024-04-25T10:00:34.710815+0000","last_became_active":"2024-04-25T10:00:34.705668+0000","last_became_peered":"2024-04-25T10:00:34.705668+0000","last_unstale":"2024-04-25T10:00:34.710815+0000","last_undegraded":"2024-04-25T10:00:34.710815+0000","last_fullsized":"2024-04-25T10:00:34.710815+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:50.131148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"87'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.719645+0000","last_change":"2024-04-25T10:00:33.699290+0000","last_active":"2024-04-25T10:00:34.719645+0000","last_peered":"2024-04-25T10:00:34.719645+0000","last_clean":"2024-04-25T10:00:34.719645+0000","last_became_active":"2024-04-25T10:00:33.699005+0000","last_became_peered":"2024-04-25T10:00:33.699005+0000","last_unstale":"2024-04-25T10:00:34.719645+0000","last_undegraded":"2024-04-25T10:00:34.719645+0000","last_fullsized":"2024-04-25T10:00:34.719645+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:02.217807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.703759+0000","last_change":"2024-04-25T10:00:34.694978+0000","last_active":"2024-04-25T10:00:35.703759+0000","last_peered":"2024-04-25T10:00:35.703759+0000","last_clean":"2024-04-25T10:00:35.703759+0000","last_became_active":"2024-04-25T10:00:34.694707+0000","last_became_peered":"2024-04-25T10:00:34.694707+0000","last_unstale":"2024-04-25T10:00:35.703759+0000","last_undegraded":"2024-04-25T10:00:35.703759+0000","last_fullsized":"2024-04-25T10:00:35.703759+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:05.674231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.689404+0000","last_change":"2024-04-25T10:00:33.703607+0000","last_active":"2024-04-25T10:00:34.689404+0000","last_peered":"2024-04-25T10:00:34.689404+0000","last_clean":"2024-04-25T10:00:34.689404+0000","last_became_active":"2024-04-25T10:00:33.703274+0000","last_became_peered":"2024-04-25T10:00:33.703274+0000","last_unstale":"2024-04-25T10:00:34.689404+0000","last_undegraded":"2024-04-25T10:00:34.689404+0000","last_fullsized":"2024-04-25T10:00:34.689404+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:56.996863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.712719+0000","last_change":"2024-04-25T10:00:34.710945+0000","last_active":"2024-04-25T10:00:34.712719+0000","last_peered":"2024-04-25T10:00:34.712719+0000","last_clean":"2024-04-25T10:00:34.712719+0000","last_became_active":"2024-04-25T10:00:34.710647+0000","last_became_peered":"2024-04-25T10:00:34.710647+0000","last_unstale":"2024-04-25T10:00:34.712719+0000","last_undegraded":"2024-04-25T10:00:34.712719+0000","last_fullsized":"2024-04-25T10:00:34.712719+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:23.696794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.690193+0000","last_change":"2024-04-25T10:00:33.696209+0000","last_active":"2024-04-25T10:00:34.690193+0000","last_peered":"2024-04-25T10:00:34.690193+0000","last_clean":"2024-04-25T10:00:34.690193+0000","last_became_active":"2024-04-25T10:00:33.695862+0000","last_became_peered":"2024-04-25T10:00:33.695862+0000","last_unstale":"2024-04-25T10:00:34.690193+0000","last_undegraded":"2024-04-25T10:00:34.690193+0000","last_fullsized":"2024-04-25T10:00:34.690193+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:17.368377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.702711+0000","last_change":"2024-04-25T10:00:34.701981+0000","last_active":"2024-04-25T10:00:34.702711+0000","last_peered":"2024-04-25T10:00:34.702711+0000","last_clean":"2024-04-25T10:00:34.702711+0000","last_became_active":"2024-04-25T10:00:34.701705+0000","last_became_peered":"2024-04-25T10:00:34.701705+0000","last_unstale":"2024-04-25T10:00:34.702711+0000","last_undegraded":"2024-04-25T10:00:34.702711+0000","last_fullsized":"2024-04-25T10:00:34.702711+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:38.796511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"87'8","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.721597+0000","last_change":"2024-04-25T10:00:33.699541+0000","last_active":"2024-04-25T10:00:34.721597+0000","last_peered":"2024-04-25T10:00:34.721597+0000","last_clean":"2024-04-25T10:00:34.721597+0000","last_became_active":"2024-04-25T10:00:33.699231+0000","last_became_peered":"2024-04-25T10:00:33.699231+0000","last_unstale":"2024-04-25T10:00:34.721597+0000","last_undegraded":"2024-04-25T10:00:34.721597+0000","last_fullsized":"2024-04-25T10:00:34.721597+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:31.522672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.706948+0000","last_change":"2024-04-25T10:00:34.700455+0000","last_active":"2024-04-25T10:00:34.706948+0000","last_peered":"2024-04-25T10:00:34.706948+0000","last_clean":"2024-04-25T10:00:34.706948+0000","last_became_active":"2024-04-25T10:00:34.699819+0000","last_became_peered":"2024-04-25T10:00:34.699819+0000","last_unstale":"2024-04-25T10:00:34.706948+0000","last_undegraded":"2024-04-25T10:00:34.706948+0000","last_fullsized":"2024-04-25T10:00:34.706948+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:29.005616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.869372+0000","last_change":"2024-04-25T10:00:33.697547+0000","last_active":"2024-04-25T10:00:35.869372+0000","last_peered":"2024-04-25T10:00:35.869372+0000","last_clean":"2024-04-25T10:00:35.869372+0000","last_became_active":"2024-04-25T10:00:33.697282+0000","last_became_peered":"2024-04-25T10:00:33.697282+0000","last_unstale":"2024-04-25T10:00:35.869372+0000","last_undegraded":"2024-04-25T10:00:35.869372+0000","last_fullsized":"2024-04-25T10:00:35.869372+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:21:02.870613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.869223+0000","last_change":"2024-04-25T10:00:34.692487+0000","last_active":"2024-04-25T10:00:35.869223+0000","last_peered":"2024-04-25T10:00:35.869223+0000","last_clean":"2024-04-25T10:00:35.869223+0000","last_became_active":"2024-04-25T10:00:34.692184+0000","last_became_peered":"2024-04-25T10:00:34.692184+0000","last_unstale":"2024-04-25T10:00:35.869223+0000","last_undegraded":"2024-04-25T10:00:35.869223+0000","last_fullsized":"2024-04-25T10:00:35.869223+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:00.980613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"87'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.715268+0000","last_change":"2024-04-25T10:00:33.699569+0000","last_active":"2024-04-25T10:00:34.715268+0000","last_peered":"2024-04-25T10:00:34.715268+0000","last_clean":"2024-04-25T10:00:34.715268+0000","last_became_active":"2024-04-25T10:00:33.698528+0000","last_became_peered":"2024-04-25T10:00:33.698528+0000","last_unstale":"2024-04-25T10:00:34.715268+0000","last_undegraded":"2024-04-25T10:00:34.715268+0000","last_fullsized":"2024-04-25T10:00:34.715268+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:30:37.164312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.704167+0000","last_change":"2024-04-25T10:00:34.703058+0000","last_active":"2024-04-25T10:00:35.704167+0000","last_peered":"2024-04-25T10:00:35.704167+0000","last_clean":"2024-04-25T10:00:35.704167+0000","last_became_active":"2024-04-25T10:00:34.702598+0000","last_became_peered":"2024-04-25T10:00:34.702598+0000","last_unstale":"2024-04-25T10:00:35.704167+0000","last_undegraded":"2024-04-25T10:00:35.704167+0000","last_fullsized":"2024-04-25T10:00:35.704167+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:27.817975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.704504+0000","last_change":"2024-04-25T10:00:33.704158+0000","last_active":"2024-04-25T10:00:35.704504+0000","last_peered":"2024-04-25T10:00:35.704504+0000","last_clean":"2024-04-25T10:00:35.704504+0000","last_became_active":"2024-04-25T10:00:33.703829+0000","last_became_peered":"2024-04-25T10:00:33.703829+0000","last_unstale":"2024-04-25T10:00:35.704504+0000","last_undegraded":"2024-04-25T10:00:35.704504+0000","last_fullsized":"2024-04-25T10:00:35.704504+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:17.368377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.707450+0000","last_change":"2024-04-25T10:00:34.701001+0000","last_active":"2024-04-25T10:00:34.707450+0000","last_peered":"2024-04-25T10:00:34.707450+0000","last_clean":"2024-04-25T10:00:34.707450+0000","last_became_active":"2024-04-25T10:00:34.700695+0000","last_became_peered":"2024-04-25T10:00:34.700695+0000","last_unstale":"2024-04-25T10:00:34.707450+0000","last_undegraded":"2024-04-25T10:00:34.707450+0000","last_fullsized":"2024-04-25T10:00:34.707450+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:27:32.070038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.706556+0000","last_change":"2024-04-25T10:00:33.696464+0000","last_active":"2024-04-25T10:00:35.706556+0000","last_peered":"2024-04-25T10:00:35.706556+0000","last_clean":"2024-04-25T10:00:35.706556+0000","last_became_active":"2024-04-25T10:00:33.696138+0000","last_became_peered":"2024-04-25T10:00:33.696138+0000","last_unstale":"2024-04-25T10:00:35.706556+0000","last_undegraded":"2024-04-25T10:00:35.706556+0000","last_fullsized":"2024-04-25T10:00:35.706556+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:28.856482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.706417+0000","last_change":"2024-04-25T10:00:34.700342+0000","last_active":"2024-04-25T10:00:35.706417+0000","last_peered":"2024-04-25T10:00:35.706417+0000","last_clean":"2024-04-25T10:00:35.706417+0000","last_became_active":"2024-04-25T10:00:34.699919+0000","last_became_peered":"2024-04-25T10:00:34.699919+0000","last_unstale":"2024-04-25T10:00:35.706417+0000","last_undegraded":"2024-04-25T10:00:35.706417+0000","last_fullsized":"2024-04-25T10:00:35.706417+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:11.735986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.692263+0000","last_change":"2024-04-25T10:00:33.701060+0000","last_active":"2024-04-25T10:00:34.692263+0000","last_peered":"2024-04-25T10:00:34.692263+0000","last_clean":"2024-04-25T10:00:34.692263+0000","last_became_active":"2024-04-25T10:00:33.700447+0000","last_became_peered":"2024-04-25T10:00:33.700447+0000","last_unstale":"2024-04-25T10:00:34.692263+0000","last_undegraded":"2024-04-25T10:00:34.692263+0000","last_fullsized":"2024-04-25T10:00:34.692263+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:06.029051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.706499+0000","last_change":"2024-04-25T10:00:34.706727+0000","last_active":"2024-04-25T10:00:35.706499+0000","last_peered":"2024-04-25T10:00:35.706499+0000","last_clean":"2024-04-25T10:00:35.706499+0000","last_became_active":"2024-04-25T10:00:34.706431+0000","last_became_peered":"2024-04-25T10:00:34.706431+0000","last_unstale":"2024-04-25T10:00:35.706499+0000","last_undegraded":"2024-04-25T10:00:35.706499+0000","last_fullsized":"2024-04-25T10:00:35.706499+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:03.229236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.706459+0000","last_change":"2024-04-25T10:00:33.697946+0000","last_active":"2024-04-25T10:00:35.706459+0000","last_peered":"2024-04-25T10:00:35.706459+0000","last_clean":"2024-04-25T10:00:35.706459+0000","last_became_active":"2024-04-25T10:00:33.697660+0000","last_became_peered":"2024-04-25T10:00:33.697660+0000","last_unstale":"2024-04-25T10:00:35.706459+0000","last_undegraded":"2024-04-25T10:00:35.706459+0000","last_fullsized":"2024-04-25T10:00:35.706459+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:54.195695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.716166+0000","last_change":"2024-04-25T10:00:34.712588+0000","last_active":"2024-04-25T10:00:34.716166+0000","last_peered":"2024-04-25T10:00:34.716166+0000","last_clean":"2024-04-25T10:00:34.716166+0000","last_became_active":"2024-04-25T10:00:34.711418+0000","last_became_peered":"2024-04-25T10:00:34.711418+0000","last_unstale":"2024-04-25T10:00:34.716166+0000","last_undegraded":"2024-04-25T10:00:34.716166+0000","last_fullsized":"2024-04-25T10:00:34.716166+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:52.804110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.694547+0000","last_change":"2024-04-25T10:00:33.695497+0000","last_active":"2024-04-25T10:00:34.694547+0000","last_peered":"2024-04-25T10:00:34.694547+0000","last_clean":"2024-04-25T10:00:34.694547+0000","last_became_active":"2024-04-25T10:00:33.695186+0000","last_became_peered":"2024-04-25T10:00:33.695186+0000","last_unstale":"2024-04-25T10:00:34.694547+0000","last_undegraded":"2024-04-25T10:00:34.694547+0000","last_fullsized":"2024-04-25T10:00:34.694547+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:52.824906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.869014+0000","last_change":"2024-04-25T10:00:34.691035+0000","last_active":"2024-04-25T10:00:35.869014+0000","last_peered":"2024-04-25T10:00:35.869014+0000","last_clean":"2024-04-25T10:00:35.869014+0000","last_became_active":"2024-04-25T10:00:34.690745+0000","last_became_peered":"2024-04-25T10:00:34.690745+0000","last_unstale":"2024-04-25T10:00:35.869014+0000","last_undegraded":"2024-04-25T10:00:35.869014+0000","last_fullsized":"2024-04-25T10:00:35.869014+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:40.908385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"87'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.714975+0000","last_change":"2024-04-25T10:00:33.701838+0000","last_active":"2024-04-25T10:00:34.714975+0000","last_peered":"2024-04-25T10:00:34.714975+0000","last_clean":"2024-04-25T10:00:34.714975+0000","last_became_active":"2024-04-25T10:00:33.701358+0000","last_became_peered":"2024-04-25T10:00:33.701358+0000","last_unstale":"2024-04-25T10:00:34.714975+0000","last_undegraded":"2024-04-25T10:00:34.714975+0000","last_fullsized":"2024-04-25T10:00:34.714975+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:30.901702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.707505+0000","last_change":"2024-04-25T10:00:34.701211+0000","last_active":"2024-04-25T10:00:34.707505+0000","last_peered":"2024-04-25T10:00:34.707505+0000","last_clean":"2024-04-25T10:00:34.707505+0000","last_became_active":"2024-04-25T10:00:34.700797+0000","last_became_peered":"2024-04-25T10:00:34.700797+0000","last_unstale":"2024-04-25T10:00:34.707505+0000","last_undegraded":"2024-04-25T10:00:34.707505+0000","last_fullsized":"2024-04-25T10:00:34.707505+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:26.212420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"88'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.705662+0000","last_change":"2024-04-25T10:00:33.700497+0000","last_active":"2024-04-25T10:00:35.705662+0000","last_peered":"2024-04-25T10:00:35.705662+0000","last_clean":"2024-04-25T10:00:35.705662+0000","last_became_active":"2024-04-25T10:00:33.700215+0000","last_became_peered":"2024-04-25T10:00:33.700215+0000","last_unstale":"2024-04-25T10:00:35.705662+0000","last_undegraded":"2024-04-25T10:00:35.705662+0000","last_fullsized":"2024-04-25T10:00:35.705662+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:42:34.900813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.706292+0000","last_change":"2024-04-25T10:00:34.700422+0000","last_active":"2024-04-25T10:00:34.706292+0000","last_peered":"2024-04-25T10:00:34.706292+0000","last_clean":"2024-04-25T10:00:34.706292+0000","last_became_active":"2024-04-25T10:00:34.699997+0000","last_became_peered":"2024-04-25T10:00:34.699997+0000","last_unstale":"2024-04-25T10:00:34.706292+0000","last_undegraded":"2024-04-25T10:00:34.706292+0000","last_fullsized":"2024-04-25T10:00:34.706292+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:24.837206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.704543+0000","last_change":"2024-04-25T10:00:33.702808+0000","last_active":"2024-04-25T10:00:35.704543+0000","last_peered":"2024-04-25T10:00:35.704543+0000","last_clean":"2024-04-25T10:00:35.704543+0000","last_became_active":"2024-04-25T10:00:33.702533+0000","last_became_peered":"2024-04-25T10:00:33.702533+0000","last_unstale":"2024-04-25T10:00:35.704543+0000","last_undegraded":"2024-04-25T10:00:35.704543+0000","last_fullsized":"2024-04-25T10:00:35.704543+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:48.754794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.706751+0000","last_change":"2024-04-25T10:00:34.698875+0000","last_active":"2024-04-25T10:00:35.706751+0000","last_peered":"2024-04-25T10:00:35.706751+0000","last_clean":"2024-04-25T10:00:35.706751+0000","last_became_active":"2024-04-25T10:00:34.698538+0000","last_became_peered":"2024-04-25T10:00:34.698538+0000","last_unstale":"2024-04-25T10:00:35.706751+0000","last_undegraded":"2024-04-25T10:00:35.706751+0000","last_fullsized":"2024-04-25T10:00:35.706751+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:19.684811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.869221+0000","last_change":"2024-04-25T10:00:33.699468+0000","last_active":"2024-04-25T10:00:35.869221+0000","last_peered":"2024-04-25T10:00:35.869221+0000","last_clean":"2024-04-25T10:00:35.869221+0000","last_became_active":"2024-04-25T10:00:33.699196+0000","last_became_peered":"2024-04-25T10:00:33.699196+0000","last_unstale":"2024-04-25T10:00:35.869221+0000","last_undegraded":"2024-04-25T10:00:35.869221+0000","last_fullsized":"2024-04-25T10:00:35.869221+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:05.572101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.712671+0000","last_change":"2024-04-25T10:00:34.710372+0000","last_active":"2024-04-25T10:00:34.712671+0000","last_peered":"2024-04-25T10:00:34.712671+0000","last_clean":"2024-04-25T10:00:34.712671+0000","last_became_active":"2024-04-25T10:00:34.710077+0000","last_became_peered":"2024-04-25T10:00:34.710077+0000","last_unstale":"2024-04-25T10:00:34.712671+0000","last_undegraded":"2024-04-25T10:00:34.712671+0000","last_fullsized":"2024-04-25T10:00:34.712671+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:43.881755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.692578+0000","last_change":"2024-04-25T10:00:33.703938+0000","last_active":"2024-04-25T10:00:34.692578+0000","last_peered":"2024-04-25T10:00:34.692578+0000","last_clean":"2024-04-25T10:00:34.692578+0000","last_became_active":"2024-04-25T10:00:33.703296+0000","last_became_peered":"2024-04-25T10:00:33.703296+0000","last_unstale":"2024-04-25T10:00:34.692578+0000","last_undegraded":"2024-04-25T10:00:34.692578+0000","last_fullsized":"2024-04-25T10:00:34.692578+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:30.137629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.713673+0000","last_change":"2024-04-25T10:00:34.709661+0000","last_active":"2024-04-25T10:00:34.713673+0000","last_peered":"2024-04-25T10:00:34.713673+0000","last_clean":"2024-04-25T10:00:34.713673+0000","last_became_active":"2024-04-25T10:00:34.709330+0000","last_became_peered":"2024-04-25T10:00:34.709330+0000","last_unstale":"2024-04-25T10:00:34.713673+0000","last_undegraded":"2024-04-25T10:00:34.713673+0000","last_fullsized":"2024-04-25T10:00:34.713673+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:28.835260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.706510+0000","last_change":"2024-04-25T10:00:33.697208+0000","last_active":"2024-04-25T10:00:35.706510+0000","last_peered":"2024-04-25T10:00:35.706510+0000","last_clean":"2024-04-25T10:00:35.706510+0000","last_became_active":"2024-04-25T10:00:33.696914+0000","last_became_peered":"2024-04-25T10:00:33.696914+0000","last_unstale":"2024-04-25T10:00:35.706510+0000","last_undegraded":"2024-04-25T10:00:35.706510+0000","last_fullsized":"2024-04-25T10:00:35.706510+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:24:18.837013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.868988+0000","last_change":"2024-04-25T10:00:34.701114+0000","last_active":"2024-04-25T10:00:35.868988+0000","last_peered":"2024-04-25T10:00:35.868988+0000","last_clean":"2024-04-25T10:00:35.868988+0000","last_became_active":"2024-04-25T10:00:34.700795+0000","last_became_peered":"2024-04-25T10:00:34.700795+0000","last_unstale":"2024-04-25T10:00:35.868988+0000","last_undegraded":"2024-04-25T10:00:35.868988+0000","last_fullsized":"2024-04-25T10:00:35.868988+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:03.262312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T10:00:35.869108+0000","last_change":"2024-04-25T10:00:33.695464+0000","last_active":"2024-04-25T10:00:35.869108+0000","last_peered":"2024-04-25T10:00:35.869108+0000","last_clean":"2024-04-25T10:00:35.869108+0000","last_became_active":"2024-04-25T10:00:33.695055+0000","last_became_peered":"2024-04-25T10:00:33.695055+0000","last_unstale":"2024-04-25T10:00:35.869108+0000","last_undegraded":"2024-04-25T10:00:35.869108+0000","last_fullsized":"2024-04-25T10:00:35.869108+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:03.980250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.707612+0000","last_change":"2024-04-25T10:00:34.703076+0000","last_active":"2024-04-25T10:00:34.707612+0000","last_peered":"2024-04-25T10:00:34.707612+0000","last_clean":"2024-04-25T10:00:34.707612+0000","last_became_active":"2024-04-25T10:00:34.702795+0000","last_became_peered":"2024-04-25T10:00:34.702795+0000","last_unstale":"2024-04-25T10:00:34.707612+0000","last_undegraded":"2024-04-25T10:00:34.707612+0000","last_fullsized":"2024-04-25T10:00:34.707612+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:49.485457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.683557+0000","last_change":"2024-04-25T10:00:33.700907+0000","last_active":"2024-04-25T10:00:34.683557+0000","last_peered":"2024-04-25T10:00:34.683557+0000","last_clean":"2024-04-25T10:00:34.683557+0000","last_became_active":"2024-04-25T10:00:33.700570+0000","last_became_peered":"2024-04-25T10:00:33.700570+0000","last_unstale":"2024-04-25T10:00:34.683557+0000","last_undegraded":"2024-04-25T10:00:34.683557+0000","last_fullsized":"2024-04-25T10:00:34.683557+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:59.136168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.688634+0000","last_change":"2024-04-25T10:00:34.686884+0000","last_active":"2024-04-25T10:00:34.688634+0000","last_peered":"2024-04-25T10:00:34.688634+0000","last_clean":"2024-04-25T10:00:34.688634+0000","last_became_active":"2024-04-25T10:00:34.686510+0000","last_became_peered":"2024-04-25T10:00:34.686510+0000","last_unstale":"2024-04-25T10:00:34.688634+0000","last_undegraded":"2024-04-25T10:00:34.688634+0000","last_fullsized":"2024-04-25T10:00:34.688634+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:33.675573+0000","last_clean_scrub_stamp":"2024-04-25T10:00:33.675573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:41.942475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.690086+0000","last_change":"2024-04-25T10:00:33.690904+0000","last_active":"2024-04-25T10:00:34.690086+0000","last_peered":"2024-04-25T10:00:34.690086+0000","last_clean":"2024-04-25T10:00:34.690086+0000","last_became_active":"2024-04-25T10:00:33.690591+0000","last_became_peered":"2024-04-25T10:00:33.690591+0000","last_unstale":"2024-04-25T10:00:34.690086+0000","last_undegraded":"2024-04-25T10:00:34.690086+0000","last_fullsized":"2024-04-25T10:00:34.690086+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:00:32.664144+0000","last_clean_scrub_stamp":"2024-04-25T10:00:32.664144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:04.085303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":293,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T10:00:34.683633+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T10:00:34.683633+0000","last_peered":"2024-04-25T10:00:34.683633+0000","last_clean":"2024-04-25T10:00:34.683633+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T10:00:34.683633+0000","last_undegraded":"2024-04-25T10:00:34.683633+0000","last_fullsized":"2024-04-25T10:00:34.683633+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542223,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32824,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339016,"statfs":{"total":96636764160,"available":96603152384,"internally_reserved":0,"allocated":1671168,"data_stored":1079147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542223,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1089536,"data_stored":490939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542225,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1069056,"data_stored":488723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542222,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32244,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1077248,"data_stored":488883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1056768,"data_stored":481556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1056768,"data_stored":481556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1073152,"data_stored":488793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32800,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339040,"statfs":{"total":96636764160,"available":96603176960,"internally_reserved":0,"allocated":1650688,"data_stored":1071924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:00:38.045 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T10:00:38.046 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T10:00:38.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.185+0000 7fa4dace1640 1 Processor -- start 2024-04-25T10:00:38.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.185+0000 7fa4dace1640 1 -- start start 2024-04-25T10:00:38.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.186+0000 7fa4dace1640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa4d40d0a50 0x7fa4d40d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:38.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.186+0000 7fa4dace1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa4d40b53b0 0x7fa4d40d2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:38.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.186+0000 7fa4dace1640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d40d1e80 con 0x7fa4d415db00 2024-04-25T10:00:38.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.186+0000 7fa4dace1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d40b5930 con 0x7fa4d40b53b0 2024-04-25T10:00:38.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.186+0000 7fa4dace1640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d40b5c10 con 0x7fa4d40d0a50 2024-04-25T10:00:38.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.186+0000 7fa4d8a7d640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa4d415db00 0x7fa4d40d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40626/0 (socket says 172.21.15.7:40626) 2024-04-25T10:00:38.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.186+0000 7fa4d8a7d640 1 -- 172.21.15.7:0/799745259 learned_addr learned my addr 172.21.15.7:0/799745259 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:38.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.186+0000 7fa4d37fe640 1 -- 172.21.15.7:0/799745259 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2949281448 0 0) 0x7fa4d40d1e80 con 0x7fa4d415db00 2024-04-25T10:00:38.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.187+0000 7fa4d37fe640 1 -- 172.21.15.7:0/799745259 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4bc003520 con 0x7fa4d415db00 2024-04-25T10:00:38.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.187+0000 7fa4d927e640 1 --2- 172.21.15.7:0/799745259 >> v2:172.21.15.55:3300/0 conn(0x7fa4d40b53b0 0x7fa4d40d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:38.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.187+0000 7fa4d3fff640 1 --2- 172.21.15.7:0/799745259 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa4d40d0a50 0x7fa4d40d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:38.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.187+0000 7fa4d37fe640 1 -- 172.21.15.7:0/799745259 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2299790153 0 0) 0x7fa4bc003520 con 0x7fa4d415db00 2024-04-25T10:00:38.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.187+0000 7fa4d37fe640 1 -- 172.21.15.7:0/799745259 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa4d40d0a50 msgr2=0x7fa4d40d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:38.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.187+0000 7fa4d37fe640 1 --2- 172.21.15.7:0/799745259 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa4d40d0a50 0x7fa4d40d2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:38.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.187+0000 7fa4d37fe640 1 -- 172.21.15.7:0/799745259 >> v2:172.21.15.55:3300/0 conn(0x7fa4d40b53b0 msgr2=0x7fa4d40d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:38.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.187+0000 7fa4d37fe640 1 --2- 172.21.15.7:0/799745259 >> v2:172.21.15.55:3300/0 conn(0x7fa4d40b53b0 0x7fa4d40d2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:38.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.187+0000 7fa4d37fe640 1 -- 172.21.15.7:0/799745259 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d40b5ef0 con 0x7fa4d415db00 2024-04-25T10:00:38.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.187+0000 7fa4d37fe640 1 -- 172.21.15.7:0/799745259 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fa4cc0019f0 con 0x7fa4d415db00 2024-04-25T10:00:38.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.187+0000 7fa4d37fe640 1 -- 172.21.15.7:0/799745259 >> v1:172.21.15.7:6789/0 conn(0x7fa4d415db00 legacy=0x7fa4d40d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:38.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.187+0000 7fa4d37fe640 1 --2- 172.21.15.7:0/799745259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4bc0039b0 0x7fa4bc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:38.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.187+0000 7fa4d37fe640 1 --2- 172.21.15.7:0/799745259 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa4d40d0a50 0x7fa4bc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:38.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.187+0000 7fa4d37fe640 1 --2- 172.21.15.7:0/799745259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4bc004d40 0x7fa4bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:38.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.187+0000 7fa4d37fe640 1 -- 172.21.15.7:0/799745259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d40b5930 con 0x7fa4bc004d40 2024-04-25T10:00:38.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.187+0000 7fa4d37fe640 1 -- 172.21.15.7:0/799745259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d40b5c10 con 0x7fa4bc0039b0 2024-04-25T10:00:38.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.187+0000 7fa4d37fe640 1 -- 172.21.15.7:0/799745259 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc00b9c0 con 0x7fa4d40d0a50 2024-04-25T10:00:38.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.187+0000 7fa4d927e640 1 --2- 172.21.15.7:0/799745259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4bc004d40 0x7fa4bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:38.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.187+0000 7fa4d8a7d640 1 --2- 172.21.15.7:0/799745259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4bc0039b0 0x7fa4bc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:38.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.187+0000 7fa4d3fff640 1 --2- 172.21.15.7:0/799745259 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa4d40d0a50 0x7fa4bc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:38.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.187+0000 7fa4d927e640 1 -- 172.21.15.7:0/799745259 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa4d40d0a50 msgr2=0x7fa4bc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:38.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.187+0000 7fa4d927e640 1 --2- 172.21.15.7:0/799745259 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa4d40d0a50 0x7fa4bc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:38.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.187+0000 7fa4d927e640 1 -- 172.21.15.7:0/799745259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4bc0039b0 msgr2=0x7fa4bc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:38.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.187+0000 7fa4d927e640 1 --2- 172.21.15.7:0/799745259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4bc0039b0 0x7fa4bc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:38.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.187+0000 7fa4d927e640 1 -- 172.21.15.7:0/799745259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc003520 con 0x7fa4bc004d40 2024-04-25T10:00:38.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.187+0000 7fa4d3fff640 1 --2- 172.21.15.7:0/799745259 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa4d40d0a50 0x7fa4bc004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:38.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.188+0000 7fa4d927e640 1 --2- 172.21.15.7:0/799745259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4bc004d40 0x7fa4bc0051c0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009a90 tx=0x7fa4bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f48762b5f6b2f49 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:38.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.188+0000 7fa4d37fe640 1 -- 172.21.15.7:0/799745259 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4036070 con 0x7fa4bc004d40 2024-04-25T10:00:38.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.188+0000 7fa4d37fe640 1 -- 172.21.15.7:0/799745259 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c4031400 con 0x7fa4bc004d40 2024-04-25T10:00:38.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.188+0000 7fa4d37fe640 1 -- 172.21.15.7:0/799745259 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4009690 con 0x7fa4bc004d40 2024-04-25T10:00:38.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.189+0000 7fa4dace1640 1 -- 172.21.15.7:0/799745259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4bc004d40 msgr2=0x7fa4bc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:38.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.189+0000 7fa4dace1640 1 --2- 172.21.15.7:0/799745259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4bc004d40 0x7fa4bc0051c0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009a90 tx=0x7fa4bc005830 comp rx=0 tx=0).stop 2024-04-25T10:00:38.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.189+0000 7fa4d927e640 1 -- 172.21.15.7:0/799745259 reap_dead start 2024-04-25T10:00:38.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.189+0000 7fa4dace1640 1 -- 172.21.15.7:0/799745259 shutdown_connections 2024-04-25T10:00:38.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.189+0000 7fa4dace1640 1 -- 172.21.15.7:0/799745259 >> 172.21.15.7:0/799745259 conn(0x7fa4d4072290 msgr2=0x7fa4d40726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:38.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.189+0000 7fa4dace1640 1 -- 172.21.15.7:0/799745259 shutdown_connections 2024-04-25T10:00:38.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.189+0000 7fa4dace1640 1 -- 172.21.15.7:0/799745259 wait complete. 2024-04-25T10:00:38.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.190+0000 7fa4dace1640 1 Processor -- start 2024-04-25T10:00:38.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.190+0000 7fa4dace1640 1 -- start start 2024-04-25T10:00:38.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.191+0000 7fa4dace1640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa4bc004d40 0x7fa4d4141380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:38.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.191+0000 7fa4dace1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4d414e520 0x7fa4d40cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:38.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.191+0000 7fa4dace1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4d40b6c10 0x7fa4d40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:38.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.191+0000 7fa4dace1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d40d3660 con 0x7fa4d414e520 2024-04-25T10:00:38.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.191+0000 7fa4dace1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d40b61d0 con 0x7fa4d40b6c10 2024-04-25T10:00:38.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.191+0000 7fa4dace1640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d40ce2b0 con 0x7fa4bc004d40 2024-04-25T10:00:38.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.191+0000 7fa4d3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4d414e520 0x7fa4d40cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:38.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.191+0000 7fa4d3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4d414e520 0x7fa4d40cd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51264/0 (socket says 172.21.15.7:51264) 2024-04-25T10:00:38.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.191+0000 7fa4d3fff640 1 -- 172.21.15.7:0/2744003311 learned_addr learned my addr 172.21.15.7:0/2744003311 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:38.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.191+0000 7fa4d927e640 1 --2- 172.21.15.7:0/2744003311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4d40b6c10 0x7fa4d40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:38.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.191+0000 7fa4d8a7d640 1 --2- 172.21.15.7:0/2744003311 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa4bc004d40 0x7fa4d4141380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:38.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.191+0000 7fa4d3fff640 1 -- 172.21.15.7:0/2744003311 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa4bc004d40 msgr2=0x7fa4d4141380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:38.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.191+0000 7fa4d3fff640 1 --2- 172.21.15.7:0/2744003311 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa4bc004d40 0x7fa4d4141380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:38.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.191+0000 7fa4d3fff640 1 -- 172.21.15.7:0/2744003311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4d40b6c10 msgr2=0x7fa4d40b7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:38.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.191+0000 7fa4d3fff640 1 --2- 172.21.15.7:0/2744003311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4d40b6c10 0x7fa4d40b7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:38.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.191+0000 7fa4d3fff640 1 -- 172.21.15.7:0/2744003311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d40cd930 con 0x7fa4d414e520 2024-04-25T10:00:38.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.191+0000 7fa4d927e640 1 --2- 172.21.15.7:0/2744003311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4d40b6c10 0x7fa4d40b7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:00:38.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.192+0000 7fa4d3fff640 1 --2- 172.21.15.7:0/2744003311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4d414e520 0x7fa4d40cd3f0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8011700 tx=0x7fa4c8011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:38.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.192+0000 7fa4d17fa640 1 -- 172.21.15.7:0/2744003311 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c800f960 con 0x7fa4d414e520 2024-04-25T10:00:38.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.192+0000 7fa4d17fa640 1 -- 172.21.15.7:0/2744003311 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c800fb00 con 0x7fa4d414e520 2024-04-25T10:00:38.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.192+0000 7fa4d17fa640 1 -- 172.21.15.7:0/2744003311 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8015460 con 0x7fa4d414e520 2024-04-25T10:00:38.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.192+0000 7fa4dace1640 1 -- 172.21.15.7:0/2744003311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d41f6ab0 con 0x7fa4d414e520 2024-04-25T10:00:38.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.192+0000 7fa4dace1640 1 -- 172.21.15.7:0/2744003311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d41f7070 con 0x7fa4d414e520 2024-04-25T10:00:38.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.193+0000 7fa4dace1640 1 -- 172.21.15.7:0/2744003311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d4068fd0 con 0x7fa4d414e520 2024-04-25T10:00:38.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.193+0000 7fa4d17fa640 1 -- 172.21.15.7:0/2744003311 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa4c8015600 con 0x7fa4d414e520 2024-04-25T10:00:38.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.194+0000 7fa4d17fa640 1 --2- 172.21.15.7:0/2744003311 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa4c006b4d0 0x7fa4c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:38.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.194+0000 7fa4d17fa640 1 -- 172.21.15.7:0/2744003311 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa4c808ac80 con 0x7fa4d414e520 2024-04-25T10:00:38.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.194+0000 7fa4d8a7d640 1 --2- 172.21.15.7:0/2744003311 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa4c006b4d0 0x7fa4c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:38.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.194+0000 7fa4d8a7d640 1 --2- 172.21.15.7:0/2744003311 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa4c006b4d0 0x7fa4c006d990 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc004c20 tx=0x7fa4cc006040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:38.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.198+0000 7fa4d17fa640 1 -- 172.21.15.7:0/2744003311 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa4c8019030 con 0x7fa4d414e520 2024-04-25T10:00:38.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.444+0000 7fa4dace1640 1 -- 172.21.15.7:0/2744003311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa4d40d16b0 con 0x7fa4d414e520 2024-04-25T10:00:38.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.447+0000 7fa4d17fa640 1 -- 172.21.15.7:0/2744003311 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7fa4c8059980 con 0x7fa4d414e520 2024-04-25T10:00:38.451 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2024-04-25T10:00:38.451 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAYKCpmaJKeORAALxC5ZqLLEu0zJFG+SOGukQ== 2024-04-25T10:00:38.451 INFO:teuthology.orchestra.run.smithi007.stdout: caps mds = "allow" 2024-04-25T10:00:38.452 INFO:teuthology.orchestra.run.smithi007.stdout: caps mon = "allow r" 2024-04-25T10:00:38.452 INFO:teuthology.orchestra.run.smithi007.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T10:00:38.452 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2024-04-25T10:00:38.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.449+0000 7fa4dace1640 1 -- 172.21.15.7:0/2744003311 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa4c006b4d0 msgr2=0x7fa4c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:38.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.449+0000 7fa4dace1640 1 --2- 172.21.15.7:0/2744003311 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa4c006b4d0 0x7fa4c006d990 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc004c20 tx=0x7fa4cc006040 comp rx=0 tx=0).stop 2024-04-25T10:00:38.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.449+0000 7fa4dace1640 1 -- 172.21.15.7:0/2744003311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4d414e520 msgr2=0x7fa4d40cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:38.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.449+0000 7fa4dace1640 1 --2- 172.21.15.7:0/2744003311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4d414e520 0x7fa4d40cd3f0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8011700 tx=0x7fa4c8011bc0 comp rx=0 tx=0).stop 2024-04-25T10:00:38.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.450+0000 7fa4dace1640 1 -- 172.21.15.7:0/2744003311 shutdown_connections 2024-04-25T10:00:38.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.450+0000 7fa4dace1640 1 --2- 172.21.15.7:0/2744003311 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa4c006b4d0 0x7fa4c006d990 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:38.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.450+0000 7fa4dace1640 1 --2- 172.21.15.7:0/2744003311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4d40b6c10 0x7fa4d40b7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:38.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.450+0000 7fa4dace1640 1 --2- 172.21.15.7:0/2744003311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4d414e520 0x7fa4d40cd3f0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:38.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.450+0000 7fa4dace1640 1 --2- 172.21.15.7:0/2744003311 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa4bc004d40 0x7fa4d4141380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:38.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.450+0000 7fa4dace1640 1 -- 172.21.15.7:0/2744003311 >> 172.21.15.7:0/2744003311 conn(0x7fa4d4072290 msgr2=0x7fa4d40cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:38.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.450+0000 7fa4dace1640 1 -- 172.21.15.7:0/2744003311 shutdown_connections 2024-04-25T10:00:38.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.450+0000 7fa4dace1640 1 -- 172.21.15.7:0/2744003311 wait complete. 2024-04-25T10:00:38.465 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:00:38.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.561+0000 7f7a15ebc640 1 Processor -- start 2024-04-25T10:00:38.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.561+0000 7f7a15ebc640 1 -- start start 2024-04-25T10:00:38.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.562+0000 7f7a15ebc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7a1015b8e0 0x7f7a100d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:38.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.562+0000 7f7a15ebc640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7a100cc300 0x7f7a100999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:38.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.562+0000 7f7a15ebc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7a10099f30 0x7f7a1015f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:38.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.562+0000 7f7a15ebc640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a100cd7d0 con 0x7f7a100cc300 2024-04-25T10:00:38.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.562+0000 7f7a15ebc640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a1009a340 con 0x7f7a10099f30 2024-04-25T10:00:38.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.562+0000 7f7a15ebc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a100ccbc0 con 0x7f7a1015b8e0 2024-04-25T10:00:38.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.562+0000 7f7a0effd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7a100cc300 0x7f7a100999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:38.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.562+0000 7f7a0effd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7a100cc300 0x7f7a100999f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51274/0 (socket says 172.21.15.7:51274) 2024-04-25T10:00:38.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.562+0000 7f7a0effd640 1 -- 172.21.15.7:0/3121793985 learned_addr learned my addr 172.21.15.7:0/3121793985 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:38.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.563+0000 7f7a0effd640 1 -- 172.21.15.7:0/3121793985 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7a1015b8e0 msgr2=0x7f7a100d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:38.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.563+0000 7f7a0effd640 1 --2- 172.21.15.7:0/3121793985 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7a1015b8e0 0x7f7a100d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:38.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.563+0000 7f7a0effd640 1 -- 172.21.15.7:0/3121793985 >> v2:172.21.15.55:3300/0 conn(0x7f7a10099f30 msgr2=0x7f7a1015f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:38.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.563+0000 7f7a0ffff640 1 --2- 172.21.15.7:0/3121793985 >> v2:172.21.15.55:3300/0 conn(0x7f7a10099f30 0x7f7a1015f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:38.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.563+0000 7f7a0effd640 1 --2- 172.21.15.7:0/3121793985 >> v2:172.21.15.55:3300/0 conn(0x7f7a10099f30 0x7f7a1015f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:38.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.563+0000 7f7a0effd640 1 -- 172.21.15.7:0/3121793985 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a100ccea0 con 0x7f7a100cc300 2024-04-25T10:00:38.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.563+0000 7f7a0effd640 1 --2- 172.21.15.7:0/3121793985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a100cc300 0x7f7a100999f0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f7a10072f90 tx=0x7f7a0402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be14b78b8bec82b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:38.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.564+0000 7f7a0e7fc640 1 -- 172.21.15.7:0/3121793985 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a04037070 con 0x7f7a100cc300 2024-04-25T10:00:38.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.564+0000 7f7a0e7fc640 1 -- 172.21.15.7:0/3121793985 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a04032440 con 0x7f7a100cc300 2024-04-25T10:00:38.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.564+0000 7f7a0e7fc640 1 -- 172.21.15.7:0/3121793985 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a04032810 con 0x7f7a100cc300 2024-04-25T10:00:38.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.564+0000 7f7a15ebc640 1 -- 172.21.15.7:0/3121793985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a100cc300 msgr2=0x7f7a100999f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:38.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.564+0000 7f7a15ebc640 1 --2- 172.21.15.7:0/3121793985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a100cc300 0x7f7a100999f0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f7a10072f90 tx=0x7f7a0402a1e0 comp rx=0 tx=0).stop 2024-04-25T10:00:38.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.564+0000 7f7a15ebc640 1 -- 172.21.15.7:0/3121793985 shutdown_connections 2024-04-25T10:00:38.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.564+0000 7f7a15ebc640 1 --2- 172.21.15.7:0/3121793985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a100cc300 0x7f7a100999f0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:38.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.564+0000 7f7a15ebc640 1 --2- 172.21.15.7:0/3121793985 >> v2:172.21.15.55:3300/0 conn(0x7f7a10099f30 0x7f7a1015f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:38.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.564+0000 7f7a15ebc640 1 --2- 172.21.15.7:0/3121793985 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7a1015b8e0 0x7f7a100d0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:38.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.564+0000 7f7a15ebc640 1 -- 172.21.15.7:0/3121793985 >> 172.21.15.7:0/3121793985 conn(0x7f7a100b3130 msgr2=0x7f7a100b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:38.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.564+0000 7f7a15ebc640 1 -- 172.21.15.7:0/3121793985 shutdown_connections 2024-04-25T10:00:38.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.564+0000 7f7a15ebc640 1 -- 172.21.15.7:0/3121793985 wait complete. 2024-04-25T10:00:38.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.565+0000 7f7a15ebc640 1 Processor -- start 2024-04-25T10:00:38.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.566+0000 7f7a15ebc640 1 -- start start 2024-04-25T10:00:38.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.566+0000 7f7a15ebc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a10099f30 0x7f7a1015ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:38.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.566+0000 7f7a15ebc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a100cc300 0x7f7a100b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:38.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.566+0000 7f7a15ebc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7a1015b8e0 0x7f7a100b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:38.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.566+0000 7f7a15ebc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1015bcc0 con 0x7f7a100cc300 2024-04-25T10:00:38.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.566+0000 7f7a15ebc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a100cd460 con 0x7f7a10099f30 2024-04-25T10:00:38.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.566+0000 7f7a15ebc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1015be40 con 0x7f7a1015b8e0 2024-04-25T10:00:38.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.566+0000 7f7a0effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a100cc300 0x7f7a100b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:38.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.566+0000 7f7a0effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a100cc300 0x7f7a100b5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51284/0 (socket says 172.21.15.7:51284) 2024-04-25T10:00:38.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.566+0000 7f7a0effd640 1 -- 172.21.15.7:0/1230947240 learned_addr learned my addr 172.21.15.7:0/1230947240 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:38.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.566+0000 7f7a0ffff640 1 --2- 172.21.15.7:0/1230947240 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7a1015b8e0 0x7f7a100b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:38.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.566+0000 7f7a0f7fe640 1 --2- 172.21.15.7:0/1230947240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a10099f30 0x7f7a1015ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:38.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.567+0000 7f7a0effd640 1 -- 172.21.15.7:0/1230947240 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7a1015b8e0 msgr2=0x7f7a100b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:38.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.567+0000 7f7a0effd640 1 --2- 172.21.15.7:0/1230947240 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7a1015b8e0 0x7f7a100b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:38.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.567+0000 7f7a0effd640 1 -- 172.21.15.7:0/1230947240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a10099f30 msgr2=0x7f7a1015ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:38.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.567+0000 7f7a0effd640 1 --2- 172.21.15.7:0/1230947240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a10099f30 0x7f7a1015ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:38.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.567+0000 7f7a0effd640 1 -- 172.21.15.7:0/1230947240 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a100b65c0 con 0x7f7a100cc300 2024-04-25T10:00:38.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.567+0000 7f7a0ffff640 1 --2- 172.21.15.7:0/1230947240 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7a1015b8e0 0x7f7a100b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:38.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.567+0000 7f7a0f7fe640 1 --2- 172.21.15.7:0/1230947240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a10099f30 0x7f7a1015ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:38.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.567+0000 7f7a0effd640 1 --2- 172.21.15.7:0/1230947240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a100cc300 0x7f7a100b5a00 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f7a04000c00 tx=0x7f7a040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:38.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.567+0000 7f79f7fff640 1 -- 172.21.15.7:0/1230947240 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a04041020 con 0x7f7a100cc300 2024-04-25T10:00:38.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.567+0000 7f79f7fff640 1 -- 172.21.15.7:0/1230947240 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a04030970 con 0x7f7a100cc300 2024-04-25T10:00:38.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.567+0000 7f7a15ebc640 1 -- 172.21.15.7:0/1230947240 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a100b68a0 con 0x7f7a100cc300 2024-04-25T10:00:38.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.567+0000 7f79f7fff640 1 -- 172.21.15.7:0/1230947240 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a04037040 con 0x7f7a100cc300 2024-04-25T10:00:38.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.567+0000 7f7a15ebc640 1 -- 172.21.15.7:0/1230947240 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a100b6e60 con 0x7f7a100cc300 2024-04-25T10:00:38.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.568+0000 7f7a15ebc640 1 -- 172.21.15.7:0/1230947240 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a10068fd0 con 0x7f7a100cc300 2024-04-25T10:00:38.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.569+0000 7f79f7fff640 1 -- 172.21.15.7:0/1230947240 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7a04044020 con 0x7f7a100cc300 2024-04-25T10:00:38.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.569+0000 7f79f7fff640 1 --2- 172.21.15.7:0/1230947240 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f79fc06b4d0 0x7f79fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:38.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.569+0000 7f79f7fff640 1 -- 172.21.15.7:0/1230947240 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7a040aacf0 con 0x7f7a100cc300 2024-04-25T10:00:38.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.569+0000 7f7a0f7fe640 1 --2- 172.21.15.7:0/1230947240 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f79fc06b4d0 0x7f79fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:38.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.570+0000 7f7a0f7fe640 1 --2- 172.21.15.7:0/1230947240 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f79fc06b4d0 0x7f79fc06d990 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009890 tx=0x7f7a00008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:38.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.574+0000 7f79f7fff640 1 -- 172.21.15.7:0/1230947240 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7a040af070 con 0x7f7a100cc300 2024-04-25T10:00:38.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.790+0000 7f7a15ebc640 1 -- 172.21.15.7:0/1230947240 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a100b0810 con 0x7f7a100cc300 2024-04-25T10:00:38.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.791+0000 7f79f7fff640 1 -- 172.21.15.7:0/1230947240 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4934 (secure 0 0 0) 0x7f7a0404b030 con 0x7f7a100cc300 2024-04-25T10:00:38.795 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:00:38.796 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2505539422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2505539422},{"type":"v1","addr":"172.21.15.55:6834","nonce":2505539422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2808857776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2808857776},{"type":"v1","addr":"172.21.15.55:6835","nonce":2808857776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7518,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1796103144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1796103144},{"type":"v1","addr":"172.21.15.7:6835","nonce":1796103144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:00:34.054759+0000","modified":"2024-04-25T10:00:36.044190+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7533":{"gid":7533,"name":"a","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6837/2878753733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2878753733},{"type":"v1","addr":"172.21.15.7:6837","nonce":2878753733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:00:38.796 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 53 2024-04-25T10:00:38.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.793+0000 7f7a15ebc640 1 -- 172.21.15.7:0/1230947240 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f79fc06b4d0 msgr2=0x7f79fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:38.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.793+0000 7f7a15ebc640 1 --2- 172.21.15.7:0/1230947240 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f79fc06b4d0 0x7f79fc06d990 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009890 tx=0x7f7a00008040 comp rx=0 tx=0).stop 2024-04-25T10:00:38.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.793+0000 7f7a15ebc640 1 -- 172.21.15.7:0/1230947240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a100cc300 msgr2=0x7f7a100b5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:38.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.793+0000 7f7a15ebc640 1 --2- 172.21.15.7:0/1230947240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a100cc300 0x7f7a100b5a00 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f7a04000c00 tx=0x7f7a040046c0 comp rx=0 tx=0).stop 2024-04-25T10:00:38.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.793+0000 7f7a15ebc640 1 -- 172.21.15.7:0/1230947240 shutdown_connections 2024-04-25T10:00:38.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.793+0000 7f7a15ebc640 1 --2- 172.21.15.7:0/1230947240 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f79fc06b4d0 0x7f79fc06d990 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:38.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.793+0000 7f7a15ebc640 1 --2- 172.21.15.7:0/1230947240 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7a1015b8e0 0x7f7a100b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:38.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.793+0000 7f7a15ebc640 1 --2- 172.21.15.7:0/1230947240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a100cc300 0x7f7a100b5a00 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:38.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.793+0000 7f7a15ebc640 1 --2- 172.21.15.7:0/1230947240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a10099f30 0x7f7a1015ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:38.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.793+0000 7f7a15ebc640 1 -- 172.21.15.7:0/1230947240 >> 172.21.15.7:0/1230947240 conn(0x7f7a100b3130 msgr2=0x7f7a100b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:38.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.793+0000 7f7a15ebc640 1 -- 172.21.15.7:0/1230947240 shutdown_connections 2024-04-25T10:00:38.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:38.793+0000 7f7a15ebc640 1 -- 172.21.15.7:0/1230947240 wait complete. 2024-04-25T10:00:39.211 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 53, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:00:34.054759+0000', 'modified': '2024-04-25T10:00:36.044190+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7533}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7533': {'gid': 7533, 'name': 'a', 'rank': 0, 'incarnation': 51, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.7:6837/2878753733', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6836', 'nonce': 2878753733}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 2878753733}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:00:39.212 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T10:00:39.212 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T10:00:39.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.313+0000 7f05cf9e7640 1 Processor -- start 2024-04-25T10:00:39.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.314+0000 7f05cf9e7640 1 -- start start 2024-04-25T10:00:39.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.314+0000 7f05cf9e7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f05c80cd740 0x7f05c80d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.314+0000 7f05cf9e7640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f05c806cd90 0x7f05c80cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.314+0000 7f05cf9e7640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c8099b90 con 0x7f05c80d08d0 2024-04-25T10:00:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.314+0000 7f05cf9e7640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c80cdb20 con 0x7f05c806cd90 2024-04-25T10:00:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.314+0000 7f05cf9e7640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c8099e70 con 0x7f05c80cd740 2024-04-25T10:00:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.315+0000 7f05cdf84640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f05c806cd90 0x7f05c80cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.315+0000 7f05cdf84640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f05c806cd90 0x7f05c80cbc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51286/0 (socket says 172.21.15.7:51286) 2024-04-25T10:00:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.315+0000 7f05cdf84640 1 -- 172.21.15.7:0/3089048922 learned_addr learned my addr 172.21.15.7:0/3089048922 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.315+0000 7f05cd783640 1 --2- 172.21.15.7:0/3089048922 >> v2:172.21.15.55:3300/0 conn(0x7f05c80cd740 0x7f05c80d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.315+0000 7f05cdf84640 1 -- 172.21.15.7:0/3089048922 >> v2:172.21.15.55:3300/0 conn(0x7f05c80cd740 msgr2=0x7f05c80d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.315+0000 7f05cdf84640 1 --2- 172.21.15.7:0/3089048922 >> v2:172.21.15.55:3300/0 conn(0x7f05c80cd740 0x7f05c80d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.315+0000 7f05cdf84640 1 -- 172.21.15.7:0/3089048922 >> v1:172.21.15.55:6789/0 conn(0x7f05c80d08d0 legacy=0x7f05c806c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.315+0000 7f05cdf84640 1 -- 172.21.15.7:0/3089048922 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c809a150 con 0x7f05c806cd90 2024-04-25T10:00:39.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.316+0000 7f05cdf84640 1 --2- 172.21.15.7:0/3089048922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05c806cd90 0x7f05c80cbc90 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f05c806ebf0 tx=0x7f05c002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a9a341dd93fad7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:39.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.316+0000 7f05bffff640 1 -- 172.21.15.7:0/3089048922 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c0036070 con 0x7f05c806cd90 2024-04-25T10:00:39.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.316+0000 7f05bffff640 1 -- 172.21.15.7:0/3089048922 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c0031600 con 0x7f05c806cd90 2024-04-25T10:00:39.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.316+0000 7f05bffff640 1 -- 172.21.15.7:0/3089048922 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c00319d0 con 0x7f05c806cd90 2024-04-25T10:00:39.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.316+0000 7f05cf9e7640 1 -- 172.21.15.7:0/3089048922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05c806cd90 msgr2=0x7f05c80cbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:39.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.316+0000 7f05cf9e7640 1 --2- 172.21.15.7:0/3089048922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05c806cd90 0x7f05c80cbc90 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f05c806ebf0 tx=0x7f05c002a730 comp rx=0 tx=0).stop 2024-04-25T10:00:39.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.316+0000 7f05cf9e7640 1 -- 172.21.15.7:0/3089048922 shutdown_connections 2024-04-25T10:00:39.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.316+0000 7f05cf9e7640 1 --2- 172.21.15.7:0/3089048922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05c806cd90 0x7f05c80cbc90 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.316+0000 7f05cf9e7640 1 --2- 172.21.15.7:0/3089048922 >> v2:172.21.15.55:3300/0 conn(0x7f05c80cd740 0x7f05c80d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.316+0000 7f05cf9e7640 1 -- 172.21.15.7:0/3089048922 >> 172.21.15.7:0/3089048922 conn(0x7f05c80b3130 msgr2=0x7f05c80b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:39.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.316+0000 7f05cf9e7640 1 -- 172.21.15.7:0/3089048922 shutdown_connections 2024-04-25T10:00:39.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.316+0000 7f05cf9e7640 1 -- 172.21.15.7:0/3089048922 wait complete. 2024-04-25T10:00:39.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.318+0000 7f05cf9e7640 1 Processor -- start 2024-04-25T10:00:39.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.318+0000 7f05cf9e7640 1 -- start start 2024-04-25T10:00:39.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.318+0000 7f05cf9e7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c806cd90 0x7f05c80b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:39.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.318+0000 7f05cf9e7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05c80cd740 0x7f05c8070610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:39.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.318+0000 7f05cf9e7640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05c80d08d0 0x7f05c8070b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:39.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.318+0000 7f05cf9e7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c809ac30 con 0x7f05c80cd740 2024-04-25T10:00:39.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.318+0000 7f05cf9e7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c809a710 con 0x7f05c806cd90 2024-04-25T10:00:39.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.318+0000 7f05cf9e7640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c809adb0 con 0x7f05c80d08d0 2024-04-25T10:00:39.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.318+0000 7f05ccf82640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05c80cd740 0x7f05c8070610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:39.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.319+0000 7f05ccf82640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05c80cd740 0x7f05c8070610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51300/0 (socket says 172.21.15.7:51300) 2024-04-25T10:00:39.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.319+0000 7f05ccf82640 1 -- 172.21.15.7:0/1395757503 learned_addr learned my addr 172.21.15.7:0/1395757503 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:39.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.319+0000 7f05cdf84640 1 --2- 172.21.15.7:0/1395757503 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05c80d08d0 0x7f05c8070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:39.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.319+0000 7f05cd783640 1 --2- 172.21.15.7:0/1395757503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c806cd90 0x7f05c80b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:39.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.319+0000 7f05ccf82640 1 -- 172.21.15.7:0/1395757503 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05c80d08d0 msgr2=0x7f05c8070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:39.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.319+0000 7f05ccf82640 1 --2- 172.21.15.7:0/1395757503 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05c80d08d0 0x7f05c8070b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.319+0000 7f05ccf82640 1 -- 172.21.15.7:0/1395757503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c806cd90 msgr2=0x7f05c80b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:39.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.319+0000 7f05ccf82640 1 --2- 172.21.15.7:0/1395757503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c806cd90 0x7f05c80b0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.319+0000 7f05ccf82640 1 -- 172.21.15.7:0/1395757503 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c80b1c10 con 0x7f05c80cd740 2024-04-25T10:00:39.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.319+0000 7f05ccf82640 1 --2- 172.21.15.7:0/1395757503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05c80cd740 0x7f05c8070610 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f05b800c400 tx=0x7f05b800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:39.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.319+0000 7f05bdffb640 1 -- 172.21.15.7:0/1395757503 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b80052d0 con 0x7f05c80cd740 2024-04-25T10:00:39.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.319+0000 7f05bdffb640 1 -- 172.21.15.7:0/1395757503 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b8005490 con 0x7f05c80cd740 2024-04-25T10:00:39.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.319+0000 7f05cf9e7640 1 -- 172.21.15.7:0/1395757503 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c80b1ef0 con 0x7f05c80cd740 2024-04-25T10:00:39.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.319+0000 7f05bdffb640 1 -- 172.21.15.7:0/1395757503 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b8007260 con 0x7f05c80cd740 2024-04-25T10:00:39.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.319+0000 7f05cf9e7640 1 -- 172.21.15.7:0/1395757503 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c809b9b0 con 0x7f05c80cd740 2024-04-25T10:00:39.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.321+0000 7f05bdffb640 1 -- 172.21.15.7:0/1395757503 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f05b8007400 con 0x7f05c80cd740 2024-04-25T10:00:39.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.322+0000 7f05bdffb640 1 --2- 172.21.15.7:0/1395757503 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f05ac06b4d0 0x7f05ac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:39.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.322+0000 7f05bdffb640 1 -- 172.21.15.7:0/1395757503 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f05b80898e0 con 0x7f05c80cd740 2024-04-25T10:00:39.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.322+0000 7f05cd783640 1 --2- 172.21.15.7:0/1395757503 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f05ac06b4d0 0x7f05ac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:39.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.322+0000 7f05cd783640 1 --2- 172.21.15.7:0/1395757503 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f05ac06b4d0 0x7f05ac06d990 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f05c4006fd0 tx=0x7f05c4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:39.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.323+0000 7f05d27c7740 1 Processor -- start 2024-04-25T10:00:39.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.323+0000 7f05d27c7740 1 -- start start 2024-04-25T10:00:39.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.323+0000 7f05d27c7740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d92fb5230 0x562d92fb5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:39.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.323+0000 7f05d27c7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d92fd2ad0 0x562d92fd3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:39.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.323+0000 7f05d27c7740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562d92f8af10 0x562d92fd1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:39.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.323+0000 7f05d27c7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d92eeda10 con 0x562d92fd2ad0 2024-04-25T10:00:39.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.323+0000 7f05d27c7740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d92e96b30 con 0x562d92fb5230 2024-04-25T10:00:39.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.323+0000 7f05d27c7740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d92ee9c50 con 0x562d92f8af10 2024-04-25T10:00:39.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.323+0000 7f05ccf82640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d92fd2ad0 0x562d92fd3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:39.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.323+0000 7f05ccf82640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d92fd2ad0 0x562d92fd3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51312/0 (socket says 172.21.15.7:51312) 2024-04-25T10:00:39.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.323+0000 7f05ccf82640 1 -- 172.21.15.7:0/2439514320 learned_addr learned my addr 172.21.15.7:0/2439514320 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:39.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.324+0000 7f05cd783640 1 --2- 172.21.15.7:0/2439514320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d92fb5230 0x562d92fb5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:39.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.324+0000 7f05cdf84640 1 --2- 172.21.15.7:0/2439514320 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562d92f8af10 0x562d92fd1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:39.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.324+0000 7f05ccf82640 1 -- 172.21.15.7:0/2439514320 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562d92f8af10 msgr2=0x562d92fd1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:39.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.324+0000 7f05ccf82640 1 --2- 172.21.15.7:0/2439514320 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562d92f8af10 0x562d92fd1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.324+0000 7f05ccf82640 1 -- 172.21.15.7:0/2439514320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d92fb5230 msgr2=0x562d92fb5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:39.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.324+0000 7f05ccf82640 1 --2- 172.21.15.7:0/2439514320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d92fb5230 0x562d92fb5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.324+0000 7f05ccf82640 1 -- 172.21.15.7:0/2439514320 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d92eabe10 con 0x562d92fd2ad0 2024-04-25T10:00:39.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.324+0000 7f05cd783640 1 --2- 172.21.15.7:0/2439514320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d92fb5230 0x562d92fb5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:39.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.324+0000 7f05ccf82640 1 --2- 172.21.15.7:0/2439514320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d92fd2ad0 0x562d92fd3020 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f05b800cfd0 tx=0x7f05b800a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dfdfe9404b2a961 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:39.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.324+0000 7f05b2ffd640 1 -- 172.21.15.7:0/2439514320 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b80561d0 con 0x562d92fd2ad0 2024-04-25T10:00:39.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.324+0000 7f05b2ffd640 1 -- 172.21.15.7:0/2439514320 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b8054540 con 0x562d92fd2ad0 2024-04-25T10:00:39.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.324+0000 7f05b2ffd640 1 -- 172.21.15.7:0/2439514320 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b805e2b0 con 0x562d92fd2ad0 2024-04-25T10:00:39.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.325+0000 7f05d27c7740 1 -- 172.21.15.7:0/2439514320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d92fd2ad0 msgr2=0x562d92fd3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:39.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.325+0000 7f05d27c7740 1 --2- 172.21.15.7:0/2439514320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d92fd2ad0 0x562d92fd3020 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f05b800cfd0 tx=0x7f05b800a000 comp rx=0 tx=0).stop 2024-04-25T10:00:39.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.325+0000 7f05d27c7740 1 -- 172.21.15.7:0/2439514320 shutdown_connections 2024-04-25T10:00:39.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.325+0000 7f05d27c7740 1 --2- 172.21.15.7:0/2439514320 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562d92f8af10 0x562d92fd1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.325+0000 7f05d27c7740 1 --2- 172.21.15.7:0/2439514320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d92fd2ad0 0x562d92fd3020 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.325+0000 7f05d27c7740 1 --2- 172.21.15.7:0/2439514320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d92fb5230 0x562d92fb5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.325+0000 7f05d27c7740 1 -- 172.21.15.7:0/2439514320 >> 172.21.15.7:0/2439514320 conn(0x562d92f87840 msgr2=0x562d92fd0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:39.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.325+0000 7f05d27c7740 1 -- 172.21.15.7:0/2439514320 shutdown_connections 2024-04-25T10:00:39.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.325+0000 7f05d27c7740 1 -- 172.21.15.7:0/2439514320 wait complete. 2024-04-25T10:00:39.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.325+0000 7f05d27c7740 1 -- start start 2024-04-25T10:00:39.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.325+0000 7f05d27c7740 1 Processor -- start 2024-04-25T10:00:39.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.326+0000 7f05d27c7740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562d92fb5230 0x562d92fe2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:39.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.326+0000 7f05d27c7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d92fd2ad0 0x562d92fc7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:39.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.326+0000 7f05d27c7740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d92fb72d0 0x562d92f84920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:39.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.326+0000 7f05d27c7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d92f8bcb0 con 0x562d92fd2ad0 2024-04-25T10:00:39.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.326+0000 7f05d27c7740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d92eaa0c0 con 0x562d92fb72d0 2024-04-25T10:00:39.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.326+0000 7f05d27c7740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d92f85770 con 0x562d92fb5230 2024-04-25T10:00:39.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.326+0000 7f05d27c7740 10 client.0 _ll_register_callbacks cb 0x562d92e9dec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:00:39.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.326+0000 7f05ccf82640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d92fd2ad0 0x562d92fc7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:39.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.326+0000 7f05ccf82640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d92fd2ad0 0x562d92fc7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51328/0 (socket says 172.21.15.7:51328) 2024-04-25T10:00:39.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.326+0000 7f05ccf82640 1 -- 172.21.15.7:0/969242802 learned_addr learned my addr 172.21.15.7:0/969242802 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:39.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.326+0000 7f05cd783640 1 --2- 172.21.15.7:0/969242802 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562d92fb5230 0x562d92fe2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:39.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.326+0000 7f05cdf84640 1 --2- 172.21.15.7:0/969242802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d92fb72d0 0x562d92f84920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:39.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.327+0000 7f05ccf82640 1 -- 172.21.15.7:0/969242802 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562d92fb5230 msgr2=0x562d92fe2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:39.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.327+0000 7f05ccf82640 1 --2- 172.21.15.7:0/969242802 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562d92fb5230 0x562d92fe2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.327+0000 7f05ccf82640 1 -- 172.21.15.7:0/969242802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d92fb72d0 msgr2=0x562d92f84920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:39.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.327+0000 7f05ccf82640 1 --2- 172.21.15.7:0/969242802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d92fb72d0 0x562d92f84920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.327+0000 7f05ccf82640 1 -- 172.21.15.7:0/969242802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562d92c022d0 con 0x562d92fd2ad0 2024-04-25T10:00:39.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.327+0000 7f05cdf84640 1 --2- 172.21.15.7:0/969242802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d92fb72d0 0x562d92f84920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:39.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.327+0000 7f05ccf82640 1 --2- 172.21.15.7:0/969242802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d92fd2ad0 0x562d92fc7ac0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f05b8000fb0 tx=0x7f05b8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e516145a04cfad23 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:39.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.327+0000 7f05a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:00:39.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.327+0000 7f05a7fff640 1 -- 172.21.15.7:0/969242802 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b8054170 con 0x562d92fd2ad0 2024-04-25T10:00:39.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.327+0000 7f05a7fff640 1 -- 172.21.15.7:0/969242802 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f05b805e270 con 0x562d92fd2ad0 2024-04-25T10:00:39.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.327+0000 7f05d27c7740 1 -- 172.21.15.7:0/969242802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f05b8054540 con 0x562d92fd2ad0 2024-04-25T10:00:39.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.327+0000 7f05a7fff640 1 -- 172.21.15.7:0/969242802 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05b8057320 con 0x562d92fd2ad0 2024-04-25T10:00:39.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.327+0000 7f05d27c7740 10 client.7665 fetch_fsmap learned FSMap version 53 2024-04-25T10:00:39.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.327+0000 7f05d27c7740 1 -- 172.21.15.7:0/969242802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) v3 -- 0x562d92ccc6b0 con 0x562d92fd2ad0 2024-04-25T10:00:39.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.327+0000 7f05a7fff640 1 -- 172.21.15.7:0/969242802 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b8054540 con 0x562d92fd2ad0 2024-04-25T10:00:39.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.327+0000 7f05a7fff640 1 -- 172.21.15.7:0/969242802 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 53) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f05b80574c0 con 0x562d92fd2ad0 2024-04-25T10:00:39.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.327+0000 7f05d27c7740 10 client.7665 fetch_fsmap finished waiting for FSMap version 53 2024-04-25T10:00:39.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.327+0000 7f05d27c7740 10 client.7665 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:00:39.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.327+0000 7f05d27c7740 20 client.7665 populate_metadata read hostname 'smithi007' 2024-04-25T10:00:39.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.327+0000 7f05d27c7740 1 --2- 172.21.15.7:0/969242802 >> [v2:172.21.15.7:6836/2878753733,v1:172.21.15.7:6837/2878753733] conn(0x562d92fe0180 0x562d92fe0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:39.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.327+0000 7f05d27c7740 4 client.7665 mds_command: new command op to 7533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:00:39.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.327+0000 7f05d27c7740 1 -- 172.21.15.7:0/969242802 --> [v2:172.21.15.7:6836/2878753733,v1:172.21.15.7:6837/2878753733] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562d92f4c920 con 0x562d92fe0180 2024-04-25T10:00:39.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.327+0000 7f05cd783640 1 --2- 172.21.15.7:0/969242802 >> [v2:172.21.15.7:6836/2878753733,v1:172.21.15.7:6837/2878753733] conn(0x562d92fe0180 0x562d92fe0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:39.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.328+0000 7f05a7fff640 10 client.7665 ms_handle_connect on v2:172.21.15.7:6836/2878753733 2024-04-25T10:00:39.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.328+0000 7f05cd783640 1 --2- 172.21.15.7:0/969242802 >> [v2:172.21.15.7:6836/2878753733,v1:172.21.15.7:6837/2878753733] conn(0x562d92fe0180 0x562d92fe0560 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b096ef6dc8294220 server_cookie=a8a80a69bde9b92f in_seq=0 out_seq=0 2024-04-25T10:00:39.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.328+0000 7f05a7fff640 1 -- 172.21.15.7:0/969242802 <== mds.0 v2:172.21.15.7:6836/2878753733 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562d92f4c920 con 0x562d92fe0180 2024-04-25T10:00:39.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.328+0000 7f05a7fff640 10 client.7665 handle_command_reply: tid=0 2024-04-25T10:00:39.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.328+0000 7f05d27c7740 1 client.7665 shutdown 2024-04-25T10:00:39.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.329+0000 7f05d27c7740 1 -- 172.21.15.7:0/969242802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d92fd2ad0 msgr2=0x562d92fc7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:39.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.329+0000 7f05d27c7740 1 --2- 172.21.15.7:0/969242802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d92fd2ad0 0x562d92fc7ac0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f05b8000fb0 tx=0x7f05b8000bc0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.329+0000 7f05d27c7740 1 -- 172.21.15.7:0/969242802 shutdown_connections 2024-04-25T10:00:39.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.329+0000 7f05d27c7740 1 --2- 172.21.15.7:0/969242802 >> [v2:172.21.15.7:6836/2878753733,v1:172.21.15.7:6837/2878753733] conn(0x562d92fe0180 0x562d92fe0560 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.329+0000 7f05d27c7740 1 --2- 172.21.15.7:0/969242802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d92fb72d0 0x562d92f84920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.329+0000 7f05a7fff640 0 client.7665 ms_handle_reset on v2:172.21.15.7:6836/2878753733 2024-04-25T10:00:39.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.329+0000 7f05d27c7740 1 --2- 172.21.15.7:0/969242802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d92fd2ad0 0x562d92fc7ac0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.329+0000 7f05d27c7740 1 --2- 172.21.15.7:0/969242802 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562d92fb5230 0x562d92fe2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.329+0000 7f05d27c7740 1 -- 172.21.15.7:0/969242802 >> 172.21.15.7:0/969242802 conn(0x562d92f8af10 msgr2=0x562d92fd35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:39.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.329+0000 7f05d27c7740 1 -- 172.21.15.7:0/969242802 shutdown_connections 2024-04-25T10:00:39.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.329+0000 7f05d27c7740 1 -- 172.21.15.7:0/969242802 wait complete. 2024-04-25T10:00:39.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.329+0000 7f05d27c7740 20 client.7665 trim_cache size 0 max 16384 2024-04-25T10:00:39.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.345+0000 7f05d27c7740 1 Processor -- start 2024-04-25T10:00:39.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.345+0000 7f05d27c7740 1 -- start start 2024-04-25T10:00:39.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.345+0000 7f05d27c7740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562d92fb5230 0x562d92fb1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.345+0000 7f05d27c7740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d92fb72d0 0x562d92fb1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.345+0000 7f05d27c7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d92fd2ad0 0x562d92fd0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.345+0000 7f05d27c7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c81ff560 con 0x562d92fd2ad0 2024-04-25T10:00:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.345+0000 7f05d27c7740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c809cac0 con 0x562d92fb72d0 2024-04-25T10:00:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.345+0000 7f05d27c7740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c809d0c0 con 0x562d92fb5230 2024-04-25T10:00:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.345+0000 7f05cdf84640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d92fd2ad0 0x562d92fd0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.346+0000 7f05cdf84640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d92fd2ad0 0x562d92fd0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51342/0 (socket says 172.21.15.7:51342) 2024-04-25T10:00:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.346+0000 7f05cdf84640 1 -- 172.21.15.7:0/2436048706 learned_addr learned my addr 172.21.15.7:0/2436048706 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.346+0000 7f05cd783640 1 --2- 172.21.15.7:0/2436048706 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562d92fb5230 0x562d92fb1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.346+0000 7f05ccf82640 1 --2- 172.21.15.7:0/2436048706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d92fb72d0 0x562d92fb1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.346+0000 7f05cdf84640 1 -- 172.21.15.7:0/2436048706 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562d92fb5230 msgr2=0x562d92fb1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.346+0000 7f05cdf84640 1 --2- 172.21.15.7:0/2436048706 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562d92fb5230 0x562d92fb1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.346+0000 7f05cdf84640 1 -- 172.21.15.7:0/2436048706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d92fb72d0 msgr2=0x562d92fb1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.346+0000 7f05cdf84640 1 --2- 172.21.15.7:0/2436048706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d92fb72d0 0x562d92fb1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.346+0000 7f05cdf84640 1 -- 172.21.15.7:0/2436048706 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d92fdfe50 con 0x562d92fd2ad0 2024-04-25T10:00:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.346+0000 7f05cdf84640 1 --2- 172.21.15.7:0/2436048706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d92fd2ad0 0x562d92fd0e50 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f05c0009f40 tx=0x7f05c002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d193d4ecbab43af9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.346+0000 7f05b27fc640 1 -- 172.21.15.7:0/2436048706 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c0036040 con 0x562d92fd2ad0 2024-04-25T10:00:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.346+0000 7f05b27fc640 1 -- 172.21.15.7:0/2436048706 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c003c6e0 con 0x562d92fd2ad0 2024-04-25T10:00:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.346+0000 7f05b27fc640 1 -- 172.21.15.7:0/2436048706 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c003ca90 con 0x562d92fd2ad0 2024-04-25T10:00:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.347+0000 7f05d27c7740 1 -- 172.21.15.7:0/2436048706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d92fd2ad0 msgr2=0x562d92fd0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.347+0000 7f05d27c7740 1 --2- 172.21.15.7:0/2436048706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d92fd2ad0 0x562d92fd0e50 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f05c0009f40 tx=0x7f05c002e000 comp rx=0 tx=0).stop 2024-04-25T10:00:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.347+0000 7f05d27c7740 1 -- 172.21.15.7:0/2436048706 shutdown_connections 2024-04-25T10:00:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.347+0000 7f05d27c7740 1 --2- 172.21.15.7:0/2436048706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d92fd2ad0 0x562d92fd0e50 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.347+0000 7f05d27c7740 1 --2- 172.21.15.7:0/2436048706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d92fb72d0 0x562d92fb1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.347+0000 7f05d27c7740 1 --2- 172.21.15.7:0/2436048706 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562d92fb5230 0x562d92fb1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.347+0000 7f05d27c7740 1 -- 172.21.15.7:0/2436048706 >> 172.21.15.7:0/2436048706 conn(0x562d92f8af10 msgr2=0x562d92fc8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.347+0000 7f05d27c7740 1 -- 172.21.15.7:0/2436048706 shutdown_connections 2024-04-25T10:00:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.347+0000 7f05d27c7740 1 -- 172.21.15.7:0/2436048706 wait complete. 2024-04-25T10:00:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.347+0000 7f05d27c7740 1 -- start start 2024-04-25T10:00:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.347+0000 7f05d27c7740 1 Processor -- start 2024-04-25T10:00:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.348+0000 7f05d27c7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d92fb5230 0x562d92fb2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.348+0000 7f05d27c7740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562d92fb72d0 0x562d92fe9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.348+0000 7f05d27c7740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d92fd2ad0 0x562d92fe9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.348+0000 7f05d27c7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d92fc8000 con 0x562d92fb5230 2024-04-25T10:00:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.348+0000 7f05d27c7740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d92f8bcb0 con 0x562d92fd2ad0 2024-04-25T10:00:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.348+0000 7f05d27c7740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d92fb3a40 con 0x562d92fb72d0 2024-04-25T10:00:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.348+0000 7f05d27c7740 10 client.0 _ll_register_callbacks cb 0x562d92f85c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:00:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.348+0000 7f05cd783640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d92fb5230 0x562d92fb2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.348+0000 7f05cd783640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d92fb5230 0x562d92fb2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51358/0 (socket says 172.21.15.7:51358) 2024-04-25T10:00:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.348+0000 7f05cd783640 1 -- 172.21.15.7:0/2342231475 learned_addr learned my addr 172.21.15.7:0/2342231475 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.348+0000 7f05ccf82640 1 --2- 172.21.15.7:0/2342231475 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562d92fb72d0 0x562d92fe9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.349+0000 7f05cdf84640 1 --2- 172.21.15.7:0/2342231475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d92fd2ad0 0x562d92fe9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.349+0000 7f05cd783640 1 -- 172.21.15.7:0/2342231475 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562d92fb72d0 msgr2=0x562d92fe9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.349+0000 7f05cd783640 1 --2- 172.21.15.7:0/2342231475 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562d92fb72d0 0x562d92fe9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.349+0000 7f05cd783640 1 -- 172.21.15.7:0/2342231475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d92fd2ad0 msgr2=0x562d92fe9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.349+0000 7f05cd783640 1 --2- 172.21.15.7:0/2342231475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d92fd2ad0 0x562d92fe9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.349+0000 7f05cd783640 1 -- 172.21.15.7:0/2342231475 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562d92fb2290 con 0x562d92fb5230 2024-04-25T10:00:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.349+0000 7f05cd783640 1 --2- 172.21.15.7:0/2342231475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d92fb5230 0x562d92fb2ac0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x562d92fd45d0 tx=0x7f05c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39289e57cec58b5e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.349+0000 7f05a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:00:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.349+0000 7f05a7fff640 1 -- 172.21.15.7:0/2342231475 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c401b040 con 0x562d92fb5230 2024-04-25T10:00:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.349+0000 7f05a7fff640 1 -- 172.21.15.7:0/2342231475 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f05c400f920 con 0x562d92fb5230 2024-04-25T10:00:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.349+0000 7f05d27c7740 1 -- 172.21.15.7:0/2342231475 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f05c003c6e0 con 0x562d92fb5230 2024-04-25T10:00:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.349+0000 7f05a7fff640 1 -- 172.21.15.7:0/2342231475 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05c4037050 con 0x562d92fb5230 2024-04-25T10:00:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.349+0000 7f05d27c7740 10 client.7671 fetch_fsmap learned FSMap version 53 2024-04-25T10:00:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.349+0000 7f05d27c7740 1 -- 172.21.15.7:0/2342231475 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) v3 -- 0x562d92fea2e0 con 0x562d92fb5230 2024-04-25T10:00:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.349+0000 7f05a7fff640 1 -- 172.21.15.7:0/2342231475 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c003c6e0 con 0x562d92fb5230 2024-04-25T10:00:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.349+0000 7f05a7fff640 1 -- 172.21.15.7:0/2342231475 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 53) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f05c403a020 con 0x562d92fb5230 2024-04-25T10:00:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.349+0000 7f05d27c7740 10 client.7671 fetch_fsmap finished waiting for FSMap version 53 2024-04-25T10:00:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.349+0000 7f05d27c7740 10 client.7671 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:00:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.349+0000 7f05d27c7740 20 client.7671 populate_metadata read hostname 'smithi007' 2024-04-25T10:00:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.349+0000 7f05d27c7740 1 --2- 172.21.15.7:0/2342231475 >> [v2:172.21.15.7:6836/2878753733,v1:172.21.15.7:6837/2878753733] conn(0x562d9303b090 0x562d92fc59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.349+0000 7f05d27c7740 4 client.7671 mds_command: new command op to 7533 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:00:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.349+0000 7f05d27c7740 1 -- 172.21.15.7:0/2342231475 --> [v2:172.21.15.7:6836/2878753733,v1:172.21.15.7:6837/2878753733] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562d92efaf50 con 0x562d9303b090 2024-04-25T10:00:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.350+0000 7f05ccf82640 1 --2- 172.21.15.7:0/2342231475 >> [v2:172.21.15.7:6836/2878753733,v1:172.21.15.7:6837/2878753733] conn(0x562d9303b090 0x562d92fc59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.350+0000 7f05a7fff640 10 client.7671 ms_handle_connect on v2:172.21.15.7:6836/2878753733 2024-04-25T10:00:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.350+0000 7f05ccf82640 1 --2- 172.21.15.7:0/2342231475 >> [v2:172.21.15.7:6836/2878753733,v1:172.21.15.7:6837/2878753733] conn(0x562d9303b090 0x562d92fc59d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12c53926d941cf2e server_cookie=3399d9c424e8f6e2 in_seq=0 out_seq=0 2024-04-25T10:00:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.350+0000 7f05a7fff640 1 -- 172.21.15.7:0/2342231475 <== mds.0 v2:172.21.15.7:6836/2878753733 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x562d92efaf50 con 0x562d9303b090 2024-04-25T10:00:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.350+0000 7f05a7fff640 10 client.7671 handle_command_reply: tid=0 2024-04-25T10:00:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.350+0000 7f05d27c7740 1 client.7671 shutdown 2024-04-25T10:00:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.350+0000 7f05d27c7740 1 -- 172.21.15.7:0/2342231475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d92fb5230 msgr2=0x562d92fb2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.350+0000 7f05d27c7740 1 --2- 172.21.15.7:0/2342231475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d92fb5230 0x562d92fb2ac0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x562d92fd45d0 tx=0x7f05c4004730 comp rx=0 tx=0).stop 2024-04-25T10:00:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.350+0000 7f05d27c7740 1 -- 172.21.15.7:0/2342231475 shutdown_connections 2024-04-25T10:00:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.350+0000 7f05d27c7740 1 --2- 172.21.15.7:0/2342231475 >> [v2:172.21.15.7:6836/2878753733,v1:172.21.15.7:6837/2878753733] conn(0x562d9303b090 0x562d92fc59d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.350+0000 7f05d27c7740 1 --2- 172.21.15.7:0/2342231475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562d92fd2ad0 0x562d92fe9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.350+0000 7f05d27c7740 1 --2- 172.21.15.7:0/2342231475 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562d92fb72d0 0x562d92fe9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.350+0000 7f05a7fff640 0 client.7671 ms_handle_reset on v2:172.21.15.7:6836/2878753733 2024-04-25T10:00:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.350+0000 7f05d27c7740 1 --2- 172.21.15.7:0/2342231475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562d92fb5230 0x562d92fb2ac0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.350+0000 7f05d27c7740 1 -- 172.21.15.7:0/2342231475 >> 172.21.15.7:0/2342231475 conn(0x562d92f8af10 msgr2=0x562d92fe0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.350+0000 7f05d27c7740 1 -- 172.21.15.7:0/2342231475 shutdown_connections 2024-04-25T10:00:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.350+0000 7f05d27c7740 1 -- 172.21.15.7:0/2342231475 wait complete. 2024-04-25T10:00:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.351+0000 7f05d27c7740 20 client.7671 trim_cache size 0 max 16384 2024-04-25T10:00:39.364 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:00:39.364 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "c03d0745-5946-49c3-ad88-1165c5b68b4e", 2024-04-25T10:00:39.364 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-04-25T10:00:39.364 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 7533, 2024-04-25T10:00:39.364 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-04-25T10:00:39.365 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-04-25T10:00:39.365 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-04-25T10:00:39.365 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 4.6598936389999999, 2024-04-25T10:00:39.365 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 53, 2024-04-25T10:00:39.365 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 88, 2024-04-25T10:00:39.365 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 88, 2024-04-25T10:00:39.365 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 9.7526066339999993 2024-04-25T10:00:39.365 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:00:39.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.351+0000 7f05cf9e7640 1 -- 172.21.15.7:0/1395757503 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f05ac06b4d0 msgr2=0x7f05ac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.351+0000 7f05cf9e7640 1 --2- 172.21.15.7:0/1395757503 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f05ac06b4d0 0x7f05ac06d990 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f05c4006fd0 tx=0x7f05c4008040 comp rx=0 tx=0).stop 2024-04-25T10:00:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.351+0000 7f05cf9e7640 1 -- 172.21.15.7:0/1395757503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05c80cd740 msgr2=0x7f05c8070610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.351+0000 7f05cf9e7640 1 --2- 172.21.15.7:0/1395757503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05c80cd740 0x7f05c8070610 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f05b800c400 tx=0x7f05b800c8c0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.351+0000 7f05cf9e7640 1 -- 172.21.15.7:0/1395757503 shutdown_connections 2024-04-25T10:00:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.351+0000 7f05cf9e7640 1 --2- 172.21.15.7:0/1395757503 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f05ac06b4d0 0x7f05ac06d990 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.351+0000 7f05cf9e7640 1 --2- 172.21.15.7:0/1395757503 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05c80d08d0 0x7f05c8070b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.351+0000 7f05cf9e7640 1 --2- 172.21.15.7:0/1395757503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05c80cd740 0x7f05c8070610 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.351+0000 7f05cf9e7640 1 --2- 172.21.15.7:0/1395757503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c806cd90 0x7f05c80b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.351+0000 7f05cf9e7640 1 -- 172.21.15.7:0/1395757503 >> 172.21.15.7:0/1395757503 conn(0x7f05c80b3130 msgr2=0x7f05c806f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.351+0000 7f05cf9e7640 1 -- 172.21.15.7:0/1395757503 shutdown_connections 2024-04-25T10:00:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.351+0000 7f05cf9e7640 1 -- 172.21.15.7:0/1395757503 wait complete. 2024-04-25T10:00:39.368 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:00:39.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.463+0000 7f4ccebab640 1 Processor -- start 2024-04-25T10:00:39.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.463+0000 7f4ccebab640 1 -- start start 2024-04-25T10:00:39.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.464+0000 7f4ccebab640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4cc815db00 0x7f4cc80d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:39.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.464+0000 7f4ccebab640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4cc80ce2b0 0x7f4cc80d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:39.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.464+0000 7f4ccebab640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cc80d1e80 con 0x7f4cc80b53b0 2024-04-25T10:00:39.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.464+0000 7f4ccebab640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cc80b5930 con 0x7f4cc80ce2b0 2024-04-25T10:00:39.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.464+0000 7f4ccebab640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc80b5c10 con 0x7f4cc815db00 2024-04-25T10:00:39.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.464+0000 7f4ccd148640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4cc80ce2b0 0x7f4cc80d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:39.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.464+0000 7f4ccd148640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4cc80ce2b0 0x7f4cc80d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51372/0 (socket says 172.21.15.7:51372) 2024-04-25T10:00:39.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.464+0000 7f4ccd148640 1 -- 172.21.15.7:0/2124106586 learned_addr learned my addr 172.21.15.7:0/2124106586 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:39.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.465+0000 7f4ccc947640 1 --2- 172.21.15.7:0/2124106586 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4cc815db00 0x7f4cc80d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:39.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.465+0000 7f4ccd148640 1 -- 172.21.15.7:0/2124106586 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4cc815db00 msgr2=0x7f4cc80d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:39.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.465+0000 7f4ccd148640 1 --2- 172.21.15.7:0/2124106586 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4cc815db00 0x7f4cc80d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.465+0000 7f4ccd148640 1 -- 172.21.15.7:0/2124106586 >> v1:172.21.15.55:6789/0 conn(0x7f4cc80b53b0 legacy=0x7f4cc8161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:39.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.465+0000 7f4ccd148640 1 -- 172.21.15.7:0/2124106586 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc80b5ef0 con 0x7f4cc80ce2b0 2024-04-25T10:00:39.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.465+0000 7f4ccc947640 1 --2- 172.21.15.7:0/2124106586 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4cc815db00 0x7f4cc80d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:00:39.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.465+0000 7f4ccd148640 1 --2- 172.21.15.7:0/2124106586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cc80ce2b0 0x7f4cc80d0880 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0009870 tx=0x7f4cb002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b6a3d872a48393 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:39.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.465+0000 7f4cc77fe640 1 -- 172.21.15.7:0/2124106586 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb0037070 con 0x7f4cc80ce2b0 2024-04-25T10:00:39.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.466+0000 7f4cc77fe640 1 -- 172.21.15.7:0/2124106586 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb0032440 con 0x7f4cc80ce2b0 2024-04-25T10:00:39.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.466+0000 7f4cc77fe640 1 -- 172.21.15.7:0/2124106586 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb0032810 con 0x7f4cc80ce2b0 2024-04-25T10:00:39.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.466+0000 7f4ccebab640 1 -- 172.21.15.7:0/2124106586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cc80ce2b0 msgr2=0x7f4cc80d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:39.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.466+0000 7f4ccebab640 1 --2- 172.21.15.7:0/2124106586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cc80ce2b0 0x7f4cc80d0880 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0009870 tx=0x7f4cb002a210 comp rx=0 tx=0).stop 2024-04-25T10:00:39.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.466+0000 7f4ccebab640 1 -- 172.21.15.7:0/2124106586 shutdown_connections 2024-04-25T10:00:39.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.466+0000 7f4ccebab640 1 --2- 172.21.15.7:0/2124106586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cc80ce2b0 0x7f4cc80d0880 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.466+0000 7f4ccebab640 1 --2- 172.21.15.7:0/2124106586 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4cc815db00 0x7f4cc80d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.466+0000 7f4ccebab640 1 -- 172.21.15.7:0/2124106586 >> 172.21.15.7:0/2124106586 conn(0x7f4cc8072290 msgr2=0x7f4cc80726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:39.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.466+0000 7f4ccebab640 1 -- 172.21.15.7:0/2124106586 shutdown_connections 2024-04-25T10:00:39.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.466+0000 7f4ccebab640 1 -- 172.21.15.7:0/2124106586 wait complete. 2024-04-25T10:00:39.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.467+0000 7f4ccebab640 1 Processor -- start 2024-04-25T10:00:39.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.467+0000 7f4ccebab640 1 -- start start 2024-04-25T10:00:39.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.468+0000 7f4ccebab640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4cc80b53b0 0x7f4cc814f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:39.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.468+0000 7f4ccebab640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cc80ce2b0 0x7f4cc815e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:39.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.468+0000 7f4ccebab640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cc815db00 0x7f4cc80c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:39.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.468+0000 7f4ccebab640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc80d3660 con 0x7f4cc80ce2b0 2024-04-25T10:00:39.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.468+0000 7f4ccebab640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc80b61d0 con 0x7f4cc815db00 2024-04-25T10:00:39.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.468+0000 7f4ccebab640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc80b6c10 con 0x7f4cc80b53b0 2024-04-25T10:00:39.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.468+0000 7f4cc7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cc80ce2b0 0x7f4cc815e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:39.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.468+0000 7f4cc7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cc80ce2b0 0x7f4cc815e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51378/0 (socket says 172.21.15.7:51378) 2024-04-25T10:00:39.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.468+0000 7f4cc7fff640 1 -- 172.21.15.7:0/1719502361 learned_addr learned my addr 172.21.15.7:0/1719502361 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:39.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.468+0000 7f4ccc947640 1 --2- 172.21.15.7:0/1719502361 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4cc80b53b0 0x7f4cc814f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:39.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.468+0000 7f4ccd148640 1 --2- 172.21.15.7:0/1719502361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cc815db00 0x7f4cc80c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:39.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.469+0000 7f4cc7fff640 1 -- 172.21.15.7:0/1719502361 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4cc80b53b0 msgr2=0x7f4cc814f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:39.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.469+0000 7f4cc7fff640 1 --2- 172.21.15.7:0/1719502361 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4cc80b53b0 0x7f4cc814f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.469+0000 7f4cc7fff640 1 -- 172.21.15.7:0/1719502361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cc815db00 msgr2=0x7f4cc80c9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:39.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.469+0000 7f4cc7fff640 1 --2- 172.21.15.7:0/1719502361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cc815db00 0x7f4cc80c9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.469+0000 7f4cc7fff640 1 -- 172.21.15.7:0/1719502361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc80c9a50 con 0x7f4cc80ce2b0 2024-04-25T10:00:39.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.469+0000 7f4cc7fff640 1 --2- 172.21.15.7:0/1719502361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cc80ce2b0 0x7f4cc815e0f0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800c7f0 tx=0x7f4cb800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:39.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.469+0000 7f4cc57fa640 1 -- 172.21.15.7:0/1719502361 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8016020 con 0x7f4cc80ce2b0 2024-04-25T10:00:39.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.469+0000 7f4cc57fa640 1 -- 172.21.15.7:0/1719502361 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb800aa50 con 0x7f4cc80ce2b0 2024-04-25T10:00:39.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.469+0000 7f4cc57fa640 1 -- 172.21.15.7:0/1719502361 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb800ae40 con 0x7f4cc80ce2b0 2024-04-25T10:00:39.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.469+0000 7f4ccebab640 1 -- 172.21.15.7:0/1719502361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cc80cab30 con 0x7f4cc80ce2b0 2024-04-25T10:00:39.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.469+0000 7f4ccebab640 1 -- 172.21.15.7:0/1719502361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cc80cb0f0 con 0x7f4cc80ce2b0 2024-04-25T10:00:39.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.470+0000 7f4ccebab640 1 -- 172.21.15.7:0/1719502361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cc8068fd0 con 0x7f4cc80ce2b0 2024-04-25T10:00:39.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.471+0000 7f4cc57fa640 1 -- 172.21.15.7:0/1719502361 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4cb8019020 con 0x7f4cc80ce2b0 2024-04-25T10:00:39.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.471+0000 7f4cc57fa640 1 --2- 172.21.15.7:0/1719502361 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4ca806b500 0x7f4ca806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:39.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.471+0000 7f4cc57fa640 1 -- 172.21.15.7:0/1719502361 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4cb8089f20 con 0x7f4cc80ce2b0 2024-04-25T10:00:39.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.471+0000 7f4ccc947640 1 --2- 172.21.15.7:0/1719502361 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4ca806b500 0x7f4ca806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:39.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.471+0000 7f4ccc947640 1 --2- 172.21.15.7:0/1719502361 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4ca806b500 0x7f4ca806d9c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000aac0 tx=0x7f4cc0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:39.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.475+0000 7f4cc57fa640 1 -- 172.21.15.7:0/1719502361 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4cb8020070 con 0x7f4cc80ce2b0 2024-04-25T10:00:39.665 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-04-25T10:00:39.661+0000 7f26046e9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:00:39.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.693+0000 7f4ccebab640 1 -- 172.21.15.7:0/1719502361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4cc80d16b0 con 0x7f4cc80ce2b0 2024-04-25T10:00:39.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.694+0000 7f4cc57fa640 1 -- 172.21.15.7:0/1719502361 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v53) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4cb8058650 con 0x7f4cc80ce2b0 2024-04-25T10:00:39.698 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T10:00:39.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.696+0000 7f4ccebab640 1 -- 172.21.15.7:0/1719502361 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4ca806b500 msgr2=0x7f4ca806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:39.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.696+0000 7f4ccebab640 1 --2- 172.21.15.7:0/1719502361 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4ca806b500 0x7f4ca806d9c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000aac0 tx=0x7f4cc0008040 comp rx=0 tx=0).stop 2024-04-25T10:00:39.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.696+0000 7f4ccebab640 1 -- 172.21.15.7:0/1719502361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cc80ce2b0 msgr2=0x7f4cc815e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:39.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.696+0000 7f4ccebab640 1 --2- 172.21.15.7:0/1719502361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cc80ce2b0 0x7f4cc815e0f0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800c7f0 tx=0x7f4cb800ccb0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.696+0000 7f4ccebab640 1 -- 172.21.15.7:0/1719502361 shutdown_connections 2024-04-25T10:00:39.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.696+0000 7f4ccebab640 1 --2- 172.21.15.7:0/1719502361 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4ca806b500 0x7f4ca806d9c0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.696+0000 7f4ccebab640 1 --2- 172.21.15.7:0/1719502361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cc815db00 0x7f4cc80c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.696+0000 7f4ccebab640 1 --2- 172.21.15.7:0/1719502361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cc80ce2b0 0x7f4cc815e0f0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.696+0000 7f4ccebab640 1 --2- 172.21.15.7:0/1719502361 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4cc80b53b0 0x7f4cc814f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:39.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.696+0000 7f4ccebab640 1 -- 172.21.15.7:0/1719502361 >> 172.21.15.7:0/1719502361 conn(0x7f4cc8072290 msgr2=0x7f4cc8157b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:39.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.696+0000 7f4ccebab640 1 -- 172.21.15.7:0/1719502361 shutdown_connections 2024-04-25T10:00:39.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:39.696+0000 7f4ccebab640 1 -- 172.21.15.7:0/1719502361 wait complete. 2024-04-25T10:00:39.711 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T10:00:39.711 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:00:39.711 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-04-25T10:00:39.711 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T10:00:39.711 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T10:00:39.711 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T10:00:39.711 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T10:00:39.711 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:00:39.712 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:00:39.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:39.712 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-04-25T10:00:39.727 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:00:39.727 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:00:39.727 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:00:39.727 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:00:39.727 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-04-25T10:00:39.728 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:00:39.728 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:00:39.728 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-04-25T10:00:39.728 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-04-25T10:00:39.728 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:00:39.728 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-04-25T10:00:39.728 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-04-25T10:00:39.728 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:00:39.728 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-04-25T10:00:39.728 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-04-25T10:00:39.728 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T10:00:39.728 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42360sec preferred_lft 42360sec 2024-04-25T10:00:39.728 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link noprefixroute 2024-04-25T10:00:39.728 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:00:39.729 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:00:39.729 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-04-25T10:00:39.729 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-04-25T10:00:39.729 INFO:teuthology.orchestra.run.smithi007.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T10:00:39.729 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 26:0c:99:53:12:e3 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:00:39.729 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T10:00:39.729 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:00:39.729 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::50aa:55ff:febc:5f67/64 scope link 2024-04-25T10:00:39.729 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:00:39.729 INFO:teuthology.orchestra.run.smithi007.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:00:39.729 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 6e:99:f1:00:a9:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:00:39.729 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6c99:f1ff:fe00:a95e/64 scope link 2024-04-25T10:00:39.729 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:00:39.730 INFO:teuthology.orchestra.run.smithi007.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:00:39.730 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 26:0c:99:53:12:e3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T10:00:39.730 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::240c:99ff:fe53:12e3/64 scope link 2024-04-25T10:00:39.730 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:00:39.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:39.730 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:00:39.790 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-04-25T10:00:39.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:39.791 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-04-25T10:00:39.847 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-04-25T10:00:39.847 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:00:39.847 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T10:00:39.847 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T10:00:39.847 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:00:39.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:39.848 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-04-25T10:00:39.848 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-25T10:00:39.848 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:00:39.848 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:00:39.848 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:00:39.848 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-25T10:00:39.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:39.932 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-04-25T10:00:39.947 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T10:00:39.947 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T10:00:39.948 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:00:39.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:39.948 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-04-25T10:00:40.012 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:00:40.012 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T10:00:40.068 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:00:40.068 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:00:40.069 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:00:40.124 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T10:00:40.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:40.124 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:00:40.206 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:00:40.206 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T10:00:40.206 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T10:00:40.215 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:00:40.215 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T10:00:40.215 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T10:00:40.215 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T10:00:40.215 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T10:00:40.220 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:00:40.220 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T10:00:40.220 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T10:00:40.220 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T10:00:40.221 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T10:00:40.221 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790" 2024-04-25T10:00:40.221 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790:/ 2024-04-25T10:00:40.221 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c03d0745-5946-49c3-ad88-1165c5b68b4e" will pass to kernel 2024-04-25T10:00:40.221 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T10:00:40.221 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-04-25T10:00:40.222 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T10:00:40.222 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T10:00:40.222 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T10:00:40.225 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T10:00:40.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:40.225 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:00:40.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:40.288 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:00:40.348 INFO:teuthology.orchestra.run.smithi007.stdout:client6904 2024-04-25T10:00:40.348 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:00:40.348 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:00:40.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:40.404 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir) 2024-04-25T10:00:40.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:40.464 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir/file) 2024-04-25T10:00:40.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:40.520 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-04-25T10:00:40.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:40.577 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln dir/file testdir/hardlink) 2024-04-25T10:00:40.636 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T10:00:40.636 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T10:00:40.636 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T10:00:40.636 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T10:00:40.636 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir").st_ino) 2024-04-25T10:00:40.637 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T10:00:40.745 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627776 2024-04-25T10:00:40.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:00:40.754 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:00:40.754 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:00:40.810 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:00:40.810 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:00:40.866 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:00:41.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.002+0000 7f052824d640 1 Processor -- start 2024-04-25T10:00:41.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.002+0000 7f052824d640 1 -- start start 2024-04-25T10:00:41.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.003+0000 7f052824d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f05200b5e60 0x7f052006bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:41.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.003+0000 7f052824d640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f052006cd00 con 0x7f052015dd00 2024-04-25T10:00:41.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.003+0000 7f052824d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05200d1ca0 con 0x7f05200b6a40 2024-04-25T10:00:41.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.003+0000 7f052824d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f052015e0e0 con 0x7f05200b5e60 2024-04-25T10:00:41.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.003+0000 7f0525fe9640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f052015dd00 0x7f05200b5750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45324/0 (socket says 172.21.15.7:45324) 2024-04-25T10:00:41.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.003+0000 7f0525fe9640 1 -- 172.21.15.7:0/911345026 learned_addr learned my addr 172.21.15.7:0/911345026 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:41.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.003+0000 7f0524fe7640 1 -- 172.21.15.7:0/911345026 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2696354992 0 0) 0x7f052006cd00 con 0x7f052015dd00 2024-04-25T10:00:41.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.003+0000 7f0524fe7640 1 -- 172.21.15.7:0/911345026 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f050c003520 con 0x7f052015dd00 2024-04-25T10:00:41.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.003+0000 7f05257e8640 1 --2- 172.21.15.7:0/911345026 >> v2:172.21.15.55:3300/0 conn(0x7f05200b5e60 0x7f052006bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:41.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.003+0000 7f0524fe7640 1 -- 172.21.15.7:0/911345026 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1679956318 0 0) 0x7f050c003520 con 0x7f052015dd00 2024-04-25T10:00:41.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.003+0000 7f0524fe7640 1 -- 172.21.15.7:0/911345026 >> v2:172.21.15.55:3300/0 conn(0x7f05200b5e60 msgr2=0x7f052006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:41.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.003+0000 7f0524fe7640 1 --2- 172.21.15.7:0/911345026 >> v2:172.21.15.55:3300/0 conn(0x7f05200b5e60 0x7f052006bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.003+0000 7f0524fe7640 1 -- 172.21.15.7:0/911345026 >> v1:172.21.15.55:6789/0 conn(0x7f05200b6a40 legacy=0x7f052006c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:41.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.003+0000 7f0524fe7640 1 -- 172.21.15.7:0/911345026 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05200d1f80 con 0x7f052015dd00 2024-04-25T10:00:41.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.003+0000 7f0524fe7640 1 -- 172.21.15.7:0/911345026 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f051c001670 con 0x7f052015dd00 2024-04-25T10:00:41.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.003+0000 7f0524fe7640 1 -- 172.21.15.7:0/911345026 >> v1:172.21.15.7:6789/0 conn(0x7f052015dd00 legacy=0x7f05200b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:41.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.004+0000 7f0524fe7640 1 --2- 172.21.15.7:0/911345026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f050c0039b0 0x7f050c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:41.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.004+0000 7f0524fe7640 1 --2- 172.21.15.7:0/911345026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f050c004800 0x7f050c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:41.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.004+0000 7f0524fe7640 1 --2- 172.21.15.7:0/911345026 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f050c0051c0 0x7f050c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:41.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.004+0000 7f0524fe7640 1 -- 172.21.15.7:0/911345026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052015e0e0 con 0x7f050c004800 2024-04-25T10:00:41.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.004+0000 7f0524fe7640 1 -- 172.21.15.7:0/911345026 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050c00c060 con 0x7f050c0039b0 2024-04-25T10:00:41.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.004+0000 7f0524fe7640 1 -- 172.21.15.7:0/911345026 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050c00c260 con 0x7f050c0051c0 2024-04-25T10:00:41.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.004+0000 7f05257e8640 1 --2- 172.21.15.7:0/911345026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f050c004800 0x7f050c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:41.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.004+0000 7f0525fe9640 1 --2- 172.21.15.7:0/911345026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f050c0039b0 0x7f050c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:41.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.004+0000 7f05267ea640 1 --2- 172.21.15.7:0/911345026 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f050c0051c0 0x7f050c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:41.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.004+0000 7f05257e8640 1 -- 172.21.15.7:0/911345026 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f050c0051c0 msgr2=0x7f050c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:41.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.004+0000 7f05257e8640 1 --2- 172.21.15.7:0/911345026 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f050c0051c0 0x7f050c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.004+0000 7f05257e8640 1 -- 172.21.15.7:0/911345026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f050c0039b0 msgr2=0x7f050c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:41.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.004+0000 7f05257e8640 1 --2- 172.21.15.7:0/911345026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f050c0039b0 0x7f050c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.004+0000 7f05257e8640 1 -- 172.21.15.7:0/911345026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050c003520 con 0x7f050c004800 2024-04-25T10:00:41.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.004+0000 7f05267ea640 1 -- 172.21.15.7:0/911345026 reap_dead start 2024-04-25T10:00:41.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.005+0000 7f05257e8640 1 --2- 172.21.15.7:0/911345026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f050c004800 0x7f050c004c80 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f0510009ac0 tx=0x7f050c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff9ee0be312cc2c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:41.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.005+0000 7f0524fe7640 1 -- 172.21.15.7:0/911345026 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0510036070 con 0x7f050c004800 2024-04-25T10:00:41.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.005+0000 7f0524fe7640 1 -- 172.21.15.7:0/911345026 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0510031400 con 0x7f050c004800 2024-04-25T10:00:41.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.005+0000 7f0524fe7640 1 -- 172.21.15.7:0/911345026 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0510009690 con 0x7f050c004800 2024-04-25T10:00:41.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.005+0000 7f052824d640 1 -- 172.21.15.7:0/911345026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f050c004800 msgr2=0x7f050c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:41.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.005+0000 7f052824d640 1 --2- 172.21.15.7:0/911345026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f050c004800 0x7f050c004c80 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f0510009ac0 tx=0x7f050c005830 comp rx=0 tx=0).stop 2024-04-25T10:00:41.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.006+0000 7f052824d640 1 -- 172.21.15.7:0/911345026 shutdown_connections 2024-04-25T10:00:41.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.006+0000 7f052824d640 1 --2- 172.21.15.7:0/911345026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f050c004800 0x7f050c004c80 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.006+0000 7f052824d640 1 -- 172.21.15.7:0/911345026 >> 172.21.15.7:0/911345026 conn(0x7f05200d07b0 msgr2=0x7f05200d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:41.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.006+0000 7f052824d640 1 -- 172.21.15.7:0/911345026 shutdown_connections 2024-04-25T10:00:41.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.006+0000 7f052824d640 1 -- 172.21.15.7:0/911345026 wait complete. 2024-04-25T10:00:41.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.007+0000 7f052824d640 1 Processor -- start 2024-04-25T10:00:41.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.007+0000 7f052824d640 1 -- start start 2024-04-25T10:00:41.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.007+0000 7f052824d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f050c004800 0x7f052014b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:41.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.008+0000 7f052824d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f052015a120 0x7f05200cb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:41.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.008+0000 7f052824d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f052015b880 0x7f052015bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:41.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.008+0000 7f052824d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05200b5750 con 0x7f052015a120 2024-04-25T10:00:41.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.008+0000 7f052824d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052006cfe0 con 0x7f052015b880 2024-04-25T10:00:41.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.008+0000 7f052824d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05200b58d0 con 0x7f050c004800 2024-04-25T10:00:41.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.008+0000 7f05257e8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f052015a120 0x7f05200cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:41.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.008+0000 7f05257e8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f052015a120 0x7f05200cb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49554/0 (socket says 172.21.15.7:49554) 2024-04-25T10:00:41.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.008+0000 7f05257e8640 1 -- 172.21.15.7:0/2579392084 learned_addr learned my addr 172.21.15.7:0/2579392084 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:41.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.008+0000 7f05257e8640 1 -- 172.21.15.7:0/2579392084 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f050c004800 msgr2=0x7f052014b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:41.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.008+0000 7f05267ea640 1 --2- 172.21.15.7:0/2579392084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f052015b880 0x7f052015bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:41.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.008+0000 7f0525fe9640 1 --2- 172.21.15.7:0/2579392084 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f050c004800 0x7f052014b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:41.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.008+0000 7f05257e8640 1 --2- 172.21.15.7:0/2579392084 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f050c004800 0x7f052014b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.008+0000 7f05257e8640 1 -- 172.21.15.7:0/2579392084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f052015b880 msgr2=0x7f052015bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:41.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.008+0000 7f05257e8640 1 --2- 172.21.15.7:0/2579392084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f052015b880 0x7f052015bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.008+0000 7f05257e8640 1 -- 172.21.15.7:0/2579392084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052015a7e0 con 0x7f052015a120 2024-04-25T10:00:41.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.008+0000 7f05257e8640 1 --2- 172.21.15.7:0/2579392084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f052015a120 0x7f05200cb580 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f051002abb0 tx=0x7f0510004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:41.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.008+0000 7f05167fc640 1 -- 172.21.15.7:0/2579392084 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051003f020 con 0x7f052015a120 2024-04-25T10:00:41.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.008+0000 7f05167fc640 1 -- 172.21.15.7:0/2579392084 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0510037040 con 0x7f052015a120 2024-04-25T10:00:41.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.008+0000 7f05167fc640 1 -- 172.21.15.7:0/2579392084 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0510036070 con 0x7f052015a120 2024-04-25T10:00:41.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.008+0000 7f052824d640 1 -- 172.21.15.7:0/2579392084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f052015aac0 con 0x7f052015a120 2024-04-25T10:00:41.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.008+0000 7f052824d640 1 -- 172.21.15.7:0/2579392084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f052015b080 con 0x7f052015a120 2024-04-25T10:00:41.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.009+0000 7f052824d640 1 -- 172.21.15.7:0/2579392084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0520068fd0 con 0x7f052015a120 2024-04-25T10:00:41.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.010+0000 7f05167fc640 1 -- 172.21.15.7:0/2579392084 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0510042020 con 0x7f052015a120 2024-04-25T10:00:41.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.010+0000 7f05167fc640 1 --2- 172.21.15.7:0/2579392084 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f050406b500 0x7f050406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:41.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.010+0000 7f05167fc640 1 -- 172.21.15.7:0/2579392084 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f05100aa7f0 con 0x7f052015a120 2024-04-25T10:00:41.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.010+0000 7f0525fe9640 1 --2- 172.21.15.7:0/2579392084 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f050406b500 0x7f050406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:41.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.011+0000 7f0525fe9640 1 --2- 172.21.15.7:0/2579392084 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f050406b500 0x7f050406d9c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0520050700 tx=0x7f051c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:41.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.014+0000 7f05167fc640 1 -- 172.21.15.7:0/2579392084 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0510049020 con 0x7f052015a120 2024-04-25T10:00:41.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.195+0000 7f052824d640 1 -- 172.21.15.7:0/2579392084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05200d1620 con 0x7f052015a120 2024-04-25T10:00:41.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.196+0000 7f05167fc640 1 -- 172.21.15.7:0/2579392084 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+16789 (secure 0 0 0) 0x7f0510079500 con 0x7f052015a120 2024-04-25T10:00:41.201 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:00:41.201 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":88,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:00:35.690122+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:00:32.330930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T10:00:33.030728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:00:41.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.198+0000 7f052824d640 1 -- 172.21.15.7:0/2579392084 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f050406b500 msgr2=0x7f050406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:41.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.198+0000 7f052824d640 1 --2- 172.21.15.7:0/2579392084 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f050406b500 0x7f050406d9c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0520050700 tx=0x7f051c009040 comp rx=0 tx=0).stop 2024-04-25T10:00:41.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.198+0000 7f052824d640 1 -- 172.21.15.7:0/2579392084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f052015a120 msgr2=0x7f05200cb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:41.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.198+0000 7f052824d640 1 --2- 172.21.15.7:0/2579392084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f052015a120 0x7f05200cb580 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f051002abb0 tx=0x7f0510004730 comp rx=0 tx=0).stop 2024-04-25T10:00:41.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.198+0000 7f052824d640 1 -- 172.21.15.7:0/2579392084 shutdown_connections 2024-04-25T10:00:41.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.198+0000 7f052824d640 1 --2- 172.21.15.7:0/2579392084 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f050406b500 0x7f050406d9c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.198+0000 7f052824d640 1 --2- 172.21.15.7:0/2579392084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f052015b880 0x7f052015bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.198+0000 7f052824d640 1 --2- 172.21.15.7:0/2579392084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f052015a120 0x7f05200cb580 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.198+0000 7f052824d640 1 --2- 172.21.15.7:0/2579392084 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f050c004800 0x7f052014b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.198+0000 7f052824d640 1 -- 172.21.15.7:0/2579392084 >> 172.21.15.7:0/2579392084 conn(0x7f05200d07b0 msgr2=0x7f05200b6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:41.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.198+0000 7f052824d640 1 -- 172.21.15.7:0/2579392084 shutdown_connections 2024-04-25T10:00:41.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.198+0000 7f052824d640 1 -- 172.21.15.7:0/2579392084 wait complete. 2024-04-25T10:00:41.213 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:00:32.330930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:00:33.030728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:00:41.213 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:00:41.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.313+0000 7f0eca129640 1 Processor -- start 2024-04-25T10:00:41.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.313+0000 7f0eca129640 1 -- start start 2024-04-25T10:00:41.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.314+0000 7f0eca129640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0ec415b7a0 0x7f0ec40b1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:41.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.314+0000 7f0eca129640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ec406ab60 0x7f0ec406afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:41.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.314+0000 7f0eca129640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec40b1e40 con 0x7f0ec415f430 2024-04-25T10:00:41.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.314+0000 7f0eca129640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec406b500 con 0x7f0ec415b7a0 2024-04-25T10:00:41.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.314+0000 7f0eca129640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec40d13e0 con 0x7f0ec406ab60 2024-04-25T10:00:41.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.314+0000 7f0ec37fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0ec415b7a0 0x7f0ec40b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:41.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.314+0000 7f0ec3fff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0ec415f430 0x7f0ec415f8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45330/0 (socket says 172.21.15.7:45330) 2024-04-25T10:00:41.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.314+0000 7f0ec3fff640 1 -- 172.21.15.7:0/1290321482 learned_addr learned my addr 172.21.15.7:0/1290321482 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:41.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.314+0000 7f0ec37fe640 1 -- 172.21.15.7:0/1290321482 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ec406ab60 msgr2=0x7f0ec406afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:41.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.314+0000 7f0ec2ffd640 1 --2- 172.21.15.7:0/1290321482 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ec406ab60 0x7f0ec406afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:41.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.315+0000 7f0ec27fc640 1 -- 172.21.15.7:0/1290321482 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 647152785 0 0) 0x7f0ebc001490 con 0x7f0ec415f430 2024-04-25T10:00:41.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.315+0000 7f0ec37fe640 1 --2- 172.21.15.7:0/1290321482 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ec406ab60 0x7f0ec406afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.315+0000 7f0ec37fe640 1 -- 172.21.15.7:0/1290321482 >> v1:172.21.15.7:6789/0 conn(0x7f0ec415f430 legacy=0x7f0ec415f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:41.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.315+0000 7f0ec37fe640 1 -- 172.21.15.7:0/1290321482 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec40d0860 con 0x7f0ec415b7a0 2024-04-25T10:00:41.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.315+0000 7f0ec2ffd640 1 --2- 172.21.15.7:0/1290321482 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ec406ab60 0x7f0ec406afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:00:41.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.315+0000 7f0ec37fe640 1 --2- 172.21.15.7:0/1290321482 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ec415b7a0 0x7f0ec40b1900 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f0eb40097a0 tx=0x7f0eb402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aa0f3e86f58d473 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:41.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.315+0000 7f0ec27fc640 1 -- 172.21.15.7:0/1290321482 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4037070 con 0x7f0ec415b7a0 2024-04-25T10:00:41.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.315+0000 7f0ec27fc640 1 -- 172.21.15.7:0/1290321482 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb4032440 con 0x7f0ec415b7a0 2024-04-25T10:00:41.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.315+0000 7f0ec27fc640 1 -- 172.21.15.7:0/1290321482 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4032810 con 0x7f0ec415b7a0 2024-04-25T10:00:41.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.316+0000 7f0eca129640 1 -- 172.21.15.7:0/1290321482 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ec415b7a0 msgr2=0x7f0ec40b1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:41.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.316+0000 7f0eca129640 1 --2- 172.21.15.7:0/1290321482 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ec415b7a0 0x7f0ec40b1900 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f0eb40097a0 tx=0x7f0eb402a180 comp rx=0 tx=0).stop 2024-04-25T10:00:41.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.316+0000 7f0eca129640 1 -- 172.21.15.7:0/1290321482 shutdown_connections 2024-04-25T10:00:41.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.316+0000 7f0eca129640 1 --2- 172.21.15.7:0/1290321482 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ec406ab60 0x7f0ec406afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.316+0000 7f0eca129640 1 --2- 172.21.15.7:0/1290321482 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ec415b7a0 0x7f0ec40b1900 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.316+0000 7f0eca129640 1 -- 172.21.15.7:0/1290321482 >> 172.21.15.7:0/1290321482 conn(0x7f0ec40725e0 msgr2=0x7f0ec40999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:41.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.316+0000 7f0eca129640 1 -- 172.21.15.7:0/1290321482 shutdown_connections 2024-04-25T10:00:41.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.316+0000 7f0eca129640 1 -- 172.21.15.7:0/1290321482 wait complete. 2024-04-25T10:00:41.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.317+0000 7f0eca129640 1 Processor -- start 2024-04-25T10:00:41.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.317+0000 7f0eca129640 1 -- start start 2024-04-25T10:00:41.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.318+0000 7f0eca129640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ec406ab60 0x7f0ec414cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:41.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.318+0000 7f0eca129640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ec415b7a0 0x7f0ec40b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:41.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.318+0000 7f0eca129640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ec415f430 0x7f0ec40add10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:41.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.318+0000 7f0eca129640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec40d1100 con 0x7f0ec415f430 2024-04-25T10:00:41.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.318+0000 7f0eca129640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec40d0e20 con 0x7f0ec415b7a0 2024-04-25T10:00:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.318+0000 7f0eca129640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec40d04f0 con 0x7f0ec406ab60 2024-04-25T10:00:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.318+0000 7f0ec3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ec415f430 0x7f0ec40add10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.318+0000 7f0ec3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ec415f430 0x7f0ec40add10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49560/0 (socket says 172.21.15.7:49560) 2024-04-25T10:00:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.318+0000 7f0ec3fff640 1 -- 172.21.15.7:0/3357178927 learned_addr learned my addr 172.21.15.7:0/3357178927 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.318+0000 7f0ec37fe640 1 --2- 172.21.15.7:0/3357178927 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ec406ab60 0x7f0ec414cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.318+0000 7f0ec2ffd640 1 --2- 172.21.15.7:0/3357178927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ec415b7a0 0x7f0ec40b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.318+0000 7f0ec3fff640 1 -- 172.21.15.7:0/3357178927 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ec406ab60 msgr2=0x7f0ec414cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.318+0000 7f0ec3fff640 1 --2- 172.21.15.7:0/3357178927 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ec406ab60 0x7f0ec414cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.318+0000 7f0ec3fff640 1 -- 172.21.15.7:0/3357178927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ec415b7a0 msgr2=0x7f0ec40b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.318+0000 7f0ec3fff640 1 --2- 172.21.15.7:0/3357178927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ec415b7a0 0x7f0ec40b4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.318+0000 7f0ec3fff640 1 -- 172.21.15.7:0/3357178927 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec40b3260 con 0x7f0ec415f430 2024-04-25T10:00:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.318+0000 7f0ec2ffd640 1 --2- 172.21.15.7:0/3357178927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ec415b7a0 0x7f0ec40b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:00:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.319+0000 7f0ec3fff640 1 --2- 172.21.15.7:0/3357178927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ec415f430 0x7f0ec40add10 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc00c730 tx=0x7f0ebc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:41.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.319+0000 7f0eabfff640 1 -- 172.21.15.7:0/3357178927 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc018070 con 0x7f0ec415f430 2024-04-25T10:00:41.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.319+0000 7f0eabfff640 1 -- 172.21.15.7:0/3357178927 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ebc00ce40 con 0x7f0ec415f430 2024-04-25T10:00:41.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.319+0000 7f0eca129640 1 -- 172.21.15.7:0/3357178927 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec40b3540 con 0x7f0ec415f430 2024-04-25T10:00:41.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.319+0000 7f0eabfff640 1 -- 172.21.15.7:0/3357178927 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc00a860 con 0x7f0ec415f430 2024-04-25T10:00:41.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.319+0000 7f0eca129640 1 -- 172.21.15.7:0/3357178927 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec40b3b00 con 0x7f0ec415f430 2024-04-25T10:00:41.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.320+0000 7f0eca129640 1 -- 172.21.15.7:0/3357178927 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec4068f60 con 0x7f0ec415f430 2024-04-25T10:00:41.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.320+0000 7f0eabfff640 1 -- 172.21.15.7:0/3357178927 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0ebc01b070 con 0x7f0ec415f430 2024-04-25T10:00:41.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.321+0000 7f0eabfff640 1 --2- 172.21.15.7:0/3357178927 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0eb006b4d0 0x7f0eb006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:41.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.321+0000 7f0eabfff640 1 -- 172.21.15.7:0/3357178927 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0ebc089940 con 0x7f0ec415f430 2024-04-25T10:00:41.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.321+0000 7f0ec37fe640 1 --2- 172.21.15.7:0/3357178927 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0eb006b4d0 0x7f0eb006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:41.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.321+0000 7f0ec37fe640 1 --2- 172.21.15.7:0/3357178927 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0eb006b4d0 0x7f0eb006d990 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4034000 tx=0x7f0eb402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:41.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.325+0000 7f0eabfff640 1 -- 172.21.15.7:0/3357178927 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0ec40b1e40 con 0x7f0ec415f430 2024-04-25T10:00:41.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.503+0000 7f0eca129640 1 -- 172.21.15.7:0/3357178927 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0ec40b6500 con 0x7f0ec415f430 2024-04-25T10:00:41.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.504+0000 7f0eabfff640 1 -- 172.21.15.7:0/3357178927 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0ebc058630 con 0x7f0ec415f430 2024-04-25T10:00:41.508 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T10:00:41.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.505+0000 7f0eca129640 1 -- 172.21.15.7:0/3357178927 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0eb006b4d0 msgr2=0x7f0eb006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:41.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.505+0000 7f0eca129640 1 --2- 172.21.15.7:0/3357178927 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0eb006b4d0 0x7f0eb006d990 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4034000 tx=0x7f0eb402e000 comp rx=0 tx=0).stop 2024-04-25T10:00:41.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.505+0000 7f0eca129640 1 -- 172.21.15.7:0/3357178927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ec415f430 msgr2=0x7f0ec40add10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:41.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.505+0000 7f0eca129640 1 --2- 172.21.15.7:0/3357178927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ec415f430 0x7f0ec40add10 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc00c730 tx=0x7f0ebc00cbf0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.505+0000 7f0eca129640 1 -- 172.21.15.7:0/3357178927 shutdown_connections 2024-04-25T10:00:41.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.505+0000 7f0eca129640 1 --2- 172.21.15.7:0/3357178927 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0eb006b4d0 0x7f0eb006d990 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.505+0000 7f0eca129640 1 --2- 172.21.15.7:0/3357178927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ec415f430 0x7f0ec40add10 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.506+0000 7f0eca129640 1 --2- 172.21.15.7:0/3357178927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ec415b7a0 0x7f0ec40b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.506+0000 7f0eca129640 1 --2- 172.21.15.7:0/3357178927 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ec406ab60 0x7f0ec414cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.506+0000 7f0eca129640 1 -- 172.21.15.7:0/3357178927 >> 172.21.15.7:0/3357178927 conn(0x7f0ec40725e0 msgr2=0x7f0ec415bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:41.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.506+0000 7f0eca129640 1 -- 172.21.15.7:0/3357178927 shutdown_connections 2024-04-25T10:00:41.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.506+0000 7f0eca129640 1 -- 172.21.15.7:0/3357178927 wait complete. 2024-04-25T10:00:41.521 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:00:41.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.622+0000 7ff06ebed640 1 Processor -- start 2024-04-25T10:00:41.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.622+0000 7ff06ebed640 1 -- start start 2024-04-25T10:00:41.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.622+0000 7ff06ebed640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff06815f1c0 0x7ff06815eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:41.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.622+0000 7ff06ebed640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0680ced10 con 0x7ff0680ce830 2024-04-25T10:00:41.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.622+0000 7ff06ebed640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0680d1b40 con 0x7ff0680d3760 2024-04-25T10:00:41.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.622+0000 7ff06ebed640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0680ce380 con 0x7ff06815f1c0 2024-04-25T10:00:41.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.623+0000 7ff067fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff06815f1c0 0x7ff06815eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:41.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.623+0000 7ff06d18a640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff0680ce830 0x7ff0680b2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45334/0 (socket says 172.21.15.7:45334) 2024-04-25T10:00:41.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.623+0000 7ff06d18a640 1 -- 172.21.15.7:0/305780996 learned_addr learned my addr 172.21.15.7:0/305780996 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:41.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.623+0000 7ff067fff640 1 -- 172.21.15.7:0/305780996 >> v1:172.21.15.55:6789/0 conn(0x7ff0680d3760 legacy=0x7ff0680d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:41.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.623+0000 7ff067fff640 1 -- 172.21.15.7:0/305780996 >> v1:172.21.15.7:6789/0 conn(0x7ff0680ce830 legacy=0x7ff0680b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:41.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.623+0000 7ff067fff640 1 -- 172.21.15.7:0/305780996 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0680d1e20 con 0x7ff06815f1c0 2024-04-25T10:00:41.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.623+0000 7ff0677fe640 1 -- 172.21.15.7:0/305780996 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2407569637 0 0) 0x7ff0680ced10 con 0x7ff0680ce830 2024-04-25T10:00:41.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.624+0000 7ff067fff640 1 --2- 172.21.15.7:0/305780996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff06815f1c0 0x7ff06815eac0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7ff0540097a0 tx=0x7ff05402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=996c7e82de1c03c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:41.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.624+0000 7ff0677fe640 1 -- 172.21.15.7:0/305780996 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff054037070 con 0x7ff06815f1c0 2024-04-25T10:00:41.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.624+0000 7ff0677fe640 1 -- 172.21.15.7:0/305780996 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff054032440 con 0x7ff06815f1c0 2024-04-25T10:00:41.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.624+0000 7ff0677fe640 1 -- 172.21.15.7:0/305780996 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff054032810 con 0x7ff06815f1c0 2024-04-25T10:00:41.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.624+0000 7ff06ebed640 1 -- 172.21.15.7:0/305780996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff06815f1c0 msgr2=0x7ff06815eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:41.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.624+0000 7ff06ebed640 1 --2- 172.21.15.7:0/305780996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff06815f1c0 0x7ff06815eac0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7ff0540097a0 tx=0x7ff05402a230 comp rx=0 tx=0).stop 2024-04-25T10:00:41.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.624+0000 7ff06ebed640 1 -- 172.21.15.7:0/305780996 shutdown_connections 2024-04-25T10:00:41.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.624+0000 7ff06ebed640 1 --2- 172.21.15.7:0/305780996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff06815f1c0 0x7ff06815eac0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.624+0000 7ff06ebed640 1 -- 172.21.15.7:0/305780996 >> 172.21.15.7:0/305780996 conn(0x7ff068072680 msgr2=0x7ff068072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:41.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.624+0000 7ff06ebed640 1 -- 172.21.15.7:0/305780996 shutdown_connections 2024-04-25T10:00:41.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.624+0000 7ff06ebed640 1 -- 172.21.15.7:0/305780996 wait complete. 2024-04-25T10:00:41.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.625+0000 7ff06ebed640 1 Processor -- start 2024-04-25T10:00:41.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.626+0000 7ff06ebed640 1 -- start start 2024-04-25T10:00:41.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.626+0000 7ff06ebed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0680ce830 0x7ff0680d2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:41.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.626+0000 7ff06ebed640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0680d3760 0x7ff0680b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:41.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.626+0000 7ff06ebed640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff06815f1c0 0x7ff0680b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:41.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.626+0000 7ff06ebed640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0680d2190 con 0x7ff0680ce830 2024-04-25T10:00:41.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.626+0000 7ff06ebed640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06815f000 con 0x7ff06815f1c0 2024-04-25T10:00:41.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.626+0000 7ff06ebed640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0680b2950 con 0x7ff0680d3760 2024-04-25T10:00:41.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.626+0000 7ff06c989640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0680ce830 0x7ff0680d2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:41.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.627+0000 7ff06c989640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0680ce830 0x7ff0680d2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49578/0 (socket says 172.21.15.7:49578) 2024-04-25T10:00:41.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.627+0000 7ff06c989640 1 -- 172.21.15.7:0/1009459550 learned_addr learned my addr 172.21.15.7:0/1009459550 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:41.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.627+0000 7ff06d18a640 1 --2- 172.21.15.7:0/1009459550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff06815f1c0 0x7ff0680b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:41.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.627+0000 7ff067fff640 1 --2- 172.21.15.7:0/1009459550 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0680d3760 0x7ff0680b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:41.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.627+0000 7ff06c989640 1 -- 172.21.15.7:0/1009459550 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0680d3760 msgr2=0x7ff0680b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:41.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.627+0000 7ff06c989640 1 --2- 172.21.15.7:0/1009459550 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0680d3760 0x7ff0680b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.627+0000 7ff06c989640 1 -- 172.21.15.7:0/1009459550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff06815f1c0 msgr2=0x7ff0680b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:41.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.627+0000 7ff06c989640 1 --2- 172.21.15.7:0/1009459550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff06815f1c0 0x7ff0680b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.627+0000 7ff06c989640 1 -- 172.21.15.7:0/1009459550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0680b4ea0 con 0x7ff0680ce830 2024-04-25T10:00:41.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.627+0000 7ff06d18a640 1 --2- 172.21.15.7:0/1009459550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff06815f1c0 0x7ff0680b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:00:41.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.627+0000 7ff06c989640 1 --2- 172.21.15.7:0/1009459550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0680ce830 0x7ff0680d2790 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7ff05c00c450 tx=0x7ff05c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:41.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.627+0000 7ff0657fa640 1 -- 172.21.15.7:0/1009459550 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05c0052d0 con 0x7ff0680ce830 2024-04-25T10:00:41.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.627+0000 7ff0657fa640 1 -- 172.21.15.7:0/1009459550 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05c005470 con 0x7ff0680ce830 2024-04-25T10:00:41.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.627+0000 7ff06ebed640 1 -- 172.21.15.7:0/1009459550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0680b5180 con 0x7ff0680ce830 2024-04-25T10:00:41.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.627+0000 7ff0657fa640 1 -- 172.21.15.7:0/1009459550 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05c012870 con 0x7ff0680ce830 2024-04-25T10:00:41.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.627+0000 7ff06ebed640 1 -- 172.21.15.7:0/1009459550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0680b5740 con 0x7ff0680ce830 2024-04-25T10:00:41.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.628+0000 7ff06ebed640 1 -- 172.21.15.7:0/1009459550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff068068f60 con 0x7ff0680ce830 2024-04-25T10:00:41.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.629+0000 7ff0657fa640 1 -- 172.21.15.7:0/1009459550 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff05c012a10 con 0x7ff0680ce830 2024-04-25T10:00:41.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.629+0000 7ff0657fa640 1 --2- 172.21.15.7:0/1009459550 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff04c06b4d0 0x7ff04c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:41.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.629+0000 7ff0657fa640 1 -- 172.21.15.7:0/1009459550 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff05c089f50 con 0x7ff0680ce830 2024-04-25T10:00:41.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.629+0000 7ff067fff640 1 --2- 172.21.15.7:0/1009459550 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff04c06b4d0 0x7ff04c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:41.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.630+0000 7ff067fff640 1 --2- 172.21.15.7:0/1009459550 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff04c06b4d0 0x7ff04c06d990 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff054034000 tx=0x7ff05402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:41.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.634+0000 7ff0657fa640 1 -- 172.21.15.7:0/1009459550 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff05c058cd0 con 0x7ff0680ce830 2024-04-25T10:00:41.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.815+0000 7ff06ebed640 1 -- 172.21.15.7:0/1009459550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff0680ce610 con 0x7ff0680ce830 2024-04-25T10:00:41.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.816+0000 7ff0657fa640 1 -- 172.21.15.7:0/1009459550 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff05c0585d0 con 0x7ff0680ce830 2024-04-25T10:00:41.820 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T10:00:41.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.818+0000 7ff06ebed640 1 -- 172.21.15.7:0/1009459550 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff04c06b4d0 msgr2=0x7ff04c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:41.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.818+0000 7ff06ebed640 1 --2- 172.21.15.7:0/1009459550 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff04c06b4d0 0x7ff04c06d990 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff054034000 tx=0x7ff05402e000 comp rx=0 tx=0).stop 2024-04-25T10:00:41.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.818+0000 7ff06ebed640 1 -- 172.21.15.7:0/1009459550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0680ce830 msgr2=0x7ff0680d2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:41.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.818+0000 7ff06ebed640 1 --2- 172.21.15.7:0/1009459550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0680ce830 0x7ff0680d2790 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7ff05c00c450 tx=0x7ff05c00c910 comp rx=0 tx=0).stop 2024-04-25T10:00:41.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.818+0000 7ff06ebed640 1 -- 172.21.15.7:0/1009459550 shutdown_connections 2024-04-25T10:00:41.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.818+0000 7ff06ebed640 1 --2- 172.21.15.7:0/1009459550 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff04c06b4d0 0x7ff04c06d990 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.818+0000 7ff06ebed640 1 --2- 172.21.15.7:0/1009459550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff06815f1c0 0x7ff0680b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.818+0000 7ff06ebed640 1 --2- 172.21.15.7:0/1009459550 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0680d3760 0x7ff0680b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.818+0000 7ff06ebed640 1 --2- 172.21.15.7:0/1009459550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0680ce830 0x7ff0680d2790 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.818+0000 7ff06ebed640 1 -- 172.21.15.7:0/1009459550 >> 172.21.15.7:0/1009459550 conn(0x7ff068072680 msgr2=0x7ff0680d3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:41.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.818+0000 7ff06ebed640 1 -- 172.21.15.7:0/1009459550 shutdown_connections 2024-04-25T10:00:41.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.818+0000 7ff06ebed640 1 -- 172.21.15.7:0/1009459550 wait complete. 2024-04-25T10:00:41.833 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:00:41.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.932+0000 7f1e9aa6f640 1 Processor -- start 2024-04-25T10:00:41.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.932+0000 7f1e9aa6f640 1 -- start start 2024-04-25T10:00:41.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.933+0000 7f1e9aa6f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1e9415d990 0x7f1e940b1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:41.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.933+0000 7f1e9aa6f640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e940cbcb0 con 0x7f1e940b29c0 2024-04-25T10:00:41.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.933+0000 7f1e9aa6f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e940b1df0 con 0x7f1e940d1c90 2024-04-25T10:00:41.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.933+0000 7f1e9aa6f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e940b20d0 con 0x7f1e9415d990 2024-04-25T10:00:41.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.933+0000 7f1e93fff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1e940b29c0 0x7f1e940d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45346/0 (socket says 172.21.15.7:45346) 2024-04-25T10:00:41.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.933+0000 7f1e93fff640 1 -- 172.21.15.7:0/2196810951 learned_addr learned my addr 172.21.15.7:0/2196810951 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:41.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.934+0000 7f1e9880b640 1 --2- 172.21.15.7:0/2196810951 >> v2:172.21.15.55:3300/0 conn(0x7f1e9415d990 0x7f1e940b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:41.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.934+0000 7f1e937fe640 1 -- 172.21.15.7:0/2196810951 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 779810228 0 0) 0x7f1e940cbcb0 con 0x7f1e940b29c0 2024-04-25T10:00:41.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.934+0000 7f1e937fe640 1 -- 172.21.15.7:0/2196810951 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e7c003520 con 0x7f1e940b29c0 2024-04-25T10:00:41.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.934+0000 7f1e937fe640 1 -- 172.21.15.7:0/2196810951 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1387934651 0 0) 0x7f1e940b1df0 con 0x7f1e940d1c90 2024-04-25T10:00:41.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.934+0000 7f1e937fe640 1 -- 172.21.15.7:0/2196810951 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e940cbcb0 con 0x7f1e940d1c90 2024-04-25T10:00:41.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.934+0000 7f1e937fe640 1 -- 172.21.15.7:0/2196810951 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2372991327 0 0) 0x7f1e7c003520 con 0x7f1e940b29c0 2024-04-25T10:00:41.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.934+0000 7f1e937fe640 1 -- 172.21.15.7:0/2196810951 >> v2:172.21.15.55:3300/0 conn(0x7f1e9415d990 msgr2=0x7f1e940b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:41.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.934+0000 7f1e937fe640 1 --2- 172.21.15.7:0/2196810951 >> v2:172.21.15.55:3300/0 conn(0x7f1e9415d990 0x7f1e940b1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.934+0000 7f1e937fe640 1 -- 172.21.15.7:0/2196810951 >> v1:172.21.15.55:6789/0 conn(0x7f1e940d1c90 legacy=0x7f1e9406c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:41.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.934+0000 7f1e937fe640 1 -- 172.21.15.7:0/2196810951 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e940b23b0 con 0x7f1e940b29c0 2024-04-25T10:00:41.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.934+0000 7f1e937fe640 1 -- 172.21.15.7:0/2196810951 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f1e88001690 con 0x7f1e940b29c0 2024-04-25T10:00:41.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.934+0000 7f1e937fe640 1 -- 172.21.15.7:0/2196810951 >> v1:172.21.15.7:6789/0 conn(0x7f1e940b29c0 legacy=0x7f1e940d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:41.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.934+0000 7f1e937fe640 1 --2- 172.21.15.7:0/2196810951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e7c003b40 0x7f1e7c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:41.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.934+0000 7f1e937fe640 1 --2- 172.21.15.7:0/2196810951 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1e7c004800 0x7f1e7c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:41.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.934+0000 7f1e937fe640 1 --2- 172.21.15.7:0/2196810951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e7c0051c0 0x7f1e7c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:41.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.934+0000 7f1e937fe640 1 -- 172.21.15.7:0/2196810951 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e940b20d0 con 0x7f1e7c0051c0 2024-04-25T10:00:41.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.934+0000 7f1e937fe640 1 -- 172.21.15.7:0/2196810951 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c00c0f0 con 0x7f1e7c003b40 2024-04-25T10:00:41.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.934+0000 7f1e937fe640 1 -- 172.21.15.7:0/2196810951 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c00c2f0 con 0x7f1e7c004800 2024-04-25T10:00:41.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.934+0000 7f1e9880b640 1 --2- 172.21.15.7:0/2196810951 >> v2:172.21.15.55:3300/0 conn(0x7f1e9415d990 0x7f1e940b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:00:41.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.934+0000 7f1e9900c640 1 --2- 172.21.15.7:0/2196810951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e7c0051c0 0x7f1e7c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:41.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.934+0000 7f1e93fff640 1 --2- 172.21.15.7:0/2196810951 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1e7c004800 0x7f1e7c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:41.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.934+0000 7f1e9880b640 1 --2- 172.21.15.7:0/2196810951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e7c003b40 0x7f1e7c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:41.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.935+0000 7f1e9900c640 1 -- 172.21.15.7:0/2196810951 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1e7c004800 msgr2=0x7f1e7c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:41.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.935+0000 7f1e9900c640 1 --2- 172.21.15.7:0/2196810951 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1e7c004800 0x7f1e7c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.935+0000 7f1e9900c640 1 -- 172.21.15.7:0/2196810951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e7c003b40 msgr2=0x7f1e7c003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:41.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.935+0000 7f1e9900c640 1 --2- 172.21.15.7:0/2196810951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e7c003b40 0x7f1e7c003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.935+0000 7f1e9900c640 1 -- 172.21.15.7:0/2196810951 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7c003520 con 0x7f1e7c0051c0 2024-04-25T10:00:41.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.935+0000 7f1e9880b640 1 --2- 172.21.15.7:0/2196810951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e7c003b40 0x7f1e7c003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:41.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.935+0000 7f1e9900c640 1 -- 172.21.15.7:0/2196810951 reap_dead start 2024-04-25T10:00:41.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.935+0000 7f1e9900c640 1 --2- 172.21.15.7:0/2196810951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e7c0051c0 0x7f1e7c00b9c0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f1e840018a0 tx=0x7f1e7c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=994833e4c16f97f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:41.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.935+0000 7f1e937fe640 1 -- 172.21.15.7:0/2196810951 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e840014f0 con 0x7f1e7c0051c0 2024-04-25T10:00:41.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.935+0000 7f1e937fe640 1 -- 172.21.15.7:0/2196810951 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e840052d0 con 0x7f1e7c0051c0 2024-04-25T10:00:41.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.935+0000 7f1e937fe640 1 -- 172.21.15.7:0/2196810951 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8402ac80 con 0x7f1e7c0051c0 2024-04-25T10:00:41.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.936+0000 7f1e9aa6f640 1 -- 172.21.15.7:0/2196810951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e7c0051c0 msgr2=0x7f1e7c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:41.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.936+0000 7f1e9aa6f640 1 --2- 172.21.15.7:0/2196810951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e7c0051c0 0x7f1e7c00b9c0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f1e840018a0 tx=0x7f1e7c005830 comp rx=0 tx=0).stop 2024-04-25T10:00:41.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.936+0000 7f1e9aa6f640 1 -- 172.21.15.7:0/2196810951 shutdown_connections 2024-04-25T10:00:41.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.936+0000 7f1e9aa6f640 1 --2- 172.21.15.7:0/2196810951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e7c0051c0 0x7f1e7c00b9c0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.936+0000 7f1e9aa6f640 1 -- 172.21.15.7:0/2196810951 >> 172.21.15.7:0/2196810951 conn(0x7f1e9408af80 msgr2=0x7f1e9408b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:41.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.936+0000 7f1e9aa6f640 1 -- 172.21.15.7:0/2196810951 shutdown_connections 2024-04-25T10:00:41.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.936+0000 7f1e9aa6f640 1 -- 172.21.15.7:0/2196810951 wait complete. 2024-04-25T10:00:41.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.937+0000 7f1e9aa6f640 1 Processor -- start 2024-04-25T10:00:41.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.937+0000 7f1e9aa6f640 1 -- start start 2024-04-25T10:00:41.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.938+0000 7f1e9aa6f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e7c0051c0 0x7f1e941f2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:41.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.938+0000 7f1e9aa6f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e9415f120 0x7f1e9415f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:41.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.938+0000 7f1e9aa6f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1e941f3d00 0x7f1e941f4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:41.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.938+0000 7f1e9aa6f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9415dd70 con 0x7f1e7c0051c0 2024-04-25T10:00:41.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.938+0000 7f1e9aa6f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e940cf9d0 con 0x7f1e9415f120 2024-04-25T10:00:41.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.938+0000 7f1e9aa6f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9415def0 con 0x7f1e941f3d00 2024-04-25T10:00:41.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.938+0000 7f1e9880b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e7c0051c0 0x7f1e941f2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:41.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.938+0000 7f1e9880b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e7c0051c0 0x7f1e941f2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49594/0 (socket says 172.21.15.7:49594) 2024-04-25T10:00:41.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.938+0000 7f1e9880b640 1 -- 172.21.15.7:0/1880936117 learned_addr learned my addr 172.21.15.7:0/1880936117 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:41.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.938+0000 7f1e93fff640 1 --2- 172.21.15.7:0/1880936117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e9415f120 0x7f1e9415f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:41.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.938+0000 7f1e9900c640 1 --2- 172.21.15.7:0/1880936117 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1e941f3d00 0x7f1e941f4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:41.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.939+0000 7f1e9880b640 1 -- 172.21.15.7:0/1880936117 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1e941f3d00 msgr2=0x7f1e941f4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:41.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.939+0000 7f1e9880b640 1 --2- 172.21.15.7:0/1880936117 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1e941f3d00 0x7f1e941f4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.939+0000 7f1e9880b640 1 -- 172.21.15.7:0/1880936117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e9415f120 msgr2=0x7f1e9415f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:41.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.939+0000 7f1e9880b640 1 --2- 172.21.15.7:0/1880936117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e9415f120 0x7f1e9415f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:41.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.939+0000 7f1e9880b640 1 -- 172.21.15.7:0/1880936117 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9415fbc0 con 0x7f1e7c0051c0 2024-04-25T10:00:41.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.939+0000 7f1e9900c640 1 --2- 172.21.15.7:0/1880936117 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1e941f3d00 0x7f1e941f4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:41.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.939+0000 7f1e9880b640 1 --2- 172.21.15.7:0/1880936117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e7c0051c0 0x7f1e941f2b50 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c011500 tx=0x7f1e8c0119c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:41.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.939+0000 7f1e917fa640 1 -- 172.21.15.7:0/1880936117 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c01a020 con 0x7f1e7c0051c0 2024-04-25T10:00:41.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.939+0000 7f1e917fa640 1 -- 172.21.15.7:0/1880936117 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8c016680 con 0x7f1e7c0051c0 2024-04-25T10:00:41.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.939+0000 7f1e9aa6f640 1 -- 172.21.15.7:0/1880936117 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e9415fea0 con 0x7f1e7c0051c0 2024-04-25T10:00:41.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.939+0000 7f1e917fa640 1 -- 172.21.15.7:0/1880936117 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c016a30 con 0x7f1e7c0051c0 2024-04-25T10:00:41.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.939+0000 7f1e9aa6f640 1 -- 172.21.15.7:0/1880936117 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e941f37e0 con 0x7f1e7c0051c0 2024-04-25T10:00:41.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.940+0000 7f1e9aa6f640 1 -- 172.21.15.7:0/1880936117 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e94068f60 con 0x7f1e7c0051c0 2024-04-25T10:00:41.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.941+0000 7f1e917fa640 1 -- 172.21.15.7:0/1880936117 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1e8c005d10 con 0x7f1e7c0051c0 2024-04-25T10:00:41.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.941+0000 7f1e917fa640 1 --2- 172.21.15.7:0/1880936117 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1e8006b500 0x7f1e8006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:41.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.941+0000 7f1e917fa640 1 -- 172.21.15.7:0/1880936117 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1e8c08b3b0 con 0x7f1e7c0051c0 2024-04-25T10:00:41.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.941+0000 7f1e93fff640 1 --2- 172.21.15.7:0/1880936117 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1e8006b500 0x7f1e8006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:41.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.942+0000 7f1e93fff640 1 --2- 172.21.15.7:0/1880936117 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1e8006b500 0x7f1e8006d9c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1e9406d440 tx=0x7f1e88001e40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:41.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:41.945+0000 7f1e917fa640 1 -- 172.21.15.7:0/1880936117 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1e8c024030 con 0x7f1e7c0051c0 2024-04-25T10:00:42.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.124+0000 7f1e9aa6f640 1 -- 172.21.15.7:0/1880936117 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1e940cead0 con 0x7f1e7c0051c0 2024-04-25T10:00:42.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.124+0000 7f1e917fa640 1 -- 172.21.15.7:0/1880936117 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1e8c05a0b0 con 0x7f1e7c0051c0 2024-04-25T10:00:42.129 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T10:00:42.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.126+0000 7f1e9aa6f640 1 -- 172.21.15.7:0/1880936117 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1e8006b500 msgr2=0x7f1e8006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:42.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.126+0000 7f1e9aa6f640 1 --2- 172.21.15.7:0/1880936117 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1e8006b500 0x7f1e8006d9c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1e9406d440 tx=0x7f1e88001e40 comp rx=0 tx=0).stop 2024-04-25T10:00:42.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.126+0000 7f1e9aa6f640 1 -- 172.21.15.7:0/1880936117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e7c0051c0 msgr2=0x7f1e941f2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:42.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.126+0000 7f1e9aa6f640 1 --2- 172.21.15.7:0/1880936117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e7c0051c0 0x7f1e941f2b50 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c011500 tx=0x7f1e8c0119c0 comp rx=0 tx=0).stop 2024-04-25T10:00:42.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.126+0000 7f1e9aa6f640 1 -- 172.21.15.7:0/1880936117 shutdown_connections 2024-04-25T10:00:42.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.126+0000 7f1e9aa6f640 1 --2- 172.21.15.7:0/1880936117 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1e8006b500 0x7f1e8006d9c0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:42.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.126+0000 7f1e9aa6f640 1 --2- 172.21.15.7:0/1880936117 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1e941f3d00 0x7f1e941f4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:42.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.126+0000 7f1e9aa6f640 1 --2- 172.21.15.7:0/1880936117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e9415f120 0x7f1e9415f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:42.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.126+0000 7f1e9aa6f640 1 --2- 172.21.15.7:0/1880936117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e7c0051c0 0x7f1e941f2b50 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:42.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.126+0000 7f1e9aa6f640 1 -- 172.21.15.7:0/1880936117 >> 172.21.15.7:0/1880936117 conn(0x7f1e9408af80 msgr2=0x7f1e940b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:42.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.126+0000 7f1e9aa6f640 1 -- 172.21.15.7:0/1880936117 shutdown_connections 2024-04-25T10:00:42.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.126+0000 7f1e9aa6f640 1 -- 172.21.15.7:0/1880936117 wait complete. 2024-04-25T10:00:42.142 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:00:42.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.238+0000 7fcf632b6640 1 Processor -- start 2024-04-25T10:00:42.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.239+0000 7fcf632b6640 1 -- start start 2024-04-25T10:00:42.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.239+0000 7fcf632b6640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcf5c0cd740 0x7fcf5c0d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:42.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.239+0000 7fcf632b6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcf5c06cd90 0x7fcf5c0cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:42.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.239+0000 7fcf632b6640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5c099b90 con 0x7fcf5c0d08d0 2024-04-25T10:00:42.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.239+0000 7fcf632b6640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5c0cdb20 con 0x7fcf5c06cd90 2024-04-25T10:00:42.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.239+0000 7fcf632b6640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c099e70 con 0x7fcf5c0cd740 2024-04-25T10:00:42.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.240+0000 7fcf60851640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fcf5c0d08d0 0x7fcf5c06c680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45352/0 (socket says 172.21.15.7:45352) 2024-04-25T10:00:42.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.240+0000 7fcf60851640 1 -- 172.21.15.7:0/488128494 learned_addr learned my addr 172.21.15.7:0/488128494 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:42.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.240+0000 7fcf61052640 1 --2- 172.21.15.7:0/488128494 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcf5c0cd740 0x7fcf5c0d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:42.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.240+0000 7fcf61853640 1 --2- 172.21.15.7:0/488128494 >> v2:172.21.15.55:3300/0 conn(0x7fcf5c06cd90 0x7fcf5c0cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:42.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.240+0000 7fcf5bfff640 1 -- 172.21.15.7:0/488128494 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 226137764 0 0) 0x7fcf5c099b90 con 0x7fcf5c0d08d0 2024-04-25T10:00:42.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.240+0000 7fcf5bfff640 1 -- 172.21.15.7:0/488128494 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf44003520 con 0x7fcf5c0d08d0 2024-04-25T10:00:42.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.240+0000 7fcf61052640 1 -- 172.21.15.7:0/488128494 >> v2:172.21.15.55:3300/0 conn(0x7fcf5c06cd90 msgr2=0x7fcf5c0cbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:42.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.240+0000 7fcf61052640 1 --2- 172.21.15.7:0/488128494 >> v2:172.21.15.55:3300/0 conn(0x7fcf5c06cd90 0x7fcf5c0cbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:42.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.240+0000 7fcf61052640 1 -- 172.21.15.7:0/488128494 >> v1:172.21.15.7:6789/0 conn(0x7fcf5c0d08d0 legacy=0x7fcf5c06c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:42.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.240+0000 7fcf61052640 1 -- 172.21.15.7:0/488128494 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c09a150 con 0x7fcf5c0cd740 2024-04-25T10:00:42.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.241+0000 7fcf61052640 1 --2- 172.21.15.7:0/488128494 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcf5c0cd740 0x7fcf5c0d0390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcf540097a0 tx=0x7fcf5402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5eed36d2d3c9be7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:42.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.241+0000 7fcf5bfff640 1 -- 172.21.15.7:0/488128494 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf54037070 con 0x7fcf5c0cd740 2024-04-25T10:00:42.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.241+0000 7fcf5bfff640 1 -- 172.21.15.7:0/488128494 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf54032440 con 0x7fcf5c0cd740 2024-04-25T10:00:42.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.241+0000 7fcf5bfff640 1 -- 172.21.15.7:0/488128494 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf54032810 con 0x7fcf5c0cd740 2024-04-25T10:00:42.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.241+0000 7fcf632b6640 1 -- 172.21.15.7:0/488128494 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcf5c0cd740 msgr2=0x7fcf5c0d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:42.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.241+0000 7fcf632b6640 1 --2- 172.21.15.7:0/488128494 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcf5c0cd740 0x7fcf5c0d0390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcf540097a0 tx=0x7fcf5402a180 comp rx=0 tx=0).stop 2024-04-25T10:00:42.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.241+0000 7fcf632b6640 1 -- 172.21.15.7:0/488128494 shutdown_connections 2024-04-25T10:00:42.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.241+0000 7fcf632b6640 1 --2- 172.21.15.7:0/488128494 >> v2:172.21.15.55:3300/0 conn(0x7fcf5c06cd90 0x7fcf5c0cbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:42.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.242+0000 7fcf632b6640 1 --2- 172.21.15.7:0/488128494 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcf5c0cd740 0x7fcf5c0d0390 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:42.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.242+0000 7fcf632b6640 1 -- 172.21.15.7:0/488128494 >> 172.21.15.7:0/488128494 conn(0x7fcf5c0b3130 msgr2=0x7fcf5c0b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:42.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.242+0000 7fcf632b6640 1 -- 172.21.15.7:0/488128494 shutdown_connections 2024-04-25T10:00:42.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.242+0000 7fcf632b6640 1 -- 172.21.15.7:0/488128494 wait complete. 2024-04-25T10:00:42.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.243+0000 7fcf632b6640 1 Processor -- start 2024-04-25T10:00:42.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.243+0000 7fcf632b6640 1 -- start start 2024-04-25T10:00:42.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.243+0000 7fcf632b6640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcf5c06cd90 0x7fcf5c157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:42.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.243+0000 7fcf632b6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf5c0cd740 0x7fcf5c0c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:42.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.244+0000 7fcf632b6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf5c0d08d0 0x7fcf5c0c7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:42.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.244+0000 7fcf632b6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c09ac30 con 0x7fcf5c0d08d0 2024-04-25T10:00:42.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.244+0000 7fcf632b6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c09a710 con 0x7fcf5c0cd740 2024-04-25T10:00:42.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.244+0000 7fcf632b6640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c09adb0 con 0x7fcf5c06cd90 2024-04-25T10:00:42.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.244+0000 7fcf61853640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf5c0d08d0 0x7fcf5c0c7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:42.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.244+0000 7fcf61853640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf5c0d08d0 0x7fcf5c0c7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49600/0 (socket says 172.21.15.7:49600) 2024-04-25T10:00:42.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.244+0000 7fcf61853640 1 -- 172.21.15.7:0/2632473550 learned_addr learned my addr 172.21.15.7:0/2632473550 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:42.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.244+0000 7fcf60851640 1 --2- 172.21.15.7:0/2632473550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf5c0cd740 0x7fcf5c0c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:42.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.244+0000 7fcf61052640 1 --2- 172.21.15.7:0/2632473550 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcf5c06cd90 0x7fcf5c157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:42.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.244+0000 7fcf61853640 1 -- 172.21.15.7:0/2632473550 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcf5c06cd90 msgr2=0x7fcf5c157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:42.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.244+0000 7fcf61853640 1 --2- 172.21.15.7:0/2632473550 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcf5c06cd90 0x7fcf5c157430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:42.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.244+0000 7fcf61853640 1 -- 172.21.15.7:0/2632473550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf5c0cd740 msgr2=0x7fcf5c0c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:42.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.244+0000 7fcf61853640 1 --2- 172.21.15.7:0/2632473550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf5c0cd740 0x7fcf5c0c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:42.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.244+0000 7fcf61853640 1 -- 172.21.15.7:0/2632473550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c157970 con 0x7fcf5c0d08d0 2024-04-25T10:00:42.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.244+0000 7fcf61853640 1 --2- 172.21.15.7:0/2632473550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf5c0d08d0 0x7fcf5c0c7000 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00ef90 tx=0x7fcf4c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:42.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.244+0000 7fcf59ffb640 1 -- 172.21.15.7:0/2632473550 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c018020 con 0x7fcf5c0d08d0 2024-04-25T10:00:42.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.244+0000 7fcf59ffb640 1 -- 172.21.15.7:0/2632473550 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c014480 con 0x7fcf5c0d08d0 2024-04-25T10:00:42.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.244+0000 7fcf59ffb640 1 -- 172.21.15.7:0/2632473550 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c014870 con 0x7fcf5c0d08d0 2024-04-25T10:00:42.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.244+0000 7fcf632b6640 1 -- 172.21.15.7:0/2632473550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5c159990 con 0x7fcf5c0d08d0 2024-04-25T10:00:42.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.245+0000 7fcf632b6640 1 -- 172.21.15.7:0/2632473550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf5c1f75d0 con 0x7fcf5c0d08d0 2024-04-25T10:00:42.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.246+0000 7fcf632b6640 1 -- 172.21.15.7:0/2632473550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf5c068fd0 con 0x7fcf5c0d08d0 2024-04-25T10:00:42.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.246+0000 7fcf59ffb640 1 -- 172.21.15.7:0/2632473550 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcf4c005d10 con 0x7fcf5c0d08d0 2024-04-25T10:00:42.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.246+0000 7fcf59ffb640 1 --2- 172.21.15.7:0/2632473550 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcf4806b4d0 0x7fcf4806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:42.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.247+0000 7fcf61052640 1 --2- 172.21.15.7:0/2632473550 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcf4806b4d0 0x7fcf4806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:42.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.247+0000 7fcf59ffb640 1 -- 172.21.15.7:0/2632473550 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcf4c08b020 con 0x7fcf5c0d08d0 2024-04-25T10:00:42.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.247+0000 7fcf61052640 1 --2- 172.21.15.7:0/2632473550 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcf4806b4d0 0x7fcf4806d990 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fcf54034000 tx=0x7fcf5402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:42.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.251+0000 7fcf59ffb640 1 -- 172.21.15.7:0/2632473550 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcf4c022030 con 0x7fcf5c0d08d0 2024-04-25T10:00:42.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.444+0000 7fcf632b6640 1 -- 172.21.15.7:0/2632473550 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcf5c0b4040 con 0x7fcf5c0d08d0 2024-04-25T10:00:42.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.444+0000 7fcf59ffb640 1 -- 172.21.15.7:0/2632473550 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v88) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcf4c010040 con 0x7fcf5c0d08d0 2024-04-25T10:00:42.449 INFO:teuthology.orchestra.run.smithi007.stderr:listed 0 entries 2024-04-25T10:00:42.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.446+0000 7fcf632b6640 1 -- 172.21.15.7:0/2632473550 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcf4806b4d0 msgr2=0x7fcf4806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:42.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.446+0000 7fcf632b6640 1 --2- 172.21.15.7:0/2632473550 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcf4806b4d0 0x7fcf4806d990 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fcf54034000 tx=0x7fcf5402e000 comp rx=0 tx=0).stop 2024-04-25T10:00:42.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.446+0000 7fcf632b6640 1 -- 172.21.15.7:0/2632473550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf5c0d08d0 msgr2=0x7fcf5c0c7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:42.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.446+0000 7fcf632b6640 1 --2- 172.21.15.7:0/2632473550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf5c0d08d0 0x7fcf5c0c7000 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00ef90 tx=0x7fcf4c00c490 comp rx=0 tx=0).stop 2024-04-25T10:00:42.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.446+0000 7fcf632b6640 1 -- 172.21.15.7:0/2632473550 shutdown_connections 2024-04-25T10:00:42.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.446+0000 7fcf632b6640 1 --2- 172.21.15.7:0/2632473550 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcf4806b4d0 0x7fcf4806d990 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:42.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.446+0000 7fcf632b6640 1 --2- 172.21.15.7:0/2632473550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf5c0d08d0 0x7fcf5c0c7000 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:42.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.446+0000 7fcf632b6640 1 --2- 172.21.15.7:0/2632473550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf5c0cd740 0x7fcf5c0c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:42.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.446+0000 7fcf632b6640 1 --2- 172.21.15.7:0/2632473550 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcf5c06cd90 0x7fcf5c157430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:42.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.446+0000 7fcf632b6640 1 -- 172.21.15.7:0/2632473550 >> 172.21.15.7:0/2632473550 conn(0x7fcf5c0b3130 msgr2=0x7fcf5c0b4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:42.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.446+0000 7fcf632b6640 1 -- 172.21.15.7:0/2632473550 shutdown_connections 2024-04-25T10:00:42.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.446+0000 7fcf632b6640 1 -- 172.21.15.7:0/2632473550 wait complete. 2024-04-25T10:00:42.461 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T10:00:42.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:42.462 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T10:00:42.513 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-04-25T10:00:42.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:42.513 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T10:00:42.543 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:00:42.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.679+0000 7f2e5b66f640 1 Processor -- start 2024-04-25T10:00:42.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.680+0000 7f2e5b66f640 1 -- start start 2024-04-25T10:00:42.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.680+0000 7f2e5b66f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e540d0a50 0x7f2e540d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:42.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.680+0000 7f2e5b66f640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e540d1e80 con 0x7f2e5415db00 2024-04-25T10:00:42.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.680+0000 7f2e5b66f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e540b5930 con 0x7f2e540b53b0 2024-04-25T10:00:42.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.680+0000 7f2e5b66f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e540b5c10 con 0x7f2e540d0a50 2024-04-25T10:00:42.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.680+0000 7f2e5940b640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2e5415db00 0x7f2e540d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45364/0 (socket says 172.21.15.7:45364) 2024-04-25T10:00:42.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.680+0000 7f2e5940b640 1 -- 172.21.15.7:0/1154760243 learned_addr learned my addr 172.21.15.7:0/1154760243 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:42.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.681+0000 7f2e53fff640 1 -- 172.21.15.7:0/1154760243 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725865196 0 0) 0x7f2e540d1e80 con 0x7f2e5415db00 2024-04-25T10:00:42.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.681+0000 7f2e58c0a640 1 --2- 172.21.15.7:0/1154760243 >> v2:172.21.15.55:3300/0 conn(0x7f2e540d0a50 0x7f2e540d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:42.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.681+0000 7f2e53fff640 1 -- 172.21.15.7:0/1154760243 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e3c003520 con 0x7f2e5415db00 2024-04-25T10:00:42.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.681+0000 7f2e53fff640 1 -- 172.21.15.7:0/1154760243 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4011720240 0 0) 0x7f2e3c003520 con 0x7f2e5415db00 2024-04-25T10:00:42.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.681+0000 7f2e53fff640 1 -- 172.21.15.7:0/1154760243 >> v2:172.21.15.55:3300/0 conn(0x7f2e540d0a50 msgr2=0x7f2e540d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:42.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.681+0000 7f2e53fff640 1 --2- 172.21.15.7:0/1154760243 >> v2:172.21.15.55:3300/0 conn(0x7f2e540d0a50 0x7f2e540d2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:42.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.681+0000 7f2e53fff640 1 -- 172.21.15.7:0/1154760243 >> v1:172.21.15.55:6789/0 conn(0x7f2e540b53b0 legacy=0x7f2e540d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:42.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.681+0000 7f2e53fff640 1 -- 172.21.15.7:0/1154760243 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e540b5ef0 con 0x7f2e5415db00 2024-04-25T10:00:42.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.681+0000 7f2e53fff640 1 -- 172.21.15.7:0/1154760243 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f2e440019f0 con 0x7f2e5415db00 2024-04-25T10:00:42.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.681+0000 7f2e53fff640 1 -- 172.21.15.7:0/1154760243 >> v1:172.21.15.7:6789/0 conn(0x7f2e5415db00 legacy=0x7f2e540d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:42.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.681+0000 7f2e53fff640 1 --2- 172.21.15.7:0/1154760243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e3c0039b0 0x7f2e3c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:42.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.681+0000 7f2e53fff640 1 --2- 172.21.15.7:0/1154760243 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e3c004800 0x7f2e3c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:42.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.681+0000 7f2e53fff640 1 --2- 172.21.15.7:0/1154760243 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e3c0051c0 0x7f2e3c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:42.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.681+0000 7f2e53fff640 1 -- 172.21.15.7:0/1154760243 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e540b5c10 con 0x7f2e3c0039b0 2024-04-25T10:00:42.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.681+0000 7f2e53fff640 1 -- 172.21.15.7:0/1154760243 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c00c060 con 0x7f2e3c0051c0 2024-04-25T10:00:42.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.681+0000 7f2e53fff640 1 -- 172.21.15.7:0/1154760243 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c00c260 con 0x7f2e3c004800 2024-04-25T10:00:42.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.681+0000 7f2e5940b640 1 --2- 172.21.15.7:0/1154760243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e3c0039b0 0x7f2e3c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:42.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.681+0000 7f2e58c0a640 1 --2- 172.21.15.7:0/1154760243 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e3c004800 0x7f2e3c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:42.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.681+0000 7f2e59c0c640 1 --2- 172.21.15.7:0/1154760243 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e3c0051c0 0x7f2e3c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:42.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.682+0000 7f2e5940b640 1 -- 172.21.15.7:0/1154760243 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e3c004800 msgr2=0x7f2e3c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:42.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.682+0000 7f2e5940b640 1 --2- 172.21.15.7:0/1154760243 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e3c004800 0x7f2e3c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:42.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.682+0000 7f2e5940b640 1 -- 172.21.15.7:0/1154760243 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e3c0051c0 msgr2=0x7f2e3c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:42.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.682+0000 7f2e5940b640 1 --2- 172.21.15.7:0/1154760243 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e3c0051c0 0x7f2e3c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:42.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.682+0000 7f2e59c0c640 1 -- 172.21.15.7:0/1154760243 reap_dead start 2024-04-25T10:00:42.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.682+0000 7f2e5940b640 1 -- 172.21.15.7:0/1154760243 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3c003520 con 0x7f2e3c0039b0 2024-04-25T10:00:42.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.682+0000 7f2e5940b640 1 --2- 172.21.15.7:0/1154760243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e3c0039b0 0x7f2e3c003dd0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f2e4400a850 tx=0x7f2e3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bbdc8f122b10f03 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:42.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.682+0000 7f2e53fff640 1 -- 172.21.15.7:0/1154760243 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4400a4a0 con 0x7f2e3c0039b0 2024-04-25T10:00:42.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.682+0000 7f2e53fff640 1 -- 172.21.15.7:0/1154760243 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4402f070 con 0x7f2e3c0039b0 2024-04-25T10:00:42.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.682+0000 7f2e53fff640 1 -- 172.21.15.7:0/1154760243 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4402bd20 con 0x7f2e3c0039b0 2024-04-25T10:00:42.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.683+0000 7f2e5b66f640 1 -- 172.21.15.7:0/1154760243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e3c0039b0 msgr2=0x7f2e3c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:42.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.683+0000 7f2e5b66f640 1 --2- 172.21.15.7:0/1154760243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e3c0039b0 0x7f2e3c003dd0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f2e4400a850 tx=0x7f2e3c005830 comp rx=0 tx=0).stop 2024-04-25T10:00:42.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.683+0000 7f2e5b66f640 1 -- 172.21.15.7:0/1154760243 shutdown_connections 2024-04-25T10:00:42.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.683+0000 7f2e5b66f640 1 --2- 172.21.15.7:0/1154760243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e3c0039b0 0x7f2e3c003dd0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:42.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.683+0000 7f2e5b66f640 1 -- 172.21.15.7:0/1154760243 >> 172.21.15.7:0/1154760243 conn(0x7f2e54072290 msgr2=0x7f2e540726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:42.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.683+0000 7f2e5b66f640 1 -- 172.21.15.7:0/1154760243 shutdown_connections 2024-04-25T10:00:42.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.683+0000 7f2e5b66f640 1 -- 172.21.15.7:0/1154760243 wait complete. 2024-04-25T10:00:42.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.684+0000 7f2e5b66f640 1 Processor -- start 2024-04-25T10:00:42.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.684+0000 7f2e5b66f640 1 -- start start 2024-04-25T10:00:42.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.685+0000 7f2e5b66f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e3c0039b0 0x7f2e54152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:42.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.685+0000 7f2e5b66f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e540ccde0 0x7f2e541e6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:42.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.685+0000 7f2e5b66f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e54160100 0x7f2e54160580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:42.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.685+0000 7f2e5b66f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e540d3660 con 0x7f2e3c0039b0 2024-04-25T10:00:42.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.685+0000 7f2e5b66f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e540b61d0 con 0x7f2e540ccde0 2024-04-25T10:00:42.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.685+0000 7f2e5b66f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e540ce2b0 con 0x7f2e54160100 2024-04-25T10:00:42.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.685+0000 7f2e5940b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e3c0039b0 0x7f2e54152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:42.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.685+0000 7f2e5940b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e3c0039b0 0x7f2e54152ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49616/0 (socket says 172.21.15.7:49616) 2024-04-25T10:00:42.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.685+0000 7f2e5940b640 1 -- 172.21.15.7:0/2059048603 learned_addr learned my addr 172.21.15.7:0/2059048603 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:42.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.685+0000 7f2e59c0c640 1 --2- 172.21.15.7:0/2059048603 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e54160100 0x7f2e54160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:42.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.685+0000 7f2e58c0a640 1 --2- 172.21.15.7:0/2059048603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e540ccde0 0x7f2e541e6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:42.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.685+0000 7f2e5940b640 1 -- 172.21.15.7:0/2059048603 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e54160100 msgr2=0x7f2e54160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:42.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.685+0000 7f2e5940b640 1 --2- 172.21.15.7:0/2059048603 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e54160100 0x7f2e54160580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:42.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.685+0000 7f2e5940b640 1 -- 172.21.15.7:0/2059048603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e540ccde0 msgr2=0x7f2e541e6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:42.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.685+0000 7f2e5940b640 1 --2- 172.21.15.7:0/2059048603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e540ccde0 0x7f2e541e6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:42.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.685+0000 7f2e5940b640 1 -- 172.21.15.7:0/2059048603 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e54153400 con 0x7f2e3c0039b0 2024-04-25T10:00:42.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.685+0000 7f2e58c0a640 1 --2- 172.21.15.7:0/2059048603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e540ccde0 0x7f2e541e6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:42.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.686+0000 7f2e5940b640 1 --2- 172.21.15.7:0/2059048603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e3c0039b0 0x7f2e54152ec0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f2e4400a970 tx=0x7f2e4402d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:42.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.686+0000 7f2e51ffb640 1 -- 172.21.15.7:0/2059048603 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e44034670 con 0x7f2e3c0039b0 2024-04-25T10:00:42.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.686+0000 7f2e51ffb640 1 -- 172.21.15.7:0/2059048603 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e44034810 con 0x7f2e3c0039b0 2024-04-25T10:00:42.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.686+0000 7f2e5b66f640 1 -- 172.21.15.7:0/2059048603 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e541e6850 con 0x7f2e3c0039b0 2024-04-25T10:00:42.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.686+0000 7f2e51ffb640 1 -- 172.21.15.7:0/2059048603 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e44034bc0 con 0x7f2e3c0039b0 2024-04-25T10:00:42.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.686+0000 7f2e5b66f640 1 -- 172.21.15.7:0/2059048603 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e541e6e00 con 0x7f2e3c0039b0 2024-04-25T10:00:42.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.687+0000 7f2e5b66f640 1 -- 172.21.15.7:0/2059048603 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e54068fd0 con 0x7f2e3c0039b0 2024-04-25T10:00:42.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.688+0000 7f2e51ffb640 1 -- 172.21.15.7:0/2059048603 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2e44040430 con 0x7f2e3c0039b0 2024-04-25T10:00:42.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.688+0000 7f2e51ffb640 1 --2- 172.21.15.7:0/2059048603 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2e4006b500 0x7f2e4006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:42.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.688+0000 7f2e51ffb640 1 -- 172.21.15.7:0/2059048603 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2e440aabf0 con 0x7f2e3c0039b0 2024-04-25T10:00:42.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.688+0000 7f2e58c0a640 1 --2- 172.21.15.7:0/2059048603 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2e4006b500 0x7f2e4006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:42.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.688+0000 7f2e58c0a640 1 --2- 172.21.15.7:0/2059048603 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2e4006b500 0x7f2e4006d9c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f2e54160e10 tx=0x7f2e48008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:42.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.692+0000 7f2e51ffb640 1 -- 172.21.15.7:0/2059048603 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2e54153400 con 0x7f2e3c0039b0 2024-04-25T10:00:42.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.912+0000 7f2e5b66f640 1 -- 172.21.15.7:0/2059048603 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e540d16b0 con 0x7f2e3c0039b0 2024-04-25T10:00:42.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.912+0000 7f2e51ffb640 1 -- 172.21.15.7:0/2059048603 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4934 (secure 0 0 0) 0x7f2e4407f020 con 0x7f2e3c0039b0 2024-04-25T10:00:42.917 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:00:42.917 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2505539422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2505539422},{"type":"v1","addr":"172.21.15.55:6834","nonce":2505539422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2808857776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2808857776},{"type":"v1","addr":"172.21.15.55:6835","nonce":2808857776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7518,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1796103144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1796103144},{"type":"v1","addr":"172.21.15.7:6835","nonce":1796103144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:00:34.054759+0000","modified":"2024-04-25T10:00:36.044190+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7533":{"gid":7533,"name":"a","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6837/2878753733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2878753733},{"type":"v1","addr":"172.21.15.7:6837","nonce":2878753733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:00:42.917 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 53 2024-04-25T10:00:42.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.914+0000 7f2e5b66f640 1 -- 172.21.15.7:0/2059048603 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2e4006b500 msgr2=0x7f2e4006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:42.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.914+0000 7f2e5b66f640 1 --2- 172.21.15.7:0/2059048603 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2e4006b500 0x7f2e4006d9c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f2e54160e10 tx=0x7f2e48008040 comp rx=0 tx=0).stop 2024-04-25T10:00:42.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.914+0000 7f2e5b66f640 1 -- 172.21.15.7:0/2059048603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e3c0039b0 msgr2=0x7f2e54152ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:42.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.914+0000 7f2e5b66f640 1 --2- 172.21.15.7:0/2059048603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e3c0039b0 0x7f2e54152ec0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f2e4400a970 tx=0x7f2e4402d070 comp rx=0 tx=0).stop 2024-04-25T10:00:42.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.914+0000 7f2e5b66f640 1 -- 172.21.15.7:0/2059048603 shutdown_connections 2024-04-25T10:00:42.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.914+0000 7f2e5b66f640 1 --2- 172.21.15.7:0/2059048603 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2e4006b500 0x7f2e4006d9c0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:42.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.914+0000 7f2e5b66f640 1 --2- 172.21.15.7:0/2059048603 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e54160100 0x7f2e54160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:42.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.914+0000 7f2e5b66f640 1 --2- 172.21.15.7:0/2059048603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e540ccde0 0x7f2e541e6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:42.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.914+0000 7f2e5b66f640 1 --2- 172.21.15.7:0/2059048603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e3c0039b0 0x7f2e54152ec0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:42.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.914+0000 7f2e5b66f640 1 -- 172.21.15.7:0/2059048603 >> 172.21.15.7:0/2059048603 conn(0x7f2e54072290 msgr2=0x7f2e540c7460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:42.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.914+0000 7f2e5b66f640 1 -- 172.21.15.7:0/2059048603 shutdown_connections 2024-04-25T10:00:42.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:42.914+0000 7f2e5b66f640 1 -- 172.21.15.7:0/2059048603 wait complete. 2024-04-25T10:00:42.929 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-25T10:00:43.052 INFO:teuthology.orchestra.run.smithi007.stdout:{"message":"","return_code":0} 2024-04-25T10:00:43.052 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T10:00:43.052 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T10:00:43.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.149+0000 7f2c2bf13640 1 Processor -- start 2024-04-25T10:00:43.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.149+0000 7f2c2bf13640 1 -- start start 2024-04-25T10:00:43.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.150+0000 7f2c2bf13640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2c2415dd00 0x7f2c240b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.150+0000 7f2c2bf13640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2c2406c6c0 0x7f2c240b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.150+0000 7f2c2bf13640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c2406cd00 con 0x7f2c240b6a40 2024-04-25T10:00:43.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.150+0000 7f2c2bf13640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c2415e0e0 con 0x7f2c2415dd00 2024-04-25T10:00:43.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.150+0000 7f2c2bf13640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2406cfe0 con 0x7f2c2406c6c0 2024-04-25T10:00:43.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.150+0000 7f2c294ae640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2c240b6a40 0x7f2c2406bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45378/0 (socket says 172.21.15.7:45378) 2024-04-25T10:00:43.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.150+0000 7f2c294ae640 1 -- 172.21.15.7:0/447464830 learned_addr learned my addr 172.21.15.7:0/447464830 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:43.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.151+0000 7f2c28cad640 1 -- 172.21.15.7:0/447464830 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1903023940 0 0) 0x7f2c2406cd00 con 0x7f2c240b6a40 2024-04-25T10:00:43.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.151+0000 7f2c28cad640 1 -- 172.21.15.7:0/447464830 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c0c003520 con 0x7f2c240b6a40 2024-04-25T10:00:43.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.151+0000 7f2c29caf640 1 --2- 172.21.15.7:0/447464830 >> v2:172.21.15.55:3300/0 conn(0x7f2c2415dd00 0x7f2c240b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.151+0000 7f2c2a4b0640 1 --2- 172.21.15.7:0/447464830 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2c2406c6c0 0x7f2c240b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.151+0000 7f2c28cad640 1 -- 172.21.15.7:0/447464830 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 956787459 0 0) 0x7f2c0c003520 con 0x7f2c240b6a40 2024-04-25T10:00:43.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.151+0000 7f2c28cad640 1 -- 172.21.15.7:0/447464830 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2c2406c6c0 msgr2=0x7f2c240b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:43.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.151+0000 7f2c28cad640 1 --2- 172.21.15.7:0/447464830 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2c2406c6c0 0x7f2c240b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.151+0000 7f2c28cad640 1 -- 172.21.15.7:0/447464830 >> v2:172.21.15.55:3300/0 conn(0x7f2c2415dd00 msgr2=0x7f2c240b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:43.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.151+0000 7f2c28cad640 1 --2- 172.21.15.7:0/447464830 >> v2:172.21.15.55:3300/0 conn(0x7f2c2415dd00 0x7f2c240b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.151+0000 7f2c28cad640 1 -- 172.21.15.7:0/447464830 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c240d1ca0 con 0x7f2c240b6a40 2024-04-25T10:00:43.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.151+0000 7f2c28cad640 1 -- 172.21.15.7:0/447464830 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f2c18001670 con 0x7f2c240b6a40 2024-04-25T10:00:43.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.151+0000 7f2c28cad640 1 -- 172.21.15.7:0/447464830 >> v1:172.21.15.7:6789/0 conn(0x7f2c240b6a40 legacy=0x7f2c2406bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:43.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.151+0000 7f2c28cad640 1 --2- 172.21.15.7:0/447464830 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2c2406c6c0 0x7f2c0c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.151+0000 7f2c28cad640 1 --2- 172.21.15.7:0/447464830 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c0c003f30 0x7f2c0c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.151+0000 7f2c28cad640 1 --2- 172.21.15.7:0/447464830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c0c004d40 0x7f2c0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.151+0000 7f2c28cad640 1 -- 172.21.15.7:0/447464830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2415e0e0 con 0x7f2c0c004d40 2024-04-25T10:00:43.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.151+0000 7f2c28cad640 1 -- 172.21.15.7:0/447464830 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2406cfe0 con 0x7f2c0c003f30 2024-04-25T10:00:43.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.151+0000 7f2c28cad640 1 -- 172.21.15.7:0/447464830 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c00b9f0 con 0x7f2c2406c6c0 2024-04-25T10:00:43.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.151+0000 7f2c2a4b0640 1 --2- 172.21.15.7:0/447464830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c0c004d40 0x7f2c0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.151+0000 7f2c29caf640 1 --2- 172.21.15.7:0/447464830 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2c2406c6c0 0x7f2c0c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.151+0000 7f2c294ae640 1 --2- 172.21.15.7:0/447464830 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c0c003f30 0x7f2c0c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.151+0000 7f2c2a4b0640 1 -- 172.21.15.7:0/447464830 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2c2406c6c0 msgr2=0x7f2c0c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:43.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.151+0000 7f2c2a4b0640 1 --2- 172.21.15.7:0/447464830 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2c2406c6c0 0x7f2c0c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.151+0000 7f2c2a4b0640 1 -- 172.21.15.7:0/447464830 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c0c003f30 msgr2=0x7f2c0c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:43.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.151+0000 7f2c2a4b0640 1 --2- 172.21.15.7:0/447464830 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c0c003f30 0x7f2c0c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.151+0000 7f2c2a4b0640 1 -- 172.21.15.7:0/447464830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c0c003520 con 0x7f2c0c004d40 2024-04-25T10:00:43.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.152+0000 7f2c2a4b0640 1 --2- 172.21.15.7:0/447464830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c0c004d40 0x7f2c0c0051c0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f2c14009fc0 tx=0x7f2c0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81a84fce9b800dbb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:43.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.152+0000 7f2c28cad640 1 -- 172.21.15.7:0/447464830 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c14009c10 con 0x7f2c0c004d40 2024-04-25T10:00:43.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.152+0000 7f2c28cad640 1 -- 172.21.15.7:0/447464830 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c14036070 con 0x7f2c0c004d40 2024-04-25T10:00:43.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.152+0000 7f2c28cad640 1 -- 172.21.15.7:0/447464830 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c14031880 con 0x7f2c0c004d40 2024-04-25T10:00:43.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.153+0000 7f2c2bf13640 1 -- 172.21.15.7:0/447464830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c0c004d40 msgr2=0x7f2c0c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:43.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.153+0000 7f2c2bf13640 1 --2- 172.21.15.7:0/447464830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c0c004d40 0x7f2c0c0051c0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f2c14009fc0 tx=0x7f2c0c005830 comp rx=0 tx=0).stop 2024-04-25T10:00:43.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.153+0000 7f2c2a4b0640 1 -- 172.21.15.7:0/447464830 reap_dead start 2024-04-25T10:00:43.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.153+0000 7f2c2bf13640 1 -- 172.21.15.7:0/447464830 shutdown_connections 2024-04-25T10:00:43.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.153+0000 7f2c2bf13640 1 -- 172.21.15.7:0/447464830 >> 172.21.15.7:0/447464830 conn(0x7f2c240d07b0 msgr2=0x7f2c240d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:43.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.153+0000 7f2c2bf13640 1 -- 172.21.15.7:0/447464830 shutdown_connections 2024-04-25T10:00:43.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.153+0000 7f2c2bf13640 1 -- 172.21.15.7:0/447464830 wait complete. 2024-04-25T10:00:43.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.154+0000 7f2c2bf13640 1 Processor -- start 2024-04-25T10:00:43.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.154+0000 7f2c2bf13640 1 -- start start 2024-04-25T10:00:43.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.155+0000 7f2c2bf13640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c0c004d40 0x7f2c24160260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.155+0000 7f2c2bf13640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2c240c90f0 0x7f2c240c9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.155+0000 7f2c2bf13640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c240cc130 0x7f2c240cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.155+0000 7f2c2bf13640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c240b5c90 con 0x7f2c0c004d40 2024-04-25T10:00:43.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.155+0000 7f2c2bf13640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c240d2260 con 0x7f2c240cc130 2024-04-25T10:00:43.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.155+0000 7f2c2bf13640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c240b5e10 con 0x7f2c240c90f0 2024-04-25T10:00:43.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.155+0000 7f2c29caf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c0c004d40 0x7f2c24160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.155+0000 7f2c29caf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c0c004d40 0x7f2c24160260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49632/0 (socket says 172.21.15.7:49632) 2024-04-25T10:00:43.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.155+0000 7f2c29caf640 1 -- 172.21.15.7:0/3670083784 learned_addr learned my addr 172.21.15.7:0/3670083784 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:43.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.155+0000 7f2c2a4b0640 1 --2- 172.21.15.7:0/3670083784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c240cc130 0x7f2c240cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.155+0000 7f2c294ae640 1 --2- 172.21.15.7:0/3670083784 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2c240c90f0 0x7f2c240c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.155+0000 7f2c29caf640 1 -- 172.21.15.7:0/3670083784 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2c240c90f0 msgr2=0x7f2c240c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:43.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.155+0000 7f2c29caf640 1 --2- 172.21.15.7:0/3670083784 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2c240c90f0 0x7f2c240c9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.155+0000 7f2c29caf640 1 -- 172.21.15.7:0/3670083784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c240cc130 msgr2=0x7f2c240cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:43.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.155+0000 7f2c29caf640 1 --2- 172.21.15.7:0/3670083784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c240cc130 0x7f2c240cc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.155+0000 7f2c29caf640 1 -- 172.21.15.7:0/3670083784 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c240c9ab0 con 0x7f2c0c004d40 2024-04-25T10:00:43.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.155+0000 7f2c29caf640 1 --2- 172.21.15.7:0/3670083784 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c0c004d40 0x7f2c24160260 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c011aa0 tx=0x7f2c1c011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:43.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.156+0000 7f2c227fc640 1 -- 172.21.15.7:0/3670083784 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c00fb80 con 0x7f2c0c004d40 2024-04-25T10:00:43.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.156+0000 7f2c227fc640 1 -- 172.21.15.7:0/3670083784 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1c00fd20 con 0x7f2c0c004d40 2024-04-25T10:00:43.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.156+0000 7f2c2bf13640 1 -- 172.21.15.7:0/3670083784 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c240ccea0 con 0x7f2c0c004d40 2024-04-25T10:00:43.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.156+0000 7f2c227fc640 1 -- 172.21.15.7:0/3670083784 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c014660 con 0x7f2c0c004d40 2024-04-25T10:00:43.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.156+0000 7f2c2bf13640 1 -- 172.21.15.7:0/3670083784 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c240cd460 con 0x7f2c0c004d40 2024-04-25T10:00:43.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.157+0000 7f2c2bf13640 1 -- 172.21.15.7:0/3670083784 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c24068fd0 con 0x7f2c0c004d40 2024-04-25T10:00:43.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.157+0000 7f2c227fc640 1 -- 172.21.15.7:0/3670083784 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2c1c012040 con 0x7f2c0c004d40 2024-04-25T10:00:43.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.158+0000 7f2c227fc640 1 --2- 172.21.15.7:0/3670083784 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2c1006b500 0x7f2c1006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.158+0000 7f2c227fc640 1 -- 172.21.15.7:0/3670083784 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2c1c08aa90 con 0x7f2c0c004d40 2024-04-25T10:00:43.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.158+0000 7f2c294ae640 1 --2- 172.21.15.7:0/3670083784 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2c1006b500 0x7f2c1006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.158+0000 7f2c294ae640 1 --2- 172.21.15.7:0/3670083784 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2c1006b500 0x7f2c1006d9c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2c241611e0 tx=0x7f2c18009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:43.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.162+0000 7f2c227fc640 1 -- 172.21.15.7:0/3670083784 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2c1c019030 con 0x7f2c0c004d40 2024-04-25T10:00:43.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.377+0000 7f2c2bf13640 1 -- 172.21.15.7:0/3670083784 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2c240d1620 con 0x7f2c0c004d40 2024-04-25T10:00:43.382 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-04-25T10:00:43.378+0000 7f45ad572640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T10:00:43.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.380+0000 7f2c227fc640 1 -- 172.21.15.7:0/3670083784 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v54) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2c1c059780 con 0x7f2c0c004d40 2024-04-25T10:00:43.384 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T10:00:43.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.383+0000 7f2c2bf13640 1 -- 172.21.15.7:0/3670083784 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2c1006b500 msgr2=0x7f2c1006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:43.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.383+0000 7f2c2bf13640 1 --2- 172.21.15.7:0/3670083784 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2c1006b500 0x7f2c1006d9c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2c241611e0 tx=0x7f2c18009040 comp rx=0 tx=0).stop 2024-04-25T10:00:43.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.383+0000 7f2c2bf13640 1 -- 172.21.15.7:0/3670083784 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c0c004d40 msgr2=0x7f2c24160260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:43.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.383+0000 7f2c2bf13640 1 --2- 172.21.15.7:0/3670083784 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c0c004d40 0x7f2c24160260 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c011aa0 tx=0x7f2c1c011f60 comp rx=0 tx=0).stop 2024-04-25T10:00:43.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.383+0000 7f2c2bf13640 1 -- 172.21.15.7:0/3670083784 shutdown_connections 2024-04-25T10:00:43.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.383+0000 7f2c2bf13640 1 --2- 172.21.15.7:0/3670083784 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2c1006b500 0x7f2c1006d9c0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.383+0000 7f2c2bf13640 1 --2- 172.21.15.7:0/3670083784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c240cc130 0x7f2c240cc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.383+0000 7f2c2bf13640 1 --2- 172.21.15.7:0/3670083784 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2c240c90f0 0x7f2c240c9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.383+0000 7f2c2bf13640 1 --2- 172.21.15.7:0/3670083784 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c0c004d40 0x7f2c24160260 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.383+0000 7f2c2bf13640 1 -- 172.21.15.7:0/3670083784 >> 172.21.15.7:0/3670083784 conn(0x7f2c240d07b0 msgr2=0x7f2c240b8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:43.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.383+0000 7f2c2bf13640 1 -- 172.21.15.7:0/3670083784 shutdown_connections 2024-04-25T10:00:43.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.383+0000 7f2c2bf13640 1 -- 172.21.15.7:0/3670083784 wait complete. 2024-04-25T10:00:43.389 INFO:tasks.ceph.mds.a.smithi007.stderr: -4647> 2024-04-25T10:00:39.661+0000 7f26046e9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:00:43.398 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 10000000000.00000000 2024-04-25T10:00:43.420 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-04-25T10:00:43.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.437+0000 7fbec7debf40 1 Processor -- start 2024-04-25T10:00:43.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.437+0000 7fbec7debf40 1 -- start start 2024-04-25T10:00:43.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.438+0000 7fbec7debf40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a7f91cce90 0x55a7f91c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.438+0000 7fbec7debf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7f91cd270 0x55a7f9112df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.438+0000 7fbec7debf40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a7f91cd680 0x55a7f91ea990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.438+0000 7fbec7debf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7f915afc0 con 0x55a7f91cd270 2024-04-25T10:00:43.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.438+0000 7fbec7debf40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7f90b7df0 con 0x55a7f91cce90 2024-04-25T10:00:43.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.438+0000 7fbec7debf40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a7f91cdbf0 con 0x55a7f91cd680 2024-04-25T10:00:43.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.438+0000 7fbec50eb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7f91cd270 0x55a7f9112df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.438+0000 7fbec50eb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7f91cd270 0x55a7f9112df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49676/0 (socket says 172.21.15.7:49676) 2024-04-25T10:00:43.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.438+0000 7fbec50eb640 1 -- 172.21.15.7:0/2297538560 learned_addr learned my addr 172.21.15.7:0/2297538560 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:43.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.438+0000 7fbec50eb640 1 -- 172.21.15.7:0/2297538560 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a7f91cd680 msgr2=0x55a7f91ea990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:43.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.438+0000 7fbec60ed640 1 --2- 172.21.15.7:0/2297538560 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a7f91cd680 0x55a7f91ea990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.438+0000 7fbec58ec640 1 --2- 172.21.15.7:0/2297538560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a7f91cce90 0x55a7f91c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.438+0000 7fbec50eb640 1 --2- 172.21.15.7:0/2297538560 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a7f91cd680 0x55a7f91ea990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.438+0000 7fbec50eb640 1 -- 172.21.15.7:0/2297538560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a7f91cce90 msgr2=0x55a7f91c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:43.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.438+0000 7fbec50eb640 1 --2- 172.21.15.7:0/2297538560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a7f91cce90 0x55a7f91c8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.438+0000 7fbec50eb640 1 -- 172.21.15.7:0/2297538560 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7f903dc50 con 0x55a7f91cd270 2024-04-25T10:00:43.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.438+0000 7fbec60ed640 1 --2- 172.21.15.7:0/2297538560 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a7f91cd680 0x55a7f91ea990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:00:43.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.438+0000 7fbec58ec640 1 --2- 172.21.15.7:0/2297538560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a7f91cce90 0x55a7f91c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:00:43.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.438+0000 7fbec50eb640 1 --2- 172.21.15.7:0/2297538560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7f91cd270 0x55a7f9112df0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fbebc025dc0 tx=0x7fbebc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2334a76e1ee65735 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:43.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.439+0000 7fbeb7fff640 1 -- 172.21.15.7:0/2297538560 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc056070 con 0x55a7f91cd270 2024-04-25T10:00:43.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.439+0000 7fbeb7fff640 1 -- 172.21.15.7:0/2297538560 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbebc0529f0 con 0x55a7f91cd270 2024-04-25T10:00:43.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.439+0000 7fbeb7fff640 1 -- 172.21.15.7:0/2297538560 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc052da0 con 0x55a7f91cd270 2024-04-25T10:00:43.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.439+0000 7fbec7debf40 1 -- 172.21.15.7:0/2297538560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7f91cd270 msgr2=0x55a7f9112df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:43.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.439+0000 7fbec7debf40 1 --2- 172.21.15.7:0/2297538560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7f91cd270 0x55a7f9112df0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fbebc025dc0 tx=0x7fbebc051000 comp rx=0 tx=0).stop 2024-04-25T10:00:43.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.439+0000 7fbec7debf40 1 -- 172.21.15.7:0/2297538560 shutdown_connections 2024-04-25T10:00:43.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.439+0000 7fbec7debf40 1 --2- 172.21.15.7:0/2297538560 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a7f91cd680 0x55a7f91ea990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.439+0000 7fbec7debf40 1 --2- 172.21.15.7:0/2297538560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7f91cd270 0x55a7f9112df0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.439+0000 7fbec7debf40 1 --2- 172.21.15.7:0/2297538560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a7f91cce90 0x55a7f91c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.439+0000 7fbec7debf40 1 -- 172.21.15.7:0/2297538560 >> 172.21.15.7:0/2297538560 conn(0x55a7f910fa60 msgr2=0x55a7f910ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:43.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.439+0000 7fbec7debf40 1 -- 172.21.15.7:0/2297538560 shutdown_connections 2024-04-25T10:00:43.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.439+0000 7fbec7debf40 1 -- 172.21.15.7:0/2297538560 wait complete. 2024-04-25T10:00:43.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.440+0000 7fbec7debf40 1 Processor -- start 2024-04-25T10:00:43.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.440+0000 7fbec7debf40 1 -- start start 2024-04-25T10:00:43.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.440+0000 7fbec7debf40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a7f91cce90 0x55a7f91c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.440+0000 7fbec7debf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7f91cd270 0x55a7f91e4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.440+0000 7fbec7debf40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a7f91cd680 0x55a7f91e4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.440+0000 7fbec7debf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7f91e8100 con 0x55a7f91cd270 2024-04-25T10:00:43.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.440+0000 7fbec7debf40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7f91ca5e0 con 0x55a7f91cce90 2024-04-25T10:00:43.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.440+0000 7fbec7debf40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a7f91ca300 con 0x55a7f91cd680 2024-04-25T10:00:43.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.441+0000 7fbec50eb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7f91cd270 0x55a7f91e4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.441+0000 7fbec50eb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7f91cd270 0x55a7f91e4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49678/0 (socket says 172.21.15.7:49678) 2024-04-25T10:00:43.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.441+0000 7fbec50eb640 1 -- 172.21.15.7:0/3329099691 learned_addr learned my addr 172.21.15.7:0/3329099691 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:43.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.441+0000 7fbec58ec640 1 --2- 172.21.15.7:0/3329099691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a7f91cce90 0x55a7f91c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.441+0000 7fbec60ed640 1 --2- 172.21.15.7:0/3329099691 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a7f91cd680 0x55a7f91e4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.441+0000 7fbec50eb640 1 -- 172.21.15.7:0/3329099691 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a7f91cd680 msgr2=0x55a7f91e4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:43.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.441+0000 7fbec50eb640 1 --2- 172.21.15.7:0/3329099691 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a7f91cd680 0x55a7f91e4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.441+0000 7fbec50eb640 1 -- 172.21.15.7:0/3329099691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a7f91cce90 msgr2=0x55a7f91c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:43.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.441+0000 7fbec50eb640 1 --2- 172.21.15.7:0/3329099691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a7f91cce90 0x55a7f91c6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.441+0000 7fbec50eb640 1 -- 172.21.15.7:0/3329099691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7f91c7490 con 0x55a7f91cd270 2024-04-25T10:00:43.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.441+0000 7fbec60ed640 1 --2- 172.21.15.7:0/3329099691 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a7f91cd680 0x55a7f91e4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:43.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.441+0000 7fbec58ec640 1 --2- 172.21.15.7:0/3329099691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a7f91cce90 0x55a7f91c6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:43.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.441+0000 7fbec50eb640 1 --2- 172.21.15.7:0/3329099691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7f91cd270 0x55a7f91e4a90 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fbebc052610 tx=0x7fbebc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:43.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.441+0000 7fbeb6ffd640 1 -- 172.21.15.7:0/3329099691 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc073070 con 0x55a7f91cd270 2024-04-25T10:00:43.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.441+0000 7fbeb6ffd640 1 -- 172.21.15.7:0/3329099691 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbebc00a040 con 0x55a7f91cd270 2024-04-25T10:00:43.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.441+0000 7fbec7debf40 1 -- 172.21.15.7:0/3329099691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a7f91c7770 con 0x55a7f91cd270 2024-04-25T10:00:43.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.441+0000 7fbeb6ffd640 1 -- 172.21.15.7:0/3329099691 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc056070 con 0x55a7f91cd270 2024-04-25T10:00:43.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.441+0000 7fbec7debf40 1 -- 172.21.15.7:0/3329099691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a7f91c7d30 con 0x55a7f91cd270 2024-04-25T10:00:43.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.443+0000 7fbeb6ffd640 1 -- 172.21.15.7:0/3329099691 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbebc059020 con 0x55a7f91cd270 2024-04-25T10:00:43.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.443+0000 7fbeb6ffd640 1 --2- 172.21.15.7:0/3329099691 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbea8069eb0 0x7fbea806c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.443+0000 7fbeb6ffd640 1 -- 172.21.15.7:0/3329099691 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fbebc0cdd30 con 0x55a7f91cd270 2024-04-25T10:00:43.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.443+0000 7fbec58ec640 1 --2- 172.21.15.7:0/3329099691 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbea8069eb0 0x7fbea806c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.443+0000 7fbec7debf40 1 --2- 172.21.15.7:0/3329099691 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x55a7f913ca00 0x55a7f91e2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.443+0000 7fbec7debf40 1 -- 172.21.15.7:0/3329099691 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:1 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e89) v9 -- 0x55a7f91e3170 con 0x55a7f913ca00 2024-04-25T10:00:43.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.443+0000 7fbec60ed640 1 --2- 172.21.15.7:0/3329099691 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x55a7f913ca00 0x55a7f91e2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.444+0000 7fbec58ec640 1 --2- 172.21.15.7:0/3329099691 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbea8069eb0 0x7fbea806c370 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x55a7f91eb650 tx=0x7fbeb8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:43.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.444+0000 7fbec60ed640 1 --2- 172.21.15.7:0/3329099691 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x55a7f913ca00 0x55a7f91e2c30 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:43.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.447+0000 7fbec60ed640 1 -- 172.21.15.7:0/3329099691 <== osd.1 v2:172.21.15.7:6816/434435857 1 ==== osd_op_reply(1 10000000000.00000000 [delete] v89'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fbec000b720 con 0x55a7f913ca00 2024-04-25T10:00:43.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.447+0000 7fbec7debf40 1 -- 172.21.15.7:0/3329099691 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x55a7f913ca00 msgr2=0x55a7f91e2c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:43.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.447+0000 7fbec7debf40 1 --2- 172.21.15.7:0/3329099691 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x55a7f913ca00 0x55a7f91e2c30 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.447+0000 7fbec7debf40 1 -- 172.21.15.7:0/3329099691 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbea8069eb0 msgr2=0x7fbea806c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:43.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.447+0000 7fbec7debf40 1 --2- 172.21.15.7:0/3329099691 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbea8069eb0 0x7fbea806c370 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x55a7f91eb650 tx=0x7fbeb8009040 comp rx=0 tx=0).stop 2024-04-25T10:00:43.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.447+0000 7fbec7debf40 1 -- 172.21.15.7:0/3329099691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7f91cd270 msgr2=0x55a7f91e4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:43.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.447+0000 7fbec7debf40 1 --2- 172.21.15.7:0/3329099691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7f91cd270 0x55a7f91e4a90 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fbebc052610 tx=0x7fbebc002fb0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.447+0000 7fbec60ed640 1 -- 172.21.15.7:0/3329099691 reap_dead start 2024-04-25T10:00:43.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.447+0000 7fbec7debf40 1 -- 172.21.15.7:0/3329099691 shutdown_connections 2024-04-25T10:00:43.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.447+0000 7fbec7debf40 1 -- 172.21.15.7:0/3329099691 >> 172.21.15.7:0/3329099691 conn(0x55a7f910fa60 msgr2=0x55a7f91cb770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:43.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.447+0000 7fbec7debf40 1 -- 172.21.15.7:0/3329099691 shutdown_connections 2024-04-25T10:00:43.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.447+0000 7fbec7debf40 1 -- 172.21.15.7:0/3329099691 wait complete. 2024-04-25T10:00:43.455 DEBUG:teuthology.orchestra.run.smithi007:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset 2024-04-25T10:00:43.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.532+0000 7f571581f280 1 -- start start 2024-04-25T10:00:43.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.532+0000 7f571581f280 1 Processor -- start 2024-04-25T10:00:43.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.533+0000 7f571581f280 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56438ae32800 0x56438ad30b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.533+0000 7f571581f280 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56438ae33c00 0x56438ad31b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.533+0000 7f571581f280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56438ae33400 0x56438ad31080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.533+0000 7f571581f280 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x56438ae28000 con 0x56438ae32800 2024-04-25T10:00:43.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.533+0000 7f571581f280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56438ae28180 con 0x56438ae33400 2024-04-25T10:00:43.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.533+0000 7f571581f280 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x56438ae28300 con 0x56438ae33c00 2024-04-25T10:00:43.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.533+0000 7f5713353640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56438ae32800 0x56438ad30b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.533+0000 7f5713353640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56438ae32800 0x56438ad30b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49702/0 (socket says 172.21.15.7:49702) 2024-04-25T10:00:43.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.533+0000 7f5713353640 1 -- 172.21.15.7:0/486242327 learned_addr learned my addr 172.21.15.7:0/486242327 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:43.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.533+0000 7f5713353640 1 -- 172.21.15.7:0/486242327 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56438ae33c00 msgr2=0x56438ad31b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:43.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.533+0000 7f5713353640 1 --2- 172.21.15.7:0/486242327 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56438ae33c00 0x56438ad31b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.533+0000 7f5713b54640 1 --2- 172.21.15.7:0/486242327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56438ae33400 0x56438ad31080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.533+0000 7f5713353640 1 -- 172.21.15.7:0/486242327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56438ae33400 msgr2=0x56438ad31080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:43.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.533+0000 7f5713353640 1 --2- 172.21.15.7:0/486242327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56438ae33400 0x56438ad31080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.533+0000 7f5713353640 1 -- 172.21.15.7:0/486242327 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56438acf6780 con 0x56438ae32800 2024-04-25T10:00:43.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.533+0000 7f5713353640 1 --2- 172.21.15.7:0/486242327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56438ae32800 0x56438ad30b00 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x56438baef290 tx=0x56438ba8c060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2989baddfc704c14 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:43.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.533+0000 7f5710b4e640 1 -- 172.21.15.7:0/486242327 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56438ace6d00 con 0x56438ae32800 2024-04-25T10:00:43.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.533+0000 7f5710b4e640 1 -- 172.21.15.7:0/486242327 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56438acece00 con 0x56438ae32800 2024-04-25T10:00:43.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.533+0000 7f5710b4e640 1 -- 172.21.15.7:0/486242327 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56438ace6680 con 0x56438ae32800 2024-04-25T10:00:43.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.533+0000 7f571581f280 1 -- 172.21.15.7:0/486242327 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56438acf6000 con 0x56438ae32800 2024-04-25T10:00:43.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.533+0000 7f571581f280 1 -- 172.21.15.7:0/486242327 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x56438acf7a40 con 0x56438ae32800 2024-04-25T10:00:43.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.533+0000 7f571581f280 4 waiting for MDS map... 2024-04-25T10:00:43.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.534+0000 7f5710b4e640 1 -- 172.21.15.7:0/486242327 <== mon.0 v2:172.21.15.7:3300/0 4 ==== osd_map(89..89 src has 1..89) v4 ==== 6187+0+0 (secure 0 0 0) 0x56438bad0400 con 0x56438ae32800 2024-04-25T10:00:43.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.534+0000 7f5710b4e640 1 -- 172.21.15.7:0/486242327 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 54) v1 ==== 2723+0+0 (secure 0 0 0) 0x56438ad1b180 con 0x56438ae32800 2024-04-25T10:00:43.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.534+0000 7f571581f280 4 Got MDS map 54 2024-04-25T10:00:43.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.534+0000 7f571581f280 10 main: JournalTool::main 2024-04-25T10:00:43.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.534+0000 7f571581f280 4 main: JournalTool: connecting to RADOS... 2024-04-25T10:00:43.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.534+0000 7f571581f280 1 Processor -- start 2024-04-25T10:00:43.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.534+0000 7f571581f280 1 -- start start 2024-04-25T10:00:43.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.535+0000 7f571581f280 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56438bb8ec00 0x56438ad30580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.535+0000 7f571581f280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56438bb8f000 0x56438ad32100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.535+0000 7f571581f280 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56438bb8f400 0x56438ad32680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.535+0000 7f571581f280 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x56438ae28480 con 0x56438bb8ec00 2024-04-25T10:00:43.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.535+0000 7f571581f280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56438ae28600 con 0x56438bb8f000 2024-04-25T10:00:43.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.535+0000 7f571581f280 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x56438ae28780 con 0x56438bb8f400 2024-04-25T10:00:43.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.535+0000 7f5713b54640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56438bb8ec00 0x56438ad30580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.535+0000 7f5713b54640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56438bb8ec00 0x56438ad30580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49706/0 (socket says 172.21.15.7:49706) 2024-04-25T10:00:43.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.535+0000 7f5713b54640 1 -- 172.21.15.7:0/1340171040 learned_addr learned my addr 172.21.15.7:0/1340171040 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:43.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.535+0000 7f5712b52640 1 --2- 172.21.15.7:0/1340171040 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56438bb8f400 0x56438ad32680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.535+0000 7f5713353640 1 --2- 172.21.15.7:0/1340171040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56438bb8f000 0x56438ad32100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.535+0000 7f5713b54640 1 -- 172.21.15.7:0/1340171040 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56438bb8f400 msgr2=0x56438ad32680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:43.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.535+0000 7f5713b54640 1 --2- 172.21.15.7:0/1340171040 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56438bb8f400 0x56438ad32680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.535+0000 7f5713b54640 1 -- 172.21.15.7:0/1340171040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56438bb8f000 msgr2=0x56438ad32100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:43.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.535+0000 7f5713b54640 1 --2- 172.21.15.7:0/1340171040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56438bb8f000 0x56438ad32100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.535+0000 7f5713b54640 1 -- 172.21.15.7:0/1340171040 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56438acf7860 con 0x56438bb8ec00 2024-04-25T10:00:43.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.535+0000 7f5713b54640 1 --2- 172.21.15.7:0/1340171040 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56438bb8ec00 0x56438ad30580 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x56438acf5aa0 tx=0x56438ba447e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0bb5a9435a5a12 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:43.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.535+0000 7f570eb4a640 1 -- 172.21.15.7:0/1340171040 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56438ace6b60 con 0x56438bb8ec00 2024-04-25T10:00:43.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.536+0000 7f570eb4a640 1 -- 172.21.15.7:0/1340171040 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56438acec1c0 con 0x56438bb8ec00 2024-04-25T10:00:43.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.536+0000 7f570eb4a640 1 -- 172.21.15.7:0/1340171040 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56438ace6d00 con 0x56438bb8ec00 2024-04-25T10:00:43.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.536+0000 7f571581f280 1 -- 172.21.15.7:0/1340171040 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56438bb8ec00 msgr2=0x56438ad30580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:43.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.536+0000 7f571581f280 1 --2- 172.21.15.7:0/1340171040 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56438bb8ec00 0x56438ad30580 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x56438acf5aa0 tx=0x56438ba447e0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.536+0000 7f571581f280 1 -- 172.21.15.7:0/1340171040 shutdown_connections 2024-04-25T10:00:43.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.536+0000 7f571581f280 1 --2- 172.21.15.7:0/1340171040 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56438bb8f400 0x56438ad32680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.536+0000 7f571581f280 1 --2- 172.21.15.7:0/1340171040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56438bb8f000 0x56438ad32100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.536+0000 7f571581f280 1 --2- 172.21.15.7:0/1340171040 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56438bb8ec00 0x56438ad30580 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.536+0000 7f571581f280 1 -- 172.21.15.7:0/1340171040 >> 172.21.15.7:0/1340171040 conn(0x56438ae33800 msgr2=0x56438adbb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:43.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.536+0000 7f571581f280 1 -- 172.21.15.7:0/1340171040 shutdown_connections 2024-04-25T10:00:43.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.536+0000 7f571581f280 1 -- 172.21.15.7:0/1340171040 wait complete. 2024-04-25T10:00:43.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.537+0000 7f571581f280 1 Processor -- start 2024-04-25T10:00:43.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.537+0000 7f571581f280 1 -- start start 2024-04-25T10:00:43.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.537+0000 7f571581f280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56438bb8ec00 0x56438ad30580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.537+0000 7f571581f280 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56438bb8f000 0x56438ad32100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.537+0000 7f571581f280 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56438bb8f400 0x56438ad32680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.537+0000 7f571581f280 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x56438ae29c80 con 0x56438bb8f000 2024-04-25T10:00:43.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.537+0000 7f571581f280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56438ae29b00 con 0x56438bb8ec00 2024-04-25T10:00:43.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.537+0000 7f571581f280 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x56438ae29980 con 0x56438bb8f400 2024-04-25T10:00:43.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.537+0000 7f5713353640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56438bb8f000 0x56438ad32100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.537+0000 7f5713353640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56438bb8f000 0x56438ad32100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49716/0 (socket says 172.21.15.7:49716) 2024-04-25T10:00:43.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.537+0000 7f5713353640 1 -- 172.21.15.7:0/2071123680 learned_addr learned my addr 172.21.15.7:0/2071123680 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:43.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.537+0000 7f5713b54640 1 --2- 172.21.15.7:0/2071123680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56438bb8ec00 0x56438ad30580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.537+0000 7f5712b52640 1 --2- 172.21.15.7:0/2071123680 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56438bb8f400 0x56438ad32680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.538+0000 7f5713353640 1 -- 172.21.15.7:0/2071123680 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56438bb8f400 msgr2=0x56438ad32680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:43.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.538+0000 7f5713353640 1 --2- 172.21.15.7:0/2071123680 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56438bb8f400 0x56438ad32680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.538+0000 7f5713353640 1 -- 172.21.15.7:0/2071123680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56438bb8ec00 msgr2=0x56438ad30580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:43.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.538+0000 7f5713353640 1 --2- 172.21.15.7:0/2071123680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56438bb8ec00 0x56438ad30580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.538+0000 7f5713353640 1 -- 172.21.15.7:0/2071123680 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56438acf74a0 con 0x56438bb8f000 2024-04-25T10:00:43.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.538+0000 7f5713353640 1 --2- 172.21.15.7:0/2071123680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56438bb8f000 0x56438ad32100 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x56438baef680 tx=0x56438ba452c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:43.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.538+0000 7f570d347640 1 -- 172.21.15.7:0/2071123680 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56438ace6b60 con 0x56438bb8f000 2024-04-25T10:00:43.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.538+0000 7f570d347640 1 -- 172.21.15.7:0/2071123680 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56438acecc40 con 0x56438bb8f000 2024-04-25T10:00:43.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.538+0000 7f571581f280 1 -- 172.21.15.7:0/2071123680 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56438acf6960 con 0x56438bb8f000 2024-04-25T10:00:43.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.538+0000 7f570d347640 1 -- 172.21.15.7:0/2071123680 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56438ace6d00 con 0x56438bb8f000 2024-04-25T10:00:43.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.538+0000 7f571581f280 1 -- 172.21.15.7:0/2071123680 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56438acf6780 con 0x56438bb8f000 2024-04-25T10:00:43.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.538+0000 7f571581f280 4 main: JournalTool: resolving pool 13 2024-04-25T10:00:43.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.539+0000 7f570d347640 1 -- 172.21.15.7:0/2071123680 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x56438bbf6c00 con 0x56438bb8f000 2024-04-25T10:00:43.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.540+0000 7f570d347640 1 --2- 172.21.15.7:0/2071123680 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x56438bbfb000 0x56438ad33700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.540+0000 7f570d347640 1 -- 172.21.15.7:0/2071123680 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6187+0+0 (secure 0 0 0) 0x56438bbf4800 con 0x56438bb8f000 2024-04-25T10:00:43.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.540+0000 7f5713b54640 1 --2- 172.21.15.7:0/2071123680 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x56438bbfb000 0x56438ad33700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.540+0000 7f571581f280 4 main: JournalTool: creating IoCtx.. 2024-04-25T10:00:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.540+0000 7f571581f280 4 main: Executing for rank 0 2024-04-25T10:00:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.540+0000 7f5713b54640 1 --2- 172.21.15.7:0/2071123680 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x56438bbfb000 0x56438ad33700 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x56438acf5aa0 tx=0x56438ba45a40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.540+0000 7f571581f280 1 -- start start 2024-04-25T10:00:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.540+0000 7f571581f280 1 Processor -- start 2024-04-25T10:00:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.541+0000 7f571581f280 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56438bb8fc00 0x56438ad32c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.541+0000 7f571581f280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56438bbfb400 0x56438ad33180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.541+0000 7f571581f280 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56438bbfb800 0x56438b088000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.541+0000 7f571581f280 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x56438ae29680 con 0x56438bbfb800 2024-04-25T10:00:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.541+0000 7f571581f280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56438ae29500 con 0x56438bbfb400 2024-04-25T10:00:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.541+0000 7f571581f280 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x56438ae28480 con 0x56438bb8fc00 2024-04-25T10:00:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.541+0000 7f5712b52640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56438bbfb800 0x56438b088000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.541+0000 7f5712b52640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56438bbfb800 0x56438b088000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49732/0 (socket says 172.21.15.7:49732) 2024-04-25T10:00:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.541+0000 7f5712b52640 1 -- 172.21.15.7:0/2192478266 learned_addr learned my addr 172.21.15.7:0/2192478266 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.541+0000 7f5713353640 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56438bbfb400 0x56438ad33180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.541+0000 7f5713b54640 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56438bb8fc00 0x56438ad32c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.541+0000 7f5712b52640 1 -- 172.21.15.7:0/2192478266 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56438bb8fc00 msgr2=0x56438ad32c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.541+0000 7f5712b52640 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56438bb8fc00 0x56438ad32c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.541+0000 7f5712b52640 1 -- 172.21.15.7:0/2192478266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56438bbfb400 msgr2=0x56438ad33180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.541+0000 7f5712b52640 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56438bbfb400 0x56438ad33180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.541+0000 7f5712b52640 1 -- 172.21.15.7:0/2192478266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56438acf6000 con 0x56438bbfb800 2024-04-25T10:00:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.541+0000 7f5713353640 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56438bbfb400 0x56438ad33180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:00:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.542+0000 7f5712b52640 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56438bbfb800 0x56438b088000 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x56438afcba40 tx=0x56438b035800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a766e09a88aeb510 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.542+0000 7f570a341640 1 -- 172.21.15.7:0/2192478266 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56438bc2f6c0 con 0x56438bbfb800 2024-04-25T10:00:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.542+0000 7f570a341640 1 -- 172.21.15.7:0/2192478266 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56438acec700 con 0x56438bbfb800 2024-04-25T10:00:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.542+0000 7f570a341640 1 -- 172.21.15.7:0/2192478266 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56438bc31860 con 0x56438bbfb800 2024-04-25T10:00:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.542+0000 7f571581f280 1 -- 172.21.15.7:0/2192478266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56438acf7680 con 0x56438bbfb800 2024-04-25T10:00:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.542+0000 7f571581f280 1 -- 172.21.15.7:0/2192478266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x56438acf63c0 con 0x56438bbfb800 2024-04-25T10:00:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.542+0000 7f571581f280 4 waiting for MDS map... 2024-04-25T10:00:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.542+0000 7f570a341640 1 -- 172.21.15.7:0/2192478266 <== mon.0 v2:172.21.15.7:3300/0 4 ==== osd_map(89..89 src has 1..89) v4 ==== 6187+0+0 (secure 0 0 0) 0x56438b08ea00 con 0x56438bbfb800 2024-04-25T10:00:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.542+0000 7f570a341640 1 -- 172.21.15.7:0/2192478266 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 54) v1 ==== 2723+0+0 (secure 0 0 0) 0x56438b0a0000 con 0x56438bbfb800 2024-04-25T10:00:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.542+0000 7f571581f280 4 Got MDS map 54 2024-04-25T10:00:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.542+0000 7f571581f280 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x56438bbfbc00 0x56438b088580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.542+0000 7f571581f280 1 -- 172.21.15.7:0/2192478266 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:1 13.f 13:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89) v9 -- 0x56438b08d000 con 0x56438bbfbc00 2024-04-25T10:00:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.542+0000 7f5713b54640 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x56438bbfbc00 0x56438b088580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.543+0000 7f5713b54640 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x56438bbfbc00 0x56438b088580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=a8c7f11d9a308558 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.545+0000 7f5713b54640 1 -- 172.21.15.7:0/2192478266 <== osd.6 v2:172.21.15.55:6824/4293769515 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x56438ba40000 con 0x56438bbfbc00 2024-04-25T10:00:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.546+0000 7f571581f280 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x56438b08d400 0x56438b088b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.546+0000 7f571581f280 1 -- 172.21.15.7:0/2192478266 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:2 13.14 13:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89) v9 -- 0x56438b08d800 con 0x56438b08d400 2024-04-25T10:00:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.546+0000 7f5713353640 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x56438b08d400 0x56438b088b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.546+0000 7f5713353640 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x56438b08d400 0x56438b088b00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=6c07f6a84d86fb9e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.546+0000 7f5713353640 1 -- 172.21.15.7:0/2192478266 <== osd.0 v2:172.21.15.7:6800/4167741236 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv20 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x56438ba40500 con 0x56438b08d400 2024-04-25T10:00:43.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.546+0000 7f5708b3e640 1 -- 172.21.15.7:0/2192478266 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:3 13.14 13:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e89) v9 -- 0x56438b0b0000 con 0x56438b08d400 2024-04-25T10:00:43.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.546+0000 7f5708b3e640 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x56438b0b0400 0x56438b089b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.546+0000 7f5708b3e640 1 -- 172.21.15.7:0/2192478266 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:4 13.1b 13:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e89) v9 -- 0x56438b0b0800 con 0x56438b0b0400 2024-04-25T10:00:43.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.547+0000 7f5713353640 1 -- 172.21.15.7:0/2192478266 <== osd.0 v2:172.21.15.7:6800/4167741236 2 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv17 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x56438ba40500 con 0x56438b08d400 2024-04-25T10:00:43.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.547+0000 7f5713b54640 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x56438b0b0400 0x56438b089b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.547+0000 7f5713b54640 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x56438b0b0400 0x56438b089b80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=d5f88dfe8a85b309 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:43.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.547+0000 7f5713b54640 1 -- 172.21.15.7:0/2192478266 <== osd.4 v2:172.21.15.55:6808/2248155105 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x56438ba40000 con 0x56438b0b0400 2024-04-25T10:00:43.557 INFO:teuthology.orchestra.run.smithi007.stdout:old journal was 4212724~2605 2024-04-25T10:00:43.558 INFO:teuthology.orchestra.run.smithi007.stdout:new journal start will be 8388608 (4173279 bytes past old end) 2024-04-25T10:00:43.558 INFO:teuthology.orchestra.run.smithi007.stdout:writing journal head 2024-04-25T10:00:43.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.547+0000 7f571581f280 1 -- 172.21.15.7:0/2192478266 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:5 13.14 13:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) v9 -- 0x56438b08dc00 con 0x56438b08d400 2024-04-25T10:00:43.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.549+0000 7f5713353640 1 -- 172.21.15.7:0/2192478266 <== osd.0 v2:172.21.15.7:6800/4167741236 3 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v89'21 uv21 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x56438ba40500 con 0x56438b08d400 2024-04-25T10:00:43.558 INFO:teuthology.orchestra.run.smithi007.stdout:writing EResetJournal entry 2024-04-25T10:00:43.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.549+0000 7f571581f280 1 -- 172.21.15.7:0/2192478266 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:6 13.1b 13:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) v9 -- 0x56438b0b0000 con 0x56438b0b0400 2024-04-25T10:00:43.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.549+0000 7f571581f280 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x56438b0b0c00 0x56438b089080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.549+0000 7f571581f280 1 -- 172.21.15.7:0/2192478266 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:7 13.b 13:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) v9 -- 0x56438b0b1000 con 0x56438b0b0c00 2024-04-25T10:00:43.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.549+0000 7f571581f280 1 -- 172.21.15.7:0/2192478266 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:8 13.1f 13:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) v9 -- 0x56438b08d800 con 0x56438bbfbc00 2024-04-25T10:00:43.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.549+0000 7f571581f280 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x56438b08dc00 0x56438b089600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.549+0000 7f571581f280 1 -- 172.21.15.7:0/2192478266 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:9 13.1a 13:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) v9 -- 0x56438bbfac00 con 0x56438b08dc00 2024-04-25T10:00:43.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.549+0000 7f571581f280 1 -- 172.21.15.7:0/2192478266 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:10 13.1e 13:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) v9 -- 0x56438bbfa800 con 0x56438b0b0400 2024-04-25T10:00:43.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.549+0000 7f571581f280 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x56438bbfa400 0x56438b08a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.549+0000 7f571581f280 1 -- 172.21.15.7:0/2192478266 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:11 13.1d 13:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) v9 -- 0x56438b0b0800 con 0x56438bbfa400 2024-04-25T10:00:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.549+0000 7f5712b52640 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x56438b08dc00 0x56438b089600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.549+0000 7f5713353640 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x56438b0b0c00 0x56438b089080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.549+0000 7f5713b54640 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x56438bbfa400 0x56438b08a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.549+0000 7f5712b52640 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x56438b08dc00 0x56438b089600 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=c4e9c3ef0ad94a8f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.550+0000 7f5713353640 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x56438b0b0c00 0x56438b089080 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=c1fd22c51bfa336b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.550+0000 7f5713b54640 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x56438bbfa400 0x56438b08a100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=1548afc658f5ba5d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.550+0000 7f5713b54640 1 -- 172.21.15.7:0/2192478266 <== osd.6 v2:172.21.15.55:6824/4293769515 2 ==== osd_op_reply(8 200.00000004 [delete] v89'7 uv6 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x56438ba40000 con 0x56438bbfbc00 2024-04-25T10:00:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.550+0000 7f5712b52640 1 -- 172.21.15.7:0/2192478266 <== osd.1 v2:172.21.15.7:6816/434435857 1 ==== osd_op_reply(9 200.00000005 [delete] v89'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x56438ba40780 con 0x56438b08dc00 2024-04-25T10:00:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.550+0000 7f5713b54640 1 -- 172.21.15.7:0/2192478266 <== osd.4 v2:172.21.15.55:6808/2248155105 2 ==== osd_op_reply(6 200.00000002 [delete] v89'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x56438ba40000 con 0x56438b0b0400 2024-04-25T10:00:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.551+0000 7f5713b54640 1 -- 172.21.15.7:0/2192478266 <== osd.4 v2:172.21.15.55:6808/2248155105 3 ==== osd_op_reply(10 200.00000006 [delete] v89'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x56438ba40000 con 0x56438b0b0400 2024-04-25T10:00:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.553+0000 7f5713353640 1 -- 172.21.15.7:0/2192478266 <== osd.5 v2:172.21.15.55:6800/2514169616 1 ==== osd_op_reply(7 200.00000003 [delete] v89'4 uv3 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x56438ba40500 con 0x56438b0b0c00 2024-04-25T10:00:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.553+0000 7f5708b3e640 1 -- 172.21.15.7:0/2192478266 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:12 13.1b 13:ddb4e4d7:::200.00000002:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) v9 -- 0x56438b0c2000 con 0x56438b0b0400 2024-04-25T10:00:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.554+0000 7f5713b54640 1 -- 172.21.15.7:0/2192478266 <== osd.7 v2:172.21.15.55:6816/2960381217 1 ==== osd_op_reply(11 200.00000007 [delete] v89'3 uv2 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x56438ba40000 con 0x56438bbfa400 2024-04-25T10:00:43.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.554+0000 7f5713b54640 1 -- 172.21.15.7:0/2192478266 <== osd.4 v2:172.21.15.55:6808/2248155105 4 ==== osd_op_reply(12 200.00000002 [write 0~48] v89'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x56438ba40000 con 0x56438b0b0400 2024-04-25T10:00:43.563 INFO:teuthology.orchestra.run.smithi007.stdout:done 2024-04-25T10:00:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.554+0000 7f571581f280 1 -- 172.21.15.7:0/2192478266 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x56438b08d400 msgr2=0x56438b088b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.554+0000 7f571581f280 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x56438b08d400 0x56438b088b00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.554+0000 7f571581f280 1 -- 172.21.15.7:0/2192478266 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x56438b08dc00 msgr2=0x56438b089600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.554+0000 7f571581f280 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x56438b08dc00 0x56438b089600 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.554+0000 7f571581f280 1 -- 172.21.15.7:0/2192478266 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x56438b0b0400 msgr2=0x56438b089b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.554+0000 7f571581f280 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x56438b0b0400 0x56438b089b80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.554+0000 7f571581f280 1 -- 172.21.15.7:0/2192478266 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x56438b0b0c00 msgr2=0x56438b089080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.554+0000 7f571581f280 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x56438b0b0c00 0x56438b089080 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.554+0000 7f571581f280 1 -- 172.21.15.7:0/2192478266 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x56438bbfbc00 msgr2=0x56438b088580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.554+0000 7f571581f280 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x56438bbfbc00 0x56438b088580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.555+0000 7f571581f280 1 -- 172.21.15.7:0/2192478266 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x56438bbfa400 msgr2=0x56438b08a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.555+0000 7f571581f280 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x56438bbfa400 0x56438b08a100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.555+0000 7f5712b52640 1 -- 172.21.15.7:0/2192478266 reap_dead start 2024-04-25T10:00:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.555+0000 7f571581f280 1 -- 172.21.15.7:0/2192478266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56438bbfb800 msgr2=0x56438b088000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.555+0000 7f571581f280 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56438bbfb800 0x56438b088000 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x56438afcba40 tx=0x56438b035800 comp rx=0 tx=0).stop 2024-04-25T10:00:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.555+0000 7f571581f280 1 -- 172.21.15.7:0/2192478266 shutdown_connections 2024-04-25T10:00:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.555+0000 7f571581f280 1 --2- 172.21.15.7:0/2192478266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56438bbfb800 0x56438b088000 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.555+0000 7f571581f280 1 -- 172.21.15.7:0/2192478266 >> 172.21.15.7:0/2192478266 conn(0x56438bb8f800 msgr2=0x56438adbb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.555+0000 7f571581f280 1 -- 172.21.15.7:0/2192478266 shutdown_connections 2024-04-25T10:00:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.555+0000 7f571581f280 1 -- 172.21.15.7:0/2192478266 wait complete. 2024-04-25T10:00:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.555+0000 7f571581f280 1 -- 172.21.15.7:0/2071123680 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x56438bbfb000 msgr2=0x56438ad33700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.555+0000 7f571581f280 1 --2- 172.21.15.7:0/2071123680 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x56438bbfb000 0x56438ad33700 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x56438acf5aa0 tx=0x56438ba45a40 comp rx=0 tx=0).stop 2024-04-25T10:00:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.555+0000 7f571581f280 1 -- 172.21.15.7:0/2071123680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56438bb8f000 msgr2=0x56438ad32100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.555+0000 7f571581f280 1 --2- 172.21.15.7:0/2071123680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56438bb8f000 0x56438ad32100 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x56438baef680 tx=0x56438ba452c0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.555+0000 7f571581f280 1 -- 172.21.15.7:0/2071123680 shutdown_connections 2024-04-25T10:00:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.555+0000 7f571581f280 1 --2- 172.21.15.7:0/2071123680 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x56438bbfb000 0x56438ad33700 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.555+0000 7f571581f280 1 --2- 172.21.15.7:0/2071123680 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56438bb8f400 0x56438ad32680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.555+0000 7f571581f280 1 --2- 172.21.15.7:0/2071123680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56438bb8f000 0x56438ad32100 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.555+0000 7f571581f280 1 --2- 172.21.15.7:0/2071123680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56438bb8ec00 0x56438ad30580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.555+0000 7f571581f280 1 -- 172.21.15.7:0/2071123680 >> 172.21.15.7:0/2071123680 conn(0x56438ae33800 msgr2=0x56438adbb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.555+0000 7f571581f280 1 -- 172.21.15.7:0/2071123680 shutdown_connections 2024-04-25T10:00:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.555+0000 7f571581f280 1 -- 172.21.15.7:0/2071123680 wait complete. 2024-04-25T10:00:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.555+0000 7f571581f280 1 -- 172.21.15.7:0/486242327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56438ae32800 msgr2=0x56438ad30b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.555+0000 7f571581f280 1 --2- 172.21.15.7:0/486242327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56438ae32800 0x56438ad30b00 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x56438baef290 tx=0x56438ba8c060 comp rx=0 tx=0).stop 2024-04-25T10:00:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.555+0000 7f571581f280 1 -- 172.21.15.7:0/486242327 shutdown_connections 2024-04-25T10:00:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.555+0000 7f571581f280 1 --2- 172.21.15.7:0/486242327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56438ae33400 0x56438ad31080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.555+0000 7f571581f280 1 --2- 172.21.15.7:0/486242327 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56438ae33c00 0x56438ad31b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.556+0000 7f571581f280 1 --2- 172.21.15.7:0/486242327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56438ae32800 0x56438ad30b00 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.556+0000 7f571581f280 1 -- 172.21.15.7:0/486242327 >> 172.21.15.7:0/486242327 conn(0x56438acc1000 msgr2=0x56438adba000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:43.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.556+0000 7f571581f280 1 -- 172.21.15.7:0/486242327 shutdown_connections 2024-04-25T10:00:43.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.556+0000 7f571581f280 1 -- 172.21.15.7:0/486242327 wait complete. 2024-04-25T10:00:43.569 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset'] in time 0:00:00.114100, result: old journal was 4212724~2605 new journal start will be 8388608 (4173279 bytes past old end) writing journal head writing EResetJournal entry done 2024-04-25T10:00:43.569 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T10:00:43.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.705+0000 7ff47bd42640 1 Processor -- start 2024-04-25T10:00:43.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.706+0000 7ff47bd42640 1 -- start start 2024-04-25T10:00:43.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.706+0000 7ff47bd42640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff4740cfc40 0x7ff4740d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.706+0000 7ff47bd42640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff4740b1480 0x7ff4740b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.706+0000 7ff47bd42640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4740ce070 0x7ff4740ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.706+0000 7ff47bd42640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4740b25e0 con 0x7ff4740b1480 2024-04-25T10:00:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.706+0000 7ff47bd42640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff47415bec0 con 0x7ff4740cfc40 2024-04-25T10:00:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.706+0000 7ff47bd42640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4740d0560 con 0x7ff4740ce070 2024-04-25T10:00:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.707+0000 7ff4792dd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff4740b1480 0x7ff4740b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.707+0000 7ff4792dd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff4740b1480 0x7ff4740b0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49738/0 (socket says 172.21.15.7:49738) 2024-04-25T10:00:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.707+0000 7ff4792dd640 1 -- 172.21.15.7:0/3664070246 learned_addr learned my addr 172.21.15.7:0/3664070246 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.707+0000 7ff4792dd640 1 -- 172.21.15.7:0/3664070246 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4740ce070 msgr2=0x7ff4740ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.707+0000 7ff4792dd640 1 --2- 172.21.15.7:0/3664070246 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4740ce070 0x7ff4740ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.707+0000 7ff4792dd640 1 -- 172.21.15.7:0/3664070246 >> v2:172.21.15.55:3300/0 conn(0x7ff4740cfc40 msgr2=0x7ff4740d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.707+0000 7ff4792dd640 1 --2- 172.21.15.7:0/3664070246 >> v2:172.21.15.55:3300/0 conn(0x7ff4740cfc40 0x7ff4740d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.707+0000 7ff4792dd640 1 -- 172.21.15.7:0/3664070246 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4740b19d0 con 0x7ff4740b1480 2024-04-25T10:00:43.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.708+0000 7ff4792dd640 1 --2- 172.21.15.7:0/3664070246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4740b1480 0x7ff4740b0ad0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7ff4740cf110 tx=0x7ff46402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4697f58f2a967758 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:43.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.708+0000 7ff478adc640 1 -- 172.21.15.7:0/3664070246 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff464037070 con 0x7ff4740b1480 2024-04-25T10:00:43.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.708+0000 7ff478adc640 1 -- 172.21.15.7:0/3664070246 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff464032440 con 0x7ff4740b1480 2024-04-25T10:00:43.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.708+0000 7ff478adc640 1 -- 172.21.15.7:0/3664070246 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff464032810 con 0x7ff4740b1480 2024-04-25T10:00:43.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.708+0000 7ff47bd42640 1 -- 172.21.15.7:0/3664070246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4740b1480 msgr2=0x7ff4740b0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:43.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.708+0000 7ff47bd42640 1 --2- 172.21.15.7:0/3664070246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4740b1480 0x7ff4740b0ad0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7ff4740cf110 tx=0x7ff46402a1e0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.708+0000 7ff47bd42640 1 -- 172.21.15.7:0/3664070246 shutdown_connections 2024-04-25T10:00:43.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.708+0000 7ff47bd42640 1 --2- 172.21.15.7:0/3664070246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4740b1480 0x7ff4740b0ad0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.708+0000 7ff47bd42640 1 --2- 172.21.15.7:0/3664070246 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4740ce070 0x7ff4740ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.708+0000 7ff47bd42640 1 --2- 172.21.15.7:0/3664070246 >> v2:172.21.15.55:3300/0 conn(0x7ff4740cfc40 0x7ff4740d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.708+0000 7ff47bd42640 1 -- 172.21.15.7:0/3664070246 >> 172.21.15.7:0/3664070246 conn(0x7ff47408af80 msgr2=0x7ff47408b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:43.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.708+0000 7ff47bd42640 1 -- 172.21.15.7:0/3664070246 shutdown_connections 2024-04-25T10:00:43.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.708+0000 7ff47bd42640 1 -- 172.21.15.7:0/3664070246 wait complete. 2024-04-25T10:00:43.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.710+0000 7ff47bd42640 1 Processor -- start 2024-04-25T10:00:43.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.710+0000 7ff47bd42640 1 -- start start 2024-04-25T10:00:43.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.710+0000 7ff47bd42640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4740b1480 0x7ff4741f4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.710+0000 7ff47bd42640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4740ce070 0x7ff4740c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.710+0000 7ff47bd42640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4740cfc40 0x7ff4740b6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.710+0000 7ff47bd42640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4740b2270 con 0x7ff4740cfc40 2024-04-25T10:00:43.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.710+0000 7ff47bd42640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4740b1f90 con 0x7ff4740b1480 2024-04-25T10:00:43.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.710+0000 7ff47bd42640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4740b1010 con 0x7ff4740ce070 2024-04-25T10:00:43.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.710+0000 7ff47a2df640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4740cfc40 0x7ff4740b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.710+0000 7ff47a2df640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4740cfc40 0x7ff4740b6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49740/0 (socket says 172.21.15.7:49740) 2024-04-25T10:00:43.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.710+0000 7ff47a2df640 1 -- 172.21.15.7:0/1614141848 learned_addr learned my addr 172.21.15.7:0/1614141848 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:43.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.711+0000 7ff479ade640 1 --2- 172.21.15.7:0/1614141848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4740b1480 0x7ff4741f4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.711+0000 7ff4792dd640 1 --2- 172.21.15.7:0/1614141848 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4740ce070 0x7ff4740c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.711+0000 7ff47a2df640 1 -- 172.21.15.7:0/1614141848 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4740ce070 msgr2=0x7ff4740c58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:43.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.711+0000 7ff47a2df640 1 --2- 172.21.15.7:0/1614141848 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4740ce070 0x7ff4740c58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.711+0000 7ff47a2df640 1 -- 172.21.15.7:0/1614141848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4740b1480 msgr2=0x7ff4741f4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:43.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.711+0000 7ff47a2df640 1 --2- 172.21.15.7:0/1614141848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4740b1480 0x7ff4741f4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:43.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.711+0000 7ff47a2df640 1 -- 172.21.15.7:0/1614141848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4740c6230 con 0x7ff4740cfc40 2024-04-25T10:00:43.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.711+0000 7ff4792dd640 1 --2- 172.21.15.7:0/1614141848 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4740ce070 0x7ff4740c58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:43.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.711+0000 7ff479ade640 1 --2- 172.21.15.7:0/1614141848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4740b1480 0x7ff4741f4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:43.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.711+0000 7ff47a2df640 1 --2- 172.21.15.7:0/1614141848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4740cfc40 0x7ff4740b6410 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7ff46c00b9a0 tx=0x7ff46c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:43.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.711+0000 7ff46a7fc640 1 -- 172.21.15.7:0/1614141848 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c019070 con 0x7ff4740cfc40 2024-04-25T10:00:43.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.711+0000 7ff46a7fc640 1 -- 172.21.15.7:0/1614141848 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46c00cbc0 con 0x7ff4740cfc40 2024-04-25T10:00:43.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.711+0000 7ff47bd42640 1 -- 172.21.15.7:0/1614141848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4740c6510 con 0x7ff4740cfc40 2024-04-25T10:00:43.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.711+0000 7ff46a7fc640 1 -- 172.21.15.7:0/1614141848 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c014440 con 0x7ff4740cfc40 2024-04-25T10:00:43.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.711+0000 7ff47bd42640 1 -- 172.21.15.7:0/1614141848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4740c6ad0 con 0x7ff4740cfc40 2024-04-25T10:00:43.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.712+0000 7ff47bd42640 1 -- 172.21.15.7:0/1614141848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff474068f60 con 0x7ff4740cfc40 2024-04-25T10:00:43.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.712+0000 7ff46a7fc640 1 -- 172.21.15.7:0/1614141848 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff46c01c070 con 0x7ff4740cfc40 2024-04-25T10:00:43.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.713+0000 7ff46a7fc640 1 --2- 172.21.15.7:0/1614141848 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff45806b4d0 0x7ff45806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:43.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.713+0000 7ff46a7fc640 1 -- 172.21.15.7:0/1614141848 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6187+0+0 (secure 0 0 0) 0x7ff46c08a160 con 0x7ff4740cfc40 2024-04-25T10:00:43.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.713+0000 7ff479ade640 1 --2- 172.21.15.7:0/1614141848 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff45806b4d0 0x7ff45806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:43.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.713+0000 7ff479ade640 1 --2- 172.21.15.7:0/1614141848 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff45806b4d0 0x7ff45806d990 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff47406fd70 tx=0x7ff470008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:43.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.717+0000 7ff46a7fc640 1 -- 172.21.15.7:0/1614141848 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff46c058e00 con 0x7ff4740cfc40 2024-04-25T10:00:43.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:43.939+0000 7ff47bd42640 1 -- 172.21.15.7:0/1614141848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7ff4740b73e0 con 0x7ff4740cfc40 2024-04-25T10:00:44.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.381+0000 7ff46a7fc640 1 -- 172.21.15.7:0/1614141848 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v55) v1 ==== 162+0+0 (secure 0 0 0) 0x7ff46c058700 con 0x7ff4740cfc40 2024-04-25T10:00:44.386 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T10:00:44.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.384+0000 7ff47bd42640 1 -- 172.21.15.7:0/1614141848 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff45806b4d0 msgr2=0x7ff45806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:44.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.384+0000 7ff47bd42640 1 --2- 172.21.15.7:0/1614141848 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff45806b4d0 0x7ff45806d990 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff47406fd70 tx=0x7ff470008040 comp rx=0 tx=0).stop 2024-04-25T10:00:44.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.384+0000 7ff47bd42640 1 -- 172.21.15.7:0/1614141848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4740cfc40 msgr2=0x7ff4740b6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:44.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.384+0000 7ff47bd42640 1 --2- 172.21.15.7:0/1614141848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4740cfc40 0x7ff4740b6410 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7ff46c00b9a0 tx=0x7ff46c00be60 comp rx=0 tx=0).stop 2024-04-25T10:00:44.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.384+0000 7ff47bd42640 1 -- 172.21.15.7:0/1614141848 shutdown_connections 2024-04-25T10:00:44.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.384+0000 7ff47bd42640 1 --2- 172.21.15.7:0/1614141848 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff45806b4d0 0x7ff45806d990 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:44.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.384+0000 7ff47bd42640 1 --2- 172.21.15.7:0/1614141848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4740cfc40 0x7ff4740b6410 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:44.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.384+0000 7ff47bd42640 1 --2- 172.21.15.7:0/1614141848 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4740ce070 0x7ff4740c58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:44.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.384+0000 7ff47bd42640 1 --2- 172.21.15.7:0/1614141848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4740b1480 0x7ff4741f4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:44.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.384+0000 7ff47bd42640 1 -- 172.21.15.7:0/1614141848 >> 172.21.15.7:0/1614141848 conn(0x7ff47408af80 msgr2=0x7ff4740d1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:44.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.384+0000 7ff47bd42640 1 -- 172.21.15.7:0/1614141848 shutdown_connections 2024-04-25T10:00:44.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.384+0000 7ff47bd42640 1 -- 172.21.15.7:0/1614141848 wait complete. 2024-04-25T10:00:44.402 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:00:44.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.501+0000 7f641a96a640 1 Processor -- start 2024-04-25T10:00:44.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.501+0000 7f641a96a640 1 -- start start 2024-04-25T10:00:44.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.502+0000 7f641a96a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f64140d0a50 0x7f64140d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:44.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.502+0000 7f641a96a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f64140b53b0 0x7f64140d2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:44.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.502+0000 7f641a96a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64140d1e80 con 0x7f641415db00 2024-04-25T10:00:44.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.502+0000 7f641a96a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64140b5930 con 0x7f64140d0a50 2024-04-25T10:00:44.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.502+0000 7f641a96a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64140b5c10 con 0x7f64140b53b0 2024-04-25T10:00:44.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.502+0000 7f6413fff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f641415db00 0x7f64140d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45392/0 (socket says 172.21.15.7:45392) 2024-04-25T10:00:44.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.502+0000 7f6413fff640 1 -- 172.21.15.7:0/900935456 learned_addr learned my addr 172.21.15.7:0/900935456 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:44.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.502+0000 7f6412ffd640 1 -- 172.21.15.7:0/900935456 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2557866516 0 0) 0x7f64140d1e80 con 0x7f641415db00 2024-04-25T10:00:44.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.502+0000 7f6418f07640 1 --2- 172.21.15.7:0/900935456 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f64140b53b0 0x7f64140d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:44.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.502+0000 7f64137fe640 1 --2- 172.21.15.7:0/900935456 >> v2:172.21.15.55:3300/0 conn(0x7f64140d0a50 0x7f64140d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:44.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.502+0000 7f6412ffd640 1 -- 172.21.15.7:0/900935456 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63fc003520 con 0x7f641415db00 2024-04-25T10:00:44.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.502+0000 7f6412ffd640 1 -- 172.21.15.7:0/900935456 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 844907099 0 0) 0x7f63fc003520 con 0x7f641415db00 2024-04-25T10:00:44.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.502+0000 7f6412ffd640 1 -- 172.21.15.7:0/900935456 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f64140b53b0 msgr2=0x7f64140d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:44.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.502+0000 7f6412ffd640 1 --2- 172.21.15.7:0/900935456 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f64140b53b0 0x7f64140d2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:44.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.502+0000 7f6412ffd640 1 -- 172.21.15.7:0/900935456 >> v2:172.21.15.55:3300/0 conn(0x7f64140d0a50 msgr2=0x7f64140d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:44.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.502+0000 7f6412ffd640 1 --2- 172.21.15.7:0/900935456 >> v2:172.21.15.55:3300/0 conn(0x7f64140d0a50 0x7f64140d2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:44.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.502+0000 7f6412ffd640 1 -- 172.21.15.7:0/900935456 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64140b5ef0 con 0x7f641415db00 2024-04-25T10:00:44.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.502+0000 7f6412ffd640 1 -- 172.21.15.7:0/900935456 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f6404001670 con 0x7f641415db00 2024-04-25T10:00:44.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.502+0000 7f64137fe640 1 --2- 172.21.15.7:0/900935456 >> v2:172.21.15.55:3300/0 conn(0x7f64140d0a50 0x7f64140d2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:44.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.503+0000 7f6412ffd640 1 -- 172.21.15.7:0/900935456 >> v1:172.21.15.7:6789/0 conn(0x7f641415db00 legacy=0x7f64140d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:44.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.503+0000 7f6412ffd640 1 --2- 172.21.15.7:0/900935456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63fc0039b0 0x7f63fc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:44.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.503+0000 7f6412ffd640 1 --2- 172.21.15.7:0/900935456 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f64140b53b0 0x7f63fc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:44.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.503+0000 7f6412ffd640 1 --2- 172.21.15.7:0/900935456 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63fc004d40 0x7f63fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:44.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.503+0000 7f6412ffd640 1 -- 172.21.15.7:0/900935456 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64140b5930 con 0x7f63fc0039b0 2024-04-25T10:00:44.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.503+0000 7f6412ffd640 1 -- 172.21.15.7:0/900935456 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64140b5c10 con 0x7f63fc004d40 2024-04-25T10:00:44.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.503+0000 7f6412ffd640 1 -- 172.21.15.7:0/900935456 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc00b9f0 con 0x7f64140b53b0 2024-04-25T10:00:44.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.503+0000 7f6413fff640 1 --2- 172.21.15.7:0/900935456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63fc0039b0 0x7f63fc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:44.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.503+0000 7f64137fe640 1 --2- 172.21.15.7:0/900935456 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f64140b53b0 0x7f63fc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:44.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.503+0000 7f6418f07640 1 --2- 172.21.15.7:0/900935456 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63fc004d40 0x7f63fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:44.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.503+0000 7f6413fff640 1 -- 172.21.15.7:0/900935456 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f64140b53b0 msgr2=0x7f63fc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:44.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.503+0000 7f6413fff640 1 --2- 172.21.15.7:0/900935456 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f64140b53b0 0x7f63fc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:44.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.503+0000 7f6413fff640 1 -- 172.21.15.7:0/900935456 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63fc004d40 msgr2=0x7f63fc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:44.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.503+0000 7f6413fff640 1 --2- 172.21.15.7:0/900935456 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63fc004d40 0x7f63fc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:44.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.503+0000 7f6413fff640 1 -- 172.21.15.7:0/900935456 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63fc003520 con 0x7f63fc0039b0 2024-04-25T10:00:44.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.503+0000 7f6418f07640 1 --2- 172.21.15.7:0/900935456 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63fc004d40 0x7f63fc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:44.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.504+0000 7f6413fff640 1 --2- 172.21.15.7:0/900935456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63fc0039b0 0x7f63fc003dd0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f6404001050 tx=0x7f63fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b2e50442e77b5d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:44.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.504+0000 7f6412ffd640 1 -- 172.21.15.7:0/900935456 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640402e070 con 0x7f63fc0039b0 2024-04-25T10:00:44.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.504+0000 7f6412ffd640 1 -- 172.21.15.7:0/900935456 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6404005af0 con 0x7f63fc0039b0 2024-04-25T10:00:44.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.504+0000 7f6412ffd640 1 -- 172.21.15.7:0/900935456 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6404007d70 con 0x7f63fc0039b0 2024-04-25T10:00:44.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.504+0000 7f641a96a640 1 -- 172.21.15.7:0/900935456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63fc0039b0 msgr2=0x7f63fc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:44.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.504+0000 7f641a96a640 1 --2- 172.21.15.7:0/900935456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63fc0039b0 0x7f63fc003dd0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f6404001050 tx=0x7f63fc005830 comp rx=0 tx=0).stop 2024-04-25T10:00:44.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.504+0000 7f6418f07640 1 -- 172.21.15.7:0/900935456 reap_dead start 2024-04-25T10:00:44.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.504+0000 7f641a96a640 1 -- 172.21.15.7:0/900935456 shutdown_connections 2024-04-25T10:00:44.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.504+0000 7f641a96a640 1 -- 172.21.15.7:0/900935456 >> 172.21.15.7:0/900935456 conn(0x7f6414072290 msgr2=0x7f64140726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:44.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.504+0000 7f641a96a640 1 -- 172.21.15.7:0/900935456 shutdown_connections 2024-04-25T10:00:44.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.504+0000 7f641a96a640 1 -- 172.21.15.7:0/900935456 wait complete. 2024-04-25T10:00:44.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.506+0000 7f641a96a640 1 Processor -- start 2024-04-25T10:00:44.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.506+0000 7f641a96a640 1 -- start start 2024-04-25T10:00:44.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.507+0000 7f641a96a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64140b4040 0x7f64140b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:44.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.507+0000 7f641a96a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f64140cbfb0 0x7f64140b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:44.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.507+0000 7f641a96a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64140b3470 0x7f641415b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:44.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.507+0000 7f641a96a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64140d3660 con 0x7f64140b4040 2024-04-25T10:00:44.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.507+0000 7f641a96a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64140b61d0 con 0x7f64140b3470 2024-04-25T10:00:44.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.507+0000 7f641a96a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64140ce2b0 con 0x7f64140cbfb0 2024-04-25T10:00:44.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.507+0000 7f6413fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64140b4040 0x7f64140b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:44.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.507+0000 7f6413fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64140b4040 0x7f64140b29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49752/0 (socket says 172.21.15.7:49752) 2024-04-25T10:00:44.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.507+0000 7f6413fff640 1 -- 172.21.15.7:0/678511963 learned_addr learned my addr 172.21.15.7:0/678511963 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:44.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.507+0000 7f6413fff640 1 -- 172.21.15.7:0/678511963 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f64140cbfb0 msgr2=0x7f64140b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:44.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.507+0000 7f6413fff640 1 --2- 172.21.15.7:0/678511963 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f64140cbfb0 0x7f64140b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:44.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.507+0000 7f6413fff640 1 -- 172.21.15.7:0/678511963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64140b3470 msgr2=0x7f641415b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:44.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.507+0000 7f6418f07640 1 --2- 172.21.15.7:0/678511963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64140b3470 0x7f641415b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:44.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.507+0000 7f6413fff640 1 --2- 172.21.15.7:0/678511963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64140b3470 0x7f641415b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:44.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.507+0000 7f6413fff640 1 -- 172.21.15.7:0/678511963 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f641415a240 con 0x7f64140b4040 2024-04-25T10:00:44.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.507+0000 7f6413fff640 1 --2- 172.21.15.7:0/678511963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64140b4040 0x7f64140b29f0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f640402adb0 tx=0x7f6404000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:44.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.507+0000 7f6410ff9640 1 -- 172.21.15.7:0/678511963 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6404042020 con 0x7f64140b4040 2024-04-25T10:00:44.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.507+0000 7f6410ff9640 1 -- 172.21.15.7:0/678511963 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6404004cb0 con 0x7f64140b4040 2024-04-25T10:00:44.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.507+0000 7f641a96a640 1 -- 172.21.15.7:0/678511963 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64140cd900 con 0x7f64140b4040 2024-04-25T10:00:44.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.507+0000 7f6410ff9640 1 -- 172.21.15.7:0/678511963 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6404004e60 con 0x7f64140b4040 2024-04-25T10:00:44.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.507+0000 7f641a96a640 1 -- 172.21.15.7:0/678511963 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64140cb4f0 con 0x7f64140b4040 2024-04-25T10:00:44.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.508+0000 7f641a96a640 1 -- 172.21.15.7:0/678511963 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6414068fd0 con 0x7f64140b4040 2024-04-25T10:00:44.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.509+0000 7f6410ff9640 1 -- 172.21.15.7:0/678511963 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6404045020 con 0x7f64140b4040 2024-04-25T10:00:44.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.509+0000 7f6410ff9640 1 --2- 172.21.15.7:0/678511963 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f640006b4d0 0x7f640006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:44.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.509+0000 7f6410ff9640 1 -- 172.21.15.7:0/678511963 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f64040aa950 con 0x7f64140b4040 2024-04-25T10:00:44.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.509+0000 7f64137fe640 1 --2- 172.21.15.7:0/678511963 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f640006b4d0 0x7f640006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:44.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.510+0000 7f64137fe640 1 --2- 172.21.15.7:0/678511963 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f640006b4d0 0x7f640006d990 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f6408006d40 tx=0x7f6408006cd0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:44.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.514+0000 7f6410ff9640 1 -- 172.21.15.7:0/678511963 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f640404c070 con 0x7f64140b4040 2024-04-25T10:00:44.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.729+0000 7f641a96a640 1 -- 172.21.15.7:0/678511963 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64140ca760 con 0x7f64140b4040 2024-04-25T10:00:44.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.730+0000 7f6410ff9640 1 -- 172.21.15.7:0/678511963 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f64040795f0 con 0x7f64140b4040 2024-04-25T10:00:44.734 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:00:44.735 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2505539422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2505539422},{"type":"v1","addr":"172.21.15.55:6834","nonce":2505539422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2808857776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2808857776},{"type":"v1","addr":"172.21.15.55:6835","nonce":2808857776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7518,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1796103144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1796103144},{"type":"v1","addr":"172.21.15.7:6835","nonce":1796103144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:00:34.054759+0000","modified":"2024-04-25T10:00:44.384947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7734},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7734":{"gid":7734,"name":"a","rank":0,"incarnation":56,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6837/3829085443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3829085443},{"type":"v1","addr":"172.21.15.7:6837","nonce":3829085443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:00:44.735 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 56 2024-04-25T10:00:44.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.732+0000 7f641a96a640 1 -- 172.21.15.7:0/678511963 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f640006b4d0 msgr2=0x7f640006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:44.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.732+0000 7f641a96a640 1 --2- 172.21.15.7:0/678511963 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f640006b4d0 0x7f640006d990 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f6408006d40 tx=0x7f6408006cd0 comp rx=0 tx=0).stop 2024-04-25T10:00:44.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.732+0000 7f641a96a640 1 -- 172.21.15.7:0/678511963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64140b4040 msgr2=0x7f64140b29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:44.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.732+0000 7f641a96a640 1 --2- 172.21.15.7:0/678511963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64140b4040 0x7f64140b29f0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f640402adb0 tx=0x7f6404000fe0 comp rx=0 tx=0).stop 2024-04-25T10:00:44.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.732+0000 7f641a96a640 1 -- 172.21.15.7:0/678511963 shutdown_connections 2024-04-25T10:00:44.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.732+0000 7f641a96a640 1 --2- 172.21.15.7:0/678511963 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f640006b4d0 0x7f640006d990 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:44.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.732+0000 7f641a96a640 1 --2- 172.21.15.7:0/678511963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64140b3470 0x7f641415b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:44.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.732+0000 7f641a96a640 1 --2- 172.21.15.7:0/678511963 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f64140cbfb0 0x7f64140b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:44.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.732+0000 7f641a96a640 1 --2- 172.21.15.7:0/678511963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64140b4040 0x7f64140b29f0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:44.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.732+0000 7f641a96a640 1 -- 172.21.15.7:0/678511963 >> 172.21.15.7:0/678511963 conn(0x7f6414072290 msgr2=0x7f64140726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:44.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.732+0000 7f641a96a640 1 -- 172.21.15.7:0/678511963 shutdown_connections 2024-04-25T10:00:44.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:44.732+0000 7f641a96a640 1 -- 172.21.15.7:0/678511963 wait complete. 2024-04-25T10:00:45.150 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:00:34.054759+0000', 'modified': '2024-04-25T10:00:44.384947+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 89, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7734}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7734': {'gid': 7734, 'name': 'a', 'rank': 0, 'incarnation': 56, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.7:6837/3829085443', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6836', 'nonce': 3829085443}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 3829085443}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:00:45.150 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7734:up:replay 2024-04-25T10:00:46.151 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:00:46.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.258+0000 7faeb3276640 1 Processor -- start 2024-04-25T10:00:46.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.258+0000 7faeb3276640 1 -- start start 2024-04-25T10:00:46.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.259+0000 7faeb3276640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faeac15dd00 0x7faeac0b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:46.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.259+0000 7faeb3276640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faeac0b6a40 0x7faeac0b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:46.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.259+0000 7faeb3276640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeac06cd00 con 0x7faeac06bfb0 2024-04-25T10:00:46.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.259+0000 7faeb3276640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeac15e0e0 con 0x7faeac15dd00 2024-04-25T10:00:46.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.259+0000 7faeb3276640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeac06cfe0 con 0x7faeac0b6a40 2024-04-25T10:00:46.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.259+0000 7faeb1012640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faeac15dd00 0x7faeac0b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:46.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.259+0000 7faeb0811640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faeac0b6a40 0x7faeac0b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:46.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.259+0000 7faeb1012640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faeac15dd00 0x7faeac0b5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:36646/0 (socket says 172.21.15.7:36646) 2024-04-25T10:00:46.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.259+0000 7faeb1012640 1 -- 172.21.15.7:0/1680980851 learned_addr learned my addr 172.21.15.7:0/1680980851 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:46.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.259+0000 7faeb1813640 1 --1- 172.21.15.7:0/1680980851 >> v1:172.21.15.55:6789/0 conn(0x7faeac06bfb0 0x7faeac06c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:44200/0 (socket says 172.21.15.7:44200) 2024-04-25T10:00:46.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.260+0000 7faeb1012640 1 -- 172.21.15.7:0/1680980851 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faeac0b6a40 msgr2=0x7faeac0b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:46.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.260+0000 7faeb1012640 1 --2- 172.21.15.7:0/1680980851 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faeac0b6a40 0x7faeac0b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:46.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.260+0000 7faeb1012640 1 -- 172.21.15.7:0/1680980851 >> v1:172.21.15.55:6789/0 conn(0x7faeac06bfb0 legacy=0x7faeac06c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:46.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.260+0000 7faeb1012640 1 -- 172.21.15.7:0/1680980851 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac0d1ca0 con 0x7faeac15dd00 2024-04-25T10:00:46.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.260+0000 7faea3fff640 1 -- 172.21.15.7:0/1680980851 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2146985540 0 0) 0x7faeac06cd00 con 0x7faeac06bfb0 2024-04-25T10:00:46.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.260+0000 7faeb0811640 1 --2- 172.21.15.7:0/1680980851 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faeac0b6a40 0x7faeac0b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:00:46.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.260+0000 7faeb1012640 1 --2- 172.21.15.7:0/1680980851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeac15dd00 0x7faeac0b5750 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7faea8009870 tx=0x7faea802a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9ee9a2257db0162 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:46.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.261+0000 7faea3fff640 1 -- 172.21.15.7:0/1680980851 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea8037070 con 0x7faeac15dd00 2024-04-25T10:00:46.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.261+0000 7faea3fff640 1 -- 172.21.15.7:0/1680980851 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea802ae50 con 0x7faeac15dd00 2024-04-25T10:00:46.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.261+0000 7faea3fff640 1 -- 172.21.15.7:0/1680980851 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea8032860 con 0x7faeac15dd00 2024-04-25T10:00:46.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.261+0000 7faeb3276640 1 -- 172.21.15.7:0/1680980851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeac15dd00 msgr2=0x7faeac0b5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:46.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.261+0000 7faeb3276640 1 --2- 172.21.15.7:0/1680980851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeac15dd00 0x7faeac0b5750 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7faea8009870 tx=0x7faea802a300 comp rx=0 tx=0).stop 2024-04-25T10:00:46.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.261+0000 7faeb3276640 1 -- 172.21.15.7:0/1680980851 shutdown_connections 2024-04-25T10:00:46.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.261+0000 7faeb3276640 1 --2- 172.21.15.7:0/1680980851 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faeac0b6a40 0x7faeac0b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:46.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.261+0000 7faeb3276640 1 --2- 172.21.15.7:0/1680980851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeac15dd00 0x7faeac0b5750 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:46.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.261+0000 7faeb3276640 1 -- 172.21.15.7:0/1680980851 >> 172.21.15.7:0/1680980851 conn(0x7faeac0d07b0 msgr2=0x7faeac0d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:46.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.261+0000 7faeb3276640 1 -- 172.21.15.7:0/1680980851 shutdown_connections 2024-04-25T10:00:46.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.261+0000 7faeb3276640 1 -- 172.21.15.7:0/1680980851 wait complete. 2024-04-25T10:00:46.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.262+0000 7faeb3276640 1 Processor -- start 2024-04-25T10:00:46.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.263+0000 7faeb3276640 1 -- start start 2024-04-25T10:00:46.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.263+0000 7faeb3276640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faeac06bfb0 0x7faeac0cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:46.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.263+0000 7faeb3276640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeac0b6a40 0x7faeac1525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:46.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.263+0000 7faeb3276640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faeac15dd00 0x7faeac152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:46.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.263+0000 7faeb3276640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac0d2780 con 0x7faeac15dd00 2024-04-25T10:00:46.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.263+0000 7faeb3276640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac0d2260 con 0x7faeac0b6a40 2024-04-25T10:00:46.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.263+0000 7faeb3276640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeac0d2900 con 0x7faeac06bfb0 2024-04-25T10:00:46.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.263+0000 7faeb1813640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faeac15dd00 0x7faeac152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:46.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.263+0000 7faeb1012640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faeac06bfb0 0x7faeac0cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:46.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.263+0000 7faeb1813640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faeac15dd00 0x7faeac152b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49758/0 (socket says 172.21.15.7:49758) 2024-04-25T10:00:46.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.263+0000 7faeb1813640 1 -- 172.21.15.7:0/3700303838 learned_addr learned my addr 172.21.15.7:0/3700303838 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:46.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.263+0000 7faeb0811640 1 --2- 172.21.15.7:0/3700303838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeac0b6a40 0x7faeac1525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:46.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.264+0000 7faeb1813640 1 -- 172.21.15.7:0/3700303838 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faeac06bfb0 msgr2=0x7faeac0cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:46.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.264+0000 7faeb1813640 1 --2- 172.21.15.7:0/3700303838 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faeac06bfb0 0x7faeac0cc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:46.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.264+0000 7faeb1813640 1 -- 172.21.15.7:0/3700303838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeac0b6a40 msgr2=0x7faeac1525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:46.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.264+0000 7faeb1813640 1 --2- 172.21.15.7:0/3700303838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeac0b6a40 0x7faeac1525f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:46.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.264+0000 7faeb1813640 1 -- 172.21.15.7:0/3700303838 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac1f4510 con 0x7faeac15dd00 2024-04-25T10:00:46.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.264+0000 7faeb1813640 1 --2- 172.21.15.7:0/3700303838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faeac15dd00 0x7faeac152b30 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7faea400c7a0 tx=0x7faea400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:46.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.264+0000 7faea1ffb640 1 -- 172.21.15.7:0/3700303838 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea4018070 con 0x7faeac15dd00 2024-04-25T10:00:46.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.264+0000 7faea1ffb640 1 -- 172.21.15.7:0/3700303838 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea400a640 con 0x7faeac15dd00 2024-04-25T10:00:46.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.264+0000 7faeb3276640 1 -- 172.21.15.7:0/3700303838 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeac0caba0 con 0x7faeac15dd00 2024-04-25T10:00:46.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.264+0000 7faea1ffb640 1 -- 172.21.15.7:0/3700303838 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea400aab0 con 0x7faeac15dd00 2024-04-25T10:00:46.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.264+0000 7faeb3276640 1 -- 172.21.15.7:0/3700303838 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeac0cb160 con 0x7faeac15dd00 2024-04-25T10:00:46.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.265+0000 7faeb3276640 1 -- 172.21.15.7:0/3700303838 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeac068fd0 con 0x7faeac15dd00 2024-04-25T10:00:46.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.266+0000 7faea1ffb640 1 -- 172.21.15.7:0/3700303838 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faea401b070 con 0x7faeac15dd00 2024-04-25T10:00:46.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.266+0000 7faea1ffb640 1 --2- 172.21.15.7:0/3700303838 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fae9006b500 0x7fae9006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:46.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.266+0000 7faea1ffb640 1 -- 172.21.15.7:0/3700303838 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6187+0+0 (secure 0 0 0) 0x7faea40899e0 con 0x7faeac15dd00 2024-04-25T10:00:46.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.266+0000 7faeb1012640 1 --2- 172.21.15.7:0/3700303838 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fae9006b500 0x7fae9006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:46.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.267+0000 7faeb1012640 1 --2- 172.21.15.7:0/3700303838 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fae9006b500 0x7fae9006d9c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7faea8034000 tx=0x7faea802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:46.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.270+0000 7faea1ffb640 1 -- 172.21.15.7:0/3700303838 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faea4057f90 con 0x7faeac15dd00 2024-04-25T10:00:46.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.496+0000 7faeb3276640 1 -- 172.21.15.7:0/3700303838 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faeac0d0d30 con 0x7faeac15dd00 2024-04-25T10:00:46.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.497+0000 7faea1ffb640 1 -- 172.21.15.7:0/3700303838 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4935 (secure 0 0 0) 0x7faea405c030 con 0x7faeac15dd00 2024-04-25T10:00:46.502 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:00:46.502 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":58,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2505539422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2505539422},{"type":"v1","addr":"172.21.15.55:6834","nonce":2505539422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2808857776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2808857776},{"type":"v1","addr":"172.21.15.55:6835","nonce":2808857776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7518,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1796103144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1796103144},{"type":"v1","addr":"172.21.15.7:6835","nonce":1796103144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:00:34.054759+0000","modified":"2024-04-25T10:00:45.396889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7734},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7734":{"gid":7734,"name":"a","rank":0,"incarnation":56,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.7:6837/3829085443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3829085443},{"type":"v1","addr":"172.21.15.7:6837","nonce":3829085443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:00:46.502 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 58 2024-04-25T10:00:46.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.499+0000 7faeb3276640 1 -- 172.21.15.7:0/3700303838 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fae9006b500 msgr2=0x7fae9006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:46.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.499+0000 7faeb3276640 1 --2- 172.21.15.7:0/3700303838 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fae9006b500 0x7fae9006d9c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7faea8034000 tx=0x7faea802e000 comp rx=0 tx=0).stop 2024-04-25T10:00:46.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.499+0000 7faeb3276640 1 -- 172.21.15.7:0/3700303838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faeac15dd00 msgr2=0x7faeac152b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:46.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.499+0000 7faeb3276640 1 --2- 172.21.15.7:0/3700303838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faeac15dd00 0x7faeac152b30 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7faea400c7a0 tx=0x7faea400cc60 comp rx=0 tx=0).stop 2024-04-25T10:00:46.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.499+0000 7faeb3276640 1 -- 172.21.15.7:0/3700303838 shutdown_connections 2024-04-25T10:00:46.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.499+0000 7faeb3276640 1 --2- 172.21.15.7:0/3700303838 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fae9006b500 0x7fae9006d9c0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:46.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.499+0000 7faeb3276640 1 --2- 172.21.15.7:0/3700303838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faeac15dd00 0x7faeac152b30 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:46.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.499+0000 7faeb3276640 1 --2- 172.21.15.7:0/3700303838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeac0b6a40 0x7faeac1525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:46.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.499+0000 7faeb3276640 1 --2- 172.21.15.7:0/3700303838 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faeac06bfb0 0x7faeac0cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:46.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.499+0000 7faeb3276640 1 -- 172.21.15.7:0/3700303838 >> 172.21.15.7:0/3700303838 conn(0x7faeac0d07b0 msgr2=0x7faeac151730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:46.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.499+0000 7faeb3276640 1 -- 172.21.15.7:0/3700303838 shutdown_connections 2024-04-25T10:00:46.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:46.499+0000 7faeb3276640 1 -- 172.21.15.7:0/3700303838 wait complete. 2024-04-25T10:00:46.921 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 58, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:00:34.054759+0000', 'modified': '2024-04-25T10:00:45.396889+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 89, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7734}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7734': {'gid': 7734, 'name': 'a', 'rank': 0, 'incarnation': 56, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.7:6837/3829085443', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6836', 'nonce': 3829085443}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 3829085443}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:00:46.922 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7734:up:rejoin 2024-04-25T10:00:47.923 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:00:48.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.033+0000 7f8531ecd640 1 Processor -- start 2024-04-25T10:00:48.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.033+0000 7f8531ecd640 1 -- start start 2024-04-25T10:00:48.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.034+0000 7f8531ecd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f852c09a8e0 0x7f852c0cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.034+0000 7f8531ecd640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f852c099b20 con 0x7f852c06c250 2024-04-25T10:00:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.034+0000 7f8531ecd640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f852c099e00 con 0x7f852c06bce0 2024-04-25T10:00:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.034+0000 7f8531ecd640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f852c09a450 con 0x7f852c09a8e0 2024-04-25T10:00:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.034+0000 7f852b7fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f852c06c250 0x7f852c06c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45406/0 (socket says 172.21.15.7:45406) 2024-04-25T10:00:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.034+0000 7f852bfff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f852c09a8e0 0x7f852c0cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.034+0000 7f852b7fe640 1 -- 172.21.15.7:0/931312132 learned_addr learned my addr 172.21.15.7:0/931312132 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.034+0000 7f852bfff640 1 -- 172.21.15.7:0/931312132 >> v1:172.21.15.55:6789/0 conn(0x7f852c06bce0 legacy=0x7f852c0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.034+0000 7f852bfff640 1 -- 172.21.15.7:0/931312132 >> v1:172.21.15.7:6789/0 conn(0x7f852c06c250 legacy=0x7f852c06c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.034+0000 7f852bfff640 1 -- 172.21.15.7:0/931312132 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852c09a0e0 con 0x7f852c09a8e0 2024-04-25T10:00:48.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.035+0000 7f852bfff640 1 --2- 172.21.15.7:0/931312132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f852c09a8e0 0x7f852c0cbd30 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f8524009d90 tx=0x7f852402a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbeb6441065cb68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:48.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.035+0000 7f852a7fc640 1 -- 172.21.15.7:0/931312132 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8524007740 con 0x7f852c09a8e0 2024-04-25T10:00:48.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.035+0000 7f852a7fc640 1 -- 172.21.15.7:0/931312132 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85240078e0 con 0x7f852c09a8e0 2024-04-25T10:00:48.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.035+0000 7f852a7fc640 1 -- 172.21.15.7:0/931312132 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8524007cb0 con 0x7f852c09a8e0 2024-04-25T10:00:48.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.035+0000 7f8531ecd640 1 -- 172.21.15.7:0/931312132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f852c09a8e0 msgr2=0x7f852c0cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:48.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.035+0000 7f8531ecd640 1 --2- 172.21.15.7:0/931312132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f852c09a8e0 0x7f852c0cbd30 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f8524009d90 tx=0x7f852402a580 comp rx=0 tx=0).stop 2024-04-25T10:00:48.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.035+0000 7f8531ecd640 1 -- 172.21.15.7:0/931312132 shutdown_connections 2024-04-25T10:00:48.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.035+0000 7f8531ecd640 1 --2- 172.21.15.7:0/931312132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f852c09a8e0 0x7f852c0cbd30 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.035+0000 7f8531ecd640 1 -- 172.21.15.7:0/931312132 >> 172.21.15.7:0/931312132 conn(0x7f852c0d16e0 msgr2=0x7f852c0d1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:48.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.036+0000 7f8531ecd640 1 -- 172.21.15.7:0/931312132 shutdown_connections 2024-04-25T10:00:48.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.036+0000 7f8531ecd640 1 -- 172.21.15.7:0/931312132 wait complete. 2024-04-25T10:00:48.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.037+0000 7f8531ecd640 1 Processor -- start 2024-04-25T10:00:48.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.037+0000 7f8531ecd640 1 -- start start 2024-04-25T10:00:48.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.038+0000 7f8531ecd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f852c06bce0 0x7f852c0c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.038+0000 7f8531ecd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f852c06c250 0x7f852c1f8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.038+0000 7f8531ecd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f852c09a8e0 0x7f852c1f8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.038+0000 7f8531ecd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852c15f000 con 0x7f852c09a8e0 2024-04-25T10:00:48.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.038+0000 7f8531ecd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852c0d0c60 con 0x7f852c06c250 2024-04-25T10:00:48.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.038+0000 7f8531ecd640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f852c15f180 con 0x7f852c06bce0 2024-04-25T10:00:48.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.038+0000 7f852bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f852c09a8e0 0x7f852c1f8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.038+0000 7f852bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f852c09a8e0 0x7f852c1f8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49770/0 (socket says 172.21.15.7:49770) 2024-04-25T10:00:48.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.038+0000 7f852bfff640 1 -- 172.21.15.7:0/1435685177 learned_addr learned my addr 172.21.15.7:0/1435685177 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:48.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.038+0000 7f852affd640 1 --2- 172.21.15.7:0/1435685177 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f852c06c250 0x7f852c1f8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.038+0000 7f852b7fe640 1 --2- 172.21.15.7:0/1435685177 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f852c06bce0 0x7f852c0c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.038+0000 7f852bfff640 1 -- 172.21.15.7:0/1435685177 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f852c06bce0 msgr2=0x7f852c0c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:48.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.038+0000 7f852bfff640 1 --2- 172.21.15.7:0/1435685177 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f852c06bce0 0x7f852c0c7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.038+0000 7f852bfff640 1 -- 172.21.15.7:0/1435685177 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f852c06c250 msgr2=0x7f852c1f8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:48.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.038+0000 7f852bfff640 1 --2- 172.21.15.7:0/1435685177 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f852c06c250 0x7f852c1f8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.038+0000 7f852bfff640 1 -- 172.21.15.7:0/1435685177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852c15f8a0 con 0x7f852c09a8e0 2024-04-25T10:00:48.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.038+0000 7f852affd640 1 --2- 172.21.15.7:0/1435685177 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f852c06c250 0x7f852c1f8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:00:48.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.038+0000 7f852bfff640 1 --2- 172.21.15.7:0/1435685177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f852c09a8e0 0x7f852c1f8570 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f8524009eb0 tx=0x7f8524004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:48.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.039+0000 7f8513fff640 1 -- 172.21.15.7:0/1435685177 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8524040070 con 0x7f852c09a8e0 2024-04-25T10:00:48.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.039+0000 7f8513fff640 1 -- 172.21.15.7:0/1435685177 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8524031c40 con 0x7f852c09a8e0 2024-04-25T10:00:48.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.039+0000 7f8531ecd640 1 -- 172.21.15.7:0/1435685177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f852c15fb80 con 0x7f852c09a8e0 2024-04-25T10:00:48.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.039+0000 7f8513fff640 1 -- 172.21.15.7:0/1435685177 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852403c420 con 0x7f852c09a8e0 2024-04-25T10:00:48.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.039+0000 7f8531ecd640 1 -- 172.21.15.7:0/1435685177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f852c160140 con 0x7f852c09a8e0 2024-04-25T10:00:48.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.040+0000 7f8531ecd640 1 -- 172.21.15.7:0/1435685177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f852c068fd0 con 0x7f852c09a8e0 2024-04-25T10:00:48.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.040+0000 7f8513fff640 1 -- 172.21.15.7:0/1435685177 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8524039040 con 0x7f852c09a8e0 2024-04-25T10:00:48.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.040+0000 7f8513fff640 1 --2- 172.21.15.7:0/1435685177 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f851806b4d0 0x7f851806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.041+0000 7f8513fff640 1 -- 172.21.15.7:0/1435685177 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f85240aba90 con 0x7f852c09a8e0 2024-04-25T10:00:48.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.041+0000 7f852b7fe640 1 --2- 172.21.15.7:0/1435685177 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f851806b4d0 0x7f851806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.041+0000 7f852b7fe640 1 --2- 172.21.15.7:0/1435685177 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f851806b4d0 0x7f851806d990 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f852c0c6d70 tx=0x7f8520009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:48.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.045+0000 7f8513fff640 1 -- 172.21.15.7:0/1435685177 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f852407a0e0 con 0x7f852c09a8e0 2024-04-25T10:00:48.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.262+0000 7f8531ecd640 1 -- 172.21.15.7:0/1435685177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f852c0d1150 con 0x7f852c09a8e0 2024-04-25T10:00:48.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.263+0000 7f8513fff640 1 -- 172.21.15.7:0/1435685177 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f852407e180 con 0x7f852c09a8e0 2024-04-25T10:00:48.268 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:00:48.268 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":59,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2505539422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2505539422},{"type":"v1","addr":"172.21.15.55:6834","nonce":2505539422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2808857776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2808857776},{"type":"v1","addr":"172.21.15.55:6835","nonce":2808857776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7518,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1796103144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1796103144},{"type":"v1","addr":"172.21.15.7:6835","nonce":1796103144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:00:34.054759+0000","modified":"2024-04-25T10:00:46.397872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7734},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7734":{"gid":7734,"name":"a","rank":0,"incarnation":56,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6837/3829085443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3829085443},{"type":"v1","addr":"172.21.15.7:6837","nonce":3829085443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:00:48.268 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 59 2024-04-25T10:00:48.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.265+0000 7f8531ecd640 1 -- 172.21.15.7:0/1435685177 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f851806b4d0 msgr2=0x7f851806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:48.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.265+0000 7f8531ecd640 1 --2- 172.21.15.7:0/1435685177 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f851806b4d0 0x7f851806d990 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f852c0c6d70 tx=0x7f8520009040 comp rx=0 tx=0).stop 2024-04-25T10:00:48.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.265+0000 7f8531ecd640 1 -- 172.21.15.7:0/1435685177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f852c09a8e0 msgr2=0x7f852c1f8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:48.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.265+0000 7f8531ecd640 1 --2- 172.21.15.7:0/1435685177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f852c09a8e0 0x7f852c1f8570 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f8524009eb0 tx=0x7f8524004a40 comp rx=0 tx=0).stop 2024-04-25T10:00:48.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.265+0000 7f8531ecd640 1 -- 172.21.15.7:0/1435685177 shutdown_connections 2024-04-25T10:00:48.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.265+0000 7f8531ecd640 1 --2- 172.21.15.7:0/1435685177 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f851806b4d0 0x7f851806d990 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.265+0000 7f8531ecd640 1 --2- 172.21.15.7:0/1435685177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f852c09a8e0 0x7f852c1f8570 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.265+0000 7f8531ecd640 1 --2- 172.21.15.7:0/1435685177 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f852c06c250 0x7f852c1f8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.265+0000 7f8531ecd640 1 --2- 172.21.15.7:0/1435685177 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f852c06bce0 0x7f852c0c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.265+0000 7f8531ecd640 1 -- 172.21.15.7:0/1435685177 >> 172.21.15.7:0/1435685177 conn(0x7f852c0d16e0 msgr2=0x7f852c15aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:48.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.265+0000 7f8531ecd640 1 -- 172.21.15.7:0/1435685177 shutdown_connections 2024-04-25T10:00:48.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.265+0000 7f8531ecd640 1 -- 172.21.15.7:0/1435685177 wait complete. 2024-04-25T10:00:48.683 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:00:34.054759+0000', 'modified': '2024-04-25T10:00:46.397872+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 89, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7734}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7734': {'gid': 7734, 'name': 'a', 'rank': 0, 'incarnation': 56, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.7:6837/3829085443', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6836', 'nonce': 3829085443}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 3829085443}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:00:48.684 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T10:00:48.684 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T10:00:48.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.785+0000 7f3c4996a640 1 Processor -- start 2024-04-25T10:00:48.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.785+0000 7f3c4996a640 1 -- start start 2024-04-25T10:00:48.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.786+0000 7f3c4996a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3c440b5e60 0x7f3c4406bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.786+0000 7f3c4996a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3c440b6a40 0x7f3c4406c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.786+0000 7f3c4996a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c4406ca30 con 0x7f3c4415dd00 2024-04-25T10:00:48.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.786+0000 7f3c4996a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c4415e0e0 con 0x7f3c440b5e60 2024-04-25T10:00:48.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.786+0000 7f3c4996a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c4406cfe0 con 0x7f3c440b6a40 2024-04-25T10:00:48.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.786+0000 7f3c427fc640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3c440b5e60 0x7f3c4406bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.786+0000 7f3c427fc640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3c440b5e60 0x7f3c4406bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49784/0 (socket says 172.21.15.7:49784) 2024-04-25T10:00:48.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.786+0000 7f3c427fc640 1 -- 172.21.15.7:0/495217341 learned_addr learned my addr 172.21.15.7:0/495217341 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:48.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.786+0000 7f3c427fc640 1 -- 172.21.15.7:0/495217341 >> v2:172.21.15.55:3300/0 conn(0x7f3c440b6a40 msgr2=0x7f3c4406c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:48.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.786+0000 7f3c427fc640 1 --2- 172.21.15.7:0/495217341 >> v2:172.21.15.55:3300/0 conn(0x7f3c440b6a40 0x7f3c4406c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.786+0000 7f3c427fc640 1 -- 172.21.15.7:0/495217341 >> v1:172.21.15.55:6789/0 conn(0x7f3c4415dd00 legacy=0x7f3c440b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:48.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.786+0000 7f3c427fc640 1 -- 172.21.15.7:0/495217341 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4406cd00 con 0x7f3c440b5e60 2024-04-25T10:00:48.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.787+0000 7f3c427fc640 1 --2- 172.21.15.7:0/495217341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c440b5e60 0x7f3c4406bfb0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f3c440d0270 tx=0x7f3c3802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1753be8418b2f7bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:48.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.787+0000 7f3c41ffb640 1 -- 172.21.15.7:0/495217341 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c38037070 con 0x7f3c440b5e60 2024-04-25T10:00:48.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.787+0000 7f3c41ffb640 1 -- 172.21.15.7:0/495217341 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c38032440 con 0x7f3c440b5e60 2024-04-25T10:00:48.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.787+0000 7f3c41ffb640 1 -- 172.21.15.7:0/495217341 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c38032810 con 0x7f3c440b5e60 2024-04-25T10:00:48.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.787+0000 7f3c4996a640 1 -- 172.21.15.7:0/495217341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c440b5e60 msgr2=0x7f3c4406bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:48.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.787+0000 7f3c4996a640 1 --2- 172.21.15.7:0/495217341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c440b5e60 0x7f3c4406bfb0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f3c440d0270 tx=0x7f3c3802a2c0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.787+0000 7f3c4996a640 1 -- 172.21.15.7:0/495217341 shutdown_connections 2024-04-25T10:00:48.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.787+0000 7f3c4996a640 1 --2- 172.21.15.7:0/495217341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c440b5e60 0x7f3c4406bfb0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.787+0000 7f3c4996a640 1 --2- 172.21.15.7:0/495217341 >> v2:172.21.15.55:3300/0 conn(0x7f3c440b6a40 0x7f3c4406c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.787+0000 7f3c4996a640 1 -- 172.21.15.7:0/495217341 >> 172.21.15.7:0/495217341 conn(0x7f3c440d07b0 msgr2=0x7f3c440d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:48.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.787+0000 7f3c4996a640 1 -- 172.21.15.7:0/495217341 shutdown_connections 2024-04-25T10:00:48.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.787+0000 7f3c4996a640 1 -- 172.21.15.7:0/495217341 wait complete. 2024-04-25T10:00:48.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.789+0000 7f3c4996a640 1 Processor -- start 2024-04-25T10:00:48.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.789+0000 7f3c4996a640 1 -- start start 2024-04-25T10:00:48.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.789+0000 7f3c4996a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c440b5e60 0x7f3c4414b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.790+0000 7f3c4996a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c440b6a40 0x7f3c440cd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.790+0000 7f3c4996a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c4415dd00 0x7f3c440ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.790+0000 7f3c4996a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c440d2260 con 0x7f3c440b5e60 2024-04-25T10:00:48.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.790+0000 7f3c4996a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c440d1f80 con 0x7f3c4415dd00 2024-04-25T10:00:48.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.790+0000 7f3c4996a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c440d2780 con 0x7f3c440b6a40 2024-04-25T10:00:48.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.790+0000 7f3c42ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c440b5e60 0x7f3c4414b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.790+0000 7f3c42ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c440b5e60 0x7f3c4414b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49800/0 (socket says 172.21.15.7:49800) 2024-04-25T10:00:48.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.790+0000 7f3c42ffd640 1 -- 172.21.15.7:0/3704078647 learned_addr learned my addr 172.21.15.7:0/3704078647 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:48.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.790+0000 7f3c437fe640 1 --2- 172.21.15.7:0/3704078647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c4415dd00 0x7f3c440ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.790+0000 7f3c427fc640 1 --2- 172.21.15.7:0/3704078647 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c440b6a40 0x7f3c440cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.790+0000 7f3c42ffd640 1 -- 172.21.15.7:0/3704078647 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c440b6a40 msgr2=0x7f3c440cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:48.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.790+0000 7f3c42ffd640 1 --2- 172.21.15.7:0/3704078647 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c440b6a40 0x7f3c440cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.790+0000 7f3c42ffd640 1 -- 172.21.15.7:0/3704078647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c4415dd00 msgr2=0x7f3c440ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:48.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.790+0000 7f3c42ffd640 1 --2- 172.21.15.7:0/3704078647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c4415dd00 0x7f3c440ca9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.790+0000 7f3c42ffd640 1 -- 172.21.15.7:0/3704078647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c440cbd20 con 0x7f3c440b5e60 2024-04-25T10:00:48.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.790+0000 7f3c42ffd640 1 --2- 172.21.15.7:0/3704078647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c440b5e60 0x7f3c4414b1e0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f3c3400b410 tx=0x7f3c3400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:48.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.790+0000 7f3c2bfff640 1 -- 172.21.15.7:0/3704078647 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c34015020 con 0x7f3c440b5e60 2024-04-25T10:00:48.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.790+0000 7f3c2bfff640 1 -- 172.21.15.7:0/3704078647 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c34011830 con 0x7f3c440b5e60 2024-04-25T10:00:48.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.790+0000 7f3c2bfff640 1 -- 172.21.15.7:0/3704078647 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c34011c20 con 0x7f3c440b5e60 2024-04-25T10:00:48.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.790+0000 7f3c4996a640 1 -- 172.21.15.7:0/3704078647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4414b720 con 0x7f3c440b5e60 2024-04-25T10:00:48.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.790+0000 7f3c4996a640 1 -- 172.21.15.7:0/3704078647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c44158d80 con 0x7f3c440b5e60 2024-04-25T10:00:48.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.792+0000 7f3c2bfff640 1 -- 172.21.15.7:0/3704078647 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3c34018020 con 0x7f3c440b5e60 2024-04-25T10:00:48.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.792+0000 7f3c2bfff640 1 --2- 172.21.15.7:0/3704078647 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3c3006b4d0 0x7f3c3006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.792+0000 7f3c2bfff640 1 -- 172.21.15.7:0/3704078647 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f3c3408a350 con 0x7f3c440b5e60 2024-04-25T10:00:48.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.792+0000 7f3c427fc640 1 --2- 172.21.15.7:0/3704078647 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3c3006b4d0 0x7f3c3006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.793+0000 7f3c427fc640 1 --2- 172.21.15.7:0/3704078647 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3c3006b4d0 0x7f3c3006d990 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3c38034000 tx=0x7f3c3802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:48.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.793+0000 7f3c4c673740 1 Processor -- start 2024-04-25T10:00:48.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.794+0000 7f3c4c673740 1 -- start start 2024-04-25T10:00:48.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.794+0000 7f3c4c673740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26426b230 0x55b26426b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.794+0000 7f3c4c673740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b264288ad0 0x55b264289020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.794+0000 7f3c4c673740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b264240f10 0x55b264287190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.794+0000 7f3c4c673740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2641a3a10 con 0x55b26426b230 2024-04-25T10:00:48.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.794+0000 7f3c4c673740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b26414cb30 con 0x55b264240f10 2024-04-25T10:00:48.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.794+0000 7f3c4c673740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b26419fc50 con 0x55b264288ad0 2024-04-25T10:00:48.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.795+0000 7f3c42ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26426b230 0x55b26426b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.795+0000 7f3c42ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26426b230 0x55b26426b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49810/0 (socket says 172.21.15.7:49810) 2024-04-25T10:00:48.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.795+0000 7f3c42ffd640 1 -- 172.21.15.7:0/1071219236 learned_addr learned my addr 172.21.15.7:0/1071219236 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:48.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.795+0000 7f3c437fe640 1 --2- 172.21.15.7:0/1071219236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b264240f10 0x55b264287190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.795+0000 7f3c427fc640 1 --2- 172.21.15.7:0/1071219236 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b264288ad0 0x55b264289020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.795+0000 7f3c42ffd640 1 -- 172.21.15.7:0/1071219236 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b264288ad0 msgr2=0x55b264289020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:48.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.795+0000 7f3c42ffd640 1 --2- 172.21.15.7:0/1071219236 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b264288ad0 0x55b264289020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.795+0000 7f3c42ffd640 1 -- 172.21.15.7:0/1071219236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b264240f10 msgr2=0x55b264287190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:48.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.795+0000 7f3c42ffd640 1 --2- 172.21.15.7:0/1071219236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b264240f10 0x55b264287190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.795+0000 7f3c42ffd640 1 -- 172.21.15.7:0/1071219236 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b264161e10 con 0x55b26426b230 2024-04-25T10:00:48.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.795+0000 7f3c42ffd640 1 --2- 172.21.15.7:0/1071219236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26426b230 0x55b26426b610 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f3c34054d50 tx=0x7f3c340589b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29bee43b3ff8d82c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:48.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.795+0000 7f3c297fa640 1 -- 172.21.15.7:0/1071219236 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c34011dc0 con 0x55b26426b230 2024-04-25T10:00:48.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.795+0000 7f3c297fa640 1 -- 172.21.15.7:0/1071219236 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c34056bf0 con 0x55b26426b230 2024-04-25T10:00:48.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.795+0000 7f3c297fa640 1 -- 172.21.15.7:0/1071219236 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c34054f60 con 0x55b26426b230 2024-04-25T10:00:48.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.796+0000 7f3c4c673740 1 -- 172.21.15.7:0/1071219236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26426b230 msgr2=0x55b26426b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:48.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.796+0000 7f3c4c673740 1 --2- 172.21.15.7:0/1071219236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26426b230 0x55b26426b610 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f3c34054d50 tx=0x7f3c340589b0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.796+0000 7f3c4c673740 1 -- 172.21.15.7:0/1071219236 shutdown_connections 2024-04-25T10:00:48.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.796+0000 7f3c4c673740 1 --2- 172.21.15.7:0/1071219236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b264240f10 0x55b264287190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.796+0000 7f3c4c673740 1 --2- 172.21.15.7:0/1071219236 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b264288ad0 0x55b264289020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.796+0000 7f3c4c673740 1 --2- 172.21.15.7:0/1071219236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26426b230 0x55b26426b610 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.796+0000 7f3c4c673740 1 -- 172.21.15.7:0/1071219236 >> 172.21.15.7:0/1071219236 conn(0x55b26423d840 msgr2=0x55b264286040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:48.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.796+0000 7f3c4c673740 1 -- 172.21.15.7:0/1071219236 shutdown_connections 2024-04-25T10:00:48.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.796+0000 7f3c4c673740 1 -- 172.21.15.7:0/1071219236 wait complete. 2024-04-25T10:00:48.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.796+0000 7f3c4c673740 1 -- start start 2024-04-25T10:00:48.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.797+0000 7f3c4c673740 1 Processor -- start 2024-04-25T10:00:48.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.797+0000 7f3c4c673740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b26426b230 0x55b2642970d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.797+0000 7f3c4c673740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b264288ad0 0x55b264269f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.797+0000 7f3c4c673740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26426a4d0 0x55b26426e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.797+0000 7f3c4c673740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b264241cb0 con 0x55b26426a4d0 2024-04-25T10:00:48.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.797+0000 7f3c4c673740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2641600c0 con 0x55b26426b230 2024-04-25T10:00:48.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.797+0000 7f3c4c673740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b26423b770 con 0x55b264288ad0 2024-04-25T10:00:48.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.797+0000 7f3c4c673740 10 client.0 _ll_register_callbacks cb 0x55b264153ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:00:48.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.797+0000 7f3c437fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26426a4d0 0x55b26426e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.798+0000 7f3c437fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26426a4d0 0x55b26426e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49822/0 (socket says 172.21.15.7:49822) 2024-04-25T10:00:48.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.798+0000 7f3c437fe640 1 -- 172.21.15.7:0/2965294445 learned_addr learned my addr 172.21.15.7:0/2965294445 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:48.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.798+0000 7f3c42ffd640 1 --2- 172.21.15.7:0/2965294445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b26426b230 0x55b2642970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.798+0000 7f3c427fc640 1 --2- 172.21.15.7:0/2965294445 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b264288ad0 0x55b264269f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.798+0000 7f3c437fe640 1 -- 172.21.15.7:0/2965294445 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b264288ad0 msgr2=0x55b264269f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:48.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.798+0000 7f3c437fe640 1 --2- 172.21.15.7:0/2965294445 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b264288ad0 0x55b264269f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.798+0000 7f3c437fe640 1 -- 172.21.15.7:0/2965294445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b26426b230 msgr2=0x55b2642970d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:48.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.798+0000 7f3c437fe640 1 --2- 172.21.15.7:0/2965294445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b26426b230 0x55b2642970d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.798+0000 7f3c437fe640 1 -- 172.21.15.7:0/2965294445 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b263eb82d0 con 0x55b26426a4d0 2024-04-25T10:00:48.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.798+0000 7f3c437fe640 1 --2- 172.21.15.7:0/2965294445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26426a4d0 0x55b26426e590 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00abf0 tx=0x7f3c3c0072b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25eb35d2528b3f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:48.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.798+0000 7f3c227fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:00:48.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.798+0000 7f3c227fc640 1 -- 172.21.15.7:0/2965294445 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c01b060 con 0x55b26426a4d0 2024-04-25T10:00:48.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.798+0000 7f3c227fc640 1 -- 172.21.15.7:0/2965294445 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f3c3c016480 con 0x55b26426a4d0 2024-04-25T10:00:48.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.798+0000 7f3c4c673740 1 -- 172.21.15.7:0/2965294445 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3c34056bf0 con 0x55b26426a4d0 2024-04-25T10:00:48.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.798+0000 7f3c227fc640 1 -- 172.21.15.7:0/2965294445 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c3c021050 con 0x55b26426a4d0 2024-04-25T10:00:48.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.798+0000 7f3c4c673740 10 client.7794 fetch_fsmap learned FSMap version 59 2024-04-25T10:00:48.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.798+0000 7f3c4c673740 1 -- 172.21.15.7:0/2965294445 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x55b263f826b0 con 0x55b26426a4d0 2024-04-25T10:00:48.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.798+0000 7f3c227fc640 1 -- 172.21.15.7:0/2965294445 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c34056bf0 con 0x55b26426a4d0 2024-04-25T10:00:48.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.799+0000 7f3c227fc640 1 -- 172.21.15.7:0/2965294445 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 59) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3c3c024020 con 0x55b26426a4d0 2024-04-25T10:00:48.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.799+0000 7f3c4c673740 10 client.7794 fetch_fsmap finished waiting for FSMap version 59 2024-04-25T10:00:48.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.799+0000 7f3c4c673740 10 client.7794 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:00:48.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.799+0000 7f3c4c673740 20 client.7794 populate_metadata read hostname 'smithi007' 2024-04-25T10:00:48.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.799+0000 7f3c4c673740 1 --2- 172.21.15.7:0/2965294445 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x55b264297950 0x55b264267d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.799+0000 7f3c4c673740 4 client.7794 mds_command: new command op to 7734 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:00:48.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.799+0000 7f3c4c673740 1 -- 172.21.15.7:0/2965294445 --> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b264202920 con 0x55b264297950 2024-04-25T10:00:48.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.799+0000 7f3c42ffd640 1 --2- 172.21.15.7:0/2965294445 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x55b264297950 0x55b264267d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.799+0000 7f3c42ffd640 1 --2- 172.21.15.7:0/2965294445 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x55b264297950 0x55b264267d20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa96d94d80d03513 server_cookie=4bc4424e54aaaa82 in_seq=0 out_seq=0 2024-04-25T10:00:48.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.799+0000 7f3c227fc640 10 client.7794 ms_handle_connect on v2:172.21.15.7:6836/3829085443 2024-04-25T10:00:48.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.800+0000 7f3c227fc640 1 -- 172.21.15.7:0/2965294445 <== mds.0 v2:172.21.15.7:6836/3829085443 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b264202920 con 0x55b264297950 2024-04-25T10:00:48.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.800+0000 7f3c227fc640 10 client.7794 handle_command_reply: tid=0 2024-04-25T10:00:48.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.800+0000 7f3c4c673740 1 client.7794 shutdown 2024-04-25T10:00:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.800+0000 7f3c4c673740 1 -- 172.21.15.7:0/2965294445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26426a4d0 msgr2=0x55b26426e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.800+0000 7f3c4c673740 1 --2- 172.21.15.7:0/2965294445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26426a4d0 0x55b26426e590 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00abf0 tx=0x7f3c3c0072b0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.800+0000 7f3c4c673740 1 -- 172.21.15.7:0/2965294445 shutdown_connections 2024-04-25T10:00:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.800+0000 7f3c4c673740 1 --2- 172.21.15.7:0/2965294445 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x55b264297950 0x55b264267d20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.800+0000 7f3c4c673740 1 --2- 172.21.15.7:0/2965294445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26426a4d0 0x55b26426e590 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.800+0000 7f3c4c673740 1 --2- 172.21.15.7:0/2965294445 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b264288ad0 0x55b264269f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.800+0000 7f3c227fc640 0 client.7794 ms_handle_reset on v2:172.21.15.7:6836/3829085443 2024-04-25T10:00:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.800+0000 7f3c4c673740 1 --2- 172.21.15.7:0/2965294445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b26426b230 0x55b2642970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.800+0000 7f3c4c673740 1 -- 172.21.15.7:0/2965294445 >> 172.21.15.7:0/2965294445 conn(0x55b264240f10 msgr2=0x55b2642895c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.800+0000 7f3c4c673740 1 -- 172.21.15.7:0/2965294445 shutdown_connections 2024-04-25T10:00:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.800+0000 7f3c4c673740 1 -- 172.21.15.7:0/2965294445 wait complete. 2024-04-25T10:00:48.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.800+0000 7f3c4c673740 20 client.7794 trim_cache size 0 max 16384 2024-04-25T10:00:48.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.816+0000 7f3c4c673740 1 Processor -- start 2024-04-25T10:00:48.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.816+0000 7f3c4c673740 1 -- start start 2024-04-25T10:00:48.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.816+0000 7f3c4c673740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b26426a4d0 0x55b2642682c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.817+0000 7f3c4c673740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26426b230 0x55b264284920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.817+0000 7f3c4c673740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b264288ad0 0x55b264284e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.817+0000 7f3c4c673740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c441ff7c0 con 0x55b26426b230 2024-04-25T10:00:48.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.817+0000 7f3c4c673740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4415a150 con 0x55b26426a4d0 2024-04-25T10:00:48.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.817+0000 7f3c4c673740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c441ff1c0 con 0x55b264288ad0 2024-04-25T10:00:48.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.817+0000 7f3c427fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26426b230 0x55b264284920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.817+0000 7f3c427fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26426b230 0x55b264284920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49836/0 (socket says 172.21.15.7:49836) 2024-04-25T10:00:48.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.817+0000 7f3c427fc640 1 -- 172.21.15.7:0/489905415 learned_addr learned my addr 172.21.15.7:0/489905415 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:48.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.817+0000 7f3c427fc640 1 -- 172.21.15.7:0/489905415 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b264288ad0 msgr2=0x55b264284e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:48.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.817+0000 7f3c427fc640 1 --2- 172.21.15.7:0/489905415 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b264288ad0 0x55b264284e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.817+0000 7f3c427fc640 1 -- 172.21.15.7:0/489905415 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b26426a4d0 msgr2=0x55b2642682c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:48.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.817+0000 7f3c42ffd640 1 --2- 172.21.15.7:0/489905415 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b26426a4d0 0x55b2642682c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.817+0000 7f3c427fc640 1 --2- 172.21.15.7:0/489905415 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b26426a4d0 0x55b2642682c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.817+0000 7f3c427fc640 1 -- 172.21.15.7:0/489905415 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b264240710 con 0x55b26426b230 2024-04-25T10:00:48.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.817+0000 7f3c427fc640 1 --2- 172.21.15.7:0/489905415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26426b230 0x55b264284920 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f3c3802a8b0 tx=0x7f3c38008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5a1f09f9f1736d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:48.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.817+0000 7f3c28ff9640 1 -- 172.21.15.7:0/489905415 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3804e070 con 0x55b26426b230 2024-04-25T10:00:48.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.817+0000 7f3c28ff9640 1 -- 172.21.15.7:0/489905415 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3803e660 con 0x55b26426b230 2024-04-25T10:00:48.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.817+0000 7f3c28ff9640 1 -- 172.21.15.7:0/489905415 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c38037040 con 0x55b26426b230 2024-04-25T10:00:48.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.818+0000 7f3c4c673740 1 -- 172.21.15.7:0/489905415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26426b230 msgr2=0x55b264284920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:48.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.818+0000 7f3c4c673740 1 --2- 172.21.15.7:0/489905415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26426b230 0x55b264284920 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f3c3802a8b0 tx=0x7f3c38008030 comp rx=0 tx=0).stop 2024-04-25T10:00:48.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.818+0000 7f3c4c673740 1 -- 172.21.15.7:0/489905415 shutdown_connections 2024-04-25T10:00:48.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.818+0000 7f3c4c673740 1 --2- 172.21.15.7:0/489905415 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b264288ad0 0x55b264284e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.818+0000 7f3c4c673740 1 --2- 172.21.15.7:0/489905415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b26426b230 0x55b264284920 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.818+0000 7f3c4c673740 1 --2- 172.21.15.7:0/489905415 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b26426a4d0 0x55b2642682c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.818+0000 7f3c4c673740 1 -- 172.21.15.7:0/489905415 >> 172.21.15.7:0/489905415 conn(0x55b264240f10 msgr2=0x55b26427de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:48.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.818+0000 7f3c4c673740 1 -- 172.21.15.7:0/489905415 shutdown_connections 2024-04-25T10:00:48.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.818+0000 7f3c4c673740 1 -- 172.21.15.7:0/489905415 wait complete. 2024-04-25T10:00:48.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.819+0000 7f3c4c673740 1 -- start start 2024-04-25T10:00:48.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.819+0000 7f3c4c673740 1 Processor -- start 2024-04-25T10:00:48.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.819+0000 7f3c4c673740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b26426a4d0 0x55b2642f10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.819+0000 7f3c4c673740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b26426b230 0x55b2642f1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.819+0000 7f3c4c673740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b264288ad0 0x55b2642f2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.819+0000 7f3c4c673740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2642977d0 con 0x55b264288ad0 2024-04-25T10:00:48.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.819+0000 7f3c4c673740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b26426c650 con 0x55b26426a4d0 2024-04-25T10:00:48.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.819+0000 7f3c4c673740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b26426d650 con 0x55b26426b230 2024-04-25T10:00:48.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.819+0000 7f3c4c673740 10 client.0 _ll_register_callbacks cb 0x55b26423bc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:00:48.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.820+0000 7f3c437fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b264288ad0 0x55b2642f2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.820+0000 7f3c437fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b264288ad0 0x55b2642f2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49840/0 (socket says 172.21.15.7:49840) 2024-04-25T10:00:48.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.820+0000 7f3c437fe640 1 -- 172.21.15.7:0/2937096119 learned_addr learned my addr 172.21.15.7:0/2937096119 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:48.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.820+0000 7f3c427fc640 1 --2- 172.21.15.7:0/2937096119 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b26426b230 0x55b2642f1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.820+0000 7f3c42ffd640 1 --2- 172.21.15.7:0/2937096119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b26426a4d0 0x55b2642f10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.820+0000 7f3c437fe640 1 -- 172.21.15.7:0/2937096119 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b26426b230 msgr2=0x55b2642f1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:48.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.820+0000 7f3c437fe640 1 --2- 172.21.15.7:0/2937096119 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b26426b230 0x55b2642f1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.820+0000 7f3c437fe640 1 -- 172.21.15.7:0/2937096119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b26426a4d0 msgr2=0x55b2642f10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:48.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.820+0000 7f3c437fe640 1 --2- 172.21.15.7:0/2937096119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b26426a4d0 0x55b2642f10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.820+0000 7f3c437fe640 1 -- 172.21.15.7:0/2937096119 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b26427bcb0 con 0x55b264288ad0 2024-04-25T10:00:48.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.820+0000 7f3c437fe640 1 --2- 172.21.15.7:0/2937096119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b264288ad0 0x55b2642f2240 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c019040 tx=0x7f3c3c004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e67d441ebd6973 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:48.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.820+0000 7f3c227fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:00:48.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.820+0000 7f3c227fc640 1 -- 172.21.15.7:0/2937096119 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0077b0 con 0x55b264288ad0 2024-04-25T10:00:48.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.820+0000 7f3c227fc640 1 -- 172.21.15.7:0/2937096119 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f3c3c02d400 con 0x55b264288ad0 2024-04-25T10:00:48.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.820+0000 7f3c4c673740 1 -- 172.21.15.7:0/2937096119 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3c3803e660 con 0x55b264288ad0 2024-04-25T10:00:48.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.820+0000 7f3c227fc640 1 -- 172.21.15.7:0/2937096119 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c3c035050 con 0x55b264288ad0 2024-04-25T10:00:48.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.820+0000 7f3c4c673740 10 client.7800 fetch_fsmap learned FSMap version 59 2024-04-25T10:00:48.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.820+0000 7f3c4c673740 1 -- 172.21.15.7:0/2937096119 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x55b2642685c0 con 0x55b264288ad0 2024-04-25T10:00:48.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.820+0000 7f3c227fc640 1 -- 172.21.15.7:0/2937096119 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3803e660 con 0x55b264288ad0 2024-04-25T10:00:48.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.821+0000 7f3c227fc640 1 -- 172.21.15.7:0/2937096119 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 59) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3c3c038020 con 0x55b264288ad0 2024-04-25T10:00:48.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.821+0000 7f3c4c673740 10 client.7800 fetch_fsmap finished waiting for FSMap version 59 2024-04-25T10:00:48.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.821+0000 7f3c4c673740 10 client.7800 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:00:48.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.821+0000 7f3c4c673740 20 client.7800 populate_metadata read hostname 'smithi007' 2024-04-25T10:00:48.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.821+0000 7f3c4c673740 1 --2- 172.21.15.7:0/2937096119 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x55b26426e2a0 0x55b26423ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.821+0000 7f3c4c673740 4 client.7800 mds_command: new command op to 7734 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:00:48.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.821+0000 7f3c4c673740 1 -- 172.21.15.7:0/2937096119 --> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b2641b0f50 con 0x55b26426e2a0 2024-04-25T10:00:48.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.821+0000 7f3c42ffd640 1 --2- 172.21.15.7:0/2937096119 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x55b26426e2a0 0x55b26423ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.821+0000 7f3c227fc640 10 client.7800 ms_handle_connect on v2:172.21.15.7:6836/3829085443 2024-04-25T10:00:48.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.821+0000 7f3c42ffd640 1 --2- 172.21.15.7:0/2937096119 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x55b26426e2a0 0x55b26423ec50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=622c50d88e2fd507 server_cookie=26b5b6df2d1ba477 in_seq=0 out_seq=0 2024-04-25T10:00:48.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.821+0000 7f3c227fc640 1 -- 172.21.15.7:0/2937096119 <== mds.0 v2:172.21.15.7:6836/3829085443 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55b2641b0f50 con 0x55b26426e2a0 2024-04-25T10:00:48.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.821+0000 7f3c227fc640 10 client.7800 handle_command_reply: tid=0 2024-04-25T10:00:48.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.821+0000 7f3c4c673740 1 client.7800 shutdown 2024-04-25T10:00:48.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.821+0000 7f3c4c673740 1 -- 172.21.15.7:0/2937096119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b264288ad0 msgr2=0x55b2642f2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:48.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.821+0000 7f3c4c673740 1 --2- 172.21.15.7:0/2937096119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b264288ad0 0x55b2642f2240 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c019040 tx=0x7f3c3c004b50 comp rx=0 tx=0).stop 2024-04-25T10:00:48.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.821+0000 7f3c4c673740 1 -- 172.21.15.7:0/2937096119 shutdown_connections 2024-04-25T10:00:48.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.821+0000 7f3c4c673740 1 --2- 172.21.15.7:0/2937096119 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x55b26426e2a0 0x55b26423ec50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.821+0000 7f3c4c673740 1 --2- 172.21.15.7:0/2937096119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b264288ad0 0x55b2642f2240 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.821+0000 7f3c227fc640 0 client.7800 ms_handle_reset on v2:172.21.15.7:6836/3829085443 2024-04-25T10:00:48.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.821+0000 7f3c4c673740 1 --2- 172.21.15.7:0/2937096119 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55b26426b230 0x55b2642f1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.821+0000 7f3c4c673740 1 --2- 172.21.15.7:0/2937096119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b26426a4d0 0x55b2642f10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.821+0000 7f3c4c673740 1 -- 172.21.15.7:0/2937096119 >> 172.21.15.7:0/2937096119 conn(0x55b264240f10 msgr2=0x55b264267cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:48.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.822+0000 7f3c4c673740 1 -- 172.21.15.7:0/2937096119 shutdown_connections 2024-04-25T10:00:48.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.822+0000 7f3c4c673740 1 -- 172.21.15.7:0/2937096119 wait complete. 2024-04-25T10:00:48.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.822+0000 7f3c4c673740 20 client.7800 trim_cache size 0 max 16384 2024-04-25T10:00:48.833 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:00:48.833 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "c03d0745-5946-49c3-ad88-1165c5b68b4e", 2024-04-25T10:00:48.833 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-04-25T10:00:48.833 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 7734, 2024-04-25T10:00:48.833 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-04-25T10:00:48.833 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-04-25T10:00:48.833 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-04-25T10:00:48.833 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 4.4295988939999997, 2024-04-25T10:00:48.833 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 59, 2024-04-25T10:00:48.833 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 89, 2024-04-25T10:00:48.833 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 89, 2024-04-25T10:00:48.833 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 5.4040945000000002 2024-04-25T10:00:48.833 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:00:48.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.822+0000 7f3c4996a640 1 -- 172.21.15.7:0/3704078647 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3c3006b4d0 msgr2=0x7f3c3006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:48.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.822+0000 7f3c4996a640 1 --2- 172.21.15.7:0/3704078647 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3c3006b4d0 0x7f3c3006d990 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3c38034000 tx=0x7f3c3802e000 comp rx=0 tx=0).stop 2024-04-25T10:00:48.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.822+0000 7f3c4996a640 1 -- 172.21.15.7:0/3704078647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c440b5e60 msgr2=0x7f3c4414b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:48.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.822+0000 7f3c4996a640 1 --2- 172.21.15.7:0/3704078647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c440b5e60 0x7f3c4414b1e0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f3c3400b410 tx=0x7f3c3400b8d0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.822+0000 7f3c4996a640 1 -- 172.21.15.7:0/3704078647 shutdown_connections 2024-04-25T10:00:48.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.822+0000 7f3c4996a640 1 --2- 172.21.15.7:0/3704078647 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3c3006b4d0 0x7f3c3006d990 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.822+0000 7f3c4996a640 1 --2- 172.21.15.7:0/3704078647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c4415dd00 0x7f3c440ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.822+0000 7f3c4996a640 1 --2- 172.21.15.7:0/3704078647 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c440b6a40 0x7f3c440cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.822+0000 7f3c4996a640 1 --2- 172.21.15.7:0/3704078647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c440b5e60 0x7f3c4414b1e0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.822+0000 7f3c4996a640 1 -- 172.21.15.7:0/3704078647 >> 172.21.15.7:0/3704078647 conn(0x7f3c440d07b0 msgr2=0x7f3c440d2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:48.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.822+0000 7f3c4996a640 1 -- 172.21.15.7:0/3704078647 shutdown_connections 2024-04-25T10:00:48.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.822+0000 7f3c4996a640 1 -- 172.21.15.7:0/3704078647 wait complete. 2024-04-25T10:00:48.837 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:00:48.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.933+0000 7fa4923db640 1 Processor -- start 2024-04-25T10:00:48.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.933+0000 7fa4923db640 1 -- start start 2024-04-25T10:00:48.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.934+0000 7fa4923db640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa48c15da60 0x7fa48c0d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.934+0000 7fa4923db640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa48c15de40 0x7fa48c15e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.934+0000 7fa4923db640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa48c15e8a0 con 0x7fa48c161d70 2024-04-25T10:00:48.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.934+0000 7fa4923db640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa48c15eb80 con 0x7fa48c15da60 2024-04-25T10:00:48.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.934+0000 7fa4923db640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c15ee60 con 0x7fa48c15de40 2024-04-25T10:00:48.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.934+0000 7fa490978640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa48c161d70 0x7fa48c0ce520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45418/0 (socket says 172.21.15.7:45418) 2024-04-25T10:00:48.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.934+0000 7fa490978640 1 -- 172.21.15.7:0/677013094 learned_addr learned my addr 172.21.15.7:0/677013094 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:48.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.935+0000 7fa48bfff640 1 --2- 172.21.15.7:0/677013094 >> v2:172.21.15.55:3300/0 conn(0x7fa48c15da60 0x7fa48c0d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.935+0000 7fa48affd640 1 -- 172.21.15.7:0/677013094 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 560989428 0 0) 0x7fa48c15e8a0 con 0x7fa48c161d70 2024-04-25T10:00:48.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.935+0000 7fa48b7fe640 1 --2- 172.21.15.7:0/677013094 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa48c15de40 0x7fa48c15e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.935+0000 7fa48affd640 1 -- 172.21.15.7:0/677013094 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa474003520 con 0x7fa48c161d70 2024-04-25T10:00:48.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.935+0000 7fa48affd640 1 -- 172.21.15.7:0/677013094 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1166039787 0 0) 0x7fa474003520 con 0x7fa48c161d70 2024-04-25T10:00:48.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.935+0000 7fa48affd640 1 -- 172.21.15.7:0/677013094 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa48c15de40 msgr2=0x7fa48c15e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:48.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.935+0000 7fa48affd640 1 --2- 172.21.15.7:0/677013094 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa48c15de40 0x7fa48c15e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.935+0000 7fa48affd640 1 -- 172.21.15.7:0/677013094 >> v2:172.21.15.55:3300/0 conn(0x7fa48c15da60 msgr2=0x7fa48c0d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:48.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.935+0000 7fa48affd640 1 --2- 172.21.15.7:0/677013094 >> v2:172.21.15.55:3300/0 conn(0x7fa48c15da60 0x7fa48c0d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.935+0000 7fa48affd640 1 -- 172.21.15.7:0/677013094 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48c161850 con 0x7fa48c161d70 2024-04-25T10:00:48.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.935+0000 7fa48affd640 1 -- 172.21.15.7:0/677013094 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fa4840019f0 con 0x7fa48c161d70 2024-04-25T10:00:48.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.935+0000 7fa48affd640 1 -- 172.21.15.7:0/677013094 >> v1:172.21.15.7:6789/0 conn(0x7fa48c161d70 legacy=0x7fa48c0ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:48.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.935+0000 7fa48affd640 1 --2- 172.21.15.7:0/677013094 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa48c15de40 0x7fa4740039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.935+0000 7fa48affd640 1 --2- 172.21.15.7:0/677013094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa474003f30 0x7fa474004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.935+0000 7fa48affd640 1 --2- 172.21.15.7:0/677013094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa474004d40 0x7fa4740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.935+0000 7fa48affd640 1 -- 172.21.15.7:0/677013094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c15eb80 con 0x7fa474004d40 2024-04-25T10:00:48.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.935+0000 7fa48affd640 1 -- 172.21.15.7:0/677013094 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c15ee60 con 0x7fa474003f30 2024-04-25T10:00:48.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.935+0000 7fa48affd640 1 -- 172.21.15.7:0/677013094 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa47400ba10 con 0x7fa48c15de40 2024-04-25T10:00:48.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.935+0000 7fa490978640 1 --2- 172.21.15.7:0/677013094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa474004d40 0x7fa4740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.935+0000 7fa48b7fe640 1 --2- 172.21.15.7:0/677013094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa474003f30 0x7fa474004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.935+0000 7fa48bfff640 1 --2- 172.21.15.7:0/677013094 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa48c15de40 0x7fa4740039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.935+0000 7fa490978640 1 -- 172.21.15.7:0/677013094 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa48c15de40 msgr2=0x7fa4740039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:48.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.935+0000 7fa490978640 1 --2- 172.21.15.7:0/677013094 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa48c15de40 0x7fa4740039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.935+0000 7fa490978640 1 -- 172.21.15.7:0/677013094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa474003f30 msgr2=0x7fa474004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:48.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.935+0000 7fa490978640 1 --2- 172.21.15.7:0/677013094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa474003f30 0x7fa474004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.935+0000 7fa490978640 1 -- 172.21.15.7:0/677013094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa474003520 con 0x7fa474004d40 2024-04-25T10:00:48.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.936+0000 7fa490978640 1 --2- 172.21.15.7:0/677013094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa474004d40 0x7fa4740051c0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fa48400a890 tx=0x7fa474005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c230106abdcf5b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:48.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.936+0000 7fa48affd640 1 -- 172.21.15.7:0/677013094 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48400a4e0 con 0x7fa474004d40 2024-04-25T10:00:48.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.936+0000 7fa48affd640 1 -- 172.21.15.7:0/677013094 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48402f070 con 0x7fa474004d40 2024-04-25T10:00:48.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.936+0000 7fa48affd640 1 -- 172.21.15.7:0/677013094 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48402bcf0 con 0x7fa474004d40 2024-04-25T10:00:48.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.937+0000 7fa4923db640 1 -- 172.21.15.7:0/677013094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa474004d40 msgr2=0x7fa4740051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:48.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.937+0000 7fa4923db640 1 --2- 172.21.15.7:0/677013094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa474004d40 0x7fa4740051c0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fa48400a890 tx=0x7fa474005830 comp rx=0 tx=0).stop 2024-04-25T10:00:48.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.937+0000 7fa490978640 1 -- 172.21.15.7:0/677013094 reap_dead start 2024-04-25T10:00:48.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.937+0000 7fa4923db640 1 -- 172.21.15.7:0/677013094 shutdown_connections 2024-04-25T10:00:48.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.937+0000 7fa4923db640 1 -- 172.21.15.7:0/677013094 >> 172.21.15.7:0/677013094 conn(0x7fa48c06bfe0 msgr2=0x7fa48c06c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:48.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.937+0000 7fa4923db640 1 -- 172.21.15.7:0/677013094 shutdown_connections 2024-04-25T10:00:48.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.937+0000 7fa4923db640 1 -- 172.21.15.7:0/677013094 wait complete. 2024-04-25T10:00:48.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.938+0000 7fa4923db640 1 Processor -- start 2024-04-25T10:00:48.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.938+0000 7fa4923db640 1 -- start start 2024-04-25T10:00:48.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.939+0000 7fa4923db640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa474004d40 0x7fa48c153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.939+0000 7fa4923db640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa48c0cdeb0 0x7fa48c0ce330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.939+0000 7fa4923db640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa48c0cc980 0x7fa48c0cce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.939+0000 7fa4923db640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c15e2a0 con 0x7fa474004d40 2024-04-25T10:00:48.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.939+0000 7fa4923db640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c0cee40 con 0x7fa48c0cc980 2024-04-25T10:00:48.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.939+0000 7fa4923db640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c15e420 con 0x7fa48c0cdeb0 2024-04-25T10:00:48.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.939+0000 7fa48bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa474004d40 0x7fa48c153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.939+0000 7fa48bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa474004d40 0x7fa48c153cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49866/0 (socket says 172.21.15.7:49866) 2024-04-25T10:00:48.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.939+0000 7fa48bfff640 1 -- 172.21.15.7:0/952735008 learned_addr learned my addr 172.21.15.7:0/952735008 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:48.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.939+0000 7fa48b7fe640 1 --2- 172.21.15.7:0/952735008 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa48c0cdeb0 0x7fa48c0ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.939+0000 7fa490978640 1 --2- 172.21.15.7:0/952735008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa48c0cc980 0x7fa48c0cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.939+0000 7fa48bfff640 1 -- 172.21.15.7:0/952735008 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa48c0cdeb0 msgr2=0x7fa48c0ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:48.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.939+0000 7fa48bfff640 1 --2- 172.21.15.7:0/952735008 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa48c0cdeb0 0x7fa48c0ce330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.939+0000 7fa48bfff640 1 -- 172.21.15.7:0/952735008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa48c0cc980 msgr2=0x7fa48c0cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:48.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.939+0000 7fa48bfff640 1 --2- 172.21.15.7:0/952735008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa48c0cc980 0x7fa48c0cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:48.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.939+0000 7fa48bfff640 1 -- 172.21.15.7:0/952735008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48c1546b0 con 0x7fa474004d40 2024-04-25T10:00:48.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.939+0000 7fa48b7fe640 1 --2- 172.21.15.7:0/952735008 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa48c0cdeb0 0x7fa48c0ce330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:48.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.939+0000 7fa490978640 1 --2- 172.21.15.7:0/952735008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa48c0cc980 0x7fa48c0cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:48.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.940+0000 7fa48bfff640 1 --2- 172.21.15.7:0/952735008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa474004d40 0x7fa48c153cf0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fa47c011ad0 tx=0x7fa47c011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:48.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.940+0000 7fa488ff9640 1 -- 172.21.15.7:0/952735008 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c00fbb0 con 0x7fa474004d40 2024-04-25T10:00:48.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.940+0000 7fa488ff9640 1 -- 172.21.15.7:0/952735008 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47c00fd50 con 0x7fa474004d40 2024-04-25T10:00:48.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.940+0000 7fa488ff9640 1 -- 172.21.15.7:0/952735008 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c014660 con 0x7fa474004d40 2024-04-25T10:00:48.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.940+0000 7fa4923db640 1 -- 172.21.15.7:0/952735008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa48c154990 con 0x7fa474004d40 2024-04-25T10:00:48.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.940+0000 7fa4923db640 1 -- 172.21.15.7:0/952735008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa48c154230 con 0x7fa474004d40 2024-04-25T10:00:48.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.941+0000 7fa4923db640 1 -- 172.21.15.7:0/952735008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa48c068fd0 con 0x7fa474004d40 2024-04-25T10:00:48.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.941+0000 7fa488ff9640 1 -- 172.21.15.7:0/952735008 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa47c012040 con 0x7fa474004d40 2024-04-25T10:00:48.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.942+0000 7fa488ff9640 1 --2- 172.21.15.7:0/952735008 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa47806b500 0x7fa47806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:48.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.942+0000 7fa488ff9640 1 -- 172.21.15.7:0/952735008 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fa47c08aab0 con 0x7fa474004d40 2024-04-25T10:00:48.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.942+0000 7fa48b7fe640 1 --2- 172.21.15.7:0/952735008 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa47806b500 0x7fa47806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:48.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.942+0000 7fa48b7fe640 1 --2- 172.21.15.7:0/952735008 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa47806b500 0x7fa47806d9c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa48c1f6840 tx=0x7fa480008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:48.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:48.946+0000 7fa488ff9640 1 -- 172.21.15.7:0/952735008 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa47c019030 con 0x7fa474004d40 2024-04-25T10:00:49.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:49.165+0000 7fa4923db640 1 -- 172.21.15.7:0/952735008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa48c0d1560 con 0x7fa474004d40 2024-04-25T10:00:49.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:49.165+0000 7fa488ff9640 1 -- 172.21.15.7:0/952735008 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v59) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa47c0597e0 con 0x7fa474004d40 2024-04-25T10:00:49.173 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T10:00:49.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:49.167+0000 7fa4923db640 1 -- 172.21.15.7:0/952735008 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa47806b500 msgr2=0x7fa47806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:49.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:49.167+0000 7fa4923db640 1 --2- 172.21.15.7:0/952735008 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa47806b500 0x7fa47806d9c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa48c1f6840 tx=0x7fa480008040 comp rx=0 tx=0).stop 2024-04-25T10:00:49.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:49.167+0000 7fa4923db640 1 -- 172.21.15.7:0/952735008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa474004d40 msgr2=0x7fa48c153cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:49.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:49.167+0000 7fa4923db640 1 --2- 172.21.15.7:0/952735008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa474004d40 0x7fa48c153cf0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fa47c011ad0 tx=0x7fa47c011f90 comp rx=0 tx=0).stop 2024-04-25T10:00:49.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:49.167+0000 7fa4923db640 1 -- 172.21.15.7:0/952735008 shutdown_connections 2024-04-25T10:00:49.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:49.167+0000 7fa4923db640 1 --2- 172.21.15.7:0/952735008 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa47806b500 0x7fa47806d9c0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:49.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:49.167+0000 7fa4923db640 1 --2- 172.21.15.7:0/952735008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa48c0cc980 0x7fa48c0cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:49.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:49.167+0000 7fa4923db640 1 --2- 172.21.15.7:0/952735008 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa48c0cdeb0 0x7fa48c0ce330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:49.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:49.167+0000 7fa4923db640 1 --2- 172.21.15.7:0/952735008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa474004d40 0x7fa48c153cf0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:49.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:49.167+0000 7fa4923db640 1 -- 172.21.15.7:0/952735008 >> 172.21.15.7:0/952735008 conn(0x7fa48c06bfe0 msgr2=0x7fa48c1608a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:49.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:49.167+0000 7fa4923db640 1 -- 172.21.15.7:0/952735008 shutdown_connections 2024-04-25T10:00:49.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:49.167+0000 7fa4923db640 1 -- 172.21.15.7:0/952735008 wait complete. 2024-04-25T10:00:49.183 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T10:00:49.183 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:00:49.183 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-04-25T10:00:49.183 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T10:00:49.184 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T10:00:49.184 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T10:00:49.184 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T10:00:49.184 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:00:49.184 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:00:49.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:49.185 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-04-25T10:00:49.201 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:00:49.201 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:00:49.201 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:00:49.201 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:00:49.201 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-04-25T10:00:49.201 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:00:49.201 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:00:49.201 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-04-25T10:00:49.201 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-04-25T10:00:49.201 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:00:49.201 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-04-25T10:00:49.202 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-04-25T10:00:49.202 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:00:49.202 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-04-25T10:00:49.202 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-04-25T10:00:49.202 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T10:00:49.202 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42350sec preferred_lft 42350sec 2024-04-25T10:00:49.202 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link noprefixroute 2024-04-25T10:00:49.202 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:00:49.202 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:00:49.202 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-04-25T10:00:49.202 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-04-25T10:00:49.202 INFO:teuthology.orchestra.run.smithi007.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T10:00:49.202 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 26:0c:99:53:12:e3 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:00:49.202 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T10:00:49.203 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:00:49.203 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::50aa:55ff:febc:5f67/64 scope link 2024-04-25T10:00:49.203 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:00:49.203 INFO:teuthology.orchestra.run.smithi007.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:00:49.203 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 6e:99:f1:00:a9:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:00:49.203 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6c99:f1ff:fe00:a95e/64 scope link 2024-04-25T10:00:49.203 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:00:49.203 INFO:teuthology.orchestra.run.smithi007.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:00:49.203 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 26:0c:99:53:12:e3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T10:00:49.203 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::240c:99ff:fe53:12e3/64 scope link 2024-04-25T10:00:49.203 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:00:49.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:49.204 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:00:49.264 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-04-25T10:00:49.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:49.266 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-04-25T10:00:49.322 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-04-25T10:00:49.322 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:00:49.323 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T10:00:49.323 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T10:00:49.323 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:00:49.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:49.323 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-04-25T10:00:49.323 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-25T10:00:49.323 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:00:49.323 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:00:49.324 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:00:49.324 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-25T10:00:49.392 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-04-25T10:00:49.388+0000 7f5deecb3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:00:49.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:49.409 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-04-25T10:00:49.465 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T10:00:49.465 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T10:00:49.465 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:00:49.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:49.465 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-04-25T10:00:49.529 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:00:49.530 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T10:00:49.586 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:00:49.587 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:00:49.587 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:00:49.642 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T10:00:49.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:49.643 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:00:49.725 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:00:49.725 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T10:00:49.725 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T10:00:49.733 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:00:49.734 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T10:00:49.734 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T10:00:49.734 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T10:00:49.734 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T10:00:49.738 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:00:49.738 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T10:00:49.739 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T10:00:49.739 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T10:00:49.739 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T10:00:49.739 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790" 2024-04-25T10:00:49.739 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790:/ 2024-04-25T10:00:49.739 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c03d0745-5946-49c3-ad88-1165c5b68b4e" will pass to kernel 2024-04-25T10:00:49.739 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T10:00:49.739 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-04-25T10:00:49.739 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T10:00:49.740 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T10:00:49.740 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T10:00:49.741 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T10:00:49.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:49.742 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:00:49.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:49.807 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:00:49.864 INFO:teuthology.orchestra.run.smithi007.stdout:client6278 2024-04-25T10:00:49.864 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:00:49.864 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:00:49.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:49.921 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat testdir/hardlink) 2024-04-25T10:00:49.979 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-04-25T10:00:49.975+0000 7f5deacab640 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-04-25T10:00:49.980 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:00:49.981 INFO:teuthology.orchestra.run.smithi007.stderr:stat: cannot statx 'testdir/hardlink': Input/output error 2024-04-25T10:00:49.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:49.981 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive 2024-04-25T10:00:50.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.121+0000 7f2ba477e640 1 Processor -- start 2024-04-25T10:00:50.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.121+0000 7f2ba477e640 1 -- start start 2024-04-25T10:00:50.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.122+0000 7f2ba477e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2b9c15dba0 0x7f2b9c0b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.122+0000 7f2ba477e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b9c15df80 0x7f2b9c0cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.122+0000 7f2ba477e640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b9c0d1a10 con 0x7f2b9c0b6a40 2024-04-25T10:00:50.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.122+0000 7f2ba477e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b9c0d1cb0 con 0x7f2b9c15dba0 2024-04-25T10:00:50.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.122+0000 7f2ba477e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c0d1f90 con 0x7f2b9c15df80 2024-04-25T10:00:50.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.122+0000 7f2ba2d1b640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2b9c0b6a40 0x7f2b9c0d0220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:36938/0 (socket says 172.21.15.7:36938) 2024-04-25T10:00:50.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.122+0000 7f2ba2d1b640 1 -- 172.21.15.7:0/2552269366 learned_addr learned my addr 172.21.15.7:0/2552269366 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:00:50.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.122+0000 7f2ba1d19640 1 --2- 172.21.15.7:0/2552269366 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b9c15df80 0x7f2b9c0cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.122+0000 7f2ba251a640 1 --2- 172.21.15.7:0/2552269366 >> v2:172.21.15.55:3300/0 conn(0x7f2b9c15dba0 0x7f2b9c0b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.122+0000 7f2ba1518640 1 -- 172.21.15.7:0/2552269366 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2875454786 0 0) 0x7f2b9c0d1a10 con 0x7f2b9c0b6a40 2024-04-25T10:00:50.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.122+0000 7f2ba1518640 1 -- 172.21.15.7:0/2552269366 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b88003520 con 0x7f2b9c0b6a40 2024-04-25T10:00:50.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.122+0000 7f2ba1518640 1 -- 172.21.15.7:0/2552269366 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2256651337 0 0) 0x7f2b88003520 con 0x7f2b9c0b6a40 2024-04-25T10:00:50.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.122+0000 7f2ba1518640 1 -- 172.21.15.7:0/2552269366 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b9c15df80 msgr2=0x7f2b9c0cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:50.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.122+0000 7f2ba1518640 1 --2- 172.21.15.7:0/2552269366 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b9c15df80 0x7f2b9c0cea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.122+0000 7f2ba1518640 1 -- 172.21.15.7:0/2552269366 >> v2:172.21.15.55:3300/0 conn(0x7f2b9c15dba0 msgr2=0x7f2b9c0b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:50.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.122+0000 7f2ba1518640 1 --2- 172.21.15.7:0/2552269366 >> v2:172.21.15.55:3300/0 conn(0x7f2b9c15dba0 0x7f2b9c0b2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.122+0000 7f2ba1518640 1 -- 172.21.15.7:0/2552269366 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b9c0d2270 con 0x7f2b9c0b6a40 2024-04-25T10:00:50.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.122+0000 7f2ba1518640 1 -- 172.21.15.7:0/2552269366 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f2b94001a10 con 0x7f2b9c0b6a40 2024-04-25T10:00:50.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.122+0000 7f2ba251a640 1 --2- 172.21.15.7:0/2552269366 >> v2:172.21.15.55:3300/0 conn(0x7f2b9c15dba0 0x7f2b9c0b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:00:50.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.122+0000 7f2ba1518640 1 -- 172.21.15.7:0/2552269366 >> v1:172.21.15.7:6789/0 conn(0x7f2b9c0b6a40 legacy=0x7f2b9c0d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:50.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.122+0000 7f2ba1518640 1 --2- 172.21.15.7:0/2552269366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b880039b0 0x7f2b88003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.122+0000 7f2ba1518640 1 --2- 172.21.15.7:0/2552269366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b88004800 0x7f2b88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.122+0000 7f2ba1518640 1 --2- 172.21.15.7:0/2552269366 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b880051c0 0x7f2b8800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.123+0000 7f2ba1518640 1 -- 172.21.15.7:0/2552269366 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c0d1cb0 con 0x7f2b88004800 2024-04-25T10:00:50.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.123+0000 7f2ba1518640 1 -- 172.21.15.7:0/2552269366 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c0d1f90 con 0x7f2b880039b0 2024-04-25T10:00:50.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.123+0000 7f2ba1518640 1 -- 172.21.15.7:0/2552269366 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8800bf00 con 0x7f2b880051c0 2024-04-25T10:00:50.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.123+0000 7f2ba1d19640 1 --2- 172.21.15.7:0/2552269366 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b9c15df80 0x7f2b9c0cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:00:50.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.123+0000 7f2ba1d19640 1 --2- 172.21.15.7:0/2552269366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b88004800 0x7f2b88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.123+0000 7f2ba251a640 1 --2- 172.21.15.7:0/2552269366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b880039b0 0x7f2b88003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.123+0000 7f2ba2d1b640 1 --2- 172.21.15.7:0/2552269366 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b880051c0 0x7f2b8800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.123+0000 7f2ba1d19640 1 -- 172.21.15.7:0/2552269366 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b880051c0 msgr2=0x7f2b8800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:50.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.123+0000 7f2ba1d19640 1 --2- 172.21.15.7:0/2552269366 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b880051c0 0x7f2b8800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.123+0000 7f2ba1d19640 1 -- 172.21.15.7:0/2552269366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b880039b0 msgr2=0x7f2b88003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:50.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.123+0000 7f2ba1d19640 1 --2- 172.21.15.7:0/2552269366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b880039b0 0x7f2b88003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.123+0000 7f2ba1d19640 1 -- 172.21.15.7:0/2552269366 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b88003520 con 0x7f2b88004800 2024-04-25T10:00:50.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.124+0000 7f2ba1d19640 1 --2- 172.21.15.7:0/2552269366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b88004800 0x7f2b88004c80 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c009b00 tx=0x7f2b88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a62460d0a4116561 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:50.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.124+0000 7f2ba1518640 1 -- 172.21.15.7:0/2552269366 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c036070 con 0x7f2b88004800 2024-04-25T10:00:50.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.124+0000 7f2ba1518640 1 -- 172.21.15.7:0/2552269366 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8c004030 con 0x7f2b88004800 2024-04-25T10:00:50.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.124+0000 7f2ba1518640 1 -- 172.21.15.7:0/2552269366 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c0097d0 con 0x7f2b88004800 2024-04-25T10:00:50.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.124+0000 7f2ba477e640 1 -- 172.21.15.7:0/2552269366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b88004800 msgr2=0x7f2b88004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:50.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.124+0000 7f2ba477e640 1 --2- 172.21.15.7:0/2552269366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b88004800 0x7f2b88004c80 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c009b00 tx=0x7f2b88005830 comp rx=0 tx=0).stop 2024-04-25T10:00:50.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.124+0000 7f2ba2d1b640 1 -- 172.21.15.7:0/2552269366 reap_dead start 2024-04-25T10:00:50.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.124+0000 7f2ba477e640 1 -- 172.21.15.7:0/2552269366 shutdown_connections 2024-04-25T10:00:50.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.124+0000 7f2ba477e640 1 -- 172.21.15.7:0/2552269366 >> 172.21.15.7:0/2552269366 conn(0x7f2b9c06c530 msgr2=0x7f2b9c072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:50.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.124+0000 7f2ba477e640 1 -- 172.21.15.7:0/2552269366 shutdown_connections 2024-04-25T10:00:50.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.124+0000 7f2ba477e640 1 -- 172.21.15.7:0/2552269366 wait complete. 2024-04-25T10:00:50.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.126+0000 7f2ba477e640 1 Processor -- start 2024-04-25T10:00:50.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.126+0000 7f2ba477e640 1 -- start start 2024-04-25T10:00:50.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.126+0000 7f2ba477e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b88004800 0x7f2b9c1579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.126+0000 7f2ba477e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b9c0b45b0 0x7f2b9c0c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.126+0000 7f2ba477e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b9c0b2ce0 0x7f2b9c0b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.126+0000 7f2ba477e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c0d0ab0 con 0x7f2b9c0b45b0 2024-04-25T10:00:50.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.126+0000 7f2ba477e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c0d0930 con 0x7f2b88004800 2024-04-25T10:00:50.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.126+0000 7f2ba477e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c0b6ec0 con 0x7f2b9c0b2ce0 2024-04-25T10:00:50.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.126+0000 7f2ba1d19640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b9c0b45b0 0x7f2b9c0c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.126+0000 7f2ba1d19640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b9c0b45b0 0x7f2b9c0c95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46298/0 (socket says 172.21.15.7:46298) 2024-04-25T10:00:50.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.126+0000 7f2ba1d19640 1 -- 172.21.15.7:0/672773641 learned_addr learned my addr 172.21.15.7:0/672773641 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:50.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.127+0000 7f2ba251a640 1 --2- 172.21.15.7:0/672773641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b88004800 0x7f2b9c1579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.127+0000 7f2ba2d1b640 1 --2- 172.21.15.7:0/672773641 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b9c0b2ce0 0x7f2b9c0b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.127+0000 7f2ba1d19640 1 -- 172.21.15.7:0/672773641 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b9c0b2ce0 msgr2=0x7f2b9c0b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:50.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.127+0000 7f2ba1d19640 1 --2- 172.21.15.7:0/672773641 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b9c0b2ce0 0x7f2b9c0b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.127+0000 7f2ba1d19640 1 -- 172.21.15.7:0/672773641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b88004800 msgr2=0x7f2b9c1579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:50.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.127+0000 7f2ba1d19640 1 --2- 172.21.15.7:0/672773641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b88004800 0x7f2b9c1579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.127+0000 7f2ba1d19640 1 -- 172.21.15.7:0/672773641 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b9c0b3510 con 0x7f2b9c0b45b0 2024-04-25T10:00:50.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.127+0000 7f2ba2d1b640 1 --2- 172.21.15.7:0/672773641 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b9c0b2ce0 0x7f2b9c0b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:50.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.127+0000 7f2ba1d19640 1 --2- 172.21.15.7:0/672773641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b9c0b45b0 0x7f2b9c0c95b0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c034040 tx=0x7f2b8c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:50.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.127+0000 7f2b92ffd640 1 -- 172.21.15.7:0/672773641 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c041020 con 0x7f2b9c0b45b0 2024-04-25T10:00:50.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.127+0000 7f2b92ffd640 1 -- 172.21.15.7:0/672773641 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8c0039f0 con 0x7f2b9c0b45b0 2024-04-25T10:00:50.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.127+0000 7f2ba477e640 1 -- 172.21.15.7:0/672773641 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b9c0b37f0 con 0x7f2b9c0b45b0 2024-04-25T10:00:50.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.127+0000 7f2b92ffd640 1 -- 172.21.15.7:0/672773641 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c036040 con 0x7f2b9c0b45b0 2024-04-25T10:00:50.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.127+0000 7f2ba477e640 1 -- 172.21.15.7:0/672773641 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b9c0b3db0 con 0x7f2b9c0b45b0 2024-04-25T10:00:50.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.128+0000 7f2b92ffd640 1 -- 172.21.15.7:0/672773641 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2b8c044020 con 0x7f2b9c0b45b0 2024-04-25T10:00:50.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.129+0000 7f2b92ffd640 1 --2- 172.21.15.7:0/672773641 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2b8006b4d0 0x7f2b8006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.129+0000 7f2b92ffd640 1 -- 172.21.15.7:0/672773641 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f2b8c0aa570 con 0x7f2b9c0b45b0 2024-04-25T10:00:50.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.129+0000 7f2ba251a640 1 --2- 172.21.15.7:0/672773641 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2b8006b4d0 0x7f2b8006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.129+0000 7f2ba251a640 1 --2- 172.21.15.7:0/672773641 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2b8006b4d0 0x7f2b8006d990 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2b980093d0 tx=0x7f2b98009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:50.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.130+0000 7f2ba7480740 1 Processor -- start 2024-04-25T10:00:50.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.130+0000 7f2ba7480740 1 -- start start 2024-04-25T10:00:50.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.131+0000 7f2ba7480740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x565019596080 0x565019598890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.131+0000 7f2ba7480740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565019596460 0x565019598dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.131+0000 7f2ba7480740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565019568ce0 0x56501956c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.131+0000 7f2ba7480740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650194d1af0 con 0x565019596460 2024-04-25T10:00:50.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.131+0000 7f2ba7480740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56501947ade0 con 0x565019568ce0 2024-04-25T10:00:50.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.131+0000 7f2ba7480740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5650194cdb90 con 0x565019596080 2024-04-25T10:00:50.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.131+0000 7f2ba1d19640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565019596460 0x565019598dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.131+0000 7f2ba1d19640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565019596460 0x565019598dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46308/0 (socket says 172.21.15.7:46308) 2024-04-25T10:00:50.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.131+0000 7f2ba1d19640 1 -- 172.21.15.7:0/3823595364 learned_addr learned my addr 172.21.15.7:0/3823595364 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:50.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.131+0000 7f2ba2d1b640 1 --2- 172.21.15.7:0/3823595364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565019568ce0 0x56501956c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.131+0000 7f2ba251a640 1 --2- 172.21.15.7:0/3823595364 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x565019596080 0x565019598890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.131+0000 7f2ba1d19640 1 -- 172.21.15.7:0/3823595364 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x565019596080 msgr2=0x565019598890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:50.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.131+0000 7f2ba1d19640 1 --2- 172.21.15.7:0/3823595364 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x565019596080 0x565019598890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.131+0000 7f2ba1d19640 1 -- 172.21.15.7:0/3823595364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565019568ce0 msgr2=0x56501956c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:50.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.131+0000 7f2ba1d19640 1 --2- 172.21.15.7:0/3823595364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565019568ce0 0x56501956c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.131+0000 7f2ba1d19640 1 -- 172.21.15.7:0/3823595364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650192b27b0 con 0x565019596460 2024-04-25T10:00:50.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.131+0000 7f2ba2d1b640 1 --2- 172.21.15.7:0/3823595364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565019568ce0 0x56501956c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:50.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.131+0000 7f2ba1d19640 1 --2- 172.21.15.7:0/3823595364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565019596460 0x565019598dd0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c078be0 tx=0x7f2b8c078790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=856997ea99453dad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:50.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.131+0000 7f2b7ffff640 1 -- 172.21.15.7:0/3823595364 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c07ccf0 con 0x565019596460 2024-04-25T10:00:50.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.132+0000 7f2b7ffff640 1 -- 172.21.15.7:0/3823595364 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8c0812b0 con 0x565019596460 2024-04-25T10:00:50.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.132+0000 7f2b7ffff640 1 -- 172.21.15.7:0/3823595364 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c076f50 con 0x565019596460 2024-04-25T10:00:50.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.132+0000 7f2ba7480740 1 -- 172.21.15.7:0/3823595364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565019596460 msgr2=0x565019598dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:50.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.132+0000 7f2ba7480740 1 --2- 172.21.15.7:0/3823595364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565019596460 0x565019598dd0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c078be0 tx=0x7f2b8c078790 comp rx=0 tx=0).stop 2024-04-25T10:00:50.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.132+0000 7f2ba7480740 1 -- 172.21.15.7:0/3823595364 shutdown_connections 2024-04-25T10:00:50.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.132+0000 7f2ba7480740 1 --2- 172.21.15.7:0/3823595364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565019568ce0 0x56501956c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.132+0000 7f2ba7480740 1 --2- 172.21.15.7:0/3823595364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565019596460 0x565019598dd0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.132+0000 7f2ba7480740 1 --2- 172.21.15.7:0/3823595364 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x565019596080 0x565019598890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.132+0000 7f2ba7480740 1 -- 172.21.15.7:0/3823595364 >> 172.21.15.7:0/3823595364 conn(0x56501956af50 msgr2=0x5650195b3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:50.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.132+0000 7f2ba7480740 1 -- 172.21.15.7:0/3823595364 shutdown_connections 2024-04-25T10:00:50.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.132+0000 7f2ba7480740 1 -- 172.21.15.7:0/3823595364 wait complete. 2024-04-25T10:00:50.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.133+0000 7f2ba7480740 1 -- start start 2024-04-25T10:00:50.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.133+0000 7f2ba7480740 1 Processor -- start 2024-04-25T10:00:50.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.134+0000 7f2ba7480740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565019596080 0x5650195b84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.134+0000 7f2ba7480740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565019596460 0x56501959a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.134+0000 7f2ba7480740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56501959abe0 0x5650195ba870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.134+0000 7f2ba7480740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650194cdb90 con 0x565019596080 2024-04-25T10:00:50.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.134+0000 7f2ba7480740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650194703e0 con 0x565019596460 2024-04-25T10:00:50.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.134+0000 7f2ba7480740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5650194d1af0 con 0x56501959abe0 2024-04-25T10:00:50.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.134+0000 7f2ba7480740 10 client.0 _ll_register_callbacks cb 0x56501948dd50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:00:50.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.134+0000 7f2ba251a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565019596080 0x5650195b84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.134+0000 7f2ba251a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565019596080 0x5650195b84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46314/0 (socket says 172.21.15.7:46314) 2024-04-25T10:00:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.134+0000 7f2ba251a640 1 -- 172.21.15.7:0/3633197424 learned_addr learned my addr 172.21.15.7:0/3633197424 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.134+0000 7f2ba1d19640 1 --2- 172.21.15.7:0/3633197424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565019596460 0x56501959a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.134+0000 7f2ba2d1b640 1 --2- 172.21.15.7:0/3633197424 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56501959abe0 0x5650195ba870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.134+0000 7f2ba251a640 1 -- 172.21.15.7:0/3633197424 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56501959abe0 msgr2=0x5650195ba870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.134+0000 7f2ba251a640 1 --2- 172.21.15.7:0/3633197424 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56501959abe0 0x5650195ba870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.134+0000 7f2ba251a640 1 -- 172.21.15.7:0/3633197424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565019596460 msgr2=0x56501959a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.134+0000 7f2ba251a640 1 --2- 172.21.15.7:0/3633197424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565019596460 0x56501959a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.134+0000 7f2ba251a640 1 -- 172.21.15.7:0/3633197424 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565019312f40 con 0x565019596080 2024-04-25T10:00:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.134+0000 7f2ba251a640 1 --2- 172.21.15.7:0/3633197424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565019596080 0x5650195b84f0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f2b98003bc0 tx=0x7f2b980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea62fe7c68db080c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.135+0000 7f2b7d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:00:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.135+0000 7f2b7d7fa640 1 -- 172.21.15.7:0/3633197424 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9801b070 con 0x565019596080 2024-04-25T10:00:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.135+0000 7f2b7d7fa640 1 -- 172.21.15.7:0/3633197424 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f2b98015630 con 0x565019596080 2024-04-25T10:00:50.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.135+0000 7f2ba7480740 1 -- 172.21.15.7:0/3633197424 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2b8c0812b0 con 0x565019596080 2024-04-25T10:00:50.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.135+0000 7f2b7d7fa640 1 -- 172.21.15.7:0/3633197424 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b98033050 con 0x565019596080 2024-04-25T10:00:50.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.135+0000 7f2ba7480740 10 client.7818 fetch_fsmap learned FSMap version 59 2024-04-25T10:00:50.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.135+0000 7f2ba7480740 1 -- 172.21.15.7:0/3633197424 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x5650191a60a0 con 0x565019596080 2024-04-25T10:00:50.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.135+0000 7f2b7d7fa640 1 -- 172.21.15.7:0/3633197424 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8c0812b0 con 0x565019596080 2024-04-25T10:00:50.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.135+0000 7f2b7d7fa640 1 -- 172.21.15.7:0/3633197424 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 59) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2b98036020 con 0x565019596080 2024-04-25T10:00:50.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.135+0000 7f2ba7480740 10 client.7818 fetch_fsmap finished waiting for FSMap version 59 2024-04-25T10:00:50.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.135+0000 7f2ba7480740 10 client.7818 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T10:00:50.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.135+0000 7f2ba7480740 20 client.7818 populate_metadata read hostname 'smithi007' 2024-04-25T10:00:50.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.135+0000 7f2ba7480740 1 --2- 172.21.15.7:0/3633197424 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x5650195bb280 0x565019594e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.135+0000 7f2ba7480740 4 client.7818 mds_command: new command op to 7734 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:00:50.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.135+0000 7f2ba7480740 1 -- 172.21.15.7:0/3633197424 --> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5650194df030 con 0x5650195bb280 2024-04-25T10:00:50.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.135+0000 7f2ba1d19640 1 --2- 172.21.15.7:0/3633197424 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x5650195bb280 0x565019594e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.136+0000 7f2b7d7fa640 10 client.7818 ms_handle_connect on v2:172.21.15.7:6836/3829085443 2024-04-25T10:00:50.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.136+0000 7f2ba1d19640 1 --2- 172.21.15.7:0/3633197424 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x5650195bb280 0x565019594e60 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a4d899907d4d6ec server_cookie=47ba4ff512c6cbfe in_seq=0 out_seq=0 2024-04-25T10:00:50.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.136+0000 7f2b7d7fa640 1 -- 172.21.15.7:0/3633197424 <== mds.0 v2:172.21.15.7:6836/3829085443 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5650194df030 con 0x5650195bb280 2024-04-25T10:00:50.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.136+0000 7f2b7d7fa640 10 client.7818 handle_command_reply: tid=0 2024-04-25T10:00:50.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.136+0000 7f2ba7480740 1 client.7818 shutdown 2024-04-25T10:00:50.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.136+0000 7f2ba7480740 1 -- 172.21.15.7:0/3633197424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565019596080 msgr2=0x5650195b84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:50.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.136+0000 7f2ba7480740 1 --2- 172.21.15.7:0/3633197424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565019596080 0x5650195b84f0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f2b98003bc0 tx=0x7f2b980046c0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.136+0000 7f2ba7480740 1 -- 172.21.15.7:0/3633197424 shutdown_connections 2024-04-25T10:00:50.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.136+0000 7f2ba7480740 1 --2- 172.21.15.7:0/3633197424 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x5650195bb280 0x565019594e60 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.136+0000 7f2ba7480740 1 --2- 172.21.15.7:0/3633197424 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56501959abe0 0x5650195ba870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.136+0000 7f2ba7480740 1 --2- 172.21.15.7:0/3633197424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565019596460 0x56501959a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.136+0000 7f2ba7480740 1 --2- 172.21.15.7:0/3633197424 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565019596080 0x5650195b84f0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.136+0000 7f2b7d7fa640 0 client.7818 ms_handle_reset on v2:172.21.15.7:6836/3829085443 2024-04-25T10:00:50.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.136+0000 7f2ba7480740 1 -- 172.21.15.7:0/3633197424 >> 172.21.15.7:0/3633197424 conn(0x565019568ce0 msgr2=0x56501956e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:50.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.136+0000 7f2ba7480740 1 -- 172.21.15.7:0/3633197424 shutdown_connections 2024-04-25T10:00:50.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.137+0000 7f2ba7480740 1 -- 172.21.15.7:0/3633197424 wait complete. 2024-04-25T10:00:50.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.137+0000 7f2ba7480740 20 client.7818 trim_cache size 0 max 16384 2024-04-25T10:00:50.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.152+0000 7f2ba7480740 1 Processor -- start 2024-04-25T10:00:50.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.152+0000 7f2ba7480740 1 -- start start 2024-04-25T10:00:50.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.152+0000 7f2ba7480740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565019596080 0x565019567b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.152+0000 7f2ba7480740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565019596460 0x56501959bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.152+0000 7f2ba7480740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56501959abe0 0x56501959c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.152+0000 7f2ba7480740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c200cd0 con 0x565019596080 2024-04-25T10:00:50.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.152+0000 7f2ba7480740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c1ffe70 con 0x565019596460 2024-04-25T10:00:50.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.152+0000 7f2ba7480740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c1ff3c0 con 0x56501959abe0 2024-04-25T10:00:50.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.152+0000 7f2ba251a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565019596080 0x565019567b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.152+0000 7f2ba251a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565019596080 0x565019567b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46316/0 (socket says 172.21.15.7:46316) 2024-04-25T10:00:50.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.152+0000 7f2ba251a640 1 -- 172.21.15.7:0/2500278266 learned_addr learned my addr 172.21.15.7:0/2500278266 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:50.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.153+0000 7f2ba1d19640 1 --2- 172.21.15.7:0/2500278266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565019596460 0x56501959bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.153+0000 7f2ba2d1b640 1 --2- 172.21.15.7:0/2500278266 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56501959abe0 0x56501959c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.153+0000 7f2ba251a640 1 -- 172.21.15.7:0/2500278266 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56501959abe0 msgr2=0x56501959c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:50.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.153+0000 7f2ba251a640 1 --2- 172.21.15.7:0/2500278266 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56501959abe0 0x56501959c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.153+0000 7f2ba251a640 1 -- 172.21.15.7:0/2500278266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565019596460 msgr2=0x56501959bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:50.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.153+0000 7f2ba251a640 1 --2- 172.21.15.7:0/2500278266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565019596460 0x56501959bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.153+0000 7f2ba251a640 1 -- 172.21.15.7:0/2500278266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56501959aa10 con 0x565019596080 2024-04-25T10:00:50.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.153+0000 7f2ba251a640 1 --2- 172.21.15.7:0/2500278266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565019596080 0x565019567b00 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f2b98014d30 tx=0x7f2b98025070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6fbe7f46c85c1e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:50.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.153+0000 7f2b7f7fe640 1 -- 172.21.15.7:0/2500278266 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9803b020 con 0x565019596080 2024-04-25T10:00:50.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.153+0000 7f2b7f7fe640 1 -- 172.21.15.7:0/2500278266 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b98027030 con 0x565019596080 2024-04-25T10:00:50.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.153+0000 7f2b7f7fe640 1 -- 172.21.15.7:0/2500278266 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9802c420 con 0x565019596080 2024-04-25T10:00:50.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.154+0000 7f2ba7480740 1 -- 172.21.15.7:0/2500278266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565019596080 msgr2=0x565019567b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:50.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.154+0000 7f2ba7480740 1 --2- 172.21.15.7:0/2500278266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565019596080 0x565019567b00 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f2b98014d30 tx=0x7f2b98025070 comp rx=0 tx=0).stop 2024-04-25T10:00:50.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.154+0000 7f2ba7480740 1 -- 172.21.15.7:0/2500278266 shutdown_connections 2024-04-25T10:00:50.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.154+0000 7f2ba7480740 1 --2- 172.21.15.7:0/2500278266 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56501959abe0 0x56501959c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.154+0000 7f2ba7480740 1 --2- 172.21.15.7:0/2500278266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565019596460 0x56501959bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.154+0000 7f2ba7480740 1 --2- 172.21.15.7:0/2500278266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565019596080 0x565019567b00 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.154+0000 7f2ba7480740 1 -- 172.21.15.7:0/2500278266 >> 172.21.15.7:0/2500278266 conn(0x565019568ce0 msgr2=0x5650195ba630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:50.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.154+0000 7f2ba7480740 1 -- 172.21.15.7:0/2500278266 shutdown_connections 2024-04-25T10:00:50.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.154+0000 7f2ba7480740 1 -- 172.21.15.7:0/2500278266 wait complete. 2024-04-25T10:00:50.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.154+0000 7f2ba7480740 1 -- start start 2024-04-25T10:00:50.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.154+0000 7f2ba7480740 1 Processor -- start 2024-04-25T10:00:50.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.155+0000 7f2ba7480740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565019596080 0x56501956c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.155+0000 7f2ba7480740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x565019596460 0x565019567b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.155+0000 7f2ba7480740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56501959abe0 0x565019568040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.155+0000 7f2ba7480740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x56501947ade0 con 0x565019596080 2024-04-25T10:00:50.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.155+0000 7f2ba7480740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c1ff870 con 0x56501959abe0 2024-04-25T10:00:50.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.155+0000 7f2ba7480740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x56501948df00 con 0x565019596460 2024-04-25T10:00:50.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.155+0000 7f2ba7480740 10 client.0 _ll_register_callbacks cb 0x7f2b98009a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:00:50.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.155+0000 7f2ba251a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565019596080 0x56501956c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.155+0000 7f2ba251a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565019596080 0x56501956c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46330/0 (socket says 172.21.15.7:46330) 2024-04-25T10:00:50.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.155+0000 7f2ba251a640 1 -- 172.21.15.7:0/910724545 learned_addr learned my addr 172.21.15.7:0/910724545 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:50.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.156+0000 7f2ba2d1b640 1 --2- 172.21.15.7:0/910724545 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56501959abe0 0x565019568040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.156+0000 7f2ba251a640 1 -- 172.21.15.7:0/910724545 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x565019596460 msgr2=0x565019567b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:50.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.156+0000 7f2ba1d19640 1 --2- 172.21.15.7:0/910724545 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x565019596460 0x565019567b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.156+0000 7f2ba251a640 1 --2- 172.21.15.7:0/910724545 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x565019596460 0x565019567b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.156+0000 7f2ba251a640 1 -- 172.21.15.7:0/910724545 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56501959abe0 msgr2=0x565019568040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:50.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.156+0000 7f2ba251a640 1 --2- 172.21.15.7:0/910724545 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56501959abe0 0x565019568040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.156+0000 7f2ba251a640 1 -- 172.21.15.7:0/910724545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5650195951d0 con 0x565019596080 2024-04-25T10:00:50.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.156+0000 7f2ba2d1b640 1 --2- 172.21.15.7:0/910724545 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56501959abe0 0x565019568040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:00:50.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.156+0000 7f2ba251a640 1 --2- 172.21.15.7:0/910724545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565019596080 0x56501956c8d0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f2b9800b010 tx=0x7f2b98018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca1052dbc321a5b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:50.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.156+0000 7f2b7d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:00:50.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.156+0000 7f2b7d7fa640 1 -- 172.21.15.7:0/910724545 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9803b030 con 0x565019596080 2024-04-25T10:00:50.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.156+0000 7f2b7d7fa640 1 -- 172.21.15.7:0/910724545 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f2b98040420 con 0x565019596080 2024-04-25T10:00:50.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.156+0000 7f2ba7480740 1 -- 172.21.15.7:0/910724545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2b98027030 con 0x565019596080 2024-04-25T10:00:50.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.156+0000 7f2b7d7fa640 1 -- 172.21.15.7:0/910724545 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b98050050 con 0x565019596080 2024-04-25T10:00:50.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.156+0000 7f2ba7480740 10 client.7824 fetch_fsmap learned FSMap version 59 2024-04-25T10:00:50.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.156+0000 7f2ba7480740 1 -- 172.21.15.7:0/910724545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x5650195b3ed0 con 0x565019596080 2024-04-25T10:00:50.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.156+0000 7f2b7d7fa640 1 -- 172.21.15.7:0/910724545 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b98027030 con 0x565019596080 2024-04-25T10:00:50.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.156+0000 7f2b7d7fa640 1 -- 172.21.15.7:0/910724545 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 59) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2b98053020 con 0x565019596080 2024-04-25T10:00:50.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.156+0000 7f2ba7480740 10 client.7824 fetch_fsmap finished waiting for FSMap version 59 2024-04-25T10:00:50.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.156+0000 7f2ba7480740 10 client.7824 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T10:00:50.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.156+0000 7f2ba7480740 20 client.7824 populate_metadata read hostname 'smithi007' 2024-04-25T10:00:50.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.156+0000 7f2ba7480740 1 --2- 172.21.15.7:0/910724545 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x5650195b03c0 0x56501961e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.156+0000 7f2ba7480740 4 client.7824 mds_command: new command op to 7734 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive"]}] 2024-04-25T10:00:50.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.156+0000 7f2ba7480740 1 -- 172.21.15.7:0/910724545 --> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive"]}) v1 -- 0x5650194d9380 con 0x5650195b03c0 2024-04-25T10:00:50.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.157+0000 7f2ba1d19640 1 --2- 172.21.15.7:0/910724545 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x5650195b03c0 0x56501961e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.157+0000 7f2b7d7fa640 10 client.7824 ms_handle_connect on v2:172.21.15.7:6836/3829085443 2024-04-25T10:00:50.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.157+0000 7f2ba1d19640 1 --2- 172.21.15.7:0/910724545 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x5650195b03c0 0x56501961e5b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec04606a769e229 server_cookie=7a6b658f58058fcc in_seq=0 out_seq=0 2024-04-25T10:00:50.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.157+0000 7f2b7d7fa640 1 -- 172.21.15.7:0/910724545 <== mds.0 v2:172.21.15.7:6836/3829085443 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5650194d9380 con 0x5650195b03c0 2024-04-25T10:00:50.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.157+0000 7f2b7d7fa640 10 client.7824 handle_command_reply: tid=0 2024-04-25T10:00:50.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.157+0000 7f2ba7480740 1 client.7824 shutdown 2024-04-25T10:00:50.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.158+0000 7f2ba7480740 1 -- 172.21.15.7:0/910724545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565019596080 msgr2=0x56501956c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:50.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.158+0000 7f2ba7480740 1 --2- 172.21.15.7:0/910724545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565019596080 0x56501956c8d0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f2b9800b010 tx=0x7f2b98018000 comp rx=0 tx=0).stop 2024-04-25T10:00:50.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.158+0000 7f2ba7480740 1 -- 172.21.15.7:0/910724545 shutdown_connections 2024-04-25T10:00:50.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.158+0000 7f2ba7480740 1 --2- 172.21.15.7:0/910724545 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x5650195b03c0 0x56501961e5b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.158+0000 7f2ba7480740 1 --2- 172.21.15.7:0/910724545 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56501959abe0 0x565019568040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.158+0000 7f2ba7480740 1 --2- 172.21.15.7:0/910724545 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x565019596460 0x565019567b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.158+0000 7f2b7d7fa640 0 client.7824 ms_handle_reset on v2:172.21.15.7:6836/3829085443 2024-04-25T10:00:50.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.158+0000 7f2ba7480740 1 --2- 172.21.15.7:0/910724545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x565019596080 0x56501956c8d0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.158+0000 7f2ba7480740 1 -- 172.21.15.7:0/910724545 >> 172.21.15.7:0/910724545 conn(0x565019568ce0 msgr2=0x5650195ba5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:50.168 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-04-25T10:00:50.158+0000 7f5deacab640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 ap=1 f(v0 m2024-04-25T10:00:40.515339+0000 1=1+0) n(v0 rc2024-04-25T10:00:40.630337+0000 2=1+1) (iversion lock) | dirfrag=0 authpin=1 scrubqueue=0 0x5556ae5f9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-25T10:00:40.515339+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-25T10:00:40.630337+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2024-04-25T10:00:50.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.158+0000 7f2ba7480740 1 -- 172.21.15.7:0/910724545 shutdown_connections 2024-04-25T10:00:50.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.158+0000 7f2ba7480740 1 -- 172.21.15.7:0/910724545 wait complete. 2024-04-25T10:00:50.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.158+0000 7f2ba7480740 20 client.7824 trim_cache size 0 max 16384 2024-04-25T10:00:50.169 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:00:50.169 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-04-25T10:00:50.169 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "b497117f-ed68-477c-b03f-96e34a882e4c", 2024-04-25T10:00:50.169 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-04-25T10:00:50.169 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:00:50.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.158+0000 7f2ba477e640 1 -- 172.21.15.7:0/672773641 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2b8006b4d0 msgr2=0x7f2b8006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:50.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.158+0000 7f2ba477e640 1 --2- 172.21.15.7:0/672773641 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2b8006b4d0 0x7f2b8006d990 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2b980093d0 tx=0x7f2b98009190 comp rx=0 tx=0).stop 2024-04-25T10:00:50.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.158+0000 7f2ba477e640 1 -- 172.21.15.7:0/672773641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b9c0b45b0 msgr2=0x7f2b9c0c95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:50.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.158+0000 7f2ba477e640 1 --2- 172.21.15.7:0/672773641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b9c0b45b0 0x7f2b9c0c95b0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c034040 tx=0x7f2b8c004730 comp rx=0 tx=0).stop 2024-04-25T10:00:50.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.158+0000 7f2ba477e640 1 -- 172.21.15.7:0/672773641 shutdown_connections 2024-04-25T10:00:50.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.158+0000 7f2ba477e640 1 --2- 172.21.15.7:0/672773641 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2b8006b4d0 0x7f2b8006d990 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.158+0000 7f2ba477e640 1 --2- 172.21.15.7:0/672773641 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b9c0b2ce0 0x7f2b9c0b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.158+0000 7f2ba477e640 1 --2- 172.21.15.7:0/672773641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b9c0b45b0 0x7f2b9c0c95b0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.158+0000 7f2ba477e640 1 --2- 172.21.15.7:0/672773641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b88004800 0x7f2b9c1579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.158+0000 7f2ba477e640 1 -- 172.21.15.7:0/672773641 >> 172.21.15.7:0/672773641 conn(0x7f2b9c06c530 msgr2=0x7f2b9c0ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:50.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.158+0000 7f2ba477e640 1 -- 172.21.15.7:0/672773641 shutdown_connections 2024-04-25T10:00:50.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.159+0000 7f2ba477e640 1 -- 172.21.15.7:0/672773641 wait complete. 2024-04-25T10:00:50.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:00:50.174 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T10:00:50.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.272+0000 7fef66afc640 1 Processor -- start 2024-04-25T10:00:50.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.272+0000 7fef66afc640 1 -- start start 2024-04-25T10:00:50.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.273+0000 7fef66afc640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fef6015deb0 0x7fef600b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.273+0000 7fef66afc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fef600ce030 0x7fef600b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.273+0000 7fef66afc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fef600b6f20 0x7fef600d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.273+0000 7fef66afc640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef600d1a40 con 0x7fef6015deb0 2024-04-25T10:00:50.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.273+0000 7fef66afc640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef600d1d20 con 0x7fef600b6f20 2024-04-25T10:00:50.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.273+0000 7fef66afc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef600d2000 con 0x7fef600ce030 2024-04-25T10:00:50.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.273+0000 7fef64898640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fef6015deb0 0x7fef600b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.273+0000 7fef64898640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fef6015deb0 0x7fef600b2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46342/0 (socket says 172.21.15.7:46342) 2024-04-25T10:00:50.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.273+0000 7fef64898640 1 -- 172.21.15.7:0/1035712890 learned_addr learned my addr 172.21.15.7:0/1035712890 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:50.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.273+0000 7fef64898640 1 -- 172.21.15.7:0/1035712890 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fef600ce030 msgr2=0x7fef600b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:50.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.273+0000 7fef64898640 1 --2- 172.21.15.7:0/1035712890 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fef600ce030 0x7fef600b69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.273+0000 7fef64898640 1 -- 172.21.15.7:0/1035712890 >> v2:172.21.15.55:3300/0 conn(0x7fef600b6f20 msgr2=0x7fef600d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:50.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.273+0000 7fef64898640 1 --2- 172.21.15.7:0/1035712890 >> v2:172.21.15.55:3300/0 conn(0x7fef600b6f20 0x7fef600d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.273+0000 7fef64898640 1 -- 172.21.15.7:0/1035712890 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef600d22e0 con 0x7fef6015deb0 2024-04-25T10:00:50.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.274+0000 7fef64898640 1 --2- 172.21.15.7:0/1035712890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef6015deb0 0x7fef600b2c30 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fef600cddb0 tx=0x7fef5402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ecf7a563394122c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:50.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.274+0000 7fef5f7fe640 1 -- 172.21.15.7:0/1035712890 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef54037070 con 0x7fef6015deb0 2024-04-25T10:00:50.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.274+0000 7fef5f7fe640 1 -- 172.21.15.7:0/1035712890 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef54032440 con 0x7fef6015deb0 2024-04-25T10:00:50.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.274+0000 7fef5f7fe640 1 -- 172.21.15.7:0/1035712890 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef54032810 con 0x7fef6015deb0 2024-04-25T10:00:50.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.274+0000 7fef66afc640 1 -- 172.21.15.7:0/1035712890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef6015deb0 msgr2=0x7fef600b2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:50.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.274+0000 7fef66afc640 1 --2- 172.21.15.7:0/1035712890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef6015deb0 0x7fef600b2c30 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fef600cddb0 tx=0x7fef5402a1e0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.275+0000 7fef66afc640 1 -- 172.21.15.7:0/1035712890 shutdown_connections 2024-04-25T10:00:50.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.275+0000 7fef66afc640 1 --2- 172.21.15.7:0/1035712890 >> v2:172.21.15.55:3300/0 conn(0x7fef600b6f20 0x7fef600d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.275+0000 7fef66afc640 1 --2- 172.21.15.7:0/1035712890 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fef600ce030 0x7fef600b69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.275+0000 7fef66afc640 1 --2- 172.21.15.7:0/1035712890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef6015deb0 0x7fef600b2c30 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.275+0000 7fef66afc640 1 -- 172.21.15.7:0/1035712890 >> 172.21.15.7:0/1035712890 conn(0x7fef600726b0 msgr2=0x7fef60072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:50.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.275+0000 7fef66afc640 1 -- 172.21.15.7:0/1035712890 shutdown_connections 2024-04-25T10:00:50.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.275+0000 7fef66afc640 1 -- 172.21.15.7:0/1035712890 wait complete. 2024-04-25T10:00:50.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.276+0000 7fef66afc640 1 Processor -- start 2024-04-25T10:00:50.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.276+0000 7fef66afc640 1 -- start start 2024-04-25T10:00:50.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.277+0000 7fef66afc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef600b6f20 0x7fef601487c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.277+0000 7fef66afc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fef600ce030 0x7fef600ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.277+0000 7fef66afc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef6015deb0 0x7fef601f65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.277+0000 7fef66afc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef600d3ca0 con 0x7fef6015deb0 2024-04-25T10:00:50.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.277+0000 7fef66afc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef600ce490 con 0x7fef600b6f20 2024-04-25T10:00:50.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.277+0000 7fef66afc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef600d3e20 con 0x7fef600ce030 2024-04-25T10:00:50.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.277+0000 7fef65099640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef6015deb0 0x7fef601f65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.277+0000 7fef65099640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef6015deb0 0x7fef601f65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46350/0 (socket says 172.21.15.7:46350) 2024-04-25T10:00:50.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.277+0000 7fef65099640 1 -- 172.21.15.7:0/273009213 learned_addr learned my addr 172.21.15.7:0/273009213 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:50.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.277+0000 7fef5ffff640 1 --2- 172.21.15.7:0/273009213 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fef600ce030 0x7fef600ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.277+0000 7fef65099640 1 -- 172.21.15.7:0/273009213 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fef600ce030 msgr2=0x7fef600ca8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:50.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.277+0000 7fef64898640 1 --2- 172.21.15.7:0/273009213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef600b6f20 0x7fef601487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.277+0000 7fef65099640 1 --2- 172.21.15.7:0/273009213 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fef600ce030 0x7fef600ca8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.277+0000 7fef65099640 1 -- 172.21.15.7:0/273009213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef600b6f20 msgr2=0x7fef601487c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:50.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.277+0000 7fef65099640 1 --2- 172.21.15.7:0/273009213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef600b6f20 0x7fef601487c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.277+0000 7fef65099640 1 -- 172.21.15.7:0/273009213 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6015f240 con 0x7fef6015deb0 2024-04-25T10:00:50.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.277+0000 7fef65099640 1 --2- 172.21.15.7:0/273009213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef6015deb0 0x7fef601f65c0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fef5800ba10 tx=0x7fef5800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:50.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.277+0000 7fef5d7fa640 1 -- 172.21.15.7:0/273009213 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef58019070 con 0x7fef6015deb0 2024-04-25T10:00:50.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.277+0000 7fef5d7fa640 1 -- 172.21.15.7:0/273009213 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5800cb40 con 0x7fef6015deb0 2024-04-25T10:00:50.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.277+0000 7fef66afc640 1 -- 172.21.15.7:0/273009213 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef6015f520 con 0x7fef6015deb0 2024-04-25T10:00:50.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.277+0000 7fef5d7fa640 1 -- 172.21.15.7:0/273009213 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef58014440 con 0x7fef6015deb0 2024-04-25T10:00:50.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.277+0000 7fef66afc640 1 -- 172.21.15.7:0/273009213 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef6015fae0 con 0x7fef6015deb0 2024-04-25T10:00:50.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.279+0000 7fef5d7fa640 1 -- 172.21.15.7:0/273009213 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fef5801c070 con 0x7fef6015deb0 2024-04-25T10:00:50.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.280+0000 7fef5d7fa640 1 --2- 172.21.15.7:0/273009213 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fef4406b4d0 0x7fef4406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.280+0000 7fef64898640 1 --2- 172.21.15.7:0/273009213 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fef4406b4d0 0x7fef4406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.280+0000 7fef5d7fa640 1 -- 172.21.15.7:0/273009213 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fef5808a0d0 con 0x7fef6015deb0 2024-04-25T10:00:50.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.280+0000 7fef64898640 1 --2- 172.21.15.7:0/273009213 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fef4406b4d0 0x7fef4406d990 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fef54034000 tx=0x7fef5402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:50.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.281+0000 7fef697ff740 1 Processor -- start 2024-04-25T10:00:50.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.281+0000 7fef697ff740 1 -- start start 2024-04-25T10:00:50.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.281+0000 7fef697ff740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f3cd66b10 0x563f3cd69320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.281+0000 7fef697ff740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f3cd66ef0 0x563f3cd69860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.281+0000 7fef697ff740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f3cd39770 0x563f3cd3cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.281+0000 7fef697ff740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f3cca2da0 con 0x563f3cd66ef0 2024-04-25T10:00:50.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.281+0000 7fef697ff740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f3cc4bb80 con 0x563f3cd66b10 2024-04-25T10:00:50.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.281+0000 7fef697ff740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f3cc9ee40 con 0x563f3cd39770 2024-04-25T10:00:50.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.282+0000 7fef5ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f3cd66ef0 0x563f3cd69860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.282+0000 7fef5ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f3cd66ef0 0x563f3cd69860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46352/0 (socket says 172.21.15.7:46352) 2024-04-25T10:00:50.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.282+0000 7fef5ffff640 1 -- 172.21.15.7:0/4290186483 learned_addr learned my addr 172.21.15.7:0/4290186483 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:50.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.282+0000 7fef5ffff640 1 -- 172.21.15.7:0/4290186483 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f3cd39770 msgr2=0x563f3cd3cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:50.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.282+0000 7fef5ffff640 1 --2- 172.21.15.7:0/4290186483 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f3cd39770 0x563f3cd3cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.282+0000 7fef5ffff640 1 -- 172.21.15.7:0/4290186483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f3cd66b10 msgr2=0x563f3cd69320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:50.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.282+0000 7fef5ffff640 1 --2- 172.21.15.7:0/4290186483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f3cd66b10 0x563f3cd69320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.282+0000 7fef5ffff640 1 -- 172.21.15.7:0/4290186483 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f3cc55f10 con 0x563f3cd66ef0 2024-04-25T10:00:50.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.282+0000 7fef5ffff640 1 --2- 172.21.15.7:0/4290186483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f3cd66ef0 0x563f3cd69860 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fef4c00a880 tx=0x7fef4c00ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1342eb6c4fd0e846 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:50.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.282+0000 7fef4a7fc640 1 -- 172.21.15.7:0/4290186483 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c015070 con 0x563f3cd66ef0 2024-04-25T10:00:50.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.282+0000 7fef4a7fc640 1 -- 172.21.15.7:0/4290186483 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4c00cae0 con 0x563f3cd66ef0 2024-04-25T10:00:50.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.282+0000 7fef4a7fc640 1 -- 172.21.15.7:0/4290186483 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c0113f0 con 0x563f3cd66ef0 2024-04-25T10:00:50.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.283+0000 7fef697ff740 1 -- 172.21.15.7:0/4290186483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f3cd66ef0 msgr2=0x563f3cd69860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:50.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.283+0000 7fef697ff740 1 --2- 172.21.15.7:0/4290186483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f3cd66ef0 0x563f3cd69860 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fef4c00a880 tx=0x7fef4c00ad40 comp rx=0 tx=0).stop 2024-04-25T10:00:50.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.283+0000 7fef697ff740 1 -- 172.21.15.7:0/4290186483 shutdown_connections 2024-04-25T10:00:50.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.283+0000 7fef697ff740 1 --2- 172.21.15.7:0/4290186483 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f3cd39770 0x563f3cd3cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.283+0000 7fef697ff740 1 --2- 172.21.15.7:0/4290186483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f3cd66ef0 0x563f3cd69860 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.283+0000 7fef697ff740 1 --2- 172.21.15.7:0/4290186483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f3cd66b10 0x563f3cd69320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.283+0000 7fef697ff740 1 -- 172.21.15.7:0/4290186483 >> 172.21.15.7:0/4290186483 conn(0x563f3cd3b9e0 msgr2=0x563f3cd84320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:50.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.283+0000 7fef697ff740 1 -- 172.21.15.7:0/4290186483 shutdown_connections 2024-04-25T10:00:50.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.283+0000 7fef697ff740 1 -- 172.21.15.7:0/4290186483 wait complete. 2024-04-25T10:00:50.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.283+0000 7fef697ff740 1 -- start start 2024-04-25T10:00:50.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.284+0000 7fef697ff740 1 Processor -- start 2024-04-25T10:00:50.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.284+0000 7fef697ff740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f3cd66b10 0x563f3cd63d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.284+0000 7fef697ff740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f3cd66ef0 0x563f3cd64250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.284+0000 7fef697ff740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f3cd97de0 0x563f3cd98240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.284+0000 7fef697ff740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f3cd3eb90 con 0x563f3cd66ef0 2024-04-25T10:00:50.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.284+0000 7fef697ff740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f3cc414b0 con 0x563f3cd97de0 2024-04-25T10:00:50.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.284+0000 7fef697ff740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f3cd3ee70 con 0x563f3cd66b10 2024-04-25T10:00:50.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.285+0000 7fef697ff740 10 client.0 _ll_register_callbacks cb 0x563f3cc81180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:00:50.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.285+0000 7fef5ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f3cd66ef0 0x563f3cd64250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.285+0000 7fef5ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f3cd66ef0 0x563f3cd64250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46358/0 (socket says 172.21.15.7:46358) 2024-04-25T10:00:50.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.285+0000 7fef5ffff640 1 -- 172.21.15.7:0/1067676210 learned_addr learned my addr 172.21.15.7:0/1067676210 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:50.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.285+0000 7fef64898640 1 --2- 172.21.15.7:0/1067676210 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f3cd66b10 0x563f3cd63d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.285+0000 7fef65099640 1 --2- 172.21.15.7:0/1067676210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f3cd97de0 0x563f3cd98240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.285+0000 7fef5ffff640 1 -- 172.21.15.7:0/1067676210 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f3cd66b10 msgr2=0x563f3cd63d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:50.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.285+0000 7fef5ffff640 1 --2- 172.21.15.7:0/1067676210 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f3cd66b10 0x563f3cd63d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.285+0000 7fef5ffff640 1 -- 172.21.15.7:0/1067676210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f3cd97de0 msgr2=0x563f3cd98240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:50.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.285+0000 7fef5ffff640 1 --2- 172.21.15.7:0/1067676210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f3cd97de0 0x563f3cd98240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.285+0000 7fef5ffff640 1 -- 172.21.15.7:0/1067676210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563f3ca817d0 con 0x563f3cd66ef0 2024-04-25T10:00:50.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.285+0000 7fef65099640 1 --2- 172.21.15.7:0/1067676210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f3cd97de0 0x563f3cd98240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:00:50.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.285+0000 7fef5ffff640 1 --2- 172.21.15.7:0/1067676210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f3cd66ef0 0x563f3cd64250 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fef4c006c00 tx=0x7fef4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd886aaf180a7b6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:50.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.285+0000 7fef3f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:00:50.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.285+0000 7fef3f7fe640 1 -- 172.21.15.7:0/1067676210 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c02a060 con 0x563f3cd66ef0 2024-04-25T10:00:50.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.285+0000 7fef3f7fe640 1 -- 172.21.15.7:0/1067676210 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fef4c01a450 con 0x563f3cd66ef0 2024-04-25T10:00:50.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.285+0000 7fef697ff740 1 -- 172.21.15.7:0/1067676210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fef4c00cae0 con 0x563f3cd66ef0 2024-04-25T10:00:50.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.285+0000 7fef3f7fe640 1 -- 172.21.15.7:0/1067676210 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef4c030050 con 0x563f3cd66ef0 2024-04-25T10:00:50.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.285+0000 7fef697ff740 10 client.7836 fetch_fsmap learned FSMap version 59 2024-04-25T10:00:50.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.285+0000 7fef697ff740 1 -- 172.21.15.7:0/1067676210 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x563f3c9b73f0 con 0x563f3cd66ef0 2024-04-25T10:00:50.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.286+0000 7fef3f7fe640 1 -- 172.21.15.7:0/1067676210 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4c00cae0 con 0x563f3cd66ef0 2024-04-25T10:00:50.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.286+0000 7fef3f7fe640 1 -- 172.21.15.7:0/1067676210 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 59) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fef4c033020 con 0x563f3cd66ef0 2024-04-25T10:00:50.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.286+0000 7fef697ff740 10 client.7836 fetch_fsmap finished waiting for FSMap version 59 2024-04-25T10:00:50.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.286+0000 7fef697ff740 10 client.7836 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T10:00:50.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.286+0000 7fef697ff740 20 client.7836 populate_metadata read hostname 'smithi007' 2024-04-25T10:00:50.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.286+0000 7fef697ff740 1 --2- 172.21.15.7:0/1067676210 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x563f3cd7ffa0 0x563f3cda1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.286+0000 7fef697ff740 4 client.7836 mds_command: new command op to 7734 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:00:50.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.286+0000 7fef697ff740 1 -- 172.21.15.7:0/1067676210 --> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563f3ccb02e0 con 0x563f3cd7ffa0 2024-04-25T10:00:50.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.286+0000 7fef64898640 1 --2- 172.21.15.7:0/1067676210 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x563f3cd7ffa0 0x563f3cda1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.286+0000 7fef3f7fe640 10 client.7836 ms_handle_connect on v2:172.21.15.7:6836/3829085443 2024-04-25T10:00:50.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.286+0000 7fef64898640 1 --2- 172.21.15.7:0/1067676210 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x563f3cd7ffa0 0x563f3cda1e30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c29a5c893e3cd3 server_cookie=e52567c460ed07d6 in_seq=0 out_seq=0 2024-04-25T10:00:50.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.287+0000 7fef3f7fe640 1 -- 172.21.15.7:0/1067676210 <== mds.0 v2:172.21.15.7:6836/3829085443 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563f3ccb02e0 con 0x563f3cd7ffa0 2024-04-25T10:00:50.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.287+0000 7fef3f7fe640 10 client.7836 handle_command_reply: tid=0 2024-04-25T10:00:50.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.287+0000 7fef697ff740 1 client.7836 shutdown 2024-04-25T10:00:50.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.287+0000 7fef697ff740 1 -- 172.21.15.7:0/1067676210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f3cd66ef0 msgr2=0x563f3cd64250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:50.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.287+0000 7fef697ff740 1 --2- 172.21.15.7:0/1067676210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f3cd66ef0 0x563f3cd64250 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fef4c006c00 tx=0x7fef4c0046c0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.287+0000 7fef697ff740 1 -- 172.21.15.7:0/1067676210 shutdown_connections 2024-04-25T10:00:50.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.287+0000 7fef697ff740 1 --2- 172.21.15.7:0/1067676210 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x563f3cd7ffa0 0x563f3cda1e30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.287+0000 7fef697ff740 1 --2- 172.21.15.7:0/1067676210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f3cd97de0 0x563f3cd98240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.287+0000 7fef3f7fe640 0 client.7836 ms_handle_reset on v2:172.21.15.7:6836/3829085443 2024-04-25T10:00:50.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.287+0000 7fef697ff740 1 --2- 172.21.15.7:0/1067676210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f3cd66ef0 0x563f3cd64250 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.287+0000 7fef697ff740 1 --2- 172.21.15.7:0/1067676210 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f3cd66b10 0x563f3cd63d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.287+0000 7fef697ff740 1 -- 172.21.15.7:0/1067676210 >> 172.21.15.7:0/1067676210 conn(0x563f3cd39770 msgr2=0x563f3cd65da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:50.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.287+0000 7fef697ff740 1 -- 172.21.15.7:0/1067676210 shutdown_connections 2024-04-25T10:00:50.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.287+0000 7fef697ff740 1 -- 172.21.15.7:0/1067676210 wait complete. 2024-04-25T10:00:50.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.287+0000 7fef697ff740 20 client.7836 trim_cache size 0 max 16384 2024-04-25T10:00:50.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.302+0000 7fef697ff740 1 Processor -- start 2024-04-25T10:00:50.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.302+0000 7fef697ff740 1 -- start start 2024-04-25T10:00:50.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.303+0000 7fef697ff740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f3cd66b10 0x563f3cd6d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.303+0000 7fef697ff740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f3cd66ef0 0x563f3cd387f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.303+0000 7fef697ff740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f3cd97de0 0x563f3cd96f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.303+0000 7fef697ff740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef602004e0 con 0x563f3cd97de0 2024-04-25T10:00:50.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.303+0000 7fef697ff740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef601ff6e0 con 0x563f3cd66b10 2024-04-25T10:00:50.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.303+0000 7fef697ff740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef600b42a0 con 0x563f3cd66ef0 2024-04-25T10:00:50.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.303+0000 7fef65099640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f3cd97de0 0x563f3cd96f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.303+0000 7fef65099640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f3cd97de0 0x563f3cd96f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46360/0 (socket says 172.21.15.7:46360) 2024-04-25T10:00:50.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.303+0000 7fef65099640 1 -- 172.21.15.7:0/1839478794 learned_addr learned my addr 172.21.15.7:0/1839478794 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:50.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.303+0000 7fef65099640 1 -- 172.21.15.7:0/1839478794 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f3cd66ef0 msgr2=0x563f3cd387f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:50.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.303+0000 7fef5ffff640 1 --2- 172.21.15.7:0/1839478794 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f3cd66ef0 0x563f3cd387f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.304+0000 7fef65099640 1 --2- 172.21.15.7:0/1839478794 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f3cd66ef0 0x563f3cd387f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.304+0000 7fef65099640 1 -- 172.21.15.7:0/1839478794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f3cd66b10 msgr2=0x563f3cd6d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:50.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.304+0000 7fef64898640 1 --2- 172.21.15.7:0/1839478794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f3cd66b10 0x563f3cd6d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.304+0000 7fef65099640 1 --2- 172.21.15.7:0/1839478794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f3cd66b10 0x563f3cd6d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.304+0000 7fef65099640 1 -- 172.21.15.7:0/1839478794 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f3c9770f0 con 0x563f3cd97de0 2024-04-25T10:00:50.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.304+0000 7fef5ffff640 1 --2- 172.21.15.7:0/1839478794 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f3cd66ef0 0x563f3cd387f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:00:50.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.304+0000 7fef64898640 1 --2- 172.21.15.7:0/1839478794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f3cd66b10 0x563f3cd6d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:00:50.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.304+0000 7fef65099640 1 --2- 172.21.15.7:0/1839478794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f3cd97de0 0x563f3cd96f50 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fef5800cfd0 tx=0x7fef5808a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=babc1eb53e1a8db3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:50.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.304+0000 7fef49ffb640 1 -- 172.21.15.7:0/1839478794 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef580701c0 con 0x563f3cd97de0 2024-04-25T10:00:50.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.304+0000 7fef49ffb640 1 -- 172.21.15.7:0/1839478794 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef58056970 con 0x563f3cd97de0 2024-04-25T10:00:50.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.304+0000 7fef49ffb640 1 -- 172.21.15.7:0/1839478794 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef580608f0 con 0x563f3cd97de0 2024-04-25T10:00:50.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.304+0000 7fef697ff740 1 -- 172.21.15.7:0/1839478794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f3cd97de0 msgr2=0x563f3cd96f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:50.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.304+0000 7fef697ff740 1 --2- 172.21.15.7:0/1839478794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f3cd97de0 0x563f3cd96f50 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fef5800cfd0 tx=0x7fef5808a040 comp rx=0 tx=0).stop 2024-04-25T10:00:50.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.304+0000 7fef697ff740 1 -- 172.21.15.7:0/1839478794 shutdown_connections 2024-04-25T10:00:50.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.304+0000 7fef697ff740 1 --2- 172.21.15.7:0/1839478794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f3cd97de0 0x563f3cd96f50 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.304+0000 7fef697ff740 1 --2- 172.21.15.7:0/1839478794 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f3cd66ef0 0x563f3cd387f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.304+0000 7fef697ff740 1 --2- 172.21.15.7:0/1839478794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f3cd66b10 0x563f3cd6d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.304+0000 7fef697ff740 1 -- 172.21.15.7:0/1839478794 >> 172.21.15.7:0/1839478794 conn(0x563f3cd39770 msgr2=0x563f3cd840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:50.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.305+0000 7fef697ff740 1 -- 172.21.15.7:0/1839478794 shutdown_connections 2024-04-25T10:00:50.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.305+0000 7fef697ff740 1 -- 172.21.15.7:0/1839478794 wait complete. 2024-04-25T10:00:50.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.305+0000 7fef697ff740 1 -- start start 2024-04-25T10:00:50.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.305+0000 7fef697ff740 1 Processor -- start 2024-04-25T10:00:50.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.306+0000 7fef697ff740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f3cd66b10 0x563f3cd69850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.306+0000 7fef697ff740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f3cd66ef0 0x563f3cdeddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.306+0000 7fef697ff740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f3cd97de0 0x563f3cd63ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.306+0000 7fef697ff740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef600b48a0 con 0x563f3cd66b10 2024-04-25T10:00:50.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.306+0000 7fef697ff740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f3cd63010 con 0x563f3cd66ef0 2024-04-25T10:00:50.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.306+0000 7fef697ff740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f3cd3e490 con 0x563f3cd97de0 2024-04-25T10:00:50.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.306+0000 7fef697ff740 10 client.0 _ll_register_callbacks cb 0x7fef4c00a0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:00:50.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.306+0000 7fef64898640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f3cd66b10 0x563f3cd69850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.306+0000 7fef64898640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f3cd66b10 0x563f3cd69850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46370/0 (socket says 172.21.15.7:46370) 2024-04-25T10:00:50.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.306+0000 7fef64898640 1 -- 172.21.15.7:0/2647475070 learned_addr learned my addr 172.21.15.7:0/2647475070 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:00:50.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.306+0000 7fef5ffff640 1 --2- 172.21.15.7:0/2647475070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f3cd66ef0 0x563f3cdeddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.306+0000 7fef65099640 1 --2- 172.21.15.7:0/2647475070 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f3cd97de0 0x563f3cd63ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.306+0000 7fef64898640 1 -- 172.21.15.7:0/2647475070 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f3cd97de0 msgr2=0x563f3cd63ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:50.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.306+0000 7fef64898640 1 --2- 172.21.15.7:0/2647475070 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f3cd97de0 0x563f3cd63ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.306+0000 7fef64898640 1 -- 172.21.15.7:0/2647475070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f3cd66ef0 msgr2=0x563f3cdeddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:00:50.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.306+0000 7fef64898640 1 --2- 172.21.15.7:0/2647475070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f3cd66ef0 0x563f3cdeddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.306+0000 7fef64898640 1 -- 172.21.15.7:0/2647475070 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563f3cd40600 con 0x563f3cd66b10 2024-04-25T10:00:50.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.307+0000 7fef64898640 1 --2- 172.21.15.7:0/2647475070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f3cd66b10 0x563f3cd69850 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fef54035040 tx=0x7fef54004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b24b91703559953 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:00:50.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.307+0000 7fef3f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:00:50.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.307+0000 7fef3f7fe640 1 -- 172.21.15.7:0/2647475070 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef54037040 con 0x563f3cd66b10 2024-04-25T10:00:50.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.307+0000 7fef3f7fe640 1 -- 172.21.15.7:0/2647475070 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fef5404d390 con 0x563f3cd66b10 2024-04-25T10:00:50.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.307+0000 7fef697ff740 1 -- 172.21.15.7:0/2647475070 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fef58056970 con 0x563f3cd66b10 2024-04-25T10:00:50.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.307+0000 7fef3f7fe640 1 -- 172.21.15.7:0/2647475070 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef5405c050 con 0x563f3cd66b10 2024-04-25T10:00:50.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.307+0000 7fef697ff740 10 client.7842 fetch_fsmap learned FSMap version 59 2024-04-25T10:00:50.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.307+0000 7fef697ff740 1 -- 172.21.15.7:0/2647475070 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x563f3cdee310 con 0x563f3cd66b10 2024-04-25T10:00:50.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.307+0000 7fef3f7fe640 1 -- 172.21.15.7:0/2647475070 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef58056970 con 0x563f3cd66b10 2024-04-25T10:00:50.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.307+0000 7fef3f7fe640 1 -- 172.21.15.7:0/2647475070 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 59) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fef5405f020 con 0x563f3cd66b10 2024-04-25T10:00:50.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.307+0000 7fef697ff740 10 client.7842 fetch_fsmap finished waiting for FSMap version 59 2024-04-25T10:00:50.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.307+0000 7fef697ff740 10 client.7842 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T10:00:50.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.307+0000 7fef697ff740 20 client.7842 populate_metadata read hostname 'smithi007' 2024-04-25T10:00:50.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.307+0000 7fef697ff740 1 --2- 172.21.15.7:0/2647475070 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x563f3cd640e0 0x563f3cd6ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:00:50.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.307+0000 7fef697ff740 4 client.7842 mds_command: new command op to 7734 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T10:00:50.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.307+0000 7fef697ff740 1 -- 172.21.15.7:0/2647475070 --> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563f3ccaa630 con 0x563f3cd640e0 2024-04-25T10:00:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.307+0000 7fef5ffff640 1 --2- 172.21.15.7:0/2647475070 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x563f3cd640e0 0x563f3cd6ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:00:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.308+0000 7fef3f7fe640 10 client.7842 ms_handle_connect on v2:172.21.15.7:6836/3829085443 2024-04-25T10:00:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.308+0000 7fef5ffff640 1 --2- 172.21.15.7:0/2647475070 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x563f3cd640e0 0x563f3cd6ca30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b458549d54fbfcb server_cookie=cc9fba8862a32757 in_seq=0 out_seq=0 2024-04-25T10:00:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.308+0000 7fef3f7fe640 1 -- 172.21.15.7:0/2647475070 <== mds.0 v2:172.21.15.7:6836/3829085443 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+256 (crc 0 0 0) 0x563f3ccaa630 con 0x563f3cd640e0 2024-04-25T10:00:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.308+0000 7fef3f7fe640 10 client.7842 handle_command_reply: tid=0 2024-04-25T10:00:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.308+0000 7fef697ff740 1 client.7842 shutdown 2024-04-25T10:00:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.308+0000 7fef697ff740 1 -- 172.21.15.7:0/2647475070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f3cd66b10 msgr2=0x563f3cd69850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.308+0000 7fef697ff740 1 --2- 172.21.15.7:0/2647475070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f3cd66b10 0x563f3cd69850 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fef54035040 tx=0x7fef54004730 comp rx=0 tx=0).stop 2024-04-25T10:00:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.308+0000 7fef697ff740 1 -- 172.21.15.7:0/2647475070 shutdown_connections 2024-04-25T10:00:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.308+0000 7fef697ff740 1 --2- 172.21.15.7:0/2647475070 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x563f3cd640e0 0x563f3cd6ca30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.308+0000 7fef697ff740 1 --2- 172.21.15.7:0/2647475070 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563f3cd97de0 0x563f3cd63ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.308+0000 7fef697ff740 1 --2- 172.21.15.7:0/2647475070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563f3cd66ef0 0x563f3cdeddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.308+0000 7fef697ff740 1 --2- 172.21.15.7:0/2647475070 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563f3cd66b10 0x563f3cd69850 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.308+0000 7fef3f7fe640 0 client.7842 ms_handle_reset on v2:172.21.15.7:6836/3829085443 2024-04-25T10:00:50.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.308+0000 7fef697ff740 1 -- 172.21.15.7:0/2647475070 >> 172.21.15.7:0/2647475070 conn(0x563f3cd39770 msgr2=0x563f3cd96dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:50.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.308+0000 7fef697ff740 1 -- 172.21.15.7:0/2647475070 shutdown_connections 2024-04-25T10:00:50.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.308+0000 7fef697ff740 1 -- 172.21.15.7:0/2647475070 wait complete. 2024-04-25T10:00:50.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.308+0000 7fef697ff740 20 client.7842 trim_cache size 0 max 16384 2024-04-25T10:00:50.319 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:00:50.319 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T10:00:50.319 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-04-25T10:00:50.319 INFO:teuthology.orchestra.run.smithi007.stdout: "b497117f-ed68-477c-b03f-96e34a882e4c": { 2024-04-25T10:00:50.319 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/dir", 2024-04-25T10:00:50.320 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "b497117f-ed68-477c-b03f-96e34a882e4c", 2024-04-25T10:00:50.320 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive" 2024-04-25T10:00:50.320 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:00:50.320 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:00:50.320 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:00:50.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.309+0000 7fef66afc640 1 -- 172.21.15.7:0/273009213 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fef4406b4d0 msgr2=0x7fef4406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:50.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.309+0000 7fef66afc640 1 --2- 172.21.15.7:0/273009213 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fef4406b4d0 0x7fef4406d990 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fef54034000 tx=0x7fef5402e000 comp rx=0 tx=0).stop 2024-04-25T10:00:50.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.309+0000 7fef66afc640 1 -- 172.21.15.7:0/273009213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef6015deb0 msgr2=0x7fef601f65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:00:50.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.309+0000 7fef66afc640 1 --2- 172.21.15.7:0/273009213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef6015deb0 0x7fef601f65c0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fef5800ba10 tx=0x7fef5800bed0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.309+0000 7fef66afc640 1 -- 172.21.15.7:0/273009213 shutdown_connections 2024-04-25T10:00:50.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.309+0000 7fef66afc640 1 --2- 172.21.15.7:0/273009213 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fef4406b4d0 0x7fef4406d990 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.309+0000 7fef66afc640 1 --2- 172.21.15.7:0/273009213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fef6015deb0 0x7fef601f65c0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.309+0000 7fef66afc640 1 --2- 172.21.15.7:0/273009213 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fef600ce030 0x7fef600ca8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.309+0000 7fef66afc640 1 --2- 172.21.15.7:0/273009213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef600b6f20 0x7fef601487c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:00:50.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.309+0000 7fef66afc640 1 -- 172.21.15.7:0/273009213 >> 172.21.15.7:0/273009213 conn(0x7fef600726b0 msgr2=0x7fef60072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:00:50.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.309+0000 7fef66afc640 1 -- 172.21.15.7:0/273009213 shutdown_connections 2024-04-25T10:00:50.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:00:50.309+0000 7fef66afc640 1 -- 172.21.15.7:0/273009213 wait complete. 2024-04-25T10:00:50.324 INFO:tasks.cephfs.filesystem:scrub status for tag:b497117f-ed68-477c-b03f-96e34a882e4c - {'path': '/dir', 'tag': 'b497117f-ed68-477c-b03f-96e34a882e4c', 'options': 'recursive'} 2024-04-25T10:00:54.422 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-04-25T10:00:54.418+0000 7f45afd77640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T10:00:56.933 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:00:56.937 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:01:20.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:01:20.326 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T10:01:20.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.441+0000 7f0ab4a9e640 1 Processor -- start 2024-04-25T10:01:20.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.441+0000 7f0ab4a9e640 1 -- start start 2024-04-25T10:01:20.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.442+0000 7f0ab4a9e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0ab0071840 0x7f0ab0166370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.442+0000 7f0ab4a9e640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ab01453c0 con 0x7f0ab0144fe0 2024-04-25T10:01:20.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.442+0000 7f0ab4a9e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ab006d6a0 con 0x7f0ab006d130 2024-04-25T10:01:20.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.442+0000 7f0ab4a9e640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab00a8560 con 0x7f0ab0071840 2024-04-25T10:01:20.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.442+0000 7f0aaed9d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0ab0071840 0x7f0ab0166370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.442+0000 7f0aae59c640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0ab0144fe0 0x7f0ab006e560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55168/0 (socket says 172.21.15.7:55168) 2024-04-25T10:01:20.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.442+0000 7f0aae59c640 1 -- 172.21.15.7:0/2031942196 learned_addr learned my addr 172.21.15.7:0/2031942196 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:01:20.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.442+0000 7f0aaed9d640 1 -- 172.21.15.7:0/2031942196 >> v1:172.21.15.55:6789/0 conn(0x7f0ab006d130 legacy=0x7f0ab0071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:20.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.442+0000 7f0aaed9d640 1 -- 172.21.15.7:0/2031942196 >> v1:172.21.15.7:6789/0 conn(0x7f0ab0144fe0 legacy=0x7f0ab006e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:20.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.442+0000 7f0aaed9d640 1 -- 172.21.15.7:0/2031942196 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab006d980 con 0x7f0ab0071840 2024-04-25T10:01:20.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.442+0000 7f0aadd9b640 1 -- 172.21.15.7:0/2031942196 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3599472544 0 0) 0x7f0ab01453c0 con 0x7f0ab0144fe0 2024-04-25T10:01:20.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.443+0000 7f0aaed9d640 1 --2- 172.21.15.7:0/2031942196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ab0071840 0x7f0ab0166370 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8009d90 tx=0x7f0aa802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2360fa10d9ff61db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:20.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.443+0000 7f0aadd9b640 1 -- 172.21.15.7:0/2031942196 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8007740 con 0x7f0ab0071840 2024-04-25T10:01:20.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.443+0000 7f0aadd9b640 1 -- 172.21.15.7:0/2031942196 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa80078e0 con 0x7f0ab0071840 2024-04-25T10:01:20.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.443+0000 7f0aadd9b640 1 -- 172.21.15.7:0/2031942196 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8007cb0 con 0x7f0ab0071840 2024-04-25T10:01:20.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.443+0000 7f0ab4a9e640 1 -- 172.21.15.7:0/2031942196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ab0071840 msgr2=0x7f0ab0166370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.443+0000 7f0ab4a9e640 1 --2- 172.21.15.7:0/2031942196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ab0071840 0x7f0ab0166370 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8009d90 tx=0x7f0aa802a6f0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.444+0000 7f0ab4a9e640 1 -- 172.21.15.7:0/2031942196 shutdown_connections 2024-04-25T10:01:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.444+0000 7f0ab4a9e640 1 --2- 172.21.15.7:0/2031942196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ab0071840 0x7f0ab0166370 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.444+0000 7f0ab4a9e640 1 -- 172.21.15.7:0/2031942196 >> 172.21.15.7:0/2031942196 conn(0x7f0ab006ab60 msgr2=0x7f0ab006af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.444+0000 7f0ab4a9e640 1 -- 172.21.15.7:0/2031942196 shutdown_connections 2024-04-25T10:01:20.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.444+0000 7f0ab4a9e640 1 -- 172.21.15.7:0/2031942196 wait complete. 2024-04-25T10:01:20.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.445+0000 7f0ab4a9e640 1 Processor -- start 2024-04-25T10:01:20.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.445+0000 7f0ab4a9e640 1 -- start start 2024-04-25T10:01:20.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.446+0000 7f0ab4a9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ab006d130 0x7f0ab013e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.446+0000 7f0ab4a9e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ab0071840 0x7f0ab015a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.446+0000 7f0ab4a9e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ab0144fe0 0x7f0ab013b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.446+0000 7f0ab4a9e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab015be50 con 0x7f0ab0144fe0 2024-04-25T10:01:20.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.446+0000 7f0ab4a9e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab006df40 con 0x7f0ab006d130 2024-04-25T10:01:20.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.446+0000 7f0ab4a9e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab015d380 con 0x7f0ab0071840 2024-04-25T10:01:20.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.446+0000 7f0aaed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ab0144fe0 0x7f0ab013b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.446+0000 7f0aaed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ab0144fe0 0x7f0ab013b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38364/0 (socket says 172.21.15.7:38364) 2024-04-25T10:01:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.446+0000 7f0aaed9d640 1 -- 172.21.15.7:0/3008680648 learned_addr learned my addr 172.21.15.7:0/3008680648 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.446+0000 7f0aae59c640 1 --2- 172.21.15.7:0/3008680648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ab006d130 0x7f0ab013e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.446+0000 7f0aa7fff640 1 --2- 172.21.15.7:0/3008680648 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ab0071840 0x7f0ab015a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.446+0000 7f0aaed9d640 1 -- 172.21.15.7:0/3008680648 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ab0071840 msgr2=0x7f0ab015a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.446+0000 7f0aaed9d640 1 --2- 172.21.15.7:0/3008680648 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ab0071840 0x7f0ab015a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.446+0000 7f0aaed9d640 1 -- 172.21.15.7:0/3008680648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ab006d130 msgr2=0x7f0ab013e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.446+0000 7f0aaed9d640 1 --2- 172.21.15.7:0/3008680648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ab006d130 0x7f0ab013e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.446+0000 7f0aaed9d640 1 -- 172.21.15.7:0/3008680648 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab013fd50 con 0x7f0ab0144fe0 2024-04-25T10:01:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.446+0000 7f0aaed9d640 1 --2- 172.21.15.7:0/3008680648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ab0144fe0 0x7f0ab013b830 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8009d90 tx=0x7f0aa8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.447+0000 7f0aa6ffd640 1 -- 172.21.15.7:0/3008680648 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8040070 con 0x7f0ab0144fe0 2024-04-25T10:01:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.447+0000 7f0aa6ffd640 1 -- 172.21.15.7:0/3008680648 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa8031c40 con 0x7f0ab0144fe0 2024-04-25T10:01:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.447+0000 7f0aa6ffd640 1 -- 172.21.15.7:0/3008680648 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8003990 con 0x7f0ab0144fe0 2024-04-25T10:01:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.447+0000 7f0ab4a9e640 1 -- 172.21.15.7:0/3008680648 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab013d820 con 0x7f0ab0144fe0 2024-04-25T10:01:20.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.447+0000 7f0ab4a9e640 1 -- 172.21.15.7:0/3008680648 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab013dde0 con 0x7f0ab0144fe0 2024-04-25T10:01:20.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.448+0000 7f0aa6ffd640 1 -- 172.21.15.7:0/3008680648 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0aa8039040 con 0x7f0ab0144fe0 2024-04-25T10:01:20.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.448+0000 7f0aa6ffd640 1 --2- 172.21.15.7:0/3008680648 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0a9006b4d0 0x7f0a9006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.449+0000 7f0aa6ffd640 1 -- 172.21.15.7:0/3008680648 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f0aa80ab7d0 con 0x7f0ab0144fe0 2024-04-25T10:01:20.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.449+0000 7f0aae59c640 1 --2- 172.21.15.7:0/3008680648 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0a9006b4d0 0x7f0a9006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.449+0000 7f0aae59c640 1 --2- 172.21.15.7:0/3008680648 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0a9006b4d0 0x7f0a9006d990 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0000f60 tx=0x7f0aa0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:20.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.450+0000 7f0ab77a2740 1 Processor -- start 2024-04-25T10:01:20.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.450+0000 7f0ab77a2740 1 -- start start 2024-04-25T10:01:20.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.450+0000 7f0ab77a2740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b17996b10 0x562b17999320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.450+0000 7f0ab77a2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b17996ef0 0x562b17999860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.450+0000 7f0ab77a2740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562b17969770 0x562b1796cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.450+0000 7f0ab77a2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b178d2da0 con 0x562b17996ef0 2024-04-25T10:01:20.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.450+0000 7f0ab77a2740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b1787bb80 con 0x562b17996b10 2024-04-25T10:01:20.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.450+0000 7f0ab77a2740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b178cee40 con 0x562b17969770 2024-04-25T10:01:20.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.451+0000 7f0aa7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b17996ef0 0x562b17999860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.451+0000 7f0aa7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b17996ef0 0x562b17999860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38378/0 (socket says 172.21.15.7:38378) 2024-04-25T10:01:20.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.451+0000 7f0aa7fff640 1 -- 172.21.15.7:0/1642329298 learned_addr learned my addr 172.21.15.7:0/1642329298 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:20.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.451+0000 7f0aaed9d640 1 --2- 172.21.15.7:0/1642329298 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562b17969770 0x562b1796cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.451+0000 7f0aae59c640 1 --2- 172.21.15.7:0/1642329298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b17996b10 0x562b17999320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.451+0000 7f0aa7fff640 1 -- 172.21.15.7:0/1642329298 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562b17969770 msgr2=0x562b1796cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:20.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.451+0000 7f0aa7fff640 1 --2- 172.21.15.7:0/1642329298 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562b17969770 0x562b1796cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.451+0000 7f0aa7fff640 1 -- 172.21.15.7:0/1642329298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b17996b10 msgr2=0x562b17999320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:20.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.451+0000 7f0aa7fff640 1 --2- 172.21.15.7:0/1642329298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b17996b10 0x562b17999320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.451+0000 7f0aa7fff640 1 -- 172.21.15.7:0/1642329298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b17885f10 con 0x562b17996ef0 2024-04-25T10:01:20.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.451+0000 7f0aaed9d640 1 --2- 172.21.15.7:0/1642329298 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562b17969770 0x562b1796cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:01:20.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.451+0000 7f0aa7fff640 1 --2- 172.21.15.7:0/1642329298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b17996ef0 0x562b17999860 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f0a980015c0 tx=0x7f0a98001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e8a862c36d68df server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:20.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.451+0000 7f0a8ffff640 1 -- 172.21.15.7:0/1642329298 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a98019070 con 0x562b17996ef0 2024-04-25T10:01:20.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.451+0000 7f0a8ffff640 1 -- 172.21.15.7:0/1642329298 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a980050d0 con 0x562b17996ef0 2024-04-25T10:01:20.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.451+0000 7f0a8ffff640 1 -- 172.21.15.7:0/1642329298 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a980054a0 con 0x562b17996ef0 2024-04-25T10:01:20.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.452+0000 7f0ab77a2740 1 -- 172.21.15.7:0/1642329298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b17996ef0 msgr2=0x562b17999860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:20.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.452+0000 7f0ab77a2740 1 --2- 172.21.15.7:0/1642329298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b17996ef0 0x562b17999860 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f0a980015c0 tx=0x7f0a98001a80 comp rx=0 tx=0).stop 2024-04-25T10:01:20.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.452+0000 7f0ab77a2740 1 -- 172.21.15.7:0/1642329298 shutdown_connections 2024-04-25T10:01:20.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.452+0000 7f0ab77a2740 1 --2- 172.21.15.7:0/1642329298 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562b17969770 0x562b1796cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.452+0000 7f0ab77a2740 1 --2- 172.21.15.7:0/1642329298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b17996ef0 0x562b17999860 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.452+0000 7f0ab77a2740 1 --2- 172.21.15.7:0/1642329298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b17996b10 0x562b17999320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.452+0000 7f0ab77a2740 1 -- 172.21.15.7:0/1642329298 >> 172.21.15.7:0/1642329298 conn(0x562b1796b9e0 msgr2=0x562b179b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:20.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.452+0000 7f0ab77a2740 1 -- 172.21.15.7:0/1642329298 shutdown_connections 2024-04-25T10:01:20.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.452+0000 7f0ab77a2740 1 -- 172.21.15.7:0/1642329298 wait complete. 2024-04-25T10:01:20.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.453+0000 7f0ab77a2740 1 -- start start 2024-04-25T10:01:20.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.453+0000 7f0ab77a2740 1 Processor -- start 2024-04-25T10:01:20.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.454+0000 7f0ab77a2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b17996b10 0x562b17986b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.454+0000 7f0ab77a2740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b17996ef0 0x562b179ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.454+0000 7f0ab77a2740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562b179b6eb0 0x562b179ab7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.454+0000 7f0ab77a2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b1796eb90 con 0x562b17996b10 2024-04-25T10:01:20.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.454+0000 7f0ab77a2740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b178714b0 con 0x562b17996ef0 2024-04-25T10:01:20.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.454+0000 7f0ab77a2740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b1796ee70 con 0x562b179b6eb0 2024-04-25T10:01:20.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.454+0000 7f0aae59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b17996b10 0x562b17986b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.454+0000 7f0ab77a2740 10 client.0 _ll_register_callbacks cb 0x562b178b1180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:01:20.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.454+0000 7f0aae59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b17996b10 0x562b17986b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38388/0 (socket says 172.21.15.7:38388) 2024-04-25T10:01:20.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.454+0000 7f0aae59c640 1 -- 172.21.15.7:0/1753521709 learned_addr learned my addr 172.21.15.7:0/1753521709 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:20.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.454+0000 7f0aaed9d640 1 --2- 172.21.15.7:0/1753521709 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562b179b6eb0 0x562b179ab7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.454+0000 7f0aa7fff640 1 --2- 172.21.15.7:0/1753521709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b17996ef0 0x562b179ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.454+0000 7f0aae59c640 1 -- 172.21.15.7:0/1753521709 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562b179b6eb0 msgr2=0x562b179ab7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:20.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.454+0000 7f0aae59c640 1 --2- 172.21.15.7:0/1753521709 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562b179b6eb0 0x562b179ab7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.454+0000 7f0aae59c640 1 -- 172.21.15.7:0/1753521709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b17996ef0 msgr2=0x562b179ab2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:20.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.454+0000 7f0aae59c640 1 --2- 172.21.15.7:0/1753521709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b17996ef0 0x562b179ab2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.454+0000 7f0aae59c640 1 -- 172.21.15.7:0/1753521709 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562b176b17d0 con 0x562b17996b10 2024-04-25T10:01:20.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.454+0000 7f0aae59c640 1 --2- 172.21.15.7:0/1753521709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b17996b10 0x562b17986b90 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0005e30 tx=0x7f0aa0007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f138577b91c940 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:20.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.454+0000 7f0a8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:01:20.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.455+0000 7f0a8d7fa640 1 -- 172.21.15.7:0/1753521709 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa0005e60 con 0x562b17996b10 2024-04-25T10:01:20.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.455+0000 7f0a8d7fa640 1 -- 172.21.15.7:0/1753521709 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f0aa0007560 con 0x562b17996b10 2024-04-25T10:01:20.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.455+0000 7f0ab77a2740 1 -- 172.21.15.7:0/1753521709 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0a980050d0 con 0x562b17996b10 2024-04-25T10:01:20.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.455+0000 7f0a8d7fa640 1 -- 172.21.15.7:0/1753521709 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0aa0022430 con 0x562b17996b10 2024-04-25T10:01:20.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.455+0000 7f0ab77a2740 10 client.7857 fetch_fsmap learned FSMap version 60 2024-04-25T10:01:20.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.455+0000 7f0ab77a2740 1 -- 172.21.15.7:0/1753521709 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x562b175e73f0 con 0x562b17996b10 2024-04-25T10:01:20.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.455+0000 7f0a8d7fa640 1 -- 172.21.15.7:0/1753521709 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a980050d0 con 0x562b17996b10 2024-04-25T10:01:20.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.455+0000 7f0a8d7fa640 1 -- 172.21.15.7:0/1753521709 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 60) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0aa00225d0 con 0x562b17996b10 2024-04-25T10:01:20.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.455+0000 7f0ab77a2740 10 client.7857 fetch_fsmap finished waiting for FSMap version 60 2024-04-25T10:01:20.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.455+0000 7f0ab77a2740 10 client.7857 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T10:01:20.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.455+0000 7f0ab77a2740 20 client.7857 populate_metadata read hostname 'smithi007' 2024-04-25T10:01:20.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.455+0000 7f0ab77a2740 1 --2- 172.21.15.7:0/1753521709 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x562b179ad920 0x562b179add20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.455+0000 7f0ab77a2740 4 client.7857 mds_command: new command op to 7734 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:01:20.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.455+0000 7f0ab77a2740 1 -- 172.21.15.7:0/1753521709 --> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562b178e02e0 con 0x562b179ad920 2024-04-25T10:01:20.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.455+0000 7f0aa7fff640 1 --2- 172.21.15.7:0/1753521709 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x562b179ad920 0x562b179add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.456+0000 7f0a8d7fa640 10 client.7857 ms_handle_connect on v2:172.21.15.7:6836/3829085443 2024-04-25T10:01:20.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.456+0000 7f0aa7fff640 1 --2- 172.21.15.7:0/1753521709 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x562b179ad920 0x562b179add20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60adc1315c179693 server_cookie=8f91b7f411436757 in_seq=0 out_seq=0 2024-04-25T10:01:20.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.456+0000 7f0a8d7fa640 1 -- 172.21.15.7:0/1753521709 <== mds.0 v2:172.21.15.7:6836/3829085443 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562b178e02e0 con 0x562b179ad920 2024-04-25T10:01:20.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.456+0000 7f0a8d7fa640 10 client.7857 handle_command_reply: tid=0 2024-04-25T10:01:20.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.456+0000 7f0ab77a2740 1 client.7857 shutdown 2024-04-25T10:01:20.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.456+0000 7f0ab77a2740 1 -- 172.21.15.7:0/1753521709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b17996b10 msgr2=0x562b17986b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:20.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.456+0000 7f0ab77a2740 1 --2- 172.21.15.7:0/1753521709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b17996b10 0x562b17986b90 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0005e30 tx=0x7f0aa0007bc0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.456+0000 7f0ab77a2740 1 -- 172.21.15.7:0/1753521709 shutdown_connections 2024-04-25T10:01:20.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.456+0000 7f0ab77a2740 1 --2- 172.21.15.7:0/1753521709 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x562b179ad920 0x562b179add20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.456+0000 7f0ab77a2740 1 --2- 172.21.15.7:0/1753521709 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562b179b6eb0 0x562b179ab7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.456+0000 7f0ab77a2740 1 --2- 172.21.15.7:0/1753521709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b17996ef0 0x562b179ab2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.456+0000 7f0ab77a2740 1 --2- 172.21.15.7:0/1753521709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b17996b10 0x562b17986b90 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.456+0000 7f0a8d7fa640 0 client.7857 ms_handle_reset on v2:172.21.15.7:6836/3829085443 2024-04-25T10:01:20.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.456+0000 7f0ab77a2740 1 -- 172.21.15.7:0/1753521709 >> 172.21.15.7:0/1753521709 conn(0x562b17969770 msgr2=0x562b179b2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:20.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.456+0000 7f0ab77a2740 1 -- 172.21.15.7:0/1753521709 shutdown_connections 2024-04-25T10:01:20.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.456+0000 7f0ab77a2740 1 -- 172.21.15.7:0/1753521709 wait complete. 2024-04-25T10:01:20.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.457+0000 7f0ab77a2740 20 client.7857 trim_cache size 0 max 16384 2024-04-25T10:01:20.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.472+0000 7f0ab77a2740 1 Processor -- start 2024-04-25T10:01:20.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.472+0000 7f0ab77a2740 1 -- start start 2024-04-25T10:01:20.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.472+0000 7f0ab77a2740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b17996b10 0x562b179ac170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.472+0000 7f0ab77a2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b17996ef0 0x562b17995440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.472+0000 7f0ab77a2740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562b179b6eb0 0x562b1796a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.472+0000 7f0ab77a2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab01fe4a0 con 0x562b17996ef0 2024-04-25T10:01:20.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.472+0000 7f0ab77a2740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab01fd660 con 0x562b17996b10 2024-04-25T10:01:20.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.472+0000 7f0ab77a2740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab01fcaf0 con 0x562b179b6eb0 2024-04-25T10:01:20.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.473+0000 7f0aa7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b17996ef0 0x562b17995440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.473+0000 7f0aa7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b17996ef0 0x562b17995440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38402/0 (socket says 172.21.15.7:38402) 2024-04-25T10:01:20.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.473+0000 7f0aa7fff640 1 -- 172.21.15.7:0/1322190738 learned_addr learned my addr 172.21.15.7:0/1322190738 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:20.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.473+0000 7f0aaed9d640 1 --2- 172.21.15.7:0/1322190738 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562b179b6eb0 0x562b1796a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.473+0000 7f0aae59c640 1 --2- 172.21.15.7:0/1322190738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b17996b10 0x562b179ac170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.473+0000 7f0aa7fff640 1 -- 172.21.15.7:0/1322190738 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562b179b6eb0 msgr2=0x562b1796a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:20.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.473+0000 7f0aa7fff640 1 --2- 172.21.15.7:0/1322190738 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562b179b6eb0 0x562b1796a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.473+0000 7f0aa7fff640 1 -- 172.21.15.7:0/1322190738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b17996b10 msgr2=0x562b179ac170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:20.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.473+0000 7f0aa7fff640 1 --2- 172.21.15.7:0/1322190738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b17996b10 0x562b179ac170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.473+0000 7f0aa7fff640 1 -- 172.21.15.7:0/1322190738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b175a70f0 con 0x562b17996ef0 2024-04-25T10:01:20.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.473+0000 7f0aa7fff640 1 --2- 172.21.15.7:0/1322190738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b17996ef0 0x562b17995440 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f0a98001ac0 tx=0x7f0a9800a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca4fadbf412ece1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:20.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.473+0000 7f0a8f7fe640 1 -- 172.21.15.7:0/1322190738 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a98029070 con 0x562b17996ef0 2024-04-25T10:01:20.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.473+0000 7f0a8f7fe640 1 -- 172.21.15.7:0/1322190738 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9801a040 con 0x562b17996ef0 2024-04-25T10:01:20.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.473+0000 7f0a8f7fe640 1 -- 172.21.15.7:0/1322190738 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a98019040 con 0x562b17996ef0 2024-04-25T10:01:20.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.474+0000 7f0ab77a2740 1 -- 172.21.15.7:0/1322190738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b17996ef0 msgr2=0x562b17995440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:20.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.474+0000 7f0ab77a2740 1 --2- 172.21.15.7:0/1322190738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b17996ef0 0x562b17995440 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f0a98001ac0 tx=0x7f0a9800a000 comp rx=0 tx=0).stop 2024-04-25T10:01:20.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.474+0000 7f0ab77a2740 1 -- 172.21.15.7:0/1322190738 shutdown_connections 2024-04-25T10:01:20.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.474+0000 7f0ab77a2740 1 --2- 172.21.15.7:0/1322190738 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562b179b6eb0 0x562b1796a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.474+0000 7f0ab77a2740 1 --2- 172.21.15.7:0/1322190738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b17996ef0 0x562b17995440 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.474+0000 7f0ab77a2740 1 --2- 172.21.15.7:0/1322190738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b17996b10 0x562b179ac170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.474+0000 7f0ab77a2740 1 -- 172.21.15.7:0/1322190738 >> 172.21.15.7:0/1322190738 conn(0x562b17969770 msgr2=0x562b17968600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:20.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.474+0000 7f0ab77a2740 1 -- 172.21.15.7:0/1322190738 shutdown_connections 2024-04-25T10:01:20.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.474+0000 7f0ab77a2740 1 -- 172.21.15.7:0/1322190738 wait complete. 2024-04-25T10:01:20.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.474+0000 7f0ab77a2740 1 -- start start 2024-04-25T10:01:20.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.474+0000 7f0ab77a2740 1 Processor -- start 2024-04-25T10:01:20.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.475+0000 7f0ab77a2740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b17996b10 0x562b17a205e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.475+0000 7f0ab77a2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b17996ef0 0x562b179cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.475+0000 7f0ab77a2740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562b179b6eb0 0x562b179cd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.475+0000 7f0ab77a2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b17965420 con 0x562b17996ef0 2024-04-25T10:01:20.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.475+0000 7f0ab77a2740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab01fd060 con 0x562b17996b10 2024-04-25T10:01:20.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.475+0000 7f0ab77a2740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b17970eb0 con 0x562b179b6eb0 2024-04-25T10:01:20.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.475+0000 7f0ab77a2740 10 client.0 _ll_register_callbacks cb 0x7f0a98007e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:01:20.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.475+0000 7f0aa7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b17996ef0 0x562b179cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.475+0000 7f0aa7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b17996ef0 0x562b179cccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38418/0 (socket says 172.21.15.7:38418) 2024-04-25T10:01:20.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.475+0000 7f0aa7fff640 1 -- 172.21.15.7:0/168723751 learned_addr learned my addr 172.21.15.7:0/168723751 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:20.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.476+0000 7f0aaed9d640 1 --2- 172.21.15.7:0/168723751 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562b179b6eb0 0x562b179cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.476+0000 7f0aae59c640 1 --2- 172.21.15.7:0/168723751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b17996b10 0x562b17a205e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.476+0000 7f0aa7fff640 1 -- 172.21.15.7:0/168723751 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562b179b6eb0 msgr2=0x562b179cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:20.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.476+0000 7f0aa7fff640 1 --2- 172.21.15.7:0/168723751 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562b179b6eb0 0x562b179cd200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.476+0000 7f0aa7fff640 1 -- 172.21.15.7:0/168723751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b17996b10 msgr2=0x562b17a205e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:20.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.476+0000 7f0aa7fff640 1 --2- 172.21.15.7:0/168723751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b17996b10 0x562b17a205e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.476+0000 7f0aa7fff640 1 -- 172.21.15.7:0/168723751 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562b179cda40 con 0x562b17996ef0 2024-04-25T10:01:20.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.476+0000 7f0aa7fff640 1 --2- 172.21.15.7:0/168723751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b17996ef0 0x562b179cccc0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x562b17971070 tx=0x7f0a98000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e122a5964ec3586d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:20.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.476+0000 7f0a8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:01:20.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.476+0000 7f0a8d7fa640 1 -- 172.21.15.7:0/168723751 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a98019030 con 0x562b17996ef0 2024-04-25T10:01:20.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.476+0000 7f0a8d7fa640 1 -- 172.21.15.7:0/168723751 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f0a980074d0 con 0x562b17996ef0 2024-04-25T10:01:20.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.476+0000 7f0ab77a2740 1 -- 172.21.15.7:0/168723751 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0a9801a040 con 0x562b17996ef0 2024-04-25T10:01:20.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.476+0000 7f0a8d7fa640 1 -- 172.21.15.7:0/168723751 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a98029070 con 0x562b17996ef0 2024-04-25T10:01:20.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.476+0000 7f0ab77a2740 10 client.7863 fetch_fsmap learned FSMap version 60 2024-04-25T10:01:20.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.476+0000 7f0ab77a2740 1 -- 172.21.15.7:0/168723751 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x562b179ac940 con 0x562b17996ef0 2024-04-25T10:01:20.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.476+0000 7f0a8d7fa640 1 -- 172.21.15.7:0/168723751 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9801a040 con 0x562b17996ef0 2024-04-25T10:01:20.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.476+0000 7f0a8d7fa640 1 -- 172.21.15.7:0/168723751 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 60) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0a980067d0 con 0x562b17996ef0 2024-04-25T10:01:20.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.477+0000 7f0ab77a2740 10 client.7863 fetch_fsmap finished waiting for FSMap version 60 2024-04-25T10:01:20.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.477+0000 7f0ab77a2740 10 client.7863 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T10:01:20.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.477+0000 7f0ab77a2740 20 client.7863 populate_metadata read hostname 'smithi007' 2024-04-25T10:01:20.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.477+0000 7f0ab77a2740 1 --2- 172.21.15.7:0/168723751 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x562b179b6920 0x562b179d65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.477+0000 7f0ab77a2740 4 client.7863 mds_command: new command op to 7734 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T10:01:20.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.477+0000 7f0ab77a2740 1 -- 172.21.15.7:0/168723751 --> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562b178da630 con 0x562b179b6920 2024-04-25T10:01:20.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.477+0000 7f0aae59c640 1 --2- 172.21.15.7:0/168723751 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x562b179b6920 0x562b179d65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.477+0000 7f0aae59c640 1 --2- 172.21.15.7:0/168723751 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x562b179b6920 0x562b179d65a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5a4a776634d2554 server_cookie=135e0586b602038b in_seq=0 out_seq=0 2024-04-25T10:01:20.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.477+0000 7f0a8d7fa640 10 client.7863 ms_handle_connect on v2:172.21.15.7:6836/3829085443 2024-04-25T10:01:20.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.477+0000 7f0a8d7fa640 1 -- 172.21.15.7:0/168723751 <== mds.0 v2:172.21.15.7:6836/3829085443 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x562b178da630 con 0x562b179b6920 2024-04-25T10:01:20.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.477+0000 7f0a8d7fa640 10 client.7863 handle_command_reply: tid=0 2024-04-25T10:01:20.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.477+0000 7f0ab77a2740 1 client.7863 shutdown 2024-04-25T10:01:20.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.477+0000 7f0ab77a2740 1 -- 172.21.15.7:0/168723751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b17996ef0 msgr2=0x562b179cccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:20.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.477+0000 7f0ab77a2740 1 --2- 172.21.15.7:0/168723751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b17996ef0 0x562b179cccc0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x562b17971070 tx=0x7f0a98000ed0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.477+0000 7f0ab77a2740 1 -- 172.21.15.7:0/168723751 shutdown_connections 2024-04-25T10:01:20.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.477+0000 7f0ab77a2740 1 --2- 172.21.15.7:0/168723751 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x562b179b6920 0x562b179d65a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.477+0000 7f0ab77a2740 1 --2- 172.21.15.7:0/168723751 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562b179b6eb0 0x562b179cd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.477+0000 7f0ab77a2740 1 --2- 172.21.15.7:0/168723751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562b17996ef0 0x562b179cccc0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.477+0000 7f0ab77a2740 1 --2- 172.21.15.7:0/168723751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b17996b10 0x562b17a205e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.477+0000 7f0a8d7fa640 0 client.7863 ms_handle_reset on v2:172.21.15.7:6836/3829085443 2024-04-25T10:01:20.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.477+0000 7f0ab77a2740 1 -- 172.21.15.7:0/168723751 >> 172.21.15.7:0/168723751 conn(0x562b17969770 msgr2=0x562b179952a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:20.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.478+0000 7f0ab77a2740 1 -- 172.21.15.7:0/168723751 shutdown_connections 2024-04-25T10:01:20.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.478+0000 7f0ab77a2740 1 -- 172.21.15.7:0/168723751 wait complete. 2024-04-25T10:01:20.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.478+0000 7f0ab77a2740 20 client.7863 trim_cache size 0 max 16384 2024-04-25T10:01:20.489 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:01:20.489 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-04-25T10:01:20.489 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-04-25T10:01:20.489 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:01:20.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.478+0000 7f0ab4a9e640 1 -- 172.21.15.7:0/3008680648 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0a9006b4d0 msgr2=0x7f0a9006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:20.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.478+0000 7f0ab4a9e640 1 --2- 172.21.15.7:0/3008680648 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0a9006b4d0 0x7f0a9006d990 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0000f60 tx=0x7f0aa0009040 comp rx=0 tx=0).stop 2024-04-25T10:01:20.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.478+0000 7f0ab4a9e640 1 -- 172.21.15.7:0/3008680648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ab0144fe0 msgr2=0x7f0ab013b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:20.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.478+0000 7f0ab4a9e640 1 --2- 172.21.15.7:0/3008680648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ab0144fe0 0x7f0ab013b830 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8009d90 tx=0x7f0aa8004a40 comp rx=0 tx=0).stop 2024-04-25T10:01:20.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.478+0000 7f0ab4a9e640 1 -- 172.21.15.7:0/3008680648 shutdown_connections 2024-04-25T10:01:20.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.478+0000 7f0ab4a9e640 1 --2- 172.21.15.7:0/3008680648 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0a9006b4d0 0x7f0a9006d990 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.478+0000 7f0ab4a9e640 1 --2- 172.21.15.7:0/3008680648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ab0144fe0 0x7f0ab013b830 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.478+0000 7f0ab4a9e640 1 --2- 172.21.15.7:0/3008680648 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ab0071840 0x7f0ab015a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.478+0000 7f0ab4a9e640 1 --2- 172.21.15.7:0/3008680648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ab006d130 0x7f0ab013e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.478+0000 7f0ab4a9e640 1 -- 172.21.15.7:0/3008680648 >> 172.21.15.7:0/3008680648 conn(0x7f0ab006ab60 msgr2=0x7f0ab015df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:20.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.478+0000 7f0ab4a9e640 1 -- 172.21.15.7:0/3008680648 shutdown_connections 2024-04-25T10:01:20.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.478+0000 7f0ab4a9e640 1 -- 172.21.15.7:0/3008680648 wait complete. 2024-04-25T10:01:20.493 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T10:01:20.494 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:01:20.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.592+0000 7f060717e640 1 Processor -- start 2024-04-25T10:01:20.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.592+0000 7f060717e640 1 -- start start 2024-04-25T10:01:20.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.593+0000 7f060717e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f060006e970 0x7f06000cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.593+0000 7f060717e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06000ced20 0x7f060015b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.593+0000 7f060717e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06000cdbf0 con 0x7f0600144100 2024-04-25T10:01:20.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.593+0000 7f060717e640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06001444e0 con 0x7f060006e970 2024-04-25T10:01:20.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.593+0000 7f060717e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f060015ac70 con 0x7f06000ced20 2024-04-25T10:01:20.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.593+0000 7f05fffff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f060006e970 0x7f06000cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.593+0000 7f05fffff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f060006e970 0x7f06000cd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38434/0 (socket says 172.21.15.7:38434) 2024-04-25T10:01:20.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.593+0000 7f05fffff640 1 -- 172.21.15.7:0/223096734 learned_addr learned my addr 172.21.15.7:0/223096734 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:20.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.593+0000 7f060571b640 1 --2- 172.21.15.7:0/223096734 >> v2:172.21.15.55:3300/0 conn(0x7f06000ced20 0x7f060015b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.593+0000 7f05fffff640 1 -- 172.21.15.7:0/223096734 >> v2:172.21.15.55:3300/0 conn(0x7f06000ced20 msgr2=0x7f060015b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:20.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.593+0000 7f05fffff640 1 --2- 172.21.15.7:0/223096734 >> v2:172.21.15.55:3300/0 conn(0x7f06000ced20 0x7f060015b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.593+0000 7f05fffff640 1 -- 172.21.15.7:0/223096734 >> v1:172.21.15.55:6789/0 conn(0x7f0600144100 legacy=0x7f060006e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:20.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.593+0000 7f05fffff640 1 -- 172.21.15.7:0/223096734 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06000cded0 con 0x7f060006e970 2024-04-25T10:01:20.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.594+0000 7f05fffff640 1 --2- 172.21.15.7:0/223096734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f060006e970 0x7f06000cd610 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f06000710e0 tx=0x7f05e802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f10f45d47f29b654 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:20.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.594+0000 7f05ff7fe640 1 -- 172.21.15.7:0/223096734 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e8037070 con 0x7f060006e970 2024-04-25T10:01:20.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.594+0000 7f05ff7fe640 1 -- 172.21.15.7:0/223096734 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e8032440 con 0x7f060006e970 2024-04-25T10:01:20.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.594+0000 7f05ff7fe640 1 -- 172.21.15.7:0/223096734 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e8032810 con 0x7f060006e970 2024-04-25T10:01:20.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.594+0000 7f060717e640 1 -- 172.21.15.7:0/223096734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f060006e970 msgr2=0x7f06000cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:20.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.594+0000 7f060717e640 1 --2- 172.21.15.7:0/223096734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f060006e970 0x7f06000cd610 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f06000710e0 tx=0x7f05e802a1e0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.594+0000 7f060717e640 1 -- 172.21.15.7:0/223096734 shutdown_connections 2024-04-25T10:01:20.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.594+0000 7f060717e640 1 --2- 172.21.15.7:0/223096734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f060006e970 0x7f06000cd610 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.594+0000 7f060717e640 1 --2- 172.21.15.7:0/223096734 >> v2:172.21.15.55:3300/0 conn(0x7f06000ced20 0x7f060015b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.595+0000 7f060717e640 1 -- 172.21.15.7:0/223096734 >> 172.21.15.7:0/223096734 conn(0x7f0600071150 msgr2=0x7f0600071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:20.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.595+0000 7f060717e640 1 -- 172.21.15.7:0/223096734 shutdown_connections 2024-04-25T10:01:20.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.595+0000 7f060717e640 1 -- 172.21.15.7:0/223096734 wait complete. 2024-04-25T10:01:20.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.596+0000 7f060717e640 1 Processor -- start 2024-04-25T10:01:20.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.596+0000 7f060717e640 1 -- start start 2024-04-25T10:01:20.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.597+0000 7f060717e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f060006e970 0x7f0600137f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.597+0000 7f060717e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f06000ced20 0x7f06001f30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.597+0000 7f060717e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0600144100 0x7f0600142c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.597+0000 7f060717e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06000cea00 con 0x7f0600144100 2024-04-25T10:01:20.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.597+0000 7f060717e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06000ce490 con 0x7f060006e970 2024-04-25T10:01:20.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.597+0000 7f060717e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f060015b670 con 0x7f06000ced20 2024-04-25T10:01:20.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.597+0000 7f060571b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0600144100 0x7f0600142c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.597+0000 7f060571b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0600144100 0x7f0600142c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38448/0 (socket says 172.21.15.7:38448) 2024-04-25T10:01:20.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.597+0000 7f060571b640 1 -- 172.21.15.7:0/3858390342 learned_addr learned my addr 172.21.15.7:0/3858390342 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:20.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.597+0000 7f05fffff640 1 --2- 172.21.15.7:0/3858390342 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f06000ced20 0x7f06001f30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.597+0000 7f0604f1a640 1 --2- 172.21.15.7:0/3858390342 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f060006e970 0x7f0600137f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.597+0000 7f060571b640 1 -- 172.21.15.7:0/3858390342 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f06000ced20 msgr2=0x7f06001f30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:20.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.597+0000 7f060571b640 1 --2- 172.21.15.7:0/3858390342 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f06000ced20 0x7f06001f30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.597+0000 7f060571b640 1 -- 172.21.15.7:0/3858390342 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f060006e970 msgr2=0x7f0600137f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:20.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.597+0000 7f060571b640 1 --2- 172.21.15.7:0/3858390342 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f060006e970 0x7f0600137f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.597+0000 7f060571b640 1 -- 172.21.15.7:0/3858390342 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06001f3b90 con 0x7f0600144100 2024-04-25T10:01:20.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.597+0000 7f05fffff640 1 --2- 172.21.15.7:0/3858390342 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f06000ced20 0x7f06001f30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:01:20.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.597+0000 7f060571b640 1 --2- 172.21.15.7:0/3858390342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0600144100 0x7f0600142c60 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f05f000e930 tx=0x7f05f000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:20.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.597+0000 7f05fd7fa640 1 -- 172.21.15.7:0/3858390342 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f0017070 con 0x7f0600144100 2024-04-25T10:01:20.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.597+0000 7f05fd7fa640 1 -- 172.21.15.7:0/3858390342 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f000c920 con 0x7f0600144100 2024-04-25T10:01:20.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.597+0000 7f060717e640 1 -- 172.21.15.7:0/3858390342 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06001f3e70 con 0x7f0600144100 2024-04-25T10:01:20.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.597+0000 7f05fd7fa640 1 -- 172.21.15.7:0/3858390342 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f000cd10 con 0x7f0600144100 2024-04-25T10:01:20.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.597+0000 7f060717e640 1 -- 172.21.15.7:0/3858390342 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06001f4430 con 0x7f0600144100 2024-04-25T10:01:20.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.598+0000 7f060717e640 1 -- 172.21.15.7:0/3858390342 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0600068fd0 con 0x7f0600144100 2024-04-25T10:01:20.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.599+0000 7f05fd7fa640 1 -- 172.21.15.7:0/3858390342 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f05f001a070 con 0x7f0600144100 2024-04-25T10:01:20.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.599+0000 7f05fd7fa640 1 --2- 172.21.15.7:0/3858390342 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f05e006b4d0 0x7f05e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.600+0000 7f0604f1a640 1 --2- 172.21.15.7:0/3858390342 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f05e006b4d0 0x7f05e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.600+0000 7f05fd7fa640 1 -- 172.21.15.7:0/3858390342 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f05f008a860 con 0x7f0600144100 2024-04-25T10:01:20.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.600+0000 7f0604f1a640 1 --2- 172.21.15.7:0/3858390342 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f05e006b4d0 0x7f05e006d990 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f05f8001ca0 tx=0x7f05f8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:20.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.604+0000 7f05fd7fa640 1 -- 172.21.15.7:0/3858390342 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f05f00594b0 con 0x7f0600144100 2024-04-25T10:01:20.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.821+0000 7f060717e640 1 -- 172.21.15.7:0/3858390342 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06000cd0d0 con 0x7f0600144100 2024-04-25T10:01:20.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.821+0000 7f05fd7fa640 1 -- 172.21.15.7:0/3858390342 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f05f005de20 con 0x7f0600144100 2024-04-25T10:01:20.826 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:01:20.826 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2505539422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2505539422},{"type":"v1","addr":"172.21.15.55:6834","nonce":2505539422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2808857776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2808857776},{"type":"v1","addr":"172.21.15.55:6835","nonce":2808857776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7518,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1796103144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1796103144},{"type":"v1","addr":"172.21.15.7:6835","nonce":1796103144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:00:34.054759+0000","modified":"2024-04-25T10:00:54.397441+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7734},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7734":{"gid":7734,"name":"a","rank":0,"incarnation":56,"state":"up:active","state_seq":6,"addr":"172.21.15.7:6837/3829085443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3829085443},{"type":"v1","addr":"172.21.15.7:6837","nonce":3829085443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:01:20.827 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 60 2024-04-25T10:01:20.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.823+0000 7f060717e640 1 -- 172.21.15.7:0/3858390342 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f05e006b4d0 msgr2=0x7f05e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:20.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.823+0000 7f060717e640 1 --2- 172.21.15.7:0/3858390342 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f05e006b4d0 0x7f05e006d990 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f05f8001ca0 tx=0x7f05f8009040 comp rx=0 tx=0).stop 2024-04-25T10:01:20.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.823+0000 7f060717e640 1 -- 172.21.15.7:0/3858390342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0600144100 msgr2=0x7f0600142c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:20.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.823+0000 7f060717e640 1 --2- 172.21.15.7:0/3858390342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0600144100 0x7f0600142c60 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f05f000e930 tx=0x7f05f000edf0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.824+0000 7f060717e640 1 -- 172.21.15.7:0/3858390342 shutdown_connections 2024-04-25T10:01:20.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.824+0000 7f060717e640 1 --2- 172.21.15.7:0/3858390342 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f05e006b4d0 0x7f05e006d990 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.824+0000 7f060717e640 1 --2- 172.21.15.7:0/3858390342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0600144100 0x7f0600142c60 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.824+0000 7f060717e640 1 --2- 172.21.15.7:0/3858390342 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f06000ced20 0x7f06001f30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.824+0000 7f060717e640 1 --2- 172.21.15.7:0/3858390342 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f060006e970 0x7f0600137f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.824+0000 7f060717e640 1 -- 172.21.15.7:0/3858390342 >> 172.21.15.7:0/3858390342 conn(0x7f0600071150 msgr2=0x7f060013e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:20.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.824+0000 7f060717e640 1 -- 172.21.15.7:0/3858390342 shutdown_connections 2024-04-25T10:01:20.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.824+0000 7f060717e640 1 -- 172.21.15.7:0/3858390342 wait complete. 2024-04-25T10:01:20.839 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-25T10:01:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.937+0000 7f0da90b3640 1 Processor -- start 2024-04-25T10:01:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.937+0000 7f0da90b3640 1 -- start start 2024-04-25T10:01:20.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.938+0000 7f0da90b3640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0da406e950 0x7f0da40b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.938+0000 7f0da90b3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0da40ce610 0x7f0da40ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.938+0000 7f0da90b3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0da40b2ee0 con 0x7f0da4143fb0 2024-04-25T10:01:20.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.938+0000 7f0da90b3640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da40b3150 con 0x7f0da406e950 2024-04-25T10:01:20.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.938+0000 7f0da90b3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da40b3430 con 0x7f0da40ce610 2024-04-25T10:01:20.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.938+0000 7f0da259c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0da406e950 0x7f0da40b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.938+0000 7f0da259c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0da406e950 0x7f0da40b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38464/0 (socket says 172.21.15.7:38464) 2024-04-25T10:01:20.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.938+0000 7f0da259c640 1 -- 172.21.15.7:0/2572758955 learned_addr learned my addr 172.21.15.7:0/2572758955 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:20.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.938+0000 7f0da259c640 1 -- 172.21.15.7:0/2572758955 >> v2:172.21.15.55:3300/0 conn(0x7f0da40ce610 msgr2=0x7f0da40ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:20.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.938+0000 7f0da359e640 1 --2- 172.21.15.7:0/2572758955 >> v2:172.21.15.55:3300/0 conn(0x7f0da40ce610 0x7f0da40ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.938+0000 7f0da259c640 1 --2- 172.21.15.7:0/2572758955 >> v2:172.21.15.55:3300/0 conn(0x7f0da40ce610 0x7f0da40ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.938+0000 7f0da259c640 1 -- 172.21.15.7:0/2572758955 >> v1:172.21.15.55:6789/0 conn(0x7f0da4143fb0 legacy=0x7f0da406e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:20.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.938+0000 7f0da259c640 1 -- 172.21.15.7:0/2572758955 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da40b3710 con 0x7f0da406e950 2024-04-25T10:01:20.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.939+0000 7f0da259c640 1 --2- 172.21.15.7:0/2572758955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0da406e950 0x7f0da40b3c30 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f0da40cd8e0 tx=0x7f0d9802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95cb33f2485480cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:20.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.939+0000 7f0da1d9b640 1 -- 172.21.15.7:0/2572758955 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d98037070 con 0x7f0da406e950 2024-04-25T10:01:20.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.939+0000 7f0da1d9b640 1 -- 172.21.15.7:0/2572758955 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d98032440 con 0x7f0da406e950 2024-04-25T10:01:20.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.939+0000 7f0da1d9b640 1 -- 172.21.15.7:0/2572758955 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d98032810 con 0x7f0da406e950 2024-04-25T10:01:20.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.939+0000 7f0da90b3640 1 -- 172.21.15.7:0/2572758955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0da406e950 msgr2=0x7f0da40b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:20.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.939+0000 7f0da90b3640 1 --2- 172.21.15.7:0/2572758955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0da406e950 0x7f0da40b3c30 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f0da40cd8e0 tx=0x7f0d9802a1a0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.939+0000 7f0da90b3640 1 -- 172.21.15.7:0/2572758955 shutdown_connections 2024-04-25T10:01:20.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.939+0000 7f0da90b3640 1 --2- 172.21.15.7:0/2572758955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0da406e950 0x7f0da40b3c30 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.939+0000 7f0da90b3640 1 --2- 172.21.15.7:0/2572758955 >> v2:172.21.15.55:3300/0 conn(0x7f0da40ce610 0x7f0da40ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.939+0000 7f0da90b3640 1 -- 172.21.15.7:0/2572758955 >> 172.21.15.7:0/2572758955 conn(0x7f0da406ab60 msgr2=0x7f0da406af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:20.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.939+0000 7f0da90b3640 1 -- 172.21.15.7:0/2572758955 shutdown_connections 2024-04-25T10:01:20.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.939+0000 7f0da90b3640 1 -- 172.21.15.7:0/2572758955 wait complete. 2024-04-25T10:01:20.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.941+0000 7f0da90b3640 1 Processor -- start 2024-04-25T10:01:20.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.941+0000 7f0da90b3640 1 -- start start 2024-04-25T10:01:20.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.942+0000 7f0da90b3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0da406e950 0x7f0da413f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.942+0000 7f0da90b3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0da40ce610 0x7f0da41f7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.942+0000 7f0da90b3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0da4143fb0 0x7f0da415a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.942+0000 7f0da90b3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da40cf2f0 con 0x7f0da406e950 2024-04-25T10:01:20.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.942+0000 7f0da90b3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da4144390 con 0x7f0da4143fb0 2024-04-25T10:01:20.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.942+0000 7f0da90b3640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da415ac70 con 0x7f0da40ce610 2024-04-25T10:01:20.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.942+0000 7f0da2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0da406e950 0x7f0da413f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.942+0000 7f0da2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0da406e950 0x7f0da413f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38476/0 (socket says 172.21.15.7:38476) 2024-04-25T10:01:20.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.942+0000 7f0da2d9d640 1 -- 172.21.15.7:0/1313661604 learned_addr learned my addr 172.21.15.7:0/1313661604 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:20.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.942+0000 7f0da2d9d640 1 -- 172.21.15.7:0/1313661604 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0da40ce610 msgr2=0x7f0da41f7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:20.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.942+0000 7f0da2d9d640 1 --2- 172.21.15.7:0/1313661604 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0da40ce610 0x7f0da41f7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.942+0000 7f0da2d9d640 1 -- 172.21.15.7:0/1313661604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0da4143fb0 msgr2=0x7f0da415a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:20.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.942+0000 7f0da2d9d640 1 --2- 172.21.15.7:0/1313661604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0da4143fb0 0x7f0da415a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.942+0000 7f0da2d9d640 1 -- 172.21.15.7:0/1313661604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da40a84f0 con 0x7f0da406e950 2024-04-25T10:01:20.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.942+0000 7f0da2d9d640 1 --2- 172.21.15.7:0/1313661604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0da406e950 0x7f0da413f750 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400b3f0 tx=0x7f0d9400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:20.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.942+0000 7f0d8b7fe640 1 -- 172.21.15.7:0/1313661604 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d94015020 con 0x7f0da406e950 2024-04-25T10:01:20.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.942+0000 7f0d8b7fe640 1 -- 172.21.15.7:0/1313661604 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d94011830 con 0x7f0da406e950 2024-04-25T10:01:20.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.942+0000 7f0da90b3640 1 -- 172.21.15.7:0/1313661604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0da41f78e0 con 0x7f0da406e950 2024-04-25T10:01:20.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.942+0000 7f0d8b7fe640 1 -- 172.21.15.7:0/1313661604 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d94011c20 con 0x7f0da406e950 2024-04-25T10:01:20.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.942+0000 7f0da90b3640 1 -- 172.21.15.7:0/1313661604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0da40a8760 con 0x7f0da406e950 2024-04-25T10:01:20.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.944+0000 7f0d8b7fe640 1 -- 172.21.15.7:0/1313661604 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0d94018020 con 0x7f0da406e950 2024-04-25T10:01:20.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.944+0000 7f0d8b7fe640 1 --2- 172.21.15.7:0/1313661604 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0d9006b500 0x7f0d9006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.945+0000 7f0d8b7fe640 1 -- 172.21.15.7:0/1313661604 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f0d9408a120 con 0x7f0da406e950 2024-04-25T10:01:20.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.945+0000 7f0da259c640 1 --2- 172.21.15.7:0/1313661604 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0d9006b500 0x7f0d9006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.945+0000 7f0da259c640 1 --2- 172.21.15.7:0/1313661604 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0d9006b500 0x7f0d9006d9c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f0d98034000 tx=0x7f0d9802c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:20.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.945+0000 7f0dabdba740 1 Processor -- start 2024-04-25T10:01:20.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.945+0000 7f0dabdba740 1 -- start start 2024-04-25T10:01:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.946+0000 7f0dabdba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621ff22e590 0x5621ff2306f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.946+0000 7f0dabdba740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621ff26ac60 0x5621ff22e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.946+0000 7f0dabdba740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621ff259050 0x5621ff2594d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.946+0000 7f0dabdba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621ff191c60 con 0x5621ff22e590 2024-04-25T10:01:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.946+0000 7f0dabdba740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621ff130d80 con 0x5621ff26ac60 2024-04-25T10:01:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.946+0000 7f0dabdba740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5621ff18dd00 con 0x5621ff259050 2024-04-25T10:01:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.946+0000 7f0da2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621ff22e590 0x5621ff2306f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.946+0000 7f0da2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621ff22e590 0x5621ff2306f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38490/0 (socket says 172.21.15.7:38490) 2024-04-25T10:01:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.946+0000 7f0da2d9d640 1 -- 172.21.15.7:0/1368539032 learned_addr learned my addr 172.21.15.7:0/1368539032 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.946+0000 7f0da359e640 1 --2- 172.21.15.7:0/1368539032 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621ff259050 0x5621ff2594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.946+0000 7f0da259c640 1 --2- 172.21.15.7:0/1368539032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621ff26ac60 0x5621ff22e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.947+0000 7f0da2d9d640 1 -- 172.21.15.7:0/1368539032 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621ff259050 msgr2=0x5621ff2594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.947+0000 7f0da2d9d640 1 --2- 172.21.15.7:0/1368539032 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621ff259050 0x5621ff2594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.947+0000 7f0da2d9d640 1 -- 172.21.15.7:0/1368539032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621ff26ac60 msgr2=0x5621ff22e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.947+0000 7f0da2d9d640 1 --2- 172.21.15.7:0/1368539032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621ff26ac60 0x5621ff22e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.947+0000 7f0da2d9d640 1 -- 172.21.15.7:0/1368539032 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621fef727c0 con 0x5621ff22e590 2024-04-25T10:01:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.947+0000 7f0da2d9d640 1 --2- 172.21.15.7:0/1368539032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621ff22e590 0x5621ff2306f0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f0d94060790 tx=0x7f0d940586f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=642403a560482ba8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.947+0000 7f0d88ff9640 1 -- 172.21.15.7:0/1368539032 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d94070020 con 0x5621ff22e590 2024-04-25T10:01:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.947+0000 7f0d88ff9640 1 -- 172.21.15.7:0/1368539032 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d940568b0 con 0x5621ff22e590 2024-04-25T10:01:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.947+0000 7f0d88ff9640 1 -- 172.21.15.7:0/1368539032 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d94057a00 con 0x5621ff22e590 2024-04-25T10:01:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.947+0000 7f0dabdba740 1 -- 172.21.15.7:0/1368539032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621ff22e590 msgr2=0x5621ff2306f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.947+0000 7f0dabdba740 1 --2- 172.21.15.7:0/1368539032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621ff22e590 0x5621ff2306f0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f0d94060790 tx=0x7f0d940586f0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.948+0000 7f0dabdba740 1 -- 172.21.15.7:0/1368539032 shutdown_connections 2024-04-25T10:01:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.948+0000 7f0dabdba740 1 --2- 172.21.15.7:0/1368539032 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621ff259050 0x5621ff2594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.948+0000 7f0dabdba740 1 --2- 172.21.15.7:0/1368539032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621ff26ac60 0x5621ff22e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.948+0000 7f0dabdba740 1 --2- 172.21.15.7:0/1368539032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621ff22e590 0x5621ff2306f0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.948+0000 7f0dabdba740 1 -- 172.21.15.7:0/1368539032 >> 172.21.15.7:0/1368539032 conn(0x5621ff1f66e0 msgr2=0x5621ff274050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.948+0000 7f0dabdba740 1 -- 172.21.15.7:0/1368539032 shutdown_connections 2024-04-25T10:01:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.948+0000 7f0dabdba740 1 -- 172.21.15.7:0/1368539032 wait complete. 2024-04-25T10:01:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.948+0000 7f0dabdba740 1 -- start start 2024-04-25T10:01:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.948+0000 7f0dabdba740 1 Processor -- start 2024-04-25T10:01:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.949+0000 7f0dabdba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621ff22e590 0x5621ff254aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.949+0000 7f0dabdba740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621ff259050 0x5621ff274300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.949+0000 7f0dabdba740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621ff26ac60 0x5621ff254170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.949+0000 7f0dabdba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621ff12e840 con 0x5621ff22e590 2024-04-25T10:01:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.949+0000 7f0dabdba740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621ff256ba0 con 0x5621ff259050 2024-04-25T10:01:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.949+0000 7f0dabdba740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5621ff2749c0 con 0x5621ff26ac60 2024-04-25T10:01:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.949+0000 7f0dabdba740 10 client.0 _ll_register_callbacks cb 0x5621ff148980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:01:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.949+0000 7f0da2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621ff22e590 0x5621ff254aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.949+0000 7f0da2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621ff22e590 0x5621ff254aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38506/0 (socket says 172.21.15.7:38506) 2024-04-25T10:01:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.949+0000 7f0da2d9d640 1 -- 172.21.15.7:0/1406141516 learned_addr learned my addr 172.21.15.7:0/1406141516 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.949+0000 7f0da359e640 1 --2- 172.21.15.7:0/1406141516 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621ff26ac60 0x5621ff254170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.949+0000 7f0da259c640 1 --2- 172.21.15.7:0/1406141516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621ff259050 0x5621ff274300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.949+0000 7f0da2d9d640 1 -- 172.21.15.7:0/1406141516 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621ff26ac60 msgr2=0x5621ff254170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.949+0000 7f0da2d9d640 1 --2- 172.21.15.7:0/1406141516 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621ff26ac60 0x5621ff254170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.949+0000 7f0da2d9d640 1 -- 172.21.15.7:0/1406141516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621ff259050 msgr2=0x5621ff274300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.949+0000 7f0da2d9d640 1 --2- 172.21.15.7:0/1406141516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621ff259050 0x5621ff274300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.949+0000 7f0da2d9d640 1 -- 172.21.15.7:0/1406141516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621fefd2f50 con 0x5621ff22e590 2024-04-25T10:01:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.949+0000 7f0da259c640 1 --2- 172.21.15.7:0/1406141516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621ff259050 0x5621ff274300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:01:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.950+0000 7f0da2d9d640 1 --2- 172.21.15.7:0/1406141516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621ff22e590 0x5621ff254aa0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f0d94056860 tx=0x7f0d940092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=404b8447ba861bb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.950+0000 7f0d81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:01:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.950+0000 7f0d81ffb640 1 -- 172.21.15.7:0/1406141516 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d94070040 con 0x5621ff22e590 2024-04-25T10:01:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.950+0000 7f0d81ffb640 1 -- 172.21.15.7:0/1406141516 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f0d94057a00 con 0x5621ff22e590 2024-04-25T10:01:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.950+0000 7f0dabdba740 1 -- 172.21.15.7:0/1406141516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0d940568b0 con 0x5621ff22e590 2024-04-25T10:01:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.950+0000 7f0d81ffb640 1 -- 172.21.15.7:0/1406141516 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d94054850 con 0x5621ff22e590 2024-04-25T10:01:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.950+0000 7f0dabdba740 10 client.7881 fetch_fsmap learned FSMap version 60 2024-04-25T10:01:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.950+0000 7f0dabdba740 1 -- 172.21.15.7:0/1406141516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x5621fee660b0 con 0x5621ff22e590 2024-04-25T10:01:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.950+0000 7f0d81ffb640 1 -- 172.21.15.7:0/1406141516 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d940568b0 con 0x5621ff22e590 2024-04-25T10:01:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.950+0000 7f0d81ffb640 1 -- 172.21.15.7:0/1406141516 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 60) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0d9405c1b0 con 0x5621ff22e590 2024-04-25T10:01:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.950+0000 7f0dabdba740 10 client.7881 fetch_fsmap finished waiting for FSMap version 60 2024-04-25T10:01:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.950+0000 7f0dabdba740 10 client.7881 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:01:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.950+0000 7f0dabdba740 20 client.7881 populate_metadata read hostname 'smithi007' 2024-04-25T10:01:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.950+0000 7f0dabdba740 1 --2- 172.21.15.7:0/1406141516 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x5621ff25bcb0 0x5621ff291550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.950+0000 7f0dabdba740 4 client.7881 mds_command: new command op to 7734 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:01:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.950+0000 7f0dabdba740 1 -- 172.21.15.7:0/1406141516 --> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5621ff151e60 con 0x5621ff25bcb0 2024-04-25T10:01:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.950+0000 7f0da259c640 1 --2- 172.21.15.7:0/1406141516 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x5621ff25bcb0 0x5621ff291550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.951+0000 7f0da259c640 1 --2- 172.21.15.7:0/1406141516 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x5621ff25bcb0 0x5621ff291550 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d631ad43d6094ddb server_cookie=a8e8888f511b60c8 in_seq=0 out_seq=0 2024-04-25T10:01:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.951+0000 7f0d81ffb640 10 client.7881 ms_handle_connect on v2:172.21.15.7:6836/3829085443 2024-04-25T10:01:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.951+0000 7f0d81ffb640 1 -- 172.21.15.7:0/1406141516 <== mds.0 v2:172.21.15.7:6836/3829085443 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5621ff151e60 con 0x5621ff25bcb0 2024-04-25T10:01:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.951+0000 7f0d81ffb640 10 client.7881 handle_command_reply: tid=0 2024-04-25T10:01:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.951+0000 7f0dabdba740 1 client.7881 shutdown 2024-04-25T10:01:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.951+0000 7f0dabdba740 1 -- 172.21.15.7:0/1406141516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621ff22e590 msgr2=0x5621ff254aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:20.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.951+0000 7f0dabdba740 1 --2- 172.21.15.7:0/1406141516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621ff22e590 0x5621ff254aa0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f0d94056860 tx=0x7f0d940092c0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.951+0000 7f0dabdba740 1 -- 172.21.15.7:0/1406141516 shutdown_connections 2024-04-25T10:01:20.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.951+0000 7f0dabdba740 1 --2- 172.21.15.7:0/1406141516 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x5621ff25bcb0 0x5621ff291550 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.951+0000 7f0dabdba740 1 --2- 172.21.15.7:0/1406141516 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621ff26ac60 0x5621ff254170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.951+0000 7f0dabdba740 1 --2- 172.21.15.7:0/1406141516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621ff259050 0x5621ff274300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.951+0000 7f0d81ffb640 0 client.7881 ms_handle_reset on v2:172.21.15.7:6836/3829085443 2024-04-25T10:01:20.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.951+0000 7f0dabdba740 1 --2- 172.21.15.7:0/1406141516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621ff22e590 0x5621ff254aa0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.951+0000 7f0dabdba740 1 -- 172.21.15.7:0/1406141516 >> 172.21.15.7:0/1406141516 conn(0x5621ff1f66e0 msgr2=0x5621ff22ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:20.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.951+0000 7f0dabdba740 1 -- 172.21.15.7:0/1406141516 shutdown_connections 2024-04-25T10:01:20.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.951+0000 7f0dabdba740 1 -- 172.21.15.7:0/1406141516 wait complete. 2024-04-25T10:01:20.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.952+0000 7f0dabdba740 20 client.7881 trim_cache size 0 max 16384 2024-04-25T10:01:20.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.963+0000 7f0dabdba740 1 Processor -- start 2024-04-25T10:01:20.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.963+0000 7f0dabdba740 1 -- start start 2024-04-25T10:01:20.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.964+0000 7f0dabdba740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621ff22e590 0x5621ff295690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.964+0000 7f0dabdba740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621ff259050 0x5621ff26e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.964+0000 7f0dabdba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621ff26ac60 0x5621ff26eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.964+0000 7f0dabdba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da41ff940 con 0x5621ff26ac60 2024-04-25T10:01:20.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.964+0000 7f0dabdba740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da406ddd0 con 0x5621ff22e590 2024-04-25T10:01:20.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.964+0000 7f0dabdba740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da41ff340 con 0x5621ff259050 2024-04-25T10:01:20.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.964+0000 7f0da359e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621ff26ac60 0x5621ff26eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.964+0000 7f0da359e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621ff26ac60 0x5621ff26eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38522/0 (socket says 172.21.15.7:38522) 2024-04-25T10:01:20.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.964+0000 7f0da359e640 1 -- 172.21.15.7:0/3683708716 learned_addr learned my addr 172.21.15.7:0/3683708716 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:20.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.964+0000 7f0da359e640 1 -- 172.21.15.7:0/3683708716 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621ff259050 msgr2=0x5621ff26e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:20.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.964+0000 7f0da359e640 1 --2- 172.21.15.7:0/3683708716 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621ff259050 0x5621ff26e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.964+0000 7f0da359e640 1 -- 172.21.15.7:0/3683708716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621ff22e590 msgr2=0x5621ff295690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:20.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.964+0000 7f0da359e640 1 --2- 172.21.15.7:0/3683708716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621ff22e590 0x5621ff295690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.964+0000 7f0da359e640 1 -- 172.21.15.7:0/3683708716 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621ff276eb0 con 0x5621ff26ac60 2024-04-25T10:01:20.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.964+0000 7f0da359e640 1 --2- 172.21.15.7:0/3683708716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621ff26ac60 0x5621ff26eb40 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c007fd0 tx=0x7f0d9c00f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=825dee123ffc5878 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:20.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.965+0000 7f0d83fff640 1 -- 172.21.15.7:0/3683708716 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c003ba0 con 0x5621ff26ac60 2024-04-25T10:01:20.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.965+0000 7f0d83fff640 1 -- 172.21.15.7:0/3683708716 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9c003d40 con 0x5621ff26ac60 2024-04-25T10:01:20.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.965+0000 7f0d83fff640 1 -- 172.21.15.7:0/3683708716 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c004230 con 0x5621ff26ac60 2024-04-25T10:01:20.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.965+0000 7f0dabdba740 1 -- 172.21.15.7:0/3683708716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621ff26ac60 msgr2=0x5621ff26eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:20.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.965+0000 7f0dabdba740 1 --2- 172.21.15.7:0/3683708716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621ff26ac60 0x5621ff26eb40 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c007fd0 tx=0x7f0d9c00f890 comp rx=0 tx=0).stop 2024-04-25T10:01:20.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.965+0000 7f0dabdba740 1 -- 172.21.15.7:0/3683708716 shutdown_connections 2024-04-25T10:01:20.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.965+0000 7f0dabdba740 1 --2- 172.21.15.7:0/3683708716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621ff26ac60 0x5621ff26eb40 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.965+0000 7f0dabdba740 1 --2- 172.21.15.7:0/3683708716 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621ff259050 0x5621ff26e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.965+0000 7f0dabdba740 1 --2- 172.21.15.7:0/3683708716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621ff22e590 0x5621ff295690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.965+0000 7f0dabdba740 1 -- 172.21.15.7:0/3683708716 >> 172.21.15.7:0/3683708716 conn(0x5621ff1f66e0 msgr2=0x5621ff254a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:20.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.965+0000 7f0dabdba740 1 -- 172.21.15.7:0/3683708716 shutdown_connections 2024-04-25T10:01:20.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.965+0000 7f0dabdba740 1 -- 172.21.15.7:0/3683708716 wait complete. 2024-04-25T10:01:20.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.966+0000 7f0dabdba740 1 -- start start 2024-04-25T10:01:20.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.966+0000 7f0dabdba740 1 Processor -- start 2024-04-25T10:01:20.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.966+0000 7f0dabdba740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621ff22e590 0x5621ff2d8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.966+0000 7f0dabdba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621ff259050 0x5621ff25ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.966+0000 7f0dabdba740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621ff26ac60 0x5621ff2de6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.966+0000 7f0dabdba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621ff12e840 con 0x5621ff259050 2024-04-25T10:01:20.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.966+0000 7f0dabdba740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621ff2749c0 con 0x5621ff22e590 2024-04-25T10:01:20.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.966+0000 7f0dabdba740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5621ff256ba0 con 0x5621ff26ac60 2024-04-25T10:01:20.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.967+0000 7f0dabdba740 10 client.0 _ll_register_callbacks cb 0x7f0d94058400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:01:20.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.967+0000 7f0da259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621ff259050 0x5621ff25ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.967+0000 7f0da259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621ff259050 0x5621ff25ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38524/0 (socket says 172.21.15.7:38524) 2024-04-25T10:01:20.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.967+0000 7f0da259c640 1 -- 172.21.15.7:0/2282647304 learned_addr learned my addr 172.21.15.7:0/2282647304 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:20.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.967+0000 7f0da259c640 1 -- 172.21.15.7:0/2282647304 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621ff26ac60 msgr2=0x5621ff2de6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:20.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.967+0000 7f0da259c640 1 --2- 172.21.15.7:0/2282647304 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621ff26ac60 0x5621ff2de6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.967+0000 7f0da259c640 1 -- 172.21.15.7:0/2282647304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621ff22e590 msgr2=0x5621ff2d8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:20.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.967+0000 7f0da259c640 1 --2- 172.21.15.7:0/2282647304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621ff22e590 0x5621ff2d8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.967+0000 7f0da259c640 1 -- 172.21.15.7:0/2282647304 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621ff269c30 con 0x5621ff259050 2024-04-25T10:01:20.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.967+0000 7f0da259c640 1 --2- 172.21.15.7:0/2282647304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621ff259050 0x5621ff25ade0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f0d980090b0 tx=0x7f0d980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1efbe15ed92323e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:20.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.967+0000 7f0d81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:01:20.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.967+0000 7f0d81ffb640 1 -- 172.21.15.7:0/2282647304 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d98037040 con 0x5621ff259050 2024-04-25T10:01:20.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.967+0000 7f0d81ffb640 1 -- 172.21.15.7:0/2282647304 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f0d9804d360 con 0x5621ff259050 2024-04-25T10:01:20.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.967+0000 7f0dabdba740 1 -- 172.21.15.7:0/2282647304 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0d9c003d40 con 0x5621ff259050 2024-04-25T10:01:20.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.967+0000 7f0d81ffb640 1 -- 172.21.15.7:0/2282647304 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d9805c050 con 0x5621ff259050 2024-04-25T10:01:20.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.967+0000 7f0dabdba740 10 client.7887 fetch_fsmap learned FSMap version 60 2024-04-25T10:01:20.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.967+0000 7f0dabdba740 1 -- 172.21.15.7:0/2282647304 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x5621ff26a4d0 con 0x5621ff259050 2024-04-25T10:01:20.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.967+0000 7f0d81ffb640 1 -- 172.21.15.7:0/2282647304 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9c003d40 con 0x5621ff259050 2024-04-25T10:01:20.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.967+0000 7f0d81ffb640 1 -- 172.21.15.7:0/2282647304 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 60) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0d9805f020 con 0x5621ff259050 2024-04-25T10:01:20.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.967+0000 7f0dabdba740 10 client.7887 fetch_fsmap finished waiting for FSMap version 60 2024-04-25T10:01:20.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.967+0000 7f0dabdba740 10 client.7887 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:01:20.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.968+0000 7f0dabdba740 20 client.7887 populate_metadata read hostname 'smithi007' 2024-04-25T10:01:20.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.968+0000 7f0dabdba740 1 --2- 172.21.15.7:0/2282647304 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x5621ff26eca0 0x5621ff254a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:20.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.968+0000 7f0dabdba740 4 client.7887 mds_command: new command op to 7734 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T10:01:20.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.968+0000 7f0dabdba740 1 -- 172.21.15.7:0/2282647304 --> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x5621ff19f1a0 con 0x5621ff26eca0 2024-04-25T10:01:20.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.968+0000 7f0da2d9d640 1 --2- 172.21.15.7:0/2282647304 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x5621ff26eca0 0x5621ff254a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:20.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.968+0000 7f0d81ffb640 10 client.7887 ms_handle_connect on v2:172.21.15.7:6836/3829085443 2024-04-25T10:01:20.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.968+0000 7f0da2d9d640 1 --2- 172.21.15.7:0/2282647304 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x5621ff26eca0 0x5621ff254a40 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e03ea4c0e07f497 server_cookie=a9944f8ee997e779 in_seq=0 out_seq=0 2024-04-25T10:01:20.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.968+0000 7f0d81ffb640 1 -- 172.21.15.7:0/2282647304 <== mds.0 v2:172.21.15.7:6836/3829085443 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+420 (crc 0 0 0) 0x5621ff19f1a0 con 0x5621ff26eca0 2024-04-25T10:01:20.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.968+0000 7f0d81ffb640 10 client.7887 handle_command_reply: tid=0 2024-04-25T10:01:20.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.968+0000 7f0dabdba740 1 client.7887 shutdown 2024-04-25T10:01:20.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.968+0000 7f0dabdba740 1 -- 172.21.15.7:0/2282647304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621ff259050 msgr2=0x5621ff25ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:20.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.968+0000 7f0dabdba740 1 --2- 172.21.15.7:0/2282647304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621ff259050 0x5621ff25ade0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f0d980090b0 tx=0x7f0d980046c0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.968+0000 7f0dabdba740 1 -- 172.21.15.7:0/2282647304 shutdown_connections 2024-04-25T10:01:20.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.968+0000 7f0dabdba740 1 --2- 172.21.15.7:0/2282647304 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x5621ff26eca0 0x5621ff254a40 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.968+0000 7f0dabdba740 1 --2- 172.21.15.7:0/2282647304 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5621ff26ac60 0x5621ff2de6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.968+0000 7f0dabdba740 1 --2- 172.21.15.7:0/2282647304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621ff259050 0x5621ff25ade0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.968+0000 7f0dabdba740 1 --2- 172.21.15.7:0/2282647304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5621ff22e590 0x5621ff2d8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.968+0000 7f0d81ffb640 0 client.7887 ms_handle_reset on v2:172.21.15.7:6836/3829085443 2024-04-25T10:01:20.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.968+0000 7f0dabdba740 1 -- 172.21.15.7:0/2282647304 >> 172.21.15.7:0/2282647304 conn(0x5621ff1f66e0 msgr2=0x5621ff277b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:20.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.968+0000 7f0dabdba740 1 -- 172.21.15.7:0/2282647304 shutdown_connections 2024-04-25T10:01:20.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.968+0000 7f0dabdba740 1 -- 172.21.15.7:0/2282647304 wait complete. 2024-04-25T10:01:20.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.968+0000 7f0dabdba740 20 client.7887 trim_cache size 0 max 16384 2024-04-25T10:01:20.980 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:01:20.980 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2024-04-25T10:01:20.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:01:20.980 INFO:teuthology.orchestra.run.smithi007.stdout: "damage_type": "backtrace", 2024-04-25T10:01:20.980 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 1471494770, 2024-04-25T10:01:20.980 INFO:teuthology.orchestra.run.smithi007.stdout: "ino": 1099511627776, 2024-04-25T10:01:20.980 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/dir" 2024-04-25T10:01:20.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:01:20.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:01:20.980 INFO:teuthology.orchestra.run.smithi007.stdout: "damage_type": "backtrace", 2024-04-25T10:01:20.980 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 3039243795, 2024-04-25T10:01:20.980 INFO:teuthology.orchestra.run.smithi007.stdout: "ino": 1099511627777, 2024-04-25T10:01:20.981 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/testdir/hardlink" 2024-04-25T10:01:20.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:01:20.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:01:20.981 INFO:teuthology.orchestra.run.smithi007.stdout: "damage_type": "dir_frag", 2024-04-25T10:01:20.981 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 3866735752, 2024-04-25T10:01:20.981 INFO:teuthology.orchestra.run.smithi007.stdout: "ino": 1099511627776, 2024-04-25T10:01:20.981 INFO:teuthology.orchestra.run.smithi007.stdout: "frag": "*", 2024-04-25T10:01:20.981 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/dir" 2024-04-25T10:01:20.981 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:01:20.981 INFO:teuthology.orchestra.run.smithi007.stdout:] 2024-04-25T10:01:20.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.969+0000 7f0da90b3640 1 -- 172.21.15.7:0/1313661604 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0d9006b500 msgr2=0x7f0d9006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:20.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.969+0000 7f0da90b3640 1 --2- 172.21.15.7:0/1313661604 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0d9006b500 0x7f0d9006d9c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f0d98034000 tx=0x7f0d9802c000 comp rx=0 tx=0).stop 2024-04-25T10:01:20.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.969+0000 7f0da90b3640 1 -- 172.21.15.7:0/1313661604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0da406e950 msgr2=0x7f0da413f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:20.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.969+0000 7f0da90b3640 1 --2- 172.21.15.7:0/1313661604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0da406e950 0x7f0da413f750 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400b3f0 tx=0x7f0d9400b8b0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.969+0000 7f0da90b3640 1 -- 172.21.15.7:0/1313661604 shutdown_connections 2024-04-25T10:01:20.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.969+0000 7f0da90b3640 1 --2- 172.21.15.7:0/1313661604 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0d9006b500 0x7f0d9006d9c0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.969+0000 7f0da90b3640 1 --2- 172.21.15.7:0/1313661604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0da4143fb0 0x7f0da415a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.969+0000 7f0da90b3640 1 --2- 172.21.15.7:0/1313661604 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0da40ce610 0x7f0da41f7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.969+0000 7f0da90b3640 1 --2- 172.21.15.7:0/1313661604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0da406e950 0x7f0da413f750 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:20.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.969+0000 7f0da90b3640 1 -- 172.21.15.7:0/1313661604 >> 172.21.15.7:0/1313661604 conn(0x7f0da406ab60 msgr2=0x7f0da40af1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:20.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.969+0000 7f0da90b3640 1 -- 172.21.15.7:0/1313661604 shutdown_connections 2024-04-25T10:01:20.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:20.969+0000 7f0da90b3640 1 -- 172.21.15.7:0/1313661604 wait complete. 2024-04-25T10:01:20.984 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T10:01:21.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.079+0000 7fd03709c640 1 Processor -- start 2024-04-25T10:01:21.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.079+0000 7fd03709c640 1 -- start start 2024-04-25T10:01:21.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.080+0000 7fd03709c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd0300b3c40 0x7fd0300cece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.080+0000 7fd03709c640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0300cf350 con 0x7fd030143ed0 2024-04-25T10:01:21.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.080+0000 7fd03709c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0300b2e80 con 0x7fd03006e990 2024-04-25T10:01:21.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.080+0000 7fd03709c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0300b3160 con 0x7fd0300b3c40 2024-04-25T10:01:21.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.080+0000 7fd034e38640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd030143ed0 0x7fd03006e280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55184/0 (socket says 172.21.15.7:55184) 2024-04-25T10:01:21.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.080+0000 7fd034e38640 1 -- 172.21.15.7:0/3644560357 learned_addr learned my addr 172.21.15.7:0/3644560357 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:01:21.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.080+0000 7fd02f7fe640 1 -- 172.21.15.7:0/3644560357 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4195439622 0 0) 0x7fd0300cf350 con 0x7fd030143ed0 2024-04-25T10:01:21.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.080+0000 7fd02f7fe640 1 -- 172.21.15.7:0/3644560357 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd01c003520 con 0x7fd030143ed0 2024-04-25T10:01:21.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.080+0000 7fd035639640 1 --2- 172.21.15.7:0/3644560357 >> v2:172.21.15.55:3300/0 conn(0x7fd0300b3c40 0x7fd0300cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.081+0000 7fd02f7fe640 1 -- 172.21.15.7:0/3644560357 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1389074752 0 0) 0x7fd01c003520 con 0x7fd030143ed0 2024-04-25T10:01:21.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.081+0000 7fd02f7fe640 1 -- 172.21.15.7:0/3644560357 >> v2:172.21.15.55:3300/0 conn(0x7fd0300b3c40 msgr2=0x7fd0300cece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:21.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.081+0000 7fd02f7fe640 1 --2- 172.21.15.7:0/3644560357 >> v2:172.21.15.55:3300/0 conn(0x7fd0300b3c40 0x7fd0300cece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.081+0000 7fd02f7fe640 1 -- 172.21.15.7:0/3644560357 >> v1:172.21.15.55:6789/0 conn(0x7fd03006e990 legacy=0x7fd0300ce5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:21.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.081+0000 7fd02f7fe640 1 -- 172.21.15.7:0/3644560357 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0300b3440 con 0x7fd030143ed0 2024-04-25T10:01:21.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.081+0000 7fd02f7fe640 1 -- 172.21.15.7:0/3644560357 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fd0280019f0 con 0x7fd030143ed0 2024-04-25T10:01:21.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.081+0000 7fd02f7fe640 1 -- 172.21.15.7:0/3644560357 >> v1:172.21.15.7:6789/0 conn(0x7fd030143ed0 legacy=0x7fd03006e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:21.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.081+0000 7fd02f7fe640 1 --2- 172.21.15.7:0/3644560357 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd01c0039b0 0x7fd01c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.081+0000 7fd02f7fe640 1 --2- 172.21.15.7:0/3644560357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd01c004800 0x7fd01c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.081+0000 7fd02f7fe640 1 --2- 172.21.15.7:0/3644560357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd01c0051c0 0x7fd01c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.081+0000 7fd02f7fe640 1 -- 172.21.15.7:0/3644560357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0300b3160 con 0x7fd01c004800 2024-04-25T10:01:21.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.081+0000 7fd02f7fe640 1 -- 172.21.15.7:0/3644560357 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c00c160 con 0x7fd01c0051c0 2024-04-25T10:01:21.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.081+0000 7fd02f7fe640 1 -- 172.21.15.7:0/3644560357 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c00c360 con 0x7fd01c0039b0 2024-04-25T10:01:21.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.081+0000 7fd02ffff640 1 --2- 172.21.15.7:0/3644560357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd01c004800 0x7fd01c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.081+0000 7fd034e38640 1 --2- 172.21.15.7:0/3644560357 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd01c0039b0 0x7fd01c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.081+0000 7fd035639640 1 --2- 172.21.15.7:0/3644560357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd01c0051c0 0x7fd01c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.081+0000 7fd02ffff640 1 -- 172.21.15.7:0/3644560357 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd01c0039b0 msgr2=0x7fd01c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:21.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.081+0000 7fd02ffff640 1 --2- 172.21.15.7:0/3644560357 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd01c0039b0 0x7fd01c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.081+0000 7fd02ffff640 1 -- 172.21.15.7:0/3644560357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd01c0051c0 msgr2=0x7fd01c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:21.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.081+0000 7fd02ffff640 1 --2- 172.21.15.7:0/3644560357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd01c0051c0 0x7fd01c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.081+0000 7fd02ffff640 1 -- 172.21.15.7:0/3644560357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01c003520 con 0x7fd01c004800 2024-04-25T10:01:21.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.081+0000 7fd035639640 1 -- 172.21.15.7:0/3644560357 reap_dead start 2024-04-25T10:01:21.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.082+0000 7fd02ffff640 1 --2- 172.21.15.7:0/3644560357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd01c004800 0x7fd01c004c80 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fd018001750 tx=0x7fd01c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c451fc6c33e19515 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:21.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.082+0000 7fd02f7fe640 1 -- 172.21.15.7:0/3644560357 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd018001370 con 0x7fd01c004800 2024-04-25T10:01:21.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.082+0000 7fd02f7fe640 1 -- 172.21.15.7:0/3644560357 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0180052d0 con 0x7fd01c004800 2024-04-25T10:01:21.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.082+0000 7fd02f7fe640 1 -- 172.21.15.7:0/3644560357 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01802abc0 con 0x7fd01c004800 2024-04-25T10:01:21.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.082+0000 7fd03709c640 1 -- 172.21.15.7:0/3644560357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd01c004800 msgr2=0x7fd01c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:21.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.082+0000 7fd03709c640 1 --2- 172.21.15.7:0/3644560357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd01c004800 0x7fd01c004c80 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fd018001750 tx=0x7fd01c005830 comp rx=0 tx=0).stop 2024-04-25T10:01:21.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.083+0000 7fd03709c640 1 -- 172.21.15.7:0/3644560357 shutdown_connections 2024-04-25T10:01:21.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.083+0000 7fd03709c640 1 --2- 172.21.15.7:0/3644560357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd01c004800 0x7fd01c004c80 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.083+0000 7fd03709c640 1 -- 172.21.15.7:0/3644560357 >> 172.21.15.7:0/3644560357 conn(0x7fd03006ab60 msgr2=0x7fd03006af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:21.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.083+0000 7fd03709c640 1 -- 172.21.15.7:0/3644560357 shutdown_connections 2024-04-25T10:01:21.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.083+0000 7fd03709c640 1 -- 172.21.15.7:0/3644560357 wait complete. 2024-04-25T10:01:21.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.084+0000 7fd03709c640 1 Processor -- start 2024-04-25T10:01:21.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.084+0000 7fd03709c640 1 -- start start 2024-04-25T10:01:21.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.085+0000 7fd03709c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd01c004800 0x7fd0301571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.085+0000 7fd03709c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd030135600 0x7fd030135a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.085+0000 7fd03709c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd03015d330 0x7fd03015d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.085+0000 7fd03709c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd030144430 con 0x7fd030135600 2024-04-25T10:01:21.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.085+0000 7fd03709c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0301442b0 con 0x7fd01c004800 2024-04-25T10:01:21.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.085+0000 7fd03709c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0300ce5d0 con 0x7fd03015d330 2024-04-25T10:01:21.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.085+0000 7fd02ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd030135600 0x7fd030135a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.085+0000 7fd02ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd030135600 0x7fd030135a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38536/0 (socket says 172.21.15.7:38536) 2024-04-25T10:01:21.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.085+0000 7fd02ffff640 1 -- 172.21.15.7:0/3218158398 learned_addr learned my addr 172.21.15.7:0/3218158398 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:21.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.085+0000 7fd034e38640 1 --2- 172.21.15.7:0/3218158398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd01c004800 0x7fd0301571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.085+0000 7fd035639640 1 --2- 172.21.15.7:0/3218158398 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd03015d330 0x7fd03015d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.085+0000 7fd02ffff640 1 -- 172.21.15.7:0/3218158398 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd03015d330 msgr2=0x7fd03015d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:21.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.085+0000 7fd02ffff640 1 --2- 172.21.15.7:0/3218158398 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd03015d330 0x7fd03015d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.085+0000 7fd02ffff640 1 -- 172.21.15.7:0/3218158398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd01c004800 msgr2=0x7fd0301571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:21.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.085+0000 7fd02ffff640 1 --2- 172.21.15.7:0/3218158398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd01c004800 0x7fd0301571d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.085+0000 7fd02ffff640 1 -- 172.21.15.7:0/3218158398 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03015c290 con 0x7fd030135600 2024-04-25T10:01:21.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.085+0000 7fd02ffff640 1 --2- 172.21.15.7:0/3218158398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd030135600 0x7fd030135a60 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fd018005040 tx=0x7fd018001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:21.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.085+0000 7fd02d7fa640 1 -- 172.21.15.7:0/3218158398 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd018037040 con 0x7fd030135600 2024-04-25T10:01:21.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.085+0000 7fd02d7fa640 1 -- 172.21.15.7:0/3218158398 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd018005480 con 0x7fd030135600 2024-04-25T10:01:21.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.086+0000 7fd03709c640 1 -- 172.21.15.7:0/3218158398 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd03015c570 con 0x7fd030135600 2024-04-25T10:01:21.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.086+0000 7fd02d7fa640 1 -- 172.21.15.7:0/3218158398 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd018007a30 con 0x7fd030135600 2024-04-25T10:01:21.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.086+0000 7fd03709c640 1 -- 172.21.15.7:0/3218158398 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd03015cb30 con 0x7fd030135600 2024-04-25T10:01:21.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.087+0000 7fd03709c640 1 -- 172.21.15.7:0/3218158398 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd030074bb0 con 0x7fd030135600 2024-04-25T10:01:21.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.087+0000 7fd02d7fa640 1 -- 172.21.15.7:0/3218158398 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd018044020 con 0x7fd030135600 2024-04-25T10:01:21.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.087+0000 7fd02d7fa640 1 --2- 172.21.15.7:0/3218158398 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd01006b4d0 0x7fd01006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.088+0000 7fd02d7fa640 1 -- 172.21.15.7:0/3218158398 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6303+0+0 (secure 0 0 0) 0x7fd0180a9fe0 con 0x7fd030135600 2024-04-25T10:01:21.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.088+0000 7fd034e38640 1 --2- 172.21.15.7:0/3218158398 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd01006b4d0 0x7fd01006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.088+0000 7fd034e38640 1 --2- 172.21.15.7:0/3218158398 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd01006b4d0 0x7fd01006d990 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd028004d00 tx=0x7fd028006040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:21.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.092+0000 7fd02d7fa640 1 -- 172.21.15.7:0/3218158398 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd018078b80 con 0x7fd030135600 2024-04-25T10:01:21.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.310+0000 7fd03709c640 1 -- 172.21.15.7:0/3218158398 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd030138cc0 con 0x7fd030135600 2024-04-25T10:01:21.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.310+0000 7fd02d7fa640 1 -- 172.21.15.7:0/3218158398 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7fd018078480 con 0x7fd030135600 2024-04-25T10:01:21.315 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:01:21.315 INFO:teuthology.orchestra.run.smithi007.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-04-25T10:01:21.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.312+0000 7fd03709c640 1 -- 172.21.15.7:0/3218158398 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd01006b4d0 msgr2=0x7fd01006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:21.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.312+0000 7fd03709c640 1 --2- 172.21.15.7:0/3218158398 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd01006b4d0 0x7fd01006d990 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd028004d00 tx=0x7fd028006040 comp rx=0 tx=0).stop 2024-04-25T10:01:21.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.312+0000 7fd03709c640 1 -- 172.21.15.7:0/3218158398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd030135600 msgr2=0x7fd030135a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:21.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.312+0000 7fd03709c640 1 --2- 172.21.15.7:0/3218158398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd030135600 0x7fd030135a60 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fd018005040 tx=0x7fd018001120 comp rx=0 tx=0).stop 2024-04-25T10:01:21.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.312+0000 7fd03709c640 1 -- 172.21.15.7:0/3218158398 shutdown_connections 2024-04-25T10:01:21.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.312+0000 7fd03709c640 1 --2- 172.21.15.7:0/3218158398 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd01006b4d0 0x7fd01006d990 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.312+0000 7fd03709c640 1 --2- 172.21.15.7:0/3218158398 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd03015d330 0x7fd03015d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.312+0000 7fd03709c640 1 --2- 172.21.15.7:0/3218158398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd030135600 0x7fd030135a60 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.312+0000 7fd03709c640 1 --2- 172.21.15.7:0/3218158398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd01c004800 0x7fd0301571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.312+0000 7fd03709c640 1 -- 172.21.15.7:0/3218158398 >> 172.21.15.7:0/3218158398 conn(0x7fd03006ab60 msgr2=0x7fd03013ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:21.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.312+0000 7fd03709c640 1 -- 172.21.15.7:0/3218158398 shutdown_connections 2024-04-25T10:01:21.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.312+0000 7fd03709c640 1 -- 172.21.15.7:0/3218158398 wait complete. 2024-04-25T10:01:21.330 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T10:01:21.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:01:21.330 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive,repair 2024-04-25T10:01:21.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.430+0000 7f3050363640 1 Processor -- start 2024-04-25T10:01:21.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.430+0000 7f3050363640 1 -- start start 2024-04-25T10:01:21.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.431+0000 7f3050363640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f30480d3330 0x7f30480d3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.431+0000 7f3050363640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30480d2290 con 0x7f30480b9290 2024-04-25T10:01:21.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.431+0000 7f3050363640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30480d2570 con 0x7f304815de70 2024-04-25T10:01:21.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.431+0000 7f3050363640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30480d2030 con 0x7f30480d3330 2024-04-25T10:01:21.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.431+0000 7f304d8fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f30480d3330 0x7f30480d3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.431+0000 7f304d8fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f30480d3330 0x7f30480d3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38538/0 (socket says 172.21.15.7:38538) 2024-04-25T10:01:21.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.431+0000 7f304e900640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f30480b9290 0x7f30480b6a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55196/0 (socket says 172.21.15.7:55196) 2024-04-25T10:01:21.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.431+0000 7f304d8fe640 1 -- 172.21.15.7:0/3051397083 learned_addr learned my addr 172.21.15.7:0/3051397083 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:21.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.432+0000 7f304d8fe640 1 -- 172.21.15.7:0/3051397083 >> v1:172.21.15.55:6789/0 conn(0x7f304815de70 legacy=0x7f30480d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:21.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.432+0000 7f304d8fe640 1 -- 172.21.15.7:0/3051397083 >> v1:172.21.15.7:6789/0 conn(0x7f30480b9290 legacy=0x7f30480b6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:21.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.432+0000 7f304d8fe640 1 -- 172.21.15.7:0/3051397083 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30480d2850 con 0x7f30480d3330 2024-04-25T10:01:21.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.432+0000 7f304d0fd640 1 -- 172.21.15.7:0/3051397083 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2661873454 0 0) 0x7f30480d2290 con 0x7f30480b9290 2024-04-25T10:01:21.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.432+0000 7f304d8fe640 1 --2- 172.21.15.7:0/3051397083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30480d3330 0x7f30480d3800 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f303c009870 tx=0x7f303c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c743594110afda server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:21.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.433+0000 7f304d0fd640 1 -- 172.21.15.7:0/3051397083 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c037070 con 0x7f30480d3330 2024-04-25T10:01:21.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.433+0000 7f304d0fd640 1 -- 172.21.15.7:0/3051397083 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303c02ae50 con 0x7f30480d3330 2024-04-25T10:01:21.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.433+0000 7f304d0fd640 1 -- 172.21.15.7:0/3051397083 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c032860 con 0x7f30480d3330 2024-04-25T10:01:21.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.433+0000 7f3050363640 1 -- 172.21.15.7:0/3051397083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30480d3330 msgr2=0x7f30480d3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:21.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.433+0000 7f3050363640 1 --2- 172.21.15.7:0/3051397083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30480d3330 0x7f30480d3800 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f303c009870 tx=0x7f303c02a300 comp rx=0 tx=0).stop 2024-04-25T10:01:21.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.433+0000 7f3050363640 1 -- 172.21.15.7:0/3051397083 shutdown_connections 2024-04-25T10:01:21.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.433+0000 7f3050363640 1 --2- 172.21.15.7:0/3051397083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30480d3330 0x7f30480d3800 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.433+0000 7f3050363640 1 -- 172.21.15.7:0/3051397083 >> 172.21.15.7:0/3051397083 conn(0x7f30480726b0 msgr2=0x7f3048072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:21.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.433+0000 7f3050363640 1 -- 172.21.15.7:0/3051397083 shutdown_connections 2024-04-25T10:01:21.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.433+0000 7f3050363640 1 -- 172.21.15.7:0/3051397083 wait complete. 2024-04-25T10:01:21.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.434+0000 7f3050363640 1 Processor -- start 2024-04-25T10:01:21.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.435+0000 7f3050363640 1 -- start start 2024-04-25T10:01:21.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.435+0000 7f3050363640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30480b9290 0x7f30481f69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.435+0000 7f3050363640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30480d3330 0x7f304815e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.435+0000 7f3050363640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f304815de70 0x7f304815e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.435+0000 7f3050363640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30480d3d40 con 0x7f30480b9290 2024-04-25T10:01:21.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.435+0000 7f3050363640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30480d2e10 con 0x7f30480d3330 2024-04-25T10:01:21.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.435+0000 7f3050363640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30480d3ec0 con 0x7f304815de70 2024-04-25T10:01:21.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.435+0000 7f304e0ff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30480b9290 0x7f30481f69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.435+0000 7f304e0ff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30480b9290 0x7f30481f69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38542/0 (socket says 172.21.15.7:38542) 2024-04-25T10:01:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.435+0000 7f304e0ff640 1 -- 172.21.15.7:0/3788708291 learned_addr learned my addr 172.21.15.7:0/3788708291 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.436+0000 7f304e900640 1 --2- 172.21.15.7:0/3788708291 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f304815de70 0x7f304815e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.436+0000 7f304d8fe640 1 --2- 172.21.15.7:0/3788708291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30480d3330 0x7f304815e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.436+0000 7f304e0ff640 1 -- 172.21.15.7:0/3788708291 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f304815de70 msgr2=0x7f304815e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.436+0000 7f304e0ff640 1 --2- 172.21.15.7:0/3788708291 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f304815de70 0x7f304815e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.436+0000 7f304e0ff640 1 -- 172.21.15.7:0/3788708291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30480d3330 msgr2=0x7f304815e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.436+0000 7f304e0ff640 1 --2- 172.21.15.7:0/3788708291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30480d3330 0x7f304815e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.436+0000 7f304e0ff640 1 -- 172.21.15.7:0/3788708291 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30480c9ba0 con 0x7f30480b9290 2024-04-25T10:01:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.436+0000 7f304d8fe640 1 --2- 172.21.15.7:0/3788708291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30480d3330 0x7f304815e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:01:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.436+0000 7f304e0ff640 1 --2- 172.21.15.7:0/3788708291 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30480b9290 0x7f30481f69d0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f304000c400 tx=0x7f304000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.436+0000 7f3046ffd640 1 -- 172.21.15.7:0/3788708291 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3040017070 con 0x7f30480b9290 2024-04-25T10:01:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.436+0000 7f3046ffd640 1 -- 172.21.15.7:0/3788708291 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30400052d0 con 0x7f30480b9290 2024-04-25T10:01:21.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.436+0000 7f3046ffd640 1 -- 172.21.15.7:0/3788708291 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3040003830 con 0x7f30480b9290 2024-04-25T10:01:21.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.436+0000 7f3050363640 1 -- 172.21.15.7:0/3788708291 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30480c9300 con 0x7f30480b9290 2024-04-25T10:01:21.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.436+0000 7f3050363640 1 -- 172.21.15.7:0/3788708291 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30480c98c0 con 0x7f30480b9290 2024-04-25T10:01:21.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.438+0000 7f3046ffd640 1 -- 172.21.15.7:0/3788708291 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f304001a070 con 0x7f30480b9290 2024-04-25T10:01:21.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.438+0000 7f3046ffd640 1 --2- 172.21.15.7:0/3788708291 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f303406b500 0x7f303406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.438+0000 7f3046ffd640 1 -- 172.21.15.7:0/3788708291 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f30400896c0 con 0x7f30480b9290 2024-04-25T10:01:21.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.438+0000 7f304d8fe640 1 --2- 172.21.15.7:0/3788708291 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f303406b500 0x7f303406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.439+0000 7f304d8fe640 1 --2- 172.21.15.7:0/3788708291 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f303406b500 0x7f303406d9c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f303c034000 tx=0x7f303c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:21.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.439+0000 7f305306d740 1 Processor -- start 2024-04-25T10:01:21.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.439+0000 7f305306d740 1 -- start start 2024-04-25T10:01:21.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.440+0000 7f305306d740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557ecde35bb0 0x557ecde35f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.440+0000 7f305306d740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557ecde30830 0x557ecde347b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.440+0000 7f305306d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ecde34cf0 0x557ecde35130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.440+0000 7f305306d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ecdd99ac0 con 0x557ecde34cf0 2024-04-25T10:01:21.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.440+0000 7f305306d740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ecdd42d80 con 0x557ecde35bb0 2024-04-25T10:01:21.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.440+0000 7f305306d740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ecdd95b60 con 0x557ecde30830 2024-04-25T10:01:21.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.440+0000 7f304e900640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ecde34cf0 0x557ecde35130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.440+0000 7f304e900640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ecde34cf0 0x557ecde35130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38546/0 (socket says 172.21.15.7:38546) 2024-04-25T10:01:21.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.440+0000 7f304e900640 1 -- 172.21.15.7:0/565673627 learned_addr learned my addr 172.21.15.7:0/565673627 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:21.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.440+0000 7f304d8fe640 1 --2- 172.21.15.7:0/565673627 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557ecde30830 0x557ecde347b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.440+0000 7f304e0ff640 1 --2- 172.21.15.7:0/565673627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557ecde35bb0 0x557ecde35f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.440+0000 7f304e900640 1 -- 172.21.15.7:0/565673627 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557ecde30830 msgr2=0x557ecde347b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:21.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.440+0000 7f304e900640 1 --2- 172.21.15.7:0/565673627 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557ecde30830 0x557ecde347b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.440+0000 7f304e900640 1 -- 172.21.15.7:0/565673627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557ecde35bb0 msgr2=0x557ecde35f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:21.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.440+0000 7f304e900640 1 --2- 172.21.15.7:0/565673627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557ecde35bb0 0x557ecde35f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.440+0000 7f304e900640 1 -- 172.21.15.7:0/565673627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ecdb767e0 con 0x557ecde34cf0 2024-04-25T10:01:21.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.440+0000 7f304e900640 1 --2- 172.21.15.7:0/565673627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ecde34cf0 0x557ecde35130 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f30380072b0 tx=0x7f3038007770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=376929a454b5f330 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:21.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.441+0000 7f302ffff640 1 -- 172.21.15.7:0/565673627 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3038019070 con 0x557ecde34cf0 2024-04-25T10:01:21.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.441+0000 7f302ffff640 1 -- 172.21.15.7:0/565673627 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30380079c0 con 0x557ecde34cf0 2024-04-25T10:01:21.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.441+0000 7f302ffff640 1 -- 172.21.15.7:0/565673627 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3038001c10 con 0x557ecde34cf0 2024-04-25T10:01:21.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.441+0000 7f305306d740 1 -- 172.21.15.7:0/565673627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ecde34cf0 msgr2=0x557ecde35130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:21.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.441+0000 7f305306d740 1 --2- 172.21.15.7:0/565673627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ecde34cf0 0x557ecde35130 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f30380072b0 tx=0x7f3038007770 comp rx=0 tx=0).stop 2024-04-25T10:01:21.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.441+0000 7f305306d740 1 -- 172.21.15.7:0/565673627 shutdown_connections 2024-04-25T10:01:21.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.441+0000 7f305306d740 1 --2- 172.21.15.7:0/565673627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ecde34cf0 0x557ecde35130 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.441+0000 7f305306d740 1 --2- 172.21.15.7:0/565673627 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557ecde30830 0x557ecde347b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.441+0000 7f305306d740 1 --2- 172.21.15.7:0/565673627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557ecde35bb0 0x557ecde35f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.441+0000 7f305306d740 1 -- 172.21.15.7:0/565673627 >> 172.21.15.7:0/565673627 conn(0x557ecde32cb0 msgr2=0x557ecde7b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:21.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.441+0000 7f305306d740 1 -- 172.21.15.7:0/565673627 shutdown_connections 2024-04-25T10:01:21.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.441+0000 7f305306d740 1 -- 172.21.15.7:0/565673627 wait complete. 2024-04-25T10:01:21.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.442+0000 7f305306d740 1 -- start start 2024-04-25T10:01:21.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.442+0000 7f305306d740 1 Processor -- start 2024-04-25T10:01:21.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.443+0000 7f305306d740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557ecde34cf0 0x557ecde7f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.443+0000 7f305306d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ecde35bb0 0x557ecde4c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.443+0000 7f305306d740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557ecde4d810 0x557ecde502c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.443+0000 7f305306d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ecde61740 con 0x557ecde35bb0 2024-04-25T10:01:21.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.443+0000 7f305306d740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ecdd38530 con 0x557ecde4d810 2024-04-25T10:01:21.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.443+0000 7f305306d740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ecde60bc0 con 0x557ecde34cf0 2024-04-25T10:01:21.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.443+0000 7f305306d740 10 client.0 _ll_register_callbacks cb 0x557ecdd90130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:01:21.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.443+0000 7f304d8fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ecde35bb0 0x557ecde4c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.443+0000 7f304d8fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ecde35bb0 0x557ecde4c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38552/0 (socket says 172.21.15.7:38552) 2024-04-25T10:01:21.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.443+0000 7f304d8fe640 1 -- 172.21.15.7:0/925485417 learned_addr learned my addr 172.21.15.7:0/925485417 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:21.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.443+0000 7f304e0ff640 1 --2- 172.21.15.7:0/925485417 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557ecde34cf0 0x557ecde7f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.443+0000 7f304e900640 1 --2- 172.21.15.7:0/925485417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557ecde4d810 0x557ecde502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.443+0000 7f304d8fe640 1 -- 172.21.15.7:0/925485417 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557ecde34cf0 msgr2=0x557ecde7f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:21.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.443+0000 7f304d8fe640 1 --2- 172.21.15.7:0/925485417 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557ecde34cf0 0x557ecde7f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.443+0000 7f304d8fe640 1 -- 172.21.15.7:0/925485417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557ecde4d810 msgr2=0x557ecde502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:21.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.443+0000 7f304d8fe640 1 --2- 172.21.15.7:0/925485417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557ecde4d810 0x557ecde502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.443+0000 7f304d8fe640 1 -- 172.21.15.7:0/925485417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557ecdbd6f70 con 0x557ecde35bb0 2024-04-25T10:01:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.443+0000 7f304d8fe640 1 --2- 172.21.15.7:0/925485417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ecde35bb0 0x557ecde4c6c0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f303c0090b0 tx=0x7f303c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ace81466bdef6a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.443+0000 7f302d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:01:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.444+0000 7f302d7fa640 1 -- 172.21.15.7:0/925485417 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c050060 con 0x557ecde35bb0 2024-04-25T10:01:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.444+0000 7f302d7fa640 1 -- 172.21.15.7:0/925485417 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f303c03ee00 con 0x557ecde35bb0 2024-04-25T10:01:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.444+0000 7f305306d740 1 -- 172.21.15.7:0/925485417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f30380079c0 con 0x557ecde35bb0 2024-04-25T10:01:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.444+0000 7f302d7fa640 1 -- 172.21.15.7:0/925485417 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f303c056050 con 0x557ecde35bb0 2024-04-25T10:01:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.444+0000 7f305306d740 10 client.7908 fetch_fsmap learned FSMap version 60 2024-04-25T10:01:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.444+0000 7f305306d740 1 -- 172.21.15.7:0/925485417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x557ecda6e170 con 0x557ecde35bb0 2024-04-25T10:01:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.444+0000 7f302d7fa640 1 -- 172.21.15.7:0/925485417 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30380079c0 con 0x557ecde35bb0 2024-04-25T10:01:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.444+0000 7f302d7fa640 1 -- 172.21.15.7:0/925485417 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 60) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f303c059020 con 0x557ecde35bb0 2024-04-25T10:01:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.444+0000 7f305306d740 10 client.7908 fetch_fsmap finished waiting for FSMap version 60 2024-04-25T10:01:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.444+0000 7f305306d740 10 client.7908 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T10:01:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.444+0000 7f305306d740 20 client.7908 populate_metadata read hostname 'smithi007' 2024-04-25T10:01:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.444+0000 7f305306d740 1 --2- 172.21.15.7:0/925485417 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x557ecde8ee60 0x557ecde8f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.444+0000 7f305306d740 4 client.7908 mds_command: new command op to 7734 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:01:21.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.444+0000 7f305306d740 1 -- 172.21.15.7:0/925485417 --> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557ecdda7000 con 0x557ecde8ee60 2024-04-25T10:01:21.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.444+0000 7f304e0ff640 1 --2- 172.21.15.7:0/925485417 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x557ecde8ee60 0x557ecde8f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.444+0000 7f304e0ff640 1 --2- 172.21.15.7:0/925485417 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x557ecde8ee60 0x557ecde8f270 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b06031f435610ea3 server_cookie=2665ca51aff4dabe in_seq=0 out_seq=0 2024-04-25T10:01:21.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.445+0000 7f302d7fa640 10 client.7908 ms_handle_connect on v2:172.21.15.7:6836/3829085443 2024-04-25T10:01:21.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.445+0000 7f302d7fa640 1 -- 172.21.15.7:0/925485417 <== mds.0 v2:172.21.15.7:6836/3829085443 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557ecdda7000 con 0x557ecde8ee60 2024-04-25T10:01:21.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.445+0000 7f302d7fa640 10 client.7908 handle_command_reply: tid=0 2024-04-25T10:01:21.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.445+0000 7f305306d740 1 client.7908 shutdown 2024-04-25T10:01:21.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.445+0000 7f305306d740 1 -- 172.21.15.7:0/925485417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ecde35bb0 msgr2=0x557ecde4c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:21.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.445+0000 7f305306d740 1 --2- 172.21.15.7:0/925485417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ecde35bb0 0x557ecde4c6c0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f303c0090b0 tx=0x7f303c02c000 comp rx=0 tx=0).stop 2024-04-25T10:01:21.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.445+0000 7f305306d740 1 -- 172.21.15.7:0/925485417 shutdown_connections 2024-04-25T10:01:21.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.445+0000 7f305306d740 1 --2- 172.21.15.7:0/925485417 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x557ecde8ee60 0x557ecde8f270 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.445+0000 7f305306d740 1 --2- 172.21.15.7:0/925485417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557ecde4d810 0x557ecde502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.445+0000 7f305306d740 1 --2- 172.21.15.7:0/925485417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ecde35bb0 0x557ecde4c6c0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.445+0000 7f302d7fa640 0 client.7908 ms_handle_reset on v2:172.21.15.7:6836/3829085443 2024-04-25T10:01:21.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.445+0000 7f305306d740 1 --2- 172.21.15.7:0/925485417 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557ecde34cf0 0x557ecde7f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.445+0000 7f305306d740 1 -- 172.21.15.7:0/925485417 >> 172.21.15.7:0/925485417 conn(0x557ecde30830 msgr2=0x557ecde2ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:21.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.445+0000 7f305306d740 1 -- 172.21.15.7:0/925485417 shutdown_connections 2024-04-25T10:01:21.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.445+0000 7f305306d740 1 -- 172.21.15.7:0/925485417 wait complete. 2024-04-25T10:01:21.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.445+0000 7f305306d740 20 client.7908 trim_cache size 0 max 16384 2024-04-25T10:01:21.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.461+0000 7f305306d740 1 Processor -- start 2024-04-25T10:01:21.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.461+0000 7f305306d740 1 -- start start 2024-04-25T10:01:21.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.461+0000 7f305306d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ecde34cf0 0x557ecde2be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.461+0000 7f305306d740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557ecde35bb0 0x557ecde9e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.461+0000 7f305306d740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557ecde4d810 0x557ecde8de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.461+0000 7f305306d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30482003d0 con 0x557ecde34cf0 2024-04-25T10:01:21.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.461+0000 7f305306d740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30481ff550 con 0x557ecde4d810 2024-04-25T10:01:21.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.461+0000 7f305306d740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3048157c00 con 0x557ecde35bb0 2024-04-25T10:01:21.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.461+0000 7f304e0ff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ecde34cf0 0x557ecde2be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.461+0000 7f304e0ff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ecde34cf0 0x557ecde2be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38568/0 (socket says 172.21.15.7:38568) 2024-04-25T10:01:21.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.461+0000 7f304e0ff640 1 -- 172.21.15.7:0/1881669187 learned_addr learned my addr 172.21.15.7:0/1881669187 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:21.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.462+0000 7f304e0ff640 1 -- 172.21.15.7:0/1881669187 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557ecde35bb0 msgr2=0x557ecde9e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:21.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.462+0000 7f304e0ff640 1 --2- 172.21.15.7:0/1881669187 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557ecde35bb0 0x557ecde9e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.462+0000 7f304e0ff640 1 -- 172.21.15.7:0/1881669187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557ecde4d810 msgr2=0x557ecde8de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:21.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.462+0000 7f304e0ff640 1 --2- 172.21.15.7:0/1881669187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557ecde4d810 0x557ecde8de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.462+0000 7f304e0ff640 1 -- 172.21.15.7:0/1881669187 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ecde8f8a0 con 0x557ecde34cf0 2024-04-25T10:01:21.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.462+0000 7f304e0ff640 1 --2- 172.21.15.7:0/1881669187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ecde34cf0 0x557ecde2be60 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f3040057980 tx=0x7f3040001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a822b6a35d80edc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:21.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.462+0000 7f302f7fe640 1 -- 172.21.15.7:0/1881669187 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3040060390 con 0x557ecde34cf0 2024-04-25T10:01:21.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.462+0000 7f302f7fe640 1 -- 172.21.15.7:0/1881669187 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3040055d20 con 0x557ecde34cf0 2024-04-25T10:01:21.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.462+0000 7f302f7fe640 1 -- 172.21.15.7:0/1881669187 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30400542f0 con 0x557ecde34cf0 2024-04-25T10:01:21.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.463+0000 7f305306d740 1 -- 172.21.15.7:0/1881669187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ecde34cf0 msgr2=0x557ecde2be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:21.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.463+0000 7f305306d740 1 --2- 172.21.15.7:0/1881669187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ecde34cf0 0x557ecde2be60 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f3040057980 tx=0x7f3040001080 comp rx=0 tx=0).stop 2024-04-25T10:01:21.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.463+0000 7f305306d740 1 -- 172.21.15.7:0/1881669187 shutdown_connections 2024-04-25T10:01:21.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.463+0000 7f305306d740 1 --2- 172.21.15.7:0/1881669187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557ecde4d810 0x557ecde8de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.463+0000 7f305306d740 1 --2- 172.21.15.7:0/1881669187 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557ecde35bb0 0x557ecde9e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.463+0000 7f305306d740 1 --2- 172.21.15.7:0/1881669187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ecde34cf0 0x557ecde2be60 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.463+0000 7f305306d740 1 -- 172.21.15.7:0/1881669187 >> 172.21.15.7:0/1881669187 conn(0x557ecde30830 msgr2=0x557ecde4c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:21.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.463+0000 7f305306d740 1 -- 172.21.15.7:0/1881669187 shutdown_connections 2024-04-25T10:01:21.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.463+0000 7f305306d740 1 -- 172.21.15.7:0/1881669187 wait complete. 2024-04-25T10:01:21.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.463+0000 7f305306d740 1 -- start start 2024-04-25T10:01:21.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.463+0000 7f305306d740 1 Processor -- start 2024-04-25T10:01:21.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.464+0000 7f305306d740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557ecde34cf0 0x557ecde95a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.464+0000 7f305306d740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557ecde35bb0 0x557ecde8e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.464+0000 7f305306d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ecde4d810 0x557ecdeda8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.464+0000 7f305306d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3048158200 con 0x557ecde4d810 2024-04-25T10:01:21.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.464+0000 7f305306d740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ecdda48e0 con 0x557ecde34cf0 2024-04-25T10:01:21.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.464+0000 7f305306d740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ecde930e0 con 0x557ecde35bb0 2024-04-25T10:01:21.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.464+0000 7f305306d740 10 client.0 _ll_register_callbacks cb 0x7f3038005c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:01:21.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.464+0000 7f304e900640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ecde4d810 0x557ecdeda8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.464+0000 7f304e900640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ecde4d810 0x557ecdeda8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38572/0 (socket says 172.21.15.7:38572) 2024-04-25T10:01:21.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.464+0000 7f304e900640 1 -- 172.21.15.7:0/892766547 learned_addr learned my addr 172.21.15.7:0/892766547 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:21.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.464+0000 7f304d8fe640 1 --2- 172.21.15.7:0/892766547 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557ecde35bb0 0x557ecde8e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.464+0000 7f304e0ff640 1 --2- 172.21.15.7:0/892766547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557ecde34cf0 0x557ecde95a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.465+0000 7f304e900640 1 -- 172.21.15.7:0/892766547 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557ecde35bb0 msgr2=0x557ecde8e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:21.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.465+0000 7f304e900640 1 --2- 172.21.15.7:0/892766547 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557ecde35bb0 0x557ecde8e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.465+0000 7f304e900640 1 -- 172.21.15.7:0/892766547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557ecde34cf0 msgr2=0x557ecde95a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:21.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.465+0000 7f304e900640 1 --2- 172.21.15.7:0/892766547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557ecde34cf0 0x557ecde95a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.465+0000 7f304e900640 1 -- 172.21.15.7:0/892766547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557ecde8e7d0 con 0x557ecde4d810 2024-04-25T10:01:21.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.465+0000 7f304d8fe640 1 --2- 172.21.15.7:0/892766547 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557ecde35bb0 0x557ecde8e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:01:21.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.465+0000 7f304e900640 1 --2- 172.21.15.7:0/892766547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ecde4d810 0x557ecdeda8c0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f3038012000 tx=0x7f3038001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e7b6dfe792e8a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:21.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.465+0000 7f302d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:01:21.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.465+0000 7f302d7fa640 1 -- 172.21.15.7:0/892766547 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3038019040 con 0x557ecde4d810 2024-04-25T10:01:21.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.465+0000 7f302d7fa640 1 -- 172.21.15.7:0/892766547 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f3038001e10 con 0x557ecde4d810 2024-04-25T10:01:21.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.465+0000 7f305306d740 1 -- 172.21.15.7:0/892766547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3040055d20 con 0x557ecde4d810 2024-04-25T10:01:21.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.465+0000 7f302d7fa640 1 -- 172.21.15.7:0/892766547 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f303802b050 con 0x557ecde4d810 2024-04-25T10:01:21.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.465+0000 7f305306d740 10 client.7914 fetch_fsmap learned FSMap version 60 2024-04-25T10:01:21.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.465+0000 7f305306d740 1 -- 172.21.15.7:0/892766547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x557ecde4ef20 con 0x557ecde4d810 2024-04-25T10:01:21.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.465+0000 7f302d7fa640 1 -- 172.21.15.7:0/892766547 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3040055d20 con 0x557ecde4d810 2024-04-25T10:01:21.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.465+0000 7f302d7fa640 1 -- 172.21.15.7:0/892766547 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 60) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f303802e020 con 0x557ecde4d810 2024-04-25T10:01:21.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.465+0000 7f305306d740 10 client.7914 fetch_fsmap finished waiting for FSMap version 60 2024-04-25T10:01:21.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.465+0000 7f305306d740 10 client.7914 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T10:01:21.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.465+0000 7f305306d740 20 client.7914 populate_metadata read hostname 'smithi007' 2024-04-25T10:01:21.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.465+0000 7f305306d740 1 --2- 172.21.15.7:0/892766547 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x557ecdedae00 0x557ecdedbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.465+0000 7f305306d740 4 client.7914 mds_command: new command op to 7734 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}] 2024-04-25T10:01:21.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.465+0000 7f305306d740 1 -- 172.21.15.7:0/892766547 --> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}) v1 -- 0x557ecde7dac0 con 0x557ecdedae00 2024-04-25T10:01:21.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.465+0000 7f304e0ff640 1 --2- 172.21.15.7:0/892766547 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x557ecdedae00 0x557ecdedbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.466+0000 7f302d7fa640 10 client.7914 ms_handle_connect on v2:172.21.15.7:6836/3829085443 2024-04-25T10:01:21.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.466+0000 7f304e0ff640 1 --2- 172.21.15.7:0/892766547 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x557ecdedae00 0x557ecdedbd30 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b63816a55ff5338 server_cookie=1e34df0cc96c8165 in_seq=0 out_seq=0 2024-04-25T10:01:21.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.466+0000 7f302d7fa640 1 -- 172.21.15.7:0/892766547 <== mds.0 v2:172.21.15.7:6836/3829085443 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x557ecde7dac0 con 0x557ecdedae00 2024-04-25T10:01:21.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.466+0000 7f302d7fa640 10 client.7914 handle_command_reply: tid=0 2024-04-25T10:01:21.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.466+0000 7f305306d740 1 client.7914 shutdown 2024-04-25T10:01:21.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.466+0000 7f305306d740 1 -- 172.21.15.7:0/892766547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ecde4d810 msgr2=0x557ecdeda8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:21.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.466+0000 7f305306d740 1 --2- 172.21.15.7:0/892766547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ecde4d810 0x557ecdeda8c0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f3038012000 tx=0x7f3038001250 comp rx=0 tx=0).stop 2024-04-25T10:01:21.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.466+0000 7f305306d740 1 -- 172.21.15.7:0/892766547 shutdown_connections 2024-04-25T10:01:21.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.466+0000 7f305306d740 1 --2- 172.21.15.7:0/892766547 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x557ecdedae00 0x557ecdedbd30 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.466+0000 7f305306d740 1 --2- 172.21.15.7:0/892766547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ecde4d810 0x557ecdeda8c0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.466+0000 7f305306d740 1 --2- 172.21.15.7:0/892766547 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557ecde35bb0 0x557ecde8e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.466+0000 7f302d7fa640 0 client.7914 ms_handle_reset on v2:172.21.15.7:6836/3829085443 2024-04-25T10:01:21.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.466+0000 7f305306d740 1 --2- 172.21.15.7:0/892766547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557ecde34cf0 0x557ecde95a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.467+0000 7f305306d740 1 -- 172.21.15.7:0/892766547 >> 172.21.15.7:0/892766547 conn(0x557ecde30830 msgr2=0x557ecdedcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:21.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.467+0000 7f305306d740 1 -- 172.21.15.7:0/892766547 shutdown_connections 2024-04-25T10:01:21.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.467+0000 7f305306d740 1 -- 172.21.15.7:0/892766547 wait complete. 2024-04-25T10:01:21.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.467+0000 7f305306d740 20 client.7914 trim_cache size 0 max 16384 2024-04-25T10:01:21.477 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-04-25T10:01:21.467+0000 7f5deacab640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 pv20 ap=3 DIRTYPARENT f(v0 m2024-04-25T10:00:40.515339+0000 1=1+0)->f(v1 m2024-04-25T10:00:40.515339+0000) n(v0 rc2024-04-25T10:00:40.630337+0000 2=1+1)->n(v0 rc2024-04-25T10:00:40.630337+0000 2=1+1) (inest lock dirty) (ifile lock->sync w=1 flushing) (iversion lock) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x5556ae5f9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-25T10:00:40.515339+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-25T10:00:40.630337+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-2} 2024-04-25T10:01:21.478 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:01:21.478 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-04-25T10:01:21.478 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "9c648561-f309-4ea6-87e6-0ebfa2e6ae60", 2024-04-25T10:01:21.478 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-04-25T10:01:21.478 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:01:21.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.467+0000 7f3050363640 1 -- 172.21.15.7:0/3788708291 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f303406b500 msgr2=0x7f303406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:21.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.467+0000 7f3050363640 1 --2- 172.21.15.7:0/3788708291 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f303406b500 0x7f303406d9c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f303c034000 tx=0x7f303c02e000 comp rx=0 tx=0).stop 2024-04-25T10:01:21.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.467+0000 7f3050363640 1 -- 172.21.15.7:0/3788708291 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30480b9290 msgr2=0x7f30481f69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:21.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.467+0000 7f3050363640 1 --2- 172.21.15.7:0/3788708291 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30480b9290 0x7f30481f69d0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f304000c400 tx=0x7f304000c8c0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.467+0000 7f3050363640 1 -- 172.21.15.7:0/3788708291 shutdown_connections 2024-04-25T10:01:21.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.467+0000 7f3050363640 1 --2- 172.21.15.7:0/3788708291 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f303406b500 0x7f303406d9c0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.467+0000 7f3050363640 1 --2- 172.21.15.7:0/3788708291 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f304815de70 0x7f304815e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.467+0000 7f3050363640 1 --2- 172.21.15.7:0/3788708291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30480d3330 0x7f304815e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.467+0000 7f3050363640 1 --2- 172.21.15.7:0/3788708291 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30480b9290 0x7f30481f69d0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.467+0000 7f3050363640 1 -- 172.21.15.7:0/3788708291 >> 172.21.15.7:0/3788708291 conn(0x7f30480726b0 msgr2=0x7f30480ce1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:21.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.467+0000 7f3050363640 1 -- 172.21.15.7:0/3788708291 shutdown_connections 2024-04-25T10:01:21.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.467+0000 7f3050363640 1 -- 172.21.15.7:0/3788708291 wait complete. 2024-04-25T10:01:21.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:01:21.483 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T10:01:21.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.582+0000 7f450a713640 1 Processor -- start 2024-04-25T10:01:21.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.582+0000 7f450a713640 1 -- start start 2024-04-25T10:01:21.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.582+0000 7f450a713640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4504143fb0 0x7f45040b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.582+0000 7f450a713640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f45040ced20 0x7f450406e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.583+0000 7f450a713640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45040b2ee0 con 0x7f450406e240 2024-04-25T10:01:21.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.583+0000 7f450a713640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f450406ebe0 con 0x7f45040ced20 2024-04-25T10:01:21.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.583+0000 7f450a713640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45040b3150 con 0x7f4504143fb0 2024-04-25T10:01:21.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.583+0000 7f45037fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f450406e240 0x7f45040ce610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55200/0 (socket says 172.21.15.7:55200) 2024-04-25T10:01:21.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.583+0000 7f45037fe640 1 -- 172.21.15.7:0/232368078 learned_addr learned my addr 172.21.15.7:0/232368078 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:01:21.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.583+0000 7f4503fff640 1 --2- 172.21.15.7:0/232368078 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4504143fb0 0x7f45040b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.583+0000 7f4508cb0640 1 --2- 172.21.15.7:0/232368078 >> v2:172.21.15.55:3300/0 conn(0x7f45040ced20 0x7f450406e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.583+0000 7f4502ffd640 1 -- 172.21.15.7:0/232368078 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2749839464 0 0) 0x7f45040b2ee0 con 0x7f450406e240 2024-04-25T10:01:21.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.583+0000 7f4502ffd640 1 -- 172.21.15.7:0/232368078 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44ec003520 con 0x7f450406e240 2024-04-25T10:01:21.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.583+0000 7f4502ffd640 1 -- 172.21.15.7:0/232368078 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 89316599 0 0) 0x7f44ec003520 con 0x7f450406e240 2024-04-25T10:01:21.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.583+0000 7f4503fff640 1 -- 172.21.15.7:0/232368078 >> v2:172.21.15.55:3300/0 conn(0x7f45040ced20 msgr2=0x7f450406e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:21.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.583+0000 7f4503fff640 1 --2- 172.21.15.7:0/232368078 >> v2:172.21.15.55:3300/0 conn(0x7f45040ced20 0x7f450406e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.583+0000 7f4503fff640 1 -- 172.21.15.7:0/232368078 >> v1:172.21.15.7:6789/0 conn(0x7f450406e240 legacy=0x7f45040ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:21.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.583+0000 7f4503fff640 1 -- 172.21.15.7:0/232368078 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45040b3430 con 0x7f4504143fb0 2024-04-25T10:01:21.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.583+0000 7f4508cb0640 1 --2- 172.21.15.7:0/232368078 >> v2:172.21.15.55:3300/0 conn(0x7f45040ced20 0x7f450406e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:01:21.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.584+0000 7f4503fff640 1 --2- 172.21.15.7:0/232368078 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4504143fb0 0x7f45040b3c30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f44f40097a0 tx=0x7f44f402a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e44162d6707e11c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:21.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.584+0000 7f4502ffd640 1 -- 172.21.15.7:0/232368078 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f4037070 con 0x7f4504143fb0 2024-04-25T10:01:21.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.584+0000 7f4502ffd640 1 -- 172.21.15.7:0/232368078 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f402aba0 con 0x7f4504143fb0 2024-04-25T10:01:21.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.584+0000 7f4502ffd640 1 -- 172.21.15.7:0/232368078 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f8001670 con 0x7f4504143fb0 2024-04-25T10:01:21.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.585+0000 7f450a713640 1 -- 172.21.15.7:0/232368078 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4504143fb0 msgr2=0x7f45040b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:21.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.585+0000 7f450a713640 1 --2- 172.21.15.7:0/232368078 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4504143fb0 0x7f45040b3c30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f44f40097a0 tx=0x7f44f402a110 comp rx=0 tx=0).stop 2024-04-25T10:01:21.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.585+0000 7f450a713640 1 -- 172.21.15.7:0/232368078 shutdown_connections 2024-04-25T10:01:21.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.585+0000 7f450a713640 1 --2- 172.21.15.7:0/232368078 >> v2:172.21.15.55:3300/0 conn(0x7f45040ced20 0x7f450406e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.585+0000 7f450a713640 1 --2- 172.21.15.7:0/232368078 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4504143fb0 0x7f45040b3c30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.585+0000 7f450a713640 1 -- 172.21.15.7:0/232368078 >> 172.21.15.7:0/232368078 conn(0x7f450406ab60 msgr2=0x7f450406af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:21.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.585+0000 7f450a713640 1 -- 172.21.15.7:0/232368078 shutdown_connections 2024-04-25T10:01:21.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.585+0000 7f450a713640 1 -- 172.21.15.7:0/232368078 wait complete. 2024-04-25T10:01:21.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.586+0000 7f450a713640 1 Processor -- start 2024-04-25T10:01:21.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.586+0000 7f450a713640 1 -- start start 2024-04-25T10:01:21.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.587+0000 7f450a713640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f450406e240 0x7f450414d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.587+0000 7f450a713640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45040ced20 0x7f45041e35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.587+0000 7f450a713640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4504143fb0 0x7f450413dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.587+0000 7f450a713640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45040cf2f0 con 0x7f45040ced20 2024-04-25T10:01:21.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.587+0000 7f450a713640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4504144390 con 0x7f4504143fb0 2024-04-25T10:01:21.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.587+0000 7f450a713640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450415ac70 con 0x7f450406e240 2024-04-25T10:01:21.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.587+0000 7f45037fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45040ced20 0x7f45041e35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.587+0000 7f45037fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45040ced20 0x7f45041e35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38582/0 (socket says 172.21.15.7:38582) 2024-04-25T10:01:21.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.587+0000 7f45037fe640 1 -- 172.21.15.7:0/1432380195 learned_addr learned my addr 172.21.15.7:0/1432380195 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:21.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.587+0000 7f4503fff640 1 --2- 172.21.15.7:0/1432380195 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f450406e240 0x7f450414d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.587+0000 7f4508cb0640 1 --2- 172.21.15.7:0/1432380195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4504143fb0 0x7f450413dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.587+0000 7f45037fe640 1 -- 172.21.15.7:0/1432380195 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f450406e240 msgr2=0x7f450414d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:21.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.587+0000 7f45037fe640 1 --2- 172.21.15.7:0/1432380195 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f450406e240 0x7f450414d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.587+0000 7f45037fe640 1 -- 172.21.15.7:0/1432380195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4504143fb0 msgr2=0x7f450413dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:21.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.587+0000 7f45037fe640 1 --2- 172.21.15.7:0/1432380195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4504143fb0 0x7f450413dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.588+0000 7f45037fe640 1 -- 172.21.15.7:0/1432380195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45041e3f30 con 0x7f45040ced20 2024-04-25T10:01:21.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.588+0000 7f4503fff640 1 --2- 172.21.15.7:0/1432380195 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f450406e240 0x7f450414d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:01:21.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.588+0000 7f4508cb0640 1 --2- 172.21.15.7:0/1432380195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4504143fb0 0x7f450413dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:01:21.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.588+0000 7f45037fe640 1 --2- 172.21.15.7:0/1432380195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45040ced20 0x7f45041e35c0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f44f800c780 tx=0x7f44f800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:21.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.588+0000 7f4500ff9640 1 -- 172.21.15.7:0/1432380195 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f8017070 con 0x7f45040ced20 2024-04-25T10:01:21.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.588+0000 7f4500ff9640 1 -- 172.21.15.7:0/1432380195 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f8005ad0 con 0x7f45040ced20 2024-04-25T10:01:21.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.588+0000 7f450a713640 1 -- 172.21.15.7:0/1432380195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45041e4210 con 0x7f45040ced20 2024-04-25T10:01:21.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.588+0000 7f4500ff9640 1 -- 172.21.15.7:0/1432380195 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f8007070 con 0x7f45040ced20 2024-04-25T10:01:21.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.588+0000 7f450a713640 1 -- 172.21.15.7:0/1432380195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45041e47d0 con 0x7f45040ced20 2024-04-25T10:01:21.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.589+0000 7f4500ff9640 1 -- 172.21.15.7:0/1432380195 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f44f801a070 con 0x7f45040ced20 2024-04-25T10:01:21.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.590+0000 7f4500ff9640 1 --2- 172.21.15.7:0/1432380195 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f44f006b4d0 0x7f44f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.590+0000 7f4500ff9640 1 -- 172.21.15.7:0/1432380195 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f44f80899d0 con 0x7f45040ced20 2024-04-25T10:01:21.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.590+0000 7f4503fff640 1 --2- 172.21.15.7:0/1432380195 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f44f006b4d0 0x7f44f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.590+0000 7f4503fff640 1 --2- 172.21.15.7:0/1432380195 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f44f006b4d0 0x7f44f006d990 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f44f4034000 tx=0x7f44f402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:21.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.591+0000 7f450d40b740 1 Processor -- start 2024-04-25T10:01:21.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.591+0000 7f450d40b740 1 -- start start 2024-04-25T10:01:21.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.592+0000 7f450d40b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5c661a510 0x55e5c661a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.592+0000 7f450d40b740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5c65ea770 0x55e5c65f07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.592+0000 7f450d40b740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e5c6636470 0x55e5c66368f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.592+0000 7f450d40b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5c6553da0 con 0x55e5c661a510 2024-04-25T10:01:21.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.592+0000 7f450d40b740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5c64fcb80 con 0x55e5c65ea770 2024-04-25T10:01:21.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.592+0000 7f450d40b740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e5c654fe40 con 0x55e5c6636470 2024-04-25T10:01:21.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.592+0000 7f4503fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5c661a510 0x55e5c661a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.592+0000 7f4503fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5c661a510 0x55e5c661a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38588/0 (socket says 172.21.15.7:38588) 2024-04-25T10:01:21.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.592+0000 7f4503fff640 1 -- 172.21.15.7:0/1003913112 learned_addr learned my addr 172.21.15.7:0/1003913112 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:21.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.592+0000 7f4508cb0640 1 --2- 172.21.15.7:0/1003913112 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e5c6636470 0x55e5c66368f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.592+0000 7f45037fe640 1 --2- 172.21.15.7:0/1003913112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5c65ea770 0x55e5c65f07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.592+0000 7f4503fff640 1 -- 172.21.15.7:0/1003913112 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e5c6636470 msgr2=0x55e5c66368f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:21.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.592+0000 7f4503fff640 1 --2- 172.21.15.7:0/1003913112 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e5c6636470 0x55e5c66368f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.592+0000 7f4503fff640 1 -- 172.21.15.7:0/1003913112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5c65ea770 msgr2=0x55e5c65f07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:21.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.592+0000 7f4503fff640 1 --2- 172.21.15.7:0/1003913112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5c65ea770 0x55e5c65f07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.592+0000 7f4503fff640 1 -- 172.21.15.7:0/1003913112 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5c6506f10 con 0x55e5c661a510 2024-04-25T10:01:21.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.592+0000 7f45037fe640 1 --2- 172.21.15.7:0/1003913112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5c65ea770 0x55e5c65f07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:01:21.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.592+0000 7f4503fff640 1 --2- 172.21.15.7:0/1003913112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5c661a510 0x55e5c661a8f0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f44f402a700 tx=0x7f44f402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b7f718529ef858b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:21.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.592+0000 7f44e9ffb640 1 -- 172.21.15.7:0/1003913112 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f4037040 con 0x55e5c661a510 2024-04-25T10:01:21.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.592+0000 7f44e9ffb640 1 -- 172.21.15.7:0/1003913112 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f403e460 con 0x55e5c661a510 2024-04-25T10:01:21.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.592+0000 7f44e9ffb640 1 -- 172.21.15.7:0/1003913112 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f403e830 con 0x55e5c661a510 2024-04-25T10:01:21.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.593+0000 7f450d40b740 1 -- 172.21.15.7:0/1003913112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5c661a510 msgr2=0x55e5c661a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:21.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.593+0000 7f450d40b740 1 --2- 172.21.15.7:0/1003913112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5c661a510 0x55e5c661a8f0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f44f402a700 tx=0x7f44f402c000 comp rx=0 tx=0).stop 2024-04-25T10:01:21.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.593+0000 7f450d40b740 1 -- 172.21.15.7:0/1003913112 shutdown_connections 2024-04-25T10:01:21.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.593+0000 7f450d40b740 1 --2- 172.21.15.7:0/1003913112 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e5c6636470 0x55e5c66368f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.593+0000 7f450d40b740 1 --2- 172.21.15.7:0/1003913112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5c65ea770 0x55e5c65f07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.593+0000 7f450d40b740 1 --2- 172.21.15.7:0/1003913112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5c661a510 0x55e5c661a8f0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.593+0000 7f450d40b740 1 -- 172.21.15.7:0/1003913112 >> 172.21.15.7:0/1003913112 conn(0x55e5c65ec9e0 msgr2=0x55e5c6635320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:21.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.593+0000 7f450d40b740 1 -- 172.21.15.7:0/1003913112 shutdown_connections 2024-04-25T10:01:21.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.593+0000 7f450d40b740 1 -- 172.21.15.7:0/1003913112 wait complete. 2024-04-25T10:01:21.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.593+0000 7f450d40b740 1 -- start start 2024-04-25T10:01:21.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.594+0000 7f450d40b740 1 Processor -- start 2024-04-25T10:01:21.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.594+0000 7f450d40b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5c661a510 0x55e5c6606d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.594+0000 7f450d40b740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5c6636470 0x55e5c663a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.594+0000 7f450d40b740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e5c661d040 0x55e5c65e9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.594+0000 7f450d40b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5c65f0ce0 con 0x55e5c661a510 2024-04-25T10:01:21.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.594+0000 7f450d40b740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5c64f24b0 con 0x55e5c6636470 2024-04-25T10:01:21.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.594+0000 7f450d40b740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e5c65f0310 con 0x55e5c661d040 2024-04-25T10:01:21.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.595+0000 7f450d40b740 10 client.0 _ll_register_callbacks cb 0x55e5c6532180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:01:21.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.595+0000 7f4503fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5c661a510 0x55e5c6606d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.595+0000 7f4503fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5c661a510 0x55e5c6606d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38592/0 (socket says 172.21.15.7:38592) 2024-04-25T10:01:21.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.595+0000 7f4503fff640 1 -- 172.21.15.7:0/1964832753 learned_addr learned my addr 172.21.15.7:0/1964832753 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:21.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.595+0000 7f4508cb0640 1 --2- 172.21.15.7:0/1964832753 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e5c661d040 0x55e5c65e9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.595+0000 7f45037fe640 1 --2- 172.21.15.7:0/1964832753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5c6636470 0x55e5c663a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.595+0000 7f4503fff640 1 -- 172.21.15.7:0/1964832753 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e5c661d040 msgr2=0x55e5c65e9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:21.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.595+0000 7f4503fff640 1 --2- 172.21.15.7:0/1964832753 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e5c661d040 0x55e5c65e9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.595+0000 7f4503fff640 1 -- 172.21.15.7:0/1964832753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5c6636470 msgr2=0x55e5c663a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:21.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.595+0000 7f4503fff640 1 --2- 172.21.15.7:0/1964832753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5c6636470 0x55e5c663a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.595+0000 7f4503fff640 1 -- 172.21.15.7:0/1964832753 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e5c63327d0 con 0x55e5c661a510 2024-04-25T10:01:21.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.595+0000 7f4503fff640 1 --2- 172.21.15.7:0/1964832753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5c661a510 0x55e5c6606d90 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f44f4009890 tx=0x7f44f4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c3415b6ae4147e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:21.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.595+0000 7f44e2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:01:21.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.595+0000 7f44e2ffd640 1 -- 172.21.15.7:0/1964832753 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f4057060 con 0x55e5c661a510 2024-04-25T10:01:21.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.595+0000 7f44e2ffd640 1 -- 172.21.15.7:0/1964832753 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f44f4045040 con 0x55e5c661a510 2024-04-25T10:01:21.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.595+0000 7f450d40b740 1 -- 172.21.15.7:0/1964832753 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f44f403e460 con 0x55e5c661a510 2024-04-25T10:01:21.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.595+0000 7f44e2ffd640 1 -- 172.21.15.7:0/1964832753 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44f403eda0 con 0x55e5c661a510 2024-04-25T10:01:21.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.595+0000 7f450d40b740 10 client.7926 fetch_fsmap learned FSMap version 60 2024-04-25T10:01:21.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.596+0000 7f450d40b740 1 -- 172.21.15.7:0/1964832753 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x55e5c62683f0 con 0x55e5c661a510 2024-04-25T10:01:21.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.596+0000 7f44e2ffd640 1 -- 172.21.15.7:0/1964832753 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f403e460 con 0x55e5c661a510 2024-04-25T10:01:21.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.596+0000 7f44e2ffd640 1 -- 172.21.15.7:0/1964832753 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 60) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f44f4051070 con 0x55e5c661a510 2024-04-25T10:01:21.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.596+0000 7f450d40b740 10 client.7926 fetch_fsmap finished waiting for FSMap version 60 2024-04-25T10:01:21.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.596+0000 7f450d40b740 10 client.7926 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T10:01:21.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.596+0000 7f450d40b740 20 client.7926 populate_metadata read hostname 'smithi007' 2024-04-25T10:01:21.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.596+0000 7f450d40b740 1 --2- 172.21.15.7:0/1964832753 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x55e5c6649ad0 0x55e5c6649eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.596+0000 7f450d40b740 4 client.7926 mds_command: new command op to 7734 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:01:21.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.596+0000 7f450d40b740 1 -- 172.21.15.7:0/1964832753 --> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e5c65612e0 con 0x55e5c6649ad0 2024-04-25T10:01:21.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.596+0000 7f45037fe640 1 --2- 172.21.15.7:0/1964832753 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x55e5c6649ad0 0x55e5c6649eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.596+0000 7f44e2ffd640 10 client.7926 ms_handle_connect on v2:172.21.15.7:6836/3829085443 2024-04-25T10:01:21.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.596+0000 7f45037fe640 1 --2- 172.21.15.7:0/1964832753 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x55e5c6649ad0 0x55e5c6649eb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5989c71f62ba100c server_cookie=39f93d644c76eb51 in_seq=0 out_seq=0 2024-04-25T10:01:21.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.597+0000 7f44e2ffd640 1 -- 172.21.15.7:0/1964832753 <== mds.0 v2:172.21.15.7:6836/3829085443 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e5c65612e0 con 0x55e5c6649ad0 2024-04-25T10:01:21.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.597+0000 7f44e2ffd640 10 client.7926 handle_command_reply: tid=0 2024-04-25T10:01:21.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.597+0000 7f450d40b740 1 client.7926 shutdown 2024-04-25T10:01:21.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.597+0000 7f450d40b740 1 -- 172.21.15.7:0/1964832753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5c661a510 msgr2=0x55e5c6606d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:21.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.597+0000 7f450d40b740 1 --2- 172.21.15.7:0/1964832753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5c661a510 0x55e5c6606d90 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f44f4009890 tx=0x7f44f4004730 comp rx=0 tx=0).stop 2024-04-25T10:01:21.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.597+0000 7f450d40b740 1 -- 172.21.15.7:0/1964832753 shutdown_connections 2024-04-25T10:01:21.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.597+0000 7f450d40b740 1 --2- 172.21.15.7:0/1964832753 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x55e5c6649ad0 0x55e5c6649eb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.597+0000 7f450d40b740 1 --2- 172.21.15.7:0/1964832753 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e5c661d040 0x55e5c65e9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.597+0000 7f450d40b740 1 --2- 172.21.15.7:0/1964832753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5c6636470 0x55e5c663a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.597+0000 7f44e2ffd640 0 client.7926 ms_handle_reset on v2:172.21.15.7:6836/3829085443 2024-04-25T10:01:21.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.597+0000 7f450d40b740 1 --2- 172.21.15.7:0/1964832753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5c661a510 0x55e5c6606d90 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.597+0000 7f450d40b740 1 -- 172.21.15.7:0/1964832753 >> 172.21.15.7:0/1964832753 conn(0x55e5c65ea770 msgr2=0x55e5c65ee7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:21.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.597+0000 7f450d40b740 1 -- 172.21.15.7:0/1964832753 shutdown_connections 2024-04-25T10:01:21.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.597+0000 7f450d40b740 1 -- 172.21.15.7:0/1964832753 wait complete. 2024-04-25T10:01:21.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.597+0000 7f450d40b740 20 client.7926 trim_cache size 0 max 16384 2024-04-25T10:01:21.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.612+0000 7f450d40b740 1 Processor -- start 2024-04-25T10:01:21.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.612+0000 7f450d40b740 1 -- start start 2024-04-25T10:01:21.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.613+0000 7f450d40b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5c661a510 0x55e5c662b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.613+0000 7f450d40b740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5c661d040 0x55e5c65eec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.613+0000 7f450d40b740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e5c6636470 0x55e5c6635e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.613+0000 7f450d40b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45041fc020 con 0x55e5c661a510 2024-04-25T10:01:21.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.613+0000 7f450d40b740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450415d020 con 0x55e5c661d040 2024-04-25T10:01:21.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.613+0000 7f450d40b740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450415c420 con 0x55e5c6636470 2024-04-25T10:01:21.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.613+0000 7f4503fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5c661a510 0x55e5c662b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.613+0000 7f4503fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5c661a510 0x55e5c662b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38606/0 (socket says 172.21.15.7:38606) 2024-04-25T10:01:21.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.613+0000 7f4503fff640 1 -- 172.21.15.7:0/3938197075 learned_addr learned my addr 172.21.15.7:0/3938197075 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:21.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.613+0000 7f45037fe640 1 --2- 172.21.15.7:0/3938197075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5c661d040 0x55e5c65eec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.613+0000 7f4508cb0640 1 --2- 172.21.15.7:0/3938197075 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e5c6636470 0x55e5c6635e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.614+0000 7f4503fff640 1 -- 172.21.15.7:0/3938197075 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e5c6636470 msgr2=0x55e5c6635e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:21.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.614+0000 7f4503fff640 1 --2- 172.21.15.7:0/3938197075 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e5c6636470 0x55e5c6635e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.614+0000 7f4503fff640 1 -- 172.21.15.7:0/3938197075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5c661d040 msgr2=0x55e5c65eec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:21.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.614+0000 7f4503fff640 1 --2- 172.21.15.7:0/3938197075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5c661d040 0x55e5c65eec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.614+0000 7f4503fff640 1 -- 172.21.15.7:0/3938197075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5c65e9970 con 0x55e5c661a510 2024-04-25T10:01:21.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.614+0000 7f4508cb0640 1 --2- 172.21.15.7:0/3938197075 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e5c6636470 0x55e5c6635e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:01:21.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.614+0000 7f4503fff640 1 --2- 172.21.15.7:0/3938197075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5c661a510 0x55e5c662b890 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f44f402a700 tx=0x7f44f4042000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f4f05bd1cef0e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:21.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.614+0000 7f44e97fa640 1 -- 172.21.15.7:0/3938197075 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f403c5a0 con 0x55e5c661a510 2024-04-25T10:01:21.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.614+0000 7f44e97fa640 1 -- 172.21.15.7:0/3938197075 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f403e920 con 0x55e5c661a510 2024-04-25T10:01:21.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.614+0000 7f44e97fa640 1 -- 172.21.15.7:0/3938197075 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f403ca90 con 0x55e5c661a510 2024-04-25T10:01:21.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.614+0000 7f450d40b740 1 -- 172.21.15.7:0/3938197075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5c661a510 msgr2=0x55e5c662b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:21.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.614+0000 7f450d40b740 1 --2- 172.21.15.7:0/3938197075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5c661a510 0x55e5c662b890 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f44f402a700 tx=0x7f44f4042000 comp rx=0 tx=0).stop 2024-04-25T10:01:21.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.614+0000 7f450d40b740 1 -- 172.21.15.7:0/3938197075 shutdown_connections 2024-04-25T10:01:21.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.614+0000 7f450d40b740 1 --2- 172.21.15.7:0/3938197075 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e5c6636470 0x55e5c6635e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.614+0000 7f450d40b740 1 --2- 172.21.15.7:0/3938197075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5c661d040 0x55e5c65eec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.614+0000 7f450d40b740 1 --2- 172.21.15.7:0/3938197075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5c661a510 0x55e5c662b890 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.614+0000 7f450d40b740 1 -- 172.21.15.7:0/3938197075 >> 172.21.15.7:0/3938197075 conn(0x55e5c65ea770 msgr2=0x55e5c65e5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:21.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.614+0000 7f450d40b740 1 -- 172.21.15.7:0/3938197075 shutdown_connections 2024-04-25T10:01:21.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.614+0000 7f450d40b740 1 -- 172.21.15.7:0/3938197075 wait complete. 2024-04-25T10:01:21.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.615+0000 7f450d40b740 1 -- start start 2024-04-25T10:01:21.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.615+0000 7f450d40b740 1 Processor -- start 2024-04-25T10:01:21.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.616+0000 7f450d40b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5c661a510 0x55e5c6615490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.616+0000 7f450d40b740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5c661d040 0x55e5c65f1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.616+0000 7f450d40b740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e5c6636470 0x55e5c65f1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.616+0000 7f450d40b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5c6634ba0 con 0x55e5c661a510 2024-04-25T10:01:21.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.616+0000 7f450d40b740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450415ca20 con 0x55e5c661d040 2024-04-25T10:01:21.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.616+0000 7f450d40b740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e5c64f4010 con 0x55e5c6636470 2024-04-25T10:01:21.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.616+0000 7f450d40b740 10 client.0 _ll_register_callbacks cb 0x7f44f4035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:01:21.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.616+0000 7f4503fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5c661a510 0x55e5c6615490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.616+0000 7f4503fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5c661a510 0x55e5c6615490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38616/0 (socket says 172.21.15.7:38616) 2024-04-25T10:01:21.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.616+0000 7f4503fff640 1 -- 172.21.15.7:0/1456143945 learned_addr learned my addr 172.21.15.7:0/1456143945 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:21.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.616+0000 7f4508cb0640 1 --2- 172.21.15.7:0/1456143945 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e5c6636470 0x55e5c65f1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.616+0000 7f45037fe640 1 --2- 172.21.15.7:0/1456143945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5c661d040 0x55e5c65f1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.616+0000 7f4503fff640 1 -- 172.21.15.7:0/1456143945 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e5c6636470 msgr2=0x55e5c65f1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:21.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.616+0000 7f4503fff640 1 --2- 172.21.15.7:0/1456143945 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e5c6636470 0x55e5c65f1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.616+0000 7f4503fff640 1 -- 172.21.15.7:0/1456143945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5c661d040 msgr2=0x55e5c65f1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:21.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.616+0000 7f4503fff640 1 --2- 172.21.15.7:0/1456143945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5c661d040 0x55e5c65f1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.616+0000 7f4503fff640 1 -- 172.21.15.7:0/1456143945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e5c62280f0 con 0x55e5c661a510 2024-04-25T10:01:21.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.616+0000 7f45037fe640 1 --2- 172.21.15.7:0/1456143945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5c661d040 0x55e5c65f1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:01:21.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.617+0000 7f4503fff640 1 --2- 172.21.15.7:0/1456143945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5c661a510 0x55e5c6615490 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f44f4032a70 tx=0x7f44f4008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87790d441b00975 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:21.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.617+0000 7f44e2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:01:21.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.617+0000 7f44e2ffd640 1 -- 172.21.15.7:0/1456143945 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f403ce30 con 0x55e5c661a510 2024-04-25T10:01:21.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.617+0000 7f44e2ffd640 1 -- 172.21.15.7:0/1456143945 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f44f4045040 con 0x55e5c661a510 2024-04-25T10:01:21.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.617+0000 7f450d40b740 1 -- 172.21.15.7:0/1456143945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f44f403e920 con 0x55e5c661a510 2024-04-25T10:01:21.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.617+0000 7f44e2ffd640 1 -- 172.21.15.7:0/1456143945 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44f4069050 con 0x55e5c661a510 2024-04-25T10:01:21.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.617+0000 7f450d40b740 10 client.7932 fetch_fsmap learned FSMap version 60 2024-04-25T10:01:21.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.617+0000 7f450d40b740 1 -- 172.21.15.7:0/1456143945 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x55e5c6652e90 con 0x55e5c661a510 2024-04-25T10:01:21.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.617+0000 7f44e2ffd640 1 -- 172.21.15.7:0/1456143945 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f403e920 con 0x55e5c661a510 2024-04-25T10:01:21.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.617+0000 7f44e2ffd640 1 -- 172.21.15.7:0/1456143945 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 60) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f44f406c020 con 0x55e5c661a510 2024-04-25T10:01:21.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.617+0000 7f450d40b740 10 client.7932 fetch_fsmap finished waiting for FSMap version 60 2024-04-25T10:01:21.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.617+0000 7f450d40b740 10 client.7932 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T10:01:21.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.617+0000 7f450d40b740 20 client.7932 populate_metadata read hostname 'smithi007' 2024-04-25T10:01:21.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.617+0000 7f450d40b740 1 --2- 172.21.15.7:0/1456143945 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x55e5c65eeeb0 0x55e5c66a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:21.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.617+0000 7f450d40b740 4 client.7932 mds_command: new command op to 7734 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T10:01:21.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.617+0000 7f450d40b740 1 -- 172.21.15.7:0/1456143945 --> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e5c655b630 con 0x55e5c65eeeb0 2024-04-25T10:01:21.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.617+0000 7f45037fe640 1 --2- 172.21.15.7:0/1456143945 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x55e5c65eeeb0 0x55e5c66a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:21.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.618+0000 7f44e2ffd640 10 client.7932 ms_handle_connect on v2:172.21.15.7:6836/3829085443 2024-04-25T10:01:21.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.618+0000 7f45037fe640 1 --2- 172.21.15.7:0/1456143945 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x55e5c65eeeb0 0x55e5c66a4d50 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a42e9e9dd0a727a0 server_cookie=810fcdef64f52403 in_seq=0 out_seq=0 2024-04-25T10:01:21.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.618+0000 7f44e2ffd640 1 -- 172.21.15.7:0/1456143945 <== mds.0 v2:172.21.15.7:6836/3829085443 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+263 (crc 0 0 0) 0x55e5c655b630 con 0x55e5c65eeeb0 2024-04-25T10:01:21.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.618+0000 7f44e2ffd640 10 client.7932 handle_command_reply: tid=0 2024-04-25T10:01:21.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.618+0000 7f450d40b740 1 client.7932 shutdown 2024-04-25T10:01:21.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.618+0000 7f450d40b740 1 -- 172.21.15.7:0/1456143945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5c661a510 msgr2=0x55e5c6615490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:21.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.618+0000 7f450d40b740 1 --2- 172.21.15.7:0/1456143945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5c661a510 0x55e5c6615490 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f44f4032a70 tx=0x7f44f4008030 comp rx=0 tx=0).stop 2024-04-25T10:01:21.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.618+0000 7f450d40b740 1 -- 172.21.15.7:0/1456143945 shutdown_connections 2024-04-25T10:01:21.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.618+0000 7f450d40b740 1 --2- 172.21.15.7:0/1456143945 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x55e5c65eeeb0 0x55e5c66a4d50 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.618+0000 7f450d40b740 1 --2- 172.21.15.7:0/1456143945 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e5c6636470 0x55e5c65f1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.618+0000 7f450d40b740 1 --2- 172.21.15.7:0/1456143945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5c661d040 0x55e5c65f1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.618+0000 7f44e2ffd640 0 client.7932 ms_handle_reset on v2:172.21.15.7:6836/3829085443 2024-04-25T10:01:21.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.618+0000 7f450d40b740 1 --2- 172.21.15.7:0/1456143945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5c661a510 0x55e5c6615490 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.618+0000 7f450d40b740 1 -- 172.21.15.7:0/1456143945 >> 172.21.15.7:0/1456143945 conn(0x55e5c65ea770 msgr2=0x55e5c65f06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:21.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.618+0000 7f450d40b740 1 -- 172.21.15.7:0/1456143945 shutdown_connections 2024-04-25T10:01:21.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.618+0000 7f450d40b740 1 -- 172.21.15.7:0/1456143945 wait complete. 2024-04-25T10:01:21.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.618+0000 7f450d40b740 20 client.7932 trim_cache size 0 max 16384 2024-04-25T10:01:21.629 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:01:21.629 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T10:01:21.629 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-04-25T10:01:21.629 INFO:teuthology.orchestra.run.smithi007.stdout: "9c648561-f309-4ea6-87e6-0ebfa2e6ae60": { 2024-04-25T10:01:21.630 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/dir", 2024-04-25T10:01:21.630 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "9c648561-f309-4ea6-87e6-0ebfa2e6ae60", 2024-04-25T10:01:21.630 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,repair" 2024-04-25T10:01:21.630 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:01:21.630 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:01:21.630 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:01:21.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.619+0000 7f450a713640 1 -- 172.21.15.7:0/1432380195 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f44f006b4d0 msgr2=0x7f44f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:21.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.619+0000 7f450a713640 1 --2- 172.21.15.7:0/1432380195 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f44f006b4d0 0x7f44f006d990 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f44f4034000 tx=0x7f44f402e000 comp rx=0 tx=0).stop 2024-04-25T10:01:21.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.619+0000 7f450a713640 1 -- 172.21.15.7:0/1432380195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45040ced20 msgr2=0x7f45041e35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:21.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.619+0000 7f450a713640 1 --2- 172.21.15.7:0/1432380195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45040ced20 0x7f45041e35c0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f44f800c780 tx=0x7f44f800cc40 comp rx=0 tx=0).stop 2024-04-25T10:01:21.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.619+0000 7f450a713640 1 -- 172.21.15.7:0/1432380195 shutdown_connections 2024-04-25T10:01:21.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.619+0000 7f450a713640 1 --2- 172.21.15.7:0/1432380195 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f44f006b4d0 0x7f44f006d990 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.619+0000 7f450a713640 1 --2- 172.21.15.7:0/1432380195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4504143fb0 0x7f450413dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.619+0000 7f450a713640 1 --2- 172.21.15.7:0/1432380195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f45040ced20 0x7f45041e35c0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.619+0000 7f450a713640 1 --2- 172.21.15.7:0/1432380195 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f450406e240 0x7f450414d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:21.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.619+0000 7f450a713640 1 -- 172.21.15.7:0/1432380195 >> 172.21.15.7:0/1432380195 conn(0x7f450406ab60 msgr2=0x7f45040b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:21.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.619+0000 7f450a713640 1 -- 172.21.15.7:0/1432380195 shutdown_connections 2024-04-25T10:01:21.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:21.619+0000 7f450a713640 1 -- 172.21.15.7:0/1432380195 wait complete. 2024-04-25T10:01:21.634 INFO:tasks.cephfs.filesystem:scrub status for tag:9c648561-f309-4ea6-87e6-0ebfa2e6ae60 - {'path': '/dir', 'tag': '9c648561-f309-4ea6-87e6-0ebfa2e6ae60', 'options': 'recursive,repair'} 2024-04-25T10:01:26.998 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:01:27.002 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:01:51.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:01:51.636 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T10:01:51.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.749+0000 7f44e9b22640 1 Processor -- start 2024-04-25T10:01:51.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.749+0000 7f44e9b22640 1 -- start start 2024-04-25T10:01:51.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.750+0000 7f44e9b22640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f44e40720d0 0x7f44e415ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:51.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.750+0000 7f44e9b22640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f44e40ae9e0 0x7f44e40cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:51.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.750+0000 7f44e9b22640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e415d9f0 con 0x7f44e4154590 2024-04-25T10:01:51.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.750+0000 7f44e9b22640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e415e5e0 con 0x7f44e40ae9e0 2024-04-25T10:01:51.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.750+0000 7f44e9b22640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e40b4b60 con 0x7f44e40720d0 2024-04-25T10:01:51.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.750+0000 7f44e37fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f44e4154590 0x7f44e40719c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38580/0 (socket says 172.21.15.7:38580) 2024-04-25T10:01:51.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.750+0000 7f44e37fe640 1 -- 172.21.15.7:0/497985512 learned_addr learned my addr 172.21.15.7:0/497985512 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:01:51.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.750+0000 7f44e2ffd640 1 --2- 172.21.15.7:0/497985512 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f44e40720d0 0x7f44e415ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:51.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.750+0000 7f44e3fff640 1 --2- 172.21.15.7:0/497985512 >> v2:172.21.15.55:3300/0 conn(0x7f44e40ae9e0 0x7f44e40cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:51.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.750+0000 7f44e27fc640 1 -- 172.21.15.7:0/497985512 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1247514953 0 0) 0x7f44e415d9f0 con 0x7f44e4154590 2024-04-25T10:01:51.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.750+0000 7f44e27fc640 1 -- 172.21.15.7:0/497985512 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44cc003520 con 0x7f44e4154590 2024-04-25T10:01:51.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.751+0000 7f44e27fc640 1 -- 172.21.15.7:0/497985512 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 251734802 0 0) 0x7f44cc003520 con 0x7f44e4154590 2024-04-25T10:01:51.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.751+0000 7f44e3fff640 1 -- 172.21.15.7:0/497985512 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f44e40720d0 msgr2=0x7f44e415ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:51.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.751+0000 7f44e3fff640 1 --2- 172.21.15.7:0/497985512 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f44e40720d0 0x7f44e415ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.751+0000 7f44e3fff640 1 -- 172.21.15.7:0/497985512 >> v1:172.21.15.7:6789/0 conn(0x7f44e4154590 legacy=0x7f44e40719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:51.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.751+0000 7f44e3fff640 1 -- 172.21.15.7:0/497985512 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e415dcb0 con 0x7f44e40ae9e0 2024-04-25T10:01:51.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.751+0000 7f44e2ffd640 1 --2- 172.21.15.7:0/497985512 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f44e40720d0 0x7f44e415ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:01:51.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.752+0000 7f44e3fff640 1 --2- 172.21.15.7:0/497985512 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44e40ae9e0 0x7f44e40cdd40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f44dc00aea0 tx=0x7f44dc02b740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=771d722ffff3544d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:51.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.752+0000 7f44e27fc640 1 -- 172.21.15.7:0/497985512 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc037070 con 0x7f44e40ae9e0 2024-04-25T10:01:51.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.752+0000 7f44e27fc640 1 -- 172.21.15.7:0/497985512 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44dc008440 con 0x7f44e40ae9e0 2024-04-25T10:01:51.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.752+0000 7f44e27fc640 1 -- 172.21.15.7:0/497985512 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d4001670 con 0x7f44e40ae9e0 2024-04-25T10:01:51.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.752+0000 7f44e9b22640 1 -- 172.21.15.7:0/497985512 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44e40ae9e0 msgr2=0x7f44e40cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:51.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.752+0000 7f44e9b22640 1 --2- 172.21.15.7:0/497985512 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44e40ae9e0 0x7f44e40cdd40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f44dc00aea0 tx=0x7f44dc02b740 comp rx=0 tx=0).stop 2024-04-25T10:01:51.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.752+0000 7f44e9b22640 1 -- 172.21.15.7:0/497985512 shutdown_connections 2024-04-25T10:01:51.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.752+0000 7f44e9b22640 1 --2- 172.21.15.7:0/497985512 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44e40ae9e0 0x7f44e40cdd40 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.752+0000 7f44e9b22640 1 --2- 172.21.15.7:0/497985512 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f44e40720d0 0x7f44e415ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.752+0000 7f44e9b22640 1 -- 172.21.15.7:0/497985512 >> 172.21.15.7:0/497985512 conn(0x7f44e406ab60 msgr2=0x7f44e406af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:51.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.752+0000 7f44e9b22640 1 -- 172.21.15.7:0/497985512 shutdown_connections 2024-04-25T10:01:51.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.752+0000 7f44e9b22640 1 -- 172.21.15.7:0/497985512 wait complete. 2024-04-25T10:01:51.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.754+0000 7f44e9b22640 1 Processor -- start 2024-04-25T10:01:51.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.754+0000 7f44e9b22640 1 -- start start 2024-04-25T10:01:51.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.755+0000 7f44e9b22640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f44e40720d0 0x7f44e414c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:51.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.755+0000 7f44e9b22640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44e40ae9e0 0x7f44e4155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:51.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.755+0000 7f44e9b22640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44e4154590 0x7f44e4147ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:51.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.755+0000 7f44e9b22640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e4071130 con 0x7f44e40ae9e0 2024-04-25T10:01:51.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.755+0000 7f44e9b22640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e415e270 con 0x7f44e4154590 2024-04-25T10:01:51.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.755+0000 7f44e9b22640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e40712b0 con 0x7f44e40720d0 2024-04-25T10:01:51.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.755+0000 7f44e2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44e40ae9e0 0x7f44e4155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:51.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.755+0000 7f44e2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44e40ae9e0 0x7f44e4155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44496/0 (socket says 172.21.15.7:44496) 2024-04-25T10:01:51.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.755+0000 7f44e2ffd640 1 -- 172.21.15.7:0/950842812 learned_addr learned my addr 172.21.15.7:0/950842812 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:51.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.755+0000 7f44e37fe640 1 --2- 172.21.15.7:0/950842812 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f44e40720d0 0x7f44e414c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:51.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.755+0000 7f44e3fff640 1 --2- 172.21.15.7:0/950842812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44e4154590 0x7f44e4147ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:51.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.755+0000 7f44e2ffd640 1 -- 172.21.15.7:0/950842812 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f44e40720d0 msgr2=0x7f44e414c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:51.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.755+0000 7f44e2ffd640 1 --2- 172.21.15.7:0/950842812 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f44e40720d0 0x7f44e414c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.755+0000 7f44e2ffd640 1 -- 172.21.15.7:0/950842812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44e4154590 msgr2=0x7f44e4147ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:51.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.755+0000 7f44e2ffd640 1 --2- 172.21.15.7:0/950842812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44e4154590 0x7f44e4147ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.755+0000 7f44e2ffd640 1 -- 172.21.15.7:0/950842812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e4155e40 con 0x7f44e40ae9e0 2024-04-25T10:01:51.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.755+0000 7f44e2ffd640 1 --2- 172.21.15.7:0/950842812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44e40ae9e0 0x7f44e4155710 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f44d800ebe0 tx=0x7f44d800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:51.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.756+0000 7f44cbfff640 1 -- 172.21.15.7:0/950842812 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d8017070 con 0x7f44e40ae9e0 2024-04-25T10:01:51.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.756+0000 7f44cbfff640 1 -- 172.21.15.7:0/950842812 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d800cc30 con 0x7f44e40ae9e0 2024-04-25T10:01:51.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.756+0000 7f44e9b22640 1 -- 172.21.15.7:0/950842812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e414cf20 con 0x7f44e40ae9e0 2024-04-25T10:01:51.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.756+0000 7f44cbfff640 1 -- 172.21.15.7:0/950842812 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d8013470 con 0x7f44e40ae9e0 2024-04-25T10:01:51.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.756+0000 7f44e9b22640 1 -- 172.21.15.7:0/950842812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e414d4e0 con 0x7f44e40ae9e0 2024-04-25T10:01:51.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.758+0000 7f44cbfff640 1 -- 172.21.15.7:0/950842812 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f44d801a070 con 0x7f44e40ae9e0 2024-04-25T10:01:51.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.758+0000 7f44cbfff640 1 --2- 172.21.15.7:0/950842812 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f44d006b4d0 0x7f44d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:51.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.758+0000 7f44cbfff640 1 -- 172.21.15.7:0/950842812 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f44d808a470 con 0x7f44e40ae9e0 2024-04-25T10:01:51.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.758+0000 7f44e37fe640 1 --2- 172.21.15.7:0/950842812 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f44d006b4d0 0x7f44d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:51.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.759+0000 7f44e37fe640 1 --2- 172.21.15.7:0/950842812 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f44d006b4d0 0x7f44d006d990 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f44d4005880 tx=0x7f44d4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:51.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.759+0000 7f44ec824740 1 Processor -- start 2024-04-25T10:01:51.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.759+0000 7f44ec824740 1 -- start start 2024-04-25T10:01:51.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.760+0000 7f44ec824740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561dfedd6b10 0x561dfedd9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:51.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.760+0000 7f44ec824740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x561dfedd6ef0 0x561dfedd9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:51.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.760+0000 7f44ec824740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561dfeda9770 0x561dfedacf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:51.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.760+0000 7f44ec824740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dfed12da0 con 0x561dfeda9770 2024-04-25T10:01:51.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.760+0000 7f44ec824740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dfecbbb80 con 0x561dfedd6b10 2024-04-25T10:01:51.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.760+0000 7f44ec824740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x561dfed0ee40 con 0x561dfedd6ef0 2024-04-25T10:01:51.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.760+0000 7f44e3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561dfeda9770 0x561dfedacf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:51.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.760+0000 7f44e3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561dfeda9770 0x561dfedacf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44500/0 (socket says 172.21.15.7:44500) 2024-04-25T10:01:51.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.760+0000 7f44e3fff640 1 -- 172.21.15.7:0/4252769943 learned_addr learned my addr 172.21.15.7:0/4252769943 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:51.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.760+0000 7f44e2ffd640 1 --2- 172.21.15.7:0/4252769943 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x561dfedd6ef0 0x561dfedd9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:51.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.760+0000 7f44e3fff640 1 -- 172.21.15.7:0/4252769943 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x561dfedd6ef0 msgr2=0x561dfedd9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:51.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.760+0000 7f44e3fff640 1 --2- 172.21.15.7:0/4252769943 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x561dfedd6ef0 0x561dfedd9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.760+0000 7f44e3fff640 1 -- 172.21.15.7:0/4252769943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561dfedd6b10 msgr2=0x561dfedd9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:51.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.760+0000 7f44e37fe640 1 --2- 172.21.15.7:0/4252769943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561dfedd6b10 0x561dfedd9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:51.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.760+0000 7f44e3fff640 1 --2- 172.21.15.7:0/4252769943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561dfedd6b10 0x561dfedd9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.760+0000 7f44e3fff640 1 -- 172.21.15.7:0/4252769943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561dfecc5f10 con 0x561dfeda9770 2024-04-25T10:01:51.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.760+0000 7f44e37fe640 1 --2- 172.21.15.7:0/4252769943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561dfedd6b10 0x561dfedd9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:01:51.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.761+0000 7f44e3fff640 1 --2- 172.21.15.7:0/4252769943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561dfeda9770 0x561dfedacf80 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f44dc00aea0 tx=0x7f44dc02f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2744814ee7f9796a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:51.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.761+0000 7f44c97fa640 1 -- 172.21.15.7:0/4252769943 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc037040 con 0x561dfeda9770 2024-04-25T10:01:51.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.761+0000 7f44c97fa640 1 -- 172.21.15.7:0/4252769943 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44dc03d470 con 0x561dfeda9770 2024-04-25T10:01:51.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.761+0000 7f44c97fa640 1 -- 172.21.15.7:0/4252769943 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc03d860 con 0x561dfeda9770 2024-04-25T10:01:51.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.761+0000 7f44ec824740 1 -- 172.21.15.7:0/4252769943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561dfeda9770 msgr2=0x561dfedacf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:51.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.761+0000 7f44ec824740 1 --2- 172.21.15.7:0/4252769943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561dfeda9770 0x561dfedacf80 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f44dc00aea0 tx=0x7f44dc02f000 comp rx=0 tx=0).stop 2024-04-25T10:01:51.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.762+0000 7f44ec824740 1 -- 172.21.15.7:0/4252769943 shutdown_connections 2024-04-25T10:01:51.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.762+0000 7f44ec824740 1 --2- 172.21.15.7:0/4252769943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561dfeda9770 0x561dfedacf80 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.762+0000 7f44ec824740 1 --2- 172.21.15.7:0/4252769943 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x561dfedd6ef0 0x561dfedd9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.762+0000 7f44ec824740 1 --2- 172.21.15.7:0/4252769943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561dfedd6b10 0x561dfedd9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.762+0000 7f44ec824740 1 -- 172.21.15.7:0/4252769943 >> 172.21.15.7:0/4252769943 conn(0x561dfedab9e0 msgr2=0x561dfedf4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:51.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.762+0000 7f44ec824740 1 -- 172.21.15.7:0/4252769943 shutdown_connections 2024-04-25T10:01:51.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.762+0000 7f44ec824740 1 -- 172.21.15.7:0/4252769943 wait complete. 2024-04-25T10:01:51.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.762+0000 7f44ec824740 1 -- start start 2024-04-25T10:01:51.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.762+0000 7f44ec824740 1 Processor -- start 2024-04-25T10:01:51.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.763+0000 7f44ec824740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561dfedd6b10 0x561dfedf5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:51.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.763+0000 7f44ec824740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561dfedd6ef0 0x561dfedd2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:51.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.763+0000 7f44ec824740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x561dfedd00c0 0x561dfedd0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:51.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.763+0000 7f44ec824740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dfedaeb90 con 0x561dfedd6b10 2024-04-25T10:01:51.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.763+0000 7f44ec824740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dfecb14b0 con 0x561dfedd6ef0 2024-04-25T10:01:51.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.763+0000 7f44ec824740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x561dfedaee70 con 0x561dfedd00c0 2024-04-25T10:01:51.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.763+0000 7f44ec824740 10 client.0 _ll_register_callbacks cb 0x561dfecf1180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:01:51.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.763+0000 7f44e37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561dfedd6b10 0x561dfedf5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:51.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.763+0000 7f44e37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561dfedd6b10 0x561dfedf5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44512/0 (socket says 172.21.15.7:44512) 2024-04-25T10:01:51.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.763+0000 7f44e37fe640 1 -- 172.21.15.7:0/2103346009 learned_addr learned my addr 172.21.15.7:0/2103346009 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:51.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.763+0000 7f44e2ffd640 1 --2- 172.21.15.7:0/2103346009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561dfedd6ef0 0x561dfedd2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:51.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.763+0000 7f44e3fff640 1 --2- 172.21.15.7:0/2103346009 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x561dfedd00c0 0x561dfedd0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:51.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.763+0000 7f44e37fe640 1 -- 172.21.15.7:0/2103346009 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x561dfedd00c0 msgr2=0x561dfedd0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:51.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.763+0000 7f44e37fe640 1 --2- 172.21.15.7:0/2103346009 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x561dfedd00c0 0x561dfedd0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.763+0000 7f44e37fe640 1 -- 172.21.15.7:0/2103346009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561dfedd6ef0 msgr2=0x561dfedd2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:51.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.763+0000 7f44e37fe640 1 --2- 172.21.15.7:0/2103346009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561dfedd6ef0 0x561dfedd2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.763+0000 7f44e37fe640 1 -- 172.21.15.7:0/2103346009 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561dfeaf17d0 con 0x561dfedd6b10 2024-04-25T10:01:51.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.763+0000 7f44e2ffd640 1 --2- 172.21.15.7:0/2103346009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561dfedd6ef0 0x561dfedd2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:01:51.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.763+0000 7f44e3fff640 1 --2- 172.21.15.7:0/2103346009 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x561dfedd00c0 0x561dfedd0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:01:51.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.764+0000 7f44e37fe640 1 --2- 172.21.15.7:0/2103346009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561dfedd6b10 0x561dfedf5450 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f44d4005f40 tx=0x7f44d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83ceac3edc0f2d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:51.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.764+0000 7f44c27fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:01:51.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.764+0000 7f44c27fc640 1 -- 172.21.15.7:0/2103346009 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d4007560 con 0x561dfedd6b10 2024-04-25T10:01:51.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.764+0000 7f44c27fc640 1 -- 172.21.15.7:0/2103346009 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f44d4021cd0 con 0x561dfedd6b10 2024-04-25T10:01:51.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.764+0000 7f44ec824740 1 -- 172.21.15.7:0/2103346009 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f44dc03d470 con 0x561dfedd6b10 2024-04-25T10:01:51.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.764+0000 7f44c27fc640 1 -- 172.21.15.7:0/2103346009 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44d4007700 con 0x561dfedd6b10 2024-04-25T10:01:51.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.764+0000 7f44ec824740 10 client.7944 fetch_fsmap learned FSMap version 60 2024-04-25T10:01:51.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.764+0000 7f44ec824740 1 -- 172.21.15.7:0/2103346009 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x561dfea273f0 con 0x561dfedd6b10 2024-04-25T10:01:51.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.764+0000 7f44c27fc640 1 -- 172.21.15.7:0/2103346009 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44dc03d470 con 0x561dfedd6b10 2024-04-25T10:01:51.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.764+0000 7f44c27fc640 1 -- 172.21.15.7:0/2103346009 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 60) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f44d4021420 con 0x561dfedd6b10 2024-04-25T10:01:51.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.764+0000 7f44ec824740 10 client.7944 fetch_fsmap finished waiting for FSMap version 60 2024-04-25T10:01:51.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.764+0000 7f44ec824740 10 client.7944 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T10:01:51.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.764+0000 7f44ec824740 20 client.7944 populate_metadata read hostname 'smithi007' 2024-04-25T10:01:51.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.764+0000 7f44ec824740 1 --2- 172.21.15.7:0/2103346009 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x561dfedf7240 0x561dfedf7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:51.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.764+0000 7f44ec824740 4 client.7944 mds_command: new command op to 7734 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:01:51.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.764+0000 7f44ec824740 1 -- 172.21.15.7:0/2103346009 --> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561dfed202e0 con 0x561dfedf7240 2024-04-25T10:01:51.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.765+0000 7f44e2ffd640 1 --2- 172.21.15.7:0/2103346009 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x561dfedf7240 0x561dfedf7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:51.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.765+0000 7f44e2ffd640 1 --2- 172.21.15.7:0/2103346009 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x561dfedf7240 0x561dfedf7640 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfb4cfb1108f01b5 server_cookie=f06bf51bbda5b532 in_seq=0 out_seq=0 2024-04-25T10:01:51.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.765+0000 7f44c27fc640 10 client.7944 ms_handle_connect on v2:172.21.15.7:6836/3829085443 2024-04-25T10:01:51.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.765+0000 7f44c27fc640 1 -- 172.21.15.7:0/2103346009 <== mds.0 v2:172.21.15.7:6836/3829085443 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561dfed202e0 con 0x561dfedf7240 2024-04-25T10:01:51.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.765+0000 7f44c27fc640 10 client.7944 handle_command_reply: tid=0 2024-04-25T10:01:51.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.765+0000 7f44ec824740 1 client.7944 shutdown 2024-04-25T10:01:51.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.765+0000 7f44ec824740 1 -- 172.21.15.7:0/2103346009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561dfedd6b10 msgr2=0x561dfedf5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:51.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.765+0000 7f44ec824740 1 --2- 172.21.15.7:0/2103346009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561dfedd6b10 0x561dfedf5450 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f44d4005f40 tx=0x7f44d40057f0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.766+0000 7f44ec824740 1 -- 172.21.15.7:0/2103346009 shutdown_connections 2024-04-25T10:01:51.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.766+0000 7f44ec824740 1 --2- 172.21.15.7:0/2103346009 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x561dfedf7240 0x561dfedf7640 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.766+0000 7f44ec824740 1 --2- 172.21.15.7:0/2103346009 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x561dfedd00c0 0x561dfedd0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.766+0000 7f44ec824740 1 --2- 172.21.15.7:0/2103346009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561dfedd6ef0 0x561dfedd2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.766+0000 7f44ec824740 1 --2- 172.21.15.7:0/2103346009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561dfedd6b10 0x561dfedf5450 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.766+0000 7f44c27fc640 0 client.7944 ms_handle_reset on v2:172.21.15.7:6836/3829085443 2024-04-25T10:01:51.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.766+0000 7f44ec824740 1 -- 172.21.15.7:0/2103346009 >> 172.21.15.7:0/2103346009 conn(0x561dfeda9770 msgr2=0x561dfedd1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:51.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.766+0000 7f44ec824740 1 -- 172.21.15.7:0/2103346009 shutdown_connections 2024-04-25T10:01:51.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.766+0000 7f44ec824740 1 -- 172.21.15.7:0/2103346009 wait complete. 2024-04-25T10:01:51.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.766+0000 7f44ec824740 20 client.7944 trim_cache size 0 max 16384 2024-04-25T10:01:51.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.781+0000 7f44ec824740 1 Processor -- start 2024-04-25T10:01:51.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.781+0000 7f44ec824740 1 -- start start 2024-04-25T10:01:51.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.782+0000 7f44ec824740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561dfedd00c0 0x561dfedd3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:51.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.782+0000 7f44ec824740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561dfedd6b10 0x561dfedae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:51.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.782+0000 7f44ec824740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x561dfedd6ef0 0x561dfedf4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:51.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.782+0000 7f44ec824740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e41fc060 con 0x561dfedd00c0 2024-04-25T10:01:51.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.782+0000 7f44ec824740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e41fb1e0 con 0x561dfedd6b10 2024-04-25T10:01:51.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.782+0000 7f44ec824740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e40b1f70 con 0x561dfedd6ef0 2024-04-25T10:01:51.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.782+0000 7f44e37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561dfedd00c0 0x561dfedd3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:51.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.782+0000 7f44e37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561dfedd00c0 0x561dfedd3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44520/0 (socket says 172.21.15.7:44520) 2024-04-25T10:01:51.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.782+0000 7f44e37fe640 1 -- 172.21.15.7:0/3186870946 learned_addr learned my addr 172.21.15.7:0/3186870946 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:51.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.782+0000 7f44e2ffd640 1 --2- 172.21.15.7:0/3186870946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561dfedd6b10 0x561dfedae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:51.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.782+0000 7f44e3fff640 1 --2- 172.21.15.7:0/3186870946 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x561dfedd6ef0 0x561dfedf4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:51.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.782+0000 7f44e37fe640 1 -- 172.21.15.7:0/3186870946 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x561dfedd6ef0 msgr2=0x561dfedf4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:51.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.782+0000 7f44e37fe640 1 --2- 172.21.15.7:0/3186870946 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x561dfedd6ef0 0x561dfedf4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.782+0000 7f44e37fe640 1 -- 172.21.15.7:0/3186870946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561dfedd6b10 msgr2=0x561dfedae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:51.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.782+0000 7f44e37fe640 1 --2- 172.21.15.7:0/3186870946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561dfedd6b10 0x561dfedae3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.782+0000 7f44e37fe640 1 -- 172.21.15.7:0/3186870946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561dfe9e70f0 con 0x561dfedd00c0 2024-04-25T10:01:51.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.782+0000 7f44e37fe640 1 --2- 172.21.15.7:0/3186870946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561dfedd00c0 0x561dfedd3ba0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f44d4005bc0 tx=0x7f44d401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=588ced5bb6341206 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:51.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.782+0000 7f44c8ff9640 1 -- 172.21.15.7:0/3186870946 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d4038070 con 0x561dfedd00c0 2024-04-25T10:01:51.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.782+0000 7f44c8ff9640 1 -- 172.21.15.7:0/3186870946 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d400eb60 con 0x561dfedd00c0 2024-04-25T10:01:51.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.782+0000 7f44c8ff9640 1 -- 172.21.15.7:0/3186870946 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d4030070 con 0x561dfedd00c0 2024-04-25T10:01:51.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.783+0000 7f44ec824740 1 -- 172.21.15.7:0/3186870946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561dfedd00c0 msgr2=0x561dfedd3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:51.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.783+0000 7f44ec824740 1 --2- 172.21.15.7:0/3186870946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561dfedd00c0 0x561dfedd3ba0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f44d4005bc0 tx=0x7f44d401e000 comp rx=0 tx=0).stop 2024-04-25T10:01:51.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.783+0000 7f44ec824740 1 -- 172.21.15.7:0/3186870946 shutdown_connections 2024-04-25T10:01:51.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.783+0000 7f44ec824740 1 --2- 172.21.15.7:0/3186870946 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x561dfedd6ef0 0x561dfedf4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.783+0000 7f44ec824740 1 --2- 172.21.15.7:0/3186870946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561dfedd6b10 0x561dfedae3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.783+0000 7f44ec824740 1 --2- 172.21.15.7:0/3186870946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561dfedd00c0 0x561dfedd3ba0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.783+0000 7f44ec824740 1 -- 172.21.15.7:0/3186870946 >> 172.21.15.7:0/3186870946 conn(0x561dfeda9770 msgr2=0x561dfee15680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:51.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.783+0000 7f44ec824740 1 -- 172.21.15.7:0/3186870946 shutdown_connections 2024-04-25T10:01:51.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.783+0000 7f44ec824740 1 -- 172.21.15.7:0/3186870946 wait complete. 2024-04-25T10:01:51.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.784+0000 7f44ec824740 1 -- start start 2024-04-25T10:01:51.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.784+0000 7f44ec824740 1 Processor -- start 2024-04-25T10:01:51.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.785+0000 7f44ec824740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561dfedd00c0 0x561dfee5ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:51.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.785+0000 7f44ec824740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561dfedd6b10 0x561dfeddc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:51.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.785+0000 7f44ec824740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x561dfedd6ef0 0x561dfedf1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:51.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.785+0000 7f44ec824740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dfedead30 con 0x561dfedd00c0 2024-04-25T10:01:51.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.785+0000 7f44ec824740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e41fac10 con 0x561dfedd6b10 2024-04-25T10:01:51.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.785+0000 7f44ec824740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x561dfedfc750 con 0x561dfedd6ef0 2024-04-25T10:01:51.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.785+0000 7f44ec824740 10 client.0 _ll_register_callbacks cb 0x7f44dc035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:01:51.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.785+0000 7f44e37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561dfedd00c0 0x561dfee5ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:51.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.785+0000 7f44e37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561dfedd00c0 0x561dfee5ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44534/0 (socket says 172.21.15.7:44534) 2024-04-25T10:01:51.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.785+0000 7f44e37fe640 1 -- 172.21.15.7:0/886241604 learned_addr learned my addr 172.21.15.7:0/886241604 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:51.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.785+0000 7f44e3fff640 1 --2- 172.21.15.7:0/886241604 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x561dfedd6ef0 0x561dfedf1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:51.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.785+0000 7f44e2ffd640 1 --2- 172.21.15.7:0/886241604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561dfedd6b10 0x561dfeddc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:51.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.785+0000 7f44e37fe640 1 -- 172.21.15.7:0/886241604 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x561dfedd6ef0 msgr2=0x561dfedf1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:51.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.785+0000 7f44e37fe640 1 --2- 172.21.15.7:0/886241604 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x561dfedd6ef0 0x561dfedf1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.785+0000 7f44e37fe640 1 -- 172.21.15.7:0/886241604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561dfedd6b10 msgr2=0x561dfeddc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:51.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.785+0000 7f44e37fe640 1 --2- 172.21.15.7:0/886241604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561dfedd6b10 0x561dfeddc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.785+0000 7f44e37fe640 1 -- 172.21.15.7:0/886241604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561dfedd51f0 con 0x561dfedd00c0 2024-04-25T10:01:51.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.785+0000 7f44e2ffd640 1 --2- 172.21.15.7:0/886241604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561dfedd6b10 0x561dfeddc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:01:51.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.785+0000 7f44e37fe640 1 --2- 172.21.15.7:0/886241604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561dfedd00c0 0x561dfee5ea80 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f44d4011040 tx=0x7f44d4007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd30f518bd98040 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:51.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.785+0000 7f44c27fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:01:51.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.785+0000 7f44c27fc640 1 -- 172.21.15.7:0/886241604 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d4041060 con 0x561dfedd00c0 2024-04-25T10:01:51.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.785+0000 7f44c27fc640 1 -- 172.21.15.7:0/886241604 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f44d4005040 con 0x561dfedd00c0 2024-04-25T10:01:51.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.785+0000 7f44ec824740 1 -- 172.21.15.7:0/886241604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f44d400eb60 con 0x561dfedd00c0 2024-04-25T10:01:51.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.786+0000 7f44c27fc640 1 -- 172.21.15.7:0/886241604 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44d4047050 con 0x561dfedd00c0 2024-04-25T10:01:51.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.786+0000 7f44ec824740 10 client.7950 fetch_fsmap learned FSMap version 60 2024-04-25T10:01:51.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.786+0000 7f44ec824740 1 -- 172.21.15.7:0/886241604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x561dfedf7900 con 0x561dfedd00c0 2024-04-25T10:01:51.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.786+0000 7f44c27fc640 1 -- 172.21.15.7:0/886241604 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d400eb60 con 0x561dfedd00c0 2024-04-25T10:01:51.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.786+0000 7f44c27fc640 1 -- 172.21.15.7:0/886241604 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 60) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f44d404a020 con 0x561dfedd00c0 2024-04-25T10:01:51.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.786+0000 7f44ec824740 10 client.7950 fetch_fsmap finished waiting for FSMap version 60 2024-04-25T10:01:51.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.786+0000 7f44ec824740 10 client.7950 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T10:01:51.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.786+0000 7f44ec824740 20 client.7950 populate_metadata read hostname 'smithi007' 2024-04-25T10:01:51.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.786+0000 7f44ec824740 1 --2- 172.21.15.7:0/886241604 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x561dfedea8f0 0x561dfedf2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:51.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.786+0000 7f44ec824740 4 client.7950 mds_command: new command op to 7734 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T10:01:51.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.786+0000 7f44ec824740 1 -- 172.21.15.7:0/886241604 --> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561dfed1a630 con 0x561dfedea8f0 2024-04-25T10:01:51.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.786+0000 7f44e2ffd640 1 --2- 172.21.15.7:0/886241604 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x561dfedea8f0 0x561dfedf2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:51.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.786+0000 7f44e2ffd640 1 --2- 172.21.15.7:0/886241604 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x561dfedea8f0 0x561dfedf2180 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3de020679389ea8 server_cookie=a475ebcf61c3ccb8 in_seq=0 out_seq=0 2024-04-25T10:01:51.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.786+0000 7f44c27fc640 10 client.7950 ms_handle_connect on v2:172.21.15.7:6836/3829085443 2024-04-25T10:01:51.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.786+0000 7f44c27fc640 1 -- 172.21.15.7:0/886241604 <== mds.0 v2:172.21.15.7:6836/3829085443 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x561dfed1a630 con 0x561dfedea8f0 2024-04-25T10:01:51.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.786+0000 7f44c27fc640 10 client.7950 handle_command_reply: tid=0 2024-04-25T10:01:51.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.786+0000 7f44ec824740 1 client.7950 shutdown 2024-04-25T10:01:51.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.787+0000 7f44ec824740 1 -- 172.21.15.7:0/886241604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561dfedd00c0 msgr2=0x561dfee5ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:51.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.787+0000 7f44ec824740 1 --2- 172.21.15.7:0/886241604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561dfedd00c0 0x561dfee5ea80 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f44d4011040 tx=0x7f44d4007000 comp rx=0 tx=0).stop 2024-04-25T10:01:51.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.787+0000 7f44ec824740 1 -- 172.21.15.7:0/886241604 shutdown_connections 2024-04-25T10:01:51.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.787+0000 7f44ec824740 1 --2- 172.21.15.7:0/886241604 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x561dfedea8f0 0x561dfedf2180 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.787+0000 7f44ec824740 1 --2- 172.21.15.7:0/886241604 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x561dfedd6ef0 0x561dfedf1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.787+0000 7f44ec824740 1 --2- 172.21.15.7:0/886241604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561dfedd6b10 0x561dfeddc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.787+0000 7f44c27fc640 0 client.7950 ms_handle_reset on v2:172.21.15.7:6836/3829085443 2024-04-25T10:01:51.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.787+0000 7f44ec824740 1 --2- 172.21.15.7:0/886241604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561dfedd00c0 0x561dfee5ea80 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.787+0000 7f44ec824740 1 -- 172.21.15.7:0/886241604 >> 172.21.15.7:0/886241604 conn(0x561dfeda9770 msgr2=0x561dfedf4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:51.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.787+0000 7f44ec824740 1 -- 172.21.15.7:0/886241604 shutdown_connections 2024-04-25T10:01:51.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.787+0000 7f44ec824740 1 -- 172.21.15.7:0/886241604 wait complete. 2024-04-25T10:01:51.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.787+0000 7f44ec824740 20 client.7950 trim_cache size 0 max 16384 2024-04-25T10:01:51.798 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:01:51.798 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-04-25T10:01:51.798 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-04-25T10:01:51.798 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:01:51.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.787+0000 7f44e9b22640 1 -- 172.21.15.7:0/950842812 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f44d006b4d0 msgr2=0x7f44d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:51.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.787+0000 7f44e9b22640 1 --2- 172.21.15.7:0/950842812 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f44d006b4d0 0x7f44d006d990 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f44d4005880 tx=0x7f44d4009040 comp rx=0 tx=0).stop 2024-04-25T10:01:51.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.787+0000 7f44e9b22640 1 -- 172.21.15.7:0/950842812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44e40ae9e0 msgr2=0x7f44e4155710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:51.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.787+0000 7f44e9b22640 1 --2- 172.21.15.7:0/950842812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44e40ae9e0 0x7f44e4155710 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f44d800ebe0 tx=0x7f44d800c520 comp rx=0 tx=0).stop 2024-04-25T10:01:51.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.787+0000 7f44e9b22640 1 -- 172.21.15.7:0/950842812 shutdown_connections 2024-04-25T10:01:51.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.787+0000 7f44e9b22640 1 --2- 172.21.15.7:0/950842812 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f44d006b4d0 0x7f44d006d990 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.787+0000 7f44e9b22640 1 --2- 172.21.15.7:0/950842812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44e4154590 0x7f44e4147ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.787+0000 7f44e9b22640 1 --2- 172.21.15.7:0/950842812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44e40ae9e0 0x7f44e4155710 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.787+0000 7f44e9b22640 1 --2- 172.21.15.7:0/950842812 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f44e40720d0 0x7f44e414c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.787+0000 7f44e9b22640 1 -- 172.21.15.7:0/950842812 >> 172.21.15.7:0/950842812 conn(0x7f44e406ab60 msgr2=0x7f44e406af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:51.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.787+0000 7f44e9b22640 1 -- 172.21.15.7:0/950842812 shutdown_connections 2024-04-25T10:01:51.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.787+0000 7f44e9b22640 1 -- 172.21.15.7:0/950842812 wait complete. 2024-04-25T10:01:51.803 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T10:01:51.803 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:01:51.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.899+0000 7f751faf5640 1 Processor -- start 2024-04-25T10:01:51.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.899+0000 7f751faf5640 1 -- start start 2024-04-25T10:01:51.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.900+0000 7f751faf5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f751815da20 0x7f751809a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:51.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.900+0000 7f751faf5640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f751806bc70 0x7f75180d0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:51.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.900+0000 7f751faf5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f75180d10b0 0x7f751806c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:51.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.900+0000 7f751faf5640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75180d06e0 con 0x7f751806bc70 2024-04-25T10:01:51.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.900+0000 7f751faf5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f751809a940 con 0x7f751815da20 2024-04-25T10:01:51.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.900+0000 7f751faf5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75180cfad0 con 0x7f75180d10b0 2024-04-25T10:01:51.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.900+0000 7f751d090640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f751806bc70 0x7f75180d0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:51.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.900+0000 7f751d090640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f751806bc70 0x7f75180d0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44538/0 (socket says 172.21.15.7:44538) 2024-04-25T10:01:51.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.900+0000 7f751d090640 1 -- 172.21.15.7:0/1637574360 learned_addr learned my addr 172.21.15.7:0/1637574360 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:51.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.900+0000 7f751e092640 1 --2- 172.21.15.7:0/1637574360 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f75180d10b0 0x7f751806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:51.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.900+0000 7f751d891640 1 --2- 172.21.15.7:0/1637574360 >> v2:172.21.15.55:3300/0 conn(0x7f751815da20 0x7f751809a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:51.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.900+0000 7f751d090640 1 -- 172.21.15.7:0/1637574360 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f75180d10b0 msgr2=0x7f751806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:51.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.900+0000 7f751d090640 1 --2- 172.21.15.7:0/1637574360 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f75180d10b0 0x7f751806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.900+0000 7f751d090640 1 -- 172.21.15.7:0/1637574360 >> v2:172.21.15.55:3300/0 conn(0x7f751815da20 msgr2=0x7f751809a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:51.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.900+0000 7f751d090640 1 --2- 172.21.15.7:0/1637574360 >> v2:172.21.15.55:3300/0 conn(0x7f751815da20 0x7f751809a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.900+0000 7f751d090640 1 -- 172.21.15.7:0/1637574360 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75180cfdb0 con 0x7f751806bc70 2024-04-25T10:01:51.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.900+0000 7f751d891640 1 --2- 172.21.15.7:0/1637574360 >> v2:172.21.15.55:3300/0 conn(0x7f751815da20 0x7f751809a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:01:51.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.901+0000 7f751d090640 1 --2- 172.21.15.7:0/1637574360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f751806bc70 0x7f75180d0b70 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f751806dca0 tx=0x7f750802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc009bf0a7fd3b4b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:51.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.901+0000 7f751c88f640 1 -- 172.21.15.7:0/1637574360 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7508037070 con 0x7f751806bc70 2024-04-25T10:01:51.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.901+0000 7f751c88f640 1 -- 172.21.15.7:0/1637574360 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7508032440 con 0x7f751806bc70 2024-04-25T10:01:51.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.901+0000 7f751c88f640 1 -- 172.21.15.7:0/1637574360 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7508032810 con 0x7f751806bc70 2024-04-25T10:01:51.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.902+0000 7f751faf5640 1 -- 172.21.15.7:0/1637574360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f751806bc70 msgr2=0x7f75180d0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:51.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.902+0000 7f751faf5640 1 --2- 172.21.15.7:0/1637574360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f751806bc70 0x7f75180d0b70 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f751806dca0 tx=0x7f750802a1e0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.902+0000 7f751faf5640 1 -- 172.21.15.7:0/1637574360 shutdown_connections 2024-04-25T10:01:51.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.902+0000 7f751faf5640 1 --2- 172.21.15.7:0/1637574360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f751806bc70 0x7f75180d0b70 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.902+0000 7f751faf5640 1 --2- 172.21.15.7:0/1637574360 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f75180d10b0 0x7f751806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.902+0000 7f751faf5640 1 --2- 172.21.15.7:0/1637574360 >> v2:172.21.15.55:3300/0 conn(0x7f751815da20 0x7f751809a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.902+0000 7f751faf5640 1 -- 172.21.15.7:0/1637574360 >> 172.21.15.7:0/1637574360 conn(0x7f75180d16f0 msgr2=0x7f75180d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:51.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.902+0000 7f751faf5640 1 -- 172.21.15.7:0/1637574360 shutdown_connections 2024-04-25T10:01:51.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.902+0000 7f751faf5640 1 -- 172.21.15.7:0/1637574360 wait complete. 2024-04-25T10:01:51.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.903+0000 7f751faf5640 1 Processor -- start 2024-04-25T10:01:51.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.903+0000 7f751faf5640 1 -- start start 2024-04-25T10:01:51.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.904+0000 7f751faf5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f751806bc70 0x7f7518154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:51.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.904+0000 7f751faf5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75180d10b0 0x7f75180c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:51.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.904+0000 7f751faf5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f751815da20 0x7f75180b5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:51.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.904+0000 7f751faf5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751815de00 con 0x7f751815da20 2024-04-25T10:01:51.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.904+0000 7f751faf5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75180d0370 con 0x7f75180d10b0 2024-04-25T10:01:51.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.904+0000 7f751faf5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751815df80 con 0x7f751806bc70 2024-04-25T10:01:51.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.904+0000 7f751e092640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f751815da20 0x7f75180b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:51.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.904+0000 7f751e092640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f751815da20 0x7f75180b5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44554/0 (socket says 172.21.15.7:44554) 2024-04-25T10:01:51.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.904+0000 7f751e092640 1 -- 172.21.15.7:0/2995556495 learned_addr learned my addr 172.21.15.7:0/2995556495 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:51.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.904+0000 7f751d090640 1 --2- 172.21.15.7:0/2995556495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75180d10b0 0x7f75180c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:51.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.904+0000 7f751d891640 1 --2- 172.21.15.7:0/2995556495 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f751806bc70 0x7f7518154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:51.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.904+0000 7f751e092640 1 -- 172.21.15.7:0/2995556495 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f751806bc70 msgr2=0x7f7518154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:51.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.904+0000 7f751e092640 1 --2- 172.21.15.7:0/2995556495 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f751806bc70 0x7f7518154fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.904+0000 7f751e092640 1 -- 172.21.15.7:0/2995556495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75180d10b0 msgr2=0x7f75180c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:51.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.904+0000 7f751e092640 1 --2- 172.21.15.7:0/2995556495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75180d10b0 0x7f75180c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:51.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.904+0000 7f751e092640 1 -- 172.21.15.7:0/2995556495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75180c97d0 con 0x7f751815da20 2024-04-25T10:01:51.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.904+0000 7f751d090640 1 --2- 172.21.15.7:0/2995556495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75180d10b0 0x7f75180c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:01:51.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.904+0000 7f751d891640 1 --2- 172.21.15.7:0/2995556495 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f751806bc70 0x7f7518154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:01:51.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.904+0000 7f751e092640 1 --2- 172.21.15.7:0/2995556495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f751815da20 0x7f75180b5980 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f7510009fd0 tx=0x7f751000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:51.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.904+0000 7f750e7fc640 1 -- 172.21.15.7:0/2995556495 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7510014420 con 0x7f751815da20 2024-04-25T10:01:51.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.904+0000 7f750e7fc640 1 -- 172.21.15.7:0/2995556495 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7510019070 con 0x7f751815da20 2024-04-25T10:01:51.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.904+0000 7f751faf5640 1 -- 172.21.15.7:0/2995556495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75180c9210 con 0x7f751815da20 2024-04-25T10:01:51.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.904+0000 7f750e7fc640 1 -- 172.21.15.7:0/2995556495 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7510014800 con 0x7f751815da20 2024-04-25T10:01:51.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.904+0000 7f751faf5640 1 -- 172.21.15.7:0/2995556495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75180c9d70 con 0x7f751815da20 2024-04-25T10:01:51.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.905+0000 7f751faf5640 1 -- 172.21.15.7:0/2995556495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7518068fd0 con 0x7f751815da20 2024-04-25T10:01:51.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.906+0000 7f750e7fc640 1 -- 172.21.15.7:0/2995556495 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f75100149a0 con 0x7f751815da20 2024-04-25T10:01:51.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.906+0000 7f750e7fc640 1 --2- 172.21.15.7:0/2995556495 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f74fc06b4d0 0x7f74fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:51.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.907+0000 7f750e7fc640 1 -- 172.21.15.7:0/2995556495 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f751008acd0 con 0x7f751815da20 2024-04-25T10:01:51.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.907+0000 7f751d891640 1 --2- 172.21.15.7:0/2995556495 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f74fc06b4d0 0x7f74fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:51.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.907+0000 7f751d891640 1 --2- 172.21.15.7:0/2995556495 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f74fc06b4d0 0x7f74fc06d990 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7514006fd0 tx=0x7f7514008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:51.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:51.911+0000 7f750e7fc640 1 -- 172.21.15.7:0/2995556495 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7510059900 con 0x7f751815da20 2024-04-25T10:01:52.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.130+0000 7f751faf5640 1 -- 172.21.15.7:0/2995556495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75180cc1e0 con 0x7f751815da20 2024-04-25T10:01:52.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.131+0000 7f750e7fc640 1 -- 172.21.15.7:0/2995556495 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f7510059200 con 0x7f751815da20 2024-04-25T10:01:52.136 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:01:52.136 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2505539422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2505539422},{"type":"v1","addr":"172.21.15.55:6834","nonce":2505539422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2808857776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2808857776},{"type":"v1","addr":"172.21.15.55:6835","nonce":2808857776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7518,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1796103144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1796103144},{"type":"v1","addr":"172.21.15.7:6835","nonce":1796103144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:00:34.054759+0000","modified":"2024-04-25T10:00:54.397441+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7734},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7734":{"gid":7734,"name":"a","rank":0,"incarnation":56,"state":"up:active","state_seq":6,"addr":"172.21.15.7:6837/3829085443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3829085443},{"type":"v1","addr":"172.21.15.7:6837","nonce":3829085443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:01:52.136 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 60 2024-04-25T10:01:52.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.133+0000 7f751faf5640 1 -- 172.21.15.7:0/2995556495 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f74fc06b4d0 msgr2=0x7f74fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:52.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.133+0000 7f751faf5640 1 --2- 172.21.15.7:0/2995556495 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f74fc06b4d0 0x7f74fc06d990 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7514006fd0 tx=0x7f7514008040 comp rx=0 tx=0).stop 2024-04-25T10:01:52.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.133+0000 7f751faf5640 1 -- 172.21.15.7:0/2995556495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f751815da20 msgr2=0x7f75180b5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:52.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.133+0000 7f751faf5640 1 --2- 172.21.15.7:0/2995556495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f751815da20 0x7f75180b5980 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f7510009fd0 tx=0x7f751000e4b0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.133+0000 7f751faf5640 1 -- 172.21.15.7:0/2995556495 shutdown_connections 2024-04-25T10:01:52.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.133+0000 7f751faf5640 1 --2- 172.21.15.7:0/2995556495 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f74fc06b4d0 0x7f74fc06d990 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.133+0000 7f751faf5640 1 --2- 172.21.15.7:0/2995556495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f751815da20 0x7f75180b5980 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.133+0000 7f751faf5640 1 --2- 172.21.15.7:0/2995556495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75180d10b0 0x7f75180c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.133+0000 7f751faf5640 1 --2- 172.21.15.7:0/2995556495 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f751806bc70 0x7f7518154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.133+0000 7f751faf5640 1 -- 172.21.15.7:0/2995556495 >> 172.21.15.7:0/2995556495 conn(0x7f75180d16f0 msgr2=0x7f751815c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:52.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.133+0000 7f751faf5640 1 -- 172.21.15.7:0/2995556495 shutdown_connections 2024-04-25T10:01:52.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.133+0000 7f751faf5640 1 -- 172.21.15.7:0/2995556495 wait complete. 2024-04-25T10:01:52.148 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-25T10:01:52.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.246+0000 7f2c5125a640 1 Processor -- start 2024-04-25T10:01:52.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.246+0000 7f2c5125a640 1 -- start start 2024-04-25T10:01:52.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.247+0000 7f2c5125a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2c4c06f7d0 0x7f2c4c1620a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.247+0000 7f2c5125a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c4c1625e0 con 0x7f2c4c0b2950 2024-04-25T10:01:52.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.247+0000 7f2c5125a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c4c06b0d0 con 0x7f2c4c06ab60 2024-04-25T10:01:52.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.247+0000 7f2c5125a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c161c10 con 0x7f2c4c06f7d0 2024-04-25T10:01:52.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.247+0000 7f2c4b59e640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2c4c0b2950 0x7f2c4c15d1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38582/0 (socket says 172.21.15.7:38582) 2024-04-25T10:01:52.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.247+0000 7f2c4b59e640 1 -- 172.21.15.7:0/2366652345 learned_addr learned my addr 172.21.15.7:0/2366652345 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:01:52.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.247+0000 7f2c4ad9d640 1 --2- 172.21.15.7:0/2366652345 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2c4c06f7d0 0x7f2c4c1620a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.247+0000 7f2c4a59c640 1 -- 172.21.15.7:0/2366652345 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3346980235 0 0) 0x7f2c4c1625e0 con 0x7f2c4c0b2950 2024-04-25T10:01:52.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.247+0000 7f2c4a59c640 1 -- 172.21.15.7:0/2366652345 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c38003520 con 0x7f2c4c0b2950 2024-04-25T10:01:52.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.247+0000 7f2c4a59c640 1 -- 172.21.15.7:0/2366652345 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223247337 0 0) 0x7f2c4c06b0d0 con 0x7f2c4c06ab60 2024-04-25T10:01:52.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.247+0000 7f2c4a59c640 1 -- 172.21.15.7:0/2366652345 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c4c1625e0 con 0x7f2c4c06ab60 2024-04-25T10:01:52.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.247+0000 7f2c4a59c640 1 -- 172.21.15.7:0/2366652345 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3203535797 0 0) 0x7f2c38003520 con 0x7f2c4c0b2950 2024-04-25T10:01:52.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.247+0000 7f2c4ad9d640 1 -- 172.21.15.7:0/2366652345 >> v1:172.21.15.55:6789/0 conn(0x7f2c4c06ab60 legacy=0x7f2c4c06fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:52.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.247+0000 7f2c4ad9d640 1 -- 172.21.15.7:0/2366652345 >> v1:172.21.15.7:6789/0 conn(0x7f2c4c0b2950 legacy=0x7f2c4c15d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:52.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.247+0000 7f2c4ad9d640 1 -- 172.21.15.7:0/2366652345 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4c06b3b0 con 0x7f2c4c06f7d0 2024-04-25T10:01:52.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.248+0000 7f2c4ad9d640 1 --2- 172.21.15.7:0/2366652345 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2c4c06f7d0 0x7f2c4c1620a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c009800 tx=0x7f2c3c02a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1107fb42021cf70 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:52.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.248+0000 7f2c4a59c640 1 -- 172.21.15.7:0/2366652345 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c037070 con 0x7f2c4c06f7d0 2024-04-25T10:01:52.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.248+0000 7f2c4a59c640 1 -- 172.21.15.7:0/2366652345 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3c02ace0 con 0x7f2c4c06f7d0 2024-04-25T10:01:52.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.248+0000 7f2c4a59c640 1 -- 172.21.15.7:0/2366652345 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c440019f0 con 0x7f2c4c06f7d0 2024-04-25T10:01:52.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.249+0000 7f2c5125a640 1 -- 172.21.15.7:0/2366652345 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2c4c06f7d0 msgr2=0x7f2c4c1620a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:52.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.249+0000 7f2c5125a640 1 --2- 172.21.15.7:0/2366652345 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2c4c06f7d0 0x7f2c4c1620a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c009800 tx=0x7f2c3c02a250 comp rx=0 tx=0).stop 2024-04-25T10:01:52.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.249+0000 7f2c5125a640 1 -- 172.21.15.7:0/2366652345 shutdown_connections 2024-04-25T10:01:52.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.249+0000 7f2c5125a640 1 --2- 172.21.15.7:0/2366652345 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2c4c06f7d0 0x7f2c4c1620a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.249+0000 7f2c5125a640 1 -- 172.21.15.7:0/2366652345 >> 172.21.15.7:0/2366652345 conn(0x7f2c4c0999f0 msgr2=0x7f2c4c0b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:52.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.249+0000 7f2c5125a640 1 -- 172.21.15.7:0/2366652345 shutdown_connections 2024-04-25T10:01:52.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.249+0000 7f2c5125a640 1 -- 172.21.15.7:0/2366652345 wait complete. 2024-04-25T10:01:52.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.250+0000 7f2c5125a640 1 Processor -- start 2024-04-25T10:01:52.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.250+0000 7f2c5125a640 1 -- start start 2024-04-25T10:01:52.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.251+0000 7f2c5125a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c4c06ab60 0x7f2c4c0b3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.251+0000 7f2c5125a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2c4c06f7d0 0x7f2c4c0b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.251+0000 7f2c5125a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c4c0b2950 0x7f2c4c14f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.251+0000 7f2c5125a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c0b2de0 con 0x7f2c4c0b2950 2024-04-25T10:01:52.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.251+0000 7f2c5125a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c0afd90 con 0x7f2c4c06ab60 2024-04-25T10:01:52.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.251+0000 7f2c5125a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c0b2f60 con 0x7f2c4c06f7d0 2024-04-25T10:01:52.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.251+0000 7f2c4b59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c4c0b2950 0x7f2c4c14f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.251+0000 7f2c4b59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c4c0b2950 0x7f2c4c14f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44568/0 (socket says 172.21.15.7:44568) 2024-04-25T10:01:52.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.251+0000 7f2c4b59e640 1 -- 172.21.15.7:0/860153046 learned_addr learned my addr 172.21.15.7:0/860153046 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:52.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.251+0000 7f2c4ad9d640 1 --2- 172.21.15.7:0/860153046 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c4c06ab60 0x7f2c4c0b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.251+0000 7f2c4259c640 1 --2- 172.21.15.7:0/860153046 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2c4c06f7d0 0x7f2c4c0b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.252+0000 7f2c4b59e640 1 -- 172.21.15.7:0/860153046 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2c4c06f7d0 msgr2=0x7f2c4c0b5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:52.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.252+0000 7f2c4b59e640 1 --2- 172.21.15.7:0/860153046 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2c4c06f7d0 0x7f2c4c0b5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.252+0000 7f2c4b59e640 1 -- 172.21.15.7:0/860153046 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c4c06ab60 msgr2=0x7f2c4c0b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:52.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.252+0000 7f2c4b59e640 1 --2- 172.21.15.7:0/860153046 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c4c06ab60 0x7f2c4c0b3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.252+0000 7f2c4b59e640 1 -- 172.21.15.7:0/860153046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4c14f820 con 0x7f2c4c0b2950 2024-04-25T10:01:52.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.252+0000 7f2c4b59e640 1 --2- 172.21.15.7:0/860153046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c4c0b2950 0x7f2c4c14f2e0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f2c44005c00 tx=0x7f2c4400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:52.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.252+0000 7f2c43fff640 1 -- 172.21.15.7:0/860153046 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c44017070 con 0x7f2c4c0b2950 2024-04-25T10:01:52.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.252+0000 7f2c43fff640 1 -- 172.21.15.7:0/860153046 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4400ad30 con 0x7f2c4c0b2950 2024-04-25T10:01:52.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.252+0000 7f2c5125a640 1 -- 172.21.15.7:0/860153046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c4c0c8780 con 0x7f2c4c0b2950 2024-04-25T10:01:52.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.252+0000 7f2c43fff640 1 -- 172.21.15.7:0/860153046 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c44012640 con 0x7f2c4c0b2950 2024-04-25T10:01:52.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.252+0000 7f2c5125a640 1 -- 172.21.15.7:0/860153046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c4c0c8d40 con 0x7f2c4c0b2950 2024-04-25T10:01:52.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.253+0000 7f2c43fff640 1 -- 172.21.15.7:0/860153046 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2c4401a070 con 0x7f2c4c0b2950 2024-04-25T10:01:52.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.254+0000 7f2c43fff640 1 --2- 172.21.15.7:0/860153046 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2c2c06b4d0 0x7f2c2c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.254+0000 7f2c43fff640 1 -- 172.21.15.7:0/860153046 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f2c4408a310 con 0x7f2c4c0b2950 2024-04-25T10:01:52.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.254+0000 7f2c4ad9d640 1 --2- 172.21.15.7:0/860153046 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2c2c06b4d0 0x7f2c2c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.254+0000 7f2c4ad9d640 1 --2- 172.21.15.7:0/860153046 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2c2c06b4d0 0x7f2c2c06d990 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c034000 tx=0x7f2c3c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:52.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.255+0000 7f2c54034740 1 Processor -- start 2024-04-25T10:01:52.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.255+0000 7f2c54034740 1 -- start start 2024-04-25T10:01:52.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.256+0000 7f2c54034740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559c00d28590 0x559c00d2a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.256+0000 7f2c54034740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c00d64c60 0x559c00d28970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.256+0000 7f2c54034740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559c00d53050 0x559c00d534d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.256+0000 7f2c54034740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c00c8bc60 con 0x559c00d64c60 2024-04-25T10:01:52.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.256+0000 7f2c54034740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c00c2ad80 con 0x559c00d53050 2024-04-25T10:01:52.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.256+0000 7f2c54034740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c00c87d00 con 0x559c00d28590 2024-04-25T10:01:52.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.256+0000 7f2c4259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c00d64c60 0x559c00d28970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.256+0000 7f2c4259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c00d64c60 0x559c00d28970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44582/0 (socket says 172.21.15.7:44582) 2024-04-25T10:01:52.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.256+0000 7f2c4259c640 1 -- 172.21.15.7:0/3484391742 learned_addr learned my addr 172.21.15.7:0/3484391742 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:52.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.256+0000 7f2c4ad9d640 1 --2- 172.21.15.7:0/3484391742 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559c00d28590 0x559c00d2a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.256+0000 7f2c4259c640 1 -- 172.21.15.7:0/3484391742 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559c00d28590 msgr2=0x559c00d2a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:52.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.256+0000 7f2c4259c640 1 --2- 172.21.15.7:0/3484391742 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559c00d28590 0x559c00d2a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.256+0000 7f2c4259c640 1 -- 172.21.15.7:0/3484391742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559c00d53050 msgr2=0x559c00d534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:52.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.256+0000 7f2c4259c640 1 --2- 172.21.15.7:0/3484391742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559c00d53050 0x559c00d534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.256+0000 7f2c4259c640 1 -- 172.21.15.7:0/3484391742 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c00a6c7c0 con 0x559c00d64c60 2024-04-25T10:01:52.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.256+0000 7f2c4259c640 1 --2- 172.21.15.7:0/3484391742 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c00d64c60 0x559c00d28970 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f2c34001870 tx=0x7f2c34007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1862491557cf7b61 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:52.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.256+0000 7f2c40d99640 1 -- 172.21.15.7:0/3484391742 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c340052e0 con 0x559c00d64c60 2024-04-25T10:01:52.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.256+0000 7f2c40d99640 1 -- 172.21.15.7:0/3484391742 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c34018070 con 0x559c00d64c60 2024-04-25T10:01:52.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.256+0000 7f2c40d99640 1 -- 172.21.15.7:0/3484391742 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3400fa10 con 0x559c00d64c60 2024-04-25T10:01:52.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.257+0000 7f2c54034740 1 -- 172.21.15.7:0/3484391742 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c00d64c60 msgr2=0x559c00d28970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:52.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.257+0000 7f2c54034740 1 --2- 172.21.15.7:0/3484391742 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c00d64c60 0x559c00d28970 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f2c34001870 tx=0x7f2c34007d20 comp rx=0 tx=0).stop 2024-04-25T10:01:52.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.257+0000 7f2c54034740 1 -- 172.21.15.7:0/3484391742 shutdown_connections 2024-04-25T10:01:52.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.257+0000 7f2c54034740 1 --2- 172.21.15.7:0/3484391742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559c00d53050 0x559c00d534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.257+0000 7f2c54034740 1 --2- 172.21.15.7:0/3484391742 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c00d64c60 0x559c00d28970 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.257+0000 7f2c54034740 1 --2- 172.21.15.7:0/3484391742 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559c00d28590 0x559c00d2a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.257+0000 7f2c54034740 1 -- 172.21.15.7:0/3484391742 >> 172.21.15.7:0/3484391742 conn(0x559c00cf06e0 msgr2=0x559c00d6e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:52.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.257+0000 7f2c54034740 1 -- 172.21.15.7:0/3484391742 shutdown_connections 2024-04-25T10:01:52.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.257+0000 7f2c54034740 1 -- 172.21.15.7:0/3484391742 wait complete. 2024-04-25T10:01:52.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.258+0000 7f2c54034740 1 -- start start 2024-04-25T10:01:52.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.258+0000 7f2c54034740 1 Processor -- start 2024-04-25T10:01:52.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.258+0000 7f2c54034740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559c00d28590 0x559c00d42b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.258+0000 7f2c54034740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559c00d53050 0x559c00d534d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.258+0000 7f2c54034740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c00d64c60 0x559c00d54f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.259+0000 7f2c54034740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c00c28840 con 0x559c00d64c60 2024-04-25T10:01:52.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.259+0000 7f2c54034740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c00d50ba0 con 0x559c00d53050 2024-04-25T10:01:52.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.259+0000 7f2c54034740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c00d66b60 con 0x559c00d28590 2024-04-25T10:01:52.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.259+0000 7f2c54034740 10 client.0 _ll_register_callbacks cb 0x559c00c42980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:01:52.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.259+0000 7f2c4b59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c00d64c60 0x559c00d54f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.259+0000 7f2c4b59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c00d64c60 0x559c00d54f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44586/0 (socket says 172.21.15.7:44586) 2024-04-25T10:01:52.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.259+0000 7f2c4b59e640 1 -- 172.21.15.7:0/3437707136 learned_addr learned my addr 172.21.15.7:0/3437707136 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:52.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.259+0000 7f2c4259c640 1 --2- 172.21.15.7:0/3437707136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559c00d53050 0x559c00d534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.259+0000 7f2c4ad9d640 1 --2- 172.21.15.7:0/3437707136 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559c00d28590 0x559c00d42b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.259+0000 7f2c4b59e640 1 -- 172.21.15.7:0/3437707136 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559c00d28590 msgr2=0x559c00d42b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:52.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.259+0000 7f2c4b59e640 1 --2- 172.21.15.7:0/3437707136 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559c00d28590 0x559c00d42b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.259+0000 7f2c4b59e640 1 -- 172.21.15.7:0/3437707136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559c00d53050 msgr2=0x559c00d534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:52.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.259+0000 7f2c4b59e640 1 --2- 172.21.15.7:0/3437707136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559c00d53050 0x559c00d534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.259+0000 7f2c4b59e640 1 -- 172.21.15.7:0/3437707136 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559c00accf50 con 0x559c00d64c60 2024-04-25T10:01:52.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.259+0000 7f2c4b59e640 1 --2- 172.21.15.7:0/3437707136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c00d64c60 0x559c00d54f30 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f2c44054cc0 tx=0x7f2c4405c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1989fa3f7cf130b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:52.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.259+0000 7f2c29ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:01:52.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.259+0000 7f2c29ffb640 1 -- 172.21.15.7:0/3437707136 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c44070370 con 0x559c00d64c60 2024-04-25T10:01:52.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.259+0000 7f2c29ffb640 1 -- 172.21.15.7:0/3437707136 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f2c44060ac0 con 0x559c00d64c60 2024-04-25T10:01:52.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.259+0000 7f2c54034740 1 -- 172.21.15.7:0/3437707136 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2c34018070 con 0x559c00d64c60 2024-04-25T10:01:52.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.259+0000 7f2c29ffb640 1 -- 172.21.15.7:0/3437707136 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c44088050 con 0x559c00d64c60 2024-04-25T10:01:52.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.260+0000 7f2c54034740 10 client.7968 fetch_fsmap learned FSMap version 60 2024-04-25T10:01:52.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.260+0000 7f2c54034740 1 -- 172.21.15.7:0/3437707136 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x559c009600b0 con 0x559c00d64c60 2024-04-25T10:01:52.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.260+0000 7f2c29ffb640 1 -- 172.21.15.7:0/3437707136 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c34018070 con 0x559c00d64c60 2024-04-25T10:01:52.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.260+0000 7f2c29ffb640 1 -- 172.21.15.7:0/3437707136 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 60) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2c440881f0 con 0x559c00d64c60 2024-04-25T10:01:52.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.260+0000 7f2c54034740 10 client.7968 fetch_fsmap finished waiting for FSMap version 60 2024-04-25T10:01:52.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.260+0000 7f2c54034740 10 client.7968 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:01:52.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.260+0000 7f2c54034740 20 client.7968 populate_metadata read hostname 'smithi007' 2024-04-25T10:01:52.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.260+0000 7f2c54034740 1 --2- 172.21.15.7:0/3437707136 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x559c00d65820 0x559c00d65c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.260+0000 7f2c54034740 4 client.7968 mds_command: new command op to 7734 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:01:52.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.260+0000 7f2c54034740 1 -- 172.21.15.7:0/3437707136 --> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559c00c4be60 con 0x559c00d65820 2024-04-25T10:01:52.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.260+0000 7f2c4ad9d640 1 --2- 172.21.15.7:0/3437707136 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x559c00d65820 0x559c00d65c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.260+0000 7f2c29ffb640 10 client.7968 ms_handle_connect on v2:172.21.15.7:6836/3829085443 2024-04-25T10:01:52.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.260+0000 7f2c4ad9d640 1 --2- 172.21.15.7:0/3437707136 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x559c00d65820 0x559c00d65c00 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c585d93b16dd5727 server_cookie=d280195fe606de29 in_seq=0 out_seq=0 2024-04-25T10:01:52.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.261+0000 7f2c29ffb640 1 -- 172.21.15.7:0/3437707136 <== mds.0 v2:172.21.15.7:6836/3829085443 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559c00c4be60 con 0x559c00d65820 2024-04-25T10:01:52.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.261+0000 7f2c29ffb640 10 client.7968 handle_command_reply: tid=0 2024-04-25T10:01:52.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.261+0000 7f2c54034740 1 client.7968 shutdown 2024-04-25T10:01:52.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.261+0000 7f2c54034740 1 -- 172.21.15.7:0/3437707136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c00d64c60 msgr2=0x559c00d54f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:52.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.261+0000 7f2c54034740 1 --2- 172.21.15.7:0/3437707136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c00d64c60 0x559c00d54f30 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f2c44054cc0 tx=0x7f2c4405c9c0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.261+0000 7f2c54034740 1 -- 172.21.15.7:0/3437707136 shutdown_connections 2024-04-25T10:01:52.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.261+0000 7f2c54034740 1 --2- 172.21.15.7:0/3437707136 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x559c00d65820 0x559c00d65c00 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.261+0000 7f2c54034740 1 --2- 172.21.15.7:0/3437707136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c00d64c60 0x559c00d54f30 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.261+0000 7f2c54034740 1 --2- 172.21.15.7:0/3437707136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559c00d53050 0x559c00d534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.261+0000 7f2c29ffb640 0 client.7968 ms_handle_reset on v2:172.21.15.7:6836/3829085443 2024-04-25T10:01:52.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.261+0000 7f2c54034740 1 --2- 172.21.15.7:0/3437707136 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559c00d28590 0x559c00d42b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.261+0000 7f2c54034740 1 -- 172.21.15.7:0/3437707136 >> 172.21.15.7:0/3437707136 conn(0x559c00cf06e0 msgr2=0x559c00d4e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:52.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.261+0000 7f2c54034740 1 -- 172.21.15.7:0/3437707136 shutdown_connections 2024-04-25T10:01:52.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.261+0000 7f2c54034740 1 -- 172.21.15.7:0/3437707136 wait complete. 2024-04-25T10:01:52.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.261+0000 7f2c54034740 20 client.7968 trim_cache size 0 max 16384 2024-04-25T10:01:52.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.273+0000 7f2c54034740 1 Processor -- start 2024-04-25T10:01:52.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.273+0000 7f2c54034740 1 -- start start 2024-04-25T10:01:52.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.274+0000 7f2c54034740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559c00d28590 0x559c00d54a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.274+0000 7f2c54034740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559c00d53050 0x559c00d7c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.274+0000 7f2c54034740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c00d64c60 0x559c00d7cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.274+0000 7f2c54034740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c1ff6f0 con 0x559c00d64c60 2024-04-25T10:01:52.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.274+0000 7f2c54034740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c1607f0 con 0x559c00d28590 2024-04-25T10:01:52.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.274+0000 7f2c54034740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c0ca080 con 0x559c00d53050 2024-04-25T10:01:52.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.274+0000 7f2c4b59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c00d64c60 0x559c00d7cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.274+0000 7f2c4b59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c00d64c60 0x559c00d7cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44596/0 (socket says 172.21.15.7:44596) 2024-04-25T10:01:52.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.274+0000 7f2c4b59e640 1 -- 172.21.15.7:0/42433750 learned_addr learned my addr 172.21.15.7:0/42433750 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:52.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.274+0000 7f2c4b59e640 1 -- 172.21.15.7:0/42433750 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559c00d53050 msgr2=0x559c00d7c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:52.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.274+0000 7f2c4b59e640 1 --2- 172.21.15.7:0/42433750 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559c00d53050 0x559c00d7c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.274+0000 7f2c4b59e640 1 -- 172.21.15.7:0/42433750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559c00d28590 msgr2=0x559c00d54a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:52.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.274+0000 7f2c4ad9d640 1 --2- 172.21.15.7:0/42433750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559c00d28590 0x559c00d54a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.274+0000 7f2c4b59e640 1 --2- 172.21.15.7:0/42433750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559c00d28590 0x559c00d54a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.274+0000 7f2c4b59e640 1 -- 172.21.15.7:0/42433750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c00d42360 con 0x559c00d64c60 2024-04-25T10:01:52.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.274+0000 7f2c4b59e640 1 --2- 172.21.15.7:0/42433750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c00d64c60 0x559c00d7cc90 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f2c44001560 tx=0x7f2c4405a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55fd8eda1b6637d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:52.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.274+0000 7f2c2bfff640 1 -- 172.21.15.7:0/42433750 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c44060ac0 con 0x559c00d64c60 2024-04-25T10:01:52.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.274+0000 7f2c2bfff640 1 -- 172.21.15.7:0/42433750 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c44070170 con 0x559c00d64c60 2024-04-25T10:01:52.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.274+0000 7f2c2bfff640 1 -- 172.21.15.7:0/42433750 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c44088410 con 0x559c00d64c60 2024-04-25T10:01:52.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.275+0000 7f2c54034740 1 -- 172.21.15.7:0/42433750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c00d64c60 msgr2=0x559c00d7cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:52.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.275+0000 7f2c54034740 1 --2- 172.21.15.7:0/42433750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c00d64c60 0x559c00d7cc90 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f2c44001560 tx=0x7f2c4405a000 comp rx=0 tx=0).stop 2024-04-25T10:01:52.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.275+0000 7f2c54034740 1 -- 172.21.15.7:0/42433750 shutdown_connections 2024-04-25T10:01:52.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.275+0000 7f2c54034740 1 --2- 172.21.15.7:0/42433750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c00d64c60 0x559c00d7cc90 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.275+0000 7f2c54034740 1 --2- 172.21.15.7:0/42433750 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559c00d53050 0x559c00d7c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.275+0000 7f2c54034740 1 --2- 172.21.15.7:0/42433750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559c00d28590 0x559c00d54a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.275+0000 7f2c54034740 1 -- 172.21.15.7:0/42433750 >> 172.21.15.7:0/42433750 conn(0x559c00cf06e0 msgr2=0x559c00d55fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:52.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.275+0000 7f2c54034740 1 -- 172.21.15.7:0/42433750 shutdown_connections 2024-04-25T10:01:52.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.275+0000 7f2c54034740 1 -- 172.21.15.7:0/42433750 wait complete. 2024-04-25T10:01:52.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.275+0000 7f2c54034740 1 -- start start 2024-04-25T10:01:52.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.276+0000 7f2c54034740 1 Processor -- start 2024-04-25T10:01:52.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.276+0000 7f2c54034740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559c00d28590 0x559c00dbe830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.276+0000 7f2c54034740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c00d53050 0x559c00d4eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.276+0000 7f2c54034740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559c00d64c60 0x559c00d64280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.276+0000 7f2c54034740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c00d4dcd0 con 0x559c00d53050 2024-04-25T10:01:52.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.276+0000 7f2c54034740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c00d668a0 con 0x559c00d64c60 2024-04-25T10:01:52.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.276+0000 7f2c54034740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c00d81650 con 0x559c00d28590 2024-04-25T10:01:52.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.276+0000 7f2c54034740 10 client.0 _ll_register_callbacks cb 0x7f2c340012d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:01:52.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.276+0000 7f2c4259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c00d53050 0x559c00d4eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.276+0000 7f2c4259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c00d53050 0x559c00d4eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44598/0 (socket says 172.21.15.7:44598) 2024-04-25T10:01:52.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.276+0000 7f2c4259c640 1 -- 172.21.15.7:0/1492510079 learned_addr learned my addr 172.21.15.7:0/1492510079 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:52.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.277+0000 7f2c4ad9d640 1 --2- 172.21.15.7:0/1492510079 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559c00d28590 0x559c00dbe830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.277+0000 7f2c4b59e640 1 --2- 172.21.15.7:0/1492510079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559c00d64c60 0x559c00d64280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.277+0000 7f2c4259c640 1 -- 172.21.15.7:0/1492510079 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559c00d28590 msgr2=0x559c00dbe830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:52.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.277+0000 7f2c4259c640 1 --2- 172.21.15.7:0/1492510079 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559c00d28590 0x559c00dbe830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.277+0000 7f2c4259c640 1 -- 172.21.15.7:0/1492510079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559c00d64c60 msgr2=0x559c00d64280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:52.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.277+0000 7f2c4259c640 1 --2- 172.21.15.7:0/1492510079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559c00d64c60 0x559c00d64280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.277+0000 7f2c4259c640 1 -- 172.21.15.7:0/1492510079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559c00d65fa0 con 0x559c00d53050 2024-04-25T10:01:52.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.277+0000 7f2c4259c640 1 --2- 172.21.15.7:0/1492510079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c00d53050 0x559c00d4eab0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f2c34009010 tx=0x7f2c34001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cfe62ff8e31fd65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:52.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.277+0000 7f2c29ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:01:52.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.277+0000 7f2c29ffb640 1 -- 172.21.15.7:0/1492510079 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c340035f0 con 0x559c00d53050 2024-04-25T10:01:52.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.277+0000 7f2c29ffb640 1 -- 172.21.15.7:0/1492510079 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f2c34003790 con 0x559c00d53050 2024-04-25T10:01:52.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.277+0000 7f2c54034740 1 -- 172.21.15.7:0/1492510079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2c44070170 con 0x559c00d53050 2024-04-25T10:01:52.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.277+0000 7f2c29ffb640 1 -- 172.21.15.7:0/1492510079 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c3402e050 con 0x559c00d53050 2024-04-25T10:01:52.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.277+0000 7f2c54034740 10 client.7974 fetch_fsmap learned FSMap version 60 2024-04-25T10:01:52.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.277+0000 7f2c54034740 1 -- 172.21.15.7:0/1492510079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x559c00d4eff0 con 0x559c00d53050 2024-04-25T10:01:52.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.277+0000 7f2c29ffb640 1 -- 172.21.15.7:0/1492510079 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c44070170 con 0x559c00d53050 2024-04-25T10:01:52.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.278+0000 7f2c29ffb640 1 -- 172.21.15.7:0/1492510079 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 60) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2c34031020 con 0x559c00d53050 2024-04-25T10:01:52.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.278+0000 7f2c54034740 10 client.7974 fetch_fsmap finished waiting for FSMap version 60 2024-04-25T10:01:52.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.278+0000 7f2c54034740 10 client.7974 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:01:52.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.278+0000 7f2c54034740 20 client.7974 populate_metadata read hostname 'smithi007' 2024-04-25T10:01:52.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.278+0000 7f2c54034740 1 --2- 172.21.15.7:0/1492510079 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x559c00d7ca50 0x559c00d40620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.278+0000 7f2c54034740 4 client.7974 mds_command: new command op to 7734 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T10:01:52.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.278+0000 7f2c54034740 1 -- 172.21.15.7:0/1492510079 --> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x559c00c991a0 con 0x559c00d7ca50 2024-04-25T10:01:52.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.278+0000 7f2c4ad9d640 1 --2- 172.21.15.7:0/1492510079 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x559c00d7ca50 0x559c00d40620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.278+0000 7f2c4ad9d640 1 --2- 172.21.15.7:0/1492510079 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x559c00d7ca50 0x559c00d40620 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbc82c53568eec28 server_cookie=65e6850beab94a3d in_seq=0 out_seq=0 2024-04-25T10:01:52.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.278+0000 7f2c29ffb640 10 client.7974 ms_handle_connect on v2:172.21.15.7:6836/3829085443 2024-04-25T10:01:52.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.278+0000 7f2c29ffb640 1 -- 172.21.15.7:0/1492510079 <== mds.0 v2:172.21.15.7:6836/3829085443 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+144 (crc 0 0 0) 0x559c00c991a0 con 0x559c00d7ca50 2024-04-25T10:01:52.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.278+0000 7f2c29ffb640 10 client.7974 handle_command_reply: tid=0 2024-04-25T10:01:52.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.278+0000 7f2c54034740 1 client.7974 shutdown 2024-04-25T10:01:52.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.278+0000 7f2c54034740 1 -- 172.21.15.7:0/1492510079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c00d53050 msgr2=0x559c00d4eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:52.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.278+0000 7f2c54034740 1 --2- 172.21.15.7:0/1492510079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c00d53050 0x559c00d4eab0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f2c34009010 tx=0x7f2c34001150 comp rx=0 tx=0).stop 2024-04-25T10:01:52.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.278+0000 7f2c54034740 1 -- 172.21.15.7:0/1492510079 shutdown_connections 2024-04-25T10:01:52.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.278+0000 7f2c54034740 1 --2- 172.21.15.7:0/1492510079 >> [v2:172.21.15.7:6836/3829085443,v1:172.21.15.7:6837/3829085443] conn(0x559c00d7ca50 0x559c00d40620 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.278+0000 7f2c54034740 1 --2- 172.21.15.7:0/1492510079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559c00d64c60 0x559c00d64280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.278+0000 7f2c29ffb640 0 client.7974 ms_handle_reset on v2:172.21.15.7:6836/3829085443 2024-04-25T10:01:52.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.278+0000 7f2c54034740 1 --2- 172.21.15.7:0/1492510079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559c00d53050 0x559c00d4eab0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.278+0000 7f2c54034740 1 --2- 172.21.15.7:0/1492510079 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x559c00d28590 0x559c00dbe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.278+0000 7f2c54034740 1 -- 172.21.15.7:0/1492510079 >> 172.21.15.7:0/1492510079 conn(0x559c00cf06e0 msgr2=0x559c00d22490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:52.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.278+0000 7f2c54034740 1 -- 172.21.15.7:0/1492510079 shutdown_connections 2024-04-25T10:01:52.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.278+0000 7f2c54034740 1 -- 172.21.15.7:0/1492510079 wait complete. 2024-04-25T10:01:52.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.279+0000 7f2c54034740 20 client.7974 trim_cache size 0 max 16384 2024-04-25T10:01:52.290 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:01:52.290 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2024-04-25T10:01:52.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:01:52.290 INFO:teuthology.orchestra.run.smithi007.stdout: "damage_type": "backtrace", 2024-04-25T10:01:52.290 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 3039243795, 2024-04-25T10:01:52.290 INFO:teuthology.orchestra.run.smithi007.stdout: "ino": 1099511627777, 2024-04-25T10:01:52.290 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/testdir/hardlink" 2024-04-25T10:01:52.290 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:01:52.290 INFO:teuthology.orchestra.run.smithi007.stdout:] 2024-04-25T10:01:52.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.279+0000 7f2c5125a640 1 -- 172.21.15.7:0/860153046 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2c2c06b4d0 msgr2=0x7f2c2c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:52.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.279+0000 7f2c5125a640 1 --2- 172.21.15.7:0/860153046 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2c2c06b4d0 0x7f2c2c06d990 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c034000 tx=0x7f2c3c02e000 comp rx=0 tx=0).stop 2024-04-25T10:01:52.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.279+0000 7f2c5125a640 1 -- 172.21.15.7:0/860153046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c4c0b2950 msgr2=0x7f2c4c14f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:52.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.279+0000 7f2c5125a640 1 --2- 172.21.15.7:0/860153046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c4c0b2950 0x7f2c4c14f2e0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f2c44005c00 tx=0x7f2c4400a430 comp rx=0 tx=0).stop 2024-04-25T10:01:52.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.279+0000 7f2c5125a640 1 -- 172.21.15.7:0/860153046 shutdown_connections 2024-04-25T10:01:52.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.279+0000 7f2c5125a640 1 --2- 172.21.15.7:0/860153046 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2c2c06b4d0 0x7f2c2c06d990 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.279+0000 7f2c5125a640 1 --2- 172.21.15.7:0/860153046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c4c0b2950 0x7f2c4c14f2e0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.279+0000 7f2c5125a640 1 --2- 172.21.15.7:0/860153046 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2c4c06f7d0 0x7f2c4c0b5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.279+0000 7f2c5125a640 1 --2- 172.21.15.7:0/860153046 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c4c06ab60 0x7f2c4c0b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.279+0000 7f2c5125a640 1 -- 172.21.15.7:0/860153046 >> 172.21.15.7:0/860153046 conn(0x7f2c4c0999f0 msgr2=0x7f2c4c0b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:52.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.279+0000 7f2c5125a640 1 -- 172.21.15.7:0/860153046 shutdown_connections 2024-04-25T10:01:52.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.279+0000 7f2c5125a640 1 -- 172.21.15.7:0/860153046 wait complete. 2024-04-25T10:01:52.294 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:01:52.294 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:01:52.310 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:01:52.310 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:01:52.366 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:01:52.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.502+0000 7feab59a5640 1 Processor -- start 2024-04-25T10:01:52.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.502+0000 7feab59a5640 1 -- start start 2024-04-25T10:01:52.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.503+0000 7feab59a5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feab015da50 0x7feab00cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.503+0000 7feab59a5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feab015de30 0x7feab015e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.503+0000 7feab59a5640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab00ce2b0 con 0x7feab00d0280 2024-04-25T10:01:52.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.503+0000 7feab59a5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab015e960 con 0x7feab015de30 2024-04-25T10:01:52.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.503+0000 7feab59a5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab015ec40 con 0x7feab015da50 2024-04-25T10:01:52.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.503+0000 7feaaf7fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7feab00d0280 0x7feab00d1d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38590/0 (socket says 172.21.15.7:38590) 2024-04-25T10:01:52.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.503+0000 7feaaf7fe640 1 -- 172.21.15.7:0/3569512771 learned_addr learned my addr 172.21.15.7:0/3569512771 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:01:52.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.504+0000 7feaae7fc640 1 --2- 172.21.15.7:0/3569512771 >> v2:172.21.15.55:3300/0 conn(0x7feab015de30 0x7feab015e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.504+0000 7feaaeffd640 1 --2- 172.21.15.7:0/3569512771 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feab015da50 0x7feab00cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.504+0000 7feaadffb640 1 -- 172.21.15.7:0/3569512771 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 823537213 0 0) 0x7feab00ce2b0 con 0x7feab00d0280 2024-04-25T10:01:52.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.504+0000 7feaadffb640 1 -- 172.21.15.7:0/3569512771 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea98003520 con 0x7feab00d0280 2024-04-25T10:01:52.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.504+0000 7feaadffb640 1 -- 172.21.15.7:0/3569512771 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1375469971 0 0) 0x7fea98003520 con 0x7feab00d0280 2024-04-25T10:01:52.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.504+0000 7feaadffb640 1 -- 172.21.15.7:0/3569512771 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feab015da50 msgr2=0x7feab00cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:52.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.504+0000 7feaadffb640 1 --2- 172.21.15.7:0/3569512771 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feab015da50 0x7feab00cea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.504+0000 7feaadffb640 1 -- 172.21.15.7:0/3569512771 >> v2:172.21.15.55:3300/0 conn(0x7feab015de30 msgr2=0x7feab015e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:52.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.504+0000 7feaadffb640 1 --2- 172.21.15.7:0/3569512771 >> v2:172.21.15.55:3300/0 conn(0x7feab015de30 0x7feab015e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.504+0000 7feaadffb640 1 -- 172.21.15.7:0/3569512771 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab00ce570 con 0x7feab00d0280 2024-04-25T10:01:52.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.504+0000 7feaadffb640 1 -- 172.21.15.7:0/3569512771 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7feaa00019f0 con 0x7feab00d0280 2024-04-25T10:01:52.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.504+0000 7feaadffb640 1 -- 172.21.15.7:0/3569512771 >> v1:172.21.15.7:6789/0 conn(0x7feab00d0280 legacy=0x7feab00d1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:52.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.504+0000 7feaadffb640 1 --2- 172.21.15.7:0/3569512771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea980039b0 0x7fea98003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.504+0000 7feaadffb640 1 --2- 172.21.15.7:0/3569512771 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feab015da50 0x7fea98004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.504+0000 7feaadffb640 1 --2- 172.21.15.7:0/3569512771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea98004d40 0x7fea980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.504+0000 7feaadffb640 1 -- 172.21.15.7:0/3569512771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab015e960 con 0x7fea98004d40 2024-04-25T10:01:52.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.504+0000 7feaadffb640 1 -- 172.21.15.7:0/3569512771 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab015ec40 con 0x7fea980039b0 2024-04-25T10:01:52.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.504+0000 7feaadffb640 1 -- 172.21.15.7:0/3569512771 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9800b9c0 con 0x7feab015da50 2024-04-25T10:01:52.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.504+0000 7feaaf7fe640 1 --2- 172.21.15.7:0/3569512771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea98004d40 0x7fea980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.504+0000 7feaaeffd640 1 --2- 172.21.15.7:0/3569512771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea980039b0 0x7fea98003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.504+0000 7feaae7fc640 1 --2- 172.21.15.7:0/3569512771 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feab015da50 0x7fea98004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.504+0000 7feaaf7fe640 1 -- 172.21.15.7:0/3569512771 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feab015da50 msgr2=0x7fea98004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:52.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.504+0000 7feaaf7fe640 1 --2- 172.21.15.7:0/3569512771 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feab015da50 0x7fea98004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.505+0000 7feaaf7fe640 1 -- 172.21.15.7:0/3569512771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea980039b0 msgr2=0x7fea98003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:52.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.505+0000 7feaaf7fe640 1 --2- 172.21.15.7:0/3569512771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea980039b0 0x7fea98003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.505+0000 7feaaf7fe640 1 -- 172.21.15.7:0/3569512771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea98003520 con 0x7fea98004d40 2024-04-25T10:01:52.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.505+0000 7feaaf7fe640 1 --2- 172.21.15.7:0/3569512771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea98004d40 0x7fea980051c0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7feaa00013d0 tx=0x7fea98005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a7aab4e6d211a31 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:52.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.505+0000 7feaadffb640 1 -- 172.21.15.7:0/3569512771 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa000a4e0 con 0x7fea98004d40 2024-04-25T10:01:52.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.505+0000 7feaadffb640 1 -- 172.21.15.7:0/3569512771 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa002f070 con 0x7fea98004d40 2024-04-25T10:01:52.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.505+0000 7feaadffb640 1 -- 172.21.15.7:0/3569512771 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa002bce0 con 0x7fea98004d40 2024-04-25T10:01:52.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.506+0000 7feab59a5640 1 -- 172.21.15.7:0/3569512771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea98004d40 msgr2=0x7fea980051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:52.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.506+0000 7feab59a5640 1 --2- 172.21.15.7:0/3569512771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea98004d40 0x7fea980051c0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7feaa00013d0 tx=0x7fea98005830 comp rx=0 tx=0).stop 2024-04-25T10:01:52.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.506+0000 7feaaf7fe640 1 -- 172.21.15.7:0/3569512771 reap_dead start 2024-04-25T10:01:52.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.506+0000 7feab59a5640 1 -- 172.21.15.7:0/3569512771 shutdown_connections 2024-04-25T10:01:52.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.506+0000 7feab59a5640 1 -- 172.21.15.7:0/3569512771 >> 172.21.15.7:0/3569512771 conn(0x7feab0072290 msgr2=0x7feab0072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:52.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.506+0000 7feab59a5640 1 -- 172.21.15.7:0/3569512771 shutdown_connections 2024-04-25T10:01:52.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.506+0000 7feab59a5640 1 -- 172.21.15.7:0/3569512771 wait complete. 2024-04-25T10:01:52.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.507+0000 7feab59a5640 1 Processor -- start 2024-04-25T10:01:52.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.507+0000 7feab59a5640 1 -- start start 2024-04-25T10:01:52.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.508+0000 7feab59a5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea98004d40 0x7feab00c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.508+0000 7feab59a5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feab00c8980 0x7feab00c7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.508+0000 7feab59a5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feab0151390 0x7feab0158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.508+0000 7feab59a5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab00d2450 con 0x7feab0151390 2024-04-25T10:01:52.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.508+0000 7feab59a5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab0161850 con 0x7fea98004d40 2024-04-25T10:01:52.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.508+0000 7feab59a5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab00d25d0 con 0x7feab00c8980 2024-04-25T10:01:52.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.508+0000 7feaaf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feab0151390 0x7feab0158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.508+0000 7feaaf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feab0151390 0x7feab0158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44624/0 (socket says 172.21.15.7:44624) 2024-04-25T10:01:52.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.508+0000 7feaaf7fe640 1 -- 172.21.15.7:0/2836945520 learned_addr learned my addr 172.21.15.7:0/2836945520 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:52.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.508+0000 7feaaeffd640 1 --2- 172.21.15.7:0/2836945520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea98004d40 0x7feab00c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.508+0000 7feaae7fc640 1 --2- 172.21.15.7:0/2836945520 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feab00c8980 0x7feab00c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.509+0000 7feaaf7fe640 1 -- 172.21.15.7:0/2836945520 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feab00c8980 msgr2=0x7feab00c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:52.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.509+0000 7feaaf7fe640 1 --2- 172.21.15.7:0/2836945520 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feab00c8980 0x7feab00c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.509+0000 7feaaf7fe640 1 -- 172.21.15.7:0/2836945520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea98004d40 msgr2=0x7feab00c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:52.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.509+0000 7feaaf7fe640 1 --2- 172.21.15.7:0/2836945520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea98004d40 0x7feab00c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.509+0000 7feaaf7fe640 1 -- 172.21.15.7:0/2836945520 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab0152340 con 0x7feab0151390 2024-04-25T10:01:52.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.509+0000 7feaaf7fe640 1 --2- 172.21.15.7:0/2836945520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feab0151390 0x7feab0158000 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7feaa000a0b0 tx=0x7feaa0001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:52.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.509+0000 7fea97fff640 1 -- 172.21.15.7:0/2836945520 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa0002040 con 0x7feab0151390 2024-04-25T10:01:52.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.509+0000 7fea97fff640 1 -- 172.21.15.7:0/2836945520 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa000a4c0 con 0x7feab0151390 2024-04-25T10:01:52.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.509+0000 7fea97fff640 1 -- 172.21.15.7:0/2836945520 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa0034670 con 0x7feab0151390 2024-04-25T10:01:52.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.509+0000 7feab59a5640 1 -- 172.21.15.7:0/2836945520 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab00c78e0 con 0x7feab0151390 2024-04-25T10:01:52.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.509+0000 7feab59a5640 1 -- 172.21.15.7:0/2836945520 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab00c7ea0 con 0x7feab0151390 2024-04-25T10:01:52.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.510+0000 7feab59a5640 1 -- 172.21.15.7:0/2836945520 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab0068fd0 con 0x7feab0151390 2024-04-25T10:01:52.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.510+0000 7fea97fff640 1 -- 172.21.15.7:0/2836945520 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7feaa0034810 con 0x7feab0151390 2024-04-25T10:01:52.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.511+0000 7fea97fff640 1 --2- 172.21.15.7:0/2836945520 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fea9c06b500 0x7fea9c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.511+0000 7fea97fff640 1 -- 172.21.15.7:0/2836945520 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6303+0+0 (secure 0 0 0) 0x7feaa00aa370 con 0x7feab0151390 2024-04-25T10:01:52.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.511+0000 7feaaeffd640 1 --2- 172.21.15.7:0/2836945520 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fea9c06b500 0x7fea9c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.511+0000 7feaaeffd640 1 --2- 172.21.15.7:0/2836945520 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fea9c06b500 0x7fea9c06d9c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7feaa8009b40 tx=0x7feaa8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:52.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.515+0000 7fea97fff640 1 -- 172.21.15.7:0/2836945520 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7feab0152340 con 0x7feab0151390 2024-04-25T10:01:52.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.701+0000 7feab59a5640 1 -- 172.21.15.7:0/2836945520 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feab00d0900 con 0x7feab0151390 2024-04-25T10:01:52.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.702+0000 7fea97fff640 1 -- 172.21.15.7:0/2836945520 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+17110 (secure 0 0 0) 0x7feaa0079060 con 0x7feab0151390 2024-04-25T10:01:52.755 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:01:52.756 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":91,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:01:10.497157+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:00:32.330930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T10:00:33.030728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1b","mappings":[{"from":1,"to":7}]},{"pgid":"14.2c","mappings":[{"from":1,"to":5}]},{"pgid":"14.31","mappings":[{"from":1,"to":7}]},{"pgid":"14.32","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6837/2878753733":"2024-04-26T10:00:43.379350+0000","172.21.15.7:6836/2878753733":"2024-04-26T10:00:43.379350+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:01:52.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.704+0000 7feab59a5640 1 -- 172.21.15.7:0/2836945520 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fea9c06b500 msgr2=0x7fea9c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:52.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.704+0000 7feab59a5640 1 --2- 172.21.15.7:0/2836945520 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fea9c06b500 0x7fea9c06d9c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7feaa8009b40 tx=0x7feaa8009190 comp rx=0 tx=0).stop 2024-04-25T10:01:52.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.704+0000 7feab59a5640 1 -- 172.21.15.7:0/2836945520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feab0151390 msgr2=0x7feab0158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:52.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.704+0000 7feab59a5640 1 --2- 172.21.15.7:0/2836945520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feab0151390 0x7feab0158000 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7feaa000a0b0 tx=0x7feaa0001dc0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.704+0000 7feab59a5640 1 -- 172.21.15.7:0/2836945520 shutdown_connections 2024-04-25T10:01:52.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.704+0000 7feab59a5640 1 --2- 172.21.15.7:0/2836945520 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fea9c06b500 0x7fea9c06d9c0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.704+0000 7feab59a5640 1 --2- 172.21.15.7:0/2836945520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feab0151390 0x7feab0158000 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.704+0000 7feab59a5640 1 --2- 172.21.15.7:0/2836945520 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feab00c8980 0x7feab00c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.704+0000 7feab59a5640 1 --2- 172.21.15.7:0/2836945520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea98004d40 0x7feab00c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.704+0000 7feab59a5640 1 -- 172.21.15.7:0/2836945520 >> 172.21.15.7:0/2836945520 conn(0x7feab0072290 msgr2=0x7feab00b7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:52.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.705+0000 7feab59a5640 1 -- 172.21.15.7:0/2836945520 shutdown_connections 2024-04-25T10:01:52.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.705+0000 7feab59a5640 1 -- 172.21.15.7:0/2836945520 wait complete. 2024-04-25T10:01:52.758 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:00:32.330930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:00:33.030728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:01:52.759 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:01:52.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.858+0000 7f871a7a5640 1 Processor -- start 2024-04-25T10:01:52.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.858+0000 7f871a7a5640 1 -- start start 2024-04-25T10:01:52.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.859+0000 7f871a7a5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87140d3760 0x7f871415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.859+0000 7f871a7a5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f871415f1c0 0x7f87140d3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.859+0000 7f871a7a5640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87140d4080 con 0x7f87140ce830 2024-04-25T10:01:52.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.859+0000 7f871a7a5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87140ce380 con 0x7f87140d3760 2024-04-25T10:01:52.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.859+0000 7f871a7a5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871415f000 con 0x7f871415f1c0 2024-04-25T10:01:52.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.859+0000 7f8718d42640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f87140ce830 0x7f87140b2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38600/0 (socket says 172.21.15.7:38600) 2024-04-25T10:01:52.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.859+0000 7f8718d42640 1 -- 172.21.15.7:0/3595388567 learned_addr learned my addr 172.21.15.7:0/3595388567 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:01:52.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.859+0000 7f87137fe640 1 --2- 172.21.15.7:0/3595388567 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f871415f1c0 0x7f87140d3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.859+0000 7f8713fff640 1 --2- 172.21.15.7:0/3595388567 >> v2:172.21.15.55:3300/0 conn(0x7f87140d3760 0x7f871415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.859+0000 7f8712ffd640 1 -- 172.21.15.7:0/3595388567 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965032103 0 0) 0x7f87140d4080 con 0x7f87140ce830 2024-04-25T10:01:52.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.859+0000 7f8712ffd640 1 -- 172.21.15.7:0/3595388567 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86fc003520 con 0x7f87140ce830 2024-04-25T10:01:52.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.859+0000 7f8712ffd640 1 -- 172.21.15.7:0/3595388567 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3153232663 0 0) 0x7f86fc003520 con 0x7f87140ce830 2024-04-25T10:01:52.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.859+0000 7f8712ffd640 1 -- 172.21.15.7:0/3595388567 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f871415f1c0 msgr2=0x7f87140d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:52.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.859+0000 7f8712ffd640 1 --2- 172.21.15.7:0/3595388567 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f871415f1c0 0x7f87140d3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.859+0000 7f8712ffd640 1 -- 172.21.15.7:0/3595388567 >> v2:172.21.15.55:3300/0 conn(0x7f87140d3760 msgr2=0x7f871415eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:52.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.859+0000 7f8712ffd640 1 --2- 172.21.15.7:0/3595388567 >> v2:172.21.15.55:3300/0 conn(0x7f87140d3760 0x7f871415eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.859+0000 7f8712ffd640 1 -- 172.21.15.7:0/3595388567 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87140ced10 con 0x7f87140ce830 2024-04-25T10:01:52.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.859+0000 7f8712ffd640 1 -- 172.21.15.7:0/3595388567 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f870c0019f0 con 0x7f87140ce830 2024-04-25T10:01:52.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.859+0000 7f87137fe640 1 --2- 172.21.15.7:0/3595388567 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f871415f1c0 0x7f87140d3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:01:52.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.859+0000 7f8713fff640 1 --2- 172.21.15.7:0/3595388567 >> v2:172.21.15.55:3300/0 conn(0x7f87140d3760 0x7f871415eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:01:52.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.859+0000 7f8712ffd640 1 -- 172.21.15.7:0/3595388567 >> v1:172.21.15.7:6789/0 conn(0x7f87140ce830 legacy=0x7f87140b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:52.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.860+0000 7f8712ffd640 1 --2- 172.21.15.7:0/3595388567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86fc0039e0 0x7f86fc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.860+0000 7f8712ffd640 1 --2- 172.21.15.7:0/3595388567 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f871415f1c0 0x7f86fc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.860+0000 7f8712ffd640 1 --2- 172.21.15.7:0/3595388567 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86fc004d40 0x7f86fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.860+0000 7f8712ffd640 1 -- 172.21.15.7:0/3595388567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871415f000 con 0x7f86fc0039e0 2024-04-25T10:01:52.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.860+0000 7f8712ffd640 1 -- 172.21.15.7:0/3595388567 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc00b9c0 con 0x7f86fc004d40 2024-04-25T10:01:52.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.860+0000 7f8712ffd640 1 -- 172.21.15.7:0/3595388567 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc00bb40 con 0x7f871415f1c0 2024-04-25T10:01:52.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.860+0000 7f8713fff640 1 --2- 172.21.15.7:0/3595388567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86fc0039e0 0x7f86fc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.860+0000 7f87137fe640 1 --2- 172.21.15.7:0/3595388567 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f871415f1c0 0x7f86fc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.860+0000 7f8718d42640 1 --2- 172.21.15.7:0/3595388567 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86fc004d40 0x7f86fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.860+0000 7f8713fff640 1 -- 172.21.15.7:0/3595388567 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f871415f1c0 msgr2=0x7f86fc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:52.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.860+0000 7f8713fff640 1 --2- 172.21.15.7:0/3595388567 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f871415f1c0 0x7f86fc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.860+0000 7f8713fff640 1 -- 172.21.15.7:0/3595388567 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86fc004d40 msgr2=0x7f86fc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:52.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.860+0000 7f8713fff640 1 --2- 172.21.15.7:0/3595388567 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86fc004d40 0x7f86fc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.860+0000 7f8713fff640 1 -- 172.21.15.7:0/3595388567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86fc003520 con 0x7f86fc0039e0 2024-04-25T10:01:52.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.860+0000 7f87137fe640 1 --2- 172.21.15.7:0/3595388567 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f871415f1c0 0x7f86fc004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:01:52.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.861+0000 7f8713fff640 1 --2- 172.21.15.7:0/3595388567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86fc0039e0 0x7f86fc003e00 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f8708009c90 tx=0x7f86fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4f74f9ebd41f02 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:52.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.861+0000 7f8712ffd640 1 -- 172.21.15.7:0/3595388567 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708036070 con 0x7f86fc0039e0 2024-04-25T10:01:52.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.861+0000 7f8712ffd640 1 -- 172.21.15.7:0/3595388567 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8708031400 con 0x7f86fc0039e0 2024-04-25T10:01:52.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.861+0000 7f8712ffd640 1 -- 172.21.15.7:0/3595388567 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708009860 con 0x7f86fc0039e0 2024-04-25T10:01:52.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.861+0000 7f871a7a5640 1 -- 172.21.15.7:0/3595388567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86fc0039e0 msgr2=0x7f86fc003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:52.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.861+0000 7f871a7a5640 1 --2- 172.21.15.7:0/3595388567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86fc0039e0 0x7f86fc003e00 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f8708009c90 tx=0x7f86fc005830 comp rx=0 tx=0).stop 2024-04-25T10:01:52.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.861+0000 7f8718d42640 1 -- 172.21.15.7:0/3595388567 reap_dead start 2024-04-25T10:01:52.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.861+0000 7f871a7a5640 1 -- 172.21.15.7:0/3595388567 shutdown_connections 2024-04-25T10:01:52.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.861+0000 7f871a7a5640 1 -- 172.21.15.7:0/3595388567 >> 172.21.15.7:0/3595388567 conn(0x7f8714072680 msgr2=0x7f8714072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:52.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.861+0000 7f871a7a5640 1 -- 172.21.15.7:0/3595388567 shutdown_connections 2024-04-25T10:01:52.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.861+0000 7f871a7a5640 1 -- 172.21.15.7:0/3595388567 wait complete. 2024-04-25T10:01:52.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.862+0000 7f871a7a5640 1 Processor -- start 2024-04-25T10:01:52.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.863+0000 7f871a7a5640 1 -- start start 2024-04-25T10:01:52.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.863+0000 7f871a7a5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86fc0039e0 0x7f8714159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.863+0000 7f871a7a5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8714148fe0 0x7f87140cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.863+0000 7f871a7a5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f871415bab0 0x7f871415bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.863+0000 7f871a7a5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87140d1e20 con 0x7f8714148fe0 2024-04-25T10:01:52.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.863+0000 7f871a7a5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87140d2190 con 0x7f86fc0039e0 2024-04-25T10:01:52.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.863+0000 7f871a7a5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871415de10 con 0x7f871415bab0 2024-04-25T10:01:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.864+0000 7f87137fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8714148fe0 0x7f87140cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.864+0000 7f87137fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8714148fe0 0x7f87140cb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44650/0 (socket says 172.21.15.7:44650) 2024-04-25T10:01:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.864+0000 7f87137fe640 1 -- 172.21.15.7:0/2733135234 learned_addr learned my addr 172.21.15.7:0/2733135234 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.864+0000 7f8713fff640 1 --2- 172.21.15.7:0/2733135234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86fc0039e0 0x7f8714159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.864+0000 7f8718d42640 1 --2- 172.21.15.7:0/2733135234 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f871415bab0 0x7f871415bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.864+0000 7f87137fe640 1 -- 172.21.15.7:0/2733135234 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f871415bab0 msgr2=0x7f871415bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.864+0000 7f87137fe640 1 --2- 172.21.15.7:0/2733135234 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f871415bab0 0x7f871415bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.864+0000 7f87137fe640 1 -- 172.21.15.7:0/2733135234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86fc0039e0 msgr2=0x7f8714159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.864+0000 7f87137fe640 1 --2- 172.21.15.7:0/2733135234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86fc0039e0 0x7f8714159de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.864+0000 7f87137fe640 1 -- 172.21.15.7:0/2733135234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87140cbb00 con 0x7f8714148fe0 2024-04-25T10:01:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.864+0000 7f8713fff640 1 --2- 172.21.15.7:0/2733135234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86fc0039e0 0x7f8714159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:01:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.864+0000 7f8718d42640 1 --2- 172.21.15.7:0/2733135234 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f871415bab0 0x7f871415bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:01:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.864+0000 7f87137fe640 1 --2- 172.21.15.7:0/2733135234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8714148fe0 0x7f87140cb2b0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f87040115f0 tx=0x7f8704011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.864+0000 7f8710ff9640 1 -- 172.21.15.7:0/2733135234 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870400f9b0 con 0x7f8714148fe0 2024-04-25T10:01:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.864+0000 7f8710ff9640 1 -- 172.21.15.7:0/2733135234 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870400fb50 con 0x7f8714148fe0 2024-04-25T10:01:52.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.864+0000 7f871a7a5640 1 -- 172.21.15.7:0/2733135234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87140cbde0 con 0x7f8714148fe0 2024-04-25T10:01:52.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.864+0000 7f8710ff9640 1 -- 172.21.15.7:0/2733135234 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8704015460 con 0x7f8714148fe0 2024-04-25T10:01:52.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.864+0000 7f871a7a5640 1 -- 172.21.15.7:0/2733135234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87140cc3a0 con 0x7f8714148fe0 2024-04-25T10:01:52.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.866+0000 7f871a7a5640 1 -- 172.21.15.7:0/2733135234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8714068f60 con 0x7f8714148fe0 2024-04-25T10:01:52.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.866+0000 7f8710ff9640 1 -- 172.21.15.7:0/2733135234 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8704015600 con 0x7f8714148fe0 2024-04-25T10:01:52.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.866+0000 7f8710ff9640 1 --2- 172.21.15.7:0/2733135234 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f870006b4d0 0x7f870006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:52.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.866+0000 7f8710ff9640 1 -- 172.21.15.7:0/2733135234 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f870408adb0 con 0x7f8714148fe0 2024-04-25T10:01:52.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.866+0000 7f8713fff640 1 --2- 172.21.15.7:0/2733135234 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f870006b4d0 0x7f870006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:52.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.867+0000 7f8713fff640 1 --2- 172.21.15.7:0/2733135234 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f870006b4d0 0x7f870006d990 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f8708033000 tx=0x7f8708008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:52.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:52.870+0000 7f8710ff9640 1 -- 172.21.15.7:0/2733135234 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8704019030 con 0x7f8714148fe0 2024-04-25T10:01:53.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.051+0000 7f871a7a5640 1 -- 172.21.15.7:0/2733135234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f87140ce610 con 0x7f8714148fe0 2024-04-25T10:01:53.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.052+0000 7f8710ff9640 1 -- 172.21.15.7:0/2733135234 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8704059a70 con 0x7f8714148fe0 2024-04-25T10:01:53.057 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T10:01:53.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.054+0000 7f871a7a5640 1 -- 172.21.15.7:0/2733135234 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f870006b4d0 msgr2=0x7f870006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:53.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.054+0000 7f871a7a5640 1 --2- 172.21.15.7:0/2733135234 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f870006b4d0 0x7f870006d990 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f8708033000 tx=0x7f8708008030 comp rx=0 tx=0).stop 2024-04-25T10:01:53.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.054+0000 7f871a7a5640 1 -- 172.21.15.7:0/2733135234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8714148fe0 msgr2=0x7f87140cb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:53.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.054+0000 7f871a7a5640 1 --2- 172.21.15.7:0/2733135234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8714148fe0 0x7f87140cb2b0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f87040115f0 tx=0x7f8704011ab0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.054+0000 7f871a7a5640 1 -- 172.21.15.7:0/2733135234 shutdown_connections 2024-04-25T10:01:53.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.054+0000 7f871a7a5640 1 --2- 172.21.15.7:0/2733135234 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f870006b4d0 0x7f870006d990 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.054+0000 7f871a7a5640 1 --2- 172.21.15.7:0/2733135234 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f871415bab0 0x7f871415bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.054+0000 7f871a7a5640 1 --2- 172.21.15.7:0/2733135234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8714148fe0 0x7f87140cb2b0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.054+0000 7f871a7a5640 1 --2- 172.21.15.7:0/2733135234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86fc0039e0 0x7f8714159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.054+0000 7f871a7a5640 1 -- 172.21.15.7:0/2733135234 >> 172.21.15.7:0/2733135234 conn(0x7f8714072680 msgr2=0x7f87140c9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:53.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.054+0000 7f871a7a5640 1 -- 172.21.15.7:0/2733135234 shutdown_connections 2024-04-25T10:01:53.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.054+0000 7f871a7a5640 1 -- 172.21.15.7:0/2733135234 wait complete. 2024-04-25T10:01:53.069 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:01:53.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.167+0000 7f5881522640 1 Processor -- start 2024-04-25T10:01:53.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.167+0000 7f5881522640 1 -- start start 2024-04-25T10:01:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.168+0000 7f5881522640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f587c15db70 0x7f587c0ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.168+0000 7f5881522640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f587c0cede0 0x7f587c0d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.168+0000 7f5881522640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587c0d29c0 con 0x7f587c0d21b0 2024-04-25T10:01:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.168+0000 7f5881522640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f587c0b6ce0 con 0x7f587c15db70 2024-04-25T10:01:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.168+0000 7f5881522640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0d2f80 con 0x7f587c0cede0 2024-04-25T10:01:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.169+0000 7f587a7fc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f587c0cede0 0x7f587c0d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.169+0000 7f587affd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f587c15db70 0x7f587c0ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.169+0000 7f587b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f587c0d21b0 0x7f587c06bb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:38444/0 (socket says 172.21.15.7:38444) 2024-04-25T10:01:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.169+0000 7f587a7fc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f587c0cede0 0x7f587c0d1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:48002/0 (socket says 172.21.15.7:48002) 2024-04-25T10:01:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.169+0000 7f587b7fe640 1 -- 172.21.15.7:0/2904844684 learned_addr learned my addr 172.21.15.7:0/2904844684 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:01:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.169+0000 7f587a7fc640 1 -- 172.21.15.7:0/2904844684 >> v2:172.21.15.55:3300/0 conn(0x7f587c15db70 msgr2=0x7f587c0ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:53.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.169+0000 7f587a7fc640 1 --2- 172.21.15.7:0/2904844684 >> v2:172.21.15.55:3300/0 conn(0x7f587c15db70 0x7f587c0ce8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.169+0000 7f587a7fc640 1 -- 172.21.15.7:0/2904844684 >> v1:172.21.15.55:6789/0 conn(0x7f587c0d21b0 legacy=0x7f587c06bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:53.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.169+0000 7f587a7fc640 1 -- 172.21.15.7:0/2904844684 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587c0d2ca0 con 0x7f587c0cede0 2024-04-25T10:01:53.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.170+0000 7f587a7fc640 1 --2- 172.21.15.7:0/2904844684 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f587c0cede0 0x7f587c0d1c70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f58700097a0 tx=0x7f587002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26667485873ea9c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:53.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.170+0000 7f5879ffb640 1 -- 172.21.15.7:0/2904844684 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870037070 con 0x7f587c0cede0 2024-04-25T10:01:53.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.170+0000 7f5879ffb640 1 -- 172.21.15.7:0/2904844684 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5870032440 con 0x7f587c0cede0 2024-04-25T10:01:53.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.170+0000 7f5879ffb640 1 -- 172.21.15.7:0/2904844684 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870032810 con 0x7f587c0cede0 2024-04-25T10:01:53.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.170+0000 7f5881522640 1 -- 172.21.15.7:0/2904844684 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f587c0cede0 msgr2=0x7f587c0d1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:53.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.170+0000 7f5881522640 1 --2- 172.21.15.7:0/2904844684 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f587c0cede0 0x7f587c0d1c70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f58700097a0 tx=0x7f587002a180 comp rx=0 tx=0).stop 2024-04-25T10:01:53.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.171+0000 7f5881522640 1 -- 172.21.15.7:0/2904844684 shutdown_connections 2024-04-25T10:01:53.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.171+0000 7f5881522640 1 --2- 172.21.15.7:0/2904844684 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f587c0cede0 0x7f587c0d1c70 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.171+0000 7f5881522640 1 --2- 172.21.15.7:0/2904844684 >> v2:172.21.15.55:3300/0 conn(0x7f587c15db70 0x7f587c0ce8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.171+0000 7f5881522640 1 -- 172.21.15.7:0/2904844684 >> 172.21.15.7:0/2904844684 conn(0x7f587c0b5370 msgr2=0x7f587c0b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:53.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.171+0000 7f5881522640 1 -- 172.21.15.7:0/2904844684 shutdown_connections 2024-04-25T10:01:53.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.171+0000 7f5881522640 1 -- 172.21.15.7:0/2904844684 wait complete. 2024-04-25T10:01:53.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.172+0000 7f5881522640 1 Processor -- start 2024-04-25T10:01:53.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.172+0000 7f5881522640 1 -- start start 2024-04-25T10:01:53.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.173+0000 7f5881522640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f587c0cede0 0x7f587c152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:53.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.173+0000 7f5881522640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f587c0d21b0 0x7f587c0c7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:53.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.173+0000 7f5881522640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f587c15db70 0x7f587c160760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:53.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.173+0000 7f5881522640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0cf220 con 0x7f587c0cede0 2024-04-25T10:01:53.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.173+0000 7f5881522640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0b7280 con 0x7f587c15db70 2024-04-25T10:01:53.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.173+0000 7f5881522640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0d2620 con 0x7f587c0d21b0 2024-04-25T10:01:53.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.173+0000 7f587affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f587c0cede0 0x7f587c152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:53.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.173+0000 7f587affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f587c0cede0 0x7f587c152650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44664/0 (socket says 172.21.15.7:44664) 2024-04-25T10:01:53.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.173+0000 7f587affd640 1 -- 172.21.15.7:0/3874016380 learned_addr learned my addr 172.21.15.7:0/3874016380 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:53.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.173+0000 7f587a7fc640 1 --2- 172.21.15.7:0/3874016380 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f587c0d21b0 0x7f587c0c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:53.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.173+0000 7f587b7fe640 1 --2- 172.21.15.7:0/3874016380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f587c15db70 0x7f587c160760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:53.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.173+0000 7f587affd640 1 -- 172.21.15.7:0/3874016380 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f587c0d21b0 msgr2=0x7f587c0c7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:53.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.173+0000 7f587affd640 1 --2- 172.21.15.7:0/3874016380 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f587c0d21b0 0x7f587c0c7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.173+0000 7f587affd640 1 -- 172.21.15.7:0/3874016380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f587c15db70 msgr2=0x7f587c160760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:53.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.173+0000 7f587affd640 1 --2- 172.21.15.7:0/3874016380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f587c15db70 0x7f587c160760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.173+0000 7f587affd640 1 -- 172.21.15.7:0/3874016380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587c15f6c0 con 0x7f587c0cede0 2024-04-25T10:01:53.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.173+0000 7f587affd640 1 --2- 172.21.15.7:0/3874016380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f587c0cede0 0x7f587c152650 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f587400e8a0 tx=0x7f587400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:53.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.173+0000 7f58637fe640 1 -- 172.21.15.7:0/3874016380 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5874017070 con 0x7f587c0cede0 2024-04-25T10:01:53.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.174+0000 7f58637fe640 1 -- 172.21.15.7:0/3874016380 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587400c940 con 0x7f587c0cede0 2024-04-25T10:01:53.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.174+0000 7f5881522640 1 -- 172.21.15.7:0/3874016380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587c15f9a0 con 0x7f587c0cede0 2024-04-25T10:01:53.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.174+0000 7f58637fe640 1 -- 172.21.15.7:0/3874016380 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587400cd30 con 0x7f587c0cede0 2024-04-25T10:01:53.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.174+0000 7f5881522640 1 -- 172.21.15.7:0/3874016380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587c15ff60 con 0x7f587c0cede0 2024-04-25T10:01:53.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.175+0000 7f5881522640 1 -- 172.21.15.7:0/3874016380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587c068f60 con 0x7f587c0cede0 2024-04-25T10:01:53.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.175+0000 7f58637fe640 1 -- 172.21.15.7:0/3874016380 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f587401a070 con 0x7f587c0cede0 2024-04-25T10:01:53.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.175+0000 7f58637fe640 1 --2- 172.21.15.7:0/3874016380 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f586806b4d0 0x7f586806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:53.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.176+0000 7f58637fe640 1 -- 172.21.15.7:0/3874016380 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f587408a540 con 0x7f587c0cede0 2024-04-25T10:01:53.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.176+0000 7f587a7fc640 1 --2- 172.21.15.7:0/3874016380 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f586806b4d0 0x7f586806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:53.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.176+0000 7f587a7fc640 1 --2- 172.21.15.7:0/3874016380 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f586806b4d0 0x7f586806d990 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5870034000 tx=0x7f587002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:53.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.180+0000 7f58637fe640 1 -- 172.21.15.7:0/3874016380 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5874058bb0 con 0x7f587c0cede0 2024-04-25T10:01:53.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.357+0000 7f5881522640 1 -- 172.21.15.7:0/3874016380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f587c0b4f00 con 0x7f587c0cede0 2024-04-25T10:01:53.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.358+0000 7f58637fe640 1 -- 172.21.15.7:0/3874016380 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+11 (secure 0 0 0) 0x7f587405cc50 con 0x7f587c0cede0 2024-04-25T10:01:53.363 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T10:01:53.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.360+0000 7f5881522640 1 -- 172.21.15.7:0/3874016380 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f586806b4d0 msgr2=0x7f586806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:53.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.360+0000 7f5881522640 1 --2- 172.21.15.7:0/3874016380 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f586806b4d0 0x7f586806d990 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5870034000 tx=0x7f587002e000 comp rx=0 tx=0).stop 2024-04-25T10:01:53.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.360+0000 7f5881522640 1 -- 172.21.15.7:0/3874016380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f587c0cede0 msgr2=0x7f587c152650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:53.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.360+0000 7f5881522640 1 --2- 172.21.15.7:0/3874016380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f587c0cede0 0x7f587c152650 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f587400e8a0 tx=0x7f587400ed60 comp rx=0 tx=0).stop 2024-04-25T10:01:53.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.360+0000 7f5881522640 1 -- 172.21.15.7:0/3874016380 shutdown_connections 2024-04-25T10:01:53.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.360+0000 7f5881522640 1 --2- 172.21.15.7:0/3874016380 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f586806b4d0 0x7f586806d990 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.360+0000 7f5881522640 1 --2- 172.21.15.7:0/3874016380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f587c15db70 0x7f587c160760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.360+0000 7f5881522640 1 --2- 172.21.15.7:0/3874016380 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f587c0d21b0 0x7f587c0c7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.360+0000 7f5881522640 1 --2- 172.21.15.7:0/3874016380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f587c0cede0 0x7f587c152650 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.360+0000 7f5881522640 1 -- 172.21.15.7:0/3874016380 >> 172.21.15.7:0/3874016380 conn(0x7f587c0b5370 msgr2=0x7f587c0cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:53.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.360+0000 7f5881522640 1 -- 172.21.15.7:0/3874016380 shutdown_connections 2024-04-25T10:01:53.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.360+0000 7f5881522640 1 -- 172.21.15.7:0/3874016380 wait complete. 2024-04-25T10:01:53.375 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:01:53.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.475+0000 7faef725d640 1 Processor -- start 2024-04-25T10:01:53.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.475+0000 7faef725d640 1 -- start start 2024-04-25T10:01:53.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.476+0000 7faef725d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faef0071c60 0x7faef00aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:53.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.476+0000 7faef725d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faef006e800 0x7faef0072210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:53.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.476+0000 7faef725d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faef00ce970 con 0x7faef015b700 2024-04-25T10:01:53.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.476+0000 7faef725d640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faef00cec50 con 0x7faef006e800 2024-04-25T10:01:53.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.476+0000 7faef725d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faef00cef30 con 0x7faef0071c60 2024-04-25T10:01:53.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.476+0000 7faef57fa640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faef006e800 0x7faef0072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:53.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.476+0000 7faef57fa640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faef006e800 0x7faef0072210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44666/0 (socket says 172.21.15.7:44666) 2024-04-25T10:01:53.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.476+0000 7faef57fa640 1 -- 172.21.15.7:0/2390201679 learned_addr learned my addr 172.21.15.7:0/2390201679 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:53.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.476+0000 7faeeffff640 1 --2- 172.21.15.7:0/2390201679 >> v2:172.21.15.55:3300/0 conn(0x7faef0071c60 0x7faef00aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:53.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.476+0000 7faef57fa640 1 -- 172.21.15.7:0/2390201679 >> v2:172.21.15.55:3300/0 conn(0x7faef0071c60 msgr2=0x7faef00aeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:53.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.476+0000 7faef57fa640 1 --2- 172.21.15.7:0/2390201679 >> v2:172.21.15.55:3300/0 conn(0x7faef0071c60 0x7faef00aeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.476+0000 7faef57fa640 1 -- 172.21.15.7:0/2390201679 >> v1:172.21.15.55:6789/0 conn(0x7faef015b700 legacy=0x7faef0071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:53.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.476+0000 7faef57fa640 1 -- 172.21.15.7:0/2390201679 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef00cf210 con 0x7faef006e800 2024-04-25T10:01:53.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.477+0000 7faef57fa640 1 --2- 172.21.15.7:0/2390201679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faef006e800 0x7faef0072210 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7faee8009e50 tx=0x7faee802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c4f85110015e142 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:53.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.477+0000 7faeef7fe640 1 -- 172.21.15.7:0/2390201679 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee8036070 con 0x7faef006e800 2024-04-25T10:01:53.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.477+0000 7faeef7fe640 1 -- 172.21.15.7:0/2390201679 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee8031600 con 0x7faef006e800 2024-04-25T10:01:53.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.477+0000 7faeef7fe640 1 -- 172.21.15.7:0/2390201679 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee80319d0 con 0x7faef006e800 2024-04-25T10:01:53.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.477+0000 7faef725d640 1 -- 172.21.15.7:0/2390201679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faef006e800 msgr2=0x7faef0072210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:53.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.477+0000 7faef725d640 1 --2- 172.21.15.7:0/2390201679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faef006e800 0x7faef0072210 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7faee8009e50 tx=0x7faee802a710 comp rx=0 tx=0).stop 2024-04-25T10:01:53.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.478+0000 7faef725d640 1 -- 172.21.15.7:0/2390201679 shutdown_connections 2024-04-25T10:01:53.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.478+0000 7faef725d640 1 --2- 172.21.15.7:0/2390201679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faef006e800 0x7faef0072210 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.478+0000 7faef725d640 1 --2- 172.21.15.7:0/2390201679 >> v2:172.21.15.55:3300/0 conn(0x7faef0071c60 0x7faef00aeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.478+0000 7faef725d640 1 -- 172.21.15.7:0/2390201679 >> 172.21.15.7:0/2390201679 conn(0x7faef00b16d0 msgr2=0x7faef00b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:53.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.478+0000 7faef725d640 1 -- 172.21.15.7:0/2390201679 shutdown_connections 2024-04-25T10:01:53.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.478+0000 7faef725d640 1 -- 172.21.15.7:0/2390201679 wait complete. 2024-04-25T10:01:53.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.479+0000 7faef725d640 1 Processor -- start 2024-04-25T10:01:53.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.479+0000 7faef725d640 1 -- start start 2024-04-25T10:01:53.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.480+0000 7faef725d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faef006e800 0x7faef013fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:53.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.480+0000 7faef725d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faef0071c60 0x7faef0142a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:53.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.480+0000 7faef725d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faef015b700 0x7faef01e4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:53.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.480+0000 7faef725d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef015bc60 con 0x7faef006e800 2024-04-25T10:01:53.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.480+0000 7faef725d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef015bae0 con 0x7faef0071c60 2024-04-25T10:01:53.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.480+0000 7faef725d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef00b2ad0 con 0x7faef015b700 2024-04-25T10:01:53.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.480+0000 7faef4ff9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faef006e800 0x7faef013fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:53.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.480+0000 7faef4ff9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faef006e800 0x7faef013fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44680/0 (socket says 172.21.15.7:44680) 2024-04-25T10:01:53.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.480+0000 7faef4ff9640 1 -- 172.21.15.7:0/3135854075 learned_addr learned my addr 172.21.15.7:0/3135854075 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:53.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.480+0000 7faeeffff640 1 --2- 172.21.15.7:0/3135854075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faef0071c60 0x7faef0142a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:53.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.480+0000 7faef57fa640 1 --2- 172.21.15.7:0/3135854075 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faef015b700 0x7faef01e4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:53.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.480+0000 7faef4ff9640 1 -- 172.21.15.7:0/3135854075 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faef015b700 msgr2=0x7faef01e4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:53.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.480+0000 7faef4ff9640 1 --2- 172.21.15.7:0/3135854075 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faef015b700 0x7faef01e4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.480+0000 7faef4ff9640 1 -- 172.21.15.7:0/3135854075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faef0071c60 msgr2=0x7faef0142a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:53.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.480+0000 7faef4ff9640 1 --2- 172.21.15.7:0/3135854075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faef0071c60 0x7faef0142a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.480+0000 7faef4ff9640 1 -- 172.21.15.7:0/3135854075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef01e4640 con 0x7faef006e800 2024-04-25T10:01:53.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.480+0000 7faeeffff640 1 --2- 172.21.15.7:0/3135854075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faef0071c60 0x7faef0142a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:01:53.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.480+0000 7faef4ff9640 1 --2- 172.21.15.7:0/3135854075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faef006e800 0x7faef013fe20 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7faee400b3f0 tx=0x7faee400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:53.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.480+0000 7faeed7fa640 1 -- 172.21.15.7:0/3135854075 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4015020 con 0x7faef006e800 2024-04-25T10:01:53.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.480+0000 7faeed7fa640 1 -- 172.21.15.7:0/3135854075 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee4011830 con 0x7faef006e800 2024-04-25T10:01:53.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.480+0000 7faef725d640 1 -- 172.21.15.7:0/3135854075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faef01e4910 con 0x7faef006e800 2024-04-25T10:01:53.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.480+0000 7faeed7fa640 1 -- 172.21.15.7:0/3135854075 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4011c20 con 0x7faef006e800 2024-04-25T10:01:53.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.480+0000 7faef725d640 1 -- 172.21.15.7:0/3135854075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faef01e4ed0 con 0x7faef006e800 2024-04-25T10:01:53.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.482+0000 7faef725d640 1 -- 172.21.15.7:0/3135854075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faef0068f60 con 0x7faef006e800 2024-04-25T10:01:53.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.482+0000 7faeed7fa640 1 -- 172.21.15.7:0/3135854075 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faee4018020 con 0x7faef006e800 2024-04-25T10:01:53.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.482+0000 7faeed7fa640 1 --2- 172.21.15.7:0/3135854075 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faed406b4d0 0x7faed406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:53.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.483+0000 7faeed7fa640 1 -- 172.21.15.7:0/3135854075 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6303+0+0 (secure 0 0 0) 0x7faee4089fe0 con 0x7faef006e800 2024-04-25T10:01:53.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.483+0000 7faeeffff640 1 --2- 172.21.15.7:0/3135854075 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faed406b4d0 0x7faed406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:53.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.483+0000 7faeeffff640 1 --2- 172.21.15.7:0/3135854075 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faed406b4d0 0x7faed406d990 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7faef0156b40 tx=0x7faedc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:53.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.487+0000 7faeed7fa640 1 -- 172.21.15.7:0/3135854075 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faee401f030 con 0x7faef006e800 2024-04-25T10:01:53.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.669+0000 7faef725d640 1 -- 172.21.15.7:0/3135854075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faef0156700 con 0x7faef006e800 2024-04-25T10:01:53.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.669+0000 7faeed7fa640 1 -- 172.21.15.7:0/3135854075 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+11 (secure 0 0 0) 0x7faee4058c20 con 0x7faef006e800 2024-04-25T10:01:53.674 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T10:01:53.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.671+0000 7faef725d640 1 -- 172.21.15.7:0/3135854075 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faed406b4d0 msgr2=0x7faed406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:53.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.671+0000 7faef725d640 1 --2- 172.21.15.7:0/3135854075 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faed406b4d0 0x7faed406d990 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7faef0156b40 tx=0x7faedc008040 comp rx=0 tx=0).stop 2024-04-25T10:01:53.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.671+0000 7faef725d640 1 -- 172.21.15.7:0/3135854075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faef006e800 msgr2=0x7faef013fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:53.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.671+0000 7faef725d640 1 --2- 172.21.15.7:0/3135854075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faef006e800 0x7faef013fe20 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7faee400b3f0 tx=0x7faee400b8b0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.671+0000 7faef725d640 1 -- 172.21.15.7:0/3135854075 shutdown_connections 2024-04-25T10:01:53.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.671+0000 7faef725d640 1 --2- 172.21.15.7:0/3135854075 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faed406b4d0 0x7faed406d990 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.671+0000 7faef725d640 1 --2- 172.21.15.7:0/3135854075 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faef015b700 0x7faef01e4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.671+0000 7faef725d640 1 --2- 172.21.15.7:0/3135854075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faef0071c60 0x7faef0142a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.671+0000 7faef725d640 1 --2- 172.21.15.7:0/3135854075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faef006e800 0x7faef013fe20 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.671+0000 7faef725d640 1 -- 172.21.15.7:0/3135854075 >> 172.21.15.7:0/3135854075 conn(0x7faef00b16d0 msgr2=0x7faef00cf900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:53.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.671+0000 7faef725d640 1 -- 172.21.15.7:0/3135854075 shutdown_connections 2024-04-25T10:01:53.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.671+0000 7faef725d640 1 -- 172.21.15.7:0/3135854075 wait complete. 2024-04-25T10:01:53.690 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:01:53.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.787+0000 7f64c9f61640 1 Processor -- start 2024-04-25T10:01:53.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.787+0000 7f64c9f61640 1 -- start start 2024-04-25T10:01:53.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.788+0000 7f64c9f61640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f64c40d0330 0x7f64c40999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:53.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.788+0000 7f64c9f61640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64c409a330 con 0x7f64c415b8e0 2024-04-25T10:01:53.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.788+0000 7f64c9f61640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64c40ccbc0 con 0x7f64c4099f30 2024-04-25T10:01:53.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.788+0000 7f64c9f61640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c40cd7d0 con 0x7f64c40d0330 2024-04-25T10:01:53.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.788+0000 7f64c2ffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f64c40d0330 0x7f64c40999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:53.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.788+0000 7f64c37fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f64c415b8e0 0x7f64c40cc300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38616/0 (socket says 172.21.15.7:38616) 2024-04-25T10:01:53.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.788+0000 7f64c37fe640 1 -- 172.21.15.7:0/1470786812 learned_addr learned my addr 172.21.15.7:0/1470786812 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:01:53.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.789+0000 7f64c2ffd640 1 -- 172.21.15.7:0/1470786812 >> v1:172.21.15.55:6789/0 conn(0x7f64c4099f30 legacy=0x7f64c40b0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:53.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.789+0000 7f64c2ffd640 1 -- 172.21.15.7:0/1470786812 >> v1:172.21.15.7:6789/0 conn(0x7f64c415b8e0 legacy=0x7f64c40cc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:53.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.789+0000 7f64c2ffd640 1 -- 172.21.15.7:0/1470786812 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c40ccea0 con 0x7f64c40d0330 2024-04-25T10:01:53.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.789+0000 7f64c27fc640 1 -- 172.21.15.7:0/1470786812 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2486348564 0 0) 0x7f64c409a330 con 0x7f64c415b8e0 2024-04-25T10:01:53.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.789+0000 7f64c2ffd640 1 --2- 172.21.15.7:0/1470786812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64c40d0330 0x7f64c40999f0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f64b80097a0 tx=0x7f64b802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db12bd53ea54c53 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:53.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.790+0000 7f64c27fc640 1 -- 172.21.15.7:0/1470786812 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b8037070 con 0x7f64c40d0330 2024-04-25T10:01:53.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.790+0000 7f64c27fc640 1 -- 172.21.15.7:0/1470786812 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b8032440 con 0x7f64c40d0330 2024-04-25T10:01:53.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.790+0000 7f64c27fc640 1 -- 172.21.15.7:0/1470786812 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b8032810 con 0x7f64c40d0330 2024-04-25T10:01:53.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.790+0000 7f64c9f61640 1 -- 172.21.15.7:0/1470786812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64c40d0330 msgr2=0x7f64c40999f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:53.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.790+0000 7f64c9f61640 1 --2- 172.21.15.7:0/1470786812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64c40d0330 0x7f64c40999f0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f64b80097a0 tx=0x7f64b802a230 comp rx=0 tx=0).stop 2024-04-25T10:01:53.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.790+0000 7f64c9f61640 1 -- 172.21.15.7:0/1470786812 shutdown_connections 2024-04-25T10:01:53.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.790+0000 7f64c9f61640 1 --2- 172.21.15.7:0/1470786812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64c40d0330 0x7f64c40999f0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.790+0000 7f64c9f61640 1 -- 172.21.15.7:0/1470786812 >> 172.21.15.7:0/1470786812 conn(0x7f64c40b3130 msgr2=0x7f64c40b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:53.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.790+0000 7f64c9f61640 1 -- 172.21.15.7:0/1470786812 shutdown_connections 2024-04-25T10:01:53.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.790+0000 7f64c9f61640 1 -- 172.21.15.7:0/1470786812 wait complete. 2024-04-25T10:01:53.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.791+0000 7f64c9f61640 1 Processor -- start 2024-04-25T10:01:53.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.791+0000 7f64c9f61640 1 -- start start 2024-04-25T10:01:53.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.792+0000 7f64c9f61640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64c4099f30 0x7f64c41f69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:53.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.792+0000 7f64c9f61640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64c40d0330 0x7f64c41f3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:53.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.792+0000 7f64c9f61640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f64c415b8e0 0x7f64c41f3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:53.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.792+0000 7f64c9f61640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c40cd460 con 0x7f64c40d0330 2024-04-25T10:01:53.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.792+0000 7f64c9f61640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c40d07c0 con 0x7f64c4099f30 2024-04-25T10:01:53.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.792+0000 7f64c9f61640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c415bcc0 con 0x7f64c415b8e0 2024-04-25T10:01:53.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.792+0000 7f64c2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64c40d0330 0x7f64c41f3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:53.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.792+0000 7f64c2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64c40d0330 0x7f64c41f3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44696/0 (socket says 172.21.15.7:44696) 2024-04-25T10:01:53.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.792+0000 7f64c2ffd640 1 -- 172.21.15.7:0/966915516 learned_addr learned my addr 172.21.15.7:0/966915516 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:53.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.793+0000 7f64c37fe640 1 --2- 172.21.15.7:0/966915516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64c4099f30 0x7f64c41f69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:53.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.793+0000 7f64c3fff640 1 --2- 172.21.15.7:0/966915516 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f64c415b8e0 0x7f64c41f3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:53.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.793+0000 7f64c2ffd640 1 -- 172.21.15.7:0/966915516 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f64c415b8e0 msgr2=0x7f64c41f3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:53.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.793+0000 7f64c2ffd640 1 --2- 172.21.15.7:0/966915516 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f64c415b8e0 0x7f64c41f3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.793+0000 7f64c2ffd640 1 -- 172.21.15.7:0/966915516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64c4099f30 msgr2=0x7f64c41f69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:53.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.793+0000 7f64c2ffd640 1 --2- 172.21.15.7:0/966915516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64c4099f30 0x7f64c41f69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.793+0000 7f64c2ffd640 1 -- 172.21.15.7:0/966915516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c41f7080 con 0x7f64c40d0330 2024-04-25T10:01:53.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.793+0000 7f64c3fff640 1 --2- 172.21.15.7:0/966915516 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f64c415b8e0 0x7f64c41f3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:01:53.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.793+0000 7f64c37fe640 1 --2- 172.21.15.7:0/966915516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64c4099f30 0x7f64c41f69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:01:53.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.793+0000 7f64c2ffd640 1 --2- 172.21.15.7:0/966915516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64c40d0330 0x7f64c41f3400 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f64b8000c00 tx=0x7f64b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:53.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.793+0000 7f64abfff640 1 -- 172.21.15.7:0/966915516 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b8037040 con 0x7f64c40d0330 2024-04-25T10:01:53.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.793+0000 7f64abfff640 1 -- 172.21.15.7:0/966915516 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b8042070 con 0x7f64c40d0330 2024-04-25T10:01:53.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.793+0000 7f64abfff640 1 -- 172.21.15.7:0/966915516 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b8030a70 con 0x7f64c40d0330 2024-04-25T10:01:53.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.793+0000 7f64c9f61640 1 -- 172.21.15.7:0/966915516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c41f7360 con 0x7f64c40d0330 2024-04-25T10:01:53.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.793+0000 7f64c9f61640 1 -- 172.21.15.7:0/966915516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c406bda0 con 0x7f64c40d0330 2024-04-25T10:01:53.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.794+0000 7f64c9f61640 1 -- 172.21.15.7:0/966915516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c406bfa0 con 0x7f64c40d0330 2024-04-25T10:01:53.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.794+0000 7f64abfff640 1 -- 172.21.15.7:0/966915516 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f64b8030c10 con 0x7f64c40d0330 2024-04-25T10:01:53.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.795+0000 7f64abfff640 1 --2- 172.21.15.7:0/966915516 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f64b006b4d0 0x7f64b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:53.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.795+0000 7f64abfff640 1 -- 172.21.15.7:0/966915516 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f64b80aae30 con 0x7f64c40d0330 2024-04-25T10:01:53.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.795+0000 7f64c37fe640 1 --2- 172.21.15.7:0/966915516 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f64b006b4d0 0x7f64b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:53.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.795+0000 7f64c37fe640 1 --2- 172.21.15.7:0/966915516 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f64b006b4d0 0x7f64b006d990 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f64b40012e0 tx=0x7f64b4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:53.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.799+0000 7f64abfff640 1 -- 172.21.15.7:0/966915516 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f64c406bfa0 con 0x7f64c40d0330 2024-04-25T10:01:53.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.990+0000 7f64c9f61640 1 -- 172.21.15.7:0/966915516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f64c4068fd0 con 0x7f64c40d0330 2024-04-25T10:01:53.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.990+0000 7f64abfff640 1 -- 172.21.15.7:0/966915516 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v91) v1 ==== 80+0+120 (secure 0 0 0) 0x7f64b8045360 con 0x7f64c40d0330 2024-04-25T10:01:53.995 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2878753733 2024-04-26T10:00:43.379350+0000 2024-04-25T10:01:53.995 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/2878753733 2024-04-26T10:00:43.379350+0000 2024-04-25T10:01:53.995 INFO:teuthology.orchestra.run.smithi007.stderr:listed 2 entries 2024-04-25T10:01:53.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.992+0000 7f64c9f61640 1 -- 172.21.15.7:0/966915516 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f64b006b4d0 msgr2=0x7f64b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:53.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.992+0000 7f64c9f61640 1 --2- 172.21.15.7:0/966915516 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f64b006b4d0 0x7f64b006d990 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f64b40012e0 tx=0x7f64b4009040 comp rx=0 tx=0).stop 2024-04-25T10:01:53.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.992+0000 7f64c9f61640 1 -- 172.21.15.7:0/966915516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64c40d0330 msgr2=0x7f64c41f3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:53.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.992+0000 7f64c9f61640 1 --2- 172.21.15.7:0/966915516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64c40d0330 0x7f64c41f3400 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f64b8000c00 tx=0x7f64b80046c0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.992+0000 7f64c9f61640 1 -- 172.21.15.7:0/966915516 shutdown_connections 2024-04-25T10:01:53.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.992+0000 7f64c9f61640 1 --2- 172.21.15.7:0/966915516 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f64b006b4d0 0x7f64b006d990 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.992+0000 7f64c9f61640 1 --2- 172.21.15.7:0/966915516 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f64c415b8e0 0x7f64c41f3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.992+0000 7f64c9f61640 1 --2- 172.21.15.7:0/966915516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64c40d0330 0x7f64c41f3400 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.992+0000 7f64c9f61640 1 --2- 172.21.15.7:0/966915516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64c4099f30 0x7f64c41f69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:53.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.993+0000 7f64c9f61640 1 -- 172.21.15.7:0/966915516 >> 172.21.15.7:0/966915516 conn(0x7f64c40b3130 msgr2=0x7f64c40b1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:53.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.993+0000 7f64c9f61640 1 -- 172.21.15.7:0/966915516 shutdown_connections 2024-04-25T10:01:53.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:53.993+0000 7f64c9f61640 1 -- 172.21.15.7:0/966915516 wait complete. 2024-04-25T10:01:54.008 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T10:01:54.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:01:54.008 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T10:01:54.036 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-04-25T10:01:54.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:01:54.036 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T10:01:54.092 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:01:54.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.229+0000 7fd8834b3640 1 Processor -- start 2024-04-25T10:01:54.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.229+0000 7fd8834b3640 1 -- start start 2024-04-25T10:01:54.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.230+0000 7fd8834b3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd87c15da60 0x7fd87c0d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:54.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.230+0000 7fd8834b3640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd87c15e2a0 0x7fd87c0ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:54.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.230+0000 7fd8834b3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd87c15e8a0 con 0x7fd87c15de40 2024-04-25T10:01:54.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.230+0000 7fd8834b3640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd87c15eb80 con 0x7fd87c15e2a0 2024-04-25T10:01:54.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.230+0000 7fd8834b3640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c15ee60 con 0x7fd87c15da60 2024-04-25T10:01:54.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.230+0000 7fd881a50640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd87c15e2a0 0x7fd87c0ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:54.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.230+0000 7fd881a50640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd87c15e2a0 0x7fd87c0ce520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44710/0 (socket says 172.21.15.7:44710) 2024-04-25T10:01:54.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.230+0000 7fd881a50640 1 -- 172.21.15.7:0/2518941794 learned_addr learned my addr 172.21.15.7:0/2518941794 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:54.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.230+0000 7fd88124f640 1 --2- 172.21.15.7:0/2518941794 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd87c15da60 0x7fd87c0d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:54.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.230+0000 7fd881a50640 1 -- 172.21.15.7:0/2518941794 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd87c15da60 msgr2=0x7fd87c0d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:54.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.230+0000 7fd881a50640 1 --2- 172.21.15.7:0/2518941794 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd87c15da60 0x7fd87c0d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:54.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.230+0000 7fd881a50640 1 -- 172.21.15.7:0/2518941794 >> v1:172.21.15.55:6789/0 conn(0x7fd87c15de40 legacy=0x7fd87c161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:54.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.230+0000 7fd881a50640 1 -- 172.21.15.7:0/2518941794 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87c161850 con 0x7fd87c15e2a0 2024-04-25T10:01:54.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.230+0000 7fd88124f640 1 --2- 172.21.15.7:0/2518941794 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd87c15da60 0x7fd87c0d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:01:54.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.231+0000 7fd881a50640 1 --2- 172.21.15.7:0/2518941794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd87c15e2a0 0x7fd87c0ce520 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fd874009e50 tx=0x7fd87402a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a46bfd1ec9c975e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:54.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.231+0000 7fd873fff640 1 -- 172.21.15.7:0/2518941794 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd874036070 con 0x7fd87c15e2a0 2024-04-25T10:01:54.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.231+0000 7fd873fff640 1 -- 172.21.15.7:0/2518941794 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd874031600 con 0x7fd87c15e2a0 2024-04-25T10:01:54.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.231+0000 7fd873fff640 1 -- 172.21.15.7:0/2518941794 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8740319d0 con 0x7fd87c15e2a0 2024-04-25T10:01:54.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.231+0000 7fd8834b3640 1 -- 172.21.15.7:0/2518941794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd87c15e2a0 msgr2=0x7fd87c0ce520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:54.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.231+0000 7fd8834b3640 1 --2- 172.21.15.7:0/2518941794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd87c15e2a0 0x7fd87c0ce520 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fd874009e50 tx=0x7fd87402a630 comp rx=0 tx=0).stop 2024-04-25T10:01:54.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.232+0000 7fd8834b3640 1 -- 172.21.15.7:0/2518941794 shutdown_connections 2024-04-25T10:01:54.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.232+0000 7fd8834b3640 1 --2- 172.21.15.7:0/2518941794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd87c15e2a0 0x7fd87c0ce520 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:54.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.232+0000 7fd8834b3640 1 --2- 172.21.15.7:0/2518941794 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd87c15da60 0x7fd87c0d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:54.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.232+0000 7fd8834b3640 1 -- 172.21.15.7:0/2518941794 >> 172.21.15.7:0/2518941794 conn(0x7fd87c06bfe0 msgr2=0x7fd87c06c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:54.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.232+0000 7fd8834b3640 1 -- 172.21.15.7:0/2518941794 shutdown_connections 2024-04-25T10:01:54.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.232+0000 7fd8834b3640 1 -- 172.21.15.7:0/2518941794 wait complete. 2024-04-25T10:01:54.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.233+0000 7fd8834b3640 1 Processor -- start 2024-04-25T10:01:54.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.233+0000 7fd8834b3640 1 -- start start 2024-04-25T10:01:54.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.234+0000 7fd8834b3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd87c15da60 0x7fd87c0aa220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:54.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.234+0000 7fd8834b3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd87c15de40 0x7fd87c0c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:54.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.234+0000 7fd8834b3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd87c15e2a0 0x7fd87c1e7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:54.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.234+0000 7fd8834b3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c0cebe0 con 0x7fd87c15da60 2024-04-25T10:01:54.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.234+0000 7fd8834b3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c0cea60 con 0x7fd87c15de40 2024-04-25T10:01:54.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.234+0000 7fd8834b3640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c0ced60 con 0x7fd87c15e2a0 2024-04-25T10:01:54.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.234+0000 7fd88124f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd87c15da60 0x7fd87c0aa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:54.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.234+0000 7fd88124f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd87c15da60 0x7fd87c0aa220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44726/0 (socket says 172.21.15.7:44726) 2024-04-25T10:01:54.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.234+0000 7fd88124f640 1 -- 172.21.15.7:0/133278842 learned_addr learned my addr 172.21.15.7:0/133278842 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:54.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.234+0000 7fd881a50640 1 --2- 172.21.15.7:0/133278842 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd87c15e2a0 0x7fd87c1e7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:54.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.234+0000 7fd880a4e640 1 --2- 172.21.15.7:0/133278842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd87c15de40 0x7fd87c0c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:54.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.234+0000 7fd88124f640 1 -- 172.21.15.7:0/133278842 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd87c15e2a0 msgr2=0x7fd87c1e7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:54.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.234+0000 7fd88124f640 1 --2- 172.21.15.7:0/133278842 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd87c15e2a0 0x7fd87c1e7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:54.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.234+0000 7fd88124f640 1 -- 172.21.15.7:0/133278842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd87c15de40 msgr2=0x7fd87c0c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:54.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.234+0000 7fd88124f640 1 --2- 172.21.15.7:0/133278842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd87c15de40 0x7fd87c0c9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:54.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.234+0000 7fd88124f640 1 -- 172.21.15.7:0/133278842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87c0aa760 con 0x7fd87c15da60 2024-04-25T10:01:54.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.234+0000 7fd880a4e640 1 --2- 172.21.15.7:0/133278842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd87c15de40 0x7fd87c0c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:01:54.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.234+0000 7fd88124f640 1 --2- 172.21.15.7:0/133278842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd87c15da60 0x7fd87c0aa220 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fd87800c7f0 tx=0x7fd87800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:54.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.234+0000 7fd871ffb640 1 -- 172.21.15.7:0/133278842 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd878015070 con 0x7fd87c15da60 2024-04-25T10:01:54.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.234+0000 7fd871ffb640 1 -- 172.21.15.7:0/133278842 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd878007820 con 0x7fd87c15da60 2024-04-25T10:01:54.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.234+0000 7fd871ffb640 1 -- 172.21.15.7:0/133278842 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd878007bd0 con 0x7fd87c15da60 2024-04-25T10:01:54.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.234+0000 7fd8834b3640 1 -- 172.21.15.7:0/133278842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd87c149e60 con 0x7fd87c15da60 2024-04-25T10:01:54.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.235+0000 7fd8834b3640 1 -- 172.21.15.7:0/133278842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd87c14a6a0 con 0x7fd87c15da60 2024-04-25T10:01:54.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.235+0000 7fd8834b3640 1 -- 172.21.15.7:0/133278842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd87c068070 con 0x7fd87c15da60 2024-04-25T10:01:54.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.236+0000 7fd871ffb640 1 -- 172.21.15.7:0/133278842 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd878018070 con 0x7fd87c15da60 2024-04-25T10:01:54.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.236+0000 7fd871ffb640 1 --2- 172.21.15.7:0/133278842 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd86006b4d0 0x7fd86006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:54.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.236+0000 7fd871ffb640 1 -- 172.21.15.7:0/133278842 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6303+0+0 (secure 0 0 0) 0x7fd87808a610 con 0x7fd87c15da60 2024-04-25T10:01:54.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.236+0000 7fd880a4e640 1 --2- 172.21.15.7:0/133278842 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd86006b4d0 0x7fd86006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:54.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.237+0000 7fd880a4e640 1 --2- 172.21.15.7:0/133278842 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd86006b4d0 0x7fd86006d990 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0b5f20 tx=0x7fd86c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:54.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.240+0000 7fd871ffb640 1 -- 172.21.15.7:0/133278842 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd87c068070 con 0x7fd87c15da60 2024-04-25T10:01:54.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.459+0000 7fd8834b3640 1 -- 172.21.15.7:0/133278842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd87c0d1560 con 0x7fd87c15da60 2024-04-25T10:01:54.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.459+0000 7fd871ffb640 1 -- 172.21.15.7:0/133278842 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4935 (secure 0 0 0) 0x7fd87c149e60 con 0x7fd87c15da60 2024-04-25T10:01:54.464 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:01:54.464 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2505539422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2505539422},{"type":"v1","addr":"172.21.15.55:6834","nonce":2505539422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2808857776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2808857776},{"type":"v1","addr":"172.21.15.55:6835","nonce":2808857776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7518,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1796103144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1796103144},{"type":"v1","addr":"172.21.15.7:6835","nonce":1796103144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:00:34.054759+0000","modified":"2024-04-25T10:00:54.397441+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7734},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7734":{"gid":7734,"name":"a","rank":0,"incarnation":56,"state":"up:active","state_seq":6,"addr":"172.21.15.7:6837/3829085443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":3829085443},{"type":"v1","addr":"172.21.15.7:6837","nonce":3829085443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:01:54.465 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 60 2024-04-25T10:01:54.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.462+0000 7fd8834b3640 1 -- 172.21.15.7:0/133278842 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd86006b4d0 msgr2=0x7fd86006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:54.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.462+0000 7fd8834b3640 1 --2- 172.21.15.7:0/133278842 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd86006b4d0 0x7fd86006d990 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0b5f20 tx=0x7fd86c008040 comp rx=0 tx=0).stop 2024-04-25T10:01:54.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.462+0000 7fd8834b3640 1 -- 172.21.15.7:0/133278842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd87c15da60 msgr2=0x7fd87c0aa220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:54.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.462+0000 7fd8834b3640 1 --2- 172.21.15.7:0/133278842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd87c15da60 0x7fd87c0aa220 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fd87800c7f0 tx=0x7fd87800ccb0 comp rx=0 tx=0).stop 2024-04-25T10:01:54.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.462+0000 7fd8834b3640 1 -- 172.21.15.7:0/133278842 shutdown_connections 2024-04-25T10:01:54.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.462+0000 7fd8834b3640 1 --2- 172.21.15.7:0/133278842 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd86006b4d0 0x7fd86006d990 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:54.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.462+0000 7fd8834b3640 1 --2- 172.21.15.7:0/133278842 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd87c15e2a0 0x7fd87c1e7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:54.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.462+0000 7fd8834b3640 1 --2- 172.21.15.7:0/133278842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd87c15de40 0x7fd87c0c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:54.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.462+0000 7fd8834b3640 1 --2- 172.21.15.7:0/133278842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd87c15da60 0x7fd87c0aa220 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:54.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.462+0000 7fd8834b3640 1 -- 172.21.15.7:0/133278842 >> 172.21.15.7:0/133278842 conn(0x7fd87c06bfe0 msgr2=0x7fd87c160660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:54.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.462+0000 7fd8834b3640 1 -- 172.21.15.7:0/133278842 shutdown_connections 2024-04-25T10:01:54.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.462+0000 7fd8834b3640 1 -- 172.21.15.7:0/133278842 wait complete. 2024-04-25T10:01:54.478 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-25T10:01:54.601 INFO:teuthology.orchestra.run.smithi007.stdout:{"message":"","return_code":0} 2024-04-25T10:01:54.601 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T10:01:54.601 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T10:01:54.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.699+0000 7f86378b3640 1 Processor -- start 2024-04-25T10:01:54.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.699+0000 7f86378b3640 1 -- start start 2024-04-25T10:01:54.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.700+0000 7f86378b3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f863015aa10 0x7f86300b4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:54.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.700+0000 7f86378b3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f863015adf0 0x7f863006fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:54.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.700+0000 7f86378b3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86300b5360 con 0x7f86300b4650 2024-04-25T10:01:54.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.700+0000 7f86378b3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86300ceb60 con 0x7f863015aa10 2024-04-25T10:01:54.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.700+0000 7f86378b3640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86300b5640 con 0x7f863015adf0 2024-04-25T10:01:54.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.700+0000 7f863564f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f863015aa10 0x7f86300b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:54.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.700+0000 7f8634e4e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f863015adf0 0x7f863006fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:54.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.701+0000 7f8634e4e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f863015adf0 0x7f863006fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:48064/0 (socket says 172.21.15.7:48064) 2024-04-25T10:01:54.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.700+0000 7f8635e50640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f86300b4650 0x7f86300d0110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:38468/0 (socket says 172.21.15.7:38468) 2024-04-25T10:01:54.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.701+0000 7f8634e4e640 1 -- 172.21.15.7:0/2845430860 learned_addr learned my addr 172.21.15.7:0/2845430860 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:54.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.700+0000 7f863564f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f863015aa10 0x7f86300b4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:37486/0 (socket says 172.21.15.7:37486) 2024-04-25T10:01:54.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.701+0000 7f8634e4e640 1 -- 172.21.15.7:0/2845430860 >> v2:172.21.15.55:3300/0 conn(0x7f863015aa10 msgr2=0x7f86300b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:54.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.701+0000 7f8634e4e640 1 --2- 172.21.15.7:0/2845430860 >> v2:172.21.15.55:3300/0 conn(0x7f863015aa10 0x7f86300b4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:54.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.701+0000 7f8627fff640 1 -- 172.21.15.7:0/2845430860 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3254242017 0 0) 0x7f86300b5360 con 0x7f86300b4650 2024-04-25T10:01:54.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.701+0000 7f8634e4e640 1 -- 172.21.15.7:0/2845430860 >> v1:172.21.15.55:6789/0 conn(0x7f86300b4650 legacy=0x7f86300d0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:54.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.701+0000 7f8634e4e640 1 -- 172.21.15.7:0/2845430860 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86300b5920 con 0x7f863015adf0 2024-04-25T10:01:54.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.702+0000 7f8634e4e640 1 --2- 172.21.15.7:0/2845430860 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f863015adf0 0x7f863006fb30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8620009870 tx=0x7f862002a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f06614e5ba3ffba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:54.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.702+0000 7f8627fff640 1 -- 172.21.15.7:0/2845430860 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8620037070 con 0x7f863015adf0 2024-04-25T10:01:54.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.702+0000 7f8627fff640 1 -- 172.21.15.7:0/2845430860 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8620032440 con 0x7f863015adf0 2024-04-25T10:01:54.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.702+0000 7f8627fff640 1 -- 172.21.15.7:0/2845430860 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8620032810 con 0x7f863015adf0 2024-04-25T10:01:54.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.703+0000 7f86378b3640 1 -- 172.21.15.7:0/2845430860 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f863015adf0 msgr2=0x7f863006fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:54.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.703+0000 7f86378b3640 1 --2- 172.21.15.7:0/2845430860 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f863015adf0 0x7f863006fb30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8620009870 tx=0x7f862002a130 comp rx=0 tx=0).stop 2024-04-25T10:01:54.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.703+0000 7f86378b3640 1 -- 172.21.15.7:0/2845430860 shutdown_connections 2024-04-25T10:01:54.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.703+0000 7f86378b3640 1 --2- 172.21.15.7:0/2845430860 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f863015adf0 0x7f863006fb30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:54.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.703+0000 7f86378b3640 1 --2- 172.21.15.7:0/2845430860 >> v2:172.21.15.55:3300/0 conn(0x7f863015aa10 0x7f86300b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:54.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.703+0000 7f86378b3640 1 -- 172.21.15.7:0/2845430860 >> 172.21.15.7:0/2845430860 conn(0x7f86300b2400 msgr2=0x7f86300b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:54.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.703+0000 7f86378b3640 1 -- 172.21.15.7:0/2845430860 shutdown_connections 2024-04-25T10:01:54.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.703+0000 7f86378b3640 1 -- 172.21.15.7:0/2845430860 wait complete. 2024-04-25T10:01:54.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.704+0000 7f86378b3640 1 Processor -- start 2024-04-25T10:01:54.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.704+0000 7f86378b3640 1 -- start start 2024-04-25T10:01:54.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.705+0000 7f86378b3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86300b4650 0x7f863014cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:54.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.705+0000 7f86378b3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f863015aa10 0x7f86301e5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:54.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.705+0000 7f86378b3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f863015adf0 0x7f86300cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:54.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.705+0000 7f86378b3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86300ce870 con 0x7f86300b4650 2024-04-25T10:01:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.705+0000 7f86378b3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86300ce6f0 con 0x7f863015aa10 2024-04-25T10:01:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.705+0000 7f86378b3640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8630070070 con 0x7f863015adf0 2024-04-25T10:01:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.705+0000 7f863564f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86300b4650 0x7f863014cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.705+0000 7f8634e4e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f863015aa10 0x7f86301e5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.705+0000 7f863564f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86300b4650 0x7f863014cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44740/0 (socket says 172.21.15.7:44740) 2024-04-25T10:01:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.705+0000 7f863564f640 1 -- 172.21.15.7:0/3145533616 learned_addr learned my addr 172.21.15.7:0/3145533616 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.705+0000 7f8635e50640 1 --2- 172.21.15.7:0/3145533616 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f863015adf0 0x7f86300cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.706+0000 7f863564f640 1 -- 172.21.15.7:0/3145533616 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f863015adf0 msgr2=0x7f86300cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.706+0000 7f863564f640 1 --2- 172.21.15.7:0/3145533616 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f863015adf0 0x7f86300cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.706+0000 7f863564f640 1 -- 172.21.15.7:0/3145533616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f863015aa10 msgr2=0x7f86301e5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.706+0000 7f863564f640 1 --2- 172.21.15.7:0/3145533616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f863015aa10 0x7f86301e5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.706+0000 7f863564f640 1 -- 172.21.15.7:0/3145533616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86301e5db0 con 0x7f86300b4650 2024-04-25T10:01:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.706+0000 7f863564f640 1 --2- 172.21.15.7:0/3145533616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86300b4650 0x7f863014cc60 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f862c00e9b0 tx=0x7f862c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:54.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.706+0000 7f8625ffb640 1 -- 172.21.15.7:0/3145533616 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862c017070 con 0x7f86300b4650 2024-04-25T10:01:54.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.706+0000 7f8625ffb640 1 -- 172.21.15.7:0/3145533616 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862c00c9a0 con 0x7f86300b4650 2024-04-25T10:01:54.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.706+0000 7f8625ffb640 1 -- 172.21.15.7:0/3145533616 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862c00cd90 con 0x7f86300b4650 2024-04-25T10:01:54.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.706+0000 7f86378b3640 1 -- 172.21.15.7:0/3145533616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86301e6090 con 0x7f86300b4650 2024-04-25T10:01:54.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.706+0000 7f86378b3640 1 -- 172.21.15.7:0/3145533616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8630157ed0 con 0x7f86300b4650 2024-04-25T10:01:54.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.707+0000 7f86378b3640 1 -- 172.21.15.7:0/3145533616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86301579e0 con 0x7f86300b4650 2024-04-25T10:01:54.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.708+0000 7f8625ffb640 1 -- 172.21.15.7:0/3145533616 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f862c01a070 con 0x7f86300b4650 2024-04-25T10:01:54.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.708+0000 7f8625ffb640 1 --2- 172.21.15.7:0/3145533616 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f861406b4d0 0x7f861406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:54.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.708+0000 7f8625ffb640 1 -- 172.21.15.7:0/3145533616 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f862c08a3a0 con 0x7f86300b4650 2024-04-25T10:01:54.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.708+0000 7f8634e4e640 1 --2- 172.21.15.7:0/3145533616 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f861406b4d0 0x7f861406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:54.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.709+0000 7f8634e4e640 1 --2- 172.21.15.7:0/3145533616 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f861406b4d0 0x7f861406d990 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8620034000 tx=0x7f862002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:54.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.713+0000 7f8625ffb640 1 -- 172.21.15.7:0/3145533616 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f862c058a10 con 0x7f86300b4650 2024-04-25T10:01:54.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.930+0000 7f86378b3640 1 -- 172.21.15.7:0/3145533616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8630068fd0 con 0x7f86300b4650 2024-04-25T10:01:54.936 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-04-25T10:01:54.931+0000 7f45ad572640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T10:01:54.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.933+0000 7f8625ffb640 1 -- 172.21.15.7:0/3145533616 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v61) v1 ==== 161+0+0 (secure 0 0 0) 0x7f862c05cab0 con 0x7f86300b4650 2024-04-25T10:01:54.937 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T10:01:54.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.936+0000 7f86378b3640 1 -- 172.21.15.7:0/3145533616 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f861406b4d0 msgr2=0x7f861406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:54.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.936+0000 7f86378b3640 1 --2- 172.21.15.7:0/3145533616 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f861406b4d0 0x7f861406d990 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8620034000 tx=0x7f862002e000 comp rx=0 tx=0).stop 2024-04-25T10:01:54.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.936+0000 7f86378b3640 1 -- 172.21.15.7:0/3145533616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86300b4650 msgr2=0x7f863014cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:54.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.936+0000 7f86378b3640 1 --2- 172.21.15.7:0/3145533616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86300b4650 0x7f863014cc60 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f862c00e9b0 tx=0x7f862c00ee70 comp rx=0 tx=0).stop 2024-04-25T10:01:54.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.936+0000 7f86378b3640 1 -- 172.21.15.7:0/3145533616 shutdown_connections 2024-04-25T10:01:54.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.936+0000 7f86378b3640 1 --2- 172.21.15.7:0/3145533616 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f861406b4d0 0x7f861406d990 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:54.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.936+0000 7f86378b3640 1 --2- 172.21.15.7:0/3145533616 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f863015adf0 0x7f86300cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:54.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.936+0000 7f86378b3640 1 --2- 172.21.15.7:0/3145533616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f863015aa10 0x7f86301e5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:54.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.936+0000 7f86378b3640 1 --2- 172.21.15.7:0/3145533616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86300b4650 0x7f863014cc60 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:54.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.936+0000 7f86378b3640 1 -- 172.21.15.7:0/3145533616 >> 172.21.15.7:0/3145533616 conn(0x7f86300b2400 msgr2=0x7f863006ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:54.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.936+0000 7f86378b3640 1 -- 172.21.15.7:0/3145533616 shutdown_connections 2024-04-25T10:01:54.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.936+0000 7f86378b3640 1 -- 172.21.15.7:0/3145533616 wait complete. 2024-04-25T10:01:54.943 INFO:tasks.ceph.mds.a.smithi007.stderr: -4558> 2024-04-25T10:00:49.388+0000 7f5deecb3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:01:54.943 INFO:tasks.ceph.mds.a.smithi007.stderr: -4216> 2024-04-25T10:00:49.975+0000 7f5deacab640 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-04-25T10:01:54.943 INFO:tasks.ceph.mds.a.smithi007.stderr: -4058> 2024-04-25T10:00:50.158+0000 7f5deacab640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 ap=1 f(v0 m2024-04-25T10:00:40.515339+0000 1=1+0) n(v0 rc2024-04-25T10:00:40.630337+0000 2=1+1) (iversion lock) | dirfrag=0 authpin=1 scrubqueue=0 0x5556ae5f9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-25T10:00:40.515339+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-25T10:00:40.630337+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2024-04-25T10:01:54.946 INFO:tasks.ceph.mds.a.smithi007.stderr: -2209> 2024-04-25T10:01:21.467+0000 7f5deacab640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 pv20 ap=3 DIRTYPARENT f(v0 m2024-04-25T10:00:40.515339+0000 1=1+0)->f(v1 m2024-04-25T10:00:40.515339+0000) n(v0 rc2024-04-25T10:00:40.630337+0000 2=1+1)->n(v0 rc2024-04-25T10:00:40.630337+0000 2=1+1) (inest lock dirty) (ifile lock->sync w=1 flushing) (iversion lock) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x5556ae5f9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-25T10:00:40.515339+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-25T10:00:40.630337+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-2} 2024-04-25T10:01:54.952 DEBUG:teuthology.orchestra.run.smithi007:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents cephfs_data 2024-04-25T10:01:54.972 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-04-25T10:01:54.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.988+0000 7f378ab34740 1 -- start start 2024-04-25T10:01:54.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.988+0000 7f378ab34740 1 Processor -- start 2024-04-25T10:01:55.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.989+0000 7f378ab34740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e10464ec00 0x55e1046be580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.989+0000 7f378ab34740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e10464f800 0x55e1046beb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.989+0000 7f378ab34740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e10464fc00 0x55e1046bf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.989+0000 7f378ab34740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e10542a600 con 0x55e10464ec00 2024-04-25T10:01:55.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.989+0000 7f378ab34740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e10542a480 con 0x55e10464fc00 2024-04-25T10:01:55.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.989+0000 7f378ab34740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e10542a300 con 0x55e10464f800 2024-04-25T10:01:55.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.989+0000 7f3788b6c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e10464ec00 0x55e1046be580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.989+0000 7f3788b6c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e10464ec00 0x55e1046be580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44772/0 (socket says 172.21.15.7:44772) 2024-04-25T10:01:55.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.989+0000 7f3788b6c640 1 -- 172.21.15.7:0/2405960851 learned_addr learned my addr 172.21.15.7:0/2405960851 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:55.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.989+0000 7f378936d640 1 --2- 172.21.15.7:0/2405960851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e10464fc00 0x55e1046bf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.989+0000 7f378836b640 1 --2- 172.21.15.7:0/2405960851 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e10464f800 0x55e1046beb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.989+0000 7f3788b6c640 1 -- 172.21.15.7:0/2405960851 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e10464f800 msgr2=0x55e1046beb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.989+0000 7f3788b6c640 1 --2- 172.21.15.7:0/2405960851 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e10464f800 0x55e1046beb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.989+0000 7f3788b6c640 1 -- 172.21.15.7:0/2405960851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e10464fc00 msgr2=0x55e1046bf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.989+0000 7f3788b6c640 1 --2- 172.21.15.7:0/2405960851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e10464fc00 0x55e1046bf080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.989+0000 7f3788b6c640 1 -- 172.21.15.7:0/2405960851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e10467b680 con 0x55e10464ec00 2024-04-25T10:01:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.989+0000 7f378836b640 1 --2- 172.21.15.7:0/2405960851 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e10464f800 0x55e1046beb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:01:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.989+0000 7f3788b6c640 1 --2- 172.21.15.7:0/2405960851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e10464ec00 0x55e1046be580 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x55e1054651d0 tx=0x55e1053d2900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dad471fff7cb1d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.989+0000 7f3786367640 1 -- 172.21.15.7:0/2405960851 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e1046749c0 con 0x55e10464ec00 2024-04-25T10:01:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.989+0000 7f3786367640 1 -- 172.21.15.7:0/2405960851 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e104698c40 con 0x55e10464ec00 2024-04-25T10:01:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.989+0000 7f3786367640 1 -- 172.21.15.7:0/2405960851 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e104674680 con 0x55e10464ec00 2024-04-25T10:01:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.989+0000 7f378ab34740 1 -- 172.21.15.7:0/2405960851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e10467ba40 con 0x55e10464ec00 2024-04-25T10:01:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.989+0000 7f378ab34740 1 -- 172.21.15.7:0/2405960851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55e10467b860 con 0x55e10464ec00 2024-04-25T10:01:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.989+0000 7f378ab34740 4 waiting for MDS map... 2024-04-25T10:01:55.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.990+0000 7f3786367640 1 -- 172.21.15.7:0/2405960851 <== mon.0 v2:172.21.15.7:3300/0 4 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x55e10550a000 con 0x55e10464ec00 2024-04-25T10:01:55.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.990+0000 7f3786367640 1 -- 172.21.15.7:0/2405960851 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 61) v1 ==== 2723+0+0 (secure 0 0 0) 0x55e1046a7180 con 0x55e10464ec00 2024-04-25T10:01:55.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.990+0000 7f378ab34740 4 Got MDS map 61 2024-04-25T10:01:55.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.990+0000 7f378ab34740 4 datascan.main: Using metadata pool output 2024-04-25T10:01:55.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.990+0000 7f378ab34740 4 datascan.main: connecting to RADOS... 2024-04-25T10:01:55.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.990+0000 7f378ab34740 1 Processor -- start 2024-04-25T10:01:55.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.990+0000 7f378ab34740 1 -- start start 2024-04-25T10:01:55.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.991+0000 7f378ab34740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e10542dc00 0x55e1046bf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.991+0000 7f378ab34740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e105576000 0x55e1046bfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.991+0000 7f378ab34740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e105576400 0x55e1046c0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.991+0000 7f378ab34740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e10542a180 con 0x55e105576400 2024-04-25T10:01:55.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.991+0000 7f378ab34740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1046ae480 con 0x55e105576000 2024-04-25T10:01:55.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.991+0000 7f378ab34740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e1046ae900 con 0x55e10542dc00 2024-04-25T10:01:55.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.991+0000 7f378836b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e105576400 0x55e1046c0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.991+0000 7f378836b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e105576400 0x55e1046c0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44784/0 (socket says 172.21.15.7:44784) 2024-04-25T10:01:55.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.991+0000 7f378836b640 1 -- 172.21.15.7:0/3119087099 learned_addr learned my addr 172.21.15.7:0/3119087099 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:55.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.991+0000 7f378936d640 1 --2- 172.21.15.7:0/3119087099 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e10542dc00 0x55e1046bf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.991+0000 7f3788b6c640 1 --2- 172.21.15.7:0/3119087099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e105576000 0x55e1046bfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.991+0000 7f378836b640 1 -- 172.21.15.7:0/3119087099 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e10542dc00 msgr2=0x55e1046bf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:55.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.991+0000 7f378836b640 1 --2- 172.21.15.7:0/3119087099 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e10542dc00 0x55e1046bf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.991+0000 7f378836b640 1 -- 172.21.15.7:0/3119087099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e105576000 msgr2=0x55e1046bfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:55.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.991+0000 7f378836b640 1 --2- 172.21.15.7:0/3119087099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e105576000 0x55e1046bfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.991+0000 7f378836b640 1 -- 172.21.15.7:0/3119087099 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e10467b0e0 con 0x55e105576400 2024-04-25T10:01:55.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.992+0000 7f378836b640 1 --2- 172.21.15.7:0/3119087099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e105576400 0x55e1046c0100 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x55e10552ae10 tx=0x55e105530c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61df7a9c2658f1bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.992+0000 7f3784363640 1 -- 172.21.15.7:0/3119087099 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e1046749c0 con 0x55e105576400 2024-04-25T10:01:55.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.992+0000 7f3784363640 1 -- 172.21.15.7:0/3119087099 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e1046981c0 con 0x55e105576400 2024-04-25T10:01:55.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.992+0000 7f3784363640 1 -- 172.21.15.7:0/3119087099 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e104674680 con 0x55e105576400 2024-04-25T10:01:55.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.992+0000 7f378ab34740 1 -- 172.21.15.7:0/3119087099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e105576400 msgr2=0x55e1046c0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.992+0000 7f378ab34740 1 --2- 172.21.15.7:0/3119087099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e105576400 0x55e1046c0100 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x55e10552ae10 tx=0x55e105530c00 comp rx=0 tx=0).stop 2024-04-25T10:01:55.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.992+0000 7f378ab34740 1 -- 172.21.15.7:0/3119087099 shutdown_connections 2024-04-25T10:01:55.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.992+0000 7f378ab34740 1 --2- 172.21.15.7:0/3119087099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e105576400 0x55e1046c0100 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.992+0000 7f378ab34740 1 --2- 172.21.15.7:0/3119087099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e105576000 0x55e1046bfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.992+0000 7f378ab34740 1 --2- 172.21.15.7:0/3119087099 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e10542dc00 0x55e1046bf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.992+0000 7f378ab34740 1 -- 172.21.15.7:0/3119087099 >> 172.21.15.7:0/3119087099 conn(0x55e10542d800 msgr2=0x55e104746800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:55.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.992+0000 7f378ab34740 1 -- 172.21.15.7:0/3119087099 shutdown_connections 2024-04-25T10:01:55.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.992+0000 7f378ab34740 1 -- 172.21.15.7:0/3119087099 wait complete. 2024-04-25T10:01:55.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.993+0000 7f378ab34740 1 Processor -- start 2024-04-25T10:01:55.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.993+0000 7f378ab34740 1 -- start start 2024-04-25T10:01:55.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.993+0000 7f378ab34740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e10542d800 0x55e1046c1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.993+0000 7f378ab34740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e105577000 0x55e1046c0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.993+0000 7f378ab34740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e105576c00 0x55e1046c0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.993+0000 7f378ab34740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e10542b380 con 0x55e105577000 2024-04-25T10:01:55.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.993+0000 7f378ab34740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e10542a180 con 0x55e10542d800 2024-04-25T10:01:55.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.993+0000 7f378ab34740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e10542b500 con 0x55e105576c00 2024-04-25T10:01:55.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.993+0000 7f3788b6c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e105577000 0x55e1046c0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.993+0000 7f3788b6c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e105577000 0x55e1046c0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44788/0 (socket says 172.21.15.7:44788) 2024-04-25T10:01:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.993+0000 7f3788b6c640 1 -- 172.21.15.7:0/177399238 learned_addr learned my addr 172.21.15.7:0/177399238 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.993+0000 7f378936d640 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e10542d800 0x55e1046c1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.993+0000 7f378836b640 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e105576c00 0x55e1046c0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.994+0000 7f3788b6c640 1 -- 172.21.15.7:0/177399238 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e105576c00 msgr2=0x55e1046c0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.994+0000 7f3788b6c640 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e105576c00 0x55e1046c0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.994+0000 7f3788b6c640 1 -- 172.21.15.7:0/177399238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e10542d800 msgr2=0x55e1046c1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.994+0000 7f3788b6c640 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e10542d800 0x55e1046c1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.994+0000 7f3788b6c640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e10467b680 con 0x55e105577000 2024-04-25T10:01:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.994+0000 7f3788b6c640 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e105577000 0x55e1046c0c00 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x55e105465e30 tx=0x55e1053d2f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.994+0000 7f3782b60640 1 -- 172.21.15.7:0/177399238 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e104674b60 con 0x55e105577000 2024-04-25T10:01:55.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.994+0000 7f3782b60640 1 -- 172.21.15.7:0/177399238 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e104698a80 con 0x55e105577000 2024-04-25T10:01:55.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.994+0000 7f378ab34740 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e10467b4a0 con 0x55e105577000 2024-04-25T10:01:55.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.994+0000 7f3782b60640 1 -- 172.21.15.7:0/177399238 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e104674820 con 0x55e105577000 2024-04-25T10:01:55.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.994+0000 7f378ab34740 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e10467b2c0 con 0x55e105577000 2024-04-25T10:01:55.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.994+0000 7f378ab34740 4 datascan.init: resolving metadata pool 13 2024-04-25T10:01:55.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.995+0000 7f3782b60640 1 -- 172.21.15.7:0/177399238 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x55e105586c00 con 0x55e105577000 2024-04-25T10:01:55.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.996+0000 7f3782b60640 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x55e105599000 0x55e1046c1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.996+0000 7f3782b60640 1 -- 172.21.15.7:0/177399238 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x55e105584e00 con 0x55e105577000 2024-04-25T10:01:55.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.996+0000 7f378ab34740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T10:01:55.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.996+0000 7f378936d640 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x55e105599000 0x55e1046c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.996+0000 7f378ab34740 4 datascan.main: data pool 'cephfs_data' has ID 14 2024-04-25T10:01:55.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.996+0000 7f378ab34740 4 datascan.main: opening data pool 'cephfs_data' 2024-04-25T10:01:55.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.996+0000 7f378ab34740 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x55e105576800 0x55e1046c0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.996+0000 7f378ab34740 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:1 14.0 14:00000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e105576400 con 0x55e105576800 2024-04-25T10:01:55.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.996+0000 7f378836b640 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x55e105576800 0x55e1046c0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.996+0000 7f378936d640 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x55e105599000 0x55e1046c1700 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x55e1053e3050 tx=0x55e1049cc000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.996+0000 7f378836b640 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x55e105576800 0x55e1046c0100 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.998+0000 7f378836b640 1 -- 172.21.15.7:0/177399238 <== osd.2 v2:172.21.15.7:6808/1173474863 1 ==== osd_op_reply(1 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce000 con 0x55e105576800 2024-04-25T10:01:55.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.998+0000 7f3783b62640 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x55e105577c00 0x55e1049d8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.998+0000 7f3783b62640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:2 14.20 14:04000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e105577400 con 0x55e105577c00 2024-04-25T10:01:55.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.999+0000 7f378936d640 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x55e105577c00 0x55e1049d8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:54.999+0000 7f378936d640 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x55e105577c00 0x55e1049d8000 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.001+0000 7f378936d640 1 -- 172.21.15.7:0/177399238 <== osd.0 v2:172.21.15.7:6800/4167741236 1 ==== osd_op_reply(2 [pgnls start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce500 con 0x55e105577c00 2024-04-25T10:01:55.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.001+0000 7f3784363640 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x55e105576400 0x55e1049d8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.001+0000 7f3784363640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:3 14.10 14:08000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049d4000 con 0x55e105576400 2024-04-25T10:01:55.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.001+0000 7f3788b6c640 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x55e105576400 0x55e1049d8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.001+0000 7f3788b6c640 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x55e105576400 0x55e1049d8580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.003+0000 7f3788b6c640 1 -- 172.21.15.7:0/177399238 <== osd.1 v2:172.21.15.7:6816/434435857 1 ==== osd_op_reply(3 [pgnls start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce780 con 0x55e105576400 2024-04-25T10:01:55.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.003+0000 7f3783b62640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:4 14.30 14:0c000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e105577800 con 0x55e105577c00 2024-04-25T10:01:55.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.003+0000 7f378936d640 1 -- 172.21.15.7:0/177399238 <== osd.0 v2:172.21.15.7:6800/4167741236 2 ==== osd_op_reply(4 [pgnls start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce500 con 0x55e105577c00 2024-04-25T10:01:55.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.003+0000 7f3784363640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:5 14.8 14:10000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049d4400 con 0x55e105577c00 2024-04-25T10:01:55.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.004+0000 7f378936d640 1 -- 172.21.15.7:0/177399238 <== osd.0 v2:172.21.15.7:6800/4167741236 3 ==== osd_op_reply(5 [pgnls start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce500 con 0x55e105577c00 2024-04-25T10:01:55.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.004+0000 7f3783b62640 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x55e105577400 0x55e1049d8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.004+0000 7f3783b62640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:6 14.28 14:14000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e105577800 con 0x55e105577400 2024-04-25T10:01:55.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.004+0000 7f378836b640 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x55e105577400 0x55e1049d8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.004+0000 7f378836b640 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x55e105577400 0x55e1049d8b00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.004+0000 7f378836b640 1 -- 172.21.15.7:0/177399238 <== osd.3 v2:172.21.15.7:6824/3045538953 1 ==== osd_op_reply(6 [pgnls start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce000 con 0x55e105577400 2024-04-25T10:01:55.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.004+0000 7f3784363640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:7 14.18 14:18000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049d4400 con 0x55e105576400 2024-04-25T10:01:55.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.004+0000 7f3788b6c640 1 -- 172.21.15.7:0/177399238 <== osd.1 v2:172.21.15.7:6816/434435857 2 ==== osd_op_reply(7 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce780 con 0x55e105576400 2024-04-25T10:01:55.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.005+0000 7f3783b62640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:8 14.38 14:1c000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e105599c00 con 0x55e105576400 2024-04-25T10:01:55.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.005+0000 7f3788b6c640 1 -- 172.21.15.7:0/177399238 <== osd.1 v2:172.21.15.7:6816/434435857 3 ==== osd_op_reply(8 [pgnls start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce780 con 0x55e105576400 2024-04-25T10:01:55.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.005+0000 7f3784363640 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x55e1049d4800 0x55e1049d9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.005+0000 7f3784363640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:9 14.4 14:20000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049d4c00 con 0x55e1049d4800 2024-04-25T10:01:55.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.005+0000 7f378936d640 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x55e1049d4800 0x55e1049d9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.006+0000 7f378936d640 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x55e1049d4800 0x55e1049d9600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.008+0000 7f378936d640 1 -- 172.21.15.7:0/177399238 <== osd.6 v2:172.21.15.55:6824/4293769515 1 ==== osd_op_reply(9 [pgnls start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce500 con 0x55e1049d4800 2024-04-25T10:01:55.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.008+0000 7f3783b62640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:10 14.24 14:24000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049d5000 con 0x55e105576400 2024-04-25T10:01:55.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.008+0000 7f3788b6c640 1 -- 172.21.15.7:0/177399238 <== osd.1 v2:172.21.15.7:6816/434435857 4 ==== osd_op_reply(10 [pgnls start_epoch 92 out=49b] v88'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce780 con 0x55e105576400 2024-04-25T10:01:55.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.008+0000 7f3784363640 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x55e1049d4000 0x55e1049d9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.008+0000 7f3784363640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:11 14.14 14:28000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e105598c00 con 0x55e1049d4000 2024-04-25T10:01:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.008+0000 7f3788b6c640 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x55e1049d4000 0x55e1049d9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.009+0000 7f3788b6c640 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x55e1049d4000 0x55e1049d9b80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.009+0000 7f3788b6c640 1 -- 172.21.15.7:0/177399238 <== osd.4 v2:172.21.15.55:6808/2248155105 1 ==== osd_op_reply(11 [pgnls start_epoch 92 out=49b] v88'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce780 con 0x55e1049d4000 2024-04-25T10:01:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.009+0000 7f3783b62640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:12 14.34 14:2c000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049d5400 con 0x55e105576800 2024-04-25T10:01:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.009+0000 7f378836b640 1 -- 172.21.15.7:0/177399238 <== osd.2 v2:172.21.15.7:6808/1173474863 2 ==== osd_op_reply(12 [pgnls start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce000 con 0x55e105576800 2024-04-25T10:01:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.009+0000 7f3784363640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:13 14.c 14:30000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e105598800 con 0x55e105577c00 2024-04-25T10:01:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.010+0000 7f378936d640 1 -- 172.21.15.7:0/177399238 <== osd.0 v2:172.21.15.7:6800/4167741236 4 ==== osd_op_reply(13 [pgnls start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce500 con 0x55e105577c00 2024-04-25T10:01:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.010+0000 7f3783b62640 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x55e1049d5800 0x55e1049d9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.010+0000 7f3783b62640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:14 14.2c 14:34000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049d5c00 con 0x55e1049d5800 2024-04-25T10:01:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.010+0000 7f378836b640 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x55e1049d5800 0x55e1049d9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.010+0000 7f378836b640 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x55e1049d5800 0x55e1049d9080 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.012+0000 7f378836b640 1 -- 172.21.15.7:0/177399238 <== osd.5 v2:172.21.15.55:6800/2514169616 1 ==== osd_op_reply(14 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce000 con 0x55e1049d5800 2024-04-25T10:01:55.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.012+0000 7f3784363640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:15 14.1c 14:38000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e105599c00 con 0x55e105577c00 2024-04-25T10:01:55.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.013+0000 7f378936d640 1 -- 172.21.15.7:0/177399238 <== osd.0 v2:172.21.15.7:6800/4167741236 5 ==== osd_op_reply(15 [pgnls start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce500 con 0x55e105577c00 2024-04-25T10:01:55.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.013+0000 7f3783b62640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:16 14.3c 14:3c000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049d4400 con 0x55e105576400 2024-04-25T10:01:55.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.013+0000 7f3788b6c640 1 -- 172.21.15.7:0/177399238 <== osd.1 v2:172.21.15.7:6816/434435857 5 ==== osd_op_reply(16 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce780 con 0x55e105576400 2024-04-25T10:01:55.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.013+0000 7f3784363640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:17 14.2 14:40000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049fa000 con 0x55e1049d4800 2024-04-25T10:01:55.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.013+0000 7f378936d640 1 -- 172.21.15.7:0/177399238 <== osd.6 v2:172.21.15.55:6824/4293769515 2 ==== osd_op_reply(17 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce500 con 0x55e1049d4800 2024-04-25T10:01:55.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.013+0000 7f3783b62640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:18 14.22 14:44000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049d5000 con 0x55e1049d4000 2024-04-25T10:01:55.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.014+0000 7f3788b6c640 1 -- 172.21.15.7:0/177399238 <== osd.4 v2:172.21.15.55:6808/2248155105 2 ==== osd_op_reply(18 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce780 con 0x55e1049d4000 2024-04-25T10:01:55.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.014+0000 7f3784363640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:19 14.12 14:48000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049fa400 con 0x55e105576800 2024-04-25T10:01:55.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.014+0000 7f378836b640 1 -- 172.21.15.7:0/177399238 <== osd.2 v2:172.21.15.7:6808/1173474863 3 ==== osd_op_reply(19 [pgnls start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce000 con 0x55e105576800 2024-04-25T10:01:55.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.014+0000 7f3783b62640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:20 14.32 14:4c000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049fb400 con 0x55e1049d4000 2024-04-25T10:01:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.014+0000 7f3788b6c640 1 -- 172.21.15.7:0/177399238 <== osd.4 v2:172.21.15.55:6808/2248155105 3 ==== osd_op_reply(20 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce780 con 0x55e1049d4000 2024-04-25T10:01:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.014+0000 7f3784363640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:21 14.a 14:50000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049fa800 con 0x55e1049d5800 2024-04-25T10:01:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.015+0000 7f378836b640 1 -- 172.21.15.7:0/177399238 <== osd.5 v2:172.21.15.55:6800/2514169616 2 ==== osd_op_reply(21 [pgnls start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce000 con 0x55e1049d5800 2024-04-25T10:01:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.015+0000 7f3783b62640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:22 14.2a 14:54000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049fb800 con 0x55e1049d4000 2024-04-25T10:01:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.015+0000 7f3788b6c640 1 -- 172.21.15.7:0/177399238 <== osd.4 v2:172.21.15.55:6808/2248155105 4 ==== osd_op_reply(22 [pgnls start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce780 con 0x55e1049d4000 2024-04-25T10:01:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.015+0000 7f3784363640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:23 14.1a 14:58000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049fac00 con 0x55e105577c00 2024-04-25T10:01:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.016+0000 7f378936d640 1 -- 172.21.15.7:0/177399238 <== osd.0 v2:172.21.15.7:6800/4167741236 6 ==== osd_op_reply(23 [pgnls start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce500 con 0x55e105577c00 2024-04-25T10:01:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.016+0000 7f3783b62640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:24 14.3a 14:5c000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049fbc00 con 0x55e105577c00 2024-04-25T10:01:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.016+0000 7f378936d640 1 -- 172.21.15.7:0/177399238 <== osd.0 v2:172.21.15.7:6800/4167741236 7 ==== osd_op_reply(24 [pgnls start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce500 con 0x55e105577c00 2024-04-25T10:01:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.016+0000 7f3784363640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:25 14.6 14:60000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049fb000 con 0x55e105577c00 2024-04-25T10:01:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.016+0000 7f378936d640 1 -- 172.21.15.7:0/177399238 <== osd.0 v2:172.21.15.7:6800/4167741236 8 ==== osd_op_reply(25 [pgnls start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce500 con 0x55e105577c00 2024-04-25T10:01:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.016+0000 7f3783b62640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:26 14.26 14:64000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049fa000 con 0x55e1049d4000 2024-04-25T10:01:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.016+0000 7f3788b6c640 1 -- 172.21.15.7:0/177399238 <== osd.4 v2:172.21.15.55:6808/2248155105 5 ==== osd_op_reply(26 [pgnls start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce780 con 0x55e1049d4000 2024-04-25T10:01:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.016+0000 7f3784363640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:27 14.16 14:68000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049fac00 con 0x55e105577400 2024-04-25T10:01:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.017+0000 7f378836b640 1 -- 172.21.15.7:0/177399238 <== osd.3 v2:172.21.15.7:6824/3045538953 2 ==== osd_op_reply(27 [pgnls start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce000 con 0x55e105577400 2024-04-25T10:01:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.017+0000 7f3783b62640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:28 14.36 14:6c000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049d4c00 con 0x55e105576800 2024-04-25T10:01:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.017+0000 7f378836b640 1 -- 172.21.15.7:0/177399238 <== osd.2 v2:172.21.15.7:6808/1173474863 4 ==== osd_op_reply(28 [pgnls start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce000 con 0x55e105576800 2024-04-25T10:01:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.017+0000 7f3784363640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:29 14.e 14:70000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049fa400 con 0x55e1049d4000 2024-04-25T10:01:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.017+0000 7f3788b6c640 1 -- 172.21.15.7:0/177399238 <== osd.4 v2:172.21.15.55:6808/2248155105 6 ==== osd_op_reply(29 [pgnls start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce780 con 0x55e1049d4000 2024-04-25T10:01:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.017+0000 7f3783b62640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:30 14.2e 14:74000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049d5400 con 0x55e105577400 2024-04-25T10:01:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.018+0000 7f378836b640 1 -- 172.21.15.7:0/177399238 <== osd.3 v2:172.21.15.7:6824/3045538953 3 ==== osd_op_reply(30 [pgnls start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce000 con 0x55e105577400 2024-04-25T10:01:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.018+0000 7f3784363640 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x55e1049fa800 0x55e1049da100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.018+0000 7f3784363640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:31 14.1e 14:78000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049fb400 con 0x55e1049fa800 2024-04-25T10:01:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.018+0000 7f378936d640 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x55e1049fa800 0x55e1049da100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.018+0000 7f378936d640 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x55e1049fa800 0x55e1049da100 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.019+0000 7f378936d640 1 -- 172.21.15.7:0/177399238 <== osd.7 v2:172.21.15.55:6816/2960381217 1 ==== osd_op_reply(31 [pgnls start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce500 con 0x55e1049fa800 2024-04-25T10:01:55.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.019+0000 7f3783b62640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:32 14.3e 14:7c000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049d5c00 con 0x55e1049d5800 2024-04-25T10:01:55.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.019+0000 7f378836b640 1 -- 172.21.15.7:0/177399238 <== osd.5 v2:172.21.15.55:6800/2514169616 3 ==== osd_op_reply(32 [pgnls start_epoch 92 out=49b] v88'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce000 con 0x55e1049d5800 2024-04-25T10:01:55.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.019+0000 7f3784363640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:33 14.1 14:80000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049fb800 con 0x55e105577400 2024-04-25T10:01:55.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.019+0000 7f378836b640 1 -- 172.21.15.7:0/177399238 <== osd.3 v2:172.21.15.7:6824/3045538953 4 ==== osd_op_reply(33 [pgnls start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce000 con 0x55e105577400 2024-04-25T10:01:55.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.019+0000 7f3783b62640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:34 14.21 14:84000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e105577800 con 0x55e1049d5800 2024-04-25T10:01:55.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.020+0000 7f378836b640 1 -- 172.21.15.7:0/177399238 <== osd.5 v2:172.21.15.55:6800/2514169616 4 ==== osd_op_reply(34 [pgnls start_epoch 92 out=49b] v88'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce000 con 0x55e1049d5800 2024-04-25T10:01:55.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.020+0000 7f3784363640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:35 14.11 14:88000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049fa000 con 0x55e1049d4000 2024-04-25T10:01:55.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.020+0000 7f3788b6c640 1 -- 172.21.15.7:0/177399238 <== osd.4 v2:172.21.15.55:6808/2248155105 7 ==== osd_op_reply(35 [pgnls start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce780 con 0x55e1049d4000 2024-04-25T10:01:55.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.020+0000 7f3783b62640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:36 14.31 14:8c000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e105598800 con 0x55e1049fa800 2024-04-25T10:01:55.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.020+0000 7f378936d640 1 -- 172.21.15.7:0/177399238 <== osd.7 v2:172.21.15.55:6816/2960381217 2 ==== osd_op_reply(36 [pgnls start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce500 con 0x55e1049fa800 2024-04-25T10:01:55.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.020+0000 7f3784363640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:37 14.9 14:90000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049fa400 con 0x55e1049d5800 2024-04-25T10:01:55.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.021+0000 7f378836b640 1 -- 172.21.15.7:0/177399238 <== osd.5 v2:172.21.15.55:6800/2514169616 5 ==== osd_op_reply(37 [pgnls start_epoch 92 out=49b] v88'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce000 con 0x55e1049d5800 2024-04-25T10:01:55.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.021+0000 7f3783b62640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:38 14.29 14:94000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e105599c00 con 0x55e1049d4800 2024-04-25T10:01:55.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.021+0000 7f378936d640 1 -- 172.21.15.7:0/177399238 <== osd.6 v2:172.21.15.55:6824/4293769515 3 ==== osd_op_reply(38 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce500 con 0x55e1049d4800 2024-04-25T10:01:55.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.021+0000 7f3784363640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:39 14.19 14:98000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049d4400 con 0x55e1049d4800 2024-04-25T10:01:55.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.022+0000 7f378936d640 1 -- 172.21.15.7:0/177399238 <== osd.6 v2:172.21.15.55:6824/4293769515 4 ==== osd_op_reply(39 [pgnls start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce500 con 0x55e1049d4800 2024-04-25T10:01:55.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.022+0000 7f3783b62640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:40 14.39 14:9c000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049fbc00 con 0x55e1049fa800 2024-04-25T10:01:55.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.022+0000 7f378936d640 1 -- 172.21.15.7:0/177399238 <== osd.7 v2:172.21.15.55:6816/2960381217 3 ==== osd_op_reply(40 [pgnls start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce500 con 0x55e1049fa800 2024-04-25T10:01:55.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.022+0000 7f3784363640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:41 14.5 14:a0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049d5000 con 0x55e105577c00 2024-04-25T10:01:55.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.022+0000 7f378936d640 1 -- 172.21.15.7:0/177399238 <== osd.0 v2:172.21.15.7:6800/4167741236 9 ==== osd_op_reply(41 [pgnls start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce500 con 0x55e105577c00 2024-04-25T10:01:55.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.022+0000 7f3783b62640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:42 14.25 14:a4000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049fb000 con 0x55e105576800 2024-04-25T10:01:55.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.023+0000 7f378836b640 1 -- 172.21.15.7:0/177399238 <== osd.2 v2:172.21.15.7:6808/1173474863 5 ==== osd_op_reply(42 [pgnls start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce000 con 0x55e105576800 2024-04-25T10:01:55.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.023+0000 7f3784363640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:43 14.15 14:a8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e105598c00 con 0x55e1049fa800 2024-04-25T10:01:55.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.023+0000 7f378936d640 1 -- 172.21.15.7:0/177399238 <== osd.7 v2:172.21.15.55:6816/2960381217 4 ==== osd_op_reply(43 [pgnls start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce500 con 0x55e1049fa800 2024-04-25T10:01:55.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.023+0000 7f3783b62640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:44 14.35 14:ac000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049d4400 con 0x55e1049d4000 2024-04-25T10:01:55.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.023+0000 7f3788b6c640 1 -- 172.21.15.7:0/177399238 <== osd.4 v2:172.21.15.55:6808/2248155105 8 ==== osd_op_reply(44 [pgnls start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce780 con 0x55e1049d4000 2024-04-25T10:01:55.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.024+0000 7f3784363640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:45 14.d 14:b0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e105577800 con 0x55e1049d4800 2024-04-25T10:01:55.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.024+0000 7f378936d640 1 -- 172.21.15.7:0/177399238 <== osd.6 v2:172.21.15.55:6824/4293769515 5 ==== osd_op_reply(45 [pgnls start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce500 con 0x55e1049d4800 2024-04-25T10:01:55.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.024+0000 7f3783b62640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:46 14.2d 14:b4000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049d4c00 con 0x55e1049d4000 2024-04-25T10:01:55.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.024+0000 7f3788b6c640 1 -- 172.21.15.7:0/177399238 <== osd.4 v2:172.21.15.55:6808/2248155105 9 ==== osd_op_reply(46 [pgnls start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce780 con 0x55e1049d4000 2024-04-25T10:01:55.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.024+0000 7f3784363640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:47 14.1d 14:b8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049fb400 con 0x55e105577c00 2024-04-25T10:01:55.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.024+0000 7f378936d640 1 -- 172.21.15.7:0/177399238 <== osd.0 v2:172.21.15.7:6800/4167741236 10 ==== osd_op_reply(47 [pgnls start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce500 con 0x55e105577c00 2024-04-25T10:01:55.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.024+0000 7f3783b62640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:48 14.3d 14:bc000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049d5400 con 0x55e105577400 2024-04-25T10:01:55.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.025+0000 7f378836b640 1 -- 172.21.15.7:0/177399238 <== osd.3 v2:172.21.15.7:6824/3045538953 5 ==== osd_op_reply(48 [pgnls start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce000 con 0x55e105577400 2024-04-25T10:01:55.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.025+0000 7f3784363640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:49 14.3 14:c0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049fac00 con 0x55e105577c00 2024-04-25T10:01:55.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.025+0000 7f378936d640 1 -- 172.21.15.7:0/177399238 <== osd.0 v2:172.21.15.7:6800/4167741236 11 ==== osd_op_reply(49 [pgnls start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce500 con 0x55e105577c00 2024-04-25T10:01:55.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.025+0000 7f3783b62640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:50 14.23 14:c4000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049d5c00 con 0x55e1049fa800 2024-04-25T10:01:55.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.025+0000 7f378936d640 1 -- 172.21.15.7:0/177399238 <== osd.7 v2:172.21.15.55:6816/2960381217 5 ==== osd_op_reply(50 [pgnls start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce500 con 0x55e1049fa800 2024-04-25T10:01:55.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.025+0000 7f3784363640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:51 14.13 14:c8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049fb800 con 0x55e105576800 2024-04-25T10:01:55.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.026+0000 7f378836b640 1 -- 172.21.15.7:0/177399238 <== osd.2 v2:172.21.15.7:6808/1173474863 6 ==== osd_op_reply(51 [pgnls start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce000 con 0x55e105576800 2024-04-25T10:01:55.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.026+0000 7f3783b62640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:52 14.33 14:cc000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e105598800 con 0x55e105576400 2024-04-25T10:01:55.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.026+0000 7f3788b6c640 1 -- 172.21.15.7:0/177399238 <== osd.1 v2:172.21.15.7:6816/434435857 6 ==== osd_op_reply(52 [pgnls start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce780 con 0x55e105576400 2024-04-25T10:01:55.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.026+0000 7f3784363640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:53 14.b 14:d0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049d5000 con 0x55e105577c00 2024-04-25T10:01:55.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.026+0000 7f378936d640 1 -- 172.21.15.7:0/177399238 <== osd.0 v2:172.21.15.7:6800/4167741236 12 ==== osd_op_reply(53 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce500 con 0x55e105577c00 2024-04-25T10:01:55.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.026+0000 7f3783b62640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:54 14.2b 14:d4000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e105599c00 con 0x55e1049d4000 2024-04-25T10:01:55.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.027+0000 7f3788b6c640 1 -- 172.21.15.7:0/177399238 <== osd.4 v2:172.21.15.55:6808/2248155105 10 ==== osd_op_reply(54 [pgnls start_epoch 92 out=49b] v88'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce780 con 0x55e1049d4000 2024-04-25T10:01:55.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.027+0000 7f3784363640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:55 14.1b 14:d8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049d5c00 con 0x55e1049fa800 2024-04-25T10:01:55.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.027+0000 7f378936d640 1 -- 172.21.15.7:0/177399238 <== osd.7 v2:172.21.15.55:6816/2960381217 6 ==== osd_op_reply(55 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce500 con 0x55e1049fa800 2024-04-25T10:01:55.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.027+0000 7f3783b62640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:56 14.3b 14:dc000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e104a04000 con 0x55e1049d4000 2024-04-25T10:01:55.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.027+0000 7f3788b6c640 1 -- 172.21.15.7:0/177399238 <== osd.4 v2:172.21.15.55:6808/2248155105 11 ==== osd_op_reply(56 [pgnls start_epoch 92 out=49b] v88'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce780 con 0x55e1049d4000 2024-04-25T10:01:55.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.027+0000 7f3784363640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:57 14.7 14:e0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049fbc00 con 0x55e1049d5800 2024-04-25T10:01:55.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.028+0000 7f378836b640 1 -- 172.21.15.7:0/177399238 <== osd.5 v2:172.21.15.55:6800/2514169616 6 ==== osd_op_reply(57 [pgnls start_epoch 92 out=81b] v88'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e1053ce000 con 0x55e1049d5800 2024-04-25T10:01:55.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.028+0000 7f378ab34740 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:58 14.7 14:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e105576000 con 0x55e1049d5800 2024-04-25T10:01:55.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.028+0000 7f378836b640 1 -- 172.21.15.7:0/177399238 <== osd.5 v2:172.21.15.55:6800/2514169616 7 ==== osd_op_reply(58 10000000001.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55e1053ce000 con 0x55e1049d5800 2024-04-25T10:01:55.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.028+0000 7f378ab34740 10 datascan.operator(): handling object 1099511627777.0 2024-04-25T10:01:55.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.028+0000 7f378ab34740 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:59 14.7 14:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e104a0c000 con 0x55e1049d5800 2024-04-25T10:01:55.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.030+0000 7f378836b640 1 -- 172.21.15.7:0/177399238 <== osd.5 v2:172.21.15.55:6800/2514169616 8 ==== osd_op_reply(59 10000000001.00000000 [call] v92'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e1053ce000 con 0x55e1049d5800 2024-04-25T10:01:55.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.030+0000 7f378ab34740 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:60 14.27 14:e4000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e104a0c400 con 0x55e1049d5800 2024-04-25T10:01:55.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.030+0000 7f378836b640 1 -- 172.21.15.7:0/177399238 <== osd.5 v2:172.21.15.55:6800/2514169616 9 ==== osd_op_reply(60 [pgnls start_epoch 92 out=49b] v88'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce000 con 0x55e1049d5800 2024-04-25T10:01:55.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.030+0000 7f3784363640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:61 14.17 14:e8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049fb400 con 0x55e105576400 2024-04-25T10:01:55.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.030+0000 7f3788b6c640 1 -- 172.21.15.7:0/177399238 <== osd.1 v2:172.21.15.7:6816/434435857 7 ==== osd_op_reply(61 [pgnls start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce780 con 0x55e105576400 2024-04-25T10:01:55.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.030+0000 7f3783b62640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:62 14.37 14:ec000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e104a04400 con 0x55e1049d4000 2024-04-25T10:01:55.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.030+0000 7f3788b6c640 1 -- 172.21.15.7:0/177399238 <== osd.4 v2:172.21.15.55:6808/2248155105 12 ==== osd_op_reply(62 [pgnls start_epoch 92 out=49b] v88'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce780 con 0x55e1049d4000 2024-04-25T10:01:55.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.030+0000 7f3784363640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:63 14.f 14:f0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e1049fac00 con 0x55e1049fa800 2024-04-25T10:01:55.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.031+0000 7f378936d640 1 -- 172.21.15.7:0/177399238 <== osd.7 v2:172.21.15.55:6816/2960381217 7 ==== osd_op_reply(63 [pgnls start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce500 con 0x55e1049fa800 2024-04-25T10:01:55.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.031+0000 7f3783b62640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:64 14.2f 14:f4000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e104a04800 con 0x55e105577c00 2024-04-25T10:01:55.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.031+0000 7f378936d640 1 -- 172.21.15.7:0/177399238 <== osd.0 v2:172.21.15.7:6800/4167741236 13 ==== osd_op_reply(64 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce500 con 0x55e105577c00 2024-04-25T10:01:55.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.031+0000 7f3784363640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:65 14.1f 14:f8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e105577800 con 0x55e105577c00 2024-04-25T10:01:55.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.031+0000 7f378936d640 1 -- 172.21.15.7:0/177399238 <== osd.0 v2:172.21.15.7:6800/4167741236 14 ==== osd_op_reply(65 [pgnls start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce500 con 0x55e105577c00 2024-04-25T10:01:55.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.031+0000 7f3783b62640 1 -- 172.21.15.7:0/177399238 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:66 14.3f 14:fc000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x55e104a04c00 con 0x55e105577400 2024-04-25T10:01:55.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378836b640 1 -- 172.21.15.7:0/177399238 <== osd.3 v2:172.21.15.7:6824/3045538953 6 ==== osd_op_reply(66 [pgnls start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e1053ce000 con 0x55e105577400 2024-04-25T10:01:55.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378ab34740 1 -- 172.21.15.7:0/177399238 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x55e105577c00 msgr2=0x55e1049d8000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378ab34740 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x55e105577c00 0x55e1049d8000 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378ab34740 1 -- 172.21.15.7:0/177399238 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x55e105576400 msgr2=0x55e1049d8580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378ab34740 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x55e105576400 0x55e1049d8580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378ab34740 1 -- 172.21.15.7:0/177399238 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x55e105576800 msgr2=0x55e1046c0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378ab34740 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x55e105576800 0x55e1046c0100 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378ab34740 1 -- 172.21.15.7:0/177399238 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x55e105577400 msgr2=0x55e1049d8b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378ab34740 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x55e105577400 0x55e1049d8b00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378836b640 1 -- 172.21.15.7:0/177399238 reap_dead start 2024-04-25T10:01:55.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378ab34740 1 -- 172.21.15.7:0/177399238 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x55e1049d4000 msgr2=0x55e1049d9b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378ab34740 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x55e1049d4000 0x55e1049d9b80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378ab34740 1 -- 172.21.15.7:0/177399238 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x55e1049d5800 msgr2=0x55e1049d9080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378ab34740 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x55e1049d5800 0x55e1049d9080 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378ab34740 1 -- 172.21.15.7:0/177399238 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x55e1049d4800 msgr2=0x55e1049d9600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378ab34740 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x55e1049d4800 0x55e1049d9600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378ab34740 1 -- 172.21.15.7:0/177399238 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x55e1049fa800 msgr2=0x55e1049da100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378ab34740 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x55e1049fa800 0x55e1049da100 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378836b640 1 -- 172.21.15.7:0/177399238 reap_dead start 2024-04-25T10:01:55.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378ab34740 1 -- 172.21.15.7:0/177399238 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x55e105599000 msgr2=0x55e1046c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378ab34740 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x55e105599000 0x55e1046c1700 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x55e1053e3050 tx=0x55e1049cc000 comp rx=0 tx=0).stop 2024-04-25T10:01:55.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378ab34740 1 -- 172.21.15.7:0/177399238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e105577000 msgr2=0x55e1046c0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378ab34740 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e105577000 0x55e1046c0c00 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x55e105465e30 tx=0x55e1053d2f60 comp rx=0 tx=0).stop 2024-04-25T10:01:55.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378ab34740 1 -- 172.21.15.7:0/177399238 shutdown_connections 2024-04-25T10:01:55.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378ab34740 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x55e105599000 0x55e1046c1700 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378ab34740 1 --2- 172.21.15.7:0/177399238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e105577000 0x55e1046c0c00 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378ab34740 1 -- 172.21.15.7:0/177399238 >> 172.21.15.7:0/177399238 conn(0x55e10542dc00 msgr2=0x55e104746800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:55.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378ab34740 1 -- 172.21.15.7:0/177399238 shutdown_connections 2024-04-25T10:01:55.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378ab34740 1 -- 172.21.15.7:0/177399238 wait complete. 2024-04-25T10:01:55.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378ab34740 1 -- 172.21.15.7:0/2405960851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e10464ec00 msgr2=0x55e1046be580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378ab34740 1 --2- 172.21.15.7:0/2405960851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e10464ec00 0x55e1046be580 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x55e1054651d0 tx=0x55e1053d2900 comp rx=0 tx=0).stop 2024-04-25T10:01:55.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378ab34740 1 -- 172.21.15.7:0/2405960851 shutdown_connections 2024-04-25T10:01:55.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.032+0000 7f378ab34740 1 --2- 172.21.15.7:0/2405960851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e10464fc00 0x55e1046bf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.033+0000 7f378ab34740 1 --2- 172.21.15.7:0/2405960851 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55e10464f800 0x55e1046beb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.033+0000 7f378ab34740 1 --2- 172.21.15.7:0/2405960851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e10464ec00 0x55e1046be580 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.033+0000 7f378ab34740 1 -- 172.21.15.7:0/2405960851 >> 172.21.15.7:0/2405960851 conn(0x55e10464f000 msgr2=0x55e104747000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:55.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.033+0000 7f378ab34740 1 -- 172.21.15.7:0/2405960851 shutdown_connections 2024-04-25T10:01:55.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.033+0000 7f378ab34740 1 -- 172.21.15.7:0/2405960851 wait complete. 2024-04-25T10:01:55.046 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', 'cephfs_data'] in time 0:00:00.093941, result: 2024-04-25T10:01:55.046 DEBUG:teuthology.orchestra.run.smithi007:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes cephfs_data 2024-04-25T10:01:55.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.116+0000 7f68f5920740 1 -- start start 2024-04-25T10:01:55.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.116+0000 7f68f5920740 1 Processor -- start 2024-04-25T10:01:55.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.116+0000 7f68f5920740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56329abbac00 0x56329ac2a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.116+0000 7f68f5920740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56329abbb800 0x56329ac2ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.116+0000 7f68f5920740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56329abbbc00 0x56329ac2b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.116+0000 7f68f5920740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x56329b94a180 con 0x56329abbb800 2024-04-25T10:01:55.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.116+0000 7f68f5920740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56329b94a300 con 0x56329abbac00 2024-04-25T10:01:55.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.116+0000 7f68f5920740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x56329b94a480 con 0x56329abbbc00 2024-04-25T10:01:55.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.116+0000 7f68f30ac640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56329abbb800 0x56329ac2ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.117+0000 7f68f30ac640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56329abbb800 0x56329ac2ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44814/0 (socket says 172.21.15.7:44814) 2024-04-25T10:01:55.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.117+0000 7f68f30ac640 1 -- 172.21.15.7:0/2634811604 learned_addr learned my addr 172.21.15.7:0/2634811604 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:55.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.117+0000 7f68f38ad640 1 --2- 172.21.15.7:0/2634811604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56329abbac00 0x56329ac2a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.117+0000 7f68f40ae640 1 --2- 172.21.15.7:0/2634811604 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56329abbbc00 0x56329ac2b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.117+0000 7f68f30ac640 1 -- 172.21.15.7:0/2634811604 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56329abbbc00 msgr2=0x56329ac2b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:55.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.117+0000 7f68f30ac640 1 --2- 172.21.15.7:0/2634811604 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56329abbbc00 0x56329ac2b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.117+0000 7f68f30ac640 1 -- 172.21.15.7:0/2634811604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56329abbac00 msgr2=0x56329ac2a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:55.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.117+0000 7f68f30ac640 1 --2- 172.21.15.7:0/2634811604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56329abbac00 0x56329ac2a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.117+0000 7f68f30ac640 1 -- 172.21.15.7:0/2634811604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56329abe7680 con 0x56329abbb800 2024-04-25T10:01:55.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.117+0000 7f68f40ae640 1 --2- 172.21.15.7:0/2634811604 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56329abbbc00 0x56329ac2b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:01:55.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.117+0000 7f68f30ac640 1 --2- 172.21.15.7:0/2634811604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56329abbb800 0x56329ac2ab00 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x56329b9c7cb0 tx=0x56329ad2e240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de5d7414996dc1a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.117+0000 7f68f10a8640 1 -- 172.21.15.7:0/2634811604 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56329abe0680 con 0x56329abbb800 2024-04-25T10:01:55.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.117+0000 7f68f10a8640 1 -- 172.21.15.7:0/2634811604 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56329ac041c0 con 0x56329abbb800 2024-04-25T10:01:55.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.117+0000 7f68f10a8640 1 -- 172.21.15.7:0/2634811604 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56329abe0b60 con 0x56329abbb800 2024-04-25T10:01:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.117+0000 7f68f5920740 1 -- 172.21.15.7:0/2634811604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56329abe7860 con 0x56329abbb800 2024-04-25T10:01:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.117+0000 7f68f5920740 1 -- 172.21.15.7:0/2634811604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x56329abe72c0 con 0x56329abbb800 2024-04-25T10:01:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.117+0000 7f68f5920740 4 waiting for MDS map... 2024-04-25T10:01:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.117+0000 7f68f10a8640 1 -- 172.21.15.7:0/2634811604 <== mon.0 v2:172.21.15.7:3300/0 4 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x56329ba8a600 con 0x56329abbb800 2024-04-25T10:01:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.117+0000 7f68f10a8640 1 -- 172.21.15.7:0/2634811604 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 61) v1 ==== 2723+0+0 (secure 0 0 0) 0x56329ac13180 con 0x56329abbb800 2024-04-25T10:01:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.117+0000 7f68f5920740 4 Got MDS map 61 2024-04-25T10:01:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.118+0000 7f68f5920740 4 datascan.main: Using metadata pool output 2024-04-25T10:01:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.118+0000 7f68f5920740 4 datascan.main: connecting to RADOS... 2024-04-25T10:01:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.118+0000 7f68f5920740 1 Processor -- start 2024-04-25T10:01:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.118+0000 7f68f5920740 1 -- start start 2024-04-25T10:01:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.119+0000 7f68f5920740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56329ba8d000 0x56329ac2b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.119+0000 7f68f5920740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56329ba8d400 0x56329ac2bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.119+0000 7f68f5920740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56329ba8d800 0x56329ac2c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.119+0000 7f68f5920740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x56329b94a600 con 0x56329ba8d800 2024-04-25T10:01:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.119+0000 7f68f5920740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56329b94a780 con 0x56329ba8d400 2024-04-25T10:01:55.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.119+0000 7f68f5920740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x56329b94a900 con 0x56329ba8d000 2024-04-25T10:01:55.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.119+0000 7f68f30ac640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56329ba8d800 0x56329ac2c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.119+0000 7f68f30ac640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56329ba8d800 0x56329ac2c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44822/0 (socket says 172.21.15.7:44822) 2024-04-25T10:01:55.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.119+0000 7f68f30ac640 1 -- 172.21.15.7:0/913511422 learned_addr learned my addr 172.21.15.7:0/913511422 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:55.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.119+0000 7f68f40ae640 1 --2- 172.21.15.7:0/913511422 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56329ba8d000 0x56329ac2b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.119+0000 7f68f38ad640 1 --2- 172.21.15.7:0/913511422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56329ba8d400 0x56329ac2bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.119+0000 7f68f30ac640 1 -- 172.21.15.7:0/913511422 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56329ba8d000 msgr2=0x56329ac2b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:55.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.119+0000 7f68f30ac640 1 --2- 172.21.15.7:0/913511422 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56329ba8d000 0x56329ac2b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.119+0000 7f68f30ac640 1 -- 172.21.15.7:0/913511422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56329ba8d400 msgr2=0x56329ac2bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:55.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.119+0000 7f68f30ac640 1 --2- 172.21.15.7:0/913511422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56329ba8d400 0x56329ac2bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.119+0000 7f68f30ac640 1 -- 172.21.15.7:0/913511422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56329abe74a0 con 0x56329ba8d800 2024-04-25T10:01:55.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.119+0000 7f68f40ae640 1 --2- 172.21.15.7:0/913511422 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56329ba8d000 0x56329ac2b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:01:55.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.119+0000 7f68f38ad640 1 --2- 172.21.15.7:0/913511422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56329ba8d400 0x56329ac2bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:01:55.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.119+0000 7f68f30ac640 1 --2- 172.21.15.7:0/913511422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56329ba8d800 0x56329ac2c100 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x56329ba9f0b0 tx=0x56329b93ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2d322783bc0dbb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.119+0000 7f68ef0a4640 1 -- 172.21.15.7:0/913511422 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56329abe0820 con 0x56329ba8d800 2024-04-25T10:01:55.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.119+0000 7f68ef0a4640 1 -- 172.21.15.7:0/913511422 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56329ac04e00 con 0x56329ba8d800 2024-04-25T10:01:55.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.119+0000 7f68ef0a4640 1 -- 172.21.15.7:0/913511422 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56329abe0680 con 0x56329ba8d800 2024-04-25T10:01:55.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.120+0000 7f68f5920740 1 -- 172.21.15.7:0/913511422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56329ba8d800 msgr2=0x56329ac2c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.120+0000 7f68f5920740 1 --2- 172.21.15.7:0/913511422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56329ba8d800 0x56329ac2c100 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x56329ba9f0b0 tx=0x56329b93ea80 comp rx=0 tx=0).stop 2024-04-25T10:01:55.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.120+0000 7f68f5920740 1 -- 172.21.15.7:0/913511422 shutdown_connections 2024-04-25T10:01:55.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.120+0000 7f68f5920740 1 --2- 172.21.15.7:0/913511422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56329ba8d800 0x56329ac2c100 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.120+0000 7f68f5920740 1 --2- 172.21.15.7:0/913511422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56329ba8d400 0x56329ac2bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.120+0000 7f68f5920740 1 --2- 172.21.15.7:0/913511422 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56329ba8d000 0x56329ac2b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.120+0000 7f68f5920740 1 -- 172.21.15.7:0/913511422 >> 172.21.15.7:0/913511422 conn(0x56329ba8cc00 msgr2=0x56329acb5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:55.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.120+0000 7f68f5920740 1 -- 172.21.15.7:0/913511422 shutdown_connections 2024-04-25T10:01:55.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.120+0000 7f68f5920740 1 -- 172.21.15.7:0/913511422 wait complete. 2024-04-25T10:01:55.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.120+0000 7f68f5920740 1 Processor -- start 2024-04-25T10:01:55.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.120+0000 7f68f5920740 1 -- start start 2024-04-25T10:01:55.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.121+0000 7f68f5920740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56329ba8d000 0x56329ac2d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.121+0000 7f68f5920740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56329ba8d400 0x56329ac2cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.121+0000 7f68f5920740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56329ba8d800 0x56329ac2c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.121+0000 7f68f5920740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x56329b94bc80 con 0x56329ba8d400 2024-04-25T10:01:55.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.121+0000 7f68f5920740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56329b94bb00 con 0x56329ba8d800 2024-04-25T10:01:55.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.121+0000 7f68f5920740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x56329b94b980 con 0x56329ba8d000 2024-04-25T10:01:55.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.121+0000 7f68f38ad640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56329ba8d400 0x56329ac2cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.121+0000 7f68f38ad640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56329ba8d400 0x56329ac2cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44830/0 (socket says 172.21.15.7:44830) 2024-04-25T10:01:55.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.121+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 learned_addr learned my addr 172.21.15.7:0/678024873 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:55.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.121+0000 7f68f40ae640 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56329ba8d000 0x56329ac2d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.121+0000 7f68f30ac640 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56329ba8d800 0x56329ac2c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.121+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56329ba8d000 msgr2=0x56329ac2d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.121+0000 7f68f38ad640 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56329ba8d000 0x56329ac2d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.121+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56329ba8d800 msgr2=0x56329ac2c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.121+0000 7f68f38ad640 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56329ba8d800 0x56329ac2c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.121+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56329abe7680 con 0x56329ba8d400 2024-04-25T10:01:55.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.121+0000 7f68f30ac640 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56329ba8d800 0x56329ac2c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:01:55.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.121+0000 7f68f40ae640 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56329ba8d000 0x56329ac2d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:01:55.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.121+0000 7f68f38ad640 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56329ba8d400 0x56329ac2cc00 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x56329b9c71d0 tx=0x56329b94c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.122+0000 7f68ed8a1640 1 -- 172.21.15.7:0/678024873 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56329abe09c0 con 0x56329ba8d400 2024-04-25T10:01:55.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.122+0000 7f68ed8a1640 1 -- 172.21.15.7:0/678024873 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56329ac04e00 con 0x56329ba8d400 2024-04-25T10:01:55.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.122+0000 7f68f5920740 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56329abe7860 con 0x56329ba8d400 2024-04-25T10:01:55.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.122+0000 7f68ed8a1640 1 -- 172.21.15.7:0/678024873 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56329abe0820 con 0x56329ba8d400 2024-04-25T10:01:55.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.122+0000 7f68f5920740 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56329abe70e0 con 0x56329ba8d400 2024-04-25T10:01:55.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.122+0000 7f68f5920740 4 datascan.init: resolving metadata pool 13 2024-04-25T10:01:55.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.123+0000 7f68ed8a1640 1 -- 172.21.15.7:0/678024873 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x56329bafec00 con 0x56329ba8d400 2024-04-25T10:01:55.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.123+0000 7f68ed8a1640 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x56329ba8dc00 0x56329ac2d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.123+0000 7f68ed8a1640 1 -- 172.21.15.7:0/678024873 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x56329ba82400 con 0x56329ba8d400 2024-04-25T10:01:55.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.123+0000 7f68f40ae640 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x56329ba8dc00 0x56329ac2d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.123+0000 7f68f5920740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T10:01:55.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.123+0000 7f68f5920740 4 datascan.main: data pool 'cephfs_data' has ID 14 2024-04-25T10:01:55.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.123+0000 7f68f5920740 4 datascan.main: opening data pool 'cephfs_data' 2024-04-25T10:01:55.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.123+0000 7f68f5920740 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x56329af30000 0x56329ac2c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.123+0000 7f68f5920740 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:1 13.14 13:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af30400 con 0x56329af30000 2024-04-25T10:01:55.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.123+0000 7f68f30ac640 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x56329af30000 0x56329ac2c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.124+0000 7f68f40ae640 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x56329ba8dc00 0x56329ac2d700 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x56329b94eed0 tx=0x56329af32000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.124+0000 7f68f30ac640 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x56329af30000 0x56329ac2c100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.124+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.0 v2:172.21.15.7:6800/4167741236 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv25 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x56329b93a000 con 0x56329af30000 2024-04-25T10:01:55.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.124+0000 7f68f5920740 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x56329af30800 0x56329ac2bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.124+0000 7f68f5920740 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:2 13.1f 13:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af30c00 con 0x56329af30800 2024-04-25T10:01:55.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.124+0000 7f68f40ae640 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x56329af30800 0x56329ac2bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.125+0000 7f68f40ae640 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x56329af30800 0x56329ac2bb80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.125+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.6 v2:172.21.15.55:6824/4293769515 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+16 (crc 0 0 0) 0x56329b93a500 con 0x56329af30800 2024-04-25T10:01:55.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.125+0000 7f68f5920740 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x56329af31000 0x56329ac2b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.125+0000 7f68f5920740 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:3 14.0 14:00000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af44000 con 0x56329af31000 2024-04-25T10:01:55.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.125+0000 7f68f38ad640 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x56329af31000 0x56329ac2b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.125+0000 7f68f38ad640 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x56329af31000 0x56329ac2b600 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.126+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.2 v2:172.21.15.7:6808/1173474863 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af31000 2024-04-25T10:01:55.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.126+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:4 14.20 14:04000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af45800 con 0x56329af30000 2024-04-25T10:01:55.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.126+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.0 v2:172.21.15.7:6800/4167741236 2 ==== osd_op_reply(4 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af30000 2024-04-25T10:01:55.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.126+0000 7f68ef0a4640 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x56329af45c00 0x56329af56000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.126+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:5 14.10 14:08000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5a000 con 0x56329af45c00 2024-04-25T10:01:55.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.126+0000 7f68f30ac640 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x56329af45c00 0x56329af56000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.127+0000 7f68f30ac640 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x56329af45c00 0x56329af56000 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.127+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.1 v2:172.21.15.7:6816/434435857 1 ==== osd_op_reply(5 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af45c00 2024-04-25T10:01:55.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.127+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:6 14.30 14:0c000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329ba8c400 con 0x56329af30000 2024-04-25T10:01:55.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.127+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.0 v2:172.21.15.7:6800/4167741236 3 ==== osd_op_reply(6 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af30000 2024-04-25T10:01:55.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.127+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:7 14.8 14:10000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5a400 con 0x56329af30000 2024-04-25T10:01:55.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.127+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.0 v2:172.21.15.7:6800/4167741236 4 ==== osd_op_reply(7 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af30000 2024-04-25T10:01:55.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.127+0000 7f68ee8a3640 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x56329ba8c800 0x56329af56580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.127+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:8 14.28 14:14000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5a000 con 0x56329ba8c800 2024-04-25T10:01:55.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.127+0000 7f68f40ae640 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x56329ba8c800 0x56329af56580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.128+0000 7f68f40ae640 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x56329ba8c800 0x56329af56580 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.128+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.3 v2:172.21.15.7:6824/3045538953 1 ==== osd_op_reply(8 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329ba8c800 2024-04-25T10:01:55.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.128+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:9 14.18 14:18000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5a800 con 0x56329af45c00 2024-04-25T10:01:55.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.128+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.1 v2:172.21.15.7:6816/434435857 2 ==== osd_op_reply(9 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af45c00 2024-04-25T10:01:55.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.128+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:10 14.38 14:1c000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af45800 con 0x56329af45c00 2024-04-25T10:01:55.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.128+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.1 v2:172.21.15.7:6816/434435857 3 ==== osd_op_reply(10 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af45c00 2024-04-25T10:01:55.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.128+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:11 14.4 14:20000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5ac00 con 0x56329af30800 2024-04-25T10:01:55.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.129+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.6 v2:172.21.15.55:6824/4293769515 2 ==== osd_op_reply(11 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329af30800 2024-04-25T10:01:55.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.129+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:12 14.24 14:24000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af30400 con 0x56329af45c00 2024-04-25T10:01:55.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.129+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.1 v2:172.21.15.7:6816/434435857 4 ==== osd_op_reply(12 [pgnls-filter start_epoch 92 out=49b] v88'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af45c00 2024-04-25T10:01:55.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.129+0000 7f68ef0a4640 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x56329af5b000 0x56329af56b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.129+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:13 14.14 14:28000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5a000 con 0x56329af5b000 2024-04-25T10:01:55.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.130+0000 7f68f38ad640 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x56329af5b000 0x56329af56b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.130+0000 7f68f38ad640 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x56329af5b000 0x56329af56b00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.130+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.4 v2:172.21.15.55:6808/2248155105 1 ==== osd_op_reply(13 [pgnls-filter start_epoch 92 out=49b] v88'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af5b000 2024-04-25T10:01:55.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.130+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:14 14.34 14:2c000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5b400 con 0x56329af31000 2024-04-25T10:01:55.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.130+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.2 v2:172.21.15.7:6808/1173474863 2 ==== osd_op_reply(14 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af31000 2024-04-25T10:01:55.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.131+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:15 14.c 14:30000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5ac00 con 0x56329af30000 2024-04-25T10:01:55.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.131+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.0 v2:172.21.15.7:6800/4167741236 5 ==== osd_op_reply(15 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af30000 2024-04-25T10:01:55.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.131+0000 7f68ee8a3640 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x56329af5b800 0x56329af57600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.131+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:16 14.2c 14:34000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5bc00 con 0x56329af5b800 2024-04-25T10:01:55.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.131+0000 7f68f30ac640 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x56329af5b800 0x56329af57600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.131+0000 7f68f30ac640 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x56329af5b800 0x56329af57600 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.132+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.5 v2:172.21.15.55:6800/2514169616 1 ==== osd_op_reply(16 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af5b800 2024-04-25T10:01:55.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.132+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:17 14.1c 14:38000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af31c00 con 0x56329af30000 2024-04-25T10:01:55.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.132+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.0 v2:172.21.15.7:6800/4167741236 6 ==== osd_op_reply(17 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af30000 2024-04-25T10:01:55.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.132+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:18 14.3c 14:3c000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5a400 con 0x56329af45c00 2024-04-25T10:01:55.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.132+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.1 v2:172.21.15.7:6816/434435857 5 ==== osd_op_reply(18 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af45c00 2024-04-25T10:01:55.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.132+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:19 14.2 14:40000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af30c00 con 0x56329af30800 2024-04-25T10:01:55.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.133+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.6 v2:172.21.15.55:6824/4293769515 3 ==== osd_op_reply(19 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329af30800 2024-04-25T10:01:55.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.133+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:20 14.22 14:44000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5a800 con 0x56329af5b000 2024-04-25T10:01:55.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.133+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.4 v2:172.21.15.55:6808/2248155105 2 ==== osd_op_reply(20 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af5b000 2024-04-25T10:01:55.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.133+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:21 14.12 14:48000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5a000 con 0x56329af31000 2024-04-25T10:01:55.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.133+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.2 v2:172.21.15.7:6808/1173474863 3 ==== osd_op_reply(21 [pgnls-filter start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af31000 2024-04-25T10:01:55.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.133+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:22 14.32 14:4c000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af30400 con 0x56329af5b000 2024-04-25T10:01:55.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.133+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.4 v2:172.21.15.55:6808/2248155105 3 ==== osd_op_reply(22 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af5b000 2024-04-25T10:01:55.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.133+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:23 14.a 14:50000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5b400 con 0x56329af5b800 2024-04-25T10:01:55.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.134+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.5 v2:172.21.15.55:6800/2514169616 2 ==== osd_op_reply(23 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af5b800 2024-04-25T10:01:55.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.134+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:24 14.2a 14:54000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af45800 con 0x56329af5b000 2024-04-25T10:01:55.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.134+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.4 v2:172.21.15.55:6808/2248155105 4 ==== osd_op_reply(24 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af5b000 2024-04-25T10:01:55.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.134+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:25 14.1a 14:58000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5a800 con 0x56329af30000 2024-04-25T10:01:55.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.134+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.0 v2:172.21.15.7:6800/4167741236 7 ==== osd_op_reply(25 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af30000 2024-04-25T10:01:55.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.134+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:26 14.3a 14:5c000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329ba8c400 con 0x56329af30000 2024-04-25T10:01:55.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.135+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.0 v2:172.21.15.7:6800/4167741236 8 ==== osd_op_reply(26 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af30000 2024-04-25T10:01:55.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.135+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:27 14.6 14:60000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af44000 con 0x56329af30000 2024-04-25T10:01:55.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.135+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.0 v2:172.21.15.7:6800/4167741236 9 ==== osd_op_reply(27 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af30000 2024-04-25T10:01:55.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.135+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:28 14.26 14:64000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5bc00 con 0x56329af5b000 2024-04-25T10:01:55.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.135+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.4 v2:172.21.15.55:6808/2248155105 5 ==== osd_op_reply(28 [pgnls-filter start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af5b000 2024-04-25T10:01:55.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.135+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:29 14.16 14:68000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329b993400 con 0x56329ba8c800 2024-04-25T10:01:55.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.136+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.3 v2:172.21.15.7:6824/3045538953 2 ==== osd_op_reply(29 [pgnls-filter start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329ba8c800 2024-04-25T10:01:55.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.136+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:30 14.36 14:6c000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5a400 con 0x56329af31000 2024-04-25T10:01:55.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.136+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.2 v2:172.21.15.7:6808/1173474863 4 ==== osd_op_reply(30 [pgnls-filter start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af31000 2024-04-25T10:01:55.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.136+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:31 14.e 14:70000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5a800 con 0x56329af5b000 2024-04-25T10:01:55.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.136+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.4 v2:172.21.15.55:6808/2248155105 6 ==== osd_op_reply(31 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af5b000 2024-04-25T10:01:55.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.136+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:32 14.2e 14:74000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5b400 con 0x56329ba8c800 2024-04-25T10:01:55.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.137+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.3 v2:172.21.15.7:6824/3045538953 3 ==== osd_op_reply(32 [pgnls-filter start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329ba8c800 2024-04-25T10:01:55.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.137+0000 7f68ef0a4640 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x56329af5ac00 0x56329af57080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.137+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:33 14.1e 14:78000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5a000 con 0x56329af5ac00 2024-04-25T10:01:55.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.137+0000 7f68f40ae640 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x56329af5ac00 0x56329af57080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.137+0000 7f68f40ae640 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x56329af5ac00 0x56329af57080 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.137+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.7 v2:172.21.15.55:6816/2960381217 1 ==== osd_op_reply(33 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329af5ac00 2024-04-25T10:01:55.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.137+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:34 14.3e 14:7c000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af44000 con 0x56329af5b800 2024-04-25T10:01:55.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.138+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.5 v2:172.21.15.55:6800/2514169616 3 ==== osd_op_reply(34 [pgnls-filter start_epoch 92 out=49b] v88'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af5b800 2024-04-25T10:01:55.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.138+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:35 14.1 14:80000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5bc00 con 0x56329ba8c800 2024-04-25T10:01:55.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.138+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.3 v2:172.21.15.7:6824/3045538953 4 ==== osd_op_reply(35 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329ba8c800 2024-04-25T10:01:55.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.138+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:36 14.21 14:84000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329ba8c400 con 0x56329af5b800 2024-04-25T10:01:55.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.138+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.5 v2:172.21.15.55:6800/2514169616 4 ==== osd_op_reply(36 [pgnls-filter start_epoch 92 out=49b] v88'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af5b800 2024-04-25T10:01:55.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.138+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:37 14.11 14:88000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5a400 con 0x56329af5b000 2024-04-25T10:01:55.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.139+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.4 v2:172.21.15.55:6808/2248155105 7 ==== osd_op_reply(37 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af5b000 2024-04-25T10:01:55.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.139+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:38 14.31 14:8c000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af31c00 con 0x56329af5ac00 2024-04-25T10:01:55.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.139+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.7 v2:172.21.15.55:6816/2960381217 2 ==== osd_op_reply(38 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329af5ac00 2024-04-25T10:01:55.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.139+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:39 14.9 14:90000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5a800 con 0x56329af5b800 2024-04-25T10:01:55.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.139+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.5 v2:172.21.15.55:6800/2514169616 5 ==== osd_op_reply(39 [pgnls-filter start_epoch 92 out=49b] v88'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af5b800 2024-04-25T10:01:55.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.140+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:40 14.29 14:94000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5b400 con 0x56329af30800 2024-04-25T10:01:55.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.140+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.6 v2:172.21.15.55:6824/4293769515 4 ==== osd_op_reply(40 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329af30800 2024-04-25T10:01:55.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.140+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:41 14.19 14:98000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af45800 con 0x56329af30800 2024-04-25T10:01:55.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.140+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.6 v2:172.21.15.55:6824/4293769515 5 ==== osd_op_reply(41 [pgnls-filter start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329af30800 2024-04-25T10:01:55.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.140+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:42 14.39 14:9c000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5a000 con 0x56329af5ac00 2024-04-25T10:01:55.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.141+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.7 v2:172.21.15.55:6816/2960381217 3 ==== osd_op_reply(42 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329af5ac00 2024-04-25T10:01:55.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.141+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:43 14.5 14:a0000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af30400 con 0x56329af30000 2024-04-25T10:01:55.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.141+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.0 v2:172.21.15.7:6800/4167741236 10 ==== osd_op_reply(43 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af30000 2024-04-25T10:01:55.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.141+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:44 14.25 14:a4000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5bc00 con 0x56329af31000 2024-04-25T10:01:55.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.141+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.2 v2:172.21.15.7:6808/1173474863 5 ==== osd_op_reply(44 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af31000 2024-04-25T10:01:55.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.141+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:45 14.15 14:a8000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af76000 con 0x56329af5ac00 2024-04-25T10:01:55.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.142+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.7 v2:172.21.15.55:6816/2960381217 4 ==== osd_op_reply(45 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329af5ac00 2024-04-25T10:01:55.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.142+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:46 14.35 14:ac000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329b993400 con 0x56329af5b000 2024-04-25T10:01:55.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.142+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.4 v2:172.21.15.55:6808/2248155105 8 ==== osd_op_reply(46 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af5b000 2024-04-25T10:01:55.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.142+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:47 14.d 14:b0000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af76400 con 0x56329af30800 2024-04-25T10:01:55.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.142+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.6 v2:172.21.15.55:6824/4293769515 6 ==== osd_op_reply(47 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329af30800 2024-04-25T10:01:55.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.142+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:48 14.2d 14:b4000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af30c00 con 0x56329af5b000 2024-04-25T10:01:55.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.143+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.4 v2:172.21.15.55:6808/2248155105 9 ==== osd_op_reply(48 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af5b000 2024-04-25T10:01:55.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.143+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:49 14.1d 14:b8000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af76800 con 0x56329af30000 2024-04-25T10:01:55.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.143+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.0 v2:172.21.15.7:6800/4167741236 11 ==== osd_op_reply(49 [pgnls-filter start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af30000 2024-04-25T10:01:55.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.143+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:50 14.3d 14:bc000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af76000 con 0x56329ba8c800 2024-04-25T10:01:55.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.144+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.3 v2:172.21.15.7:6824/3045538953 5 ==== osd_op_reply(50 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329ba8c800 2024-04-25T10:01:55.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.144+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:51 14.3 14:c0000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af76c00 con 0x56329af30000 2024-04-25T10:01:55.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.144+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.0 v2:172.21.15.7:6800/4167741236 12 ==== osd_op_reply(51 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af30000 2024-04-25T10:01:55.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.144+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:52 14.23 14:c4000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af76400 con 0x56329af5ac00 2024-04-25T10:01:55.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.144+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.7 v2:172.21.15.55:6816/2960381217 5 ==== osd_op_reply(52 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329af5ac00 2024-04-25T10:01:55.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.144+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:53 14.13 14:c8000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af77000 con 0x56329af31000 2024-04-25T10:01:55.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.144+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.2 v2:172.21.15.7:6808/1173474863 6 ==== osd_op_reply(53 [pgnls-filter start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af31000 2024-04-25T10:01:55.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.144+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:54 14.33 14:cc000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5b400 con 0x56329af45c00 2024-04-25T10:01:55.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.145+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.1 v2:172.21.15.7:6816/434435857 6 ==== osd_op_reply(54 [pgnls-filter start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af45c00 2024-04-25T10:01:55.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.145+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:55 14.b 14:d0000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af77400 con 0x56329af30000 2024-04-25T10:01:55.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.145+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.0 v2:172.21.15.7:6800/4167741236 13 ==== osd_op_reply(55 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af30000 2024-04-25T10:01:55.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.145+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:56 14.2b 14:d4000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5a000 con 0x56329af5b000 2024-04-25T10:01:55.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.145+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.4 v2:172.21.15.55:6808/2248155105 10 ==== osd_op_reply(56 [pgnls-filter start_epoch 92 out=49b] v88'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af5b000 2024-04-25T10:01:55.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.145+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:57 14.1b 14:d8000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af77800 con 0x56329af5ac00 2024-04-25T10:01:55.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.146+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.7 v2:172.21.15.55:6816/2960381217 6 ==== osd_op_reply(57 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329af5ac00 2024-04-25T10:01:55.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.146+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:58 14.3b 14:dc000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af45800 con 0x56329af5b000 2024-04-25T10:01:55.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.146+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.4 v2:172.21.15.55:6808/2248155105 11 ==== osd_op_reply(58 [pgnls-filter start_epoch 92 out=49b] v88'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af5b000 2024-04-25T10:01:55.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.146+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:59 14.7 14:e0000000::::head [pgnls-filter start_epoch 92 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af77c00 con 0x56329af5b800 2024-04-25T10:01:55.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.147+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.5 v2:172.21.15.55:6800/2514169616 6 ==== osd_op_reply(59 [pgnls-filter start_epoch 92 out=81b] v92'7 uv7 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x56329b93a000 con 0x56329af5b800 2024-04-25T10:01:55.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.147+0000 7f68f5920740 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:60 14.0 14:00000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af44400 con 0x56329af31000 2024-04-25T10:01:55.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.147+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.2 v2:172.21.15.7:6808/1173474863 7 ==== osd_op_reply(60 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af31000 2024-04-25T10:01:55.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.147+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:61 14.20 14:04000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5a400 con 0x56329af30000 2024-04-25T10:01:55.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.147+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.0 v2:172.21.15.7:6800/4167741236 14 ==== osd_op_reply(61 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af30000 2024-04-25T10:01:55.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.147+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:62 14.10 14:08000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af31c00 con 0x56329af45c00 2024-04-25T10:01:55.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.148+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.1 v2:172.21.15.7:6816/434435857 7 ==== osd_op_reply(62 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af45c00 2024-04-25T10:01:55.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.148+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:63 14.30 14:0c000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5bc00 con 0x56329af30000 2024-04-25T10:01:55.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.148+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.0 v2:172.21.15.7:6800/4167741236 15 ==== osd_op_reply(63 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af30000 2024-04-25T10:01:55.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.148+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:64 14.8 14:10000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af77000 con 0x56329af30000 2024-04-25T10:01:55.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.148+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.0 v2:172.21.15.7:6800/4167741236 16 ==== osd_op_reply(64 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af30000 2024-04-25T10:01:55.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.148+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:65 14.28 14:14000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5a000 con 0x56329ba8c800 2024-04-25T10:01:55.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.148+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.3 v2:172.21.15.7:6824/3045538953 6 ==== osd_op_reply(65 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329ba8c800 2024-04-25T10:01:55.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.148+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:66 14.18 14:18000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af76800 con 0x56329af45c00 2024-04-25T10:01:55.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.149+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.1 v2:172.21.15.7:6816/434435857 8 ==== osd_op_reply(66 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af45c00 2024-04-25T10:01:55.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.149+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:67 14.38 14:1c000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af30c00 con 0x56329af45c00 2024-04-25T10:01:55.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.149+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.1 v2:172.21.15.7:6816/434435857 9 ==== osd_op_reply(67 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af45c00 2024-04-25T10:01:55.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.149+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:68 14.4 14:20000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af76c00 con 0x56329af30800 2024-04-25T10:01:55.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.149+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.6 v2:172.21.15.55:6824/4293769515 7 ==== osd_op_reply(68 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329af30800 2024-04-25T10:01:55.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.149+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:69 14.24 14:24000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af30400 con 0x56329af45c00 2024-04-25T10:01:55.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.150+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.1 v2:172.21.15.7:6816/434435857 10 ==== osd_op_reply(69 [pgnls-filter start_epoch 92 out=49b] v88'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af45c00 2024-04-25T10:01:55.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.150+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:70 14.14 14:28000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af77400 con 0x56329af5b000 2024-04-25T10:01:55.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.150+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.4 v2:172.21.15.55:6808/2248155105 12 ==== osd_op_reply(70 [pgnls-filter start_epoch 92 out=49b] v88'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af5b000 2024-04-25T10:01:55.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.150+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:71 14.34 14:2c000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329ba8c400 con 0x56329af31000 2024-04-25T10:01:55.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.150+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.2 v2:172.21.15.7:6808/1173474863 8 ==== osd_op_reply(71 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af31000 2024-04-25T10:01:55.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.150+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:72 14.c 14:30000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5a800 con 0x56329af30000 2024-04-25T10:01:55.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.150+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.0 v2:172.21.15.7:6800/4167741236 17 ==== osd_op_reply(72 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af30000 2024-04-25T10:01:55.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.151+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:73 14.2c 14:34000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af45800 con 0x56329af5b800 2024-04-25T10:01:55.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.151+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.5 v2:172.21.15.55:6800/2514169616 7 ==== osd_op_reply(73 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af5b800 2024-04-25T10:01:55.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.151+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:74 14.1c 14:38000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5b400 con 0x56329af30000 2024-04-25T10:01:55.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.151+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.0 v2:172.21.15.7:6800/4167741236 18 ==== osd_op_reply(74 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af30000 2024-04-25T10:01:55.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.151+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:75 14.3c 14:3c000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af44000 con 0x56329af45c00 2024-04-25T10:01:55.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.151+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.1 v2:172.21.15.7:6816/434435857 11 ==== osd_op_reply(75 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af45c00 2024-04-25T10:01:55.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.151+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:76 14.2 14:40000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5a400 con 0x56329af30800 2024-04-25T10:01:55.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.152+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.6 v2:172.21.15.55:6824/4293769515 8 ==== osd_op_reply(76 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329af30800 2024-04-25T10:01:55.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.152+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:77 14.22 14:44000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329b993400 con 0x56329af5b000 2024-04-25T10:01:55.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.152+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.4 v2:172.21.15.55:6808/2248155105 13 ==== osd_op_reply(77 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af5b000 2024-04-25T10:01:55.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.152+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:78 14.12 14:48000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5bc00 con 0x56329af31000 2024-04-25T10:01:55.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.153+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.2 v2:172.21.15.7:6808/1173474863 9 ==== osd_op_reply(78 [pgnls-filter start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af31000 2024-04-25T10:01:55.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.153+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:79 14.32 14:4c000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af6c000 con 0x56329af5b000 2024-04-25T10:01:55.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.153+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.4 v2:172.21.15.55:6808/2248155105 14 ==== osd_op_reply(79 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af5b000 2024-04-25T10:01:55.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.153+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:80 14.a 14:50000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5a800 con 0x56329af5b800 2024-04-25T10:01:55.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.153+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.5 v2:172.21.15.55:6800/2514169616 8 ==== osd_op_reply(80 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af5b800 2024-04-25T10:01:55.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.153+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:81 14.2a 14:54000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af6c400 con 0x56329af5b000 2024-04-25T10:01:55.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.154+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.4 v2:172.21.15.55:6808/2248155105 15 ==== osd_op_reply(81 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af5b000 2024-04-25T10:01:55.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.154+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:82 14.1a 14:58000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af31c00 con 0x56329af30000 2024-04-25T10:01:55.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.154+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.0 v2:172.21.15.7:6800/4167741236 19 ==== osd_op_reply(82 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af30000 2024-04-25T10:01:55.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.154+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:83 14.3a 14:5c000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af6c800 con 0x56329af30000 2024-04-25T10:01:55.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.154+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.0 v2:172.21.15.7:6800/4167741236 20 ==== osd_op_reply(83 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af30000 2024-04-25T10:01:55.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.154+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:84 14.6 14:60000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af30c00 con 0x56329af30000 2024-04-25T10:01:55.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.154+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.0 v2:172.21.15.7:6800/4167741236 21 ==== osd_op_reply(84 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af30000 2024-04-25T10:01:55.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.154+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:85 14.26 14:64000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af6cc00 con 0x56329af5b000 2024-04-25T10:01:55.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.155+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.4 v2:172.21.15.55:6808/2248155105 16 ==== osd_op_reply(85 [pgnls-filter start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af5b000 2024-04-25T10:01:55.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.155+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:86 14.16 14:68000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af30400 con 0x56329ba8c800 2024-04-25T10:01:55.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.155+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.3 v2:172.21.15.7:6824/3045538953 7 ==== osd_op_reply(86 [pgnls-filter start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329ba8c800 2024-04-25T10:01:55.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.155+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:87 14.36 14:6c000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af6d000 con 0x56329af31000 2024-04-25T10:01:55.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.155+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.2 v2:172.21.15.7:6808/1173474863 10 ==== osd_op_reply(87 [pgnls-filter start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af31000 2024-04-25T10:01:55.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.155+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:88 14.e 14:70000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af77c00 con 0x56329af5b000 2024-04-25T10:01:55.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.155+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.4 v2:172.21.15.55:6808/2248155105 17 ==== osd_op_reply(88 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af5b000 2024-04-25T10:01:55.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.156+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:89 14.2e 14:74000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af6d400 con 0x56329ba8c800 2024-04-25T10:01:55.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.156+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.3 v2:172.21.15.7:6824/3045538953 8 ==== osd_op_reply(89 [pgnls-filter start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329ba8c800 2024-04-25T10:01:55.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.156+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:90 14.1e 14:78000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af77000 con 0x56329af5ac00 2024-04-25T10:01:55.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.156+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.7 v2:172.21.15.55:6816/2960381217 7 ==== osd_op_reply(90 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329af5ac00 2024-04-25T10:01:55.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.156+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:91 14.3e 14:7c000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af6d800 con 0x56329af5b800 2024-04-25T10:01:55.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.156+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.5 v2:172.21.15.55:6800/2514169616 9 ==== osd_op_reply(91 [pgnls-filter start_epoch 92 out=49b] v88'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af5b800 2024-04-25T10:01:55.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.156+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:92 14.1 14:80000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af76800 con 0x56329ba8c800 2024-04-25T10:01:55.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.157+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.3 v2:172.21.15.7:6824/3045538953 9 ==== osd_op_reply(92 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329ba8c800 2024-04-25T10:01:55.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.157+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:93 14.21 14:84000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af6dc00 con 0x56329af5b800 2024-04-25T10:01:55.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.157+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.5 v2:172.21.15.55:6800/2514169616 10 ==== osd_op_reply(93 [pgnls-filter start_epoch 92 out=49b] v88'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af5b800 2024-04-25T10:01:55.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.157+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:94 14.11 14:88000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5a000 con 0x56329af5b000 2024-04-25T10:01:55.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.157+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.4 v2:172.21.15.55:6808/2248155105 18 ==== osd_op_reply(94 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af5b000 2024-04-25T10:01:55.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.157+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:95 14.31 14:8c000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af6c000 con 0x56329af5ac00 2024-04-25T10:01:55.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.158+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.7 v2:172.21.15.55:6816/2960381217 8 ==== osd_op_reply(95 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329af5ac00 2024-04-25T10:01:55.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.158+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:96 14.9 14:90000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5a400 con 0x56329af5b800 2024-04-25T10:01:55.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.158+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.5 v2:172.21.15.55:6800/2514169616 11 ==== osd_op_reply(96 [pgnls-filter start_epoch 92 out=49b] v88'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af5b800 2024-04-25T10:01:55.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.158+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:97 14.29 14:94000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af6c400 con 0x56329af30800 2024-04-25T10:01:55.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.158+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.6 v2:172.21.15.55:6824/4293769515 9 ==== osd_op_reply(97 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329af30800 2024-04-25T10:01:55.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.158+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:98 14.19 14:98000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329b993400 con 0x56329af30800 2024-04-25T10:01:55.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.159+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.6 v2:172.21.15.55:6824/4293769515 10 ==== osd_op_reply(98 [pgnls-filter start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329af30800 2024-04-25T10:01:55.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.159+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:99 14.39 14:9c000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af6cc00 con 0x56329af5ac00 2024-04-25T10:01:55.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.159+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.7 v2:172.21.15.55:6816/2960381217 9 ==== osd_op_reply(99 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329af5ac00 2024-04-25T10:01:55.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.159+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:100 14.5 14:a0000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329ba8c400 con 0x56329af30000 2024-04-25T10:01:55.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.159+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.0 v2:172.21.15.7:6800/4167741236 22 ==== osd_op_reply(100 [pgnls-filter start_epoch 92 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af30000 2024-04-25T10:01:55.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.160+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:101 14.25 14:a4000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5bc00 con 0x56329af31000 2024-04-25T10:01:55.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.160+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.2 v2:172.21.15.7:6808/1173474863 11 ==== osd_op_reply(101 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af31000 2024-04-25T10:01:55.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.160+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:102 14.15 14:a8000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af76000 con 0x56329af5ac00 2024-04-25T10:01:55.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.160+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.7 v2:172.21.15.55:6816/2960381217 10 ==== osd_op_reply(102 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329af5ac00 2024-04-25T10:01:55.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.160+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:103 14.35 14:ac000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af6d400 con 0x56329af5b000 2024-04-25T10:01:55.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.160+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.4 v2:172.21.15.55:6808/2248155105 19 ==== osd_op_reply(103 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af5b000 2024-04-25T10:01:55.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.160+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:104 14.d 14:b0000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af76400 con 0x56329af30800 2024-04-25T10:01:55.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.161+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.6 v2:172.21.15.55:6824/4293769515 11 ==== osd_op_reply(104 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329af30800 2024-04-25T10:01:55.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.161+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:105 14.2d 14:b4000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af6c000 con 0x56329af5b000 2024-04-25T10:01:55.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.161+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.4 v2:172.21.15.55:6808/2248155105 20 ==== osd_op_reply(105 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af5b000 2024-04-25T10:01:55.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.161+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:106 14.1d 14:b8000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af77800 con 0x56329af30000 2024-04-25T10:01:55.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.162+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.0 v2:172.21.15.7:6800/4167741236 23 ==== osd_op_reply(106 [pgnls-filter start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af30000 2024-04-25T10:01:55.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.162+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:107 14.3d 14:bc000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af6c400 con 0x56329ba8c800 2024-04-25T10:01:55.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.162+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.3 v2:172.21.15.7:6824/3045538953 10 ==== osd_op_reply(107 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329ba8c800 2024-04-25T10:01:55.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.162+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:108 14.3 14:c0000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af76c00 con 0x56329af30000 2024-04-25T10:01:55.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.162+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.0 v2:172.21.15.7:6800/4167741236 24 ==== osd_op_reply(108 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af30000 2024-04-25T10:01:55.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.162+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:109 14.23 14:c4000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af6cc00 con 0x56329af5ac00 2024-04-25T10:01:55.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.162+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.7 v2:172.21.15.55:6816/2960381217 11 ==== osd_op_reply(109 [pgnls-filter start_epoch 92 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329af5ac00 2024-04-25T10:01:55.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.162+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:110 14.13 14:c8000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af77400 con 0x56329af31000 2024-04-25T10:01:55.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.163+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.2 v2:172.21.15.7:6808/1173474863 12 ==== osd_op_reply(110 [pgnls-filter start_epoch 92 out=49b] v88'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af31000 2024-04-25T10:01:55.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.163+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:111 14.33 14:cc000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af31c00 con 0x56329af45c00 2024-04-25T10:01:55.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.163+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.1 v2:172.21.15.7:6816/434435857 12 ==== osd_op_reply(111 [pgnls-filter start_epoch 92 out=49b] v88'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af45c00 2024-04-25T10:01:55.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.163+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:112 14.b 14:d0000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af44400 con 0x56329af30000 2024-04-25T10:01:55.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.163+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.0 v2:172.21.15.7:6800/4167741236 25 ==== osd_op_reply(112 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af30000 2024-04-25T10:01:55.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.163+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:113 14.2b 14:d4000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af30c00 con 0x56329af5b000 2024-04-25T10:01:55.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.164+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.4 v2:172.21.15.55:6808/2248155105 21 ==== osd_op_reply(113 [pgnls-filter start_epoch 92 out=49b] v88'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af5b000 2024-04-25T10:01:55.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.164+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:114 14.1b 14:d8000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af30400 con 0x56329af5ac00 2024-04-25T10:01:55.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.164+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.7 v2:172.21.15.55:6816/2960381217 12 ==== osd_op_reply(114 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329af5ac00 2024-04-25T10:01:55.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.164+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:115 14.3b 14:dc000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af45800 con 0x56329af5b000 2024-04-25T10:01:55.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.164+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.4 v2:172.21.15.55:6808/2248155105 22 ==== osd_op_reply(115 [pgnls-filter start_epoch 92 out=49b] v88'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af5b000 2024-04-25T10:01:55.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.164+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:116 14.7 14:e0000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5a000 con 0x56329af5b800 2024-04-25T10:01:55.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.165+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.5 v2:172.21.15.55:6800/2514169616 12 ==== osd_op_reply(116 [pgnls-filter start_epoch 92 out=81b] v92'7 uv7 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x56329b93a000 con 0x56329af5b800 2024-04-25T10:01:55.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.165+0000 7f68f5920740 20 datascan.forall_objects: OSD matched oid 10000000001.00000000 2024-04-25T10:01:55.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.165+0000 7f68f5920740 10 datascan.operator(): handling object 10000000001.0 2024-04-25T10:01:55.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.165+0000 7f68f5920740 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:117 14.7 14:e2e07930:::10000000001.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af44c00 con 0x56329af5b800 2024-04-25T10:01:55.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.165+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.5 v2:172.21.15.55:6800/2514169616 13 ==== osd_op_reply(117 10000000001.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv7 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x56329b93a000 con 0x56329af5b800 2024-04-25T10:01:55.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.165+0000 7f68f5920740 10 datascan.inject_with_backtrace: inode: 0x0x10000000001 2024-04-25T10:01:55.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.165+0000 7f68f5920740 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/file 2024-04-25T10:01:55.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.165+0000 7f68f5920740 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=file 2024-04-25T10:01:55.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.165+0000 7f68f5920740 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:118 13.10 13:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af45000 con 0x56329af45c00 2024-04-25T10:01:55.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.165+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.1 v2:172.21.15.7:6816/434435857 13 ==== osd_op_reply(118 10000000000.00000000 [getxattr (59) out=59b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+59 (crc 0 0 0) 0x56329b93a000 con 0x56329af45c00 2024-04-25T10:01:55.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.165+0000 7f68f5920740 20 datascan.get_frag_of: got backtrace parent 0x1/dir 2024-04-25T10:01:55.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.165+0000 7f68f5920740 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:119 13.1f 13:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af45400 con 0x56329af30800 2024-04-25T10:01:55.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.166+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.6 v2:172.21.15.55:6824/4293769515 12 ==== osd_op_reply(119 1.00000000 [omap-get-vals-by-keys out=581b] v0'0 uv9 ondisk = 0) v8 ==== 154+0+581 (crc 0 0 0) 0x56329b93a500 con 0x56329af30800 2024-04-25T10:01:55.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.166+0000 7f68f5920740 20 datascan.read_dentry: oid=1.00000000 dname=dir frag=*, r=0 2024-04-25T10:01:55.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.166+0000 7f68f5920740 20 datascan.get_frag_of: fast path, fragtree is fragtree_t() 2024-04-25T10:01:55.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.166+0000 7f68f5920740 20 datascan.get_frag_of: frag is * 2024-04-25T10:01:55.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.166+0000 7f68f5920740 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:120 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5b400 con 0x56329af45c00 2024-04-25T10:01:55.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.166+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.1 v2:172.21.15.7:6816/434435857 14 ==== osd_op_reply(120 10000000000.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x56329b93a000 con 0x56329af45c00 2024-04-25T10:01:55.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.166+0000 7f68f5920740 10 datascan.find_or_create_dirfrag: read_version = 17 2024-04-25T10:01:55.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.166+0000 7f68f5920740 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2024-04-25T10:01:55.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.166+0000 7f68f5920740 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:121 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5a800 con 0x56329af45c00 2024-04-25T10:01:55.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.166+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.1 v2:172.21.15.7:6816/434435857 15 ==== osd_op_reply(121 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x56329b93a000 con 0x56329af45c00 2024-04-25T10:01:55.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.166+0000 7f68f5920740 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-04-25T10:01:55.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.166+0000 7f68f5920740 20 datascan.read_dentry: file_head not found in result 2024-04-25T10:01:55.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.166+0000 7f68f5920740 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000001 at 0x0x10000000000/file with size=0 bytes 2024-04-25T10:01:55.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.166+0000 7f68f5920740 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:122 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5a400 con 0x56329af45c00 2024-04-25T10:01:55.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.167+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.1 v2:172.21.15.7:6816/434435857 16 ==== osd_op_reply(122 10000000000.00000000 [omap-set-vals] v92'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56329b93a000 con 0x56329af45c00 2024-04-25T10:01:55.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.167+0000 7f68f5920740 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-04-25T10:01:55.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.167+0000 7f68f5920740 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:123 14.27 14:e4000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af44400 con 0x56329af5b800 2024-04-25T10:01:55.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.168+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.5 v2:172.21.15.55:6800/2514169616 14 ==== osd_op_reply(123 [pgnls-filter start_epoch 92 out=49b] v88'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af5b800 2024-04-25T10:01:55.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.168+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:124 14.17 14:e8000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af5bc00 con 0x56329af45c00 2024-04-25T10:01:55.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.168+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.1 v2:172.21.15.7:6816/434435857 17 ==== osd_op_reply(124 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af45c00 2024-04-25T10:01:55.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.168+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:125 14.37 14:ec000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af44000 con 0x56329af5b000 2024-04-25T10:01:55.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.168+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 <== osd.4 v2:172.21.15.55:6808/2248155105 23 ==== osd_op_reply(125 [pgnls-filter start_epoch 92 out=49b] v88'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a780 con 0x56329af5b000 2024-04-25T10:01:55.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.168+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:126 14.f 14:f0000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af6d000 con 0x56329af5ac00 2024-04-25T10:01:55.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.169+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.7 v2:172.21.15.55:6816/2960381217 13 ==== osd_op_reply(126 [pgnls-filter start_epoch 92 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329af5ac00 2024-04-25T10:01:55.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.169+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:127 14.2f 14:f4000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af77000 con 0x56329af30000 2024-04-25T10:01:55.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.169+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.0 v2:172.21.15.7:6800/4167741236 26 ==== osd_op_reply(127 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af30000 2024-04-25T10:01:55.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.169+0000 7f68ee8a3640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:128 14.1f 14:f8000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af6d400 con 0x56329af30000 2024-04-25T10:01:55.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.169+0000 7f68f30ac640 1 -- 172.21.15.7:0/678024873 <== osd.0 v2:172.21.15.7:6800/4167741236 27 ==== osd_op_reply(128 [pgnls-filter start_epoch 92 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a000 con 0x56329af30000 2024-04-25T10:01:55.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.169+0000 7f68ef0a4640 1 -- 172.21.15.7:0/678024873 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:129 14.3f 14:fc000000::::head [pgnls-filter start_epoch 92 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x56329af76800 con 0x56329ba8c800 2024-04-25T10:01:55.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.169+0000 7f68f40ae640 1 -- 172.21.15.7:0/678024873 <== osd.3 v2:172.21.15.7:6824/3045538953 11 ==== osd_op_reply(129 [pgnls-filter start_epoch 92 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56329b93a500 con 0x56329ba8c800 2024-04-25T10:01:55.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.169+0000 7f68f5920740 1 -- 172.21.15.7:0/678024873 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x56329af30000 msgr2=0x56329ac2c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.169+0000 7f68f5920740 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x56329af30000 0x56329ac2c100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.169+0000 7f68f5920740 1 -- 172.21.15.7:0/678024873 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x56329af45c00 msgr2=0x56329af56000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.169+0000 7f68f5920740 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x56329af45c00 0x56329af56000 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.169+0000 7f68f5920740 1 -- 172.21.15.7:0/678024873 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x56329af31000 msgr2=0x56329ac2b600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.169+0000 7f68f5920740 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x56329af31000 0x56329ac2b600 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.169+0000 7f68f5920740 1 -- 172.21.15.7:0/678024873 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x56329ba8c800 msgr2=0x56329af56580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.169+0000 7f68f5920740 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x56329ba8c800 0x56329af56580 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.169+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 reap_dead start 2024-04-25T10:01:55.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.169+0000 7f68f5920740 1 -- 172.21.15.7:0/678024873 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x56329af5b000 msgr2=0x56329af56b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.169+0000 7f68f5920740 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x56329af5b000 0x56329af56b00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.170+0000 7f68f5920740 1 -- 172.21.15.7:0/678024873 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x56329af5b800 msgr2=0x56329af57600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.170+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 reap_dead start 2024-04-25T10:01:55.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.170+0000 7f68f5920740 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x56329af5b800 0x56329af57600 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.170+0000 7f68f5920740 1 -- 172.21.15.7:0/678024873 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x56329af30800 msgr2=0x56329ac2bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.170+0000 7f68f5920740 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x56329af30800 0x56329ac2bb80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.170+0000 7f68f5920740 1 -- 172.21.15.7:0/678024873 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x56329af5ac00 msgr2=0x56329af57080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.170+0000 7f68f5920740 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x56329af5ac00 0x56329af57080 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.170+0000 7f68f5920740 1 -- 172.21.15.7:0/678024873 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x56329ba8dc00 msgr2=0x56329ac2d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.170+0000 7f68f5920740 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x56329ba8dc00 0x56329ac2d700 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x56329b94eed0 tx=0x56329af32000 comp rx=0 tx=0).stop 2024-04-25T10:01:55.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.170+0000 7f68f5920740 1 -- 172.21.15.7:0/678024873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56329ba8d400 msgr2=0x56329ac2cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.170+0000 7f68f5920740 1 --2- 172.21.15.7:0/678024873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56329ba8d400 0x56329ac2cc00 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x56329b9c71d0 tx=0x56329b94c8a0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.170+0000 7f68f38ad640 1 -- 172.21.15.7:0/678024873 reap_dead start 2024-04-25T10:01:55.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.170+0000 7f68f5920740 1 -- 172.21.15.7:0/678024873 shutdown_connections 2024-04-25T10:01:55.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.170+0000 7f68f5920740 1 -- 172.21.15.7:0/678024873 >> 172.21.15.7:0/678024873 conn(0x56329ba8cc00 msgr2=0x56329acb5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:55.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.170+0000 7f68f5920740 1 -- 172.21.15.7:0/678024873 shutdown_connections 2024-04-25T10:01:55.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.170+0000 7f68f5920740 1 -- 172.21.15.7:0/678024873 wait complete. 2024-04-25T10:01:55.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.170+0000 7f68f5920740 1 -- 172.21.15.7:0/2634811604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56329abbb800 msgr2=0x56329ac2ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.170+0000 7f68f5920740 1 --2- 172.21.15.7:0/2634811604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56329abbb800 0x56329ac2ab00 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x56329b9c7cb0 tx=0x56329ad2e240 comp rx=0 tx=0).stop 2024-04-25T10:01:55.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.170+0000 7f68f5920740 1 -- 172.21.15.7:0/2634811604 shutdown_connections 2024-04-25T10:01:55.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.170+0000 7f68f5920740 1 --2- 172.21.15.7:0/2634811604 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56329abbbc00 0x56329ac2b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.170+0000 7f68f5920740 1 --2- 172.21.15.7:0/2634811604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56329abbb800 0x56329ac2ab00 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.170+0000 7f68f5920740 1 --2- 172.21.15.7:0/2634811604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56329abbac00 0x56329ac2a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.170+0000 7f68f5920740 1 -- 172.21.15.7:0/2634811604 >> 172.21.15.7:0/2634811604 conn(0x56329abbb000 msgr2=0x56329acb4800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:55.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.170+0000 7f68f5920740 1 -- 172.21.15.7:0/2634811604 shutdown_connections 2024-04-25T10:01:55.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.170+0000 7f68f5920740 1 -- 172.21.15.7:0/2634811604 wait complete. 2024-04-25T10:01:55.193 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', 'cephfs_data'] in time 0:00:00.146944, result: 2024-04-25T10:01:55.193 DEBUG:teuthology.orchestra.run.smithi007:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2024-04-25T10:01:55.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.259+0000 7f788a60c740 1 -- start start 2024-04-25T10:01:55.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.259+0000 7f788a60c740 1 Processor -- start 2024-04-25T10:01:55.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.260+0000 7f788a60c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56335778ec00 0x5633577fe580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.260+0000 7f788a60c740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56335778f800 0x5633577feb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.260+0000 7f788a60c740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56335778fc00 0x5633577ff080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.260+0000 7f788a60c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x563358646180 con 0x56335778ec00 2024-04-25T10:01:55.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.260+0000 7f788a60c740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x563358646300 con 0x56335778fc00 2024-04-25T10:01:55.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.260+0000 7f788a60c740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x563358646480 con 0x56335778f800 2024-04-25T10:01:55.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.260+0000 7f788820f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56335778ec00 0x5633577fe580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.260+0000 7f788820f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56335778ec00 0x5633577fe580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44846/0 (socket says 172.21.15.7:44846) 2024-04-25T10:01:55.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.260+0000 7f788820f640 1 -- 172.21.15.7:0/3477758273 learned_addr learned my addr 172.21.15.7:0/3477758273 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:55.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.260+0000 7f7888a10640 1 --2- 172.21.15.7:0/3477758273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56335778fc00 0x5633577ff080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.260+0000 7f7887a0e640 1 --2- 172.21.15.7:0/3477758273 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56335778f800 0x5633577feb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.260+0000 7f788820f640 1 -- 172.21.15.7:0/3477758273 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56335778f800 msgr2=0x5633577feb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:55.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.260+0000 7f788820f640 1 --2- 172.21.15.7:0/3477758273 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56335778f800 0x5633577feb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.260+0000 7f788820f640 1 -- 172.21.15.7:0/3477758273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56335778fc00 msgr2=0x5633577ff080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:55.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.260+0000 7f788820f640 1 --2- 172.21.15.7:0/3477758273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56335778fc00 0x5633577ff080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.260+0000 7f788820f640 1 -- 172.21.15.7:0/3477758273 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633577bb680 con 0x56335778ec00 2024-04-25T10:01:55.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.260+0000 7f7887a0e640 1 --2- 172.21.15.7:0/3477758273 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56335778f800 0x5633577feb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:01:55.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.260+0000 7f7888a10640 1 --2- 172.21.15.7:0/3477758273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56335778fc00 0x5633577ff080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:01:55.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.260+0000 7f788820f640 1 --2- 172.21.15.7:0/3477758273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56335778ec00 0x5633577fe580 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x5633585a7c80 tx=0x563357902240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a68de9bac5d9b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.260+0000 7f7885a0a640 1 -- 172.21.15.7:0/3477758273 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5633577b4680 con 0x56335778ec00 2024-04-25T10:01:55.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.260+0000 7f7885a0a640 1 -- 172.21.15.7:0/3477758273 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5633577d81c0 con 0x56335778ec00 2024-04-25T10:01:55.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.260+0000 7f7885a0a640 1 -- 172.21.15.7:0/3477758273 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5633577b4b60 con 0x56335778ec00 2024-04-25T10:01:55.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.260+0000 7f788a60c740 1 -- 172.21.15.7:0/3477758273 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5633577bb4a0 con 0x56335778ec00 2024-04-25T10:01:55.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.261+0000 7f788a60c740 1 -- 172.21.15.7:0/3477758273 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5633577bba40 con 0x56335778ec00 2024-04-25T10:01:55.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.261+0000 7f788a60c740 4 waiting for MDS map... 2024-04-25T10:01:55.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.261+0000 7f7885a0a640 1 -- 172.21.15.7:0/3477758273 <== mon.0 v2:172.21.15.7:3300/0 4 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x563358652600 con 0x56335778ec00 2024-04-25T10:01:55.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.261+0000 7f7885a0a640 1 -- 172.21.15.7:0/3477758273 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 61) v1 ==== 2723+0+0 (secure 0 0 0) 0x5633577e7180 con 0x56335778ec00 2024-04-25T10:01:55.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.261+0000 7f788a60c740 4 Got MDS map 61 2024-04-25T10:01:55.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.261+0000 7f788a60c740 4 datascan.main: Using metadata pool output 2024-04-25T10:01:55.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.261+0000 7f788a60c740 4 datascan.main: connecting to RADOS... 2024-04-25T10:01:55.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.261+0000 7f788a60c740 1 Processor -- start 2024-04-25T10:01:55.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.261+0000 7f788a60c740 1 -- start start 2024-04-25T10:01:55.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.262+0000 7f788a60c740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563358659000 0x5633577ff600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.262+0000 7f788a60c740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563358659400 0x5633577ffb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.262+0000 7f788a60c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563358659800 0x563357800100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.262+0000 7f788a60c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x563358646600 con 0x563358659800 2024-04-25T10:01:55.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.262+0000 7f788a60c740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x563358646780 con 0x563358659000 2024-04-25T10:01:55.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.262+0000 7f788a60c740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x563358646900 con 0x563358659400 2024-04-25T10:01:55.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.262+0000 7f7887a0e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563358659800 0x563357800100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.262+0000 7f7887a0e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563358659800 0x563357800100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44860/0 (socket says 172.21.15.7:44860) 2024-04-25T10:01:55.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.262+0000 7f7887a0e640 1 -- 172.21.15.7:0/356169285 learned_addr learned my addr 172.21.15.7:0/356169285 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:55.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.262+0000 7f788820f640 1 --2- 172.21.15.7:0/356169285 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563358659400 0x5633577ffb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.262+0000 7f7888a10640 1 --2- 172.21.15.7:0/356169285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563358659000 0x5633577ff600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.262+0000 7f7887a0e640 1 -- 172.21.15.7:0/356169285 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563358659400 msgr2=0x5633577ffb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:55.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.262+0000 7f7887a0e640 1 --2- 172.21.15.7:0/356169285 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563358659400 0x5633577ffb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.262+0000 7f7887a0e640 1 -- 172.21.15.7:0/356169285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563358659000 msgr2=0x5633577ff600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:55.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.262+0000 7f7887a0e640 1 --2- 172.21.15.7:0/356169285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563358659000 0x5633577ff600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.262+0000 7f7887a0e640 1 -- 172.21.15.7:0/356169285 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633577bb860 con 0x563358659800 2024-04-25T10:01:55.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.262+0000 7f7888a10640 1 --2- 172.21.15.7:0/356169285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563358659000 0x5633577ff600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:01:55.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.262+0000 7f7887a0e640 1 --2- 172.21.15.7:0/356169285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563358659800 0x563357800100 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x5633585a7200 tx=0x5633585208a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec2267f1dd58248 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.263+0000 7f7883a06640 1 -- 172.21.15.7:0/356169285 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5633577b49c0 con 0x563358659800 2024-04-25T10:01:55.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.263+0000 7f7883a06640 1 -- 172.21.15.7:0/356169285 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5633577d8c40 con 0x563358659800 2024-04-25T10:01:55.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.263+0000 7f7883a06640 1 -- 172.21.15.7:0/356169285 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5633577b4680 con 0x563358659800 2024-04-25T10:01:55.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.263+0000 7f788a60c740 1 -- 172.21.15.7:0/356169285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563358659800 msgr2=0x563357800100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.263+0000 7f788a60c740 1 --2- 172.21.15.7:0/356169285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563358659800 0x563357800100 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x5633585a7200 tx=0x5633585208a0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.263+0000 7f788a60c740 1 -- 172.21.15.7:0/356169285 shutdown_connections 2024-04-25T10:01:55.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.263+0000 7f788a60c740 1 --2- 172.21.15.7:0/356169285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563358659800 0x563357800100 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.263+0000 7f788a60c740 1 --2- 172.21.15.7:0/356169285 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563358659400 0x5633577ffb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.263+0000 7f788a60c740 1 --2- 172.21.15.7:0/356169285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563358659000 0x5633577ff600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.263+0000 7f788a60c740 1 -- 172.21.15.7:0/356169285 >> 172.21.15.7:0/356169285 conn(0x563358658c00 msgr2=0x563357889000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:55.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.263+0000 7f788a60c740 1 -- 172.21.15.7:0/356169285 shutdown_connections 2024-04-25T10:01:55.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.263+0000 7f788a60c740 1 -- 172.21.15.7:0/356169285 wait complete. 2024-04-25T10:01:55.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.264+0000 7f788a60c740 1 Processor -- start 2024-04-25T10:01:55.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.264+0000 7f788a60c740 1 -- start start 2024-04-25T10:01:55.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.264+0000 7f788a60c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563358659000 0x563357801180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.264+0000 7f788a60c740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563358659400 0x563357800c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.264+0000 7f788a60c740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563358659800 0x563357800680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.264+0000 7f788a60c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x563358647b00 con 0x563358659000 2024-04-25T10:01:55.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.264+0000 7f788a60c740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x563358647980 con 0x563358659800 2024-04-25T10:01:55.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.264+0000 7f788a60c740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x563358647800 con 0x563358659400 2024-04-25T10:01:55.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.264+0000 7f7888a10640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563358659000 0x563357801180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.264+0000 7f7888a10640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563358659000 0x563357801180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44868/0 (socket says 172.21.15.7:44868) 2024-04-25T10:01:55.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.264+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 learned_addr learned my addr 172.21.15.7:0/1176717349 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:55.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.264+0000 7f7887a0e640 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563358659800 0x563357800680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.264+0000 7f788820f640 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563358659400 0x563357800c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.265+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563358659400 msgr2=0x563357800c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.265+0000 7f7888a10640 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563358659400 0x563357800c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.265+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563358659800 msgr2=0x563357800680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.265+0000 7f7888a10640 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563358659800 0x563357800680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.265+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633577bb680 con 0x563358659000 2024-04-25T10:01:55.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.265+0000 7f7888a10640 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563358659000 0x563357801180 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x563358671e90 tx=0x56335867ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.265+0000 7f7882203640 1 -- 172.21.15.7:0/1176717349 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5633577b49c0 con 0x563358659000 2024-04-25T10:01:55.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.265+0000 7f7882203640 1 -- 172.21.15.7:0/1176717349 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5633577d9340 con 0x563358659000 2024-04-25T10:01:55.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.265+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5633577bb4a0 con 0x563358659000 2024-04-25T10:01:55.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.265+0000 7f7882203640 1 -- 172.21.15.7:0/1176717349 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5633577b4680 con 0x563358659000 2024-04-25T10:01:55.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.265+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5633577bba40 con 0x563358659000 2024-04-25T10:01:55.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.265+0000 7f788a60c740 4 datascan.init: resolving metadata pool 13 2024-04-25T10:01:55.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.266+0000 7f7882203640 1 -- 172.21.15.7:0/1176717349 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x563358654c00 con 0x563358659000 2024-04-25T10:01:55.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.267+0000 7f7882203640 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x5633586d6800 0x563357801700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.267+0000 7f7882203640 1 -- 172.21.15.7:0/1176717349 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x56335858e600 con 0x563358659000 2024-04-25T10:01:55.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.267+0000 7f788820f640 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x5633586d6800 0x563357801700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.267+0000 7f788a60c740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T10:01:55.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.267+0000 7f788a60c740 4 datascan.main: resolving metadata pool 13 2024-04-25T10:01:55.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.267+0000 7f788a60c740 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x5633586d6c00 0x563357800100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.267+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:1 13.0 13:00000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7000 con 0x5633586d6c00 2024-04-25T10:01:55.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.267+0000 7f7887a0e640 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x5633586d6c00 0x563357800100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.267+0000 7f788820f640 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x5633586d6800 0x563357801700 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x5633586703f0 tx=0x563358512a80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.267+0000 7f7887a0e640 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x5633586d6c00 0x563357800100 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.268+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.7 v2:172.21.15.55:6816/2960381217 1 ==== osd_op_reply(1 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e000 con 0x5633586d6c00 2024-04-25T10:01:55.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.268+0000 7f7887a0e640 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x5633586d7000 0x563357b02000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.268+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:2 13.10 13:08000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x563358575400 con 0x5633586d7000 2024-04-25T10:01:55.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.268+0000 7f7888a10640 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x5633586d7000 0x563357b02000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.268+0000 7f7888a10640 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x5633586d7000 0x563357b02000 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.269+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.1 v2:172.21.15.7:6816/434435857 1 ==== osd_op_reply(2 [pgnls start_epoch 92 out=177b] v92'18 uv18 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x56335850e500 con 0x5633586d7000 2024-04-25T10:01:55.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.269+0000 7f7888a10640 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x563358575400 0x563357b02580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.269+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:3 13.8 13:10000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b0c000 con 0x563358575400 2024-04-25T10:01:55.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.269+0000 7f788820f640 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x563358575400 0x563357b02580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.269+0000 7f788820f640 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x563358575400 0x563357b02580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.269+0000 7f788820f640 1 -- 172.21.15.7:0/1176717349 <== osd.2 v2:172.21.15.7:6808/1173474863 1 ==== osd_op_reply(3 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e780 con 0x563358575400 2024-04-25T10:01:55.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.269+0000 7f788820f640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:4 13.18 13:18000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b0c000 con 0x5633586d6c00 2024-04-25T10:01:55.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.270+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.7 v2:172.21.15.55:6816/2960381217 2 ==== osd_op_reply(4 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e000 con 0x5633586d6c00 2024-04-25T10:01:55.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.270+0000 7f7887a0e640 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x563357b0c000 0x563357b02b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.270+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:5 13.4 13:20000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x563358575000 con 0x563357b0c000 2024-04-25T10:01:55.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.270+0000 7f7887a0e640 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x563357b0c000 0x563357b02b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.271+0000 7f7887a0e640 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x563357b0c000 0x563357b02b00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.271+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.6 v2:172.21.15.55:6824/4293769515 1 ==== osd_op_reply(5 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e000 con 0x563357b0c000 2024-04-25T10:01:55.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.271+0000 7f7887a0e640 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x563358575000 0x563357b03080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.271+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:6 13.14 13:28000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x563358574c00 con 0x563358575000 2024-04-25T10:01:55.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.271+0000 7f7888a10640 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x563358575000 0x563357b03080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.271+0000 7f7888a10640 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x563358575000 0x563357b03080 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.272+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.0 v2:172.21.15.7:6800/4167741236 1 ==== osd_op_reply(6 [pgnls start_epoch 92 out=149b] v91'28 uv28 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x56335850e500 con 0x563358575000 2024-04-25T10:01:55.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.272+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:7 13.c 13:30000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x563358574c00 con 0x5633586d7000 2024-04-25T10:01:55.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.272+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.1 v2:172.21.15.7:6816/434435857 2 ==== osd_op_reply(7 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e500 con 0x5633586d7000 2024-04-25T10:01:55.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.272+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:8 13.1c 13:38000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x563358574c00 con 0x563357b0c000 2024-04-25T10:01:55.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.272+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.6 v2:172.21.15.55:6824/4293769515 2 ==== osd_op_reply(8 [pgnls start_epoch 92 out=73b] v91'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x56335850e000 con 0x563357b0c000 2024-04-25T10:01:55.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.272+0000 7f7887a0e640 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x563358574c00 0x563357b03600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.272+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:9 13.2 13:40000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x563358574800 con 0x563358574c00 2024-04-25T10:01:55.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.272+0000 7f788820f640 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x563358574c00 0x563357b03600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.273+0000 7f788820f640 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x563358574c00 0x563357b03600 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.273+0000 7f788820f640 1 -- 172.21.15.7:0/1176717349 <== osd.5 v2:172.21.15.55:6800/2514169616 1 ==== osd_op_reply(9 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e780 con 0x563358574c00 2024-04-25T10:01:55.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.273+0000 7f788820f640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:10 13.12 13:48000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x563358574800 con 0x563358575000 2024-04-25T10:01:55.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.273+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.0 v2:172.21.15.7:6800/4167741236 2 ==== osd_op_reply(10 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e500 con 0x563358575000 2024-04-25T10:01:55.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.273+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:11 13.a 13:50000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x563358574800 con 0x563358575400 2024-04-25T10:01:55.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.274+0000 7f788820f640 1 -- 172.21.15.7:0/1176717349 <== osd.2 v2:172.21.15.7:6808/1173474863 2 ==== osd_op_reply(11 [pgnls start_epoch 92 out=81b] v91'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x56335850e780 con 0x563358575400 2024-04-25T10:01:55.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.274+0000 7f788820f640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:12 13.1a 13:58000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x563358574800 con 0x5633586d7000 2024-04-25T10:01:55.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.274+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.1 v2:172.21.15.7:6816/434435857 3 ==== osd_op_reply(12 [pgnls start_epoch 92 out=49b] v89'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e500 con 0x5633586d7000 2024-04-25T10:01:55.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.274+0000 7f7888a10640 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x563358574800 0x563357b04680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.274+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:13 13.6 13:60000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b0c400 con 0x563358574800 2024-04-25T10:01:55.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.274+0000 7f7887a0e640 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x563358574800 0x563357b04680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.274+0000 7f7887a0e640 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x563358574800 0x563357b04680 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.275+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.4 v2:172.21.15.55:6808/2248155105 1 ==== osd_op_reply(13 [pgnls start_epoch 92 out=77b] v91'8 uv8 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x56335850e000 con 0x563358574800 2024-04-25T10:01:55.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.275+0000 7f7887a0e640 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x563357b0c400 0x563357b03b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.275+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:14 13.16 13:68000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b0cc00 con 0x563357b0c400 2024-04-25T10:01:55.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.275+0000 7f7888a10640 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x563357b0c400 0x563357b03b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.275+0000 7f7888a10640 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x563357b0c400 0x563357b03b80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.275+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.3 v2:172.21.15.7:6824/3045538953 1 ==== osd_op_reply(14 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e500 con 0x563357b0c400 2024-04-25T10:01:55.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.275+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:15 13.e 13:70000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b0cc00 con 0x5633586d6c00 2024-04-25T10:01:55.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.276+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.7 v2:172.21.15.55:6816/2960381217 3 ==== osd_op_reply(15 [pgnls start_epoch 92 out=73b] v91'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x56335850e000 con 0x5633586d6c00 2024-04-25T10:01:55.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.276+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:16 13.1e 13:78000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b0cc00 con 0x563358574800 2024-04-25T10:01:55.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.276+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.4 v2:172.21.15.55:6808/2248155105 2 ==== osd_op_reply(16 [pgnls start_epoch 92 out=49b] v89'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e000 con 0x563358574800 2024-04-25T10:01:55.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.276+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:17 13.1 13:80000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b0cc00 con 0x563357b0c000 2024-04-25T10:01:55.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.276+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.6 v2:172.21.15.55:6824/4293769515 3 ==== osd_op_reply(17 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e000 con 0x563357b0c000 2024-04-25T10:01:55.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.276+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:18 13.11 13:88000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b0cc00 con 0x5633586d7000 2024-04-25T10:01:55.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.277+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.1 v2:172.21.15.7:6816/434435857 4 ==== osd_op_reply(18 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e500 con 0x5633586d7000 2024-04-25T10:01:55.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.277+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:19 13.9 13:90000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b0cc00 con 0x563358574c00 2024-04-25T10:01:55.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.277+0000 7f788820f640 1 -- 172.21.15.7:0/1176717349 <== osd.5 v2:172.21.15.55:6800/2514169616 2 ==== osd_op_reply(19 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e780 con 0x563358574c00 2024-04-25T10:01:55.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.277+0000 7f788820f640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:20 13.19 13:98000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b0cc00 con 0x563357b0c400 2024-04-25T10:01:55.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.277+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.3 v2:172.21.15.7:6824/3045538953 2 ==== osd_op_reply(20 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e500 con 0x563357b0c400 2024-04-25T10:01:55.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.277+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:21 13.5 13:a0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b0cc00 con 0x563358574800 2024-04-25T10:01:55.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.277+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.4 v2:172.21.15.55:6808/2248155105 3 ==== osd_op_reply(21 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e000 con 0x563358574800 2024-04-25T10:01:55.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.277+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:22 13.15 13:a8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b0cc00 con 0x563358574800 2024-04-25T10:01:55.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.278+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.4 v2:172.21.15.55:6808/2248155105 4 ==== osd_op_reply(22 [pgnls start_epoch 92 out=97b] v91'4 uv4 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x56335850e000 con 0x563358574800 2024-04-25T10:01:55.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.278+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:23 13.d 13:b0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b0cc00 con 0x563358574800 2024-04-25T10:01:55.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.278+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.4 v2:172.21.15.55:6808/2248155105 5 ==== osd_op_reply(23 [pgnls start_epoch 92 out=74b] v87'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x56335850e000 con 0x563358574800 2024-04-25T10:01:55.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.278+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:24 13.1d 13:b8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b0cc00 con 0x5633586d6c00 2024-04-25T10:01:55.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.278+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.7 v2:172.21.15.55:6816/2960381217 4 ==== osd_op_reply(24 [pgnls start_epoch 92 out=73b] v91'5 uv5 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x56335850e000 con 0x5633586d6c00 2024-04-25T10:01:55.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.278+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:25 13.3 13:c0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b0cc00 con 0x563358575000 2024-04-25T10:01:55.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.279+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.0 v2:172.21.15.7:6800/4167741236 3 ==== osd_op_reply(25 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e500 con 0x563358575000 2024-04-25T10:01:55.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.279+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:26 13.13 13:c8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b0cc00 con 0x5633586d6c00 2024-04-25T10:01:55.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.279+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.7 v2:172.21.15.55:6816/2960381217 5 ==== osd_op_reply(26 [pgnls start_epoch 92 out=98b] v91'4 uv4 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x56335850e000 con 0x5633586d6c00 2024-04-25T10:01:55.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.279+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:27 13.b 13:d0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b0cc00 con 0x563358574c00 2024-04-25T10:01:55.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.279+0000 7f788820f640 1 -- 172.21.15.7:0/1176717349 <== osd.5 v2:172.21.15.55:6800/2514169616 3 ==== osd_op_reply(27 [pgnls start_epoch 92 out=76b] v91'6 uv6 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x56335850e780 con 0x563358574c00 2024-04-25T10:01:55.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.279+0000 7f788820f640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:28 13.1b 13:d8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b0cc00 con 0x563358574800 2024-04-25T10:01:55.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.280+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.4 v2:172.21.15.55:6808/2248155105 6 ==== osd_op_reply(28 [pgnls start_epoch 92 out=73b] v91'10 uv10 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x56335850e000 con 0x563358574800 2024-04-25T10:01:55.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.280+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:29 13.7 13:e0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b0cc00 con 0x5633586d6c00 2024-04-25T10:01:55.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.280+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.7 v2:172.21.15.55:6816/2960381217 6 ==== osd_op_reply(29 [pgnls start_epoch 92 out=73b] v91'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x56335850e000 con 0x5633586d6c00 2024-04-25T10:01:55.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.280+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:30 13.17 13:e8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b0cc00 con 0x563358574c00 2024-04-25T10:01:55.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.280+0000 7f788820f640 1 -- 172.21.15.7:0/1176717349 <== osd.5 v2:172.21.15.55:6800/2514169616 4 ==== osd_op_reply(30 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e780 con 0x563358574c00 2024-04-25T10:01:55.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.280+0000 7f788820f640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:31 13.f 13:f0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b0cc00 con 0x563357b0c000 2024-04-25T10:01:55.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.281+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.6 v2:172.21.15.55:6824/4293769515 4 ==== osd_op_reply(31 [pgnls start_epoch 92 out=73b] v87'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x56335850e000 con 0x563357b0c000 2024-04-25T10:01:55.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.281+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:32 13.1f 13:f8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b0cc00 con 0x563357b0c000 2024-04-25T10:01:55.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.281+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.6 v2:172.21.15.55:6824/4293769515 5 ==== osd_op_reply(32 [pgnls start_epoch 92 out=101b] v91'9 uv9 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x56335850e000 con 0x563357b0c000 2024-04-25T10:01:55.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.281+0000 7f788a60c740 10 datascan.scan_links: step 1: handling object 601.00000000 2024-04-25T10:01:55.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.281+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:33 13.10 13:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7400 con 0x5633586d7000 2024-04-25T10:01:55.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.281+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.1 v2:172.21.15.7:6816/434435857 5 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56335850e500 con 0x5633586d7000 2024-04-25T10:01:55.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.281+0000 7f788a60c740 10 datascan.scan_links: step 1: handling object 602.00000000 2024-04-25T10:01:55.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.281+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:34 13.10 13:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7800 con 0x5633586d7000 2024-04-25T10:01:55.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.281+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.1 v2:172.21.15.7:6816/434435857 6 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56335850e500 con 0x5633586d7000 2024-04-25T10:01:55.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.281+0000 7f788a60c740 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2024-04-25T10:01:55.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.281+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:35 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x5633586d7000 2024-04-25T10:01:55.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.282+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.1 v2:172.21.15.7:6816/434435857 7 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=506b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+506 (crc 0 0 0) 0x56335850e500 con 0x5633586d7000 2024-04-25T10:01:55.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.282+0000 7f788a60c740 20 datascan.scan_links: injected ino detected 2024-04-25T10:01:55.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.282+0000 7f788a60c740 10 datascan.scan_links: step 1: handling object 600.00000000 2024-04-25T10:01:55.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.282+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:36 13.10 13:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b32000 con 0x5633586d7000 2024-04-25T10:01:55.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.282+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.1 v2:172.21.15.7:6816/434435857 8 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv12 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56335850e500 con 0x5633586d7000 2024-04-25T10:01:55.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.282+0000 7f788a60c740 10 datascan.scan_links: step 1: handling object 603.00000000 2024-04-25T10:01:55.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.282+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:37 13.10 13:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b32400 con 0x5633586d7000 2024-04-25T10:01:55.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.282+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.1 v2:172.21.15.7:6816/434435857 9 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56335850e500 con 0x5633586d7000 2024-04-25T10:01:55.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.282+0000 7f788a60c740 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2024-04-25T10:01:55.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.282+0000 7f788a60c740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-25T10:01:55.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.282+0000 7f788a60c740 10 datascan.scan_links: step 1: handling object 200.00000000 2024-04-25T10:01:55.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.282+0000 7f788a60c740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-25T10:01:55.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.282+0000 7f788a60c740 10 datascan.scan_links: step 1: handling object 200.00000001 2024-04-25T10:01:55.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.282+0000 7f788a60c740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-25T10:01:55.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.282+0000 7f788a60c740 10 datascan.scan_links: step 1: handling object 606.00000000 2024-04-25T10:01:55.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.282+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:38 13.14 13:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b32800 con 0x563358575000 2024-04-25T10:01:55.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.283+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.0 v2:172.21.15.7:6800/4167741236 4 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv26 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56335850e500 con 0x563358575000 2024-04-25T10:01:55.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.283+0000 7f788a60c740 10 datascan.scan_links: step 1: handling object 607.00000000 2024-04-25T10:01:55.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.283+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:39 13.1c 13:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b32c00 con 0x563357b0c000 2024-04-25T10:01:55.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.283+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.6 v2:172.21.15.55:6824/4293769515 6 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56335850e000 con 0x563357b0c000 2024-04-25T10:01:55.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.283+0000 7f788a60c740 10 datascan.scan_links: step 1: handling object 100000001f6.00000000 2024-04-25T10:01:55.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.283+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:40 13.a 13:57fe7535:::100000001f6.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b33000 con 0x563358575400 2024-04-25T10:01:55.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.283+0000 7f788820f640 1 -- 172.21.15.7:0/1176717349 <== osd.2 v2:172.21.15.7:6808/1173474863 3 ==== osd_op_reply(40 100000001f6.00000000 [omap-get-vals out=54b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+54 (crc 0 0 0) 0x56335850e780 con 0x563358575400 2024-04-25T10:01:55.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.283+0000 7f788a60c740 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2024-04-25T10:01:55.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.283+0000 7f788a60c740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-25T10:01:55.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.283+0000 7f788a60c740 10 datascan.scan_links: step 1: handling object 608.00000000 2024-04-25T10:01:55.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.283+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:41 13.e 13:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b33400 con 0x5633586d6c00 2024-04-25T10:01:55.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.284+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.7 v2:172.21.15.55:6816/2960381217 7 ==== osd_op_reply(41 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56335850e000 con 0x5633586d6c00 2024-04-25T10:01:55.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.284+0000 7f788a60c740 10 datascan.scan_links: step 1: handling object 604.00000000 2024-04-25T10:01:55.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.284+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:42 13.15 13:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b32000 con 0x563358574800 2024-04-25T10:01:55.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.284+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.4 v2:172.21.15.55:6808/2248155105 7 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56335850e000 con 0x563358574800 2024-04-25T10:01:55.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.284+0000 7f788a60c740 10 datascan.scan_links: step 1: handling object 500.00000000 2024-04-25T10:01:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.284+0000 7f788a60c740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-25T10:01:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.284+0000 7f788a60c740 10 datascan.scan_links: step 1: handling object mds_snaptable 2024-04-25T10:01:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.284+0000 7f788a60c740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-25T10:01:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.284+0000 7f788a60c740 10 datascan.scan_links: step 1: handling object 605.00000000 2024-04-25T10:01:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.284+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:43 13.1d 13:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b33800 con 0x5633586d6c00 2024-04-25T10:01:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.285+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.7 v2:172.21.15.55:6816/2960381217 8 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56335850e000 con 0x5633586d6c00 2024-04-25T10:01:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.285+0000 7f788a60c740 10 datascan.scan_links: step 1: handling object mds0_inotable 2024-04-25T10:01:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.285+0000 7f788a60c740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-25T10:01:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.285+0000 7f788a60c740 10 datascan.scan_links: step 1: handling object 100.00000000 2024-04-25T10:01:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.285+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:44 13.13 13:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b33c00 con 0x5633586d6c00 2024-04-25T10:01:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.285+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.7 v2:172.21.15.55:6816/2960381217 9 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5195b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x56335850e000 con 0x5633586d6c00 2024-04-25T10:01:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.285+0000 7f788a60c740 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2024-04-25T10:01:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.285+0000 7f788a60c740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-25T10:01:55.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.285+0000 7f788a60c740 10 datascan.scan_links: step 1: handling object 200.00000002 2024-04-25T10:01:55.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.285+0000 7f788a60c740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000002' 2024-04-25T10:01:55.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.285+0000 7f788a60c740 10 datascan.scan_links: step 1: handling object 609.00000000 2024-04-25T10:01:55.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.285+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:45 13.7 13:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7400 con 0x5633586d6c00 2024-04-25T10:01:55.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.285+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.7 v2:172.21.15.55:6816/2960381217 10 ==== osd_op_reply(45 609.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56335850e000 con 0x5633586d6c00 2024-04-25T10:01:55.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.285+0000 7f788a60c740 10 datascan.scan_links: step 1: handling object 400.00000000 2024-04-25T10:01:55.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.285+0000 7f788a60c740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-25T10:01:55.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.285+0000 7f788a60c740 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2024-04-25T10:01:55.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.285+0000 7f788a60c740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-25T10:01:55.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.285+0000 7f788a60c740 10 datascan.scan_links: step 1: handling object 1.00000000 2024-04-25T10:01:55.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.285+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:46 13.1f 13:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7800 con 0x563357b0c000 2024-04-25T10:01:55.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.286+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.6 v2:172.21.15.55:6824/4293769515 7 ==== osd_op_reply(46 1.00000000 [omap-get-vals out=1163b] v0'0 uv9 ondisk = 0) v8 ==== 154+0+1163 (crc 0 0 0) 0x56335850e000 con 0x563357b0c000 2024-04-25T10:01:55.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.286+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:47 13.0 13:00000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x5633586d6c00 2024-04-25T10:01:55.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.286+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.7 v2:172.21.15.55:6816/2960381217 11 ==== osd_op_reply(47 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e000 con 0x5633586d6c00 2024-04-25T10:01:55.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.286+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:48 13.10 13:08000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x5633586d7000 2024-04-25T10:01:55.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.286+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.1 v2:172.21.15.7:6816/434435857 10 ==== osd_op_reply(48 [pgnls start_epoch 92 out=177b] v92'18 uv18 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x56335850e500 con 0x5633586d7000 2024-04-25T10:01:55.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.286+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:49 13.8 13:10000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x563358575400 2024-04-25T10:01:55.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.287+0000 7f788820f640 1 -- 172.21.15.7:0/1176717349 <== osd.2 v2:172.21.15.7:6808/1173474863 4 ==== osd_op_reply(49 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e780 con 0x563358575400 2024-04-25T10:01:55.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.287+0000 7f788820f640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:50 13.18 13:18000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x5633586d6c00 2024-04-25T10:01:55.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.287+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.7 v2:172.21.15.55:6816/2960381217 12 ==== osd_op_reply(50 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e000 con 0x5633586d6c00 2024-04-25T10:01:55.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.287+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:51 13.4 13:20000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x563357b0c000 2024-04-25T10:01:55.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.287+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.6 v2:172.21.15.55:6824/4293769515 8 ==== osd_op_reply(51 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e000 con 0x563357b0c000 2024-04-25T10:01:55.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.287+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:52 13.14 13:28000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x563358575000 2024-04-25T10:01:55.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.287+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.0 v2:172.21.15.7:6800/4167741236 5 ==== osd_op_reply(52 [pgnls start_epoch 92 out=149b] v91'28 uv28 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x56335850e500 con 0x563358575000 2024-04-25T10:01:55.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.287+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:53 13.c 13:30000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x5633586d7000 2024-04-25T10:01:55.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.288+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.1 v2:172.21.15.7:6816/434435857 11 ==== osd_op_reply(53 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e500 con 0x5633586d7000 2024-04-25T10:01:55.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.288+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:54 13.1c 13:38000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x563357b0c000 2024-04-25T10:01:55.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.288+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.6 v2:172.21.15.55:6824/4293769515 9 ==== osd_op_reply(54 [pgnls start_epoch 92 out=73b] v91'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x56335850e000 con 0x563357b0c000 2024-04-25T10:01:55.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.288+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:55 13.2 13:40000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x563358574c00 2024-04-25T10:01:55.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.288+0000 7f788820f640 1 -- 172.21.15.7:0/1176717349 <== osd.5 v2:172.21.15.55:6800/2514169616 5 ==== osd_op_reply(55 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e780 con 0x563358574c00 2024-04-25T10:01:55.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.288+0000 7f788820f640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:56 13.12 13:48000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x563358575000 2024-04-25T10:01:55.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.289+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.0 v2:172.21.15.7:6800/4167741236 6 ==== osd_op_reply(56 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e500 con 0x563358575000 2024-04-25T10:01:55.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.289+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:57 13.a 13:50000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x563358575400 2024-04-25T10:01:55.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.289+0000 7f788820f640 1 -- 172.21.15.7:0/1176717349 <== osd.2 v2:172.21.15.7:6808/1173474863 5 ==== osd_op_reply(57 [pgnls start_epoch 92 out=81b] v91'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x56335850e780 con 0x563358575400 2024-04-25T10:01:55.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.289+0000 7f788820f640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:58 13.1a 13:58000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x5633586d7000 2024-04-25T10:01:55.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.289+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.1 v2:172.21.15.7:6816/434435857 12 ==== osd_op_reply(58 [pgnls start_epoch 92 out=49b] v89'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e500 con 0x5633586d7000 2024-04-25T10:01:55.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.289+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:59 13.6 13:60000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x563358574800 2024-04-25T10:01:55.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.289+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.4 v2:172.21.15.55:6808/2248155105 8 ==== osd_op_reply(59 [pgnls start_epoch 92 out=77b] v91'8 uv8 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x56335850e000 con 0x563358574800 2024-04-25T10:01:55.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.289+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:60 13.16 13:68000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x563357b0c400 2024-04-25T10:01:55.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.290+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.3 v2:172.21.15.7:6824/3045538953 3 ==== osd_op_reply(60 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e500 con 0x563357b0c400 2024-04-25T10:01:55.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.290+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:61 13.e 13:70000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x5633586d6c00 2024-04-25T10:01:55.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.290+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.7 v2:172.21.15.55:6816/2960381217 13 ==== osd_op_reply(61 [pgnls start_epoch 92 out=73b] v91'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x56335850e000 con 0x5633586d6c00 2024-04-25T10:01:55.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.290+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:62 13.1e 13:78000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x563358574800 2024-04-25T10:01:55.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.290+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.4 v2:172.21.15.55:6808/2248155105 9 ==== osd_op_reply(62 [pgnls start_epoch 92 out=49b] v89'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e000 con 0x563358574800 2024-04-25T10:01:55.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.290+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:63 13.1 13:80000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x563357b0c000 2024-04-25T10:01:55.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.291+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.6 v2:172.21.15.55:6824/4293769515 10 ==== osd_op_reply(63 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e000 con 0x563357b0c000 2024-04-25T10:01:55.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.291+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:64 13.11 13:88000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x5633586d7000 2024-04-25T10:01:55.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.291+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.1 v2:172.21.15.7:6816/434435857 13 ==== osd_op_reply(64 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e500 con 0x5633586d7000 2024-04-25T10:01:55.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.291+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:65 13.9 13:90000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x563358574c00 2024-04-25T10:01:55.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.291+0000 7f788820f640 1 -- 172.21.15.7:0/1176717349 <== osd.5 v2:172.21.15.55:6800/2514169616 6 ==== osd_op_reply(65 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e780 con 0x563358574c00 2024-04-25T10:01:55.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.291+0000 7f788820f640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:66 13.19 13:98000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x563357b0c400 2024-04-25T10:01:55.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.291+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.3 v2:172.21.15.7:6824/3045538953 4 ==== osd_op_reply(66 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e500 con 0x563357b0c400 2024-04-25T10:01:55.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.291+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:67 13.5 13:a0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x563358574800 2024-04-25T10:01:55.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.292+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.4 v2:172.21.15.55:6808/2248155105 10 ==== osd_op_reply(67 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e000 con 0x563358574800 2024-04-25T10:01:55.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.292+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:68 13.15 13:a8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x563358574800 2024-04-25T10:01:55.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.292+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.4 v2:172.21.15.55:6808/2248155105 11 ==== osd_op_reply(68 [pgnls start_epoch 92 out=97b] v91'4 uv4 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x56335850e000 con 0x563358574800 2024-04-25T10:01:55.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.292+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:69 13.d 13:b0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x563358574800 2024-04-25T10:01:55.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.293+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.4 v2:172.21.15.55:6808/2248155105 12 ==== osd_op_reply(69 [pgnls start_epoch 92 out=74b] v87'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x56335850e000 con 0x563358574800 2024-04-25T10:01:55.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.293+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:70 13.1d 13:b8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x5633586d6c00 2024-04-25T10:01:55.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.293+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.7 v2:172.21.15.55:6816/2960381217 14 ==== osd_op_reply(70 [pgnls start_epoch 92 out=73b] v91'5 uv5 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x56335850e000 con 0x5633586d6c00 2024-04-25T10:01:55.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.293+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:71 13.3 13:c0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x563358575000 2024-04-25T10:01:55.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.293+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.0 v2:172.21.15.7:6800/4167741236 7 ==== osd_op_reply(71 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e500 con 0x563358575000 2024-04-25T10:01:55.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.293+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:72 13.13 13:c8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x5633586d6c00 2024-04-25T10:01:55.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.294+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.7 v2:172.21.15.55:6816/2960381217 15 ==== osd_op_reply(72 [pgnls start_epoch 92 out=98b] v91'4 uv4 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x56335850e000 con 0x5633586d6c00 2024-04-25T10:01:55.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.294+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:73 13.b 13:d0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x563358574c00 2024-04-25T10:01:55.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.294+0000 7f788820f640 1 -- 172.21.15.7:0/1176717349 <== osd.5 v2:172.21.15.55:6800/2514169616 7 ==== osd_op_reply(73 [pgnls start_epoch 92 out=76b] v91'6 uv6 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x56335850e780 con 0x563358574c00 2024-04-25T10:01:55.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.294+0000 7f788820f640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:74 13.1b 13:d8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x563358574800 2024-04-25T10:01:55.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.294+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.4 v2:172.21.15.55:6808/2248155105 13 ==== osd_op_reply(74 [pgnls start_epoch 92 out=73b] v91'10 uv10 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x56335850e000 con 0x563358574800 2024-04-25T10:01:55.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.294+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:75 13.7 13:e0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x5633586d6c00 2024-04-25T10:01:55.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.294+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.7 v2:172.21.15.55:6816/2960381217 16 ==== osd_op_reply(75 [pgnls start_epoch 92 out=73b] v91'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x56335850e000 con 0x5633586d6c00 2024-04-25T10:01:55.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.294+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:76 13.17 13:e8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x563358574c00 2024-04-25T10:01:55.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.295+0000 7f788820f640 1 -- 172.21.15.7:0/1176717349 <== osd.5 v2:172.21.15.55:6800/2514169616 8 ==== osd_op_reply(76 [pgnls start_epoch 92 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56335850e780 con 0x563358574c00 2024-04-25T10:01:55.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.295+0000 7f788820f640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:77 13.f 13:f0000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x563357b0c000 2024-04-25T10:01:55.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.295+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.6 v2:172.21.15.55:6824/4293769515 11 ==== osd_op_reply(77 [pgnls start_epoch 92 out=73b] v87'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x56335850e000 con 0x563357b0c000 2024-04-25T10:01:55.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.295+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:78 13.1f 13:f8000000::::head [pgnls start_epoch 92 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e92) v9 -- 0x5633586d7c00 con 0x563357b0c000 2024-04-25T10:01:55.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.295+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.6 v2:172.21.15.55:6824/4293769515 12 ==== osd_op_reply(78 [pgnls start_epoch 92 out=101b] v91'9 uv9 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x56335850e000 con 0x563357b0c000 2024-04-25T10:01:55.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.295+0000 7f788a60c740 10 datascan.scan_links: step 2: handling object 601.00000000 2024-04-25T10:01:55.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.295+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:79 13.10 13:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b0c800 con 0x5633586d7000 2024-04-25T10:01:55.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.296+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.1 v2:172.21.15.7:6816/434435857 14 ==== osd_op_reply(79 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56335850e500 con 0x5633586d7000 2024-04-25T10:01:55.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.296+0000 7f788a60c740 10 datascan.scan_links: step 2: handling object 602.00000000 2024-04-25T10:01:55.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.296+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:80 13.10 13:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b32c00 con 0x5633586d7000 2024-04-25T10:01:55.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.296+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.1 v2:172.21.15.7:6816/434435857 15 ==== osd_op_reply(80 602.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56335850e500 con 0x5633586d7000 2024-04-25T10:01:55.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.296+0000 7f788a60c740 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2024-04-25T10:01:55.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.296+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:81 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b33400 con 0x5633586d7000 2024-04-25T10:01:55.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.296+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.1 v2:172.21.15.7:6816/434435857 16 ==== osd_op_reply(81 10000000000.00000000 [omap-get-vals out=506b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+506 (crc 0 0 0) 0x56335850e500 con 0x5633586d7000 2024-04-25T10:01:55.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.296+0000 7f788a60c740 20 datascan.scan_links: injected ino detected 2024-04-25T10:01:55.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.296+0000 7f788a60c740 -1 datascan.scan_links: Bad nlink on 0x10000000001 expected 2 has 1 2024-04-25T10:01:55.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.296+0000 7f788a60c740 20 datascan.scan_links: adding 0x10000000001 for future processing to fix dnfirst 2024-04-25T10:01:55.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.296+0000 7f788a60c740 10 datascan.scan_links: step 2: handling object 600.00000000 2024-04-25T10:01:55.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.296+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:82 13.10 13:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b32000 con 0x5633586d7000 2024-04-25T10:01:55.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.296+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.1 v2:172.21.15.7:6816/434435857 17 ==== osd_op_reply(82 600.00000000 [omap-get-vals out=5b] v0'0 uv12 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56335850e500 con 0x5633586d7000 2024-04-25T10:01:55.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.296+0000 7f788a60c740 10 datascan.scan_links: step 2: handling object 603.00000000 2024-04-25T10:01:55.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.296+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:83 13.10 13:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b0dc00 con 0x5633586d7000 2024-04-25T10:01:55.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.297+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.1 v2:172.21.15.7:6816/434435857 18 ==== osd_op_reply(83 603.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56335850e500 con 0x5633586d7000 2024-04-25T10:01:55.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.297+0000 7f788a60c740 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2024-04-25T10:01:55.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.297+0000 7f788a60c740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-25T10:01:55.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.297+0000 7f788a60c740 10 datascan.scan_links: step 2: handling object 200.00000000 2024-04-25T10:01:55.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.297+0000 7f788a60c740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-25T10:01:55.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.297+0000 7f788a60c740 10 datascan.scan_links: step 2: handling object 200.00000001 2024-04-25T10:01:55.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.297+0000 7f788a60c740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-25T10:01:55.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.297+0000 7f788a60c740 10 datascan.scan_links: step 2: handling object 606.00000000 2024-04-25T10:01:55.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.297+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:84 13.14 13:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b0d800 con 0x563358575000 2024-04-25T10:01:55.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.297+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.0 v2:172.21.15.7:6800/4167741236 8 ==== osd_op_reply(84 606.00000000 [omap-get-vals out=5b] v0'0 uv26 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56335850e500 con 0x563358575000 2024-04-25T10:01:55.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.297+0000 7f788a60c740 10 datascan.scan_links: step 2: handling object 607.00000000 2024-04-25T10:01:55.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.297+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:85 13.1c 13:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b0d400 con 0x563357b0c000 2024-04-25T10:01:55.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.297+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.6 v2:172.21.15.55:6824/4293769515 13 ==== osd_op_reply(85 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56335850e000 con 0x563357b0c000 2024-04-25T10:01:55.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.297+0000 7f788a60c740 10 datascan.scan_links: step 2: handling object 100000001f6.00000000 2024-04-25T10:01:55.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.297+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:86 13.a 13:57fe7535:::100000001f6.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b0d000 con 0x563358575400 2024-04-25T10:01:55.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.298+0000 7f788820f640 1 -- 172.21.15.7:0/1176717349 <== osd.2 v2:172.21.15.7:6808/1173474863 6 ==== osd_op_reply(86 100000001f6.00000000 [omap-get-vals out=54b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+54 (crc 0 0 0) 0x56335850e780 con 0x563358575400 2024-04-25T10:01:55.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.298+0000 7f788a60c740 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2024-04-25T10:01:55.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.298+0000 7f788a60c740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-25T10:01:55.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.298+0000 7f788a60c740 10 datascan.scan_links: step 2: handling object 608.00000000 2024-04-25T10:01:55.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.298+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:87 13.e 13:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b0cc00 con 0x5633586d6c00 2024-04-25T10:01:55.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.298+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.7 v2:172.21.15.55:6816/2960381217 17 ==== osd_op_reply(87 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56335850e000 con 0x5633586d6c00 2024-04-25T10:01:55.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.298+0000 7f788a60c740 10 datascan.scan_links: step 2: handling object 604.00000000 2024-04-25T10:01:55.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.298+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:88 13.15 13:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b32400 con 0x563358574800 2024-04-25T10:01:55.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.298+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.4 v2:172.21.15.55:6808/2248155105 14 ==== osd_op_reply(88 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56335850e000 con 0x563358574800 2024-04-25T10:01:55.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.299+0000 7f788a60c740 10 datascan.scan_links: step 2: handling object 500.00000000 2024-04-25T10:01:55.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.299+0000 7f788a60c740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-25T10:01:55.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.299+0000 7f788a60c740 10 datascan.scan_links: step 2: handling object mds_snaptable 2024-04-25T10:01:55.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.299+0000 7f788a60c740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-25T10:01:55.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.299+0000 7f788a60c740 10 datascan.scan_links: step 2: handling object 605.00000000 2024-04-25T10:01:55.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.299+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b32800 con 0x5633586d6c00 2024-04-25T10:01:55.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.299+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.7 v2:172.21.15.55:6816/2960381217 18 ==== osd_op_reply(89 605.00000000 [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56335850e000 con 0x5633586d6c00 2024-04-25T10:01:55.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.299+0000 7f788a60c740 10 datascan.scan_links: step 2: handling object mds0_inotable 2024-04-25T10:01:55.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.299+0000 7f788a60c740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-25T10:01:55.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.299+0000 7f788a60c740 10 datascan.scan_links: step 2: handling object 100.00000000 2024-04-25T10:01:55.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.299+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:90 13.13 13:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b32c00 con 0x5633586d6c00 2024-04-25T10:01:55.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.299+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.7 v2:172.21.15.55:6816/2960381217 19 ==== osd_op_reply(90 100.00000000 [omap-get-vals out=5195b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x56335850e000 con 0x5633586d6c00 2024-04-25T10:01:55.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.299+0000 7f788a60c740 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2024-04-25T10:01:55.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.299+0000 7f788a60c740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-25T10:01:55.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.299+0000 7f788a60c740 10 datascan.scan_links: step 2: handling object 200.00000002 2024-04-25T10:01:55.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.299+0000 7f788a60c740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000002' 2024-04-25T10:01:55.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.299+0000 7f788a60c740 10 datascan.scan_links: step 2: handling object 609.00000000 2024-04-25T10:01:55.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.299+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:91 13.7 13:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b33400 con 0x5633586d6c00 2024-04-25T10:01:55.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.300+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.7 v2:172.21.15.55:6816/2960381217 20 ==== osd_op_reply(91 609.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56335850e000 con 0x5633586d6c00 2024-04-25T10:01:55.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.300+0000 7f788a60c740 10 datascan.scan_links: step 2: handling object 400.00000000 2024-04-25T10:01:55.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.300+0000 7f788a60c740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-25T10:01:55.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.300+0000 7f788a60c740 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2024-04-25T10:01:55.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.300+0000 7f788a60c740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-25T10:01:55.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.300+0000 7f788a60c740 10 datascan.scan_links: step 2: handling object 1.00000000 2024-04-25T10:01:55.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.300+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:92 13.1f 13:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b32000 con 0x563357b0c000 2024-04-25T10:01:55.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.300+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.6 v2:172.21.15.55:6824/4293769515 14 ==== osd_op_reply(92 1.00000000 [omap-get-vals out=1163b] v0'0 uv9 ondisk = 0) v8 ==== 154+0+1163 (crc 0 0 0) 0x56335850e000 con 0x563357b0c000 2024-04-25T10:01:55.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.300+0000 7f788a60c740 10 datascan.scan_links: processing 0 dup_primaries, 1 remote_links 2024-04-25T10:01:55.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.300+0000 7f788a60c740 10 datascan.scan_links: removing dup dentries from 0 objects 2024-04-25T10:01:55.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.300+0000 7f788a60c740 10 datascan.scan_links: processing 1 bad_nlink_inos 2024-04-25T10:01:55.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.300+0000 7f788a60c740 10 datascan.scan_links: handling bad_nlink_ino 0x10000000001 2024-04-25T10:01:55.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.300+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:93 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b0c800 con 0x5633586d7000 2024-04-25T10:01:55.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.300+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.1 v2:172.21.15.7:6816/434435857 19 ==== osd_op_reply(93 10000000000.00000000 [omap-get-vals-by-keys out=505b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+505 (crc 0 0 0) 0x56335850e500 con 0x5633586d7000 2024-04-25T10:01:55.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.301+0000 7f788a60c740 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-04-25T10:01:55.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.301+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:94 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b33800 con 0x5633586d7000 2024-04-25T10:01:55.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.302+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.1 v2:172.21.15.7:6816/434435857 20 ==== osd_op_reply(94 10000000000.00000000 [omap-set-vals] v92'19 uv19 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56335850e500 con 0x5633586d7000 2024-04-25T10:01:55.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.302+0000 7f788a60c740 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-04-25T10:01:55.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.302+0000 7f788a60c740 10 datascan.scan_links: processing 1 injected_inos 2024-04-25T10:01:55.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.302+0000 7f788a60c740 10 datascan.scan_links: handling injected_ino 0x10000000001 2024-04-25T10:01:55.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.302+0000 7f788a60c740 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:file 2024-04-25T10:01:55.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.302+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:95 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b33c00 con 0x5633586d7000 2024-04-25T10:01:55.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.302+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.1 v2:172.21.15.7:6816/434435857 21 ==== osd_op_reply(95 10000000000.00000000 [omap-get-vals-by-keys out=505b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+505 (crc 0 0 0) 0x56335850e500 con 0x5633586d7000 2024-04-25T10:01:55.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.302+0000 7f788a60c740 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-04-25T10:01:55.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.302+0000 7f788a60c740 20 datascan.scan_links: first is now 2 2024-04-25T10:01:55.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.302+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:96 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b32400 con 0x5633586d7000 2024-04-25T10:01:55.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.303+0000 7f7888a10640 1 -- 172.21.15.7:0/1176717349 <== osd.1 v2:172.21.15.7:6816/434435857 22 ==== osd_op_reply(96 10000000000.00000000 [omap-set-vals] v92'20 uv20 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56335850e500 con 0x5633586d7000 2024-04-25T10:01:55.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.303+0000 7f788a60c740 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-04-25T10:01:55.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.303+0000 7f788a60c740 10 datascan.scan_links: updating inotable 2024-04-25T10:01:55.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.303+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:97 13.13 13:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b32800 con 0x5633586d6c00 2024-04-25T10:01:55.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.304+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.7 v2:172.21.15.55:6816/2960381217 21 ==== osd_op_reply(97 mds0_inotable [read 0~50 out=50b] v0'0 uv3 ondisk = 0) v8 ==== 157+0+50 (crc 0 0 0) 0x56335850e000 con 0x5633586d6c00 2024-04-25T10:01:55.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.304+0000 7f788a60c740 10 mds.0.inotable: skip_inos was [0x10000000002~0x1f4,0x100000001f7~0xfffffffe09] 2024-04-25T10:01:55.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.304+0000 7f788a60c740 10 mds.0.inotable: skip_inos now [0x100000001f7~0xfffffffe09] 2024-04-25T10:01:55.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.304+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:98 13.13 13:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b0d400 con 0x5633586d6c00 2024-04-25T10:01:55.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.305+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.7 v2:172.21.15.55:6816/2960381217 22 ==== osd_op_reply(98 mds0_inotable [writefull 0~34] v92'5 uv5 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x56335850e000 con 0x5633586d6c00 2024-04-25T10:01:55.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.305+0000 7f788a60c740 10 datascan.scan_links: updating snaptable 2024-04-25T10:01:55.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.305+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:99 13.d 13:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92) v9 -- 0x563357b0cc00 con 0x563358574800 2024-04-25T10:01:55.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.305+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 <== osd.4 v2:172.21.15.55:6808/2248155105 15 ==== osd_op_reply(99 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) v8 ==== 157+0+70 (crc 0 0 0) 0x56335850e000 con 0x563358574800 2024-04-25T10:01:55.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.305+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x563358575000 msgr2=0x563357b03080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.305+0000 7f788a60c740 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x563358575000 0x563357b03080 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.305+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x5633586d7000 msgr2=0x563357b02000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.305+0000 7f788a60c740 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x5633586d7000 0x563357b02000 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.305+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x563358575400 msgr2=0x563357b02580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.305+0000 7f788a60c740 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x563358575400 0x563357b02580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.305+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x563357b0c400 msgr2=0x563357b03b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.305+0000 7f788a60c740 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x563357b0c400 0x563357b03b80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.305+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 reap_dead start 2024-04-25T10:01:55.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.305+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x563358574800 msgr2=0x563357b04680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.305+0000 7f788a60c740 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x563358574800 0x563357b04680 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.305+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 reap_dead start 2024-04-25T10:01:55.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.305+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x563358574c00 msgr2=0x563357b03600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.305+0000 7f788a60c740 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x563358574c00 0x563357b03600 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.305+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x563357b0c000 msgr2=0x563357b02b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.305+0000 7f788a60c740 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x563357b0c000 0x563357b02b00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.305+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x5633586d6c00 msgr2=0x563357800100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.305+0000 7f788a60c740 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x5633586d6c00 0x563357800100 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.305+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x5633586d6800 msgr2=0x563357801700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.305+0000 7f788a60c740 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x5633586d6800 0x563357801700 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x5633586703f0 tx=0x563358512a80 comp rx=0 tx=0).stop 2024-04-25T10:01:55.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.305+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563358659000 msgr2=0x563357801180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.305+0000 7f788a60c740 1 --2- 172.21.15.7:0/1176717349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563358659000 0x563357801180 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x563358671e90 tx=0x56335867ac00 comp rx=0 tx=0).stop 2024-04-25T10:01:55.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.306+0000 7f7887a0e640 1 -- 172.21.15.7:0/1176717349 reap_dead start 2024-04-25T10:01:55.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.306+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 shutdown_connections 2024-04-25T10:01:55.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.306+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 >> 172.21.15.7:0/1176717349 conn(0x563358658c00 msgr2=0x563357889000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:55.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.306+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 shutdown_connections 2024-04-25T10:01:55.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.306+0000 7f788a60c740 1 -- 172.21.15.7:0/1176717349 wait complete. 2024-04-25T10:01:55.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.306+0000 7f788a60c740 1 -- 172.21.15.7:0/3477758273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56335778ec00 msgr2=0x5633577fe580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.306+0000 7f788a60c740 1 --2- 172.21.15.7:0/3477758273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56335778ec00 0x5633577fe580 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x5633585a7c80 tx=0x563357902240 comp rx=0 tx=0).stop 2024-04-25T10:01:55.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.306+0000 7f788a60c740 1 -- 172.21.15.7:0/3477758273 shutdown_connections 2024-04-25T10:01:55.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.306+0000 7f788a60c740 1 --2- 172.21.15.7:0/3477758273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56335778fc00 0x5633577ff080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.306+0000 7f788a60c740 1 --2- 172.21.15.7:0/3477758273 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56335778f800 0x5633577feb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.306+0000 7f788a60c740 1 --2- 172.21.15.7:0/3477758273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56335778ec00 0x5633577fe580 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.306+0000 7f788a60c740 1 -- 172.21.15.7:0/3477758273 >> 172.21.15.7:0/3477758273 conn(0x56335778f000 msgr2=0x563357888800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:55.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.306+0000 7f788a60c740 1 -- 172.21.15.7:0/3477758273 shutdown_connections 2024-04-25T10:01:55.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.306+0000 7f788a60c740 1 -- 172.21.15.7:0/3477758273 wait complete. 2024-04-25T10:01:55.328 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.134799, result: 2024-04-25T10:01:55.328 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T10:01:55.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.463+0000 7fe28595c640 1 Processor -- start 2024-04-25T10:01:55.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.463+0000 7fe28595c640 1 -- start start 2024-04-25T10:01:55.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.464+0000 7fe28595c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe2800d0780 0x7fe2800d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.464+0000 7fe28595c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe2800b9130 0x7fe2800d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.464+0000 7fe28595c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2800d10a0 con 0x7fe2800b9590 2024-04-25T10:01:55.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.464+0000 7fe28595c640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2800b7ef0 con 0x7fe2800d0780 2024-04-25T10:01:55.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.464+0000 7fe28595c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2800b81d0 con 0x7fe2800b9130 2024-04-25T10:01:55.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.464+0000 7fe27effd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe2800d0780 0x7fe2800d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.464+0000 7fe27effd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe2800d0780 0x7fe2800d0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44880/0 (socket says 172.21.15.7:44880) 2024-04-25T10:01:55.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.464+0000 7fe27effd640 1 -- 172.21.15.7:0/1718160745 learned_addr learned my addr 172.21.15.7:0/1718160745 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:55.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.464+0000 7fe27e7fc640 1 --2- 172.21.15.7:0/1718160745 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe2800b9130 0x7fe2800d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.464+0000 7fe27effd640 1 -- 172.21.15.7:0/1718160745 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe2800b9130 msgr2=0x7fe2800d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:55.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.464+0000 7fe27effd640 1 --2- 172.21.15.7:0/1718160745 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe2800b9130 0x7fe2800d1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.464+0000 7fe27effd640 1 -- 172.21.15.7:0/1718160745 >> v1:172.21.15.55:6789/0 conn(0x7fe2800b9590 legacy=0x7fe2800d2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.464+0000 7fe27effd640 1 -- 172.21.15.7:0/1718160745 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2800b84b0 con 0x7fe2800d0780 2024-04-25T10:01:55.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.464+0000 7fe27e7fc640 1 --2- 172.21.15.7:0/1718160745 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe2800b9130 0x7fe2800d1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:01:55.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.465+0000 7fe27effd640 1 --2- 172.21.15.7:0/1718160745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2800d0780 0x7fe2800d0b60 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fe278009870 tx=0x7fe27802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6739ea1a79c2d4b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.465+0000 7fe27dffb640 1 -- 172.21.15.7:0/1718160745 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe278037070 con 0x7fe2800d0780 2024-04-25T10:01:55.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.465+0000 7fe27dffb640 1 -- 172.21.15.7:0/1718160745 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe278032440 con 0x7fe2800d0780 2024-04-25T10:01:55.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.465+0000 7fe27dffb640 1 -- 172.21.15.7:0/1718160745 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe278032810 con 0x7fe2800d0780 2024-04-25T10:01:55.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.466+0000 7fe28595c640 1 -- 172.21.15.7:0/1718160745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2800d0780 msgr2=0x7fe2800d0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.466+0000 7fe28595c640 1 --2- 172.21.15.7:0/1718160745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2800d0780 0x7fe2800d0b60 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fe278009870 tx=0x7fe27802a270 comp rx=0 tx=0).stop 2024-04-25T10:01:55.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.466+0000 7fe28595c640 1 -- 172.21.15.7:0/1718160745 shutdown_connections 2024-04-25T10:01:55.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.466+0000 7fe28595c640 1 --2- 172.21.15.7:0/1718160745 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe2800b9130 0x7fe2800d1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.466+0000 7fe28595c640 1 --2- 172.21.15.7:0/1718160745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2800d0780 0x7fe2800d0b60 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.466+0000 7fe28595c640 1 -- 172.21.15.7:0/1718160745 >> 172.21.15.7:0/1718160745 conn(0x7fe2800726b0 msgr2=0x7fe280072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:55.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.466+0000 7fe28595c640 1 -- 172.21.15.7:0/1718160745 shutdown_connections 2024-04-25T10:01:55.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.466+0000 7fe28595c640 1 -- 172.21.15.7:0/1718160745 wait complete. 2024-04-25T10:01:55.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.467+0000 7fe28595c640 1 Processor -- start 2024-04-25T10:01:55.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.467+0000 7fe28595c640 1 -- start start 2024-04-25T10:01:55.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.468+0000 7fe28595c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2800b9130 0x7fe2800d3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.468+0000 7fe28595c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2800b9590 0x7fe280146700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.468+0000 7fe28595c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe2800d0780 0x7fe2800b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.468+0000 7fe28595c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2801611b0 con 0x7fe2800b9130 2024-04-25T10:01:55.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.468+0000 7fe28595c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2800b8a70 con 0x7fe2800b9590 2024-04-25T10:01:55.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.468+0000 7fe28595c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe280161330 con 0x7fe2800d0780 2024-04-25T10:01:55.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.468+0000 7fe27effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2800b9130 0x7fe2800d3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.468+0000 7fe27effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2800b9130 0x7fe2800d3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44888/0 (socket says 172.21.15.7:44888) 2024-04-25T10:01:55.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.468+0000 7fe27effd640 1 -- 172.21.15.7:0/4288363318 learned_addr learned my addr 172.21.15.7:0/4288363318 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:55.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.468+0000 7fe27effd640 1 -- 172.21.15.7:0/4288363318 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe2800d0780 msgr2=0x7fe2800b7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.468+0000 7fe27effd640 1 --2- 172.21.15.7:0/4288363318 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe2800d0780 0x7fe2800b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.468+0000 7fe27effd640 1 -- 172.21.15.7:0/4288363318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2800b9590 msgr2=0x7fe280146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.468+0000 7fe27effd640 1 --2- 172.21.15.7:0/4288363318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2800b9590 0x7fe280146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.468+0000 7fe27effd640 1 -- 172.21.15.7:0/4288363318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2801f3aa0 con 0x7fe2800b9130 2024-04-25T10:01:55.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.468+0000 7fe27effd640 1 --2- 172.21.15.7:0/4288363318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2800b9130 0x7fe2800d3590 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fe278000c00 tx=0x7fe2780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.468+0000 7fe277fff640 1 -- 172.21.15.7:0/4288363318 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe278041020 con 0x7fe2800b9130 2024-04-25T10:01:55.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.469+0000 7fe277fff640 1 -- 172.21.15.7:0/4288363318 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2780306c0 con 0x7fe2800b9130 2024-04-25T10:01:55.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.469+0000 7fe28595c640 1 -- 172.21.15.7:0/4288363318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2800ccab0 con 0x7fe2800b9130 2024-04-25T10:01:55.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.469+0000 7fe277fff640 1 -- 172.21.15.7:0/4288363318 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe278037040 con 0x7fe2800b9130 2024-04-25T10:01:55.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.469+0000 7fe28595c640 1 -- 172.21.15.7:0/4288363318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2800cd070 con 0x7fe2800b9130 2024-04-25T10:01:55.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.469+0000 7fe28595c640 1 -- 172.21.15.7:0/4288363318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2800685d0 con 0x7fe2800b9130 2024-04-25T10:01:55.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.470+0000 7fe277fff640 1 -- 172.21.15.7:0/4288363318 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe278044020 con 0x7fe2800b9130 2024-04-25T10:01:55.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.470+0000 7fe277fff640 1 --2- 172.21.15.7:0/4288363318 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe26006b4d0 0x7fe26006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:55.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.470+0000 7fe277fff640 1 -- 172.21.15.7:0/4288363318 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fe2780aabd0 con 0x7fe2800b9130 2024-04-25T10:01:55.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.470+0000 7fe27e7fc640 1 --2- 172.21.15.7:0/4288363318 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe26006b4d0 0x7fe26006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:55.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.471+0000 7fe27e7fc640 1 --2- 172.21.15.7:0/4288363318 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe26006b4d0 0x7fe26006d990 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe268006fd0 tx=0x7fe268008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:55.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.474+0000 7fe277fff640 1 -- 172.21.15.7:0/4288363318 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe27804b030 con 0x7fe2800b9130 2024-04-25T10:01:55.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.697+0000 7fe28595c640 1 -- 172.21.15.7:0/4288363318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fe2800b5750 con 0x7fe2800b9130 2024-04-25T10:01:55.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.934+0000 7fe277fff640 1 -- 172.21.15.7:0/4288363318 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v62) v1 ==== 162+0+0 (secure 0 0 0) 0x7fe278079830 con 0x7fe2800b9130 2024-04-25T10:01:55.939 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T10:01:55.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.936+0000 7fe28595c640 1 -- 172.21.15.7:0/4288363318 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe26006b4d0 msgr2=0x7fe26006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.936+0000 7fe28595c640 1 --2- 172.21.15.7:0/4288363318 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe26006b4d0 0x7fe26006d990 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe268006fd0 tx=0x7fe268008040 comp rx=0 tx=0).stop 2024-04-25T10:01:55.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.936+0000 7fe28595c640 1 -- 172.21.15.7:0/4288363318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2800b9130 msgr2=0x7fe2800d3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:55.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.936+0000 7fe28595c640 1 --2- 172.21.15.7:0/4288363318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2800b9130 0x7fe2800d3590 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fe278000c00 tx=0x7fe2780046c0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.936+0000 7fe28595c640 1 -- 172.21.15.7:0/4288363318 shutdown_connections 2024-04-25T10:01:55.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.936+0000 7fe28595c640 1 --2- 172.21.15.7:0/4288363318 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe26006b4d0 0x7fe26006d990 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.936+0000 7fe28595c640 1 --2- 172.21.15.7:0/4288363318 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe2800d0780 0x7fe2800b7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.936+0000 7fe28595c640 1 --2- 172.21.15.7:0/4288363318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2800b9590 0x7fe280146700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.936+0000 7fe28595c640 1 --2- 172.21.15.7:0/4288363318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2800b9130 0x7fe2800d3590 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:55.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.936+0000 7fe28595c640 1 -- 172.21.15.7:0/4288363318 >> 172.21.15.7:0/4288363318 conn(0x7fe2800726b0 msgr2=0x7fe2800cde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:55.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.936+0000 7fe28595c640 1 -- 172.21.15.7:0/4288363318 shutdown_connections 2024-04-25T10:01:55.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:55.937+0000 7fe28595c640 1 -- 172.21.15.7:0/4288363318 wait complete. 2024-04-25T10:01:55.955 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:01:56.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.051+0000 7ffb0f5d5640 1 Processor -- start 2024-04-25T10:01:56.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.051+0000 7ffb0f5d5640 1 -- start start 2024-04-25T10:01:56.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.052+0000 7ffb0f5d5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffb0815d920 0x7ffb08161630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:56.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.052+0000 7ffb0f5d5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffb080b9250 0x7ffb080ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:56.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.052+0000 7ffb0f5d5640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffb0815dd00 0x7ffb080ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:56.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.052+0000 7ffb0f5d5640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb080d1de0 con 0x7ffb0815dd00 2024-04-25T10:01:56.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.052+0000 7ffb0f5d5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb08162560 con 0x7ffb0815d920 2024-04-25T10:01:56.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.052+0000 7ffb0f5d5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb08161fa0 con 0x7ffb080b9250 2024-04-25T10:01:56.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.052+0000 7ffb0db72640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffb0815dd00 0x7ffb080ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:56.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.052+0000 7ffb0db72640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffb0815dd00 0x7ffb080ceb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44902/0 (socket says 172.21.15.7:44902) 2024-04-25T10:01:56.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.052+0000 7ffb0db72640 1 -- 172.21.15.7:0/2525972270 learned_addr learned my addr 172.21.15.7:0/2525972270 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:56.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.052+0000 7ffb0db72640 1 -- 172.21.15.7:0/2525972270 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffb080b9250 msgr2=0x7ffb080ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:56.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.052+0000 7ffb0db72640 1 --2- 172.21.15.7:0/2525972270 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffb080b9250 0x7ffb080ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:56.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.052+0000 7ffb0db72640 1 -- 172.21.15.7:0/2525972270 >> v2:172.21.15.55:3300/0 conn(0x7ffb0815d920 msgr2=0x7ffb08161630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:56.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.052+0000 7ffb0db72640 1 --2- 172.21.15.7:0/2525972270 >> v2:172.21.15.55:3300/0 conn(0x7ffb0815d920 0x7ffb08161630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:56.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.052+0000 7ffb0db72640 1 -- 172.21.15.7:0/2525972270 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb08162280 con 0x7ffb0815dd00 2024-04-25T10:01:56.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.053+0000 7ffb0db72640 1 --2- 172.21.15.7:0/2525972270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb0815dd00 0x7ffb080ceb60 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7ffb0806da30 tx=0x7ffb0002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d9a82b11f9ebad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:56.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.053+0000 7ffafffff640 1 -- 172.21.15.7:0/2525972270 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb00036070 con 0x7ffb0815dd00 2024-04-25T10:01:56.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.053+0000 7ffafffff640 1 -- 172.21.15.7:0/2525972270 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb00031600 con 0x7ffb0815dd00 2024-04-25T10:01:56.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.053+0000 7ffafffff640 1 -- 172.21.15.7:0/2525972270 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb000319d0 con 0x7ffb0815dd00 2024-04-25T10:01:56.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.053+0000 7ffb0f5d5640 1 -- 172.21.15.7:0/2525972270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb0815dd00 msgr2=0x7ffb080ceb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:56.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.053+0000 7ffb0f5d5640 1 --2- 172.21.15.7:0/2525972270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb0815dd00 0x7ffb080ceb60 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7ffb0806da30 tx=0x7ffb0002a610 comp rx=0 tx=0).stop 2024-04-25T10:01:56.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.054+0000 7ffb0f5d5640 1 -- 172.21.15.7:0/2525972270 shutdown_connections 2024-04-25T10:01:56.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.054+0000 7ffb0f5d5640 1 --2- 172.21.15.7:0/2525972270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb0815dd00 0x7ffb080ceb60 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:56.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.054+0000 7ffb0f5d5640 1 --2- 172.21.15.7:0/2525972270 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffb080b9250 0x7ffb080ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:56.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.054+0000 7ffb0f5d5640 1 --2- 172.21.15.7:0/2525972270 >> v2:172.21.15.55:3300/0 conn(0x7ffb0815d920 0x7ffb08161630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:56.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.054+0000 7ffb0f5d5640 1 -- 172.21.15.7:0/2525972270 >> 172.21.15.7:0/2525972270 conn(0x7ffb0806bfe0 msgr2=0x7ffb0806c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:56.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.054+0000 7ffb0f5d5640 1 -- 172.21.15.7:0/2525972270 shutdown_connections 2024-04-25T10:01:56.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.054+0000 7ffb0f5d5640 1 -- 172.21.15.7:0/2525972270 wait complete. 2024-04-25T10:01:56.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.055+0000 7ffb0f5d5640 1 Processor -- start 2024-04-25T10:01:56.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.055+0000 7ffb0f5d5640 1 -- start start 2024-04-25T10:01:56.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.056+0000 7ffb0f5d5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb080b9250 0x7ffb0815f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:56.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.056+0000 7ffb0f5d5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffb0815d920 0x7ffb0815f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:56.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.056+0000 7ffb0f5d5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0815dd00 0x7ffb0815fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:56.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.056+0000 7ffb0f5d5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb08161cf0 con 0x7ffb080b9250 2024-04-25T10:01:56.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.056+0000 7ffb0f5d5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb08161b70 con 0x7ffb0815dd00 2024-04-25T10:01:56.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.056+0000 7ffb0f5d5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb080b52d0 con 0x7ffb0815d920 2024-04-25T10:01:56.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.056+0000 7ffb0d371640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb080b9250 0x7ffb0815f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:56.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.056+0000 7ffb0d371640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb080b9250 0x7ffb0815f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44908/0 (socket says 172.21.15.7:44908) 2024-04-25T10:01:56.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.056+0000 7ffb0d371640 1 -- 172.21.15.7:0/2152018140 learned_addr learned my addr 172.21.15.7:0/2152018140 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:56.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.056+0000 7ffb0d371640 1 -- 172.21.15.7:0/2152018140 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffb0815d920 msgr2=0x7ffb0815f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:56.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.056+0000 7ffb0d371640 1 --2- 172.21.15.7:0/2152018140 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffb0815d920 0x7ffb0815f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:56.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.056+0000 7ffb0d371640 1 -- 172.21.15.7:0/2152018140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0815dd00 msgr2=0x7ffb0815fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:56.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.056+0000 7ffb0d371640 1 --2- 172.21.15.7:0/2152018140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0815dd00 0x7ffb0815fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:56.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.056+0000 7ffb0d371640 1 -- 172.21.15.7:0/2152018140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb08152640 con 0x7ffb080b9250 2024-04-25T10:01:56.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.056+0000 7ffb0d371640 1 --2- 172.21.15.7:0/2152018140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb080b9250 0x7ffb0815f0e0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400b4a0 tx=0x7ffb0400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:56.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.056+0000 7ffafdffb640 1 -- 172.21.15.7:0/2152018140 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb04014070 con 0x7ffb080b9250 2024-04-25T10:01:56.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.056+0000 7ffafdffb640 1 -- 172.21.15.7:0/2152018140 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb04010610 con 0x7ffb080b9250 2024-04-25T10:01:56.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.056+0000 7ffb0f5d5640 1 -- 172.21.15.7:0/2152018140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb08159b50 con 0x7ffb080b9250 2024-04-25T10:01:56.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.056+0000 7ffafdffb640 1 -- 172.21.15.7:0/2152018140 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb04010a00 con 0x7ffb080b9250 2024-04-25T10:01:56.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.057+0000 7ffb0f5d5640 1 -- 172.21.15.7:0/2152018140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0815a110 con 0x7ffb080b9250 2024-04-25T10:01:56.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.058+0000 7ffb0f5d5640 1 -- 172.21.15.7:0/2152018140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb080c7100 con 0x7ffb080b9250 2024-04-25T10:01:56.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.058+0000 7ffafdffb640 1 -- 172.21.15.7:0/2152018140 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffb04017070 con 0x7ffb080b9250 2024-04-25T10:01:56.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.058+0000 7ffafdffb640 1 --2- 172.21.15.7:0/2152018140 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ffaec06b4d0 0x7ffaec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:56.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.058+0000 7ffafdffb640 1 -- 172.21.15.7:0/2152018140 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7ffb04089e60 con 0x7ffb080b9250 2024-04-25T10:01:56.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.058+0000 7ffb0cb70640 1 --2- 172.21.15.7:0/2152018140 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ffaec06b4d0 0x7ffaec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:56.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.059+0000 7ffb0cb70640 1 --2- 172.21.15.7:0/2152018140 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ffaec06b4d0 0x7ffaec06d990 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ffb080b9220 tx=0x7ffaf8006c90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:56.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.063+0000 7ffafdffb640 1 -- 172.21.15.7:0/2152018140 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffb04058ac0 con 0x7ffb080b9250 2024-04-25T10:01:56.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.279+0000 7ffb0f5d5640 1 -- 172.21.15.7:0/2152018140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb080d14f0 con 0x7ffb080b9250 2024-04-25T10:01:56.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.279+0000 7ffafdffb640 1 -- 172.21.15.7:0/2152018140 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4935 (secure 0 0 0) 0x7ffb040583c0 con 0x7ffb080b9250 2024-04-25T10:01:56.284 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:01:56.284 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":63,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2505539422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2505539422},{"type":"v1","addr":"172.21.15.55:6834","nonce":2505539422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2808857776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2808857776},{"type":"v1","addr":"172.21.15.55:6835","nonce":2808857776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7518,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1796103144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1796103144},{"type":"v1","addr":"172.21.15.7:6835","nonce":1796103144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:00:34.054759+0000","modified":"2024-04-25T10:01:55.937490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8022},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8022":{"gid":8022,"name":"a","rank":0,"incarnation":63,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6837/1061077733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1061077733},{"type":"v1","addr":"172.21.15.7:6837","nonce":1061077733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:01:56.284 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 63 2024-04-25T10:01:56.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.281+0000 7ffb0f5d5640 1 -- 172.21.15.7:0/2152018140 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ffaec06b4d0 msgr2=0x7ffaec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:56.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.281+0000 7ffb0f5d5640 1 --2- 172.21.15.7:0/2152018140 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ffaec06b4d0 0x7ffaec06d990 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ffb080b9220 tx=0x7ffaf8006c90 comp rx=0 tx=0).stop 2024-04-25T10:01:56.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.281+0000 7ffb0f5d5640 1 -- 172.21.15.7:0/2152018140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb080b9250 msgr2=0x7ffb0815f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:56.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.281+0000 7ffb0f5d5640 1 --2- 172.21.15.7:0/2152018140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb080b9250 0x7ffb0815f0e0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400b4a0 tx=0x7ffb0400b960 comp rx=0 tx=0).stop 2024-04-25T10:01:56.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.281+0000 7ffb0f5d5640 1 -- 172.21.15.7:0/2152018140 shutdown_connections 2024-04-25T10:01:56.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.281+0000 7ffb0f5d5640 1 --2- 172.21.15.7:0/2152018140 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ffaec06b4d0 0x7ffaec06d990 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:56.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.281+0000 7ffb0f5d5640 1 --2- 172.21.15.7:0/2152018140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb0815dd00 0x7ffb0815fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:56.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.281+0000 7ffb0f5d5640 1 --2- 172.21.15.7:0/2152018140 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffb0815d920 0x7ffb0815f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:56.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.281+0000 7ffb0f5d5640 1 --2- 172.21.15.7:0/2152018140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb080b9250 0x7ffb0815f0e0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:56.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.281+0000 7ffb0f5d5640 1 -- 172.21.15.7:0/2152018140 >> 172.21.15.7:0/2152018140 conn(0x7ffb0806bfe0 msgr2=0x7ffb0806c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:56.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.282+0000 7ffb0f5d5640 1 -- 172.21.15.7:0/2152018140 shutdown_connections 2024-04-25T10:01:56.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:56.282+0000 7ffb0f5d5640 1 -- 172.21.15.7:0/2152018140 wait complete. 2024-04-25T10:01:56.700 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 63, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:00:34.054759+0000', 'modified': '2024-04-25T10:01:55.937490+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 92, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8022}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8022': {'gid': 8022, 'name': 'a', 'rank': 0, 'incarnation': 63, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.7:6837/1061077733', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6836', 'nonce': 1061077733}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 1061077733}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:01:56.700 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8022:up:replay 2024-04-25T10:01:57.074 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:01:57.077 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:01:57.701 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:01:57.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.810+0000 7effb4316640 1 Processor -- start 2024-04-25T10:01:57.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.810+0000 7effb4316640 1 -- start start 2024-04-25T10:01:57.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.811+0000 7effb4316640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7effac06e970 0x7effac0cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:57.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.811+0000 7effb4316640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7effac0ced20 0x7effac15b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:57.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.811+0000 7effb4316640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effac0cdbf0 con 0x7effac144100 2024-04-25T10:01:57.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.811+0000 7effb4316640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effac1444e0 con 0x7effac06e970 2024-04-25T10:01:57.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.811+0000 7effb4316640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effac15ac70 con 0x7effac0ced20 2024-04-25T10:01:57.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.811+0000 7effb18b1640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7effac06e970 0x7effac0cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:57.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.811+0000 7effb18b1640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7effac06e970 0x7effac0cd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44916/0 (socket says 172.21.15.7:44916) 2024-04-25T10:01:57.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.811+0000 7effb18b1640 1 -- 172.21.15.7:0/197436367 learned_addr learned my addr 172.21.15.7:0/197436367 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:57.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.811+0000 7effb28b3640 1 --2- 172.21.15.7:0/197436367 >> v2:172.21.15.55:3300/0 conn(0x7effac0ced20 0x7effac15b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:57.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.811+0000 7effb18b1640 1 -- 172.21.15.7:0/197436367 >> v2:172.21.15.55:3300/0 conn(0x7effac0ced20 msgr2=0x7effac15b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:57.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.811+0000 7effb18b1640 1 --2- 172.21.15.7:0/197436367 >> v2:172.21.15.55:3300/0 conn(0x7effac0ced20 0x7effac15b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:57.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.811+0000 7effb18b1640 1 -- 172.21.15.7:0/197436367 >> v1:172.21.15.55:6789/0 conn(0x7effac144100 legacy=0x7effac06e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:01:57.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.811+0000 7effb18b1640 1 -- 172.21.15.7:0/197436367 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac0cded0 con 0x7effac06e970 2024-04-25T10:01:57.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.812+0000 7effb28b3640 1 --2- 172.21.15.7:0/197436367 >> v2:172.21.15.55:3300/0 conn(0x7effac0ced20 0x7effac15b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:01:57.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.812+0000 7effb18b1640 1 --2- 172.21.15.7:0/197436367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effac06e970 0x7effac0cd610 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7effac0710e0 tx=0x7effa002c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbbfeeba1ca79140 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:57.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.812+0000 7effb10b0640 1 -- 172.21.15.7:0/197436367 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa0032710 con 0x7effac06e970 2024-04-25T10:01:57.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.812+0000 7effb10b0640 1 -- 172.21.15.7:0/197436367 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa00328b0 con 0x7effac06e970 2024-04-25T10:01:57.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.812+0000 7effb10b0640 1 -- 172.21.15.7:0/197436367 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa0032ca0 con 0x7effac06e970 2024-04-25T10:01:57.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.813+0000 7effb4316640 1 -- 172.21.15.7:0/197436367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effac06e970 msgr2=0x7effac0cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:57.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.813+0000 7effb4316640 1 --2- 172.21.15.7:0/197436367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effac06e970 0x7effac0cd610 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7effac0710e0 tx=0x7effa002c850 comp rx=0 tx=0).stop 2024-04-25T10:01:57.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.813+0000 7effb4316640 1 -- 172.21.15.7:0/197436367 shutdown_connections 2024-04-25T10:01:57.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.813+0000 7effb4316640 1 --2- 172.21.15.7:0/197436367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effac06e970 0x7effac0cd610 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:57.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.813+0000 7effb4316640 1 --2- 172.21.15.7:0/197436367 >> v2:172.21.15.55:3300/0 conn(0x7effac0ced20 0x7effac15b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:57.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.813+0000 7effb4316640 1 -- 172.21.15.7:0/197436367 >> 172.21.15.7:0/197436367 conn(0x7effac071150 msgr2=0x7effac071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:57.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.813+0000 7effb4316640 1 -- 172.21.15.7:0/197436367 shutdown_connections 2024-04-25T10:01:57.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.813+0000 7effb4316640 1 -- 172.21.15.7:0/197436367 wait complete. 2024-04-25T10:01:57.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.814+0000 7effb4316640 1 Processor -- start 2024-04-25T10:01:57.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.814+0000 7effb4316640 1 -- start start 2024-04-25T10:01:57.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.815+0000 7effb4316640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7effac06e970 0x7effac137ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:57.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.815+0000 7effb4316640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effac0ced20 0x7effac1596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:57.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.815+0000 7effb4316640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effac144100 0x7effac13a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:57.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.815+0000 7effb4316640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac0cea00 con 0x7effac0ced20 2024-04-25T10:01:57.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.815+0000 7effb4316640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac0ce490 con 0x7effac144100 2024-04-25T10:01:57.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.815+0000 7effb4316640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effac15b670 con 0x7effac06e970 2024-04-25T10:01:57.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.815+0000 7effb18b1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effac0ced20 0x7effac1596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:57.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.815+0000 7effb18b1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effac0ced20 0x7effac1596a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44922/0 (socket says 172.21.15.7:44922) 2024-04-25T10:01:57.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.815+0000 7effb18b1640 1 -- 172.21.15.7:0/2745596364 learned_addr learned my addr 172.21.15.7:0/2745596364 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:57.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.815+0000 7effb28b3640 1 --2- 172.21.15.7:0/2745596364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effac144100 0x7effac13a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:57.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.815+0000 7effb20b2640 1 --2- 172.21.15.7:0/2745596364 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7effac06e970 0x7effac137ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:57.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.816+0000 7effb18b1640 1 -- 172.21.15.7:0/2745596364 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7effac06e970 msgr2=0x7effac137ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:57.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.816+0000 7effb18b1640 1 --2- 172.21.15.7:0/2745596364 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7effac06e970 0x7effac137ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:57.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.816+0000 7effb18b1640 1 -- 172.21.15.7:0/2745596364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effac144100 msgr2=0x7effac13a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:57.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.816+0000 7effb18b1640 1 --2- 172.21.15.7:0/2745596364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effac144100 0x7effac13a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:57.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.816+0000 7effb18b1640 1 -- 172.21.15.7:0/2745596364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac1385d0 con 0x7effac0ced20 2024-04-25T10:01:57.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.816+0000 7effb28b3640 1 --2- 172.21.15.7:0/2745596364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effac144100 0x7effac13a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:01:57.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.816+0000 7effb20b2640 1 --2- 172.21.15.7:0/2745596364 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7effac06e970 0x7effac137ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:01:57.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.816+0000 7effb18b1640 1 --2- 172.21.15.7:0/2745596364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effac0ced20 0x7effac1596a0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7effa002c890 tx=0x7effa00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:57.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.816+0000 7effaaffd640 1 -- 172.21.15.7:0/2745596364 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa0041020 con 0x7effac0ced20 2024-04-25T10:01:57.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.816+0000 7effaaffd640 1 -- 172.21.15.7:0/2745596364 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa0003850 con 0x7effac0ced20 2024-04-25T10:01:57.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.816+0000 7effb4316640 1 -- 172.21.15.7:0/2745596364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effac1388b0 con 0x7effac0ced20 2024-04-25T10:01:57.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.816+0000 7effaaffd640 1 -- 172.21.15.7:0/2745596364 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa0003c40 con 0x7effac0ced20 2024-04-25T10:01:57.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.816+0000 7effb4316640 1 -- 172.21.15.7:0/2745596364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effac138e70 con 0x7effac0ced20 2024-04-25T10:01:57.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.817+0000 7effb4316640 1 -- 172.21.15.7:0/2745596364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effac068fd0 con 0x7effac0ced20 2024-04-25T10:01:57.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.818+0000 7effaaffd640 1 -- 172.21.15.7:0/2745596364 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7effa0044020 con 0x7effac0ced20 2024-04-25T10:01:57.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.818+0000 7effaaffd640 1 --2- 172.21.15.7:0/2745596364 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7eff9806b4d0 0x7eff9806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:57.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.818+0000 7effaaffd640 1 -- 172.21.15.7:0/2745596364 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7effa00ab170 con 0x7effac0ced20 2024-04-25T10:01:57.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.818+0000 7effb20b2640 1 --2- 172.21.15.7:0/2745596364 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7eff9806b4d0 0x7eff9806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:57.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.819+0000 7effb20b2640 1 --2- 172.21.15.7:0/2745596364 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7eff9806b4d0 0x7eff9806d990 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7eff9c006fd0 tx=0x7eff9c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:57.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:57.822+0000 7effaaffd640 1 -- 172.21.15.7:0/2745596364 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7effa004b030 con 0x7effac0ced20 2024-04-25T10:01:58.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:58.044+0000 7effb4316640 1 -- 172.21.15.7:0/2745596364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7effac0b5080 con 0x7effac0ced20 2024-04-25T10:01:58.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:58.045+0000 7effaaffd640 1 -- 172.21.15.7:0/2745596364 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4935 (secure 0 0 0) 0x7effa0079cb0 con 0x7effac0ced20 2024-04-25T10:01:58.050 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:01:58.050 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":65,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2505539422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2505539422},{"type":"v1","addr":"172.21.15.55:6834","nonce":2505539422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2808857776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2808857776},{"type":"v1","addr":"172.21.15.55:6835","nonce":2808857776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7518,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1796103144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1796103144},{"type":"v1","addr":"172.21.15.7:6835","nonce":1796103144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:00:34.054759+0000","modified":"2024-04-25T10:01:56.947626+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8022},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8022":{"gid":8022,"name":"a","rank":0,"incarnation":63,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.7:6837/1061077733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1061077733},{"type":"v1","addr":"172.21.15.7:6837","nonce":1061077733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:01:58.050 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 65 2024-04-25T10:01:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:58.047+0000 7effb4316640 1 -- 172.21.15.7:0/2745596364 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7eff9806b4d0 msgr2=0x7eff9806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:58.047+0000 7effb4316640 1 --2- 172.21.15.7:0/2745596364 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7eff9806b4d0 0x7eff9806d990 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7eff9c006fd0 tx=0x7eff9c008040 comp rx=0 tx=0).stop 2024-04-25T10:01:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:58.047+0000 7effb4316640 1 -- 172.21.15.7:0/2745596364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effac0ced20 msgr2=0x7effac1596a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:58.047+0000 7effb4316640 1 --2- 172.21.15.7:0/2745596364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effac0ced20 0x7effac1596a0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7effa002c890 tx=0x7effa00046c0 comp rx=0 tx=0).stop 2024-04-25T10:01:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:58.047+0000 7effb4316640 1 -- 172.21.15.7:0/2745596364 shutdown_connections 2024-04-25T10:01:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:58.047+0000 7effb4316640 1 --2- 172.21.15.7:0/2745596364 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7eff9806b4d0 0x7eff9806d990 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:58.047+0000 7effb4316640 1 --2- 172.21.15.7:0/2745596364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effac144100 0x7effac13a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:58.047+0000 7effb4316640 1 --2- 172.21.15.7:0/2745596364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effac0ced20 0x7effac1596a0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:58.047+0000 7effb4316640 1 --2- 172.21.15.7:0/2745596364 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7effac06e970 0x7effac137ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:58.047+0000 7effb4316640 1 -- 172.21.15.7:0/2745596364 >> 172.21.15.7:0/2745596364 conn(0x7effac071150 msgr2=0x7effac0cc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:58.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:58.047+0000 7effb4316640 1 -- 172.21.15.7:0/2745596364 shutdown_connections 2024-04-25T10:01:58.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:58.047+0000 7effb4316640 1 -- 172.21.15.7:0/2745596364 wait complete. 2024-04-25T10:01:58.465 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 65, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:00:34.054759+0000', 'modified': '2024-04-25T10:01:56.947626+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 92, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8022}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8022': {'gid': 8022, 'name': 'a', 'rank': 0, 'incarnation': 63, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.7:6837/1061077733', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6836', 'nonce': 1061077733}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 1061077733}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:01:58.465 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8022:up:rejoin 2024-04-25T10:01:59.466 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:01:59.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.575+0000 7fca662fc640 1 Processor -- start 2024-04-25T10:01:59.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.575+0000 7fca662fc640 1 -- start start 2024-04-25T10:01:59.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.576+0000 7fca662fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fca6015dd00 0x7fca600b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:59.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.576+0000 7fca662fc640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca6006cd00 con 0x7fca6006c6c0 2024-04-25T10:01:59.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.576+0000 7fca662fc640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca600d1ca0 con 0x7fca600b6a40 2024-04-25T10:01:59.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.576+0000 7fca662fc640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca6015e0e0 con 0x7fca6015dd00 2024-04-25T10:01:59.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.576+0000 7fca64899640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fca6006c6c0 0x7fca600d2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38642/0 (socket says 172.21.15.7:38642) 2024-04-25T10:01:59.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.576+0000 7fca64899640 1 -- 172.21.15.7:0/1425619711 learned_addr learned my addr 172.21.15.7:0/1425619711 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:01:59.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.576+0000 7fca5ffff640 1 --2- 172.21.15.7:0/1425619711 >> v2:172.21.15.55:3300/0 conn(0x7fca6015dd00 0x7fca600b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:59.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.576+0000 7fca5effd640 1 -- 172.21.15.7:0/1425619711 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 818881779 0 0) 0x7fca6006cd00 con 0x7fca6006c6c0 2024-04-25T10:01:59.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.576+0000 7fca5effd640 1 -- 172.21.15.7:0/1425619711 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca4c003520 con 0x7fca6006c6c0 2024-04-25T10:01:59.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.577+0000 7fca5effd640 1 -- 172.21.15.7:0/1425619711 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3587809632 0 0) 0x7fca600d1ca0 con 0x7fca600b6a40 2024-04-25T10:01:59.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.577+0000 7fca5effd640 1 -- 172.21.15.7:0/1425619711 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca6006cd00 con 0x7fca600b6a40 2024-04-25T10:01:59.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.577+0000 7fca5effd640 1 -- 172.21.15.7:0/1425619711 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2821240312 0 0) 0x7fca4c003520 con 0x7fca6006c6c0 2024-04-25T10:01:59.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.577+0000 7fca5ffff640 1 -- 172.21.15.7:0/1425619711 >> v1:172.21.15.55:6789/0 conn(0x7fca600b6a40 legacy=0x7fca6006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:59.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.577+0000 7fca5ffff640 1 -- 172.21.15.7:0/1425619711 >> v1:172.21.15.7:6789/0 conn(0x7fca6006c6c0 legacy=0x7fca600d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:59.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.577+0000 7fca5ffff640 1 -- 172.21.15.7:0/1425619711 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca600d1f80 con 0x7fca6015dd00 2024-04-25T10:01:59.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.577+0000 7fca5ffff640 1 --2- 172.21.15.7:0/1425619711 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca6015dd00 0x7fca600b5750 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fca500097a0 tx=0x7fca5002a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7c74a513aa64bd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:59.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.578+0000 7fca5effd640 1 -- 172.21.15.7:0/1425619711 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca50037070 con 0x7fca6015dd00 2024-04-25T10:01:59.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.578+0000 7fca5effd640 1 -- 172.21.15.7:0/1425619711 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5002ace0 con 0x7fca6015dd00 2024-04-25T10:01:59.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.578+0000 7fca5effd640 1 -- 172.21.15.7:0/1425619711 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca580019f0 con 0x7fca6015dd00 2024-04-25T10:01:59.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.578+0000 7fca662fc640 1 -- 172.21.15.7:0/1425619711 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca6015dd00 msgr2=0x7fca600b5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:59.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.578+0000 7fca662fc640 1 --2- 172.21.15.7:0/1425619711 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca6015dd00 0x7fca600b5750 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fca500097a0 tx=0x7fca5002a250 comp rx=0 tx=0).stop 2024-04-25T10:01:59.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.578+0000 7fca662fc640 1 -- 172.21.15.7:0/1425619711 shutdown_connections 2024-04-25T10:01:59.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.578+0000 7fca662fc640 1 --2- 172.21.15.7:0/1425619711 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca6015dd00 0x7fca600b5750 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:59.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.578+0000 7fca662fc640 1 -- 172.21.15.7:0/1425619711 >> 172.21.15.7:0/1425619711 conn(0x7fca600d07b0 msgr2=0x7fca600d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:59.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.578+0000 7fca662fc640 1 -- 172.21.15.7:0/1425619711 shutdown_connections 2024-04-25T10:01:59.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.578+0000 7fca662fc640 1 -- 172.21.15.7:0/1425619711 wait complete. 2024-04-25T10:01:59.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.580+0000 7fca662fc640 1 Processor -- start 2024-04-25T10:01:59.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.580+0000 7fca662fc640 1 -- start start 2024-04-25T10:01:59.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.580+0000 7fca662fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca6006c6c0 0x7fca6014b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:59.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.580+0000 7fca662fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca600b6a40 0x7fca6014dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:59.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.581+0000 7fca662fc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fca6015dd00 0x7fca600b8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:59.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.581+0000 7fca662fc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca600b5c90 con 0x7fca6006c6c0 2024-04-25T10:01:59.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.581+0000 7fca662fc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6006cfe0 con 0x7fca600b6a40 2024-04-25T10:01:59.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.581+0000 7fca662fc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca600b5e10 con 0x7fca6015dd00 2024-04-25T10:01:59.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.581+0000 7fca5ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca6006c6c0 0x7fca6014b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:59.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.581+0000 7fca5ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca6006c6c0 0x7fca6014b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44928/0 (socket says 172.21.15.7:44928) 2024-04-25T10:01:59.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.581+0000 7fca5ffff640 1 -- 172.21.15.7:0/1125524586 learned_addr learned my addr 172.21.15.7:0/1125524586 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:01:59.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.581+0000 7fca5f7fe640 1 --2- 172.21.15.7:0/1125524586 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca600b6a40 0x7fca6014dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:59.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.581+0000 7fca5ffff640 1 -- 172.21.15.7:0/1125524586 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fca6015dd00 msgr2=0x7fca600b8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:59.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.581+0000 7fca64899640 1 --2- 172.21.15.7:0/1125524586 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fca6015dd00 0x7fca600b8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:59.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.581+0000 7fca5ffff640 1 --2- 172.21.15.7:0/1125524586 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fca6015dd00 0x7fca600b8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:59.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.581+0000 7fca5ffff640 1 -- 172.21.15.7:0/1125524586 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca600b6a40 msgr2=0x7fca6014dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:59.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.581+0000 7fca5ffff640 1 --2- 172.21.15.7:0/1125524586 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca600b6a40 0x7fca6014dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:59.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.581+0000 7fca5ffff640 1 -- 172.21.15.7:0/1125524586 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca600cb880 con 0x7fca6006c6c0 2024-04-25T10:01:59.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.581+0000 7fca5f7fe640 1 --2- 172.21.15.7:0/1125524586 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca600b6a40 0x7fca6014dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:01:59.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.581+0000 7fca64899640 1 --2- 172.21.15.7:0/1125524586 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fca6015dd00 0x7fca600b8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:01:59.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.581+0000 7fca5ffff640 1 --2- 172.21.15.7:0/1125524586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca6006c6c0 0x7fca6014b490 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fca50035040 tx=0x7fca500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:59.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.581+0000 7fca5cff9640 1 -- 172.21.15.7:0/1125524586 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca50041020 con 0x7fca6006c6c0 2024-04-25T10:01:59.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.581+0000 7fca5cff9640 1 -- 172.21.15.7:0/1125524586 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5003d620 con 0x7fca6006c6c0 2024-04-25T10:01:59.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.581+0000 7fca662fc640 1 -- 172.21.15.7:0/1125524586 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca600cbb60 con 0x7fca6006c6c0 2024-04-25T10:01:59.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.582+0000 7fca5cff9640 1 -- 172.21.15.7:0/1125524586 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca50037040 con 0x7fca6006c6c0 2024-04-25T10:01:59.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.582+0000 7fca662fc640 1 -- 172.21.15.7:0/1125524586 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca600cc8f0 con 0x7fca6006c6c0 2024-04-25T10:01:59.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.583+0000 7fca662fc640 1 -- 172.21.15.7:0/1125524586 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca60068fd0 con 0x7fca6006c6c0 2024-04-25T10:01:59.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.583+0000 7fca5cff9640 1 -- 172.21.15.7:0/1125524586 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fca50044020 con 0x7fca6006c6c0 2024-04-25T10:01:59.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.583+0000 7fca5cff9640 1 --2- 172.21.15.7:0/1125524586 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fca4006b4d0 0x7fca4006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:01:59.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.584+0000 7fca5cff9640 1 -- 172.21.15.7:0/1125524586 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fca500aa9c0 con 0x7fca6006c6c0 2024-04-25T10:01:59.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.584+0000 7fca5f7fe640 1 --2- 172.21.15.7:0/1125524586 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fca4006b4d0 0x7fca4006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:01:59.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.584+0000 7fca5f7fe640 1 --2- 172.21.15.7:0/1125524586 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fca4006b4d0 0x7fca4006d990 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fca60159980 tx=0x7fca48009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:01:59.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.588+0000 7fca5cff9640 1 -- 172.21.15.7:0/1125524586 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fca500ace20 con 0x7fca6006c6c0 2024-04-25T10:01:59.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.805+0000 7fca662fc640 1 -- 172.21.15.7:0/1125524586 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca600d1620 con 0x7fca6006c6c0 2024-04-25T10:01:59.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.806+0000 7fca5cff9640 1 -- 172.21.15.7:0/1125524586 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4935 (secure 0 0 0) 0x7fca5004b030 con 0x7fca6006c6c0 2024-04-25T10:01:59.814 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:01:59.815 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":66,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2505539422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2505539422},{"type":"v1","addr":"172.21.15.55:6834","nonce":2505539422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2808857776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2808857776},{"type":"v1","addr":"172.21.15.55:6835","nonce":2808857776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7518,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1796103144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1796103144},{"type":"v1","addr":"172.21.15.7:6835","nonce":1796103144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:00:34.054759+0000","modified":"2024-04-25T10:01:57.949246+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8022},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8022":{"gid":8022,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6837/1061077733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1061077733},{"type":"v1","addr":"172.21.15.7:6837","nonce":1061077733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:01:59.816 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 66 2024-04-25T10:01:59.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.808+0000 7fca662fc640 1 -- 172.21.15.7:0/1125524586 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fca4006b4d0 msgr2=0x7fca4006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:59.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.808+0000 7fca662fc640 1 --2- 172.21.15.7:0/1125524586 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fca4006b4d0 0x7fca4006d990 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fca60159980 tx=0x7fca48009040 comp rx=0 tx=0).stop 2024-04-25T10:01:59.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.808+0000 7fca662fc640 1 -- 172.21.15.7:0/1125524586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca6006c6c0 msgr2=0x7fca6014b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:01:59.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.808+0000 7fca662fc640 1 --2- 172.21.15.7:0/1125524586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca6006c6c0 0x7fca6014b490 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fca50035040 tx=0x7fca500046c0 comp rx=0 tx=0).stop 2024-04-25T10:01:59.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.808+0000 7fca662fc640 1 -- 172.21.15.7:0/1125524586 shutdown_connections 2024-04-25T10:01:59.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.808+0000 7fca662fc640 1 --2- 172.21.15.7:0/1125524586 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fca4006b4d0 0x7fca4006d990 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:59.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.808+0000 7fca662fc640 1 --2- 172.21.15.7:0/1125524586 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fca6015dd00 0x7fca600b8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:59.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.808+0000 7fca662fc640 1 --2- 172.21.15.7:0/1125524586 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca600b6a40 0x7fca6014dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:59.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.808+0000 7fca662fc640 1 --2- 172.21.15.7:0/1125524586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca6006c6c0 0x7fca6014b490 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:01:59.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.808+0000 7fca662fc640 1 -- 172.21.15.7:0/1125524586 >> 172.21.15.7:0/1125524586 conn(0x7fca600d07b0 msgr2=0x7fca600cf560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:01:59.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.808+0000 7fca662fc640 1 -- 172.21.15.7:0/1125524586 shutdown_connections 2024-04-25T10:01:59.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:01:59.808+0000 7fca662fc640 1 -- 172.21.15.7:0/1125524586 wait complete. 2024-04-25T10:02:00.226 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:00:34.054759+0000', 'modified': '2024-04-25T10:01:57.949246+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 92, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8022}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8022': {'gid': 8022, 'name': 'a', 'rank': 0, 'incarnation': 63, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.7:6837/1061077733', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6836', 'nonce': 1061077733}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 1061077733}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:02:00.226 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T10:02:00.227 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T10:02:00.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.325+0000 7fa801ab3640 1 Processor -- start 2024-04-25T10:02:00.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.325+0000 7fa801ab3640 1 -- start start 2024-04-25T10:02:00.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.325+0000 7fa801ab3640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa7fc15b8e0 0x7fa7fc0d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:00.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.325+0000 7fa801ab3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa7fc0cc300 0x7fa7fc0999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:00.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.325+0000 7fa801ab3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7fc09a340 con 0x7fa7fc099f30 2024-04-25T10:02:00.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.325+0000 7fa801ab3640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7fc0cd7d0 con 0x7fa7fc15b8e0 2024-04-25T10:02:00.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.325+0000 7fa801ab3640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc0ccbc0 con 0x7fa7fc0cc300 2024-04-25T10:02:00.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.326+0000 7fa7fb7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa7fc15b8e0 0x7fa7fc0d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:00.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.326+0000 7fa7fb7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa7fc15b8e0 0x7fa7fc0d0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35824/0 (socket says 172.21.15.7:35824) 2024-04-25T10:02:00.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.326+0000 7fa7fb7fe640 1 -- 172.21.15.7:0/1245173550 learned_addr learned my addr 172.21.15.7:0/1245173550 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:00.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.326+0000 7fa7faffd640 1 --2- 172.21.15.7:0/1245173550 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa7fc0cc300 0x7fa7fc0999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:00.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.326+0000 7fa7fb7fe640 1 -- 172.21.15.7:0/1245173550 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa7fc0cc300 msgr2=0x7fa7fc0999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:00.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.326+0000 7fa7fb7fe640 1 --2- 172.21.15.7:0/1245173550 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa7fc0cc300 0x7fa7fc0999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.326+0000 7fa7fb7fe640 1 -- 172.21.15.7:0/1245173550 >> v1:172.21.15.55:6789/0 conn(0x7fa7fc099f30 legacy=0x7fa7fc15f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:00.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.326+0000 7fa7fb7fe640 1 -- 172.21.15.7:0/1245173550 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7fc0ccea0 con 0x7fa7fc15b8e0 2024-04-25T10:02:00.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.326+0000 7fa7faffd640 1 --2- 172.21.15.7:0/1245173550 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa7fc0cc300 0x7fa7fc0999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:02:00.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.327+0000 7fa7fb7fe640 1 --2- 172.21.15.7:0/1245173550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7fc15b8e0 0x7fa7fc0d0330 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009870 tx=0x7fa7ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6fe82d6828c26c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:00.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.327+0000 7fa7fa7fc640 1 -- 172.21.15.7:0/1245173550 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec037070 con 0x7fa7fc15b8e0 2024-04-25T10:02:00.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.327+0000 7fa7fa7fc640 1 -- 172.21.15.7:0/1245173550 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ec032440 con 0x7fa7fc15b8e0 2024-04-25T10:02:00.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.327+0000 7fa7fa7fc640 1 -- 172.21.15.7:0/1245173550 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec032810 con 0x7fa7fc15b8e0 2024-04-25T10:02:00.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.327+0000 7fa801ab3640 1 -- 172.21.15.7:0/1245173550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7fc15b8e0 msgr2=0x7fa7fc0d0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:00.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.327+0000 7fa801ab3640 1 --2- 172.21.15.7:0/1245173550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7fc15b8e0 0x7fa7fc0d0330 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009870 tx=0x7fa7ec02a270 comp rx=0 tx=0).stop 2024-04-25T10:02:00.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.327+0000 7fa801ab3640 1 -- 172.21.15.7:0/1245173550 shutdown_connections 2024-04-25T10:02:00.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.327+0000 7fa801ab3640 1 --2- 172.21.15.7:0/1245173550 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa7fc0cc300 0x7fa7fc0999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.327+0000 7fa801ab3640 1 --2- 172.21.15.7:0/1245173550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7fc15b8e0 0x7fa7fc0d0330 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.327+0000 7fa801ab3640 1 -- 172.21.15.7:0/1245173550 >> 172.21.15.7:0/1245173550 conn(0x7fa7fc0b3130 msgr2=0x7fa7fc0b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:00.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.327+0000 7fa801ab3640 1 -- 172.21.15.7:0/1245173550 shutdown_connections 2024-04-25T10:02:00.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.327+0000 7fa801ab3640 1 -- 172.21.15.7:0/1245173550 wait complete. 2024-04-25T10:02:00.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.328+0000 7fa801ab3640 1 Processor -- start 2024-04-25T10:02:00.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.329+0000 7fa801ab3640 1 -- start start 2024-04-25T10:02:00.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.329+0000 7fa801ab3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7fc099f30 0x7fa7fc150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:00.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.329+0000 7fa801ab3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa7fc0cc300 0x7fa7fc14ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:00.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.329+0000 7fa801ab3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7fc15b8e0 0x7fa7fc06bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:00.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.329+0000 7fa801ab3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc15bcc0 con 0x7fa7fc15b8e0 2024-04-25T10:02:00.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.329+0000 7fa801ab3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc0cd460 con 0x7fa7fc099f30 2024-04-25T10:02:00.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.329+0000 7fa801ab3640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc15be40 con 0x7fa7fc0cc300 2024-04-25T10:02:00.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.330+0000 7fa7fbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7fc15b8e0 0x7fa7fc06bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:00.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.330+0000 7fa7fbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7fc15b8e0 0x7fa7fc06bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35826/0 (socket says 172.21.15.7:35826) 2024-04-25T10:02:00.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.330+0000 7fa7fbfff640 1 -- 172.21.15.7:0/1294573800 learned_addr learned my addr 172.21.15.7:0/1294573800 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:00.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.330+0000 7fa7fb7fe640 1 --2- 172.21.15.7:0/1294573800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7fc099f30 0x7fa7fc150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:00.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.330+0000 7fa7faffd640 1 --2- 172.21.15.7:0/1294573800 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa7fc0cc300 0x7fa7fc14ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:00.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.330+0000 7fa7fbfff640 1 -- 172.21.15.7:0/1294573800 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa7fc0cc300 msgr2=0x7fa7fc14ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:00.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.330+0000 7fa7fbfff640 1 --2- 172.21.15.7:0/1294573800 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa7fc0cc300 0x7fa7fc14ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.330+0000 7fa7fbfff640 1 -- 172.21.15.7:0/1294573800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7fc099f30 msgr2=0x7fa7fc150a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:00.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.330+0000 7fa7fbfff640 1 --2- 172.21.15.7:0/1294573800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7fc099f30 0x7fa7fc150a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.330+0000 7fa7fbfff640 1 -- 172.21.15.7:0/1294573800 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7fc155e40 con 0x7fa7fc15b8e0 2024-04-25T10:02:00.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.330+0000 7fa7faffd640 1 --2- 172.21.15.7:0/1294573800 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa7fc0cc300 0x7fa7fc14ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:02:00.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.330+0000 7fa7fbfff640 1 --2- 172.21.15.7:0/1294573800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7fc15b8e0 0x7fa7fc06bc70 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400c7d0 tx=0x7fa7f400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:00.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.330+0000 7fa7e3fff640 1 -- 172.21.15.7:0/1294573800 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4003b70 con 0x7fa7fc15b8e0 2024-04-25T10:02:00.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.330+0000 7fa7e3fff640 1 -- 172.21.15.7:0/1294573800 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f4003d30 con 0x7fa7fc15b8e0 2024-04-25T10:02:00.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.330+0000 7fa801ab3640 1 -- 172.21.15.7:0/1294573800 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7fc156120 con 0x7fa7fc15b8e0 2024-04-25T10:02:00.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.330+0000 7fa7e3fff640 1 -- 172.21.15.7:0/1294573800 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f400aa90 con 0x7fa7fc15b8e0 2024-04-25T10:02:00.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.330+0000 7fa801ab3640 1 -- 172.21.15.7:0/1294573800 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7fc157e20 con 0x7fa7fc15b8e0 2024-04-25T10:02:00.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.332+0000 7fa7e3fff640 1 -- 172.21.15.7:0/1294573800 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa7f400ac30 con 0x7fa7fc15b8e0 2024-04-25T10:02:00.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.333+0000 7fa7e3fff640 1 --2- 172.21.15.7:0/1294573800 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa7e806b4d0 0x7fa7e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:00.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.333+0000 7fa7e3fff640 1 -- 172.21.15.7:0/1294573800 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fa7f408a340 con 0x7fa7fc15b8e0 2024-04-25T10:02:00.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.333+0000 7fa7fb7fe640 1 --2- 172.21.15.7:0/1294573800 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa7e806b4d0 0x7fa7e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:00.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.333+0000 7fa7fb7fe640 1 --2- 172.21.15.7:0/1294573800 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa7e806b4d0 0x7fa7e806d990 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec034000 tx=0x7fa7ec02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:00.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.333+0000 7fa8047ba740 1 Processor -- start 2024-04-25T10:02:00.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.333+0000 7fa8047ba740 1 -- start start 2024-04-25T10:02:00.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.334+0000 7fa8047ba740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563506a45230 0x563506a45610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:00.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.334+0000 7fa8047ba740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563506a62ad0 0x563506a63020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:00.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.334+0000 7fa8047ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563506a1af10 0x563506a61190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:00.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.334+0000 7fa8047ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x56350697da10 con 0x563506a1af10 2024-04-25T10:02:00.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.334+0000 7fa8047ba740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x563506926b30 con 0x563506a45230 2024-04-25T10:02:00.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.334+0000 7fa8047ba740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x563506979c50 con 0x563506a62ad0 2024-04-25T10:02:00.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.334+0000 7fa7fbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563506a1af10 0x563506a61190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:00.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.334+0000 7fa7fbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563506a1af10 0x563506a61190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35828/0 (socket says 172.21.15.7:35828) 2024-04-25T10:02:00.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.334+0000 7fa7fbfff640 1 -- 172.21.15.7:0/3058765777 learned_addr learned my addr 172.21.15.7:0/3058765777 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:00.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.335+0000 7fa7faffd640 1 --2- 172.21.15.7:0/3058765777 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563506a62ad0 0x563506a63020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:00.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.335+0000 7fa7fb7fe640 1 --2- 172.21.15.7:0/3058765777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563506a45230 0x563506a45610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:00.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.335+0000 7fa7fbfff640 1 -- 172.21.15.7:0/3058765777 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563506a62ad0 msgr2=0x563506a63020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:00.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.335+0000 7fa7fbfff640 1 --2- 172.21.15.7:0/3058765777 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563506a62ad0 0x563506a63020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.335+0000 7fa7fbfff640 1 -- 172.21.15.7:0/3058765777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563506a45230 msgr2=0x563506a45610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:00.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.335+0000 7fa7fbfff640 1 --2- 172.21.15.7:0/3058765777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563506a45230 0x563506a45610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.335+0000 7fa7fbfff640 1 -- 172.21.15.7:0/3058765777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56350693be10 con 0x563506a1af10 2024-04-25T10:02:00.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.335+0000 7fa7fbfff640 1 --2- 172.21.15.7:0/3058765777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563506a1af10 0x563506a61190 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4054c60 tx=0x7fa7f4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b52c4a5908dbcfc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:00.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.335+0000 7fa7e17fa640 1 -- 172.21.15.7:0/3058765777 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f405c950 con 0x563506a1af10 2024-04-25T10:02:00.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.335+0000 7fa7e17fa640 1 -- 172.21.15.7:0/3058765777 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f4060f10 con 0x563506a1af10 2024-04-25T10:02:00.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.335+0000 7fa7e17fa640 1 -- 172.21.15.7:0/3058765777 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4056b00 con 0x563506a1af10 2024-04-25T10:02:00.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.336+0000 7fa8047ba740 1 -- 172.21.15.7:0/3058765777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563506a1af10 msgr2=0x563506a61190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:00.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.336+0000 7fa8047ba740 1 --2- 172.21.15.7:0/3058765777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563506a1af10 0x563506a61190 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4054c60 tx=0x7fa7f4011000 comp rx=0 tx=0).stop 2024-04-25T10:02:00.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.336+0000 7fa8047ba740 1 -- 172.21.15.7:0/3058765777 shutdown_connections 2024-04-25T10:02:00.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.336+0000 7fa8047ba740 1 --2- 172.21.15.7:0/3058765777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563506a1af10 0x563506a61190 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.336+0000 7fa8047ba740 1 --2- 172.21.15.7:0/3058765777 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563506a62ad0 0x563506a63020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.336+0000 7fa8047ba740 1 --2- 172.21.15.7:0/3058765777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563506a45230 0x563506a45610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.336+0000 7fa8047ba740 1 -- 172.21.15.7:0/3058765777 >> 172.21.15.7:0/3058765777 conn(0x563506a17840 msgr2=0x563506a60040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:00.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.336+0000 7fa8047ba740 1 -- 172.21.15.7:0/3058765777 shutdown_connections 2024-04-25T10:02:00.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.336+0000 7fa8047ba740 1 -- 172.21.15.7:0/3058765777 wait complete. 2024-04-25T10:02:00.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.336+0000 7fa8047ba740 1 -- start start 2024-04-25T10:02:00.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.336+0000 7fa8047ba740 1 Processor -- start 2024-04-25T10:02:00.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.337+0000 7fa8047ba740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563506a45230 0x563506a41910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:00.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.337+0000 7fa8047ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563506a62ad0 0x563506a599c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:00.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.337+0000 7fa8047ba740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563506a58030 0x563506a471c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:00.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.337+0000 7fa8047ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x563506a1bcb0 con 0x563506a62ad0 2024-04-25T10:02:00.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.337+0000 7fa8047ba740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56350693a0c0 con 0x563506a58030 2024-04-25T10:02:00.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.337+0000 7fa8047ba740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x563506a15770 con 0x563506a45230 2024-04-25T10:02:00.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.337+0000 7fa8047ba740 10 client.0 _ll_register_callbacks cb 0x56350692dec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:02:00.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.337+0000 7fa7faffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563506a62ad0 0x563506a599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:00.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.337+0000 7fa7faffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563506a62ad0 0x563506a599c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35832/0 (socket says 172.21.15.7:35832) 2024-04-25T10:02:00.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.337+0000 7fa7faffd640 1 -- 172.21.15.7:0/2967741430 learned_addr learned my addr 172.21.15.7:0/2967741430 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:00.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.337+0000 7fa7fb7fe640 1 --2- 172.21.15.7:0/2967741430 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563506a45230 0x563506a41910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:00.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.337+0000 7fa7fbfff640 1 --2- 172.21.15.7:0/2967741430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563506a58030 0x563506a471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:00.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.337+0000 7fa7faffd640 1 -- 172.21.15.7:0/2967741430 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563506a45230 msgr2=0x563506a41910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:00.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.337+0000 7fa7faffd640 1 --2- 172.21.15.7:0/2967741430 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563506a45230 0x563506a41910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.337+0000 7fa7faffd640 1 -- 172.21.15.7:0/2967741430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563506a58030 msgr2=0x563506a471c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:00.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.337+0000 7fa7faffd640 1 --2- 172.21.15.7:0/2967741430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563506a58030 0x563506a471c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.337+0000 7fa7faffd640 1 -- 172.21.15.7:0/2967741430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5635066922d0 con 0x563506a62ad0 2024-04-25T10:02:00.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.337+0000 7fa7fbfff640 1 --2- 172.21.15.7:0/2967741430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563506a58030 0x563506a471c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:02:00.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.338+0000 7fa7faffd640 1 --2- 172.21.15.7:0/2967741430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563506a62ad0 0x563506a599c0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0012570 tx=0x7fa7f0012a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511074a2da7403d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:00.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.338+0000 7fa7da7fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:02:00.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.338+0000 7fa7da7fc640 1 -- 172.21.15.7:0/2967741430 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f000f040 con 0x563506a62ad0 2024-04-25T10:02:00.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.338+0000 7fa7da7fc640 1 -- 172.21.15.7:0/2967741430 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fa7f0004230 con 0x563506a62ad0 2024-04-25T10:02:00.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.338+0000 7fa8047ba740 1 -- 172.21.15.7:0/2967741430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa7f4060f10 con 0x563506a62ad0 2024-04-25T10:02:00.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.338+0000 7fa7da7fc640 1 -- 172.21.15.7:0/2967741430 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7f0025050 con 0x563506a62ad0 2024-04-25T10:02:00.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.338+0000 7fa8047ba740 10 client.8094 fetch_fsmap learned FSMap version 66 2024-04-25T10:02:00.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.338+0000 7fa8047ba740 1 -- 172.21.15.7:0/2967741430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x56350675c6b0 con 0x563506a62ad0 2024-04-25T10:02:00.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.338+0000 7fa7da7fc640 1 -- 172.21.15.7:0/2967741430 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f4060f10 con 0x563506a62ad0 2024-04-25T10:02:00.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.338+0000 7fa7da7fc640 1 -- 172.21.15.7:0/2967741430 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 66) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa7f0028020 con 0x563506a62ad0 2024-04-25T10:02:00.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.338+0000 7fa8047ba740 10 client.8094 fetch_fsmap finished waiting for FSMap version 66 2024-04-25T10:02:00.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.338+0000 7fa8047ba740 10 client.8094 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:02:00.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.338+0000 7fa8047ba740 20 client.8094 populate_metadata read hostname 'smithi007' 2024-04-25T10:02:00.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.338+0000 7fa8047ba740 1 --2- 172.21.15.7:0/2967741430 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x563506a70350 0x563506a73d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:00.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.338+0000 7fa8047ba740 4 client.8094 mds_command: new command op to 8022 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:02:00.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.338+0000 7fa8047ba740 1 -- 172.21.15.7:0/2967741430 --> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5635069dc920 con 0x563506a70350 2024-04-25T10:02:00.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.339+0000 7fa7fb7fe640 1 --2- 172.21.15.7:0/2967741430 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x563506a70350 0x563506a73d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:00.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.339+0000 7fa7da7fc640 10 client.8094 ms_handle_connect on v2:172.21.15.7:6836/1061077733 2024-04-25T10:02:00.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.339+0000 7fa7fb7fe640 1 --2- 172.21.15.7:0/2967741430 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x563506a70350 0x563506a73d30 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e341a8d44a8312a server_cookie=55d1863b06425cae in_seq=0 out_seq=0 2024-04-25T10:02:00.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.339+0000 7fa7da7fc640 1 -- 172.21.15.7:0/2967741430 <== mds.0 v2:172.21.15.7:6836/1061077733 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5635069dc920 con 0x563506a70350 2024-04-25T10:02:00.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.339+0000 7fa7da7fc640 10 client.8094 handle_command_reply: tid=0 2024-04-25T10:02:00.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.339+0000 7fa8047ba740 1 client.8094 shutdown 2024-04-25T10:02:00.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.339+0000 7fa8047ba740 1 -- 172.21.15.7:0/2967741430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563506a62ad0 msgr2=0x563506a599c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:00.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.340+0000 7fa8047ba740 1 --2- 172.21.15.7:0/2967741430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563506a62ad0 0x563506a599c0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0012570 tx=0x7fa7f0012a30 comp rx=0 tx=0).stop 2024-04-25T10:02:00.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.340+0000 7fa8047ba740 1 -- 172.21.15.7:0/2967741430 shutdown_connections 2024-04-25T10:02:00.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.340+0000 7fa8047ba740 1 --2- 172.21.15.7:0/2967741430 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x563506a70350 0x563506a73d30 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.340+0000 7fa8047ba740 1 --2- 172.21.15.7:0/2967741430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563506a58030 0x563506a471c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.340+0000 7fa8047ba740 1 --2- 172.21.15.7:0/2967741430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563506a62ad0 0x563506a599c0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.340+0000 7fa8047ba740 1 --2- 172.21.15.7:0/2967741430 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563506a45230 0x563506a41910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.340+0000 7fa7da7fc640 0 client.8094 ms_handle_reset on v2:172.21.15.7:6836/1061077733 2024-04-25T10:02:00.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.340+0000 7fa8047ba740 1 -- 172.21.15.7:0/2967741430 >> 172.21.15.7:0/2967741430 conn(0x563506a1af10 msgr2=0x563506a635c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:00.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.340+0000 7fa8047ba740 1 -- 172.21.15.7:0/2967741430 shutdown_connections 2024-04-25T10:02:00.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.340+0000 7fa8047ba740 1 -- 172.21.15.7:0/2967741430 wait complete. 2024-04-25T10:02:00.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.340+0000 7fa8047ba740 20 client.8094 trim_cache size 0 max 16384 2024-04-25T10:02:00.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.356+0000 7fa8047ba740 1 Processor -- start 2024-04-25T10:02:00.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.356+0000 7fa8047ba740 1 -- start start 2024-04-25T10:02:00.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.356+0000 7fa8047ba740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563506a45230 0x563506a59a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:00.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.356+0000 7fa8047ba740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563506a58030 0x563506a60160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:00.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.356+0000 7fa8047ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563506a62ad0 0x563506a79f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:00.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.356+0000 7fa8047ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc1ffa10 con 0x563506a62ad0 2024-04-25T10:02:00.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.356+0000 7fa8047ba740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc155af0 con 0x563506a45230 2024-04-25T10:02:00.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.356+0000 7fa8047ba740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc1ff410 con 0x563506a58030 2024-04-25T10:02:00.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.357+0000 7fa7fbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563506a62ad0 0x563506a79f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:00.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.357+0000 7fa7fbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563506a62ad0 0x563506a79f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35842/0 (socket says 172.21.15.7:35842) 2024-04-25T10:02:00.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.357+0000 7fa7fbfff640 1 -- 172.21.15.7:0/2303431380 learned_addr learned my addr 172.21.15.7:0/2303431380 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:00.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.357+0000 7fa7fb7fe640 1 --2- 172.21.15.7:0/2303431380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563506a45230 0x563506a59a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:00.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.357+0000 7fa7faffd640 1 --2- 172.21.15.7:0/2303431380 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563506a58030 0x563506a60160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:00.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.357+0000 7fa7fbfff640 1 -- 172.21.15.7:0/2303431380 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563506a58030 msgr2=0x563506a60160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:00.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.357+0000 7fa7fbfff640 1 --2- 172.21.15.7:0/2303431380 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563506a58030 0x563506a60160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.357+0000 7fa7fbfff640 1 -- 172.21.15.7:0/2303431380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563506a45230 msgr2=0x563506a59a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:00.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.357+0000 7fa7fbfff640 1 --2- 172.21.15.7:0/2303431380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563506a45230 0x563506a59a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.357+0000 7fa7fbfff640 1 -- 172.21.15.7:0/2303431380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563506a57b80 con 0x563506a62ad0 2024-04-25T10:02:00.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.357+0000 7fa7fbfff640 1 --2- 172.21.15.7:0/2303431380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563506a62ad0 0x563506a79f50 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4054c60 tx=0x7fa7f408a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ebdfe9c7c37061b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:00.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.357+0000 7fa7e0ff9640 1 -- 172.21.15.7:0/2303431380 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4060f10 con 0x563506a62ad0 2024-04-25T10:02:00.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.357+0000 7fa7e0ff9640 1 -- 172.21.15.7:0/2303431380 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f405c950 con 0x563506a62ad0 2024-04-25T10:02:00.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.357+0000 7fa7e0ff9640 1 -- 172.21.15.7:0/2303431380 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f40568a0 con 0x563506a62ad0 2024-04-25T10:02:00.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.358+0000 7fa8047ba740 1 -- 172.21.15.7:0/2303431380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563506a62ad0 msgr2=0x563506a79f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:00.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.358+0000 7fa8047ba740 1 --2- 172.21.15.7:0/2303431380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563506a62ad0 0x563506a79f50 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4054c60 tx=0x7fa7f408a050 comp rx=0 tx=0).stop 2024-04-25T10:02:00.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.358+0000 7fa8047ba740 1 -- 172.21.15.7:0/2303431380 shutdown_connections 2024-04-25T10:02:00.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.358+0000 7fa8047ba740 1 --2- 172.21.15.7:0/2303431380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563506a62ad0 0x563506a79f50 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.358+0000 7fa8047ba740 1 --2- 172.21.15.7:0/2303431380 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563506a58030 0x563506a60160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.358+0000 7fa8047ba740 1 --2- 172.21.15.7:0/2303431380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563506a45230 0x563506a59a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.358+0000 7fa8047ba740 1 -- 172.21.15.7:0/2303431380 >> 172.21.15.7:0/2303431380 conn(0x563506a1af10 msgr2=0x563506a41720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:00.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.358+0000 7fa8047ba740 1 -- 172.21.15.7:0/2303431380 shutdown_connections 2024-04-25T10:02:00.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.358+0000 7fa8047ba740 1 -- 172.21.15.7:0/2303431380 wait complete. 2024-04-25T10:02:00.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.358+0000 7fa8047ba740 1 -- start start 2024-04-25T10:02:00.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.359+0000 7fa8047ba740 1 Processor -- start 2024-04-25T10:02:00.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.359+0000 7fa8047ba740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563506a45230 0x563506a63890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:00.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.359+0000 7fa8047ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563506a58030 0x563506a559d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:00.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.359+0000 7fa8047ba740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563506a62ad0 0x563506a55f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:00.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.359+0000 7fa8047ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x563506a701d0 con 0x563506a58030 2024-04-25T10:02:00.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.359+0000 7fa8047ba740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x563506a71000 con 0x563506a62ad0 2024-04-25T10:02:00.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.359+0000 7fa8047ba740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x563506a707d0 con 0x563506a45230 2024-04-25T10:02:00.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.359+0000 7fa8047ba740 10 client.0 _ll_register_callbacks cb 0x563506a15c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:02:00.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.359+0000 7fa7faffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563506a58030 0x563506a559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:00.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.359+0000 7fa7faffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563506a58030 0x563506a559d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35846/0 (socket says 172.21.15.7:35846) 2024-04-25T10:02:00.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.359+0000 7fa7faffd640 1 -- 172.21.15.7:0/3414240285 learned_addr learned my addr 172.21.15.7:0/3414240285 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:00.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.360+0000 7fa7fbfff640 1 --2- 172.21.15.7:0/3414240285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563506a62ad0 0x563506a55f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:00.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.360+0000 7fa7fb7fe640 1 --2- 172.21.15.7:0/3414240285 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563506a45230 0x563506a63890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:00.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.360+0000 7fa7faffd640 1 -- 172.21.15.7:0/3414240285 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563506a45230 msgr2=0x563506a63890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:00.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.360+0000 7fa7faffd640 1 --2- 172.21.15.7:0/3414240285 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563506a45230 0x563506a63890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.360+0000 7fa7faffd640 1 -- 172.21.15.7:0/3414240285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563506a62ad0 msgr2=0x563506a55f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:00.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.360+0000 7fa7faffd640 1 --2- 172.21.15.7:0/3414240285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563506a62ad0 0x563506a55f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.360+0000 7fa7faffd640 1 -- 172.21.15.7:0/3414240285 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563506a57000 con 0x563506a58030 2024-04-25T10:02:00.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.360+0000 7fa7faffd640 1 --2- 172.21.15.7:0/3414240285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563506a58030 0x563506a559d0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0009570 tx=0x7fa7f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c85e223b16bd7412 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:00.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.360+0000 7fa7da7fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:02:00.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.360+0000 7fa7da7fc640 1 -- 172.21.15.7:0/3414240285 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0009d90 con 0x563506a58030 2024-04-25T10:02:00.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.360+0000 7fa7da7fc640 1 -- 172.21.15.7:0/3414240285 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fa7f00206c0 con 0x563506a58030 2024-04-25T10:02:00.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.360+0000 7fa8047ba740 1 -- 172.21.15.7:0/3414240285 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa7f405c950 con 0x563506a58030 2024-04-25T10:02:00.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.360+0000 7fa7da7fc640 1 -- 172.21.15.7:0/3414240285 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7f003b050 con 0x563506a58030 2024-04-25T10:02:00.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.360+0000 7fa8047ba740 10 client.8100 fetch_fsmap learned FSMap version 66 2024-04-25T10:02:00.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.360+0000 7fa8047ba740 1 -- 172.21.15.7:0/3414240285 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x563506a59fa0 con 0x563506a58030 2024-04-25T10:02:00.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.360+0000 7fa7da7fc640 1 -- 172.21.15.7:0/3414240285 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f405c950 con 0x563506a58030 2024-04-25T10:02:00.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.361+0000 7fa7da7fc640 1 -- 172.21.15.7:0/3414240285 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 66) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa7f003e020 con 0x563506a58030 2024-04-25T10:02:00.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.361+0000 7fa8047ba740 10 client.8100 fetch_fsmap finished waiting for FSMap version 66 2024-04-25T10:02:00.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.361+0000 7fa8047ba740 10 client.8100 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:02:00.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.361+0000 7fa8047ba740 20 client.8100 populate_metadata read hostname 'smithi007' 2024-04-25T10:02:00.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.361+0000 7fa8047ba740 1 --2- 172.21.15.7:0/3414240285 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x563506acef70 0x563506acf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:00.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.361+0000 7fa8047ba740 4 client.8100 mds_command: new command op to 8022 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:02:00.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.361+0000 7fa8047ba740 1 -- 172.21.15.7:0/3414240285 --> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563506a16660 con 0x563506acef70 2024-04-25T10:02:00.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.361+0000 7fa7fb7fe640 1 --2- 172.21.15.7:0/3414240285 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x563506acef70 0x563506acf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:00.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.361+0000 7fa7da7fc640 10 client.8100 ms_handle_connect on v2:172.21.15.7:6836/1061077733 2024-04-25T10:02:00.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.361+0000 7fa7fb7fe640 1 --2- 172.21.15.7:0/3414240285 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x563506acef70 0x563506acf350 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b6d660768d6b90c server_cookie=5b3f0fd125542b41 in_seq=0 out_seq=0 2024-04-25T10:02:00.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.361+0000 7fa7da7fc640 1 -- 172.21.15.7:0/3414240285 <== mds.0 v2:172.21.15.7:6836/1061077733 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x563506a16660 con 0x563506acef70 2024-04-25T10:02:00.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.361+0000 7fa7da7fc640 10 client.8100 handle_command_reply: tid=0 2024-04-25T10:02:00.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.361+0000 7fa8047ba740 1 client.8100 shutdown 2024-04-25T10:02:00.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.361+0000 7fa8047ba740 1 -- 172.21.15.7:0/3414240285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563506a58030 msgr2=0x563506a559d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:00.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.361+0000 7fa8047ba740 1 --2- 172.21.15.7:0/3414240285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563506a58030 0x563506a559d0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0009570 tx=0x7fa7f00046c0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.361+0000 7fa8047ba740 1 -- 172.21.15.7:0/3414240285 shutdown_connections 2024-04-25T10:02:00.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.361+0000 7fa8047ba740 1 --2- 172.21.15.7:0/3414240285 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x563506acef70 0x563506acf350 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.361+0000 7fa8047ba740 1 --2- 172.21.15.7:0/3414240285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563506a62ad0 0x563506a55f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.361+0000 7fa7da7fc640 0 client.8100 ms_handle_reset on v2:172.21.15.7:6836/1061077733 2024-04-25T10:02:00.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.361+0000 7fa8047ba740 1 --2- 172.21.15.7:0/3414240285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563506a58030 0x563506a559d0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.361+0000 7fa8047ba740 1 --2- 172.21.15.7:0/3414240285 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563506a45230 0x563506a63890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.361+0000 7fa8047ba740 1 -- 172.21.15.7:0/3414240285 >> 172.21.15.7:0/3414240285 conn(0x563506a1af10 msgr2=0x563506a1b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:00.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.361+0000 7fa8047ba740 1 -- 172.21.15.7:0/3414240285 shutdown_connections 2024-04-25T10:02:00.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.361+0000 7fa8047ba740 1 -- 172.21.15.7:0/3414240285 wait complete. 2024-04-25T10:02:00.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.362+0000 7fa8047ba740 20 client.8100 trim_cache size 0 max 16384 2024-04-25T10:02:00.373 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:02:00.373 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "c03d0745-5946-49c3-ad88-1165c5b68b4e", 2024-04-25T10:02:00.373 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-04-25T10:02:00.373 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 8022, 2024-04-25T10:02:00.373 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-04-25T10:02:00.373 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-04-25T10:02:00.373 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-04-25T10:02:00.373 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 4.4203984219999999, 2024-04-25T10:02:00.373 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 66, 2024-04-25T10:02:00.374 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 92, 2024-04-25T10:02:00.374 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 92, 2024-04-25T10:02:00.374 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 5.3920037279999997 2024-04-25T10:02:00.374 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:02:00.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.362+0000 7fa801ab3640 1 -- 172.21.15.7:0/1294573800 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa7e806b4d0 msgr2=0x7fa7e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:00.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.362+0000 7fa801ab3640 1 --2- 172.21.15.7:0/1294573800 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa7e806b4d0 0x7fa7e806d990 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec034000 tx=0x7fa7ec02e000 comp rx=0 tx=0).stop 2024-04-25T10:02:00.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.362+0000 7fa801ab3640 1 -- 172.21.15.7:0/1294573800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7fc15b8e0 msgr2=0x7fa7fc06bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:00.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.362+0000 7fa801ab3640 1 --2- 172.21.15.7:0/1294573800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7fc15b8e0 0x7fa7fc06bc70 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400c7d0 tx=0x7fa7f400cc90 comp rx=0 tx=0).stop 2024-04-25T10:02:00.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.362+0000 7fa801ab3640 1 -- 172.21.15.7:0/1294573800 shutdown_connections 2024-04-25T10:02:00.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.362+0000 7fa801ab3640 1 --2- 172.21.15.7:0/1294573800 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa7e806b4d0 0x7fa7e806d990 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.362+0000 7fa801ab3640 1 --2- 172.21.15.7:0/1294573800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7fc15b8e0 0x7fa7fc06bc70 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.362+0000 7fa801ab3640 1 --2- 172.21.15.7:0/1294573800 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa7fc0cc300 0x7fa7fc14ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.362+0000 7fa801ab3640 1 --2- 172.21.15.7:0/1294573800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7fc099f30 0x7fa7fc150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.362+0000 7fa801ab3640 1 -- 172.21.15.7:0/1294573800 >> 172.21.15.7:0/1294573800 conn(0x7fa7fc0b3130 msgr2=0x7fa7fc073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:00.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.362+0000 7fa801ab3640 1 -- 172.21.15.7:0/1294573800 shutdown_connections 2024-04-25T10:02:00.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.362+0000 7fa801ab3640 1 -- 172.21.15.7:0/1294573800 wait complete. 2024-04-25T10:02:00.377 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:02:00.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.472+0000 7fedd3cc4640 1 Processor -- start 2024-04-25T10:02:00.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.473+0000 7fedd3cc4640 1 -- start start 2024-04-25T10:02:00.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.473+0000 7fedd3cc4640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fedcc15db00 0x7fedcc0d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:00.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.473+0000 7fedd3cc4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fedcc0b53b0 0x7fedcc0d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:00.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.473+0000 7fedd3cc4640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedcc0d1e80 con 0x7fedcc0ce2b0 2024-04-25T10:02:00.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.473+0000 7fedd3cc4640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedcc0b5930 con 0x7fedcc0b53b0 2024-04-25T10:02:00.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.473+0000 7fedd3cc4640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc0b5c10 con 0x7fedcc15db00 2024-04-25T10:02:00.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.474+0000 7fedd125f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fedcc0b53b0 0x7fedcc0d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:00.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.474+0000 7fedd1a60640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fedcc15db00 0x7fedcc0d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:00.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.474+0000 7fedd125f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fedcc0b53b0 0x7fedcc0d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:40356/0 (socket says 172.21.15.7:40356) 2024-04-25T10:02:00.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.474+0000 7fedd125f640 1 -- 172.21.15.7:0/358421026 learned_addr learned my addr 172.21.15.7:0/358421026 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:00.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.474+0000 7fedd1a60640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fedcc15db00 0x7fedcc0d0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:55556/0 (socket says 172.21.15.7:55556) 2024-04-25T10:02:00.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.474+0000 7fedd2261640 1 --1- 172.21.15.7:0/358421026 >> v1:172.21.15.55:6789/0 conn(0x7fedcc0ce2b0 0x7fedcc161670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:49988/0 (socket says 172.21.15.7:49988) 2024-04-25T10:02:00.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.474+0000 7fedd125f640 1 -- 172.21.15.7:0/358421026 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fedcc15db00 msgr2=0x7fedcc0d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:00.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.474+0000 7fedd125f640 1 --2- 172.21.15.7:0/358421026 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fedcc15db00 0x7fedcc0d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.474+0000 7fedd125f640 1 -- 172.21.15.7:0/358421026 >> v1:172.21.15.55:6789/0 conn(0x7fedcc0ce2b0 legacy=0x7fedcc161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:00.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.474+0000 7fedd125f640 1 -- 172.21.15.7:0/358421026 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedcc0b5ef0 con 0x7fedcc0b53b0 2024-04-25T10:02:00.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.475+0000 7fedd125f640 1 --2- 172.21.15.7:0/358421026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedcc0b53b0 0x7fedcc0d0880 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fedbc009870 tx=0x7fedbc02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31770f59b945f268 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:00.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.475+0000 7fedd0a5e640 1 -- 172.21.15.7:0/358421026 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc037070 con 0x7fedcc0b53b0 2024-04-25T10:02:00.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.475+0000 7fedd0a5e640 1 -- 172.21.15.7:0/358421026 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedbc032440 con 0x7fedcc0b53b0 2024-04-25T10:02:00.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.475+0000 7fedd0a5e640 1 -- 172.21.15.7:0/358421026 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc032810 con 0x7fedcc0b53b0 2024-04-25T10:02:00.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.476+0000 7fedd3cc4640 1 -- 172.21.15.7:0/358421026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedcc0b53b0 msgr2=0x7fedcc0d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:00.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.476+0000 7fedd3cc4640 1 --2- 172.21.15.7:0/358421026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedcc0b53b0 0x7fedcc0d0880 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fedbc009870 tx=0x7fedbc02a270 comp rx=0 tx=0).stop 2024-04-25T10:02:00.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.476+0000 7fedd3cc4640 1 -- 172.21.15.7:0/358421026 shutdown_connections 2024-04-25T10:02:00.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.476+0000 7fedd3cc4640 1 --2- 172.21.15.7:0/358421026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedcc0b53b0 0x7fedcc0d0880 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.476+0000 7fedd3cc4640 1 --2- 172.21.15.7:0/358421026 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fedcc15db00 0x7fedcc0d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.476+0000 7fedd3cc4640 1 -- 172.21.15.7:0/358421026 >> 172.21.15.7:0/358421026 conn(0x7fedcc072290 msgr2=0x7fedcc0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:00.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.476+0000 7fedd3cc4640 1 -- 172.21.15.7:0/358421026 shutdown_connections 2024-04-25T10:02:00.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.476+0000 7fedd3cc4640 1 -- 172.21.15.7:0/358421026 wait complete. 2024-04-25T10:02:00.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.477+0000 7fedd3cc4640 1 Processor -- start 2024-04-25T10:02:00.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.477+0000 7fedd3cc4640 1 -- start start 2024-04-25T10:02:00.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.478+0000 7fedd3cc4640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fedcc0b53b0 0x7fedcc15e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:00.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.478+0000 7fedd3cc4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedcc0ce2b0 0x7fedcc1f6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:00.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.478+0000 7fedd3cc4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fedcc15db00 0x7fedcc160390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:00.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.478+0000 7fedd3cc4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc0d3660 con 0x7fedcc15db00 2024-04-25T10:02:00.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.478+0000 7fedd3cc4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc0b61d0 con 0x7fedcc0ce2b0 2024-04-25T10:02:00.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.478+0000 7fedd3cc4640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc0b6c10 con 0x7fedcc0b53b0 2024-04-25T10:02:00.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.478+0000 7fedd2261640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fedcc15db00 0x7fedcc160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:00.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.478+0000 7fedd2261640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fedcc15db00 0x7fedcc160390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35848/0 (socket says 172.21.15.7:35848) 2024-04-25T10:02:00.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.478+0000 7fedd2261640 1 -- 172.21.15.7:0/2788663099 learned_addr learned my addr 172.21.15.7:0/2788663099 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:00.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.478+0000 7fedd1a60640 1 --2- 172.21.15.7:0/2788663099 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fedcc0b53b0 0x7fedcc15e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:00.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.478+0000 7fedd125f640 1 --2- 172.21.15.7:0/2788663099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedcc0ce2b0 0x7fedcc1f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:00.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.478+0000 7fedd2261640 1 -- 172.21.15.7:0/2788663099 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fedcc0b53b0 msgr2=0x7fedcc15e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:00.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.478+0000 7fedd2261640 1 --2- 172.21.15.7:0/2788663099 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fedcc0b53b0 0x7fedcc15e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.478+0000 7fedd2261640 1 -- 172.21.15.7:0/2788663099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedcc0ce2b0 msgr2=0x7fedcc1f6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:00.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.478+0000 7fedd2261640 1 --2- 172.21.15.7:0/2788663099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedcc0ce2b0 0x7fedcc1f6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.478+0000 7fedd2261640 1 -- 172.21.15.7:0/2788663099 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedcc15e780 con 0x7fedcc15db00 2024-04-25T10:02:00.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.478+0000 7fedd1a60640 1 --2- 172.21.15.7:0/2788663099 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fedcc0b53b0 0x7fedcc15e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:02:00.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.478+0000 7fedd2261640 1 --2- 172.21.15.7:0/2788663099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fedcc15db00 0x7fedcc160390 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fedc400c780 tx=0x7fedc400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:00.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.478+0000 7fedc27fc640 1 -- 172.21.15.7:0/2788663099 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc4017070 con 0x7fedcc15db00 2024-04-25T10:02:00.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.478+0000 7fedc27fc640 1 -- 172.21.15.7:0/2788663099 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc400a640 con 0x7fedcc15db00 2024-04-25T10:02:00.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.478+0000 7fedd3cc4640 1 -- 172.21.15.7:0/2788663099 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedcc15ea60 con 0x7fedcc15db00 2024-04-25T10:02:00.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.478+0000 7fedc27fc640 1 -- 172.21.15.7:0/2788663099 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc400aa30 con 0x7fedcc15db00 2024-04-25T10:02:00.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.479+0000 7fedd3cc4640 1 -- 172.21.15.7:0/2788663099 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedcc15f020 con 0x7fedcc15db00 2024-04-25T10:02:00.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.480+0000 7fedd3cc4640 1 -- 172.21.15.7:0/2788663099 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedcc068fd0 con 0x7fedcc15db00 2024-04-25T10:02:00.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.480+0000 7fedc27fc640 1 -- 172.21.15.7:0/2788663099 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fedc401a070 con 0x7fedcc15db00 2024-04-25T10:02:00.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.480+0000 7fedc27fc640 1 --2- 172.21.15.7:0/2788663099 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fedb006b4d0 0x7fedb006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:00.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.481+0000 7fedd1a60640 1 --2- 172.21.15.7:0/2788663099 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fedb006b4d0 0x7fedb006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:00.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.481+0000 7fedc27fc640 1 -- 172.21.15.7:0/2788663099 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fedc40899e0 con 0x7fedcc15db00 2024-04-25T10:02:00.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.481+0000 7fedd1a60640 1 --2- 172.21.15.7:0/2788663099 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fedb006b4d0 0x7fedb006d990 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fedc8009af0 tx=0x7fedc8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:00.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.485+0000 7fedc27fc640 1 -- 172.21.15.7:0/2788663099 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fedc4057f50 con 0x7fedcc15db00 2024-04-25T10:02:00.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.704+0000 7fedd3cc4640 1 -- 172.21.15.7:0/2788663099 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fedcc0d16b0 con 0x7fedcc15db00 2024-04-25T10:02:00.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.704+0000 7fedc27fc640 1 -- 172.21.15.7:0/2788663099 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v66) v1 ==== 53+0+73 (secure 0 0 0) 0x7fedc405bff0 con 0x7fedcc15db00 2024-04-25T10:02:00.709 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T10:02:00.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.706+0000 7fedd3cc4640 1 -- 172.21.15.7:0/2788663099 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fedb006b4d0 msgr2=0x7fedb006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:00.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.706+0000 7fedd3cc4640 1 --2- 172.21.15.7:0/2788663099 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fedb006b4d0 0x7fedb006d990 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fedc8009af0 tx=0x7fedc8008040 comp rx=0 tx=0).stop 2024-04-25T10:02:00.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.706+0000 7fedd3cc4640 1 -- 172.21.15.7:0/2788663099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fedcc15db00 msgr2=0x7fedcc160390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:00.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.706+0000 7fedd3cc4640 1 --2- 172.21.15.7:0/2788663099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fedcc15db00 0x7fedcc160390 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fedc400c780 tx=0x7fedc400cc40 comp rx=0 tx=0).stop 2024-04-25T10:02:00.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.706+0000 7fedd3cc4640 1 -- 172.21.15.7:0/2788663099 shutdown_connections 2024-04-25T10:02:00.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.706+0000 7fedd3cc4640 1 --2- 172.21.15.7:0/2788663099 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fedb006b4d0 0x7fedb006d990 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.706+0000 7fedd3cc4640 1 --2- 172.21.15.7:0/2788663099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fedcc15db00 0x7fedcc160390 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.706+0000 7fedd3cc4640 1 --2- 172.21.15.7:0/2788663099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedcc0ce2b0 0x7fedcc1f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.706+0000 7fedd3cc4640 1 --2- 172.21.15.7:0/2788663099 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fedcc0b53b0 0x7fedcc15e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:00.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.706+0000 7fedd3cc4640 1 -- 172.21.15.7:0/2788663099 >> 172.21.15.7:0/2788663099 conn(0x7fedcc072290 msgr2=0x7fedcc0d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:00.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.706+0000 7fedd3cc4640 1 -- 172.21.15.7:0/2788663099 shutdown_connections 2024-04-25T10:02:00.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:00.706+0000 7fedd3cc4640 1 -- 172.21.15.7:0/2788663099 wait complete. 2024-04-25T10:02:00.721 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T10:02:00.722 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:02:00.722 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-04-25T10:02:00.722 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T10:02:00.722 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T10:02:00.722 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T10:02:00.722 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T10:02:00.722 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:02:00.722 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:02:00.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:02:00.723 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-04-25T10:02:00.738 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:02:00.738 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:02:00.738 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:02:00.738 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:02:00.738 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-04-25T10:02:00.739 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:02:00.739 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:02:00.739 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-04-25T10:02:00.739 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-04-25T10:02:00.739 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:02:00.739 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-04-25T10:02:00.739 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-04-25T10:02:00.739 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:02:00.739 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-04-25T10:02:00.739 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-04-25T10:02:00.739 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T10:02:00.739 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42279sec preferred_lft 42279sec 2024-04-25T10:02:00.739 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link noprefixroute 2024-04-25T10:02:00.739 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:02:00.739 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:02:00.740 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-04-25T10:02:00.740 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-04-25T10:02:00.740 INFO:teuthology.orchestra.run.smithi007.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T10:02:00.740 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 26:0c:99:53:12:e3 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:02:00.740 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T10:02:00.740 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:02:00.740 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::50aa:55ff:febc:5f67/64 scope link 2024-04-25T10:02:00.740 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:02:00.740 INFO:teuthology.orchestra.run.smithi007.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:02:00.740 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 6e:99:f1:00:a9:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:02:00.740 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6c99:f1ff:fe00:a95e/64 scope link 2024-04-25T10:02:00.740 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:02:00.740 INFO:teuthology.orchestra.run.smithi007.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:02:00.740 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 26:0c:99:53:12:e3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T10:02:00.741 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::240c:99ff:fe53:12e3/64 scope link 2024-04-25T10:02:00.741 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:02:00.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:02:00.741 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:02:00.801 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-04-25T10:02:00.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:02:00.802 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-04-25T10:02:00.859 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-04-25T10:02:00.859 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:02:00.859 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T10:02:00.859 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T10:02:00.859 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:02:00.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:02:00.859 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-04-25T10:02:00.859 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-25T10:02:00.860 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:02:00.860 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:02:00.860 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:02:00.860 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-25T10:02:00.945 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-04-25T10:02:00.940+0000 7f37733a0640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:02:00.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:02:00.946 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-04-25T10:02:00.961 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T10:02:00.961 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T10:02:00.961 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:02:00.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:02:00.962 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-04-25T10:02:01.026 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:02:01.026 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T10:02:01.082 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:02:01.082 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:02:01.082 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:02:01.137 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T10:02:01.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:02:01.137 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:02:01.220 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:02:01.220 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T10:02:01.220 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T10:02:01.228 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:02:01.229 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T10:02:01.229 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T10:02:01.229 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T10:02:01.229 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T10:02:01.234 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:02:01.234 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T10:02:01.234 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T10:02:01.234 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T10:02:01.234 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T10:02:01.234 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790" 2024-04-25T10:02:01.234 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790:/ 2024-04-25T10:02:01.234 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c03d0745-5946-49c3-ad88-1165c5b68b4e" will pass to kernel 2024-04-25T10:02:01.237 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T10:02:01.237 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-04-25T10:02:01.237 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T10:02:01.237 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T10:02:01.238 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T10:02:01.239 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T10:02:01.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:02:01.239 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:02:01.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:02:01.304 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:02:01.361 INFO:teuthology.orchestra.run.smithi007.stdout:client7210 2024-04-25T10:02:01.362 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:02:01.362 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:02:01.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:02:01.418 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive,repair 2024-04-25T10:02:01.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.557+0000 7fb337f6a640 1 Processor -- start 2024-04-25T10:02:01.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.557+0000 7fb337f6a640 1 -- start start 2024-04-25T10:02:01.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.558+0000 7fb337f6a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb3300d0f20 0x7fb3300b8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.558+0000 7fb337f6a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3300ce900 0x7fb3300b8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.558+0000 7fb337f6a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3300cee00 con 0x7fb33015d9b0 2024-04-25T10:02:01.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.558+0000 7fb337f6a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3300b7500 con 0x7fb3300d0f20 2024-04-25T10:02:01.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.558+0000 7fb337f6a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3300b7750 con 0x7fb3300ce900 2024-04-25T10:02:01.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.558+0000 7fb335505640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb3300d0f20 0x7fb3300b8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.558+0000 7fb335505640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb3300d0f20 0x7fb3300b8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35864/0 (socket says 172.21.15.7:35864) 2024-04-25T10:02:01.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.558+0000 7fb335505640 1 -- 172.21.15.7:0/3227346916 learned_addr learned my addr 172.21.15.7:0/3227346916 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:01.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.558+0000 7fb336507640 1 --2- 172.21.15.7:0/3227346916 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3300ce900 0x7fb3300b8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.558+0000 7fb335505640 1 -- 172.21.15.7:0/3227346916 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3300ce900 msgr2=0x7fb3300b8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:01.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.559+0000 7fb335505640 1 --2- 172.21.15.7:0/3227346916 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3300ce900 0x7fb3300b8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.559+0000 7fb335505640 1 -- 172.21.15.7:0/3227346916 >> v1:172.21.15.55:6789/0 conn(0x7fb33015d9b0 legacy=0x7fb3300d0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:01.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.559+0000 7fb335505640 1 -- 172.21.15.7:0/3227346916 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3300b7a30 con 0x7fb3300d0f20 2024-04-25T10:02:01.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.559+0000 7fb335505640 1 --2- 172.21.15.7:0/3227346916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3300d0f20 0x7fb3300b8230 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fb324009870 tx=0x7fb32402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb7de7cda041b78 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.559+0000 7fb334d04640 1 -- 172.21.15.7:0/3227346916 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb324037070 con 0x7fb3300d0f20 2024-04-25T10:02:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.559+0000 7fb334d04640 1 -- 172.21.15.7:0/3227346916 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb324032440 con 0x7fb3300d0f20 2024-04-25T10:02:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.559+0000 7fb334d04640 1 -- 172.21.15.7:0/3227346916 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb324032810 con 0x7fb3300d0f20 2024-04-25T10:02:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.560+0000 7fb337f6a640 1 -- 172.21.15.7:0/3227346916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3300d0f20 msgr2=0x7fb3300b8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.560+0000 7fb337f6a640 1 --2- 172.21.15.7:0/3227346916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3300d0f20 0x7fb3300b8230 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fb324009870 tx=0x7fb32402a270 comp rx=0 tx=0).stop 2024-04-25T10:02:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.560+0000 7fb337f6a640 1 -- 172.21.15.7:0/3227346916 shutdown_connections 2024-04-25T10:02:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.560+0000 7fb337f6a640 1 --2- 172.21.15.7:0/3227346916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3300d0f20 0x7fb3300b8230 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.560+0000 7fb337f6a640 1 --2- 172.21.15.7:0/3227346916 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3300ce900 0x7fb3300b8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.560+0000 7fb337f6a640 1 -- 172.21.15.7:0/3227346916 >> 172.21.15.7:0/3227346916 conn(0x7fb3300726b0 msgr2=0x7fb330072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.560+0000 7fb337f6a640 1 -- 172.21.15.7:0/3227346916 shutdown_connections 2024-04-25T10:02:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.560+0000 7fb337f6a640 1 -- 172.21.15.7:0/3227346916 wait complete. 2024-04-25T10:02:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.561+0000 7fb337f6a640 1 Processor -- start 2024-04-25T10:02:01.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.561+0000 7fb337f6a640 1 -- start start 2024-04-25T10:02:01.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.562+0000 7fb337f6a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3300ce900 0x7fb3300c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.562+0000 7fb337f6a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3300d0f20 0x7fb3300c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.562+0000 7fb337f6a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb33015d9b0 0x7fb3300cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.562+0000 7fb337f6a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3300b2bc0 con 0x7fb33015d9b0 2024-04-25T10:02:01.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.562+0000 7fb337f6a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33015dd90 con 0x7fb3300ce900 2024-04-25T10:02:01.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.562+0000 7fb337f6a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3300b2d40 con 0x7fb3300d0f20 2024-04-25T10:02:01.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.562+0000 7fb336507640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb33015d9b0 0x7fb3300cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.562+0000 7fb336507640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb33015d9b0 0x7fb3300cc830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35868/0 (socket says 172.21.15.7:35868) 2024-04-25T10:02:01.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.562+0000 7fb336507640 1 -- 172.21.15.7:0/4034334717 learned_addr learned my addr 172.21.15.7:0/4034334717 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:01.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.562+0000 7fb335d06640 1 --2- 172.21.15.7:0/4034334717 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3300ce900 0x7fb3300c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.562+0000 7fb335505640 1 --2- 172.21.15.7:0/4034334717 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3300d0f20 0x7fb3300c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.562+0000 7fb336507640 1 -- 172.21.15.7:0/4034334717 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3300d0f20 msgr2=0x7fb3300c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:01.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.562+0000 7fb336507640 1 --2- 172.21.15.7:0/4034334717 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3300d0f20 0x7fb3300c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.562+0000 7fb336507640 1 -- 172.21.15.7:0/4034334717 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3300ce900 msgr2=0x7fb3300c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:01.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.562+0000 7fb336507640 1 --2- 172.21.15.7:0/4034334717 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3300ce900 0x7fb3300c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.562+0000 7fb336507640 1 -- 172.21.15.7:0/4034334717 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3300ccd70 con 0x7fb33015d9b0 2024-04-25T10:02:01.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.563+0000 7fb335505640 1 --2- 172.21.15.7:0/4034334717 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3300d0f20 0x7fb3300c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:02:01.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.563+0000 7fb336507640 1 --2- 172.21.15.7:0/4034334717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb33015d9b0 0x7fb3300cc830 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fb32800d600 tx=0x7fb32800dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:01.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.563+0000 7fb32e7fc640 1 -- 172.21.15.7:0/4034334717 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3280125f0 con 0x7fb33015d9b0 2024-04-25T10:02:01.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.563+0000 7fb32e7fc640 1 -- 172.21.15.7:0/4034334717 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb328019070 con 0x7fb33015d9b0 2024-04-25T10:02:01.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.563+0000 7fb337f6a640 1 -- 172.21.15.7:0/4034334717 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3300ccff0 con 0x7fb33015d9b0 2024-04-25T10:02:01.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.563+0000 7fb32e7fc640 1 -- 172.21.15.7:0/4034334717 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3280129d0 con 0x7fb33015d9b0 2024-04-25T10:02:01.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.563+0000 7fb337f6a640 1 -- 172.21.15.7:0/4034334717 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb33015f8e0 con 0x7fb33015d9b0 2024-04-25T10:02:01.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.564+0000 7fb32e7fc640 1 -- 172.21.15.7:0/4034334717 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb328012b70 con 0x7fb33015d9b0 2024-04-25T10:02:01.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.565+0000 7fb32e7fc640 1 --2- 172.21.15.7:0/4034334717 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb31c06b4d0 0x7fb31c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.565+0000 7fb32e7fc640 1 -- 172.21.15.7:0/4034334717 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fb32808a940 con 0x7fb33015d9b0 2024-04-25T10:02:01.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.565+0000 7fb335d06640 1 --2- 172.21.15.7:0/4034334717 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb31c06b4d0 0x7fb31c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.565+0000 7fb335d06640 1 --2- 172.21.15.7:0/4034334717 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb31c06b4d0 0x7fb31c06d990 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fb320001ca0 tx=0x7fb320009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:01.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.566+0000 7fb33ac5f740 1 Processor -- start 2024-04-25T10:02:01.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.566+0000 7fb33ac5f740 1 -- start start 2024-04-25T10:02:01.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.566+0000 7fb33ac5f740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564327bd6bb0 0x564327bd6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.567+0000 7fb33ac5f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564327bd1830 0x564327bd57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.567+0000 7fb33ac5f740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x564327bd5cf0 0x564327bd6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.567+0000 7fb33ac5f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x564327b3aac0 con 0x564327bd1830 2024-04-25T10:02:01.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.567+0000 7fb33ac5f740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564327ae3d80 con 0x564327bd6bb0 2024-04-25T10:02:01.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.567+0000 7fb33ac5f740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x564327b36b60 con 0x564327bd5cf0 2024-04-25T10:02:01.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.567+0000 7fb335505640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564327bd1830 0x564327bd57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.567+0000 7fb335505640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564327bd1830 0x564327bd57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35878/0 (socket says 172.21.15.7:35878) 2024-04-25T10:02:01.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.567+0000 7fb335505640 1 -- 172.21.15.7:0/3584320337 learned_addr learned my addr 172.21.15.7:0/3584320337 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:01.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.567+0000 7fb335505640 1 -- 172.21.15.7:0/3584320337 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x564327bd5cf0 msgr2=0x564327bd6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:01.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.567+0000 7fb335505640 1 --2- 172.21.15.7:0/3584320337 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x564327bd5cf0 0x564327bd6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.567+0000 7fb335505640 1 -- 172.21.15.7:0/3584320337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564327bd6bb0 msgr2=0x564327bd6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:01.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.567+0000 7fb335505640 1 --2- 172.21.15.7:0/3584320337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564327bd6bb0 0x564327bd6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.567+0000 7fb335505640 1 -- 172.21.15.7:0/3584320337 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643279177e0 con 0x564327bd1830 2024-04-25T10:02:01.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.567+0000 7fb335505640 1 --2- 172.21.15.7:0/3584320337 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564327bd1830 0x564327bd57b0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fb324000c00 tx=0x7fb32402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4daa7c6ab1b14f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:01.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.567+0000 7fb3177fe640 1 -- 172.21.15.7:0/3584320337 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb324041070 con 0x564327bd1830 2024-04-25T10:02:01.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.567+0000 7fb3177fe640 1 -- 172.21.15.7:0/3584320337 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3240326c0 con 0x564327bd1830 2024-04-25T10:02:01.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.567+0000 7fb3177fe640 1 -- 172.21.15.7:0/3584320337 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb324037040 con 0x564327bd1830 2024-04-25T10:02:01.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.568+0000 7fb33ac5f740 1 -- 172.21.15.7:0/3584320337 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564327bd1830 msgr2=0x564327bd57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:01.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.568+0000 7fb33ac5f740 1 --2- 172.21.15.7:0/3584320337 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564327bd1830 0x564327bd57b0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fb324000c00 tx=0x7fb32402c000 comp rx=0 tx=0).stop 2024-04-25T10:02:01.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.568+0000 7fb33ac5f740 1 -- 172.21.15.7:0/3584320337 shutdown_connections 2024-04-25T10:02:01.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.568+0000 7fb33ac5f740 1 --2- 172.21.15.7:0/3584320337 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x564327bd5cf0 0x564327bd6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.568+0000 7fb33ac5f740 1 --2- 172.21.15.7:0/3584320337 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564327bd1830 0x564327bd57b0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.568+0000 7fb33ac5f740 1 --2- 172.21.15.7:0/3584320337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564327bd6bb0 0x564327bd6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.568+0000 7fb33ac5f740 1 -- 172.21.15.7:0/3584320337 >> 172.21.15.7:0/3584320337 conn(0x564327bd3cb0 msgr2=0x564327c1c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:01.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.568+0000 7fb33ac5f740 1 -- 172.21.15.7:0/3584320337 shutdown_connections 2024-04-25T10:02:01.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.568+0000 7fb33ac5f740 1 -- 172.21.15.7:0/3584320337 wait complete. 2024-04-25T10:02:01.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.569+0000 7fb33ac5f740 1 -- start start 2024-04-25T10:02:01.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.569+0000 7fb33ac5f740 1 Processor -- start 2024-04-25T10:02:01.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.570+0000 7fb33ac5f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564327bd5cf0 0x564327c236f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.570+0000 7fb33ac5f740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x564327bd6bb0 0x564327bf6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.570+0000 7fb33ac5f740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564327bf7770 0x564327bf7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.570+0000 7fb33ac5f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x564327c02740 con 0x564327bd5cf0 2024-04-25T10:02:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.570+0000 7fb33ac5f740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564327ad9530 con 0x564327bf7770 2024-04-25T10:02:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.570+0000 7fb33ac5f740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x564327c01bc0 con 0x564327bd6bb0 2024-04-25T10:02:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.570+0000 7fb33ac5f740 10 client.0 _ll_register_callbacks cb 0x564327b31130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:02:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.570+0000 7fb335d06640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564327bd5cf0 0x564327c236f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.570+0000 7fb335d06640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564327bd5cf0 0x564327c236f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35894/0 (socket says 172.21.15.7:35894) 2024-04-25T10:02:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.570+0000 7fb335d06640 1 -- 172.21.15.7:0/3388481017 learned_addr learned my addr 172.21.15.7:0/3388481017 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.570+0000 7fb336507640 1 --2- 172.21.15.7:0/3388481017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564327bf7770 0x564327bf7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.570+0000 7fb335505640 1 --2- 172.21.15.7:0/3388481017 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x564327bd6bb0 0x564327bf6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.570+0000 7fb335d06640 1 -- 172.21.15.7:0/3388481017 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x564327bd6bb0 msgr2=0x564327bf6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.570+0000 7fb335d06640 1 --2- 172.21.15.7:0/3388481017 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x564327bd6bb0 0x564327bf6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.570+0000 7fb335d06640 1 -- 172.21.15.7:0/3388481017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564327bf7770 msgr2=0x564327bf7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:01.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.570+0000 7fb335d06640 1 --2- 172.21.15.7:0/3388481017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564327bf7770 0x564327bf7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.570+0000 7fb335d06640 1 -- 172.21.15.7:0/3388481017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564327977f70 con 0x564327bd5cf0 2024-04-25T10:02:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.570+0000 7fb335d06640 1 --2- 172.21.15.7:0/3388481017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564327bd5cf0 0x564327c236f0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fb320001550 tx=0x7fb32000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e033543712fa282 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.570+0000 7fb314ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:02:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.570+0000 7fb314ff9640 1 -- 172.21.15.7:0/3388481017 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32000ee60 con 0x564327bd5cf0 2024-04-25T10:02:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.570+0000 7fb314ff9640 1 -- 172.21.15.7:0/3388481017 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fb320023d80 con 0x564327bd5cf0 2024-04-25T10:02:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.570+0000 7fb33ac5f740 1 -- 172.21.15.7:0/3388481017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb3240326c0 con 0x564327bd5cf0 2024-04-25T10:02:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.570+0000 7fb314ff9640 1 -- 172.21.15.7:0/3388481017 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3200057e0 con 0x564327bd5cf0 2024-04-25T10:02:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.570+0000 7fb33ac5f740 10 client.8115 fetch_fsmap learned FSMap version 66 2024-04-25T10:02:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.571+0000 7fb33ac5f740 1 -- 172.21.15.7:0/3388481017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x56432780f170 con 0x564327bd5cf0 2024-04-25T10:02:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.571+0000 7fb314ff9640 1 -- 172.21.15.7:0/3388481017 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3240326c0 con 0x564327bd5cf0 2024-04-25T10:02:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.571+0000 7fb314ff9640 1 -- 172.21.15.7:0/3388481017 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 66) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb320022420 con 0x564327bd5cf0 2024-04-25T10:02:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.571+0000 7fb33ac5f740 10 client.8115 fetch_fsmap finished waiting for FSMap version 66 2024-04-25T10:02:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.571+0000 7fb33ac5f740 10 client.8115 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T10:02:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.571+0000 7fb33ac5f740 20 client.8115 populate_metadata read hostname 'smithi007' 2024-04-25T10:02:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.571+0000 7fb33ac5f740 1 --2- 172.21.15.7:0/3388481017 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x564327c1ed50 0x564327c1f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.571+0000 7fb33ac5f740 4 client.8115 mds_command: new command op to 8022 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:02:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.571+0000 7fb33ac5f740 1 -- 172.21.15.7:0/3388481017 --> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564327b48000 con 0x564327c1ed50 2024-04-25T10:02:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.571+0000 7fb335505640 1 --2- 172.21.15.7:0/3388481017 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x564327c1ed50 0x564327c1f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.571+0000 7fb314ff9640 10 client.8115 ms_handle_connect on v2:172.21.15.7:6836/1061077733 2024-04-25T10:02:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.571+0000 7fb335505640 1 --2- 172.21.15.7:0/3388481017 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x564327c1ed50 0x564327c1f130 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ad6772980f90bad server_cookie=afbfb24765a6e0a2 in_seq=0 out_seq=0 2024-04-25T10:02:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.572+0000 7fb314ff9640 1 -- 172.21.15.7:0/3388481017 <== mds.0 v2:172.21.15.7:6836/1061077733 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564327b48000 con 0x564327c1ed50 2024-04-25T10:02:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.572+0000 7fb314ff9640 10 client.8115 handle_command_reply: tid=0 2024-04-25T10:02:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.572+0000 7fb33ac5f740 1 client.8115 shutdown 2024-04-25T10:02:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.572+0000 7fb33ac5f740 1 -- 172.21.15.7:0/3388481017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564327bd5cf0 msgr2=0x564327c236f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.572+0000 7fb33ac5f740 1 --2- 172.21.15.7:0/3388481017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564327bd5cf0 0x564327c236f0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fb320001550 tx=0x7fb32000ec70 comp rx=0 tx=0).stop 2024-04-25T10:02:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.572+0000 7fb33ac5f740 1 -- 172.21.15.7:0/3388481017 shutdown_connections 2024-04-25T10:02:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.572+0000 7fb33ac5f740 1 --2- 172.21.15.7:0/3388481017 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x564327c1ed50 0x564327c1f130 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.572+0000 7fb33ac5f740 1 --2- 172.21.15.7:0/3388481017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564327bf7770 0x564327bf7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.572+0000 7fb33ac5f740 1 --2- 172.21.15.7:0/3388481017 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x564327bd6bb0 0x564327bf6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.572+0000 7fb33ac5f740 1 --2- 172.21.15.7:0/3388481017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564327bd5cf0 0x564327c236f0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.572+0000 7fb314ff9640 0 client.8115 ms_handle_reset on v2:172.21.15.7:6836/1061077733 2024-04-25T10:02:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.572+0000 7fb33ac5f740 1 -- 172.21.15.7:0/3388481017 >> 172.21.15.7:0/3388481017 conn(0x564327bd1830 msgr2=0x564327bd76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.572+0000 7fb33ac5f740 1 -- 172.21.15.7:0/3388481017 shutdown_connections 2024-04-25T10:02:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.572+0000 7fb33ac5f740 1 -- 172.21.15.7:0/3388481017 wait complete. 2024-04-25T10:02:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.572+0000 7fb33ac5f740 20 client.8115 trim_cache size 0 max 16384 2024-04-25T10:02:01.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.587+0000 7fb33ac5f740 1 Processor -- start 2024-04-25T10:02:01.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.587+0000 7fb33ac5f740 1 -- start start 2024-04-25T10:02:01.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.588+0000 7fb33ac5f740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x564327bd5cf0 0x564327bd0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.588+0000 7fb33ac5f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564327bd6bb0 0x564327bfe7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.588+0000 7fb33ac5f740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564327bf7770 0x564327bfed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.588+0000 7fb33ac5f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb330200730 con 0x564327bd6bb0 2024-04-25T10:02:01.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.588+0000 7fb33ac5f740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3301ff8b0 con 0x564327bf7770 2024-04-25T10:02:01.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.588+0000 7fb33ac5f740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3301fecb0 con 0x564327bd5cf0 2024-04-25T10:02:01.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.588+0000 7fb335505640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564327bd6bb0 0x564327bfe7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.588+0000 7fb335505640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564327bd6bb0 0x564327bfe7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35898/0 (socket says 172.21.15.7:35898) 2024-04-25T10:02:01.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.588+0000 7fb335505640 1 -- 172.21.15.7:0/2974550765 learned_addr learned my addr 172.21.15.7:0/2974550765 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:01.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.588+0000 7fb336507640 1 --2- 172.21.15.7:0/2974550765 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564327bf7770 0x564327bfed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.588+0000 7fb335505640 1 -- 172.21.15.7:0/2974550765 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x564327bd5cf0 msgr2=0x564327bd0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:01.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.588+0000 7fb335505640 1 --2- 172.21.15.7:0/2974550765 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x564327bd5cf0 0x564327bd0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.588+0000 7fb335505640 1 -- 172.21.15.7:0/2974550765 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564327bf7770 msgr2=0x564327bfed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:01.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.589+0000 7fb335505640 1 --2- 172.21.15.7:0/2974550765 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564327bf7770 0x564327bfed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.589+0000 7fb335505640 1 -- 172.21.15.7:0/2974550765 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564327c1f4a0 con 0x564327bd6bb0 2024-04-25T10:02:01.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.589+0000 7fb336507640 1 --2- 172.21.15.7:0/2974550765 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564327bf7770 0x564327bfed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:02:01.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.589+0000 7fb335505640 1 --2- 172.21.15.7:0/2974550765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564327bd6bb0 0x564327bfe7c0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fb324009990 tx=0x7fb324008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c4d37e9b22a832 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:01.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.589+0000 7fb316ffd640 1 -- 172.21.15.7:0/2974550765 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32404a070 con 0x564327bd6bb0 2024-04-25T10:02:01.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.589+0000 7fb316ffd640 1 -- 172.21.15.7:0/2974550765 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb324003610 con 0x564327bd6bb0 2024-04-25T10:02:01.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.589+0000 7fb316ffd640 1 -- 172.21.15.7:0/2974550765 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb324037040 con 0x564327bd6bb0 2024-04-25T10:02:01.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.589+0000 7fb33ac5f740 1 -- 172.21.15.7:0/2974550765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564327bd6bb0 msgr2=0x564327bfe7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:01.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.589+0000 7fb33ac5f740 1 --2- 172.21.15.7:0/2974550765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564327bd6bb0 0x564327bfe7c0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fb324009990 tx=0x7fb324008030 comp rx=0 tx=0).stop 2024-04-25T10:02:01.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.589+0000 7fb33ac5f740 1 -- 172.21.15.7:0/2974550765 shutdown_connections 2024-04-25T10:02:01.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.589+0000 7fb33ac5f740 1 --2- 172.21.15.7:0/2974550765 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564327bf7770 0x564327bfed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.589+0000 7fb33ac5f740 1 --2- 172.21.15.7:0/2974550765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564327bd6bb0 0x564327bfe7c0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.589+0000 7fb33ac5f740 1 --2- 172.21.15.7:0/2974550765 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x564327bd5cf0 0x564327bd0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.589+0000 7fb33ac5f740 1 -- 172.21.15.7:0/2974550765 >> 172.21.15.7:0/2974550765 conn(0x564327bd1830 msgr2=0x564327c23500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:01.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.589+0000 7fb33ac5f740 1 -- 172.21.15.7:0/2974550765 shutdown_connections 2024-04-25T10:02:01.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.589+0000 7fb33ac5f740 1 -- 172.21.15.7:0/2974550765 wait complete. 2024-04-25T10:02:01.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.590+0000 7fb33ac5f740 1 -- start start 2024-04-25T10:02:01.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.590+0000 7fb33ac5f740 1 Processor -- start 2024-04-25T10:02:01.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.591+0000 7fb33ac5f740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x564327bd5cf0 0x564327c6d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.591+0000 7fb33ac5f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564327bd6bb0 0x564327bfe7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.591+0000 7fb33ac5f740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564327bf7770 0x564327bfed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.591+0000 7fb33ac5f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x564327bf7480 con 0x564327bd6bb0 2024-04-25T10:02:01.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.591+0000 7fb33ac5f740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3301ff2b0 con 0x564327bf7770 2024-04-25T10:02:01.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.591+0000 7fb33ac5f740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x564327c1fd20 con 0x564327bd5cf0 2024-04-25T10:02:01.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.591+0000 7fb33ac5f740 10 client.0 _ll_register_callbacks cb 0x7fb324035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:02:01.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.591+0000 7fb335505640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564327bd6bb0 0x564327bfe7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.591+0000 7fb335505640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564327bd6bb0 0x564327bfe7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35914/0 (socket says 172.21.15.7:35914) 2024-04-25T10:02:01.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.591+0000 7fb335505640 1 -- 172.21.15.7:0/3997860836 learned_addr learned my addr 172.21.15.7:0/3997860836 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:01.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.591+0000 7fb336507640 1 --2- 172.21.15.7:0/3997860836 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564327bf7770 0x564327bfed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.591+0000 7fb335d06640 1 --2- 172.21.15.7:0/3997860836 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x564327bd5cf0 0x564327c6d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.591+0000 7fb335505640 1 -- 172.21.15.7:0/3997860836 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x564327bd5cf0 msgr2=0x564327c6d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:01.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.591+0000 7fb335505640 1 --2- 172.21.15.7:0/3997860836 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x564327bd5cf0 0x564327c6d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.591+0000 7fb335505640 1 -- 172.21.15.7:0/3997860836 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564327bf7770 msgr2=0x564327bfed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:01.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.591+0000 7fb335505640 1 --2- 172.21.15.7:0/3997860836 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564327bf7770 0x564327bfed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.591+0000 7fb335505640 1 -- 172.21.15.7:0/3997860836 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564327bf9e80 con 0x564327bd6bb0 2024-04-25T10:02:01.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.591+0000 7fb336507640 1 --2- 172.21.15.7:0/3997860836 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564327bf7770 0x564327bfed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:02:01.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.591+0000 7fb335505640 1 --2- 172.21.15.7:0/3997860836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564327bd6bb0 0x564327bfe7c0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fb324009870 tx=0x7fb324004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17eba7db81043223 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:01.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.591+0000 7fb314ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:02:01.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.592+0000 7fb314ff9640 1 -- 172.21.15.7:0/3997860836 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb324053060 con 0x564327bd6bb0 2024-04-25T10:02:01.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.592+0000 7fb314ff9640 1 -- 172.21.15.7:0/3997860836 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fb324005dd0 con 0x564327bd6bb0 2024-04-25T10:02:01.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.592+0000 7fb33ac5f740 1 -- 172.21.15.7:0/3997860836 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb324003610 con 0x564327bd6bb0 2024-04-25T10:02:01.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.592+0000 7fb314ff9640 1 -- 172.21.15.7:0/3997860836 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb324059050 con 0x564327bd6bb0 2024-04-25T10:02:01.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.592+0000 7fb33ac5f740 10 client.8121 fetch_fsmap learned FSMap version 66 2024-04-25T10:02:01.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.592+0000 7fb33ac5f740 1 -- 172.21.15.7:0/3997860836 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x564327bf9520 con 0x564327bd6bb0 2024-04-25T10:02:01.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.592+0000 7fb314ff9640 1 -- 172.21.15.7:0/3997860836 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb324003610 con 0x564327bd6bb0 2024-04-25T10:02:01.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.592+0000 7fb314ff9640 1 -- 172.21.15.7:0/3997860836 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 66) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb32405c020 con 0x564327bd6bb0 2024-04-25T10:02:01.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.592+0000 7fb33ac5f740 10 client.8121 fetch_fsmap finished waiting for FSMap version 66 2024-04-25T10:02:01.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.592+0000 7fb33ac5f740 10 client.8121 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T10:02:01.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.592+0000 7fb33ac5f740 20 client.8121 populate_metadata read hostname 'smithi007' 2024-04-25T10:02:01.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.592+0000 7fb33ac5f740 1 --2- 172.21.15.7:0/3997860836 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x564327c155c0 0x564327c16ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.592+0000 7fb33ac5f740 4 client.8121 mds_command: new command op to 8022 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}] 2024-04-25T10:02:01.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.592+0000 7fb33ac5f740 1 -- 172.21.15.7:0/3997860836 --> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}) v1 -- 0x564327b42350 con 0x564327c155c0 2024-04-25T10:02:01.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.592+0000 7fb335d06640 1 --2- 172.21.15.7:0/3997860836 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x564327c155c0 0x564327c16ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.592+0000 7fb314ff9640 10 client.8121 ms_handle_connect on v2:172.21.15.7:6836/1061077733 2024-04-25T10:02:01.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.592+0000 7fb335d06640 1 --2- 172.21.15.7:0/3997860836 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x564327c155c0 0x564327c16ef0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f3e1bb8302589a9 server_cookie=13e21ce7f427691c in_seq=0 out_seq=0 2024-04-25T10:02:01.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.593+0000 7fb314ff9640 1 -- 172.21.15.7:0/3997860836 <== mds.0 v2:172.21.15.7:6836/1061077733 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x564327b42350 con 0x564327c155c0 2024-04-25T10:02:01.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.593+0000 7fb314ff9640 10 client.8121 handle_command_reply: tid=0 2024-04-25T10:02:01.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.593+0000 7fb33ac5f740 1 client.8121 shutdown 2024-04-25T10:02:01.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.593+0000 7fb33ac5f740 1 -- 172.21.15.7:0/3997860836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564327bd6bb0 msgr2=0x564327bfe7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:01.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.593+0000 7fb33ac5f740 1 --2- 172.21.15.7:0/3997860836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564327bd6bb0 0x564327bfe7c0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fb324009870 tx=0x7fb324004730 comp rx=0 tx=0).stop 2024-04-25T10:02:01.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.593+0000 7fb33ac5f740 1 -- 172.21.15.7:0/3997860836 shutdown_connections 2024-04-25T10:02:01.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.593+0000 7fb33ac5f740 1 --2- 172.21.15.7:0/3997860836 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x564327c155c0 0x564327c16ef0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.593+0000 7fb33ac5f740 1 --2- 172.21.15.7:0/3997860836 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564327bf7770 0x564327bfed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.593+0000 7fb33ac5f740 1 --2- 172.21.15.7:0/3997860836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564327bd6bb0 0x564327bfe7c0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.593+0000 7fb33ac5f740 1 --2- 172.21.15.7:0/3997860836 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x564327bd5cf0 0x564327c6d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.593+0000 7fb33ac5f740 1 -- 172.21.15.7:0/3997860836 >> 172.21.15.7:0/3997860836 conn(0x564327bd1830 msgr2=0x564327bd8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:01.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.593+0000 7fb314ff9640 0 client.8121 ms_handle_reset on v2:172.21.15.7:6836/1061077733 2024-04-25T10:02:01.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.593+0000 7fb33ac5f740 1 -- 172.21.15.7:0/3997860836 shutdown_connections 2024-04-25T10:02:01.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.593+0000 7fb33ac5f740 1 -- 172.21.15.7:0/3997860836 wait complete. 2024-04-25T10:02:01.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.593+0000 7fb33ac5f740 20 client.8121 trim_cache size 0 max 16384 2024-04-25T10:02:01.605 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:02:01.605 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-04-25T10:02:01.605 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "32661b4e-6757-4535-9727-801059a04ef4", 2024-04-25T10:02:01.605 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-04-25T10:02:01.605 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:02:01.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.594+0000 7fb337f6a640 1 -- 172.21.15.7:0/4034334717 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb31c06b4d0 msgr2=0x7fb31c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:01.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.594+0000 7fb337f6a640 1 --2- 172.21.15.7:0/4034334717 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb31c06b4d0 0x7fb31c06d990 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fb320001ca0 tx=0x7fb320009040 comp rx=0 tx=0).stop 2024-04-25T10:02:01.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.594+0000 7fb337f6a640 1 -- 172.21.15.7:0/4034334717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb33015d9b0 msgr2=0x7fb3300cc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:01.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.594+0000 7fb337f6a640 1 --2- 172.21.15.7:0/4034334717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb33015d9b0 0x7fb3300cc830 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fb32800d600 tx=0x7fb32800dac0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.594+0000 7fb337f6a640 1 -- 172.21.15.7:0/4034334717 shutdown_connections 2024-04-25T10:02:01.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.594+0000 7fb337f6a640 1 --2- 172.21.15.7:0/4034334717 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb31c06b4d0 0x7fb31c06d990 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.594+0000 7fb337f6a640 1 --2- 172.21.15.7:0/4034334717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb33015d9b0 0x7fb3300cc830 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.594+0000 7fb337f6a640 1 --2- 172.21.15.7:0/4034334717 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3300d0f20 0x7fb3300c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.594+0000 7fb337f6a640 1 --2- 172.21.15.7:0/4034334717 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3300ce900 0x7fb3300c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.594+0000 7fb337f6a640 1 -- 172.21.15.7:0/4034334717 >> 172.21.15.7:0/4034334717 conn(0x7fb3300726b0 msgr2=0x7fb3300d18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:01.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.594+0000 7fb337f6a640 1 -- 172.21.15.7:0/4034334717 shutdown_connections 2024-04-25T10:02:01.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.594+0000 7fb337f6a640 1 -- 172.21.15.7:0/4034334717 wait complete. 2024-04-25T10:02:01.607 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-04-25T10:02:01.595+0000 7f376f398640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [...2,head] /dir/file auth v1 ap=1 DIRTYPARENT s=0 nl=2 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55deb258a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(14)0x10000000001:[<0x10000000000/file v8>,<0x1/dir v15>]//[]","memoryvalue":"(14)0x10000000001:[<0x10000000000/file v1>,<0x1/dir v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T10:02:01.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:02:01.610 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T10:02:01.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.708+0000 7f7b511f5640 1 Processor -- start 2024-04-25T10:02:01.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.708+0000 7f7b511f5640 1 -- start start 2024-04-25T10:02:01.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.709+0000 7f7b511f5640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7b4c0d3760 0x7f7b4c15eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.709+0000 7f7b511f5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7b4c15f1c0 0x7f7b4c0d3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.709+0000 7f7b511f5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4c0d4080 con 0x7f7b4c0ce830 2024-04-25T10:02:01.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.709+0000 7f7b511f5640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b4c0ce380 con 0x7f7b4c0d3760 2024-04-25T10:02:01.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.709+0000 7f7b511f5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b4c15f000 con 0x7f7b4c15f1c0 2024-04-25T10:02:01.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.709+0000 7f7b4ad9d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7b4c0d3760 0x7f7b4c15eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.709+0000 7f7b4ad9d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7b4c0d3760 0x7f7b4c15eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35916/0 (socket says 172.21.15.7:35916) 2024-04-25T10:02:01.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.709+0000 7f7b4ad9d640 1 -- 172.21.15.7:0/1215961736 learned_addr learned my addr 172.21.15.7:0/1215961736 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:01.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.710+0000 7f7b43fff640 1 --2- 172.21.15.7:0/1215961736 >> v2:172.21.15.55:3300/0 conn(0x7f7b4c15f1c0 0x7f7b4c0d3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.710+0000 7f7b4ad9d640 1 -- 172.21.15.7:0/1215961736 >> v2:172.21.15.55:3300/0 conn(0x7f7b4c15f1c0 msgr2=0x7f7b4c0d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:01.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.710+0000 7f7b4ad9d640 1 --2- 172.21.15.7:0/1215961736 >> v2:172.21.15.55:3300/0 conn(0x7f7b4c15f1c0 0x7f7b4c0d3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.710+0000 7f7b4ad9d640 1 -- 172.21.15.7:0/1215961736 >> v1:172.21.15.55:6789/0 conn(0x7f7b4c0ce830 legacy=0x7f7b4c0b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:01.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.710+0000 7f7b4ad9d640 1 -- 172.21.15.7:0/1215961736 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4c0ced10 con 0x7f7b4c0d3760 2024-04-25T10:02:01.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.710+0000 7f7b4ad9d640 1 --2- 172.21.15.7:0/1215961736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b4c0d3760 0x7f7b4c15eac0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c0b9830 tx=0x7f7b3c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de62db83deeb74c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:01.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.711+0000 7f7b4a59c640 1 -- 172.21.15.7:0/1215961736 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c037070 con 0x7f7b4c0d3760 2024-04-25T10:02:01.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.711+0000 7f7b4a59c640 1 -- 172.21.15.7:0/1215961736 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c032440 con 0x7f7b4c0d3760 2024-04-25T10:02:01.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.711+0000 7f7b4a59c640 1 -- 172.21.15.7:0/1215961736 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c032810 con 0x7f7b4c0d3760 2024-04-25T10:02:01.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.711+0000 7f7b511f5640 1 -- 172.21.15.7:0/1215961736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b4c0d3760 msgr2=0x7f7b4c15eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:01.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.711+0000 7f7b511f5640 1 --2- 172.21.15.7:0/1215961736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b4c0d3760 0x7f7b4c15eac0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c0b9830 tx=0x7f7b3c02a270 comp rx=0 tx=0).stop 2024-04-25T10:02:01.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.711+0000 7f7b511f5640 1 -- 172.21.15.7:0/1215961736 shutdown_connections 2024-04-25T10:02:01.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.711+0000 7f7b511f5640 1 --2- 172.21.15.7:0/1215961736 >> v2:172.21.15.55:3300/0 conn(0x7f7b4c15f1c0 0x7f7b4c0d3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.711+0000 7f7b511f5640 1 --2- 172.21.15.7:0/1215961736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b4c0d3760 0x7f7b4c15eac0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.711+0000 7f7b511f5640 1 -- 172.21.15.7:0/1215961736 >> 172.21.15.7:0/1215961736 conn(0x7f7b4c072680 msgr2=0x7f7b4c072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:01.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.711+0000 7f7b511f5640 1 -- 172.21.15.7:0/1215961736 shutdown_connections 2024-04-25T10:02:01.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.711+0000 7f7b511f5640 1 -- 172.21.15.7:0/1215961736 wait complete. 2024-04-25T10:02:01.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.713+0000 7f7b511f5640 1 Processor -- start 2024-04-25T10:02:01.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.713+0000 7f7b511f5640 1 -- start start 2024-04-25T10:02:01.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.713+0000 7f7b511f5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7b4c0ce830 0x7f7b4c158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.713+0000 7f7b511f5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b4c0d3760 0x7f7b4c15a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.713+0000 7f7b511f5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b4c15f1c0 0x7f7b4c0ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.713+0000 7f7b511f5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c0d1e20 con 0x7f7b4c0d3760 2024-04-25T10:02:01.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.713+0000 7f7b511f5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c0d2190 con 0x7f7b4c15f1c0 2024-04-25T10:02:01.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.713+0000 7f7b511f5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c15de10 con 0x7f7b4c0ce830 2024-04-25T10:02:01.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.713+0000 7f7b43fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b4c0d3760 0x7f7b4c15a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.713+0000 7f7b43fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b4c0d3760 0x7f7b4c15a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35920/0 (socket says 172.21.15.7:35920) 2024-04-25T10:02:01.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.713+0000 7f7b43fff640 1 -- 172.21.15.7:0/3808519310 learned_addr learned my addr 172.21.15.7:0/3808519310 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:01.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.714+0000 7f7b4ad9d640 1 --2- 172.21.15.7:0/3808519310 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7b4c0ce830 0x7f7b4c158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.714+0000 7f7b4b59e640 1 --2- 172.21.15.7:0/3808519310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b4c15f1c0 0x7f7b4c0ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.714+0000 7f7b43fff640 1 -- 172.21.15.7:0/3808519310 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7b4c0ce830 msgr2=0x7f7b4c158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:01.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.714+0000 7f7b43fff640 1 --2- 172.21.15.7:0/3808519310 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7b4c0ce830 0x7f7b4c158160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.714+0000 7f7b43fff640 1 -- 172.21.15.7:0/3808519310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b4c15f1c0 msgr2=0x7f7b4c0ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:01.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.714+0000 7f7b43fff640 1 --2- 172.21.15.7:0/3808519310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b4c15f1c0 0x7f7b4c0ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.714+0000 7f7b43fff640 1 -- 172.21.15.7:0/3808519310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4c158890 con 0x7f7b4c0d3760 2024-04-25T10:02:01.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.714+0000 7f7b4b59e640 1 --2- 172.21.15.7:0/3808519310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b4c15f1c0 0x7f7b4c0ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:02:01.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.714+0000 7f7b43fff640 1 --2- 172.21.15.7:0/3808519310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b4c0d3760 0x7f7b4c15a260 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400d5c0 tx=0x7f7b3400da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:01.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.714+0000 7f7b437fe640 1 -- 172.21.15.7:0/3808519310 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b340125f0 con 0x7f7b4c0d3760 2024-04-25T10:02:01.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.714+0000 7f7b437fe640 1 -- 172.21.15.7:0/3808519310 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b34019070 con 0x7f7b4c0d3760 2024-04-25T10:02:01.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.714+0000 7f7b511f5640 1 -- 172.21.15.7:0/3808519310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b4c158b70 con 0x7f7b4c0d3760 2024-04-25T10:02:01.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.714+0000 7f7b437fe640 1 -- 172.21.15.7:0/3808519310 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b340129d0 con 0x7f7b4c0d3760 2024-04-25T10:02:01.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.714+0000 7f7b511f5640 1 -- 172.21.15.7:0/3808519310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4c0ca9d0 con 0x7f7b4c0d3760 2024-04-25T10:02:01.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.716+0000 7f7b437fe640 1 -- 172.21.15.7:0/3808519310 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7b34012b70 con 0x7f7b4c0d3760 2024-04-25T10:02:01.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.716+0000 7f7b437fe640 1 --2- 172.21.15.7:0/3808519310 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7b2c06b500 0x7f7b2c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.716+0000 7f7b437fe640 1 -- 172.21.15.7:0/3808519310 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f7b3408a770 con 0x7f7b4c0d3760 2024-04-25T10:02:01.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.716+0000 7f7b4ad9d640 1 --2- 172.21.15.7:0/3808519310 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7b2c06b500 0x7f7b2c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.717+0000 7f7b4ad9d640 1 --2- 172.21.15.7:0/3808519310 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7b2c06b500 0x7f7b2c06d9c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c034000 tx=0x7f7b3c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:01.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.717+0000 7f7b53fd4740 1 Processor -- start 2024-04-25T10:02:01.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.717+0000 7f7b53fd4740 1 -- start start 2024-04-25T10:02:01.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.718+0000 7f7b53fd4740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55702df75b10 0x55702df78320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.718+0000 7f7b53fd4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55702df75ef0 0x55702df78860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.718+0000 7f7b53fd4740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55702df48770 0x55702df4bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.718+0000 7f7b53fd4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55702deb1da0 con 0x55702df75ef0 2024-04-25T10:02:01.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.718+0000 7f7b53fd4740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55702de5ab80 con 0x55702df48770 2024-04-25T10:02:01.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.718+0000 7f7b53fd4740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55702deade40 con 0x55702df75b10 2024-04-25T10:02:01.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.718+0000 7f7b43fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55702df75ef0 0x55702df78860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.718+0000 7f7b43fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55702df75ef0 0x55702df78860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35932/0 (socket says 172.21.15.7:35932) 2024-04-25T10:02:01.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.718+0000 7f7b43fff640 1 -- 172.21.15.7:0/3660735242 learned_addr learned my addr 172.21.15.7:0/3660735242 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:01.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.718+0000 7f7b43fff640 1 -- 172.21.15.7:0/3660735242 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55702df75b10 msgr2=0x55702df78320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:01.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.718+0000 7f7b43fff640 1 --2- 172.21.15.7:0/3660735242 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55702df75b10 0x55702df78320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.718+0000 7f7b43fff640 1 -- 172.21.15.7:0/3660735242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55702df48770 msgr2=0x55702df4bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:01.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.718+0000 7f7b4b59e640 1 --2- 172.21.15.7:0/3660735242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55702df48770 0x55702df4bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.718+0000 7f7b43fff640 1 --2- 172.21.15.7:0/3660735242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55702df48770 0x55702df4bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.718+0000 7f7b43fff640 1 -- 172.21.15.7:0/3660735242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55702de64f10 con 0x55702df75ef0 2024-04-25T10:02:01.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.719+0000 7f7b43fff640 1 --2- 172.21.15.7:0/3660735242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55702df75ef0 0x55702df78860 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f7b34088a80 tx=0x7f7b34059490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3027b241bbb1c020 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:01.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.719+0000 7f7b40ff9640 1 -- 172.21.15.7:0/3660735242 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b340613e0 con 0x55702df75ef0 2024-04-25T10:02:01.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.719+0000 7f7b40ff9640 1 -- 172.21.15.7:0/3660735242 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3405f070 con 0x55702df75ef0 2024-04-25T10:02:01.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.719+0000 7f7b40ff9640 1 -- 172.21.15.7:0/3660735242 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b34055340 con 0x55702df75ef0 2024-04-25T10:02:01.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.719+0000 7f7b53fd4740 1 -- 172.21.15.7:0/3660735242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55702df75ef0 msgr2=0x55702df78860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:01.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.719+0000 7f7b53fd4740 1 --2- 172.21.15.7:0/3660735242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55702df75ef0 0x55702df78860 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f7b34088a80 tx=0x7f7b34059490 comp rx=0 tx=0).stop 2024-04-25T10:02:01.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.719+0000 7f7b53fd4740 1 -- 172.21.15.7:0/3660735242 shutdown_connections 2024-04-25T10:02:01.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.719+0000 7f7b53fd4740 1 --2- 172.21.15.7:0/3660735242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55702df48770 0x55702df4bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.719+0000 7f7b53fd4740 1 --2- 172.21.15.7:0/3660735242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55702df75ef0 0x55702df78860 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.719+0000 7f7b53fd4740 1 --2- 172.21.15.7:0/3660735242 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55702df75b10 0x55702df78320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.719+0000 7f7b53fd4740 1 -- 172.21.15.7:0/3660735242 >> 172.21.15.7:0/3660735242 conn(0x55702df4a9e0 msgr2=0x55702df93320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:01.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.720+0000 7f7b53fd4740 1 -- 172.21.15.7:0/3660735242 shutdown_connections 2024-04-25T10:02:01.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.720+0000 7f7b53fd4740 1 -- 172.21.15.7:0/3660735242 wait complete. 2024-04-25T10:02:01.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.720+0000 7f7b53fd4740 1 -- start start 2024-04-25T10:02:01.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.720+0000 7f7b53fd4740 1 Processor -- start 2024-04-25T10:02:01.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.721+0000 7f7b53fd4740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55702df75b10 0x55702df9b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.721+0000 7f7b53fd4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55702df75ef0 0x55702df923e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.721+0000 7f7b53fd4740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55702df6cf30 0x55702df92920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.721+0000 7f7b53fd4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55702df4db90 con 0x55702df75ef0 2024-04-25T10:02:01.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.721+0000 7f7b53fd4740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55702de504b0 con 0x55702df6cf30 2024-04-25T10:02:01.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.721+0000 7f7b53fd4740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55702df4de70 con 0x55702df75b10 2024-04-25T10:02:01.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.721+0000 7f7b53fd4740 10 client.0 _ll_register_callbacks cb 0x55702de90180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:02:01.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.721+0000 7f7b43fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55702df75ef0 0x55702df923e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.721+0000 7f7b43fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55702df75ef0 0x55702df923e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35940/0 (socket says 172.21.15.7:35940) 2024-04-25T10:02:01.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.721+0000 7f7b43fff640 1 -- 172.21.15.7:0/1959445216 learned_addr learned my addr 172.21.15.7:0/1959445216 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:01.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.721+0000 7f7b4b59e640 1 --2- 172.21.15.7:0/1959445216 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55702df6cf30 0x55702df92920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.721+0000 7f7b4ad9d640 1 --2- 172.21.15.7:0/1959445216 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55702df75b10 0x55702df9b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.721+0000 7f7b43fff640 1 -- 172.21.15.7:0/1959445216 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55702df75b10 msgr2=0x55702df9b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:01.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.721+0000 7f7b43fff640 1 --2- 172.21.15.7:0/1959445216 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55702df75b10 0x55702df9b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.721+0000 7f7b43fff640 1 -- 172.21.15.7:0/1959445216 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55702df6cf30 msgr2=0x55702df92920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:01.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.721+0000 7f7b43fff640 1 --2- 172.21.15.7:0/1959445216 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55702df6cf30 0x55702df92920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.721+0000 7f7b43fff640 1 -- 172.21.15.7:0/1959445216 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55702dc907d0 con 0x55702df75ef0 2024-04-25T10:02:01.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.721+0000 7f7b4ad9d640 1 --2- 172.21.15.7:0/1959445216 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55702df75b10 0x55702df9b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:02:01.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.721+0000 7f7b4b59e640 1 --2- 172.21.15.7:0/1959445216 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55702df6cf30 0x55702df92920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:02:01.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.721+0000 7f7b43fff640 1 --2- 172.21.15.7:0/1959445216 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55702df75ef0 0x55702df923e0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f7b34088ad0 tx=0x7f7b34000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9d48b003a94df93 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:01.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.722+0000 7f7b29ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:02:01.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.722+0000 7f7b29ffb640 1 -- 172.21.15.7:0/1959445216 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b34087070 con 0x55702df75ef0 2024-04-25T10:02:01.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.722+0000 7f7b29ffb640 1 -- 172.21.15.7:0/1959445216 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f7b34055340 con 0x55702df75ef0 2024-04-25T10:02:01.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.722+0000 7f7b53fd4740 1 -- 172.21.15.7:0/1959445216 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7b3405f070 con 0x55702df75ef0 2024-04-25T10:02:01.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.722+0000 7f7b29ffb640 1 -- 172.21.15.7:0/1959445216 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b34060f50 con 0x55702df75ef0 2024-04-25T10:02:01.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.722+0000 7f7b53fd4740 10 client.8133 fetch_fsmap learned FSMap version 66 2024-04-25T10:02:01.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.722+0000 7f7b53fd4740 1 -- 172.21.15.7:0/1959445216 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x55702dbc63f0 con 0x55702df75ef0 2024-04-25T10:02:01.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.722+0000 7f7b29ffb640 1 -- 172.21.15.7:0/1959445216 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3405f070 con 0x55702df75ef0 2024-04-25T10:02:01.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.722+0000 7f7b29ffb640 1 -- 172.21.15.7:0/1959445216 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 66) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7b34013070 con 0x55702df75ef0 2024-04-25T10:02:01.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.722+0000 7f7b53fd4740 10 client.8133 fetch_fsmap finished waiting for FSMap version 66 2024-04-25T10:02:01.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.722+0000 7f7b53fd4740 10 client.8133 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T10:02:01.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.722+0000 7f7b53fd4740 20 client.8133 populate_metadata read hostname 'smithi007' 2024-04-25T10:02:01.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.722+0000 7f7b53fd4740 1 --2- 172.21.15.7:0/1959445216 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x55702df94920 0x55702df94d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.722+0000 7f7b53fd4740 4 client.8133 mds_command: new command op to 8022 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:02:01.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.722+0000 7f7b53fd4740 1 -- 172.21.15.7:0/1959445216 --> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55702debf2e0 con 0x55702df94920 2024-04-25T10:02:01.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.722+0000 7f7b4ad9d640 1 --2- 172.21.15.7:0/1959445216 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x55702df94920 0x55702df94d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.723+0000 7f7b4ad9d640 1 --2- 172.21.15.7:0/1959445216 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x55702df94920 0x55702df94d30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e44465657babfc1f server_cookie=ef5054da48a81e46 in_seq=0 out_seq=0 2024-04-25T10:02:01.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.723+0000 7f7b29ffb640 10 client.8133 ms_handle_connect on v2:172.21.15.7:6836/1061077733 2024-04-25T10:02:01.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.723+0000 7f7b29ffb640 1 -- 172.21.15.7:0/1959445216 <== mds.0 v2:172.21.15.7:6836/1061077733 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55702debf2e0 con 0x55702df94920 2024-04-25T10:02:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.723+0000 7f7b29ffb640 10 client.8133 handle_command_reply: tid=0 2024-04-25T10:02:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.723+0000 7f7b53fd4740 1 client.8133 shutdown 2024-04-25T10:02:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.723+0000 7f7b53fd4740 1 -- 172.21.15.7:0/1959445216 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55702df75ef0 msgr2=0x55702df923e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.723+0000 7f7b53fd4740 1 --2- 172.21.15.7:0/1959445216 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55702df75ef0 0x55702df923e0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f7b34088ad0 tx=0x7f7b34000bc0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.723+0000 7f7b53fd4740 1 -- 172.21.15.7:0/1959445216 shutdown_connections 2024-04-25T10:02:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.723+0000 7f7b53fd4740 1 --2- 172.21.15.7:0/1959445216 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x55702df94920 0x55702df94d30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.723+0000 7f7b53fd4740 1 --2- 172.21.15.7:0/1959445216 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55702df6cf30 0x55702df92920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.723+0000 7f7b53fd4740 1 --2- 172.21.15.7:0/1959445216 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55702df75ef0 0x55702df923e0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.723+0000 7f7b29ffb640 0 client.8133 ms_handle_reset on v2:172.21.15.7:6836/1061077733 2024-04-25T10:02:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.723+0000 7f7b53fd4740 1 --2- 172.21.15.7:0/1959445216 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55702df75b10 0x55702df9b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.723+0000 7f7b53fd4740 1 -- 172.21.15.7:0/1959445216 >> 172.21.15.7:0/1959445216 conn(0x55702df48770 msgr2=0x55702df49420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.723+0000 7f7b53fd4740 1 -- 172.21.15.7:0/1959445216 shutdown_connections 2024-04-25T10:02:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.723+0000 7f7b53fd4740 1 -- 172.21.15.7:0/1959445216 wait complete. 2024-04-25T10:02:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.723+0000 7f7b53fd4740 20 client.8133 trim_cache size 0 max 16384 2024-04-25T10:02:01.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.739+0000 7f7b53fd4740 1 Processor -- start 2024-04-25T10:02:01.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.739+0000 7f7b53fd4740 1 -- start start 2024-04-25T10:02:01.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.739+0000 7f7b53fd4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55702df6cf30 0x55702df90090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.739+0000 7f7b53fd4740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55702df75b10 0x55702df94d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.739+0000 7f7b53fd4740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55702df75ef0 0x55702df73610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.739+0000 7f7b53fd4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c200600 con 0x55702df6cf30 2024-04-25T10:02:01.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.739+0000 7f7b53fd4740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c1ff760 con 0x55702df75b10 2024-04-25T10:02:01.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.739+0000 7f7b53fd4740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c0cbcb0 con 0x55702df75ef0 2024-04-25T10:02:01.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.739+0000 7f7b4ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55702df6cf30 0x55702df90090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.739+0000 7f7b4ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55702df6cf30 0x55702df90090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35946/0 (socket says 172.21.15.7:35946) 2024-04-25T10:02:01.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.739+0000 7f7b4ad9d640 1 -- 172.21.15.7:0/961080404 learned_addr learned my addr 172.21.15.7:0/961080404 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:01.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.739+0000 7f7b43fff640 1 --2- 172.21.15.7:0/961080404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55702df75b10 0x55702df94d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.740+0000 7f7b4b59e640 1 --2- 172.21.15.7:0/961080404 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55702df75ef0 0x55702df73610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.740+0000 7f7b4ad9d640 1 -- 172.21.15.7:0/961080404 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55702df75ef0 msgr2=0x55702df73610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:01.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.740+0000 7f7b4ad9d640 1 --2- 172.21.15.7:0/961080404 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55702df75ef0 0x55702df73610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.740+0000 7f7b4ad9d640 1 -- 172.21.15.7:0/961080404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55702df75b10 msgr2=0x55702df94d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:01.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.740+0000 7f7b4ad9d640 1 --2- 172.21.15.7:0/961080404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55702df75b10 0x55702df94d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.740+0000 7f7b4ad9d640 1 -- 172.21.15.7:0/961080404 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55702db860f0 con 0x55702df6cf30 2024-04-25T10:02:01.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.740+0000 7f7b4ad9d640 1 --2- 172.21.15.7:0/961080404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55702df6cf30 0x55702df90090 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c009960 tx=0x7f7b3c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=691acb7b17e0769c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:01.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.740+0000 7f7b2bfff640 1 -- 172.21.15.7:0/961080404 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c04f070 con 0x55702df6cf30 2024-04-25T10:02:01.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.740+0000 7f7b2bfff640 1 -- 172.21.15.7:0/961080404 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c04a710 con 0x55702df6cf30 2024-04-25T10:02:01.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.740+0000 7f7b2bfff640 1 -- 172.21.15.7:0/961080404 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c037040 con 0x55702df6cf30 2024-04-25T10:02:01.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.740+0000 7f7b53fd4740 1 -- 172.21.15.7:0/961080404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55702df6cf30 msgr2=0x55702df90090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:01.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.740+0000 7f7b53fd4740 1 --2- 172.21.15.7:0/961080404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55702df6cf30 0x55702df90090 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c009960 tx=0x7f7b3c02c000 comp rx=0 tx=0).stop 2024-04-25T10:02:01.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.741+0000 7f7b53fd4740 1 -- 172.21.15.7:0/961080404 shutdown_connections 2024-04-25T10:02:01.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.741+0000 7f7b53fd4740 1 --2- 172.21.15.7:0/961080404 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55702df75ef0 0x55702df73610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.741+0000 7f7b53fd4740 1 --2- 172.21.15.7:0/961080404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55702df75b10 0x55702df94d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.741+0000 7f7b53fd4740 1 --2- 172.21.15.7:0/961080404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55702df6cf30 0x55702df90090 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.741+0000 7f7b53fd4740 1 -- 172.21.15.7:0/961080404 >> 172.21.15.7:0/961080404 conn(0x55702df48770 msgr2=0x55702df4d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:01.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.741+0000 7f7b53fd4740 1 -- 172.21.15.7:0/961080404 shutdown_connections 2024-04-25T10:02:01.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.741+0000 7f7b53fd4740 1 -- 172.21.15.7:0/961080404 wait complete. 2024-04-25T10:02:01.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.741+0000 7f7b53fd4740 1 -- start start 2024-04-25T10:02:01.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.741+0000 7f7b53fd4740 1 Processor -- start 2024-04-25T10:02:01.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.742+0000 7f7b53fd4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55702df6cf30 0x55702dfe68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.742+0000 7f7b53fd4740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55702df75b10 0x55702df47600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.742+0000 7f7b53fd4740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55702df75ef0 0x55702e001170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.742+0000 7f7b53fd4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55702df43f00 con 0x55702df6cf30 2024-04-25T10:02:01.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.742+0000 7f7b53fd4740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c1ff260 con 0x55702df75b10 2024-04-25T10:02:01.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.742+0000 7f7b53fd4740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55702df95240 con 0x55702df75ef0 2024-04-25T10:02:01.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.742+0000 7f7b53fd4740 10 client.0 _ll_register_callbacks cb 0x7f7b34054ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:02:01.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.742+0000 7f7b4ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55702df6cf30 0x55702dfe68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.742+0000 7f7b4ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55702df6cf30 0x55702dfe68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35952/0 (socket says 172.21.15.7:35952) 2024-04-25T10:02:01.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.742+0000 7f7b4ad9d640 1 -- 172.21.15.7:0/3739366452 learned_addr learned my addr 172.21.15.7:0/3739366452 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:01.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.742+0000 7f7b4b59e640 1 --2- 172.21.15.7:0/3739366452 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55702df75ef0 0x55702e001170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.742+0000 7f7b43fff640 1 --2- 172.21.15.7:0/3739366452 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55702df75b10 0x55702df47600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.742+0000 7f7b4ad9d640 1 -- 172.21.15.7:0/3739366452 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55702df75ef0 msgr2=0x55702e001170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:01.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.742+0000 7f7b4ad9d640 1 --2- 172.21.15.7:0/3739366452 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55702df75ef0 0x55702e001170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.742+0000 7f7b4ad9d640 1 -- 172.21.15.7:0/3739366452 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55702df75b10 msgr2=0x55702df47600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:01.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.742+0000 7f7b4ad9d640 1 --2- 172.21.15.7:0/3739366452 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55702df75b10 0x55702df47600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.742+0000 7f7b4ad9d640 1 -- 172.21.15.7:0/3739366452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55702df9ab10 con 0x55702df6cf30 2024-04-25T10:02:01.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.742+0000 7f7b4ad9d640 1 --2- 172.21.15.7:0/3739366452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55702df6cf30 0x55702dfe68e0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c009960 tx=0x7f7b3c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c5676e50fe7af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:01.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.742+0000 7f7b29ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:02:01.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.743+0000 7f7b29ffb640 1 -- 172.21.15.7:0/3739366452 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c05a060 con 0x55702df6cf30 2024-04-25T10:02:01.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.743+0000 7f7b29ffb640 1 -- 172.21.15.7:0/3739366452 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f7b3c004230 con 0x55702df6cf30 2024-04-25T10:02:01.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.743+0000 7f7b53fd4740 1 -- 172.21.15.7:0/3739366452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7b3c04a710 con 0x55702df6cf30 2024-04-25T10:02:01.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.743+0000 7f7b29ffb640 1 -- 172.21.15.7:0/3739366452 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b3c060050 con 0x55702df6cf30 2024-04-25T10:02:01.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.743+0000 7f7b53fd4740 10 client.8139 fetch_fsmap learned FSMap version 66 2024-04-25T10:02:01.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.743+0000 7f7b53fd4740 1 -- 172.21.15.7:0/3739366452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x55702e000cb0 con 0x55702df6cf30 2024-04-25T10:02:01.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.743+0000 7f7b29ffb640 1 -- 172.21.15.7:0/3739366452 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c04a710 con 0x55702df6cf30 2024-04-25T10:02:01.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.743+0000 7f7b29ffb640 1 -- 172.21.15.7:0/3739366452 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 66) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7b3c063020 con 0x55702df6cf30 2024-04-25T10:02:01.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.743+0000 7f7b53fd4740 10 client.8139 fetch_fsmap finished waiting for FSMap version 66 2024-04-25T10:02:01.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.743+0000 7f7b53fd4740 10 client.8139 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T10:02:01.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.743+0000 7f7b53fd4740 20 client.8139 populate_metadata read hostname 'smithi007' 2024-04-25T10:02:01.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.743+0000 7f7b53fd4740 1 --2- 172.21.15.7:0/3739366452 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x55702df933d0 0x55702df48fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:01.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.743+0000 7f7b53fd4740 4 client.8139 mds_command: new command op to 8022 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T10:02:01.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.743+0000 7f7b53fd4740 1 -- 172.21.15.7:0/3739366452 --> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55702deb9630 con 0x55702df933d0 2024-04-25T10:02:01.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.743+0000 7f7b43fff640 1 --2- 172.21.15.7:0/3739366452 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x55702df933d0 0x55702df48fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:01.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.743+0000 7f7b29ffb640 10 client.8139 ms_handle_connect on v2:172.21.15.7:6836/1061077733 2024-04-25T10:02:01.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.743+0000 7f7b43fff640 1 --2- 172.21.15.7:0/3739366452 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x55702df933d0 0x55702df48fa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=881805f021fdde84 server_cookie=751219891a4e3cee in_seq=0 out_seq=0 2024-04-25T10:02:01.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.743+0000 7f7b29ffb640 1 -- 172.21.15.7:0/3739366452 <== mds.0 v2:172.21.15.7:6836/1061077733 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+263 (crc 0 0 0) 0x55702deb9630 con 0x55702df933d0 2024-04-25T10:02:01.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.744+0000 7f7b29ffb640 10 client.8139 handle_command_reply: tid=0 2024-04-25T10:02:01.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.744+0000 7f7b53fd4740 1 client.8139 shutdown 2024-04-25T10:02:01.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.744+0000 7f7b53fd4740 1 -- 172.21.15.7:0/3739366452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55702df6cf30 msgr2=0x55702dfe68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:01.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.744+0000 7f7b53fd4740 1 --2- 172.21.15.7:0/3739366452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55702df6cf30 0x55702dfe68e0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c009960 tx=0x7f7b3c004730 comp rx=0 tx=0).stop 2024-04-25T10:02:01.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.744+0000 7f7b53fd4740 1 -- 172.21.15.7:0/3739366452 shutdown_connections 2024-04-25T10:02:01.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.744+0000 7f7b53fd4740 1 --2- 172.21.15.7:0/3739366452 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x55702df933d0 0x55702df48fa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.744+0000 7f7b53fd4740 1 --2- 172.21.15.7:0/3739366452 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55702df75ef0 0x55702e001170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.744+0000 7f7b53fd4740 1 --2- 172.21.15.7:0/3739366452 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55702df75b10 0x55702df47600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.744+0000 7f7b53fd4740 1 --2- 172.21.15.7:0/3739366452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55702df6cf30 0x55702dfe68e0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.744+0000 7f7b29ffb640 0 client.8139 ms_handle_reset on v2:172.21.15.7:6836/1061077733 2024-04-25T10:02:01.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.744+0000 7f7b53fd4740 1 -- 172.21.15.7:0/3739366452 >> 172.21.15.7:0/3739366452 conn(0x55702df48770 msgr2=0x55702df4c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:01.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.744+0000 7f7b53fd4740 1 -- 172.21.15.7:0/3739366452 shutdown_connections 2024-04-25T10:02:01.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.744+0000 7f7b53fd4740 1 -- 172.21.15.7:0/3739366452 wait complete. 2024-04-25T10:02:01.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.744+0000 7f7b53fd4740 20 client.8139 trim_cache size 0 max 16384 2024-04-25T10:02:01.755 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:02:01.755 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T10:02:01.755 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-04-25T10:02:01.755 INFO:teuthology.orchestra.run.smithi007.stdout: "32661b4e-6757-4535-9727-801059a04ef4": { 2024-04-25T10:02:01.755 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/dir", 2024-04-25T10:02:01.756 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "32661b4e-6757-4535-9727-801059a04ef4", 2024-04-25T10:02:01.756 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,repair" 2024-04-25T10:02:01.756 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:02:01.756 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:02:01.756 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:02:01.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.744+0000 7f7b511f5640 1 -- 172.21.15.7:0/3808519310 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7b2c06b500 msgr2=0x7f7b2c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:01.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.744+0000 7f7b511f5640 1 --2- 172.21.15.7:0/3808519310 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7b2c06b500 0x7f7b2c06d9c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c034000 tx=0x7f7b3c02e000 comp rx=0 tx=0).stop 2024-04-25T10:02:01.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.744+0000 7f7b511f5640 1 -- 172.21.15.7:0/3808519310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b4c0d3760 msgr2=0x7f7b4c15a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:01.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.744+0000 7f7b511f5640 1 --2- 172.21.15.7:0/3808519310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b4c0d3760 0x7f7b4c15a260 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400d5c0 tx=0x7f7b3400da80 comp rx=0 tx=0).stop 2024-04-25T10:02:01.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.744+0000 7f7b511f5640 1 -- 172.21.15.7:0/3808519310 shutdown_connections 2024-04-25T10:02:01.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.744+0000 7f7b511f5640 1 --2- 172.21.15.7:0/3808519310 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7b2c06b500 0x7f7b2c06d9c0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.744+0000 7f7b511f5640 1 --2- 172.21.15.7:0/3808519310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b4c15f1c0 0x7f7b4c0ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.744+0000 7f7b511f5640 1 --2- 172.21.15.7:0/3808519310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b4c0d3760 0x7f7b4c15a260 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.744+0000 7f7b511f5640 1 --2- 172.21.15.7:0/3808519310 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7b4c0ce830 0x7f7b4c158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:01.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.744+0000 7f7b511f5640 1 -- 172.21.15.7:0/3808519310 >> 172.21.15.7:0/3808519310 conn(0x7f7b4c072680 msgr2=0x7f7b4c0c96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:01.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.744+0000 7f7b511f5640 1 -- 172.21.15.7:0/3808519310 shutdown_connections 2024-04-25T10:02:01.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:01.744+0000 7f7b511f5640 1 -- 172.21.15.7:0/3808519310 wait complete. 2024-04-25T10:02:01.759 INFO:tasks.cephfs.filesystem:scrub status for tag:32661b4e-6757-4535-9727-801059a04ef4 - {'path': '/dir', 'tag': '32661b4e-6757-4535-9727-801059a04ef4', 'options': 'recursive,repair'} 2024-04-25T10:02:27.136 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:02:27.139 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:02:31.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:02:31.761 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T10:02:31.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.873+0000 7effb0b89640 1 Processor -- start 2024-04-25T10:02:31.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.873+0000 7effb0b89640 1 -- start start 2024-04-25T10:02:31.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.874+0000 7effb0b89640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7effac06d130 0x7effac071130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:31.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.874+0000 7effb0b89640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effac1453c0 con 0x7effac144fe0 2024-04-25T10:02:31.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.874+0000 7effb0b89640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effac06d6a0 con 0x7effac071670 2024-04-25T10:02:31.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.874+0000 7effb0b89640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effac0a8560 con 0x7effac06d130 2024-04-25T10:02:31.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.874+0000 7effa3fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7effac06d130 0x7effac071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:31.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.874+0000 7effaa59c640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7effac144fe0 0x7effac06e560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40736/0 (socket says 172.21.15.7:40736) 2024-04-25T10:02:31.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.874+0000 7effaa59c640 1 -- 172.21.15.7:0/646655270 learned_addr learned my addr 172.21.15.7:0/646655270 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:02:31.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.874+0000 7effa3fff640 1 -- 172.21.15.7:0/646655270 >> v1:172.21.15.55:6789/0 conn(0x7effac071670 legacy=0x7effac15c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:31.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.874+0000 7effa3fff640 1 -- 172.21.15.7:0/646655270 >> v1:172.21.15.7:6789/0 conn(0x7effac144fe0 legacy=0x7effac06e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:31.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.874+0000 7effa3fff640 1 -- 172.21.15.7:0/646655270 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac06d980 con 0x7effac06d130 2024-04-25T10:02:31.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.875+0000 7effa3fff640 1 --2- 172.21.15.7:0/646655270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effac06d130 0x7effac071130 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7eff940097a0 tx=0x7eff9402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdda41f6b0db9865 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:31.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.875+0000 7effa9d9b640 1 -- 172.21.15.7:0/646655270 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff94037070 con 0x7effac06d130 2024-04-25T10:02:31.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.875+0000 7effa9d9b640 1 -- 172.21.15.7:0/646655270 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff94032440 con 0x7effac06d130 2024-04-25T10:02:31.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.875+0000 7effa9d9b640 1 -- 172.21.15.7:0/646655270 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff94032810 con 0x7effac06d130 2024-04-25T10:02:31.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.876+0000 7effb0b89640 1 -- 172.21.15.7:0/646655270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effac06d130 msgr2=0x7effac071130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:31.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.876+0000 7effb0b89640 1 --2- 172.21.15.7:0/646655270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effac06d130 0x7effac071130 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7eff940097a0 tx=0x7eff9402a1e0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.876+0000 7effb0b89640 1 -- 172.21.15.7:0/646655270 shutdown_connections 2024-04-25T10:02:31.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.876+0000 7effb0b89640 1 --2- 172.21.15.7:0/646655270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effac06d130 0x7effac071130 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.876+0000 7effb0b89640 1 -- 172.21.15.7:0/646655270 >> 172.21.15.7:0/646655270 conn(0x7effac06ab60 msgr2=0x7effac06af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:31.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.876+0000 7effb0b89640 1 -- 172.21.15.7:0/646655270 shutdown_connections 2024-04-25T10:02:31.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.876+0000 7effb0b89640 1 -- 172.21.15.7:0/646655270 wait complete. 2024-04-25T10:02:31.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.877+0000 7effb0b89640 1 Processor -- start 2024-04-25T10:02:31.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.877+0000 7effb0b89640 1 -- start start 2024-04-25T10:02:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.878+0000 7effb0b89640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7effac06d130 0x7effac1f58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.878+0000 7effb0b89640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effac071670 0x7effac132890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.878+0000 7effb0b89640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effac144fe0 0x7effac130a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.878+0000 7effb0b89640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac15be50 con 0x7effac071670 2024-04-25T10:02:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.878+0000 7effb0b89640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac06df40 con 0x7effac144fe0 2024-04-25T10:02:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.878+0000 7effb0b89640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effac15ca80 con 0x7effac06d130 2024-04-25T10:02:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.878+0000 7effa3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effac071670 0x7effac132890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.878+0000 7effa3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effac071670 0x7effac132890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48204/0 (socket says 172.21.15.7:48204) 2024-04-25T10:02:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.878+0000 7effa3fff640 1 -- 172.21.15.7:0/2370466056 learned_addr learned my addr 172.21.15.7:0/2370466056 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.878+0000 7effaa59c640 1 --2- 172.21.15.7:0/2370466056 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7effac06d130 0x7effac1f58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.878+0000 7effaad9d640 1 --2- 172.21.15.7:0/2370466056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effac144fe0 0x7effac130a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.879+0000 7effa3fff640 1 -- 172.21.15.7:0/2370466056 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7effac06d130 msgr2=0x7effac1f58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.879+0000 7effa3fff640 1 --2- 172.21.15.7:0/2370466056 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7effac06d130 0x7effac1f58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.879+0000 7effa3fff640 1 -- 172.21.15.7:0/2370466056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effac144fe0 msgr2=0x7effac130a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.879+0000 7effa3fff640 1 --2- 172.21.15.7:0/2370466056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effac144fe0 0x7effac130a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.879+0000 7effa3fff640 1 -- 172.21.15.7:0/2370466056 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac1f5e20 con 0x7effac071670 2024-04-25T10:02:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.879+0000 7effa3fff640 1 --2- 172.21.15.7:0/2370466056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effac071670 0x7effac132890 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7eff9402a220 tx=0x7eff940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.879+0000 7effa2ffd640 1 -- 172.21.15.7:0/2370466056 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff94037040 con 0x7effac071670 2024-04-25T10:02:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.879+0000 7effa2ffd640 1 -- 172.21.15.7:0/2370466056 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff94042070 con 0x7effac071670 2024-04-25T10:02:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.879+0000 7effb0b89640 1 -- 172.21.15.7:0/2370466056 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effac12d8b0 con 0x7effac071670 2024-04-25T10:02:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.879+0000 7effa2ffd640 1 -- 172.21.15.7:0/2370466056 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff94030bd0 con 0x7effac071670 2024-04-25T10:02:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.879+0000 7effb0b89640 1 -- 172.21.15.7:0/2370466056 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effac12de70 con 0x7effac071670 2024-04-25T10:02:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.880+0000 7effa2ffd640 1 -- 172.21.15.7:0/2370466056 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7eff94047460 con 0x7effac071670 2024-04-25T10:02:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.881+0000 7effa2ffd640 1 --2- 172.21.15.7:0/2370466056 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7eff8c06b4d0 0x7eff8c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.881+0000 7effa2ffd640 1 -- 172.21.15.7:0/2370466056 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7eff940ab150 con 0x7effac071670 2024-04-25T10:02:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.881+0000 7effaa59c640 1 --2- 172.21.15.7:0/2370466056 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7eff8c06b4d0 0x7eff8c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.882+0000 7effaa59c640 1 --2- 172.21.15.7:0/2370466056 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7eff8c06b4d0 0x7eff8c06d990 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7eff9c000f60 tx=0x7eff9c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.882+0000 7effb396e740 1 Processor -- start 2024-04-25T10:02:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.882+0000 7effb396e740 1 -- start start 2024-04-25T10:02:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.883+0000 7effb396e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e7b7b8b10 0x560e7b7bb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.883+0000 7effb396e740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560e7b7b8ef0 0x560e7b7bb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.883+0000 7effb396e740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e7b78b770 0x560e7b78ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.883+0000 7effb396e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7b6f4da0 con 0x560e7b7b8b10 2024-04-25T10:02:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.883+0000 7effb396e740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7b69db80 con 0x560e7b7b8ef0 2024-04-25T10:02:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.883+0000 7effb396e740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x560e7b6f0e40 con 0x560e7b78b770 2024-04-25T10:02:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.883+0000 7effaa59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e7b7b8b10 0x560e7b7bb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.883+0000 7effaa59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e7b7b8b10 0x560e7b7bb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48214/0 (socket says 172.21.15.7:48214) 2024-04-25T10:02:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.883+0000 7effaa59c640 1 -- 172.21.15.7:0/3017663638 learned_addr learned my addr 172.21.15.7:0/3017663638 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.883+0000 7effa3fff640 1 --2- 172.21.15.7:0/3017663638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560e7b7b8ef0 0x560e7b7bb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.883+0000 7effaad9d640 1 --2- 172.21.15.7:0/3017663638 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e7b78b770 0x560e7b78ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.883+0000 7effaa59c640 1 -- 172.21.15.7:0/3017663638 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e7b78b770 msgr2=0x560e7b78ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.883+0000 7effaa59c640 1 --2- 172.21.15.7:0/3017663638 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e7b78b770 0x560e7b78ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.883+0000 7effaa59c640 1 -- 172.21.15.7:0/3017663638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560e7b7b8ef0 msgr2=0x560e7b7bb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.883+0000 7effaa59c640 1 --2- 172.21.15.7:0/3017663638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560e7b7b8ef0 0x560e7b7bb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.883+0000 7effaa59c640 1 -- 172.21.15.7:0/3017663638 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e7b6a7f10 con 0x560e7b7b8b10 2024-04-25T10:02:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.883+0000 7effaad9d640 1 --2- 172.21.15.7:0/3017663638 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e7b78b770 0x560e7b78ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:02:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.884+0000 7effaa59c640 1 --2- 172.21.15.7:0/3017663638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e7b7b8b10 0x560e7b7bb320 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7eff9c005aa0 tx=0x7eff9c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ff0cfa1d614ea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.884+0000 7eff8bfff640 1 -- 172.21.15.7:0/3017663638 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c007710 con 0x560e7b7b8b10 2024-04-25T10:02:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.884+0000 7eff8bfff640 1 -- 172.21.15.7:0/3017663638 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9c00e6e0 con 0x560e7b7b8b10 2024-04-25T10:02:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.884+0000 7eff8bfff640 1 -- 172.21.15.7:0/3017663638 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c00eab0 con 0x560e7b7b8b10 2024-04-25T10:02:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.884+0000 7effb396e740 1 -- 172.21.15.7:0/3017663638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e7b7b8b10 msgr2=0x560e7b7bb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.884+0000 7effb396e740 1 --2- 172.21.15.7:0/3017663638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e7b7b8b10 0x560e7b7bb320 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7eff9c005aa0 tx=0x7eff9c011000 comp rx=0 tx=0).stop 2024-04-25T10:02:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.884+0000 7effb396e740 1 -- 172.21.15.7:0/3017663638 shutdown_connections 2024-04-25T10:02:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.884+0000 7effb396e740 1 --2- 172.21.15.7:0/3017663638 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e7b78b770 0x560e7b78ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.884+0000 7effb396e740 1 --2- 172.21.15.7:0/3017663638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560e7b7b8ef0 0x560e7b7bb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.884+0000 7effb396e740 1 --2- 172.21.15.7:0/3017663638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e7b7b8b10 0x560e7b7bb320 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.884+0000 7effb396e740 1 -- 172.21.15.7:0/3017663638 >> 172.21.15.7:0/3017663638 conn(0x560e7b78d9e0 msgr2=0x560e7b7d6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:31.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.885+0000 7effb396e740 1 -- 172.21.15.7:0/3017663638 shutdown_connections 2024-04-25T10:02:31.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.885+0000 7effb396e740 1 -- 172.21.15.7:0/3017663638 wait complete. 2024-04-25T10:02:31.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.885+0000 7effb396e740 1 -- start start 2024-04-25T10:02:31.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.885+0000 7effb396e740 1 Processor -- start 2024-04-25T10:02:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.886+0000 7effb396e740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e7b7b8b10 0x560e7b7ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.886+0000 7effb396e740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560e7b7b8ef0 0x560e7b78a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.886+0000 7effb396e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e7b7af8c0 0x560e7b78ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.886+0000 7effb396e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7b790b90 con 0x560e7b7af8c0 2024-04-25T10:02:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.886+0000 7effb396e740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7b6934b0 con 0x560e7b7b8ef0 2024-04-25T10:02:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.886+0000 7effb396e740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x560e7b790e70 con 0x560e7b7b8b10 2024-04-25T10:02:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.886+0000 7effb396e740 10 client.0 _ll_register_callbacks cb 0x560e7b6d3180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:02:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.886+0000 7effaad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e7b7af8c0 0x560e7b78ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.886+0000 7effaad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e7b7af8c0 0x560e7b78ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48228/0 (socket says 172.21.15.7:48228) 2024-04-25T10:02:31.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.886+0000 7effaad9d640 1 -- 172.21.15.7:0/3423686757 learned_addr learned my addr 172.21.15.7:0/3423686757 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:31.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.886+0000 7effa3fff640 1 --2- 172.21.15.7:0/3423686757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560e7b7b8ef0 0x560e7b78a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:31.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.886+0000 7effaa59c640 1 --2- 172.21.15.7:0/3423686757 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e7b7b8b10 0x560e7b7ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:31.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.887+0000 7effaad9d640 1 -- 172.21.15.7:0/3423686757 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e7b7b8b10 msgr2=0x560e7b7ae1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:31.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.887+0000 7effaad9d640 1 --2- 172.21.15.7:0/3423686757 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e7b7b8b10 0x560e7b7ae1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.887+0000 7effaad9d640 1 -- 172.21.15.7:0/3423686757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560e7b7b8ef0 msgr2=0x560e7b78a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:31.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.887+0000 7effaad9d640 1 --2- 172.21.15.7:0/3423686757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560e7b7b8ef0 0x560e7b78a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.887+0000 7effaad9d640 1 -- 172.21.15.7:0/3423686757 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560e7b4d37d0 con 0x560e7b7af8c0 2024-04-25T10:02:31.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.887+0000 7effaad9d640 1 --2- 172.21.15.7:0/3423686757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e7b7af8c0 0x560e7b78ab40 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7effa4010510 tx=0x7effa40109d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb47513b8132b12c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:31.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.887+0000 7eff897fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:02:31.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.887+0000 7eff897fa640 1 -- 172.21.15.7:0/3423686757 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa4019030 con 0x560e7b7af8c0 2024-04-25T10:02:31.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.887+0000 7eff897fa640 1 -- 172.21.15.7:0/3423686757 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7effa4003be0 con 0x560e7b7af8c0 2024-04-25T10:02:31.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.887+0000 7effb396e740 1 -- 172.21.15.7:0/3423686757 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7eff9c00e6e0 con 0x560e7b7af8c0 2024-04-25T10:02:31.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.887+0000 7eff897fa640 1 -- 172.21.15.7:0/3423686757 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7effa4022050 con 0x560e7b7af8c0 2024-04-25T10:02:31.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.887+0000 7effb396e740 10 client.8154 fetch_fsmap learned FSMap version 66 2024-04-25T10:02:31.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.887+0000 7effb396e740 1 -- 172.21.15.7:0/3423686757 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x560e7b4093f0 con 0x560e7b7af8c0 2024-04-25T10:02:31.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.887+0000 7eff897fa640 1 -- 172.21.15.7:0/3423686757 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9c00e6e0 con 0x560e7b7af8c0 2024-04-25T10:02:31.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.887+0000 7eff897fa640 1 -- 172.21.15.7:0/3423686757 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 66) v1 ==== 3294+0+0 (secure 0 0 0) 0x7effa4025020 con 0x560e7b7af8c0 2024-04-25T10:02:31.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.887+0000 7effb396e740 10 client.8154 fetch_fsmap finished waiting for FSMap version 66 2024-04-25T10:02:31.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.887+0000 7effb396e740 10 client.8154 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T10:02:31.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.887+0000 7effb396e740 20 client.8154 populate_metadata read hostname 'smithi007' 2024-04-25T10:02:31.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.887+0000 7effb396e740 1 --2- 172.21.15.7:0/3423686757 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x560e7b7aed10 0x560e7b7af120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:31.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.887+0000 7effb396e740 4 client.8154 mds_command: new command op to 8022 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:02:31.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.887+0000 7effb396e740 1 -- 172.21.15.7:0/3423686757 --> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560e7b7022e0 con 0x560e7b7aed10 2024-04-25T10:02:31.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.888+0000 7effaa59c640 1 --2- 172.21.15.7:0/3423686757 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x560e7b7aed10 0x560e7b7af120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:31.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.888+0000 7eff897fa640 10 client.8154 ms_handle_connect on v2:172.21.15.7:6836/1061077733 2024-04-25T10:02:31.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.888+0000 7effaa59c640 1 --2- 172.21.15.7:0/3423686757 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x560e7b7aed10 0x560e7b7af120 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e284656d3a547ec server_cookie=d0af72599a3e40eb in_seq=0 out_seq=0 2024-04-25T10:02:31.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.888+0000 7eff897fa640 1 -- 172.21.15.7:0/3423686757 <== mds.0 v2:172.21.15.7:6836/1061077733 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560e7b7022e0 con 0x560e7b7aed10 2024-04-25T10:02:31.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.888+0000 7eff897fa640 10 client.8154 handle_command_reply: tid=0 2024-04-25T10:02:31.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.888+0000 7effb396e740 1 client.8154 shutdown 2024-04-25T10:02:31.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.889+0000 7effb396e740 1 -- 172.21.15.7:0/3423686757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e7b7af8c0 msgr2=0x560e7b78ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:31.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.889+0000 7effb396e740 1 --2- 172.21.15.7:0/3423686757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e7b7af8c0 0x560e7b78ab40 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7effa4010510 tx=0x7effa40109d0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.889+0000 7effb396e740 1 -- 172.21.15.7:0/3423686757 shutdown_connections 2024-04-25T10:02:31.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.889+0000 7effb396e740 1 --2- 172.21.15.7:0/3423686757 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x560e7b7aed10 0x560e7b7af120 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.889+0000 7effb396e740 1 --2- 172.21.15.7:0/3423686757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e7b7af8c0 0x560e7b78ab40 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.889+0000 7effb396e740 1 --2- 172.21.15.7:0/3423686757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560e7b7b8ef0 0x560e7b78a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.889+0000 7eff897fa640 0 client.8154 ms_handle_reset on v2:172.21.15.7:6836/1061077733 2024-04-25T10:02:31.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.889+0000 7effb396e740 1 --2- 172.21.15.7:0/3423686757 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e7b7b8b10 0x560e7b7ae1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.889+0000 7effb396e740 1 -- 172.21.15.7:0/3423686757 >> 172.21.15.7:0/3423686757 conn(0x560e7b78b770 msgr2=0x560e7b7903e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:31.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.889+0000 7effb396e740 1 -- 172.21.15.7:0/3423686757 shutdown_connections 2024-04-25T10:02:31.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.889+0000 7effb396e740 1 -- 172.21.15.7:0/3423686757 wait complete. 2024-04-25T10:02:31.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.889+0000 7effb396e740 20 client.8154 trim_cache size 0 max 16384 2024-04-25T10:02:31.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.904+0000 7effb396e740 1 Processor -- start 2024-04-25T10:02:31.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.904+0000 7effb396e740 1 -- start start 2024-04-25T10:02:31.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.905+0000 7effb396e740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e7b7af8c0 0x560e7b787060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:31.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.905+0000 7effb396e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e7b7b8b10 0x560e7b78c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:31.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.905+0000 7effb396e740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560e7b7b8ef0 0x560e7b7918a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:31.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.905+0000 7effb396e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac1fe590 con 0x560e7b7b8b10 2024-04-25T10:02:31.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.905+0000 7effb396e740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac12fc10 con 0x560e7b7b8ef0 2024-04-25T10:02:31.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.905+0000 7effb396e740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effac0ae160 con 0x560e7b7af8c0 2024-04-25T10:02:31.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.905+0000 7effa3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e7b7b8b10 0x560e7b78c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:31.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.905+0000 7effa3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e7b7b8b10 0x560e7b78c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48244/0 (socket says 172.21.15.7:48244) 2024-04-25T10:02:31.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.905+0000 7effa3fff640 1 -- 172.21.15.7:0/3830624635 learned_addr learned my addr 172.21.15.7:0/3830624635 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:31.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.905+0000 7effaad9d640 1 --2- 172.21.15.7:0/3830624635 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560e7b7b8ef0 0x560e7b7918a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:31.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.905+0000 7effa3fff640 1 -- 172.21.15.7:0/3830624635 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e7b7af8c0 msgr2=0x560e7b787060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:31.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.905+0000 7effa3fff640 1 --2- 172.21.15.7:0/3830624635 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e7b7af8c0 0x560e7b787060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.905+0000 7effa3fff640 1 -- 172.21.15.7:0/3830624635 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560e7b7b8ef0 msgr2=0x560e7b7918a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:31.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.905+0000 7effa3fff640 1 --2- 172.21.15.7:0/3830624635 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560e7b7b8ef0 0x560e7b7918a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.905+0000 7effa3fff640 1 -- 172.21.15.7:0/3830624635 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e7b3c90f0 con 0x560e7b7b8b10 2024-04-25T10:02:31.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.905+0000 7effaad9d640 1 --2- 172.21.15.7:0/3830624635 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560e7b7b8ef0 0x560e7b7918a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:02:31.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.906+0000 7effa3fff640 1 --2- 172.21.15.7:0/3830624635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e7b7b8b10 0x560e7b78c0e0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7eff94079320 tx=0x7eff94009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be07812d45486fc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:31.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.906+0000 7eff8b7fe640 1 -- 172.21.15.7:0/3830624635 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff940a6020 con 0x560e7b7b8b10 2024-04-25T10:02:31.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.906+0000 7eff8b7fe640 1 -- 172.21.15.7:0/3830624635 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9407d770 con 0x560e7b7b8b10 2024-04-25T10:02:31.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.906+0000 7eff8b7fe640 1 -- 172.21.15.7:0/3830624635 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff94081d30 con 0x560e7b7b8b10 2024-04-25T10:02:31.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.906+0000 7effb396e740 1 -- 172.21.15.7:0/3830624635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e7b7b8b10 msgr2=0x560e7b78c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:31.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.906+0000 7effb396e740 1 --2- 172.21.15.7:0/3830624635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e7b7b8b10 0x560e7b78c0e0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7eff94079320 tx=0x7eff94009520 comp rx=0 tx=0).stop 2024-04-25T10:02:31.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.906+0000 7effb396e740 1 -- 172.21.15.7:0/3830624635 shutdown_connections 2024-04-25T10:02:31.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.906+0000 7effb396e740 1 --2- 172.21.15.7:0/3830624635 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560e7b7b8ef0 0x560e7b7918a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.906+0000 7effb396e740 1 --2- 172.21.15.7:0/3830624635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e7b7b8b10 0x560e7b78c0e0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.906+0000 7effb396e740 1 --2- 172.21.15.7:0/3830624635 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e7b7af8c0 0x560e7b787060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.906+0000 7effb396e740 1 -- 172.21.15.7:0/3830624635 >> 172.21.15.7:0/3830624635 conn(0x560e7b78b770 msgr2=0x560e7b7bb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:31.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.906+0000 7effb396e740 1 -- 172.21.15.7:0/3830624635 shutdown_connections 2024-04-25T10:02:31.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.906+0000 7effb396e740 1 -- 172.21.15.7:0/3830624635 wait complete. 2024-04-25T10:02:31.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.907+0000 7effb396e740 1 -- start start 2024-04-25T10:02:31.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.907+0000 7effb396e740 1 Processor -- start 2024-04-25T10:02:31.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.908+0000 7effb396e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e7b7af8c0 0x560e7b78a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:31.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.908+0000 7effb396e740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560e7b7b8b10 0x560e7b78ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:31.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.908+0000 7effb396e740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e7b7b8ef0 0x560e7b7d5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:31.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.908+0000 7effb396e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7b7ad440 con 0x560e7b7af8c0 2024-04-25T10:02:31.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.908+0000 7effb396e740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac12f610 con 0x560e7b7b8b10 2024-04-25T10:02:31.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.908+0000 7effb396e740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x560e7b7f89b0 con 0x560e7b7b8ef0 2024-04-25T10:02:31.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.908+0000 7effb396e740 10 client.0 _ll_register_callbacks cb 0x7eff9c001360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:02:31.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.908+0000 7effaa59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e7b7af8c0 0x560e7b78a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:31.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.908+0000 7effaa59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e7b7af8c0 0x560e7b78a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48260/0 (socket says 172.21.15.7:48260) 2024-04-25T10:02:31.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.908+0000 7effaa59c640 1 -- 172.21.15.7:0/2728572520 learned_addr learned my addr 172.21.15.7:0/2728572520 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:31.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.908+0000 7effa3fff640 1 --2- 172.21.15.7:0/2728572520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560e7b7b8b10 0x560e7b78ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:31.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.908+0000 7effaad9d640 1 --2- 172.21.15.7:0/2728572520 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e7b7b8ef0 0x560e7b7d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:31.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.908+0000 7effaa59c640 1 -- 172.21.15.7:0/2728572520 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e7b7b8ef0 msgr2=0x560e7b7d5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:31.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.908+0000 7effaa59c640 1 --2- 172.21.15.7:0/2728572520 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e7b7b8ef0 0x560e7b7d5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.908+0000 7effaa59c640 1 -- 172.21.15.7:0/2728572520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560e7b7b8b10 msgr2=0x560e7b78ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:31.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.908+0000 7effaa59c640 1 --2- 172.21.15.7:0/2728572520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560e7b7b8b10 0x560e7b78ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.908+0000 7effaa59c640 1 -- 172.21.15.7:0/2728572520 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560e7b7af290 con 0x560e7b7af8c0 2024-04-25T10:02:31.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.908+0000 7effaad9d640 1 --2- 172.21.15.7:0/2728572520 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e7b7b8ef0 0x560e7b7d5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:02:31.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.908+0000 7effaa59c640 1 --2- 172.21.15.7:0/2728572520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e7b7af8c0 0x560e7b78a600 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7eff9c005a40 tx=0x7eff9c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca204f4875ec6447 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:31.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.908+0000 7eff897fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:02:31.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.909+0000 7eff897fa640 1 -- 172.21.15.7:0/2728572520 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c02e830 con 0x560e7b7af8c0 2024-04-25T10:02:31.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.909+0000 7eff897fa640 1 -- 172.21.15.7:0/2728572520 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7eff9c010930 con 0x560e7b7af8c0 2024-04-25T10:02:31.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.909+0000 7effb396e740 1 -- 172.21.15.7:0/2728572520 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7eff9407d770 con 0x560e7b7af8c0 2024-04-25T10:02:31.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.909+0000 7eff897fa640 1 -- 172.21.15.7:0/2728572520 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff9c03b050 con 0x560e7b7af8c0 2024-04-25T10:02:31.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.909+0000 7effb396e740 10 client.8160 fetch_fsmap learned FSMap version 66 2024-04-25T10:02:31.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.909+0000 7effb396e740 1 -- 172.21.15.7:0/2728572520 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x560e7b8418a0 con 0x560e7b7af8c0 2024-04-25T10:02:31.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.909+0000 7eff897fa640 1 -- 172.21.15.7:0/2728572520 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9407d770 con 0x560e7b7af8c0 2024-04-25T10:02:31.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.909+0000 7eff897fa640 1 -- 172.21.15.7:0/2728572520 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 66) v1 ==== 3294+0+0 (secure 0 0 0) 0x7eff9c03e020 con 0x560e7b7af8c0 2024-04-25T10:02:31.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.909+0000 7effb396e740 10 client.8160 fetch_fsmap finished waiting for FSMap version 66 2024-04-25T10:02:31.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.909+0000 7effb396e740 10 client.8160 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T10:02:31.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.909+0000 7effb396e740 20 client.8160 populate_metadata read hostname 'smithi007' 2024-04-25T10:02:31.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.909+0000 7effb396e740 1 --2- 172.21.15.7:0/2728572520 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x560e7b7bef50 0x560e7b7d6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:31.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.909+0000 7effb396e740 4 client.8160 mds_command: new command op to 8022 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T10:02:31.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.909+0000 7effb396e740 1 -- 172.21.15.7:0/2728572520 --> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560e7b6fc630 con 0x560e7b7bef50 2024-04-25T10:02:31.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.909+0000 7effa3fff640 1 --2- 172.21.15.7:0/2728572520 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x560e7b7bef50 0x560e7b7d6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:31.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.910+0000 7eff897fa640 10 client.8160 ms_handle_connect on v2:172.21.15.7:6836/1061077733 2024-04-25T10:02:31.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.910+0000 7effa3fff640 1 --2- 172.21.15.7:0/2728572520 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x560e7b7bef50 0x560e7b7d6100 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4a5e7119d35860c server_cookie=54cbfa82e428d072 in_seq=0 out_seq=0 2024-04-25T10:02:31.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.910+0000 7eff897fa640 1 -- 172.21.15.7:0/2728572520 <== mds.0 v2:172.21.15.7:6836/1061077733 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x560e7b6fc630 con 0x560e7b7bef50 2024-04-25T10:02:31.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.910+0000 7eff897fa640 10 client.8160 handle_command_reply: tid=0 2024-04-25T10:02:31.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.910+0000 7effb396e740 1 client.8160 shutdown 2024-04-25T10:02:31.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.910+0000 7effb396e740 1 -- 172.21.15.7:0/2728572520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e7b7af8c0 msgr2=0x560e7b78a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:31.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.910+0000 7effb396e740 1 --2- 172.21.15.7:0/2728572520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e7b7af8c0 0x560e7b78a600 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7eff9c005a40 tx=0x7eff9c000ed0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.910+0000 7effb396e740 1 -- 172.21.15.7:0/2728572520 shutdown_connections 2024-04-25T10:02:31.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.910+0000 7effb396e740 1 --2- 172.21.15.7:0/2728572520 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x560e7b7bef50 0x560e7b7d6100 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.910+0000 7effb396e740 1 --2- 172.21.15.7:0/2728572520 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x560e7b7b8ef0 0x560e7b7d5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.910+0000 7effb396e740 1 --2- 172.21.15.7:0/2728572520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560e7b7b8b10 0x560e7b78ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.910+0000 7eff897fa640 0 client.8160 ms_handle_reset on v2:172.21.15.7:6836/1061077733 2024-04-25T10:02:31.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.910+0000 7effb396e740 1 --2- 172.21.15.7:0/2728572520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560e7b7af8c0 0x560e7b78a600 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.910+0000 7effb396e740 1 -- 172.21.15.7:0/2728572520 >> 172.21.15.7:0/2728572520 conn(0x560e7b78b770 msgr2=0x560e7b786b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:31.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.910+0000 7effb396e740 1 -- 172.21.15.7:0/2728572520 shutdown_connections 2024-04-25T10:02:31.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.910+0000 7effb396e740 1 -- 172.21.15.7:0/2728572520 wait complete. 2024-04-25T10:02:31.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.910+0000 7effb396e740 20 client.8160 trim_cache size 0 max 16384 2024-04-25T10:02:31.921 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:02:31.921 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-04-25T10:02:31.921 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-04-25T10:02:31.921 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:02:31.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.911+0000 7effb0b89640 1 -- 172.21.15.7:0/2370466056 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7eff8c06b4d0 msgr2=0x7eff8c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:31.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.911+0000 7effb0b89640 1 --2- 172.21.15.7:0/2370466056 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7eff8c06b4d0 0x7eff8c06d990 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7eff9c000f60 tx=0x7eff9c009040 comp rx=0 tx=0).stop 2024-04-25T10:02:31.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.911+0000 7effb0b89640 1 -- 172.21.15.7:0/2370466056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effac071670 msgr2=0x7effac132890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:31.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.911+0000 7effb0b89640 1 --2- 172.21.15.7:0/2370466056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effac071670 0x7effac132890 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7eff9402a220 tx=0x7eff940046c0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.911+0000 7effb0b89640 1 -- 172.21.15.7:0/2370466056 shutdown_connections 2024-04-25T10:02:31.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.911+0000 7effb0b89640 1 --2- 172.21.15.7:0/2370466056 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7eff8c06b4d0 0x7eff8c06d990 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.911+0000 7effb0b89640 1 --2- 172.21.15.7:0/2370466056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effac144fe0 0x7effac130a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.911+0000 7effb0b89640 1 --2- 172.21.15.7:0/2370466056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effac071670 0x7effac132890 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.911+0000 7effb0b89640 1 --2- 172.21.15.7:0/2370466056 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7effac06d130 0x7effac1f58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:31.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.911+0000 7effb0b89640 1 -- 172.21.15.7:0/2370466056 >> 172.21.15.7:0/2370466056 conn(0x7effac06ab60 msgr2=0x7effac0b17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:31.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.911+0000 7effb0b89640 1 -- 172.21.15.7:0/2370466056 shutdown_connections 2024-04-25T10:02:31.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:31.911+0000 7effb0b89640 1 -- 172.21.15.7:0/2370466056 wait complete. 2024-04-25T10:02:31.926 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T10:02:31.927 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:02:32.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.023+0000 7fae4dc5d640 1 Processor -- start 2024-04-25T10:02:32.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.023+0000 7fae4dc5d640 1 -- start start 2024-04-25T10:02:32.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.024+0000 7fae4dc5d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fae4806c250 0x7fae4809a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:32.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.024+0000 7fae4dc5d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fae4806bce0 0x7fae4806c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:32.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.024+0000 7fae4dc5d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae4806cb70 con 0x7fae480d0360 2024-04-25T10:02:32.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.024+0000 7fae4dc5d640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae4809ae20 con 0x7fae4806bce0 2024-04-25T10:02:32.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.024+0000 7fae4dc5d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae4809a450 con 0x7fae4806c250 2024-04-25T10:02:32.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.024+0000 7fae46ffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fae4806bce0 0x7fae4806c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:32.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.024+0000 7fae46ffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fae4806bce0 0x7fae4806c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48264/0 (socket says 172.21.15.7:48264) 2024-04-25T10:02:32.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.024+0000 7fae46ffd640 1 -- 172.21.15.7:0/3040102441 learned_addr learned my addr 172.21.15.7:0/3040102441 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:32.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.024+0000 7fae477fe640 1 --2- 172.21.15.7:0/3040102441 >> v2:172.21.15.55:3300/0 conn(0x7fae4806c250 0x7fae4809a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:32.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.025+0000 7fae46ffd640 1 -- 172.21.15.7:0/3040102441 >> v2:172.21.15.55:3300/0 conn(0x7fae4806c250 msgr2=0x7fae4809a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:32.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.025+0000 7fae46ffd640 1 --2- 172.21.15.7:0/3040102441 >> v2:172.21.15.55:3300/0 conn(0x7fae4806c250 0x7fae4809a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.025+0000 7fae46ffd640 1 -- 172.21.15.7:0/3040102441 >> v1:172.21.15.55:6789/0 conn(0x7fae480d0360 legacy=0x7fae480cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:32.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.025+0000 7fae46ffd640 1 -- 172.21.15.7:0/3040102441 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae48099b20 con 0x7fae4806bce0 2024-04-25T10:02:32.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.025+0000 7fae477fe640 1 --2- 172.21.15.7:0/3040102441 >> v2:172.21.15.55:3300/0 conn(0x7fae4806c250 0x7fae4809a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:02:32.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.025+0000 7fae46ffd640 1 --2- 172.21.15.7:0/3040102441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae4806bce0 0x7fae4806c630 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fae480d27e0 tx=0x7fae3c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2aff056aedb8793 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:32.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.025+0000 7fae467fc640 1 -- 172.21.15.7:0/3040102441 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3c037070 con 0x7fae4806bce0 2024-04-25T10:02:32.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.025+0000 7fae467fc640 1 -- 172.21.15.7:0/3040102441 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3c02ae10 con 0x7fae4806bce0 2024-04-25T10:02:32.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.025+0000 7fae467fc640 1 -- 172.21.15.7:0/3040102441 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3c032660 con 0x7fae4806bce0 2024-04-25T10:02:32.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.026+0000 7fae4dc5d640 1 -- 172.21.15.7:0/3040102441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae4806bce0 msgr2=0x7fae4806c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:32.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.026+0000 7fae4dc5d640 1 --2- 172.21.15.7:0/3040102441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae4806bce0 0x7fae4806c630 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fae480d27e0 tx=0x7fae3c02a100 comp rx=0 tx=0).stop 2024-04-25T10:02:32.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.026+0000 7fae4dc5d640 1 -- 172.21.15.7:0/3040102441 shutdown_connections 2024-04-25T10:02:32.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.026+0000 7fae4dc5d640 1 --2- 172.21.15.7:0/3040102441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae4806bce0 0x7fae4806c630 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.026+0000 7fae4dc5d640 1 --2- 172.21.15.7:0/3040102441 >> v2:172.21.15.55:3300/0 conn(0x7fae4806c250 0x7fae4809a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.026+0000 7fae4dc5d640 1 -- 172.21.15.7:0/3040102441 >> 172.21.15.7:0/3040102441 conn(0x7fae480d16e0 msgr2=0x7fae480d1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:32.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.026+0000 7fae4dc5d640 1 -- 172.21.15.7:0/3040102441 shutdown_connections 2024-04-25T10:02:32.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.026+0000 7fae4dc5d640 1 -- 172.21.15.7:0/3040102441 wait complete. 2024-04-25T10:02:32.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.027+0000 7fae4dc5d640 1 Processor -- start 2024-04-25T10:02:32.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.027+0000 7fae4dc5d640 1 -- start start 2024-04-25T10:02:32.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.028+0000 7fae4dc5d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae4806bce0 0x7fae4815e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:32.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.028+0000 7fae4dc5d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae4806c250 0x7fae4815cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:32.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.028+0000 7fae4dc5d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae480d0360 0x7fae481f8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:32.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.028+0000 7fae4dc5d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4809a0e0 con 0x7fae480d0360 2024-04-25T10:02:32.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.028+0000 7fae4dc5d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae480d0c60 con 0x7fae4806bce0 2024-04-25T10:02:32.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.028+0000 7fae4dc5d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4815f000 con 0x7fae4806c250 2024-04-25T10:02:32.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.028+0000 7fae47fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae480d0360 0x7fae481f8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:32.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.028+0000 7fae47fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae480d0360 0x7fae481f8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48278/0 (socket says 172.21.15.7:48278) 2024-04-25T10:02:32.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.028+0000 7fae47fff640 1 -- 172.21.15.7:0/2370032025 learned_addr learned my addr 172.21.15.7:0/2370032025 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:32.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.028+0000 7fae477fe640 1 --2- 172.21.15.7:0/2370032025 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae4806bce0 0x7fae4815e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:32.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.028+0000 7fae46ffd640 1 --2- 172.21.15.7:0/2370032025 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae4806c250 0x7fae4815cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:32.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.028+0000 7fae47fff640 1 -- 172.21.15.7:0/2370032025 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae4806c250 msgr2=0x7fae4815cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:32.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.028+0000 7fae47fff640 1 --2- 172.21.15.7:0/2370032025 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae4806c250 0x7fae4815cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.028+0000 7fae47fff640 1 -- 172.21.15.7:0/2370032025 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae4806bce0 msgr2=0x7fae4815e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:32.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.029+0000 7fae47fff640 1 --2- 172.21.15.7:0/2370032025 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae4806bce0 0x7fae4815e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.029+0000 7fae47fff640 1 -- 172.21.15.7:0/2370032025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4815d310 con 0x7fae480d0360 2024-04-25T10:02:32.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.029+0000 7fae47fff640 1 --2- 172.21.15.7:0/2370032025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae480d0360 0x7fae481f8160 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fae4000c7b0 tx=0x7fae4000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:32.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.029+0000 7fae2ffff640 1 -- 172.21.15.7:0/2370032025 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae40004b60 con 0x7fae480d0360 2024-04-25T10:02:32.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.029+0000 7fae2ffff640 1 -- 172.21.15.7:0/2370032025 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae40004d00 con 0x7fae480d0360 2024-04-25T10:02:32.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.029+0000 7fae2ffff640 1 -- 172.21.15.7:0/2370032025 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4000aa90 con 0x7fae480d0360 2024-04-25T10:02:32.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.029+0000 7fae4dc5d640 1 -- 172.21.15.7:0/2370032025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae4815d5f0 con 0x7fae480d0360 2024-04-25T10:02:32.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.029+0000 7fae4dc5d640 1 -- 172.21.15.7:0/2370032025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae4815dbb0 con 0x7fae480d0360 2024-04-25T10:02:32.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.030+0000 7fae4dc5d640 1 -- 172.21.15.7:0/2370032025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae48068fd0 con 0x7fae480d0360 2024-04-25T10:02:32.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.030+0000 7fae2ffff640 1 -- 172.21.15.7:0/2370032025 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fae4000ac30 con 0x7fae480d0360 2024-04-25T10:02:32.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.031+0000 7fae2ffff640 1 --2- 172.21.15.7:0/2370032025 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fae3406b4d0 0x7fae3406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:32.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.031+0000 7fae2ffff640 1 -- 172.21.15.7:0/2370032025 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fae4008a5f0 con 0x7fae480d0360 2024-04-25T10:02:32.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.031+0000 7fae477fe640 1 --2- 172.21.15.7:0/2370032025 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fae3406b4d0 0x7fae3406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:32.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.031+0000 7fae477fe640 1 --2- 172.21.15.7:0/2370032025 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fae3406b4d0 0x7fae3406d990 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fae3800aac0 tx=0x7fae38008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:32.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.035+0000 7fae2ffff640 1 -- 172.21.15.7:0/2370032025 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fae40020070 con 0x7fae480d0360 2024-04-25T10:02:32.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.254+0000 7fae4dc5d640 1 -- 172.21.15.7:0/2370032025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae480d1150 con 0x7fae480d0360 2024-04-25T10:02:32.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.254+0000 7fae2ffff640 1 -- 172.21.15.7:0/2370032025 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4935 (secure 0 0 0) 0x7fae40058b70 con 0x7fae480d0360 2024-04-25T10:02:32.259 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:02:32.259 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":66,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2505539422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2505539422},{"type":"v1","addr":"172.21.15.55:6834","nonce":2505539422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2808857776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2808857776},{"type":"v1","addr":"172.21.15.55:6835","nonce":2808857776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7518,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1796103144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1796103144},{"type":"v1","addr":"172.21.15.7:6835","nonce":1796103144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:00:34.054759+0000","modified":"2024-04-25T10:01:57.949246+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8022},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8022":{"gid":8022,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6837/1061077733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1061077733},{"type":"v1","addr":"172.21.15.7:6837","nonce":1061077733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:02:32.260 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 66 2024-04-25T10:02:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.256+0000 7fae4dc5d640 1 -- 172.21.15.7:0/2370032025 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fae3406b4d0 msgr2=0x7fae3406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.256+0000 7fae4dc5d640 1 --2- 172.21.15.7:0/2370032025 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fae3406b4d0 0x7fae3406d990 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fae3800aac0 tx=0x7fae38008040 comp rx=0 tx=0).stop 2024-04-25T10:02:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.257+0000 7fae4dc5d640 1 -- 172.21.15.7:0/2370032025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae480d0360 msgr2=0x7fae481f8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.257+0000 7fae4dc5d640 1 --2- 172.21.15.7:0/2370032025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae480d0360 0x7fae481f8160 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fae4000c7b0 tx=0x7fae4000cc70 comp rx=0 tx=0).stop 2024-04-25T10:02:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.257+0000 7fae4dc5d640 1 -- 172.21.15.7:0/2370032025 shutdown_connections 2024-04-25T10:02:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.257+0000 7fae4dc5d640 1 --2- 172.21.15.7:0/2370032025 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fae3406b4d0 0x7fae3406d990 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.257+0000 7fae4dc5d640 1 --2- 172.21.15.7:0/2370032025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae480d0360 0x7fae481f8160 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.257+0000 7fae4dc5d640 1 --2- 172.21.15.7:0/2370032025 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae4806c250 0x7fae4815cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.257+0000 7fae4dc5d640 1 --2- 172.21.15.7:0/2370032025 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae4806bce0 0x7fae4815e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.257+0000 7fae4dc5d640 1 -- 172.21.15.7:0/2370032025 >> 172.21.15.7:0/2370032025 conn(0x7fae480d16e0 msgr2=0x7fae480b6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.257+0000 7fae4dc5d640 1 -- 172.21.15.7:0/2370032025 shutdown_connections 2024-04-25T10:02:32.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.257+0000 7fae4dc5d640 1 -- 172.21.15.7:0/2370032025 wait complete. 2024-04-25T10:02:32.272 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-25T10:02:32.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.370+0000 7fe1ef65a640 1 Processor -- start 2024-04-25T10:02:32.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.370+0000 7fe1ef65a640 1 -- start start 2024-04-25T10:02:32.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.371+0000 7fe1ef65a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe1e80d0780 0x7fe1e80d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:32.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.371+0000 7fe1ef65a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e80d10a0 con 0x7fe1e80b9130 2024-04-25T10:02:32.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.371+0000 7fe1ef65a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e80b7ef0 con 0x7fe1e80b9590 2024-04-25T10:02:32.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.371+0000 7fe1ef65a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e80b81d0 con 0x7fe1e80d0780 2024-04-25T10:02:32.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.371+0000 7fe1ed3f6640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe1e80d0780 0x7fe1e80d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:32.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.371+0000 7fe1ecbf5640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe1e80b9130 0x7fe1e80d1c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40742/0 (socket says 172.21.15.7:40742) 2024-04-25T10:02:32.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.371+0000 7fe1ecbf5640 1 -- 172.21.15.7:0/2492717794 learned_addr learned my addr 172.21.15.7:0/2492717794 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:02:32.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.371+0000 7fe1ed3f6640 1 -- 172.21.15.7:0/2492717794 >> v1:172.21.15.55:6789/0 conn(0x7fe1e80b9590 legacy=0x7fe1e80d2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:32.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.371+0000 7fe1ed3f6640 1 -- 172.21.15.7:0/2492717794 >> v1:172.21.15.7:6789/0 conn(0x7fe1e80b9130 legacy=0x7fe1e80d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:32.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.371+0000 7fe1ed3f6640 1 -- 172.21.15.7:0/2492717794 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e80b84b0 con 0x7fe1e80d0780 2024-04-25T10:02:32.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.372+0000 7fe1ed3f6640 1 --2- 172.21.15.7:0/2492717794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1e80d0780 0x7fe1e80d0b60 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40097a0 tx=0x7fe1e402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efdf6ddd2bd1a111 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:32.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.372+0000 7fe1dffff640 1 -- 172.21.15.7:0/2492717794 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4037070 con 0x7fe1e80d0780 2024-04-25T10:02:32.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.372+0000 7fe1dffff640 1 -- 172.21.15.7:0/2492717794 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e4032440 con 0x7fe1e80d0780 2024-04-25T10:02:32.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.372+0000 7fe1dffff640 1 -- 172.21.15.7:0/2492717794 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4032810 con 0x7fe1e80d0780 2024-04-25T10:02:32.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.373+0000 7fe1ef65a640 1 -- 172.21.15.7:0/2492717794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1e80d0780 msgr2=0x7fe1e80d0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:32.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.373+0000 7fe1ef65a640 1 --2- 172.21.15.7:0/2492717794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1e80d0780 0x7fe1e80d0b60 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40097a0 tx=0x7fe1e402a230 comp rx=0 tx=0).stop 2024-04-25T10:02:32.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.373+0000 7fe1ef65a640 1 -- 172.21.15.7:0/2492717794 shutdown_connections 2024-04-25T10:02:32.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.373+0000 7fe1ef65a640 1 --2- 172.21.15.7:0/2492717794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1e80d0780 0x7fe1e80d0b60 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.373+0000 7fe1ef65a640 1 -- 172.21.15.7:0/2492717794 >> 172.21.15.7:0/2492717794 conn(0x7fe1e80726b0 msgr2=0x7fe1e8072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:32.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.373+0000 7fe1ef65a640 1 -- 172.21.15.7:0/2492717794 shutdown_connections 2024-04-25T10:02:32.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.373+0000 7fe1ef65a640 1 -- 172.21.15.7:0/2492717794 wait complete. 2024-04-25T10:02:32.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.374+0000 7fe1ef65a640 1 Processor -- start 2024-04-25T10:02:32.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.374+0000 7fe1ef65a640 1 -- start start 2024-04-25T10:02:32.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.375+0000 7fe1ef65a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe1e80b9130 0x7fe1e81f3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:32.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.375+0000 7fe1ef65a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1e80b9590 0x7fe1e80c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:32.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.375+0000 7fe1ef65a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1e80d0780 0x7fe1e81e96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:32.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.375+0000 7fe1ef65a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e81611b0 con 0x7fe1e80b9590 2024-04-25T10:02:32.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.375+0000 7fe1ef65a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e80b8a70 con 0x7fe1e80d0780 2024-04-25T10:02:32.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.375+0000 7fe1ef65a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e8161330 con 0x7fe1e80b9130 2024-04-25T10:02:32.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.375+0000 7fe1ecbf5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1e80b9590 0x7fe1e80c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:32.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.375+0000 7fe1ecbf5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1e80b9590 0x7fe1e80c9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48300/0 (socket says 172.21.15.7:48300) 2024-04-25T10:02:32.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.375+0000 7fe1ecbf5640 1 -- 172.21.15.7:0/2884136110 learned_addr learned my addr 172.21.15.7:0/2884136110 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:32.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.375+0000 7fe1ecbf5640 1 -- 172.21.15.7:0/2884136110 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe1e80b9130 msgr2=0x7fe1e81f3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:32.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.375+0000 7fe1ecbf5640 1 --2- 172.21.15.7:0/2884136110 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe1e80b9130 0x7fe1e81f3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.375+0000 7fe1ecbf5640 1 -- 172.21.15.7:0/2884136110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1e80d0780 msgr2=0x7fe1e81e96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:32.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.375+0000 7fe1edbf7640 1 --2- 172.21.15.7:0/2884136110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1e80d0780 0x7fe1e81e96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:32.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.375+0000 7fe1ecbf5640 1 --2- 172.21.15.7:0/2884136110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1e80d0780 0x7fe1e81e96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.375+0000 7fe1ecbf5640 1 -- 172.21.15.7:0/2884136110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e80d2450 con 0x7fe1e80b9590 2024-04-25T10:02:32.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.375+0000 7fe1ecbf5640 1 --2- 172.21.15.7:0/2884136110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1e80b9590 0x7fe1e80c9b60 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fe1d800c4a0 tx=0x7fe1d800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:32.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.375+0000 7fe1ddffb640 1 -- 172.21.15.7:0/2884136110 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8017070 con 0x7fe1e80b9590 2024-04-25T10:02:32.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.375+0000 7fe1ddffb640 1 -- 172.21.15.7:0/2884136110 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d8005ce0 con 0x7fe1e80b9590 2024-04-25T10:02:32.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.375+0000 7fe1ef65a640 1 -- 172.21.15.7:0/2884136110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e80d26f0 con 0x7fe1e80b9590 2024-04-25T10:02:32.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.375+0000 7fe1ddffb640 1 -- 172.21.15.7:0/2884136110 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8007270 con 0x7fe1e80b9590 2024-04-25T10:02:32.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.376+0000 7fe1ef65a640 1 -- 172.21.15.7:0/2884136110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e80d2cb0 con 0x7fe1e80b9590 2024-04-25T10:02:32.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.377+0000 7fe1ddffb640 1 -- 172.21.15.7:0/2884136110 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe1d801a070 con 0x7fe1e80b9590 2024-04-25T10:02:32.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.378+0000 7fe1ddffb640 1 --2- 172.21.15.7:0/2884136110 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe1cc06b4d0 0x7fe1cc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:32.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.378+0000 7fe1ddffb640 1 -- 172.21.15.7:0/2884136110 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fe1d8089780 con 0x7fe1e80b9590 2024-04-25T10:02:32.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.378+0000 7fe1ed3f6640 1 --2- 172.21.15.7:0/2884136110 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe1cc06b4d0 0x7fe1cc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:32.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.378+0000 7fe1ed3f6640 1 --2- 172.21.15.7:0/2884136110 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe1cc06b4d0 0x7fe1cc06d990 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4034000 tx=0x7fe1e402c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:32.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.379+0000 7fe1f2430740 1 Processor -- start 2024-04-25T10:02:32.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.379+0000 7fe1f2430740 1 -- start start 2024-04-25T10:02:32.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.379+0000 7fe1f2430740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa5d550590 0x55fa5d5526f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:32.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.379+0000 7fe1f2430740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fa5d58cc60 0x55fa5d550970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:32.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.379+0000 7fe1f2430740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fa5d57b050 0x55fa5d57b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:32.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.379+0000 7fe1f2430740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa5d4b3c60 con 0x55fa5d57b050 2024-04-25T10:02:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.379+0000 7fe1f2430740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa5d452d80 con 0x55fa5d550590 2024-04-25T10:02:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.379+0000 7fe1f2430740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa5d4afd00 con 0x55fa5d58cc60 2024-04-25T10:02:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.379+0000 7fe1edbf7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fa5d57b050 0x55fa5d57b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.379+0000 7fe1edbf7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fa5d57b050 0x55fa5d57b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48312/0 (socket says 172.21.15.7:48312) 2024-04-25T10:02:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.379+0000 7fe1edbf7640 1 -- 172.21.15.7:0/490983219 learned_addr learned my addr 172.21.15.7:0/490983219 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.379+0000 7fe1ed3f6640 1 --2- 172.21.15.7:0/490983219 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa5d550590 0x55fa5d5526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.379+0000 7fe1ecbf5640 1 --2- 172.21.15.7:0/490983219 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fa5d58cc60 0x55fa5d550970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.380+0000 7fe1edbf7640 1 -- 172.21.15.7:0/490983219 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fa5d58cc60 msgr2=0x55fa5d550970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.380+0000 7fe1edbf7640 1 --2- 172.21.15.7:0/490983219 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fa5d58cc60 0x55fa5d550970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.380+0000 7fe1edbf7640 1 -- 172.21.15.7:0/490983219 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa5d550590 msgr2=0x55fa5d5526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.380+0000 7fe1edbf7640 1 --2- 172.21.15.7:0/490983219 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa5d550590 0x55fa5d5526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.380+0000 7fe1edbf7640 1 -- 172.21.15.7:0/490983219 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa5d2947c0 con 0x55fa5d57b050 2024-04-25T10:02:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.380+0000 7fe1edbf7640 1 --2- 172.21.15.7:0/490983219 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fa5d57b050 0x55fa5d57b4d0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0001da0 tx=0x7fe1e000d150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=843afe60693afaed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.380+0000 7fe1d2ffd640 1 -- 172.21.15.7:0/490983219 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0016020 con 0x55fa5d57b050 2024-04-25T10:02:32.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.380+0000 7fe1d2ffd640 1 -- 172.21.15.7:0/490983219 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e000dd30 con 0x55fa5d57b050 2024-04-25T10:02:32.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.380+0000 7fe1d2ffd640 1 -- 172.21.15.7:0/490983219 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e00125f0 con 0x55fa5d57b050 2024-04-25T10:02:32.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.381+0000 7fe1f2430740 1 -- 172.21.15.7:0/490983219 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fa5d57b050 msgr2=0x55fa5d57b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:32.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.381+0000 7fe1f2430740 1 --2- 172.21.15.7:0/490983219 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fa5d57b050 0x55fa5d57b4d0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0001da0 tx=0x7fe1e000d150 comp rx=0 tx=0).stop 2024-04-25T10:02:32.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.381+0000 7fe1f2430740 1 -- 172.21.15.7:0/490983219 shutdown_connections 2024-04-25T10:02:32.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.381+0000 7fe1f2430740 1 --2- 172.21.15.7:0/490983219 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fa5d57b050 0x55fa5d57b4d0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.381+0000 7fe1f2430740 1 --2- 172.21.15.7:0/490983219 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fa5d58cc60 0x55fa5d550970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.381+0000 7fe1f2430740 1 --2- 172.21.15.7:0/490983219 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa5d550590 0x55fa5d5526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.381+0000 7fe1f2430740 1 -- 172.21.15.7:0/490983219 >> 172.21.15.7:0/490983219 conn(0x55fa5d5186e0 msgr2=0x55fa5d596050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:32.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.381+0000 7fe1f2430740 1 -- 172.21.15.7:0/490983219 shutdown_connections 2024-04-25T10:02:32.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.381+0000 7fe1f2430740 1 -- 172.21.15.7:0/490983219 wait complete. 2024-04-25T10:02:32.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.381+0000 7fe1f2430740 1 -- start start 2024-04-25T10:02:32.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.381+0000 7fe1f2430740 1 Processor -- start 2024-04-25T10:02:32.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.382+0000 7fe1f2430740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fa5d550590 0x55fa5d5913e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:32.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.382+0000 7fe1f2430740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa5d57b050 0x55fa5d591920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:32.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.382+0000 7fe1f2430740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fa5d58cc60 0x55fa5d58f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:32.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.382+0000 7fe1f2430740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa5d450840 con 0x55fa5d550590 2024-04-25T10:02:32.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.382+0000 7fe1f2430740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa5d578ba0 con 0x55fa5d57b050 2024-04-25T10:02:32.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.382+0000 7fe1f2430740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa5d5a7380 con 0x55fa5d58cc60 2024-04-25T10:02:32.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.382+0000 7fe1f2430740 10 client.0 _ll_register_callbacks cb 0x55fa5d46a980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:02:32.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.382+0000 7fe1ed3f6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fa5d550590 0x55fa5d5913e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:32.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.382+0000 7fe1ed3f6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fa5d550590 0x55fa5d5913e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48324/0 (socket says 172.21.15.7:48324) 2024-04-25T10:02:32.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.382+0000 7fe1ed3f6640 1 -- 172.21.15.7:0/3975459583 learned_addr learned my addr 172.21.15.7:0/3975459583 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:32.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.382+0000 7fe1ecbf5640 1 --2- 172.21.15.7:0/3975459583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa5d57b050 0x55fa5d591920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:32.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.382+0000 7fe1edbf7640 1 --2- 172.21.15.7:0/3975459583 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fa5d58cc60 0x55fa5d58f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:32.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.383+0000 7fe1ed3f6640 1 -- 172.21.15.7:0/3975459583 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fa5d58cc60 msgr2=0x55fa5d58f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:32.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.383+0000 7fe1ed3f6640 1 --2- 172.21.15.7:0/3975459583 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fa5d58cc60 0x55fa5d58f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.383+0000 7fe1ed3f6640 1 -- 172.21.15.7:0/3975459583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa5d57b050 msgr2=0x55fa5d591920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:32.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.383+0000 7fe1ed3f6640 1 --2- 172.21.15.7:0/3975459583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa5d57b050 0x55fa5d591920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.383+0000 7fe1ed3f6640 1 -- 172.21.15.7:0/3975459583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa5d2f4f50 con 0x55fa5d550590 2024-04-25T10:02:32.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.383+0000 7fe1ed3f6640 1 --2- 172.21.15.7:0/3975459583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fa5d550590 0x55fa5d5913e0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40098c0 tx=0x7fe1e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fddc9ae2c50ac527 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:32.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.383+0000 7fe1c7fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:02:32.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.383+0000 7fe1c7fff640 1 -- 172.21.15.7:0/3975459583 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4037040 con 0x55fa5d550590 2024-04-25T10:02:32.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.383+0000 7fe1c7fff640 1 -- 172.21.15.7:0/3975459583 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fe1e4032db0 con 0x55fa5d550590 2024-04-25T10:02:32.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.383+0000 7fe1f2430740 1 -- 172.21.15.7:0/3975459583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe1e000dd30 con 0x55fa5d550590 2024-04-25T10:02:32.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.383+0000 7fe1c7fff640 1 -- 172.21.15.7:0/3975459583 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1e4003610 con 0x55fa5d550590 2024-04-25T10:02:32.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.383+0000 7fe1f2430740 10 client.8181 fetch_fsmap learned FSMap version 66 2024-04-25T10:02:32.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.383+0000 7fe1f2430740 1 -- 172.21.15.7:0/3975459583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x55fa5d1880b0 con 0x55fa5d550590 2024-04-25T10:02:32.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.383+0000 7fe1c7fff640 1 -- 172.21.15.7:0/3975459583 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e000dd30 con 0x55fa5d550590 2024-04-25T10:02:32.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.383+0000 7fe1c7fff640 1 -- 172.21.15.7:0/3975459583 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 66) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe1e403a030 con 0x55fa5d550590 2024-04-25T10:02:32.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.383+0000 7fe1f2430740 10 client.8181 fetch_fsmap finished waiting for FSMap version 66 2024-04-25T10:02:32.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.383+0000 7fe1f2430740 10 client.8181 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:02:32.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.383+0000 7fe1f2430740 20 client.8181 populate_metadata read hostname 'smithi007' 2024-04-25T10:02:32.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.383+0000 7fe1f2430740 1 --2- 172.21.15.7:0/3975459583 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x55fa5d57b5b0 0x55fa5d5b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:32.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.383+0000 7fe1f2430740 4 client.8181 mds_command: new command op to 8022 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:02:32.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.383+0000 7fe1f2430740 1 -- 172.21.15.7:0/3975459583 --> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fa5d473e60 con 0x55fa5d57b5b0 2024-04-25T10:02:32.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.384+0000 7fe1ecbf5640 1 --2- 172.21.15.7:0/3975459583 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x55fa5d57b5b0 0x55fa5d5b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:32.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.384+0000 7fe1c7fff640 10 client.8181 ms_handle_connect on v2:172.21.15.7:6836/1061077733 2024-04-25T10:02:32.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.384+0000 7fe1ecbf5640 1 --2- 172.21.15.7:0/3975459583 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x55fa5d57b5b0 0x55fa5d5b38e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce56eded20e471a6 server_cookie=625e60c03acbe4a5 in_seq=0 out_seq=0 2024-04-25T10:02:32.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.384+0000 7fe1c7fff640 1 -- 172.21.15.7:0/3975459583 <== mds.0 v2:172.21.15.7:6836/1061077733 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fa5d473e60 con 0x55fa5d57b5b0 2024-04-25T10:02:32.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.384+0000 7fe1c7fff640 10 client.8181 handle_command_reply: tid=0 2024-04-25T10:02:32.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.384+0000 7fe1f2430740 1 client.8181 shutdown 2024-04-25T10:02:32.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.385+0000 7fe1f2430740 1 -- 172.21.15.7:0/3975459583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fa5d550590 msgr2=0x55fa5d5913e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:32.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.385+0000 7fe1f2430740 1 --2- 172.21.15.7:0/3975459583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fa5d550590 0x55fa5d5913e0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40098c0 tx=0x7fe1e4004730 comp rx=0 tx=0).stop 2024-04-25T10:02:32.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.385+0000 7fe1f2430740 1 -- 172.21.15.7:0/3975459583 shutdown_connections 2024-04-25T10:02:32.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.385+0000 7fe1f2430740 1 --2- 172.21.15.7:0/3975459583 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x55fa5d57b5b0 0x55fa5d5b38e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.385+0000 7fe1f2430740 1 --2- 172.21.15.7:0/3975459583 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fa5d58cc60 0x55fa5d58f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.385+0000 7fe1c7fff640 0 client.8181 ms_handle_reset on v2:172.21.15.7:6836/1061077733 2024-04-25T10:02:32.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.385+0000 7fe1f2430740 1 --2- 172.21.15.7:0/3975459583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa5d57b050 0x55fa5d591920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.385+0000 7fe1f2430740 1 --2- 172.21.15.7:0/3975459583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fa5d550590 0x55fa5d5913e0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.385+0000 7fe1f2430740 1 -- 172.21.15.7:0/3975459583 >> 172.21.15.7:0/3975459583 conn(0x55fa5d5186e0 msgr2=0x55fa5d578fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:32.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.385+0000 7fe1f2430740 1 -- 172.21.15.7:0/3975459583 shutdown_connections 2024-04-25T10:02:32.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.385+0000 7fe1f2430740 1 -- 172.21.15.7:0/3975459583 wait complete. 2024-04-25T10:02:32.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.385+0000 7fe1f2430740 20 client.8181 trim_cache size 0 max 16384 2024-04-25T10:02:32.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.397+0000 7fe1f2430740 1 Processor -- start 2024-04-25T10:02:32.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.397+0000 7fe1f2430740 1 -- start start 2024-04-25T10:02:32.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.397+0000 7fe1f2430740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa5d550590 0x55fa5d57d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:32.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.397+0000 7fe1f2430740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fa5d57b050 0x55fa5d595440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:32.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.397+0000 7fe1f2430740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fa5d58cc60 0x55fa5d595980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:32.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.397+0000 7fe1f2430740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e81ff920 con 0x55fa5d57b050 2024-04-25T10:02:32.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.397+0000 7fe1f2430740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e815d530 con 0x55fa5d550590 2024-04-25T10:02:32.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.397+0000 7fe1f2430740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e81ff320 con 0x55fa5d58cc60 2024-04-25T10:02:32.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.398+0000 7fe1ecbf5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fa5d57b050 0x55fa5d595440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:32.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.398+0000 7fe1ecbf5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fa5d57b050 0x55fa5d595440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48334/0 (socket says 172.21.15.7:48334) 2024-04-25T10:02:32.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.398+0000 7fe1ecbf5640 1 -- 172.21.15.7:0/1759286197 learned_addr learned my addr 172.21.15.7:0/1759286197 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:32.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.398+0000 7fe1ecbf5640 1 -- 172.21.15.7:0/1759286197 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fa5d58cc60 msgr2=0x55fa5d595980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:32.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.398+0000 7fe1ecbf5640 1 --2- 172.21.15.7:0/1759286197 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fa5d58cc60 0x55fa5d595980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.398+0000 7fe1ecbf5640 1 -- 172.21.15.7:0/1759286197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa5d550590 msgr2=0x55fa5d57d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:32.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.398+0000 7fe1ecbf5640 1 --2- 172.21.15.7:0/1759286197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa5d550590 0x55fa5d57d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.398+0000 7fe1ecbf5640 1 -- 172.21.15.7:0/1759286197 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa5d596e00 con 0x55fa5d57b050 2024-04-25T10:02:32.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.398+0000 7fe1ecbf5640 1 --2- 172.21.15.7:0/1759286197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fa5d57b050 0x55fa5d595440 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fe1d800ce60 tx=0x7fe1d805e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f36409d78bf7ea96 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:32.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.398+0000 7fe1d27fc640 1 -- 172.21.15.7:0/1759286197 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d805fe30 con 0x55fa5d57b050 2024-04-25T10:02:32.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.398+0000 7fe1d27fc640 1 -- 172.21.15.7:0/1759286197 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d805ffd0 con 0x55fa5d57b050 2024-04-25T10:02:32.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.398+0000 7fe1d27fc640 1 -- 172.21.15.7:0/1759286197 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d806bd70 con 0x55fa5d57b050 2024-04-25T10:02:32.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.399+0000 7fe1f2430740 1 -- 172.21.15.7:0/1759286197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fa5d57b050 msgr2=0x55fa5d595440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:32.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.399+0000 7fe1f2430740 1 --2- 172.21.15.7:0/1759286197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fa5d57b050 0x55fa5d595440 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fe1d800ce60 tx=0x7fe1d805e040 comp rx=0 tx=0).stop 2024-04-25T10:02:32.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.399+0000 7fe1f2430740 1 -- 172.21.15.7:0/1759286197 shutdown_connections 2024-04-25T10:02:32.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.399+0000 7fe1f2430740 1 --2- 172.21.15.7:0/1759286197 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fa5d58cc60 0x55fa5d595980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.399+0000 7fe1f2430740 1 --2- 172.21.15.7:0/1759286197 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fa5d57b050 0x55fa5d595440 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.399+0000 7fe1f2430740 1 --2- 172.21.15.7:0/1759286197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa5d550590 0x55fa5d57d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.399+0000 7fe1f2430740 1 -- 172.21.15.7:0/1759286197 >> 172.21.15.7:0/1759286197 conn(0x55fa5d5186e0 msgr2=0x55fa5d56cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:32.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.399+0000 7fe1f2430740 1 -- 172.21.15.7:0/1759286197 shutdown_connections 2024-04-25T10:02:32.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.399+0000 7fe1f2430740 1 -- 172.21.15.7:0/1759286197 wait complete. 2024-04-25T10:02:32.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.399+0000 7fe1f2430740 1 -- start start 2024-04-25T10:02:32.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.399+0000 7fe1f2430740 1 Processor -- start 2024-04-25T10:02:32.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.400+0000 7fe1f2430740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fa5d550590 0x55fa5d595c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:32.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.400+0000 7fe1f2430740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa5d57b050 0x55fa5d5961b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:32.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.400+0000 7fe1f2430740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fa5d58cc60 0x55fa5d5af550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:32.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.400+0000 7fe1f2430740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa5d57b430 con 0x55fa5d58cc60 2024-04-25T10:02:32.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.400+0000 7fe1f2430740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa5d56da40 con 0x55fa5d57b050 2024-04-25T10:02:32.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.400+0000 7fe1f2430740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa5d57b9a0 con 0x55fa5d550590 2024-04-25T10:02:32.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.400+0000 7fe1f2430740 10 client.0 _ll_register_callbacks cb 0x7fe1e00015c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:02:32.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.400+0000 7fe1edbf7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fa5d58cc60 0x55fa5d5af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:32.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.400+0000 7fe1edbf7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fa5d58cc60 0x55fa5d5af550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48350/0 (socket says 172.21.15.7:48350) 2024-04-25T10:02:32.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.400+0000 7fe1edbf7640 1 -- 172.21.15.7:0/4116751504 learned_addr learned my addr 172.21.15.7:0/4116751504 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:32.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.400+0000 7fe1ecbf5640 1 --2- 172.21.15.7:0/4116751504 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa5d57b050 0x55fa5d5961b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:32.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.401+0000 7fe1ed3f6640 1 --2- 172.21.15.7:0/4116751504 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fa5d550590 0x55fa5d595c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:32.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.401+0000 7fe1edbf7640 1 -- 172.21.15.7:0/4116751504 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fa5d550590 msgr2=0x55fa5d595c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:32.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.401+0000 7fe1edbf7640 1 --2- 172.21.15.7:0/4116751504 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fa5d550590 0x55fa5d595c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.401+0000 7fe1edbf7640 1 -- 172.21.15.7:0/4116751504 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa5d57b050 msgr2=0x55fa5d5961b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:32.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.401+0000 7fe1edbf7640 1 --2- 172.21.15.7:0/4116751504 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa5d57b050 0x55fa5d5961b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.401+0000 7fe1edbf7640 1 -- 172.21.15.7:0/4116751504 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa5d58f3d0 con 0x55fa5d58cc60 2024-04-25T10:02:32.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.401+0000 7fe1ed3f6640 1 --2- 172.21.15.7:0/4116751504 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fa5d550590 0x55fa5d595c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:02:32.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.401+0000 7fe1edbf7640 1 --2- 172.21.15.7:0/4116751504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fa5d58cc60 0x55fa5d5af550 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00012e0 tx=0x7fe1e0001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d50c382ad8e674 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:32.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.401+0000 7fe1c7fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:02:32.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.401+0000 7fe1c7fff640 1 -- 172.21.15.7:0/4116751504 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0016070 con 0x55fa5d58cc60 2024-04-25T10:02:32.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.401+0000 7fe1c7fff640 1 -- 172.21.15.7:0/4116751504 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fe1e0025d90 con 0x55fa5d58cc60 2024-04-25T10:02:32.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.401+0000 7fe1f2430740 1 -- 172.21.15.7:0/4116751504 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe1d805ffd0 con 0x55fa5d58cc60 2024-04-25T10:02:32.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.401+0000 7fe1c7fff640 1 -- 172.21.15.7:0/4116751504 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1e002c050 con 0x55fa5d58cc60 2024-04-25T10:02:32.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.401+0000 7fe1f2430740 10 client.8187 fetch_fsmap learned FSMap version 66 2024-04-25T10:02:32.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.401+0000 7fe1f2430740 1 -- 172.21.15.7:0/4116751504 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x55fa5d5919a0 con 0x55fa5d58cc60 2024-04-25T10:02:32.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.401+0000 7fe1c7fff640 1 -- 172.21.15.7:0/4116751504 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d805ffd0 con 0x55fa5d58cc60 2024-04-25T10:02:32.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.401+0000 7fe1c7fff640 1 -- 172.21.15.7:0/4116751504 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 66) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe1e002f020 con 0x55fa5d58cc60 2024-04-25T10:02:32.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.401+0000 7fe1f2430740 10 client.8187 fetch_fsmap finished waiting for FSMap version 66 2024-04-25T10:02:32.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.402+0000 7fe1f2430740 10 client.8187 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:02:32.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.402+0000 7fe1f2430740 20 client.8187 populate_metadata read hostname 'smithi007' 2024-04-25T10:02:32.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.402+0000 7fe1f2430740 1 --2- 172.21.15.7:0/4116751504 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x55fa5d5aff00 0x55fa5d599190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:32.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.402+0000 7fe1f2430740 4 client.8187 mds_command: new command op to 8022 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T10:02:32.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.402+0000 7fe1f2430740 1 -- 172.21.15.7:0/4116751504 --> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x55fa5d4c11a0 con 0x55fa5d5aff00 2024-04-25T10:02:32.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.402+0000 7fe1ed3f6640 1 --2- 172.21.15.7:0/4116751504 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x55fa5d5aff00 0x55fa5d599190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:32.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.402+0000 7fe1ed3f6640 1 --2- 172.21.15.7:0/4116751504 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x55fa5d5aff00 0x55fa5d599190 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9418c173fa28aafc server_cookie=70602331adce3c52 in_seq=0 out_seq=0 2024-04-25T10:02:32.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.402+0000 7fe1c7fff640 10 client.8187 ms_handle_connect on v2:172.21.15.7:6836/1061077733 2024-04-25T10:02:32.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.402+0000 7fe1c7fff640 1 -- 172.21.15.7:0/4116751504 <== mds.0 v2:172.21.15.7:6836/1061077733 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55fa5d4c11a0 con 0x55fa5d5aff00 2024-04-25T10:02:32.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.402+0000 7fe1c7fff640 10 client.8187 handle_command_reply: tid=0 2024-04-25T10:02:32.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.402+0000 7fe1f2430740 1 client.8187 shutdown 2024-04-25T10:02:32.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.402+0000 7fe1f2430740 1 -- 172.21.15.7:0/4116751504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fa5d58cc60 msgr2=0x55fa5d5af550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:32.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.402+0000 7fe1f2430740 1 --2- 172.21.15.7:0/4116751504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fa5d58cc60 0x55fa5d5af550 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00012e0 tx=0x7fe1e0001250 comp rx=0 tx=0).stop 2024-04-25T10:02:32.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.402+0000 7fe1f2430740 1 -- 172.21.15.7:0/4116751504 shutdown_connections 2024-04-25T10:02:32.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.402+0000 7fe1f2430740 1 --2- 172.21.15.7:0/4116751504 >> [v2:172.21.15.7:6836/1061077733,v1:172.21.15.7:6837/1061077733] conn(0x55fa5d5aff00 0x55fa5d599190 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.402+0000 7fe1f2430740 1 --2- 172.21.15.7:0/4116751504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fa5d58cc60 0x55fa5d5af550 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.402+0000 7fe1f2430740 1 --2- 172.21.15.7:0/4116751504 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa5d57b050 0x55fa5d5961b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.402+0000 7fe1f2430740 1 --2- 172.21.15.7:0/4116751504 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fa5d550590 0x55fa5d595c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.402+0000 7fe1c7fff640 0 client.8187 ms_handle_reset on v2:172.21.15.7:6836/1061077733 2024-04-25T10:02:32.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.402+0000 7fe1f2430740 1 -- 172.21.15.7:0/4116751504 >> 172.21.15.7:0/4116751504 conn(0x55fa5d5186e0 msgr2=0x55fa5d57d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:32.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.402+0000 7fe1f2430740 1 -- 172.21.15.7:0/4116751504 shutdown_connections 2024-04-25T10:02:32.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.402+0000 7fe1f2430740 1 -- 172.21.15.7:0/4116751504 wait complete. 2024-04-25T10:02:32.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.403+0000 7fe1f2430740 20 client.8187 trim_cache size 0 max 16384 2024-04-25T10:02:32.414 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:02:32.414 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-04-25T10:02:32.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.403+0000 7fe1ef65a640 1 -- 172.21.15.7:0/2884136110 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe1cc06b4d0 msgr2=0x7fe1cc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:32.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.403+0000 7fe1ef65a640 1 --2- 172.21.15.7:0/2884136110 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe1cc06b4d0 0x7fe1cc06d990 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4034000 tx=0x7fe1e402c000 comp rx=0 tx=0).stop 2024-04-25T10:02:32.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.403+0000 7fe1ef65a640 1 -- 172.21.15.7:0/2884136110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1e80b9590 msgr2=0x7fe1e80c9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:32.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.403+0000 7fe1ef65a640 1 --2- 172.21.15.7:0/2884136110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1e80b9590 0x7fe1e80c9b60 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fe1d800c4a0 tx=0x7fe1d800c960 comp rx=0 tx=0).stop 2024-04-25T10:02:32.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.403+0000 7fe1ef65a640 1 -- 172.21.15.7:0/2884136110 shutdown_connections 2024-04-25T10:02:32.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.403+0000 7fe1ef65a640 1 --2- 172.21.15.7:0/2884136110 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe1cc06b4d0 0x7fe1cc06d990 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.403+0000 7fe1ef65a640 1 --2- 172.21.15.7:0/2884136110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1e80d0780 0x7fe1e81e96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.403+0000 7fe1ef65a640 1 --2- 172.21.15.7:0/2884136110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe1e80b9590 0x7fe1e80c9b60 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.403+0000 7fe1ef65a640 1 --2- 172.21.15.7:0/2884136110 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe1e80b9130 0x7fe1e81f3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.403+0000 7fe1ef65a640 1 -- 172.21.15.7:0/2884136110 >> 172.21.15.7:0/2884136110 conn(0x7fe1e80726b0 msgr2=0x7fe1e815f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:32.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.403+0000 7fe1ef65a640 1 -- 172.21.15.7:0/2884136110 shutdown_connections 2024-04-25T10:02:32.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.403+0000 7fe1ef65a640 1 -- 172.21.15.7:0/2884136110 wait complete. 2024-04-25T10:02:32.418 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T10:02:32.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.513+0000 7f305aad8640 1 Processor -- start 2024-04-25T10:02:32.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.513+0000 7f305aad8640 1 -- start start 2024-04-25T10:02:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.514+0000 7f305aad8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f305415dad0 0x7f30540d18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.514+0000 7f305aad8640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30540b9580 0x7f30540d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.514+0000 7f305aad8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30540d2240 con 0x7f30540d32e0 2024-04-25T10:02:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.514+0000 7f305aad8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30540b7990 con 0x7f305415dad0 2024-04-25T10:02:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.514+0000 7f305aad8640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30540d2520 con 0x7f30540b9580 2024-04-25T10:02:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.514+0000 7f3058874640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f305415dad0 0x7f30540d18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.514+0000 7f3053fff640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30540b9580 0x7f30540d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.515+0000 7f3059075640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f30540d32e0 0x7f30540b52d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:53944/0 (socket says 172.21.15.7:53944) 2024-04-25T10:02:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.515+0000 7f3059075640 1 -- 172.21.15.7:0/1544661115 learned_addr learned my addr 172.21.15.7:0/1544661115 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:02:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.515+0000 7f3058874640 1 -- 172.21.15.7:0/1544661115 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30540b9580 msgr2=0x7f30540d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.515+0000 7f3058874640 1 --2- 172.21.15.7:0/1544661115 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30540b9580 0x7f30540d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.515+0000 7f3058874640 1 -- 172.21.15.7:0/1544661115 >> v1:172.21.15.55:6789/0 conn(0x7f30540d32e0 legacy=0x7f30540b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:32.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.515+0000 7f3058874640 1 -- 172.21.15.7:0/1544661115 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30540d2800 con 0x7f305415dad0 2024-04-25T10:02:32.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.515+0000 7f3053fff640 1 --2- 172.21.15.7:0/1544661115 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30540b9580 0x7f30540d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:02:32.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.516+0000 7f3058874640 1 --2- 172.21.15.7:0/1544661115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f305415dad0 0x7f30540d18d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f304c009d90 tx=0x7f304c02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfb87ac2d2289a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:32.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.516+0000 7f30537fe640 1 -- 172.21.15.7:0/1544661115 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c007740 con 0x7f305415dad0 2024-04-25T10:02:32.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.516+0000 7f30537fe640 1 -- 172.21.15.7:0/1544661115 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304c0078e0 con 0x7f305415dad0 2024-04-25T10:02:32.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.516+0000 7f30537fe640 1 -- 172.21.15.7:0/1544661115 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c007cb0 con 0x7f305415dad0 2024-04-25T10:02:32.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.516+0000 7f305aad8640 1 -- 172.21.15.7:0/1544661115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f305415dad0 msgr2=0x7f30540d18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:32.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.516+0000 7f305aad8640 1 --2- 172.21.15.7:0/1544661115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f305415dad0 0x7f30540d18d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f304c009d90 tx=0x7f304c02a6f0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.516+0000 7f305aad8640 1 -- 172.21.15.7:0/1544661115 shutdown_connections 2024-04-25T10:02:32.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.516+0000 7f305aad8640 1 --2- 172.21.15.7:0/1544661115 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30540b9580 0x7f30540d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.516+0000 7f305aad8640 1 --2- 172.21.15.7:0/1544661115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f305415dad0 0x7f30540d18d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.516+0000 7f305aad8640 1 -- 172.21.15.7:0/1544661115 >> 172.21.15.7:0/1544661115 conn(0x7f305406bfe0 msgr2=0x7f305406c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:32.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.516+0000 7f305aad8640 1 -- 172.21.15.7:0/1544661115 shutdown_connections 2024-04-25T10:02:32.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.517+0000 7f305aad8640 1 -- 172.21.15.7:0/1544661115 wait complete. 2024-04-25T10:02:32.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.518+0000 7f305aad8640 1 Processor -- start 2024-04-25T10:02:32.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.518+0000 7f305aad8640 1 -- start start 2024-04-25T10:02:32.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.519+0000 7f305aad8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30540b9580 0x7f305415a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:32.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.519+0000 7f305aad8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30540d32e0 0x7f30541f7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:32.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.519+0000 7f305aad8640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f305415dad0 0x7f3054158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:32.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.519+0000 7f305aad8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305415deb0 con 0x7f30540d32e0 2024-04-25T10:02:32.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.519+0000 7f305aad8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30540d2dc0 con 0x7f30540b9580 2024-04-25T10:02:32.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.519+0000 7f305aad8640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30540cb4c0 con 0x7f305415dad0 2024-04-25T10:02:32.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.519+0000 7f3053fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30540d32e0 0x7f30541f7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:32.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.519+0000 7f3053fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30540d32e0 0x7f30541f7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48362/0 (socket says 172.21.15.7:48362) 2024-04-25T10:02:32.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.519+0000 7f3053fff640 1 -- 172.21.15.7:0/2035991330 learned_addr learned my addr 172.21.15.7:0/2035991330 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:32.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.519+0000 7f3058874640 1 --2- 172.21.15.7:0/2035991330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30540b9580 0x7f305415a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:32.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.519+0000 7f3059075640 1 --2- 172.21.15.7:0/2035991330 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f305415dad0 0x7f3054158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:32.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.519+0000 7f3053fff640 1 -- 172.21.15.7:0/2035991330 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f305415dad0 msgr2=0x7f3054158380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:32.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.519+0000 7f3053fff640 1 --2- 172.21.15.7:0/2035991330 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f305415dad0 0x7f3054158380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.519+0000 7f3053fff640 1 -- 172.21.15.7:0/2035991330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30540b9580 msgr2=0x7f305415a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:32.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.519+0000 7f3053fff640 1 --2- 172.21.15.7:0/2035991330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30540b9580 0x7f305415a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.519+0000 7f3053fff640 1 -- 172.21.15.7:0/2035991330 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30540cb7a0 con 0x7f30540d32e0 2024-04-25T10:02:32.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.519+0000 7f3058874640 1 --2- 172.21.15.7:0/2035991330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30540b9580 0x7f305415a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:02:32.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.519+0000 7f3053fff640 1 --2- 172.21.15.7:0/2035991330 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30540d32e0 0x7f30541f7bb0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f304400ebe0 tx=0x7f304400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:32.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.519+0000 7f30517fa640 1 -- 172.21.15.7:0/2035991330 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3044017070 con 0x7f30540d32e0 2024-04-25T10:02:32.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.519+0000 7f30517fa640 1 -- 172.21.15.7:0/2035991330 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304400cc30 con 0x7f30540d32e0 2024-04-25T10:02:32.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.519+0000 7f305aad8640 1 -- 172.21.15.7:0/2035991330 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30540cba80 con 0x7f30540d32e0 2024-04-25T10:02:32.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.519+0000 7f30517fa640 1 -- 172.21.15.7:0/2035991330 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3044013470 con 0x7f30540d32e0 2024-04-25T10:02:32.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.520+0000 7f305aad8640 1 -- 172.21.15.7:0/2035991330 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30541f80f0 con 0x7f30540d32e0 2024-04-25T10:02:32.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.521+0000 7f305aad8640 1 -- 172.21.15.7:0/2035991330 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3054074bb0 con 0x7f30540d32e0 2024-04-25T10:02:32.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.521+0000 7f30517fa640 1 -- 172.21.15.7:0/2035991330 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f304401a070 con 0x7f30540d32e0 2024-04-25T10:02:32.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.521+0000 7f30517fa640 1 --2- 172.21.15.7:0/2035991330 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f303406b4d0 0x7f303406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:32.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.521+0000 7f30517fa640 1 -- 172.21.15.7:0/2035991330 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f304408a7b0 con 0x7f30540d32e0 2024-04-25T10:02:32.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.521+0000 7f3058874640 1 --2- 172.21.15.7:0/2035991330 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f303406b4d0 0x7f303406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:32.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.522+0000 7f3058874640 1 --2- 172.21.15.7:0/2035991330 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f303406b4d0 0x7f303406d990 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f304c034000 tx=0x7f304c033040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:32.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.525+0000 7f30517fa640 1 -- 172.21.15.7:0/2035991330 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3044059380 con 0x7f30540d32e0 2024-04-25T10:02:32.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.742+0000 7f305aad8640 1 -- 172.21.15.7:0/2035991330 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f30540d1330 con 0x7f30540d32e0 2024-04-25T10:02:32.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.742+0000 7f30517fa640 1 -- 172.21.15.7:0/2035991330 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f3044058c80 con 0x7f30540d32e0 2024-04-25T10:02:32.747 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:02:32.747 INFO:teuthology.orchestra.run.smithi007.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T10:02:32.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.744+0000 7f305aad8640 1 -- 172.21.15.7:0/2035991330 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f303406b4d0 msgr2=0x7f303406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:32.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.744+0000 7f305aad8640 1 --2- 172.21.15.7:0/2035991330 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f303406b4d0 0x7f303406d990 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f304c034000 tx=0x7f304c033040 comp rx=0 tx=0).stop 2024-04-25T10:02:32.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.744+0000 7f305aad8640 1 -- 172.21.15.7:0/2035991330 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30540d32e0 msgr2=0x7f30541f7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:32.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.744+0000 7f305aad8640 1 --2- 172.21.15.7:0/2035991330 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30540d32e0 0x7f30541f7bb0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f304400ebe0 tx=0x7f304400c520 comp rx=0 tx=0).stop 2024-04-25T10:02:32.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.744+0000 7f305aad8640 1 -- 172.21.15.7:0/2035991330 shutdown_connections 2024-04-25T10:02:32.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.744+0000 7f305aad8640 1 --2- 172.21.15.7:0/2035991330 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f303406b4d0 0x7f303406d990 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.744+0000 7f305aad8640 1 --2- 172.21.15.7:0/2035991330 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f305415dad0 0x7f3054158380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.744+0000 7f305aad8640 1 --2- 172.21.15.7:0/2035991330 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f30540d32e0 0x7f30541f7bb0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.744+0000 7f305aad8640 1 --2- 172.21.15.7:0/2035991330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30540b9580 0x7f305415a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:32.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.744+0000 7f305aad8640 1 -- 172.21.15.7:0/2035991330 >> 172.21.15.7:0/2035991330 conn(0x7f305406bfe0 msgr2=0x7f30540d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:32.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.744+0000 7f305aad8640 1 -- 172.21.15.7:0/2035991330 shutdown_connections 2024-04-25T10:02:32.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:32.744+0000 7f305aad8640 1 -- 172.21.15.7:0/2035991330 wait complete. 2024-04-25T10:02:32.759 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T10:02:32.760 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T10:02:32.760 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:02:32.797 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:02:32.840 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T10:02:32.840 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:02:32.840 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:02:32.856 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:02:32.856 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:02:32.912 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:02:33.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.047+0000 7fa77fd22640 1 Processor -- start 2024-04-25T10:02:33.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.047+0000 7fa77fd22640 1 -- start start 2024-04-25T10:02:33.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.048+0000 7fa77fd22640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa77815da20 0x7fa77809a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:33.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.048+0000 7fa77fd22640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7780cfad0 con 0x7fa77806bc70 2024-04-25T10:02:33.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.048+0000 7fa77fd22640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7780cfdb0 con 0x7fa77806c330 2024-04-25T10:02:33.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.048+0000 7fa77fd22640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7780d06e0 con 0x7fa77815da20 2024-04-25T10:02:33.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.048+0000 7fa77d2bd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa77806bc70 0x7fa7780d0b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40754/0 (socket says 172.21.15.7:40754) 2024-04-25T10:02:33.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.048+0000 7fa77d2bd640 1 -- 172.21.15.7:0/2611575422 learned_addr learned my addr 172.21.15.7:0/2611575422 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:02:33.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.048+0000 7fa77dabe640 1 --2- 172.21.15.7:0/2611575422 >> v2:172.21.15.55:3300/0 conn(0x7fa77815da20 0x7fa77809a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:33.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.048+0000 7fa77cabc640 1 -- 172.21.15.7:0/2611575422 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 396410472 0 0) 0x7fa7780cfad0 con 0x7fa77806bc70 2024-04-25T10:02:33.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.048+0000 7fa77cabc640 1 -- 172.21.15.7:0/2611575422 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa764003520 con 0x7fa77806bc70 2024-04-25T10:02:33.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.049+0000 7fa77cabc640 1 -- 172.21.15.7:0/2611575422 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2185378709 0 0) 0x7fa764003520 con 0x7fa77806bc70 2024-04-25T10:02:33.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.049+0000 7fa77cabc640 1 -- 172.21.15.7:0/2611575422 >> v2:172.21.15.55:3300/0 conn(0x7fa77815da20 msgr2=0x7fa77809a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:33.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.049+0000 7fa77cabc640 1 --2- 172.21.15.7:0/2611575422 >> v2:172.21.15.55:3300/0 conn(0x7fa77815da20 0x7fa77809a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.049+0000 7fa77cabc640 1 -- 172.21.15.7:0/2611575422 >> v1:172.21.15.55:6789/0 conn(0x7fa77806c330 legacy=0x7fa7780cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:33.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.049+0000 7fa77cabc640 1 -- 172.21.15.7:0/2611575422 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7780d0090 con 0x7fa77806bc70 2024-04-25T10:02:33.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.049+0000 7fa77cabc640 1 -- 172.21.15.7:0/2611575422 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fa768001670 con 0x7fa77806bc70 2024-04-25T10:02:33.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.049+0000 7fa77cabc640 1 -- 172.21.15.7:0/2611575422 >> v1:172.21.15.7:6789/0 conn(0x7fa77806bc70 legacy=0x7fa7780d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:33.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.049+0000 7fa77cabc640 1 --2- 172.21.15.7:0/2611575422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7640039b0 0x7fa764003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:33.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.049+0000 7fa77cabc640 1 --2- 172.21.15.7:0/2611575422 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa764004800 0x7fa764004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:33.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.049+0000 7fa77cabc640 1 --2- 172.21.15.7:0/2611575422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7640051c0 0x7fa76400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:33.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.049+0000 7fa77cabc640 1 -- 172.21.15.7:0/2611575422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7780d06e0 con 0x7fa7640039b0 2024-04-25T10:02:33.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.049+0000 7fa77cabc640 1 -- 172.21.15.7:0/2611575422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76400c060 con 0x7fa7640051c0 2024-04-25T10:02:33.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.049+0000 7fa77cabc640 1 -- 172.21.15.7:0/2611575422 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76400c260 con 0x7fa764004800 2024-04-25T10:02:33.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.049+0000 7fa77dabe640 1 --2- 172.21.15.7:0/2611575422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7640039b0 0x7fa764003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:33.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.049+0000 7fa77d2bd640 1 --2- 172.21.15.7:0/2611575422 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa764004800 0x7fa764004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:33.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.049+0000 7fa77e2bf640 1 --2- 172.21.15.7:0/2611575422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7640051c0 0x7fa76400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:33.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.049+0000 7fa77dabe640 1 -- 172.21.15.7:0/2611575422 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa764004800 msgr2=0x7fa764004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:33.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.049+0000 7fa77dabe640 1 --2- 172.21.15.7:0/2611575422 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa764004800 0x7fa764004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.049+0000 7fa77dabe640 1 -- 172.21.15.7:0/2611575422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7640051c0 msgr2=0x7fa76400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:33.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.049+0000 7fa77dabe640 1 --2- 172.21.15.7:0/2611575422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7640051c0 0x7fa76400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.049+0000 7fa77dabe640 1 -- 172.21.15.7:0/2611575422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa764003520 con 0x7fa7640039b0 2024-04-25T10:02:33.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.049+0000 7fa77e2bf640 1 -- 172.21.15.7:0/2611575422 reap_dead start 2024-04-25T10:02:33.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.050+0000 7fa77dabe640 1 --2- 172.21.15.7:0/2611575422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7640039b0 0x7fa764003dd0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fa770009ac0 tx=0x7fa764005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9070f5398e4f39e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:33.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.050+0000 7fa77cabc640 1 -- 172.21.15.7:0/2611575422 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa770036070 con 0x7fa7640039b0 2024-04-25T10:02:33.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.050+0000 7fa77cabc640 1 -- 172.21.15.7:0/2611575422 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa770031400 con 0x7fa7640039b0 2024-04-25T10:02:33.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.050+0000 7fa77cabc640 1 -- 172.21.15.7:0/2611575422 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa770009690 con 0x7fa7640039b0 2024-04-25T10:02:33.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.050+0000 7fa77fd22640 1 -- 172.21.15.7:0/2611575422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7640039b0 msgr2=0x7fa764003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:33.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.050+0000 7fa77fd22640 1 --2- 172.21.15.7:0/2611575422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7640039b0 0x7fa764003dd0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fa770009ac0 tx=0x7fa764005830 comp rx=0 tx=0).stop 2024-04-25T10:02:33.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.050+0000 7fa77fd22640 1 -- 172.21.15.7:0/2611575422 shutdown_connections 2024-04-25T10:02:33.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.050+0000 7fa77fd22640 1 --2- 172.21.15.7:0/2611575422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7640039b0 0x7fa764003dd0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.050+0000 7fa77fd22640 1 -- 172.21.15.7:0/2611575422 >> 172.21.15.7:0/2611575422 conn(0x7fa7780d16f0 msgr2=0x7fa7780d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:33.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.051+0000 7fa77fd22640 1 -- 172.21.15.7:0/2611575422 shutdown_connections 2024-04-25T10:02:33.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.051+0000 7fa77fd22640 1 -- 172.21.15.7:0/2611575422 wait complete. 2024-04-25T10:02:33.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.052+0000 7fa77fd22640 1 Processor -- start 2024-04-25T10:02:33.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.052+0000 7fa77fd22640 1 -- start start 2024-04-25T10:02:33.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.052+0000 7fa77fd22640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7640039b0 0x7fa778157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:33.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.052+0000 7fa77fd22640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7780c79a0 0x7fa77815c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:33.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.052+0000 7fa77fd22640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa77815b3b0 0x7fa778070490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:33.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.052+0000 7fa77fd22640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77815df80 con 0x7fa7640039b0 2024-04-25T10:02:33.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.052+0000 7fa77fd22640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77815de00 con 0x7fa7780c79a0 2024-04-25T10:02:33.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.053+0000 7fa77fd22640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa77806c7e0 con 0x7fa77815b3b0 2024-04-25T10:02:33.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.053+0000 7fa77dabe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7640039b0 0x7fa778157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:33.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.053+0000 7fa77dabe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7640039b0 0x7fa778157570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48378/0 (socket says 172.21.15.7:48378) 2024-04-25T10:02:33.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.053+0000 7fa77dabe640 1 -- 172.21.15.7:0/3957511802 learned_addr learned my addr 172.21.15.7:0/3957511802 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:33.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.053+0000 7fa77dabe640 1 -- 172.21.15.7:0/3957511802 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa77815b3b0 msgr2=0x7fa778070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:33.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.053+0000 7fa77d2bd640 1 --2- 172.21.15.7:0/3957511802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7780c79a0 0x7fa77815c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:33.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.053+0000 7fa77e2bf640 1 --2- 172.21.15.7:0/3957511802 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa77815b3b0 0x7fa778070490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:33.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.053+0000 7fa77dabe640 1 --2- 172.21.15.7:0/3957511802 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa77815b3b0 0x7fa778070490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.053+0000 7fa77dabe640 1 -- 172.21.15.7:0/3957511802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7780c79a0 msgr2=0x7fa77815c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:33.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.053+0000 7fa77dabe640 1 --2- 172.21.15.7:0/3957511802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7780c79a0 0x7fa77815c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.053+0000 7fa77dabe640 1 -- 172.21.15.7:0/3957511802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7780c6be0 con 0x7fa7640039b0 2024-04-25T10:02:33.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.053+0000 7fa77dabe640 1 --2- 172.21.15.7:0/3957511802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7640039b0 0x7fa778157570 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fa770009be0 tx=0x7fa770004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:33.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.053+0000 7fa76e7fc640 1 -- 172.21.15.7:0/3957511802 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77003f020 con 0x7fa7640039b0 2024-04-25T10:02:33.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.053+0000 7fa76e7fc640 1 -- 172.21.15.7:0/3957511802 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa770037040 con 0x7fa7640039b0 2024-04-25T10:02:33.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.053+0000 7fa77fd22640 1 -- 172.21.15.7:0/3957511802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7780c6ec0 con 0x7fa7640039b0 2024-04-25T10:02:33.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.053+0000 7fa76e7fc640 1 -- 172.21.15.7:0/3957511802 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa770036070 con 0x7fa7640039b0 2024-04-25T10:02:33.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.053+0000 7fa77fd22640 1 -- 172.21.15.7:0/3957511802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7780c7480 con 0x7fa7640039b0 2024-04-25T10:02:33.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.054+0000 7fa77fd22640 1 -- 172.21.15.7:0/3957511802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7780cd330 con 0x7fa7640039b0 2024-04-25T10:02:33.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.055+0000 7fa76e7fc640 1 -- 172.21.15.7:0/3957511802 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa770042020 con 0x7fa7640039b0 2024-04-25T10:02:33.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.055+0000 7fa76e7fc640 1 --2- 172.21.15.7:0/3957511802 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa75c06b500 0x7fa75c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:33.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.055+0000 7fa76e7fc640 1 -- 172.21.15.7:0/3957511802 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fa7700aa1b0 con 0x7fa7640039b0 2024-04-25T10:02:33.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.055+0000 7fa77d2bd640 1 --2- 172.21.15.7:0/3957511802 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa75c06b500 0x7fa75c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:33.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.056+0000 7fa77d2bd640 1 --2- 172.21.15.7:0/3957511802 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa75c06b500 0x7fa75c06d9c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa768001eb0 tx=0x7fa768001da0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:33.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.059+0000 7fa76e7fc640 1 -- 172.21.15.7:0/3957511802 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa7780cd330 con 0x7fa7640039b0 2024-04-25T10:02:33.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.239+0000 7fa77fd22640 1 -- 172.21.15.7:0/3957511802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa778068fd0 con 0x7fa7640039b0 2024-04-25T10:02:33.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.240+0000 7fa76e7fc640 1 -- 172.21.15.7:0/3957511802 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+17238 (secure 0 0 0) 0x7fa770049070 con 0x7fa7640039b0 2024-04-25T10:02:33.245 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:02:33.246 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":92,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:01:54.932383+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:00:32.330930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T10:00:33.030728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1b","mappings":[{"from":1,"to":7}]},{"pgid":"14.2c","mappings":[{"from":1,"to":5}]},{"pgid":"14.31","mappings":[{"from":1,"to":7}]},{"pgid":"14.32","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6837/3829085443":"2024-04-26T10:01:54.932349+0000","172.21.15.7:6836/3829085443":"2024-04-26T10:01:54.932349+0000","172.21.15.7:6837/2878753733":"2024-04-26T10:00:43.379350+0000","172.21.15.7:6836/2878753733":"2024-04-26T10:00:43.379350+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:02:33.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.243+0000 7fa77fd22640 1 -- 172.21.15.7:0/3957511802 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa75c06b500 msgr2=0x7fa75c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:33.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.243+0000 7fa77fd22640 1 --2- 172.21.15.7:0/3957511802 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa75c06b500 0x7fa75c06d9c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa768001eb0 tx=0x7fa768001da0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.243+0000 7fa77fd22640 1 -- 172.21.15.7:0/3957511802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7640039b0 msgr2=0x7fa778157570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:33.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.243+0000 7fa77fd22640 1 --2- 172.21.15.7:0/3957511802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7640039b0 0x7fa778157570 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fa770009be0 tx=0x7fa770004730 comp rx=0 tx=0).stop 2024-04-25T10:02:33.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.243+0000 7fa77fd22640 1 -- 172.21.15.7:0/3957511802 shutdown_connections 2024-04-25T10:02:33.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.243+0000 7fa77fd22640 1 --2- 172.21.15.7:0/3957511802 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa75c06b500 0x7fa75c06d9c0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.243+0000 7fa77fd22640 1 --2- 172.21.15.7:0/3957511802 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa77815b3b0 0x7fa778070490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.243+0000 7fa77fd22640 1 --2- 172.21.15.7:0/3957511802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7780c79a0 0x7fa77815c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.243+0000 7fa77fd22640 1 --2- 172.21.15.7:0/3957511802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7640039b0 0x7fa778157570 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.243+0000 7fa77fd22640 1 -- 172.21.15.7:0/3957511802 >> 172.21.15.7:0/3957511802 conn(0x7fa7780d16f0 msgr2=0x7fa778159da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:33.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.243+0000 7fa77fd22640 1 -- 172.21.15.7:0/3957511802 shutdown_connections 2024-04-25T10:02:33.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.243+0000 7fa77fd22640 1 -- 172.21.15.7:0/3957511802 wait complete. 2024-04-25T10:02:33.258 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:00:32.330930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:00:33.030728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:02:33.259 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:02:33.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.357+0000 7f251e3bd640 1 Processor -- start 2024-04-25T10:02:33.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.357+0000 7f251e3bd640 1 -- start start 2024-04-25T10:02:33.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.358+0000 7f251e3bd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f25180b78c0 0x7f25181685d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:33.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.358+0000 7f251e3bd640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25180b7ef0 con 0x7f25180d2c40 2024-04-25T10:02:33.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.358+0000 7f251e3bd640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25180b81d0 con 0x7f25180d0780 2024-04-25T10:02:33.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.358+0000 7f251e3bd640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25180b9840 con 0x7f25180b78c0 2024-04-25T10:02:33.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.358+0000 7f251c95a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f25180b78c0 0x7f25181685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:33.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.358+0000 7f25177fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f25180d2c40 0x7f25180b9130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40768/0 (socket says 172.21.15.7:40768) 2024-04-25T10:02:33.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.358+0000 7f25177fe640 1 -- 172.21.15.7:0/95610204 learned_addr learned my addr 172.21.15.7:0/95610204 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:02:33.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.358+0000 7f251c95a640 1 -- 172.21.15.7:0/95610204 >> v1:172.21.15.55:6789/0 conn(0x7f25180d0780 legacy=0x7f25180d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:33.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.358+0000 7f251c95a640 1 -- 172.21.15.7:0/95610204 >> v1:172.21.15.7:6789/0 conn(0x7f25180d2c40 legacy=0x7f25180b9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:33.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.358+0000 7f251c95a640 1 -- 172.21.15.7:0/95610204 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25180b84b0 con 0x7f25180b78c0 2024-04-25T10:02:33.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.358+0000 7f2516ffd640 1 -- 172.21.15.7:0/95610204 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1558372171 0 0) 0x7f25180b7ef0 con 0x7f25180d2c40 2024-04-25T10:02:33.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.359+0000 7f251c95a640 1 --2- 172.21.15.7:0/95610204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25180b78c0 0x7f25181685d0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f2510009d90 tx=0x7f251002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fad5553fac55a7c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:33.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.359+0000 7f2516ffd640 1 -- 172.21.15.7:0/95610204 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2510007740 con 0x7f25180b78c0 2024-04-25T10:02:33.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.359+0000 7f2516ffd640 1 -- 172.21.15.7:0/95610204 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25100078e0 con 0x7f25180b78c0 2024-04-25T10:02:33.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.359+0000 7f2516ffd640 1 -- 172.21.15.7:0/95610204 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2510007cb0 con 0x7f25180b78c0 2024-04-25T10:02:33.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.360+0000 7f251e3bd640 1 -- 172.21.15.7:0/95610204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25180b78c0 msgr2=0x7f25181685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:33.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.360+0000 7f251e3bd640 1 --2- 172.21.15.7:0/95610204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25180b78c0 0x7f25181685d0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f2510009d90 tx=0x7f251002a6f0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.360+0000 7f251e3bd640 1 -- 172.21.15.7:0/95610204 shutdown_connections 2024-04-25T10:02:33.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.360+0000 7f251e3bd640 1 --2- 172.21.15.7:0/95610204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25180b78c0 0x7f25181685d0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.360+0000 7f251e3bd640 1 -- 172.21.15.7:0/95610204 >> 172.21.15.7:0/95610204 conn(0x7f25180726b0 msgr2=0x7f2518072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:33.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.360+0000 7f251e3bd640 1 -- 172.21.15.7:0/95610204 shutdown_connections 2024-04-25T10:02:33.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.360+0000 7f251e3bd640 1 -- 172.21.15.7:0/95610204 wait complete. 2024-04-25T10:02:33.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.361+0000 7f251e3bd640 1 Processor -- start 2024-04-25T10:02:33.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.361+0000 7f251e3bd640 1 -- start start 2024-04-25T10:02:33.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.362+0000 7f251e3bd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25180b78c0 0x7f251815c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:33.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.362+0000 7f251e3bd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25180d0780 0x7f25181f0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:33.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.362+0000 7f251e3bd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25180d2c40 0x7f25181f0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:33.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.362+0000 7f251e3bd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25181611b0 con 0x7f25180d2c40 2024-04-25T10:02:33.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.362+0000 7f251e3bd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25180b8a70 con 0x7f25180b78c0 2024-04-25T10:02:33.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.362+0000 7f251e3bd640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2518161330 con 0x7f25180d0780 2024-04-25T10:02:33.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.362+0000 7f251c95a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25180d2c40 0x7f25181f0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:33.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.362+0000 7f251c95a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25180d2c40 0x7f25181f0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48398/0 (socket says 172.21.15.7:48398) 2024-04-25T10:02:33.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.362+0000 7f251c95a640 1 -- 172.21.15.7:0/3049595032 learned_addr learned my addr 172.21.15.7:0/3049595032 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:33.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.362+0000 7f2517fff640 1 --2- 172.21.15.7:0/3049595032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25180b78c0 0x7f251815c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:33.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.362+0000 7f25177fe640 1 --2- 172.21.15.7:0/3049595032 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25180d0780 0x7f25181f0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:33.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.362+0000 7f251c95a640 1 -- 172.21.15.7:0/3049595032 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25180d0780 msgr2=0x7f25181f0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:33.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.362+0000 7f251c95a640 1 --2- 172.21.15.7:0/3049595032 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25180d0780 0x7f25181f0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.362+0000 7f251c95a640 1 -- 172.21.15.7:0/3049595032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25180b78c0 msgr2=0x7f251815c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:33.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.362+0000 7f251c95a640 1 --2- 172.21.15.7:0/3049595032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25180b78c0 0x7f251815c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.362+0000 7f251c95a640 1 -- 172.21.15.7:0/3049595032 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25181f3870 con 0x7f25180d2c40 2024-04-25T10:02:33.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.362+0000 7f251c95a640 1 --2- 172.21.15.7:0/3049595032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25180d2c40 0x7f25181f0a60 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f2510009d90 tx=0x7f2510004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:33.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.363+0000 7f2514ff9640 1 -- 172.21.15.7:0/3049595032 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2510040070 con 0x7f25180d2c40 2024-04-25T10:02:33.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.363+0000 7f2514ff9640 1 -- 172.21.15.7:0/3049595032 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2510031c90 con 0x7f25180d2c40 2024-04-25T10:02:33.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.363+0000 7f251e3bd640 1 -- 172.21.15.7:0/3049595032 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25181f3b50 con 0x7f25180d2c40 2024-04-25T10:02:33.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.363+0000 7f2514ff9640 1 -- 172.21.15.7:0/3049595032 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251003c640 con 0x7f25180d2c40 2024-04-25T10:02:33.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.363+0000 7f251e3bd640 1 -- 172.21.15.7:0/3049595032 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25181f4110 con 0x7f25180d2c40 2024-04-25T10:02:33.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.364+0000 7f251e3bd640 1 -- 172.21.15.7:0/3049595032 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25180685d0 con 0x7f25180d2c40 2024-04-25T10:02:33.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.364+0000 7f2514ff9640 1 -- 172.21.15.7:0/3049595032 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2510039040 con 0x7f25180d2c40 2024-04-25T10:02:33.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.365+0000 7f2514ff9640 1 --2- 172.21.15.7:0/3049595032 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f24f806b4d0 0x7f24f806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:33.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.365+0000 7f2514ff9640 1 -- 172.21.15.7:0/3049595032 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f25100ab9b0 con 0x7f25180d2c40 2024-04-25T10:02:33.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.365+0000 7f2517fff640 1 --2- 172.21.15.7:0/3049595032 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f24f806b4d0 0x7f24f806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:33.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.365+0000 7f2517fff640 1 --2- 172.21.15.7:0/3049595032 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f24f806b4d0 0x7f24f806d990 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f25180d29d0 tx=0x7f2508009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:33.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.369+0000 7f2514ff9640 1 -- 172.21.15.7:0/3049595032 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2510079fe0 con 0x7f25180d2c40 2024-04-25T10:02:33.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.549+0000 7f251e3bd640 1 -- 172.21.15.7:0/3049595032 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2518068f60 con 0x7f25180d2c40 2024-04-25T10:02:33.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.549+0000 7f2514ff9640 1 -- 172.21.15.7:0/3049595032 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7f251007e080 con 0x7f25180d2c40 2024-04-25T10:02:33.554 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T10:02:33.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.551+0000 7f251e3bd640 1 -- 172.21.15.7:0/3049595032 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f24f806b4d0 msgr2=0x7f24f806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.551+0000 7f251e3bd640 1 --2- 172.21.15.7:0/3049595032 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f24f806b4d0 0x7f24f806d990 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f25180d29d0 tx=0x7f2508009040 comp rx=0 tx=0).stop 2024-04-25T10:02:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.551+0000 7f251e3bd640 1 -- 172.21.15.7:0/3049595032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25180d2c40 msgr2=0x7f25181f0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.551+0000 7f251e3bd640 1 --2- 172.21.15.7:0/3049595032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25180d2c40 0x7f25181f0a60 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f2510009d90 tx=0x7f2510004a40 comp rx=0 tx=0).stop 2024-04-25T10:02:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.551+0000 7f251e3bd640 1 -- 172.21.15.7:0/3049595032 shutdown_connections 2024-04-25T10:02:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.551+0000 7f251e3bd640 1 --2- 172.21.15.7:0/3049595032 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f24f806b4d0 0x7f24f806d990 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.551+0000 7f251e3bd640 1 --2- 172.21.15.7:0/3049595032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25180d2c40 0x7f25181f0a60 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.551+0000 7f251e3bd640 1 --2- 172.21.15.7:0/3049595032 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25180d0780 0x7f25181f0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.551+0000 7f251e3bd640 1 --2- 172.21.15.7:0/3049595032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25180b78c0 0x7f251815c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.551+0000 7f251e3bd640 1 -- 172.21.15.7:0/3049595032 >> 172.21.15.7:0/3049595032 conn(0x7f25180726b0 msgr2=0x7f251815de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.552+0000 7f251e3bd640 1 -- 172.21.15.7:0/3049595032 shutdown_connections 2024-04-25T10:02:33.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.552+0000 7f251e3bd640 1 -- 172.21.15.7:0/3049595032 wait complete. 2024-04-25T10:02:33.567 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:02:33.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.666+0000 7fe962cf5640 1 Processor -- start 2024-04-25T10:02:33.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.666+0000 7fe962cf5640 1 -- start start 2024-04-25T10:02:33.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.666+0000 7fe962cf5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe95c143fb0 0x7fe95c0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:33.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.666+0000 7fe962cf5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe95c06e240 0x7fe95c06e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:33.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.667+0000 7fe962cf5640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe95c0ce610 0x7fe95c0cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:33.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.667+0000 7fe962cf5640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe95c06ebe0 con 0x7fe95c0ce610 2024-04-25T10:02:33.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.667+0000 7fe962cf5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe95c0b2ee0 con 0x7fe95c143fb0 2024-04-25T10:02:33.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.667+0000 7fe962cf5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c0b3150 con 0x7fe95c06e240 2024-04-25T10:02:33.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.667+0000 7fe961292640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe95c0ce610 0x7fe95c0cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:33.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.667+0000 7fe961292640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe95c0ce610 0x7fe95c0cea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48402/0 (socket says 172.21.15.7:48402) 2024-04-25T10:02:33.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.667+0000 7fe961292640 1 -- 172.21.15.7:0/916646098 learned_addr learned my addr 172.21.15.7:0/916646098 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:33.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.667+0000 7fe95bfff640 1 --2- 172.21.15.7:0/916646098 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe95c06e240 0x7fe95c06e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:33.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.667+0000 7fe960a91640 1 --2- 172.21.15.7:0/916646098 >> v2:172.21.15.55:3300/0 conn(0x7fe95c143fb0 0x7fe95c0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:33.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.667+0000 7fe961292640 1 -- 172.21.15.7:0/916646098 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe95c06e240 msgr2=0x7fe95c06e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:33.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.667+0000 7fe961292640 1 --2- 172.21.15.7:0/916646098 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe95c06e240 0x7fe95c06e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.667+0000 7fe961292640 1 -- 172.21.15.7:0/916646098 >> v2:172.21.15.55:3300/0 conn(0x7fe95c143fb0 msgr2=0x7fe95c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:33.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.667+0000 7fe961292640 1 --2- 172.21.15.7:0/916646098 >> v2:172.21.15.55:3300/0 conn(0x7fe95c143fb0 0x7fe95c0b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.667+0000 7fe961292640 1 -- 172.21.15.7:0/916646098 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95c0b3430 con 0x7fe95c0ce610 2024-04-25T10:02:33.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.668+0000 7fe961292640 1 --2- 172.21.15.7:0/916646098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe95c0ce610 0x7fe95c0cea30 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fe95c0b4d20 tx=0x7fe95402c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8733677662d2f5d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.668+0000 7fe95b7fe640 1 -- 172.21.15.7:0/916646098 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95400b2e0 con 0x7fe95c0ce610 2024-04-25T10:02:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.668+0000 7fe95b7fe640 1 -- 172.21.15.7:0/916646098 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe954009600 con 0x7fe95c0ce610 2024-04-25T10:02:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.668+0000 7fe95b7fe640 1 -- 172.21.15.7:0/916646098 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95400b480 con 0x7fe95c0ce610 2024-04-25T10:02:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.668+0000 7fe962cf5640 1 -- 172.21.15.7:0/916646098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe95c0ce610 msgr2=0x7fe95c0cea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.668+0000 7fe962cf5640 1 --2- 172.21.15.7:0/916646098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe95c0ce610 0x7fe95c0cea30 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fe95c0b4d20 tx=0x7fe95402c8a0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.668+0000 7fe962cf5640 1 -- 172.21.15.7:0/916646098 shutdown_connections 2024-04-25T10:02:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.668+0000 7fe962cf5640 1 --2- 172.21.15.7:0/916646098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe95c0ce610 0x7fe95c0cea30 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.668+0000 7fe962cf5640 1 --2- 172.21.15.7:0/916646098 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe95c06e240 0x7fe95c06e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.668+0000 7fe962cf5640 1 --2- 172.21.15.7:0/916646098 >> v2:172.21.15.55:3300/0 conn(0x7fe95c143fb0 0x7fe95c0b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.669+0000 7fe962cf5640 1 -- 172.21.15.7:0/916646098 >> 172.21.15.7:0/916646098 conn(0x7fe95c06ab60 msgr2=0x7fe95c06af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.669+0000 7fe962cf5640 1 -- 172.21.15.7:0/916646098 shutdown_connections 2024-04-25T10:02:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.669+0000 7fe962cf5640 1 -- 172.21.15.7:0/916646098 wait complete. 2024-04-25T10:02:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.670+0000 7fe962cf5640 1 Processor -- start 2024-04-25T10:02:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.670+0000 7fe962cf5640 1 -- start start 2024-04-25T10:02:33.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.671+0000 7fe962cf5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe95c06e240 0x7fe95c0ab100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:33.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.671+0000 7fe962cf5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe95c0ce610 0x7fe95c0a9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:33.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.671+0000 7fe962cf5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe95c143fb0 0x7fe95c0a9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:33.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.671+0000 7fe962cf5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c0cf2f0 con 0x7fe95c0ce610 2024-04-25T10:02:33.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.671+0000 7fe962cf5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c144390 con 0x7fe95c143fb0 2024-04-25T10:02:33.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.671+0000 7fe962cf5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c0cef70 con 0x7fe95c06e240 2024-04-25T10:02:33.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.671+0000 7fe95bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe95c0ce610 0x7fe95c0a9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:33.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.671+0000 7fe95bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe95c0ce610 0x7fe95c0a9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48412/0 (socket says 172.21.15.7:48412) 2024-04-25T10:02:33.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.671+0000 7fe95bfff640 1 -- 172.21.15.7:0/1841173480 learned_addr learned my addr 172.21.15.7:0/1841173480 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:33.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.671+0000 7fe961292640 1 --2- 172.21.15.7:0/1841173480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe95c143fb0 0x7fe95c0a9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:33.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.671+0000 7fe960a91640 1 --2- 172.21.15.7:0/1841173480 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe95c06e240 0x7fe95c0ab100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:33.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.671+0000 7fe95bfff640 1 -- 172.21.15.7:0/1841173480 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe95c06e240 msgr2=0x7fe95c0ab100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:33.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.671+0000 7fe95bfff640 1 --2- 172.21.15.7:0/1841173480 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe95c06e240 0x7fe95c0ab100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.671+0000 7fe95bfff640 1 -- 172.21.15.7:0/1841173480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe95c143fb0 msgr2=0x7fe95c0a9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:33.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.671+0000 7fe95bfff640 1 --2- 172.21.15.7:0/1841173480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe95c143fb0 0x7fe95c0a9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.671+0000 7fe95bfff640 1 -- 172.21.15.7:0/1841173480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95c0aed00 con 0x7fe95c0ce610 2024-04-25T10:02:33.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.671+0000 7fe961292640 1 --2- 172.21.15.7:0/1841173480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe95c143fb0 0x7fe95c0a9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:02:33.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.671+0000 7fe960a91640 1 --2- 172.21.15.7:0/1841173480 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe95c06e240 0x7fe95c0ab100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:02:33.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.671+0000 7fe95bfff640 1 --2- 172.21.15.7:0/1841173480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe95c0ce610 0x7fe95c0a9a40 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fe94800d800 tx=0x7fe94800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:33.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.671+0000 7fe9597fa640 1 -- 172.21.15.7:0/1841173480 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe948018020 con 0x7fe95c0ce610 2024-04-25T10:02:33.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.671+0000 7fe9597fa640 1 -- 172.21.15.7:0/1841173480 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9480096a0 con 0x7fe95c0ce610 2024-04-25T10:02:33.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.672+0000 7fe962cf5640 1 -- 172.21.15.7:0/1841173480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe95c131250 con 0x7fe95c0ce610 2024-04-25T10:02:33.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.672+0000 7fe9597fa640 1 -- 172.21.15.7:0/1841173480 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe948009a70 con 0x7fe95c0ce610 2024-04-25T10:02:33.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.672+0000 7fe962cf5640 1 -- 172.21.15.7:0/1841173480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe95c131810 con 0x7fe95c0ce610 2024-04-25T10:02:33.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.672+0000 7fe962cf5640 1 -- 172.21.15.7:0/1841173480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe95c068f60 con 0x7fe95c0ce610 2024-04-25T10:02:33.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.673+0000 7fe9597fa640 1 -- 172.21.15.7:0/1841173480 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe94801b020 con 0x7fe95c0ce610 2024-04-25T10:02:33.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.673+0000 7fe9597fa640 1 --2- 172.21.15.7:0/1841173480 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe94006b4d0 0x7fe94006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:33.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.673+0000 7fe9597fa640 1 -- 172.21.15.7:0/1841173480 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fe94808a7c0 con 0x7fe95c0ce610 2024-04-25T10:02:33.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.673+0000 7fe960a91640 1 --2- 172.21.15.7:0/1841173480 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe94006b4d0 0x7fe94006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:33.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.674+0000 7fe960a91640 1 --2- 172.21.15.7:0/1841173480 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe94006b4d0 0x7fe94006d990 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fe950006fd0 tx=0x7fe950008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:33.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.678+0000 7fe9597fa640 1 -- 172.21.15.7:0/1841173480 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe948022030 con 0x7fe95c0ce610 2024-04-25T10:02:33.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.861+0000 7fe962cf5640 1 -- 172.21.15.7:0/1841173480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe95c0ccd30 con 0x7fe95c0ce610 2024-04-25T10:02:33.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.861+0000 7fe9597fa640 1 -- 172.21.15.7:0/1841173480 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe9480592f0 con 0x7fe95c0ce610 2024-04-25T10:02:33.866 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T10:02:33.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.863+0000 7fe962cf5640 1 -- 172.21.15.7:0/1841173480 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe94006b4d0 msgr2=0x7fe94006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:33.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.863+0000 7fe962cf5640 1 --2- 172.21.15.7:0/1841173480 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe94006b4d0 0x7fe94006d990 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fe950006fd0 tx=0x7fe950008040 comp rx=0 tx=0).stop 2024-04-25T10:02:33.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.863+0000 7fe962cf5640 1 -- 172.21.15.7:0/1841173480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe95c0ce610 msgr2=0x7fe95c0a9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:33.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.863+0000 7fe962cf5640 1 --2- 172.21.15.7:0/1841173480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe95c0ce610 0x7fe95c0a9a40 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fe94800d800 tx=0x7fe94800dcc0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.863+0000 7fe962cf5640 1 -- 172.21.15.7:0/1841173480 shutdown_connections 2024-04-25T10:02:33.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.863+0000 7fe962cf5640 1 --2- 172.21.15.7:0/1841173480 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe94006b4d0 0x7fe94006d990 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.863+0000 7fe962cf5640 1 --2- 172.21.15.7:0/1841173480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe95c143fb0 0x7fe95c0a9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.863+0000 7fe962cf5640 1 --2- 172.21.15.7:0/1841173480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe95c0ce610 0x7fe95c0a9a40 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.863+0000 7fe962cf5640 1 --2- 172.21.15.7:0/1841173480 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe95c06e240 0x7fe95c0ab100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.863+0000 7fe962cf5640 1 -- 172.21.15.7:0/1841173480 >> 172.21.15.7:0/1841173480 conn(0x7fe95c06ab60 msgr2=0x7fe95c15c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:33.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.863+0000 7fe962cf5640 1 -- 172.21.15.7:0/1841173480 shutdown_connections 2024-04-25T10:02:33.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.863+0000 7fe962cf5640 1 -- 172.21.15.7:0/1841173480 wait complete. 2024-04-25T10:02:33.879 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:02:33.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.979+0000 7fe41a142640 1 Processor -- start 2024-04-25T10:02:33.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.979+0000 7fe41a142640 1 -- start start 2024-04-25T10:02:33.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.980+0000 7fe41a142640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe4140b78c0 0x7fe4141685d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:33.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.980+0000 7fe41a142640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4140b7ef0 con 0x7fe4140d0780 2024-04-25T10:02:33.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.980+0000 7fe41a142640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4140b81d0 con 0x7fe4140d2c40 2024-04-25T10:02:33.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.980+0000 7fe41a142640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4140b9840 con 0x7fe4140b78c0 2024-04-25T10:02:33.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.980+0000 7fe413fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe4140b78c0 0x7fe4141685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:33.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.980+0000 7fe4137fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe4140d0780 0x7fe4140d0b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40770/0 (socket says 172.21.15.7:40770) 2024-04-25T10:02:33.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.980+0000 7fe4137fe640 1 -- 172.21.15.7:0/636647305 learned_addr learned my addr 172.21.15.7:0/636647305 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:02:33.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.980+0000 7fe413fff640 1 -- 172.21.15.7:0/636647305 >> v1:172.21.15.55:6789/0 conn(0x7fe4140d2c40 legacy=0x7fe4140b9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:33.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.980+0000 7fe413fff640 1 -- 172.21.15.7:0/636647305 >> v1:172.21.15.7:6789/0 conn(0x7fe4140d0780 legacy=0x7fe4140d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:33.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.980+0000 7fe4127fc640 1 -- 172.21.15.7:0/636647305 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105532032 0 0) 0x7fe4140b7ef0 con 0x7fe4140d0780 2024-04-25T10:02:33.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.980+0000 7fe413fff640 1 -- 172.21.15.7:0/636647305 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4140b84b0 con 0x7fe4140b78c0 2024-04-25T10:02:33.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.981+0000 7fe413fff640 1 --2- 172.21.15.7:0/636647305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4140b78c0 0x7fe4141685d0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fe40c009d90 tx=0x7fe40c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e77dc79e479f33c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:33.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.981+0000 7fe4127fc640 1 -- 172.21.15.7:0/636647305 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c007740 con 0x7fe4140b78c0 2024-04-25T10:02:33.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.981+0000 7fe4127fc640 1 -- 172.21.15.7:0/636647305 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40c0078e0 con 0x7fe4140b78c0 2024-04-25T10:02:33.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.981+0000 7fe4127fc640 1 -- 172.21.15.7:0/636647305 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c007cb0 con 0x7fe4140b78c0 2024-04-25T10:02:33.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.981+0000 7fe41a142640 1 -- 172.21.15.7:0/636647305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4140b78c0 msgr2=0x7fe4141685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:33.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.981+0000 7fe41a142640 1 --2- 172.21.15.7:0/636647305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4140b78c0 0x7fe4141685d0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fe40c009d90 tx=0x7fe40c02a6a0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.981+0000 7fe41a142640 1 -- 172.21.15.7:0/636647305 shutdown_connections 2024-04-25T10:02:33.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.981+0000 7fe41a142640 1 --2- 172.21.15.7:0/636647305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4140b78c0 0x7fe4141685d0 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.981+0000 7fe41a142640 1 -- 172.21.15.7:0/636647305 >> 172.21.15.7:0/636647305 conn(0x7fe4140726b0 msgr2=0x7fe414072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:33.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.982+0000 7fe41a142640 1 -- 172.21.15.7:0/636647305 shutdown_connections 2024-04-25T10:02:33.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.982+0000 7fe41a142640 1 -- 172.21.15.7:0/636647305 wait complete. 2024-04-25T10:02:33.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.983+0000 7fe41a142640 1 Processor -- start 2024-04-25T10:02:33.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.983+0000 7fe41a142640 1 -- start start 2024-04-25T10:02:33.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.983+0000 7fe41a142640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4140b78c0 0x7fe41414d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:33.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.983+0000 7fe41a142640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe4140d0780 0x7fe41415cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:33.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.983+0000 7fe41a142640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4140d2c40 0x7fe414149910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:33.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.984+0000 7fe41a142640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4141611b0 con 0x7fe4140d2c40 2024-04-25T10:02:33.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.984+0000 7fe41a142640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4140b8a70 con 0x7fe4140b78c0 2024-04-25T10:02:33.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.984+0000 7fe41a142640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe414161330 con 0x7fe4140d0780 2024-04-25T10:02:33.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.984+0000 7fe413fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4140d2c40 0x7fe414149910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:33.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.984+0000 7fe413fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4140d2c40 0x7fe414149910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48436/0 (socket says 172.21.15.7:48436) 2024-04-25T10:02:33.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.984+0000 7fe413fff640 1 -- 172.21.15.7:0/2665237613 learned_addr learned my addr 172.21.15.7:0/2665237613 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:33.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.984+0000 7fe4137fe640 1 --2- 172.21.15.7:0/2665237613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4140b78c0 0x7fe41414d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:33.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.984+0000 7fe412ffd640 1 --2- 172.21.15.7:0/2665237613 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe4140d0780 0x7fe41415cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:33.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.984+0000 7fe413fff640 1 -- 172.21.15.7:0/2665237613 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe4140d0780 msgr2=0x7fe41415cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:33.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.984+0000 7fe413fff640 1 --2- 172.21.15.7:0/2665237613 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe4140d0780 0x7fe41415cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.984+0000 7fe413fff640 1 -- 172.21.15.7:0/2665237613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4140b78c0 msgr2=0x7fe41414d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:33.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.984+0000 7fe413fff640 1 --2- 172.21.15.7:0/2665237613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4140b78c0 0x7fe41414d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:33.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.984+0000 7fe413fff640 1 -- 172.21.15.7:0/2665237613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41414d700 con 0x7fe4140d2c40 2024-04-25T10:02:33.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.984+0000 7fe413fff640 1 --2- 172.21.15.7:0/2665237613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4140d2c40 0x7fe414149910 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fe40c009eb0 tx=0x7fe40c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:33.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.984+0000 7fe3fbfff640 1 -- 172.21.15.7:0/2665237613 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c040070 con 0x7fe4140d2c40 2024-04-25T10:02:33.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.984+0000 7fe3fbfff640 1 -- 172.21.15.7:0/2665237613 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40c031c40 con 0x7fe4140d2c40 2024-04-25T10:02:33.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.984+0000 7fe41a142640 1 -- 172.21.15.7:0/2665237613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4141583e0 con 0x7fe4140d2c40 2024-04-25T10:02:33.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.984+0000 7fe3fbfff640 1 -- 172.21.15.7:0/2665237613 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c003990 con 0x7fe4140d2c40 2024-04-25T10:02:33.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.984+0000 7fe41a142640 1 -- 172.21.15.7:0/2665237613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4140c9080 con 0x7fe4140d2c40 2024-04-25T10:02:33.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.985+0000 7fe41a142640 1 -- 172.21.15.7:0/2665237613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe414068f60 con 0x7fe4140d2c40 2024-04-25T10:02:33.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.986+0000 7fe3fbfff640 1 -- 172.21.15.7:0/2665237613 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe40c039040 con 0x7fe4140d2c40 2024-04-25T10:02:33.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.986+0000 7fe3fbfff640 1 --2- 172.21.15.7:0/2665237613 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe40006b500 0x7fe40006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:33.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.986+0000 7fe4137fe640 1 --2- 172.21.15.7:0/2665237613 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe40006b500 0x7fe40006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:33.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.986+0000 7fe3fbfff640 1 -- 172.21.15.7:0/2665237613 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fe40c0ab4c0 con 0x7fe4140d2c40 2024-04-25T10:02:33.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.987+0000 7fe4137fe640 1 --2- 172.21.15.7:0/2665237613 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe40006b500 0x7fe40006d9c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fe404007fd0 tx=0x7fe404009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:33.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:33.991+0000 7fe3fbfff640 1 -- 172.21.15.7:0/2665237613 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe4141583e0 con 0x7fe4140d2c40 2024-04-25T10:02:34.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.169+0000 7fe41a142640 1 -- 172.21.15.7:0/2665237613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe41406aef0 con 0x7fe4140d2c40 2024-04-25T10:02:34.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.170+0000 7fe3fbfff640 1 -- 172.21.15.7:0/2665237613 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe41414d700 con 0x7fe4140d2c40 2024-04-25T10:02:34.175 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T10:02:34.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.172+0000 7fe41a142640 1 -- 172.21.15.7:0/2665237613 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe40006b500 msgr2=0x7fe40006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:34.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.172+0000 7fe41a142640 1 --2- 172.21.15.7:0/2665237613 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe40006b500 0x7fe40006d9c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fe404007fd0 tx=0x7fe404009040 comp rx=0 tx=0).stop 2024-04-25T10:02:34.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.172+0000 7fe41a142640 1 -- 172.21.15.7:0/2665237613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4140d2c40 msgr2=0x7fe414149910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:34.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.172+0000 7fe41a142640 1 --2- 172.21.15.7:0/2665237613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4140d2c40 0x7fe414149910 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fe40c009eb0 tx=0x7fe40c004a40 comp rx=0 tx=0).stop 2024-04-25T10:02:34.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.172+0000 7fe41a142640 1 -- 172.21.15.7:0/2665237613 shutdown_connections 2024-04-25T10:02:34.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.172+0000 7fe41a142640 1 --2- 172.21.15.7:0/2665237613 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe40006b500 0x7fe40006d9c0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:34.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.172+0000 7fe41a142640 1 --2- 172.21.15.7:0/2665237613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4140d2c40 0x7fe414149910 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:34.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.172+0000 7fe41a142640 1 --2- 172.21.15.7:0/2665237613 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe4140d0780 0x7fe41415cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:34.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.172+0000 7fe41a142640 1 --2- 172.21.15.7:0/2665237613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4140b78c0 0x7fe41414d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:34.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.172+0000 7fe41a142640 1 -- 172.21.15.7:0/2665237613 >> 172.21.15.7:0/2665237613 conn(0x7fe4140726b0 msgr2=0x7fe4140d3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:34.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.172+0000 7fe41a142640 1 -- 172.21.15.7:0/2665237613 shutdown_connections 2024-04-25T10:02:34.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.172+0000 7fe41a142640 1 -- 172.21.15.7:0/2665237613 wait complete. 2024-04-25T10:02:34.187 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:02:34.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.284+0000 7f4bf57ce640 1 Processor -- start 2024-04-25T10:02:34.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.284+0000 7f4bf57ce640 1 -- start start 2024-04-25T10:02:34.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.285+0000 7f4bf57ce640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4bf006c250 0x7f4bf009a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:34.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.285+0000 7f4bf57ce640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4bf00d0360 0x7f4bf00cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:34.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.285+0000 7f4bf57ce640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf0099b20 con 0x7f4bf006bce0 2024-04-25T10:02:34.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.285+0000 7f4bf57ce640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bf009ae20 con 0x7f4bf006c250 2024-04-25T10:02:34.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.285+0000 7f4bf57ce640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf009a450 con 0x7f4bf00d0360 2024-04-25T10:02:34.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.285+0000 7f4bef7fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4bf00d0360 0x7f4bf00cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:34.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.285+0000 7f4beeffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4bf006c250 0x7f4bf009a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:34.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.285+0000 7f4bef7fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4bf00d0360 0x7f4bf00cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:49552/0 (socket says 172.21.15.7:49552) 2024-04-25T10:02:34.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.285+0000 7f4bee7fc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4bf006bce0 0x7f4bf006c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:53998/0 (socket says 172.21.15.7:53998) 2024-04-25T10:02:34.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.285+0000 7f4bef7fe640 1 -- 172.21.15.7:0/2570735803 learned_addr learned my addr 172.21.15.7:0/2570735803 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:34.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.285+0000 7f4beeffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4bf006c250 0x7f4bf009a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:44328/0 (socket says 172.21.15.7:44328) 2024-04-25T10:02:34.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.286+0000 7f4bef7fe640 1 -- 172.21.15.7:0/2570735803 >> v2:172.21.15.55:3300/0 conn(0x7f4bf006c250 msgr2=0x7f4bf009a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:34.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.286+0000 7f4bef7fe640 1 --2- 172.21.15.7:0/2570735803 >> v2:172.21.15.55:3300/0 conn(0x7f4bf006c250 0x7f4bf009a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:34.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.286+0000 7f4bef7fe640 1 -- 172.21.15.7:0/2570735803 >> v1:172.21.15.55:6789/0 conn(0x7f4bf006bce0 legacy=0x7f4bf006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:34.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.286+0000 7f4bef7fe640 1 -- 172.21.15.7:0/2570735803 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf0099e00 con 0x7f4bf00d0360 2024-04-25T10:02:34.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.286+0000 7f4beeffd640 1 --2- 172.21.15.7:0/2570735803 >> v2:172.21.15.55:3300/0 conn(0x7f4bf006c250 0x7f4bf009a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:02:34.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.287+0000 7f4bef7fe640 1 --2- 172.21.15.7:0/2570735803 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4bf00d0360 0x7f4bf00cbd30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4be0009e50 tx=0x7f4be002a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39d56fa4efd47351 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:34.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.287+0000 7f4bedffb640 1 -- 172.21.15.7:0/2570735803 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be0036070 con 0x7f4bf00d0360 2024-04-25T10:02:34.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.287+0000 7f4bedffb640 1 -- 172.21.15.7:0/2570735803 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be0031600 con 0x7f4bf00d0360 2024-04-25T10:02:34.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.287+0000 7f4bedffb640 1 -- 172.21.15.7:0/2570735803 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be00319d0 con 0x7f4bf00d0360 2024-04-25T10:02:34.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.287+0000 7f4bf57ce640 1 -- 172.21.15.7:0/2570735803 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4bf00d0360 msgr2=0x7f4bf00cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:34.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.287+0000 7f4bf57ce640 1 --2- 172.21.15.7:0/2570735803 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4bf00d0360 0x7f4bf00cbd30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4be0009e50 tx=0x7f4be002a5f0 comp rx=0 tx=0).stop 2024-04-25T10:02:34.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.287+0000 7f4bf57ce640 1 -- 172.21.15.7:0/2570735803 shutdown_connections 2024-04-25T10:02:34.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.287+0000 7f4bf57ce640 1 --2- 172.21.15.7:0/2570735803 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4bf00d0360 0x7f4bf00cbd30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:34.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.287+0000 7f4bf57ce640 1 --2- 172.21.15.7:0/2570735803 >> v2:172.21.15.55:3300/0 conn(0x7f4bf006c250 0x7f4bf009a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:34.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.287+0000 7f4bf57ce640 1 -- 172.21.15.7:0/2570735803 >> 172.21.15.7:0/2570735803 conn(0x7f4bf00d16e0 msgr2=0x7f4bf00d1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:34.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.287+0000 7f4bf57ce640 1 -- 172.21.15.7:0/2570735803 shutdown_connections 2024-04-25T10:02:34.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.287+0000 7f4bf57ce640 1 -- 172.21.15.7:0/2570735803 wait complete. 2024-04-25T10:02:34.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.289+0000 7f4bf57ce640 1 Processor -- start 2024-04-25T10:02:34.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.289+0000 7f4bf57ce640 1 -- start start 2024-04-25T10:02:34.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.289+0000 7f4bf57ce640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bf006bce0 0x7f4bf01f3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:34.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.289+0000 7f4bf57ce640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4bf006c250 0x7f4bf00ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:34.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.289+0000 7f4bf57ce640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bf00d0360 0x7f4bf00cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:34.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.289+0000 7f4bf57ce640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf015f000 con 0x7f4bf00d0360 2024-04-25T10:02:34.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.289+0000 7f4bf57ce640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf00d0c60 con 0x7f4bf006bce0 2024-04-25T10:02:34.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.289+0000 7f4bf57ce640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf015f180 con 0x7f4bf006c250 2024-04-25T10:02:34.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.290+0000 7f4bef7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bf00d0360 0x7f4bf00cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:34.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.290+0000 7f4bef7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bf00d0360 0x7f4bf00cac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48444/0 (socket says 172.21.15.7:48444) 2024-04-25T10:02:34.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.290+0000 7f4bef7fe640 1 -- 172.21.15.7:0/269826934 learned_addr learned my addr 172.21.15.7:0/269826934 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:34.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.290+0000 7f4beeffd640 1 --2- 172.21.15.7:0/269826934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bf006bce0 0x7f4bf01f3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:34.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.290+0000 7f4bee7fc640 1 --2- 172.21.15.7:0/269826934 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4bf006c250 0x7f4bf00ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:34.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.290+0000 7f4bef7fe640 1 -- 172.21.15.7:0/269826934 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4bf006c250 msgr2=0x7f4bf00ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:34.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.290+0000 7f4bef7fe640 1 --2- 172.21.15.7:0/269826934 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4bf006c250 0x7f4bf00ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:34.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.290+0000 7f4bef7fe640 1 -- 172.21.15.7:0/269826934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bf006bce0 msgr2=0x7f4bf01f3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:34.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.290+0000 7f4bef7fe640 1 --2- 172.21.15.7:0/269826934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bf006bce0 0x7f4bf01f3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:34.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.290+0000 7f4bef7fe640 1 -- 172.21.15.7:0/269826934 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf01f8920 con 0x7f4bf00d0360 2024-04-25T10:02:34.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.290+0000 7f4bef7fe640 1 --2- 172.21.15.7:0/269826934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bf00d0360 0x7f4bf00cac00 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f4be0009e50 tx=0x7f4be0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:34.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.290+0000 7f4bd77fe640 1 -- 172.21.15.7:0/269826934 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be0036050 con 0x7f4bf00d0360 2024-04-25T10:02:34.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.290+0000 7f4bd77fe640 1 -- 172.21.15.7:0/269826934 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be0042070 con 0x7f4bf00d0360 2024-04-25T10:02:34.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.290+0000 7f4bf57ce640 1 -- 172.21.15.7:0/269826934 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf00c7dd0 con 0x7f4bf00d0360 2024-04-25T10:02:34.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.290+0000 7f4bd77fe640 1 -- 172.21.15.7:0/269826934 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be0007bf0 con 0x7f4bf00d0360 2024-04-25T10:02:34.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.290+0000 7f4bf57ce640 1 -- 172.21.15.7:0/269826934 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf00c8070 con 0x7f4bf00d0360 2024-04-25T10:02:34.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.291+0000 7f4bf57ce640 1 -- 172.21.15.7:0/269826934 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf00c82b0 con 0x7f4bf00d0360 2024-04-25T10:02:34.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.292+0000 7f4bd77fe640 1 -- 172.21.15.7:0/269826934 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4be0047460 con 0x7f4bf00d0360 2024-04-25T10:02:34.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.292+0000 7f4bd77fe640 1 --2- 172.21.15.7:0/269826934 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4bdc06b4d0 0x7f4bdc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:34.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.292+0000 7f4bd77fe640 1 -- 172.21.15.7:0/269826934 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f4be00ab170 con 0x7f4bf00d0360 2024-04-25T10:02:34.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.292+0000 7f4beeffd640 1 --2- 172.21.15.7:0/269826934 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4bdc06b4d0 0x7f4bdc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:34.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.293+0000 7f4beeffd640 1 --2- 172.21.15.7:0/269826934 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4bdc06b4d0 0x7f4bdc06d990 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4be8009560 tx=0x7f4be8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:34.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.296+0000 7f4bd77fe640 1 -- 172.21.15.7:0/269826934 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4bf00c82b0 con 0x7f4bf00d0360 2024-04-25T10:02:34.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.491+0000 7f4bf57ce640 1 -- 172.21.15.7:0/269826934 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4bf0068fd0 con 0x7f4bf00d0360 2024-04-25T10:02:34.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.491+0000 7f4bd77fe640 1 -- 172.21.15.7:0/269826934 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v92) v1 ==== 80+0+240 (secure 0 0 0) 0x7f4be0079780 con 0x7f4bf00d0360 2024-04-25T10:02:34.496 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/3829085443 2024-04-26T10:01:54.932349+0000 2024-04-25T10:02:34.496 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3829085443 2024-04-26T10:01:54.932349+0000 2024-04-25T10:02:34.496 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/2878753733 2024-04-26T10:00:43.379350+0000 2024-04-25T10:02:34.496 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/2878753733 2024-04-26T10:00:43.379350+0000 2024-04-25T10:02:34.497 INFO:teuthology.orchestra.run.smithi007.stderr:listed 4 entries 2024-04-25T10:02:34.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.493+0000 7f4bf57ce640 1 -- 172.21.15.7:0/269826934 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4bdc06b4d0 msgr2=0x7f4bdc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:34.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.493+0000 7f4bf57ce640 1 --2- 172.21.15.7:0/269826934 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4bdc06b4d0 0x7f4bdc06d990 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4be8009560 tx=0x7f4be8009190 comp rx=0 tx=0).stop 2024-04-25T10:02:34.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.493+0000 7f4bf57ce640 1 -- 172.21.15.7:0/269826934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bf00d0360 msgr2=0x7f4bf00cac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:34.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.493+0000 7f4bf57ce640 1 --2- 172.21.15.7:0/269826934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bf00d0360 0x7f4bf00cac00 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f4be0009e50 tx=0x7f4be0004a40 comp rx=0 tx=0).stop 2024-04-25T10:02:34.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.493+0000 7f4bf57ce640 1 -- 172.21.15.7:0/269826934 shutdown_connections 2024-04-25T10:02:34.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.493+0000 7f4bf57ce640 1 --2- 172.21.15.7:0/269826934 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4bdc06b4d0 0x7f4bdc06d990 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:34.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.493+0000 7f4bf57ce640 1 --2- 172.21.15.7:0/269826934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bf00d0360 0x7f4bf00cac00 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:34.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.493+0000 7f4bf57ce640 1 --2- 172.21.15.7:0/269826934 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4bf006c250 0x7f4bf00ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:34.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.493+0000 7f4bf57ce640 1 --2- 172.21.15.7:0/269826934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bf006bce0 0x7f4bf01f3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:34.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.493+0000 7f4bf57ce640 1 -- 172.21.15.7:0/269826934 >> 172.21.15.7:0/269826934 conn(0x7f4bf00d16e0 msgr2=0x7f4bf00cbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:34.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.493+0000 7f4bf57ce640 1 -- 172.21.15.7:0/269826934 shutdown_connections 2024-04-25T10:02:34.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.493+0000 7f4bf57ce640 1 -- 172.21.15.7:0/269826934 wait complete. 2024-04-25T10:02:34.509 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T10:02:34.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:02:34.509 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T10:02:34.536 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-04-25T10:02:34.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:02:34.536 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T10:02:34.592 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T10:02:34.592 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:02:34.613 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19023 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:02:34.613 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:02:34.613 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:02:34.649 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13704 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:02:34.649 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T10:02:34.649 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:02:34.672 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19023 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:02:34.672 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:02:34.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.787+0000 7f57cbf89640 1 Processor -- start 2024-04-25T10:02:34.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.787+0000 7f57cbf89640 1 -- start start 2024-04-25T10:02:34.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.788+0000 7f57cbf89640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f57c40d0aa0 0x7f57c4161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:34.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.788+0000 7f57cbf89640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f57c41622b0 0x7f57c40ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:34.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.788+0000 7f57cbf89640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c415e8a0 con 0x7f57c415da60 2024-04-25T10:02:34.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.788+0000 7f57cbf89640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c415eb80 con 0x7f57c41622b0 2024-04-25T10:02:34.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.788+0000 7f57cbf89640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c415ee60 con 0x7f57c40d0aa0 2024-04-25T10:02:34.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.788+0000 7f57ca526640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f57c41622b0 0x7f57c40ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:34.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.788+0000 7f57ca526640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f57c41622b0 0x7f57c40ce520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48448/0 (socket says 172.21.15.7:48448) 2024-04-25T10:02:34.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.788+0000 7f57ca526640 1 -- 172.21.15.7:0/1535254800 learned_addr learned my addr 172.21.15.7:0/1535254800 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:34.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.788+0000 7f57c9524640 1 --2- 172.21.15.7:0/1535254800 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f57c40d0aa0 0x7f57c4161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:34.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.788+0000 7f57ca526640 1 -- 172.21.15.7:0/1535254800 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f57c40d0aa0 msgr2=0x7f57c4161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:34.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.788+0000 7f57ca526640 1 --2- 172.21.15.7:0/1535254800 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f57c40d0aa0 0x7f57c4161d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:34.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.788+0000 7f57ca526640 1 -- 172.21.15.7:0/1535254800 >> v1:172.21.15.55:6789/0 conn(0x7f57c415da60 legacy=0x7f57c415de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:34.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.788+0000 7f57ca526640 1 -- 172.21.15.7:0/1535254800 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c4161850 con 0x7f57c41622b0 2024-04-25T10:02:34.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.789+0000 7f57ca526640 1 --2- 172.21.15.7:0/1535254800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57c41622b0 0x7f57c40ce520 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f57bc009e50 tx=0x7f57bc02a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4629557a6eb1b37a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:34.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.789+0000 7f57c8d23640 1 -- 172.21.15.7:0/1535254800 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc036070 con 0x7f57c41622b0 2024-04-25T10:02:34.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.789+0000 7f57c8d23640 1 -- 172.21.15.7:0/1535254800 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57bc031600 con 0x7f57c41622b0 2024-04-25T10:02:34.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.789+0000 7f57c8d23640 1 -- 172.21.15.7:0/1535254800 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc0319d0 con 0x7f57c41622b0 2024-04-25T10:02:34.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.790+0000 7f57cbf89640 1 -- 172.21.15.7:0/1535254800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57c41622b0 msgr2=0x7f57c40ce520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:34.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.790+0000 7f57cbf89640 1 --2- 172.21.15.7:0/1535254800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57c41622b0 0x7f57c40ce520 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f57bc009e50 tx=0x7f57bc02a630 comp rx=0 tx=0).stop 2024-04-25T10:02:34.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.790+0000 7f57cbf89640 1 -- 172.21.15.7:0/1535254800 shutdown_connections 2024-04-25T10:02:34.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.790+0000 7f57cbf89640 1 --2- 172.21.15.7:0/1535254800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57c41622b0 0x7f57c40ce520 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:34.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.790+0000 7f57cbf89640 1 --2- 172.21.15.7:0/1535254800 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f57c40d0aa0 0x7f57c4161d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:34.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.790+0000 7f57cbf89640 1 -- 172.21.15.7:0/1535254800 >> 172.21.15.7:0/1535254800 conn(0x7f57c406bfe0 msgr2=0x7f57c406c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:34.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.790+0000 7f57cbf89640 1 -- 172.21.15.7:0/1535254800 shutdown_connections 2024-04-25T10:02:34.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.790+0000 7f57cbf89640 1 -- 172.21.15.7:0/1535254800 wait complete. 2024-04-25T10:02:34.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.791+0000 7f57cbf89640 1 Processor -- start 2024-04-25T10:02:34.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.791+0000 7f57cbf89640 1 -- start start 2024-04-25T10:02:34.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.792+0000 7f57cbf89640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57c40d0aa0 0x7f57c415f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:34.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.792+0000 7f57cbf89640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57c415da60 0x7f57c414e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:34.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.792+0000 7f57cbf89640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f57c41622b0 0x7f57c414ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:34.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.792+0000 7f57cbf89640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c40cebe0 con 0x7f57c40d0aa0 2024-04-25T10:02:34.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.792+0000 7f57cbf89640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c40cea60 con 0x7f57c415da60 2024-04-25T10:02:34.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.792+0000 7f57cbf89640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c40ced60 con 0x7f57c41622b0 2024-04-25T10:02:34.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.792+0000 7f57c9d25640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57c40d0aa0 0x7f57c415f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:34.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.792+0000 7f57c9d25640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57c40d0aa0 0x7f57c415f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48456/0 (socket says 172.21.15.7:48456) 2024-04-25T10:02:34.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.792+0000 7f57c9d25640 1 -- 172.21.15.7:0/535621254 learned_addr learned my addr 172.21.15.7:0/535621254 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:34.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.792+0000 7f57ca526640 1 --2- 172.21.15.7:0/535621254 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f57c41622b0 0x7f57c414ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:34.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.792+0000 7f57c9524640 1 --2- 172.21.15.7:0/535621254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57c415da60 0x7f57c414e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:34.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.792+0000 7f57c9d25640 1 -- 172.21.15.7:0/535621254 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f57c41622b0 msgr2=0x7f57c414ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:34.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.792+0000 7f57c9d25640 1 --2- 172.21.15.7:0/535621254 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f57c41622b0 0x7f57c414ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:34.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.792+0000 7f57c9d25640 1 -- 172.21.15.7:0/535621254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57c415da60 msgr2=0x7f57c414e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:34.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.792+0000 7f57c9d25640 1 --2- 172.21.15.7:0/535621254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57c415da60 0x7f57c414e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:34.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.792+0000 7f57c9d25640 1 -- 172.21.15.7:0/535621254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c40ca9c0 con 0x7f57c40d0aa0 2024-04-25T10:02:34.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.793+0000 7f57c9d25640 1 --2- 172.21.15.7:0/535621254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57c40d0aa0 0x7f57c415f440 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f57c000b3f0 tx=0x7f57c000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:34.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.793+0000 7f57ba7fc640 1 -- 172.21.15.7:0/535621254 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c0015020 con 0x7f57c40d0aa0 2024-04-25T10:02:34.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.793+0000 7f57ba7fc640 1 -- 172.21.15.7:0/535621254 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c0011830 con 0x7f57c40d0aa0 2024-04-25T10:02:34.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.793+0000 7f57cbf89640 1 -- 172.21.15.7:0/535621254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c40caca0 con 0x7f57c40d0aa0 2024-04-25T10:02:34.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.793+0000 7f57ba7fc640 1 -- 172.21.15.7:0/535621254 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c0011c20 con 0x7f57c40d0aa0 2024-04-25T10:02:34.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.793+0000 7f57cbf89640 1 -- 172.21.15.7:0/535621254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c40cb260 con 0x7f57c40d0aa0 2024-04-25T10:02:34.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.794+0000 7f57cbf89640 1 -- 172.21.15.7:0/535621254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c40cffe0 con 0x7f57c40d0aa0 2024-04-25T10:02:34.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.794+0000 7f57ba7fc640 1 -- 172.21.15.7:0/535621254 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f57c0018020 con 0x7f57c40d0aa0 2024-04-25T10:02:34.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.795+0000 7f57ba7fc640 1 --2- 172.21.15.7:0/535621254 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f57a806b4d0 0x7f57a806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:34.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.795+0000 7f57ba7fc640 1 -- 172.21.15.7:0/535621254 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f57c008a4c0 con 0x7f57c40d0aa0 2024-04-25T10:02:34.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.795+0000 7f57c9524640 1 --2- 172.21.15.7:0/535621254 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f57a806b4d0 0x7f57a806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:34.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.795+0000 7f57c9524640 1 --2- 172.21.15.7:0/535621254 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f57a806b4d0 0x7f57a806d990 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f57c40d3710 tx=0x7f57b4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:34.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:34.799+0000 7f57ba7fc640 1 -- 172.21.15.7:0/535621254 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f57c40cffe0 con 0x7f57c40d0aa0 2024-04-25T10:02:35.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.018+0000 7f57cbf89640 1 -- 172.21.15.7:0/535621254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57c4068fd0 con 0x7f57c40d0aa0 2024-04-25T10:02:35.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.018+0000 7f57ba7fc640 1 -- 172.21.15.7:0/535621254 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f57c001f020 con 0x7f57c40d0aa0 2024-04-25T10:02:35.024 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:02:35.024 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":66,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2505539422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2505539422},{"type":"v1","addr":"172.21.15.55:6834","nonce":2505539422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2808857776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2808857776},{"type":"v1","addr":"172.21.15.55:6835","nonce":2808857776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7518,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1796103144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1796103144},{"type":"v1","addr":"172.21.15.7:6835","nonce":1796103144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:00:34.054759+0000","modified":"2024-04-25T10:01:57.949246+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8022},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8022":{"gid":8022,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6837/1061077733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1061077733},{"type":"v1","addr":"172.21.15.7:6837","nonce":1061077733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:02:35.024 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 66 2024-04-25T10:02:35.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.020+0000 7f57cbf89640 1 -- 172.21.15.7:0/535621254 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f57a806b4d0 msgr2=0x7f57a806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:35.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.020+0000 7f57cbf89640 1 --2- 172.21.15.7:0/535621254 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f57a806b4d0 0x7f57a806d990 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f57c40d3710 tx=0x7f57b4008040 comp rx=0 tx=0).stop 2024-04-25T10:02:35.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.020+0000 7f57cbf89640 1 -- 172.21.15.7:0/535621254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57c40d0aa0 msgr2=0x7f57c415f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:35.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.020+0000 7f57cbf89640 1 --2- 172.21.15.7:0/535621254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57c40d0aa0 0x7f57c415f440 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f57c000b3f0 tx=0x7f57c000b8b0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.020+0000 7f57cbf89640 1 -- 172.21.15.7:0/535621254 shutdown_connections 2024-04-25T10:02:35.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.020+0000 7f57cbf89640 1 --2- 172.21.15.7:0/535621254 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f57a806b4d0 0x7f57a806d990 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.020+0000 7f57cbf89640 1 --2- 172.21.15.7:0/535621254 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f57c41622b0 0x7f57c414ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.020+0000 7f57cbf89640 1 --2- 172.21.15.7:0/535621254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57c415da60 0x7f57c414e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.020+0000 7f57cbf89640 1 --2- 172.21.15.7:0/535621254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f57c40d0aa0 0x7f57c415f440 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.020+0000 7f57cbf89640 1 -- 172.21.15.7:0/535621254 >> 172.21.15.7:0/535621254 conn(0x7f57c406bfe0 msgr2=0x7f57c406c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:35.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.021+0000 7f57cbf89640 1 -- 172.21.15.7:0/535621254 shutdown_connections 2024-04-25T10:02:35.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.021+0000 7f57cbf89640 1 -- 172.21.15.7:0/535621254 wait complete. 2024-04-25T10:02:35.036 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:02:35.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.132+0000 7f6c1657e640 1 Processor -- start 2024-04-25T10:02:35.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.132+0000 7f6c1657e640 1 -- start start 2024-04-25T10:02:35.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.133+0000 7f6c1657e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6c1015ee90 0x7f6c100ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:35.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.133+0000 7f6c1657e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6c1015ced0 0x7f6c100ce890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:35.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.133+0000 7f6c1657e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c1006d1f0 con 0x7f6c100c5a10 2024-04-25T10:02:35.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.133+0000 7f6c1657e640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1006d4d0 con 0x7f6c1015ced0 2024-04-25T10:02:35.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.133+0000 7f6c1657e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1006d7b0 con 0x7f6c1015ee90 2024-04-25T10:02:35.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.133+0000 7f6c0f7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6c1015ced0 0x7f6c100ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:35.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.133+0000 7f6c0f7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6c1015ced0 0x7f6c100ce890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48460/0 (socket says 172.21.15.7:48460) 2024-04-25T10:02:35.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.133+0000 7f6c0f7fe640 1 -- 172.21.15.7:0/2312201757 learned_addr learned my addr 172.21.15.7:0/2312201757 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:35.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.133+0000 7f6c0ffff640 1 --2- 172.21.15.7:0/2312201757 >> v2:172.21.15.55:3300/0 conn(0x7f6c1015ee90 0x7f6c100ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:35.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.133+0000 7f6c0f7fe640 1 -- 172.21.15.7:0/2312201757 >> v2:172.21.15.55:3300/0 conn(0x7f6c1015ee90 msgr2=0x7f6c100ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:35.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.133+0000 7f6c0f7fe640 1 --2- 172.21.15.7:0/2312201757 >> v2:172.21.15.55:3300/0 conn(0x7f6c1015ee90 0x7f6c100ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.133+0000 7f6c0f7fe640 1 -- 172.21.15.7:0/2312201757 >> v1:172.21.15.55:6789/0 conn(0x7f6c100c5a10 legacy=0x7f6c100c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:35.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.133+0000 7f6c0f7fe640 1 -- 172.21.15.7:0/2312201757 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1006da90 con 0x7f6c1015ced0 2024-04-25T10:02:35.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.134+0000 7f6c0f7fe640 1 --2- 172.21.15.7:0/2312201757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c1015ced0 0x7f6c100ce890 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f6c100b58b0 tx=0x7f6c0002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91b3f8d53694700 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:35.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.134+0000 7f6c0effd640 1 -- 172.21.15.7:0/2312201757 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c00037070 con 0x7f6c1015ced0 2024-04-25T10:02:35.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.134+0000 7f6c0effd640 1 -- 172.21.15.7:0/2312201757 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c00032440 con 0x7f6c1015ced0 2024-04-25T10:02:35.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.134+0000 7f6c0effd640 1 -- 172.21.15.7:0/2312201757 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c00032810 con 0x7f6c1015ced0 2024-04-25T10:02:35.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.135+0000 7f6c1657e640 1 -- 172.21.15.7:0/2312201757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c1015ced0 msgr2=0x7f6c100ce890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:35.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.135+0000 7f6c1657e640 1 --2- 172.21.15.7:0/2312201757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c1015ced0 0x7f6c100ce890 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f6c100b58b0 tx=0x7f6c0002a1e0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.135+0000 7f6c1657e640 1 -- 172.21.15.7:0/2312201757 shutdown_connections 2024-04-25T10:02:35.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.135+0000 7f6c1657e640 1 --2- 172.21.15.7:0/2312201757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c1015ced0 0x7f6c100ce890 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.135+0000 7f6c1657e640 1 --2- 172.21.15.7:0/2312201757 >> v2:172.21.15.55:3300/0 conn(0x7f6c1015ee90 0x7f6c100ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.135+0000 7f6c1657e640 1 -- 172.21.15.7:0/2312201757 >> 172.21.15.7:0/2312201757 conn(0x7f6c10071150 msgr2=0x7f6c10071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:35.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.135+0000 7f6c1657e640 1 -- 172.21.15.7:0/2312201757 shutdown_connections 2024-04-25T10:02:35.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.135+0000 7f6c1657e640 1 -- 172.21.15.7:0/2312201757 wait complete. 2024-04-25T10:02:35.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.136+0000 7f6c1657e640 1 Processor -- start 2024-04-25T10:02:35.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.136+0000 7f6c1657e640 1 -- start start 2024-04-25T10:02:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.137+0000 7f6c1657e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c100c5a10 0x7f6c10141ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.137+0000 7f6c1657e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6c1015ced0 0x7f6c10142400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.137+0000 7f6c1657e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c1015ee90 0x7f6c1015a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.137+0000 7f6c1657e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1015c000 con 0x7f6c1015ee90 2024-04-25T10:02:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.137+0000 7f6c1657e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1015be80 con 0x7f6c100c5a10 2024-04-25T10:02:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.137+0000 7f6c1657e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1015c180 con 0x7f6c1015ced0 2024-04-25T10:02:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.137+0000 7f6c14b1b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c1015ee90 0x7f6c1015a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.137+0000 7f6c14b1b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c1015ee90 0x7f6c1015a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48474/0 (socket says 172.21.15.7:48474) 2024-04-25T10:02:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.137+0000 7f6c14b1b640 1 -- 172.21.15.7:0/571764050 learned_addr learned my addr 172.21.15.7:0/571764050 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.137+0000 7f6c0ffff640 1 --2- 172.21.15.7:0/571764050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c100c5a10 0x7f6c10141ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.137+0000 7f6c0f7fe640 1 --2- 172.21.15.7:0/571764050 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6c1015ced0 0x7f6c10142400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.137+0000 7f6c14b1b640 1 -- 172.21.15.7:0/571764050 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6c1015ced0 msgr2=0x7f6c10142400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.137+0000 7f6c14b1b640 1 --2- 172.21.15.7:0/571764050 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6c1015ced0 0x7f6c10142400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.137+0000 7f6c14b1b640 1 -- 172.21.15.7:0/571764050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c100c5a10 msgr2=0x7f6c10141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.137+0000 7f6c14b1b640 1 --2- 172.21.15.7:0/571764050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c100c5a10 0x7f6c10141ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.137+0000 7f6c14b1b640 1 -- 172.21.15.7:0/571764050 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c10142a50 con 0x7f6c1015ee90 2024-04-25T10:02:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.137+0000 7f6c14b1b640 1 --2- 172.21.15.7:0/571764050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c1015ee90 0x7f6c1015a290 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800c7a0 tx=0x7f6c0800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.138+0000 7f6c0cff9640 1 -- 172.21.15.7:0/571764050 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c08003b70 con 0x7f6c1015ee90 2024-04-25T10:02:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.138+0000 7f6c0cff9640 1 -- 172.21.15.7:0/571764050 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c08003d30 con 0x7f6c1015ee90 2024-04-25T10:02:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.138+0000 7f6c1657e640 1 -- 172.21.15.7:0/571764050 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c10142d30 con 0x7f6c1015ee90 2024-04-25T10:02:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.138+0000 7f6c0cff9640 1 -- 172.21.15.7:0/571764050 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0800aa90 con 0x7f6c1015ee90 2024-04-25T10:02:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.138+0000 7f6c1657e640 1 -- 172.21.15.7:0/571764050 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c101432f0 con 0x7f6c1015ee90 2024-04-25T10:02:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.139+0000 7f6c1657e640 1 -- 172.21.15.7:0/571764050 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c100c4d70 con 0x7f6c1015ee90 2024-04-25T10:02:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.139+0000 7f6c0cff9640 1 -- 172.21.15.7:0/571764050 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6c0800ac30 con 0x7f6c1015ee90 2024-04-25T10:02:35.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.140+0000 7f6c0cff9640 1 --2- 172.21.15.7:0/571764050 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6bf006b4d0 0x7f6bf006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:35.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.140+0000 7f6c0ffff640 1 --2- 172.21.15.7:0/571764050 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6bf006b4d0 0x7f6bf006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:35.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.140+0000 7f6c0cff9640 1 -- 172.21.15.7:0/571764050 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f6c0808a4d0 con 0x7f6c1015ee90 2024-04-25T10:02:35.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.140+0000 7f6c0ffff640 1 --2- 172.21.15.7:0/571764050 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6bf006b4d0 0x7f6bf006d990 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8009a30 tx=0x7f6bf8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:35.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.144+0000 7f6c0cff9640 1 -- 172.21.15.7:0/571764050 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6c100c4d70 con 0x7f6c1015ee90 2024-04-25T10:02:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.325+0000 7f6c1657e640 1 -- 172.21.15.7:0/571764050 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c10068fd0 con 0x7f6c1015ee90 2024-04-25T10:02:35.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.326+0000 7f6c0cff9640 1 -- 172.21.15.7:0/571764050 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+17238 (secure 0 0 0) 0x7f6c08059000 con 0x7f6c1015ee90 2024-04-25T10:02:35.331 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:02:35.331 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":92,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:01:54.932383+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:00:32.330930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T10:00:33.030728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1b","mappings":[{"from":1,"to":7}]},{"pgid":"14.2c","mappings":[{"from":1,"to":5}]},{"pgid":"14.31","mappings":[{"from":1,"to":7}]},{"pgid":"14.32","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6837/3829085443":"2024-04-26T10:01:54.932349+0000","172.21.15.7:6836/3829085443":"2024-04-26T10:01:54.932349+0000","172.21.15.7:6837/2878753733":"2024-04-26T10:00:43.379350+0000","172.21.15.7:6836/2878753733":"2024-04-26T10:00:43.379350+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:02:35.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.328+0000 7f6c1657e640 1 -- 172.21.15.7:0/571764050 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6bf006b4d0 msgr2=0x7f6bf006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:35.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.328+0000 7f6c1657e640 1 --2- 172.21.15.7:0/571764050 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6bf006b4d0 0x7f6bf006d990 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8009a30 tx=0x7f6bf8008040 comp rx=0 tx=0).stop 2024-04-25T10:02:35.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.328+0000 7f6c1657e640 1 -- 172.21.15.7:0/571764050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c1015ee90 msgr2=0x7f6c1015a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:35.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.328+0000 7f6c1657e640 1 --2- 172.21.15.7:0/571764050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c1015ee90 0x7f6c1015a290 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800c7a0 tx=0x7f6c0800cc60 comp rx=0 tx=0).stop 2024-04-25T10:02:35.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.328+0000 7f6c1657e640 1 -- 172.21.15.7:0/571764050 shutdown_connections 2024-04-25T10:02:35.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.328+0000 7f6c1657e640 1 --2- 172.21.15.7:0/571764050 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6bf006b4d0 0x7f6bf006d990 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.328+0000 7f6c1657e640 1 --2- 172.21.15.7:0/571764050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c1015ee90 0x7f6c1015a290 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.328+0000 7f6c1657e640 1 --2- 172.21.15.7:0/571764050 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6c1015ced0 0x7f6c10142400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.328+0000 7f6c1657e640 1 --2- 172.21.15.7:0/571764050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c100c5a10 0x7f6c10141ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.328+0000 7f6c1657e640 1 -- 172.21.15.7:0/571764050 >> 172.21.15.7:0/571764050 conn(0x7f6c10071150 msgr2=0x7f6c100c4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:35.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.328+0000 7f6c1657e640 1 -- 172.21.15.7:0/571764050 shutdown_connections 2024-04-25T10:02:35.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.328+0000 7f6c1657e640 1 -- 172.21.15.7:0/571764050 wait complete. 2024-04-25T10:02:35.344 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:00:32.330930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:00:33.030728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:02:35.344 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:02:35.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.443+0000 7f0a94607640 1 Processor -- start 2024-04-25T10:02:35.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.443+0000 7f0a94607640 1 -- start start 2024-04-25T10:02:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.444+0000 7f0a94607640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0a8c0d3760 0x7f0a8c15eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.444+0000 7f0a94607640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0a8c15f1c0 0x7f0a8c0d3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.444+0000 7f0a94607640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a8c0ce830 0x7f0a8c0b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.444+0000 7f0a94607640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a8c0ce380 con 0x7f0a8c0d3760 2024-04-25T10:02:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.444+0000 7f0a94607640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a8c15f000 con 0x7f0a8c15f1c0 2024-04-25T10:02:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.444+0000 7f0a94607640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c0d2190 con 0x7f0a8c0ce830 2024-04-25T10:02:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.444+0000 7f0a923a3640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0a8c0d3760 0x7f0a8c15eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.444+0000 7f0a923a3640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0a8c0d3760 0x7f0a8c15eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48480/0 (socket says 172.21.15.7:48480) 2024-04-25T10:02:35.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.444+0000 7f0a923a3640 1 -- 172.21.15.7:0/3839975946 learned_addr learned my addr 172.21.15.7:0/3839975946 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:35.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.444+0000 7f0a91ba2640 1 --2- 172.21.15.7:0/3839975946 >> v2:172.21.15.55:3300/0 conn(0x7f0a8c15f1c0 0x7f0a8c0d3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:35.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.444+0000 7f0a92ba4640 1 --2- 172.21.15.7:0/3839975946 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a8c0ce830 0x7f0a8c0b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:35.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.444+0000 7f0a923a3640 1 -- 172.21.15.7:0/3839975946 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a8c0ce830 msgr2=0x7f0a8c0b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:35.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.444+0000 7f0a923a3640 1 --2- 172.21.15.7:0/3839975946 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a8c0ce830 0x7f0a8c0b2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.444+0000 7f0a923a3640 1 -- 172.21.15.7:0/3839975946 >> v2:172.21.15.55:3300/0 conn(0x7f0a8c15f1c0 msgr2=0x7f0a8c0d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:35.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.444+0000 7f0a923a3640 1 --2- 172.21.15.7:0/3839975946 >> v2:172.21.15.55:3300/0 conn(0x7f0a8c15f1c0 0x7f0a8c0d3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.444+0000 7f0a923a3640 1 -- 172.21.15.7:0/3839975946 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8c0d4080 con 0x7f0a8c0d3760 2024-04-25T10:02:35.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.445+0000 7f0a923a3640 1 --2- 172.21.15.7:0/3839975946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a8c0d3760 0x7f0a8c15eac0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c0b9830 tx=0x7f0a8802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c028481e288f8844 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:35.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.445+0000 7f0a913a1640 1 -- 172.21.15.7:0/3839975946 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a88037070 con 0x7f0a8c0d3760 2024-04-25T10:02:35.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.445+0000 7f0a913a1640 1 -- 172.21.15.7:0/3839975946 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a88032440 con 0x7f0a8c0d3760 2024-04-25T10:02:35.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.445+0000 7f0a913a1640 1 -- 172.21.15.7:0/3839975946 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a88032810 con 0x7f0a8c0d3760 2024-04-25T10:02:35.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.446+0000 7f0a94607640 1 -- 172.21.15.7:0/3839975946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a8c0d3760 msgr2=0x7f0a8c15eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:35.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.446+0000 7f0a94607640 1 --2- 172.21.15.7:0/3839975946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a8c0d3760 0x7f0a8c15eac0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c0b9830 tx=0x7f0a8802a1e0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.446+0000 7f0a94607640 1 -- 172.21.15.7:0/3839975946 shutdown_connections 2024-04-25T10:02:35.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.446+0000 7f0a94607640 1 --2- 172.21.15.7:0/3839975946 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a8c0ce830 0x7f0a8c0b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.446+0000 7f0a94607640 1 --2- 172.21.15.7:0/3839975946 >> v2:172.21.15.55:3300/0 conn(0x7f0a8c15f1c0 0x7f0a8c0d3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.446+0000 7f0a94607640 1 --2- 172.21.15.7:0/3839975946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a8c0d3760 0x7f0a8c15eac0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.446+0000 7f0a94607640 1 -- 172.21.15.7:0/3839975946 >> 172.21.15.7:0/3839975946 conn(0x7f0a8c072680 msgr2=0x7f0a8c072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:35.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.446+0000 7f0a94607640 1 -- 172.21.15.7:0/3839975946 shutdown_connections 2024-04-25T10:02:35.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.446+0000 7f0a94607640 1 -- 172.21.15.7:0/3839975946 wait complete. 2024-04-25T10:02:35.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.447+0000 7f0a94607640 1 Processor -- start 2024-04-25T10:02:35.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.447+0000 7f0a94607640 1 -- start start 2024-04-25T10:02:35.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.448+0000 7f0a94607640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a8c0ce830 0x7f0a8c0c7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:35.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.448+0000 7f0a94607640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a8c0d3760 0x7f0a8c0cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:35.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.448+0000 7f0a94607640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a8c15f1c0 0x7f0a8c1e71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:35.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.448+0000 7f0a94607640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c0d1e20 con 0x7f0a8c0d3760 2024-04-25T10:02:35.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.448+0000 7f0a94607640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c0d1b40 con 0x7f0a8c15f1c0 2024-04-25T10:02:35.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.448+0000 7f0a94607640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c15de10 con 0x7f0a8c0ce830 2024-04-25T10:02:35.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.448+0000 7f0a91ba2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a8c0d3760 0x7f0a8c0cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:35.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.448+0000 7f0a91ba2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a8c0d3760 0x7f0a8c0cdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48484/0 (socket says 172.21.15.7:48484) 2024-04-25T10:02:35.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.448+0000 7f0a91ba2640 1 -- 172.21.15.7:0/1048170744 learned_addr learned my addr 172.21.15.7:0/1048170744 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:35.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.448+0000 7f0a923a3640 1 --2- 172.21.15.7:0/1048170744 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a8c0ce830 0x7f0a8c0c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:35.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.448+0000 7f0a92ba4640 1 --2- 172.21.15.7:0/1048170744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a8c15f1c0 0x7f0a8c1e71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:35.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.448+0000 7f0a91ba2640 1 -- 172.21.15.7:0/1048170744 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a8c0ce830 msgr2=0x7f0a8c0c7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:35.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.448+0000 7f0a91ba2640 1 --2- 172.21.15.7:0/1048170744 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a8c0ce830 0x7f0a8c0c7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.448+0000 7f0a91ba2640 1 -- 172.21.15.7:0/1048170744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a8c15f1c0 msgr2=0x7f0a8c1e71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:35.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.448+0000 7f0a91ba2640 1 --2- 172.21.15.7:0/1048170744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a8c15f1c0 0x7f0a8c1e71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.448+0000 7f0a91ba2640 1 -- 172.21.15.7:0/1048170744 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8c15ce50 con 0x7f0a8c0d3760 2024-04-25T10:02:35.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.448+0000 7f0a92ba4640 1 --2- 172.21.15.7:0/1048170744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a8c15f1c0 0x7f0a8c1e71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:02:35.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.448+0000 7f0a91ba2640 1 --2- 172.21.15.7:0/1048170744 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a8c0d3760 0x7f0a8c0cdb40 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c00c7c0 tx=0x7f0a7c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:35.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.448+0000 7f0a82ffd640 1 -- 172.21.15.7:0/1048170744 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c015070 con 0x7f0a8c0d3760 2024-04-25T10:02:35.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.448+0000 7f0a82ffd640 1 -- 172.21.15.7:0/1048170744 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7c007820 con 0x7f0a8c0d3760 2024-04-25T10:02:35.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.448+0000 7f0a94607640 1 -- 172.21.15.7:0/1048170744 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a8c1560a0 con 0x7f0a8c0d3760 2024-04-25T10:02:35.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.448+0000 7f0a82ffd640 1 -- 172.21.15.7:0/1048170744 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c007bd0 con 0x7f0a8c0d3760 2024-04-25T10:02:35.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.449+0000 7f0a94607640 1 -- 172.21.15.7:0/1048170744 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a8c15c890 con 0x7f0a8c0d3760 2024-04-25T10:02:35.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.449+0000 7f0a94607640 1 -- 172.21.15.7:0/1048170744 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a8c068f60 con 0x7f0a8c0d3760 2024-04-25T10:02:35.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.450+0000 7f0a82ffd640 1 -- 172.21.15.7:0/1048170744 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0a7c018070 con 0x7f0a8c0d3760 2024-04-25T10:02:35.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.450+0000 7f0a82ffd640 1 --2- 172.21.15.7:0/1048170744 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0a7006b4d0 0x7f0a7006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:35.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.450+0000 7f0a82ffd640 1 -- 172.21.15.7:0/1048170744 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f0a7c089f50 con 0x7f0a8c0d3760 2024-04-25T10:02:35.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.450+0000 7f0a923a3640 1 --2- 172.21.15.7:0/1048170744 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0a7006b4d0 0x7f0a7006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:35.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.451+0000 7f0a923a3640 1 --2- 172.21.15.7:0/1048170744 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0a7006b4d0 0x7f0a7006d990 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0a88034000 tx=0x7f0a8802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:35.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.455+0000 7f0a82ffd640 1 -- 172.21.15.7:0/1048170744 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0a7c0584c0 con 0x7f0a8c0d3760 2024-04-25T10:02:35.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.634+0000 7f0a94607640 1 -- 172.21.15.7:0/1048170744 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0a8c0b8e70 con 0x7f0a8c0d3760 2024-04-25T10:02:35.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.634+0000 7f0a82ffd640 1 -- 172.21.15.7:0/1048170744 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0a7c05c560 con 0x7f0a8c0d3760 2024-04-25T10:02:35.639 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T10:02:35.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.636+0000 7f0a94607640 1 -- 172.21.15.7:0/1048170744 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0a7006b4d0 msgr2=0x7f0a7006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:35.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.636+0000 7f0a94607640 1 --2- 172.21.15.7:0/1048170744 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0a7006b4d0 0x7f0a7006d990 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0a88034000 tx=0x7f0a8802e000 comp rx=0 tx=0).stop 2024-04-25T10:02:35.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.636+0000 7f0a94607640 1 -- 172.21.15.7:0/1048170744 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a8c0d3760 msgr2=0x7f0a8c0cdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:35.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.637+0000 7f0a94607640 1 --2- 172.21.15.7:0/1048170744 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a8c0d3760 0x7f0a8c0cdb40 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c00c7c0 tx=0x7f0a7c00cc80 comp rx=0 tx=0).stop 2024-04-25T10:02:35.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.637+0000 7f0a94607640 1 -- 172.21.15.7:0/1048170744 shutdown_connections 2024-04-25T10:02:35.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.637+0000 7f0a94607640 1 --2- 172.21.15.7:0/1048170744 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0a7006b4d0 0x7f0a7006d990 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.637+0000 7f0a94607640 1 --2- 172.21.15.7:0/1048170744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a8c15f1c0 0x7f0a8c1e71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.637+0000 7f0a94607640 1 --2- 172.21.15.7:0/1048170744 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a8c0d3760 0x7f0a8c0cdb40 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.637+0000 7f0a94607640 1 --2- 172.21.15.7:0/1048170744 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a8c0ce830 0x7f0a8c0c7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.637+0000 7f0a94607640 1 -- 172.21.15.7:0/1048170744 >> 172.21.15.7:0/1048170744 conn(0x7f0a8c072680 msgr2=0x7f0a8c0d2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:35.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.637+0000 7f0a94607640 1 -- 172.21.15.7:0/1048170744 shutdown_connections 2024-04-25T10:02:35.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.637+0000 7f0a94607640 1 -- 172.21.15.7:0/1048170744 wait complete. 2024-04-25T10:02:35.652 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:02:35.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.751+0000 7f8510d70640 1 Processor -- start 2024-04-25T10:02:35.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.751+0000 7f8510d70640 1 -- start start 2024-04-25T10:02:35.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.752+0000 7f8510d70640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f850c06e950 0x7f850c0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:35.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.752+0000 7f8510d70640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f850c0ce610 0x7f850c0ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:35.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.752+0000 7f8510d70640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f850c0b2ee0 con 0x7f850c143fb0 2024-04-25T10:02:35.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.752+0000 7f8510d70640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f850c0b3150 con 0x7f850c06e950 2024-04-25T10:02:35.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.752+0000 7f8510d70640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850c0b3430 con 0x7f850c0ce610 2024-04-25T10:02:35.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.752+0000 7f8509d9b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f850c06e950 0x7f850c0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:35.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.752+0000 7f8509d9b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f850c06e950 0x7f850c0b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48486/0 (socket says 172.21.15.7:48486) 2024-04-25T10:02:35.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.752+0000 7f8509d9b640 1 -- 172.21.15.7:0/3516613350 learned_addr learned my addr 172.21.15.7:0/3516613350 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:35.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.752+0000 7f850ad9d640 1 --2- 172.21.15.7:0/3516613350 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f850c0ce610 0x7f850c0ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:35.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.752+0000 7f8509d9b640 1 -- 172.21.15.7:0/3516613350 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f850c0ce610 msgr2=0x7f850c0ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:35.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.752+0000 7f8509d9b640 1 --2- 172.21.15.7:0/3516613350 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f850c0ce610 0x7f850c0ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.752+0000 7f8509d9b640 1 -- 172.21.15.7:0/3516613350 >> v1:172.21.15.55:6789/0 conn(0x7f850c143fb0 legacy=0x7f850c06e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:35.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.752+0000 7f8509d9b640 1 -- 172.21.15.7:0/3516613350 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850c0b3710 con 0x7f850c06e950 2024-04-25T10:02:35.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.753+0000 7f8509d9b640 1 --2- 172.21.15.7:0/3516613350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f850c06e950 0x7f850c0b3c30 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f8500009870 tx=0x7f850002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90eab0adfc427c7d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:35.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.753+0000 7f850959a640 1 -- 172.21.15.7:0/3516613350 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8500037070 con 0x7f850c06e950 2024-04-25T10:02:35.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.753+0000 7f850959a640 1 -- 172.21.15.7:0/3516613350 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8500032440 con 0x7f850c06e950 2024-04-25T10:02:35.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.753+0000 7f850959a640 1 -- 172.21.15.7:0/3516613350 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8500032810 con 0x7f850c06e950 2024-04-25T10:02:35.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.754+0000 7f8510d70640 1 -- 172.21.15.7:0/3516613350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f850c06e950 msgr2=0x7f850c0b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:35.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.754+0000 7f8510d70640 1 --2- 172.21.15.7:0/3516613350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f850c06e950 0x7f850c0b3c30 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f8500009870 tx=0x7f850002a270 comp rx=0 tx=0).stop 2024-04-25T10:02:35.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.754+0000 7f8510d70640 1 -- 172.21.15.7:0/3516613350 shutdown_connections 2024-04-25T10:02:35.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.754+0000 7f8510d70640 1 --2- 172.21.15.7:0/3516613350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f850c06e950 0x7f850c0b3c30 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.754+0000 7f8510d70640 1 --2- 172.21.15.7:0/3516613350 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f850c0ce610 0x7f850c0ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.754+0000 7f8510d70640 1 -- 172.21.15.7:0/3516613350 >> 172.21.15.7:0/3516613350 conn(0x7f850c06ab60 msgr2=0x7f850c06af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:35.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.754+0000 7f8510d70640 1 -- 172.21.15.7:0/3516613350 shutdown_connections 2024-04-25T10:02:35.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.754+0000 7f8510d70640 1 -- 172.21.15.7:0/3516613350 wait complete. 2024-04-25T10:02:35.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.755+0000 7f8510d70640 1 Processor -- start 2024-04-25T10:02:35.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.755+0000 7f8510d70640 1 -- start start 2024-04-25T10:02:35.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.756+0000 7f8510d70640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f850c06e950 0x7f850c15a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:35.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.756+0000 7f8510d70640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f850c0ce610 0x7f850c06dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:35.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.756+0000 7f8510d70640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f850c143fb0 0x7f850c1f3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:35.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.756+0000 7f8510d70640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850c0cf2f0 con 0x7f850c0ce610 2024-04-25T10:02:35.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.756+0000 7f8510d70640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850c144390 con 0x7f850c06e950 2024-04-25T10:02:35.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.756+0000 7f8510d70640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850c15ac70 con 0x7f850c143fb0 2024-04-25T10:02:35.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.756+0000 7f8509d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f850c0ce610 0x7f850c06dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:35.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.756+0000 7f8509d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f850c0ce610 0x7f850c06dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48492/0 (socket says 172.21.15.7:48492) 2024-04-25T10:02:35.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.756+0000 7f8509d9b640 1 -- 172.21.15.7:0/848652875 learned_addr learned my addr 172.21.15.7:0/848652875 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:35.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.756+0000 7f850a59c640 1 --2- 172.21.15.7:0/848652875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f850c06e950 0x7f850c15a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:35.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.756+0000 7f850ad9d640 1 --2- 172.21.15.7:0/848652875 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f850c143fb0 0x7f850c1f3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:35.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.757+0000 7f8509d9b640 1 -- 172.21.15.7:0/848652875 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f850c143fb0 msgr2=0x7f850c1f3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:35.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.757+0000 7f8509d9b640 1 --2- 172.21.15.7:0/848652875 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f850c143fb0 0x7f850c1f3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.757+0000 7f8509d9b640 1 -- 172.21.15.7:0/848652875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f850c06e950 msgr2=0x7f850c15a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:35.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.757+0000 7f8509d9b640 1 --2- 172.21.15.7:0/848652875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f850c06e950 0x7f850c15a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.757+0000 7f8509d9b640 1 -- 172.21.15.7:0/848652875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850c140670 con 0x7f850c0ce610 2024-04-25T10:02:35.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.757+0000 7f850ad9d640 1 --2- 172.21.15.7:0/848652875 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f850c143fb0 0x7f850c1f3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:02:35.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.757+0000 7f8509d9b640 1 --2- 172.21.15.7:0/848652875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f850c0ce610 0x7f850c06dae0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f8500000c00 tx=0x7f85000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:35.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.757+0000 7f84faffd640 1 -- 172.21.15.7:0/848652875 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8500037040 con 0x7f850c0ce610 2024-04-25T10:02:35.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.757+0000 7f84faffd640 1 -- 172.21.15.7:0/848652875 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8500042070 con 0x7f850c0ce610 2024-04-25T10:02:35.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.757+0000 7f84faffd640 1 -- 172.21.15.7:0/848652875 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8500030880 con 0x7f850c0ce610 2024-04-25T10:02:35.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.757+0000 7f8510d70640 1 -- 172.21.15.7:0/848652875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f850c06e020 con 0x7f850c0ce610 2024-04-25T10:02:35.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.757+0000 7f8510d70640 1 -- 172.21.15.7:0/848652875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f850c13f020 con 0x7f850c0ce610 2024-04-25T10:02:35.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.758+0000 7f8510d70640 1 -- 172.21.15.7:0/848652875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f850c068f60 con 0x7f850c0ce610 2024-04-25T10:02:35.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.758+0000 7f84faffd640 1 -- 172.21.15.7:0/848652875 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8500030a20 con 0x7f850c0ce610 2024-04-25T10:02:35.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.759+0000 7f84faffd640 1 --2- 172.21.15.7:0/848652875 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f84ec06b500 0x7f84ec06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:35.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.759+0000 7f84faffd640 1 -- 172.21.15.7:0/848652875 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f85000aacb0 con 0x7f850c0ce610 2024-04-25T10:02:35.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.759+0000 7f850a59c640 1 --2- 172.21.15.7:0/848652875 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f84ec06b500 0x7f84ec06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:35.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.759+0000 7f850a59c640 1 --2- 172.21.15.7:0/848652875 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f84ec06b500 0x7f84ec06d9c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f850c0cc7b0 tx=0x7f8504009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:35.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.763+0000 7f84faffd640 1 -- 172.21.15.7:0/848652875 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8500079880 con 0x7f850c0ce610 2024-04-25T10:02:35.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.946+0000 7f8510d70640 1 -- 172.21.15.7:0/848652875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f850c15c180 con 0x7f850c0ce610 2024-04-25T10:02:35.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.947+0000 7f84faffd640 1 -- 172.21.15.7:0/848652875 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8500079180 con 0x7f850c0ce610 2024-04-25T10:02:35.952 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T10:02:35.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.949+0000 7f8510d70640 1 -- 172.21.15.7:0/848652875 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f84ec06b500 msgr2=0x7f84ec06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:35.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.949+0000 7f8510d70640 1 --2- 172.21.15.7:0/848652875 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f84ec06b500 0x7f84ec06d9c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f850c0cc7b0 tx=0x7f8504009040 comp rx=0 tx=0).stop 2024-04-25T10:02:35.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.949+0000 7f8510d70640 1 -- 172.21.15.7:0/848652875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f850c0ce610 msgr2=0x7f850c06dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:35.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.949+0000 7f8510d70640 1 --2- 172.21.15.7:0/848652875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f850c0ce610 0x7f850c06dae0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f8500000c00 tx=0x7f85000046c0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.949+0000 7f8510d70640 1 -- 172.21.15.7:0/848652875 shutdown_connections 2024-04-25T10:02:35.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.949+0000 7f8510d70640 1 --2- 172.21.15.7:0/848652875 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f84ec06b500 0x7f84ec06d9c0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.949+0000 7f8510d70640 1 --2- 172.21.15.7:0/848652875 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f850c143fb0 0x7f850c1f3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.949+0000 7f8510d70640 1 --2- 172.21.15.7:0/848652875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f850c0ce610 0x7f850c06dae0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.949+0000 7f8510d70640 1 --2- 172.21.15.7:0/848652875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f850c06e950 0x7f850c15a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:35.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.949+0000 7f8510d70640 1 -- 172.21.15.7:0/848652875 >> 172.21.15.7:0/848652875 conn(0x7f850c06ab60 msgr2=0x7f850c13cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:35.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.949+0000 7f8510d70640 1 -- 172.21.15.7:0/848652875 shutdown_connections 2024-04-25T10:02:35.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:35.949+0000 7f8510d70640 1 -- 172.21.15.7:0/848652875 wait complete. 2024-04-25T10:02:35.965 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:02:36.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.063+0000 7fbddf0bc640 1 Processor -- start 2024-04-25T10:02:36.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.064+0000 7fbddf0bc640 1 -- start start 2024-04-25T10:02:36.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.064+0000 7fbddf0bc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbdd815dc60 0x7fbdd80cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:36.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.064+0000 7fbddf0bc640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbdd80cc760 0x7fbdd806ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:36.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.064+0000 7fbddf0bc640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd80caf00 con 0x7fbdd80ce150 2024-04-25T10:02:36.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.064+0000 7fbddf0bc640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd80cb1e0 con 0x7fbdd80cc760 2024-04-25T10:02:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.064+0000 7fbddf0bc640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd80cb4c0 con 0x7fbdd815dc60 2024-04-25T10:02:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.064+0000 7fbdd7fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbdd80cc760 0x7fbdd806ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.064+0000 7fbddd659640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbdd80ce150 0x7fbdd8161650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40772/0 (socket says 172.21.15.7:40772) 2024-04-25T10:02:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.064+0000 7fbddd659640 1 -- 172.21.15.7:0/4235093860 learned_addr learned my addr 172.21.15.7:0/4235093860 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:02:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.065+0000 7fbddce58640 1 --2- 172.21.15.7:0/4235093860 >> v2:172.21.15.55:3300/0 conn(0x7fbdd815dc60 0x7fbdd80cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.065+0000 7fbdd7fff640 1 -- 172.21.15.7:0/4235093860 >> v2:172.21.15.55:3300/0 conn(0x7fbdd815dc60 msgr2=0x7fbdd80cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.065+0000 7fbdd7fff640 1 --2- 172.21.15.7:0/4235093860 >> v2:172.21.15.55:3300/0 conn(0x7fbdd815dc60 0x7fbdd80cbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.065+0000 7fbdd7fff640 1 -- 172.21.15.7:0/4235093860 >> v1:172.21.15.7:6789/0 conn(0x7fbdd80ce150 legacy=0x7fbdd8161650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.065+0000 7fbdd7fff640 1 -- 172.21.15.7:0/4235093860 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd80cb7a0 con 0x7fbdd80cc760 2024-04-25T10:02:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.065+0000 7fbddce58640 1 --2- 172.21.15.7:0/4235093860 >> v2:172.21.15.55:3300/0 conn(0x7fbdd815dc60 0x7fbdd80cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:02:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.065+0000 7fbdd77fe640 1 -- 172.21.15.7:0/4235093860 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1729057661 0 0) 0x7fbdd80caf00 con 0x7fbdd80ce150 2024-04-25T10:02:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.065+0000 7fbdd7fff640 1 --2- 172.21.15.7:0/4235093860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdd80cc760 0x7fbdd806ab60 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fbdd80b3170 tx=0x7fbdcc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ac8c04b98a2314 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.066+0000 7fbdd77fe640 1 -- 172.21.15.7:0/4235093860 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc037070 con 0x7fbdd80cc760 2024-04-25T10:02:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.066+0000 7fbdd77fe640 1 -- 172.21.15.7:0/4235093860 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdcc032440 con 0x7fbdd80cc760 2024-04-25T10:02:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.066+0000 7fbdd77fe640 1 -- 172.21.15.7:0/4235093860 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc032810 con 0x7fbdd80cc760 2024-04-25T10:02:36.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.066+0000 7fbddf0bc640 1 -- 172.21.15.7:0/4235093860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdd80cc760 msgr2=0x7fbdd806ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:36.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.066+0000 7fbddf0bc640 1 --2- 172.21.15.7:0/4235093860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdd80cc760 0x7fbdd806ab60 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fbdd80b3170 tx=0x7fbdcc02a1a0 comp rx=0 tx=0).stop 2024-04-25T10:02:36.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.066+0000 7fbddf0bc640 1 -- 172.21.15.7:0/4235093860 shutdown_connections 2024-04-25T10:02:36.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.066+0000 7fbddf0bc640 1 --2- 172.21.15.7:0/4235093860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdd80cc760 0x7fbdd806ab60 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:36.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.066+0000 7fbddf0bc640 1 --2- 172.21.15.7:0/4235093860 >> v2:172.21.15.55:3300/0 conn(0x7fbdd815dc60 0x7fbdd80cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:36.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.066+0000 7fbddf0bc640 1 -- 172.21.15.7:0/4235093860 >> 172.21.15.7:0/4235093860 conn(0x7fbdd80725e0 msgr2=0x7fbdd80999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:36.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.066+0000 7fbddf0bc640 1 -- 172.21.15.7:0/4235093860 shutdown_connections 2024-04-25T10:02:36.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.066+0000 7fbddf0bc640 1 -- 172.21.15.7:0/4235093860 wait complete. 2024-04-25T10:02:36.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.067+0000 7fbddf0bc640 1 Processor -- start 2024-04-25T10:02:36.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.067+0000 7fbddf0bc640 1 -- start start 2024-04-25T10:02:36.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.068+0000 7fbddf0bc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbdd80cc760 0x7fbdd8157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:36.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.068+0000 7fbddf0bc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdd80ce150 0x7fbdd8147900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:36.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.068+0000 7fbddf0bc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdd815dc60 0x7fbdd81555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:36.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.068+0000 7fbddf0bc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd806b0a0 con 0x7fbdd815dc60 2024-04-25T10:02:36.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.068+0000 7fbddf0bc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd80cabd0 con 0x7fbdd80ce150 2024-04-25T10:02:36.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.068+0000 7fbddf0bc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd806b220 con 0x7fbdd80cc760 2024-04-25T10:02:36.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.068+0000 7fbddd659640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdd815dc60 0x7fbdd81555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:36.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.068+0000 7fbddd659640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdd815dc60 0x7fbdd81555d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48516/0 (socket says 172.21.15.7:48516) 2024-04-25T10:02:36.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.068+0000 7fbddd659640 1 -- 172.21.15.7:0/740218248 learned_addr learned my addr 172.21.15.7:0/740218248 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:36.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.069+0000 7fbddce58640 1 --2- 172.21.15.7:0/740218248 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbdd80cc760 0x7fbdd8157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:36.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.069+0000 7fbdd7fff640 1 --2- 172.21.15.7:0/740218248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdd80ce150 0x7fbdd8147900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:36.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.069+0000 7fbddd659640 1 -- 172.21.15.7:0/740218248 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbdd80cc760 msgr2=0x7fbdd8157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:36.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.069+0000 7fbddd659640 1 --2- 172.21.15.7:0/740218248 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbdd80cc760 0x7fbdd8157050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:36.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.069+0000 7fbddd659640 1 -- 172.21.15.7:0/740218248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdd80ce150 msgr2=0x7fbdd8147900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:36.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.069+0000 7fbddd659640 1 --2- 172.21.15.7:0/740218248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdd80ce150 0x7fbdd8147900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:36.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.069+0000 7fbddd659640 1 -- 172.21.15.7:0/740218248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd8155fb0 con 0x7fbdd815dc60 2024-04-25T10:02:36.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.069+0000 7fbdd7fff640 1 --2- 172.21.15.7:0/740218248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdd80ce150 0x7fbdd8147900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:02:36.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.069+0000 7fbddd659640 1 --2- 172.21.15.7:0/740218248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdd815dc60 0x7fbdd81555d0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800c480 tx=0x7fbdc800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:36.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.069+0000 7fbdd57fa640 1 -- 172.21.15.7:0/740218248 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8018070 con 0x7fbdd815dc60 2024-04-25T10:02:36.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.069+0000 7fbdd57fa640 1 -- 172.21.15.7:0/740218248 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc8007500 con 0x7fbdd815dc60 2024-04-25T10:02:36.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.069+0000 7fbdd57fa640 1 -- 172.21.15.7:0/740218248 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8004a20 con 0x7fbdd815dc60 2024-04-25T10:02:36.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.069+0000 7fbddf0bc640 1 -- 172.21.15.7:0/740218248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd8156290 con 0x7fbdd815dc60 2024-04-25T10:02:36.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.069+0000 7fbddf0bc640 1 -- 172.21.15.7:0/740218248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd8156850 con 0x7fbdd815dc60 2024-04-25T10:02:36.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.070+0000 7fbddf0bc640 1 -- 172.21.15.7:0/740218248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd8068f60 con 0x7fbdd815dc60 2024-04-25T10:02:36.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.071+0000 7fbdd57fa640 1 -- 172.21.15.7:0/740218248 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbdc8004bc0 con 0x7fbdd815dc60 2024-04-25T10:02:36.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.071+0000 7fbdd57fa640 1 --2- 172.21.15.7:0/740218248 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbdc406b4d0 0x7fbdc406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:36.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.071+0000 7fbdd57fa640 1 -- 172.21.15.7:0/740218248 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fbdc8089630 con 0x7fbdd815dc60 2024-04-25T10:02:36.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.071+0000 7fbddce58640 1 --2- 172.21.15.7:0/740218248 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbdc406b4d0 0x7fbdc406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:36.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.071+0000 7fbddce58640 1 --2- 172.21.15.7:0/740218248 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbdc406b4d0 0x7fbdc406d990 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8158b00 tx=0x7fbdd0007770 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:36.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.075+0000 7fbdd57fa640 1 -- 172.21.15.7:0/740218248 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbdc8057c40 con 0x7fbdd815dc60 2024-04-25T10:02:36.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.255+0000 7fbddf0bc640 1 -- 172.21.15.7:0/740218248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbdd80b6500 con 0x7fbdd815dc60 2024-04-25T10:02:36.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.256+0000 7fbdd57fa640 1 -- 172.21.15.7:0/740218248 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbdc805bce0 con 0x7fbdd815dc60 2024-04-25T10:02:36.261 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T10:02:36.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.258+0000 7fbddf0bc640 1 -- 172.21.15.7:0/740218248 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbdc406b4d0 msgr2=0x7fbdc406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:36.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.258+0000 7fbddf0bc640 1 --2- 172.21.15.7:0/740218248 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbdc406b4d0 0x7fbdc406d990 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8158b00 tx=0x7fbdd0007770 comp rx=0 tx=0).stop 2024-04-25T10:02:36.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.258+0000 7fbddf0bc640 1 -- 172.21.15.7:0/740218248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdd815dc60 msgr2=0x7fbdd81555d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:36.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.258+0000 7fbddf0bc640 1 --2- 172.21.15.7:0/740218248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdd815dc60 0x7fbdd81555d0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800c480 tx=0x7fbdc800c940 comp rx=0 tx=0).stop 2024-04-25T10:02:36.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.258+0000 7fbddf0bc640 1 -- 172.21.15.7:0/740218248 shutdown_connections 2024-04-25T10:02:36.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.258+0000 7fbddf0bc640 1 --2- 172.21.15.7:0/740218248 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbdc406b4d0 0x7fbdc406d990 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:36.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.258+0000 7fbddf0bc640 1 --2- 172.21.15.7:0/740218248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdd815dc60 0x7fbdd81555d0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:36.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.258+0000 7fbddf0bc640 1 --2- 172.21.15.7:0/740218248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdd80ce150 0x7fbdd8147900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:36.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.258+0000 7fbddf0bc640 1 --2- 172.21.15.7:0/740218248 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbdd80cc760 0x7fbdd8157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:36.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.258+0000 7fbddf0bc640 1 -- 172.21.15.7:0/740218248 >> 172.21.15.7:0/740218248 conn(0x7fbdd80725e0 msgr2=0x7fbdd806f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:36.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.258+0000 7fbddf0bc640 1 -- 172.21.15.7:0/740218248 shutdown_connections 2024-04-25T10:02:36.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.258+0000 7fbddf0bc640 1 -- 172.21.15.7:0/740218248 wait complete. 2024-04-25T10:02:36.273 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:02:36.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.369+0000 7fefe656a640 1 Processor -- start 2024-04-25T10:02:36.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.369+0000 7fefe656a640 1 -- start start 2024-04-25T10:02:36.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.370+0000 7fefe656a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fefe015db00 0x7fefe00d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:36.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.370+0000 7fefe656a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fefe00b53b0 0x7fefe00d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:36.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.370+0000 7fefe656a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe00d1e80 con 0x7fefe00ce2b0 2024-04-25T10:02:36.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.370+0000 7fefe656a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe00b5930 con 0x7fefe00b53b0 2024-04-25T10:02:36.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.370+0000 7fefe656a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe00b5c10 con 0x7fefe015db00 2024-04-25T10:02:36.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.370+0000 7fefdf7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fefe00b53b0 0x7fefe00d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:36.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.370+0000 7fefe4b07640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fefe00ce2b0 0x7fefe0161670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40782/0 (socket says 172.21.15.7:40782) 2024-04-25T10:02:36.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.370+0000 7fefe4b07640 1 -- 172.21.15.7:0/3645294970 learned_addr learned my addr 172.21.15.7:0/3645294970 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:02:36.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.371+0000 7fefdffff640 1 --2- 172.21.15.7:0/3645294970 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fefe015db00 0x7fefe00d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:36.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.371+0000 7fefdf7fe640 1 -- 172.21.15.7:0/3645294970 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fefe015db00 msgr2=0x7fefe00d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:36.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.371+0000 7fefdf7fe640 1 --2- 172.21.15.7:0/3645294970 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fefe015db00 0x7fefe00d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:36.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.371+0000 7fefdf7fe640 1 -- 172.21.15.7:0/3645294970 >> v1:172.21.15.7:6789/0 conn(0x7fefe00ce2b0 legacy=0x7fefe0161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:36.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.371+0000 7fefdf7fe640 1 -- 172.21.15.7:0/3645294970 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe00b5ef0 con 0x7fefe00b53b0 2024-04-25T10:02:36.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.371+0000 7fefdeffd640 1 -- 172.21.15.7:0/3645294970 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2869856489 0 0) 0x7fefe00d1e80 con 0x7fefe00ce2b0 2024-04-25T10:02:36.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.371+0000 7fefdffff640 1 --2- 172.21.15.7:0/3645294970 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fefe015db00 0x7fefe00d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:02:36.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.371+0000 7fefdf7fe640 1 --2- 172.21.15.7:0/3645294970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefe00b53b0 0x7fefe00d0880 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fefd40097a0 tx=0x7fefd402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab63bdea150660a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:36.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.371+0000 7fefdeffd640 1 -- 172.21.15.7:0/3645294970 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd4037070 con 0x7fefe00b53b0 2024-04-25T10:02:36.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.372+0000 7fefdeffd640 1 -- 172.21.15.7:0/3645294970 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd4032440 con 0x7fefe00b53b0 2024-04-25T10:02:36.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.372+0000 7fefdeffd640 1 -- 172.21.15.7:0/3645294970 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd4032810 con 0x7fefe00b53b0 2024-04-25T10:02:36.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.372+0000 7fefe656a640 1 -- 172.21.15.7:0/3645294970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefe00b53b0 msgr2=0x7fefe00d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:36.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.372+0000 7fefe656a640 1 --2- 172.21.15.7:0/3645294970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefe00b53b0 0x7fefe00d0880 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fefd40097a0 tx=0x7fefd402a180 comp rx=0 tx=0).stop 2024-04-25T10:02:36.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.372+0000 7fefe656a640 1 -- 172.21.15.7:0/3645294970 shutdown_connections 2024-04-25T10:02:36.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.372+0000 7fefe656a640 1 --2- 172.21.15.7:0/3645294970 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefe00b53b0 0x7fefe00d0880 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:36.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.372+0000 7fefe656a640 1 --2- 172.21.15.7:0/3645294970 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fefe015db00 0x7fefe00d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:36.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.372+0000 7fefe656a640 1 -- 172.21.15.7:0/3645294970 >> 172.21.15.7:0/3645294970 conn(0x7fefe0072290 msgr2=0x7fefe00726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:36.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.372+0000 7fefe656a640 1 -- 172.21.15.7:0/3645294970 shutdown_connections 2024-04-25T10:02:36.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.372+0000 7fefe656a640 1 -- 172.21.15.7:0/3645294970 wait complete. 2024-04-25T10:02:36.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.373+0000 7fefe656a640 1 Processor -- start 2024-04-25T10:02:36.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.373+0000 7fefe656a640 1 -- start start 2024-04-25T10:02:36.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.374+0000 7fefe656a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefe00b53b0 0x7fefe00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:36.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.374+0000 7fefe656a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fefe00ce2b0 0x7fefe0149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:36.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.374+0000 7fefe656a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefe015db00 0x7fefe0160740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:36.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.374+0000 7fefe656a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe00d3660 con 0x7fefe015db00 2024-04-25T10:02:36.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.374+0000 7fefe656a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe00b61d0 con 0x7fefe00b53b0 2024-04-25T10:02:36.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.374+0000 7fefe656a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe00b6c10 con 0x7fefe00ce2b0 2024-04-25T10:02:36.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.374+0000 7fefe4b07640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefe015db00 0x7fefe0160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:36.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.374+0000 7fefe4b07640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefe015db00 0x7fefe0160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48542/0 (socket says 172.21.15.7:48542) 2024-04-25T10:02:36.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.374+0000 7fefe4b07640 1 -- 172.21.15.7:0/3847374448 learned_addr learned my addr 172.21.15.7:0/3847374448 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:36.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.374+0000 7fefdf7fe640 1 --2- 172.21.15.7:0/3847374448 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fefe00ce2b0 0x7fefe0149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:36.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.375+0000 7fefe4b07640 1 -- 172.21.15.7:0/3847374448 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fefe00ce2b0 msgr2=0x7fefe0149ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:36.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.375+0000 7fefdffff640 1 --2- 172.21.15.7:0/3847374448 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefe00b53b0 0x7fefe00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:36.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.375+0000 7fefe4b07640 1 --2- 172.21.15.7:0/3847374448 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fefe00ce2b0 0x7fefe0149ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:36.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.375+0000 7fefe4b07640 1 -- 172.21.15.7:0/3847374448 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefe00b53b0 msgr2=0x7fefe00b8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:36.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.375+0000 7fefe4b07640 1 --2- 172.21.15.7:0/3847374448 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefe00b53b0 0x7fefe00b8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:36.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.375+0000 7fefe4b07640 1 -- 172.21.15.7:0/3847374448 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe0160eb0 con 0x7fefe015db00 2024-04-25T10:02:36.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.375+0000 7fefe4b07640 1 --2- 172.21.15.7:0/3847374448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefe015db00 0x7fefe0160740 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fefd800c7a0 tx=0x7fefd800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:36.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.375+0000 7fefdcff9640 1 -- 172.21.15.7:0/3847374448 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd8018070 con 0x7fefe015db00 2024-04-25T10:02:36.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.375+0000 7fefdcff9640 1 -- 172.21.15.7:0/3847374448 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd800a640 con 0x7fefe015db00 2024-04-25T10:02:36.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.375+0000 7fefe656a640 1 -- 172.21.15.7:0/3847374448 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe015eba0 con 0x7fefe015db00 2024-04-25T10:02:36.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.375+0000 7fefdcff9640 1 -- 172.21.15.7:0/3847374448 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd800aab0 con 0x7fefe015db00 2024-04-25T10:02:36.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.375+0000 7fefe656a640 1 -- 172.21.15.7:0/3847374448 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe015f160 con 0x7fefe015db00 2024-04-25T10:02:36.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.376+0000 7fefe656a640 1 -- 172.21.15.7:0/3847374448 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe0068fd0 con 0x7fefe015db00 2024-04-25T10:02:36.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.376+0000 7fefdcff9640 1 -- 172.21.15.7:0/3847374448 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fefd801b070 con 0x7fefe015db00 2024-04-25T10:02:36.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.377+0000 7fefdcff9640 1 --2- 172.21.15.7:0/3847374448 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fefcc06b4d0 0x7fefcc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:36.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.377+0000 7fefdcff9640 1 -- 172.21.15.7:0/3847374448 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fefd8089b90 con 0x7fefe015db00 2024-04-25T10:02:36.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.377+0000 7fefdffff640 1 --2- 172.21.15.7:0/3847374448 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fefcc06b4d0 0x7fefcc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:36.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.377+0000 7fefdffff640 1 --2- 172.21.15.7:0/3847374448 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fefcc06b4d0 0x7fefcc06d990 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fefd000b840 tx=0x7fefd0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:36.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.381+0000 7fefdcff9640 1 -- 172.21.15.7:0/3847374448 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fefd80586c0 con 0x7fefe015db00 2024-04-25T10:02:36.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.601+0000 7fefe656a640 1 -- 172.21.15.7:0/3847374448 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fefe00b8800 con 0x7fefe015db00 2024-04-25T10:02:36.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.601+0000 7fefdcff9640 1 -- 172.21.15.7:0/3847374448 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4935 (secure 0 0 0) 0x7fefd8057fc0 con 0x7fefe015db00 2024-04-25T10:02:36.606 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:02:36.607 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":66,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2505539422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2505539422},{"type":"v1","addr":"172.21.15.55:6834","nonce":2505539422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2808857776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2808857776},{"type":"v1","addr":"172.21.15.55:6835","nonce":2808857776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7518,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1796103144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1796103144},{"type":"v1","addr":"172.21.15.7:6835","nonce":1796103144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:00:34.054759+0000","modified":"2024-04-25T10:01:57.949246+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8022},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8022":{"gid":8022,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6837/1061077733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1061077733},{"type":"v1","addr":"172.21.15.7:6837","nonce":1061077733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:02:36.607 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 66 2024-04-25T10:02:36.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.603+0000 7fefe656a640 1 -- 172.21.15.7:0/3847374448 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fefcc06b4d0 msgr2=0x7fefcc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:36.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.603+0000 7fefe656a640 1 --2- 172.21.15.7:0/3847374448 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fefcc06b4d0 0x7fefcc06d990 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fefd000b840 tx=0x7fefd0008040 comp rx=0 tx=0).stop 2024-04-25T10:02:36.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.603+0000 7fefe656a640 1 -- 172.21.15.7:0/3847374448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefe015db00 msgr2=0x7fefe0160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:36.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.603+0000 7fefe656a640 1 --2- 172.21.15.7:0/3847374448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefe015db00 0x7fefe0160740 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fefd800c7a0 tx=0x7fefd800cc60 comp rx=0 tx=0).stop 2024-04-25T10:02:36.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.603+0000 7fefe656a640 1 -- 172.21.15.7:0/3847374448 shutdown_connections 2024-04-25T10:02:36.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.603+0000 7fefe656a640 1 --2- 172.21.15.7:0/3847374448 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fefcc06b4d0 0x7fefcc06d990 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:36.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.603+0000 7fefe656a640 1 --2- 172.21.15.7:0/3847374448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefe015db00 0x7fefe0160740 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:36.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.603+0000 7fefe656a640 1 --2- 172.21.15.7:0/3847374448 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fefe00ce2b0 0x7fefe0149ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:36.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.603+0000 7fefe656a640 1 --2- 172.21.15.7:0/3847374448 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefe00b53b0 0x7fefe00b8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:36.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.603+0000 7fefe656a640 1 -- 172.21.15.7:0/3847374448 >> 172.21.15.7:0/3847374448 conn(0x7fefe0072290 msgr2=0x7fefe015be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:36.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.604+0000 7fefe656a640 1 -- 172.21.15.7:0/3847374448 shutdown_connections 2024-04-25T10:02:36.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.604+0000 7fefe656a640 1 -- 172.21.15.7:0/3847374448 wait complete. 2024-04-25T10:02:36.619 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:02:36.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.714+0000 7fab5369e640 1 Processor -- start 2024-04-25T10:02:36.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.715+0000 7fab5369e640 1 -- start start 2024-04-25T10:02:36.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.715+0000 7fab5369e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fab4c15da20 0x7fab4c09a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:36.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.715+0000 7fab5369e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fab4c06bc70 0x7fab4c0d0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:36.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.715+0000 7fab5369e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab4c0d10b0 0x7fab4c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:36.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.715+0000 7fab5369e640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4c0d06e0 con 0x7fab4c06bc70 2024-04-25T10:02:36.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.715+0000 7fab5369e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4c09a940 con 0x7fab4c15da20 2024-04-25T10:02:36.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.715+0000 7fab5369e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c0cfad0 con 0x7fab4c0d10b0 2024-04-25T10:02:36.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.716+0000 7fab50c39640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fab4c06bc70 0x7fab4c0d0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:36.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.716+0000 7fab50c39640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fab4c06bc70 0x7fab4c0d0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48546/0 (socket says 172.21.15.7:48546) 2024-04-25T10:02:36.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.716+0000 7fab50c39640 1 -- 172.21.15.7:0/1989189984 learned_addr learned my addr 172.21.15.7:0/1989189984 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:36.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.716+0000 7fab50c39640 1 -- 172.21.15.7:0/1989189984 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab4c0d10b0 msgr2=0x7fab4c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:36.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.716+0000 7fab51c3b640 1 --2- 172.21.15.7:0/1989189984 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab4c0d10b0 0x7fab4c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:36.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.716+0000 7fab5143a640 1 --2- 172.21.15.7:0/1989189984 >> v2:172.21.15.55:3300/0 conn(0x7fab4c15da20 0x7fab4c09a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:36.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.716+0000 7fab50c39640 1 --2- 172.21.15.7:0/1989189984 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab4c0d10b0 0x7fab4c06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:36.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.716+0000 7fab50c39640 1 -- 172.21.15.7:0/1989189984 >> v2:172.21.15.55:3300/0 conn(0x7fab4c15da20 msgr2=0x7fab4c09a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:36.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.716+0000 7fab50c39640 1 --2- 172.21.15.7:0/1989189984 >> v2:172.21.15.55:3300/0 conn(0x7fab4c15da20 0x7fab4c09a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:36.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.716+0000 7fab50c39640 1 -- 172.21.15.7:0/1989189984 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c0cfdb0 con 0x7fab4c06bc70 2024-04-25T10:02:36.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.716+0000 7fab51c3b640 1 --2- 172.21.15.7:0/1989189984 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab4c0d10b0 0x7fab4c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:02:36.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.716+0000 7fab5143a640 1 --2- 172.21.15.7:0/1989189984 >> v2:172.21.15.55:3300/0 conn(0x7fab4c15da20 0x7fab4c09a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:02:36.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.717+0000 7fab50c39640 1 --2- 172.21.15.7:0/1989189984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab4c06bc70 0x7fab4c0d0b70 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fab4c06dca0 tx=0x7fab4002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb42eeb541ae361 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.717+0000 7fab4bfff640 1 -- 172.21.15.7:0/1989189984 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab40037070 con 0x7fab4c06bc70 2024-04-25T10:02:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.717+0000 7fab4bfff640 1 -- 172.21.15.7:0/1989189984 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab40032440 con 0x7fab4c06bc70 2024-04-25T10:02:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.717+0000 7fab4bfff640 1 -- 172.21.15.7:0/1989189984 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab40032810 con 0x7fab4c06bc70 2024-04-25T10:02:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.717+0000 7fab5369e640 1 -- 172.21.15.7:0/1989189984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab4c06bc70 msgr2=0x7fab4c0d0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.717+0000 7fab5369e640 1 --2- 172.21.15.7:0/1989189984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab4c06bc70 0x7fab4c0d0b70 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fab4c06dca0 tx=0x7fab4002a1e0 comp rx=0 tx=0).stop 2024-04-25T10:02:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.717+0000 7fab5369e640 1 -- 172.21.15.7:0/1989189984 shutdown_connections 2024-04-25T10:02:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.717+0000 7fab5369e640 1 --2- 172.21.15.7:0/1989189984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab4c06bc70 0x7fab4c0d0b70 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.717+0000 7fab5369e640 1 --2- 172.21.15.7:0/1989189984 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab4c0d10b0 0x7fab4c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.717+0000 7fab5369e640 1 --2- 172.21.15.7:0/1989189984 >> v2:172.21.15.55:3300/0 conn(0x7fab4c15da20 0x7fab4c09a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.717+0000 7fab5369e640 1 -- 172.21.15.7:0/1989189984 >> 172.21.15.7:0/1989189984 conn(0x7fab4c0d16f0 msgr2=0x7fab4c0d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.718+0000 7fab5369e640 1 -- 172.21.15.7:0/1989189984 shutdown_connections 2024-04-25T10:02:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.718+0000 7fab5369e640 1 -- 172.21.15.7:0/1989189984 wait complete. 2024-04-25T10:02:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.719+0000 7fab5369e640 1 Processor -- start 2024-04-25T10:02:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.719+0000 7fab5369e640 1 -- start start 2024-04-25T10:02:36.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.719+0000 7fab5369e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab4c06bc70 0x7fab4c0aea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:36.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.719+0000 7fab5369e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab4c0d10b0 0x7fab4c09b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:36.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.719+0000 7fab5369e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab4c15da20 0x7fab4c06c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:36.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.719+0000 7fab5369e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c15de00 con 0x7fab4c06bc70 2024-04-25T10:02:36.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.719+0000 7fab5369e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c0d0370 con 0x7fab4c0d10b0 2024-04-25T10:02:36.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.719+0000 7fab5369e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c15df80 con 0x7fab4c15da20 2024-04-25T10:02:36.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.719+0000 7fab5143a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab4c06bc70 0x7fab4c0aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:36.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.719+0000 7fab5143a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab4c06bc70 0x7fab4c0aea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48554/0 (socket says 172.21.15.7:48554) 2024-04-25T10:02:36.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.720+0000 7fab5143a640 1 -- 172.21.15.7:0/4272260619 learned_addr learned my addr 172.21.15.7:0/4272260619 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:36.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.720+0000 7fab50c39640 1 --2- 172.21.15.7:0/4272260619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab4c0d10b0 0x7fab4c09b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:36.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.720+0000 7fab51c3b640 1 --2- 172.21.15.7:0/4272260619 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab4c15da20 0x7fab4c06c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:36.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.720+0000 7fab5143a640 1 -- 172.21.15.7:0/4272260619 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab4c15da20 msgr2=0x7fab4c06c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:36.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.720+0000 7fab5143a640 1 --2- 172.21.15.7:0/4272260619 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab4c15da20 0x7fab4c06c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:36.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.720+0000 7fab5143a640 1 -- 172.21.15.7:0/4272260619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab4c0d10b0 msgr2=0x7fab4c09b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:36.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.720+0000 7fab5143a640 1 --2- 172.21.15.7:0/4272260619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab4c0d10b0 0x7fab4c09b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:36.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.720+0000 7fab5143a640 1 -- 172.21.15.7:0/4272260619 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c09c0f0 con 0x7fab4c06bc70 2024-04-25T10:02:36.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.720+0000 7fab50c39640 1 --2- 172.21.15.7:0/4272260619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab4c0d10b0 0x7fab4c09b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:02:36.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.720+0000 7fab5143a640 1 --2- 172.21.15.7:0/4272260619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab4c06bc70 0x7fab4c0aea00 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fab3c00cf60 tx=0x7fab3c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:36.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.720+0000 7fab49ffb640 1 -- 172.21.15.7:0/4272260619 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3c01a070 con 0x7fab4c06bc70 2024-04-25T10:02:36.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.720+0000 7fab49ffb640 1 -- 172.21.15.7:0/4272260619 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3c00d840 con 0x7fab4c06bc70 2024-04-25T10:02:36.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.720+0000 7fab5369e640 1 -- 172.21.15.7:0/4272260619 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab4c09c3d0 con 0x7fab4c06bc70 2024-04-25T10:02:36.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.720+0000 7fab49ffb640 1 -- 172.21.15.7:0/4272260619 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3c00dc10 con 0x7fab4c06bc70 2024-04-25T10:02:36.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.720+0000 7fab5369e640 1 -- 172.21.15.7:0/4272260619 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab4c1562a0 con 0x7fab4c06bc70 2024-04-25T10:02:36.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.721+0000 7fab5369e640 1 -- 172.21.15.7:0/4272260619 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab4c068fd0 con 0x7fab4c06bc70 2024-04-25T10:02:36.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.722+0000 7fab49ffb640 1 -- 172.21.15.7:0/4272260619 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fab3c01d070 con 0x7fab4c06bc70 2024-04-25T10:02:36.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.722+0000 7fab49ffb640 1 --2- 172.21.15.7:0/4272260619 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fab3806b4d0 0x7fab3806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:36.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.722+0000 7fab49ffb640 1 -- 172.21.15.7:0/4272260619 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fab3c08ab30 con 0x7fab4c06bc70 2024-04-25T10:02:36.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.722+0000 7fab50c39640 1 --2- 172.21.15.7:0/4272260619 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fab3806b4d0 0x7fab3806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:36.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.722+0000 7fab50c39640 1 --2- 172.21.15.7:0/4272260619 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fab3806b4d0 0x7fab3806d990 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fab40034000 tx=0x7fab4002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:36.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.726+0000 7fab49ffb640 1 -- 172.21.15.7:0/4272260619 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fab3c059140 con 0x7fab4c06bc70 2024-04-25T10:02:36.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.907+0000 7fab5369e640 1 -- 172.21.15.7:0/4272260619 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab4c09c5a0 con 0x7fab4c06bc70 2024-04-25T10:02:36.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.908+0000 7fab49ffb640 1 -- 172.21.15.7:0/4272260619 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+17238 (secure 0 0 0) 0x7fab3c05d1e0 con 0x7fab4c06bc70 2024-04-25T10:02:36.913 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:02:36.913 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":92,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:01:54.932383+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:00:32.330930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T10:00:33.030728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1b","mappings":[{"from":1,"to":7}]},{"pgid":"14.2c","mappings":[{"from":1,"to":5}]},{"pgid":"14.31","mappings":[{"from":1,"to":7}]},{"pgid":"14.32","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6837/3829085443":"2024-04-26T10:01:54.932349+0000","172.21.15.7:6836/3829085443":"2024-04-26T10:01:54.932349+0000","172.21.15.7:6837/2878753733":"2024-04-26T10:00:43.379350+0000","172.21.15.7:6836/2878753733":"2024-04-26T10:00:43.379350+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:02:36.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.910+0000 7fab5369e640 1 -- 172.21.15.7:0/4272260619 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fab3806b4d0 msgr2=0x7fab3806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:36.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.910+0000 7fab5369e640 1 --2- 172.21.15.7:0/4272260619 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fab3806b4d0 0x7fab3806d990 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fab40034000 tx=0x7fab4002e000 comp rx=0 tx=0).stop 2024-04-25T10:02:36.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.910+0000 7fab5369e640 1 -- 172.21.15.7:0/4272260619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab4c06bc70 msgr2=0x7fab4c0aea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:36.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.910+0000 7fab5369e640 1 --2- 172.21.15.7:0/4272260619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab4c06bc70 0x7fab4c0aea00 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fab3c00cf60 tx=0x7fab3c00cf90 comp rx=0 tx=0).stop 2024-04-25T10:02:36.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.911+0000 7fab5369e640 1 -- 172.21.15.7:0/4272260619 shutdown_connections 2024-04-25T10:02:36.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.911+0000 7fab5369e640 1 --2- 172.21.15.7:0/4272260619 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fab3806b4d0 0x7fab3806d990 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:36.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.911+0000 7fab5369e640 1 --2- 172.21.15.7:0/4272260619 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab4c15da20 0x7fab4c06c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:36.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.911+0000 7fab5369e640 1 --2- 172.21.15.7:0/4272260619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab4c0d10b0 0x7fab4c09b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:36.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.911+0000 7fab5369e640 1 --2- 172.21.15.7:0/4272260619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab4c06bc70 0x7fab4c0aea00 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:36.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.911+0000 7fab5369e640 1 -- 172.21.15.7:0/4272260619 >> 172.21.15.7:0/4272260619 conn(0x7fab4c0d16f0 msgr2=0x7fab4c0cd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:36.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.911+0000 7fab5369e640 1 -- 172.21.15.7:0/4272260619 shutdown_connections 2024-04-25T10:02:36.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:36.911+0000 7fab5369e640 1 -- 172.21.15.7:0/4272260619 wait complete. 2024-04-25T10:02:36.926 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T10:02:36.927 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:02:37.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.022+0000 7f0ba5c15640 1 Processor -- start 2024-04-25T10:02:37.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.023+0000 7f0ba5c15640 1 -- start start 2024-04-25T10:02:37.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.023+0000 7f0ba5c15640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ba00cd740 0x7f0ba00d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:37.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.023+0000 7f0ba5c15640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0ba00d08d0 0x7f0ba006c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:37.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.023+0000 7f0ba5c15640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ba0099b90 con 0x7f0ba006cbc0 2024-04-25T10:02:37.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.023+0000 7f0ba5c15640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ba00cdb20 con 0x7f0ba00d08d0 2024-04-25T10:02:37.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.023+0000 7f0ba5c15640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba00ccca0 con 0x7f0ba00cd740 2024-04-25T10:02:37.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.024+0000 7f0b9effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0ba00d08d0 0x7f0ba006c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:37.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.024+0000 7f0b9f7fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ba00cd740 0x7f0ba00d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:37.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.024+0000 7f0b9ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0ba006cbc0 0x7f0ba0161830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:54042/0 (socket says 172.21.15.7:54042) 2024-04-25T10:02:37.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.024+0000 7f0b9ffff640 1 -- 172.21.15.7:0/1304992844 learned_addr learned my addr 172.21.15.7:0/1304992844 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:02:37.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.024+0000 7f0b9e7fc640 1 -- 172.21.15.7:0/1304992844 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328432111 0 0) 0x7f0ba0099b90 con 0x7f0ba006cbc0 2024-04-25T10:02:37.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.024+0000 7f0b9e7fc640 1 -- 172.21.15.7:0/1304992844 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b88003520 con 0x7f0ba006cbc0 2024-04-25T10:02:37.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.024+0000 7f0b9effd640 1 -- 172.21.15.7:0/1304992844 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ba00cd740 msgr2=0x7f0ba00d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:37.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.024+0000 7f0b9effd640 1 --2- 172.21.15.7:0/1304992844 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ba00cd740 0x7f0ba00d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:37.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.024+0000 7f0b9effd640 1 -- 172.21.15.7:0/1304992844 >> v1:172.21.15.55:6789/0 conn(0x7f0ba006cbc0 legacy=0x7f0ba0161830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:37.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.024+0000 7f0b9effd640 1 -- 172.21.15.7:0/1304992844 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba0099e70 con 0x7f0ba00d08d0 2024-04-25T10:02:37.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.024+0000 7f0b9f7fe640 1 --2- 172.21.15.7:0/1304992844 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ba00cd740 0x7f0ba00d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:02:37.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.025+0000 7f0b9effd640 1 --2- 172.21.15.7:0/1304992844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ba00d08d0 0x7f0ba006c680 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0b940097a0 tx=0x7f0b9402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a661f2fe37cfdcb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:37.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.025+0000 7f0b9e7fc640 1 -- 172.21.15.7:0/1304992844 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b94037070 con 0x7f0ba00d08d0 2024-04-25T10:02:37.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.025+0000 7f0b9e7fc640 1 -- 172.21.15.7:0/1304992844 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b94032440 con 0x7f0ba00d08d0 2024-04-25T10:02:37.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.025+0000 7f0b9e7fc640 1 -- 172.21.15.7:0/1304992844 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b940327f0 con 0x7f0ba00d08d0 2024-04-25T10:02:37.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.026+0000 7f0ba5c15640 1 -- 172.21.15.7:0/1304992844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ba00d08d0 msgr2=0x7f0ba006c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:37.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.026+0000 7f0ba5c15640 1 --2- 172.21.15.7:0/1304992844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ba00d08d0 0x7f0ba006c680 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0b940097a0 tx=0x7f0b9402a180 comp rx=0 tx=0).stop 2024-04-25T10:02:37.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.026+0000 7f0ba5c15640 1 -- 172.21.15.7:0/1304992844 shutdown_connections 2024-04-25T10:02:37.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.026+0000 7f0ba5c15640 1 --2- 172.21.15.7:0/1304992844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ba00d08d0 0x7f0ba006c680 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:37.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.026+0000 7f0ba5c15640 1 --2- 172.21.15.7:0/1304992844 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ba00cd740 0x7f0ba00d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:37.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.026+0000 7f0ba5c15640 1 -- 172.21.15.7:0/1304992844 >> 172.21.15.7:0/1304992844 conn(0x7f0ba00b3130 msgr2=0x7f0ba00b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:37.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.026+0000 7f0ba5c15640 1 -- 172.21.15.7:0/1304992844 shutdown_connections 2024-04-25T10:02:37.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.026+0000 7f0ba5c15640 1 -- 172.21.15.7:0/1304992844 wait complete. 2024-04-25T10:02:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.027+0000 7f0ba5c15640 1 Processor -- start 2024-04-25T10:02:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.027+0000 7f0ba5c15640 1 -- start start 2024-04-25T10:02:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.028+0000 7f0ba5c15640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ba006cbc0 0x7f0ba00b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.028+0000 7f0ba5c15640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ba00cd740 0x7f0ba00aea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.028+0000 7f0ba5c15640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ba00d08d0 0x7f0ba01574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.028+0000 7f0ba5c15640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba009a710 con 0x7f0ba00d08d0 2024-04-25T10:02:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.028+0000 7f0ba5c15640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba009a430 con 0x7f0ba006cbc0 2024-04-25T10:02:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.028+0000 7f0ba5c15640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba009ac30 con 0x7f0ba00cd740 2024-04-25T10:02:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.028+0000 7f0b9ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ba00d08d0 0x7f0ba01574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:37.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.028+0000 7f0b9ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ba00d08d0 0x7f0ba01574c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48562/0 (socket says 172.21.15.7:48562) 2024-04-25T10:02:37.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.028+0000 7f0b9ffff640 1 -- 172.21.15.7:0/1893626578 learned_addr learned my addr 172.21.15.7:0/1893626578 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:37.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.028+0000 7f0b9f7fe640 1 --2- 172.21.15.7:0/1893626578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ba006cbc0 0x7f0ba00b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:37.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.028+0000 7f0b9effd640 1 --2- 172.21.15.7:0/1893626578 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ba00cd740 0x7f0ba00aea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:37.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.028+0000 7f0b9ffff640 1 -- 172.21.15.7:0/1893626578 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ba00cd740 msgr2=0x7f0ba00aea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:37.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.028+0000 7f0b9ffff640 1 --2- 172.21.15.7:0/1893626578 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ba00cd740 0x7f0ba00aea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:37.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.028+0000 7f0b9ffff640 1 -- 172.21.15.7:0/1893626578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ba006cbc0 msgr2=0x7f0ba00b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:37.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.028+0000 7f0b9ffff640 1 --2- 172.21.15.7:0/1893626578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ba006cbc0 0x7f0ba00b1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:37.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.028+0000 7f0b9ffff640 1 -- 172.21.15.7:0/1893626578 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba00aefd0 con 0x7f0ba00d08d0 2024-04-25T10:02:37.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.028+0000 7f0b9effd640 1 --2- 172.21.15.7:0/1893626578 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ba00cd740 0x7f0ba00aea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:02:37.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.028+0000 7f0b9ffff640 1 --2- 172.21.15.7:0/1893626578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ba00d08d0 0x7f0ba01574c0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f0b9800caa0 tx=0x7f0b9800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:37.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.029+0000 7f0b87fff640 1 -- 172.21.15.7:0/1893626578 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b98017070 con 0x7f0ba00d08d0 2024-04-25T10:02:37.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.029+0000 7f0ba5c15640 1 -- 172.21.15.7:0/1893626578 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba00af280 con 0x7f0ba00d08d0 2024-04-25T10:02:37.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.029+0000 7f0b87fff640 1 -- 172.21.15.7:0/1893626578 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9800ac00 con 0x7f0ba00d08d0 2024-04-25T10:02:37.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.029+0000 7f0b87fff640 1 -- 172.21.15.7:0/1893626578 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b98012400 con 0x7f0ba00d08d0 2024-04-25T10:02:37.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.029+0000 7f0ba5c15640 1 -- 172.21.15.7:0/1893626578 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba00af840 con 0x7f0ba00d08d0 2024-04-25T10:02:37.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.030+0000 7f0ba5c15640 1 -- 172.21.15.7:0/1893626578 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ba0068fd0 con 0x7f0ba00d08d0 2024-04-25T10:02:37.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.030+0000 7f0b87fff640 1 -- 172.21.15.7:0/1893626578 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0b9801a070 con 0x7f0ba00d08d0 2024-04-25T10:02:37.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.031+0000 7f0b87fff640 1 --2- 172.21.15.7:0/1893626578 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0b8c06b500 0x7f0b8c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:37.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.031+0000 7f0b87fff640 1 -- 172.21.15.7:0/1893626578 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f0b9808a1a0 con 0x7f0ba00d08d0 2024-04-25T10:02:37.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.031+0000 7f0b9f7fe640 1 --2- 172.21.15.7:0/1893626578 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0b8c06b500 0x7f0b8c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:37.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.031+0000 7f0b9f7fe640 1 --2- 172.21.15.7:0/1893626578 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0b8c06b500 0x7f0b8c06d9c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0b90009560 tx=0x7f0b90009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:37.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.035+0000 7f0b87fff640 1 -- 172.21.15.7:0/1893626578 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0b98058730 con 0x7f0ba00d08d0 2024-04-25T10:02:37.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.258+0000 7f0ba5c15640 1 -- 172.21.15.7:0/1893626578 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ba0159f30 con 0x7f0ba00d08d0 2024-04-25T10:02:37.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.259+0000 7f0b87fff640 1 -- 172.21.15.7:0/1893626578 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f0b9805c7d0 con 0x7f0ba00d08d0 2024-04-25T10:02:37.264 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:02:37.264 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":66,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2505539422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2505539422},{"type":"v1","addr":"172.21.15.55:6834","nonce":2505539422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2808857776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2808857776},{"type":"v1","addr":"172.21.15.55:6835","nonce":2808857776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7518,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1796103144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1796103144},{"type":"v1","addr":"172.21.15.7:6835","nonce":1796103144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:00:34.054759+0000","modified":"2024-04-25T10:01:57.949246+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8022},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8022":{"gid":8022,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6837/1061077733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1061077733},{"type":"v1","addr":"172.21.15.7:6837","nonce":1061077733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:02:37.265 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 66 2024-04-25T10:02:37.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.261+0000 7f0ba5c15640 1 -- 172.21.15.7:0/1893626578 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0b8c06b500 msgr2=0x7f0b8c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:37.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.261+0000 7f0ba5c15640 1 --2- 172.21.15.7:0/1893626578 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0b8c06b500 0x7f0b8c06d9c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0b90009560 tx=0x7f0b90009190 comp rx=0 tx=0).stop 2024-04-25T10:02:37.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.261+0000 7f0ba5c15640 1 -- 172.21.15.7:0/1893626578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ba00d08d0 msgr2=0x7f0ba01574c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:37.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.261+0000 7f0ba5c15640 1 --2- 172.21.15.7:0/1893626578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ba00d08d0 0x7f0ba01574c0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f0b9800caa0 tx=0x7f0b9800cf60 comp rx=0 tx=0).stop 2024-04-25T10:02:37.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.261+0000 7f0ba5c15640 1 -- 172.21.15.7:0/1893626578 shutdown_connections 2024-04-25T10:02:37.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.261+0000 7f0ba5c15640 1 --2- 172.21.15.7:0/1893626578 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0b8c06b500 0x7f0b8c06d9c0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:37.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.261+0000 7f0ba5c15640 1 --2- 172.21.15.7:0/1893626578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ba00d08d0 0x7f0ba01574c0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:37.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.261+0000 7f0ba5c15640 1 --2- 172.21.15.7:0/1893626578 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ba00cd740 0x7f0ba00aea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:37.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.261+0000 7f0ba5c15640 1 --2- 172.21.15.7:0/1893626578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ba006cbc0 0x7f0ba00b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:37.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.261+0000 7f0ba5c15640 1 -- 172.21.15.7:0/1893626578 >> 172.21.15.7:0/1893626578 conn(0x7f0ba00b3130 msgr2=0x7f0ba006d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:37.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.261+0000 7f0ba5c15640 1 -- 172.21.15.7:0/1893626578 shutdown_connections 2024-04-25T10:02:37.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.261+0000 7f0ba5c15640 1 -- 172.21.15.7:0/1893626578 wait complete. 2024-04-25T10:02:37.277 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:02:37.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.372+0000 7f27662b6640 1 Processor -- start 2024-04-25T10:02:37.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.372+0000 7f27662b6640 1 -- start start 2024-04-25T10:02:37.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.373+0000 7f27662b6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f27600cd740 0x7f27600d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:37.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.373+0000 7f27662b6640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f276006cd90 0x7f27600cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:37.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.373+0000 7f27662b6640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2760099b90 con 0x7f27600d08d0 2024-04-25T10:02:37.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.373+0000 7f27662b6640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27600cdb20 con 0x7f276006cd90 2024-04-25T10:02:37.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.373+0000 7f27662b6640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2760099e70 con 0x7f27600cd740 2024-04-25T10:02:37.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.373+0000 7f2764853640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f276006cd90 0x7f27600cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:37.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.373+0000 7f2764853640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f276006cd90 0x7f27600cbc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48578/0 (socket says 172.21.15.7:48578) 2024-04-25T10:02:37.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.373+0000 7f2764853640 1 -- 172.21.15.7:0/462359960 learned_addr learned my addr 172.21.15.7:0/462359960 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:37.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.374+0000 7f275ffff640 1 --2- 172.21.15.7:0/462359960 >> v2:172.21.15.55:3300/0 conn(0x7f27600cd740 0x7f27600d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:37.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.374+0000 7f2764853640 1 -- 172.21.15.7:0/462359960 >> v2:172.21.15.55:3300/0 conn(0x7f27600cd740 msgr2=0x7f27600d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:37.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.374+0000 7f2764853640 1 --2- 172.21.15.7:0/462359960 >> v2:172.21.15.55:3300/0 conn(0x7f27600cd740 0x7f27600d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:37.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.374+0000 7f2764853640 1 -- 172.21.15.7:0/462359960 >> v1:172.21.15.55:6789/0 conn(0x7f27600d08d0 legacy=0x7f276006c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:37.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.374+0000 7f2764853640 1 -- 172.21.15.7:0/462359960 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276009a150 con 0x7f276006cd90 2024-04-25T10:02:37.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.374+0000 7f2764853640 1 --2- 172.21.15.7:0/462359960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f276006cd90 0x7f27600cbc90 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f276006ebf0 tx=0x7f275802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf08c2e5f47108d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:37.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.375+0000 7f275effd640 1 -- 172.21.15.7:0/462359960 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2758036070 con 0x7f276006cd90 2024-04-25T10:02:37.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.375+0000 7f275effd640 1 -- 172.21.15.7:0/462359960 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2758031600 con 0x7f276006cd90 2024-04-25T10:02:37.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.375+0000 7f275effd640 1 -- 172.21.15.7:0/462359960 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27580319d0 con 0x7f276006cd90 2024-04-25T10:02:37.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.375+0000 7f27662b6640 1 -- 172.21.15.7:0/462359960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f276006cd90 msgr2=0x7f27600cbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:37.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.375+0000 7f27662b6640 1 --2- 172.21.15.7:0/462359960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f276006cd90 0x7f27600cbc90 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f276006ebf0 tx=0x7f275802a730 comp rx=0 tx=0).stop 2024-04-25T10:02:37.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.375+0000 7f27662b6640 1 -- 172.21.15.7:0/462359960 shutdown_connections 2024-04-25T10:02:37.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.375+0000 7f27662b6640 1 --2- 172.21.15.7:0/462359960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f276006cd90 0x7f27600cbc90 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:37.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.375+0000 7f27662b6640 1 --2- 172.21.15.7:0/462359960 >> v2:172.21.15.55:3300/0 conn(0x7f27600cd740 0x7f27600d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:37.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.375+0000 7f27662b6640 1 -- 172.21.15.7:0/462359960 >> 172.21.15.7:0/462359960 conn(0x7f27600b3130 msgr2=0x7f27600b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:37.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.375+0000 7f27662b6640 1 -- 172.21.15.7:0/462359960 shutdown_connections 2024-04-25T10:02:37.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.375+0000 7f27662b6640 1 -- 172.21.15.7:0/462359960 wait complete. 2024-04-25T10:02:37.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.376+0000 7f27662b6640 1 Processor -- start 2024-04-25T10:02:37.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.377+0000 7f27662b6640 1 -- start start 2024-04-25T10:02:37.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.377+0000 7f27662b6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f276006cd90 0x7f27600b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:37.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.377+0000 7f27662b6640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f27600cd740 0x7f27600b5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:37.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.377+0000 7f27662b6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27600d08d0 0x7f276014d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:37.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.377+0000 7f27662b6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276009ac30 con 0x7f276006cd90 2024-04-25T10:02:37.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.377+0000 7f27662b6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276009a710 con 0x7f27600d08d0 2024-04-25T10:02:37.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.377+0000 7f27662b6640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f276009adb0 con 0x7f27600cd740 2024-04-25T10:02:37.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.377+0000 7f275ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f276006cd90 0x7f27600b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:37.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.377+0000 7f275ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f276006cd90 0x7f27600b53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48592/0 (socket says 172.21.15.7:48592) 2024-04-25T10:02:37.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.377+0000 7f275ffff640 1 -- 172.21.15.7:0/26308281 learned_addr learned my addr 172.21.15.7:0/26308281 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:37.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.378+0000 7f2764853640 1 --2- 172.21.15.7:0/26308281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27600d08d0 0x7f276014d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:37.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.378+0000 7f275f7fe640 1 --2- 172.21.15.7:0/26308281 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f27600cd740 0x7f27600b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:37.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.378+0000 7f275ffff640 1 -- 172.21.15.7:0/26308281 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f27600cd740 msgr2=0x7f27600b5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:37.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.378+0000 7f275ffff640 1 --2- 172.21.15.7:0/26308281 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f27600cd740 0x7f27600b5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:37.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.378+0000 7f275ffff640 1 -- 172.21.15.7:0/26308281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27600d08d0 msgr2=0x7f276014d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:37.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.378+0000 7f275ffff640 1 --2- 172.21.15.7:0/26308281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27600d08d0 0x7f276014d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:37.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.378+0000 7f275ffff640 1 -- 172.21.15.7:0/26308281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276014e6a0 con 0x7f276006cd90 2024-04-25T10:02:37.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.378+0000 7f2764853640 1 --2- 172.21.15.7:0/26308281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27600d08d0 0x7f276014d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:02:37.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.378+0000 7f275f7fe640 1 --2- 172.21.15.7:0/26308281 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f27600cd740 0x7f27600b5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:02:37.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.378+0000 7f275ffff640 1 --2- 172.21.15.7:0/26308281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f276006cd90 0x7f27600b53c0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f275000e9e0 tx=0x7f275000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:37.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.378+0000 7f275cff9640 1 -- 172.21.15.7:0/26308281 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2750017070 con 0x7f276006cd90 2024-04-25T10:02:37.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.378+0000 7f275cff9640 1 -- 172.21.15.7:0/26308281 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275000c9d0 con 0x7f276006cd90 2024-04-25T10:02:37.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.378+0000 7f27662b6640 1 -- 172.21.15.7:0/26308281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f276014e980 con 0x7f276006cd90 2024-04-25T10:02:37.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.378+0000 7f275cff9640 1 -- 172.21.15.7:0/26308281 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275000cdc0 con 0x7f276006cd90 2024-04-25T10:02:37.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.378+0000 7f27662b6640 1 -- 172.21.15.7:0/26308281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f276014ef40 con 0x7f276006cd90 2024-04-25T10:02:37.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.379+0000 7f27662b6640 1 -- 172.21.15.7:0/26308281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2760068fd0 con 0x7f276006cd90 2024-04-25T10:02:37.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.380+0000 7f275cff9640 1 -- 172.21.15.7:0/26308281 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f275001a070 con 0x7f276006cd90 2024-04-25T10:02:37.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.380+0000 7f275cff9640 1 --2- 172.21.15.7:0/26308281 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f274c06b500 0x7f274c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:37.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.380+0000 7f275cff9640 1 -- 172.21.15.7:0/26308281 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f275008a860 con 0x7f276006cd90 2024-04-25T10:02:37.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.380+0000 7f275f7fe640 1 --2- 172.21.15.7:0/26308281 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f274c06b500 0x7f274c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:37.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.381+0000 7f275f7fe640 1 --2- 172.21.15.7:0/26308281 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f274c06b500 0x7f274c06d9c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f276009b7d0 tx=0x7f2754009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:37.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.384+0000 7f275cff9640 1 -- 172.21.15.7:0/26308281 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2750059430 con 0x7f276006cd90 2024-04-25T10:02:37.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.604+0000 7f27662b6640 1 -- 172.21.15.7:0/26308281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2760159480 con 0x7f276006cd90 2024-04-25T10:02:37.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.605+0000 7f275cff9640 1 -- 172.21.15.7:0/26308281 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f2750058d30 con 0x7f276006cd90 2024-04-25T10:02:37.610 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:02:37.610 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":66,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2505539422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2505539422},{"type":"v1","addr":"172.21.15.55:6834","nonce":2505539422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2808857776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2808857776},{"type":"v1","addr":"172.21.15.55:6835","nonce":2808857776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7518,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1796103144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1796103144},{"type":"v1","addr":"172.21.15.7:6835","nonce":1796103144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:00:34.054759+0000","modified":"2024-04-25T10:01:57.949246+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8022},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8022":{"gid":8022,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6837/1061077733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1061077733},{"type":"v1","addr":"172.21.15.7:6837","nonce":1061077733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:02:37.610 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 66 2024-04-25T10:02:37.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.607+0000 7f27662b6640 1 -- 172.21.15.7:0/26308281 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f274c06b500 msgr2=0x7f274c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:37.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.607+0000 7f27662b6640 1 --2- 172.21.15.7:0/26308281 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f274c06b500 0x7f274c06d9c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f276009b7d0 tx=0x7f2754009040 comp rx=0 tx=0).stop 2024-04-25T10:02:37.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.607+0000 7f27662b6640 1 -- 172.21.15.7:0/26308281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f276006cd90 msgr2=0x7f27600b53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:37.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.607+0000 7f27662b6640 1 --2- 172.21.15.7:0/26308281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f276006cd90 0x7f27600b53c0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f275000e9e0 tx=0x7f275000eea0 comp rx=0 tx=0).stop 2024-04-25T10:02:37.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.607+0000 7f27662b6640 1 -- 172.21.15.7:0/26308281 shutdown_connections 2024-04-25T10:02:37.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.607+0000 7f27662b6640 1 --2- 172.21.15.7:0/26308281 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f274c06b500 0x7f274c06d9c0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:37.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.607+0000 7f27662b6640 1 --2- 172.21.15.7:0/26308281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27600d08d0 0x7f276014d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:37.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.607+0000 7f27662b6640 1 --2- 172.21.15.7:0/26308281 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f27600cd740 0x7f27600b5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:37.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.607+0000 7f27662b6640 1 --2- 172.21.15.7:0/26308281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f276006cd90 0x7f27600b53c0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:37.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.607+0000 7f27662b6640 1 -- 172.21.15.7:0/26308281 >> 172.21.15.7:0/26308281 conn(0x7f27600b3130 msgr2=0x7f276006f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:37.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.607+0000 7f27662b6640 1 -- 172.21.15.7:0/26308281 shutdown_connections 2024-04-25T10:02:37.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.607+0000 7f27662b6640 1 -- 172.21.15.7:0/26308281 wait complete. 2024-04-25T10:02:37.622 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:02:37.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.718+0000 7fdcd96d8640 1 Processor -- start 2024-04-25T10:02:37.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.718+0000 7fdcd96d8640 1 -- start start 2024-04-25T10:02:37.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.719+0000 7fdcd96d8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdcd415db00 0x7fdcd40d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:37.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.719+0000 7fdcd96d8640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdcd40b53b0 0x7fdcd40d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:37.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.719+0000 7fdcd96d8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcd40d1e80 con 0x7fdcd40ce2b0 2024-04-25T10:02:37.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.719+0000 7fdcd96d8640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd40b5930 con 0x7fdcd40b53b0 2024-04-25T10:02:37.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.719+0000 7fdcd96d8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd40b5c10 con 0x7fdcd415db00 2024-04-25T10:02:37.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.719+0000 7fdccbfff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdcd40b53b0 0x7fdcd40d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:37.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.719+0000 7fdccbfff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdcd40b53b0 0x7fdcd40d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48604/0 (socket says 172.21.15.7:48604) 2024-04-25T10:02:37.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.719+0000 7fdccbfff640 1 -- 172.21.15.7:0/738276569 learned_addr learned my addr 172.21.15.7:0/738276569 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:37.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.719+0000 7fdcd2ffd640 1 --2- 172.21.15.7:0/738276569 >> v2:172.21.15.55:3300/0 conn(0x7fdcd415db00 0x7fdcd40d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:37.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.720+0000 7fdccbfff640 1 -- 172.21.15.7:0/738276569 >> v2:172.21.15.55:3300/0 conn(0x7fdcd415db00 msgr2=0x7fdcd40d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:37.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.720+0000 7fdccbfff640 1 --2- 172.21.15.7:0/738276569 >> v2:172.21.15.55:3300/0 conn(0x7fdcd415db00 0x7fdcd40d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:37.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.720+0000 7fdccbfff640 1 -- 172.21.15.7:0/738276569 >> v1:172.21.15.55:6789/0 conn(0x7fdcd40ce2b0 legacy=0x7fdcd4161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:37.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.720+0000 7fdccbfff640 1 -- 172.21.15.7:0/738276569 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd40b5ef0 con 0x7fdcd40b53b0 2024-04-25T10:02:37.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.720+0000 7fdccbfff640 1 --2- 172.21.15.7:0/738276569 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdcd40b53b0 0x7fdcd40d0880 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40d4940 tx=0x7fdcbc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c8d4a79ee18ef9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:37.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.721+0000 7fdcd27fc640 1 -- 172.21.15.7:0/738276569 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc037070 con 0x7fdcd40b53b0 2024-04-25T10:02:37.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.721+0000 7fdcd27fc640 1 -- 172.21.15.7:0/738276569 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcbc032440 con 0x7fdcd40b53b0 2024-04-25T10:02:37.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.721+0000 7fdcd27fc640 1 -- 172.21.15.7:0/738276569 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc032810 con 0x7fdcd40b53b0 2024-04-25T10:02:37.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.721+0000 7fdcd96d8640 1 -- 172.21.15.7:0/738276569 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdcd40b53b0 msgr2=0x7fdcd40d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:37.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.721+0000 7fdcd96d8640 1 --2- 172.21.15.7:0/738276569 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdcd40b53b0 0x7fdcd40d0880 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40d4940 tx=0x7fdcbc02a270 comp rx=0 tx=0).stop 2024-04-25T10:02:37.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.721+0000 7fdcd96d8640 1 -- 172.21.15.7:0/738276569 shutdown_connections 2024-04-25T10:02:37.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.721+0000 7fdcd96d8640 1 --2- 172.21.15.7:0/738276569 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdcd40b53b0 0x7fdcd40d0880 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:37.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.721+0000 7fdcd96d8640 1 --2- 172.21.15.7:0/738276569 >> v2:172.21.15.55:3300/0 conn(0x7fdcd415db00 0x7fdcd40d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:37.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.721+0000 7fdcd96d8640 1 -- 172.21.15.7:0/738276569 >> 172.21.15.7:0/738276569 conn(0x7fdcd4072290 msgr2=0x7fdcd40726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:37.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.721+0000 7fdcd96d8640 1 -- 172.21.15.7:0/738276569 shutdown_connections 2024-04-25T10:02:37.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.721+0000 7fdcd96d8640 1 -- 172.21.15.7:0/738276569 wait complete. 2024-04-25T10:02:37.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.722+0000 7fdcd96d8640 1 Processor -- start 2024-04-25T10:02:37.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.722+0000 7fdcd96d8640 1 -- start start 2024-04-25T10:02:37.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.723+0000 7fdcd96d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcd40b53b0 0x7fdcd40c7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:37.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.723+0000 7fdcd96d8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdcd40ce2b0 0x7fdcd40c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:37.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.723+0000 7fdcd96d8640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdcd415db00 0x7fdcd4160240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:37.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.723+0000 7fdcd96d8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd40d3660 con 0x7fdcd40ce2b0 2024-04-25T10:02:37.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.723+0000 7fdcd96d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd40b61d0 con 0x7fdcd40b53b0 2024-04-25T10:02:37.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.723+0000 7fdcd96d8640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd40b6c10 con 0x7fdcd415db00 2024-04-25T10:02:37.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.723+0000 7fdccbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdcd40ce2b0 0x7fdcd40c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:37.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.723+0000 7fdccbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdcd40ce2b0 0x7fdcd40c9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48618/0 (socket says 172.21.15.7:48618) 2024-04-25T10:02:37.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.723+0000 7fdccbfff640 1 -- 172.21.15.7:0/2646205509 learned_addr learned my addr 172.21.15.7:0/2646205509 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:37.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.723+0000 7fdcd2ffd640 1 --2- 172.21.15.7:0/2646205509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcd40b53b0 0x7fdcd40c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:37.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.723+0000 7fdcd37fe640 1 --2- 172.21.15.7:0/2646205509 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdcd415db00 0x7fdcd4160240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:37.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.723+0000 7fdccbfff640 1 -- 172.21.15.7:0/2646205509 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdcd415db00 msgr2=0x7fdcd4160240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:37.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.723+0000 7fdccbfff640 1 --2- 172.21.15.7:0/2646205509 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdcd415db00 0x7fdcd4160240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:37.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.723+0000 7fdccbfff640 1 -- 172.21.15.7:0/2646205509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcd40b53b0 msgr2=0x7fdcd40c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:37.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.723+0000 7fdccbfff640 1 --2- 172.21.15.7:0/2646205509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcd40b53b0 0x7fdcd40c7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:37.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.723+0000 7fdccbfff640 1 -- 172.21.15.7:0/2646205509 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd414d2b0 con 0x7fdcd40ce2b0 2024-04-25T10:02:37.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.724+0000 7fdcd37fe640 1 --2- 172.21.15.7:0/2646205509 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdcd415db00 0x7fdcd4160240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:02:37.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.724+0000 7fdccbfff640 1 --2- 172.21.15.7:0/2646205509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdcd40ce2b0 0x7fdcd40c9e20 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc000c00 tx=0x7fdcbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:37.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.724+0000 7fdccb7fe640 1 -- 172.21.15.7:0/2646205509 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc037040 con 0x7fdcd40ce2b0 2024-04-25T10:02:37.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.724+0000 7fdccb7fe640 1 -- 172.21.15.7:0/2646205509 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcbc042070 con 0x7fdcd40ce2b0 2024-04-25T10:02:37.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.724+0000 7fdcd96d8640 1 -- 172.21.15.7:0/2646205509 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd415f1a0 con 0x7fdcd40ce2b0 2024-04-25T10:02:37.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.724+0000 7fdccb7fe640 1 -- 172.21.15.7:0/2646205509 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc030880 con 0x7fdcd40ce2b0 2024-04-25T10:02:37.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.724+0000 7fdcd96d8640 1 -- 172.21.15.7:0/2646205509 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd415f760 con 0x7fdcd40ce2b0 2024-04-25T10:02:37.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.725+0000 7fdcd96d8640 1 -- 172.21.15.7:0/2646205509 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd4068fd0 con 0x7fdcd40ce2b0 2024-04-25T10:02:37.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.725+0000 7fdccb7fe640 1 -- 172.21.15.7:0/2646205509 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdcbc030a20 con 0x7fdcd40ce2b0 2024-04-25T10:02:37.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.726+0000 7fdccb7fe640 1 --2- 172.21.15.7:0/2646205509 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdcb406b500 0x7fdcb406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:37.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.726+0000 7fdccb7fe640 1 -- 172.21.15.7:0/2646205509 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fdcbc0aac40 con 0x7fdcd40ce2b0 2024-04-25T10:02:37.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.726+0000 7fdcd2ffd640 1 --2- 172.21.15.7:0/2646205509 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdcb406b500 0x7fdcb406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:37.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.726+0000 7fdcd2ffd640 1 --2- 172.21.15.7:0/2646205509 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdcb406b500 0x7fdcb406d9c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4009aa0 tx=0x7fdcc4009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:37.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.730+0000 7fdccb7fe640 1 -- 172.21.15.7:0/2646205509 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdcbc079810 con 0x7fdcd40ce2b0 2024-04-25T10:02:37.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.910+0000 7fdcd96d8640 1 -- 172.21.15.7:0/2646205509 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdcd40cdcb0 con 0x7fdcd40ce2b0 2024-04-25T10:02:37.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.911+0000 7fdccb7fe640 1 -- 172.21.15.7:0/2646205509 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+17238 (secure 0 0 0) 0x7fdcbc079110 con 0x7fdcd40ce2b0 2024-04-25T10:02:37.916 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:02:37.917 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":92,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:01:54.932383+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:00:32.330930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T10:00:33.030728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1b","mappings":[{"from":1,"to":7}]},{"pgid":"14.2c","mappings":[{"from":1,"to":5}]},{"pgid":"14.31","mappings":[{"from":1,"to":7}]},{"pgid":"14.32","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6837/3829085443":"2024-04-26T10:01:54.932349+0000","172.21.15.7:6836/3829085443":"2024-04-26T10:01:54.932349+0000","172.21.15.7:6837/2878753733":"2024-04-26T10:00:43.379350+0000","172.21.15.7:6836/2878753733":"2024-04-26T10:00:43.379350+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:02:37.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.914+0000 7fdcd96d8640 1 -- 172.21.15.7:0/2646205509 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdcb406b500 msgr2=0x7fdcb406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:37.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.914+0000 7fdcd96d8640 1 --2- 172.21.15.7:0/2646205509 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdcb406b500 0x7fdcb406d9c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4009aa0 tx=0x7fdcc4009190 comp rx=0 tx=0).stop 2024-04-25T10:02:37.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.914+0000 7fdcd96d8640 1 -- 172.21.15.7:0/2646205509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdcd40ce2b0 msgr2=0x7fdcd40c9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:37.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.914+0000 7fdcd96d8640 1 --2- 172.21.15.7:0/2646205509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdcd40ce2b0 0x7fdcd40c9e20 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc000c00 tx=0x7fdcbc0046c0 comp rx=0 tx=0).stop 2024-04-25T10:02:37.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.914+0000 7fdcd96d8640 1 -- 172.21.15.7:0/2646205509 shutdown_connections 2024-04-25T10:02:37.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.914+0000 7fdcd96d8640 1 --2- 172.21.15.7:0/2646205509 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdcb406b500 0x7fdcb406d9c0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:37.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.914+0000 7fdcd96d8640 1 --2- 172.21.15.7:0/2646205509 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdcd415db00 0x7fdcd4160240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:37.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.914+0000 7fdcd96d8640 1 --2- 172.21.15.7:0/2646205509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdcd40ce2b0 0x7fdcd40c9e20 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:37.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.914+0000 7fdcd96d8640 1 --2- 172.21.15.7:0/2646205509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcd40b53b0 0x7fdcd40c7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:37.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.914+0000 7fdcd96d8640 1 -- 172.21.15.7:0/2646205509 >> 172.21.15.7:0/2646205509 conn(0x7fdcd4072290 msgr2=0x7fdcd40cf600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:37.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.914+0000 7fdcd96d8640 1 -- 172.21.15.7:0/2646205509 shutdown_connections 2024-04-25T10:02:37.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:37.914+0000 7fdcd96d8640 1 -- 172.21.15.7:0/2646205509 wait complete. 2024-04-25T10:02:37.930 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T10:02:38.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.028+0000 7fdc93c53640 1 Processor -- start 2024-04-25T10:02:38.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.029+0000 7fdc93c53640 1 -- start start 2024-04-25T10:02:38.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.029+0000 7fdc93c53640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdc8c0cd740 0x7fdc8c0d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:38.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.029+0000 7fdc93c53640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdc8c0d08d0 0x7fdc8c06c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:38.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.029+0000 7fdc93c53640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc8c099b90 con 0x7fdc8c06cbc0 2024-04-25T10:02:38.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.029+0000 7fdc93c53640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc8c0cdb20 con 0x7fdc8c0cd740 2024-04-25T10:02:38.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.029+0000 7fdc93c53640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc8c0ccca0 con 0x7fdc8c0d08d0 2024-04-25T10:02:38.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.030+0000 7fdc919ef640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdc8c0cd740 0x7fdc8c0d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:38.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.030+0000 7fdc919ef640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdc8c0cd740 0x7fdc8c0d0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48626/0 (socket says 172.21.15.7:48626) 2024-04-25T10:02:38.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.030+0000 7fdc919ef640 1 -- 172.21.15.7:0/1736964472 learned_addr learned my addr 172.21.15.7:0/1736964472 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:38.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.030+0000 7fdc911ee640 1 --2- 172.21.15.7:0/1736964472 >> v2:172.21.15.55:3300/0 conn(0x7fdc8c0d08d0 0x7fdc8c06c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:38.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.030+0000 7fdc919ef640 1 -- 172.21.15.7:0/1736964472 >> v2:172.21.15.55:3300/0 conn(0x7fdc8c0d08d0 msgr2=0x7fdc8c06c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:38.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.030+0000 7fdc919ef640 1 --2- 172.21.15.7:0/1736964472 >> v2:172.21.15.55:3300/0 conn(0x7fdc8c0d08d0 0x7fdc8c06c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:38.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.030+0000 7fdc919ef640 1 -- 172.21.15.7:0/1736964472 >> v1:172.21.15.55:6789/0 conn(0x7fdc8c06cbc0 legacy=0x7fdc8c161830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:38.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.030+0000 7fdc919ef640 1 -- 172.21.15.7:0/1736964472 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8c099e70 con 0x7fdc8c0cd740 2024-04-25T10:02:38.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.031+0000 7fdc919ef640 1 --2- 172.21.15.7:0/1736964472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc8c0cd740 0x7fdc8c0d0390 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c0722b0 tx=0x7fdc8802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da07486ac042aa9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:38.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.031+0000 7fdc909ed640 1 -- 172.21.15.7:0/1736964472 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc88037070 con 0x7fdc8c0cd740 2024-04-25T10:02:38.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.031+0000 7fdc909ed640 1 -- 172.21.15.7:0/1736964472 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc88032440 con 0x7fdc8c0cd740 2024-04-25T10:02:38.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.031+0000 7fdc909ed640 1 -- 172.21.15.7:0/1736964472 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc88032810 con 0x7fdc8c0cd740 2024-04-25T10:02:38.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.031+0000 7fdc93c53640 1 -- 172.21.15.7:0/1736964472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc8c0cd740 msgr2=0x7fdc8c0d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:38.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.031+0000 7fdc93c53640 1 --2- 172.21.15.7:0/1736964472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc8c0cd740 0x7fdc8c0d0390 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c0722b0 tx=0x7fdc8802a270 comp rx=0 tx=0).stop 2024-04-25T10:02:38.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.031+0000 7fdc93c53640 1 -- 172.21.15.7:0/1736964472 shutdown_connections 2024-04-25T10:02:38.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.031+0000 7fdc93c53640 1 --2- 172.21.15.7:0/1736964472 >> v2:172.21.15.55:3300/0 conn(0x7fdc8c0d08d0 0x7fdc8c06c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:38.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.031+0000 7fdc93c53640 1 --2- 172.21.15.7:0/1736964472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc8c0cd740 0x7fdc8c0d0390 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:38.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.031+0000 7fdc93c53640 1 -- 172.21.15.7:0/1736964472 >> 172.21.15.7:0/1736964472 conn(0x7fdc8c0b3130 msgr2=0x7fdc8c0b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:38.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.031+0000 7fdc93c53640 1 -- 172.21.15.7:0/1736964472 shutdown_connections 2024-04-25T10:02:38.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.031+0000 7fdc93c53640 1 -- 172.21.15.7:0/1736964472 wait complete. 2024-04-25T10:02:38.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.033+0000 7fdc93c53640 1 Processor -- start 2024-04-25T10:02:38.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.033+0000 7fdc93c53640 1 -- start start 2024-04-25T10:02:38.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.033+0000 7fdc93c53640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc8c06cbc0 0x7fdc8c1576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:38.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.033+0000 7fdc93c53640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc8c0cd740 0x7fdc8c1596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:38.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.033+0000 7fdc93c53640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdc8c0d08d0 0x7fdc8c0b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:38.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.033+0000 7fdc93c53640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c09a430 con 0x7fdc8c0cd740 2024-04-25T10:02:38.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.033+0000 7fdc93c53640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c06cff0 con 0x7fdc8c06cbc0 2024-04-25T10:02:38.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.033+0000 7fdc93c53640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c09a710 con 0x7fdc8c0d08d0 2024-04-25T10:02:38.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.033+0000 7fdc911ee640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc8c0cd740 0x7fdc8c1596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:38.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.033+0000 7fdc911ee640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc8c0cd740 0x7fdc8c1596f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48628/0 (socket says 172.21.15.7:48628) 2024-04-25T10:02:38.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.033+0000 7fdc911ee640 1 -- 172.21.15.7:0/419247278 learned_addr learned my addr 172.21.15.7:0/419247278 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:38.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.034+0000 7fdc921f0640 1 --2- 172.21.15.7:0/419247278 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdc8c0d08d0 0x7fdc8c0b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:38.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.034+0000 7fdc919ef640 1 --2- 172.21.15.7:0/419247278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc8c06cbc0 0x7fdc8c1576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:38.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.034+0000 7fdc911ee640 1 -- 172.21.15.7:0/419247278 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdc8c0d08d0 msgr2=0x7fdc8c0b61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:38.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.034+0000 7fdc911ee640 1 --2- 172.21.15.7:0/419247278 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdc8c0d08d0 0x7fdc8c0b61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:38.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.034+0000 7fdc911ee640 1 -- 172.21.15.7:0/419247278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc8c06cbc0 msgr2=0x7fdc8c1576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:38.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.034+0000 7fdc911ee640 1 --2- 172.21.15.7:0/419247278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc8c06cbc0 0x7fdc8c1576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:38.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.034+0000 7fdc911ee640 1 -- 172.21.15.7:0/419247278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8c15a3b0 con 0x7fdc8c0cd740 2024-04-25T10:02:38.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.034+0000 7fdc911ee640 1 --2- 172.21.15.7:0/419247278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc8c0cd740 0x7fdc8c1596f0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c00e870 tx=0x7fdc7c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:38.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.034+0000 7fdc827fc640 1 -- 172.21.15.7:0/419247278 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c017070 con 0x7fdc8c0cd740 2024-04-25T10:02:38.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.034+0000 7fdc827fc640 1 -- 172.21.15.7:0/419247278 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7c00c940 con 0x7fdc8c0cd740 2024-04-25T10:02:38.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.034+0000 7fdc93c53640 1 -- 172.21.15.7:0/419247278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc8c15a0d0 con 0x7fdc8c0cd740 2024-04-25T10:02:38.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.034+0000 7fdc827fc640 1 -- 172.21.15.7:0/419247278 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c00cd30 con 0x7fdc8c0cd740 2024-04-25T10:02:38.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.034+0000 7fdc93c53640 1 -- 172.21.15.7:0/419247278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc8c1f3f00 con 0x7fdc8c0cd740 2024-04-25T10:02:38.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.035+0000 7fdc93c53640 1 -- 172.21.15.7:0/419247278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc8c068fd0 con 0x7fdc8c0cd740 2024-04-25T10:02:38.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.036+0000 7fdc827fc640 1 -- 172.21.15.7:0/419247278 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdc7c01a070 con 0x7fdc8c0cd740 2024-04-25T10:02:38.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.036+0000 7fdc827fc640 1 --2- 172.21.15.7:0/419247278 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdc7006b500 0x7fdc7006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:38.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.036+0000 7fdc827fc640 1 -- 172.21.15.7:0/419247278 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fdc7c08a290 con 0x7fdc8c0cd740 2024-04-25T10:02:38.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.036+0000 7fdc919ef640 1 --2- 172.21.15.7:0/419247278 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdc7006b500 0x7fdc7006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:38.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.036+0000 7fdc919ef640 1 --2- 172.21.15.7:0/419247278 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdc7006b500 0x7fdc7006d9c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fdc88034000 tx=0x7fdc8802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:38.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.040+0000 7fdc827fc640 1 -- 172.21.15.7:0/419247278 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdc7c058ef0 con 0x7fdc8c0cd740 2024-04-25T10:02:38.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.258+0000 7fdc93c53640 1 -- 172.21.15.7:0/419247278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdc8c0b4040 con 0x7fdc8c0cd740 2024-04-25T10:02:38.266 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-04-25T10:02:38.259+0000 7f45ad572640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T10:02:38.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.260+0000 7fdc827fc640 1 -- 172.21.15.7:0/419247278 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v67) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdc7c0587f0 con 0x7fdc8c0cd740 2024-04-25T10:02:38.267 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T10:02:38.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.263+0000 7fdc93c53640 1 -- 172.21.15.7:0/419247278 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdc7006b500 msgr2=0x7fdc7006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:38.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.263+0000 7fdc93c53640 1 --2- 172.21.15.7:0/419247278 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdc7006b500 0x7fdc7006d9c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fdc88034000 tx=0x7fdc8802e000 comp rx=0 tx=0).stop 2024-04-25T10:02:38.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.263+0000 7fdc93c53640 1 -- 172.21.15.7:0/419247278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc8c0cd740 msgr2=0x7fdc8c1596f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:38.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.263+0000 7fdc93c53640 1 --2- 172.21.15.7:0/419247278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc8c0cd740 0x7fdc8c1596f0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c00e870 tx=0x7fdc7c00ed30 comp rx=0 tx=0).stop 2024-04-25T10:02:38.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.263+0000 7fdc93c53640 1 -- 172.21.15.7:0/419247278 shutdown_connections 2024-04-25T10:02:38.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.263+0000 7fdc93c53640 1 --2- 172.21.15.7:0/419247278 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdc7006b500 0x7fdc7006d9c0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:38.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.263+0000 7fdc93c53640 1 --2- 172.21.15.7:0/419247278 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdc8c0d08d0 0x7fdc8c0b61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:38.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.263+0000 7fdc93c53640 1 --2- 172.21.15.7:0/419247278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc8c0cd740 0x7fdc8c1596f0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:38.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.263+0000 7fdc93c53640 1 --2- 172.21.15.7:0/419247278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc8c06cbc0 0x7fdc8c1576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:38.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.264+0000 7fdc93c53640 1 -- 172.21.15.7:0/419247278 >> 172.21.15.7:0/419247278 conn(0x7fdc8c0b3130 msgr2=0x7fdc8c0ce030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:38.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.264+0000 7fdc93c53640 1 -- 172.21.15.7:0/419247278 shutdown_connections 2024-04-25T10:02:38.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.264+0000 7fdc93c53640 1 -- 172.21.15.7:0/419247278 wait complete. 2024-04-25T10:02:38.270 INFO:tasks.ceph.mds.a.smithi007.stderr: -2297> 2024-04-25T10:02:00.940+0000 7f37733a0640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:02:38.270 INFO:tasks.ceph.mds.a.smithi007.stderr: -1905> 2024-04-25T10:02:01.595+0000 7f376f398640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [...2,head] /dir/file auth v1 ap=1 DIRTYPARENT s=0 nl=2 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55deb258a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(14)0x10000000001:[<0x10000000000/file v8>,<0x1/dir v15>]//[]","memoryvalue":"(14)0x10000000001:[<0x10000000000/file v1>,<0x1/dir v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T10:02:38.281 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T10:02:38.298 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-04-25T10:02:38.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.380+0000 7fb2b55b7640 1 Processor -- start 2024-04-25T10:02:38.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.380+0000 7fb2b55b7640 1 -- start start 2024-04-25T10:02:38.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.381+0000 7fb2b55b7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb2b00ce680 0x7fb2b00ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:38.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.381+0000 7fb2b55b7640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b00cf050 con 0x7fb2b015db30 2024-04-25T10:02:38.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.381+0000 7fb2b55b7640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b015df10 con 0x7fb2b00b6a70 2024-04-25T10:02:38.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.381+0000 7fb2b55b7640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b00d1780 con 0x7fb2b00ce680 2024-04-25T10:02:38.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.381+0000 7fb2aeffd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb2b015db30 0x7fb2b00d0440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40788/0 (socket says 172.21.15.7:40788) 2024-04-25T10:02:38.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.381+0000 7fb2aeffd640 1 -- 172.21.15.7:0/2278708514 learned_addr learned my addr 172.21.15.7:0/2278708514 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:02:38.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.381+0000 7fb2ae7fc640 1 --2- 172.21.15.7:0/2278708514 >> v2:172.21.15.55:3300/0 conn(0x7fb2b00ce680 0x7fb2b00ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:38.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.381+0000 7fb2adffb640 1 -- 172.21.15.7:0/2278708514 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 599381553 0 0) 0x7fb2b00cf050 con 0x7fb2b015db30 2024-04-25T10:02:38.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.381+0000 7fb2adffb640 1 -- 172.21.15.7:0/2278708514 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb298003520 con 0x7fb2b015db30 2024-04-25T10:02:38.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.381+0000 7fb2adffb640 1 -- 172.21.15.7:0/2278708514 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 654597107 0 0) 0x7fb298003520 con 0x7fb2b015db30 2024-04-25T10:02:38.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.381+0000 7fb2adffb640 1 -- 172.21.15.7:0/2278708514 >> v2:172.21.15.55:3300/0 conn(0x7fb2b00ce680 msgr2=0x7fb2b00ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:38.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.381+0000 7fb2adffb640 1 --2- 172.21.15.7:0/2278708514 >> v2:172.21.15.55:3300/0 conn(0x7fb2b00ce680 0x7fb2b00ceb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:38.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.381+0000 7fb2adffb640 1 -- 172.21.15.7:0/2278708514 >> v1:172.21.15.55:6789/0 conn(0x7fb2b00b6a70 legacy=0x7fb2b00b6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:38.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.381+0000 7fb2adffb640 1 -- 172.21.15.7:0/2278708514 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b00d1a60 con 0x7fb2b015db30 2024-04-25T10:02:38.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.382+0000 7fb2adffb640 1 -- 172.21.15.7:0/2278708514 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fb2a0001690 con 0x7fb2b015db30 2024-04-25T10:02:38.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.382+0000 7fb2adffb640 1 -- 172.21.15.7:0/2278708514 >> v1:172.21.15.7:6789/0 conn(0x7fb2b015db30 legacy=0x7fb2b00d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:38.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.382+0000 7fb2adffb640 1 --2- 172.21.15.7:0/2278708514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2980039b0 0x7fb298003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:38.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.382+0000 7fb2adffb640 1 --2- 172.21.15.7:0/2278708514 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb298004800 0x7fb298004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:38.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.382+0000 7fb2adffb640 1 --2- 172.21.15.7:0/2278708514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2980051c0 0x7fb29800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:38.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.382+0000 7fb2adffb640 1 -- 172.21.15.7:0/2278708514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b00d1780 con 0x7fb2980051c0 2024-04-25T10:02:38.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.382+0000 7fb2adffb640 1 -- 172.21.15.7:0/2278708514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29800c060 con 0x7fb2980039b0 2024-04-25T10:02:38.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.382+0000 7fb2adffb640 1 -- 172.21.15.7:0/2278708514 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb29800c260 con 0x7fb298004800 2024-04-25T10:02:38.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.382+0000 7fb2af7fe640 1 --2- 172.21.15.7:0/2278708514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2980051c0 0x7fb29800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:38.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.382+0000 7fb2ae7fc640 1 --2- 172.21.15.7:0/2278708514 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb298004800 0x7fb298004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:38.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.382+0000 7fb2aeffd640 1 --2- 172.21.15.7:0/2278708514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2980039b0 0x7fb298003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:38.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.382+0000 7fb2af7fe640 1 -- 172.21.15.7:0/2278708514 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb298004800 msgr2=0x7fb298004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:38.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.382+0000 7fb2af7fe640 1 --2- 172.21.15.7:0/2278708514 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb298004800 0x7fb298004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:38.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.382+0000 7fb2af7fe640 1 -- 172.21.15.7:0/2278708514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2980039b0 msgr2=0x7fb298003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:38.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.382+0000 7fb2af7fe640 1 --2- 172.21.15.7:0/2278708514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2980039b0 0x7fb298003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:38.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.382+0000 7fb2af7fe640 1 -- 172.21.15.7:0/2278708514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb298003520 con 0x7fb2980051c0 2024-04-25T10:02:38.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.383+0000 7fb2af7fe640 1 -- 172.21.15.7:0/2278708514 reap_dead start 2024-04-25T10:02:38.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.383+0000 7fb2af7fe640 1 --2- 172.21.15.7:0/2278708514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2980051c0 0x7fb29800b9c0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8001e50 tx=0x7fb298005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff106dc922f1b084 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:38.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.383+0000 7fb2adffb640 1 -- 172.21.15.7:0/2278708514 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8001a70 con 0x7fb2980051c0 2024-04-25T10:02:38.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.383+0000 7fb2adffb640 1 -- 172.21.15.7:0/2278708514 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a8003970 con 0x7fb2980051c0 2024-04-25T10:02:38.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.383+0000 7fb2adffb640 1 -- 172.21.15.7:0/2278708514 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8003d60 con 0x7fb2980051c0 2024-04-25T10:02:38.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.383+0000 7fb2b55b7640 1 -- 172.21.15.7:0/2278708514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2980051c0 msgr2=0x7fb29800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:38.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.383+0000 7fb2b55b7640 1 --2- 172.21.15.7:0/2278708514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2980051c0 0x7fb29800b9c0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8001e50 tx=0x7fb298005830 comp rx=0 tx=0).stop 2024-04-25T10:02:38.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.383+0000 7fb2b55b7640 1 -- 172.21.15.7:0/2278708514 shutdown_connections 2024-04-25T10:02:38.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.383+0000 7fb2b55b7640 1 --2- 172.21.15.7:0/2278708514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2980051c0 0x7fb29800b9c0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:38.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.383+0000 7fb2b55b7640 1 -- 172.21.15.7:0/2278708514 >> 172.21.15.7:0/2278708514 conn(0x7fb2b00728c0 msgr2=0x7fb2b006bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:38.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.383+0000 7fb2b55b7640 1 -- 172.21.15.7:0/2278708514 shutdown_connections 2024-04-25T10:02:38.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.384+0000 7fb2b55b7640 1 -- 172.21.15.7:0/2278708514 wait complete. 2024-04-25T10:02:38.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.385+0000 7fb2b55b7640 1 Processor -- start 2024-04-25T10:02:38.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.385+0000 7fb2b55b7640 1 -- start start 2024-04-25T10:02:38.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.386+0000 7fb2b55b7640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb2980051c0 0x7fb2b00cb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:38.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.386+0000 7fb2b55b7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2b01531d0 0x7fb2b014e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:38.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.386+0000 7fb2b55b7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2b0153650 0x7fb2b014edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:38.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.386+0000 7fb2b55b7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b00d1410 con 0x7fb2b0153650 2024-04-25T10:02:38.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.386+0000 7fb2b55b7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b00d2020 con 0x7fb2b01531d0 2024-04-25T10:02:38.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.386+0000 7fb2b55b7640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b00ceb10 con 0x7fb2980051c0 2024-04-25T10:02:38.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.386+0000 7fb2af7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2b0153650 0x7fb2b014edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:38.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.386+0000 7fb2af7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2b0153650 0x7fb2b014edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48660/0 (socket says 172.21.15.7:48660) 2024-04-25T10:02:38.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.386+0000 7fb2af7fe640 1 -- 172.21.15.7:0/710947816 learned_addr learned my addr 172.21.15.7:0/710947816 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:38.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.386+0000 7fb2aeffd640 1 --2- 172.21.15.7:0/710947816 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb2980051c0 0x7fb2b00cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:38.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.386+0000 7fb2ae7fc640 1 --2- 172.21.15.7:0/710947816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2b01531d0 0x7fb2b014e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:38.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.386+0000 7fb2af7fe640 1 -- 172.21.15.7:0/710947816 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb2980051c0 msgr2=0x7fb2b00cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:38.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.386+0000 7fb2af7fe640 1 --2- 172.21.15.7:0/710947816 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb2980051c0 0x7fb2b00cb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:38.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.386+0000 7fb2af7fe640 1 -- 172.21.15.7:0/710947816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2b01531d0 msgr2=0x7fb2b014e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:38.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.386+0000 7fb2af7fe640 1 --2- 172.21.15.7:0/710947816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2b01531d0 0x7fb2b014e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:38.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.386+0000 7fb2af7fe640 1 -- 172.21.15.7:0/710947816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b01f4100 con 0x7fb2b0153650 2024-04-25T10:02:38.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.386+0000 7fb2af7fe640 1 --2- 172.21.15.7:0/710947816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2b0153650 0x7fb2b014edc0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8001f70 tx=0x7fb2a80014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:38.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.386+0000 7fb2977fe640 1 -- 172.21.15.7:0/710947816 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8001a70 con 0x7fb2b0153650 2024-04-25T10:02:38.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.386+0000 7fb2977fe640 1 -- 172.21.15.7:0/710947816 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a802ac70 con 0x7fb2b0153650 2024-04-25T10:02:38.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.386+0000 7fb2b55b7640 1 -- 172.21.15.7:0/710947816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b00caa90 con 0x7fb2b0153650 2024-04-25T10:02:38.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.386+0000 7fb2977fe640 1 -- 172.21.15.7:0/710947816 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8006d70 con 0x7fb2b0153650 2024-04-25T10:02:38.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.386+0000 7fb2b55b7640 1 -- 172.21.15.7:0/710947816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b00cb050 con 0x7fb2b0153650 2024-04-25T10:02:38.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.387+0000 7fb2b55b7640 1 -- 172.21.15.7:0/710947816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b00cb250 con 0x7fb2b0153650 2024-04-25T10:02:38.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.388+0000 7fb2977fe640 1 -- 172.21.15.7:0/710947816 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb2a8007030 con 0x7fb2b0153650 2024-04-25T10:02:38.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.388+0000 7fb2977fe640 1 --2- 172.21.15.7:0/710947816 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb29c06b4d0 0x7fb29c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:38.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.388+0000 7fb2977fe640 1 -- 172.21.15.7:0/710947816 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6475+0+0 (secure 0 0 0) 0x7fb2a80a9c60 con 0x7fb2b0153650 2024-04-25T10:02:38.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.388+0000 7fb2aeffd640 1 --2- 172.21.15.7:0/710947816 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb29c06b4d0 0x7fb29c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:38.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.389+0000 7fb2aeffd640 1 --2- 172.21.15.7:0/710947816 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb29c06b4d0 0x7fb29c06d990 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00cf220 tx=0x7fb2a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:38.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.392+0000 7fb2977fe640 1 -- 172.21.15.7:0/710947816 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb2b00cb250 con 0x7fb2b0153650 2024-04-25T10:02:38.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:38.613+0000 7fb2b55b7640 1 -- 172.21.15.7:0/710947816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb2b0068f60 con 0x7fb2b0153650 2024-04-25T10:02:39.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.262+0000 7fb2977fe640 1 -- 172.21.15.7:0/710947816 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v68) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb2a8043060 con 0x7fb2b0153650 2024-04-25T10:02:39.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.265+0000 7fb2b55b7640 1 -- 172.21.15.7:0/710947816 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb29c06b4d0 msgr2=0x7fb29c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:39.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.265+0000 7fb2b55b7640 1 --2- 172.21.15.7:0/710947816 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb29c06b4d0 0x7fb29c06d990 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00cf220 tx=0x7fb2a0009040 comp rx=0 tx=0).stop 2024-04-25T10:02:39.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.265+0000 7fb2b55b7640 1 -- 172.21.15.7:0/710947816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2b0153650 msgr2=0x7fb2b014edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:39.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.265+0000 7fb2b55b7640 1 --2- 172.21.15.7:0/710947816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2b0153650 0x7fb2b014edc0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8001f70 tx=0x7fb2a80014a0 comp rx=0 tx=0).stop 2024-04-25T10:02:39.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.265+0000 7fb2b55b7640 1 -- 172.21.15.7:0/710947816 shutdown_connections 2024-04-25T10:02:39.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.265+0000 7fb2b55b7640 1 --2- 172.21.15.7:0/710947816 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb29c06b4d0 0x7fb29c06d990 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:39.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.265+0000 7fb2b55b7640 1 --2- 172.21.15.7:0/710947816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2b0153650 0x7fb2b014edc0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:39.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.265+0000 7fb2b55b7640 1 --2- 172.21.15.7:0/710947816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2b01531d0 0x7fb2b014e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:39.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.265+0000 7fb2b55b7640 1 --2- 172.21.15.7:0/710947816 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb2980051c0 0x7fb2b00cb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:39.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.265+0000 7fb2b55b7640 1 -- 172.21.15.7:0/710947816 >> 172.21.15.7:0/710947816 conn(0x7fb2b00728c0 msgr2=0x7fb2b00b8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:39.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.265+0000 7fb2b55b7640 1 -- 172.21.15.7:0/710947816 shutdown_connections 2024-04-25T10:02:39.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.265+0000 7fb2b55b7640 1 -- 172.21.15.7:0/710947816 wait complete. 2024-04-25T10:02:39.284 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T10:02:39.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.433+0000 7fb1f85fe640 1 Processor -- start 2024-04-25T10:02:39.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.433+0000 7fb1f85fe640 1 -- start start 2024-04-25T10:02:39.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.434+0000 7fb1f85fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb1f015de70 0x7fb1f00d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:39.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.434+0000 7fb1f85fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb1f00d3330 0x7fb1f00d3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:39.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.434+0000 7fb1f85fe640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1f00d2290 con 0x7fb1f00b9290 2024-04-25T10:02:39.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.434+0000 7fb1f85fe640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f00d2570 con 0x7fb1f00d3330 2024-04-25T10:02:39.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.434+0000 7fb1f85fe640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f00d2850 con 0x7fb1f015de70 2024-04-25T10:02:39.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.434+0000 7fb1f5b99640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb1f00d3330 0x7fb1f00d3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:39.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.434+0000 7fb1f5b99640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb1f00d3330 0x7fb1f00d3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48672/0 (socket says 172.21.15.7:48672) 2024-04-25T10:02:39.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.434+0000 7fb1f5b99640 1 -- 172.21.15.7:0/1269319071 learned_addr learned my addr 172.21.15.7:0/1269319071 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:39.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.435+0000 7fb1f639a640 1 --2- 172.21.15.7:0/1269319071 >> v2:172.21.15.55:3300/0 conn(0x7fb1f015de70 0x7fb1f00d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:39.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.435+0000 7fb1f5b99640 1 -- 172.21.15.7:0/1269319071 >> v2:172.21.15.55:3300/0 conn(0x7fb1f015de70 msgr2=0x7fb1f00d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:39.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.435+0000 7fb1f5b99640 1 --2- 172.21.15.7:0/1269319071 >> v2:172.21.15.55:3300/0 conn(0x7fb1f015de70 0x7fb1f00d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:39.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.435+0000 7fb1f5b99640 1 -- 172.21.15.7:0/1269319071 >> v1:172.21.15.55:6789/0 conn(0x7fb1f00b9290 legacy=0x7fb1f00b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:39.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.435+0000 7fb1f5b99640 1 -- 172.21.15.7:0/1269319071 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f00d2b30 con 0x7fb1f00d3330 2024-04-25T10:02:39.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.435+0000 7fb1f5b99640 1 --2- 172.21.15.7:0/1269319071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1f00d3330 0x7fb1f00d3800 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fb1f00d43c0 tx=0x7fb1e002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2249a2cf9799e4f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:39.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.435+0000 7fb1f5398640 1 -- 172.21.15.7:0/1269319071 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0037070 con 0x7fb1f00d3330 2024-04-25T10:02:39.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.435+0000 7fb1f5398640 1 -- 172.21.15.7:0/1269319071 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e0032440 con 0x7fb1f00d3330 2024-04-25T10:02:39.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.436+0000 7fb1f5398640 1 -- 172.21.15.7:0/1269319071 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0032810 con 0x7fb1f00d3330 2024-04-25T10:02:39.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.436+0000 7fb1f85fe640 1 -- 172.21.15.7:0/1269319071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1f00d3330 msgr2=0x7fb1f00d3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:39.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.436+0000 7fb1f85fe640 1 --2- 172.21.15.7:0/1269319071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1f00d3330 0x7fb1f00d3800 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fb1f00d43c0 tx=0x7fb1e002a230 comp rx=0 tx=0).stop 2024-04-25T10:02:39.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.436+0000 7fb1f85fe640 1 -- 172.21.15.7:0/1269319071 shutdown_connections 2024-04-25T10:02:39.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.436+0000 7fb1f85fe640 1 --2- 172.21.15.7:0/1269319071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1f00d3330 0x7fb1f00d3800 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:39.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.436+0000 7fb1f85fe640 1 --2- 172.21.15.7:0/1269319071 >> v2:172.21.15.55:3300/0 conn(0x7fb1f015de70 0x7fb1f00d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:39.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.436+0000 7fb1f85fe640 1 -- 172.21.15.7:0/1269319071 >> 172.21.15.7:0/1269319071 conn(0x7fb1f00726b0 msgr2=0x7fb1f0072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:39.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.436+0000 7fb1f85fe640 1 -- 172.21.15.7:0/1269319071 shutdown_connections 2024-04-25T10:02:39.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.436+0000 7fb1f85fe640 1 -- 172.21.15.7:0/1269319071 wait complete. 2024-04-25T10:02:39.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.437+0000 7fb1f85fe640 1 Processor -- start 2024-04-25T10:02:39.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.437+0000 7fb1f85fe640 1 -- start start 2024-04-25T10:02:39.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.438+0000 7fb1f85fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1f00b9290 0x7fb1f014bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:39.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.438+0000 7fb1f85fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1f00d3330 0x7fb1f00c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:39.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.438+0000 7fb1f85fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb1f015de70 0x7fb1f00ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:39.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.438+0000 7fb1f85fe640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f00d1fe0 con 0x7fb1f00d3330 2024-04-25T10:02:39.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.438+0000 7fb1f85fe640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f00d1e60 con 0x7fb1f00b9290 2024-04-25T10:02:39.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.438+0000 7fb1f85fe640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f00d3d40 con 0x7fb1f015de70 2024-04-25T10:02:39.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.438+0000 7fb1f5b99640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1f00d3330 0x7fb1f00c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:39.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.438+0000 7fb1f5b99640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1f00d3330 0x7fb1f00c94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48688/0 (socket says 172.21.15.7:48688) 2024-04-25T10:02:39.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.438+0000 7fb1f5b99640 1 -- 172.21.15.7:0/3936828549 learned_addr learned my addr 172.21.15.7:0/3936828549 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:39.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.438+0000 7fb1f639a640 1 --2- 172.21.15.7:0/3936828549 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1f00b9290 0x7fb1f014bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:39.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.438+0000 7fb1f6b9b640 1 --2- 172.21.15.7:0/3936828549 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb1f015de70 0x7fb1f00ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:39.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.439+0000 7fb1f5b99640 1 -- 172.21.15.7:0/3936828549 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb1f015de70 msgr2=0x7fb1f00ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:39.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.439+0000 7fb1f5b99640 1 --2- 172.21.15.7:0/3936828549 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb1f015de70 0x7fb1f00ccb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:39.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.439+0000 7fb1f5b99640 1 -- 172.21.15.7:0/3936828549 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1f00b9290 msgr2=0x7fb1f014bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:39.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.439+0000 7fb1f5b99640 1 --2- 172.21.15.7:0/3936828549 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1f00b9290 0x7fb1f014bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:39.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.439+0000 7fb1f5b99640 1 -- 172.21.15.7:0/3936828549 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f00c9d40 con 0x7fb1f00d3330 2024-04-25T10:02:39.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.439+0000 7fb1f5b99640 1 --2- 172.21.15.7:0/3936828549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1f00d3330 0x7fb1f00c94d0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fb1e002a270 tx=0x7fb1e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:39.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.439+0000 7fb1e6ffd640 1 -- 172.21.15.7:0/3936828549 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0037040 con 0x7fb1f00d3330 2024-04-25T10:02:39.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.439+0000 7fb1e6ffd640 1 -- 172.21.15.7:0/3936828549 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e0042070 con 0x7fb1f00d3330 2024-04-25T10:02:39.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.439+0000 7fb1f85fe640 1 -- 172.21.15.7:0/3936828549 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f00ca020 con 0x7fb1f00d3330 2024-04-25T10:02:39.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.439+0000 7fb1e6ffd640 1 -- 172.21.15.7:0/3936828549 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0030bb0 con 0x7fb1f00d3330 2024-04-25T10:02:39.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.439+0000 7fb1f85fe640 1 -- 172.21.15.7:0/3936828549 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f00c9a10 con 0x7fb1f00d3330 2024-04-25T10:02:39.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.440+0000 7fb1f85fe640 1 -- 172.21.15.7:0/3936828549 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1f015c270 con 0x7fb1f00d3330 2024-04-25T10:02:39.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.441+0000 7fb1e6ffd640 1 -- 172.21.15.7:0/3936828549 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb1e0047460 con 0x7fb1f00d3330 2024-04-25T10:02:39.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.441+0000 7fb1e6ffd640 1 --2- 172.21.15.7:0/3936828549 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb1d406b4d0 0x7fb1d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:39.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.441+0000 7fb1e6ffd640 1 -- 172.21.15.7:0/3936828549 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6475+0+0 (secure 0 0 0) 0x7fb1e00ab020 con 0x7fb1f00d3330 2024-04-25T10:02:39.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.441+0000 7fb1f639a640 1 --2- 172.21.15.7:0/3936828549 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb1d406b4d0 0x7fb1d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:39.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.442+0000 7fb1f639a640 1 --2- 172.21.15.7:0/3936828549 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb1d406b4d0 0x7fb1d406d990 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800aa20 tx=0x7fb1e8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:39.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.445+0000 7fb1e6ffd640 1 -- 172.21.15.7:0/3936828549 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb1f015c270 con 0x7fb1f00d3330 2024-04-25T10:02:39.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:39.627+0000 7fb1f85fe640 1 -- 172.21.15.7:0/3936828549 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb1f00ca1f0 con 0x7fb1f00d3330 2024-04-25T10:02:40.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.513+0000 7fb1e6ffd640 1 -- 172.21.15.7:0/3936828549 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v94) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb1e0079550 con 0x7fb1f00d3330 2024-04-25T10:02:40.518 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2024-04-25T10:02:40.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.517+0000 7fb1f85fe640 1 -- 172.21.15.7:0/3936828549 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb1d406b4d0 msgr2=0x7fb1d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:40.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.517+0000 7fb1f85fe640 1 --2- 172.21.15.7:0/3936828549 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb1d406b4d0 0x7fb1d406d990 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800aa20 tx=0x7fb1e8008040 comp rx=0 tx=0).stop 2024-04-25T10:02:40.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.517+0000 7fb1f85fe640 1 -- 172.21.15.7:0/3936828549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1f00d3330 msgr2=0x7fb1f00c94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:40.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.517+0000 7fb1f85fe640 1 --2- 172.21.15.7:0/3936828549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1f00d3330 0x7fb1f00c94d0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fb1e002a270 tx=0x7fb1e00046c0 comp rx=0 tx=0).stop 2024-04-25T10:02:40.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.517+0000 7fb1f85fe640 1 -- 172.21.15.7:0/3936828549 shutdown_connections 2024-04-25T10:02:40.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.517+0000 7fb1f85fe640 1 --2- 172.21.15.7:0/3936828549 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb1d406b4d0 0x7fb1d406d990 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:40.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.517+0000 7fb1f85fe640 1 --2- 172.21.15.7:0/3936828549 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb1f015de70 0x7fb1f00ccb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:40.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.517+0000 7fb1f85fe640 1 --2- 172.21.15.7:0/3936828549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1f00d3330 0x7fb1f00c94d0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:40.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.517+0000 7fb1f85fe640 1 --2- 172.21.15.7:0/3936828549 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1f00b9290 0x7fb1f014bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:40.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.517+0000 7fb1f85fe640 1 -- 172.21.15.7:0/3936828549 >> 172.21.15.7:0/3936828549 conn(0x7fb1f00726b0 msgr2=0x7fb1f015c470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:40.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.517+0000 7fb1f85fe640 1 -- 172.21.15.7:0/3936828549 shutdown_connections 2024-04-25T10:02:40.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.518+0000 7fb1f85fe640 1 -- 172.21.15.7:0/3936828549 wait complete. 2024-04-25T10:02:40.537 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T10:02:40.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.643+0000 7f572cdd5640 1 Processor -- start 2024-04-25T10:02:40.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.643+0000 7f572cdd5640 1 -- start start 2024-04-25T10:02:40.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.644+0000 7f572cdd5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f572815d980 0x7f5728161520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:40.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.644+0000 7f572cdd5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f572815e5f0 0x7f572815ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:40.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.644+0000 7f572cdd5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5728162450 con 0x7f57280b9390 2024-04-25T10:02:40.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.644+0000 7f572cdd5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5728161bb0 con 0x7f572815d980 2024-04-25T10:02:40.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.644+0000 7f572cdd5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5728161e90 con 0x7f572815e5f0 2024-04-25T10:02:40.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.644+0000 7f5726d9d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f572815e5f0 0x7f572815ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:40.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.644+0000 7f572659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f572815d980 0x7f5728161520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:40.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.644+0000 7f5725d9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f57280b9390 0x7f57280d1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:36356/0 (socket says 172.21.15.7:36356) 2024-04-25T10:02:40.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.644+0000 7f5725d9b640 1 -- 172.21.15.7:0/855342530 learned_addr learned my addr 172.21.15.7:0/855342530 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:02:40.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.645+0000 7f572559a640 1 -- 172.21.15.7:0/855342530 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3775482027 0 0) 0x7f5728162450 con 0x7f57280b9390 2024-04-25T10:02:40.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.645+0000 7f572559a640 1 -- 172.21.15.7:0/855342530 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5714003520 con 0x7f57280b9390 2024-04-25T10:02:40.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.645+0000 7f5726d9d640 1 -- 172.21.15.7:0/855342530 >> v2:172.21.15.55:3300/0 conn(0x7f572815d980 msgr2=0x7f5728161520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:40.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.645+0000 7f5726d9d640 1 --2- 172.21.15.7:0/855342530 >> v2:172.21.15.55:3300/0 conn(0x7f572815d980 0x7f5728161520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:40.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.645+0000 7f5726d9d640 1 -- 172.21.15.7:0/855342530 >> v1:172.21.15.55:6789/0 conn(0x7f57280b9390 legacy=0x7f57280d1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:40.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.645+0000 7f5726d9d640 1 -- 172.21.15.7:0/855342530 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5728162170 con 0x7f572815e5f0 2024-04-25T10:02:40.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.645+0000 7f572659c640 1 --2- 172.21.15.7:0/855342530 >> v2:172.21.15.55:3300/0 conn(0x7f572815d980 0x7f5728161520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:02:40.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.645+0000 7f5726d9d640 1 --2- 172.21.15.7:0/855342530 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f572815e5f0 0x7f572815ea20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f57200097a0 tx=0x7f572002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3350c6892af54a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:40.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.646+0000 7f572559a640 1 -- 172.21.15.7:0/855342530 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5720037070 con 0x7f572815e5f0 2024-04-25T10:02:40.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.646+0000 7f572559a640 1 -- 172.21.15.7:0/855342530 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5720032440 con 0x7f572815e5f0 2024-04-25T10:02:40.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.646+0000 7f572559a640 1 -- 172.21.15.7:0/855342530 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5720032810 con 0x7f572815e5f0 2024-04-25T10:02:40.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.646+0000 7f572cdd5640 1 -- 172.21.15.7:0/855342530 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f572815e5f0 msgr2=0x7f572815ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:40.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.646+0000 7f572cdd5640 1 --2- 172.21.15.7:0/855342530 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f572815e5f0 0x7f572815ea20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f57200097a0 tx=0x7f572002a180 comp rx=0 tx=0).stop 2024-04-25T10:02:40.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.646+0000 7f572cdd5640 1 -- 172.21.15.7:0/855342530 shutdown_connections 2024-04-25T10:02:40.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.646+0000 7f572cdd5640 1 --2- 172.21.15.7:0/855342530 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f572815e5f0 0x7f572815ea20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:40.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.646+0000 7f572cdd5640 1 --2- 172.21.15.7:0/855342530 >> v2:172.21.15.55:3300/0 conn(0x7f572815d980 0x7f5728161520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:40.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.646+0000 7f572cdd5640 1 -- 172.21.15.7:0/855342530 >> 172.21.15.7:0/855342530 conn(0x7f572806c3d0 msgr2=0x7f572806c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:40.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.646+0000 7f572cdd5640 1 -- 172.21.15.7:0/855342530 shutdown_connections 2024-04-25T10:02:40.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.646+0000 7f572cdd5640 1 -- 172.21.15.7:0/855342530 wait complete. 2024-04-25T10:02:40.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.648+0000 7f572cdd5640 1 Processor -- start 2024-04-25T10:02:40.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.648+0000 7f572cdd5640 1 -- start start 2024-04-25T10:02:40.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.648+0000 7f572cdd5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f57280b9390 0x7f57280d3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:40.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.648+0000 7f572cdd5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f572815d980 0x7f57280d4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:40.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.648+0000 7f572cdd5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f572815e5f0 0x7f57281f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:40.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.648+0000 7f572cdd5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572815dd60 con 0x7f572815d980 2024-04-25T10:02:40.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.648+0000 7f572cdd5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57280b9820 con 0x7f572815e5f0 2024-04-25T10:02:40.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.648+0000 7f572cdd5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57280d2150 con 0x7f57280b9390 2024-04-25T10:02:40.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.649+0000 7f5725d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f572815d980 0x7f57280d4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:40.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.649+0000 7f5725d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f572815d980 0x7f57280d4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47158/0 (socket says 172.21.15.7:47158) 2024-04-25T10:02:40.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.649+0000 7f5725d9b640 1 -- 172.21.15.7:0/2554943478 learned_addr learned my addr 172.21.15.7:0/2554943478 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:40.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.649+0000 7f572659c640 1 --2- 172.21.15.7:0/2554943478 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f57280b9390 0x7f57280d3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:40.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.649+0000 7f5726d9d640 1 --2- 172.21.15.7:0/2554943478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f572815e5f0 0x7f57281f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:40.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.649+0000 7f5725d9b640 1 -- 172.21.15.7:0/2554943478 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f57280b9390 msgr2=0x7f57280d3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:40.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.649+0000 7f5725d9b640 1 --2- 172.21.15.7:0/2554943478 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f57280b9390 0x7f57280d3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:40.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.649+0000 7f5725d9b640 1 -- 172.21.15.7:0/2554943478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f572815e5f0 msgr2=0x7f57281f6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:40.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.649+0000 7f5725d9b640 1 --2- 172.21.15.7:0/2554943478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f572815e5f0 0x7f57281f6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:40.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.649+0000 7f5725d9b640 1 -- 172.21.15.7:0/2554943478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57280c8e50 con 0x7f572815d980 2024-04-25T10:02:40.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.649+0000 7f5725d9b640 1 --2- 172.21.15.7:0/2554943478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f572815d980 0x7f57280d4100 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f571000c430 tx=0x7f571000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:40.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.649+0000 7f571effd640 1 -- 172.21.15.7:0/2554943478 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5710017070 con 0x7f572815d980 2024-04-25T10:02:40.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.649+0000 7f571effd640 1 -- 172.21.15.7:0/2554943478 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5710005ce0 con 0x7f572815d980 2024-04-25T10:02:40.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.649+0000 7f572cdd5640 1 -- 172.21.15.7:0/2554943478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57280b6ae0 con 0x7f572815d980 2024-04-25T10:02:40.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.649+0000 7f571effd640 1 -- 172.21.15.7:0/2554943478 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57100072f0 con 0x7f572815d980 2024-04-25T10:02:40.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.649+0000 7f572cdd5640 1 -- 172.21.15.7:0/2554943478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57280b70a0 con 0x7f572815d980 2024-04-25T10:02:40.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.651+0000 7f572cdd5640 1 -- 172.21.15.7:0/2554943478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57280b72a0 con 0x7f572815d980 2024-04-25T10:02:40.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.651+0000 7f571effd640 1 -- 172.21.15.7:0/2554943478 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f571001a070 con 0x7f572815d980 2024-04-25T10:02:40.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.651+0000 7f571effd640 1 --2- 172.21.15.7:0/2554943478 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f570806b500 0x7f570806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:40.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.651+0000 7f572659c640 1 --2- 172.21.15.7:0/2554943478 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f570806b500 0x7f570806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:40.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.651+0000 7f571effd640 1 -- 172.21.15.7:0/2554943478 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6037+0+0 (secure 0 0 0) 0x7f57100896c0 con 0x7f572815d980 2024-04-25T10:02:40.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.652+0000 7f572659c640 1 --2- 172.21.15.7:0/2554943478 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f570806b500 0x7f570806d9c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f5718009bd0 tx=0x7f571800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:40.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.656+0000 7f571effd640 1 -- 172.21.15.7:0/2554943478 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f57280b72a0 con 0x7f572815d980 2024-04-25T10:02:40.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:40.842+0000 7f572cdd5640 1 -- 172.21.15.7:0/2554943478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5728069040 con 0x7f572815d980 2024-04-25T10:02:41.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.523+0000 7f571effd640 1 -- 172.21.15.7:0/2554943478 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v95) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5710087e20 con 0x7f572815d980 2024-04-25T10:02:41.528 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2024-04-25T10:02:41.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.527+0000 7f572cdd5640 1 -- 172.21.15.7:0/2554943478 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f570806b500 msgr2=0x7f570806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:41.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.527+0000 7f572cdd5640 1 --2- 172.21.15.7:0/2554943478 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f570806b500 0x7f570806d9c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f5718009bd0 tx=0x7f571800b040 comp rx=0 tx=0).stop 2024-04-25T10:02:41.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.527+0000 7f572cdd5640 1 -- 172.21.15.7:0/2554943478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f572815d980 msgr2=0x7f57280d4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:41.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.527+0000 7f572cdd5640 1 --2- 172.21.15.7:0/2554943478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f572815d980 0x7f57280d4100 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f571000c430 tx=0x7f571000c8f0 comp rx=0 tx=0).stop 2024-04-25T10:02:41.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.530+0000 7f572cdd5640 1 -- 172.21.15.7:0/2554943478 shutdown_connections 2024-04-25T10:02:41.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.530+0000 7f572cdd5640 1 --2- 172.21.15.7:0/2554943478 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f570806b500 0x7f570806d9c0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:41.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.530+0000 7f572cdd5640 1 --2- 172.21.15.7:0/2554943478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f572815e5f0 0x7f57281f6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:41.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.530+0000 7f572cdd5640 1 --2- 172.21.15.7:0/2554943478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f572815d980 0x7f57280d4100 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:41.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.530+0000 7f572cdd5640 1 --2- 172.21.15.7:0/2554943478 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f57280b9390 0x7f57280d3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:41.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.530+0000 7f572cdd5640 1 -- 172.21.15.7:0/2554943478 >> 172.21.15.7:0/2554943478 conn(0x7f572806c3d0 msgr2=0x7f572814c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:41.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.530+0000 7f572cdd5640 1 -- 172.21.15.7:0/2554943478 shutdown_connections 2024-04-25T10:02:41.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.530+0000 7f572cdd5640 1 -- 172.21.15.7:0/2554943478 wait complete. 2024-04-25T10:02:41.553 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T10:02:41.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.656+0000 7fa0ab66b640 1 Processor -- start 2024-04-25T10:02:41.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.657+0000 7fa0ab66b640 1 -- start start 2024-04-25T10:02:41.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.657+0000 7fa0ab66b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa0a415deb0 0x7fa0a40b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:41.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.657+0000 7fa0ab66b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0a40d3760 0x7fa0a40d3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:41.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.657+0000 7fa0ab66b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a40ce4c0 con 0x7fa0a40ce030 2024-04-25T10:02:41.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.657+0000 7fa0ab66b640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a40d1a40 con 0x7fa0a415deb0 2024-04-25T10:02:41.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.658+0000 7fa0ab66b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a40d1d20 con 0x7fa0a40d3760 2024-04-25T10:02:41.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.658+0000 7fa0a9407640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa0a415deb0 0x7fa0a40b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:41.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.658+0000 7fa0a9407640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa0a415deb0 0x7fa0a40b2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47162/0 (socket says 172.21.15.7:47162) 2024-04-25T10:02:41.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.658+0000 7fa0a9407640 1 -- 172.21.15.7:0/2644253676 learned_addr learned my addr 172.21.15.7:0/2644253676 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:41.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.658+0000 7fa0a9c08640 1 --2- 172.21.15.7:0/2644253676 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0a40d3760 0x7fa0a40d3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:41.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.658+0000 7fa0a9407640 1 -- 172.21.15.7:0/2644253676 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0a40d3760 msgr2=0x7fa0a40d3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:41.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.658+0000 7fa0a9407640 1 --2- 172.21.15.7:0/2644253676 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0a40d3760 0x7fa0a40d3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:41.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.658+0000 7fa0a9407640 1 -- 172.21.15.7:0/2644253676 >> v1:172.21.15.55:6789/0 conn(0x7fa0a40ce030 legacy=0x7fa0a40b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:41.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.658+0000 7fa0a9407640 1 -- 172.21.15.7:0/2644253676 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a40d2000 con 0x7fa0a415deb0 2024-04-25T10:02:41.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.658+0000 7fa0a9c08640 1 --2- 172.21.15.7:0/2644253676 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0a40d3760 0x7fa0a40d3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:02:41.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.659+0000 7fa0a9407640 1 --2- 172.21.15.7:0/2644253676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0a415deb0 0x7fa0a40b2c30 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0009870 tx=0x7fa0a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1686beddf69f1eee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:41.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.659+0000 7fa09bfff640 1 -- 172.21.15.7:0/2644253676 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0037070 con 0x7fa0a415deb0 2024-04-25T10:02:41.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.659+0000 7fa09bfff640 1 -- 172.21.15.7:0/2644253676 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a0032440 con 0x7fa0a415deb0 2024-04-25T10:02:41.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.659+0000 7fa09bfff640 1 -- 172.21.15.7:0/2644253676 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0032810 con 0x7fa0a415deb0 2024-04-25T10:02:41.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.659+0000 7fa0ab66b640 1 -- 172.21.15.7:0/2644253676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0a415deb0 msgr2=0x7fa0a40b2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:41.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.660+0000 7fa0ab66b640 1 --2- 172.21.15.7:0/2644253676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0a415deb0 0x7fa0a40b2c30 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0009870 tx=0x7fa0a002a270 comp rx=0 tx=0).stop 2024-04-25T10:02:41.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.660+0000 7fa0ab66b640 1 -- 172.21.15.7:0/2644253676 shutdown_connections 2024-04-25T10:02:41.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.660+0000 7fa0ab66b640 1 --2- 172.21.15.7:0/2644253676 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0a40d3760 0x7fa0a40d3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:41.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.660+0000 7fa0ab66b640 1 --2- 172.21.15.7:0/2644253676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0a415deb0 0x7fa0a40b2c30 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:41.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.660+0000 7fa0ab66b640 1 -- 172.21.15.7:0/2644253676 >> 172.21.15.7:0/2644253676 conn(0x7fa0a40726b0 msgr2=0x7fa0a4072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:41.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.660+0000 7fa0ab66b640 1 -- 172.21.15.7:0/2644253676 shutdown_connections 2024-04-25T10:02:41.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.660+0000 7fa0ab66b640 1 -- 172.21.15.7:0/2644253676 wait complete. 2024-04-25T10:02:41.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.661+0000 7fa0ab66b640 1 Processor -- start 2024-04-25T10:02:41.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.661+0000 7fa0ab66b640 1 -- start start 2024-04-25T10:02:41.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.662+0000 7fa0ab66b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0a40ce030 0x7fa0a40b7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:41.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.662+0000 7fa0ab66b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0a40d3760 0x7fa0a40b77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:41.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.662+0000 7fa0ab66b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0a415deb0 0x7fa0a40cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:41.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.662+0000 7fa0ab66b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a40b70f0 con 0x7fa0a40ce030 2024-04-25T10:02:41.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.662+0000 7fa0ab66b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a40d25c0 con 0x7fa0a40d3760 2024-04-25T10:02:41.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.662+0000 7fa0ab66b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a40d2ae0 con 0x7fa0a415deb0 2024-04-25T10:02:41.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.662+0000 7fa0a9407640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0a40ce030 0x7fa0a40b7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:41.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.662+0000 7fa0a9407640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0a40ce030 0x7fa0a40b7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47178/0 (socket says 172.21.15.7:47178) 2024-04-25T10:02:41.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.662+0000 7fa0a9407640 1 -- 172.21.15.7:0/2664826408 learned_addr learned my addr 172.21.15.7:0/2664826408 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:41.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.662+0000 7fa0a9407640 1 -- 172.21.15.7:0/2664826408 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0a415deb0 msgr2=0x7fa0a40cb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:41.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.662+0000 7fa0a9407640 1 --2- 172.21.15.7:0/2664826408 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0a415deb0 0x7fa0a40cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:41.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.662+0000 7fa0a9407640 1 -- 172.21.15.7:0/2664826408 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0a40d3760 msgr2=0x7fa0a40b77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:41.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.662+0000 7fa0a9407640 1 --2- 172.21.15.7:0/2664826408 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0a40d3760 0x7fa0a40b77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:41.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.662+0000 7fa0a9407640 1 -- 172.21.15.7:0/2664826408 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a415e330 con 0x7fa0a40ce030 2024-04-25T10:02:41.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.662+0000 7fa0a9407640 1 --2- 172.21.15.7:0/2664826408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0a40ce030 0x7fa0a40b7270 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0000c00 tx=0x7fa0a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:41.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.662+0000 7fa099ffb640 1 -- 172.21.15.7:0/2664826408 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0041020 con 0x7fa0a40ce030 2024-04-25T10:02:41.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.662+0000 7fa099ffb640 1 -- 172.21.15.7:0/2664826408 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a00306c0 con 0x7fa0a40ce030 2024-04-25T10:02:41.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.662+0000 7fa0ab66b640 1 -- 172.21.15.7:0/2664826408 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a4157f20 con 0x7fa0a40ce030 2024-04-25T10:02:41.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.663+0000 7fa099ffb640 1 -- 172.21.15.7:0/2664826408 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0037040 con 0x7fa0a40ce030 2024-04-25T10:02:41.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.663+0000 7fa0ab66b640 1 -- 172.21.15.7:0/2664826408 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a41584e0 con 0x7fa0a40ce030 2024-04-25T10:02:41.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.664+0000 7fa0ab66b640 1 -- 172.21.15.7:0/2664826408 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a4068f60 con 0x7fa0a40ce030 2024-04-25T10:02:41.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.664+0000 7fa099ffb640 1 -- 172.21.15.7:0/2664826408 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa0a0044020 con 0x7fa0a40ce030 2024-04-25T10:02:41.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.665+0000 7fa099ffb640 1 --2- 172.21.15.7:0/2664826408 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa08806b4d0 0x7fa08806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:41.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.665+0000 7fa099ffb640 1 -- 172.21.15.7:0/2664826408 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fa0a00aa990 con 0x7fa0a40ce030 2024-04-25T10:02:41.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.665+0000 7fa0a8c06640 1 --2- 172.21.15.7:0/2664826408 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa08806b4d0 0x7fa08806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:41.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.665+0000 7fa0a8c06640 1 --2- 172.21.15.7:0/2664826408 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa08806b4d0 0x7fa08806d990 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa094000f60 tx=0x7fa0940079d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:41.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.669+0000 7fa099ffb640 1 -- 172.21.15.7:0/2664826408 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa0a004b030 con 0x7fa0a40ce030 2024-04-25T10:02:41.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.857+0000 7fa0ab66b640 1 -- 172.21.15.7:0/2664826408 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa0a40b8fb0 con 0x7fa0a40ce030 2024-04-25T10:02:41.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.860+0000 7fa099ffb640 1 -- 172.21.15.7:0/2664826408 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa0a0079830 con 0x7fa0a40ce030 2024-04-25T10:02:41.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.862+0000 7fa0ab66b640 1 -- 172.21.15.7:0/2664826408 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa08806b4d0 msgr2=0x7fa08806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:41.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.862+0000 7fa0ab66b640 1 --2- 172.21.15.7:0/2664826408 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa08806b4d0 0x7fa08806d990 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa094000f60 tx=0x7fa0940079d0 comp rx=0 tx=0).stop 2024-04-25T10:02:41.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.862+0000 7fa0ab66b640 1 -- 172.21.15.7:0/2664826408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0a40ce030 msgr2=0x7fa0a40b7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:41.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.862+0000 7fa0ab66b640 1 --2- 172.21.15.7:0/2664826408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0a40ce030 0x7fa0a40b7270 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0000c00 tx=0x7fa0a00046c0 comp rx=0 tx=0).stop 2024-04-25T10:02:41.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.862+0000 7fa0ab66b640 1 -- 172.21.15.7:0/2664826408 shutdown_connections 2024-04-25T10:02:41.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.862+0000 7fa0ab66b640 1 --2- 172.21.15.7:0/2664826408 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa08806b4d0 0x7fa08806d990 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:41.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.862+0000 7fa0ab66b640 1 --2- 172.21.15.7:0/2664826408 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0a415deb0 0x7fa0a40cb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:41.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.862+0000 7fa0ab66b640 1 --2- 172.21.15.7:0/2664826408 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0a40d3760 0x7fa0a40b77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:41.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.862+0000 7fa0ab66b640 1 --2- 172.21.15.7:0/2664826408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0a40ce030 0x7fa0a40b7270 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:41.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.862+0000 7fa0ab66b640 1 -- 172.21.15.7:0/2664826408 >> 172.21.15.7:0/2664826408 conn(0x7fa0a40726b0 msgr2=0x7fa0a4072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:41.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.862+0000 7fa0ab66b640 1 -- 172.21.15.7:0/2664826408 shutdown_connections 2024-04-25T10:02:41.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.862+0000 7fa0ab66b640 1 -- 172.21.15.7:0/2664826408 wait complete. 2024-04-25T10:02:41.878 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair' 2024-04-25T10:02:41.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.974+0000 7f79af3e0640 1 Processor -- start 2024-04-25T10:02:41.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.974+0000 7f79af3e0640 1 -- start start 2024-04-25T10:02:41.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.975+0000 7f79af3e0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f79a815db00 0x7f79a80d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:41.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.975+0000 7f79af3e0640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f79a80b53b0 0x7f79a80d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:41.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.975+0000 7f79af3e0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f79a80ce2b0 0x7f79a8161670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:41.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.975+0000 7f79af3e0640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a80d1e80 con 0x7f79a80b53b0 2024-04-25T10:02:41.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.975+0000 7f79af3e0640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a80b5930 con 0x7f79a815db00 2024-04-25T10:02:41.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.975+0000 7f79af3e0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a80b5c10 con 0x7f79a80ce2b0 2024-04-25T10:02:41.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.975+0000 7f79ac97b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f79a80b53b0 0x7f79a80d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:41.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.975+0000 7f79ac97b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f79a80b53b0 0x7f79a80d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47180/0 (socket says 172.21.15.7:47180) 2024-04-25T10:02:41.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.975+0000 7f79ac97b640 1 -- 172.21.15.7:0/4103310987 learned_addr learned my addr 172.21.15.7:0/4103310987 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:41.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.976+0000 7f79ad17c640 1 --2- 172.21.15.7:0/4103310987 >> v2:172.21.15.55:3300/0 conn(0x7f79a815db00 0x7f79a80d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:41.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.976+0000 7f79ad97d640 1 --2- 172.21.15.7:0/4103310987 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f79a80ce2b0 0x7f79a8161670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:41.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.976+0000 7f79ac97b640 1 -- 172.21.15.7:0/4103310987 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f79a80ce2b0 msgr2=0x7f79a8161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:41.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.976+0000 7f79ac97b640 1 --2- 172.21.15.7:0/4103310987 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f79a80ce2b0 0x7f79a8161670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:41.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.976+0000 7f79ac97b640 1 -- 172.21.15.7:0/4103310987 >> v2:172.21.15.55:3300/0 conn(0x7f79a815db00 msgr2=0x7f79a80d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:41.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.976+0000 7f79ac97b640 1 --2- 172.21.15.7:0/4103310987 >> v2:172.21.15.55:3300/0 conn(0x7f79a815db00 0x7f79a80d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:41.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.976+0000 7f79ac97b640 1 -- 172.21.15.7:0/4103310987 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a80b5ef0 con 0x7f79a80b53b0 2024-04-25T10:02:41.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.976+0000 7f79ad97d640 1 --2- 172.21.15.7:0/4103310987 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f79a80ce2b0 0x7f79a8161670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:02:41.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.976+0000 7f79ad17c640 1 --2- 172.21.15.7:0/4103310987 >> v2:172.21.15.55:3300/0 conn(0x7f79a815db00 0x7f79a80d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:02:41.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.976+0000 7f79ac97b640 1 --2- 172.21.15.7:0/4103310987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79a80b53b0 0x7f79a80d0880 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f79a80d4940 tx=0x7f799c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e822300c9bc83d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:41.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.977+0000 7f79a7fff640 1 -- 172.21.15.7:0/4103310987 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c037070 con 0x7f79a80b53b0 2024-04-25T10:02:41.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.977+0000 7f79a7fff640 1 -- 172.21.15.7:0/4103310987 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799c032440 con 0x7f79a80b53b0 2024-04-25T10:02:41.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.977+0000 7f79a7fff640 1 -- 172.21.15.7:0/4103310987 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c032810 con 0x7f79a80b53b0 2024-04-25T10:02:41.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.977+0000 7f79af3e0640 1 -- 172.21.15.7:0/4103310987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79a80b53b0 msgr2=0x7f79a80d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:41.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.977+0000 7f79af3e0640 1 --2- 172.21.15.7:0/4103310987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79a80b53b0 0x7f79a80d0880 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f79a80d4940 tx=0x7f799c02a1e0 comp rx=0 tx=0).stop 2024-04-25T10:02:41.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.977+0000 7f79af3e0640 1 -- 172.21.15.7:0/4103310987 shutdown_connections 2024-04-25T10:02:41.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.977+0000 7f79af3e0640 1 --2- 172.21.15.7:0/4103310987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79a80b53b0 0x7f79a80d0880 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:41.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.977+0000 7f79af3e0640 1 --2- 172.21.15.7:0/4103310987 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f79a80ce2b0 0x7f79a8161670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:41.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.977+0000 7f79af3e0640 1 --2- 172.21.15.7:0/4103310987 >> v2:172.21.15.55:3300/0 conn(0x7f79a815db00 0x7f79a80d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:41.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.977+0000 7f79af3e0640 1 -- 172.21.15.7:0/4103310987 >> 172.21.15.7:0/4103310987 conn(0x7f79a8072290 msgr2=0x7f79a80726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:41.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.977+0000 7f79af3e0640 1 -- 172.21.15.7:0/4103310987 shutdown_connections 2024-04-25T10:02:41.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.977+0000 7f79af3e0640 1 -- 172.21.15.7:0/4103310987 wait complete. 2024-04-25T10:02:41.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.978+0000 7f79af3e0640 1 Processor -- start 2024-04-25T10:02:41.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.978+0000 7f79af3e0640 1 -- start start 2024-04-25T10:02:41.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.979+0000 7f79af3e0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79a80b53b0 0x7f79a8160b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:41.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.979+0000 7f79af3e0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f79a80ce2b0 0x7f79a815e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:41.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.979+0000 7f79af3e0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79a815db00 0x7f79a8140b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:41.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.979+0000 7f79af3e0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a80d3660 con 0x7f79a815db00 2024-04-25T10:02:41.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.979+0000 7f79af3e0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a80b61d0 con 0x7f79a80b53b0 2024-04-25T10:02:41.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.979+0000 7f79af3e0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a80b6c10 con 0x7f79a80ce2b0 2024-04-25T10:02:41.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.979+0000 7f79ad97d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79a815db00 0x7f79a8140b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:41.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.979+0000 7f79ad97d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79a815db00 0x7f79a8140b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47196/0 (socket says 172.21.15.7:47196) 2024-04-25T10:02:41.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.979+0000 7f79ad97d640 1 -- 172.21.15.7:0/663292516 learned_addr learned my addr 172.21.15.7:0/663292516 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:41.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.979+0000 7f79ad17c640 1 --2- 172.21.15.7:0/663292516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79a80b53b0 0x7f79a8160b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:41.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.979+0000 7f79ac97b640 1 --2- 172.21.15.7:0/663292516 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f79a80ce2b0 0x7f79a815e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:41.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.980+0000 7f79ad97d640 1 -- 172.21.15.7:0/663292516 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f79a80ce2b0 msgr2=0x7f79a815e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:41.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.980+0000 7f79ad97d640 1 --2- 172.21.15.7:0/663292516 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f79a80ce2b0 0x7f79a815e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:41.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.980+0000 7f79ad97d640 1 -- 172.21.15.7:0/663292516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79a80b53b0 msgr2=0x7f79a8160b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:41.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.980+0000 7f79ad97d640 1 --2- 172.21.15.7:0/663292516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79a80b53b0 0x7f79a8160b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:41.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.980+0000 7f79ad97d640 1 -- 172.21.15.7:0/663292516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a80c7f10 con 0x7f79a815db00 2024-04-25T10:02:41.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.980+0000 7f79ad17c640 1 --2- 172.21.15.7:0/663292516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79a80b53b0 0x7f79a8160b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:02:41.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.980+0000 7f79ac97b640 1 --2- 172.21.15.7:0/663292516 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f79a80ce2b0 0x7f79a815e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:02:41.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.980+0000 7f79ad97d640 1 --2- 172.21.15.7:0/663292516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79a815db00 0x7f79a8140b70 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f799800cef0 tx=0x7f799800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:41.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.980+0000 7f79a5ffb640 1 -- 172.21.15.7:0/663292516 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799801a070 con 0x7f79a815db00 2024-04-25T10:02:41.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.980+0000 7f79a5ffb640 1 -- 172.21.15.7:0/663292516 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799800d860 con 0x7f79a815db00 2024-04-25T10:02:41.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.980+0000 7f79af3e0640 1 -- 172.21.15.7:0/663292516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a80c81f0 con 0x7f79a815db00 2024-04-25T10:02:41.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.980+0000 7f79a5ffb640 1 -- 172.21.15.7:0/663292516 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799800dc50 con 0x7f79a815db00 2024-04-25T10:02:41.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.980+0000 7f79af3e0640 1 -- 172.21.15.7:0/663292516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a815e870 con 0x7f79a815db00 2024-04-25T10:02:41.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.981+0000 7f79af3e0640 1 -- 172.21.15.7:0/663292516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a8068fd0 con 0x7f79a815db00 2024-04-25T10:02:41.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.981+0000 7f79a5ffb640 1 -- 172.21.15.7:0/663292516 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f799801d070 con 0x7f79a815db00 2024-04-25T10:02:41.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.982+0000 7f79a5ffb640 1 --2- 172.21.15.7:0/663292516 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f799406b4d0 0x7f799406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:41.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.982+0000 7f79a5ffb640 1 -- 172.21.15.7:0/663292516 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f799808aa50 con 0x7f79a815db00 2024-04-25T10:02:41.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.982+0000 7f79ad17c640 1 --2- 172.21.15.7:0/663292516 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f799406b4d0 0x7f799406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:41.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.982+0000 7f79ad17c640 1 --2- 172.21.15.7:0/663292516 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f799406b4d0 0x7f799406d990 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f79a000a910 tx=0x7f79a0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:41.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:41.986+0000 7f79a5ffb640 1 -- 172.21.15.7:0/663292516 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f79980599c0 con 0x7f79a815db00 2024-04-25T10:02:42.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.243+0000 7f79af3e0640 1 -- 172.21.15.7:0/663292516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]} v 0) v1 -- 0x7f79a80d16b0 con 0x7f79a815db00 2024-04-25T10:02:42.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.524+0000 7f79a5ffb640 1 -- 172.21.15.7:0/663292516 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]}]=0 v395) v1 ==== 167+0+0 (secure 0 0 0) 0x7f79980592c0 con 0x7f79a815db00 2024-04-25T10:02:42.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.527+0000 7f79af3e0640 1 -- 172.21.15.7:0/663292516 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f799406b4d0 msgr2=0x7f799406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:42.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.527+0000 7f79af3e0640 1 --2- 172.21.15.7:0/663292516 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f799406b4d0 0x7f799406d990 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f79a000a910 tx=0x7f79a0008040 comp rx=0 tx=0).stop 2024-04-25T10:02:42.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.527+0000 7f79af3e0640 1 -- 172.21.15.7:0/663292516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79a815db00 msgr2=0x7f79a8140b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:42.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.527+0000 7f79af3e0640 1 --2- 172.21.15.7:0/663292516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79a815db00 0x7f79a8140b70 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f799800cef0 tx=0x7f799800a710 comp rx=0 tx=0).stop 2024-04-25T10:02:42.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.527+0000 7f79af3e0640 1 -- 172.21.15.7:0/663292516 shutdown_connections 2024-04-25T10:02:42.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.527+0000 7f79af3e0640 1 --2- 172.21.15.7:0/663292516 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f799406b4d0 0x7f799406d990 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:42.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.527+0000 7f79af3e0640 1 --2- 172.21.15.7:0/663292516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79a815db00 0x7f79a8140b70 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:42.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.527+0000 7f79af3e0640 1 --2- 172.21.15.7:0/663292516 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f79a80ce2b0 0x7f79a815e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:42.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.527+0000 7f79af3e0640 1 --2- 172.21.15.7:0/663292516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79a80b53b0 0x7f79a8160b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:42.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.527+0000 7f79af3e0640 1 -- 172.21.15.7:0/663292516 >> 172.21.15.7:0/663292516 conn(0x7f79a8072290 msgr2=0x7f79a80d4120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:42.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.527+0000 7f79af3e0640 1 -- 172.21.15.7:0/663292516 shutdown_connections 2024-04-25T10:02:42.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.527+0000 7f79af3e0640 1 -- 172.21.15.7:0/663292516 wait complete. 2024-04-25T10:02:42.544 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-04-25T10:02:42.544 INFO:tasks.cephfs_test_runner:Starting test: test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T10:02:42.544 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:02:42.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.642+0000 7fb3d8eb6640 1 Processor -- start 2024-04-25T10:02:42.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.642+0000 7fb3d8eb6640 1 -- start start 2024-04-25T10:02:42.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.643+0000 7fb3d8eb6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb3d415da60 0x7fb3d40d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:42.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.643+0000 7fb3d8eb6640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3d415de40 0x7fb3d415e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:42.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.643+0000 7fb3d8eb6640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d415e8a0 con 0x7fb3d4161d70 2024-04-25T10:02:42.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.643+0000 7fb3d8eb6640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d415eb80 con 0x7fb3d415da60 2024-04-25T10:02:42.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.643+0000 7fb3d8eb6640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d415ee60 con 0x7fb3d415de40 2024-04-25T10:02:42.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.643+0000 7fb3d2d9d640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb3d4161d70 0x7fb3d40ce520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38676/0 (socket says 172.21.15.7:38676) 2024-04-25T10:02:42.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.643+0000 7fb3d2d9d640 1 -- 172.21.15.7:0/1173955059 learned_addr learned my addr 172.21.15.7:0/1173955059 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:02:42.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.643+0000 7fb3d259c640 1 --2- 172.21.15.7:0/1173955059 >> v2:172.21.15.55:3300/0 conn(0x7fb3d415da60 0x7fb3d40d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:42.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.643+0000 7fb3d1d9b640 1 --2- 172.21.15.7:0/1173955059 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3d415de40 0x7fb3d415e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:42.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.643+0000 7fb3d159a640 1 -- 172.21.15.7:0/1173955059 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3197606344 0 0) 0x7fb3d415e8a0 con 0x7fb3d4161d70 2024-04-25T10:02:42.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.643+0000 7fb3d159a640 1 -- 172.21.15.7:0/1173955059 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3bc003520 con 0x7fb3d4161d70 2024-04-25T10:02:42.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.643+0000 7fb3d159a640 1 -- 172.21.15.7:0/1173955059 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 626244155 0 0) 0x7fb3bc003520 con 0x7fb3d4161d70 2024-04-25T10:02:42.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.643+0000 7fb3d159a640 1 -- 172.21.15.7:0/1173955059 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3d415de40 msgr2=0x7fb3d415e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:42.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.643+0000 7fb3d159a640 1 --2- 172.21.15.7:0/1173955059 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3d415de40 0x7fb3d415e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:42.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.643+0000 7fb3d159a640 1 -- 172.21.15.7:0/1173955059 >> v2:172.21.15.55:3300/0 conn(0x7fb3d415da60 msgr2=0x7fb3d40d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:42.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.643+0000 7fb3d159a640 1 --2- 172.21.15.7:0/1173955059 >> v2:172.21.15.55:3300/0 conn(0x7fb3d415da60 0x7fb3d40d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:42.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.643+0000 7fb3d159a640 1 -- 172.21.15.7:0/1173955059 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d4161850 con 0x7fb3d4161d70 2024-04-25T10:02:42.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.643+0000 7fb3d159a640 1 -- 172.21.15.7:0/1173955059 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fb3cc0019f0 con 0x7fb3d4161d70 2024-04-25T10:02:42.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.644+0000 7fb3d159a640 1 -- 172.21.15.7:0/1173955059 >> v1:172.21.15.7:6789/0 conn(0x7fb3d4161d70 legacy=0x7fb3d40ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:42.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.644+0000 7fb3d159a640 1 --2- 172.21.15.7:0/1173955059 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3d415de40 0x7fb3bc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:42.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.644+0000 7fb3d159a640 1 --2- 172.21.15.7:0/1173955059 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3bc003f30 0x7fb3bc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:42.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.644+0000 7fb3d159a640 1 --2- 172.21.15.7:0/1173955059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3bc004d40 0x7fb3bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:42.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.644+0000 7fb3d159a640 1 -- 172.21.15.7:0/1173955059 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d415eb80 con 0x7fb3bc004d40 2024-04-25T10:02:42.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.644+0000 7fb3d159a640 1 -- 172.21.15.7:0/1173955059 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d415ee60 con 0x7fb3bc003f30 2024-04-25T10:02:42.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.644+0000 7fb3d159a640 1 -- 172.21.15.7:0/1173955059 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc00ba10 con 0x7fb3d415de40 2024-04-25T10:02:42.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.644+0000 7fb3d2d9d640 1 --2- 172.21.15.7:0/1173955059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3bc004d40 0x7fb3bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:42.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.644+0000 7fb3d259c640 1 --2- 172.21.15.7:0/1173955059 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3d415de40 0x7fb3bc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:42.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.644+0000 7fb3d1d9b640 1 --2- 172.21.15.7:0/1173955059 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3bc003f30 0x7fb3bc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:42.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.644+0000 7fb3d2d9d640 1 -- 172.21.15.7:0/1173955059 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3d415de40 msgr2=0x7fb3bc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:42.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.644+0000 7fb3d2d9d640 1 --2- 172.21.15.7:0/1173955059 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3d415de40 0x7fb3bc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:42.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.644+0000 7fb3d2d9d640 1 -- 172.21.15.7:0/1173955059 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3bc003f30 msgr2=0x7fb3bc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:42.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.644+0000 7fb3d2d9d640 1 --2- 172.21.15.7:0/1173955059 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3bc003f30 0x7fb3bc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:42.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.644+0000 7fb3d2d9d640 1 -- 172.21.15.7:0/1173955059 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3bc003520 con 0x7fb3bc004d40 2024-04-25T10:02:42.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.645+0000 7fb3d2d9d640 1 --2- 172.21.15.7:0/1173955059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3bc004d40 0x7fb3bc0051c0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc00a890 tx=0x7fb3bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83c25d088bf69f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:42.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.645+0000 7fb3d159a640 1 -- 172.21.15.7:0/1173955059 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc00a4e0 con 0x7fb3bc004d40 2024-04-25T10:02:42.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.645+0000 7fb3d159a640 1 -- 172.21.15.7:0/1173955059 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3cc02f070 con 0x7fb3bc004d40 2024-04-25T10:02:42.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.645+0000 7fb3d159a640 1 -- 172.21.15.7:0/1173955059 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc02bcf0 con 0x7fb3bc004d40 2024-04-25T10:02:42.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.645+0000 7fb3d8eb6640 1 -- 172.21.15.7:0/1173955059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3bc004d40 msgr2=0x7fb3bc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:42.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.645+0000 7fb3d8eb6640 1 --2- 172.21.15.7:0/1173955059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3bc004d40 0x7fb3bc0051c0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc00a890 tx=0x7fb3bc005830 comp rx=0 tx=0).stop 2024-04-25T10:02:42.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.645+0000 7fb3d2d9d640 1 -- 172.21.15.7:0/1173955059 reap_dead start 2024-04-25T10:02:42.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.645+0000 7fb3d8eb6640 1 -- 172.21.15.7:0/1173955059 shutdown_connections 2024-04-25T10:02:42.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.645+0000 7fb3d8eb6640 1 -- 172.21.15.7:0/1173955059 >> 172.21.15.7:0/1173955059 conn(0x7fb3d406bfe0 msgr2=0x7fb3d406c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:42.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.645+0000 7fb3d8eb6640 1 -- 172.21.15.7:0/1173955059 shutdown_connections 2024-04-25T10:02:42.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.646+0000 7fb3d8eb6640 1 -- 172.21.15.7:0/1173955059 wait complete. 2024-04-25T10:02:42.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.647+0000 7fb3d8eb6640 1 Processor -- start 2024-04-25T10:02:42.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.647+0000 7fb3d8eb6640 1 -- start start 2024-04-25T10:02:42.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.647+0000 7fb3d8eb6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3bc004d40 0x7fb3d40b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:42.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.648+0000 7fb3d8eb6640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3d40b5f50 0x7fb3d414b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:42.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.648+0000 7fb3d8eb6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3d414bf10 0x7fb3d414c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:42.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.648+0000 7fb3d8eb6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d415e2a0 con 0x7fb3d414bf10 2024-04-25T10:02:42.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.648+0000 7fb3d8eb6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d40cee40 con 0x7fb3bc004d40 2024-04-25T10:02:42.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.648+0000 7fb3d8eb6640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d415e420 con 0x7fb3d40b5f50 2024-04-25T10:02:42.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.648+0000 7fb3d2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3d414bf10 0x7fb3d414c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:42.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.648+0000 7fb3d2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3d414bf10 0x7fb3d414c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47216/0 (socket says 172.21.15.7:47216) 2024-04-25T10:02:42.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.648+0000 7fb3d2d9d640 1 -- 172.21.15.7:0/90475689 learned_addr learned my addr 172.21.15.7:0/90475689 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:42.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.648+0000 7fb3d1d9b640 1 --2- 172.21.15.7:0/90475689 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3d40b5f50 0x7fb3d414b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:42.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.648+0000 7fb3d259c640 1 --2- 172.21.15.7:0/90475689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3bc004d40 0x7fb3d40b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:42.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.648+0000 7fb3d2d9d640 1 -- 172.21.15.7:0/90475689 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3d40b5f50 msgr2=0x7fb3d414b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:42.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.648+0000 7fb3d2d9d640 1 --2- 172.21.15.7:0/90475689 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3d40b5f50 0x7fb3d414b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:42.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.648+0000 7fb3d2d9d640 1 -- 172.21.15.7:0/90475689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3bc004d40 msgr2=0x7fb3d40b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:42.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.648+0000 7fb3d2d9d640 1 --2- 172.21.15.7:0/90475689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3bc004d40 0x7fb3d40b3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:42.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.648+0000 7fb3d2d9d640 1 -- 172.21.15.7:0/90475689 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d40b4630 con 0x7fb3d414bf10 2024-04-25T10:02:42.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.648+0000 7fb3d2d9d640 1 --2- 172.21.15.7:0/90475689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3d414bf10 0x7fb3d414c380 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc00a0b0 tx=0x7fb3cc001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:42.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.648+0000 7fb3c2ffd640 1 -- 172.21.15.7:0/90475689 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc002040 con 0x7fb3d414bf10 2024-04-25T10:02:42.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.648+0000 7fb3c2ffd640 1 -- 172.21.15.7:0/90475689 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3cc00a4c0 con 0x7fb3d414bf10 2024-04-25T10:02:42.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.648+0000 7fb3d8eb6640 1 -- 172.21.15.7:0/90475689 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d40b4910 con 0x7fb3d414bf10 2024-04-25T10:02:42.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.648+0000 7fb3c2ffd640 1 -- 172.21.15.7:0/90475689 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc034670 con 0x7fb3d414bf10 2024-04-25T10:02:42.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.648+0000 7fb3d8eb6640 1 -- 172.21.15.7:0/90475689 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d4149d50 con 0x7fb3d414bf10 2024-04-25T10:02:42.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.649+0000 7fb3d8eb6640 1 -- 172.21.15.7:0/90475689 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d4068fd0 con 0x7fb3d414bf10 2024-04-25T10:02:42.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.650+0000 7fb3c2ffd640 1 -- 172.21.15.7:0/90475689 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb3cc034810 con 0x7fb3d414bf10 2024-04-25T10:02:42.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.650+0000 7fb3c2ffd640 1 --2- 172.21.15.7:0/90475689 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb3b406b4d0 0x7fb3b406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:42.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.651+0000 7fb3c2ffd640 1 -- 172.21.15.7:0/90475689 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fb3cc0aa100 con 0x7fb3d414bf10 2024-04-25T10:02:42.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.651+0000 7fb3d259c640 1 --2- 172.21.15.7:0/90475689 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb3b406b4d0 0x7fb3b406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:42.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.651+0000 7fb3d259c640 1 --2- 172.21.15.7:0/90475689 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb3b406b4d0 0x7fb3b406d990 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4009b80 tx=0x7fb3c4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:42.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.655+0000 7fb3c2ffd640 1 -- 172.21.15.7:0/90475689 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb3cc0790d0 con 0x7fb3d414bf10 2024-04-25T10:02:42.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.837+0000 7fb3d8eb6640 1 -- 172.21.15.7:0/90475689 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3d40d1560 con 0x7fb3d414bf10 2024-04-25T10:02:42.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.838+0000 7fb3c2ffd640 1 -- 172.21.15.7:0/90475689 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+13452 (secure 0 0 0) 0x7fb3cc0789d0 con 0x7fb3d414bf10 2024-04-25T10:02:42.843 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:02:42.843 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":95,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:02:41.514965+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6837/1061077733":"2024-04-26T10:02:38.259964+0000","172.21.15.7:6836/1061077733":"2024-04-26T10:02:38.259964+0000","172.21.15.7:6837/3829085443":"2024-04-26T10:01:54.932349+0000","172.21.15.7:6836/3829085443":"2024-04-26T10:01:54.932349+0000","172.21.15.7:6837/2878753733":"2024-04-26T10:00:43.379350+0000","172.21.15.7:6836/2878753733":"2024-04-26T10:00:43.379350+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:02:42.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.840+0000 7fb3d8eb6640 1 -- 172.21.15.7:0/90475689 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb3b406b4d0 msgr2=0x7fb3b406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:42.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.840+0000 7fb3d8eb6640 1 --2- 172.21.15.7:0/90475689 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb3b406b4d0 0x7fb3b406d990 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4009b80 tx=0x7fb3c4008040 comp rx=0 tx=0).stop 2024-04-25T10:02:42.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.840+0000 7fb3d8eb6640 1 -- 172.21.15.7:0/90475689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3d414bf10 msgr2=0x7fb3d414c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:42.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.840+0000 7fb3d8eb6640 1 --2- 172.21.15.7:0/90475689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3d414bf10 0x7fb3d414c380 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc00a0b0 tx=0x7fb3cc001dc0 comp rx=0 tx=0).stop 2024-04-25T10:02:42.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.840+0000 7fb3d8eb6640 1 -- 172.21.15.7:0/90475689 shutdown_connections 2024-04-25T10:02:42.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.840+0000 7fb3d8eb6640 1 --2- 172.21.15.7:0/90475689 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb3b406b4d0 0x7fb3b406d990 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:42.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.840+0000 7fb3d8eb6640 1 --2- 172.21.15.7:0/90475689 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3d414bf10 0x7fb3d414c380 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:42.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.840+0000 7fb3d8eb6640 1 --2- 172.21.15.7:0/90475689 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3d40b5f50 0x7fb3d414b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:42.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.840+0000 7fb3d8eb6640 1 --2- 172.21.15.7:0/90475689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3bc004d40 0x7fb3d40b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:42.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.840+0000 7fb3d8eb6640 1 -- 172.21.15.7:0/90475689 >> 172.21.15.7:0/90475689 conn(0x7fb3d406bfe0 msgr2=0x7fb3d40d1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:42.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.840+0000 7fb3d8eb6640 1 -- 172.21.15.7:0/90475689 shutdown_connections 2024-04-25T10:02:42.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.840+0000 7fb3d8eb6640 1 -- 172.21.15.7:0/90475689 wait complete. 2024-04-25T10:02:42.856 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:02:42.856 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:02:42.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.955+0000 7f2b91ff5640 1 Processor -- start 2024-04-25T10:02:42.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.955+0000 7f2b91ff5640 1 -- start start 2024-04-25T10:02:42.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.956+0000 7f2b91ff5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2b8c0cda20 0x7f2b8c0cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:42.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.956+0000 7f2b91ff5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b8c09a100 0x7f2b8c15d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:42.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.956+0000 7f2b91ff5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b8c0d02f0 con 0x7f2b8c06bf10 2024-04-25T10:02:42.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.956+0000 7f2b91ff5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b8c0cde00 con 0x7f2b8c0cda20 2024-04-25T10:02:42.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.956+0000 7f2b91ff5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c0d05d0 con 0x7f2b8c09a100 2024-04-25T10:02:42.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.956+0000 7f2b8bfff640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b8c09a100 0x7f2b8c15d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:42.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.956+0000 7f2b8b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2b8c0cda20 0x7f2b8c0cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:42.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.956+0000 7f2b8affd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2b8c06bf10 0x7f2b8c0999f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:36388/0 (socket says 172.21.15.7:36388) 2024-04-25T10:02:42.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.956+0000 7f2b8affd640 1 -- 172.21.15.7:0/247140312 learned_addr learned my addr 172.21.15.7:0/247140312 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:02:42.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.956+0000 7f2b8a7fc640 1 -- 172.21.15.7:0/247140312 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3640919247 0 0) 0x7f2b8c0d02f0 con 0x7f2b8c06bf10 2024-04-25T10:02:42.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.956+0000 7f2b8a7fc640 1 -- 172.21.15.7:0/247140312 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b74003520 con 0x7f2b8c06bf10 2024-04-25T10:02:42.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.956+0000 7f2b8bfff640 1 -- 172.21.15.7:0/247140312 >> v2:172.21.15.55:3300/0 conn(0x7f2b8c0cda20 msgr2=0x7f2b8c0cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:42.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.956+0000 7f2b8bfff640 1 --2- 172.21.15.7:0/247140312 >> v2:172.21.15.55:3300/0 conn(0x7f2b8c0cda20 0x7f2b8c0cf9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:42.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.956+0000 7f2b8bfff640 1 -- 172.21.15.7:0/247140312 >> v1:172.21.15.55:6789/0 conn(0x7f2b8c06bf10 legacy=0x7f2b8c0999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:42.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.956+0000 7f2b8bfff640 1 -- 172.21.15.7:0/247140312 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8c0d08b0 con 0x7f2b8c09a100 2024-04-25T10:02:42.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.956+0000 7f2b8b7fe640 1 --2- 172.21.15.7:0/247140312 >> v2:172.21.15.55:3300/0 conn(0x7f2b8c0cda20 0x7f2b8c0cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:02:42.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.957+0000 7f2b8bfff640 1 --2- 172.21.15.7:0/247140312 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b8c09a100 0x7f2b8c15d290 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2b84009d90 tx=0x7f2b8402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d714d141d31cb030 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:42.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.957+0000 7f2b8a7fc640 1 -- 172.21.15.7:0/247140312 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b84007740 con 0x7f2b8c09a100 2024-04-25T10:02:42.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.957+0000 7f2b8a7fc640 1 -- 172.21.15.7:0/247140312 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b840078e0 con 0x7f2b8c09a100 2024-04-25T10:02:42.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.957+0000 7f2b8a7fc640 1 -- 172.21.15.7:0/247140312 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b84007c90 con 0x7f2b8c09a100 2024-04-25T10:02:42.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.958+0000 7f2b91ff5640 1 -- 172.21.15.7:0/247140312 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b8c09a100 msgr2=0x7f2b8c15d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:42.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.958+0000 7f2b91ff5640 1 --2- 172.21.15.7:0/247140312 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b8c09a100 0x7f2b8c15d290 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2b84009d90 tx=0x7f2b8402a660 comp rx=0 tx=0).stop 2024-04-25T10:02:42.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.958+0000 7f2b91ff5640 1 -- 172.21.15.7:0/247140312 shutdown_connections 2024-04-25T10:02:42.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.958+0000 7f2b91ff5640 1 --2- 172.21.15.7:0/247140312 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b8c09a100 0x7f2b8c15d290 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:42.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.958+0000 7f2b91ff5640 1 --2- 172.21.15.7:0/247140312 >> v2:172.21.15.55:3300/0 conn(0x7f2b8c0cda20 0x7f2b8c0cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:42.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.958+0000 7f2b91ff5640 1 -- 172.21.15.7:0/247140312 >> 172.21.15.7:0/247140312 conn(0x7f2b8c0b3110 msgr2=0x7f2b8c0b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:42.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.958+0000 7f2b91ff5640 1 -- 172.21.15.7:0/247140312 shutdown_connections 2024-04-25T10:02:42.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.958+0000 7f2b91ff5640 1 -- 172.21.15.7:0/247140312 wait complete. 2024-04-25T10:02:42.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.959+0000 7f2b91ff5640 1 Processor -- start 2024-04-25T10:02:42.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.959+0000 7f2b91ff5640 1 -- start start 2024-04-25T10:02:42.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.960+0000 7f2b91ff5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b8c06bf10 0x7f2b8c155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:42.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.960+0000 7f2b91ff5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8c09a100 0x7f2b8c0b6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:42.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.960+0000 7f2b91ff5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b8c0cda20 0x7f2b8c0af380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:42.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.960+0000 7f2b91ff5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c0cff10 con 0x7f2b8c09a100 2024-04-25T10:02:42.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.960+0000 7f2b91ff5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c0d0e70 con 0x7f2b8c0cda20 2024-04-25T10:02:42.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.960+0000 7f2b91ff5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c0d0090 con 0x7f2b8c06bf10 2024-04-25T10:02:42.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.960+0000 7f2b8affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8c09a100 0x7f2b8c0b6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:42.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.960+0000 7f2b8affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8c09a100 0x7f2b8c0b6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47220/0 (socket says 172.21.15.7:47220) 2024-04-25T10:02:42.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.960+0000 7f2b8affd640 1 -- 172.21.15.7:0/1213178792 learned_addr learned my addr 172.21.15.7:0/1213178792 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:42.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.960+0000 7f2b8bfff640 1 --2- 172.21.15.7:0/1213178792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b8c0cda20 0x7f2b8c0af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:42.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.960+0000 7f2b8b7fe640 1 --2- 172.21.15.7:0/1213178792 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b8c06bf10 0x7f2b8c155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:42.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.960+0000 7f2b8affd640 1 -- 172.21.15.7:0/1213178792 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b8c06bf10 msgr2=0x7f2b8c155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:42.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.960+0000 7f2b8affd640 1 --2- 172.21.15.7:0/1213178792 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b8c06bf10 0x7f2b8c155b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:42.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.960+0000 7f2b8affd640 1 -- 172.21.15.7:0/1213178792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b8c0cda20 msgr2=0x7f2b8c0af380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:42.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.960+0000 7f2b8affd640 1 --2- 172.21.15.7:0/1213178792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b8c0cda20 0x7f2b8c0af380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:42.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.960+0000 7f2b8affd640 1 -- 172.21.15.7:0/1213178792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8c1f6e80 con 0x7f2b8c09a100 2024-04-25T10:02:42.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.961+0000 7f2b8affd640 1 --2- 172.21.15.7:0/1213178792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8c09a100 0x7f2b8c0b6c00 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000c390 tx=0x7f2b8000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:42.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.961+0000 7f2b73fff640 1 -- 172.21.15.7:0/1213178792 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b80017070 con 0x7f2b8c09a100 2024-04-25T10:02:42.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.961+0000 7f2b73fff640 1 -- 172.21.15.7:0/1213178792 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b80005d00 con 0x7f2b8c09a100 2024-04-25T10:02:42.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.961+0000 7f2b91ff5640 1 -- 172.21.15.7:0/1213178792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b8c1f7160 con 0x7f2b8c09a100 2024-04-25T10:02:42.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.961+0000 7f2b73fff640 1 -- 172.21.15.7:0/1213178792 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b80007310 con 0x7f2b8c09a100 2024-04-25T10:02:42.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.961+0000 7f2b91ff5640 1 -- 172.21.15.7:0/1213178792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b8c1560b0 con 0x7f2b8c09a100 2024-04-25T10:02:42.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.962+0000 7f2b91ff5640 1 -- 172.21.15.7:0/1213178792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b8c068f60 con 0x7f2b8c09a100 2024-04-25T10:02:42.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.962+0000 7f2b73fff640 1 -- 172.21.15.7:0/1213178792 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2b8001a070 con 0x7f2b8c09a100 2024-04-25T10:02:42.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.963+0000 7f2b73fff640 1 --2- 172.21.15.7:0/1213178792 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2b7806b4d0 0x7f2b7806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:42.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.963+0000 7f2b8b7fe640 1 --2- 172.21.15.7:0/1213178792 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2b7806b4d0 0x7f2b7806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:42.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.963+0000 7f2b73fff640 1 -- 172.21.15.7:0/1213178792 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f2b80089480 con 0x7f2b8c09a100 2024-04-25T10:02:42.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.963+0000 7f2b8b7fe640 1 --2- 172.21.15.7:0/1213178792 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2b7806b4d0 0x7f2b7806d990 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c009560 tx=0x7f2b7c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:42.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:42.967+0000 7f2b73fff640 1 -- 172.21.15.7:0/1213178792 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2b80058450 con 0x7f2b8c09a100 2024-04-25T10:02:43.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.147+0000 7f2b91ff5640 1 -- 172.21.15.7:0/1213178792 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2b8c099a90 con 0x7f2b8c09a100 2024-04-25T10:02:43.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.147+0000 7f2b73fff640 1 -- 172.21.15.7:0/1213178792 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2b80057d50 con 0x7f2b8c09a100 2024-04-25T10:02:43.152 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T10:02:43.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.149+0000 7f2b91ff5640 1 -- 172.21.15.7:0/1213178792 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2b7806b4d0 msgr2=0x7f2b7806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:43.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.149+0000 7f2b91ff5640 1 --2- 172.21.15.7:0/1213178792 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2b7806b4d0 0x7f2b7806d990 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c009560 tx=0x7f2b7c008040 comp rx=0 tx=0).stop 2024-04-25T10:02:43.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.149+0000 7f2b91ff5640 1 -- 172.21.15.7:0/1213178792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8c09a100 msgr2=0x7f2b8c0b6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:43.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.149+0000 7f2b91ff5640 1 --2- 172.21.15.7:0/1213178792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8c09a100 0x7f2b8c0b6c00 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000c390 tx=0x7f2b8000c850 comp rx=0 tx=0).stop 2024-04-25T10:02:43.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.149+0000 7f2b91ff5640 1 -- 172.21.15.7:0/1213178792 shutdown_connections 2024-04-25T10:02:43.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.149+0000 7f2b91ff5640 1 --2- 172.21.15.7:0/1213178792 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2b7806b4d0 0x7f2b7806d990 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:43.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.149+0000 7f2b91ff5640 1 --2- 172.21.15.7:0/1213178792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b8c0cda20 0x7f2b8c0af380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:43.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.149+0000 7f2b91ff5640 1 --2- 172.21.15.7:0/1213178792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8c09a100 0x7f2b8c0b6c00 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:43.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.149+0000 7f2b91ff5640 1 --2- 172.21.15.7:0/1213178792 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2b8c06bf10 0x7f2b8c155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:43.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.149+0000 7f2b91ff5640 1 -- 172.21.15.7:0/1213178792 >> 172.21.15.7:0/1213178792 conn(0x7f2b8c0b3110 msgr2=0x7f2b8c070c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:43.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.149+0000 7f2b91ff5640 1 -- 172.21.15.7:0/1213178792 shutdown_connections 2024-04-25T10:02:43.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.149+0000 7f2b91ff5640 1 -- 172.21.15.7:0/1213178792 wait complete. 2024-04-25T10:02:43.166 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2024-04-25T10:02:43.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.263+0000 7ff0b5bf9640 1 Processor -- start 2024-04-25T10:02:43.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.263+0000 7ff0b5bf9640 1 -- start start 2024-04-25T10:02:43.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.263+0000 7ff0b5bf9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff0b015b8e0 0x7ff0b00d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:43.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.263+0000 7ff0b5bf9640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0b00cc300 0x7ff0b00999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:43.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.263+0000 7ff0b5bf9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0b009a340 con 0x7ff0b0099f30 2024-04-25T10:02:43.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.263+0000 7ff0b5bf9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0b00cd7d0 con 0x7ff0b015b8e0 2024-04-25T10:02:43.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.263+0000 7ff0b5bf9640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b00ccbc0 con 0x7ff0b00cc300 2024-04-25T10:02:43.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.264+0000 7ff0af7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff0b015b8e0 0x7ff0b00d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:43.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.264+0000 7ff0aeffd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0b00cc300 0x7ff0b00999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:43.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.264+0000 7ff0affff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff0b0099f30 0x7ff0b015f520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:36402/0 (socket says 172.21.15.7:36402) 2024-04-25T10:02:43.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.264+0000 7ff0affff640 1 -- 172.21.15.7:0/1310404774 learned_addr learned my addr 172.21.15.7:0/1310404774 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:02:43.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.264+0000 7ff0aeffd640 1 -- 172.21.15.7:0/1310404774 >> v2:172.21.15.55:3300/0 conn(0x7ff0b015b8e0 msgr2=0x7ff0b00d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:43.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.264+0000 7ff0aeffd640 1 --2- 172.21.15.7:0/1310404774 >> v2:172.21.15.55:3300/0 conn(0x7ff0b015b8e0 0x7ff0b00d0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:43.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.264+0000 7ff0aeffd640 1 -- 172.21.15.7:0/1310404774 >> v1:172.21.15.55:6789/0 conn(0x7ff0b0099f30 legacy=0x7ff0b015f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:43.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.264+0000 7ff0aeffd640 1 -- 172.21.15.7:0/1310404774 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b00ccea0 con 0x7ff0b00cc300 2024-04-25T10:02:43.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.265+0000 7ff0aeffd640 1 --2- 172.21.15.7:0/1310404774 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0b00cc300 0x7ff0b00999f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff0a40097a0 tx=0x7ff0a402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e3c4edc99cb4a25 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:43.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.265+0000 7ff0ae7fc640 1 -- 172.21.15.7:0/1310404774 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a4037070 con 0x7ff0b00cc300 2024-04-25T10:02:43.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.265+0000 7ff0ae7fc640 1 -- 172.21.15.7:0/1310404774 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a4032440 con 0x7ff0b00cc300 2024-04-25T10:02:43.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.265+0000 7ff0ae7fc640 1 -- 172.21.15.7:0/1310404774 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a4032810 con 0x7ff0b00cc300 2024-04-25T10:02:43.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.265+0000 7ff0b5bf9640 1 -- 172.21.15.7:0/1310404774 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0b00cc300 msgr2=0x7ff0b00999f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:43.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.265+0000 7ff0b5bf9640 1 --2- 172.21.15.7:0/1310404774 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0b00cc300 0x7ff0b00999f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff0a40097a0 tx=0x7ff0a402a180 comp rx=0 tx=0).stop 2024-04-25T10:02:43.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.266+0000 7ff0b5bf9640 1 -- 172.21.15.7:0/1310404774 shutdown_connections 2024-04-25T10:02:43.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.266+0000 7ff0b5bf9640 1 --2- 172.21.15.7:0/1310404774 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0b00cc300 0x7ff0b00999f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:43.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.266+0000 7ff0b5bf9640 1 --2- 172.21.15.7:0/1310404774 >> v2:172.21.15.55:3300/0 conn(0x7ff0b015b8e0 0x7ff0b00d0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:43.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.266+0000 7ff0b5bf9640 1 -- 172.21.15.7:0/1310404774 >> 172.21.15.7:0/1310404774 conn(0x7ff0b00b3130 msgr2=0x7ff0b00b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:43.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.266+0000 7ff0b5bf9640 1 -- 172.21.15.7:0/1310404774 shutdown_connections 2024-04-25T10:02:43.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.266+0000 7ff0b5bf9640 1 -- 172.21.15.7:0/1310404774 wait complete. 2024-04-25T10:02:43.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.267+0000 7ff0b5bf9640 1 Processor -- start 2024-04-25T10:02:43.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.267+0000 7ff0b5bf9640 1 -- start start 2024-04-25T10:02:43.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.268+0000 7ff0b5bf9640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0b0099f30 0x7ff0b006d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:43.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.268+0000 7ff0b5bf9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0b00cc300 0x7ff0b0158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:43.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.268+0000 7ff0b5bf9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0b015b8e0 0x7ff0b00c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:43.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.268+0000 7ff0b5bf9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b015bcc0 con 0x7ff0b015b8e0 2024-04-25T10:02:43.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.268+0000 7ff0b5bf9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b00cd460 con 0x7ff0b00cc300 2024-04-25T10:02:43.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.268+0000 7ff0b5bf9640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b015be40 con 0x7ff0b0099f30 2024-04-25T10:02:43.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.268+0000 7ff0affff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0b015b8e0 0x7ff0b00c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:43.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.268+0000 7ff0affff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0b015b8e0 0x7ff0b00c9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47222/0 (socket says 172.21.15.7:47222) 2024-04-25T10:02:43.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.268+0000 7ff0affff640 1 -- 172.21.15.7:0/3572836837 learned_addr learned my addr 172.21.15.7:0/3572836837 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:43.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.268+0000 7ff0af7fe640 1 --2- 172.21.15.7:0/3572836837 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0b0099f30 0x7ff0b006d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:43.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.268+0000 7ff0aeffd640 1 --2- 172.21.15.7:0/3572836837 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0b00cc300 0x7ff0b0158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:43.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.268+0000 7ff0affff640 1 -- 172.21.15.7:0/3572836837 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0b0099f30 msgr2=0x7ff0b006d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:43.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.268+0000 7ff0affff640 1 --2- 172.21.15.7:0/3572836837 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0b0099f30 0x7ff0b006d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:43.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.268+0000 7ff0affff640 1 -- 172.21.15.7:0/3572836837 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0b00cc300 msgr2=0x7ff0b0158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:43.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.268+0000 7ff0affff640 1 --2- 172.21.15.7:0/3572836837 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0b00cc300 0x7ff0b0158f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:43.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.268+0000 7ff0affff640 1 -- 172.21.15.7:0/3572836837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b0158150 con 0x7ff0b015b8e0 2024-04-25T10:02:43.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.268+0000 7ff0affff640 1 --2- 172.21.15.7:0/3572836837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0b015b8e0 0x7ff0b00c9f80 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7ff0a800cbf0 tx=0x7ff0a800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:43.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.268+0000 7ff097fff640 1 -- 172.21.15.7:0/3572836837 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a8017070 con 0x7ff0b015b8e0 2024-04-25T10:02:43.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.268+0000 7ff097fff640 1 -- 172.21.15.7:0/3572836837 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a800ad40 con 0x7ff0b015b8e0 2024-04-25T10:02:43.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.269+0000 7ff0b5bf9640 1 -- 172.21.15.7:0/3572836837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b0158430 con 0x7ff0b015b8e0 2024-04-25T10:02:43.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.269+0000 7ff097fff640 1 -- 172.21.15.7:0/3572836837 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a8012600 con 0x7ff0b015b8e0 2024-04-25T10:02:43.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.269+0000 7ff0b5bf9640 1 -- 172.21.15.7:0/3572836837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b01589f0 con 0x7ff0b015b8e0 2024-04-25T10:02:43.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.269+0000 7ff0b5bf9640 1 -- 172.21.15.7:0/3572836837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0b0068fd0 con 0x7ff0b015b8e0 2024-04-25T10:02:43.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.270+0000 7ff097fff640 1 -- 172.21.15.7:0/3572836837 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff0a801a070 con 0x7ff0b015b8e0 2024-04-25T10:02:43.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.270+0000 7ff097fff640 1 --2- 172.21.15.7:0/3572836837 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff09c06b4d0 0x7ff09c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:43.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.270+0000 7ff097fff640 1 -- 172.21.15.7:0/3572836837 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5507+0+0 (secure 0 0 0) 0x7ff0a8089da0 con 0x7ff0b015b8e0 2024-04-25T10:02:43.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.270+0000 7ff0af7fe640 1 --2- 172.21.15.7:0/3572836837 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff09c06b4d0 0x7ff09c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:43.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.271+0000 7ff0af7fe640 1 --2- 172.21.15.7:0/3572836837 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff09c06b4d0 0x7ff09c06d990 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff0b00cf7d0 tx=0x7ff0a0009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:43.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.275+0000 7ff097fff640 1 -- 172.21.15.7:0/3572836837 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff0b009a340 con 0x7ff0b015b8e0 2024-04-25T10:02:43.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:43.527+0000 7ff0b5bf9640 1 -- 172.21.15.7:0/3572836837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) v1 -- 0x7ff0b00b0810 con 0x7ff0b015b8e0 2024-04-25T10:02:44.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.537+0000 7ff097fff640 1 -- 172.21.15.7:0/3572836837 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v397) v1 ==== 149+0+0 (secure 0 0 0) 0x7ff0a8058690 con 0x7ff0b015b8e0 2024-04-25T10:02:44.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.539+0000 7ff0b5bf9640 1 -- 172.21.15.7:0/3572836837 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff09c06b4d0 msgr2=0x7ff09c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:44.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.539+0000 7ff0b5bf9640 1 --2- 172.21.15.7:0/3572836837 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff09c06b4d0 0x7ff09c06d990 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff0b00cf7d0 tx=0x7ff0a0009190 comp rx=0 tx=0).stop 2024-04-25T10:02:44.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.539+0000 7ff0b5bf9640 1 -- 172.21.15.7:0/3572836837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0b015b8e0 msgr2=0x7ff0b00c9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:44.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.539+0000 7ff0b5bf9640 1 --2- 172.21.15.7:0/3572836837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0b015b8e0 0x7ff0b00c9f80 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7ff0a800cbf0 tx=0x7ff0a800a430 comp rx=0 tx=0).stop 2024-04-25T10:02:44.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.540+0000 7ff0b5bf9640 1 -- 172.21.15.7:0/3572836837 shutdown_connections 2024-04-25T10:02:44.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.540+0000 7ff0b5bf9640 1 --2- 172.21.15.7:0/3572836837 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff09c06b4d0 0x7ff09c06d990 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:44.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.540+0000 7ff0b5bf9640 1 --2- 172.21.15.7:0/3572836837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0b015b8e0 0x7ff0b00c9f80 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:44.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.540+0000 7ff0b5bf9640 1 --2- 172.21.15.7:0/3572836837 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0b00cc300 0x7ff0b0158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:44.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.540+0000 7ff0b5bf9640 1 --2- 172.21.15.7:0/3572836837 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0b0099f30 0x7ff0b006d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:44.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.540+0000 7ff0b5bf9640 1 -- 172.21.15.7:0/3572836837 >> 172.21.15.7:0/3572836837 conn(0x7ff0b00b3130 msgr2=0x7ff0b00b1210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:44.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.540+0000 7ff0b5bf9640 1 -- 172.21.15.7:0/3572836837 shutdown_connections 2024-04-25T10:02:44.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.540+0000 7ff0b5bf9640 1 -- 172.21.15.7:0/3572836837 wait complete. 2024-04-25T10:02:44.558 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T10:02:44.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.664+0000 7ff46050a640 1 Processor -- start 2024-04-25T10:02:44.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.664+0000 7ff46050a640 1 -- start start 2024-04-25T10:02:44.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.665+0000 7ff46050a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff4580cfc40 0x7ff4580d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:44.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.665+0000 7ff46050a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff4580cc580 0x7ff4580cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:44.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.665+0000 7ff46050a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4580b25e0 con 0x7ff4580b1480 2024-04-25T10:02:44.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.665+0000 7ff46050a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff45815bec0 con 0x7ff4580cc580 2024-04-25T10:02:44.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.665+0000 7ff46050a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4580d0560 con 0x7ff4580cfc40 2024-04-25T10:02:44.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.665+0000 7ff45eaa7640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff4580cc580 0x7ff4580cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:44.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.665+0000 7ff45daa5640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff4580b1480 0x7ff4580b0ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38686/0 (socket says 172.21.15.7:38686) 2024-04-25T10:02:44.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.665+0000 7ff45eaa7640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff4580cc580 0x7ff4580cc9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47234/0 (socket says 172.21.15.7:47234) 2024-04-25T10:02:44.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.665+0000 7ff45daa5640 1 -- 172.21.15.7:0/569263476 learned_addr learned my addr 172.21.15.7:0/569263476 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:02:44.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.665+0000 7ff45e2a6640 1 --2- 172.21.15.7:0/569263476 >> v2:172.21.15.55:3300/0 conn(0x7ff4580cfc40 0x7ff4580d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:44.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.665+0000 7ff45eaa7640 1 -- 172.21.15.7:0/569263476 >> v2:172.21.15.55:3300/0 conn(0x7ff4580cfc40 msgr2=0x7ff4580d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:44.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.665+0000 7ff45eaa7640 1 --2- 172.21.15.7:0/569263476 >> v2:172.21.15.55:3300/0 conn(0x7ff4580cfc40 0x7ff4580d0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:44.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.665+0000 7ff45eaa7640 1 -- 172.21.15.7:0/569263476 >> v1:172.21.15.7:6789/0 conn(0x7ff4580b1480 legacy=0x7ff4580b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:44.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.665+0000 7ff45eaa7640 1 -- 172.21.15.7:0/569263476 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4580b19d0 con 0x7ff4580cc580 2024-04-25T10:02:44.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.665+0000 7ff45d2a4640 1 -- 172.21.15.7:0/569263476 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3003337636 0 0) 0x7ff4580b25e0 con 0x7ff4580b1480 2024-04-25T10:02:44.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.666+0000 7ff45eaa7640 1 --2- 172.21.15.7:0/569263476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4580cc580 0x7ff4580cc9d0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7ff4580cf110 tx=0x7ff45002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e1d3f8bac21229 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:44.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.666+0000 7ff45d2a4640 1 -- 172.21.15.7:0/569263476 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450007740 con 0x7ff4580cc580 2024-04-25T10:02:44.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.666+0000 7ff45d2a4640 1 -- 172.21.15.7:0/569263476 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4500078e0 con 0x7ff4580cc580 2024-04-25T10:02:44.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.666+0000 7ff45d2a4640 1 -- 172.21.15.7:0/569263476 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450007cb0 con 0x7ff4580cc580 2024-04-25T10:02:44.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.666+0000 7ff46050a640 1 -- 172.21.15.7:0/569263476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4580cc580 msgr2=0x7ff4580cc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:44.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.666+0000 7ff46050a640 1 --2- 172.21.15.7:0/569263476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4580cc580 0x7ff4580cc9d0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7ff4580cf110 tx=0x7ff45002a5f0 comp rx=0 tx=0).stop 2024-04-25T10:02:44.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.667+0000 7ff46050a640 1 -- 172.21.15.7:0/569263476 shutdown_connections 2024-04-25T10:02:44.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.667+0000 7ff46050a640 1 --2- 172.21.15.7:0/569263476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4580cc580 0x7ff4580cc9d0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:44.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.667+0000 7ff46050a640 1 --2- 172.21.15.7:0/569263476 >> v2:172.21.15.55:3300/0 conn(0x7ff4580cfc40 0x7ff4580d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:44.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.667+0000 7ff46050a640 1 -- 172.21.15.7:0/569263476 >> 172.21.15.7:0/569263476 conn(0x7ff45808af80 msgr2=0x7ff45808b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:44.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.667+0000 7ff46050a640 1 -- 172.21.15.7:0/569263476 shutdown_connections 2024-04-25T10:02:44.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.667+0000 7ff46050a640 1 -- 172.21.15.7:0/569263476 wait complete. 2024-04-25T10:02:44.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.668+0000 7ff46050a640 1 Processor -- start 2024-04-25T10:02:44.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.668+0000 7ff46050a640 1 -- start start 2024-04-25T10:02:44.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.669+0000 7ff46050a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4580b1480 0x7ff4581f4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:44.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.669+0000 7ff46050a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4580cc580 0x7ff4580ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:44.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.669+0000 7ff46050a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4580cfc40 0x7ff4581e48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:44.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.669+0000 7ff46050a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4580b2270 con 0x7ff4580cfc40 2024-04-25T10:02:44.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.669+0000 7ff46050a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4580b1f90 con 0x7ff4580cc580 2024-04-25T10:02:44.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.669+0000 7ff46050a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4580ccf10 con 0x7ff4580b1480 2024-04-25T10:02:44.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.669+0000 7ff45eaa7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4580cfc40 0x7ff4581e48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:44.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.669+0000 7ff45eaa7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4580cfc40 0x7ff4581e48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47246/0 (socket says 172.21.15.7:47246) 2024-04-25T10:02:44.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.669+0000 7ff45eaa7640 1 -- 172.21.15.7:0/3012134057 learned_addr learned my addr 172.21.15.7:0/3012134057 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:44.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.669+0000 7ff45daa5640 1 --2- 172.21.15.7:0/3012134057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4580cc580 0x7ff4580ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:44.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.669+0000 7ff45e2a6640 1 --2- 172.21.15.7:0/3012134057 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4580b1480 0x7ff4581f4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:44.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.669+0000 7ff45eaa7640 1 -- 172.21.15.7:0/3012134057 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4580b1480 msgr2=0x7ff4581f4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:44.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.669+0000 7ff45eaa7640 1 --2- 172.21.15.7:0/3012134057 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4580b1480 0x7ff4581f4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:44.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.669+0000 7ff45eaa7640 1 -- 172.21.15.7:0/3012134057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4580cc580 msgr2=0x7ff4580ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:44.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.669+0000 7ff45eaa7640 1 --2- 172.21.15.7:0/3012134057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4580cc580 0x7ff4580ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:44.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.669+0000 7ff45eaa7640 1 -- 172.21.15.7:0/3012134057 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4580c8730 con 0x7ff4580cfc40 2024-04-25T10:02:44.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.669+0000 7ff45e2a6640 1 --2- 172.21.15.7:0/3012134057 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4580b1480 0x7ff4581f4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:02:44.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.669+0000 7ff45eaa7640 1 --2- 172.21.15.7:0/3012134057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4580cfc40 0x7ff4581e48d0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7ff45002abe0 tx=0x7ff450004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:44.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.669+0000 7ff44effd640 1 -- 172.21.15.7:0/3012134057 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450040070 con 0x7ff4580cfc40 2024-04-25T10:02:44.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.669+0000 7ff44effd640 1 -- 172.21.15.7:0/3012134057 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff450031c40 con 0x7ff4580cfc40 2024-04-25T10:02:44.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.669+0000 7ff44effd640 1 -- 172.21.15.7:0/3012134057 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450009450 con 0x7ff4580cfc40 2024-04-25T10:02:44.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.669+0000 7ff46050a640 1 -- 172.21.15.7:0/3012134057 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4580c8a10 con 0x7ff4580cfc40 2024-04-25T10:02:44.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.670+0000 7ff46050a640 1 -- 172.21.15.7:0/3012134057 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4580c8fd0 con 0x7ff4580cfc40 2024-04-25T10:02:44.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.670+0000 7ff46050a640 1 -- 172.21.15.7:0/3012134057 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff458068f60 con 0x7ff4580cfc40 2024-04-25T10:02:44.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.671+0000 7ff44effd640 1 -- 172.21.15.7:0/3012134057 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff450039040 con 0x7ff4580cfc40 2024-04-25T10:02:44.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.671+0000 7ff44effd640 1 --2- 172.21.15.7:0/3012134057 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff43c06b4d0 0x7ff43c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:44.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.671+0000 7ff44effd640 1 -- 172.21.15.7:0/3012134057 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5507+0+0 (secure 0 0 0) 0x7ff4500ab2f0 con 0x7ff4580cfc40 2024-04-25T10:02:44.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.671+0000 7ff45e2a6640 1 --2- 172.21.15.7:0/3012134057 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff43c06b4d0 0x7ff43c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:44.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.672+0000 7ff45e2a6640 1 --2- 172.21.15.7:0/3012134057 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff43c06b4d0 0x7ff43c06d990 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff454006fd0 tx=0x7ff454008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:44.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.676+0000 7ff44effd640 1 -- 172.21.15.7:0/3012134057 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff45007a2c0 con 0x7ff4580cfc40 2024-04-25T10:02:44.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.860+0000 7ff46050a640 1 -- 172.21.15.7:0/3012134057 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff4580ce490 con 0x7ff4580cfc40 2024-04-25T10:02:44.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.864+0000 7ff44effd640 1 -- 172.21.15.7:0/3012134057 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff450079bc0 con 0x7ff4580cfc40 2024-04-25T10:02:44.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.866+0000 7ff46050a640 1 -- 172.21.15.7:0/3012134057 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff43c06b4d0 msgr2=0x7ff43c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:44.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.866+0000 7ff46050a640 1 --2- 172.21.15.7:0/3012134057 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff43c06b4d0 0x7ff43c06d990 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff454006fd0 tx=0x7ff454008040 comp rx=0 tx=0).stop 2024-04-25T10:02:44.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.866+0000 7ff46050a640 1 -- 172.21.15.7:0/3012134057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4580cfc40 msgr2=0x7ff4581e48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:44.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.866+0000 7ff46050a640 1 --2- 172.21.15.7:0/3012134057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4580cfc40 0x7ff4581e48d0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7ff45002abe0 tx=0x7ff450004a40 comp rx=0 tx=0).stop 2024-04-25T10:02:44.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.866+0000 7ff46050a640 1 -- 172.21.15.7:0/3012134057 shutdown_connections 2024-04-25T10:02:44.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.866+0000 7ff46050a640 1 --2- 172.21.15.7:0/3012134057 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff43c06b4d0 0x7ff43c06d990 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:44.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.866+0000 7ff46050a640 1 --2- 172.21.15.7:0/3012134057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4580cfc40 0x7ff4581e48d0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:44.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.866+0000 7ff46050a640 1 --2- 172.21.15.7:0/3012134057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4580cc580 0x7ff4580ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:44.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.866+0000 7ff46050a640 1 --2- 172.21.15.7:0/3012134057 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff4580b1480 0x7ff4581f4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:44.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.866+0000 7ff46050a640 1 -- 172.21.15.7:0/3012134057 >> 172.21.15.7:0/3012134057 conn(0x7ff45808af80 msgr2=0x7ff45806f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:44.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.866+0000 7ff46050a640 1 -- 172.21.15.7:0/3012134057 shutdown_connections 2024-04-25T10:02:44.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:44.866+0000 7ff46050a640 1 -- 172.21.15.7:0/3012134057 wait complete. 2024-04-25T10:02:44.882 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T10:02:44.882 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:02:44.918 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:02:44.962 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T10:02:44.962 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:02:44.962 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:02:44.977 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13704 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:02:44.978 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T10:02:44.978 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:02:45.021 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19023 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:02:45.022 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:02:45.022 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:02:45.037 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13704 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:02:45.037 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T10:02:45.038 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:02:45.080 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19023 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:02:45.081 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T10:02:45.081 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:02:45.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.176+0000 7f2fe2f7e640 1 Processor -- start 2024-04-25T10:02:45.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.176+0000 7f2fe2f7e640 1 -- start start 2024-04-25T10:02:45.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.177+0000 7f2fe2f7e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2fdc15db00 0x7f2fdc0d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:45.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.177+0000 7f2fe2f7e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2fdc0b53b0 0x7f2fdc0d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:45.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.177+0000 7f2fe2f7e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2fdc0ce2b0 0x7f2fdc161670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:45.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.177+0000 7f2fe2f7e640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fdc0d1e80 con 0x7f2fdc0b53b0 2024-04-25T10:02:45.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.177+0000 7f2fe2f7e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fdc0b5930 con 0x7f2fdc15db00 2024-04-25T10:02:45.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.177+0000 7f2fe2f7e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc0b5c10 con 0x7f2fdc0ce2b0 2024-04-25T10:02:45.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.177+0000 7f2fdbfff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2fdc0b53b0 0x7f2fdc0d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:45.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.177+0000 7f2fdbfff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2fdc0b53b0 0x7f2fdc0d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47254/0 (socket says 172.21.15.7:47254) 2024-04-25T10:02:45.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.177+0000 7f2fdbfff640 1 -- 172.21.15.7:0/3090596279 learned_addr learned my addr 172.21.15.7:0/3090596279 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:45.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.177+0000 7f2fe151b640 1 --2- 172.21.15.7:0/3090596279 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2fdc0ce2b0 0x7f2fdc161670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:45.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.178+0000 7f2fe0d1a640 1 --2- 172.21.15.7:0/3090596279 >> v2:172.21.15.55:3300/0 conn(0x7f2fdc15db00 0x7f2fdc0d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:45.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.178+0000 7f2fdbfff640 1 -- 172.21.15.7:0/3090596279 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2fdc0ce2b0 msgr2=0x7f2fdc161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:45.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.178+0000 7f2fdbfff640 1 --2- 172.21.15.7:0/3090596279 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2fdc0ce2b0 0x7f2fdc161670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:45.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.178+0000 7f2fdbfff640 1 -- 172.21.15.7:0/3090596279 >> v2:172.21.15.55:3300/0 conn(0x7f2fdc15db00 msgr2=0x7f2fdc0d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:45.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.178+0000 7f2fdbfff640 1 --2- 172.21.15.7:0/3090596279 >> v2:172.21.15.55:3300/0 conn(0x7f2fdc15db00 0x7f2fdc0d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:45.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.178+0000 7f2fdbfff640 1 -- 172.21.15.7:0/3090596279 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc0b5ef0 con 0x7f2fdc0b53b0 2024-04-25T10:02:45.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.178+0000 7f2fdbfff640 1 --2- 172.21.15.7:0/3090596279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fdc0b53b0 0x7f2fdc0d0880 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0d4940 tx=0x7f2fd002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ca9a7db9a1ea16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:45.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.178+0000 7f2fdb7fe640 1 -- 172.21.15.7:0/3090596279 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0037070 con 0x7f2fdc0b53b0 2024-04-25T10:02:45.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.178+0000 7f2fdb7fe640 1 -- 172.21.15.7:0/3090596279 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd0032440 con 0x7f2fdc0b53b0 2024-04-25T10:02:45.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.179+0000 7f2fdb7fe640 1 -- 172.21.15.7:0/3090596279 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0032810 con 0x7f2fdc0b53b0 2024-04-25T10:02:45.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.179+0000 7f2fe2f7e640 1 -- 172.21.15.7:0/3090596279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fdc0b53b0 msgr2=0x7f2fdc0d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:45.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.179+0000 7f2fe2f7e640 1 --2- 172.21.15.7:0/3090596279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fdc0b53b0 0x7f2fdc0d0880 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0d4940 tx=0x7f2fd002a1e0 comp rx=0 tx=0).stop 2024-04-25T10:02:45.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.179+0000 7f2fe2f7e640 1 -- 172.21.15.7:0/3090596279 shutdown_connections 2024-04-25T10:02:45.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.179+0000 7f2fe2f7e640 1 --2- 172.21.15.7:0/3090596279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fdc0b53b0 0x7f2fdc0d0880 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:45.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.179+0000 7f2fe2f7e640 1 --2- 172.21.15.7:0/3090596279 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2fdc0ce2b0 0x7f2fdc161670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:45.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.179+0000 7f2fe2f7e640 1 --2- 172.21.15.7:0/3090596279 >> v2:172.21.15.55:3300/0 conn(0x7f2fdc15db00 0x7f2fdc0d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:45.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.179+0000 7f2fe2f7e640 1 -- 172.21.15.7:0/3090596279 >> 172.21.15.7:0/3090596279 conn(0x7f2fdc072290 msgr2=0x7f2fdc0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:45.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.179+0000 7f2fe2f7e640 1 -- 172.21.15.7:0/3090596279 shutdown_connections 2024-04-25T10:02:45.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.179+0000 7f2fe2f7e640 1 -- 172.21.15.7:0/3090596279 wait complete. 2024-04-25T10:02:45.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.180+0000 7f2fe2f7e640 1 Processor -- start 2024-04-25T10:02:45.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.180+0000 7f2fe2f7e640 1 -- start start 2024-04-25T10:02:45.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.181+0000 7f2fe2f7e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fdc0b53b0 0x7f2fdc149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:45.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.181+0000 7f2fe2f7e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fdc0ce2b0 0x7f2fdc159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:45.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.181+0000 7f2fe2f7e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2fdc15db00 0x7f2fdc1596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:45.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.181+0000 7f2fe2f7e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc0d3660 con 0x7f2fdc0b53b0 2024-04-25T10:02:45.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.181+0000 7f2fe2f7e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc0b61d0 con 0x7f2fdc0ce2b0 2024-04-25T10:02:45.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.181+0000 7f2fe2f7e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc0b6c10 con 0x7f2fdc15db00 2024-04-25T10:02:45.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.181+0000 7f2fe0d1a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fdc0b53b0 0x7f2fdc149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:45.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.181+0000 7f2fe0d1a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fdc0b53b0 0x7f2fdc149690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47260/0 (socket says 172.21.15.7:47260) 2024-04-25T10:02:45.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.181+0000 7f2fe0d1a640 1 -- 172.21.15.7:0/1936493045 learned_addr learned my addr 172.21.15.7:0/1936493045 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:45.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.181+0000 7f2fe151b640 1 --2- 172.21.15.7:0/1936493045 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2fdc15db00 0x7f2fdc1596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:45.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.181+0000 7f2fdbfff640 1 --2- 172.21.15.7:0/1936493045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fdc0ce2b0 0x7f2fdc159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:45.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.181+0000 7f2fe0d1a640 1 -- 172.21.15.7:0/1936493045 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2fdc15db00 msgr2=0x7f2fdc1596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:45.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.182+0000 7f2fe0d1a640 1 --2- 172.21.15.7:0/1936493045 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2fdc15db00 0x7f2fdc1596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:45.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.182+0000 7f2fe0d1a640 1 -- 172.21.15.7:0/1936493045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fdc0ce2b0 msgr2=0x7f2fdc159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:45.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.182+0000 7f2fe0d1a640 1 --2- 172.21.15.7:0/1936493045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fdc0ce2b0 0x7f2fdc159160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:45.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.182+0000 7f2fe0d1a640 1 -- 172.21.15.7:0/1936493045 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc0d41d0 con 0x7f2fdc0b53b0 2024-04-25T10:02:45.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.182+0000 7f2fe0d1a640 1 --2- 172.21.15.7:0/1936493045 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fdc0b53b0 0x7f2fdc149690 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4007e40 tx=0x7f2fd400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:45.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.182+0000 7f2fd97fa640 1 -- 172.21.15.7:0/1936493045 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4014620 con 0x7f2fdc0b53b0 2024-04-25T10:02:45.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.182+0000 7f2fd97fa640 1 -- 172.21.15.7:0/1936493045 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd4019070 con 0x7f2fdc0b53b0 2024-04-25T10:02:45.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.182+0000 7f2fd97fa640 1 -- 172.21.15.7:0/1936493045 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4014a00 con 0x7f2fdc0b53b0 2024-04-25T10:02:45.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.182+0000 7f2fe2f7e640 1 -- 172.21.15.7:0/1936493045 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fdc15e290 con 0x7f2fdc0b53b0 2024-04-25T10:02:45.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.182+0000 7f2fe2f7e640 1 -- 172.21.15.7:0/1936493045 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fdc15e810 con 0x7f2fdc0b53b0 2024-04-25T10:02:45.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.183+0000 7f2fe2f7e640 1 -- 172.21.15.7:0/1936493045 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fdc068fd0 con 0x7f2fdc0b53b0 2024-04-25T10:02:45.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.183+0000 7f2fd97fa640 1 -- 172.21.15.7:0/1936493045 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2fd4014ba0 con 0x7f2fdc0b53b0 2024-04-25T10:02:45.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.184+0000 7f2fd97fa640 1 --2- 172.21.15.7:0/1936493045 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2fc806b4d0 0x7f2fc806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:45.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.184+0000 7f2fd97fa640 1 -- 172.21.15.7:0/1936493045 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f2fd408aa60 con 0x7f2fdc0b53b0 2024-04-25T10:02:45.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.184+0000 7f2fdbfff640 1 --2- 172.21.15.7:0/1936493045 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2fc806b4d0 0x7f2fc806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:45.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.184+0000 7f2fdbfff640 1 --2- 172.21.15.7:0/1936493045 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2fc806b4d0 0x7f2fc806d990 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0034000 tx=0x7f2fd002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:45.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.188+0000 7f2fd97fa640 1 -- 172.21.15.7:0/1936493045 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2fd4059870 con 0x7f2fdc0b53b0 2024-04-25T10:02:45.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.404+0000 7f2fe2f7e640 1 -- 172.21.15.7:0/1936493045 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2fdc0d16b0 con 0x7f2fdc0b53b0 2024-04-25T10:02:45.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.405+0000 7f2fd97fa640 1 -- 172.21.15.7:0/1936493045 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+3693 (secure 0 0 0) 0x7f2fd4059170 con 0x7f2fdc0b53b0 2024-04-25T10:02:45.410 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:02:45.410 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":68,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2505539422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2505539422},{"type":"v1","addr":"172.21.15.55:6834","nonce":2505539422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2808857776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2808857776},{"type":"v1","addr":"172.21.15.55:6835","nonce":2808857776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":7518,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/1796103144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1796103144},{"type":"v1","addr":"172.21.15.7:6835","nonce":1796103144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":8295,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2474084120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2474084120},{"type":"v1","addr":"172.21.15.7:6837","nonce":2474084120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[]} 2024-04-25T10:02:45.410 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 68 2024-04-25T10:02:45.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.406+0000 7f2fe2f7e640 1 -- 172.21.15.7:0/1936493045 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2fc806b4d0 msgr2=0x7f2fc806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:45.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.407+0000 7f2fe2f7e640 1 --2- 172.21.15.7:0/1936493045 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2fc806b4d0 0x7f2fc806d990 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0034000 tx=0x7f2fd002e000 comp rx=0 tx=0).stop 2024-04-25T10:02:45.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.407+0000 7f2fe2f7e640 1 -- 172.21.15.7:0/1936493045 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fdc0b53b0 msgr2=0x7f2fdc149690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:45.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.407+0000 7f2fe2f7e640 1 --2- 172.21.15.7:0/1936493045 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fdc0b53b0 0x7f2fdc149690 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4007e40 tx=0x7f2fd400e4b0 comp rx=0 tx=0).stop 2024-04-25T10:02:45.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.407+0000 7f2fe2f7e640 1 -- 172.21.15.7:0/1936493045 shutdown_connections 2024-04-25T10:02:45.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.407+0000 7f2fe2f7e640 1 --2- 172.21.15.7:0/1936493045 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2fc806b4d0 0x7f2fc806d990 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:45.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.407+0000 7f2fe2f7e640 1 --2- 172.21.15.7:0/1936493045 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2fdc15db00 0x7f2fdc1596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:45.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.407+0000 7f2fe2f7e640 1 --2- 172.21.15.7:0/1936493045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fdc0ce2b0 0x7f2fdc159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:45.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.407+0000 7f2fe2f7e640 1 --2- 172.21.15.7:0/1936493045 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2fdc0b53b0 0x7f2fdc149690 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:45.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.407+0000 7f2fe2f7e640 1 -- 172.21.15.7:0/1936493045 >> 172.21.15.7:0/1936493045 conn(0x7f2fdc072290 msgr2=0x7f2fdc0d37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:45.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.407+0000 7f2fe2f7e640 1 -- 172.21.15.7:0/1936493045 shutdown_connections 2024-04-25T10:02:45.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.407+0000 7f2fe2f7e640 1 -- 172.21.15.7:0/1936493045 wait complete. 2024-04-25T10:02:45.423 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T10:02:45.424 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T10:02:45.424 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T10:02:45.424 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:02:45.424 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T10:02:45.424 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T10:02:45.424 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T10:02:45.424 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:02:45.425 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T10:02:45.425 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T10:02:45.425 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T10:02:45.425 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:02:45.425 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T10:02:45.425 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T10:02:45.425 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T10:02:45.426 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:02:45.433 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T10:02:45.434 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T10:02:45.434 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T10:02:45.435 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T10:02:45.438 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T10:02:45.438 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T10:02:45.439 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T10:02:45.439 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T10:02:45.476 INFO:tasks.ceph.mds.a:Started 2024-04-25T10:02:45.477 DEBUG:teuthology.parallel:result is None 2024-04-25T10:02:45.477 INFO:tasks.ceph.mds.c:Started 2024-04-25T10:02:45.477 DEBUG:teuthology.parallel:result is None 2024-04-25T10:02:45.481 INFO:tasks.ceph.mds.b:Started 2024-04-25T10:02:45.481 DEBUG:teuthology.parallel:result is None 2024-04-25T10:02:45.481 INFO:tasks.ceph.mds.d:Started 2024-04-25T10:02:45.482 DEBUG:teuthology.parallel:result is None 2024-04-25T10:02:45.482 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T10:02:45.553 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-04-25T10:02:45.553 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-04-25T10:02:45.566 INFO:tasks.ceph.mds.b.smithi055.stdout:starting mds.b at 2024-04-25T10:02:45.567 INFO:tasks.ceph.mds.d.smithi055.stdout:starting mds.d at 2024-04-25T10:02:45.567 INFO:tasks.ceph.mds.d.smithi055.stderr:2024-04-25T10:02:45.563+0000 7f9c2770e640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-04-25T10:02:45.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.584+0000 7f819ae9e640 1 Processor -- start 2024-04-25T10:02:45.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.584+0000 7f819ae9e640 1 -- start start 2024-04-25T10:02:45.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.585+0000 7f819ae9e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f81940726e0 0x7f819415c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:45.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.585+0000 7f819ae9e640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819415f500 con 0x7f819406b270 2024-04-25T10:02:45.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.585+0000 7f819ae9e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819415f7e0 con 0x7f8194145260 2024-04-25T10:02:45.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.585+0000 7f819ae9e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8194160110 con 0x7f81940726e0 2024-04-25T10:02:45.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.585+0000 7f8193fff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f819406b270 0x7f819415d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38692/0 (socket says 172.21.15.7:38692) 2024-04-25T10:02:45.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.585+0000 7f8193fff640 1 -- 172.21.15.7:0/3765695385 learned_addr learned my addr 172.21.15.7:0/3765695385 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:02:45.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.585+0000 7f819943b640 1 --2- 172.21.15.7:0/3765695385 >> v2:172.21.15.55:3300/0 conn(0x7f81940726e0 0x7f819415c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:45.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.585+0000 7f81937fe640 1 -- 172.21.15.7:0/3765695385 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 23573586 0 0) 0x7f819415f500 con 0x7f819406b270 2024-04-25T10:02:45.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.585+0000 7f81937fe640 1 -- 172.21.15.7:0/3765695385 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8184003520 con 0x7f819406b270 2024-04-25T10:02:45.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.585+0000 7f81937fe640 1 -- 172.21.15.7:0/3765695385 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1751540933 0 0) 0x7f8184003520 con 0x7f819406b270 2024-04-25T10:02:45.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.585+0000 7f81937fe640 1 -- 172.21.15.7:0/3765695385 >> v2:172.21.15.55:3300/0 conn(0x7f81940726e0 msgr2=0x7f819415c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:45.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.585+0000 7f81937fe640 1 --2- 172.21.15.7:0/3765695385 >> v2:172.21.15.55:3300/0 conn(0x7f81940726e0 0x7f819415c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:45.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.585+0000 7f81937fe640 1 -- 172.21.15.7:0/3765695385 >> v1:172.21.15.55:6789/0 conn(0x7f8194145260 legacy=0x7f819406ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:45.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.585+0000 7f81937fe640 1 -- 172.21.15.7:0/3765695385 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819415fac0 con 0x7f819406b270 2024-04-25T10:02:45.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.585+0000 7f81937fe640 1 -- 172.21.15.7:0/3765695385 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f8180001670 con 0x7f819406b270 2024-04-25T10:02:45.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.585+0000 7f81937fe640 1 -- 172.21.15.7:0/3765695385 >> v1:172.21.15.7:6789/0 conn(0x7f819406b270 legacy=0x7f819415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:45.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.585+0000 7f81937fe640 1 --2- 172.21.15.7:0/3765695385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81840039b0 0x7f8184003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:45.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.585+0000 7f81937fe640 1 --2- 172.21.15.7:0/3765695385 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8184004800 0x7f8184004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:45.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.585+0000 7f81937fe640 1 --2- 172.21.15.7:0/3765695385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81840051c0 0x7f818400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:45.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.586+0000 7f81937fe640 1 -- 172.21.15.7:0/3765695385 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818400c0e0 con 0x7f81840051c0 2024-04-25T10:02:45.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.586+0000 7f81937fe640 1 -- 172.21.15.7:0/3765695385 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818400c290 con 0x7f81840039b0 2024-04-25T10:02:45.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.586+0000 7f81937fe640 1 -- 172.21.15.7:0/3765695385 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818400c490 con 0x7f8184004800 2024-04-25T10:02:45.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.586+0000 7f819943b640 1 --2- 172.21.15.7:0/3765695385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81840051c0 0x7f818400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:45.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.586+0000 7f8198c3a640 1 --2- 172.21.15.7:0/3765695385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81840039b0 0x7f8184003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:45.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.586+0000 7f8193fff640 1 --2- 172.21.15.7:0/3765695385 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8184004800 0x7f8184004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:45.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.586+0000 7f819943b640 1 -- 172.21.15.7:0/3765695385 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8184004800 msgr2=0x7f8184004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:45.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.586+0000 7f819943b640 1 --2- 172.21.15.7:0/3765695385 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8184004800 0x7f8184004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:45.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.586+0000 7f819943b640 1 -- 172.21.15.7:0/3765695385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81840039b0 msgr2=0x7f8184003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:45.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.586+0000 7f819943b640 1 --2- 172.21.15.7:0/3765695385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81840039b0 0x7f8184003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:45.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.586+0000 7f819943b640 1 -- 172.21.15.7:0/3765695385 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8184003520 con 0x7f81840051c0 2024-04-25T10:02:45.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.586+0000 7f819943b640 1 -- 172.21.15.7:0/3765695385 reap_dead start 2024-04-25T10:02:45.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.587+0000 7f819943b640 1 --2- 172.21.15.7:0/3765695385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81840051c0 0x7f818400b9c0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f818c007360 tx=0x7f8184005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0bbfdac894a0e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:45.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.587+0000 7f81937fe640 1 -- 172.21.15.7:0/3765695385 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c009be0 con 0x7f81840051c0 2024-04-25T10:02:45.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.587+0000 7f81937fe640 1 -- 172.21.15.7:0/3765695385 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818c003bd0 con 0x7f81840051c0 2024-04-25T10:02:45.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.587+0000 7f81937fe640 1 -- 172.21.15.7:0/3765695385 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c004020 con 0x7f81840051c0 2024-04-25T10:02:45.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.587+0000 7f819ae9e640 1 -- 172.21.15.7:0/3765695385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81840051c0 msgr2=0x7f818400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:45.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.587+0000 7f819ae9e640 1 --2- 172.21.15.7:0/3765695385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81840051c0 0x7f818400b9c0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f818c007360 tx=0x7f8184005830 comp rx=0 tx=0).stop 2024-04-25T10:02:45.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.587+0000 7f819ae9e640 1 -- 172.21.15.7:0/3765695385 shutdown_connections 2024-04-25T10:02:45.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.587+0000 7f819ae9e640 1 --2- 172.21.15.7:0/3765695385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81840051c0 0x7f818400b9c0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:45.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.587+0000 7f819ae9e640 1 -- 172.21.15.7:0/3765695385 >> 172.21.15.7:0/3765695385 conn(0x7f81940b5c30 msgr2=0x7f81940999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:45.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.587+0000 7f819ae9e640 1 -- 172.21.15.7:0/3765695385 shutdown_connections 2024-04-25T10:02:45.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.587+0000 7f819ae9e640 1 -- 172.21.15.7:0/3765695385 wait complete. 2024-04-25T10:02:45.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.588+0000 7f819ae9e640 1 Processor -- start 2024-04-25T10:02:45.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.588+0000 7f819ae9e640 1 -- start start 2024-04-25T10:02:45.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.589+0000 7f819ae9e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81840051c0 0x7f8194136840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:45.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.589+0000 7f819ae9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81940cfba0 0x7f81940cd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.589+0000 7f819ae9e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8194153720 0x7f8194153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.589+0000 7f819ae9e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819415c8f0 con 0x7f8194153720 2024-04-25T10:02:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.589+0000 7f819ae9e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819415ca70 con 0x7f81940cfba0 2024-04-25T10:02:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.589+0000 7f819ae9e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f819415cbf0 con 0x7f81840051c0 2024-04-25T10:02:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.589+0000 7f819943b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8194153720 0x7f8194153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.589+0000 7f819943b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8194153720 0x7f8194153ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47306/0 (socket says 172.21.15.7:47306) 2024-04-25T10:02:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.589+0000 7f819943b640 1 -- 172.21.15.7:0/772269809 learned_addr learned my addr 172.21.15.7:0/772269809 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.590+0000 7f8198c3a640 1 --2- 172.21.15.7:0/772269809 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81840051c0 0x7f8194136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.590+0000 7f8193fff640 1 --2- 172.21.15.7:0/772269809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81940cfba0 0x7f81940cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.590+0000 7f819943b640 1 -- 172.21.15.7:0/772269809 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81840051c0 msgr2=0x7f8194136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.590+0000 7f819943b640 1 --2- 172.21.15.7:0/772269809 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81840051c0 0x7f8194136840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.590+0000 7f819943b640 1 -- 172.21.15.7:0/772269809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81940cfba0 msgr2=0x7f81940cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.590+0000 7f819943b640 1 --2- 172.21.15.7:0/772269809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81940cfba0 0x7f81940cd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.590+0000 7f819943b640 1 -- 172.21.15.7:0/772269809 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81941352e0 con 0x7f8194153720 2024-04-25T10:02:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.590+0000 7f8198c3a640 1 --2- 172.21.15.7:0/772269809 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81840051c0 0x7f8194136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:02:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.590+0000 7f8193fff640 1 --2- 172.21.15.7:0/772269809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81940cfba0 0x7f81940cd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:02:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.590+0000 7f819943b640 1 --2- 172.21.15.7:0/772269809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8194153720 0x7f8194153ba0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f818c007450 tx=0x7f818c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.590+0000 7f81917fa640 1 -- 172.21.15.7:0/772269809 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c045070 con 0x7f8194153720 2024-04-25T10:02:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.590+0000 7f81917fa640 1 -- 172.21.15.7:0/772269809 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818c036650 con 0x7f8194153720 2024-04-25T10:02:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.590+0000 7f81917fa640 1 -- 172.21.15.7:0/772269809 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c009be0 con 0x7f8194153720 2024-04-25T10:02:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.590+0000 7f819ae9e640 1 -- 172.21.15.7:0/772269809 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8194136ed0 con 0x7f8194153720 2024-04-25T10:02:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.590+0000 7f819ae9e640 1 -- 172.21.15.7:0/772269809 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8194137490 con 0x7f8194153720 2024-04-25T10:02:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.591+0000 7f819ae9e640 1 -- 172.21.15.7:0/772269809 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8194068fd0 con 0x7f8194153720 2024-04-25T10:02:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.592+0000 7f81917fa640 1 -- 172.21.15.7:0/772269809 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f818c048070 con 0x7f8194153720 2024-04-25T10:02:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.592+0000 7f81917fa640 1 --2- 172.21.15.7:0/772269809 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f817806b500 0x7f817806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.592+0000 7f81917fa640 1 -- 172.21.15.7:0/772269809 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f818c0aa930 con 0x7f8194153720 2024-04-25T10:02:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.592+0000 7f8198c3a640 1 --2- 172.21.15.7:0/772269809 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f817806b500 0x7f817806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:45.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.593+0000 7f8198c3a640 1 --2- 172.21.15.7:0/772269809 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f817806b500 0x7f817806d9c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f8188000c00 tx=0x7f8188009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:45.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.597+0000 7f81917fa640 1 -- 172.21.15.7:0/772269809 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f818c03d070 con 0x7f8194153720 2024-04-25T10:02:45.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:45.790+0000 7f819ae9e640 1 -- 172.21.15.7:0/772269809 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f8194144a80 con 0x7f8194153720 2024-04-25T10:02:46.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.554+0000 7f81917fa640 1 -- 172.21.15.7:0/772269809 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v97) v1 ==== 97+0+0 (secure 0 0 0) 0x7f818c032030 con 0x7f8194153720 2024-04-25T10:02:46.559 INFO:teuthology.orchestra.run.smithi007.stderr: removed all blocklist entries 2024-04-25T10:02:46.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.557+0000 7f819ae9e640 1 -- 172.21.15.7:0/772269809 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f817806b500 msgr2=0x7f817806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:46.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.557+0000 7f819ae9e640 1 --2- 172.21.15.7:0/772269809 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f817806b500 0x7f817806d9c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f8188000c00 tx=0x7f8188009040 comp rx=0 tx=0).stop 2024-04-25T10:02:46.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.557+0000 7f819ae9e640 1 -- 172.21.15.7:0/772269809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8194153720 msgr2=0x7f8194153ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:46.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.557+0000 7f819ae9e640 1 --2- 172.21.15.7:0/772269809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8194153720 0x7f8194153ba0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f818c007450 tx=0x7f818c004ab0 comp rx=0 tx=0).stop 2024-04-25T10:02:46.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.558+0000 7f819ae9e640 1 -- 172.21.15.7:0/772269809 shutdown_connections 2024-04-25T10:02:46.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.558+0000 7f819ae9e640 1 --2- 172.21.15.7:0/772269809 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f817806b500 0x7f817806d9c0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:46.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.558+0000 7f819ae9e640 1 --2- 172.21.15.7:0/772269809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8194153720 0x7f8194153ba0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:46.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.558+0000 7f819ae9e640 1 --2- 172.21.15.7:0/772269809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81940cfba0 0x7f81940cd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:46.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.558+0000 7f819ae9e640 1 --2- 172.21.15.7:0/772269809 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81840051c0 0x7f8194136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:46.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.558+0000 7f819ae9e640 1 -- 172.21.15.7:0/772269809 >> 172.21.15.7:0/772269809 conn(0x7f81940b5c30 msgr2=0x7f81940b5470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:46.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.558+0000 7f819ae9e640 1 -- 172.21.15.7:0/772269809 shutdown_connections 2024-04-25T10:02:46.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.558+0000 7f819ae9e640 1 -- 172.21.15.7:0/772269809 wait complete. 2024-04-25T10:02:46.577 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T10:02:46.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.679+0000 7efc134fc640 1 Processor -- start 2024-04-25T10:02:46.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.679+0000 7efc134fc640 1 -- start start 2024-04-25T10:02:46.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.680+0000 7efc134fc640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efc0c0d0aa0 0x7efc0c161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:46.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.680+0000 7efc134fc640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc0c15e8a0 con 0x7efc0c1622b0 2024-04-25T10:02:46.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.680+0000 7efc134fc640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc0c15eb80 con 0x7efc0c15da60 2024-04-25T10:02:46.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.680+0000 7efc134fc640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc0c15ee60 con 0x7efc0c0d0aa0 2024-04-25T10:02:46.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.680+0000 7efc10a97640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efc0c0d0aa0 0x7efc0c161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:46.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.680+0000 7efc11a99640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7efc0c1622b0 0x7efc0c0ce520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38708/0 (socket says 172.21.15.7:38708) 2024-04-25T10:02:46.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.680+0000 7efc11a99640 1 -- 172.21.15.7:0/3006987783 learned_addr learned my addr 172.21.15.7:0/3006987783 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:02:46.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.680+0000 7efc10a97640 1 -- 172.21.15.7:0/3006987783 >> v1:172.21.15.55:6789/0 conn(0x7efc0c15da60 legacy=0x7efc0c15de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:46.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.680+0000 7efc10a97640 1 -- 172.21.15.7:0/3006987783 >> v1:172.21.15.7:6789/0 conn(0x7efc0c1622b0 legacy=0x7efc0c0ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:46.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.680+0000 7efc10a97640 1 -- 172.21.15.7:0/3006987783 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0c161850 con 0x7efc0c0d0aa0 2024-04-25T10:02:46.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.681+0000 7efc10a97640 1 --2- 172.21.15.7:0/3006987783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc0c0d0aa0 0x7efc0c161d70 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0097a0 tx=0x7efbfc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aab02a8d7cbeeeb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:46.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.681+0000 7efc03fff640 1 -- 172.21.15.7:0/3006987783 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc037070 con 0x7efc0c0d0aa0 2024-04-25T10:02:46.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.681+0000 7efc03fff640 1 -- 172.21.15.7:0/3006987783 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbfc02ae50 con 0x7efc0c0d0aa0 2024-04-25T10:02:46.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.681+0000 7efc03fff640 1 -- 172.21.15.7:0/3006987783 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc032660 con 0x7efc0c0d0aa0 2024-04-25T10:02:46.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.682+0000 7efc134fc640 1 -- 172.21.15.7:0/3006987783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc0c0d0aa0 msgr2=0x7efc0c161d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:46.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.682+0000 7efc134fc640 1 --2- 172.21.15.7:0/3006987783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc0c0d0aa0 0x7efc0c161d70 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0097a0 tx=0x7efbfc02a140 comp rx=0 tx=0).stop 2024-04-25T10:02:46.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.682+0000 7efc134fc640 1 -- 172.21.15.7:0/3006987783 shutdown_connections 2024-04-25T10:02:46.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.682+0000 7efc134fc640 1 --2- 172.21.15.7:0/3006987783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc0c0d0aa0 0x7efc0c161d70 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:46.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.682+0000 7efc134fc640 1 -- 172.21.15.7:0/3006987783 >> 172.21.15.7:0/3006987783 conn(0x7efc0c06bfe0 msgr2=0x7efc0c06c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:46.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.682+0000 7efc134fc640 1 -- 172.21.15.7:0/3006987783 shutdown_connections 2024-04-25T10:02:46.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.682+0000 7efc134fc640 1 -- 172.21.15.7:0/3006987783 wait complete. 2024-04-25T10:02:46.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.683+0000 7efc134fc640 1 Processor -- start 2024-04-25T10:02:46.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.683+0000 7efc134fc640 1 -- start start 2024-04-25T10:02:46.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.684+0000 7efc134fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc0c0d0aa0 0x7efc0c0cd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:46.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.684+0000 7efc134fc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efc0c15da60 0x7efc0c14ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:46.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.684+0000 7efc134fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc0c1622b0 0x7efc0c15c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:46.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.684+0000 7efc134fc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c0cedb0 con 0x7efc0c1622b0 2024-04-25T10:02:46.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.684+0000 7efc134fc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c0cec30 con 0x7efc0c0d0aa0 2024-04-25T10:02:46.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.684+0000 7efc134fc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c0d2ca0 con 0x7efc0c15da60 2024-04-25T10:02:46.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.684+0000 7efc11a99640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc0c1622b0 0x7efc0c15c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:46.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.684+0000 7efc11a99640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc0c1622b0 0x7efc0c15c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47324/0 (socket says 172.21.15.7:47324) 2024-04-25T10:02:46.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.684+0000 7efc11a99640 1 -- 172.21.15.7:0/2884989003 learned_addr learned my addr 172.21.15.7:0/2884989003 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:46.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.684+0000 7efc10a97640 1 --2- 172.21.15.7:0/2884989003 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efc0c15da60 0x7efc0c14ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:46.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.684+0000 7efc11298640 1 --2- 172.21.15.7:0/2884989003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc0c0d0aa0 0x7efc0c0cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:46.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.684+0000 7efc11a99640 1 -- 172.21.15.7:0/2884989003 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efc0c15da60 msgr2=0x7efc0c14ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:46.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.684+0000 7efc11a99640 1 --2- 172.21.15.7:0/2884989003 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efc0c15da60 0x7efc0c14ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:46.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.684+0000 7efc11a99640 1 -- 172.21.15.7:0/2884989003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc0c0d0aa0 msgr2=0x7efc0c0cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:46.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.684+0000 7efc11a99640 1 --2- 172.21.15.7:0/2884989003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc0c0d0aa0 0x7efc0c0cd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:46.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.684+0000 7efc11a99640 1 -- 172.21.15.7:0/2884989003 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0c1f6f70 con 0x7efc0c1622b0 2024-04-25T10:02:46.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.684+0000 7efc11a99640 1 --2- 172.21.15.7:0/2884989003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc0c1622b0 0x7efc0c15c390 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7efc0400c9f0 tx=0x7efc0400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:46.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.685+0000 7efc01ffb640 1 -- 172.21.15.7:0/2884989003 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc04017070 con 0x7efc0c1622b0 2024-04-25T10:02:46.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.685+0000 7efc01ffb640 1 -- 172.21.15.7:0/2884989003 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0400ab70 con 0x7efc0c1622b0 2024-04-25T10:02:46.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.685+0000 7efc01ffb640 1 -- 172.21.15.7:0/2884989003 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc04012400 con 0x7efc0c1622b0 2024-04-25T10:02:46.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.685+0000 7efc134fc640 1 -- 172.21.15.7:0/2884989003 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc0c1f7250 con 0x7efc0c1622b0 2024-04-25T10:02:46.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.685+0000 7efc134fc640 1 -- 172.21.15.7:0/2884989003 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc0c1f7810 con 0x7efc0c1622b0 2024-04-25T10:02:46.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.686+0000 7efc134fc640 1 -- 172.21.15.7:0/2884989003 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc0c068fd0 con 0x7efc0c1622b0 2024-04-25T10:02:46.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.686+0000 7efc01ffb640 1 -- 172.21.15.7:0/2884989003 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efc0401a070 con 0x7efc0c1622b0 2024-04-25T10:02:46.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.686+0000 7efc01ffb640 1 --2- 172.21.15.7:0/2884989003 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efbf006b500 0x7efbf006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:46.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.687+0000 7efc01ffb640 1 -- 172.21.15.7:0/2884989003 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5249+0+0 (secure 0 0 0) 0x7efc04089b90 con 0x7efc0c1622b0 2024-04-25T10:02:46.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.687+0000 7efc11298640 1 --2- 172.21.15.7:0/2884989003 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efbf006b500 0x7efbf006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:46.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.687+0000 7efc11298640 1 --2- 172.21.15.7:0/2884989003 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efbf006b500 0x7efbf006d9c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7efc0c1594a0 tx=0x7efc08009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:46.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.691+0000 7efc01ffb640 1 -- 172.21.15.7:0/2884989003 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efc04058580 con 0x7efc0c1622b0 2024-04-25T10:02:46.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.936+0000 7efc134fc640 1 -- 172.21.15.7:0/2884989003 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7efc0c0d1560 con 0x7efc0c1622b0 2024-04-25T10:02:46.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.936+0000 7efc01ffb640 1 -- 172.21.15.7:0/2884989003 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7efc0405c620 con 0x7efc0c1622b0 2024-04-25T10:02:46.942 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:02:46.942 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:02:46.942 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_dump": [ 2024-04-25T10:02:46.942 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:02:46.942 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.a", 2024-04-25T10:02:46.942 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmDER5IhAA2ih+YNPXKaTRN6KeMKiDaA==", 2024-04-25T10:02:46.942 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:02:46.942 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T10:02:46.942 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T10:02:46.942 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T10:02:46.942 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:02:46.942 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:02:46.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:02:46.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:02:46.943 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.b", 2024-04-25T10:02:46.943 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmp55aLhAAD3pB8YjSzrpU6DfjQTVHPw==", 2024-04-25T10:02:46.943 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:02:46.943 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T10:02:46.943 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T10:02:46.943 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T10:02:46.943 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:02:46.943 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:02:46.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:02:46.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:02:46.943 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.c", 2024-04-25T10:02:46.944 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpm8jBtKRAAiDZo8S/z1fE588t8tiuX8Q==", 2024-04-25T10:02:46.944 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:02:46.944 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T10:02:46.944 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T10:02:46.944 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T10:02:46.944 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:02:46.944 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:02:46.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:02:46.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:02:46.944 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.d", 2024-04-25T10:02:46.944 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmZWyRNRAA6tdquR+Hh8Lhx7LATegX6g==", 2024-04-25T10:02:46.944 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:02:46.944 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T10:02:46.944 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T10:02:46.945 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T10:02:46.945 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:02:46.945 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:02:46.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:02:46.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:02:46.945 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.0", 2024-04-25T10:02:46.945 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAaKCpmfHZ9HBAA9FYBJbc1QdNt1a9qtFhgBw==", 2024-04-25T10:02:46.945 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:02:46.945 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T10:02:46.945 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T10:02:46.945 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:02:46.945 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:02:46.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:02:46.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:02:46.946 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.1", 2024-04-25T10:02:46.946 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAdKCpmtYOgGhAAbM8XXG5fT+UNSvzvijeJ9Q==", 2024-04-25T10:02:46.946 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:02:46.946 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T10:02:46.946 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T10:02:46.946 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:02:46.946 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:02:46.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:02:46.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:02:46.946 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.2", 2024-04-25T10:02:46.946 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAgKCpmz4uZGBAA6JD3UWZ/8l12y4lJg0kH0A==", 2024-04-25T10:02:46.946 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:02:46.946 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T10:02:46.947 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T10:02:46.947 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:02:46.947 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:02:46.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:02:46.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:02:46.947 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.3", 2024-04-25T10:02:46.947 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAjKCpmcbXXFhAAsK64H4YqdiD1VJKQtn46OQ==", 2024-04-25T10:02:46.947 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:02:46.947 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T10:02:46.947 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T10:02:46.947 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:02:46.947 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:02:46.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:02:46.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:02:46.948 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.4", 2024-04-25T10:02:46.948 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAsKCpmzEDuKxAAmzxdcdVZIq2bGfG0rYcBBg==", 2024-04-25T10:02:46.948 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:02:46.948 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T10:02:46.948 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T10:02:46.948 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:02:46.948 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:02:46.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:02:46.948 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:02:46.948 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.5", 2024-04-25T10:02:46.948 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAvKCpmfyC4KxAAl6QUtdlRRaRNZpECSoHLJQ==", 2024-04-25T10:02:46.948 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:02:46.948 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T10:02:46.948 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T10:02:46.949 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:02:46.949 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:02:46.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:02:46.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:02:46.949 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.6", 2024-04-25T10:02:46.949 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAyKCpmBrUsKxAAH5IlxYRXUtPKYWDdTqBp3w==", 2024-04-25T10:02:46.949 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:02:46.949 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T10:02:46.949 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T10:02:46.949 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:02:46.949 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:02:46.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:02:46.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:02:46.949 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.7", 2024-04-25T10:02:46.950 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQA1KCpmmwTSKhAAdzw/c0Xc6KCQHssqUI910g==", 2024-04-25T10:02:46.950 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:02:46.950 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T10:02:46.950 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T10:02:46.950 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:02:46.950 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:02:46.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:02:46.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:02:46.950 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.0", 2024-04-25T10:02:46.950 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmaJKeORAALxC5ZqLLEu0zJFG+SOGukQ==", 2024-04-25T10:02:46.950 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:02:46.950 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T10:02:46.950 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow r", 2024-04-25T10:02:46.951 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T10:02:46.951 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:02:46.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:02:46.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:02:46.951 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.1", 2024-04-25T10:02:46.951 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAZKCpmC2i6BhAAtKmpTNs/Tga7NtOkm7jSOg==", 2024-04-25T10:02:46.951 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:02:46.951 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T10:02:46.951 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-04-25T10:02:46.951 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-04-25T10:02:46.951 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-04-25T10:02:46.951 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:02:46.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:02:46.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:02:46.951 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.2", 2024-04-25T10:02:46.952 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAZKCpmytCIAxAAhP2UjagzGbz1ySErw1cw3Q==", 2024-04-25T10:02:46.952 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:02:46.952 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T10:02:46.952 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-04-25T10:02:46.952 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-04-25T10:02:46.952 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-04-25T10:02:46.952 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:02:46.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:02:46.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:02:46.952 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.3", 2024-04-25T10:02:46.952 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAZKCpmSj88DBAAg+N3XDyc3H6fUBqkScD/9Q==", 2024-04-25T10:02:46.952 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:02:46.952 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T10:02:46.953 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-04-25T10:02:46.953 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-04-25T10:02:46.953 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-04-25T10:02:46.953 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:02:46.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:02:46.953 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:02:46.953 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.admin", 2024-04-25T10:02:46.953 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpm8SYpBhAACl5SVNaaKZV7rIIFaFlmvw==", 2024-04-25T10:02:46.953 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:02:46.953 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-04-25T10:02:46.953 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T10:02:46.953 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T10:02:46.953 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:02:46.953 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:02:46.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:02:46.954 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:02:46.954 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.x", 2024-04-25T10:02:46.954 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmqIdPHxAACc5SoI1y74ickl2cPjfGIg==", 2024-04-25T10:02:46.954 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:02:46.954 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-04-25T10:02:46.954 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2024-04-25T10:02:46.954 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:02:46.954 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:02:46.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:02:46.954 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:02:46.954 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.y", 2024-04-25T10:02:46.954 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmCvpDGxAAYsxd6zUjxUgY0sYwR4VvAQ==", 2024-04-25T10:02:46.955 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:02:46.955 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-04-25T10:02:46.955 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2024-04-25T10:02:46.955 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:02:46.955 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:02:46.955 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:02:46.955 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-25T10:02:46.955 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:02:46.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.938+0000 7efc134fc640 1 -- 172.21.15.7:0/2884989003 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efbf006b500 msgr2=0x7efbf006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:46.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.938+0000 7efc134fc640 1 --2- 172.21.15.7:0/2884989003 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efbf006b500 0x7efbf006d9c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7efc0c1594a0 tx=0x7efc08009040 comp rx=0 tx=0).stop 2024-04-25T10:02:46.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.938+0000 7efc134fc640 1 -- 172.21.15.7:0/2884989003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc0c1622b0 msgr2=0x7efc0c15c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:46.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.938+0000 7efc134fc640 1 --2- 172.21.15.7:0/2884989003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc0c1622b0 0x7efc0c15c390 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7efc0400c9f0 tx=0x7efc0400ceb0 comp rx=0 tx=0).stop 2024-04-25T10:02:46.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.938+0000 7efc134fc640 1 -- 172.21.15.7:0/2884989003 shutdown_connections 2024-04-25T10:02:46.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.938+0000 7efc134fc640 1 --2- 172.21.15.7:0/2884989003 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efbf006b500 0x7efbf006d9c0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:46.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.938+0000 7efc134fc640 1 --2- 172.21.15.7:0/2884989003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc0c1622b0 0x7efc0c15c390 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:46.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.938+0000 7efc134fc640 1 --2- 172.21.15.7:0/2884989003 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efc0c15da60 0x7efc0c14ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:46.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.938+0000 7efc134fc640 1 --2- 172.21.15.7:0/2884989003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc0c0d0aa0 0x7efc0c0cd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:46.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.938+0000 7efc134fc640 1 -- 172.21.15.7:0/2884989003 >> 172.21.15.7:0/2884989003 conn(0x7efc0c06bfe0 msgr2=0x7efc0c06c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:46.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.938+0000 7efc134fc640 1 -- 172.21.15.7:0/2884989003 shutdown_connections 2024-04-25T10:02:46.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:46.939+0000 7efc134fc640 1 -- 172.21.15.7:0/2884989003 wait complete. 2024-04-25T10:02:46.958 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:02:47.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.054+0000 7f3762476640 1 Processor -- start 2024-04-25T10:02:47.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.054+0000 7f3762476640 1 -- start start 2024-04-25T10:02:47.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.055+0000 7f3762476640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f375c0d0aa0 0x7f375c161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:47.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.055+0000 7f3762476640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f375c1622b0 0x7f375c0ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:47.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.055+0000 7f3762476640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f375c15e8a0 con 0x7f375c15da60 2024-04-25T10:02:47.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.055+0000 7f3762476640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f375c15eb80 con 0x7f375c0d0aa0 2024-04-25T10:02:47.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.055+0000 7f3762476640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375c15ee60 con 0x7f375c1622b0 2024-04-25T10:02:47.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.055+0000 7f375b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f375c0d0aa0 0x7f375c161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:47.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.055+0000 7f3760a13640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f375c1622b0 0x7f375c0ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:47.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.055+0000 7f375b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f375c0d0aa0 0x7f375c161d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:59148/0 (socket says 172.21.15.7:59148) 2024-04-25T10:02:47.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.055+0000 7f375b7fe640 1 -- 172.21.15.7:0/1840959234 learned_addr learned my addr 172.21.15.7:0/1840959234 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:47.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.056+0000 7f375b7fe640 1 -- 172.21.15.7:0/1840959234 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f375c1622b0 msgr2=0x7f375c0ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:47.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.056+0000 7f375b7fe640 1 --2- 172.21.15.7:0/1840959234 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f375c1622b0 0x7f375c0ce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.056+0000 7f375b7fe640 1 -- 172.21.15.7:0/1840959234 >> v1:172.21.15.55:6789/0 conn(0x7f375c15da60 legacy=0x7f375c15de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:47.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.056+0000 7f375b7fe640 1 -- 172.21.15.7:0/1840959234 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375c161850 con 0x7f375c0d0aa0 2024-04-25T10:02:47.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.056+0000 7f375b7fe640 1 --2- 172.21.15.7:0/1840959234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f375c0d0aa0 0x7f375c161d70 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f374c009870 tx=0x7f374c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbc636a5b5469261 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:47.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.056+0000 7f375affd640 1 -- 172.21.15.7:0/1840959234 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c037070 con 0x7f375c0d0aa0 2024-04-25T10:02:47.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.056+0000 7f375affd640 1 -- 172.21.15.7:0/1840959234 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374c032440 con 0x7f375c0d0aa0 2024-04-25T10:02:47.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.057+0000 7f375affd640 1 -- 172.21.15.7:0/1840959234 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c032810 con 0x7f375c0d0aa0 2024-04-25T10:02:47.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.057+0000 7f3762476640 1 -- 172.21.15.7:0/1840959234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f375c0d0aa0 msgr2=0x7f375c161d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:47.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.057+0000 7f3762476640 1 --2- 172.21.15.7:0/1840959234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f375c0d0aa0 0x7f375c161d70 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f374c009870 tx=0x7f374c02a1c0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.057+0000 7f3762476640 1 -- 172.21.15.7:0/1840959234 shutdown_connections 2024-04-25T10:02:47.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.057+0000 7f3762476640 1 --2- 172.21.15.7:0/1840959234 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f375c1622b0 0x7f375c0ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.057+0000 7f3762476640 1 --2- 172.21.15.7:0/1840959234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f375c0d0aa0 0x7f375c161d70 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.057+0000 7f3762476640 1 -- 172.21.15.7:0/1840959234 >> 172.21.15.7:0/1840959234 conn(0x7f375c06bfe0 msgr2=0x7f375c06c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:47.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.057+0000 7f3762476640 1 -- 172.21.15.7:0/1840959234 shutdown_connections 2024-04-25T10:02:47.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.057+0000 7f3762476640 1 -- 172.21.15.7:0/1840959234 wait complete. 2024-04-25T10:02:47.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.058+0000 7f3762476640 1 Processor -- start 2024-04-25T10:02:47.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.058+0000 7f3762476640 1 -- start start 2024-04-25T10:02:47.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.059+0000 7f3762476640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f375c0d0aa0 0x7f375c0c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:47.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.059+0000 7f3762476640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f375c15da60 0x7f375c1575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:47.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.059+0000 7f3762476640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f375c1622b0 0x7f375c157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:47.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.059+0000 7f3762476640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375c0cebe0 con 0x7f375c0d0aa0 2024-04-25T10:02:47.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.059+0000 7f3762476640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375c0cea60 con 0x7f375c1622b0 2024-04-25T10:02:47.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.059+0000 7f3762476640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375c0ced60 con 0x7f375c15da60 2024-04-25T10:02:47.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.059+0000 7f375bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f375c0d0aa0 0x7f375c0c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:47.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.059+0000 7f375bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f375c0d0aa0 0x7f375c0c9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47330/0 (socket says 172.21.15.7:47330) 2024-04-25T10:02:47.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.059+0000 7f375bfff640 1 -- 172.21.15.7:0/1858119494 learned_addr learned my addr 172.21.15.7:0/1858119494 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:47.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.059+0000 7f375b7fe640 1 --2- 172.21.15.7:0/1858119494 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f375c15da60 0x7f375c1575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.059+0000 7f3760a13640 1 --2- 172.21.15.7:0/1858119494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f375c1622b0 0x7f375c157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.060+0000 7f375bfff640 1 -- 172.21.15.7:0/1858119494 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f375c15da60 msgr2=0x7f375c1575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.060+0000 7f375bfff640 1 --2- 172.21.15.7:0/1858119494 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f375c15da60 0x7f375c1575f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.060+0000 7f375bfff640 1 -- 172.21.15.7:0/1858119494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f375c1622b0 msgr2=0x7f375c157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.060+0000 7f375bfff640 1 --2- 172.21.15.7:0/1858119494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f375c1622b0 0x7f375c157b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.060+0000 7f375bfff640 1 -- 172.21.15.7:0/1858119494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375c0ca180 con 0x7f375c0d0aa0 2024-04-25T10:02:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.060+0000 7f375bfff640 1 --2- 172.21.15.7:0/1858119494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f375c0d0aa0 0x7f375c0c9c40 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f375000c3f0 tx=0x7f375000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.060+0000 7f3758ff9640 1 -- 172.21.15.7:0/1858119494 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37500052d0 con 0x7f375c0d0aa0 2024-04-25T10:02:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.060+0000 7f3758ff9640 1 -- 172.21.15.7:0/1858119494 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3750005490 con 0x7f375c0d0aa0 2024-04-25T10:02:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.060+0000 7f3762476640 1 -- 172.21.15.7:0/1858119494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f375c1f6f70 con 0x7f375c0d0aa0 2024-04-25T10:02:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.060+0000 7f3758ff9640 1 -- 172.21.15.7:0/1858119494 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3750007260 con 0x7f375c0d0aa0 2024-04-25T10:02:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.060+0000 7f3762476640 1 -- 172.21.15.7:0/1858119494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f375c1f7530 con 0x7f375c0d0aa0 2024-04-25T10:02:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.061+0000 7f3762476640 1 -- 172.21.15.7:0/1858119494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f375c068fd0 con 0x7f375c0d0aa0 2024-04-25T10:02:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.062+0000 7f3758ff9640 1 -- 172.21.15.7:0/1858119494 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3750007400 con 0x7f375c0d0aa0 2024-04-25T10:02:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.062+0000 7f3758ff9640 1 --2- 172.21.15.7:0/1858119494 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f374806b4d0 0x7f374806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.062+0000 7f3758ff9640 1 -- 172.21.15.7:0/1858119494 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f3750089470 con 0x7f375c0d0aa0 2024-04-25T10:02:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.062+0000 7f375b7fe640 1 --2- 172.21.15.7:0/1858119494 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f374806b4d0 0x7f374806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.062+0000 7f375b7fe640 1 --2- 172.21.15.7:0/1858119494 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f374806b4d0 0x7f374806d990 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f374c034000 tx=0x7f374c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:47.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.066+0000 7f3758ff9640 1 -- 172.21.15.7:0/1858119494 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3750057e60 con 0x7f375c0d0aa0 2024-04-25T10:02:47.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.248+0000 7f3762476640 1 -- 172.21.15.7:0/1858119494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f375c0d1590 con 0x7f375c0d0aa0 2024-04-25T10:02:47.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.249+0000 7f3758ff9640 1 -- 172.21.15.7:0/1858119494 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+13069 (secure 0 0 0) 0x7f375005ce20 con 0x7f375c0d0aa0 2024-04-25T10:02:47.254 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:02:47.254 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":99,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:02:46.562284+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:02:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.251+0000 7f3762476640 1 -- 172.21.15.7:0/1858119494 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f374806b4d0 msgr2=0x7f374806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.251+0000 7f3762476640 1 --2- 172.21.15.7:0/1858119494 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f374806b4d0 0x7f374806d990 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f374c034000 tx=0x7f374c02e000 comp rx=0 tx=0).stop 2024-04-25T10:02:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.251+0000 7f3762476640 1 -- 172.21.15.7:0/1858119494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f375c0d0aa0 msgr2=0x7f375c0c9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.251+0000 7f3762476640 1 --2- 172.21.15.7:0/1858119494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f375c0d0aa0 0x7f375c0c9c40 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f375000c3f0 tx=0x7f375000c8b0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.251+0000 7f3762476640 1 -- 172.21.15.7:0/1858119494 shutdown_connections 2024-04-25T10:02:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.251+0000 7f3762476640 1 --2- 172.21.15.7:0/1858119494 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f374806b4d0 0x7f374806d990 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.251+0000 7f3762476640 1 --2- 172.21.15.7:0/1858119494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f375c1622b0 0x7f375c157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.251+0000 7f3762476640 1 --2- 172.21.15.7:0/1858119494 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f375c15da60 0x7f375c1575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.251+0000 7f3762476640 1 --2- 172.21.15.7:0/1858119494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f375c0d0aa0 0x7f375c0c9c40 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.251+0000 7f3762476640 1 -- 172.21.15.7:0/1858119494 >> 172.21.15.7:0/1858119494 conn(0x7f375c06bfe0 msgr2=0x7f375c160b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.251+0000 7f3762476640 1 -- 172.21.15.7:0/1858119494 shutdown_connections 2024-04-25T10:02:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.251+0000 7f3762476640 1 -- 172.21.15.7:0/1858119494 wait complete. 2024-04-25T10:02:47.267 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:02:47.268 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:02:47.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.366+0000 7f3cee83a640 1 Processor -- start 2024-04-25T10:02:47.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.366+0000 7f3cee83a640 1 -- start start 2024-04-25T10:02:47.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.367+0000 7f3cee83a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3ce815deb0 0x7f3ce80b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:47.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.367+0000 7f3cee83a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3ce80d3760 0x7f3ce80d3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:47.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.367+0000 7f3cee83a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce80ce4c0 con 0x7f3ce80ce030 2024-04-25T10:02:47.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.367+0000 7f3cee83a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce80d4110 con 0x7f3ce815deb0 2024-04-25T10:02:47.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.367+0000 7f3cee83a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce80d1a40 con 0x7f3ce80d3760 2024-04-25T10:02:47.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.367+0000 7f3ce7fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3ce815deb0 0x7f3ce80b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:47.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.367+0000 7f3ce77fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3ce80ce030 0x7f3ce80b69e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38712/0 (socket says 172.21.15.7:38712) 2024-04-25T10:02:47.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.367+0000 7f3ce77fe640 1 -- 172.21.15.7:0/1234233878 learned_addr learned my addr 172.21.15.7:0/1234233878 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:02:47.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.368+0000 7f3cecdd7640 1 --2- 172.21.15.7:0/1234233878 >> v2:172.21.15.55:3300/0 conn(0x7f3ce80d3760 0x7f3ce80d3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:47.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.368+0000 7f3ce7fff640 1 -- 172.21.15.7:0/1234233878 >> v2:172.21.15.55:3300/0 conn(0x7f3ce80d3760 msgr2=0x7f3ce80d3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:47.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.368+0000 7f3ce7fff640 1 --2- 172.21.15.7:0/1234233878 >> v2:172.21.15.55:3300/0 conn(0x7f3ce80d3760 0x7f3ce80d3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.368+0000 7f3ce7fff640 1 -- 172.21.15.7:0/1234233878 >> v1:172.21.15.7:6789/0 conn(0x7f3ce80ce030 legacy=0x7f3ce80b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:47.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.368+0000 7f3ce7fff640 1 -- 172.21.15.7:0/1234233878 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce80d1d20 con 0x7f3ce815deb0 2024-04-25T10:02:47.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.368+0000 7f3ce6ffd640 1 -- 172.21.15.7:0/1234233878 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3109484042 0 0) 0x7f3ce80ce4c0 con 0x7f3ce80ce030 2024-04-25T10:02:47.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.368+0000 7f3ce7fff640 1 --2- 172.21.15.7:0/1234233878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ce815deb0 0x7f3ce80b2c30 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f3ce80b67b0 tx=0x7f3cdc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf4d133a5d27463 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:47.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.368+0000 7f3ce6ffd640 1 -- 172.21.15.7:0/1234233878 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc037070 con 0x7f3ce815deb0 2024-04-25T10:02:47.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.368+0000 7f3ce6ffd640 1 -- 172.21.15.7:0/1234233878 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cdc032440 con 0x7f3ce815deb0 2024-04-25T10:02:47.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.369+0000 7f3ce6ffd640 1 -- 172.21.15.7:0/1234233878 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc032810 con 0x7f3ce815deb0 2024-04-25T10:02:47.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.369+0000 7f3cee83a640 1 -- 172.21.15.7:0/1234233878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ce815deb0 msgr2=0x7f3ce80b2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:47.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.369+0000 7f3cee83a640 1 --2- 172.21.15.7:0/1234233878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ce815deb0 0x7f3ce80b2c30 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f3ce80b67b0 tx=0x7f3cdc02a1a0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.369+0000 7f3cee83a640 1 -- 172.21.15.7:0/1234233878 shutdown_connections 2024-04-25T10:02:47.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.369+0000 7f3cee83a640 1 --2- 172.21.15.7:0/1234233878 >> v2:172.21.15.55:3300/0 conn(0x7f3ce80d3760 0x7f3ce80d3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.369+0000 7f3cee83a640 1 --2- 172.21.15.7:0/1234233878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ce815deb0 0x7f3ce80b2c30 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.369+0000 7f3cee83a640 1 -- 172.21.15.7:0/1234233878 >> 172.21.15.7:0/1234233878 conn(0x7f3ce80726b0 msgr2=0x7f3ce8072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:47.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.369+0000 7f3cee83a640 1 -- 172.21.15.7:0/1234233878 shutdown_connections 2024-04-25T10:02:47.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.369+0000 7f3cee83a640 1 -- 172.21.15.7:0/1234233878 wait complete. 2024-04-25T10:02:47.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.370+0000 7f3cee83a640 1 Processor -- start 2024-04-25T10:02:47.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.371+0000 7f3cee83a640 1 -- start start 2024-04-25T10:02:47.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.371+0000 7f3cee83a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3ce80ce030 0x7f3ce814d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:47.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.371+0000 7f3cee83a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ce80d3760 0x7f3ce80b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:47.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.371+0000 7f3cee83a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ce815deb0 0x7f3ce81604c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:47.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.371+0000 7f3cee83a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce80d25c0 con 0x7f3ce80d3760 2024-04-25T10:02:47.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.371+0000 7f3cee83a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce80d22e0 con 0x7f3ce815deb0 2024-04-25T10:02:47.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.371+0000 7f3cee83a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce80b70f0 con 0x7f3ce80ce030 2024-04-25T10:02:47.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.371+0000 7f3ce77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ce80d3760 0x7f3ce80b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:47.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.371+0000 7f3ce77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ce80d3760 0x7f3ce80b5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47348/0 (socket says 172.21.15.7:47348) 2024-04-25T10:02:47.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.371+0000 7f3ce77fe640 1 -- 172.21.15.7:0/3086006651 learned_addr learned my addr 172.21.15.7:0/3086006651 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:47.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.371+0000 7f3cecdd7640 1 --2- 172.21.15.7:0/3086006651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ce815deb0 0x7f3ce81604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:47.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.371+0000 7f3ce7fff640 1 --2- 172.21.15.7:0/3086006651 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3ce80ce030 0x7f3ce814d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:47.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.372+0000 7f3ce77fe640 1 -- 172.21.15.7:0/3086006651 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3ce80ce030 msgr2=0x7f3ce814d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:47.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.372+0000 7f3ce77fe640 1 --2- 172.21.15.7:0/3086006651 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3ce80ce030 0x7f3ce814d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.372+0000 7f3ce77fe640 1 -- 172.21.15.7:0/3086006651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ce815deb0 msgr2=0x7f3ce81604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:47.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.372+0000 7f3ce77fe640 1 --2- 172.21.15.7:0/3086006651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ce815deb0 0x7f3ce81604c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.372+0000 7f3ce77fe640 1 -- 172.21.15.7:0/3086006651 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce80b60c0 con 0x7f3ce80d3760 2024-04-25T10:02:47.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.372+0000 7f3ce77fe640 1 --2- 172.21.15.7:0/3086006651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ce80d3760 0x7f3ce80b5b80 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f3cd800c4d0 tx=0x7f3cd800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:47.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.372+0000 7f3ce4ff9640 1 -- 172.21.15.7:0/3086006651 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8018070 con 0x7f3ce80d3760 2024-04-25T10:02:47.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.372+0000 7f3ce4ff9640 1 -- 172.21.15.7:0/3086006651 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd8007500 con 0x7f3ce80d3760 2024-04-25T10:02:47.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.372+0000 7f3ce4ff9640 1 -- 172.21.15.7:0/3086006651 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8004a20 con 0x7f3ce80d3760 2024-04-25T10:02:47.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.372+0000 7f3cee83a640 1 -- 172.21.15.7:0/3086006651 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce80b3c40 con 0x7f3ce80d3760 2024-04-25T10:02:47.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.372+0000 7f3cee83a640 1 -- 172.21.15.7:0/3086006651 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce80b41e0 con 0x7f3ce80d3760 2024-04-25T10:02:47.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.373+0000 7f3cee83a640 1 -- 172.21.15.7:0/3086006651 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce80b4b80 con 0x7f3ce80d3760 2024-04-25T10:02:47.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.374+0000 7f3ce4ff9640 1 -- 172.21.15.7:0/3086006651 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3cd801b070 con 0x7f3ce80d3760 2024-04-25T10:02:47.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.374+0000 7f3ce4ff9640 1 --2- 172.21.15.7:0/3086006651 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3cd406b4d0 0x7f3cd406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:47.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.374+0000 7f3ce4ff9640 1 -- 172.21.15.7:0/3086006651 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f3cd8089210 con 0x7f3ce80d3760 2024-04-25T10:02:47.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.374+0000 7f3ce7fff640 1 --2- 172.21.15.7:0/3086006651 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3cd406b4d0 0x7f3cd406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:47.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.375+0000 7f3ce7fff640 1 --2- 172.21.15.7:0/3086006651 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3cd406b4d0 0x7f3cd406d990 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc034000 tx=0x7f3cdc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:47.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.378+0000 7f3ce4ff9640 1 -- 172.21.15.7:0/3086006651 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3ce80b4b80 con 0x7f3ce80d3760 2024-04-25T10:02:47.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.562+0000 7f3cee83a640 1 -- 172.21.15.7:0/3086006651 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3ce8073d00 con 0x7f3ce80d3760 2024-04-25T10:02:47.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.563+0000 7f3ce4ff9640 1 -- 172.21.15.7:0/3086006651 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v99) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3cd8057c90 con 0x7f3ce80d3760 2024-04-25T10:02:47.568 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T10:02:47.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.564+0000 7f3cee83a640 1 -- 172.21.15.7:0/3086006651 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3cd406b4d0 msgr2=0x7f3cd406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:47.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.564+0000 7f3cee83a640 1 --2- 172.21.15.7:0/3086006651 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3cd406b4d0 0x7f3cd406d990 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc034000 tx=0x7f3cdc02e000 comp rx=0 tx=0).stop 2024-04-25T10:02:47.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.564+0000 7f3cee83a640 1 -- 172.21.15.7:0/3086006651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ce80d3760 msgr2=0x7f3ce80b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:47.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.564+0000 7f3cee83a640 1 --2- 172.21.15.7:0/3086006651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ce80d3760 0x7f3ce80b5b80 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f3cd800c4d0 tx=0x7f3cd800c990 comp rx=0 tx=0).stop 2024-04-25T10:02:47.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.565+0000 7f3cee83a640 1 -- 172.21.15.7:0/3086006651 shutdown_connections 2024-04-25T10:02:47.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.565+0000 7f3cee83a640 1 --2- 172.21.15.7:0/3086006651 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3cd406b4d0 0x7f3cd406d990 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.565+0000 7f3cee83a640 1 --2- 172.21.15.7:0/3086006651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ce815deb0 0x7f3ce81604c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.565+0000 7f3cee83a640 1 --2- 172.21.15.7:0/3086006651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ce80d3760 0x7f3ce80b5b80 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.565+0000 7f3cee83a640 1 --2- 172.21.15.7:0/3086006651 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3ce80ce030 0x7f3ce814d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.565+0000 7f3cee83a640 1 -- 172.21.15.7:0/3086006651 >> 172.21.15.7:0/3086006651 conn(0x7f3ce80726b0 msgr2=0x7f3ce80b7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:47.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.565+0000 7f3cee83a640 1 -- 172.21.15.7:0/3086006651 shutdown_connections 2024-04-25T10:02:47.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.565+0000 7f3cee83a640 1 -- 172.21.15.7:0/3086006651 wait complete. 2024-04-25T10:02:47.581 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T10:02:47.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.677+0000 7f90956ac640 1 Processor -- start 2024-04-25T10:02:47.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.677+0000 7f90956ac640 1 -- start start 2024-04-25T10:02:47.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.678+0000 7f90956ac640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f909015dd00 0x7f90900b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:47.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.678+0000 7f90956ac640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f909006cd00 con 0x7f909006c6c0 2024-04-25T10:02:47.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.678+0000 7f90956ac640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90900d1ca0 con 0x7f90900b6a40 2024-04-25T10:02:47.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.678+0000 7f90956ac640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f909015e0e0 con 0x7f909015dd00 2024-04-25T10:02:47.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.678+0000 7f908effd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f909015dd00 0x7f90900b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:47.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.678+0000 7f908effd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f909015dd00 0x7f90900b5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47362/0 (socket says 172.21.15.7:47362) 2024-04-25T10:02:47.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.678+0000 7f908effd640 1 -- 172.21.15.7:0/160125391 learned_addr learned my addr 172.21.15.7:0/160125391 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:47.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.678+0000 7f908f7fe640 1 --1- 172.21.15.7:0/160125391 >> v1:172.21.15.7:6789/0 conn(0x7f909006c6c0 0x7f90900d2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38728/0 (socket says 172.21.15.7:38728) 2024-04-25T10:02:47.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.678+0000 7f908effd640 1 -- 172.21.15.7:0/160125391 >> v1:172.21.15.55:6789/0 conn(0x7f90900b6a40 legacy=0x7f909006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:47.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.678+0000 7f908effd640 1 -- 172.21.15.7:0/160125391 >> v1:172.21.15.7:6789/0 conn(0x7f909006c6c0 legacy=0x7f90900d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:47.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.678+0000 7f908dffb640 1 -- 172.21.15.7:0/160125391 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2964374177 0 0) 0x7f909006cd00 con 0x7f909006c6c0 2024-04-25T10:02:47.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.678+0000 7f908effd640 1 -- 172.21.15.7:0/160125391 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90900d1f80 con 0x7f909015dd00 2024-04-25T10:02:47.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.679+0000 7f908effd640 1 --2- 172.21.15.7:0/160125391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f909015dd00 0x7f90900b5750 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f9088009870 tx=0x7f908802a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211091e20971768b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:47.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.679+0000 7f908dffb640 1 -- 172.21.15.7:0/160125391 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9088037070 con 0x7f909015dd00 2024-04-25T10:02:47.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.679+0000 7f908dffb640 1 -- 172.21.15.7:0/160125391 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9088032640 con 0x7f909015dd00 2024-04-25T10:02:47.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.679+0000 7f908dffb640 1 -- 172.21.15.7:0/160125391 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9088032a10 con 0x7f909015dd00 2024-04-25T10:02:47.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.680+0000 7f90956ac640 1 -- 172.21.15.7:0/160125391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f909015dd00 msgr2=0x7f90900b5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:47.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.680+0000 7f90956ac640 1 --2- 172.21.15.7:0/160125391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f909015dd00 0x7f90900b5750 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f9088009870 tx=0x7f908802a330 comp rx=0 tx=0).stop 2024-04-25T10:02:47.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.680+0000 7f90956ac640 1 -- 172.21.15.7:0/160125391 shutdown_connections 2024-04-25T10:02:47.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.680+0000 7f90956ac640 1 --2- 172.21.15.7:0/160125391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f909015dd00 0x7f90900b5750 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.680+0000 7f90956ac640 1 -- 172.21.15.7:0/160125391 >> 172.21.15.7:0/160125391 conn(0x7f90900d07b0 msgr2=0x7f90900d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:47.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.680+0000 7f90956ac640 1 -- 172.21.15.7:0/160125391 shutdown_connections 2024-04-25T10:02:47.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.680+0000 7f90956ac640 1 -- 172.21.15.7:0/160125391 wait complete. 2024-04-25T10:02:47.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.681+0000 7f90956ac640 1 Processor -- start 2024-04-25T10:02:47.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.681+0000 7f90956ac640 1 -- start start 2024-04-25T10:02:47.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.682+0000 7f90956ac640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f909006c6c0 0x7f90900cb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:47.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.682+0000 7f90956ac640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90900b6a40 0x7f90900c9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:47.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.682+0000 7f90956ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f909015dd00 0x7f909015a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:47.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.682+0000 7f90956ac640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90900b5c90 con 0x7f909006c6c0 2024-04-25T10:02:47.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.682+0000 7f90956ac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909006cfe0 con 0x7f909015dd00 2024-04-25T10:02:47.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.682+0000 7f90956ac640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90900b5e10 con 0x7f90900b6a40 2024-04-25T10:02:47.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.682+0000 7f908effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f909006c6c0 0x7f90900cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:47.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.682+0000 7f908effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f909006c6c0 0x7f90900cb960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47370/0 (socket says 172.21.15.7:47370) 2024-04-25T10:02:47.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.682+0000 7f908effd640 1 -- 172.21.15.7:0/1938222871 learned_addr learned my addr 172.21.15.7:0/1938222871 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:47.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.682+0000 7f908f7fe640 1 --2- 172.21.15.7:0/1938222871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f909015dd00 0x7f909015a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:47.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.682+0000 7f908e7fc640 1 --2- 172.21.15.7:0/1938222871 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90900b6a40 0x7f90900c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:47.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.682+0000 7f908effd640 1 -- 172.21.15.7:0/1938222871 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90900b6a40 msgr2=0x7f90900c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:47.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.682+0000 7f908effd640 1 --2- 172.21.15.7:0/1938222871 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90900b6a40 0x7f90900c9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.682+0000 7f908effd640 1 -- 172.21.15.7:0/1938222871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f909015dd00 msgr2=0x7f909015a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:47.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.682+0000 7f908effd640 1 --2- 172.21.15.7:0/1938222871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f909015dd00 0x7f909015a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.682+0000 7f908effd640 1 -- 172.21.15.7:0/1938222871 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90901f7800 con 0x7f909006c6c0 2024-04-25T10:02:47.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.682+0000 7f908effd640 1 --2- 172.21.15.7:0/1938222871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f909006c6c0 0x7f90900cb960 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f9088009870 tx=0x7f90880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:47.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.683+0000 7f90877fe640 1 -- 172.21.15.7:0/1938222871 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9088041070 con 0x7f909006c6c0 2024-04-25T10:02:47.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.683+0000 7f90877fe640 1 -- 172.21.15.7:0/1938222871 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908803c870 con 0x7f909006c6c0 2024-04-25T10:02:47.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.683+0000 7f90956ac640 1 -- 172.21.15.7:0/1938222871 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f909015f3e0 con 0x7f909006c6c0 2024-04-25T10:02:47.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.683+0000 7f90877fe640 1 -- 172.21.15.7:0/1938222871 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9088037040 con 0x7f909006c6c0 2024-04-25T10:02:47.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.683+0000 7f90956ac640 1 -- 172.21.15.7:0/1938222871 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f909015f9a0 con 0x7f909006c6c0 2024-04-25T10:02:47.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.684+0000 7f90956ac640 1 -- 172.21.15.7:0/1938222871 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9090068fd0 con 0x7f909006c6c0 2024-04-25T10:02:47.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.684+0000 7f90877fe640 1 -- 172.21.15.7:0/1938222871 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9088044070 con 0x7f909006c6c0 2024-04-25T10:02:47.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.685+0000 7f90877fe640 1 --2- 172.21.15.7:0/1938222871 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f907006b4d0 0x7f907006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:47.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.685+0000 7f90877fe640 1 -- 172.21.15.7:0/1938222871 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f90880aad20 con 0x7f909006c6c0 2024-04-25T10:02:47.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.685+0000 7f908e7fc640 1 --2- 172.21.15.7:0/1938222871 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f907006b4d0 0x7f907006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:47.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.685+0000 7f908e7fc640 1 --2- 172.21.15.7:0/1938222871 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f907006b4d0 0x7f907006d990 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f90901598f0 tx=0x7f9078009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:47.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.689+0000 7f90877fe640 1 -- 172.21.15.7:0/1938222871 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9088079df0 con 0x7f909006c6c0 2024-04-25T10:02:47.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.870+0000 7f90956ac640 1 -- 172.21.15.7:0/1938222871 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f90900d1620 con 0x7f909006c6c0 2024-04-25T10:02:47.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.871+0000 7f90877fe640 1 -- 172.21.15.7:0/1938222871 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v99) v1 ==== 84+0+65 (secure 0 0 0) 0x7f90880796f0 con 0x7f909006c6c0 2024-04-25T10:02:47.876 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:02:47.876 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2024-04-25T10:02:47.876 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:02:47.876 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2024-04-25T10:02:47.876 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2024-04-25T10:02:47.876 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:02:47.876 INFO:teuthology.orchestra.run.smithi007.stdout:] 2024-04-25T10:02:47.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.872+0000 7f90956ac640 1 -- 172.21.15.7:0/1938222871 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f907006b4d0 msgr2=0x7f907006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:47.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.872+0000 7f90956ac640 1 --2- 172.21.15.7:0/1938222871 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f907006b4d0 0x7f907006d990 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f90901598f0 tx=0x7f9078009040 comp rx=0 tx=0).stop 2024-04-25T10:02:47.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.872+0000 7f90956ac640 1 -- 172.21.15.7:0/1938222871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f909006c6c0 msgr2=0x7f90900cb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:47.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.872+0000 7f90956ac640 1 --2- 172.21.15.7:0/1938222871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f909006c6c0 0x7f90900cb960 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f9088009870 tx=0x7f90880046c0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.872+0000 7f90956ac640 1 -- 172.21.15.7:0/1938222871 shutdown_connections 2024-04-25T10:02:47.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.872+0000 7f90956ac640 1 --2- 172.21.15.7:0/1938222871 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f907006b4d0 0x7f907006d990 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.872+0000 7f90956ac640 1 --2- 172.21.15.7:0/1938222871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f909015dd00 0x7f909015a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.872+0000 7f90956ac640 1 --2- 172.21.15.7:0/1938222871 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90900b6a40 0x7f90900c9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.872+0000 7f90956ac640 1 --2- 172.21.15.7:0/1938222871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f909006c6c0 0x7f90900cb960 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.872+0000 7f90956ac640 1 -- 172.21.15.7:0/1938222871 >> 172.21.15.7:0/1938222871 conn(0x7f90900d07b0 msgr2=0x7f90900c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:47.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.873+0000 7f90956ac640 1 -- 172.21.15.7:0/1938222871 shutdown_connections 2024-04-25T10:02:47.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.873+0000 7f90956ac640 1 -- 172.21.15.7:0/1938222871 wait complete. 2024-04-25T10:02:47.888 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T10:02:47.888 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T10:02:47.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.988+0000 7f6103f34640 1 Processor -- start 2024-04-25T10:02:47.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.988+0000 7f6103f34640 1 -- start start 2024-04-25T10:02:47.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.989+0000 7f6103f34640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f60fc15df80 0x7f60fc0b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:47.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.989+0000 7f6103f34640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f60fc0b6a40 0x7f60fc0d0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:47.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.989+0000 7f6103f34640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60fc0d1a10 con 0x7f60fc15dba0 2024-04-25T10:02:47.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.989+0000 7f6103f34640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60fc0d1cb0 con 0x7f60fc15df80 2024-04-25T10:02:47.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.989+0000 7f6103f34640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc0d1f90 con 0x7f60fc0b6a40 2024-04-25T10:02:47.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.989+0000 7f61024d1640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f60fc0b6a40 0x7f60fc0d0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:47.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.989+0000 7f61014cf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f60fc15df80 0x7f60fc0b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:47.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.989+0000 7f61014cf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f60fc15df80 0x7f60fc0b2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:59200/0 (socket says 172.21.15.7:59200) 2024-04-25T10:02:47.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.989+0000 7f61024d1640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f60fc0b6a40 0x7f60fc0d0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:58528/0 (socket says 172.21.15.7:58528) 2024-04-25T10:02:47.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.989+0000 7f61014cf640 1 -- 172.21.15.7:0/2018498609 learned_addr learned my addr 172.21.15.7:0/2018498609 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:47.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.989+0000 7f6101cd0640 1 --1- 172.21.15.7:0/2018498609 >> v1:172.21.15.55:6789/0 conn(0x7f60fc15dba0 0x7f60fc0cea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:36458/0 (socket says 172.21.15.7:36458) 2024-04-25T10:02:47.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.990+0000 7f61014cf640 1 -- 172.21.15.7:0/2018498609 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f60fc0b6a40 msgr2=0x7f60fc0d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:47.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.990+0000 7f61014cf640 1 --2- 172.21.15.7:0/2018498609 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f60fc0b6a40 0x7f60fc0d0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.990+0000 7f61014cf640 1 -- 172.21.15.7:0/2018498609 >> v1:172.21.15.55:6789/0 conn(0x7f60fc15dba0 legacy=0x7f60fc0cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:47.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.990+0000 7f61014cf640 1 -- 172.21.15.7:0/2018498609 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60fc0d2270 con 0x7f60fc15df80 2024-04-25T10:02:47.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.990+0000 7f61024d1640 1 --2- 172.21.15.7:0/2018498609 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f60fc0b6a40 0x7f60fc0d0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:02:47.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.991+0000 7f61014cf640 1 --2- 172.21.15.7:0/2018498609 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60fc15df80 0x7f60fc0b2c00 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f60ec009870 tx=0x7f60ec02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bf652744165e1ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:47.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.991+0000 7f6100cce640 1 -- 172.21.15.7:0/2018498609 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec037070 con 0x7f60fc15df80 2024-04-25T10:02:47.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.991+0000 7f6100cce640 1 -- 172.21.15.7:0/2018498609 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ec032440 con 0x7f60fc15df80 2024-04-25T10:02:47.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.991+0000 7f6100cce640 1 -- 172.21.15.7:0/2018498609 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec032810 con 0x7f60fc15df80 2024-04-25T10:02:47.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.991+0000 7f6103f34640 1 -- 172.21.15.7:0/2018498609 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60fc15df80 msgr2=0x7f60fc0b2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:47.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.991+0000 7f6103f34640 1 --2- 172.21.15.7:0/2018498609 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60fc15df80 0x7f60fc0b2c00 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f60ec009870 tx=0x7f60ec02a270 comp rx=0 tx=0).stop 2024-04-25T10:02:47.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.991+0000 7f6103f34640 1 -- 172.21.15.7:0/2018498609 shutdown_connections 2024-04-25T10:02:47.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.991+0000 7f6103f34640 1 --2- 172.21.15.7:0/2018498609 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f60fc0b6a40 0x7f60fc0d0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.991+0000 7f6103f34640 1 --2- 172.21.15.7:0/2018498609 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60fc15df80 0x7f60fc0b2c00 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:47.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.991+0000 7f6103f34640 1 -- 172.21.15.7:0/2018498609 >> 172.21.15.7:0/2018498609 conn(0x7f60fc06c530 msgr2=0x7f60fc072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:47.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.991+0000 7f6103f34640 1 -- 172.21.15.7:0/2018498609 shutdown_connections 2024-04-25T10:02:47.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.991+0000 7f6103f34640 1 -- 172.21.15.7:0/2018498609 wait complete. 2024-04-25T10:02:47.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.993+0000 7f6103f34640 1 Processor -- start 2024-04-25T10:02:47.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.993+0000 7f6103f34640 1 -- start start 2024-04-25T10:02:48.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.993+0000 7f6103f34640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60fc0b6a40 0x7f60fc158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:48.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.993+0000 7f6103f34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60fc15dba0 0x7f60fc0ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:48.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.994+0000 7f6103f34640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f60fc15df80 0x7f60fc1f3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:48.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.994+0000 7f6103f34640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc0b7030 con 0x7f60fc0b6a40 2024-04-25T10:02:48.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.994+0000 7f6103f34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc0b6eb0 con 0x7f60fc15dba0 2024-04-25T10:02:48.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.994+0000 7f6103f34640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc0b71b0 con 0x7f60fc15df80 2024-04-25T10:02:48.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.994+0000 7f6101cd0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60fc0b6a40 0x7f60fc158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:48.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.994+0000 7f6101cd0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60fc0b6a40 0x7f60fc158270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47380/0 (socket says 172.21.15.7:47380) 2024-04-25T10:02:48.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.994+0000 7f6101cd0640 1 -- 172.21.15.7:0/2681660002 learned_addr learned my addr 172.21.15.7:0/2681660002 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:48.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.994+0000 7f61014cf640 1 --2- 172.21.15.7:0/2681660002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60fc15dba0 0x7f60fc0ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:48.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.994+0000 7f61024d1640 1 --2- 172.21.15.7:0/2681660002 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f60fc15df80 0x7f60fc1f3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:48.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.994+0000 7f6101cd0640 1 -- 172.21.15.7:0/2681660002 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f60fc15df80 msgr2=0x7f60fc1f3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:48.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.994+0000 7f6101cd0640 1 --2- 172.21.15.7:0/2681660002 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f60fc15df80 0x7f60fc1f3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:48.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.994+0000 7f6101cd0640 1 -- 172.21.15.7:0/2681660002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60fc15dba0 msgr2=0x7f60fc0ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:48.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.994+0000 7f6101cd0640 1 --2- 172.21.15.7:0/2681660002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60fc15dba0 0x7f60fc0ca8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:48.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.994+0000 7f6101cd0640 1 -- 172.21.15.7:0/2681660002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60fc1f4160 con 0x7f60fc0b6a40 2024-04-25T10:02:48.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.994+0000 7f61014cf640 1 --2- 172.21.15.7:0/2681660002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60fc15dba0 0x7f60fc0ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:02:48.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.994+0000 7f6101cd0640 1 --2- 172.21.15.7:0/2681660002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60fc0b6a40 0x7f60fc158270 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f60f800c400 tx=0x7f60f800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:48.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.994+0000 7f60f27fc640 1 -- 172.21.15.7:0/2681660002 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f80074e0 con 0x7f60fc0b6a40 2024-04-25T10:02:48.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.994+0000 7f60f27fc640 1 -- 172.21.15.7:0/2681660002 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f8007680 con 0x7f60fc0b6a40 2024-04-25T10:02:48.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.994+0000 7f6103f34640 1 -- 172.21.15.7:0/2681660002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60fc1f46d0 con 0x7f60fc0b6a40 2024-04-25T10:02:48.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.994+0000 7f60f27fc640 1 -- 172.21.15.7:0/2681660002 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f8004a00 con 0x7f60fc0b6a40 2024-04-25T10:02:48.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.994+0000 7f6103f34640 1 -- 172.21.15.7:0/2681660002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60fc156ca0 con 0x7f60fc0b6a40 2024-04-25T10:02:48.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.995+0000 7f6103f34640 1 -- 172.21.15.7:0/2681660002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60fc0d0130 con 0x7f60fc0b6a40 2024-04-25T10:02:48.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.996+0000 7f60f27fc640 1 -- 172.21.15.7:0/2681660002 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f60f801a020 con 0x7f60fc0b6a40 2024-04-25T10:02:48.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.996+0000 7f60f27fc640 1 --2- 172.21.15.7:0/2681660002 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f60e006b4d0 0x7f60e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:48.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.996+0000 7f61014cf640 1 --2- 172.21.15.7:0/2681660002 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f60e006b4d0 0x7f60e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:48.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.997+0000 7f60f27fc640 1 -- 172.21.15.7:0/2681660002 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f60f8089730 con 0x7f60fc0b6a40 2024-04-25T10:02:48.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:47.997+0000 7f61014cf640 1 --2- 172.21.15.7:0/2681660002 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f60e006b4d0 0x7f60e006d990 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f60ec034000 tx=0x7f60ec02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:48.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.001+0000 7f60f27fc640 1 -- 172.21.15.7:0/2681660002 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f60f8010300 con 0x7f60fc0b6a40 2024-04-25T10:02:48.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.181+0000 7f6103f34640 1 -- 172.21.15.7:0/2681660002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f60fc1f4500 con 0x7f60fc0b6a40 2024-04-25T10:02:48.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.562+0000 7f60f27fc640 1 -- 172.21.15.7:0/2681660002 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v100) v1 ==== 138+0+0 (secure 0 0 0) 0x7f60f8058800 con 0x7f60fc0b6a40 2024-04-25T10:02:48.567 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2024-04-25T10:02:48.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.564+0000 7f6103f34640 1 -- 172.21.15.7:0/2681660002 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f60e006b4d0 msgr2=0x7f60e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:48.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.564+0000 7f6103f34640 1 --2- 172.21.15.7:0/2681660002 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f60e006b4d0 0x7f60e006d990 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f60ec034000 tx=0x7f60ec02e000 comp rx=0 tx=0).stop 2024-04-25T10:02:48.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.564+0000 7f6103f34640 1 -- 172.21.15.7:0/2681660002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60fc0b6a40 msgr2=0x7f60fc158270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:48.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.564+0000 7f6103f34640 1 --2- 172.21.15.7:0/2681660002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60fc0b6a40 0x7f60fc158270 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f60f800c400 tx=0x7f60f800c800 comp rx=0 tx=0).stop 2024-04-25T10:02:48.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.564+0000 7f6103f34640 1 -- 172.21.15.7:0/2681660002 shutdown_connections 2024-04-25T10:02:48.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.564+0000 7f6103f34640 1 --2- 172.21.15.7:0/2681660002 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f60e006b4d0 0x7f60e006d990 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:48.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.564+0000 7f6103f34640 1 --2- 172.21.15.7:0/2681660002 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f60fc15df80 0x7f60fc1f3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:48.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.564+0000 7f6103f34640 1 --2- 172.21.15.7:0/2681660002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60fc15dba0 0x7f60fc0ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:48.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.564+0000 7f6103f34640 1 --2- 172.21.15.7:0/2681660002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60fc0b6a40 0x7f60fc158270 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:48.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.564+0000 7f6103f34640 1 -- 172.21.15.7:0/2681660002 >> 172.21.15.7:0/2681660002 conn(0x7f60fc06c530 msgr2=0x7f60fc15e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:48.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.564+0000 7f6103f34640 1 -- 172.21.15.7:0/2681660002 shutdown_connections 2024-04-25T10:02:48.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.564+0000 7f6103f34640 1 -- 172.21.15.7:0/2681660002 wait complete. 2024-04-25T10:02:48.583 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T10:02:48.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.687+0000 7fbef085a640 1 Processor -- start 2024-04-25T10:02:48.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.687+0000 7fbef085a640 1 -- start start 2024-04-25T10:02:48.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.688+0000 7fbef085a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbeec0d0780 0x7fbeec0d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:48.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.688+0000 7fbef085a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbeec0b9130 0x7fbeec0d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:48.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.688+0000 7fbef085a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeec0d10a0 con 0x7fbeec0b9590 2024-04-25T10:02:48.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.688+0000 7fbef085a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeec0b7ef0 con 0x7fbeec0d0780 2024-04-25T10:02:48.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.688+0000 7fbef085a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec0b81d0 con 0x7fbeec0b9130 2024-04-25T10:02:48.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.689+0000 7fbee9d9b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbeec0b9130 0x7fbeec0d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:48.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.689+0000 7fbeea59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbeec0d0780 0x7fbeec0d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:48.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.689+0000 7fbeead9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbeec0b9590 0x7fbeec0d2170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:36474/0 (socket says 172.21.15.7:36474) 2024-04-25T10:02:48.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.689+0000 7fbeea59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbeec0d0780 0x7fbeec0d0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:59222/0 (socket says 172.21.15.7:59222) 2024-04-25T10:02:48.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.689+0000 7fbee9d9b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbeec0b9130 0x7fbeec0d1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:58550/0 (socket says 172.21.15.7:58550) 2024-04-25T10:02:48.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.689+0000 7fbeea59c640 1 -- 172.21.15.7:0/827516976 learned_addr learned my addr 172.21.15.7:0/827516976 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:48.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.689+0000 7fbeea59c640 1 -- 172.21.15.7:0/827516976 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbeec0b9130 msgr2=0x7fbeec0d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:48.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.689+0000 7fbeea59c640 1 --2- 172.21.15.7:0/827516976 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbeec0b9130 0x7fbeec0d1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:48.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.689+0000 7fbeea59c640 1 -- 172.21.15.7:0/827516976 >> v1:172.21.15.55:6789/0 conn(0x7fbeec0b9590 legacy=0x7fbeec0d2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:48.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.689+0000 7fbeea59c640 1 -- 172.21.15.7:0/827516976 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeec0b84b0 con 0x7fbeec0d0780 2024-04-25T10:02:48.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.689+0000 7fbee9d9b640 1 --2- 172.21.15.7:0/827516976 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbeec0b9130 0x7fbeec0d1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:02:48.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.690+0000 7fbeea59c640 1 --2- 172.21.15.7:0/827516976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeec0d0780 0x7fbeec0d0b60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fbee4009870 tx=0x7fbee402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84cd464fee5396e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:48.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.690+0000 7fbee959a640 1 -- 172.21.15.7:0/827516976 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee4037070 con 0x7fbeec0d0780 2024-04-25T10:02:48.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.690+0000 7fbee959a640 1 -- 172.21.15.7:0/827516976 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee4032440 con 0x7fbeec0d0780 2024-04-25T10:02:48.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.690+0000 7fbee959a640 1 -- 172.21.15.7:0/827516976 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee4032810 con 0x7fbeec0d0780 2024-04-25T10:02:48.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.691+0000 7fbef085a640 1 -- 172.21.15.7:0/827516976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeec0d0780 msgr2=0x7fbeec0d0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:48.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.691+0000 7fbef085a640 1 --2- 172.21.15.7:0/827516976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeec0d0780 0x7fbeec0d0b60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fbee4009870 tx=0x7fbee402a270 comp rx=0 tx=0).stop 2024-04-25T10:02:48.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.691+0000 7fbef085a640 1 -- 172.21.15.7:0/827516976 shutdown_connections 2024-04-25T10:02:48.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.691+0000 7fbef085a640 1 --2- 172.21.15.7:0/827516976 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbeec0b9130 0x7fbeec0d1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:48.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.691+0000 7fbef085a640 1 --2- 172.21.15.7:0/827516976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeec0d0780 0x7fbeec0d0b60 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:48.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.691+0000 7fbef085a640 1 -- 172.21.15.7:0/827516976 >> 172.21.15.7:0/827516976 conn(0x7fbeec0726b0 msgr2=0x7fbeec072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:48.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.691+0000 7fbef085a640 1 -- 172.21.15.7:0/827516976 shutdown_connections 2024-04-25T10:02:48.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.691+0000 7fbef085a640 1 -- 172.21.15.7:0/827516976 wait complete. 2024-04-25T10:02:48.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.692+0000 7fbef085a640 1 Processor -- start 2024-04-25T10:02:48.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.692+0000 7fbef085a640 1 -- start start 2024-04-25T10:02:48.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.693+0000 7fbef085a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbeec0b9130 0x7fbeec0cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:48.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.693+0000 7fbef085a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbeec0b9590 0x7fbeec154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:48.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.693+0000 7fbef085a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeec0d0780 0x7fbeec1549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:48.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.693+0000 7fbef085a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec1611b0 con 0x7fbeec0b9590 2024-04-25T10:02:48.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.693+0000 7fbef085a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec0b8a70 con 0x7fbeec0d0780 2024-04-25T10:02:48.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.693+0000 7fbef085a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec161330 con 0x7fbeec0b9130 2024-04-25T10:02:48.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.693+0000 7fbee9d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbeec0b9590 0x7fbeec154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:48.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.693+0000 7fbee9d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbeec0b9590 0x7fbeec154480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47396/0 (socket says 172.21.15.7:47396) 2024-04-25T10:02:48.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.693+0000 7fbee9d9b640 1 -- 172.21.15.7:0/1061529028 learned_addr learned my addr 172.21.15.7:0/1061529028 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:48.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.693+0000 7fbeead9d640 1 --2- 172.21.15.7:0/1061529028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeec0d0780 0x7fbeec1549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:48.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.693+0000 7fbeea59c640 1 --2- 172.21.15.7:0/1061529028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbeec0b9130 0x7fbeec0cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:48.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.693+0000 7fbee9d9b640 1 -- 172.21.15.7:0/1061529028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbeec0b9130 msgr2=0x7fbeec0cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:48.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.693+0000 7fbee9d9b640 1 --2- 172.21.15.7:0/1061529028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbeec0b9130 0x7fbeec0cc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:48.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.693+0000 7fbee9d9b640 1 -- 172.21.15.7:0/1061529028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeec0d0780 msgr2=0x7fbeec1549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:48.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.693+0000 7fbee9d9b640 1 --2- 172.21.15.7:0/1061529028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeec0d0780 0x7fbeec1549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:48.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.693+0000 7fbee9d9b640 1 -- 172.21.15.7:0/1061529028 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeec0c7d30 con 0x7fbeec0b9590 2024-04-25T10:02:48.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.693+0000 7fbee9d9b640 1 --2- 172.21.15.7:0/1061529028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbeec0b9590 0x7fbeec154480 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fbed400ebe0 tx=0x7fbed400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:48.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.694+0000 7fbee2ffd640 1 -- 172.21.15.7:0/1061529028 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed4017070 con 0x7fbeec0b9590 2024-04-25T10:02:48.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.694+0000 7fbee2ffd640 1 -- 172.21.15.7:0/1061529028 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed400cc30 con 0x7fbeec0b9590 2024-04-25T10:02:48.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.694+0000 7fbef085a640 1 -- 172.21.15.7:0/1061529028 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeec0c7fb0 con 0x7fbeec0b9590 2024-04-25T10:02:48.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.694+0000 7fbee2ffd640 1 -- 172.21.15.7:0/1061529028 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed4013470 con 0x7fbeec0b9590 2024-04-25T10:02:48.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.694+0000 7fbef085a640 1 -- 172.21.15.7:0/1061529028 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeec0c8570 con 0x7fbeec0b9590 2024-04-25T10:02:48.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.695+0000 7fbef085a640 1 -- 172.21.15.7:0/1061529028 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeec068f60 con 0x7fbeec0b9590 2024-04-25T10:02:48.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.695+0000 7fbee2ffd640 1 -- 172.21.15.7:0/1061529028 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbed401a070 con 0x7fbeec0b9590 2024-04-25T10:02:48.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.696+0000 7fbee2ffd640 1 --2- 172.21.15.7:0/1061529028 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbecc06b500 0x7fbecc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:48.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.696+0000 7fbee2ffd640 1 -- 172.21.15.7:0/1061529028 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5619+0+0 (secure 0 0 0) 0x7fbed408a3f0 con 0x7fbeec0b9590 2024-04-25T10:02:48.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.696+0000 7fbeea59c640 1 --2- 172.21.15.7:0/1061529028 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbecc06b500 0x7fbecc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:48.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.696+0000 7fbeea59c640 1 --2- 172.21.15.7:0/1061529028 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbecc06b500 0x7fbecc06d9c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fbee4034000 tx=0x7fbee402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:48.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.700+0000 7fbee2ffd640 1 -- 172.21.15.7:0/1061529028 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbeec0c7d30 con 0x7fbeec0b9590 2024-04-25T10:02:48.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:48.884+0000 7fbef085a640 1 -- 172.21.15.7:0/1061529028 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fbeec06aef0 con 0x7fbeec0b9590 2024-04-25T10:02:49.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.577+0000 7fbee2ffd640 1 -- 172.21.15.7:0/1061529028 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v101) v1 ==== 170+0+0 (secure 0 0 0) 0x7fbed4058c70 con 0x7fbeec0b9590 2024-04-25T10:02:49.583 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2024-04-25T10:02:49.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.581+0000 7fbef085a640 1 -- 172.21.15.7:0/1061529028 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbecc06b500 msgr2=0x7fbecc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:49.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.581+0000 7fbef085a640 1 --2- 172.21.15.7:0/1061529028 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbecc06b500 0x7fbecc06d9c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fbee4034000 tx=0x7fbee402e000 comp rx=0 tx=0).stop 2024-04-25T10:02:49.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.581+0000 7fbef085a640 1 -- 172.21.15.7:0/1061529028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbeec0b9590 msgr2=0x7fbeec154480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:49.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.581+0000 7fbef085a640 1 --2- 172.21.15.7:0/1061529028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbeec0b9590 0x7fbeec154480 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fbed400ebe0 tx=0x7fbed400c520 comp rx=0 tx=0).stop 2024-04-25T10:02:49.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.581+0000 7fbef085a640 1 -- 172.21.15.7:0/1061529028 shutdown_connections 2024-04-25T10:02:49.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.581+0000 7fbef085a640 1 --2- 172.21.15.7:0/1061529028 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbecc06b500 0x7fbecc06d9c0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:49.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.581+0000 7fbef085a640 1 --2- 172.21.15.7:0/1061529028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeec0d0780 0x7fbeec1549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:49.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.581+0000 7fbef085a640 1 --2- 172.21.15.7:0/1061529028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbeec0b9590 0x7fbeec154480 secure :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fbed400ebe0 tx=0x7fbed400c520 comp rx=0 tx=0).stop 2024-04-25T10:02:49.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.581+0000 7fbef085a640 1 --2- 172.21.15.7:0/1061529028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbeec0b9130 0x7fbeec0cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:49.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.581+0000 7fbef085a640 1 -- 172.21.15.7:0/1061529028 >> 172.21.15.7:0/1061529028 conn(0x7fbeec0726b0 msgr2=0x7fbeec0b6870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:49.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.581+0000 7fbef085a640 1 -- 172.21.15.7:0/1061529028 shutdown_connections 2024-04-25T10:02:49.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.582+0000 7fbef085a640 1 -- 172.21.15.7:0/1061529028 wait complete. 2024-04-25T10:02:49.610 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T10:02:49.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.711+0000 7fcb95a1f640 1 Processor -- start 2024-04-25T10:02:49.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.711+0000 7fcb95a1f640 1 -- start start 2024-04-25T10:02:49.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.712+0000 7fcb95a1f640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcb900ccc80 0x7fcb9015d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:49.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.712+0000 7fcb95a1f640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb900d02f0 con 0x7fcb9006bf10 2024-04-25T10:02:49.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.712+0000 7fcb95a1f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb900d05d0 con 0x7fcb900cda20 2024-04-25T10:02:49.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.712+0000 7fcb95a1f640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb900cde00 con 0x7fcb900ccc80 2024-04-25T10:02:49.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.712+0000 7fcb8e7fc640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fcb9006bf10 0x7fcb900999f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:38740/0 (socket says 172.21.15.7:38740) 2024-04-25T10:02:49.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.712+0000 7fcb8e7fc640 1 -- 172.21.15.7:0/2552710885 learned_addr learned my addr 172.21.15.7:0/2552710885 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:02:49.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.712+0000 7fcb8f7fe640 1 --2- 172.21.15.7:0/2552710885 >> v2:172.21.15.7:3300/0 conn(0x7fcb900ccc80 0x7fcb9015d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:49.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.712+0000 7fcb8f7fe640 1 -- 172.21.15.7:0/2552710885 >> v1:172.21.15.55:6789/0 conn(0x7fcb900cda20 legacy=0x7fcb900cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:49.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.712+0000 7fcb8f7fe640 1 -- 172.21.15.7:0/2552710885 >> v1:172.21.15.7:6789/0 conn(0x7fcb9006bf10 legacy=0x7fcb900999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:49.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.712+0000 7fcb8f7fe640 1 -- 172.21.15.7:0/2552710885 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb900d08b0 con 0x7fcb900ccc80 2024-04-25T10:02:49.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.712+0000 7fcb8dffb640 1 -- 172.21.15.7:0/2552710885 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3480793949 0 0) 0x7fcb900d02f0 con 0x7fcb9006bf10 2024-04-25T10:02:49.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.713+0000 7fcb8f7fe640 1 --2- 172.21.15.7:0/2552710885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb900ccc80 0x7fcb9015d290 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fcb88009d90 tx=0x7fcb8802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa5b01a7d02d425 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:49.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.713+0000 7fcb8dffb640 1 -- 172.21.15.7:0/2552710885 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb88007740 con 0x7fcb900ccc80 2024-04-25T10:02:49.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.713+0000 7fcb8dffb640 1 -- 172.21.15.7:0/2552710885 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb880078e0 con 0x7fcb900ccc80 2024-04-25T10:02:49.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.713+0000 7fcb8dffb640 1 -- 172.21.15.7:0/2552710885 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb88007cb0 con 0x7fcb900ccc80 2024-04-25T10:02:49.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.714+0000 7fcb95a1f640 1 -- 172.21.15.7:0/2552710885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb900ccc80 msgr2=0x7fcb9015d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:49.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.714+0000 7fcb95a1f640 1 --2- 172.21.15.7:0/2552710885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb900ccc80 0x7fcb9015d290 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fcb88009d90 tx=0x7fcb8802a6f0 comp rx=0 tx=0).stop 2024-04-25T10:02:49.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.714+0000 7fcb95a1f640 1 -- 172.21.15.7:0/2552710885 shutdown_connections 2024-04-25T10:02:49.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.714+0000 7fcb95a1f640 1 --2- 172.21.15.7:0/2552710885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb900ccc80 0x7fcb9015d290 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:49.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.714+0000 7fcb95a1f640 1 -- 172.21.15.7:0/2552710885 >> 172.21.15.7:0/2552710885 conn(0x7fcb900b3110 msgr2=0x7fcb900b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:49.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.714+0000 7fcb95a1f640 1 -- 172.21.15.7:0/2552710885 shutdown_connections 2024-04-25T10:02:49.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.714+0000 7fcb95a1f640 1 -- 172.21.15.7:0/2552710885 wait complete. 2024-04-25T10:02:49.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.715+0000 7fcb95a1f640 1 Processor -- start 2024-04-25T10:02:49.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.715+0000 7fcb95a1f640 1 -- start start 2024-04-25T10:02:49.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.716+0000 7fcb95a1f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcb9006bf10 0x7fcb900c7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:49.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.716+0000 7fcb95a1f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb900ccc80 0x7fcb900b5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:49.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.716+0000 7fcb95a1f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb900cda20 0x7fcb9015e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:49.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.716+0000 7fcb95a1f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9009a100 con 0x7fcb900ccc80 2024-04-25T10:02:49.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.716+0000 7fcb95a1f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb900d0e70 con 0x7fcb900cda20 2024-04-25T10:02:49.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.716+0000 7fcb95a1f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9009a280 con 0x7fcb9006bf10 2024-04-25T10:02:49.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.716+0000 7fcb8e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb900ccc80 0x7fcb900b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:49.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.716+0000 7fcb8e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb900ccc80 0x7fcb900b5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47416/0 (socket says 172.21.15.7:47416) 2024-04-25T10:02:49.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.716+0000 7fcb8e7fc640 1 -- 172.21.15.7:0/3000278576 learned_addr learned my addr 172.21.15.7:0/3000278576 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:49.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.716+0000 7fcb8f7fe640 1 --2- 172.21.15.7:0/3000278576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb900cda20 0x7fcb9015e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:49.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.716+0000 7fcb8effd640 1 --2- 172.21.15.7:0/3000278576 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcb9006bf10 0x7fcb900c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:49.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.716+0000 7fcb8e7fc640 1 -- 172.21.15.7:0/3000278576 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcb9006bf10 msgr2=0x7fcb900c7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:49.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.716+0000 7fcb8e7fc640 1 --2- 172.21.15.7:0/3000278576 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcb9006bf10 0x7fcb900c7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:49.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.716+0000 7fcb8e7fc640 1 -- 172.21.15.7:0/3000278576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb900cda20 msgr2=0x7fcb9015e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:49.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.716+0000 7fcb8e7fc640 1 --2- 172.21.15.7:0/3000278576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb900cda20 0x7fcb9015e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:49.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.716+0000 7fcb8e7fc640 1 -- 172.21.15.7:0/3000278576 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb900c7a00 con 0x7fcb900ccc80 2024-04-25T10:02:49.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.717+0000 7fcb8e7fc640 1 --2- 172.21.15.7:0/3000278576 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb900ccc80 0x7fcb900b5890 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400c390 tx=0x7fcb8400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:49.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.717+0000 7fcb77fff640 1 -- 172.21.15.7:0/3000278576 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb84017070 con 0x7fcb900ccc80 2024-04-25T10:02:49.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.717+0000 7fcb77fff640 1 -- 172.21.15.7:0/3000278576 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb84005ce0 con 0x7fcb900ccc80 2024-04-25T10:02:49.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.717+0000 7fcb77fff640 1 -- 172.21.15.7:0/3000278576 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb84007310 con 0x7fcb900ccc80 2024-04-25T10:02:49.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.717+0000 7fcb95a1f640 1 -- 172.21.15.7:0/3000278576 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb900c7ce0 con 0x7fcb900ccc80 2024-04-25T10:02:49.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.717+0000 7fcb95a1f640 1 -- 172.21.15.7:0/3000278576 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb901586e0 con 0x7fcb900ccc80 2024-04-25T10:02:49.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.718+0000 7fcb95a1f640 1 -- 172.21.15.7:0/3000278576 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb90068f60 con 0x7fcb900ccc80 2024-04-25T10:02:49.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.718+0000 7fcb77fff640 1 -- 172.21.15.7:0/3000278576 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcb8401a070 con 0x7fcb900ccc80 2024-04-25T10:02:49.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.719+0000 7fcb77fff640 1 --2- 172.21.15.7:0/3000278576 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcb7c06b500 0x7fcb7c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:49.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.719+0000 7fcb77fff640 1 -- 172.21.15.7:0/3000278576 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6001+0+0 (secure 0 0 0) 0x7fcb840895a0 con 0x7fcb900ccc80 2024-04-25T10:02:49.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.719+0000 7fcb8effd640 1 --2- 172.21.15.7:0/3000278576 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcb7c06b500 0x7fcb7c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:49.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.719+0000 7fcb8effd640 1 --2- 172.21.15.7:0/3000278576 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcb7c06b500 0x7fcb7c06d9c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fcb80000f60 tx=0x7fcb80009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:49.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.723+0000 7fcb77fff640 1 -- 172.21.15.7:0/3000278576 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcb84057d30 con 0x7fcb900ccc80 2024-04-25T10:02:49.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:49.942+0000 7fcb95a1f640 1 -- 172.21.15.7:0/3000278576 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fcb9006e280 con 0x7fcb900ccc80 2024-04-25T10:02:50.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.585+0000 7fcb77fff640 1 -- 172.21.15.7:0/3000278576 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v71) v1 ==== 174+0+0 (secure 0 0 0) 0x7fcb8405bdd0 con 0x7fcb900ccc80 2024-04-25T10:02:50.594 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 15 and data pool 16 2024-04-25T10:02:50.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.602+0000 7fcb95a1f640 1 -- 172.21.15.7:0/3000278576 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcb7c06b500 msgr2=0x7fcb7c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:50.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.602+0000 7fcb95a1f640 1 --2- 172.21.15.7:0/3000278576 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcb7c06b500 0x7fcb7c06d9c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fcb80000f60 tx=0x7fcb80009040 comp rx=0 tx=0).stop 2024-04-25T10:02:50.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.602+0000 7fcb95a1f640 1 -- 172.21.15.7:0/3000278576 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb900ccc80 msgr2=0x7fcb900b5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:50.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.602+0000 7fcb95a1f640 1 --2- 172.21.15.7:0/3000278576 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb900ccc80 0x7fcb900b5890 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400c390 tx=0x7fcb8400c850 comp rx=0 tx=0).stop 2024-04-25T10:02:50.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.602+0000 7fcb95a1f640 1 -- 172.21.15.7:0/3000278576 shutdown_connections 2024-04-25T10:02:50.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.602+0000 7fcb95a1f640 1 --2- 172.21.15.7:0/3000278576 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcb7c06b500 0x7fcb7c06d9c0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:50.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.602+0000 7fcb95a1f640 1 --2- 172.21.15.7:0/3000278576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb900cda20 0x7fcb9015e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:50.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.602+0000 7fcb95a1f640 1 --2- 172.21.15.7:0/3000278576 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb900ccc80 0x7fcb900b5890 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:50.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.602+0000 7fcb95a1f640 1 --2- 172.21.15.7:0/3000278576 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcb9006bf10 0x7fcb900c7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:50.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.602+0000 7fcb95a1f640 1 -- 172.21.15.7:0/3000278576 >> 172.21.15.7:0/3000278576 conn(0x7fcb900b3110 msgr2=0x7fcb90070b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:50.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.604+0000 7fcb95a1f640 1 -- 172.21.15.7:0/3000278576 shutdown_connections 2024-04-25T10:02:50.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.604+0000 7fcb95a1f640 1 -- 172.21.15.7:0/3000278576 wait complete. 2024-04-25T10:02:50.628 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:02:50.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.729+0000 7fd38b493640 1 Processor -- start 2024-04-25T10:02:50.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.729+0000 7fd38b493640 1 -- start start 2024-04-25T10:02:50.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.730+0000 7fd38b493640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd3840b53b0 0x7fd3840d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:50.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.730+0000 7fd38b493640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3840d1e80 con 0x7fd38415db00 2024-04-25T10:02:50.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.730+0000 7fd38b493640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3840b5930 con 0x7fd3840d0a50 2024-04-25T10:02:50.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.730+0000 7fd38b493640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3840b5c10 con 0x7fd3840b53b0 2024-04-25T10:02:50.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.730+0000 7fd38922f640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd38415db00 0x7fd3840d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35556/0 (socket says 172.21.15.7:35556) 2024-04-25T10:02:50.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.730+0000 7fd38922f640 1 -- 172.21.15.7:0/2073450522 learned_addr learned my addr 172.21.15.7:0/2073450522 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:02:50.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.730+0000 7fd37bfff640 1 -- 172.21.15.7:0/2073450522 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 520647664 0 0) 0x7fd3840d1e80 con 0x7fd38415db00 2024-04-25T10:02:50.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.730+0000 7fd389a30640 1 --2- 172.21.15.7:0/2073450522 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd3840b53b0 0x7fd3840d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:50.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.730+0000 7fd37bfff640 1 -- 172.21.15.7:0/2073450522 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd370003520 con 0x7fd38415db00 2024-04-25T10:02:50.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.730+0000 7fd37bfff640 1 -- 172.21.15.7:0/2073450522 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2834204819 0 0) 0x7fd370003520 con 0x7fd38415db00 2024-04-25T10:02:50.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.730+0000 7fd37bfff640 1 -- 172.21.15.7:0/2073450522 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd3840b53b0 msgr2=0x7fd3840d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:50.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.730+0000 7fd37bfff640 1 --2- 172.21.15.7:0/2073450522 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd3840b53b0 0x7fd3840d2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:50.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.730+0000 7fd37bfff640 1 -- 172.21.15.7:0/2073450522 >> v1:172.21.15.55:6789/0 conn(0x7fd3840d0a50 legacy=0x7fd3840d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:50.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.730+0000 7fd37bfff640 1 -- 172.21.15.7:0/2073450522 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3840b5ef0 con 0x7fd38415db00 2024-04-25T10:02:50.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.730+0000 7fd37bfff640 1 -- 172.21.15.7:0/2073450522 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fd380001670 con 0x7fd38415db00 2024-04-25T10:02:50.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.730+0000 7fd37bfff640 1 -- 172.21.15.7:0/2073450522 >> v1:172.21.15.7:6789/0 conn(0x7fd38415db00 legacy=0x7fd3840d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:50.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.730+0000 7fd37bfff640 1 --2- 172.21.15.7:0/2073450522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3700039e0 0x7fd370003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:50.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.730+0000 7fd37bfff640 1 --2- 172.21.15.7:0/2073450522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd370004800 0x7fd370004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:50.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.730+0000 7fd37bfff640 1 --2- 172.21.15.7:0/2073450522 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd3840b53b0 0x7fd3700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:50.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.730+0000 7fd37bfff640 1 -- 172.21.15.7:0/2073450522 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3840b5c10 con 0x7fd3700039e0 2024-04-25T10:02:50.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.730+0000 7fd37bfff640 1 -- 172.21.15.7:0/2073450522 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37000baa0 con 0x7fd370004800 2024-04-25T10:02:50.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.730+0000 7fd37bfff640 1 -- 172.21.15.7:0/2073450522 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37000bca0 con 0x7fd3840b53b0 2024-04-25T10:02:50.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.731+0000 7fd38922f640 1 --2- 172.21.15.7:0/2073450522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3700039e0 0x7fd370003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:50.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.731+0000 7fd388a2e640 1 --2- 172.21.15.7:0/2073450522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd370004800 0x7fd370004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:50.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.731+0000 7fd389a30640 1 --2- 172.21.15.7:0/2073450522 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd3840b53b0 0x7fd3700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:50.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.731+0000 7fd38922f640 1 -- 172.21.15.7:0/2073450522 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd3840b53b0 msgr2=0x7fd3700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:50.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.731+0000 7fd38922f640 1 --2- 172.21.15.7:0/2073450522 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd3840b53b0 0x7fd3700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:50.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.731+0000 7fd38922f640 1 -- 172.21.15.7:0/2073450522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd370004800 msgr2=0x7fd370004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:50.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.731+0000 7fd38922f640 1 --2- 172.21.15.7:0/2073450522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd370004800 0x7fd370004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:50.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.731+0000 7fd38922f640 1 -- 172.21.15.7:0/2073450522 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd370003520 con 0x7fd3700039e0 2024-04-25T10:02:50.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.732+0000 7fd38922f640 1 --2- 172.21.15.7:0/2073450522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3700039e0 0x7fd370003e00 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fd380001eb0 tx=0x7fd370005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e09ed38434de33 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:50.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.732+0000 7fd37bfff640 1 -- 172.21.15.7:0/2073450522 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd380007d30 con 0x7fd3700039e0 2024-04-25T10:02:50.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.732+0000 7fd37bfff640 1 -- 172.21.15.7:0/2073450522 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd380005af0 con 0x7fd3700039e0 2024-04-25T10:02:50.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.732+0000 7fd37bfff640 1 -- 172.21.15.7:0/2073450522 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd380007070 con 0x7fd3700039e0 2024-04-25T10:02:50.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.732+0000 7fd38b493640 1 -- 172.21.15.7:0/2073450522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3700039e0 msgr2=0x7fd370003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:50.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.732+0000 7fd38b493640 1 --2- 172.21.15.7:0/2073450522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3700039e0 0x7fd370003e00 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fd380001eb0 tx=0x7fd370005830 comp rx=0 tx=0).stop 2024-04-25T10:02:50.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.732+0000 7fd389a30640 1 -- 172.21.15.7:0/2073450522 reap_dead start 2024-04-25T10:02:50.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.732+0000 7fd38b493640 1 -- 172.21.15.7:0/2073450522 shutdown_connections 2024-04-25T10:02:50.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.732+0000 7fd38b493640 1 -- 172.21.15.7:0/2073450522 >> 172.21.15.7:0/2073450522 conn(0x7fd384072290 msgr2=0x7fd3840726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:50.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.732+0000 7fd38b493640 1 -- 172.21.15.7:0/2073450522 shutdown_connections 2024-04-25T10:02:50.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.732+0000 7fd38b493640 1 -- 172.21.15.7:0/2073450522 wait complete. 2024-04-25T10:02:50.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.733+0000 7fd38b493640 1 Processor -- start 2024-04-25T10:02:50.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.734+0000 7fd38b493640 1 -- start start 2024-04-25T10:02:50.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.734+0000 7fd38b493640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3700039e0 0x7fd3841f32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:50.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.734+0000 7fd38b493640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3840cb6d0 0x7fd384150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:50.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.734+0000 7fd38b493640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd38415cb80 0x7fd38414e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:50.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.734+0000 7fd38b493640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3840d3660 con 0x7fd3700039e0 2024-04-25T10:02:50.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.734+0000 7fd38b493640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3840b61d0 con 0x7fd3840cb6d0 2024-04-25T10:02:50.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.734+0000 7fd38b493640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3840ce2b0 con 0x7fd38415cb80 2024-04-25T10:02:50.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.734+0000 7fd38922f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3700039e0 0x7fd3841f32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:50.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.734+0000 7fd38922f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3700039e0 0x7fd3841f32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44068/0 (socket says 172.21.15.7:44068) 2024-04-25T10:02:50.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.734+0000 7fd38922f640 1 -- 172.21.15.7:0/328125464 learned_addr learned my addr 172.21.15.7:0/328125464 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:50.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.734+0000 7fd389a30640 1 --2- 172.21.15.7:0/328125464 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd38415cb80 0x7fd38414e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:50.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.734+0000 7fd388a2e640 1 --2- 172.21.15.7:0/328125464 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3840cb6d0 0x7fd384150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:50.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.735+0000 7fd38922f640 1 -- 172.21.15.7:0/328125464 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd38415cb80 msgr2=0x7fd38414e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:50.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.735+0000 7fd38922f640 1 --2- 172.21.15.7:0/328125464 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd38415cb80 0x7fd38414e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:50.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.735+0000 7fd38922f640 1 -- 172.21.15.7:0/328125464 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3840cb6d0 msgr2=0x7fd384150a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:50.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.735+0000 7fd38922f640 1 --2- 172.21.15.7:0/328125464 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3840cb6d0 0x7fd384150a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:50.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.735+0000 7fd38922f640 1 -- 172.21.15.7:0/328125464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3841511b0 con 0x7fd3700039e0 2024-04-25T10:02:50.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.735+0000 7fd388a2e640 1 --2- 172.21.15.7:0/328125464 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3840cb6d0 0x7fd384150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:02:50.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.735+0000 7fd38922f640 1 --2- 172.21.15.7:0/328125464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3700039e0 0x7fd3841f32f0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fd380001eb0 tx=0x7fd380001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:50.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.735+0000 7fd379ffb640 1 -- 172.21.15.7:0/328125464 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd380041030 con 0x7fd3700039e0 2024-04-25T10:02:50.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.735+0000 7fd379ffb640 1 -- 172.21.15.7:0/328125464 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd380038040 con 0x7fd3700039e0 2024-04-25T10:02:50.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.735+0000 7fd379ffb640 1 -- 172.21.15.7:0/328125464 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd380001670 con 0x7fd3700039e0 2024-04-25T10:02:50.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.735+0000 7fd38b493640 1 -- 172.21.15.7:0/328125464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd384151490 con 0x7fd3700039e0 2024-04-25T10:02:50.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.735+0000 7fd38b493640 1 -- 172.21.15.7:0/328125464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd384151a50 con 0x7fd3700039e0 2024-04-25T10:02:50.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.736+0000 7fd38b493640 1 -- 172.21.15.7:0/328125464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd384068fd0 con 0x7fd3700039e0 2024-04-25T10:02:50.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.737+0000 7fd379ffb640 1 -- 172.21.15.7:0/328125464 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd380044070 con 0x7fd3700039e0 2024-04-25T10:02:50.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.737+0000 7fd379ffb640 1 --2- 172.21.15.7:0/328125464 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd36806b4d0 0x7fd36806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:50.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.737+0000 7fd379ffb640 1 -- 172.21.15.7:0/328125464 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd3800a9d30 con 0x7fd3700039e0 2024-04-25T10:02:50.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.737+0000 7fd388a2e640 1 --2- 172.21.15.7:0/328125464 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd36806b4d0 0x7fd36806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:50.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.738+0000 7fd388a2e640 1 --2- 172.21.15.7:0/328125464 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd36806b4d0 0x7fd36806d990 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd3840cbad0 tx=0x7fd374009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:50.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.741+0000 7fd379ffb640 1 -- 172.21.15.7:0/328125464 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd38004b020 con 0x7fd3700039e0 2024-04-25T10:02:50.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.923+0000 7fd38b493640 1 -- 172.21.15.7:0/328125464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3840d16b0 con 0x7fd3700039e0 2024-04-25T10:02:50.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.924+0000 7fd379ffb640 1 -- 172.21.15.7:0/328125464 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+16801 (secure 0 0 0) 0x7fd380078ab0 con 0x7fd3700039e0 2024-04-25T10:02:50.931 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:02:50.931 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":102,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:02:49.943977+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:02:48.213751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T10:02:48.916114+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:02:50.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.927+0000 7fd38b493640 1 -- 172.21.15.7:0/328125464 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd36806b4d0 msgr2=0x7fd36806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:50.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.927+0000 7fd38b493640 1 --2- 172.21.15.7:0/328125464 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd36806b4d0 0x7fd36806d990 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd3840cbad0 tx=0x7fd374009040 comp rx=0 tx=0).stop 2024-04-25T10:02:50.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.927+0000 7fd38b493640 1 -- 172.21.15.7:0/328125464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3700039e0 msgr2=0x7fd3841f32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:50.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.927+0000 7fd38b493640 1 --2- 172.21.15.7:0/328125464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3700039e0 0x7fd3841f32f0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fd380001eb0 tx=0x7fd380001a40 comp rx=0 tx=0).stop 2024-04-25T10:02:50.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.927+0000 7fd38b493640 1 -- 172.21.15.7:0/328125464 shutdown_connections 2024-04-25T10:02:50.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.927+0000 7fd38b493640 1 --2- 172.21.15.7:0/328125464 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd36806b4d0 0x7fd36806d990 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:50.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.927+0000 7fd38b493640 1 --2- 172.21.15.7:0/328125464 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd38415cb80 0x7fd38414e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:50.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.927+0000 7fd38b493640 1 --2- 172.21.15.7:0/328125464 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3840cb6d0 0x7fd384150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:50.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.927+0000 7fd38b493640 1 --2- 172.21.15.7:0/328125464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3700039e0 0x7fd3841f32f0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:50.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.927+0000 7fd38b493640 1 -- 172.21.15.7:0/328125464 >> 172.21.15.7:0/328125464 conn(0x7fd384072290 msgr2=0x7fd38415f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:50.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.927+0000 7fd38b493640 1 -- 172.21.15.7:0/328125464 shutdown_connections 2024-04-25T10:02:50.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:50.927+0000 7fd38b493640 1 -- 172.21.15.7:0/328125464 wait complete. 2024-04-25T10:02:50.943 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:02:51.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.039+0000 7f46e57cf640 1 Processor -- start 2024-04-25T10:02:51.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.039+0000 7f46e57cf640 1 -- start start 2024-04-25T10:02:51.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.039+0000 7f46e57cf640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f46e006c250 0x7f46e009a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:51.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.040+0000 7f46e57cf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f46e006bce0 0x7f46e006c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:51.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.040+0000 7f46e57cf640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e006cb70 con 0x7f46e00d0360 2024-04-25T10:02:51.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.040+0000 7f46e57cf640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e009ae20 con 0x7f46e006c250 2024-04-25T10:02:51.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.040+0000 7f46e57cf640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e009a450 con 0x7f46e006bce0 2024-04-25T10:02:51.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.040+0000 7f46deffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f46e006c250 0x7f46e009a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:51.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.040+0000 7f46deffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f46e006c250 0x7f46e009a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44074/0 (socket says 172.21.15.7:44074) 2024-04-25T10:02:51.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.040+0000 7f46deffd640 1 -- 172.21.15.7:0/3413574471 learned_addr learned my addr 172.21.15.7:0/3413574471 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:51.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.040+0000 7f46deffd640 1 -- 172.21.15.7:0/3413574471 >> v2:172.21.15.55:3300/0 conn(0x7f46e006bce0 msgr2=0x7f46e006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:51.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.040+0000 7f46deffd640 1 --2- 172.21.15.7:0/3413574471 >> v2:172.21.15.55:3300/0 conn(0x7f46e006bce0 0x7f46e006c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:51.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.040+0000 7f46deffd640 1 -- 172.21.15.7:0/3413574471 >> v1:172.21.15.55:6789/0 conn(0x7f46e00d0360 legacy=0x7f46e00cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:51.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.040+0000 7f46deffd640 1 -- 172.21.15.7:0/3413574471 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e0099b20 con 0x7f46e006c250 2024-04-25T10:02:51.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.041+0000 7f46deffd640 1 --2- 172.21.15.7:0/3413574471 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46e006c250 0x7f46e009a8e0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f46e00727b0 tx=0x7f46d002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7403b486ee750345 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:51.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.041+0000 7f46de7fc640 1 -- 172.21.15.7:0/3413574471 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d0037070 con 0x7f46e006c250 2024-04-25T10:02:51.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.041+0000 7f46de7fc640 1 -- 172.21.15.7:0/3413574471 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d002ae20 con 0x7f46e006c250 2024-04-25T10:02:51.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.041+0000 7f46de7fc640 1 -- 172.21.15.7:0/3413574471 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d0032660 con 0x7f46e006c250 2024-04-25T10:02:51.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.041+0000 7f46e57cf640 1 -- 172.21.15.7:0/3413574471 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46e006c250 msgr2=0x7f46e009a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:51.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.041+0000 7f46e57cf640 1 --2- 172.21.15.7:0/3413574471 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46e006c250 0x7f46e009a8e0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f46e00727b0 tx=0x7f46d002a110 comp rx=0 tx=0).stop 2024-04-25T10:02:51.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.041+0000 7f46e57cf640 1 -- 172.21.15.7:0/3413574471 shutdown_connections 2024-04-25T10:02:51.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.041+0000 7f46e57cf640 1 --2- 172.21.15.7:0/3413574471 >> v2:172.21.15.55:3300/0 conn(0x7f46e006bce0 0x7f46e006c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:51.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.041+0000 7f46e57cf640 1 --2- 172.21.15.7:0/3413574471 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46e006c250 0x7f46e009a8e0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:51.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.042+0000 7f46e57cf640 1 -- 172.21.15.7:0/3413574471 >> 172.21.15.7:0/3413574471 conn(0x7f46e00d16e0 msgr2=0x7f46e00d1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:51.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.042+0000 7f46e57cf640 1 -- 172.21.15.7:0/3413574471 shutdown_connections 2024-04-25T10:02:51.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.042+0000 7f46e57cf640 1 -- 172.21.15.7:0/3413574471 wait complete. 2024-04-25T10:02:51.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.043+0000 7f46e57cf640 1 Processor -- start 2024-04-25T10:02:51.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.043+0000 7f46e57cf640 1 -- start start 2024-04-25T10:02:51.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.043+0000 7f46e57cf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46e006bce0 0x7f46e00ca550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:51.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.043+0000 7f46e57cf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46e006c250 0x7f46e015da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:51.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.043+0000 7f46e57cf640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f46e00d0360 0x7f46e01597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:51.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.043+0000 7f46e57cf640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e009a0e0 con 0x7f46e006bce0 2024-04-25T10:02:51.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.043+0000 7f46e57cf640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e00d0c60 con 0x7f46e006c250 2024-04-25T10:02:51.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.043+0000 7f46e57cf640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e015f000 con 0x7f46e00d0360 2024-04-25T10:02:51.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.044+0000 7f46deffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46e006bce0 0x7f46e00ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:51.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.044+0000 7f46deffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46e006bce0 0x7f46e00ca550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44078/0 (socket says 172.21.15.7:44078) 2024-04-25T10:02:51.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.044+0000 7f46deffd640 1 -- 172.21.15.7:0/4143422041 learned_addr learned my addr 172.21.15.7:0/4143422041 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:51.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.044+0000 7f46d7fff640 1 --2- 172.21.15.7:0/4143422041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46e006c250 0x7f46e015da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:51.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.044+0000 7f46df7fe640 1 --2- 172.21.15.7:0/4143422041 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f46e00d0360 0x7f46e01597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:51.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.044+0000 7f46deffd640 1 -- 172.21.15.7:0/4143422041 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f46e00d0360 msgr2=0x7f46e01597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:51.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.044+0000 7f46deffd640 1 --2- 172.21.15.7:0/4143422041 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f46e00d0360 0x7f46e01597f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:51.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.044+0000 7f46deffd640 1 -- 172.21.15.7:0/4143422041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46e006c250 msgr2=0x7f46e015da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:51.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.044+0000 7f46deffd640 1 --2- 172.21.15.7:0/4143422041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46e006c250 0x7f46e015da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:51.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.044+0000 7f46deffd640 1 -- 172.21.15.7:0/4143422041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e015c170 con 0x7f46e006bce0 2024-04-25T10:02:51.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.044+0000 7f46deffd640 1 --2- 172.21.15.7:0/4143422041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46e006bce0 0x7f46e00ca550 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f46d002a150 tx=0x7f46d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:51.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.044+0000 7f46d77fe640 1 -- 172.21.15.7:0/4143422041 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d0042070 con 0x7f46e006bce0 2024-04-25T10:02:51.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.044+0000 7f46d77fe640 1 -- 172.21.15.7:0/4143422041 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d003e670 con 0x7f46e006bce0 2024-04-25T10:02:51.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.044+0000 7f46e57cf640 1 -- 172.21.15.7:0/4143422041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e015c450 con 0x7f46e006bce0 2024-04-25T10:02:51.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.044+0000 7f46d77fe640 1 -- 172.21.15.7:0/4143422041 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d0037040 con 0x7f46e006bce0 2024-04-25T10:02:51.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.044+0000 7f46e57cf640 1 -- 172.21.15.7:0/4143422041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e015ca10 con 0x7f46e006bce0 2024-04-25T10:02:51.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.045+0000 7f46e57cf640 1 -- 172.21.15.7:0/4143422041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e0068fd0 con 0x7f46e006bce0 2024-04-25T10:02:51.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.046+0000 7f46d77fe640 1 -- 172.21.15.7:0/4143422041 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f46d0045070 con 0x7f46e006bce0 2024-04-25T10:02:51.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.046+0000 7f46d77fe640 1 --2- 172.21.15.7:0/4143422041 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f46c006b4d0 0x7f46c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:51.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.047+0000 7f46d77fe640 1 -- 172.21.15.7:0/4143422041 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f46d00aaa10 con 0x7f46e006bce0 2024-04-25T10:02:51.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.047+0000 7f46d7fff640 1 --2- 172.21.15.7:0/4143422041 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f46c006b4d0 0x7f46c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:51.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.047+0000 7f46d7fff640 1 --2- 172.21.15.7:0/4143422041 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f46c006b4d0 0x7f46c006d990 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f46e009ad10 tx=0x7f46c8009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:51.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.051+0000 7f46d77fe640 1 -- 172.21.15.7:0/4143422041 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f46d00790a0 con 0x7f46e006bce0 2024-04-25T10:02:51.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.230+0000 7f46e57cf640 1 -- 172.21.15.7:0/4143422041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46e00d1150 con 0x7f46e006bce0 2024-04-25T10:02:51.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.231+0000 7f46d77fe640 1 -- 172.21.15.7:0/4143422041 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+16801 (secure 0 0 0) 0x7f46d002ae20 con 0x7f46e006bce0 2024-04-25T10:02:51.236 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:02:51.236 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":102,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:02:49.943977+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:02:48.213751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T10:02:48.916114+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:02:51.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.233+0000 7f46e57cf640 1 -- 172.21.15.7:0/4143422041 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f46c006b4d0 msgr2=0x7f46c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:51.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.233+0000 7f46e57cf640 1 --2- 172.21.15.7:0/4143422041 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f46c006b4d0 0x7f46c006d990 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f46e009ad10 tx=0x7f46c8009060 comp rx=0 tx=0).stop 2024-04-25T10:02:51.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.233+0000 7f46e57cf640 1 -- 172.21.15.7:0/4143422041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46e006bce0 msgr2=0x7f46e00ca550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:51.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.233+0000 7f46e57cf640 1 --2- 172.21.15.7:0/4143422041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46e006bce0 0x7f46e00ca550 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f46d002a150 tx=0x7f46d00046c0 comp rx=0 tx=0).stop 2024-04-25T10:02:51.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.233+0000 7f46e57cf640 1 -- 172.21.15.7:0/4143422041 shutdown_connections 2024-04-25T10:02:51.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.233+0000 7f46e57cf640 1 --2- 172.21.15.7:0/4143422041 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f46c006b4d0 0x7f46c006d990 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:51.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.233+0000 7f46e57cf640 1 --2- 172.21.15.7:0/4143422041 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f46e00d0360 0x7f46e01597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:51.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.233+0000 7f46e57cf640 1 --2- 172.21.15.7:0/4143422041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46e006c250 0x7f46e015da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:51.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.233+0000 7f46e57cf640 1 --2- 172.21.15.7:0/4143422041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46e006bce0 0x7f46e00ca550 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:51.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.233+0000 7f46e57cf640 1 -- 172.21.15.7:0/4143422041 >> 172.21.15.7:0/4143422041 conn(0x7f46e00d16e0 msgr2=0x7f46e015a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:51.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.233+0000 7f46e57cf640 1 -- 172.21.15.7:0/4143422041 shutdown_connections 2024-04-25T10:02:51.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.233+0000 7f46e57cf640 1 -- 172.21.15.7:0/4143422041 wait complete. 2024-04-25T10:02:51.250 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T10:02:51.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.348+0000 7fdd70cf5640 1 Processor -- start 2024-04-25T10:02:51.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.348+0000 7fdd70cf5640 1 -- start start 2024-04-25T10:02:51.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.349+0000 7fdd70cf5640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdd6c15f1c0 0x7fdd6c15eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:51.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.349+0000 7fdd70cf5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd6c0ce830 0x7fdd6c0b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:51.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.349+0000 7fdd70cf5640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd6c0ced10 con 0x7fdd6c0d3760 2024-04-25T10:02:51.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.349+0000 7fdd70cf5640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd6c0ce380 con 0x7fdd6c15f1c0 2024-04-25T10:02:51.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.349+0000 7fdd70cf5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c15f000 con 0x7fdd6c0ce830 2024-04-25T10:02:51.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.349+0000 7fdd69d9b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdd6c15f1c0 0x7fdd6c15eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:51.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.349+0000 7fdd6a59c640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fdd6c0d3760 0x7fdd6c0d3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35570/0 (socket says 172.21.15.7:35570) 2024-04-25T10:02:51.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.349+0000 7fdd6a59c640 1 -- 172.21.15.7:0/4054947776 learned_addr learned my addr 172.21.15.7:0/4054947776 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:02:51.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.350+0000 7fdd6ad9d640 1 --2- 172.21.15.7:0/4054947776 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd6c0ce830 0x7fdd6c0b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:51.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.350+0000 7fdd69d9b640 1 -- 172.21.15.7:0/4054947776 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd6c0ce830 msgr2=0x7fdd6c0b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:51.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.350+0000 7fdd69d9b640 1 --2- 172.21.15.7:0/4054947776 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd6c0ce830 0x7fdd6c0b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:51.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.350+0000 7fdd69d9b640 1 -- 172.21.15.7:0/4054947776 >> v1:172.21.15.7:6789/0 conn(0x7fdd6c0d3760 legacy=0x7fdd6c0d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:51.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.350+0000 7fdd69d9b640 1 -- 172.21.15.7:0/4054947776 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd6c0d1b40 con 0x7fdd6c15f1c0 2024-04-25T10:02:51.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.350+0000 7fdd6959a640 1 -- 172.21.15.7:0/4054947776 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861301501 0 0) 0x7fdd6c0ced10 con 0x7fdd6c0d3760 2024-04-25T10:02:51.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.350+0000 7fdd69d9b640 1 --2- 172.21.15.7:0/4054947776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd6c15f1c0 0x7fdd6c15eac0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fdd600097a0 tx=0x7fdd6002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce52d23685860b61 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:51.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.351+0000 7fdd6959a640 1 -- 172.21.15.7:0/4054947776 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd60037070 con 0x7fdd6c15f1c0 2024-04-25T10:02:51.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.351+0000 7fdd6959a640 1 -- 172.21.15.7:0/4054947776 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd60032440 con 0x7fdd6c15f1c0 2024-04-25T10:02:51.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.351+0000 7fdd6959a640 1 -- 172.21.15.7:0/4054947776 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd60032810 con 0x7fdd6c15f1c0 2024-04-25T10:02:51.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.351+0000 7fdd70cf5640 1 -- 172.21.15.7:0/4054947776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd6c15f1c0 msgr2=0x7fdd6c15eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:51.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.351+0000 7fdd70cf5640 1 --2- 172.21.15.7:0/4054947776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd6c15f1c0 0x7fdd6c15eac0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fdd600097a0 tx=0x7fdd6002a180 comp rx=0 tx=0).stop 2024-04-25T10:02:51.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.351+0000 7fdd70cf5640 1 -- 172.21.15.7:0/4054947776 shutdown_connections 2024-04-25T10:02:51.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.351+0000 7fdd70cf5640 1 --2- 172.21.15.7:0/4054947776 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd6c0ce830 0x7fdd6c0b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:51.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.351+0000 7fdd70cf5640 1 --2- 172.21.15.7:0/4054947776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd6c15f1c0 0x7fdd6c15eac0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:51.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.351+0000 7fdd70cf5640 1 -- 172.21.15.7:0/4054947776 >> 172.21.15.7:0/4054947776 conn(0x7fdd6c072680 msgr2=0x7fdd6c072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:51.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.351+0000 7fdd70cf5640 1 -- 172.21.15.7:0/4054947776 shutdown_connections 2024-04-25T10:02:51.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.351+0000 7fdd70cf5640 1 -- 172.21.15.7:0/4054947776 wait complete. 2024-04-25T10:02:51.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.353+0000 7fdd70cf5640 1 Processor -- start 2024-04-25T10:02:51.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.353+0000 7fdd70cf5640 1 -- start start 2024-04-25T10:02:51.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.353+0000 7fdd70cf5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd6c0ce830 0x7fdd6c0b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:51.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.353+0000 7fdd70cf5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd6c0d3760 0x7fdd6c14edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:51.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.353+0000 7fdd70cf5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd6c15f1c0 0x7fdd6c15b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:51.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.353+0000 7fdd70cf5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c15de10 con 0x7fdd6c15f1c0 2024-04-25T10:02:51.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.353+0000 7fdd70cf5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c0d2190 con 0x7fdd6c0ce830 2024-04-25T10:02:51.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.353+0000 7fdd70cf5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c0b2780 con 0x7fdd6c0d3760 2024-04-25T10:02:51.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.354+0000 7fdd6ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd6c15f1c0 0x7fdd6c15b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:51.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.354+0000 7fdd6ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd6c15f1c0 0x7fdd6c15b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44110/0 (socket says 172.21.15.7:44110) 2024-04-25T10:02:51.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.354+0000 7fdd6ad9d640 1 -- 172.21.15.7:0/446680205 learned_addr learned my addr 172.21.15.7:0/446680205 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:51.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.354+0000 7fdd69d9b640 1 --2- 172.21.15.7:0/446680205 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd6c0d3760 0x7fdd6c14edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:51.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.354+0000 7fdd6a59c640 1 --2- 172.21.15.7:0/446680205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd6c0ce830 0x7fdd6c0b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:51.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.354+0000 7fdd6ad9d640 1 -- 172.21.15.7:0/446680205 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd6c0d3760 msgr2=0x7fdd6c14edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:51.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.354+0000 7fdd6ad9d640 1 --2- 172.21.15.7:0/446680205 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd6c0d3760 0x7fdd6c14edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:51.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.354+0000 7fdd6ad9d640 1 -- 172.21.15.7:0/446680205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd6c0ce830 msgr2=0x7fdd6c0b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:51.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.354+0000 7fdd6ad9d640 1 --2- 172.21.15.7:0/446680205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd6c0ce830 0x7fdd6c0b2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:51.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.354+0000 7fdd6ad9d640 1 -- 172.21.15.7:0/446680205 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd6c0b3240 con 0x7fdd6c15f1c0 2024-04-25T10:02:51.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.354+0000 7fdd6ad9d640 1 --2- 172.21.15.7:0/446680205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd6c15f1c0 0x7fdd6c15b500 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c007e30 tx=0x7fdd5c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:51.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.354+0000 7fdd5affd640 1 -- 172.21.15.7:0/446680205 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c014620 con 0x7fdd6c15f1c0 2024-04-25T10:02:51.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.354+0000 7fdd5affd640 1 -- 172.21.15.7:0/446680205 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5c019070 con 0x7fdd6c15f1c0 2024-04-25T10:02:51.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.354+0000 7fdd5affd640 1 -- 172.21.15.7:0/446680205 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c014a00 con 0x7fdd6c15f1c0 2024-04-25T10:02:51.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.354+0000 7fdd70cf5640 1 -- 172.21.15.7:0/446680205 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd6c0b3520 con 0x7fdd6c15f1c0 2024-04-25T10:02:51.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.354+0000 7fdd70cf5640 1 -- 172.21.15.7:0/446680205 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd6c0b3ae0 con 0x7fdd6c15f1c0 2024-04-25T10:02:51.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.355+0000 7fdd70cf5640 1 -- 172.21.15.7:0/446680205 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd6c068f60 con 0x7fdd6c15f1c0 2024-04-25T10:02:51.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.356+0000 7fdd5affd640 1 -- 172.21.15.7:0/446680205 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdd5c014ba0 con 0x7fdd6c15f1c0 2024-04-25T10:02:51.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.356+0000 7fdd5affd640 1 --2- 172.21.15.7:0/446680205 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdd4c06b4d0 0x7fdd4c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:51.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.356+0000 7fdd5affd640 1 -- 172.21.15.7:0/446680205 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fdd5c08ae20 con 0x7fdd6c15f1c0 2024-04-25T10:02:51.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.356+0000 7fdd6a59c640 1 --2- 172.21.15.7:0/446680205 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdd4c06b4d0 0x7fdd4c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:51.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.357+0000 7fdd6a59c640 1 --2- 172.21.15.7:0/446680205 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdd4c06b4d0 0x7fdd4c06d990 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fdd64000f60 tx=0x7fdd64007b50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:51.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.360+0000 7fdd5affd640 1 -- 172.21.15.7:0/446680205 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdd5c0599e0 con 0x7fdd6c15f1c0 2024-04-25T10:02:51.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.580+0000 7fdd70cf5640 1 -- 172.21.15.7:0/446680205 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdd6c0ce610 con 0x7fdd6c15f1c0 2024-04-25T10:02:51.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.586+0000 7fdd5affd640 1 -- 172.21.15.7:0/446680205 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v72) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdd5c0592e0 con 0x7fdd6c15f1c0 2024-04-25T10:02:51.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.588+0000 7fdd70cf5640 1 -- 172.21.15.7:0/446680205 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdd4c06b4d0 msgr2=0x7fdd4c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:51.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.588+0000 7fdd70cf5640 1 --2- 172.21.15.7:0/446680205 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdd4c06b4d0 0x7fdd4c06d990 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fdd64000f60 tx=0x7fdd64007b50 comp rx=0 tx=0).stop 2024-04-25T10:02:51.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.588+0000 7fdd70cf5640 1 -- 172.21.15.7:0/446680205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd6c15f1c0 msgr2=0x7fdd6c15b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:51.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.588+0000 7fdd70cf5640 1 --2- 172.21.15.7:0/446680205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd6c15f1c0 0x7fdd6c15b500 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c007e30 tx=0x7fdd5c00e4b0 comp rx=0 tx=0).stop 2024-04-25T10:02:51.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.588+0000 7fdd70cf5640 1 -- 172.21.15.7:0/446680205 shutdown_connections 2024-04-25T10:02:51.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.588+0000 7fdd70cf5640 1 --2- 172.21.15.7:0/446680205 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdd4c06b4d0 0x7fdd4c06d990 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:51.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.588+0000 7fdd70cf5640 1 --2- 172.21.15.7:0/446680205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd6c15f1c0 0x7fdd6c15b500 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:51.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.588+0000 7fdd70cf5640 1 --2- 172.21.15.7:0/446680205 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd6c0d3760 0x7fdd6c14edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:51.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.588+0000 7fdd70cf5640 1 --2- 172.21.15.7:0/446680205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd6c0ce830 0x7fdd6c0b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:51.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.588+0000 7fdd70cf5640 1 -- 172.21.15.7:0/446680205 >> 172.21.15.7:0/446680205 conn(0x7fdd6c072680 msgr2=0x7fdd6c0b6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:51.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.588+0000 7fdd70cf5640 1 -- 172.21.15.7:0/446680205 shutdown_connections 2024-04-25T10:02:51.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.588+0000 7fdd70cf5640 1 -- 172.21.15.7:0/446680205 wait complete. 2024-04-25T10:02:51.605 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T10:02:51.605 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T10:02:51.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.703+0000 7fb268093640 1 Processor -- start 2024-04-25T10:02:51.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.704+0000 7fb268093640 1 -- start start 2024-04-25T10:02:51.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.704+0000 7fb268093640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb2600cfc40 0x7fb2600d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:51.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.704+0000 7fb268093640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb2600b1480 0x7fb2600b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:51.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.704+0000 7fb268093640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb2600ce070 0x7fb2600ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:51.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.704+0000 7fb268093640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2600b25e0 con 0x7fb2600ce070 2024-04-25T10:02:51.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.704+0000 7fb268093640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb26015bec0 con 0x7fb2600cfc40 2024-04-25T10:02:51.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.704+0000 7fb268093640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2600d0560 con 0x7fb2600b1480 2024-04-25T10:02:51.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.705+0000 7fb266630640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb2600ce070 0x7fb2600ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:51.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.705+0000 7fb266630640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb2600ce070 0x7fb2600ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44112/0 (socket says 172.21.15.7:44112) 2024-04-25T10:02:51.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.705+0000 7fb266630640 1 -- 172.21.15.7:0/3262657122 learned_addr learned my addr 172.21.15.7:0/3262657122 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:51.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.705+0000 7fb26562e640 1 --2- 172.21.15.7:0/3262657122 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb2600b1480 0x7fb2600b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:51.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.705+0000 7fb265e2f640 1 --2- 172.21.15.7:0/3262657122 >> v2:172.21.15.55:3300/0 conn(0x7fb2600cfc40 0x7fb2600d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:51.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.705+0000 7fb266630640 1 -- 172.21.15.7:0/3262657122 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb2600b1480 msgr2=0x7fb2600b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:51.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.705+0000 7fb266630640 1 --2- 172.21.15.7:0/3262657122 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb2600b1480 0x7fb2600b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:51.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.705+0000 7fb266630640 1 -- 172.21.15.7:0/3262657122 >> v2:172.21.15.55:3300/0 conn(0x7fb2600cfc40 msgr2=0x7fb2600d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:51.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.705+0000 7fb266630640 1 --2- 172.21.15.7:0/3262657122 >> v2:172.21.15.55:3300/0 conn(0x7fb2600cfc40 0x7fb2600d0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:51.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.705+0000 7fb266630640 1 -- 172.21.15.7:0/3262657122 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2600b19d0 con 0x7fb2600ce070 2024-04-25T10:02:51.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.706+0000 7fb266630640 1 --2- 172.21.15.7:0/3262657122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2600ce070 0x7fb2600ce500 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fb2600cf110 tx=0x7fb25802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1d15b1d88283935 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:51.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.706+0000 7fb264e2d640 1 -- 172.21.15.7:0/3262657122 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb258036070 con 0x7fb2600ce070 2024-04-25T10:02:51.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.706+0000 7fb264e2d640 1 -- 172.21.15.7:0/3262657122 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb258031600 con 0x7fb2600ce070 2024-04-25T10:02:51.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.706+0000 7fb264e2d640 1 -- 172.21.15.7:0/3262657122 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2580319d0 con 0x7fb2600ce070 2024-04-25T10:02:51.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.706+0000 7fb268093640 1 -- 172.21.15.7:0/3262657122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2600ce070 msgr2=0x7fb2600ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:51.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.706+0000 7fb268093640 1 --2- 172.21.15.7:0/3262657122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2600ce070 0x7fb2600ce500 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fb2600cf110 tx=0x7fb25802a6a0 comp rx=0 tx=0).stop 2024-04-25T10:02:51.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.706+0000 7fb268093640 1 -- 172.21.15.7:0/3262657122 shutdown_connections 2024-04-25T10:02:51.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.706+0000 7fb268093640 1 --2- 172.21.15.7:0/3262657122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2600ce070 0x7fb2600ce500 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:51.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.706+0000 7fb268093640 1 --2- 172.21.15.7:0/3262657122 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb2600b1480 0x7fb2600b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:51.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.706+0000 7fb268093640 1 --2- 172.21.15.7:0/3262657122 >> v2:172.21.15.55:3300/0 conn(0x7fb2600cfc40 0x7fb2600d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:51.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.706+0000 7fb268093640 1 -- 172.21.15.7:0/3262657122 >> 172.21.15.7:0/3262657122 conn(0x7fb26008af80 msgr2=0x7fb26008b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:51.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.706+0000 7fb268093640 1 -- 172.21.15.7:0/3262657122 shutdown_connections 2024-04-25T10:02:51.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.706+0000 7fb268093640 1 -- 172.21.15.7:0/3262657122 wait complete. 2024-04-25T10:02:51.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.708+0000 7fb268093640 1 Processor -- start 2024-04-25T10:02:51.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.708+0000 7fb268093640 1 -- start start 2024-04-25T10:02:51.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.708+0000 7fb268093640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb2600b1480 0x7fb2601f4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:51.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.708+0000 7fb268093640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2600ce070 0x7fb2600b6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:51.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.708+0000 7fb268093640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2600cfc40 0x7fb2601f6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:51.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.708+0000 7fb268093640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2600b2270 con 0x7fb2600ce070 2024-04-25T10:02:51.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.708+0000 7fb268093640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2600b1f90 con 0x7fb2600cfc40 2024-04-25T10:02:51.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.708+0000 7fb268093640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2600b1010 con 0x7fb2600b1480 2024-04-25T10:02:51.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.708+0000 7fb26562e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2600ce070 0x7fb2600b6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:51.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.708+0000 7fb26562e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2600ce070 0x7fb2600b6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44124/0 (socket says 172.21.15.7:44124) 2024-04-25T10:02:51.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.708+0000 7fb26562e640 1 -- 172.21.15.7:0/112393783 learned_addr learned my addr 172.21.15.7:0/112393783 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:51.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.709+0000 7fb265e2f640 1 --2- 172.21.15.7:0/112393783 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb2600b1480 0x7fb2601f4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:51.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.709+0000 7fb266630640 1 --2- 172.21.15.7:0/112393783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2600cfc40 0x7fb2601f6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:51.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.709+0000 7fb26562e640 1 -- 172.21.15.7:0/112393783 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb2600b1480 msgr2=0x7fb2601f4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:51.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.709+0000 7fb26562e640 1 --2- 172.21.15.7:0/112393783 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb2600b1480 0x7fb2601f4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:51.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.709+0000 7fb26562e640 1 -- 172.21.15.7:0/112393783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2600cfc40 msgr2=0x7fb2601f6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:51.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.709+0000 7fb26562e640 1 --2- 172.21.15.7:0/112393783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2600cfc40 0x7fb2601f6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:51.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.709+0000 7fb26562e640 1 -- 172.21.15.7:0/112393783 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2600c71c0 con 0x7fb2600ce070 2024-04-25T10:02:51.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.709+0000 7fb266630640 1 --2- 172.21.15.7:0/112393783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2600cfc40 0x7fb2601f6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:02:51.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.709+0000 7fb26562e640 1 --2- 172.21.15.7:0/112393783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2600ce070 0x7fb2600b6d50 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fb25000d5f0 tx=0x7fb25000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:51.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.709+0000 7fb2567fc640 1 -- 172.21.15.7:0/112393783 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2500125f0 con 0x7fb2600ce070 2024-04-25T10:02:51.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.709+0000 7fb2567fc640 1 -- 172.21.15.7:0/112393783 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb250019070 con 0x7fb2600ce070 2024-04-25T10:02:51.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.709+0000 7fb2567fc640 1 -- 172.21.15.7:0/112393783 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2500129d0 con 0x7fb2600ce070 2024-04-25T10:02:51.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.709+0000 7fb268093640 1 -- 172.21.15.7:0/112393783 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2601f7d90 con 0x7fb2600ce070 2024-04-25T10:02:51.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.709+0000 7fb268093640 1 -- 172.21.15.7:0/112393783 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2601f3a60 con 0x7fb2600ce070 2024-04-25T10:02:51.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.710+0000 7fb268093640 1 -- 172.21.15.7:0/112393783 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2600b02c0 con 0x7fb2600ce070 2024-04-25T10:02:51.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.711+0000 7fb2567fc640 1 -- 172.21.15.7:0/112393783 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb250012b70 con 0x7fb2600ce070 2024-04-25T10:02:51.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.711+0000 7fb2567fc640 1 --2- 172.21.15.7:0/112393783 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb24406b500 0x7fb24406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:51.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.711+0000 7fb2567fc640 1 -- 172.21.15.7:0/112393783 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb25008a670 con 0x7fb2600ce070 2024-04-25T10:02:51.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.711+0000 7fb265e2f640 1 --2- 172.21.15.7:0/112393783 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb24406b500 0x7fb24406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:51.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.711+0000 7fb265e2f640 1 --2- 172.21.15.7:0/112393783 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb24406b500 0x7fb24406d9c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb25c006fd0 tx=0x7fb25c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:51.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.715+0000 7fb2567fc640 1 -- 172.21.15.7:0/112393783 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb2600b02c0 con 0x7fb2600ce070 2024-04-25T10:02:51.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:51.941+0000 7fb268093640 1 -- 172.21.15.7:0/112393783 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb260066d30 con 0x7fb2600ce070 2024-04-25T10:02:52.562 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-04-25T10:02:52.555+0000 7f870781e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:02:52.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.604+0000 7fb2567fc640 1 -- 172.21.15.7:0/112393783 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v73) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb260066d30 con 0x7fb2600ce070 2024-04-25T10:02:52.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.608+0000 7fb268093640 1 -- 172.21.15.7:0/112393783 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb24406b500 msgr2=0x7fb24406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:52.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.608+0000 7fb268093640 1 --2- 172.21.15.7:0/112393783 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb24406b500 0x7fb24406d9c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb25c006fd0 tx=0x7fb25c008040 comp rx=0 tx=0).stop 2024-04-25T10:02:52.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.608+0000 7fb268093640 1 -- 172.21.15.7:0/112393783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2600ce070 msgr2=0x7fb2600b6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:52.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.608+0000 7fb268093640 1 --2- 172.21.15.7:0/112393783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2600ce070 0x7fb2600b6d50 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fb25000d5f0 tx=0x7fb25000dab0 comp rx=0 tx=0).stop 2024-04-25T10:02:52.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.608+0000 7fb268093640 1 -- 172.21.15.7:0/112393783 shutdown_connections 2024-04-25T10:02:52.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.608+0000 7fb268093640 1 --2- 172.21.15.7:0/112393783 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb24406b500 0x7fb24406d9c0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:52.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.608+0000 7fb268093640 1 --2- 172.21.15.7:0/112393783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2600cfc40 0x7fb2601f6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:52.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.608+0000 7fb268093640 1 --2- 172.21.15.7:0/112393783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2600ce070 0x7fb2600b6d50 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:52.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.608+0000 7fb268093640 1 --2- 172.21.15.7:0/112393783 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb2600b1480 0x7fb2601f4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:52.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.608+0000 7fb268093640 1 -- 172.21.15.7:0/112393783 >> 172.21.15.7:0/112393783 conn(0x7fb26008af80 msgr2=0x7fb26006f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:52.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.608+0000 7fb268093640 1 -- 172.21.15.7:0/112393783 shutdown_connections 2024-04-25T10:02:52.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.608+0000 7fb268093640 1 -- 172.21.15.7:0/112393783 wait complete. 2024-04-25T10:02:52.627 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T10:02:52.627 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:02:52.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.731+0000 7f9226122640 1 Processor -- start 2024-04-25T10:02:52.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.731+0000 7f9226122640 1 -- start start 2024-04-25T10:02:52.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.731+0000 7f9226122640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92200cd740 0x7f92200d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:52.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.731+0000 7f9226122640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f922006cd90 0x7f92200cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:52.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.731+0000 7f9226122640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9220099b90 con 0x7f92200d08d0 2024-04-25T10:02:52.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.731+0000 7f9226122640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92200cdb20 con 0x7f922006cd90 2024-04-25T10:02:52.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.731+0000 7f9226122640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9220099e70 con 0x7f92200cd740 2024-04-25T10:02:52.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.732+0000 7f921f7fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92200cd740 0x7f92200d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:52.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.732+0000 7f921ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f922006cd90 0x7f92200cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:52.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.732+0000 7f921f7fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92200cd740 0x7f92200d0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:57168/0 (socket says 172.21.15.7:57168) 2024-04-25T10:02:52.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.732+0000 7f921f7fe640 1 -- 172.21.15.7:0/3782476002 learned_addr learned my addr 172.21.15.7:0/3782476002 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:52.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.732+0000 7f921ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f922006cd90 0x7f92200cbc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:49682/0 (socket says 172.21.15.7:49682) 2024-04-25T10:02:52.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.732+0000 7f921effd640 1 --1- 172.21.15.7:0/3782476002 >> v1:172.21.15.55:6789/0 conn(0x7f92200d08d0 0x7f922006c680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:47064/0 (socket says 172.21.15.7:47064) 2024-04-25T10:02:52.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.732+0000 7f921f7fe640 1 -- 172.21.15.7:0/3782476002 >> v2:172.21.15.55:3300/0 conn(0x7f922006cd90 msgr2=0x7f92200cbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:52.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.732+0000 7f921f7fe640 1 --2- 172.21.15.7:0/3782476002 >> v2:172.21.15.55:3300/0 conn(0x7f922006cd90 0x7f92200cbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:52.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.732+0000 7f921f7fe640 1 -- 172.21.15.7:0/3782476002 >> v1:172.21.15.55:6789/0 conn(0x7f92200d08d0 legacy=0x7f922006c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:52.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.732+0000 7f921f7fe640 1 -- 172.21.15.7:0/3782476002 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922009a150 con 0x7f92200cd740 2024-04-25T10:02:52.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.733+0000 7f921f7fe640 1 --2- 172.21.15.7:0/3782476002 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92200cd740 0x7f92200d0390 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9210009870 tx=0x7f921002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a724aed81615cb13 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:52.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.733+0000 7f921e7fc640 1 -- 172.21.15.7:0/3782476002 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9210037070 con 0x7f92200cd740 2024-04-25T10:02:52.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.733+0000 7f921e7fc640 1 -- 172.21.15.7:0/3782476002 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9210032440 con 0x7f92200cd740 2024-04-25T10:02:52.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.733+0000 7f921e7fc640 1 -- 172.21.15.7:0/3782476002 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9210032810 con 0x7f92200cd740 2024-04-25T10:02:52.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.734+0000 7f9226122640 1 -- 172.21.15.7:0/3782476002 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92200cd740 msgr2=0x7f92200d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:52.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.734+0000 7f9226122640 1 --2- 172.21.15.7:0/3782476002 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92200cd740 0x7f92200d0390 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9210009870 tx=0x7f921002a270 comp rx=0 tx=0).stop 2024-04-25T10:02:52.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.734+0000 7f9226122640 1 -- 172.21.15.7:0/3782476002 shutdown_connections 2024-04-25T10:02:52.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.734+0000 7f9226122640 1 --2- 172.21.15.7:0/3782476002 >> v2:172.21.15.55:3300/0 conn(0x7f922006cd90 0x7f92200cbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:52.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.734+0000 7f9226122640 1 --2- 172.21.15.7:0/3782476002 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92200cd740 0x7f92200d0390 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:52.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.734+0000 7f9226122640 1 -- 172.21.15.7:0/3782476002 >> 172.21.15.7:0/3782476002 conn(0x7f92200b3130 msgr2=0x7f92200b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:52.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.734+0000 7f9226122640 1 -- 172.21.15.7:0/3782476002 shutdown_connections 2024-04-25T10:02:52.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.734+0000 7f9226122640 1 -- 172.21.15.7:0/3782476002 wait complete. 2024-04-25T10:02:52.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.735+0000 7f9226122640 1 Processor -- start 2024-04-25T10:02:52.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.735+0000 7f9226122640 1 -- start start 2024-04-25T10:02:52.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.736+0000 7f9226122640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f922006cd90 0x7f922009dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:52.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.736+0000 7f9226122640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92200cd740 0x7f92200b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:52.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.736+0000 7f9226122640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92200d08d0 0x7f92200b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:52.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.736+0000 7f9226122640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922009ac30 con 0x7f922006cd90 2024-04-25T10:02:52.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.736+0000 7f9226122640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922009a710 con 0x7f92200d08d0 2024-04-25T10:02:52.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.736+0000 7f9226122640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922009adb0 con 0x7f92200cd740 2024-04-25T10:02:52.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.736+0000 7f921f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f922006cd90 0x7f922009dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:52.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.736+0000 7f921f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f922006cd90 0x7f922009dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44140/0 (socket says 172.21.15.7:44140) 2024-04-25T10:02:52.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.736+0000 7f921f7fe640 1 -- 172.21.15.7:0/255394397 learned_addr learned my addr 172.21.15.7:0/255394397 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:52.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.736+0000 7f921effd640 1 --2- 172.21.15.7:0/255394397 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92200cd740 0x7f92200b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:52.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.736+0000 7f921ffff640 1 --2- 172.21.15.7:0/255394397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92200d08d0 0x7f92200b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:52.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.736+0000 7f921f7fe640 1 -- 172.21.15.7:0/255394397 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92200cd740 msgr2=0x7f92200b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:52.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.736+0000 7f921f7fe640 1 --2- 172.21.15.7:0/255394397 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92200cd740 0x7f92200b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:52.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.736+0000 7f921f7fe640 1 -- 172.21.15.7:0/255394397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92200d08d0 msgr2=0x7f92200b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:52.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.736+0000 7f921f7fe640 1 --2- 172.21.15.7:0/255394397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92200d08d0 0x7f92200b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:52.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.736+0000 7f921f7fe640 1 -- 172.21.15.7:0/255394397 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92200ae520 con 0x7f922006cd90 2024-04-25T10:02:52.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.736+0000 7f921effd640 1 --2- 172.21.15.7:0/255394397 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92200cd740 0x7f92200b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:02:52.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.736+0000 7f921f7fe640 1 --2- 172.21.15.7:0/255394397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f922006cd90 0x7f922009dad0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f9210000c00 tx=0x7f92100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:52.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.737+0000 7f9207fff640 1 -- 172.21.15.7:0/255394397 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9210037040 con 0x7f922006cd90 2024-04-25T10:02:52.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.737+0000 7f9207fff640 1 -- 172.21.15.7:0/255394397 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9210042070 con 0x7f922006cd90 2024-04-25T10:02:52.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.737+0000 7f9207fff640 1 -- 172.21.15.7:0/255394397 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9210030860 con 0x7f922006cd90 2024-04-25T10:02:52.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.737+0000 7f9226122640 1 -- 172.21.15.7:0/255394397 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92200ae7c0 con 0x7f922006cd90 2024-04-25T10:02:52.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.737+0000 7f9226122640 1 -- 172.21.15.7:0/255394397 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92200aed80 con 0x7f922006cd90 2024-04-25T10:02:52.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.738+0000 7f9226122640 1 -- 172.21.15.7:0/255394397 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9220068fd0 con 0x7f922006cd90 2024-04-25T10:02:52.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.738+0000 7f9207fff640 1 -- 172.21.15.7:0/255394397 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9210030a00 con 0x7f922006cd90 2024-04-25T10:02:52.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.739+0000 7f9207fff640 1 --2- 172.21.15.7:0/255394397 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f920c06b4d0 0x7f920c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:52.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.739+0000 7f9207fff640 1 -- 172.21.15.7:0/255394397 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f92100aabd0 con 0x7f922006cd90 2024-04-25T10:02:52.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.739+0000 7f921effd640 1 --2- 172.21.15.7:0/255394397 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f920c06b4d0 0x7f920c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:52.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.739+0000 7f921effd640 1 --2- 172.21.15.7:0/255394397 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f920c06b4d0 0x7f920c06d990 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f9214007fd0 tx=0x7f9214007d40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:52.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.743+0000 7f9207fff640 1 -- 172.21.15.7:0/255394397 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f92100798c0 con 0x7f922006cd90 2024-04-25T10:02:52.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.960+0000 7f9226122640 1 -- 172.21.15.7:0/255394397 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92200b4040 con 0x7f922006cd90 2024-04-25T10:02:52.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.960+0000 7f9207fff640 1 -- 172.21.15.7:0/255394397 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4931 (secure 0 0 0) 0x7f92100791c0 con 0x7f922006cd90 2024-04-25T10:02:52.965 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:02:52.965 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":73,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6617,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3278722694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3278722694},{"type":"v1","addr":"172.21.15.55:6835","nonce":3278722694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":7435,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3598653097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3598653097},{"type":"v1","addr":"172.21.15.55:6834","nonce":3598653097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":8361,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3628875229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3628875229},{"type":"v1","addr":"172.21.15.7:6836","nonce":3628875229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:02:49.944298+0000","modified":"2024-04-25T10:02:51.943060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8364},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8364":{"gid":8364,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6837/900729992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":900729992},{"type":"v1","addr":"172.21.15.7:6837","nonce":900729992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T10:02:52.966 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 73 2024-04-25T10:02:52.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.962+0000 7f9226122640 1 -- 172.21.15.7:0/255394397 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f920c06b4d0 msgr2=0x7f920c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:52.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.962+0000 7f9226122640 1 --2- 172.21.15.7:0/255394397 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f920c06b4d0 0x7f920c06d990 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f9214007fd0 tx=0x7f9214007d40 comp rx=0 tx=0).stop 2024-04-25T10:02:52.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.962+0000 7f9226122640 1 -- 172.21.15.7:0/255394397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f922006cd90 msgr2=0x7f922009dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:52.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.962+0000 7f9226122640 1 --2- 172.21.15.7:0/255394397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f922006cd90 0x7f922009dad0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f9210000c00 tx=0x7f92100046c0 comp rx=0 tx=0).stop 2024-04-25T10:02:52.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.963+0000 7f9226122640 1 -- 172.21.15.7:0/255394397 shutdown_connections 2024-04-25T10:02:52.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.963+0000 7f9226122640 1 --2- 172.21.15.7:0/255394397 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f920c06b4d0 0x7f920c06d990 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:52.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.963+0000 7f9226122640 1 --2- 172.21.15.7:0/255394397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92200d08d0 0x7f92200b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:52.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.963+0000 7f9226122640 1 --2- 172.21.15.7:0/255394397 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92200cd740 0x7f92200b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:52.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.963+0000 7f9226122640 1 --2- 172.21.15.7:0/255394397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f922006cd90 0x7f922009dad0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:52.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.963+0000 7f9226122640 1 -- 172.21.15.7:0/255394397 >> 172.21.15.7:0/255394397 conn(0x7f92200b3130 msgr2=0x7f922015d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:52.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.963+0000 7f9226122640 1 -- 172.21.15.7:0/255394397 shutdown_connections 2024-04-25T10:02:52.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:52.963+0000 7f9226122640 1 -- 172.21.15.7:0/255394397 wait complete. 2024-04-25T10:02:52.979 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:02:53.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.074+0000 7fc42770a640 1 Processor -- start 2024-04-25T10:02:53.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.074+0000 7fc42770a640 1 -- start start 2024-04-25T10:02:53.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.075+0000 7fc42770a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc4200b5e60 0x7fc42006bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:53.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.075+0000 7fc42770a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc42006cd00 con 0x7fc42015dd00 2024-04-25T10:02:53.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.075+0000 7fc42770a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4200d1ca0 con 0x7fc4200b6a40 2024-04-25T10:02:53.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.075+0000 7fc42770a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc42015e0e0 con 0x7fc4200b5e60 2024-04-25T10:02:53.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.075+0000 7fc424ca5640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc4200b5e60 0x7fc42006bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:53.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.075+0000 7fc4254a6640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc42015dd00 0x7fc4200b5750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35578/0 (socket says 172.21.15.7:35578) 2024-04-25T10:02:53.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.075+0000 7fc4254a6640 1 -- 172.21.15.7:0/4222611085 learned_addr learned my addr 172.21.15.7:0/4222611085 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:02:53.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.075+0000 7fc424ca5640 1 -- 172.21.15.7:0/4222611085 >> v1:172.21.15.55:6789/0 conn(0x7fc4200b6a40 legacy=0x7fc42006c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:53.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.075+0000 7fc424ca5640 1 -- 172.21.15.7:0/4222611085 >> v1:172.21.15.7:6789/0 conn(0x7fc42015dd00 legacy=0x7fc4200b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:53.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.075+0000 7fc424ca5640 1 -- 172.21.15.7:0/4222611085 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4200d1f80 con 0x7fc4200b5e60 2024-04-25T10:02:53.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.075+0000 7fc41ffff640 1 -- 172.21.15.7:0/4222611085 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469672370 0 0) 0x7fc42006cd00 con 0x7fc42015dd00 2024-04-25T10:02:53.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.076+0000 7fc424ca5640 1 --2- 172.21.15.7:0/4222611085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4200b5e60 0x7fc42006bfb0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fc4140097a0 tx=0x7fc41402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2067dbb283ac309 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:53.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.076+0000 7fc41ffff640 1 -- 172.21.15.7:0/4222611085 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc414037070 con 0x7fc4200b5e60 2024-04-25T10:02:53.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.076+0000 7fc41ffff640 1 -- 172.21.15.7:0/4222611085 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc414032440 con 0x7fc4200b5e60 2024-04-25T10:02:53.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.076+0000 7fc41ffff640 1 -- 172.21.15.7:0/4222611085 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc414032810 con 0x7fc4200b5e60 2024-04-25T10:02:53.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.077+0000 7fc42770a640 1 -- 172.21.15.7:0/4222611085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4200b5e60 msgr2=0x7fc42006bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:53.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.077+0000 7fc42770a640 1 --2- 172.21.15.7:0/4222611085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4200b5e60 0x7fc42006bfb0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fc4140097a0 tx=0x7fc41402a230 comp rx=0 tx=0).stop 2024-04-25T10:02:53.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.077+0000 7fc42770a640 1 -- 172.21.15.7:0/4222611085 shutdown_connections 2024-04-25T10:02:53.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.077+0000 7fc42770a640 1 --2- 172.21.15.7:0/4222611085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4200b5e60 0x7fc42006bfb0 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:53.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.077+0000 7fc42770a640 1 -- 172.21.15.7:0/4222611085 >> 172.21.15.7:0/4222611085 conn(0x7fc4200d07b0 msgr2=0x7fc4200d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:53.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.077+0000 7fc42770a640 1 -- 172.21.15.7:0/4222611085 shutdown_connections 2024-04-25T10:02:53.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.077+0000 7fc42770a640 1 -- 172.21.15.7:0/4222611085 wait complete. 2024-04-25T10:02:53.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.078+0000 7fc42770a640 1 Processor -- start 2024-04-25T10:02:53.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.078+0000 7fc42770a640 1 -- start start 2024-04-25T10:02:53.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.079+0000 7fc42770a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc4200b5e60 0x7fc42014a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:53.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.079+0000 7fc42770a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4200b6a40 0x7fc42014e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:53.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.079+0000 7fc42770a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc42015dd00 0x7fc420160250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:53.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.079+0000 7fc42770a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc420168ab0 con 0x7fc4200b6a40 2024-04-25T10:02:53.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.079+0000 7fc42770a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42006cfe0 con 0x7fc42015dd00 2024-04-25T10:02:53.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.079+0000 7fc42770a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc420168c30 con 0x7fc4200b5e60 2024-04-25T10:02:53.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.079+0000 7fc424ca5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4200b6a40 0x7fc42014e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:53.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.079+0000 7fc424ca5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4200b6a40 0x7fc42014e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44166/0 (socket says 172.21.15.7:44166) 2024-04-25T10:02:53.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.079+0000 7fc424ca5640 1 -- 172.21.15.7:0/2258431266 learned_addr learned my addr 172.21.15.7:0/2258431266 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:53.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.079+0000 7fc4254a6640 1 --2- 172.21.15.7:0/2258431266 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc4200b5e60 0x7fc42014a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:53.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.079+0000 7fc425ca7640 1 --2- 172.21.15.7:0/2258431266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc42015dd00 0x7fc420160250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:53.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.079+0000 7fc424ca5640 1 -- 172.21.15.7:0/2258431266 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc4200b5e60 msgr2=0x7fc42014a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:53.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.079+0000 7fc424ca5640 1 --2- 172.21.15.7:0/2258431266 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc4200b5e60 0x7fc42014a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:53.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.079+0000 7fc424ca5640 1 -- 172.21.15.7:0/2258431266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc42015dd00 msgr2=0x7fc420160250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:53.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.079+0000 7fc424ca5640 1 --2- 172.21.15.7:0/2258431266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc42015dd00 0x7fc420160250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:53.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.079+0000 7fc424ca5640 1 -- 172.21.15.7:0/2258431266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc42014cff0 con 0x7fc4200b6a40 2024-04-25T10:02:53.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.079+0000 7fc425ca7640 1 --2- 172.21.15.7:0/2258431266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc42015dd00 0x7fc420160250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:02:53.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.079+0000 7fc424ca5640 1 --2- 172.21.15.7:0/2258431266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4200b6a40 0x7fc42014e940 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fc4140097a0 tx=0x7fc4140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:53.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.080+0000 7fc41dffb640 1 -- 172.21.15.7:0/2258431266 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc414037050 con 0x7fc4200b6a40 2024-04-25T10:02:53.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.080+0000 7fc41dffb640 1 -- 172.21.15.7:0/2258431266 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc414038040 con 0x7fc4200b6a40 2024-04-25T10:02:53.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.080+0000 7fc41dffb640 1 -- 172.21.15.7:0/2258431266 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc414004490 con 0x7fc4200b6a40 2024-04-25T10:02:53.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.080+0000 7fc42770a640 1 -- 172.21.15.7:0/2258431266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc420160e30 con 0x7fc4200b6a40 2024-04-25T10:02:53.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.080+0000 7fc42770a640 1 -- 172.21.15.7:0/2258431266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4200cae60 con 0x7fc4200b6a40 2024-04-25T10:02:53.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.081+0000 7fc42770a640 1 -- 172.21.15.7:0/2258431266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc420068fd0 con 0x7fc4200b6a40 2024-04-25T10:02:53.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.081+0000 7fc41dffb640 1 -- 172.21.15.7:0/2258431266 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc414030900 con 0x7fc4200b6a40 2024-04-25T10:02:53.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.082+0000 7fc41dffb640 1 --2- 172.21.15.7:0/2258431266 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc40c06b4d0 0x7fc40c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:53.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.082+0000 7fc41dffb640 1 -- 172.21.15.7:0/2258431266 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc4140aaf00 con 0x7fc4200b6a40 2024-04-25T10:02:53.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.082+0000 7fc4254a6640 1 --2- 172.21.15.7:0/2258431266 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc40c06b4d0 0x7fc40c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:53.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.082+0000 7fc4254a6640 1 --2- 172.21.15.7:0/2258431266 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc40c06b4d0 0x7fc40c06d990 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc4100012e0 tx=0x7fc410004d40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:53.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.086+0000 7fc41dffb640 1 -- 172.21.15.7:0/2258431266 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc42014cff0 con 0x7fc4200b6a40 2024-04-25T10:02:53.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.269+0000 7fc42770a640 1 -- 172.21.15.7:0/2258431266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4200d1620 con 0x7fc4200b6a40 2024-04-25T10:02:53.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.270+0000 7fc41dffb640 1 -- 172.21.15.7:0/2258431266 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+16788 (secure 0 0 0) 0x7fc414079d10 con 0x7fc4200b6a40 2024-04-25T10:02:53.275 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:02:53.275 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":103,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:02:51.586260+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:02:48.213751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T10:02:48.916114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:02:53.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.272+0000 7fc42770a640 1 -- 172.21.15.7:0/2258431266 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc40c06b4d0 msgr2=0x7fc40c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:53.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.272+0000 7fc42770a640 1 --2- 172.21.15.7:0/2258431266 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc40c06b4d0 0x7fc40c06d990 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc4100012e0 tx=0x7fc410004d40 comp rx=0 tx=0).stop 2024-04-25T10:02:53.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.272+0000 7fc42770a640 1 -- 172.21.15.7:0/2258431266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4200b6a40 msgr2=0x7fc42014e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:53.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.272+0000 7fc42770a640 1 --2- 172.21.15.7:0/2258431266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4200b6a40 0x7fc42014e940 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fc4140097a0 tx=0x7fc4140046c0 comp rx=0 tx=0).stop 2024-04-25T10:02:53.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.272+0000 7fc42770a640 1 -- 172.21.15.7:0/2258431266 shutdown_connections 2024-04-25T10:02:53.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.272+0000 7fc42770a640 1 --2- 172.21.15.7:0/2258431266 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc40c06b4d0 0x7fc40c06d990 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:53.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.272+0000 7fc42770a640 1 --2- 172.21.15.7:0/2258431266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc42015dd00 0x7fc420160250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:53.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.272+0000 7fc42770a640 1 --2- 172.21.15.7:0/2258431266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4200b6a40 0x7fc42014e940 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:53.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.272+0000 7fc42770a640 1 --2- 172.21.15.7:0/2258431266 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc4200b5e60 0x7fc42014a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:53.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.272+0000 7fc42770a640 1 -- 172.21.15.7:0/2258431266 >> 172.21.15.7:0/2258431266 conn(0x7fc4200d07b0 msgr2=0x7fc4200b39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:53.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.272+0000 7fc42770a640 1 -- 172.21.15.7:0/2258431266 shutdown_connections 2024-04-25T10:02:53.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.272+0000 7fc42770a640 1 -- 172.21.15.7:0/2258431266 wait complete. 2024-04-25T10:02:53.288 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T10:02:53.289 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:02:53.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.384+0000 7fc3171b0640 1 Processor -- start 2024-04-25T10:02:53.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.385+0000 7fc3171b0640 1 -- start start 2024-04-25T10:02:53.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.385+0000 7fc3171b0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc310145260 0x7fc3100726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:53.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.385+0000 7fc3171b0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc31006b270 0x7fc31015d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:53.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.385+0000 7fc3171b0640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc31015cd80 con 0x7fc31015c8f0 2024-04-25T10:02:53.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.385+0000 7fc3171b0640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc310160110 con 0x7fc310145260 2024-04-25T10:02:53.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.385+0000 7fc3171b0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31015f500 con 0x7fc31006b270 2024-04-25T10:02:53.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.385+0000 7fc30ffff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc31015c8f0 0x7fc31006ab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35584/0 (socket says 172.21.15.7:35584) 2024-04-25T10:02:53.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.386+0000 7fc30ffff640 1 -- 172.21.15.7:0/4190731360 learned_addr learned my addr 172.21.15.7:0/4190731360 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:02:53.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.386+0000 7fc314f4c640 1 --2- 172.21.15.7:0/4190731360 >> v2:172.21.15.55:3300/0 conn(0x7fc310145260 0x7fc3100726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:53.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.386+0000 7fc31574d640 1 --2- 172.21.15.7:0/4190731360 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc31006b270 0x7fc31015d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:53.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.386+0000 7fc30f7fe640 1 -- 172.21.15.7:0/4190731360 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2375980431 0 0) 0x7fc31015cd80 con 0x7fc31015c8f0 2024-04-25T10:02:53.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.386+0000 7fc30f7fe640 1 -- 172.21.15.7:0/4190731360 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2fc003520 con 0x7fc31015c8f0 2024-04-25T10:02:53.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.386+0000 7fc30f7fe640 1 -- 172.21.15.7:0/4190731360 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 999753141 0 0) 0x7fc2fc003520 con 0x7fc31015c8f0 2024-04-25T10:02:53.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.386+0000 7fc30f7fe640 1 -- 172.21.15.7:0/4190731360 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc31006b270 msgr2=0x7fc31015d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:53.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.386+0000 7fc30f7fe640 1 --2- 172.21.15.7:0/4190731360 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc31006b270 0x7fc31015d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:53.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.386+0000 7fc30f7fe640 1 -- 172.21.15.7:0/4190731360 >> v2:172.21.15.55:3300/0 conn(0x7fc310145260 msgr2=0x7fc3100726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:53.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.386+0000 7fc30f7fe640 1 --2- 172.21.15.7:0/4190731360 >> v2:172.21.15.55:3300/0 conn(0x7fc310145260 0x7fc3100726e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:53.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.386+0000 7fc30f7fe640 1 -- 172.21.15.7:0/4190731360 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31015f7e0 con 0x7fc31015c8f0 2024-04-25T10:02:53.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.386+0000 7fc30f7fe640 1 -- 172.21.15.7:0/4190731360 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fc3000019f0 con 0x7fc31015c8f0 2024-04-25T10:02:53.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.386+0000 7fc30f7fe640 1 -- 172.21.15.7:0/4190731360 >> v1:172.21.15.7:6789/0 conn(0x7fc31015c8f0 legacy=0x7fc31006ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:53.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.386+0000 7fc30f7fe640 1 --2- 172.21.15.7:0/4190731360 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2fc0039b0 0x7fc2fc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:53.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.386+0000 7fc30f7fe640 1 --2- 172.21.15.7:0/4190731360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2fc0043a0 0x7fc2fc004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:53.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.386+0000 7fc30f7fe640 1 --2- 172.21.15.7:0/4190731360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2fc004ef0 0x7fc2fc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:53.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.386+0000 7fc30f7fe640 1 -- 172.21.15.7:0/4190731360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31015f500 con 0x7fc2fc004ef0 2024-04-25T10:02:53.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.386+0000 7fc30f7fe640 1 -- 172.21.15.7:0/4190731360 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2fc00bf00 con 0x7fc2fc0043a0 2024-04-25T10:02:53.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.386+0000 7fc30f7fe640 1 -- 172.21.15.7:0/4190731360 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2fc00c080 con 0x7fc2fc0039b0 2024-04-25T10:02:53.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.386+0000 7fc31574d640 1 --2- 172.21.15.7:0/4190731360 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc31006b270 0x7fc31015d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:02:53.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.386+0000 7fc314f4c640 1 --2- 172.21.15.7:0/4190731360 >> v2:172.21.15.55:3300/0 conn(0x7fc310145260 0x7fc3100726e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:02:53.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.386+0000 7fc31574d640 1 --2- 172.21.15.7:0/4190731360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2fc004ef0 0x7fc2fc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:53.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.386+0000 7fc30ffff640 1 --2- 172.21.15.7:0/4190731360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2fc0043a0 0x7fc2fc004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:53.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.386+0000 7fc314f4c640 1 --2- 172.21.15.7:0/4190731360 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2fc0039b0 0x7fc2fc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:53.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.387+0000 7fc31574d640 1 -- 172.21.15.7:0/4190731360 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2fc0039b0 msgr2=0x7fc2fc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:53.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.387+0000 7fc31574d640 1 --2- 172.21.15.7:0/4190731360 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2fc0039b0 0x7fc2fc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:53.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.387+0000 7fc31574d640 1 -- 172.21.15.7:0/4190731360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2fc0043a0 msgr2=0x7fc2fc004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:53.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.387+0000 7fc31574d640 1 --2- 172.21.15.7:0/4190731360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2fc0043a0 0x7fc2fc004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:53.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.387+0000 7fc31574d640 1 -- 172.21.15.7:0/4190731360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2fc003520 con 0x7fc2fc004ef0 2024-04-25T10:02:53.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.387+0000 7fc30ffff640 1 --2- 172.21.15.7:0/4190731360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2fc0043a0 0x7fc2fc004880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:02:53.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.387+0000 7fc314f4c640 1 --2- 172.21.15.7:0/4190731360 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2fc0039b0 0x7fc2fc003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:02:53.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.387+0000 7fc31574d640 1 --2- 172.21.15.7:0/4190731360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2fc004ef0 0x7fc2fc00b9c0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8009b00 tx=0x7fc2fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7458ff6d2ca6fb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:53.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.387+0000 7fc30f7fe640 1 -- 172.21.15.7:0/4190731360 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8036070 con 0x7fc2fc004ef0 2024-04-25T10:02:53.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.387+0000 7fc30f7fe640 1 -- 172.21.15.7:0/4190731360 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f8004030 con 0x7fc2fc004ef0 2024-04-25T10:02:53.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.387+0000 7fc30f7fe640 1 -- 172.21.15.7:0/4190731360 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f80097d0 con 0x7fc2fc004ef0 2024-04-25T10:02:53.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.388+0000 7fc3171b0640 1 -- 172.21.15.7:0/4190731360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2fc004ef0 msgr2=0x7fc2fc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:53.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.388+0000 7fc3171b0640 1 --2- 172.21.15.7:0/4190731360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2fc004ef0 0x7fc2fc00b9c0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8009b00 tx=0x7fc2fc005830 comp rx=0 tx=0).stop 2024-04-25T10:02:53.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.388+0000 7fc31574d640 1 -- 172.21.15.7:0/4190731360 reap_dead start 2024-04-25T10:02:53.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.388+0000 7fc3171b0640 1 -- 172.21.15.7:0/4190731360 shutdown_connections 2024-04-25T10:02:53.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.388+0000 7fc3171b0640 1 -- 172.21.15.7:0/4190731360 >> 172.21.15.7:0/4190731360 conn(0x7fc3100b5c30 msgr2=0x7fc3100999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:53.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.388+0000 7fc3171b0640 1 -- 172.21.15.7:0/4190731360 shutdown_connections 2024-04-25T10:02:53.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.388+0000 7fc3171b0640 1 -- 172.21.15.7:0/4190731360 wait complete. 2024-04-25T10:02:53.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.389+0000 7fc3171b0640 1 Processor -- start 2024-04-25T10:02:53.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.389+0000 7fc3171b0640 1 -- start start 2024-04-25T10:02:53.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.390+0000 7fc3171b0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2fc004ef0 0x7fc31015ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:53.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.390+0000 7fc3171b0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc31009aef0 0x7fc310135ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:53.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.390+0000 7fc3171b0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc31009b350 0x7fc310135ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:53.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.390+0000 7fc3171b0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31015d240 con 0x7fc31009b350 2024-04-25T10:02:53.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.390+0000 7fc3171b0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31015fda0 con 0x7fc31009aef0 2024-04-25T10:02:53.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.390+0000 7fc3171b0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31015d3c0 con 0x7fc2fc004ef0 2024-04-25T10:02:53.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.390+0000 7fc31574d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc31009b350 0x7fc310135ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:53.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.390+0000 7fc31574d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc31009b350 0x7fc310135ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44184/0 (socket says 172.21.15.7:44184) 2024-04-25T10:02:53.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.390+0000 7fc31574d640 1 -- 172.21.15.7:0/893234296 learned_addr learned my addr 172.21.15.7:0/893234296 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:53.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.390+0000 7fc314f4c640 1 --2- 172.21.15.7:0/893234296 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2fc004ef0 0x7fc31015ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:53.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.390+0000 7fc30ffff640 1 --2- 172.21.15.7:0/893234296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc31009aef0 0x7fc310135ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:53.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.391+0000 7fc31574d640 1 -- 172.21.15.7:0/893234296 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2fc004ef0 msgr2=0x7fc31015ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:53.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.391+0000 7fc31574d640 1 --2- 172.21.15.7:0/893234296 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2fc004ef0 0x7fc31015ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:53.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.391+0000 7fc31574d640 1 -- 172.21.15.7:0/893234296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc31009aef0 msgr2=0x7fc310135ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:53.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.391+0000 7fc31574d640 1 --2- 172.21.15.7:0/893234296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc31009aef0 0x7fc310135ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:53.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.391+0000 7fc31574d640 1 -- 172.21.15.7:0/893234296 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31009d830 con 0x7fc31009b350 2024-04-25T10:02:53.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.391+0000 7fc30ffff640 1 --2- 172.21.15.7:0/893234296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc31009aef0 0x7fc310135ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:02:53.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.391+0000 7fc31574d640 1 --2- 172.21.15.7:0/893234296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc31009b350 0x7fc310135ff0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8009c20 tx=0x7fc2f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:53.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.391+0000 7fc30d7fa640 1 -- 172.21.15.7:0/893234296 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8036040 con 0x7fc31009b350 2024-04-25T10:02:53.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.391+0000 7fc30d7fa640 1 -- 172.21.15.7:0/893234296 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f8041070 con 0x7fc31009b350 2024-04-25T10:02:53.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.391+0000 7fc3171b0640 1 -- 172.21.15.7:0/893234296 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc31009db10 con 0x7fc31009b350 2024-04-25T10:02:53.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.391+0000 7fc30d7fa640 1 -- 172.21.15.7:0/893234296 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8003a30 con 0x7fc31009b350 2024-04-25T10:02:53.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.391+0000 7fc3171b0640 1 -- 172.21.15.7:0/893234296 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc31009e0d0 con 0x7fc31009b350 2024-04-25T10:02:53.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.392+0000 7fc3171b0640 1 -- 172.21.15.7:0/893234296 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc310068fd0 con 0x7fc31009b350 2024-04-25T10:02:53.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.392+0000 7fc30d7fa640 1 -- 172.21.15.7:0/893234296 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc2f8003bd0 con 0x7fc31009b350 2024-04-25T10:02:53.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.393+0000 7fc30d7fa640 1 --2- 172.21.15.7:0/893234296 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc2f006b4d0 0x7fc2f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:53.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.393+0000 7fc30d7fa640 1 -- 172.21.15.7:0/893234296 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc2f80a9f30 con 0x7fc31009b350 2024-04-25T10:02:53.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.393+0000 7fc314f4c640 1 --2- 172.21.15.7:0/893234296 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc2f006b4d0 0x7fc2f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:53.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.393+0000 7fc314f4c640 1 --2- 172.21.15.7:0/893234296 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc2f006b4d0 0x7fc2f006d990 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc308006f80 tx=0x7fc308008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:53.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.397+0000 7fc30d7fa640 1 -- 172.21.15.7:0/893234296 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc2f80785d0 con 0x7fc31009b350 2024-04-25T10:02:53.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.572+0000 7fc3171b0640 1 -- 172.21.15.7:0/893234296 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc310070a20 con 0x7fc2f006b4d0 2024-04-25T10:02:53.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.579+0000 7fc30d7fa640 1 -- 172.21.15.7:0/893234296 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249440 (secure 0 0 0) 0x7fc310070a20 con 0x7fc2f006b4d0 2024-04-25T10:02:53.586 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:02:53.588 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T10:02:53.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.581+0000 7fc3171b0640 1 -- 172.21.15.7:0/893234296 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc2f006b4d0 msgr2=0x7fc2f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:53.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.581+0000 7fc3171b0640 1 --2- 172.21.15.7:0/893234296 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc2f006b4d0 0x7fc2f006d990 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc308006f80 tx=0x7fc308008040 comp rx=0 tx=0).stop 2024-04-25T10:02:53.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.581+0000 7fc3171b0640 1 -- 172.21.15.7:0/893234296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc31009b350 msgr2=0x7fc310135ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:53.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.581+0000 7fc3171b0640 1 --2- 172.21.15.7:0/893234296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc31009b350 0x7fc310135ff0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8009c20 tx=0x7fc2f8004730 comp rx=0 tx=0).stop 2024-04-25T10:02:53.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.582+0000 7fc3171b0640 1 -- 172.21.15.7:0/893234296 shutdown_connections 2024-04-25T10:02:53.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.582+0000 7fc3171b0640 1 --2- 172.21.15.7:0/893234296 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc2f006b4d0 0x7fc2f006d990 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:53.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.582+0000 7fc3171b0640 1 --2- 172.21.15.7:0/893234296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc31009b350 0x7fc310135ff0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:53.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.582+0000 7fc3171b0640 1 --2- 172.21.15.7:0/893234296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc31009aef0 0x7fc310135ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:53.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.582+0000 7fc3171b0640 1 --2- 172.21.15.7:0/893234296 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2fc004ef0 0x7fc31015ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:53.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.582+0000 7fc3171b0640 1 -- 172.21.15.7:0/893234296 >> 172.21.15.7:0/893234296 conn(0x7fc3100b5c30 msgr2=0x7fc3100999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:53.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.582+0000 7fc3171b0640 1 -- 172.21.15.7:0/893234296 shutdown_connections 2024-04-25T10:02:53.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.582+0000 7fc3171b0640 1 -- 172.21.15.7:0/893234296 wait complete. 2024-04-25T10:02:53.597 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":355,"stamp":"2024-04-25T10:02:51.970875+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592162,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":186,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":75,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260416,"kb_used_data":10928,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714304,"statfs":{"total":773094113280,"available":772827447296,"internally_reserved":0,"allocated":11190272,"data_stored":5793816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1794,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000939"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585616+0000","last_change":"2024-04-25T10:02:49.585616+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585616+0000","last_undegraded":"2024-04-25T10:02:49.585616+0000","last_fullsized":"2024-04-25T10:02:49.585616+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.608577+0000","last_change":"2024-04-25T10:02:50.603031+0000","last_active":"2024-04-25T10:02:50.608577+0000","last_peered":"2024-04-25T10:02:50.608577+0000","last_clean":"2024-04-25T10:02:50.608577+0000","last_became_active":"2024-04-25T10:02:50.602748+0000","last_became_peered":"2024-04-25T10:02:50.602748+0000","last_unstale":"2024-04-25T10:02:50.608577+0000","last_undegraded":"2024-04-25T10:02:50.608577+0000","last_fullsized":"2024-04-25T10:02:50.608577+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:16.100766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585815+0000","last_change":"2024-04-25T10:02:49.585815+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585815+0000","last_undegraded":"2024-04-25T10:02:49.585815+0000","last_fullsized":"2024-04-25T10:02:49.585815+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.584483+0000","last_change":"2024-04-25T10:02:49.584483+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.584483+0000","last_undegraded":"2024-04-25T10:02:49.584483+0000","last_fullsized":"2024-04-25T10:02:49.584483+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.587454+0000","last_change":"2024-04-25T10:02:49.587454+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.587454+0000","last_undegraded":"2024-04-25T10:02:49.587454+0000","last_fullsized":"2024-04-25T10:02:49.587454+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.608539+0000","last_change":"2024-04-25T10:02:50.600787+0000","last_active":"2024-04-25T10:02:50.608539+0000","last_peered":"2024-04-25T10:02:50.608539+0000","last_clean":"2024-04-25T10:02:50.608539+0000","last_became_active":"2024-04-25T10:02:50.599972+0000","last_became_peered":"2024-04-25T10:02:50.599972+0000","last_unstale":"2024-04-25T10:02:50.608539+0000","last_undegraded":"2024-04-25T10:02:50.608539+0000","last_fullsized":"2024-04-25T10:02:50.608539+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:34:25.529946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.603998+0000","last_change":"2024-04-25T10:02:50.598983+0000","last_active":"2024-04-25T10:02:50.603998+0000","last_peered":"2024-04-25T10:02:50.603998+0000","last_clean":"2024-04-25T10:02:50.603998+0000","last_became_active":"2024-04-25T10:02:50.598041+0000","last_became_peered":"2024-04-25T10:02:50.598041+0000","last_unstale":"2024-04-25T10:02:50.603998+0000","last_undegraded":"2024-04-25T10:02:50.603998+0000","last_fullsized":"2024-04-25T10:02:50.603998+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:26.544669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.595587+0000","last_change":"2024-04-25T10:02:49.595587+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.595587+0000","last_undegraded":"2024-04-25T10:02:49.595587+0000","last_fullsized":"2024-04-25T10:02:49.595587+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.608465+0000","last_change":"2024-04-25T10:02:50.600374+0000","last_active":"2024-04-25T10:02:50.608465+0000","last_peered":"2024-04-25T10:02:50.608465+0000","last_clean":"2024-04-25T10:02:50.608465+0000","last_became_active":"2024-04-25T10:02:50.600063+0000","last_became_peered":"2024-04-25T10:02:50.600063+0000","last_unstale":"2024-04-25T10:02:50.608465+0000","last_undegraded":"2024-04-25T10:02:50.608465+0000","last_fullsized":"2024-04-25T10:02:50.608465+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:13.384824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.587520+0000","last_change":"2024-04-25T10:02:49.587520+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.587520+0000","last_undegraded":"2024-04-25T10:02:49.587520+0000","last_fullsized":"2024-04-25T10:02:49.587520+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.603520+0000","last_change":"2024-04-25T10:02:50.597667+0000","last_active":"2024-04-25T10:02:50.603520+0000","last_peered":"2024-04-25T10:02:50.603520+0000","last_clean":"2024-04-25T10:02:50.603520+0000","last_became_active":"2024-04-25T10:02:50.597380+0000","last_became_peered":"2024-04-25T10:02:50.597380+0000","last_unstale":"2024-04-25T10:02:50.603520+0000","last_undegraded":"2024-04-25T10:02:50.603520+0000","last_fullsized":"2024-04-25T10:02:50.603520+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:00.445645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.598512+0000","last_change":"2024-04-25T10:02:50.597126+0000","last_active":"2024-04-25T10:02:50.598512+0000","last_peered":"2024-04-25T10:02:50.598512+0000","last_clean":"2024-04-25T10:02:50.598512+0000","last_became_active":"2024-04-25T10:02:50.596838+0000","last_became_peered":"2024-04-25T10:02:50.596838+0000","last_unstale":"2024-04-25T10:02:50.598512+0000","last_undegraded":"2024-04-25T10:02:50.598512+0000","last_fullsized":"2024-04-25T10:02:50.598512+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:25.592490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.584137+0000","last_change":"2024-04-25T10:02:49.584137+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.584137+0000","last_undegraded":"2024-04-25T10:02:49.584137+0000","last_fullsized":"2024-04-25T10:02:49.584137+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.600410+0000","last_change":"2024-04-25T10:02:50.594589+0000","last_active":"2024-04-25T10:02:50.600410+0000","last_peered":"2024-04-25T10:02:50.600410+0000","last_clean":"2024-04-25T10:02:50.600410+0000","last_became_active":"2024-04-25T10:02:50.594292+0000","last_became_peered":"2024-04-25T10:02:50.594292+0000","last_unstale":"2024-04-25T10:02:50.600410+0000","last_undegraded":"2024-04-25T10:02:50.600410+0000","last_fullsized":"2024-04-25T10:02:50.600410+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:27.456813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.603854+0000","last_change":"2024-04-25T10:02:50.602757+0000","last_active":"2024-04-25T10:02:50.603854+0000","last_peered":"2024-04-25T10:02:50.603854+0000","last_clean":"2024-04-25T10:02:50.603854+0000","last_became_active":"2024-04-25T10:02:50.602479+0000","last_became_peered":"2024-04-25T10:02:50.602479+0000","last_unstale":"2024-04-25T10:02:50.603854+0000","last_undegraded":"2024-04-25T10:02:50.603854+0000","last_fullsized":"2024-04-25T10:02:50.603854+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:52.545352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613866+0000","last_change":"2024-04-25T10:02:50.611124+0000","last_active":"2024-04-25T10:02:50.613866+0000","last_peered":"2024-04-25T10:02:50.613866+0000","last_clean":"2024-04-25T10:02:50.613866+0000","last_became_active":"2024-04-25T10:02:50.610797+0000","last_became_peered":"2024-04-25T10:02:50.610797+0000","last_unstale":"2024-04-25T10:02:50.613866+0000","last_undegraded":"2024-04-25T10:02:50.613866+0000","last_fullsized":"2024-04-25T10:02:50.613866+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:04.437758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585202+0000","last_change":"2024-04-25T10:02:49.585202+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585202+0000","last_undegraded":"2024-04-25T10:02:49.585202+0000","last_fullsized":"2024-04-25T10:02:49.585202+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.604313+0000","last_change":"2024-04-25T10:02:50.599375+0000","last_active":"2024-04-25T10:02:50.604313+0000","last_peered":"2024-04-25T10:02:50.604313+0000","last_clean":"2024-04-25T10:02:50.604313+0000","last_became_active":"2024-04-25T10:02:50.599069+0000","last_became_peered":"2024-04-25T10:02:50.599069+0000","last_unstale":"2024-04-25T10:02:50.604313+0000","last_undegraded":"2024-04-25T10:02:50.604313+0000","last_fullsized":"2024-04-25T10:02:50.604313+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:08:30.199923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585426+0000","last_change":"2024-04-25T10:02:49.585426+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585426+0000","last_undegraded":"2024-04-25T10:02:49.585426+0000","last_fullsized":"2024-04-25T10:02:49.585426+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.595723+0000","last_change":"2024-04-25T10:02:50.592377+0000","last_active":"2024-04-25T10:02:50.595723+0000","last_peered":"2024-04-25T10:02:50.595723+0000","last_clean":"2024-04-25T10:02:50.595723+0000","last_became_active":"2024-04-25T10:02:50.592080+0000","last_became_peered":"2024-04-25T10:02:50.592080+0000","last_unstale":"2024-04-25T10:02:50.595723+0000","last_undegraded":"2024-04-25T10:02:50.595723+0000","last_fullsized":"2024-04-25T10:02:50.595723+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:07.989371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.594791+0000","last_change":"2024-04-25T10:02:49.594791+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.594791+0000","last_undegraded":"2024-04-25T10:02:49.594791+0000","last_fullsized":"2024-04-25T10:02:49.594791+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.586101+0000","last_change":"2024-04-25T10:02:49.586101+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.586101+0000","last_undegraded":"2024-04-25T10:02:49.586101+0000","last_fullsized":"2024-04-25T10:02:49.586101+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.584332+0000","last_change":"2024-04-25T10:02:49.584332+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.584332+0000","last_undegraded":"2024-04-25T10:02:49.584332+0000","last_fullsized":"2024-04-25T10:02:49.584332+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585088+0000","last_change":"2024-04-25T10:02:49.585088+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585088+0000","last_undegraded":"2024-04-25T10:02:49.585088+0000","last_fullsized":"2024-04-25T10:02:49.585088+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.595760+0000","last_change":"2024-04-25T10:02:50.593306+0000","last_active":"2024-04-25T10:02:50.595760+0000","last_peered":"2024-04-25T10:02:50.595760+0000","last_clean":"2024-04-25T10:02:50.595760+0000","last_became_active":"2024-04-25T10:02:50.593032+0000","last_became_peered":"2024-04-25T10:02:50.593032+0000","last_unstale":"2024-04-25T10:02:50.595760+0000","last_undegraded":"2024-04-25T10:02:50.595760+0000","last_fullsized":"2024-04-25T10:02:50.595760+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:08.637593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.603488+0000","last_change":"2024-04-25T10:02:50.600711+0000","last_active":"2024-04-25T10:02:50.603488+0000","last_peered":"2024-04-25T10:02:50.603488+0000","last_clean":"2024-04-25T10:02:50.603488+0000","last_became_active":"2024-04-25T10:02:50.600415+0000","last_became_peered":"2024-04-25T10:02:50.600415+0000","last_unstale":"2024-04-25T10:02:50.603488+0000","last_undegraded":"2024-04-25T10:02:50.603488+0000","last_fullsized":"2024-04-25T10:02:50.603488+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:47.347288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.600930+0000","last_change":"2024-04-25T10:02:50.592967+0000","last_active":"2024-04-25T10:02:50.600930+0000","last_peered":"2024-04-25T10:02:50.600930+0000","last_clean":"2024-04-25T10:02:50.600930+0000","last_became_active":"2024-04-25T10:02:50.592601+0000","last_became_peered":"2024-04-25T10:02:50.592601+0000","last_unstale":"2024-04-25T10:02:50.600930+0000","last_undegraded":"2024-04-25T10:02:50.600930+0000","last_fullsized":"2024-04-25T10:02:50.600930+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:42.927791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613090+0000","last_change":"2024-04-25T10:02:50.604355+0000","last_active":"2024-04-25T10:02:50.613090+0000","last_peered":"2024-04-25T10:02:50.613090+0000","last_clean":"2024-04-25T10:02:50.613090+0000","last_became_active":"2024-04-25T10:02:50.603745+0000","last_became_peered":"2024-04-25T10:02:50.603745+0000","last_unstale":"2024-04-25T10:02:50.613090+0000","last_undegraded":"2024-04-25T10:02:50.613090+0000","last_fullsized":"2024-04-25T10:02:50.613090+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:48.165008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.594396+0000","last_change":"2024-04-25T10:02:49.594396+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.594396+0000","last_undegraded":"2024-04-25T10:02:49.594396+0000","last_fullsized":"2024-04-25T10:02:49.594396+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.595701+0000","last_change":"2024-04-25T10:02:50.590740+0000","last_active":"2024-04-25T10:02:50.595701+0000","last_peered":"2024-04-25T10:02:50.595701+0000","last_clean":"2024-04-25T10:02:50.595701+0000","last_became_active":"2024-04-25T10:02:50.590423+0000","last_became_peered":"2024-04-25T10:02:50.590423+0000","last_unstale":"2024-04-25T10:02:50.595701+0000","last_undegraded":"2024-04-25T10:02:50.595701+0000","last_fullsized":"2024-04-25T10:02:50.595701+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:48.165008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613110+0000","last_change":"2024-04-25T10:02:50.605847+0000","last_active":"2024-04-25T10:02:50.613110+0000","last_peered":"2024-04-25T10:02:50.613110+0000","last_clean":"2024-04-25T10:02:50.613110+0000","last_became_active":"2024-04-25T10:02:50.605541+0000","last_became_peered":"2024-04-25T10:02:50.605541+0000","last_unstale":"2024-04-25T10:02:50.613110+0000","last_undegraded":"2024-04-25T10:02:50.613110+0000","last_fullsized":"2024-04-25T10:02:50.613110+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:08.637593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.593250+0000","last_change":"2024-04-25T10:02:49.593250+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.593250+0000","last_undegraded":"2024-04-25T10:02:49.593250+0000","last_fullsized":"2024-04-25T10:02:49.593250+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585100+0000","last_change":"2024-04-25T10:02:49.585100+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585100+0000","last_undegraded":"2024-04-25T10:02:49.585100+0000","last_fullsized":"2024-04-25T10:02:49.585100+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.601832+0000","last_change":"2024-04-25T10:02:49.599379+0000","last_active":"2024-04-25T10:02:49.601832+0000","last_peered":"2024-04-25T10:02:49.601832+0000","last_clean":"2024-04-25T10:02:49.601832+0000","last_became_active":"2024-04-25T10:02:49.599070+0000","last_became_peered":"2024-04-25T10:02:49.599070+0000","last_unstale":"2024-04-25T10:02:49.601832+0000","last_undegraded":"2024-04-25T10:02:49.601832+0000","last_fullsized":"2024-04-25T10:02:49.601832+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:32.905433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.592135+0000","last_change":"2024-04-25T10:02:49.592135+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.592135+0000","last_undegraded":"2024-04-25T10:02:49.592135+0000","last_fullsized":"2024-04-25T10:02:49.592135+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.598801+0000","last_change":"2024-04-25T10:02:49.597685+0000","last_active":"2024-04-25T10:02:49.598801+0000","last_peered":"2024-04-25T10:02:49.598801+0000","last_clean":"2024-04-25T10:02:49.598801+0000","last_became_active":"2024-04-25T10:02:49.597436+0000","last_became_peered":"2024-04-25T10:02:49.597436+0000","last_unstale":"2024-04-25T10:02:49.598801+0000","last_undegraded":"2024-04-25T10:02:49.598801+0000","last_fullsized":"2024-04-25T10:02:49.598801+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:15.857498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.608237+0000","last_change":"2024-04-25T10:02:50.601730+0000","last_active":"2024-04-25T10:02:50.608237+0000","last_peered":"2024-04-25T10:02:50.608237+0000","last_clean":"2024-04-25T10:02:50.608237+0000","last_became_active":"2024-04-25T10:02:50.601433+0000","last_became_peered":"2024-04-25T10:02:50.601433+0000","last_unstale":"2024-04-25T10:02:50.608237+0000","last_undegraded":"2024-04-25T10:02:50.608237+0000","last_fullsized":"2024-04-25T10:02:50.608237+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:59.212329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"102'2","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613763+0000","last_change":"2024-04-25T10:02:49.602625+0000","last_active":"2024-04-25T10:02:50.613763+0000","last_peered":"2024-04-25T10:02:50.613763+0000","last_clean":"2024-04-25T10:02:50.613763+0000","last_became_active":"2024-04-25T10:02:49.602213+0000","last_became_peered":"2024-04-25T10:02:49.602213+0000","last_unstale":"2024-04-25T10:02:50.613763+0000","last_undegraded":"2024-04-25T10:02:50.613763+0000","last_fullsized":"2024-04-25T10:02:50.613763+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:16.695057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.603943+0000","last_change":"2024-04-25T10:02:50.597990+0000","last_active":"2024-04-25T10:02:50.603943+0000","last_peered":"2024-04-25T10:02:50.603943+0000","last_clean":"2024-04-25T10:02:50.603943+0000","last_became_active":"2024-04-25T10:02:50.597292+0000","last_became_peered":"2024-04-25T10:02:50.597292+0000","last_unstale":"2024-04-25T10:02:50.603943+0000","last_undegraded":"2024-04-25T10:02:50.603943+0000","last_fullsized":"2024-04-25T10:02:50.603943+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:50.079193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.603349+0000","last_change":"2024-04-25T10:02:49.601540+0000","last_active":"2024-04-25T10:02:49.603349+0000","last_peered":"2024-04-25T10:02:49.603349+0000","last_clean":"2024-04-25T10:02:49.603349+0000","last_became_active":"2024-04-25T10:02:49.601236+0000","last_became_peered":"2024-04-25T10:02:49.601236+0000","last_unstale":"2024-04-25T10:02:49.603349+0000","last_undegraded":"2024-04-25T10:02:49.603349+0000","last_fullsized":"2024-04-25T10:02:49.603349+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:02.585092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.583753+0000","last_change":"2024-04-25T10:02:49.583753+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.583753+0000","last_undegraded":"2024-04-25T10:02:49.583753+0000","last_fullsized":"2024-04-25T10:02:49.583753+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"102'1","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613424+0000","last_change":"2024-04-25T10:02:49.600687+0000","last_active":"2024-04-25T10:02:50.613424+0000","last_peered":"2024-04-25T10:02:50.613424+0000","last_clean":"2024-04-25T10:02:50.613424+0000","last_became_active":"2024-04-25T10:02:49.600405+0000","last_became_peered":"2024-04-25T10:02:49.600405+0000","last_unstale":"2024-04-25T10:02:50.613424+0000","last_undegraded":"2024-04-25T10:02:50.613424+0000","last_fullsized":"2024-04-25T10:02:50.613424+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:54:46.938087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.584373+0000","last_change":"2024-04-25T10:02:49.584373+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.584373+0000","last_undegraded":"2024-04-25T10:02:49.584373+0000","last_fullsized":"2024-04-25T10:02:49.584373+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"102'1","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613725+0000","last_change":"2024-04-25T10:02:49.599888+0000","last_active":"2024-04-25T10:02:50.613725+0000","last_peered":"2024-04-25T10:02:50.613725+0000","last_clean":"2024-04-25T10:02:50.613725+0000","last_became_active":"2024-04-25T10:02:49.599607+0000","last_became_peered":"2024-04-25T10:02:49.599607+0000","last_unstale":"2024-04-25T10:02:50.613725+0000","last_undegraded":"2024-04-25T10:02:50.613725+0000","last_fullsized":"2024-04-25T10:02:50.613725+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:46.336023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.608555+0000","last_change":"2024-04-25T10:02:50.602985+0000","last_active":"2024-04-25T10:02:50.608555+0000","last_peered":"2024-04-25T10:02:50.608555+0000","last_clean":"2024-04-25T10:02:50.608555+0000","last_became_active":"2024-04-25T10:02:50.602713+0000","last_became_peered":"2024-04-25T10:02:50.602713+0000","last_unstale":"2024-04-25T10:02:50.608555+0000","last_undegraded":"2024-04-25T10:02:50.608555+0000","last_fullsized":"2024-04-25T10:02:50.608555+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:49:13.711038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.585083+0000","last_change":"2024-04-25T10:02:49.598952+0000","last_active":"2024-04-25T10:02:50.585083+0000","last_peered":"2024-04-25T10:02:50.585083+0000","last_clean":"2024-04-25T10:02:50.585083+0000","last_became_active":"2024-04-25T10:02:49.598639+0000","last_became_peered":"2024-04-25T10:02:49.598639+0000","last_unstale":"2024-04-25T10:02:50.585083+0000","last_undegraded":"2024-04-25T10:02:50.585083+0000","last_fullsized":"2024-04-25T10:02:50.585083+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:49:12.699773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.583769+0000","last_change":"2024-04-25T10:02:49.583769+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.583769+0000","last_undegraded":"2024-04-25T10:02:49.583769+0000","last_fullsized":"2024-04-25T10:02:49.583769+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.590806+0000","last_change":"2024-04-25T10:02:49.589456+0000","last_active":"2024-04-25T10:02:49.590806+0000","last_peered":"2024-04-25T10:02:49.590806+0000","last_clean":"2024-04-25T10:02:49.590806+0000","last_became_active":"2024-04-25T10:02:49.589179+0000","last_became_peered":"2024-04-25T10:02:49.589179+0000","last_unstale":"2024-04-25T10:02:49.590806+0000","last_undegraded":"2024-04-25T10:02:49.590806+0000","last_fullsized":"2024-04-25T10:02:49.590806+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:54.456889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585585+0000","last_change":"2024-04-25T10:02:49.585585+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585585+0000","last_undegraded":"2024-04-25T10:02:49.585585+0000","last_fullsized":"2024-04-25T10:02:49.585585+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.585540+0000","last_change":"2024-04-25T10:02:49.599488+0000","last_active":"2024-04-25T10:02:50.585540+0000","last_peered":"2024-04-25T10:02:50.585540+0000","last_clean":"2024-04-25T10:02:50.585540+0000","last_became_active":"2024-04-25T10:02:49.599195+0000","last_became_peered":"2024-04-25T10:02:49.599195+0000","last_unstale":"2024-04-25T10:02:50.585540+0000","last_undegraded":"2024-04-25T10:02:50.585540+0000","last_fullsized":"2024-04-25T10:02:50.585540+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:15.089501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.587749+0000","last_change":"2024-04-25T10:02:49.587749+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.587749+0000","last_undegraded":"2024-04-25T10:02:49.587749+0000","last_fullsized":"2024-04-25T10:02:49.587749+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.600981+0000","last_change":"2024-04-25T10:02:49.600228+0000","last_active":"2024-04-25T10:02:49.600981+0000","last_peered":"2024-04-25T10:02:49.600981+0000","last_clean":"2024-04-25T10:02:49.600981+0000","last_became_active":"2024-04-25T10:02:49.599938+0000","last_became_peered":"2024-04-25T10:02:49.599938+0000","last_unstale":"2024-04-25T10:02:49.600981+0000","last_undegraded":"2024-04-25T10:02:49.600981+0000","last_fullsized":"2024-04-25T10:02:49.600981+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:36.517034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.593715+0000","last_change":"2024-04-25T10:02:49.593715+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.593715+0000","last_undegraded":"2024-04-25T10:02:49.593715+0000","last_fullsized":"2024-04-25T10:02:49.593715+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"102'3","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.615029+0000","last_change":"2024-04-25T10:02:49.595272+0000","last_active":"2024-04-25T10:02:50.615029+0000","last_peered":"2024-04-25T10:02:50.615029+0000","last_clean":"2024-04-25T10:02:50.615029+0000","last_became_active":"2024-04-25T10:02:49.594964+0000","last_became_peered":"2024-04-25T10:02:49.594964+0000","last_unstale":"2024-04-25T10:02:50.615029+0000","last_undegraded":"2024-04-25T10:02:50.615029+0000","last_fullsized":"2024-04-25T10:02:50.615029+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:04:50.351393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.586617+0000","last_change":"2024-04-25T10:02:49.586617+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.586617+0000","last_undegraded":"2024-04-25T10:02:49.586617+0000","last_fullsized":"2024-04-25T10:02:49.586617+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"102'6","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.622147+0000","last_change":"2024-04-25T10:02:49.596547+0000","last_active":"2024-04-25T10:02:50.622147+0000","last_peered":"2024-04-25T10:02:50.622147+0000","last_clean":"2024-04-25T10:02:50.622147+0000","last_became_active":"2024-04-25T10:02:49.596273+0000","last_became_peered":"2024-04-25T10:02:49.596273+0000","last_unstale":"2024-04-25T10:02:50.622147+0000","last_undegraded":"2024-04-25T10:02:50.622147+0000","last_fullsized":"2024-04-25T10:02:50.622147+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:28.059919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.617363+0000","last_change":"2024-04-25T10:02:50.609769+0000","last_active":"2024-04-25T10:02:50.617363+0000","last_peered":"2024-04-25T10:02:50.617363+0000","last_clean":"2024-04-25T10:02:50.617363+0000","last_became_active":"2024-04-25T10:02:50.609239+0000","last_became_peered":"2024-04-25T10:02:50.609239+0000","last_unstale":"2024-04-25T10:02:50.617363+0000","last_undegraded":"2024-04-25T10:02:50.617363+0000","last_fullsized":"2024-04-25T10:02:50.617363+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:55.468154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.599594+0000","last_change":"2024-04-25T10:02:49.598214+0000","last_active":"2024-04-25T10:02:49.599594+0000","last_peered":"2024-04-25T10:02:49.599594+0000","last_clean":"2024-04-25T10:02:49.599594+0000","last_became_active":"2024-04-25T10:02:49.597943+0000","last_became_peered":"2024-04-25T10:02:49.597943+0000","last_unstale":"2024-04-25T10:02:49.599594+0000","last_undegraded":"2024-04-25T10:02:49.599594+0000","last_fullsized":"2024-04-25T10:02:49.599594+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:05:23.495102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.608468+0000","last_change":"2024-04-25T10:02:50.600485+0000","last_active":"2024-04-25T10:02:50.608468+0000","last_peered":"2024-04-25T10:02:50.608468+0000","last_clean":"2024-04-25T10:02:50.608468+0000","last_became_active":"2024-04-25T10:02:50.600156+0000","last_became_peered":"2024-04-25T10:02:50.600156+0000","last_unstale":"2024-04-25T10:02:50.608468+0000","last_undegraded":"2024-04-25T10:02:50.608468+0000","last_fullsized":"2024-04-25T10:02:50.608468+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:17.706322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.595028+0000","last_change":"2024-04-25T10:02:49.594284+0000","last_active":"2024-04-25T10:02:49.595028+0000","last_peered":"2024-04-25T10:02:49.595028+0000","last_clean":"2024-04-25T10:02:49.595028+0000","last_became_active":"2024-04-25T10:02:49.593996+0000","last_became_peered":"2024-04-25T10:02:49.593996+0000","last_unstale":"2024-04-25T10:02:49.595028+0000","last_undegraded":"2024-04-25T10:02:49.595028+0000","last_fullsized":"2024-04-25T10:02:49.595028+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:16.312918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.594191+0000","last_change":"2024-04-25T10:02:49.594191+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.594191+0000","last_undegraded":"2024-04-25T10:02:49.594191+0000","last_fullsized":"2024-04-25T10:02:49.594191+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.604212+0000","last_change":"2024-04-25T10:02:49.603609+0000","last_active":"2024-04-25T10:02:49.604212+0000","last_peered":"2024-04-25T10:02:49.604212+0000","last_clean":"2024-04-25T10:02:49.604212+0000","last_became_active":"2024-04-25T10:02:49.603297+0000","last_became_peered":"2024-04-25T10:02:49.603297+0000","last_unstale":"2024-04-25T10:02:49.604212+0000","last_undegraded":"2024-04-25T10:02:49.604212+0000","last_fullsized":"2024-04-25T10:02:49.604212+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:44.744796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.584331+0000","last_change":"2024-04-25T10:02:49.584331+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.584331+0000","last_undegraded":"2024-04-25T10:02:49.584331+0000","last_fullsized":"2024-04-25T10:02:49.584331+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"102'8","reported_seq":20,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.618329+0000","last_change":"2024-04-25T10:02:49.598951+0000","last_active":"2024-04-25T10:02:50.618329+0000","last_peered":"2024-04-25T10:02:50.618329+0000","last_clean":"2024-04-25T10:02:50.618329+0000","last_became_active":"2024-04-25T10:02:49.598508+0000","last_became_peered":"2024-04-25T10:02:49.598508+0000","last_unstale":"2024-04-25T10:02:50.618329+0000","last_undegraded":"2024-04-25T10:02:50.618329+0000","last_fullsized":"2024-04-25T10:02:50.618329+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:34:24.518681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.592454+0000","last_change":"2024-04-25T10:02:49.592454+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.592454+0000","last_undegraded":"2024-04-25T10:02:49.592454+0000","last_fullsized":"2024-04-25T10:02:49.592454+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"102'1","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.617905+0000","last_change":"2024-04-25T10:02:49.605550+0000","last_active":"2024-04-25T10:02:50.617905+0000","last_peered":"2024-04-25T10:02:50.617905+0000","last_clean":"2024-04-25T10:02:50.617905+0000","last_became_active":"2024-04-25T10:02:49.605242+0000","last_became_peered":"2024-04-25T10:02:49.605242+0000","last_unstale":"2024-04-25T10:02:50.617905+0000","last_undegraded":"2024-04-25T10:02:50.617905+0000","last_fullsized":"2024-04-25T10:02:50.617905+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:41.634104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613130+0000","last_change":"2024-04-25T10:02:50.605531+0000","last_active":"2024-04-25T10:02:50.613130+0000","last_peered":"2024-04-25T10:02:50.613130+0000","last_clean":"2024-04-25T10:02:50.613130+0000","last_became_active":"2024-04-25T10:02:50.605229+0000","last_became_peered":"2024-04-25T10:02:50.605229+0000","last_unstale":"2024-04-25T10:02:50.613130+0000","last_undegraded":"2024-04-25T10:02:50.613130+0000","last_fullsized":"2024-04-25T10:02:50.613130+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:07.989371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"102'1","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613455+0000","last_change":"2024-04-25T10:02:49.599107+0000","last_active":"2024-04-25T10:02:50.613455+0000","last_peered":"2024-04-25T10:02:50.613455+0000","last_clean":"2024-04-25T10:02:50.613455+0000","last_became_active":"2024-04-25T10:02:49.598627+0000","last_became_peered":"2024-04-25T10:02:49.598627+0000","last_unstale":"2024-04-25T10:02:50.613455+0000","last_undegraded":"2024-04-25T10:02:50.613455+0000","last_fullsized":"2024-04-25T10:02:50.613455+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:58.452441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.587028+0000","last_change":"2024-04-25T10:02:49.587028+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.587028+0000","last_undegraded":"2024-04-25T10:02:49.587028+0000","last_fullsized":"2024-04-25T10:02:49.587028+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.590432+0000","last_change":"2024-04-25T10:02:49.600728+0000","last_active":"2024-04-25T10:02:50.590432+0000","last_peered":"2024-04-25T10:02:50.590432+0000","last_clean":"2024-04-25T10:02:50.590432+0000","last_became_active":"2024-04-25T10:02:49.600439+0000","last_became_peered":"2024-04-25T10:02:49.600439+0000","last_unstale":"2024-04-25T10:02:50.590432+0000","last_undegraded":"2024-04-25T10:02:50.590432+0000","last_fullsized":"2024-04-25T10:02:50.590432+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:58.201064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.584662+0000","last_change":"2024-04-25T10:02:49.584662+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.584662+0000","last_undegraded":"2024-04-25T10:02:49.584662+0000","last_fullsized":"2024-04-25T10:02:49.584662+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.603838+0000","last_change":"2024-04-25T10:02:49.603196+0000","last_active":"2024-04-25T10:02:49.603838+0000","last_peered":"2024-04-25T10:02:49.603838+0000","last_clean":"2024-04-25T10:02:49.603838+0000","last_became_active":"2024-04-25T10:02:49.602809+0000","last_became_peered":"2024-04-25T10:02:49.602809+0000","last_unstale":"2024-04-25T10:02:49.603838+0000","last_undegraded":"2024-04-25T10:02:49.603838+0000","last_fullsized":"2024-04-25T10:02:49.603838+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:34.725327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.584993+0000","last_change":"2024-04-25T10:02:49.584993+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.584993+0000","last_undegraded":"2024-04-25T10:02:49.584993+0000","last_fullsized":"2024-04-25T10:02:49.584993+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.603096+0000","last_change":"2024-04-25T10:02:49.602636+0000","last_active":"2024-04-25T10:02:49.603096+0000","last_peered":"2024-04-25T10:02:49.603096+0000","last_clean":"2024-04-25T10:02:49.603096+0000","last_became_active":"2024-04-25T10:02:49.602376+0000","last_became_peered":"2024-04-25T10:02:49.602376+0000","last_unstale":"2024-04-25T10:02:49.603096+0000","last_undegraded":"2024-04-25T10:02:49.603096+0000","last_fullsized":"2024-04-25T10:02:49.603096+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:10.084009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.583767+0000","last_change":"2024-04-25T10:02:49.583767+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.583767+0000","last_undegraded":"2024-04-25T10:02:49.583767+0000","last_fullsized":"2024-04-25T10:02:49.583767+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.595549+0000","last_change":"2024-04-25T10:02:49.596692+0000","last_active":"2024-04-25T10:02:50.595549+0000","last_peered":"2024-04-25T10:02:50.595549+0000","last_clean":"2024-04-25T10:02:50.595549+0000","last_became_active":"2024-04-25T10:02:49.596371+0000","last_became_peered":"2024-04-25T10:02:49.596371+0000","last_unstale":"2024-04-25T10:02:50.595549+0000","last_undegraded":"2024-04-25T10:02:50.595549+0000","last_fullsized":"2024-04-25T10:02:50.595549+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:09.504320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.593530+0000","last_change":"2024-04-25T10:02:49.593530+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.593530+0000","last_undegraded":"2024-04-25T10:02:49.593530+0000","last_fullsized":"2024-04-25T10:02:49.593530+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.598418+0000","last_change":"2024-04-25T10:02:49.596751+0000","last_active":"2024-04-25T10:02:49.598418+0000","last_peered":"2024-04-25T10:02:49.598418+0000","last_clean":"2024-04-25T10:02:49.598418+0000","last_became_active":"2024-04-25T10:02:49.596497+0000","last_became_peered":"2024-04-25T10:02:49.596497+0000","last_unstale":"2024-04-25T10:02:49.598418+0000","last_undegraded":"2024-04-25T10:02:49.598418+0000","last_fullsized":"2024-04-25T10:02:49.598418+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:55.785270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585994+0000","last_change":"2024-04-25T10:02:49.585994+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585994+0000","last_undegraded":"2024-04-25T10:02:49.585994+0000","last_fullsized":"2024-04-25T10:02:49.585994+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.600871+0000","last_change":"2024-04-25T10:02:49.597614+0000","last_active":"2024-04-25T10:02:49.600871+0000","last_peered":"2024-04-25T10:02:49.600871+0000","last_clean":"2024-04-25T10:02:49.600871+0000","last_became_active":"2024-04-25T10:02:49.597315+0000","last_became_peered":"2024-04-25T10:02:49.597315+0000","last_unstale":"2024-04-25T10:02:49.600871+0000","last_undegraded":"2024-04-25T10:02:49.600871+0000","last_fullsized":"2024-04-25T10:02:49.600871+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:54.318211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.598481+0000","last_change":"2024-04-25T10:02:50.597174+0000","last_active":"2024-04-25T10:02:50.598481+0000","last_peered":"2024-04-25T10:02:50.598481+0000","last_clean":"2024-04-25T10:02:50.598481+0000","last_became_active":"2024-04-25T10:02:50.596881+0000","last_became_peered":"2024-04-25T10:02:50.596881+0000","last_unstale":"2024-04-25T10:02:50.598481+0000","last_undegraded":"2024-04-25T10:02:50.598481+0000","last_fullsized":"2024-04-25T10:02:50.598481+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:29:23.799255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.597653+0000","last_change":"2024-04-25T10:02:49.595969+0000","last_active":"2024-04-25T10:02:49.597653+0000","last_peered":"2024-04-25T10:02:49.597653+0000","last_clean":"2024-04-25T10:02:49.597653+0000","last_became_active":"2024-04-25T10:02:49.595693+0000","last_became_peered":"2024-04-25T10:02:49.595693+0000","last_unstale":"2024-04-25T10:02:49.597653+0000","last_undegraded":"2024-04-25T10:02:49.597653+0000","last_fullsized":"2024-04-25T10:02:49.597653+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:14.963530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.583995+0000","last_change":"2024-04-25T10:02:49.583995+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.583995+0000","last_undegraded":"2024-04-25T10:02:49.583995+0000","last_fullsized":"2024-04-25T10:02:49.583995+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.596214+0000","last_change":"2024-04-25T10:02:49.593862+0000","last_active":"2024-04-25T10:02:50.596214+0000","last_peered":"2024-04-25T10:02:50.596214+0000","last_clean":"2024-04-25T10:02:50.596214+0000","last_became_active":"2024-04-25T10:02:49.593554+0000","last_became_peered":"2024-04-25T10:02:49.593554+0000","last_unstale":"2024-04-25T10:02:50.596214+0000","last_undegraded":"2024-04-25T10:02:50.596214+0000","last_fullsized":"2024-04-25T10:02:50.596214+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:33.837038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.603964+0000","last_change":"2024-04-25T10:02:50.601221+0000","last_active":"2024-04-25T10:02:50.603964+0000","last_peered":"2024-04-25T10:02:50.603964+0000","last_clean":"2024-04-25T10:02:50.603964+0000","last_became_active":"2024-04-25T10:02:50.600909+0000","last_became_peered":"2024-04-25T10:02:50.600909+0000","last_unstale":"2024-04-25T10:02:50.603964+0000","last_undegraded":"2024-04-25T10:02:50.603964+0000","last_fullsized":"2024-04-25T10:02:50.603964+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:46.085984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.601700+0000","last_change":"2024-04-25T10:02:49.600863+0000","last_active":"2024-04-25T10:02:49.601700+0000","last_peered":"2024-04-25T10:02:49.601700+0000","last_clean":"2024-04-25T10:02:49.601700+0000","last_became_active":"2024-04-25T10:02:49.600571+0000","last_became_peered":"2024-04-25T10:02:49.600571+0000","last_unstale":"2024-04-25T10:02:49.601700+0000","last_undegraded":"2024-04-25T10:02:49.601700+0000","last_fullsized":"2024-04-25T10:02:49.601700+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:42.042387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.593132+0000","last_change":"2024-04-25T10:02:49.593132+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.593132+0000","last_undegraded":"2024-04-25T10:02:49.593132+0000","last_fullsized":"2024-04-25T10:02:49.593132+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.583742+0000","last_change":"2024-04-25T10:02:49.601012+0000","last_active":"2024-04-25T10:02:50.583742+0000","last_peered":"2024-04-25T10:02:50.583742+0000","last_clean":"2024-04-25T10:02:50.583742+0000","last_became_active":"2024-04-25T10:02:49.600731+0000","last_became_peered":"2024-04-25T10:02:49.600731+0000","last_unstale":"2024-04-25T10:02:50.583742+0000","last_undegraded":"2024-04-25T10:02:50.583742+0000","last_fullsized":"2024-04-25T10:02:50.583742+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:12.373559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.592072+0000","last_change":"2024-04-25T10:02:49.592072+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.592072+0000","last_undegraded":"2024-04-25T10:02:49.592072+0000","last_fullsized":"2024-04-25T10:02:49.592072+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.602217+0000","last_change":"2024-04-25T10:02:49.600898+0000","last_active":"2024-04-25T10:02:49.602217+0000","last_peered":"2024-04-25T10:02:49.602217+0000","last_clean":"2024-04-25T10:02:49.602217+0000","last_became_active":"2024-04-25T10:02:49.600598+0000","last_became_peered":"2024-04-25T10:02:49.600598+0000","last_unstale":"2024-04-25T10:02:49.602217+0000","last_undegraded":"2024-04-25T10:02:49.602217+0000","last_fullsized":"2024-04-25T10:02:49.602217+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:03.344877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.603429+0000","last_change":"2024-04-25T10:02:50.602017+0000","last_active":"2024-04-25T10:02:50.603429+0000","last_peered":"2024-04-25T10:02:50.603429+0000","last_clean":"2024-04-25T10:02:50.603429+0000","last_became_active":"2024-04-25T10:02:50.601702+0000","last_became_peered":"2024-04-25T10:02:50.601702+0000","last_unstale":"2024-04-25T10:02:50.603429+0000","last_undegraded":"2024-04-25T10:02:50.603429+0000","last_fullsized":"2024-04-25T10:02:50.603429+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:36.647239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.595712+0000","last_change":"2024-04-25T10:02:49.592618+0000","last_active":"2024-04-25T10:02:50.595712+0000","last_peered":"2024-04-25T10:02:50.595712+0000","last_clean":"2024-04-25T10:02:50.595712+0000","last_became_active":"2024-04-25T10:02:49.592337+0000","last_became_peered":"2024-04-25T10:02:49.592337+0000","last_unstale":"2024-04-25T10:02:50.595712+0000","last_undegraded":"2024-04-25T10:02:50.595712+0000","last_fullsized":"2024-04-25T10:02:50.595712+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:37.202053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.601041+0000","last_change":"2024-04-25T10:02:50.593723+0000","last_active":"2024-04-25T10:02:50.601041+0000","last_peered":"2024-04-25T10:02:50.601041+0000","last_clean":"2024-04-25T10:02:50.601041+0000","last_became_active":"2024-04-25T10:02:50.593409+0000","last_became_peered":"2024-04-25T10:02:50.593409+0000","last_unstale":"2024-04-25T10:02:50.601041+0000","last_undegraded":"2024-04-25T10:02:50.601041+0000","last_fullsized":"2024-04-25T10:02:50.601041+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:44:14.466542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.602152+0000","last_change":"2024-04-25T10:02:49.599898+0000","last_active":"2024-04-25T10:02:49.602152+0000","last_peered":"2024-04-25T10:02:49.602152+0000","last_clean":"2024-04-25T10:02:49.602152+0000","last_became_active":"2024-04-25T10:02:49.599612+0000","last_became_peered":"2024-04-25T10:02:49.599612+0000","last_unstale":"2024-04-25T10:02:49.602152+0000","last_undegraded":"2024-04-25T10:02:49.602152+0000","last_fullsized":"2024-04-25T10:02:49.602152+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:05:42.694860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.612908+0000","last_change":"2024-04-25T10:02:50.605854+0000","last_active":"2024-04-25T10:02:50.612908+0000","last_peered":"2024-04-25T10:02:50.612908+0000","last_clean":"2024-04-25T10:02:50.612908+0000","last_became_active":"2024-04-25T10:02:50.605508+0000","last_became_peered":"2024-04-25T10:02:50.605508+0000","last_unstale":"2024-04-25T10:02:50.612908+0000","last_undegraded":"2024-04-25T10:02:50.612908+0000","last_fullsized":"2024-04-25T10:02:50.612908+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:28.150965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.598822+0000","last_change":"2024-04-25T10:02:49.598137+0000","last_active":"2024-04-25T10:02:49.598822+0000","last_peered":"2024-04-25T10:02:49.598822+0000","last_clean":"2024-04-25T10:02:49.598822+0000","last_became_active":"2024-04-25T10:02:49.597841+0000","last_became_peered":"2024-04-25T10:02:49.597841+0000","last_unstale":"2024-04-25T10:02:49.598822+0000","last_undegraded":"2024-04-25T10:02:49.598822+0000","last_fullsized":"2024-04-25T10:02:49.598822+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:42.504597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":321,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.587486+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T10:02:50.587486+0000","last_peered":"2024-04-25T10:02:50.587486+0000","last_clean":"2024-04-25T10:02:50.587486+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T10:02:50.587486+0000","last_undegraded":"2024-04-25T10:02:50.587486+0000","last_fullsized":"2024-04-25T10:02:50.587486+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":1794,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23,"ondisk_log_size":23,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542250,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33008,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338832,"statfs":{"total":96636764160,"available":96602963968,"internally_reserved":0,"allocated":1863680,"data_stored":1174185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542250,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1249280,"data_stored":576490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542252,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1261568,"data_stored":583657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542249,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1249280,"data_stored":576490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574954,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1236992,"data_stored":569823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1236992,"data_stored":569823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1249280,"data_stored":576490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574954,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32988,"kb_used_data":1800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338852,"statfs":{"total":96636764160,"available":96602984448,"internally_reserved":0,"allocated":1843200,"data_stored":1166858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:02:53.602 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:02:53.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.734+0000 7f0ee97b0640 1 Processor -- start 2024-04-25T10:02:53.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.734+0000 7f0ee97b0640 1 -- start start 2024-04-25T10:02:53.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.735+0000 7f0ee97b0640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0ee415d7b0 0x7f0ee406fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:53.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.735+0000 7f0ee97b0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0ee415eba0 0x7f0ee40b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:53.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.735+0000 7f0ee97b0640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee41618f0 con 0x7f0ee40b53c0 2024-04-25T10:02:53.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.735+0000 7f0ee97b0640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee4161bd0 con 0x7f0ee415d7b0 2024-04-25T10:02:53.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.735+0000 7f0ee97b0640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee4161eb0 con 0x7f0ee415eba0 2024-04-25T10:02:53.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.735+0000 7f0ee2ffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0ee415d7b0 0x7f0ee406fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:53.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.735+0000 7f0ee2ffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0ee415d7b0 0x7f0ee406fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44198/0 (socket says 172.21.15.7:44198) 2024-04-25T10:02:53.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.735+0000 7f0ee2ffd640 1 -- 172.21.15.7:0/1768542798 learned_addr learned my addr 172.21.15.7:0/1768542798 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:53.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.735+0000 7f0ee37fe640 1 --2- 172.21.15.7:0/1768542798 >> v2:172.21.15.55:3300/0 conn(0x7f0ee415eba0 0x7f0ee40b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:53.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.735+0000 7f0ee2ffd640 1 -- 172.21.15.7:0/1768542798 >> v2:172.21.15.55:3300/0 conn(0x7f0ee415eba0 msgr2=0x7f0ee40b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:53.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.735+0000 7f0ee2ffd640 1 --2- 172.21.15.7:0/1768542798 >> v2:172.21.15.55:3300/0 conn(0x7f0ee415eba0 0x7f0ee40b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:53.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.735+0000 7f0ee2ffd640 1 -- 172.21.15.7:0/1768542798 >> v1:172.21.15.7:6789/0 conn(0x7f0ee40b53c0 legacy=0x7f0ee406ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:53.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.735+0000 7f0ee27fc640 1 -- 172.21.15.7:0/1768542798 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3219721405 0 0) 0x7f0ee41618f0 con 0x7f0ee40b53c0 2024-04-25T10:02:53.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.735+0000 7f0ee2ffd640 1 -- 172.21.15.7:0/1768542798 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee4162190 con 0x7f0ee415d7b0 2024-04-25T10:02:53.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.735+0000 7f0ee37fe640 1 --2- 172.21.15.7:0/1768542798 >> v2:172.21.15.55:3300/0 conn(0x7f0ee415eba0 0x7f0ee40b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:02:53.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.736+0000 7f0ee2ffd640 1 --2- 172.21.15.7:0/1768542798 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ee415d7b0 0x7f0ee406fa00 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4068460 tx=0x7f0ed402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e509e2d6c3f31293 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:53.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.736+0000 7f0ee27fc640 1 -- 172.21.15.7:0/1768542798 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4037070 con 0x7f0ee415d7b0 2024-04-25T10:02:53.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.736+0000 7f0ee27fc640 1 -- 172.21.15.7:0/1768542798 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed4032440 con 0x7f0ee415d7b0 2024-04-25T10:02:53.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.736+0000 7f0ee27fc640 1 -- 172.21.15.7:0/1768542798 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4032810 con 0x7f0ee415d7b0 2024-04-25T10:02:53.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.737+0000 7f0ee97b0640 1 -- 172.21.15.7:0/1768542798 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ee415d7b0 msgr2=0x7f0ee406fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:53.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.737+0000 7f0ee97b0640 1 --2- 172.21.15.7:0/1768542798 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ee415d7b0 0x7f0ee406fa00 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4068460 tx=0x7f0ed402a270 comp rx=0 tx=0).stop 2024-04-25T10:02:53.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.737+0000 7f0ee97b0640 1 -- 172.21.15.7:0/1768542798 shutdown_connections 2024-04-25T10:02:53.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.737+0000 7f0ee97b0640 1 --2- 172.21.15.7:0/1768542798 >> v2:172.21.15.55:3300/0 conn(0x7f0ee415eba0 0x7f0ee40b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:53.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.737+0000 7f0ee97b0640 1 --2- 172.21.15.7:0/1768542798 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ee415d7b0 0x7f0ee406fa00 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:53.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.737+0000 7f0ee97b0640 1 -- 172.21.15.7:0/1768542798 >> 172.21.15.7:0/1768542798 conn(0x7f0ee40b2390 msgr2=0x7f0ee40b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:53.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.737+0000 7f0ee97b0640 1 -- 172.21.15.7:0/1768542798 shutdown_connections 2024-04-25T10:02:53.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.737+0000 7f0ee97b0640 1 -- 172.21.15.7:0/1768542798 wait complete. 2024-04-25T10:02:53.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.738+0000 7f0ee97b0640 1 Processor -- start 2024-04-25T10:02:53.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.738+0000 7f0ee97b0640 1 -- start start 2024-04-25T10:02:53.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.739+0000 7f0ee97b0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ee40b53c0 0x7f0ee414b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:53.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.739+0000 7f0ee97b0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ee415d7b0 0x7f0ee415db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:53.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.739+0000 7f0ee97b0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ee415eba0 0x7f0ee415e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:53.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.739+0000 7f0ee97b0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee406b3f0 con 0x7f0ee415d7b0 2024-04-25T10:02:53.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.739+0000 7f0ee97b0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee406b270 con 0x7f0ee40b53c0 2024-04-25T10:02:53.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.739+0000 7f0ee97b0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee40b5850 con 0x7f0ee415eba0 2024-04-25T10:02:53.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.739+0000 7f0edbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ee415d7b0 0x7f0ee415db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:53.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.739+0000 7f0edbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ee415d7b0 0x7f0ee415db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44208/0 (socket says 172.21.15.7:44208) 2024-04-25T10:02:53.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.739+0000 7f0edbfff640 1 -- 172.21.15.7:0/2978209830 learned_addr learned my addr 172.21.15.7:0/2978209830 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:53.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.739+0000 7f0ee2ffd640 1 --2- 172.21.15.7:0/2978209830 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ee40b53c0 0x7f0ee414b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:53.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.739+0000 7f0ee37fe640 1 --2- 172.21.15.7:0/2978209830 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ee415eba0 0x7f0ee415e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:53.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.739+0000 7f0edbfff640 1 -- 172.21.15.7:0/2978209830 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ee415eba0 msgr2=0x7f0ee415e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:53.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.739+0000 7f0edbfff640 1 --2- 172.21.15.7:0/2978209830 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ee415eba0 0x7f0ee415e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:53.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.739+0000 7f0edbfff640 1 -- 172.21.15.7:0/2978209830 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ee40b53c0 msgr2=0x7f0ee414b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:53.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.739+0000 7f0edbfff640 1 --2- 172.21.15.7:0/2978209830 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ee40b53c0 0x7f0ee414b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:53.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.739+0000 7f0edbfff640 1 -- 172.21.15.7:0/2978209830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee41570d0 con 0x7f0ee415d7b0 2024-04-25T10:02:53.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.739+0000 7f0ee37fe640 1 --2- 172.21.15.7:0/2978209830 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ee415eba0 0x7f0ee415e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:02:53.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.739+0000 7f0edbfff640 1 --2- 172.21.15.7:0/2978209830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ee415d7b0 0x7f0ee415db90 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00c410 tx=0x7f0ecc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:53.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.740+0000 7f0edb7fe640 1 -- 172.21.15.7:0/2978209830 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc017070 con 0x7f0ee415d7b0 2024-04-25T10:02:53.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.740+0000 7f0edb7fe640 1 -- 172.21.15.7:0/2978209830 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ecc0035f0 con 0x7f0ee415d7b0 2024-04-25T10:02:53.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.740+0000 7f0ee97b0640 1 -- 172.21.15.7:0/2978209830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee41573b0 con 0x7f0ee415d7b0 2024-04-25T10:02:53.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.740+0000 7f0edb7fe640 1 -- 172.21.15.7:0/2978209830 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc0039e0 con 0x7f0ee415d7b0 2024-04-25T10:02:53.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.740+0000 7f0ee97b0640 1 -- 172.21.15.7:0/2978209830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee4157970 con 0x7f0ee415d7b0 2024-04-25T10:02:53.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.741+0000 7f0ee97b0640 1 -- 172.21.15.7:0/2978209830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee40caff0 con 0x7f0ee415d7b0 2024-04-25T10:02:53.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.741+0000 7f0edb7fe640 1 -- 172.21.15.7:0/2978209830 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0ecc01a070 con 0x7f0ee415d7b0 2024-04-25T10:02:53.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.741+0000 7f0edb7fe640 1 --2- 172.21.15.7:0/2978209830 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0ec406b4d0 0x7f0ec406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:53.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.741+0000 7f0edb7fe640 1 -- 172.21.15.7:0/2978209830 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0ecc089750 con 0x7f0ee415d7b0 2024-04-25T10:02:53.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.742+0000 7f0ee2ffd640 1 --2- 172.21.15.7:0/2978209830 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0ec406b4d0 0x7f0ec406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:53.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.742+0000 7f0ee2ffd640 1 --2- 172.21.15.7:0/2978209830 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0ec406b4d0 0x7f0ec406d990 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4034000 tx=0x7f0ed402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:53.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.746+0000 7f0edb7fe640 1 -- 172.21.15.7:0/2978209830 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0ee40caff0 con 0x7f0ee415d7b0 2024-04-25T10:02:53.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.924+0000 7f0ee97b0640 1 -- 172.21.15.7:0/2978209830 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0ee4068fd0 con 0x7f0ec406b4d0 2024-04-25T10:02:53.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.930+0000 7f0edb7fe640 1 -- 172.21.15.7:0/2978209830 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249440 (secure 0 0 0) 0x7f0ee4068fd0 con 0x7f0ec406b4d0 2024-04-25T10:02:53.937 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:02:53.939 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T10:02:53.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.933+0000 7f0ee97b0640 1 -- 172.21.15.7:0/2978209830 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0ec406b4d0 msgr2=0x7f0ec406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:53.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.933+0000 7f0ee97b0640 1 --2- 172.21.15.7:0/2978209830 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0ec406b4d0 0x7f0ec406d990 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4034000 tx=0x7f0ed402e000 comp rx=0 tx=0).stop 2024-04-25T10:02:53.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.933+0000 7f0ee97b0640 1 -- 172.21.15.7:0/2978209830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ee415d7b0 msgr2=0x7f0ee415db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:53.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.933+0000 7f0ee97b0640 1 --2- 172.21.15.7:0/2978209830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ee415d7b0 0x7f0ee415db90 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00c410 tx=0x7f0ecc00c8d0 comp rx=0 tx=0).stop 2024-04-25T10:02:53.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.933+0000 7f0ee97b0640 1 -- 172.21.15.7:0/2978209830 shutdown_connections 2024-04-25T10:02:53.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.933+0000 7f0ee97b0640 1 --2- 172.21.15.7:0/2978209830 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0ec406b4d0 0x7f0ec406d990 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:53.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.933+0000 7f0ee97b0640 1 --2- 172.21.15.7:0/2978209830 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0ee415eba0 0x7f0ee415e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:53.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.933+0000 7f0ee97b0640 1 --2- 172.21.15.7:0/2978209830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ee415d7b0 0x7f0ee415db90 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:53.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.933+0000 7f0ee97b0640 1 --2- 172.21.15.7:0/2978209830 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ee40b53c0 0x7f0ee414b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:53.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.933+0000 7f0ee97b0640 1 -- 172.21.15.7:0/2978209830 >> 172.21.15.7:0/2978209830 conn(0x7f0ee40b2390 msgr2=0x7f0ee40b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:53.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.933+0000 7f0ee97b0640 1 -- 172.21.15.7:0/2978209830 shutdown_connections 2024-04-25T10:02:53.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:53.933+0000 7f0ee97b0640 1 -- 172.21.15.7:0/2978209830 wait complete. 2024-04-25T10:02:53.949 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":355,"stamp":"2024-04-25T10:02:51.970875+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592162,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":186,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":75,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260416,"kb_used_data":10928,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714304,"statfs":{"total":773094113280,"available":772827447296,"internally_reserved":0,"allocated":11190272,"data_stored":5793816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1794,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000939"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585616+0000","last_change":"2024-04-25T10:02:49.585616+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585616+0000","last_undegraded":"2024-04-25T10:02:49.585616+0000","last_fullsized":"2024-04-25T10:02:49.585616+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.608577+0000","last_change":"2024-04-25T10:02:50.603031+0000","last_active":"2024-04-25T10:02:50.608577+0000","last_peered":"2024-04-25T10:02:50.608577+0000","last_clean":"2024-04-25T10:02:50.608577+0000","last_became_active":"2024-04-25T10:02:50.602748+0000","last_became_peered":"2024-04-25T10:02:50.602748+0000","last_unstale":"2024-04-25T10:02:50.608577+0000","last_undegraded":"2024-04-25T10:02:50.608577+0000","last_fullsized":"2024-04-25T10:02:50.608577+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:16.100766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585815+0000","last_change":"2024-04-25T10:02:49.585815+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585815+0000","last_undegraded":"2024-04-25T10:02:49.585815+0000","last_fullsized":"2024-04-25T10:02:49.585815+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.584483+0000","last_change":"2024-04-25T10:02:49.584483+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.584483+0000","last_undegraded":"2024-04-25T10:02:49.584483+0000","last_fullsized":"2024-04-25T10:02:49.584483+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.587454+0000","last_change":"2024-04-25T10:02:49.587454+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.587454+0000","last_undegraded":"2024-04-25T10:02:49.587454+0000","last_fullsized":"2024-04-25T10:02:49.587454+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.608539+0000","last_change":"2024-04-25T10:02:50.600787+0000","last_active":"2024-04-25T10:02:50.608539+0000","last_peered":"2024-04-25T10:02:50.608539+0000","last_clean":"2024-04-25T10:02:50.608539+0000","last_became_active":"2024-04-25T10:02:50.599972+0000","last_became_peered":"2024-04-25T10:02:50.599972+0000","last_unstale":"2024-04-25T10:02:50.608539+0000","last_undegraded":"2024-04-25T10:02:50.608539+0000","last_fullsized":"2024-04-25T10:02:50.608539+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:34:25.529946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.603998+0000","last_change":"2024-04-25T10:02:50.598983+0000","last_active":"2024-04-25T10:02:50.603998+0000","last_peered":"2024-04-25T10:02:50.603998+0000","last_clean":"2024-04-25T10:02:50.603998+0000","last_became_active":"2024-04-25T10:02:50.598041+0000","last_became_peered":"2024-04-25T10:02:50.598041+0000","last_unstale":"2024-04-25T10:02:50.603998+0000","last_undegraded":"2024-04-25T10:02:50.603998+0000","last_fullsized":"2024-04-25T10:02:50.603998+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:26.544669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.595587+0000","last_change":"2024-04-25T10:02:49.595587+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.595587+0000","last_undegraded":"2024-04-25T10:02:49.595587+0000","last_fullsized":"2024-04-25T10:02:49.595587+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.608465+0000","last_change":"2024-04-25T10:02:50.600374+0000","last_active":"2024-04-25T10:02:50.608465+0000","last_peered":"2024-04-25T10:02:50.608465+0000","last_clean":"2024-04-25T10:02:50.608465+0000","last_became_active":"2024-04-25T10:02:50.600063+0000","last_became_peered":"2024-04-25T10:02:50.600063+0000","last_unstale":"2024-04-25T10:02:50.608465+0000","last_undegraded":"2024-04-25T10:02:50.608465+0000","last_fullsized":"2024-04-25T10:02:50.608465+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:13.384824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.587520+0000","last_change":"2024-04-25T10:02:49.587520+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.587520+0000","last_undegraded":"2024-04-25T10:02:49.587520+0000","last_fullsized":"2024-04-25T10:02:49.587520+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.603520+0000","last_change":"2024-04-25T10:02:50.597667+0000","last_active":"2024-04-25T10:02:50.603520+0000","last_peered":"2024-04-25T10:02:50.603520+0000","last_clean":"2024-04-25T10:02:50.603520+0000","last_became_active":"2024-04-25T10:02:50.597380+0000","last_became_peered":"2024-04-25T10:02:50.597380+0000","last_unstale":"2024-04-25T10:02:50.603520+0000","last_undegraded":"2024-04-25T10:02:50.603520+0000","last_fullsized":"2024-04-25T10:02:50.603520+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:00.445645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.598512+0000","last_change":"2024-04-25T10:02:50.597126+0000","last_active":"2024-04-25T10:02:50.598512+0000","last_peered":"2024-04-25T10:02:50.598512+0000","last_clean":"2024-04-25T10:02:50.598512+0000","last_became_active":"2024-04-25T10:02:50.596838+0000","last_became_peered":"2024-04-25T10:02:50.596838+0000","last_unstale":"2024-04-25T10:02:50.598512+0000","last_undegraded":"2024-04-25T10:02:50.598512+0000","last_fullsized":"2024-04-25T10:02:50.598512+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:25.592490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.584137+0000","last_change":"2024-04-25T10:02:49.584137+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.584137+0000","last_undegraded":"2024-04-25T10:02:49.584137+0000","last_fullsized":"2024-04-25T10:02:49.584137+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.600410+0000","last_change":"2024-04-25T10:02:50.594589+0000","last_active":"2024-04-25T10:02:50.600410+0000","last_peered":"2024-04-25T10:02:50.600410+0000","last_clean":"2024-04-25T10:02:50.600410+0000","last_became_active":"2024-04-25T10:02:50.594292+0000","last_became_peered":"2024-04-25T10:02:50.594292+0000","last_unstale":"2024-04-25T10:02:50.600410+0000","last_undegraded":"2024-04-25T10:02:50.600410+0000","last_fullsized":"2024-04-25T10:02:50.600410+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:27.456813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.603854+0000","last_change":"2024-04-25T10:02:50.602757+0000","last_active":"2024-04-25T10:02:50.603854+0000","last_peered":"2024-04-25T10:02:50.603854+0000","last_clean":"2024-04-25T10:02:50.603854+0000","last_became_active":"2024-04-25T10:02:50.602479+0000","last_became_peered":"2024-04-25T10:02:50.602479+0000","last_unstale":"2024-04-25T10:02:50.603854+0000","last_undegraded":"2024-04-25T10:02:50.603854+0000","last_fullsized":"2024-04-25T10:02:50.603854+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:52.545352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613866+0000","last_change":"2024-04-25T10:02:50.611124+0000","last_active":"2024-04-25T10:02:50.613866+0000","last_peered":"2024-04-25T10:02:50.613866+0000","last_clean":"2024-04-25T10:02:50.613866+0000","last_became_active":"2024-04-25T10:02:50.610797+0000","last_became_peered":"2024-04-25T10:02:50.610797+0000","last_unstale":"2024-04-25T10:02:50.613866+0000","last_undegraded":"2024-04-25T10:02:50.613866+0000","last_fullsized":"2024-04-25T10:02:50.613866+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:04.437758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585202+0000","last_change":"2024-04-25T10:02:49.585202+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585202+0000","last_undegraded":"2024-04-25T10:02:49.585202+0000","last_fullsized":"2024-04-25T10:02:49.585202+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.604313+0000","last_change":"2024-04-25T10:02:50.599375+0000","last_active":"2024-04-25T10:02:50.604313+0000","last_peered":"2024-04-25T10:02:50.604313+0000","last_clean":"2024-04-25T10:02:50.604313+0000","last_became_active":"2024-04-25T10:02:50.599069+0000","last_became_peered":"2024-04-25T10:02:50.599069+0000","last_unstale":"2024-04-25T10:02:50.604313+0000","last_undegraded":"2024-04-25T10:02:50.604313+0000","last_fullsized":"2024-04-25T10:02:50.604313+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:08:30.199923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585426+0000","last_change":"2024-04-25T10:02:49.585426+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585426+0000","last_undegraded":"2024-04-25T10:02:49.585426+0000","last_fullsized":"2024-04-25T10:02:49.585426+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.595723+0000","last_change":"2024-04-25T10:02:50.592377+0000","last_active":"2024-04-25T10:02:50.595723+0000","last_peered":"2024-04-25T10:02:50.595723+0000","last_clean":"2024-04-25T10:02:50.595723+0000","last_became_active":"2024-04-25T10:02:50.592080+0000","last_became_peered":"2024-04-25T10:02:50.592080+0000","last_unstale":"2024-04-25T10:02:50.595723+0000","last_undegraded":"2024-04-25T10:02:50.595723+0000","last_fullsized":"2024-04-25T10:02:50.595723+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:07.989371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.594791+0000","last_change":"2024-04-25T10:02:49.594791+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.594791+0000","last_undegraded":"2024-04-25T10:02:49.594791+0000","last_fullsized":"2024-04-25T10:02:49.594791+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.586101+0000","last_change":"2024-04-25T10:02:49.586101+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.586101+0000","last_undegraded":"2024-04-25T10:02:49.586101+0000","last_fullsized":"2024-04-25T10:02:49.586101+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.584332+0000","last_change":"2024-04-25T10:02:49.584332+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.584332+0000","last_undegraded":"2024-04-25T10:02:49.584332+0000","last_fullsized":"2024-04-25T10:02:49.584332+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585088+0000","last_change":"2024-04-25T10:02:49.585088+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585088+0000","last_undegraded":"2024-04-25T10:02:49.585088+0000","last_fullsized":"2024-04-25T10:02:49.585088+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.595760+0000","last_change":"2024-04-25T10:02:50.593306+0000","last_active":"2024-04-25T10:02:50.595760+0000","last_peered":"2024-04-25T10:02:50.595760+0000","last_clean":"2024-04-25T10:02:50.595760+0000","last_became_active":"2024-04-25T10:02:50.593032+0000","last_became_peered":"2024-04-25T10:02:50.593032+0000","last_unstale":"2024-04-25T10:02:50.595760+0000","last_undegraded":"2024-04-25T10:02:50.595760+0000","last_fullsized":"2024-04-25T10:02:50.595760+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:08.637593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.603488+0000","last_change":"2024-04-25T10:02:50.600711+0000","last_active":"2024-04-25T10:02:50.603488+0000","last_peered":"2024-04-25T10:02:50.603488+0000","last_clean":"2024-04-25T10:02:50.603488+0000","last_became_active":"2024-04-25T10:02:50.600415+0000","last_became_peered":"2024-04-25T10:02:50.600415+0000","last_unstale":"2024-04-25T10:02:50.603488+0000","last_undegraded":"2024-04-25T10:02:50.603488+0000","last_fullsized":"2024-04-25T10:02:50.603488+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:47.347288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.600930+0000","last_change":"2024-04-25T10:02:50.592967+0000","last_active":"2024-04-25T10:02:50.600930+0000","last_peered":"2024-04-25T10:02:50.600930+0000","last_clean":"2024-04-25T10:02:50.600930+0000","last_became_active":"2024-04-25T10:02:50.592601+0000","last_became_peered":"2024-04-25T10:02:50.592601+0000","last_unstale":"2024-04-25T10:02:50.600930+0000","last_undegraded":"2024-04-25T10:02:50.600930+0000","last_fullsized":"2024-04-25T10:02:50.600930+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:42.927791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613090+0000","last_change":"2024-04-25T10:02:50.604355+0000","last_active":"2024-04-25T10:02:50.613090+0000","last_peered":"2024-04-25T10:02:50.613090+0000","last_clean":"2024-04-25T10:02:50.613090+0000","last_became_active":"2024-04-25T10:02:50.603745+0000","last_became_peered":"2024-04-25T10:02:50.603745+0000","last_unstale":"2024-04-25T10:02:50.613090+0000","last_undegraded":"2024-04-25T10:02:50.613090+0000","last_fullsized":"2024-04-25T10:02:50.613090+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:48.165008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.594396+0000","last_change":"2024-04-25T10:02:49.594396+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.594396+0000","last_undegraded":"2024-04-25T10:02:49.594396+0000","last_fullsized":"2024-04-25T10:02:49.594396+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.595701+0000","last_change":"2024-04-25T10:02:50.590740+0000","last_active":"2024-04-25T10:02:50.595701+0000","last_peered":"2024-04-25T10:02:50.595701+0000","last_clean":"2024-04-25T10:02:50.595701+0000","last_became_active":"2024-04-25T10:02:50.590423+0000","last_became_peered":"2024-04-25T10:02:50.590423+0000","last_unstale":"2024-04-25T10:02:50.595701+0000","last_undegraded":"2024-04-25T10:02:50.595701+0000","last_fullsized":"2024-04-25T10:02:50.595701+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:48.165008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613110+0000","last_change":"2024-04-25T10:02:50.605847+0000","last_active":"2024-04-25T10:02:50.613110+0000","last_peered":"2024-04-25T10:02:50.613110+0000","last_clean":"2024-04-25T10:02:50.613110+0000","last_became_active":"2024-04-25T10:02:50.605541+0000","last_became_peered":"2024-04-25T10:02:50.605541+0000","last_unstale":"2024-04-25T10:02:50.613110+0000","last_undegraded":"2024-04-25T10:02:50.613110+0000","last_fullsized":"2024-04-25T10:02:50.613110+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:08.637593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.593250+0000","last_change":"2024-04-25T10:02:49.593250+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.593250+0000","last_undegraded":"2024-04-25T10:02:49.593250+0000","last_fullsized":"2024-04-25T10:02:49.593250+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585100+0000","last_change":"2024-04-25T10:02:49.585100+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585100+0000","last_undegraded":"2024-04-25T10:02:49.585100+0000","last_fullsized":"2024-04-25T10:02:49.585100+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.601832+0000","last_change":"2024-04-25T10:02:49.599379+0000","last_active":"2024-04-25T10:02:49.601832+0000","last_peered":"2024-04-25T10:02:49.601832+0000","last_clean":"2024-04-25T10:02:49.601832+0000","last_became_active":"2024-04-25T10:02:49.599070+0000","last_became_peered":"2024-04-25T10:02:49.599070+0000","last_unstale":"2024-04-25T10:02:49.601832+0000","last_undegraded":"2024-04-25T10:02:49.601832+0000","last_fullsized":"2024-04-25T10:02:49.601832+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:32.905433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.592135+0000","last_change":"2024-04-25T10:02:49.592135+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.592135+0000","last_undegraded":"2024-04-25T10:02:49.592135+0000","last_fullsized":"2024-04-25T10:02:49.592135+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.598801+0000","last_change":"2024-04-25T10:02:49.597685+0000","last_active":"2024-04-25T10:02:49.598801+0000","last_peered":"2024-04-25T10:02:49.598801+0000","last_clean":"2024-04-25T10:02:49.598801+0000","last_became_active":"2024-04-25T10:02:49.597436+0000","last_became_peered":"2024-04-25T10:02:49.597436+0000","last_unstale":"2024-04-25T10:02:49.598801+0000","last_undegraded":"2024-04-25T10:02:49.598801+0000","last_fullsized":"2024-04-25T10:02:49.598801+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:15.857498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.608237+0000","last_change":"2024-04-25T10:02:50.601730+0000","last_active":"2024-04-25T10:02:50.608237+0000","last_peered":"2024-04-25T10:02:50.608237+0000","last_clean":"2024-04-25T10:02:50.608237+0000","last_became_active":"2024-04-25T10:02:50.601433+0000","last_became_peered":"2024-04-25T10:02:50.601433+0000","last_unstale":"2024-04-25T10:02:50.608237+0000","last_undegraded":"2024-04-25T10:02:50.608237+0000","last_fullsized":"2024-04-25T10:02:50.608237+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:59.212329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"102'2","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613763+0000","last_change":"2024-04-25T10:02:49.602625+0000","last_active":"2024-04-25T10:02:50.613763+0000","last_peered":"2024-04-25T10:02:50.613763+0000","last_clean":"2024-04-25T10:02:50.613763+0000","last_became_active":"2024-04-25T10:02:49.602213+0000","last_became_peered":"2024-04-25T10:02:49.602213+0000","last_unstale":"2024-04-25T10:02:50.613763+0000","last_undegraded":"2024-04-25T10:02:50.613763+0000","last_fullsized":"2024-04-25T10:02:50.613763+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:16.695057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.603943+0000","last_change":"2024-04-25T10:02:50.597990+0000","last_active":"2024-04-25T10:02:50.603943+0000","last_peered":"2024-04-25T10:02:50.603943+0000","last_clean":"2024-04-25T10:02:50.603943+0000","last_became_active":"2024-04-25T10:02:50.597292+0000","last_became_peered":"2024-04-25T10:02:50.597292+0000","last_unstale":"2024-04-25T10:02:50.603943+0000","last_undegraded":"2024-04-25T10:02:50.603943+0000","last_fullsized":"2024-04-25T10:02:50.603943+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:50.079193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.603349+0000","last_change":"2024-04-25T10:02:49.601540+0000","last_active":"2024-04-25T10:02:49.603349+0000","last_peered":"2024-04-25T10:02:49.603349+0000","last_clean":"2024-04-25T10:02:49.603349+0000","last_became_active":"2024-04-25T10:02:49.601236+0000","last_became_peered":"2024-04-25T10:02:49.601236+0000","last_unstale":"2024-04-25T10:02:49.603349+0000","last_undegraded":"2024-04-25T10:02:49.603349+0000","last_fullsized":"2024-04-25T10:02:49.603349+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:02.585092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.583753+0000","last_change":"2024-04-25T10:02:49.583753+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.583753+0000","last_undegraded":"2024-04-25T10:02:49.583753+0000","last_fullsized":"2024-04-25T10:02:49.583753+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"102'1","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613424+0000","last_change":"2024-04-25T10:02:49.600687+0000","last_active":"2024-04-25T10:02:50.613424+0000","last_peered":"2024-04-25T10:02:50.613424+0000","last_clean":"2024-04-25T10:02:50.613424+0000","last_became_active":"2024-04-25T10:02:49.600405+0000","last_became_peered":"2024-04-25T10:02:49.600405+0000","last_unstale":"2024-04-25T10:02:50.613424+0000","last_undegraded":"2024-04-25T10:02:50.613424+0000","last_fullsized":"2024-04-25T10:02:50.613424+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:54:46.938087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.584373+0000","last_change":"2024-04-25T10:02:49.584373+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.584373+0000","last_undegraded":"2024-04-25T10:02:49.584373+0000","last_fullsized":"2024-04-25T10:02:49.584373+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"102'1","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613725+0000","last_change":"2024-04-25T10:02:49.599888+0000","last_active":"2024-04-25T10:02:50.613725+0000","last_peered":"2024-04-25T10:02:50.613725+0000","last_clean":"2024-04-25T10:02:50.613725+0000","last_became_active":"2024-04-25T10:02:49.599607+0000","last_became_peered":"2024-04-25T10:02:49.599607+0000","last_unstale":"2024-04-25T10:02:50.613725+0000","last_undegraded":"2024-04-25T10:02:50.613725+0000","last_fullsized":"2024-04-25T10:02:50.613725+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:46.336023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.608555+0000","last_change":"2024-04-25T10:02:50.602985+0000","last_active":"2024-04-25T10:02:50.608555+0000","last_peered":"2024-04-25T10:02:50.608555+0000","last_clean":"2024-04-25T10:02:50.608555+0000","last_became_active":"2024-04-25T10:02:50.602713+0000","last_became_peered":"2024-04-25T10:02:50.602713+0000","last_unstale":"2024-04-25T10:02:50.608555+0000","last_undegraded":"2024-04-25T10:02:50.608555+0000","last_fullsized":"2024-04-25T10:02:50.608555+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:49:13.711038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.585083+0000","last_change":"2024-04-25T10:02:49.598952+0000","last_active":"2024-04-25T10:02:50.585083+0000","last_peered":"2024-04-25T10:02:50.585083+0000","last_clean":"2024-04-25T10:02:50.585083+0000","last_became_active":"2024-04-25T10:02:49.598639+0000","last_became_peered":"2024-04-25T10:02:49.598639+0000","last_unstale":"2024-04-25T10:02:50.585083+0000","last_undegraded":"2024-04-25T10:02:50.585083+0000","last_fullsized":"2024-04-25T10:02:50.585083+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:49:12.699773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.583769+0000","last_change":"2024-04-25T10:02:49.583769+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.583769+0000","last_undegraded":"2024-04-25T10:02:49.583769+0000","last_fullsized":"2024-04-25T10:02:49.583769+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.590806+0000","last_change":"2024-04-25T10:02:49.589456+0000","last_active":"2024-04-25T10:02:49.590806+0000","last_peered":"2024-04-25T10:02:49.590806+0000","last_clean":"2024-04-25T10:02:49.590806+0000","last_became_active":"2024-04-25T10:02:49.589179+0000","last_became_peered":"2024-04-25T10:02:49.589179+0000","last_unstale":"2024-04-25T10:02:49.590806+0000","last_undegraded":"2024-04-25T10:02:49.590806+0000","last_fullsized":"2024-04-25T10:02:49.590806+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:54.456889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585585+0000","last_change":"2024-04-25T10:02:49.585585+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585585+0000","last_undegraded":"2024-04-25T10:02:49.585585+0000","last_fullsized":"2024-04-25T10:02:49.585585+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.585540+0000","last_change":"2024-04-25T10:02:49.599488+0000","last_active":"2024-04-25T10:02:50.585540+0000","last_peered":"2024-04-25T10:02:50.585540+0000","last_clean":"2024-04-25T10:02:50.585540+0000","last_became_active":"2024-04-25T10:02:49.599195+0000","last_became_peered":"2024-04-25T10:02:49.599195+0000","last_unstale":"2024-04-25T10:02:50.585540+0000","last_undegraded":"2024-04-25T10:02:50.585540+0000","last_fullsized":"2024-04-25T10:02:50.585540+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:15.089501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.587749+0000","last_change":"2024-04-25T10:02:49.587749+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.587749+0000","last_undegraded":"2024-04-25T10:02:49.587749+0000","last_fullsized":"2024-04-25T10:02:49.587749+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.600981+0000","last_change":"2024-04-25T10:02:49.600228+0000","last_active":"2024-04-25T10:02:49.600981+0000","last_peered":"2024-04-25T10:02:49.600981+0000","last_clean":"2024-04-25T10:02:49.600981+0000","last_became_active":"2024-04-25T10:02:49.599938+0000","last_became_peered":"2024-04-25T10:02:49.599938+0000","last_unstale":"2024-04-25T10:02:49.600981+0000","last_undegraded":"2024-04-25T10:02:49.600981+0000","last_fullsized":"2024-04-25T10:02:49.600981+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:36.517034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.593715+0000","last_change":"2024-04-25T10:02:49.593715+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.593715+0000","last_undegraded":"2024-04-25T10:02:49.593715+0000","last_fullsized":"2024-04-25T10:02:49.593715+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"102'3","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.615029+0000","last_change":"2024-04-25T10:02:49.595272+0000","last_active":"2024-04-25T10:02:50.615029+0000","last_peered":"2024-04-25T10:02:50.615029+0000","last_clean":"2024-04-25T10:02:50.615029+0000","last_became_active":"2024-04-25T10:02:49.594964+0000","last_became_peered":"2024-04-25T10:02:49.594964+0000","last_unstale":"2024-04-25T10:02:50.615029+0000","last_undegraded":"2024-04-25T10:02:50.615029+0000","last_fullsized":"2024-04-25T10:02:50.615029+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:04:50.351393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.586617+0000","last_change":"2024-04-25T10:02:49.586617+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.586617+0000","last_undegraded":"2024-04-25T10:02:49.586617+0000","last_fullsized":"2024-04-25T10:02:49.586617+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"102'6","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.622147+0000","last_change":"2024-04-25T10:02:49.596547+0000","last_active":"2024-04-25T10:02:50.622147+0000","last_peered":"2024-04-25T10:02:50.622147+0000","last_clean":"2024-04-25T10:02:50.622147+0000","last_became_active":"2024-04-25T10:02:49.596273+0000","last_became_peered":"2024-04-25T10:02:49.596273+0000","last_unstale":"2024-04-25T10:02:50.622147+0000","last_undegraded":"2024-04-25T10:02:50.622147+0000","last_fullsized":"2024-04-25T10:02:50.622147+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:28.059919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.617363+0000","last_change":"2024-04-25T10:02:50.609769+0000","last_active":"2024-04-25T10:02:50.617363+0000","last_peered":"2024-04-25T10:02:50.617363+0000","last_clean":"2024-04-25T10:02:50.617363+0000","last_became_active":"2024-04-25T10:02:50.609239+0000","last_became_peered":"2024-04-25T10:02:50.609239+0000","last_unstale":"2024-04-25T10:02:50.617363+0000","last_undegraded":"2024-04-25T10:02:50.617363+0000","last_fullsized":"2024-04-25T10:02:50.617363+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:55.468154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.599594+0000","last_change":"2024-04-25T10:02:49.598214+0000","last_active":"2024-04-25T10:02:49.599594+0000","last_peered":"2024-04-25T10:02:49.599594+0000","last_clean":"2024-04-25T10:02:49.599594+0000","last_became_active":"2024-04-25T10:02:49.597943+0000","last_became_peered":"2024-04-25T10:02:49.597943+0000","last_unstale":"2024-04-25T10:02:49.599594+0000","last_undegraded":"2024-04-25T10:02:49.599594+0000","last_fullsized":"2024-04-25T10:02:49.599594+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:05:23.495102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.608468+0000","last_change":"2024-04-25T10:02:50.600485+0000","last_active":"2024-04-25T10:02:50.608468+0000","last_peered":"2024-04-25T10:02:50.608468+0000","last_clean":"2024-04-25T10:02:50.608468+0000","last_became_active":"2024-04-25T10:02:50.600156+0000","last_became_peered":"2024-04-25T10:02:50.600156+0000","last_unstale":"2024-04-25T10:02:50.608468+0000","last_undegraded":"2024-04-25T10:02:50.608468+0000","last_fullsized":"2024-04-25T10:02:50.608468+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:17.706322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.595028+0000","last_change":"2024-04-25T10:02:49.594284+0000","last_active":"2024-04-25T10:02:49.595028+0000","last_peered":"2024-04-25T10:02:49.595028+0000","last_clean":"2024-04-25T10:02:49.595028+0000","last_became_active":"2024-04-25T10:02:49.593996+0000","last_became_peered":"2024-04-25T10:02:49.593996+0000","last_unstale":"2024-04-25T10:02:49.595028+0000","last_undegraded":"2024-04-25T10:02:49.595028+0000","last_fullsized":"2024-04-25T10:02:49.595028+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:16.312918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.594191+0000","last_change":"2024-04-25T10:02:49.594191+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.594191+0000","last_undegraded":"2024-04-25T10:02:49.594191+0000","last_fullsized":"2024-04-25T10:02:49.594191+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.604212+0000","last_change":"2024-04-25T10:02:49.603609+0000","last_active":"2024-04-25T10:02:49.604212+0000","last_peered":"2024-04-25T10:02:49.604212+0000","last_clean":"2024-04-25T10:02:49.604212+0000","last_became_active":"2024-04-25T10:02:49.603297+0000","last_became_peered":"2024-04-25T10:02:49.603297+0000","last_unstale":"2024-04-25T10:02:49.604212+0000","last_undegraded":"2024-04-25T10:02:49.604212+0000","last_fullsized":"2024-04-25T10:02:49.604212+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:44.744796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.584331+0000","last_change":"2024-04-25T10:02:49.584331+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.584331+0000","last_undegraded":"2024-04-25T10:02:49.584331+0000","last_fullsized":"2024-04-25T10:02:49.584331+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"102'8","reported_seq":20,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.618329+0000","last_change":"2024-04-25T10:02:49.598951+0000","last_active":"2024-04-25T10:02:50.618329+0000","last_peered":"2024-04-25T10:02:50.618329+0000","last_clean":"2024-04-25T10:02:50.618329+0000","last_became_active":"2024-04-25T10:02:49.598508+0000","last_became_peered":"2024-04-25T10:02:49.598508+0000","last_unstale":"2024-04-25T10:02:50.618329+0000","last_undegraded":"2024-04-25T10:02:50.618329+0000","last_fullsized":"2024-04-25T10:02:50.618329+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:34:24.518681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.592454+0000","last_change":"2024-04-25T10:02:49.592454+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.592454+0000","last_undegraded":"2024-04-25T10:02:49.592454+0000","last_fullsized":"2024-04-25T10:02:49.592454+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"102'1","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.617905+0000","last_change":"2024-04-25T10:02:49.605550+0000","last_active":"2024-04-25T10:02:50.617905+0000","last_peered":"2024-04-25T10:02:50.617905+0000","last_clean":"2024-04-25T10:02:50.617905+0000","last_became_active":"2024-04-25T10:02:49.605242+0000","last_became_peered":"2024-04-25T10:02:49.605242+0000","last_unstale":"2024-04-25T10:02:50.617905+0000","last_undegraded":"2024-04-25T10:02:50.617905+0000","last_fullsized":"2024-04-25T10:02:50.617905+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:41.634104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613130+0000","last_change":"2024-04-25T10:02:50.605531+0000","last_active":"2024-04-25T10:02:50.613130+0000","last_peered":"2024-04-25T10:02:50.613130+0000","last_clean":"2024-04-25T10:02:50.613130+0000","last_became_active":"2024-04-25T10:02:50.605229+0000","last_became_peered":"2024-04-25T10:02:50.605229+0000","last_unstale":"2024-04-25T10:02:50.613130+0000","last_undegraded":"2024-04-25T10:02:50.613130+0000","last_fullsized":"2024-04-25T10:02:50.613130+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:07.989371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"102'1","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613455+0000","last_change":"2024-04-25T10:02:49.599107+0000","last_active":"2024-04-25T10:02:50.613455+0000","last_peered":"2024-04-25T10:02:50.613455+0000","last_clean":"2024-04-25T10:02:50.613455+0000","last_became_active":"2024-04-25T10:02:49.598627+0000","last_became_peered":"2024-04-25T10:02:49.598627+0000","last_unstale":"2024-04-25T10:02:50.613455+0000","last_undegraded":"2024-04-25T10:02:50.613455+0000","last_fullsized":"2024-04-25T10:02:50.613455+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:58.452441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.587028+0000","last_change":"2024-04-25T10:02:49.587028+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.587028+0000","last_undegraded":"2024-04-25T10:02:49.587028+0000","last_fullsized":"2024-04-25T10:02:49.587028+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.590432+0000","last_change":"2024-04-25T10:02:49.600728+0000","last_active":"2024-04-25T10:02:50.590432+0000","last_peered":"2024-04-25T10:02:50.590432+0000","last_clean":"2024-04-25T10:02:50.590432+0000","last_became_active":"2024-04-25T10:02:49.600439+0000","last_became_peered":"2024-04-25T10:02:49.600439+0000","last_unstale":"2024-04-25T10:02:50.590432+0000","last_undegraded":"2024-04-25T10:02:50.590432+0000","last_fullsized":"2024-04-25T10:02:50.590432+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:58.201064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.584662+0000","last_change":"2024-04-25T10:02:49.584662+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.584662+0000","last_undegraded":"2024-04-25T10:02:49.584662+0000","last_fullsized":"2024-04-25T10:02:49.584662+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.603838+0000","last_change":"2024-04-25T10:02:49.603196+0000","last_active":"2024-04-25T10:02:49.603838+0000","last_peered":"2024-04-25T10:02:49.603838+0000","last_clean":"2024-04-25T10:02:49.603838+0000","last_became_active":"2024-04-25T10:02:49.602809+0000","last_became_peered":"2024-04-25T10:02:49.602809+0000","last_unstale":"2024-04-25T10:02:49.603838+0000","last_undegraded":"2024-04-25T10:02:49.603838+0000","last_fullsized":"2024-04-25T10:02:49.603838+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:34.725327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.584993+0000","last_change":"2024-04-25T10:02:49.584993+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.584993+0000","last_undegraded":"2024-04-25T10:02:49.584993+0000","last_fullsized":"2024-04-25T10:02:49.584993+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.603096+0000","last_change":"2024-04-25T10:02:49.602636+0000","last_active":"2024-04-25T10:02:49.603096+0000","last_peered":"2024-04-25T10:02:49.603096+0000","last_clean":"2024-04-25T10:02:49.603096+0000","last_became_active":"2024-04-25T10:02:49.602376+0000","last_became_peered":"2024-04-25T10:02:49.602376+0000","last_unstale":"2024-04-25T10:02:49.603096+0000","last_undegraded":"2024-04-25T10:02:49.603096+0000","last_fullsized":"2024-04-25T10:02:49.603096+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:10.084009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.583767+0000","last_change":"2024-04-25T10:02:49.583767+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.583767+0000","last_undegraded":"2024-04-25T10:02:49.583767+0000","last_fullsized":"2024-04-25T10:02:49.583767+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.595549+0000","last_change":"2024-04-25T10:02:49.596692+0000","last_active":"2024-04-25T10:02:50.595549+0000","last_peered":"2024-04-25T10:02:50.595549+0000","last_clean":"2024-04-25T10:02:50.595549+0000","last_became_active":"2024-04-25T10:02:49.596371+0000","last_became_peered":"2024-04-25T10:02:49.596371+0000","last_unstale":"2024-04-25T10:02:50.595549+0000","last_undegraded":"2024-04-25T10:02:50.595549+0000","last_fullsized":"2024-04-25T10:02:50.595549+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:09.504320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.593530+0000","last_change":"2024-04-25T10:02:49.593530+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.593530+0000","last_undegraded":"2024-04-25T10:02:49.593530+0000","last_fullsized":"2024-04-25T10:02:49.593530+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.598418+0000","last_change":"2024-04-25T10:02:49.596751+0000","last_active":"2024-04-25T10:02:49.598418+0000","last_peered":"2024-04-25T10:02:49.598418+0000","last_clean":"2024-04-25T10:02:49.598418+0000","last_became_active":"2024-04-25T10:02:49.596497+0000","last_became_peered":"2024-04-25T10:02:49.596497+0000","last_unstale":"2024-04-25T10:02:49.598418+0000","last_undegraded":"2024-04-25T10:02:49.598418+0000","last_fullsized":"2024-04-25T10:02:49.598418+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:55.785270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585994+0000","last_change":"2024-04-25T10:02:49.585994+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585994+0000","last_undegraded":"2024-04-25T10:02:49.585994+0000","last_fullsized":"2024-04-25T10:02:49.585994+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.600871+0000","last_change":"2024-04-25T10:02:49.597614+0000","last_active":"2024-04-25T10:02:49.600871+0000","last_peered":"2024-04-25T10:02:49.600871+0000","last_clean":"2024-04-25T10:02:49.600871+0000","last_became_active":"2024-04-25T10:02:49.597315+0000","last_became_peered":"2024-04-25T10:02:49.597315+0000","last_unstale":"2024-04-25T10:02:49.600871+0000","last_undegraded":"2024-04-25T10:02:49.600871+0000","last_fullsized":"2024-04-25T10:02:49.600871+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:54.318211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.598481+0000","last_change":"2024-04-25T10:02:50.597174+0000","last_active":"2024-04-25T10:02:50.598481+0000","last_peered":"2024-04-25T10:02:50.598481+0000","last_clean":"2024-04-25T10:02:50.598481+0000","last_became_active":"2024-04-25T10:02:50.596881+0000","last_became_peered":"2024-04-25T10:02:50.596881+0000","last_unstale":"2024-04-25T10:02:50.598481+0000","last_undegraded":"2024-04-25T10:02:50.598481+0000","last_fullsized":"2024-04-25T10:02:50.598481+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:29:23.799255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.597653+0000","last_change":"2024-04-25T10:02:49.595969+0000","last_active":"2024-04-25T10:02:49.597653+0000","last_peered":"2024-04-25T10:02:49.597653+0000","last_clean":"2024-04-25T10:02:49.597653+0000","last_became_active":"2024-04-25T10:02:49.595693+0000","last_became_peered":"2024-04-25T10:02:49.595693+0000","last_unstale":"2024-04-25T10:02:49.597653+0000","last_undegraded":"2024-04-25T10:02:49.597653+0000","last_fullsized":"2024-04-25T10:02:49.597653+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:14.963530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.583995+0000","last_change":"2024-04-25T10:02:49.583995+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.583995+0000","last_undegraded":"2024-04-25T10:02:49.583995+0000","last_fullsized":"2024-04-25T10:02:49.583995+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.596214+0000","last_change":"2024-04-25T10:02:49.593862+0000","last_active":"2024-04-25T10:02:50.596214+0000","last_peered":"2024-04-25T10:02:50.596214+0000","last_clean":"2024-04-25T10:02:50.596214+0000","last_became_active":"2024-04-25T10:02:49.593554+0000","last_became_peered":"2024-04-25T10:02:49.593554+0000","last_unstale":"2024-04-25T10:02:50.596214+0000","last_undegraded":"2024-04-25T10:02:50.596214+0000","last_fullsized":"2024-04-25T10:02:50.596214+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:33.837038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.603964+0000","last_change":"2024-04-25T10:02:50.601221+0000","last_active":"2024-04-25T10:02:50.603964+0000","last_peered":"2024-04-25T10:02:50.603964+0000","last_clean":"2024-04-25T10:02:50.603964+0000","last_became_active":"2024-04-25T10:02:50.600909+0000","last_became_peered":"2024-04-25T10:02:50.600909+0000","last_unstale":"2024-04-25T10:02:50.603964+0000","last_undegraded":"2024-04-25T10:02:50.603964+0000","last_fullsized":"2024-04-25T10:02:50.603964+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:46.085984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.601700+0000","last_change":"2024-04-25T10:02:49.600863+0000","last_active":"2024-04-25T10:02:49.601700+0000","last_peered":"2024-04-25T10:02:49.601700+0000","last_clean":"2024-04-25T10:02:49.601700+0000","last_became_active":"2024-04-25T10:02:49.600571+0000","last_became_peered":"2024-04-25T10:02:49.600571+0000","last_unstale":"2024-04-25T10:02:49.601700+0000","last_undegraded":"2024-04-25T10:02:49.601700+0000","last_fullsized":"2024-04-25T10:02:49.601700+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:42.042387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.593132+0000","last_change":"2024-04-25T10:02:49.593132+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.593132+0000","last_undegraded":"2024-04-25T10:02:49.593132+0000","last_fullsized":"2024-04-25T10:02:49.593132+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.583742+0000","last_change":"2024-04-25T10:02:49.601012+0000","last_active":"2024-04-25T10:02:50.583742+0000","last_peered":"2024-04-25T10:02:50.583742+0000","last_clean":"2024-04-25T10:02:50.583742+0000","last_became_active":"2024-04-25T10:02:49.600731+0000","last_became_peered":"2024-04-25T10:02:49.600731+0000","last_unstale":"2024-04-25T10:02:50.583742+0000","last_undegraded":"2024-04-25T10:02:50.583742+0000","last_fullsized":"2024-04-25T10:02:50.583742+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:12.373559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.592072+0000","last_change":"2024-04-25T10:02:49.592072+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.592072+0000","last_undegraded":"2024-04-25T10:02:49.592072+0000","last_fullsized":"2024-04-25T10:02:49.592072+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.602217+0000","last_change":"2024-04-25T10:02:49.600898+0000","last_active":"2024-04-25T10:02:49.602217+0000","last_peered":"2024-04-25T10:02:49.602217+0000","last_clean":"2024-04-25T10:02:49.602217+0000","last_became_active":"2024-04-25T10:02:49.600598+0000","last_became_peered":"2024-04-25T10:02:49.600598+0000","last_unstale":"2024-04-25T10:02:49.602217+0000","last_undegraded":"2024-04-25T10:02:49.602217+0000","last_fullsized":"2024-04-25T10:02:49.602217+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:03.344877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.603429+0000","last_change":"2024-04-25T10:02:50.602017+0000","last_active":"2024-04-25T10:02:50.603429+0000","last_peered":"2024-04-25T10:02:50.603429+0000","last_clean":"2024-04-25T10:02:50.603429+0000","last_became_active":"2024-04-25T10:02:50.601702+0000","last_became_peered":"2024-04-25T10:02:50.601702+0000","last_unstale":"2024-04-25T10:02:50.603429+0000","last_undegraded":"2024-04-25T10:02:50.603429+0000","last_fullsized":"2024-04-25T10:02:50.603429+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:36.647239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.595712+0000","last_change":"2024-04-25T10:02:49.592618+0000","last_active":"2024-04-25T10:02:50.595712+0000","last_peered":"2024-04-25T10:02:50.595712+0000","last_clean":"2024-04-25T10:02:50.595712+0000","last_became_active":"2024-04-25T10:02:49.592337+0000","last_became_peered":"2024-04-25T10:02:49.592337+0000","last_unstale":"2024-04-25T10:02:50.595712+0000","last_undegraded":"2024-04-25T10:02:50.595712+0000","last_fullsized":"2024-04-25T10:02:50.595712+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:37.202053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.601041+0000","last_change":"2024-04-25T10:02:50.593723+0000","last_active":"2024-04-25T10:02:50.601041+0000","last_peered":"2024-04-25T10:02:50.601041+0000","last_clean":"2024-04-25T10:02:50.601041+0000","last_became_active":"2024-04-25T10:02:50.593409+0000","last_became_peered":"2024-04-25T10:02:50.593409+0000","last_unstale":"2024-04-25T10:02:50.601041+0000","last_undegraded":"2024-04-25T10:02:50.601041+0000","last_fullsized":"2024-04-25T10:02:50.601041+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:44:14.466542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.602152+0000","last_change":"2024-04-25T10:02:49.599898+0000","last_active":"2024-04-25T10:02:49.602152+0000","last_peered":"2024-04-25T10:02:49.602152+0000","last_clean":"2024-04-25T10:02:49.602152+0000","last_became_active":"2024-04-25T10:02:49.599612+0000","last_became_peered":"2024-04-25T10:02:49.599612+0000","last_unstale":"2024-04-25T10:02:49.602152+0000","last_undegraded":"2024-04-25T10:02:49.602152+0000","last_fullsized":"2024-04-25T10:02:49.602152+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:05:42.694860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.612908+0000","last_change":"2024-04-25T10:02:50.605854+0000","last_active":"2024-04-25T10:02:50.612908+0000","last_peered":"2024-04-25T10:02:50.612908+0000","last_clean":"2024-04-25T10:02:50.612908+0000","last_became_active":"2024-04-25T10:02:50.605508+0000","last_became_peered":"2024-04-25T10:02:50.605508+0000","last_unstale":"2024-04-25T10:02:50.612908+0000","last_undegraded":"2024-04-25T10:02:50.612908+0000","last_fullsized":"2024-04-25T10:02:50.612908+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:28.150965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.598822+0000","last_change":"2024-04-25T10:02:49.598137+0000","last_active":"2024-04-25T10:02:49.598822+0000","last_peered":"2024-04-25T10:02:49.598822+0000","last_clean":"2024-04-25T10:02:49.598822+0000","last_became_active":"2024-04-25T10:02:49.597841+0000","last_became_peered":"2024-04-25T10:02:49.597841+0000","last_unstale":"2024-04-25T10:02:49.598822+0000","last_undegraded":"2024-04-25T10:02:49.598822+0000","last_fullsized":"2024-04-25T10:02:49.598822+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:42.504597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":321,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.587486+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T10:02:50.587486+0000","last_peered":"2024-04-25T10:02:50.587486+0000","last_clean":"2024-04-25T10:02:50.587486+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T10:02:50.587486+0000","last_undegraded":"2024-04-25T10:02:50.587486+0000","last_fullsized":"2024-04-25T10:02:50.587486+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":1794,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23,"ondisk_log_size":23,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542250,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33008,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338832,"statfs":{"total":96636764160,"available":96602963968,"internally_reserved":0,"allocated":1863680,"data_stored":1174185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542250,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1249280,"data_stored":576490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542252,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1261568,"data_stored":583657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542249,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1249280,"data_stored":576490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574954,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1236992,"data_stored":569823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1236992,"data_stored":569823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1249280,"data_stored":576490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574954,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32988,"kb_used_data":1800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338852,"statfs":{"total":96636764160,"available":96602984448,"internally_reserved":0,"allocated":1843200,"data_stored":1166858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:02:53.952 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:02:54.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.086+0000 7fb6a6fed640 1 Processor -- start 2024-04-25T10:02:54.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.086+0000 7fb6a6fed640 1 -- start start 2024-04-25T10:02:54.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.086+0000 7fb6a6fed640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb6a0145260 0x7fb6a00726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:54.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.086+0000 7fb6a6fed640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb6a006b270 0x7fb6a015d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:54.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.086+0000 7fb6a6fed640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6a015cd50 con 0x7fb6a015c8f0 2024-04-25T10:02:54.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.086+0000 7fb6a6fed640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6a0160110 con 0x7fb6a006b270 2024-04-25T10:02:54.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.086+0000 7fb6a6fed640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a015f500 con 0x7fb6a0145260 2024-04-25T10:02:54.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.087+0000 7fb69ffff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb6a015c8f0 0x7fb6a006ab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35600/0 (socket says 172.21.15.7:35600) 2024-04-25T10:02:54.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.087+0000 7fb69ffff640 1 -- 172.21.15.7:0/3426209079 learned_addr learned my addr 172.21.15.7:0/3426209079 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:02:54.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.087+0000 7fb6a558a640 1 --2- 172.21.15.7:0/3426209079 >> v2:172.21.15.55:3300/0 conn(0x7fb6a006b270 0x7fb6a015d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:54.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.087+0000 7fb69f7fe640 1 -- 172.21.15.7:0/3426209079 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4059558102 0 0) 0x7fb6a015cd50 con 0x7fb6a015c8f0 2024-04-25T10:02:54.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.087+0000 7fb6a4d89640 1 --2- 172.21.15.7:0/3426209079 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb6a0145260 0x7fb6a00726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:54.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.087+0000 7fb69f7fe640 1 -- 172.21.15.7:0/3426209079 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb690003520 con 0x7fb6a015c8f0 2024-04-25T10:02:54.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.087+0000 7fb69f7fe640 1 -- 172.21.15.7:0/3426209079 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3054269291 0 0) 0x7fb690003520 con 0x7fb6a015c8f0 2024-04-25T10:02:54.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.087+0000 7fb69f7fe640 1 -- 172.21.15.7:0/3426209079 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb6a0145260 msgr2=0x7fb6a00726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:54.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.087+0000 7fb69f7fe640 1 --2- 172.21.15.7:0/3426209079 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb6a0145260 0x7fb6a00726e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:54.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.087+0000 7fb69f7fe640 1 -- 172.21.15.7:0/3426209079 >> v2:172.21.15.55:3300/0 conn(0x7fb6a006b270 msgr2=0x7fb6a015d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:54.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.087+0000 7fb69f7fe640 1 --2- 172.21.15.7:0/3426209079 >> v2:172.21.15.55:3300/0 conn(0x7fb6a006b270 0x7fb6a015d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:54.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.087+0000 7fb69f7fe640 1 -- 172.21.15.7:0/3426209079 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a015f7e0 con 0x7fb6a015c8f0 2024-04-25T10:02:54.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.087+0000 7fb69f7fe640 1 -- 172.21.15.7:0/3426209079 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fb68c001670 con 0x7fb6a015c8f0 2024-04-25T10:02:54.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.087+0000 7fb69f7fe640 1 -- 172.21.15.7:0/3426209079 >> v1:172.21.15.7:6789/0 conn(0x7fb6a015c8f0 legacy=0x7fb6a006ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:54.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.087+0000 7fb69f7fe640 1 --2- 172.21.15.7:0/3426209079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6900039b0 0x7fb690003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:54.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.087+0000 7fb69f7fe640 1 --2- 172.21.15.7:0/3426209079 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb6a0145260 0x7fb690004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:54.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.087+0000 7fb69f7fe640 1 --2- 172.21.15.7:0/3426209079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb690004d40 0x7fb6900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:54.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.087+0000 7fb69f7fe640 1 -- 172.21.15.7:0/3426209079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a015f500 con 0x7fb690004d40 2024-04-25T10:02:54.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.087+0000 7fb69f7fe640 1 -- 172.21.15.7:0/3426209079 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69000b9c0 con 0x7fb6900039b0 2024-04-25T10:02:54.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.087+0000 7fb69f7fe640 1 -- 172.21.15.7:0/3426209079 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb69000bb40 con 0x7fb6a0145260 2024-04-25T10:02:54.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.087+0000 7fb6a558a640 1 --2- 172.21.15.7:0/3426209079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb690004d40 0x7fb6900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:54.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.087+0000 7fb6a4d89640 1 --2- 172.21.15.7:0/3426209079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6900039b0 0x7fb690003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:54.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.087+0000 7fb69ffff640 1 --2- 172.21.15.7:0/3426209079 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb6a0145260 0x7fb690004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:54.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.088+0000 7fb6a558a640 1 -- 172.21.15.7:0/3426209079 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb6a0145260 msgr2=0x7fb690004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:54.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.088+0000 7fb6a558a640 1 --2- 172.21.15.7:0/3426209079 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb6a0145260 0x7fb690004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:54.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.088+0000 7fb6a558a640 1 -- 172.21.15.7:0/3426209079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6900039b0 msgr2=0x7fb690003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:54.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.088+0000 7fb6a558a640 1 --2- 172.21.15.7:0/3426209079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6900039b0 0x7fb690003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:54.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.088+0000 7fb6a558a640 1 -- 172.21.15.7:0/3426209079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb690003520 con 0x7fb690004d40 2024-04-25T10:02:54.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.088+0000 7fb6a558a640 1 --2- 172.21.15.7:0/3426209079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb690004d40 0x7fb6900051c0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fb698009fc0 tx=0x7fb690005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e155da001164059 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:54.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.088+0000 7fb69f7fe640 1 -- 172.21.15.7:0/3426209079 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb698009c10 con 0x7fb690004d40 2024-04-25T10:02:54.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.088+0000 7fb69f7fe640 1 -- 172.21.15.7:0/3426209079 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb698036070 con 0x7fb690004d40 2024-04-25T10:02:54.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.088+0000 7fb69f7fe640 1 -- 172.21.15.7:0/3426209079 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69802d070 con 0x7fb690004d40 2024-04-25T10:02:54.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.089+0000 7fb6a6fed640 1 -- 172.21.15.7:0/3426209079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb690004d40 msgr2=0x7fb6900051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:54.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.089+0000 7fb6a6fed640 1 --2- 172.21.15.7:0/3426209079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb690004d40 0x7fb6900051c0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fb698009fc0 tx=0x7fb690005830 comp rx=0 tx=0).stop 2024-04-25T10:02:54.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.089+0000 7fb6a558a640 1 -- 172.21.15.7:0/3426209079 reap_dead start 2024-04-25T10:02:54.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.089+0000 7fb6a6fed640 1 -- 172.21.15.7:0/3426209079 shutdown_connections 2024-04-25T10:02:54.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.089+0000 7fb6a6fed640 1 -- 172.21.15.7:0/3426209079 >> 172.21.15.7:0/3426209079 conn(0x7fb6a00b5c30 msgr2=0x7fb6a00999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:54.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.089+0000 7fb6a6fed640 1 -- 172.21.15.7:0/3426209079 shutdown_connections 2024-04-25T10:02:54.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.089+0000 7fb6a6fed640 1 -- 172.21.15.7:0/3426209079 wait complete. 2024-04-25T10:02:54.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.090+0000 7fb6a6fed640 1 Processor -- start 2024-04-25T10:02:54.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.090+0000 7fb6a6fed640 1 -- start start 2024-04-25T10:02:54.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.091+0000 7fb6a6fed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb690004d40 0x7fb6a015b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:54.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.091+0000 7fb6a6fed640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb6a00b3b70 0x7fb6a00b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:54.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.091+0000 7fb6a6fed640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6a009cac0 0x7fb6a009cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:54.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.091+0000 7fb6a6fed640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a00726e0 con 0x7fb690004d40 2024-04-25T10:02:54.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.091+0000 7fb6a6fed640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a015fda0 con 0x7fb6a009cac0 2024-04-25T10:02:54.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.091+0000 7fb6a6fed640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a0072860 con 0x7fb6a00b3b70 2024-04-25T10:02:54.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.091+0000 7fb6a4d89640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb690004d40 0x7fb6a015b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:54.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.091+0000 7fb6a4d89640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb690004d40 0x7fb6a015b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44220/0 (socket says 172.21.15.7:44220) 2024-04-25T10:02:54.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.091+0000 7fb6a4d89640 1 -- 172.21.15.7:0/3723059133 learned_addr learned my addr 172.21.15.7:0/3723059133 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:54.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.091+0000 7fb6a558a640 1 --2- 172.21.15.7:0/3723059133 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6a009cac0 0x7fb6a009cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:54.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.091+0000 7fb69ffff640 1 --2- 172.21.15.7:0/3723059133 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb6a00b3b70 0x7fb6a00b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:54.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.092+0000 7fb6a4d89640 1 -- 172.21.15.7:0/3723059133 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb6a00b3b70 msgr2=0x7fb6a00b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:54.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.092+0000 7fb6a4d89640 1 --2- 172.21.15.7:0/3723059133 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb6a00b3b70 0x7fb6a00b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:54.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.092+0000 7fb6a4d89640 1 -- 172.21.15.7:0/3723059133 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6a009cac0 msgr2=0x7fb6a009cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:54.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.092+0000 7fb6a4d89640 1 --2- 172.21.15.7:0/3723059133 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6a009cac0 0x7fb6a009cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:54.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.092+0000 7fb6a4d89640 1 -- 172.21.15.7:0/3723059133 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a00b4730 con 0x7fb690004d40 2024-04-25T10:02:54.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.092+0000 7fb6a4d89640 1 --2- 172.21.15.7:0/3723059133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb690004d40 0x7fb6a015b080 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fb694011a00 tx=0x7fb694011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:54.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.092+0000 7fb69d7fa640 1 -- 172.21.15.7:0/3723059133 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69400fb50 con 0x7fb690004d40 2024-04-25T10:02:54.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.092+0000 7fb69d7fa640 1 -- 172.21.15.7:0/3723059133 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69400fcf0 con 0x7fb690004d40 2024-04-25T10:02:54.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.092+0000 7fb6a6fed640 1 -- 172.21.15.7:0/3723059133 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a00b4a10 con 0x7fb690004d40 2024-04-25T10:02:54.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.092+0000 7fb69d7fa640 1 -- 172.21.15.7:0/3723059133 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69400fea0 con 0x7fb690004d40 2024-04-25T10:02:54.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.092+0000 7fb6a6fed640 1 -- 172.21.15.7:0/3723059133 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a009ab10 con 0x7fb690004d40 2024-04-25T10:02:54.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.093+0000 7fb6a6fed640 1 -- 172.21.15.7:0/3723059133 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a0068fd0 con 0x7fb690004d40 2024-04-25T10:02:54.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.093+0000 7fb69d7fa640 1 -- 172.21.15.7:0/3723059133 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb694012040 con 0x7fb690004d40 2024-04-25T10:02:54.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.094+0000 7fb69d7fa640 1 --2- 172.21.15.7:0/3723059133 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb68406b500 0x7fb68406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:54.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.094+0000 7fb69d7fa640 1 -- 172.21.15.7:0/3723059133 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb69408a860 con 0x7fb690004d40 2024-04-25T10:02:54.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.094+0000 7fb69ffff640 1 --2- 172.21.15.7:0/3723059133 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb68406b500 0x7fb68406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:54.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.094+0000 7fb69ffff640 1 --2- 172.21.15.7:0/3723059133 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb68406b500 0x7fb68406d9c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb6a009c720 tx=0x7fb68c0078f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:54.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.098+0000 7fb69d7fa640 1 -- 172.21.15.7:0/3723059133 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb694019030 con 0x7fb690004d40 2024-04-25T10:02:54.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.275+0000 7fb6a6fed640 1 -- 172.21.15.7:0/3723059133 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb6a01403b0 con 0x7fb68406b500 2024-04-25T10:02:54.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.280+0000 7fb69d7fa640 1 -- 172.21.15.7:0/3723059133 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249440 (secure 0 0 0) 0x7fb68c007690 con 0x7fb68406b500 2024-04-25T10:02:54.288 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:02:54.289 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T10:02:54.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.283+0000 7fb6a6fed640 1 -- 172.21.15.7:0/3723059133 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb68406b500 msgr2=0x7fb68406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:54.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.283+0000 7fb6a6fed640 1 --2- 172.21.15.7:0/3723059133 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb68406b500 0x7fb68406d9c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb6a009c720 tx=0x7fb68c0078f0 comp rx=0 tx=0).stop 2024-04-25T10:02:54.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.283+0000 7fb6a6fed640 1 -- 172.21.15.7:0/3723059133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb690004d40 msgr2=0x7fb6a015b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:54.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.283+0000 7fb6a6fed640 1 --2- 172.21.15.7:0/3723059133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb690004d40 0x7fb6a015b080 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fb694011a00 tx=0x7fb694011ec0 comp rx=0 tx=0).stop 2024-04-25T10:02:54.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.283+0000 7fb6a6fed640 1 -- 172.21.15.7:0/3723059133 shutdown_connections 2024-04-25T10:02:54.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.283+0000 7fb6a6fed640 1 --2- 172.21.15.7:0/3723059133 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb68406b500 0x7fb68406d9c0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:54.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.283+0000 7fb6a6fed640 1 --2- 172.21.15.7:0/3723059133 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6a009cac0 0x7fb6a009cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:54.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.283+0000 7fb6a6fed640 1 --2- 172.21.15.7:0/3723059133 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb6a00b3b70 0x7fb6a00b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:54.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.283+0000 7fb6a6fed640 1 --2- 172.21.15.7:0/3723059133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb690004d40 0x7fb6a015b080 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:54.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.283+0000 7fb6a6fed640 1 -- 172.21.15.7:0/3723059133 >> 172.21.15.7:0/3723059133 conn(0x7fb6a00b5c30 msgr2=0x7fb6a00cf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:54.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.284+0000 7fb6a6fed640 1 -- 172.21.15.7:0/3723059133 shutdown_connections 2024-04-25T10:02:54.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.284+0000 7fb6a6fed640 1 -- 172.21.15.7:0/3723059133 wait complete. 2024-04-25T10:02:54.299 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":356,"stamp":"2024-04-25T10:02:53.971304+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592162,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":186,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":75,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260416,"kb_used_data":10928,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714304,"statfs":{"total":773094113280,"available":772827447296,"internally_reserved":0,"allocated":11190272,"data_stored":5793816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1794,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.407631"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585616+0000","last_change":"2024-04-25T10:02:49.585616+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585616+0000","last_undegraded":"2024-04-25T10:02:49.585616+0000","last_fullsized":"2024-04-25T10:02:49.585616+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.608577+0000","last_change":"2024-04-25T10:02:50.603031+0000","last_active":"2024-04-25T10:02:50.608577+0000","last_peered":"2024-04-25T10:02:50.608577+0000","last_clean":"2024-04-25T10:02:50.608577+0000","last_became_active":"2024-04-25T10:02:50.602748+0000","last_became_peered":"2024-04-25T10:02:50.602748+0000","last_unstale":"2024-04-25T10:02:50.608577+0000","last_undegraded":"2024-04-25T10:02:50.608577+0000","last_fullsized":"2024-04-25T10:02:50.608577+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:16.100766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585815+0000","last_change":"2024-04-25T10:02:49.585815+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585815+0000","last_undegraded":"2024-04-25T10:02:49.585815+0000","last_fullsized":"2024-04-25T10:02:49.585815+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.584483+0000","last_change":"2024-04-25T10:02:49.584483+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.584483+0000","last_undegraded":"2024-04-25T10:02:49.584483+0000","last_fullsized":"2024-04-25T10:02:49.584483+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.587454+0000","last_change":"2024-04-25T10:02:49.587454+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.587454+0000","last_undegraded":"2024-04-25T10:02:49.587454+0000","last_fullsized":"2024-04-25T10:02:49.587454+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.608539+0000","last_change":"2024-04-25T10:02:50.600787+0000","last_active":"2024-04-25T10:02:50.608539+0000","last_peered":"2024-04-25T10:02:50.608539+0000","last_clean":"2024-04-25T10:02:50.608539+0000","last_became_active":"2024-04-25T10:02:50.599972+0000","last_became_peered":"2024-04-25T10:02:50.599972+0000","last_unstale":"2024-04-25T10:02:50.608539+0000","last_undegraded":"2024-04-25T10:02:50.608539+0000","last_fullsized":"2024-04-25T10:02:50.608539+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:34:25.529946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.603998+0000","last_change":"2024-04-25T10:02:50.598983+0000","last_active":"2024-04-25T10:02:50.603998+0000","last_peered":"2024-04-25T10:02:50.603998+0000","last_clean":"2024-04-25T10:02:50.603998+0000","last_became_active":"2024-04-25T10:02:50.598041+0000","last_became_peered":"2024-04-25T10:02:50.598041+0000","last_unstale":"2024-04-25T10:02:50.603998+0000","last_undegraded":"2024-04-25T10:02:50.603998+0000","last_fullsized":"2024-04-25T10:02:50.603998+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:26.544669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.595587+0000","last_change":"2024-04-25T10:02:49.595587+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.595587+0000","last_undegraded":"2024-04-25T10:02:49.595587+0000","last_fullsized":"2024-04-25T10:02:49.595587+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.608465+0000","last_change":"2024-04-25T10:02:50.600374+0000","last_active":"2024-04-25T10:02:50.608465+0000","last_peered":"2024-04-25T10:02:50.608465+0000","last_clean":"2024-04-25T10:02:50.608465+0000","last_became_active":"2024-04-25T10:02:50.600063+0000","last_became_peered":"2024-04-25T10:02:50.600063+0000","last_unstale":"2024-04-25T10:02:50.608465+0000","last_undegraded":"2024-04-25T10:02:50.608465+0000","last_fullsized":"2024-04-25T10:02:50.608465+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:13.384824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.587520+0000","last_change":"2024-04-25T10:02:49.587520+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.587520+0000","last_undegraded":"2024-04-25T10:02:49.587520+0000","last_fullsized":"2024-04-25T10:02:49.587520+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.603520+0000","last_change":"2024-04-25T10:02:50.597667+0000","last_active":"2024-04-25T10:02:50.603520+0000","last_peered":"2024-04-25T10:02:50.603520+0000","last_clean":"2024-04-25T10:02:50.603520+0000","last_became_active":"2024-04-25T10:02:50.597380+0000","last_became_peered":"2024-04-25T10:02:50.597380+0000","last_unstale":"2024-04-25T10:02:50.603520+0000","last_undegraded":"2024-04-25T10:02:50.603520+0000","last_fullsized":"2024-04-25T10:02:50.603520+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:00.445645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.598512+0000","last_change":"2024-04-25T10:02:50.597126+0000","last_active":"2024-04-25T10:02:50.598512+0000","last_peered":"2024-04-25T10:02:50.598512+0000","last_clean":"2024-04-25T10:02:50.598512+0000","last_became_active":"2024-04-25T10:02:50.596838+0000","last_became_peered":"2024-04-25T10:02:50.596838+0000","last_unstale":"2024-04-25T10:02:50.598512+0000","last_undegraded":"2024-04-25T10:02:50.598512+0000","last_fullsized":"2024-04-25T10:02:50.598512+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:25.592490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.584137+0000","last_change":"2024-04-25T10:02:49.584137+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.584137+0000","last_undegraded":"2024-04-25T10:02:49.584137+0000","last_fullsized":"2024-04-25T10:02:49.584137+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.600410+0000","last_change":"2024-04-25T10:02:50.594589+0000","last_active":"2024-04-25T10:02:50.600410+0000","last_peered":"2024-04-25T10:02:50.600410+0000","last_clean":"2024-04-25T10:02:50.600410+0000","last_became_active":"2024-04-25T10:02:50.594292+0000","last_became_peered":"2024-04-25T10:02:50.594292+0000","last_unstale":"2024-04-25T10:02:50.600410+0000","last_undegraded":"2024-04-25T10:02:50.600410+0000","last_fullsized":"2024-04-25T10:02:50.600410+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:27.456813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.603854+0000","last_change":"2024-04-25T10:02:50.602757+0000","last_active":"2024-04-25T10:02:50.603854+0000","last_peered":"2024-04-25T10:02:50.603854+0000","last_clean":"2024-04-25T10:02:50.603854+0000","last_became_active":"2024-04-25T10:02:50.602479+0000","last_became_peered":"2024-04-25T10:02:50.602479+0000","last_unstale":"2024-04-25T10:02:50.603854+0000","last_undegraded":"2024-04-25T10:02:50.603854+0000","last_fullsized":"2024-04-25T10:02:50.603854+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:52.545352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613866+0000","last_change":"2024-04-25T10:02:50.611124+0000","last_active":"2024-04-25T10:02:50.613866+0000","last_peered":"2024-04-25T10:02:50.613866+0000","last_clean":"2024-04-25T10:02:50.613866+0000","last_became_active":"2024-04-25T10:02:50.610797+0000","last_became_peered":"2024-04-25T10:02:50.610797+0000","last_unstale":"2024-04-25T10:02:50.613866+0000","last_undegraded":"2024-04-25T10:02:50.613866+0000","last_fullsized":"2024-04-25T10:02:50.613866+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:04.437758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585202+0000","last_change":"2024-04-25T10:02:49.585202+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585202+0000","last_undegraded":"2024-04-25T10:02:49.585202+0000","last_fullsized":"2024-04-25T10:02:49.585202+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.604313+0000","last_change":"2024-04-25T10:02:50.599375+0000","last_active":"2024-04-25T10:02:50.604313+0000","last_peered":"2024-04-25T10:02:50.604313+0000","last_clean":"2024-04-25T10:02:50.604313+0000","last_became_active":"2024-04-25T10:02:50.599069+0000","last_became_peered":"2024-04-25T10:02:50.599069+0000","last_unstale":"2024-04-25T10:02:50.604313+0000","last_undegraded":"2024-04-25T10:02:50.604313+0000","last_fullsized":"2024-04-25T10:02:50.604313+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:08:30.199923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585426+0000","last_change":"2024-04-25T10:02:49.585426+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585426+0000","last_undegraded":"2024-04-25T10:02:49.585426+0000","last_fullsized":"2024-04-25T10:02:49.585426+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.595723+0000","last_change":"2024-04-25T10:02:50.592377+0000","last_active":"2024-04-25T10:02:50.595723+0000","last_peered":"2024-04-25T10:02:50.595723+0000","last_clean":"2024-04-25T10:02:50.595723+0000","last_became_active":"2024-04-25T10:02:50.592080+0000","last_became_peered":"2024-04-25T10:02:50.592080+0000","last_unstale":"2024-04-25T10:02:50.595723+0000","last_undegraded":"2024-04-25T10:02:50.595723+0000","last_fullsized":"2024-04-25T10:02:50.595723+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:07.989371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.594791+0000","last_change":"2024-04-25T10:02:49.594791+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.594791+0000","last_undegraded":"2024-04-25T10:02:49.594791+0000","last_fullsized":"2024-04-25T10:02:49.594791+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.586101+0000","last_change":"2024-04-25T10:02:49.586101+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.586101+0000","last_undegraded":"2024-04-25T10:02:49.586101+0000","last_fullsized":"2024-04-25T10:02:49.586101+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.584332+0000","last_change":"2024-04-25T10:02:49.584332+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.584332+0000","last_undegraded":"2024-04-25T10:02:49.584332+0000","last_fullsized":"2024-04-25T10:02:49.584332+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585088+0000","last_change":"2024-04-25T10:02:49.585088+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585088+0000","last_undegraded":"2024-04-25T10:02:49.585088+0000","last_fullsized":"2024-04-25T10:02:49.585088+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.595760+0000","last_change":"2024-04-25T10:02:50.593306+0000","last_active":"2024-04-25T10:02:50.595760+0000","last_peered":"2024-04-25T10:02:50.595760+0000","last_clean":"2024-04-25T10:02:50.595760+0000","last_became_active":"2024-04-25T10:02:50.593032+0000","last_became_peered":"2024-04-25T10:02:50.593032+0000","last_unstale":"2024-04-25T10:02:50.595760+0000","last_undegraded":"2024-04-25T10:02:50.595760+0000","last_fullsized":"2024-04-25T10:02:50.595760+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:08.637593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.603488+0000","last_change":"2024-04-25T10:02:50.600711+0000","last_active":"2024-04-25T10:02:50.603488+0000","last_peered":"2024-04-25T10:02:50.603488+0000","last_clean":"2024-04-25T10:02:50.603488+0000","last_became_active":"2024-04-25T10:02:50.600415+0000","last_became_peered":"2024-04-25T10:02:50.600415+0000","last_unstale":"2024-04-25T10:02:50.603488+0000","last_undegraded":"2024-04-25T10:02:50.603488+0000","last_fullsized":"2024-04-25T10:02:50.603488+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:47.347288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.600930+0000","last_change":"2024-04-25T10:02:50.592967+0000","last_active":"2024-04-25T10:02:50.600930+0000","last_peered":"2024-04-25T10:02:50.600930+0000","last_clean":"2024-04-25T10:02:50.600930+0000","last_became_active":"2024-04-25T10:02:50.592601+0000","last_became_peered":"2024-04-25T10:02:50.592601+0000","last_unstale":"2024-04-25T10:02:50.600930+0000","last_undegraded":"2024-04-25T10:02:50.600930+0000","last_fullsized":"2024-04-25T10:02:50.600930+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:42.927791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613090+0000","last_change":"2024-04-25T10:02:50.604355+0000","last_active":"2024-04-25T10:02:50.613090+0000","last_peered":"2024-04-25T10:02:50.613090+0000","last_clean":"2024-04-25T10:02:50.613090+0000","last_became_active":"2024-04-25T10:02:50.603745+0000","last_became_peered":"2024-04-25T10:02:50.603745+0000","last_unstale":"2024-04-25T10:02:50.613090+0000","last_undegraded":"2024-04-25T10:02:50.613090+0000","last_fullsized":"2024-04-25T10:02:50.613090+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:48.165008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.594396+0000","last_change":"2024-04-25T10:02:49.594396+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.594396+0000","last_undegraded":"2024-04-25T10:02:49.594396+0000","last_fullsized":"2024-04-25T10:02:49.594396+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.595701+0000","last_change":"2024-04-25T10:02:50.590740+0000","last_active":"2024-04-25T10:02:50.595701+0000","last_peered":"2024-04-25T10:02:50.595701+0000","last_clean":"2024-04-25T10:02:50.595701+0000","last_became_active":"2024-04-25T10:02:50.590423+0000","last_became_peered":"2024-04-25T10:02:50.590423+0000","last_unstale":"2024-04-25T10:02:50.595701+0000","last_undegraded":"2024-04-25T10:02:50.595701+0000","last_fullsized":"2024-04-25T10:02:50.595701+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:48.165008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613110+0000","last_change":"2024-04-25T10:02:50.605847+0000","last_active":"2024-04-25T10:02:50.613110+0000","last_peered":"2024-04-25T10:02:50.613110+0000","last_clean":"2024-04-25T10:02:50.613110+0000","last_became_active":"2024-04-25T10:02:50.605541+0000","last_became_peered":"2024-04-25T10:02:50.605541+0000","last_unstale":"2024-04-25T10:02:50.613110+0000","last_undegraded":"2024-04-25T10:02:50.613110+0000","last_fullsized":"2024-04-25T10:02:50.613110+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:08.637593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.593250+0000","last_change":"2024-04-25T10:02:49.593250+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.593250+0000","last_undegraded":"2024-04-25T10:02:49.593250+0000","last_fullsized":"2024-04-25T10:02:49.593250+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585100+0000","last_change":"2024-04-25T10:02:49.585100+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585100+0000","last_undegraded":"2024-04-25T10:02:49.585100+0000","last_fullsized":"2024-04-25T10:02:49.585100+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.601832+0000","last_change":"2024-04-25T10:02:49.599379+0000","last_active":"2024-04-25T10:02:49.601832+0000","last_peered":"2024-04-25T10:02:49.601832+0000","last_clean":"2024-04-25T10:02:49.601832+0000","last_became_active":"2024-04-25T10:02:49.599070+0000","last_became_peered":"2024-04-25T10:02:49.599070+0000","last_unstale":"2024-04-25T10:02:49.601832+0000","last_undegraded":"2024-04-25T10:02:49.601832+0000","last_fullsized":"2024-04-25T10:02:49.601832+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:32.905433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.592135+0000","last_change":"2024-04-25T10:02:49.592135+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.592135+0000","last_undegraded":"2024-04-25T10:02:49.592135+0000","last_fullsized":"2024-04-25T10:02:49.592135+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.598801+0000","last_change":"2024-04-25T10:02:49.597685+0000","last_active":"2024-04-25T10:02:49.598801+0000","last_peered":"2024-04-25T10:02:49.598801+0000","last_clean":"2024-04-25T10:02:49.598801+0000","last_became_active":"2024-04-25T10:02:49.597436+0000","last_became_peered":"2024-04-25T10:02:49.597436+0000","last_unstale":"2024-04-25T10:02:49.598801+0000","last_undegraded":"2024-04-25T10:02:49.598801+0000","last_fullsized":"2024-04-25T10:02:49.598801+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:15.857498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.608237+0000","last_change":"2024-04-25T10:02:50.601730+0000","last_active":"2024-04-25T10:02:50.608237+0000","last_peered":"2024-04-25T10:02:50.608237+0000","last_clean":"2024-04-25T10:02:50.608237+0000","last_became_active":"2024-04-25T10:02:50.601433+0000","last_became_peered":"2024-04-25T10:02:50.601433+0000","last_unstale":"2024-04-25T10:02:50.608237+0000","last_undegraded":"2024-04-25T10:02:50.608237+0000","last_fullsized":"2024-04-25T10:02:50.608237+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:59.212329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"102'2","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613763+0000","last_change":"2024-04-25T10:02:49.602625+0000","last_active":"2024-04-25T10:02:50.613763+0000","last_peered":"2024-04-25T10:02:50.613763+0000","last_clean":"2024-04-25T10:02:50.613763+0000","last_became_active":"2024-04-25T10:02:49.602213+0000","last_became_peered":"2024-04-25T10:02:49.602213+0000","last_unstale":"2024-04-25T10:02:50.613763+0000","last_undegraded":"2024-04-25T10:02:50.613763+0000","last_fullsized":"2024-04-25T10:02:50.613763+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:16.695057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.603943+0000","last_change":"2024-04-25T10:02:50.597990+0000","last_active":"2024-04-25T10:02:50.603943+0000","last_peered":"2024-04-25T10:02:50.603943+0000","last_clean":"2024-04-25T10:02:50.603943+0000","last_became_active":"2024-04-25T10:02:50.597292+0000","last_became_peered":"2024-04-25T10:02:50.597292+0000","last_unstale":"2024-04-25T10:02:50.603943+0000","last_undegraded":"2024-04-25T10:02:50.603943+0000","last_fullsized":"2024-04-25T10:02:50.603943+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:50.079193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.603349+0000","last_change":"2024-04-25T10:02:49.601540+0000","last_active":"2024-04-25T10:02:49.603349+0000","last_peered":"2024-04-25T10:02:49.603349+0000","last_clean":"2024-04-25T10:02:49.603349+0000","last_became_active":"2024-04-25T10:02:49.601236+0000","last_became_peered":"2024-04-25T10:02:49.601236+0000","last_unstale":"2024-04-25T10:02:49.603349+0000","last_undegraded":"2024-04-25T10:02:49.603349+0000","last_fullsized":"2024-04-25T10:02:49.603349+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:02.585092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.583753+0000","last_change":"2024-04-25T10:02:49.583753+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.583753+0000","last_undegraded":"2024-04-25T10:02:49.583753+0000","last_fullsized":"2024-04-25T10:02:49.583753+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"102'1","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613424+0000","last_change":"2024-04-25T10:02:49.600687+0000","last_active":"2024-04-25T10:02:50.613424+0000","last_peered":"2024-04-25T10:02:50.613424+0000","last_clean":"2024-04-25T10:02:50.613424+0000","last_became_active":"2024-04-25T10:02:49.600405+0000","last_became_peered":"2024-04-25T10:02:49.600405+0000","last_unstale":"2024-04-25T10:02:50.613424+0000","last_undegraded":"2024-04-25T10:02:50.613424+0000","last_fullsized":"2024-04-25T10:02:50.613424+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:54:46.938087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.584373+0000","last_change":"2024-04-25T10:02:49.584373+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.584373+0000","last_undegraded":"2024-04-25T10:02:49.584373+0000","last_fullsized":"2024-04-25T10:02:49.584373+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"102'1","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613725+0000","last_change":"2024-04-25T10:02:49.599888+0000","last_active":"2024-04-25T10:02:50.613725+0000","last_peered":"2024-04-25T10:02:50.613725+0000","last_clean":"2024-04-25T10:02:50.613725+0000","last_became_active":"2024-04-25T10:02:49.599607+0000","last_became_peered":"2024-04-25T10:02:49.599607+0000","last_unstale":"2024-04-25T10:02:50.613725+0000","last_undegraded":"2024-04-25T10:02:50.613725+0000","last_fullsized":"2024-04-25T10:02:50.613725+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:46.336023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.608555+0000","last_change":"2024-04-25T10:02:50.602985+0000","last_active":"2024-04-25T10:02:50.608555+0000","last_peered":"2024-04-25T10:02:50.608555+0000","last_clean":"2024-04-25T10:02:50.608555+0000","last_became_active":"2024-04-25T10:02:50.602713+0000","last_became_peered":"2024-04-25T10:02:50.602713+0000","last_unstale":"2024-04-25T10:02:50.608555+0000","last_undegraded":"2024-04-25T10:02:50.608555+0000","last_fullsized":"2024-04-25T10:02:50.608555+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:49:13.711038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.585083+0000","last_change":"2024-04-25T10:02:49.598952+0000","last_active":"2024-04-25T10:02:50.585083+0000","last_peered":"2024-04-25T10:02:50.585083+0000","last_clean":"2024-04-25T10:02:50.585083+0000","last_became_active":"2024-04-25T10:02:49.598639+0000","last_became_peered":"2024-04-25T10:02:49.598639+0000","last_unstale":"2024-04-25T10:02:50.585083+0000","last_undegraded":"2024-04-25T10:02:50.585083+0000","last_fullsized":"2024-04-25T10:02:50.585083+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:49:12.699773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.583769+0000","last_change":"2024-04-25T10:02:49.583769+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.583769+0000","last_undegraded":"2024-04-25T10:02:49.583769+0000","last_fullsized":"2024-04-25T10:02:49.583769+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.590806+0000","last_change":"2024-04-25T10:02:49.589456+0000","last_active":"2024-04-25T10:02:49.590806+0000","last_peered":"2024-04-25T10:02:49.590806+0000","last_clean":"2024-04-25T10:02:49.590806+0000","last_became_active":"2024-04-25T10:02:49.589179+0000","last_became_peered":"2024-04-25T10:02:49.589179+0000","last_unstale":"2024-04-25T10:02:49.590806+0000","last_undegraded":"2024-04-25T10:02:49.590806+0000","last_fullsized":"2024-04-25T10:02:49.590806+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:54.456889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585585+0000","last_change":"2024-04-25T10:02:49.585585+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585585+0000","last_undegraded":"2024-04-25T10:02:49.585585+0000","last_fullsized":"2024-04-25T10:02:49.585585+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.585540+0000","last_change":"2024-04-25T10:02:49.599488+0000","last_active":"2024-04-25T10:02:50.585540+0000","last_peered":"2024-04-25T10:02:50.585540+0000","last_clean":"2024-04-25T10:02:50.585540+0000","last_became_active":"2024-04-25T10:02:49.599195+0000","last_became_peered":"2024-04-25T10:02:49.599195+0000","last_unstale":"2024-04-25T10:02:50.585540+0000","last_undegraded":"2024-04-25T10:02:50.585540+0000","last_fullsized":"2024-04-25T10:02:50.585540+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:15.089501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.587749+0000","last_change":"2024-04-25T10:02:49.587749+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.587749+0000","last_undegraded":"2024-04-25T10:02:49.587749+0000","last_fullsized":"2024-04-25T10:02:49.587749+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.600981+0000","last_change":"2024-04-25T10:02:49.600228+0000","last_active":"2024-04-25T10:02:49.600981+0000","last_peered":"2024-04-25T10:02:49.600981+0000","last_clean":"2024-04-25T10:02:49.600981+0000","last_became_active":"2024-04-25T10:02:49.599938+0000","last_became_peered":"2024-04-25T10:02:49.599938+0000","last_unstale":"2024-04-25T10:02:49.600981+0000","last_undegraded":"2024-04-25T10:02:49.600981+0000","last_fullsized":"2024-04-25T10:02:49.600981+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:36.517034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.593715+0000","last_change":"2024-04-25T10:02:49.593715+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.593715+0000","last_undegraded":"2024-04-25T10:02:49.593715+0000","last_fullsized":"2024-04-25T10:02:49.593715+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"102'3","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.615029+0000","last_change":"2024-04-25T10:02:49.595272+0000","last_active":"2024-04-25T10:02:50.615029+0000","last_peered":"2024-04-25T10:02:50.615029+0000","last_clean":"2024-04-25T10:02:50.615029+0000","last_became_active":"2024-04-25T10:02:49.594964+0000","last_became_peered":"2024-04-25T10:02:49.594964+0000","last_unstale":"2024-04-25T10:02:50.615029+0000","last_undegraded":"2024-04-25T10:02:50.615029+0000","last_fullsized":"2024-04-25T10:02:50.615029+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:04:50.351393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.586617+0000","last_change":"2024-04-25T10:02:49.586617+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.586617+0000","last_undegraded":"2024-04-25T10:02:49.586617+0000","last_fullsized":"2024-04-25T10:02:49.586617+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"102'6","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.622147+0000","last_change":"2024-04-25T10:02:49.596547+0000","last_active":"2024-04-25T10:02:50.622147+0000","last_peered":"2024-04-25T10:02:50.622147+0000","last_clean":"2024-04-25T10:02:50.622147+0000","last_became_active":"2024-04-25T10:02:49.596273+0000","last_became_peered":"2024-04-25T10:02:49.596273+0000","last_unstale":"2024-04-25T10:02:50.622147+0000","last_undegraded":"2024-04-25T10:02:50.622147+0000","last_fullsized":"2024-04-25T10:02:50.622147+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:28.059919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.617363+0000","last_change":"2024-04-25T10:02:50.609769+0000","last_active":"2024-04-25T10:02:50.617363+0000","last_peered":"2024-04-25T10:02:50.617363+0000","last_clean":"2024-04-25T10:02:50.617363+0000","last_became_active":"2024-04-25T10:02:50.609239+0000","last_became_peered":"2024-04-25T10:02:50.609239+0000","last_unstale":"2024-04-25T10:02:50.617363+0000","last_undegraded":"2024-04-25T10:02:50.617363+0000","last_fullsized":"2024-04-25T10:02:50.617363+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:55.468154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.599594+0000","last_change":"2024-04-25T10:02:49.598214+0000","last_active":"2024-04-25T10:02:49.599594+0000","last_peered":"2024-04-25T10:02:49.599594+0000","last_clean":"2024-04-25T10:02:49.599594+0000","last_became_active":"2024-04-25T10:02:49.597943+0000","last_became_peered":"2024-04-25T10:02:49.597943+0000","last_unstale":"2024-04-25T10:02:49.599594+0000","last_undegraded":"2024-04-25T10:02:49.599594+0000","last_fullsized":"2024-04-25T10:02:49.599594+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:05:23.495102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.608468+0000","last_change":"2024-04-25T10:02:50.600485+0000","last_active":"2024-04-25T10:02:50.608468+0000","last_peered":"2024-04-25T10:02:50.608468+0000","last_clean":"2024-04-25T10:02:50.608468+0000","last_became_active":"2024-04-25T10:02:50.600156+0000","last_became_peered":"2024-04-25T10:02:50.600156+0000","last_unstale":"2024-04-25T10:02:50.608468+0000","last_undegraded":"2024-04-25T10:02:50.608468+0000","last_fullsized":"2024-04-25T10:02:50.608468+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:17.706322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.595028+0000","last_change":"2024-04-25T10:02:49.594284+0000","last_active":"2024-04-25T10:02:49.595028+0000","last_peered":"2024-04-25T10:02:49.595028+0000","last_clean":"2024-04-25T10:02:49.595028+0000","last_became_active":"2024-04-25T10:02:49.593996+0000","last_became_peered":"2024-04-25T10:02:49.593996+0000","last_unstale":"2024-04-25T10:02:49.595028+0000","last_undegraded":"2024-04-25T10:02:49.595028+0000","last_fullsized":"2024-04-25T10:02:49.595028+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:16.312918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.594191+0000","last_change":"2024-04-25T10:02:49.594191+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.594191+0000","last_undegraded":"2024-04-25T10:02:49.594191+0000","last_fullsized":"2024-04-25T10:02:49.594191+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.604212+0000","last_change":"2024-04-25T10:02:49.603609+0000","last_active":"2024-04-25T10:02:49.604212+0000","last_peered":"2024-04-25T10:02:49.604212+0000","last_clean":"2024-04-25T10:02:49.604212+0000","last_became_active":"2024-04-25T10:02:49.603297+0000","last_became_peered":"2024-04-25T10:02:49.603297+0000","last_unstale":"2024-04-25T10:02:49.604212+0000","last_undegraded":"2024-04-25T10:02:49.604212+0000","last_fullsized":"2024-04-25T10:02:49.604212+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:44.744796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.584331+0000","last_change":"2024-04-25T10:02:49.584331+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.584331+0000","last_undegraded":"2024-04-25T10:02:49.584331+0000","last_fullsized":"2024-04-25T10:02:49.584331+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"102'8","reported_seq":20,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.618329+0000","last_change":"2024-04-25T10:02:49.598951+0000","last_active":"2024-04-25T10:02:50.618329+0000","last_peered":"2024-04-25T10:02:50.618329+0000","last_clean":"2024-04-25T10:02:50.618329+0000","last_became_active":"2024-04-25T10:02:49.598508+0000","last_became_peered":"2024-04-25T10:02:49.598508+0000","last_unstale":"2024-04-25T10:02:50.618329+0000","last_undegraded":"2024-04-25T10:02:50.618329+0000","last_fullsized":"2024-04-25T10:02:50.618329+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:34:24.518681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.592454+0000","last_change":"2024-04-25T10:02:49.592454+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.592454+0000","last_undegraded":"2024-04-25T10:02:49.592454+0000","last_fullsized":"2024-04-25T10:02:49.592454+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"102'1","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.617905+0000","last_change":"2024-04-25T10:02:49.605550+0000","last_active":"2024-04-25T10:02:50.617905+0000","last_peered":"2024-04-25T10:02:50.617905+0000","last_clean":"2024-04-25T10:02:50.617905+0000","last_became_active":"2024-04-25T10:02:49.605242+0000","last_became_peered":"2024-04-25T10:02:49.605242+0000","last_unstale":"2024-04-25T10:02:50.617905+0000","last_undegraded":"2024-04-25T10:02:50.617905+0000","last_fullsized":"2024-04-25T10:02:50.617905+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:41.634104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613130+0000","last_change":"2024-04-25T10:02:50.605531+0000","last_active":"2024-04-25T10:02:50.613130+0000","last_peered":"2024-04-25T10:02:50.613130+0000","last_clean":"2024-04-25T10:02:50.613130+0000","last_became_active":"2024-04-25T10:02:50.605229+0000","last_became_peered":"2024-04-25T10:02:50.605229+0000","last_unstale":"2024-04-25T10:02:50.613130+0000","last_undegraded":"2024-04-25T10:02:50.613130+0000","last_fullsized":"2024-04-25T10:02:50.613130+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:07.989371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"102'1","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613455+0000","last_change":"2024-04-25T10:02:49.599107+0000","last_active":"2024-04-25T10:02:50.613455+0000","last_peered":"2024-04-25T10:02:50.613455+0000","last_clean":"2024-04-25T10:02:50.613455+0000","last_became_active":"2024-04-25T10:02:49.598627+0000","last_became_peered":"2024-04-25T10:02:49.598627+0000","last_unstale":"2024-04-25T10:02:50.613455+0000","last_undegraded":"2024-04-25T10:02:50.613455+0000","last_fullsized":"2024-04-25T10:02:50.613455+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:58.452441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.587028+0000","last_change":"2024-04-25T10:02:49.587028+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.587028+0000","last_undegraded":"2024-04-25T10:02:49.587028+0000","last_fullsized":"2024-04-25T10:02:49.587028+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.590432+0000","last_change":"2024-04-25T10:02:49.600728+0000","last_active":"2024-04-25T10:02:50.590432+0000","last_peered":"2024-04-25T10:02:50.590432+0000","last_clean":"2024-04-25T10:02:50.590432+0000","last_became_active":"2024-04-25T10:02:49.600439+0000","last_became_peered":"2024-04-25T10:02:49.600439+0000","last_unstale":"2024-04-25T10:02:50.590432+0000","last_undegraded":"2024-04-25T10:02:50.590432+0000","last_fullsized":"2024-04-25T10:02:50.590432+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:58.201064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.584662+0000","last_change":"2024-04-25T10:02:49.584662+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.584662+0000","last_undegraded":"2024-04-25T10:02:49.584662+0000","last_fullsized":"2024-04-25T10:02:49.584662+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.603838+0000","last_change":"2024-04-25T10:02:49.603196+0000","last_active":"2024-04-25T10:02:49.603838+0000","last_peered":"2024-04-25T10:02:49.603838+0000","last_clean":"2024-04-25T10:02:49.603838+0000","last_became_active":"2024-04-25T10:02:49.602809+0000","last_became_peered":"2024-04-25T10:02:49.602809+0000","last_unstale":"2024-04-25T10:02:49.603838+0000","last_undegraded":"2024-04-25T10:02:49.603838+0000","last_fullsized":"2024-04-25T10:02:49.603838+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:34.725327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.584993+0000","last_change":"2024-04-25T10:02:49.584993+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.584993+0000","last_undegraded":"2024-04-25T10:02:49.584993+0000","last_fullsized":"2024-04-25T10:02:49.584993+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.603096+0000","last_change":"2024-04-25T10:02:49.602636+0000","last_active":"2024-04-25T10:02:49.603096+0000","last_peered":"2024-04-25T10:02:49.603096+0000","last_clean":"2024-04-25T10:02:49.603096+0000","last_became_active":"2024-04-25T10:02:49.602376+0000","last_became_peered":"2024-04-25T10:02:49.602376+0000","last_unstale":"2024-04-25T10:02:49.603096+0000","last_undegraded":"2024-04-25T10:02:49.603096+0000","last_fullsized":"2024-04-25T10:02:49.603096+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:10.084009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.583767+0000","last_change":"2024-04-25T10:02:49.583767+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.583767+0000","last_undegraded":"2024-04-25T10:02:49.583767+0000","last_fullsized":"2024-04-25T10:02:49.583767+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.595549+0000","last_change":"2024-04-25T10:02:49.596692+0000","last_active":"2024-04-25T10:02:50.595549+0000","last_peered":"2024-04-25T10:02:50.595549+0000","last_clean":"2024-04-25T10:02:50.595549+0000","last_became_active":"2024-04-25T10:02:49.596371+0000","last_became_peered":"2024-04-25T10:02:49.596371+0000","last_unstale":"2024-04-25T10:02:50.595549+0000","last_undegraded":"2024-04-25T10:02:50.595549+0000","last_fullsized":"2024-04-25T10:02:50.595549+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:09.504320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.593530+0000","last_change":"2024-04-25T10:02:49.593530+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.593530+0000","last_undegraded":"2024-04-25T10:02:49.593530+0000","last_fullsized":"2024-04-25T10:02:49.593530+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.598418+0000","last_change":"2024-04-25T10:02:49.596751+0000","last_active":"2024-04-25T10:02:49.598418+0000","last_peered":"2024-04-25T10:02:49.598418+0000","last_clean":"2024-04-25T10:02:49.598418+0000","last_became_active":"2024-04-25T10:02:49.596497+0000","last_became_peered":"2024-04-25T10:02:49.596497+0000","last_unstale":"2024-04-25T10:02:49.598418+0000","last_undegraded":"2024-04-25T10:02:49.598418+0000","last_fullsized":"2024-04-25T10:02:49.598418+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:55.785270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585994+0000","last_change":"2024-04-25T10:02:49.585994+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585994+0000","last_undegraded":"2024-04-25T10:02:49.585994+0000","last_fullsized":"2024-04-25T10:02:49.585994+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.600871+0000","last_change":"2024-04-25T10:02:49.597614+0000","last_active":"2024-04-25T10:02:49.600871+0000","last_peered":"2024-04-25T10:02:49.600871+0000","last_clean":"2024-04-25T10:02:49.600871+0000","last_became_active":"2024-04-25T10:02:49.597315+0000","last_became_peered":"2024-04-25T10:02:49.597315+0000","last_unstale":"2024-04-25T10:02:49.600871+0000","last_undegraded":"2024-04-25T10:02:49.600871+0000","last_fullsized":"2024-04-25T10:02:49.600871+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:54.318211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.598481+0000","last_change":"2024-04-25T10:02:50.597174+0000","last_active":"2024-04-25T10:02:50.598481+0000","last_peered":"2024-04-25T10:02:50.598481+0000","last_clean":"2024-04-25T10:02:50.598481+0000","last_became_active":"2024-04-25T10:02:50.596881+0000","last_became_peered":"2024-04-25T10:02:50.596881+0000","last_unstale":"2024-04-25T10:02:50.598481+0000","last_undegraded":"2024-04-25T10:02:50.598481+0000","last_fullsized":"2024-04-25T10:02:50.598481+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:29:23.799255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.597653+0000","last_change":"2024-04-25T10:02:49.595969+0000","last_active":"2024-04-25T10:02:49.597653+0000","last_peered":"2024-04-25T10:02:49.597653+0000","last_clean":"2024-04-25T10:02:49.597653+0000","last_became_active":"2024-04-25T10:02:49.595693+0000","last_became_peered":"2024-04-25T10:02:49.595693+0000","last_unstale":"2024-04-25T10:02:49.597653+0000","last_undegraded":"2024-04-25T10:02:49.597653+0000","last_fullsized":"2024-04-25T10:02:49.597653+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:14.963530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.583995+0000","last_change":"2024-04-25T10:02:49.583995+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.583995+0000","last_undegraded":"2024-04-25T10:02:49.583995+0000","last_fullsized":"2024-04-25T10:02:49.583995+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.596214+0000","last_change":"2024-04-25T10:02:49.593862+0000","last_active":"2024-04-25T10:02:50.596214+0000","last_peered":"2024-04-25T10:02:50.596214+0000","last_clean":"2024-04-25T10:02:50.596214+0000","last_became_active":"2024-04-25T10:02:49.593554+0000","last_became_peered":"2024-04-25T10:02:49.593554+0000","last_unstale":"2024-04-25T10:02:50.596214+0000","last_undegraded":"2024-04-25T10:02:50.596214+0000","last_fullsized":"2024-04-25T10:02:50.596214+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:33.837038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.603964+0000","last_change":"2024-04-25T10:02:50.601221+0000","last_active":"2024-04-25T10:02:50.603964+0000","last_peered":"2024-04-25T10:02:50.603964+0000","last_clean":"2024-04-25T10:02:50.603964+0000","last_became_active":"2024-04-25T10:02:50.600909+0000","last_became_peered":"2024-04-25T10:02:50.600909+0000","last_unstale":"2024-04-25T10:02:50.603964+0000","last_undegraded":"2024-04-25T10:02:50.603964+0000","last_fullsized":"2024-04-25T10:02:50.603964+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:46.085984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.601700+0000","last_change":"2024-04-25T10:02:49.600863+0000","last_active":"2024-04-25T10:02:49.601700+0000","last_peered":"2024-04-25T10:02:49.601700+0000","last_clean":"2024-04-25T10:02:49.601700+0000","last_became_active":"2024-04-25T10:02:49.600571+0000","last_became_peered":"2024-04-25T10:02:49.600571+0000","last_unstale":"2024-04-25T10:02:49.601700+0000","last_undegraded":"2024-04-25T10:02:49.601700+0000","last_fullsized":"2024-04-25T10:02:49.601700+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:42.042387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.593132+0000","last_change":"2024-04-25T10:02:49.593132+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.593132+0000","last_undegraded":"2024-04-25T10:02:49.593132+0000","last_fullsized":"2024-04-25T10:02:49.593132+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.583742+0000","last_change":"2024-04-25T10:02:49.601012+0000","last_active":"2024-04-25T10:02:50.583742+0000","last_peered":"2024-04-25T10:02:50.583742+0000","last_clean":"2024-04-25T10:02:50.583742+0000","last_became_active":"2024-04-25T10:02:49.600731+0000","last_became_peered":"2024-04-25T10:02:49.600731+0000","last_unstale":"2024-04-25T10:02:50.583742+0000","last_undegraded":"2024-04-25T10:02:50.583742+0000","last_fullsized":"2024-04-25T10:02:50.583742+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:12.373559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.592072+0000","last_change":"2024-04-25T10:02:49.592072+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.592072+0000","last_undegraded":"2024-04-25T10:02:49.592072+0000","last_fullsized":"2024-04-25T10:02:49.592072+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.602217+0000","last_change":"2024-04-25T10:02:49.600898+0000","last_active":"2024-04-25T10:02:49.602217+0000","last_peered":"2024-04-25T10:02:49.602217+0000","last_clean":"2024-04-25T10:02:49.602217+0000","last_became_active":"2024-04-25T10:02:49.600598+0000","last_became_peered":"2024-04-25T10:02:49.600598+0000","last_unstale":"2024-04-25T10:02:49.602217+0000","last_undegraded":"2024-04-25T10:02:49.602217+0000","last_fullsized":"2024-04-25T10:02:49.602217+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:03.344877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.603429+0000","last_change":"2024-04-25T10:02:50.602017+0000","last_active":"2024-04-25T10:02:50.603429+0000","last_peered":"2024-04-25T10:02:50.603429+0000","last_clean":"2024-04-25T10:02:50.603429+0000","last_became_active":"2024-04-25T10:02:50.601702+0000","last_became_peered":"2024-04-25T10:02:50.601702+0000","last_unstale":"2024-04-25T10:02:50.603429+0000","last_undegraded":"2024-04-25T10:02:50.603429+0000","last_fullsized":"2024-04-25T10:02:50.603429+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:36.647239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.595712+0000","last_change":"2024-04-25T10:02:49.592618+0000","last_active":"2024-04-25T10:02:50.595712+0000","last_peered":"2024-04-25T10:02:50.595712+0000","last_clean":"2024-04-25T10:02:50.595712+0000","last_became_active":"2024-04-25T10:02:49.592337+0000","last_became_peered":"2024-04-25T10:02:49.592337+0000","last_unstale":"2024-04-25T10:02:50.595712+0000","last_undegraded":"2024-04-25T10:02:50.595712+0000","last_fullsized":"2024-04-25T10:02:50.595712+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:37.202053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.601041+0000","last_change":"2024-04-25T10:02:50.593723+0000","last_active":"2024-04-25T10:02:50.601041+0000","last_peered":"2024-04-25T10:02:50.601041+0000","last_clean":"2024-04-25T10:02:50.601041+0000","last_became_active":"2024-04-25T10:02:50.593409+0000","last_became_peered":"2024-04-25T10:02:50.593409+0000","last_unstale":"2024-04-25T10:02:50.601041+0000","last_undegraded":"2024-04-25T10:02:50.601041+0000","last_fullsized":"2024-04-25T10:02:50.601041+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:44:14.466542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.602152+0000","last_change":"2024-04-25T10:02:49.599898+0000","last_active":"2024-04-25T10:02:49.602152+0000","last_peered":"2024-04-25T10:02:49.602152+0000","last_clean":"2024-04-25T10:02:49.602152+0000","last_became_active":"2024-04-25T10:02:49.599612+0000","last_became_peered":"2024-04-25T10:02:49.599612+0000","last_unstale":"2024-04-25T10:02:49.602152+0000","last_undegraded":"2024-04-25T10:02:49.602152+0000","last_fullsized":"2024-04-25T10:02:49.602152+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:05:42.694860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.612908+0000","last_change":"2024-04-25T10:02:50.605854+0000","last_active":"2024-04-25T10:02:50.612908+0000","last_peered":"2024-04-25T10:02:50.612908+0000","last_clean":"2024-04-25T10:02:50.612908+0000","last_became_active":"2024-04-25T10:02:50.605508+0000","last_became_peered":"2024-04-25T10:02:50.605508+0000","last_unstale":"2024-04-25T10:02:50.612908+0000","last_undegraded":"2024-04-25T10:02:50.612908+0000","last_fullsized":"2024-04-25T10:02:50.612908+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:28.150965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.598822+0000","last_change":"2024-04-25T10:02:49.598137+0000","last_active":"2024-04-25T10:02:49.598822+0000","last_peered":"2024-04-25T10:02:49.598822+0000","last_clean":"2024-04-25T10:02:49.598822+0000","last_became_active":"2024-04-25T10:02:49.597841+0000","last_became_peered":"2024-04-25T10:02:49.597841+0000","last_unstale":"2024-04-25T10:02:49.598822+0000","last_undegraded":"2024-04-25T10:02:49.598822+0000","last_fullsized":"2024-04-25T10:02:49.598822+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:42.504597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":321,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.587486+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T10:02:50.587486+0000","last_peered":"2024-04-25T10:02:50.587486+0000","last_clean":"2024-04-25T10:02:50.587486+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T10:02:50.587486+0000","last_undegraded":"2024-04-25T10:02:50.587486+0000","last_fullsized":"2024-04-25T10:02:50.587486+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":1794,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23,"ondisk_log_size":23,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542250,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33008,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338832,"statfs":{"total":96636764160,"available":96602963968,"internally_reserved":0,"allocated":1863680,"data_stored":1174185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542250,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1249280,"data_stored":576490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542252,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1261568,"data_stored":583657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542249,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1249280,"data_stored":576490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574954,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1236992,"data_stored":569823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1236992,"data_stored":569823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1249280,"data_stored":576490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574954,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32988,"kb_used_data":1800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338852,"statfs":{"total":96636764160,"available":96602984448,"internally_reserved":0,"allocated":1843200,"data_stored":1166858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:02:54.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3f is not active+clean 2024-04-25T10:02:54.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.585616+0000', 'last_change': '2024-04-25T10:02:49.585616+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.585616+0000', 'last_undegraded': '2024-04-25T10:02:49.585616+0000', 'last_fullsized': '2024-04-25T10:02:49.585616+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:02:54.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3d is not active+clean 2024-04-25T10:02:54.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.585815+0000', 'last_change': '2024-04-25T10:02:49.585815+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.585815+0000', 'last_undegraded': '2024-04-25T10:02:49.585815+0000', 'last_fullsized': '2024-04-25T10:02:49.585815+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:02:54.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3c is not active+clean 2024-04-25T10:02:54.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.584483+0000', 'last_change': '2024-04-25T10:02:49.584483+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.584483+0000', 'last_undegraded': '2024-04-25T10:02:49.584483+0000', 'last_fullsized': '2024-04-25T10:02:49.584483+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:02:54.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3b is not active+clean 2024-04-25T10:02:54.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.587454+0000', 'last_change': '2024-04-25T10:02:49.587454+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.587454+0000', 'last_undegraded': '2024-04-25T10:02:49.587454+0000', 'last_fullsized': '2024-04-25T10:02:49.587454+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T10:02:54.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.38 is not active+clean 2024-04-25T10:02:54.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.595587+0000', 'last_change': '2024-04-25T10:02:49.595587+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.595587+0000', 'last_undegraded': '2024-04-25T10:02:49.595587+0000', 'last_fullsized': '2024-04-25T10:02:49.595587+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T10:02:54.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.36 is not active+clean 2024-04-25T10:02:54.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.587520+0000', 'last_change': '2024-04-25T10:02:49.587520+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.587520+0000', 'last_undegraded': '2024-04-25T10:02:49.587520+0000', 'last_fullsized': '2024-04-25T10:02:49.587520+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T10:02:54.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.33 is not active+clean 2024-04-25T10:02:54.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.584137+0000', 'last_change': '2024-04-25T10:02:49.584137+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.584137+0000', 'last_undegraded': '2024-04-25T10:02:49.584137+0000', 'last_fullsized': '2024-04-25T10:02:49.584137+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:02:54.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2f is not active+clean 2024-04-25T10:02:54.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.585202+0000', 'last_change': '2024-04-25T10:02:49.585202+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.585202+0000', 'last_undegraded': '2024-04-25T10:02:49.585202+0000', 'last_fullsized': '2024-04-25T10:02:49.585202+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:02:54.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2d is not active+clean 2024-04-25T10:02:54.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.585426+0000', 'last_change': '2024-04-25T10:02:49.585426+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.585426+0000', 'last_undegraded': '2024-04-25T10:02:49.585426+0000', 'last_fullsized': '2024-04-25T10:02:49.585426+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:02:54.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2b is not active+clean 2024-04-25T10:02:54.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.594791+0000', 'last_change': '2024-04-25T10:02:49.594791+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.594791+0000', 'last_undegraded': '2024-04-25T10:02:49.594791+0000', 'last_fullsized': '2024-04-25T10:02:49.594791+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T10:02:54.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2a is not active+clean 2024-04-25T10:02:54.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.586101+0000', 'last_change': '2024-04-25T10:02:49.586101+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.586101+0000', 'last_undegraded': '2024-04-25T10:02:49.586101+0000', 'last_fullsized': '2024-04-25T10:02:49.586101+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T10:02:54.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.29 is not active+clean 2024-04-25T10:02:54.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.584332+0000', 'last_change': '2024-04-25T10:02:49.584332+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.584332+0000', 'last_undegraded': '2024-04-25T10:02:49.584332+0000', 'last_fullsized': '2024-04-25T10:02:49.584332+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:02:54.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.28 is not active+clean 2024-04-25T10:02:54.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.585088+0000', 'last_change': '2024-04-25T10:02:49.585088+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.585088+0000', 'last_undegraded': '2024-04-25T10:02:49.585088+0000', 'last_fullsized': '2024-04-25T10:02:49.585088+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T10:02:54.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.23 is not active+clean 2024-04-25T10:02:54.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.594396+0000', 'last_change': '2024-04-25T10:02:49.594396+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.594396+0000', 'last_undegraded': '2024-04-25T10:02:49.594396+0000', 'last_fullsized': '2024-04-25T10:02:49.594396+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T10:02:54.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.20 is not active+clean 2024-04-25T10:02:54.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.593250+0000', 'last_change': '2024-04-25T10:02:49.593250+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.593250+0000', 'last_undegraded': '2024-04-25T10:02:49.593250+0000', 'last_fullsized': '2024-04-25T10:02:49.593250+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T10:02:54.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.0 is not active+clean 2024-04-25T10:02:54.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.585100+0000', 'last_change': '2024-04-25T10:02:49.585100+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.585100+0000', 'last_undegraded': '2024-04-25T10:02:49.585100+0000', 'last_fullsized': '2024-04-25T10:02:49.585100+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:02:54.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1 is not active+clean 2024-04-25T10:02:54.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.592135+0000', 'last_change': '2024-04-25T10:02:49.592135+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.592135+0000', 'last_undegraded': '2024-04-25T10:02:49.592135+0000', 'last_fullsized': '2024-04-25T10:02:49.592135+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T10:02:54.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.4 is not active+clean 2024-04-25T10:02:54.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.583753+0000', 'last_change': '2024-04-25T10:02:49.583753+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.583753+0000', 'last_undegraded': '2024-04-25T10:02:49.583753+0000', 'last_fullsized': '2024-04-25T10:02:49.583753+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:02:54.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.5 is not active+clean 2024-04-25T10:02:54.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.584373+0000', 'last_change': '2024-04-25T10:02:49.584373+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.584373+0000', 'last_undegraded': '2024-04-25T10:02:49.584373+0000', 'last_fullsized': '2024-04-25T10:02:49.584373+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:02:54.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.7 is not active+clean 2024-04-25T10:02:54.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.583769+0000', 'last_change': '2024-04-25T10:02:49.583769+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.583769+0000', 'last_undegraded': '2024-04-25T10:02:49.583769+0000', 'last_fullsized': '2024-04-25T10:02:49.583769+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:02:54.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.8 is not active+clean 2024-04-25T10:02:54.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.585585+0000', 'last_change': '2024-04-25T10:02:49.585585+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.585585+0000', 'last_undegraded': '2024-04-25T10:02:49.585585+0000', 'last_fullsized': '2024-04-25T10:02:49.585585+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:02:54.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.9 is not active+clean 2024-04-25T10:02:54.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.587749+0000', 'last_change': '2024-04-25T10:02:49.587749+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.587749+0000', 'last_undegraded': '2024-04-25T10:02:49.587749+0000', 'last_fullsized': '2024-04-25T10:02:49.587749+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T10:02:54.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.a is not active+clean 2024-04-25T10:02:54.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.593715+0000', 'last_change': '2024-04-25T10:02:49.593715+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.593715+0000', 'last_undegraded': '2024-04-25T10:02:49.593715+0000', 'last_fullsized': '2024-04-25T10:02:49.593715+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T10:02:54.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.b is not active+clean 2024-04-25T10:02:54.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.586617+0000', 'last_change': '2024-04-25T10:02:49.586617+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.586617+0000', 'last_undegraded': '2024-04-25T10:02:49.586617+0000', 'last_fullsized': '2024-04-25T10:02:49.586617+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T10:02:54.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.e is not active+clean 2024-04-25T10:02:54.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.594191+0000', 'last_change': '2024-04-25T10:02:49.594191+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.594191+0000', 'last_undegraded': '2024-04-25T10:02:49.594191+0000', 'last_fullsized': '2024-04-25T10:02:49.594191+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T10:02:54.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.f is not active+clean 2024-04-25T10:02:54.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.584331+0000', 'last_change': '2024-04-25T10:02:49.584331+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.584331+0000', 'last_undegraded': '2024-04-25T10:02:49.584331+0000', 'last_fullsized': '2024-04-25T10:02:49.584331+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:02:54.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.10 is not active+clean 2024-04-25T10:02:54.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.592454+0000', 'last_change': '2024-04-25T10:02:49.592454+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.592454+0000', 'last_undegraded': '2024-04-25T10:02:49.592454+0000', 'last_fullsized': '2024-04-25T10:02:49.592454+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T10:02:54.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.13 is not active+clean 2024-04-25T10:02:54.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.587028+0000', 'last_change': '2024-04-25T10:02:49.587028+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.587028+0000', 'last_undegraded': '2024-04-25T10:02:49.587028+0000', 'last_fullsized': '2024-04-25T10:02:49.587028+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T10:02:54.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.14 is not active+clean 2024-04-25T10:02:54.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.584662+0000', 'last_change': '2024-04-25T10:02:49.584662+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.584662+0000', 'last_undegraded': '2024-04-25T10:02:49.584662+0000', 'last_fullsized': '2024-04-25T10:02:49.584662+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:02:54.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.15 is not active+clean 2024-04-25T10:02:54.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.584993+0000', 'last_change': '2024-04-25T10:02:49.584993+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.584993+0000', 'last_undegraded': '2024-04-25T10:02:49.584993+0000', 'last_fullsized': '2024-04-25T10:02:49.584993+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:02:54.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.16 is not active+clean 2024-04-25T10:02:54.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.583767+0000', 'last_change': '2024-04-25T10:02:49.583767+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.583767+0000', 'last_undegraded': '2024-04-25T10:02:49.583767+0000', 'last_fullsized': '2024-04-25T10:02:49.583767+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:02:54.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.17 is not active+clean 2024-04-25T10:02:54.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.593530+0000', 'last_change': '2024-04-25T10:02:49.593530+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.593530+0000', 'last_undegraded': '2024-04-25T10:02:49.593530+0000', 'last_fullsized': '2024-04-25T10:02:49.593530+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T10:02:54.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.18 is not active+clean 2024-04-25T10:02:54.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.585994+0000', 'last_change': '2024-04-25T10:02:49.585994+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.585994+0000', 'last_undegraded': '2024-04-25T10:02:49.585994+0000', 'last_fullsized': '2024-04-25T10:02:49.585994+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:02:54.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1a is not active+clean 2024-04-25T10:02:54.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.583995+0000', 'last_change': '2024-04-25T10:02:49.583995+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.583995+0000', 'last_undegraded': '2024-04-25T10:02:49.583995+0000', 'last_fullsized': '2024-04-25T10:02:49.583995+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:02:54.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1c is not active+clean 2024-04-25T10:02:54.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.593132+0000', 'last_change': '2024-04-25T10:02:49.593132+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.593132+0000', 'last_undegraded': '2024-04-25T10:02:49.593132+0000', 'last_fullsized': '2024-04-25T10:02:49.593132+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T10:02:54.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1d is not active+clean 2024-04-25T10:02:54.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:02:49.592072+0000', 'last_change': '2024-04-25T10:02:49.592072+0000', 'last_active': '2024-04-25T10:02:49.563723+0000', 'last_peered': '2024-04-25T10:02:49.563723+0000', 'last_clean': '2024-04-25T10:02:49.563723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:02:49.592072+0000', 'last_undegraded': '2024-04-25T10:02:49.592072+0000', 'last_fullsized': '2024-04-25T10:02:49.592072+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'last_clean_scrub_stamp': '2024-04-25T10:02:49.563723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T10:02:54.346 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T10:02:54.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.441+0000 7f033b2fc640 1 Processor -- start 2024-04-25T10:02:54.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.441+0000 7f033b2fc640 1 -- start start 2024-04-25T10:02:54.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.442+0000 7f033b2fc640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f033415dad0 0x7f03340d18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:54.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.442+0000 7f033b2fc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f03340d0950 0x7f03340b6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:54.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.442+0000 7f033b2fc640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03340d2240 con 0x7f03340b9580 2024-04-25T10:02:54.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.442+0000 7f033b2fc640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03340d2520 con 0x7f033415dad0 2024-04-25T10:02:54.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.442+0000 7f033b2fc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03340d2800 con 0x7f03340d0950 2024-04-25T10:02:54.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.442+0000 7f0339098640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f033415dad0 0x7f03340d18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:54.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.442+0000 7f0338897640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f03340b9580 0x7f03340d0240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35608/0 (socket says 172.21.15.7:35608) 2024-04-25T10:02:54.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.442+0000 7f0338897640 1 -- 172.21.15.7:0/637945129 learned_addr learned my addr 172.21.15.7:0/637945129 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:02:54.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.443+0000 7f0339899640 1 --2- 172.21.15.7:0/637945129 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f03340d0950 0x7f03340b6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:54.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.443+0000 7f0339098640 1 -- 172.21.15.7:0/637945129 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f03340d0950 msgr2=0x7f03340b6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:54.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.443+0000 7f0339098640 1 --2- 172.21.15.7:0/637945129 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f03340d0950 0x7f03340b6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:54.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.443+0000 7f0339098640 1 -- 172.21.15.7:0/637945129 >> v1:172.21.15.7:6789/0 conn(0x7f03340b9580 legacy=0x7f03340d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:54.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.443+0000 7f0339098640 1 -- 172.21.15.7:0/637945129 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03340d2ae0 con 0x7f033415dad0 2024-04-25T10:02:54.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.443+0000 7f0339899640 1 --2- 172.21.15.7:0/637945129 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f03340d0950 0x7f03340b6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:02:54.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.443+0000 7f0339098640 1 --2- 172.21.15.7:0/637945129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f033415dad0 0x7f03340d18d0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f032c0097a0 tx=0x7f032c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb41e8045aca2c12 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:54.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.444+0000 7f0333fff640 1 -- 172.21.15.7:0/637945129 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c037070 con 0x7f033415dad0 2024-04-25T10:02:54.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.444+0000 7f0333fff640 1 -- 172.21.15.7:0/637945129 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032c032440 con 0x7f033415dad0 2024-04-25T10:02:54.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.444+0000 7f0333fff640 1 -- 172.21.15.7:0/637945129 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c032810 con 0x7f033415dad0 2024-04-25T10:02:54.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.444+0000 7f033b2fc640 1 -- 172.21.15.7:0/637945129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f033415dad0 msgr2=0x7f03340d18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:54.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.444+0000 7f033b2fc640 1 --2- 172.21.15.7:0/637945129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f033415dad0 0x7f03340d18d0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f032c0097a0 tx=0x7f032c02a210 comp rx=0 tx=0).stop 2024-04-25T10:02:54.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.444+0000 7f033b2fc640 1 -- 172.21.15.7:0/637945129 shutdown_connections 2024-04-25T10:02:54.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.444+0000 7f033b2fc640 1 --2- 172.21.15.7:0/637945129 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f03340d0950 0x7f03340b6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:54.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.444+0000 7f033b2fc640 1 --2- 172.21.15.7:0/637945129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f033415dad0 0x7f03340d18d0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:54.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.444+0000 7f033b2fc640 1 -- 172.21.15.7:0/637945129 >> 172.21.15.7:0/637945129 conn(0x7f033406bfe0 msgr2=0x7f033406c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:54.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.444+0000 7f033b2fc640 1 -- 172.21.15.7:0/637945129 shutdown_connections 2024-04-25T10:02:54.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.444+0000 7f033b2fc640 1 -- 172.21.15.7:0/637945129 wait complete. 2024-04-25T10:02:54.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.445+0000 7f033b2fc640 1 Processor -- start 2024-04-25T10:02:54.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.446+0000 7f033b2fc640 1 -- start start 2024-04-25T10:02:54.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.446+0000 7f033b2fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03340b9580 0x7f0334152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:54.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.446+0000 7f033b2fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03340d0950 0x7f03341513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:54.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.446+0000 7f033b2fc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f033415dad0 0x7f03341f72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:54.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.446+0000 7f033b2fc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033415deb0 con 0x7f03340d0950 2024-04-25T10:02:54.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.446+0000 7f033b2fc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03340d1e10 con 0x7f03340b9580 2024-04-25T10:02:54.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.446+0000 7f033b2fc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03341528e0 con 0x7f033415dad0 2024-04-25T10:02:54.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.446+0000 7f0338897640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03340d0950 0x7f03341513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:54.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.446+0000 7f0338897640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03340d0950 0x7f03341513d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44240/0 (socket says 172.21.15.7:44240) 2024-04-25T10:02:54.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.446+0000 7f0338897640 1 -- 172.21.15.7:0/4118718699 learned_addr learned my addr 172.21.15.7:0/4118718699 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:54.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.446+0000 7f0339098640 1 --2- 172.21.15.7:0/4118718699 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03340b9580 0x7f0334152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:54.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.446+0000 7f0339899640 1 --2- 172.21.15.7:0/4118718699 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f033415dad0 0x7f03341f72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:54.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.447+0000 7f0338897640 1 -- 172.21.15.7:0/4118718699 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f033415dad0 msgr2=0x7f03341f72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:54.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.447+0000 7f0338897640 1 --2- 172.21.15.7:0/4118718699 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f033415dad0 0x7f03341f72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:54.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.447+0000 7f0338897640 1 -- 172.21.15.7:0/4118718699 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03340b9580 msgr2=0x7f0334152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:54.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.447+0000 7f0338897640 1 --2- 172.21.15.7:0/4118718699 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03340b9580 0x7f0334152d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:54.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.447+0000 7f0338897640 1 -- 172.21.15.7:0/4118718699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0334151cd0 con 0x7f03340d0950 2024-04-25T10:02:54.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.447+0000 7f0338897640 1 --2- 172.21.15.7:0/4118718699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03340d0950 0x7f03341513d0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f032800c400 tx=0x7f032800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:54.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.447+0000 7f0331ffb640 1 -- 172.21.15.7:0/4118718699 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0328017070 con 0x7f03340d0950 2024-04-25T10:02:54.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.447+0000 7f0331ffb640 1 -- 172.21.15.7:0/4118718699 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0328005ce0 con 0x7f03340d0950 2024-04-25T10:02:54.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.447+0000 7f0331ffb640 1 -- 172.21.15.7:0/4118718699 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03280072f0 con 0x7f03340d0950 2024-04-25T10:02:54.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.447+0000 7f033b2fc640 1 -- 172.21.15.7:0/4118718699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0334151fb0 con 0x7f03340d0950 2024-04-25T10:02:54.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.447+0000 7f033b2fc640 1 -- 172.21.15.7:0/4118718699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0334151910 con 0x7f03340d0950 2024-04-25T10:02:54.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.448+0000 7f033b2fc640 1 -- 172.21.15.7:0/4118718699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0334074bb0 con 0x7f03340d0950 2024-04-25T10:02:54.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.449+0000 7f0331ffb640 1 -- 172.21.15.7:0/4118718699 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f032801a070 con 0x7f03340d0950 2024-04-25T10:02:54.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.449+0000 7f0331ffb640 1 --2- 172.21.15.7:0/4118718699 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f032006b4d0 0x7f032006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:54.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.449+0000 7f0331ffb640 1 -- 172.21.15.7:0/4118718699 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0328089720 con 0x7f03340d0950 2024-04-25T10:02:54.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.449+0000 7f0339098640 1 --2- 172.21.15.7:0/4118718699 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f032006b4d0 0x7f032006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:54.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.449+0000 7f0339098640 1 --2- 172.21.15.7:0/4118718699 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f032006b4d0 0x7f032006d990 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f032c034000 tx=0x7f032c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:54.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.453+0000 7f0331ffb640 1 -- 172.21.15.7:0/4118718699 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0328057dc0 con 0x7f03340d0950 2024-04-25T10:02:54.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.706+0000 7f033b2fc640 1 -- 172.21.15.7:0/4118718699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f0334152180 con 0x7f03340d0950 2024-04-25T10:02:54.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.706+0000 7f0331ffb640 1 -- 172.21.15.7:0/4118718699 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1262 (secure 0 0 0) 0x7f032805be60 con 0x7f03340d0950 2024-04-25T10:02:54.711 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:02:54.711 INFO:teuthology.orchestra.run.smithi007.stdout:{"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":531,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":103,"num_osds":8,"num_up_osds":8,"osd_up_since":1714038855,"num_in_osds":8,"osd_in_since":1714038845,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":61},{"state_name":"creating+peering","count":36}],"num_pgs":97,"num_pools":3,"num_objects":15,"data_bytes":592162,"bytes_used":266665984,"bytes_avail":772827447296,"bytes_total":773094113280,"inactive_pgs_ratio":0.37113401293754578,"write_bytes_sec":1136,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":73,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":8364}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":31,"modified":"2024-04-25T10:02:15.963144+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T10:02:54.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.708+0000 7f033b2fc640 1 -- 172.21.15.7:0/4118718699 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f032006b4d0 msgr2=0x7f032006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:54.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.708+0000 7f033b2fc640 1 --2- 172.21.15.7:0/4118718699 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f032006b4d0 0x7f032006d990 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f032c034000 tx=0x7f032c02e000 comp rx=0 tx=0).stop 2024-04-25T10:02:54.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.708+0000 7f033b2fc640 1 -- 172.21.15.7:0/4118718699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03340d0950 msgr2=0x7f03341513d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:54.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.708+0000 7f033b2fc640 1 --2- 172.21.15.7:0/4118718699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03340d0950 0x7f03341513d0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f032800c400 tx=0x7f032800c8c0 comp rx=0 tx=0).stop 2024-04-25T10:02:54.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.708+0000 7f033b2fc640 1 -- 172.21.15.7:0/4118718699 shutdown_connections 2024-04-25T10:02:54.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.708+0000 7f033b2fc640 1 --2- 172.21.15.7:0/4118718699 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f032006b4d0 0x7f032006d990 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:54.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.708+0000 7f033b2fc640 1 --2- 172.21.15.7:0/4118718699 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f033415dad0 0x7f03341f72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:54.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.708+0000 7f033b2fc640 1 --2- 172.21.15.7:0/4118718699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03340d0950 0x7f03341513d0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:54.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.708+0000 7f033b2fc640 1 --2- 172.21.15.7:0/4118718699 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03340b9580 0x7f0334152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:54.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.708+0000 7f033b2fc640 1 -- 172.21.15.7:0/4118718699 >> 172.21.15.7:0/4118718699 conn(0x7f033406bfe0 msgr2=0x7f03341601d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:54.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.708+0000 7f033b2fc640 1 -- 172.21.15.7:0/4118718699 shutdown_connections 2024-04-25T10:02:54.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.708+0000 7f033b2fc640 1 -- 172.21.15.7:0/4118718699 wait complete. 2024-04-25T10:02:54.724 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T10:02:54.724 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:02:54.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.820+0000 7f2ac3570640 1 Processor -- start 2024-04-25T10:02:54.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.820+0000 7f2ac3570640 1 -- start start 2024-04-25T10:02:54.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.821+0000 7f2ac3570640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2abc06b270 0x7f2abc06fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:54.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.821+0000 7f2ac3570640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2abc1618f0 con 0x7f2abc15d7b0 2024-04-25T10:02:54.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.821+0000 7f2ac3570640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2abc161bd0 con 0x7f2abc15eba0 2024-04-25T10:02:54.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.821+0000 7f2ac3570640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc161eb0 con 0x7f2abc06b270 2024-04-25T10:02:54.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.821+0000 7f2ac130c640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2abc15d7b0 0x7f2abc0b53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35620/0 (socket says 172.21.15.7:35620) 2024-04-25T10:02:54.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.821+0000 7f2ac130c640 1 -- 172.21.15.7:0/2653187924 learned_addr learned my addr 172.21.15.7:0/2653187924 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:02:54.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.821+0000 7f2ac1b0d640 1 --2- 172.21.15.7:0/2653187924 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2abc06b270 0x7f2abc06fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:54.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.821+0000 7f2abbfff640 1 -- 172.21.15.7:0/2653187924 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1917906266 0 0) 0x7f2abc1618f0 con 0x7f2abc15d7b0 2024-04-25T10:02:54.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.822+0000 7f2abbfff640 1 -- 172.21.15.7:0/2653187924 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2aa4003520 con 0x7f2abc15d7b0 2024-04-25T10:02:54.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.822+0000 7f2abbfff640 1 -- 172.21.15.7:0/2653187924 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4207614328 0 0) 0x7f2aa4003520 con 0x7f2abc15d7b0 2024-04-25T10:02:54.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.822+0000 7f2abbfff640 1 -- 172.21.15.7:0/2653187924 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2abc06b270 msgr2=0x7f2abc06fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:54.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.822+0000 7f2abbfff640 1 --2- 172.21.15.7:0/2653187924 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2abc06b270 0x7f2abc06fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:54.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.822+0000 7f2abbfff640 1 -- 172.21.15.7:0/2653187924 >> v1:172.21.15.55:6789/0 conn(0x7f2abc15eba0 legacy=0x7f2abc06ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:54.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.822+0000 7f2abbfff640 1 -- 172.21.15.7:0/2653187924 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2abc162190 con 0x7f2abc15d7b0 2024-04-25T10:02:54.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.822+0000 7f2abbfff640 1 -- 172.21.15.7:0/2653187924 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f2ab4001670 con 0x7f2abc15d7b0 2024-04-25T10:02:54.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.822+0000 7f2abbfff640 1 -- 172.21.15.7:0/2653187924 >> v1:172.21.15.7:6789/0 conn(0x7f2abc15d7b0 legacy=0x7f2abc0b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:54.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.822+0000 7f2abbfff640 1 --2- 172.21.15.7:0/2653187924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2aa40039e0 0x7f2aa4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:54.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.822+0000 7f2abbfff640 1 --2- 172.21.15.7:0/2653187924 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2abc06b270 0x7f2aa4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:54.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.822+0000 7f2abbfff640 1 --2- 172.21.15.7:0/2653187924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2aa4004d40 0x7f2aa40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:54.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.822+0000 7f2abbfff640 1 -- 172.21.15.7:0/2653187924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc161eb0 con 0x7f2aa40039e0 2024-04-25T10:02:54.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.822+0000 7f2abbfff640 1 -- 172.21.15.7:0/2653187924 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa400ba20 con 0x7f2aa4004d40 2024-04-25T10:02:54.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.822+0000 7f2abbfff640 1 -- 172.21.15.7:0/2653187924 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa400bc20 con 0x7f2abc06b270 2024-04-25T10:02:54.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.822+0000 7f2ac130c640 1 --2- 172.21.15.7:0/2653187924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2aa40039e0 0x7f2aa4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:54.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.822+0000 7f2ac0b0b640 1 --2- 172.21.15.7:0/2653187924 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2abc06b270 0x7f2aa4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:54.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.822+0000 7f2ac1b0d640 1 --2- 172.21.15.7:0/2653187924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2aa4004d40 0x7f2aa40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:54.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.822+0000 7f2ac130c640 1 -- 172.21.15.7:0/2653187924 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2abc06b270 msgr2=0x7f2aa4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:54.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.822+0000 7f2ac130c640 1 --2- 172.21.15.7:0/2653187924 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2abc06b270 0x7f2aa4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:54.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.822+0000 7f2ac130c640 1 -- 172.21.15.7:0/2653187924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2aa4004d40 msgr2=0x7f2aa40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:54.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.822+0000 7f2ac130c640 1 --2- 172.21.15.7:0/2653187924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2aa4004d40 0x7f2aa40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:54.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.822+0000 7f2ac130c640 1 -- 172.21.15.7:0/2653187924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa4003520 con 0x7f2aa40039e0 2024-04-25T10:02:54.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.822+0000 7f2ac0b0b640 1 --2- 172.21.15.7:0/2653187924 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2abc06b270 0x7f2aa4004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:02:54.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.823+0000 7f2ac130c640 1 --2- 172.21.15.7:0/2653187924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2aa40039e0 0x7f2aa4003dc0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f2ab400c240 tx=0x7f2aa4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e803ae02f677d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:54.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.823+0000 7f2abbfff640 1 -- 172.21.15.7:0/2653187924 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4007d10 con 0x7f2aa40039e0 2024-04-25T10:02:54.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.823+0000 7f2abbfff640 1 -- 172.21.15.7:0/2653187924 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab4005ad0 con 0x7f2aa40039e0 2024-04-25T10:02:54.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.823+0000 7f2abbfff640 1 -- 172.21.15.7:0/2653187924 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4007070 con 0x7f2aa40039e0 2024-04-25T10:02:54.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.824+0000 7f2ac3570640 1 -- 172.21.15.7:0/2653187924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2aa40039e0 msgr2=0x7f2aa4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:54.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.824+0000 7f2ac3570640 1 --2- 172.21.15.7:0/2653187924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2aa40039e0 0x7f2aa4003dc0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f2ab400c240 tx=0x7f2aa4005830 comp rx=0 tx=0).stop 2024-04-25T10:02:54.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.824+0000 7f2ac1b0d640 1 -- 172.21.15.7:0/2653187924 reap_dead start 2024-04-25T10:02:54.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.824+0000 7f2ac3570640 1 -- 172.21.15.7:0/2653187924 shutdown_connections 2024-04-25T10:02:54.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.824+0000 7f2ac3570640 1 -- 172.21.15.7:0/2653187924 >> 172.21.15.7:0/2653187924 conn(0x7f2abc0b2390 msgr2=0x7f2abc0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:54.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.824+0000 7f2ac3570640 1 -- 172.21.15.7:0/2653187924 shutdown_connections 2024-04-25T10:02:54.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.824+0000 7f2ac3570640 1 -- 172.21.15.7:0/2653187924 wait complete. 2024-04-25T10:02:54.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.825+0000 7f2ac3570640 1 Processor -- start 2024-04-25T10:02:54.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.825+0000 7f2ac3570640 1 -- start start 2024-04-25T10:02:54.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.826+0000 7f2ac3570640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2aa40039e0 0x7f2abc14af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:54.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.826+0000 7f2ac3570640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2abc0cb870 0x7f2abc0cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:54.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.826+0000 7f2ac3570640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2abc072260 0x7f2abc0726e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:54.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.826+0000 7f2ac3570640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc161690 con 0x7f2abc0cb870 2024-04-25T10:02:54.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.826+0000 7f2ac3570640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc161510 con 0x7f2abc072260 2024-04-25T10:02:54.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.826+0000 7f2ac3570640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc06fa00 con 0x7f2aa40039e0 2024-04-25T10:02:54.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.826+0000 7f2ac0b0b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2abc0cb870 0x7f2abc0cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:54.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.826+0000 7f2ac0b0b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2abc0cb870 0x7f2abc0cc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44258/0 (socket says 172.21.15.7:44258) 2024-04-25T10:02:54.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.826+0000 7f2ac0b0b640 1 -- 172.21.15.7:0/2390468747 learned_addr learned my addr 172.21.15.7:0/2390468747 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:54.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.826+0000 7f2ac0b0b640 1 -- 172.21.15.7:0/2390468747 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2aa40039e0 msgr2=0x7f2abc14af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:54.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.826+0000 7f2ac130c640 1 --2- 172.21.15.7:0/2390468747 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2aa40039e0 0x7f2abc14af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:54.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.826+0000 7f2ac0b0b640 1 --2- 172.21.15.7:0/2390468747 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2aa40039e0 0x7f2abc14af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:54.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.826+0000 7f2ac1b0d640 1 --2- 172.21.15.7:0/2390468747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2abc072260 0x7f2abc0726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:54.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.826+0000 7f2ac0b0b640 1 -- 172.21.15.7:0/2390468747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2abc072260 msgr2=0x7f2abc0726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:54.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.826+0000 7f2ac0b0b640 1 --2- 172.21.15.7:0/2390468747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2abc072260 0x7f2abc0726e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:54.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.826+0000 7f2ac0b0b640 1 -- 172.21.15.7:0/2390468747 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2abc0c9cd0 con 0x7f2abc0cb870 2024-04-25T10:02:54.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.826+0000 7f2ac0b0b640 1 --2- 172.21.15.7:0/2390468747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2abc0cb870 0x7f2abc0cc270 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f2ab000e7d0 tx=0x7f2ab000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:54.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.826+0000 7f2ab9ffb640 1 -- 172.21.15.7:0/2390468747 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab00050d0 con 0x7f2abc0cb870 2024-04-25T10:02:54.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.826+0000 7f2ab9ffb640 1 -- 172.21.15.7:0/2390468747 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab0018070 con 0x7f2abc0cb870 2024-04-25T10:02:54.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.826+0000 7f2ac3570640 1 -- 172.21.15.7:0/2390468747 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2abc0c9fb0 con 0x7f2abc0cb870 2024-04-25T10:02:54.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.826+0000 7f2ab9ffb640 1 -- 172.21.15.7:0/2390468747 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab0005470 con 0x7f2abc0cb870 2024-04-25T10:02:54.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.827+0000 7f2ac3570640 1 -- 172.21.15.7:0/2390468747 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2abc0cb350 con 0x7f2abc0cb870 2024-04-25T10:02:54.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.828+0000 7f2ac3570640 1 -- 172.21.15.7:0/2390468747 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2abc072c20 con 0x7f2abc0cb870 2024-04-25T10:02:54.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.828+0000 7f2ab9ffb640 1 -- 172.21.15.7:0/2390468747 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2ab000c6c0 con 0x7f2abc0cb870 2024-04-25T10:02:54.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.828+0000 7f2ab9ffb640 1 --2- 172.21.15.7:0/2390468747 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2aa806b4d0 0x7f2aa806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:54.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.828+0000 7f2ab9ffb640 1 -- 172.21.15.7:0/2390468747 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2ab008a140 con 0x7f2abc0cb870 2024-04-25T10:02:54.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.828+0000 7f2ac130c640 1 --2- 172.21.15.7:0/2390468747 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2aa806b4d0 0x7f2aa806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:54.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.829+0000 7f2ac130c640 1 --2- 172.21.15.7:0/2390468747 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2aa806b4d0 0x7f2aa806d990 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4032000 tx=0x7f2ab4007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:54.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:54.833+0000 7f2ab9ffb640 1 -- 172.21.15.7:0/2390468747 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2ab0058e30 con 0x7f2abc0cb870 2024-04-25T10:02:55.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:55.008+0000 7f2ac3570640 1 -- 172.21.15.7:0/2390468747 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2abc068fd0 con 0x7f2aa806b4d0 2024-04-25T10:02:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:55.014+0000 7f2ab9ffb640 1 -- 172.21.15.7:0/2390468747 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249440 (secure 0 0 0) 0x7f2abc068fd0 con 0x7f2aa806b4d0 2024-04-25T10:02:55.021 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:02:55.022 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T10:02:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:55.016+0000 7f2ac3570640 1 -- 172.21.15.7:0/2390468747 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2aa806b4d0 msgr2=0x7f2aa806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:55.016+0000 7f2ac3570640 1 --2- 172.21.15.7:0/2390468747 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2aa806b4d0 0x7f2aa806d990 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4032000 tx=0x7f2ab4007000 comp rx=0 tx=0).stop 2024-04-25T10:02:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:55.016+0000 7f2ac3570640 1 -- 172.21.15.7:0/2390468747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2abc0cb870 msgr2=0x7f2abc0cc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:55.016+0000 7f2ac3570640 1 --2- 172.21.15.7:0/2390468747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2abc0cb870 0x7f2abc0cc270 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f2ab000e7d0 tx=0x7f2ab000ec90 comp rx=0 tx=0).stop 2024-04-25T10:02:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:55.016+0000 7f2ac3570640 1 -- 172.21.15.7:0/2390468747 shutdown_connections 2024-04-25T10:02:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:55.016+0000 7f2ac3570640 1 --2- 172.21.15.7:0/2390468747 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2aa806b4d0 0x7f2aa806d990 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:55.016+0000 7f2ac3570640 1 --2- 172.21.15.7:0/2390468747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2abc072260 0x7f2abc0726e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:55.016+0000 7f2ac3570640 1 --2- 172.21.15.7:0/2390468747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2abc0cb870 0x7f2abc0cc270 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:55.016+0000 7f2ac3570640 1 --2- 172.21.15.7:0/2390468747 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2aa40039e0 0x7f2abc14af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:55.016+0000 7f2ac3570640 1 -- 172.21.15.7:0/2390468747 >> 172.21.15.7:0/2390468747 conn(0x7f2abc0b2390 msgr2=0x7f2abc0b5370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:55.017+0000 7f2ac3570640 1 -- 172.21.15.7:0/2390468747 shutdown_connections 2024-04-25T10:02:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:55.017+0000 7f2ac3570640 1 -- 172.21.15.7:0/2390468747 wait complete. 2024-04-25T10:02:55.032 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":356,"stamp":"2024-04-25T10:02:53.971304+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592162,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":186,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":75,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260416,"kb_used_data":10928,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714304,"statfs":{"total":773094113280,"available":772827447296,"internally_reserved":0,"allocated":11190272,"data_stored":5793816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1794,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.407631"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585616+0000","last_change":"2024-04-25T10:02:49.585616+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585616+0000","last_undegraded":"2024-04-25T10:02:49.585616+0000","last_fullsized":"2024-04-25T10:02:49.585616+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.608577+0000","last_change":"2024-04-25T10:02:50.603031+0000","last_active":"2024-04-25T10:02:50.608577+0000","last_peered":"2024-04-25T10:02:50.608577+0000","last_clean":"2024-04-25T10:02:50.608577+0000","last_became_active":"2024-04-25T10:02:50.602748+0000","last_became_peered":"2024-04-25T10:02:50.602748+0000","last_unstale":"2024-04-25T10:02:50.608577+0000","last_undegraded":"2024-04-25T10:02:50.608577+0000","last_fullsized":"2024-04-25T10:02:50.608577+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:16.100766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585815+0000","last_change":"2024-04-25T10:02:49.585815+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585815+0000","last_undegraded":"2024-04-25T10:02:49.585815+0000","last_fullsized":"2024-04-25T10:02:49.585815+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.584483+0000","last_change":"2024-04-25T10:02:49.584483+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.584483+0000","last_undegraded":"2024-04-25T10:02:49.584483+0000","last_fullsized":"2024-04-25T10:02:49.584483+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.587454+0000","last_change":"2024-04-25T10:02:49.587454+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.587454+0000","last_undegraded":"2024-04-25T10:02:49.587454+0000","last_fullsized":"2024-04-25T10:02:49.587454+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.608539+0000","last_change":"2024-04-25T10:02:50.600787+0000","last_active":"2024-04-25T10:02:50.608539+0000","last_peered":"2024-04-25T10:02:50.608539+0000","last_clean":"2024-04-25T10:02:50.608539+0000","last_became_active":"2024-04-25T10:02:50.599972+0000","last_became_peered":"2024-04-25T10:02:50.599972+0000","last_unstale":"2024-04-25T10:02:50.608539+0000","last_undegraded":"2024-04-25T10:02:50.608539+0000","last_fullsized":"2024-04-25T10:02:50.608539+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:34:25.529946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.603998+0000","last_change":"2024-04-25T10:02:50.598983+0000","last_active":"2024-04-25T10:02:50.603998+0000","last_peered":"2024-04-25T10:02:50.603998+0000","last_clean":"2024-04-25T10:02:50.603998+0000","last_became_active":"2024-04-25T10:02:50.598041+0000","last_became_peered":"2024-04-25T10:02:50.598041+0000","last_unstale":"2024-04-25T10:02:50.603998+0000","last_undegraded":"2024-04-25T10:02:50.603998+0000","last_fullsized":"2024-04-25T10:02:50.603998+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:26.544669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.595587+0000","last_change":"2024-04-25T10:02:49.595587+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.595587+0000","last_undegraded":"2024-04-25T10:02:49.595587+0000","last_fullsized":"2024-04-25T10:02:49.595587+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.608465+0000","last_change":"2024-04-25T10:02:50.600374+0000","last_active":"2024-04-25T10:02:50.608465+0000","last_peered":"2024-04-25T10:02:50.608465+0000","last_clean":"2024-04-25T10:02:50.608465+0000","last_became_active":"2024-04-25T10:02:50.600063+0000","last_became_peered":"2024-04-25T10:02:50.600063+0000","last_unstale":"2024-04-25T10:02:50.608465+0000","last_undegraded":"2024-04-25T10:02:50.608465+0000","last_fullsized":"2024-04-25T10:02:50.608465+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:13.384824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.587520+0000","last_change":"2024-04-25T10:02:49.587520+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.587520+0000","last_undegraded":"2024-04-25T10:02:49.587520+0000","last_fullsized":"2024-04-25T10:02:49.587520+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.603520+0000","last_change":"2024-04-25T10:02:50.597667+0000","last_active":"2024-04-25T10:02:50.603520+0000","last_peered":"2024-04-25T10:02:50.603520+0000","last_clean":"2024-04-25T10:02:50.603520+0000","last_became_active":"2024-04-25T10:02:50.597380+0000","last_became_peered":"2024-04-25T10:02:50.597380+0000","last_unstale":"2024-04-25T10:02:50.603520+0000","last_undegraded":"2024-04-25T10:02:50.603520+0000","last_fullsized":"2024-04-25T10:02:50.603520+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:00.445645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.598512+0000","last_change":"2024-04-25T10:02:50.597126+0000","last_active":"2024-04-25T10:02:50.598512+0000","last_peered":"2024-04-25T10:02:50.598512+0000","last_clean":"2024-04-25T10:02:50.598512+0000","last_became_active":"2024-04-25T10:02:50.596838+0000","last_became_peered":"2024-04-25T10:02:50.596838+0000","last_unstale":"2024-04-25T10:02:50.598512+0000","last_undegraded":"2024-04-25T10:02:50.598512+0000","last_fullsized":"2024-04-25T10:02:50.598512+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:25.592490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.584137+0000","last_change":"2024-04-25T10:02:49.584137+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.584137+0000","last_undegraded":"2024-04-25T10:02:49.584137+0000","last_fullsized":"2024-04-25T10:02:49.584137+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.600410+0000","last_change":"2024-04-25T10:02:50.594589+0000","last_active":"2024-04-25T10:02:50.600410+0000","last_peered":"2024-04-25T10:02:50.600410+0000","last_clean":"2024-04-25T10:02:50.600410+0000","last_became_active":"2024-04-25T10:02:50.594292+0000","last_became_peered":"2024-04-25T10:02:50.594292+0000","last_unstale":"2024-04-25T10:02:50.600410+0000","last_undegraded":"2024-04-25T10:02:50.600410+0000","last_fullsized":"2024-04-25T10:02:50.600410+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:27.456813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.603854+0000","last_change":"2024-04-25T10:02:50.602757+0000","last_active":"2024-04-25T10:02:50.603854+0000","last_peered":"2024-04-25T10:02:50.603854+0000","last_clean":"2024-04-25T10:02:50.603854+0000","last_became_active":"2024-04-25T10:02:50.602479+0000","last_became_peered":"2024-04-25T10:02:50.602479+0000","last_unstale":"2024-04-25T10:02:50.603854+0000","last_undegraded":"2024-04-25T10:02:50.603854+0000","last_fullsized":"2024-04-25T10:02:50.603854+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:52.545352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613866+0000","last_change":"2024-04-25T10:02:50.611124+0000","last_active":"2024-04-25T10:02:50.613866+0000","last_peered":"2024-04-25T10:02:50.613866+0000","last_clean":"2024-04-25T10:02:50.613866+0000","last_became_active":"2024-04-25T10:02:50.610797+0000","last_became_peered":"2024-04-25T10:02:50.610797+0000","last_unstale":"2024-04-25T10:02:50.613866+0000","last_undegraded":"2024-04-25T10:02:50.613866+0000","last_fullsized":"2024-04-25T10:02:50.613866+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:04.437758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585202+0000","last_change":"2024-04-25T10:02:49.585202+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585202+0000","last_undegraded":"2024-04-25T10:02:49.585202+0000","last_fullsized":"2024-04-25T10:02:49.585202+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.604313+0000","last_change":"2024-04-25T10:02:50.599375+0000","last_active":"2024-04-25T10:02:50.604313+0000","last_peered":"2024-04-25T10:02:50.604313+0000","last_clean":"2024-04-25T10:02:50.604313+0000","last_became_active":"2024-04-25T10:02:50.599069+0000","last_became_peered":"2024-04-25T10:02:50.599069+0000","last_unstale":"2024-04-25T10:02:50.604313+0000","last_undegraded":"2024-04-25T10:02:50.604313+0000","last_fullsized":"2024-04-25T10:02:50.604313+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:08:30.199923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585426+0000","last_change":"2024-04-25T10:02:49.585426+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585426+0000","last_undegraded":"2024-04-25T10:02:49.585426+0000","last_fullsized":"2024-04-25T10:02:49.585426+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.595723+0000","last_change":"2024-04-25T10:02:50.592377+0000","last_active":"2024-04-25T10:02:50.595723+0000","last_peered":"2024-04-25T10:02:50.595723+0000","last_clean":"2024-04-25T10:02:50.595723+0000","last_became_active":"2024-04-25T10:02:50.592080+0000","last_became_peered":"2024-04-25T10:02:50.592080+0000","last_unstale":"2024-04-25T10:02:50.595723+0000","last_undegraded":"2024-04-25T10:02:50.595723+0000","last_fullsized":"2024-04-25T10:02:50.595723+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:07.989371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.594791+0000","last_change":"2024-04-25T10:02:49.594791+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.594791+0000","last_undegraded":"2024-04-25T10:02:49.594791+0000","last_fullsized":"2024-04-25T10:02:49.594791+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.586101+0000","last_change":"2024-04-25T10:02:49.586101+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.586101+0000","last_undegraded":"2024-04-25T10:02:49.586101+0000","last_fullsized":"2024-04-25T10:02:49.586101+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.584332+0000","last_change":"2024-04-25T10:02:49.584332+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.584332+0000","last_undegraded":"2024-04-25T10:02:49.584332+0000","last_fullsized":"2024-04-25T10:02:49.584332+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585088+0000","last_change":"2024-04-25T10:02:49.585088+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585088+0000","last_undegraded":"2024-04-25T10:02:49.585088+0000","last_fullsized":"2024-04-25T10:02:49.585088+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.595760+0000","last_change":"2024-04-25T10:02:50.593306+0000","last_active":"2024-04-25T10:02:50.595760+0000","last_peered":"2024-04-25T10:02:50.595760+0000","last_clean":"2024-04-25T10:02:50.595760+0000","last_became_active":"2024-04-25T10:02:50.593032+0000","last_became_peered":"2024-04-25T10:02:50.593032+0000","last_unstale":"2024-04-25T10:02:50.595760+0000","last_undegraded":"2024-04-25T10:02:50.595760+0000","last_fullsized":"2024-04-25T10:02:50.595760+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:08.637593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.603488+0000","last_change":"2024-04-25T10:02:50.600711+0000","last_active":"2024-04-25T10:02:50.603488+0000","last_peered":"2024-04-25T10:02:50.603488+0000","last_clean":"2024-04-25T10:02:50.603488+0000","last_became_active":"2024-04-25T10:02:50.600415+0000","last_became_peered":"2024-04-25T10:02:50.600415+0000","last_unstale":"2024-04-25T10:02:50.603488+0000","last_undegraded":"2024-04-25T10:02:50.603488+0000","last_fullsized":"2024-04-25T10:02:50.603488+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:47.347288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.600930+0000","last_change":"2024-04-25T10:02:50.592967+0000","last_active":"2024-04-25T10:02:50.600930+0000","last_peered":"2024-04-25T10:02:50.600930+0000","last_clean":"2024-04-25T10:02:50.600930+0000","last_became_active":"2024-04-25T10:02:50.592601+0000","last_became_peered":"2024-04-25T10:02:50.592601+0000","last_unstale":"2024-04-25T10:02:50.600930+0000","last_undegraded":"2024-04-25T10:02:50.600930+0000","last_fullsized":"2024-04-25T10:02:50.600930+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:42.927791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613090+0000","last_change":"2024-04-25T10:02:50.604355+0000","last_active":"2024-04-25T10:02:50.613090+0000","last_peered":"2024-04-25T10:02:50.613090+0000","last_clean":"2024-04-25T10:02:50.613090+0000","last_became_active":"2024-04-25T10:02:50.603745+0000","last_became_peered":"2024-04-25T10:02:50.603745+0000","last_unstale":"2024-04-25T10:02:50.613090+0000","last_undegraded":"2024-04-25T10:02:50.613090+0000","last_fullsized":"2024-04-25T10:02:50.613090+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:48.165008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.594396+0000","last_change":"2024-04-25T10:02:49.594396+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.594396+0000","last_undegraded":"2024-04-25T10:02:49.594396+0000","last_fullsized":"2024-04-25T10:02:49.594396+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.595701+0000","last_change":"2024-04-25T10:02:50.590740+0000","last_active":"2024-04-25T10:02:50.595701+0000","last_peered":"2024-04-25T10:02:50.595701+0000","last_clean":"2024-04-25T10:02:50.595701+0000","last_became_active":"2024-04-25T10:02:50.590423+0000","last_became_peered":"2024-04-25T10:02:50.590423+0000","last_unstale":"2024-04-25T10:02:50.595701+0000","last_undegraded":"2024-04-25T10:02:50.595701+0000","last_fullsized":"2024-04-25T10:02:50.595701+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:48.165008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613110+0000","last_change":"2024-04-25T10:02:50.605847+0000","last_active":"2024-04-25T10:02:50.613110+0000","last_peered":"2024-04-25T10:02:50.613110+0000","last_clean":"2024-04-25T10:02:50.613110+0000","last_became_active":"2024-04-25T10:02:50.605541+0000","last_became_peered":"2024-04-25T10:02:50.605541+0000","last_unstale":"2024-04-25T10:02:50.613110+0000","last_undegraded":"2024-04-25T10:02:50.613110+0000","last_fullsized":"2024-04-25T10:02:50.613110+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:08.637593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.593250+0000","last_change":"2024-04-25T10:02:49.593250+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.593250+0000","last_undegraded":"2024-04-25T10:02:49.593250+0000","last_fullsized":"2024-04-25T10:02:49.593250+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585100+0000","last_change":"2024-04-25T10:02:49.585100+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585100+0000","last_undegraded":"2024-04-25T10:02:49.585100+0000","last_fullsized":"2024-04-25T10:02:49.585100+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.601832+0000","last_change":"2024-04-25T10:02:49.599379+0000","last_active":"2024-04-25T10:02:49.601832+0000","last_peered":"2024-04-25T10:02:49.601832+0000","last_clean":"2024-04-25T10:02:49.601832+0000","last_became_active":"2024-04-25T10:02:49.599070+0000","last_became_peered":"2024-04-25T10:02:49.599070+0000","last_unstale":"2024-04-25T10:02:49.601832+0000","last_undegraded":"2024-04-25T10:02:49.601832+0000","last_fullsized":"2024-04-25T10:02:49.601832+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:32.905433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.592135+0000","last_change":"2024-04-25T10:02:49.592135+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.592135+0000","last_undegraded":"2024-04-25T10:02:49.592135+0000","last_fullsized":"2024-04-25T10:02:49.592135+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.598801+0000","last_change":"2024-04-25T10:02:49.597685+0000","last_active":"2024-04-25T10:02:49.598801+0000","last_peered":"2024-04-25T10:02:49.598801+0000","last_clean":"2024-04-25T10:02:49.598801+0000","last_became_active":"2024-04-25T10:02:49.597436+0000","last_became_peered":"2024-04-25T10:02:49.597436+0000","last_unstale":"2024-04-25T10:02:49.598801+0000","last_undegraded":"2024-04-25T10:02:49.598801+0000","last_fullsized":"2024-04-25T10:02:49.598801+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:15.857498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.608237+0000","last_change":"2024-04-25T10:02:50.601730+0000","last_active":"2024-04-25T10:02:50.608237+0000","last_peered":"2024-04-25T10:02:50.608237+0000","last_clean":"2024-04-25T10:02:50.608237+0000","last_became_active":"2024-04-25T10:02:50.601433+0000","last_became_peered":"2024-04-25T10:02:50.601433+0000","last_unstale":"2024-04-25T10:02:50.608237+0000","last_undegraded":"2024-04-25T10:02:50.608237+0000","last_fullsized":"2024-04-25T10:02:50.608237+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:59.212329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"102'2","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613763+0000","last_change":"2024-04-25T10:02:49.602625+0000","last_active":"2024-04-25T10:02:50.613763+0000","last_peered":"2024-04-25T10:02:50.613763+0000","last_clean":"2024-04-25T10:02:50.613763+0000","last_became_active":"2024-04-25T10:02:49.602213+0000","last_became_peered":"2024-04-25T10:02:49.602213+0000","last_unstale":"2024-04-25T10:02:50.613763+0000","last_undegraded":"2024-04-25T10:02:50.613763+0000","last_fullsized":"2024-04-25T10:02:50.613763+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:16.695057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.603943+0000","last_change":"2024-04-25T10:02:50.597990+0000","last_active":"2024-04-25T10:02:50.603943+0000","last_peered":"2024-04-25T10:02:50.603943+0000","last_clean":"2024-04-25T10:02:50.603943+0000","last_became_active":"2024-04-25T10:02:50.597292+0000","last_became_peered":"2024-04-25T10:02:50.597292+0000","last_unstale":"2024-04-25T10:02:50.603943+0000","last_undegraded":"2024-04-25T10:02:50.603943+0000","last_fullsized":"2024-04-25T10:02:50.603943+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:50.079193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.603349+0000","last_change":"2024-04-25T10:02:49.601540+0000","last_active":"2024-04-25T10:02:49.603349+0000","last_peered":"2024-04-25T10:02:49.603349+0000","last_clean":"2024-04-25T10:02:49.603349+0000","last_became_active":"2024-04-25T10:02:49.601236+0000","last_became_peered":"2024-04-25T10:02:49.601236+0000","last_unstale":"2024-04-25T10:02:49.603349+0000","last_undegraded":"2024-04-25T10:02:49.603349+0000","last_fullsized":"2024-04-25T10:02:49.603349+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:02.585092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.583753+0000","last_change":"2024-04-25T10:02:49.583753+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.583753+0000","last_undegraded":"2024-04-25T10:02:49.583753+0000","last_fullsized":"2024-04-25T10:02:49.583753+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"102'1","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613424+0000","last_change":"2024-04-25T10:02:49.600687+0000","last_active":"2024-04-25T10:02:50.613424+0000","last_peered":"2024-04-25T10:02:50.613424+0000","last_clean":"2024-04-25T10:02:50.613424+0000","last_became_active":"2024-04-25T10:02:49.600405+0000","last_became_peered":"2024-04-25T10:02:49.600405+0000","last_unstale":"2024-04-25T10:02:50.613424+0000","last_undegraded":"2024-04-25T10:02:50.613424+0000","last_fullsized":"2024-04-25T10:02:50.613424+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:54:46.938087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.584373+0000","last_change":"2024-04-25T10:02:49.584373+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.584373+0000","last_undegraded":"2024-04-25T10:02:49.584373+0000","last_fullsized":"2024-04-25T10:02:49.584373+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"102'1","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613725+0000","last_change":"2024-04-25T10:02:49.599888+0000","last_active":"2024-04-25T10:02:50.613725+0000","last_peered":"2024-04-25T10:02:50.613725+0000","last_clean":"2024-04-25T10:02:50.613725+0000","last_became_active":"2024-04-25T10:02:49.599607+0000","last_became_peered":"2024-04-25T10:02:49.599607+0000","last_unstale":"2024-04-25T10:02:50.613725+0000","last_undegraded":"2024-04-25T10:02:50.613725+0000","last_fullsized":"2024-04-25T10:02:50.613725+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:46.336023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.608555+0000","last_change":"2024-04-25T10:02:50.602985+0000","last_active":"2024-04-25T10:02:50.608555+0000","last_peered":"2024-04-25T10:02:50.608555+0000","last_clean":"2024-04-25T10:02:50.608555+0000","last_became_active":"2024-04-25T10:02:50.602713+0000","last_became_peered":"2024-04-25T10:02:50.602713+0000","last_unstale":"2024-04-25T10:02:50.608555+0000","last_undegraded":"2024-04-25T10:02:50.608555+0000","last_fullsized":"2024-04-25T10:02:50.608555+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:49:13.711038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.585083+0000","last_change":"2024-04-25T10:02:49.598952+0000","last_active":"2024-04-25T10:02:50.585083+0000","last_peered":"2024-04-25T10:02:50.585083+0000","last_clean":"2024-04-25T10:02:50.585083+0000","last_became_active":"2024-04-25T10:02:49.598639+0000","last_became_peered":"2024-04-25T10:02:49.598639+0000","last_unstale":"2024-04-25T10:02:50.585083+0000","last_undegraded":"2024-04-25T10:02:50.585083+0000","last_fullsized":"2024-04-25T10:02:50.585083+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:49:12.699773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.583769+0000","last_change":"2024-04-25T10:02:49.583769+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.583769+0000","last_undegraded":"2024-04-25T10:02:49.583769+0000","last_fullsized":"2024-04-25T10:02:49.583769+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.590806+0000","last_change":"2024-04-25T10:02:49.589456+0000","last_active":"2024-04-25T10:02:49.590806+0000","last_peered":"2024-04-25T10:02:49.590806+0000","last_clean":"2024-04-25T10:02:49.590806+0000","last_became_active":"2024-04-25T10:02:49.589179+0000","last_became_peered":"2024-04-25T10:02:49.589179+0000","last_unstale":"2024-04-25T10:02:49.590806+0000","last_undegraded":"2024-04-25T10:02:49.590806+0000","last_fullsized":"2024-04-25T10:02:49.590806+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:54.456889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585585+0000","last_change":"2024-04-25T10:02:49.585585+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585585+0000","last_undegraded":"2024-04-25T10:02:49.585585+0000","last_fullsized":"2024-04-25T10:02:49.585585+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.585540+0000","last_change":"2024-04-25T10:02:49.599488+0000","last_active":"2024-04-25T10:02:50.585540+0000","last_peered":"2024-04-25T10:02:50.585540+0000","last_clean":"2024-04-25T10:02:50.585540+0000","last_became_active":"2024-04-25T10:02:49.599195+0000","last_became_peered":"2024-04-25T10:02:49.599195+0000","last_unstale":"2024-04-25T10:02:50.585540+0000","last_undegraded":"2024-04-25T10:02:50.585540+0000","last_fullsized":"2024-04-25T10:02:50.585540+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:15.089501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.587749+0000","last_change":"2024-04-25T10:02:49.587749+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.587749+0000","last_undegraded":"2024-04-25T10:02:49.587749+0000","last_fullsized":"2024-04-25T10:02:49.587749+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.600981+0000","last_change":"2024-04-25T10:02:49.600228+0000","last_active":"2024-04-25T10:02:49.600981+0000","last_peered":"2024-04-25T10:02:49.600981+0000","last_clean":"2024-04-25T10:02:49.600981+0000","last_became_active":"2024-04-25T10:02:49.599938+0000","last_became_peered":"2024-04-25T10:02:49.599938+0000","last_unstale":"2024-04-25T10:02:49.600981+0000","last_undegraded":"2024-04-25T10:02:49.600981+0000","last_fullsized":"2024-04-25T10:02:49.600981+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:36.517034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.593715+0000","last_change":"2024-04-25T10:02:49.593715+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.593715+0000","last_undegraded":"2024-04-25T10:02:49.593715+0000","last_fullsized":"2024-04-25T10:02:49.593715+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"102'3","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.615029+0000","last_change":"2024-04-25T10:02:49.595272+0000","last_active":"2024-04-25T10:02:50.615029+0000","last_peered":"2024-04-25T10:02:50.615029+0000","last_clean":"2024-04-25T10:02:50.615029+0000","last_became_active":"2024-04-25T10:02:49.594964+0000","last_became_peered":"2024-04-25T10:02:49.594964+0000","last_unstale":"2024-04-25T10:02:50.615029+0000","last_undegraded":"2024-04-25T10:02:50.615029+0000","last_fullsized":"2024-04-25T10:02:50.615029+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:04:50.351393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.586617+0000","last_change":"2024-04-25T10:02:49.586617+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.586617+0000","last_undegraded":"2024-04-25T10:02:49.586617+0000","last_fullsized":"2024-04-25T10:02:49.586617+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"102'6","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.622147+0000","last_change":"2024-04-25T10:02:49.596547+0000","last_active":"2024-04-25T10:02:50.622147+0000","last_peered":"2024-04-25T10:02:50.622147+0000","last_clean":"2024-04-25T10:02:50.622147+0000","last_became_active":"2024-04-25T10:02:49.596273+0000","last_became_peered":"2024-04-25T10:02:49.596273+0000","last_unstale":"2024-04-25T10:02:50.622147+0000","last_undegraded":"2024-04-25T10:02:50.622147+0000","last_fullsized":"2024-04-25T10:02:50.622147+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:28.059919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.617363+0000","last_change":"2024-04-25T10:02:50.609769+0000","last_active":"2024-04-25T10:02:50.617363+0000","last_peered":"2024-04-25T10:02:50.617363+0000","last_clean":"2024-04-25T10:02:50.617363+0000","last_became_active":"2024-04-25T10:02:50.609239+0000","last_became_peered":"2024-04-25T10:02:50.609239+0000","last_unstale":"2024-04-25T10:02:50.617363+0000","last_undegraded":"2024-04-25T10:02:50.617363+0000","last_fullsized":"2024-04-25T10:02:50.617363+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:55.468154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.599594+0000","last_change":"2024-04-25T10:02:49.598214+0000","last_active":"2024-04-25T10:02:49.599594+0000","last_peered":"2024-04-25T10:02:49.599594+0000","last_clean":"2024-04-25T10:02:49.599594+0000","last_became_active":"2024-04-25T10:02:49.597943+0000","last_became_peered":"2024-04-25T10:02:49.597943+0000","last_unstale":"2024-04-25T10:02:49.599594+0000","last_undegraded":"2024-04-25T10:02:49.599594+0000","last_fullsized":"2024-04-25T10:02:49.599594+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:05:23.495102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.608468+0000","last_change":"2024-04-25T10:02:50.600485+0000","last_active":"2024-04-25T10:02:50.608468+0000","last_peered":"2024-04-25T10:02:50.608468+0000","last_clean":"2024-04-25T10:02:50.608468+0000","last_became_active":"2024-04-25T10:02:50.600156+0000","last_became_peered":"2024-04-25T10:02:50.600156+0000","last_unstale":"2024-04-25T10:02:50.608468+0000","last_undegraded":"2024-04-25T10:02:50.608468+0000","last_fullsized":"2024-04-25T10:02:50.608468+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:17.706322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.595028+0000","last_change":"2024-04-25T10:02:49.594284+0000","last_active":"2024-04-25T10:02:49.595028+0000","last_peered":"2024-04-25T10:02:49.595028+0000","last_clean":"2024-04-25T10:02:49.595028+0000","last_became_active":"2024-04-25T10:02:49.593996+0000","last_became_peered":"2024-04-25T10:02:49.593996+0000","last_unstale":"2024-04-25T10:02:49.595028+0000","last_undegraded":"2024-04-25T10:02:49.595028+0000","last_fullsized":"2024-04-25T10:02:49.595028+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:16.312918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.594191+0000","last_change":"2024-04-25T10:02:49.594191+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.594191+0000","last_undegraded":"2024-04-25T10:02:49.594191+0000","last_fullsized":"2024-04-25T10:02:49.594191+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.604212+0000","last_change":"2024-04-25T10:02:49.603609+0000","last_active":"2024-04-25T10:02:49.604212+0000","last_peered":"2024-04-25T10:02:49.604212+0000","last_clean":"2024-04-25T10:02:49.604212+0000","last_became_active":"2024-04-25T10:02:49.603297+0000","last_became_peered":"2024-04-25T10:02:49.603297+0000","last_unstale":"2024-04-25T10:02:49.604212+0000","last_undegraded":"2024-04-25T10:02:49.604212+0000","last_fullsized":"2024-04-25T10:02:49.604212+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:44.744796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.584331+0000","last_change":"2024-04-25T10:02:49.584331+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.584331+0000","last_undegraded":"2024-04-25T10:02:49.584331+0000","last_fullsized":"2024-04-25T10:02:49.584331+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"102'8","reported_seq":20,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.618329+0000","last_change":"2024-04-25T10:02:49.598951+0000","last_active":"2024-04-25T10:02:50.618329+0000","last_peered":"2024-04-25T10:02:50.618329+0000","last_clean":"2024-04-25T10:02:50.618329+0000","last_became_active":"2024-04-25T10:02:49.598508+0000","last_became_peered":"2024-04-25T10:02:49.598508+0000","last_unstale":"2024-04-25T10:02:50.618329+0000","last_undegraded":"2024-04-25T10:02:50.618329+0000","last_fullsized":"2024-04-25T10:02:50.618329+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:34:24.518681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.592454+0000","last_change":"2024-04-25T10:02:49.592454+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.592454+0000","last_undegraded":"2024-04-25T10:02:49.592454+0000","last_fullsized":"2024-04-25T10:02:49.592454+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"102'1","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.617905+0000","last_change":"2024-04-25T10:02:49.605550+0000","last_active":"2024-04-25T10:02:50.617905+0000","last_peered":"2024-04-25T10:02:50.617905+0000","last_clean":"2024-04-25T10:02:50.617905+0000","last_became_active":"2024-04-25T10:02:49.605242+0000","last_became_peered":"2024-04-25T10:02:49.605242+0000","last_unstale":"2024-04-25T10:02:50.617905+0000","last_undegraded":"2024-04-25T10:02:50.617905+0000","last_fullsized":"2024-04-25T10:02:50.617905+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:41.634104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613130+0000","last_change":"2024-04-25T10:02:50.605531+0000","last_active":"2024-04-25T10:02:50.613130+0000","last_peered":"2024-04-25T10:02:50.613130+0000","last_clean":"2024-04-25T10:02:50.613130+0000","last_became_active":"2024-04-25T10:02:50.605229+0000","last_became_peered":"2024-04-25T10:02:50.605229+0000","last_unstale":"2024-04-25T10:02:50.613130+0000","last_undegraded":"2024-04-25T10:02:50.613130+0000","last_fullsized":"2024-04-25T10:02:50.613130+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:07.989371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"102'1","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.613455+0000","last_change":"2024-04-25T10:02:49.599107+0000","last_active":"2024-04-25T10:02:50.613455+0000","last_peered":"2024-04-25T10:02:50.613455+0000","last_clean":"2024-04-25T10:02:50.613455+0000","last_became_active":"2024-04-25T10:02:49.598627+0000","last_became_peered":"2024-04-25T10:02:49.598627+0000","last_unstale":"2024-04-25T10:02:50.613455+0000","last_undegraded":"2024-04-25T10:02:50.613455+0000","last_fullsized":"2024-04-25T10:02:50.613455+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:58.452441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.587028+0000","last_change":"2024-04-25T10:02:49.587028+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.587028+0000","last_undegraded":"2024-04-25T10:02:49.587028+0000","last_fullsized":"2024-04-25T10:02:49.587028+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.590432+0000","last_change":"2024-04-25T10:02:49.600728+0000","last_active":"2024-04-25T10:02:50.590432+0000","last_peered":"2024-04-25T10:02:50.590432+0000","last_clean":"2024-04-25T10:02:50.590432+0000","last_became_active":"2024-04-25T10:02:49.600439+0000","last_became_peered":"2024-04-25T10:02:49.600439+0000","last_unstale":"2024-04-25T10:02:50.590432+0000","last_undegraded":"2024-04-25T10:02:50.590432+0000","last_fullsized":"2024-04-25T10:02:50.590432+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:58.201064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.584662+0000","last_change":"2024-04-25T10:02:49.584662+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.584662+0000","last_undegraded":"2024-04-25T10:02:49.584662+0000","last_fullsized":"2024-04-25T10:02:49.584662+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.603838+0000","last_change":"2024-04-25T10:02:49.603196+0000","last_active":"2024-04-25T10:02:49.603838+0000","last_peered":"2024-04-25T10:02:49.603838+0000","last_clean":"2024-04-25T10:02:49.603838+0000","last_became_active":"2024-04-25T10:02:49.602809+0000","last_became_peered":"2024-04-25T10:02:49.602809+0000","last_unstale":"2024-04-25T10:02:49.603838+0000","last_undegraded":"2024-04-25T10:02:49.603838+0000","last_fullsized":"2024-04-25T10:02:49.603838+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:34.725327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.584993+0000","last_change":"2024-04-25T10:02:49.584993+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.584993+0000","last_undegraded":"2024-04-25T10:02:49.584993+0000","last_fullsized":"2024-04-25T10:02:49.584993+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.603096+0000","last_change":"2024-04-25T10:02:49.602636+0000","last_active":"2024-04-25T10:02:49.603096+0000","last_peered":"2024-04-25T10:02:49.603096+0000","last_clean":"2024-04-25T10:02:49.603096+0000","last_became_active":"2024-04-25T10:02:49.602376+0000","last_became_peered":"2024-04-25T10:02:49.602376+0000","last_unstale":"2024-04-25T10:02:49.603096+0000","last_undegraded":"2024-04-25T10:02:49.603096+0000","last_fullsized":"2024-04-25T10:02:49.603096+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:10.084009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.583767+0000","last_change":"2024-04-25T10:02:49.583767+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.583767+0000","last_undegraded":"2024-04-25T10:02:49.583767+0000","last_fullsized":"2024-04-25T10:02:49.583767+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.595549+0000","last_change":"2024-04-25T10:02:49.596692+0000","last_active":"2024-04-25T10:02:50.595549+0000","last_peered":"2024-04-25T10:02:50.595549+0000","last_clean":"2024-04-25T10:02:50.595549+0000","last_became_active":"2024-04-25T10:02:49.596371+0000","last_became_peered":"2024-04-25T10:02:49.596371+0000","last_unstale":"2024-04-25T10:02:50.595549+0000","last_undegraded":"2024-04-25T10:02:50.595549+0000","last_fullsized":"2024-04-25T10:02:50.595549+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:09.504320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.593530+0000","last_change":"2024-04-25T10:02:49.593530+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.593530+0000","last_undegraded":"2024-04-25T10:02:49.593530+0000","last_fullsized":"2024-04-25T10:02:49.593530+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.598418+0000","last_change":"2024-04-25T10:02:49.596751+0000","last_active":"2024-04-25T10:02:49.598418+0000","last_peered":"2024-04-25T10:02:49.598418+0000","last_clean":"2024-04-25T10:02:49.598418+0000","last_became_active":"2024-04-25T10:02:49.596497+0000","last_became_peered":"2024-04-25T10:02:49.596497+0000","last_unstale":"2024-04-25T10:02:49.598418+0000","last_undegraded":"2024-04-25T10:02:49.598418+0000","last_fullsized":"2024-04-25T10:02:49.598418+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:55.785270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.585994+0000","last_change":"2024-04-25T10:02:49.585994+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.585994+0000","last_undegraded":"2024-04-25T10:02:49.585994+0000","last_fullsized":"2024-04-25T10:02:49.585994+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.600871+0000","last_change":"2024-04-25T10:02:49.597614+0000","last_active":"2024-04-25T10:02:49.600871+0000","last_peered":"2024-04-25T10:02:49.600871+0000","last_clean":"2024-04-25T10:02:49.600871+0000","last_became_active":"2024-04-25T10:02:49.597315+0000","last_became_peered":"2024-04-25T10:02:49.597315+0000","last_unstale":"2024-04-25T10:02:49.600871+0000","last_undegraded":"2024-04-25T10:02:49.600871+0000","last_fullsized":"2024-04-25T10:02:49.600871+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:54.318211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.598481+0000","last_change":"2024-04-25T10:02:50.597174+0000","last_active":"2024-04-25T10:02:50.598481+0000","last_peered":"2024-04-25T10:02:50.598481+0000","last_clean":"2024-04-25T10:02:50.598481+0000","last_became_active":"2024-04-25T10:02:50.596881+0000","last_became_peered":"2024-04-25T10:02:50.596881+0000","last_unstale":"2024-04-25T10:02:50.598481+0000","last_undegraded":"2024-04-25T10:02:50.598481+0000","last_fullsized":"2024-04-25T10:02:50.598481+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:29:23.799255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.597653+0000","last_change":"2024-04-25T10:02:49.595969+0000","last_active":"2024-04-25T10:02:49.597653+0000","last_peered":"2024-04-25T10:02:49.597653+0000","last_clean":"2024-04-25T10:02:49.597653+0000","last_became_active":"2024-04-25T10:02:49.595693+0000","last_became_peered":"2024-04-25T10:02:49.595693+0000","last_unstale":"2024-04-25T10:02:49.597653+0000","last_undegraded":"2024-04-25T10:02:49.597653+0000","last_fullsized":"2024-04-25T10:02:49.597653+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:14.963530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.583995+0000","last_change":"2024-04-25T10:02:49.583995+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.583995+0000","last_undegraded":"2024-04-25T10:02:49.583995+0000","last_fullsized":"2024-04-25T10:02:49.583995+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.596214+0000","last_change":"2024-04-25T10:02:49.593862+0000","last_active":"2024-04-25T10:02:50.596214+0000","last_peered":"2024-04-25T10:02:50.596214+0000","last_clean":"2024-04-25T10:02:50.596214+0000","last_became_active":"2024-04-25T10:02:49.593554+0000","last_became_peered":"2024-04-25T10:02:49.593554+0000","last_unstale":"2024-04-25T10:02:50.596214+0000","last_undegraded":"2024-04-25T10:02:50.596214+0000","last_fullsized":"2024-04-25T10:02:50.596214+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:33.837038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.603964+0000","last_change":"2024-04-25T10:02:50.601221+0000","last_active":"2024-04-25T10:02:50.603964+0000","last_peered":"2024-04-25T10:02:50.603964+0000","last_clean":"2024-04-25T10:02:50.603964+0000","last_became_active":"2024-04-25T10:02:50.600909+0000","last_became_peered":"2024-04-25T10:02:50.600909+0000","last_unstale":"2024-04-25T10:02:50.603964+0000","last_undegraded":"2024-04-25T10:02:50.603964+0000","last_fullsized":"2024-04-25T10:02:50.603964+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:46.085984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.601700+0000","last_change":"2024-04-25T10:02:49.600863+0000","last_active":"2024-04-25T10:02:49.601700+0000","last_peered":"2024-04-25T10:02:49.601700+0000","last_clean":"2024-04-25T10:02:49.601700+0000","last_became_active":"2024-04-25T10:02:49.600571+0000","last_became_peered":"2024-04-25T10:02:49.600571+0000","last_unstale":"2024-04-25T10:02:49.601700+0000","last_undegraded":"2024-04-25T10:02:49.601700+0000","last_fullsized":"2024-04-25T10:02:49.601700+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:42.042387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.593132+0000","last_change":"2024-04-25T10:02:49.593132+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.593132+0000","last_undegraded":"2024-04-25T10:02:49.593132+0000","last_fullsized":"2024-04-25T10:02:49.593132+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.583742+0000","last_change":"2024-04-25T10:02:49.601012+0000","last_active":"2024-04-25T10:02:50.583742+0000","last_peered":"2024-04-25T10:02:50.583742+0000","last_clean":"2024-04-25T10:02:50.583742+0000","last_became_active":"2024-04-25T10:02:49.600731+0000","last_became_peered":"2024-04-25T10:02:49.600731+0000","last_unstale":"2024-04-25T10:02:50.583742+0000","last_undegraded":"2024-04-25T10:02:50.583742+0000","last_fullsized":"2024-04-25T10:02:50.583742+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:12.373559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-04-25T10:02:49.592072+0000","last_change":"2024-04-25T10:02:49.592072+0000","last_active":"2024-04-25T10:02:49.563723+0000","last_peered":"2024-04-25T10:02:49.563723+0000","last_clean":"2024-04-25T10:02:49.563723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:02:49.592072+0000","last_undegraded":"2024-04-25T10:02:49.592072+0000","last_fullsized":"2024-04-25T10:02:49.592072+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.602217+0000","last_change":"2024-04-25T10:02:49.600898+0000","last_active":"2024-04-25T10:02:49.602217+0000","last_peered":"2024-04-25T10:02:49.602217+0000","last_clean":"2024-04-25T10:02:49.602217+0000","last_became_active":"2024-04-25T10:02:49.600598+0000","last_became_peered":"2024-04-25T10:02:49.600598+0000","last_unstale":"2024-04-25T10:02:49.602217+0000","last_undegraded":"2024-04-25T10:02:49.602217+0000","last_fullsized":"2024-04-25T10:02:49.602217+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:03.344877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.603429+0000","last_change":"2024-04-25T10:02:50.602017+0000","last_active":"2024-04-25T10:02:50.603429+0000","last_peered":"2024-04-25T10:02:50.603429+0000","last_clean":"2024-04-25T10:02:50.603429+0000","last_became_active":"2024-04-25T10:02:50.601702+0000","last_became_peered":"2024-04-25T10:02:50.601702+0000","last_unstale":"2024-04-25T10:02:50.603429+0000","last_undegraded":"2024-04-25T10:02:50.603429+0000","last_fullsized":"2024-04-25T10:02:50.603429+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:36.647239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.595712+0000","last_change":"2024-04-25T10:02:49.592618+0000","last_active":"2024-04-25T10:02:50.595712+0000","last_peered":"2024-04-25T10:02:50.595712+0000","last_clean":"2024-04-25T10:02:50.595712+0000","last_became_active":"2024-04-25T10:02:49.592337+0000","last_became_peered":"2024-04-25T10:02:49.592337+0000","last_unstale":"2024-04-25T10:02:50.595712+0000","last_undegraded":"2024-04-25T10:02:50.595712+0000","last_fullsized":"2024-04-25T10:02:50.595712+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:37.202053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.601041+0000","last_change":"2024-04-25T10:02:50.593723+0000","last_active":"2024-04-25T10:02:50.601041+0000","last_peered":"2024-04-25T10:02:50.601041+0000","last_clean":"2024-04-25T10:02:50.601041+0000","last_became_active":"2024-04-25T10:02:50.593409+0000","last_became_peered":"2024-04-25T10:02:50.593409+0000","last_unstale":"2024-04-25T10:02:50.601041+0000","last_undegraded":"2024-04-25T10:02:50.601041+0000","last_fullsized":"2024-04-25T10:02:50.601041+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:44:14.466542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.602152+0000","last_change":"2024-04-25T10:02:49.599898+0000","last_active":"2024-04-25T10:02:49.602152+0000","last_peered":"2024-04-25T10:02:49.602152+0000","last_clean":"2024-04-25T10:02:49.602152+0000","last_became_active":"2024-04-25T10:02:49.599612+0000","last_became_peered":"2024-04-25T10:02:49.599612+0000","last_unstale":"2024-04-25T10:02:49.602152+0000","last_undegraded":"2024-04-25T10:02:49.602152+0000","last_fullsized":"2024-04-25T10:02:49.602152+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:05:42.694860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.612908+0000","last_change":"2024-04-25T10:02:50.605854+0000","last_active":"2024-04-25T10:02:50.612908+0000","last_peered":"2024-04-25T10:02:50.612908+0000","last_clean":"2024-04-25T10:02:50.612908+0000","last_became_active":"2024-04-25T10:02:50.605508+0000","last_became_peered":"2024-04-25T10:02:50.605508+0000","last_unstale":"2024-04-25T10:02:50.612908+0000","last_undegraded":"2024-04-25T10:02:50.612908+0000","last_fullsized":"2024-04-25T10:02:50.612908+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:28.150965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T10:02:49.598822+0000","last_change":"2024-04-25T10:02:49.598137+0000","last_active":"2024-04-25T10:02:49.598822+0000","last_peered":"2024-04-25T10:02:49.598822+0000","last_clean":"2024-04-25T10:02:49.598822+0000","last_became_active":"2024-04-25T10:02:49.597841+0000","last_became_peered":"2024-04-25T10:02:49.597841+0000","last_unstale":"2024-04-25T10:02:49.598822+0000","last_undegraded":"2024-04-25T10:02:49.598822+0000","last_fullsized":"2024-04-25T10:02:49.598822+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:42.504597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":321,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-25T10:02:50.587486+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T10:02:50.587486+0000","last_peered":"2024-04-25T10:02:50.587486+0000","last_clean":"2024-04-25T10:02:50.587486+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T10:02:50.587486+0000","last_undegraded":"2024-04-25T10:02:50.587486+0000","last_fullsized":"2024-04-25T10:02:50.587486+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":1794,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23,"ondisk_log_size":23,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542250,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33008,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338832,"statfs":{"total":96636764160,"available":96602963968,"internally_reserved":0,"allocated":1863680,"data_stored":1174185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542250,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1249280,"data_stored":576490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542252,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1261568,"data_stored":583657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542249,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1249280,"data_stored":576490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574954,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1236992,"data_stored":569823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1236992,"data_stored":569823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1249280,"data_stored":576490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574954,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32988,"kb_used_data":1800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338852,"statfs":{"total":96636764160,"available":96602984448,"internally_reserved":0,"allocated":1843200,"data_stored":1166858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:02:57.203 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:02:57.206 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:02:58.037 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:02:58.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.144+0000 7f441111d640 1 Processor -- start 2024-04-25T10:02:58.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.145+0000 7f441111d640 1 -- start start 2024-04-25T10:02:58.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.145+0000 7f441111d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f440c144100 0x7f440c0cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:58.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.145+0000 7f441111d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f440c06e970 0x7f440c15b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:58.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.145+0000 7f441111d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f440c0cdbf0 con 0x7f440c0ced20 2024-04-25T10:02:58.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.145+0000 7f441111d640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f440c1444e0 con 0x7f440c144100 2024-04-25T10:02:58.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.145+0000 7f441111d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f440c15ac70 con 0x7f440c06e970 2024-04-25T10:02:58.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.146+0000 7f440ad9d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f440c144100 0x7f440c0cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:58.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.146+0000 7f440ad9d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f440c144100 0x7f440c0cd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44262/0 (socket says 172.21.15.7:44262) 2024-04-25T10:02:58.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.146+0000 7f440ad9d640 1 -- 172.21.15.7:0/302702869 learned_addr learned my addr 172.21.15.7:0/302702869 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:58.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.146+0000 7f440b59e640 1 --2- 172.21.15.7:0/302702869 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f440c06e970 0x7f440c15b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:58.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.146+0000 7f440ad9d640 1 -- 172.21.15.7:0/302702869 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f440c06e970 msgr2=0x7f440c15b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:58.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.146+0000 7f440ad9d640 1 --2- 172.21.15.7:0/302702869 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f440c06e970 0x7f440c15b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:58.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.146+0000 7f440ad9d640 1 -- 172.21.15.7:0/302702869 >> v1:172.21.15.55:6789/0 conn(0x7f440c0ced20 legacy=0x7f440c06e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:58.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.146+0000 7f440ad9d640 1 -- 172.21.15.7:0/302702869 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f440c0cded0 con 0x7f440c144100 2024-04-25T10:02:58.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.147+0000 7f440ad9d640 1 --2- 172.21.15.7:0/302702869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f440c144100 0x7f440c0cd610 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f43fc009870 tx=0x7f43fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78ca034c4a4dbe9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:58.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.147+0000 7f4409d9b640 1 -- 172.21.15.7:0/302702869 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc037070 con 0x7f440c144100 2024-04-25T10:02:58.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.147+0000 7f4409d9b640 1 -- 172.21.15.7:0/302702869 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43fc032440 con 0x7f440c144100 2024-04-25T10:02:58.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.147+0000 7f4409d9b640 1 -- 172.21.15.7:0/302702869 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc032810 con 0x7f440c144100 2024-04-25T10:02:58.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.147+0000 7f441111d640 1 -- 172.21.15.7:0/302702869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f440c144100 msgr2=0x7f440c0cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:58.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.147+0000 7f441111d640 1 --2- 172.21.15.7:0/302702869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f440c144100 0x7f440c0cd610 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f43fc009870 tx=0x7f43fc02a270 comp rx=0 tx=0).stop 2024-04-25T10:02:58.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.147+0000 7f441111d640 1 -- 172.21.15.7:0/302702869 shutdown_connections 2024-04-25T10:02:58.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.147+0000 7f441111d640 1 --2- 172.21.15.7:0/302702869 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f440c06e970 0x7f440c15b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:58.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.147+0000 7f441111d640 1 --2- 172.21.15.7:0/302702869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f440c144100 0x7f440c0cd610 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:58.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.147+0000 7f441111d640 1 -- 172.21.15.7:0/302702869 >> 172.21.15.7:0/302702869 conn(0x7f440c071150 msgr2=0x7f440c071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:58.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.147+0000 7f441111d640 1 -- 172.21.15.7:0/302702869 shutdown_connections 2024-04-25T10:02:58.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.148+0000 7f441111d640 1 -- 172.21.15.7:0/302702869 wait complete. 2024-04-25T10:02:58.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.149+0000 7f441111d640 1 Processor -- start 2024-04-25T10:02:58.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.149+0000 7f441111d640 1 -- start start 2024-04-25T10:02:58.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.150+0000 7f441111d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f440c06e970 0x7f440c15a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:58.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.150+0000 7f441111d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f440c0ced20 0x7f440c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:58.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.150+0000 7f441111d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f440c144100 0x7f440c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:58.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.150+0000 7f441111d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440c0cea00 con 0x7f440c0ced20 2024-04-25T10:02:58.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.150+0000 7f441111d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440c0ce490 con 0x7f440c144100 2024-04-25T10:02:58.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.150+0000 7f441111d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f440c15b670 con 0x7f440c06e970 2024-04-25T10:02:58.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.150+0000 7f440a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f440c0ced20 0x7f440c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:58.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.150+0000 7f440a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f440c0ced20 0x7f440c06d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44270/0 (socket says 172.21.15.7:44270) 2024-04-25T10:02:58.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.150+0000 7f440a59c640 1 -- 172.21.15.7:0/701097587 learned_addr learned my addr 172.21.15.7:0/701097587 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:58.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.150+0000 7f440ad9d640 1 --2- 172.21.15.7:0/701097587 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f440c06e970 0x7f440c15a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:58.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.150+0000 7f440b59e640 1 --2- 172.21.15.7:0/701097587 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f440c144100 0x7f440c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:58.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.150+0000 7f440a59c640 1 -- 172.21.15.7:0/701097587 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f440c06e970 msgr2=0x7f440c15a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:58.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.150+0000 7f440a59c640 1 --2- 172.21.15.7:0/701097587 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f440c06e970 0x7f440c15a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:58.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.150+0000 7f440a59c640 1 -- 172.21.15.7:0/701097587 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f440c144100 msgr2=0x7f440c06d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:58.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.150+0000 7f440a59c640 1 --2- 172.21.15.7:0/701097587 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f440c144100 0x7f440c06d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:58.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.150+0000 7f440a59c640 1 -- 172.21.15.7:0/701097587 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f440c13dc10 con 0x7f440c0ced20 2024-04-25T10:02:58.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.150+0000 7f440a59c640 1 --2- 172.21.15.7:0/701097587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f440c0ced20 0x7f440c06d150 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f440000c430 tx=0x7f440000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:58.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.151+0000 7f43f37fe640 1 -- 172.21.15.7:0/701097587 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44000052d0 con 0x7f440c0ced20 2024-04-25T10:02:58.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.151+0000 7f43f37fe640 1 -- 172.21.15.7:0/701097587 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4400005490 con 0x7f440c0ced20 2024-04-25T10:02:58.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.151+0000 7f441111d640 1 -- 172.21.15.7:0/701097587 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f440c0b3690 con 0x7f440c0ced20 2024-04-25T10:02:58.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.151+0000 7f43f37fe640 1 -- 172.21.15.7:0/701097587 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4400007260 con 0x7f440c0ced20 2024-04-25T10:02:58.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.151+0000 7f441111d640 1 -- 172.21.15.7:0/701097587 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f440c13e190 con 0x7f440c0ced20 2024-04-25T10:02:58.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.152+0000 7f441111d640 1 -- 172.21.15.7:0/701097587 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f440c13e390 con 0x7f440c0ced20 2024-04-25T10:02:58.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.152+0000 7f43f37fe640 1 -- 172.21.15.7:0/701097587 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4400007400 con 0x7f440c0ced20 2024-04-25T10:02:58.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.153+0000 7f43f37fe640 1 --2- 172.21.15.7:0/701097587 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f43f806b4d0 0x7f43f806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:58.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.153+0000 7f43f37fe640 1 -- 172.21.15.7:0/701097587 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4400089880 con 0x7f440c0ced20 2024-04-25T10:02:58.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.153+0000 7f440ad9d640 1 --2- 172.21.15.7:0/701097587 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f43f806b4d0 0x7f43f806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:58.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.153+0000 7f440ad9d640 1 --2- 172.21.15.7:0/701097587 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f43f806b4d0 0x7f43f806d990 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f43fc034000 tx=0x7f43fc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:58.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.157+0000 7f43f37fe640 1 -- 172.21.15.7:0/701097587 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f440c13e390 con 0x7f440c0ced20 2024-04-25T10:02:58.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.334+0000 7f441111d640 1 -- 172.21.15.7:0/701097587 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f440c068fd0 con 0x7f43f806b4d0 2024-04-25T10:02:58.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.340+0000 7f43f37fe640 1 -- 172.21.15.7:0/701097587 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252450 (secure 0 0 0) 0x7f440c068fd0 con 0x7f43f806b4d0 2024-04-25T10:02:58.347 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:02:58.349 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T10:02:58.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.343+0000 7f441111d640 1 -- 172.21.15.7:0/701097587 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f43f806b4d0 msgr2=0x7f43f806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:58.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.343+0000 7f441111d640 1 --2- 172.21.15.7:0/701097587 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f43f806b4d0 0x7f43f806d990 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f43fc034000 tx=0x7f43fc02e000 comp rx=0 tx=0).stop 2024-04-25T10:02:58.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.343+0000 7f441111d640 1 -- 172.21.15.7:0/701097587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f440c0ced20 msgr2=0x7f440c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:58.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.343+0000 7f441111d640 1 --2- 172.21.15.7:0/701097587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f440c0ced20 0x7f440c06d150 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f440000c430 tx=0x7f440000c8f0 comp rx=0 tx=0).stop 2024-04-25T10:02:58.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.344+0000 7f441111d640 1 -- 172.21.15.7:0/701097587 shutdown_connections 2024-04-25T10:02:58.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.344+0000 7f441111d640 1 --2- 172.21.15.7:0/701097587 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f43f806b4d0 0x7f43f806d990 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:58.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.344+0000 7f441111d640 1 --2- 172.21.15.7:0/701097587 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f440c144100 0x7f440c06d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:58.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.344+0000 7f441111d640 1 --2- 172.21.15.7:0/701097587 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f440c0ced20 0x7f440c06d150 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:58.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.344+0000 7f441111d640 1 --2- 172.21.15.7:0/701097587 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f440c06e970 0x7f440c15a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:58.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.344+0000 7f441111d640 1 -- 172.21.15.7:0/701097587 >> 172.21.15.7:0/701097587 conn(0x7f440c071150 msgr2=0x7f440c13d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:58.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.344+0000 7f441111d640 1 -- 172.21.15.7:0/701097587 shutdown_connections 2024-04-25T10:02:58.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.344+0000 7f441111d640 1 -- 172.21.15.7:0/701097587 wait complete. 2024-04-25T10:02:58.359 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":358,"stamp":"2024-04-25T10:02:57.972440+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260636,"kb_used_data":11176,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714084,"statfs":{"total":773094113280,"available":772827222016,"internally_reserved":0,"allocated":11444224,"data_stored":5908348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002177"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.599845+0000","last_change":"2024-04-25T10:02:50.604622+0000","last_active":"2024-04-25T10:02:51.599845+0000","last_peered":"2024-04-25T10:02:51.599845+0000","last_clean":"2024-04-25T10:02:51.599845+0000","last_became_active":"2024-04-25T10:02:50.604280+0000","last_became_peered":"2024-04-25T10:02:50.604280+0000","last_unstale":"2024-04-25T10:02:51.599845+0000","last_undegraded":"2024-04-25T10:02:51.599845+0000","last_fullsized":"2024-04-25T10:02:51.599845+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:36.381278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.690851+0000","last_change":"2024-04-25T10:02:50.603031+0000","last_active":"2024-04-25T10:02:52.690851+0000","last_peered":"2024-04-25T10:02:52.690851+0000","last_clean":"2024-04-25T10:02:52.690851+0000","last_became_active":"2024-04-25T10:02:50.602748+0000","last_became_peered":"2024-04-25T10:02:50.602748+0000","last_unstale":"2024-04-25T10:02:52.690851+0000","last_undegraded":"2024-04-25T10:02:52.690851+0000","last_fullsized":"2024-04-25T10:02:52.690851+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:50.079193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.599535+0000","last_change":"2024-04-25T10:02:50.591920+0000","last_active":"2024-04-25T10:02:51.599535+0000","last_peered":"2024-04-25T10:02:51.599535+0000","last_clean":"2024-04-25T10:02:51.599535+0000","last_became_active":"2024-04-25T10:02:50.591647+0000","last_became_peered":"2024-04-25T10:02:50.591647+0000","last_unstale":"2024-04-25T10:02:51.599535+0000","last_undegraded":"2024-04-25T10:02:51.599535+0000","last_fullsized":"2024-04-25T10:02:51.599535+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:30.408117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.003576+0000","last_change":"2024-04-25T10:02:50.599454+0000","last_active":"2024-04-25T10:02:52.003576+0000","last_peered":"2024-04-25T10:02:52.003576+0000","last_clean":"2024-04-25T10:02:52.003576+0000","last_became_active":"2024-04-25T10:02:50.599129+0000","last_became_peered":"2024-04-25T10:02:50.599129+0000","last_unstale":"2024-04-25T10:02:52.003576+0000","last_undegraded":"2024-04-25T10:02:52.003576+0000","last_fullsized":"2024-04-25T10:02:52.003576+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:51.850946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.188837+0000","last_change":"2024-04-25T10:02:50.601016+0000","last_active":"2024-04-25T10:02:52.188837+0000","last_peered":"2024-04-25T10:02:52.188837+0000","last_clean":"2024-04-25T10:02:52.188837+0000","last_became_active":"2024-04-25T10:02:50.600390+0000","last_became_peered":"2024-04-25T10:02:50.600390+0000","last_unstale":"2024-04-25T10:02:52.188837+0000","last_undegraded":"2024-04-25T10:02:52.188837+0000","last_fullsized":"2024-04-25T10:02:52.188837+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:07.989371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.690146+0000","last_change":"2024-04-25T10:02:50.600787+0000","last_active":"2024-04-25T10:02:52.690146+0000","last_peered":"2024-04-25T10:02:52.690146+0000","last_clean":"2024-04-25T10:02:52.690146+0000","last_became_active":"2024-04-25T10:02:50.599972+0000","last_became_peered":"2024-04-25T10:02:50.599972+0000","last_unstale":"2024-04-25T10:02:52.690146+0000","last_undegraded":"2024-04-25T10:02:52.690146+0000","last_fullsized":"2024-04-25T10:02:52.690146+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:47.347288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.689916+0000","last_change":"2024-04-25T10:02:50.598983+0000","last_active":"2024-04-25T10:02:52.689916+0000","last_peered":"2024-04-25T10:02:52.689916+0000","last_clean":"2024-04-25T10:02:52.689916+0000","last_became_active":"2024-04-25T10:02:50.598041+0000","last_became_peered":"2024-04-25T10:02:50.598041+0000","last_unstale":"2024-04-25T10:02:52.689916+0000","last_undegraded":"2024-04-25T10:02:52.689916+0000","last_fullsized":"2024-04-25T10:02:52.689916+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:25.592490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.689359+0000","last_change":"2024-04-25T10:02:50.604758+0000","last_active":"2024-04-25T10:02:52.689359+0000","last_peered":"2024-04-25T10:02:52.689359+0000","last_clean":"2024-04-25T10:02:52.689359+0000","last_became_active":"2024-04-25T10:02:50.604461+0000","last_became_peered":"2024-04-25T10:02:50.604461+0000","last_unstale":"2024-04-25T10:02:52.689359+0000","last_undegraded":"2024-04-25T10:02:52.689359+0000","last_fullsized":"2024-04-25T10:02:52.689359+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:20.303178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.690806+0000","last_change":"2024-04-25T10:02:50.600374+0000","last_active":"2024-04-25T10:02:52.690806+0000","last_peered":"2024-04-25T10:02:52.690806+0000","last_clean":"2024-04-25T10:02:52.690806+0000","last_became_active":"2024-04-25T10:02:50.600063+0000","last_became_peered":"2024-04-25T10:02:50.600063+0000","last_unstale":"2024-04-25T10:02:52.690806+0000","last_undegraded":"2024-04-25T10:02:52.690806+0000","last_fullsized":"2024-04-25T10:02:52.690806+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:00.445645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.189109+0000","last_change":"2024-04-25T10:02:50.601546+0000","last_active":"2024-04-25T10:02:52.189109+0000","last_peered":"2024-04-25T10:02:52.189109+0000","last_clean":"2024-04-25T10:02:52.189109+0000","last_became_active":"2024-04-25T10:02:50.601278+0000","last_became_peered":"2024-04-25T10:02:50.601278+0000","last_unstale":"2024-04-25T10:02:52.189109+0000","last_undegraded":"2024-04-25T10:02:52.189109+0000","last_fullsized":"2024-04-25T10:02:52.189109+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:47.347288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.691020+0000","last_change":"2024-04-25T10:02:50.597667+0000","last_active":"2024-04-25T10:02:52.691020+0000","last_peered":"2024-04-25T10:02:52.691020+0000","last_clean":"2024-04-25T10:02:52.691020+0000","last_became_active":"2024-04-25T10:02:50.597380+0000","last_became_peered":"2024-04-25T10:02:50.597380+0000","last_unstale":"2024-04-25T10:02:52.691020+0000","last_undegraded":"2024-04-25T10:02:52.691020+0000","last_fullsized":"2024-04-25T10:02:52.691020+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:04:51.362659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.608555+0000","last_change":"2024-04-25T10:02:50.597126+0000","last_active":"2024-04-25T10:02:51.608555+0000","last_peered":"2024-04-25T10:02:51.608555+0000","last_clean":"2024-04-25T10:02:51.608555+0000","last_became_active":"2024-04-25T10:02:50.596838+0000","last_became_peered":"2024-04-25T10:02:50.596838+0000","last_unstale":"2024-04-25T10:02:51.608555+0000","last_undegraded":"2024-04-25T10:02:51.608555+0000","last_fullsized":"2024-04-25T10:02:51.608555+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:28.150965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.003434+0000","last_change":"2024-04-25T10:02:50.607460+0000","last_active":"2024-04-25T10:02:52.003434+0000","last_peered":"2024-04-25T10:02:52.003434+0000","last_clean":"2024-04-25T10:02:52.003434+0000","last_became_active":"2024-04-25T10:02:50.607158+0000","last_became_peered":"2024-04-25T10:02:50.607158+0000","last_unstale":"2024-04-25T10:02:52.003434+0000","last_undegraded":"2024-04-25T10:02:52.003434+0000","last_fullsized":"2024-04-25T10:02:52.003434+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:40.513789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.805670+0000","last_change":"2024-04-25T10:02:50.594589+0000","last_active":"2024-04-25T10:02:51.805670+0000","last_peered":"2024-04-25T10:02:51.805670+0000","last_clean":"2024-04-25T10:02:51.805670+0000","last_became_active":"2024-04-25T10:02:50.594292+0000","last_became_peered":"2024-04-25T10:02:50.594292+0000","last_unstale":"2024-04-25T10:02:51.805670+0000","last_undegraded":"2024-04-25T10:02:51.805670+0000","last_fullsized":"2024-04-25T10:02:51.805670+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:53.249661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.805649+0000","last_change":"2024-04-25T10:02:50.602757+0000","last_active":"2024-04-25T10:02:51.805649+0000","last_peered":"2024-04-25T10:02:51.805649+0000","last_clean":"2024-04-25T10:02:51.805649+0000","last_became_active":"2024-04-25T10:02:50.602479+0000","last_became_peered":"2024-04-25T10:02:50.602479+0000","last_unstale":"2024-04-25T10:02:51.805649+0000","last_undegraded":"2024-04-25T10:02:51.805649+0000","last_fullsized":"2024-04-25T10:02:51.805649+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:32.580337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.805643+0000","last_change":"2024-04-25T10:02:50.611124+0000","last_active":"2024-04-25T10:02:51.805643+0000","last_peered":"2024-04-25T10:02:51.805643+0000","last_clean":"2024-04-25T10:02:51.805643+0000","last_became_active":"2024-04-25T10:02:50.610797+0000","last_became_peered":"2024-04-25T10:02:50.610797+0000","last_unstale":"2024-04-25T10:02:51.805643+0000","last_undegraded":"2024-04-25T10:02:51.805643+0000","last_fullsized":"2024-04-25T10:02:51.805643+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:16.366474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.599888+0000","last_change":"2024-04-25T10:02:50.591606+0000","last_active":"2024-04-25T10:02:51.599888+0000","last_peered":"2024-04-25T10:02:51.599888+0000","last_clean":"2024-04-25T10:02:51.599888+0000","last_became_active":"2024-04-25T10:02:50.591286+0000","last_became_peered":"2024-04-25T10:02:50.591286+0000","last_unstale":"2024-04-25T10:02:51.599888+0000","last_undegraded":"2024-04-25T10:02:51.599888+0000","last_fullsized":"2024-04-25T10:02:51.599888+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:06.420825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.691058+0000","last_change":"2024-04-25T10:02:50.599375+0000","last_active":"2024-04-25T10:02:52.691058+0000","last_peered":"2024-04-25T10:02:52.691058+0000","last_clean":"2024-04-25T10:02:52.691058+0000","last_became_active":"2024-04-25T10:02:50.599069+0000","last_became_peered":"2024-04-25T10:02:50.599069+0000","last_unstale":"2024-04-25T10:02:52.691058+0000","last_undegraded":"2024-04-25T10:02:52.691058+0000","last_fullsized":"2024-04-25T10:02:52.691058+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:46.085984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.599689+0000","last_change":"2024-04-25T10:02:50.598042+0000","last_active":"2024-04-25T10:02:51.599689+0000","last_peered":"2024-04-25T10:02:51.599689+0000","last_clean":"2024-04-25T10:02:51.599689+0000","last_became_active":"2024-04-25T10:02:50.597747+0000","last_became_peered":"2024-04-25T10:02:50.597747+0000","last_unstale":"2024-04-25T10:02:51.599689+0000","last_undegraded":"2024-04-25T10:02:51.599689+0000","last_fullsized":"2024-04-25T10:02:51.599689+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:45.519745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.608702+0000","last_change":"2024-04-25T10:02:50.592377+0000","last_active":"2024-04-25T10:02:51.608702+0000","last_peered":"2024-04-25T10:02:51.608702+0000","last_clean":"2024-04-25T10:02:51.608702+0000","last_became_active":"2024-04-25T10:02:50.592080+0000","last_became_peered":"2024-04-25T10:02:50.592080+0000","last_unstale":"2024-04-25T10:02:51.608702+0000","last_undegraded":"2024-04-25T10:02:51.608702+0000","last_fullsized":"2024-04-25T10:02:51.608702+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:55.468154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.689645+0000","last_change":"2024-04-25T10:02:50.605740+0000","last_active":"2024-04-25T10:02:52.689645+0000","last_peered":"2024-04-25T10:02:52.689645+0000","last_clean":"2024-04-25T10:02:52.689645+0000","last_became_active":"2024-04-25T10:02:50.605167+0000","last_became_peered":"2024-04-25T10:02:50.605167+0000","last_unstale":"2024-04-25T10:02:52.689645+0000","last_undegraded":"2024-04-25T10:02:52.689645+0000","last_fullsized":"2024-04-25T10:02:52.689645+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:48:12.198786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.188898+0000","last_change":"2024-04-25T10:02:50.595854+0000","last_active":"2024-04-25T10:02:52.188898+0000","last_peered":"2024-04-25T10:02:52.188898+0000","last_clean":"2024-04-25T10:02:52.188898+0000","last_became_active":"2024-04-25T10:02:50.595532+0000","last_became_peered":"2024-04-25T10:02:50.595532+0000","last_unstale":"2024-04-25T10:02:52.188898+0000","last_undegraded":"2024-04-25T10:02:52.188898+0000","last_fullsized":"2024-04-25T10:02:52.188898+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:08.637593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.599425+0000","last_change":"2024-04-25T10:02:50.592265+0000","last_active":"2024-04-25T10:02:51.599425+0000","last_peered":"2024-04-25T10:02:51.599425+0000","last_clean":"2024-04-25T10:02:51.599425+0000","last_became_active":"2024-04-25T10:02:50.591269+0000","last_became_peered":"2024-04-25T10:02:50.591269+0000","last_unstale":"2024-04-25T10:02:51.599425+0000","last_undegraded":"2024-04-25T10:02:51.599425+0000","last_fullsized":"2024-04-25T10:02:51.599425+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:02.503131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.188737+0000","last_change":"2024-04-25T10:02:50.606408+0000","last_active":"2024-04-25T10:02:52.188737+0000","last_peered":"2024-04-25T10:02:52.188737+0000","last_clean":"2024-04-25T10:02:52.188737+0000","last_became_active":"2024-04-25T10:02:50.606109+0000","last_became_peered":"2024-04-25T10:02:50.606109+0000","last_unstale":"2024-04-25T10:02:52.188737+0000","last_undegraded":"2024-04-25T10:02:52.188737+0000","last_fullsized":"2024-04-25T10:02:52.188737+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:48.165008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.608264+0000","last_change":"2024-04-25T10:02:50.593306+0000","last_active":"2024-04-25T10:02:51.608264+0000","last_peered":"2024-04-25T10:02:51.608264+0000","last_clean":"2024-04-25T10:02:51.608264+0000","last_became_active":"2024-04-25T10:02:50.593032+0000","last_became_peered":"2024-04-25T10:02:50.593032+0000","last_unstale":"2024-04-25T10:02:51.608264+0000","last_undegraded":"2024-04-25T10:02:51.608264+0000","last_fullsized":"2024-04-25T10:02:51.608264+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:00.445645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.608469+0000","last_change":"2024-04-25T10:02:50.600711+0000","last_active":"2024-04-25T10:02:51.608469+0000","last_peered":"2024-04-25T10:02:51.608469+0000","last_clean":"2024-04-25T10:02:51.608469+0000","last_became_active":"2024-04-25T10:02:50.600415+0000","last_became_peered":"2024-04-25T10:02:50.600415+0000","last_unstale":"2024-04-25T10:02:51.608469+0000","last_undegraded":"2024-04-25T10:02:51.608469+0000","last_fullsized":"2024-04-25T10:02:51.608469+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:46.085984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.691119+0000","last_change":"2024-04-25T10:02:50.592967+0000","last_active":"2024-04-25T10:02:52.691119+0000","last_peered":"2024-04-25T10:02:52.691119+0000","last_clean":"2024-04-25T10:02:52.691119+0000","last_became_active":"2024-04-25T10:02:50.592601+0000","last_became_peered":"2024-04-25T10:02:50.592601+0000","last_unstale":"2024-04-25T10:02:52.691119+0000","last_undegraded":"2024-04-25T10:02:52.691119+0000","last_fullsized":"2024-04-25T10:02:52.691119+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:59.463706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.690204+0000","last_change":"2024-04-25T10:02:50.604355+0000","last_active":"2024-04-25T10:02:52.690204+0000","last_peered":"2024-04-25T10:02:52.690204+0000","last_clean":"2024-04-25T10:02:52.690204+0000","last_became_active":"2024-04-25T10:02:50.603745+0000","last_became_peered":"2024-04-25T10:02:50.603745+0000","last_unstale":"2024-04-25T10:02:52.690204+0000","last_undegraded":"2024-04-25T10:02:52.690204+0000","last_fullsized":"2024-04-25T10:02:52.690204+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:59.212329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.689643+0000","last_change":"2024-04-25T10:02:50.610949+0000","last_active":"2024-04-25T10:02:52.689643+0000","last_peered":"2024-04-25T10:02:52.689643+0000","last_clean":"2024-04-25T10:02:52.689643+0000","last_became_active":"2024-04-25T10:02:50.610610+0000","last_became_peered":"2024-04-25T10:02:50.610610+0000","last_unstale":"2024-04-25T10:02:52.689643+0000","last_undegraded":"2024-04-25T10:02:52.689643+0000","last_fullsized":"2024-04-25T10:02:52.689643+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:43.842056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.608394+0000","last_change":"2024-04-25T10:02:50.590740+0000","last_active":"2024-04-25T10:02:51.608394+0000","last_peered":"2024-04-25T10:02:51.608394+0000","last_clean":"2024-04-25T10:02:51.608394+0000","last_became_active":"2024-04-25T10:02:50.590423+0000","last_became_peered":"2024-04-25T10:02:50.590423+0000","last_unstale":"2024-04-25T10:02:51.608394+0000","last_undegraded":"2024-04-25T10:02:51.608394+0000","last_fullsized":"2024-04-25T10:02:51.608394+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:50.079193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.690041+0000","last_change":"2024-04-25T10:02:50.605847+0000","last_active":"2024-04-25T10:02:52.690041+0000","last_peered":"2024-04-25T10:02:52.690041+0000","last_clean":"2024-04-25T10:02:52.690041+0000","last_became_active":"2024-04-25T10:02:50.605541+0000","last_became_peered":"2024-04-25T10:02:50.605541+0000","last_unstale":"2024-04-25T10:02:52.690041+0000","last_undegraded":"2024-04-25T10:02:52.690041+0000","last_fullsized":"2024-04-25T10:02:52.690041+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:29:23.799255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.689443+0000","last_change":"2024-04-25T10:02:50.609913+0000","last_active":"2024-04-25T10:02:52.689443+0000","last_peered":"2024-04-25T10:02:52.689443+0000","last_clean":"2024-04-25T10:02:52.689443+0000","last_became_active":"2024-04-25T10:02:50.609563+0000","last_became_peered":"2024-04-25T10:02:50.609563+0000","last_unstale":"2024-04-25T10:02:52.689443+0000","last_undegraded":"2024-04-25T10:02:52.689443+0000","last_fullsized":"2024-04-25T10:02:52.689443+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:44.893766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.599617+0000","last_change":"2024-04-25T10:02:50.597209+0000","last_active":"2024-04-25T10:02:51.599617+0000","last_peered":"2024-04-25T10:02:51.599617+0000","last_clean":"2024-04-25T10:02:51.599617+0000","last_became_active":"2024-04-25T10:02:50.596896+0000","last_became_peered":"2024-04-25T10:02:50.596896+0000","last_unstale":"2024-04-25T10:02:51.599617+0000","last_undegraded":"2024-04-25T10:02:51.599617+0000","last_fullsized":"2024-04-25T10:02:51.599617+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:06.095065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"102'4","reported_seq":18,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.003582+0000","last_change":"2024-04-25T10:02:49.599379+0000","last_active":"2024-04-25T10:02:52.003582+0000","last_peered":"2024-04-25T10:02:52.003582+0000","last_clean":"2024-04-25T10:02:52.003582+0000","last_became_active":"2024-04-25T10:02:49.599070+0000","last_became_peered":"2024-04-25T10:02:49.599070+0000","last_unstale":"2024-04-25T10:02:52.003582+0000","last_undegraded":"2024-04-25T10:02:52.003582+0000","last_fullsized":"2024-04-25T10:02:52.003582+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:58.452441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.689413+0000","last_change":"2024-04-25T10:02:50.603303+0000","last_active":"2024-04-25T10:02:52.689413+0000","last_peered":"2024-04-25T10:02:52.689413+0000","last_clean":"2024-04-25T10:02:52.689413+0000","last_became_active":"2024-04-25T10:02:50.603036+0000","last_became_peered":"2024-04-25T10:02:50.603036+0000","last_unstale":"2024-04-25T10:02:52.689413+0000","last_undegraded":"2024-04-25T10:02:52.689413+0000","last_fullsized":"2024-04-25T10:02:52.689413+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:40.725356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"102'1","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.689906+0000","last_change":"2024-04-25T10:02:49.597685+0000","last_active":"2024-04-25T10:02:52.689906+0000","last_peered":"2024-04-25T10:02:52.689906+0000","last_clean":"2024-04-25T10:02:52.689906+0000","last_became_active":"2024-04-25T10:02:49.597436+0000","last_became_peered":"2024-04-25T10:02:49.597436+0000","last_unstale":"2024-04-25T10:02:52.689906+0000","last_undegraded":"2024-04-25T10:02:52.689906+0000","last_fullsized":"2024-04-25T10:02:52.689906+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:51.871111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.608221+0000","last_change":"2024-04-25T10:02:50.601730+0000","last_active":"2024-04-25T10:02:51.608221+0000","last_peered":"2024-04-25T10:02:51.608221+0000","last_clean":"2024-04-25T10:02:51.608221+0000","last_became_active":"2024-04-25T10:02:50.601433+0000","last_became_peered":"2024-04-25T10:02:50.601433+0000","last_unstale":"2024-04-25T10:02:51.608221+0000","last_undegraded":"2024-04-25T10:02:51.608221+0000","last_fullsized":"2024-04-25T10:02:51.608221+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:44:14.466542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.608313+0000","last_change":"2024-04-25T10:02:49.602625+0000","last_active":"2024-04-25T10:02:51.608313+0000","last_peered":"2024-04-25T10:02:51.608313+0000","last_clean":"2024-04-25T10:02:51.608313+0000","last_became_active":"2024-04-25T10:02:49.602213+0000","last_became_peered":"2024-04-25T10:02:49.602213+0000","last_unstale":"2024-04-25T10:02:51.608313+0000","last_undegraded":"2024-04-25T10:02:51.608313+0000","last_fullsized":"2024-04-25T10:02:51.608313+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:16.695057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.690463+0000","last_change":"2024-04-25T10:02:50.597990+0000","last_active":"2024-04-25T10:02:52.690463+0000","last_peered":"2024-04-25T10:02:52.690463+0000","last_clean":"2024-04-25T10:02:52.690463+0000","last_became_active":"2024-04-25T10:02:50.597292+0000","last_became_peered":"2024-04-25T10:02:50.597292+0000","last_unstale":"2024-04-25T10:02:52.690463+0000","last_undegraded":"2024-04-25T10:02:52.690463+0000","last_fullsized":"2024-04-25T10:02:52.690463+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:26:10.814131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.189035+0000","last_change":"2024-04-25T10:02:49.601540+0000","last_active":"2024-04-25T10:02:52.189035+0000","last_peered":"2024-04-25T10:02:52.189035+0000","last_clean":"2024-04-25T10:02:52.189035+0000","last_became_active":"2024-04-25T10:02:49.601236+0000","last_became_peered":"2024-04-25T10:02:49.601236+0000","last_unstale":"2024-04-25T10:02:52.189035+0000","last_undegraded":"2024-04-25T10:02:52.189035+0000","last_fullsized":"2024-04-25T10:02:52.189035+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:33.837038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.003647+0000","last_change":"2024-04-25T10:02:50.605148+0000","last_active":"2024-04-25T10:02:52.003647+0000","last_peered":"2024-04-25T10:02:52.003647+0000","last_clean":"2024-04-25T10:02:52.003647+0000","last_became_active":"2024-04-25T10:02:50.604854+0000","last_became_peered":"2024-04-25T10:02:50.604854+0000","last_unstale":"2024-04-25T10:02:52.003647+0000","last_undegraded":"2024-04-25T10:02:52.003647+0000","last_fullsized":"2024-04-25T10:02:52.003647+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:18.191230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"102'1","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.805750+0000","last_change":"2024-04-25T10:02:49.600687+0000","last_active":"2024-04-25T10:02:51.805750+0000","last_peered":"2024-04-25T10:02:51.805750+0000","last_clean":"2024-04-25T10:02:51.805750+0000","last_became_active":"2024-04-25T10:02:49.600405+0000","last_became_peered":"2024-04-25T10:02:49.600405+0000","last_unstale":"2024-04-25T10:02:51.805750+0000","last_undegraded":"2024-04-25T10:02:51.805750+0000","last_fullsized":"2024-04-25T10:02:51.805750+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:54:46.938087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.599838+0000","last_change":"2024-04-25T10:02:50.598424+0000","last_active":"2024-04-25T10:02:51.599838+0000","last_peered":"2024-04-25T10:02:51.599838+0000","last_clean":"2024-04-25T10:02:51.599838+0000","last_became_active":"2024-04-25T10:02:50.598121+0000","last_became_peered":"2024-04-25T10:02:50.598121+0000","last_unstale":"2024-04-25T10:02:51.599838+0000","last_undegraded":"2024-04-25T10:02:51.599838+0000","last_fullsized":"2024-04-25T10:02:51.599838+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:55.073382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"102'1","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.690216+0000","last_change":"2024-04-25T10:02:49.599888+0000","last_active":"2024-04-25T10:02:52.690216+0000","last_peered":"2024-04-25T10:02:52.690216+0000","last_clean":"2024-04-25T10:02:52.690216+0000","last_became_active":"2024-04-25T10:02:49.599607+0000","last_became_peered":"2024-04-25T10:02:49.599607+0000","last_unstale":"2024-04-25T10:02:52.690216+0000","last_undegraded":"2024-04-25T10:02:52.690216+0000","last_fullsized":"2024-04-25T10:02:52.690216+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:46.336023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.691087+0000","last_change":"2024-04-25T10:02:50.602985+0000","last_active":"2024-04-25T10:02:52.691087+0000","last_peered":"2024-04-25T10:02:52.691087+0000","last_clean":"2024-04-25T10:02:52.691087+0000","last_became_active":"2024-04-25T10:02:50.602713+0000","last_became_peered":"2024-04-25T10:02:50.602713+0000","last_unstale":"2024-04-25T10:02:52.691087+0000","last_undegraded":"2024-04-25T10:02:52.691087+0000","last_fullsized":"2024-04-25T10:02:52.691087+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:28.150965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.607968+0000","last_change":"2024-04-25T10:02:49.598952+0000","last_active":"2024-04-25T10:02:51.607968+0000","last_peered":"2024-04-25T10:02:51.607968+0000","last_clean":"2024-04-25T10:02:51.607968+0000","last_became_active":"2024-04-25T10:02:49.598639+0000","last_became_peered":"2024-04-25T10:02:49.598639+0000","last_unstale":"2024-04-25T10:02:51.607968+0000","last_undegraded":"2024-04-25T10:02:51.607968+0000","last_fullsized":"2024-04-25T10:02:51.607968+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:49:12.699773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.003614+0000","last_change":"2024-04-25T10:02:50.608425+0000","last_active":"2024-04-25T10:02:52.003614+0000","last_peered":"2024-04-25T10:02:52.003614+0000","last_clean":"2024-04-25T10:02:52.003614+0000","last_became_active":"2024-04-25T10:02:50.608149+0000","last_became_peered":"2024-04-25T10:02:50.608149+0000","last_unstale":"2024-04-25T10:02:52.003614+0000","last_undegraded":"2024-04-25T10:02:52.003614+0000","last_fullsized":"2024-04-25T10:02:52.003614+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:58.939417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.003343+0000","last_change":"2024-04-25T10:02:49.589456+0000","last_active":"2024-04-25T10:02:52.003343+0000","last_peered":"2024-04-25T10:02:52.003343+0000","last_clean":"2024-04-25T10:02:52.003343+0000","last_became_active":"2024-04-25T10:02:49.589179+0000","last_became_peered":"2024-04-25T10:02:49.589179+0000","last_unstale":"2024-04-25T10:02:52.003343+0000","last_undegraded":"2024-04-25T10:02:52.003343+0000","last_fullsized":"2024-04-25T10:02:52.003343+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:54:46.938087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.599376+0000","last_change":"2024-04-25T10:02:50.598243+0000","last_active":"2024-04-25T10:02:51.599376+0000","last_peered":"2024-04-25T10:02:51.599376+0000","last_clean":"2024-04-25T10:02:51.599376+0000","last_became_active":"2024-04-25T10:02:50.597887+0000","last_became_peered":"2024-04-25T10:02:50.597887+0000","last_unstale":"2024-04-25T10:02:51.599376+0000","last_undegraded":"2024-04-25T10:02:51.599376+0000","last_fullsized":"2024-04-25T10:02:51.599376+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:02.688422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.608235+0000","last_change":"2024-04-25T10:02:49.599488+0000","last_active":"2024-04-25T10:02:51.608235+0000","last_peered":"2024-04-25T10:02:51.608235+0000","last_clean":"2024-04-25T10:02:51.608235+0000","last_became_active":"2024-04-25T10:02:49.599195+0000","last_became_peered":"2024-04-25T10:02:49.599195+0000","last_unstale":"2024-04-25T10:02:51.608235+0000","last_undegraded":"2024-04-25T10:02:51.608235+0000","last_fullsized":"2024-04-25T10:02:51.608235+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:15.089501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.188939+0000","last_change":"2024-04-25T10:02:50.610737+0000","last_active":"2024-04-25T10:02:52.188939+0000","last_peered":"2024-04-25T10:02:52.188939+0000","last_clean":"2024-04-25T10:02:52.188939+0000","last_became_active":"2024-04-25T10:02:50.610444+0000","last_became_peered":"2024-04-25T10:02:50.610444+0000","last_unstale":"2024-04-25T10:02:52.188939+0000","last_undegraded":"2024-04-25T10:02:52.188939+0000","last_fullsized":"2024-04-25T10:02:52.188939+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:29:23.799255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.599406+0000","last_change":"2024-04-25T10:02:49.600228+0000","last_active":"2024-04-25T10:02:51.599406+0000","last_peered":"2024-04-25T10:02:51.599406+0000","last_clean":"2024-04-25T10:02:51.599406+0000","last_became_active":"2024-04-25T10:02:49.599938+0000","last_became_peered":"2024-04-25T10:02:49.599938+0000","last_unstale":"2024-04-25T10:02:51.599406+0000","last_undegraded":"2024-04-25T10:02:51.599406+0000","last_fullsized":"2024-04-25T10:02:51.599406+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:39.866369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.689421+0000","last_change":"2024-04-25T10:02:50.609510+0000","last_active":"2024-04-25T10:02:52.689421+0000","last_peered":"2024-04-25T10:02:52.689421+0000","last_clean":"2024-04-25T10:02:52.689421+0000","last_became_active":"2024-04-25T10:02:50.609228+0000","last_became_peered":"2024-04-25T10:02:50.609228+0000","last_unstale":"2024-04-25T10:02:52.689421+0000","last_undegraded":"2024-04-25T10:02:52.689421+0000","last_fullsized":"2024-04-25T10:02:52.689421+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:42.100570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"102'3","reported_seq":17,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.805841+0000","last_change":"2024-04-25T10:02:49.595272+0000","last_active":"2024-04-25T10:02:51.805841+0000","last_peered":"2024-04-25T10:02:51.805841+0000","last_clean":"2024-04-25T10:02:51.805841+0000","last_became_active":"2024-04-25T10:02:49.594964+0000","last_became_peered":"2024-04-25T10:02:49.594964+0000","last_unstale":"2024-04-25T10:02:51.805841+0000","last_undegraded":"2024-04-25T10:02:51.805841+0000","last_fullsized":"2024-04-25T10:02:51.805841+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:04:50.351393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.189120+0000","last_change":"2024-04-25T10:02:50.610211+0000","last_active":"2024-04-25T10:02:52.189120+0000","last_peered":"2024-04-25T10:02:52.189120+0000","last_clean":"2024-04-25T10:02:52.189120+0000","last_became_active":"2024-04-25T10:02:50.609926+0000","last_became_peered":"2024-04-25T10:02:50.609926+0000","last_unstale":"2024-04-25T10:02:52.189120+0000","last_undegraded":"2024-04-25T10:02:52.189120+0000","last_fullsized":"2024-04-25T10:02:52.189120+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:59.212329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"102'6","reported_seq":20,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.690465+0000","last_change":"2024-04-25T10:02:49.596547+0000","last_active":"2024-04-25T10:02:52.690465+0000","last_peered":"2024-04-25T10:02:52.690465+0000","last_clean":"2024-04-25T10:02:52.690465+0000","last_became_active":"2024-04-25T10:02:49.596273+0000","last_became_peered":"2024-04-25T10:02:49.596273+0000","last_unstale":"2024-04-25T10:02:52.690465+0000","last_undegraded":"2024-04-25T10:02:52.690465+0000","last_fullsized":"2024-04-25T10:02:52.690465+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:28.059919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.690439+0000","last_change":"2024-04-25T10:02:50.609769+0000","last_active":"2024-04-25T10:02:52.690439+0000","last_peered":"2024-04-25T10:02:52.690439+0000","last_clean":"2024-04-25T10:02:52.690439+0000","last_became_active":"2024-04-25T10:02:50.609239+0000","last_became_peered":"2024-04-25T10:02:50.609239+0000","last_unstale":"2024-04-25T10:02:52.690439+0000","last_undegraded":"2024-04-25T10:02:52.690439+0000","last_fullsized":"2024-04-25T10:02:52.690439+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:30.410817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.189198+0000","last_change":"2024-04-25T10:02:49.598214+0000","last_active":"2024-04-25T10:02:52.189198+0000","last_peered":"2024-04-25T10:02:52.189198+0000","last_clean":"2024-04-25T10:02:52.189198+0000","last_became_active":"2024-04-25T10:02:49.597943+0000","last_became_peered":"2024-04-25T10:02:49.597943+0000","last_unstale":"2024-04-25T10:02:52.189198+0000","last_undegraded":"2024-04-25T10:02:52.189198+0000","last_fullsized":"2024-04-25T10:02:52.189198+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:28.059919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.690648+0000","last_change":"2024-04-25T10:02:50.600485+0000","last_active":"2024-04-25T10:02:52.690648+0000","last_peered":"2024-04-25T10:02:52.690648+0000","last_clean":"2024-04-25T10:02:52.690648+0000","last_became_active":"2024-04-25T10:02:50.600156+0000","last_became_peered":"2024-04-25T10:02:50.600156+0000","last_unstale":"2024-04-25T10:02:52.690648+0000","last_undegraded":"2024-04-25T10:02:52.690648+0000","last_fullsized":"2024-04-25T10:02:52.690648+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:44:14.466542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.003526+0000","last_change":"2024-04-25T10:02:49.594284+0000","last_active":"2024-04-25T10:02:52.003526+0000","last_peered":"2024-04-25T10:02:52.003526+0000","last_clean":"2024-04-25T10:02:52.003526+0000","last_became_active":"2024-04-25T10:02:49.593996+0000","last_became_peered":"2024-04-25T10:02:49.593996+0000","last_unstale":"2024-04-25T10:02:52.003526+0000","last_undegraded":"2024-04-25T10:02:52.003526+0000","last_fullsized":"2024-04-25T10:02:52.003526+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:04:50.351393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.689556+0000","last_change":"2024-04-25T10:02:50.600778+0000","last_active":"2024-04-25T10:02:52.689556+0000","last_peered":"2024-04-25T10:02:52.689556+0000","last_clean":"2024-04-25T10:02:52.689556+0000","last_became_active":"2024-04-25T10:02:50.600497+0000","last_became_peered":"2024-04-25T10:02:50.600497+0000","last_unstale":"2024-04-25T10:02:52.689556+0000","last_undegraded":"2024-04-25T10:02:52.689556+0000","last_fullsized":"2024-04-25T10:02:52.689556+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:47.958188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.689416+0000","last_change":"2024-04-25T10:02:49.603609+0000","last_active":"2024-04-25T10:02:52.689416+0000","last_peered":"2024-04-25T10:02:52.689416+0000","last_clean":"2024-04-25T10:02:52.689416+0000","last_became_active":"2024-04-25T10:02:49.603297+0000","last_became_peered":"2024-04-25T10:02:49.603297+0000","last_unstale":"2024-04-25T10:02:52.689416+0000","last_undegraded":"2024-04-25T10:02:52.689416+0000","last_fullsized":"2024-04-25T10:02:52.689416+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:16.165955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.599968+0000","last_change":"2024-04-25T10:02:50.593408+0000","last_active":"2024-04-25T10:02:51.599968+0000","last_peered":"2024-04-25T10:02:51.599968+0000","last_clean":"2024-04-25T10:02:51.599968+0000","last_became_active":"2024-04-25T10:02:50.593008+0000","last_became_peered":"2024-04-25T10:02:50.593008+0000","last_unstale":"2024-04-25T10:02:51.599968+0000","last_undegraded":"2024-04-25T10:02:51.599968+0000","last_fullsized":"2024-04-25T10:02:51.599968+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:23.700889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"102'8","reported_seq":22,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.607907+0000","last_change":"2024-04-25T10:02:49.598951+0000","last_active":"2024-04-25T10:02:51.607907+0000","last_peered":"2024-04-25T10:02:51.607907+0000","last_clean":"2024-04-25T10:02:51.607907+0000","last_became_active":"2024-04-25T10:02:49.598508+0000","last_became_peered":"2024-04-25T10:02:49.598508+0000","last_unstale":"2024-04-25T10:02:51.607907+0000","last_undegraded":"2024-04-25T10:02:51.607907+0000","last_fullsized":"2024-04-25T10:02:51.607907+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:34:24.518681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.689531+0000","last_change":"2024-04-25T10:02:50.606552+0000","last_active":"2024-04-25T10:02:52.689531+0000","last_peered":"2024-04-25T10:02:52.689531+0000","last_clean":"2024-04-25T10:02:52.689531+0000","last_became_active":"2024-04-25T10:02:50.606189+0000","last_became_peered":"2024-04-25T10:02:50.606189+0000","last_unstale":"2024-04-25T10:02:52.689531+0000","last_undegraded":"2024-04-25T10:02:52.689531+0000","last_fullsized":"2024-04-25T10:02:52.689531+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:49.889917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"102'1","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.690845+0000","last_change":"2024-04-25T10:02:49.605550+0000","last_active":"2024-04-25T10:02:52.690845+0000","last_peered":"2024-04-25T10:02:52.690845+0000","last_clean":"2024-04-25T10:02:52.690845+0000","last_became_active":"2024-04-25T10:02:49.605242+0000","last_became_peered":"2024-04-25T10:02:49.605242+0000","last_unstale":"2024-04-25T10:02:52.690845+0000","last_undegraded":"2024-04-25T10:02:52.690845+0000","last_fullsized":"2024-04-25T10:02:52.690845+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:41.634104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.690331+0000","last_change":"2024-04-25T10:02:50.605531+0000","last_active":"2024-04-25T10:02:52.690331+0000","last_peered":"2024-04-25T10:02:52.690331+0000","last_clean":"2024-04-25T10:02:52.690331+0000","last_became_active":"2024-04-25T10:02:50.605229+0000","last_became_peered":"2024-04-25T10:02:50.605229+0000","last_unstale":"2024-04-25T10:02:52.690331+0000","last_undegraded":"2024-04-25T10:02:52.690331+0000","last_fullsized":"2024-04-25T10:02:52.690331+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:42.927791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"102'1","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.805967+0000","last_change":"2024-04-25T10:02:49.599107+0000","last_active":"2024-04-25T10:02:51.805967+0000","last_peered":"2024-04-25T10:02:51.805967+0000","last_clean":"2024-04-25T10:02:51.805967+0000","last_became_active":"2024-04-25T10:02:49.598627+0000","last_became_peered":"2024-04-25T10:02:49.598627+0000","last_unstale":"2024-04-25T10:02:51.805967+0000","last_undegraded":"2024-04-25T10:02:51.805967+0000","last_fullsized":"2024-04-25T10:02:51.805967+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:58.452441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.188919+0000","last_change":"2024-04-25T10:02:50.595926+0000","last_active":"2024-04-25T10:02:52.188919+0000","last_peered":"2024-04-25T10:02:52.188919+0000","last_clean":"2024-04-25T10:02:52.188919+0000","last_became_active":"2024-04-25T10:02:50.595601+0000","last_became_peered":"2024-04-25T10:02:50.595601+0000","last_unstale":"2024-04-25T10:02:52.188919+0000","last_undegraded":"2024-04-25T10:02:52.188919+0000","last_fullsized":"2024-04-25T10:02:52.188919+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:25.592490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.690556+0000","last_change":"2024-04-25T10:02:49.600728+0000","last_active":"2024-04-25T10:02:52.690556+0000","last_peered":"2024-04-25T10:02:52.690556+0000","last_clean":"2024-04-25T10:02:52.690556+0000","last_became_active":"2024-04-25T10:02:49.600439+0000","last_became_peered":"2024-04-25T10:02:49.600439+0000","last_unstale":"2024-04-25T10:02:52.690556+0000","last_undegraded":"2024-04-25T10:02:52.690556+0000","last_fullsized":"2024-04-25T10:02:52.690556+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:58.201064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.599730+0000","last_change":"2024-04-25T10:02:50.593626+0000","last_active":"2024-04-25T10:02:51.599730+0000","last_peered":"2024-04-25T10:02:51.599730+0000","last_clean":"2024-04-25T10:02:51.599730+0000","last_became_active":"2024-04-25T10:02:50.593309+0000","last_became_peered":"2024-04-25T10:02:50.593309+0000","last_unstale":"2024-04-25T10:02:51.599730+0000","last_undegraded":"2024-04-25T10:02:51.599730+0000","last_fullsized":"2024-04-25T10:02:51.599730+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:34.094055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.689767+0000","last_change":"2024-04-25T10:02:49.603196+0000","last_active":"2024-04-25T10:02:52.689767+0000","last_peered":"2024-04-25T10:02:52.689767+0000","last_clean":"2024-04-25T10:02:52.689767+0000","last_became_active":"2024-04-25T10:02:49.602809+0000","last_became_peered":"2024-04-25T10:02:49.602809+0000","last_unstale":"2024-04-25T10:02:52.689767+0000","last_undegraded":"2024-04-25T10:02:52.689767+0000","last_fullsized":"2024-04-25T10:02:52.689767+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:36.575324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.599783+0000","last_change":"2024-04-25T10:02:50.595809+0000","last_active":"2024-04-25T10:02:51.599783+0000","last_peered":"2024-04-25T10:02:51.599783+0000","last_clean":"2024-04-25T10:02:51.599783+0000","last_became_active":"2024-04-25T10:02:50.595506+0000","last_became_peered":"2024-04-25T10:02:50.595506+0000","last_unstale":"2024-04-25T10:02:51.599783+0000","last_undegraded":"2024-04-25T10:02:51.599783+0000","last_fullsized":"2024-04-25T10:02:51.599783+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:57.045131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.689860+0000","last_change":"2024-04-25T10:02:49.602636+0000","last_active":"2024-04-25T10:02:52.689860+0000","last_peered":"2024-04-25T10:02:52.689860+0000","last_clean":"2024-04-25T10:02:52.689860+0000","last_became_active":"2024-04-25T10:02:49.602376+0000","last_became_peered":"2024-04-25T10:02:49.602376+0000","last_unstale":"2024-04-25T10:02:52.689860+0000","last_undegraded":"2024-04-25T10:02:52.689860+0000","last_fullsized":"2024-04-25T10:02:52.689860+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:48.171256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.003526+0000","last_change":"2024-04-25T10:02:50.602895+0000","last_active":"2024-04-25T10:02:52.003526+0000","last_peered":"2024-04-25T10:02:52.003526+0000","last_clean":"2024-04-25T10:02:52.003526+0000","last_became_active":"2024-04-25T10:02:50.602616+0000","last_became_peered":"2024-04-25T10:02:50.602616+0000","last_unstale":"2024-04-25T10:02:52.003526+0000","last_undegraded":"2024-04-25T10:02:52.003526+0000","last_fullsized":"2024-04-25T10:02:52.003526+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:59.117380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.690050+0000","last_change":"2024-04-25T10:02:49.596692+0000","last_active":"2024-04-25T10:02:52.690050+0000","last_peered":"2024-04-25T10:02:52.690050+0000","last_clean":"2024-04-25T10:02:52.690050+0000","last_became_active":"2024-04-25T10:02:49.596371+0000","last_became_peered":"2024-04-25T10:02:49.596371+0000","last_unstale":"2024-04-25T10:02:52.690050+0000","last_undegraded":"2024-04-25T10:02:52.690050+0000","last_fullsized":"2024-04-25T10:02:52.690050+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:09.504320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.689986+0000","last_change":"2024-04-25T10:02:50.602663+0000","last_active":"2024-04-25T10:02:52.689986+0000","last_peered":"2024-04-25T10:02:52.689986+0000","last_clean":"2024-04-25T10:02:52.689986+0000","last_became_active":"2024-04-25T10:02:50.602386+0000","last_became_peered":"2024-04-25T10:02:50.602386+0000","last_unstale":"2024-04-25T10:02:52.689986+0000","last_undegraded":"2024-04-25T10:02:52.689986+0000","last_fullsized":"2024-04-25T10:02:52.689986+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:28.273439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.689557+0000","last_change":"2024-04-25T10:02:49.596751+0000","last_active":"2024-04-25T10:02:52.689557+0000","last_peered":"2024-04-25T10:02:52.689557+0000","last_clean":"2024-04-25T10:02:52.689557+0000","last_became_active":"2024-04-25T10:02:49.596497+0000","last_became_peered":"2024-04-25T10:02:49.596497+0000","last_unstale":"2024-04-25T10:02:52.689557+0000","last_undegraded":"2024-04-25T10:02:52.689557+0000","last_fullsized":"2024-04-25T10:02:52.689557+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:53.052626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.599363+0000","last_change":"2024-04-25T10:02:50.602293+0000","last_active":"2024-04-25T10:02:51.599363+0000","last_peered":"2024-04-25T10:02:51.599363+0000","last_clean":"2024-04-25T10:02:51.599363+0000","last_became_active":"2024-04-25T10:02:50.602004+0000","last_became_peered":"2024-04-25T10:02:50.602004+0000","last_unstale":"2024-04-25T10:02:51.599363+0000","last_undegraded":"2024-04-25T10:02:51.599363+0000","last_fullsized":"2024-04-25T10:02:51.599363+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:39.292335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.189096+0000","last_change":"2024-04-25T10:02:49.597614+0000","last_active":"2024-04-25T10:02:52.189096+0000","last_peered":"2024-04-25T10:02:52.189096+0000","last_clean":"2024-04-25T10:02:52.189096+0000","last_became_active":"2024-04-25T10:02:49.597315+0000","last_became_peered":"2024-04-25T10:02:49.597315+0000","last_unstale":"2024-04-25T10:02:52.189096+0000","last_undegraded":"2024-04-25T10:02:52.189096+0000","last_fullsized":"2024-04-25T10:02:52.189096+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:09.504320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.608214+0000","last_change":"2024-04-25T10:02:50.597174+0000","last_active":"2024-04-25T10:02:51.608214+0000","last_peered":"2024-04-25T10:02:51.608214+0000","last_clean":"2024-04-25T10:02:51.608214+0000","last_became_active":"2024-04-25T10:02:50.596881+0000","last_became_peered":"2024-04-25T10:02:50.596881+0000","last_unstale":"2024-04-25T10:02:51.608214+0000","last_undegraded":"2024-04-25T10:02:51.608214+0000","last_fullsized":"2024-04-25T10:02:51.608214+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:42.927791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"102'1","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.599505+0000","last_change":"2024-04-25T10:02:49.595969+0000","last_active":"2024-04-25T10:02:51.599505+0000","last_peered":"2024-04-25T10:02:51.599505+0000","last_clean":"2024-04-25T10:02:51.599505+0000","last_became_active":"2024-04-25T10:02:49.595693+0000","last_became_peered":"2024-04-25T10:02:49.595693+0000","last_unstale":"2024-04-25T10:02:51.599505+0000","last_undegraded":"2024-04-25T10:02:51.599505+0000","last_fullsized":"2024-04-25T10:02:51.599505+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:47.398936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.003417+0000","last_change":"2024-04-25T10:02:50.602178+0000","last_active":"2024-04-25T10:02:52.003417+0000","last_peered":"2024-04-25T10:02:52.003417+0000","last_clean":"2024-04-25T10:02:52.003417+0000","last_became_active":"2024-04-25T10:02:50.601890+0000","last_became_peered":"2024-04-25T10:02:50.601890+0000","last_unstale":"2024-04-25T10:02:52.003417+0000","last_undegraded":"2024-04-25T10:02:52.003417+0000","last_fullsized":"2024-04-25T10:02:52.003417+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:53.249661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.690832+0000","last_change":"2024-04-25T10:02:49.593862+0000","last_active":"2024-04-25T10:02:52.690832+0000","last_peered":"2024-04-25T10:02:52.690832+0000","last_clean":"2024-04-25T10:02:52.690832+0000","last_became_active":"2024-04-25T10:02:49.593554+0000","last_became_peered":"2024-04-25T10:02:49.593554+0000","last_unstale":"2024-04-25T10:02:52.690832+0000","last_undegraded":"2024-04-25T10:02:52.690832+0000","last_fullsized":"2024-04-25T10:02:52.690832+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:33.837038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.690751+0000","last_change":"2024-04-25T10:02:50.601221+0000","last_active":"2024-04-25T10:02:52.690751+0000","last_peered":"2024-04-25T10:02:52.690751+0000","last_clean":"2024-04-25T10:02:52.690751+0000","last_became_active":"2024-04-25T10:02:50.600909+0000","last_became_peered":"2024-04-25T10:02:50.600909+0000","last_unstale":"2024-04-25T10:02:52.690751+0000","last_undegraded":"2024-04-25T10:02:52.690751+0000","last_fullsized":"2024-04-25T10:02:52.690751+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:54:47.949352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.189080+0000","last_change":"2024-04-25T10:02:49.600863+0000","last_active":"2024-04-25T10:02:52.189080+0000","last_peered":"2024-04-25T10:02:52.189080+0000","last_clean":"2024-04-25T10:02:52.189080+0000","last_became_active":"2024-04-25T10:02:49.600571+0000","last_became_peered":"2024-04-25T10:02:49.600571+0000","last_unstale":"2024-04-25T10:02:52.189080+0000","last_undegraded":"2024-04-25T10:02:52.189080+0000","last_fullsized":"2024-04-25T10:02:52.189080+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:37.202053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.689570+0000","last_change":"2024-04-25T10:02:50.604014+0000","last_active":"2024-04-25T10:02:52.689570+0000","last_peered":"2024-04-25T10:02:52.689570+0000","last_clean":"2024-04-25T10:02:52.689570+0000","last_became_active":"2024-04-25T10:02:50.603702+0000","last_became_peered":"2024-04-25T10:02:50.603702+0000","last_unstale":"2024-04-25T10:02:52.689570+0000","last_undegraded":"2024-04-25T10:02:52.689570+0000","last_fullsized":"2024-04-25T10:02:52.689570+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:05.373607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.608114+0000","last_change":"2024-04-25T10:02:49.601012+0000","last_active":"2024-04-25T10:02:51.608114+0000","last_peered":"2024-04-25T10:02:51.608114+0000","last_clean":"2024-04-25T10:02:51.608114+0000","last_became_active":"2024-04-25T10:02:49.600731+0000","last_became_peered":"2024-04-25T10:02:49.600731+0000","last_unstale":"2024-04-25T10:02:51.608114+0000","last_undegraded":"2024-04-25T10:02:51.608114+0000","last_fullsized":"2024-04-25T10:02:51.608114+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:12.373559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.689689+0000","last_change":"2024-04-25T10:02:50.601935+0000","last_active":"2024-04-25T10:02:52.689689+0000","last_peered":"2024-04-25T10:02:52.689689+0000","last_clean":"2024-04-25T10:02:52.689689+0000","last_became_active":"2024-04-25T10:02:50.601621+0000","last_became_peered":"2024-04-25T10:02:50.601621+0000","last_unstale":"2024-04-25T10:02:52.689689+0000","last_undegraded":"2024-04-25T10:02:52.689689+0000","last_fullsized":"2024-04-25T10:02:52.689689+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:07:26.991205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.689776+0000","last_change":"2024-04-25T10:02:49.600898+0000","last_active":"2024-04-25T10:02:52.689776+0000","last_peered":"2024-04-25T10:02:52.689776+0000","last_clean":"2024-04-25T10:02:52.689776+0000","last_became_active":"2024-04-25T10:02:49.600598+0000","last_became_peered":"2024-04-25T10:02:49.600598+0000","last_unstale":"2024-04-25T10:02:52.689776+0000","last_undegraded":"2024-04-25T10:02:52.689776+0000","last_fullsized":"2024-04-25T10:02:52.689776+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:46.790016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.806015+0000","last_change":"2024-04-25T10:02:50.602017+0000","last_active":"2024-04-25T10:02:51.806015+0000","last_peered":"2024-04-25T10:02:51.806015+0000","last_clean":"2024-04-25T10:02:51.806015+0000","last_became_active":"2024-04-25T10:02:50.601702+0000","last_became_peered":"2024-04-25T10:02:50.601702+0000","last_unstale":"2024-04-25T10:02:51.806015+0000","last_undegraded":"2024-04-25T10:02:51.806015+0000","last_fullsized":"2024-04-25T10:02:51.806015+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:40.513789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.690167+0000","last_change":"2024-04-25T10:02:49.592618+0000","last_active":"2024-04-25T10:02:52.690167+0000","last_peered":"2024-04-25T10:02:52.690167+0000","last_clean":"2024-04-25T10:02:52.690167+0000","last_became_active":"2024-04-25T10:02:49.592337+0000","last_became_peered":"2024-04-25T10:02:49.592337+0000","last_unstale":"2024-04-25T10:02:52.690167+0000","last_undegraded":"2024-04-25T10:02:52.690167+0000","last_fullsized":"2024-04-25T10:02:52.690167+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:37.202053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.691206+0000","last_change":"2024-04-25T10:02:50.593723+0000","last_active":"2024-04-25T10:02:52.691206+0000","last_peered":"2024-04-25T10:02:52.691206+0000","last_clean":"2024-04-25T10:02:52.691206+0000","last_became_active":"2024-04-25T10:02:50.593409+0000","last_became_peered":"2024-04-25T10:02:50.593409+0000","last_unstale":"2024-04-25T10:02:52.691206+0000","last_undegraded":"2024-04-25T10:02:52.691206+0000","last_fullsized":"2024-04-25T10:02:52.691206+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:27.456813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.689643+0000","last_change":"2024-04-25T10:02:49.599898+0000","last_active":"2024-04-25T10:02:52.689643+0000","last_peered":"2024-04-25T10:02:52.689643+0000","last_clean":"2024-04-25T10:02:52.689643+0000","last_became_active":"2024-04-25T10:02:49.599612+0000","last_became_peered":"2024-04-25T10:02:49.599612+0000","last_unstale":"2024-04-25T10:02:52.689643+0000","last_undegraded":"2024-04-25T10:02:52.689643+0000","last_fullsized":"2024-04-25T10:02:52.689643+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:15.024482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.690151+0000","last_change":"2024-04-25T10:02:50.605854+0000","last_active":"2024-04-25T10:02:52.690151+0000","last_peered":"2024-04-25T10:02:52.690151+0000","last_clean":"2024-04-25T10:02:52.690151+0000","last_became_active":"2024-04-25T10:02:50.605508+0000","last_became_peered":"2024-04-25T10:02:50.605508+0000","last_unstale":"2024-04-25T10:02:52.690151+0000","last_undegraded":"2024-04-25T10:02:52.690151+0000","last_fullsized":"2024-04-25T10:02:52.690151+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:49.563723+0000","last_clean_scrub_stamp":"2024-04-25T10:02:49.563723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:33.916698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:52.689916+0000","last_change":"2024-04-25T10:02:49.598137+0000","last_active":"2024-04-25T10:02:52.689916+0000","last_peered":"2024-04-25T10:02:52.689916+0000","last_clean":"2024-04-25T10:02:52.689916+0000","last_became_active":"2024-04-25T10:02:49.597841+0000","last_became_peered":"2024-04-25T10:02:49.597841+0000","last_unstale":"2024-04-25T10:02:52.689916+0000","last_undegraded":"2024-04-25T10:02:52.689916+0000","last_fullsized":"2024-04-25T10:02:52.689916+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:02:48.552458+0000","last_clean_scrub_stamp":"2024-04-25T10:02:48.552458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:36.961996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":323,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T10:02:51.805521+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T10:02:51.805521+0000","last_peered":"2024-04-25T10:02:51.805521+0000","last_clean":"2024-04-25T10:02:51.805521+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T10:02:51.805521+0000","last_undegraded":"2024-04-25T10:02:51.805521+0000","last_fullsized":"2024-04-25T10:02:51.805521+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542251,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33012,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338828,"statfs":{"total":96636764160,"available":96602959872,"internally_reserved":0,"allocated":1875968,"data_stored":1180877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542251,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1294336,"data_stored":592565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542253,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1273856,"data_stored":590349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542250,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1282048,"data_stored":590441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574955,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32436,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1277952,"data_stored":590931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574955,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":1277952,"data_stored":590383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574955,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32436,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1277952,"data_stored":590383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574955,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33024,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338816,"statfs":{"total":96636764160,"available":96602947584,"internally_reserved":0,"allocated":1884160,"data_stored":1182419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:02:58.363 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T10:02:58.364 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T10:02:58.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.503+0000 7fbcb4a6b640 1 Processor -- start 2024-04-25T10:02:58.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.503+0000 7fbcb4a6b640 1 -- start start 2024-04-25T10:02:58.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.504+0000 7fbcb4a6b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbcb00b9250 0x7fbcb00ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:58.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.504+0000 7fbcb4a6b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbcb015dd00 0x7fbcb00ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:58.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.504+0000 7fbcb4a6b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcb0161fa0 con 0x7fbcb015d920 2024-04-25T10:02:58.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.504+0000 7fbcb4a6b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb00d1de0 con 0x7fbcb00b9250 2024-04-25T10:02:58.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.504+0000 7fbcb4a6b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb0162560 con 0x7fbcb015dd00 2024-04-25T10:02:58.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.504+0000 7fbcaed9d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbcb015dd00 0x7fbcb00ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:58.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.504+0000 7fbca7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbcb00b9250 0x7fbcb00ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:58.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.504+0000 7fbcaed9d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbcb015dd00 0x7fbcb00ceb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:57334/0 (socket says 172.21.15.7:57334) 2024-04-25T10:02:58.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.504+0000 7fbcaed9d640 1 -- 172.21.15.7:0/612461668 learned_addr learned my addr 172.21.15.7:0/612461668 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:58.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.504+0000 7fbcaed9d640 1 -- 172.21.15.7:0/612461668 >> v2:172.21.15.55:3300/0 conn(0x7fbcb00b9250 msgr2=0x7fbcb00ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:58.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.504+0000 7fbcaed9d640 1 --2- 172.21.15.7:0/612461668 >> v2:172.21.15.55:3300/0 conn(0x7fbcb00b9250 0x7fbcb00ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:58.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.505+0000 7fbcaed9d640 1 -- 172.21.15.7:0/612461668 >> v1:172.21.15.55:6789/0 conn(0x7fbcb015d920 legacy=0x7fbcb0161630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:58.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.505+0000 7fbcaed9d640 1 -- 172.21.15.7:0/612461668 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb0162280 con 0x7fbcb015dd00 2024-04-25T10:02:58.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.505+0000 7fbcaed9d640 1 --2- 172.21.15.7:0/612461668 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbcb015dd00 0x7fbcb00ceb60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbca8009e50 tx=0x7fbca802a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78999c2af752e961 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:58.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.505+0000 7fbcadd9b640 1 -- 172.21.15.7:0/612461668 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca8036070 con 0x7fbcb015dd00 2024-04-25T10:02:58.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.506+0000 7fbcadd9b640 1 -- 172.21.15.7:0/612461668 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca8031600 con 0x7fbcb015dd00 2024-04-25T10:02:58.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.506+0000 7fbcadd9b640 1 -- 172.21.15.7:0/612461668 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca80319d0 con 0x7fbcb015dd00 2024-04-25T10:02:58.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.506+0000 7fbcb4a6b640 1 -- 172.21.15.7:0/612461668 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbcb015dd00 msgr2=0x7fbcb00ceb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:58.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.506+0000 7fbcb4a6b640 1 --2- 172.21.15.7:0/612461668 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbcb015dd00 0x7fbcb00ceb60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbca8009e50 tx=0x7fbca802a680 comp rx=0 tx=0).stop 2024-04-25T10:02:58.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.506+0000 7fbcb4a6b640 1 -- 172.21.15.7:0/612461668 shutdown_connections 2024-04-25T10:02:58.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.506+0000 7fbcb4a6b640 1 --2- 172.21.15.7:0/612461668 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbcb015dd00 0x7fbcb00ceb60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:58.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.506+0000 7fbcb4a6b640 1 --2- 172.21.15.7:0/612461668 >> v2:172.21.15.55:3300/0 conn(0x7fbcb00b9250 0x7fbcb00ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:58.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.506+0000 7fbcb4a6b640 1 -- 172.21.15.7:0/612461668 >> 172.21.15.7:0/612461668 conn(0x7fbcb006bfe0 msgr2=0x7fbcb006c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:58.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.506+0000 7fbcb4a6b640 1 -- 172.21.15.7:0/612461668 shutdown_connections 2024-04-25T10:02:58.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.506+0000 7fbcb4a6b640 1 -- 172.21.15.7:0/612461668 wait complete. 2024-04-25T10:02:58.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.507+0000 7fbcb4a6b640 1 Processor -- start 2024-04-25T10:02:58.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.507+0000 7fbcb4a6b640 1 -- start start 2024-04-25T10:02:58.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.508+0000 7fbcb4a6b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbcb00b9250 0x7fbcb0151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:58.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.508+0000 7fbcb4a6b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbcb015d920 0x7fbcb01604b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:58.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.508+0000 7fbcb4a6b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcb015dd00 0x7fbcb01609f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:58.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.508+0000 7fbcb4a6b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb00d2270 con 0x7fbcb015dd00 2024-04-25T10:02:58.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.508+0000 7fbcb4a6b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb0161d40 con 0x7fbcb00b9250 2024-04-25T10:02:58.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.508+0000 7fbcb4a6b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb00d23f0 con 0x7fbcb015d920 2024-04-25T10:02:58.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.508+0000 7fbcaed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcb015dd00 0x7fbcb01609f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:58.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.508+0000 7fbcaed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcb015dd00 0x7fbcb01609f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44274/0 (socket says 172.21.15.7:44274) 2024-04-25T10:02:58.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.508+0000 7fbcaed9d640 1 -- 172.21.15.7:0/913097701 learned_addr learned my addr 172.21.15.7:0/913097701 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:58.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.508+0000 7fbca7fff640 1 --2- 172.21.15.7:0/913097701 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbcb015d920 0x7fbcb01604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:58.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.508+0000 7fbcae59c640 1 --2- 172.21.15.7:0/913097701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbcb00b9250 0x7fbcb0151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:58.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.509+0000 7fbcaed9d640 1 -- 172.21.15.7:0/913097701 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbcb015d920 msgr2=0x7fbcb01604b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:58.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.509+0000 7fbcaed9d640 1 --2- 172.21.15.7:0/913097701 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbcb015d920 0x7fbcb01604b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:58.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.509+0000 7fbcaed9d640 1 -- 172.21.15.7:0/913097701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbcb00b9250 msgr2=0x7fbcb0151c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:58.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.509+0000 7fbcaed9d640 1 --2- 172.21.15.7:0/913097701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbcb00b9250 0x7fbcb0151c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:58.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.509+0000 7fbcaed9d640 1 -- 172.21.15.7:0/913097701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb0160080 con 0x7fbcb015dd00 2024-04-25T10:02:58.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.509+0000 7fbcaed9d640 1 --2- 172.21.15.7:0/913097701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcb015dd00 0x7fbcb01609f0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fbca8009f70 tx=0x7fbca8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:58.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.509+0000 7fbca6ffd640 1 -- 172.21.15.7:0/913097701 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca8041020 con 0x7fbcb015dd00 2024-04-25T10:02:58.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.509+0000 7fbca6ffd640 1 -- 172.21.15.7:0/913097701 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca8007820 con 0x7fbcb015dd00 2024-04-25T10:02:58.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.509+0000 7fbcb4a6b640 1 -- 172.21.15.7:0/913097701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb015efe0 con 0x7fbcb015dd00 2024-04-25T10:02:58.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.509+0000 7fbca6ffd640 1 -- 172.21.15.7:0/913097701 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca8036040 con 0x7fbcb015dd00 2024-04-25T10:02:58.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.509+0000 7fbcb4a6b640 1 -- 172.21.15.7:0/913097701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb015f5a0 con 0x7fbcb015dd00 2024-04-25T10:02:58.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.510+0000 7fbcb4a6b640 1 -- 172.21.15.7:0/913097701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb0068fd0 con 0x7fbcb015dd00 2024-04-25T10:02:58.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.511+0000 7fbca6ffd640 1 -- 172.21.15.7:0/913097701 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbca8044020 con 0x7fbcb015dd00 2024-04-25T10:02:58.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.511+0000 7fbca6ffd640 1 --2- 172.21.15.7:0/913097701 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbc9006b4d0 0x7fbc9006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:58.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.511+0000 7fbca6ffd640 1 -- 172.21.15.7:0/913097701 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbca80aaf00 con 0x7fbcb015dd00 2024-04-25T10:02:58.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.511+0000 7fbcae59c640 1 --2- 172.21.15.7:0/913097701 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbc9006b4d0 0x7fbc9006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:58.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.512+0000 7fbcae59c640 1 --2- 172.21.15.7:0/913097701 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbc9006b4d0 0x7fbc9006d990 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fbcb015c8d0 tx=0x7fbca0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:58.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.516+0000 7fbca6ffd640 1 -- 172.21.15.7:0/913097701 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbca804b030 con 0x7fbcb015dd00 2024-04-25T10:02:58.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.777+0000 7fbcb4a6b640 1 -- 172.21.15.7:0/913097701 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fbcb0067d20 con 0x7fbcb015dd00 2024-04-25T10:02:58.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.780+0000 7fbca6ffd640 1 -- 172.21.15.7:0/913097701 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+147 (secure 0 0 0) 0x7fbca80980c0 con 0x7fbcb015dd00 2024-04-25T10:02:58.784 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2024-04-25T10:02:58.785 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAYKCpmaJKeORAALxC5ZqLLEu0zJFG+SOGukQ== 2024-04-25T10:02:58.785 INFO:teuthology.orchestra.run.smithi007.stdout: caps mds = "allow" 2024-04-25T10:02:58.785 INFO:teuthology.orchestra.run.smithi007.stdout: caps mon = "allow r" 2024-04-25T10:02:58.785 INFO:teuthology.orchestra.run.smithi007.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T10:02:58.785 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2024-04-25T10:02:58.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.782+0000 7fbcb4a6b640 1 -- 172.21.15.7:0/913097701 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbc9006b4d0 msgr2=0x7fbc9006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:58.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.782+0000 7fbcb4a6b640 1 --2- 172.21.15.7:0/913097701 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbc9006b4d0 0x7fbc9006d990 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fbcb015c8d0 tx=0x7fbca0009040 comp rx=0 tx=0).stop 2024-04-25T10:02:58.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.782+0000 7fbcb4a6b640 1 -- 172.21.15.7:0/913097701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcb015dd00 msgr2=0x7fbcb01609f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:58.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.782+0000 7fbcb4a6b640 1 --2- 172.21.15.7:0/913097701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcb015dd00 0x7fbcb01609f0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fbca8009f70 tx=0x7fbca8004a40 comp rx=0 tx=0).stop 2024-04-25T10:02:58.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.782+0000 7fbcb4a6b640 1 -- 172.21.15.7:0/913097701 shutdown_connections 2024-04-25T10:02:58.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.782+0000 7fbcb4a6b640 1 --2- 172.21.15.7:0/913097701 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbc9006b4d0 0x7fbc9006d990 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:58.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.782+0000 7fbcb4a6b640 1 --2- 172.21.15.7:0/913097701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcb015dd00 0x7fbcb01609f0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:58.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.782+0000 7fbcb4a6b640 1 --2- 172.21.15.7:0/913097701 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbcb015d920 0x7fbcb01604b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:58.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.782+0000 7fbcb4a6b640 1 --2- 172.21.15.7:0/913097701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbcb00b9250 0x7fbcb0151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:58.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.782+0000 7fbcb4a6b640 1 -- 172.21.15.7:0/913097701 >> 172.21.15.7:0/913097701 conn(0x7fbcb006bfe0 msgr2=0x7fbcb00b6940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:58.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.782+0000 7fbcb4a6b640 1 -- 172.21.15.7:0/913097701 shutdown_connections 2024-04-25T10:02:58.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.782+0000 7fbcb4a6b640 1 -- 172.21.15.7:0/913097701 wait complete. 2024-04-25T10:02:58.798 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:02:58.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.894+0000 7f0a1136a640 1 Processor -- start 2024-04-25T10:02:58.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.894+0000 7f0a1136a640 1 -- start start 2024-04-25T10:02:58.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.895+0000 7f0a1136a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0a0c0cd740 0x7f0a0c0d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:58.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.895+0000 7f0a1136a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a0c0d08d0 0x7f0a0c06c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:58.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.895+0000 7f0a1136a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a0c099b90 con 0x7f0a0c06cbc0 2024-04-25T10:02:58.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.895+0000 7f0a1136a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a0c0cdb20 con 0x7f0a0c0cd740 2024-04-25T10:02:58.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.895+0000 7f0a1136a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c0ccca0 con 0x7f0a0c0d08d0 2024-04-25T10:02:58.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.895+0000 7f0a0b7fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0a0c06cbc0 0x7f0a0c161830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35636/0 (socket says 172.21.15.7:35636) 2024-04-25T10:02:58.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.895+0000 7f0a0b7fe640 1 -- 172.21.15.7:0/2451284629 learned_addr learned my addr 172.21.15.7:0/2451284629 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:02:58.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.895+0000 7f0a0affd640 1 --2- 172.21.15.7:0/2451284629 >> v2:172.21.15.55:3300/0 conn(0x7f0a0c0cd740 0x7f0a0c0d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:58.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.895+0000 7f0a0a7fc640 1 --2- 172.21.15.7:0/2451284629 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a0c0d08d0 0x7f0a0c06c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:58.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.896+0000 7f0a09ffb640 1 -- 172.21.15.7:0/2451284629 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2168235274 0 0) 0x7f0a0c099b90 con 0x7f0a0c06cbc0 2024-04-25T10:02:58.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.896+0000 7f0a09ffb640 1 -- 172.21.15.7:0/2451284629 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09f4003520 con 0x7f0a0c06cbc0 2024-04-25T10:02:58.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.896+0000 7f0a09ffb640 1 -- 172.21.15.7:0/2451284629 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1641769485 0 0) 0x7f09f4003520 con 0x7f0a0c06cbc0 2024-04-25T10:02:58.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.896+0000 7f0a09ffb640 1 -- 172.21.15.7:0/2451284629 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a0c0d08d0 msgr2=0x7f0a0c06c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:58.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.896+0000 7f0a09ffb640 1 --2- 172.21.15.7:0/2451284629 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a0c0d08d0 0x7f0a0c06c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:58.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.896+0000 7f0a09ffb640 1 -- 172.21.15.7:0/2451284629 >> v2:172.21.15.55:3300/0 conn(0x7f0a0c0cd740 msgr2=0x7f0a0c0d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:58.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.896+0000 7f0a09ffb640 1 --2- 172.21.15.7:0/2451284629 >> v2:172.21.15.55:3300/0 conn(0x7f0a0c0cd740 0x7f0a0c0d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:58.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.896+0000 7f0a09ffb640 1 -- 172.21.15.7:0/2451284629 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c099e70 con 0x7f0a0c06cbc0 2024-04-25T10:02:58.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.896+0000 7f0a09ffb640 1 -- 172.21.15.7:0/2451284629 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f0a040019f0 con 0x7f0a0c06cbc0 2024-04-25T10:02:58.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.896+0000 7f0a09ffb640 1 -- 172.21.15.7:0/2451284629 >> v1:172.21.15.7:6789/0 conn(0x7f0a0c06cbc0 legacy=0x7f0a0c161830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:58.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.896+0000 7f0a09ffb640 1 --2- 172.21.15.7:0/2451284629 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f40039b0 0x7f09f4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:58.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.896+0000 7f0a09ffb640 1 --2- 172.21.15.7:0/2451284629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09f4004800 0x7f09f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:58.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.896+0000 7f0a09ffb640 1 --2- 172.21.15.7:0/2451284629 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a0c0d08d0 0x7f09f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:58.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.896+0000 7f0a09ffb640 1 -- 172.21.15.7:0/2451284629 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c0ccca0 con 0x7f09f4004800 2024-04-25T10:02:58.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.896+0000 7f0a09ffb640 1 -- 172.21.15.7:0/2451284629 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f400b9c0 con 0x7f09f40039b0 2024-04-25T10:02:58.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.896+0000 7f0a09ffb640 1 -- 172.21.15.7:0/2451284629 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f400bb40 con 0x7f0a0c0d08d0 2024-04-25T10:02:58.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.896+0000 7f0a0a7fc640 1 --2- 172.21.15.7:0/2451284629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09f4004800 0x7f09f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:58.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.896+0000 7f0a0affd640 1 --2- 172.21.15.7:0/2451284629 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f40039b0 0x7f09f4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:58.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.896+0000 7f0a0b7fe640 1 --2- 172.21.15.7:0/2451284629 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a0c0d08d0 0x7f09f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:58.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.896+0000 7f0a0a7fc640 1 -- 172.21.15.7:0/2451284629 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a0c0d08d0 msgr2=0x7f09f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:58.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.896+0000 7f0a0a7fc640 1 --2- 172.21.15.7:0/2451284629 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a0c0d08d0 0x7f09f40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:58.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.896+0000 7f0a0a7fc640 1 -- 172.21.15.7:0/2451284629 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f40039b0 msgr2=0x7f09f4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:58.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.896+0000 7f0a0a7fc640 1 --2- 172.21.15.7:0/2451284629 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f40039b0 0x7f09f4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:58.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.896+0000 7f0a0a7fc640 1 -- 172.21.15.7:0/2451284629 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f4003520 con 0x7f09f4004800 2024-04-25T10:02:58.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.896+0000 7f0a0b7fe640 1 --2- 172.21.15.7:0/2451284629 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0a0c0d08d0 0x7f09f40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:02:58.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.896+0000 7f0a0affd640 1 --2- 172.21.15.7:0/2451284629 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f40039b0 0x7f09f4003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:02:58.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.897+0000 7f0a0a7fc640 1 --2- 172.21.15.7:0/2451284629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09f4004800 0x7f09f4004c80 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f0a00009ac0 tx=0x7f09f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f5507a4317edbd9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:58.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.897+0000 7f0a09ffb640 1 -- 172.21.15.7:0/2451284629 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a00036070 con 0x7f09f4004800 2024-04-25T10:02:58.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.897+0000 7f0a09ffb640 1 -- 172.21.15.7:0/2451284629 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a00031400 con 0x7f09f4004800 2024-04-25T10:02:58.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.897+0000 7f0a09ffb640 1 -- 172.21.15.7:0/2451284629 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a00009690 con 0x7f09f4004800 2024-04-25T10:02:58.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.898+0000 7f0a1136a640 1 -- 172.21.15.7:0/2451284629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09f4004800 msgr2=0x7f09f4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:58.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.898+0000 7f0a1136a640 1 --2- 172.21.15.7:0/2451284629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09f4004800 0x7f09f4004c80 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f0a00009ac0 tx=0x7f09f4005830 comp rx=0 tx=0).stop 2024-04-25T10:02:58.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.898+0000 7f0a0b7fe640 1 -- 172.21.15.7:0/2451284629 reap_dead start 2024-04-25T10:02:58.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.898+0000 7f0a1136a640 1 -- 172.21.15.7:0/2451284629 shutdown_connections 2024-04-25T10:02:58.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.898+0000 7f0a1136a640 1 -- 172.21.15.7:0/2451284629 >> 172.21.15.7:0/2451284629 conn(0x7f0a0c0b3130 msgr2=0x7f0a0c0b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:58.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.898+0000 7f0a1136a640 1 -- 172.21.15.7:0/2451284629 shutdown_connections 2024-04-25T10:02:58.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.898+0000 7f0a1136a640 1 -- 172.21.15.7:0/2451284629 wait complete. 2024-04-25T10:02:58.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.899+0000 7f0a1136a640 1 Processor -- start 2024-04-25T10:02:58.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.899+0000 7f0a1136a640 1 -- start start 2024-04-25T10:02:58.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.900+0000 7f0a1136a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f09f4004800 0x7f0a0c150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:58.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.900+0000 7f0a1136a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a0c1f4570 0x7f0a0c070610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:58.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.900+0000 7f0a1136a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a0c070b50 0x7f0a0c1f3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:58.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.900+0000 7f0a1136a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c09a710 con 0x7f0a0c1f4570 2024-04-25T10:02:58.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.900+0000 7f0a1136a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c09a430 con 0x7f0a0c070b50 2024-04-25T10:02:58.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.900+0000 7f0a1136a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c09ac30 con 0x7f09f4004800 2024-04-25T10:02:58.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.900+0000 7f0a0a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a0c1f4570 0x7f0a0c070610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:58.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.900+0000 7f0a0a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a0c1f4570 0x7f0a0c070610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44288/0 (socket says 172.21.15.7:44288) 2024-04-25T10:02:58.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.900+0000 7f0a0a7fc640 1 -- 172.21.15.7:0/3431765274 learned_addr learned my addr 172.21.15.7:0/3431765274 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:58.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.900+0000 7f0a0b7fe640 1 --2- 172.21.15.7:0/3431765274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a0c070b50 0x7f0a0c1f3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:58.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.900+0000 7f0a0affd640 1 --2- 172.21.15.7:0/3431765274 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f09f4004800 0x7f0a0c150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:58.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.900+0000 7f0a0a7fc640 1 -- 172.21.15.7:0/3431765274 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f09f4004800 msgr2=0x7f0a0c150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:58.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.900+0000 7f0a0a7fc640 1 --2- 172.21.15.7:0/3431765274 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f09f4004800 0x7f0a0c150ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:58.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.900+0000 7f0a0a7fc640 1 -- 172.21.15.7:0/3431765274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a0c070b50 msgr2=0x7f0a0c1f3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:58.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.900+0000 7f0a0a7fc640 1 --2- 172.21.15.7:0/3431765274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a0c070b50 0x7f0a0c1f3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:58.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.900+0000 7f0a0a7fc640 1 -- 172.21.15.7:0/3431765274 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c151010 con 0x7f0a0c1f4570 2024-04-25T10:02:58.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.900+0000 7f0a0b7fe640 1 --2- 172.21.15.7:0/3431765274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a0c070b50 0x7f0a0c1f3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:02:58.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.901+0000 7f0a0a7fc640 1 --2- 172.21.15.7:0/3431765274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a0c1f4570 0x7f0a0c070610 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f0a00009be0 tx=0x7f0a00004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:58.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.901+0000 7f09f37fe640 1 -- 172.21.15.7:0/3431765274 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a00041020 con 0x7f0a0c1f4570 2024-04-25T10:02:58.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.901+0000 7f09f37fe640 1 -- 172.21.15.7:0/3431765274 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0003c470 con 0x7f0a0c1f4570 2024-04-25T10:02:58.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.901+0000 7f0a1136a640 1 -- 172.21.15.7:0/3431765274 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a0c09d990 con 0x7f0a0c1f4570 2024-04-25T10:02:58.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.901+0000 7f09f37fe640 1 -- 172.21.15.7:0/3431765274 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a00036040 con 0x7f0a0c1f4570 2024-04-25T10:02:58.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.901+0000 7f0a1136a640 1 -- 172.21.15.7:0/3431765274 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a0c09df50 con 0x7f0a0c1f4570 2024-04-25T10:02:58.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.902+0000 7f0a1136a640 1 -- 172.21.15.7:0/3431765274 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a0c068fd0 con 0x7f0a0c1f4570 2024-04-25T10:02:58.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.902+0000 7f09f37fe640 1 -- 172.21.15.7:0/3431765274 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0a00044020 con 0x7f0a0c1f4570 2024-04-25T10:02:58.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.903+0000 7f09f37fe640 1 --2- 172.21.15.7:0/3431765274 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f09f806b500 0x7f09f806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:58.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.903+0000 7f09f37fe640 1 -- 172.21.15.7:0/3431765274 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0a000aa0b0 con 0x7f0a0c1f4570 2024-04-25T10:02:58.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.903+0000 7f0a0affd640 1 --2- 172.21.15.7:0/3431765274 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f09f806b500 0x7f09f806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:58.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.903+0000 7f0a0affd640 1 --2- 172.21.15.7:0/3431765274 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f09f806b500 0x7f09f806d9c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f09fc009bc0 tx=0x7f09fc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:58.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:58.907+0000 7f09f37fe640 1 -- 172.21.15.7:0/3431765274 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0a0c151010 con 0x7f0a0c1f4570 2024-04-25T10:02:59.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.125+0000 7f0a1136a640 1 -- 172.21.15.7:0/3431765274 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a0c070f30 con 0x7f0a0c1f4570 2024-04-25T10:02:59.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.126+0000 7f09f37fe640 1 -- 172.21.15.7:0/3431765274 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4931 (secure 0 0 0) 0x7f0a000787e0 con 0x7f0a0c1f4570 2024-04-25T10:02:59.131 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:02:59.131 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":73,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6617,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3278722694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3278722694},{"type":"v1","addr":"172.21.15.55:6835","nonce":3278722694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":7435,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3598653097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3598653097},{"type":"v1","addr":"172.21.15.55:6834","nonce":3598653097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":8361,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3628875229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3628875229},{"type":"v1","addr":"172.21.15.7:6836","nonce":3628875229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:02:49.944298+0000","modified":"2024-04-25T10:02:51.943060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8364},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8364":{"gid":8364,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6837/900729992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":900729992},{"type":"v1","addr":"172.21.15.7:6837","nonce":900729992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T10:02:59.132 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 73 2024-04-25T10:02:59.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.128+0000 7f0a1136a640 1 -- 172.21.15.7:0/3431765274 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f09f806b500 msgr2=0x7f09f806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:59.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.128+0000 7f0a1136a640 1 --2- 172.21.15.7:0/3431765274 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f09f806b500 0x7f09f806d9c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f09fc009bc0 tx=0x7f09fc008040 comp rx=0 tx=0).stop 2024-04-25T10:02:59.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.128+0000 7f0a1136a640 1 -- 172.21.15.7:0/3431765274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a0c1f4570 msgr2=0x7f0a0c070610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:59.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.128+0000 7f0a1136a640 1 --2- 172.21.15.7:0/3431765274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a0c1f4570 0x7f0a0c070610 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f0a00009be0 tx=0x7f0a00004730 comp rx=0 tx=0).stop 2024-04-25T10:02:59.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.128+0000 7f0a1136a640 1 -- 172.21.15.7:0/3431765274 shutdown_connections 2024-04-25T10:02:59.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.128+0000 7f0a1136a640 1 --2- 172.21.15.7:0/3431765274 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f09f806b500 0x7f09f806d9c0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.128+0000 7f0a1136a640 1 --2- 172.21.15.7:0/3431765274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a0c070b50 0x7f0a0c1f3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.128+0000 7f0a1136a640 1 --2- 172.21.15.7:0/3431765274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a0c1f4570 0x7f0a0c070610 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.128+0000 7f0a1136a640 1 --2- 172.21.15.7:0/3431765274 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f09f4004800 0x7f0a0c150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.128+0000 7f0a1136a640 1 -- 172.21.15.7:0/3431765274 >> 172.21.15.7:0/3431765274 conn(0x7f0a0c0b3130 msgr2=0x7f0a0c0b4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:59.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.128+0000 7f0a1136a640 1 -- 172.21.15.7:0/3431765274 shutdown_connections 2024-04-25T10:02:59.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.128+0000 7f0a1136a640 1 -- 172.21.15.7:0/3431765274 wait complete. 2024-04-25T10:02:59.546 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 73, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:02:49.944298+0000', 'modified': '2024-04-25T10:02:51.943060+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8364}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8364': {'gid': 8364, 'name': 'a', 'rank': 0, 'incarnation': 71, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.7:6837/900729992', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6835', 'nonce': 900729992}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 900729992}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:02:59.546 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T10:02:59.546 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T10:02:59.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.647+0000 7fb8025d5640 1 Processor -- start 2024-04-25T10:02:59.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.648+0000 7fb8025d5640 1 -- start start 2024-04-25T10:02:59.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.648+0000 7fb8025d5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb7fc15aa10 0x7fb7fc0d0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:59.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.648+0000 7fb8025d5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb7fc0d0760 0x7fb7fc0d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:59.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.648+0000 7fb8025d5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7fc0b4ca0 con 0x7fb7fc06e370 2024-04-25T10:02:59.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.648+0000 7fb8025d5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7fc15adf0 con 0x7fb7fc15aa10 2024-04-25T10:02:59.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.648+0000 7fb8025d5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc0d1250 con 0x7fb7fc0d0760 2024-04-25T10:02:59.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.649+0000 7fb7fb7fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb7fc0d0760 0x7fb7fc0d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:59.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.649+0000 7fb7fbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb7fc15aa10 0x7fb7fc0d0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:59.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.649+0000 7fb7fb7fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb7fc0d0760 0x7fb7fc0d0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:57376/0 (socket says 172.21.15.7:57376) 2024-04-25T10:02:59.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.649+0000 7fb7fb7fe640 1 -- 172.21.15.7:0/3813079192 learned_addr learned my addr 172.21.15.7:0/3813079192 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:59.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.649+0000 7fb800b72640 1 --1- 172.21.15.7:0/3813079192 >> v1:172.21.15.55:6789/0 conn(0x7fb7fc06e370 0x7fb7fc06e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:47108/0 (socket says 172.21.15.7:47108) 2024-04-25T10:02:59.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.649+0000 7fb7fb7fe640 1 -- 172.21.15.7:0/3813079192 >> v2:172.21.15.55:3300/0 conn(0x7fb7fc15aa10 msgr2=0x7fb7fc0d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:59.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.649+0000 7fb7fb7fe640 1 --2- 172.21.15.7:0/3813079192 >> v2:172.21.15.55:3300/0 conn(0x7fb7fc15aa10 0x7fb7fc0d0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.649+0000 7fb7fb7fe640 1 -- 172.21.15.7:0/3813079192 >> v1:172.21.15.55:6789/0 conn(0x7fb7fc06e370 legacy=0x7fb7fc06e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:59.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.649+0000 7fb7fb7fe640 1 -- 172.21.15.7:0/3813079192 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc0b3ee0 con 0x7fb7fc0d0760 2024-04-25T10:02:59.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.650+0000 7fb7fb7fe640 1 --2- 172.21.15.7:0/3813079192 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb7fc0d0760 0x7fb7fc0d0bc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4009870 tx=0x7fb7e402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=479518f7fce16fb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:59.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.650+0000 7fb7faffd640 1 -- 172.21.15.7:0/3813079192 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4037070 con 0x7fb7fc0d0760 2024-04-25T10:02:59.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.650+0000 7fb7faffd640 1 -- 172.21.15.7:0/3813079192 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e4032440 con 0x7fb7fc0d0760 2024-04-25T10:02:59.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.650+0000 7fb7faffd640 1 -- 172.21.15.7:0/3813079192 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4032810 con 0x7fb7fc0d0760 2024-04-25T10:02:59.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.651+0000 7fb8025d5640 1 -- 172.21.15.7:0/3813079192 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb7fc0d0760 msgr2=0x7fb7fc0d0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:59.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.651+0000 7fb8025d5640 1 --2- 172.21.15.7:0/3813079192 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb7fc0d0760 0x7fb7fc0d0bc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4009870 tx=0x7fb7e402a270 comp rx=0 tx=0).stop 2024-04-25T10:02:59.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.651+0000 7fb8025d5640 1 -- 172.21.15.7:0/3813079192 shutdown_connections 2024-04-25T10:02:59.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.651+0000 7fb8025d5640 1 --2- 172.21.15.7:0/3813079192 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb7fc0d0760 0x7fb7fc0d0bc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.651+0000 7fb8025d5640 1 --2- 172.21.15.7:0/3813079192 >> v2:172.21.15.55:3300/0 conn(0x7fb7fc15aa10 0x7fb7fc0d0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.651+0000 7fb8025d5640 1 -- 172.21.15.7:0/3813079192 >> 172.21.15.7:0/3813079192 conn(0x7fb7fc0b59f0 msgr2=0x7fb7fc0b5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:59.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.651+0000 7fb8025d5640 1 -- 172.21.15.7:0/3813079192 shutdown_connections 2024-04-25T10:02:59.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.651+0000 7fb8025d5640 1 -- 172.21.15.7:0/3813079192 wait complete. 2024-04-25T10:02:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.652+0000 7fb8025d5640 1 Processor -- start 2024-04-25T10:02:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.652+0000 7fb8025d5640 1 -- start start 2024-04-25T10:02:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.653+0000 7fb8025d5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7fc06e370 0x7fb7fc151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.653+0000 7fb8025d5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb7fc0d0760 0x7fb7fc140f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.653+0000 7fb8025d5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7fc15aa10 0x7fb7fc0aee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.653+0000 7fb8025d5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc0b4780 con 0x7fb7fc06e370 2024-04-25T10:02:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.653+0000 7fb8025d5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc0b44a0 con 0x7fb7fc15aa10 2024-04-25T10:02:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.653+0000 7fb8025d5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc0afda0 con 0x7fb7fc0d0760 2024-04-25T10:02:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.653+0000 7fb7fbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7fc06e370 0x7fb7fc151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.653+0000 7fb7fbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7fc06e370 0x7fb7fc151f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44300/0 (socket says 172.21.15.7:44300) 2024-04-25T10:02:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.653+0000 7fb7fbfff640 1 -- 172.21.15.7:0/819252967 learned_addr learned my addr 172.21.15.7:0/819252967 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.653+0000 7fb7fbfff640 1 -- 172.21.15.7:0/819252967 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb7fc0d0760 msgr2=0x7fb7fc140f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.653+0000 7fb800b72640 1 --2- 172.21.15.7:0/819252967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7fc15aa10 0x7fb7fc0aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.653+0000 7fb7fb7fe640 1 --2- 172.21.15.7:0/819252967 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb7fc0d0760 0x7fb7fc140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.653+0000 7fb7fbfff640 1 --2- 172.21.15.7:0/819252967 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb7fc0d0760 0x7fb7fc140f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.653+0000 7fb7fbfff640 1 -- 172.21.15.7:0/819252967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7fc15aa10 msgr2=0x7fb7fc0aee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.653+0000 7fb7fbfff640 1 --2- 172.21.15.7:0/819252967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7fc15aa10 0x7fb7fc0aee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.653+0000 7fb7fbfff640 1 -- 172.21.15.7:0/819252967 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc141960 con 0x7fb7fc06e370 2024-04-25T10:02:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.653+0000 7fb7fbfff640 1 --2- 172.21.15.7:0/819252967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7fc06e370 0x7fb7fc151f30 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00e9b0 tx=0x7fb7ec00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.654+0000 7fb7f8ff9640 1 -- 172.21.15.7:0/819252967 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec017070 con 0x7fb7fc06e370 2024-04-25T10:02:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.654+0000 7fb7f8ff9640 1 -- 172.21.15.7:0/819252967 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ec00c9a0 con 0x7fb7fc06e370 2024-04-25T10:02:59.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.654+0000 7fb7f8ff9640 1 -- 172.21.15.7:0/819252967 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec00cd90 con 0x7fb7fc06e370 2024-04-25T10:02:59.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.654+0000 7fb8025d5640 1 -- 172.21.15.7:0/819252967 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7fc141c40 con 0x7fb7fc06e370 2024-04-25T10:02:59.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.654+0000 7fb8025d5640 1 -- 172.21.15.7:0/819252967 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7fc142200 con 0x7fb7fc06e370 2024-04-25T10:02:59.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.655+0000 7fb7f8ff9640 1 -- 172.21.15.7:0/819252967 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb7ec01a070 con 0x7fb7fc06e370 2024-04-25T10:02:59.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.656+0000 7fb7f8ff9640 1 --2- 172.21.15.7:0/819252967 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb7dc06b4d0 0x7fb7dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:59.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.656+0000 7fb7f8ff9640 1 -- 172.21.15.7:0/819252967 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb7ec08a7c0 con 0x7fb7fc06e370 2024-04-25T10:02:59.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.656+0000 7fb7fb7fe640 1 --2- 172.21.15.7:0/819252967 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb7dc06b4d0 0x7fb7dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:59.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.656+0000 7fb7fb7fe640 1 --2- 172.21.15.7:0/819252967 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb7dc06b4d0 0x7fb7dc06d990 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4034000 tx=0x7fb7e402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:59.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.657+0000 7fb8053b5740 1 Processor -- start 2024-04-25T10:02:59.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.657+0000 7fb8053b5740 1 -- start start 2024-04-25T10:02:59.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.657+0000 7fb8053b5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561312071230 0x561312071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:59.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.657+0000 7fb8053b5740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56131208ead0 0x56131208f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:59.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.657+0000 7fb8053b5740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561312046f10 0x56131208d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:59.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.657+0000 7fb8053b5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x561311fa9a10 con 0x561312071230 2024-04-25T10:02:59.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.657+0000 7fb8053b5740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561311f52b30 con 0x561312046f10 2024-04-25T10:02:59.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.657+0000 7fb8053b5740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x561311fa5c50 con 0x56131208ead0 2024-04-25T10:02:59.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.658+0000 7fb7fbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561312071230 0x561312071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:59.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.658+0000 7fb7fbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561312071230 0x561312071610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44314/0 (socket says 172.21.15.7:44314) 2024-04-25T10:02:59.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.658+0000 7fb7fbfff640 1 -- 172.21.15.7:0/2582368621 learned_addr learned my addr 172.21.15.7:0/2582368621 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:59.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.658+0000 7fb7fb7fe640 1 --2- 172.21.15.7:0/2582368621 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56131208ead0 0x56131208f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:59.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.658+0000 7fb800b72640 1 --2- 172.21.15.7:0/2582368621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561312046f10 0x56131208d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:59.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.658+0000 7fb7fbfff640 1 -- 172.21.15.7:0/2582368621 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56131208ead0 msgr2=0x56131208f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:59.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.658+0000 7fb7fbfff640 1 --2- 172.21.15.7:0/2582368621 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56131208ead0 0x56131208f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.658+0000 7fb7fbfff640 1 -- 172.21.15.7:0/2582368621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561312046f10 msgr2=0x56131208d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:59.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.658+0000 7fb7fbfff640 1 --2- 172.21.15.7:0/2582368621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561312046f10 0x56131208d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.658+0000 7fb7fbfff640 1 -- 172.21.15.7:0/2582368621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561311f67e10 con 0x561312071230 2024-04-25T10:02:59.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.658+0000 7fb800b72640 1 --2- 172.21.15.7:0/2582368621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561312046f10 0x56131208d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:02:59.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.658+0000 7fb7fbfff640 1 --2- 172.21.15.7:0/2582368621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561312071230 0x561312071610 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00cfd0 tx=0x7fb7ec059550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f194c1c17429d05f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:59.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.658+0000 7fb7f1ffb640 1 -- 172.21.15.7:0/2582368621 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec021070 con 0x561312071230 2024-04-25T10:02:59.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.658+0000 7fb7f1ffb640 1 -- 172.21.15.7:0/2582368621 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ec056db0 con 0x561312071230 2024-04-25T10:02:59.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.658+0000 7fb7f1ffb640 1 -- 172.21.15.7:0/2582368621 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec055380 con 0x561312071230 2024-04-25T10:02:59.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.659+0000 7fb8053b5740 1 -- 172.21.15.7:0/2582368621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561312071230 msgr2=0x561312071610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:59.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.659+0000 7fb8053b5740 1 --2- 172.21.15.7:0/2582368621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561312071230 0x561312071610 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00cfd0 tx=0x7fb7ec059550 comp rx=0 tx=0).stop 2024-04-25T10:02:59.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.659+0000 7fb8053b5740 1 -- 172.21.15.7:0/2582368621 shutdown_connections 2024-04-25T10:02:59.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.659+0000 7fb8053b5740 1 --2- 172.21.15.7:0/2582368621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561312046f10 0x56131208d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.659+0000 7fb8053b5740 1 --2- 172.21.15.7:0/2582368621 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56131208ead0 0x56131208f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.659+0000 7fb8053b5740 1 --2- 172.21.15.7:0/2582368621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561312071230 0x561312071610 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.659+0000 7fb8053b5740 1 -- 172.21.15.7:0/2582368621 >> 172.21.15.7:0/2582368621 conn(0x561312043840 msgr2=0x56131208c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:59.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.659+0000 7fb8053b5740 1 -- 172.21.15.7:0/2582368621 shutdown_connections 2024-04-25T10:02:59.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.659+0000 7fb8053b5740 1 -- 172.21.15.7:0/2582368621 wait complete. 2024-04-25T10:02:59.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.659+0000 7fb8053b5740 1 -- start start 2024-04-25T10:02:59.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.660+0000 7fb8053b5740 1 Processor -- start 2024-04-25T10:02:59.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.660+0000 7fb8053b5740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x561312071230 0x561312072e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:59.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.660+0000 7fb8053b5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56131208ead0 0x5613120738a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:59.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.660+0000 7fb8053b5740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56131206d0f0 0x56131206feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:59.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.660+0000 7fb8053b5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x561312047cb0 con 0x56131208ead0 2024-04-25T10:02:59.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.660+0000 7fb8053b5740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561311f660c0 con 0x56131206d0f0 2024-04-25T10:02:59.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.660+0000 7fb8053b5740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x561312041770 con 0x561312071230 2024-04-25T10:02:59.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.660+0000 7fb8053b5740 10 client.0 _ll_register_callbacks cb 0x561311f59ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:02:59.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.660+0000 7fb7fb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56131208ead0 0x5613120738a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:59.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.660+0000 7fb7fb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56131208ead0 0x5613120738a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44326/0 (socket says 172.21.15.7:44326) 2024-04-25T10:02:59.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.660+0000 7fb7fb7fe640 1 -- 172.21.15.7:0/3404599332 learned_addr learned my addr 172.21.15.7:0/3404599332 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:59.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.661+0000 7fb7fbfff640 1 --2- 172.21.15.7:0/3404599332 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x561312071230 0x561312072e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:59.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.661+0000 7fb800b72640 1 --2- 172.21.15.7:0/3404599332 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56131206d0f0 0x56131206feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:59.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.661+0000 7fb7fb7fe640 1 -- 172.21.15.7:0/3404599332 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x561312071230 msgr2=0x561312072e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:59.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.661+0000 7fb7fb7fe640 1 --2- 172.21.15.7:0/3404599332 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x561312071230 0x561312072e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.661+0000 7fb7fb7fe640 1 -- 172.21.15.7:0/3404599332 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56131206d0f0 msgr2=0x56131206feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:59.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.661+0000 7fb7fb7fe640 1 --2- 172.21.15.7:0/3404599332 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56131206d0f0 0x56131206feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.661+0000 7fb7fb7fe640 1 -- 172.21.15.7:0/3404599332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561311cbe2d0 con 0x56131208ead0 2024-04-25T10:02:59.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.661+0000 7fb7fb7fe640 1 --2- 172.21.15.7:0/3404599332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56131208ead0 0x5613120738a0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4009990 tx=0x7fb7e402c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8a23e0bc4a88bfd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:59.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.661+0000 7fb7daffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:02:59.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.661+0000 7fb7daffd640 1 -- 172.21.15.7:0/3404599332 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4037040 con 0x56131208ead0 2024-04-25T10:02:59.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.661+0000 7fb7daffd640 1 -- 172.21.15.7:0/3404599332 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb7e403ca30 con 0x56131208ead0 2024-04-25T10:02:59.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.661+0000 7fb8053b5740 1 -- 172.21.15.7:0/3404599332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb7ec056db0 con 0x56131208ead0 2024-04-25T10:02:59.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.661+0000 7fb7daffd640 1 -- 172.21.15.7:0/3404599332 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7e4055050 con 0x56131208ead0 2024-04-25T10:02:59.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.661+0000 7fb8053b5740 10 client.8529 fetch_fsmap learned FSMap version 73 2024-04-25T10:02:59.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.661+0000 7fb8053b5740 1 -- 172.21.15.7:0/3404599332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x561311d886b0 con 0x56131208ead0 2024-04-25T10:02:59.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.661+0000 7fb7daffd640 1 -- 172.21.15.7:0/3404599332 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ec056db0 con 0x56131208ead0 2024-04-25T10:02:59.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.661+0000 7fb7daffd640 1 -- 172.21.15.7:0/3404599332 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 73) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb7e4058020 con 0x56131208ead0 2024-04-25T10:02:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.662+0000 7fb8053b5740 10 client.8529 fetch_fsmap finished waiting for FSMap version 73 2024-04-25T10:02:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.662+0000 7fb8053b5740 10 client.8529 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:02:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.662+0000 7fb8053b5740 20 client.8529 populate_metadata read hostname 'smithi007' 2024-04-25T10:02:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.662+0000 7fb8053b5740 1 --2- 172.21.15.7:0/3404599332 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x56131209c790 0x561312090cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.662+0000 7fb8053b5740 4 client.8529 mds_command: new command op to 8364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:02:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.662+0000 7fb8053b5740 1 -- 172.21.15.7:0/3404599332 --> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561312008920 con 0x56131209c790 2024-04-25T10:02:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.662+0000 7fb7fbfff640 1 --2- 172.21.15.7:0/3404599332 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x56131209c790 0x561312090cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.662+0000 7fb7daffd640 10 client.8529 ms_handle_connect on v2:172.21.15.7:6835/900729992 2024-04-25T10:02:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.662+0000 7fb7fbfff640 1 --2- 172.21.15.7:0/3404599332 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x56131209c790 0x561312090cc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=416b7ba16956693d server_cookie=f31335ef982af133 in_seq=0 out_seq=0 2024-04-25T10:02:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.662+0000 7fb7daffd640 1 -- 172.21.15.7:0/3404599332 <== mds.0 v2:172.21.15.7:6835/900729992 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561312008920 con 0x56131209c790 2024-04-25T10:02:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.662+0000 7fb7daffd640 10 client.8529 handle_command_reply: tid=0 2024-04-25T10:02:59.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.663+0000 7fb8053b5740 1 client.8529 shutdown 2024-04-25T10:02:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.663+0000 7fb8053b5740 1 -- 172.21.15.7:0/3404599332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56131208ead0 msgr2=0x5613120738a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.663+0000 7fb8053b5740 1 --2- 172.21.15.7:0/3404599332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56131208ead0 0x5613120738a0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4009990 tx=0x7fb7e402c070 comp rx=0 tx=0).stop 2024-04-25T10:02:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.663+0000 7fb8053b5740 1 -- 172.21.15.7:0/3404599332 shutdown_connections 2024-04-25T10:02:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.663+0000 7fb8053b5740 1 --2- 172.21.15.7:0/3404599332 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56131206d0f0 0x56131206feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.663+0000 7fb8053b5740 1 --2- 172.21.15.7:0/3404599332 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x56131209c790 0x561312090cc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.663+0000 7fb8053b5740 1 --2- 172.21.15.7:0/3404599332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56131208ead0 0x5613120738a0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.663+0000 7fb8053b5740 1 --2- 172.21.15.7:0/3404599332 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x561312071230 0x561312072e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.663+0000 7fb7daffd640 0 client.8529 ms_handle_reset on v2:172.21.15.7:6835/900729992 2024-04-25T10:02:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.663+0000 7fb8053b5740 1 -- 172.21.15.7:0/3404599332 >> 172.21.15.7:0/3404599332 conn(0x561312046f10 msgr2=0x56131208f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.663+0000 7fb8053b5740 1 -- 172.21.15.7:0/3404599332 shutdown_connections 2024-04-25T10:02:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.663+0000 7fb8053b5740 1 -- 172.21.15.7:0/3404599332 wait complete. 2024-04-25T10:02:59.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.663+0000 7fb8053b5740 20 client.8529 trim_cache size 0 max 16384 2024-04-25T10:02:59.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.679+0000 7fb8053b5740 1 Processor -- start 2024-04-25T10:02:59.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.679+0000 7fb8053b5740 1 -- start start 2024-04-25T10:02:59.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.680+0000 7fb8053b5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56131206d0f0 0x5613120467a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:59.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.680+0000 7fb8053b5740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x561312071230 0x5613120474e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:59.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.680+0000 7fb8053b5740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56131208ead0 0x5613120730f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:59.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.680+0000 7fb8053b5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc1fd4a0 con 0x56131206d0f0 2024-04-25T10:02:59.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.680+0000 7fb8053b5740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc0cd8a0 con 0x56131208ead0 2024-04-25T10:02:59.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.680+0000 7fb8053b5740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc1fcfb0 con 0x561312071230 2024-04-25T10:02:59.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.680+0000 7fb7fbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56131206d0f0 0x5613120467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:59.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.680+0000 7fb7fbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56131206d0f0 0x5613120467a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44336/0 (socket says 172.21.15.7:44336) 2024-04-25T10:02:59.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.680+0000 7fb7fbfff640 1 -- 172.21.15.7:0/4251276784 learned_addr learned my addr 172.21.15.7:0/4251276784 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:59.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.680+0000 7fb7fbfff640 1 -- 172.21.15.7:0/4251276784 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x561312071230 msgr2=0x5613120474e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:59.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.680+0000 7fb7fbfff640 1 --2- 172.21.15.7:0/4251276784 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x561312071230 0x5613120474e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.680+0000 7fb7fbfff640 1 -- 172.21.15.7:0/4251276784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56131208ead0 msgr2=0x5613120730f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:59.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.680+0000 7fb7fbfff640 1 --2- 172.21.15.7:0/4251276784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56131208ead0 0x5613120730f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.680+0000 7fb7fbfff640 1 -- 172.21.15.7:0/4251276784 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561312041d60 con 0x56131206d0f0 2024-04-25T10:02:59.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.680+0000 7fb7fbfff640 1 --2- 172.21.15.7:0/4251276784 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56131206d0f0 0x5613120467a0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00c520 tx=0x7fb7ec014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb66693773759424 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:59.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.680+0000 7fb7f17fa640 1 -- 172.21.15.7:0/4251276784 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec021040 con 0x56131206d0f0 2024-04-25T10:02:59.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.680+0000 7fb7f17fa640 1 -- 172.21.15.7:0/4251276784 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ec057010 con 0x56131206d0f0 2024-04-25T10:02:59.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.680+0000 7fb7f17fa640 1 -- 172.21.15.7:0/4251276784 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec058ae0 con 0x56131206d0f0 2024-04-25T10:02:59.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.681+0000 7fb8053b5740 1 -- 172.21.15.7:0/4251276784 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56131206d0f0 msgr2=0x5613120467a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:59.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.681+0000 7fb8053b5740 1 --2- 172.21.15.7:0/4251276784 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56131206d0f0 0x5613120467a0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00c520 tx=0x7fb7ec014000 comp rx=0 tx=0).stop 2024-04-25T10:02:59.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.681+0000 7fb8053b5740 1 -- 172.21.15.7:0/4251276784 shutdown_connections 2024-04-25T10:02:59.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.681+0000 7fb8053b5740 1 --2- 172.21.15.7:0/4251276784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56131208ead0 0x5613120730f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.681+0000 7fb8053b5740 1 --2- 172.21.15.7:0/4251276784 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x561312071230 0x5613120474e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.681+0000 7fb8053b5740 1 --2- 172.21.15.7:0/4251276784 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56131206d0f0 0x5613120467a0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.681+0000 7fb8053b5740 1 -- 172.21.15.7:0/4251276784 >> 172.21.15.7:0/4251276784 conn(0x561312046f10 msgr2=0x5613120af1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:59.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.681+0000 7fb8053b5740 1 -- 172.21.15.7:0/4251276784 shutdown_connections 2024-04-25T10:02:59.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.681+0000 7fb8053b5740 1 -- 172.21.15.7:0/4251276784 wait complete. 2024-04-25T10:02:59.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.681+0000 7fb8053b5740 1 -- start start 2024-04-25T10:02:59.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.682+0000 7fb8053b5740 1 Processor -- start 2024-04-25T10:02:59.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.682+0000 7fb8053b5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56131206d0f0 0x5613120732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:59.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.682+0000 7fb8053b5740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561312071230 0x561312073830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:59.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.682+0000 7fb8053b5740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56131208ead0 0x56131206aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:59.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.682+0000 7fb8053b5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x56131209c610 con 0x56131206d0f0 2024-04-25T10:02:59.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.682+0000 7fb8053b5740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561312072650 con 0x561312071230 2024-04-25T10:02:59.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.682+0000 7fb8053b5740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x56131209cc10 con 0x56131208ead0 2024-04-25T10:02:59.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.682+0000 7fb8053b5740 10 client.0 _ll_register_callbacks cb 0x561312041c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:02:59.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.682+0000 7fb7fbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56131206d0f0 0x5613120732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:59.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.682+0000 7fb7fbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56131206d0f0 0x5613120732f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44346/0 (socket says 172.21.15.7:44346) 2024-04-25T10:02:59.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.682+0000 7fb7fbfff640 1 -- 172.21.15.7:0/197919379 learned_addr learned my addr 172.21.15.7:0/197919379 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:59.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.683+0000 7fb7fb7fe640 1 --2- 172.21.15.7:0/197919379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561312071230 0x561312073830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:59.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.683+0000 7fb800b72640 1 --2- 172.21.15.7:0/197919379 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56131208ead0 0x56131206aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:59.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.683+0000 7fb7fbfff640 1 -- 172.21.15.7:0/197919379 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56131208ead0 msgr2=0x56131206aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:59.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.683+0000 7fb7fbfff640 1 --2- 172.21.15.7:0/197919379 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56131208ead0 0x56131206aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.683+0000 7fb7fbfff640 1 -- 172.21.15.7:0/197919379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561312071230 msgr2=0x561312073830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:59.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.683+0000 7fb7fbfff640 1 --2- 172.21.15.7:0/197919379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561312071230 0x561312073830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.683+0000 7fb7fbfff640 1 -- 172.21.15.7:0/197919379 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561312046180 con 0x56131206d0f0 2024-04-25T10:02:59.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.683+0000 7fb800b72640 1 --2- 172.21.15.7:0/197919379 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56131208ead0 0x56131206aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:02:59.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.683+0000 7fb7fb7fe640 1 --2- 172.21.15.7:0/197919379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561312071230 0x561312073830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:02:59.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.683+0000 7fb7fbfff640 1 --2- 172.21.15.7:0/197919379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56131206d0f0 0x5613120732f0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec058a10 tx=0x7fb7ec000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98d744aa5691c44 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:59.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.683+0000 7fb7daffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:02:59.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.683+0000 7fb7daffd640 1 -- 172.21.15.7:0/197919379 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec074070 con 0x56131206d0f0 2024-04-25T10:02:59.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.683+0000 7fb7daffd640 1 -- 172.21.15.7:0/197919379 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb7ec055380 con 0x56131206d0f0 2024-04-25T10:02:59.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.683+0000 7fb8053b5740 1 -- 172.21.15.7:0/197919379 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb7ec057010 con 0x56131206d0f0 2024-04-25T10:02:59.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.683+0000 7fb7daffd640 1 -- 172.21.15.7:0/197919379 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7ec021050 con 0x56131206d0f0 2024-04-25T10:02:59.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.683+0000 7fb8053b5740 10 client.8535 fetch_fsmap learned FSMap version 73 2024-04-25T10:02:59.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.683+0000 7fb8053b5740 1 -- 172.21.15.7:0/197919379 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x561312072dd0 con 0x56131206d0f0 2024-04-25T10:02:59.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.683+0000 7fb7daffd640 1 -- 172.21.15.7:0/197919379 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ec057010 con 0x56131206d0f0 2024-04-25T10:02:59.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.683+0000 7fb7daffd640 1 -- 172.21.15.7:0/197919379 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 73) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb7ec077be0 con 0x56131206d0f0 2024-04-25T10:02:59.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.683+0000 7fb8053b5740 10 client.8535 fetch_fsmap finished waiting for FSMap version 73 2024-04-25T10:02:59.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.683+0000 7fb8053b5740 10 client.8535 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:02:59.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.683+0000 7fb8053b5740 20 client.8535 populate_metadata read hostname 'smithi007' 2024-04-25T10:02:59.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.683+0000 7fb8053b5740 1 --2- 172.21.15.7:0/197919379 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x5613120f7780 0x5613120f7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:59.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.684+0000 7fb8053b5740 4 client.8535 mds_command: new command op to 8364 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:02:59.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.684+0000 7fb8053b5740 1 -- 172.21.15.7:0/197919379 --> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561311fb6f50 con 0x5613120f7780 2024-04-25T10:02:59.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.684+0000 7fb7fb7fe640 1 --2- 172.21.15.7:0/197919379 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x5613120f7780 0x5613120f7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:59.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.684+0000 7fb7fb7fe640 1 --2- 172.21.15.7:0/197919379 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x5613120f7780 0x5613120f7b60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfb92f55eec426d5 server_cookie=94b927e73cf36384 in_seq=0 out_seq=0 2024-04-25T10:02:59.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.684+0000 7fb7daffd640 10 client.8535 ms_handle_connect on v2:172.21.15.7:6835/900729992 2024-04-25T10:02:59.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.684+0000 7fb7daffd640 1 -- 172.21.15.7:0/197919379 <== mds.0 v2:172.21.15.7:6835/900729992 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x561311fb6f50 con 0x5613120f7780 2024-04-25T10:02:59.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.684+0000 7fb7daffd640 10 client.8535 handle_command_reply: tid=0 2024-04-25T10:02:59.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.684+0000 7fb8053b5740 1 client.8535 shutdown 2024-04-25T10:02:59.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.684+0000 7fb8053b5740 1 -- 172.21.15.7:0/197919379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56131206d0f0 msgr2=0x5613120732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:59.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.684+0000 7fb8053b5740 1 --2- 172.21.15.7:0/197919379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56131206d0f0 0x5613120732f0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec058a10 tx=0x7fb7ec000bc0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.684+0000 7fb8053b5740 1 -- 172.21.15.7:0/197919379 shutdown_connections 2024-04-25T10:02:59.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.684+0000 7fb8053b5740 1 --2- 172.21.15.7:0/197919379 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56131208ead0 0x56131206aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.684+0000 7fb8053b5740 1 --2- 172.21.15.7:0/197919379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561312071230 0x561312073830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.684+0000 7fb8053b5740 1 --2- 172.21.15.7:0/197919379 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x5613120f7780 0x5613120f7b60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.684+0000 7fb8053b5740 1 --2- 172.21.15.7:0/197919379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56131206d0f0 0x5613120732f0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.684+0000 7fb7daffd640 0 client.8535 ms_handle_reset on v2:172.21.15.7:6835/900729992 2024-04-25T10:02:59.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.684+0000 7fb8053b5740 1 -- 172.21.15.7:0/197919379 >> 172.21.15.7:0/197919379 conn(0x561312046f10 msgr2=0x5613120467a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:59.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.684+0000 7fb8053b5740 1 -- 172.21.15.7:0/197919379 shutdown_connections 2024-04-25T10:02:59.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.684+0000 7fb8053b5740 1 -- 172.21.15.7:0/197919379 wait complete. 2024-04-25T10:02:59.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.685+0000 7fb8053b5740 20 client.8535 trim_cache size 0 max 16384 2024-04-25T10:02:59.696 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:02:59.696 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "c03d0745-5946-49c3-ad88-1165c5b68b4e", 2024-04-25T10:02:59.696 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-04-25T10:02:59.696 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 8364, 2024-04-25T10:02:59.696 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-04-25T10:02:59.696 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-04-25T10:02:59.697 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-04-25T10:02:59.697 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 9.0981593850000007, 2024-04-25T10:02:59.697 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 73, 2024-04-25T10:02:59.697 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 103, 2024-04-25T10:02:59.697 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 103, 2024-04-25T10:02:59.697 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 14.134380969 2024-04-25T10:02:59.697 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:02:59.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.685+0000 7fb8025d5640 1 -- 172.21.15.7:0/819252967 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb7dc06b4d0 msgr2=0x7fb7dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:59.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.685+0000 7fb8025d5640 1 --2- 172.21.15.7:0/819252967 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb7dc06b4d0 0x7fb7dc06d990 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4034000 tx=0x7fb7e402e000 comp rx=0 tx=0).stop 2024-04-25T10:02:59.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.685+0000 7fb8025d5640 1 -- 172.21.15.7:0/819252967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7fc06e370 msgr2=0x7fb7fc151f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:59.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.685+0000 7fb8025d5640 1 --2- 172.21.15.7:0/819252967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7fc06e370 0x7fb7fc151f30 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00e9b0 tx=0x7fb7ec00ee70 comp rx=0 tx=0).stop 2024-04-25T10:02:59.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.685+0000 7fb8025d5640 1 -- 172.21.15.7:0/819252967 shutdown_connections 2024-04-25T10:02:59.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.685+0000 7fb8025d5640 1 --2- 172.21.15.7:0/819252967 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb7dc06b4d0 0x7fb7dc06d990 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.685+0000 7fb8025d5640 1 --2- 172.21.15.7:0/819252967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7fc15aa10 0x7fb7fc0aee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.685+0000 7fb8025d5640 1 --2- 172.21.15.7:0/819252967 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb7fc0d0760 0x7fb7fc140f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.685+0000 7fb8025d5640 1 --2- 172.21.15.7:0/819252967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7fc06e370 0x7fb7fc151f30 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.685+0000 7fb8025d5640 1 -- 172.21.15.7:0/819252967 >> 172.21.15.7:0/819252967 conn(0x7fb7fc0b59f0 msgr2=0x7fb7fc06f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:59.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.685+0000 7fb8025d5640 1 -- 172.21.15.7:0/819252967 shutdown_connections 2024-04-25T10:02:59.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.685+0000 7fb8025d5640 1 -- 172.21.15.7:0/819252967 wait complete. 2024-04-25T10:02:59.701 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:02:59.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.796+0000 7fe826bf4640 1 Processor -- start 2024-04-25T10:02:59.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.796+0000 7fe826bf4640 1 -- start start 2024-04-25T10:02:59.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.797+0000 7fe826bf4640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe82006b270 0x7fe8200726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:59.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.797+0000 7fe826bf4640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe82015c8f0 0x7fe82015d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:59.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.797+0000 7fe826bf4640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe82015cd80 con 0x7fe820145260 2024-04-25T10:02:59.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.797+0000 7fe826bf4640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe820160110 con 0x7fe82006b270 2024-04-25T10:02:59.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.797+0000 7fe826bf4640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82015f500 con 0x7fe82015c8f0 2024-04-25T10:02:59.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.797+0000 7fe81ffff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe82006b270 0x7fe8200726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:59.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.797+0000 7fe824990640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe820145260 0x7fe82006ab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35388/0 (socket says 172.21.15.7:35388) 2024-04-25T10:02:59.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.797+0000 7fe824990640 1 -- 172.21.15.7:0/3089466410 learned_addr learned my addr 172.21.15.7:0/3089466410 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:02:59.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.798+0000 7fe825191640 1 --2- 172.21.15.7:0/3089466410 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe82015c8f0 0x7fe82015d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:59.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.798+0000 7fe81f7fe640 1 -- 172.21.15.7:0/3089466410 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1156281288 0 0) 0x7fe82015cd80 con 0x7fe820145260 2024-04-25T10:02:59.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.798+0000 7fe81f7fe640 1 -- 172.21.15.7:0/3089466410 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe80c003520 con 0x7fe820145260 2024-04-25T10:02:59.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.798+0000 7fe81ffff640 1 -- 172.21.15.7:0/3089466410 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe82015c8f0 msgr2=0x7fe82015d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:02:59.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.798+0000 7fe81ffff640 1 --2- 172.21.15.7:0/3089466410 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe82015c8f0 0x7fe82015d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.798+0000 7fe81ffff640 1 -- 172.21.15.7:0/3089466410 >> v1:172.21.15.7:6789/0 conn(0x7fe820145260 legacy=0x7fe82006ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:59.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.798+0000 7fe81ffff640 1 -- 172.21.15.7:0/3089466410 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82015f7e0 con 0x7fe82006b270 2024-04-25T10:02:59.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.798+0000 7fe825191640 1 --2- 172.21.15.7:0/3089466410 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe82015c8f0 0x7fe82015d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:02:59.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.798+0000 7fe81ffff640 1 --2- 172.21.15.7:0/3089466410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe82006b270 0x7fe8200726e0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fe810009d90 tx=0x7fe81002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55837391fc247c84 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:59.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.799+0000 7fe81f7fe640 1 -- 172.21.15.7:0/3089466410 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe810007740 con 0x7fe82006b270 2024-04-25T10:02:59.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.799+0000 7fe81f7fe640 1 -- 172.21.15.7:0/3089466410 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8100078e0 con 0x7fe82006b270 2024-04-25T10:02:59.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.799+0000 7fe81f7fe640 1 -- 172.21.15.7:0/3089466410 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe810007c90 con 0x7fe82006b270 2024-04-25T10:02:59.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.799+0000 7fe826bf4640 1 -- 172.21.15.7:0/3089466410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe82006b270 msgr2=0x7fe8200726e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:59.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.799+0000 7fe826bf4640 1 --2- 172.21.15.7:0/3089466410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe82006b270 0x7fe8200726e0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fe810009d90 tx=0x7fe81002a660 comp rx=0 tx=0).stop 2024-04-25T10:02:59.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.799+0000 7fe826bf4640 1 -- 172.21.15.7:0/3089466410 shutdown_connections 2024-04-25T10:02:59.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.799+0000 7fe826bf4640 1 --2- 172.21.15.7:0/3089466410 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe82015c8f0 0x7fe82015d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.799+0000 7fe826bf4640 1 --2- 172.21.15.7:0/3089466410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe82006b270 0x7fe8200726e0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.799+0000 7fe826bf4640 1 -- 172.21.15.7:0/3089466410 >> 172.21.15.7:0/3089466410 conn(0x7fe8200b5c30 msgr2=0x7fe8200999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:02:59.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.799+0000 7fe826bf4640 1 -- 172.21.15.7:0/3089466410 shutdown_connections 2024-04-25T10:02:59.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.799+0000 7fe826bf4640 1 -- 172.21.15.7:0/3089466410 wait complete. 2024-04-25T10:02:59.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.800+0000 7fe826bf4640 1 Processor -- start 2024-04-25T10:02:59.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.800+0000 7fe826bf4640 1 -- start start 2024-04-25T10:02:59.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.801+0000 7fe826bf4640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe82006b270 0x7fe82013d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:59.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.801+0000 7fe826bf4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe820145260 0x7fe8201432b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:59.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.801+0000 7fe826bf4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe82015c8f0 0x7fe8201437f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:59.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.801+0000 7fe826bf4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82015d780 con 0x7fe82015c8f0 2024-04-25T10:02:59.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.801+0000 7fe826bf4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82015fda0 con 0x7fe820145260 2024-04-25T10:02:59.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.801+0000 7fe826bf4640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82015d900 con 0x7fe82006b270 2024-04-25T10:02:59.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.801+0000 7fe825191640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe82015c8f0 0x7fe8201437f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:59.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.801+0000 7fe825191640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe82015c8f0 0x7fe8201437f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50438/0 (socket says 172.21.15.7:50438) 2024-04-25T10:02:59.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.801+0000 7fe825191640 1 -- 172.21.15.7:0/153585372 learned_addr learned my addr 172.21.15.7:0/153585372 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:02:59.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.801+0000 7fe81ffff640 1 --2- 172.21.15.7:0/153585372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe820145260 0x7fe8201432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:59.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.801+0000 7fe824990640 1 --2- 172.21.15.7:0/153585372 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe82006b270 0x7fe82013d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:59.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.802+0000 7fe825191640 1 -- 172.21.15.7:0/153585372 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe82006b270 msgr2=0x7fe82013d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:59.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.802+0000 7fe825191640 1 --2- 172.21.15.7:0/153585372 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe82006b270 0x7fe82013d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.802+0000 7fe825191640 1 -- 172.21.15.7:0/153585372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe820145260 msgr2=0x7fe8201432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:02:59.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.802+0000 7fe825191640 1 --2- 172.21.15.7:0/153585372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe820145260 0x7fe8201432b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:02:59.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.802+0000 7fe825191640 1 -- 172.21.15.7:0/153585372 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82013e560 con 0x7fe82015c8f0 2024-04-25T10:02:59.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.802+0000 7fe825191640 1 --2- 172.21.15.7:0/153585372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe82015c8f0 0x7fe8201437f0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fe80800d7d0 tx=0x7fe80800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:59.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.802+0000 7fe81d7fa640 1 -- 172.21.15.7:0/153585372 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe808004030 con 0x7fe82015c8f0 2024-04-25T10:02:59.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.802+0000 7fe81d7fa640 1 -- 172.21.15.7:0/153585372 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8080041d0 con 0x7fe82015c8f0 2024-04-25T10:02:59.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.802+0000 7fe826bf4640 1 -- 172.21.15.7:0/153585372 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe82013e840 con 0x7fe82015c8f0 2024-04-25T10:02:59.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.802+0000 7fe81d7fa640 1 -- 172.21.15.7:0/153585372 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8080096a0 con 0x7fe82015c8f0 2024-04-25T10:02:59.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.802+0000 7fe826bf4640 1 -- 172.21.15.7:0/153585372 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe82013ee00 con 0x7fe82015c8f0 2024-04-25T10:02:59.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.803+0000 7fe826bf4640 1 -- 172.21.15.7:0/153585372 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe820068fd0 con 0x7fe82015c8f0 2024-04-25T10:02:59.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.804+0000 7fe81d7fa640 1 -- 172.21.15.7:0/153585372 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe808009840 con 0x7fe82015c8f0 2024-04-25T10:02:59.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.804+0000 7fe81d7fa640 1 --2- 172.21.15.7:0/153585372 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe80006b500 0x7fe80006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:02:59.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.804+0000 7fe81d7fa640 1 -- 172.21.15.7:0/153585372 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe80808a610 con 0x7fe82015c8f0 2024-04-25T10:02:59.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.804+0000 7fe824990640 1 --2- 172.21.15.7:0/153585372 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe80006b500 0x7fe80006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:02:59.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.804+0000 7fe824990640 1 --2- 172.21.15.7:0/153585372 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe80006b500 0x7fe80006d9c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fe818005880 tx=0x7fe818009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:02:59.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:02:59.808+0000 7fe81d7fa640 1 -- 172.21.15.7:0/153585372 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe808058c20 con 0x7fe82015c8f0 2024-04-25T10:03:00.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:00.026+0000 7fe826bf4640 1 -- 172.21.15.7:0/153585372 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe820070a20 con 0x7fe82015c8f0 2024-04-25T10:03:00.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:00.026+0000 7fe81d7fa640 1 -- 172.21.15.7:0/153585372 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v73) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe80805ccc0 con 0x7fe82015c8f0 2024-04-25T10:03:00.031 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T10:03:00.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:00.028+0000 7fe826bf4640 1 -- 172.21.15.7:0/153585372 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe80006b500 msgr2=0x7fe80006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:00.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:00.028+0000 7fe826bf4640 1 --2- 172.21.15.7:0/153585372 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe80006b500 0x7fe80006d9c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fe818005880 tx=0x7fe818009040 comp rx=0 tx=0).stop 2024-04-25T10:03:00.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:00.028+0000 7fe826bf4640 1 -- 172.21.15.7:0/153585372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe82015c8f0 msgr2=0x7fe8201437f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:00.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:00.028+0000 7fe826bf4640 1 --2- 172.21.15.7:0/153585372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe82015c8f0 0x7fe8201437f0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fe80800d7d0 tx=0x7fe80800dc90 comp rx=0 tx=0).stop 2024-04-25T10:03:00.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:00.028+0000 7fe826bf4640 1 -- 172.21.15.7:0/153585372 shutdown_connections 2024-04-25T10:03:00.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:00.028+0000 7fe826bf4640 1 --2- 172.21.15.7:0/153585372 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe80006b500 0x7fe80006d9c0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:00.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:00.028+0000 7fe826bf4640 1 --2- 172.21.15.7:0/153585372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe82015c8f0 0x7fe8201437f0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:00.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:00.028+0000 7fe826bf4640 1 --2- 172.21.15.7:0/153585372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe820145260 0x7fe8201432b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:00.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:00.028+0000 7fe826bf4640 1 --2- 172.21.15.7:0/153585372 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe82006b270 0x7fe82013d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:00.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:00.028+0000 7fe826bf4640 1 -- 172.21.15.7:0/153585372 >> 172.21.15.7:0/153585372 conn(0x7fe8200b5c30 msgr2=0x7fe82006ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:00.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:00.028+0000 7fe826bf4640 1 -- 172.21.15.7:0/153585372 shutdown_connections 2024-04-25T10:03:00.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:00.028+0000 7fe826bf4640 1 -- 172.21.15.7:0/153585372 wait complete. 2024-04-25T10:03:00.044 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T10:03:00.044 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:03:00.044 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-04-25T10:03:00.044 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T10:03:00.044 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T10:03:00.044 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T10:03:00.044 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T10:03:00.045 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:03:00.045 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:03:00.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:00.045 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-04-25T10:03:00.061 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:03:00.061 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:03:00.061 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:03:00.062 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:03:00.062 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-04-25T10:03:00.062 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:03:00.062 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:03:00.062 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-04-25T10:03:00.062 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-04-25T10:03:00.062 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:03:00.062 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-04-25T10:03:00.062 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-04-25T10:03:00.062 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:03:00.062 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-04-25T10:03:00.062 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-04-25T10:03:00.062 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T10:03:00.063 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42219sec preferred_lft 42219sec 2024-04-25T10:03:00.063 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link noprefixroute 2024-04-25T10:03:00.063 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:03:00.063 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:03:00.063 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-04-25T10:03:00.063 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-04-25T10:03:00.063 INFO:teuthology.orchestra.run.smithi007.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T10:03:00.063 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 26:0c:99:53:12:e3 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:03:00.063 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T10:03:00.063 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:03:00.063 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::50aa:55ff:febc:5f67/64 scope link 2024-04-25T10:03:00.063 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:03:00.063 INFO:teuthology.orchestra.run.smithi007.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:03:00.063 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 6e:99:f1:00:a9:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:03:00.064 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6c99:f1ff:fe00:a95e/64 scope link 2024-04-25T10:03:00.064 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:03:00.064 INFO:teuthology.orchestra.run.smithi007.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:03:00.064 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 26:0c:99:53:12:e3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T10:03:00.064 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::240c:99ff:fe53:12e3/64 scope link 2024-04-25T10:03:00.064 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:03:00.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:00.064 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:03:00.125 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-04-25T10:03:00.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:00.126 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-04-25T10:03:00.182 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-04-25T10:03:00.182 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:03:00.183 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T10:03:00.183 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T10:03:00.183 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:03:00.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:00.183 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-04-25T10:03:00.183 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-25T10:03:00.183 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:03:00.183 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:03:00.183 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:03:00.183 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-25T10:03:00.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:00.268 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-04-25T10:03:00.283 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T10:03:00.283 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T10:03:00.283 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:03:00.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:00.283 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-04-25T10:03:00.348 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:03:00.348 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T10:03:00.404 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:03:00.404 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:03:00.404 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:03:00.460 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T10:03:00.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:00.460 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:03:00.542 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:03:00.542 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T10:03:00.542 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T10:03:00.550 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:03:00.551 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T10:03:00.551 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T10:03:00.551 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T10:03:00.551 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T10:03:00.556 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:03:00.556 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T10:03:00.556 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T10:03:00.556 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T10:03:00.556 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T10:03:00.556 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790" 2024-04-25T10:03:00.557 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790:/ 2024-04-25T10:03:00.557 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c03d0745-5946-49c3-ad88-1165c5b68b4e" will pass to kernel 2024-04-25T10:03:00.557 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T10:03:00.557 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-04-25T10:03:00.557 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T10:03:00.557 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T10:03:00.557 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T10:03:00.558 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T10:03:00.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:00.559 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:03:00.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:00.623 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:03:00.684 INFO:teuthology.orchestra.run.smithi007.stdout:client8547 2024-04-25T10:03:00.684 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:03:00.684 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:03:00.740 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:03:00.740 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:03:00.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:00.797 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file1_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-04-25T10:03:00.892 INFO:teuthology.orchestra.run.smithi007.stderr:6+0 records in 2024-04-25T10:03:00.892 INFO:teuthology.orchestra.run.smithi007.stderr:6+0 records out 2024-04-25T10:03:00.893 INFO:teuthology.orchestra.run.smithi007.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0359481 s, 175 MB/s 2024-04-25T10:03:00.894 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:03:00.894 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:03:00.910 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:03:00.910 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:03:00.967 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:03:01.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.102+0000 7fb11504a640 1 Processor -- start 2024-04-25T10:03:01.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.102+0000 7fb11504a640 1 -- start start 2024-04-25T10:03:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.103+0000 7fb11504a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb1100cea60 0x7fb110166420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.103+0000 7fb11504a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb11015bdc0 con 0x7fb110071ed0 2024-04-25T10:03:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.103+0000 7fb11504a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb11015c060 con 0x7fb1101529e0 2024-04-25T10:03:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.103+0000 7fb11504a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1100b2340 con 0x7fb1100cea60 2024-04-25T10:03:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.103+0000 7fb10f59e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb1100cea60 0x7fb110166420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.103+0000 7fb107fff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb110071ed0 0x7fb1100ce350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35394/0 (socket says 172.21.15.7:35394) 2024-04-25T10:03:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.103+0000 7fb107fff640 1 -- 172.21.15.7:0/2667747521 learned_addr learned my addr 172.21.15.7:0/2667747521 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:03:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.103+0000 7fb10f59e640 1 -- 172.21.15.7:0/2667747521 >> v1:172.21.15.55:6789/0 conn(0x7fb1101529e0 legacy=0x7fb1100c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.103+0000 7fb10f59e640 1 -- 172.21.15.7:0/2667747521 >> v1:172.21.15.7:6789/0 conn(0x7fb110071ed0 legacy=0x7fb1100ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.103+0000 7fb10f59e640 1 -- 172.21.15.7:0/2667747521 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11015c340 con 0x7fb1100cea60 2024-04-25T10:03:01.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.104+0000 7fb10f59e640 1 --2- 172.21.15.7:0/2667747521 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1100cea60 0x7fb110166420 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fb1100c78c0 tx=0x7fb10802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce3a6d2682c1a4a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:01.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.104+0000 7fb10e59c640 1 -- 172.21.15.7:0/2667747521 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb108007740 con 0x7fb1100cea60 2024-04-25T10:03:01.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.104+0000 7fb10e59c640 1 -- 172.21.15.7:0/2667747521 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1080078e0 con 0x7fb1100cea60 2024-04-25T10:03:01.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.104+0000 7fb10e59c640 1 -- 172.21.15.7:0/2667747521 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb108007cb0 con 0x7fb1100cea60 2024-04-25T10:03:01.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.105+0000 7fb11504a640 1 -- 172.21.15.7:0/2667747521 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1100cea60 msgr2=0x7fb110166420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:01.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.105+0000 7fb11504a640 1 --2- 172.21.15.7:0/2667747521 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1100cea60 0x7fb110166420 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fb1100c78c0 tx=0x7fb10802a6a0 comp rx=0 tx=0).stop 2024-04-25T10:03:01.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.105+0000 7fb11504a640 1 -- 172.21.15.7:0/2667747521 shutdown_connections 2024-04-25T10:03:01.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.105+0000 7fb11504a640 1 --2- 172.21.15.7:0/2667747521 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1100cea60 0x7fb110166420 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:01.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.105+0000 7fb11504a640 1 -- 172.21.15.7:0/2667747521 >> 172.21.15.7:0/2667747521 conn(0x7fb110071150 msgr2=0x7fb110071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:01.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.105+0000 7fb11504a640 1 -- 172.21.15.7:0/2667747521 shutdown_connections 2024-04-25T10:03:01.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.105+0000 7fb11504a640 1 -- 172.21.15.7:0/2667747521 wait complete. 2024-04-25T10:03:01.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.106+0000 7fb11504a640 1 Processor -- start 2024-04-25T10:03:01.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.106+0000 7fb11504a640 1 -- start start 2024-04-25T10:03:01.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.107+0000 7fb11504a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb110071ed0 0x7fb11013dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:01.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.107+0000 7fb11504a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb1100cea60 0x7fb1100b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:01.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.107+0000 7fb11504a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb11014ba50 0x7fb1101401e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:01.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.107+0000 7fb11504a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1100c65e0 con 0x7fb110071ed0 2024-04-25T10:03:01.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.107+0000 7fb11504a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11015c900 con 0x7fb11014ba50 2024-04-25T10:03:01.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.107+0000 7fb11504a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb11006e160 con 0x7fb1100cea60 2024-04-25T10:03:01.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.107+0000 7fb10ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb110071ed0 0x7fb11013dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:01.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.107+0000 7fb10ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb110071ed0 0x7fb11013dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50452/0 (socket says 172.21.15.7:50452) 2024-04-25T10:03:01.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.107+0000 7fb10ed9d640 1 -- 172.21.15.7:0/1875591186 learned_addr learned my addr 172.21.15.7:0/1875591186 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:01.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.107+0000 7fb107fff640 1 --2- 172.21.15.7:0/1875591186 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb1100cea60 0x7fb1100b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:01.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.107+0000 7fb10f59e640 1 --2- 172.21.15.7:0/1875591186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb11014ba50 0x7fb1101401e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:01.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.107+0000 7fb10ed9d640 1 -- 172.21.15.7:0/1875591186 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb1100cea60 msgr2=0x7fb1100b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:01.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.107+0000 7fb10ed9d640 1 --2- 172.21.15.7:0/1875591186 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb1100cea60 0x7fb1100b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:01.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.107+0000 7fb10ed9d640 1 -- 172.21.15.7:0/1875591186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb11014ba50 msgr2=0x7fb1101401e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:01.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.107+0000 7fb10ed9d640 1 --2- 172.21.15.7:0/1875591186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb11014ba50 0x7fb1101401e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:01.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.107+0000 7fb10ed9d640 1 -- 172.21.15.7:0/1875591186 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11014ea60 con 0x7fb110071ed0 2024-04-25T10:03:01.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.107+0000 7fb10f59e640 1 --2- 172.21.15.7:0/1875591186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb11014ba50 0x7fb1101401e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:03:01.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.107+0000 7fb107fff640 1 --2- 172.21.15.7:0/1875591186 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb1100cea60 0x7fb1100b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:03:01.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.107+0000 7fb10ed9d640 1 --2- 172.21.15.7:0/1875591186 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb110071ed0 0x7fb11013dac0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fb10000b3e0 tx=0x7fb10000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:01.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.107+0000 7fb1077fe640 1 -- 172.21.15.7:0/1875591186 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb100015020 con 0x7fb110071ed0 2024-04-25T10:03:01.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.108+0000 7fb1077fe640 1 -- 172.21.15.7:0/1875591186 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb100011850 con 0x7fb110071ed0 2024-04-25T10:03:01.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.108+0000 7fb11504a640 1 -- 172.21.15.7:0/1875591186 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb11014ed40 con 0x7fb110071ed0 2024-04-25T10:03:01.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.108+0000 7fb1077fe640 1 -- 172.21.15.7:0/1875591186 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb100011c40 con 0x7fb110071ed0 2024-04-25T10:03:01.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.108+0000 7fb11504a640 1 -- 172.21.15.7:0/1875591186 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1100b4590 con 0x7fb110071ed0 2024-04-25T10:03:01.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.108+0000 7fb11504a640 1 -- 172.21.15.7:0/1875591186 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb110068fd0 con 0x7fb110071ed0 2024-04-25T10:03:01.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.109+0000 7fb1077fe640 1 -- 172.21.15.7:0/1875591186 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb100018020 con 0x7fb110071ed0 2024-04-25T10:03:01.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.109+0000 7fb1077fe640 1 --2- 172.21.15.7:0/1875591186 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb0f006b4d0 0x7fb0f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:01.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.109+0000 7fb1077fe640 1 -- 172.21.15.7:0/1875591186 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb10008a300 con 0x7fb110071ed0 2024-04-25T10:03:01.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.109+0000 7fb107fff640 1 --2- 172.21.15.7:0/1875591186 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb0f006b4d0 0x7fb0f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:01.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.110+0000 7fb107fff640 1 --2- 172.21.15.7:0/1875591186 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb0f006b4d0 0x7fb0f006d990 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fb11014b1a0 tx=0x7fb0f8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:01.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.114+0000 7fb1077fe640 1 -- 172.21.15.7:0/1875591186 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb10001f020 con 0x7fb110071ed0 2024-04-25T10:03:01.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.294+0000 7fb11504a640 1 -- 172.21.15.7:0/1875591186 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb11015a0a0 con 0x7fb110071ed0 2024-04-25T10:03:01.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.296+0000 7fb1077fe640 1 -- 172.21.15.7:0/1875591186 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+16788 (secure 0 0 0) 0x7fb1000172c0 con 0x7fb110071ed0 2024-04-25T10:03:01.301 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:03:01.301 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":103,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:02:51.586260+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:02:48.213751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T10:02:48.916114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:03:01.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.297+0000 7fb11504a640 1 -- 172.21.15.7:0/1875591186 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb0f006b4d0 msgr2=0x7fb0f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:01.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.297+0000 7fb11504a640 1 --2- 172.21.15.7:0/1875591186 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb0f006b4d0 0x7fb0f006d990 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fb11014b1a0 tx=0x7fb0f8009040 comp rx=0 tx=0).stop 2024-04-25T10:03:01.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.297+0000 7fb11504a640 1 -- 172.21.15.7:0/1875591186 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb110071ed0 msgr2=0x7fb11013dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:01.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.297+0000 7fb11504a640 1 --2- 172.21.15.7:0/1875591186 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb110071ed0 0x7fb11013dac0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fb10000b3e0 tx=0x7fb10000b8a0 comp rx=0 tx=0).stop 2024-04-25T10:03:01.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.297+0000 7fb11504a640 1 -- 172.21.15.7:0/1875591186 shutdown_connections 2024-04-25T10:03:01.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.297+0000 7fb11504a640 1 --2- 172.21.15.7:0/1875591186 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb0f006b4d0 0x7fb0f006d990 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:01.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.297+0000 7fb11504a640 1 --2- 172.21.15.7:0/1875591186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb11014ba50 0x7fb1101401e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:01.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.297+0000 7fb11504a640 1 --2- 172.21.15.7:0/1875591186 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb1100cea60 0x7fb1100b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:01.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.297+0000 7fb11504a640 1 --2- 172.21.15.7:0/1875591186 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb110071ed0 0x7fb11013dac0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:01.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.297+0000 7fb11504a640 1 -- 172.21.15.7:0/1875591186 >> 172.21.15.7:0/1875591186 conn(0x7fb110071150 msgr2=0x7fb1100ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:01.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.298+0000 7fb11504a640 1 -- 172.21.15.7:0/1875591186 shutdown_connections 2024-04-25T10:03:01.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.298+0000 7fb11504a640 1 -- 172.21.15.7:0/1875591186 wait complete. 2024-04-25T10:03:01.313 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:02:48.213751+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:02:48.916114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:03:01.314 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:03:01.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.412+0000 7f28b3129640 1 Processor -- start 2024-04-25T10:03:01.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.412+0000 7f28b3129640 1 -- start start 2024-04-25T10:03:01.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.413+0000 7f28b3129640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f28ac0d3760 0x7f28ac15eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:01.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.413+0000 7f28b3129640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ac0ced10 con 0x7f28ac15f1c0 2024-04-25T10:03:01.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.413+0000 7f28b3129640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ac0d1b40 con 0x7f28ac0ce830 2024-04-25T10:03:01.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.413+0000 7f28b3129640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28ac0ce380 con 0x7f28ac0d3760 2024-04-25T10:03:01.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.413+0000 7f28abfff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f28ac15f1c0 0x7f28ac0d3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35402/0 (socket says 172.21.15.7:35402) 2024-04-25T10:03:01.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.413+0000 7f28abfff640 1 -- 172.21.15.7:0/3073983909 learned_addr learned my addr 172.21.15.7:0/3073983909 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:03:01.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.413+0000 7f28b0ec5640 1 --2- 172.21.15.7:0/3073983909 >> v2:172.21.15.55:3300/0 conn(0x7f28ac0d3760 0x7f28ac15eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:01.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.414+0000 7f28ab7fe640 1 -- 172.21.15.7:0/3073983909 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2910403386 0 0) 0x7f28ac0ced10 con 0x7f28ac15f1c0 2024-04-25T10:03:01.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.414+0000 7f28ab7fe640 1 -- 172.21.15.7:0/3073983909 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2898003520 con 0x7f28ac15f1c0 2024-04-25T10:03:01.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.414+0000 7f28ab7fe640 1 -- 172.21.15.7:0/3073983909 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2030268505 0 0) 0x7f2898003520 con 0x7f28ac15f1c0 2024-04-25T10:03:01.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.414+0000 7f28ab7fe640 1 -- 172.21.15.7:0/3073983909 >> v2:172.21.15.55:3300/0 conn(0x7f28ac0d3760 msgr2=0x7f28ac15eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:01.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.414+0000 7f28ab7fe640 1 --2- 172.21.15.7:0/3073983909 >> v2:172.21.15.55:3300/0 conn(0x7f28ac0d3760 0x7f28ac15eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:01.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.414+0000 7f28ab7fe640 1 -- 172.21.15.7:0/3073983909 >> v1:172.21.15.55:6789/0 conn(0x7f28ac0ce830 legacy=0x7f28ac0b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:01.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.414+0000 7f28ab7fe640 1 -- 172.21.15.7:0/3073983909 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac0d1e20 con 0x7f28ac15f1c0 2024-04-25T10:03:01.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.414+0000 7f28ab7fe640 1 -- 172.21.15.7:0/3073983909 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f289c001670 con 0x7f28ac15f1c0 2024-04-25T10:03:01.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.414+0000 7f28ab7fe640 1 -- 172.21.15.7:0/3073983909 >> v1:172.21.15.7:6789/0 conn(0x7f28ac15f1c0 legacy=0x7f28ac0d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:01.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.414+0000 7f28ab7fe640 1 --2- 172.21.15.7:0/3073983909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28980039b0 0x7f2898003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:01.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.414+0000 7f28ab7fe640 1 --2- 172.21.15.7:0/3073983909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2898004800 0x7f2898004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:01.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.414+0000 7f28ab7fe640 1 --2- 172.21.15.7:0/3073983909 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28980051c0 0x7f289800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:01.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.414+0000 7f28ab7fe640 1 -- 172.21.15.7:0/3073983909 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289800c030 con 0x7f2898004800 2024-04-25T10:03:01.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.414+0000 7f28ab7fe640 1 -- 172.21.15.7:0/3073983909 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289800c1e0 con 0x7f28980039b0 2024-04-25T10:03:01.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.414+0000 7f28ab7fe640 1 -- 172.21.15.7:0/3073983909 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289800c3e0 con 0x7f28980051c0 2024-04-25T10:03:01.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.414+0000 7f28abfff640 1 --2- 172.21.15.7:0/3073983909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2898004800 0x7f2898004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:01.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.414+0000 7f28b0ec5640 1 --2- 172.21.15.7:0/3073983909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28980039b0 0x7f2898003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:01.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.414+0000 7f28b16c6640 1 --2- 172.21.15.7:0/3073983909 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28980051c0 0x7f289800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:01.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.414+0000 7f28abfff640 1 -- 172.21.15.7:0/3073983909 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28980051c0 msgr2=0x7f289800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:01.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.414+0000 7f28abfff640 1 --2- 172.21.15.7:0/3073983909 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28980051c0 0x7f289800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:01.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.414+0000 7f28abfff640 1 -- 172.21.15.7:0/3073983909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28980039b0 msgr2=0x7f2898003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:01.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.414+0000 7f28abfff640 1 --2- 172.21.15.7:0/3073983909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28980039b0 0x7f2898003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:01.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.414+0000 7f28abfff640 1 -- 172.21.15.7:0/3073983909 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2898003520 con 0x7f2898004800 2024-04-25T10:03:01.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.414+0000 7f28b16c6640 1 -- 172.21.15.7:0/3073983909 reap_dead start 2024-04-25T10:03:01.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.415+0000 7f28abfff640 1 --2- 172.21.15.7:0/3073983909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2898004800 0x7f2898004c80 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f289c00c210 tx=0x7f2898005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc5e6ed766097e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:01.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.415+0000 7f28ab7fe640 1 -- 172.21.15.7:0/3073983909 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c007cf0 con 0x7f2898004800 2024-04-25T10:03:01.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.415+0000 7f28ab7fe640 1 -- 172.21.15.7:0/3073983909 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289c005af0 con 0x7f2898004800 2024-04-25T10:03:01.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.415+0000 7f28ab7fe640 1 -- 172.21.15.7:0/3073983909 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c007070 con 0x7f2898004800 2024-04-25T10:03:01.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.416+0000 7f28b3129640 1 -- 172.21.15.7:0/3073983909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2898004800 msgr2=0x7f2898004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:01.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.416+0000 7f28b3129640 1 --2- 172.21.15.7:0/3073983909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2898004800 0x7f2898004c80 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f289c00c210 tx=0x7f2898005830 comp rx=0 tx=0).stop 2024-04-25T10:03:01.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.416+0000 7f28b3129640 1 -- 172.21.15.7:0/3073983909 shutdown_connections 2024-04-25T10:03:01.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.416+0000 7f28b3129640 1 --2- 172.21.15.7:0/3073983909 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2898004800 0x7f2898004c80 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:01.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.416+0000 7f28b3129640 1 -- 172.21.15.7:0/3073983909 >> 172.21.15.7:0/3073983909 conn(0x7f28ac072680 msgr2=0x7f28ac072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:01.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.416+0000 7f28b3129640 1 -- 172.21.15.7:0/3073983909 shutdown_connections 2024-04-25T10:03:01.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.416+0000 7f28b3129640 1 -- 172.21.15.7:0/3073983909 wait complete. 2024-04-25T10:03:01.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.417+0000 7f28b3129640 1 Processor -- start 2024-04-25T10:03:01.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.417+0000 7f28b3129640 1 -- start start 2024-04-25T10:03:01.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.418+0000 7f28b3129640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2898004800 0x7f28ac15c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:01.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.418+0000 7f28b3129640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28ac1e6ca0 0x7f28ac1e7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:01.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.418+0000 7f28b3129640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28ac1497a0 0x7f28ac149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:01.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.418+0000 7f28b3129640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac15eac0 con 0x7f2898004800 2024-04-25T10:03:01.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.418+0000 7f28b3129640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac0d2190 con 0x7f28ac1e6ca0 2024-04-25T10:03:01.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.418+0000 7f28b3129640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac15ec40 con 0x7f28ac1497a0 2024-04-25T10:03:01.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.418+0000 7f28b0ec5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2898004800 0x7f28ac15c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:01.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.418+0000 7f28b0ec5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2898004800 0x7f28ac15c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50468/0 (socket says 172.21.15.7:50468) 2024-04-25T10:03:01.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.418+0000 7f28b0ec5640 1 -- 172.21.15.7:0/120006596 learned_addr learned my addr 172.21.15.7:0/120006596 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:01.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.418+0000 7f28abfff640 1 --2- 172.21.15.7:0/120006596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28ac1e6ca0 0x7f28ac1e7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:01.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.418+0000 7f28b16c6640 1 --2- 172.21.15.7:0/120006596 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28ac1497a0 0x7f28ac149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:01.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.418+0000 7f28b0ec5640 1 -- 172.21.15.7:0/120006596 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28ac1497a0 msgr2=0x7f28ac149c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:01.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.418+0000 7f28b0ec5640 1 --2- 172.21.15.7:0/120006596 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28ac1497a0 0x7f28ac149c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:01.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.418+0000 7f28b0ec5640 1 -- 172.21.15.7:0/120006596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28ac1e6ca0 msgr2=0x7f28ac1e7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:01.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.418+0000 7f28b0ec5640 1 --2- 172.21.15.7:0/120006596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28ac1e6ca0 0x7f28ac1e7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:01.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.418+0000 7f28b0ec5640 1 -- 172.21.15.7:0/120006596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac14d2d0 con 0x7f2898004800 2024-04-25T10:03:01.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.418+0000 7f28abfff640 1 --2- 172.21.15.7:0/120006596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28ac1e6ca0 0x7f28ac1e7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:01.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.418+0000 7f28b16c6640 1 --2- 172.21.15.7:0/120006596 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28ac1497a0 0x7f28ac149c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:01.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.419+0000 7f28b0ec5640 1 --2- 172.21.15.7:0/120006596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2898004800 0x7f28ac15c560 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f28a4011e30 tx=0x7f28a400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:01.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.419+0000 7f28a97fa640 1 -- 172.21.15.7:0/120006596 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a4015630 con 0x7f2898004800 2024-04-25T10:03:01.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.419+0000 7f28a97fa640 1 -- 172.21.15.7:0/120006596 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a40157d0 con 0x7f2898004800 2024-04-25T10:03:01.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.419+0000 7f28b3129640 1 -- 172.21.15.7:0/120006596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28ac0cb8f0 con 0x7f2898004800 2024-04-25T10:03:01.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.419+0000 7f28a97fa640 1 -- 172.21.15.7:0/120006596 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a4015bc0 con 0x7f2898004800 2024-04-25T10:03:01.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.419+0000 7f28b3129640 1 -- 172.21.15.7:0/120006596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ac0cbbb0 con 0x7f2898004800 2024-04-25T10:03:01.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.420+0000 7f28b3129640 1 -- 172.21.15.7:0/120006596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28ac068f60 con 0x7f2898004800 2024-04-25T10:03:01.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.420+0000 7f28a97fa640 1 -- 172.21.15.7:0/120006596 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f28a401d400 con 0x7f2898004800 2024-04-25T10:03:01.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.420+0000 7f28a97fa640 1 --2- 172.21.15.7:0/120006596 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f288c06b4d0 0x7f288c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:01.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.421+0000 7f28a97fa640 1 -- 172.21.15.7:0/120006596 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f28a408b600 con 0x7f2898004800 2024-04-25T10:03:01.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.421+0000 7f28abfff640 1 --2- 172.21.15.7:0/120006596 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f288c06b4d0 0x7f288c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:01.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.421+0000 7f28abfff640 1 --2- 172.21.15.7:0/120006596 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f288c06b4d0 0x7f288c06d990 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f28ac15f5a0 tx=0x7f289c009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:01.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.425+0000 7f28a97fa640 1 -- 172.21.15.7:0/120006596 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f28ac14d2d0 con 0x7f2898004800 2024-04-25T10:03:01.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.609+0000 7f28b3129640 1 -- 172.21.15.7:0/120006596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f28ac0b63d0 con 0x7f2898004800 2024-04-25T10:03:01.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.609+0000 7f28a97fa640 1 -- 172.21.15.7:0/120006596 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) v1 ==== 93+0+10 (secure 0 0 0) 0x7f28a4019030 con 0x7f2898004800 2024-04-25T10:03:01.615 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T10:03:01.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.611+0000 7f28b3129640 1 -- 172.21.15.7:0/120006596 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f288c06b4d0 msgr2=0x7f288c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:01.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.611+0000 7f28b3129640 1 --2- 172.21.15.7:0/120006596 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f288c06b4d0 0x7f288c06d990 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f28ac15f5a0 tx=0x7f289c009030 comp rx=0 tx=0).stop 2024-04-25T10:03:01.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.611+0000 7f28b3129640 1 -- 172.21.15.7:0/120006596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2898004800 msgr2=0x7f28ac15c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:01.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.611+0000 7f28b3129640 1 --2- 172.21.15.7:0/120006596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2898004800 0x7f28ac15c560 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f28a4011e30 tx=0x7f28a400f580 comp rx=0 tx=0).stop 2024-04-25T10:03:01.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.612+0000 7f28b3129640 1 -- 172.21.15.7:0/120006596 shutdown_connections 2024-04-25T10:03:01.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.612+0000 7f28b3129640 1 --2- 172.21.15.7:0/120006596 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f288c06b4d0 0x7f288c06d990 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:01.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.612+0000 7f28b3129640 1 --2- 172.21.15.7:0/120006596 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28ac1497a0 0x7f28ac149c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:01.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.612+0000 7f28b3129640 1 --2- 172.21.15.7:0/120006596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28ac1e6ca0 0x7f28ac1e7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:01.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.612+0000 7f28b3129640 1 --2- 172.21.15.7:0/120006596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2898004800 0x7f28ac15c560 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:01.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.612+0000 7f28b3129640 1 -- 172.21.15.7:0/120006596 >> 172.21.15.7:0/120006596 conn(0x7f28ac072680 msgr2=0x7f28ac0b87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:01.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.612+0000 7f28b3129640 1 -- 172.21.15.7:0/120006596 shutdown_connections 2024-04-25T10:03:01.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.612+0000 7f28b3129640 1 -- 172.21.15.7:0/120006596 wait complete. 2024-04-25T10:03:01.627 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:03:01.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.726+0000 7fe310e6b640 1 Processor -- start 2024-04-25T10:03:01.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.726+0000 7fe310e6b640 1 -- start start 2024-04-25T10:03:01.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.727+0000 7fe310e6b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe30c0d3760 0x7fe30c15eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:01.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.727+0000 7fe310e6b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe30c15f1c0 0x7fe30c0d3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:01.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.727+0000 7fe310e6b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe30c0d4080 con 0x7fe30c0ce830 2024-04-25T10:03:01.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.727+0000 7fe310e6b640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe30c0ce380 con 0x7fe30c15f1c0 2024-04-25T10:03:01.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.727+0000 7fe310e6b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe30c15f000 con 0x7fe30c0d3760 2024-04-25T10:03:01.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.727+0000 7fe309d9b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe30c15f1c0 0x7fe30c0d3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:01.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.728+0000 7fe309d9b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe30c15f1c0 0x7fe30c0d3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50474/0 (socket says 172.21.15.7:50474) 2024-04-25T10:03:01.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.728+0000 7fe309d9b640 1 -- 172.21.15.7:0/3624199097 learned_addr learned my addr 172.21.15.7:0/3624199097 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:01.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.728+0000 7fe30a59c640 1 --2- 172.21.15.7:0/3624199097 >> v2:172.21.15.55:3300/0 conn(0x7fe30c0d3760 0x7fe30c15eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:01.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.728+0000 7fe309d9b640 1 -- 172.21.15.7:0/3624199097 >> v2:172.21.15.55:3300/0 conn(0x7fe30c0d3760 msgr2=0x7fe30c15eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.728+0000 7fe309d9b640 1 --2- 172.21.15.7:0/3624199097 >> v2:172.21.15.55:3300/0 conn(0x7fe30c0d3760 0x7fe30c15eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.728+0000 7fe309d9b640 1 -- 172.21.15.7:0/3624199097 >> v1:172.21.15.55:6789/0 conn(0x7fe30c0ce830 legacy=0x7fe30c0b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.728+0000 7fe309d9b640 1 -- 172.21.15.7:0/3624199097 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30c0ced10 con 0x7fe30c15f1c0 2024-04-25T10:03:01.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.729+0000 7fe309d9b640 1 --2- 172.21.15.7:0/3624199097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe30c15f1c0 0x7fe30c0d3b40 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fe30c0b6320 tx=0x7fe30002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66273ea19c907e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:01.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.729+0000 7fe30959a640 1 -- 172.21.15.7:0/3624199097 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe300037070 con 0x7fe30c15f1c0 2024-04-25T10:03:01.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.729+0000 7fe30959a640 1 -- 172.21.15.7:0/3624199097 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe300032440 con 0x7fe30c15f1c0 2024-04-25T10:03:01.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.729+0000 7fe30959a640 1 -- 172.21.15.7:0/3624199097 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe300032810 con 0x7fe30c15f1c0 2024-04-25T10:03:01.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.729+0000 7fe310e6b640 1 -- 172.21.15.7:0/3624199097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe30c15f1c0 msgr2=0x7fe30c0d3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:01.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.729+0000 7fe310e6b640 1 --2- 172.21.15.7:0/3624199097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe30c15f1c0 0x7fe30c0d3b40 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fe30c0b6320 tx=0x7fe30002a230 comp rx=0 tx=0).stop 2024-04-25T10:03:01.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.729+0000 7fe310e6b640 1 -- 172.21.15.7:0/3624199097 shutdown_connections 2024-04-25T10:03:01.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.729+0000 7fe310e6b640 1 --2- 172.21.15.7:0/3624199097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe30c15f1c0 0x7fe30c0d3b40 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:01.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.729+0000 7fe310e6b640 1 --2- 172.21.15.7:0/3624199097 >> v2:172.21.15.55:3300/0 conn(0x7fe30c0d3760 0x7fe30c15eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:01.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.729+0000 7fe310e6b640 1 -- 172.21.15.7:0/3624199097 >> 172.21.15.7:0/3624199097 conn(0x7fe30c072680 msgr2=0x7fe30c072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:01.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.729+0000 7fe310e6b640 1 -- 172.21.15.7:0/3624199097 shutdown_connections 2024-04-25T10:03:01.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.729+0000 7fe310e6b640 1 -- 172.21.15.7:0/3624199097 wait complete. 2024-04-25T10:03:01.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.731+0000 7fe310e6b640 1 Processor -- start 2024-04-25T10:03:01.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.731+0000 7fe310e6b640 1 -- start start 2024-04-25T10:03:01.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.731+0000 7fe310e6b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe30c0ce830 0x7fe30c1f6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:01.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.731+0000 7fe310e6b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe30c0d3760 0x7fe30c148b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:01.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.731+0000 7fe310e6b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe30c15f1c0 0x7fe30c0d2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:01.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.731+0000 7fe310e6b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c0d1e20 con 0x7fe30c0d3760 2024-04-25T10:03:01.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.731+0000 7fe310e6b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c0d2190 con 0x7fe30c15f1c0 2024-04-25T10:03:01.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.731+0000 7fe310e6b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c15de10 con 0x7fe30c0ce830 2024-04-25T10:03:01.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.731+0000 7fe309d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe30c0d3760 0x7fe30c148b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:01.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.732+0000 7fe309d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe30c0d3760 0x7fe30c148b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50482/0 (socket says 172.21.15.7:50482) 2024-04-25T10:03:01.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.732+0000 7fe309d9b640 1 -- 172.21.15.7:0/115005595 learned_addr learned my addr 172.21.15.7:0/115005595 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:01.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.732+0000 7fe30ad9d640 1 --2- 172.21.15.7:0/115005595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe30c15f1c0 0x7fe30c0d2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:01.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.732+0000 7fe30a59c640 1 --2- 172.21.15.7:0/115005595 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe30c0ce830 0x7fe30c1f6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:01.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.732+0000 7fe309d9b640 1 -- 172.21.15.7:0/115005595 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe30c0ce830 msgr2=0x7fe30c1f6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:01.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.732+0000 7fe309d9b640 1 --2- 172.21.15.7:0/115005595 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe30c0ce830 0x7fe30c1f6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:01.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.732+0000 7fe309d9b640 1 -- 172.21.15.7:0/115005595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe30c15f1c0 msgr2=0x7fe30c0d2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:01.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.732+0000 7fe309d9b640 1 --2- 172.21.15.7:0/115005595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe30c15f1c0 0x7fe30c0d2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:01.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.732+0000 7fe309d9b640 1 -- 172.21.15.7:0/115005595 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30c1f7680 con 0x7fe30c0d3760 2024-04-25T10:03:01.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.732+0000 7fe30a59c640 1 --2- 172.21.15.7:0/115005595 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe30c0ce830 0x7fe30c1f6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:01.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.732+0000 7fe309d9b640 1 --2- 172.21.15.7:0/115005595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe30c0d3760 0x7fe30c148b50 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fe300000c00 tx=0x7fe3000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:01.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.732+0000 7fe2faffd640 1 -- 172.21.15.7:0/115005595 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe300041020 con 0x7fe30c0d3760 2024-04-25T10:03:01.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.732+0000 7fe2faffd640 1 -- 172.21.15.7:0/115005595 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3000306c0 con 0x7fe30c0d3760 2024-04-25T10:03:01.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.732+0000 7fe310e6b640 1 -- 172.21.15.7:0/115005595 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe30c1f7960 con 0x7fe30c0d3760 2024-04-25T10:03:01.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.732+0000 7fe2faffd640 1 -- 172.21.15.7:0/115005595 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe300037040 con 0x7fe30c0d3760 2024-04-25T10:03:01.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.732+0000 7fe310e6b640 1 -- 172.21.15.7:0/115005595 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe30c0ca940 con 0x7fe30c0d3760 2024-04-25T10:03:01.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.733+0000 7fe310e6b640 1 -- 172.21.15.7:0/115005595 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe30c0cf1e0 con 0x7fe30c0d3760 2024-04-25T10:03:01.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.734+0000 7fe2faffd640 1 -- 172.21.15.7:0/115005595 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe300044020 con 0x7fe30c0d3760 2024-04-25T10:03:01.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.734+0000 7fe2faffd640 1 --2- 172.21.15.7:0/115005595 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe2ec06b4d0 0x7fe2ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:01.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.734+0000 7fe2faffd640 1 -- 172.21.15.7:0/115005595 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe3000aa790 con 0x7fe30c0d3760 2024-04-25T10:03:01.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.734+0000 7fe30a59c640 1 --2- 172.21.15.7:0/115005595 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe2ec06b4d0 0x7fe2ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:01.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.735+0000 7fe30a59c640 1 --2- 172.21.15.7:0/115005595 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe2ec06b4d0 0x7fe2ec06d990 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc006fd0 tx=0x7fe2fc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:01.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.738+0000 7fe2faffd640 1 -- 172.21.15.7:0/115005595 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe30c0cf1e0 con 0x7fe30c0d3760 2024-04-25T10:03:01.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.916+0000 7fe310e6b640 1 -- 172.21.15.7:0/115005595 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe30c0ce140 con 0x7fe30c0d3760 2024-04-25T10:03:01.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.916+0000 7fe2faffd640 1 -- 172.21.15.7:0/115005595 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v103) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe30004b070 con 0x7fe30c0d3760 2024-04-25T10:03:01.921 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T10:03:01.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.918+0000 7fe310e6b640 1 -- 172.21.15.7:0/115005595 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe2ec06b4d0 msgr2=0x7fe2ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:01.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.918+0000 7fe310e6b640 1 --2- 172.21.15.7:0/115005595 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe2ec06b4d0 0x7fe2ec06d990 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc006fd0 tx=0x7fe2fc008040 comp rx=0 tx=0).stop 2024-04-25T10:03:01.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.918+0000 7fe310e6b640 1 -- 172.21.15.7:0/115005595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe30c0d3760 msgr2=0x7fe30c148b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:01.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.918+0000 7fe310e6b640 1 --2- 172.21.15.7:0/115005595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe30c0d3760 0x7fe30c148b50 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fe300000c00 tx=0x7fe3000046c0 comp rx=0 tx=0).stop 2024-04-25T10:03:01.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.918+0000 7fe310e6b640 1 -- 172.21.15.7:0/115005595 shutdown_connections 2024-04-25T10:03:01.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.918+0000 7fe310e6b640 1 --2- 172.21.15.7:0/115005595 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe2ec06b4d0 0x7fe2ec06d990 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:01.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.918+0000 7fe310e6b640 1 --2- 172.21.15.7:0/115005595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe30c15f1c0 0x7fe30c0d2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:01.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.918+0000 7fe310e6b640 1 --2- 172.21.15.7:0/115005595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe30c0d3760 0x7fe30c148b50 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:01.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.918+0000 7fe310e6b640 1 --2- 172.21.15.7:0/115005595 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe30c0ce830 0x7fe30c1f6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:01.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.918+0000 7fe310e6b640 1 -- 172.21.15.7:0/115005595 >> 172.21.15.7:0/115005595 conn(0x7fe30c072680 msgr2=0x7fe30c072a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:01.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.918+0000 7fe310e6b640 1 -- 172.21.15.7:0/115005595 shutdown_connections 2024-04-25T10:03:01.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:01.918+0000 7fe310e6b640 1 -- 172.21.15.7:0/115005595 wait complete. 2024-04-25T10:03:01.934 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:03:02.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.032+0000 7f8cedbb7640 1 Processor -- start 2024-04-25T10:03:02.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.032+0000 7f8cedbb7640 1 -- start start 2024-04-25T10:03:02.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.033+0000 7f8cedbb7640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ce80cfc40 0x7f8ce80d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:02.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.033+0000 7f8cedbb7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8ce80cc580 0x7f8ce80cca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:02.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.033+0000 7f8cedbb7640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce80b25e0 con 0x7f8ce80b1480 2024-04-25T10:03:02.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.033+0000 7f8cedbb7640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce815bec0 con 0x7f8ce80cc580 2024-04-25T10:03:02.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.033+0000 7f8cedbb7640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce80d0560 con 0x7f8ce80cfc40 2024-04-25T10:03:02.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.033+0000 7f8ce6ffd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f8ce80b1480 0x7f8ce80b0ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35410/0 (socket says 172.21.15.7:35410) 2024-04-25T10:03:02.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.033+0000 7f8ce6ffd640 1 -- 172.21.15.7:0/1984968155 learned_addr learned my addr 172.21.15.7:0/1984968155 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:03:02.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.034+0000 7f8ce67fc640 1 -- 172.21.15.7:0/1984968155 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1992696237 0 0) 0x7f8ce80b25e0 con 0x7f8ce80b1480 2024-04-25T10:03:02.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.034+0000 7f8ce67fc640 1 -- 172.21.15.7:0/1984968155 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cd0003520 con 0x7f8ce80b1480 2024-04-25T10:03:02.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.034+0000 7f8ce7fff640 1 --2- 172.21.15.7:0/1984968155 >> v2:172.21.15.55:3300/0 conn(0x7f8ce80cc580 0x7f8ce80cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:02.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.034+0000 7f8ce77fe640 1 --2- 172.21.15.7:0/1984968155 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ce80cfc40 0x7f8ce80d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:02.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.034+0000 7f8ce67fc640 1 -- 172.21.15.7:0/1984968155 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2361910037 0 0) 0x7f8cd0003520 con 0x7f8ce80b1480 2024-04-25T10:03:02.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.034+0000 7f8ce67fc640 1 -- 172.21.15.7:0/1984968155 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ce80cfc40 msgr2=0x7f8ce80d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:02.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.034+0000 7f8ce67fc640 1 --2- 172.21.15.7:0/1984968155 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ce80cfc40 0x7f8ce80d0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:02.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.034+0000 7f8ce67fc640 1 -- 172.21.15.7:0/1984968155 >> v2:172.21.15.55:3300/0 conn(0x7f8ce80cc580 msgr2=0x7f8ce80cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:02.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.034+0000 7f8ce67fc640 1 --2- 172.21.15.7:0/1984968155 >> v2:172.21.15.55:3300/0 conn(0x7f8ce80cc580 0x7f8ce80cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:02.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.034+0000 7f8ce67fc640 1 -- 172.21.15.7:0/1984968155 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce80b19d0 con 0x7f8ce80b1480 2024-04-25T10:03:02.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.034+0000 7f8ce67fc640 1 -- 172.21.15.7:0/1984968155 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f8cdc001670 con 0x7f8ce80b1480 2024-04-25T10:03:02.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.034+0000 7f8ce67fc640 1 -- 172.21.15.7:0/1984968155 >> v1:172.21.15.7:6789/0 conn(0x7f8ce80b1480 legacy=0x7f8ce80b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:02.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.034+0000 7f8ce67fc640 1 --2- 172.21.15.7:0/1984968155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cd00039b0 0x7f8cd0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:02.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.034+0000 7f8ce67fc640 1 --2- 172.21.15.7:0/1984968155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8cd0004800 0x7f8cd0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:02.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.034+0000 7f8ce67fc640 1 --2- 172.21.15.7:0/1984968155 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ce80cfc40 0x7f8cd00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:02.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.034+0000 7f8ce67fc640 1 -- 172.21.15.7:0/1984968155 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce815bec0 con 0x7f8cd00039b0 2024-04-25T10:03:02.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.034+0000 7f8ce67fc640 1 -- 172.21.15.7:0/1984968155 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce80d0560 con 0x7f8cd0004800 2024-04-25T10:03:02.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.034+0000 7f8ce67fc640 1 -- 172.21.15.7:0/1984968155 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd000b9c0 con 0x7f8ce80cfc40 2024-04-25T10:03:02.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.034+0000 7f8ce77fe640 1 --2- 172.21.15.7:0/1984968155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cd00039b0 0x7f8cd0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:02.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.034+0000 7f8ce6ffd640 1 --2- 172.21.15.7:0/1984968155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8cd0004800 0x7f8cd0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:02.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.034+0000 7f8ce7fff640 1 --2- 172.21.15.7:0/1984968155 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ce80cfc40 0x7f8cd00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:02.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.034+0000 7f8ce77fe640 1 -- 172.21.15.7:0/1984968155 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ce80cfc40 msgr2=0x7f8cd00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:02.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.035+0000 7f8ce77fe640 1 --2- 172.21.15.7:0/1984968155 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ce80cfc40 0x7f8cd00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:02.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.035+0000 7f8ce77fe640 1 -- 172.21.15.7:0/1984968155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8cd0004800 msgr2=0x7f8cd0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:02.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.035+0000 7f8ce77fe640 1 --2- 172.21.15.7:0/1984968155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8cd0004800 0x7f8cd0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:02.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.035+0000 7f8ce77fe640 1 -- 172.21.15.7:0/1984968155 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd0003520 con 0x7f8cd00039b0 2024-04-25T10:03:02.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.035+0000 7f8ce7fff640 1 --2- 172.21.15.7:0/1984968155 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ce80cfc40 0x7f8cd00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:02.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.035+0000 7f8ce6ffd640 1 --2- 172.21.15.7:0/1984968155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8cd0004800 0x7f8cd0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:02.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.035+0000 7f8ce77fe640 1 --2- 172.21.15.7:0/1984968155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cd00039b0 0x7f8cd0003dd0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8009af0 tx=0x7f8cd0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ca361dfa28be91 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:02.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.035+0000 7f8ce67fc640 1 -- 172.21.15.7:0/1984968155 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8036070 con 0x7f8cd00039b0 2024-04-25T10:03:02.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.035+0000 7f8ce67fc640 1 -- 172.21.15.7:0/1984968155 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd8031400 con 0x7f8cd00039b0 2024-04-25T10:03:02.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.035+0000 7f8ce67fc640 1 -- 172.21.15.7:0/1984968155 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8009690 con 0x7f8cd00039b0 2024-04-25T10:03:02.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.036+0000 7f8cedbb7640 1 -- 172.21.15.7:0/1984968155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cd00039b0 msgr2=0x7f8cd0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:02.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.036+0000 7f8cedbb7640 1 --2- 172.21.15.7:0/1984968155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cd00039b0 0x7f8cd0003dd0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8009af0 tx=0x7f8cd0005830 comp rx=0 tx=0).stop 2024-04-25T10:03:02.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.036+0000 7f8ce7fff640 1 -- 172.21.15.7:0/1984968155 reap_dead start 2024-04-25T10:03:02.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.036+0000 7f8cedbb7640 1 -- 172.21.15.7:0/1984968155 shutdown_connections 2024-04-25T10:03:02.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.036+0000 7f8cedbb7640 1 -- 172.21.15.7:0/1984968155 >> 172.21.15.7:0/1984968155 conn(0x7f8ce808af80 msgr2=0x7f8ce808b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:02.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.036+0000 7f8cedbb7640 1 -- 172.21.15.7:0/1984968155 shutdown_connections 2024-04-25T10:03:02.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.036+0000 7f8cedbb7640 1 -- 172.21.15.7:0/1984968155 wait complete. 2024-04-25T10:03:02.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.037+0000 7f8cedbb7640 1 Processor -- start 2024-04-25T10:03:02.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.037+0000 7f8cedbb7640 1 -- start start 2024-04-25T10:03:02.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.038+0000 7f8cedbb7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cd00039b0 0x7f8ce80c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:02.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.038+0000 7f8cedbb7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ce80b4e10 0x7f8ce81ee990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:02.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.038+0000 7f8cedbb7640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ce80c7470 0x7f8ce80c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:02.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.038+0000 7f8cedbb7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce80b2270 con 0x7f8cd00039b0 2024-04-25T10:03:02.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.038+0000 7f8cedbb7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce80b1f90 con 0x7f8ce80b4e10 2024-04-25T10:03:02.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.038+0000 7f8cedbb7640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce80d0020 con 0x7f8ce80c7470 2024-04-25T10:03:02.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.038+0000 7f8ce77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cd00039b0 0x7f8ce80c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:02.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.038+0000 7f8ce77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cd00039b0 0x7f8ce80c5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50492/0 (socket says 172.21.15.7:50492) 2024-04-25T10:03:02.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.038+0000 7f8ce77fe640 1 -- 172.21.15.7:0/2134592548 learned_addr learned my addr 172.21.15.7:0/2134592548 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:02.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.038+0000 7f8ce6ffd640 1 --2- 172.21.15.7:0/2134592548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ce80b4e10 0x7f8ce81ee990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:02.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.038+0000 7f8ce7fff640 1 --2- 172.21.15.7:0/2134592548 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ce80c7470 0x7f8ce80c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:02.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.038+0000 7f8ce77fe640 1 -- 172.21.15.7:0/2134592548 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ce80c7470 msgr2=0x7f8ce80c78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:02.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.038+0000 7f8ce77fe640 1 --2- 172.21.15.7:0/2134592548 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ce80c7470 0x7f8ce80c78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:02.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.038+0000 7f8ce77fe640 1 -- 172.21.15.7:0/2134592548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ce80b4e10 msgr2=0x7f8ce81ee990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:02.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.038+0000 7f8ce77fe640 1 --2- 172.21.15.7:0/2134592548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ce80b4e10 0x7f8ce81ee990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:02.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.038+0000 7f8ce77fe640 1 -- 172.21.15.7:0/2134592548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce81f1580 con 0x7f8cd00039b0 2024-04-25T10:03:02.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.039+0000 7f8ce77fe640 1 --2- 172.21.15.7:0/2134592548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cd00039b0 0x7f8ce80c5b80 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8009af0 tx=0x7f8cd8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:02.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.039+0000 7f8ccffff640 1 -- 172.21.15.7:0/2134592548 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8041020 con 0x7f8cd00039b0 2024-04-25T10:03:02.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.039+0000 7f8ccffff640 1 -- 172.21.15.7:0/2134592548 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd803c470 con 0x7f8cd00039b0 2024-04-25T10:03:02.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.039+0000 7f8cedbb7640 1 -- 172.21.15.7:0/2134592548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce81f1860 con 0x7f8cd00039b0 2024-04-25T10:03:02.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.039+0000 7f8ccffff640 1 -- 172.21.15.7:0/2134592548 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8036040 con 0x7f8cd00039b0 2024-04-25T10:03:02.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.039+0000 7f8cedbb7640 1 -- 172.21.15.7:0/2134592548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce81f1e20 con 0x7f8cd00039b0 2024-04-25T10:03:02.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.040+0000 7f8cedbb7640 1 -- 172.21.15.7:0/2134592548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce8068f60 con 0x7f8cd00039b0 2024-04-25T10:03:02.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.041+0000 7f8ccffff640 1 -- 172.21.15.7:0/2134592548 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8cd8044020 con 0x7f8cd00039b0 2024-04-25T10:03:02.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.041+0000 7f8ccffff640 1 --2- 172.21.15.7:0/2134592548 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8cd406b500 0x7f8cd406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:02.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.041+0000 7f8ccffff640 1 -- 172.21.15.7:0/2134592548 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8cd80aa2d0 con 0x7f8cd00039b0 2024-04-25T10:03:02.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.041+0000 7f8ce6ffd640 1 --2- 172.21.15.7:0/2134592548 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8cd406b500 0x7f8cd406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:02.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.042+0000 7f8ce6ffd640 1 --2- 172.21.15.7:0/2134592548 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8cd406b500 0x7f8cd406d9c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc000c00 tx=0x7f8cdc001be0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:02.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.045+0000 7f8ccffff640 1 -- 172.21.15.7:0/2134592548 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8cd8078fc0 con 0x7f8cd00039b0 2024-04-25T10:03:02.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.227+0000 7f8cedbb7640 1 -- 172.21.15.7:0/2134592548 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8ce80cd9e0 con 0x7f8cd00039b0 2024-04-25T10:03:02.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.227+0000 7f8ccffff640 1 -- 172.21.15.7:0/2134592548 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v103) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8cd80aa0f0 con 0x7f8cd00039b0 2024-04-25T10:03:02.232 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T10:03:02.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.229+0000 7f8cedbb7640 1 -- 172.21.15.7:0/2134592548 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8cd406b500 msgr2=0x7f8cd406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:02.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.229+0000 7f8cedbb7640 1 --2- 172.21.15.7:0/2134592548 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8cd406b500 0x7f8cd406d9c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc000c00 tx=0x7f8cdc001be0 comp rx=0 tx=0).stop 2024-04-25T10:03:02.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.229+0000 7f8cedbb7640 1 -- 172.21.15.7:0/2134592548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cd00039b0 msgr2=0x7f8ce80c5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:02.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.229+0000 7f8cedbb7640 1 --2- 172.21.15.7:0/2134592548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cd00039b0 0x7f8ce80c5b80 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8009af0 tx=0x7f8cd8004730 comp rx=0 tx=0).stop 2024-04-25T10:03:02.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.229+0000 7f8cedbb7640 1 -- 172.21.15.7:0/2134592548 shutdown_connections 2024-04-25T10:03:02.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.229+0000 7f8cedbb7640 1 --2- 172.21.15.7:0/2134592548 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8cd406b500 0x7f8cd406d9c0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:02.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.229+0000 7f8cedbb7640 1 --2- 172.21.15.7:0/2134592548 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8ce80c7470 0x7f8ce80c78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:02.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.229+0000 7f8cedbb7640 1 --2- 172.21.15.7:0/2134592548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ce80b4e10 0x7f8ce81ee990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:02.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.229+0000 7f8cedbb7640 1 --2- 172.21.15.7:0/2134592548 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cd00039b0 0x7f8ce80c5b80 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:02.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.229+0000 7f8cedbb7640 1 -- 172.21.15.7:0/2134592548 >> 172.21.15.7:0/2134592548 conn(0x7f8ce808af80 msgr2=0x7f8ce806fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:02.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.229+0000 7f8cedbb7640 1 -- 172.21.15.7:0/2134592548 shutdown_connections 2024-04-25T10:03:02.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.229+0000 7f8cedbb7640 1 -- 172.21.15.7:0/2134592548 wait complete. 2024-04-25T10:03:02.245 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:03:02.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.342+0000 7f2a48a9e640 1 Processor -- start 2024-04-25T10:03:02.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.342+0000 7f2a48a9e640 1 -- start start 2024-04-25T10:03:02.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.343+0000 7f2a48a9e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2a4415db00 0x7f2a440d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:02.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.343+0000 7f2a48a9e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2a440b53b0 0x7f2a440d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:02.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.343+0000 7f2a48a9e640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a440d1e80 con 0x7f2a440ce2b0 2024-04-25T10:03:02.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.343+0000 7f2a48a9e640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a440b5930 con 0x7f2a4415db00 2024-04-25T10:03:02.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.343+0000 7f2a48a9e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a440b5c10 con 0x7f2a440b53b0 2024-04-25T10:03:02.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.343+0000 7f2a4259c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2a4415db00 0x7f2a440d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:02.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.343+0000 7f2a42d9d640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2a440ce2b0 0x7f2a44161670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35420/0 (socket says 172.21.15.7:35420) 2024-04-25T10:03:02.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.343+0000 7f2a42d9d640 1 -- 172.21.15.7:0/4155269126 learned_addr learned my addr 172.21.15.7:0/4155269126 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:03:02.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.344+0000 7f2a41d9b640 1 --2- 172.21.15.7:0/4155269126 >> v2:172.21.15.55:3300/0 conn(0x7f2a440b53b0 0x7f2a440d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:02.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.344+0000 7f2a4259c640 1 -- 172.21.15.7:0/4155269126 >> v2:172.21.15.55:3300/0 conn(0x7f2a440b53b0 msgr2=0x7f2a440d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:02.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.344+0000 7f2a4259c640 1 --2- 172.21.15.7:0/4155269126 >> v2:172.21.15.55:3300/0 conn(0x7f2a440b53b0 0x7f2a440d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:02.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.344+0000 7f2a4259c640 1 -- 172.21.15.7:0/4155269126 >> v1:172.21.15.7:6789/0 conn(0x7f2a440ce2b0 legacy=0x7f2a44161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:02.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.344+0000 7f2a4159a640 1 -- 172.21.15.7:0/4155269126 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 124794541 0 0) 0x7f2a440d1e80 con 0x7f2a440ce2b0 2024-04-25T10:03:02.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.344+0000 7f2a4259c640 1 -- 172.21.15.7:0/4155269126 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a440b5ef0 con 0x7f2a4415db00 2024-04-25T10:03:02.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.344+0000 7f2a41d9b640 1 --2- 172.21.15.7:0/4155269126 >> v2:172.21.15.55:3300/0 conn(0x7f2a440b53b0 0x7f2a440d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:03:02.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.344+0000 7f2a4259c640 1 --2- 172.21.15.7:0/4155269126 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a4415db00 0x7f2a440d0340 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f2a440d4a00 tx=0x7f2a3402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8bb94c4e35c9aa0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:02.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.345+0000 7f2a4159a640 1 -- 172.21.15.7:0/4155269126 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34037070 con 0x7f2a4415db00 2024-04-25T10:03:02.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.345+0000 7f2a4159a640 1 -- 172.21.15.7:0/4155269126 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a34032440 con 0x7f2a4415db00 2024-04-25T10:03:02.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.345+0000 7f2a4159a640 1 -- 172.21.15.7:0/4155269126 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34032810 con 0x7f2a4415db00 2024-04-25T10:03:02.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.345+0000 7f2a48a9e640 1 -- 172.21.15.7:0/4155269126 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a4415db00 msgr2=0x7f2a440d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:02.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.345+0000 7f2a48a9e640 1 --2- 172.21.15.7:0/4155269126 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a4415db00 0x7f2a440d0340 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f2a440d4a00 tx=0x7f2a3402a1a0 comp rx=0 tx=0).stop 2024-04-25T10:03:02.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.345+0000 7f2a48a9e640 1 -- 172.21.15.7:0/4155269126 shutdown_connections 2024-04-25T10:03:02.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.345+0000 7f2a48a9e640 1 --2- 172.21.15.7:0/4155269126 >> v2:172.21.15.55:3300/0 conn(0x7f2a440b53b0 0x7f2a440d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:02.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.345+0000 7f2a48a9e640 1 --2- 172.21.15.7:0/4155269126 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a4415db00 0x7f2a440d0340 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:02.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.345+0000 7f2a48a9e640 1 -- 172.21.15.7:0/4155269126 >> 172.21.15.7:0/4155269126 conn(0x7f2a44072290 msgr2=0x7f2a440726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:02.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.345+0000 7f2a48a9e640 1 -- 172.21.15.7:0/4155269126 shutdown_connections 2024-04-25T10:03:02.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.345+0000 7f2a48a9e640 1 -- 172.21.15.7:0/4155269126 wait complete. 2024-04-25T10:03:02.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.346+0000 7f2a48a9e640 1 Processor -- start 2024-04-25T10:03:02.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.347+0000 7f2a48a9e640 1 -- start start 2024-04-25T10:03:02.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.347+0000 7f2a48a9e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a440b53b0 0x7f2a441f6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:02.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.347+0000 7f2a48a9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a440ce2b0 0x7f2a4415f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:02.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.347+0000 7f2a48a9e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2a4415db00 0x7f2a44160570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:02.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.347+0000 7f2a48a9e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a440d3660 con 0x7f2a440b53b0 2024-04-25T10:03:02.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.347+0000 7f2a48a9e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a440b61d0 con 0x7f2a440ce2b0 2024-04-25T10:03:02.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.347+0000 7f2a48a9e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a440b6c10 con 0x7f2a4415db00 2024-04-25T10:03:02.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.347+0000 7f2a4259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a440b53b0 0x7f2a441f6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:02.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.347+0000 7f2a4259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a440b53b0 0x7f2a441f6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50500/0 (socket says 172.21.15.7:50500) 2024-04-25T10:03:02.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.347+0000 7f2a4259c640 1 -- 172.21.15.7:0/3727780008 learned_addr learned my addr 172.21.15.7:0/3727780008 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:02.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.348+0000 7f2a42d9d640 1 --2- 172.21.15.7:0/3727780008 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2a4415db00 0x7f2a44160570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:02.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.348+0000 7f2a41d9b640 1 --2- 172.21.15.7:0/3727780008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a440ce2b0 0x7f2a4415f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:02.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.348+0000 7f2a4259c640 1 -- 172.21.15.7:0/3727780008 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2a4415db00 msgr2=0x7f2a44160570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:02.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.348+0000 7f2a4259c640 1 --2- 172.21.15.7:0/3727780008 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2a4415db00 0x7f2a44160570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:02.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.348+0000 7f2a4259c640 1 -- 172.21.15.7:0/3727780008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a440ce2b0 msgr2=0x7f2a4415f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:02.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.348+0000 7f2a4259c640 1 --2- 172.21.15.7:0/3727780008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a440ce2b0 0x7f2a4415f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:02.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.348+0000 7f2a4259c640 1 -- 172.21.15.7:0/3727780008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a44142910 con 0x7f2a440b53b0 2024-04-25T10:03:02.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.348+0000 7f2a4259c640 1 --2- 172.21.15.7:0/3727780008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a440b53b0 0x7f2a441f6910 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f2a34000c00 tx=0x7f2a340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:02.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.348+0000 7f2a32ffd640 1 -- 172.21.15.7:0/3727780008 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34037040 con 0x7f2a440b53b0 2024-04-25T10:03:02.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.348+0000 7f2a32ffd640 1 -- 172.21.15.7:0/3727780008 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a34042070 con 0x7f2a440b53b0 2024-04-25T10:03:02.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.348+0000 7f2a48a9e640 1 -- 172.21.15.7:0/3727780008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a44142bf0 con 0x7f2a440b53b0 2024-04-25T10:03:02.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.348+0000 7f2a32ffd640 1 -- 172.21.15.7:0/3727780008 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34030a50 con 0x7f2a440b53b0 2024-04-25T10:03:02.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.348+0000 7f2a48a9e640 1 -- 172.21.15.7:0/3727780008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a441431b0 con 0x7f2a440b53b0 2024-04-25T10:03:02.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.349+0000 7f2a48a9e640 1 -- 172.21.15.7:0/3727780008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a44068fd0 con 0x7f2a440b53b0 2024-04-25T10:03:02.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.350+0000 7f2a32ffd640 1 -- 172.21.15.7:0/3727780008 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2a34030bf0 con 0x7f2a440b53b0 2024-04-25T10:03:02.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.350+0000 7f2a32ffd640 1 --2- 172.21.15.7:0/3727780008 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2a2406b4d0 0x7f2a2406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:02.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.350+0000 7f2a32ffd640 1 -- 172.21.15.7:0/3727780008 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2a340aaeb0 con 0x7f2a440b53b0 2024-04-25T10:03:02.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.350+0000 7f2a41d9b640 1 --2- 172.21.15.7:0/3727780008 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2a2406b4d0 0x7f2a2406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:02.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.351+0000 7f2a41d9b640 1 --2- 172.21.15.7:0/3727780008 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2a2406b4d0 0x7f2a2406d990 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2a440d0ad0 tx=0x7f2a38008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:02.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.354+0000 7f2a32ffd640 1 -- 172.21.15.7:0/3727780008 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2a34045360 con 0x7f2a440b53b0 2024-04-25T10:03:02.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.546+0000 7f2a48a9e640 1 -- 172.21.15.7:0/3727780008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2a441f6e50 con 0x7f2a440b53b0 2024-04-25T10:03:02.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.546+0000 7f2a32ffd640 1 -- 172.21.15.7:0/3727780008 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v103) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2a34079c30 con 0x7f2a440b53b0 2024-04-25T10:03:02.552 INFO:teuthology.orchestra.run.smithi007.stderr:listed 0 entries 2024-04-25T10:03:02.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.548+0000 7f2a48a9e640 1 -- 172.21.15.7:0/3727780008 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2a2406b4d0 msgr2=0x7f2a2406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:02.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.548+0000 7f2a48a9e640 1 --2- 172.21.15.7:0/3727780008 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2a2406b4d0 0x7f2a2406d990 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2a440d0ad0 tx=0x7f2a38008040 comp rx=0 tx=0).stop 2024-04-25T10:03:02.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.548+0000 7f2a48a9e640 1 -- 172.21.15.7:0/3727780008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a440b53b0 msgr2=0x7f2a441f6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:02.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.548+0000 7f2a48a9e640 1 --2- 172.21.15.7:0/3727780008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a440b53b0 0x7f2a441f6910 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f2a34000c00 tx=0x7f2a340046c0 comp rx=0 tx=0).stop 2024-04-25T10:03:02.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.548+0000 7f2a48a9e640 1 -- 172.21.15.7:0/3727780008 shutdown_connections 2024-04-25T10:03:02.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.548+0000 7f2a48a9e640 1 --2- 172.21.15.7:0/3727780008 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2a2406b4d0 0x7f2a2406d990 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:02.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.548+0000 7f2a48a9e640 1 --2- 172.21.15.7:0/3727780008 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2a4415db00 0x7f2a44160570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:02.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.548+0000 7f2a48a9e640 1 --2- 172.21.15.7:0/3727780008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a440ce2b0 0x7f2a4415f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:02.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.548+0000 7f2a48a9e640 1 --2- 172.21.15.7:0/3727780008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a440b53b0 0x7f2a441f6910 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:02.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.548+0000 7f2a48a9e640 1 -- 172.21.15.7:0/3727780008 >> 172.21.15.7:0/3727780008 conn(0x7f2a44072290 msgr2=0x7f2a440b7710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:02.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.549+0000 7f2a48a9e640 1 -- 172.21.15.7:0/3727780008 shutdown_connections 2024-04-25T10:03:02.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.549+0000 7f2a48a9e640 1 -- 172.21.15.7:0/3727780008 wait complete. 2024-04-25T10:03:02.564 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T10:03:02.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:02.564 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T10:03:02.595 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-04-25T10:03:02.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:02.595 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T10:03:02.651 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:03:02.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.787+0000 7fbb41fc1640 1 Processor -- start 2024-04-25T10:03:02.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.787+0000 7fbb41fc1640 1 -- start start 2024-04-25T10:03:02.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.788+0000 7fbb41fc1640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbb3c0d0a50 0x7fbb3c0d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:02.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.788+0000 7fbb41fc1640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb3c0d1e80 con 0x7fbb3c15db00 2024-04-25T10:03:02.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.788+0000 7fbb41fc1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb3c0b5930 con 0x7fbb3c0b53b0 2024-04-25T10:03:02.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.788+0000 7fbb41fc1640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb3c0b5c10 con 0x7fbb3c0d0a50 2024-04-25T10:03:02.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.788+0000 7fbb3affd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbb3c0d0a50 0x7fbb3c0d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:02.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.788+0000 7fbb3b7fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbb3c15db00 0x7fbb3c0d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35434/0 (socket says 172.21.15.7:35434) 2024-04-25T10:03:02.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.788+0000 7fbb3b7fe640 1 -- 172.21.15.7:0/2713168975 learned_addr learned my addr 172.21.15.7:0/2713168975 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:03:02.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.789+0000 7fbb3affd640 1 -- 172.21.15.7:0/2713168975 >> v1:172.21.15.55:6789/0 conn(0x7fbb3c0b53b0 legacy=0x7fbb3c0d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:02.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.789+0000 7fbb3affd640 1 -- 172.21.15.7:0/2713168975 >> v1:172.21.15.7:6789/0 conn(0x7fbb3c15db00 legacy=0x7fbb3c0d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:02.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.789+0000 7fbb3a7fc640 1 -- 172.21.15.7:0/2713168975 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 978151872 0 0) 0x7fbb3c0d1e80 con 0x7fbb3c15db00 2024-04-25T10:03:02.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.789+0000 7fbb3affd640 1 -- 172.21.15.7:0/2713168975 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3c0b5ef0 con 0x7fbb3c0d0a50 2024-04-25T10:03:02.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.789+0000 7fbb3affd640 1 --2- 172.21.15.7:0/2713168975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb3c0d0a50 0x7fbb3c0d2330 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fbb300097a0 tx=0x7fbb3002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e275e66e4b02a039 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:02.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.789+0000 7fbb3a7fc640 1 -- 172.21.15.7:0/2713168975 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb30037070 con 0x7fbb3c0d0a50 2024-04-25T10:03:02.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.789+0000 7fbb3a7fc640 1 -- 172.21.15.7:0/2713168975 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb30032440 con 0x7fbb3c0d0a50 2024-04-25T10:03:02.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.790+0000 7fbb3a7fc640 1 -- 172.21.15.7:0/2713168975 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb30032810 con 0x7fbb3c0d0a50 2024-04-25T10:03:02.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.790+0000 7fbb41fc1640 1 -- 172.21.15.7:0/2713168975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb3c0d0a50 msgr2=0x7fbb3c0d2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:02.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.790+0000 7fbb41fc1640 1 --2- 172.21.15.7:0/2713168975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb3c0d0a50 0x7fbb3c0d2330 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fbb300097a0 tx=0x7fbb3002a230 comp rx=0 tx=0).stop 2024-04-25T10:03:02.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.790+0000 7fbb41fc1640 1 -- 172.21.15.7:0/2713168975 shutdown_connections 2024-04-25T10:03:02.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.790+0000 7fbb41fc1640 1 --2- 172.21.15.7:0/2713168975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb3c0d0a50 0x7fbb3c0d2330 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:02.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.790+0000 7fbb41fc1640 1 -- 172.21.15.7:0/2713168975 >> 172.21.15.7:0/2713168975 conn(0x7fbb3c072290 msgr2=0x7fbb3c0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:02.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.790+0000 7fbb41fc1640 1 -- 172.21.15.7:0/2713168975 shutdown_connections 2024-04-25T10:03:02.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.790+0000 7fbb41fc1640 1 -- 172.21.15.7:0/2713168975 wait complete. 2024-04-25T10:03:02.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.791+0000 7fbb41fc1640 1 Processor -- start 2024-04-25T10:03:02.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.791+0000 7fbb41fc1640 1 -- start start 2024-04-25T10:03:02.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.792+0000 7fbb41fc1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb3c0b53b0 0x7fbb3c14e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:02.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.792+0000 7fbb41fc1640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbb3c0d0a50 0x7fbb3c0c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:02.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.792+0000 7fbb41fc1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb3c15db00 0x7fbb3c0d2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:02.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.792+0000 7fbb41fc1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c0d3660 con 0x7fbb3c0b53b0 2024-04-25T10:03:02.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.792+0000 7fbb41fc1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c0b61d0 con 0x7fbb3c15db00 2024-04-25T10:03:02.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.792+0000 7fbb41fc1640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c0d2f80 con 0x7fbb3c0d0a50 2024-04-25T10:03:02.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.792+0000 7fbb3b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb3c0b53b0 0x7fbb3c14e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:02.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.792+0000 7fbb3b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb3c0b53b0 0x7fbb3c14e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50524/0 (socket says 172.21.15.7:50524) 2024-04-25T10:03:02.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.792+0000 7fbb3b7fe640 1 -- 172.21.15.7:0/456951264 learned_addr learned my addr 172.21.15.7:0/456951264 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:02.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.792+0000 7fbb3affd640 1 --2- 172.21.15.7:0/456951264 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbb3c0d0a50 0x7fbb3c0c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:02.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.792+0000 7fbb3bfff640 1 --2- 172.21.15.7:0/456951264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb3c15db00 0x7fbb3c0d2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:02.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.793+0000 7fbb3b7fe640 1 -- 172.21.15.7:0/456951264 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbb3c0d0a50 msgr2=0x7fbb3c0c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:02.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.793+0000 7fbb3b7fe640 1 --2- 172.21.15.7:0/456951264 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbb3c0d0a50 0x7fbb3c0c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:02.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.793+0000 7fbb3b7fe640 1 -- 172.21.15.7:0/456951264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb3c15db00 msgr2=0x7fbb3c0d2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:02.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.793+0000 7fbb3b7fe640 1 --2- 172.21.15.7:0/456951264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb3c15db00 0x7fbb3c0d2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:02.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.793+0000 7fbb3b7fe640 1 -- 172.21.15.7:0/456951264 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3c0caf00 con 0x7fbb3c0b53b0 2024-04-25T10:03:02.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.793+0000 7fbb3affd640 1 --2- 172.21.15.7:0/456951264 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbb3c0d0a50 0x7fbb3c0c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:03:02.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.793+0000 7fbb3b7fe640 1 --2- 172.21.15.7:0/456951264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb3c0b53b0 0x7fbb3c14e910 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c00c3f0 tx=0x7fbb2c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:02.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.793+0000 7fbb23fff640 1 -- 172.21.15.7:0/456951264 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c0074e0 con 0x7fbb3c0b53b0 2024-04-25T10:03:02.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.793+0000 7fbb23fff640 1 -- 172.21.15.7:0/456951264 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2c0047e0 con 0x7fbb3c0b53b0 2024-04-25T10:03:02.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.793+0000 7fbb23fff640 1 -- 172.21.15.7:0/456951264 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c004bd0 con 0x7fbb3c0b53b0 2024-04-25T10:03:02.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.793+0000 7fbb41fc1640 1 -- 172.21.15.7:0/456951264 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb3c0cb1e0 con 0x7fbb3c0b53b0 2024-04-25T10:03:02.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.793+0000 7fbb41fc1640 1 -- 172.21.15.7:0/456951264 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb3c0cb7a0 con 0x7fbb3c0b53b0 2024-04-25T10:03:02.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.794+0000 7fbb41fc1640 1 -- 172.21.15.7:0/456951264 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb3c068fd0 con 0x7fbb3c0b53b0 2024-04-25T10:03:02.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.794+0000 7fbb23fff640 1 -- 172.21.15.7:0/456951264 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbb2c011070 con 0x7fbb3c0b53b0 2024-04-25T10:03:02.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.795+0000 7fbb23fff640 1 --2- 172.21.15.7:0/456951264 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbb2806b4d0 0x7fbb2806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:02.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.795+0000 7fbb23fff640 1 -- 172.21.15.7:0/456951264 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbb2c089f30 con 0x7fbb3c0b53b0 2024-04-25T10:03:02.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.795+0000 7fbb3affd640 1 --2- 172.21.15.7:0/456951264 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbb2806b4d0 0x7fbb2806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:02.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.795+0000 7fbb3affd640 1 --2- 172.21.15.7:0/456951264 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbb2806b4d0 0x7fbb2806d990 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fbb30034000 tx=0x7fbb3002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:02.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:02.799+0000 7fbb23fff640 1 -- 172.21.15.7:0/456951264 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbb2c058cb0 con 0x7fbb3c0b53b0 2024-04-25T10:03:03.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.016+0000 7fbb41fc1640 1 -- 172.21.15.7:0/456951264 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb3c0d16b0 con 0x7fbb3c0b53b0 2024-04-25T10:03:03.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.016+0000 7fbb23fff640 1 -- 172.21.15.7:0/456951264 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4931 (secure 0 0 0) 0x7fbb2c0585b0 con 0x7fbb3c0b53b0 2024-04-25T10:03:03.021 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:03:03.022 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":73,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6617,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3278722694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3278722694},{"type":"v1","addr":"172.21.15.55:6835","nonce":3278722694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":7435,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3598653097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3598653097},{"type":"v1","addr":"172.21.15.55:6834","nonce":3598653097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":8361,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3628875229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3628875229},{"type":"v1","addr":"172.21.15.7:6836","nonce":3628875229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:02:49.944298+0000","modified":"2024-04-25T10:02:51.943060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8364},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8364":{"gid":8364,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6837/900729992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":900729992},{"type":"v1","addr":"172.21.15.7:6837","nonce":900729992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T10:03:03.022 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 73 2024-04-25T10:03:03.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.019+0000 7fbb41fc1640 1 -- 172.21.15.7:0/456951264 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbb2806b4d0 msgr2=0x7fbb2806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:03.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.019+0000 7fbb41fc1640 1 --2- 172.21.15.7:0/456951264 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbb2806b4d0 0x7fbb2806d990 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fbb30034000 tx=0x7fbb3002e000 comp rx=0 tx=0).stop 2024-04-25T10:03:03.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.019+0000 7fbb41fc1640 1 -- 172.21.15.7:0/456951264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb3c0b53b0 msgr2=0x7fbb3c14e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:03.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.019+0000 7fbb41fc1640 1 --2- 172.21.15.7:0/456951264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb3c0b53b0 0x7fbb3c14e910 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c00c3f0 tx=0x7fbb2c00c8b0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.019+0000 7fbb41fc1640 1 -- 172.21.15.7:0/456951264 shutdown_connections 2024-04-25T10:03:03.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.019+0000 7fbb41fc1640 1 --2- 172.21.15.7:0/456951264 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbb2806b4d0 0x7fbb2806d990 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.019+0000 7fbb41fc1640 1 --2- 172.21.15.7:0/456951264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb3c15db00 0x7fbb3c0d2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.019+0000 7fbb41fc1640 1 --2- 172.21.15.7:0/456951264 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbb3c0d0a50 0x7fbb3c0c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.019+0000 7fbb41fc1640 1 --2- 172.21.15.7:0/456951264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb3c0b53b0 0x7fbb3c14e910 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.019+0000 7fbb41fc1640 1 -- 172.21.15.7:0/456951264 >> 172.21.15.7:0/456951264 conn(0x7fbb3c072290 msgr2=0x7fbb3c0d4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:03.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.019+0000 7fbb41fc1640 1 -- 172.21.15.7:0/456951264 shutdown_connections 2024-04-25T10:03:03.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.019+0000 7fbb41fc1640 1 -- 172.21.15.7:0/456951264 wait complete. 2024-04-25T10:03:03.035 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-25T10:03:03.165 INFO:teuthology.orchestra.run.smithi007.stdout:{"message":"","return_code":0} 2024-04-25T10:03:03.165 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T10:03:03.166 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:03:03.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.261+0000 7f0b51f09640 1 Processor -- start 2024-04-25T10:03:03.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.261+0000 7f0b51f09640 1 -- start start 2024-04-25T10:03:03.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.262+0000 7f0b51f09640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0b4c15da60 0x7f0b4c0d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:03.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.262+0000 7f0b51f09640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0b4c15e2d0 0x7f0b4c0ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:03.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.262+0000 7f0b51f09640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b4c15e8a0 con 0x7f0b4c15de40 2024-04-25T10:03:03.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.262+0000 7f0b51f09640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b4c15eb80 con 0x7f0b4c15da60 2024-04-25T10:03:03.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.262+0000 7f0b51f09640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b4c15ee60 con 0x7f0b4c15e2d0 2024-04-25T10:03:03.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.262+0000 7f0b4b7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0b4c15da60 0x7f0b4c0d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:03.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.262+0000 7f0b4b7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0b4c15da60 0x7f0b4c0d0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50530/0 (socket says 172.21.15.7:50530) 2024-04-25T10:03:03.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.262+0000 7f0b4b7fe640 1 -- 172.21.15.7:0/696912776 learned_addr learned my addr 172.21.15.7:0/696912776 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:03.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.262+0000 7f0b4b7fe640 1 -- 172.21.15.7:0/696912776 >> v2:172.21.15.55:3300/0 conn(0x7f0b4c15e2d0 msgr2=0x7f0b4c0ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:03.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.262+0000 7f0b4bfff640 1 --2- 172.21.15.7:0/696912776 >> v2:172.21.15.55:3300/0 conn(0x7f0b4c15e2d0 0x7f0b4c0ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:03.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.262+0000 7f0b4b7fe640 1 --2- 172.21.15.7:0/696912776 >> v2:172.21.15.55:3300/0 conn(0x7f0b4c15e2d0 0x7f0b4c0ce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.262+0000 7f0b4b7fe640 1 -- 172.21.15.7:0/696912776 >> v1:172.21.15.55:6789/0 conn(0x7f0b4c15de40 legacy=0x7f0b4c161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:03.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.262+0000 7f0b4b7fe640 1 -- 172.21.15.7:0/696912776 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4c161850 con 0x7f0b4c15da60 2024-04-25T10:03:03.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.262+0000 7f0b4bfff640 1 --2- 172.21.15.7:0/696912776 >> v2:172.21.15.55:3300/0 conn(0x7f0b4c15e2d0 0x7f0b4c0ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:03:03.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.263+0000 7f0b4b7fe640 1 --2- 172.21.15.7:0/696912776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b4c15da60 0x7f0b4c0d0aa0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c161580 tx=0x7f0b3c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d80a8a9bd80d397 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:03.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.263+0000 7f0b4a7fc640 1 -- 172.21.15.7:0/696912776 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c037070 con 0x7f0b4c15da60 2024-04-25T10:03:03.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.263+0000 7f0b4a7fc640 1 -- 172.21.15.7:0/696912776 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3c032440 con 0x7f0b4c15da60 2024-04-25T10:03:03.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.263+0000 7f0b4a7fc640 1 -- 172.21.15.7:0/696912776 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c032810 con 0x7f0b4c15da60 2024-04-25T10:03:03.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.264+0000 7f0b51f09640 1 -- 172.21.15.7:0/696912776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b4c15da60 msgr2=0x7f0b4c0d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:03.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.264+0000 7f0b51f09640 1 --2- 172.21.15.7:0/696912776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b4c15da60 0x7f0b4c0d0aa0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c161580 tx=0x7f0b3c02a1a0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.264+0000 7f0b51f09640 1 -- 172.21.15.7:0/696912776 shutdown_connections 2024-04-25T10:03:03.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.264+0000 7f0b51f09640 1 --2- 172.21.15.7:0/696912776 >> v2:172.21.15.55:3300/0 conn(0x7f0b4c15e2d0 0x7f0b4c0ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.264+0000 7f0b51f09640 1 --2- 172.21.15.7:0/696912776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b4c15da60 0x7f0b4c0d0aa0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.264+0000 7f0b51f09640 1 -- 172.21.15.7:0/696912776 >> 172.21.15.7:0/696912776 conn(0x7f0b4c06bfe0 msgr2=0x7f0b4c06c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:03.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.264+0000 7f0b51f09640 1 -- 172.21.15.7:0/696912776 shutdown_connections 2024-04-25T10:03:03.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.264+0000 7f0b51f09640 1 -- 172.21.15.7:0/696912776 wait complete. 2024-04-25T10:03:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.265+0000 7f0b51f09640 1 Processor -- start 2024-04-25T10:03:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.265+0000 7f0b51f09640 1 -- start start 2024-04-25T10:03:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.266+0000 7f0b51f09640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b4c15da60 0x7f0b4c0b1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.266+0000 7f0b51f09640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b4c15de40 0x7f0b4c0b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.266+0000 7f0b51f09640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b4c15e2d0 0x7f0b4c0aa220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.266+0000 7f0b51f09640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c0cebe0 con 0x7f0b4c15de40 2024-04-25T10:03:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.266+0000 7f0b51f09640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c0cea60 con 0x7f0b4c15da60 2024-04-25T10:03:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.266+0000 7f0b51f09640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c0ced60 con 0x7f0b4c15e2d0 2024-04-25T10:03:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.266+0000 7f0b4affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b4c15de40 0x7f0b4c0b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.266+0000 7f0b4affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b4c15de40 0x7f0b4c0b4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50538/0 (socket says 172.21.15.7:50538) 2024-04-25T10:03:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.266+0000 7f0b4affd640 1 -- 172.21.15.7:0/300871857 learned_addr learned my addr 172.21.15.7:0/300871857 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.266+0000 7f0b4b7fe640 1 --2- 172.21.15.7:0/300871857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b4c15da60 0x7f0b4c0b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.266+0000 7f0b4bfff640 1 --2- 172.21.15.7:0/300871857 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b4c15e2d0 0x7f0b4c0aa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:03.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.266+0000 7f0b4affd640 1 -- 172.21.15.7:0/300871857 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b4c15e2d0 msgr2=0x7f0b4c0aa220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:03.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.266+0000 7f0b4affd640 1 --2- 172.21.15.7:0/300871857 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b4c15e2d0 0x7f0b4c0aa220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.266+0000 7f0b4affd640 1 -- 172.21.15.7:0/300871857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b4c15da60 msgr2=0x7f0b4c0b1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:03.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.266+0000 7f0b4affd640 1 --2- 172.21.15.7:0/300871857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b4c15da60 0x7f0b4c0b1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.266+0000 7f0b4affd640 1 -- 172.21.15.7:0/300871857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4c0cb810 con 0x7f0b4c15de40 2024-04-25T10:03:03.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.266+0000 7f0b4b7fe640 1 --2- 172.21.15.7:0/300871857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b4c15da60 0x7f0b4c0b1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:03.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.266+0000 7f0b4bfff640 1 --2- 172.21.15.7:0/300871857 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b4c15e2d0 0x7f0b4c0aa220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:03.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.267+0000 7f0b4affd640 1 --2- 172.21.15.7:0/300871857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b4c15de40 0x7f0b4c0b4d10 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000b3f0 tx=0x7f0b4000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:03.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.267+0000 7f0b33fff640 1 -- 172.21.15.7:0/300871857 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b40015020 con 0x7f0b4c15de40 2024-04-25T10:03:03.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.267+0000 7f0b33fff640 1 -- 172.21.15.7:0/300871857 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b40011830 con 0x7f0b4c15de40 2024-04-25T10:03:03.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.267+0000 7f0b51f09640 1 -- 172.21.15.7:0/300871857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b4c0b1e70 con 0x7f0b4c15de40 2024-04-25T10:03:03.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.267+0000 7f0b33fff640 1 -- 172.21.15.7:0/300871857 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b40011c20 con 0x7f0b4c15de40 2024-04-25T10:03:03.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.267+0000 7f0b51f09640 1 -- 172.21.15.7:0/300871857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b4c0b58d0 con 0x7f0b4c15de40 2024-04-25T10:03:03.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.268+0000 7f0b51f09640 1 -- 172.21.15.7:0/300871857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b4c068fd0 con 0x7f0b4c15de40 2024-04-25T10:03:03.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.268+0000 7f0b33fff640 1 -- 172.21.15.7:0/300871857 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0b40018020 con 0x7f0b4c15de40 2024-04-25T10:03:03.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.269+0000 7f0b33fff640 1 --2- 172.21.15.7:0/300871857 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0b3806b4d0 0x7f0b3806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:03.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.269+0000 7f0b33fff640 1 -- 172.21.15.7:0/300871857 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0b40089f20 con 0x7f0b4c15de40 2024-04-25T10:03:03.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.269+0000 7f0b4b7fe640 1 --2- 172.21.15.7:0/300871857 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0b3806b4d0 0x7f0b3806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:03.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.269+0000 7f0b4b7fe640 1 --2- 172.21.15.7:0/300871857 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0b3806b4d0 0x7f0b3806d990 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c034000 tx=0x7f0b3c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:03.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.273+0000 7f0b33fff640 1 -- 172.21.15.7:0/300871857 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0b4001f030 con 0x7f0b4c15de40 2024-04-25T10:03:03.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.487+0000 7f0b51f09640 1 -- 172.21.15.7:0/300871857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b4c0ca1b0 con 0x7f0b4c15de40 2024-04-25T10:03:03.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.488+0000 7f0b33fff640 1 -- 172.21.15.7:0/300871857 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4931 (secure 0 0 0) 0x7f0b400172c0 con 0x7f0b4c15de40 2024-04-25T10:03:03.493 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:03:03.493 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":73,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6617,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3278722694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3278722694},{"type":"v1","addr":"172.21.15.55:6835","nonce":3278722694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":7435,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3598653097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3598653097},{"type":"v1","addr":"172.21.15.55:6834","nonce":3598653097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":8361,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3628875229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3628875229},{"type":"v1","addr":"172.21.15.7:6836","nonce":3628875229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:02:49.944298+0000","modified":"2024-04-25T10:02:51.943060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8364},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8364":{"gid":8364,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6837/900729992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":900729992},{"type":"v1","addr":"172.21.15.7:6837","nonce":900729992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T10:03:03.494 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 73 2024-04-25T10:03:03.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.490+0000 7f0b51f09640 1 -- 172.21.15.7:0/300871857 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0b3806b4d0 msgr2=0x7f0b3806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:03.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.490+0000 7f0b51f09640 1 --2- 172.21.15.7:0/300871857 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0b3806b4d0 0x7f0b3806d990 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c034000 tx=0x7f0b3c02e000 comp rx=0 tx=0).stop 2024-04-25T10:03:03.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.490+0000 7f0b51f09640 1 -- 172.21.15.7:0/300871857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b4c15de40 msgr2=0x7f0b4c0b4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:03.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.490+0000 7f0b51f09640 1 --2- 172.21.15.7:0/300871857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b4c15de40 0x7f0b4c0b4d10 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000b3f0 tx=0x7f0b4000b8b0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.490+0000 7f0b51f09640 1 -- 172.21.15.7:0/300871857 shutdown_connections 2024-04-25T10:03:03.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.490+0000 7f0b51f09640 1 --2- 172.21.15.7:0/300871857 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0b3806b4d0 0x7f0b3806d990 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.490+0000 7f0b51f09640 1 --2- 172.21.15.7:0/300871857 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b4c15e2d0 0x7f0b4c0aa220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.490+0000 7f0b51f09640 1 --2- 172.21.15.7:0/300871857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b4c15de40 0x7f0b4c0b4d10 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.490+0000 7f0b51f09640 1 --2- 172.21.15.7:0/300871857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b4c15da60 0x7f0b4c0b1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.490+0000 7f0b51f09640 1 -- 172.21.15.7:0/300871857 >> 172.21.15.7:0/300871857 conn(0x7f0b4c06bfe0 msgr2=0x7f0b4c1604a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:03.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.490+0000 7f0b51f09640 1 -- 172.21.15.7:0/300871857 shutdown_connections 2024-04-25T10:03:03.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.490+0000 7f0b51f09640 1 -- 172.21.15.7:0/300871857 wait complete. 2024-04-25T10:03:03.506 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata get mds0_inotable - 2024-04-25T10:03:03.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.544+0000 7f74657fef40 1 Processor -- start 2024-04-25T10:03:03.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.544+0000 7f74657fef40 1 -- start start 2024-04-25T10:03:03.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.545+0000 7f74657fef40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557fb1ca3670 0x557fb1ca2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:03.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.545+0000 7f74657fef40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557fb1ca3a50 0x557fb1ca0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:03.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.545+0000 7f74657fef40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fb1ca3e60 0x557fb1bf8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:03.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.545+0000 7f74657fef40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fb1b75df0 con 0x557fb1ca3e60 2024-04-25T10:03:03.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.545+0000 7f74657fef40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fb1b79d50 con 0x557fb1ca3a50 2024-04-25T10:03:03.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.545+0000 7f74657fef40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x557fb1c16c60 con 0x557fb1ca3670 2024-04-25T10:03:03.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.545+0000 7f7463b02640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fb1ca3e60 0x557fb1bf8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:03.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.545+0000 7f7463b02640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fb1ca3e60 0x557fb1bf8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50550/0 (socket says 172.21.15.7:50550) 2024-04-25T10:03:03.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.545+0000 7f7463b02640 1 -- 172.21.15.7:0/27897594 learned_addr learned my addr 172.21.15.7:0/27897594 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:03.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.545+0000 7f7462b00640 1 --2- 172.21.15.7:0/27897594 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557fb1ca3a50 0x557fb1ca0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:03.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.545+0000 7f7463301640 1 --2- 172.21.15.7:0/27897594 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557fb1ca3670 0x557fb1ca2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:03.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.545+0000 7f7463b02640 1 -- 172.21.15.7:0/27897594 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557fb1ca3670 msgr2=0x557fb1ca2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:03.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.545+0000 7f7463b02640 1 --2- 172.21.15.7:0/27897594 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557fb1ca3670 0x557fb1ca2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.545+0000 7f7463b02640 1 -- 172.21.15.7:0/27897594 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557fb1ca3a50 msgr2=0x557fb1ca0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:03.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.545+0000 7f7463b02640 1 --2- 172.21.15.7:0/27897594 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557fb1ca3a50 0x557fb1ca0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.545+0000 7f7463b02640 1 -- 172.21.15.7:0/27897594 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557fb1bfdb40 con 0x557fb1ca3e60 2024-04-25T10:03:03.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.545+0000 7f7462b00640 1 --2- 172.21.15.7:0/27897594 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557fb1ca3a50 0x557fb1ca0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:03.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.545+0000 7f7463b02640 1 --2- 172.21.15.7:0/27897594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fb1ca3e60 0x557fb1bf8e80 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f74540015b0 tx=0x7f7454001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ecd00412e786c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:03.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.545+0000 7f7461afe640 1 -- 172.21.15.7:0/27897594 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7454016070 con 0x557fb1ca3e60 2024-04-25T10:03:03.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.545+0000 7f7461afe640 1 -- 172.21.15.7:0/27897594 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745400f710 con 0x557fb1ca3e60 2024-04-25T10:03:03.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.545+0000 7f7461afe640 1 -- 172.21.15.7:0/27897594 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745400fb00 con 0x557fb1ca3e60 2024-04-25T10:03:03.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.546+0000 7f74657fef40 1 -- 172.21.15.7:0/27897594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fb1ca3e60 msgr2=0x557fb1bf8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:03.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.546+0000 7f74657fef40 1 --2- 172.21.15.7:0/27897594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fb1ca3e60 0x557fb1bf8e80 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f74540015b0 tx=0x7f7454001a70 comp rx=0 tx=0).stop 2024-04-25T10:03:03.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.546+0000 7f74657fef40 1 -- 172.21.15.7:0/27897594 shutdown_connections 2024-04-25T10:03:03.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.546+0000 7f74657fef40 1 --2- 172.21.15.7:0/27897594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fb1ca3e60 0x557fb1bf8e80 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.546+0000 7f74657fef40 1 --2- 172.21.15.7:0/27897594 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557fb1ca3a50 0x557fb1ca0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.546+0000 7f74657fef40 1 --2- 172.21.15.7:0/27897594 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557fb1ca3670 0x557fb1ca2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.546+0000 7f74657fef40 1 -- 172.21.15.7:0/27897594 >> 172.21.15.7:0/27897594 conn(0x557fb1bcda60 msgr2=0x557fb1bfd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:03.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.546+0000 7f74657fef40 1 -- 172.21.15.7:0/27897594 shutdown_connections 2024-04-25T10:03:03.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.546+0000 7f74657fef40 1 -- 172.21.15.7:0/27897594 wait complete. 2024-04-25T10:03:03.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.547+0000 7f74657fef40 1 Processor -- start 2024-04-25T10:03:03.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.547+0000 7f74657fef40 1 -- start start 2024-04-25T10:03:03.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.547+0000 7f74657fef40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fb1ca3670 0x557fb1c95d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:03.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.547+0000 7f74657fef40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557fb1ca3a50 0x557fb1bd05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:03.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.547+0000 7f74657fef40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557fb1ca3e60 0x557fb1bd0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:03.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.547+0000 7f74657fef40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fb1c9c800 con 0x557fb1ca3670 2024-04-25T10:03:03.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.547+0000 7f74657fef40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fb1c9c5b0 con 0x557fb1ca3a50 2024-04-25T10:03:03.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.547+0000 7f74657fef40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x557fb1bceec0 con 0x557fb1ca3e60 2024-04-25T10:03:03.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.547+0000 7f7463301640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fb1ca3670 0x557fb1c95d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:03.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.547+0000 7f7463301640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fb1ca3670 0x557fb1c95d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50558/0 (socket says 172.21.15.7:50558) 2024-04-25T10:03:03.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.547+0000 7f7463301640 1 -- 172.21.15.7:0/3704000457 learned_addr learned my addr 172.21.15.7:0/3704000457 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:03.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.548+0000 7f7462b00640 1 --2- 172.21.15.7:0/3704000457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557fb1ca3a50 0x557fb1bd05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:03.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.548+0000 7f7463b02640 1 --2- 172.21.15.7:0/3704000457 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557fb1ca3e60 0x557fb1bd0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:03.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.548+0000 7f7463301640 1 -- 172.21.15.7:0/3704000457 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557fb1ca3e60 msgr2=0x557fb1bd0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:03.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.548+0000 7f7463301640 1 --2- 172.21.15.7:0/3704000457 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x557fb1ca3e60 0x557fb1bd0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.548+0000 7f7463301640 1 -- 172.21.15.7:0/3704000457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557fb1ca3a50 msgr2=0x557fb1bd05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:03.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.548+0000 7f7463301640 1 --2- 172.21.15.7:0/3704000457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557fb1ca3a50 0x557fb1bd05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.548+0000 7f7463301640 1 -- 172.21.15.7:0/3704000457 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557fb1ca4cb0 con 0x557fb1ca3670 2024-04-25T10:03:03.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.548+0000 7f7463301640 1 --2- 172.21.15.7:0/3704000457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fb1ca3670 0x557fb1c95d40 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f745c001db0 tx=0x7f745c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:03.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.548+0000 7f7460afc640 1 -- 172.21.15.7:0/3704000457 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c00f860 con 0x557fb1ca3670 2024-04-25T10:03:03.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.548+0000 7f7460afc640 1 -- 172.21.15.7:0/3704000457 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745c00fa00 con 0x557fb1ca3670 2024-04-25T10:03:03.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.548+0000 7f7460afc640 1 -- 172.21.15.7:0/3704000457 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c00fdd0 con 0x557fb1ca3670 2024-04-25T10:03:03.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.548+0000 7f74657fef40 1 -- 172.21.15.7:0/3704000457 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557fb1ca5c70 con 0x557fb1ca3670 2024-04-25T10:03:03.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.548+0000 7f74657fef40 1 -- 172.21.15.7:0/3704000457 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557fb1c96280 con 0x557fb1ca3670 2024-04-25T10:03:03.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.550+0000 7f7460afc640 1 -- 172.21.15.7:0/3704000457 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f745c017400 con 0x557fb1ca3670 2024-04-25T10:03:03.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.550+0000 7f7460afc640 1 --2- 172.21.15.7:0/3704000457 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7444069eb0 0x7f744406c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:03.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.550+0000 7f7460afc640 1 -- 172.21.15.7:0/3704000457 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f745c089850 con 0x557fb1ca3670 2024-04-25T10:03:03.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.550+0000 7f7462b00640 1 --2- 172.21.15.7:0/3704000457 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7444069eb0 0x7f744406c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:03.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.550+0000 7f74657fef40 1 --2- 172.21.15.7:0/3704000457 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x557fb1d314d0 0x557fb1c9ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:03.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.550+0000 7f74657fef40 1 -- 172.21.15.7:0/3704000457 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:1 15.13 15:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103) v9 -- 0x557fb1c9f2d0 con 0x557fb1d314d0 2024-04-25T10:03:03.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.550+0000 7f7463b02640 1 --2- 172.21.15.7:0/3704000457 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x557fb1d314d0 0x557fb1c9ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:03.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.551+0000 7f7462b00640 1 --2- 172.21.15.7:0/3704000457 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7444069eb0 0x7f744406c370 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f744c056000 tx=0x7f744c050000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:03.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.551+0000 7f7463b02640 1 --2- 172.21.15.7:0/3704000457 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x557fb1d314d0 0x557fb1c9ed90 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:03.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.551+0000 7f7463b02640 1 -- 172.21.15.7:0/3704000457 <== osd.1 v2:172.21.15.7:6816/434435857 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv3 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x7f745400f070 con 0x557fb1d314d0 2024-04-25T10:03:03.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.551+0000 7f74657fef40 1 -- 172.21.15.7:0/3704000457 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x557fb1d314d0 msgr2=0x557fb1c9ed90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:03.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.551+0000 7f74657fef40 1 --2- 172.21.15.7:0/3704000457 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x557fb1d314d0 0x557fb1c9ed90 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.551+0000 7f74657fef40 1 -- 172.21.15.7:0/3704000457 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7444069eb0 msgr2=0x7f744406c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:03.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.551+0000 7f74657fef40 1 --2- 172.21.15.7:0/3704000457 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7444069eb0 0x7f744406c370 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f744c056000 tx=0x7f744c050000 comp rx=0 tx=0).stop 2024-04-25T10:03:03.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.551+0000 7f74657fef40 1 -- 172.21.15.7:0/3704000457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fb1ca3670 msgr2=0x557fb1c95d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:03.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.551+0000 7f74657fef40 1 --2- 172.21.15.7:0/3704000457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557fb1ca3670 0x557fb1c95d40 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f745c001db0 tx=0x7f745c00b6c0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.551+0000 7f7463b02640 1 -- 172.21.15.7:0/3704000457 reap_dead start 2024-04-25T10:03:03.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.551+0000 7f74657fef40 1 -- 172.21.15.7:0/3704000457 shutdown_connections 2024-04-25T10:03:03.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.551+0000 7f74657fef40 1 -- 172.21.15.7:0/3704000457 >> 172.21.15.7:0/3704000457 conn(0x557fb1bcda60 msgr2=0x557fb1c9b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:03.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.551+0000 7f74657fef40 1 -- 172.21.15.7:0/3704000457 shutdown_connections 2024-04-25T10:03:03.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.551+0000 7f74657fef40 1 -- 172.21.15.7:0/3704000457 wait complete. 2024-04-25T10:03:03.562 INFO:teuthology.orchestra.run.smithi007.stdout:����� 2024-04-25T10:03:03.562 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:03:03.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.700+0000 7fbab1c4a640 1 Processor -- start 2024-04-25T10:03:03.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.700+0000 7fbab1c4a640 1 -- start start 2024-04-25T10:03:03.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.701+0000 7fbab1c4a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbaac15ed50 0x7fbaac06f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:03.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.701+0000 7fbab1c4a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbaac0724b0 0x7fbaac072940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:03.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.701+0000 7fbab1c4a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaac0af2b0 con 0x7fbaac06eba0 2024-04-25T10:03:03.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.701+0000 7fbab1c4a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaac15f130 con 0x7fbaac0724b0 2024-04-25T10:03:03.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.701+0000 7fbaabfff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbaac0724b0 0x7fbaac072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:03.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.701+0000 7fbaaaffd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbaac06eba0 0x7fbaac0ad720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35466/0 (socket says 172.21.15.7:35466) 2024-04-25T10:03:03.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.701+0000 7fbab1c4a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaac0cfb40 con 0x7fbaac15ed50 2024-04-25T10:03:03.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.701+0000 7fbaaaffd640 1 -- 172.21.15.7:0/2933868717 learned_addr learned my addr 172.21.15.7:0/2933868717 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:03:03.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.701+0000 7fbaab7fe640 1 --2- 172.21.15.7:0/2933868717 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbaac15ed50 0x7fbaac06f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:03.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.701+0000 7fbaabfff640 1 -- 172.21.15.7:0/2933868717 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbaac15ed50 msgr2=0x7fbaac06f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:03.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.701+0000 7fbaabfff640 1 --2- 172.21.15.7:0/2933868717 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbaac15ed50 0x7fbaac06f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.701+0000 7fbaabfff640 1 -- 172.21.15.7:0/2933868717 >> v1:172.21.15.7:6789/0 conn(0x7fbaac06eba0 legacy=0x7fbaac0ad720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:03.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.701+0000 7fbaaa7fc640 1 -- 172.21.15.7:0/2933868717 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 403596473 0 0) 0x7fbaac0af2b0 con 0x7fbaac06eba0 2024-04-25T10:03:03.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.701+0000 7fbaabfff640 1 -- 172.21.15.7:0/2933868717 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaac06f870 con 0x7fbaac0724b0 2024-04-25T10:03:03.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.702+0000 7fbaabfff640 1 --2- 172.21.15.7:0/2933868717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbaac0724b0 0x7fbaac072940 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4009d90 tx=0x7fbaa402a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0c8b7851006060 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:03.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.702+0000 7fbaaa7fc640 1 -- 172.21.15.7:0/2933868717 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4007740 con 0x7fbaac0724b0 2024-04-25T10:03:03.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.702+0000 7fbaaa7fc640 1 -- 172.21.15.7:0/2933868717 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa40078e0 con 0x7fbaac0724b0 2024-04-25T10:03:03.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.702+0000 7fbaaa7fc640 1 -- 172.21.15.7:0/2933868717 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4007cb0 con 0x7fbaac0724b0 2024-04-25T10:03:03.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.703+0000 7fbab1c4a640 1 -- 172.21.15.7:0/2933868717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbaac0724b0 msgr2=0x7fbaac072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:03.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.703+0000 7fbab1c4a640 1 --2- 172.21.15.7:0/2933868717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbaac0724b0 0x7fbaac072940 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4009d90 tx=0x7fbaa402a530 comp rx=0 tx=0).stop 2024-04-25T10:03:03.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.703+0000 7fbab1c4a640 1 -- 172.21.15.7:0/2933868717 shutdown_connections 2024-04-25T10:03:03.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.703+0000 7fbab1c4a640 1 --2- 172.21.15.7:0/2933868717 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbaac0724b0 0x7fbaac072940 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.703+0000 7fbab1c4a640 1 --2- 172.21.15.7:0/2933868717 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbaac15ed50 0x7fbaac06f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.703+0000 7fbab1c4a640 1 -- 172.21.15.7:0/2933868717 >> 172.21.15.7:0/2933868717 conn(0x7fbaac0719c0 msgr2=0x7fbaac071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:03.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.703+0000 7fbab1c4a640 1 -- 172.21.15.7:0/2933868717 shutdown_connections 2024-04-25T10:03:03.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.703+0000 7fbab1c4a640 1 -- 172.21.15.7:0/2933868717 wait complete. 2024-04-25T10:03:03.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.704+0000 7fbab1c4a640 1 Processor -- start 2024-04-25T10:03:03.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.704+0000 7fbab1c4a640 1 -- start start 2024-04-25T10:03:03.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.705+0000 7fbab1c4a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaac06eba0 0x7fbaac154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:03.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.705+0000 7fbab1c4a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbaac0724b0 0x7fbaac149770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:03.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.705+0000 7fbab1c4a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbaac15ed50 0x7fbaac157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:03.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.705+0000 7fbab1c4a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaac06e890 con 0x7fbaac15ed50 2024-04-25T10:03:03.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.705+0000 7fbab1c4a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaac06e5b0 con 0x7fbaac06eba0 2024-04-25T10:03:03.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.705+0000 7fbab1c4a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaac0cc380 con 0x7fbaac0724b0 2024-04-25T10:03:03.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.705+0000 7fbaabfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbaac15ed50 0x7fbaac157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:03.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.705+0000 7fbaabfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbaac15ed50 0x7fbaac157020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50562/0 (socket says 172.21.15.7:50562) 2024-04-25T10:03:03.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.705+0000 7fbaabfff640 1 -- 172.21.15.7:0/1927316124 learned_addr learned my addr 172.21.15.7:0/1927316124 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:03.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.705+0000 7fbaaaffd640 1 --2- 172.21.15.7:0/1927316124 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbaac0724b0 0x7fbaac149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:03.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.705+0000 7fbaab7fe640 1 --2- 172.21.15.7:0/1927316124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaac06eba0 0x7fbaac154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:03.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.705+0000 7fbaabfff640 1 -- 172.21.15.7:0/1927316124 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbaac0724b0 msgr2=0x7fbaac149770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:03.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.705+0000 7fbaabfff640 1 --2- 172.21.15.7:0/1927316124 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbaac0724b0 0x7fbaac149770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.705+0000 7fbaabfff640 1 -- 172.21.15.7:0/1927316124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaac06eba0 msgr2=0x7fbaac154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:03.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.705+0000 7fbaabfff640 1 --2- 172.21.15.7:0/1927316124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaac06eba0 0x7fbaac154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.705+0000 7fbaabfff640 1 -- 172.21.15.7:0/1927316124 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaac152c20 con 0x7fbaac15ed50 2024-04-25T10:03:03.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.705+0000 7fbaab7fe640 1 --2- 172.21.15.7:0/1927316124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaac06eba0 0x7fbaac154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:03:03.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.705+0000 7fbaaaffd640 1 --2- 172.21.15.7:0/1927316124 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbaac0724b0 0x7fbaac149770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:03:03.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.705+0000 7fbaabfff640 1 --2- 172.21.15.7:0/1927316124 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbaac15ed50 0x7fbaac157020 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4009eb0 tx=0x7fbaa4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:03.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.706+0000 7fba93fff640 1 -- 172.21.15.7:0/1927316124 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4040070 con 0x7fbaac15ed50 2024-04-25T10:03:03.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.706+0000 7fba93fff640 1 -- 172.21.15.7:0/1927316124 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa4031bc0 con 0x7fbaac15ed50 2024-04-25T10:03:03.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.706+0000 7fbab1c4a640 1 -- 172.21.15.7:0/1927316124 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaac153460 con 0x7fbaac15ed50 2024-04-25T10:03:03.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.706+0000 7fba93fff640 1 -- 172.21.15.7:0/1927316124 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4045460 con 0x7fbaac15ed50 2024-04-25T10:03:03.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.706+0000 7fbab1c4a640 1 -- 172.21.15.7:0/1927316124 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaac153a20 con 0x7fbaac15ed50 2024-04-25T10:03:03.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.707+0000 7fbab1c4a640 1 -- 172.21.15.7:0/1927316124 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaac068fd0 con 0x7fbaac15ed50 2024-04-25T10:03:03.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.707+0000 7fba93fff640 1 -- 172.21.15.7:0/1927316124 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbaa4039040 con 0x7fbaac15ed50 2024-04-25T10:03:03.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.707+0000 7fba93fff640 1 --2- 172.21.15.7:0/1927316124 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fba9806b4d0 0x7fba9806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:03.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.708+0000 7fba93fff640 1 -- 172.21.15.7:0/1927316124 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbaa40abdb0 con 0x7fbaac15ed50 2024-04-25T10:03:03.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.708+0000 7fbaab7fe640 1 --2- 172.21.15.7:0/1927316124 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fba9806b4d0 0x7fba9806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:03.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.708+0000 7fbaab7fe640 1 --2- 172.21.15.7:0/1927316124 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fba9806b4d0 0x7fba9806d990 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fba9c006fd0 tx=0x7fba9c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:03.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.712+0000 7fba93fff640 1 -- 172.21.15.7:0/1927316124 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbaa40b0070 con 0x7fbaac15ed50 2024-04-25T10:03:03.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.930+0000 7fbab1c4a640 1 -- 172.21.15.7:0/1927316124 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbaac0668f0 con 0x7fbaac15ed50 2024-04-25T10:03:03.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.930+0000 7fba93fff640 1 -- 172.21.15.7:0/1927316124 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v73) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbaa407aa00 con 0x7fbaac15ed50 2024-04-25T10:03:03.935 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T10:03:03.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.932+0000 7fbab1c4a640 1 -- 172.21.15.7:0/1927316124 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fba9806b4d0 msgr2=0x7fba9806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:03.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.932+0000 7fbab1c4a640 1 --2- 172.21.15.7:0/1927316124 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fba9806b4d0 0x7fba9806d990 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fba9c006fd0 tx=0x7fba9c008040 comp rx=0 tx=0).stop 2024-04-25T10:03:03.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.932+0000 7fbab1c4a640 1 -- 172.21.15.7:0/1927316124 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbaac15ed50 msgr2=0x7fbaac157020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:03.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.932+0000 7fbab1c4a640 1 --2- 172.21.15.7:0/1927316124 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbaac15ed50 0x7fbaac157020 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4009eb0 tx=0x7fbaa4004a40 comp rx=0 tx=0).stop 2024-04-25T10:03:03.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.932+0000 7fbab1c4a640 1 -- 172.21.15.7:0/1927316124 shutdown_connections 2024-04-25T10:03:03.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.932+0000 7fbab1c4a640 1 --2- 172.21.15.7:0/1927316124 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fba9806b4d0 0x7fba9806d990 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.932+0000 7fbab1c4a640 1 --2- 172.21.15.7:0/1927316124 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbaac15ed50 0x7fbaac157020 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.932+0000 7fbab1c4a640 1 --2- 172.21.15.7:0/1927316124 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbaac0724b0 0x7fbaac149770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.932+0000 7fbab1c4a640 1 --2- 172.21.15.7:0/1927316124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaac06eba0 0x7fbaac154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:03.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.932+0000 7fbab1c4a640 1 -- 172.21.15.7:0/1927316124 >> 172.21.15.7:0/1927316124 conn(0x7fbaac0719c0 msgr2=0x7fbaac0b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:03.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.932+0000 7fbab1c4a640 1 -- 172.21.15.7:0/1927316124 shutdown_connections 2024-04-25T10:03:03.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:03.932+0000 7fbab1c4a640 1 -- 172.21.15.7:0/1927316124 wait complete. 2024-04-25T10:03:03.948 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T10:03:03.948 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:03:03.948 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-04-25T10:03:03.948 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T10:03:03.948 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T10:03:03.948 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T10:03:03.948 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T10:03:03.948 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:03:03.949 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:03:03.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:03.949 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-04-25T10:03:03.965 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:03:03.965 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:03:03.965 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:03:03.965 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:03:03.965 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-04-25T10:03:03.965 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:03:03.965 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:03:03.965 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-04-25T10:03:03.965 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-04-25T10:03:03.965 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:03:03.965 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-04-25T10:03:03.965 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-04-25T10:03:03.966 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:03:03.966 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-04-25T10:03:03.966 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-04-25T10:03:03.966 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T10:03:03.966 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42215sec preferred_lft 42215sec 2024-04-25T10:03:03.966 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link noprefixroute 2024-04-25T10:03:03.966 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:03:03.966 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:03:03.966 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-04-25T10:03:03.966 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-04-25T10:03:03.966 INFO:teuthology.orchestra.run.smithi007.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T10:03:03.966 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 26:0c:99:53:12:e3 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:03:03.966 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T10:03:03.966 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:03:03.967 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::50aa:55ff:febc:5f67/64 scope link 2024-04-25T10:03:03.967 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:03:03.967 INFO:teuthology.orchestra.run.smithi007.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:03:03.967 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 6e:99:f1:00:a9:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:03:03.967 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6c99:f1ff:fe00:a95e/64 scope link 2024-04-25T10:03:03.967 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:03:03.967 INFO:teuthology.orchestra.run.smithi007.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:03:03.967 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 26:0c:99:53:12:e3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T10:03:03.967 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::240c:99ff:fe53:12e3/64 scope link 2024-04-25T10:03:03.967 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:03:03.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:03.967 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:03:04.027 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-04-25T10:03:04.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:04.029 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-04-25T10:03:04.086 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-04-25T10:03:04.086 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:03:04.086 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T10:03:04.086 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T10:03:04.086 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:03:04.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:04.087 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-04-25T10:03:04.087 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-25T10:03:04.087 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:03:04.087 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:03:04.087 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:03:04.087 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-25T10:03:04.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:04.172 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-04-25T10:03:04.186 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T10:03:04.187 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T10:03:04.187 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:03:04.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:04.187 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-04-25T10:03:04.251 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:03:04.251 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T10:03:04.307 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:03:04.307 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:03:04.307 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:03:04.361 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T10:03:04.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:04.362 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:03:04.443 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:03:04.444 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T10:03:04.444 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T10:03:04.452 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:03:04.452 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T10:03:04.452 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T10:03:04.452 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T10:03:04.452 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T10:03:04.457 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:03:04.457 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T10:03:04.457 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T10:03:04.457 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T10:03:04.457 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T10:03:04.457 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790" 2024-04-25T10:03:04.457 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790:/ 2024-04-25T10:03:04.457 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c03d0745-5946-49c3-ad88-1165c5b68b4e" will pass to kernel 2024-04-25T10:03:04.457 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T10:03:04.458 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-04-25T10:03:04.458 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T10:03:04.458 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T10:03:04.458 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T10:03:04.459 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T10:03:04.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:04.459 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:03:04.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:04.524 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:03:04.581 INFO:teuthology.orchestra.run.smithi007.stdout:client7621 2024-04-25T10:03:04.581 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:03:04.581 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:03:04.636 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:03:04.636 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:03:04.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:04.693 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file2_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-04-25T10:03:04.780 INFO:teuthology.orchestra.run.smithi007.stderr:6+0 records in 2024-04-25T10:03:04.780 INFO:teuthology.orchestra.run.smithi007.stderr:6+0 records out 2024-04-25T10:03:04.780 INFO:teuthology.orchestra.run.smithi007.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.02911 s, 216 MB/s 2024-04-25T10:03:04.780 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:03:04.780 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:03:04.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:04.796 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file3_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-04-25T10:03:04.885 INFO:teuthology.orchestra.run.smithi007.stderr:6+0 records in 2024-04-25T10:03:04.885 INFO:teuthology.orchestra.run.smithi007.stderr:6+0 records out 2024-04-25T10:03:04.885 INFO:teuthology.orchestra.run.smithi007.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0323507 s, 194 MB/s 2024-04-25T10:03:04.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:04.886 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T10:03:04.903 INFO:teuthology.orchestra.run.smithi007.stdout:./ 2024-04-25T10:03:04.903 INFO:teuthology.orchestra.run.smithi007.stdout:./file2_sixmegs 2024-04-25T10:03:04.903 INFO:teuthology.orchestra.run.smithi007.stdout:./file3_sixmegs 2024-04-25T10:03:04.903 INFO:teuthology.orchestra.run.smithi007.stdout:./file1_sixmegs 2024-04-25T10:03:04.903 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T10:03:04.903 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T10:03:04.904 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T10:03:04.904 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T10:03:04.904 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T10:03:04.904 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T10:03:05.010 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-04-25T10:03:05.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:03:05.019 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T10:03:05.019 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T10:03:05.019 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T10:03:05.019 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T10:03:05.019 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file2_sixmegs").st_ino) 2024-04-25T10:03:05.019 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T10:03:05.126 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627777 2024-04-25T10:03:05.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:03:05.136 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T10:03:05.136 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T10:03:05.136 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T10:03:05.137 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T10:03:05.137 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file3_sixmegs").st_ino) 2024-04-25T10:03:05.137 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T10:03:05.243 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627778 2024-04-25T10:03:05.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:03:05.252 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T10:03:05.253 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T10:03:05.253 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T10:03:05.253 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T10:03:05.253 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file1_sixmegs").st_ino) 2024-04-25T10:03:05.253 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T10:03:05.360 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627776 2024-04-25T10:03:05.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:03:05.369 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:03:05.369 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:03:05.427 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:03:05.427 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:03:05.484 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:03:05.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.621+0000 7fbf31e9e640 1 Processor -- start 2024-04-25T10:03:05.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.621+0000 7fbf31e9e640 1 -- start start 2024-04-25T10:03:05.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.622+0000 7fbf31e9e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbf2c0b5e60 0x7fbf2c06bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:05.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.622+0000 7fbf31e9e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf2c0b6a40 0x7fbf2c06c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:05.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.622+0000 7fbf31e9e640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf2c06ca30 con 0x7fbf2c15dd00 2024-04-25T10:03:05.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.622+0000 7fbf31e9e640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf2c15e0e0 con 0x7fbf2c0b5e60 2024-04-25T10:03:05.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.622+0000 7fbf31e9e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c06cfe0 con 0x7fbf2c0b6a40 2024-04-25T10:03:05.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.622+0000 7fbf2affd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbf2c0b5e60 0x7fbf2c06bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:05.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.622+0000 7fbf2affd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbf2c0b5e60 0x7fbf2c06bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50576/0 (socket says 172.21.15.7:50576) 2024-04-25T10:03:05.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.622+0000 7fbf2b7fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbf2c15dd00 0x7fbf2c0b5750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35472/0 (socket says 172.21.15.7:35472) 2024-04-25T10:03:05.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.622+0000 7fbf2affd640 1 -- 172.21.15.7:0/3156700857 learned_addr learned my addr 172.21.15.7:0/3156700857 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:05.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.622+0000 7fbf2bfff640 1 --2- 172.21.15.7:0/3156700857 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf2c0b6a40 0x7fbf2c06c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:05.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.622+0000 7fbf2affd640 1 -- 172.21.15.7:0/3156700857 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf2c0b6a40 msgr2=0x7fbf2c06c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:05.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.622+0000 7fbf2affd640 1 --2- 172.21.15.7:0/3156700857 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf2c0b6a40 0x7fbf2c06c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:05.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.623+0000 7fbf2affd640 1 -- 172.21.15.7:0/3156700857 >> v1:172.21.15.7:6789/0 conn(0x7fbf2c15dd00 legacy=0x7fbf2c0b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:05.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.623+0000 7fbf2affd640 1 -- 172.21.15.7:0/3156700857 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2c06cd00 con 0x7fbf2c0b5e60 2024-04-25T10:03:05.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.623+0000 7fbf2a7fc640 1 -- 172.21.15.7:0/3156700857 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4112782074 0 0) 0x7fbf2c06ca30 con 0x7fbf2c15dd00 2024-04-25T10:03:05.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.623+0000 7fbf2affd640 1 --2- 172.21.15.7:0/3156700857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf2c0b5e60 0x7fbf2c06bfb0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fbf20009870 tx=0x7fbf2002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7255da5cfbc7129 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:05.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.623+0000 7fbf2a7fc640 1 -- 172.21.15.7:0/3156700857 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf20037070 con 0x7fbf2c0b5e60 2024-04-25T10:03:05.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.623+0000 7fbf2a7fc640 1 -- 172.21.15.7:0/3156700857 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2002ae50 con 0x7fbf2c0b5e60 2024-04-25T10:03:05.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.623+0000 7fbf2a7fc640 1 -- 172.21.15.7:0/3156700857 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf20032860 con 0x7fbf2c0b5e60 2024-04-25T10:03:05.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.624+0000 7fbf31e9e640 1 -- 172.21.15.7:0/3156700857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf2c0b5e60 msgr2=0x7fbf2c06bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:05.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.624+0000 7fbf31e9e640 1 --2- 172.21.15.7:0/3156700857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf2c0b5e60 0x7fbf2c06bfb0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fbf20009870 tx=0x7fbf2002a300 comp rx=0 tx=0).stop 2024-04-25T10:03:05.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.624+0000 7fbf31e9e640 1 -- 172.21.15.7:0/3156700857 shutdown_connections 2024-04-25T10:03:05.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.624+0000 7fbf31e9e640 1 --2- 172.21.15.7:0/3156700857 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf2c0b6a40 0x7fbf2c06c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:05.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.624+0000 7fbf31e9e640 1 --2- 172.21.15.7:0/3156700857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf2c0b5e60 0x7fbf2c06bfb0 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:05.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.624+0000 7fbf31e9e640 1 -- 172.21.15.7:0/3156700857 >> 172.21.15.7:0/3156700857 conn(0x7fbf2c0d07b0 msgr2=0x7fbf2c0d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:05.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.624+0000 7fbf31e9e640 1 -- 172.21.15.7:0/3156700857 shutdown_connections 2024-04-25T10:03:05.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.624+0000 7fbf31e9e640 1 -- 172.21.15.7:0/3156700857 wait complete. 2024-04-25T10:03:05.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.625+0000 7fbf31e9e640 1 Processor -- start 2024-04-25T10:03:05.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.625+0000 7fbf31e9e640 1 -- start start 2024-04-25T10:03:05.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.626+0000 7fbf31e9e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf2c0b5e60 0x7fbf2c15e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:05.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.626+0000 7fbf31e9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf2c0b6a40 0x7fbf2c152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:05.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.626+0000 7fbf31e9e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf2c15dd00 0x7fbf2c152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:05.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.626+0000 7fbf31e9e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c0d2260 con 0x7fbf2c15dd00 2024-04-25T10:03:05.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.626+0000 7fbf31e9e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c0d1f80 con 0x7fbf2c0b6a40 2024-04-25T10:03:05.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.626+0000 7fbf31e9e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c0d2780 con 0x7fbf2c0b5e60 2024-04-25T10:03:05.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.626+0000 7fbf2bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf2c15dd00 0x7fbf2c152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:05.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.626+0000 7fbf2bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf2c15dd00 0x7fbf2c152a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50588/0 (socket says 172.21.15.7:50588) 2024-04-25T10:03:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.626+0000 7fbf2bfff640 1 -- 172.21.15.7:0/129015311 learned_addr learned my addr 172.21.15.7:0/129015311 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.626+0000 7fbf2b7fe640 1 --2- 172.21.15.7:0/129015311 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf2c0b5e60 0x7fbf2c15e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.626+0000 7fbf2affd640 1 --2- 172.21.15.7:0/129015311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf2c0b6a40 0x7fbf2c152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.627+0000 7fbf2bfff640 1 -- 172.21.15.7:0/129015311 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf2c0b5e60 msgr2=0x7fbf2c15e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.627+0000 7fbf2bfff640 1 --2- 172.21.15.7:0/129015311 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf2c0b5e60 0x7fbf2c15e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.627+0000 7fbf2bfff640 1 -- 172.21.15.7:0/129015311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf2c0b6a40 msgr2=0x7fbf2c152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.627+0000 7fbf2bfff640 1 --2- 172.21.15.7:0/129015311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf2c0b6a40 0x7fbf2c152530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.627+0000 7fbf2bfff640 1 -- 172.21.15.7:0/129015311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2c153280 con 0x7fbf2c15dd00 2024-04-25T10:03:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.627+0000 7fbf2bfff640 1 --2- 172.21.15.7:0/129015311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf2c15dd00 0x7fbf2c152a70 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fbf24007e40 tx=0x7fbf2400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.627+0000 7fbf13fff640 1 -- 172.21.15.7:0/129015311 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf24014620 con 0x7fbf2c15dd00 2024-04-25T10:03:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.627+0000 7fbf13fff640 1 -- 172.21.15.7:0/129015311 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf24019070 con 0x7fbf2c15dd00 2024-04-25T10:03:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.627+0000 7fbf31e9e640 1 -- 172.21.15.7:0/129015311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf2c152fb0 con 0x7fbf2c15dd00 2024-04-25T10:03:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.627+0000 7fbf13fff640 1 -- 172.21.15.7:0/129015311 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf24014a20 con 0x7fbf2c15dd00 2024-04-25T10:03:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.627+0000 7fbf31e9e640 1 -- 172.21.15.7:0/129015311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf2c1550d0 con 0x7fbf2c15dd00 2024-04-25T10:03:05.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.628+0000 7fbf31e9e640 1 -- 172.21.15.7:0/129015311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf2c068fd0 con 0x7fbf2c15dd00 2024-04-25T10:03:05.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.629+0000 7fbf13fff640 1 -- 172.21.15.7:0/129015311 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbf24014bc0 con 0x7fbf2c15dd00 2024-04-25T10:03:05.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.629+0000 7fbf13fff640 1 --2- 172.21.15.7:0/129015311 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbf1806b4d0 0x7fbf1806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:05.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.629+0000 7fbf13fff640 1 -- 172.21.15.7:0/129015311 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbf2408ab10 con 0x7fbf2c15dd00 2024-04-25T10:03:05.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.629+0000 7fbf2b7fe640 1 --2- 172.21.15.7:0/129015311 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbf1806b4d0 0x7fbf1806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:05.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.630+0000 7fbf2b7fe640 1 --2- 172.21.15.7:0/129015311 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbf1806b4d0 0x7fbf1806d990 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c007fd0 tx=0x7fbf1c007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:05.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.633+0000 7fbf13fff640 1 -- 172.21.15.7:0/129015311 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbf240591b0 con 0x7fbf2c15dd00 2024-04-25T10:03:05.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.815+0000 7fbf31e9e640 1 -- 172.21.15.7:0/129015311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf2c0d1620 con 0x7fbf2c15dd00 2024-04-25T10:03:05.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.816+0000 7fbf13fff640 1 -- 172.21.15.7:0/129015311 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+16788 (secure 0 0 0) 0x7fbf2405d250 con 0x7fbf2c15dd00 2024-04-25T10:03:05.821 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:03:05.821 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":103,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:02:51.586260+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:02:48.213751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T10:02:48.916114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:03:05.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.818+0000 7fbf31e9e640 1 -- 172.21.15.7:0/129015311 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbf1806b4d0 msgr2=0x7fbf1806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:05.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.818+0000 7fbf31e9e640 1 --2- 172.21.15.7:0/129015311 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbf1806b4d0 0x7fbf1806d990 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c007fd0 tx=0x7fbf1c007de0 comp rx=0 tx=0).stop 2024-04-25T10:03:05.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.818+0000 7fbf31e9e640 1 -- 172.21.15.7:0/129015311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf2c15dd00 msgr2=0x7fbf2c152a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:05.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.818+0000 7fbf31e9e640 1 --2- 172.21.15.7:0/129015311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf2c15dd00 0x7fbf2c152a70 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fbf24007e40 tx=0x7fbf2400e4b0 comp rx=0 tx=0).stop 2024-04-25T10:03:05.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.818+0000 7fbf31e9e640 1 -- 172.21.15.7:0/129015311 shutdown_connections 2024-04-25T10:03:05.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.818+0000 7fbf31e9e640 1 --2- 172.21.15.7:0/129015311 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbf1806b4d0 0x7fbf1806d990 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:05.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.818+0000 7fbf31e9e640 1 --2- 172.21.15.7:0/129015311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf2c15dd00 0x7fbf2c152a70 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:05.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.818+0000 7fbf31e9e640 1 --2- 172.21.15.7:0/129015311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf2c0b6a40 0x7fbf2c152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:05.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.818+0000 7fbf31e9e640 1 --2- 172.21.15.7:0/129015311 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf2c0b5e60 0x7fbf2c15e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:05.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.818+0000 7fbf31e9e640 1 -- 172.21.15.7:0/129015311 >> 172.21.15.7:0/129015311 conn(0x7fbf2c0d07b0 msgr2=0x7fbf2c15b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:05.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.818+0000 7fbf31e9e640 1 -- 172.21.15.7:0/129015311 shutdown_connections 2024-04-25T10:03:05.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.818+0000 7fbf31e9e640 1 -- 172.21.15.7:0/129015311 wait complete. 2024-04-25T10:03:05.834 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:02:48.213751+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:02:48.916114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:03:05.835 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:03:05.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.933+0000 7efe8767d640 1 Processor -- start 2024-04-25T10:03:05.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.934+0000 7efe8767d640 1 -- start start 2024-04-25T10:03:05.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.934+0000 7efe8767d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efe800b1480 0x7efe800b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:05.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.934+0000 7efe8767d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efe800cc580 0x7efe800cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:05.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.934+0000 7efe8767d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe800b25e0 con 0x7efe800cfc40 2024-04-25T10:03:05.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.934+0000 7efe8767d640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe8015bec0 con 0x7efe800cc580 2024-04-25T10:03:05.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.934+0000 7efe8767d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe800b19d0 con 0x7efe800b1480 2024-04-25T10:03:05.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.935+0000 7efe85c1a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efe800cc580 0x7efe800cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:05.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.935+0000 7efe85c1a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efe800cc580 0x7efe800cc9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50590/0 (socket says 172.21.15.7:50590) 2024-04-25T10:03:05.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.935+0000 7efe85c1a640 1 -- 172.21.15.7:0/995789786 learned_addr learned my addr 172.21.15.7:0/995789786 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:05.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.935+0000 7efe84c18640 1 --2- 172.21.15.7:0/995789786 >> v2:172.21.15.55:3300/0 conn(0x7efe800b1480 0x7efe800b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:05.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.935+0000 7efe85c1a640 1 -- 172.21.15.7:0/995789786 >> v2:172.21.15.55:3300/0 conn(0x7efe800b1480 msgr2=0x7efe800b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:05.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.935+0000 7efe85c1a640 1 --2- 172.21.15.7:0/995789786 >> v2:172.21.15.55:3300/0 conn(0x7efe800b1480 0x7efe800b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:05.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.935+0000 7efe85c1a640 1 -- 172.21.15.7:0/995789786 >> v1:172.21.15.55:6789/0 conn(0x7efe800cfc40 legacy=0x7efe800d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:05.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.935+0000 7efe85c1a640 1 -- 172.21.15.7:0/995789786 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe800b1cb0 con 0x7efe800cc580 2024-04-25T10:03:05.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.935+0000 7efe85c1a640 1 --2- 172.21.15.7:0/995789786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe800cc580 0x7efe800cc9f0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7efe80067390 tx=0x7efe7802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1ec8034b42dda server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:05.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.936+0000 7efe77fff640 1 -- 172.21.15.7:0/995789786 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe78036070 con 0x7efe800cc580 2024-04-25T10:03:05.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.936+0000 7efe77fff640 1 -- 172.21.15.7:0/995789786 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe78031600 con 0x7efe800cc580 2024-04-25T10:03:05.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.936+0000 7efe77fff640 1 -- 172.21.15.7:0/995789786 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe780319d0 con 0x7efe800cc580 2024-04-25T10:03:05.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.936+0000 7efe8767d640 1 -- 172.21.15.7:0/995789786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe800cc580 msgr2=0x7efe800cc9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:05.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.936+0000 7efe8767d640 1 --2- 172.21.15.7:0/995789786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe800cc580 0x7efe800cc9f0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7efe80067390 tx=0x7efe7802a730 comp rx=0 tx=0).stop 2024-04-25T10:03:05.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.936+0000 7efe8767d640 1 -- 172.21.15.7:0/995789786 shutdown_connections 2024-04-25T10:03:05.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.936+0000 7efe8767d640 1 --2- 172.21.15.7:0/995789786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe800cc580 0x7efe800cc9f0 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:05.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.936+0000 7efe8767d640 1 --2- 172.21.15.7:0/995789786 >> v2:172.21.15.55:3300/0 conn(0x7efe800b1480 0x7efe800b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:05.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.936+0000 7efe8767d640 1 -- 172.21.15.7:0/995789786 >> 172.21.15.7:0/995789786 conn(0x7efe8008af80 msgr2=0x7efe8008b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:05.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.936+0000 7efe8767d640 1 -- 172.21.15.7:0/995789786 shutdown_connections 2024-04-25T10:03:05.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.936+0000 7efe8767d640 1 -- 172.21.15.7:0/995789786 wait complete. 2024-04-25T10:03:05.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.937+0000 7efe8767d640 1 Processor -- start 2024-04-25T10:03:05.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.938+0000 7efe8767d640 1 -- start start 2024-04-25T10:03:05.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.938+0000 7efe8767d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efe800b1480 0x7efe8006d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:05.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.938+0000 7efe8767d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe800cc580 0x7efe800c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:05.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.938+0000 7efe8767d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe800cfc40 0x7efe801f7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:05.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.938+0000 7efe8767d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe800b1010 con 0x7efe800cfc40 2024-04-25T10:03:05.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.938+0000 7efe8767d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe800b2270 con 0x7efe800cc580 2024-04-25T10:03:05.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.938+0000 7efe8767d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe800ccf30 con 0x7efe800b1480 2024-04-25T10:03:05.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.938+0000 7efe85c1a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe800cfc40 0x7efe801f7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:05.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.938+0000 7efe85c1a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe800cfc40 0x7efe801f7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50596/0 (socket says 172.21.15.7:50596) 2024-04-25T10:03:05.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.938+0000 7efe85c1a640 1 -- 172.21.15.7:0/2719109442 learned_addr learned my addr 172.21.15.7:0/2719109442 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:05.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.938+0000 7efe84c18640 1 --2- 172.21.15.7:0/2719109442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe800cc580 0x7efe800c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:05.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.938+0000 7efe85419640 1 --2- 172.21.15.7:0/2719109442 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efe800b1480 0x7efe8006d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:05.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.939+0000 7efe85c1a640 1 -- 172.21.15.7:0/2719109442 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efe800b1480 msgr2=0x7efe8006d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:05.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.939+0000 7efe85c1a640 1 --2- 172.21.15.7:0/2719109442 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efe800b1480 0x7efe8006d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:05.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.939+0000 7efe85c1a640 1 -- 172.21.15.7:0/2719109442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe800cc580 msgr2=0x7efe800c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:05.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.939+0000 7efe85c1a640 1 --2- 172.21.15.7:0/2719109442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe800cc580 0x7efe800c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:05.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.939+0000 7efe85c1a640 1 -- 172.21.15.7:0/2719109442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe801f4430 con 0x7efe800cfc40 2024-04-25T10:03:05.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.939+0000 7efe84c18640 1 --2- 172.21.15.7:0/2719109442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe800cc580 0x7efe800c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:05.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.939+0000 7efe85c1a640 1 --2- 172.21.15.7:0/2719109442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe800cfc40 0x7efe801f7920 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7efe78009f40 tx=0x7efe78004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:05.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.939+0000 7efe75ffb640 1 -- 172.21.15.7:0/2719109442 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7803f020 con 0x7efe800cfc40 2024-04-25T10:03:05.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.939+0000 7efe75ffb640 1 -- 172.21.15.7:0/2719109442 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe78037040 con 0x7efe800cfc40 2024-04-25T10:03:05.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.939+0000 7efe75ffb640 1 -- 172.21.15.7:0/2719109442 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe78036070 con 0x7efe800cfc40 2024-04-25T10:03:05.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.939+0000 7efe8767d640 1 -- 172.21.15.7:0/2719109442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe801f4710 con 0x7efe800cfc40 2024-04-25T10:03:05.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.939+0000 7efe8767d640 1 -- 172.21.15.7:0/2719109442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe801f7400 con 0x7efe800cfc40 2024-04-25T10:03:05.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.940+0000 7efe8767d640 1 -- 172.21.15.7:0/2719109442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe801f7600 con 0x7efe800cfc40 2024-04-25T10:03:05.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.941+0000 7efe75ffb640 1 -- 172.21.15.7:0/2719109442 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efe78042020 con 0x7efe800cfc40 2024-04-25T10:03:05.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.941+0000 7efe75ffb640 1 --2- 172.21.15.7:0/2719109442 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efe6406b4d0 0x7efe6406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:05.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.941+0000 7efe75ffb640 1 -- 172.21.15.7:0/2719109442 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7efe780aa9d0 con 0x7efe800cfc40 2024-04-25T10:03:05.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.941+0000 7efe85419640 1 --2- 172.21.15.7:0/2719109442 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efe6406b4d0 0x7efe6406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:05.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.942+0000 7efe85419640 1 --2- 172.21.15.7:0/2719109442 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efe6406b4d0 0x7efe6406d990 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7efe7c0016e0 tx=0x7efe7c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:05.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:05.946+0000 7efe75ffb640 1 -- 172.21.15.7:0/2719109442 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efe801f7600 con 0x7efe800cfc40 2024-04-25T10:03:06.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.125+0000 7efe8767d640 1 -- 172.21.15.7:0/2719109442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efe80068f60 con 0x7efe800cfc40 2024-04-25T10:03:06.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.125+0000 7efe75ffb640 1 -- 172.21.15.7:0/2719109442 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) v1 ==== 93+0+10 (secure 0 0 0) 0x7efe78049020 con 0x7efe800cfc40 2024-04-25T10:03:06.130 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T10:03:06.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.127+0000 7efe8767d640 1 -- 172.21.15.7:0/2719109442 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efe6406b4d0 msgr2=0x7efe6406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:06.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.127+0000 7efe8767d640 1 --2- 172.21.15.7:0/2719109442 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efe6406b4d0 0x7efe6406d990 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7efe7c0016e0 tx=0x7efe7c009040 comp rx=0 tx=0).stop 2024-04-25T10:03:06.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.127+0000 7efe8767d640 1 -- 172.21.15.7:0/2719109442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe800cfc40 msgr2=0x7efe801f7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:06.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.127+0000 7efe8767d640 1 --2- 172.21.15.7:0/2719109442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe800cfc40 0x7efe801f7920 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7efe78009f40 tx=0x7efe78004a40 comp rx=0 tx=0).stop 2024-04-25T10:03:06.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.127+0000 7efe8767d640 1 -- 172.21.15.7:0/2719109442 shutdown_connections 2024-04-25T10:03:06.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.127+0000 7efe8767d640 1 --2- 172.21.15.7:0/2719109442 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7efe6406b4d0 0x7efe6406d990 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:06.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.127+0000 7efe8767d640 1 --2- 172.21.15.7:0/2719109442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe800cfc40 0x7efe801f7920 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:06.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.127+0000 7efe8767d640 1 --2- 172.21.15.7:0/2719109442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe800cc580 0x7efe800c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:06.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.127+0000 7efe8767d640 1 --2- 172.21.15.7:0/2719109442 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efe800b1480 0x7efe8006d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:06.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.127+0000 7efe8767d640 1 -- 172.21.15.7:0/2719109442 >> 172.21.15.7:0/2719109442 conn(0x7efe8008af80 msgr2=0x7efe800b0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:06.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.127+0000 7efe8767d640 1 -- 172.21.15.7:0/2719109442 shutdown_connections 2024-04-25T10:03:06.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.127+0000 7efe8767d640 1 -- 172.21.15.7:0/2719109442 wait complete. 2024-04-25T10:03:06.143 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:03:06.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.241+0000 7fced41b7640 1 Processor -- start 2024-04-25T10:03:06.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.241+0000 7fced41b7640 1 -- start start 2024-04-25T10:03:06.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.242+0000 7fced41b7640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcecc161200 0x7fcecc0cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:06.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.242+0000 7fced41b7640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcecc09a9a0 0x7fcecc0cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:06.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.242+0000 7fced41b7640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcecc1615e0 con 0x7fcecc0d0a00 2024-04-25T10:03:06.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.242+0000 7fced41b7640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcecc09ae30 con 0x7fcecc09a9a0 2024-04-25T10:03:06.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.242+0000 7fced41b7640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc06c9f0 con 0x7fcecc161200 2024-04-25T10:03:06.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.242+0000 7fced2754640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcecc09a9a0 0x7fcecc0cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:06.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.242+0000 7fced1752640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fcecc0d0a00 0x7fcecc09a290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35480/0 (socket says 172.21.15.7:35480) 2024-04-25T10:03:06.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.242+0000 7fced1752640 1 -- 172.21.15.7:0/3104363081 learned_addr learned my addr 172.21.15.7:0/3104363081 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:03:06.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.242+0000 7fced1f53640 1 --2- 172.21.15.7:0/3104363081 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcecc161200 0x7fcecc0cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:06.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.242+0000 7fced0f51640 1 -- 172.21.15.7:0/3104363081 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902299038 0 0) 0x7fcebc001110 con 0x7fcecc0d0a00 2024-04-25T10:03:06.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.242+0000 7fced0f51640 1 -- 172.21.15.7:0/3104363081 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fceb8003520 con 0x7fcecc0d0a00 2024-04-25T10:03:06.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.242+0000 7fced2754640 1 -- 172.21.15.7:0/3104363081 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcecc161200 msgr2=0x7fcecc0cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:06.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.242+0000 7fced2754640 1 --2- 172.21.15.7:0/3104363081 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcecc161200 0x7fcecc0cbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:06.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.242+0000 7fced2754640 1 -- 172.21.15.7:0/3104363081 >> v1:172.21.15.7:6789/0 conn(0x7fcecc0d0a00 legacy=0x7fcecc09a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:06.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.242+0000 7fced2754640 1 -- 172.21.15.7:0/3104363081 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc06ccd0 con 0x7fcecc09a9a0 2024-04-25T10:03:06.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.242+0000 7fced1f53640 1 --2- 172.21.15.7:0/3104363081 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcecc161200 0x7fcecc0cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:06.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.243+0000 7fced2754640 1 --2- 172.21.15.7:0/3104363081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcecc09a9a0 0x7fcecc0cf840 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fcec4009d90 tx=0x7fcec402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96e6031e5217e8a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:06.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.243+0000 7fced0f51640 1 -- 172.21.15.7:0/3104363081 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec4007740 con 0x7fcecc09a9a0 2024-04-25T10:03:06.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.243+0000 7fced0f51640 1 -- 172.21.15.7:0/3104363081 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec40078e0 con 0x7fcecc09a9a0 2024-04-25T10:03:06.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.243+0000 7fced0f51640 1 -- 172.21.15.7:0/3104363081 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec4007cb0 con 0x7fcecc09a9a0 2024-04-25T10:03:06.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.244+0000 7fced41b7640 1 -- 172.21.15.7:0/3104363081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcecc09a9a0 msgr2=0x7fcecc0cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:06.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.244+0000 7fced41b7640 1 --2- 172.21.15.7:0/3104363081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcecc09a9a0 0x7fcecc0cf840 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fcec4009d90 tx=0x7fcec402a660 comp rx=0 tx=0).stop 2024-04-25T10:03:06.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.244+0000 7fced41b7640 1 -- 172.21.15.7:0/3104363081 shutdown_connections 2024-04-25T10:03:06.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.244+0000 7fced41b7640 1 --2- 172.21.15.7:0/3104363081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcecc09a9a0 0x7fcecc0cf840 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:06.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.244+0000 7fced41b7640 1 --2- 172.21.15.7:0/3104363081 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcecc161200 0x7fcecc0cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:06.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.244+0000 7fced41b7640 1 -- 172.21.15.7:0/3104363081 >> 172.21.15.7:0/3104363081 conn(0x7fcecc0b31a0 msgr2=0x7fcecc0b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:06.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.244+0000 7fced41b7640 1 -- 172.21.15.7:0/3104363081 shutdown_connections 2024-04-25T10:03:06.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.244+0000 7fced41b7640 1 -- 172.21.15.7:0/3104363081 wait complete. 2024-04-25T10:03:06.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.245+0000 7fced41b7640 1 Processor -- start 2024-04-25T10:03:06.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.245+0000 7fced41b7640 1 -- start start 2024-04-25T10:03:06.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.246+0000 7fced41b7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcecc09a9a0 0x7fcecc0b5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:06.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.246+0000 7fced41b7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcecc0d0a00 0x7fcecc1f39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:06.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.246+0000 7fced41b7640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcecc161200 0x7fcecc14f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:06.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.246+0000 7fced41b7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc0cc240 con 0x7fcecc0d0a00 2024-04-25T10:03:06.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.246+0000 7fced41b7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc099d70 con 0x7fcecc09a9a0 2024-04-25T10:03:06.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.246+0000 7fced41b7640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc06c680 con 0x7fcecc161200 2024-04-25T10:03:06.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.246+0000 7fced1752640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcecc0d0a00 0x7fcecc1f39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:06.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.246+0000 7fced1752640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcecc0d0a00 0x7fcecc1f39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50620/0 (socket says 172.21.15.7:50620) 2024-04-25T10:03:06.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.246+0000 7fced1752640 1 -- 172.21.15.7:0/3711411167 learned_addr learned my addr 172.21.15.7:0/3711411167 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:06.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.246+0000 7fced2754640 1 --2- 172.21.15.7:0/3711411167 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcecc161200 0x7fcecc14f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:06.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.246+0000 7fced1f53640 1 --2- 172.21.15.7:0/3711411167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcecc09a9a0 0x7fcecc0b5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:06.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.246+0000 7fced1752640 1 -- 172.21.15.7:0/3711411167 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcecc161200 msgr2=0x7fcecc14f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:06.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.246+0000 7fced1752640 1 --2- 172.21.15.7:0/3711411167 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcecc161200 0x7fcecc14f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:06.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.246+0000 7fced1752640 1 -- 172.21.15.7:0/3711411167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcecc09a9a0 msgr2=0x7fcecc0b5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:06.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.246+0000 7fced1752640 1 --2- 172.21.15.7:0/3711411167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcecc09a9a0 0x7fcecc0b5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:06.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.246+0000 7fced1752640 1 -- 172.21.15.7:0/3711411167 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc0c65c0 con 0x7fcecc0d0a00 2024-04-25T10:03:06.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.246+0000 7fced1f53640 1 --2- 172.21.15.7:0/3711411167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcecc09a9a0 0x7fcecc0b5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:03:06.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.246+0000 7fced2754640 1 --2- 172.21.15.7:0/3711411167 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcecc161200 0x7fcecc14f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:03:06.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.246+0000 7fced1752640 1 --2- 172.21.15.7:0/3711411167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcecc0d0a00 0x7fcecc1f39f0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00c730 tx=0x7fcebc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:06.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.247+0000 7fcec27fc640 1 -- 172.21.15.7:0/3711411167 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc017070 con 0x7fcecc0d0a00 2024-04-25T10:03:06.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.247+0000 7fcec27fc640 1 -- 172.21.15.7:0/3711411167 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcebc005ad0 con 0x7fcecc0d0a00 2024-04-25T10:03:06.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.247+0000 7fced41b7640 1 -- 172.21.15.7:0/3711411167 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcecc0b7490 con 0x7fcecc0d0a00 2024-04-25T10:03:06.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.247+0000 7fcec27fc640 1 -- 172.21.15.7:0/3711411167 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc007e20 con 0x7fcecc0d0a00 2024-04-25T10:03:06.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.247+0000 7fced41b7640 1 -- 172.21.15.7:0/3711411167 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcecc0c6b60 con 0x7fcecc0d0a00 2024-04-25T10:03:06.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.248+0000 7fced41b7640 1 -- 172.21.15.7:0/3711411167 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcecc068f60 con 0x7fcecc0d0a00 2024-04-25T10:03:06.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.248+0000 7fcec27fc640 1 -- 172.21.15.7:0/3711411167 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcebc01a070 con 0x7fcecc0d0a00 2024-04-25T10:03:06.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.248+0000 7fcec27fc640 1 --2- 172.21.15.7:0/3711411167 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fceb006b4d0 0x7fceb006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:06.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.249+0000 7fcec27fc640 1 -- 172.21.15.7:0/3711411167 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcebc089740 con 0x7fcecc0d0a00 2024-04-25T10:03:06.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.249+0000 7fced1f53640 1 --2- 172.21.15.7:0/3711411167 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fceb006b4d0 0x7fceb006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:06.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.249+0000 7fced1f53640 1 --2- 172.21.15.7:0/3711411167 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fceb006b4d0 0x7fceb006d990 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fcec8006fd0 tx=0x7fcec8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:06.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.253+0000 7fcec27fc640 1 -- 172.21.15.7:0/3711411167 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcecc1615e0 con 0x7fcecc0d0a00 2024-04-25T10:03:06.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.431+0000 7fced41b7640 1 -- 172.21.15.7:0/3711411167 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcecc0b4050 con 0x7fcecc0d0a00 2024-04-25T10:03:06.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.431+0000 7fcec27fc640 1 -- 172.21.15.7:0/3711411167 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v103) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcebc058430 con 0x7fcecc0d0a00 2024-04-25T10:03:06.436 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T10:03:06.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.433+0000 7fced41b7640 1 -- 172.21.15.7:0/3711411167 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fceb006b4d0 msgr2=0x7fceb006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:06.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.433+0000 7fced41b7640 1 --2- 172.21.15.7:0/3711411167 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fceb006b4d0 0x7fceb006d990 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fcec8006fd0 tx=0x7fcec8008040 comp rx=0 tx=0).stop 2024-04-25T10:03:06.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.433+0000 7fced41b7640 1 -- 172.21.15.7:0/3711411167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcecc0d0a00 msgr2=0x7fcecc1f39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:06.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.433+0000 7fced41b7640 1 --2- 172.21.15.7:0/3711411167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcecc0d0a00 0x7fcecc1f39f0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00c730 tx=0x7fcebc00cbf0 comp rx=0 tx=0).stop 2024-04-25T10:03:06.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.434+0000 7fced41b7640 1 -- 172.21.15.7:0/3711411167 shutdown_connections 2024-04-25T10:03:06.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.434+0000 7fced41b7640 1 --2- 172.21.15.7:0/3711411167 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fceb006b4d0 0x7fceb006d990 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:06.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.434+0000 7fced41b7640 1 --2- 172.21.15.7:0/3711411167 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcecc161200 0x7fcecc14f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:06.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.434+0000 7fced41b7640 1 --2- 172.21.15.7:0/3711411167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcecc0d0a00 0x7fcecc1f39f0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:06.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.434+0000 7fced41b7640 1 --2- 172.21.15.7:0/3711411167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcecc09a9a0 0x7fcecc0b5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:06.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.434+0000 7fced41b7640 1 -- 172.21.15.7:0/3711411167 >> 172.21.15.7:0/3711411167 conn(0x7fcecc0b31a0 msgr2=0x7fcecc0ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:06.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.434+0000 7fced41b7640 1 -- 172.21.15.7:0/3711411167 shutdown_connections 2024-04-25T10:03:06.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.434+0000 7fced41b7640 1 -- 172.21.15.7:0/3711411167 wait complete. 2024-04-25T10:03:06.450 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:03:06.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.549+0000 7f7d9bd90640 1 Processor -- start 2024-04-25T10:03:06.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.549+0000 7f7d9bd90640 1 -- start start 2024-04-25T10:03:06.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.549+0000 7f7d9bd90640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d940cda20 0x7f7d940cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:06.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.550+0000 7f7d9bd90640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7d9409a100 0x7f7d9415d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:06.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.550+0000 7f7d9bd90640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d940d02f0 con 0x7f7d9406bf10 2024-04-25T10:03:06.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.550+0000 7f7d9bd90640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d940cde00 con 0x7f7d9409a100 2024-04-25T10:03:06.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.550+0000 7f7d9bd90640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d940d05d0 con 0x7f7d940cda20 2024-04-25T10:03:06.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.550+0000 7f7d9932b640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7d9406bf10 0x7f7d940999f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35496/0 (socket says 172.21.15.7:35496) 2024-04-25T10:03:06.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.550+0000 7f7d9932b640 1 -- 172.21.15.7:0/2149350732 learned_addr learned my addr 172.21.15.7:0/2149350732 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:03:06.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.550+0000 7f7d98b2a640 1 -- 172.21.15.7:0/2149350732 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1199849127 0 0) 0x7f7d940d02f0 con 0x7f7d9406bf10 2024-04-25T10:03:06.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.550+0000 7f7d99b2c640 1 --2- 172.21.15.7:0/2149350732 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d940cda20 0x7f7d940cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:06.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.550+0000 7f7d98b2a640 1 -- 172.21.15.7:0/2149350732 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d80003520 con 0x7f7d9406bf10 2024-04-25T10:03:06.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.550+0000 7f7d9a32d640 1 --2- 172.21.15.7:0/2149350732 >> v2:172.21.15.55:3300/0 conn(0x7f7d9409a100 0x7f7d9415d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:06.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.550+0000 7f7d98b2a640 1 -- 172.21.15.7:0/2149350732 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2149921219 0 0) 0x7f7d80003520 con 0x7f7d9406bf10 2024-04-25T10:03:06.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.550+0000 7f7d98b2a640 1 -- 172.21.15.7:0/2149350732 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d940cda20 msgr2=0x7f7d940cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:06.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.550+0000 7f7d98b2a640 1 --2- 172.21.15.7:0/2149350732 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d940cda20 0x7f7d940cf9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:06.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.550+0000 7f7d98b2a640 1 -- 172.21.15.7:0/2149350732 >> v2:172.21.15.55:3300/0 conn(0x7f7d9409a100 msgr2=0x7f7d9415d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:06.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.550+0000 7f7d98b2a640 1 --2- 172.21.15.7:0/2149350732 >> v2:172.21.15.55:3300/0 conn(0x7f7d9409a100 0x7f7d9415d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:06.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.550+0000 7f7d98b2a640 1 -- 172.21.15.7:0/2149350732 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d940d08b0 con 0x7f7d9406bf10 2024-04-25T10:03:06.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.550+0000 7f7d98b2a640 1 -- 172.21.15.7:0/2149350732 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f7d84001670 con 0x7f7d9406bf10 2024-04-25T10:03:06.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.550+0000 7f7d98b2a640 1 -- 172.21.15.7:0/2149350732 >> v1:172.21.15.7:6789/0 conn(0x7f7d9406bf10 legacy=0x7f7d940999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:06.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.550+0000 7f7d98b2a640 1 --2- 172.21.15.7:0/2149350732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d800039b0 0x7f7d80003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:06.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.550+0000 7f7d98b2a640 1 --2- 172.21.15.7:0/2149350732 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d940cda20 0x7f7d80004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:06.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.550+0000 7f7d98b2a640 1 --2- 172.21.15.7:0/2149350732 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d80004d40 0x7f7d800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:06.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.550+0000 7f7d98b2a640 1 -- 172.21.15.7:0/2149350732 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d940cde00 con 0x7f7d800039b0 2024-04-25T10:03:06.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.550+0000 7f7d98b2a640 1 -- 172.21.15.7:0/2149350732 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d940d05d0 con 0x7f7d80004d40 2024-04-25T10:03:06.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.550+0000 7f7d98b2a640 1 -- 172.21.15.7:0/2149350732 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8000b9c0 con 0x7f7d940cda20 2024-04-25T10:03:06.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.550+0000 7f7d99b2c640 1 --2- 172.21.15.7:0/2149350732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d800039b0 0x7f7d80003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:06.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.551+0000 7f7d9a32d640 1 --2- 172.21.15.7:0/2149350732 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d80004d40 0x7f7d800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:06.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.551+0000 7f7d9932b640 1 --2- 172.21.15.7:0/2149350732 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d940cda20 0x7f7d80004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:06.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.551+0000 7f7d99b2c640 1 -- 172.21.15.7:0/2149350732 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d940cda20 msgr2=0x7f7d80004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:06.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.551+0000 7f7d99b2c640 1 --2- 172.21.15.7:0/2149350732 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d940cda20 0x7f7d80004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:06.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.551+0000 7f7d99b2c640 1 -- 172.21.15.7:0/2149350732 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d80004d40 msgr2=0x7f7d800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:06.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.551+0000 7f7d99b2c640 1 --2- 172.21.15.7:0/2149350732 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d80004d40 0x7f7d800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:06.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.551+0000 7f7d99b2c640 1 -- 172.21.15.7:0/2149350732 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d80003520 con 0x7f7d800039b0 2024-04-25T10:03:06.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.551+0000 7f7d9932b640 1 --2- 172.21.15.7:0/2149350732 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d940cda20 0x7f7d80004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:06.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.551+0000 7f7d9a32d640 1 --2- 172.21.15.7:0/2149350732 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d80004d40 0x7f7d800051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:06.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.551+0000 7f7d99b2c640 1 --2- 172.21.15.7:0/2149350732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d800039b0 0x7f7d80003dd0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009ac0 tx=0x7f7d80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c77a01c9184953e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:06.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.552+0000 7f7d98b2a640 1 -- 172.21.15.7:0/2149350732 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d90036070 con 0x7f7d800039b0 2024-04-25T10:03:06.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.552+0000 7f7d98b2a640 1 -- 172.21.15.7:0/2149350732 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d90031400 con 0x7f7d800039b0 2024-04-25T10:03:06.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.552+0000 7f7d98b2a640 1 -- 172.21.15.7:0/2149350732 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d90009690 con 0x7f7d800039b0 2024-04-25T10:03:06.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.552+0000 7f7d9bd90640 1 -- 172.21.15.7:0/2149350732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d800039b0 msgr2=0x7f7d80003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:06.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.552+0000 7f7d9bd90640 1 --2- 172.21.15.7:0/2149350732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d800039b0 0x7f7d80003dd0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009ac0 tx=0x7f7d80005830 comp rx=0 tx=0).stop 2024-04-25T10:03:06.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.552+0000 7f7d9a32d640 1 -- 172.21.15.7:0/2149350732 reap_dead start 2024-04-25T10:03:06.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.552+0000 7f7d9bd90640 1 -- 172.21.15.7:0/2149350732 shutdown_connections 2024-04-25T10:03:06.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.552+0000 7f7d9bd90640 1 -- 172.21.15.7:0/2149350732 >> 172.21.15.7:0/2149350732 conn(0x7f7d940b3110 msgr2=0x7f7d940b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:06.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.552+0000 7f7d9bd90640 1 -- 172.21.15.7:0/2149350732 shutdown_connections 2024-04-25T10:03:06.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.552+0000 7f7d9bd90640 1 -- 172.21.15.7:0/2149350732 wait complete. 2024-04-25T10:03:06.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.553+0000 7f7d9bd90640 1 Processor -- start 2024-04-25T10:03:06.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.554+0000 7f7d9bd90640 1 -- start start 2024-04-25T10:03:06.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.554+0000 7f7d9bd90640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d9415ff50 0x7f7d941f3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:06.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.554+0000 7f7d9bd90640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d940b6150 0x7f7d940b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:06.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.554+0000 7f7d9bd90640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d941f6a30 0x7f7d941f6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:06.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.554+0000 7f7d9bd90640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d940cf9d0 con 0x7f7d9415ff50 2024-04-25T10:03:06.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.554+0000 7f7d9bd90640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d940d0e70 con 0x7f7d940b6150 2024-04-25T10:03:06.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.554+0000 7f7d9bd90640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d940cfb50 con 0x7f7d941f6a30 2024-04-25T10:03:06.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.554+0000 7f7d99b2c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d9415ff50 0x7f7d941f3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:06.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.554+0000 7f7d99b2c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d9415ff50 0x7f7d941f3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50636/0 (socket says 172.21.15.7:50636) 2024-04-25T10:03:06.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.554+0000 7f7d99b2c640 1 -- 172.21.15.7:0/1781033991 learned_addr learned my addr 172.21.15.7:0/1781033991 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:06.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.554+0000 7f7d9a32d640 1 --2- 172.21.15.7:0/1781033991 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d941f6a30 0x7f7d941f6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:06.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.555+0000 7f7d9932b640 1 --2- 172.21.15.7:0/1781033991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d940b6150 0x7f7d940b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:06.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.555+0000 7f7d99b2c640 1 -- 172.21.15.7:0/1781033991 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d941f6a30 msgr2=0x7f7d941f6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:06.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.555+0000 7f7d99b2c640 1 --2- 172.21.15.7:0/1781033991 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d941f6a30 0x7f7d941f6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:06.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.555+0000 7f7d99b2c640 1 -- 172.21.15.7:0/1781033991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d940b6150 msgr2=0x7f7d940b65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:06.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.555+0000 7f7d99b2c640 1 --2- 172.21.15.7:0/1781033991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d940b6150 0x7f7d940b65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:06.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.555+0000 7f7d99b2c640 1 -- 172.21.15.7:0/1781033991 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d941f4400 con 0x7f7d9415ff50 2024-04-25T10:03:06.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.555+0000 7f7d99b2c640 1 --2- 172.21.15.7:0/1781033991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d9415ff50 0x7f7d941f3ec0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f7d90034040 tx=0x7f7d90004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:06.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.555+0000 7f7d8a7fc640 1 -- 172.21.15.7:0/1781033991 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d90036050 con 0x7f7d9415ff50 2024-04-25T10:03:06.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.555+0000 7f7d8a7fc640 1 -- 172.21.15.7:0/1781033991 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d90042070 con 0x7f7d9415ff50 2024-04-25T10:03:06.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.555+0000 7f7d9bd90640 1 -- 172.21.15.7:0/1781033991 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d940b45e0 con 0x7f7d9415ff50 2024-04-25T10:03:06.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.555+0000 7f7d8a7fc640 1 -- 172.21.15.7:0/1781033991 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d90003c60 con 0x7f7d9415ff50 2024-04-25T10:03:06.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.555+0000 7f7d9bd90640 1 -- 172.21.15.7:0/1781033991 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d940b4ba0 con 0x7f7d9415ff50 2024-04-25T10:03:06.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.556+0000 7f7d9bd90640 1 -- 172.21.15.7:0/1781033991 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d94068f60 con 0x7f7d9415ff50 2024-04-25T10:03:06.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.556+0000 7f7d8a7fc640 1 -- 172.21.15.7:0/1781033991 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7d9003d450 con 0x7f7d9415ff50 2024-04-25T10:03:06.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.557+0000 7f7d8a7fc640 1 --2- 172.21.15.7:0/1781033991 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7d7806b4d0 0x7f7d7806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:06.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.557+0000 7f7d8a7fc640 1 -- 172.21.15.7:0/1781033991 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7d900aa610 con 0x7f7d9415ff50 2024-04-25T10:03:06.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.557+0000 7f7d9932b640 1 --2- 172.21.15.7:0/1781033991 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7d7806b4d0 0x7f7d7806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:06.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.557+0000 7f7d9932b640 1 --2- 172.21.15.7:0/1781033991 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7d7806b4d0 0x7f7d7806d990 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f7d84001030 tx=0x7f7d84009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:06.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.561+0000 7f7d8a7fc640 1 -- 172.21.15.7:0/1781033991 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7d9004b020 con 0x7f7d9415ff50 2024-04-25T10:03:06.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.742+0000 7f7d9bd90640 1 -- 172.21.15.7:0/1781033991 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7d940cb950 con 0x7f7d9415ff50 2024-04-25T10:03:06.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.743+0000 7f7d8a7fc640 1 -- 172.21.15.7:0/1781033991 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v103) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7d941f4400 con 0x7f7d9415ff50 2024-04-25T10:03:06.748 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T10:03:06.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.745+0000 7f7d9bd90640 1 -- 172.21.15.7:0/1781033991 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7d7806b4d0 msgr2=0x7f7d7806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:06.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.745+0000 7f7d9bd90640 1 --2- 172.21.15.7:0/1781033991 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7d7806b4d0 0x7f7d7806d990 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f7d84001030 tx=0x7f7d84009040 comp rx=0 tx=0).stop 2024-04-25T10:03:06.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.745+0000 7f7d9bd90640 1 -- 172.21.15.7:0/1781033991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d9415ff50 msgr2=0x7f7d941f3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:06.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.745+0000 7f7d9bd90640 1 --2- 172.21.15.7:0/1781033991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d9415ff50 0x7f7d941f3ec0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f7d90034040 tx=0x7f7d90004730 comp rx=0 tx=0).stop 2024-04-25T10:03:06.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.745+0000 7f7d9bd90640 1 -- 172.21.15.7:0/1781033991 shutdown_connections 2024-04-25T10:03:06.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.745+0000 7f7d9bd90640 1 --2- 172.21.15.7:0/1781033991 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7d7806b4d0 0x7f7d7806d990 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:06.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.745+0000 7f7d9bd90640 1 --2- 172.21.15.7:0/1781033991 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7d941f6a30 0x7f7d941f6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:06.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.745+0000 7f7d9bd90640 1 --2- 172.21.15.7:0/1781033991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d940b6150 0x7f7d940b65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:06.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.745+0000 7f7d9bd90640 1 --2- 172.21.15.7:0/1781033991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d9415ff50 0x7f7d941f3ec0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:06.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.745+0000 7f7d9bd90640 1 -- 172.21.15.7:0/1781033991 >> 172.21.15.7:0/1781033991 conn(0x7f7d940b3110 msgr2=0x7f7d940701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:06.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.745+0000 7f7d9bd90640 1 -- 172.21.15.7:0/1781033991 shutdown_connections 2024-04-25T10:03:06.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.745+0000 7f7d9bd90640 1 -- 172.21.15.7:0/1781033991 wait complete. 2024-04-25T10:03:06.760 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:03:06.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.857+0000 7fae6109e640 1 Processor -- start 2024-04-25T10:03:06.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.857+0000 7fae6109e640 1 -- start start 2024-04-25T10:03:06.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.858+0000 7fae6109e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fae5c0d0aa0 0x7fae5c161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:06.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.858+0000 7fae6109e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fae5c1622b0 0x7fae5c0ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:06.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.858+0000 7fae6109e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae5c15e8a0 con 0x7fae5c15da60 2024-04-25T10:03:06.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.858+0000 7fae6109e640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae5c15eb80 con 0x7fae5c1622b0 2024-04-25T10:03:06.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.858+0000 7fae6109e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae5c15ee60 con 0x7fae5c0d0aa0 2024-04-25T10:03:06.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.858+0000 7fae5b59e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fae5c1622b0 0x7fae5c0ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:06.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.858+0000 7fae5b59e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fae5c1622b0 0x7fae5c0ce520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50648/0 (socket says 172.21.15.7:50648) 2024-04-25T10:03:06.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.858+0000 7fae5b59e640 1 -- 172.21.15.7:0/2313995704 learned_addr learned my addr 172.21.15.7:0/2313995704 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:06.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.858+0000 7fae5a59c640 1 --2- 172.21.15.7:0/2313995704 >> v2:172.21.15.55:3300/0 conn(0x7fae5c0d0aa0 0x7fae5c161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:06.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.858+0000 7fae5b59e640 1 -- 172.21.15.7:0/2313995704 >> v2:172.21.15.55:3300/0 conn(0x7fae5c0d0aa0 msgr2=0x7fae5c161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:06.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.858+0000 7fae5b59e640 1 --2- 172.21.15.7:0/2313995704 >> v2:172.21.15.55:3300/0 conn(0x7fae5c0d0aa0 0x7fae5c161d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:06.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.858+0000 7fae5b59e640 1 -- 172.21.15.7:0/2313995704 >> v1:172.21.15.55:6789/0 conn(0x7fae5c15da60 legacy=0x7fae5c15de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:06.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.858+0000 7fae5b59e640 1 -- 172.21.15.7:0/2313995704 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae5c161850 con 0x7fae5c1622b0 2024-04-25T10:03:06.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.858+0000 7fae5a59c640 1 --2- 172.21.15.7:0/2313995704 >> v2:172.21.15.55:3300/0 conn(0x7fae5c0d0aa0 0x7fae5c161d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:03:06.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.859+0000 7fae5b59e640 1 --2- 172.21.15.7:0/2313995704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae5c1622b0 0x7fae5c0ce520 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fae5c0b3260 tx=0x7fae4c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb8d7574da2c52e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:06.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.859+0000 7fae59d9b640 1 -- 172.21.15.7:0/2313995704 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c036070 con 0x7fae5c1622b0 2024-04-25T10:03:06.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.859+0000 7fae59d9b640 1 -- 172.21.15.7:0/2313995704 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4c031600 con 0x7fae5c1622b0 2024-04-25T10:03:06.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.859+0000 7fae59d9b640 1 -- 172.21.15.7:0/2313995704 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c0319d0 con 0x7fae5c1622b0 2024-04-25T10:03:06.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.860+0000 7fae6109e640 1 -- 172.21.15.7:0/2313995704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae5c1622b0 msgr2=0x7fae5c0ce520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:06.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.860+0000 7fae6109e640 1 --2- 172.21.15.7:0/2313995704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae5c1622b0 0x7fae5c0ce520 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fae5c0b3260 tx=0x7fae4c02a660 comp rx=0 tx=0).stop 2024-04-25T10:03:06.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.860+0000 7fae6109e640 1 -- 172.21.15.7:0/2313995704 shutdown_connections 2024-04-25T10:03:06.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.860+0000 7fae6109e640 1 --2- 172.21.15.7:0/2313995704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae5c1622b0 0x7fae5c0ce520 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:06.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.860+0000 7fae6109e640 1 --2- 172.21.15.7:0/2313995704 >> v2:172.21.15.55:3300/0 conn(0x7fae5c0d0aa0 0x7fae5c161d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:06.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.860+0000 7fae6109e640 1 -- 172.21.15.7:0/2313995704 >> 172.21.15.7:0/2313995704 conn(0x7fae5c06bfe0 msgr2=0x7fae5c06c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:06.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.860+0000 7fae6109e640 1 -- 172.21.15.7:0/2313995704 shutdown_connections 2024-04-25T10:03:06.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.860+0000 7fae6109e640 1 -- 172.21.15.7:0/2313995704 wait complete. 2024-04-25T10:03:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.861+0000 7fae6109e640 1 Processor -- start 2024-04-25T10:03:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.861+0000 7fae6109e640 1 -- start start 2024-04-25T10:03:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.862+0000 7fae6109e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae5c0d0aa0 0x7fae5c0b5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.862+0000 7fae6109e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae5c15da60 0x7fae5c1f3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.862+0000 7fae6109e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae5c1622b0 0x7fae5c1f37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.862+0000 7fae6109e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c0cebe0 con 0x7fae5c1622b0 2024-04-25T10:03:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.862+0000 7fae6109e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c0cea60 con 0x7fae5c15da60 2024-04-25T10:03:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.862+0000 7fae6109e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c0ced60 con 0x7fae5c0d0aa0 2024-04-25T10:03:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.862+0000 7fae5b59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae5c1622b0 0x7fae5c1f37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.862+0000 7fae5b59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae5c1622b0 0x7fae5c1f37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50656/0 (socket says 172.21.15.7:50656) 2024-04-25T10:03:06.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.862+0000 7fae5b59e640 1 -- 172.21.15.7:0/4225457752 learned_addr learned my addr 172.21.15.7:0/4225457752 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.862+0000 7fae5a59c640 1 --2- 172.21.15.7:0/4225457752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae5c15da60 0x7fae5c1f3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.862+0000 7fae5ad9d640 1 --2- 172.21.15.7:0/4225457752 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae5c0d0aa0 0x7fae5c0b5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.863+0000 7fae5b59e640 1 -- 172.21.15.7:0/4225457752 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae5c0d0aa0 msgr2=0x7fae5c0b5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.863+0000 7fae5b59e640 1 --2- 172.21.15.7:0/4225457752 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae5c0d0aa0 0x7fae5c0b5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.863+0000 7fae5b59e640 1 -- 172.21.15.7:0/4225457752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae5c15da60 msgr2=0x7fae5c1f3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.863+0000 7fae5b59e640 1 --2- 172.21.15.7:0/4225457752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae5c15da60 0x7fae5c1f3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.863+0000 7fae5b59e640 1 -- 172.21.15.7:0/4225457752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae5c1578e0 con 0x7fae5c1622b0 2024-04-25T10:03:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.863+0000 7fae5b59e640 1 --2- 172.21.15.7:0/4225457752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae5c1622b0 0x7fae5c1f37a0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fae4c009f40 tx=0x7fae4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.863+0000 7fae537fe640 1 -- 172.21.15.7:0/4225457752 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c036050 con 0x7fae5c1622b0 2024-04-25T10:03:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.863+0000 7fae537fe640 1 -- 172.21.15.7:0/4225457752 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4c042070 con 0x7fae5c1622b0 2024-04-25T10:03:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.863+0000 7fae6109e640 1 -- 172.21.15.7:0/4225457752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae5c157bc0 con 0x7fae5c1622b0 2024-04-25T10:03:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.863+0000 7fae537fe640 1 -- 172.21.15.7:0/4225457752 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c009510 con 0x7fae5c1622b0 2024-04-25T10:03:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.863+0000 7fae6109e640 1 -- 172.21.15.7:0/4225457752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae5c0b5ba0 con 0x7fae5c1622b0 2024-04-25T10:03:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.864+0000 7fae6109e640 1 -- 172.21.15.7:0/4225457752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae5c068fd0 con 0x7fae5c1622b0 2024-04-25T10:03:06.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.865+0000 7fae537fe640 1 -- 172.21.15.7:0/4225457752 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fae4c007bd0 con 0x7fae5c1622b0 2024-04-25T10:03:06.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.865+0000 7fae537fe640 1 --2- 172.21.15.7:0/4225457752 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fae3c06b4d0 0x7fae3c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:06.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.865+0000 7fae537fe640 1 -- 172.21.15.7:0/4225457752 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fae4c0ab1e0 con 0x7fae5c1622b0 2024-04-25T10:03:06.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.865+0000 7fae5ad9d640 1 --2- 172.21.15.7:0/4225457752 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fae3c06b4d0 0x7fae3c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:06.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.865+0000 7fae5ad9d640 1 --2- 172.21.15.7:0/4225457752 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fae3c06b4d0 0x7fae3c06d990 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fae54006fd0 tx=0x7fae54009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:06.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:06.869+0000 7fae537fe640 1 -- 172.21.15.7:0/4225457752 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fae4c079880 con 0x7fae5c1622b0 2024-04-25T10:03:07.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.063+0000 7fae6109e640 1 -- 172.21.15.7:0/4225457752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fae5c0ca1b0 con 0x7fae5c1622b0 2024-04-25T10:03:07.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.064+0000 7fae537fe640 1 -- 172.21.15.7:0/4225457752 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v103) v1 ==== 80+0+0 (secure 0 0 0) 0x7fae4c07d920 con 0x7fae5c1622b0 2024-04-25T10:03:07.069 INFO:teuthology.orchestra.run.smithi007.stderr:listed 0 entries 2024-04-25T10:03:07.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.066+0000 7fae6109e640 1 -- 172.21.15.7:0/4225457752 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fae3c06b4d0 msgr2=0x7fae3c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:07.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.066+0000 7fae6109e640 1 --2- 172.21.15.7:0/4225457752 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fae3c06b4d0 0x7fae3c06d990 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fae54006fd0 tx=0x7fae54009060 comp rx=0 tx=0).stop 2024-04-25T10:03:07.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.066+0000 7fae6109e640 1 -- 172.21.15.7:0/4225457752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae5c1622b0 msgr2=0x7fae5c1f37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:07.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.066+0000 7fae6109e640 1 --2- 172.21.15.7:0/4225457752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae5c1622b0 0x7fae5c1f37a0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fae4c009f40 tx=0x7fae4c004a40 comp rx=0 tx=0).stop 2024-04-25T10:03:07.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.066+0000 7fae6109e640 1 -- 172.21.15.7:0/4225457752 shutdown_connections 2024-04-25T10:03:07.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.066+0000 7fae6109e640 1 --2- 172.21.15.7:0/4225457752 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fae3c06b4d0 0x7fae3c06d990 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.066+0000 7fae6109e640 1 --2- 172.21.15.7:0/4225457752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae5c1622b0 0x7fae5c1f37a0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.066+0000 7fae6109e640 1 --2- 172.21.15.7:0/4225457752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae5c15da60 0x7fae5c1f3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.066+0000 7fae6109e640 1 --2- 172.21.15.7:0/4225457752 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae5c0d0aa0 0x7fae5c0b5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.066+0000 7fae6109e640 1 -- 172.21.15.7:0/4225457752 >> 172.21.15.7:0/4225457752 conn(0x7fae5c06bfe0 msgr2=0x7fae5c073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:07.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.066+0000 7fae6109e640 1 -- 172.21.15.7:0/4225457752 shutdown_connections 2024-04-25T10:03:07.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.066+0000 7fae6109e640 1 -- 172.21.15.7:0/4225457752 wait complete. 2024-04-25T10:03:07.082 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T10:03:07.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:07.082 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T10:03:07.124 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-04-25T10:03:07.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:07.124 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T10:03:07.179 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:03:07.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.315+0000 7f2291258640 1 Processor -- start 2024-04-25T10:03:07.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.315+0000 7f2291258640 1 -- start start 2024-04-25T10:03:07.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.316+0000 7f2291258640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f228c15dd00 0x7f228c0b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.316+0000 7f2291258640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f228c06cd00 con 0x7f228c0b6a40 2024-04-25T10:03:07.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.316+0000 7f2291258640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f228c0d1ca0 con 0x7f228c06c6c0 2024-04-25T10:03:07.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.316+0000 7f2291258640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f228c15e0e0 con 0x7f228c15dd00 2024-04-25T10:03:07.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.316+0000 7f228a59c640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f228c0b6a40 0x7f228c06bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35512/0 (socket says 172.21.15.7:35512) 2024-04-25T10:03:07.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.316+0000 7f228a59c640 1 -- 172.21.15.7:0/529820162 learned_addr learned my addr 172.21.15.7:0/529820162 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:03:07.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.316+0000 7f2289d9b640 1 -- 172.21.15.7:0/529820162 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780172086 0 0) 0x7f228c06cd00 con 0x7f228c0b6a40 2024-04-25T10:03:07.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.316+0000 7f228ad9d640 1 --2- 172.21.15.7:0/529820162 >> v2:172.21.15.55:3300/0 conn(0x7f228c15dd00 0x7f228c0b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.316+0000 7f2289d9b640 1 -- 172.21.15.7:0/529820162 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2274003520 con 0x7f228c0b6a40 2024-04-25T10:03:07.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.317+0000 7f2289d9b640 1 -- 172.21.15.7:0/529820162 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 516497372 0 0) 0x7f2274003520 con 0x7f228c0b6a40 2024-04-25T10:03:07.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.317+0000 7f2289d9b640 1 -- 172.21.15.7:0/529820162 >> v2:172.21.15.55:3300/0 conn(0x7f228c15dd00 msgr2=0x7f228c0b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.317+0000 7f2289d9b640 1 --2- 172.21.15.7:0/529820162 >> v2:172.21.15.55:3300/0 conn(0x7f228c15dd00 0x7f228c0b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.317+0000 7f2289d9b640 1 -- 172.21.15.7:0/529820162 >> v1:172.21.15.55:6789/0 conn(0x7f228c06c6c0 legacy=0x7f228c0d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.317+0000 7f2289d9b640 1 -- 172.21.15.7:0/529820162 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f228c0d1f80 con 0x7f228c0b6a40 2024-04-25T10:03:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.317+0000 7f2289d9b640 1 -- 172.21.15.7:0/529820162 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f2280001670 con 0x7f228c0b6a40 2024-04-25T10:03:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.317+0000 7f2289d9b640 1 -- 172.21.15.7:0/529820162 >> v1:172.21.15.7:6789/0 conn(0x7f228c0b6a40 legacy=0x7f228c06bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.317+0000 7f2289d9b640 1 --2- 172.21.15.7:0/529820162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22740039b0 0x7f2274003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.317+0000 7f2289d9b640 1 --2- 172.21.15.7:0/529820162 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2274004800 0x7f2274004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.317+0000 7f2289d9b640 1 --2- 172.21.15.7:0/529820162 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f22740051c0 0x7f227400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.317+0000 7f2289d9b640 1 -- 172.21.15.7:0/529820162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228c15e0e0 con 0x7f22740039b0 2024-04-25T10:03:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.317+0000 7f2289d9b640 1 -- 172.21.15.7:0/529820162 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227400c070 con 0x7f2274004800 2024-04-25T10:03:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.317+0000 7f2289d9b640 1 -- 172.21.15.7:0/529820162 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227400c270 con 0x7f22740051c0 2024-04-25T10:03:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.317+0000 7f228ad9d640 1 --2- 172.21.15.7:0/529820162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22740039b0 0x7f2274003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.317+0000 7f228a59c640 1 --2- 172.21.15.7:0/529820162 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2274004800 0x7f2274004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.317+0000 7f228b59e640 1 --2- 172.21.15.7:0/529820162 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f22740051c0 0x7f227400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.317+0000 7f228ad9d640 1 -- 172.21.15.7:0/529820162 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f22740051c0 msgr2=0x7f227400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.317+0000 7f228ad9d640 1 --2- 172.21.15.7:0/529820162 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f22740051c0 0x7f227400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.317+0000 7f228ad9d640 1 -- 172.21.15.7:0/529820162 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2274004800 msgr2=0x7f2274004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.317+0000 7f228ad9d640 1 --2- 172.21.15.7:0/529820162 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2274004800 0x7f2274004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.317+0000 7f228ad9d640 1 -- 172.21.15.7:0/529820162 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2274003520 con 0x7f22740039b0 2024-04-25T10:03:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.317+0000 7f228b59e640 1 -- 172.21.15.7:0/529820162 reap_dead start 2024-04-25T10:03:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.318+0000 7f228ad9d640 1 --2- 172.21.15.7:0/529820162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22740039b0 0x7f2274003dd0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f227c009ac0 tx=0x7f2274005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=478c675087755ec2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:07.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.318+0000 7f2289d9b640 1 -- 172.21.15.7:0/529820162 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c036070 con 0x7f22740039b0 2024-04-25T10:03:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.318+0000 7f2289d9b640 1 -- 172.21.15.7:0/529820162 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227c031400 con 0x7f22740039b0 2024-04-25T10:03:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.318+0000 7f2289d9b640 1 -- 172.21.15.7:0/529820162 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c009690 con 0x7f22740039b0 2024-04-25T10:03:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.318+0000 7f2291258640 1 -- 172.21.15.7:0/529820162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22740039b0 msgr2=0x7f2274003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.318+0000 7f2291258640 1 --2- 172.21.15.7:0/529820162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22740039b0 0x7f2274003dd0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f227c009ac0 tx=0x7f2274005830 comp rx=0 tx=0).stop 2024-04-25T10:03:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.319+0000 7f2291258640 1 -- 172.21.15.7:0/529820162 shutdown_connections 2024-04-25T10:03:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.319+0000 7f2291258640 1 --2- 172.21.15.7:0/529820162 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22740039b0 0x7f2274003dd0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.319+0000 7f2291258640 1 -- 172.21.15.7:0/529820162 >> 172.21.15.7:0/529820162 conn(0x7f228c0d07b0 msgr2=0x7f228c0d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:07.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.319+0000 7f2291258640 1 -- 172.21.15.7:0/529820162 shutdown_connections 2024-04-25T10:03:07.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.319+0000 7f2291258640 1 -- 172.21.15.7:0/529820162 wait complete. 2024-04-25T10:03:07.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.320+0000 7f2291258640 1 Processor -- start 2024-04-25T10:03:07.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.320+0000 7f2291258640 1 -- start start 2024-04-25T10:03:07.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.321+0000 7f2291258640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22740039b0 0x7f228c14fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.321+0000 7f2291258640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f228c151470 0x7f228c0cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.321+0000 7f2291258640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f228c156d60 0x7f228c160380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.321+0000 7f2291258640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228c06bfb0 con 0x7f22740039b0 2024-04-25T10:03:07.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.321+0000 7f2291258640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228c06cfe0 con 0x7f228c156d60 2024-04-25T10:03:07.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.321+0000 7f2291258640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f228c06c130 con 0x7f228c151470 2024-04-25T10:03:07.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.321+0000 7f228ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22740039b0 0x7f228c14fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.321+0000 7f228ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22740039b0 0x7f228c14fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50666/0 (socket says 172.21.15.7:50666) 2024-04-25T10:03:07.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.321+0000 7f228ad9d640 1 -- 172.21.15.7:0/3511050281 learned_addr learned my addr 172.21.15.7:0/3511050281 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:07.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.321+0000 7f228a59c640 1 --2- 172.21.15.7:0/3511050281 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f228c151470 0x7f228c0cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.321+0000 7f228b59e640 1 --2- 172.21.15.7:0/3511050281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f228c156d60 0x7f228c160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.321+0000 7f228ad9d640 1 -- 172.21.15.7:0/3511050281 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f228c151470 msgr2=0x7f228c0cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:07.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.321+0000 7f228ad9d640 1 --2- 172.21.15.7:0/3511050281 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f228c151470 0x7f228c0cbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.321+0000 7f228ad9d640 1 -- 172.21.15.7:0/3511050281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f228c156d60 msgr2=0x7f228c160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:07.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.321+0000 7f228ad9d640 1 --2- 172.21.15.7:0/3511050281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f228c156d60 0x7f228c160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.321+0000 7f228ad9d640 1 -- 172.21.15.7:0/3511050281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f228c0cc8d0 con 0x7f22740039b0 2024-04-25T10:03:07.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.322+0000 7f228ad9d640 1 --2- 172.21.15.7:0/3511050281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22740039b0 0x7f228c14fb40 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f227c034040 tx=0x7f227c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:07.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.322+0000 7f22737fe640 1 -- 172.21.15.7:0/3511050281 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c03f020 con 0x7f22740039b0 2024-04-25T10:03:07.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.322+0000 7f22737fe640 1 -- 172.21.15.7:0/3511050281 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227c037040 con 0x7f22740039b0 2024-04-25T10:03:07.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.322+0000 7f2291258640 1 -- 172.21.15.7:0/3511050281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f228c1506b0 con 0x7f22740039b0 2024-04-25T10:03:07.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.322+0000 7f22737fe640 1 -- 172.21.15.7:0/3511050281 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c036070 con 0x7f22740039b0 2024-04-25T10:03:07.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.322+0000 7f2291258640 1 -- 172.21.15.7:0/3511050281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f228c150c70 con 0x7f22740039b0 2024-04-25T10:03:07.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.323+0000 7f2291258640 1 -- 172.21.15.7:0/3511050281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f228c0cfb90 con 0x7f22740039b0 2024-04-25T10:03:07.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.323+0000 7f22737fe640 1 -- 172.21.15.7:0/3511050281 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f227c042020 con 0x7f22740039b0 2024-04-25T10:03:07.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.324+0000 7f22737fe640 1 --2- 172.21.15.7:0/3511050281 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f227806b4d0 0x7f227806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.324+0000 7f22737fe640 1 -- 172.21.15.7:0/3511050281 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f227c0aa390 con 0x7f22740039b0 2024-04-25T10:03:07.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.324+0000 7f228a59c640 1 --2- 172.21.15.7:0/3511050281 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f227806b4d0 0x7f227806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.324+0000 7f228a59c640 1 --2- 172.21.15.7:0/3511050281 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f227806b4d0 0x7f227806d990 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f228c0cbee0 tx=0x7f2280009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:07.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.328+0000 7f22737fe640 1 -- 172.21.15.7:0/3511050281 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f228c0cfb90 con 0x7f22740039b0 2024-04-25T10:03:07.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.546+0000 7f2291258640 1 -- 172.21.15.7:0/3511050281 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f228c068fd0 con 0x7f22740039b0 2024-04-25T10:03:07.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.547+0000 7f22737fe640 1 -- 172.21.15.7:0/3511050281 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4931 (secure 0 0 0) 0x7f227c049030 con 0x7f22740039b0 2024-04-25T10:03:07.552 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:03:07.552 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":73,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6617,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3278722694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3278722694},{"type":"v1","addr":"172.21.15.55:6835","nonce":3278722694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":7435,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3598653097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3598653097},{"type":"v1","addr":"172.21.15.55:6834","nonce":3598653097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":8361,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3628875229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3628875229},{"type":"v1","addr":"172.21.15.7:6836","nonce":3628875229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:02:49.944298+0000","modified":"2024-04-25T10:02:51.943060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8364},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8364":{"gid":8364,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6837/900729992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":900729992},{"type":"v1","addr":"172.21.15.7:6837","nonce":900729992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T10:03:07.552 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 73 2024-04-25T10:03:07.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.549+0000 7f2291258640 1 -- 172.21.15.7:0/3511050281 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f227806b4d0 msgr2=0x7f227806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:07.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.549+0000 7f2291258640 1 --2- 172.21.15.7:0/3511050281 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f227806b4d0 0x7f227806d990 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f228c0cbee0 tx=0x7f2280009040 comp rx=0 tx=0).stop 2024-04-25T10:03:07.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.549+0000 7f2291258640 1 -- 172.21.15.7:0/3511050281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22740039b0 msgr2=0x7f228c14fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:07.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.549+0000 7f2291258640 1 --2- 172.21.15.7:0/3511050281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22740039b0 0x7f228c14fb40 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f227c034040 tx=0x7f227c004730 comp rx=0 tx=0).stop 2024-04-25T10:03:07.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.549+0000 7f2291258640 1 -- 172.21.15.7:0/3511050281 shutdown_connections 2024-04-25T10:03:07.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.549+0000 7f2291258640 1 --2- 172.21.15.7:0/3511050281 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f227806b4d0 0x7f227806d990 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.549+0000 7f2291258640 1 --2- 172.21.15.7:0/3511050281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f228c156d60 0x7f228c160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.549+0000 7f2291258640 1 --2- 172.21.15.7:0/3511050281 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f228c151470 0x7f228c0cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.549+0000 7f2291258640 1 --2- 172.21.15.7:0/3511050281 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22740039b0 0x7f228c14fb40 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.549+0000 7f2291258640 1 -- 172.21.15.7:0/3511050281 >> 172.21.15.7:0/3511050281 conn(0x7f228c0d07b0 msgr2=0x7f228c0b3370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:07.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.549+0000 7f2291258640 1 -- 172.21.15.7:0/3511050281 shutdown_connections 2024-04-25T10:03:07.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.549+0000 7f2291258640 1 -- 172.21.15.7:0/3511050281 wait complete. 2024-04-25T10:03:07.565 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-25T10:03:07.696 INFO:teuthology.orchestra.run.smithi007.stdout:{"message":"","return_code":0} 2024-04-25T10:03:07.696 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T10:03:07.696 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:03:07.696 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:03:07.712 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13704 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:03:07.712 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-04-25T10:03:07.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:07.712 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T10:03:07.766 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:03:07.767 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-25T10:03:07.767 DEBUG:teuthology.orchestra.run.smithi007:> sudo daemon-helper kill ceph --cluster ceph -w 2024-04-25T10:03:07.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:07.810 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start / repair,recursive 2024-04-25T10:03:07.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.910+0000 7f11002b3640 1 Processor -- start 2024-04-25T10:03:07.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.910+0000 7f11002b3640 1 -- start start 2024-04-25T10:03:07.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.911+0000 7f11002b3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f10f815de70 0x7f10f80d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.911+0000 7f11002b3640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f10f80d3330 0x7f10f80d3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.911+0000 7f11002b3640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f80d2290 con 0x7f10f80b9290 2024-04-25T10:03:07.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.911+0000 7f11002b3640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f80d2570 con 0x7f10f80d3330 2024-04-25T10:03:07.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.911+0000 7f11002b3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f80d2850 con 0x7f10f815de70 2024-04-25T10:03:07.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.911+0000 7f10fd84e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f10f80d3330 0x7f10f80d3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.911+0000 7f10fe850640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f10f80b9290 0x7f10f80b52f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35524/0 (socket says 172.21.15.7:35524) 2024-04-25T10:03:07.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.911+0000 7f10fe850640 1 -- 172.21.15.7:0/737767264 learned_addr learned my addr 172.21.15.7:0/737767264 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:03:07.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.911+0000 7f10fe04f640 1 --2- 172.21.15.7:0/737767264 >> v2:172.21.15.55:3300/0 conn(0x7f10f815de70 0x7f10f80d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.911+0000 7f10fd04d640 1 -- 172.21.15.7:0/737767264 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4027101686 0 0) 0x7f10f80d2290 con 0x7f10f80b9290 2024-04-25T10:03:07.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.911+0000 7f10fd04d640 1 -- 172.21.15.7:0/737767264 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10e4003520 con 0x7f10f80b9290 2024-04-25T10:03:07.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.911+0000 7f10fd84e640 1 -- 172.21.15.7:0/737767264 >> v2:172.21.15.55:3300/0 conn(0x7f10f815de70 msgr2=0x7f10f80d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:07.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.911+0000 7f10fd84e640 1 --2- 172.21.15.7:0/737767264 >> v2:172.21.15.55:3300/0 conn(0x7f10f815de70 0x7f10f80d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.911+0000 7f10fd84e640 1 -- 172.21.15.7:0/737767264 >> v1:172.21.15.7:6789/0 conn(0x7f10f80b9290 legacy=0x7f10f80b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:07.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.911+0000 7f10fd84e640 1 -- 172.21.15.7:0/737767264 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f80d2b30 con 0x7f10f80d3330 2024-04-25T10:03:07.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.912+0000 7f10fd84e640 1 --2- 172.21.15.7:0/737767264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10f80d3330 0x7f10f80d3800 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f10f80d43c0 tx=0x7f10e802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b00a4eac293f837b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:07.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.912+0000 7f10fd04d640 1 -- 172.21.15.7:0/737767264 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e8037070 con 0x7f10f80d3330 2024-04-25T10:03:07.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.912+0000 7f10fd04d640 1 -- 172.21.15.7:0/737767264 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e8032440 con 0x7f10f80d3330 2024-04-25T10:03:07.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.912+0000 7f10fd04d640 1 -- 172.21.15.7:0/737767264 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e8032810 con 0x7f10f80d3330 2024-04-25T10:03:07.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.913+0000 7f11002b3640 1 -- 172.21.15.7:0/737767264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10f80d3330 msgr2=0x7f10f80d3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:07.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.913+0000 7f11002b3640 1 --2- 172.21.15.7:0/737767264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10f80d3330 0x7f10f80d3800 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f10f80d43c0 tx=0x7f10e802a1a0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.913+0000 7f11002b3640 1 -- 172.21.15.7:0/737767264 shutdown_connections 2024-04-25T10:03:07.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.913+0000 7f11002b3640 1 --2- 172.21.15.7:0/737767264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10f80d3330 0x7f10f80d3800 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.913+0000 7f11002b3640 1 --2- 172.21.15.7:0/737767264 >> v2:172.21.15.55:3300/0 conn(0x7f10f815de70 0x7f10f80d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.913+0000 7f11002b3640 1 -- 172.21.15.7:0/737767264 >> 172.21.15.7:0/737767264 conn(0x7f10f80726b0 msgr2=0x7f10f8072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:07.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.913+0000 7f11002b3640 1 -- 172.21.15.7:0/737767264 shutdown_connections 2024-04-25T10:03:07.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.913+0000 7f11002b3640 1 -- 172.21.15.7:0/737767264 wait complete. 2024-04-25T10:03:07.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.914+0000 7f11002b3640 1 Processor -- start 2024-04-25T10:03:07.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.914+0000 7f11002b3640 1 -- start start 2024-04-25T10:03:07.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.915+0000 7f11002b3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f10f80b9290 0x7f10f8160d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.915+0000 7f11002b3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10f80d3330 0x7f10f8155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.915+0000 7f11002b3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10f815de70 0x7f10f80b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.915+0000 7f11002b3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f80d1fe0 con 0x7f10f80d3330 2024-04-25T10:03:07.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.915+0000 7f11002b3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f80d1e60 con 0x7f10f815de70 2024-04-25T10:03:07.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.915+0000 7f11002b3640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f80d3d40 con 0x7f10f80b9290 2024-04-25T10:03:07.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.915+0000 7f10fd84e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10f80d3330 0x7f10f8155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.915+0000 7f10fd84e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10f80d3330 0x7f10f8155100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50680/0 (socket says 172.21.15.7:50680) 2024-04-25T10:03:07.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.915+0000 7f10fd84e640 1 -- 172.21.15.7:0/361723091 learned_addr learned my addr 172.21.15.7:0/361723091 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:07.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.915+0000 7f10fe04f640 1 --2- 172.21.15.7:0/361723091 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f10f80b9290 0x7f10f8160d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.915+0000 7f10fe850640 1 --2- 172.21.15.7:0/361723091 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10f815de70 0x7f10f80b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.915+0000 7f10fd84e640 1 -- 172.21.15.7:0/361723091 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f10f80b9290 msgr2=0x7f10f8160d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:07.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.915+0000 7f10fd84e640 1 --2- 172.21.15.7:0/361723091 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f10f80b9290 0x7f10f8160d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.915+0000 7f10fd84e640 1 -- 172.21.15.7:0/361723091 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10f815de70 msgr2=0x7f10f80b77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:07.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.915+0000 7f10fd84e640 1 --2- 172.21.15.7:0/361723091 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10f815de70 0x7f10f80b77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.915+0000 7f10fd84e640 1 -- 172.21.15.7:0/361723091 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f81540a0 con 0x7f10f80d3330 2024-04-25T10:03:07.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.915+0000 7f10fe04f640 1 --2- 172.21.15.7:0/361723091 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f10f80b9290 0x7f10f8160d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:03:07.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.915+0000 7f10fe850640 1 --2- 172.21.15.7:0/361723091 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10f815de70 0x7f10f80b77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:03:07.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.916+0000 7f10fd84e640 1 --2- 172.21.15.7:0/361723091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10f80d3330 0x7f10f8155100 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f10e8000c00 tx=0x7f10e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:07.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.916+0000 7f10eeffd640 1 -- 172.21.15.7:0/361723091 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e8037040 con 0x7f10f80d3330 2024-04-25T10:03:07.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.916+0000 7f10eeffd640 1 -- 172.21.15.7:0/361723091 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e8042070 con 0x7f10f80d3330 2024-04-25T10:03:07.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.916+0000 7f11002b3640 1 -- 172.21.15.7:0/361723091 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f8154340 con 0x7f10f80d3330 2024-04-25T10:03:07.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.916+0000 7f10eeffd640 1 -- 172.21.15.7:0/361723091 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e8030960 con 0x7f10f80d3330 2024-04-25T10:03:07.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.916+0000 7f11002b3640 1 -- 172.21.15.7:0/361723091 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f8154900 con 0x7f10f80d3330 2024-04-25T10:03:07.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.917+0000 7f10eeffd640 1 -- 172.21.15.7:0/361723091 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f10e8030b00 con 0x7f10f80d3330 2024-04-25T10:03:07.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.918+0000 7f10eeffd640 1 --2- 172.21.15.7:0/361723091 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f10dc06b500 0x7f10dc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.918+0000 7f10eeffd640 1 -- 172.21.15.7:0/361723091 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f10e80aac50 con 0x7f10f80d3330 2024-04-25T10:03:07.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.918+0000 7f10fe04f640 1 --2- 172.21.15.7:0/361723091 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f10dc06b500 0x7f10dc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.919+0000 7f10fe04f640 1 --2- 172.21.15.7:0/361723091 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f10dc06b500 0x7f10dc06d9c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f10f4006fd0 tx=0x7f10f4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:07.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.919+0000 7f1102fbc740 1 Processor -- start 2024-04-25T10:03:07.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.919+0000 7f1102fbc740 1 -- start start 2024-04-25T10:03:07.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.920+0000 7f1102fbc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432399dbb0 0x56432399df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.920+0000 7f1102fbc740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564323998830 0x56432399c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.920+0000 7f1102fbc740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56432399ccf0 0x56432399d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.920+0000 7f1102fbc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x564323901ac0 con 0x56432399dbb0 2024-04-25T10:03:07.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.920+0000 7f1102fbc740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643238aad80 con 0x564323998830 2024-04-25T10:03:07.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.920+0000 7f1102fbc740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5643238fdb60 con 0x56432399ccf0 2024-04-25T10:03:07.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.920+0000 7f10fe04f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432399dbb0 0x56432399df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.920+0000 7f10fe04f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432399dbb0 0x56432399df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50692/0 (socket says 172.21.15.7:50692) 2024-04-25T10:03:07.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.920+0000 7f10fe04f640 1 -- 172.21.15.7:0/4294559156 learned_addr learned my addr 172.21.15.7:0/4294559156 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:07.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.920+0000 7f10fe850640 1 --2- 172.21.15.7:0/4294559156 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56432399ccf0 0x56432399d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.920+0000 7f10fd84e640 1 --2- 172.21.15.7:0/4294559156 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564323998830 0x56432399c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.921+0000 7f10fe04f640 1 -- 172.21.15.7:0/4294559156 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56432399ccf0 msgr2=0x56432399d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:07.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.921+0000 7f10fe04f640 1 --2- 172.21.15.7:0/4294559156 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56432399ccf0 0x56432399d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.921+0000 7f10fe04f640 1 -- 172.21.15.7:0/4294559156 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564323998830 msgr2=0x56432399c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:07.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.921+0000 7f10fe04f640 1 --2- 172.21.15.7:0/4294559156 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564323998830 0x56432399c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.921+0000 7f10fe04f640 1 -- 172.21.15.7:0/4294559156 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643236de7e0 con 0x56432399dbb0 2024-04-25T10:03:07.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.921+0000 7f10fe04f640 1 --2- 172.21.15.7:0/4294559156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432399dbb0 0x56432399df90 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f10f4004350 tx=0x7f10f4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d3f795def9105d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:07.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.921+0000 7f10dbfff640 1 -- 172.21.15.7:0/4294559156 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f400f040 con 0x56432399dbb0 2024-04-25T10:03:07.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.921+0000 7f10dbfff640 1 -- 172.21.15.7:0/4294559156 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f4004380 con 0x56432399dbb0 2024-04-25T10:03:07.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.921+0000 7f10dbfff640 1 -- 172.21.15.7:0/4294559156 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f400ee80 con 0x56432399dbb0 2024-04-25T10:03:07.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.922+0000 7f1102fbc740 1 -- 172.21.15.7:0/4294559156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432399dbb0 msgr2=0x56432399df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:07.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.922+0000 7f1102fbc740 1 --2- 172.21.15.7:0/4294559156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432399dbb0 0x56432399df90 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f10f4004350 tx=0x7f10f4011000 comp rx=0 tx=0).stop 2024-04-25T10:03:07.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.922+0000 7f1102fbc740 1 -- 172.21.15.7:0/4294559156 shutdown_connections 2024-04-25T10:03:07.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.922+0000 7f1102fbc740 1 --2- 172.21.15.7:0/4294559156 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56432399ccf0 0x56432399d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.922+0000 7f1102fbc740 1 --2- 172.21.15.7:0/4294559156 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564323998830 0x56432399c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.922+0000 7f1102fbc740 1 --2- 172.21.15.7:0/4294559156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432399dbb0 0x56432399df90 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.922+0000 7f1102fbc740 1 -- 172.21.15.7:0/4294559156 >> 172.21.15.7:0/4294559156 conn(0x56432399acb0 msgr2=0x5643239e3770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:07.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.922+0000 7f1102fbc740 1 -- 172.21.15.7:0/4294559156 shutdown_connections 2024-04-25T10:03:07.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.922+0000 7f1102fbc740 1 -- 172.21.15.7:0/4294559156 wait complete. 2024-04-25T10:03:07.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.922+0000 7f1102fbc740 1 -- start start 2024-04-25T10:03:07.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.922+0000 7f1102fbc740 1 Processor -- start 2024-04-25T10:03:07.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.923+0000 7f1102fbc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432399ccf0 0x5643239ebad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.923+0000 7f1102fbc740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56432399dbb0 0x5643239bd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.923+0000 7f1102fbc740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5643239bb450 0x5643239bde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.923+0000 7f1102fbc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643239c9740 con 0x56432399ccf0 2024-04-25T10:03:07.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.923+0000 7f1102fbc740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643238a0530 con 0x56432399dbb0 2024-04-25T10:03:07.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.923+0000 7f1102fbc740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5643239c8bc0 con 0x5643239bb450 2024-04-25T10:03:07.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.923+0000 7f1102fbc740 10 client.0 _ll_register_callbacks cb 0x5643238f8130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:03:07.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.923+0000 7f10fe04f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432399ccf0 0x5643239ebad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.923+0000 7f10fe04f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432399ccf0 0x5643239ebad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50706/0 (socket says 172.21.15.7:50706) 2024-04-25T10:03:07.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.923+0000 7f10fe04f640 1 -- 172.21.15.7:0/952089929 learned_addr learned my addr 172.21.15.7:0/952089929 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:07.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.924+0000 7f10fd84e640 1 --2- 172.21.15.7:0/952089929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56432399dbb0 0x5643239bd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.924+0000 7f10fe850640 1 --2- 172.21.15.7:0/952089929 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5643239bb450 0x5643239bde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.924+0000 7f10fe04f640 1 -- 172.21.15.7:0/952089929 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5643239bb450 msgr2=0x5643239bde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:07.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.924+0000 7f10fe04f640 1 --2- 172.21.15.7:0/952089929 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5643239bb450 0x5643239bde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.924+0000 7f10fe04f640 1 -- 172.21.15.7:0/952089929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56432399dbb0 msgr2=0x5643239bd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:07.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.924+0000 7f10fe04f640 1 --2- 172.21.15.7:0/952089929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56432399dbb0 0x5643239bd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.924+0000 7f10fe04f640 1 -- 172.21.15.7:0/952089929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56432373ef70 con 0x56432399ccf0 2024-04-25T10:03:07.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.924+0000 7f10fd84e640 1 --2- 172.21.15.7:0/952089929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56432399dbb0 0x5643239bd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:07.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.924+0000 7f10fe04f640 1 --2- 172.21.15.7:0/952089929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432399ccf0 0x5643239ebad0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f10f40095f0 tx=0x7f10f4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b49e4467337954 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:07.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.924+0000 7f10d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:03:07.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.924+0000 7f10d97fa640 1 -- 172.21.15.7:0/952089929 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f4031060 con 0x56432399ccf0 2024-04-25T10:03:07.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.924+0000 7f10d97fa640 1 -- 172.21.15.7:0/952089929 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f10f4013a70 con 0x56432399ccf0 2024-04-25T10:03:07.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.924+0000 7f1102fbc740 1 -- 172.21.15.7:0/952089929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f10f4004380 con 0x56432399ccf0 2024-04-25T10:03:07.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.924+0000 7f10d97fa640 1 -- 172.21.15.7:0/952089929 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10f4037050 con 0x56432399ccf0 2024-04-25T10:03:07.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.924+0000 7f1102fbc740 10 client.8673 fetch_fsmap learned FSMap version 73 2024-04-25T10:03:07.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.924+0000 7f1102fbc740 1 -- 172.21.15.7:0/952089929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x5643235d6170 con 0x56432399ccf0 2024-04-25T10:03:07.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.925+0000 7f10d97fa640 1 -- 172.21.15.7:0/952089929 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f4004380 con 0x56432399ccf0 2024-04-25T10:03:07.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.925+0000 7f10d97fa640 1 -- 172.21.15.7:0/952089929 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 73) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f10f403a020 con 0x56432399ccf0 2024-04-25T10:03:07.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.925+0000 7f1102fbc740 10 client.8673 fetch_fsmap finished waiting for FSMap version 73 2024-04-25T10:03:07.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.925+0000 7f1102fbc740 10 client.8673 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T10:03:07.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.925+0000 7f1102fbc740 20 client.8673 populate_metadata read hostname 'smithi007' 2024-04-25T10:03:07.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.925+0000 7f1102fbc740 1 --2- 172.21.15.7:0/952089929 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x5643239ea3b0 0x5643239ea820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.925+0000 7f1102fbc740 4 client.8673 mds_command: new command op to 8364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:03:07.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.925+0000 7f1102fbc740 1 -- 172.21.15.7:0/952089929 --> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56432390f000 con 0x5643239ea3b0 2024-04-25T10:03:07.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.925+0000 7f10fd84e640 1 --2- 172.21.15.7:0/952089929 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x5643239ea3b0 0x5643239ea820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.925+0000 7f10d97fa640 10 client.8673 ms_handle_connect on v2:172.21.15.7:6835/900729992 2024-04-25T10:03:07.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.925+0000 7f10fd84e640 1 --2- 172.21.15.7:0/952089929 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x5643239ea3b0 0x5643239ea820 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fca497ef4160071 server_cookie=512201ad5ab19e79 in_seq=0 out_seq=0 2024-04-25T10:03:07.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.926+0000 7f10d97fa640 1 -- 172.21.15.7:0/952089929 <== mds.0 v2:172.21.15.7:6835/900729992 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56432390f000 con 0x5643239ea3b0 2024-04-25T10:03:07.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.926+0000 7f10d97fa640 10 client.8673 handle_command_reply: tid=0 2024-04-25T10:03:07.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.926+0000 7f1102fbc740 1 client.8673 shutdown 2024-04-25T10:03:07.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.926+0000 7f1102fbc740 1 -- 172.21.15.7:0/952089929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432399ccf0 msgr2=0x5643239ebad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:07.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.926+0000 7f1102fbc740 1 --2- 172.21.15.7:0/952089929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432399ccf0 0x5643239ebad0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f10f40095f0 tx=0x7f10f4004730 comp rx=0 tx=0).stop 2024-04-25T10:03:07.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.926+0000 7f1102fbc740 1 -- 172.21.15.7:0/952089929 shutdown_connections 2024-04-25T10:03:07.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.926+0000 7f1102fbc740 1 --2- 172.21.15.7:0/952089929 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5643239bb450 0x5643239bde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.926+0000 7f1102fbc740 1 --2- 172.21.15.7:0/952089929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56432399dbb0 0x5643239bd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.926+0000 7f1102fbc740 1 --2- 172.21.15.7:0/952089929 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x5643239ea3b0 0x5643239ea820 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.926+0000 7f1102fbc740 1 --2- 172.21.15.7:0/952089929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432399ccf0 0x5643239ebad0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.926+0000 7f1102fbc740 1 -- 172.21.15.7:0/952089929 >> 172.21.15.7:0/952089929 conn(0x564323998830 msgr2=0x564323997f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:07.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.926+0000 7f10d97fa640 0 client.8673 ms_handle_reset on v2:172.21.15.7:6835/900729992 2024-04-25T10:03:07.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.926+0000 7f1102fbc740 1 -- 172.21.15.7:0/952089929 shutdown_connections 2024-04-25T10:03:07.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.926+0000 7f1102fbc740 1 -- 172.21.15.7:0/952089929 wait complete. 2024-04-25T10:03:07.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.926+0000 7f1102fbc740 20 client.8673 trim_cache size 0 max 16384 2024-04-25T10:03:07.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.929+0000 7fba95d90640 1 Processor -- start 2024-04-25T10:03:07.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.929+0000 7fba95d90640 1 -- start start 2024-04-25T10:03:07.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.931+0000 7fba95d90640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fba9015deb0 0x7fba900d1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.931+0000 7fba95d90640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fba900d3390 0x7fba900b9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.931+0000 7fba95d90640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba900b9840 con 0x7fba900ce660 2024-04-25T10:03:07.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.931+0000 7fba95d90640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba900b79d0 con 0x7fba9015deb0 2024-04-25T10:03:07.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.931+0000 7fba95d90640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba900d22f0 con 0x7fba900d3390 2024-04-25T10:03:07.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.931+0000 7fba8ffff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fba900ce660 0x7fba900d3820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35532/0 (socket says 172.21.15.7:35532) 2024-04-25T10:03:07.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.931+0000 7fba8ffff640 1 -- 172.21.15.7:0/577677753 learned_addr learned my addr 172.21.15.7:0/577677753 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:03:07.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.931+0000 7fba8f7fe640 1 --2- 172.21.15.7:0/577677753 >> v2:172.21.15.55:3300/0 conn(0x7fba9015deb0 0x7fba900d1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.931+0000 7fba8effd640 1 --2- 172.21.15.7:0/577677753 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fba900d3390 0x7fba900b9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.931+0000 7fba8e7fc640 1 -- 172.21.15.7:0/577677753 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 420208537 0 0) 0x7fba900b9840 con 0x7fba900ce660 2024-04-25T10:03:07.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.931+0000 7fba8e7fc640 1 -- 172.21.15.7:0/577677753 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba78003520 con 0x7fba900ce660 2024-04-25T10:03:07.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.931+0000 7fba8f7fe640 1 -- 172.21.15.7:0/577677753 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fba900d3390 msgr2=0x7fba900b9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:07.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.931+0000 7fba8f7fe640 1 --2- 172.21.15.7:0/577677753 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fba900d3390 0x7fba900b9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.931+0000 7fba8f7fe640 1 -- 172.21.15.7:0/577677753 >> v1:172.21.15.7:6789/0 conn(0x7fba900ce660 legacy=0x7fba900d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:07.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.931+0000 7fba8f7fe640 1 -- 172.21.15.7:0/577677753 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba900d25d0 con 0x7fba9015deb0 2024-04-25T10:03:07.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.931+0000 7fba8effd640 1 --2- 172.21.15.7:0/577677753 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fba900d3390 0x7fba900b9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:03:07.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.932+0000 7fba8f7fe640 1 --2- 172.21.15.7:0/577677753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba9015deb0 0x7fba900d1c60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fba800097a0 tx=0x7fba8002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=379d7e3aab1f6a67 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:07.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.932+0000 7fba8e7fc640 1 -- 172.21.15.7:0/577677753 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba80037070 con 0x7fba9015deb0 2024-04-25T10:03:07.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.932+0000 7fba8e7fc640 1 -- 172.21.15.7:0/577677753 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8002ae50 con 0x7fba9015deb0 2024-04-25T10:03:07.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.932+0000 7fba8e7fc640 1 -- 172.21.15.7:0/577677753 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba80032660 con 0x7fba9015deb0 2024-04-25T10:03:07.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.933+0000 7fba95d90640 1 -- 172.21.15.7:0/577677753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba9015deb0 msgr2=0x7fba900d1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:07.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.933+0000 7fba95d90640 1 --2- 172.21.15.7:0/577677753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba9015deb0 0x7fba900d1c60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fba800097a0 tx=0x7fba8002a100 comp rx=0 tx=0).stop 2024-04-25T10:03:07.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.933+0000 7fba95d90640 1 -- 172.21.15.7:0/577677753 shutdown_connections 2024-04-25T10:03:07.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.933+0000 7fba95d90640 1 --2- 172.21.15.7:0/577677753 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fba900d3390 0x7fba900b9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.933+0000 7fba95d90640 1 --2- 172.21.15.7:0/577677753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba9015deb0 0x7fba900d1c60 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.933+0000 7fba95d90640 1 -- 172.21.15.7:0/577677753 >> 172.21.15.7:0/577677753 conn(0x7fba900726b0 msgr2=0x7fba90072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:07.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.933+0000 7fba95d90640 1 -- 172.21.15.7:0/577677753 shutdown_connections 2024-04-25T10:03:07.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.933+0000 7fba95d90640 1 -- 172.21.15.7:0/577677753 wait complete. 2024-04-25T10:03:07.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.935+0000 7fba95d90640 1 Processor -- start 2024-04-25T10:03:07.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.935+0000 7fba95d90640 1 -- start start 2024-04-25T10:03:07.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.937+0000 7fba95d90640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fba900ce660 0x7fba90151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.937+0000 7fba95d90640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba900d3390 0x7fba900cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.937+0000 7fba95d90640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba9015deb0 0x7fba900b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.937+0000 7fba95d90640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba900d2b90 con 0x7fba900d3390 2024-04-25T10:03:07.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.937+0000 7fba95d90640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba900d28b0 con 0x7fba9015deb0 2024-04-25T10:03:07.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.937+0000 7fba95d90640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba900cea90 con 0x7fba900ce660 2024-04-25T10:03:07.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.937+0000 7fba8effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba900d3390 0x7fba900cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.937+0000 7fba8effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba900d3390 0x7fba900cbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50716/0 (socket says 172.21.15.7:50716) 2024-04-25T10:03:07.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.937+0000 7fba8effd640 1 -- 172.21.15.7:0/267178334 learned_addr learned my addr 172.21.15.7:0/267178334 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:07.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.937+0000 7fba8effd640 1 -- 172.21.15.7:0/267178334 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fba900ce660 msgr2=0x7fba90151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:07.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.937+0000 7fba8effd640 1 --2- 172.21.15.7:0/267178334 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fba900ce660 0x7fba90151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.937+0000 7fba8effd640 1 -- 172.21.15.7:0/267178334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba9015deb0 msgr2=0x7fba900b3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:07.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.937+0000 7fba8ffff640 1 --2- 172.21.15.7:0/267178334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba9015deb0 0x7fba900b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.937+0000 7fba8effd640 1 --2- 172.21.15.7:0/267178334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba9015deb0 0x7fba900b3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.937+0000 7fba8effd640 1 -- 172.21.15.7:0/267178334 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba900c9730 con 0x7fba900d3390 2024-04-25T10:03:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.937+0000 7fba8ffff640 1 --2- 172.21.15.7:0/267178334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba9015deb0 0x7fba900b3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:03:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.937+0000 7fba8effd640 1 --2- 172.21.15.7:0/267178334 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba900d3390 0x7fba900cbc70 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fba8400e9b0 tx=0x7fba8400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.938+0000 7fba77fff640 1 -- 172.21.15.7:0/267178334 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba84017070 con 0x7fba900d3390 2024-04-25T10:03:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.938+0000 7fba77fff640 1 -- 172.21.15.7:0/267178334 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8400ca00 con 0x7fba900d3390 2024-04-25T10:03:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.938+0000 7fba95d90640 1 -- 172.21.15.7:0/267178334 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba900c9a10 con 0x7fba900d3390 2024-04-25T10:03:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.938+0000 7fba77fff640 1 -- 172.21.15.7:0/267178334 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8400cdf0 con 0x7fba900d3390 2024-04-25T10:03:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.938+0000 7fba95d90640 1 -- 172.21.15.7:0/267178334 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba900c9fd0 con 0x7fba900d3390 2024-04-25T10:03:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.938+0000 7fba95d90640 1 -- 172.21.15.7:0/267178334 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fba90068f60 con 0x7fba900d3390 2024-04-25T10:03:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.939+0000 7fba77fff640 1 -- 172.21.15.7:0/267178334 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fba8401a070 con 0x7fba900d3390 2024-04-25T10:03:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.940+0000 7fba77fff640 1 --2- 172.21.15.7:0/267178334 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fba7c06b4d0 0x7fba7c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.940+0000 7fba8f7fe640 1 --2- 172.21.15.7:0/267178334 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fba7c06b4d0 0x7fba7c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.940+0000 7fba77fff640 1 -- 172.21.15.7:0/267178334 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fba8408ab70 con 0x7fba900d3390 2024-04-25T10:03:07.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.940+0000 7fba77fff640 1 -- 172.21.15.7:0/267178334 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+511 (secure 0 0 0) 0x7fba8408b2d0 con 0x7fba900d3390 2024-04-25T10:03:07.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.940+0000 7fba95d90640 1 -- 172.21.15.7:0/267178334 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7fba900d3a70 con 0x7fba900d3390 2024-04-25T10:03:07.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.940+0000 7fba8f7fe640 1 --2- 172.21.15.7:0/267178334 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fba7c06b4d0 0x7fba7c06d990 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fba80034000 tx=0x7fba8002c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:07.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.946+0000 7f1102fbc740 1 Processor -- start 2024-04-25T10:03:07.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.946+0000 7f1102fbc740 1 -- start start 2024-04-25T10:03:07.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.947+0000 7f1102fbc740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56432399ccf0 0x56432399d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.947+0000 7f1102fbc740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56432399dbb0 0x5643239fd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.947+0000 7f1102fbc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5643239bb450 0x5643239fd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.947+0000 7f1102fbc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x56432399bbc0 con 0x5643239bb450 2024-04-25T10:03:07.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.947+0000 7f1102fbc740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f8200230 con 0x56432399dbb0 2024-04-25T10:03:07.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.947+0000 7f1102fbc740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f81ff3b0 con 0x56432399ccf0 2024-04-25T10:03:07.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.947+0000 7f10fe850640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5643239bb450 0x5643239fd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.947+0000 7f10fe850640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5643239bb450 0x5643239fd580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50722/0 (socket says 172.21.15.7:50722) 2024-04-25T10:03:07.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.947+0000 7f10fe850640 1 -- 172.21.15.7:0/2205593218 learned_addr learned my addr 172.21.15.7:0/2205593218 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:07.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.947+0000 7f10fd84e640 1 --2- 172.21.15.7:0/2205593218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56432399dbb0 0x5643239fd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.947+0000 7f10fe04f640 1 --2- 172.21.15.7:0/2205593218 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56432399ccf0 0x56432399d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.947+0000 7f10fe850640 1 -- 172.21.15.7:0/2205593218 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56432399ccf0 msgr2=0x56432399d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:07.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.947+0000 7f10fe850640 1 --2- 172.21.15.7:0/2205593218 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56432399ccf0 0x56432399d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.947+0000 7f10fe850640 1 -- 172.21.15.7:0/2205593218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56432399dbb0 msgr2=0x5643239fd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:07.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.947+0000 7f10fe850640 1 --2- 172.21.15.7:0/2205593218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56432399dbb0 0x5643239fd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.947+0000 7f10fe850640 1 -- 172.21.15.7:0/2205593218 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56432399f260 con 0x5643239bb450 2024-04-25T10:03:07.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.947+0000 7f10fe850640 1 --2- 172.21.15.7:0/2205593218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5643239bb450 0x5643239fd580 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f10f00021c0 tx=0x7f10f00021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af57e138a7c2218 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:07.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.947+0000 7f10db7fe640 1 -- 172.21.15.7:0/2205593218 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f0019020 con 0x5643239bb450 2024-04-25T10:03:07.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.947+0000 7f10db7fe640 1 -- 172.21.15.7:0/2205593218 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f0015440 con 0x5643239bb450 2024-04-25T10:03:07.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.947+0000 7f10db7fe640 1 -- 172.21.15.7:0/2205593218 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f0015810 con 0x5643239bb450 2024-04-25T10:03:07.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.948+0000 7f1102fbc740 1 -- 172.21.15.7:0/2205593218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5643239bb450 msgr2=0x5643239fd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:07.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.948+0000 7f1102fbc740 1 --2- 172.21.15.7:0/2205593218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5643239bb450 0x5643239fd580 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f10f00021c0 tx=0x7f10f00021f0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.948+0000 7f1102fbc740 1 -- 172.21.15.7:0/2205593218 shutdown_connections 2024-04-25T10:03:07.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.948+0000 7f1102fbc740 1 --2- 172.21.15.7:0/2205593218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5643239bb450 0x5643239fd580 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.948+0000 7f1102fbc740 1 --2- 172.21.15.7:0/2205593218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56432399dbb0 0x5643239fd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.948+0000 7f1102fbc740 1 --2- 172.21.15.7:0/2205593218 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56432399ccf0 0x56432399d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.948+0000 7f1102fbc740 1 -- 172.21.15.7:0/2205593218 >> 172.21.15.7:0/2205593218 conn(0x564323998830 msgr2=0x56432399e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:07.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.948+0000 7f1102fbc740 1 -- 172.21.15.7:0/2205593218 shutdown_connections 2024-04-25T10:03:07.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.948+0000 7f1102fbc740 1 -- 172.21.15.7:0/2205593218 wait complete. 2024-04-25T10:03:07.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.949+0000 7f1102fbc740 1 -- start start 2024-04-25T10:03:07.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.949+0000 7f1102fbc740 1 Processor -- start 2024-04-25T10:03:07.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.950+0000 7f1102fbc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432399ccf0 0x56432399d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.950+0000 7f1102fbc740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56432399dbb0 0x5643239be970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.950+0000 7f1102fbc740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643239bb450 0x5643239eb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.950+0000 7f1102fbc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f815ac30 con 0x56432399ccf0 2024-04-25T10:03:07.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.950+0000 7f1102fbc740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f81607a0 con 0x5643239bb450 2024-04-25T10:03:07.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.950+0000 7f1102fbc740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x56432399f610 con 0x56432399dbb0 2024-04-25T10:03:07.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.950+0000 7f1102fbc740 10 client.0 _ll_register_callbacks cb 0x7f10f4009200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:03:07.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.950+0000 7f10fe04f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432399ccf0 0x56432399d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.950+0000 7f10fe04f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432399ccf0 0x56432399d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50730/0 (socket says 172.21.15.7:50730) 2024-04-25T10:03:07.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.950+0000 7f10fe04f640 1 -- 172.21.15.7:0/3975538113 learned_addr learned my addr 172.21.15.7:0/3975538113 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:07.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.950+0000 7f10fd84e640 1 --2- 172.21.15.7:0/3975538113 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56432399dbb0 0x5643239be970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.950+0000 7f10fe850640 1 --2- 172.21.15.7:0/3975538113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643239bb450 0x5643239eb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.950+0000 7f10fe04f640 1 -- 172.21.15.7:0/3975538113 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56432399dbb0 msgr2=0x5643239be970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:07.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.950+0000 7f10fe04f640 1 --2- 172.21.15.7:0/3975538113 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56432399dbb0 0x5643239be970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.950+0000 7f10fe04f640 1 -- 172.21.15.7:0/3975538113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643239bb450 msgr2=0x5643239eb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:07.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.950+0000 7f10fe04f640 1 --2- 172.21.15.7:0/3975538113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643239bb450 0x5643239eb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.950+0000 7f10fe04f640 1 -- 172.21.15.7:0/3975538113 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5643239beeb0 con 0x56432399ccf0 2024-04-25T10:03:07.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.950+0000 7f10fe04f640 1 --2- 172.21.15.7:0/3975538113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432399ccf0 0x56432399d0d0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f10f400a010 tx=0x7f10f4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d5a825e6ce0bca3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:07.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.950+0000 7f10d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:03:07.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.951+0000 7f10d97fa640 1 -- 172.21.15.7:0/3975538113 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f4004460 con 0x56432399ccf0 2024-04-25T10:03:07.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.951+0000 7f10d97fa640 1 -- 172.21.15.7:0/3975538113 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f10f4013430 con 0x56432399ccf0 2024-04-25T10:03:07.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.951+0000 7f1102fbc740 1 -- 172.21.15.7:0/3975538113 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f10f0015440 con 0x56432399ccf0 2024-04-25T10:03:07.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.951+0000 7f10d97fa640 1 -- 172.21.15.7:0/3975538113 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10f4013630 con 0x56432399ccf0 2024-04-25T10:03:07.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.951+0000 7f1102fbc740 10 client.8685 fetch_fsmap learned FSMap version 73 2024-04-25T10:03:07.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.951+0000 7f1102fbc740 1 -- 172.21.15.7:0/3975538113 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x5643239ea790 con 0x56432399ccf0 2024-04-25T10:03:07.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.951+0000 7f10d97fa640 1 -- 172.21.15.7:0/3975538113 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f0015440 con 0x56432399ccf0 2024-04-25T10:03:07.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.951+0000 7f10d97fa640 1 -- 172.21.15.7:0/3975538113 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 73) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f10f403a040 con 0x56432399ccf0 2024-04-25T10:03:07.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.951+0000 7f1102fbc740 10 client.8685 fetch_fsmap finished waiting for FSMap version 73 2024-04-25T10:03:07.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.951+0000 7f1102fbc740 10 client.8685 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T10:03:07.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.951+0000 7f1102fbc740 20 client.8685 populate_metadata read hostname 'smithi007' 2024-04-25T10:03:07.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.951+0000 7f1102fbc740 1 --2- 172.21.15.7:0/3975538113 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x564323a4f330 0x564323a4f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:07.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.951+0000 7f1102fbc740 4 client.8685 mds_command: new command op to 8364 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-04-25T10:03:07.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.951+0000 7f1102fbc740 1 -- 172.21.15.7:0/3975538113 --> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x564323909350 con 0x564323a4f330 2024-04-25T10:03:07.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.951+0000 7f10fd84e640 1 --2- 172.21.15.7:0/3975538113 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x564323a4f330 0x564323a4f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:07.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.952+0000 7f10fd84e640 1 --2- 172.21.15.7:0/3975538113 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x564323a4f330 0x564323a4f740 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df981690f5862ec1 server_cookie=20b7c533ff0941e4 in_seq=0 out_seq=0 2024-04-25T10:03:07.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.952+0000 7f10d97fa640 10 client.8685 ms_handle_connect on v2:172.21.15.7:6835/900729992 2024-04-25T10:03:07.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.952+0000 7f10d97fa640 1 -- 172.21.15.7:0/3975538113 <== mds.0 v2:172.21.15.7:6835/900729992 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x564323909350 con 0x564323a4f330 2024-04-25T10:03:07.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.952+0000 7f10d97fa640 10 client.8685 handle_command_reply: tid=0 2024-04-25T10:03:07.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.952+0000 7f1102fbc740 1 client.8685 shutdown 2024-04-25T10:03:07.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.952+0000 7f1102fbc740 1 -- 172.21.15.7:0/3975538113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432399ccf0 msgr2=0x56432399d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:07.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.952+0000 7f1102fbc740 1 --2- 172.21.15.7:0/3975538113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432399ccf0 0x56432399d0d0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f10f400a010 tx=0x7f10f4014000 comp rx=0 tx=0).stop 2024-04-25T10:03:07.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.952+0000 7f1102fbc740 1 -- 172.21.15.7:0/3975538113 shutdown_connections 2024-04-25T10:03:07.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.952+0000 7f1102fbc740 1 --2- 172.21.15.7:0/3975538113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643239bb450 0x5643239eb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.952+0000 7f1102fbc740 1 --2- 172.21.15.7:0/3975538113 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56432399dbb0 0x5643239be970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.952+0000 7f1102fbc740 1 --2- 172.21.15.7:0/3975538113 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x564323a4f330 0x564323a4f740 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.952+0000 7f1102fbc740 1 --2- 172.21.15.7:0/3975538113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56432399ccf0 0x56432399d0d0 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.952+0000 7f10d97fa640 0 client.8685 ms_handle_reset on v2:172.21.15.7:6835/900729992 2024-04-25T10:03:07.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.952+0000 7f1102fbc740 1 -- 172.21.15.7:0/3975538113 >> 172.21.15.7:0/3975538113 conn(0x564323998830 msgr2=0x564323993db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:07.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.953+0000 7f1102fbc740 1 -- 172.21.15.7:0/3975538113 shutdown_connections 2024-04-25T10:03:07.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.953+0000 7f1102fbc740 1 -- 172.21.15.7:0/3975538113 wait complete. 2024-04-25T10:03:07.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.953+0000 7f1102fbc740 20 client.8685 trim_cache size 0 max 16384 2024-04-25T10:03:07.965 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:03:07.965 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-04-25T10:03:07.965 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "077d1cb0-638f-4029-bb13-036608f2d6e1", 2024-04-25T10:03:07.965 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-04-25T10:03:07.965 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:03:07.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.953+0000 7f11002b3640 1 -- 172.21.15.7:0/361723091 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f10dc06b500 msgr2=0x7f10dc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:07.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.953+0000 7f11002b3640 1 --2- 172.21.15.7:0/361723091 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f10dc06b500 0x7f10dc06d9c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f10f4006fd0 tx=0x7f10f4008040 comp rx=0 tx=0).stop 2024-04-25T10:03:07.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.953+0000 7f11002b3640 1 -- 172.21.15.7:0/361723091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10f80d3330 msgr2=0x7f10f8155100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:07.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.953+0000 7f11002b3640 1 --2- 172.21.15.7:0/361723091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10f80d3330 0x7f10f8155100 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f10e8000c00 tx=0x7f10e80046c0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.953+0000 7f11002b3640 1 -- 172.21.15.7:0/361723091 shutdown_connections 2024-04-25T10:03:07.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.953+0000 7f11002b3640 1 --2- 172.21.15.7:0/361723091 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f10dc06b500 0x7f10dc06d9c0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.953+0000 7f11002b3640 1 --2- 172.21.15.7:0/361723091 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10f815de70 0x7f10f80b77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.953+0000 7f11002b3640 1 --2- 172.21.15.7:0/361723091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10f80d3330 0x7f10f8155100 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.953+0000 7f11002b3640 1 --2- 172.21.15.7:0/361723091 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f10f80b9290 0x7f10f8160d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:07.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.953+0000 7f11002b3640 1 -- 172.21.15.7:0/361723091 >> 172.21.15.7:0/361723091 conn(0x7f10f80726b0 msgr2=0x7f10f80c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:07.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.953+0000 7f11002b3640 1 -- 172.21.15.7:0/361723091 shutdown_connections 2024-04-25T10:03:07.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:07.953+0000 7f11002b3640 1 -- 172.21.15.7:0/361723091 wait complete. 2024-04-25T10:03:07.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:07.970 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-25T10:03:08.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.067+0000 7f33112e1640 1 Processor -- start 2024-04-25T10:03:08.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.067+0000 7f33112e1640 1 -- start start 2024-04-25T10:03:08.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.068+0000 7f33112e1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f330c15bad0 0x7f330c0cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:08.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.068+0000 7f33112e1640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f330c0cd210 0x7f330c0999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:08.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.068+0000 7f33112e1640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f330c0b5480 con 0x7f330c099f30 2024-04-25T10:03:08.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.068+0000 7f33112e1640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f330c0cf1f0 con 0x7f330c0cd210 2024-04-25T10:03:08.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.068+0000 7f33112e1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f330c0cf440 con 0x7f330c15bad0 2024-04-25T10:03:08.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.068+0000 7f330a7fc640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f330c0cd210 0x7f330c0999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:08.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.068+0000 7f330b7fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f330c099f30 0x7f330c15f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35546/0 (socket says 172.21.15.7:35546) 2024-04-25T10:03:08.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.068+0000 7f330b7fe640 1 -- 172.21.15.7:0/1238247053 learned_addr learned my addr 172.21.15.7:0/1238247053 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:03:08.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.068+0000 7f330affd640 1 --2- 172.21.15.7:0/1238247053 >> v2:172.21.15.55:3300/0 conn(0x7f330c15bad0 0x7f330c0cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:08.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.068+0000 7f330a7fc640 1 -- 172.21.15.7:0/1238247053 >> v2:172.21.15.55:3300/0 conn(0x7f330c15bad0 msgr2=0x7f330c0cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:08.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.068+0000 7f330a7fc640 1 --2- 172.21.15.7:0/1238247053 >> v2:172.21.15.55:3300/0 conn(0x7f330c15bad0 0x7f330c0cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.068+0000 7f330a7fc640 1 -- 172.21.15.7:0/1238247053 >> v1:172.21.15.7:6789/0 conn(0x7f330c099f30 legacy=0x7f330c15f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:08.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.068+0000 7f3309ffb640 1 -- 172.21.15.7:0/1238247053 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2725993990 0 0) 0x7f330c0b5480 con 0x7f330c099f30 2024-04-25T10:03:08.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.068+0000 7f330a7fc640 1 -- 172.21.15.7:0/1238247053 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330c0cf720 con 0x7f330c0cd210 2024-04-25T10:03:08.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.069+0000 7f330a7fc640 1 --2- 172.21.15.7:0/1238247053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f330c0cd210 0x7f330c0999f0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f330c0727e0 tx=0x7f330002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b3c80d27569a3ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:08.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.069+0000 7f3309ffb640 1 -- 172.21.15.7:0/1238247053 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3300037070 con 0x7f330c0cd210 2024-04-25T10:03:08.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.069+0000 7f3309ffb640 1 -- 172.21.15.7:0/1238247053 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3300032440 con 0x7f330c0cd210 2024-04-25T10:03:08.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.069+0000 7f3309ffb640 1 -- 172.21.15.7:0/1238247053 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3300032810 con 0x7f330c0cd210 2024-04-25T10:03:08.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.070+0000 7f33112e1640 1 -- 172.21.15.7:0/1238247053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f330c0cd210 msgr2=0x7f330c0999f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:08.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.070+0000 7f33112e1640 1 --2- 172.21.15.7:0/1238247053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f330c0cd210 0x7f330c0999f0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f330c0727e0 tx=0x7f330002a1a0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.070+0000 7f33112e1640 1 -- 172.21.15.7:0/1238247053 shutdown_connections 2024-04-25T10:03:08.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.070+0000 7f33112e1640 1 --2- 172.21.15.7:0/1238247053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f330c0cd210 0x7f330c0999f0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.070+0000 7f33112e1640 1 --2- 172.21.15.7:0/1238247053 >> v2:172.21.15.55:3300/0 conn(0x7f330c15bad0 0x7f330c0cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.070+0000 7f33112e1640 1 -- 172.21.15.7:0/1238247053 >> 172.21.15.7:0/1238247053 conn(0x7f330c0b3110 msgr2=0x7f330c0b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:08.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.070+0000 7f33112e1640 1 -- 172.21.15.7:0/1238247053 shutdown_connections 2024-04-25T10:03:08.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.070+0000 7f33112e1640 1 -- 172.21.15.7:0/1238247053 wait complete. 2024-04-25T10:03:08.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.071+0000 7f33112e1640 1 Processor -- start 2024-04-25T10:03:08.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.071+0000 7f33112e1640 1 -- start start 2024-04-25T10:03:08.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.072+0000 7f33112e1640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f330c099f30 0x7f330c157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:08.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.072+0000 7f33112e1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f330c0cd210 0x7f330c0ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:08.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.072+0000 7f33112e1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f330c15bad0 0x7f330c0ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:08.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.072+0000 7f33112e1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330c0cffc0 con 0x7f330c15bad0 2024-04-25T10:03:08.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.072+0000 7f33112e1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330c0cfce0 con 0x7f330c0cd210 2024-04-25T10:03:08.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.072+0000 7f33112e1640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f330c0d04e0 con 0x7f330c099f30 2024-04-25T10:03:08.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.072+0000 7f330b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f330c15bad0 0x7f330c0ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:08.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.072+0000 7f330b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f330c15bad0 0x7f330c0ca7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50748/0 (socket says 172.21.15.7:50748) 2024-04-25T10:03:08.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.072+0000 7f330b7fe640 1 -- 172.21.15.7:0/1463368842 learned_addr learned my addr 172.21.15.7:0/1463368842 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:08.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.072+0000 7f330a7fc640 1 --2- 172.21.15.7:0/1463368842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f330c0cd210 0x7f330c0ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:08.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.072+0000 7f330affd640 1 --2- 172.21.15.7:0/1463368842 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f330c099f30 0x7f330c157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:08.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.072+0000 7f330b7fe640 1 -- 172.21.15.7:0/1463368842 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f330c099f30 msgr2=0x7f330c157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:08.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.072+0000 7f330b7fe640 1 --2- 172.21.15.7:0/1463368842 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f330c099f30 0x7f330c157dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.072+0000 7f330b7fe640 1 -- 172.21.15.7:0/1463368842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f330c0cd210 msgr2=0x7f330c0ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:08.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.072+0000 7f330b7fe640 1 --2- 172.21.15.7:0/1463368842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f330c0cd210 0x7f330c0ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.072+0000 7f330b7fe640 1 -- 172.21.15.7:0/1463368842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330c15dd30 con 0x7f330c15bad0 2024-04-25T10:03:08.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.072+0000 7f330a7fc640 1 --2- 172.21.15.7:0/1463368842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f330c0cd210 0x7f330c0ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:08.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.072+0000 7f330b7fe640 1 --2- 172.21.15.7:0/1463368842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f330c15bad0 0x7f330c0ca7d0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f330400c700 tx=0x7f330400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:08.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.072+0000 7f32f37fe640 1 -- 172.21.15.7:0/1463368842 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3304018070 con 0x7f330c15bad0 2024-04-25T10:03:08.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.073+0000 7f32f37fe640 1 -- 172.21.15.7:0/1463368842 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330400ce10 con 0x7f330c15bad0 2024-04-25T10:03:08.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.073+0000 7f33112e1640 1 -- 172.21.15.7:0/1463368842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f330c15e010 con 0x7f330c15bad0 2024-04-25T10:03:08.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.073+0000 7f32f37fe640 1 -- 172.21.15.7:0/1463368842 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330400a880 con 0x7f330c15bad0 2024-04-25T10:03:08.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.073+0000 7f33112e1640 1 -- 172.21.15.7:0/1463368842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f330c15e5d0 con 0x7f330c15bad0 2024-04-25T10:03:08.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.074+0000 7f32f37fe640 1 -- 172.21.15.7:0/1463368842 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f330401b070 con 0x7f330c15bad0 2024-04-25T10:03:08.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.074+0000 7f32f37fe640 1 --2- 172.21.15.7:0/1463368842 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f32f806b4d0 0x7f32f806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:08.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.075+0000 7f32f37fe640 1 -- 172.21.15.7:0/1463368842 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3304089920 con 0x7f330c15bad0 2024-04-25T10:03:08.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.075+0000 7f330affd640 1 --2- 172.21.15.7:0/1463368842 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f32f806b4d0 0x7f32f806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:08.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.075+0000 7f330affd640 1 --2- 172.21.15.7:0/1463368842 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f32f806b4d0 0x7f32f806d990 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f32fc006fd0 tx=0x7f32fc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:08.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.075+0000 7f3313fe5740 1 Processor -- start 2024-04-25T10:03:08.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.076+0000 7f3313fe5740 1 -- start start 2024-04-25T10:03:08.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.076+0000 7f3313fe5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c37ed5510 0x563c37ed58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:08.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.076+0000 7f3313fe5740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c37ea5770 0x563c37eab7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:08.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.076+0000 7f3313fe5740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563c37ef1470 0x563c37ef18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:08.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.076+0000 7f3313fe5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c37e0eda0 con 0x563c37ed5510 2024-04-25T10:03:08.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.076+0000 7f3313fe5740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c37db7b80 con 0x563c37ea5770 2024-04-25T10:03:08.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.076+0000 7f3313fe5740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c37e0ae40 con 0x563c37ef1470 2024-04-25T10:03:08.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.076+0000 7f330affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c37ed5510 0x563c37ed58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:08.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.076+0000 7f330affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c37ed5510 0x563c37ed58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50754/0 (socket says 172.21.15.7:50754) 2024-04-25T10:03:08.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.076+0000 7f330affd640 1 -- 172.21.15.7:0/2938104975 learned_addr learned my addr 172.21.15.7:0/2938104975 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:08.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.077+0000 7f330affd640 1 -- 172.21.15.7:0/2938104975 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563c37ef1470 msgr2=0x563c37ef18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:08.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.077+0000 7f330b7fe640 1 --2- 172.21.15.7:0/2938104975 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563c37ef1470 0x563c37ef18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:08.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.077+0000 7f330a7fc640 1 --2- 172.21.15.7:0/2938104975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c37ea5770 0x563c37eab7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:08.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.077+0000 7f330affd640 1 --2- 172.21.15.7:0/2938104975 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563c37ef1470 0x563c37ef18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.077+0000 7f330affd640 1 -- 172.21.15.7:0/2938104975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c37ea5770 msgr2=0x563c37eab7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:08.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.077+0000 7f330affd640 1 --2- 172.21.15.7:0/2938104975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c37ea5770 0x563c37eab7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.077+0000 7f330affd640 1 -- 172.21.15.7:0/2938104975 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c37dc1f10 con 0x563c37ed5510 2024-04-25T10:03:08.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.077+0000 7f330affd640 1 --2- 172.21.15.7:0/2938104975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c37ed5510 0x563c37ed58f0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00fab0 tx=0x7f32fc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f73915c32ca724bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:08.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.077+0000 7f32f0ff9640 1 -- 172.21.15.7:0/2938104975 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc01b050 con 0x563c37ed5510 2024-04-25T10:03:08.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.077+0000 7f32f0ff9640 1 -- 172.21.15.7:0/2938104975 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32fc025070 con 0x563c37ed5510 2024-04-25T10:03:08.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.077+0000 7f32f0ff9640 1 -- 172.21.15.7:0/2938104975 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc014de0 con 0x563c37ed5510 2024-04-25T10:03:08.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.078+0000 7f3313fe5740 1 -- 172.21.15.7:0/2938104975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c37ed5510 msgr2=0x563c37ed58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:08.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.078+0000 7f3313fe5740 1 --2- 172.21.15.7:0/2938104975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c37ed5510 0x563c37ed58f0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00fab0 tx=0x7f32fc012000 comp rx=0 tx=0).stop 2024-04-25T10:03:08.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.078+0000 7f3313fe5740 1 -- 172.21.15.7:0/2938104975 shutdown_connections 2024-04-25T10:03:08.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.078+0000 7f3313fe5740 1 --2- 172.21.15.7:0/2938104975 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563c37ef1470 0x563c37ef18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.078+0000 7f3313fe5740 1 --2- 172.21.15.7:0/2938104975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c37ea5770 0x563c37eab7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.078+0000 7f3313fe5740 1 --2- 172.21.15.7:0/2938104975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c37ed5510 0x563c37ed58f0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.078+0000 7f3313fe5740 1 -- 172.21.15.7:0/2938104975 >> 172.21.15.7:0/2938104975 conn(0x563c37ea79e0 msgr2=0x563c37ef0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:08.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.078+0000 7f3313fe5740 1 -- 172.21.15.7:0/2938104975 shutdown_connections 2024-04-25T10:03:08.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.078+0000 7f3313fe5740 1 -- 172.21.15.7:0/2938104975 wait complete. 2024-04-25T10:03:08.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.078+0000 7f3313fe5740 1 -- start start 2024-04-25T10:03:08.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.079+0000 7f3313fe5740 1 Processor -- start 2024-04-25T10:03:08.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.079+0000 7f3313fe5740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563c37ed5510 0x563c37ebfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:08.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.079+0000 7f3313fe5740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c37ef1470 0x563c37ed12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:08.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.079+0000 7f3313fe5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c37ed8e00 0x563c37ed9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:08.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.079+0000 7f3313fe5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c37eabce0 con 0x563c37ed8e00 2024-04-25T10:03:08.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.079+0000 7f3313fe5740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c37dad4b0 con 0x563c37ef1470 2024-04-25T10:03:08.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.079+0000 7f3313fe5740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c37eab310 con 0x563c37ed5510 2024-04-25T10:03:08.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.079+0000 7f3313fe5740 10 client.0 _ll_register_callbacks cb 0x563c37ded180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:03:08.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.079+0000 7f330b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c37ed8e00 0x563c37ed9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:08.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.079+0000 7f330b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c37ed8e00 0x563c37ed9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50762/0 (socket says 172.21.15.7:50762) 2024-04-25T10:03:08.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.079+0000 7f330b7fe640 1 -- 172.21.15.7:0/1549735502 learned_addr learned my addr 172.21.15.7:0/1549735502 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:08.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.080+0000 7f330a7fc640 1 --2- 172.21.15.7:0/1549735502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c37ef1470 0x563c37ed12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:08.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.080+0000 7f330affd640 1 --2- 172.21.15.7:0/1549735502 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563c37ed5510 0x563c37ebfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:08.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.080+0000 7f330b7fe640 1 -- 172.21.15.7:0/1549735502 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563c37ed5510 msgr2=0x563c37ebfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:08.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.080+0000 7f330b7fe640 1 --2- 172.21.15.7:0/1549735502 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563c37ed5510 0x563c37ebfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.080+0000 7f330b7fe640 1 -- 172.21.15.7:0/1549735502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c37ef1470 msgr2=0x563c37ed12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:08.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.080+0000 7f330b7fe640 1 --2- 172.21.15.7:0/1549735502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c37ef1470 0x563c37ed12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.080+0000 7f330b7fe640 1 -- 172.21.15.7:0/1549735502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c37bed7d0 con 0x563c37ed8e00 2024-04-25T10:03:08.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.080+0000 7f330a7fc640 1 --2- 172.21.15.7:0/1549735502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c37ef1470 0x563c37ed12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:08.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.080+0000 7f330b7fe640 1 --2- 172.21.15.7:0/1549735502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c37ed8e00 0x563c37ed9280 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f330400c6d0 tx=0x7f33040586d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da246bb031a5e2c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:08.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.080+0000 7f32e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:03:08.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.080+0000 7f32e9ffb640 1 -- 172.21.15.7:0/1549735502 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330405e2c0 con 0x563c37ed8e00 2024-04-25T10:03:08.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.080+0000 7f32e9ffb640 1 -- 172.21.15.7:0/1549735502 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3304057360 con 0x563c37ed8e00 2024-04-25T10:03:08.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.080+0000 7f3313fe5740 1 -- 172.21.15.7:0/1549735502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f32fc025070 con 0x563c37ed8e00 2024-04-25T10:03:08.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.080+0000 7f32e9ffb640 1 -- 172.21.15.7:0/1549735502 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3304060620 con 0x563c37ed8e00 2024-04-25T10:03:08.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.080+0000 7f3313fe5740 10 client.8700 fetch_fsmap learned FSMap version 73 2024-04-25T10:03:08.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.080+0000 7f3313fe5740 1 -- 172.21.15.7:0/1549735502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x563c37b233f0 con 0x563c37ed8e00 2024-04-25T10:03:08.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.080+0000 7f32e9ffb640 1 -- 172.21.15.7:0/1549735502 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32fc025070 con 0x563c37ed8e00 2024-04-25T10:03:08.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.080+0000 7f32e9ffb640 1 -- 172.21.15.7:0/1549735502 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 73) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3304053c60 con 0x563c37ed8e00 2024-04-25T10:03:08.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.080+0000 7f3313fe5740 10 client.8700 fetch_fsmap finished waiting for FSMap version 73 2024-04-25T10:03:08.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.080+0000 7f3313fe5740 10 client.8700 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T10:03:08.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.080+0000 7f3313fe5740 20 client.8700 populate_metadata read hostname 'smithi007' 2024-04-25T10:03:08.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.080+0000 7f3313fe5740 1 --2- 172.21.15.7:0/1549735502 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x563c37ed75e0 0x563c37ed79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:08.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.080+0000 7f3313fe5740 4 client.8700 mds_command: new command op to 8364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:03:08.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.080+0000 7f3313fe5740 1 -- 172.21.15.7:0/1549735502 --> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563c37e1c2e0 con 0x563c37ed75e0 2024-04-25T10:03:08.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.081+0000 7f330affd640 1 --2- 172.21.15.7:0/1549735502 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x563c37ed75e0 0x563c37ed79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:08.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.081+0000 7f32e9ffb640 10 client.8700 ms_handle_connect on v2:172.21.15.7:6835/900729992 2024-04-25T10:03:08.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.081+0000 7f330affd640 1 --2- 172.21.15.7:0/1549735502 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x563c37ed75e0 0x563c37ed79f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5783152b5fbac170 server_cookie=a5e18cba5e38931b in_seq=0 out_seq=0 2024-04-25T10:03:08.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.081+0000 7f32e9ffb640 1 -- 172.21.15.7:0/1549735502 <== mds.0 v2:172.21.15.7:6835/900729992 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563c37e1c2e0 con 0x563c37ed75e0 2024-04-25T10:03:08.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.081+0000 7f32e9ffb640 10 client.8700 handle_command_reply: tid=0 2024-04-25T10:03:08.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.081+0000 7f3313fe5740 1 client.8700 shutdown 2024-04-25T10:03:08.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.082+0000 7f3313fe5740 1 -- 172.21.15.7:0/1549735502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c37ed8e00 msgr2=0x563c37ed9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:08.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.082+0000 7f3313fe5740 1 --2- 172.21.15.7:0/1549735502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c37ed8e00 0x563c37ed9280 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f330400c6d0 tx=0x7f33040586d0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.082+0000 7f3313fe5740 1 -- 172.21.15.7:0/1549735502 shutdown_connections 2024-04-25T10:03:08.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.082+0000 7f3313fe5740 1 --2- 172.21.15.7:0/1549735502 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x563c37ed75e0 0x563c37ed79f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.082+0000 7f3313fe5740 1 --2- 172.21.15.7:0/1549735502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c37ed8e00 0x563c37ed9280 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.082+0000 7f3313fe5740 1 --2- 172.21.15.7:0/1549735502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c37ef1470 0x563c37ed12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.082+0000 7f32e9ffb640 0 client.8700 ms_handle_reset on v2:172.21.15.7:6835/900729992 2024-04-25T10:03:08.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.082+0000 7f3313fe5740 1 --2- 172.21.15.7:0/1549735502 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563c37ed5510 0x563c37ebfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.082+0000 7f3313fe5740 1 -- 172.21.15.7:0/1549735502 >> 172.21.15.7:0/1549735502 conn(0x563c37ea5770 msgr2=0x563c37ea4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:08.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.082+0000 7f3313fe5740 1 -- 172.21.15.7:0/1549735502 shutdown_connections 2024-04-25T10:03:08.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.082+0000 7f3313fe5740 1 -- 172.21.15.7:0/1549735502 wait complete. 2024-04-25T10:03:08.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.082+0000 7f3313fe5740 20 client.8700 trim_cache size 0 max 16384 2024-04-25T10:03:08.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.097+0000 7f3313fe5740 1 Processor -- start 2024-04-25T10:03:08.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.097+0000 7f3313fe5740 1 -- start start 2024-04-25T10:03:08.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.097+0000 7f3313fe5740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563c37ed5510 0x563c37ecd550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:08.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.098+0000 7f3313fe5740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c37ed8e00 0x563c37efc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:08.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.098+0000 7f3313fe5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c37ef1470 0x563c37efc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:08.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.098+0000 7f3313fe5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330c1fbe90 con 0x563c37ef1470 2024-04-25T10:03:08.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.098+0000 7f3313fe5740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330c06d4d0 con 0x563c37ed8e00 2024-04-25T10:03:08.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.098+0000 7f3313fe5740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f330c1f24b0 con 0x563c37ed5510 2024-04-25T10:03:08.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.098+0000 7f330b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c37ef1470 0x563c37efc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:08.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.098+0000 7f330b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c37ef1470 0x563c37efc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50770/0 (socket says 172.21.15.7:50770) 2024-04-25T10:03:08.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.098+0000 7f330b7fe640 1 -- 172.21.15.7:0/1037067903 learned_addr learned my addr 172.21.15.7:0/1037067903 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:08.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.098+0000 7f330a7fc640 1 --2- 172.21.15.7:0/1037067903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c37ed8e00 0x563c37efc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:08.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.098+0000 7f330affd640 1 --2- 172.21.15.7:0/1037067903 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563c37ed5510 0x563c37ecd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:08.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.098+0000 7f330b7fe640 1 -- 172.21.15.7:0/1037067903 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563c37ed5510 msgr2=0x563c37ecd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:08.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.098+0000 7f330b7fe640 1 --2- 172.21.15.7:0/1037067903 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563c37ed5510 0x563c37ecd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.098+0000 7f330b7fe640 1 -- 172.21.15.7:0/1037067903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c37ed8e00 msgr2=0x563c37efc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:08.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.098+0000 7f330b7fe640 1 --2- 172.21.15.7:0/1037067903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c37ed8e00 0x563c37efc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.098+0000 7f330b7fe640 1 -- 172.21.15.7:0/1037067903 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c37ece4d0 con 0x563c37ef1470 2024-04-25T10:03:08.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.098+0000 7f330b7fe640 1 --2- 172.21.15.7:0/1037067903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c37ef1470 0x563c37efc690 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f33040587c0 tx=0x7f3304009070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40315ae9cfcb0c70 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:08.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.098+0000 7f32ebfff640 1 -- 172.21.15.7:0/1037067903 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330405e2c0 con 0x563c37ef1470 2024-04-25T10:03:08.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.098+0000 7f32ebfff640 1 -- 172.21.15.7:0/1037067903 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3304057360 con 0x563c37ef1470 2024-04-25T10:03:08.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.098+0000 7f32ebfff640 1 -- 172.21.15.7:0/1037067903 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3304056dd0 con 0x563c37ef1470 2024-04-25T10:03:08.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.099+0000 7f3313fe5740 1 -- 172.21.15.7:0/1037067903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c37ef1470 msgr2=0x563c37efc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:08.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.099+0000 7f3313fe5740 1 --2- 172.21.15.7:0/1037067903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c37ef1470 0x563c37efc690 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f33040587c0 tx=0x7f3304009070 comp rx=0 tx=0).stop 2024-04-25T10:03:08.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.099+0000 7f3313fe5740 1 -- 172.21.15.7:0/1037067903 shutdown_connections 2024-04-25T10:03:08.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.099+0000 7f3313fe5740 1 --2- 172.21.15.7:0/1037067903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c37ef1470 0x563c37efc690 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.099+0000 7f3313fe5740 1 --2- 172.21.15.7:0/1037067903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c37ed8e00 0x563c37efc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.099+0000 7f3313fe5740 1 --2- 172.21.15.7:0/1037067903 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563c37ed5510 0x563c37ecd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.099+0000 7f3313fe5740 1 -- 172.21.15.7:0/1037067903 >> 172.21.15.7:0/1037067903 conn(0x563c37ea5770 msgr2=0x563c37ef0690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:08.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.099+0000 7f3313fe5740 1 -- 172.21.15.7:0/1037067903 shutdown_connections 2024-04-25T10:03:08.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.099+0000 7f3313fe5740 1 -- 172.21.15.7:0/1037067903 wait complete. 2024-04-25T10:03:08.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.099+0000 7f3313fe5740 1 -- start start 2024-04-25T10:03:08.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.099+0000 7f3313fe5740 1 Processor -- start 2024-04-25T10:03:08.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.100+0000 7f3313fe5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c37ed5510 0x563c37f0d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:08.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.100+0000 7f3313fe5740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c37ed8e00 0x563c37eac440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:08.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.100+0000 7f3313fe5740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563c37ef1470 0x563c37eac980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:08.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.100+0000 7f3313fe5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c37ed8aa0 con 0x563c37ed5510 2024-04-25T10:03:08.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.100+0000 7f3313fe5740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330c06ced0 con 0x563c37ed8e00 2024-04-25T10:03:08.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.100+0000 7f3313fe5740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c37f0e210 con 0x563c37ef1470 2024-04-25T10:03:08.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.100+0000 7f3313fe5740 10 client.0 _ll_register_callbacks cb 0x7f32fc00b200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:03:08.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.100+0000 7f330affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c37ed5510 0x563c37f0d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:08.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.100+0000 7f330affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c37ed5510 0x563c37f0d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50780/0 (socket says 172.21.15.7:50780) 2024-04-25T10:03:08.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.100+0000 7f330affd640 1 -- 172.21.15.7:0/1492941828 learned_addr learned my addr 172.21.15.7:0/1492941828 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:08.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.100+0000 7f330a7fc640 1 --2- 172.21.15.7:0/1492941828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c37ed8e00 0x563c37eac440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:08.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.100+0000 7f330b7fe640 1 --2- 172.21.15.7:0/1492941828 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563c37ef1470 0x563c37eac980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:08.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.101+0000 7f330affd640 1 -- 172.21.15.7:0/1492941828 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563c37ef1470 msgr2=0x563c37eac980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:08.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.101+0000 7f330affd640 1 --2- 172.21.15.7:0/1492941828 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563c37ef1470 0x563c37eac980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.101+0000 7f330affd640 1 -- 172.21.15.7:0/1492941828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c37ed8e00 msgr2=0x563c37eac440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:08.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.101+0000 7f330affd640 1 --2- 172.21.15.7:0/1492941828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c37ed8e00 0x563c37eac440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.101+0000 7f330affd640 1 -- 172.21.15.7:0/1492941828 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c37ae30f0 con 0x563c37ed5510 2024-04-25T10:03:08.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.101+0000 7f330affd640 1 --2- 172.21.15.7:0/1492941828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c37ed5510 0x563c37f0d980 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00f5b0 tx=0x7f32fc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e9c63796025cbb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:08.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.101+0000 7f32e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:03:08.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.101+0000 7f32e9ffb640 1 -- 172.21.15.7:0/1492941828 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc01b040 con 0x563c37ed5510 2024-04-25T10:03:08.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.101+0000 7f32e9ffb640 1 -- 172.21.15.7:0/1492941828 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f32fc0355b0 con 0x563c37ed5510 2024-04-25T10:03:08.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.101+0000 7f3313fe5740 1 -- 172.21.15.7:0/1492941828 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3304057360 con 0x563c37ed5510 2024-04-25T10:03:08.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.101+0000 7f32e9ffb640 1 -- 172.21.15.7:0/1492941828 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32fc045050 con 0x563c37ed5510 2024-04-25T10:03:08.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.101+0000 7f3313fe5740 10 client.8706 fetch_fsmap learned FSMap version 73 2024-04-25T10:03:08.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.101+0000 7f3313fe5740 1 -- 172.21.15.7:0/1492941828 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x563c37ea9b00 con 0x563c37ed5510 2024-04-25T10:03:08.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.101+0000 7f32e9ffb640 1 -- 172.21.15.7:0/1492941828 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3304057360 con 0x563c37ed5510 2024-04-25T10:03:08.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.101+0000 7f32e9ffb640 1 -- 172.21.15.7:0/1492941828 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 73) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f32fc048020 con 0x563c37ed5510 2024-04-25T10:03:08.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.101+0000 7f3313fe5740 10 client.8706 fetch_fsmap finished waiting for FSMap version 73 2024-04-25T10:03:08.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.101+0000 7f3313fe5740 10 client.8706 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T10:03:08.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.101+0000 7f3313fe5740 20 client.8706 populate_metadata read hostname 'smithi007' 2024-04-25T10:03:08.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.101+0000 7f3313fe5740 1 --2- 172.21.15.7:0/1492941828 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x563c37ed85e0 0x563c37efc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:08.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.101+0000 7f3313fe5740 4 client.8706 mds_command: new command op to 8364 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T10:03:08.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.101+0000 7f3313fe5740 1 -- 172.21.15.7:0/1492941828 --> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563c37e16630 con 0x563c37ed85e0 2024-04-25T10:03:08.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.102+0000 7f330a7fc640 1 --2- 172.21.15.7:0/1492941828 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x563c37ed85e0 0x563c37efc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:08.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.102+0000 7f32e9ffb640 10 client.8706 ms_handle_connect on v2:172.21.15.7:6835/900729992 2024-04-25T10:03:08.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.102+0000 7f330a7fc640 1 --2- 172.21.15.7:0/1492941828 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x563c37ed85e0 0x563c37efc150 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd654d2115c33fa6 server_cookie=bfe9270f48650b06 in_seq=0 out_seq=0 2024-04-25T10:03:08.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.102+0000 7f32e9ffb640 1 -- 172.21.15.7:0/1492941828 <== mds.0 v2:172.21.15.7:6835/900729992 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x563c37e16630 con 0x563c37ed85e0 2024-04-25T10:03:08.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.102+0000 7f32e9ffb640 10 client.8706 handle_command_reply: tid=0 2024-04-25T10:03:08.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.102+0000 7f3313fe5740 1 client.8706 shutdown 2024-04-25T10:03:08.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.102+0000 7f3313fe5740 1 -- 172.21.15.7:0/1492941828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c37ed5510 msgr2=0x563c37f0d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:08.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.102+0000 7f3313fe5740 1 --2- 172.21.15.7:0/1492941828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c37ed5510 0x563c37f0d980 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00f5b0 tx=0x7f32fc004730 comp rx=0 tx=0).stop 2024-04-25T10:03:08.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.102+0000 7f3313fe5740 1 -- 172.21.15.7:0/1492941828 shutdown_connections 2024-04-25T10:03:08.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.102+0000 7f3313fe5740 1 --2- 172.21.15.7:0/1492941828 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563c37ef1470 0x563c37eac980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.102+0000 7f3313fe5740 1 --2- 172.21.15.7:0/1492941828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563c37ed8e00 0x563c37eac440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.102+0000 7f3313fe5740 1 --2- 172.21.15.7:0/1492941828 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x563c37ed85e0 0x563c37efc150 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.102+0000 7f3313fe5740 1 --2- 172.21.15.7:0/1492941828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c37ed5510 0x563c37f0d980 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.102+0000 7f32e9ffb640 0 client.8706 ms_handle_reset on v2:172.21.15.7:6835/900729992 2024-04-25T10:03:08.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.102+0000 7f3313fe5740 1 -- 172.21.15.7:0/1492941828 >> 172.21.15.7:0/1492941828 conn(0x563c37ea5770 msgr2=0x563c37ed79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:08.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.102+0000 7f3313fe5740 1 -- 172.21.15.7:0/1492941828 shutdown_connections 2024-04-25T10:03:08.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.102+0000 7f3313fe5740 1 -- 172.21.15.7:0/1492941828 wait complete. 2024-04-25T10:03:08.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.102+0000 7f3313fe5740 20 client.8706 trim_cache size 0 max 16384 2024-04-25T10:03:08.115 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:03:08.115 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T10:03:08.115 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-04-25T10:03:08.115 INFO:teuthology.orchestra.run.smithi007.stdout: "077d1cb0-638f-4029-bb13-036608f2d6e1": { 2024-04-25T10:03:08.116 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-04-25T10:03:08.116 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "077d1cb0-638f-4029-bb13-036608f2d6e1", 2024-04-25T10:03:08.116 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,repair" 2024-04-25T10:03:08.116 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:03:08.116 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:03:08.116 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:03:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.103+0000 7f33112e1640 1 -- 172.21.15.7:0/1463368842 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f32f806b4d0 msgr2=0x7f32f806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.103+0000 7f33112e1640 1 --2- 172.21.15.7:0/1463368842 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f32f806b4d0 0x7f32f806d990 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f32fc006fd0 tx=0x7f32fc008040 comp rx=0 tx=0).stop 2024-04-25T10:03:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.103+0000 7f33112e1640 1 -- 172.21.15.7:0/1463368842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f330c15bad0 msgr2=0x7f330c0ca7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.103+0000 7f33112e1640 1 --2- 172.21.15.7:0/1463368842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f330c15bad0 0x7f330c0ca7d0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f330400c700 tx=0x7f330400cbc0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.103+0000 7f33112e1640 1 -- 172.21.15.7:0/1463368842 shutdown_connections 2024-04-25T10:03:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.103+0000 7f33112e1640 1 --2- 172.21.15.7:0/1463368842 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f32f806b4d0 0x7f32f806d990 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.103+0000 7f33112e1640 1 --2- 172.21.15.7:0/1463368842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f330c15bad0 0x7f330c0ca7d0 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.103+0000 7f33112e1640 1 --2- 172.21.15.7:0/1463368842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f330c0cd210 0x7f330c0ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.103+0000 7f33112e1640 1 --2- 172.21.15.7:0/1463368842 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f330c099f30 0x7f330c157dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.103+0000 7f33112e1640 1 -- 172.21.15.7:0/1463368842 >> 172.21.15.7:0/1463368842 conn(0x7f330c0b3110 msgr2=0x7f330c0c52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:08.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.103+0000 7f33112e1640 1 -- 172.21.15.7:0/1463368842 shutdown_connections 2024-04-25T10:03:08.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.103+0000 7f33112e1640 1 -- 172.21.15.7:0/1463368842 wait complete. 2024-04-25T10:03:08.118 INFO:tasks.cephfs.filesystem:scrub status for tag:077d1cb0-638f-4029-bb13-036608f2d6e1 - {'path': '/', 'tag': '077d1cb0-638f-4029-bb13-036608f2d6e1', 'options': 'recursive,repair'} 2024-04-25T10:03:08.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:08.688+0000 7fba77fff640 1 -- 172.21.15.7:0/267178334 <== mon.0 v2:172.21.15.7:3300/0 7 ==== log(4 entries from seq 1 at 2024-04-25T10:03:07.953305+0000) v1 ==== 695+0+0 (secure 0 0 0) 0x7fba84089020 con 0x7fba900d3390 2024-04-25T10:03:08.694 INFO:teuthology.orchestra.run.smithi007.stdout: cluster: 2024-04-25T10:03:08.694 INFO:teuthology.orchestra.run.smithi007.stdout: id: c03d0745-5946-49c3-ad88-1165c5b68b4e 2024-04-25T10:03:08.694 INFO:teuthology.orchestra.run.smithi007.stdout: health: HEALTH_OK 2024-04-25T10:03:08.694 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:03:08.694 INFO:teuthology.orchestra.run.smithi007.stdout: services: 2024-04-25T10:03:08.694 INFO:teuthology.orchestra.run.smithi007.stdout: mon: 3 daemons, quorum a,b,c (age 9m) 2024-04-25T10:03:08.694 INFO:teuthology.orchestra.run.smithi007.stdout: mgr: y(active, since 9m), standbys: x 2024-04-25T10:03:08.695 INFO:teuthology.orchestra.run.smithi007.stdout: mds: 1/1 daemons up, 3 standby 2024-04-25T10:03:08.695 INFO:teuthology.orchestra.run.smithi007.stdout: osd: 8 osds: 8 up (since 8m), 8 in (since 9m) 2024-04-25T10:03:08.695 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:03:08.695 INFO:teuthology.orchestra.run.smithi007.stdout: data: 2024-04-25T10:03:08.695 INFO:teuthology.orchestra.run.smithi007.stdout: volumes: 1/1 healthy 2024-04-25T10:03:08.695 INFO:teuthology.orchestra.run.smithi007.stdout: pools: 3 pools, 97 pgs 2024-04-25T10:03:08.695 INFO:teuthology.orchestra.run.smithi007.stdout: objects: 30 objects, 19 MiB 2024-04-25T10:03:08.695 INFO:teuthology.orchestra.run.smithi007.stdout: usage: 273 MiB used, 720 GiB / 720 GiB avail 2024-04-25T10:03:08.695 INFO:teuthology.orchestra.run.smithi007.stdout: pgs: 97 active+clean 2024-04-25T10:03:08.695 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:03:08.695 INFO:teuthology.orchestra.run.smithi007.stdout: io: 2024-04-25T10:03:08.695 INFO:teuthology.orchestra.run.smithi007.stdout: client: 85 B/s rd, 1.5 MiB/s wr, 0 op/s rd, 4 op/s wr 2024-04-25T10:03:08.695 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:03:08.695 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:03:08.696 INFO:teuthology.orchestra.run.smithi007.stdout:2024-04-25T10:03:07.953305+0000 mds.a [INF] scrub queued for path: / 2024-04-25T10:03:08.696 INFO:teuthology.orchestra.run.smithi007.stdout:2024-04-25T10:03:07.953308+0000 mds.a [INF] scrub summary: idle+waiting paths [/] 2024-04-25T10:03:08.696 INFO:teuthology.orchestra.run.smithi007.stdout:2024-04-25T10:03:07.953312+0000 mds.a [INF] scrub summary: active paths [/] 2024-04-25T10:03:08.696 INFO:teuthology.orchestra.run.smithi007.stdout:2024-04-25T10:03:07.954390+0000 mds.a [INF] scrub summary: idle+waiting paths [/] 2024-04-25T10:03:09.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:09.690+0000 7fba77fff640 1 -- 172.21.15.7:0/267178334 <== mon.0 v2:172.21.15.7:3300/0 8 ==== log(2 entries from seq 1157 at 2024-04-25T10:03:09.515464+0000) v1 ==== 603+0+0 (secure 0 0 0) 0x7fba8408b000 con 0x7fba900d3390 2024-04-25T10:03:10.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:10.708+0000 7fba77fff640 1 -- 172.21.15.7:0/267178334 <== mon.0 v2:172.21.15.7:3300/0 9 ==== log(2 entries from seq 1159 at 2024-04-25T10:03:09.700855+0000) v1 ==== 607+0+0 (secure 0 0 0) 0x7fba84009360 con 0x7fba900d3390 2024-04-25T10:03:11.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:11.709+0000 7fba77fff640 1 -- 172.21.15.7:0/267178334 <== mon.0 v2:172.21.15.7:3300/0 10 ==== log(1 entries from seq 5 at 2024-04-25T10:03:10.553863+0000) v1 ==== 189+0+0 (secure 0 0 0) 0x7fba84057180 con 0x7fba900d3390 2024-04-25T10:03:11.714 INFO:teuthology.orchestra.run.smithi007.stdout:2024-04-25T10:03:10.553863+0000 mds.a [INF] scrub summary: idle 2024-04-25T10:03:27.267 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:03:27.271 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:03:38.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:38.120 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-25T10:03:38.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.232+0000 7f81b9fe0640 1 Processor -- start 2024-04-25T10:03:38.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.232+0000 7f81b9fe0640 1 -- start start 2024-04-25T10:03:38.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.233+0000 7f81b9fe0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f81b41475e0 0x7f81b406dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.233+0000 7f81b9fe0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81b406e500 0x7f81b4071550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.233+0000 7f81b9fe0640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81b406ea60 con 0x7f81b4071a90 2024-04-25T10:03:38.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.233+0000 7f81b9fe0640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81b40acd40 con 0x7f81b41475e0 2024-04-25T10:03:38.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.233+0000 7f81b9fe0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b406ed40 con 0x7f81b406e500 2024-04-25T10:03:38.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.233+0000 7f81b3fff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f81b4071a90 0x7f81b40b30c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45360/0 (socket says 172.21.15.7:45360) 2024-04-25T10:03:38.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.233+0000 7f81b3fff640 1 -- 172.21.15.7:0/131569050 learned_addr learned my addr 172.21.15.7:0/131569050 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:03:38.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.233+0000 7f81b2ffd640 1 --2- 172.21.15.7:0/131569050 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81b406e500 0x7f81b4071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.233+0000 7f81b37fe640 1 --2- 172.21.15.7:0/131569050 >> v2:172.21.15.55:3300/0 conn(0x7f81b41475e0 0x7f81b406dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.233+0000 7f81b27fc640 1 -- 172.21.15.7:0/131569050 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4219298461 0 0) 0x7f81b406ea60 con 0x7f81b4071a90 2024-04-25T10:03:38.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.233+0000 7f81b27fc640 1 -- 172.21.15.7:0/131569050 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f819c003520 con 0x7f81b4071a90 2024-04-25T10:03:38.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.234+0000 7f81b2ffd640 1 -- 172.21.15.7:0/131569050 >> v2:172.21.15.55:3300/0 conn(0x7f81b41475e0 msgr2=0x7f81b406dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:38.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.234+0000 7f81b2ffd640 1 --2- 172.21.15.7:0/131569050 >> v2:172.21.15.55:3300/0 conn(0x7f81b41475e0 0x7f81b406dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.234+0000 7f81b2ffd640 1 -- 172.21.15.7:0/131569050 >> v1:172.21.15.7:6789/0 conn(0x7f81b4071a90 legacy=0x7f81b40b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.234+0000 7f81b2ffd640 1 -- 172.21.15.7:0/131569050 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b406f020 con 0x7f81b406e500 2024-04-25T10:03:38.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.234+0000 7f81b2ffd640 1 --2- 172.21.15.7:0/131569050 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81b406e500 0x7f81b4071550 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f81a80097a0 tx=0x7f81a802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e4414b07645a366 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:38.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.235+0000 7f81b27fc640 1 -- 172.21.15.7:0/131569050 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a8037070 con 0x7f81b406e500 2024-04-25T10:03:38.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.235+0000 7f81b27fc640 1 -- 172.21.15.7:0/131569050 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a8032440 con 0x7f81b406e500 2024-04-25T10:03:38.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.235+0000 7f81b27fc640 1 -- 172.21.15.7:0/131569050 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a8032810 con 0x7f81b406e500 2024-04-25T10:03:38.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.235+0000 7f81b9fe0640 1 -- 172.21.15.7:0/131569050 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81b406e500 msgr2=0x7f81b4071550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.235+0000 7f81b9fe0640 1 --2- 172.21.15.7:0/131569050 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81b406e500 0x7f81b4071550 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f81a80097a0 tx=0x7f81a802a180 comp rx=0 tx=0).stop 2024-04-25T10:03:38.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.235+0000 7f81b9fe0640 1 -- 172.21.15.7:0/131569050 shutdown_connections 2024-04-25T10:03:38.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.235+0000 7f81b9fe0640 1 --2- 172.21.15.7:0/131569050 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81b406e500 0x7f81b4071550 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.235+0000 7f81b9fe0640 1 --2- 172.21.15.7:0/131569050 >> v2:172.21.15.55:3300/0 conn(0x7f81b41475e0 0x7f81b406dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.235+0000 7f81b9fe0640 1 -- 172.21.15.7:0/131569050 >> 172.21.15.7:0/131569050 conn(0x7f81b40b16d0 msgr2=0x7f81b40b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:38.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.235+0000 7f81b9fe0640 1 -- 172.21.15.7:0/131569050 shutdown_connections 2024-04-25T10:03:38.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.235+0000 7f81b9fe0640 1 -- 172.21.15.7:0/131569050 wait complete. 2024-04-25T10:03:38.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.236+0000 7f81b9fe0640 1 Processor -- start 2024-04-25T10:03:38.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.237+0000 7f81b9fe0640 1 -- start start 2024-04-25T10:03:38.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.237+0000 7f81b9fe0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81b406e500 0x7f81b41f6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.237+0000 7f81b9fe0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81b4071a90 0x7f81b40c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.237+0000 7f81b9fe0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81b41475e0 0x7f81b41456c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.237+0000 7f81b9fe0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b40ae1e0 con 0x7f81b41475e0 2024-04-25T10:03:38.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.237+0000 7f81b9fe0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b40724c0 con 0x7f81b4071a90 2024-04-25T10:03:38.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.237+0000 7f81b9fe0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b40ae360 con 0x7f81b406e500 2024-04-25T10:03:38.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.238+0000 7f81b3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81b41475e0 0x7f81b41456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.238+0000 7f81b3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81b41475e0 0x7f81b41456c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43480/0 (socket says 172.21.15.7:43480) 2024-04-25T10:03:38.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.238+0000 7f81b3fff640 1 -- 172.21.15.7:0/3421532547 learned_addr learned my addr 172.21.15.7:0/3421532547 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:38.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.238+0000 7f81b37fe640 1 --2- 172.21.15.7:0/3421532547 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81b406e500 0x7f81b41f6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.238+0000 7f81b2ffd640 1 --2- 172.21.15.7:0/3421532547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81b4071a90 0x7f81b40c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.238+0000 7f81b3fff640 1 -- 172.21.15.7:0/3421532547 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81b406e500 msgr2=0x7f81b41f6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.238+0000 7f81b3fff640 1 --2- 172.21.15.7:0/3421532547 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81b406e500 0x7f81b41f6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.238+0000 7f81b3fff640 1 -- 172.21.15.7:0/3421532547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81b4071a90 msgr2=0x7f81b40c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.238+0000 7f81b3fff640 1 --2- 172.21.15.7:0/3421532547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81b4071a90 0x7f81b40c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.238+0000 7f81b3fff640 1 -- 172.21.15.7:0/3421532547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b40c62b0 con 0x7f81b41475e0 2024-04-25T10:03:38.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.238+0000 7f81b2ffd640 1 --2- 172.21.15.7:0/3421532547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81b4071a90 0x7f81b40c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:38.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.238+0000 7f81b3fff640 1 --2- 172.21.15.7:0/3421532547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81b41475e0 0x7f81b41456c0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f81ac00cb10 tx=0x7f81ac00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:38.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.238+0000 7f819bfff640 1 -- 172.21.15.7:0/3421532547 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac017070 con 0x7f81b41475e0 2024-04-25T10:03:38.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.238+0000 7f819bfff640 1 -- 172.21.15.7:0/3421532547 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ac00ac70 con 0x7f81b41475e0 2024-04-25T10:03:38.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.238+0000 7f81b9fe0640 1 -- 172.21.15.7:0/3421532547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b40c6590 con 0x7f81b41475e0 2024-04-25T10:03:38.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.238+0000 7f819bfff640 1 -- 172.21.15.7:0/3421532547 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac00ae60 con 0x7f81b41475e0 2024-04-25T10:03:38.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.238+0000 7f81b9fe0640 1 -- 172.21.15.7:0/3421532547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b40c6b50 con 0x7f81b41475e0 2024-04-25T10:03:38.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.240+0000 7f819bfff640 1 -- 172.21.15.7:0/3421532547 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f81ac01a070 con 0x7f81b41475e0 2024-04-25T10:03:38.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.240+0000 7f819bfff640 1 --2- 172.21.15.7:0/3421532547 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f81a006b4d0 0x7f81a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.240+0000 7f819bfff640 1 -- 172.21.15.7:0/3421532547 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f81ac08a190 con 0x7f81b41475e0 2024-04-25T10:03:38.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.240+0000 7f81b37fe640 1 --2- 172.21.15.7:0/3421532547 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f81a006b4d0 0x7f81a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.241+0000 7f81b37fe640 1 --2- 172.21.15.7:0/3421532547 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f81a006b4d0 0x7f81a006d990 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f81b41450d0 tx=0x7f81a4009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:38.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.241+0000 7f81bcdc4740 1 Processor -- start 2024-04-25T10:03:38.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.241+0000 7f81bcdc4740 1 -- start start 2024-04-25T10:03:38.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.242+0000 7f81bcdc4740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578d0597b10 0x5578d059a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.242+0000 7f81bcdc4740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5578d0597ef0 0x5578d059a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.242+0000 7f81bcdc4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578d056a770 0x5578d056df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.242+0000 7f81bcdc4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578d04d3da0 con 0x5578d056a770 2024-04-25T10:03:38.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.242+0000 7f81bcdc4740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578d047cb80 con 0x5578d0597b10 2024-04-25T10:03:38.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.242+0000 7f81bcdc4740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5578d04cfe40 con 0x5578d0597ef0 2024-04-25T10:03:38.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.242+0000 7f81b3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578d056a770 0x5578d056df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.242+0000 7f81b3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578d056a770 0x5578d056df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43496/0 (socket says 172.21.15.7:43496) 2024-04-25T10:03:38.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.242+0000 7f81b3fff640 1 -- 172.21.15.7:0/146437415 learned_addr learned my addr 172.21.15.7:0/146437415 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:38.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.243+0000 7f81b37fe640 1 --2- 172.21.15.7:0/146437415 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578d0597b10 0x5578d059a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.243+0000 7f81b2ffd640 1 --2- 172.21.15.7:0/146437415 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5578d0597ef0 0x5578d059a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.243+0000 7f81b3fff640 1 -- 172.21.15.7:0/146437415 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5578d0597ef0 msgr2=0x5578d059a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:38.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.243+0000 7f81b3fff640 1 --2- 172.21.15.7:0/146437415 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5578d0597ef0 0x5578d059a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.243+0000 7f81b3fff640 1 -- 172.21.15.7:0/146437415 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578d0597b10 msgr2=0x5578d059a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:38.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.243+0000 7f81b3fff640 1 --2- 172.21.15.7:0/146437415 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578d0597b10 0x5578d059a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.243+0000 7f81b3fff640 1 -- 172.21.15.7:0/146437415 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578d0486f10 con 0x5578d056a770 2024-04-25T10:03:38.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.243+0000 7f81b3fff640 1 --2- 172.21.15.7:0/146437415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578d056a770 0x5578d056df80 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f81ac0586f0 tx=0x7f81ac05c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6138a882189ce78c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:38.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.243+0000 7f81997fa640 1 -- 172.21.15.7:0/146437415 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac054dd0 con 0x5578d056a770 2024-04-25T10:03:38.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.243+0000 7f81997fa640 1 -- 172.21.15.7:0/146437415 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ac060930 con 0x5578d056a770 2024-04-25T10:03:38.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.243+0000 7f81997fa640 1 -- 172.21.15.7:0/146437415 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac057bb0 con 0x5578d056a770 2024-04-25T10:03:38.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.244+0000 7f81bcdc4740 1 -- 172.21.15.7:0/146437415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578d056a770 msgr2=0x5578d056df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.244+0000 7f81bcdc4740 1 --2- 172.21.15.7:0/146437415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578d056a770 0x5578d056df80 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f81ac0586f0 tx=0x7f81ac05c940 comp rx=0 tx=0).stop 2024-04-25T10:03:38.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.244+0000 7f81bcdc4740 1 -- 172.21.15.7:0/146437415 shutdown_connections 2024-04-25T10:03:38.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.244+0000 7f81bcdc4740 1 --2- 172.21.15.7:0/146437415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578d056a770 0x5578d056df80 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.244+0000 7f81bcdc4740 1 --2- 172.21.15.7:0/146437415 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5578d0597ef0 0x5578d059a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.244+0000 7f81bcdc4740 1 --2- 172.21.15.7:0/146437415 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578d0597b10 0x5578d059a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.244+0000 7f81bcdc4740 1 -- 172.21.15.7:0/146437415 >> 172.21.15.7:0/146437415 conn(0x5578d056c9e0 msgr2=0x5578d05b5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:38.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.244+0000 7f81bcdc4740 1 -- 172.21.15.7:0/146437415 shutdown_connections 2024-04-25T10:03:38.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.244+0000 7f81bcdc4740 1 -- 172.21.15.7:0/146437415 wait complete. 2024-04-25T10:03:38.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.244+0000 7f81bcdc4740 1 -- start start 2024-04-25T10:03:38.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.245+0000 7f81bcdc4740 1 Processor -- start 2024-04-25T10:03:38.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.245+0000 7f81bcdc4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578d0597b10 0x5578d058ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.245+0000 7f81bcdc4740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5578d0597ef0 0x5578d0591e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.245+0000 7f81bcdc4740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578d05b7cd0 0x5578d05b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.245+0000 7f81bcdc4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578d056fb90 con 0x5578d0597b10 2024-04-25T10:03:38.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.245+0000 7f81bcdc4740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578d04724b0 con 0x5578d05b7cd0 2024-04-25T10:03:38.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.245+0000 7f81bcdc4740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5578d056fe70 con 0x5578d0597ef0 2024-04-25T10:03:38.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.245+0000 7f81bcdc4740 10 client.0 _ll_register_callbacks cb 0x5578d04b2180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:03:38.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.245+0000 7f81b37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578d0597b10 0x5578d058ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.245+0000 7f81b37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578d0597b10 0x5578d058ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43510/0 (socket says 172.21.15.7:43510) 2024-04-25T10:03:38.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.245+0000 7f81b37fe640 1 -- 172.21.15.7:0/1307497268 learned_addr learned my addr 172.21.15.7:0/1307497268 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:38.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.246+0000 7f81b37fe640 1 -- 172.21.15.7:0/1307497268 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5578d0597ef0 msgr2=0x5578d0591e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:38.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.246+0000 7f81b37fe640 1 --2- 172.21.15.7:0/1307497268 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5578d0597ef0 0x5578d0591e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.246+0000 7f81b37fe640 1 -- 172.21.15.7:0/1307497268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578d05b7cd0 msgr2=0x5578d05b8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:38.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.246+0000 7f81b37fe640 1 --2- 172.21.15.7:0/1307497268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578d05b7cd0 0x5578d05b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.246+0000 7f81b37fe640 1 -- 172.21.15.7:0/1307497268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5578d02b27d0 con 0x5578d0597b10 2024-04-25T10:03:38.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.246+0000 7f81b37fe640 1 --2- 172.21.15.7:0/1307497268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578d0597b10 0x5578d058ee30 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f81a4003640 tx=0x7f81a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9cf4a96c919a06f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:38.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.246+0000 7f81927fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:03:38.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.246+0000 7f81927fc640 1 -- 172.21.15.7:0/1307497268 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a4027070 con 0x5578d0597b10 2024-04-25T10:03:38.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.246+0000 7f81927fc640 1 -- 172.21.15.7:0/1307497268 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f81a4023480 con 0x5578d0597b10 2024-04-25T10:03:38.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.246+0000 7f81bcdc4740 1 -- 172.21.15.7:0/1307497268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f81ac060930 con 0x5578d0597b10 2024-04-25T10:03:38.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.246+0000 7f81927fc640 1 -- 172.21.15.7:0/1307497268 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81a4023680 con 0x5578d0597b10 2024-04-25T10:03:38.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.246+0000 7f81bcdc4740 10 client.8718 fetch_fsmap learned FSMap version 73 2024-04-25T10:03:38.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.246+0000 7f81bcdc4740 1 -- 172.21.15.7:0/1307497268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x5578d01e83f0 con 0x5578d0597b10 2024-04-25T10:03:38.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.246+0000 7f81927fc640 1 -- 172.21.15.7:0/1307497268 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ac060930 con 0x5578d0597b10 2024-04-25T10:03:38.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.246+0000 7f81927fc640 1 -- 172.21.15.7:0/1307497268 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 73) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f81a4035080 con 0x5578d0597b10 2024-04-25T10:03:38.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.247+0000 7f81bcdc4740 10 client.8718 fetch_fsmap finished waiting for FSMap version 73 2024-04-25T10:03:38.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.247+0000 7f81bcdc4740 10 client.8718 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T10:03:38.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.247+0000 7f81bcdc4740 20 client.8718 populate_metadata read hostname 'smithi007' 2024-04-25T10:03:38.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.247+0000 7f81bcdc4740 1 --2- 172.21.15.7:0/1307497268 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x5578d0593b00 0x5578d0593f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.247+0000 7f81bcdc4740 4 client.8718 mds_command: new command op to 8364 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:03:38.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.247+0000 7f81bcdc4740 1 -- 172.21.15.7:0/1307497268 --> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5578d04e12e0 con 0x5578d0593b00 2024-04-25T10:03:38.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.247+0000 7f81b2ffd640 1 --2- 172.21.15.7:0/1307497268 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x5578d0593b00 0x5578d0593f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.247+0000 7f81b2ffd640 1 --2- 172.21.15.7:0/1307497268 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x5578d0593b00 0x5578d0593f80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc151964aa1bdae8 server_cookie=6e4eaf8a26941548 in_seq=0 out_seq=0 2024-04-25T10:03:38.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.247+0000 7f81927fc640 10 client.8718 ms_handle_connect on v2:172.21.15.7:6835/900729992 2024-04-25T10:03:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.248+0000 7f81927fc640 1 -- 172.21.15.7:0/1307497268 <== mds.0 v2:172.21.15.7:6835/900729992 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5578d04e12e0 con 0x5578d0593b00 2024-04-25T10:03:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.248+0000 7f81927fc640 10 client.8718 handle_command_reply: tid=0 2024-04-25T10:03:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.248+0000 7f81bcdc4740 1 client.8718 shutdown 2024-04-25T10:03:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.248+0000 7f81bcdc4740 1 -- 172.21.15.7:0/1307497268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578d0597b10 msgr2=0x5578d058ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.248+0000 7f81bcdc4740 1 --2- 172.21.15.7:0/1307497268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578d0597b10 0x5578d058ee30 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f81a4003640 tx=0x7f81a40046c0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.248+0000 7f81bcdc4740 1 -- 172.21.15.7:0/1307497268 shutdown_connections 2024-04-25T10:03:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.248+0000 7f81bcdc4740 1 --2- 172.21.15.7:0/1307497268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578d05b7cd0 0x5578d05b8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.248+0000 7f81bcdc4740 1 --2- 172.21.15.7:0/1307497268 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5578d0597ef0 0x5578d0591e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.248+0000 7f81bcdc4740 1 --2- 172.21.15.7:0/1307497268 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x5578d0593b00 0x5578d0593f80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.248+0000 7f81bcdc4740 1 --2- 172.21.15.7:0/1307497268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578d0597b10 0x5578d058ee30 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.248+0000 7f81927fc640 0 client.8718 ms_handle_reset on v2:172.21.15.7:6835/900729992 2024-04-25T10:03:38.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.248+0000 7f81bcdc4740 1 -- 172.21.15.7:0/1307497268 >> 172.21.15.7:0/1307497268 conn(0x5578d056a770 msgr2=0x5578d0596190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:38.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.248+0000 7f81bcdc4740 1 -- 172.21.15.7:0/1307497268 shutdown_connections 2024-04-25T10:03:38.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.248+0000 7f81bcdc4740 1 -- 172.21.15.7:0/1307497268 wait complete. 2024-04-25T10:03:38.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.248+0000 7f81bcdc4740 20 client.8718 trim_cache size 0 max 16384 2024-04-25T10:03:38.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.263+0000 7f81bcdc4740 1 Processor -- start 2024-04-25T10:03:38.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.264+0000 7f81bcdc4740 1 -- start start 2024-04-25T10:03:38.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.264+0000 7f81bcdc4740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578d0597b10 0x5578d056ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.264+0000 7f81bcdc4740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5578d0597ef0 0x5578d056b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.264+0000 7f81bcdc4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578d05b7cd0 0x5578d0569600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.264+0000 7f81bcdc4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b42001e0 con 0x5578d05b7cd0 2024-04-25T10:03:38.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.264+0000 7f81bcdc4740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b41ff3c0 con 0x5578d0597b10 2024-04-25T10:03:38.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.264+0000 7f81bcdc4740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b41f4520 con 0x5578d0597ef0 2024-04-25T10:03:38.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.264+0000 7f81b3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578d05b7cd0 0x5578d0569600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.265+0000 7f81b3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578d05b7cd0 0x5578d0569600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43522/0 (socket says 172.21.15.7:43522) 2024-04-25T10:03:38.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.265+0000 7f81b3fff640 1 -- 172.21.15.7:0/1981340949 learned_addr learned my addr 172.21.15.7:0/1981340949 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:38.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.265+0000 7f81b2ffd640 1 --2- 172.21.15.7:0/1981340949 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5578d0597ef0 0x5578d056b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.265+0000 7f81b37fe640 1 --2- 172.21.15.7:0/1981340949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578d0597b10 0x5578d056ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.265+0000 7f81b3fff640 1 -- 172.21.15.7:0/1981340949 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5578d0597ef0 msgr2=0x5578d056b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:38.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.265+0000 7f81b3fff640 1 --2- 172.21.15.7:0/1981340949 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5578d0597ef0 0x5578d056b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.265+0000 7f81b3fff640 1 -- 172.21.15.7:0/1981340949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578d0597b10 msgr2=0x5578d056ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:38.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.265+0000 7f81b3fff640 1 --2- 172.21.15.7:0/1981340949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578d0597b10 0x5578d056ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.265+0000 7f81b3fff640 1 -- 172.21.15.7:0/1981340949 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578d01a80f0 con 0x5578d05b7cd0 2024-04-25T10:03:38.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.265+0000 7f81b37fe640 1 --2- 172.21.15.7:0/1981340949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578d0597b10 0x5578d056ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:38.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.265+0000 7f81b3fff640 1 --2- 172.21.15.7:0/1981340949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578d05b7cd0 0x5578d0569600 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f81ac058460 tx=0x7f81ac014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a291633d63dc5fd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:38.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.265+0000 7f8198ff9640 1 -- 172.21.15.7:0/1981340949 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac085070 con 0x5578d05b7cd0 2024-04-25T10:03:38.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.265+0000 7f8198ff9640 1 -- 172.21.15.7:0/1981340949 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ac070050 con 0x5578d05b7cd0 2024-04-25T10:03:38.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.265+0000 7f8198ff9640 1 -- 172.21.15.7:0/1981340949 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac0582a0 con 0x5578d05b7cd0 2024-04-25T10:03:38.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.266+0000 7f81bcdc4740 1 -- 172.21.15.7:0/1981340949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578d05b7cd0 msgr2=0x5578d0569600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.266+0000 7f81bcdc4740 1 --2- 172.21.15.7:0/1981340949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578d05b7cd0 0x5578d0569600 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f81ac058460 tx=0x7f81ac014040 comp rx=0 tx=0).stop 2024-04-25T10:03:38.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.266+0000 7f81bcdc4740 1 -- 172.21.15.7:0/1981340949 shutdown_connections 2024-04-25T10:03:38.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.266+0000 7f81bcdc4740 1 --2- 172.21.15.7:0/1981340949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578d05b7cd0 0x5578d0569600 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.266+0000 7f81bcdc4740 1 --2- 172.21.15.7:0/1981340949 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5578d0597ef0 0x5578d056b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.266+0000 7f81bcdc4740 1 --2- 172.21.15.7:0/1981340949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578d0597b10 0x5578d056ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.266+0000 7f81bcdc4740 1 -- 172.21.15.7:0/1981340949 >> 172.21.15.7:0/1981340949 conn(0x5578d056a770 msgr2=0x5578d058ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:38.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.266+0000 7f81bcdc4740 1 -- 172.21.15.7:0/1981340949 shutdown_connections 2024-04-25T10:03:38.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.266+0000 7f81bcdc4740 1 -- 172.21.15.7:0/1981340949 wait complete. 2024-04-25T10:03:38.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.266+0000 7f81bcdc4740 1 -- start start 2024-04-25T10:03:38.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.266+0000 7f81bcdc4740 1 Processor -- start 2024-04-25T10:03:38.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.267+0000 7f81bcdc4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578d0597b10 0x5578d056ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.267+0000 7f81bcdc4740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5578d0597ef0 0x5578d056b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.267+0000 7f81bcdc4740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578d05b7cd0 0x5578d05c3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.267+0000 7f81bcdc4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578d0593300 con 0x5578d0597b10 2024-04-25T10:03:38.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.267+0000 7f81bcdc4740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b41fee60 con 0x5578d05b7cd0 2024-04-25T10:03:38.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.267+0000 7f81bcdc4740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5578d056d000 con 0x5578d0597ef0 2024-04-25T10:03:38.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.267+0000 7f81bcdc4740 10 client.0 _ll_register_callbacks cb 0x7f81ac054a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:03:38.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.267+0000 7f81b37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578d0597b10 0x5578d056ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.267+0000 7f81b37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578d0597b10 0x5578d056ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43526/0 (socket says 172.21.15.7:43526) 2024-04-25T10:03:38.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.267+0000 7f81b37fe640 1 -- 172.21.15.7:0/1317966474 learned_addr learned my addr 172.21.15.7:0/1317966474 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:38.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.268+0000 7f81b2ffd640 1 --2- 172.21.15.7:0/1317966474 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5578d0597ef0 0x5578d056b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.268+0000 7f81b3fff640 1 --2- 172.21.15.7:0/1317966474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578d05b7cd0 0x5578d05c3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.268+0000 7f81b37fe640 1 -- 172.21.15.7:0/1317966474 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5578d0597ef0 msgr2=0x5578d056b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:38.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.268+0000 7f81b37fe640 1 --2- 172.21.15.7:0/1317966474 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5578d0597ef0 0x5578d056b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.268+0000 7f81b37fe640 1 -- 172.21.15.7:0/1317966474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578d05b7cd0 msgr2=0x5578d05c3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:38.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.268+0000 7f81b37fe640 1 --2- 172.21.15.7:0/1317966474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578d05b7cd0 0x5578d05c3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.268+0000 7f81b37fe640 1 -- 172.21.15.7:0/1317966474 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5578d059dca0 con 0x5578d0597b10 2024-04-25T10:03:38.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.268+0000 7f81b37fe640 1 --2- 172.21.15.7:0/1317966474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578d0597b10 0x5578d056ac50 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f81a4011730 tx=0x7f81a4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bcb92b494ed209d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:38.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.268+0000 7f81927fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:03:38.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.268+0000 7f81927fc640 1 -- 172.21.15.7:0/1317966474 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a403c030 con 0x5578d0597b10 2024-04-25T10:03:38.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.268+0000 7f81927fc640 1 -- 172.21.15.7:0/1317966474 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f81a4023480 con 0x5578d0597b10 2024-04-25T10:03:38.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.268+0000 7f81bcdc4740 1 -- 172.21.15.7:0/1317966474 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f81ac070050 con 0x5578d0597b10 2024-04-25T10:03:38.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.268+0000 7f81927fc640 1 -- 172.21.15.7:0/1317966474 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81a4027040 con 0x5578d0597b10 2024-04-25T10:03:38.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.268+0000 7f81bcdc4740 10 client.8724 fetch_fsmap learned FSMap version 73 2024-04-25T10:03:38.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.268+0000 7f81bcdc4740 1 -- 172.21.15.7:0/1317966474 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x5578d059d4a0 con 0x5578d0597b10 2024-04-25T10:03:38.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.268+0000 7f81927fc640 1 -- 172.21.15.7:0/1317966474 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ac070050 con 0x5578d0597b10 2024-04-25T10:03:38.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.268+0000 7f81927fc640 1 -- 172.21.15.7:0/1317966474 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 73) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f81a404b080 con 0x5578d0597b10 2024-04-25T10:03:38.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.268+0000 7f81bcdc4740 10 client.8724 fetch_fsmap finished waiting for FSMap version 73 2024-04-25T10:03:38.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.268+0000 7f81bcdc4740 10 client.8724 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T10:03:38.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.268+0000 7f81bcdc4740 20 client.8724 populate_metadata read hostname 'smithi007' 2024-04-25T10:03:38.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.268+0000 7f81bcdc4740 1 --2- 172.21.15.7:0/1317966474 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x5578d0605e50 0x5578d05c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.268+0000 7f81bcdc4740 4 client.8724 mds_command: new command op to 8364 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T10:03:38.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.268+0000 7f81bcdc4740 1 -- 172.21.15.7:0/1317966474 --> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5578d04db630 con 0x5578d0605e50 2024-04-25T10:03:38.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.269+0000 7f81b2ffd640 1 --2- 172.21.15.7:0/1317966474 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x5578d0605e50 0x5578d05c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.269+0000 7f81927fc640 10 client.8724 ms_handle_connect on v2:172.21.15.7:6835/900729992 2024-04-25T10:03:38.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.269+0000 7f81b2ffd640 1 --2- 172.21.15.7:0/1317966474 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x5578d0605e50 0x5578d05c41b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dd1a99de86741e9 server_cookie=1f6e0135606b1bdb in_seq=0 out_seq=0 2024-04-25T10:03:38.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.269+0000 7f81927fc640 1 -- 172.21.15.7:0/1317966474 <== mds.0 v2:172.21.15.7:6835/900729992 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5578d04db630 con 0x5578d0605e50 2024-04-25T10:03:38.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.269+0000 7f81927fc640 10 client.8724 handle_command_reply: tid=0 2024-04-25T10:03:38.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.269+0000 7f81bcdc4740 1 client.8724 shutdown 2024-04-25T10:03:38.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.269+0000 7f81bcdc4740 1 -- 172.21.15.7:0/1317966474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578d0597b10 msgr2=0x5578d056ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.269+0000 7f81bcdc4740 1 --2- 172.21.15.7:0/1317966474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578d0597b10 0x5578d056ac50 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f81a4011730 tx=0x7f81a4019000 comp rx=0 tx=0).stop 2024-04-25T10:03:38.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.269+0000 7f81bcdc4740 1 -- 172.21.15.7:0/1317966474 shutdown_connections 2024-04-25T10:03:38.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.269+0000 7f81bcdc4740 1 --2- 172.21.15.7:0/1317966474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578d05b7cd0 0x5578d05c3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.269+0000 7f81bcdc4740 1 --2- 172.21.15.7:0/1317966474 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5578d0597ef0 0x5578d056b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.269+0000 7f81bcdc4740 1 --2- 172.21.15.7:0/1317966474 >> [v2:172.21.15.7:6835/900729992,v1:172.21.15.7:6837/900729992] conn(0x5578d0605e50 0x5578d05c41b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.269+0000 7f81bcdc4740 1 --2- 172.21.15.7:0/1317966474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578d0597b10 0x5578d056ac50 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.269+0000 7f81927fc640 0 client.8724 ms_handle_reset on v2:172.21.15.7:6835/900729992 2024-04-25T10:03:38.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.269+0000 7f81bcdc4740 1 -- 172.21.15.7:0/1317966474 >> 172.21.15.7:0/1317966474 conn(0x5578d056a770 msgr2=0x5578d05b5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:38.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.269+0000 7f81bcdc4740 1 -- 172.21.15.7:0/1317966474 shutdown_connections 2024-04-25T10:03:38.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.269+0000 7f81bcdc4740 1 -- 172.21.15.7:0/1317966474 wait complete. 2024-04-25T10:03:38.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.269+0000 7f81bcdc4740 20 client.8724 trim_cache size 0 max 16384 2024-04-25T10:03:38.281 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:03:38.281 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-04-25T10:03:38.281 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-04-25T10:03:38.282 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:03:38.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.270+0000 7f81b9fe0640 1 -- 172.21.15.7:0/3421532547 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f81a006b4d0 msgr2=0x7f81a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.270+0000 7f81b9fe0640 1 --2- 172.21.15.7:0/3421532547 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f81a006b4d0 0x7f81a006d990 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f81b41450d0 tx=0x7f81a4009190 comp rx=0 tx=0).stop 2024-04-25T10:03:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.270+0000 7f81b9fe0640 1 -- 172.21.15.7:0/3421532547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81b41475e0 msgr2=0x7f81b41456c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.270+0000 7f81b9fe0640 1 --2- 172.21.15.7:0/3421532547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81b41475e0 0x7f81b41456c0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f81ac00cb10 tx=0x7f81ac00a060 comp rx=0 tx=0).stop 2024-04-25T10:03:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.270+0000 7f81b9fe0640 1 -- 172.21.15.7:0/3421532547 shutdown_connections 2024-04-25T10:03:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.270+0000 7f81b9fe0640 1 --2- 172.21.15.7:0/3421532547 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f81a006b4d0 0x7f81a006d990 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.270+0000 7f81b9fe0640 1 --2- 172.21.15.7:0/3421532547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f81b41475e0 0x7f81b41456c0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.270+0000 7f81b9fe0640 1 --2- 172.21.15.7:0/3421532547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81b4071a90 0x7f81b40c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.270+0000 7f81b9fe0640 1 --2- 172.21.15.7:0/3421532547 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81b406e500 0x7f81b41f6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.270+0000 7f81b9fe0640 1 -- 172.21.15.7:0/3421532547 >> 172.21.15.7:0/3421532547 conn(0x7f81b40b16d0 msgr2=0x7f81b40ad960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.270+0000 7f81b9fe0640 1 -- 172.21.15.7:0/3421532547 shutdown_connections 2024-04-25T10:03:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.270+0000 7f81b9fe0640 1 -- 172.21.15.7:0/3421532547 wait complete. 2024-04-25T10:03:38.286 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T10:03:38.387 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T10:03:38.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.485+0000 7fc1ab4fc640 1 Processor -- start 2024-04-25T10:03:38.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.485+0000 7fc1ab4fc640 1 -- start start 2024-04-25T10:03:38.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.486+0000 7fc1ab4fc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc1a41472c0 0x7fc1a40cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.486+0000 7fc1ab4fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc1a40ced80 0x7fc1a40cb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.486+0000 7fc1ab4fc640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1a40c9f90 con 0x7fc1a40cad50 2024-04-25T10:03:38.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.486+0000 7fc1ab4fc640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1a40ca270 con 0x7fc1a40ced80 2024-04-25T10:03:38.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.486+0000 7fc1ab4fc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a40ca550 con 0x7fc1a41472c0 2024-04-25T10:03:38.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.487+0000 7fc1a9a99640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc1a40ced80 0x7fc1a40cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.487+0000 7fc1a9298640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc1a41472c0 0x7fc1a40cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.487+0000 7fc1a9298640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc1a41472c0 0x7fc1a40cb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:45664/0 (socket says 172.21.15.7:45664) 2024-04-25T10:03:38.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.487+0000 7fc1a8a97640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc1a40cad50 0x7fc1a40ce670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:35066/0 (socket says 172.21.15.7:35066) 2024-04-25T10:03:38.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.487+0000 7fc1a9a99640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc1a40ced80 0x7fc1a40cb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:38574/0 (socket says 172.21.15.7:38574) 2024-04-25T10:03:38.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.487+0000 7fc1a9298640 1 -- 172.21.15.7:0/2250818770 learned_addr learned my addr 172.21.15.7:0/2250818770 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:38.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.487+0000 7fc1a9298640 1 -- 172.21.15.7:0/2250818770 >> v2:172.21.15.55:3300/0 conn(0x7fc1a40ced80 msgr2=0x7fc1a40cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:38.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.487+0000 7fc1a9298640 1 --2- 172.21.15.7:0/2250818770 >> v2:172.21.15.55:3300/0 conn(0x7fc1a40ced80 0x7fc1a40cb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.487+0000 7fc1a9298640 1 -- 172.21.15.7:0/2250818770 >> v1:172.21.15.55:6789/0 conn(0x7fc1a40cad50 legacy=0x7fc1a40ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.487+0000 7fc1a3fff640 1 -- 172.21.15.7:0/2250818770 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1103343157 0 0) 0x7fc1a40c9f90 con 0x7fc1a40cad50 2024-04-25T10:03:38.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.487+0000 7fc1a9298640 1 -- 172.21.15.7:0/2250818770 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a40ca830 con 0x7fc1a41472c0 2024-04-25T10:03:38.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.488+0000 7fc1a9298640 1 --2- 172.21.15.7:0/2250818770 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc1a41472c0 0x7fc1a40cb440 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc194009e50 tx=0x7fc19402a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d45d617b2be8a9e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:38.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.488+0000 7fc1a3fff640 1 -- 172.21.15.7:0/2250818770 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc194036070 con 0x7fc1a41472c0 2024-04-25T10:03:38.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.488+0000 7fc1a3fff640 1 -- 172.21.15.7:0/2250818770 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc194031600 con 0x7fc1a41472c0 2024-04-25T10:03:38.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.488+0000 7fc1a3fff640 1 -- 172.21.15.7:0/2250818770 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1940319d0 con 0x7fc1a41472c0 2024-04-25T10:03:38.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.488+0000 7fc1ab4fc640 1 -- 172.21.15.7:0/2250818770 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc1a41472c0 msgr2=0x7fc1a40cb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.488+0000 7fc1ab4fc640 1 --2- 172.21.15.7:0/2250818770 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc1a41472c0 0x7fc1a40cb440 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc194009e50 tx=0x7fc19402a5f0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.488+0000 7fc1ab4fc640 1 -- 172.21.15.7:0/2250818770 shutdown_connections 2024-04-25T10:03:38.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.488+0000 7fc1ab4fc640 1 --2- 172.21.15.7:0/2250818770 >> v2:172.21.15.55:3300/0 conn(0x7fc1a40ced80 0x7fc1a40cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.488+0000 7fc1ab4fc640 1 --2- 172.21.15.7:0/2250818770 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc1a41472c0 0x7fc1a40cb440 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.488+0000 7fc1ab4fc640 1 -- 172.21.15.7:0/2250818770 >> 172.21.15.7:0/2250818770 conn(0x7fc1a4071150 msgr2=0x7fc1a4071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:38.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.488+0000 7fc1ab4fc640 1 -- 172.21.15.7:0/2250818770 shutdown_connections 2024-04-25T10:03:38.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.489+0000 7fc1ab4fc640 1 -- 172.21.15.7:0/2250818770 wait complete. 2024-04-25T10:03:38.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.490+0000 7fc1ab4fc640 1 Processor -- start 2024-04-25T10:03:38.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.490+0000 7fc1ab4fc640 1 -- start start 2024-04-25T10:03:38.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.490+0000 7fc1ab4fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1a40cad50 0x7fc1a413c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.490+0000 7fc1ab4fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1a40ced80 0x7fc1a41458e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.490+0000 7fc1ab4fc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc1a41472c0 0x7fc1a4145e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.490+0000 7fc1ab4fc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a406d2d0 con 0x7fc1a40cad50 2024-04-25T10:03:38.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.490+0000 7fc1ab4fc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a406d150 con 0x7fc1a40ced80 2024-04-25T10:03:38.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.490+0000 7fc1ab4fc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a406d450 con 0x7fc1a41472c0 2024-04-25T10:03:38.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.490+0000 7fc1a9298640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1a40cad50 0x7fc1a413c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.491+0000 7fc1a9298640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1a40cad50 0x7fc1a413c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43534/0 (socket says 172.21.15.7:43534) 2024-04-25T10:03:38.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.491+0000 7fc1a9298640 1 -- 172.21.15.7:0/3477293861 learned_addr learned my addr 172.21.15.7:0/3477293861 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:38.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.491+0000 7fc1a8a97640 1 --2- 172.21.15.7:0/3477293861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1a40ced80 0x7fc1a41458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.491+0000 7fc1a9a99640 1 --2- 172.21.15.7:0/3477293861 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc1a41472c0 0x7fc1a4145e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.491+0000 7fc1a9298640 1 -- 172.21.15.7:0/3477293861 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc1a41472c0 msgr2=0x7fc1a4145e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.491+0000 7fc1a9298640 1 --2- 172.21.15.7:0/3477293861 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc1a41472c0 0x7fc1a4145e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.491+0000 7fc1a9298640 1 -- 172.21.15.7:0/3477293861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1a40ced80 msgr2=0x7fc1a41458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.491+0000 7fc1a9298640 1 --2- 172.21.15.7:0/3477293861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1a40ced80 0x7fc1a41458e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.491+0000 7fc1a9298640 1 -- 172.21.15.7:0/3477293861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a4140080 con 0x7fc1a40cad50 2024-04-25T10:03:38.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.491+0000 7fc1a9298640 1 --2- 172.21.15.7:0/3477293861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1a40cad50 0x7fc1a413c660 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fc194034040 tx=0x7fc194004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:38.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.491+0000 7fc1a1ffb640 1 -- 172.21.15.7:0/3477293861 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc194041020 con 0x7fc1a40cad50 2024-04-25T10:03:38.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.491+0000 7fc1a1ffb640 1 -- 172.21.15.7:0/3477293861 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc194007820 con 0x7fc1a40cad50 2024-04-25T10:03:38.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.491+0000 7fc1a1ffb640 1 -- 172.21.15.7:0/3477293861 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc194036040 con 0x7fc1a40cad50 2024-04-25T10:03:38.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.491+0000 7fc1ab4fc640 1 -- 172.21.15.7:0/3477293861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a4140320 con 0x7fc1a40cad50 2024-04-25T10:03:38.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.491+0000 7fc1ab4fc640 1 -- 172.21.15.7:0/3477293861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1a41408e0 con 0x7fc1a40cad50 2024-04-25T10:03:38.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.492+0000 7fc1ab4fc640 1 -- 172.21.15.7:0/3477293861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1a4068fd0 con 0x7fc1a40cad50 2024-04-25T10:03:38.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.493+0000 7fc1a1ffb640 1 -- 172.21.15.7:0/3477293861 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc194044020 con 0x7fc1a40cad50 2024-04-25T10:03:38.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.493+0000 7fc1a1ffb640 1 --2- 172.21.15.7:0/3477293861 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc19006b4d0 0x7fc19006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.493+0000 7fc1a1ffb640 1 -- 172.21.15.7:0/3477293861 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fc1940aaeb0 con 0x7fc1a40cad50 2024-04-25T10:03:38.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.493+0000 7fc1a8a97640 1 --2- 172.21.15.7:0/3477293861 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc19006b4d0 0x7fc19006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.494+0000 7fc1a8a97640 1 --2- 172.21.15.7:0/3477293861 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc19006b4d0 0x7fc19006d990 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4162560 tx=0x7fc198007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:38.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.498+0000 7fc1a1ffb640 1 -- 172.21.15.7:0/3477293861 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc19404b030 con 0x7fc1a40cad50 2024-04-25T10:03:38.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.722+0000 7fc1ab4fc640 1 -- 172.21.15.7:0/3477293861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc1a4072390 con 0x7fc1a40cad50 2024-04-25T10:03:38.727 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-04-25T10:03:38.722+0000 7f45ad572640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T10:03:38.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.724+0000 7fc1a1ffb640 1 -- 172.21.15.7:0/3477293861 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v74) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc194079520 con 0x7fc1a40cad50 2024-04-25T10:03:38.729 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T10:03:38.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.727+0000 7fc1ab4fc640 1 -- 172.21.15.7:0/3477293861 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc19006b4d0 msgr2=0x7fc19006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.727+0000 7fc1ab4fc640 1 --2- 172.21.15.7:0/3477293861 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc19006b4d0 0x7fc19006d990 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4162560 tx=0x7fc198007d50 comp rx=0 tx=0).stop 2024-04-25T10:03:38.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.727+0000 7fc1ab4fc640 1 -- 172.21.15.7:0/3477293861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1a40cad50 msgr2=0x7fc1a413c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.727+0000 7fc1ab4fc640 1 --2- 172.21.15.7:0/3477293861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1a40cad50 0x7fc1a413c660 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fc194034040 tx=0x7fc194004a40 comp rx=0 tx=0).stop 2024-04-25T10:03:38.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.727+0000 7fc1ab4fc640 1 -- 172.21.15.7:0/3477293861 shutdown_connections 2024-04-25T10:03:38.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.727+0000 7fc1ab4fc640 1 --2- 172.21.15.7:0/3477293861 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc19006b4d0 0x7fc19006d990 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.727+0000 7fc1ab4fc640 1 --2- 172.21.15.7:0/3477293861 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc1a41472c0 0x7fc1a4145e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.727+0000 7fc1ab4fc640 1 --2- 172.21.15.7:0/3477293861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1a40ced80 0x7fc1a41458e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.727+0000 7fc1ab4fc640 1 --2- 172.21.15.7:0/3477293861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1a40cad50 0x7fc1a413c660 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.727+0000 7fc1ab4fc640 1 -- 172.21.15.7:0/3477293861 >> 172.21.15.7:0/3477293861 conn(0x7fc1a4071150 msgr2=0x7fc1a406d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:38.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.727+0000 7fc1ab4fc640 1 -- 172.21.15.7:0/3477293861 shutdown_connections 2024-04-25T10:03:38.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.727+0000 7fc1ab4fc640 1 -- 172.21.15.7:0/3477293861 wait complete. 2024-04-25T10:03:38.735 INFO:tasks.ceph.mds.a.smithi007.stderr: -7077> 2024-04-25T10:02:52.555+0000 7f870781e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:03:38.744 DEBUG:teuthology.orchestra.run.smithi007:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627777 summary 2024-04-25T10:03:38.766 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-04-25T10:03:38.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.781+0000 7f78ec520280 1 -- start start 2024-04-25T10:03:38.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.781+0000 7f78ec520280 1 Processor -- start 2024-04-25T10:03:38.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.782+0000 7f78ec520280 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc480eac00 0x55fc4815a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.782+0000 7f78ec520280 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fc480eb800 0x55fc4815ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.782+0000 7f78ec520280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc480ebc00 0x55fc4815b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.782+0000 7f78ec520280 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc48ec6180 con 0x55fc480eac00 2024-04-25T10:03:38.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.782+0000 7f78ec520280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc48ec6300 con 0x55fc480ebc00 2024-04-25T10:03:38.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.782+0000 7f78ec520280 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc48ec6480 con 0x55fc480eb800 2024-04-25T10:03:38.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.782+0000 7f78ea285640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc480eac00 0x55fc4815a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.782+0000 7f78ea285640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc480eac00 0x55fc4815a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43574/0 (socket says 172.21.15.7:43574) 2024-04-25T10:03:38.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.782+0000 7f78ea285640 1 -- 172.21.15.7:0/3529212288 learned_addr learned my addr 172.21.15.7:0/3529212288 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:38.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.782+0000 7f78eaa86640 1 --2- 172.21.15.7:0/3529212288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc480ebc00 0x55fc4815b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.782+0000 7f78e9a84640 1 --2- 172.21.15.7:0/3529212288 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fc480eb800 0x55fc4815ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.783+0000 7f78ea285640 1 -- 172.21.15.7:0/3529212288 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fc480eb800 msgr2=0x55fc4815ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:38.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.783+0000 7f78ea285640 1 --2- 172.21.15.7:0/3529212288 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fc480eb800 0x55fc4815ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.783+0000 7f78ea285640 1 -- 172.21.15.7:0/3529212288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc480ebc00 msgr2=0x55fc4815b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:38.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.783+0000 7f78ea285640 1 --2- 172.21.15.7:0/3529212288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc480ebc00 0x55fc4815b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.783+0000 7f78ea285640 1 -- 172.21.15.7:0/3529212288 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc48120780 con 0x55fc480eac00 2024-04-25T10:03:38.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.783+0000 7f78e9a84640 1 --2- 172.21.15.7:0/3529212288 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fc480eb800 0x55fc4815ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:38.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.783+0000 7f78ea285640 1 --2- 172.21.15.7:0/3529212288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc480eac00 0x55fc4815a580 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x55fc48f0b3b0 tx=0x55fc48eb6240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f506175ef1c525a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:38.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.783+0000 7f78e7a80640 1 -- 172.21.15.7:0/3529212288 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fc48110680 con 0x55fc480eac00 2024-04-25T10:03:38.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.783+0000 7f78e7a80640 1 -- 172.21.15.7:0/3529212288 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fc48116700 con 0x55fc480eac00 2024-04-25T10:03:38.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.783+0000 7f78e7a80640 1 -- 172.21.15.7:0/3529212288 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fc48110b60 con 0x55fc480eac00 2024-04-25T10:03:38.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.783+0000 7f78ec520280 1 -- 172.21.15.7:0/3529212288 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fc481214a0 con 0x55fc480eac00 2024-04-25T10:03:38.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.783+0000 7f78ec520280 1 -- 172.21.15.7:0/3529212288 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55fc48120000 con 0x55fc480eac00 2024-04-25T10:03:38.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.783+0000 7f78ec520280 4 waiting for MDS map... 2024-04-25T10:03:38.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.783+0000 7f78e7a80640 1 -- 172.21.15.7:0/3529212288 <== mon.0 v2:172.21.15.7:3300/0 4 ==== osd_map(106..106 src has 1..106) v4 ==== 6245+0+0 (secure 0 0 0) 0x55fc48fc0600 con 0x55fc480eac00 2024-04-25T10:03:38.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.783+0000 7f78e7a80640 1 -- 172.21.15.7:0/3529212288 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 74) v1 ==== 2723+0+0 (secure 0 0 0) 0x55fc48145180 con 0x55fc480eac00 2024-04-25T10:03:38.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.783+0000 7f78ec520280 4 Got MDS map 74 2024-04-25T10:03:38.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.783+0000 7f78ec520280 10 main: JournalTool::main 2024-04-25T10:03:38.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.783+0000 7f78ec520280 4 main: JournalTool: connecting to RADOS... 2024-04-25T10:03:38.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.784+0000 7f78ec520280 1 Processor -- start 2024-04-25T10:03:38.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.784+0000 7f78ec520280 1 -- start start 2024-04-25T10:03:38.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.784+0000 7f78ec520280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc48fc3000 0x55fc4815b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.784+0000 7f78ec520280 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc48fc3400 0x55fc4815bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.784+0000 7f78ec520280 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fc48fc3800 0x55fc4815c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.784+0000 7f78ec520280 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc48ec6600 con 0x55fc48fc3400 2024-04-25T10:03:38.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.784+0000 7f78ec520280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc48ec6780 con 0x55fc48fc3000 2024-04-25T10:03:38.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.784+0000 7f78ec520280 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc48ec6900 con 0x55fc48fc3800 2024-04-25T10:03:38.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.785+0000 7f78ea285640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc48fc3400 0x55fc4815bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.785+0000 7f78ea285640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc48fc3400 0x55fc4815bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43586/0 (socket says 172.21.15.7:43586) 2024-04-25T10:03:38.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.785+0000 7f78ea285640 1 -- 172.21.15.7:0/1411437618 learned_addr learned my addr 172.21.15.7:0/1411437618 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:38.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.785+0000 7f78ea285640 1 -- 172.21.15.7:0/1411437618 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fc48fc3800 msgr2=0x55fc4815c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:38.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.785+0000 7f78eaa86640 1 --2- 172.21.15.7:0/1411437618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc48fc3000 0x55fc4815b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.785+0000 7f78ea285640 1 --2- 172.21.15.7:0/1411437618 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fc48fc3800 0x55fc4815c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.785+0000 7f78ea285640 1 -- 172.21.15.7:0/1411437618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc48fc3000 msgr2=0x55fc4815b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:38.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.785+0000 7f78ea285640 1 --2- 172.21.15.7:0/1411437618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc48fc3000 0x55fc4815b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.785+0000 7f78ea285640 1 -- 172.21.15.7:0/1411437618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc481203c0 con 0x55fc48fc3400 2024-04-25T10:03:38.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.785+0000 7f78ea285640 1 --2- 172.21.15.7:0/1411437618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc48fc3400 0x55fc4815bb80 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x55fc48fce660 tx=0x55fc48e7d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47274465a95b472 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:38.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.785+0000 7f78e5a7c640 1 -- 172.21.15.7:0/1411437618 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fc48110820 con 0x55fc48fc3400 2024-04-25T10:03:38.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.785+0000 7f78e5a7c640 1 -- 172.21.15.7:0/1411437618 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fc48116fc0 con 0x55fc48fc3400 2024-04-25T10:03:38.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.785+0000 7f78e5a7c640 1 -- 172.21.15.7:0/1411437618 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fc48110680 con 0x55fc48fc3400 2024-04-25T10:03:38.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.786+0000 7f78ec520280 1 -- 172.21.15.7:0/1411437618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc48fc3400 msgr2=0x55fc4815bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.786+0000 7f78ec520280 1 --2- 172.21.15.7:0/1411437618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc48fc3400 0x55fc4815bb80 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x55fc48fce660 tx=0x55fc48e7d7a0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.786+0000 7f78ec520280 1 -- 172.21.15.7:0/1411437618 shutdown_connections 2024-04-25T10:03:38.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.786+0000 7f78ec520280 1 --2- 172.21.15.7:0/1411437618 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fc48fc3800 0x55fc4815c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.786+0000 7f78ec520280 1 --2- 172.21.15.7:0/1411437618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc48fc3400 0x55fc4815bb80 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.786+0000 7f78ec520280 1 --2- 172.21.15.7:0/1411437618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc48fc3000 0x55fc4815b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.786+0000 7f78ec520280 1 -- 172.21.15.7:0/1411437618 >> 172.21.15.7:0/1411437618 conn(0x55fc48fc2c00 msgr2=0x55fc481e5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:38.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.786+0000 7f78ec520280 1 -- 172.21.15.7:0/1411437618 shutdown_connections 2024-04-25T10:03:38.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.786+0000 7f78ec520280 1 -- 172.21.15.7:0/1411437618 wait complete. 2024-04-25T10:03:38.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.786+0000 7f78ec520280 1 Processor -- start 2024-04-25T10:03:38.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.786+0000 7f78ec520280 1 -- start start 2024-04-25T10:03:38.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.787+0000 7f78ec520280 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fc48fc3000 0x55fc4815d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.787+0000 7f78ec520280 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc48fc3400 0x55fc4815cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.787+0000 7f78ec520280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc48fc3800 0x55fc4815c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.787+0000 7f78ec520280 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc48ec7b00 con 0x55fc48fc3400 2024-04-25T10:03:38.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.787+0000 7f78ec520280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc48ec7980 con 0x55fc48fc3800 2024-04-25T10:03:38.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.787+0000 7f78ec520280 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc48ec7800 con 0x55fc48fc3000 2024-04-25T10:03:38.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.787+0000 7f78ea285640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc48fc3400 0x55fc4815cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.787+0000 7f78ea285640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc48fc3400 0x55fc4815cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43588/0 (socket says 172.21.15.7:43588) 2024-04-25T10:03:38.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.787+0000 7f78ea285640 1 -- 172.21.15.7:0/1183321495 learned_addr learned my addr 172.21.15.7:0/1183321495 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:38.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.787+0000 7f78eaa86640 1 --2- 172.21.15.7:0/1183321495 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fc48fc3000 0x55fc4815d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.787+0000 7f78e9a84640 1 --2- 172.21.15.7:0/1183321495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc48fc3800 0x55fc4815c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.787+0000 7f78ea285640 1 -- 172.21.15.7:0/1183321495 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fc48fc3000 msgr2=0x55fc4815d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.787+0000 7f78ea285640 1 --2- 172.21.15.7:0/1183321495 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fc48fc3000 0x55fc4815d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.787+0000 7f78ea285640 1 -- 172.21.15.7:0/1183321495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc48fc3800 msgr2=0x55fc4815c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.787+0000 7f78ea285640 1 --2- 172.21.15.7:0/1183321495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc48fc3800 0x55fc4815c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.787+0000 7f78ea285640 1 -- 172.21.15.7:0/1183321495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc48120780 con 0x55fc48fc3400 2024-04-25T10:03:38.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.787+0000 7f78ea285640 1 --2- 172.21.15.7:0/1183321495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc48fc3400 0x55fc4815cc00 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x55fc48fcf320 tx=0x55fc48fd2c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:38.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.787+0000 7f78e4279640 1 -- 172.21.15.7:0/1183321495 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fc48110b60 con 0x55fc48fc3400 2024-04-25T10:03:38.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.787+0000 7f78e4279640 1 -- 172.21.15.7:0/1183321495 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fc48116e00 con 0x55fc48fc3400 2024-04-25T10:03:38.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.788+0000 7f78ec520280 1 -- 172.21.15.7:0/1183321495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fc481214a0 con 0x55fc48fc3400 2024-04-25T10:03:38.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.788+0000 7f78e4279640 1 -- 172.21.15.7:0/1183321495 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fc481104e0 con 0x55fc48fc3400 2024-04-25T10:03:38.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.788+0000 7f78ec520280 1 -- 172.21.15.7:0/1183321495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fc48120960 con 0x55fc48fc3400 2024-04-25T10:03:38.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.788+0000 7f78ec520280 4 main: JournalTool: resolving pool 15 2024-04-25T10:03:38.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.789+0000 7f78e4279640 1 -- 172.21.15.7:0/1183321495 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x55fc49024c00 con 0x55fc48fc3400 2024-04-25T10:03:38.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.789+0000 7f78e4279640 1 --2- 172.21.15.7:0/1183321495 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x55fc48452000 0x55fc4815d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.789+0000 7f78e4279640 1 -- 172.21.15.7:0/1183321495 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6245+0+0 (secure 0 0 0) 0x55fc49030600 con 0x55fc48fc3400 2024-04-25T10:03:38.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.789+0000 7f78eaa86640 1 --2- 172.21.15.7:0/1183321495 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x55fc48452000 0x55fc4815d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.789+0000 7f78ec520280 4 main: JournalTool: creating IoCtx.. 2024-04-25T10:03:38.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.789+0000 7f78ec520280 4 main: Executing for rank 0 2024-04-25T10:03:38.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.789+0000 7f78ec520280 4 Filtering by inode '1099511627777' 2024-04-25T10:03:38.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.789+0000 7f78ec520280 1 --2- 172.21.15.7:0/1183321495 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x55fc48452400 0x55fc4815c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.789+0000 7f78ec520280 1 -- 172.21.15.7:0/1183321495 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:1 15.f 15:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e106) v9 -- 0x55fc48452800 con 0x55fc48452400 2024-04-25T10:03:38.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.790+0000 7f78e9a84640 1 --2- 172.21.15.7:0/1183321495 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x55fc48452400 0x55fc4815c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.790+0000 7f78eaa86640 1 --2- 172.21.15.7:0/1183321495 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x55fc48452000 0x55fc4815d700 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x55fc4811f7d0 tx=0x55fc48e6e5a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:38.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.790+0000 7f78e9a84640 1 --2- 172.21.15.7:0/1183321495 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x55fc48452400 0x55fc4815c100 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:38.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.793+0000 7f78e9a84640 1 -- 172.21.15.7:0/1183321495 <== osd.6 v2:172.21.15.55:6824/4293769515 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55fc481d8000 con 0x55fc48452400 2024-04-25T10:03:38.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.793+0000 7f78ec520280 4 Pointer 400.00000000 is readable 2024-04-25T10:03:38.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.793+0000 7f78ec520280 4 JournalScanner::scan: reading header object '200.00000000' 2024-04-25T10:03:38.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.793+0000 7f78ec520280 1 -- 172.21.15.7:0/1183321495 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:2 15.14 15:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e106) v9 -- 0x55fc48452c00 con 0x55fc48452400 2024-04-25T10:03:38.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.794+0000 7f78e9a84640 1 -- 172.21.15.7:0/1183321495 <== osd.6 v2:172.21.15.55:6824/4293769515 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv31 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55fc481d8000 con 0x55fc48452400 2024-04-25T10:03:38.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.794+0000 7f78ec520280 10 Header 0x400000 0x407d21 0x40809d 2024-04-25T10:03:38.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.794+0000 7f78ec520280 10 Starting journal scan from offset 0x407d21 2024-04-25T10:03:38.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.794+0000 7f78ec520280 1 -- 172.21.15.7:0/1183321495 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:3 15.14 15:2e2fa760:::200.00000001:head [read 32033~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e106) v9 -- 0x55fc48453000 con 0x55fc48452400 2024-04-25T10:03:38.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.795+0000 7f78e9a84640 1 -- 172.21.15.7:0/1183321495 <== osd.6 v2:172.21.15.55:6824/4293769515 3 ==== osd_op_reply(3 200.00000001 [read 32033~892 out=892b] v0'0 uv28 ondisk = 0) v8 ==== 156+0+892 (crc 0 0 0) 0x55fc481d8000 con 0x55fc48452400 2024-04-25T10:03:38.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.795+0000 7f78ec520280 4 Read 0x37c bytes from 200.00000001 gap=0 2024-04-25T10:03:38.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.795+0000 7f78ec520280 10 Parsing data, 0x37c bytes available 2024-04-25T10:03:38.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.795+0000 7f78ec520280 10 Attempting decode at 0x407d21 2024-04-25T10:03:38.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.795+0000 7f78ec520280 10 Consumed 0x37c bytes 2024-04-25T10:03:38.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.795+0000 7f78ec520280 10 Valid entry at 0x407d21 2024-04-25T10:03:38.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.795+0000 7f78ec520280 1 --2- 172.21.15.7:0/1183321495 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x55fc48453400 0x55fc4815bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.795+0000 7f78ec520280 1 -- 172.21.15.7:0/1183321495 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:4 15.1b 15:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e106) v9 -- 0x55fc48452800 con 0x55fc48453400 2024-04-25T10:03:38.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.795+0000 7f78eaa86640 1 --2- 172.21.15.7:0/1183321495 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x55fc48453400 0x55fc4815bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.795+0000 7f78eaa86640 1 --2- 172.21.15.7:0/1183321495 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x55fc48453400 0x55fc4815bb80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:38.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.798+0000 7f78eaa86640 1 -- 172.21.15.7:0/1183321495 <== osd.7 v2:172.21.15.55:6816/2960381217 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55fc481d8500 con 0x55fc48453400 2024-04-25T10:03:38.806 INFO:teuthology.orchestra.run.smithi007.stdout:Events by type: 2024-04-25T10:03:38.806 INFO:teuthology.orchestra.run.smithi007.stdout:Errors: 0 2024-04-25T10:03:38.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.798+0000 7f78ec520280 4 Reached end of journal objects 2024-04-25T10:03:38.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.798+0000 7f78ec520280 4 Scanned objects, 0 missing, 1 valid 2024-04-25T10:03:38.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.798+0000 7f78ec520280 4 Events scanned, 0 gaps 2024-04-25T10:03:38.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.798+0000 7f78ec520280 4 Found 1 valid events 2024-04-25T10:03:38.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.798+0000 7f78ec520280 4 Selected 0 events events for processing 2024-04-25T10:03:38.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.798+0000 7f78ec520280 4 0 events 2024-04-25T10:03:38.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.798+0000 7f78ec520280 1 -- 172.21.15.7:0/1183321495 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x55fc48452400 msgr2=0x55fc4815c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.798+0000 7f78ec520280 1 --2- 172.21.15.7:0/1183321495 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x55fc48452400 0x55fc4815c100 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.798+0000 7f78ec520280 1 -- 172.21.15.7:0/1183321495 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x55fc48453400 msgr2=0x55fc4815bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.798+0000 7f78ec520280 1 --2- 172.21.15.7:0/1183321495 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x55fc48453400 0x55fc4815bb80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.798+0000 7f78ec520280 1 -- 172.21.15.7:0/1183321495 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x55fc48452000 msgr2=0x55fc4815d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.798+0000 7f78ec520280 1 --2- 172.21.15.7:0/1183321495 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x55fc48452000 0x55fc4815d700 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x55fc4811f7d0 tx=0x55fc48e6e5a0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.798+0000 7f78ec520280 1 -- 172.21.15.7:0/1183321495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc48fc3400 msgr2=0x55fc4815cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.798+0000 7f78e9a84640 1 -- 172.21.15.7:0/1183321495 reap_dead start 2024-04-25T10:03:38.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.798+0000 7f78ec520280 1 --2- 172.21.15.7:0/1183321495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc48fc3400 0x55fc4815cc00 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x55fc48fcf320 tx=0x55fc48fd2c00 comp rx=0 tx=0).stop 2024-04-25T10:03:38.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.798+0000 7f78ec520280 1 -- 172.21.15.7:0/1183321495 shutdown_connections 2024-04-25T10:03:38.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.798+0000 7f78ec520280 1 --2- 172.21.15.7:0/1183321495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc48fc3400 0x55fc4815cc00 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.798+0000 7f78ec520280 1 -- 172.21.15.7:0/1183321495 >> 172.21.15.7:0/1183321495 conn(0x55fc48fc2c00 msgr2=0x55fc481e5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.798+0000 7f78ec520280 1 -- 172.21.15.7:0/1183321495 shutdown_connections 2024-04-25T10:03:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.798+0000 7f78ec520280 1 -- 172.21.15.7:0/1183321495 wait complete. 2024-04-25T10:03:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.798+0000 7f78ec520280 1 -- 172.21.15.7:0/3529212288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc480eac00 msgr2=0x55fc4815a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.798+0000 7f78ec520280 1 --2- 172.21.15.7:0/3529212288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc480eac00 0x55fc4815a580 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x55fc48f0b3b0 tx=0x55fc48eb6240 comp rx=0 tx=0).stop 2024-04-25T10:03:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.798+0000 7f78ec520280 1 -- 172.21.15.7:0/3529212288 shutdown_connections 2024-04-25T10:03:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.798+0000 7f78ec520280 1 --2- 172.21.15.7:0/3529212288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc480ebc00 0x55fc4815b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.798+0000 7f78ec520280 1 --2- 172.21.15.7:0/3529212288 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55fc480eb800 0x55fc4815ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.798+0000 7f78ec520280 1 --2- 172.21.15.7:0/3529212288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fc480eac00 0x55fc4815a580 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.798+0000 7f78ec520280 1 -- 172.21.15.7:0/3529212288 >> 172.21.15.7:0/3529212288 conn(0x55fc480eb000 msgr2=0x55fc481e4800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.798+0000 7f78ec520280 1 -- 172.21.15.7:0/3529212288 shutdown_connections 2024-04-25T10:03:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.798+0000 7f78ec520280 1 -- 172.21.15.7:0/3529212288 wait complete. 2024-04-25T10:03:38.812 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627777', 'summary'] in time 0:00:00.067950, result: Events by type: Errors: 0 2024-04-25T10:03:38.812 DEBUG:teuthology.orchestra.run.smithi007:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627778 summary 2024-04-25T10:03:38.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.887+0000 7f060ba0d280 1 -- start start 2024-04-25T10:03:38.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.887+0000 7f060ba0d280 1 Processor -- start 2024-04-25T10:03:38.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.888+0000 7f060ba0d280 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55825a61ac00 0x55825a68a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.888+0000 7f060ba0d280 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55825a61b800 0x55825a68ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.888+0000 7f060ba0d280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55825a61bc00 0x55825a68b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.888+0000 7f060ba0d280 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55825b4dc180 con 0x55825a61ac00 2024-04-25T10:03:38.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.888+0000 7f060ba0d280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55825b4dc300 con 0x55825a61bc00 2024-04-25T10:03:38.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.888+0000 7f060ba0d280 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55825b4dc480 con 0x55825a61b800 2024-04-25T10:03:38.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.888+0000 7f06094f4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55825a61ac00 0x55825a68a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.888+0000 7f06094f4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55825a61ac00 0x55825a68a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43604/0 (socket says 172.21.15.7:43604) 2024-04-25T10:03:38.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.888+0000 7f06094f4640 1 -- 172.21.15.7:0/373042610 learned_addr learned my addr 172.21.15.7:0/373042610 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:38.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.888+0000 7f0609cf5640 1 --2- 172.21.15.7:0/373042610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55825a61bc00 0x55825a68b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.888+0000 7f0608cf3640 1 --2- 172.21.15.7:0/373042610 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55825a61b800 0x55825a68ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.889+0000 7f06094f4640 1 -- 172.21.15.7:0/373042610 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55825a61b800 msgr2=0x55825a68ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:38.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.889+0000 7f06094f4640 1 --2- 172.21.15.7:0/373042610 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55825a61b800 0x55825a68ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.889+0000 7f06094f4640 1 -- 172.21.15.7:0/373042610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55825a61bc00 msgr2=0x55825a68b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:38.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.889+0000 7f06094f4640 1 --2- 172.21.15.7:0/373042610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55825a61bc00 0x55825a68b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.889+0000 7f06094f4640 1 -- 172.21.15.7:0/373042610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55825a650780 con 0x55825a61ac00 2024-04-25T10:03:38.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.889+0000 7f0609cf5640 1 --2- 172.21.15.7:0/373042610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55825a61bc00 0x55825a68b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:38.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.889+0000 7f06094f4640 1 --2- 172.21.15.7:0/373042610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55825a61ac00 0x55825a68a580 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x55825b43f350 tx=0x55825b3ec4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b4af58b3f53c7a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:38.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.889+0000 7f0606cef640 1 -- 172.21.15.7:0/373042610 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55825a640680 con 0x55825a61ac00 2024-04-25T10:03:38.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.889+0000 7f0606cef640 1 -- 172.21.15.7:0/373042610 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55825a646fc0 con 0x55825a61ac00 2024-04-25T10:03:38.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.889+0000 7f0606cef640 1 -- 172.21.15.7:0/373042610 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55825a640b60 con 0x55825a61ac00 2024-04-25T10:03:38.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.889+0000 7f060ba0d280 1 -- 172.21.15.7:0/373042610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55825a6503c0 con 0x55825a61ac00 2024-04-25T10:03:38.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.889+0000 7f060ba0d280 1 -- 172.21.15.7:0/373042610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55825a651680 con 0x55825a61ac00 2024-04-25T10:03:38.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.889+0000 7f060ba0d280 4 waiting for MDS map... 2024-04-25T10:03:38.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.889+0000 7f0606cef640 1 -- 172.21.15.7:0/373042610 <== mon.0 v2:172.21.15.7:3300/0 4 ==== osd_map(106..106 src has 1..106) v4 ==== 6245+0+0 (secure 0 0 0) 0x55825b4f4600 con 0x55825a61ac00 2024-04-25T10:03:38.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.889+0000 7f0606cef640 1 -- 172.21.15.7:0/373042610 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 74) v1 ==== 2723+0+0 (secure 0 0 0) 0x55825a675180 con 0x55825a61ac00 2024-04-25T10:03:38.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.889+0000 7f060ba0d280 4 Got MDS map 74 2024-04-25T10:03:38.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.889+0000 7f060ba0d280 10 main: JournalTool::main 2024-04-25T10:03:38.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.889+0000 7f060ba0d280 4 main: JournalTool: connecting to RADOS... 2024-04-25T10:03:38.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.890+0000 7f060ba0d280 1 Processor -- start 2024-04-25T10:03:38.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.890+0000 7f060ba0d280 1 -- start start 2024-04-25T10:03:38.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.890+0000 7f060ba0d280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55825b4f7000 0x55825a68b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.890+0000 7f060ba0d280 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55825b4f7400 0x55825a68bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.890+0000 7f060ba0d280 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55825b4f7800 0x55825a68c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.890+0000 7f060ba0d280 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55825b4dc600 con 0x55825b4f7400 2024-04-25T10:03:38.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.890+0000 7f060ba0d280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55825b4dc780 con 0x55825b4f7000 2024-04-25T10:03:38.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.890+0000 7f060ba0d280 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55825b4dc900 con 0x55825b4f7800 2024-04-25T10:03:38.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.891+0000 7f06094f4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55825b4f7400 0x55825a68bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.891+0000 7f06094f4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55825b4f7400 0x55825a68bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43612/0 (socket says 172.21.15.7:43612) 2024-04-25T10:03:38.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.891+0000 7f06094f4640 1 -- 172.21.15.7:0/4220820927 learned_addr learned my addr 172.21.15.7:0/4220820927 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:38.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.891+0000 7f0609cf5640 1 --2- 172.21.15.7:0/4220820927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55825b4f7000 0x55825a68b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.891+0000 7f0608cf3640 1 --2- 172.21.15.7:0/4220820927 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55825b4f7800 0x55825a68c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.891+0000 7f06094f4640 1 -- 172.21.15.7:0/4220820927 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55825b4f7800 msgr2=0x55825a68c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:38.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.891+0000 7f06094f4640 1 --2- 172.21.15.7:0/4220820927 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55825b4f7800 0x55825a68c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.891+0000 7f06094f4640 1 -- 172.21.15.7:0/4220820927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55825b4f7000 msgr2=0x55825a68b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:38.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.891+0000 7f06094f4640 1 --2- 172.21.15.7:0/4220820927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55825b4f7000 0x55825a68b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.891+0000 7f06094f4640 1 -- 172.21.15.7:0/4220820927 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55825a6514a0 con 0x55825b4f7400 2024-04-25T10:03:38.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.891+0000 7f06094f4640 1 --2- 172.21.15.7:0/4220820927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55825b4f7400 0x55825a68bb80 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x55825b50c660 tx=0x55825b3ec180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1358e819167837b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:38.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.891+0000 7f0604ceb640 1 -- 172.21.15.7:0/4220820927 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55825a640820 con 0x55825b4f7400 2024-04-25T10:03:38.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.891+0000 7f0604ceb640 1 -- 172.21.15.7:0/4220820927 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55825a646e00 con 0x55825b4f7400 2024-04-25T10:03:38.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.891+0000 7f0604ceb640 1 -- 172.21.15.7:0/4220820927 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55825a640680 con 0x55825b4f7400 2024-04-25T10:03:38.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.891+0000 7f060ba0d280 1 -- 172.21.15.7:0/4220820927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55825b4f7400 msgr2=0x55825a68bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.891+0000 7f060ba0d280 1 --2- 172.21.15.7:0/4220820927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55825b4f7400 0x55825a68bb80 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x55825b50c660 tx=0x55825b3ec180 comp rx=0 tx=0).stop 2024-04-25T10:03:38.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.892+0000 7f060ba0d280 1 -- 172.21.15.7:0/4220820927 shutdown_connections 2024-04-25T10:03:38.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.892+0000 7f060ba0d280 1 --2- 172.21.15.7:0/4220820927 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55825b4f7800 0x55825a68c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.892+0000 7f060ba0d280 1 --2- 172.21.15.7:0/4220820927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55825b4f7400 0x55825a68bb80 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.892+0000 7f060ba0d280 1 --2- 172.21.15.7:0/4220820927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55825b4f7000 0x55825a68b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.892+0000 7f060ba0d280 1 -- 172.21.15.7:0/4220820927 >> 172.21.15.7:0/4220820927 conn(0x55825b4f6c00 msgr2=0x55825a715000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:38.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.892+0000 7f060ba0d280 1 -- 172.21.15.7:0/4220820927 shutdown_connections 2024-04-25T10:03:38.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.892+0000 7f060ba0d280 1 -- 172.21.15.7:0/4220820927 wait complete. 2024-04-25T10:03:38.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.892+0000 7f060ba0d280 1 Processor -- start 2024-04-25T10:03:38.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.892+0000 7f060ba0d280 1 -- start start 2024-04-25T10:03:38.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.893+0000 7f060ba0d280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55825b4f7000 0x55825a68d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.893+0000 7f060ba0d280 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55825b4f7400 0x55825a68cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.893+0000 7f060ba0d280 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55825b4f7800 0x55825a68c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.893+0000 7f060ba0d280 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55825b4ddc80 con 0x55825b4f7800 2024-04-25T10:03:38.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.893+0000 7f060ba0d280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55825b4ddb00 con 0x55825b4f7000 2024-04-25T10:03:38.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.893+0000 7f060ba0d280 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55825b4dd980 con 0x55825b4f7400 2024-04-25T10:03:38.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.893+0000 7f0608cf3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55825b4f7800 0x55825a68c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.893+0000 7f0608cf3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55825b4f7800 0x55825a68c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43622/0 (socket says 172.21.15.7:43622) 2024-04-25T10:03:38.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.893+0000 7f0608cf3640 1 -- 172.21.15.7:0/61893833 learned_addr learned my addr 172.21.15.7:0/61893833 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:38.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.893+0000 7f06094f4640 1 --2- 172.21.15.7:0/61893833 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55825b4f7400 0x55825a68cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.893+0000 7f0609cf5640 1 --2- 172.21.15.7:0/61893833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55825b4f7000 0x55825a68d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.893+0000 7f0608cf3640 1 -- 172.21.15.7:0/61893833 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55825b4f7400 msgr2=0x55825a68cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.893+0000 7f0608cf3640 1 --2- 172.21.15.7:0/61893833 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55825b4f7400 0x55825a68cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.893+0000 7f0608cf3640 1 -- 172.21.15.7:0/61893833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55825b4f7000 msgr2=0x55825a68d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.893+0000 7f0608cf3640 1 --2- 172.21.15.7:0/61893833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55825b4f7000 0x55825a68d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.893+0000 7f0608cf3640 1 -- 172.21.15.7:0/61893833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55825a650780 con 0x55825b4f7800 2024-04-25T10:03:38.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.893+0000 7f0608cf3640 1 --2- 172.21.15.7:0/61893833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55825b4f7800 0x55825a68c680 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x55825b50d320 tx=0x55825b39ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:38.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.893+0000 7f06034e8640 1 -- 172.21.15.7:0/61893833 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55825a6409c0 con 0x55825b4f7800 2024-04-25T10:03:38.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.893+0000 7f06034e8640 1 -- 172.21.15.7:0/61893833 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55825a6461c0 con 0x55825b4f7800 2024-04-25T10:03:38.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.893+0000 7f060ba0d280 1 -- 172.21.15.7:0/61893833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55825a6503c0 con 0x55825b4f7800 2024-04-25T10:03:38.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.893+0000 7f06034e8640 1 -- 172.21.15.7:0/61893833 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55825a640820 con 0x55825b4f7800 2024-04-25T10:03:38.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.894+0000 7f060ba0d280 1 -- 172.21.15.7:0/61893833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55825a650000 con 0x55825b4f7800 2024-04-25T10:03:38.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.894+0000 7f060ba0d280 4 main: JournalTool: resolving pool 15 2024-04-25T10:03:38.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.895+0000 7f06034e8640 1 -- 172.21.15.7:0/61893833 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x55825b562c00 con 0x55825b4f7800 2024-04-25T10:03:38.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.895+0000 7f06034e8640 1 --2- 172.21.15.7:0/61893833 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x55825b4f7c00 0x55825a68d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.895+0000 7f06034e8640 1 -- 172.21.15.7:0/61893833 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6245+0+0 (secure 0 0 0) 0x55825b414400 con 0x55825b4f7800 2024-04-25T10:03:38.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.895+0000 7f0609cf5640 1 --2- 172.21.15.7:0/61893833 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x55825b4f7c00 0x55825a68d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.895+0000 7f060ba0d280 4 main: JournalTool: creating IoCtx.. 2024-04-25T10:03:38.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.895+0000 7f060ba0d280 4 main: Executing for rank 0 2024-04-25T10:03:38.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.895+0000 7f060ba0d280 4 Filtering by inode '1099511627778' 2024-04-25T10:03:38.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.895+0000 7f060ba0d280 1 --2- 172.21.15.7:0/61893833 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x55825a98a000 0x55825a68c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.895+0000 7f060ba0d280 1 -- 172.21.15.7:0/61893833 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:1 15.f 15:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e106) v9 -- 0x55825a98a400 con 0x55825a98a000 2024-04-25T10:03:38.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.895+0000 7f06094f4640 1 --2- 172.21.15.7:0/61893833 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x55825a98a000 0x55825a68c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.895+0000 7f0609cf5640 1 --2- 172.21.15.7:0/61893833 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x55825b4f7c00 0x55825a68d700 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x55825b39a8a0 tx=0x55825a98e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:38.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.896+0000 7f06094f4640 1 --2- 172.21.15.7:0/61893833 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x55825a98a000 0x55825a68c100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:38.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.896+0000 7f06094f4640 1 -- 172.21.15.7:0/61893833 <== osd.6 v2:172.21.15.55:6824/4293769515 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55825a708000 con 0x55825a98a000 2024-04-25T10:03:38.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.896+0000 7f060ba0d280 4 Pointer 400.00000000 is readable 2024-04-25T10:03:38.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.896+0000 7f060ba0d280 4 JournalScanner::scan: reading header object '200.00000000' 2024-04-25T10:03:38.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.896+0000 7f060ba0d280 1 -- 172.21.15.7:0/61893833 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:2 15.14 15:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e106) v9 -- 0x55825a98a800 con 0x55825a98a000 2024-04-25T10:03:38.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.896+0000 7f06094f4640 1 -- 172.21.15.7:0/61893833 <== osd.6 v2:172.21.15.55:6824/4293769515 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv31 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55825a708000 con 0x55825a98a000 2024-04-25T10:03:38.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.896+0000 7f060ba0d280 10 Header 0x400000 0x407d21 0x40809d 2024-04-25T10:03:38.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.896+0000 7f060ba0d280 10 Starting journal scan from offset 0x407d21 2024-04-25T10:03:38.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.896+0000 7f060ba0d280 1 -- 172.21.15.7:0/61893833 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:3 15.14 15:2e2fa760:::200.00000001:head [read 32033~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e106) v9 -- 0x55825a98ac00 con 0x55825a98a000 2024-04-25T10:03:38.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.897+0000 7f06094f4640 1 -- 172.21.15.7:0/61893833 <== osd.6 v2:172.21.15.55:6824/4293769515 3 ==== osd_op_reply(3 200.00000001 [read 32033~892 out=892b] v0'0 uv28 ondisk = 0) v8 ==== 156+0+892 (crc 0 0 0) 0x55825a708000 con 0x55825a98a000 2024-04-25T10:03:38.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.897+0000 7f060ba0d280 4 Read 0x37c bytes from 200.00000001 gap=0 2024-04-25T10:03:38.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.897+0000 7f060ba0d280 10 Parsing data, 0x37c bytes available 2024-04-25T10:03:38.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.897+0000 7f060ba0d280 10 Attempting decode at 0x407d21 2024-04-25T10:03:38.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.897+0000 7f060ba0d280 10 Consumed 0x37c bytes 2024-04-25T10:03:38.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.897+0000 7f060ba0d280 10 Valid entry at 0x407d21 2024-04-25T10:03:38.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.897+0000 7f060ba0d280 1 --2- 172.21.15.7:0/61893833 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x55825a98b000 0x55825a68bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:38.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.897+0000 7f060ba0d280 1 -- 172.21.15.7:0/61893833 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:4 15.1b 15:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e106) v9 -- 0x55825a98a400 con 0x55825a98b000 2024-04-25T10:03:38.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.897+0000 7f0609cf5640 1 --2- 172.21.15.7:0/61893833 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x55825a98b000 0x55825a68bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:38.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.898+0000 7f0609cf5640 1 --2- 172.21.15.7:0/61893833 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x55825a98b000 0x55825a68bb80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:38.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.898+0000 7f0609cf5640 1 -- 172.21.15.7:0/61893833 <== osd.7 v2:172.21.15.55:6816/2960381217 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55825a708500 con 0x55825a98b000 2024-04-25T10:03:38.912 INFO:teuthology.orchestra.run.smithi007.stdout:Events by type: 2024-04-25T10:03:38.912 INFO:teuthology.orchestra.run.smithi007.stdout:Errors: 0 2024-04-25T10:03:38.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.898+0000 7f060ba0d280 4 Reached end of journal objects 2024-04-25T10:03:38.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.898+0000 7f060ba0d280 4 Scanned objects, 0 missing, 1 valid 2024-04-25T10:03:38.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.898+0000 7f060ba0d280 4 Events scanned, 0 gaps 2024-04-25T10:03:38.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.898+0000 7f060ba0d280 4 Found 1 valid events 2024-04-25T10:03:38.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.898+0000 7f060ba0d280 4 Selected 0 events events for processing 2024-04-25T10:03:38.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.898+0000 7f060ba0d280 4 0 events 2024-04-25T10:03:38.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.898+0000 7f060ba0d280 1 -- 172.21.15.7:0/61893833 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x55825a98a000 msgr2=0x55825a68c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.898+0000 7f060ba0d280 1 --2- 172.21.15.7:0/61893833 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x55825a98a000 0x55825a68c100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.898+0000 7f060ba0d280 1 -- 172.21.15.7:0/61893833 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x55825a98b000 msgr2=0x55825a68bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.898+0000 7f060ba0d280 1 --2- 172.21.15.7:0/61893833 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x55825a98b000 0x55825a68bb80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.898+0000 7f060ba0d280 1 -- 172.21.15.7:0/61893833 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x55825b4f7c00 msgr2=0x55825a68d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.898+0000 7f060ba0d280 1 --2- 172.21.15.7:0/61893833 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x55825b4f7c00 0x55825a68d700 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x55825b39a8a0 tx=0x55825a98e000 comp rx=0 tx=0).stop 2024-04-25T10:03:38.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.898+0000 7f060ba0d280 1 -- 172.21.15.7:0/61893833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55825b4f7800 msgr2=0x55825a68c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.898+0000 7f060ba0d280 1 --2- 172.21.15.7:0/61893833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55825b4f7800 0x55825a68c680 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x55825b50d320 tx=0x55825b39ef60 comp rx=0 tx=0).stop 2024-04-25T10:03:38.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.898+0000 7f0608cf3640 1 -- 172.21.15.7:0/61893833 reap_dead start 2024-04-25T10:03:38.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.898+0000 7f0608cf3640 1 -- 172.21.15.7:0/61893833 reap_dead start 2024-04-25T10:03:38.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.898+0000 7f060ba0d280 1 -- 172.21.15.7:0/61893833 shutdown_connections 2024-04-25T10:03:38.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.898+0000 7f060ba0d280 1 -- 172.21.15.7:0/61893833 >> 172.21.15.7:0/61893833 conn(0x55825b4f6c00 msgr2=0x55825a715000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:38.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.898+0000 7f060ba0d280 1 -- 172.21.15.7:0/61893833 shutdown_connections 2024-04-25T10:03:38.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.898+0000 7f060ba0d280 1 -- 172.21.15.7:0/61893833 wait complete. 2024-04-25T10:03:38.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.898+0000 7f060ba0d280 1 -- 172.21.15.7:0/373042610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55825a61ac00 msgr2=0x55825a68a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:38.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.898+0000 7f060ba0d280 1 --2- 172.21.15.7:0/373042610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55825a61ac00 0x55825a68a580 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x55825b43f350 tx=0x55825b3ec4e0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.898+0000 7f060ba0d280 1 -- 172.21.15.7:0/373042610 shutdown_connections 2024-04-25T10:03:38.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.898+0000 7f060ba0d280 1 --2- 172.21.15.7:0/373042610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55825a61bc00 0x55825a68b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.898+0000 7f060ba0d280 1 --2- 172.21.15.7:0/373042610 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55825a61b800 0x55825a68ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.898+0000 7f060ba0d280 1 --2- 172.21.15.7:0/373042610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55825a61ac00 0x55825a68a580 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:38.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.898+0000 7f060ba0d280 1 -- 172.21.15.7:0/373042610 >> 172.21.15.7:0/373042610 conn(0x55825a61b000 msgr2=0x55825a714800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:38.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.898+0000 7f060ba0d280 1 -- 172.21.15.7:0/373042610 shutdown_connections 2024-04-25T10:03:38.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.898+0000 7f060ba0d280 1 -- 172.21.15.7:0/373042610 wait complete. 2024-04-25T10:03:38.916 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627778', 'summary'] in time 0:00:00.104669, result: Events by type: Errors: 0 2024-04-25T10:03:38.917 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put mds0_inotable - 2024-04-25T10:03:38.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.992+0000 7fc02b71bf40 1 Processor -- start 2024-04-25T10:03:38.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.992+0000 7fc02b71bf40 1 -- start start 2024-04-25T10:03:39.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.993+0000 7fc02b71bf40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a77c0e1e70 0x55a77c10f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:39.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.993+0000 7fc02b71bf40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a77c1afad0 0x55a77c1a97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:39.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.993+0000 7fc02b71bf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a77c1afeb0 0x55a77c1a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:39.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.993+0000 7fc02b71bf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a77c1bd7f0 con 0x55a77c1afeb0 2024-04-25T10:03:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.993+0000 7fc02b71bf40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a77c08adf0 con 0x55a77c0e1e70 2024-04-25T10:03:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.993+0000 7fc02b71bf40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a77c1bd270 con 0x55a77c1afad0 2024-04-25T10:03:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.993+0000 7fc028f99640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a77c1afeb0 0x55a77c1a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.993+0000 7fc028f99640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a77c1afeb0 0x55a77c1a9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43646/0 (socket says 172.21.15.7:43646) 2024-04-25T10:03:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.993+0000 7fc028f99640 1 -- 172.21.15.7:0/1979071990 learned_addr learned my addr 172.21.15.7:0/1979071990 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.993+0000 7fc028f99640 1 -- 172.21.15.7:0/1979071990 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a77c1afad0 msgr2=0x55a77c1a97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.993+0000 7fc027f97640 1 --2- 172.21.15.7:0/1979071990 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a77c1afad0 0x55a77c1a97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.993+0000 7fc028798640 1 --2- 172.21.15.7:0/1979071990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a77c0e1e70 0x55a77c10f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.993+0000 7fc028f99640 1 --2- 172.21.15.7:0/1979071990 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a77c1afad0 0x55a77c1a97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.993+0000 7fc028f99640 1 -- 172.21.15.7:0/1979071990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a77c0e1e70 msgr2=0x55a77c10f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.993+0000 7fc028f99640 1 --2- 172.21.15.7:0/1979071990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a77c0e1e70 0x55a77c10f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.993+0000 7fc028f99640 1 -- 172.21.15.7:0/1979071990 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a77c010c50 con 0x55a77c1afeb0 2024-04-25T10:03:39.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.993+0000 7fc028798640 1 --2- 172.21.15.7:0/1979071990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a77c0e1e70 0x55a77c10f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:03:39.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.993+0000 7fc028f99640 1 --2- 172.21.15.7:0/1979071990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a77c1afeb0 0x55a77c1a9d10 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fc02000c4b0 tx=0x7fc02000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e27401dad29fe62 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:39.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.994+0000 7fc026f95640 1 -- 172.21.15.7:0/1979071990 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0200116b0 con 0x55a77c1afeb0 2024-04-25T10:03:39.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.994+0000 7fc026f95640 1 -- 172.21.15.7:0/1979071990 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc020017070 con 0x55a77c1afeb0 2024-04-25T10:03:39.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.994+0000 7fc026f95640 1 -- 172.21.15.7:0/1979071990 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc020011a90 con 0x55a77c1afeb0 2024-04-25T10:03:39.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.994+0000 7fc02b71bf40 1 -- 172.21.15.7:0/1979071990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a77c1afeb0 msgr2=0x55a77c1a9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:39.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.994+0000 7fc02b71bf40 1 --2- 172.21.15.7:0/1979071990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a77c1afeb0 0x55a77c1a9d10 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fc02000c4b0 tx=0x7fc02000c970 comp rx=0 tx=0).stop 2024-04-25T10:03:39.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.994+0000 7fc02b71bf40 1 -- 172.21.15.7:0/1979071990 shutdown_connections 2024-04-25T10:03:39.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.994+0000 7fc02b71bf40 1 --2- 172.21.15.7:0/1979071990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a77c1afeb0 0x55a77c1a9d10 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:39.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.994+0000 7fc02b71bf40 1 --2- 172.21.15.7:0/1979071990 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a77c1afad0 0x55a77c1a97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:39.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.994+0000 7fc02b71bf40 1 --2- 172.21.15.7:0/1979071990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a77c0e1e70 0x55a77c10f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:39.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.994+0000 7fc02b71bf40 1 -- 172.21.15.7:0/1979071990 >> 172.21.15.7:0/1979071990 conn(0x55a77c0e2a60 msgr2=0x55a77c12c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:39.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.994+0000 7fc02b71bf40 1 -- 172.21.15.7:0/1979071990 shutdown_connections 2024-04-25T10:03:39.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.994+0000 7fc02b71bf40 1 -- 172.21.15.7:0/1979071990 wait complete. 2024-04-25T10:03:39.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.995+0000 7fc02b71bf40 1 Processor -- start 2024-04-25T10:03:39.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.995+0000 7fc02b71bf40 1 -- start start 2024-04-25T10:03:39.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.995+0000 7fc02b71bf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a77c0e1e70 0x55a77c1a6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:39.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.995+0000 7fc02b71bf40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a77c1afad0 0x55a77c1a7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:39.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.995+0000 7fc02b71bf40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a77c1afeb0 0x55a77c1ac240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:39.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.995+0000 7fc02b71bf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a77c1ad570 con 0x55a77c0e1e70 2024-04-25T10:03:39.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.995+0000 7fc02b71bf40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a77c1b23c0 con 0x55a77c1afad0 2024-04-25T10:03:39.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.995+0000 7fc02b71bf40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a77c1b1810 con 0x55a77c1afeb0 2024-04-25T10:03:39.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.996+0000 7fc028798640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a77c0e1e70 0x55a77c1a6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:39.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.996+0000 7fc028798640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a77c0e1e70 0x55a77c1a6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43660/0 (socket says 172.21.15.7:43660) 2024-04-25T10:03:39.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.996+0000 7fc028798640 1 -- 172.21.15.7:0/2477771958 learned_addr learned my addr 172.21.15.7:0/2477771958 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:39.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.996+0000 7fc028f99640 1 --2- 172.21.15.7:0/2477771958 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a77c1afeb0 0x55a77c1ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:39.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.996+0000 7fc027f97640 1 --2- 172.21.15.7:0/2477771958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a77c1afad0 0x55a77c1a7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:39.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.996+0000 7fc028798640 1 -- 172.21.15.7:0/2477771958 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a77c1afeb0 msgr2=0x55a77c1ac240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:39.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.996+0000 7fc028798640 1 --2- 172.21.15.7:0/2477771958 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a77c1afeb0 0x55a77c1ac240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:39.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.996+0000 7fc028798640 1 -- 172.21.15.7:0/2477771958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a77c1afad0 msgr2=0x55a77c1a7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:39.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.996+0000 7fc028798640 1 --2- 172.21.15.7:0/2477771958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a77c1afad0 0x55a77c1a7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:39.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.996+0000 7fc028798640 1 -- 172.21.15.7:0/2477771958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a77c1a7e60 con 0x55a77c0e1e70 2024-04-25T10:03:39.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.996+0000 7fc027f97640 1 --2- 172.21.15.7:0/2477771958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a77c1afad0 0x55a77c1a7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:39.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.996+0000 7fc028798640 1 --2- 172.21.15.7:0/2477771958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a77c0e1e70 0x55a77c1a6520 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fc018001ea0 tx=0x7fc01800a690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:39.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.996+0000 7fc025f93640 1 -- 172.21.15.7:0/2477771958 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc018008040 con 0x55a77c0e1e70 2024-04-25T10:03:39.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.996+0000 7fc025f93640 1 -- 172.21.15.7:0/2477771958 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc018014020 con 0x55a77c0e1e70 2024-04-25T10:03:39.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.996+0000 7fc025f93640 1 -- 172.21.15.7:0/2477771958 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01800f400 con 0x55a77c0e1e70 2024-04-25T10:03:39.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.996+0000 7fc02b71bf40 1 -- 172.21.15.7:0/2477771958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a77c1a8100 con 0x55a77c0e1e70 2024-04-25T10:03:39.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.996+0000 7fc02b71bf40 1 -- 172.21.15.7:0/2477771958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a77c1a86c0 con 0x55a77c0e1e70 2024-04-25T10:03:39.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.998+0000 7fc025f93640 1 -- 172.21.15.7:0/2477771958 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc01800f5a0 con 0x55a77c0e1e70 2024-04-25T10:03:39.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.998+0000 7fc025f93640 1 --2- 172.21.15.7:0/2477771958 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc014069ee0 0x7fc01406c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:39.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.998+0000 7fc025f93640 1 -- 172.21.15.7:0/2477771958 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6245+0+0 (secure 0 0 0) 0x7fc018088d80 con 0x55a77c0e1e70 2024-04-25T10:03:39.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.998+0000 7fc027f97640 1 --2- 172.21.15.7:0/2477771958 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc014069ee0 0x7fc01406c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:39.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.998+0000 7fc02b71bf40 1 --2- 172.21.15.7:0/2477771958 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x55a77c1b8d50 0x55a77c1b9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:39.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.998+0000 7fc02b71bf40 1 -- 172.21.15.7:0/2477771958 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:1 15.13 15:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106) v9 -- 0x55a77c1b9670 con 0x55a77c1b8d50 2024-04-25T10:03:39.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.998+0000 7fc028f99640 1 --2- 172.21.15.7:0/2477771958 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x55a77c1b8d50 0x55a77c1b9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:39.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.999+0000 7fc027f97640 1 --2- 172.21.15.7:0/2477771958 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc014069ee0 0x7fc01406c3a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fc01c056000 tx=0x7fc01c050000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:39.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:38.999+0000 7fc028f99640 1 --2- 172.21.15.7:0/2477771958 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x55a77c1b8d50 0x55a77c1b9130 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:39.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.002+0000 7fc028f99640 1 -- 172.21.15.7:0/2477771958 <== osd.1 v2:172.21.15.7:6816/434435857 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~34] v106'5 uv5 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc020011890 con 0x55a77c1b8d50 2024-04-25T10:03:39.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.002+0000 7fc02b71bf40 1 -- 172.21.15.7:0/2477771958 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x55a77c1b8d50 msgr2=0x55a77c1b9130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:39.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.002+0000 7fc02b71bf40 1 --2- 172.21.15.7:0/2477771958 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x55a77c1b8d50 0x55a77c1b9130 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:39.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.002+0000 7fc02b71bf40 1 -- 172.21.15.7:0/2477771958 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc014069ee0 msgr2=0x7fc01406c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:39.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.002+0000 7fc02b71bf40 1 --2- 172.21.15.7:0/2477771958 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc014069ee0 0x7fc01406c3a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fc01c056000 tx=0x7fc01c050000 comp rx=0 tx=0).stop 2024-04-25T10:03:39.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.002+0000 7fc02b71bf40 1 -- 172.21.15.7:0/2477771958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a77c0e1e70 msgr2=0x55a77c1a6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:39.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.002+0000 7fc02b71bf40 1 --2- 172.21.15.7:0/2477771958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a77c0e1e70 0x55a77c1a6520 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fc018001ea0 tx=0x7fc01800a690 comp rx=0 tx=0).stop 2024-04-25T10:03:39.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.002+0000 7fc028f99640 1 -- 172.21.15.7:0/2477771958 reap_dead start 2024-04-25T10:03:39.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.002+0000 7fc02b71bf40 1 -- 172.21.15.7:0/2477771958 shutdown_connections 2024-04-25T10:03:39.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.002+0000 7fc02b71bf40 1 -- 172.21.15.7:0/2477771958 >> 172.21.15.7:0/2477771958 conn(0x55a77c0e2a60 msgr2=0x55a77c12c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:39.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.002+0000 7fc02b71bf40 1 -- 172.21.15.7:0/2477771958 shutdown_connections 2024-04-25T10:03:39.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.003+0000 7fc02b71bf40 1 -- 172.21.15.7:0/2477771958 wait complete. 2024-04-25T10:03:39.011 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T10:03:39.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.151+0000 7fd9d9d29640 1 Processor -- start 2024-04-25T10:03:39.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.151+0000 7fd9d9d29640 1 -- start start 2024-04-25T10:03:39.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.152+0000 7fd9d9d29640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd9d4144fe0 0x7fd9d406e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:39.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.152+0000 7fd9d9d29640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd9d4071840 0x7fd9d415c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:39.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.152+0000 7fd9d9d29640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d41453c0 con 0x7fd9d406d130 2024-04-25T10:03:39.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.152+0000 7fd9d9d29640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d40a8560 con 0x7fd9d4144fe0 2024-04-25T10:03:39.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.152+0000 7fd9d9d29640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d406d6a0 con 0x7fd9d4071840 2024-04-25T10:03:39.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.152+0000 7fd9d37fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd9d4144fe0 0x7fd9d406e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:39.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.152+0000 7fd9d3fff640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd9d4071840 0x7fd9d415c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:39.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.152+0000 7fd9d2ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd9d406d130 0x7fd9d4071130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:35092/0 (socket says 172.21.15.7:35092) 2024-04-25T10:03:39.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.152+0000 7fd9d2ffd640 1 -- 172.21.15.7:0/744246378 learned_addr learned my addr 172.21.15.7:0/744246378 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:03:39.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.152+0000 7fd9d3fff640 1 -- 172.21.15.7:0/744246378 >> v2:172.21.15.55:3300/0 conn(0x7fd9d4144fe0 msgr2=0x7fd9d406e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:39.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.152+0000 7fd9d3fff640 1 --2- 172.21.15.7:0/744246378 >> v2:172.21.15.55:3300/0 conn(0x7fd9d4144fe0 0x7fd9d406e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:39.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.152+0000 7fd9d3fff640 1 -- 172.21.15.7:0/744246378 >> v1:172.21.15.55:6789/0 conn(0x7fd9d406d130 legacy=0x7fd9d4071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:39.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.152+0000 7fd9d27fc640 1 -- 172.21.15.7:0/744246378 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654626066 0 0) 0x7fd9d41453c0 con 0x7fd9d406d130 2024-04-25T10:03:39.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.152+0000 7fd9d3fff640 1 -- 172.21.15.7:0/744246378 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d406d980 con 0x7fd9d4071840 2024-04-25T10:03:39.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.152+0000 7fd9d37fe640 1 --2- 172.21.15.7:0/744246378 >> v2:172.21.15.55:3300/0 conn(0x7fd9d4144fe0 0x7fd9d406e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:03:39.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.153+0000 7fd9d3fff640 1 --2- 172.21.15.7:0/744246378 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd9d4071840 0x7fd9d415c370 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc009d90 tx=0x7fd9cc02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25d8f27cf4ccb941 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:39.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.153+0000 7fd9d27fc640 1 -- 172.21.15.7:0/744246378 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc007740 con 0x7fd9d4071840 2024-04-25T10:03:39.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.153+0000 7fd9d27fc640 1 -- 172.21.15.7:0/744246378 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9cc0078e0 con 0x7fd9d4071840 2024-04-25T10:03:39.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.153+0000 7fd9d27fc640 1 -- 172.21.15.7:0/744246378 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc007cb0 con 0x7fd9d4071840 2024-04-25T10:03:39.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.154+0000 7fd9d9d29640 1 -- 172.21.15.7:0/744246378 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd9d4071840 msgr2=0x7fd9d415c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:39.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.154+0000 7fd9d9d29640 1 --2- 172.21.15.7:0/744246378 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd9d4071840 0x7fd9d415c370 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc009d90 tx=0x7fd9cc02a660 comp rx=0 tx=0).stop 2024-04-25T10:03:39.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.154+0000 7fd9d9d29640 1 -- 172.21.15.7:0/744246378 shutdown_connections 2024-04-25T10:03:39.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.154+0000 7fd9d9d29640 1 --2- 172.21.15.7:0/744246378 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd9d4071840 0x7fd9d415c370 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:39.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.154+0000 7fd9d9d29640 1 --2- 172.21.15.7:0/744246378 >> v2:172.21.15.55:3300/0 conn(0x7fd9d4144fe0 0x7fd9d406e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:39.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.154+0000 7fd9d9d29640 1 -- 172.21.15.7:0/744246378 >> 172.21.15.7:0/744246378 conn(0x7fd9d406ab60 msgr2=0x7fd9d406af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:39.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.154+0000 7fd9d9d29640 1 -- 172.21.15.7:0/744246378 shutdown_connections 2024-04-25T10:03:39.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.154+0000 7fd9d9d29640 1 -- 172.21.15.7:0/744246378 wait complete. 2024-04-25T10:03:39.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.155+0000 7fd9d9d29640 1 Processor -- start 2024-04-25T10:03:39.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.155+0000 7fd9d9d29640 1 -- start start 2024-04-25T10:03:39.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.156+0000 7fd9d9d29640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd9d406d130 0x7fd9d41f0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:39.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.156+0000 7fd9d9d29640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9d4071840 0x7fd9d413c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:39.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.156+0000 7fd9d9d29640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d4144fe0 0x7fd9d413f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:39.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.156+0000 7fd9d9d29640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d415be50 con 0x7fd9d4144fe0 2024-04-25T10:03:39.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.156+0000 7fd9d9d29640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d406df40 con 0x7fd9d4071840 2024-04-25T10:03:39.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.156+0000 7fd9d9d29640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d406eaa0 con 0x7fd9d406d130 2024-04-25T10:03:39.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.156+0000 7fd9d3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d4144fe0 0x7fd9d413f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:39.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.156+0000 7fd9d3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d4144fe0 0x7fd9d413f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43668/0 (socket says 172.21.15.7:43668) 2024-04-25T10:03:39.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.156+0000 7fd9d3fff640 1 -- 172.21.15.7:0/946457447 learned_addr learned my addr 172.21.15.7:0/946457447 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:39.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.156+0000 7fd9d37fe640 1 --2- 172.21.15.7:0/946457447 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd9d406d130 0x7fd9d41f0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:39.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.156+0000 7fd9d2ffd640 1 --2- 172.21.15.7:0/946457447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9d4071840 0x7fd9d413c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:39.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.157+0000 7fd9d3fff640 1 -- 172.21.15.7:0/946457447 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd9d406d130 msgr2=0x7fd9d41f0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:39.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.157+0000 7fd9d3fff640 1 --2- 172.21.15.7:0/946457447 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd9d406d130 0x7fd9d41f0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:39.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.157+0000 7fd9d3fff640 1 -- 172.21.15.7:0/946457447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9d4071840 msgr2=0x7fd9d413c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:39.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.157+0000 7fd9d3fff640 1 --2- 172.21.15.7:0/946457447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9d4071840 0x7fd9d413c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:39.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.157+0000 7fd9d3fff640 1 -- 172.21.15.7:0/946457447 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d413d410 con 0x7fd9d4144fe0 2024-04-25T10:03:39.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.157+0000 7fd9d3fff640 1 --2- 172.21.15.7:0/946457447 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d4144fe0 0x7fd9d413f2c0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc009eb0 tx=0x7fd9cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:39.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.157+0000 7fd9bbfff640 1 -- 172.21.15.7:0/946457447 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc040070 con 0x7fd9d4144fe0 2024-04-25T10:03:39.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.157+0000 7fd9bbfff640 1 -- 172.21.15.7:0/946457447 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9cc031bc0 con 0x7fd9d4144fe0 2024-04-25T10:03:39.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.157+0000 7fd9d9d29640 1 -- 172.21.15.7:0/946457447 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d413d6f0 con 0x7fd9d4144fe0 2024-04-25T10:03:39.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.157+0000 7fd9bbfff640 1 -- 172.21.15.7:0/946457447 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc009450 con 0x7fd9d4144fe0 2024-04-25T10:03:39.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.157+0000 7fd9d9d29640 1 -- 172.21.15.7:0/946457447 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d413df90 con 0x7fd9d4144fe0 2024-04-25T10:03:39.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.158+0000 7fd9d9d29640 1 -- 172.21.15.7:0/946457447 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d4068f60 con 0x7fd9d4144fe0 2024-04-25T10:03:39.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.158+0000 7fd9bbfff640 1 -- 172.21.15.7:0/946457447 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd9cc039040 con 0x7fd9d4144fe0 2024-04-25T10:03:39.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.159+0000 7fd9bbfff640 1 --2- 172.21.15.7:0/946457447 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd9c006b4d0 0x7fd9c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:39.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.159+0000 7fd9bbfff640 1 -- 172.21.15.7:0/946457447 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6245+0+0 (secure 0 0 0) 0x7fd9cc0abba0 con 0x7fd9d4144fe0 2024-04-25T10:03:39.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.159+0000 7fd9d37fe640 1 --2- 172.21.15.7:0/946457447 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd9c006b4d0 0x7fd9c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:39.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.159+0000 7fd9d37fe640 1 --2- 172.21.15.7:0/946457447 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd9c006b4d0 0x7fd9c006d990 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4009560 tx=0x7fd9c4009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:39.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.163+0000 7fd9bbfff640 1 -- 172.21.15.7:0/946457447 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd9cc07a110 con 0x7fd9d4144fe0 2024-04-25T10:03:39.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.382+0000 7fd9d9d29640 1 -- 172.21.15.7:0/946457447 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fd9d413d8c0 con 0x7fd9d4144fe0 2024-04-25T10:03:39.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.725+0000 7fd9bbfff640 1 -- 172.21.15.7:0/946457447 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v75) v1 ==== 162+0+0 (secure 0 0 0) 0x7fd9cc07e1b0 con 0x7fd9d4144fe0 2024-04-25T10:03:39.730 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T10:03:39.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.727+0000 7fd9d9d29640 1 -- 172.21.15.7:0/946457447 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd9c006b4d0 msgr2=0x7fd9c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:39.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.727+0000 7fd9d9d29640 1 --2- 172.21.15.7:0/946457447 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd9c006b4d0 0x7fd9c006d990 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4009560 tx=0x7fd9c4009190 comp rx=0 tx=0).stop 2024-04-25T10:03:39.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.727+0000 7fd9d9d29640 1 -- 172.21.15.7:0/946457447 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d4144fe0 msgr2=0x7fd9d413f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:39.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.727+0000 7fd9d9d29640 1 --2- 172.21.15.7:0/946457447 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d4144fe0 0x7fd9d413f2c0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc009eb0 tx=0x7fd9cc004a40 comp rx=0 tx=0).stop 2024-04-25T10:03:39.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.727+0000 7fd9d9d29640 1 -- 172.21.15.7:0/946457447 shutdown_connections 2024-04-25T10:03:39.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.727+0000 7fd9d9d29640 1 --2- 172.21.15.7:0/946457447 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd9c006b4d0 0x7fd9c006d990 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:39.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.727+0000 7fd9d9d29640 1 --2- 172.21.15.7:0/946457447 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d4144fe0 0x7fd9d413f2c0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:39.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.727+0000 7fd9d9d29640 1 --2- 172.21.15.7:0/946457447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9d4071840 0x7fd9d413c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:39.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.727+0000 7fd9d9d29640 1 --2- 172.21.15.7:0/946457447 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd9d406d130 0x7fd9d41f0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:39.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.727+0000 7fd9d9d29640 1 -- 172.21.15.7:0/946457447 >> 172.21.15.7:0/946457447 conn(0x7fd9d406ab60 msgr2=0x7fd9d406af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:39.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.728+0000 7fd9d9d29640 1 -- 172.21.15.7:0/946457447 shutdown_connections 2024-04-25T10:03:39.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.728+0000 7fd9d9d29640 1 -- 172.21.15.7:0/946457447 wait complete. 2024-04-25T10:03:39.745 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:03:39.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.842+0000 7f28eccbd640 1 Processor -- start 2024-04-25T10:03:39.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.842+0000 7f28eccbd640 1 -- start start 2024-04-25T10:03:39.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.843+0000 7f28eccbd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28e815b8e0 0x7f28e80d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:39.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.843+0000 7f28eccbd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f28e80cc300 0x7f28e80999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:39.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.843+0000 7f28eccbd640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e809a340 con 0x7f28e8099f30 2024-04-25T10:03:39.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.843+0000 7f28eccbd640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28e80cd7d0 con 0x7f28e80cc300 2024-04-25T10:03:39.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.843+0000 7f28eccbd640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e80ccbc0 con 0x7f28e815b8e0 2024-04-25T10:03:39.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.844+0000 7f28e5d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f28e80cc300 0x7f28e80999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:39.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.844+0000 7f28e659c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28e815b8e0 0x7f28e80d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:39.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.844+0000 7f28e6d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f28e8099f30 0x7f28e815f520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:46998/0 (socket says 172.21.15.7:46998) 2024-04-25T10:03:39.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.844+0000 7f28e6d9d640 1 -- 172.21.15.7:0/3769501209 learned_addr learned my addr 172.21.15.7:0/3769501209 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:03:39.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.844+0000 7f28e5d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f28e80cc300 0x7f28e80999f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:36096/0 (socket says 172.21.15.7:36096) 2024-04-25T10:03:39.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.844+0000 7f28e659c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28e815b8e0 0x7f28e80d0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:50146/0 (socket says 172.21.15.7:50146) 2024-04-25T10:03:39.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.844+0000 7f28e559a640 1 -- 172.21.15.7:0/3769501209 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1310207831 0 0) 0x7f28e0001490 con 0x7f28e8099f30 2024-04-25T10:03:39.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.844+0000 7f28e559a640 1 -- 172.21.15.7:0/3769501209 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28d4003520 con 0x7f28e8099f30 2024-04-25T10:03:39.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.844+0000 7f28e5d9b640 1 -- 172.21.15.7:0/3769501209 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28e815b8e0 msgr2=0x7f28e80d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:39.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.844+0000 7f28e5d9b640 1 --2- 172.21.15.7:0/3769501209 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28e815b8e0 0x7f28e80d0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:39.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.844+0000 7f28e5d9b640 1 -- 172.21.15.7:0/3769501209 >> v1:172.21.15.55:6789/0 conn(0x7f28e8099f30 legacy=0x7f28e815f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:39.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.844+0000 7f28e5d9b640 1 -- 172.21.15.7:0/3769501209 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e80ccea0 con 0x7f28e80cc300 2024-04-25T10:03:39.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.844+0000 7f28e659c640 1 --2- 172.21.15.7:0/3769501209 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28e815b8e0 0x7f28e80d0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:03:39.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.845+0000 7f28e5d9b640 1 --2- 172.21.15.7:0/3769501209 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28e80cc300 0x7f28e80999f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f28d80097a0 tx=0x7f28d802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d02a06cf2da54ad9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:39.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.845+0000 7f28e559a640 1 -- 172.21.15.7:0/3769501209 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d8037070 con 0x7f28e80cc300 2024-04-25T10:03:39.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.845+0000 7f28e559a640 1 -- 172.21.15.7:0/3769501209 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d8032440 con 0x7f28e80cc300 2024-04-25T10:03:39.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.845+0000 7f28e559a640 1 -- 172.21.15.7:0/3769501209 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d8032810 con 0x7f28e80cc300 2024-04-25T10:03:39.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.846+0000 7f28eccbd640 1 -- 172.21.15.7:0/3769501209 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28e80cc300 msgr2=0x7f28e80999f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:39.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.846+0000 7f28eccbd640 1 --2- 172.21.15.7:0/3769501209 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28e80cc300 0x7f28e80999f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f28d80097a0 tx=0x7f28d802a180 comp rx=0 tx=0).stop 2024-04-25T10:03:39.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.846+0000 7f28eccbd640 1 -- 172.21.15.7:0/3769501209 shutdown_connections 2024-04-25T10:03:39.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.846+0000 7f28eccbd640 1 --2- 172.21.15.7:0/3769501209 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28e80cc300 0x7f28e80999f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:39.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.846+0000 7f28eccbd640 1 --2- 172.21.15.7:0/3769501209 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28e815b8e0 0x7f28e80d0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:39.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.846+0000 7f28eccbd640 1 -- 172.21.15.7:0/3769501209 >> 172.21.15.7:0/3769501209 conn(0x7f28e80b3130 msgr2=0x7f28e80b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:39.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.846+0000 7f28eccbd640 1 -- 172.21.15.7:0/3769501209 shutdown_connections 2024-04-25T10:03:39.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.846+0000 7f28eccbd640 1 -- 172.21.15.7:0/3769501209 wait complete. 2024-04-25T10:03:39.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.847+0000 7f28eccbd640 1 Processor -- start 2024-04-25T10:03:39.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.847+0000 7f28eccbd640 1 -- start start 2024-04-25T10:03:39.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.848+0000 7f28eccbd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28e8099f30 0x7f28e80ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:39.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.848+0000 7f28eccbd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28e80cc300 0x7f28e806d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:39.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.848+0000 7f28eccbd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28e815b8e0 0x7f28e8156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:39.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.848+0000 7f28eccbd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e815bcc0 con 0x7f28e80cc300 2024-04-25T10:03:39.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.848+0000 7f28eccbd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e80cd460 con 0x7f28e8099f30 2024-04-25T10:03:39.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.848+0000 7f28eccbd640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e815be40 con 0x7f28e815b8e0 2024-04-25T10:03:39.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.848+0000 7f28e5d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28e80cc300 0x7f28e806d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:39.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.848+0000 7f28e5d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28e80cc300 0x7f28e806d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35574/0 (socket says 172.21.15.7:35574) 2024-04-25T10:03:39.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.848+0000 7f28e5d9b640 1 -- 172.21.15.7:0/492533411 learned_addr learned my addr 172.21.15.7:0/492533411 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:39.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.848+0000 7f28e6d9d640 1 --2- 172.21.15.7:0/492533411 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28e815b8e0 0x7f28e8156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:39.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.848+0000 7f28e659c640 1 --2- 172.21.15.7:0/492533411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28e8099f30 0x7f28e80ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:39.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.848+0000 7f28e5d9b640 1 -- 172.21.15.7:0/492533411 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28e815b8e0 msgr2=0x7f28e8156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:39.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.848+0000 7f28e5d9b640 1 --2- 172.21.15.7:0/492533411 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28e815b8e0 0x7f28e8156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:39.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.848+0000 7f28e5d9b640 1 -- 172.21.15.7:0/492533411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28e8099f30 msgr2=0x7f28e80ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:39.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.848+0000 7f28e5d9b640 1 --2- 172.21.15.7:0/492533411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28e8099f30 0x7f28e80ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:39.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.848+0000 7f28e5d9b640 1 -- 172.21.15.7:0/492533411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e806bc70 con 0x7f28e80cc300 2024-04-25T10:03:39.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.848+0000 7f28e6d9d640 1 --2- 172.21.15.7:0/492533411 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28e815b8e0 0x7f28e8156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:39.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.849+0000 7f28e5d9b640 1 --2- 172.21.15.7:0/492533411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28e80cc300 0x7f28e806d2e0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f28d8035040 tx=0x7f28d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:39.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.849+0000 7f28deffd640 1 -- 172.21.15.7:0/492533411 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d8041030 con 0x7f28e80cc300 2024-04-25T10:03:39.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.849+0000 7f28deffd640 1 -- 172.21.15.7:0/492533411 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d803d4e0 con 0x7f28e80cc300 2024-04-25T10:03:39.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.849+0000 7f28deffd640 1 -- 172.21.15.7:0/492533411 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d8037040 con 0x7f28e80cc300 2024-04-25T10:03:39.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.849+0000 7f28eccbd640 1 -- 172.21.15.7:0/492533411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e806bf50 con 0x7f28e80cc300 2024-04-25T10:03:39.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.849+0000 7f28eccbd640 1 -- 172.21.15.7:0/492533411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e806c7f0 con 0x7f28e80cc300 2024-04-25T10:03:39.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.850+0000 7f28eccbd640 1 -- 172.21.15.7:0/492533411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e80d1210 con 0x7f28e80cc300 2024-04-25T10:03:39.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.850+0000 7f28deffd640 1 -- 172.21.15.7:0/492533411 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f28d8044070 con 0x7f28e80cc300 2024-04-25T10:03:39.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.851+0000 7f28deffd640 1 --2- 172.21.15.7:0/492533411 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f28c806b4d0 0x7f28c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:39.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.851+0000 7f28deffd640 1 -- 172.21.15.7:0/492533411 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f28d80aa9f0 con 0x7f28e80cc300 2024-04-25T10:03:39.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.851+0000 7f28e659c640 1 --2- 172.21.15.7:0/492533411 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f28c806b4d0 0x7f28c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:39.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.851+0000 7f28e659c640 1 --2- 172.21.15.7:0/492533411 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f28c806b4d0 0x7f28c806d990 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f28d0009560 tx=0x7f28d0009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:39.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:39.855+0000 7f28deffd640 1 -- 172.21.15.7:0/492533411 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f28e80d1210 con 0x7f28e80cc300 2024-04-25T10:03:40.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:40.072+0000 7f28eccbd640 1 -- 172.21.15.7:0/492533411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28e80d0900 con 0x7f28e80cc300 2024-04-25T10:03:40.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:40.072+0000 7f28deffd640 1 -- 172.21.15.7:0/492533411 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4936 (secure 0 0 0) 0x7f28e80d0900 con 0x7f28e80cc300 2024-04-25T10:03:40.077 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:03:40.077 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":76,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6617,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3278722694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3278722694},{"type":"v1","addr":"172.21.15.55:6835","nonce":3278722694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":7435,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3598653097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3598653097},{"type":"v1","addr":"172.21.15.55:6834","nonce":3598653097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":8361,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3628875229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3628875229},{"type":"v1","addr":"172.21.15.7:6836","nonce":3628875229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:02:49.944298+0000","modified":"2024-04-25T10:03:39.728819+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8736},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8736":{"gid":8736,"name":"a","rank":0,"incarnation":76,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6837/1214875974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1214875974},{"type":"v1","addr":"172.21.15.7:6837","nonce":1214875974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T10:03:40.078 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 76 2024-04-25T10:03:40.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:40.074+0000 7f28eccbd640 1 -- 172.21.15.7:0/492533411 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f28c806b4d0 msgr2=0x7f28c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:40.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:40.074+0000 7f28eccbd640 1 --2- 172.21.15.7:0/492533411 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f28c806b4d0 0x7f28c806d990 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f28d0009560 tx=0x7f28d0009190 comp rx=0 tx=0).stop 2024-04-25T10:03:40.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:40.074+0000 7f28eccbd640 1 -- 172.21.15.7:0/492533411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28e80cc300 msgr2=0x7f28e806d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:40.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:40.074+0000 7f28eccbd640 1 --2- 172.21.15.7:0/492533411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28e80cc300 0x7f28e806d2e0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f28d8035040 tx=0x7f28d80046c0 comp rx=0 tx=0).stop 2024-04-25T10:03:40.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:40.074+0000 7f28eccbd640 1 -- 172.21.15.7:0/492533411 shutdown_connections 2024-04-25T10:03:40.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:40.074+0000 7f28eccbd640 1 --2- 172.21.15.7:0/492533411 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f28c806b4d0 0x7f28c806d990 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:40.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:40.074+0000 7f28eccbd640 1 --2- 172.21.15.7:0/492533411 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28e815b8e0 0x7f28e8156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:40.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:40.074+0000 7f28eccbd640 1 --2- 172.21.15.7:0/492533411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28e80cc300 0x7f28e806d2e0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:40.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:40.074+0000 7f28eccbd640 1 --2- 172.21.15.7:0/492533411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28e8099f30 0x7f28e80ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:40.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:40.074+0000 7f28eccbd640 1 -- 172.21.15.7:0/492533411 >> 172.21.15.7:0/492533411 conn(0x7f28e80b3130 msgr2=0x7f28e8073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:40.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:40.074+0000 7f28eccbd640 1 -- 172.21.15.7:0/492533411 shutdown_connections 2024-04-25T10:03:40.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:40.074+0000 7f28eccbd640 1 -- 172.21.15.7:0/492533411 wait complete. 2024-04-25T10:03:40.493 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 76, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:02:49.944298+0000', 'modified': '2024-04-25T10:03:39.728819+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 106, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8736}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8736': {'gid': 8736, 'name': 'a', 'rank': 0, 'incarnation': 76, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.7:6837/1214875974', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6835', 'nonce': 1214875974}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 1214875974}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:03:40.493 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8736:up:replay 2024-04-25T10:03:41.495 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:03:41.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.604+0000 7fe5ab134640 1 Processor -- start 2024-04-25T10:03:41.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.604+0000 7fe5ab134640 1 -- start start 2024-04-25T10:03:41.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.605+0000 7fe5ab134640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe5a415da60 0x7fe5a40d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:41.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.605+0000 7fe5ab134640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a415e8a0 con 0x7fe5a415e2d0 2024-04-25T10:03:41.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.605+0000 7fe5ab134640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a415eb80 con 0x7fe5a415de40 2024-04-25T10:03:41.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.605+0000 7fe5ab134640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a415ee60 con 0x7fe5a415da60 2024-04-25T10:03:41.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.605+0000 7fe5a8ed0640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe5a415da60 0x7fe5a40d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:41.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.605+0000 7fe5a96d1640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe5a415e2d0 0x7fe5a40ce520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:57602/0 (socket says 172.21.15.7:57602) 2024-04-25T10:03:41.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.605+0000 7fe5a96d1640 1 -- 172.21.15.7:0/4234286109 learned_addr learned my addr 172.21.15.7:0/4234286109 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:03:41.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.605+0000 7fe5a8ed0640 1 -- 172.21.15.7:0/4234286109 >> v1:172.21.15.55:6789/0 conn(0x7fe5a415de40 legacy=0x7fe5a4161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:41.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.605+0000 7fe5a8ed0640 1 -- 172.21.15.7:0/4234286109 >> v1:172.21.15.7:6789/0 conn(0x7fe5a415e2d0 legacy=0x7fe5a40ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:41.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.605+0000 7fe5a8ed0640 1 -- 172.21.15.7:0/4234286109 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a4161850 con 0x7fe5a415da60 2024-04-25T10:03:41.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.605+0000 7fe5a37fe640 1 -- 172.21.15.7:0/4234286109 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034826400 0 0) 0x7fe5a415e8a0 con 0x7fe5a415e2d0 2024-04-25T10:03:41.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.606+0000 7fe5a8ed0640 1 --2- 172.21.15.7:0/4234286109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5a415da60 0x7fe5a40d0aa0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fe5980097a0 tx=0x7fe59802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b343d9d30a16b510 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:41.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.606+0000 7fe5a37fe640 1 -- 172.21.15.7:0/4234286109 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe598037070 con 0x7fe5a415da60 2024-04-25T10:03:41.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.606+0000 7fe5a37fe640 1 -- 172.21.15.7:0/4234286109 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59802ae50 con 0x7fe5a415da60 2024-04-25T10:03:41.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.606+0000 7fe5a37fe640 1 -- 172.21.15.7:0/4234286109 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe598032660 con 0x7fe5a415da60 2024-04-25T10:03:41.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.607+0000 7fe5ab134640 1 -- 172.21.15.7:0/4234286109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5a415da60 msgr2=0x7fe5a40d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:41.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.607+0000 7fe5ab134640 1 --2- 172.21.15.7:0/4234286109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5a415da60 0x7fe5a40d0aa0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fe5980097a0 tx=0x7fe59802a140 comp rx=0 tx=0).stop 2024-04-25T10:03:41.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.607+0000 7fe5ab134640 1 -- 172.21.15.7:0/4234286109 shutdown_connections 2024-04-25T10:03:41.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.607+0000 7fe5ab134640 1 --2- 172.21.15.7:0/4234286109 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5a415da60 0x7fe5a40d0aa0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:41.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.607+0000 7fe5ab134640 1 -- 172.21.15.7:0/4234286109 >> 172.21.15.7:0/4234286109 conn(0x7fe5a406bfe0 msgr2=0x7fe5a406c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:41.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.607+0000 7fe5ab134640 1 -- 172.21.15.7:0/4234286109 shutdown_connections 2024-04-25T10:03:41.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.607+0000 7fe5ab134640 1 -- 172.21.15.7:0/4234286109 wait complete. 2024-04-25T10:03:41.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.608+0000 7fe5ab134640 1 Processor -- start 2024-04-25T10:03:41.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.608+0000 7fe5ab134640 1 -- start start 2024-04-25T10:03:41.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.609+0000 7fe5ab134640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5a415da60 0x7fe5a4152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:41.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.609+0000 7fe5ab134640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe5a415de40 0x7fe5a40b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:41.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.609+0000 7fe5ab134640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5a415e2d0 0x7fe5a40abff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:41.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.609+0000 7fe5ab134640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a40cedb0 con 0x7fe5a415e2d0 2024-04-25T10:03:41.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.609+0000 7fe5ab134640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a40cec30 con 0x7fe5a415da60 2024-04-25T10:03:41.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.609+0000 7fe5ab134640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a40d2ca0 con 0x7fe5a415de40 2024-04-25T10:03:41.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.609+0000 7fe5a96d1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5a415e2d0 0x7fe5a40abff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:41.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.609+0000 7fe5a96d1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5a415e2d0 0x7fe5a40abff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35596/0 (socket says 172.21.15.7:35596) 2024-04-25T10:03:41.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.609+0000 7fe5a96d1640 1 -- 172.21.15.7:0/693248000 learned_addr learned my addr 172.21.15.7:0/693248000 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:41.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.609+0000 7fe5a8ed0640 1 --2- 172.21.15.7:0/693248000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5a415da60 0x7fe5a4152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:41.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.609+0000 7fe5a96d1640 1 -- 172.21.15.7:0/693248000 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe5a415de40 msgr2=0x7fe5a40b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:41.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.609+0000 7fe5a3fff640 1 --2- 172.21.15.7:0/693248000 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe5a415de40 0x7fe5a40b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:41.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.609+0000 7fe5a96d1640 1 --2- 172.21.15.7:0/693248000 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe5a415de40 0x7fe5a40b32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:41.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.609+0000 7fe5a96d1640 1 -- 172.21.15.7:0/693248000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5a415da60 msgr2=0x7fe5a4152290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:41.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.609+0000 7fe5a96d1640 1 --2- 172.21.15.7:0/693248000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5a415da60 0x7fe5a4152290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:41.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.609+0000 7fe5a96d1640 1 -- 172.21.15.7:0/693248000 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a40b3d30 con 0x7fe5a415e2d0 2024-04-25T10:03:41.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.609+0000 7fe5a8ed0640 1 --2- 172.21.15.7:0/693248000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5a415da60 0x7fe5a4152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:03:41.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.610+0000 7fe5a96d1640 1 --2- 172.21.15.7:0/693248000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5a415e2d0 0x7fe5a40abff0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00c700 tx=0x7fe59c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:41.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.610+0000 7fe5a17fa640 1 -- 172.21.15.7:0/693248000 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c018070 con 0x7fe5a415e2d0 2024-04-25T10:03:41.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.610+0000 7fe5a17fa640 1 -- 172.21.15.7:0/693248000 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59c00ce10 con 0x7fe5a415e2d0 2024-04-25T10:03:41.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.610+0000 7fe5ab134640 1 -- 172.21.15.7:0/693248000 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a40b4010 con 0x7fe5a415e2d0 2024-04-25T10:03:41.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.610+0000 7fe5a17fa640 1 -- 172.21.15.7:0/693248000 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c00a860 con 0x7fe5a415e2d0 2024-04-25T10:03:41.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.610+0000 7fe5ab134640 1 -- 172.21.15.7:0/693248000 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a40b45d0 con 0x7fe5a415e2d0 2024-04-25T10:03:41.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.611+0000 7fe5ab134640 1 -- 172.21.15.7:0/693248000 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a4068fd0 con 0x7fe5a415e2d0 2024-04-25T10:03:41.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.611+0000 7fe5a17fa640 1 -- 172.21.15.7:0/693248000 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe59c01b070 con 0x7fe5a415e2d0 2024-04-25T10:03:41.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.612+0000 7fe5a17fa640 1 --2- 172.21.15.7:0/693248000 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe58806b4d0 0x7fe58806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:41.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.612+0000 7fe5a17fa640 1 -- 172.21.15.7:0/693248000 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6245+0+0 (secure 0 0 0) 0x7fe59c089a60 con 0x7fe5a415e2d0 2024-04-25T10:03:41.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.612+0000 7fe5a8ed0640 1 --2- 172.21.15.7:0/693248000 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe58806b4d0 0x7fe58806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:41.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.612+0000 7fe5a8ed0640 1 --2- 172.21.15.7:0/693248000 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe58806b4d0 0x7fe58806d990 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe598034000 tx=0x7fe59802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:41.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.616+0000 7fe5a17fa640 1 -- 172.21.15.7:0/693248000 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe59c058630 con 0x7fe5a415e2d0 2024-04-25T10:03:41.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.838+0000 7fe5ab134640 1 -- 172.21.15.7:0/693248000 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5a40d1560 con 0x7fe5a415e2d0 2024-04-25T10:03:41.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.838+0000 7fe5a17fa640 1 -- 172.21.15.7:0/693248000 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4936 (secure 0 0 0) 0x7fe59c057f30 con 0x7fe5a415e2d0 2024-04-25T10:03:41.843 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:03:41.843 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":78,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6617,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3278722694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3278722694},{"type":"v1","addr":"172.21.15.55:6835","nonce":3278722694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":7435,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3598653097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3598653097},{"type":"v1","addr":"172.21.15.55:6834","nonce":3598653097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":8361,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3628875229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3628875229},{"type":"v1","addr":"172.21.15.7:6836","nonce":3628875229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:02:49.944298+0000","modified":"2024-04-25T10:03:40.749833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8736},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8736":{"gid":8736,"name":"a","rank":0,"incarnation":76,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.7:6837/1214875974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1214875974},{"type":"v1","addr":"172.21.15.7:6837","nonce":1214875974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T10:03:41.844 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 78 2024-04-25T10:03:41.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.840+0000 7fe5ab134640 1 -- 172.21.15.7:0/693248000 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe58806b4d0 msgr2=0x7fe58806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:41.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.840+0000 7fe5ab134640 1 --2- 172.21.15.7:0/693248000 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe58806b4d0 0x7fe58806d990 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe598034000 tx=0x7fe59802e000 comp rx=0 tx=0).stop 2024-04-25T10:03:41.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.840+0000 7fe5ab134640 1 -- 172.21.15.7:0/693248000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5a415e2d0 msgr2=0x7fe5a40abff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:41.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.840+0000 7fe5ab134640 1 --2- 172.21.15.7:0/693248000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5a415e2d0 0x7fe5a40abff0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00c700 tx=0x7fe59c00cbc0 comp rx=0 tx=0).stop 2024-04-25T10:03:41.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.840+0000 7fe5ab134640 1 -- 172.21.15.7:0/693248000 shutdown_connections 2024-04-25T10:03:41.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.840+0000 7fe5ab134640 1 --2- 172.21.15.7:0/693248000 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe58806b4d0 0x7fe58806d990 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:41.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.840+0000 7fe5ab134640 1 --2- 172.21.15.7:0/693248000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5a415e2d0 0x7fe5a40abff0 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:41.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.840+0000 7fe5ab134640 1 --2- 172.21.15.7:0/693248000 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe5a415de40 0x7fe5a40b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:41.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.840+0000 7fe5ab134640 1 --2- 172.21.15.7:0/693248000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5a415da60 0x7fe5a4152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:41.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.840+0000 7fe5ab134640 1 -- 172.21.15.7:0/693248000 >> 172.21.15.7:0/693248000 conn(0x7fe5a406bfe0 msgr2=0x7fe5a40c9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:41.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.840+0000 7fe5ab134640 1 -- 172.21.15.7:0/693248000 shutdown_connections 2024-04-25T10:03:41.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:41.840+0000 7fe5ab134640 1 -- 172.21.15.7:0/693248000 wait complete. 2024-04-25T10:03:42.259 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 78, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:02:49.944298+0000', 'modified': '2024-04-25T10:03:40.749833+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 106, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8736}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8736': {'gid': 8736, 'name': 'a', 'rank': 0, 'incarnation': 76, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.7:6837/1214875974', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6835', 'nonce': 1214875974}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 1214875974}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:03:42.259 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8736:up:rejoin 2024-04-25T10:03:43.260 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:03:43.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.369+0000 7f20d4d48640 1 Processor -- start 2024-04-25T10:03:43.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.369+0000 7f20d4d48640 1 -- start start 2024-04-25T10:03:43.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.370+0000 7f20d4d48640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f20d00d0aa0 0x7f20d0161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:43.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.370+0000 7f20d4d48640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f20d01622b0 0x7f20d00ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:43.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.370+0000 7f20d4d48640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d015e8a0 con 0x7f20d015da60 2024-04-25T10:03:43.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.370+0000 7f20d4d48640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d015eb80 con 0x7f20d00d0aa0 2024-04-25T10:03:43.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.370+0000 7f20d4d48640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d015ee60 con 0x7f20d01622b0 2024-04-25T10:03:43.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.370+0000 7f20ced9d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f20d01622b0 0x7f20d00ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:43.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.370+0000 7f20c7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f20d00d0aa0 0x7f20d0161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:43.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.370+0000 7f20c7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f20d00d0aa0 0x7f20d0161d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:36132/0 (socket says 172.21.15.7:36132) 2024-04-25T10:03:43.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.370+0000 7f20ced9d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f20d01622b0 0x7f20d00ce520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:50170/0 (socket says 172.21.15.7:50170) 2024-04-25T10:03:43.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.370+0000 7f20c7fff640 1 -- 172.21.15.7:0/454827498 learned_addr learned my addr 172.21.15.7:0/454827498 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:43.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.370+0000 7f20ce59c640 1 --1- 172.21.15.7:0/454827498 >> v1:172.21.15.55:6789/0 conn(0x7f20d015da60 0x7f20d015de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:47016/0 (socket says 172.21.15.7:47016) 2024-04-25T10:03:43.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.371+0000 7f20ced9d640 1 -- 172.21.15.7:0/454827498 >> v2:172.21.15.55:3300/0 conn(0x7f20d00d0aa0 msgr2=0x7f20d0161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:43.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.371+0000 7f20ced9d640 1 --2- 172.21.15.7:0/454827498 >> v2:172.21.15.55:3300/0 conn(0x7f20d00d0aa0 0x7f20d0161d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:43.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.371+0000 7f20ced9d640 1 -- 172.21.15.7:0/454827498 >> v1:172.21.15.55:6789/0 conn(0x7f20d015da60 legacy=0x7f20d015de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:43.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.371+0000 7f20ced9d640 1 -- 172.21.15.7:0/454827498 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d0161850 con 0x7f20d01622b0 2024-04-25T10:03:43.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.371+0000 7f20c7fff640 1 --2- 172.21.15.7:0/454827498 >> v2:172.21.15.55:3300/0 conn(0x7f20d00d0aa0 0x7f20d0161d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:03:43.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.371+0000 7f20ced9d640 1 --2- 172.21.15.7:0/454827498 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f20d01622b0 0x7f20d00ce520 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f20c8009d90 tx=0x7f20c802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bebe6bc614348bba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:43.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.371+0000 7f20cdd9b640 1 -- 172.21.15.7:0/454827498 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c8031600 con 0x7f20d01622b0 2024-04-25T10:03:43.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.372+0000 7f20cdd9b640 1 -- 172.21.15.7:0/454827498 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c80317a0 con 0x7f20d01622b0 2024-04-25T10:03:43.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.372+0000 7f20cdd9b640 1 -- 172.21.15.7:0/454827498 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c8031b70 con 0x7f20d01622b0 2024-04-25T10:03:43.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.372+0000 7f20d4d48640 1 -- 172.21.15.7:0/454827498 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f20d01622b0 msgr2=0x7f20d00ce520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:43.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.372+0000 7f20d4d48640 1 --2- 172.21.15.7:0/454827498 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f20d01622b0 0x7f20d00ce520 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f20c8009d90 tx=0x7f20c802a5d0 comp rx=0 tx=0).stop 2024-04-25T10:03:43.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.372+0000 7f20d4d48640 1 -- 172.21.15.7:0/454827498 shutdown_connections 2024-04-25T10:03:43.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.372+0000 7f20d4d48640 1 --2- 172.21.15.7:0/454827498 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f20d01622b0 0x7f20d00ce520 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:43.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.372+0000 7f20d4d48640 1 --2- 172.21.15.7:0/454827498 >> v2:172.21.15.55:3300/0 conn(0x7f20d00d0aa0 0x7f20d0161d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:43.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.372+0000 7f20d4d48640 1 -- 172.21.15.7:0/454827498 >> 172.21.15.7:0/454827498 conn(0x7f20d006bfe0 msgr2=0x7f20d006c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:43.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.372+0000 7f20d4d48640 1 -- 172.21.15.7:0/454827498 shutdown_connections 2024-04-25T10:03:43.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.372+0000 7f20d4d48640 1 -- 172.21.15.7:0/454827498 wait complete. 2024-04-25T10:03:43.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.373+0000 7f20d4d48640 1 Processor -- start 2024-04-25T10:03:43.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.374+0000 7f20d4d48640 1 -- start start 2024-04-25T10:03:43.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.374+0000 7f20d4d48640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20d00d0aa0 0x7f20d0158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:43.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.374+0000 7f20d4d48640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20d015da60 0x7f20d015a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:43.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.374+0000 7f20d4d48640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f20d01622b0 0x7f20d01e8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:43.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.374+0000 7f20d4d48640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d00cebe0 con 0x7f20d015da60 2024-04-25T10:03:43.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.374+0000 7f20d4d48640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d00cea60 con 0x7f20d00d0aa0 2024-04-25T10:03:43.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.374+0000 7f20d4d48640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d00ced60 con 0x7f20d01622b0 2024-04-25T10:03:43.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.374+0000 7f20c7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20d015da60 0x7f20d015a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:43.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.374+0000 7f20c7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20d015da60 0x7f20d015a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35608/0 (socket says 172.21.15.7:35608) 2024-04-25T10:03:43.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.374+0000 7f20c7fff640 1 -- 172.21.15.7:0/2750661449 learned_addr learned my addr 172.21.15.7:0/2750661449 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:43.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.375+0000 7f20ced9d640 1 --2- 172.21.15.7:0/2750661449 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f20d01622b0 0x7f20d01e8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:43.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.375+0000 7f20ce59c640 1 --2- 172.21.15.7:0/2750661449 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20d00d0aa0 0x7f20d0158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:43.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.375+0000 7f20c7fff640 1 -- 172.21.15.7:0/2750661449 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f20d01622b0 msgr2=0x7f20d01e8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:43.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.375+0000 7f20c7fff640 1 --2- 172.21.15.7:0/2750661449 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f20d01622b0 0x7f20d01e8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:43.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.375+0000 7f20c7fff640 1 -- 172.21.15.7:0/2750661449 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20d00d0aa0 msgr2=0x7f20d0158170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:43.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.375+0000 7f20c7fff640 1 --2- 172.21.15.7:0/2750661449 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20d00d0aa0 0x7f20d0158170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:43.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.375+0000 7f20c7fff640 1 -- 172.21.15.7:0/2750661449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d0157970 con 0x7f20d015da60 2024-04-25T10:03:43.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.375+0000 7f20c7fff640 1 --2- 172.21.15.7:0/2750661449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20d015da60 0x7f20d015a440 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f20b800e9b0 tx=0x7f20b800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:43.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.375+0000 7f20c6ffd640 1 -- 172.21.15.7:0/2750661449 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b8017070 con 0x7f20d015da60 2024-04-25T10:03:43.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.375+0000 7f20c6ffd640 1 -- 172.21.15.7:0/2750661449 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b800c9a0 con 0x7f20d015da60 2024-04-25T10:03:43.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.375+0000 7f20d4d48640 1 -- 172.21.15.7:0/2750661449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d0157c50 con 0x7f20d015da60 2024-04-25T10:03:43.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.375+0000 7f20c6ffd640 1 -- 172.21.15.7:0/2750661449 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b800cd50 con 0x7f20d015da60 2024-04-25T10:03:43.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.375+0000 7f20d4d48640 1 -- 172.21.15.7:0/2750661449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d01586b0 con 0x7f20d015da60 2024-04-25T10:03:43.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.376+0000 7f20d4d48640 1 -- 172.21.15.7:0/2750661449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d00b5970 con 0x7f20d015da60 2024-04-25T10:03:43.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.377+0000 7f20c6ffd640 1 -- 172.21.15.7:0/2750661449 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f20b801a070 con 0x7f20d015da60 2024-04-25T10:03:43.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.377+0000 7f20c6ffd640 1 --2- 172.21.15.7:0/2750661449 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f20b006b500 0x7f20b006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:43.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.377+0000 7f20c6ffd640 1 -- 172.21.15.7:0/2750661449 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f20b808a640 con 0x7f20d015da60 2024-04-25T10:03:43.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.377+0000 7f20ce59c640 1 --2- 172.21.15.7:0/2750661449 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f20b006b500 0x7f20b006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:43.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.378+0000 7f20ce59c640 1 --2- 172.21.15.7:0/2750661449 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f20b006b500 0x7f20b006d9c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f20c0000f60 tx=0x7f20c0007ce0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:43.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.381+0000 7f20c6ffd640 1 -- 172.21.15.7:0/2750661449 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f20b80592a0 con 0x7f20d015da60 2024-04-25T10:03:43.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.600+0000 7f20d4d48640 1 -- 172.21.15.7:0/2750661449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20d0157e20 con 0x7f20d015da60 2024-04-25T10:03:43.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.601+0000 7f20c6ffd640 1 -- 172.21.15.7:0/2750661449 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4936 (secure 0 0 0) 0x7f20d0157e20 con 0x7f20d015da60 2024-04-25T10:03:43.606 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:03:43.606 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":79,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6617,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3278722694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3278722694},{"type":"v1","addr":"172.21.15.55:6835","nonce":3278722694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":7435,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3598653097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3598653097},{"type":"v1","addr":"172.21.15.55:6834","nonce":3598653097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":8361,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3628875229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3628875229},{"type":"v1","addr":"172.21.15.7:6836","nonce":3628875229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:02:49.944298+0000","modified":"2024-04-25T10:03:41.751469+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8736},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8736":{"gid":8736,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6837/1214875974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1214875974},{"type":"v1","addr":"172.21.15.7:6837","nonce":1214875974}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T10:03:43.606 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 79 2024-04-25T10:03:43.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.602+0000 7f20d4d48640 1 -- 172.21.15.7:0/2750661449 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f20b006b500 msgr2=0x7f20b006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:43.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.602+0000 7f20d4d48640 1 --2- 172.21.15.7:0/2750661449 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f20b006b500 0x7f20b006d9c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f20c0000f60 tx=0x7f20c0007ce0 comp rx=0 tx=0).stop 2024-04-25T10:03:43.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.602+0000 7f20d4d48640 1 -- 172.21.15.7:0/2750661449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20d015da60 msgr2=0x7f20d015a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:43.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.602+0000 7f20d4d48640 1 --2- 172.21.15.7:0/2750661449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20d015da60 0x7f20d015a440 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f20b800e9b0 tx=0x7f20b800ee70 comp rx=0 tx=0).stop 2024-04-25T10:03:43.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.602+0000 7f20d4d48640 1 -- 172.21.15.7:0/2750661449 shutdown_connections 2024-04-25T10:03:43.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.602+0000 7f20d4d48640 1 --2- 172.21.15.7:0/2750661449 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f20b006b500 0x7f20b006d9c0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:43.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.602+0000 7f20d4d48640 1 --2- 172.21.15.7:0/2750661449 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f20d01622b0 0x7f20d01e8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:43.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.602+0000 7f20d4d48640 1 --2- 172.21.15.7:0/2750661449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20d015da60 0x7f20d015a440 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:43.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.602+0000 7f20d4d48640 1 --2- 172.21.15.7:0/2750661449 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20d00d0aa0 0x7f20d0158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:43.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.603+0000 7f20d4d48640 1 -- 172.21.15.7:0/2750661449 >> 172.21.15.7:0/2750661449 conn(0x7f20d006bfe0 msgr2=0x7f20d006c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:43.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.603+0000 7f20d4d48640 1 -- 172.21.15.7:0/2750661449 shutdown_connections 2024-04-25T10:03:43.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:43.603+0000 7f20d4d48640 1 -- 172.21.15.7:0/2750661449 wait complete. 2024-04-25T10:03:44.024 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 79, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:02:49.944298+0000', 'modified': '2024-04-25T10:03:41.751469+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 106, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8736}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8736': {'gid': 8736, 'name': 'a', 'rank': 0, 'incarnation': 76, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.7:6837/1214875974', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6835', 'nonce': 1214875974}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 1214875974}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:03:44.024 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T10:03:44.025 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T10:03:44.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.125+0000 7fb151815640 1 Processor -- start 2024-04-25T10:03:44.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.125+0000 7fb151815640 1 -- start start 2024-04-25T10:03:44.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.126+0000 7fb151815640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb14c06bce0 0x7fb14c09a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.126+0000 7fb151815640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb14c0d0360 0x7fb14c0cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.126+0000 7fb151815640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb14c099b20 con 0x7fb14c06c250 2024-04-25T10:03:44.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.126+0000 7fb151815640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb14c09ae20 con 0x7fb14c0d0360 2024-04-25T10:03:44.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.126+0000 7fb151815640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c09a450 con 0x7fb14c06bce0 2024-04-25T10:03:44.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.126+0000 7fb14b7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb14c0d0360 0x7fb14c0cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.126+0000 7fb14b7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb14c0d0360 0x7fb14c0cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35612/0 (socket says 172.21.15.7:35612) 2024-04-25T10:03:44.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.126+0000 7fb14b7fe640 1 -- 172.21.15.7:0/1273076389 learned_addr learned my addr 172.21.15.7:0/1273076389 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:44.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.126+0000 7fb143fff640 1 --2- 172.21.15.7:0/1273076389 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb14c06bce0 0x7fb14c09a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.126+0000 7fb14b7fe640 1 -- 172.21.15.7:0/1273076389 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb14c06bce0 msgr2=0x7fb14c09a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:44.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.126+0000 7fb14b7fe640 1 --2- 172.21.15.7:0/1273076389 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb14c06bce0 0x7fb14c09a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.126+0000 7fb14b7fe640 1 -- 172.21.15.7:0/1273076389 >> v1:172.21.15.55:6789/0 conn(0x7fb14c06c250 legacy=0x7fb14c06c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.126+0000 7fb14b7fe640 1 -- 172.21.15.7:0/1273076389 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14c099e00 con 0x7fb14c0d0360 2024-04-25T10:03:44.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.126+0000 7fb143fff640 1 --2- 172.21.15.7:0/1273076389 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb14c06bce0 0x7fb14c09a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:44.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.127+0000 7fb14b7fe640 1 --2- 172.21.15.7:0/1273076389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb14c0d0360 0x7fb14c0cbd30 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fb144009e50 tx=0x7fb14402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd7a6172e547c05 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:44.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.127+0000 7fb14a7fc640 1 -- 172.21.15.7:0/1273076389 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb144036070 con 0x7fb14c0d0360 2024-04-25T10:03:44.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.127+0000 7fb14a7fc640 1 -- 172.21.15.7:0/1273076389 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb144031600 con 0x7fb14c0d0360 2024-04-25T10:03:44.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.127+0000 7fb14a7fc640 1 -- 172.21.15.7:0/1273076389 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1440319d0 con 0x7fb14c0d0360 2024-04-25T10:03:44.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.128+0000 7fb151815640 1 -- 172.21.15.7:0/1273076389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb14c0d0360 msgr2=0x7fb14c0cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.128+0000 7fb151815640 1 --2- 172.21.15.7:0/1273076389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb14c0d0360 0x7fb14c0cbd30 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fb144009e50 tx=0x7fb14402a5f0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.128+0000 7fb151815640 1 -- 172.21.15.7:0/1273076389 shutdown_connections 2024-04-25T10:03:44.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.128+0000 7fb151815640 1 --2- 172.21.15.7:0/1273076389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb14c0d0360 0x7fb14c0cbd30 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.128+0000 7fb151815640 1 --2- 172.21.15.7:0/1273076389 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb14c06bce0 0x7fb14c09a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.128+0000 7fb151815640 1 -- 172.21.15.7:0/1273076389 >> 172.21.15.7:0/1273076389 conn(0x7fb14c0d16e0 msgr2=0x7fb14c0d1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:44.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.128+0000 7fb151815640 1 -- 172.21.15.7:0/1273076389 shutdown_connections 2024-04-25T10:03:44.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.128+0000 7fb151815640 1 -- 172.21.15.7:0/1273076389 wait complete. 2024-04-25T10:03:44.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.129+0000 7fb151815640 1 Processor -- start 2024-04-25T10:03:44.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.129+0000 7fb151815640 1 -- start start 2024-04-25T10:03:44.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.130+0000 7fb151815640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb14c06bce0 0x7fb14c0c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.130+0000 7fb151815640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb14c06c250 0x7fb14c15e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.130+0000 7fb151815640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb14c0d0360 0x7fb14c160bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.130+0000 7fb151815640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c15f000 con 0x7fb14c06c250 2024-04-25T10:03:44.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.130+0000 7fb151815640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c0d0c60 con 0x7fb14c06bce0 2024-04-25T10:03:44.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.130+0000 7fb151815640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c15f180 con 0x7fb14c0d0360 2024-04-25T10:03:44.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.130+0000 7fb143fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb14c06c250 0x7fb14c15e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.130+0000 7fb143fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb14c06c250 0x7fb14c15e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35622/0 (socket says 172.21.15.7:35622) 2024-04-25T10:03:44.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.130+0000 7fb143fff640 1 -- 172.21.15.7:0/1144997980 learned_addr learned my addr 172.21.15.7:0/1144997980 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:44.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.130+0000 7fb143fff640 1 -- 172.21.15.7:0/1144997980 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb14c0d0360 msgr2=0x7fb14c160bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.130+0000 7fb14affd640 1 --2- 172.21.15.7:0/1144997980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb14c06bce0 0x7fb14c0c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.130+0000 7fb14b7fe640 1 --2- 172.21.15.7:0/1144997980 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb14c0d0360 0x7fb14c160bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.130+0000 7fb143fff640 1 --2- 172.21.15.7:0/1144997980 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb14c0d0360 0x7fb14c160bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.130+0000 7fb143fff640 1 -- 172.21.15.7:0/1144997980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb14c06bce0 msgr2=0x7fb14c0c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.130+0000 7fb143fff640 1 --2- 172.21.15.7:0/1144997980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb14c06bce0 0x7fb14c0c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.130+0000 7fb143fff640 1 -- 172.21.15.7:0/1144997980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14c15e810 con 0x7fb14c06c250 2024-04-25T10:03:44.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.130+0000 7fb143fff640 1 --2- 172.21.15.7:0/1144997980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb14c06c250 0x7fb14c15e2d0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fb13400d800 tx=0x7fb13400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:44.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.131+0000 7fb148ff9640 1 -- 172.21.15.7:0/1144997980 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb134004030 con 0x7fb14c06c250 2024-04-25T10:03:44.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.131+0000 7fb148ff9640 1 -- 172.21.15.7:0/1144997980 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1340041d0 con 0x7fb14c06c250 2024-04-25T10:03:44.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.131+0000 7fb151815640 1 -- 172.21.15.7:0/1144997980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb14c15ff90 con 0x7fb14c06c250 2024-04-25T10:03:44.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.131+0000 7fb148ff9640 1 -- 172.21.15.7:0/1144997980 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1340096a0 con 0x7fb14c06c250 2024-04-25T10:03:44.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.131+0000 7fb151815640 1 -- 172.21.15.7:0/1144997980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb14c160550 con 0x7fb14c06c250 2024-04-25T10:03:44.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.132+0000 7fb148ff9640 1 -- 172.21.15.7:0/1144997980 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb134009840 con 0x7fb14c06c250 2024-04-25T10:03:44.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.133+0000 7fb148ff9640 1 --2- 172.21.15.7:0/1144997980 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb12c06b4d0 0x7fb12c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.133+0000 7fb148ff9640 1 -- 172.21.15.7:0/1144997980 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6245+0+0 (secure 0 0 0) 0x7fb13408a6c0 con 0x7fb14c06c250 2024-04-25T10:03:44.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.133+0000 7fb14affd640 1 --2- 172.21.15.7:0/1144997980 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb12c06b4d0 0x7fb12c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.133+0000 7fb14affd640 1 --2- 172.21.15.7:0/1144997980 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb12c06b4d0 0x7fb12c06d990 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fb13c0015a0 tx=0x7fb13c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:44.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.133+0000 7fb1545f8740 1 Processor -- start 2024-04-25T10:03:44.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.134+0000 7fb1545f8740 1 -- start start 2024-04-25T10:03:44.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.134+0000 7fb1545f8740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb16a9b230 0x55eb16a9b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.134+0000 7fb1545f8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb16ab8ad0 0x55eb16ab9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.134+0000 7fb1545f8740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55eb16a70f10 0x55eb16ab7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.134+0000 7fb1545f8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb169d3a10 con 0x55eb16ab8ad0 2024-04-25T10:03:44.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.134+0000 7fb1545f8740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb1697cb30 con 0x55eb16a9b230 2024-04-25T10:03:44.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.134+0000 7fb1545f8740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eb169cfc50 con 0x55eb16a70f10 2024-04-25T10:03:44.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.134+0000 7fb143fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb16ab8ad0 0x55eb16ab9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.135+0000 7fb143fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb16ab8ad0 0x55eb16ab9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35634/0 (socket says 172.21.15.7:35634) 2024-04-25T10:03:44.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.135+0000 7fb143fff640 1 -- 172.21.15.7:0/1894629445 learned_addr learned my addr 172.21.15.7:0/1894629445 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:44.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.135+0000 7fb14b7fe640 1 --2- 172.21.15.7:0/1894629445 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55eb16a70f10 0x55eb16ab7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.135+0000 7fb14affd640 1 --2- 172.21.15.7:0/1894629445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb16a9b230 0x55eb16a9b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.135+0000 7fb143fff640 1 -- 172.21.15.7:0/1894629445 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55eb16a70f10 msgr2=0x55eb16ab7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:44.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.135+0000 7fb143fff640 1 --2- 172.21.15.7:0/1894629445 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55eb16a70f10 0x55eb16ab7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.135+0000 7fb143fff640 1 -- 172.21.15.7:0/1894629445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb16a9b230 msgr2=0x55eb16a9b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:44.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.135+0000 7fb143fff640 1 --2- 172.21.15.7:0/1894629445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb16a9b230 0x55eb16a9b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.135+0000 7fb143fff640 1 -- 172.21.15.7:0/1894629445 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb16991e10 con 0x55eb16ab8ad0 2024-04-25T10:03:44.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.135+0000 7fb143fff640 1 --2- 172.21.15.7:0/1894629445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb16ab8ad0 0x55eb16ab9020 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fb134060df0 tx=0x7fb1340586a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc5e15d5d8624464 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:44.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.135+0000 7fb1417fa640 1 -- 172.21.15.7:0/1894629445 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb134059310 con 0x55eb16ab8ad0 2024-04-25T10:03:44.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.135+0000 7fb1417fa640 1 -- 172.21.15.7:0/1894629445 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb134058c10 con 0x55eb16ab8ad0 2024-04-25T10:03:44.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.135+0000 7fb1417fa640 1 -- 172.21.15.7:0/1894629445 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13405cd60 con 0x55eb16ab8ad0 2024-04-25T10:03:44.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.136+0000 7fb1545f8740 1 -- 172.21.15.7:0/1894629445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb16ab8ad0 msgr2=0x55eb16ab9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.136+0000 7fb1545f8740 1 --2- 172.21.15.7:0/1894629445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb16ab8ad0 0x55eb16ab9020 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fb134060df0 tx=0x7fb1340586a0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.136+0000 7fb1545f8740 1 -- 172.21.15.7:0/1894629445 shutdown_connections 2024-04-25T10:03:44.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.136+0000 7fb1545f8740 1 --2- 172.21.15.7:0/1894629445 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55eb16a70f10 0x55eb16ab7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.136+0000 7fb1545f8740 1 --2- 172.21.15.7:0/1894629445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb16ab8ad0 0x55eb16ab9020 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.136+0000 7fb1545f8740 1 --2- 172.21.15.7:0/1894629445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb16a9b230 0x55eb16a9b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.136+0000 7fb1545f8740 1 -- 172.21.15.7:0/1894629445 >> 172.21.15.7:0/1894629445 conn(0x55eb16a6d840 msgr2=0x55eb16ab6040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:44.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.136+0000 7fb1545f8740 1 -- 172.21.15.7:0/1894629445 shutdown_connections 2024-04-25T10:03:44.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.136+0000 7fb1545f8740 1 -- 172.21.15.7:0/1894629445 wait complete. 2024-04-25T10:03:44.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.136+0000 7fb1545f8740 1 -- start start 2024-04-25T10:03:44.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.137+0000 7fb1545f8740 1 Processor -- start 2024-04-25T10:03:44.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.137+0000 7fb1545f8740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55eb16a9b230 0x55eb16ab4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.137+0000 7fb1545f8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb16ab8ad0 0x55eb16a6a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.137+0000 7fb1545f8740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb16a94000 0x55eb16a6a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.137+0000 7fb1545f8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb16a71cb0 con 0x55eb16ab8ad0 2024-04-25T10:03:44.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.137+0000 7fb1545f8740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb169900c0 con 0x55eb16a94000 2024-04-25T10:03:44.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.137+0000 7fb1545f8740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eb16a6b770 con 0x55eb16a9b230 2024-04-25T10:03:44.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.137+0000 7fb1545f8740 10 client.0 _ll_register_callbacks cb 0x55eb16983ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:03:44.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.137+0000 7fb143fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb16ab8ad0 0x55eb16a6a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.137+0000 7fb143fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb16ab8ad0 0x55eb16a6a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35644/0 (socket says 172.21.15.7:35644) 2024-04-25T10:03:44.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.137+0000 7fb143fff640 1 -- 172.21.15.7:0/3641681412 learned_addr learned my addr 172.21.15.7:0/3641681412 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:44.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.138+0000 7fb14affd640 1 --2- 172.21.15.7:0/3641681412 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55eb16a9b230 0x55eb16ab4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.138+0000 7fb14b7fe640 1 --2- 172.21.15.7:0/3641681412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb16a94000 0x55eb16a6a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.138+0000 7fb143fff640 1 -- 172.21.15.7:0/3641681412 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55eb16a9b230 msgr2=0x55eb16ab4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:44.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.138+0000 7fb143fff640 1 --2- 172.21.15.7:0/3641681412 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55eb16a9b230 0x55eb16ab4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.138+0000 7fb143fff640 1 -- 172.21.15.7:0/3641681412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb16a94000 msgr2=0x55eb16a6a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:44.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.138+0000 7fb143fff640 1 --2- 172.21.15.7:0/3641681412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb16a94000 0x55eb16a6a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.138+0000 7fb143fff640 1 -- 172.21.15.7:0/3641681412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eb166e82d0 con 0x55eb16ab8ad0 2024-04-25T10:03:44.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.138+0000 7fb14b7fe640 1 --2- 172.21.15.7:0/3641681412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb16a94000 0x55eb16a6a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:44.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.138+0000 7fb143fff640 1 --2- 172.21.15.7:0/3641681412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb16ab8ad0 0x55eb16a6a4a0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fb134009490 tx=0x7fb13400bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5be9d722bab07dff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:44.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.138+0000 7fb12a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:03:44.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.138+0000 7fb12a7fc640 1 -- 172.21.15.7:0/3641681412 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb134076070 con 0x55eb16ab8ad0 2024-04-25T10:03:44.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.138+0000 7fb12a7fc640 1 -- 172.21.15.7:0/3641681412 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 6245+0+0 (secure 0 0 0) 0x7fb13406cbd0 con 0x55eb16ab8ad0 2024-04-25T10:03:44.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.138+0000 7fb1545f8740 1 -- 172.21.15.7:0/3641681412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb134058c10 con 0x55eb16ab8ad0 2024-04-25T10:03:44.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.138+0000 7fb12a7fc640 1 -- 172.21.15.7:0/3641681412 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb13405cd60 con 0x55eb16ab8ad0 2024-04-25T10:03:44.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.138+0000 7fb1545f8740 10 client.8805 fetch_fsmap learned FSMap version 79 2024-04-25T10:03:44.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.138+0000 7fb1545f8740 1 -- 172.21.15.7:0/3641681412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) v3 -- 0x55eb167b26b0 con 0x55eb16ab8ad0 2024-04-25T10:03:44.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.138+0000 7fb12a7fc640 1 -- 172.21.15.7:0/3641681412 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb134058c10 con 0x55eb16ab8ad0 2024-04-25T10:03:44.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.138+0000 7fb12a7fc640 1 -- 172.21.15.7:0/3641681412 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 79) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb134013070 con 0x55eb16ab8ad0 2024-04-25T10:03:44.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.138+0000 7fb1545f8740 10 client.8805 fetch_fsmap finished waiting for FSMap version 79 2024-04-25T10:03:44.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.138+0000 7fb1545f8740 10 client.8805 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:03:44.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.139+0000 7fb1545f8740 20 client.8805 populate_metadata read hostname 'smithi007' 2024-04-25T10:03:44.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.139+0000 7fb1545f8740 1 --2- 172.21.15.7:0/3641681412 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x55eb16aade20 0x55eb16aae200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.139+0000 7fb1545f8740 4 client.8805 mds_command: new command op to 8736 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:03:44.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.139+0000 7fb1545f8740 1 -- 172.21.15.7:0/3641681412 --> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eb16a32920 con 0x55eb16aade20 2024-04-25T10:03:44.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.139+0000 7fb14affd640 1 --2- 172.21.15.7:0/3641681412 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x55eb16aade20 0x55eb16aae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.139+0000 7fb14affd640 1 --2- 172.21.15.7:0/3641681412 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x55eb16aade20 0x55eb16aae200 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcd4622fc3a5c0c2 server_cookie=171aea3d73a587a1 in_seq=0 out_seq=0 2024-04-25T10:03:44.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.139+0000 7fb12a7fc640 10 client.8805 ms_handle_connect on v2:172.21.15.7:6835/1214875974 2024-04-25T10:03:44.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.139+0000 7fb12a7fc640 1 -- 172.21.15.7:0/3641681412 <== mds.0 v2:172.21.15.7:6835/1214875974 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55eb16a32920 con 0x55eb16aade20 2024-04-25T10:03:44.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.139+0000 7fb12a7fc640 10 client.8805 handle_command_reply: tid=0 2024-04-25T10:03:44.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.139+0000 7fb1545f8740 1 client.8805 shutdown 2024-04-25T10:03:44.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.140+0000 7fb1545f8740 1 -- 172.21.15.7:0/3641681412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb16ab8ad0 msgr2=0x55eb16a6a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.140+0000 7fb1545f8740 1 --2- 172.21.15.7:0/3641681412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb16ab8ad0 0x55eb16a6a4a0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fb134009490 tx=0x7fb13400bf70 comp rx=0 tx=0).stop 2024-04-25T10:03:44.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.140+0000 7fb1545f8740 1 -- 172.21.15.7:0/3641681412 shutdown_connections 2024-04-25T10:03:44.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.140+0000 7fb1545f8740 1 --2- 172.21.15.7:0/3641681412 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x55eb16aade20 0x55eb16aae200 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.140+0000 7fb1545f8740 1 --2- 172.21.15.7:0/3641681412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb16a94000 0x55eb16a6a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.140+0000 7fb12a7fc640 0 client.8805 ms_handle_reset on v2:172.21.15.7:6835/1214875974 2024-04-25T10:03:44.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.140+0000 7fb1545f8740 1 --2- 172.21.15.7:0/3641681412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb16ab8ad0 0x55eb16a6a4a0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.140+0000 7fb1545f8740 1 --2- 172.21.15.7:0/3641681412 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55eb16a9b230 0x55eb16ab4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.140+0000 7fb1545f8740 1 -- 172.21.15.7:0/3641681412 >> 172.21.15.7:0/3641681412 conn(0x55eb16a70f10 msgr2=0x55eb16ab5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:44.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.140+0000 7fb1545f8740 1 -- 172.21.15.7:0/3641681412 shutdown_connections 2024-04-25T10:03:44.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.140+0000 7fb1545f8740 1 -- 172.21.15.7:0/3641681412 wait complete. 2024-04-25T10:03:44.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.140+0000 7fb1545f8740 20 client.8805 trim_cache size 0 max 16384 2024-04-25T10:03:44.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.156+0000 7fb1545f8740 1 Processor -- start 2024-04-25T10:03:44.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.156+0000 7fb1545f8740 1 -- start start 2024-04-25T10:03:44.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.157+0000 7fb1545f8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb16a94000 0x55eb16ac53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.157+0000 7fb1545f8740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb16a9b230 0x55eb16a712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.157+0000 7fb1545f8740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55eb16ab8ad0 0x55eb16a964c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.157+0000 7fb1545f8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c1ff9b0 con 0x55eb16a94000 2024-04-25T10:03:44.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.157+0000 7fb1545f8740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c1f8290 con 0x55eb16a9b230 2024-04-25T10:03:44.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.157+0000 7fb1545f8740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c0c6560 con 0x55eb16ab8ad0 2024-04-25T10:03:44.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.157+0000 7fb14affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb16a94000 0x55eb16ac53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.157+0000 7fb14affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb16a94000 0x55eb16ac53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35648/0 (socket says 172.21.15.7:35648) 2024-04-25T10:03:44.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.157+0000 7fb14affd640 1 -- 172.21.15.7:0/3601581277 learned_addr learned my addr 172.21.15.7:0/3601581277 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:44.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.157+0000 7fb143fff640 1 --2- 172.21.15.7:0/3601581277 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb16a9b230 0x55eb16a712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.157+0000 7fb14affd640 1 -- 172.21.15.7:0/3601581277 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55eb16ab8ad0 msgr2=0x55eb16a964c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:44.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.157+0000 7fb14affd640 1 --2- 172.21.15.7:0/3601581277 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55eb16ab8ad0 0x55eb16a964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.157+0000 7fb14affd640 1 -- 172.21.15.7:0/3601581277 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb16a9b230 msgr2=0x55eb16a712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:44.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.157+0000 7fb14affd640 1 --2- 172.21.15.7:0/3601581277 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb16a9b230 0x55eb16a712f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.157+0000 7fb14affd640 1 -- 172.21.15.7:0/3601581277 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb16ac5cd0 con 0x55eb16a94000 2024-04-25T10:03:44.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.157+0000 7fb14affd640 1 --2- 172.21.15.7:0/3601581277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb16a94000 0x55eb16ac53c0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fb13c00d890 tx=0x7fb13c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e1d84626f603e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:44.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.157+0000 7fb140ff9640 1 -- 172.21.15.7:0/3601581277 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c00dc90 con 0x55eb16a94000 2024-04-25T10:03:44.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.157+0000 7fb140ff9640 1 -- 172.21.15.7:0/3601581277 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13c00de30 con 0x55eb16a94000 2024-04-25T10:03:44.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.157+0000 7fb140ff9640 1 -- 172.21.15.7:0/3601581277 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c021640 con 0x55eb16a94000 2024-04-25T10:03:44.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.158+0000 7fb1545f8740 1 -- 172.21.15.7:0/3601581277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb16a94000 msgr2=0x55eb16ac53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.158+0000 7fb1545f8740 1 --2- 172.21.15.7:0/3601581277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb16a94000 0x55eb16ac53c0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fb13c00d890 tx=0x7fb13c013000 comp rx=0 tx=0).stop 2024-04-25T10:03:44.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.158+0000 7fb1545f8740 1 -- 172.21.15.7:0/3601581277 shutdown_connections 2024-04-25T10:03:44.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.158+0000 7fb1545f8740 1 --2- 172.21.15.7:0/3601581277 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55eb16ab8ad0 0x55eb16a964c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.158+0000 7fb1545f8740 1 --2- 172.21.15.7:0/3601581277 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb16a9b230 0x55eb16a712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.158+0000 7fb1545f8740 1 --2- 172.21.15.7:0/3601581277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb16a94000 0x55eb16ac53c0 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.158+0000 7fb1545f8740 1 -- 172.21.15.7:0/3601581277 >> 172.21.15.7:0/3601581277 conn(0x55eb16a70f10 msgr2=0x55eb16aae200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:44.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.158+0000 7fb1545f8740 1 -- 172.21.15.7:0/3601581277 shutdown_connections 2024-04-25T10:03:44.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.158+0000 7fb1545f8740 1 -- 172.21.15.7:0/3601581277 wait complete. 2024-04-25T10:03:44.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.159+0000 7fb1545f8740 1 -- start start 2024-04-25T10:03:44.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.159+0000 7fb1545f8740 1 Processor -- start 2024-04-25T10:03:44.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.159+0000 7fb1545f8740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55eb16a94000 0x55eb16a71460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.159+0000 7fb1545f8740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb16a9b230 0x55eb16b05b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.159+0000 7fb1545f8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb16ab8ad0 0x55eb16a964c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.159+0000 7fb1545f8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb16a71cb0 con 0x55eb16ab8ad0 2024-04-25T10:03:44.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.159+0000 7fb1545f8740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb169900c0 con 0x55eb16a9b230 2024-04-25T10:03:44.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.159+0000 7fb1545f8740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eb16aad430 con 0x55eb16a94000 2024-04-25T10:03:44.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.159+0000 7fb1545f8740 10 client.0 _ll_register_callbacks cb 0x55eb16a6bc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:03:44.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.159+0000 7fb14b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb16ab8ad0 0x55eb16a964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.160+0000 7fb14b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb16ab8ad0 0x55eb16a964c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35664/0 (socket says 172.21.15.7:35664) 2024-04-25T10:03:44.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.160+0000 7fb14b7fe640 1 -- 172.21.15.7:0/4144529547 learned_addr learned my addr 172.21.15.7:0/4144529547 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:44.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.160+0000 7fb14affd640 1 --2- 172.21.15.7:0/4144529547 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55eb16a94000 0x55eb16a71460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.160+0000 7fb143fff640 1 --2- 172.21.15.7:0/4144529547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb16a9b230 0x55eb16b05b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.160+0000 7fb14b7fe640 1 -- 172.21.15.7:0/4144529547 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55eb16a94000 msgr2=0x55eb16a71460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:44.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.160+0000 7fb14b7fe640 1 --2- 172.21.15.7:0/4144529547 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55eb16a94000 0x55eb16a71460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.160+0000 7fb14b7fe640 1 -- 172.21.15.7:0/4144529547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb16a9b230 msgr2=0x55eb16b05b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:44.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.160+0000 7fb14b7fe640 1 --2- 172.21.15.7:0/4144529547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb16a9b230 0x55eb16b05b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.160+0000 7fb14b7fe640 1 -- 172.21.15.7:0/4144529547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eb16b1fde0 con 0x55eb16ab8ad0 2024-04-25T10:03:44.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.160+0000 7fb143fff640 1 --2- 172.21.15.7:0/4144529547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb16a9b230 0x55eb16b05b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:44.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.160+0000 7fb14b7fe640 1 --2- 172.21.15.7:0/4144529547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb16ab8ad0 0x55eb16a964c0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fb14402abe0 tx=0x7fb144004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c022f1296cc617 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:44.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.160+0000 7fb12a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:03:44.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.160+0000 7fb12a7fc640 1 -- 172.21.15.7:0/4144529547 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb144036040 con 0x55eb16ab8ad0 2024-04-25T10:03:44.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.160+0000 7fb12a7fc640 1 -- 172.21.15.7:0/4144529547 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 6245+0+0 (secure 0 0 0) 0x7fb144031cf0 con 0x55eb16ab8ad0 2024-04-25T10:03:44.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.160+0000 7fb1545f8740 1 -- 172.21.15.7:0/4144529547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb13c00de30 con 0x55eb16ab8ad0 2024-04-25T10:03:44.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.160+0000 7fb12a7fc640 1 -- 172.21.15.7:0/4144529547 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb14404d050 con 0x55eb16ab8ad0 2024-04-25T10:03:44.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.160+0000 7fb1545f8740 10 client.8811 fetch_fsmap learned FSMap version 79 2024-04-25T10:03:44.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.160+0000 7fb1545f8740 1 -- 172.21.15.7:0/4144529547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) v3 -- 0x55eb16a727e0 con 0x55eb16ab8ad0 2024-04-25T10:03:44.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.160+0000 7fb12a7fc640 1 -- 172.21.15.7:0/4144529547 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13c00de30 con 0x55eb16ab8ad0 2024-04-25T10:03:44.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.160+0000 7fb12a7fc640 1 -- 172.21.15.7:0/4144529547 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 79) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb144050020 con 0x55eb16ab8ad0 2024-04-25T10:03:44.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.160+0000 7fb1545f8740 10 client.8811 fetch_fsmap finished waiting for FSMap version 79 2024-04-25T10:03:44.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.160+0000 7fb1545f8740 10 client.8811 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:03:44.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.160+0000 7fb1545f8740 20 client.8811 populate_metadata read hostname 'smithi007' 2024-04-25T10:03:44.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.161+0000 7fb1545f8740 1 --2- 172.21.15.7:0/4144529547 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x55eb16a9a830 0x55eb16b2b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.161+0000 7fb1545f8740 4 client.8811 mds_command: new command op to 8736 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:03:44.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.161+0000 7fb1545f8740 1 -- 172.21.15.7:0/4144529547 --> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55eb169e0f50 con 0x55eb16a9a830 2024-04-25T10:03:44.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.161+0000 7fb14affd640 1 --2- 172.21.15.7:0/4144529547 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x55eb16a9a830 0x55eb16b2b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.161+0000 7fb12a7fc640 10 client.8811 ms_handle_connect on v2:172.21.15.7:6835/1214875974 2024-04-25T10:03:44.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.161+0000 7fb14affd640 1 --2- 172.21.15.7:0/4144529547 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x55eb16a9a830 0x55eb16b2b470 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27f8688c2b4e88c4 server_cookie=2ef98de947c2357b in_seq=0 out_seq=0 2024-04-25T10:03:44.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.161+0000 7fb12a7fc640 1 -- 172.21.15.7:0/4144529547 <== mds.0 v2:172.21.15.7:6835/1214875974 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55eb169e0f50 con 0x55eb16a9a830 2024-04-25T10:03:44.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.161+0000 7fb12a7fc640 10 client.8811 handle_command_reply: tid=0 2024-04-25T10:03:44.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.161+0000 7fb1545f8740 1 client.8811 shutdown 2024-04-25T10:03:44.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.161+0000 7fb1545f8740 1 -- 172.21.15.7:0/4144529547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb16ab8ad0 msgr2=0x55eb16a964c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.161+0000 7fb1545f8740 1 --2- 172.21.15.7:0/4144529547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb16ab8ad0 0x55eb16a964c0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fb14402abe0 tx=0x7fb144004a40 comp rx=0 tx=0).stop 2024-04-25T10:03:44.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.161+0000 7fb1545f8740 1 -- 172.21.15.7:0/4144529547 shutdown_connections 2024-04-25T10:03:44.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.161+0000 7fb1545f8740 1 --2- 172.21.15.7:0/4144529547 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x55eb16a9a830 0x55eb16b2b470 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.161+0000 7fb1545f8740 1 --2- 172.21.15.7:0/4144529547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb16ab8ad0 0x55eb16a964c0 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.161+0000 7fb1545f8740 1 --2- 172.21.15.7:0/4144529547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb16a9b230 0x55eb16b05b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.161+0000 7fb12a7fc640 0 client.8811 ms_handle_reset on v2:172.21.15.7:6835/1214875974 2024-04-25T10:03:44.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.161+0000 7fb1545f8740 1 --2- 172.21.15.7:0/4144529547 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55eb16a94000 0x55eb16a71460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.161+0000 7fb1545f8740 1 -- 172.21.15.7:0/4144529547 >> 172.21.15.7:0/4144529547 conn(0x55eb16a70f10 msgr2=0x55eb16ac5350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:44.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.161+0000 7fb1545f8740 1 -- 172.21.15.7:0/4144529547 shutdown_connections 2024-04-25T10:03:44.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.161+0000 7fb1545f8740 1 -- 172.21.15.7:0/4144529547 wait complete. 2024-04-25T10:03:44.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.162+0000 7fb1545f8740 20 client.8811 trim_cache size 0 max 16384 2024-04-25T10:03:44.173 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:03:44.173 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "c03d0745-5946-49c3-ad88-1165c5b68b4e", 2024-04-25T10:03:44.173 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-04-25T10:03:44.174 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 8736, 2024-04-25T10:03:44.174 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-04-25T10:03:44.174 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-04-25T10:03:44.174 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-04-25T10:03:44.174 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 4.4236732180000002, 2024-04-25T10:03:44.174 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 79, 2024-04-25T10:03:44.174 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 106, 2024-04-25T10:03:44.174 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 106, 2024-04-25T10:03:44.174 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 5.3981249299999998 2024-04-25T10:03:44.174 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:03:44.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.162+0000 7fb151815640 1 -- 172.21.15.7:0/1144997980 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb12c06b4d0 msgr2=0x7fb12c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.162+0000 7fb151815640 1 --2- 172.21.15.7:0/1144997980 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb12c06b4d0 0x7fb12c06d990 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fb13c0015a0 tx=0x7fb13c009040 comp rx=0 tx=0).stop 2024-04-25T10:03:44.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.162+0000 7fb151815640 1 -- 172.21.15.7:0/1144997980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb14c06c250 msgr2=0x7fb14c15e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.162+0000 7fb151815640 1 --2- 172.21.15.7:0/1144997980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb14c06c250 0x7fb14c15e2d0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fb13400d800 tx=0x7fb13400dcc0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.162+0000 7fb151815640 1 -- 172.21.15.7:0/1144997980 shutdown_connections 2024-04-25T10:03:44.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.162+0000 7fb151815640 1 --2- 172.21.15.7:0/1144997980 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb12c06b4d0 0x7fb12c06d990 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.162+0000 7fb151815640 1 --2- 172.21.15.7:0/1144997980 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb14c0d0360 0x7fb14c160bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.162+0000 7fb151815640 1 --2- 172.21.15.7:0/1144997980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb14c06c250 0x7fb14c15e2d0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.162+0000 7fb151815640 1 --2- 172.21.15.7:0/1144997980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb14c06bce0 0x7fb14c0c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.162+0000 7fb151815640 1 -- 172.21.15.7:0/1144997980 >> 172.21.15.7:0/1144997980 conn(0x7fb14c0d16e0 msgr2=0x7fb14c15a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:44.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.162+0000 7fb151815640 1 -- 172.21.15.7:0/1144997980 shutdown_connections 2024-04-25T10:03:44.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.162+0000 7fb151815640 1 -- 172.21.15.7:0/1144997980 wait complete. 2024-04-25T10:03:44.178 DEBUG:teuthology.orchestra.run.smithi007:> sudo daemon-helper kill ceph --cluster ceph -w 2024-04-25T10:03:44.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:44.180 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start / repair,recursive 2024-04-25T10:03:44.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.280+0000 7f392ee09640 1 Processor -- start 2024-04-25T10:03:44.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.280+0000 7f392ee09640 1 -- start start 2024-04-25T10:03:44.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.281+0000 7f392ee09640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f39280ce670 0x7f39280cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.281+0000 7f392ee09640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39280b1620 con 0x7f392815db90 2024-04-25T10:03:44.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.281+0000 7f392ee09640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f392815df70 con 0x7f39280cf890 2024-04-25T10:03:44.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.281+0000 7f392ee09640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f392806cc40 con 0x7f39280ce670 2024-04-25T10:03:44.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.281+0000 7f392d3a6640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f39280ce670 0x7f39280cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.281+0000 7f392cba5640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f392815db90 0x7f39280b2090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:57612/0 (socket says 172.21.15.7:57612) 2024-04-25T10:03:44.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.281+0000 7f392cba5640 1 -- 172.21.15.7:0/809551146 learned_addr learned my addr 172.21.15.7:0/809551146 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:03:44.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.282+0000 7f392d3a6640 1 -- 172.21.15.7:0/809551146 >> v1:172.21.15.55:6789/0 conn(0x7f39280cf890 legacy=0x7f39280cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:44.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.282+0000 7f392d3a6640 1 -- 172.21.15.7:0/809551146 >> v1:172.21.15.7:6789/0 conn(0x7f392815db90 legacy=0x7f39280b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.282+0000 7f39277fe640 1 -- 172.21.15.7:0/809551146 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2135781468 0 0) 0x7f39280b1620 con 0x7f392815db90 2024-04-25T10:03:44.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.282+0000 7f392d3a6640 1 -- 172.21.15.7:0/809551146 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39280b1890 con 0x7f39280ce670 2024-04-25T10:03:44.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.283+0000 7f392d3a6640 1 --2- 172.21.15.7:0/809551146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39280ce670 0x7f39280cfd20 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f3920009d90 tx=0x7f392002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd2e41389ae9737 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:44.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.283+0000 7f39277fe640 1 -- 172.21.15.7:0/809551146 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920007740 con 0x7f39280ce670 2024-04-25T10:03:44.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.283+0000 7f39277fe640 1 -- 172.21.15.7:0/809551146 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39200078e0 con 0x7f39280ce670 2024-04-25T10:03:44.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.283+0000 7f39277fe640 1 -- 172.21.15.7:0/809551146 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920007cb0 con 0x7f39280ce670 2024-04-25T10:03:44.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.284+0000 7f392ee09640 1 -- 172.21.15.7:0/809551146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39280ce670 msgr2=0x7f39280cfd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.284+0000 7f392ee09640 1 --2- 172.21.15.7:0/809551146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39280ce670 0x7f39280cfd20 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f3920009d90 tx=0x7f392002a6a0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.284+0000 7f392ee09640 1 -- 172.21.15.7:0/809551146 shutdown_connections 2024-04-25T10:03:44.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.284+0000 7f392ee09640 1 --2- 172.21.15.7:0/809551146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39280ce670 0x7f39280cfd20 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.284+0000 7f392ee09640 1 -- 172.21.15.7:0/809551146 >> 172.21.15.7:0/809551146 conn(0x7f39280d1650 msgr2=0x7f39280d1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:44.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.284+0000 7f392ee09640 1 -- 172.21.15.7:0/809551146 shutdown_connections 2024-04-25T10:03:44.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.284+0000 7f392ee09640 1 -- 172.21.15.7:0/809551146 wait complete. 2024-04-25T10:03:44.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.285+0000 7f392ee09640 1 Processor -- start 2024-04-25T10:03:44.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.285+0000 7f392ee09640 1 -- start start 2024-04-25T10:03:44.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.286+0000 7f392ee09640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39280ce670 0x7f3928070680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.286+0000 7f392ee09640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39280cf890 0x7f3928154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.286+0000 7f392ee09640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f392815db90 0x7f3928153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.286+0000 7f392ee09640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392806d0a0 con 0x7f39280ce670 2024-04-25T10:03:44.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.286+0000 7f392ee09640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392806cf20 con 0x7f39280cf890 2024-04-25T10:03:44.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.286+0000 7f392ee09640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39280b27a0 con 0x7f392815db90 2024-04-25T10:03:44.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.286+0000 7f392cba5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39280ce670 0x7f3928070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.286+0000 7f392cba5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39280ce670 0x7f3928070680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35672/0 (socket says 172.21.15.7:35672) 2024-04-25T10:03:44.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.286+0000 7f392cba5640 1 -- 172.21.15.7:0/1172882309 learned_addr learned my addr 172.21.15.7:0/1172882309 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:44.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.286+0000 7f392cba5640 1 -- 172.21.15.7:0/1172882309 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f392815db90 msgr2=0x7f3928153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.286+0000 7f392cba5640 1 --2- 172.21.15.7:0/1172882309 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f392815db90 0x7f3928153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.286+0000 7f392cba5640 1 -- 172.21.15.7:0/1172882309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39280cf890 msgr2=0x7f3928154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.286+0000 7f392cba5640 1 --2- 172.21.15.7:0/1172882309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39280cf890 0x7f3928154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.286+0000 7f392cba5640 1 -- 172.21.15.7:0/1172882309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3928155730 con 0x7f39280ce670 2024-04-25T10:03:44.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.286+0000 7f392cba5640 1 --2- 172.21.15.7:0/1172882309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39280ce670 0x7f3928070680 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f391c00c430 tx=0x7f391c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:44.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.287+0000 7f39257fa640 1 -- 172.21.15.7:0/1172882309 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c0074e0 con 0x7f39280ce670 2024-04-25T10:03:44.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.287+0000 7f39257fa640 1 -- 172.21.15.7:0/1172882309 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391c0047e0 con 0x7f39280ce670 2024-04-25T10:03:44.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.287+0000 7f392ee09640 1 -- 172.21.15.7:0/1172882309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3928155a10 con 0x7f39280ce670 2024-04-25T10:03:44.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.287+0000 7f39257fa640 1 -- 172.21.15.7:0/1172882309 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c004bd0 con 0x7f39280ce670 2024-04-25T10:03:44.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.287+0000 7f392ee09640 1 -- 172.21.15.7:0/1172882309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3928155fd0 con 0x7f39280ce670 2024-04-25T10:03:44.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.288+0000 7f39257fa640 1 -- 172.21.15.7:0/1172882309 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f391c011070 con 0x7f39280ce670 2024-04-25T10:03:44.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.289+0000 7f39257fa640 1 --2- 172.21.15.7:0/1172882309 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f390c06b4d0 0x7f390c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.289+0000 7f39257fa640 1 -- 172.21.15.7:0/1172882309 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f391c08a130 con 0x7f39280ce670 2024-04-25T10:03:44.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.289+0000 7f3927fff640 1 --2- 172.21.15.7:0/1172882309 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f390c06b4d0 0x7f390c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.289+0000 7f3927fff640 1 --2- 172.21.15.7:0/1172882309 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f390c06b4d0 0x7f390c06d990 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f39280aecb0 tx=0x7f39140079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:44.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.291+0000 7f3931bdf740 1 Processor -- start 2024-04-25T10:03:44.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.291+0000 7f3931bdf740 1 -- start start 2024-04-25T10:03:44.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.292+0000 7f3931bdf740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5645f4b70bb0 0x5645f4b70f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.292+0000 7f3931bdf740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5645f4b6b830 0x5645f4b6f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.292+0000 7f3931bdf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645f4b6fcf0 0x5645f4b70130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.292+0000 7f3931bdf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645f4ad4ac0 con 0x5645f4b6fcf0 2024-04-25T10:03:44.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.292+0000 7f3931bdf740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645f4a7dd80 con 0x5645f4b70bb0 2024-04-25T10:03:44.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.292+0000 7f3931bdf740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5645f4ad0b60 con 0x5645f4b6b830 2024-04-25T10:03:44.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.292+0000 7f392d3a6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645f4b6fcf0 0x5645f4b70130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.292+0000 7f392d3a6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645f4b6fcf0 0x5645f4b70130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35680/0 (socket says 172.21.15.7:35680) 2024-04-25T10:03:44.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.292+0000 7f392d3a6640 1 -- 172.21.15.7:0/2953588657 learned_addr learned my addr 172.21.15.7:0/2953588657 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:44.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.292+0000 7f392cba5640 1 --2- 172.21.15.7:0/2953588657 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5645f4b70bb0 0x5645f4b70f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.292+0000 7f3927fff640 1 --2- 172.21.15.7:0/2953588657 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5645f4b6b830 0x5645f4b6f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.292+0000 7f392d3a6640 1 -- 172.21.15.7:0/2953588657 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5645f4b6b830 msgr2=0x5645f4b6f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:44.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.292+0000 7f392d3a6640 1 --2- 172.21.15.7:0/2953588657 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5645f4b6b830 0x5645f4b6f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.292+0000 7f392d3a6640 1 -- 172.21.15.7:0/2953588657 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5645f4b70bb0 msgr2=0x5645f4b70f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:44.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.292+0000 7f392d3a6640 1 --2- 172.21.15.7:0/2953588657 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5645f4b70bb0 0x5645f4b70f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.292+0000 7f392d3a6640 1 -- 172.21.15.7:0/2953588657 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645f48b17e0 con 0x5645f4b6fcf0 2024-04-25T10:03:44.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.292+0000 7f392cba5640 1 --2- 172.21.15.7:0/2953588657 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5645f4b70bb0 0x5645f4b70f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:44.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.293+0000 7f392d3a6640 1 --2- 172.21.15.7:0/2953588657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645f4b6fcf0 0x5645f4b70130 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f3920009eb0 tx=0x7f392002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b019cae09a484838 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:44.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.293+0000 7f39127fc640 1 -- 172.21.15.7:0/2953588657 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920040070 con 0x5645f4b6fcf0 2024-04-25T10:03:44.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.293+0000 7f39127fc640 1 -- 172.21.15.7:0/2953588657 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3920007840 con 0x5645f4b6fcf0 2024-04-25T10:03:44.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.293+0000 7f39127fc640 1 -- 172.21.15.7:0/2953588657 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920007c10 con 0x5645f4b6fcf0 2024-04-25T10:03:44.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.294+0000 7f3931bdf740 1 -- 172.21.15.7:0/2953588657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645f4b6fcf0 msgr2=0x5645f4b70130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.294+0000 7f3931bdf740 1 --2- 172.21.15.7:0/2953588657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645f4b6fcf0 0x5645f4b70130 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f3920009eb0 tx=0x7f392002c000 comp rx=0 tx=0).stop 2024-04-25T10:03:44.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.294+0000 7f3931bdf740 1 -- 172.21.15.7:0/2953588657 shutdown_connections 2024-04-25T10:03:44.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.294+0000 7f3931bdf740 1 --2- 172.21.15.7:0/2953588657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645f4b6fcf0 0x5645f4b70130 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.294+0000 7f3931bdf740 1 --2- 172.21.15.7:0/2953588657 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5645f4b6b830 0x5645f4b6f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.294+0000 7f3931bdf740 1 --2- 172.21.15.7:0/2953588657 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5645f4b70bb0 0x5645f4b70f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.294+0000 7f3931bdf740 1 -- 172.21.15.7:0/2953588657 >> 172.21.15.7:0/2953588657 conn(0x5645f4b6dcb0 msgr2=0x5645f4bb6770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:44.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.294+0000 7f3931bdf740 1 -- 172.21.15.7:0/2953588657 shutdown_connections 2024-04-25T10:03:44.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.294+0000 7f3931bdf740 1 -- 172.21.15.7:0/2953588657 wait complete. 2024-04-25T10:03:44.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.295+0000 7f3931bdf740 1 -- start start 2024-04-25T10:03:44.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.295+0000 7f3931bdf740 1 Processor -- start 2024-04-25T10:03:44.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.296+0000 7f3931bdf740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5645f4b6fcf0 0x5645f4b968f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.296+0000 7f3931bdf740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5645f4b70bb0 0x5645f4b92ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.296+0000 7f3931bdf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645f4bbde50 0x5645f4b98210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.296+0000 7f3931bdf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645f4b9c740 con 0x5645f4bbde50 2024-04-25T10:03:44.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.296+0000 7f3931bdf740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645f4a73530 con 0x5645f4b6fcf0 2024-04-25T10:03:44.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.296+0000 7f3931bdf740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5645f4b9bbc0 con 0x5645f4b70bb0 2024-04-25T10:03:44.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.296+0000 7f3931bdf740 10 client.0 _ll_register_callbacks cb 0x5645f4acb130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:03:44.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.296+0000 7f392d3a6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645f4bbde50 0x5645f4b98210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.296+0000 7f392d3a6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645f4bbde50 0x5645f4b98210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35696/0 (socket says 172.21.15.7:35696) 2024-04-25T10:03:44.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.296+0000 7f392d3a6640 1 -- 172.21.15.7:0/2631968795 learned_addr learned my addr 172.21.15.7:0/2631968795 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:44.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.296+0000 7f392cba5640 1 --2- 172.21.15.7:0/2631968795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5645f4b6fcf0 0x5645f4b968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.296+0000 7f3927fff640 1 --2- 172.21.15.7:0/2631968795 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5645f4b70bb0 0x5645f4b92ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.297+0000 7f392d3a6640 1 -- 172.21.15.7:0/2631968795 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5645f4b70bb0 msgr2=0x5645f4b92ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:44.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.297+0000 7f392d3a6640 1 --2- 172.21.15.7:0/2631968795 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5645f4b70bb0 0x5645f4b92ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.297+0000 7f392d3a6640 1 -- 172.21.15.7:0/2631968795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5645f4b6fcf0 msgr2=0x5645f4b968f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:44.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.297+0000 7f392d3a6640 1 --2- 172.21.15.7:0/2631968795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5645f4b6fcf0 0x5645f4b968f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.297+0000 7f392d3a6640 1 -- 172.21.15.7:0/2631968795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5645f4911f70 con 0x5645f4bbde50 2024-04-25T10:03:44.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.297+0000 7f392d3a6640 1 --2- 172.21.15.7:0/2631968795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645f4bbde50 0x5645f4b98210 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f392002a6e0 tx=0x7f3920004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30d72a19b8bded44 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:44.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.297+0000 7f39077fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:03:44.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.297+0000 7f39077fe640 1 -- 172.21.15.7:0/2631968795 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920040040 con 0x5645f4bbde50 2024-04-25T10:03:44.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.297+0000 7f39077fe640 1 -- 172.21.15.7:0/2631968795 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f3920004040 con 0x5645f4bbde50 2024-04-25T10:03:44.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.297+0000 7f3931bdf740 1 -- 172.21.15.7:0/2631968795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3920007840 con 0x5645f4bbde50 2024-04-25T10:03:44.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.297+0000 7f39077fe640 1 -- 172.21.15.7:0/2631968795 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3920058050 con 0x5645f4bbde50 2024-04-25T10:03:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.297+0000 7f3931bdf740 10 client.8826 fetch_fsmap learned FSMap version 79 2024-04-25T10:03:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.297+0000 7f3931bdf740 1 -- 172.21.15.7:0/2631968795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) v3 -- 0x5645f47a9170 con 0x5645f4bbde50 2024-04-25T10:03:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.297+0000 7f39077fe640 1 -- 172.21.15.7:0/2631968795 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3920007840 con 0x5645f4bbde50 2024-04-25T10:03:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.298+0000 7f39077fe640 1 -- 172.21.15.7:0/2631968795 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 79) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f392005b020 con 0x5645f4bbde50 2024-04-25T10:03:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.298+0000 7f3931bdf740 10 client.8826 fetch_fsmap finished waiting for FSMap version 79 2024-04-25T10:03:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.298+0000 7f3931bdf740 10 client.8826 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T10:03:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.298+0000 7f3931bdf740 20 client.8826 populate_metadata read hostname 'smithi007' 2024-04-25T10:03:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.298+0000 7f3931bdf740 1 --2- 172.21.15.7:0/2631968795 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x5645f4b949a0 0x5645f4bbc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.298+0000 7f3931bdf740 4 client.8826 mds_command: new command op to 8736 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:03:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.298+0000 7f3931bdf740 1 -- 172.21.15.7:0/2631968795 --> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5645f4ae2000 con 0x5645f4b949a0 2024-04-25T10:03:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.298+0000 7f392cba5640 1 --2- 172.21.15.7:0/2631968795 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x5645f4b949a0 0x5645f4bbc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.298+0000 7f39077fe640 10 client.8826 ms_handle_connect on v2:172.21.15.7:6835/1214875974 2024-04-25T10:03:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.298+0000 7f392cba5640 1 --2- 172.21.15.7:0/2631968795 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x5645f4b949a0 0x5645f4bbc480 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ed04c91df67363d server_cookie=4302ec6c5dd4e68d in_seq=0 out_seq=0 2024-04-25T10:03:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.299+0000 7f39077fe640 1 -- 172.21.15.7:0/2631968795 <== mds.0 v2:172.21.15.7:6835/1214875974 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5645f4ae2000 con 0x5645f4b949a0 2024-04-25T10:03:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.299+0000 7f39077fe640 10 client.8826 handle_command_reply: tid=0 2024-04-25T10:03:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.299+0000 7f3931bdf740 1 client.8826 shutdown 2024-04-25T10:03:44.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.299+0000 7f3931bdf740 1 -- 172.21.15.7:0/2631968795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645f4bbde50 msgr2=0x5645f4b98210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.299+0000 7f3931bdf740 1 --2- 172.21.15.7:0/2631968795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645f4bbde50 0x5645f4b98210 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f392002a6e0 tx=0x7f3920004ab0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.299+0000 7f3931bdf740 1 -- 172.21.15.7:0/2631968795 shutdown_connections 2024-04-25T10:03:44.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.299+0000 7f3931bdf740 1 --2- 172.21.15.7:0/2631968795 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x5645f4b949a0 0x5645f4bbc480 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.299+0000 7f3931bdf740 1 --2- 172.21.15.7:0/2631968795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645f4bbde50 0x5645f4b98210 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.299+0000 7f3931bdf740 1 --2- 172.21.15.7:0/2631968795 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5645f4b70bb0 0x5645f4b92ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.299+0000 7f39077fe640 0 client.8826 ms_handle_reset on v2:172.21.15.7:6835/1214875974 2024-04-25T10:03:44.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.299+0000 7f3931bdf740 1 --2- 172.21.15.7:0/2631968795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5645f4b6fcf0 0x5645f4b968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.299+0000 7f3931bdf740 1 -- 172.21.15.7:0/2631968795 >> 172.21.15.7:0/2631968795 conn(0x5645f4b6b830 msgr2=0x5645f4b716a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:44.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.299+0000 7f3931bdf740 1 -- 172.21.15.7:0/2631968795 shutdown_connections 2024-04-25T10:03:44.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.299+0000 7f3931bdf740 1 -- 172.21.15.7:0/2631968795 wait complete. 2024-04-25T10:03:44.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.299+0000 7f3931bdf740 20 client.8826 trim_cache size 0 max 16384 2024-04-25T10:03:44.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.308+0000 7ffa0939e640 1 Processor -- start 2024-04-25T10:03:44.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.308+0000 7ffa0939e640 1 -- start start 2024-04-25T10:03:44.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.309+0000 7ffa0939e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffa0406c280 0x7ffa040b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.309+0000 7ffa0939e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffa040b3e30 0x7ffa0415dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.309+0000 7ffa0939e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa040b43a0 con 0x7ffa0415a160 2024-04-25T10:03:44.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.309+0000 7ffa0939e640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa040b4960 con 0x7ffa0406c280 2024-04-25T10:03:44.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.309+0000 7ffa0939e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa040b4680 con 0x7ffa040b3e30 2024-04-25T10:03:44.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.309+0000 7ffa027fc640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffa0406c280 0x7ffa040b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.309+0000 7ffa027fc640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffa0406c280 0x7ffa040b3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35704/0 (socket says 172.21.15.7:35704) 2024-04-25T10:03:44.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.309+0000 7ffa027fc640 1 -- 172.21.15.7:0/1706942181 learned_addr learned my addr 172.21.15.7:0/1706942181 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:44.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.309+0000 7ffa037fe640 1 --2- 172.21.15.7:0/1706942181 >> v2:172.21.15.55:3300/0 conn(0x7ffa040b3e30 0x7ffa0415dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.309+0000 7ffa027fc640 1 -- 172.21.15.7:0/1706942181 >> v2:172.21.15.55:3300/0 conn(0x7ffa040b3e30 msgr2=0x7ffa0415dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:44.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.309+0000 7ffa027fc640 1 --2- 172.21.15.7:0/1706942181 >> v2:172.21.15.55:3300/0 conn(0x7ffa040b3e30 0x7ffa0415dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.309+0000 7ffa027fc640 1 -- 172.21.15.7:0/1706942181 >> v1:172.21.15.55:6789/0 conn(0x7ffa0415a160 legacy=0x7ffa0406bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:44.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.310+0000 7ffa027fc640 1 -- 172.21.15.7:0/1706942181 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa040b2f40 con 0x7ffa0406c280 2024-04-25T10:03:44.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.310+0000 7ffa027fc640 1 --2- 172.21.15.7:0/1706942181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa0406c280 0x7ffa040b3740 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7ffa04071680 tx=0x7ff9f402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d748191c220464 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:44.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.310+0000 7ffa01ffb640 1 -- 172.21.15.7:0/1706942181 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f4037070 con 0x7ffa0406c280 2024-04-25T10:03:44.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.310+0000 7ffa01ffb640 1 -- 172.21.15.7:0/1706942181 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f4032440 con 0x7ffa0406c280 2024-04-25T10:03:44.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.310+0000 7ffa01ffb640 1 -- 172.21.15.7:0/1706942181 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f4032810 con 0x7ffa0406c280 2024-04-25T10:03:44.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.311+0000 7ffa0939e640 1 -- 172.21.15.7:0/1706942181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa0406c280 msgr2=0x7ffa040b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.311+0000 7ffa0939e640 1 --2- 172.21.15.7:0/1706942181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa0406c280 0x7ffa040b3740 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7ffa04071680 tx=0x7ff9f402a230 comp rx=0 tx=0).stop 2024-04-25T10:03:44.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.311+0000 7ffa0939e640 1 -- 172.21.15.7:0/1706942181 shutdown_connections 2024-04-25T10:03:44.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.311+0000 7ffa0939e640 1 --2- 172.21.15.7:0/1706942181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa0406c280 0x7ffa040b3740 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.311+0000 7ffa0939e640 1 --2- 172.21.15.7:0/1706942181 >> v2:172.21.15.55:3300/0 conn(0x7ffa040b3e30 0x7ffa0415dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.311+0000 7ffa0939e640 1 -- 172.21.15.7:0/1706942181 >> 172.21.15.7:0/1706942181 conn(0x7ffa040718c0 msgr2=0x7ffa04071cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:44.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.311+0000 7ffa0939e640 1 -- 172.21.15.7:0/1706942181 shutdown_connections 2024-04-25T10:03:44.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.311+0000 7ffa0939e640 1 -- 172.21.15.7:0/1706942181 wait complete. 2024-04-25T10:03:44.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.312+0000 7ffa0939e640 1 Processor -- start 2024-04-25T10:03:44.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.312+0000 7ffa0939e640 1 -- start start 2024-04-25T10:03:44.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.313+0000 7ffa0939e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffa0406c280 0x7ffa040cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.313+0000 7ffa0939e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa040b3e30 0x7ffa0414b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.313+0000 7ffa0939e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa0415a160 0x7ffa0415a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.313+0000 7ffa0939e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0415a540 con 0x7ffa0415a160 2024-04-25T10:03:44.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.313+0000 7ffa0939e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa040b3220 con 0x7ffa040b3e30 2024-04-25T10:03:44.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.313+0000 7ffa0939e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa040af6c0 con 0x7ffa0406c280 2024-04-25T10:03:44.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.313+0000 7ffa037fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa0415a160 0x7ffa0415a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.313+0000 7ffa037fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa0415a160 0x7ffa0415a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35712/0 (socket says 172.21.15.7:35712) 2024-04-25T10:03:44.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.313+0000 7ffa037fe640 1 -- 172.21.15.7:0/3566767806 learned_addr learned my addr 172.21.15.7:0/3566767806 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:44.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.313+0000 7ffa027fc640 1 --2- 172.21.15.7:0/3566767806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa040b3e30 0x7ffa0414b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.313+0000 7ffa02ffd640 1 --2- 172.21.15.7:0/3566767806 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffa0406c280 0x7ffa040cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.314+0000 7ffa037fe640 1 -- 172.21.15.7:0/3566767806 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffa0406c280 msgr2=0x7ffa040cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.314+0000 7ffa037fe640 1 --2- 172.21.15.7:0/3566767806 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffa0406c280 0x7ffa040cd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.314+0000 7ffa037fe640 1 -- 172.21.15.7:0/3566767806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa040b3e30 msgr2=0x7ffa0414b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.314+0000 7ffa037fe640 1 --2- 172.21.15.7:0/3566767806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa040b3e30 0x7ffa0414b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.314+0000 7ffa037fe640 1 -- 172.21.15.7:0/3566767806 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0414f990 con 0x7ffa0415a160 2024-04-25T10:03:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.314+0000 7ffa037fe640 1 --2- 172.21.15.7:0/3566767806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa0415a160 0x7ffa0415a6c0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc007e70 tx=0x7ff9fc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.314+0000 7ff9eb7fe640 1 -- 172.21.15.7:0/3566767806 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc014620 con 0x7ffa0415a160 2024-04-25T10:03:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.314+0000 7ff9eb7fe640 1 -- 172.21.15.7:0/3566767806 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9fc019070 con 0x7ffa0415a160 2024-04-25T10:03:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.314+0000 7ffa0939e640 1 -- 172.21.15.7:0/3566767806 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa0414fc70 con 0x7ffa0415a160 2024-04-25T10:03:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.314+0000 7ff9eb7fe640 1 -- 172.21.15.7:0/3566767806 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc014a20 con 0x7ffa0415a160 2024-04-25T10:03:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.314+0000 7ffa0939e640 1 -- 172.21.15.7:0/3566767806 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa0414f680 con 0x7ffa0415a160 2024-04-25T10:03:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.315+0000 7ffa0939e640 1 -- 172.21.15.7:0/3566767806 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7ffa0414fe40 con 0x7ffa0415a160 2024-04-25T10:03:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.316+0000 7ff9eb7fe640 1 -- 172.21.15.7:0/3566767806 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff9fc014bc0 con 0x7ffa0415a160 2024-04-25T10:03:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.316+0000 7ff9eb7fe640 1 --2- 172.21.15.7:0/3566767806 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff9f006b4d0 0x7ff9f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.316+0000 7ff9eb7fe640 1 -- 172.21.15.7:0/3566767806 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6245+0+0 (secure 0 0 0) 0x7ff9fc08b9d0 con 0x7ffa0415a160 2024-04-25T10:03:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.316+0000 7ffa02ffd640 1 --2- 172.21.15.7:0/3566767806 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff9f006b4d0 0x7ff9f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.316+0000 7ff9eb7fe640 1 -- 172.21.15.7:0/3566767806 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+512 (secure 0 0 0) 0x7ffa0414fe40 con 0x7ffa0415a160 2024-04-25T10:03:44.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.316+0000 7ffa0939e640 1 -- 172.21.15.7:0/3566767806 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7ffa0414e140 con 0x7ffa0415a160 2024-04-25T10:03:44.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.317+0000 7ff9eb7fe640 1 -- 172.21.15.7:0/3566767806 <== mon.0 v2:172.21.15.7:3300/0 7 ==== log(2 entries from seq 1184 at 2024-04-25T10:03:42.750110+0000) v1 ==== 389+0+0 (secure 0 0 0) 0x7ff9fc089df0 con 0x7ffa0415a160 2024-04-25T10:03:44.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.317+0000 7ffa02ffd640 1 --2- 172.21.15.7:0/3566767806 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff9f006b4d0 0x7ff9f006d990 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8006fd0 tx=0x7ff9f8009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:44.324 INFO:teuthology.orchestra.run.smithi007.stdout: cluster: 2024-04-25T10:03:44.324 INFO:teuthology.orchestra.run.smithi007.stdout: id: c03d0745-5946-49c3-ad88-1165c5b68b4e 2024-04-25T10:03:44.324 INFO:teuthology.orchestra.run.smithi007.stdout: health: HEALTH_OK 2024-04-25T10:03:44.324 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:03:44.325 INFO:teuthology.orchestra.run.smithi007.stdout: services: 2024-04-25T10:03:44.325 INFO:teuthology.orchestra.run.smithi007.stdout: mon: 3 daemons, quorum a,b,c (age 9m) 2024-04-25T10:03:44.325 INFO:teuthology.orchestra.run.smithi007.stdout: mgr: y(active, since 9m), standbys: x 2024-04-25T10:03:44.325 INFO:teuthology.orchestra.run.smithi007.stdout: mds: 1/1 daemons up, 3 standby 2024-04-25T10:03:44.325 INFO:teuthology.orchestra.run.smithi007.stdout: osd: 8 osds: 8 up (since 9m), 8 in (since 9m) 2024-04-25T10:03:44.325 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:03:44.325 INFO:teuthology.orchestra.run.smithi007.stdout: data: 2024-04-25T10:03:44.325 INFO:teuthology.orchestra.run.smithi007.stdout: volumes: 1/1 healthy 2024-04-25T10:03:44.325 INFO:teuthology.orchestra.run.smithi007.stdout: pools: 3 pools, 97 pgs 2024-04-25T10:03:44.325 INFO:teuthology.orchestra.run.smithi007.stdout: objects: 30 objects, 19 MiB 2024-04-25T10:03:44.326 INFO:teuthology.orchestra.run.smithi007.stdout: usage: 291 MiB used, 720 GiB / 720 GiB avail 2024-04-25T10:03:44.326 INFO:teuthology.orchestra.run.smithi007.stdout: pgs: 97 active+clean 2024-04-25T10:03:44.326 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:03:44.326 INFO:teuthology.orchestra.run.smithi007.stdout: io: 2024-04-25T10:03:44.326 INFO:teuthology.orchestra.run.smithi007.stdout: client: 1.8 KiB/s rd, 102 B/s wr, 1 op/s rd, 0 op/s wr 2024-04-25T10:03:44.326 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:03:44.326 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:03:44.326 INFO:teuthology.orchestra.run.smithi007.stdout:2024-04-25T10:03:42.750110+0000 mon.a [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-25T10:03:44.326 INFO:teuthology.orchestra.run.smithi007.stdout:2024-04-25T10:03:42.750136+0000 mon.a [INF] Cluster is now healthy 2024-04-25T10:03:44.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.319+0000 7f3931bdf740 1 Processor -- start 2024-04-25T10:03:44.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.320+0000 7f3931bdf740 1 -- start start 2024-04-25T10:03:44.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.320+0000 7f3931bdf740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5645f4b6fcf0 0x5645f4b71180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.320+0000 7f3931bdf740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5645f4b70bb0 0x5645f4bba3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.320+0000 7f3931bdf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645f4bbde50 0x5645f4bba920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.320+0000 7f3931bdf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3928200460 con 0x5645f4bbde50 2024-04-25T10:03:44.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.320+0000 7f3931bdf740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39280b0500 con 0x5645f4b70bb0 2024-04-25T10:03:44.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.320+0000 7f3931bdf740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392815d310 con 0x5645f4b6fcf0 2024-04-25T10:03:44.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.320+0000 7f392d3a6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645f4bbde50 0x5645f4bba920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.320+0000 7f392d3a6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645f4bbde50 0x5645f4bba920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35728/0 (socket says 172.21.15.7:35728) 2024-04-25T10:03:44.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.320+0000 7f392d3a6640 1 -- 172.21.15.7:0/41164104 learned_addr learned my addr 172.21.15.7:0/41164104 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:44.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.321+0000 7f3927fff640 1 --2- 172.21.15.7:0/41164104 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5645f4b70bb0 0x5645f4bba3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.321+0000 7f392cba5640 1 --2- 172.21.15.7:0/41164104 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5645f4b6fcf0 0x5645f4b71180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.321+0000 7f392d3a6640 1 -- 172.21.15.7:0/41164104 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5645f4b6fcf0 msgr2=0x5645f4b71180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:44.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.321+0000 7f392d3a6640 1 --2- 172.21.15.7:0/41164104 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5645f4b6fcf0 0x5645f4b71180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.321+0000 7f392d3a6640 1 -- 172.21.15.7:0/41164104 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5645f4b70bb0 msgr2=0x5645f4bba3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:44.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.321+0000 7f392d3a6640 1 --2- 172.21.15.7:0/41164104 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5645f4b70bb0 0x5645f4bba3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.321+0000 7f392d3a6640 1 -- 172.21.15.7:0/41164104 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645f4b98580 con 0x5645f4bbde50 2024-04-25T10:03:44.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.321+0000 7f392d3a6640 1 --2- 172.21.15.7:0/41164104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645f4bbde50 0x5645f4bba920 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f3920004020 tx=0x7f392004a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f442477c85d4a98 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:44.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.321+0000 7f3911ffb640 1 -- 172.21.15.7:0/41164104 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920061070 con 0x5645f4bbde50 2024-04-25T10:03:44.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.321+0000 7f3911ffb640 1 -- 172.21.15.7:0/41164104 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39200075c0 con 0x5645f4bbde50 2024-04-25T10:03:44.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.321+0000 7f3911ffb640 1 -- 172.21.15.7:0/41164104 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920040040 con 0x5645f4bbde50 2024-04-25T10:03:44.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.322+0000 7f3931bdf740 1 -- 172.21.15.7:0/41164104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645f4bbde50 msgr2=0x5645f4bba920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.322+0000 7f3931bdf740 1 --2- 172.21.15.7:0/41164104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645f4bbde50 0x5645f4bba920 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f3920004020 tx=0x7f392004a000 comp rx=0 tx=0).stop 2024-04-25T10:03:44.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.322+0000 7f3931bdf740 1 -- 172.21.15.7:0/41164104 shutdown_connections 2024-04-25T10:03:44.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.322+0000 7f3931bdf740 1 --2- 172.21.15.7:0/41164104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645f4bbde50 0x5645f4bba920 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.322+0000 7f3931bdf740 1 --2- 172.21.15.7:0/41164104 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5645f4b70bb0 0x5645f4bba3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.322+0000 7f3931bdf740 1 --2- 172.21.15.7:0/41164104 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5645f4b6fcf0 0x5645f4b71180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.322+0000 7f3931bdf740 1 -- 172.21.15.7:0/41164104 >> 172.21.15.7:0/41164104 conn(0x5645f4b6b830 msgr2=0x5645f4b9b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.322+0000 7f3931bdf740 1 -- 172.21.15.7:0/41164104 shutdown_connections 2024-04-25T10:03:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.322+0000 7f3931bdf740 1 -- 172.21.15.7:0/41164104 wait complete. 2024-04-25T10:03:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.322+0000 7f3931bdf740 1 -- start start 2024-04-25T10:03:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.323+0000 7f3931bdf740 1 Processor -- start 2024-04-25T10:03:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.323+0000 7f3931bdf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645f4b6fcf0 0x5645f4c20920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.323+0000 7f3931bdf740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5645f4b70bb0 0x5645f4bc4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.323+0000 7f3931bdf740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5645f4bbde50 0x5645f4b91470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.323+0000 7f3931bdf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39280aff00 con 0x5645f4b6fcf0 2024-04-25T10:03:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.323+0000 7f3931bdf740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645f4bc56c0 con 0x5645f4bbde50 2024-04-25T10:03:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.323+0000 7f3931bdf740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5645f4bd9910 con 0x5645f4b70bb0 2024-04-25T10:03:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.323+0000 7f3931bdf740 10 client.0 _ll_register_callbacks cb 0x7f3920009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:03:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.323+0000 7f392cba5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645f4b6fcf0 0x5645f4c20920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.323+0000 7f392cba5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645f4b6fcf0 0x5645f4c20920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35740/0 (socket says 172.21.15.7:35740) 2024-04-25T10:03:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.323+0000 7f392cba5640 1 -- 172.21.15.7:0/1094651092 learned_addr learned my addr 172.21.15.7:0/1094651092 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.324+0000 7f392d3a6640 1 --2- 172.21.15.7:0/1094651092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5645f4bbde50 0x5645f4b91470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.324+0000 7f3927fff640 1 --2- 172.21.15.7:0/1094651092 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5645f4b70bb0 0x5645f4bc4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.324+0000 7f392cba5640 1 -- 172.21.15.7:0/1094651092 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5645f4b70bb0 msgr2=0x5645f4bc4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.324+0000 7f392cba5640 1 --2- 172.21.15.7:0/1094651092 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5645f4b70bb0 0x5645f4bc4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.324+0000 7f392cba5640 1 -- 172.21.15.7:0/1094651092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5645f4bbde50 msgr2=0x5645f4b91470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.324+0000 7f392cba5640 1 --2- 172.21.15.7:0/1094651092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5645f4bbde50 0x5645f4b91470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.324+0000 7f392cba5640 1 -- 172.21.15.7:0/1094651092 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5645f4b6d080 con 0x5645f4b6fcf0 2024-04-25T10:03:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.324+0000 7f392d3a6640 1 --2- 172.21.15.7:0/1094651092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5645f4bbde50 0x5645f4b91470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.324+0000 7f392cba5640 1 --2- 172.21.15.7:0/1094651092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645f4b6fcf0 0x5645f4c20920 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f391c054a50 tx=0x7f391c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b95a66bed89ada server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.324+0000 7f39077fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:03:44.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.324+0000 7f39077fe640 1 -- 172.21.15.7:0/1094651092 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c060d00 con 0x5645f4b6fcf0 2024-04-25T10:03:44.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.324+0000 7f39077fe640 1 -- 172.21.15.7:0/1094651092 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f391c0568f0 con 0x5645f4b6fcf0 2024-04-25T10:03:44.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.324+0000 7f3931bdf740 1 -- 172.21.15.7:0/1094651092 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f39200075c0 con 0x5645f4b6fcf0 2024-04-25T10:03:44.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.324+0000 7f39077fe640 1 -- 172.21.15.7:0/1094651092 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f391c004d70 con 0x5645f4b6fcf0 2024-04-25T10:03:44.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.324+0000 7f3931bdf740 10 client.8838 fetch_fsmap learned FSMap version 79 2024-04-25T10:03:44.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.324+0000 7f3931bdf740 1 -- 172.21.15.7:0/1094651092 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) v3 -- 0x5645f4bc5110 con 0x5645f4b6fcf0 2024-04-25T10:03:44.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.324+0000 7f39077fe640 1 -- 172.21.15.7:0/1094651092 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39200075c0 con 0x5645f4b6fcf0 2024-04-25T10:03:44.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.324+0000 7f39077fe640 1 -- 172.21.15.7:0/1094651092 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 79) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f391c054c60 con 0x5645f4b6fcf0 2024-04-25T10:03:44.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.324+0000 7f3931bdf740 10 client.8838 fetch_fsmap finished waiting for FSMap version 79 2024-04-25T10:03:44.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.324+0000 7f3931bdf740 10 client.8838 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T10:03:44.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.324+0000 7f3931bdf740 20 client.8838 populate_metadata read hostname 'smithi007' 2024-04-25T10:03:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.324+0000 7f3931bdf740 1 --2- 172.21.15.7:0/1094651092 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x5645f4bd0d70 0x5645f4b71180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.324+0000 7f3931bdf740 4 client.8838 mds_command: new command op to 8736 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-04-25T10:03:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.324+0000 7f3931bdf740 1 -- 172.21.15.7:0/1094651092 --> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x5645f4adc350 con 0x5645f4bd0d70 2024-04-25T10:03:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.325+0000 7f3927fff640 1 --2- 172.21.15.7:0/1094651092 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x5645f4bd0d70 0x5645f4b71180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.325+0000 7f3927fff640 1 --2- 172.21.15.7:0/1094651092 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x5645f4bd0d70 0x5645f4b71180 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d041f555f3b24d0 server_cookie=3998ab3ac5c16e6f in_seq=0 out_seq=0 2024-04-25T10:03:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.325+0000 7f39077fe640 10 client.8838 ms_handle_connect on v2:172.21.15.7:6835/1214875974 2024-04-25T10:03:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.325+0000 7f39077fe640 1 -- 172.21.15.7:0/1094651092 <== mds.0 v2:172.21.15.7:6835/1214875974 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5645f4adc350 con 0x5645f4bd0d70 2024-04-25T10:03:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.325+0000 7f39077fe640 10 client.8838 handle_command_reply: tid=0 2024-04-25T10:03:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.325+0000 7f3931bdf740 1 client.8838 shutdown 2024-04-25T10:03:44.339 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-04-25T10:03:44.326+0000 7f6f4c582640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000001 2024-04-25T10:03:44.339 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-04-25T10:03:44.326+0000 7f6f4c582640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000001 2024-04-25T10:03:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.326+0000 7f3931bdf740 1 -- 172.21.15.7:0/1094651092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645f4b6fcf0 msgr2=0x5645f4c20920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.326+0000 7f3931bdf740 1 --2- 172.21.15.7:0/1094651092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645f4b6fcf0 0x5645f4c20920 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f391c054a50 tx=0x7f391c009040 comp rx=0 tx=0).stop 2024-04-25T10:03:44.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.326+0000 7f3931bdf740 1 -- 172.21.15.7:0/1094651092 shutdown_connections 2024-04-25T10:03:44.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.326+0000 7f3931bdf740 1 --2- 172.21.15.7:0/1094651092 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x5645f4bd0d70 0x5645f4b71180 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.326+0000 7f3931bdf740 1 --2- 172.21.15.7:0/1094651092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5645f4bbde50 0x5645f4b91470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.326+0000 7f3931bdf740 1 --2- 172.21.15.7:0/1094651092 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5645f4b70bb0 0x5645f4bc4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.326+0000 7f3931bdf740 1 --2- 172.21.15.7:0/1094651092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645f4b6fcf0 0x5645f4c20920 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.326+0000 7f3931bdf740 1 -- 172.21.15.7:0/1094651092 >> 172.21.15.7:0/1094651092 conn(0x5645f4b6b830 msgr2=0x5645f4b726c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:44.340 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-04-25T10:03:44.326+0000 7f6f4c582640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000002 2024-04-25T10:03:44.340 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-04-25T10:03:44.326+0000 7f6f4c582640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000002 2024-04-25T10:03:44.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.326+0000 7f39077fe640 0 client.8838 ms_handle_reset on v2:172.21.15.7:6835/1214875974 2024-04-25T10:03:44.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.326+0000 7f3931bdf740 1 -- 172.21.15.7:0/1094651092 shutdown_connections 2024-04-25T10:03:44.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.326+0000 7f3931bdf740 1 -- 172.21.15.7:0/1094651092 wait complete. 2024-04-25T10:03:44.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.326+0000 7f3931bdf740 20 client.8838 trim_cache size 0 max 16384 2024-04-25T10:03:44.342 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:03:44.342 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-04-25T10:03:44.342 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "943e5f0d-0bf1-4399-8999-3646e73d6167", 2024-04-25T10:03:44.342 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-04-25T10:03:44.342 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:03:44.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.327+0000 7f392ee09640 1 -- 172.21.15.7:0/1172882309 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f390c06b4d0 msgr2=0x7f390c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.327+0000 7f392ee09640 1 --2- 172.21.15.7:0/1172882309 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f390c06b4d0 0x7f390c06d990 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f39280aecb0 tx=0x7f39140079b0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.327+0000 7f392ee09640 1 -- 172.21.15.7:0/1172882309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39280ce670 msgr2=0x7f3928070680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.327+0000 7f392ee09640 1 --2- 172.21.15.7:0/1172882309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39280ce670 0x7f3928070680 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f391c00c430 tx=0x7f391c00c8f0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.327+0000 7f392ee09640 1 -- 172.21.15.7:0/1172882309 shutdown_connections 2024-04-25T10:03:44.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.327+0000 7f392ee09640 1 --2- 172.21.15.7:0/1172882309 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f390c06b4d0 0x7f390c06d990 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.327+0000 7f392ee09640 1 --2- 172.21.15.7:0/1172882309 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f392815db90 0x7f3928153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.327+0000 7f392ee09640 1 --2- 172.21.15.7:0/1172882309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39280cf890 0x7f3928154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.327+0000 7f392ee09640 1 --2- 172.21.15.7:0/1172882309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39280ce670 0x7f3928070680 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.327+0000 7f392ee09640 1 -- 172.21.15.7:0/1172882309 >> 172.21.15.7:0/1172882309 conn(0x7f39280d1650 msgr2=0x7f39280b34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:44.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.327+0000 7f392ee09640 1 -- 172.21.15.7:0/1172882309 shutdown_connections 2024-04-25T10:03:44.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.327+0000 7f392ee09640 1 -- 172.21.15.7:0/1172882309 wait complete. 2024-04-25T10:03:44.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:03:44.345 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-25T10:03:44.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.442+0000 7f70e2d5a640 1 Processor -- start 2024-04-25T10:03:44.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.443+0000 7f70e2d5a640 1 -- start start 2024-04-25T10:03:44.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.443+0000 7f70e2d5a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f70dc0d0a00 0x7f70dc09a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.443+0000 7f70e2d5a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f70dc09a7d0 0x7f70dc0cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.443+0000 7f70e2d5a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70dc1615e0 con 0x7f70dc161200 2024-04-25T10:03:44.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.443+0000 7f70e2d5a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70dc06c9f0 con 0x7f70dc0d0a00 2024-04-25T10:03:44.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.443+0000 7f70e2d5a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc06ccd0 con 0x7f70dc09a7d0 2024-04-25T10:03:44.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.443+0000 7f70dbfff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f70dc0d0a00 0x7f70dc09a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.444+0000 7f70dbfff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f70dc0d0a00 0x7f70dc09a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35748/0 (socket says 172.21.15.7:35748) 2024-04-25T10:03:44.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.444+0000 7f70dbfff640 1 -- 172.21.15.7:0/1008540015 learned_addr learned my addr 172.21.15.7:0/1008540015 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:44.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.444+0000 7f70e12f7640 1 --2- 172.21.15.7:0/1008540015 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f70dc09a7d0 0x7f70dc0cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.444+0000 7f70dbfff640 1 -- 172.21.15.7:0/1008540015 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f70dc09a7d0 msgr2=0x7f70dc0cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:44.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.444+0000 7f70dbfff640 1 --2- 172.21.15.7:0/1008540015 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f70dc09a7d0 0x7f70dc0cf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.444+0000 7f70dbfff640 1 -- 172.21.15.7:0/1008540015 >> v1:172.21.15.55:6789/0 conn(0x7f70dc161200 legacy=0x7f70dc0cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.444+0000 7f70dbfff640 1 -- 172.21.15.7:0/1008540015 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70dc099a90 con 0x7f70dc0d0a00 2024-04-25T10:03:44.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.444+0000 7f70e12f7640 1 --2- 172.21.15.7:0/1008540015 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f70dc09a7d0 0x7f70dc0cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:44.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.444+0000 7f70dbfff640 1 --2- 172.21.15.7:0/1008540015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70dc0d0a00 0x7f70dc09a290 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f70c8009870 tx=0x7f70c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd006fb31b62e70 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:44.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.445+0000 7f70db7fe640 1 -- 172.21.15.7:0/1008540015 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c8037070 con 0x7f70dc0d0a00 2024-04-25T10:03:44.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.445+0000 7f70db7fe640 1 -- 172.21.15.7:0/1008540015 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c8032440 con 0x7f70dc0d0a00 2024-04-25T10:03:44.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.445+0000 7f70db7fe640 1 -- 172.21.15.7:0/1008540015 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c8032810 con 0x7f70dc0d0a00 2024-04-25T10:03:44.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.445+0000 7f70e2d5a640 1 -- 172.21.15.7:0/1008540015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70dc0d0a00 msgr2=0x7f70dc09a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.445+0000 7f70e2d5a640 1 --2- 172.21.15.7:0/1008540015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70dc0d0a00 0x7f70dc09a290 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f70c8009870 tx=0x7f70c802a270 comp rx=0 tx=0).stop 2024-04-25T10:03:44.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.445+0000 7f70e2d5a640 1 -- 172.21.15.7:0/1008540015 shutdown_connections 2024-04-25T10:03:44.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.445+0000 7f70e2d5a640 1 --2- 172.21.15.7:0/1008540015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70dc0d0a00 0x7f70dc09a290 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.445+0000 7f70e2d5a640 1 --2- 172.21.15.7:0/1008540015 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f70dc09a7d0 0x7f70dc0cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.445+0000 7f70e2d5a640 1 -- 172.21.15.7:0/1008540015 >> 172.21.15.7:0/1008540015 conn(0x7f70dc0b31a0 msgr2=0x7f70dc0b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:44.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.445+0000 7f70e2d5a640 1 -- 172.21.15.7:0/1008540015 shutdown_connections 2024-04-25T10:03:44.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.445+0000 7f70e2d5a640 1 -- 172.21.15.7:0/1008540015 wait complete. 2024-04-25T10:03:44.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.446+0000 7f70e2d5a640 1 Processor -- start 2024-04-25T10:03:44.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.446+0000 7f70e2d5a640 1 -- start start 2024-04-25T10:03:44.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.447+0000 7f70e2d5a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70dc09a7d0 0x7f70dc156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.447+0000 7f70e2d5a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f70dc0d0a00 0x7f70dc15ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.447+0000 7f70e2d5a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70dc161200 0x7f70dc15f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.447+0000 7f70e2d5a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc06cfb0 con 0x7f70dc09a7d0 2024-04-25T10:03:44.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.447+0000 7f70e2d5a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc06c680 con 0x7f70dc161200 2024-04-25T10:03:44.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.447+0000 7f70e2d5a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc06d130 con 0x7f70dc0d0a00 2024-04-25T10:03:44.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.447+0000 7f70e0af6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70dc09a7d0 0x7f70dc156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.447+0000 7f70e0af6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70dc09a7d0 0x7f70dc156ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35750/0 (socket says 172.21.15.7:35750) 2024-04-25T10:03:44.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.447+0000 7f70e0af6640 1 -- 172.21.15.7:0/959982565 learned_addr learned my addr 172.21.15.7:0/959982565 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:44.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.448+0000 7f70e12f7640 1 --2- 172.21.15.7:0/959982565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70dc161200 0x7f70dc15f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.448+0000 7f70dbfff640 1 --2- 172.21.15.7:0/959982565 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f70dc0d0a00 0x7f70dc15ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.448+0000 7f70e0af6640 1 -- 172.21.15.7:0/959982565 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f70dc0d0a00 msgr2=0x7f70dc15ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.448+0000 7f70e0af6640 1 --2- 172.21.15.7:0/959982565 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f70dc0d0a00 0x7f70dc15ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.448+0000 7f70e0af6640 1 -- 172.21.15.7:0/959982565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70dc161200 msgr2=0x7f70dc15f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.448+0000 7f70e0af6640 1 --2- 172.21.15.7:0/959982565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70dc161200 0x7f70dc15f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.448+0000 7f70e0af6640 1 -- 172.21.15.7:0/959982565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70dc1571e0 con 0x7f70dc09a7d0 2024-04-25T10:03:44.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.448+0000 7f70e12f7640 1 --2- 172.21.15.7:0/959982565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70dc161200 0x7f70dc15f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:03:44.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.448+0000 7f70e0af6640 1 --2- 172.21.15.7:0/959982565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70dc09a7d0 0x7f70dc156ca0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f70d000c3f0 tx=0x7f70d000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:44.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.448+0000 7f70d97fa640 1 -- 172.21.15.7:0/959982565 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d00052d0 con 0x7f70dc09a7d0 2024-04-25T10:03:44.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.448+0000 7f70d97fa640 1 -- 172.21.15.7:0/959982565 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d0005490 con 0x7f70dc09a7d0 2024-04-25T10:03:44.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.448+0000 7f70e2d5a640 1 -- 172.21.15.7:0/959982565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70dc15fa40 con 0x7f70dc09a7d0 2024-04-25T10:03:44.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.448+0000 7f70d97fa640 1 -- 172.21.15.7:0/959982565 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d0007260 con 0x7f70dc09a7d0 2024-04-25T10:03:44.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.448+0000 7f70e2d5a640 1 -- 172.21.15.7:0/959982565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70dc0b53d0 con 0x7f70dc09a7d0 2024-04-25T10:03:44.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.450+0000 7f70d97fa640 1 -- 172.21.15.7:0/959982565 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f70d0007400 con 0x7f70dc09a7d0 2024-04-25T10:03:44.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.450+0000 7f70d97fa640 1 --2- 172.21.15.7:0/959982565 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f70c006b4d0 0x7f70c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.450+0000 7f70d97fa640 1 -- 172.21.15.7:0/959982565 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f70d0089870 con 0x7f70dc09a7d0 2024-04-25T10:03:44.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.450+0000 7f70dbfff640 1 --2- 172.21.15.7:0/959982565 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f70c006b4d0 0x7f70c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.451+0000 7f70dbfff640 1 --2- 172.21.15.7:0/959982565 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f70c006b4d0 0x7f70c006d990 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f70c8034000 tx=0x7f70c802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:44.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.451+0000 7f70e5a58740 1 Processor -- start 2024-04-25T10:03:44.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.451+0000 7f70e5a58740 1 -- start start 2024-04-25T10:03:44.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.452+0000 7f70e5a58740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9e8bebb10 0x55a9e8bee320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.452+0000 7f70e5a58740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9e8bebef0 0x55a9e8bee860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.452+0000 7f70e5a58740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a9e8bbe770 0x55a9e8bc1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.452+0000 7f70e5a58740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e8b27da0 con 0x55a9e8bebb10 2024-04-25T10:03:44.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.452+0000 7f70e5a58740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e8ad0b80 con 0x55a9e8bebef0 2024-04-25T10:03:44.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.452+0000 7f70e5a58740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a9e8b23e40 con 0x55a9e8bbe770 2024-04-25T10:03:44.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.452+0000 7f70e0af6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9e8bebb10 0x55a9e8bee320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.452+0000 7f70e0af6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9e8bebb10 0x55a9e8bee320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35758/0 (socket says 172.21.15.7:35758) 2024-04-25T10:03:44.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.452+0000 7f70e0af6640 1 -- 172.21.15.7:0/1225325803 learned_addr learned my addr 172.21.15.7:0/1225325803 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:44.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.452+0000 7f70dbfff640 1 --2- 172.21.15.7:0/1225325803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9e8bebef0 0x55a9e8bee860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.452+0000 7f70e12f7640 1 --2- 172.21.15.7:0/1225325803 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a9e8bbe770 0x55a9e8bc1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.452+0000 7f70e0af6640 1 -- 172.21.15.7:0/1225325803 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a9e8bbe770 msgr2=0x55a9e8bc1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:44.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.452+0000 7f70e0af6640 1 --2- 172.21.15.7:0/1225325803 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a9e8bbe770 0x55a9e8bc1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.452+0000 7f70e0af6640 1 -- 172.21.15.7:0/1225325803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9e8bebef0 msgr2=0x55a9e8bee860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:44.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.452+0000 7f70e0af6640 1 --2- 172.21.15.7:0/1225325803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9e8bebef0 0x55a9e8bee860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.452+0000 7f70e0af6640 1 -- 172.21.15.7:0/1225325803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9e8adaf10 con 0x55a9e8bebb10 2024-04-25T10:03:44.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.452+0000 7f70e12f7640 1 --2- 172.21.15.7:0/1225325803 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a9e8bbe770 0x55a9e8bc1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:03:44.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.452+0000 7f70e0af6640 1 --2- 172.21.15.7:0/1225325803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9e8bebb10 0x55a9e8bee320 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f70d0087c10 tx=0x7f70d000a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c192e0101d5834 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:44.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.453+0000 7f70c67fc640 1 -- 172.21.15.7:0/1225325803 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d0056160 con 0x55a9e8bebb10 2024-04-25T10:03:44.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.453+0000 7f70c67fc640 1 -- 172.21.15.7:0/1225325803 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d00544d0 con 0x55a9e8bebb10 2024-04-25T10:03:44.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.453+0000 7f70c67fc640 1 -- 172.21.15.7:0/1225325803 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d00572b0 con 0x55a9e8bebb10 2024-04-25T10:03:44.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.453+0000 7f70e5a58740 1 -- 172.21.15.7:0/1225325803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9e8bebb10 msgr2=0x55a9e8bee320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.453+0000 7f70e5a58740 1 --2- 172.21.15.7:0/1225325803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9e8bebb10 0x55a9e8bee320 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f70d0087c10 tx=0x7f70d000a000 comp rx=0 tx=0).stop 2024-04-25T10:03:44.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.453+0000 7f70e5a58740 1 -- 172.21.15.7:0/1225325803 shutdown_connections 2024-04-25T10:03:44.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.453+0000 7f70e5a58740 1 --2- 172.21.15.7:0/1225325803 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a9e8bbe770 0x55a9e8bc1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.453+0000 7f70e5a58740 1 --2- 172.21.15.7:0/1225325803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9e8bebef0 0x55a9e8bee860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.453+0000 7f70e5a58740 1 --2- 172.21.15.7:0/1225325803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9e8bebb10 0x55a9e8bee320 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.453+0000 7f70e5a58740 1 -- 172.21.15.7:0/1225325803 >> 172.21.15.7:0/1225325803 conn(0x55a9e8bc09e0 msgr2=0x55a9e8c09320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:44.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.453+0000 7f70e5a58740 1 -- 172.21.15.7:0/1225325803 shutdown_connections 2024-04-25T10:03:44.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.453+0000 7f70e5a58740 1 -- 172.21.15.7:0/1225325803 wait complete. 2024-04-25T10:03:44.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.454+0000 7f70e5a58740 1 -- start start 2024-04-25T10:03:44.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.454+0000 7f70e5a58740 1 Processor -- start 2024-04-25T10:03:44.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.455+0000 7f70e5a58740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9e8bebb10 0x55a9e8be25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.455+0000 7f70e5a58740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a9e8bebef0 0x55a9e8bedc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.455+0000 7f70e5a58740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9e8bee140 0x55a9e8c0a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.455+0000 7f70e5a58740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e8bc3b90 con 0x55a9e8bebb10 2024-04-25T10:03:44.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.455+0000 7f70e5a58740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e8ac64b0 con 0x55a9e8bee140 2024-04-25T10:03:44.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.455+0000 7f70e5a58740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a9e8bc3e70 con 0x55a9e8bebef0 2024-04-25T10:03:44.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.455+0000 7f70e5a58740 10 client.0 _ll_register_callbacks cb 0x55a9e8b06180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:03:44.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.455+0000 7f70e0af6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9e8bebb10 0x55a9e8be25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.455+0000 7f70e0af6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9e8bebb10 0x55a9e8be25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35768/0 (socket says 172.21.15.7:35768) 2024-04-25T10:03:44.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.455+0000 7f70e0af6640 1 -- 172.21.15.7:0/2892303183 learned_addr learned my addr 172.21.15.7:0/2892303183 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:44.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.455+0000 7f70e12f7640 1 --2- 172.21.15.7:0/2892303183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9e8bee140 0x55a9e8c0a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.455+0000 7f70dbfff640 1 --2- 172.21.15.7:0/2892303183 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a9e8bebef0 0x55a9e8bedc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.455+0000 7f70e0af6640 1 -- 172.21.15.7:0/2892303183 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a9e8bebef0 msgr2=0x55a9e8bedc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:44.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.455+0000 7f70e0af6640 1 --2- 172.21.15.7:0/2892303183 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a9e8bebef0 0x55a9e8bedc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.455+0000 7f70e0af6640 1 -- 172.21.15.7:0/2892303183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9e8bee140 msgr2=0x55a9e8c0a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:44.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.455+0000 7f70e0af6640 1 --2- 172.21.15.7:0/2892303183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9e8bee140 0x55a9e8c0a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.455+0000 7f70e0af6640 1 -- 172.21.15.7:0/2892303183 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a9e89067d0 con 0x55a9e8bebb10 2024-04-25T10:03:44.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.455+0000 7f70dbfff640 1 --2- 172.21.15.7:0/2892303183 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a9e8bebef0 0x55a9e8bedc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:44.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.455+0000 7f70e0af6640 1 --2- 172.21.15.7:0/2892303183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9e8bebb10 0x55a9e8be25d0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f70d00542c0 tx=0x7f70d0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f35c9720bac349 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:44.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.455+0000 7f70bb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:03:44.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.455+0000 7f70bb7fe640 1 -- 172.21.15.7:0/2892303183 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d0054100 con 0x55a9e8bebb10 2024-04-25T10:03:44.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.456+0000 7f70bb7fe640 1 -- 172.21.15.7:0/2892303183 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f70d00572b0 con 0x55a9e8bebb10 2024-04-25T10:03:44.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.456+0000 7f70e5a58740 1 -- 172.21.15.7:0/2892303183 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f70d00544d0 con 0x55a9e8bebb10 2024-04-25T10:03:44.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.456+0000 7f70bb7fe640 1 -- 172.21.15.7:0/2892303183 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70d0076050 con 0x55a9e8bebb10 2024-04-25T10:03:44.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.456+0000 7f70e5a58740 10 client.8850 fetch_fsmap learned FSMap version 79 2024-04-25T10:03:44.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.456+0000 7f70e5a58740 1 -- 172.21.15.7:0/2892303183 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) v3 -- 0x55a9e883c3f0 con 0x55a9e8bebb10 2024-04-25T10:03:44.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.456+0000 7f70bb7fe640 1 -- 172.21.15.7:0/2892303183 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d00544d0 con 0x55a9e8bebb10 2024-04-25T10:03:44.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.456+0000 7f70bb7fe640 1 -- 172.21.15.7:0/2892303183 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 79) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f70d0053bb0 con 0x55a9e8bebb10 2024-04-25T10:03:44.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.456+0000 7f70e5a58740 10 client.8850 fetch_fsmap finished waiting for FSMap version 79 2024-04-25T10:03:44.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.456+0000 7f70e5a58740 10 client.8850 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T10:03:44.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.456+0000 7f70e5a58740 20 client.8850 populate_metadata read hostname 'smithi007' 2024-04-25T10:03:44.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.456+0000 7f70e5a58740 1 --2- 172.21.15.7:0/2892303183 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x55a9e8c03eb0 0x55a9e8c04320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.456+0000 7f70e5a58740 4 client.8850 mds_command: new command op to 8736 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:03:44.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.456+0000 7f70e5a58740 1 -- 172.21.15.7:0/2892303183 --> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a9e8b352e0 con 0x55a9e8c03eb0 2024-04-25T10:03:44.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.456+0000 7f70dbfff640 1 --2- 172.21.15.7:0/2892303183 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x55a9e8c03eb0 0x55a9e8c04320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.457+0000 7f70dbfff640 1 --2- 172.21.15.7:0/2892303183 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x55a9e8c03eb0 0x55a9e8c04320 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c3857d23d3adb6b server_cookie=b71a526ee5cd6a18 in_seq=0 out_seq=0 2024-04-25T10:03:44.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.457+0000 7f70bb7fe640 10 client.8850 ms_handle_connect on v2:172.21.15.7:6835/1214875974 2024-04-25T10:03:44.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.457+0000 7f70bb7fe640 1 -- 172.21.15.7:0/2892303183 <== mds.0 v2:172.21.15.7:6835/1214875974 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a9e8b352e0 con 0x55a9e8c03eb0 2024-04-25T10:03:44.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.457+0000 7f70bb7fe640 10 client.8850 handle_command_reply: tid=0 2024-04-25T10:03:44.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.457+0000 7f70e5a58740 1 client.8850 shutdown 2024-04-25T10:03:44.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.457+0000 7f70e5a58740 1 -- 172.21.15.7:0/2892303183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9e8bebb10 msgr2=0x55a9e8be25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.457+0000 7f70e5a58740 1 --2- 172.21.15.7:0/2892303183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9e8bebb10 0x55a9e8be25d0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f70d00542c0 tx=0x7f70d0000bc0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.457+0000 7f70e5a58740 1 -- 172.21.15.7:0/2892303183 shutdown_connections 2024-04-25T10:03:44.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.457+0000 7f70e5a58740 1 --2- 172.21.15.7:0/2892303183 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x55a9e8c03eb0 0x55a9e8c04320 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.457+0000 7f70e5a58740 1 --2- 172.21.15.7:0/2892303183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9e8bee140 0x55a9e8c0a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.457+0000 7f70e5a58740 1 --2- 172.21.15.7:0/2892303183 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a9e8bebef0 0x55a9e8bedc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.457+0000 7f70bb7fe640 0 client.8850 ms_handle_reset on v2:172.21.15.7:6835/1214875974 2024-04-25T10:03:44.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.457+0000 7f70e5a58740 1 --2- 172.21.15.7:0/2892303183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9e8bebb10 0x55a9e8be25d0 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.457+0000 7f70e5a58740 1 -- 172.21.15.7:0/2892303183 >> 172.21.15.7:0/2892303183 conn(0x55a9e8bbe770 msgr2=0x55a9e8bbf420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:44.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.457+0000 7f70e5a58740 1 -- 172.21.15.7:0/2892303183 shutdown_connections 2024-04-25T10:03:44.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.457+0000 7f70e5a58740 1 -- 172.21.15.7:0/2892303183 wait complete. 2024-04-25T10:03:44.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.458+0000 7f70e5a58740 20 client.8850 trim_cache size 0 max 16384 2024-04-25T10:03:44.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.473+0000 7f70e5a58740 1 Processor -- start 2024-04-25T10:03:44.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.473+0000 7f70e5a58740 1 -- start start 2024-04-25T10:03:44.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.473+0000 7f70e5a58740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a9e8bebb10 0x55a9e8c09320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.473+0000 7f70e5a58740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9e8bebef0 0x55a9e8be1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.473+0000 7f70e5a58740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9e8bee140 0x55a9e8bc2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.473+0000 7f70e5a58740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc2006e0 con 0x55a9e8bebef0 2024-04-25T10:03:44.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.473+0000 7f70e5a58740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc1ff800 con 0x55a9e8bee140 2024-04-25T10:03:44.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.473+0000 7f70e5a58740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc0b6cf0 con 0x55a9e8bebb10 2024-04-25T10:03:44.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.473+0000 7f70dbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9e8bebef0 0x55a9e8be1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.473+0000 7f70dbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9e8bebef0 0x55a9e8be1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35782/0 (socket says 172.21.15.7:35782) 2024-04-25T10:03:44.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.473+0000 7f70dbfff640 1 -- 172.21.15.7:0/4220287503 learned_addr learned my addr 172.21.15.7:0/4220287503 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:44.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.474+0000 7f70e12f7640 1 --2- 172.21.15.7:0/4220287503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9e8bee140 0x55a9e8bc2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.474+0000 7f70e0af6640 1 --2- 172.21.15.7:0/4220287503 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a9e8bebb10 0x55a9e8c09320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.474+0000 7f70dbfff640 1 -- 172.21.15.7:0/4220287503 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a9e8bebb10 msgr2=0x55a9e8c09320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:44.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.474+0000 7f70dbfff640 1 --2- 172.21.15.7:0/4220287503 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a9e8bebb10 0x55a9e8c09320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.474+0000 7f70dbfff640 1 -- 172.21.15.7:0/4220287503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9e8bee140 msgr2=0x55a9e8bc2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:44.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.474+0000 7f70dbfff640 1 --2- 172.21.15.7:0/4220287503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9e8bee140 0x55a9e8bc2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.474+0000 7f70dbfff640 1 -- 172.21.15.7:0/4220287503 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9e8c0a7c0 con 0x55a9e8bebef0 2024-04-25T10:03:44.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.474+0000 7f70e0af6640 1 --2- 172.21.15.7:0/4220287503 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a9e8bebb10 0x55a9e8c09320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:03:44.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.474+0000 7f70dbfff640 1 --2- 172.21.15.7:0/4220287503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9e8bebef0 0x55a9e8be1780 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f70c80090b0 tx=0x7f70c802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9944747e58c77b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:44.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.474+0000 7f70c5ffb640 1 -- 172.21.15.7:0/4220287503 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c8037040 con 0x55a9e8bebef0 2024-04-25T10:03:44.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.474+0000 7f70c5ffb640 1 -- 172.21.15.7:0/4220287503 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c804d410 con 0x55a9e8bebef0 2024-04-25T10:03:44.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.474+0000 7f70c5ffb640 1 -- 172.21.15.7:0/4220287503 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c804d7c0 con 0x55a9e8bebef0 2024-04-25T10:03:44.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.474+0000 7f70e5a58740 1 -- 172.21.15.7:0/4220287503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9e8bebef0 msgr2=0x55a9e8be1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.474+0000 7f70e5a58740 1 --2- 172.21.15.7:0/4220287503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9e8bebef0 0x55a9e8be1780 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f70c80090b0 tx=0x7f70c802c000 comp rx=0 tx=0).stop 2024-04-25T10:03:44.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.475+0000 7f70e5a58740 1 -- 172.21.15.7:0/4220287503 shutdown_connections 2024-04-25T10:03:44.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.475+0000 7f70e5a58740 1 --2- 172.21.15.7:0/4220287503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9e8bee140 0x55a9e8bc2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.475+0000 7f70e5a58740 1 --2- 172.21.15.7:0/4220287503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9e8bebef0 0x55a9e8be1780 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.475+0000 7f70e5a58740 1 --2- 172.21.15.7:0/4220287503 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a9e8bebb10 0x55a9e8c09320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.475+0000 7f70e5a58740 1 -- 172.21.15.7:0/4220287503 >> 172.21.15.7:0/4220287503 conn(0x55a9e8bbe770 msgr2=0x55a9e8c04290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:44.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.475+0000 7f70e5a58740 1 -- 172.21.15.7:0/4220287503 shutdown_connections 2024-04-25T10:03:44.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.475+0000 7f70e5a58740 1 -- 172.21.15.7:0/4220287503 wait complete. 2024-04-25T10:03:44.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.475+0000 7f70e5a58740 1 -- start start 2024-04-25T10:03:44.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.475+0000 7f70e5a58740 1 Processor -- start 2024-04-25T10:03:44.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.476+0000 7f70e5a58740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a9e8bebb10 0x55a9e8bfecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.476+0000 7f70e5a58740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9e8bebef0 0x55a9e8bff1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.476+0000 7f70e5a58740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9e8bee140 0x55a9e8c17d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.476+0000 7f70e5a58740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e8c0d1f0 con 0x55a9e8bebef0 2024-04-25T10:03:44.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.476+0000 7f70e5a58740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc1ff210 con 0x55a9e8bee140 2024-04-25T10:03:44.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.476+0000 7f70e5a58740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a9e8be0c20 con 0x55a9e8bebb10 2024-04-25T10:03:44.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.476+0000 7f70e5a58740 10 client.0 _ll_register_callbacks cb 0x7f70d0057c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:03:44.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.476+0000 7f70dbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9e8bebef0 0x55a9e8bff1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.476+0000 7f70dbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9e8bebef0 0x55a9e8bff1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35796/0 (socket says 172.21.15.7:35796) 2024-04-25T10:03:44.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.476+0000 7f70dbfff640 1 -- 172.21.15.7:0/2417867785 learned_addr learned my addr 172.21.15.7:0/2417867785 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:03:44.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.476+0000 7f70e12f7640 1 --2- 172.21.15.7:0/2417867785 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9e8bee140 0x55a9e8c17d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.476+0000 7f70e0af6640 1 --2- 172.21.15.7:0/2417867785 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a9e8bebb10 0x55a9e8bfecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.476+0000 7f70dbfff640 1 -- 172.21.15.7:0/2417867785 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a9e8bebb10 msgr2=0x55a9e8bfecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:44.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.476+0000 7f70dbfff640 1 --2- 172.21.15.7:0/2417867785 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a9e8bebb10 0x55a9e8bfecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.477+0000 7f70dbfff640 1 -- 172.21.15.7:0/2417867785 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9e8bee140 msgr2=0x55a9e8c17d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:44.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.477+0000 7f70dbfff640 1 --2- 172.21.15.7:0/2417867785 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9e8bee140 0x55a9e8c17d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.477+0000 7f70dbfff640 1 -- 172.21.15.7:0/2417867785 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a9e87fc0f0 con 0x55a9e8bebef0 2024-04-25T10:03:44.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.477+0000 7f70e0af6640 1 --2- 172.21.15.7:0/2417867785 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a9e8bebb10 0x55a9e8bfecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:44.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.477+0000 7f70dbfff640 1 --2- 172.21.15.7:0/2417867785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9e8bebef0 0x55a9e8bff1f0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f70c8009990 tx=0x7f70c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b3360e7c7a63e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:44.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.477+0000 7f70bb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:03:44.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.477+0000 7f70bb7fe640 1 -- 172.21.15.7:0/2417867785 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c8037040 con 0x55a9e8bebef0 2024-04-25T10:03:44.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.477+0000 7f70bb7fe640 1 -- 172.21.15.7:0/2417867785 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f70c804d880 con 0x55a9e8bebef0 2024-04-25T10:03:44.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.477+0000 7f70e5a58740 1 -- 172.21.15.7:0/2417867785 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f70c804d410 con 0x55a9e8bebef0 2024-04-25T10:03:44.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.477+0000 7f70bb7fe640 1 -- 172.21.15.7:0/2417867785 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70c8056440 con 0x55a9e8bebef0 2024-04-25T10:03:44.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.477+0000 7f70e5a58740 10 client.8856 fetch_fsmap learned FSMap version 79 2024-04-25T10:03:44.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.477+0000 7f70e5a58740 1 -- 172.21.15.7:0/2417867785 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) v3 -- 0x55a9e8c22970 con 0x55a9e8bebef0 2024-04-25T10:03:44.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.477+0000 7f70bb7fe640 1 -- 172.21.15.7:0/2417867785 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c804d410 con 0x55a9e8bebef0 2024-04-25T10:03:44.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.477+0000 7f70bb7fe640 1 -- 172.21.15.7:0/2417867785 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 79) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f70c8046040 con 0x55a9e8bebef0 2024-04-25T10:03:44.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.477+0000 7f70e5a58740 10 client.8856 fetch_fsmap finished waiting for FSMap version 79 2024-04-25T10:03:44.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.477+0000 7f70e5a58740 10 client.8856 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T10:03:44.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.477+0000 7f70e5a58740 20 client.8856 populate_metadata read hostname 'smithi007' 2024-04-25T10:03:44.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.477+0000 7f70e5a58740 1 --2- 172.21.15.7:0/2417867785 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x55a9e8bc2530 0x55a9e8c182b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:44.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.477+0000 7f70e5a58740 4 client.8856 mds_command: new command op to 8736 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T10:03:44.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.477+0000 7f70e5a58740 1 -- 172.21.15.7:0/2417867785 --> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a9e8b2f630 con 0x55a9e8bc2530 2024-04-25T10:03:44.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.477+0000 7f70e0af6640 1 --2- 172.21.15.7:0/2417867785 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x55a9e8bc2530 0x55a9e8c182b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:44.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.478+0000 7f70bb7fe640 10 client.8856 ms_handle_connect on v2:172.21.15.7:6835/1214875974 2024-04-25T10:03:44.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.478+0000 7f70e0af6640 1 --2- 172.21.15.7:0/2417867785 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x55a9e8bc2530 0x55a9e8c182b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96eb8d0e2947980b server_cookie=3f44a43469df18df in_seq=0 out_seq=0 2024-04-25T10:03:44.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.478+0000 7f70bb7fe640 1 -- 172.21.15.7:0/2417867785 <== mds.0 v2:172.21.15.7:6835/1214875974 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x55a9e8b2f630 con 0x55a9e8bc2530 2024-04-25T10:03:44.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.478+0000 7f70bb7fe640 10 client.8856 handle_command_reply: tid=0 2024-04-25T10:03:44.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.478+0000 7f70e5a58740 1 client.8856 shutdown 2024-04-25T10:03:44.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.478+0000 7f70e5a58740 1 -- 172.21.15.7:0/2417867785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9e8bebef0 msgr2=0x55a9e8bff1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.478+0000 7f70e5a58740 1 --2- 172.21.15.7:0/2417867785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9e8bebef0 0x55a9e8bff1f0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f70c8009990 tx=0x7f70c8004730 comp rx=0 tx=0).stop 2024-04-25T10:03:44.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.478+0000 7f70e5a58740 1 -- 172.21.15.7:0/2417867785 shutdown_connections 2024-04-25T10:03:44.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.478+0000 7f70e5a58740 1 --2- 172.21.15.7:0/2417867785 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x55a9e8bc2530 0x55a9e8c182b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.478+0000 7f70e5a58740 1 --2- 172.21.15.7:0/2417867785 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9e8bee140 0x55a9e8c17d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.478+0000 7f70e5a58740 1 --2- 172.21.15.7:0/2417867785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a9e8bebef0 0x55a9e8bff1f0 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.478+0000 7f70bb7fe640 0 client.8856 ms_handle_reset on v2:172.21.15.7:6835/1214875974 2024-04-25T10:03:44.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.478+0000 7f70e5a58740 1 --2- 172.21.15.7:0/2417867785 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a9e8bebb10 0x55a9e8bfecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.478+0000 7f70e5a58740 1 -- 172.21.15.7:0/2417867785 >> 172.21.15.7:0/2417867785 conn(0x55a9e8bbe770 msgr2=0x55a9e8be0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:44.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.478+0000 7f70e5a58740 1 -- 172.21.15.7:0/2417867785 shutdown_connections 2024-04-25T10:03:44.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.478+0000 7f70e5a58740 1 -- 172.21.15.7:0/2417867785 wait complete. 2024-04-25T10:03:44.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.478+0000 7f70e5a58740 20 client.8856 trim_cache size 0 max 16384 2024-04-25T10:03:44.491 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:03:44.492 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T10:03:44.492 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-04-25T10:03:44.492 INFO:teuthology.orchestra.run.smithi007.stdout: "943e5f0d-0bf1-4399-8999-3646e73d6167": { 2024-04-25T10:03:44.492 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-04-25T10:03:44.492 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "943e5f0d-0bf1-4399-8999-3646e73d6167", 2024-04-25T10:03:44.492 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,repair" 2024-04-25T10:03:44.492 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:03:44.492 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:03:44.492 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:03:44.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.479+0000 7f70e2d5a640 1 -- 172.21.15.7:0/959982565 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f70c006b4d0 msgr2=0x7f70c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.479+0000 7f70e2d5a640 1 --2- 172.21.15.7:0/959982565 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f70c006b4d0 0x7f70c006d990 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f70c8034000 tx=0x7f70c802e000 comp rx=0 tx=0).stop 2024-04-25T10:03:44.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.479+0000 7f70e2d5a640 1 -- 172.21.15.7:0/959982565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70dc09a7d0 msgr2=0x7f70dc156ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:44.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.479+0000 7f70e2d5a640 1 --2- 172.21.15.7:0/959982565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70dc09a7d0 0x7f70dc156ca0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f70d000c3f0 tx=0x7f70d000c8b0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.479+0000 7f70e2d5a640 1 -- 172.21.15.7:0/959982565 shutdown_connections 2024-04-25T10:03:44.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.479+0000 7f70e2d5a640 1 --2- 172.21.15.7:0/959982565 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f70c006b4d0 0x7f70c006d990 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.479+0000 7f70e2d5a640 1 --2- 172.21.15.7:0/959982565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70dc161200 0x7f70dc15f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.479+0000 7f70e2d5a640 1 --2- 172.21.15.7:0/959982565 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f70dc0d0a00 0x7f70dc15ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.479+0000 7f70e2d5a640 1 --2- 172.21.15.7:0/959982565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70dc09a7d0 0x7f70dc156ca0 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:44.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.479+0000 7f70e2d5a640 1 -- 172.21.15.7:0/959982565 >> 172.21.15.7:0/959982565 conn(0x7f70dc0b31a0 msgr2=0x7f70dc070710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:44.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.479+0000 7f70e2d5a640 1 -- 172.21.15.7:0/959982565 shutdown_connections 2024-04-25T10:03:44.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:44.479+0000 7f70e2d5a640 1 -- 172.21.15.7:0/959982565 wait complete. 2024-04-25T10:03:44.495 INFO:tasks.cephfs.filesystem:scrub status for tag:943e5f0d-0bf1-4399-8999-3646e73d6167 - {'path': '/', 'tag': '943e5f0d-0bf1-4399-8999-3646e73d6167', 'options': 'recursive,repair'} 2024-04-25T10:03:44.737 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-04-25T10:03:44.732+0000 7f6f5058a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:03:45.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:45.771+0000 7ff9eb7fe640 1 -- 172.21.15.7:0/3566767806 <== mon.0 v2:172.21.15.7:3300/0 8 ==== log(8 entries from seq 1 at 2024-04-25T10:03:44.326633+0000) v1 ==== 1407+0+0 (secure 0 0 0) 0x7ff9fc08c000 con 0x7ffa0415a160 2024-04-25T10:03:45.778 INFO:teuthology.orchestra.run.smithi007.stdout:2024-04-25T10:03:44.326633+0000 mds.a [INF] scrub queued for path: / 2024-04-25T10:03:45.778 INFO:teuthology.orchestra.run.smithi007.stdout:2024-04-25T10:03:44.326636+0000 mds.a [INF] scrub summary: idle+waiting paths [/] 2024-04-25T10:03:45.778 INFO:teuthology.orchestra.run.smithi007.stdout:2024-04-25T10:03:44.326640+0000 mds.a [INF] scrub summary: active paths [/] 2024-04-25T10:03:45.778 INFO:teuthology.orchestra.run.smithi007.stdout:2024-04-25T10:03:44.327192+0000 mds.a [ERR] scrub: inode wrongly marked free: 0x10000000001 2024-04-25T10:03:45.778 INFO:teuthology.orchestra.run.smithi007.stdout:2024-04-25T10:03:44.327196+0000 mds.a [ERR] inode table repaired for inode: 0x10000000001 2024-04-25T10:03:45.778 INFO:teuthology.orchestra.run.smithi007.stdout:2024-04-25T10:03:44.327534+0000 mds.a [ERR] scrub: inode wrongly marked free: 0x10000000002 2024-04-25T10:03:45.778 INFO:teuthology.orchestra.run.smithi007.stdout:2024-04-25T10:03:44.327540+0000 mds.a [ERR] inode table repaired for inode: 0x10000000002 2024-04-25T10:03:45.778 INFO:teuthology.orchestra.run.smithi007.stdout:2024-04-25T10:03:44.327893+0000 mds.a [INF] scrub summary: idle+waiting paths [/] 2024-04-25T10:03:50.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:03:50.043+0000 7ff9eb7fe640 1 -- 172.21.15.7:0/3566767806 <== mon.0 v2:172.21.15.7:3300/0 9 ==== log(1 entries from seq 9 at 2024-04-25T10:03:48.766284+0000) v1 ==== 189+0+0 (secure 0 0 0) 0x7ff9fc058110 con 0x7ffa0415a160 2024-04-25T10:03:50.048 INFO:teuthology.orchestra.run.smithi007.stdout:2024-04-25T10:03:48.766284+0000 mds.a [INF] scrub summary: idle 2024-04-25T10:03:57.331 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:03:57.335 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:04:14.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:14.496 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-25T10:04:14.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.606+0000 7f620d969640 1 Processor -- start 2024-04-25T10:04:14.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.606+0000 7f620d969640 1 -- start start 2024-04-25T10:04:14.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.607+0000 7f620d969640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f62080d0780 0x7f62080d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.607+0000 7f620d969640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f62080b9130 0x7f62080d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.607+0000 7f620d969640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62080d10a0 con 0x7f62080b9590 2024-04-25T10:04:14.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.607+0000 7f620d969640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62080b7ef0 con 0x7f62080b9130 2024-04-25T10:04:14.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.607+0000 7f620d969640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62080b81d0 con 0x7f62080d0780 2024-04-25T10:04:14.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.607+0000 7f62067fc640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f62080b9130 0x7f62080d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:14.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.607+0000 7f62067fc640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f62080b9130 0x7f62080d1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36240/0 (socket says 172.21.15.7:36240) 2024-04-25T10:04:14.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.607+0000 7f62067fc640 1 -- 172.21.15.7:0/1054843643 learned_addr learned my addr 172.21.15.7:0/1054843643 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:14.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.607+0000 7f6206ffd640 1 --2- 172.21.15.7:0/1054843643 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f62080d0780 0x7f62080d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:14.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.608+0000 7f62067fc640 1 -- 172.21.15.7:0/1054843643 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f62080d0780 msgr2=0x7f62080d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:14.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.608+0000 7f62067fc640 1 --2- 172.21.15.7:0/1054843643 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f62080d0780 0x7f62080d0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.608+0000 7f62067fc640 1 -- 172.21.15.7:0/1054843643 >> v1:172.21.15.55:6789/0 conn(0x7f62080b9590 legacy=0x7f62080d2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:14.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.608+0000 7f62067fc640 1 -- 172.21.15.7:0/1054843643 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62080b84b0 con 0x7f62080b9130 2024-04-25T10:04:14.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.608+0000 7f62067fc640 1 --2- 172.21.15.7:0/1054843643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62080b9130 0x7f62080d1c30 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f61f0009870 tx=0x7f61f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b30f1a28806630 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:14.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.608+0000 7f6205ffb640 1 -- 172.21.15.7:0/1054843643 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f0037070 con 0x7f62080b9130 2024-04-25T10:04:14.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.608+0000 7f6205ffb640 1 -- 172.21.15.7:0/1054843643 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f0032440 con 0x7f62080b9130 2024-04-25T10:04:14.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.609+0000 7f6205ffb640 1 -- 172.21.15.7:0/1054843643 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f0032810 con 0x7f62080b9130 2024-04-25T10:04:14.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.609+0000 7f620d969640 1 -- 172.21.15.7:0/1054843643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62080b9130 msgr2=0x7f62080d1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:14.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.609+0000 7f620d969640 1 --2- 172.21.15.7:0/1054843643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62080b9130 0x7f62080d1c30 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f61f0009870 tx=0x7f61f002a270 comp rx=0 tx=0).stop 2024-04-25T10:04:14.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.609+0000 7f620d969640 1 -- 172.21.15.7:0/1054843643 shutdown_connections 2024-04-25T10:04:14.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.609+0000 7f620d969640 1 --2- 172.21.15.7:0/1054843643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62080b9130 0x7f62080d1c30 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.609+0000 7f620d969640 1 --2- 172.21.15.7:0/1054843643 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f62080d0780 0x7f62080d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.609+0000 7f620d969640 1 -- 172.21.15.7:0/1054843643 >> 172.21.15.7:0/1054843643 conn(0x7f62080726b0 msgr2=0x7f6208072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:14.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.609+0000 7f620d969640 1 -- 172.21.15.7:0/1054843643 shutdown_connections 2024-04-25T10:04:14.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.609+0000 7f620d969640 1 -- 172.21.15.7:0/1054843643 wait complete. 2024-04-25T10:04:14.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.610+0000 7f620d969640 1 Processor -- start 2024-04-25T10:04:14.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.611+0000 7f620d969640 1 -- start start 2024-04-25T10:04:14.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.611+0000 7f620d969640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62080b9130 0x7f62081e8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.611+0000 7f620d969640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62080b9590 0x7f62081e9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.611+0000 7f620d969640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f62080d0780 0x7f6208149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.611+0000 7f620d969640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62081611b0 con 0x7f62080b9130 2024-04-25T10:04:14.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.611+0000 7f620d969640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62080b8a70 con 0x7f62080b9590 2024-04-25T10:04:14.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.611+0000 7f620d969640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6208161330 con 0x7f62080d0780 2024-04-25T10:04:14.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.611+0000 7f6206ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62080b9130 0x7f62081e8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:14.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.611+0000 7f6206ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62080b9130 0x7f62081e8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36254/0 (socket says 172.21.15.7:36254) 2024-04-25T10:04:14.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.611+0000 7f6206ffd640 1 -- 172.21.15.7:0/2005641736 learned_addr learned my addr 172.21.15.7:0/2005641736 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:14.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.612+0000 7f62067fc640 1 --2- 172.21.15.7:0/2005641736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62080b9590 0x7f62081e9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:14.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.612+0000 7f62077fe640 1 --2- 172.21.15.7:0/2005641736 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f62080d0780 0x7f6208149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:14.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.612+0000 7f6206ffd640 1 -- 172.21.15.7:0/2005641736 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f62080d0780 msgr2=0x7f6208149d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:14.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.612+0000 7f6206ffd640 1 --2- 172.21.15.7:0/2005641736 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f62080d0780 0x7f6208149d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.612+0000 7f6206ffd640 1 -- 172.21.15.7:0/2005641736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62080b9590 msgr2=0x7f62081e9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:14.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.612+0000 7f6206ffd640 1 --2- 172.21.15.7:0/2005641736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62080b9590 0x7f62081e9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.612+0000 7f6206ffd640 1 -- 172.21.15.7:0/2005641736 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62081e65b0 con 0x7f62080b9130 2024-04-25T10:04:14.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.612+0000 7f62077fe640 1 --2- 172.21.15.7:0/2005641736 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f62080d0780 0x7f6208149d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:14.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.612+0000 7f6206ffd640 1 --2- 172.21.15.7:0/2005641736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62080b9130 0x7f62081e8f50 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f620000d620 tx=0x7f620000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:14.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.612+0000 7f61fffff640 1 -- 172.21.15.7:0/2005641736 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620000b620 con 0x7f62080b9130 2024-04-25T10:04:14.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.612+0000 7f61fffff640 1 -- 172.21.15.7:0/2005641736 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6200019070 con 0x7f62080b9130 2024-04-25T10:04:14.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.612+0000 7f61fffff640 1 -- 172.21.15.7:0/2005641736 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620000ba00 con 0x7f62080b9130 2024-04-25T10:04:14.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.612+0000 7f620d969640 1 -- 172.21.15.7:0/2005641736 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62080c9b30 con 0x7f62080b9130 2024-04-25T10:04:14.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.612+0000 7f620d969640 1 -- 172.21.15.7:0/2005641736 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62081481e0 con 0x7f62080b9130 2024-04-25T10:04:14.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.614+0000 7f61fffff640 1 -- 172.21.15.7:0/2005641736 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f620000bba0 con 0x7f62080b9130 2024-04-25T10:04:14.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.614+0000 7f61fffff640 1 --2- 172.21.15.7:0/2005641736 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f61e806b500 0x7f61e806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.614+0000 7f61fffff640 1 -- 172.21.15.7:0/2005641736 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f620008a810 con 0x7f62080b9130 2024-04-25T10:04:14.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.615+0000 7f62067fc640 1 --2- 172.21.15.7:0/2005641736 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f61e806b500 0x7f61e806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:14.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.615+0000 7f62067fc640 1 --2- 172.21.15.7:0/2005641736 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f61e806b500 0x7f61e806d9c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f61f0034000 tx=0x7f61f002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:14.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.615+0000 7f621066a740 1 Processor -- start 2024-04-25T10:04:14.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.615+0000 7f621066a740 1 -- start start 2024-04-25T10:04:14.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.616+0000 7f621066a740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5630ea30fb10 0x5630ea312320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.616+0000 7f621066a740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5630ea30fef0 0x5630ea312860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.616+0000 7f621066a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea2e2770 0x5630ea2e5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.616+0000 7f621066a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630ea24bda0 con 0x5630ea2e2770 2024-04-25T10:04:14.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.616+0000 7f621066a740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630ea1f4b80 con 0x5630ea30fb10 2024-04-25T10:04:14.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.616+0000 7f621066a740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5630ea247e40 con 0x5630ea30fef0 2024-04-25T10:04:14.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.616+0000 7f62077fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea2e2770 0x5630ea2e5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:14.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.616+0000 7f62077fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea2e2770 0x5630ea2e5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36262/0 (socket says 172.21.15.7:36262) 2024-04-25T10:04:14.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.616+0000 7f62077fe640 1 -- 172.21.15.7:0/797440737 learned_addr learned my addr 172.21.15.7:0/797440737 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:14.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.616+0000 7f62067fc640 1 --2- 172.21.15.7:0/797440737 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5630ea30fef0 0x5630ea312860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:14.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.616+0000 7f6206ffd640 1 --2- 172.21.15.7:0/797440737 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5630ea30fb10 0x5630ea312320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:14.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.617+0000 7f62077fe640 1 -- 172.21.15.7:0/797440737 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5630ea30fef0 msgr2=0x5630ea312860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:14.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.617+0000 7f62077fe640 1 --2- 172.21.15.7:0/797440737 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5630ea30fef0 0x5630ea312860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.617+0000 7f62077fe640 1 -- 172.21.15.7:0/797440737 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5630ea30fb10 msgr2=0x5630ea312320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:14.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.617+0000 7f62077fe640 1 --2- 172.21.15.7:0/797440737 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5630ea30fb10 0x5630ea312320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.617+0000 7f62077fe640 1 -- 172.21.15.7:0/797440737 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630ea1fef10 con 0x5630ea2e2770 2024-04-25T10:04:14.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.617+0000 7f62077fe640 1 --2- 172.21.15.7:0/797440737 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea2e2770 0x5630ea2e5f80 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f61f8001c90 tx=0x7f61f8002150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5fc641ea2344a5c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:14.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.617+0000 7f61fd7fa640 1 -- 172.21.15.7:0/797440737 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f8019070 con 0x5630ea2e2770 2024-04-25T10:04:14.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.617+0000 7f61fd7fa640 1 -- 172.21.15.7:0/797440737 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f8003b80 con 0x5630ea2e2770 2024-04-25T10:04:14.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.617+0000 7f61fd7fa640 1 -- 172.21.15.7:0/797440737 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f8006b50 con 0x5630ea2e2770 2024-04-25T10:04:14.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.618+0000 7f621066a740 1 -- 172.21.15.7:0/797440737 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea2e2770 msgr2=0x5630ea2e5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:14.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.618+0000 7f621066a740 1 --2- 172.21.15.7:0/797440737 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea2e2770 0x5630ea2e5f80 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f61f8001c90 tx=0x7f61f8002150 comp rx=0 tx=0).stop 2024-04-25T10:04:14.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.618+0000 7f621066a740 1 -- 172.21.15.7:0/797440737 shutdown_connections 2024-04-25T10:04:14.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.618+0000 7f621066a740 1 --2- 172.21.15.7:0/797440737 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea2e2770 0x5630ea2e5f80 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.618+0000 7f621066a740 1 --2- 172.21.15.7:0/797440737 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5630ea30fef0 0x5630ea312860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.618+0000 7f621066a740 1 --2- 172.21.15.7:0/797440737 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5630ea30fb10 0x5630ea312320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.618+0000 7f621066a740 1 -- 172.21.15.7:0/797440737 >> 172.21.15.7:0/797440737 conn(0x5630ea2e49e0 msgr2=0x5630ea32d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:14.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.618+0000 7f621066a740 1 -- 172.21.15.7:0/797440737 shutdown_connections 2024-04-25T10:04:14.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.618+0000 7f621066a740 1 -- 172.21.15.7:0/797440737 wait complete. 2024-04-25T10:04:14.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.618+0000 7f621066a740 1 -- start start 2024-04-25T10:04:14.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.618+0000 7f621066a740 1 Processor -- start 2024-04-25T10:04:14.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.619+0000 7f621066a740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5630ea30fb10 0x5630ea30db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.619+0000 7f621066a740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5630ea30fef0 0x5630ea32fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.619+0000 7f621066a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea30c2e0 0x5630ea330df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.619+0000 7f621066a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630ea2e7b90 con 0x5630ea30c2e0 2024-04-25T10:04:14.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.619+0000 7f621066a740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630ea1ea4b0 con 0x5630ea30fb10 2024-04-25T10:04:14.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.619+0000 7f621066a740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5630ea2e7e70 con 0x5630ea30fef0 2024-04-25T10:04:14.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.619+0000 7f621066a740 10 client.0 _ll_register_callbacks cb 0x5630ea22a180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:04:14.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.619+0000 7f62077fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea30c2e0 0x5630ea330df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:14.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.619+0000 7f62077fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea30c2e0 0x5630ea330df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36276/0 (socket says 172.21.15.7:36276) 2024-04-25T10:04:14.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.619+0000 7f62077fe640 1 -- 172.21.15.7:0/4279232411 learned_addr learned my addr 172.21.15.7:0/4279232411 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:14.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.619+0000 7f6206ffd640 1 --2- 172.21.15.7:0/4279232411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5630ea30fb10 0x5630ea30db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:14.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.619+0000 7f62067fc640 1 --2- 172.21.15.7:0/4279232411 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5630ea30fef0 0x5630ea32fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:14.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.620+0000 7f62077fe640 1 -- 172.21.15.7:0/4279232411 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5630ea30fef0 msgr2=0x5630ea32fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:14.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.620+0000 7f62077fe640 1 --2- 172.21.15.7:0/4279232411 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5630ea30fef0 0x5630ea32fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.620+0000 7f62077fe640 1 -- 172.21.15.7:0/4279232411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5630ea30fb10 msgr2=0x5630ea30db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:14.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.620+0000 7f62077fe640 1 --2- 172.21.15.7:0/4279232411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5630ea30fb10 0x5630ea30db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.620+0000 7f62077fe640 1 -- 172.21.15.7:0/4279232411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5630ea02a7d0 con 0x5630ea30c2e0 2024-04-25T10:04:14.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.620+0000 7f62077fe640 1 --2- 172.21.15.7:0/4279232411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea30c2e0 0x5630ea330df0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x5630ea2ea070 tx=0x7f61f8000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a86aef716ae361 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:14.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.620+0000 7f61e67fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:04:14.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.620+0000 7f61e67fc640 1 -- 172.21.15.7:0/4279232411 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f8022060 con 0x5630ea30c2e0 2024-04-25T10:04:14.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.620+0000 7f61e67fc640 1 -- 172.21.15.7:0/4279232411 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f61f800ea60 con 0x5630ea30c2e0 2024-04-25T10:04:14.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.620+0000 7f621066a740 1 -- 172.21.15.7:0/4279232411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f61f8003b80 con 0x5630ea30c2e0 2024-04-25T10:04:14.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.620+0000 7f61e67fc640 1 -- 172.21.15.7:0/4279232411 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61f8028050 con 0x5630ea30c2e0 2024-04-25T10:04:14.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.620+0000 7f621066a740 10 client.8868 fetch_fsmap learned FSMap version 79 2024-04-25T10:04:14.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.620+0000 7f621066a740 1 -- 172.21.15.7:0/4279232411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) v3 -- 0x5630e9f603f0 con 0x5630ea30c2e0 2024-04-25T10:04:14.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.620+0000 7f61e67fc640 1 -- 172.21.15.7:0/4279232411 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f8003b80 con 0x5630ea30c2e0 2024-04-25T10:04:14.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.620+0000 7f61e67fc640 1 -- 172.21.15.7:0/4279232411 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 79) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f61f802b020 con 0x5630ea30c2e0 2024-04-25T10:04:14.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.621+0000 7f621066a740 10 client.8868 fetch_fsmap finished waiting for FSMap version 79 2024-04-25T10:04:14.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.621+0000 7f621066a740 10 client.8868 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T10:04:14.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.621+0000 7f621066a740 20 client.8868 populate_metadata read hostname 'smithi007' 2024-04-25T10:04:14.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.621+0000 7f621066a740 1 --2- 172.21.15.7:0/4279232411 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x5630ea306f90 0x5630ea32e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.621+0000 7f621066a740 4 client.8868 mds_command: new command op to 8736 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:04:14.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.621+0000 7f621066a740 1 -- 172.21.15.7:0/4279232411 --> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5630ea2592e0 con 0x5630ea306f90 2024-04-25T10:04:14.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.621+0000 7f6206ffd640 1 --2- 172.21.15.7:0/4279232411 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x5630ea306f90 0x5630ea32e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:14.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.621+0000 7f61e67fc640 10 client.8868 ms_handle_connect on v2:172.21.15.7:6835/1214875974 2024-04-25T10:04:14.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.621+0000 7f6206ffd640 1 --2- 172.21.15.7:0/4279232411 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x5630ea306f90 0x5630ea32e450 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1dcab9075979ef7 server_cookie=218fe813575b7437 in_seq=0 out_seq=0 2024-04-25T10:04:14.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.621+0000 7f61e67fc640 1 -- 172.21.15.7:0/4279232411 <== mds.0 v2:172.21.15.7:6835/1214875974 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5630ea2592e0 con 0x5630ea306f90 2024-04-25T10:04:14.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.621+0000 7f61e67fc640 10 client.8868 handle_command_reply: tid=0 2024-04-25T10:04:14.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.621+0000 7f621066a740 1 client.8868 shutdown 2024-04-25T10:04:14.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.622+0000 7f621066a740 1 -- 172.21.15.7:0/4279232411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea30c2e0 msgr2=0x5630ea330df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:14.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.622+0000 7f621066a740 1 --2- 172.21.15.7:0/4279232411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea30c2e0 0x5630ea330df0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x5630ea2ea070 tx=0x7f61f8000f40 comp rx=0 tx=0).stop 2024-04-25T10:04:14.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.622+0000 7f621066a740 1 -- 172.21.15.7:0/4279232411 shutdown_connections 2024-04-25T10:04:14.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.622+0000 7f621066a740 1 --2- 172.21.15.7:0/4279232411 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x5630ea306f90 0x5630ea32e450 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.622+0000 7f621066a740 1 --2- 172.21.15.7:0/4279232411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea30c2e0 0x5630ea330df0 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.622+0000 7f621066a740 1 --2- 172.21.15.7:0/4279232411 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5630ea30fef0 0x5630ea32fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.622+0000 7f61e67fc640 0 client.8868 ms_handle_reset on v2:172.21.15.7:6835/1214875974 2024-04-25T10:04:14.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.622+0000 7f621066a740 1 --2- 172.21.15.7:0/4279232411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5630ea30fb10 0x5630ea30db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.622+0000 7f621066a740 1 -- 172.21.15.7:0/4279232411 >> 172.21.15.7:0/4279232411 conn(0x5630ea2e2770 msgr2=0x5630ea30e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:14.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.622+0000 7f621066a740 1 -- 172.21.15.7:0/4279232411 shutdown_connections 2024-04-25T10:04:14.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.622+0000 7f621066a740 1 -- 172.21.15.7:0/4279232411 wait complete. 2024-04-25T10:04:14.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.622+0000 7f621066a740 20 client.8868 trim_cache size 0 max 16384 2024-04-25T10:04:14.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.637+0000 7f621066a740 1 Processor -- start 2024-04-25T10:04:14.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.637+0000 7f621066a740 1 -- start start 2024-04-25T10:04:14.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.638+0000 7f621066a740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5630ea30c2e0 0x5630ea2e17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.638+0000 7f621066a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea30fb10 0x5630ea315e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.638+0000 7f621066a740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5630ea30fef0 0x5630ea316390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.638+0000 7f621066a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62082005c0 con 0x5630ea30fb10 2024-04-25T10:04:14.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.638+0000 7f621066a740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62081ff790 con 0x5630ea30fef0 2024-04-25T10:04:14.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.638+0000 7f621066a740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62080c95f0 con 0x5630ea30c2e0 2024-04-25T10:04:14.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.638+0000 7f62067fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea30fb10 0x5630ea315e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:14.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.638+0000 7f62067fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea30fb10 0x5630ea315e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36282/0 (socket says 172.21.15.7:36282) 2024-04-25T10:04:14.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.638+0000 7f62067fc640 1 -- 172.21.15.7:0/3519001058 learned_addr learned my addr 172.21.15.7:0/3519001058 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:14.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.638+0000 7f62067fc640 1 -- 172.21.15.7:0/3519001058 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5630ea30c2e0 msgr2=0x5630ea2e17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:14.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.638+0000 7f62067fc640 1 --2- 172.21.15.7:0/3519001058 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5630ea30c2e0 0x5630ea2e17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.638+0000 7f62067fc640 1 -- 172.21.15.7:0/3519001058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5630ea30fef0 msgr2=0x5630ea316390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:14.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.638+0000 7f62067fc640 1 --2- 172.21.15.7:0/3519001058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5630ea30fef0 0x5630ea316390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.638+0000 7f62067fc640 1 -- 172.21.15.7:0/3519001058 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630e9f200f0 con 0x5630ea30fb10 2024-04-25T10:04:14.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.638+0000 7f62067fc640 1 --2- 172.21.15.7:0/3519001058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea30fb10 0x5630ea315e50 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f61f002a860 tx=0x7f61f002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fea69100d85d44a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:14.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.639+0000 7f61fcff9640 1 -- 172.21.15.7:0/3519001058 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f0037040 con 0x5630ea30fb10 2024-04-25T10:04:14.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.639+0000 7f61fcff9640 1 -- 172.21.15.7:0/3519001058 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f0032e20 con 0x5630ea30fb10 2024-04-25T10:04:14.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.639+0000 7f61fcff9640 1 -- 172.21.15.7:0/3519001058 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f003c660 con 0x5630ea30fb10 2024-04-25T10:04:14.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.639+0000 7f621066a740 1 -- 172.21.15.7:0/3519001058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea30fb10 msgr2=0x5630ea315e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:14.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.639+0000 7f621066a740 1 --2- 172.21.15.7:0/3519001058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea30fb10 0x5630ea315e50 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f61f002a860 tx=0x7f61f002c000 comp rx=0 tx=0).stop 2024-04-25T10:04:14.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.639+0000 7f621066a740 1 -- 172.21.15.7:0/3519001058 shutdown_connections 2024-04-25T10:04:14.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.639+0000 7f621066a740 1 --2- 172.21.15.7:0/3519001058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5630ea30fef0 0x5630ea316390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.639+0000 7f621066a740 1 --2- 172.21.15.7:0/3519001058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea30fb10 0x5630ea315e50 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.639+0000 7f621066a740 1 --2- 172.21.15.7:0/3519001058 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5630ea30c2e0 0x5630ea2e17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.639+0000 7f621066a740 1 -- 172.21.15.7:0/3519001058 >> 172.21.15.7:0/3519001058 conn(0x5630ea2e2770 msgr2=0x5630ea2e8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:14.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.639+0000 7f621066a740 1 -- 172.21.15.7:0/3519001058 shutdown_connections 2024-04-25T10:04:14.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.639+0000 7f621066a740 1 -- 172.21.15.7:0/3519001058 wait complete. 2024-04-25T10:04:14.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.640+0000 7f621066a740 1 -- start start 2024-04-25T10:04:14.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.640+0000 7f621066a740 1 Processor -- start 2024-04-25T10:04:14.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.641+0000 7f621066a740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5630ea30c2e0 0x5630ea308620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.641+0000 7f621066a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea30fb10 0x5630ea308b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.641+0000 7f621066a740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5630ea30fef0 0x5630ea346520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.641+0000 7f621066a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630ea32dcd0 con 0x5630ea30fb10 2024-04-25T10:04:14.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.641+0000 7f621066a740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62081ff190 con 0x5630ea30c2e0 2024-04-25T10:04:14.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.641+0000 7f621066a740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5630ea2e7530 con 0x5630ea30fef0 2024-04-25T10:04:14.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.641+0000 7f621066a740 10 client.0 _ll_register_callbacks cb 0x7f61f8001720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:04:14.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.641+0000 7f62067fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea30fb10 0x5630ea308b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:14.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.641+0000 7f62067fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea30fb10 0x5630ea308b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36294/0 (socket says 172.21.15.7:36294) 2024-04-25T10:04:14.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.641+0000 7f62067fc640 1 -- 172.21.15.7:0/2988846296 learned_addr learned my addr 172.21.15.7:0/2988846296 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:14.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.641+0000 7f62067fc640 1 -- 172.21.15.7:0/2988846296 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5630ea30fef0 msgr2=0x5630ea346520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:14.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.641+0000 7f62067fc640 1 --2- 172.21.15.7:0/2988846296 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5630ea30fef0 0x5630ea346520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.641+0000 7f62067fc640 1 -- 172.21.15.7:0/2988846296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5630ea30c2e0 msgr2=0x5630ea308620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:14.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.641+0000 7f62067fc640 1 --2- 172.21.15.7:0/2988846296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5630ea30c2e0 0x5630ea308620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.641+0000 7f62067fc640 1 -- 172.21.15.7:0/2988846296 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5630ea2e3a80 con 0x5630ea30fb10 2024-04-25T10:04:14.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.641+0000 7f62067fc640 1 --2- 172.21.15.7:0/2988846296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea30fb10 0x5630ea308b60 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f61f0009870 tx=0x7f61f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0d32449289f2b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:14.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.641+0000 7f61e67fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:04:14.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.641+0000 7f61e67fc640 1 -- 172.21.15.7:0/2988846296 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f0059060 con 0x5630ea30fb10 2024-04-25T10:04:14.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.641+0000 7f61e67fc640 1 -- 172.21.15.7:0/2988846296 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f61f004a430 con 0x5630ea30fb10 2024-04-25T10:04:14.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.641+0000 7f621066a740 1 -- 172.21.15.7:0/2988846296 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f61f0032e20 con 0x5630ea30fb10 2024-04-25T10:04:14.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.642+0000 7f61e67fc640 1 -- 172.21.15.7:0/2988846296 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61f005f050 con 0x5630ea30fb10 2024-04-25T10:04:14.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.642+0000 7f621066a740 10 client.8874 fetch_fsmap learned FSMap version 79 2024-04-25T10:04:14.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.642+0000 7f621066a740 1 -- 172.21.15.7:0/2988846296 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) v3 -- 0x5630ea3157a0 con 0x5630ea30fb10 2024-04-25T10:04:14.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.642+0000 7f61e67fc640 1 -- 172.21.15.7:0/2988846296 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f0032e20 con 0x5630ea30fb10 2024-04-25T10:04:14.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.642+0000 7f61e67fc640 1 -- 172.21.15.7:0/2988846296 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 79) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f61f0062020 con 0x5630ea30fb10 2024-04-25T10:04:14.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.642+0000 7f621066a740 10 client.8874 fetch_fsmap finished waiting for FSMap version 79 2024-04-25T10:04:14.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.642+0000 7f621066a740 10 client.8874 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T10:04:14.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.642+0000 7f621066a740 20 client.8874 populate_metadata read hostname 'smithi007' 2024-04-25T10:04:14.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.642+0000 7f621066a740 1 --2- 172.21.15.7:0/2988846296 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x5630ea380dc0 0x5630ea32dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.642+0000 7f621066a740 4 client.8874 mds_command: new command op to 8736 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T10:04:14.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.642+0000 7f621066a740 1 -- 172.21.15.7:0/2988846296 --> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5630ea253630 con 0x5630ea380dc0 2024-04-25T10:04:14.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.642+0000 7f6206ffd640 1 --2- 172.21.15.7:0/2988846296 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x5630ea380dc0 0x5630ea32dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:14.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.642+0000 7f6206ffd640 1 --2- 172.21.15.7:0/2988846296 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x5630ea380dc0 0x5630ea32dcd0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71543d40ddb3b448 server_cookie=f7afa29ff900b273 in_seq=0 out_seq=0 2024-04-25T10:04:14.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.642+0000 7f61e67fc640 10 client.8874 ms_handle_connect on v2:172.21.15.7:6835/1214875974 2024-04-25T10:04:14.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.643+0000 7f61e67fc640 1 -- 172.21.15.7:0/2988846296 <== mds.0 v2:172.21.15.7:6835/1214875974 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5630ea253630 con 0x5630ea380dc0 2024-04-25T10:04:14.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.643+0000 7f61e67fc640 10 client.8874 handle_command_reply: tid=0 2024-04-25T10:04:14.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.643+0000 7f621066a740 1 client.8874 shutdown 2024-04-25T10:04:14.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.643+0000 7f621066a740 1 -- 172.21.15.7:0/2988846296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea30fb10 msgr2=0x5630ea308b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:14.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.643+0000 7f621066a740 1 --2- 172.21.15.7:0/2988846296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea30fb10 0x5630ea308b60 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f61f0009870 tx=0x7f61f0004730 comp rx=0 tx=0).stop 2024-04-25T10:04:14.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.643+0000 7f621066a740 1 -- 172.21.15.7:0/2988846296 shutdown_connections 2024-04-25T10:04:14.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.643+0000 7f621066a740 1 --2- 172.21.15.7:0/2988846296 >> [v2:172.21.15.7:6835/1214875974,v1:172.21.15.7:6837/1214875974] conn(0x5630ea380dc0 0x5630ea32dcd0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.643+0000 7f621066a740 1 --2- 172.21.15.7:0/2988846296 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5630ea30fef0 0x5630ea346520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.643+0000 7f621066a740 1 --2- 172.21.15.7:0/2988846296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea30fb10 0x5630ea308b60 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.643+0000 7f61e67fc640 0 client.8874 ms_handle_reset on v2:172.21.15.7:6835/1214875974 2024-04-25T10:04:14.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.643+0000 7f621066a740 1 --2- 172.21.15.7:0/2988846296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5630ea30c2e0 0x5630ea308620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.643+0000 7f621066a740 1 -- 172.21.15.7:0/2988846296 >> 172.21.15.7:0/2988846296 conn(0x5630ea2e2770 msgr2=0x5630ea2e97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:14.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.643+0000 7f621066a740 1 -- 172.21.15.7:0/2988846296 shutdown_connections 2024-04-25T10:04:14.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.643+0000 7f621066a740 1 -- 172.21.15.7:0/2988846296 wait complete. 2024-04-25T10:04:14.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.643+0000 7f621066a740 20 client.8874 trim_cache size 0 max 16384 2024-04-25T10:04:14.654 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:04:14.654 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-04-25T10:04:14.654 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {} 2024-04-25T10:04:14.654 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:04:14.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.643+0000 7f620d969640 1 -- 172.21.15.7:0/2005641736 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f61e806b500 msgr2=0x7f61e806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:14.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.643+0000 7f620d969640 1 --2- 172.21.15.7:0/2005641736 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f61e806b500 0x7f61e806d9c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f61f0034000 tx=0x7f61f002e000 comp rx=0 tx=0).stop 2024-04-25T10:04:14.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.643+0000 7f620d969640 1 -- 172.21.15.7:0/2005641736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62080b9130 msgr2=0x7f62081e8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:14.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.643+0000 7f620d969640 1 --2- 172.21.15.7:0/2005641736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62080b9130 0x7f62081e8f50 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f620000d620 tx=0x7f620000dae0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.643+0000 7f620d969640 1 -- 172.21.15.7:0/2005641736 shutdown_connections 2024-04-25T10:04:14.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.643+0000 7f620d969640 1 --2- 172.21.15.7:0/2005641736 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f61e806b500 0x7f61e806d9c0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.643+0000 7f620d969640 1 --2- 172.21.15.7:0/2005641736 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f62080d0780 0x7f6208149d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.643+0000 7f620d969640 1 --2- 172.21.15.7:0/2005641736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62080b9590 0x7f62081e9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.643+0000 7f620d969640 1 --2- 172.21.15.7:0/2005641736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62080b9130 0x7f62081e8f50 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.643+0000 7f620d969640 1 -- 172.21.15.7:0/2005641736 >> 172.21.15.7:0/2005641736 conn(0x7f62080726b0 msgr2=0x7f62080b68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:14.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.644+0000 7f620d969640 1 -- 172.21.15.7:0/2005641736 shutdown_connections 2024-04-25T10:04:14.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.644+0000 7f620d969640 1 -- 172.21.15.7:0/2005641736 wait complete. 2024-04-25T10:04:14.659 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T10:04:14.761 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T10:04:14.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.858+0000 7fb8d6476640 1 Processor -- start 2024-04-25T10:04:14.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.858+0000 7fb8d6476640 1 -- start start 2024-04-25T10:04:14.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.859+0000 7fb8d6476640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8d015f450 0x7fb8d00b2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.859+0000 7fb8d6476640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb8d00cdc80 0x7fb8d015f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.859+0000 7fb8d6476640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8d015fd70 con 0x7fb8d00999f0 2024-04-25T10:04:14.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.859+0000 7fb8d6476640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8d0160020 con 0x7fb8d00cdc80 2024-04-25T10:04:14.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.859+0000 7fb8d6476640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d0160300 con 0x7fb8d015f450 2024-04-25T10:04:14.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.859+0000 7fb8cffff640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8d015f450 0x7fb8d00b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:14.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.859+0000 7fb8cf7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb8d00cdc80 0x7fb8d015f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:14.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.859+0000 7fb8cffff640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8d015f450 0x7fb8d00b2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:60426/0 (socket says 172.21.15.7:60426) 2024-04-25T10:04:14.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.859+0000 7fb8cffff640 1 -- 172.21.15.7:0/3390047542 learned_addr learned my addr 172.21.15.7:0/3390047542 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:14.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.859+0000 7fb8d4a13640 1 --1- 172.21.15.7:0/3390047542 >> v1:172.21.15.55:6789/0 conn(0x7fb8d00999f0 0x7fb8d0099e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:41322/0 (socket says 172.21.15.7:41322) 2024-04-25T10:04:14.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.860+0000 7fb8cffff640 1 -- 172.21.15.7:0/3390047542 >> v2:172.21.15.55:3300/0 conn(0x7fb8d00cdc80 msgr2=0x7fb8d015f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:14.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.860+0000 7fb8cffff640 1 --2- 172.21.15.7:0/3390047542 >> v2:172.21.15.55:3300/0 conn(0x7fb8d00cdc80 0x7fb8d015f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.860+0000 7fb8cffff640 1 -- 172.21.15.7:0/3390047542 >> v1:172.21.15.55:6789/0 conn(0x7fb8d00999f0 legacy=0x7fb8d0099e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:14.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.860+0000 7fb8cffff640 1 -- 172.21.15.7:0/3390047542 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d00cfd60 con 0x7fb8d015f450 2024-04-25T10:04:14.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.860+0000 7fb8cf7fe640 1 --2- 172.21.15.7:0/3390047542 >> v2:172.21.15.55:3300/0 conn(0x7fb8d00cdc80 0x7fb8d015f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:14.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.860+0000 7fb8cffff640 1 --2- 172.21.15.7:0/3390047542 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8d015f450 0x7fb8d00b2310 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009870 tx=0x7fb8c402a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9fedbadce18a856 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:14.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.860+0000 7fb8ceffd640 1 -- 172.21.15.7:0/3390047542 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4037070 con 0x7fb8d015f450 2024-04-25T10:04:14.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.860+0000 7fb8ceffd640 1 -- 172.21.15.7:0/3390047542 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c4032440 con 0x7fb8d015f450 2024-04-25T10:04:14.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.860+0000 7fb8ceffd640 1 -- 172.21.15.7:0/3390047542 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4032810 con 0x7fb8d015f450 2024-04-25T10:04:14.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.861+0000 7fb8d6476640 1 -- 172.21.15.7:0/3390047542 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8d015f450 msgr2=0x7fb8d00b2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:14.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.861+0000 7fb8d6476640 1 --2- 172.21.15.7:0/3390047542 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8d015f450 0x7fb8d00b2310 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009870 tx=0x7fb8c402a130 comp rx=0 tx=0).stop 2024-04-25T10:04:14.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.861+0000 7fb8d6476640 1 -- 172.21.15.7:0/3390047542 shutdown_connections 2024-04-25T10:04:14.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.861+0000 7fb8d6476640 1 --2- 172.21.15.7:0/3390047542 >> v2:172.21.15.55:3300/0 conn(0x7fb8d00cdc80 0x7fb8d015f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.861+0000 7fb8d6476640 1 --2- 172.21.15.7:0/3390047542 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8d015f450 0x7fb8d00b2310 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.861+0000 7fb8d6476640 1 -- 172.21.15.7:0/3390047542 >> 172.21.15.7:0/3390047542 conn(0x7fb8d00d16e0 msgr2=0x7fb8d00d1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:14.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.861+0000 7fb8d6476640 1 -- 172.21.15.7:0/3390047542 shutdown_connections 2024-04-25T10:04:14.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.861+0000 7fb8d6476640 1 -- 172.21.15.7:0/3390047542 wait complete. 2024-04-25T10:04:14.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.862+0000 7fb8d6476640 1 Processor -- start 2024-04-25T10:04:14.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.862+0000 7fb8d6476640 1 -- start start 2024-04-25T10:04:14.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.863+0000 7fb8d6476640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8d00999f0 0x7fb8d00c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.863+0000 7fb8d6476640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8d00cdc80 0x7fb8d01f1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.863+0000 7fb8d6476640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8d015f450 0x7fb8d01f1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.863+0000 7fb8d6476640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d00b2a30 con 0x7fb8d015f450 2024-04-25T10:04:14.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.863+0000 7fb8d6476640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d00d0320 con 0x7fb8d00999f0 2024-04-25T10:04:14.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.863+0000 7fb8d6476640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d00c7f40 con 0x7fb8d00cdc80 2024-04-25T10:04:14.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.863+0000 7fb8d4a13640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8d015f450 0x7fb8d01f1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:14.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.863+0000 7fb8d4a13640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8d015f450 0x7fb8d01f1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36310/0 (socket says 172.21.15.7:36310) 2024-04-25T10:04:14.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.863+0000 7fb8d4a13640 1 -- 172.21.15.7:0/1542279373 learned_addr learned my addr 172.21.15.7:0/1542279373 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:14.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.863+0000 7fb8cffff640 1 --2- 172.21.15.7:0/1542279373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8d00999f0 0x7fb8d00c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:14.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.863+0000 7fb8cf7fe640 1 --2- 172.21.15.7:0/1542279373 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8d00cdc80 0x7fb8d01f1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:14.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.864+0000 7fb8d4a13640 1 -- 172.21.15.7:0/1542279373 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8d00cdc80 msgr2=0x7fb8d01f1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:14.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.864+0000 7fb8d4a13640 1 --2- 172.21.15.7:0/1542279373 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8d00cdc80 0x7fb8d01f1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.864+0000 7fb8d4a13640 1 -- 172.21.15.7:0/1542279373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8d00999f0 msgr2=0x7fb8d00c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:14.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.864+0000 7fb8d4a13640 1 --2- 172.21.15.7:0/1542279373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8d00999f0 0x7fb8d00c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.864+0000 7fb8d4a13640 1 -- 172.21.15.7:0/1542279373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d01f28c0 con 0x7fb8d015f450 2024-04-25T10:04:14.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.864+0000 7fb8d4a13640 1 --2- 172.21.15.7:0/1542279373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8d015f450 0x7fb8d01f1ed0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fb8c800c6e0 tx=0x7fb8c800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:14.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.864+0000 7fb8ccff9640 1 -- 172.21.15.7:0/1542279373 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8018070 con 0x7fb8d015f450 2024-04-25T10:04:14.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.864+0000 7fb8ccff9640 1 -- 172.21.15.7:0/1542279373 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c8004d60 con 0x7fb8d015f450 2024-04-25T10:04:14.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.864+0000 7fb8d6476640 1 -- 172.21.15.7:0/1542279373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8d01f25e0 con 0x7fb8d015f450 2024-04-25T10:04:14.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.864+0000 7fb8ccff9640 1 -- 172.21.15.7:0/1542279373 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c800a880 con 0x7fb8d015f450 2024-04-25T10:04:14.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.864+0000 7fb8d6476640 1 -- 172.21.15.7:0/1542279373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d00af830 con 0x7fb8d015f450 2024-04-25T10:04:14.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.865+0000 7fb8d6476640 1 -- 172.21.15.7:0/1542279373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8d0068fd0 con 0x7fb8d015f450 2024-04-25T10:04:14.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.866+0000 7fb8ccff9640 1 -- 172.21.15.7:0/1542279373 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb8c801b070 con 0x7fb8d015f450 2024-04-25T10:04:14.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.866+0000 7fb8ccff9640 1 --2- 172.21.15.7:0/1542279373 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb8bc06b4d0 0x7fb8bc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.866+0000 7fb8ccff9640 1 -- 172.21.15.7:0/1542279373 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6245+0+0 (secure 0 0 0) 0x7fb8c8089780 con 0x7fb8d015f450 2024-04-25T10:04:14.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.866+0000 7fb8cffff640 1 --2- 172.21.15.7:0/1542279373 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb8bc06b4d0 0x7fb8bc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:14.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.867+0000 7fb8cffff640 1 --2- 172.21.15.7:0/1542279373 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb8bc06b4d0 0x7fb8bc06d990 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4034000 tx=0x7fb8c402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:14.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:14.870+0000 7fb8ccff9640 1 -- 172.21.15.7:0/1542279373 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb8c8057e20 con 0x7fb8d015f450 2024-04-25T10:04:15.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.096+0000 7fb8d6476640 1 -- 172.21.15.7:0/1542279373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb8d00b2630 con 0x7fb8d015f450 2024-04-25T10:04:15.102 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-04-25T10:04:15.096+0000 7f45ad572640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T10:04:15.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.102+0000 7fb8ccff9640 1 -- 172.21.15.7:0/1542279373 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v80) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb8c805bec0 con 0x7fb8d015f450 2024-04-25T10:04:15.106 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T10:04:15.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.104+0000 7fb8d6476640 1 -- 172.21.15.7:0/1542279373 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb8bc06b4d0 msgr2=0x7fb8bc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.104+0000 7fb8d6476640 1 --2- 172.21.15.7:0/1542279373 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb8bc06b4d0 0x7fb8bc06d990 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4034000 tx=0x7fb8c402e000 comp rx=0 tx=0).stop 2024-04-25T10:04:15.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.104+0000 7fb8d6476640 1 -- 172.21.15.7:0/1542279373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8d015f450 msgr2=0x7fb8d01f1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.104+0000 7fb8d6476640 1 --2- 172.21.15.7:0/1542279373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8d015f450 0x7fb8d01f1ed0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fb8c800c6e0 tx=0x7fb8c800cba0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.104+0000 7fb8d6476640 1 -- 172.21.15.7:0/1542279373 shutdown_connections 2024-04-25T10:04:15.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.104+0000 7fb8d6476640 1 --2- 172.21.15.7:0/1542279373 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb8bc06b4d0 0x7fb8bc06d990 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.104+0000 7fb8d6476640 1 --2- 172.21.15.7:0/1542279373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8d015f450 0x7fb8d01f1ed0 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.104+0000 7fb8d6476640 1 --2- 172.21.15.7:0/1542279373 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8d00cdc80 0x7fb8d01f1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.104+0000 7fb8d6476640 1 --2- 172.21.15.7:0/1542279373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8d00999f0 0x7fb8d00c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.104+0000 7fb8d6476640 1 -- 172.21.15.7:0/1542279373 >> 172.21.15.7:0/1542279373 conn(0x7fb8d00d16e0 msgr2=0x7fb8d0099e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:15.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.105+0000 7fb8d6476640 1 -- 172.21.15.7:0/1542279373 shutdown_connections 2024-04-25T10:04:15.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.105+0000 7fb8d6476640 1 -- 172.21.15.7:0/1542279373 wait complete. 2024-04-25T10:04:15.111 INFO:tasks.ceph.mds.a.smithi007.stderr: -1149> 2024-04-25T10:03:44.326+0000 7f6f4c582640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000001 2024-04-25T10:04:15.111 INFO:tasks.ceph.mds.a.smithi007.stderr: -1146> 2024-04-25T10:03:44.326+0000 7f6f4c582640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000001 2024-04-25T10:04:15.111 INFO:tasks.ceph.mds.a.smithi007.stderr: -1110> 2024-04-25T10:03:44.326+0000 7f6f4c582640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000002 2024-04-25T10:04:15.111 INFO:tasks.ceph.mds.a.smithi007.stderr: -1107> 2024-04-25T10:03:44.326+0000 7f6f4c582640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000002 2024-04-25T10:04:15.112 INFO:tasks.ceph.mds.a.smithi007.stderr: -1000> 2024-04-25T10:03:44.732+0000 7f6f5058a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:04:15.121 DEBUG:teuthology.orchestra.run.smithi007:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 show inode 2024-04-25T10:04:15.138 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-04-25T10:04:15.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.156+0000 7f46c960d280 1 -- start start 2024-04-25T10:04:15.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.156+0000 7f46c960d280 1 Processor -- start 2024-04-25T10:04:15.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.157+0000 7f46c960d280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da4b9dcc00 0x55da4ba4c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.157+0000 7f46c960d280 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da4b9dd800 0x55da4ba4cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.157+0000 7f46c960d280 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55da4b9ddc00 0x55da4ba4d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.157+0000 7f46c960d280 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da4bb52600 con 0x55da4b9dd800 2024-04-25T10:04:15.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.157+0000 7f46c960d280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da4bb52480 con 0x55da4b9dcc00 2024-04-25T10:04:15.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.157+0000 7f46c960d280 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da4bb52300 con 0x55da4b9ddc00 2024-04-25T10:04:15.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.157+0000 7f46c684d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da4b9dd800 0x55da4ba4cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.157+0000 7f46c684d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da4b9dd800 0x55da4ba4cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36346/0 (socket says 172.21.15.7:36346) 2024-04-25T10:04:15.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.157+0000 7f46c684d640 1 -- 172.21.15.7:0/2619751105 learned_addr learned my addr 172.21.15.7:0/2619751105 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:15.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.157+0000 7f46c684d640 1 -- 172.21.15.7:0/2619751105 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55da4b9ddc00 msgr2=0x55da4ba4d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:15.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.157+0000 7f46c684d640 1 --2- 172.21.15.7:0/2619751105 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55da4b9ddc00 0x55da4ba4d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.157+0000 7f46c684d640 1 -- 172.21.15.7:0/2619751105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da4b9dcc00 msgr2=0x55da4ba4c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:15.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.157+0000 7f46c684d640 1 --2- 172.21.15.7:0/2619751105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da4b9dcc00 0x55da4ba4c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.157+0000 7f46c684d640 1 -- 172.21.15.7:0/2619751105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da4ba12780 con 0x55da4b9dd800 2024-04-25T10:04:15.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.157+0000 7f46c684d640 1 --2- 172.21.15.7:0/2619751105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da4b9dd800 0x55da4ba4cb00 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x55da4c7e4a80 tx=0x55da4c76f3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a18264cd6948bd1d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:15.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.157+0000 7f46c4849640 1 -- 172.21.15.7:0/2619751105 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55da4ba029c0 con 0x55da4b9dd800 2024-04-25T10:04:15.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.157+0000 7f46c4849640 1 -- 172.21.15.7:0/2619751105 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55da4ba08c40 con 0x55da4b9dd800 2024-04-25T10:04:15.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.157+0000 7f46c4849640 1 -- 172.21.15.7:0/2619751105 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55da4ba02680 con 0x55da4b9dd800 2024-04-25T10:04:15.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.157+0000 7f46c960d280 1 -- 172.21.15.7:0/2619751105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55da4ba134a0 con 0x55da4b9dd800 2024-04-25T10:04:15.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.158+0000 7f46c960d280 1 -- 172.21.15.7:0/2619751105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55da4ba12000 con 0x55da4b9dd800 2024-04-25T10:04:15.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.158+0000 7f46c960d280 4 waiting for MDS map... 2024-04-25T10:04:15.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.158+0000 7f46c4849640 1 -- 172.21.15.7:0/2619751105 <== mon.0 v2:172.21.15.7:3300/0 4 ==== osd_map(107..107 src has 1..107) v4 ==== 6331+0+0 (secure 0 0 0) 0x55da4bcc8400 con 0x55da4b9dd800 2024-04-25T10:04:15.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.158+0000 7f46c4849640 1 -- 172.21.15.7:0/2619751105 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 80) v1 ==== 2723+0+0 (secure 0 0 0) 0x55da4ba37180 con 0x55da4b9dd800 2024-04-25T10:04:15.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.158+0000 7f46c960d280 4 Got MDS map 80 2024-04-25T10:04:15.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.158+0000 7f46c960d280 10 main: main 2024-04-25T10:04:15.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.158+0000 7f46c960d280 4 main: connecting to RADOS... 2024-04-25T10:04:15.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.158+0000 7f46c960d280 1 Processor -- start 2024-04-25T10:04:15.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.158+0000 7f46c960d280 1 -- start start 2024-04-25T10:04:15.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.159+0000 7f46c960d280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da4c7a7c00 0x55da4ba4d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.159+0000 7f46c960d280 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da4bd2a000 0x55da4ba4db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.159+0000 7f46c960d280 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55da4bd2a400 0x55da4ba4e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.159+0000 7f46c960d280 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da4bb52180 con 0x55da4bd2a000 2024-04-25T10:04:15.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.159+0000 7f46c960d280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da4ba3e480 con 0x55da4c7a7c00 2024-04-25T10:04:15.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.159+0000 7f46c960d280 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da4ba3e900 con 0x55da4bd2a400 2024-04-25T10:04:15.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.159+0000 7f46c704e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da4bd2a000 0x55da4ba4db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.159+0000 7f46c704e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da4bd2a000 0x55da4ba4db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36352/0 (socket says 172.21.15.7:36352) 2024-04-25T10:04:15.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.159+0000 7f46c704e640 1 -- 172.21.15.7:0/2594731695 learned_addr learned my addr 172.21.15.7:0/2594731695 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:15.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.159+0000 7f46c684d640 1 --2- 172.21.15.7:0/2594731695 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55da4bd2a400 0x55da4ba4e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.159+0000 7f46c784f640 1 --2- 172.21.15.7:0/2594731695 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da4c7a7c00 0x55da4ba4d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.159+0000 7f46c704e640 1 -- 172.21.15.7:0/2594731695 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55da4bd2a400 msgr2=0x55da4ba4e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:15.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.159+0000 7f46c704e640 1 --2- 172.21.15.7:0/2594731695 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55da4bd2a400 0x55da4ba4e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.159+0000 7f46c704e640 1 -- 172.21.15.7:0/2594731695 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da4c7a7c00 msgr2=0x55da4ba4d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:15.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.159+0000 7f46c704e640 1 --2- 172.21.15.7:0/2594731695 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da4c7a7c00 0x55da4ba4d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.159+0000 7f46c704e640 1 -- 172.21.15.7:0/2594731695 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da4ba123c0 con 0x55da4bd2a000 2024-04-25T10:04:15.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.159+0000 7f46c684d640 1 --2- 172.21.15.7:0/2594731695 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55da4bd2a400 0x55da4ba4e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:15.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.160+0000 7f46c704e640 1 --2- 172.21.15.7:0/2594731695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da4bd2a000 0x55da4ba4db80 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x55da4c7be270 tx=0x55da4bce0e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9709985611bc7154 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:15.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.160+0000 7f46c2845640 1 -- 172.21.15.7:0/2594731695 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55da4ba029c0 con 0x55da4bd2a000 2024-04-25T10:04:15.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.160+0000 7f46c2845640 1 -- 172.21.15.7:0/2594731695 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55da4ba08a80 con 0x55da4bd2a000 2024-04-25T10:04:15.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.160+0000 7f46c2845640 1 -- 172.21.15.7:0/2594731695 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55da4ba02680 con 0x55da4bd2a000 2024-04-25T10:04:15.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.160+0000 7f46c960d280 1 -- 172.21.15.7:0/2594731695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da4bd2a000 msgr2=0x55da4ba4db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.160+0000 7f46c960d280 1 --2- 172.21.15.7:0/2594731695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da4bd2a000 0x55da4ba4db80 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x55da4c7be270 tx=0x55da4bce0e40 comp rx=0 tx=0).stop 2024-04-25T10:04:15.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.160+0000 7f46c960d280 1 -- 172.21.15.7:0/2594731695 shutdown_connections 2024-04-25T10:04:15.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.160+0000 7f46c960d280 1 --2- 172.21.15.7:0/2594731695 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55da4bd2a400 0x55da4ba4e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.160+0000 7f46c960d280 1 --2- 172.21.15.7:0/2594731695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da4bd2a000 0x55da4ba4db80 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.160+0000 7f46c960d280 1 --2- 172.21.15.7:0/2594731695 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da4c7a7c00 0x55da4ba4d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.160+0000 7f46c960d280 1 -- 172.21.15.7:0/2594731695 >> 172.21.15.7:0/2594731695 conn(0x55da4c7a7800 msgr2=0x55da4bad4800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:15.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.160+0000 7f46c960d280 1 -- 172.21.15.7:0/2594731695 shutdown_connections 2024-04-25T10:04:15.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.160+0000 7f46c960d280 1 -- 172.21.15.7:0/2594731695 wait complete. 2024-04-25T10:04:15.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.161+0000 7f46c960d280 1 Processor -- start 2024-04-25T10:04:15.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.161+0000 7f46c960d280 1 -- start start 2024-04-25T10:04:15.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.161+0000 7f46c960d280 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da4c7a7800 0x55da4ba4f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.161+0000 7f46c960d280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da4bd2b000 0x55da4ba4ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.161+0000 7f46c960d280 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55da4bd2ac00 0x55da4ba4e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.161+0000 7f46c960d280 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da4bb53380 con 0x55da4c7a7800 2024-04-25T10:04:15.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.161+0000 7f46c960d280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da4bb52180 con 0x55da4bd2b000 2024-04-25T10:04:15.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.161+0000 7f46c960d280 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da4bb53500 con 0x55da4bd2ac00 2024-04-25T10:04:15.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.162+0000 7f46c784f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da4c7a7800 0x55da4ba4f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.162+0000 7f46c784f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da4c7a7800 0x55da4ba4f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36358/0 (socket says 172.21.15.7:36358) 2024-04-25T10:04:15.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.162+0000 7f46c784f640 1 -- 172.21.15.7:0/3499763171 learned_addr learned my addr 172.21.15.7:0/3499763171 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:15.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.162+0000 7f46c684d640 1 --2- 172.21.15.7:0/3499763171 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55da4bd2ac00 0x55da4ba4e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.162+0000 7f46c704e640 1 --2- 172.21.15.7:0/3499763171 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da4bd2b000 0x55da4ba4ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.162+0000 7f46c784f640 1 -- 172.21.15.7:0/3499763171 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55da4bd2ac00 msgr2=0x55da4ba4e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.162+0000 7f46c784f640 1 --2- 172.21.15.7:0/3499763171 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55da4bd2ac00 0x55da4ba4e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.162+0000 7f46c784f640 1 -- 172.21.15.7:0/3499763171 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da4bd2b000 msgr2=0x55da4ba4ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.162+0000 7f46c784f640 1 --2- 172.21.15.7:0/3499763171 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da4bd2b000 0x55da4ba4ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.162+0000 7f46c784f640 1 -- 172.21.15.7:0/3499763171 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da4ba12960 con 0x55da4c7a7800 2024-04-25T10:04:15.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.162+0000 7f46c684d640 1 --2- 172.21.15.7:0/3499763171 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55da4bd2ac00 0x55da4ba4e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:15.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.162+0000 7f46c784f640 1 --2- 172.21.15.7:0/3499763171 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da4c7a7800 0x55da4ba4f180 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x55da4c7bf5f0 tx=0x55da4bce0f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:15.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.162+0000 7f46c1042640 1 -- 172.21.15.7:0/3499763171 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55da4ba029c0 con 0x55da4c7a7800 2024-04-25T10:04:15.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.162+0000 7f46c1042640 1 -- 172.21.15.7:0/3499763171 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55da4ba08700 con 0x55da4c7a7800 2024-04-25T10:04:15.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.162+0000 7f46c960d280 1 -- 172.21.15.7:0/3499763171 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55da4ba13680 con 0x55da4c7a7800 2024-04-25T10:04:15.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.162+0000 7f46c1042640 1 -- 172.21.15.7:0/3499763171 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55da4ba02680 con 0x55da4c7a7800 2024-04-25T10:04:15.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.162+0000 7f46c960d280 1 -- 172.21.15.7:0/3499763171 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55da4ba13860 con 0x55da4c7a7800 2024-04-25T10:04:15.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.162+0000 7f46c960d280 4 main: resolving pool 15 2024-04-25T10:04:15.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.164+0000 7f46c1042640 1 -- 172.21.15.7:0/3499763171 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x55da4bcd2c00 con 0x55da4c7a7800 2024-04-25T10:04:15.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.164+0000 7f46c1042640 1 --2- 172.21.15.7:0/3499763171 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x55da4bd4cc00 0x55da4ba4f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.164+0000 7f46c1042640 1 -- 172.21.15.7:0/3499763171 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6331+0+0 (secure 0 0 0) 0x55da4bcd1000 con 0x55da4c7a7800 2024-04-25T10:04:15.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.164+0000 7f46c704e640 1 --2- 172.21.15.7:0/3499763171 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x55da4bd4cc00 0x55da4ba4f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.164+0000 7f46c960d280 4 main: creating IoCtx.. 2024-04-25T10:04:15.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.164+0000 7f46c960d280 1 --2- 172.21.15.7:0/3499763171 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x55da4bd2a800 0x55da4ba4d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.164+0000 7f46c960d280 1 -- 172.21.15.7:0/3499763171 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:1 15.13 15:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107) v9 -- 0x55da4bd2a400 con 0x55da4bd2a800 2024-04-25T10:04:15.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.164+0000 7f46c684d640 1 --2- 172.21.15.7:0/3499763171 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x55da4bd2a800 0x55da4ba4d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.164+0000 7f46c704e640 1 --2- 172.21.15.7:0/3499763171 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x55da4bd4cc00 0x55da4ba4f700 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x55da4c7be270 tx=0x55da4bce0c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:15.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.164+0000 7f46c684d640 1 --2- 172.21.15.7:0/3499763171 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x55da4bd2a800 0x55da4ba4d600 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:15.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.166+0000 7f46c684d640 1 -- 172.21.15.7:0/3499763171 <== osd.1 v2:172.21.15.7:6816/434435857 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv7 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x55da4c75c000 con 0x55da4bd2a800 2024-04-25T10:04:15.176 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:04:15.176 INFO:teuthology.orchestra.run.smithi007.stdout: "0": { 2024-04-25T10:04:15.176 INFO:teuthology.orchestra.run.smithi007.stdout: "data": { 2024-04-25T10:04:15.176 INFO:teuthology.orchestra.run.smithi007.stdout: "version": 5, 2024-04-25T10:04:15.176 INFO:teuthology.orchestra.run.smithi007.stdout: "inotable": { 2024-04-25T10:04:15.176 INFO:teuthology.orchestra.run.smithi007.stdout: "projected_free": [ 2024-04-25T10:04:15.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:04:15.176 INFO:teuthology.orchestra.run.smithi007.stdout: "start": 1099511627779, 2024-04-25T10:04:15.177 INFO:teuthology.orchestra.run.smithi007.stdout: "len": 1099511627773 2024-04-25T10:04:15.177 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:04:15.177 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-04-25T10:04:15.177 INFO:teuthology.orchestra.run.smithi007.stdout: "free": [ 2024-04-25T10:04:15.177 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:04:15.177 INFO:teuthology.orchestra.run.smithi007.stdout: "start": 1099511627779, 2024-04-25T10:04:15.177 INFO:teuthology.orchestra.run.smithi007.stdout: "len": 1099511627773 2024-04-25T10:04:15.177 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:04:15.177 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-25T10:04:15.177 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:04:15.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:04:15.177 INFO:teuthology.orchestra.run.smithi007.stdout: "result": 0 2024-04-25T10:04:15.177 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:04:15.177 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:04:15.177 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:15.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.166+0000 7f46c960d280 1 -- 172.21.15.7:0/3499763171 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x55da4bd2a800 msgr2=0x55da4ba4d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.166+0000 7f46c960d280 1 --2- 172.21.15.7:0/3499763171 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x55da4bd2a800 0x55da4ba4d600 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.167+0000 7f46c960d280 1 -- 172.21.15.7:0/3499763171 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x55da4bd4cc00 msgr2=0x55da4ba4f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.167+0000 7f46c960d280 1 --2- 172.21.15.7:0/3499763171 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x55da4bd4cc00 0x55da4ba4f700 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x55da4c7be270 tx=0x55da4bce0c00 comp rx=0 tx=0).stop 2024-04-25T10:04:15.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.167+0000 7f46c960d280 1 -- 172.21.15.7:0/3499763171 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da4c7a7800 msgr2=0x55da4ba4f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.167+0000 7f46c960d280 1 --2- 172.21.15.7:0/3499763171 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da4c7a7800 0x55da4ba4f180 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x55da4c7bf5f0 tx=0x55da4bce0f60 comp rx=0 tx=0).stop 2024-04-25T10:04:15.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.167+0000 7f46c704e640 1 -- 172.21.15.7:0/3499763171 reap_dead start 2024-04-25T10:04:15.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.167+0000 7f46c960d280 1 -- 172.21.15.7:0/3499763171 shutdown_connections 2024-04-25T10:04:15.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.167+0000 7f46c960d280 1 -- 172.21.15.7:0/3499763171 >> 172.21.15.7:0/3499763171 conn(0x55da4c7a7c00 msgr2=0x55da4bad4800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:15.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.167+0000 7f46c960d280 1 -- 172.21.15.7:0/3499763171 shutdown_connections 2024-04-25T10:04:15.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.167+0000 7f46c960d280 1 -- 172.21.15.7:0/3499763171 wait complete. 2024-04-25T10:04:15.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.167+0000 7f46c960d280 1 -- 172.21.15.7:0/2619751105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da4b9dd800 msgr2=0x55da4ba4cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.167+0000 7f46c960d280 1 --2- 172.21.15.7:0/2619751105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da4b9dd800 0x55da4ba4cb00 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x55da4c7e4a80 tx=0x55da4c76f3e0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.167+0000 7f46c960d280 1 -- 172.21.15.7:0/2619751105 shutdown_connections 2024-04-25T10:04:15.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.167+0000 7f46c960d280 1 --2- 172.21.15.7:0/2619751105 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55da4b9ddc00 0x55da4ba4d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.167+0000 7f46c960d280 1 --2- 172.21.15.7:0/2619751105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da4b9dd800 0x55da4ba4cb00 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.167+0000 7f46c960d280 1 --2- 172.21.15.7:0/2619751105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da4b9dcc00 0x55da4ba4c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.167+0000 7f46c960d280 1 -- 172.21.15.7:0/2619751105 >> 172.21.15.7:0/2619751105 conn(0x55da4b9dd000 msgr2=0x55da4bad5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:15.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.167+0000 7f46c960d280 1 -- 172.21.15.7:0/2619751105 shutdown_connections 2024-04-25T10:04:15.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.167+0000 7f46c960d280 1 -- 172.21.15.7:0/2619751105 wait complete. 2024-04-25T10:04:15.181 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'show', 'inode'] in time 0:00:00.060084, result: { "0": { "data": { "version": 5, "inotable": { "projected_free": [ { "start": 1099511627779, "len": 1099511627773 } ], "free": [ { "start": 1099511627779, "len": 1099511627773 } ] } }, "result": 0 } } 2024-04-25T10:04:15.181 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T10:04:15.182 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:04:15.258 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:04:15.306 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T10:04:15.306 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:04:15.307 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:15.322 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13704 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:04:15.322 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T10:04:15.322 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:15.340 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19023 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:04:15.340 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:04:15.341 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:15.378 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13704 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:04:15.378 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T10:04:15.379 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:15.398 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19023 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:04:15.398 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:04:15.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.514+0000 7f0e51abd640 1 Processor -- start 2024-04-25T10:04:15.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.514+0000 7f0e51abd640 1 -- start start 2024-04-25T10:04:15.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.515+0000 7f0e51abd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0e4c0b9250 0x7f0e4c0ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.515+0000 7f0e51abd640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e4c161fa0 con 0x7f0e4c15dd00 2024-04-25T10:04:15.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.515+0000 7f0e51abd640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e4c162280 con 0x7f0e4c15d920 2024-04-25T10:04:15.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.515+0000 7f0e51abd640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c0d1de0 con 0x7f0e4c0b9250 2024-04-25T10:04:15.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.515+0000 7f0e4bfff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0e4c15dd00 0x7f0e4c0d2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:41164/0 (socket says 172.21.15.7:41164) 2024-04-25T10:04:15.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.515+0000 7f0e4bfff640 1 -- 172.21.15.7:0/571012359 learned_addr learned my addr 172.21.15.7:0/571012359 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:15.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.515+0000 7f0e4affd640 1 --2- 172.21.15.7:0/571012359 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0e4c0b9250 0x7f0e4c0ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.515+0000 7f0e4a7fc640 1 -- 172.21.15.7:0/571012359 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3393036660 0 0) 0x7f0e4c161fa0 con 0x7f0e4c15dd00 2024-04-25T10:04:15.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.515+0000 7f0e4a7fc640 1 -- 172.21.15.7:0/571012359 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e34003520 con 0x7f0e4c15dd00 2024-04-25T10:04:15.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.515+0000 7f0e4a7fc640 1 -- 172.21.15.7:0/571012359 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1695195194 0 0) 0x7f0e34003520 con 0x7f0e4c15dd00 2024-04-25T10:04:15.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.515+0000 7f0e4a7fc640 1 -- 172.21.15.7:0/571012359 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0e4c0b9250 msgr2=0x7f0e4c0ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:15.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.515+0000 7f0e4a7fc640 1 --2- 172.21.15.7:0/571012359 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0e4c0b9250 0x7f0e4c0ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.515+0000 7f0e4a7fc640 1 -- 172.21.15.7:0/571012359 >> v1:172.21.15.55:6789/0 conn(0x7f0e4c15d920 legacy=0x7f0e4c161630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.515+0000 7f0e4a7fc640 1 -- 172.21.15.7:0/571012359 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c0d1a70 con 0x7f0e4c15dd00 2024-04-25T10:04:15.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.515+0000 7f0e4a7fc640 1 -- 172.21.15.7:0/571012359 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f0e440019f0 con 0x7f0e4c15dd00 2024-04-25T10:04:15.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.515+0000 7f0e4a7fc640 1 -- 172.21.15.7:0/571012359 >> v1:172.21.15.7:6789/0 conn(0x7f0e4c15dd00 legacy=0x7f0e4c0d2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.515+0000 7f0e4a7fc640 1 --2- 172.21.15.7:0/571012359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e340039e0 0x7f0e34003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.515+0000 7f0e4a7fc640 1 --2- 172.21.15.7:0/571012359 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0e4c0b9250 0x7f0e34004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.515+0000 7f0e4a7fc640 1 --2- 172.21.15.7:0/571012359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e34004d40 0x7f0e340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.515+0000 7f0e4a7fc640 1 -- 172.21.15.7:0/571012359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c0d1de0 con 0x7f0e34004d40 2024-04-25T10:04:15.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.515+0000 7f0e4a7fc640 1 -- 172.21.15.7:0/571012359 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3400bb50 con 0x7f0e340039e0 2024-04-25T10:04:15.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.515+0000 7f0e4a7fc640 1 -- 172.21.15.7:0/571012359 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3400bd20 con 0x7f0e4c0b9250 2024-04-25T10:04:15.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.516+0000 7f0e4bfff640 1 --2- 172.21.15.7:0/571012359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e34004d40 0x7f0e340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.516+0000 7f0e4affd640 1 --2- 172.21.15.7:0/571012359 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0e4c0b9250 0x7f0e34004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.516+0000 7f0e4b7fe640 1 --2- 172.21.15.7:0/571012359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e340039e0 0x7f0e34003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.516+0000 7f0e4bfff640 1 -- 172.21.15.7:0/571012359 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0e4c0b9250 msgr2=0x7f0e34004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:15.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.516+0000 7f0e4bfff640 1 --2- 172.21.15.7:0/571012359 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0e4c0b9250 0x7f0e34004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.516+0000 7f0e4bfff640 1 -- 172.21.15.7:0/571012359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e340039e0 msgr2=0x7f0e34003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:15.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.516+0000 7f0e4bfff640 1 --2- 172.21.15.7:0/571012359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e340039e0 0x7f0e34003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.516+0000 7f0e4bfff640 1 -- 172.21.15.7:0/571012359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e34003520 con 0x7f0e34004d40 2024-04-25T10:04:15.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.516+0000 7f0e4b7fe640 1 --2- 172.21.15.7:0/571012359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e340039e0 0x7f0e34003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:15.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.517+0000 7f0e4bfff640 1 --2- 172.21.15.7:0/571012359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e34004d40 0x7f0e340051c0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f0e4400a830 tx=0x7f0e34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d22ef208cb3430 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:15.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.517+0000 7f0e4a7fc640 1 -- 172.21.15.7:0/571012359 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4400a480 con 0x7f0e34004d40 2024-04-25T10:04:15.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.517+0000 7f0e4a7fc640 1 -- 172.21.15.7:0/571012359 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4402f070 con 0x7f0e34004d40 2024-04-25T10:04:15.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.517+0000 7f0e4a7fc640 1 -- 172.21.15.7:0/571012359 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4402bc70 con 0x7f0e34004d40 2024-04-25T10:04:15.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.517+0000 7f0e51abd640 1 -- 172.21.15.7:0/571012359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e34004d40 msgr2=0x7f0e340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.517+0000 7f0e51abd640 1 --2- 172.21.15.7:0/571012359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e34004d40 0x7f0e340051c0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f0e4400a830 tx=0x7f0e34005830 comp rx=0 tx=0).stop 2024-04-25T10:04:15.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.517+0000 7f0e4bfff640 1 -- 172.21.15.7:0/571012359 reap_dead start 2024-04-25T10:04:15.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.517+0000 7f0e51abd640 1 -- 172.21.15.7:0/571012359 shutdown_connections 2024-04-25T10:04:15.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.517+0000 7f0e51abd640 1 -- 172.21.15.7:0/571012359 >> 172.21.15.7:0/571012359 conn(0x7f0e4c06bfe0 msgr2=0x7f0e4c06c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:15.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.517+0000 7f0e51abd640 1 -- 172.21.15.7:0/571012359 shutdown_connections 2024-04-25T10:04:15.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.517+0000 7f0e51abd640 1 -- 172.21.15.7:0/571012359 wait complete. 2024-04-25T10:04:15.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.518+0000 7f0e51abd640 1 Processor -- start 2024-04-25T10:04:15.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.519+0000 7f0e51abd640 1 -- start start 2024-04-25T10:04:15.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.519+0000 7f0e51abd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e34004d40 0x7f0e4c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.519+0000 7f0e51abd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e4c1e7510 0x7f0e4c1f6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.519+0000 7f0e51abd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0e4c1f3c10 0x7f0e4c1f4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.519+0000 7f0e51abd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c0cea30 con 0x7f0e4c1e7510 2024-04-25T10:04:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.519+0000 7f0e51abd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c0ce8b0 con 0x7f0e34004d40 2024-04-25T10:04:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.519+0000 7f0e51abd640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c0cebb0 con 0x7f0e4c1f3c10 2024-04-25T10:04:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.519+0000 7f0e4affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e4c1e7510 0x7f0e4c1f6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.520+0000 7f0e4affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e4c1e7510 0x7f0e4c1f6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36378/0 (socket says 172.21.15.7:36378) 2024-04-25T10:04:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.520+0000 7f0e4affd640 1 -- 172.21.15.7:0/1977975185 learned_addr learned my addr 172.21.15.7:0/1977975185 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.520+0000 7f0e4b7fe640 1 --2- 172.21.15.7:0/1977975185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e34004d40 0x7f0e4c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.520+0000 7f0e4bfff640 1 --2- 172.21.15.7:0/1977975185 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0e4c1f3c10 0x7f0e4c1f4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.520+0000 7f0e4affd640 1 -- 172.21.15.7:0/1977975185 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0e4c1f3c10 msgr2=0x7f0e4c1f4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.520+0000 7f0e4affd640 1 --2- 172.21.15.7:0/1977975185 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0e4c1f3c10 0x7f0e4c1f4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.520+0000 7f0e4affd640 1 -- 172.21.15.7:0/1977975185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e34004d40 msgr2=0x7f0e4c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.520+0000 7f0e4affd640 1 --2- 172.21.15.7:0/1977975185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e34004d40 0x7f0e4c15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.520+0000 7f0e4affd640 1 -- 172.21.15.7:0/1977975185 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c15ad50 con 0x7f0e4c1e7510 2024-04-25T10:04:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.520+0000 7f0e4affd640 1 --2- 172.21.15.7:0/1977975185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e4c1e7510 0x7f0e4c1f6740 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f0e40011940 tx=0x7f0e40011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.520+0000 7f0e33fff640 1 -- 172.21.15.7:0/1977975185 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4000faf0 con 0x7f0e4c1e7510 2024-04-25T10:04:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.520+0000 7f0e33fff640 1 -- 172.21.15.7:0/1977975185 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4000fc90 con 0x7f0e4c1e7510 2024-04-25T10:04:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.520+0000 7f0e51abd640 1 -- 172.21.15.7:0/1977975185 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e4c15b030 con 0x7f0e4c1e7510 2024-04-25T10:04:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.520+0000 7f0e33fff640 1 -- 172.21.15.7:0/1977975185 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e40014440 con 0x7f0e4c1e7510 2024-04-25T10:04:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.520+0000 7f0e51abd640 1 -- 172.21.15.7:0/1977975185 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e4c15b5f0 con 0x7f0e4c1e7510 2024-04-25T10:04:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.521+0000 7f0e51abd640 1 -- 172.21.15.7:0/1977975185 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e4c0c9930 con 0x7f0e4c1e7510 2024-04-25T10:04:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.522+0000 7f0e33fff640 1 -- 172.21.15.7:0/1977975185 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0e40012040 con 0x7f0e4c1e7510 2024-04-25T10:04:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.522+0000 7f0e33fff640 1 --2- 172.21.15.7:0/1977975185 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0e3806b500 0x7f0e3806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.522+0000 7f0e4b7fe640 1 --2- 172.21.15.7:0/1977975185 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0e3806b500 0x7f0e3806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.522+0000 7f0e33fff640 1 -- 172.21.15.7:0/1977975185 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6331+0+0 (secure 0 0 0) 0x7f0e4008aa10 con 0x7f0e4c1e7510 2024-04-25T10:04:15.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.523+0000 7f0e4b7fe640 1 --2- 172.21.15.7:0/1977975185 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0e3806b500 0x7f0e3806d9c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c007fd0 tx=0x7f0e3c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:15.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.527+0000 7f0e33fff640 1 -- 172.21.15.7:0/1977975185 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0e4c0c9930 con 0x7f0e4c1e7510 2024-04-25T10:04:15.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.745+0000 7f0e51abd640 1 -- 172.21.15.7:0/1977975185 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e4c0d14f0 con 0x7f0e4c1e7510 2024-04-25T10:04:15.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.746+0000 7f0e33fff640 1 -- 172.21.15.7:0/1977975185 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4140 (secure 0 0 0) 0x7f0e40019030 con 0x7f0e4c1e7510 2024-04-25T10:04:15.751 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:15.751 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":80,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6617,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3278722694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3278722694},{"type":"v1","addr":"172.21.15.55:6835","nonce":3278722694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":7435,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3598653097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3598653097},{"type":"v1","addr":"172.21.15.55:6834","nonce":3598653097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":8361,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3628875229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3628875229},{"type":"v1","addr":"172.21.15.7:6836","nonce":3628875229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":80,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:02:49.944298+0000","modified":"2024-04-25T10:04:15.097532+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T10:04:15.751 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 80 2024-04-25T10:04:15.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.748+0000 7f0e51abd640 1 -- 172.21.15.7:0/1977975185 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0e3806b500 msgr2=0x7f0e3806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.748+0000 7f0e51abd640 1 --2- 172.21.15.7:0/1977975185 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0e3806b500 0x7f0e3806d9c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c007fd0 tx=0x7f0e3c009040 comp rx=0 tx=0).stop 2024-04-25T10:04:15.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.748+0000 7f0e51abd640 1 -- 172.21.15.7:0/1977975185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e4c1e7510 msgr2=0x7f0e4c1f6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.748+0000 7f0e51abd640 1 --2- 172.21.15.7:0/1977975185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e4c1e7510 0x7f0e4c1f6740 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f0e40011940 tx=0x7f0e40011e00 comp rx=0 tx=0).stop 2024-04-25T10:04:15.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.748+0000 7f0e51abd640 1 -- 172.21.15.7:0/1977975185 shutdown_connections 2024-04-25T10:04:15.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.748+0000 7f0e51abd640 1 --2- 172.21.15.7:0/1977975185 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0e3806b500 0x7f0e3806d9c0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.748+0000 7f0e51abd640 1 --2- 172.21.15.7:0/1977975185 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0e4c1f3c10 0x7f0e4c1f4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.748+0000 7f0e51abd640 1 --2- 172.21.15.7:0/1977975185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e4c1e7510 0x7f0e4c1f6740 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.748+0000 7f0e51abd640 1 --2- 172.21.15.7:0/1977975185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e34004d40 0x7f0e4c15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.748+0000 7f0e51abd640 1 -- 172.21.15.7:0/1977975185 >> 172.21.15.7:0/1977975185 conn(0x7f0e4c06bfe0 msgr2=0x7f0e4c15f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:15.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.748+0000 7f0e51abd640 1 -- 172.21.15.7:0/1977975185 shutdown_connections 2024-04-25T10:04:15.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.748+0000 7f0e51abd640 1 -- 172.21.15.7:0/1977975185 wait complete. 2024-04-25T10:04:15.764 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:15.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.860+0000 7f0b4a06b640 1 Processor -- start 2024-04-25T10:04:15.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.860+0000 7f0b4a06b640 1 -- start start 2024-04-25T10:04:15.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.861+0000 7f0b4a06b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b440cdc80 0x7f0b440b2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.861+0000 7f0b4a06b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0b440cc3f0 0x7f0b440cc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.861+0000 7f0b4a06b640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b44160020 con 0x7f0b4415f450 2024-04-25T10:04:15.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.861+0000 7f0b4a06b640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b44160300 con 0x7f0b440cc3f0 2024-04-25T10:04:15.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.861+0000 7f0b4a06b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b440cfd60 con 0x7f0b440cdc80 2024-04-25T10:04:15.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.861+0000 7f0b43fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0b440cc3f0 0x7f0b440cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.861+0000 7f0b43fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0b440cc3f0 0x7f0b440cc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36388/0 (socket says 172.21.15.7:36388) 2024-04-25T10:04:15.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.861+0000 7f0b43fff640 1 -- 172.21.15.7:0/874961961 learned_addr learned my addr 172.21.15.7:0/874961961 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:15.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.861+0000 7f0b43fff640 1 -- 172.21.15.7:0/874961961 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b440cdc80 msgr2=0x7f0b440b2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:15.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.861+0000 7f0b42ffd640 1 --2- 172.21.15.7:0/874961961 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b440cdc80 0x7f0b440b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.861+0000 7f0b43fff640 1 --2- 172.21.15.7:0/874961961 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b440cdc80 0x7f0b440b2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.861+0000 7f0b427fc640 1 -- 172.21.15.7:0/874961961 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3474056843 0 0) 0x7f0b44160020 con 0x7f0b4415f450 2024-04-25T10:04:15.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.861+0000 7f0b43fff640 1 -- 172.21.15.7:0/874961961 >> v1:172.21.15.7:6789/0 conn(0x7f0b4415f450 legacy=0x7f0b4415f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.861+0000 7f0b43fff640 1 -- 172.21.15.7:0/874961961 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b440d0040 con 0x7f0b440cc3f0 2024-04-25T10:04:15.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.861+0000 7f0b42ffd640 1 --2- 172.21.15.7:0/874961961 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b440cdc80 0x7f0b440b2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:15.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.862+0000 7f0b43fff640 1 --2- 172.21.15.7:0/874961961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b440cc3f0 0x7f0b440cc880 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c009e50 tx=0x7f0b3c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6bfe02a03301961 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:15.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.862+0000 7f0b427fc640 1 -- 172.21.15.7:0/874961961 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c036070 con 0x7f0b440cc3f0 2024-04-25T10:04:15.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.862+0000 7f0b427fc640 1 -- 172.21.15.7:0/874961961 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3c031600 con 0x7f0b440cc3f0 2024-04-25T10:04:15.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.862+0000 7f0b427fc640 1 -- 172.21.15.7:0/874961961 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c0319d0 con 0x7f0b440cc3f0 2024-04-25T10:04:15.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.863+0000 7f0b4a06b640 1 -- 172.21.15.7:0/874961961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b440cc3f0 msgr2=0x7f0b440cc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.863+0000 7f0b4a06b640 1 --2- 172.21.15.7:0/874961961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b440cc3f0 0x7f0b440cc880 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c009e50 tx=0x7f0b3c02a5f0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.863+0000 7f0b4a06b640 1 -- 172.21.15.7:0/874961961 shutdown_connections 2024-04-25T10:04:15.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.863+0000 7f0b4a06b640 1 --2- 172.21.15.7:0/874961961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b440cc3f0 0x7f0b440cc880 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.863+0000 7f0b4a06b640 1 --2- 172.21.15.7:0/874961961 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b440cdc80 0x7f0b440b2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.863+0000 7f0b4a06b640 1 -- 172.21.15.7:0/874961961 >> 172.21.15.7:0/874961961 conn(0x7f0b440d16e0 msgr2=0x7f0b440d1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:15.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.863+0000 7f0b4a06b640 1 -- 172.21.15.7:0/874961961 shutdown_connections 2024-04-25T10:04:15.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.863+0000 7f0b4a06b640 1 -- 172.21.15.7:0/874961961 wait complete. 2024-04-25T10:04:15.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.864+0000 7f0b4a06b640 1 Processor -- start 2024-04-25T10:04:15.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.864+0000 7f0b4a06b640 1 -- start start 2024-04-25T10:04:15.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.865+0000 7f0b4a06b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b440cc3f0 0x7f0b4414eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.865+0000 7f0b4a06b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b440cdc80 0x7f0b441e63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.865+0000 7f0b4a06b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b4415f450 0x7f0b440c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.865+0000 7f0b4a06b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b440c7f40 con 0x7f0b440cdc80 2024-04-25T10:04:15.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.865+0000 7f0b4a06b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b440b2a30 con 0x7f0b440cc3f0 2024-04-25T10:04:15.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.865+0000 7f0b4a06b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b440c80c0 con 0x7f0b4415f450 2024-04-25T10:04:15.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.865+0000 7f0b42ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b440cdc80 0x7f0b441e63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.865+0000 7f0b42ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b440cdc80 0x7f0b441e63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36392/0 (socket says 172.21.15.7:36392) 2024-04-25T10:04:15.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.865+0000 7f0b42ffd640 1 -- 172.21.15.7:0/1346330323 learned_addr learned my addr 172.21.15.7:0/1346330323 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:15.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.865+0000 7f0b437fe640 1 --2- 172.21.15.7:0/1346330323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b440cc3f0 0x7f0b4414eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.865+0000 7f0b43fff640 1 --2- 172.21.15.7:0/1346330323 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b4415f450 0x7f0b440c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.865+0000 7f0b42ffd640 1 -- 172.21.15.7:0/1346330323 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b4415f450 msgr2=0x7f0b440c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.865+0000 7f0b42ffd640 1 --2- 172.21.15.7:0/1346330323 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b4415f450 0x7f0b440c96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.865+0000 7f0b42ffd640 1 -- 172.21.15.7:0/1346330323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b440cc3f0 msgr2=0x7f0b4414eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.865+0000 7f0b42ffd640 1 --2- 172.21.15.7:0/1346330323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b440cc3f0 0x7f0b4414eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.865+0000 7f0b42ffd640 1 -- 172.21.15.7:0/1346330323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b441e5350 con 0x7f0b440cdc80 2024-04-25T10:04:15.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.865+0000 7f0b437fe640 1 --2- 172.21.15.7:0/1346330323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b440cc3f0 0x7f0b4414eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:15.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.865+0000 7f0b43fff640 1 --2- 172.21.15.7:0/1346330323 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b4415f450 0x7f0b440c96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:15.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.865+0000 7f0b42ffd640 1 --2- 172.21.15.7:0/1346330323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b440cdc80 0x7f0b441e63f0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800c7f0 tx=0x7f0b3800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:15.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.866+0000 7f0b2bfff640 1 -- 172.21.15.7:0/1346330323 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b38015070 con 0x7f0b440cdc80 2024-04-25T10:04:15.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.866+0000 7f0b2bfff640 1 -- 172.21.15.7:0/1346330323 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b38007820 con 0x7f0b440cdc80 2024-04-25T10:04:15.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.866+0000 7f0b4a06b640 1 -- 172.21.15.7:0/1346330323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b441e5630 con 0x7f0b440cdc80 2024-04-25T10:04:15.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.866+0000 7f0b2bfff640 1 -- 172.21.15.7:0/1346330323 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b38007bd0 con 0x7f0b440cdc80 2024-04-25T10:04:15.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.866+0000 7f0b4a06b640 1 -- 172.21.15.7:0/1346330323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b441e5bf0 con 0x7f0b440cdc80 2024-04-25T10:04:15.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.867+0000 7f0b4a06b640 1 -- 172.21.15.7:0/1346330323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b44068fd0 con 0x7f0b440cdc80 2024-04-25T10:04:15.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.867+0000 7f0b2bfff640 1 -- 172.21.15.7:0/1346330323 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0b38018070 con 0x7f0b440cdc80 2024-04-25T10:04:15.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.867+0000 7f0b2bfff640 1 --2- 172.21.15.7:0/1346330323 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0b3006b4d0 0x7f0b3006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.868+0000 7f0b2bfff640 1 -- 172.21.15.7:0/1346330323 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6331+0+0 (secure 0 0 0) 0x7f0b3808a5a0 con 0x7f0b440cdc80 2024-04-25T10:04:15.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.868+0000 7f0b437fe640 1 --2- 172.21.15.7:0/1346330323 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0b3006b4d0 0x7f0b3006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.868+0000 7f0b437fe640 1 --2- 172.21.15.7:0/1346330323 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0b3006b4d0 0x7f0b3006d990 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0b34000f60 tx=0x7f0b34009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:15.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:15.872+0000 7f0b2bfff640 1 -- 172.21.15.7:0/1346330323 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0b380591a0 con 0x7f0b440cdc80 2024-04-25T10:04:16.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.054+0000 7f0b4a06b640 1 -- 172.21.15.7:0/1346330323 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b440d24d0 con 0x7f0b440cdc80 2024-04-25T10:04:16.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.055+0000 7f0b2bfff640 1 -- 172.21.15.7:0/1346330323 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+17138 (secure 0 0 0) 0x7f0b38087310 con 0x7f0b440cdc80 2024-04-25T10:04:16.060 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:16.061 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":107,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:04:15.097552+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:02:48.213751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T10:02:48.916114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.9","mappings":[{"from":1,"to":7}]},{"pgid":"16.2f","mappings":[{"from":5,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6837/1214875974":"2024-04-26T10:04:15.097519+0000","172.21.15.7:6835/1214875974":"2024-04-26T10:04:15.097519+0000","172.21.15.7:6837/900729992":"2024-04-26T10:03:38.723704+0000","172.21.15.7:6835/900729992":"2024-04-26T10:03:38.723704+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:16.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.057+0000 7f0b4a06b640 1 -- 172.21.15.7:0/1346330323 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0b3006b4d0 msgr2=0x7f0b3006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.057+0000 7f0b4a06b640 1 --2- 172.21.15.7:0/1346330323 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0b3006b4d0 0x7f0b3006d990 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0b34000f60 tx=0x7f0b34009040 comp rx=0 tx=0).stop 2024-04-25T10:04:16.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.057+0000 7f0b4a06b640 1 -- 172.21.15.7:0/1346330323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b440cdc80 msgr2=0x7f0b441e63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.057+0000 7f0b4a06b640 1 --2- 172.21.15.7:0/1346330323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b440cdc80 0x7f0b441e63f0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800c7f0 tx=0x7f0b3800ccb0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.057+0000 7f0b4a06b640 1 -- 172.21.15.7:0/1346330323 shutdown_connections 2024-04-25T10:04:16.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.057+0000 7f0b4a06b640 1 --2- 172.21.15.7:0/1346330323 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f0b3006b4d0 0x7f0b3006d990 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.057+0000 7f0b4a06b640 1 --2- 172.21.15.7:0/1346330323 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b4415f450 0x7f0b440c96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.057+0000 7f0b4a06b640 1 --2- 172.21.15.7:0/1346330323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0b440cdc80 0x7f0b441e63f0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.057+0000 7f0b4a06b640 1 --2- 172.21.15.7:0/1346330323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b440cc3f0 0x7f0b4414eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.057+0000 7f0b4a06b640 1 -- 172.21.15.7:0/1346330323 >> 172.21.15.7:0/1346330323 conn(0x7f0b440d16e0 msgr2=0x7f0b4415f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:16.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.057+0000 7f0b4a06b640 1 -- 172.21.15.7:0/1346330323 shutdown_connections 2024-04-25T10:04:16.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.057+0000 7f0b4a06b640 1 -- 172.21.15.7:0/1346330323 wait complete. 2024-04-25T10:04:16.074 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:02:48.213751+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:02:48.916114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:04:16.074 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:04:16.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.174+0000 7f665db5c640 1 Processor -- start 2024-04-25T10:04:16.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.174+0000 7f665db5c640 1 -- start start 2024-04-25T10:04:16.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.175+0000 7f665db5c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f66580d0a00 0x7f665809a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.175+0000 7f665db5c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f665809a7d0 0x7f66580cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.175+0000 7f665db5c640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66581615e0 con 0x7f6658161200 2024-04-25T10:04:16.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.175+0000 7f665db5c640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f665806c9f0 con 0x7f665809a7d0 2024-04-25T10:04:16.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.175+0000 7f665db5c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665806ccd0 con 0x7f66580d0a00 2024-04-25T10:04:16.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.175+0000 7f6657fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f665809a7d0 0x7f66580cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.175+0000 7f66577fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f6658161200 0x7f66580cbd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:41178/0 (socket says 172.21.15.7:41178) 2024-04-25T10:04:16.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.175+0000 7f66577fe640 1 -- 172.21.15.7:0/3695211318 learned_addr learned my addr 172.21.15.7:0/3695211318 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:16.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.175+0000 7f6656ffd640 1 --2- 172.21.15.7:0/3695211318 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f66580d0a00 0x7f665809a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.175+0000 7f6657fff640 1 -- 172.21.15.7:0/3695211318 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f66580d0a00 msgr2=0x7f665809a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:16.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.175+0000 7f6657fff640 1 --2- 172.21.15.7:0/3695211318 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f66580d0a00 0x7f665809a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.175+0000 7f6657fff640 1 -- 172.21.15.7:0/3695211318 >> v1:172.21.15.7:6789/0 conn(0x7f6658161200 legacy=0x7f66580cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.175+0000 7f66567fc640 1 -- 172.21.15.7:0/3695211318 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 756622526 0 0) 0x7f6648001110 con 0x7f6658161200 2024-04-25T10:04:16.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.175+0000 7f6657fff640 1 -- 172.21.15.7:0/3695211318 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6658099a90 con 0x7f665809a7d0 2024-04-25T10:04:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.176+0000 7f6657fff640 1 --2- 172.21.15.7:0/3695211318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f665809a7d0 0x7f66580cf840 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f6650009d90 tx=0x7f665002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84dd8ba1c6805503 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.176+0000 7f66567fc640 1 -- 172.21.15.7:0/3695211318 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6650007740 con 0x7f665809a7d0 2024-04-25T10:04:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.176+0000 7f66567fc640 1 -- 172.21.15.7:0/3695211318 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66500078e0 con 0x7f665809a7d0 2024-04-25T10:04:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.176+0000 7f66567fc640 1 -- 172.21.15.7:0/3695211318 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6650007cb0 con 0x7f665809a7d0 2024-04-25T10:04:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.177+0000 7f665db5c640 1 -- 172.21.15.7:0/3695211318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f665809a7d0 msgr2=0x7f66580cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.177+0000 7f665db5c640 1 --2- 172.21.15.7:0/3695211318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f665809a7d0 0x7f66580cf840 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f6650009d90 tx=0x7f665002a660 comp rx=0 tx=0).stop 2024-04-25T10:04:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.177+0000 7f665db5c640 1 -- 172.21.15.7:0/3695211318 shutdown_connections 2024-04-25T10:04:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.177+0000 7f665db5c640 1 --2- 172.21.15.7:0/3695211318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f665809a7d0 0x7f66580cf840 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.177+0000 7f665db5c640 1 --2- 172.21.15.7:0/3695211318 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f66580d0a00 0x7f665809a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.177+0000 7f665db5c640 1 -- 172.21.15.7:0/3695211318 >> 172.21.15.7:0/3695211318 conn(0x7f66580b31a0 msgr2=0x7f66580b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:16.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.177+0000 7f665db5c640 1 -- 172.21.15.7:0/3695211318 shutdown_connections 2024-04-25T10:04:16.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.177+0000 7f665db5c640 1 -- 172.21.15.7:0/3695211318 wait complete. 2024-04-25T10:04:16.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.178+0000 7f665db5c640 1 Processor -- start 2024-04-25T10:04:16.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.178+0000 7f665db5c640 1 -- start start 2024-04-25T10:04:16.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.179+0000 7f665db5c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f665809a7d0 0x7f66580c7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.179+0000 7f665db5c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66580d0a00 0x7f66580c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.179+0000 7f665db5c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6658161200 0x7f6658150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.179+0000 7f665db5c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665806cfb0 con 0x7f665809a7d0 2024-04-25T10:04:16.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.179+0000 7f665db5c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665806c680 con 0x7f66580d0a00 2024-04-25T10:04:16.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.179+0000 7f665db5c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665806d130 con 0x7f6658161200 2024-04-25T10:04:16.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.179+0000 7f66577fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f665809a7d0 0x7f66580c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.179+0000 7f66577fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f665809a7d0 0x7f66580c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36414/0 (socket says 172.21.15.7:36414) 2024-04-25T10:04:16.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.179+0000 7f66577fe640 1 -- 172.21.15.7:0/2586568559 learned_addr learned my addr 172.21.15.7:0/2586568559 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:16.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.179+0000 7f6657fff640 1 --2- 172.21.15.7:0/2586568559 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6658161200 0x7f6658150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.179+0000 7f6656ffd640 1 --2- 172.21.15.7:0/2586568559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66580d0a00 0x7f66580c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.179+0000 7f66577fe640 1 -- 172.21.15.7:0/2586568559 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6658161200 msgr2=0x7f6658150ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.179+0000 7f66577fe640 1 --2- 172.21.15.7:0/2586568559 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6658161200 0x7f6658150ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.179+0000 7f66577fe640 1 -- 172.21.15.7:0/2586568559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66580d0a00 msgr2=0x7f66580c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.179+0000 7f66577fe640 1 --2- 172.21.15.7:0/2586568559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66580d0a00 0x7f66580c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.179+0000 7f66577fe640 1 -- 172.21.15.7:0/2586568559 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66580c60f0 con 0x7f665809a7d0 2024-04-25T10:04:16.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.180+0000 7f66577fe640 1 --2- 172.21.15.7:0/2586568559 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f665809a7d0 0x7f66580c7520 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f664800c430 tx=0x7f664800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:16.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.180+0000 7f663ffff640 1 -- 172.21.15.7:0/2586568559 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66480074e0 con 0x7f665809a7d0 2024-04-25T10:04:16.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.180+0000 7f663ffff640 1 -- 172.21.15.7:0/2586568559 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66480047e0 con 0x7f665809a7d0 2024-04-25T10:04:16.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.180+0000 7f665db5c640 1 -- 172.21.15.7:0/2586568559 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66580c6360 con 0x7f665809a7d0 2024-04-25T10:04:16.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.180+0000 7f663ffff640 1 -- 172.21.15.7:0/2586568559 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6648004bd0 con 0x7f665809a7d0 2024-04-25T10:04:16.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.180+0000 7f665db5c640 1 -- 172.21.15.7:0/2586568559 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66580c8b00 con 0x7f665809a7d0 2024-04-25T10:04:16.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.181+0000 7f665db5c640 1 -- 172.21.15.7:0/2586568559 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6658068f60 con 0x7f665809a7d0 2024-04-25T10:04:16.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.181+0000 7f663ffff640 1 -- 172.21.15.7:0/2586568559 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6648011070 con 0x7f665809a7d0 2024-04-25T10:04:16.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.182+0000 7f663ffff640 1 --2- 172.21.15.7:0/2586568559 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f664406b4d0 0x7f664406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.182+0000 7f663ffff640 1 -- 172.21.15.7:0/2586568559 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6331+0+0 (secure 0 0 0) 0x7f664808a010 con 0x7f665809a7d0 2024-04-25T10:04:16.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.182+0000 7f6656ffd640 1 --2- 172.21.15.7:0/2586568559 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f664406b4d0 0x7f664406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.182+0000 7f6656ffd640 1 --2- 172.21.15.7:0/2586568559 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f664406b4d0 0x7f664406d990 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f665809a6f0 tx=0x7f664c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:16.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.186+0000 7f663ffff640 1 -- 172.21.15.7:0/2586568559 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f66581615e0 con 0x7f665809a7d0 2024-04-25T10:04:16.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.365+0000 7f665db5c640 1 -- 172.21.15.7:0/2586568559 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f66580b4050 con 0x7f665809a7d0 2024-04-25T10:04:16.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.365+0000 7f663ffff640 1 -- 172.21.15.7:0/2586568559 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v107) v1 ==== 93+0+10 (secure 0 0 0) 0x7f664800e280 con 0x7f665809a7d0 2024-04-25T10:04:16.371 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T10:04:16.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.367+0000 7f665db5c640 1 -- 172.21.15.7:0/2586568559 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f664406b4d0 msgr2=0x7f664406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.367+0000 7f665db5c640 1 --2- 172.21.15.7:0/2586568559 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f664406b4d0 0x7f664406d990 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f665809a6f0 tx=0x7f664c008040 comp rx=0 tx=0).stop 2024-04-25T10:04:16.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.367+0000 7f665db5c640 1 -- 172.21.15.7:0/2586568559 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f665809a7d0 msgr2=0x7f66580c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.367+0000 7f665db5c640 1 --2- 172.21.15.7:0/2586568559 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f665809a7d0 0x7f66580c7520 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f664800c430 tx=0x7f664800c8f0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.367+0000 7f665db5c640 1 -- 172.21.15.7:0/2586568559 shutdown_connections 2024-04-25T10:04:16.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.367+0000 7f665db5c640 1 --2- 172.21.15.7:0/2586568559 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f664406b4d0 0x7f664406d990 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.367+0000 7f665db5c640 1 --2- 172.21.15.7:0/2586568559 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6658161200 0x7f6658150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.367+0000 7f665db5c640 1 --2- 172.21.15.7:0/2586568559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66580d0a00 0x7f66580c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.367+0000 7f665db5c640 1 --2- 172.21.15.7:0/2586568559 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f665809a7d0 0x7f66580c7520 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.367+0000 7f665db5c640 1 -- 172.21.15.7:0/2586568559 >> 172.21.15.7:0/2586568559 conn(0x7f66580b31a0 msgr2=0x7f665806f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:16.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.367+0000 7f665db5c640 1 -- 172.21.15.7:0/2586568559 shutdown_connections 2024-04-25T10:04:16.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.367+0000 7f665db5c640 1 -- 172.21.15.7:0/2586568559 wait complete. 2024-04-25T10:04:16.383 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:04:16.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.481+0000 7f526ddfe640 1 Processor -- start 2024-04-25T10:04:16.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.481+0000 7f526ddfe640 1 -- start start 2024-04-25T10:04:16.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.482+0000 7f526ddfe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f52680ce830 0x7f526815eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.482+0000 7f526ddfe640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52680ced10 con 0x7f52680d3760 2024-04-25T10:04:16.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.482+0000 7f526ddfe640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52680d1b40 con 0x7f526815f1c0 2024-04-25T10:04:16.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.482+0000 7f526ddfe640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52680ce380 con 0x7f52680ce830 2024-04-25T10:04:16.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.482+0000 7f5267fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f52680ce830 0x7f526815eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.482+0000 7f52677fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f52680d3760 0x7f52680d3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:41194/0 (socket says 172.21.15.7:41194) 2024-04-25T10:04:16.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.482+0000 7f52677fe640 1 -- 172.21.15.7:0/2845457389 learned_addr learned my addr 172.21.15.7:0/2845457389 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:16.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.483+0000 7f5267fff640 1 -- 172.21.15.7:0/2845457389 >> v1:172.21.15.55:6789/0 conn(0x7f526815f1c0 legacy=0x7f52680b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:16.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.483+0000 7f5267fff640 1 -- 172.21.15.7:0/2845457389 >> v1:172.21.15.7:6789/0 conn(0x7f52680d3760 legacy=0x7f52680d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.483+0000 7f5267fff640 1 -- 172.21.15.7:0/2845457389 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52680d1e20 con 0x7f52680ce830 2024-04-25T10:04:16.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.483+0000 7f5267fff640 1 --2- 172.21.15.7:0/2845457389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52680ce830 0x7f526815eac0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f5260009d90 tx=0x7f526002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95459f7ec6c07c5f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:16.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.483+0000 7f52667fc640 1 -- 172.21.15.7:0/2845457389 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5260007740 con 0x7f52680ce830 2024-04-25T10:04:16.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.484+0000 7f52667fc640 1 -- 172.21.15.7:0/2845457389 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52600078e0 con 0x7f52680ce830 2024-04-25T10:04:16.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.484+0000 7f52667fc640 1 -- 172.21.15.7:0/2845457389 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5260007cb0 con 0x7f52680ce830 2024-04-25T10:04:16.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.484+0000 7f526ddfe640 1 -- 172.21.15.7:0/2845457389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52680ce830 msgr2=0x7f526815eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.484+0000 7f526ddfe640 1 --2- 172.21.15.7:0/2845457389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52680ce830 0x7f526815eac0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f5260009d90 tx=0x7f526002a6a0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.484+0000 7f526ddfe640 1 -- 172.21.15.7:0/2845457389 shutdown_connections 2024-04-25T10:04:16.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.484+0000 7f526ddfe640 1 --2- 172.21.15.7:0/2845457389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52680ce830 0x7f526815eac0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.484+0000 7f526ddfe640 1 -- 172.21.15.7:0/2845457389 >> 172.21.15.7:0/2845457389 conn(0x7f5268072680 msgr2=0x7f5268072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:16.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.484+0000 7f526ddfe640 1 -- 172.21.15.7:0/2845457389 shutdown_connections 2024-04-25T10:04:16.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.484+0000 7f526ddfe640 1 -- 172.21.15.7:0/2845457389 wait complete. 2024-04-25T10:04:16.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.485+0000 7f526ddfe640 1 Processor -- start 2024-04-25T10:04:16.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.485+0000 7f526ddfe640 1 -- start start 2024-04-25T10:04:16.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.486+0000 7f526ddfe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52680ce830 0x7f5268149cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.486+0000 7f526ddfe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52680d3760 0x7f52680ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.486+0000 7f526ddfe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f526815f1c0 0x7f52680cb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.486+0000 7f526ddfe640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52680d2190 con 0x7f52680d3760 2024-04-25T10:04:16.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.486+0000 7f526ddfe640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526815f000 con 0x7f52680ce830 2024-04-25T10:04:16.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.486+0000 7f526ddfe640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52680b2950 con 0x7f526815f1c0 2024-04-25T10:04:16.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.486+0000 7f5266ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52680d3760 0x7f52680ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.486+0000 7f5266ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52680d3760 0x7f52680ca8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36428/0 (socket says 172.21.15.7:36428) 2024-04-25T10:04:16.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.486+0000 7f5266ffd640 1 -- 172.21.15.7:0/3594782538 learned_addr learned my addr 172.21.15.7:0/3594782538 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:16.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.486+0000 7f52677fe640 1 --2- 172.21.15.7:0/3594782538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52680ce830 0x7f5268149cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.486+0000 7f5267fff640 1 --2- 172.21.15.7:0/3594782538 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f526815f1c0 0x7f52680cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.487+0000 7f5266ffd640 1 -- 172.21.15.7:0/3594782538 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f526815f1c0 msgr2=0x7f52680cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.487+0000 7f5266ffd640 1 --2- 172.21.15.7:0/3594782538 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f526815f1c0 0x7f52680cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.487+0000 7f5266ffd640 1 -- 172.21.15.7:0/3594782538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52680ce830 msgr2=0x7f5268149cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.487+0000 7f5266ffd640 1 --2- 172.21.15.7:0/3594782538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52680ce830 0x7f5268149cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.487+0000 7f5266ffd640 1 -- 172.21.15.7:0/3594782538 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52680c9b10 con 0x7f52680d3760 2024-04-25T10:04:16.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.487+0000 7f52677fe640 1 --2- 172.21.15.7:0/3594782538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52680ce830 0x7f5268149cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:16.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.487+0000 7f5267fff640 1 --2- 172.21.15.7:0/3594782538 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f526815f1c0 0x7f52680cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:16.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.487+0000 7f5266ffd640 1 --2- 172.21.15.7:0/3594782538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52680d3760 0x7f52680ca8a0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f525c00b3f0 tx=0x7f525c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:16.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.487+0000 7f524ffff640 1 -- 172.21.15.7:0/3594782538 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c015020 con 0x7f52680d3760 2024-04-25T10:04:16.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.487+0000 7f524ffff640 1 -- 172.21.15.7:0/3594782538 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525c011830 con 0x7f52680d3760 2024-04-25T10:04:16.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.487+0000 7f526ddfe640 1 -- 172.21.15.7:0/3594782538 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52680cd6b0 con 0x7f52680d3760 2024-04-25T10:04:16.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.487+0000 7f524ffff640 1 -- 172.21.15.7:0/3594782538 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c011c20 con 0x7f52680d3760 2024-04-25T10:04:16.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.487+0000 7f526ddfe640 1 -- 172.21.15.7:0/3594782538 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52680c9830 con 0x7f52680d3760 2024-04-25T10:04:16.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.488+0000 7f526ddfe640 1 -- 172.21.15.7:0/3594782538 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5268067ef0 con 0x7f52680d3760 2024-04-25T10:04:16.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.488+0000 7f524ffff640 1 -- 172.21.15.7:0/3594782538 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f525c018020 con 0x7f52680d3760 2024-04-25T10:04:16.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.489+0000 7f524ffff640 1 --2- 172.21.15.7:0/3594782538 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f525406b4d0 0x7f525406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.489+0000 7f524ffff640 1 -- 172.21.15.7:0/3594782538 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6331+0+0 (secure 0 0 0) 0x7f525c08a070 con 0x7f52680d3760 2024-04-25T10:04:16.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.489+0000 7f52677fe640 1 --2- 172.21.15.7:0/3594782538 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f525406b4d0 0x7f525406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.489+0000 7f52677fe640 1 --2- 172.21.15.7:0/3594782538 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f525406b4d0 0x7f525406d990 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f52681f73d0 tx=0x7f5258009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:16.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.493+0000 7f524ffff640 1 -- 172.21.15.7:0/3594782538 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5268067ef0 con 0x7f52680d3760 2024-04-25T10:04:16.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.672+0000 7f526ddfe640 1 -- 172.21.15.7:0/3594782538 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5268068f60 con 0x7f52680d3760 2024-04-25T10:04:16.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.672+0000 7f524ffff640 1 -- 172.21.15.7:0/3594782538 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v107) v1 ==== 104+0+11 (secure 0 0 0) 0x7f525c01f030 con 0x7f52680d3760 2024-04-25T10:04:16.677 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T10:04:16.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.674+0000 7f526ddfe640 1 -- 172.21.15.7:0/3594782538 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f525406b4d0 msgr2=0x7f525406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.674+0000 7f526ddfe640 1 --2- 172.21.15.7:0/3594782538 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f525406b4d0 0x7f525406d990 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f52681f73d0 tx=0x7f5258009040 comp rx=0 tx=0).stop 2024-04-25T10:04:16.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.674+0000 7f526ddfe640 1 -- 172.21.15.7:0/3594782538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52680d3760 msgr2=0x7f52680ca8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.674+0000 7f526ddfe640 1 --2- 172.21.15.7:0/3594782538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52680d3760 0x7f52680ca8a0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f525c00b3f0 tx=0x7f525c00b8b0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.674+0000 7f526ddfe640 1 -- 172.21.15.7:0/3594782538 shutdown_connections 2024-04-25T10:04:16.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.674+0000 7f526ddfe640 1 --2- 172.21.15.7:0/3594782538 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f525406b4d0 0x7f525406d990 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.674+0000 7f526ddfe640 1 --2- 172.21.15.7:0/3594782538 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f526815f1c0 0x7f52680cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.674+0000 7f526ddfe640 1 --2- 172.21.15.7:0/3594782538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52680d3760 0x7f52680ca8a0 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.674+0000 7f526ddfe640 1 --2- 172.21.15.7:0/3594782538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52680ce830 0x7f5268149cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.674+0000 7f526ddfe640 1 -- 172.21.15.7:0/3594782538 >> 172.21.15.7:0/3594782538 conn(0x7f5268072680 msgr2=0x7f5268072a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:16.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.674+0000 7f526ddfe640 1 -- 172.21.15.7:0/3594782538 shutdown_connections 2024-04-25T10:04:16.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.674+0000 7f526ddfe640 1 -- 172.21.15.7:0/3594782538 wait complete. 2024-04-25T10:04:16.690 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:04:16.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.790+0000 7f3602d10640 1 Processor -- start 2024-04-25T10:04:16.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.790+0000 7f3602d10640 1 -- start start 2024-04-25T10:04:16.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.790+0000 7f3602d10640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f35fc15f1c0 0x7f35fc15eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.790+0000 7f3602d10640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f35fc0ce830 0x7f35fc0b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.790+0000 7f3602d10640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35fc0ced10 con 0x7f35fc0d3760 2024-04-25T10:04:16.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.790+0000 7f3602d10640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35fc0ce380 con 0x7f35fc15f1c0 2024-04-25T10:04:16.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.791+0000 7f3602d10640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc15f000 con 0x7f35fc0ce830 2024-04-25T10:04:16.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.791+0000 7f35fbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f35fc15f1c0 0x7f35fc15eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.791+0000 7f36012ad640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f35fc0ce830 0x7f35fc0b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.791+0000 7f36012ad640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f35fc0ce830 0x7f35fc0b2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:60542/0 (socket says 172.21.15.7:60542) 2024-04-25T10:04:16.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.791+0000 7f35fbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f35fc15f1c0 0x7f35fc15eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:53274/0 (socket says 172.21.15.7:53274) 2024-04-25T10:04:16.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.791+0000 7f3600aac640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f35fc0d3760 0x7f35fc0d3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:41368/0 (socket says 172.21.15.7:41368) 2024-04-25T10:04:16.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.791+0000 7f36012ad640 1 -- 172.21.15.7:0/403243268 learned_addr learned my addr 172.21.15.7:0/403243268 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:16.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.791+0000 7f35fbfff640 1 -- 172.21.15.7:0/403243268 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f35fc0ce830 msgr2=0x7f35fc0b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:16.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.791+0000 7f35fbfff640 1 --2- 172.21.15.7:0/403243268 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f35fc0ce830 0x7f35fc0b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.791+0000 7f35fbfff640 1 -- 172.21.15.7:0/403243268 >> v1:172.21.15.55:6789/0 conn(0x7f35fc0d3760 legacy=0x7f35fc0d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.791+0000 7f35fbfff640 1 -- 172.21.15.7:0/403243268 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc0d1b40 con 0x7f35fc15f1c0 2024-04-25T10:04:16.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.791+0000 7f35fb7fe640 1 -- 172.21.15.7:0/403243268 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2406525285 0 0) 0x7f35fc0ced10 con 0x7f35fc0d3760 2024-04-25T10:04:16.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.791+0000 7f36012ad640 1 --2- 172.21.15.7:0/403243268 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f35fc0ce830 0x7f35fc0b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:16.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.792+0000 7f35fbfff640 1 --2- 172.21.15.7:0/403243268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35fc15f1c0 0x7f35fc15eac0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f35e80097a0 tx=0x7f35e802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8563e8f6af554d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:16.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.792+0000 7f35fb7fe640 1 -- 172.21.15.7:0/403243268 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e8037070 con 0x7f35fc15f1c0 2024-04-25T10:04:16.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.792+0000 7f35fb7fe640 1 -- 172.21.15.7:0/403243268 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e8032440 con 0x7f35fc15f1c0 2024-04-25T10:04:16.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.792+0000 7f35fb7fe640 1 -- 172.21.15.7:0/403243268 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e8032810 con 0x7f35fc15f1c0 2024-04-25T10:04:16.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.793+0000 7f3602d10640 1 -- 172.21.15.7:0/403243268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35fc15f1c0 msgr2=0x7f35fc15eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.793+0000 7f3602d10640 1 --2- 172.21.15.7:0/403243268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35fc15f1c0 0x7f35fc15eac0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f35e80097a0 tx=0x7f35e802a180 comp rx=0 tx=0).stop 2024-04-25T10:04:16.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.793+0000 7f3602d10640 1 -- 172.21.15.7:0/403243268 shutdown_connections 2024-04-25T10:04:16.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.793+0000 7f3602d10640 1 --2- 172.21.15.7:0/403243268 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f35fc0ce830 0x7f35fc0b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.793+0000 7f3602d10640 1 --2- 172.21.15.7:0/403243268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35fc15f1c0 0x7f35fc15eac0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.793+0000 7f3602d10640 1 -- 172.21.15.7:0/403243268 >> 172.21.15.7:0/403243268 conn(0x7f35fc072680 msgr2=0x7f35fc072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:16.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.793+0000 7f3602d10640 1 -- 172.21.15.7:0/403243268 shutdown_connections 2024-04-25T10:04:16.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.793+0000 7f3602d10640 1 -- 172.21.15.7:0/403243268 wait complete. 2024-04-25T10:04:16.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.794+0000 7f3602d10640 1 Processor -- start 2024-04-25T10:04:16.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.794+0000 7f3602d10640 1 -- start start 2024-04-25T10:04:16.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.795+0000 7f3602d10640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f35fc0ce830 0x7f35fc15a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.795+0000 7f3602d10640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35fc0d3760 0x7f35fc157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.795+0000 7f3602d10640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35fc15f1c0 0x7f35fc157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.795+0000 7f3602d10640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc15de10 con 0x7f35fc0d3760 2024-04-25T10:04:16.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.795+0000 7f3602d10640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc0d2190 con 0x7f35fc15f1c0 2024-04-25T10:04:16.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.795+0000 7f3602d10640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc0b2780 con 0x7f35fc0ce830 2024-04-25T10:04:16.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.795+0000 7f35fbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35fc0d3760 0x7f35fc157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.795+0000 7f35fbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35fc0d3760 0x7f35fc157400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36432/0 (socket says 172.21.15.7:36432) 2024-04-25T10:04:16.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.795+0000 7f35fbfff640 1 -- 172.21.15.7:0/4094147942 learned_addr learned my addr 172.21.15.7:0/4094147942 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:16.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.795+0000 7f3600aac640 1 --2- 172.21.15.7:0/4094147942 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f35fc0ce830 0x7f35fc15a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.795+0000 7f36012ad640 1 --2- 172.21.15.7:0/4094147942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35fc15f1c0 0x7f35fc157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.795+0000 7f35fbfff640 1 -- 172.21.15.7:0/4094147942 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f35fc0ce830 msgr2=0x7f35fc15a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.795+0000 7f35fbfff640 1 --2- 172.21.15.7:0/4094147942 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f35fc0ce830 0x7f35fc15a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.795+0000 7f35fbfff640 1 -- 172.21.15.7:0/4094147942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35fc15f1c0 msgr2=0x7f35fc157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.795+0000 7f35fbfff640 1 --2- 172.21.15.7:0/4094147942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35fc15f1c0 0x7f35fc157940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.795+0000 7f35fbfff640 1 -- 172.21.15.7:0/4094147942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc157e80 con 0x7f35fc0d3760 2024-04-25T10:04:16.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.795+0000 7f36012ad640 1 --2- 172.21.15.7:0/4094147942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35fc15f1c0 0x7f35fc157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:16.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.796+0000 7f35fbfff640 1 --2- 172.21.15.7:0/4094147942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35fc0d3760 0x7f35fc157400 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f35e8000c00 tx=0x7f35e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:16.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.796+0000 7f35f97fa640 1 -- 172.21.15.7:0/4094147942 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e8037040 con 0x7f35fc0d3760 2024-04-25T10:04:16.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.796+0000 7f35f97fa640 1 -- 172.21.15.7:0/4094147942 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e8042070 con 0x7f35fc0d3760 2024-04-25T10:04:16.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.796+0000 7f3602d10640 1 -- 172.21.15.7:0/4094147942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35fc0ca050 con 0x7f35fc0d3760 2024-04-25T10:04:16.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.796+0000 7f35f97fa640 1 -- 172.21.15.7:0/4094147942 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e8030940 con 0x7f35fc0d3760 2024-04-25T10:04:16.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.796+0000 7f3602d10640 1 -- 172.21.15.7:0/4094147942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35fc0c85e0 con 0x7f35fc0d3760 2024-04-25T10:04:16.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.797+0000 7f3602d10640 1 -- 172.21.15.7:0/4094147942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35fc073ce0 con 0x7f35fc0d3760 2024-04-25T10:04:16.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.797+0000 7f35f97fa640 1 -- 172.21.15.7:0/4094147942 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f35e8030ae0 con 0x7f35fc0d3760 2024-04-25T10:04:16.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.798+0000 7f35f97fa640 1 --2- 172.21.15.7:0/4094147942 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f35e006b4d0 0x7f35e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.798+0000 7f35f97fa640 1 -- 172.21.15.7:0/4094147942 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6331+0+0 (secure 0 0 0) 0x7f35e80aaea0 con 0x7f35fc0d3760 2024-04-25T10:04:16.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.798+0000 7f3600aac640 1 --2- 172.21.15.7:0/4094147942 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f35e006b4d0 0x7f35e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.798+0000 7f3600aac640 1 --2- 172.21.15.7:0/4094147942 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f35e006b4d0 0x7f35e006d990 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f35f0000f60 tx=0x7f35f0007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:16.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.802+0000 7f35f97fa640 1 -- 172.21.15.7:0/4094147942 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f35fc073ce0 con 0x7f35fc0d3760 2024-04-25T10:04:16.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.980+0000 7f3602d10640 1 -- 172.21.15.7:0/4094147942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f35fc068f60 con 0x7f35fc0d3760 2024-04-25T10:04:16.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.980+0000 7f35f97fa640 1 -- 172.21.15.7:0/4094147942 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v107) v1 ==== 100+0+11 (secure 0 0 0) 0x7f35fc157e80 con 0x7f35fc0d3760 2024-04-25T10:04:16.985 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T10:04:16.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.982+0000 7f3602d10640 1 -- 172.21.15.7:0/4094147942 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f35e006b4d0 msgr2=0x7f35e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.982+0000 7f3602d10640 1 --2- 172.21.15.7:0/4094147942 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f35e006b4d0 0x7f35e006d990 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f35f0000f60 tx=0x7f35f0007d50 comp rx=0 tx=0).stop 2024-04-25T10:04:16.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.982+0000 7f3602d10640 1 -- 172.21.15.7:0/4094147942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35fc0d3760 msgr2=0x7f35fc157400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.982+0000 7f3602d10640 1 --2- 172.21.15.7:0/4094147942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35fc0d3760 0x7f35fc157400 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f35e8000c00 tx=0x7f35e80046c0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.982+0000 7f3602d10640 1 -- 172.21.15.7:0/4094147942 shutdown_connections 2024-04-25T10:04:16.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.982+0000 7f3602d10640 1 --2- 172.21.15.7:0/4094147942 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f35e006b4d0 0x7f35e006d990 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.982+0000 7f3602d10640 1 --2- 172.21.15.7:0/4094147942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35fc15f1c0 0x7f35fc157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.982+0000 7f3602d10640 1 --2- 172.21.15.7:0/4094147942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35fc0d3760 0x7f35fc157400 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.982+0000 7f3602d10640 1 --2- 172.21.15.7:0/4094147942 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f35fc0ce830 0x7f35fc15a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.982+0000 7f3602d10640 1 -- 172.21.15.7:0/4094147942 >> 172.21.15.7:0/4094147942 conn(0x7f35fc072680 msgr2=0x7f35fc072a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:16.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.982+0000 7f3602d10640 1 -- 172.21.15.7:0/4094147942 shutdown_connections 2024-04-25T10:04:16.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:16.982+0000 7f3602d10640 1 -- 172.21.15.7:0/4094147942 wait complete. 2024-04-25T10:04:16.998 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:04:17.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.094+0000 7ffa06b02640 1 Processor -- start 2024-04-25T10:04:17.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.094+0000 7ffa06b02640 1 -- start start 2024-04-25T10:04:17.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.094+0000 7ffa06b02640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffa000b5e60 0x7ffa0006bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.094+0000 7ffa06b02640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa0006cd00 con 0x7ffa0015dd00 2024-04-25T10:04:17.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.094+0000 7ffa06b02640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa000d1ca0 con 0x7ffa000b6a40 2024-04-25T10:04:17.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.094+0000 7ffa06b02640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa0015e0e0 con 0x7ffa000b5e60 2024-04-25T10:04:17.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.095+0000 7ff9fffff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffa000b5e60 0x7ffa0006bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.095+0000 7ff9fffff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffa000b5e60 0x7ffa0006bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36444/0 (socket says 172.21.15.7:36444) 2024-04-25T10:04:17.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.095+0000 7ffa0489e640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ffa0015dd00 0x7ffa000b5750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:41196/0 (socket says 172.21.15.7:41196) 2024-04-25T10:04:17.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.095+0000 7ff9fffff640 1 -- 172.21.15.7:0/489173592 learned_addr learned my addr 172.21.15.7:0/489173592 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:17.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.095+0000 7ff9fffff640 1 -- 172.21.15.7:0/489173592 >> v1:172.21.15.55:6789/0 conn(0x7ffa000b6a40 legacy=0x7ffa0006c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:17.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.095+0000 7ff9fffff640 1 -- 172.21.15.7:0/489173592 >> v1:172.21.15.7:6789/0 conn(0x7ffa0015dd00 legacy=0x7ffa000b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.095+0000 7ff9ff7fe640 1 -- 172.21.15.7:0/489173592 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2512088598 0 0) 0x7ffa0006cd00 con 0x7ffa0015dd00 2024-04-25T10:04:17.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.095+0000 7ff9fffff640 1 -- 172.21.15.7:0/489173592 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa000d1f80 con 0x7ffa000b5e60 2024-04-25T10:04:17.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.096+0000 7ff9fffff640 1 --2- 172.21.15.7:0/489173592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa000b5e60 0x7ffa0006bfb0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec009870 tx=0x7ff9ec02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54647fbed26d0760 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.096+0000 7ff9ff7fe640 1 -- 172.21.15.7:0/489173592 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec037070 con 0x7ffa000b5e60 2024-04-25T10:04:17.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.096+0000 7ff9ff7fe640 1 -- 172.21.15.7:0/489173592 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ec032440 con 0x7ffa000b5e60 2024-04-25T10:04:17.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.096+0000 7ff9ff7fe640 1 -- 172.21.15.7:0/489173592 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec032810 con 0x7ffa000b5e60 2024-04-25T10:04:17.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.096+0000 7ffa06b02640 1 -- 172.21.15.7:0/489173592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa000b5e60 msgr2=0x7ffa0006bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.096+0000 7ffa06b02640 1 --2- 172.21.15.7:0/489173592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa000b5e60 0x7ffa0006bfb0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec009870 tx=0x7ff9ec02a2a0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.096+0000 7ffa06b02640 1 -- 172.21.15.7:0/489173592 shutdown_connections 2024-04-25T10:04:17.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.096+0000 7ffa06b02640 1 --2- 172.21.15.7:0/489173592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa000b5e60 0x7ffa0006bfb0 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.096+0000 7ffa06b02640 1 -- 172.21.15.7:0/489173592 >> 172.21.15.7:0/489173592 conn(0x7ffa000d07b0 msgr2=0x7ffa000d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:17.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.096+0000 7ffa06b02640 1 -- 172.21.15.7:0/489173592 shutdown_connections 2024-04-25T10:04:17.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.096+0000 7ffa06b02640 1 -- 172.21.15.7:0/489173592 wait complete. 2024-04-25T10:04:17.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.098+0000 7ffa06b02640 1 Processor -- start 2024-04-25T10:04:17.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.098+0000 7ffa06b02640 1 -- start start 2024-04-25T10:04:17.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.098+0000 7ffa06b02640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa000b5e60 0x7ffa001547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.098+0000 7ffa06b02640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffa000b6a40 0x7ffa0014c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.098+0000 7ffa06b02640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa0015dd00 0x7ffa0014ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.099+0000 7ffa06b02640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa00168ab0 con 0x7ffa0015dd00 2024-04-25T10:04:17.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.099+0000 7ffa06b02640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0006cfe0 con 0x7ffa000b5e60 2024-04-25T10:04:17.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.099+0000 7ffa06b02640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa00168c30 con 0x7ffa000b6a40 2024-04-25T10:04:17.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.099+0000 7ffa0509f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa0015dd00 0x7ffa0014ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.099+0000 7ffa0509f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa0015dd00 0x7ffa0014ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36460/0 (socket says 172.21.15.7:36460) 2024-04-25T10:04:17.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.099+0000 7ffa0509f640 1 -- 172.21.15.7:0/923251469 learned_addr learned my addr 172.21.15.7:0/923251469 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:17.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.099+0000 7ffa0489e640 1 --2- 172.21.15.7:0/923251469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa000b5e60 0x7ffa001547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.099+0000 7ff9fffff640 1 --2- 172.21.15.7:0/923251469 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffa000b6a40 0x7ffa0014c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.099+0000 7ffa0509f640 1 -- 172.21.15.7:0/923251469 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffa000b6a40 msgr2=0x7ffa0014c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.099+0000 7ffa0509f640 1 --2- 172.21.15.7:0/923251469 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffa000b6a40 0x7ffa0014c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.099+0000 7ffa0509f640 1 -- 172.21.15.7:0/923251469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa000b5e60 msgr2=0x7ffa001547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.099+0000 7ffa0509f640 1 --2- 172.21.15.7:0/923251469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa000b5e60 0x7ffa001547f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.099+0000 7ffa0509f640 1 -- 172.21.15.7:0/923251469 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0015f890 con 0x7ffa0015dd00 2024-04-25T10:04:17.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.099+0000 7ffa0489e640 1 --2- 172.21.15.7:0/923251469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa000b5e60 0x7ffa001547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:17.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.099+0000 7ffa0509f640 1 --2- 172.21.15.7:0/923251469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa0015dd00 0x7ffa0014ec40 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800c780 tx=0x7ff9f800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.099+0000 7ff9fd7fa640 1 -- 172.21.15.7:0/923251469 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f8004b60 con 0x7ffa0015dd00 2024-04-25T10:04:17.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.099+0000 7ff9fd7fa640 1 -- 172.21.15.7:0/923251469 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f8004d00 con 0x7ffa0015dd00 2024-04-25T10:04:17.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.099+0000 7ffa06b02640 1 -- 172.21.15.7:0/923251469 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa000cc370 con 0x7ffa0015dd00 2024-04-25T10:04:17.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.099+0000 7ff9fd7fa640 1 -- 172.21.15.7:0/923251469 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f800aa90 con 0x7ffa0015dd00 2024-04-25T10:04:17.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.099+0000 7ffa06b02640 1 -- 172.21.15.7:0/923251469 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa0015fe10 con 0x7ffa0015dd00 2024-04-25T10:04:17.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.100+0000 7ffa06b02640 1 -- 172.21.15.7:0/923251469 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa00068fd0 con 0x7ffa0015dd00 2024-04-25T10:04:17.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.101+0000 7ff9fd7fa640 1 -- 172.21.15.7:0/923251469 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff9f800ac30 con 0x7ffa0015dd00 2024-04-25T10:04:17.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.101+0000 7ff9fd7fa640 1 --2- 172.21.15.7:0/923251469 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff9e406b4d0 0x7ff9e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.101+0000 7ff9fd7fa640 1 -- 172.21.15.7:0/923251469 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6331+0+0 (secure 0 0 0) 0x7ff9f808a760 con 0x7ffa0015dd00 2024-04-25T10:04:17.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.101+0000 7ffa0489e640 1 --2- 172.21.15.7:0/923251469 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff9e406b4d0 0x7ff9e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.102+0000 7ffa0489e640 1 --2- 172.21.15.7:0/923251469 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff9e406b4d0 0x7ff9e406d990 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4000f60 tx=0x7ff9f4007ca0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.105+0000 7ff9fd7fa640 1 -- 172.21.15.7:0/923251469 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff9f8020070 con 0x7ffa0015dd00 2024-04-25T10:04:17.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.324+0000 7ffa06b02640 1 -- 172.21.15.7:0/923251469 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa000d1620 con 0x7ffa0015dd00 2024-04-25T10:04:17.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.324+0000 7ff9fd7fa640 1 -- 172.21.15.7:0/923251469 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4928 (secure 0 0 0) 0x7ff9f80592d0 con 0x7ffa0015dd00 2024-04-25T10:04:17.330 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:17.330 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":81,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6617,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3278722694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3278722694},{"type":"v1","addr":"172.21.15.55:6835","nonce":3278722694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":7435,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3598653097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3598653097},{"type":"v1","addr":"172.21.15.55:6834","nonce":3598653097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":8361,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3628875229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3628875229},{"type":"v1","addr":"172.21.15.7:6836","nonce":3628875229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":8883,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1325218305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1325218305},{"type":"v1","addr":"172.21.15.7:6837","nonce":1325218305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":80,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:02:49.944298+0000","modified":"2024-04-25T10:04:15.097532+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T10:04:17.331 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 81 2024-04-25T10:04:17.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.326+0000 7ffa06b02640 1 -- 172.21.15.7:0/923251469 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff9e406b4d0 msgr2=0x7ff9e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.326+0000 7ffa06b02640 1 --2- 172.21.15.7:0/923251469 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff9e406b4d0 0x7ff9e406d990 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4000f60 tx=0x7ff9f4007ca0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.326+0000 7ffa06b02640 1 -- 172.21.15.7:0/923251469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa0015dd00 msgr2=0x7ffa0014ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.326+0000 7ffa06b02640 1 --2- 172.21.15.7:0/923251469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa0015dd00 0x7ffa0014ec40 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800c780 tx=0x7ff9f800cc40 comp rx=0 tx=0).stop 2024-04-25T10:04:17.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.326+0000 7ffa06b02640 1 -- 172.21.15.7:0/923251469 shutdown_connections 2024-04-25T10:04:17.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.326+0000 7ffa06b02640 1 --2- 172.21.15.7:0/923251469 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff9e406b4d0 0x7ff9e406d990 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.326+0000 7ffa06b02640 1 --2- 172.21.15.7:0/923251469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa0015dd00 0x7ffa0014ec40 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.326+0000 7ffa06b02640 1 --2- 172.21.15.7:0/923251469 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ffa000b6a40 0x7ffa0014c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.326+0000 7ffa06b02640 1 --2- 172.21.15.7:0/923251469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa000b5e60 0x7ffa001547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.326+0000 7ffa06b02640 1 -- 172.21.15.7:0/923251469 >> 172.21.15.7:0/923251469 conn(0x7ffa000d07b0 msgr2=0x7ffa000b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:17.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.326+0000 7ffa06b02640 1 -- 172.21.15.7:0/923251469 shutdown_connections 2024-04-25T10:04:17.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.326+0000 7ffa06b02640 1 -- 172.21.15.7:0/923251469 wait complete. 2024-04-25T10:04:17.342 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:17.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.438+0000 7f9d697b7640 1 Processor -- start 2024-04-25T10:04:17.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.438+0000 7f9d697b7640 1 -- start start 2024-04-25T10:04:17.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.438+0000 7f9d697b7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9d6415dd00 0x7f9d640b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.438+0000 7f9d697b7640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d6406cd00 con 0x7f9d6406c6c0 2024-04-25T10:04:17.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.438+0000 7f9d697b7640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d640d1ca0 con 0x7f9d640b6a40 2024-04-25T10:04:17.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.438+0000 7f9d697b7640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d6415e0e0 con 0x7f9d6415dd00 2024-04-25T10:04:17.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.439+0000 7f9d637fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9d6406c6c0 0x7f9d640d2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:41212/0 (socket says 172.21.15.7:41212) 2024-04-25T10:04:17.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.439+0000 7f9d637fe640 1 -- 172.21.15.7:0/2477058265 learned_addr learned my addr 172.21.15.7:0/2477058265 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:17.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.439+0000 7f9d62ffd640 1 --2- 172.21.15.7:0/2477058265 >> v2:172.21.15.55:3300/0 conn(0x7f9d6415dd00 0x7f9d640b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.439+0000 7f9d61ffb640 1 -- 172.21.15.7:0/2477058265 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1594235675 0 0) 0x7f9d6406cd00 con 0x7f9d6406c6c0 2024-04-25T10:04:17.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.439+0000 7f9d61ffb640 1 -- 172.21.15.7:0/2477058265 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d4c003520 con 0x7f9d6406c6c0 2024-04-25T10:04:17.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.439+0000 7f9d61ffb640 1 -- 172.21.15.7:0/2477058265 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2646725770 0 0) 0x7f9d640d1ca0 con 0x7f9d640b6a40 2024-04-25T10:04:17.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.439+0000 7f9d61ffb640 1 -- 172.21.15.7:0/2477058265 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d6406cd00 con 0x7f9d640b6a40 2024-04-25T10:04:17.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.439+0000 7f9d61ffb640 1 -- 172.21.15.7:0/2477058265 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2616061743 0 0) 0x7f9d4c003520 con 0x7f9d6406c6c0 2024-04-25T10:04:17.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.439+0000 7f9d61ffb640 1 -- 172.21.15.7:0/2477058265 >> v2:172.21.15.55:3300/0 conn(0x7f9d6415dd00 msgr2=0x7f9d640b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:17.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.439+0000 7f9d61ffb640 1 --2- 172.21.15.7:0/2477058265 >> v2:172.21.15.55:3300/0 conn(0x7f9d6415dd00 0x7f9d640b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.439+0000 7f9d61ffb640 1 -- 172.21.15.7:0/2477058265 >> v1:172.21.15.55:6789/0 conn(0x7f9d640b6a40 legacy=0x7f9d6406bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.439+0000 7f9d61ffb640 1 -- 172.21.15.7:0/2477058265 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d640d1f80 con 0x7f9d6406c6c0 2024-04-25T10:04:17.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.439+0000 7f9d61ffb640 1 -- 172.21.15.7:0/2477058265 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f9d5c0019f0 con 0x7f9d6406c6c0 2024-04-25T10:04:17.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.439+0000 7f9d62ffd640 1 --2- 172.21.15.7:0/2477058265 >> v2:172.21.15.55:3300/0 conn(0x7f9d6415dd00 0x7f9d640b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:17.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.439+0000 7f9d61ffb640 1 -- 172.21.15.7:0/2477058265 >> v1:172.21.15.7:6789/0 conn(0x7f9d6406c6c0 legacy=0x7f9d640d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.439+0000 7f9d61ffb640 1 --2- 172.21.15.7:0/2477058265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d4c003b40 0x7f9d4c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.439+0000 7f9d61ffb640 1 --2- 172.21.15.7:0/2477058265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d4c004800 0x7f9d4c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.439+0000 7f9d61ffb640 1 --2- 172.21.15.7:0/2477058265 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d4c0051c0 0x7f9d4c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.439+0000 7f9d61ffb640 1 -- 172.21.15.7:0/2477058265 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6415e0e0 con 0x7f9d4c003b40 2024-04-25T10:04:17.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.439+0000 7f9d61ffb640 1 -- 172.21.15.7:0/2477058265 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c00bfb0 con 0x7f9d4c004800 2024-04-25T10:04:17.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.439+0000 7f9d61ffb640 1 -- 172.21.15.7:0/2477058265 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c00c1b0 con 0x7f9d4c0051c0 2024-04-25T10:04:17.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.439+0000 7f9d62ffd640 1 --2- 172.21.15.7:0/2477058265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d4c003b40 0x7f9d4c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.440+0000 7f9d627fc640 1 --2- 172.21.15.7:0/2477058265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d4c004800 0x7f9d4c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.440+0000 7f9d637fe640 1 --2- 172.21.15.7:0/2477058265 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d4c0051c0 0x7f9d4c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.440+0000 7f9d62ffd640 1 -- 172.21.15.7:0/2477058265 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d4c0051c0 msgr2=0x7f9d4c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:17.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.440+0000 7f9d62ffd640 1 --2- 172.21.15.7:0/2477058265 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d4c0051c0 0x7f9d4c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.440+0000 7f9d62ffd640 1 -- 172.21.15.7:0/2477058265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d4c004800 msgr2=0x7f9d4c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:17.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.440+0000 7f9d62ffd640 1 --2- 172.21.15.7:0/2477058265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d4c004800 0x7f9d4c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.440+0000 7f9d62ffd640 1 -- 172.21.15.7:0/2477058265 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4c003520 con 0x7f9d4c003b40 2024-04-25T10:04:17.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.440+0000 7f9d637fe640 1 -- 172.21.15.7:0/2477058265 reap_dead start 2024-04-25T10:04:17.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.440+0000 7f9d62ffd640 1 --2- 172.21.15.7:0/2477058265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d4c003b40 0x7f9d4c003f40 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009c60 tx=0x7f9d4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e2683d2ecd0629 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.440+0000 7f9d61ffb640 1 -- 172.21.15.7:0/2477058265 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d54036070 con 0x7f9d4c003b40 2024-04-25T10:04:17.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.441+0000 7f9d61ffb640 1 -- 172.21.15.7:0/2477058265 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d54031400 con 0x7f9d4c003b40 2024-04-25T10:04:17.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.441+0000 7f9d61ffb640 1 -- 172.21.15.7:0/2477058265 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d54009860 con 0x7f9d4c003b40 2024-04-25T10:04:17.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.441+0000 7f9d697b7640 1 -- 172.21.15.7:0/2477058265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d4c003b40 msgr2=0x7f9d4c003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.441+0000 7f9d697b7640 1 --2- 172.21.15.7:0/2477058265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d4c003b40 0x7f9d4c003f40 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009c60 tx=0x7f9d4c005830 comp rx=0 tx=0).stop 2024-04-25T10:04:17.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.441+0000 7f9d697b7640 1 -- 172.21.15.7:0/2477058265 shutdown_connections 2024-04-25T10:04:17.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.441+0000 7f9d697b7640 1 --2- 172.21.15.7:0/2477058265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d4c003b40 0x7f9d4c003f40 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.441+0000 7f9d697b7640 1 -- 172.21.15.7:0/2477058265 >> 172.21.15.7:0/2477058265 conn(0x7f9d640d07b0 msgr2=0x7f9d640d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:17.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.441+0000 7f9d697b7640 1 -- 172.21.15.7:0/2477058265 shutdown_connections 2024-04-25T10:04:17.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.441+0000 7f9d697b7640 1 -- 172.21.15.7:0/2477058265 wait complete. 2024-04-25T10:04:17.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.442+0000 7f9d697b7640 1 Processor -- start 2024-04-25T10:04:17.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.442+0000 7f9d697b7640 1 -- start start 2024-04-25T10:04:17.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.443+0000 7f9d697b7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d4c003b40 0x7f9d640c9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.443+0000 7f9d697b7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d64158430 0x7f9d641588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.443+0000 7f9d697b7640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d640cc6c0 0x7f9d640ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.443+0000 7f9d697b7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6406bfb0 con 0x7f9d4c003b40 2024-04-25T10:04:17.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.443+0000 7f9d697b7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6406cfe0 con 0x7f9d64158430 2024-04-25T10:04:17.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.443+0000 7f9d697b7640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6406c130 con 0x7f9d640cc6c0 2024-04-25T10:04:17.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.443+0000 7f9d62ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d4c003b40 0x7f9d640c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.443+0000 7f9d62ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d4c003b40 0x7f9d640c9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36482/0 (socket says 172.21.15.7:36482) 2024-04-25T10:04:17.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.443+0000 7f9d62ffd640 1 -- 172.21.15.7:0/1857877829 learned_addr learned my addr 172.21.15.7:0/1857877829 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:17.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.443+0000 7f9d627fc640 1 --2- 172.21.15.7:0/1857877829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d64158430 0x7f9d641588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.443+0000 7f9d637fe640 1 --2- 172.21.15.7:0/1857877829 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d640cc6c0 0x7f9d640ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.444+0000 7f9d62ffd640 1 -- 172.21.15.7:0/1857877829 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d640cc6c0 msgr2=0x7f9d640ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.444+0000 7f9d62ffd640 1 --2- 172.21.15.7:0/1857877829 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d640cc6c0 0x7f9d640ccb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.444+0000 7f9d62ffd640 1 -- 172.21.15.7:0/1857877829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d64158430 msgr2=0x7f9d641588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.444+0000 7f9d62ffd640 1 --2- 172.21.15.7:0/1857877829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d64158430 0x7f9d641588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.444+0000 7f9d62ffd640 1 -- 172.21.15.7:0/1857877829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d641514d0 con 0x7f9d4c003b40 2024-04-25T10:04:17.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.444+0000 7f9d62ffd640 1 --2- 172.21.15.7:0/1857877829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d4c003b40 0x7f9d640c9590 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009d80 tx=0x7f9d54004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.444+0000 7f9d4b7fe640 1 -- 172.21.15.7:0/1857877829 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d54040070 con 0x7f9d4c003b40 2024-04-25T10:04:17.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.444+0000 7f9d4b7fe640 1 -- 172.21.15.7:0/1857877829 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5403b680 con 0x7f9d4c003b40 2024-04-25T10:04:17.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.444+0000 7f9d697b7640 1 -- 172.21.15.7:0/1857877829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d641517b0 con 0x7f9d4c003b40 2024-04-25T10:04:17.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.444+0000 7f9d4b7fe640 1 -- 172.21.15.7:0/1857877829 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d54036040 con 0x7f9d4c003b40 2024-04-25T10:04:17.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.444+0000 7f9d697b7640 1 -- 172.21.15.7:0/1857877829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d64151d70 con 0x7f9d4c003b40 2024-04-25T10:04:17.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.445+0000 7f9d697b7640 1 -- 172.21.15.7:0/1857877829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d64068fd0 con 0x7f9d4c003b40 2024-04-25T10:04:17.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.445+0000 7f9d4b7fe640 1 -- 172.21.15.7:0/1857877829 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9d54043070 con 0x7f9d4c003b40 2024-04-25T10:04:17.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.446+0000 7f9d4b7fe640 1 --2- 172.21.15.7:0/1857877829 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9d5006b4d0 0x7f9d5006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.446+0000 7f9d4b7fe640 1 -- 172.21.15.7:0/1857877829 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6331+0+0 (secure 0 0 0) 0x7f9d540aab40 con 0x7f9d4c003b40 2024-04-25T10:04:17.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.446+0000 7f9d627fc640 1 --2- 172.21.15.7:0/1857877829 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9d5006b4d0 0x7f9d5006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.446+0000 7f9d627fc640 1 --2- 172.21.15.7:0/1857877829 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9d5006b4d0 0x7f9d5006d990 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f9d58007fd0 tx=0x7f9d58009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.450+0000 7f9d4b7fe640 1 -- 172.21.15.7:0/1857877829 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9d54079100 con 0x7f9d4c003b40 2024-04-25T10:04:17.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.632+0000 7f9d697b7640 1 -- 172.21.15.7:0/1857877829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d640d1620 con 0x7f9d4c003b40 2024-04-25T10:04:17.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.633+0000 7f9d4b7fe640 1 -- 172.21.15.7:0/1857877829 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+17138 (secure 0 0 0) 0x7f9d5407d1a0 con 0x7f9d4c003b40 2024-04-25T10:04:17.638 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:17.639 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":107,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:04:15.097552+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:02:48.213751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T10:02:48.916114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.9","mappings":[{"from":1,"to":7}]},{"pgid":"16.2f","mappings":[{"from":5,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6837/1214875974":"2024-04-26T10:04:15.097519+0000","172.21.15.7:6835/1214875974":"2024-04-26T10:04:15.097519+0000","172.21.15.7:6837/900729992":"2024-04-26T10:03:38.723704+0000","172.21.15.7:6835/900729992":"2024-04-26T10:03:38.723704+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:17.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.635+0000 7f9d697b7640 1 -- 172.21.15.7:0/1857877829 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9d5006b4d0 msgr2=0x7f9d5006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.635+0000 7f9d697b7640 1 --2- 172.21.15.7:0/1857877829 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9d5006b4d0 0x7f9d5006d990 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f9d58007fd0 tx=0x7f9d58009040 comp rx=0 tx=0).stop 2024-04-25T10:04:17.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.635+0000 7f9d697b7640 1 -- 172.21.15.7:0/1857877829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d4c003b40 msgr2=0x7f9d640c9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.635+0000 7f9d697b7640 1 --2- 172.21.15.7:0/1857877829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d4c003b40 0x7f9d640c9590 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009d80 tx=0x7f9d54004730 comp rx=0 tx=0).stop 2024-04-25T10:04:17.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.635+0000 7f9d697b7640 1 -- 172.21.15.7:0/1857877829 shutdown_connections 2024-04-25T10:04:17.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.635+0000 7f9d697b7640 1 --2- 172.21.15.7:0/1857877829 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9d5006b4d0 0x7f9d5006d990 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.635+0000 7f9d697b7640 1 --2- 172.21.15.7:0/1857877829 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d640cc6c0 0x7f9d640ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.635+0000 7f9d697b7640 1 --2- 172.21.15.7:0/1857877829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d64158430 0x7f9d641588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.635+0000 7f9d697b7640 1 --2- 172.21.15.7:0/1857877829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d4c003b40 0x7f9d640c9590 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.635+0000 7f9d697b7640 1 -- 172.21.15.7:0/1857877829 >> 172.21.15.7:0/1857877829 conn(0x7f9d640d07b0 msgr2=0x7f9d640b8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:17.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.635+0000 7f9d697b7640 1 -- 172.21.15.7:0/1857877829 shutdown_connections 2024-04-25T10:04:17.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.635+0000 7f9d697b7640 1 -- 172.21.15.7:0/1857877829 wait complete. 2024-04-25T10:04:17.651 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T10:04:17.651 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:04:17.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.747+0000 7fc3ae23f640 1 Processor -- start 2024-04-25T10:04:17.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.747+0000 7fc3ae23f640 1 -- start start 2024-04-25T10:04:17.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.747+0000 7fc3ae23f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc3a80d2ca0 0x7fc3a80d30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.747+0000 7fc3ae23f640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a815e8a0 con 0x7fc3a815da60 2024-04-25T10:04:17.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.747+0000 7fc3ae23f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a815eb80 con 0x7fc3a80d0aa0 2024-04-25T10:04:17.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.747+0000 7fc3ae23f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a815ee60 con 0x7fc3a80d2ca0 2024-04-25T10:04:17.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.748+0000 7fc3a77fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc3a815da60 0x7fc3a815de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:41214/0 (socket says 172.21.15.7:41214) 2024-04-25T10:04:17.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.748+0000 7fc3a77fe640 1 -- 172.21.15.7:0/2903314336 learned_addr learned my addr 172.21.15.7:0/2903314336 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:17.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.748+0000 7fc3a7fff640 1 --2- 172.21.15.7:0/2903314336 >> v2:172.21.15.55:3300/0 conn(0x7fc3a80d2ca0 0x7fc3a80d30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.748+0000 7fc3a67fc640 1 -- 172.21.15.7:0/2903314336 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1161938682 0 0) 0x7fc3a815e8a0 con 0x7fc3a815da60 2024-04-25T10:04:17.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.748+0000 7fc3a67fc640 1 -- 172.21.15.7:0/2903314336 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc394003520 con 0x7fc3a815da60 2024-04-25T10:04:17.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.748+0000 7fc3a67fc640 1 -- 172.21.15.7:0/2903314336 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3093909969 0 0) 0x7fc394003520 con 0x7fc3a815da60 2024-04-25T10:04:17.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.748+0000 7fc3a7fff640 1 -- 172.21.15.7:0/2903314336 >> v1:172.21.15.55:6789/0 conn(0x7fc3a80d0aa0 legacy=0x7fc3a8161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.748+0000 7fc3a7fff640 1 -- 172.21.15.7:0/2903314336 >> v1:172.21.15.7:6789/0 conn(0x7fc3a815da60 legacy=0x7fc3a815de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.748+0000 7fc3a7fff640 1 -- 172.21.15.7:0/2903314336 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a8161850 con 0x7fc3a80d2ca0 2024-04-25T10:04:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.749+0000 7fc3a7fff640 1 --2- 172.21.15.7:0/2903314336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3a80d2ca0 0x7fc3a80d30b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0009d90 tx=0x7fc3a002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf737ac6ef382418 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.749+0000 7fc3a67fc640 1 -- 172.21.15.7:0/2903314336 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc398001670 con 0x7fc3a80d2ca0 2024-04-25T10:04:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.749+0000 7fc3a67fc640 1 -- 172.21.15.7:0/2903314336 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a0007540 con 0x7fc3a80d2ca0 2024-04-25T10:04:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.749+0000 7fc3a67fc640 1 -- 172.21.15.7:0/2903314336 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a00078f0 con 0x7fc3a80d2ca0 2024-04-25T10:04:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.750+0000 7fc3ae23f640 1 -- 172.21.15.7:0/2903314336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3a80d2ca0 msgr2=0x7fc3a80d30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.750+0000 7fc3ae23f640 1 --2- 172.21.15.7:0/2903314336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3a80d2ca0 0x7fc3a80d30b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0009d90 tx=0x7fc3a002a5f0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.750+0000 7fc3ae23f640 1 -- 172.21.15.7:0/2903314336 shutdown_connections 2024-04-25T10:04:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.750+0000 7fc3ae23f640 1 --2- 172.21.15.7:0/2903314336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3a80d2ca0 0x7fc3a80d30b0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.750+0000 7fc3ae23f640 1 -- 172.21.15.7:0/2903314336 >> 172.21.15.7:0/2903314336 conn(0x7fc3a806bfe0 msgr2=0x7fc3a806c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.750+0000 7fc3ae23f640 1 -- 172.21.15.7:0/2903314336 shutdown_connections 2024-04-25T10:04:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.750+0000 7fc3ae23f640 1 -- 172.21.15.7:0/2903314336 wait complete. 2024-04-25T10:04:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.751+0000 7fc3ae23f640 1 Processor -- start 2024-04-25T10:04:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.751+0000 7fc3ae23f640 1 -- start start 2024-04-25T10:04:17.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.752+0000 7fc3ae23f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3a80d0aa0 0x7fc3a80cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.752+0000 7fc3ae23f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3a80d2ca0 0x7fc3a80aabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.752+0000 7fc3ae23f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3a815da60 0x7fc3a80d3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.752+0000 7fc3ae23f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a8162480 con 0x7fc3a80d0aa0 2024-04-25T10:04:17.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.752+0000 7fc3ae23f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a80ce520 con 0x7fc3a80d2ca0 2024-04-25T10:04:17.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.752+0000 7fc3ae23f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a80ccb50 con 0x7fc3a815da60 2024-04-25T10:04:17.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.752+0000 7fc3a77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3a80d0aa0 0x7fc3a80cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.752+0000 7fc3a77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3a80d0aa0 0x7fc3a80cdbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36486/0 (socket says 172.21.15.7:36486) 2024-04-25T10:04:17.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.752+0000 7fc3a77fe640 1 -- 172.21.15.7:0/471319169 learned_addr learned my addr 172.21.15.7:0/471319169 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:17.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.752+0000 7fc3a7fff640 1 --2- 172.21.15.7:0/471319169 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3a815da60 0x7fc3a80d3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.752+0000 7fc3a6ffd640 1 --2- 172.21.15.7:0/471319169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3a80d2ca0 0x7fc3a80aabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.752+0000 7fc3a77fe640 1 -- 172.21.15.7:0/471319169 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3a815da60 msgr2=0x7fc3a80d3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.752+0000 7fc3a77fe640 1 --2- 172.21.15.7:0/471319169 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3a815da60 0x7fc3a80d3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.752+0000 7fc3a77fe640 1 -- 172.21.15.7:0/471319169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3a80d2ca0 msgr2=0x7fc3a80aabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.752+0000 7fc3a77fe640 1 --2- 172.21.15.7:0/471319169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3a80d2ca0 0x7fc3a80aabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.752+0000 7fc3a77fe640 1 -- 172.21.15.7:0/471319169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a80cce30 con 0x7fc3a80d0aa0 2024-04-25T10:04:17.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.752+0000 7fc3a6ffd640 1 --2- 172.21.15.7:0/471319169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3a80d2ca0 0x7fc3a80aabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:17.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.752+0000 7fc3a77fe640 1 --2- 172.21.15.7:0/471319169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3a80d0aa0 0x7fc3a80cdbf0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fc39800c580 tx=0x7fc39800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.752+0000 7fc39ffff640 1 -- 172.21.15.7:0/471319169 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc398017070 con 0x7fc3a80d0aa0 2024-04-25T10:04:17.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.753+0000 7fc39ffff640 1 -- 172.21.15.7:0/471319169 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc398005ce0 con 0x7fc3a80d0aa0 2024-04-25T10:04:17.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.753+0000 7fc3ae23f640 1 -- 172.21.15.7:0/471319169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a80cd110 con 0x7fc3a80d0aa0 2024-04-25T10:04:17.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.753+0000 7fc39ffff640 1 -- 172.21.15.7:0/471319169 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc398007330 con 0x7fc3a80d0aa0 2024-04-25T10:04:17.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.753+0000 7fc3ae23f640 1 -- 172.21.15.7:0/471319169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a80cd6d0 con 0x7fc3a80d0aa0 2024-04-25T10:04:17.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.754+0000 7fc3ae23f640 1 -- 172.21.15.7:0/471319169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a80cd8d0 con 0x7fc3a80d0aa0 2024-04-25T10:04:17.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.754+0000 7fc39ffff640 1 -- 172.21.15.7:0/471319169 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc39801a070 con 0x7fc3a80d0aa0 2024-04-25T10:04:17.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.754+0000 7fc39ffff640 1 --2- 172.21.15.7:0/471319169 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc38806b4d0 0x7fc38806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.755+0000 7fc39ffff640 1 -- 172.21.15.7:0/471319169 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6331+0+0 (secure 0 0 0) 0x7fc398089aa0 con 0x7fc3a80d0aa0 2024-04-25T10:04:17.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.755+0000 7fc3a6ffd640 1 --2- 172.21.15.7:0/471319169 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc38806b4d0 0x7fc38806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.755+0000 7fc3a6ffd640 1 --2- 172.21.15.7:0/471319169 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc38806b4d0 0x7fc38806d990 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc3a80d01d0 tx=0x7fc390009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.759+0000 7fc39ffff640 1 -- 172.21.15.7:0/471319169 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc3a80cd8d0 con 0x7fc3a80d0aa0 2024-04-25T10:04:17.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.974+0000 7fc3ae23f640 1 -- 172.21.15.7:0/471319169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3a8068fd0 con 0x7fc3a80d0aa0 2024-04-25T10:04:17.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.975+0000 7fc39ffff640 1 -- 172.21.15.7:0/471319169 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4928 (secure 0 0 0) 0x7fc398058620 con 0x7fc3a80d0aa0 2024-04-25T10:04:17.980 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:17.980 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":81,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6617,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3278722694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3278722694},{"type":"v1","addr":"172.21.15.55:6835","nonce":3278722694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":7435,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3598653097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3598653097},{"type":"v1","addr":"172.21.15.55:6834","nonce":3598653097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":8361,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3628875229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3628875229},{"type":"v1","addr":"172.21.15.7:6836","nonce":3628875229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":8883,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1325218305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1325218305},{"type":"v1","addr":"172.21.15.7:6837","nonce":1325218305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":80,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:02:49.944298+0000","modified":"2024-04-25T10:04:15.097532+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T10:04:17.981 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 81 2024-04-25T10:04:17.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.977+0000 7fc3ae23f640 1 -- 172.21.15.7:0/471319169 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc38806b4d0 msgr2=0x7fc38806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.977+0000 7fc3ae23f640 1 --2- 172.21.15.7:0/471319169 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc38806b4d0 0x7fc38806d990 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc3a80d01d0 tx=0x7fc390009040 comp rx=0 tx=0).stop 2024-04-25T10:04:17.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.977+0000 7fc3ae23f640 1 -- 172.21.15.7:0/471319169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3a80d0aa0 msgr2=0x7fc3a80cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.977+0000 7fc3ae23f640 1 --2- 172.21.15.7:0/471319169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3a80d0aa0 0x7fc3a80cdbf0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fc39800c580 tx=0x7fc39800ca40 comp rx=0 tx=0).stop 2024-04-25T10:04:17.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.977+0000 7fc3ae23f640 1 -- 172.21.15.7:0/471319169 shutdown_connections 2024-04-25T10:04:17.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.977+0000 7fc3ae23f640 1 --2- 172.21.15.7:0/471319169 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc38806b4d0 0x7fc38806d990 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.977+0000 7fc3ae23f640 1 --2- 172.21.15.7:0/471319169 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3a815da60 0x7fc3a80d3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.977+0000 7fc3ae23f640 1 --2- 172.21.15.7:0/471319169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3a80d2ca0 0x7fc3a80aabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.977+0000 7fc3ae23f640 1 --2- 172.21.15.7:0/471319169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3a80d0aa0 0x7fc3a80cdbf0 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.977+0000 7fc3ae23f640 1 -- 172.21.15.7:0/471319169 >> 172.21.15.7:0/471319169 conn(0x7fc3a806bfe0 msgr2=0x7fc3a806c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:17.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.977+0000 7fc3ae23f640 1 -- 172.21.15.7:0/471319169 shutdown_connections 2024-04-25T10:04:17.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:17.977+0000 7fc3ae23f640 1 -- 172.21.15.7:0/471319169 wait complete. 2024-04-25T10:04:17.993 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:04:18.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.089+0000 7f74561c8640 1 Processor -- start 2024-04-25T10:04:18.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.089+0000 7f74561c8640 1 -- start start 2024-04-25T10:04:18.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.089+0000 7f74561c8640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f745015db00 0x7f74500d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.089+0000 7f74561c8640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74500b53b0 0x7f74500d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.089+0000 7f74561c8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f74500ce2b0 0x7f7450161670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.089+0000 7f74561c8640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74500d1e80 con 0x7f745015db00 2024-04-25T10:04:18.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.089+0000 7f74561c8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74500b5930 con 0x7f74500ce2b0 2024-04-25T10:04:18.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.089+0000 7f74561c8640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74500b5c10 con 0x7f74500b53b0 2024-04-25T10:04:18.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.090+0000 7f744f7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f745015db00 0x7f74500d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.090+0000 7f744f7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f745015db00 0x7f74500d0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36498/0 (socket says 172.21.15.7:36498) 2024-04-25T10:04:18.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.090+0000 7f744f7fe640 1 -- 172.21.15.7:0/1189706615 learned_addr learned my addr 172.21.15.7:0/1189706615 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:18.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.090+0000 7f744ffff640 1 --2- 172.21.15.7:0/1189706615 >> v2:172.21.15.55:3300/0 conn(0x7f74500ce2b0 0x7f7450161670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.090+0000 7f744effd640 1 --2- 172.21.15.7:0/1189706615 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74500b53b0 0x7f74500d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.090+0000 7f744f7fe640 1 -- 172.21.15.7:0/1189706615 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74500b53b0 msgr2=0x7f74500d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:18.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.090+0000 7f744f7fe640 1 --2- 172.21.15.7:0/1189706615 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74500b53b0 0x7f74500d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.090+0000 7f744f7fe640 1 -- 172.21.15.7:0/1189706615 >> v2:172.21.15.55:3300/0 conn(0x7f74500ce2b0 msgr2=0x7f7450161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:18.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.090+0000 7f744f7fe640 1 --2- 172.21.15.7:0/1189706615 >> v2:172.21.15.55:3300/0 conn(0x7f74500ce2b0 0x7f7450161670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.090+0000 7f744f7fe640 1 -- 172.21.15.7:0/1189706615 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74500b5ef0 con 0x7f745015db00 2024-04-25T10:04:18.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.091+0000 7f744f7fe640 1 --2- 172.21.15.7:0/1189706615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f745015db00 0x7f74500d0340 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f74500ce010 tx=0x7f744002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eded9e9f5ef238d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.091+0000 7f744e7fc640 1 -- 172.21.15.7:0/1189706615 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7440037070 con 0x7f745015db00 2024-04-25T10:04:18.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.091+0000 7f744e7fc640 1 -- 172.21.15.7:0/1189706615 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7440032440 con 0x7f745015db00 2024-04-25T10:04:18.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.091+0000 7f744e7fc640 1 -- 172.21.15.7:0/1189706615 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7440032810 con 0x7f745015db00 2024-04-25T10:04:18.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.091+0000 7f74561c8640 1 -- 172.21.15.7:0/1189706615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f745015db00 msgr2=0x7f74500d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.091+0000 7f74561c8640 1 --2- 172.21.15.7:0/1189706615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f745015db00 0x7f74500d0340 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f74500ce010 tx=0x7f744002a1e0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.091+0000 7f74561c8640 1 -- 172.21.15.7:0/1189706615 shutdown_connections 2024-04-25T10:04:18.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.091+0000 7f74561c8640 1 --2- 172.21.15.7:0/1189706615 >> v2:172.21.15.55:3300/0 conn(0x7f74500ce2b0 0x7f7450161670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.091+0000 7f74561c8640 1 --2- 172.21.15.7:0/1189706615 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74500b53b0 0x7f74500d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.091+0000 7f74561c8640 1 --2- 172.21.15.7:0/1189706615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f745015db00 0x7f74500d0340 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.091+0000 7f74561c8640 1 -- 172.21.15.7:0/1189706615 >> 172.21.15.7:0/1189706615 conn(0x7f7450072290 msgr2=0x7f74500726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:18.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.091+0000 7f74561c8640 1 -- 172.21.15.7:0/1189706615 shutdown_connections 2024-04-25T10:04:18.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.091+0000 7f74561c8640 1 -- 172.21.15.7:0/1189706615 wait complete. 2024-04-25T10:04:18.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.093+0000 7f74561c8640 1 Processor -- start 2024-04-25T10:04:18.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.093+0000 7f74561c8640 1 -- start start 2024-04-25T10:04:18.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.093+0000 7f74561c8640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74500b53b0 0x7f745015a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.093+0000 7f74561c8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74500ce2b0 0x7f745015b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.093+0000 7f74561c8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f745015db00 0x7f745015b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.093+0000 7f74561c8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74500d3660 con 0x7f745015db00 2024-04-25T10:04:18.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.093+0000 7f74561c8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74500b61d0 con 0x7f74500ce2b0 2024-04-25T10:04:18.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.093+0000 7f74561c8640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74500b6c10 con 0x7f74500b53b0 2024-04-25T10:04:18.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.094+0000 7f744ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f745015db00 0x7f745015b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.094+0000 7f744ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f745015db00 0x7f745015b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36506/0 (socket says 172.21.15.7:36506) 2024-04-25T10:04:18.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.094+0000 7f744ffff640 1 -- 172.21.15.7:0/1740659015 learned_addr learned my addr 172.21.15.7:0/1740659015 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:18.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.094+0000 7f744effd640 1 --2- 172.21.15.7:0/1740659015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74500ce2b0 0x7f745015b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.094+0000 7f744f7fe640 1 --2- 172.21.15.7:0/1740659015 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74500b53b0 0x7f745015a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.094+0000 7f744ffff640 1 -- 172.21.15.7:0/1740659015 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74500b53b0 msgr2=0x7f745015a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.094+0000 7f744ffff640 1 --2- 172.21.15.7:0/1740659015 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74500b53b0 0x7f745015a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.094+0000 7f744ffff640 1 -- 172.21.15.7:0/1740659015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74500ce2b0 msgr2=0x7f745015b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.094+0000 7f744ffff640 1 --2- 172.21.15.7:0/1740659015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74500ce2b0 0x7f745015b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.094+0000 7f744ffff640 1 -- 172.21.15.7:0/1740659015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745015aab0 con 0x7f745015db00 2024-04-25T10:04:18.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.094+0000 7f744ffff640 1 --2- 172.21.15.7:0/1740659015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f745015db00 0x7f745015b730 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f744800efc0 tx=0x7f744800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.094+0000 7f7437fff640 1 -- 172.21.15.7:0/1740659015 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7448018020 con 0x7f745015db00 2024-04-25T10:04:18.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.094+0000 7f7437fff640 1 -- 172.21.15.7:0/1740659015 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7448014480 con 0x7f745015db00 2024-04-25T10:04:18.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.094+0000 7f74561c8640 1 -- 172.21.15.7:0/1740659015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f745015ad90 con 0x7f745015db00 2024-04-25T10:04:18.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.094+0000 7f7437fff640 1 -- 172.21.15.7:0/1740659015 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7448014870 con 0x7f745015db00 2024-04-25T10:04:18.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.094+0000 7f74561c8640 1 -- 172.21.15.7:0/1740659015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74500cace0 con 0x7f745015db00 2024-04-25T10:04:18.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.095+0000 7f74561c8640 1 -- 172.21.15.7:0/1740659015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7450068fd0 con 0x7f745015db00 2024-04-25T10:04:18.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.096+0000 7f7437fff640 1 -- 172.21.15.7:0/1740659015 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7448005d10 con 0x7f745015db00 2024-04-25T10:04:18.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.096+0000 7f7437fff640 1 --2- 172.21.15.7:0/1740659015 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f743c06b4d0 0x7f743c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.096+0000 7f744f7fe640 1 --2- 172.21.15.7:0/1740659015 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f743c06b4d0 0x7f743c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.097+0000 7f7437fff640 1 -- 172.21.15.7:0/1740659015 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6331+0+0 (secure 0 0 0) 0x7f744808aec0 con 0x7f745015db00 2024-04-25T10:04:18.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.097+0000 7f744f7fe640 1 --2- 172.21.15.7:0/1740659015 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f743c06b4d0 0x7f743c06d990 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f7440034000 tx=0x7f744002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.101+0000 7f7437fff640 1 -- 172.21.15.7:0/1740659015 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7448022070 con 0x7f745015db00 2024-04-25T10:04:18.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.318+0000 7f74561c8640 1 -- 172.21.15.7:0/1740659015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74500d16b0 con 0x7f745015db00 2024-04-25T10:04:18.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.318+0000 7f7437fff640 1 -- 172.21.15.7:0/1740659015 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f7448010040 con 0x7f745015db00 2024-04-25T10:04:18.324 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:18.324 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":81,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6617,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3278722694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3278722694},{"type":"v1","addr":"172.21.15.55:6835","nonce":3278722694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":7435,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3598653097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3598653097},{"type":"v1","addr":"172.21.15.55:6834","nonce":3598653097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":8361,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3628875229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3628875229},{"type":"v1","addr":"172.21.15.7:6836","nonce":3628875229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":8883,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1325218305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1325218305},{"type":"v1","addr":"172.21.15.7:6837","nonce":1325218305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":80,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:02:49.944298+0000","modified":"2024-04-25T10:04:15.097532+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T10:04:18.324 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 81 2024-04-25T10:04:18.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.320+0000 7f74561c8640 1 -- 172.21.15.7:0/1740659015 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f743c06b4d0 msgr2=0x7f743c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.320+0000 7f74561c8640 1 --2- 172.21.15.7:0/1740659015 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f743c06b4d0 0x7f743c06d990 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f7440034000 tx=0x7f744002e000 comp rx=0 tx=0).stop 2024-04-25T10:04:18.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.320+0000 7f74561c8640 1 -- 172.21.15.7:0/1740659015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f745015db00 msgr2=0x7f745015b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.320+0000 7f74561c8640 1 --2- 172.21.15.7:0/1740659015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f745015db00 0x7f745015b730 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f744800efc0 tx=0x7f744800c490 comp rx=0 tx=0).stop 2024-04-25T10:04:18.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.320+0000 7f74561c8640 1 -- 172.21.15.7:0/1740659015 shutdown_connections 2024-04-25T10:04:18.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.320+0000 7f74561c8640 1 --2- 172.21.15.7:0/1740659015 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f743c06b4d0 0x7f743c06d990 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.320+0000 7f74561c8640 1 --2- 172.21.15.7:0/1740659015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f745015db00 0x7f745015b730 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.320+0000 7f74561c8640 1 --2- 172.21.15.7:0/1740659015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74500ce2b0 0x7f745015b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.320+0000 7f74561c8640 1 --2- 172.21.15.7:0/1740659015 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74500b53b0 0x7f745015a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.320+0000 7f74561c8640 1 -- 172.21.15.7:0/1740659015 >> 172.21.15.7:0/1740659015 conn(0x7f7450072290 msgr2=0x7f74500c7460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:18.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.320+0000 7f74561c8640 1 -- 172.21.15.7:0/1740659015 shutdown_connections 2024-04-25T10:04:18.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.320+0000 7f74561c8640 1 -- 172.21.15.7:0/1740659015 wait complete. 2024-04-25T10:04:18.337 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:18.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.432+0000 7fbdbbf5c640 1 Processor -- start 2024-04-25T10:04:18.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.433+0000 7fbdbbf5c640 1 -- start start 2024-04-25T10:04:18.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.434+0000 7fbdbbf5c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbdb40d0a50 0x7fbdb40d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.434+0000 7fbdbbf5c640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdb40d1e80 con 0x7fbdb40b53b0 2024-04-25T10:04:18.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.434+0000 7fbdbbf5c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdb40b5930 con 0x7fbdb415db00 2024-04-25T10:04:18.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.434+0000 7fbdbbf5c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb40b5c10 con 0x7fbdb40d0a50 2024-04-25T10:04:18.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.434+0000 7fbdba4f9640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbdb40b53b0 0x7fbdb40d2870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:41226/0 (socket says 172.21.15.7:41226) 2024-04-25T10:04:18.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.434+0000 7fbdba4f9640 1 -- 172.21.15.7:0/2719199565 learned_addr learned my addr 172.21.15.7:0/2719199565 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:18.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.434+0000 7fbdb94f7640 1 --2- 172.21.15.7:0/2719199565 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbdb40d0a50 0x7fbdb40d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.434+0000 7fbdb8cf6640 1 -- 172.21.15.7:0/2719199565 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4096933253 0 0) 0x7fbdb40d1e80 con 0x7fbdb40b53b0 2024-04-25T10:04:18.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.434+0000 7fbdb8cf6640 1 -- 172.21.15.7:0/2719199565 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd9c003520 con 0x7fbdb40b53b0 2024-04-25T10:04:18.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.434+0000 7fbdb8cf6640 1 -- 172.21.15.7:0/2719199565 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1907555294 0 0) 0x7fbd9c003520 con 0x7fbdb40b53b0 2024-04-25T10:04:18.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.434+0000 7fbdb8cf6640 1 -- 172.21.15.7:0/2719199565 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbdb40d0a50 msgr2=0x7fbdb40d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:18.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.434+0000 7fbdb8cf6640 1 --2- 172.21.15.7:0/2719199565 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbdb40d0a50 0x7fbdb40d2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.434+0000 7fbdb8cf6640 1 -- 172.21.15.7:0/2719199565 >> v1:172.21.15.55:6789/0 conn(0x7fbdb415db00 legacy=0x7fbdb40d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.434+0000 7fbdb8cf6640 1 -- 172.21.15.7:0/2719199565 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb40b5ef0 con 0x7fbdb40b53b0 2024-04-25T10:04:18.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.434+0000 7fbdb8cf6640 1 -- 172.21.15.7:0/2719199565 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fbda40019f0 con 0x7fbdb40b53b0 2024-04-25T10:04:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.434+0000 7fbdb8cf6640 1 -- 172.21.15.7:0/2719199565 >> v1:172.21.15.7:6789/0 conn(0x7fbdb40b53b0 legacy=0x7fbdb40d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.434+0000 7fbdb8cf6640 1 --2- 172.21.15.7:0/2719199565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd9c0039e0 0x7fbd9c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.434+0000 7fbdb8cf6640 1 --2- 172.21.15.7:0/2719199565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd9c004800 0x7fbd9c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.434+0000 7fbdb8cf6640 1 --2- 172.21.15.7:0/2719199565 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbdb40d0a50 0x7fbd9c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.434+0000 7fbdb8cf6640 1 -- 172.21.15.7:0/2719199565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb40b5c10 con 0x7fbd9c004800 2024-04-25T10:04:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.434+0000 7fbdb8cf6640 1 -- 172.21.15.7:0/2719199565 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c00baa0 con 0x7fbd9c0039e0 2024-04-25T10:04:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.434+0000 7fbdb8cf6640 1 -- 172.21.15.7:0/2719199565 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c00bca0 con 0x7fbdb40d0a50 2024-04-25T10:04:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.435+0000 7fbdb94f7640 1 --2- 172.21.15.7:0/2719199565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd9c004800 0x7fbd9c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.435+0000 7fbdb9cf8640 1 --2- 172.21.15.7:0/2719199565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd9c0039e0 0x7fbd9c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.435+0000 7fbdba4f9640 1 --2- 172.21.15.7:0/2719199565 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbdb40d0a50 0x7fbd9c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.435+0000 7fbdb94f7640 1 -- 172.21.15.7:0/2719199565 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbdb40d0a50 msgr2=0x7fbd9c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.435+0000 7fbdb94f7640 1 --2- 172.21.15.7:0/2719199565 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbdb40d0a50 0x7fbd9c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.435+0000 7fbdb94f7640 1 -- 172.21.15.7:0/2719199565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd9c0039e0 msgr2=0x7fbd9c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.435+0000 7fbdb94f7640 1 --2- 172.21.15.7:0/2719199565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd9c0039e0 0x7fbd9c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.435+0000 7fbdb94f7640 1 -- 172.21.15.7:0/2719199565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9c003520 con 0x7fbd9c004800 2024-04-25T10:04:18.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.435+0000 7fbdb9cf8640 1 --2- 172.21.15.7:0/2719199565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd9c0039e0 0x7fbd9c003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:18.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.435+0000 7fbdba4f9640 1 --2- 172.21.15.7:0/2719199565 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbdb40d0a50 0x7fbd9c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:18.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.436+0000 7fbdb94f7640 1 --2- 172.21.15.7:0/2719199565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd9c004800 0x7fbd9c004c80 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fbda8009a90 tx=0x7fbd9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c2f60196414061 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.436+0000 7fbdb8cf6640 1 -- 172.21.15.7:0/2719199565 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda8036070 con 0x7fbd9c004800 2024-04-25T10:04:18.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.436+0000 7fbdb8cf6640 1 -- 172.21.15.7:0/2719199565 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda8031400 con 0x7fbd9c004800 2024-04-25T10:04:18.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.436+0000 7fbdb8cf6640 1 -- 172.21.15.7:0/2719199565 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda8009690 con 0x7fbd9c004800 2024-04-25T10:04:18.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.436+0000 7fbdbbf5c640 1 -- 172.21.15.7:0/2719199565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd9c004800 msgr2=0x7fbd9c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.436+0000 7fbdbbf5c640 1 --2- 172.21.15.7:0/2719199565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd9c004800 0x7fbd9c004c80 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fbda8009a90 tx=0x7fbd9c005830 comp rx=0 tx=0).stop 2024-04-25T10:04:18.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.436+0000 7fbdba4f9640 1 -- 172.21.15.7:0/2719199565 reap_dead start 2024-04-25T10:04:18.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.436+0000 7fbdbbf5c640 1 -- 172.21.15.7:0/2719199565 shutdown_connections 2024-04-25T10:04:18.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.436+0000 7fbdbbf5c640 1 -- 172.21.15.7:0/2719199565 >> 172.21.15.7:0/2719199565 conn(0x7fbdb4072290 msgr2=0x7fbdb40726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:18.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.436+0000 7fbdbbf5c640 1 -- 172.21.15.7:0/2719199565 shutdown_connections 2024-04-25T10:04:18.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.436+0000 7fbdbbf5c640 1 -- 172.21.15.7:0/2719199565 wait complete. 2024-04-25T10:04:18.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.438+0000 7fbdbbf5c640 1 Processor -- start 2024-04-25T10:04:18.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.438+0000 7fbdbbf5c640 1 -- start start 2024-04-25T10:04:18.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.438+0000 7fbdbbf5c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd9c004800 0x7fbdb41528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.438+0000 7fbdbbf5c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdb40cc5f0 0x7fbdb41521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.438+0000 7fbdbbf5c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbdb41e7c50 0x7fbdb41602c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.438+0000 7fbdbbf5c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb40d3660 con 0x7fbd9c004800 2024-04-25T10:04:18.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.438+0000 7fbdbbf5c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb40b61d0 con 0x7fbdb40cc5f0 2024-04-25T10:04:18.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.438+0000 7fbdbbf5c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb40d2f80 con 0x7fbdb41e7c50 2024-04-25T10:04:18.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.438+0000 7fbdb9cf8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd9c004800 0x7fbdb41528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.438+0000 7fbdb9cf8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd9c004800 0x7fbdb41528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36528/0 (socket says 172.21.15.7:36528) 2024-04-25T10:04:18.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.438+0000 7fbdb9cf8640 1 -- 172.21.15.7:0/2437784665 learned_addr learned my addr 172.21.15.7:0/2437784665 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:18.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.439+0000 7fbdb94f7640 1 --2- 172.21.15.7:0/2437784665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdb40cc5f0 0x7fbdb41521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.439+0000 7fbdba4f9640 1 --2- 172.21.15.7:0/2437784665 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbdb41e7c50 0x7fbdb41602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.439+0000 7fbdb9cf8640 1 -- 172.21.15.7:0/2437784665 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbdb41e7c50 msgr2=0x7fbdb41602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.439+0000 7fbdb9cf8640 1 --2- 172.21.15.7:0/2437784665 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbdb41e7c50 0x7fbdb41602c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.439+0000 7fbdb9cf8640 1 -- 172.21.15.7:0/2437784665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdb40cc5f0 msgr2=0x7fbdb41521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.439+0000 7fbdb9cf8640 1 --2- 172.21.15.7:0/2437784665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdb40cc5f0 0x7fbdb41521d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.439+0000 7fbdb9cf8640 1 -- 172.21.15.7:0/2437784665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb41e6e90 con 0x7fbd9c004800 2024-04-25T10:04:18.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.439+0000 7fbdb94f7640 1 --2- 172.21.15.7:0/2437784665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdb40cc5f0 0x7fbdb41521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:18.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.439+0000 7fbdb9cf8640 1 --2- 172.21.15.7:0/2437784665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd9c004800 0x7fbdb41528d0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fbdac00e600 tx=0x7fbdac00eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.439+0000 7fbdb27fc640 1 -- 172.21.15.7:0/2437784665 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdac0052e0 con 0x7fbd9c004800 2024-04-25T10:04:18.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.439+0000 7fbdb27fc640 1 -- 172.21.15.7:0/2437784665 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdac018070 con 0x7fbd9c004800 2024-04-25T10:04:18.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.439+0000 7fbdbbf5c640 1 -- 172.21.15.7:0/2437784665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb41e7170 con 0x7fbd9c004800 2024-04-25T10:04:18.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.439+0000 7fbdb27fc640 1 -- 172.21.15.7:0/2437784665 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdac003810 con 0x7fbd9c004800 2024-04-25T10:04:18.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.439+0000 7fbdbbf5c640 1 -- 172.21.15.7:0/2437784665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdb40cca70 con 0x7fbd9c004800 2024-04-25T10:04:18.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.440+0000 7fbdbbf5c640 1 -- 172.21.15.7:0/2437784665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdb4068fd0 con 0x7fbd9c004800 2024-04-25T10:04:18.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.441+0000 7fbdb27fc640 1 -- 172.21.15.7:0/2437784665 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbdac0039b0 con 0x7fbd9c004800 2024-04-25T10:04:18.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.441+0000 7fbdb27fc640 1 --2- 172.21.15.7:0/2437784665 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbda006b4d0 0x7fbda006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.441+0000 7fbdb27fc640 1 -- 172.21.15.7:0/2437784665 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6331+0+0 (secure 0 0 0) 0x7fbdac08a1d0 con 0x7fbd9c004800 2024-04-25T10:04:18.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.441+0000 7fbdb94f7640 1 --2- 172.21.15.7:0/2437784665 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbda006b4d0 0x7fbda006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.442+0000 7fbdb94f7640 1 --2- 172.21.15.7:0/2437784665 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbda006b4d0 0x7fbda006d990 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fbda8033000 tx=0x7fbda8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.445+0000 7fbdb27fc640 1 -- 172.21.15.7:0/2437784665 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbdac058de0 con 0x7fbd9c004800 2024-04-25T10:04:18.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.629+0000 7fbdbbf5c640 1 -- 172.21.15.7:0/2437784665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbdb40ccd60 con 0x7fbd9c004800 2024-04-25T10:04:18.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.630+0000 7fbdb27fc640 1 -- 172.21.15.7:0/2437784665 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+17138 (secure 0 0 0) 0x7fbdac0586e0 con 0x7fbd9c004800 2024-04-25T10:04:18.635 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:18.635 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":107,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:04:15.097552+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:02:48.213751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T10:02:48.916114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.9","mappings":[{"from":1,"to":7}]},{"pgid":"16.2f","mappings":[{"from":5,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6837/1214875974":"2024-04-26T10:04:15.097519+0000","172.21.15.7:6835/1214875974":"2024-04-26T10:04:15.097519+0000","172.21.15.7:6837/900729992":"2024-04-26T10:03:38.723704+0000","172.21.15.7:6835/900729992":"2024-04-26T10:03:38.723704+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:18.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.632+0000 7fbdbbf5c640 1 -- 172.21.15.7:0/2437784665 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbda006b4d0 msgr2=0x7fbda006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.632+0000 7fbdbbf5c640 1 --2- 172.21.15.7:0/2437784665 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbda006b4d0 0x7fbda006d990 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fbda8033000 tx=0x7fbda8008030 comp rx=0 tx=0).stop 2024-04-25T10:04:18.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.632+0000 7fbdbbf5c640 1 -- 172.21.15.7:0/2437784665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd9c004800 msgr2=0x7fbdb41528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.632+0000 7fbdbbf5c640 1 --2- 172.21.15.7:0/2437784665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd9c004800 0x7fbdb41528d0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fbdac00e600 tx=0x7fbdac00eac0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.632+0000 7fbdbbf5c640 1 -- 172.21.15.7:0/2437784665 shutdown_connections 2024-04-25T10:04:18.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.632+0000 7fbdbbf5c640 1 --2- 172.21.15.7:0/2437784665 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbda006b4d0 0x7fbda006d990 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.632+0000 7fbdbbf5c640 1 --2- 172.21.15.7:0/2437784665 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbdb41e7c50 0x7fbdb41602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.632+0000 7fbdbbf5c640 1 --2- 172.21.15.7:0/2437784665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdb40cc5f0 0x7fbdb41521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.632+0000 7fbdbbf5c640 1 --2- 172.21.15.7:0/2437784665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd9c004800 0x7fbdb41528d0 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.632+0000 7fbdbbf5c640 1 -- 172.21.15.7:0/2437784665 >> 172.21.15.7:0/2437784665 conn(0x7fbdb4072290 msgr2=0x7fbdb40b8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:18.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.632+0000 7fbdbbf5c640 1 -- 172.21.15.7:0/2437784665 shutdown_connections 2024-04-25T10:04:18.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.632+0000 7fbdbbf5c640 1 -- 172.21.15.7:0/2437784665 wait complete. 2024-04-25T10:04:18.648 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T10:04:18.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.745+0000 7f5939c8f640 1 Processor -- start 2024-04-25T10:04:18.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.745+0000 7f5939c8f640 1 -- start start 2024-04-25T10:04:18.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.746+0000 7f5939c8f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59340b5e60 0x7f593406bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.746+0000 7f5939c8f640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f59340b6a40 0x7f593406c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.746+0000 7f5939c8f640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f593406ca30 con 0x7f593415dd00 2024-04-25T10:04:18.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.746+0000 7f5939c8f640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f593415e0e0 con 0x7f59340b6a40 2024-04-25T10:04:18.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.746+0000 7f5939c8f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593406cfe0 con 0x7f59340b5e60 2024-04-25T10:04:18.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.746+0000 7f5933fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f59340b6a40 0x7f593406c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.746+0000 7f59337fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f593415dd00 0x7f59340b5750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:41230/0 (socket says 172.21.15.7:41230) 2024-04-25T10:04:18.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.746+0000 7f59337fe640 1 -- 172.21.15.7:0/1978478526 learned_addr learned my addr 172.21.15.7:0/1978478526 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:18.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.746+0000 7f5933fff640 1 -- 172.21.15.7:0/1978478526 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59340b5e60 msgr2=0x7f593406bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:18.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.746+0000 7f5933fff640 1 --2- 172.21.15.7:0/1978478526 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59340b5e60 0x7f593406bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.746+0000 7f5933fff640 1 -- 172.21.15.7:0/1978478526 >> v1:172.21.15.7:6789/0 conn(0x7f593415dd00 legacy=0x7f59340b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.746+0000 7f5933fff640 1 -- 172.21.15.7:0/1978478526 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593406cd00 con 0x7f59340b6a40 2024-04-25T10:04:18.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.746+0000 7f59327fc640 1 -- 172.21.15.7:0/1978478526 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2327834106 0 0) 0x7f593406ca30 con 0x7f593415dd00 2024-04-25T10:04:18.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.747+0000 7f5933fff640 1 --2- 172.21.15.7:0/1978478526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59340b6a40 0x7f593406c4f0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f592c009d90 tx=0x7f592c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e693f4565cd9de8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.747+0000 7f59327fc640 1 -- 172.21.15.7:0/1978478526 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c007740 con 0x7f59340b6a40 2024-04-25T10:04:18.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.747+0000 7f59327fc640 1 -- 172.21.15.7:0/1978478526 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592c0078e0 con 0x7f59340b6a40 2024-04-25T10:04:18.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.747+0000 7f59327fc640 1 -- 172.21.15.7:0/1978478526 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c007cb0 con 0x7f59340b6a40 2024-04-25T10:04:18.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.748+0000 7f5939c8f640 1 -- 172.21.15.7:0/1978478526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59340b6a40 msgr2=0x7f593406c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.748+0000 7f5939c8f640 1 --2- 172.21.15.7:0/1978478526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59340b6a40 0x7f593406c4f0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f592c009d90 tx=0x7f592c02a6f0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.748+0000 7f5939c8f640 1 -- 172.21.15.7:0/1978478526 shutdown_connections 2024-04-25T10:04:18.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.748+0000 7f5939c8f640 1 --2- 172.21.15.7:0/1978478526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59340b6a40 0x7f593406c4f0 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.748+0000 7f5939c8f640 1 --2- 172.21.15.7:0/1978478526 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59340b5e60 0x7f593406bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.748+0000 7f5939c8f640 1 -- 172.21.15.7:0/1978478526 >> 172.21.15.7:0/1978478526 conn(0x7f59340d07b0 msgr2=0x7f59340d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:18.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.748+0000 7f5939c8f640 1 -- 172.21.15.7:0/1978478526 shutdown_connections 2024-04-25T10:04:18.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.748+0000 7f5939c8f640 1 -- 172.21.15.7:0/1978478526 wait complete. 2024-04-25T10:04:18.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.749+0000 7f5939c8f640 1 Processor -- start 2024-04-25T10:04:18.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.749+0000 7f5939c8f640 1 -- start start 2024-04-25T10:04:18.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.750+0000 7f5939c8f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59340b5e60 0x7f593415ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.750+0000 7f5939c8f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59340b6a40 0x7f5934160510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.750+0000 7f5939c8f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f593415dd00 0x7f5934160a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.750+0000 7f5939c8f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59340d2260 con 0x7f59340b6a40 2024-04-25T10:04:18.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.750+0000 7f5939c8f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59340d1f80 con 0x7f593415dd00 2024-04-25T10:04:18.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.750+0000 7f5939c8f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59340d2780 con 0x7f59340b5e60 2024-04-25T10:04:18.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.750+0000 7f5932ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59340b6a40 0x7f5934160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.750+0000 7f5932ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59340b6a40 0x7f5934160510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36548/0 (socket says 172.21.15.7:36548) 2024-04-25T10:04:18.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.750+0000 7f5932ffd640 1 -- 172.21.15.7:0/1728610891 learned_addr learned my addr 172.21.15.7:0/1728610891 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:18.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.750+0000 7f5933fff640 1 --2- 172.21.15.7:0/1728610891 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f593415dd00 0x7f5934160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.750+0000 7f59337fe640 1 --2- 172.21.15.7:0/1728610891 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59340b5e60 0x7f593415ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.750+0000 7f5932ffd640 1 -- 172.21.15.7:0/1728610891 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59340b5e60 msgr2=0x7f593415ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.750+0000 7f5932ffd640 1 --2- 172.21.15.7:0/1728610891 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59340b5e60 0x7f593415ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.750+0000 7f5932ffd640 1 -- 172.21.15.7:0/1728610891 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f593415dd00 msgr2=0x7f5934160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.750+0000 7f5932ffd640 1 --2- 172.21.15.7:0/1728610891 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f593415dd00 0x7f5934160a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.750+0000 7f5932ffd640 1 -- 172.21.15.7:0/1728610891 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59340c9690 con 0x7f59340b6a40 2024-04-25T10:04:18.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.750+0000 7f59337fe640 1 --2- 172.21.15.7:0/1728610891 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59340b5e60 0x7f593415ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:18.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.750+0000 7f5932ffd640 1 --2- 172.21.15.7:0/1728610891 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59340b6a40 0x7f5934160510 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f592800b4a0 tx=0x7f592800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.751+0000 7f591bfff640 1 -- 172.21.15.7:0/1728610891 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5928014070 con 0x7f59340b6a40 2024-04-25T10:04:18.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.751+0000 7f591bfff640 1 -- 172.21.15.7:0/1728610891 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5928010610 con 0x7f59340b6a40 2024-04-25T10:04:18.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.751+0000 7f5939c8f640 1 -- 172.21.15.7:0/1728610891 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59340c88f0 con 0x7f59340b6a40 2024-04-25T10:04:18.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.751+0000 7f591bfff640 1 -- 172.21.15.7:0/1728610891 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5928010a00 con 0x7f59340b6a40 2024-04-25T10:04:18.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.751+0000 7f5939c8f640 1 -- 172.21.15.7:0/1728610891 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59340c8eb0 con 0x7f59340b6a40 2024-04-25T10:04:18.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.752+0000 7f5939c8f640 1 -- 172.21.15.7:0/1728610891 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59340cc0e0 con 0x7f59340b6a40 2024-04-25T10:04:18.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.752+0000 7f591bfff640 1 -- 172.21.15.7:0/1728610891 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5928017070 con 0x7f59340b6a40 2024-04-25T10:04:18.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.752+0000 7f591bfff640 1 --2- 172.21.15.7:0/1728610891 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f592006b4d0 0x7f592006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.752+0000 7f591bfff640 1 -- 172.21.15.7:0/1728610891 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6331+0+0 (secure 0 0 0) 0x7f5928089e20 con 0x7f59340b6a40 2024-04-25T10:04:18.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.753+0000 7f59337fe640 1 --2- 172.21.15.7:0/1728610891 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f592006b4d0 0x7f592006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.753+0000 7f59337fe640 1 --2- 172.21.15.7:0/1728610891 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f592006b4d0 0x7f592006d990 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f5924000f60 tx=0x7f5924007ca0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.757+0000 7f591bfff640 1 -- 172.21.15.7:0/1728610891 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f59280583e0 con 0x7f59340b6a40 2024-04-25T10:04:18.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:18.977+0000 7f5939c8f640 1 -- 172.21.15.7:0/1728610891 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5934068fd0 con 0x7f59340b6a40 2024-04-25T10:04:19.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.136+0000 7f591bfff640 1 -- 172.21.15.7:0/1728610891 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v82) v1 ==== 161+0+0 (secure 0 0 0) 0x7f592805c480 con 0x7f59340b6a40 2024-04-25T10:04:19.141 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T10:04:19.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.138+0000 7f5939c8f640 1 -- 172.21.15.7:0/1728610891 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f592006b4d0 msgr2=0x7f592006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.138+0000 7f5939c8f640 1 --2- 172.21.15.7:0/1728610891 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f592006b4d0 0x7f592006d990 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f5924000f60 tx=0x7f5924007ca0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.138+0000 7f5939c8f640 1 -- 172.21.15.7:0/1728610891 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59340b6a40 msgr2=0x7f5934160510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.138+0000 7f5939c8f640 1 --2- 172.21.15.7:0/1728610891 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59340b6a40 0x7f5934160510 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f592800b4a0 tx=0x7f592800b960 comp rx=0 tx=0).stop 2024-04-25T10:04:19.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.138+0000 7f5939c8f640 1 -- 172.21.15.7:0/1728610891 shutdown_connections 2024-04-25T10:04:19.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.138+0000 7f5939c8f640 1 --2- 172.21.15.7:0/1728610891 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f592006b4d0 0x7f592006d990 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.138+0000 7f5939c8f640 1 --2- 172.21.15.7:0/1728610891 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f593415dd00 0x7f5934160a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.138+0000 7f5939c8f640 1 --2- 172.21.15.7:0/1728610891 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59340b6a40 0x7f5934160510 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.138+0000 7f5939c8f640 1 --2- 172.21.15.7:0/1728610891 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59340b5e60 0x7f593415ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.139+0000 7f5939c8f640 1 -- 172.21.15.7:0/1728610891 >> 172.21.15.7:0/1728610891 conn(0x7f59340d07b0 msgr2=0x7f59340d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:19.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.139+0000 7f5939c8f640 1 -- 172.21.15.7:0/1728610891 shutdown_connections 2024-04-25T10:04:19.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.139+0000 7f5939c8f640 1 -- 172.21.15.7:0/1728610891 wait complete. 2024-04-25T10:04:19.155 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T10:04:19.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.252+0000 7f2f235d5640 1 Processor -- start 2024-04-25T10:04:19.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.252+0000 7f2f235d5640 1 -- start start 2024-04-25T10:04:19.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.253+0000 7f2f235d5640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2f1c161200 0x7f2f1c0cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.253+0000 7f2f235d5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2f1c0d0a00 0x7f2f1c09a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.253+0000 7f2f235d5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f1c1615e0 con 0x7f2f1c09a7d0 2024-04-25T10:04:19.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.253+0000 7f2f235d5640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f1c06c9f0 con 0x7f2f1c161200 2024-04-25T10:04:19.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.253+0000 7f2f235d5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f1c06ccd0 con 0x7f2f1c0d0a00 2024-04-25T10:04:19.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.253+0000 7f2f21371640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2f1c161200 0x7f2f1c0cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.253+0000 7f2f21371640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2f1c161200 0x7f2f1c0cbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36550/0 (socket says 172.21.15.7:36550) 2024-04-25T10:04:19.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.253+0000 7f2f21371640 1 -- 172.21.15.7:0/1166387752 learned_addr learned my addr 172.21.15.7:0/1166387752 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:19.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.253+0000 7f2f20b70640 1 --2- 172.21.15.7:0/1166387752 >> v2:172.21.15.55:3300/0 conn(0x7f2f1c0d0a00 0x7f2f1c09a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.253+0000 7f2f21371640 1 -- 172.21.15.7:0/1166387752 >> v2:172.21.15.55:3300/0 conn(0x7f2f1c0d0a00 msgr2=0x7f2f1c09a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:19.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.253+0000 7f2f21371640 1 --2- 172.21.15.7:0/1166387752 >> v2:172.21.15.55:3300/0 conn(0x7f2f1c0d0a00 0x7f2f1c09a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.253+0000 7f2f21371640 1 -- 172.21.15.7:0/1166387752 >> v1:172.21.15.55:6789/0 conn(0x7f2f1c09a7d0 legacy=0x7f2f1c161830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.253+0000 7f2f21371640 1 -- 172.21.15.7:0/1166387752 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1c099a90 con 0x7f2f1c161200 2024-04-25T10:04:19.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.254+0000 7f2f21371640 1 --2- 172.21.15.7:0/1166387752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f1c161200 0x7f2f1c0cbd00 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0b7760 tx=0x7f2f1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551b5e059b079db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:19.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.254+0000 7f2f13fff640 1 -- 172.21.15.7:0/1166387752 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14037070 con 0x7f2f1c161200 2024-04-25T10:04:19.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.254+0000 7f2f13fff640 1 -- 172.21.15.7:0/1166387752 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f14032440 con 0x7f2f1c161200 2024-04-25T10:04:19.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.254+0000 7f2f13fff640 1 -- 172.21.15.7:0/1166387752 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14032810 con 0x7f2f1c161200 2024-04-25T10:04:19.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.255+0000 7f2f235d5640 1 -- 172.21.15.7:0/1166387752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f1c161200 msgr2=0x7f2f1c0cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.255+0000 7f2f235d5640 1 --2- 172.21.15.7:0/1166387752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f1c161200 0x7f2f1c0cbd00 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0b7760 tx=0x7f2f1402a270 comp rx=0 tx=0).stop 2024-04-25T10:04:19.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.255+0000 7f2f235d5640 1 -- 172.21.15.7:0/1166387752 shutdown_connections 2024-04-25T10:04:19.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.255+0000 7f2f235d5640 1 --2- 172.21.15.7:0/1166387752 >> v2:172.21.15.55:3300/0 conn(0x7f2f1c0d0a00 0x7f2f1c09a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.255+0000 7f2f235d5640 1 --2- 172.21.15.7:0/1166387752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f1c161200 0x7f2f1c0cbd00 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.255+0000 7f2f235d5640 1 -- 172.21.15.7:0/1166387752 >> 172.21.15.7:0/1166387752 conn(0x7f2f1c0b31a0 msgr2=0x7f2f1c0b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:19.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.255+0000 7f2f235d5640 1 -- 172.21.15.7:0/1166387752 shutdown_connections 2024-04-25T10:04:19.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.255+0000 7f2f235d5640 1 -- 172.21.15.7:0/1166387752 wait complete. 2024-04-25T10:04:19.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.256+0000 7f2f235d5640 1 Processor -- start 2024-04-25T10:04:19.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.256+0000 7f2f235d5640 1 -- start start 2024-04-25T10:04:19.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.257+0000 7f2f235d5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f1c09a7d0 0x7f2f1c0c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.257+0000 7f2f235d5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f1c0d0a00 0x7f2f1c1f68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.257+0000 7f2f235d5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f1c161200 0x7f2f1c1f6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.257+0000 7f2f235d5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c06c680 con 0x7f2f1c09a7d0 2024-04-25T10:04:19.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.257+0000 7f2f235d5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c0cc240 con 0x7f2f1c0d0a00 2024-04-25T10:04:19.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.257+0000 7f2f235d5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c06cfb0 con 0x7f2f1c161200 2024-04-25T10:04:19.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.257+0000 7f2f21371640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f1c09a7d0 0x7f2f1c0c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.257+0000 7f2f21371640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f1c09a7d0 0x7f2f1c0c6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36562/0 (socket says 172.21.15.7:36562) 2024-04-25T10:04:19.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.257+0000 7f2f21371640 1 -- 172.21.15.7:0/3528508627 learned_addr learned my addr 172.21.15.7:0/3528508627 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:19.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.257+0000 7f2f20b70640 1 --2- 172.21.15.7:0/3528508627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f1c0d0a00 0x7f2f1c1f68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.257+0000 7f2f21b72640 1 --2- 172.21.15.7:0/3528508627 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f1c161200 0x7f2f1c1f6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.257+0000 7f2f21371640 1 -- 172.21.15.7:0/3528508627 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f1c161200 msgr2=0x7f2f1c1f6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.257+0000 7f2f21371640 1 --2- 172.21.15.7:0/3528508627 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f1c161200 0x7f2f1c1f6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.257+0000 7f2f21371640 1 -- 172.21.15.7:0/3528508627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f1c0d0a00 msgr2=0x7f2f1c1f68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.257+0000 7f2f21371640 1 --2- 172.21.15.7:0/3528508627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f1c0d0a00 0x7f2f1c1f68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.257+0000 7f2f21371640 1 -- 172.21.15.7:0/3528508627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1c1f7640 con 0x7f2f1c09a7d0 2024-04-25T10:04:19.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.257+0000 7f2f21b72640 1 --2- 172.21.15.7:0/3528508627 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f1c161200 0x7f2f1c1f6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:19.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.257+0000 7f2f21371640 1 --2- 172.21.15.7:0/3528508627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f1c09a7d0 0x7f2f1c0c6a20 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f2f1402a2b0 tx=0x7f2f140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:19.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.258+0000 7f2f11ffb640 1 -- 172.21.15.7:0/3528508627 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14041030 con 0x7f2f1c09a7d0 2024-04-25T10:04:19.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.258+0000 7f2f11ffb640 1 -- 172.21.15.7:0/3528508627 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f14030440 con 0x7f2f1c09a7d0 2024-04-25T10:04:19.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.258+0000 7f2f235d5640 1 -- 172.21.15.7:0/3528508627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f1c1f7920 con 0x7f2f1c09a7d0 2024-04-25T10:04:19.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.258+0000 7f2f11ffb640 1 -- 172.21.15.7:0/3528508627 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14037040 con 0x7f2f1c09a7d0 2024-04-25T10:04:19.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.258+0000 7f2f235d5640 1 -- 172.21.15.7:0/3528508627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f1c1f7ee0 con 0x7f2f1c09a7d0 2024-04-25T10:04:19.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.259+0000 7f2f235d5640 1 -- 172.21.15.7:0/3528508627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f1c068f60 con 0x7f2f1c09a7d0 2024-04-25T10:04:19.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.259+0000 7f2f11ffb640 1 -- 172.21.15.7:0/3528508627 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2f14044070 con 0x7f2f1c09a7d0 2024-04-25T10:04:19.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.260+0000 7f2f11ffb640 1 --2- 172.21.15.7:0/3528508627 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2f0006b4d0 0x7f2f0006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.260+0000 7f2f11ffb640 1 -- 172.21.15.7:0/3528508627 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6331+0+0 (secure 0 0 0) 0x7f2f140aaab0 con 0x7f2f1c09a7d0 2024-04-25T10:04:19.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.260+0000 7f2f20b70640 1 --2- 172.21.15.7:0/3528508627 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2f0006b4d0 0x7f2f0006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.260+0000 7f2f20b70640 1 --2- 172.21.15.7:0/3528508627 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2f0006b4d0 0x7f2f0006d990 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0c7980 tx=0x7f2f0c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:19.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.264+0000 7f2f11ffb640 1 -- 172.21.15.7:0/3528508627 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2f14079870 con 0x7f2f1c09a7d0 2024-04-25T10:04:19.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:19.480+0000 7f2f235d5640 1 -- 172.21.15.7:0/3528508627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2f1c0c84b0 con 0x7f2f1c09a7d0 2024-04-25T10:04:20.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.155+0000 7f2f11ffb640 1 -- 172.21.15.7:0/3528508627 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v83) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2f14079170 con 0x7f2f1c09a7d0 2024-04-25T10:04:20.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.157+0000 7f2f235d5640 1 -- 172.21.15.7:0/3528508627 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2f0006b4d0 msgr2=0x7f2f0006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:20.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.157+0000 7f2f235d5640 1 --2- 172.21.15.7:0/3528508627 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2f0006b4d0 0x7f2f0006d990 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0c7980 tx=0x7f2f0c008040 comp rx=0 tx=0).stop 2024-04-25T10:04:20.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.158+0000 7f2f235d5640 1 -- 172.21.15.7:0/3528508627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f1c09a7d0 msgr2=0x7f2f1c0c6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:20.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.158+0000 7f2f235d5640 1 --2- 172.21.15.7:0/3528508627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f1c09a7d0 0x7f2f1c0c6a20 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f2f1402a2b0 tx=0x7f2f140046c0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.158+0000 7f2f235d5640 1 -- 172.21.15.7:0/3528508627 shutdown_connections 2024-04-25T10:04:20.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.158+0000 7f2f235d5640 1 --2- 172.21.15.7:0/3528508627 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2f0006b4d0 0x7f2f0006d990 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.158+0000 7f2f235d5640 1 --2- 172.21.15.7:0/3528508627 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f1c161200 0x7f2f1c1f6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.158+0000 7f2f235d5640 1 --2- 172.21.15.7:0/3528508627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f1c0d0a00 0x7f2f1c1f68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.158+0000 7f2f235d5640 1 --2- 172.21.15.7:0/3528508627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f1c09a7d0 0x7f2f1c0c6a20 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.158+0000 7f2f235d5640 1 -- 172.21.15.7:0/3528508627 >> 172.21.15.7:0/3528508627 conn(0x7f2f1c0b31a0 msgr2=0x7f2f1c06f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:20.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.158+0000 7f2f235d5640 1 -- 172.21.15.7:0/3528508627 shutdown_connections 2024-04-25T10:04:20.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.158+0000 7f2f235d5640 1 -- 172.21.15.7:0/3528508627 wait complete. 2024-04-25T10:04:20.176 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T10:04:20.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.283+0000 7f47c1ab3640 1 Processor -- start 2024-04-25T10:04:20.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.283+0000 7f47c1ab3640 1 -- start start 2024-04-25T10:04:20.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.284+0000 7f47c1ab3640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f47bc15b8c0 0x7f47bc0cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:20.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.284+0000 7f47c1ab3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47bc0cc250 0x7f47bc0d0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:20.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.284+0000 7f47c1ab3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f47bc0999f0 0x7f47bc099e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:20.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.284+0000 7f47c1ab3640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47bc09a3a0 con 0x7f47bc15b8c0 2024-04-25T10:04:20.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.284+0000 7f47c1ab3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47bc0d0670 con 0x7f47bc0999f0 2024-04-25T10:04:20.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.284+0000 7f47c1ab3640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc0cc730 con 0x7f47bc0cc250 2024-04-25T10:04:20.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.284+0000 7f47bb7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f47bc15b8c0 0x7f47bc0cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:20.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.284+0000 7f47bb7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f47bc15b8c0 0x7f47bc0cd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36984/0 (socket says 172.21.15.7:36984) 2024-04-25T10:04:20.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.284+0000 7f47bb7fe640 1 -- 172.21.15.7:0/2782033397 learned_addr learned my addr 172.21.15.7:0/2782033397 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:20.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.284+0000 7f47bbfff640 1 --2- 172.21.15.7:0/2782033397 >> v2:172.21.15.55:3300/0 conn(0x7f47bc0999f0 0x7f47bc099e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:20.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.284+0000 7f47baffd640 1 --2- 172.21.15.7:0/2782033397 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47bc0cc250 0x7f47bc0d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:20.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.284+0000 7f47bb7fe640 1 -- 172.21.15.7:0/2782033397 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47bc0cc250 msgr2=0x7f47bc0d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:20.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.284+0000 7f47bb7fe640 1 --2- 172.21.15.7:0/2782033397 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47bc0cc250 0x7f47bc0d0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.284+0000 7f47bb7fe640 1 -- 172.21.15.7:0/2782033397 >> v2:172.21.15.55:3300/0 conn(0x7f47bc0999f0 msgr2=0x7f47bc099e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:20.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.284+0000 7f47bb7fe640 1 --2- 172.21.15.7:0/2782033397 >> v2:172.21.15.55:3300/0 conn(0x7f47bc0999f0 0x7f47bc099e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.284+0000 7f47bb7fe640 1 -- 172.21.15.7:0/2782033397 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc0cca10 con 0x7f47bc15b8c0 2024-04-25T10:04:20.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.284+0000 7f47bbfff640 1 --2- 172.21.15.7:0/2782033397 >> v2:172.21.15.55:3300/0 conn(0x7f47bc0999f0 0x7f47bc099e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:20.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.285+0000 7f47bb7fe640 1 --2- 172.21.15.7:0/2782033397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47bc15b8c0 0x7f47bc0cd7d0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f47bc071d80 tx=0x7f47ac02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6121c9d25e40874 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:20.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.285+0000 7f47ba7fc640 1 -- 172.21.15.7:0/2782033397 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac037070 con 0x7f47bc15b8c0 2024-04-25T10:04:20.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.285+0000 7f47ba7fc640 1 -- 172.21.15.7:0/2782033397 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ac032440 con 0x7f47bc15b8c0 2024-04-25T10:04:20.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.285+0000 7f47ba7fc640 1 -- 172.21.15.7:0/2782033397 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac032810 con 0x7f47bc15b8c0 2024-04-25T10:04:20.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.286+0000 7f47c1ab3640 1 -- 172.21.15.7:0/2782033397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47bc15b8c0 msgr2=0x7f47bc0cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:20.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.286+0000 7f47c1ab3640 1 --2- 172.21.15.7:0/2782033397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47bc15b8c0 0x7f47bc0cd7d0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f47bc071d80 tx=0x7f47ac02a1e0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.286+0000 7f47c1ab3640 1 -- 172.21.15.7:0/2782033397 shutdown_connections 2024-04-25T10:04:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.286+0000 7f47c1ab3640 1 --2- 172.21.15.7:0/2782033397 >> v2:172.21.15.55:3300/0 conn(0x7f47bc0999f0 0x7f47bc099e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.286+0000 7f47c1ab3640 1 --2- 172.21.15.7:0/2782033397 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47bc0cc250 0x7f47bc0d0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.286+0000 7f47c1ab3640 1 --2- 172.21.15.7:0/2782033397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47bc15b8c0 0x7f47bc0cd7d0 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.286+0000 7f47c1ab3640 1 -- 172.21.15.7:0/2782033397 >> 172.21.15.7:0/2782033397 conn(0x7f47bc0b3130 msgr2=0x7f47bc0b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.286+0000 7f47c1ab3640 1 -- 172.21.15.7:0/2782033397 shutdown_connections 2024-04-25T10:04:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.286+0000 7f47c1ab3640 1 -- 172.21.15.7:0/2782033397 wait complete. 2024-04-25T10:04:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.287+0000 7f47c1ab3640 1 Processor -- start 2024-04-25T10:04:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.287+0000 7f47c1ab3640 1 -- start start 2024-04-25T10:04:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.288+0000 7f47c1ab3640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47bc0999f0 0x7f47bc159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.288+0000 7f47c1ab3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47bc0cc250 0x7f47bc0c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.288+0000 7f47c1ab3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47bc15b8c0 0x7f47bc0cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.288+0000 7f47c1ab3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc0cd2b0 con 0x7f47bc15b8c0 2024-04-25T10:04:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.288+0000 7f47c1ab3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc0ccfd0 con 0x7f47bc0cc250 2024-04-25T10:04:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.288+0000 7f47c1ab3640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc0cf480 con 0x7f47bc0999f0 2024-04-25T10:04:20.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.288+0000 7f47bbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47bc15b8c0 0x7f47bc0cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:20.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.288+0000 7f47bbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47bc15b8c0 0x7f47bc0cb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36992/0 (socket says 172.21.15.7:36992) 2024-04-25T10:04:20.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.288+0000 7f47bbfff640 1 -- 172.21.15.7:0/1688603204 learned_addr learned my addr 172.21.15.7:0/1688603204 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:20.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.288+0000 7f47bb7fe640 1 --2- 172.21.15.7:0/1688603204 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47bc0999f0 0x7f47bc159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:20.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.288+0000 7f47baffd640 1 --2- 172.21.15.7:0/1688603204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47bc0cc250 0x7f47bc0c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:20.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.289+0000 7f47bbfff640 1 -- 172.21.15.7:0/1688603204 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47bc0999f0 msgr2=0x7f47bc159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:20.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.289+0000 7f47bbfff640 1 --2- 172.21.15.7:0/1688603204 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47bc0999f0 0x7f47bc159310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.289+0000 7f47bbfff640 1 -- 172.21.15.7:0/1688603204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47bc0cc250 msgr2=0x7f47bc0c8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:20.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.289+0000 7f47bbfff640 1 --2- 172.21.15.7:0/1688603204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47bc0cc250 0x7f47bc0c8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.289+0000 7f47bbfff640 1 -- 172.21.15.7:0/1688603204 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc15d280 con 0x7f47bc15b8c0 2024-04-25T10:04:20.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.289+0000 7f47bbfff640 1 --2- 172.21.15.7:0/1688603204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47bc15b8c0 0x7f47bc0cb600 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f47b4007e70 tx=0x7f47b400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:20.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.289+0000 7f47a3fff640 1 -- 172.21.15.7:0/1688603204 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b401a070 con 0x7f47bc15b8c0 2024-04-25T10:04:20.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.289+0000 7f47a3fff640 1 -- 172.21.15.7:0/1688603204 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b4003bb0 con 0x7f47bc15b8c0 2024-04-25T10:04:20.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.289+0000 7f47c1ab3640 1 -- 172.21.15.7:0/1688603204 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47bc15d560 con 0x7f47bc15b8c0 2024-04-25T10:04:20.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.289+0000 7f47a3fff640 1 -- 172.21.15.7:0/1688603204 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b4004030 con 0x7f47bc15b8c0 2024-04-25T10:04:20.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.289+0000 7f47c1ab3640 1 -- 172.21.15.7:0/1688603204 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47bc15db20 con 0x7f47bc15b8c0 2024-04-25T10:04:20.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.290+0000 7f47c1ab3640 1 -- 172.21.15.7:0/1688603204 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47bc069040 con 0x7f47bc15b8c0 2024-04-25T10:04:20.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.291+0000 7f47a3fff640 1 -- 172.21.15.7:0/1688603204 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f47b401d070 con 0x7f47bc15b8c0 2024-04-25T10:04:20.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.291+0000 7f47a3fff640 1 --2- 172.21.15.7:0/1688603204 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f47a806b4d0 0x7f47a806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:20.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.291+0000 7f47a3fff640 1 -- 172.21.15.7:0/1688603204 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6331+0+0 (secure 0 0 0) 0x7f47b408a6c0 con 0x7f47bc15b8c0 2024-04-25T10:04:20.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.291+0000 7f47bb7fe640 1 --2- 172.21.15.7:0/1688603204 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f47a806b4d0 0x7f47a806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:20.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.292+0000 7f47bb7fe640 1 --2- 172.21.15.7:0/1688603204 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f47a806b4d0 0x7f47a806d990 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f47ac034000 tx=0x7f47ac02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:20.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.295+0000 7f47a3fff640 1 -- 172.21.15.7:0/1688603204 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f47b4010070 con 0x7f47bc15b8c0 2024-04-25T10:04:20.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:20.474+0000 7f47c1ab3640 1 -- 172.21.15.7:0/1688603204 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f47bc0b3fd0 con 0x7f47bc15b8c0 2024-04-25T10:04:21.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.158+0000 7f47a3fff640 1 -- 172.21.15.7:0/1688603204 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v108) v1 ==== 181+0+0 (secure 0 0 0) 0x7f47b4058c80 con 0x7f47bc15b8c0 2024-04-25T10:04:21.164 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2024-04-25T10:04:21.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.165+0000 7f47c1ab3640 1 -- 172.21.15.7:0/1688603204 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f47a806b4d0 msgr2=0x7f47a806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:21.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.165+0000 7f47c1ab3640 1 --2- 172.21.15.7:0/1688603204 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f47a806b4d0 0x7f47a806d990 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f47ac034000 tx=0x7f47ac02e000 comp rx=0 tx=0).stop 2024-04-25T10:04:21.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.165+0000 7f47c1ab3640 1 -- 172.21.15.7:0/1688603204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47bc15b8c0 msgr2=0x7f47bc0cb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:21.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.165+0000 7f47c1ab3640 1 --2- 172.21.15.7:0/1688603204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47bc15b8c0 0x7f47bc0cb600 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f47b4007e70 tx=0x7f47b400d4a0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.165+0000 7f47c1ab3640 1 -- 172.21.15.7:0/1688603204 shutdown_connections 2024-04-25T10:04:21.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.165+0000 7f47c1ab3640 1 --2- 172.21.15.7:0/1688603204 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f47a806b4d0 0x7f47a806d990 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.165+0000 7f47c1ab3640 1 --2- 172.21.15.7:0/1688603204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47bc15b8c0 0x7f47bc0cb600 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.165+0000 7f47c1ab3640 1 --2- 172.21.15.7:0/1688603204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47bc0cc250 0x7f47bc0c8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.165+0000 7f47c1ab3640 1 --2- 172.21.15.7:0/1688603204 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47bc0999f0 0x7f47bc159310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.165+0000 7f47c1ab3640 1 -- 172.21.15.7:0/1688603204 >> 172.21.15.7:0/1688603204 conn(0x7f47bc0b3130 msgr2=0x7f47bc0c6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:21.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.166+0000 7f47c1ab3640 1 -- 172.21.15.7:0/1688603204 shutdown_connections 2024-04-25T10:04:21.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.166+0000 7f47c1ab3640 1 -- 172.21.15.7:0/1688603204 wait complete. 2024-04-25T10:04:21.186 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T10:04:21.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.292+0000 7f3acaa76640 1 Processor -- start 2024-04-25T10:04:21.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.292+0000 7f3acaa76640 1 -- start start 2024-04-25T10:04:21.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.293+0000 7f3acaa76640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3ac415de70 0x7f3ac40d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:21.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.293+0000 7f3acaa76640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ac40d2290 con 0x7f3ac40d3330 2024-04-25T10:04:21.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.293+0000 7f3acaa76640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ac40d2570 con 0x7f3ac40d3f10 2024-04-25T10:04:21.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.293+0000 7f3acaa76640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ac40d2850 con 0x7f3ac415de70 2024-04-25T10:04:21.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.293+0000 7f3ac8812640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3ac415de70 0x7f3ac40d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:21.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.293+0000 7f3ac3fff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3ac40d3330 0x7f3ac40d3800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58300/0 (socket says 172.21.15.7:58300) 2024-04-25T10:04:21.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.293+0000 7f3ac3fff640 1 -- 172.21.15.7:0/111304452 learned_addr learned my addr 172.21.15.7:0/111304452 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:21.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.293+0000 7f3ac8812640 1 -- 172.21.15.7:0/111304452 >> v1:172.21.15.55:6789/0 conn(0x7f3ac40d3f10 legacy=0x7f3ac40b6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:21.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.293+0000 7f3ac8812640 1 -- 172.21.15.7:0/111304452 >> v1:172.21.15.7:6789/0 conn(0x7f3ac40d3330 legacy=0x7f3ac40d3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:21.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.293+0000 7f3ac37fe640 1 -- 172.21.15.7:0/111304452 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 307151842 0 0) 0x7f3ac40d2290 con 0x7f3ac40d3330 2024-04-25T10:04:21.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.294+0000 7f3ac8812640 1 -- 172.21.15.7:0/111304452 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac40d2b30 con 0x7f3ac415de70 2024-04-25T10:04:21.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.294+0000 7f3ac8812640 1 --2- 172.21.15.7:0/111304452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ac415de70 0x7f3ac40d1920 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f3ab40097a0 tx=0x7f3ab402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f862e05b65677dde server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:21.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.294+0000 7f3ac37fe640 1 -- 172.21.15.7:0/111304452 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab4037070 con 0x7f3ac415de70 2024-04-25T10:04:21.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.294+0000 7f3ac37fe640 1 -- 172.21.15.7:0/111304452 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab4032440 con 0x7f3ac415de70 2024-04-25T10:04:21.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.294+0000 7f3ac37fe640 1 -- 172.21.15.7:0/111304452 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab4032810 con 0x7f3ac415de70 2024-04-25T10:04:21.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.295+0000 7f3acaa76640 1 -- 172.21.15.7:0/111304452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ac415de70 msgr2=0x7f3ac40d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:21.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.295+0000 7f3acaa76640 1 --2- 172.21.15.7:0/111304452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ac415de70 0x7f3ac40d1920 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f3ab40097a0 tx=0x7f3ab402a230 comp rx=0 tx=0).stop 2024-04-25T10:04:21.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.295+0000 7f3acaa76640 1 -- 172.21.15.7:0/111304452 shutdown_connections 2024-04-25T10:04:21.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.295+0000 7f3acaa76640 1 --2- 172.21.15.7:0/111304452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ac415de70 0x7f3ac40d1920 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.295+0000 7f3acaa76640 1 -- 172.21.15.7:0/111304452 >> 172.21.15.7:0/111304452 conn(0x7f3ac40726b0 msgr2=0x7f3ac4072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:21.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.295+0000 7f3acaa76640 1 -- 172.21.15.7:0/111304452 shutdown_connections 2024-04-25T10:04:21.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.295+0000 7f3acaa76640 1 -- 172.21.15.7:0/111304452 wait complete. 2024-04-25T10:04:21.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.296+0000 7f3acaa76640 1 Processor -- start 2024-04-25T10:04:21.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.296+0000 7f3acaa76640 1 -- start start 2024-04-25T10:04:21.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.297+0000 7f3acaa76640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ac40d3330 0x7f3ac4151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:21.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.297+0000 7f3acaa76640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3ac40d3f10 0x7f3ac4153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.297+0000 7f3acaa76640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ac415de70 0x7f3ac414c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.297+0000 7f3acaa76640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac40d1fe0 con 0x7f3ac40d3330 2024-04-25T10:04:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.297+0000 7f3acaa76640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac40d1e60 con 0x7f3ac415de70 2024-04-25T10:04:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.297+0000 7f3acaa76640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac40b9290 con 0x7f3ac40d3f10 2024-04-25T10:04:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.297+0000 7f3ac8812640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ac40d3330 0x7f3ac4151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.297+0000 7f3ac8812640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ac40d3330 0x7f3ac4151bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37012/0 (socket says 172.21.15.7:37012) 2024-04-25T10:04:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.297+0000 7f3ac8812640 1 -- 172.21.15.7:0/1582109412 learned_addr learned my addr 172.21.15.7:0/1582109412 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.298+0000 7f3ac9013640 1 --2- 172.21.15.7:0/1582109412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ac415de70 0x7f3ac414c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.298+0000 7f3ac3fff640 1 --2- 172.21.15.7:0/1582109412 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3ac40d3f10 0x7f3ac4153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.298+0000 7f3ac8812640 1 -- 172.21.15.7:0/1582109412 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3ac40d3f10 msgr2=0x7f3ac4153cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.298+0000 7f3ac8812640 1 --2- 172.21.15.7:0/1582109412 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3ac40d3f10 0x7f3ac4153cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.298+0000 7f3ac8812640 1 -- 172.21.15.7:0/1582109412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ac415de70 msgr2=0x7f3ac414c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:21.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.298+0000 7f3ac8812640 1 --2- 172.21.15.7:0/1582109412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ac415de70 0x7f3ac414c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.298+0000 7f3ac8812640 1 -- 172.21.15.7:0/1582109412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac41522d0 con 0x7f3ac40d3330 2024-04-25T10:04:21.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.298+0000 7f3ac9013640 1 --2- 172.21.15.7:0/1582109412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ac415de70 0x7f3ac414c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:21.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.298+0000 7f3ac8812640 1 --2- 172.21.15.7:0/1582109412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ac40d3330 0x7f3ac4151bd0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f3ab40098c0 tx=0x7f3ab40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:21.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.298+0000 7f3ac17fa640 1 -- 172.21.15.7:0/1582109412 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab4037040 con 0x7f3ac40d3330 2024-04-25T10:04:21.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.298+0000 7f3ac17fa640 1 -- 172.21.15.7:0/1582109412 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab4042070 con 0x7f3ac40d3330 2024-04-25T10:04:21.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.298+0000 7f3ac17fa640 1 -- 172.21.15.7:0/1582109412 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab4030a70 con 0x7f3ac40d3330 2024-04-25T10:04:21.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.298+0000 7f3acaa76640 1 -- 172.21.15.7:0/1582109412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac40cbf90 con 0x7f3ac40d3330 2024-04-25T10:04:21.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.298+0000 7f3acaa76640 1 -- 172.21.15.7:0/1582109412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac414cc50 con 0x7f3ac40d3330 2024-04-25T10:04:21.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.299+0000 7f3acaa76640 1 -- 172.21.15.7:0/1582109412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ac4069040 con 0x7f3ac40d3330 2024-04-25T10:04:21.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.300+0000 7f3ac17fa640 1 -- 172.21.15.7:0/1582109412 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3ab4030c10 con 0x7f3ac40d3330 2024-04-25T10:04:21.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.300+0000 7f3ac17fa640 1 --2- 172.21.15.7:0/1582109412 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3ab006b4d0 0x7f3ab006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:21.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.300+0000 7f3ac17fa640 1 -- 172.21.15.7:0/1582109412 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5893+0+0 (secure 0 0 0) 0x7f3ab40aacd0 con 0x7f3ac40d3330 2024-04-25T10:04:21.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.300+0000 7f3ac3fff640 1 --2- 172.21.15.7:0/1582109412 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3ab006b4d0 0x7f3ab006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:21.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.301+0000 7f3ac3fff640 1 --2- 172.21.15.7:0/1582109412 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3ab006b4d0 0x7f3ab006d990 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f3ac40c9c10 tx=0x7f3ab8007b90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.306+0000 7f3ac17fa640 1 -- 172.21.15.7:0/1582109412 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3ab4045360 con 0x7f3ac40d3330 2024-04-25T10:04:21.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:21.483+0000 7f3acaa76640 1 -- 172.21.15.7:0/1582109412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3ac40c6e30 con 0x7f3ac40d3330 2024-04-25T10:04:22.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.167+0000 7f3ac17fa640 1 -- 172.21.15.7:0/1582109412 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v109) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3ab4079b20 con 0x7f3ac40d3330 2024-04-25T10:04:22.172 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2024-04-25T10:04:22.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.173+0000 7f3acaa76640 1 -- 172.21.15.7:0/1582109412 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3ab006b4d0 msgr2=0x7f3ab006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:22.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.173+0000 7f3acaa76640 1 --2- 172.21.15.7:0/1582109412 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3ab006b4d0 0x7f3ab006d990 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f3ac40c9c10 tx=0x7f3ab8007b90 comp rx=0 tx=0).stop 2024-04-25T10:04:22.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.173+0000 7f3acaa76640 1 -- 172.21.15.7:0/1582109412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ac40d3330 msgr2=0x7f3ac4151bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:22.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.173+0000 7f3acaa76640 1 --2- 172.21.15.7:0/1582109412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ac40d3330 0x7f3ac4151bd0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f3ab40098c0 tx=0x7f3ab40046c0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.173+0000 7f3acaa76640 1 -- 172.21.15.7:0/1582109412 shutdown_connections 2024-04-25T10:04:22.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.173+0000 7f3acaa76640 1 --2- 172.21.15.7:0/1582109412 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3ab006b4d0 0x7f3ab006d990 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.173+0000 7f3acaa76640 1 --2- 172.21.15.7:0/1582109412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ac415de70 0x7f3ac414c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.173+0000 7f3acaa76640 1 --2- 172.21.15.7:0/1582109412 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3ac40d3f10 0x7f3ac4153cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.173+0000 7f3acaa76640 1 --2- 172.21.15.7:0/1582109412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ac40d3330 0x7f3ac4151bd0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.173+0000 7f3acaa76640 1 -- 172.21.15.7:0/1582109412 >> 172.21.15.7:0/1582109412 conn(0x7f3ac40726b0 msgr2=0x7f3ac4154e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:22.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.176+0000 7f3acaa76640 1 -- 172.21.15.7:0/1582109412 shutdown_connections 2024-04-25T10:04:22.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.177+0000 7f3acaa76640 1 -- 172.21.15.7:0/1582109412 wait complete. 2024-04-25T10:04:22.196 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T10:04:22.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.299+0000 7f1c02288640 1 Processor -- start 2024-04-25T10:04:22.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.299+0000 7f1c02288640 1 -- start start 2024-04-25T10:04:22.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.300+0000 7f1c02288640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1bfc0b78c0 0x7f1bfc1685d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:22.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.300+0000 7f1c02288640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bfc0b7ef0 con 0x7f1bfc0d0780 2024-04-25T10:04:22.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.300+0000 7f1c02288640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bfc0b81d0 con 0x7f1bfc0d2c40 2024-04-25T10:04:22.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.300+0000 7f1c02288640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bfc0b9840 con 0x7f1bfc0b78c0 2024-04-25T10:04:22.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.300+0000 7f1bfbfff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1bfc0d0780 0x7f1bfc0d0b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58302/0 (socket says 172.21.15.7:58302) 2024-04-25T10:04:22.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.300+0000 7f1bfbfff640 1 -- 172.21.15.7:0/300528159 learned_addr learned my addr 172.21.15.7:0/300528159 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:22.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.300+0000 7f1c00825640 1 --2- 172.21.15.7:0/300528159 >> v2:172.21.15.55:3300/0 conn(0x7f1bfc0b78c0 0x7f1bfc1685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:22.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.301+0000 7f1bfaffd640 1 -- 172.21.15.7:0/300528159 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107991736 0 0) 0x7f1bfc0b7ef0 con 0x7f1bfc0d0780 2024-04-25T10:04:22.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.301+0000 7f1bfaffd640 1 -- 172.21.15.7:0/300528159 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1be8003520 con 0x7f1bfc0d0780 2024-04-25T10:04:22.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.301+0000 7f1bfaffd640 1 -- 172.21.15.7:0/300528159 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 493375999 0 0) 0x7f1be8003520 con 0x7f1bfc0d0780 2024-04-25T10:04:22.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.301+0000 7f1bfaffd640 1 -- 172.21.15.7:0/300528159 >> v2:172.21.15.55:3300/0 conn(0x7f1bfc0b78c0 msgr2=0x7f1bfc1685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:22.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.301+0000 7f1bfaffd640 1 --2- 172.21.15.7:0/300528159 >> v2:172.21.15.55:3300/0 conn(0x7f1bfc0b78c0 0x7f1bfc1685d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.301+0000 7f1bfaffd640 1 -- 172.21.15.7:0/300528159 >> v1:172.21.15.55:6789/0 conn(0x7f1bfc0d2c40 legacy=0x7f1bfc0b9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:22.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.301+0000 7f1bfaffd640 1 -- 172.21.15.7:0/300528159 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc0b84b0 con 0x7f1bfc0d0780 2024-04-25T10:04:22.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.301+0000 7f1bfaffd640 1 -- 172.21.15.7:0/300528159 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f1bec001670 con 0x7f1bfc0d0780 2024-04-25T10:04:22.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.301+0000 7f1bfaffd640 1 -- 172.21.15.7:0/300528159 >> v1:172.21.15.7:6789/0 conn(0x7f1bfc0d0780 legacy=0x7f1bfc0d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:22.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.301+0000 7f1bfaffd640 1 --2- 172.21.15.7:0/300528159 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1be80039b0 0x7f1be8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:22.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.301+0000 7f1bfaffd640 1 --2- 172.21.15.7:0/300528159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1be8004800 0x7f1be8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:22.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.301+0000 7f1bfaffd640 1 --2- 172.21.15.7:0/300528159 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1be80051c0 0x7f1be800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:22.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.301+0000 7f1bfaffd640 1 -- 172.21.15.7:0/300528159 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc0b9840 con 0x7f1be8004800 2024-04-25T10:04:22.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.301+0000 7f1bfaffd640 1 -- 172.21.15.7:0/300528159 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be800c060 con 0x7f1be80039b0 2024-04-25T10:04:22.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.301+0000 7f1bfaffd640 1 -- 172.21.15.7:0/300528159 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be800c260 con 0x7f1be80051c0 2024-04-25T10:04:22.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.301+0000 7f1bfb7fe640 1 --2- 172.21.15.7:0/300528159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1be8004800 0x7f1be8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:22.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.301+0000 7f1bfbfff640 1 --2- 172.21.15.7:0/300528159 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1be80039b0 0x7f1be8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:22.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.301+0000 7f1c00825640 1 --2- 172.21.15.7:0/300528159 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1be80051c0 0x7f1be800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:22.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.301+0000 7f1bfb7fe640 1 -- 172.21.15.7:0/300528159 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1be80051c0 msgr2=0x7f1be800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:22.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.301+0000 7f1bfb7fe640 1 --2- 172.21.15.7:0/300528159 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1be80051c0 0x7f1be800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.301+0000 7f1bfb7fe640 1 -- 172.21.15.7:0/300528159 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1be80039b0 msgr2=0x7f1be8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:22.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.301+0000 7f1bfb7fe640 1 --2- 172.21.15.7:0/300528159 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1be80039b0 0x7f1be8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.301+0000 7f1c00825640 1 -- 172.21.15.7:0/300528159 reap_dead start 2024-04-25T10:04:22.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.301+0000 7f1bfb7fe640 1 -- 172.21.15.7:0/300528159 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be8003520 con 0x7f1be8004800 2024-04-25T10:04:22.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.302+0000 7f1bfb7fe640 1 --2- 172.21.15.7:0/300528159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1be8004800 0x7f1be8004c80 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f1be4001750 tx=0x7f1be8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f43a45706a6470ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:22.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.302+0000 7f1bfaffd640 1 -- 172.21.15.7:0/300528159 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be4001370 con 0x7f1be8004800 2024-04-25T10:04:22.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.302+0000 7f1bfaffd640 1 -- 172.21.15.7:0/300528159 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be40052d0 con 0x7f1be8004800 2024-04-25T10:04:22.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.302+0000 7f1bfaffd640 1 -- 172.21.15.7:0/300528159 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be402abe0 con 0x7f1be8004800 2024-04-25T10:04:22.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.303+0000 7f1c02288640 1 -- 172.21.15.7:0/300528159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1be8004800 msgr2=0x7f1be8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:22.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.303+0000 7f1c02288640 1 --2- 172.21.15.7:0/300528159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1be8004800 0x7f1be8004c80 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f1be4001750 tx=0x7f1be8005830 comp rx=0 tx=0).stop 2024-04-25T10:04:22.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.303+0000 7f1c02288640 1 -- 172.21.15.7:0/300528159 shutdown_connections 2024-04-25T10:04:22.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.303+0000 7f1c02288640 1 --2- 172.21.15.7:0/300528159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1be8004800 0x7f1be8004c80 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.303+0000 7f1c02288640 1 -- 172.21.15.7:0/300528159 >> 172.21.15.7:0/300528159 conn(0x7f1bfc0726b0 msgr2=0x7f1bfc072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:22.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.303+0000 7f1c02288640 1 -- 172.21.15.7:0/300528159 shutdown_connections 2024-04-25T10:04:22.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.303+0000 7f1c02288640 1 -- 172.21.15.7:0/300528159 wait complete. 2024-04-25T10:04:22.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.304+0000 7f1c02288640 1 Processor -- start 2024-04-25T10:04:22.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.304+0000 7f1c02288640 1 -- start start 2024-04-25T10:04:22.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.305+0000 7f1c02288640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1be8004800 0x7f1bfc14cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:22.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.305+0000 7f1c02288640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1bfc0cb760 0x7f1bfc0cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:22.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.305+0000 7f1c02288640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bfc15c7d0 0x7f1bfc15cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:22.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.305+0000 7f1c02288640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc1611b0 con 0x7f1be8004800 2024-04-25T10:04:22.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.305+0000 7f1c02288640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc0b8a70 con 0x7f1bfc15c7d0 2024-04-25T10:04:22.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.305+0000 7f1c02288640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc161330 con 0x7f1bfc0cb760 2024-04-25T10:04:22.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.305+0000 7f1bfbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1be8004800 0x7f1bfc14cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:22.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.305+0000 7f1bfbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1be8004800 0x7f1bfc14cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37030/0 (socket says 172.21.15.7:37030) 2024-04-25T10:04:22.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.305+0000 7f1bfbfff640 1 -- 172.21.15.7:0/1881718035 learned_addr learned my addr 172.21.15.7:0/1881718035 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:22.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.305+0000 7f1bfb7fe640 1 --2- 172.21.15.7:0/1881718035 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1bfc0cb760 0x7f1bfc0cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:22.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.305+0000 7f1c00825640 1 --2- 172.21.15.7:0/1881718035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bfc15c7d0 0x7f1bfc15cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:22.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.305+0000 7f1bfbfff640 1 -- 172.21.15.7:0/1881718035 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1bfc0cb760 msgr2=0x7f1bfc0cbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:22.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.305+0000 7f1bfbfff640 1 --2- 172.21.15.7:0/1881718035 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1bfc0cb760 0x7f1bfc0cbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.305+0000 7f1bfbfff640 1 -- 172.21.15.7:0/1881718035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bfc15c7d0 msgr2=0x7f1bfc15cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:22.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.305+0000 7f1bfbfff640 1 --2- 172.21.15.7:0/1881718035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bfc15c7d0 0x7f1bfc15cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.305+0000 7f1bfbfff640 1 -- 172.21.15.7:0/1881718035 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc0c73b0 con 0x7f1be8004800 2024-04-25T10:04:22.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.305+0000 7f1bfb7fe640 1 --2- 172.21.15.7:0/1881718035 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1bfc0cb760 0x7f1bfc0cbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:22.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.305+0000 7f1c00825640 1 --2- 172.21.15.7:0/1881718035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bfc15c7d0 0x7f1bfc15cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:22.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.306+0000 7f1bfbfff640 1 --2- 172.21.15.7:0/1881718035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1be8004800 0x7f1bfc14cde0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f1bec0072c0 tx=0x7f1bec007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:22.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.306+0000 7f1bf8ff9640 1 -- 172.21.15.7:0/1881718035 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec01a070 con 0x7f1be8004800 2024-04-25T10:04:22.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.306+0000 7f1bf8ff9640 1 -- 172.21.15.7:0/1881718035 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bec00f8e0 con 0x7f1be8004800 2024-04-25T10:04:22.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.306+0000 7f1c02288640 1 -- 172.21.15.7:0/1881718035 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bfc0c7650 con 0x7f1be8004800 2024-04-25T10:04:22.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.306+0000 7f1bf8ff9640 1 -- 172.21.15.7:0/1881718035 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec00fcb0 con 0x7f1be8004800 2024-04-25T10:04:22.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.306+0000 7f1c02288640 1 -- 172.21.15.7:0/1881718035 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bfc150740 con 0x7f1be8004800 2024-04-25T10:04:22.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.307+0000 7f1c02288640 1 -- 172.21.15.7:0/1881718035 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bfc0685d0 con 0x7f1be8004800 2024-04-25T10:04:22.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.307+0000 7f1bf8ff9640 1 -- 172.21.15.7:0/1881718035 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1bec01d070 con 0x7f1be8004800 2024-04-25T10:04:22.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.308+0000 7f1bf8ff9640 1 --2- 172.21.15.7:0/1881718035 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1bdc06b4d0 0x7f1bdc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:22.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.308+0000 7f1bf8ff9640 1 -- 172.21.15.7:0/1881718035 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f1bec089c50 con 0x7f1be8004800 2024-04-25T10:04:22.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.308+0000 7f1bfb7fe640 1 --2- 172.21.15.7:0/1881718035 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1bdc06b4d0 0x7f1bdc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:22.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.308+0000 7f1bfb7fe640 1 --2- 172.21.15.7:0/1881718035 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1bdc06b4d0 0x7f1bdc06d990 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f1be4032000 tx=0x7f1be402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:22.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.313+0000 7f1bf8ff9640 1 -- 172.21.15.7:0/1881718035 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1bec08f020 con 0x7f1be8004800 2024-04-25T10:04:22.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.495+0000 7f1c02288640 1 -- 172.21.15.7:0/1881718035 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f1bfc068f60 con 0x7f1be8004800 2024-04-25T10:04:22.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.499+0000 7f1bf8ff9640 1 -- 172.21.15.7:0/1881718035 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1bec058bf0 con 0x7f1be8004800 2024-04-25T10:04:22.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.501+0000 7f1c02288640 1 -- 172.21.15.7:0/1881718035 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1bdc06b4d0 msgr2=0x7f1bdc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:22.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.501+0000 7f1c02288640 1 --2- 172.21.15.7:0/1881718035 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1bdc06b4d0 0x7f1bdc06d990 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f1be4032000 tx=0x7f1be402e000 comp rx=0 tx=0).stop 2024-04-25T10:04:22.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.502+0000 7f1c02288640 1 -- 172.21.15.7:0/1881718035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1be8004800 msgr2=0x7f1bfc14cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:22.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.502+0000 7f1c02288640 1 --2- 172.21.15.7:0/1881718035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1be8004800 0x7f1bfc14cde0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f1bec0072c0 tx=0x7f1bec007780 comp rx=0 tx=0).stop 2024-04-25T10:04:22.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.502+0000 7f1c02288640 1 -- 172.21.15.7:0/1881718035 shutdown_connections 2024-04-25T10:04:22.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.502+0000 7f1c02288640 1 --2- 172.21.15.7:0/1881718035 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1bdc06b4d0 0x7f1bdc06d990 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.502+0000 7f1c02288640 1 --2- 172.21.15.7:0/1881718035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bfc15c7d0 0x7f1bfc15cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.502+0000 7f1c02288640 1 --2- 172.21.15.7:0/1881718035 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1bfc0cb760 0x7f1bfc0cbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.502+0000 7f1c02288640 1 --2- 172.21.15.7:0/1881718035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1be8004800 0x7f1bfc14cde0 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.502+0000 7f1c02288640 1 -- 172.21.15.7:0/1881718035 >> 172.21.15.7:0/1881718035 conn(0x7f1bfc0726b0 msgr2=0x7f1bfc0ce280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:22.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.502+0000 7f1c02288640 1 -- 172.21.15.7:0/1881718035 shutdown_connections 2024-04-25T10:04:22.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.502+0000 7f1c02288640 1 -- 172.21.15.7:0/1881718035 wait complete. 2024-04-25T10:04:22.517 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2024-04-25T10:04:22.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.618+0000 7f02fe132640 1 Processor -- start 2024-04-25T10:04:22.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.618+0000 7f02fe132640 1 -- start start 2024-04-25T10:04:22.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.618+0000 7f02fe132640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f02f8145260 0x7f02f80726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:22.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.618+0000 7f02fe132640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f02f806b270 0x7f02f815d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:22.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.618+0000 7f02fe132640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f815cd80 con 0x7f02f815c8f0 2024-04-25T10:04:22.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.618+0000 7f02fe132640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f8160110 con 0x7f02f8145260 2024-04-25T10:04:22.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.618+0000 7f02fe132640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f815f500 con 0x7f02f806b270 2024-04-25T10:04:22.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.619+0000 7f02f77fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f02f8145260 0x7f02f80726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:22.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.619+0000 7f02f6ffd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f02f815c8f0 0x7f02f806ab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58304/0 (socket says 172.21.15.7:58304) 2024-04-25T10:04:22.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.619+0000 7f02f6ffd640 1 -- 172.21.15.7:0/4244548774 learned_addr learned my addr 172.21.15.7:0/4244548774 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:22.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.619+0000 7f02f7fff640 1 --2- 172.21.15.7:0/4244548774 >> v2:172.21.15.55:3300/0 conn(0x7f02f806b270 0x7f02f815d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:22.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.619+0000 7f02f77fe640 1 -- 172.21.15.7:0/4244548774 >> v2:172.21.15.55:3300/0 conn(0x7f02f806b270 msgr2=0x7f02f815d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:22.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.619+0000 7f02f77fe640 1 --2- 172.21.15.7:0/4244548774 >> v2:172.21.15.55:3300/0 conn(0x7f02f806b270 0x7f02f815d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.619+0000 7f02f77fe640 1 -- 172.21.15.7:0/4244548774 >> v1:172.21.15.7:6789/0 conn(0x7f02f815c8f0 legacy=0x7f02f806ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:22.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.619+0000 7f02f77fe640 1 -- 172.21.15.7:0/4244548774 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f815f7e0 con 0x7f02f8145260 2024-04-25T10:04:22.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.619+0000 7f02f67fc640 1 -- 172.21.15.7:0/4244548774 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215964137 0 0) 0x7f02f815cd80 con 0x7f02f815c8f0 2024-04-25T10:04:22.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.620+0000 7f02f77fe640 1 --2- 172.21.15.7:0/4244548774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f8145260 0x7f02f80726e0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f02f815be70 tx=0x7f02e802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b82e5208f3ab55 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:22.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.620+0000 7f02f67fc640 1 -- 172.21.15.7:0/4244548774 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e8037070 con 0x7f02f8145260 2024-04-25T10:04:22.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.620+0000 7f02f67fc640 1 -- 172.21.15.7:0/4244548774 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e8032440 con 0x7f02f8145260 2024-04-25T10:04:22.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.620+0000 7f02f67fc640 1 -- 172.21.15.7:0/4244548774 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e8032810 con 0x7f02f8145260 2024-04-25T10:04:22.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.620+0000 7f02fe132640 1 -- 172.21.15.7:0/4244548774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f8145260 msgr2=0x7f02f80726e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:22.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.620+0000 7f02fe132640 1 --2- 172.21.15.7:0/4244548774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f8145260 0x7f02f80726e0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f02f815be70 tx=0x7f02e802a1a0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.620+0000 7f02fe132640 1 -- 172.21.15.7:0/4244548774 shutdown_connections 2024-04-25T10:04:22.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.620+0000 7f02fe132640 1 --2- 172.21.15.7:0/4244548774 >> v2:172.21.15.55:3300/0 conn(0x7f02f806b270 0x7f02f815d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.620+0000 7f02fe132640 1 --2- 172.21.15.7:0/4244548774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f8145260 0x7f02f80726e0 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.620+0000 7f02fe132640 1 -- 172.21.15.7:0/4244548774 >> 172.21.15.7:0/4244548774 conn(0x7f02f80b5c30 msgr2=0x7f02f80999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:22.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.620+0000 7f02fe132640 1 -- 172.21.15.7:0/4244548774 shutdown_connections 2024-04-25T10:04:22.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.620+0000 7f02fe132640 1 -- 172.21.15.7:0/4244548774 wait complete. 2024-04-25T10:04:22.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.621+0000 7f02fe132640 1 Processor -- start 2024-04-25T10:04:22.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.622+0000 7f02fe132640 1 -- start start 2024-04-25T10:04:22.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.622+0000 7f02fe132640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f02f806b270 0x7f02f813d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:22.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.622+0000 7f02fe132640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02f8145260 0x7f02f8140470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:22.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.622+0000 7f02fe132640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f815c8f0 0x7f02f814e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:22.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.622+0000 7f02fe132640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f815d780 con 0x7f02f815c8f0 2024-04-25T10:04:22.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.622+0000 7f02fe132640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f815fda0 con 0x7f02f8145260 2024-04-25T10:04:22.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.622+0000 7f02fe132640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f815d900 con 0x7f02f806b270 2024-04-25T10:04:22.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.622+0000 7f02f7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f815c8f0 0x7f02f814e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:22.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.622+0000 7f02f7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f815c8f0 0x7f02f814e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37034/0 (socket says 172.21.15.7:37034) 2024-04-25T10:04:22.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.623+0000 7f02f7fff640 1 -- 172.21.15.7:0/3568185858 learned_addr learned my addr 172.21.15.7:0/3568185858 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:22.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.623+0000 7f02f77fe640 1 --2- 172.21.15.7:0/3568185858 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f02f806b270 0x7f02f813d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:22.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.623+0000 7f02f6ffd640 1 --2- 172.21.15.7:0/3568185858 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02f8145260 0x7f02f8140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:22.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.623+0000 7f02f7fff640 1 -- 172.21.15.7:0/3568185858 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f02f806b270 msgr2=0x7f02f813d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:22.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.623+0000 7f02f7fff640 1 --2- 172.21.15.7:0/3568185858 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f02f806b270 0x7f02f813d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.623+0000 7f02f7fff640 1 -- 172.21.15.7:0/3568185858 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02f8145260 msgr2=0x7f02f8140470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:22.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.623+0000 7f02f7fff640 1 --2- 172.21.15.7:0/3568185858 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02f8145260 0x7f02f8140470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.623+0000 7f02f7fff640 1 -- 172.21.15.7:0/3568185858 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f80b0320 con 0x7f02f815c8f0 2024-04-25T10:04:22.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.623+0000 7f02f7fff640 1 --2- 172.21.15.7:0/3568185858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f815c8f0 0x7f02f814e7d0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f02f0007de0 tx=0x7f02f000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:22.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.623+0000 7f02dffff640 1 -- 172.21.15.7:0/3568185858 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f0014620 con 0x7f02f815c8f0 2024-04-25T10:04:22.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.623+0000 7f02dffff640 1 -- 172.21.15.7:0/3568185858 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f0019070 con 0x7f02f815c8f0 2024-04-25T10:04:22.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.623+0000 7f02fe132640 1 -- 172.21.15.7:0/3568185858 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f80b0600 con 0x7f02f815c8f0 2024-04-25T10:04:22.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.623+0000 7f02dffff640 1 -- 172.21.15.7:0/3568185858 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f0014a20 con 0x7f02f815c8f0 2024-04-25T10:04:22.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.623+0000 7f02fe132640 1 -- 172.21.15.7:0/3568185858 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f80b0bc0 con 0x7f02f815c8f0 2024-04-25T10:04:22.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.624+0000 7f02fe132640 1 -- 172.21.15.7:0/3568185858 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02f815c710 con 0x7f02f815c8f0 2024-04-25T10:04:22.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.625+0000 7f02dffff640 1 -- 172.21.15.7:0/3568185858 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f02f0014bc0 con 0x7f02f815c8f0 2024-04-25T10:04:22.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.625+0000 7f02dffff640 1 --2- 172.21.15.7:0/3568185858 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f02e406b500 0x7f02e406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:22.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.625+0000 7f02dffff640 1 -- 172.21.15.7:0/3568185858 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f02f008a8c0 con 0x7f02f815c8f0 2024-04-25T10:04:22.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.625+0000 7f02f77fe640 1 --2- 172.21.15.7:0/3568185858 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f02e406b500 0x7f02e406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:22.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.626+0000 7f02f77fe640 1 --2- 172.21.15.7:0/3568185858 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f02e406b500 0x7f02e406d9c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f02e8034000 tx=0x7f02e802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:22.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.629+0000 7f02dffff640 1 -- 172.21.15.7:0/3568185858 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f02f815c710 con 0x7f02f815c8f0 2024-04-25T10:04:22.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:22.882+0000 7f02fe132640 1 -- 172.21.15.7:0/3568185858 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) v1 -- 0x7f02f8070a20 con 0x7f02f815c8f0 2024-04-25T10:04:23.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.169+0000 7f02dffff640 1 -- 172.21.15.7:0/3568185858 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v467) v1 ==== 146+0+0 (secure 0 0 0) 0x7f02f0059210 con 0x7f02f815c8f0 2024-04-25T10:04:23.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.171+0000 7f02fe132640 1 -- 172.21.15.7:0/3568185858 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f02e406b500 msgr2=0x7f02e406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.171+0000 7f02fe132640 1 --2- 172.21.15.7:0/3568185858 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f02e406b500 0x7f02e406d9c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f02e8034000 tx=0x7f02e802e000 comp rx=0 tx=0).stop 2024-04-25T10:04:23.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.171+0000 7f02fe132640 1 -- 172.21.15.7:0/3568185858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f815c8f0 msgr2=0x7f02f814e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.171+0000 7f02fe132640 1 --2- 172.21.15.7:0/3568185858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f815c8f0 0x7f02f814e7d0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f02f0007de0 tx=0x7f02f000e4b0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.171+0000 7f02fe132640 1 -- 172.21.15.7:0/3568185858 shutdown_connections 2024-04-25T10:04:23.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.171+0000 7f02fe132640 1 --2- 172.21.15.7:0/3568185858 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f02e406b500 0x7f02e406d9c0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.171+0000 7f02fe132640 1 --2- 172.21.15.7:0/3568185858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f815c8f0 0x7f02f814e7d0 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.171+0000 7f02fe132640 1 --2- 172.21.15.7:0/3568185858 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02f8145260 0x7f02f8140470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.171+0000 7f02fe132640 1 --2- 172.21.15.7:0/3568185858 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f02f806b270 0x7f02f813d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.171+0000 7f02fe132640 1 -- 172.21.15.7:0/3568185858 >> 172.21.15.7:0/3568185858 conn(0x7f02f80b5c30 msgr2=0x7f02f806ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:23.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.171+0000 7f02fe132640 1 -- 172.21.15.7:0/3568185858 shutdown_connections 2024-04-25T10:04:23.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.171+0000 7f02fe132640 1 -- 172.21.15.7:0/3568185858 wait complete. 2024-04-25T10:04:23.188 INFO:tasks.cephfs_test_runner:test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-04-25T10:04:23.188 INFO:tasks.cephfs_test_runner:Starting test: test_orphan_scan (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T10:04:23.188 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:23.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.286+0000 7f05d5d4f640 1 Processor -- start 2024-04-25T10:04:23.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.286+0000 7f05d5d4f640 1 -- start start 2024-04-25T10:04:23.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.287+0000 7f05d5d4f640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f05d006e970 0x7f05d00cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.287+0000 7f05d5d4f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f05d00ced20 0x7f05d015b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.287+0000 7f05d5d4f640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d00cdbf0 con 0x7f05d0144100 2024-04-25T10:04:23.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.287+0000 7f05d5d4f640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d01444e0 con 0x7f05d006e970 2024-04-25T10:04:23.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.287+0000 7f05d5d4f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d015ac70 con 0x7f05d00ced20 2024-04-25T10:04:23.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.287+0000 7f05ceffd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f05d006e970 0x7f05d00cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.287+0000 7f05cf7fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f05d0144100 0x7f05d006e260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58312/0 (socket says 172.21.15.7:58312) 2024-04-25T10:04:23.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.287+0000 7f05cf7fe640 1 -- 172.21.15.7:0/3350780160 learned_addr learned my addr 172.21.15.7:0/3350780160 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:23.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.288+0000 7f05cffff640 1 --2- 172.21.15.7:0/3350780160 >> v2:172.21.15.55:3300/0 conn(0x7f05d00ced20 0x7f05d015b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.288+0000 7f05ceffd640 1 -- 172.21.15.7:0/3350780160 >> v2:172.21.15.55:3300/0 conn(0x7f05d00ced20 msgr2=0x7f05d015b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:23.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.288+0000 7f05ceffd640 1 --2- 172.21.15.7:0/3350780160 >> v2:172.21.15.55:3300/0 conn(0x7f05d00ced20 0x7f05d015b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.288+0000 7f05ceffd640 1 -- 172.21.15.7:0/3350780160 >> v1:172.21.15.7:6789/0 conn(0x7f05d0144100 legacy=0x7f05d006e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.288+0000 7f05ceffd640 1 -- 172.21.15.7:0/3350780160 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d00cded0 con 0x7f05d006e970 2024-04-25T10:04:23.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.288+0000 7f05ceffd640 1 --2- 172.21.15.7:0/3350780160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05d006e970 0x7f05d00cd610 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f05d00710e0 tx=0x7f05c402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d45d843b3e9051 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:23.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.288+0000 7f05ce7fc640 1 -- 172.21.15.7:0/3350780160 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c4037070 con 0x7f05d006e970 2024-04-25T10:04:23.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.288+0000 7f05ce7fc640 1 -- 172.21.15.7:0/3350780160 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c4032440 con 0x7f05d006e970 2024-04-25T10:04:23.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.289+0000 7f05ce7fc640 1 -- 172.21.15.7:0/3350780160 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c402ae60 con 0x7f05d006e970 2024-04-25T10:04:23.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.289+0000 7f05d5d4f640 1 -- 172.21.15.7:0/3350780160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05d006e970 msgr2=0x7f05d00cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.289+0000 7f05d5d4f640 1 --2- 172.21.15.7:0/3350780160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05d006e970 0x7f05d00cd610 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f05d00710e0 tx=0x7f05c402a110 comp rx=0 tx=0).stop 2024-04-25T10:04:23.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.289+0000 7f05d5d4f640 1 -- 172.21.15.7:0/3350780160 shutdown_connections 2024-04-25T10:04:23.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.289+0000 7f05d5d4f640 1 --2- 172.21.15.7:0/3350780160 >> v2:172.21.15.55:3300/0 conn(0x7f05d00ced20 0x7f05d015b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.289+0000 7f05d5d4f640 1 --2- 172.21.15.7:0/3350780160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05d006e970 0x7f05d00cd610 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.289+0000 7f05d5d4f640 1 -- 172.21.15.7:0/3350780160 >> 172.21.15.7:0/3350780160 conn(0x7f05d0071150 msgr2=0x7f05d0071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:23.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.289+0000 7f05d5d4f640 1 -- 172.21.15.7:0/3350780160 shutdown_connections 2024-04-25T10:04:23.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.289+0000 7f05d5d4f640 1 -- 172.21.15.7:0/3350780160 wait complete. 2024-04-25T10:04:23.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.290+0000 7f05d5d4f640 1 Processor -- start 2024-04-25T10:04:23.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.290+0000 7f05d5d4f640 1 -- start start 2024-04-25T10:04:23.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.291+0000 7f05d5d4f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05d006e970 0x7f05d01583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.291+0000 7f05d5d4f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05d00ced20 0x7f05d013ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.291+0000 7f05d5d4f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05d0144100 0x7f05d013efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.291+0000 7f05d5d4f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d00cea00 con 0x7f05d0144100 2024-04-25T10:04:23.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.291+0000 7f05d5d4f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d00ce490 con 0x7f05d00ced20 2024-04-25T10:04:23.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.291+0000 7f05d5d4f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d015b670 con 0x7f05d006e970 2024-04-25T10:04:23.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.291+0000 7f05cffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05d0144100 0x7f05d013efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.291+0000 7f05cffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05d0144100 0x7f05d013efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37054/0 (socket says 172.21.15.7:37054) 2024-04-25T10:04:23.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.291+0000 7f05cffff640 1 -- 172.21.15.7:0/144837381 learned_addr learned my addr 172.21.15.7:0/144837381 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:23.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.291+0000 7f05ceffd640 1 --2- 172.21.15.7:0/144837381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05d00ced20 0x7f05d013ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.291+0000 7f05cf7fe640 1 --2- 172.21.15.7:0/144837381 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05d006e970 0x7f05d01583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.292+0000 7f05cffff640 1 -- 172.21.15.7:0/144837381 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05d006e970 msgr2=0x7f05d01583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.292+0000 7f05cffff640 1 --2- 172.21.15.7:0/144837381 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05d006e970 0x7f05d01583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.292+0000 7f05cffff640 1 -- 172.21.15.7:0/144837381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05d00ced20 msgr2=0x7f05d013ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.292+0000 7f05cffff640 1 --2- 172.21.15.7:0/144837381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05d00ced20 0x7f05d013ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.292+0000 7f05cffff640 1 -- 172.21.15.7:0/144837381 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d01f4d20 con 0x7f05d0144100 2024-04-25T10:04:23.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.292+0000 7f05cffff640 1 --2- 172.21.15.7:0/144837381 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05d0144100 0x7f05d013efa0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f05c8007e40 tx=0x7f05c800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:23.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.292+0000 7f05b7fff640 1 -- 172.21.15.7:0/144837381 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c8014620 con 0x7f05d0144100 2024-04-25T10:04:23.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.292+0000 7f05b7fff640 1 -- 172.21.15.7:0/144837381 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c8019070 con 0x7f05d0144100 2024-04-25T10:04:23.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.292+0000 7f05b7fff640 1 -- 172.21.15.7:0/144837381 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c8014a20 con 0x7f05d0144100 2024-04-25T10:04:23.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.292+0000 7f05d5d4f640 1 -- 172.21.15.7:0/144837381 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d01f4fe0 con 0x7f05d0144100 2024-04-25T10:04:23.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.292+0000 7f05d5d4f640 1 -- 172.21.15.7:0/144837381 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d01f55a0 con 0x7f05d0144100 2024-04-25T10:04:23.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.293+0000 7f05d5d4f640 1 -- 172.21.15.7:0/144837381 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d0068fd0 con 0x7f05d0144100 2024-04-25T10:04:23.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.293+0000 7f05b7fff640 1 -- 172.21.15.7:0/144837381 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f05c8014bc0 con 0x7f05d0144100 2024-04-25T10:04:23.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.294+0000 7f05b7fff640 1 --2- 172.21.15.7:0/144837381 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f05bc06b4d0 0x7f05bc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.294+0000 7f05b7fff640 1 -- 172.21.15.7:0/144837381 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f05c808a830 con 0x7f05d0144100 2024-04-25T10:04:23.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.294+0000 7f05cf7fe640 1 --2- 172.21.15.7:0/144837381 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f05bc06b4d0 0x7f05bc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.294+0000 7f05cf7fe640 1 --2- 172.21.15.7:0/144837381 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f05bc06b4d0 0x7f05bc06d990 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f05c0007fd0 tx=0x7f05c0007e80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:23.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.298+0000 7f05b7fff640 1 -- 172.21.15.7:0/144837381 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f05c8059210 con 0x7f05d0144100 2024-04-25T10:04:23.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.479+0000 7f05d5d4f640 1 -- 172.21.15.7:0/144837381 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05d01430d0 con 0x7f05d0144100 2024-04-25T10:04:23.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.480+0000 7f05b7fff640 1 -- 172.21.15.7:0/144837381 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+13331 (secure 0 0 0) 0x7f05c805d2b0 con 0x7f05d0144100 2024-04-25T10:04:23.484 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:23.484 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":109,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:04:22.160239+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6837/1214875974":"2024-04-26T10:04:15.097519+0000","172.21.15.7:6835/1214875974":"2024-04-26T10:04:15.097519+0000","172.21.15.7:6837/900729992":"2024-04-26T10:03:38.723704+0000","172.21.15.7:6835/900729992":"2024-04-26T10:03:38.723704+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:23.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.482+0000 7f05d5d4f640 1 -- 172.21.15.7:0/144837381 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f05bc06b4d0 msgr2=0x7f05bc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.482+0000 7f05d5d4f640 1 --2- 172.21.15.7:0/144837381 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f05bc06b4d0 0x7f05bc06d990 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f05c0007fd0 tx=0x7f05c0007e80 comp rx=0 tx=0).stop 2024-04-25T10:04:23.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.482+0000 7f05d5d4f640 1 -- 172.21.15.7:0/144837381 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05d0144100 msgr2=0x7f05d013efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.482+0000 7f05d5d4f640 1 --2- 172.21.15.7:0/144837381 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05d0144100 0x7f05d013efa0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f05c8007e40 tx=0x7f05c800e4b0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.482+0000 7f05d5d4f640 1 -- 172.21.15.7:0/144837381 shutdown_connections 2024-04-25T10:04:23.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.482+0000 7f05d5d4f640 1 --2- 172.21.15.7:0/144837381 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f05bc06b4d0 0x7f05bc06d990 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.482+0000 7f05d5d4f640 1 --2- 172.21.15.7:0/144837381 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05d0144100 0x7f05d013efa0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.482+0000 7f05d5d4f640 1 --2- 172.21.15.7:0/144837381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05d00ced20 0x7f05d013ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.482+0000 7f05d5d4f640 1 --2- 172.21.15.7:0/144837381 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f05d006e970 0x7f05d01583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.482+0000 7f05d5d4f640 1 -- 172.21.15.7:0/144837381 >> 172.21.15.7:0/144837381 conn(0x7f05d0071150 msgr2=0x7f05d015a030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:23.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.482+0000 7f05d5d4f640 1 -- 172.21.15.7:0/144837381 shutdown_connections 2024-04-25T10:04:23.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.482+0000 7f05d5d4f640 1 -- 172.21.15.7:0/144837381 wait complete. 2024-04-25T10:04:23.497 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:04:23.498 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:04:23.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.597+0000 7ff0c45d5640 1 Processor -- start 2024-04-25T10:04:23.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.597+0000 7ff0c45d5640 1 -- start start 2024-04-25T10:04:23.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.598+0000 7ff0c45d5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff0bc0b2c30 0x7ff0bc0ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.598+0000 7ff0c45d5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0bc0d3760 0x7ff0bc0d3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.598+0000 7ff0c45d5640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0bc0d1a40 con 0x7ff0bc15deb0 2024-04-25T10:04:23.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.598+0000 7ff0c45d5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0bc0d1d20 con 0x7ff0bc0b2c30 2024-04-25T10:04:23.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.598+0000 7ff0c45d5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc0d2000 con 0x7ff0bc0d3760 2024-04-25T10:04:23.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.598+0000 7ff0c2371640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff0bc15deb0 0x7ff0bc0b69e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58328/0 (socket says 172.21.15.7:58328) 2024-04-25T10:04:23.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.598+0000 7ff0c2371640 1 -- 172.21.15.7:0/959421433 learned_addr learned my addr 172.21.15.7:0/959421433 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:23.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.598+0000 7ff0c136f640 1 -- 172.21.15.7:0/959421433 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3631233986 0 0) 0x7ff0bc0d1a40 con 0x7ff0bc15deb0 2024-04-25T10:04:23.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.598+0000 7ff0c136f640 1 -- 172.21.15.7:0/959421433 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0a8003520 con 0x7ff0bc15deb0 2024-04-25T10:04:23.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.598+0000 7ff0c1b70640 1 --2- 172.21.15.7:0/959421433 >> v2:172.21.15.55:3300/0 conn(0x7ff0bc0b2c30 0x7ff0bc0ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.598+0000 7ff0c2b72640 1 --2- 172.21.15.7:0/959421433 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0bc0d3760 0x7ff0bc0d3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.598+0000 7ff0c136f640 1 -- 172.21.15.7:0/959421433 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 792291146 0 0) 0x7ff0a8003520 con 0x7ff0bc15deb0 2024-04-25T10:04:23.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.598+0000 7ff0c136f640 1 -- 172.21.15.7:0/959421433 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0bc0d3760 msgr2=0x7ff0bc0d3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:23.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.598+0000 7ff0c136f640 1 --2- 172.21.15.7:0/959421433 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0bc0d3760 0x7ff0bc0d3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.598+0000 7ff0c136f640 1 -- 172.21.15.7:0/959421433 >> v2:172.21.15.55:3300/0 conn(0x7ff0bc0b2c30 msgr2=0x7ff0bc0ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:23.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.598+0000 7ff0c136f640 1 --2- 172.21.15.7:0/959421433 >> v2:172.21.15.55:3300/0 conn(0x7ff0bc0b2c30 0x7ff0bc0ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.599+0000 7ff0c136f640 1 -- 172.21.15.7:0/959421433 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0bc0d22e0 con 0x7ff0bc15deb0 2024-04-25T10:04:23.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.599+0000 7ff0c136f640 1 -- 172.21.15.7:0/959421433 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7ff0b8001670 con 0x7ff0bc15deb0 2024-04-25T10:04:23.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.599+0000 7ff0c1b70640 1 --2- 172.21.15.7:0/959421433 >> v2:172.21.15.55:3300/0 conn(0x7ff0bc0b2c30 0x7ff0bc0ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:23.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.599+0000 7ff0c136f640 1 -- 172.21.15.7:0/959421433 >> v1:172.21.15.7:6789/0 conn(0x7ff0bc15deb0 legacy=0x7ff0bc0b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.599+0000 7ff0c136f640 1 --2- 172.21.15.7:0/959421433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0a80039b0 0x7ff0a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.599+0000 7ff0c136f640 1 --2- 172.21.15.7:0/959421433 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0a8004800 0x7ff0a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.599+0000 7ff0c136f640 1 --2- 172.21.15.7:0/959421433 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0bc0d3760 0x7ff0a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.599+0000 7ff0c136f640 1 -- 172.21.15.7:0/959421433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc0d1d20 con 0x7ff0a80039b0 2024-04-25T10:04:23.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.599+0000 7ff0c136f640 1 -- 172.21.15.7:0/959421433 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc0d2000 con 0x7ff0a8004800 2024-04-25T10:04:23.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.599+0000 7ff0c136f640 1 -- 172.21.15.7:0/959421433 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a800ba70 con 0x7ff0bc0d3760 2024-04-25T10:04:23.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.599+0000 7ff0c2371640 1 --2- 172.21.15.7:0/959421433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0a80039b0 0x7ff0a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.599+0000 7ff0c1b70640 1 --2- 172.21.15.7:0/959421433 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0a8004800 0x7ff0a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.599+0000 7ff0c2b72640 1 --2- 172.21.15.7:0/959421433 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0bc0d3760 0x7ff0a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.599+0000 7ff0c2371640 1 -- 172.21.15.7:0/959421433 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0bc0d3760 msgr2=0x7ff0a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:23.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.599+0000 7ff0c2371640 1 --2- 172.21.15.7:0/959421433 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0bc0d3760 0x7ff0a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.599+0000 7ff0c2371640 1 -- 172.21.15.7:0/959421433 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0a8004800 msgr2=0x7ff0a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:23.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.599+0000 7ff0c2371640 1 --2- 172.21.15.7:0/959421433 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0a8004800 0x7ff0a8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.599+0000 7ff0c2371640 1 -- 172.21.15.7:0/959421433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a8003520 con 0x7ff0a80039b0 2024-04-25T10:04:23.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.599+0000 7ff0c1b70640 1 --2- 172.21.15.7:0/959421433 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0a8004800 0x7ff0a8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:23.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.600+0000 7ff0c2371640 1 --2- 172.21.15.7:0/959421433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0a80039b0 0x7ff0a8003dd0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8001eb0 tx=0x7ff0a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c256710de8d9ee3b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:23.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.600+0000 7ff0c136f640 1 -- 172.21.15.7:0/959421433 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8007d70 con 0x7ff0a80039b0 2024-04-25T10:04:23.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.600+0000 7ff0c136f640 1 -- 172.21.15.7:0/959421433 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b80058d0 con 0x7ff0a80039b0 2024-04-25T10:04:23.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.600+0000 7ff0c136f640 1 -- 172.21.15.7:0/959421433 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8005ca0 con 0x7ff0a80039b0 2024-04-25T10:04:23.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.600+0000 7ff0c45d5640 1 -- 172.21.15.7:0/959421433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0a80039b0 msgr2=0x7ff0a8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.600+0000 7ff0c45d5640 1 --2- 172.21.15.7:0/959421433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0a80039b0 0x7ff0a8003dd0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8001eb0 tx=0x7ff0a8005830 comp rx=0 tx=0).stop 2024-04-25T10:04:23.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.600+0000 7ff0c2b72640 1 -- 172.21.15.7:0/959421433 reap_dead start 2024-04-25T10:04:23.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.600+0000 7ff0c45d5640 1 -- 172.21.15.7:0/959421433 shutdown_connections 2024-04-25T10:04:23.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.600+0000 7ff0c45d5640 1 -- 172.21.15.7:0/959421433 >> 172.21.15.7:0/959421433 conn(0x7ff0bc0726b0 msgr2=0x7ff0bc072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:23.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.600+0000 7ff0c45d5640 1 -- 172.21.15.7:0/959421433 shutdown_connections 2024-04-25T10:04:23.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.601+0000 7ff0c45d5640 1 -- 172.21.15.7:0/959421433 wait complete. 2024-04-25T10:04:23.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.602+0000 7ff0c45d5640 1 Processor -- start 2024-04-25T10:04:23.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.602+0000 7ff0c45d5640 1 -- start start 2024-04-25T10:04:23.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.602+0000 7ff0c45d5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0a80039b0 0x7ff0bc0cc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.602+0000 7ff0c45d5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0bc0ca8a0 0x7ff0bc0cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.602+0000 7ff0c45d5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0bc1f39c0 0x7ff0bc1f3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.602+0000 7ff0c45d5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc0d3bf0 con 0x7ff0bc0ca8a0 2024-04-25T10:04:23.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.602+0000 7ff0c45d5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc0b70f0 con 0x7ff0a80039b0 2024-04-25T10:04:23.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.602+0000 7ff0c45d5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc0d3d70 con 0x7ff0bc1f39c0 2024-04-25T10:04:23.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.602+0000 7ff0c1b70640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0bc0ca8a0 0x7ff0bc0cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.603+0000 7ff0c1b70640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0bc0ca8a0 0x7ff0bc0cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37070/0 (socket says 172.21.15.7:37070) 2024-04-25T10:04:23.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.603+0000 7ff0c1b70640 1 -- 172.21.15.7:0/3727966158 learned_addr learned my addr 172.21.15.7:0/3727966158 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:23.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.603+0000 7ff0c2b72640 1 --2- 172.21.15.7:0/3727966158 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0bc1f39c0 0x7ff0bc1f3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.603+0000 7ff0c2371640 1 --2- 172.21.15.7:0/3727966158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0a80039b0 0x7ff0bc0cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.603+0000 7ff0c1b70640 1 -- 172.21.15.7:0/3727966158 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0bc1f39c0 msgr2=0x7ff0bc1f3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.603+0000 7ff0c1b70640 1 --2- 172.21.15.7:0/3727966158 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0bc1f39c0 0x7ff0bc1f3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.603+0000 7ff0c1b70640 1 -- 172.21.15.7:0/3727966158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0a80039b0 msgr2=0x7ff0bc0cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.603+0000 7ff0c1b70640 1 --2- 172.21.15.7:0/3727966158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0a80039b0 0x7ff0bc0cc970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.603+0000 7ff0c1b70640 1 -- 172.21.15.7:0/3727966158 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0bc0cadd0 con 0x7ff0bc0ca8a0 2024-04-25T10:04:23.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.603+0000 7ff0c1b70640 1 --2- 172.21.15.7:0/3727966158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0bc0ca8a0 0x7ff0bc0cceb0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac010870 tx=0x7ff0ac010d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:23.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.603+0000 7ff0b2ffd640 1 -- 172.21.15.7:0/3727966158 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac01a020 con 0x7ff0bc0ca8a0 2024-04-25T10:04:23.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.603+0000 7ff0b2ffd640 1 -- 172.21.15.7:0/3727966158 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ac00eb60 con 0x7ff0bc0ca8a0 2024-04-25T10:04:23.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.603+0000 7ff0c45d5640 1 -- 172.21.15.7:0/3727966158 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0bc0cb0b0 con 0x7ff0bc0ca8a0 2024-04-25T10:04:23.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.603+0000 7ff0b2ffd640 1 -- 172.21.15.7:0/3727966158 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac00f040 con 0x7ff0bc0ca8a0 2024-04-25T10:04:23.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.603+0000 7ff0c45d5640 1 -- 172.21.15.7:0/3727966158 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0bc0cb670 con 0x7ff0bc0ca8a0 2024-04-25T10:04:23.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.604+0000 7ff0c45d5640 1 -- 172.21.15.7:0/3727966158 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0bc068f60 con 0x7ff0bc0ca8a0 2024-04-25T10:04:23.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.605+0000 7ff0b2ffd640 1 -- 172.21.15.7:0/3727966158 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff0ac01d020 con 0x7ff0bc0ca8a0 2024-04-25T10:04:23.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.605+0000 7ff0b2ffd640 1 --2- 172.21.15.7:0/3727966158 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff0a006b4d0 0x7ff0a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.605+0000 7ff0b2ffd640 1 -- 172.21.15.7:0/3727966158 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5421+0+0 (secure 0 0 0) 0x7ff0ac08ab00 con 0x7ff0bc0ca8a0 2024-04-25T10:04:23.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.605+0000 7ff0c2371640 1 --2- 172.21.15.7:0/3727966158 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff0a006b4d0 0x7ff0a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.606+0000 7ff0c2371640 1 --2- 172.21.15.7:0/3727966158 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff0a006b4d0 0x7ff0a006d990 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8033000 tx=0x7ff0b8009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:23.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.609+0000 7ff0b2ffd640 1 -- 172.21.15.7:0/3727966158 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff0ac024020 con 0x7ff0bc0ca8a0 2024-04-25T10:04:23.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.788+0000 7ff0c45d5640 1 -- 172.21.15.7:0/3727966158 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff0bc15cc00 con 0x7ff0bc0ca8a0 2024-04-25T10:04:23.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.788+0000 7ff0b2ffd640 1 -- 172.21.15.7:0/3727966158 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v109) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff0ac059a00 con 0x7ff0bc0ca8a0 2024-04-25T10:04:23.793 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T10:04:23.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.790+0000 7ff0c45d5640 1 -- 172.21.15.7:0/3727966158 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff0a006b4d0 msgr2=0x7ff0a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.790+0000 7ff0c45d5640 1 --2- 172.21.15.7:0/3727966158 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff0a006b4d0 0x7ff0a006d990 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8033000 tx=0x7ff0b8009030 comp rx=0 tx=0).stop 2024-04-25T10:04:23.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.790+0000 7ff0c45d5640 1 -- 172.21.15.7:0/3727966158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0bc0ca8a0 msgr2=0x7ff0bc0cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.790+0000 7ff0c45d5640 1 --2- 172.21.15.7:0/3727966158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0bc0ca8a0 0x7ff0bc0cceb0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac010870 tx=0x7ff0ac010d30 comp rx=0 tx=0).stop 2024-04-25T10:04:23.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.791+0000 7ff0c45d5640 1 -- 172.21.15.7:0/3727966158 shutdown_connections 2024-04-25T10:04:23.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.791+0000 7ff0c45d5640 1 --2- 172.21.15.7:0/3727966158 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff0a006b4d0 0x7ff0a006d990 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.791+0000 7ff0c45d5640 1 --2- 172.21.15.7:0/3727966158 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff0bc1f39c0 0x7ff0bc1f3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.791+0000 7ff0c45d5640 1 --2- 172.21.15.7:0/3727966158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0bc0ca8a0 0x7ff0bc0cceb0 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.791+0000 7ff0c45d5640 1 --2- 172.21.15.7:0/3727966158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0a80039b0 0x7ff0bc0cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.791+0000 7ff0c45d5640 1 -- 172.21.15.7:0/3727966158 >> 172.21.15.7:0/3727966158 conn(0x7ff0bc0726b0 msgr2=0x7ff0bc0ce030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:23.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.791+0000 7ff0c45d5640 1 -- 172.21.15.7:0/3727966158 shutdown_connections 2024-04-25T10:04:23.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.791+0000 7ff0c45d5640 1 -- 172.21.15.7:0/3727966158 wait complete. 2024-04-25T10:04:23.806 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan' 2024-04-25T10:04:23.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.903+0000 7f7847af5640 1 Processor -- start 2024-04-25T10:04:23.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.903+0000 7f7847af5640 1 -- start start 2024-04-25T10:04:23.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.904+0000 7f7847af5640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f78400d0a50 0x7f78400d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.904+0000 7f7847af5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f78400b53b0 0x7f78400d2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.904+0000 7f7847af5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78400d1e80 con 0x7f784015db00 2024-04-25T10:04:23.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.904+0000 7f7847af5640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78400b5930 con 0x7f78400d0a50 2024-04-25T10:04:23.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.904+0000 7f7847af5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78400b5c10 con 0x7f78400b53b0 2024-04-25T10:04:23.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.904+0000 7f7845090640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f78400d0a50 0x7f78400d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.904+0000 7f7845090640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f78400d0a50 0x7f78400d2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37072/0 (socket says 172.21.15.7:37072) 2024-04-25T10:04:23.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.904+0000 7f7845090640 1 -- 172.21.15.7:0/1364043296 learned_addr learned my addr 172.21.15.7:0/1364043296 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:23.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.904+0000 7f7846092640 1 --2- 172.21.15.7:0/1364043296 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f78400b53b0 0x7f78400d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.904+0000 7f7845090640 1 -- 172.21.15.7:0/1364043296 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f78400b53b0 msgr2=0x7f78400d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:23.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.904+0000 7f7845090640 1 --2- 172.21.15.7:0/1364043296 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f78400b53b0 0x7f78400d2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.904+0000 7f7845090640 1 -- 172.21.15.7:0/1364043296 >> v1:172.21.15.55:6789/0 conn(0x7f784015db00 legacy=0x7f78400d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.904+0000 7f7845090640 1 -- 172.21.15.7:0/1364043296 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78400b5ef0 con 0x7f78400d0a50 2024-04-25T10:04:23.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.904+0000 7f7846092640 1 --2- 172.21.15.7:0/1364043296 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f78400b53b0 0x7f78400d2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:23.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.905+0000 7f7845090640 1 --2- 172.21.15.7:0/1364043296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78400d0a50 0x7f78400d2330 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f7830009870 tx=0x7f783002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c6a53b0bf903360 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:23.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.905+0000 7f784488f640 1 -- 172.21.15.7:0/1364043296 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7830037070 con 0x7f78400d0a50 2024-04-25T10:04:23.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.905+0000 7f784488f640 1 -- 172.21.15.7:0/1364043296 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7830032440 con 0x7f78400d0a50 2024-04-25T10:04:23.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.905+0000 7f784488f640 1 -- 172.21.15.7:0/1364043296 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7830032810 con 0x7f78400d0a50 2024-04-25T10:04:23.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.905+0000 7f7847af5640 1 -- 172.21.15.7:0/1364043296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78400d0a50 msgr2=0x7f78400d2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.905+0000 7f7847af5640 1 --2- 172.21.15.7:0/1364043296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78400d0a50 0x7f78400d2330 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f7830009870 tx=0x7f783002a270 comp rx=0 tx=0).stop 2024-04-25T10:04:23.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.906+0000 7f7847af5640 1 -- 172.21.15.7:0/1364043296 shutdown_connections 2024-04-25T10:04:23.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.906+0000 7f7847af5640 1 --2- 172.21.15.7:0/1364043296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78400d0a50 0x7f78400d2330 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.906+0000 7f7847af5640 1 --2- 172.21.15.7:0/1364043296 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f78400b53b0 0x7f78400d2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.906+0000 7f7847af5640 1 -- 172.21.15.7:0/1364043296 >> 172.21.15.7:0/1364043296 conn(0x7f7840072290 msgr2=0x7f78400726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:23.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.906+0000 7f7847af5640 1 -- 172.21.15.7:0/1364043296 shutdown_connections 2024-04-25T10:04:23.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.906+0000 7f7847af5640 1 -- 172.21.15.7:0/1364043296 wait complete. 2024-04-25T10:04:23.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.907+0000 7f7847af5640 1 Processor -- start 2024-04-25T10:04:23.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.907+0000 7f7847af5640 1 -- start start 2024-04-25T10:04:23.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.907+0000 7f7847af5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f78400b53b0 0x7f7840150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.907+0000 7f7847af5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78400d0a50 0x7f784015e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.907+0000 7f7847af5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f784015db00 0x7f7840156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.907+0000 7f7847af5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78400d3660 con 0x7f784015db00 2024-04-25T10:04:23.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.907+0000 7f7847af5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78400b61d0 con 0x7f78400d0a50 2024-04-25T10:04:23.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.907+0000 7f7847af5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78400ce2b0 con 0x7f78400b53b0 2024-04-25T10:04:23.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.908+0000 7f7846092640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f784015db00 0x7f7840156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.908+0000 7f7846092640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f784015db00 0x7f7840156ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37088/0 (socket says 172.21.15.7:37088) 2024-04-25T10:04:23.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.908+0000 7f7846092640 1 -- 172.21.15.7:0/2561598906 learned_addr learned my addr 172.21.15.7:0/2561598906 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:23.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.908+0000 7f7845891640 1 --2- 172.21.15.7:0/2561598906 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f78400b53b0 0x7f7840150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.908+0000 7f7845090640 1 --2- 172.21.15.7:0/2561598906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78400d0a50 0x7f784015e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.908+0000 7f7846092640 1 -- 172.21.15.7:0/2561598906 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f78400b53b0 msgr2=0x7f7840150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.908+0000 7f7846092640 1 --2- 172.21.15.7:0/2561598906 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f78400b53b0 0x7f7840150f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.908+0000 7f7846092640 1 -- 172.21.15.7:0/2561598906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78400d0a50 msgr2=0x7f784015e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.908+0000 7f7846092640 1 --2- 172.21.15.7:0/2561598906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78400d0a50 0x7f784015e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.908+0000 7f7846092640 1 -- 172.21.15.7:0/2561598906 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7840155870 con 0x7f784015db00 2024-04-25T10:04:23.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.908+0000 7f7846092640 1 --2- 172.21.15.7:0/2561598906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f784015db00 0x7f7840156ad0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f783c00e810 tx=0x7f783c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:23.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.908+0000 7f78367fc640 1 -- 172.21.15.7:0/2561598906 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c017070 con 0x7f784015db00 2024-04-25T10:04:23.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.908+0000 7f78367fc640 1 -- 172.21.15.7:0/2561598906 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783c00c6d0 con 0x7f784015db00 2024-04-25T10:04:23.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.908+0000 7f7847af5640 1 -- 172.21.15.7:0/2561598906 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7840156030 con 0x7f784015db00 2024-04-25T10:04:23.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.908+0000 7f78367fc640 1 -- 172.21.15.7:0/2561598906 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c00f040 con 0x7f784015db00 2024-04-25T10:04:23.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.908+0000 7f7847af5640 1 -- 172.21.15.7:0/2561598906 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78401562d0 con 0x7f784015db00 2024-04-25T10:04:23.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.909+0000 7f7847af5640 1 -- 172.21.15.7:0/2561598906 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7840068fd0 con 0x7f784015db00 2024-04-25T10:04:23.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.910+0000 7f78367fc640 1 -- 172.21.15.7:0/2561598906 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f783c01a070 con 0x7f784015db00 2024-04-25T10:04:23.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.910+0000 7f78367fc640 1 --2- 172.21.15.7:0/2561598906 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f782406b4d0 0x7f782406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.910+0000 7f78367fc640 1 -- 172.21.15.7:0/2561598906 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f783c089bc0 con 0x7f784015db00 2024-04-25T10:04:23.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.910+0000 7f7845891640 1 --2- 172.21.15.7:0/2561598906 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f782406b4d0 0x7f782406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.911+0000 7f7845891640 1 --2- 172.21.15.7:0/2561598906 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f782406b4d0 0x7f782406d990 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f7838007fd0 tx=0x7f7838009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:23.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:23.914+0000 7f78367fc640 1 -- 172.21.15.7:0/2561598906 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f783c058bf0 con 0x7f784015db00 2024-04-25T10:04:24.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.164+0000 7f7847af5640 1 -- 172.21.15.7:0/2561598906 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]} v 0) v1 -- 0x7f7840072f00 con 0x7f784015db00 2024-04-25T10:04:24.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.172+0000 7f78367fc640 1 -- 172.21.15.7:0/2561598906 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]}]=0 v468) v1 ==== 147+0+0 (secure 0 0 0) 0x7f783c0584f0 con 0x7f784015db00 2024-04-25T10:04:24.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.174+0000 7f7847af5640 1 -- 172.21.15.7:0/2561598906 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f782406b4d0 msgr2=0x7f782406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:24.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.174+0000 7f7847af5640 1 --2- 172.21.15.7:0/2561598906 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f782406b4d0 0x7f782406d990 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f7838007fd0 tx=0x7f7838009040 comp rx=0 tx=0).stop 2024-04-25T10:04:24.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.174+0000 7f7847af5640 1 -- 172.21.15.7:0/2561598906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f784015db00 msgr2=0x7f7840156ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:24.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.174+0000 7f7847af5640 1 --2- 172.21.15.7:0/2561598906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f784015db00 0x7f7840156ad0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f783c00e810 tx=0x7f783c00ecd0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.174+0000 7f7847af5640 1 -- 172.21.15.7:0/2561598906 shutdown_connections 2024-04-25T10:04:24.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.174+0000 7f7847af5640 1 --2- 172.21.15.7:0/2561598906 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f782406b4d0 0x7f782406d990 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.174+0000 7f7847af5640 1 --2- 172.21.15.7:0/2561598906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f784015db00 0x7f7840156ad0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.174+0000 7f7847af5640 1 --2- 172.21.15.7:0/2561598906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78400d0a50 0x7f784015e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.174+0000 7f7847af5640 1 --2- 172.21.15.7:0/2561598906 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f78400b53b0 0x7f7840150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.174+0000 7f7847af5640 1 -- 172.21.15.7:0/2561598906 >> 172.21.15.7:0/2561598906 conn(0x7f7840072290 msgr2=0x7f7840157b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:24.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.174+0000 7f7847af5640 1 -- 172.21.15.7:0/2561598906 shutdown_connections 2024-04-25T10:04:24.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.174+0000 7f7847af5640 1 -- 172.21.15.7:0/2561598906 wait complete. 2024-04-25T10:04:24.190 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T10:04:24.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.289+0000 7fc79e99e640 1 Processor -- start 2024-04-25T10:04:24.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.289+0000 7fc79e99e640 1 -- start start 2024-04-25T10:04:24.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.290+0000 7fc79e99e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc7980d3760 0x7fc79815eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:24.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.290+0000 7fc79e99e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc7980ce830 0x7fc7980b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:24.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.290+0000 7fc79e99e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7980ced10 con 0x7fc79815f1c0 2024-04-25T10:04:24.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.290+0000 7fc79e99e640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7980ce380 con 0x7fc7980d3760 2024-04-25T10:04:24.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.290+0000 7fc79e99e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc79815f000 con 0x7fc7980ce830 2024-04-25T10:04:24.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.290+0000 7fc797fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc7980d3760 0x7fc79815eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:24.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.290+0000 7fc797fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc7980d3760 0x7fc79815eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37098/0 (socket says 172.21.15.7:37098) 2024-04-25T10:04:24.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.290+0000 7fc797fff640 1 -- 172.21.15.7:0/1029871034 learned_addr learned my addr 172.21.15.7:0/1029871034 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:24.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.290+0000 7fc79cf3b640 1 --2- 172.21.15.7:0/1029871034 >> v2:172.21.15.55:3300/0 conn(0x7fc7980ce830 0x7fc7980b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:24.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.290+0000 7fc797fff640 1 -- 172.21.15.7:0/1029871034 >> v2:172.21.15.55:3300/0 conn(0x7fc7980ce830 msgr2=0x7fc7980b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:24.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.290+0000 7fc797fff640 1 --2- 172.21.15.7:0/1029871034 >> v2:172.21.15.55:3300/0 conn(0x7fc7980ce830 0x7fc7980b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.290+0000 7fc797fff640 1 -- 172.21.15.7:0/1029871034 >> v1:172.21.15.55:6789/0 conn(0x7fc79815f1c0 legacy=0x7fc7980d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:24.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.290+0000 7fc797fff640 1 -- 172.21.15.7:0/1029871034 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7980d1b40 con 0x7fc7980d3760 2024-04-25T10:04:24.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.290+0000 7fc79cf3b640 1 --2- 172.21.15.7:0/1029871034 >> v2:172.21.15.55:3300/0 conn(0x7fc7980ce830 0x7fc7980b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:24.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.291+0000 7fc797fff640 1 --2- 172.21.15.7:0/1029871034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7980d3760 0x7fc79815eac0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fc7980cf180 tx=0x7fc78802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d8de8eea9639a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:24.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.291+0000 7fc796ffd640 1 -- 172.21.15.7:0/1029871034 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc788037070 con 0x7fc7980d3760 2024-04-25T10:04:24.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.291+0000 7fc796ffd640 1 -- 172.21.15.7:0/1029871034 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc788032440 con 0x7fc7980d3760 2024-04-25T10:04:24.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.291+0000 7fc796ffd640 1 -- 172.21.15.7:0/1029871034 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc788032810 con 0x7fc7980d3760 2024-04-25T10:04:24.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.292+0000 7fc79e99e640 1 -- 172.21.15.7:0/1029871034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7980d3760 msgr2=0x7fc79815eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:24.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.292+0000 7fc79e99e640 1 --2- 172.21.15.7:0/1029871034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7980d3760 0x7fc79815eac0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fc7980cf180 tx=0x7fc78802a230 comp rx=0 tx=0).stop 2024-04-25T10:04:24.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.292+0000 7fc79e99e640 1 -- 172.21.15.7:0/1029871034 shutdown_connections 2024-04-25T10:04:24.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.292+0000 7fc79e99e640 1 --2- 172.21.15.7:0/1029871034 >> v2:172.21.15.55:3300/0 conn(0x7fc7980ce830 0x7fc7980b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.292+0000 7fc79e99e640 1 --2- 172.21.15.7:0/1029871034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7980d3760 0x7fc79815eac0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.292+0000 7fc79e99e640 1 -- 172.21.15.7:0/1029871034 >> 172.21.15.7:0/1029871034 conn(0x7fc798072680 msgr2=0x7fc798072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:24.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.292+0000 7fc79e99e640 1 -- 172.21.15.7:0/1029871034 shutdown_connections 2024-04-25T10:04:24.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.292+0000 7fc79e99e640 1 -- 172.21.15.7:0/1029871034 wait complete. 2024-04-25T10:04:24.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.293+0000 7fc79e99e640 1 Processor -- start 2024-04-25T10:04:24.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.293+0000 7fc79e99e640 1 -- start start 2024-04-25T10:04:24.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.294+0000 7fc79e99e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc7980ce830 0x7fc7981f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:24.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.294+0000 7fc79e99e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7980d3760 0x7fc7980cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:24.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.294+0000 7fc79e99e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc79815f1c0 0x7fc7980d2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:24.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.294+0000 7fc79e99e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79815de10 con 0x7fc79815f1c0 2024-04-25T10:04:24.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.294+0000 7fc79e99e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7980d2190 con 0x7fc7980d3760 2024-04-25T10:04:24.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.294+0000 7fc79e99e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7980b2780 con 0x7fc7980ce830 2024-04-25T10:04:24.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.294+0000 7fc79cf3b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc79815f1c0 0x7fc7980d2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:24.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.294+0000 7fc79cf3b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc79815f1c0 0x7fc7980d2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37106/0 (socket says 172.21.15.7:37106) 2024-04-25T10:04:24.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.294+0000 7fc79cf3b640 1 -- 172.21.15.7:0/4195520291 learned_addr learned my addr 172.21.15.7:0/4195520291 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:24.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.294+0000 7fc7977fe640 1 --2- 172.21.15.7:0/4195520291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7980d3760 0x7fc7980cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:24.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.294+0000 7fc797fff640 1 --2- 172.21.15.7:0/4195520291 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc7980ce830 0x7fc7981f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:24.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.294+0000 7fc79cf3b640 1 -- 172.21.15.7:0/4195520291 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc7980ce830 msgr2=0x7fc7981f6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:24.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.294+0000 7fc79cf3b640 1 --2- 172.21.15.7:0/4195520291 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc7980ce830 0x7fc7981f6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.294+0000 7fc79cf3b640 1 -- 172.21.15.7:0/4195520291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7980d3760 msgr2=0x7fc7980cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:24.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.294+0000 7fc79cf3b640 1 --2- 172.21.15.7:0/4195520291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7980d3760 0x7fc7980cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.294+0000 7fc79cf3b640 1 -- 172.21.15.7:0/4195520291 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7980cc3d0 con 0x7fc79815f1c0 2024-04-25T10:04:24.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.294+0000 7fc7977fe640 1 --2- 172.21.15.7:0/4195520291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7980d3760 0x7fc7980cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:24.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.294+0000 7fc797fff640 1 --2- 172.21.15.7:0/4195520291 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc7980ce830 0x7fc7981f6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:24.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.294+0000 7fc79cf3b640 1 --2- 172.21.15.7:0/4195520291 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc79815f1c0 0x7fc7980d2620 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fc79000cf20 tx=0x7fc79000a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:24.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.295+0000 7fc794ff9640 1 -- 172.21.15.7:0/4195520291 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79001a070 con 0x7fc79815f1c0 2024-04-25T10:04:24.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.295+0000 7fc794ff9640 1 -- 172.21.15.7:0/4195520291 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79000d840 con 0x7fc79815f1c0 2024-04-25T10:04:24.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.295+0000 7fc79e99e640 1 -- 172.21.15.7:0/4195520291 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7980cc6b0 con 0x7fc79815f1c0 2024-04-25T10:04:24.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.295+0000 7fc794ff9640 1 -- 172.21.15.7:0/4195520291 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79000dc30 con 0x7fc79815f1c0 2024-04-25T10:04:24.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.295+0000 7fc79e99e640 1 -- 172.21.15.7:0/4195520291 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7980ccc70 con 0x7fc79815f1c0 2024-04-25T10:04:24.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.296+0000 7fc79e99e640 1 -- 172.21.15.7:0/4195520291 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc798068f60 con 0x7fc79815f1c0 2024-04-25T10:04:24.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.296+0000 7fc794ff9640 1 -- 172.21.15.7:0/4195520291 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc79001d070 con 0x7fc79815f1c0 2024-04-25T10:04:24.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.296+0000 7fc794ff9640 1 --2- 172.21.15.7:0/4195520291 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc78406b4d0 0x7fc78406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:24.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.297+0000 7fc794ff9640 1 -- 172.21.15.7:0/4195520291 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5421+0+0 (secure 0 0 0) 0x7fc79008a8e0 con 0x7fc79815f1c0 2024-04-25T10:04:24.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.297+0000 7fc797fff640 1 --2- 172.21.15.7:0/4195520291 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc78406b4d0 0x7fc78406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:24.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.297+0000 7fc797fff640 1 --2- 172.21.15.7:0/4195520291 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc78406b4d0 0x7fc78406d990 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fc788034000 tx=0x7fc78802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:24.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.301+0000 7fc794ff9640 1 -- 172.21.15.7:0/4195520291 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc790059880 con 0x7fc79815f1c0 2024-04-25T10:04:24.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.484+0000 7fc79e99e640 1 -- 172.21.15.7:0/4195520291 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc7980ce610 con 0x7fc79815f1c0 2024-04-25T10:04:24.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.490+0000 7fc794ff9640 1 -- 172.21.15.7:0/4195520291 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc790059180 con 0x7fc79815f1c0 2024-04-25T10:04:24.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.492+0000 7fc79e99e640 1 -- 172.21.15.7:0/4195520291 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc78406b4d0 msgr2=0x7fc78406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:24.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.492+0000 7fc79e99e640 1 --2- 172.21.15.7:0/4195520291 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc78406b4d0 0x7fc78406d990 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fc788034000 tx=0x7fc78802e000 comp rx=0 tx=0).stop 2024-04-25T10:04:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.492+0000 7fc79e99e640 1 -- 172.21.15.7:0/4195520291 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc79815f1c0 msgr2=0x7fc7980d2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.492+0000 7fc79e99e640 1 --2- 172.21.15.7:0/4195520291 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc79815f1c0 0x7fc7980d2620 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fc79000cf20 tx=0x7fc79000a7d0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.492+0000 7fc79e99e640 1 -- 172.21.15.7:0/4195520291 shutdown_connections 2024-04-25T10:04:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.492+0000 7fc79e99e640 1 --2- 172.21.15.7:0/4195520291 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc78406b4d0 0x7fc78406d990 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.492+0000 7fc79e99e640 1 --2- 172.21.15.7:0/4195520291 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc79815f1c0 0x7fc7980d2620 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.492+0000 7fc79e99e640 1 --2- 172.21.15.7:0/4195520291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7980d3760 0x7fc7980cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.492+0000 7fc79e99e640 1 --2- 172.21.15.7:0/4195520291 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc7980ce830 0x7fc7981f6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.492+0000 7fc79e99e640 1 -- 172.21.15.7:0/4195520291 >> 172.21.15.7:0/4195520291 conn(0x7fc798072680 msgr2=0x7fc79815d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.492+0000 7fc79e99e640 1 -- 172.21.15.7:0/4195520291 shutdown_connections 2024-04-25T10:04:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.492+0000 7fc79e99e640 1 -- 172.21.15.7:0/4195520291 wait complete. 2024-04-25T10:04:24.507 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T10:04:24.507 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:04:24.550 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:04:24.594 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T10:04:24.594 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:04:24.594 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:24.610 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13704 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:04:24.610 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T10:04:24.610 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:24.654 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19023 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:04:24.654 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:04:24.654 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:24.670 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13704 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:04:24.670 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T10:04:24.670 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:24.716 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19023 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:04:24.717 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T10:04:24.717 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:04:24.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.813+0000 7ff9e1637640 1 Processor -- start 2024-04-25T10:04:24.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.813+0000 7ff9e1637640 1 -- start start 2024-04-25T10:04:24.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.814+0000 7ff9e1637640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff9dc0d0aa0 0x7ff9dc161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:24.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.814+0000 7ff9e1637640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff9dc1622b0 0x7ff9dc0ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:24.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.814+0000 7ff9e1637640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9dc15e8a0 con 0x7ff9dc15da60 2024-04-25T10:04:24.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.814+0000 7ff9e1637640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9dc15eb80 con 0x7ff9dc1622b0 2024-04-25T10:04:24.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.814+0000 7ff9e1637640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9dc15ee60 con 0x7ff9dc0d0aa0 2024-04-25T10:04:24.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.814+0000 7ff9db7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff9dc1622b0 0x7ff9dc0ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:24.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.814+0000 7ff9db7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff9dc1622b0 0x7ff9dc0ce520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37122/0 (socket says 172.21.15.7:37122) 2024-04-25T10:04:24.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.814+0000 7ff9db7fe640 1 -- 172.21.15.7:0/3872323728 learned_addr learned my addr 172.21.15.7:0/3872323728 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:24.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.814+0000 7ff9da7fc640 1 --2- 172.21.15.7:0/3872323728 >> v2:172.21.15.55:3300/0 conn(0x7ff9dc0d0aa0 0x7ff9dc161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:24.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.814+0000 7ff9db7fe640 1 -- 172.21.15.7:0/3872323728 >> v2:172.21.15.55:3300/0 conn(0x7ff9dc0d0aa0 msgr2=0x7ff9dc161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:24.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.814+0000 7ff9db7fe640 1 --2- 172.21.15.7:0/3872323728 >> v2:172.21.15.55:3300/0 conn(0x7ff9dc0d0aa0 0x7ff9dc161d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.814+0000 7ff9db7fe640 1 -- 172.21.15.7:0/3872323728 >> v1:172.21.15.55:6789/0 conn(0x7ff9dc15da60 legacy=0x7ff9dc15de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:24.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.814+0000 7ff9db7fe640 1 -- 172.21.15.7:0/3872323728 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9dc161850 con 0x7ff9dc1622b0 2024-04-25T10:04:24.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.815+0000 7ff9db7fe640 1 --2- 172.21.15.7:0/3872323728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9dc1622b0 0x7ff9dc0ce520 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc0b3260 tx=0x7ff9d402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab6e7feb1971c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:24.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.815+0000 7ff9d9ffb640 1 -- 172.21.15.7:0/3872323728 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d4036070 con 0x7ff9dc1622b0 2024-04-25T10:04:24.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.815+0000 7ff9d9ffb640 1 -- 172.21.15.7:0/3872323728 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d4031600 con 0x7ff9dc1622b0 2024-04-25T10:04:24.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.815+0000 7ff9d9ffb640 1 -- 172.21.15.7:0/3872323728 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d40319d0 con 0x7ff9dc1622b0 2024-04-25T10:04:24.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.816+0000 7ff9e1637640 1 -- 172.21.15.7:0/3872323728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9dc1622b0 msgr2=0x7ff9dc0ce520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:24.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.816+0000 7ff9e1637640 1 --2- 172.21.15.7:0/3872323728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9dc1622b0 0x7ff9dc0ce520 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc0b3260 tx=0x7ff9d402a660 comp rx=0 tx=0).stop 2024-04-25T10:04:24.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.816+0000 7ff9e1637640 1 -- 172.21.15.7:0/3872323728 shutdown_connections 2024-04-25T10:04:24.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.816+0000 7ff9e1637640 1 --2- 172.21.15.7:0/3872323728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9dc1622b0 0x7ff9dc0ce520 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.816+0000 7ff9e1637640 1 --2- 172.21.15.7:0/3872323728 >> v2:172.21.15.55:3300/0 conn(0x7ff9dc0d0aa0 0x7ff9dc161d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.816+0000 7ff9e1637640 1 -- 172.21.15.7:0/3872323728 >> 172.21.15.7:0/3872323728 conn(0x7ff9dc06bfe0 msgr2=0x7ff9dc06c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:24.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.816+0000 7ff9e1637640 1 -- 172.21.15.7:0/3872323728 shutdown_connections 2024-04-25T10:04:24.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.816+0000 7ff9e1637640 1 -- 172.21.15.7:0/3872323728 wait complete. 2024-04-25T10:04:24.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.817+0000 7ff9e1637640 1 Processor -- start 2024-04-25T10:04:24.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.817+0000 7ff9e1637640 1 -- start start 2024-04-25T10:04:24.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.818+0000 7ff9e1637640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9dc0d0aa0 0x7ff9dc156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:24.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.818+0000 7ff9e1637640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9dc15da60 0x7ff9dc1568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:24.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.818+0000 7ff9e1637640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9dc1622b0 0x7ff9dc0b69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:24.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.818+0000 7ff9e1637640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc0cebe0 con 0x7ff9dc1622b0 2024-04-25T10:04:24.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.818+0000 7ff9e1637640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc0cea60 con 0x7ff9dc0d0aa0 2024-04-25T10:04:24.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.818+0000 7ff9e1637640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc0ced60 con 0x7ff9dc15da60 2024-04-25T10:04:24.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.818+0000 7ff9db7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9dc1622b0 0x7ff9dc0b69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:24.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.818+0000 7ff9db7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9dc1622b0 0x7ff9dc0b69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37134/0 (socket says 172.21.15.7:37134) 2024-04-25T10:04:24.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.818+0000 7ff9db7fe640 1 -- 172.21.15.7:0/1824663084 learned_addr learned my addr 172.21.15.7:0/1824663084 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:24.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.818+0000 7ff9daffd640 1 --2- 172.21.15.7:0/1824663084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9dc0d0aa0 0x7ff9dc156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:24.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.818+0000 7ff9da7fc640 1 --2- 172.21.15.7:0/1824663084 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9dc15da60 0x7ff9dc1568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:24.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.818+0000 7ff9db7fe640 1 -- 172.21.15.7:0/1824663084 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9dc15da60 msgr2=0x7ff9dc1568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:24.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.818+0000 7ff9db7fe640 1 --2- 172.21.15.7:0/1824663084 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9dc15da60 0x7ff9dc1568b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.818+0000 7ff9db7fe640 1 -- 172.21.15.7:0/1824663084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9dc0d0aa0 msgr2=0x7ff9dc156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:24.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.818+0000 7ff9db7fe640 1 --2- 172.21.15.7:0/1824663084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9dc0d0aa0 0x7ff9dc156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.818+0000 7ff9db7fe640 1 -- 172.21.15.7:0/1824663084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9dc0b4330 con 0x7ff9dc1622b0 2024-04-25T10:04:24.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.818+0000 7ff9da7fc640 1 --2- 172.21.15.7:0/1824663084 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9dc15da60 0x7ff9dc1568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:24.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.818+0000 7ff9daffd640 1 --2- 172.21.15.7:0/1824663084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9dc0d0aa0 0x7ff9dc156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:24.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.818+0000 7ff9db7fe640 1 --2- 172.21.15.7:0/1824663084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9dc1622b0 0x7ff9dc0b69f0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4009f40 tx=0x7ff9d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:24.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.819+0000 7ff9c37fe640 1 -- 172.21.15.7:0/1824663084 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d4036050 con 0x7ff9dc1622b0 2024-04-25T10:04:24.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.819+0000 7ff9c37fe640 1 -- 172.21.15.7:0/1824663084 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d4042070 con 0x7ff9dc1622b0 2024-04-25T10:04:24.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.819+0000 7ff9e1637640 1 -- 172.21.15.7:0/1824663084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9dc1e7f30 con 0x7ff9dc1622b0 2024-04-25T10:04:24.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.819+0000 7ff9c37fe640 1 -- 172.21.15.7:0/1824663084 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d4009510 con 0x7ff9dc1622b0 2024-04-25T10:04:24.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.819+0000 7ff9e1637640 1 -- 172.21.15.7:0/1824663084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9dc1e7be0 con 0x7ff9dc1622b0 2024-04-25T10:04:24.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.820+0000 7ff9e1637640 1 -- 172.21.15.7:0/1824663084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9dc068fd0 con 0x7ff9dc1622b0 2024-04-25T10:04:24.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.820+0000 7ff9c37fe640 1 -- 172.21.15.7:0/1824663084 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff9d4007bd0 con 0x7ff9dc1622b0 2024-04-25T10:04:24.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.821+0000 7ff9c37fe640 1 --2- 172.21.15.7:0/1824663084 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff9c806b4d0 0x7ff9c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:24.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.821+0000 7ff9c37fe640 1 -- 172.21.15.7:0/1824663084 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5421+0+0 (secure 0 0 0) 0x7ff9d40aaf90 con 0x7ff9dc1622b0 2024-04-25T10:04:24.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.821+0000 7ff9daffd640 1 --2- 172.21.15.7:0/1824663084 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff9c806b4d0 0x7ff9c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:24.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.821+0000 7ff9daffd640 1 --2- 172.21.15.7:0/1824663084 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff9c806b4d0 0x7ff9c806d990 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00a830 tx=0x7ff9cc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:24.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:24.825+0000 7ff9c37fe640 1 -- 172.21.15.7:0/1824663084 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff9d4079f30 con 0x7ff9dc1622b0 2024-04-25T10:04:25.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.041+0000 7ff9e1637640 1 -- 172.21.15.7:0/1824663084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9dc0d1560 con 0x7ff9dc1622b0 2024-04-25T10:04:25.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.041+0000 7ff9c37fe640 1 -- 172.21.15.7:0/1824663084 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+3693 (secure 0 0 0) 0x7ff9d4079830 con 0x7ff9dc1622b0 2024-04-25T10:04:25.046 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:25.046 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":83,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6617,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3278722694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3278722694},{"type":"v1","addr":"172.21.15.55:6835","nonce":3278722694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":7435,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3598653097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3598653097},{"type":"v1","addr":"172.21.15.55:6834","nonce":3598653097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70},{"gid":8361,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3628875229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3628875229},{"type":"v1","addr":"172.21.15.7:6836","nonce":3628875229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":8883,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1325218305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":1325218305},{"type":"v1","addr":"172.21.15.7:6837","nonce":1325218305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81}],"filesystems":[]} 2024-04-25T10:04:25.046 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 83 2024-04-25T10:04:25.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.043+0000 7ff9e1637640 1 -- 172.21.15.7:0/1824663084 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff9c806b4d0 msgr2=0x7ff9c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:25.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.043+0000 7ff9e1637640 1 --2- 172.21.15.7:0/1824663084 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff9c806b4d0 0x7ff9c806d990 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00a830 tx=0x7ff9cc008040 comp rx=0 tx=0).stop 2024-04-25T10:04:25.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.043+0000 7ff9e1637640 1 -- 172.21.15.7:0/1824663084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9dc1622b0 msgr2=0x7ff9dc0b69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:25.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.043+0000 7ff9e1637640 1 --2- 172.21.15.7:0/1824663084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9dc1622b0 0x7ff9dc0b69f0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4009f40 tx=0x7ff9d4004a40 comp rx=0 tx=0).stop 2024-04-25T10:04:25.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.043+0000 7ff9e1637640 1 -- 172.21.15.7:0/1824663084 shutdown_connections 2024-04-25T10:04:25.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.043+0000 7ff9e1637640 1 --2- 172.21.15.7:0/1824663084 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff9c806b4d0 0x7ff9c806d990 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.043+0000 7ff9e1637640 1 --2- 172.21.15.7:0/1824663084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9dc1622b0 0x7ff9dc0b69f0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.043+0000 7ff9e1637640 1 --2- 172.21.15.7:0/1824663084 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9dc15da60 0x7ff9dc1568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.043+0000 7ff9e1637640 1 --2- 172.21.15.7:0/1824663084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9dc0d0aa0 0x7ff9dc156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.043+0000 7ff9e1637640 1 -- 172.21.15.7:0/1824663084 >> 172.21.15.7:0/1824663084 conn(0x7ff9dc06bfe0 msgr2=0x7ff9dc073700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:25.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.043+0000 7ff9e1637640 1 -- 172.21.15.7:0/1824663084 shutdown_connections 2024-04-25T10:04:25.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.043+0000 7ff9e1637640 1 -- 172.21.15.7:0/1824663084 wait complete. 2024-04-25T10:04:25.059 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T10:04:25.059 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T10:04:25.059 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T10:04:25.059 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:04:25.059 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T10:04:25.060 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T10:04:25.060 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T10:04:25.060 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:04:25.060 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T10:04:25.060 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T10:04:25.060 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T10:04:25.060 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:04:25.061 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T10:04:25.061 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T10:04:25.061 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T10:04:25.061 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:04:25.069 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T10:04:25.069 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T10:04:25.069 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T10:04:25.070 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T10:04:25.073 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T10:04:25.074 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T10:04:25.074 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T10:04:25.075 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T10:04:25.111 INFO:tasks.ceph.mds.a:Started 2024-04-25T10:04:25.112 DEBUG:teuthology.parallel:result is None 2024-04-25T10:04:25.112 INFO:tasks.ceph.mds.c:Started 2024-04-25T10:04:25.112 DEBUG:teuthology.parallel:result is None 2024-04-25T10:04:25.116 INFO:tasks.ceph.mds.b:Started 2024-04-25T10:04:25.116 DEBUG:teuthology.parallel:result is None 2024-04-25T10:04:25.117 INFO:tasks.ceph.mds.d:Started 2024-04-25T10:04:25.117 DEBUG:teuthology.parallel:result is None 2024-04-25T10:04:25.117 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T10:04:25.187 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-04-25T10:04:25.187 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-04-25T10:04:25.188 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-04-25T10:04:25.184+0000 7f565f0fd640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-04-25T10:04:25.202 INFO:tasks.ceph.mds.b.smithi055.stdout:starting mds.b at 2024-04-25T10:04:25.202 INFO:tasks.ceph.mds.d.smithi055.stdout:starting mds.d at 2024-04-25T10:04:25.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.219+0000 7fd7b6f3b640 1 Processor -- start 2024-04-25T10:04:25.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.219+0000 7fd7b6f3b640 1 -- start start 2024-04-25T10:04:25.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.220+0000 7fd7b6f3b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd7b015db00 0x7fd7b00d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:25.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.220+0000 7fd7b6f3b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd7b00ce2b0 0x7fd7b00d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:25.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.220+0000 7fd7b6f3b640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7b00d1e80 con 0x7fd7b00b53b0 2024-04-25T10:04:25.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.220+0000 7fd7b6f3b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7b00b5930 con 0x7fd7b00ce2b0 2024-04-25T10:04:25.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.220+0000 7fd7b6f3b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b00b5c10 con 0x7fd7b015db00 2024-04-25T10:04:25.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.220+0000 7fd7affff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd7b00b53b0 0x7fd7b0161670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58354/0 (socket says 172.21.15.7:58354) 2024-04-25T10:04:25.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.220+0000 7fd7affff640 1 -- 172.21.15.7:0/2425097697 learned_addr learned my addr 172.21.15.7:0/2425097697 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:25.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.220+0000 7fd7b54d8640 1 --2- 172.21.15.7:0/2425097697 >> v2:172.21.15.55:3300/0 conn(0x7fd7b00ce2b0 0x7fd7b00d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:25.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.220+0000 7fd7b4cd7640 1 --2- 172.21.15.7:0/2425097697 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd7b015db00 0x7fd7b00d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:25.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.221+0000 7fd7af7fe640 1 -- 172.21.15.7:0/2425097697 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3299766127 0 0) 0x7fd7b00d1e80 con 0x7fd7b00b53b0 2024-04-25T10:04:25.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.221+0000 7fd7af7fe640 1 -- 172.21.15.7:0/2425097697 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7a0003520 con 0x7fd7b00b53b0 2024-04-25T10:04:25.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.221+0000 7fd7b4cd7640 1 -- 172.21.15.7:0/2425097697 >> v2:172.21.15.55:3300/0 conn(0x7fd7b00ce2b0 msgr2=0x7fd7b00d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:25.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.221+0000 7fd7b4cd7640 1 --2- 172.21.15.7:0/2425097697 >> v2:172.21.15.55:3300/0 conn(0x7fd7b00ce2b0 0x7fd7b00d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.221+0000 7fd7b4cd7640 1 -- 172.21.15.7:0/2425097697 >> v1:172.21.15.7:6789/0 conn(0x7fd7b00b53b0 legacy=0x7fd7b0161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:25.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.221+0000 7fd7b4cd7640 1 -- 172.21.15.7:0/2425097697 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b00b5ef0 con 0x7fd7b015db00 2024-04-25T10:04:25.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.221+0000 7fd7b54d8640 1 --2- 172.21.15.7:0/2425097697 >> v2:172.21.15.55:3300/0 conn(0x7fd7b00ce2b0 0x7fd7b00d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:25.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.221+0000 7fd7b4cd7640 1 --2- 172.21.15.7:0/2425097697 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd7b015db00 0x7fd7b00d0340 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd7a40097a0 tx=0x7fd7a402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60bc9d9afb2d49a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:25.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.222+0000 7fd7af7fe640 1 -- 172.21.15.7:0/2425097697 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4037070 con 0x7fd7b015db00 2024-04-25T10:04:25.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.222+0000 7fd7af7fe640 1 -- 172.21.15.7:0/2425097697 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a4032440 con 0x7fd7b015db00 2024-04-25T10:04:25.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.222+0000 7fd7af7fe640 1 -- 172.21.15.7:0/2425097697 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a40327f0 con 0x7fd7b015db00 2024-04-25T10:04:25.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.222+0000 7fd7b6f3b640 1 -- 172.21.15.7:0/2425097697 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd7b015db00 msgr2=0x7fd7b00d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:25.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.222+0000 7fd7b6f3b640 1 --2- 172.21.15.7:0/2425097697 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd7b015db00 0x7fd7b00d0340 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd7a40097a0 tx=0x7fd7a402a180 comp rx=0 tx=0).stop 2024-04-25T10:04:25.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.222+0000 7fd7b6f3b640 1 -- 172.21.15.7:0/2425097697 shutdown_connections 2024-04-25T10:04:25.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.222+0000 7fd7b6f3b640 1 --2- 172.21.15.7:0/2425097697 >> v2:172.21.15.55:3300/0 conn(0x7fd7b00ce2b0 0x7fd7b00d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.222+0000 7fd7b6f3b640 1 --2- 172.21.15.7:0/2425097697 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd7b015db00 0x7fd7b00d0340 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.222+0000 7fd7b6f3b640 1 -- 172.21.15.7:0/2425097697 >> 172.21.15.7:0/2425097697 conn(0x7fd7b0072290 msgr2=0x7fd7b00726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:25.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.222+0000 7fd7b6f3b640 1 -- 172.21.15.7:0/2425097697 shutdown_connections 2024-04-25T10:04:25.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.222+0000 7fd7b6f3b640 1 -- 172.21.15.7:0/2425097697 wait complete. 2024-04-25T10:04:25.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.223+0000 7fd7b6f3b640 1 Processor -- start 2024-04-25T10:04:25.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.223+0000 7fd7b6f3b640 1 -- start start 2024-04-25T10:04:25.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.224+0000 7fd7b6f3b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd7b00b53b0 0x7fd7b01606c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:25.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.224+0000 7fd7b6f3b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7b00ce2b0 0x7fd7b01f46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:25.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.224+0000 7fd7b6f3b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7b015db00 0x7fd7b014e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:25.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.224+0000 7fd7b6f3b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b00d3660 con 0x7fd7b00ce2b0 2024-04-25T10:04:25.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.224+0000 7fd7b6f3b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b00b61d0 con 0x7fd7b015db00 2024-04-25T10:04:25.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.224+0000 7fd7b6f3b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b00b6c10 con 0x7fd7b00b53b0 2024-04-25T10:04:25.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.224+0000 7fd7affff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7b00ce2b0 0x7fd7b01f46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:25.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.224+0000 7fd7affff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7b00ce2b0 0x7fd7b01f46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37156/0 (socket says 172.21.15.7:37156) 2024-04-25T10:04:25.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.224+0000 7fd7affff640 1 -- 172.21.15.7:0/825620545 learned_addr learned my addr 172.21.15.7:0/825620545 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:25.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.225+0000 7fd7b54d8640 1 --2- 172.21.15.7:0/825620545 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7b015db00 0x7fd7b014e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:25.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.225+0000 7fd7b4cd7640 1 --2- 172.21.15.7:0/825620545 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd7b00b53b0 0x7fd7b01606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:25.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.225+0000 7fd7affff640 1 -- 172.21.15.7:0/825620545 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd7b00b53b0 msgr2=0x7fd7b01606c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:25.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.225+0000 7fd7affff640 1 --2- 172.21.15.7:0/825620545 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd7b00b53b0 0x7fd7b01606c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.225+0000 7fd7affff640 1 -- 172.21.15.7:0/825620545 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7b015db00 msgr2=0x7fd7b014e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:25.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.225+0000 7fd7affff640 1 --2- 172.21.15.7:0/825620545 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7b015db00 0x7fd7b014e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.225+0000 7fd7affff640 1 -- 172.21.15.7:0/825620545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b015f920 con 0x7fd7b00ce2b0 2024-04-25T10:04:25.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.225+0000 7fd7affff640 1 --2- 172.21.15.7:0/825620545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7b00ce2b0 0x7fd7b01f46f0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fd79c00c430 tx=0x7fd79c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:25.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.225+0000 7fd7ad7fa640 1 -- 172.21.15.7:0/825620545 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79c017070 con 0x7fd7b00ce2b0 2024-04-25T10:04:25.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.225+0000 7fd7ad7fa640 1 -- 172.21.15.7:0/825620545 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd79c005ce0 con 0x7fd7b00ce2b0 2024-04-25T10:04:25.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.225+0000 7fd7b6f3b640 1 -- 172.21.15.7:0/825620545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b015fc00 con 0x7fd7b00ce2b0 2024-04-25T10:04:25.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.225+0000 7fd7ad7fa640 1 -- 172.21.15.7:0/825620545 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79c0072f0 con 0x7fd7b00ce2b0 2024-04-25T10:04:25.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.225+0000 7fd7b6f3b640 1 -- 172.21.15.7:0/825620545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b01601c0 con 0x7fd7b00ce2b0 2024-04-25T10:04:25.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.226+0000 7fd7b6f3b640 1 -- 172.21.15.7:0/825620545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b0068fd0 con 0x7fd7b00ce2b0 2024-04-25T10:04:25.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.227+0000 7fd7ad7fa640 1 -- 172.21.15.7:0/825620545 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd79c01a070 con 0x7fd7b00ce2b0 2024-04-25T10:04:25.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.227+0000 7fd7ad7fa640 1 --2- 172.21.15.7:0/825620545 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd79406b4d0 0x7fd79406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:25.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.227+0000 7fd7ad7fa640 1 -- 172.21.15.7:0/825620545 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5421+0+0 (secure 0 0 0) 0x7fd79c089440 con 0x7fd7b00ce2b0 2024-04-25T10:04:25.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.227+0000 7fd7b4cd7640 1 --2- 172.21.15.7:0/825620545 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd79406b4d0 0x7fd79406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:25.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.228+0000 7fd7b4cd7640 1 --2- 172.21.15.7:0/825620545 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd79406b4d0 0x7fd79406d990 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4034000 tx=0x7fd7a402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:25.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.232+0000 7fd7ad7fa640 1 -- 172.21.15.7:0/825620545 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd79c057d90 con 0x7fd7b00ce2b0 2024-04-25T10:04:25.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:25.424+0000 7fd7b6f3b640 1 -- 172.21.15.7:0/825620545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd7b00d16b0 con 0x7fd7b00ce2b0 2024-04-25T10:04:26.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.198+0000 7fd7ad7fa640 1 -- 172.21.15.7:0/825620545 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v111) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd79c05be30 con 0x7fd7b00ce2b0 2024-04-25T10:04:26.203 INFO:teuthology.orchestra.run.smithi007.stderr: removed all blocklist entries 2024-04-25T10:04:26.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.201+0000 7fd7b6f3b640 1 -- 172.21.15.7:0/825620545 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd79406b4d0 msgr2=0x7fd79406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:26.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.201+0000 7fd7b6f3b640 1 --2- 172.21.15.7:0/825620545 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd79406b4d0 0x7fd79406d990 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4034000 tx=0x7fd7a402e000 comp rx=0 tx=0).stop 2024-04-25T10:04:26.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.201+0000 7fd7b6f3b640 1 -- 172.21.15.7:0/825620545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7b00ce2b0 msgr2=0x7fd7b01f46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:26.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.201+0000 7fd7b6f3b640 1 --2- 172.21.15.7:0/825620545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7b00ce2b0 0x7fd7b01f46f0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fd79c00c430 tx=0x7fd79c00c830 comp rx=0 tx=0).stop 2024-04-25T10:04:26.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.201+0000 7fd7b6f3b640 1 -- 172.21.15.7:0/825620545 shutdown_connections 2024-04-25T10:04:26.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.201+0000 7fd7b6f3b640 1 --2- 172.21.15.7:0/825620545 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd79406b4d0 0x7fd79406d990 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.201+0000 7fd7b6f3b640 1 --2- 172.21.15.7:0/825620545 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7b015db00 0x7fd7b014e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.201+0000 7fd7b6f3b640 1 --2- 172.21.15.7:0/825620545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd7b00ce2b0 0x7fd7b01f46f0 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.201+0000 7fd7b6f3b640 1 --2- 172.21.15.7:0/825620545 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd7b00b53b0 0x7fd7b01606c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.201+0000 7fd7b6f3b640 1 -- 172.21.15.7:0/825620545 >> 172.21.15.7:0/825620545 conn(0x7fd7b0072290 msgr2=0x7fd7b00c8330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:26.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.201+0000 7fd7b6f3b640 1 -- 172.21.15.7:0/825620545 shutdown_connections 2024-04-25T10:04:26.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.201+0000 7fd7b6f3b640 1 -- 172.21.15.7:0/825620545 wait complete. 2024-04-25T10:04:26.219 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T10:04:26.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.318+0000 7fd2eaff9640 1 Processor -- start 2024-04-25T10:04:26.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.319+0000 7fd2eaff9640 1 -- start start 2024-04-25T10:04:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.319+0000 7fd2eaff9640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2e40cd740 0x7fd2e40d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.319+0000 7fd2eaff9640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd2e40d08d0 0x7fd2e406c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.319+0000 7fd2eaff9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd2e406cbc0 0x7fd2e4161830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.319+0000 7fd2eaff9640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e40cdb20 con 0x7fd2e40d08d0 2024-04-25T10:04:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.319+0000 7fd2eaff9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e4099b90 con 0x7fd2e406cbc0 2024-04-25T10:04:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.319+0000 7fd2eaff9640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e4099e70 con 0x7fd2e40cd740 2024-04-25T10:04:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.319+0000 7fd2e3fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd2e40d08d0 0x7fd2e406c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.320+0000 7fd2e3fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd2e40d08d0 0x7fd2e406c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37166/0 (socket says 172.21.15.7:37166) 2024-04-25T10:04:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.320+0000 7fd2e3fff640 1 -- 172.21.15.7:0/2279695857 learned_addr learned my addr 172.21.15.7:0/2279695857 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.320+0000 7fd2e9596640 1 --2- 172.21.15.7:0/2279695857 >> v2:172.21.15.55:3300/0 conn(0x7fd2e406cbc0 0x7fd2e4161830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.320+0000 7fd2e8d95640 1 --2- 172.21.15.7:0/2279695857 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2e40cd740 0x7fd2e40d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.320+0000 7fd2e3fff640 1 -- 172.21.15.7:0/2279695857 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2e40cd740 msgr2=0x7fd2e40d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:26.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.320+0000 7fd2e3fff640 1 --2- 172.21.15.7:0/2279695857 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2e40cd740 0x7fd2e40d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.320+0000 7fd2e3fff640 1 -- 172.21.15.7:0/2279695857 >> v2:172.21.15.55:3300/0 conn(0x7fd2e406cbc0 msgr2=0x7fd2e4161830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:26.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.320+0000 7fd2e3fff640 1 --2- 172.21.15.7:0/2279695857 >> v2:172.21.15.55:3300/0 conn(0x7fd2e406cbc0 0x7fd2e4161830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.320+0000 7fd2e3fff640 1 -- 172.21.15.7:0/2279695857 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e409a150 con 0x7fd2e40d08d0 2024-04-25T10:04:26.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.321+0000 7fd2e3fff640 1 --2- 172.21.15.7:0/2279695857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2e40d08d0 0x7fd2e406c680 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fd2e40b3fe0 tx=0x7fd2d002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=125001333bbe07d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:26.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.321+0000 7fd2e37fe640 1 -- 172.21.15.7:0/2279695857 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0037070 con 0x7fd2e40d08d0 2024-04-25T10:04:26.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.321+0000 7fd2e37fe640 1 -- 172.21.15.7:0/2279695857 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d0032440 con 0x7fd2e40d08d0 2024-04-25T10:04:26.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.321+0000 7fd2e37fe640 1 -- 172.21.15.7:0/2279695857 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0032810 con 0x7fd2e40d08d0 2024-04-25T10:04:26.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.321+0000 7fd2eaff9640 1 -- 172.21.15.7:0/2279695857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2e40d08d0 msgr2=0x7fd2e406c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:26.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.321+0000 7fd2eaff9640 1 --2- 172.21.15.7:0/2279695857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2e40d08d0 0x7fd2e406c680 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fd2e40b3fe0 tx=0x7fd2d002a1e0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.321+0000 7fd2eaff9640 1 -- 172.21.15.7:0/2279695857 shutdown_connections 2024-04-25T10:04:26.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.321+0000 7fd2eaff9640 1 --2- 172.21.15.7:0/2279695857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2e40d08d0 0x7fd2e406c680 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.321+0000 7fd2eaff9640 1 --2- 172.21.15.7:0/2279695857 >> v2:172.21.15.55:3300/0 conn(0x7fd2e406cbc0 0x7fd2e4161830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.321+0000 7fd2eaff9640 1 --2- 172.21.15.7:0/2279695857 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2e40cd740 0x7fd2e40d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.321+0000 7fd2eaff9640 1 -- 172.21.15.7:0/2279695857 >> 172.21.15.7:0/2279695857 conn(0x7fd2e40b3130 msgr2=0x7fd2e40b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:26.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.321+0000 7fd2eaff9640 1 -- 172.21.15.7:0/2279695857 shutdown_connections 2024-04-25T10:04:26.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.321+0000 7fd2eaff9640 1 -- 172.21.15.7:0/2279695857 wait complete. 2024-04-25T10:04:26.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.323+0000 7fd2eaff9640 1 Processor -- start 2024-04-25T10:04:26.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.323+0000 7fd2eaff9640 1 -- start start 2024-04-25T10:04:26.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.323+0000 7fd2eaff9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2e406cbc0 0x7fd2e4151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.323+0000 7fd2eaff9640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2e40cd740 0x7fd2e40cac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.323+0000 7fd2eaff9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2e40d08d0 0x7fd2e40cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.323+0000 7fd2eaff9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e409ac30 con 0x7fd2e40d08d0 2024-04-25T10:04:26.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.323+0000 7fd2eaff9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e409a710 con 0x7fd2e406cbc0 2024-04-25T10:04:26.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.323+0000 7fd2eaff9640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e409adb0 con 0x7fd2e40cd740 2024-04-25T10:04:26.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.324+0000 7fd2e9596640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2e40d08d0 0x7fd2e40cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.324+0000 7fd2e9596640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2e40d08d0 0x7fd2e40cb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37168/0 (socket says 172.21.15.7:37168) 2024-04-25T10:04:26.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.324+0000 7fd2e9596640 1 -- 172.21.15.7:0/4201965981 learned_addr learned my addr 172.21.15.7:0/4201965981 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:26.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.324+0000 7fd2e8d95640 1 --2- 172.21.15.7:0/4201965981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2e406cbc0 0x7fd2e4151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.324+0000 7fd2e3fff640 1 --2- 172.21.15.7:0/4201965981 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2e40cd740 0x7fd2e40cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.324+0000 7fd2e9596640 1 -- 172.21.15.7:0/4201965981 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2e40cd740 msgr2=0x7fd2e40cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:26.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.324+0000 7fd2e9596640 1 --2- 172.21.15.7:0/4201965981 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2e40cd740 0x7fd2e40cac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.324+0000 7fd2e9596640 1 -- 172.21.15.7:0/4201965981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2e406cbc0 msgr2=0x7fd2e4151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:26.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.324+0000 7fd2e9596640 1 --2- 172.21.15.7:0/4201965981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2e406cbc0 0x7fd2e4151690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.324+0000 7fd2e9596640 1 -- 172.21.15.7:0/4201965981 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e40b0810 con 0x7fd2e40d08d0 2024-04-25T10:04:26.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.324+0000 7fd2e9596640 1 --2- 172.21.15.7:0/4201965981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2e40d08d0 0x7fd2e40cb1a0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00ef00 tx=0x7fd2dc00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:26.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.324+0000 7fd2e17fa640 1 -- 172.21.15.7:0/4201965981 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc018020 con 0x7fd2e40d08d0 2024-04-25T10:04:26.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.324+0000 7fd2e17fa640 1 -- 172.21.15.7:0/4201965981 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2dc00bd20 con 0x7fd2e40d08d0 2024-04-25T10:04:26.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.324+0000 7fd2e17fa640 1 -- 172.21.15.7:0/4201965981 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc014640 con 0x7fd2e40d08d0 2024-04-25T10:04:26.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.324+0000 7fd2eaff9640 1 -- 172.21.15.7:0/4201965981 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e40b0af0 con 0x7fd2e40d08d0 2024-04-25T10:04:26.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.324+0000 7fd2eaff9640 1 -- 172.21.15.7:0/4201965981 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e4152210 con 0x7fd2e40d08d0 2024-04-25T10:04:26.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.325+0000 7fd2eaff9640 1 -- 172.21.15.7:0/4201965981 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e4152410 con 0x7fd2e40d08d0 2024-04-25T10:04:26.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.326+0000 7fd2e17fa640 1 -- 172.21.15.7:0/4201965981 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd2dc005d10 con 0x7fd2e40d08d0 2024-04-25T10:04:26.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.326+0000 7fd2e17fa640 1 --2- 172.21.15.7:0/4201965981 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd2c806b4d0 0x7fd2c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.326+0000 7fd2e17fa640 1 -- 172.21.15.7:0/4201965981 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fd2dc08a840 con 0x7fd2e40d08d0 2024-04-25T10:04:26.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.327+0000 7fd2e8d95640 1 --2- 172.21.15.7:0/4201965981 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd2c806b4d0 0x7fd2c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.327+0000 7fd2e8d95640 1 --2- 172.21.15.7:0/4201965981 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd2c806b4d0 0x7fd2c806d990 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fd2e41f6eb0 tx=0x7fd2d8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:26.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.331+0000 7fd2e17fa640 1 -- 172.21.15.7:0/4201965981 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd2dc022030 con 0x7fd2e40d08d0 2024-04-25T10:04:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.580+0000 7fd2eaff9640 1 -- 172.21.15.7:0/4201965981 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd2e4068fd0 con 0x7fd2e40d08d0 2024-04-25T10:04:26.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.581+0000 7fd2e17fa640 1 -- 172.21.15.7:0/4201965981 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fd2dc059230 con 0x7fd2e40d08d0 2024-04-25T10:04:26.586 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:26.586 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:04:26.586 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_dump": [ 2024-04-25T10:04:26.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:04:26.587 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.a", 2024-04-25T10:04:26.587 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmDER5IhAA2ih+YNPXKaTRN6KeMKiDaA==", 2024-04-25T10:04:26.587 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:04:26.587 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T10:04:26.587 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T10:04:26.587 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T10:04:26.587 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:04:26.587 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:04:26.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:04:26.587 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:04:26.587 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.b", 2024-04-25T10:04:26.587 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmp55aLhAAD3pB8YjSzrpU6DfjQTVHPw==", 2024-04-25T10:04:26.587 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:04:26.587 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T10:04:26.588 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T10:04:26.588 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T10:04:26.588 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:04:26.588 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:04:26.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:04:26.588 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:04:26.588 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.c", 2024-04-25T10:04:26.588 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpm8jBtKRAAiDZo8S/z1fE588t8tiuX8Q==", 2024-04-25T10:04:26.588 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:04:26.588 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T10:04:26.588 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T10:04:26.588 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T10:04:26.588 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:04:26.588 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:04:26.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:04:26.589 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:04:26.589 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mds.d", 2024-04-25T10:04:26.589 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmZWyRNRAA6tdquR+Hh8Lhx7LATegX6g==", 2024-04-25T10:04:26.589 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:04:26.589 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T10:04:26.589 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T10:04:26.589 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T10:04:26.589 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:04:26.589 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:04:26.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:04:26.589 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:04:26.589 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.0", 2024-04-25T10:04:26.589 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAaKCpmfHZ9HBAA9FYBJbc1QdNt1a9qtFhgBw==", 2024-04-25T10:04:26.589 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:04:26.590 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T10:04:26.590 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T10:04:26.590 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:04:26.590 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:04:26.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:04:26.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:04:26.590 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.1", 2024-04-25T10:04:26.590 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAdKCpmtYOgGhAAbM8XXG5fT+UNSvzvijeJ9Q==", 2024-04-25T10:04:26.590 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:04:26.590 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T10:04:26.590 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T10:04:26.590 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:04:26.590 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:04:26.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:04:26.591 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:04:26.591 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.2", 2024-04-25T10:04:26.591 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAgKCpmz4uZGBAA6JD3UWZ/8l12y4lJg0kH0A==", 2024-04-25T10:04:26.591 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:04:26.591 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T10:04:26.591 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T10:04:26.591 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:04:26.591 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:04:26.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:04:26.591 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:04:26.591 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.3", 2024-04-25T10:04:26.592 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAjKCpmcbXXFhAAsK64H4YqdiD1VJKQtn46OQ==", 2024-04-25T10:04:26.592 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:04:26.592 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T10:04:26.592 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T10:04:26.592 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:04:26.592 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:04:26.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:04:26.592 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:04:26.592 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.4", 2024-04-25T10:04:26.592 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAsKCpmzEDuKxAAmzxdcdVZIq2bGfG0rYcBBg==", 2024-04-25T10:04:26.592 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:04:26.592 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T10:04:26.592 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T10:04:26.593 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:04:26.593 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:04:26.593 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:04:26.593 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:04:26.593 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.5", 2024-04-25T10:04:26.593 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAvKCpmfyC4KxAAl6QUtdlRRaRNZpECSoHLJQ==", 2024-04-25T10:04:26.593 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:04:26.593 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T10:04:26.593 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T10:04:26.593 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:04:26.593 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:04:26.593 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:04:26.593 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:04:26.593 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.6", 2024-04-25T10:04:26.594 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAyKCpmBrUsKxAAH5IlxYRXUtPKYWDdTqBp3w==", 2024-04-25T10:04:26.594 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:04:26.594 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T10:04:26.594 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T10:04:26.594 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:04:26.594 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:04:26.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:04:26.594 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:04:26.594 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "osd.7", 2024-04-25T10:04:26.594 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQA1KCpmmwTSKhAAdzw/c0Xc6KCQHssqUI910g==", 2024-04-25T10:04:26.594 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:04:26.594 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow profile osd", 2024-04-25T10:04:26.594 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile osd", 2024-04-25T10:04:26.595 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:04:26.595 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:04:26.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:04:26.595 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:04:26.595 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.0", 2024-04-25T10:04:26.595 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmaJKeORAALxC5ZqLLEu0zJFG+SOGukQ==", 2024-04-25T10:04:26.595 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:04:26.595 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T10:04:26.595 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow r", 2024-04-25T10:04:26.595 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T10:04:26.595 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:04:26.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:04:26.595 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:04:26.595 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.1", 2024-04-25T10:04:26.596 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAZKCpmC2i6BhAAtKmpTNs/Tga7NtOkm7jSOg==", 2024-04-25T10:04:26.596 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:04:26.596 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T10:04:26.596 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-04-25T10:04:26.596 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-04-25T10:04:26.596 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-04-25T10:04:26.596 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:04:26.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:04:26.596 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:04:26.597 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.2", 2024-04-25T10:04:26.597 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAZKCpmytCIAxAAhP2UjagzGbz1ySErw1cw3Q==", 2024-04-25T10:04:26.597 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:04:26.597 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T10:04:26.597 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-04-25T10:04:26.597 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-04-25T10:04:26.597 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-04-25T10:04:26.597 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:04:26.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:04:26.597 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:04:26.597 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.3", 2024-04-25T10:04:26.597 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAZKCpmSj88DBAAg+N3XDyc3H6fUBqkScD/9Q==", 2024-04-25T10:04:26.597 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:04:26.597 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow", 2024-04-25T10:04:26.598 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow r", 2024-04-25T10:04:26.598 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow rw", 2024-04-25T10:04:26.598 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow rwx" 2024-04-25T10:04:26.598 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:04:26.598 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:04:26.598 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:04:26.598 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "client.admin", 2024-04-25T10:04:26.598 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpm8SYpBhAACl5SVNaaKZV7rIIFaFlmvw==", 2024-04-25T10:04:26.598 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:04:26.598 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-04-25T10:04:26.598 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": "allow *", 2024-04-25T10:04:26.598 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow *", 2024-04-25T10:04:26.598 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:04:26.599 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:04:26.599 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:04:26.599 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:04:26.599 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.x", 2024-04-25T10:04:26.599 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmqIdPHxAACc5SoI1y74ickl2cPjfGIg==", 2024-04-25T10:04:26.599 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:04:26.599 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-04-25T10:04:26.599 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2024-04-25T10:04:26.599 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:04:26.599 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:04:26.599 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-04-25T10:04:26.599 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:04:26.599 INFO:teuthology.orchestra.run.smithi007.stdout: "entity": "mgr.y", 2024-04-25T10:04:26.600 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "AQAYKCpmCvpDGxAAYsxd6zUjxUgY0sYwR4VvAQ==", 2024-04-25T10:04:26.600 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": { 2024-04-25T10:04:26.600 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": "allow *", 2024-04-25T10:04:26.600 INFO:teuthology.orchestra.run.smithi007.stdout: "mon": "allow profile mgr", 2024-04-25T10:04:26.600 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": "allow *" 2024-04-25T10:04:26.600 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:04:26.600 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:04:26.600 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-04-25T10:04:26.600 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:04:26.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.583+0000 7fd2eaff9640 1 -- 172.21.15.7:0/4201965981 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd2c806b4d0 msgr2=0x7fd2c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:26.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.583+0000 7fd2eaff9640 1 --2- 172.21.15.7:0/4201965981 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd2c806b4d0 0x7fd2c806d990 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fd2e41f6eb0 tx=0x7fd2d8009190 comp rx=0 tx=0).stop 2024-04-25T10:04:26.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.583+0000 7fd2eaff9640 1 -- 172.21.15.7:0/4201965981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2e40d08d0 msgr2=0x7fd2e40cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:26.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.583+0000 7fd2eaff9640 1 --2- 172.21.15.7:0/4201965981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2e40d08d0 0x7fd2e40cb1a0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00ef00 tx=0x7fd2dc00b480 comp rx=0 tx=0).stop 2024-04-25T10:04:26.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.583+0000 7fd2eaff9640 1 -- 172.21.15.7:0/4201965981 shutdown_connections 2024-04-25T10:04:26.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.583+0000 7fd2eaff9640 1 --2- 172.21.15.7:0/4201965981 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd2c806b4d0 0x7fd2c806d990 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.583+0000 7fd2eaff9640 1 --2- 172.21.15.7:0/4201965981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2e40d08d0 0x7fd2e40cb1a0 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.583+0000 7fd2eaff9640 1 --2- 172.21.15.7:0/4201965981 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd2e40cd740 0x7fd2e40cac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.583+0000 7fd2eaff9640 1 --2- 172.21.15.7:0/4201965981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2e406cbc0 0x7fd2e4151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.583+0000 7fd2eaff9640 1 -- 172.21.15.7:0/4201965981 >> 172.21.15.7:0/4201965981 conn(0x7fd2e40b3130 msgr2=0x7fd2e40cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:26.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.583+0000 7fd2eaff9640 1 -- 172.21.15.7:0/4201965981 shutdown_connections 2024-04-25T10:04:26.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.583+0000 7fd2eaff9640 1 -- 172.21.15.7:0/4201965981 wait complete. 2024-04-25T10:04:26.603 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:26.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.699+0000 7f66d4f68640 1 Processor -- start 2024-04-25T10:04:26.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.699+0000 7f66d4f68640 1 -- start start 2024-04-25T10:04:26.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.700+0000 7f66d4f68640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f66d015da20 0x7f66d009a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.700+0000 7f66d4f68640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f66d006bc70 0x7f66d00d0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.700+0000 7f66d4f68640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66d00cfad0 con 0x7f66d00d10b0 2024-04-25T10:04:26.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.700+0000 7f66d4f68640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66d00d06e0 con 0x7f66d015da20 2024-04-25T10:04:26.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.700+0000 7f66d4f68640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d009a940 con 0x7f66d006bc70 2024-04-25T10:04:26.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.700+0000 7f66ce59c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f66d015da20 0x7f66d009a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.700+0000 7f66ced9d640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f66d00d10b0 0x7f66d006c330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58368/0 (socket says 172.21.15.7:58368) 2024-04-25T10:04:26.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.700+0000 7f66ced9d640 1 -- 172.21.15.7:0/1777336082 learned_addr learned my addr 172.21.15.7:0/1777336082 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:26.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.700+0000 7f66ce59c640 1 -- 172.21.15.7:0/1777336082 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f66d006bc70 msgr2=0x7f66d00d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:26.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.700+0000 7f66cdd9b640 1 --2- 172.21.15.7:0/1777336082 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f66d006bc70 0x7f66d00d0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.700+0000 7f66ce59c640 1 --2- 172.21.15.7:0/1777336082 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f66d006bc70 0x7f66d00d0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.700+0000 7f66cd59a640 1 -- 172.21.15.7:0/1777336082 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2156897790 0 0) 0x7f66d00cfad0 con 0x7f66d00d10b0 2024-04-25T10:04:26.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.700+0000 7f66ce59c640 1 -- 172.21.15.7:0/1777336082 >> v1:172.21.15.7:6789/0 conn(0x7f66d00d10b0 legacy=0x7f66d006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:26.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.700+0000 7f66ce59c640 1 -- 172.21.15.7:0/1777336082 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d00cfdb0 con 0x7f66d015da20 2024-04-25T10:04:26.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.701+0000 7f66ce59c640 1 --2- 172.21.15.7:0/1777336082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66d015da20 0x7f66d009a400 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f66c00097a0 tx=0x7f66c002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c331edc7f91f6c86 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:26.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.701+0000 7f66cd59a640 1 -- 172.21.15.7:0/1777336082 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c0037070 con 0x7f66d015da20 2024-04-25T10:04:26.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.701+0000 7f66cd59a640 1 -- 172.21.15.7:0/1777336082 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c0032440 con 0x7f66d015da20 2024-04-25T10:04:26.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.701+0000 7f66cd59a640 1 -- 172.21.15.7:0/1777336082 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c0032810 con 0x7f66d015da20 2024-04-25T10:04:26.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.701+0000 7f66d4f68640 1 -- 172.21.15.7:0/1777336082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66d015da20 msgr2=0x7f66d009a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:26.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.701+0000 7f66d4f68640 1 --2- 172.21.15.7:0/1777336082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66d015da20 0x7f66d009a400 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f66c00097a0 tx=0x7f66c002a180 comp rx=0 tx=0).stop 2024-04-25T10:04:26.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.702+0000 7f66d4f68640 1 -- 172.21.15.7:0/1777336082 shutdown_connections 2024-04-25T10:04:26.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.702+0000 7f66d4f68640 1 --2- 172.21.15.7:0/1777336082 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f66d006bc70 0x7f66d00d0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.702+0000 7f66d4f68640 1 --2- 172.21.15.7:0/1777336082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66d015da20 0x7f66d009a400 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.702+0000 7f66d4f68640 1 -- 172.21.15.7:0/1777336082 >> 172.21.15.7:0/1777336082 conn(0x7f66d00d16f0 msgr2=0x7f66d00d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:26.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.702+0000 7f66d4f68640 1 -- 172.21.15.7:0/1777336082 shutdown_connections 2024-04-25T10:04:26.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.702+0000 7f66d4f68640 1 -- 172.21.15.7:0/1777336082 wait complete. 2024-04-25T10:04:26.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.703+0000 7f66d4f68640 1 Processor -- start 2024-04-25T10:04:26.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.703+0000 7f66d4f68640 1 -- start start 2024-04-25T10:04:26.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.704+0000 7f66d4f68640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f66d006bc70 0x7f66d01514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.704+0000 7f66d4f68640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66d00d10b0 0x7f66d00cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.704+0000 7f66d4f68640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66d015da20 0x7f66d014a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.704+0000 7f66d4f68640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d015de00 con 0x7f66d00d10b0 2024-04-25T10:04:26.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.704+0000 7f66d4f68640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d00d0370 con 0x7f66d015da20 2024-04-25T10:04:26.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.704+0000 7f66d4f68640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d015df80 con 0x7f66d006bc70 2024-04-25T10:04:26.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.704+0000 7f66cdd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66d00d10b0 0x7f66d00cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.704+0000 7f66cdd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66d00d10b0 0x7f66d00cb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37196/0 (socket says 172.21.15.7:37196) 2024-04-25T10:04:26.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.704+0000 7f66cdd9b640 1 -- 172.21.15.7:0/762004651 learned_addr learned my addr 172.21.15.7:0/762004651 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:26.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.704+0000 7f66ced9d640 1 --2- 172.21.15.7:0/762004651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66d015da20 0x7f66d014a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.704+0000 7f66ce59c640 1 --2- 172.21.15.7:0/762004651 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f66d006bc70 0x7f66d01514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.704+0000 7f66cdd9b640 1 -- 172.21.15.7:0/762004651 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f66d006bc70 msgr2=0x7f66d01514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:26.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.704+0000 7f66cdd9b640 1 --2- 172.21.15.7:0/762004651 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f66d006bc70 0x7f66d01514d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.704+0000 7f66cdd9b640 1 -- 172.21.15.7:0/762004651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66d015da20 msgr2=0x7f66d014a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:26.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.704+0000 7f66cdd9b640 1 --2- 172.21.15.7:0/762004651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66d015da20 0x7f66d014a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.704+0000 7f66cdd9b640 1 -- 172.21.15.7:0/762004651 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d0151a10 con 0x7f66d00d10b0 2024-04-25T10:04:26.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.704+0000 7f66ced9d640 1 --2- 172.21.15.7:0/762004651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66d015da20 0x7f66d014a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:26.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.704+0000 7f66ce59c640 1 --2- 172.21.15.7:0/762004651 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f66d006bc70 0x7f66d01514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:26.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.704+0000 7f66cdd9b640 1 --2- 172.21.15.7:0/762004651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66d00d10b0 0x7f66d00cb390 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f66c400c7f0 tx=0x7f66c400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:26.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.705+0000 7f66beffd640 1 -- 172.21.15.7:0/762004651 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c4004230 con 0x7f66d00d10b0 2024-04-25T10:04:26.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.705+0000 7f66d4f68640 1 -- 172.21.15.7:0/762004651 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d00c8c80 con 0x7f66d00d10b0 2024-04-25T10:04:26.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.705+0000 7f66beffd640 1 -- 172.21.15.7:0/762004651 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c40043d0 con 0x7f66d00d10b0 2024-04-25T10:04:26.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.705+0000 7f66beffd640 1 -- 172.21.15.7:0/762004651 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c4007860 con 0x7f66d00d10b0 2024-04-25T10:04:26.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.705+0000 7f66d4f68640 1 -- 172.21.15.7:0/762004651 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d00c9240 con 0x7f66d00d10b0 2024-04-25T10:04:26.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.706+0000 7f66d4f68640 1 -- 172.21.15.7:0/762004651 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d0067420 con 0x7f66d00d10b0 2024-04-25T10:04:26.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.706+0000 7f66beffd640 1 -- 172.21.15.7:0/762004651 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f66c4007a00 con 0x7f66d00d10b0 2024-04-25T10:04:26.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.707+0000 7f66beffd640 1 --2- 172.21.15.7:0/762004651 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f66b006b4d0 0x7f66b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.707+0000 7f66beffd640 1 -- 172.21.15.7:0/762004651 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f66c4089ff0 con 0x7f66d00d10b0 2024-04-25T10:04:26.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.707+0000 7f66ce59c640 1 --2- 172.21.15.7:0/762004651 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f66b006b4d0 0x7f66b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.707+0000 7f66ce59c640 1 --2- 172.21.15.7:0/762004651 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f66b006b4d0 0x7f66b006d990 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f66c0034000 tx=0x7f66c002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:26.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.711+0000 7f66beffd640 1 -- 172.21.15.7:0/762004651 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f66d0067420 con 0x7f66d00d10b0 2024-04-25T10:04:26.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.892+0000 7f66d4f68640 1 -- 172.21.15.7:0/762004651 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66d00c9960 con 0x7f66d00d10b0 2024-04-25T10:04:26.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.893+0000 7f66beffd640 1 -- 172.21.15.7:0/762004651 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+13078 (secure 0 0 0) 0x7f66c4015020 con 0x7f66d00d10b0 2024-04-25T10:04:26.898 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:26.899 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":113,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:04:26.221240+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:26.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.895+0000 7f66d4f68640 1 -- 172.21.15.7:0/762004651 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f66b006b4d0 msgr2=0x7f66b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:26.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.895+0000 7f66d4f68640 1 --2- 172.21.15.7:0/762004651 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f66b006b4d0 0x7f66b006d990 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f66c0034000 tx=0x7f66c002e000 comp rx=0 tx=0).stop 2024-04-25T10:04:26.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.895+0000 7f66d4f68640 1 -- 172.21.15.7:0/762004651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66d00d10b0 msgr2=0x7f66d00cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:26.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.895+0000 7f66d4f68640 1 --2- 172.21.15.7:0/762004651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66d00d10b0 0x7f66d00cb390 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f66c400c7f0 tx=0x7f66c400ccb0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.895+0000 7f66d4f68640 1 -- 172.21.15.7:0/762004651 shutdown_connections 2024-04-25T10:04:26.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.895+0000 7f66d4f68640 1 --2- 172.21.15.7:0/762004651 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f66b006b4d0 0x7f66b006d990 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.895+0000 7f66d4f68640 1 --2- 172.21.15.7:0/762004651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66d015da20 0x7f66d014a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.895+0000 7f66d4f68640 1 --2- 172.21.15.7:0/762004651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66d00d10b0 0x7f66d00cb390 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.895+0000 7f66d4f68640 1 --2- 172.21.15.7:0/762004651 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f66d006bc70 0x7f66d01514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.895+0000 7f66d4f68640 1 -- 172.21.15.7:0/762004651 >> 172.21.15.7:0/762004651 conn(0x7f66d00d16f0 msgr2=0x7f66d00cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:26.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.895+0000 7f66d4f68640 1 -- 172.21.15.7:0/762004651 shutdown_connections 2024-04-25T10:04:26.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:26.895+0000 7f66d4f68640 1 -- 172.21.15.7:0/762004651 wait complete. 2024-04-25T10:04:26.911 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:04:26.911 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:04:27.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.010+0000 7fd99f7be640 1 Processor -- start 2024-04-25T10:04:27.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.010+0000 7fd99f7be640 1 -- start start 2024-04-25T10:04:27.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.011+0000 7fd99f7be640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd9980d3760 0x7fd99815eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.011+0000 7fd99f7be640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd9980ce830 0x7fd9980b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.011+0000 7fd99f7be640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9980ced10 con 0x7fd99815f1c0 2024-04-25T10:04:27.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.011+0000 7fd99f7be640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9980ce380 con 0x7fd9980d3760 2024-04-25T10:04:27.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.011+0000 7fd99f7be640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd99815f000 con 0x7fd9980ce830 2024-04-25T10:04:27.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.011+0000 7fd99d55a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd9980d3760 0x7fd99815eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:27.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.011+0000 7fd99d55a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd9980d3760 0x7fd99815eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37212/0 (socket says 172.21.15.7:37212) 2024-04-25T10:04:27.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.011+0000 7fd99d55a640 1 -- 172.21.15.7:0/3538800211 learned_addr learned my addr 172.21.15.7:0/3538800211 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:27.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.011+0000 7fd99dd5b640 1 --2- 172.21.15.7:0/3538800211 >> v2:172.21.15.55:3300/0 conn(0x7fd9980ce830 0x7fd9980b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:27.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.011+0000 7fd99d55a640 1 -- 172.21.15.7:0/3538800211 >> v2:172.21.15.55:3300/0 conn(0x7fd9980ce830 msgr2=0x7fd9980b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:27.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.011+0000 7fd99d55a640 1 --2- 172.21.15.7:0/3538800211 >> v2:172.21.15.55:3300/0 conn(0x7fd9980ce830 0x7fd9980b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.011+0000 7fd99d55a640 1 -- 172.21.15.7:0/3538800211 >> v1:172.21.15.55:6789/0 conn(0x7fd99815f1c0 legacy=0x7fd9980d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:27.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.011+0000 7fd99d55a640 1 -- 172.21.15.7:0/3538800211 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9980d1b40 con 0x7fd9980d3760 2024-04-25T10:04:27.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.012+0000 7fd99d55a640 1 --2- 172.21.15.7:0/3538800211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9980d3760 0x7fd99815eac0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fd9980cf180 tx=0x7fd99402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a36f03fd0d3a60c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:27.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.012+0000 7fd98ffff640 1 -- 172.21.15.7:0/3538800211 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd994037070 con 0x7fd9980d3760 2024-04-25T10:04:27.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.012+0000 7fd98ffff640 1 -- 172.21.15.7:0/3538800211 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd994032440 con 0x7fd9980d3760 2024-04-25T10:04:27.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.012+0000 7fd98ffff640 1 -- 172.21.15.7:0/3538800211 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd994032810 con 0x7fd9980d3760 2024-04-25T10:04:27.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.013+0000 7fd99f7be640 1 -- 172.21.15.7:0/3538800211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9980d3760 msgr2=0x7fd99815eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:27.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.013+0000 7fd99f7be640 1 --2- 172.21.15.7:0/3538800211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9980d3760 0x7fd99815eac0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fd9980cf180 tx=0x7fd99402a270 comp rx=0 tx=0).stop 2024-04-25T10:04:27.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.013+0000 7fd99f7be640 1 -- 172.21.15.7:0/3538800211 shutdown_connections 2024-04-25T10:04:27.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.013+0000 7fd99f7be640 1 --2- 172.21.15.7:0/3538800211 >> v2:172.21.15.55:3300/0 conn(0x7fd9980ce830 0x7fd9980b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.013+0000 7fd99f7be640 1 --2- 172.21.15.7:0/3538800211 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9980d3760 0x7fd99815eac0 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.013+0000 7fd99f7be640 1 -- 172.21.15.7:0/3538800211 >> 172.21.15.7:0/3538800211 conn(0x7fd998072680 msgr2=0x7fd998072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:27.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.013+0000 7fd99f7be640 1 -- 172.21.15.7:0/3538800211 shutdown_connections 2024-04-25T10:04:27.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.013+0000 7fd99f7be640 1 -- 172.21.15.7:0/3538800211 wait complete. 2024-04-25T10:04:27.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.014+0000 7fd99f7be640 1 Processor -- start 2024-04-25T10:04:27.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.014+0000 7fd99f7be640 1 -- start start 2024-04-25T10:04:27.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.015+0000 7fd99f7be640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9980ce830 0x7fd9981f7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.015+0000 7fd99f7be640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd9980d3760 0x7fd9980b5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.015+0000 7fd99f7be640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd99815f1c0 0x7fd9980cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.015+0000 7fd99f7be640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd99815de10 con 0x7fd99815f1c0 2024-04-25T10:04:27.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.015+0000 7fd99f7be640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9980d2190 con 0x7fd9980ce830 2024-04-25T10:04:27.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.015+0000 7fd99f7be640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9980b2780 con 0x7fd9980d3760 2024-04-25T10:04:27.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.015+0000 7fd99dd5b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd99815f1c0 0x7fd9980cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:27.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.015+0000 7fd99dd5b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd99815f1c0 0x7fd9980cced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37226/0 (socket says 172.21.15.7:37226) 2024-04-25T10:04:27.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.015+0000 7fd99dd5b640 1 -- 172.21.15.7:0/1227639085 learned_addr learned my addr 172.21.15.7:0/1227639085 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:27.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.015+0000 7fd99d55a640 1 --2- 172.21.15.7:0/1227639085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9980ce830 0x7fd9981f7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:27.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.015+0000 7fd99cd59640 1 --2- 172.21.15.7:0/1227639085 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd9980d3760 0x7fd9980b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:27.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.015+0000 7fd99dd5b640 1 -- 172.21.15.7:0/1227639085 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd9980d3760 msgr2=0x7fd9980b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:27.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.015+0000 7fd99dd5b640 1 --2- 172.21.15.7:0/1227639085 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd9980d3760 0x7fd9980b5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.015+0000 7fd99dd5b640 1 -- 172.21.15.7:0/1227639085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9980ce830 msgr2=0x7fd9981f7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:27.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.015+0000 7fd99dd5b640 1 --2- 172.21.15.7:0/1227639085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9980ce830 0x7fd9981f7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.015+0000 7fd99dd5b640 1 -- 172.21.15.7:0/1227639085 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9980b5a80 con 0x7fd99815f1c0 2024-04-25T10:04:27.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.015+0000 7fd99cd59640 1 --2- 172.21.15.7:0/1227639085 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd9980d3760 0x7fd9980b5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:27.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.015+0000 7fd99dd5b640 1 --2- 172.21.15.7:0/1227639085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd99815f1c0 0x7fd9980cced0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fd990007de0 tx=0x7fd99000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:27.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.015+0000 7fd98dffb640 1 -- 172.21.15.7:0/1227639085 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd990014620 con 0x7fd99815f1c0 2024-04-25T10:04:27.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.015+0000 7fd98dffb640 1 -- 172.21.15.7:0/1227639085 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd990019070 con 0x7fd99815f1c0 2024-04-25T10:04:27.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.015+0000 7fd99f7be640 1 -- 172.21.15.7:0/1227639085 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9981f7810 con 0x7fd99815f1c0 2024-04-25T10:04:27.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.015+0000 7fd98dffb640 1 -- 172.21.15.7:0/1227639085 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd990014a20 con 0x7fd99815f1c0 2024-04-25T10:04:27.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.016+0000 7fd99f7be640 1 -- 172.21.15.7:0/1227639085 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9981f7dd0 con 0x7fd99815f1c0 2024-04-25T10:04:27.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.017+0000 7fd99f7be640 1 -- 172.21.15.7:0/1227639085 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd998068f60 con 0x7fd99815f1c0 2024-04-25T10:04:27.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.017+0000 7fd98dffb640 1 -- 172.21.15.7:0/1227639085 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd990014bc0 con 0x7fd99815f1c0 2024-04-25T10:04:27.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.017+0000 7fd98dffb640 1 --2- 172.21.15.7:0/1227639085 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd97c06b500 0x7fd97c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.017+0000 7fd98dffb640 1 -- 172.21.15.7:0/1227639085 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fd99008a840 con 0x7fd99815f1c0 2024-04-25T10:04:27.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.017+0000 7fd99d55a640 1 --2- 172.21.15.7:0/1227639085 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd97c06b500 0x7fd97c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:27.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.018+0000 7fd99d55a640 1 --2- 172.21.15.7:0/1227639085 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd97c06b500 0x7fd97c06d9c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd994034000 tx=0x7fd99402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:27.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.022+0000 7fd98dffb640 1 -- 172.21.15.7:0/1227639085 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd990059910 con 0x7fd99815f1c0 2024-04-25T10:04:27.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.203+0000 7fd99f7be640 1 -- 172.21.15.7:0/1227639085 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd998160230 con 0x7fd99815f1c0 2024-04-25T10:04:27.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.204+0000 7fd98dffb640 1 -- 172.21.15.7:0/1227639085 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v113) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd990059210 con 0x7fd99815f1c0 2024-04-25T10:04:27.209 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T10:04:27.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.206+0000 7fd99f7be640 1 -- 172.21.15.7:0/1227639085 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd97c06b500 msgr2=0x7fd97c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:27.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.206+0000 7fd99f7be640 1 --2- 172.21.15.7:0/1227639085 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd97c06b500 0x7fd97c06d9c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd994034000 tx=0x7fd99402e000 comp rx=0 tx=0).stop 2024-04-25T10:04:27.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.206+0000 7fd99f7be640 1 -- 172.21.15.7:0/1227639085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd99815f1c0 msgr2=0x7fd9980cced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:27.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.206+0000 7fd99f7be640 1 --2- 172.21.15.7:0/1227639085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd99815f1c0 0x7fd9980cced0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fd990007de0 tx=0x7fd99000e4b0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.206+0000 7fd99f7be640 1 -- 172.21.15.7:0/1227639085 shutdown_connections 2024-04-25T10:04:27.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.206+0000 7fd99f7be640 1 --2- 172.21.15.7:0/1227639085 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd97c06b500 0x7fd97c06d9c0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.206+0000 7fd99f7be640 1 --2- 172.21.15.7:0/1227639085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd99815f1c0 0x7fd9980cced0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.206+0000 7fd99f7be640 1 --2- 172.21.15.7:0/1227639085 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd9980d3760 0x7fd9980b5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.206+0000 7fd99f7be640 1 --2- 172.21.15.7:0/1227639085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9980ce830 0x7fd9981f7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.206+0000 7fd99f7be640 1 -- 172.21.15.7:0/1227639085 >> 172.21.15.7:0/1227639085 conn(0x7fd998072680 msgr2=0x7fd9980c92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:27.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.206+0000 7fd99f7be640 1 -- 172.21.15.7:0/1227639085 shutdown_connections 2024-04-25T10:04:27.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.206+0000 7fd99f7be640 1 -- 172.21.15.7:0/1227639085 wait complete. 2024-04-25T10:04:27.222 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T10:04:27.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.317+0000 7f2ce8846640 1 Processor -- start 2024-04-25T10:04:27.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.318+0000 7f2ce8846640 1 -- start start 2024-04-25T10:04:27.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.318+0000 7f2ce8846640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ce415db00 0x7f2ce40d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.318+0000 7f2ce8846640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2ce40ce2b0 0x7f2ce40d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.318+0000 7f2ce8846640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce40d1e80 con 0x7f2ce40b53b0 2024-04-25T10:04:27.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.318+0000 7f2ce8846640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce40b5930 con 0x7f2ce40ce2b0 2024-04-25T10:04:27.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.318+0000 7f2ce8846640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce40b5c10 con 0x7f2ce415db00 2024-04-25T10:04:27.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.319+0000 7f2ce2d9d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2ce40ce2b0 0x7f2ce40d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:27.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.319+0000 7f2ce2d9d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2ce40ce2b0 0x7f2ce40d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37234/0 (socket says 172.21.15.7:37234) 2024-04-25T10:04:27.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.319+0000 7f2ce2d9d640 1 -- 172.21.15.7:0/324371347 learned_addr learned my addr 172.21.15.7:0/324371347 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:27.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.319+0000 7f2ce2d9d640 1 -- 172.21.15.7:0/324371347 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ce415db00 msgr2=0x7f2ce40d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:27.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.319+0000 7f2ce259c640 1 --2- 172.21.15.7:0/324371347 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ce415db00 0x7f2ce40d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:27.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.319+0000 7f2ce2d9d640 1 --2- 172.21.15.7:0/324371347 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ce415db00 0x7f2ce40d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.319+0000 7f2ce2d9d640 1 -- 172.21.15.7:0/324371347 >> v1:172.21.15.55:6789/0 conn(0x7f2ce40b53b0 legacy=0x7f2ce4161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:27.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.319+0000 7f2ce2d9d640 1 -- 172.21.15.7:0/324371347 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce40b5ef0 con 0x7f2ce40ce2b0 2024-04-25T10:04:27.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.319+0000 7f2ce259c640 1 --2- 172.21.15.7:0/324371347 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ce415db00 0x7f2ce40d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:27.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.320+0000 7f2ce2d9d640 1 --2- 172.21.15.7:0/324371347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ce40ce2b0 0x7f2ce40d0880 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4009e50 tx=0x7f2cd402a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c4c0c15582c4675 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:27.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.320+0000 7f2ce159a640 1 -- 172.21.15.7:0/324371347 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4036070 con 0x7f2ce40ce2b0 2024-04-25T10:04:27.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.320+0000 7f2ce159a640 1 -- 172.21.15.7:0/324371347 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd4031600 con 0x7f2ce40ce2b0 2024-04-25T10:04:27.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.320+0000 7f2ce159a640 1 -- 172.21.15.7:0/324371347 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd40319d0 con 0x7f2ce40ce2b0 2024-04-25T10:04:27.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.320+0000 7f2ce8846640 1 -- 172.21.15.7:0/324371347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ce40ce2b0 msgr2=0x7f2ce40d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:27.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.320+0000 7f2ce8846640 1 --2- 172.21.15.7:0/324371347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ce40ce2b0 0x7f2ce40d0880 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4009e50 tx=0x7f2cd402a6d0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.320+0000 7f2ce8846640 1 -- 172.21.15.7:0/324371347 shutdown_connections 2024-04-25T10:04:27.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.320+0000 7f2ce8846640 1 --2- 172.21.15.7:0/324371347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ce40ce2b0 0x7f2ce40d0880 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.320+0000 7f2ce8846640 1 --2- 172.21.15.7:0/324371347 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ce415db00 0x7f2ce40d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.320+0000 7f2ce8846640 1 -- 172.21.15.7:0/324371347 >> 172.21.15.7:0/324371347 conn(0x7f2ce4072290 msgr2=0x7f2ce40726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:27.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.320+0000 7f2ce8846640 1 -- 172.21.15.7:0/324371347 shutdown_connections 2024-04-25T10:04:27.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.320+0000 7f2ce8846640 1 -- 172.21.15.7:0/324371347 wait complete. 2024-04-25T10:04:27.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.322+0000 7f2ce8846640 1 Processor -- start 2024-04-25T10:04:27.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.322+0000 7f2ce8846640 1 -- start start 2024-04-25T10:04:27.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.322+0000 7f2ce8846640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ce40b53b0 0x7f2ce414f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.322+0000 7f2ce8846640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ce40ce2b0 0x7f2ce415e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.322+0000 7f2ce8846640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ce415db00 0x7f2ce40c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.323+0000 7f2ce8846640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce40d3660 con 0x7f2ce40b53b0 2024-04-25T10:04:27.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.323+0000 7f2ce8846640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce40b61d0 con 0x7f2ce415db00 2024-04-25T10:04:27.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.323+0000 7f2ce8846640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce40b6c10 con 0x7f2ce40ce2b0 2024-04-25T10:04:27.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.323+0000 7f2ce259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ce40b53b0 0x7f2ce414f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:27.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.323+0000 7f2ce259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ce40b53b0 0x7f2ce414f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37244/0 (socket says 172.21.15.7:37244) 2024-04-25T10:04:27.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.323+0000 7f2ce259c640 1 -- 172.21.15.7:0/1394922229 learned_addr learned my addr 172.21.15.7:0/1394922229 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:27.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.323+0000 7f2ce1d9b640 1 --2- 172.21.15.7:0/1394922229 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ce40ce2b0 0x7f2ce415e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:27.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.323+0000 7f2ce2d9d640 1 --2- 172.21.15.7:0/1394922229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ce415db00 0x7f2ce40c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:27.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.323+0000 7f2ce259c640 1 -- 172.21.15.7:0/1394922229 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ce40ce2b0 msgr2=0x7f2ce415e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:27.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.323+0000 7f2ce259c640 1 --2- 172.21.15.7:0/1394922229 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ce40ce2b0 0x7f2ce415e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.323+0000 7f2ce259c640 1 -- 172.21.15.7:0/1394922229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ce415db00 msgr2=0x7f2ce40c9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:27.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.323+0000 7f2ce259c640 1 --2- 172.21.15.7:0/1394922229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ce415db00 0x7f2ce40c9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.323+0000 7f2ce259c640 1 -- 172.21.15.7:0/1394922229 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce40c9a50 con 0x7f2ce40b53b0 2024-04-25T10:04:27.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.323+0000 7f2ce259c640 1 --2- 172.21.15.7:0/1394922229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ce40b53b0 0x7f2ce414f1a0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc00c820 tx=0x7f2cdc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:27.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.323+0000 7f2cdaffd640 1 -- 172.21.15.7:0/1394922229 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc015070 con 0x7f2ce40b53b0 2024-04-25T10:04:27.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.323+0000 7f2cdaffd640 1 -- 172.21.15.7:0/1394922229 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc007a30 con 0x7f2ce40b53b0 2024-04-25T10:04:27.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.323+0000 7f2ce8846640 1 -- 172.21.15.7:0/1394922229 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce40cab30 con 0x7f2ce40b53b0 2024-04-25T10:04:27.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.323+0000 7f2cdaffd640 1 -- 172.21.15.7:0/1394922229 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc007de0 con 0x7f2ce40b53b0 2024-04-25T10:04:27.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.323+0000 7f2ce8846640 1 -- 172.21.15.7:0/1394922229 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce40cb0f0 con 0x7f2ce40b53b0 2024-04-25T10:04:27.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.324+0000 7f2ce8846640 1 -- 172.21.15.7:0/1394922229 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce4068fd0 con 0x7f2ce40b53b0 2024-04-25T10:04:27.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.325+0000 7f2cdaffd640 1 -- 172.21.15.7:0/1394922229 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2cdc018070 con 0x7f2ce40b53b0 2024-04-25T10:04:27.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.325+0000 7f2cdaffd640 1 --2- 172.21.15.7:0/1394922229 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2cc406b500 0x7f2cc406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.325+0000 7f2cdaffd640 1 -- 172.21.15.7:0/1394922229 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f2cdc089e90 con 0x7f2ce40b53b0 2024-04-25T10:04:27.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.325+0000 7f2ce1d9b640 1 --2- 172.21.15.7:0/1394922229 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2cc406b500 0x7f2cc406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:27.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.326+0000 7f2ce1d9b640 1 --2- 172.21.15.7:0/1394922229 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2cc406b500 0x7f2cc406d9c0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40ca170 tx=0x7f2ccc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:27.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.330+0000 7f2cdaffd640 1 -- 172.21.15.7:0/1394922229 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2cdc058f60 con 0x7f2ce40b53b0 2024-04-25T10:04:27.403 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:04:27.406 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:04:27.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.514+0000 7f2ce8846640 1 -- 172.21.15.7:0/1394922229 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2ce40d16b0 con 0x7f2ce40b53b0 2024-04-25T10:04:27.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.515+0000 7f2cdaffd640 1 -- 172.21.15.7:0/1394922229 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v113) v1 ==== 84+0+65 (secure 0 0 0) 0x7f2cdc058860 con 0x7f2ce40b53b0 2024-04-25T10:04:27.520 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:27.520 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2024-04-25T10:04:27.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-04-25T10:04:27.520 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2024-04-25T10:04:27.520 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2024-04-25T10:04:27.520 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-04-25T10:04:27.520 INFO:teuthology.orchestra.run.smithi007.stdout:] 2024-04-25T10:04:27.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.517+0000 7f2ce8846640 1 -- 172.21.15.7:0/1394922229 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2cc406b500 msgr2=0x7f2cc406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:27.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.517+0000 7f2ce8846640 1 --2- 172.21.15.7:0/1394922229 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2cc406b500 0x7f2cc406d9c0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40ca170 tx=0x7f2ccc009040 comp rx=0 tx=0).stop 2024-04-25T10:04:27.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.517+0000 7f2ce8846640 1 -- 172.21.15.7:0/1394922229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ce40b53b0 msgr2=0x7f2ce414f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:27.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.517+0000 7f2ce8846640 1 --2- 172.21.15.7:0/1394922229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ce40b53b0 0x7f2ce414f1a0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc00c820 tx=0x7f2cdc00cce0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.517+0000 7f2ce8846640 1 -- 172.21.15.7:0/1394922229 shutdown_connections 2024-04-25T10:04:27.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.517+0000 7f2ce8846640 1 --2- 172.21.15.7:0/1394922229 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2cc406b500 0x7f2cc406d9c0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.517+0000 7f2ce8846640 1 --2- 172.21.15.7:0/1394922229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ce415db00 0x7f2ce40c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.517+0000 7f2ce8846640 1 --2- 172.21.15.7:0/1394922229 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2ce40ce2b0 0x7f2ce415e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.517+0000 7f2ce8846640 1 --2- 172.21.15.7:0/1394922229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ce40b53b0 0x7f2ce414f1a0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.517+0000 7f2ce8846640 1 -- 172.21.15.7:0/1394922229 >> 172.21.15.7:0/1394922229 conn(0x7f2ce4072290 msgr2=0x7f2ce4157b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:27.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.517+0000 7f2ce8846640 1 -- 172.21.15.7:0/1394922229 shutdown_connections 2024-04-25T10:04:27.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.517+0000 7f2ce8846640 1 -- 172.21.15.7:0/1394922229 wait complete. 2024-04-25T10:04:27.533 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T10:04:27.533 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T10:04:27.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.632+0000 7fa530f53640 1 Processor -- start 2024-04-25T10:04:27.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.632+0000 7fa530f53640 1 -- start start 2024-04-25T10:04:27.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.633+0000 7fa530f53640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa52c0d3f10 0x7fa52c168830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.633+0000 7fa530f53640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa52c0d2290 con 0x7fa52c15de70 2024-04-25T10:04:27.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.633+0000 7fa530f53640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa52c0d2570 con 0x7fa52c0d3330 2024-04-25T10:04:27.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.633+0000 7fa530f53640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa52c0d2030 con 0x7fa52c0d3f10 2024-04-25T10:04:27.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.633+0000 7fa52ad9d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa52c0d3f10 0x7fa52c168830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:27.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.633+0000 7fa52ad9d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa52c0d3f10 0x7fa52c168830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37248/0 (socket says 172.21.15.7:37248) 2024-04-25T10:04:27.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.633+0000 7fa52a59c640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa52c15de70 0x7fa52c0d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58376/0 (socket says 172.21.15.7:58376) 2024-04-25T10:04:27.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.633+0000 7fa52ad9d640 1 -- 172.21.15.7:0/3212526089 learned_addr learned my addr 172.21.15.7:0/3212526089 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:27.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.634+0000 7fa52ad9d640 1 -- 172.21.15.7:0/3212526089 >> v1:172.21.15.55:6789/0 conn(0x7fa52c0d3330 legacy=0x7fa52c0d3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:27.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.634+0000 7fa52ad9d640 1 -- 172.21.15.7:0/3212526089 >> v1:172.21.15.7:6789/0 conn(0x7fa52c15de70 legacy=0x7fa52c0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:27.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.634+0000 7fa52959a640 1 -- 172.21.15.7:0/3212526089 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1954531654 0 0) 0x7fa52c0d2290 con 0x7fa52c15de70 2024-04-25T10:04:27.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.634+0000 7fa52ad9d640 1 -- 172.21.15.7:0/3212526089 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52c0d2850 con 0x7fa52c0d3f10 2024-04-25T10:04:27.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.634+0000 7fa52ad9d640 1 --2- 172.21.15.7:0/3212526089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa52c0d3f10 0x7fa52c168830 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fa51c009e50 tx=0x7fa51c02a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b0f59044cfd769f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:27.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.635+0000 7fa52959a640 1 -- 172.21.15.7:0/3212526089 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c036070 con 0x7fa52c0d3f10 2024-04-25T10:04:27.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.635+0000 7fa52959a640 1 -- 172.21.15.7:0/3212526089 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51c031600 con 0x7fa52c0d3f10 2024-04-25T10:04:27.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.635+0000 7fa52959a640 1 -- 172.21.15.7:0/3212526089 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c0319f0 con 0x7fa52c0d3f10 2024-04-25T10:04:27.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.635+0000 7fa530f53640 1 -- 172.21.15.7:0/3212526089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa52c0d3f10 msgr2=0x7fa52c168830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:27.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.635+0000 7fa530f53640 1 --2- 172.21.15.7:0/3212526089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa52c0d3f10 0x7fa52c168830 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fa51c009e50 tx=0x7fa51c02a7c0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.635+0000 7fa530f53640 1 -- 172.21.15.7:0/3212526089 shutdown_connections 2024-04-25T10:04:27.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.635+0000 7fa530f53640 1 --2- 172.21.15.7:0/3212526089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa52c0d3f10 0x7fa52c168830 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.635+0000 7fa530f53640 1 -- 172.21.15.7:0/3212526089 >> 172.21.15.7:0/3212526089 conn(0x7fa52c0726b0 msgr2=0x7fa52c072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:27.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.635+0000 7fa530f53640 1 -- 172.21.15.7:0/3212526089 shutdown_connections 2024-04-25T10:04:27.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.635+0000 7fa530f53640 1 -- 172.21.15.7:0/3212526089 wait complete. 2024-04-25T10:04:27.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.637+0000 7fa530f53640 1 Processor -- start 2024-04-25T10:04:27.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.637+0000 7fa530f53640 1 -- start start 2024-04-25T10:04:27.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.637+0000 7fa530f53640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa52c0d3330 0x7fa52c15b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.637+0000 7fa530f53640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa52c0d3f10 0x7fa52c1f32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.637+0000 7fa530f53640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa52c15de70 0x7fa52c160b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.637+0000 7fa530f53640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c0b9290 con 0x7fa52c0d3f10 2024-04-25T10:04:27.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.637+0000 7fa530f53640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c0d2e10 con 0x7fa52c15de70 2024-04-25T10:04:27.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.637+0000 7fa530f53640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c0b9410 con 0x7fa52c0d3330 2024-04-25T10:04:27.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.637+0000 7fa529d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa52c0d3f10 0x7fa52c1f32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:27.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.637+0000 7fa529d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa52c0d3f10 0x7fa52c1f32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37258/0 (socket says 172.21.15.7:37258) 2024-04-25T10:04:27.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.637+0000 7fa529d9b640 1 -- 172.21.15.7:0/3256387727 learned_addr learned my addr 172.21.15.7:0/3256387727 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:27.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.638+0000 7fa52ad9d640 1 --2- 172.21.15.7:0/3256387727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa52c15de70 0x7fa52c160b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:27.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.638+0000 7fa52a59c640 1 --2- 172.21.15.7:0/3256387727 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa52c0d3330 0x7fa52c15b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:27.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.638+0000 7fa529d9b640 1 -- 172.21.15.7:0/3256387727 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa52c0d3330 msgr2=0x7fa52c15b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:27.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.638+0000 7fa529d9b640 1 --2- 172.21.15.7:0/3256387727 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa52c0d3330 0x7fa52c15b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.638+0000 7fa529d9b640 1 -- 172.21.15.7:0/3256387727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa52c15de70 msgr2=0x7fa52c160b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:27.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.638+0000 7fa529d9b640 1 --2- 172.21.15.7:0/3256387727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa52c15de70 0x7fa52c160b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.638+0000 7fa529d9b640 1 -- 172.21.15.7:0/3256387727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52c15a4b0 con 0x7fa52c0d3f10 2024-04-25T10:04:27.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.638+0000 7fa52a59c640 1 --2- 172.21.15.7:0/3256387727 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa52c0d3330 0x7fa52c15b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:27.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.638+0000 7fa529d9b640 1 --2- 172.21.15.7:0/3256387727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa52c0d3f10 0x7fa52c1f32e0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7fa51400c3c0 tx=0x7fa51400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:27.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.638+0000 7fa522ffd640 1 -- 172.21.15.7:0/3256387727 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa514017070 con 0x7fa52c0d3f10 2024-04-25T10:04:27.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.638+0000 7fa522ffd640 1 -- 172.21.15.7:0/3256387727 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5140052f0 con 0x7fa52c0d3f10 2024-04-25T10:04:27.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.638+0000 7fa530f53640 1 -- 172.21.15.7:0/3256387727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa52c15a790 con 0x7fa52c0d3f10 2024-04-25T10:04:27.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.638+0000 7fa522ffd640 1 -- 172.21.15.7:0/3256387727 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa514003830 con 0x7fa52c0d3f10 2024-04-25T10:04:27.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.638+0000 7fa530f53640 1 -- 172.21.15.7:0/3256387727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa52c15ad50 con 0x7fa52c0d3f10 2024-04-25T10:04:27.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.639+0000 7fa530f53640 1 -- 172.21.15.7:0/3256387727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa52c069040 con 0x7fa52c0d3f10 2024-04-25T10:04:27.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.640+0000 7fa522ffd640 1 -- 172.21.15.7:0/3256387727 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa51401a070 con 0x7fa52c0d3f10 2024-04-25T10:04:27.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.640+0000 7fa522ffd640 1 --2- 172.21.15.7:0/3256387727 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa50c06b4d0 0x7fa50c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.640+0000 7fa522ffd640 1 -- 172.21.15.7:0/3256387727 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fa5140892e0 con 0x7fa52c0d3f10 2024-04-25T10:04:27.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.640+0000 7fa52a59c640 1 --2- 172.21.15.7:0/3256387727 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa50c06b4d0 0x7fa50c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:27.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.641+0000 7fa52a59c640 1 --2- 172.21.15.7:0/3256387727 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa50c06b4d0 0x7fa50c06d990 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fa524000f60 tx=0x7fa524007c50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:27.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.644+0000 7fa522ffd640 1 -- 172.21.15.7:0/3256387727 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa514057cd0 con 0x7fa52c0d3f10 2024-04-25T10:04:27.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:27.825+0000 7fa530f53640 1 -- 172.21.15.7:0/3256387727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa52c0c6f60 con 0x7fa52c0d3f10 2024-04-25T10:04:28.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.214+0000 7fa522ffd640 1 -- 172.21.15.7:0/3256387727 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v114) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa51405bd70 con 0x7fa52c0d3f10 2024-04-25T10:04:28.220 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2024-04-25T10:04:28.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.217+0000 7fa530f53640 1 -- 172.21.15.7:0/3256387727 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa50c06b4d0 msgr2=0x7fa50c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:28.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.217+0000 7fa530f53640 1 --2- 172.21.15.7:0/3256387727 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa50c06b4d0 0x7fa50c06d990 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fa524000f60 tx=0x7fa524007c50 comp rx=0 tx=0).stop 2024-04-25T10:04:28.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.217+0000 7fa530f53640 1 -- 172.21.15.7:0/3256387727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa52c0d3f10 msgr2=0x7fa52c1f32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:28.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.217+0000 7fa530f53640 1 --2- 172.21.15.7:0/3256387727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa52c0d3f10 0x7fa52c1f32e0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7fa51400c3c0 tx=0x7fa51400c880 comp rx=0 tx=0).stop 2024-04-25T10:04:28.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.217+0000 7fa530f53640 1 -- 172.21.15.7:0/3256387727 shutdown_connections 2024-04-25T10:04:28.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.217+0000 7fa530f53640 1 --2- 172.21.15.7:0/3256387727 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa50c06b4d0 0x7fa50c06d990 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:28.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.217+0000 7fa530f53640 1 --2- 172.21.15.7:0/3256387727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa52c15de70 0x7fa52c160b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:28.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.217+0000 7fa530f53640 1 --2- 172.21.15.7:0/3256387727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa52c0d3f10 0x7fa52c1f32e0 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:28.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.217+0000 7fa530f53640 1 --2- 172.21.15.7:0/3256387727 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa52c0d3330 0x7fa52c15b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:28.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.217+0000 7fa530f53640 1 -- 172.21.15.7:0/3256387727 >> 172.21.15.7:0/3256387727 conn(0x7fa52c0726b0 msgr2=0x7fa52c1545d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:28.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.217+0000 7fa530f53640 1 -- 172.21.15.7:0/3256387727 shutdown_connections 2024-04-25T10:04:28.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.217+0000 7fa530f53640 1 -- 172.21.15.7:0/3256387727 wait complete. 2024-04-25T10:04:28.237 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T10:04:28.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.341+0000 7f723e607640 1 Processor -- start 2024-04-25T10:04:28.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.341+0000 7f723e607640 1 -- start start 2024-04-25T10:04:28.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.342+0000 7f723e607640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f723815deb0 0x7f72380b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:28.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.342+0000 7f723e607640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f72380ce030 0x7f72380b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:28.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.342+0000 7f723e607640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72380d1a40 con 0x7f72380b6f20 2024-04-25T10:04:28.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.342+0000 7f723e607640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72380d1d20 con 0x7f723815deb0 2024-04-25T10:04:28.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.342+0000 7f723e607640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72380d2000 con 0x7f72380ce030 2024-04-25T10:04:28.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.342+0000 7f723cba4640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f72380b6f20 0x7f72380d3760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58392/0 (socket says 172.21.15.7:58392) 2024-04-25T10:04:28.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.342+0000 7f723cba4640 1 -- 172.21.15.7:0/3489714882 learned_addr learned my addr 172.21.15.7:0/3489714882 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:28.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.342+0000 7f72377fe640 1 --2- 172.21.15.7:0/3489714882 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f72380ce030 0x7f72380b69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:28.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.342+0000 7f7237fff640 1 --2- 172.21.15.7:0/3489714882 >> v2:172.21.15.55:3300/0 conn(0x7f723815deb0 0x7f72380b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:28.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.342+0000 7f7236ffd640 1 -- 172.21.15.7:0/3489714882 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2993921457 0 0) 0x7f72380d1a40 con 0x7f72380b6f20 2024-04-25T10:04:28.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.342+0000 7f7236ffd640 1 -- 172.21.15.7:0/3489714882 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7220003520 con 0x7f72380b6f20 2024-04-25T10:04:28.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.342+0000 7f7237fff640 1 -- 172.21.15.7:0/3489714882 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f72380ce030 msgr2=0x7f72380b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:28.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.342+0000 7f7237fff640 1 --2- 172.21.15.7:0/3489714882 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f72380ce030 0x7f72380b69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:28.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.342+0000 7f7237fff640 1 -- 172.21.15.7:0/3489714882 >> v1:172.21.15.7:6789/0 conn(0x7f72380b6f20 legacy=0x7f72380d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:28.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.342+0000 7f7237fff640 1 -- 172.21.15.7:0/3489714882 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72380d22e0 con 0x7f723815deb0 2024-04-25T10:04:28.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.343+0000 7f7237fff640 1 --2- 172.21.15.7:0/3489714882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f723815deb0 0x7f72380b2c30 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f72280097a0 tx=0x7f722802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd4247933fcc4c86 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:28.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.343+0000 7f7236ffd640 1 -- 172.21.15.7:0/3489714882 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228037070 con 0x7f723815deb0 2024-04-25T10:04:28.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.343+0000 7f7236ffd640 1 -- 172.21.15.7:0/3489714882 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7228032440 con 0x7f723815deb0 2024-04-25T10:04:28.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.343+0000 7f7236ffd640 1 -- 172.21.15.7:0/3489714882 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72280327f0 con 0x7f723815deb0 2024-04-25T10:04:28.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.344+0000 7f723e607640 1 -- 172.21.15.7:0/3489714882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f723815deb0 msgr2=0x7f72380b2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:28.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.344+0000 7f723e607640 1 --2- 172.21.15.7:0/3489714882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f723815deb0 0x7f72380b2c30 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f72280097a0 tx=0x7f722802a180 comp rx=0 tx=0).stop 2024-04-25T10:04:28.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.344+0000 7f723e607640 1 -- 172.21.15.7:0/3489714882 shutdown_connections 2024-04-25T10:04:28.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.344+0000 7f723e607640 1 --2- 172.21.15.7:0/3489714882 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f72380ce030 0x7f72380b69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:28.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.344+0000 7f723e607640 1 --2- 172.21.15.7:0/3489714882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f723815deb0 0x7f72380b2c30 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:28.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.344+0000 7f723e607640 1 -- 172.21.15.7:0/3489714882 >> 172.21.15.7:0/3489714882 conn(0x7f72380726b0 msgr2=0x7f7238072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:28.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.344+0000 7f723e607640 1 -- 172.21.15.7:0/3489714882 shutdown_connections 2024-04-25T10:04:28.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.344+0000 7f723e607640 1 -- 172.21.15.7:0/3489714882 wait complete. 2024-04-25T10:04:28.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.345+0000 7f723e607640 1 Processor -- start 2024-04-25T10:04:28.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.345+0000 7f723e607640 1 -- start start 2024-04-25T10:04:28.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.346+0000 7f723e607640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72380b6f20 0x7f72380b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:28.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.346+0000 7f723e607640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72380ce030 0x7f723815fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:28.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.346+0000 7f723e607640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f723815deb0 0x7f723814eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:28.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.346+0000 7f723e607640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72380d3e70 con 0x7f72380ce030 2024-04-25T10:04:28.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.346+0000 7f723e607640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72380ce490 con 0x7f72380b6f20 2024-04-25T10:04:28.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.346+0000 7f723e607640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72380d3ff0 con 0x7f723815deb0 2024-04-25T10:04:28.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.346+0000 7f72377fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72380ce030 0x7f723815fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:28.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.346+0000 7f72377fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72380ce030 0x7f723815fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37268/0 (socket says 172.21.15.7:37268) 2024-04-25T10:04:28.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.346+0000 7f72377fe640 1 -- 172.21.15.7:0/3094464638 learned_addr learned my addr 172.21.15.7:0/3094464638 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:28.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.346+0000 7f7237fff640 1 --2- 172.21.15.7:0/3094464638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72380b6f20 0x7f72380b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:28.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.346+0000 7f723cba4640 1 --2- 172.21.15.7:0/3094464638 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f723815deb0 0x7f723814eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:28.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.346+0000 7f72377fe640 1 -- 172.21.15.7:0/3094464638 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f723815deb0 msgr2=0x7f723814eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:28.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.346+0000 7f72377fe640 1 --2- 172.21.15.7:0/3094464638 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f723815deb0 0x7f723814eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:28.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.346+0000 7f72377fe640 1 -- 172.21.15.7:0/3094464638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72380b6f20 msgr2=0x7f72380b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:28.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.346+0000 7f72377fe640 1 --2- 172.21.15.7:0/3094464638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72380b6f20 0x7f72380b3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:28.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.347+0000 7f72377fe640 1 -- 172.21.15.7:0/3094464638 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72380b5c60 con 0x7f72380ce030 2024-04-25T10:04:28.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.347+0000 7f72377fe640 1 --2- 172.21.15.7:0/3094464638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72380ce030 0x7f723815fa50 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f722c00e9b0 tx=0x7f722c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:28.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.347+0000 7f7234ff9640 1 -- 172.21.15.7:0/3094464638 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722c017070 con 0x7f72380ce030 2024-04-25T10:04:28.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.347+0000 7f7234ff9640 1 -- 172.21.15.7:0/3094464638 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f722c00c9a0 con 0x7f72380ce030 2024-04-25T10:04:28.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.347+0000 7f723e607640 1 -- 172.21.15.7:0/3094464638 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72380b5f00 con 0x7f72380ce030 2024-04-25T10:04:28.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.347+0000 7f7234ff9640 1 -- 172.21.15.7:0/3094464638 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722c00cd90 con 0x7f72380ce030 2024-04-25T10:04:28.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.347+0000 7f723e607640 1 -- 172.21.15.7:0/3094464638 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f723814cfc0 con 0x7f72380ce030 2024-04-25T10:04:28.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.348+0000 7f723e607640 1 -- 172.21.15.7:0/3094464638 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7238068f60 con 0x7f72380ce030 2024-04-25T10:04:28.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.349+0000 7f7234ff9640 1 -- 172.21.15.7:0/3094464638 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f722c01a070 con 0x7f72380ce030 2024-04-25T10:04:28.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.349+0000 7f7234ff9640 1 --2- 172.21.15.7:0/3094464638 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f722406b4d0 0x7f722406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:28.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.349+0000 7f7234ff9640 1 -- 172.21.15.7:0/3094464638 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5619+0+0 (secure 0 0 0) 0x7f722c08a120 con 0x7f72380ce030 2024-04-25T10:04:28.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.349+0000 7f7237fff640 1 --2- 172.21.15.7:0/3094464638 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f722406b4d0 0x7f722406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:28.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.350+0000 7f7237fff640 1 --2- 172.21.15.7:0/3094464638 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f722406b4d0 0x7f722406d990 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7228034000 tx=0x7f722802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:28.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.354+0000 7f7234ff9640 1 -- 172.21.15.7:0/3094464638 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f722c0589b0 con 0x7f72380ce030 2024-04-25T10:04:28.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:28.534+0000 7f723e607640 1 -- 172.21.15.7:0/3094464638 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f72380d31c0 con 0x7f72380ce030 2024-04-25T10:04:29.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.225+0000 7f7234ff9640 1 -- 172.21.15.7:0/3094464638 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v115) v1 ==== 170+0+0 (secure 0 0 0) 0x7f722c05ca50 con 0x7f72380ce030 2024-04-25T10:04:29.231 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2024-04-25T10:04:29.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.229+0000 7f723e607640 1 -- 172.21.15.7:0/3094464638 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f722406b4d0 msgr2=0x7f722406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:29.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.229+0000 7f723e607640 1 --2- 172.21.15.7:0/3094464638 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f722406b4d0 0x7f722406d990 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7228034000 tx=0x7f722802e000 comp rx=0 tx=0).stop 2024-04-25T10:04:29.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.229+0000 7f723e607640 1 -- 172.21.15.7:0/3094464638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72380ce030 msgr2=0x7f723815fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:29.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.229+0000 7f723e607640 1 --2- 172.21.15.7:0/3094464638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72380ce030 0x7f723815fa50 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f722c00e9b0 tx=0x7f722c00ee70 comp rx=0 tx=0).stop 2024-04-25T10:04:29.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.229+0000 7f723e607640 1 -- 172.21.15.7:0/3094464638 shutdown_connections 2024-04-25T10:04:29.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.229+0000 7f723e607640 1 --2- 172.21.15.7:0/3094464638 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f722406b4d0 0x7f722406d990 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:29.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.229+0000 7f723e607640 1 --2- 172.21.15.7:0/3094464638 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f723815deb0 0x7f723814eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:29.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.229+0000 7f723e607640 1 --2- 172.21.15.7:0/3094464638 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72380ce030 0x7f723815fa50 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:29.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.229+0000 7f723e607640 1 --2- 172.21.15.7:0/3094464638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72380b6f20 0x7f72380b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:29.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.229+0000 7f723e607640 1 -- 172.21.15.7:0/3094464638 >> 172.21.15.7:0/3094464638 conn(0x7f72380726b0 msgr2=0x7f72380c7560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:29.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.230+0000 7f723e607640 1 -- 172.21.15.7:0/3094464638 shutdown_connections 2024-04-25T10:04:29.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.231+0000 7f723e607640 1 -- 172.21.15.7:0/3094464638 wait complete. 2024-04-25T10:04:29.266 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T10:04:29.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.369+0000 7fc45051d640 1 Processor -- start 2024-04-25T10:04:29.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.369+0000 7fc45051d640 1 -- start start 2024-04-25T10:04:29.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.370+0000 7fc45051d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc4480b2c30 0x7fc4480ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:29.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.370+0000 7fc45051d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc4480d3760 0x7fc4480d3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:29.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.370+0000 7fc45051d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4480d1a40 con 0x7fc44815deb0 2024-04-25T10:04:29.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.370+0000 7fc45051d640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4480d4110 con 0x7fc4480d3760 2024-04-25T10:04:29.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.370+0000 7fc45051d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4480d1d20 con 0x7fc4480b2c30 2024-04-25T10:04:29.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.370+0000 7fc44eaba640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc4480d3760 0x7fc4480d3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:29.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.370+0000 7fc44eaba640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc4480d3760 0x7fc4480d3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37274/0 (socket says 172.21.15.7:37274) 2024-04-25T10:04:29.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.370+0000 7fc44eaba640 1 -- 172.21.15.7:0/3880145518 learned_addr learned my addr 172.21.15.7:0/3880145518 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:29.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.370+0000 7fc44dab8640 1 --2- 172.21.15.7:0/3880145518 >> v2:172.21.15.55:3300/0 conn(0x7fc4480b2c30 0x7fc4480ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:29.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.370+0000 7fc44eaba640 1 -- 172.21.15.7:0/3880145518 >> v2:172.21.15.55:3300/0 conn(0x7fc4480b2c30 msgr2=0x7fc4480ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:29.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.370+0000 7fc44eaba640 1 --2- 172.21.15.7:0/3880145518 >> v2:172.21.15.55:3300/0 conn(0x7fc4480b2c30 0x7fc4480ce030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:29.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.370+0000 7fc44eaba640 1 -- 172.21.15.7:0/3880145518 >> v1:172.21.15.55:6789/0 conn(0x7fc44815deb0 legacy=0x7fc4480b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:29.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.370+0000 7fc44eaba640 1 -- 172.21.15.7:0/3880145518 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4480d2000 con 0x7fc4480d3760 2024-04-25T10:04:29.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.371+0000 7fc44eaba640 1 --2- 172.21.15.7:0/3880145518 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4480d3760 0x7fc4480d3bd0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fc4480d48d0 tx=0x7fc43802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9525b66be94263c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:29.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.371+0000 7fc44d2b7640 1 -- 172.21.15.7:0/3880145518 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc438036070 con 0x7fc4480d3760 2024-04-25T10:04:29.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.371+0000 7fc44d2b7640 1 -- 172.21.15.7:0/3880145518 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc438031600 con 0x7fc4480d3760 2024-04-25T10:04:29.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.371+0000 7fc44d2b7640 1 -- 172.21.15.7:0/3880145518 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4380319d0 con 0x7fc4480d3760 2024-04-25T10:04:29.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.372+0000 7fc45051d640 1 -- 172.21.15.7:0/3880145518 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4480d3760 msgr2=0x7fc4480d3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:29.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.372+0000 7fc45051d640 1 --2- 172.21.15.7:0/3880145518 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4480d3760 0x7fc4480d3bd0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fc4480d48d0 tx=0x7fc43802a6f0 comp rx=0 tx=0).stop 2024-04-25T10:04:29.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.372+0000 7fc45051d640 1 -- 172.21.15.7:0/3880145518 shutdown_connections 2024-04-25T10:04:29.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.372+0000 7fc45051d640 1 --2- 172.21.15.7:0/3880145518 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4480d3760 0x7fc4480d3bd0 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:29.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.372+0000 7fc45051d640 1 --2- 172.21.15.7:0/3880145518 >> v2:172.21.15.55:3300/0 conn(0x7fc4480b2c30 0x7fc4480ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:29.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.372+0000 7fc45051d640 1 -- 172.21.15.7:0/3880145518 >> 172.21.15.7:0/3880145518 conn(0x7fc4480726b0 msgr2=0x7fc448072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:29.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.372+0000 7fc45051d640 1 -- 172.21.15.7:0/3880145518 shutdown_connections 2024-04-25T10:04:29.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.372+0000 7fc45051d640 1 -- 172.21.15.7:0/3880145518 wait complete. 2024-04-25T10:04:29.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.373+0000 7fc45051d640 1 Processor -- start 2024-04-25T10:04:29.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.373+0000 7fc45051d640 1 -- start start 2024-04-25T10:04:29.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.374+0000 7fc45051d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4480b2c30 0x7fc448160df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:29.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.374+0000 7fc45051d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4480d3760 0x7fc4480b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:29.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.374+0000 7fc45051d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc44815deb0 0x7fc44815ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:29.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.374+0000 7fc45051d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4480b70f0 con 0x7fc4480b2c30 2024-04-25T10:04:29.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.374+0000 7fc45051d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4480d25c0 con 0x7fc4480d3760 2024-04-25T10:04:29.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.374+0000 7fc45051d640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4480d2ae0 con 0x7fc44815deb0 2024-04-25T10:04:29.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.374+0000 7fc44e2b9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4480b2c30 0x7fc448160df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:29.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.374+0000 7fc44e2b9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4480b2c30 0x7fc448160df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37290/0 (socket says 172.21.15.7:37290) 2024-04-25T10:04:29.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.374+0000 7fc44e2b9640 1 -- 172.21.15.7:0/434476623 learned_addr learned my addr 172.21.15.7:0/434476623 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:29.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.374+0000 7fc44dab8640 1 --2- 172.21.15.7:0/434476623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4480d3760 0x7fc4480b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:29.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.374+0000 7fc44eaba640 1 --2- 172.21.15.7:0/434476623 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc44815deb0 0x7fc44815ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:29.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.374+0000 7fc44e2b9640 1 -- 172.21.15.7:0/434476623 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc44815deb0 msgr2=0x7fc44815ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:29.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.374+0000 7fc44e2b9640 1 --2- 172.21.15.7:0/434476623 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc44815deb0 0x7fc44815ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:29.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.374+0000 7fc44e2b9640 1 -- 172.21.15.7:0/434476623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4480d3760 msgr2=0x7fc4480b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:29.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.374+0000 7fc44e2b9640 1 --2- 172.21.15.7:0/434476623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4480d3760 0x7fc4480b5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:29.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.374+0000 7fc44e2b9640 1 -- 172.21.15.7:0/434476623 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4480b5eb0 con 0x7fc4480b2c30 2024-04-25T10:04:29.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.374+0000 7fc44dab8640 1 --2- 172.21.15.7:0/434476623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4480d3760 0x7fc4480b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:29.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.375+0000 7fc44e2b9640 1 --2- 172.21.15.7:0/434476623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4480b2c30 0x7fc448160df0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fc44000b3e0 tx=0x7fc44000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:29.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.375+0000 7fc446ffd640 1 -- 172.21.15.7:0/434476623 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc440015020 con 0x7fc4480b2c30 2024-04-25T10:04:29.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.375+0000 7fc446ffd640 1 -- 172.21.15.7:0/434476623 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc440011850 con 0x7fc4480b2c30 2024-04-25T10:04:29.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.375+0000 7fc45051d640 1 -- 172.21.15.7:0/434476623 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc44815e430 con 0x7fc4480b2c30 2024-04-25T10:04:29.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.375+0000 7fc446ffd640 1 -- 172.21.15.7:0/434476623 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc440011c40 con 0x7fc4480b2c30 2024-04-25T10:04:29.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.375+0000 7fc45051d640 1 -- 172.21.15.7:0/434476623 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc44815e9f0 con 0x7fc4480b2c30 2024-04-25T10:04:29.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.376+0000 7fc45051d640 1 -- 172.21.15.7:0/434476623 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc44815ebf0 con 0x7fc4480b2c30 2024-04-25T10:04:29.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.377+0000 7fc446ffd640 1 -- 172.21.15.7:0/434476623 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc440018020 con 0x7fc4480b2c30 2024-04-25T10:04:29.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.377+0000 7fc446ffd640 1 --2- 172.21.15.7:0/434476623 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc43406b4d0 0x7fc43406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:29.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.377+0000 7fc446ffd640 1 -- 172.21.15.7:0/434476623 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6001+0+0 (secure 0 0 0) 0x7fc44008a1c0 con 0x7fc4480b2c30 2024-04-25T10:04:29.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.377+0000 7fc44dab8640 1 --2- 172.21.15.7:0/434476623 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc43406b4d0 0x7fc43406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:29.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.377+0000 7fc44dab8640 1 --2- 172.21.15.7:0/434476623 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc43406b4d0 0x7fc43406d990 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc4480c8220 tx=0x7fc43c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:29.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.382+0000 7fc446ffd640 1 -- 172.21.15.7:0/434476623 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc44815ebf0 con 0x7fc4480b2c30 2024-04-25T10:04:29.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:29.597+0000 7fc45051d640 1 -- 172.21.15.7:0/434476623 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc448068f60 con 0x7fc4480b2c30 2024-04-25T10:04:30.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.227+0000 7fc446ffd640 1 -- 172.21.15.7:0/434476623 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v86) v1 ==== 174+0+0 (secure 0 0 0) 0x7fc44001f020 con 0x7fc4480b2c30 2024-04-25T10:04:30.232 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 17 and data pool 18 2024-04-25T10:04:30.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.231+0000 7fc45051d640 1 -- 172.21.15.7:0/434476623 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc43406b4d0 msgr2=0x7fc43406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:30.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.231+0000 7fc45051d640 1 --2- 172.21.15.7:0/434476623 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc43406b4d0 0x7fc43406d990 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc4480c8220 tx=0x7fc43c008040 comp rx=0 tx=0).stop 2024-04-25T10:04:30.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.231+0000 7fc45051d640 1 -- 172.21.15.7:0/434476623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4480b2c30 msgr2=0x7fc448160df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:30.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.231+0000 7fc45051d640 1 --2- 172.21.15.7:0/434476623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4480b2c30 0x7fc448160df0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fc44000b3e0 tx=0x7fc44000b8a0 comp rx=0 tx=0).stop 2024-04-25T10:04:30.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.232+0000 7fc45051d640 1 -- 172.21.15.7:0/434476623 shutdown_connections 2024-04-25T10:04:30.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.232+0000 7fc45051d640 1 --2- 172.21.15.7:0/434476623 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc43406b4d0 0x7fc43406d990 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:30.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.232+0000 7fc45051d640 1 --2- 172.21.15.7:0/434476623 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc44815deb0 0x7fc44815ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:30.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.232+0000 7fc45051d640 1 --2- 172.21.15.7:0/434476623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4480d3760 0x7fc4480b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:30.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.232+0000 7fc45051d640 1 --2- 172.21.15.7:0/434476623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4480b2c30 0x7fc448160df0 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:30.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.232+0000 7fc45051d640 1 -- 172.21.15.7:0/434476623 >> 172.21.15.7:0/434476623 conn(0x7fc4480726b0 msgr2=0x7fc448072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:30.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.233+0000 7fc45051d640 1 -- 172.21.15.7:0/434476623 shutdown_connections 2024-04-25T10:04:30.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.233+0000 7fc45051d640 1 -- 172.21.15.7:0/434476623 wait complete. 2024-04-25T10:04:30.270 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:30.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.369+0000 7fccd71c1640 1 Processor -- start 2024-04-25T10:04:30.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.369+0000 7fccd71c1640 1 -- start start 2024-04-25T10:04:30.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.369+0000 7fccd71c1640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fccd00d0a50 0x7fccd00d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:30.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.369+0000 7fccd71c1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fccd00b53b0 0x7fccd00d2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:30.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.369+0000 7fccd71c1640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd00d1e80 con 0x7fccd015db00 2024-04-25T10:04:30.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.369+0000 7fccd71c1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccd00b5930 con 0x7fccd00b53b0 2024-04-25T10:04:30.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.369+0000 7fccd71c1640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd00b5c10 con 0x7fccd00d0a50 2024-04-25T10:04:30.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.370+0000 7fccd4f5d640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fccd015db00 0x7fccd00d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39400/0 (socket says 172.21.15.7:39400) 2024-04-25T10:04:30.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.370+0000 7fccd4f5d640 1 -- 172.21.15.7:0/1543630702 learned_addr learned my addr 172.21.15.7:0/1543630702 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:30.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.370+0000 7fccc7fff640 1 --2- 172.21.15.7:0/1543630702 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fccd00d0a50 0x7fccd00d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:30.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.370+0000 7fccd575e640 1 --2- 172.21.15.7:0/1543630702 >> v2:172.21.15.55:3300/0 conn(0x7fccd00b53b0 0x7fccd00d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:30.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.370+0000 7fccc77fe640 1 -- 172.21.15.7:0/1543630702 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 684003458 0 0) 0x7fccd00d1e80 con 0x7fccd015db00 2024-04-25T10:04:30.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.370+0000 7fccc77fe640 1 -- 172.21.15.7:0/1543630702 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccb8003520 con 0x7fccd015db00 2024-04-25T10:04:30.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.370+0000 7fccc7fff640 1 -- 172.21.15.7:0/1543630702 >> v2:172.21.15.55:3300/0 conn(0x7fccd00b53b0 msgr2=0x7fccd00d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:30.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.370+0000 7fccc7fff640 1 --2- 172.21.15.7:0/1543630702 >> v2:172.21.15.55:3300/0 conn(0x7fccd00b53b0 0x7fccd00d2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:30.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.370+0000 7fccc7fff640 1 -- 172.21.15.7:0/1543630702 >> v1:172.21.15.7:6789/0 conn(0x7fccd015db00 legacy=0x7fccd00d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:30.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.370+0000 7fccc7fff640 1 -- 172.21.15.7:0/1543630702 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd00b5ef0 con 0x7fccd00d0a50 2024-04-25T10:04:30.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.370+0000 7fccd575e640 1 --2- 172.21.15.7:0/1543630702 >> v2:172.21.15.55:3300/0 conn(0x7fccd00b53b0 0x7fccd00d2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:30.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.371+0000 7fccc7fff640 1 --2- 172.21.15.7:0/1543630702 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fccd00d0a50 0x7fccd00d2330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fccc00097a0 tx=0x7fccc002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b6655b049708177 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:30.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.371+0000 7fccc77fe640 1 -- 172.21.15.7:0/1543630702 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc0037070 con 0x7fccd00d0a50 2024-04-25T10:04:30.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.371+0000 7fccc77fe640 1 -- 172.21.15.7:0/1543630702 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc0032440 con 0x7fccd00d0a50 2024-04-25T10:04:30.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.371+0000 7fccc77fe640 1 -- 172.21.15.7:0/1543630702 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc00327f0 con 0x7fccd00d0a50 2024-04-25T10:04:30.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.371+0000 7fccd71c1640 1 -- 172.21.15.7:0/1543630702 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fccd00d0a50 msgr2=0x7fccd00d2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:30.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.371+0000 7fccd71c1640 1 --2- 172.21.15.7:0/1543630702 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fccd00d0a50 0x7fccd00d2330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fccc00097a0 tx=0x7fccc002a180 comp rx=0 tx=0).stop 2024-04-25T10:04:30.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.372+0000 7fccd71c1640 1 -- 172.21.15.7:0/1543630702 shutdown_connections 2024-04-25T10:04:30.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.372+0000 7fccd71c1640 1 --2- 172.21.15.7:0/1543630702 >> v2:172.21.15.55:3300/0 conn(0x7fccd00b53b0 0x7fccd00d2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:30.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.372+0000 7fccd71c1640 1 --2- 172.21.15.7:0/1543630702 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fccd00d0a50 0x7fccd00d2330 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:30.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.372+0000 7fccd71c1640 1 -- 172.21.15.7:0/1543630702 >> 172.21.15.7:0/1543630702 conn(0x7fccd0072290 msgr2=0x7fccd00726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:30.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.372+0000 7fccd71c1640 1 -- 172.21.15.7:0/1543630702 shutdown_connections 2024-04-25T10:04:30.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.372+0000 7fccd71c1640 1 -- 172.21.15.7:0/1543630702 wait complete. 2024-04-25T10:04:30.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.373+0000 7fccd71c1640 1 Processor -- start 2024-04-25T10:04:30.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.373+0000 7fccd71c1640 1 -- start start 2024-04-25T10:04:30.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.374+0000 7fccd71c1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccd00b53b0 0x7fccd00b73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:30.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.374+0000 7fccd71c1640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fccd00d0a50 0x7fccd0149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:30.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.374+0000 7fccd71c1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccd015db00 0x7fccd0154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:30.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.374+0000 7fccd71c1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd00d3660 con 0x7fccd00b53b0 2024-04-25T10:04:30.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.374+0000 7fccd71c1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd00b61d0 con 0x7fccd015db00 2024-04-25T10:04:30.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.374+0000 7fccd71c1640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd00ce2b0 con 0x7fccd00d0a50 2024-04-25T10:04:30.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.374+0000 7fccd4f5d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccd00b53b0 0x7fccd00b73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:30.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.374+0000 7fccd4f5d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccd00b53b0 0x7fccd00b73a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47582/0 (socket says 172.21.15.7:47582) 2024-04-25T10:04:30.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.374+0000 7fccd4f5d640 1 -- 172.21.15.7:0/3057253665 learned_addr learned my addr 172.21.15.7:0/3057253665 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:30.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.374+0000 7fccd4f5d640 1 -- 172.21.15.7:0/3057253665 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fccd00d0a50 msgr2=0x7fccd0149ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:30.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.374+0000 7fccd4f5d640 1 --2- 172.21.15.7:0/3057253665 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fccd00d0a50 0x7fccd0149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:30.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.374+0000 7fccd4f5d640 1 -- 172.21.15.7:0/3057253665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccd015db00 msgr2=0x7fccd0154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:30.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.374+0000 7fccd575e640 1 --2- 172.21.15.7:0/3057253665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccd015db00 0x7fccd0154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:30.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.374+0000 7fccd4f5d640 1 --2- 172.21.15.7:0/3057253665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccd015db00 0x7fccd0154990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:30.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.374+0000 7fccd4f5d640 1 -- 172.21.15.7:0/3057253665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd00c9ba0 con 0x7fccd00b53b0 2024-04-25T10:04:30.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.374+0000 7fccd4f5d640 1 --2- 172.21.15.7:0/3057253665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccd00b53b0 0x7fccd00b73a0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00c390 tx=0x7fcccc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:30.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.374+0000 7fccc57fa640 1 -- 172.21.15.7:0/3057253665 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc017070 con 0x7fccd00b53b0 2024-04-25T10:04:30.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.375+0000 7fccc57fa640 1 -- 172.21.15.7:0/3057253665 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcccc005ce0 con 0x7fccd00b53b0 2024-04-25T10:04:30.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.375+0000 7fccd71c1640 1 -- 172.21.15.7:0/3057253665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd00c8b00 con 0x7fccd00b53b0 2024-04-25T10:04:30.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.375+0000 7fccc57fa640 1 -- 172.21.15.7:0/3057253665 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc0072f0 con 0x7fccd00b53b0 2024-04-25T10:04:30.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.375+0000 7fccd71c1640 1 -- 172.21.15.7:0/3057253665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd00c90c0 con 0x7fccd00b53b0 2024-04-25T10:04:30.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.376+0000 7fccd71c1640 1 -- 172.21.15.7:0/3057253665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd0068fd0 con 0x7fccd00b53b0 2024-04-25T10:04:30.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.376+0000 7fccc57fa640 1 -- 172.21.15.7:0/3057253665 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcccc01a070 con 0x7fccd00b53b0 2024-04-25T10:04:30.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.377+0000 7fccc57fa640 1 --2- 172.21.15.7:0/3057253665 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fccbc06b4d0 0x7fccbc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:30.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.377+0000 7fccc57fa640 1 -- 172.21.15.7:0/3057253665 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcccc089790 con 0x7fccd00b53b0 2024-04-25T10:04:30.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.377+0000 7fccc7fff640 1 --2- 172.21.15.7:0/3057253665 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fccbc06b4d0 0x7fccbc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:30.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.377+0000 7fccc7fff640 1 --2- 172.21.15.7:0/3057253665 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fccbc06b4d0 0x7fccbc06d990 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fccc0034000 tx=0x7fccc002c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:30.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.381+0000 7fccc57fa640 1 -- 172.21.15.7:0/3057253665 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcccc058480 con 0x7fccd00b53b0 2024-04-25T10:04:30.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.562+0000 7fccd71c1640 1 -- 172.21.15.7:0/3057253665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fccd00d16b0 con 0x7fccd00b53b0 2024-04-25T10:04:30.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.563+0000 7fccc57fa640 1 -- 172.21.15.7:0/3057253665 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+16869 (secure 0 0 0) 0x7fcccc057d80 con 0x7fccd00b53b0 2024-04-25T10:04:30.568 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:30.568 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":116,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:04:29.598916+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:04:27.856713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T10:04:28.566676+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:30.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.565+0000 7fccd71c1640 1 -- 172.21.15.7:0/3057253665 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fccbc06b4d0 msgr2=0x7fccbc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:30.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.565+0000 7fccd71c1640 1 --2- 172.21.15.7:0/3057253665 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fccbc06b4d0 0x7fccbc06d990 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fccc0034000 tx=0x7fccc002c000 comp rx=0 tx=0).stop 2024-04-25T10:04:30.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.565+0000 7fccd71c1640 1 -- 172.21.15.7:0/3057253665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccd00b53b0 msgr2=0x7fccd00b73a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:30.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.565+0000 7fccd71c1640 1 --2- 172.21.15.7:0/3057253665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccd00b53b0 0x7fccd00b73a0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00c390 tx=0x7fcccc00c850 comp rx=0 tx=0).stop 2024-04-25T10:04:30.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.565+0000 7fccd71c1640 1 -- 172.21.15.7:0/3057253665 shutdown_connections 2024-04-25T10:04:30.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.565+0000 7fccd71c1640 1 --2- 172.21.15.7:0/3057253665 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fccbc06b4d0 0x7fccbc06d990 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:30.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.565+0000 7fccd71c1640 1 --2- 172.21.15.7:0/3057253665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccd015db00 0x7fccd0154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:30.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.565+0000 7fccd71c1640 1 --2- 172.21.15.7:0/3057253665 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fccd00d0a50 0x7fccd0149ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:30.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.565+0000 7fccd71c1640 1 --2- 172.21.15.7:0/3057253665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccd00b53b0 0x7fccd00b73a0 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:30.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.565+0000 7fccd71c1640 1 -- 172.21.15.7:0/3057253665 >> 172.21.15.7:0/3057253665 conn(0x7fccd0072290 msgr2=0x7fccd0158bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:30.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.565+0000 7fccd71c1640 1 -- 172.21.15.7:0/3057253665 shutdown_connections 2024-04-25T10:04:30.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.565+0000 7fccd71c1640 1 -- 172.21.15.7:0/3057253665 wait complete. 2024-04-25T10:04:30.582 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:30.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.678+0000 7f33ccc9e640 1 Processor -- start 2024-04-25T10:04:30.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.678+0000 7f33ccc9e640 1 -- start start 2024-04-25T10:04:30.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.679+0000 7f33ccc9e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f33c80b5e60 0x7f33c806bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:30.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.679+0000 7f33ccc9e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f33c80b6a40 0x7f33c806c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:30.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.679+0000 7f33ccc9e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c806ca30 con 0x7f33c815dd00 2024-04-25T10:04:30.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.679+0000 7f33ccc9e640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c815e0e0 con 0x7f33c80b6a40 2024-04-25T10:04:30.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.679+0000 7f33ccc9e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c806cfe0 con 0x7f33c80b5e60 2024-04-25T10:04:30.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.679+0000 7f33c6d9d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f33c80b6a40 0x7f33c806c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:30.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.679+0000 7f33c6d9d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f33c80b6a40 0x7f33c806c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47594/0 (socket says 172.21.15.7:47594) 2024-04-25T10:04:30.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.679+0000 7f33c6d9d640 1 -- 172.21.15.7:0/2277771187 learned_addr learned my addr 172.21.15.7:0/2277771187 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:30.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.679+0000 7f33bffff640 1 --2- 172.21.15.7:0/2277771187 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f33c80b5e60 0x7f33c806bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:30.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.679+0000 7f33c6d9d640 1 -- 172.21.15.7:0/2277771187 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f33c80b5e60 msgr2=0x7f33c806bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:30.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.679+0000 7f33c6d9d640 1 --2- 172.21.15.7:0/2277771187 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f33c80b5e60 0x7f33c806bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:30.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.679+0000 7f33c6d9d640 1 -- 172.21.15.7:0/2277771187 >> v1:172.21.15.55:6789/0 conn(0x7f33c815dd00 legacy=0x7f33c80b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:30.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.679+0000 7f33c6d9d640 1 -- 172.21.15.7:0/2277771187 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c806cd00 con 0x7f33c80b6a40 2024-04-25T10:04:30.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.680+0000 7f33c6d9d640 1 --2- 172.21.15.7:0/2277771187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33c80b6a40 0x7f33c806c4f0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f33c0009e50 tx=0x7f33c002a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16e27ea5044763d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:30.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.680+0000 7f33c5d9b640 1 -- 172.21.15.7:0/2277771187 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c0036070 con 0x7f33c80b6a40 2024-04-25T10:04:30.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.680+0000 7f33c5d9b640 1 -- 172.21.15.7:0/2277771187 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c0031600 con 0x7f33c80b6a40 2024-04-25T10:04:30.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.680+0000 7f33c5d9b640 1 -- 172.21.15.7:0/2277771187 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c00319d0 con 0x7f33c80b6a40 2024-04-25T10:04:30.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.681+0000 7f33ccc9e640 1 -- 172.21.15.7:0/2277771187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33c80b6a40 msgr2=0x7f33c806c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:30.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.681+0000 7f33ccc9e640 1 --2- 172.21.15.7:0/2277771187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33c80b6a40 0x7f33c806c4f0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f33c0009e50 tx=0x7f33c002a750 comp rx=0 tx=0).stop 2024-04-25T10:04:30.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.681+0000 7f33ccc9e640 1 -- 172.21.15.7:0/2277771187 shutdown_connections 2024-04-25T10:04:30.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.681+0000 7f33ccc9e640 1 --2- 172.21.15.7:0/2277771187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33c80b6a40 0x7f33c806c4f0 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:30.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.681+0000 7f33ccc9e640 1 --2- 172.21.15.7:0/2277771187 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f33c80b5e60 0x7f33c806bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:30.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.681+0000 7f33ccc9e640 1 -- 172.21.15.7:0/2277771187 >> 172.21.15.7:0/2277771187 conn(0x7f33c80d07b0 msgr2=0x7f33c80d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:30.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.681+0000 7f33ccc9e640 1 -- 172.21.15.7:0/2277771187 shutdown_connections 2024-04-25T10:04:30.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.681+0000 7f33ccc9e640 1 -- 172.21.15.7:0/2277771187 wait complete. 2024-04-25T10:04:30.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.682+0000 7f33ccc9e640 1 Processor -- start 2024-04-25T10:04:30.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.682+0000 7f33ccc9e640 1 -- start start 2024-04-25T10:04:30.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.683+0000 7f33ccc9e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33c80b5e60 0x7f33c80c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:30.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.683+0000 7f33ccc9e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f33c80b6a40 0x7f33c81547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:30.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.683+0000 7f33ccc9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33c815dd00 0x7f33c815fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:30.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.683+0000 7f33ccc9e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c80d2260 con 0x7f33c80b5e60 2024-04-25T10:04:30.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.683+0000 7f33ccc9e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c80d1f80 con 0x7f33c815dd00 2024-04-25T10:04:30.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.683+0000 7f33ccc9e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c80d2780 con 0x7f33c80b6a40 2024-04-25T10:04:30.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.683+0000 7f33c659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33c80b5e60 0x7f33c80c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:30.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.683+0000 7f33c659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33c80b5e60 0x7f33c80c9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47608/0 (socket says 172.21.15.7:47608) 2024-04-25T10:04:30.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.683+0000 7f33c659c640 1 -- 172.21.15.7:0/55097636 learned_addr learned my addr 172.21.15.7:0/55097636 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:30.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.683+0000 7f33c6d9d640 1 --2- 172.21.15.7:0/55097636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33c815dd00 0x7f33c815fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:30.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.683+0000 7f33bffff640 1 --2- 172.21.15.7:0/55097636 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f33c80b6a40 0x7f33c81547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:30.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.683+0000 7f33c659c640 1 -- 172.21.15.7:0/55097636 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f33c80b6a40 msgr2=0x7f33c81547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:30.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.683+0000 7f33c659c640 1 --2- 172.21.15.7:0/55097636 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f33c80b6a40 0x7f33c81547f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:30.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.683+0000 7f33c659c640 1 -- 172.21.15.7:0/55097636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33c815dd00 msgr2=0x7f33c815fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:30.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.683+0000 7f33c659c640 1 --2- 172.21.15.7:0/55097636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33c815dd00 0x7f33c815fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:30.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.683+0000 7f33c659c640 1 -- 172.21.15.7:0/55097636 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c8155160 con 0x7f33c80b5e60 2024-04-25T10:04:30.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.683+0000 7f33c6d9d640 1 --2- 172.21.15.7:0/55097636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33c815dd00 0x7f33c815fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:30.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.683+0000 7f33c659c640 1 --2- 172.21.15.7:0/55097636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33c80b5e60 0x7f33c80c9360 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f33b800b420 tx=0x7f33b800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:30.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.684+0000 7f33beffd640 1 -- 172.21.15.7:0/55097636 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b8011830 con 0x7f33c80b5e60 2024-04-25T10:04:30.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.684+0000 7f33beffd640 1 -- 172.21.15.7:0/55097636 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b8016070 con 0x7f33c80b5e60 2024-04-25T10:04:30.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.684+0000 7f33beffd640 1 -- 172.21.15.7:0/55097636 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b8011c10 con 0x7f33c80b5e60 2024-04-25T10:04:30.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.684+0000 7f33ccc9e640 1 -- 172.21.15.7:0/55097636 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c8155440 con 0x7f33c80b5e60 2024-04-25T10:04:30.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.684+0000 7f33ccc9e640 1 -- 172.21.15.7:0/55097636 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c8155a00 con 0x7f33c80b5e60 2024-04-25T10:04:30.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.685+0000 7f33ccc9e640 1 -- 172.21.15.7:0/55097636 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33c80cfe70 con 0x7f33c80b5e60 2024-04-25T10:04:30.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.685+0000 7f33beffd640 1 -- 172.21.15.7:0/55097636 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f33b801b460 con 0x7f33c80b5e60 2024-04-25T10:04:30.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.686+0000 7f33beffd640 1 --2- 172.21.15.7:0/55097636 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f33a806b4d0 0x7f33a806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:30.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.686+0000 7f33beffd640 1 -- 172.21.15.7:0/55097636 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f33b8089f10 con 0x7f33c80b5e60 2024-04-25T10:04:30.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.686+0000 7f33bffff640 1 --2- 172.21.15.7:0/55097636 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f33a806b4d0 0x7f33a806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:30.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.686+0000 7f33bffff640 1 --2- 172.21.15.7:0/55097636 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f33a806b4d0 0x7f33a806d990 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f33c81565d0 tx=0x7f33b0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:30.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.690+0000 7f33beffd640 1 -- 172.21.15.7:0/55097636 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f33c80cfe70 con 0x7f33c80b5e60 2024-04-25T10:04:30.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.870+0000 7f33ccc9e640 1 -- 172.21.15.7:0/55097636 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33c8068fd0 con 0x7f33c80b5e60 2024-04-25T10:04:30.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.872+0000 7f33beffd640 1 -- 172.21.15.7:0/55097636 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+16869 (secure 0 0 0) 0x7f33b8020020 con 0x7f33c80b5e60 2024-04-25T10:04:30.877 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:30.877 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":116,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:04:29.598916+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:04:27.856713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T10:04:28.566676+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:30.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.874+0000 7f33ccc9e640 1 -- 172.21.15.7:0/55097636 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f33a806b4d0 msgr2=0x7f33a806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:30.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.874+0000 7f33ccc9e640 1 --2- 172.21.15.7:0/55097636 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f33a806b4d0 0x7f33a806d990 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f33c81565d0 tx=0x7f33b0008040 comp rx=0 tx=0).stop 2024-04-25T10:04:30.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.874+0000 7f33ccc9e640 1 -- 172.21.15.7:0/55097636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33c80b5e60 msgr2=0x7f33c80c9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:30.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.874+0000 7f33ccc9e640 1 --2- 172.21.15.7:0/55097636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33c80b5e60 0x7f33c80c9360 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f33b800b420 tx=0x7f33b800b8e0 comp rx=0 tx=0).stop 2024-04-25T10:04:30.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.874+0000 7f33ccc9e640 1 -- 172.21.15.7:0/55097636 shutdown_connections 2024-04-25T10:04:30.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.874+0000 7f33ccc9e640 1 --2- 172.21.15.7:0/55097636 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f33a806b4d0 0x7f33a806d990 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:30.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.874+0000 7f33ccc9e640 1 --2- 172.21.15.7:0/55097636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33c815dd00 0x7f33c815fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:30.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.874+0000 7f33ccc9e640 1 --2- 172.21.15.7:0/55097636 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f33c80b6a40 0x7f33c81547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:30.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.874+0000 7f33ccc9e640 1 --2- 172.21.15.7:0/55097636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33c80b5e60 0x7f33c80c9360 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:30.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.874+0000 7f33ccc9e640 1 -- 172.21.15.7:0/55097636 >> 172.21.15.7:0/55097636 conn(0x7f33c80d07b0 msgr2=0x7f33c80b6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:30.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.874+0000 7f33ccc9e640 1 -- 172.21.15.7:0/55097636 shutdown_connections 2024-04-25T10:04:30.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.874+0000 7f33ccc9e640 1 -- 172.21.15.7:0/55097636 wait complete. 2024-04-25T10:04:30.890 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T10:04:30.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.989+0000 7fda28de2640 1 Processor -- start 2024-04-25T10:04:30.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.989+0000 7fda28de2640 1 -- start start 2024-04-25T10:04:30.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.990+0000 7fda28de2640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fda240d3760 0x7fda2415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:30.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.990+0000 7fda28de2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fda2415f1c0 0x7fda240d3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:30.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.990+0000 7fda28de2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda240d4080 con 0x7fda240ce830 2024-04-25T10:04:30.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.990+0000 7fda28de2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda240ce380 con 0x7fda2415f1c0 2024-04-25T10:04:30.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.990+0000 7fda28de2640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2415f000 con 0x7fda240d3760 2024-04-25T10:04:30.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.990+0000 7fda2259c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fda240d3760 0x7fda2415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:30.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.990+0000 7fda21d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fda2415f1c0 0x7fda240d3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:30.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.990+0000 7fda22d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fda240ce830 0x7fda240b2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:42802/0 (socket says 172.21.15.7:42802) 2024-04-25T10:04:30.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.990+0000 7fda22d9d640 1 -- 172.21.15.7:0/2329007759 learned_addr learned my addr 172.21.15.7:0/2329007759 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:30.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.991+0000 7fda2159a640 1 -- 172.21.15.7:0/2329007759 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899170640 0 0) 0x7fda240d4080 con 0x7fda240ce830 2024-04-25T10:04:30.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.991+0000 7fda2159a640 1 -- 172.21.15.7:0/2329007759 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda10003520 con 0x7fda240ce830 2024-04-25T10:04:30.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.991+0000 7fda2259c640 1 -- 172.21.15.7:0/2329007759 >> v2:172.21.15.55:3300/0 conn(0x7fda2415f1c0 msgr2=0x7fda240d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:30.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.991+0000 7fda2259c640 1 --2- 172.21.15.7:0/2329007759 >> v2:172.21.15.55:3300/0 conn(0x7fda2415f1c0 0x7fda240d3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:30.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.991+0000 7fda2259c640 1 -- 172.21.15.7:0/2329007759 >> v1:172.21.15.55:6789/0 conn(0x7fda240ce830 legacy=0x7fda240b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:30.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.991+0000 7fda2259c640 1 -- 172.21.15.7:0/2329007759 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda240ced10 con 0x7fda240d3760 2024-04-25T10:04:30.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.991+0000 7fda21d9b640 1 --2- 172.21.15.7:0/2329007759 >> v2:172.21.15.55:3300/0 conn(0x7fda2415f1c0 0x7fda240d3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:30.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.991+0000 7fda2259c640 1 --2- 172.21.15.7:0/2329007759 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fda240d3760 0x7fda2415eac0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fda14009d90 tx=0x7fda1402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b10cc2b6b56ab15 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:30.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.992+0000 7fda2159a640 1 -- 172.21.15.7:0/2329007759 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda14007740 con 0x7fda240d3760 2024-04-25T10:04:30.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.992+0000 7fda2159a640 1 -- 172.21.15.7:0/2329007759 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda140078e0 con 0x7fda240d3760 2024-04-25T10:04:30.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.992+0000 7fda2159a640 1 -- 172.21.15.7:0/2329007759 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda14007cb0 con 0x7fda240d3760 2024-04-25T10:04:30.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.992+0000 7fda28de2640 1 -- 172.21.15.7:0/2329007759 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fda240d3760 msgr2=0x7fda2415eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:30.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.992+0000 7fda28de2640 1 --2- 172.21.15.7:0/2329007759 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fda240d3760 0x7fda2415eac0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fda14009d90 tx=0x7fda1402a660 comp rx=0 tx=0).stop 2024-04-25T10:04:30.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.992+0000 7fda28de2640 1 -- 172.21.15.7:0/2329007759 shutdown_connections 2024-04-25T10:04:30.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.992+0000 7fda28de2640 1 --2- 172.21.15.7:0/2329007759 >> v2:172.21.15.55:3300/0 conn(0x7fda2415f1c0 0x7fda240d3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:30.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.992+0000 7fda28de2640 1 --2- 172.21.15.7:0/2329007759 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fda240d3760 0x7fda2415eac0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:30.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.992+0000 7fda28de2640 1 -- 172.21.15.7:0/2329007759 >> 172.21.15.7:0/2329007759 conn(0x7fda24072680 msgr2=0x7fda24072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:30.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.992+0000 7fda28de2640 1 -- 172.21.15.7:0/2329007759 shutdown_connections 2024-04-25T10:04:30.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.992+0000 7fda28de2640 1 -- 172.21.15.7:0/2329007759 wait complete. 2024-04-25T10:04:31.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.994+0000 7fda28de2640 1 Processor -- start 2024-04-25T10:04:31.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.994+0000 7fda28de2640 1 -- start start 2024-04-25T10:04:31.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.994+0000 7fda28de2640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fda240ce830 0x7fda24155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:31.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.994+0000 7fda28de2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda240d3760 0x7fda240c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:31.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.994+0000 7fda28de2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda2415f1c0 0x7fda240c73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:31.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.994+0000 7fda28de2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda240d1e20 con 0x7fda2415f1c0 2024-04-25T10:04:31.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.994+0000 7fda28de2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda240d2190 con 0x7fda240d3760 2024-04-25T10:04:31.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.994+0000 7fda28de2640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2415de10 con 0x7fda240ce830 2024-04-25T10:04:31.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.995+0000 7fda22d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda2415f1c0 0x7fda240c73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:31.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.995+0000 7fda22d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda2415f1c0 0x7fda240c73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47612/0 (socket says 172.21.15.7:47612) 2024-04-25T10:04:31.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.995+0000 7fda22d9d640 1 -- 172.21.15.7:0/3913292350 learned_addr learned my addr 172.21.15.7:0/3913292350 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:31.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.995+0000 7fda21d9b640 1 --2- 172.21.15.7:0/3913292350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda240d3760 0x7fda240c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:31.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.995+0000 7fda2259c640 1 --2- 172.21.15.7:0/3913292350 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fda240ce830 0x7fda24155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:31.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.995+0000 7fda22d9d640 1 -- 172.21.15.7:0/3913292350 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fda240ce830 msgr2=0x7fda24155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:31.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.995+0000 7fda22d9d640 1 --2- 172.21.15.7:0/3913292350 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fda240ce830 0x7fda24155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:31.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.995+0000 7fda22d9d640 1 -- 172.21.15.7:0/3913292350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda240d3760 msgr2=0x7fda240c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:31.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.995+0000 7fda22d9d640 1 --2- 172.21.15.7:0/3913292350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda240d3760 0x7fda240c8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:31.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.995+0000 7fda22d9d640 1 -- 172.21.15.7:0/3913292350 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda241587b0 con 0x7fda2415f1c0 2024-04-25T10:04:31.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.995+0000 7fda22d9d640 1 --2- 172.21.15.7:0/3913292350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda2415f1c0 0x7fda240c73e0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fda1c00c400 tx=0x7fda1c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:31.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.995+0000 7fda1affd640 1 -- 172.21.15.7:0/3913292350 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c017070 con 0x7fda2415f1c0 2024-04-25T10:04:31.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.995+0000 7fda1affd640 1 -- 172.21.15.7:0/3913292350 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1c005ce0 con 0x7fda2415f1c0 2024-04-25T10:04:31.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.995+0000 7fda28de2640 1 -- 172.21.15.7:0/3913292350 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda24158a50 con 0x7fda2415f1c0 2024-04-25T10:04:31.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.995+0000 7fda1affd640 1 -- 172.21.15.7:0/3913292350 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c0072d0 con 0x7fda2415f1c0 2024-04-25T10:04:31.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.995+0000 7fda28de2640 1 -- 172.21.15.7:0/3913292350 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda24158d30 con 0x7fda2415f1c0 2024-04-25T10:04:31.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.996+0000 7fda28de2640 1 -- 172.21.15.7:0/3913292350 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda24068f60 con 0x7fda2415f1c0 2024-04-25T10:04:31.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.997+0000 7fda1affd640 1 -- 172.21.15.7:0/3913292350 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fda1c01a070 con 0x7fda2415f1c0 2024-04-25T10:04:31.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.997+0000 7fda1affd640 1 --2- 172.21.15.7:0/3913292350 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fda0406b4d0 0x7fda0406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:31.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.997+0000 7fda1affd640 1 -- 172.21.15.7:0/3913292350 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fda1c089720 con 0x7fda2415f1c0 2024-04-25T10:04:31.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.997+0000 7fda2259c640 1 --2- 172.21.15.7:0/3913292350 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fda0406b4d0 0x7fda0406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:31.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:30.998+0000 7fda2259c640 1 --2- 172.21.15.7:0/3913292350 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fda0406b4d0 0x7fda0406d990 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fda14009d90 tx=0x7fda1402f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:31.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.002+0000 7fda1affd640 1 -- 172.21.15.7:0/3913292350 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fda1c057d30 con 0x7fda2415f1c0 2024-04-25T10:04:31.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.220+0000 7fda28de2640 1 -- 172.21.15.7:0/3913292350 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fda240ce610 con 0x7fda2415f1c0 2024-04-25T10:04:31.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.244+0000 7fda1affd640 1 -- 172.21.15.7:0/3913292350 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v87) v1 ==== 118+0+0 (secure 0 0 0) 0x7fda1c05bdd0 con 0x7fda2415f1c0 2024-04-25T10:04:31.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.246+0000 7fda28de2640 1 -- 172.21.15.7:0/3913292350 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fda0406b4d0 msgr2=0x7fda0406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:31.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.246+0000 7fda28de2640 1 --2- 172.21.15.7:0/3913292350 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fda0406b4d0 0x7fda0406d990 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fda14009d90 tx=0x7fda1402f000 comp rx=0 tx=0).stop 2024-04-25T10:04:31.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.246+0000 7fda28de2640 1 -- 172.21.15.7:0/3913292350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda2415f1c0 msgr2=0x7fda240c73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:31.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.246+0000 7fda28de2640 1 --2- 172.21.15.7:0/3913292350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda2415f1c0 0x7fda240c73e0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fda1c00c400 tx=0x7fda1c00c8c0 comp rx=0 tx=0).stop 2024-04-25T10:04:31.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.246+0000 7fda28de2640 1 -- 172.21.15.7:0/3913292350 shutdown_connections 2024-04-25T10:04:31.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.246+0000 7fda28de2640 1 --2- 172.21.15.7:0/3913292350 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fda0406b4d0 0x7fda0406d990 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:31.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.246+0000 7fda28de2640 1 --2- 172.21.15.7:0/3913292350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fda2415f1c0 0x7fda240c73e0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:31.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.246+0000 7fda28de2640 1 --2- 172.21.15.7:0/3913292350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda240d3760 0x7fda240c8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:31.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.246+0000 7fda28de2640 1 --2- 172.21.15.7:0/3913292350 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fda240ce830 0x7fda24155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:31.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.246+0000 7fda28de2640 1 -- 172.21.15.7:0/3913292350 >> 172.21.15.7:0/3913292350 conn(0x7fda24072680 msgr2=0x7fda2415e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:31.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.246+0000 7fda28de2640 1 -- 172.21.15.7:0/3913292350 shutdown_connections 2024-04-25T10:04:31.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.246+0000 7fda28de2640 1 -- 172.21.15.7:0/3913292350 wait complete. 2024-04-25T10:04:31.262 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T10:04:31.262 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T10:04:31.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.361+0000 7f32719e0640 1 Processor -- start 2024-04-25T10:04:31.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.361+0000 7f32719e0640 1 -- start start 2024-04-25T10:04:31.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.361+0000 7f32719e0640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f326c0cefb0 0x7f326c0d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:31.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.361+0000 7f32719e0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f326c0d21b0 0x7f326c0b7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:31.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.361+0000 7f32719e0640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f326c0d29c0 con 0x7f326c15db70 2024-04-25T10:04:31.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.361+0000 7f32719e0640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f326c0b6ce0 con 0x7f326c0cefb0 2024-04-25T10:04:31.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.361+0000 7f32719e0640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f326c0d2f80 con 0x7f326c0d21b0 2024-04-25T10:04:31.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.362+0000 7f326a7fc640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f326c0cefb0 0x7f326c0d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:31.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.362+0000 7f326affd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f326c15db70 0x7f326c0ce8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39402/0 (socket says 172.21.15.7:39402) 2024-04-25T10:04:31.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.362+0000 7f326affd640 1 -- 172.21.15.7:0/2935296502 learned_addr learned my addr 172.21.15.7:0/2935296502 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:31.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.362+0000 7f326b7fe640 1 --2- 172.21.15.7:0/2935296502 >> v2:172.21.15.55:3300/0 conn(0x7f326c0d21b0 0x7f326c0b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:31.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.362+0000 7f326a7fc640 1 -- 172.21.15.7:0/2935296502 >> v2:172.21.15.55:3300/0 conn(0x7f326c0d21b0 msgr2=0x7f326c0b7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:31.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.362+0000 7f326a7fc640 1 --2- 172.21.15.7:0/2935296502 >> v2:172.21.15.55:3300/0 conn(0x7f326c0d21b0 0x7f326c0b7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:31.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.362+0000 7f326a7fc640 1 -- 172.21.15.7:0/2935296502 >> v1:172.21.15.7:6789/0 conn(0x7f326c15db70 legacy=0x7f326c0ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:31.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.362+0000 7f3269ffb640 1 -- 172.21.15.7:0/2935296502 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2819679719 0 0) 0x7f326c0d29c0 con 0x7f326c15db70 2024-04-25T10:04:31.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.362+0000 7f326a7fc640 1 -- 172.21.15.7:0/2935296502 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f326c0d2ca0 con 0x7f326c0cefb0 2024-04-25T10:04:31.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.362+0000 7f326b7fe640 1 --2- 172.21.15.7:0/2935296502 >> v2:172.21.15.55:3300/0 conn(0x7f326c0d21b0 0x7f326c0b7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:31.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.363+0000 7f326a7fc640 1 --2- 172.21.15.7:0/2935296502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f326c0cefb0 0x7f326c0d1c70 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f326c0b71f0 tx=0x7f325402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ef1ac49dd1a6fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:31.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.363+0000 7f3269ffb640 1 -- 172.21.15.7:0/2935296502 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3254037070 con 0x7f326c0cefb0 2024-04-25T10:04:31.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.363+0000 7f3269ffb640 1 -- 172.21.15.7:0/2935296502 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3254032440 con 0x7f326c0cefb0 2024-04-25T10:04:31.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.363+0000 7f3269ffb640 1 -- 172.21.15.7:0/2935296502 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3254032810 con 0x7f326c0cefb0 2024-04-25T10:04:31.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.363+0000 7f32719e0640 1 -- 172.21.15.7:0/2935296502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f326c0cefb0 msgr2=0x7f326c0d1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:31.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.363+0000 7f32719e0640 1 --2- 172.21.15.7:0/2935296502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f326c0cefb0 0x7f326c0d1c70 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f326c0b71f0 tx=0x7f325402a1a0 comp rx=0 tx=0).stop 2024-04-25T10:04:31.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.363+0000 7f32719e0640 1 -- 172.21.15.7:0/2935296502 shutdown_connections 2024-04-25T10:04:31.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.363+0000 7f32719e0640 1 --2- 172.21.15.7:0/2935296502 >> v2:172.21.15.55:3300/0 conn(0x7f326c0d21b0 0x7f326c0b7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:31.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.363+0000 7f32719e0640 1 --2- 172.21.15.7:0/2935296502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f326c0cefb0 0x7f326c0d1c70 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:31.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.363+0000 7f32719e0640 1 -- 172.21.15.7:0/2935296502 >> 172.21.15.7:0/2935296502 conn(0x7f326c0b5370 msgr2=0x7f326c0b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:31.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.363+0000 7f32719e0640 1 -- 172.21.15.7:0/2935296502 shutdown_connections 2024-04-25T10:04:31.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.363+0000 7f32719e0640 1 -- 172.21.15.7:0/2935296502 wait complete. 2024-04-25T10:04:31.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.364+0000 7f32719e0640 1 Processor -- start 2024-04-25T10:04:31.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.365+0000 7f32719e0640 1 -- start start 2024-04-25T10:04:31.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.365+0000 7f32719e0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f326c0cefb0 0x7f326c0c7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:31.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.365+0000 7f32719e0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f326c0d21b0 0x7f326c152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:31.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.365+0000 7f32719e0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f326c15db70 0x7f326c15bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:31.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.365+0000 7f32719e0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326c0d2600 con 0x7f326c0cefb0 2024-04-25T10:04:31.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.365+0000 7f32719e0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326c0b7280 con 0x7f326c0d21b0 2024-04-25T10:04:31.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.365+0000 7f32719e0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f326c0d2780 con 0x7f326c15db70 2024-04-25T10:04:31.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.365+0000 7f326affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f326c0cefb0 0x7f326c0c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:31.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.365+0000 7f326affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f326c0cefb0 0x7f326c0c7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47638/0 (socket says 172.21.15.7:47638) 2024-04-25T10:04:31.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.365+0000 7f326affd640 1 -- 172.21.15.7:0/2333931226 learned_addr learned my addr 172.21.15.7:0/2333931226 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:31.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.366+0000 7f326a7fc640 1 --2- 172.21.15.7:0/2333931226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f326c0d21b0 0x7f326c152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:31.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.366+0000 7f326b7fe640 1 --2- 172.21.15.7:0/2333931226 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f326c15db70 0x7f326c15bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:31.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.366+0000 7f326affd640 1 -- 172.21.15.7:0/2333931226 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f326c15db70 msgr2=0x7f326c15bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:31.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.366+0000 7f326affd640 1 --2- 172.21.15.7:0/2333931226 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f326c15db70 0x7f326c15bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:31.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.366+0000 7f326affd640 1 -- 172.21.15.7:0/2333931226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f326c0d21b0 msgr2=0x7f326c152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:31.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.366+0000 7f326affd640 1 --2- 172.21.15.7:0/2333931226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f326c0d21b0 0x7f326c152e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:31.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.366+0000 7f326affd640 1 -- 172.21.15.7:0/2333931226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f326c1f78f0 con 0x7f326c0cefb0 2024-04-25T10:04:31.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.366+0000 7f326b7fe640 1 --2- 172.21.15.7:0/2333931226 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f326c15db70 0x7f326c15bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:31.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.366+0000 7f326affd640 1 --2- 172.21.15.7:0/2333931226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f326c0cefb0 0x7f326c0c7070 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f326400c7c0 tx=0x7f326400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:31.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.366+0000 7f3263fff640 1 -- 172.21.15.7:0/2333931226 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3264018070 con 0x7f326c0cefb0 2024-04-25T10:04:31.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.366+0000 7f3263fff640 1 -- 172.21.15.7:0/2333931226 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326400a5e0 con 0x7f326c0cefb0 2024-04-25T10:04:31.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.366+0000 7f32719e0640 1 -- 172.21.15.7:0/2333931226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f326c1f7bd0 con 0x7f326c0cefb0 2024-04-25T10:04:31.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.366+0000 7f3263fff640 1 -- 172.21.15.7:0/2333931226 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326400a9d0 con 0x7f326c0cefb0 2024-04-25T10:04:31.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.366+0000 7f32719e0640 1 -- 172.21.15.7:0/2333931226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f326c1f8190 con 0x7f326c0cefb0 2024-04-25T10:04:31.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.367+0000 7f32719e0640 1 -- 172.21.15.7:0/2333931226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f326c074bb0 con 0x7f326c0cefb0 2024-04-25T10:04:31.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.368+0000 7f3263fff640 1 -- 172.21.15.7:0/2333931226 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f326401b070 con 0x7f326c0cefb0 2024-04-25T10:04:31.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.368+0000 7f3263fff640 1 --2- 172.21.15.7:0/2333931226 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f324c06b4d0 0x7f324c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:31.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.368+0000 7f3263fff640 1 -- 172.21.15.7:0/2333931226 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3264089970 con 0x7f326c0cefb0 2024-04-25T10:04:31.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.368+0000 7f326a7fc640 1 --2- 172.21.15.7:0/2333931226 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f324c06b4d0 0x7f324c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:31.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.369+0000 7f326a7fc640 1 --2- 172.21.15.7:0/2333931226 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f324c06b4d0 0x7f324c06d990 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f3254034000 tx=0x7f325402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:31.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.372+0000 7f3263fff640 1 -- 172.21.15.7:0/2333931226 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f326c074bb0 con 0x7f326c0cefb0 2024-04-25T10:04:31.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:31.591+0000 7f32719e0640 1 -- 172.21.15.7:0/2333931226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f326c068f60 con 0x7f326c0cefb0 2024-04-25T10:04:32.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.250+0000 7f3263fff640 1 -- 172.21.15.7:0/2333931226 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v88) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3264058660 con 0x7f326c0cefb0 2024-04-25T10:04:32.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.253+0000 7f32719e0640 1 -- 172.21.15.7:0/2333931226 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f324c06b4d0 msgr2=0x7f324c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:32.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.253+0000 7f32719e0640 1 --2- 172.21.15.7:0/2333931226 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f324c06b4d0 0x7f324c06d990 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f3254034000 tx=0x7f325402e000 comp rx=0 tx=0).stop 2024-04-25T10:04:32.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.253+0000 7f32719e0640 1 -- 172.21.15.7:0/2333931226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f326c0cefb0 msgr2=0x7f326c0c7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:32.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.253+0000 7f32719e0640 1 --2- 172.21.15.7:0/2333931226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f326c0cefb0 0x7f326c0c7070 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f326400c7c0 tx=0x7f326400cc80 comp rx=0 tx=0).stop 2024-04-25T10:04:32.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.253+0000 7f32719e0640 1 -- 172.21.15.7:0/2333931226 shutdown_connections 2024-04-25T10:04:32.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.253+0000 7f32719e0640 1 --2- 172.21.15.7:0/2333931226 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f324c06b4d0 0x7f324c06d990 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:32.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.253+0000 7f32719e0640 1 --2- 172.21.15.7:0/2333931226 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f326c15db70 0x7f326c15bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:32.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.253+0000 7f32719e0640 1 --2- 172.21.15.7:0/2333931226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f326c0d21b0 0x7f326c152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:32.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.253+0000 7f32719e0640 1 --2- 172.21.15.7:0/2333931226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f326c0cefb0 0x7f326c0c7070 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:32.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.253+0000 7f32719e0640 1 -- 172.21.15.7:0/2333931226 >> 172.21.15.7:0/2333931226 conn(0x7f326c0b5370 msgr2=0x7f326c0ccd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:32.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.253+0000 7f32719e0640 1 -- 172.21.15.7:0/2333931226 shutdown_connections 2024-04-25T10:04:32.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.253+0000 7f32719e0640 1 -- 172.21.15.7:0/2333931226 wait complete. 2024-04-25T10:04:32.272 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T10:04:32.272 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:04:32.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.374+0000 7fd8a92ee640 1 Processor -- start 2024-04-25T10:04:32.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.374+0000 7fd8a92ee640 1 -- start start 2024-04-25T10:04:32.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.375+0000 7fd8a92ee640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8a415db00 0x7fd8a40d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:32.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.375+0000 7fd8a92ee640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd8a40ce2b0 0x7fd8a40d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:32.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.375+0000 7fd8a92ee640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a40d1e80 con 0x7fd8a40b53b0 2024-04-25T10:04:32.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.375+0000 7fd8a92ee640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a40b5930 con 0x7fd8a40ce2b0 2024-04-25T10:04:32.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.375+0000 7fd8a92ee640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a40b5c10 con 0x7fd8a415db00 2024-04-25T10:04:32.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.375+0000 7fd89a7fc640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd8a40b53b0 0x7fd8a4161670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39414/0 (socket says 172.21.15.7:39414) 2024-04-25T10:04:32.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.375+0000 7fd89a7fc640 1 -- 172.21.15.7:0/509668536 learned_addr learned my addr 172.21.15.7:0/509668536 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:32.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.375+0000 7fd8a37fe640 1 --2- 172.21.15.7:0/509668536 >> v2:172.21.15.55:3300/0 conn(0x7fd8a40ce2b0 0x7fd8a40d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:32.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.375+0000 7fd8a2ffd640 1 --2- 172.21.15.7:0/509668536 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8a415db00 0x7fd8a40d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:32.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.375+0000 7fd8a27fc640 1 -- 172.21.15.7:0/509668536 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3131157122 0 0) 0x7fd8a40d1e80 con 0x7fd8a40b53b0 2024-04-25T10:04:32.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.375+0000 7fd8a27fc640 1 -- 172.21.15.7:0/509668536 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd890003520 con 0x7fd8a40b53b0 2024-04-25T10:04:32.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.375+0000 7fd8a27fc640 1 -- 172.21.15.7:0/509668536 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1599827141 0 0) 0x7fd890003520 con 0x7fd8a40b53b0 2024-04-25T10:04:32.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.375+0000 7fd8a27fc640 1 -- 172.21.15.7:0/509668536 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8a415db00 msgr2=0x7fd8a40d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:32.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.375+0000 7fd8a27fc640 1 --2- 172.21.15.7:0/509668536 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8a415db00 0x7fd8a40d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:32.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.375+0000 7fd8a27fc640 1 -- 172.21.15.7:0/509668536 >> v2:172.21.15.55:3300/0 conn(0x7fd8a40ce2b0 msgr2=0x7fd8a40d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:32.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.375+0000 7fd8a27fc640 1 --2- 172.21.15.7:0/509668536 >> v2:172.21.15.55:3300/0 conn(0x7fd8a40ce2b0 0x7fd8a40d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:32.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.375+0000 7fd8a27fc640 1 -- 172.21.15.7:0/509668536 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a40b5ef0 con 0x7fd8a40b53b0 2024-04-25T10:04:32.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.375+0000 7fd8a27fc640 1 -- 172.21.15.7:0/509668536 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fd88c001670 con 0x7fd8a40b53b0 2024-04-25T10:04:32.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.375+0000 7fd8a27fc640 1 -- 172.21.15.7:0/509668536 >> v1:172.21.15.7:6789/0 conn(0x7fd8a40b53b0 legacy=0x7fd8a4161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:32.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.375+0000 7fd8a27fc640 1 --2- 172.21.15.7:0/509668536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8900039b0 0x7fd890003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:32.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.375+0000 7fd8a27fc640 1 --2- 172.21.15.7:0/509668536 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8a415db00 0x7fd890004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:32.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.375+0000 7fd8a27fc640 1 --2- 172.21.15.7:0/509668536 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd890004d40 0x7fd8900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:32.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.375+0000 7fd8a27fc640 1 -- 172.21.15.7:0/509668536 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a40b5930 con 0x7fd8900039b0 2024-04-25T10:04:32.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.375+0000 7fd8a27fc640 1 -- 172.21.15.7:0/509668536 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a40b5c10 con 0x7fd890004d40 2024-04-25T10:04:32.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.375+0000 7fd8a27fc640 1 -- 172.21.15.7:0/509668536 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89000b9c0 con 0x7fd8a415db00 2024-04-25T10:04:32.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.376+0000 7fd8a2ffd640 1 --2- 172.21.15.7:0/509668536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8900039b0 0x7fd890003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:32.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.376+0000 7fd89a7fc640 1 --2- 172.21.15.7:0/509668536 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8a415db00 0x7fd890004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:32.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.376+0000 7fd8a37fe640 1 --2- 172.21.15.7:0/509668536 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd890004d40 0x7fd8900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:32.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.376+0000 7fd8a2ffd640 1 -- 172.21.15.7:0/509668536 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8a415db00 msgr2=0x7fd890004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:32.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.376+0000 7fd8a2ffd640 1 --2- 172.21.15.7:0/509668536 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8a415db00 0x7fd890004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:32.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.376+0000 7fd8a2ffd640 1 -- 172.21.15.7:0/509668536 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd890004d40 msgr2=0x7fd8900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:32.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.376+0000 7fd8a2ffd640 1 --2- 172.21.15.7:0/509668536 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd890004d40 0x7fd8900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:32.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.376+0000 7fd8a2ffd640 1 -- 172.21.15.7:0/509668536 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd890003520 con 0x7fd8900039b0 2024-04-25T10:04:32.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.376+0000 7fd89a7fc640 1 --2- 172.21.15.7:0/509668536 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8a415db00 0x7fd890004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:32.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.377+0000 7fd8a2ffd640 1 --2- 172.21.15.7:0/509668536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8900039b0 0x7fd890003dd0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fd894009ac0 tx=0x7fd890005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c3b01f1db0ecb28 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:32.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.377+0000 7fd8a27fc640 1 -- 172.21.15.7:0/509668536 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd894036070 con 0x7fd8900039b0 2024-04-25T10:04:32.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.377+0000 7fd8a27fc640 1 -- 172.21.15.7:0/509668536 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd894031400 con 0x7fd8900039b0 2024-04-25T10:04:32.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.377+0000 7fd8a27fc640 1 -- 172.21.15.7:0/509668536 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd894009690 con 0x7fd8900039b0 2024-04-25T10:04:32.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.377+0000 7fd8a92ee640 1 -- 172.21.15.7:0/509668536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8900039b0 msgr2=0x7fd890003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:32.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.377+0000 7fd8a92ee640 1 --2- 172.21.15.7:0/509668536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8900039b0 0x7fd890003dd0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fd894009ac0 tx=0x7fd890005830 comp rx=0 tx=0).stop 2024-04-25T10:04:32.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.377+0000 7fd8a37fe640 1 -- 172.21.15.7:0/509668536 reap_dead start 2024-04-25T10:04:32.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.377+0000 7fd8a92ee640 1 -- 172.21.15.7:0/509668536 shutdown_connections 2024-04-25T10:04:32.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.377+0000 7fd8a92ee640 1 -- 172.21.15.7:0/509668536 >> 172.21.15.7:0/509668536 conn(0x7fd8a4072290 msgr2=0x7fd8a40726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:32.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.377+0000 7fd8a92ee640 1 -- 172.21.15.7:0/509668536 shutdown_connections 2024-04-25T10:04:32.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.377+0000 7fd8a92ee640 1 -- 172.21.15.7:0/509668536 wait complete. 2024-04-25T10:04:32.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.378+0000 7fd8a92ee640 1 Processor -- start 2024-04-25T10:04:32.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.379+0000 7fd8a92ee640 1 -- start start 2024-04-25T10:04:32.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.379+0000 7fd8a92ee640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8900039b0 0x7fd8a4158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:32.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.379+0000 7fd8a92ee640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8a41607c0 0x7fd8a40caa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:32.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.379+0000 7fd8a92ee640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8a4160c20 0x7fd8a40caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:32.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.379+0000 7fd8a92ee640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a40d3660 con 0x7fd8a41607c0 2024-04-25T10:04:32.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.379+0000 7fd8a92ee640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a40b61d0 con 0x7fd8900039b0 2024-04-25T10:04:32.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.379+0000 7fd8a92ee640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a40b6c10 con 0x7fd8a4160c20 2024-04-25T10:04:32.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.379+0000 7fd89a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8a41607c0 0x7fd8a40caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:32.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.380+0000 7fd89a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8a41607c0 0x7fd8a40caa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47662/0 (socket says 172.21.15.7:47662) 2024-04-25T10:04:32.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.380+0000 7fd89a7fc640 1 -- 172.21.15.7:0/2581861287 learned_addr learned my addr 172.21.15.7:0/2581861287 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:32.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.380+0000 7fd8a37fe640 1 --2- 172.21.15.7:0/2581861287 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8a4160c20 0x7fd8a40caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:32.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.380+0000 7fd8a2ffd640 1 --2- 172.21.15.7:0/2581861287 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8900039b0 0x7fd8a4158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:32.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.380+0000 7fd89a7fc640 1 -- 172.21.15.7:0/2581861287 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8a4160c20 msgr2=0x7fd8a40caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:32.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.380+0000 7fd89a7fc640 1 --2- 172.21.15.7:0/2581861287 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8a4160c20 0x7fd8a40caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:32.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.380+0000 7fd89a7fc640 1 -- 172.21.15.7:0/2581861287 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8900039b0 msgr2=0x7fd8a4158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:32.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.380+0000 7fd89a7fc640 1 --2- 172.21.15.7:0/2581861287 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8900039b0 0x7fd8a4158470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:32.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.380+0000 7fd89a7fc640 1 -- 172.21.15.7:0/2581861287 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a415fa20 con 0x7fd8a41607c0 2024-04-25T10:04:32.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.380+0000 7fd8a2ffd640 1 --2- 172.21.15.7:0/2581861287 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8900039b0 0x7fd8a4158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:32.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.380+0000 7fd89a7fc640 1 --2- 172.21.15.7:0/2581861287 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8a41607c0 0x7fd8a40caa00 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00e870 tx=0x7fd88c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:32.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.380+0000 7fd89bfff640 1 -- 172.21.15.7:0/2581861287 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c00c8d0 con 0x7fd8a41607c0 2024-04-25T10:04:32.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.380+0000 7fd89bfff640 1 -- 172.21.15.7:0/2581861287 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88c018070 con 0x7fd8a41607c0 2024-04-25T10:04:32.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.380+0000 7fd8a92ee640 1 -- 172.21.15.7:0/2581861287 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a415fd00 con 0x7fd8a41607c0 2024-04-25T10:04:32.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.380+0000 7fd89bfff640 1 -- 172.21.15.7:0/2581861287 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c00cc70 con 0x7fd8a41607c0 2024-04-25T10:04:32.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.380+0000 7fd8a92ee640 1 -- 172.21.15.7:0/2581861287 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a41589b0 con 0x7fd8a41607c0 2024-04-25T10:04:32.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.381+0000 7fd8a92ee640 1 -- 172.21.15.7:0/2581861287 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a4067420 con 0x7fd8a41607c0 2024-04-25T10:04:32.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.382+0000 7fd89bfff640 1 -- 172.21.15.7:0/2581861287 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd88c01d460 con 0x7fd8a41607c0 2024-04-25T10:04:32.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.382+0000 7fd89bfff640 1 --2- 172.21.15.7:0/2581861287 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd88406b4d0 0x7fd88406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:32.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.382+0000 7fd89bfff640 1 -- 172.21.15.7:0/2581861287 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd88c08a2b0 con 0x7fd8a41607c0 2024-04-25T10:04:32.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.382+0000 7fd8a2ffd640 1 --2- 172.21.15.7:0/2581861287 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd88406b4d0 0x7fd88406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:32.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.383+0000 7fd8a2ffd640 1 --2- 172.21.15.7:0/2581861287 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd88406b4d0 0x7fd88406d990 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fd894033000 tx=0x7fd894008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.386+0000 7fd89bfff640 1 -- 172.21.15.7:0/2581861287 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd8a4067420 con 0x7fd8a41607c0 2024-04-25T10:04:32.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.601+0000 7fd8a92ee640 1 -- 172.21.15.7:0/2581861287 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8a4068fd0 con 0x7fd8a41607c0 2024-04-25T10:04:32.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.602+0000 7fd89bfff640 1 -- 172.21.15.7:0/2581861287 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4934 (secure 0 0 0) 0x7fd88c058fa0 con 0x7fd8a41607c0 2024-04-25T10:04:32.607 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:32.607 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":88,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6992,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2679200172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2679200172},{"type":"v1","addr":"172.21.15.7:6837","nonce":2679200172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":7942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/4039147179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":4039147179},{"type":"v1","addr":"172.21.15.55:6833","nonce":4039147179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":7945,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3456170359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3456170359},{"type":"v1","addr":"172.21.15.55:6835","nonce":3456170359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:04:29.599245+0000","modified":"2024-04-25T10:04:31.593324+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9051},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9051":{"gid":9051,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6836/3623521645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3623521645},{"type":"v1","addr":"172.21.15.7:6836","nonce":3623521645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T10:04:32.608 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 88 2024-04-25T10:04:32.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.604+0000 7fd8a92ee640 1 -- 172.21.15.7:0/2581861287 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd88406b4d0 msgr2=0x7fd88406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:32.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.604+0000 7fd8a92ee640 1 --2- 172.21.15.7:0/2581861287 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd88406b4d0 0x7fd88406d990 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fd894033000 tx=0x7fd894008030 comp rx=0 tx=0).stop 2024-04-25T10:04:32.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.604+0000 7fd8a92ee640 1 -- 172.21.15.7:0/2581861287 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8a41607c0 msgr2=0x7fd8a40caa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:32.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.604+0000 7fd8a92ee640 1 --2- 172.21.15.7:0/2581861287 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8a41607c0 0x7fd8a40caa00 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00e870 tx=0x7fd88c00ed30 comp rx=0 tx=0).stop 2024-04-25T10:04:32.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.604+0000 7fd8a92ee640 1 -- 172.21.15.7:0/2581861287 shutdown_connections 2024-04-25T10:04:32.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.604+0000 7fd8a92ee640 1 --2- 172.21.15.7:0/2581861287 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd88406b4d0 0x7fd88406d990 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:32.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.604+0000 7fd8a92ee640 1 --2- 172.21.15.7:0/2581861287 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8a4160c20 0x7fd8a40caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:32.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.604+0000 7fd8a92ee640 1 --2- 172.21.15.7:0/2581861287 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd8a41607c0 0x7fd8a40caa00 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:32.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.604+0000 7fd8a92ee640 1 --2- 172.21.15.7:0/2581861287 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8900039b0 0x7fd8a4158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:32.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.604+0000 7fd8a92ee640 1 -- 172.21.15.7:0/2581861287 >> 172.21.15.7:0/2581861287 conn(0x7fd8a4072290 msgr2=0x7fd8a40c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:32.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.604+0000 7fd8a92ee640 1 -- 172.21.15.7:0/2581861287 shutdown_connections 2024-04-25T10:04:32.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.604+0000 7fd8a92ee640 1 -- 172.21.15.7:0/2581861287 wait complete. 2024-04-25T10:04:32.620 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:32.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.715+0000 7fa90e676640 1 Processor -- start 2024-04-25T10:04:32.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.715+0000 7fa90e676640 1 -- start start 2024-04-25T10:04:32.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.716+0000 7fa90e676640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa90815b8e0 0x7fa9080d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:32.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.716+0000 7fa90e676640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa9080cc300 0x7fa9080999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:32.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.716+0000 7fa90e676640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa90809a340 con 0x7fa908099f30 2024-04-25T10:04:32.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.716+0000 7fa90e676640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9080cd7d0 con 0x7fa90815b8e0 2024-04-25T10:04:32.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.716+0000 7fa90e676640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9080ccbc0 con 0x7fa9080cc300 2024-04-25T10:04:32.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.716+0000 7fa907fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa90815b8e0 0x7fa9080d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:32.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.716+0000 7fa90cc13640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa908099f30 0x7fa90815f520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39426/0 (socket says 172.21.15.7:39426) 2024-04-25T10:04:32.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.716+0000 7fa90cc13640 1 -- 172.21.15.7:0/2063963817 learned_addr learned my addr 172.21.15.7:0/2063963817 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:32.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.716+0000 7fa907fff640 1 --2- 172.21.15.7:0/2063963817 >> v2:172.21.15.7:3300/0 conn(0x7fa90815b8e0 0x7fa9080d0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47668/0 (socket says 172.21.15.7:47668) 2024-04-25T10:04:32.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.717+0000 7fa907fff640 1 -- 172.21.15.7:0/2063963817 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa9080cc300 msgr2=0x7fa9080999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:32.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.717+0000 7fa907fff640 1 --2- 172.21.15.7:0/2063963817 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa9080cc300 0x7fa9080999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:32.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.717+0000 7fa907fff640 1 -- 172.21.15.7:0/2063963817 >> v1:172.21.15.7:6789/0 conn(0x7fa908099f30 legacy=0x7fa90815f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:32.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.717+0000 7fa907fff640 1 -- 172.21.15.7:0/2063963817 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9080ccea0 con 0x7fa90815b8e0 2024-04-25T10:04:32.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.717+0000 7fa907fff640 1 --2- 172.21.15.7:0/2063963817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa90815b8e0 0x7fa9080d0330 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fa8f00097a0 tx=0x7fa8f002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e0e87b87fe379f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:32.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.717+0000 7fa906ffd640 1 -- 172.21.15.7:0/2063963817 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f0037070 con 0x7fa90815b8e0 2024-04-25T10:04:32.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.718+0000 7fa906ffd640 1 -- 172.21.15.7:0/2063963817 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f0032440 con 0x7fa90815b8e0 2024-04-25T10:04:32.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.718+0000 7fa906ffd640 1 -- 172.21.15.7:0/2063963817 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f0032810 con 0x7fa90815b8e0 2024-04-25T10:04:32.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.718+0000 7fa90e676640 1 -- 172.21.15.7:0/2063963817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa90815b8e0 msgr2=0x7fa9080d0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:32.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.718+0000 7fa90e676640 1 --2- 172.21.15.7:0/2063963817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa90815b8e0 0x7fa9080d0330 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fa8f00097a0 tx=0x7fa8f002a180 comp rx=0 tx=0).stop 2024-04-25T10:04:32.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.718+0000 7fa90e676640 1 -- 172.21.15.7:0/2063963817 shutdown_connections 2024-04-25T10:04:32.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.718+0000 7fa90e676640 1 --2- 172.21.15.7:0/2063963817 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa9080cc300 0x7fa9080999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:32.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.718+0000 7fa90e676640 1 --2- 172.21.15.7:0/2063963817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa90815b8e0 0x7fa9080d0330 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:32.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.718+0000 7fa90e676640 1 -- 172.21.15.7:0/2063963817 >> 172.21.15.7:0/2063963817 conn(0x7fa9080b3130 msgr2=0x7fa9080b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:32.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.718+0000 7fa90e676640 1 -- 172.21.15.7:0/2063963817 shutdown_connections 2024-04-25T10:04:32.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.718+0000 7fa90e676640 1 -- 172.21.15.7:0/2063963817 wait complete. 2024-04-25T10:04:32.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.719+0000 7fa90e676640 1 Processor -- start 2024-04-25T10:04:32.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.720+0000 7fa90e676640 1 -- start start 2024-04-25T10:04:32.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.720+0000 7fa90e676640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa908099f30 0x7fa90815d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:32.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.720+0000 7fa90e676640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9080cc300 0x7fa90815c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:32.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.720+0000 7fa90e676640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa90815b8e0 0x7fa908157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:32.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.720+0000 7fa90e676640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90815bcc0 con 0x7fa9080cc300 2024-04-25T10:04:32.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.720+0000 7fa90e676640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9080cd460 con 0x7fa908099f30 2024-04-25T10:04:32.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.720+0000 7fa90e676640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa90815be40 con 0x7fa90815b8e0 2024-04-25T10:04:32.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.720+0000 7fa9077fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9080cc300 0x7fa90815c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:32.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.720+0000 7fa9077fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9080cc300 0x7fa90815c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47672/0 (socket says 172.21.15.7:47672) 2024-04-25T10:04:32.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.720+0000 7fa9077fe640 1 -- 172.21.15.7:0/2930673279 learned_addr learned my addr 172.21.15.7:0/2930673279 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:32.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.720+0000 7fa90cc13640 1 --2- 172.21.15.7:0/2930673279 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa90815b8e0 0x7fa908157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:32.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.721+0000 7fa907fff640 1 --2- 172.21.15.7:0/2930673279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa908099f30 0x7fa90815d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:32.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.721+0000 7fa9077fe640 1 -- 172.21.15.7:0/2930673279 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa90815b8e0 msgr2=0x7fa908157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:32.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.721+0000 7fa9077fe640 1 --2- 172.21.15.7:0/2930673279 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa90815b8e0 0x7fa908157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:32.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.721+0000 7fa9077fe640 1 -- 172.21.15.7:0/2930673279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa908099f30 msgr2=0x7fa90815d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:32.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.721+0000 7fa9077fe640 1 --2- 172.21.15.7:0/2930673279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa908099f30 0x7fa90815d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:32.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.721+0000 7fa9077fe640 1 -- 172.21.15.7:0/2930673279 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9081f5680 con 0x7fa9080cc300 2024-04-25T10:04:32.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.721+0000 7fa9077fe640 1 --2- 172.21.15.7:0/2930673279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9080cc300 0x7fa90815c020 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fa8f800b4a0 tx=0x7fa8f800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:32.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.721+0000 7fa904ff9640 1 -- 172.21.15.7:0/2930673279 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f8014070 con 0x7fa9080cc300 2024-04-25T10:04:32.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.721+0000 7fa904ff9640 1 -- 172.21.15.7:0/2930673279 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f8010610 con 0x7fa9080cc300 2024-04-25T10:04:32.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.721+0000 7fa90e676640 1 -- 172.21.15.7:0/2930673279 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9081f5960 con 0x7fa9080cc300 2024-04-25T10:04:32.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.721+0000 7fa904ff9640 1 -- 172.21.15.7:0/2930673279 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f8010a00 con 0x7fa9080cc300 2024-04-25T10:04:32.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.721+0000 7fa90e676640 1 -- 172.21.15.7:0/2930673279 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9081f5f20 con 0x7fa9080cc300 2024-04-25T10:04:32.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.722+0000 7fa90e676640 1 -- 172.21.15.7:0/2930673279 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa908068fd0 con 0x7fa9080cc300 2024-04-25T10:04:32.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.722+0000 7fa904ff9640 1 -- 172.21.15.7:0/2930673279 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa8f8017070 con 0x7fa9080cc300 2024-04-25T10:04:32.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.723+0000 7fa904ff9640 1 --2- 172.21.15.7:0/2930673279 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa8e806b4d0 0x7fa8e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:32.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.723+0000 7fa907fff640 1 --2- 172.21.15.7:0/2930673279 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa8e806b4d0 0x7fa8e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:32.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.723+0000 7fa904ff9640 1 -- 172.21.15.7:0/2930673279 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa8f8089c90 con 0x7fa9080cc300 2024-04-25T10:04:32.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.724+0000 7fa907fff640 1 --2- 172.21.15.7:0/2930673279 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa8e806b4d0 0x7fa8e806d990 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0034000 tx=0x7fa8f002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:32.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.727+0000 7fa904ff9640 1 -- 172.21.15.7:0/2930673279 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa8f80583c0 con 0x7fa9080cc300 2024-04-25T10:04:32.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.906+0000 7fa90e676640 1 -- 172.21.15.7:0/2930673279 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9080d0ef0 con 0x7fa9080cc300 2024-04-25T10:04:32.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.908+0000 7fa904ff9640 1 -- 172.21.15.7:0/2930673279 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+16856 (secure 0 0 0) 0x7fa8f805c460 con 0x7fa9080cc300 2024-04-25T10:04:32.913 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:32.913 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":117,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:04:31.237000+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:04:27.856713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T10:04:28.566676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:32.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.909+0000 7fa90e676640 1 -- 172.21.15.7:0/2930673279 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa8e806b4d0 msgr2=0x7fa8e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:32.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.909+0000 7fa90e676640 1 --2- 172.21.15.7:0/2930673279 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa8e806b4d0 0x7fa8e806d990 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0034000 tx=0x7fa8f002e000 comp rx=0 tx=0).stop 2024-04-25T10:04:32.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.909+0000 7fa90e676640 1 -- 172.21.15.7:0/2930673279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9080cc300 msgr2=0x7fa90815c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:32.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.909+0000 7fa90e676640 1 --2- 172.21.15.7:0/2930673279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9080cc300 0x7fa90815c020 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fa8f800b4a0 tx=0x7fa8f800b960 comp rx=0 tx=0).stop 2024-04-25T10:04:32.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.910+0000 7fa90e676640 1 -- 172.21.15.7:0/2930673279 shutdown_connections 2024-04-25T10:04:32.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.910+0000 7fa90e676640 1 --2- 172.21.15.7:0/2930673279 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa8e806b4d0 0x7fa8e806d990 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:32.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.910+0000 7fa90e676640 1 --2- 172.21.15.7:0/2930673279 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa90815b8e0 0x7fa908157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:32.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.910+0000 7fa90e676640 1 --2- 172.21.15.7:0/2930673279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9080cc300 0x7fa90815c020 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:32.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.910+0000 7fa90e676640 1 --2- 172.21.15.7:0/2930673279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa908099f30 0x7fa90815d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:32.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.910+0000 7fa90e676640 1 -- 172.21.15.7:0/2930673279 >> 172.21.15.7:0/2930673279 conn(0x7fa9080b3130 msgr2=0x7fa9080cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:32.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.910+0000 7fa90e676640 1 -- 172.21.15.7:0/2930673279 shutdown_connections 2024-04-25T10:04:32.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:32.910+0000 7fa90e676640 1 -- 172.21.15.7:0/2930673279 wait complete. 2024-04-25T10:04:32.926 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T10:04:32.926 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:04:33.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.022+0000 7fa8f1038640 1 Processor -- start 2024-04-25T10:04:33.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.022+0000 7fa8f1038640 1 -- start start 2024-04-25T10:04:33.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.023+0000 7fa8f1038640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa8ec15db00 0x7fa8ec0d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:33.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.023+0000 7fa8f1038640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8ec0b53b0 0x7fa8ec0d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:33.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.023+0000 7fa8f1038640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8ec0d1e80 con 0x7fa8ec0ce2b0 2024-04-25T10:04:33.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.023+0000 7fa8f1038640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8ec0b5930 con 0x7fa8ec15db00 2024-04-25T10:04:33.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.023+0000 7fa8f1038640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec0b5c10 con 0x7fa8ec0b53b0 2024-04-25T10:04:33.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.023+0000 7fa8ead9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa8ec15db00 0x7fa8ec0d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:33.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.023+0000 7fa8eb59e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa8ec0ce2b0 0x7fa8ec161670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:42816/0 (socket says 172.21.15.7:42816) 2024-04-25T10:04:33.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.023+0000 7fa8ea59c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8ec0b53b0 0x7fa8ec0d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:33.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.024+0000 7fa8eb59e640 1 -- 172.21.15.7:0/1736629430 learned_addr learned my addr 172.21.15.7:0/1736629430 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:33.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.024+0000 7fa8e9d9b640 1 -- 172.21.15.7:0/1736629430 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1256462455 0 0) 0x7fa8ec0d1e80 con 0x7fa8ec0ce2b0 2024-04-25T10:04:33.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.024+0000 7fa8e9d9b640 1 -- 172.21.15.7:0/1736629430 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8d4003520 con 0x7fa8ec0ce2b0 2024-04-25T10:04:33.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.024+0000 7fa8ead9d640 1 -- 172.21.15.7:0/1736629430 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8ec0b53b0 msgr2=0x7fa8ec0d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:33.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.024+0000 7fa8ead9d640 1 --2- 172.21.15.7:0/1736629430 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8ec0b53b0 0x7fa8ec0d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.024+0000 7fa8ead9d640 1 -- 172.21.15.7:0/1736629430 >> v1:172.21.15.55:6789/0 conn(0x7fa8ec0ce2b0 legacy=0x7fa8ec161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:33.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.024+0000 7fa8ead9d640 1 -- 172.21.15.7:0/1736629430 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ec0b5ef0 con 0x7fa8ec15db00 2024-04-25T10:04:33.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.024+0000 7fa8ea59c640 1 --2- 172.21.15.7:0/1736629430 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8ec0b53b0 0x7fa8ec0d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:33.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.025+0000 7fa8ead9d640 1 --2- 172.21.15.7:0/1736629430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8ec15db00 0x7fa8ec0d0340 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa8e40097a0 tx=0x7fa8e402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf49f016413e0d79 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:33.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.025+0000 7fa8e9d9b640 1 -- 172.21.15.7:0/1736629430 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4037070 con 0x7fa8ec15db00 2024-04-25T10:04:33.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.025+0000 7fa8e9d9b640 1 -- 172.21.15.7:0/1736629430 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e4032440 con 0x7fa8ec15db00 2024-04-25T10:04:33.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.025+0000 7fa8e9d9b640 1 -- 172.21.15.7:0/1736629430 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e40327f0 con 0x7fa8ec15db00 2024-04-25T10:04:33.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.025+0000 7fa8f1038640 1 -- 172.21.15.7:0/1736629430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8ec15db00 msgr2=0x7fa8ec0d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:33.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.025+0000 7fa8f1038640 1 --2- 172.21.15.7:0/1736629430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8ec15db00 0x7fa8ec0d0340 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa8e40097a0 tx=0x7fa8e402a180 comp rx=0 tx=0).stop 2024-04-25T10:04:33.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.025+0000 7fa8f1038640 1 -- 172.21.15.7:0/1736629430 shutdown_connections 2024-04-25T10:04:33.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.025+0000 7fa8f1038640 1 --2- 172.21.15.7:0/1736629430 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8ec0b53b0 0x7fa8ec0d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.025+0000 7fa8f1038640 1 --2- 172.21.15.7:0/1736629430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8ec15db00 0x7fa8ec0d0340 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.025+0000 7fa8f1038640 1 -- 172.21.15.7:0/1736629430 >> 172.21.15.7:0/1736629430 conn(0x7fa8ec072290 msgr2=0x7fa8ec0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:33.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.025+0000 7fa8f1038640 1 -- 172.21.15.7:0/1736629430 shutdown_connections 2024-04-25T10:04:33.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.025+0000 7fa8f1038640 1 -- 172.21.15.7:0/1736629430 wait complete. 2024-04-25T10:04:33.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.027+0000 7fa8f1038640 1 Processor -- start 2024-04-25T10:04:33.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.027+0000 7fa8f1038640 1 -- start start 2024-04-25T10:04:33.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.028+0000 7fa8f1038640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8ec0b53b0 0x7fa8ec0ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:33.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.028+0000 7fa8f1038640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8ec0ce2b0 0x7fa8ec0cb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:33.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.028+0000 7fa8f1038640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8ec15db00 0x7fa8ec0b74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:33.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.028+0000 7fa8f1038640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec0d3660 con 0x7fa8ec0ce2b0 2024-04-25T10:04:33.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.028+0000 7fa8f1038640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec0b61d0 con 0x7fa8ec15db00 2024-04-25T10:04:33.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.028+0000 7fa8f1038640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec0b6c10 con 0x7fa8ec0b53b0 2024-04-25T10:04:33.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.028+0000 7fa8ea59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8ec0ce2b0 0x7fa8ec0cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:33.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.028+0000 7fa8ea59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8ec0ce2b0 0x7fa8ec0cb210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47678/0 (socket says 172.21.15.7:47678) 2024-04-25T10:04:33.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.028+0000 7fa8ea59c640 1 -- 172.21.15.7:0/1025028871 learned_addr learned my addr 172.21.15.7:0/1025028871 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:33.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.028+0000 7fa8eb59e640 1 --2- 172.21.15.7:0/1025028871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8ec15db00 0x7fa8ec0b74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:33.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.028+0000 7fa8ead9d640 1 --2- 172.21.15.7:0/1025028871 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8ec0b53b0 0x7fa8ec0ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:33.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.028+0000 7fa8ea59c640 1 -- 172.21.15.7:0/1025028871 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8ec0b53b0 msgr2=0x7fa8ec0ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:33.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.028+0000 7fa8ea59c640 1 --2- 172.21.15.7:0/1025028871 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8ec0b53b0 0x7fa8ec0ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.028+0000 7fa8ea59c640 1 -- 172.21.15.7:0/1025028871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8ec15db00 msgr2=0x7fa8ec0b74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:33.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.028+0000 7fa8ea59c640 1 --2- 172.21.15.7:0/1025028871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8ec15db00 0x7fa8ec0b74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.028+0000 7fa8ea59c640 1 -- 172.21.15.7:0/1025028871 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ec15c0c0 con 0x7fa8ec0ce2b0 2024-04-25T10:04:33.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.028+0000 7fa8ea59c640 1 --2- 172.21.15.7:0/1025028871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8ec0ce2b0 0x7fa8ec0cb210 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fa8e000ebe0 tx=0x7fa8e000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:33.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.028+0000 7fa8d37fe640 1 -- 172.21.15.7:0/1025028871 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e0017070 con 0x7fa8ec0ce2b0 2024-04-25T10:04:33.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.028+0000 7fa8d37fe640 1 -- 172.21.15.7:0/1025028871 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e000cc30 con 0x7fa8ec0ce2b0 2024-04-25T10:04:33.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.028+0000 7fa8f1038640 1 -- 172.21.15.7:0/1025028871 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8ec0cd4b0 con 0x7fa8ec0ce2b0 2024-04-25T10:04:33.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.028+0000 7fa8d37fe640 1 -- 172.21.15.7:0/1025028871 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e0013470 con 0x7fa8ec0ce2b0 2024-04-25T10:04:33.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.029+0000 7fa8f1038640 1 -- 172.21.15.7:0/1025028871 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8ec0cda70 con 0x7fa8ec0ce2b0 2024-04-25T10:04:33.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.029+0000 7fa8f1038640 1 -- 172.21.15.7:0/1025028871 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8ec068fd0 con 0x7fa8ec0ce2b0 2024-04-25T10:04:33.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.030+0000 7fa8d37fe640 1 -- 172.21.15.7:0/1025028871 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa8e001a070 con 0x7fa8ec0ce2b0 2024-04-25T10:04:33.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.030+0000 7fa8d37fe640 1 --2- 172.21.15.7:0/1025028871 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa8d806b4d0 0x7fa8d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:33.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.030+0000 7fa8d37fe640 1 -- 172.21.15.7:0/1025028871 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa8e008a360 con 0x7fa8ec0ce2b0 2024-04-25T10:04:33.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.030+0000 7fa8ead9d640 1 --2- 172.21.15.7:0/1025028871 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa8d806b4d0 0x7fa8d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:33.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.031+0000 7fa8ead9d640 1 --2- 172.21.15.7:0/1025028871 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa8d806b4d0 0x7fa8d806d990 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4034000 tx=0x7fa8e402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:33.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.035+0000 7fa8d37fe640 1 -- 172.21.15.7:0/1025028871 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa8e0058fc0 con 0x7fa8ec0ce2b0 2024-04-25T10:04:33.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.215+0000 7fa8f1038640 1 -- 172.21.15.7:0/1025028871 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa8ec0d16b0 con 0x7fa8d806b4d0 2024-04-25T10:04:33.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.221+0000 7fa8d37fe640 1 -- 172.21.15.7:0/1025028871 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249510 (secure 0 0 0) 0x7fa8ec0d16b0 con 0x7fa8d806b4d0 2024-04-25T10:04:33.229 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:33.231 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T10:04:33.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.224+0000 7fa8f1038640 1 -- 172.21.15.7:0/1025028871 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa8d806b4d0 msgr2=0x7fa8d806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:33.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.224+0000 7fa8f1038640 1 --2- 172.21.15.7:0/1025028871 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa8d806b4d0 0x7fa8d806d990 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4034000 tx=0x7fa8e402e000 comp rx=0 tx=0).stop 2024-04-25T10:04:33.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.224+0000 7fa8f1038640 1 -- 172.21.15.7:0/1025028871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8ec0ce2b0 msgr2=0x7fa8ec0cb210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:33.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.224+0000 7fa8f1038640 1 --2- 172.21.15.7:0/1025028871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8ec0ce2b0 0x7fa8ec0cb210 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fa8e000ebe0 tx=0x7fa8e000c520 comp rx=0 tx=0).stop 2024-04-25T10:04:33.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.224+0000 7fa8f1038640 1 -- 172.21.15.7:0/1025028871 shutdown_connections 2024-04-25T10:04:33.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.224+0000 7fa8f1038640 1 --2- 172.21.15.7:0/1025028871 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa8d806b4d0 0x7fa8d806d990 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.224+0000 7fa8f1038640 1 --2- 172.21.15.7:0/1025028871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8ec15db00 0x7fa8ec0b74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.224+0000 7fa8f1038640 1 --2- 172.21.15.7:0/1025028871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8ec0ce2b0 0x7fa8ec0cb210 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.224+0000 7fa8f1038640 1 --2- 172.21.15.7:0/1025028871 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8ec0b53b0 0x7fa8ec0ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.224+0000 7fa8f1038640 1 -- 172.21.15.7:0/1025028871 >> 172.21.15.7:0/1025028871 conn(0x7fa8ec072290 msgr2=0x7fa8ec0ce790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:33.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.224+0000 7fa8f1038640 1 -- 172.21.15.7:0/1025028871 shutdown_connections 2024-04-25T10:04:33.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.224+0000 7fa8f1038640 1 -- 172.21.15.7:0/1025028871 wait complete. 2024-04-25T10:04:33.240 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":419,"stamp":"2024-04-25T10:04:31.994706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":265996,"kb_used_data":12384,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754708724,"statfs":{"total":773094113280,"available":772821733376,"internally_reserved":0,"allocated":12681216,"data_stored":6509652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":259575345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":742,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000909"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.242746+0000","last_change":"2024-04-25T10:04:30.240506+0000","last_active":"2024-04-25T10:04:30.242746+0000","last_peered":"2024-04-25T10:04:30.242746+0000","last_clean":"2024-04-25T10:04:30.242746+0000","last_became_active":"2024-04-25T10:04:30.240146+0000","last_became_peered":"2024-04-25T10:04:30.240146+0000","last_unstale":"2024-04-25T10:04:30.242746+0000","last_undegraded":"2024-04-25T10:04:30.242746+0000","last_fullsized":"2024-04-25T10:04:30.242746+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:15.962820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.237330+0000","last_change":"2024-04-25T10:04:29.237330+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.237330+0000","last_undegraded":"2024-04-25T10:04:29.237330+0000","last_fullsized":"2024-04-25T10:04:29.237330+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.236919+0000","last_change":"2024-04-25T10:04:29.236919+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.236919+0000","last_undegraded":"2024-04-25T10:04:29.236919+0000","last_fullsized":"2024-04-25T10:04:29.236919+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.259642+0000","last_change":"2024-04-25T10:04:30.252147+0000","last_active":"2024-04-25T10:04:30.259642+0000","last_peered":"2024-04-25T10:04:30.259642+0000","last_clean":"2024-04-25T10:04:30.259642+0000","last_became_active":"2024-04-25T10:04:30.251836+0000","last_became_peered":"2024-04-25T10:04:30.251836+0000","last_unstale":"2024-04-25T10:04:30.259642+0000","last_undegraded":"2024-04-25T10:04:30.259642+0000","last_fullsized":"2024-04-25T10:04:30.259642+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:27.545334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.255527+0000","last_change":"2024-04-25T10:04:30.252200+0000","last_active":"2024-04-25T10:04:30.255527+0000","last_peered":"2024-04-25T10:04:30.255527+0000","last_clean":"2024-04-25T10:04:30.255527+0000","last_became_active":"2024-04-25T10:04:30.251902+0000","last_became_peered":"2024-04-25T10:04:30.251902+0000","last_unstale":"2024-04-25T10:04:30.255527+0000","last_undegraded":"2024-04-25T10:04:30.255527+0000","last_fullsized":"2024-04-25T10:04:30.255527+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:45.747180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.235067+0000","last_change":"2024-04-25T10:04:29.235067+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.235067+0000","last_undegraded":"2024-04-25T10:04:29.235067+0000","last_fullsized":"2024-04-25T10:04:29.235067+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.234975+0000","last_change":"2024-04-25T10:04:29.234975+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.234975+0000","last_undegraded":"2024-04-25T10:04:29.234975+0000","last_fullsized":"2024-04-25T10:04:29.234975+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.236365+0000","last_change":"2024-04-25T10:04:29.236365+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.236365+0000","last_undegraded":"2024-04-25T10:04:29.236365+0000","last_fullsized":"2024-04-25T10:04:29.236365+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.260091+0000","last_change":"2024-04-25T10:04:30.256927+0000","last_active":"2024-04-25T10:04:30.260091+0000","last_peered":"2024-04-25T10:04:30.260091+0000","last_clean":"2024-04-25T10:04:30.260091+0000","last_became_active":"2024-04-25T10:04:30.255115+0000","last_became_peered":"2024-04-25T10:04:30.255115+0000","last_unstale":"2024-04-25T10:04:30.260091+0000","last_undegraded":"2024-04-25T10:04:30.260091+0000","last_fullsized":"2024-04-25T10:04:30.260091+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:00.553092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.236981+0000","last_change":"2024-04-25T10:04:29.236981+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.236981+0000","last_undegraded":"2024-04-25T10:04:29.236981+0000","last_fullsized":"2024-04-25T10:04:29.236981+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.249732+0000","last_change":"2024-04-25T10:04:30.245678+0000","last_active":"2024-04-25T10:04:30.249732+0000","last_peered":"2024-04-25T10:04:30.249732+0000","last_clean":"2024-04-25T10:04:30.249732+0000","last_became_active":"2024-04-25T10:04:30.245363+0000","last_became_peered":"2024-04-25T10:04:30.245363+0000","last_unstale":"2024-04-25T10:04:30.249732+0000","last_undegraded":"2024-04-25T10:04:30.249732+0000","last_fullsized":"2024-04-25T10:04:30.249732+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:18.944449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.234165+0000","last_change":"2024-04-25T10:04:29.234165+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.234165+0000","last_undegraded":"2024-04-25T10:04:29.234165+0000","last_fullsized":"2024-04-25T10:04:29.234165+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.235212+0000","last_change":"2024-04-25T10:04:29.235212+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.235212+0000","last_undegraded":"2024-04-25T10:04:29.235212+0000","last_fullsized":"2024-04-25T10:04:29.235212+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.236402+0000","last_change":"2024-04-25T10:04:29.236402+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.236402+0000","last_undegraded":"2024-04-25T10:04:29.236402+0000","last_fullsized":"2024-04-25T10:04:29.236402+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.249655+0000","last_change":"2024-04-25T10:04:30.246368+0000","last_active":"2024-04-25T10:04:30.249655+0000","last_peered":"2024-04-25T10:04:30.249655+0000","last_clean":"2024-04-25T10:04:30.249655+0000","last_became_active":"2024-04-25T10:04:30.246100+0000","last_became_peered":"2024-04-25T10:04:30.246100+0000","last_unstale":"2024-04-25T10:04:30.249655+0000","last_undegraded":"2024-04-25T10:04:30.249655+0000","last_fullsized":"2024-04-25T10:04:30.249655+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:42.155245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.234378+0000","last_change":"2024-04-25T10:04:29.234378+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.234378+0000","last_undegraded":"2024-04-25T10:04:29.234378+0000","last_fullsized":"2024-04-25T10:04:29.234378+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.235759+0000","last_change":"2024-04-25T10:04:29.235759+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.235759+0000","last_undegraded":"2024-04-25T10:04:29.235759+0000","last_fullsized":"2024-04-25T10:04:29.235759+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.235878+0000","last_change":"2024-04-25T10:04:29.235878+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.235878+0000","last_undegraded":"2024-04-25T10:04:29.235878+0000","last_fullsized":"2024-04-25T10:04:29.235878+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.258074+0000","last_change":"2024-04-25T10:04:30.254496+0000","last_active":"2024-04-25T10:04:30.258074+0000","last_peered":"2024-04-25T10:04:30.258074+0000","last_clean":"2024-04-25T10:04:30.258074+0000","last_became_active":"2024-04-25T10:04:30.254205+0000","last_became_peered":"2024-04-25T10:04:30.254205+0000","last_unstale":"2024-04-25T10:04:30.258074+0000","last_undegraded":"2024-04-25T10:04:30.258074+0000","last_fullsized":"2024-04-25T10:04:30.258074+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:42.155245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.237396+0000","last_change":"2024-04-25T10:04:29.237396+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.237396+0000","last_undegraded":"2024-04-25T10:04:29.237396+0000","last_fullsized":"2024-04-25T10:04:29.237396+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.260054+0000","last_change":"2024-04-25T10:04:30.256744+0000","last_active":"2024-04-25T10:04:30.260054+0000","last_peered":"2024-04-25T10:04:30.260054+0000","last_clean":"2024-04-25T10:04:30.260054+0000","last_became_active":"2024-04-25T10:04:30.256064+0000","last_became_peered":"2024-04-25T10:04:30.256064+0000","last_unstale":"2024-04-25T10:04:30.260054+0000","last_undegraded":"2024-04-25T10:04:30.260054+0000","last_fullsized":"2024-04-25T10:04:30.260054+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:01.357667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.249612+0000","last_change":"2024-04-25T10:04:30.244355+0000","last_active":"2024-04-25T10:04:30.249612+0000","last_peered":"2024-04-25T10:04:30.249612+0000","last_clean":"2024-04-25T10:04:30.249612+0000","last_became_active":"2024-04-25T10:04:30.244028+0000","last_became_peered":"2024-04-25T10:04:30.244028+0000","last_unstale":"2024-04-25T10:04:30.249612+0000","last_undegraded":"2024-04-25T10:04:30.249612+0000","last_fullsized":"2024-04-25T10:04:30.249612+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:27.281210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.259695+0000","last_change":"2024-04-25T10:04:30.253400+0000","last_active":"2024-04-25T10:04:30.259695+0000","last_peered":"2024-04-25T10:04:30.259695+0000","last_clean":"2024-04-25T10:04:30.259695+0000","last_became_active":"2024-04-25T10:04:30.253118+0000","last_became_peered":"2024-04-25T10:04:30.253118+0000","last_unstale":"2024-04-25T10:04:30.259695+0000","last_undegraded":"2024-04-25T10:04:30.259695+0000","last_fullsized":"2024-04-25T10:04:30.259695+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:24.510668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.259100+0000","last_change":"2024-04-25T10:04:30.258434+0000","last_active":"2024-04-25T10:04:30.259100+0000","last_peered":"2024-04-25T10:04:30.259100+0000","last_clean":"2024-04-25T10:04:30.259100+0000","last_became_active":"2024-04-25T10:04:30.258149+0000","last_became_peered":"2024-04-25T10:04:30.258149+0000","last_unstale":"2024-04-25T10:04:30.259100+0000","last_undegraded":"2024-04-25T10:04:30.259100+0000","last_fullsized":"2024-04-25T10:04:30.259100+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:29.764075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.255118+0000","last_change":"2024-04-25T10:04:30.248070+0000","last_active":"2024-04-25T10:04:30.255118+0000","last_peered":"2024-04-25T10:04:30.255118+0000","last_clean":"2024-04-25T10:04:30.255118+0000","last_became_active":"2024-04-25T10:04:30.247788+0000","last_became_peered":"2024-04-25T10:04:30.247788+0000","last_unstale":"2024-04-25T10:04:30.255118+0000","last_undegraded":"2024-04-25T10:04:30.255118+0000","last_fullsized":"2024-04-25T10:04:30.255118+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:34.725496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.237563+0000","last_change":"2024-04-25T10:04:29.237563+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.237563+0000","last_undegraded":"2024-04-25T10:04:29.237563+0000","last_fullsized":"2024-04-25T10:04:29.237563+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.258051+0000","last_change":"2024-04-25T10:04:30.254462+0000","last_active":"2024-04-25T10:04:30.258051+0000","last_peered":"2024-04-25T10:04:30.258051+0000","last_clean":"2024-04-25T10:04:30.258051+0000","last_became_active":"2024-04-25T10:04:30.253993+0000","last_became_peered":"2024-04-25T10:04:30.253993+0000","last_unstale":"2024-04-25T10:04:30.258051+0000","last_undegraded":"2024-04-25T10:04:30.258051+0000","last_fullsized":"2024-04-25T10:04:30.258051+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:18.944449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.232701+0000","last_change":"2024-04-25T10:04:29.232701+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.232701+0000","last_undegraded":"2024-04-25T10:04:29.232701+0000","last_fullsized":"2024-04-25T10:04:29.232701+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.239225+0000","last_change":"2024-04-25T10:04:29.239225+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.239225+0000","last_undegraded":"2024-04-25T10:04:29.239225+0000","last_fullsized":"2024-04-25T10:04:29.239225+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.234215+0000","last_change":"2024-04-25T10:04:29.234215+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.234215+0000","last_undegraded":"2024-04-25T10:04:29.234215+0000","last_fullsized":"2024-04-25T10:04:29.234215+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.254755+0000","last_change":"2024-04-25T10:04:30.245661+0000","last_active":"2024-04-25T10:04:30.254755+0000","last_peered":"2024-04-25T10:04:30.254755+0000","last_clean":"2024-04-25T10:04:30.254755+0000","last_became_active":"2024-04-25T10:04:30.245371+0000","last_became_peered":"2024-04-25T10:04:30.245371+0000","last_unstale":"2024-04-25T10:04:30.254755+0000","last_undegraded":"2024-04-25T10:04:30.254755+0000","last_fullsized":"2024-04-25T10:04:30.254755+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:25.171859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.259079+0000","last_change":"2024-04-25T10:04:30.258292+0000","last_active":"2024-04-25T10:04:30.259079+0000","last_peered":"2024-04-25T10:04:30.259079+0000","last_clean":"2024-04-25T10:04:30.259079+0000","last_became_active":"2024-04-25T10:04:30.257766+0000","last_became_peered":"2024-04-25T10:04:30.257766+0000","last_unstale":"2024-04-25T10:04:30.259079+0000","last_undegraded":"2024-04-25T10:04:30.259079+0000","last_fullsized":"2024-04-25T10:04:30.259079+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:29.684144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.234675+0000","last_change":"2024-04-25T10:04:29.234675+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.234675+0000","last_undegraded":"2024-04-25T10:04:29.234675+0000","last_fullsized":"2024-04-25T10:04:29.234675+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"116'4","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.261309+0000","last_change":"2024-04-25T10:04:29.246635+0000","last_active":"2024-04-25T10:04:30.261309+0000","last_peered":"2024-04-25T10:04:30.261309+0000","last_clean":"2024-04-25T10:04:30.261309+0000","last_became_active":"2024-04-25T10:04:29.246149+0000","last_became_peered":"2024-04-25T10:04:29.246149+0000","last_unstale":"2024-04-25T10:04:30.261309+0000","last_undegraded":"2024-04-25T10:04:30.261309+0000","last_fullsized":"2024-04-25T10:04:30.261309+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:54.240491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233189+0000","last_change":"2024-04-25T10:04:29.233189+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233189+0000","last_undegraded":"2024-04-25T10:04:29.233189+0000","last_fullsized":"2024-04-25T10:04:29.233189+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.242837+0000","last_change":"2024-04-25T10:04:29.241014+0000","last_active":"2024-04-25T10:04:29.242837+0000","last_peered":"2024-04-25T10:04:29.242837+0000","last_clean":"2024-04-25T10:04:29.242837+0000","last_became_active":"2024-04-25T10:04:29.240747+0000","last_became_peered":"2024-04-25T10:04:29.240747+0000","last_unstale":"2024-04-25T10:04:29.242837+0000","last_undegraded":"2024-04-25T10:04:29.242837+0000","last_fullsized":"2024-04-25T10:04:29.242837+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:05.633007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.259127+0000","last_change":"2024-04-25T10:04:30.258097+0000","last_active":"2024-04-25T10:04:30.259127+0000","last_peered":"2024-04-25T10:04:30.259127+0000","last_clean":"2024-04-25T10:04:30.259127+0000","last_became_active":"2024-04-25T10:04:30.257788+0000","last_became_peered":"2024-04-25T10:04:30.257788+0000","last_unstale":"2024-04-25T10:04:30.259127+0000","last_undegraded":"2024-04-25T10:04:30.259127+0000","last_fullsized":"2024-04-25T10:04:30.259127+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:46:54.349361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"116'2","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.263266+0000","last_change":"2024-04-25T10:04:29.247462+0000","last_active":"2024-04-25T10:04:30.263266+0000","last_peered":"2024-04-25T10:04:30.263266+0000","last_clean":"2024-04-25T10:04:30.263266+0000","last_became_active":"2024-04-25T10:04:29.247192+0000","last_became_peered":"2024-04-25T10:04:29.247192+0000","last_unstale":"2024-04-25T10:04:30.263266+0000","last_undegraded":"2024-04-25T10:04:30.263266+0000","last_fullsized":"2024-04-25T10:04:30.263266+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:17.577585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.263922+0000","last_change":"2024-04-25T10:04:30.263430+0000","last_active":"2024-04-25T10:04:30.263922+0000","last_peered":"2024-04-25T10:04:30.263922+0000","last_clean":"2024-04-25T10:04:30.263922+0000","last_became_active":"2024-04-25T10:04:30.263105+0000","last_became_peered":"2024-04-25T10:04:30.263105+0000","last_unstale":"2024-04-25T10:04:30.263922+0000","last_undegraded":"2024-04-25T10:04:30.263922+0000","last_fullsized":"2024-04-25T10:04:30.263922+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:48.104630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.242829+0000","last_change":"2024-04-25T10:04:29.240963+0000","last_active":"2024-04-25T10:04:29.242829+0000","last_peered":"2024-04-25T10:04:29.242829+0000","last_clean":"2024-04-25T10:04:29.242829+0000","last_became_active":"2024-04-25T10:04:29.240676+0000","last_became_peered":"2024-04-25T10:04:29.240676+0000","last_unstale":"2024-04-25T10:04:29.242829+0000","last_undegraded":"2024-04-25T10:04:29.242829+0000","last_fullsized":"2024-04-25T10:04:29.242829+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:16.035459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233038+0000","last_change":"2024-04-25T10:04:29.233038+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233038+0000","last_undegraded":"2024-04-25T10:04:29.233038+0000","last_fullsized":"2024-04-25T10:04:29.233038+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"116'1","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.258625+0000","last_change":"2024-04-25T10:04:29.245168+0000","last_active":"2024-04-25T10:04:30.258625+0000","last_peered":"2024-04-25T10:04:30.258625+0000","last_clean":"2024-04-25T10:04:30.258625+0000","last_became_active":"2024-04-25T10:04:29.244887+0000","last_became_peered":"2024-04-25T10:04:29.244887+0000","last_unstale":"2024-04-25T10:04:30.258625+0000","last_undegraded":"2024-04-25T10:04:30.258625+0000","last_fullsized":"2024-04-25T10:04:30.258625+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:05.046287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.254402+0000","last_change":"2024-04-25T10:04:30.249301+0000","last_active":"2024-04-25T10:04:30.254402+0000","last_peered":"2024-04-25T10:04:30.254402+0000","last_clean":"2024-04-25T10:04:30.254402+0000","last_became_active":"2024-04-25T10:04:30.249015+0000","last_became_peered":"2024-04-25T10:04:30.249015+0000","last_unstale":"2024-04-25T10:04:30.254402+0000","last_undegraded":"2024-04-25T10:04:30.254402+0000","last_fullsized":"2024-04-25T10:04:30.254402+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:10.060231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.246412+0000","last_change":"2024-04-25T10:04:29.242148+0000","last_active":"2024-04-25T10:04:29.246412+0000","last_peered":"2024-04-25T10:04:29.246412+0000","last_clean":"2024-04-25T10:04:29.246412+0000","last_became_active":"2024-04-25T10:04:29.241863+0000","last_became_peered":"2024-04-25T10:04:29.241863+0000","last_unstale":"2024-04-25T10:04:29.246412+0000","last_undegraded":"2024-04-25T10:04:29.246412+0000","last_fullsized":"2024-04-25T10:04:29.246412+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:17.686544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233732+0000","last_change":"2024-04-25T10:04:29.233732+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233732+0000","last_undegraded":"2024-04-25T10:04:29.233732+0000","last_fullsized":"2024-04-25T10:04:29.233732+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.239530+0000","last_change":"2024-04-25T10:04:29.245895+0000","last_active":"2024-04-25T10:04:30.239530+0000","last_peered":"2024-04-25T10:04:30.239530+0000","last_clean":"2024-04-25T10:04:30.239530+0000","last_became_active":"2024-04-25T10:04:29.245618+0000","last_became_peered":"2024-04-25T10:04:29.245618+0000","last_unstale":"2024-04-25T10:04:30.239530+0000","last_undegraded":"2024-04-25T10:04:30.239530+0000","last_fullsized":"2024-04-25T10:04:30.239530+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:41.138715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.234123+0000","last_change":"2024-04-25T10:04:29.234123+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.234123+0000","last_undegraded":"2024-04-25T10:04:29.234123+0000","last_fullsized":"2024-04-25T10:04:29.234123+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.246459+0000","last_change":"2024-04-25T10:04:29.243321+0000","last_active":"2024-04-25T10:04:29.246459+0000","last_peered":"2024-04-25T10:04:29.246459+0000","last_clean":"2024-04-25T10:04:29.246459+0000","last_became_active":"2024-04-25T10:04:29.242993+0000","last_became_peered":"2024-04-25T10:04:29.242993+0000","last_unstale":"2024-04-25T10:04:29.246459+0000","last_undegraded":"2024-04-25T10:04:29.246459+0000","last_fullsized":"2024-04-25T10:04:29.246459+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:46.144168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.260114+0000","last_change":"2024-04-25T10:04:30.259351+0000","last_active":"2024-04-25T10:04:30.260114+0000","last_peered":"2024-04-25T10:04:30.260114+0000","last_clean":"2024-04-25T10:04:30.260114+0000","last_became_active":"2024-04-25T10:04:30.259032+0000","last_became_peered":"2024-04-25T10:04:30.259032+0000","last_unstale":"2024-04-25T10:04:30.260114+0000","last_undegraded":"2024-04-25T10:04:30.260114+0000","last_fullsized":"2024-04-25T10:04:30.260114+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:10.060231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.245980+0000","last_change":"2024-04-25T10:04:29.249960+0000","last_active":"2024-04-25T10:04:30.245980+0000","last_peered":"2024-04-25T10:04:30.245980+0000","last_clean":"2024-04-25T10:04:30.245980+0000","last_became_active":"2024-04-25T10:04:29.249622+0000","last_became_peered":"2024-04-25T10:04:29.249622+0000","last_unstale":"2024-04-25T10:04:30.245980+0000","last_undegraded":"2024-04-25T10:04:30.245980+0000","last_fullsized":"2024-04-25T10:04:30.245980+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:26.264680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.257314+0000","last_change":"2024-04-25T10:04:30.254839+0000","last_active":"2024-04-25T10:04:30.257314+0000","last_peered":"2024-04-25T10:04:30.257314+0000","last_clean":"2024-04-25T10:04:30.257314+0000","last_became_active":"2024-04-25T10:04:30.252585+0000","last_became_peered":"2024-04-25T10:04:30.252585+0000","last_unstale":"2024-04-25T10:04:30.257314+0000","last_undegraded":"2024-04-25T10:04:30.257314+0000","last_fullsized":"2024-04-25T10:04:30.257314+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:03.353003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.237470+0000","last_change":"2024-04-25T10:04:29.245786+0000","last_active":"2024-04-25T10:04:30.237470+0000","last_peered":"2024-04-25T10:04:30.237470+0000","last_clean":"2024-04-25T10:04:30.237470+0000","last_became_active":"2024-04-25T10:04:29.245467+0000","last_became_peered":"2024-04-25T10:04:29.245467+0000","last_unstale":"2024-04-25T10:04:30.237470+0000","last_undegraded":"2024-04-25T10:04:30.237470+0000","last_fullsized":"2024-04-25T10:04:30.237470+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:17.927919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233329+0000","last_change":"2024-04-25T10:04:29.233329+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233329+0000","last_undegraded":"2024-04-25T10:04:29.233329+0000","last_fullsized":"2024-04-25T10:04:29.233329+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"116'3","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.257027+0000","last_change":"2024-04-25T10:04:29.248775+0000","last_active":"2024-04-25T10:04:30.257027+0000","last_peered":"2024-04-25T10:04:30.257027+0000","last_clean":"2024-04-25T10:04:30.257027+0000","last_became_active":"2024-04-25T10:04:29.248484+0000","last_became_peered":"2024-04-25T10:04:29.248484+0000","last_unstale":"2024-04-25T10:04:30.257027+0000","last_undegraded":"2024-04-25T10:04:30.257027+0000","last_fullsized":"2024-04-25T10:04:30.257027+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:09.043701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.254777+0000","last_change":"2024-04-25T10:04:30.246946+0000","last_active":"2024-04-25T10:04:30.254777+0000","last_peered":"2024-04-25T10:04:30.254777+0000","last_clean":"2024-04-25T10:04:30.254777+0000","last_became_active":"2024-04-25T10:04:30.246636+0000","last_became_peered":"2024-04-25T10:04:30.246636+0000","last_unstale":"2024-04-25T10:04:30.254777+0000","last_undegraded":"2024-04-25T10:04:30.254777+0000","last_fullsized":"2024-04-25T10:04:30.254777+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:13.746169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.249491+0000","last_change":"2024-04-25T10:04:29.248492+0000","last_active":"2024-04-25T10:04:29.249491+0000","last_peered":"2024-04-25T10:04:29.249491+0000","last_clean":"2024-04-25T10:04:29.249491+0000","last_became_active":"2024-04-25T10:04:29.248184+0000","last_became_peered":"2024-04-25T10:04:29.248184+0000","last_unstale":"2024-04-25T10:04:29.249491+0000","last_undegraded":"2024-04-25T10:04:29.249491+0000","last_fullsized":"2024-04-25T10:04:29.249491+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:40.143885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.257574+0000","last_change":"2024-04-25T10:04:30.252044+0000","last_active":"2024-04-25T10:04:30.257574+0000","last_peered":"2024-04-25T10:04:30.257574+0000","last_clean":"2024-04-25T10:04:30.257574+0000","last_became_active":"2024-04-25T10:04:30.251299+0000","last_became_peered":"2024-04-25T10:04:30.251299+0000","last_unstale":"2024-04-25T10:04:30.257574+0000","last_undegraded":"2024-04-25T10:04:30.257574+0000","last_fullsized":"2024-04-25T10:04:30.257574+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:42.340536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.247504+0000","last_change":"2024-04-25T10:04:29.246443+0000","last_active":"2024-04-25T10:04:29.247504+0000","last_peered":"2024-04-25T10:04:29.247504+0000","last_clean":"2024-04-25T10:04:29.247504+0000","last_became_active":"2024-04-25T10:04:29.245766+0000","last_became_peered":"2024-04-25T10:04:29.245766+0000","last_unstale":"2024-04-25T10:04:29.247504+0000","last_undegraded":"2024-04-25T10:04:29.247504+0000","last_fullsized":"2024-04-25T10:04:29.247504+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:20.061436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.231839+0000","last_change":"2024-04-25T10:04:29.231839+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.231839+0000","last_undegraded":"2024-04-25T10:04:29.231839+0000","last_fullsized":"2024-04-25T10:04:29.231839+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.243738+0000","last_change":"2024-04-25T10:04:29.242805+0000","last_active":"2024-04-25T10:04:29.243738+0000","last_peered":"2024-04-25T10:04:29.243738+0000","last_clean":"2024-04-25T10:04:29.243738+0000","last_became_active":"2024-04-25T10:04:29.242435+0000","last_became_peered":"2024-04-25T10:04:29.242435+0000","last_unstale":"2024-04-25T10:04:29.243738+0000","last_undegraded":"2024-04-25T10:04:29.243738+0000","last_fullsized":"2024-04-25T10:04:29.243738+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:41.297407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.237096+0000","last_change":"2024-04-25T10:04:29.237096+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.237096+0000","last_undegraded":"2024-04-25T10:04:29.237096+0000","last_fullsized":"2024-04-25T10:04:29.237096+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.247541+0000","last_change":"2024-04-25T10:04:29.245970+0000","last_active":"2024-04-25T10:04:29.247541+0000","last_peered":"2024-04-25T10:04:29.247541+0000","last_clean":"2024-04-25T10:04:29.247541+0000","last_became_active":"2024-04-25T10:04:29.245667+0000","last_became_peered":"2024-04-25T10:04:29.245667+0000","last_unstale":"2024-04-25T10:04:29.247541+0000","last_undegraded":"2024-04-25T10:04:29.247541+0000","last_fullsized":"2024-04-25T10:04:29.247541+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:05.642908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.255484+0000","last_change":"2024-04-25T10:04:30.251298+0000","last_active":"2024-04-25T10:04:30.255484+0000","last_peered":"2024-04-25T10:04:30.255484+0000","last_clean":"2024-04-25T10:04:30.255484+0000","last_became_active":"2024-04-25T10:04:30.251021+0000","last_became_peered":"2024-04-25T10:04:30.251021+0000","last_unstale":"2024-04-25T10:04:30.255484+0000","last_undegraded":"2024-04-25T10:04:30.255484+0000","last_fullsized":"2024-04-25T10:04:30.255484+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:56:46.072939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.250581+0000","last_change":"2024-04-25T10:04:29.247771+0000","last_active":"2024-04-25T10:04:29.250581+0000","last_peered":"2024-04-25T10:04:29.250581+0000","last_clean":"2024-04-25T10:04:29.250581+0000","last_became_active":"2024-04-25T10:04:29.247178+0000","last_became_peered":"2024-04-25T10:04:29.247178+0000","last_unstale":"2024-04-25T10:04:29.250581+0000","last_undegraded":"2024-04-25T10:04:29.250581+0000","last_fullsized":"2024-04-25T10:04:29.250581+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:11.594481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.249711+0000","last_change":"2024-04-25T10:04:30.244889+0000","last_active":"2024-04-25T10:04:30.249711+0000","last_peered":"2024-04-25T10:04:30.249711+0000","last_clean":"2024-04-25T10:04:30.249711+0000","last_became_active":"2024-04-25T10:04:30.244564+0000","last_became_peered":"2024-04-25T10:04:30.244564+0000","last_unstale":"2024-04-25T10:04:30.249711+0000","last_undegraded":"2024-04-25T10:04:30.249711+0000","last_fullsized":"2024-04-25T10:04:30.249711+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:42.340536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.251342+0000","last_change":"2024-04-25T10:04:29.250738+0000","last_active":"2024-04-25T10:04:29.251342+0000","last_peered":"2024-04-25T10:04:29.251342+0000","last_clean":"2024-04-25T10:04:29.251342+0000","last_became_active":"2024-04-25T10:04:29.250437+0000","last_became_peered":"2024-04-25T10:04:29.250437+0000","last_unstale":"2024-04-25T10:04:29.251342+0000","last_undegraded":"2024-04-25T10:04:29.251342+0000","last_fullsized":"2024-04-25T10:04:29.251342+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:21.563376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233660+0000","last_change":"2024-04-25T10:04:29.233660+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233660+0000","last_undegraded":"2024-04-25T10:04:29.233660+0000","last_fullsized":"2024-04-25T10:04:29.233660+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"116'1","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.259833+0000","last_change":"2024-04-25T10:04:29.246631+0000","last_active":"2024-04-25T10:04:30.259833+0000","last_peered":"2024-04-25T10:04:30.259833+0000","last_clean":"2024-04-25T10:04:30.259833+0000","last_became_active":"2024-04-25T10:04:29.246207+0000","last_became_peered":"2024-04-25T10:04:29.246207+0000","last_unstale":"2024-04-25T10:04:30.259833+0000","last_undegraded":"2024-04-25T10:04:30.259833+0000","last_fullsized":"2024-04-25T10:04:30.259833+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:07.897567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.255141+0000","last_change":"2024-04-25T10:04:30.250282+0000","last_active":"2024-04-25T10:04:30.255141+0000","last_peered":"2024-04-25T10:04:30.255141+0000","last_clean":"2024-04-25T10:04:30.255141+0000","last_became_active":"2024-04-25T10:04:30.250001+0000","last_became_peered":"2024-04-25T10:04:30.250001+0000","last_unstale":"2024-04-25T10:04:30.255141+0000","last_undegraded":"2024-04-25T10:04:30.255141+0000","last_fullsized":"2024-04-25T10:04:30.255141+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:16.033392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.239824+0000","last_change":"2024-04-25T10:04:29.251151+0000","last_active":"2024-04-25T10:04:30.239824+0000","last_peered":"2024-04-25T10:04:30.239824+0000","last_clean":"2024-04-25T10:04:30.239824+0000","last_became_active":"2024-04-25T10:04:29.250830+0000","last_became_peered":"2024-04-25T10:04:29.250830+0000","last_unstale":"2024-04-25T10:04:30.239824+0000","last_undegraded":"2024-04-25T10:04:30.239824+0000","last_fullsized":"2024-04-25T10:04:30.239824+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:05.642908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233970+0000","last_change":"2024-04-25T10:04:29.233970+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233970+0000","last_undegraded":"2024-04-25T10:04:29.233970+0000","last_fullsized":"2024-04-25T10:04:29.233970+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.250438+0000","last_change":"2024-04-25T10:04:29.249278+0000","last_active":"2024-04-25T10:04:29.250438+0000","last_peered":"2024-04-25T10:04:29.250438+0000","last_clean":"2024-04-25T10:04:29.250438+0000","last_became_active":"2024-04-25T10:04:29.248937+0000","last_became_peered":"2024-04-25T10:04:29.248937+0000","last_unstale":"2024-04-25T10:04:29.250438+0000","last_undegraded":"2024-04-25T10:04:29.250438+0000","last_fullsized":"2024-04-25T10:04:29.250438+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:46.692405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.232377+0000","last_change":"2024-04-25T10:04:29.232377+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.232377+0000","last_undegraded":"2024-04-25T10:04:29.232377+0000","last_fullsized":"2024-04-25T10:04:29.232377+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.241267+0000","last_change":"2024-04-25T10:04:29.249318+0000","last_active":"2024-04-25T10:04:30.241267+0000","last_peered":"2024-04-25T10:04:30.241267+0000","last_clean":"2024-04-25T10:04:30.241267+0000","last_became_active":"2024-04-25T10:04:29.249041+0000","last_became_peered":"2024-04-25T10:04:29.249041+0000","last_unstale":"2024-04-25T10:04:30.241267+0000","last_undegraded":"2024-04-25T10:04:30.241267+0000","last_fullsized":"2024-04-25T10:04:30.241267+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:43.133631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.232853+0000","last_change":"2024-04-25T10:04:29.232853+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.232853+0000","last_undegraded":"2024-04-25T10:04:29.232853+0000","last_fullsized":"2024-04-25T10:04:29.232853+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.243702+0000","last_change":"2024-04-25T10:04:29.239923+0000","last_active":"2024-04-25T10:04:29.243702+0000","last_peered":"2024-04-25T10:04:29.243702+0000","last_clean":"2024-04-25T10:04:29.243702+0000","last_became_active":"2024-04-25T10:04:29.239005+0000","last_became_peered":"2024-04-25T10:04:29.239005+0000","last_unstale":"2024-04-25T10:04:29.243702+0000","last_undegraded":"2024-04-25T10:04:29.243702+0000","last_fullsized":"2024-04-25T10:04:29.243702+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:28.667614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.254902+0000","last_change":"2024-04-25T10:04:30.246887+0000","last_active":"2024-04-25T10:04:30.254902+0000","last_peered":"2024-04-25T10:04:30.254902+0000","last_clean":"2024-04-25T10:04:30.254902+0000","last_became_active":"2024-04-25T10:04:30.246594+0000","last_became_peered":"2024-04-25T10:04:30.246594+0000","last_unstale":"2024-04-25T10:04:30.254902+0000","last_undegraded":"2024-04-25T10:04:30.254902+0000","last_fullsized":"2024-04-25T10:04:30.254902+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:36.697245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.240011+0000","last_change":"2024-04-25T10:04:29.246354+0000","last_active":"2024-04-25T10:04:30.240011+0000","last_peered":"2024-04-25T10:04:30.240011+0000","last_clean":"2024-04-25T10:04:30.240011+0000","last_became_active":"2024-04-25T10:04:29.245722+0000","last_became_peered":"2024-04-25T10:04:29.245722+0000","last_unstale":"2024-04-25T10:04:30.240011+0000","last_undegraded":"2024-04-25T10:04:30.240011+0000","last_fullsized":"2024-04-25T10:04:30.240011+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:20.061436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.232192+0000","last_change":"2024-04-25T10:04:29.232192+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.232192+0000","last_undegraded":"2024-04-25T10:04:29.232192+0000","last_fullsized":"2024-04-25T10:04:29.232192+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.250424+0000","last_change":"2024-04-25T10:04:29.249571+0000","last_active":"2024-04-25T10:04:29.250424+0000","last_peered":"2024-04-25T10:04:29.250424+0000","last_clean":"2024-04-25T10:04:29.250424+0000","last_became_active":"2024-04-25T10:04:29.249244+0000","last_became_peered":"2024-04-25T10:04:29.249244+0000","last_unstale":"2024-04-25T10:04:29.250424+0000","last_undegraded":"2024-04-25T10:04:29.250424+0000","last_fullsized":"2024-04-25T10:04:29.250424+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:20.360839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233326+0000","last_change":"2024-04-25T10:04:29.233326+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233326+0000","last_undegraded":"2024-04-25T10:04:29.233326+0000","last_fullsized":"2024-04-25T10:04:29.233326+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.243588+0000","last_change":"2024-04-25T10:04:29.247101+0000","last_active":"2024-04-25T10:04:30.243588+0000","last_peered":"2024-04-25T10:04:30.243588+0000","last_clean":"2024-04-25T10:04:30.243588+0000","last_became_active":"2024-04-25T10:04:29.246778+0000","last_became_peered":"2024-04-25T10:04:29.246778+0000","last_unstale":"2024-04-25T10:04:30.243588+0000","last_undegraded":"2024-04-25T10:04:30.243588+0000","last_fullsized":"2024-04-25T10:04:30.243588+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:48.371611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.259969+0000","last_change":"2024-04-25T10:04:30.255411+0000","last_active":"2024-04-25T10:04:30.259969+0000","last_peered":"2024-04-25T10:04:30.259969+0000","last_clean":"2024-04-25T10:04:30.259969+0000","last_became_active":"2024-04-25T10:04:30.255122+0000","last_became_peered":"2024-04-25T10:04:30.255122+0000","last_unstale":"2024-04-25T10:04:30.259969+0000","last_undegraded":"2024-04-25T10:04:30.259969+0000","last_fullsized":"2024-04-25T10:04:30.259969+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:40.380809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.245904+0000","last_change":"2024-04-25T10:04:29.249960+0000","last_active":"2024-04-25T10:04:30.245904+0000","last_peered":"2024-04-25T10:04:30.245904+0000","last_clean":"2024-04-25T10:04:30.245904+0000","last_became_active":"2024-04-25T10:04:29.249686+0000","last_became_peered":"2024-04-25T10:04:29.249686+0000","last_unstale":"2024-04-25T10:04:30.245904+0000","last_undegraded":"2024-04-25T10:04:30.245904+0000","last_fullsized":"2024-04-25T10:04:30.245904+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:14.946290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.237161+0000","last_change":"2024-04-25T10:04:29.237161+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.237161+0000","last_undegraded":"2024-04-25T10:04:29.237161+0000","last_fullsized":"2024-04-25T10:04:29.237161+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.246678+0000","last_change":"2024-04-25T10:04:29.243398+0000","last_active":"2024-04-25T10:04:29.246678+0000","last_peered":"2024-04-25T10:04:29.246678+0000","last_clean":"2024-04-25T10:04:29.246678+0000","last_became_active":"2024-04-25T10:04:29.243107+0000","last_became_peered":"2024-04-25T10:04:29.243107+0000","last_unstale":"2024-04-25T10:04:29.246678+0000","last_undegraded":"2024-04-25T10:04:29.246678+0000","last_fullsized":"2024-04-25T10:04:29.246678+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:07.262739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233545+0000","last_change":"2024-04-25T10:04:29.233545+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233545+0000","last_undegraded":"2024-04-25T10:04:29.233545+0000","last_fullsized":"2024-04-25T10:04:29.233545+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.234664+0000","last_change":"2024-04-25T10:04:29.248089+0000","last_active":"2024-04-25T10:04:30.234664+0000","last_peered":"2024-04-25T10:04:30.234664+0000","last_clean":"2024-04-25T10:04:30.234664+0000","last_became_active":"2024-04-25T10:04:29.247817+0000","last_became_peered":"2024-04-25T10:04:29.247817+0000","last_unstale":"2024-04-25T10:04:30.234664+0000","last_undegraded":"2024-04-25T10:04:30.234664+0000","last_fullsized":"2024-04-25T10:04:30.234664+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:48.371611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.231831+0000","last_change":"2024-04-25T10:04:29.231831+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.231831+0000","last_undegraded":"2024-04-25T10:04:29.231831+0000","last_fullsized":"2024-04-25T10:04:29.231831+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.234857+0000","last_change":"2024-04-25T10:04:29.247433+0000","last_active":"2024-04-25T10:04:30.234857+0000","last_peered":"2024-04-25T10:04:30.234857+0000","last_clean":"2024-04-25T10:04:30.234857+0000","last_became_active":"2024-04-25T10:04:29.247134+0000","last_became_peered":"2024-04-25T10:04:29.247134+0000","last_unstale":"2024-04-25T10:04:30.234857+0000","last_undegraded":"2024-04-25T10:04:30.234857+0000","last_fullsized":"2024-04-25T10:04:30.234857+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:54.240491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.263266+0000","last_change":"2024-04-25T10:04:30.262379+0000","last_active":"2024-04-25T10:04:30.263266+0000","last_peered":"2024-04-25T10:04:30.263266+0000","last_clean":"2024-04-25T10:04:30.263266+0000","last_became_active":"2024-04-25T10:04:30.262076+0000","last_became_peered":"2024-04-25T10:04:30.262076+0000","last_unstale":"2024-04-25T10:04:30.263266+0000","last_undegraded":"2024-04-25T10:04:30.263266+0000","last_fullsized":"2024-04-25T10:04:30.263266+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:12:17.828765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.249176+0000","last_change":"2024-04-25T10:04:29.244891+0000","last_active":"2024-04-25T10:04:29.249176+0000","last_peered":"2024-04-25T10:04:29.249176+0000","last_clean":"2024-04-25T10:04:29.249176+0000","last_became_active":"2024-04-25T10:04:29.244546+0000","last_became_peered":"2024-04-25T10:04:29.244546+0000","last_unstale":"2024-04-25T10:04:29.249176+0000","last_undegraded":"2024-04-25T10:04:29.249176+0000","last_fullsized":"2024-04-25T10:04:29.249176+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:18.154851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.232227+0000","last_change":"2024-04-25T10:04:29.232227+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.232227+0000","last_undegraded":"2024-04-25T10:04:29.232227+0000","last_fullsized":"2024-04-25T10:04:29.232227+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.240162+0000","last_change":"2024-04-25T10:04:29.246803+0000","last_active":"2024-04-25T10:04:30.240162+0000","last_peered":"2024-04-25T10:04:30.240162+0000","last_clean":"2024-04-25T10:04:30.240162+0000","last_became_active":"2024-04-25T10:04:29.246060+0000","last_became_peered":"2024-04-25T10:04:29.246060+0000","last_unstale":"2024-04-25T10:04:30.240162+0000","last_undegraded":"2024-04-25T10:04:30.240162+0000","last_fullsized":"2024-04-25T10:04:30.240162+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:40.143885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.260029+0000","last_change":"2024-04-25T10:04:30.256368+0000","last_active":"2024-04-25T10:04:30.260029+0000","last_peered":"2024-04-25T10:04:30.260029+0000","last_clean":"2024-04-25T10:04:30.260029+0000","last_became_active":"2024-04-25T10:04:30.255756+0000","last_became_peered":"2024-04-25T10:04:30.255756+0000","last_unstale":"2024-04-25T10:04:30.260029+0000","last_undegraded":"2024-04-25T10:04:30.260029+0000","last_fullsized":"2024-04-25T10:04:30.260029+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:51.787602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.244295+0000","last_change":"2024-04-25T10:04:29.240856+0000","last_active":"2024-04-25T10:04:29.244295+0000","last_peered":"2024-04-25T10:04:29.244295+0000","last_clean":"2024-04-25T10:04:29.244295+0000","last_became_active":"2024-04-25T10:04:29.240561+0000","last_became_peered":"2024-04-25T10:04:29.240561+0000","last_unstale":"2024-04-25T10:04:29.244295+0000","last_undegraded":"2024-04-25T10:04:29.244295+0000","last_fullsized":"2024-04-25T10:04:29.244295+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:28.747545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":347,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.240294+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T10:04:30.240294+0000","last_peered":"2024-04-25T10:04:30.240294+0000","last_clean":"2024-04-25T10:04:30.240294+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T10:04:30.240294+0000","last_undegraded":"2024-04-25T10:04:30.240294+0000","last_fullsized":"2024-04-25T10:04:30.240294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":742,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542270,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33184,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338656,"statfs":{"total":96636764160,"available":96602783744,"internally_reserved":0,"allocated":2052096,"data_stored":1262200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542270,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1445888,"data_stored":671638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542272,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1429504,"data_stored":663889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542269,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32600,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339240,"statfs":{"total":96636764160,"available":96603381760,"internally_reserved":0,"allocated":1454080,"data_stored":672668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574974,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1429504,"data_stored":663889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574974,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1417216,"data_stored":657222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574974,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1429504,"data_stored":663889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574974,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37320,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334520,"statfs":{"total":96636764160,"available":96598548480,"internally_reserved":0,"allocated":2023424,"data_stored":1254257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:04:33.246 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:04:33.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.376+0000 7f54c7b9e640 1 Processor -- start 2024-04-25T10:04:33.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.377+0000 7f54c7b9e640 1 -- start start 2024-04-25T10:04:33.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.377+0000 7f54c7b9e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f54c015db00 0x7f54c00d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:33.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.377+0000 7f54c7b9e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f54c00b53b0 0x7f54c00d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:33.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.377+0000 7f54c7b9e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c00d1e80 con 0x7f54c00ce2b0 2024-04-25T10:04:33.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.377+0000 7f54c7b9e640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c00b5930 con 0x7f54c015db00 2024-04-25T10:04:33.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.377+0000 7f54c7b9e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c00b5c10 con 0x7f54c00b53b0 2024-04-25T10:04:33.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.378+0000 7f54c593a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f54c015db00 0x7f54c00d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:33.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.378+0000 7f54c593a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f54c015db00 0x7f54c00d0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47690/0 (socket says 172.21.15.7:47690) 2024-04-25T10:04:33.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.378+0000 7f54c593a640 1 -- 172.21.15.7:0/1234992483 learned_addr learned my addr 172.21.15.7:0/1234992483 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:33.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.378+0000 7f54c593a640 1 -- 172.21.15.7:0/1234992483 >> v2:172.21.15.55:3300/0 conn(0x7f54c00b53b0 msgr2=0x7f54c00d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:33.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.378+0000 7f54c593a640 1 --2- 172.21.15.7:0/1234992483 >> v2:172.21.15.55:3300/0 conn(0x7f54c00b53b0 0x7f54c00d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.378+0000 7f54c593a640 1 -- 172.21.15.7:0/1234992483 >> v1:172.21.15.55:6789/0 conn(0x7f54c00ce2b0 legacy=0x7f54c0161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:33.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.378+0000 7f54c593a640 1 -- 172.21.15.7:0/1234992483 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c00b5ef0 con 0x7f54c015db00 2024-04-25T10:04:33.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.378+0000 7f54c593a640 1 --2- 172.21.15.7:0/1234992483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54c015db00 0x7f54c00d0340 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f54c00d4a00 tx=0x7f54b002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e6f357254937c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:33.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.379+0000 7f54c4938640 1 -- 172.21.15.7:0/1234992483 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b0036070 con 0x7f54c015db00 2024-04-25T10:04:33.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.379+0000 7f54c4938640 1 -- 172.21.15.7:0/1234992483 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b0031600 con 0x7f54c015db00 2024-04-25T10:04:33.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.379+0000 7f54c4938640 1 -- 172.21.15.7:0/1234992483 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b00319d0 con 0x7f54c015db00 2024-04-25T10:04:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.379+0000 7f54c7b9e640 1 -- 172.21.15.7:0/1234992483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54c015db00 msgr2=0x7f54c00d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.379+0000 7f54c7b9e640 1 --2- 172.21.15.7:0/1234992483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54c015db00 0x7f54c00d0340 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f54c00d4a00 tx=0x7f54b002a6f0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.379+0000 7f54c7b9e640 1 -- 172.21.15.7:0/1234992483 shutdown_connections 2024-04-25T10:04:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.379+0000 7f54c7b9e640 1 --2- 172.21.15.7:0/1234992483 >> v2:172.21.15.55:3300/0 conn(0x7f54c00b53b0 0x7f54c00d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.379+0000 7f54c7b9e640 1 --2- 172.21.15.7:0/1234992483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54c015db00 0x7f54c00d0340 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.379+0000 7f54c7b9e640 1 -- 172.21.15.7:0/1234992483 >> 172.21.15.7:0/1234992483 conn(0x7f54c0072290 msgr2=0x7f54c00726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.379+0000 7f54c7b9e640 1 -- 172.21.15.7:0/1234992483 shutdown_connections 2024-04-25T10:04:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.379+0000 7f54c7b9e640 1 -- 172.21.15.7:0/1234992483 wait complete. 2024-04-25T10:04:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.380+0000 7f54c7b9e640 1 Processor -- start 2024-04-25T10:04:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.380+0000 7f54c7b9e640 1 -- start start 2024-04-25T10:04:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.381+0000 7f54c7b9e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f54c00b53b0 0x7f54c01602c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.381+0000 7f54c7b9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54c00ce2b0 0x7f54c0160800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.381+0000 7f54c7b9e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54c015db00 0x7f54c00cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.381+0000 7f54c7b9e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c00d3660 con 0x7f54c015db00 2024-04-25T10:04:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.381+0000 7f54c7b9e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c00b61d0 con 0x7f54c00ce2b0 2024-04-25T10:04:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.381+0000 7f54c7b9e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c00b6c10 con 0x7f54c00b53b0 2024-04-25T10:04:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.381+0000 7f54c613b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54c015db00 0x7f54c00cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.381+0000 7f54c613b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54c015db00 0x7f54c00cba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47700/0 (socket says 172.21.15.7:47700) 2024-04-25T10:04:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.381+0000 7f54c613b640 1 -- 172.21.15.7:0/579936072 learned_addr learned my addr 172.21.15.7:0/579936072 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:33.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.382+0000 7f54c593a640 1 --2- 172.21.15.7:0/579936072 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f54c00b53b0 0x7f54c01602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.382+0000 7f54c5139640 1 --2- 172.21.15.7:0/579936072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54c00ce2b0 0x7f54c0160800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.382+0000 7f54c613b640 1 -- 172.21.15.7:0/579936072 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f54c00b53b0 msgr2=0x7f54c01602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.382+0000 7f54c613b640 1 --2- 172.21.15.7:0/579936072 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f54c00b53b0 0x7f54c01602c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.382+0000 7f54c613b640 1 -- 172.21.15.7:0/579936072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54c00ce2b0 msgr2=0x7f54c0160800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.382+0000 7f54c613b640 1 --2- 172.21.15.7:0/579936072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54c00ce2b0 0x7f54c0160800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.382+0000 7f54c613b640 1 -- 172.21.15.7:0/579936072 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c00cd880 con 0x7f54c015db00 2024-04-25T10:04:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.382+0000 7f54c613b640 1 --2- 172.21.15.7:0/579936072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54c015db00 0x7f54c00cba70 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f54b800c390 tx=0x7f54b800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.382+0000 7f54be7fc640 1 -- 172.21.15.7:0/579936072 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b8017070 con 0x7f54c015db00 2024-04-25T10:04:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.382+0000 7f54be7fc640 1 -- 172.21.15.7:0/579936072 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b80035f0 con 0x7f54c015db00 2024-04-25T10:04:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.382+0000 7f54be7fc640 1 -- 172.21.15.7:0/579936072 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b80039e0 con 0x7f54c015db00 2024-04-25T10:04:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.382+0000 7f54c7b9e640 1 -- 172.21.15.7:0/579936072 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c00cc7e0 con 0x7f54c015db00 2024-04-25T10:04:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.382+0000 7f54c7b9e640 1 -- 172.21.15.7:0/579936072 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c00ccda0 con 0x7f54c015db00 2024-04-25T10:04:33.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.383+0000 7f54c7b9e640 1 -- 172.21.15.7:0/579936072 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c00cdcf0 con 0x7f54c015db00 2024-04-25T10:04:33.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.384+0000 7f54be7fc640 1 -- 172.21.15.7:0/579936072 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f54b8003b80 con 0x7f54c015db00 2024-04-25T10:04:33.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.384+0000 7f54be7fc640 1 --2- 172.21.15.7:0/579936072 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f54ac06b4d0 0x7f54ac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:33.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.384+0000 7f54be7fc640 1 -- 172.21.15.7:0/579936072 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f54b8089690 con 0x7f54c015db00 2024-04-25T10:04:33.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.384+0000 7f54c593a640 1 --2- 172.21.15.7:0/579936072 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f54ac06b4d0 0x7f54ac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:33.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.385+0000 7f54c593a640 1 --2- 172.21.15.7:0/579936072 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f54ac06b4d0 0x7f54ac06d990 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f54b0033000 tx=0x7f54b0009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:33.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.388+0000 7f54be7fc640 1 -- 172.21.15.7:0/579936072 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f54c00cdcf0 con 0x7f54c015db00 2024-04-25T10:04:33.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.564+0000 7f54c7b9e640 1 -- 172.21.15.7:0/579936072 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f54c0068fd0 con 0x7f54ac06b4d0 2024-04-25T10:04:33.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.570+0000 7f54be7fc640 1 -- 172.21.15.7:0/579936072 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249510 (secure 0 0 0) 0x7f54c0068fd0 con 0x7f54ac06b4d0 2024-04-25T10:04:33.577 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T10:04:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.573+0000 7f54c7b9e640 1 -- 172.21.15.7:0/579936072 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f54ac06b4d0 msgr2=0x7f54ac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.573+0000 7f54c7b9e640 1 --2- 172.21.15.7:0/579936072 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f54ac06b4d0 0x7f54ac06d990 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f54b0033000 tx=0x7f54b0009000 comp rx=0 tx=0).stop 2024-04-25T10:04:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.573+0000 7f54c7b9e640 1 -- 172.21.15.7:0/579936072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54c015db00 msgr2=0x7f54c00cba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.573+0000 7f54c7b9e640 1 --2- 172.21.15.7:0/579936072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54c015db00 0x7f54c00cba70 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f54b800c390 tx=0x7f54b800c850 comp rx=0 tx=0).stop 2024-04-25T10:04:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.573+0000 7f54c7b9e640 1 -- 172.21.15.7:0/579936072 shutdown_connections 2024-04-25T10:04:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.573+0000 7f54c7b9e640 1 --2- 172.21.15.7:0/579936072 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f54ac06b4d0 0x7f54ac06d990 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.573+0000 7f54c7b9e640 1 --2- 172.21.15.7:0/579936072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f54c015db00 0x7f54c00cba70 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.573+0000 7f54c7b9e640 1 --2- 172.21.15.7:0/579936072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54c00ce2b0 0x7f54c0160800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.573+0000 7f54c7b9e640 1 --2- 172.21.15.7:0/579936072 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f54c00b53b0 0x7f54c01602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.573+0000 7f54c7b9e640 1 -- 172.21.15.7:0/579936072 >> 172.21.15.7:0/579936072 conn(0x7f54c0072290 msgr2=0x7f54c00d37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.573+0000 7f54c7b9e640 1 -- 172.21.15.7:0/579936072 shutdown_connections 2024-04-25T10:04:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.573+0000 7f54c7b9e640 1 -- 172.21.15.7:0/579936072 wait complete. 2024-04-25T10:04:33.589 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":419,"stamp":"2024-04-25T10:04:31.994706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":265996,"kb_used_data":12384,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754708724,"statfs":{"total":773094113280,"available":772821733376,"internally_reserved":0,"allocated":12681216,"data_stored":6509652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":259575345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":742,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000909"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.242746+0000","last_change":"2024-04-25T10:04:30.240506+0000","last_active":"2024-04-25T10:04:30.242746+0000","last_peered":"2024-04-25T10:04:30.242746+0000","last_clean":"2024-04-25T10:04:30.242746+0000","last_became_active":"2024-04-25T10:04:30.240146+0000","last_became_peered":"2024-04-25T10:04:30.240146+0000","last_unstale":"2024-04-25T10:04:30.242746+0000","last_undegraded":"2024-04-25T10:04:30.242746+0000","last_fullsized":"2024-04-25T10:04:30.242746+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:15.962820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.237330+0000","last_change":"2024-04-25T10:04:29.237330+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.237330+0000","last_undegraded":"2024-04-25T10:04:29.237330+0000","last_fullsized":"2024-04-25T10:04:29.237330+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.236919+0000","last_change":"2024-04-25T10:04:29.236919+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.236919+0000","last_undegraded":"2024-04-25T10:04:29.236919+0000","last_fullsized":"2024-04-25T10:04:29.236919+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.259642+0000","last_change":"2024-04-25T10:04:30.252147+0000","last_active":"2024-04-25T10:04:30.259642+0000","last_peered":"2024-04-25T10:04:30.259642+0000","last_clean":"2024-04-25T10:04:30.259642+0000","last_became_active":"2024-04-25T10:04:30.251836+0000","last_became_peered":"2024-04-25T10:04:30.251836+0000","last_unstale":"2024-04-25T10:04:30.259642+0000","last_undegraded":"2024-04-25T10:04:30.259642+0000","last_fullsized":"2024-04-25T10:04:30.259642+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:27.545334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.255527+0000","last_change":"2024-04-25T10:04:30.252200+0000","last_active":"2024-04-25T10:04:30.255527+0000","last_peered":"2024-04-25T10:04:30.255527+0000","last_clean":"2024-04-25T10:04:30.255527+0000","last_became_active":"2024-04-25T10:04:30.251902+0000","last_became_peered":"2024-04-25T10:04:30.251902+0000","last_unstale":"2024-04-25T10:04:30.255527+0000","last_undegraded":"2024-04-25T10:04:30.255527+0000","last_fullsized":"2024-04-25T10:04:30.255527+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:45.747180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.235067+0000","last_change":"2024-04-25T10:04:29.235067+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.235067+0000","last_undegraded":"2024-04-25T10:04:29.235067+0000","last_fullsized":"2024-04-25T10:04:29.235067+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.234975+0000","last_change":"2024-04-25T10:04:29.234975+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.234975+0000","last_undegraded":"2024-04-25T10:04:29.234975+0000","last_fullsized":"2024-04-25T10:04:29.234975+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.236365+0000","last_change":"2024-04-25T10:04:29.236365+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.236365+0000","last_undegraded":"2024-04-25T10:04:29.236365+0000","last_fullsized":"2024-04-25T10:04:29.236365+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.260091+0000","last_change":"2024-04-25T10:04:30.256927+0000","last_active":"2024-04-25T10:04:30.260091+0000","last_peered":"2024-04-25T10:04:30.260091+0000","last_clean":"2024-04-25T10:04:30.260091+0000","last_became_active":"2024-04-25T10:04:30.255115+0000","last_became_peered":"2024-04-25T10:04:30.255115+0000","last_unstale":"2024-04-25T10:04:30.260091+0000","last_undegraded":"2024-04-25T10:04:30.260091+0000","last_fullsized":"2024-04-25T10:04:30.260091+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:00.553092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.236981+0000","last_change":"2024-04-25T10:04:29.236981+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.236981+0000","last_undegraded":"2024-04-25T10:04:29.236981+0000","last_fullsized":"2024-04-25T10:04:29.236981+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.249732+0000","last_change":"2024-04-25T10:04:30.245678+0000","last_active":"2024-04-25T10:04:30.249732+0000","last_peered":"2024-04-25T10:04:30.249732+0000","last_clean":"2024-04-25T10:04:30.249732+0000","last_became_active":"2024-04-25T10:04:30.245363+0000","last_became_peered":"2024-04-25T10:04:30.245363+0000","last_unstale":"2024-04-25T10:04:30.249732+0000","last_undegraded":"2024-04-25T10:04:30.249732+0000","last_fullsized":"2024-04-25T10:04:30.249732+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:18.944449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.234165+0000","last_change":"2024-04-25T10:04:29.234165+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.234165+0000","last_undegraded":"2024-04-25T10:04:29.234165+0000","last_fullsized":"2024-04-25T10:04:29.234165+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.235212+0000","last_change":"2024-04-25T10:04:29.235212+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.235212+0000","last_undegraded":"2024-04-25T10:04:29.235212+0000","last_fullsized":"2024-04-25T10:04:29.235212+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.236402+0000","last_change":"2024-04-25T10:04:29.236402+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.236402+0000","last_undegraded":"2024-04-25T10:04:29.236402+0000","last_fullsized":"2024-04-25T10:04:29.236402+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.249655+0000","last_change":"2024-04-25T10:04:30.246368+0000","last_active":"2024-04-25T10:04:30.249655+0000","last_peered":"2024-04-25T10:04:30.249655+0000","last_clean":"2024-04-25T10:04:30.249655+0000","last_became_active":"2024-04-25T10:04:30.246100+0000","last_became_peered":"2024-04-25T10:04:30.246100+0000","last_unstale":"2024-04-25T10:04:30.249655+0000","last_undegraded":"2024-04-25T10:04:30.249655+0000","last_fullsized":"2024-04-25T10:04:30.249655+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:42.155245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.234378+0000","last_change":"2024-04-25T10:04:29.234378+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.234378+0000","last_undegraded":"2024-04-25T10:04:29.234378+0000","last_fullsized":"2024-04-25T10:04:29.234378+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.235759+0000","last_change":"2024-04-25T10:04:29.235759+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.235759+0000","last_undegraded":"2024-04-25T10:04:29.235759+0000","last_fullsized":"2024-04-25T10:04:29.235759+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.235878+0000","last_change":"2024-04-25T10:04:29.235878+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.235878+0000","last_undegraded":"2024-04-25T10:04:29.235878+0000","last_fullsized":"2024-04-25T10:04:29.235878+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.258074+0000","last_change":"2024-04-25T10:04:30.254496+0000","last_active":"2024-04-25T10:04:30.258074+0000","last_peered":"2024-04-25T10:04:30.258074+0000","last_clean":"2024-04-25T10:04:30.258074+0000","last_became_active":"2024-04-25T10:04:30.254205+0000","last_became_peered":"2024-04-25T10:04:30.254205+0000","last_unstale":"2024-04-25T10:04:30.258074+0000","last_undegraded":"2024-04-25T10:04:30.258074+0000","last_fullsized":"2024-04-25T10:04:30.258074+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:42.155245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.237396+0000","last_change":"2024-04-25T10:04:29.237396+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.237396+0000","last_undegraded":"2024-04-25T10:04:29.237396+0000","last_fullsized":"2024-04-25T10:04:29.237396+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.260054+0000","last_change":"2024-04-25T10:04:30.256744+0000","last_active":"2024-04-25T10:04:30.260054+0000","last_peered":"2024-04-25T10:04:30.260054+0000","last_clean":"2024-04-25T10:04:30.260054+0000","last_became_active":"2024-04-25T10:04:30.256064+0000","last_became_peered":"2024-04-25T10:04:30.256064+0000","last_unstale":"2024-04-25T10:04:30.260054+0000","last_undegraded":"2024-04-25T10:04:30.260054+0000","last_fullsized":"2024-04-25T10:04:30.260054+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:01.357667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.249612+0000","last_change":"2024-04-25T10:04:30.244355+0000","last_active":"2024-04-25T10:04:30.249612+0000","last_peered":"2024-04-25T10:04:30.249612+0000","last_clean":"2024-04-25T10:04:30.249612+0000","last_became_active":"2024-04-25T10:04:30.244028+0000","last_became_peered":"2024-04-25T10:04:30.244028+0000","last_unstale":"2024-04-25T10:04:30.249612+0000","last_undegraded":"2024-04-25T10:04:30.249612+0000","last_fullsized":"2024-04-25T10:04:30.249612+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:27.281210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.259695+0000","last_change":"2024-04-25T10:04:30.253400+0000","last_active":"2024-04-25T10:04:30.259695+0000","last_peered":"2024-04-25T10:04:30.259695+0000","last_clean":"2024-04-25T10:04:30.259695+0000","last_became_active":"2024-04-25T10:04:30.253118+0000","last_became_peered":"2024-04-25T10:04:30.253118+0000","last_unstale":"2024-04-25T10:04:30.259695+0000","last_undegraded":"2024-04-25T10:04:30.259695+0000","last_fullsized":"2024-04-25T10:04:30.259695+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:24.510668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.259100+0000","last_change":"2024-04-25T10:04:30.258434+0000","last_active":"2024-04-25T10:04:30.259100+0000","last_peered":"2024-04-25T10:04:30.259100+0000","last_clean":"2024-04-25T10:04:30.259100+0000","last_became_active":"2024-04-25T10:04:30.258149+0000","last_became_peered":"2024-04-25T10:04:30.258149+0000","last_unstale":"2024-04-25T10:04:30.259100+0000","last_undegraded":"2024-04-25T10:04:30.259100+0000","last_fullsized":"2024-04-25T10:04:30.259100+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:29.764075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.255118+0000","last_change":"2024-04-25T10:04:30.248070+0000","last_active":"2024-04-25T10:04:30.255118+0000","last_peered":"2024-04-25T10:04:30.255118+0000","last_clean":"2024-04-25T10:04:30.255118+0000","last_became_active":"2024-04-25T10:04:30.247788+0000","last_became_peered":"2024-04-25T10:04:30.247788+0000","last_unstale":"2024-04-25T10:04:30.255118+0000","last_undegraded":"2024-04-25T10:04:30.255118+0000","last_fullsized":"2024-04-25T10:04:30.255118+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:34.725496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.237563+0000","last_change":"2024-04-25T10:04:29.237563+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.237563+0000","last_undegraded":"2024-04-25T10:04:29.237563+0000","last_fullsized":"2024-04-25T10:04:29.237563+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.258051+0000","last_change":"2024-04-25T10:04:30.254462+0000","last_active":"2024-04-25T10:04:30.258051+0000","last_peered":"2024-04-25T10:04:30.258051+0000","last_clean":"2024-04-25T10:04:30.258051+0000","last_became_active":"2024-04-25T10:04:30.253993+0000","last_became_peered":"2024-04-25T10:04:30.253993+0000","last_unstale":"2024-04-25T10:04:30.258051+0000","last_undegraded":"2024-04-25T10:04:30.258051+0000","last_fullsized":"2024-04-25T10:04:30.258051+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:18.944449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.232701+0000","last_change":"2024-04-25T10:04:29.232701+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.232701+0000","last_undegraded":"2024-04-25T10:04:29.232701+0000","last_fullsized":"2024-04-25T10:04:29.232701+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.239225+0000","last_change":"2024-04-25T10:04:29.239225+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.239225+0000","last_undegraded":"2024-04-25T10:04:29.239225+0000","last_fullsized":"2024-04-25T10:04:29.239225+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.234215+0000","last_change":"2024-04-25T10:04:29.234215+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.234215+0000","last_undegraded":"2024-04-25T10:04:29.234215+0000","last_fullsized":"2024-04-25T10:04:29.234215+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.254755+0000","last_change":"2024-04-25T10:04:30.245661+0000","last_active":"2024-04-25T10:04:30.254755+0000","last_peered":"2024-04-25T10:04:30.254755+0000","last_clean":"2024-04-25T10:04:30.254755+0000","last_became_active":"2024-04-25T10:04:30.245371+0000","last_became_peered":"2024-04-25T10:04:30.245371+0000","last_unstale":"2024-04-25T10:04:30.254755+0000","last_undegraded":"2024-04-25T10:04:30.254755+0000","last_fullsized":"2024-04-25T10:04:30.254755+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:25.171859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.259079+0000","last_change":"2024-04-25T10:04:30.258292+0000","last_active":"2024-04-25T10:04:30.259079+0000","last_peered":"2024-04-25T10:04:30.259079+0000","last_clean":"2024-04-25T10:04:30.259079+0000","last_became_active":"2024-04-25T10:04:30.257766+0000","last_became_peered":"2024-04-25T10:04:30.257766+0000","last_unstale":"2024-04-25T10:04:30.259079+0000","last_undegraded":"2024-04-25T10:04:30.259079+0000","last_fullsized":"2024-04-25T10:04:30.259079+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:29.684144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.234675+0000","last_change":"2024-04-25T10:04:29.234675+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.234675+0000","last_undegraded":"2024-04-25T10:04:29.234675+0000","last_fullsized":"2024-04-25T10:04:29.234675+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"116'4","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.261309+0000","last_change":"2024-04-25T10:04:29.246635+0000","last_active":"2024-04-25T10:04:30.261309+0000","last_peered":"2024-04-25T10:04:30.261309+0000","last_clean":"2024-04-25T10:04:30.261309+0000","last_became_active":"2024-04-25T10:04:29.246149+0000","last_became_peered":"2024-04-25T10:04:29.246149+0000","last_unstale":"2024-04-25T10:04:30.261309+0000","last_undegraded":"2024-04-25T10:04:30.261309+0000","last_fullsized":"2024-04-25T10:04:30.261309+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:54.240491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233189+0000","last_change":"2024-04-25T10:04:29.233189+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233189+0000","last_undegraded":"2024-04-25T10:04:29.233189+0000","last_fullsized":"2024-04-25T10:04:29.233189+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.242837+0000","last_change":"2024-04-25T10:04:29.241014+0000","last_active":"2024-04-25T10:04:29.242837+0000","last_peered":"2024-04-25T10:04:29.242837+0000","last_clean":"2024-04-25T10:04:29.242837+0000","last_became_active":"2024-04-25T10:04:29.240747+0000","last_became_peered":"2024-04-25T10:04:29.240747+0000","last_unstale":"2024-04-25T10:04:29.242837+0000","last_undegraded":"2024-04-25T10:04:29.242837+0000","last_fullsized":"2024-04-25T10:04:29.242837+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:05.633007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.259127+0000","last_change":"2024-04-25T10:04:30.258097+0000","last_active":"2024-04-25T10:04:30.259127+0000","last_peered":"2024-04-25T10:04:30.259127+0000","last_clean":"2024-04-25T10:04:30.259127+0000","last_became_active":"2024-04-25T10:04:30.257788+0000","last_became_peered":"2024-04-25T10:04:30.257788+0000","last_unstale":"2024-04-25T10:04:30.259127+0000","last_undegraded":"2024-04-25T10:04:30.259127+0000","last_fullsized":"2024-04-25T10:04:30.259127+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:46:54.349361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"116'2","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.263266+0000","last_change":"2024-04-25T10:04:29.247462+0000","last_active":"2024-04-25T10:04:30.263266+0000","last_peered":"2024-04-25T10:04:30.263266+0000","last_clean":"2024-04-25T10:04:30.263266+0000","last_became_active":"2024-04-25T10:04:29.247192+0000","last_became_peered":"2024-04-25T10:04:29.247192+0000","last_unstale":"2024-04-25T10:04:30.263266+0000","last_undegraded":"2024-04-25T10:04:30.263266+0000","last_fullsized":"2024-04-25T10:04:30.263266+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:17.577585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.263922+0000","last_change":"2024-04-25T10:04:30.263430+0000","last_active":"2024-04-25T10:04:30.263922+0000","last_peered":"2024-04-25T10:04:30.263922+0000","last_clean":"2024-04-25T10:04:30.263922+0000","last_became_active":"2024-04-25T10:04:30.263105+0000","last_became_peered":"2024-04-25T10:04:30.263105+0000","last_unstale":"2024-04-25T10:04:30.263922+0000","last_undegraded":"2024-04-25T10:04:30.263922+0000","last_fullsized":"2024-04-25T10:04:30.263922+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:48.104630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.242829+0000","last_change":"2024-04-25T10:04:29.240963+0000","last_active":"2024-04-25T10:04:29.242829+0000","last_peered":"2024-04-25T10:04:29.242829+0000","last_clean":"2024-04-25T10:04:29.242829+0000","last_became_active":"2024-04-25T10:04:29.240676+0000","last_became_peered":"2024-04-25T10:04:29.240676+0000","last_unstale":"2024-04-25T10:04:29.242829+0000","last_undegraded":"2024-04-25T10:04:29.242829+0000","last_fullsized":"2024-04-25T10:04:29.242829+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:16.035459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233038+0000","last_change":"2024-04-25T10:04:29.233038+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233038+0000","last_undegraded":"2024-04-25T10:04:29.233038+0000","last_fullsized":"2024-04-25T10:04:29.233038+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"116'1","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.258625+0000","last_change":"2024-04-25T10:04:29.245168+0000","last_active":"2024-04-25T10:04:30.258625+0000","last_peered":"2024-04-25T10:04:30.258625+0000","last_clean":"2024-04-25T10:04:30.258625+0000","last_became_active":"2024-04-25T10:04:29.244887+0000","last_became_peered":"2024-04-25T10:04:29.244887+0000","last_unstale":"2024-04-25T10:04:30.258625+0000","last_undegraded":"2024-04-25T10:04:30.258625+0000","last_fullsized":"2024-04-25T10:04:30.258625+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:05.046287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.254402+0000","last_change":"2024-04-25T10:04:30.249301+0000","last_active":"2024-04-25T10:04:30.254402+0000","last_peered":"2024-04-25T10:04:30.254402+0000","last_clean":"2024-04-25T10:04:30.254402+0000","last_became_active":"2024-04-25T10:04:30.249015+0000","last_became_peered":"2024-04-25T10:04:30.249015+0000","last_unstale":"2024-04-25T10:04:30.254402+0000","last_undegraded":"2024-04-25T10:04:30.254402+0000","last_fullsized":"2024-04-25T10:04:30.254402+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:10.060231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.246412+0000","last_change":"2024-04-25T10:04:29.242148+0000","last_active":"2024-04-25T10:04:29.246412+0000","last_peered":"2024-04-25T10:04:29.246412+0000","last_clean":"2024-04-25T10:04:29.246412+0000","last_became_active":"2024-04-25T10:04:29.241863+0000","last_became_peered":"2024-04-25T10:04:29.241863+0000","last_unstale":"2024-04-25T10:04:29.246412+0000","last_undegraded":"2024-04-25T10:04:29.246412+0000","last_fullsized":"2024-04-25T10:04:29.246412+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:17.686544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233732+0000","last_change":"2024-04-25T10:04:29.233732+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233732+0000","last_undegraded":"2024-04-25T10:04:29.233732+0000","last_fullsized":"2024-04-25T10:04:29.233732+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.239530+0000","last_change":"2024-04-25T10:04:29.245895+0000","last_active":"2024-04-25T10:04:30.239530+0000","last_peered":"2024-04-25T10:04:30.239530+0000","last_clean":"2024-04-25T10:04:30.239530+0000","last_became_active":"2024-04-25T10:04:29.245618+0000","last_became_peered":"2024-04-25T10:04:29.245618+0000","last_unstale":"2024-04-25T10:04:30.239530+0000","last_undegraded":"2024-04-25T10:04:30.239530+0000","last_fullsized":"2024-04-25T10:04:30.239530+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:41.138715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.234123+0000","last_change":"2024-04-25T10:04:29.234123+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.234123+0000","last_undegraded":"2024-04-25T10:04:29.234123+0000","last_fullsized":"2024-04-25T10:04:29.234123+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.246459+0000","last_change":"2024-04-25T10:04:29.243321+0000","last_active":"2024-04-25T10:04:29.246459+0000","last_peered":"2024-04-25T10:04:29.246459+0000","last_clean":"2024-04-25T10:04:29.246459+0000","last_became_active":"2024-04-25T10:04:29.242993+0000","last_became_peered":"2024-04-25T10:04:29.242993+0000","last_unstale":"2024-04-25T10:04:29.246459+0000","last_undegraded":"2024-04-25T10:04:29.246459+0000","last_fullsized":"2024-04-25T10:04:29.246459+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:46.144168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.260114+0000","last_change":"2024-04-25T10:04:30.259351+0000","last_active":"2024-04-25T10:04:30.260114+0000","last_peered":"2024-04-25T10:04:30.260114+0000","last_clean":"2024-04-25T10:04:30.260114+0000","last_became_active":"2024-04-25T10:04:30.259032+0000","last_became_peered":"2024-04-25T10:04:30.259032+0000","last_unstale":"2024-04-25T10:04:30.260114+0000","last_undegraded":"2024-04-25T10:04:30.260114+0000","last_fullsized":"2024-04-25T10:04:30.260114+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:10.060231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.245980+0000","last_change":"2024-04-25T10:04:29.249960+0000","last_active":"2024-04-25T10:04:30.245980+0000","last_peered":"2024-04-25T10:04:30.245980+0000","last_clean":"2024-04-25T10:04:30.245980+0000","last_became_active":"2024-04-25T10:04:29.249622+0000","last_became_peered":"2024-04-25T10:04:29.249622+0000","last_unstale":"2024-04-25T10:04:30.245980+0000","last_undegraded":"2024-04-25T10:04:30.245980+0000","last_fullsized":"2024-04-25T10:04:30.245980+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:26.264680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.257314+0000","last_change":"2024-04-25T10:04:30.254839+0000","last_active":"2024-04-25T10:04:30.257314+0000","last_peered":"2024-04-25T10:04:30.257314+0000","last_clean":"2024-04-25T10:04:30.257314+0000","last_became_active":"2024-04-25T10:04:30.252585+0000","last_became_peered":"2024-04-25T10:04:30.252585+0000","last_unstale":"2024-04-25T10:04:30.257314+0000","last_undegraded":"2024-04-25T10:04:30.257314+0000","last_fullsized":"2024-04-25T10:04:30.257314+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:03.353003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.237470+0000","last_change":"2024-04-25T10:04:29.245786+0000","last_active":"2024-04-25T10:04:30.237470+0000","last_peered":"2024-04-25T10:04:30.237470+0000","last_clean":"2024-04-25T10:04:30.237470+0000","last_became_active":"2024-04-25T10:04:29.245467+0000","last_became_peered":"2024-04-25T10:04:29.245467+0000","last_unstale":"2024-04-25T10:04:30.237470+0000","last_undegraded":"2024-04-25T10:04:30.237470+0000","last_fullsized":"2024-04-25T10:04:30.237470+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:17.927919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233329+0000","last_change":"2024-04-25T10:04:29.233329+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233329+0000","last_undegraded":"2024-04-25T10:04:29.233329+0000","last_fullsized":"2024-04-25T10:04:29.233329+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"116'3","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.257027+0000","last_change":"2024-04-25T10:04:29.248775+0000","last_active":"2024-04-25T10:04:30.257027+0000","last_peered":"2024-04-25T10:04:30.257027+0000","last_clean":"2024-04-25T10:04:30.257027+0000","last_became_active":"2024-04-25T10:04:29.248484+0000","last_became_peered":"2024-04-25T10:04:29.248484+0000","last_unstale":"2024-04-25T10:04:30.257027+0000","last_undegraded":"2024-04-25T10:04:30.257027+0000","last_fullsized":"2024-04-25T10:04:30.257027+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:09.043701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.254777+0000","last_change":"2024-04-25T10:04:30.246946+0000","last_active":"2024-04-25T10:04:30.254777+0000","last_peered":"2024-04-25T10:04:30.254777+0000","last_clean":"2024-04-25T10:04:30.254777+0000","last_became_active":"2024-04-25T10:04:30.246636+0000","last_became_peered":"2024-04-25T10:04:30.246636+0000","last_unstale":"2024-04-25T10:04:30.254777+0000","last_undegraded":"2024-04-25T10:04:30.254777+0000","last_fullsized":"2024-04-25T10:04:30.254777+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:13.746169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.249491+0000","last_change":"2024-04-25T10:04:29.248492+0000","last_active":"2024-04-25T10:04:29.249491+0000","last_peered":"2024-04-25T10:04:29.249491+0000","last_clean":"2024-04-25T10:04:29.249491+0000","last_became_active":"2024-04-25T10:04:29.248184+0000","last_became_peered":"2024-04-25T10:04:29.248184+0000","last_unstale":"2024-04-25T10:04:29.249491+0000","last_undegraded":"2024-04-25T10:04:29.249491+0000","last_fullsized":"2024-04-25T10:04:29.249491+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:40.143885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.257574+0000","last_change":"2024-04-25T10:04:30.252044+0000","last_active":"2024-04-25T10:04:30.257574+0000","last_peered":"2024-04-25T10:04:30.257574+0000","last_clean":"2024-04-25T10:04:30.257574+0000","last_became_active":"2024-04-25T10:04:30.251299+0000","last_became_peered":"2024-04-25T10:04:30.251299+0000","last_unstale":"2024-04-25T10:04:30.257574+0000","last_undegraded":"2024-04-25T10:04:30.257574+0000","last_fullsized":"2024-04-25T10:04:30.257574+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:42.340536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.247504+0000","last_change":"2024-04-25T10:04:29.246443+0000","last_active":"2024-04-25T10:04:29.247504+0000","last_peered":"2024-04-25T10:04:29.247504+0000","last_clean":"2024-04-25T10:04:29.247504+0000","last_became_active":"2024-04-25T10:04:29.245766+0000","last_became_peered":"2024-04-25T10:04:29.245766+0000","last_unstale":"2024-04-25T10:04:29.247504+0000","last_undegraded":"2024-04-25T10:04:29.247504+0000","last_fullsized":"2024-04-25T10:04:29.247504+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:20.061436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.231839+0000","last_change":"2024-04-25T10:04:29.231839+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.231839+0000","last_undegraded":"2024-04-25T10:04:29.231839+0000","last_fullsized":"2024-04-25T10:04:29.231839+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.243738+0000","last_change":"2024-04-25T10:04:29.242805+0000","last_active":"2024-04-25T10:04:29.243738+0000","last_peered":"2024-04-25T10:04:29.243738+0000","last_clean":"2024-04-25T10:04:29.243738+0000","last_became_active":"2024-04-25T10:04:29.242435+0000","last_became_peered":"2024-04-25T10:04:29.242435+0000","last_unstale":"2024-04-25T10:04:29.243738+0000","last_undegraded":"2024-04-25T10:04:29.243738+0000","last_fullsized":"2024-04-25T10:04:29.243738+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:41.297407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.237096+0000","last_change":"2024-04-25T10:04:29.237096+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.237096+0000","last_undegraded":"2024-04-25T10:04:29.237096+0000","last_fullsized":"2024-04-25T10:04:29.237096+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.247541+0000","last_change":"2024-04-25T10:04:29.245970+0000","last_active":"2024-04-25T10:04:29.247541+0000","last_peered":"2024-04-25T10:04:29.247541+0000","last_clean":"2024-04-25T10:04:29.247541+0000","last_became_active":"2024-04-25T10:04:29.245667+0000","last_became_peered":"2024-04-25T10:04:29.245667+0000","last_unstale":"2024-04-25T10:04:29.247541+0000","last_undegraded":"2024-04-25T10:04:29.247541+0000","last_fullsized":"2024-04-25T10:04:29.247541+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:05.642908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.255484+0000","last_change":"2024-04-25T10:04:30.251298+0000","last_active":"2024-04-25T10:04:30.255484+0000","last_peered":"2024-04-25T10:04:30.255484+0000","last_clean":"2024-04-25T10:04:30.255484+0000","last_became_active":"2024-04-25T10:04:30.251021+0000","last_became_peered":"2024-04-25T10:04:30.251021+0000","last_unstale":"2024-04-25T10:04:30.255484+0000","last_undegraded":"2024-04-25T10:04:30.255484+0000","last_fullsized":"2024-04-25T10:04:30.255484+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:56:46.072939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.250581+0000","last_change":"2024-04-25T10:04:29.247771+0000","last_active":"2024-04-25T10:04:29.250581+0000","last_peered":"2024-04-25T10:04:29.250581+0000","last_clean":"2024-04-25T10:04:29.250581+0000","last_became_active":"2024-04-25T10:04:29.247178+0000","last_became_peered":"2024-04-25T10:04:29.247178+0000","last_unstale":"2024-04-25T10:04:29.250581+0000","last_undegraded":"2024-04-25T10:04:29.250581+0000","last_fullsized":"2024-04-25T10:04:29.250581+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:11.594481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.249711+0000","last_change":"2024-04-25T10:04:30.244889+0000","last_active":"2024-04-25T10:04:30.249711+0000","last_peered":"2024-04-25T10:04:30.249711+0000","last_clean":"2024-04-25T10:04:30.249711+0000","last_became_active":"2024-04-25T10:04:30.244564+0000","last_became_peered":"2024-04-25T10:04:30.244564+0000","last_unstale":"2024-04-25T10:04:30.249711+0000","last_undegraded":"2024-04-25T10:04:30.249711+0000","last_fullsized":"2024-04-25T10:04:30.249711+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:42.340536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.251342+0000","last_change":"2024-04-25T10:04:29.250738+0000","last_active":"2024-04-25T10:04:29.251342+0000","last_peered":"2024-04-25T10:04:29.251342+0000","last_clean":"2024-04-25T10:04:29.251342+0000","last_became_active":"2024-04-25T10:04:29.250437+0000","last_became_peered":"2024-04-25T10:04:29.250437+0000","last_unstale":"2024-04-25T10:04:29.251342+0000","last_undegraded":"2024-04-25T10:04:29.251342+0000","last_fullsized":"2024-04-25T10:04:29.251342+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:21.563376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233660+0000","last_change":"2024-04-25T10:04:29.233660+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233660+0000","last_undegraded":"2024-04-25T10:04:29.233660+0000","last_fullsized":"2024-04-25T10:04:29.233660+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"116'1","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.259833+0000","last_change":"2024-04-25T10:04:29.246631+0000","last_active":"2024-04-25T10:04:30.259833+0000","last_peered":"2024-04-25T10:04:30.259833+0000","last_clean":"2024-04-25T10:04:30.259833+0000","last_became_active":"2024-04-25T10:04:29.246207+0000","last_became_peered":"2024-04-25T10:04:29.246207+0000","last_unstale":"2024-04-25T10:04:30.259833+0000","last_undegraded":"2024-04-25T10:04:30.259833+0000","last_fullsized":"2024-04-25T10:04:30.259833+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:07.897567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.255141+0000","last_change":"2024-04-25T10:04:30.250282+0000","last_active":"2024-04-25T10:04:30.255141+0000","last_peered":"2024-04-25T10:04:30.255141+0000","last_clean":"2024-04-25T10:04:30.255141+0000","last_became_active":"2024-04-25T10:04:30.250001+0000","last_became_peered":"2024-04-25T10:04:30.250001+0000","last_unstale":"2024-04-25T10:04:30.255141+0000","last_undegraded":"2024-04-25T10:04:30.255141+0000","last_fullsized":"2024-04-25T10:04:30.255141+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:16.033392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.239824+0000","last_change":"2024-04-25T10:04:29.251151+0000","last_active":"2024-04-25T10:04:30.239824+0000","last_peered":"2024-04-25T10:04:30.239824+0000","last_clean":"2024-04-25T10:04:30.239824+0000","last_became_active":"2024-04-25T10:04:29.250830+0000","last_became_peered":"2024-04-25T10:04:29.250830+0000","last_unstale":"2024-04-25T10:04:30.239824+0000","last_undegraded":"2024-04-25T10:04:30.239824+0000","last_fullsized":"2024-04-25T10:04:30.239824+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:05.642908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233970+0000","last_change":"2024-04-25T10:04:29.233970+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233970+0000","last_undegraded":"2024-04-25T10:04:29.233970+0000","last_fullsized":"2024-04-25T10:04:29.233970+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.250438+0000","last_change":"2024-04-25T10:04:29.249278+0000","last_active":"2024-04-25T10:04:29.250438+0000","last_peered":"2024-04-25T10:04:29.250438+0000","last_clean":"2024-04-25T10:04:29.250438+0000","last_became_active":"2024-04-25T10:04:29.248937+0000","last_became_peered":"2024-04-25T10:04:29.248937+0000","last_unstale":"2024-04-25T10:04:29.250438+0000","last_undegraded":"2024-04-25T10:04:29.250438+0000","last_fullsized":"2024-04-25T10:04:29.250438+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:46.692405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.232377+0000","last_change":"2024-04-25T10:04:29.232377+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.232377+0000","last_undegraded":"2024-04-25T10:04:29.232377+0000","last_fullsized":"2024-04-25T10:04:29.232377+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.241267+0000","last_change":"2024-04-25T10:04:29.249318+0000","last_active":"2024-04-25T10:04:30.241267+0000","last_peered":"2024-04-25T10:04:30.241267+0000","last_clean":"2024-04-25T10:04:30.241267+0000","last_became_active":"2024-04-25T10:04:29.249041+0000","last_became_peered":"2024-04-25T10:04:29.249041+0000","last_unstale":"2024-04-25T10:04:30.241267+0000","last_undegraded":"2024-04-25T10:04:30.241267+0000","last_fullsized":"2024-04-25T10:04:30.241267+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:43.133631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.232853+0000","last_change":"2024-04-25T10:04:29.232853+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.232853+0000","last_undegraded":"2024-04-25T10:04:29.232853+0000","last_fullsized":"2024-04-25T10:04:29.232853+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.243702+0000","last_change":"2024-04-25T10:04:29.239923+0000","last_active":"2024-04-25T10:04:29.243702+0000","last_peered":"2024-04-25T10:04:29.243702+0000","last_clean":"2024-04-25T10:04:29.243702+0000","last_became_active":"2024-04-25T10:04:29.239005+0000","last_became_peered":"2024-04-25T10:04:29.239005+0000","last_unstale":"2024-04-25T10:04:29.243702+0000","last_undegraded":"2024-04-25T10:04:29.243702+0000","last_fullsized":"2024-04-25T10:04:29.243702+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:28.667614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.254902+0000","last_change":"2024-04-25T10:04:30.246887+0000","last_active":"2024-04-25T10:04:30.254902+0000","last_peered":"2024-04-25T10:04:30.254902+0000","last_clean":"2024-04-25T10:04:30.254902+0000","last_became_active":"2024-04-25T10:04:30.246594+0000","last_became_peered":"2024-04-25T10:04:30.246594+0000","last_unstale":"2024-04-25T10:04:30.254902+0000","last_undegraded":"2024-04-25T10:04:30.254902+0000","last_fullsized":"2024-04-25T10:04:30.254902+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:36.697245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.240011+0000","last_change":"2024-04-25T10:04:29.246354+0000","last_active":"2024-04-25T10:04:30.240011+0000","last_peered":"2024-04-25T10:04:30.240011+0000","last_clean":"2024-04-25T10:04:30.240011+0000","last_became_active":"2024-04-25T10:04:29.245722+0000","last_became_peered":"2024-04-25T10:04:29.245722+0000","last_unstale":"2024-04-25T10:04:30.240011+0000","last_undegraded":"2024-04-25T10:04:30.240011+0000","last_fullsized":"2024-04-25T10:04:30.240011+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:20.061436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.232192+0000","last_change":"2024-04-25T10:04:29.232192+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.232192+0000","last_undegraded":"2024-04-25T10:04:29.232192+0000","last_fullsized":"2024-04-25T10:04:29.232192+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.250424+0000","last_change":"2024-04-25T10:04:29.249571+0000","last_active":"2024-04-25T10:04:29.250424+0000","last_peered":"2024-04-25T10:04:29.250424+0000","last_clean":"2024-04-25T10:04:29.250424+0000","last_became_active":"2024-04-25T10:04:29.249244+0000","last_became_peered":"2024-04-25T10:04:29.249244+0000","last_unstale":"2024-04-25T10:04:29.250424+0000","last_undegraded":"2024-04-25T10:04:29.250424+0000","last_fullsized":"2024-04-25T10:04:29.250424+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:20.360839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233326+0000","last_change":"2024-04-25T10:04:29.233326+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233326+0000","last_undegraded":"2024-04-25T10:04:29.233326+0000","last_fullsized":"2024-04-25T10:04:29.233326+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.243588+0000","last_change":"2024-04-25T10:04:29.247101+0000","last_active":"2024-04-25T10:04:30.243588+0000","last_peered":"2024-04-25T10:04:30.243588+0000","last_clean":"2024-04-25T10:04:30.243588+0000","last_became_active":"2024-04-25T10:04:29.246778+0000","last_became_peered":"2024-04-25T10:04:29.246778+0000","last_unstale":"2024-04-25T10:04:30.243588+0000","last_undegraded":"2024-04-25T10:04:30.243588+0000","last_fullsized":"2024-04-25T10:04:30.243588+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:48.371611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.259969+0000","last_change":"2024-04-25T10:04:30.255411+0000","last_active":"2024-04-25T10:04:30.259969+0000","last_peered":"2024-04-25T10:04:30.259969+0000","last_clean":"2024-04-25T10:04:30.259969+0000","last_became_active":"2024-04-25T10:04:30.255122+0000","last_became_peered":"2024-04-25T10:04:30.255122+0000","last_unstale":"2024-04-25T10:04:30.259969+0000","last_undegraded":"2024-04-25T10:04:30.259969+0000","last_fullsized":"2024-04-25T10:04:30.259969+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:40.380809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.245904+0000","last_change":"2024-04-25T10:04:29.249960+0000","last_active":"2024-04-25T10:04:30.245904+0000","last_peered":"2024-04-25T10:04:30.245904+0000","last_clean":"2024-04-25T10:04:30.245904+0000","last_became_active":"2024-04-25T10:04:29.249686+0000","last_became_peered":"2024-04-25T10:04:29.249686+0000","last_unstale":"2024-04-25T10:04:30.245904+0000","last_undegraded":"2024-04-25T10:04:30.245904+0000","last_fullsized":"2024-04-25T10:04:30.245904+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:14.946290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.237161+0000","last_change":"2024-04-25T10:04:29.237161+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.237161+0000","last_undegraded":"2024-04-25T10:04:29.237161+0000","last_fullsized":"2024-04-25T10:04:29.237161+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.246678+0000","last_change":"2024-04-25T10:04:29.243398+0000","last_active":"2024-04-25T10:04:29.246678+0000","last_peered":"2024-04-25T10:04:29.246678+0000","last_clean":"2024-04-25T10:04:29.246678+0000","last_became_active":"2024-04-25T10:04:29.243107+0000","last_became_peered":"2024-04-25T10:04:29.243107+0000","last_unstale":"2024-04-25T10:04:29.246678+0000","last_undegraded":"2024-04-25T10:04:29.246678+0000","last_fullsized":"2024-04-25T10:04:29.246678+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:07.262739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233545+0000","last_change":"2024-04-25T10:04:29.233545+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233545+0000","last_undegraded":"2024-04-25T10:04:29.233545+0000","last_fullsized":"2024-04-25T10:04:29.233545+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.234664+0000","last_change":"2024-04-25T10:04:29.248089+0000","last_active":"2024-04-25T10:04:30.234664+0000","last_peered":"2024-04-25T10:04:30.234664+0000","last_clean":"2024-04-25T10:04:30.234664+0000","last_became_active":"2024-04-25T10:04:29.247817+0000","last_became_peered":"2024-04-25T10:04:29.247817+0000","last_unstale":"2024-04-25T10:04:30.234664+0000","last_undegraded":"2024-04-25T10:04:30.234664+0000","last_fullsized":"2024-04-25T10:04:30.234664+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:48.371611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.231831+0000","last_change":"2024-04-25T10:04:29.231831+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.231831+0000","last_undegraded":"2024-04-25T10:04:29.231831+0000","last_fullsized":"2024-04-25T10:04:29.231831+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.234857+0000","last_change":"2024-04-25T10:04:29.247433+0000","last_active":"2024-04-25T10:04:30.234857+0000","last_peered":"2024-04-25T10:04:30.234857+0000","last_clean":"2024-04-25T10:04:30.234857+0000","last_became_active":"2024-04-25T10:04:29.247134+0000","last_became_peered":"2024-04-25T10:04:29.247134+0000","last_unstale":"2024-04-25T10:04:30.234857+0000","last_undegraded":"2024-04-25T10:04:30.234857+0000","last_fullsized":"2024-04-25T10:04:30.234857+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:54.240491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.263266+0000","last_change":"2024-04-25T10:04:30.262379+0000","last_active":"2024-04-25T10:04:30.263266+0000","last_peered":"2024-04-25T10:04:30.263266+0000","last_clean":"2024-04-25T10:04:30.263266+0000","last_became_active":"2024-04-25T10:04:30.262076+0000","last_became_peered":"2024-04-25T10:04:30.262076+0000","last_unstale":"2024-04-25T10:04:30.263266+0000","last_undegraded":"2024-04-25T10:04:30.263266+0000","last_fullsized":"2024-04-25T10:04:30.263266+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:12:17.828765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.249176+0000","last_change":"2024-04-25T10:04:29.244891+0000","last_active":"2024-04-25T10:04:29.249176+0000","last_peered":"2024-04-25T10:04:29.249176+0000","last_clean":"2024-04-25T10:04:29.249176+0000","last_became_active":"2024-04-25T10:04:29.244546+0000","last_became_peered":"2024-04-25T10:04:29.244546+0000","last_unstale":"2024-04-25T10:04:29.249176+0000","last_undegraded":"2024-04-25T10:04:29.249176+0000","last_fullsized":"2024-04-25T10:04:29.249176+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:18.154851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.232227+0000","last_change":"2024-04-25T10:04:29.232227+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.232227+0000","last_undegraded":"2024-04-25T10:04:29.232227+0000","last_fullsized":"2024-04-25T10:04:29.232227+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.240162+0000","last_change":"2024-04-25T10:04:29.246803+0000","last_active":"2024-04-25T10:04:30.240162+0000","last_peered":"2024-04-25T10:04:30.240162+0000","last_clean":"2024-04-25T10:04:30.240162+0000","last_became_active":"2024-04-25T10:04:29.246060+0000","last_became_peered":"2024-04-25T10:04:29.246060+0000","last_unstale":"2024-04-25T10:04:30.240162+0000","last_undegraded":"2024-04-25T10:04:30.240162+0000","last_fullsized":"2024-04-25T10:04:30.240162+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:40.143885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.260029+0000","last_change":"2024-04-25T10:04:30.256368+0000","last_active":"2024-04-25T10:04:30.260029+0000","last_peered":"2024-04-25T10:04:30.260029+0000","last_clean":"2024-04-25T10:04:30.260029+0000","last_became_active":"2024-04-25T10:04:30.255756+0000","last_became_peered":"2024-04-25T10:04:30.255756+0000","last_unstale":"2024-04-25T10:04:30.260029+0000","last_undegraded":"2024-04-25T10:04:30.260029+0000","last_fullsized":"2024-04-25T10:04:30.260029+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:51.787602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.244295+0000","last_change":"2024-04-25T10:04:29.240856+0000","last_active":"2024-04-25T10:04:29.244295+0000","last_peered":"2024-04-25T10:04:29.244295+0000","last_clean":"2024-04-25T10:04:29.244295+0000","last_became_active":"2024-04-25T10:04:29.240561+0000","last_became_peered":"2024-04-25T10:04:29.240561+0000","last_unstale":"2024-04-25T10:04:29.244295+0000","last_undegraded":"2024-04-25T10:04:29.244295+0000","last_fullsized":"2024-04-25T10:04:29.244295+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:28.747545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":347,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.240294+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T10:04:30.240294+0000","last_peered":"2024-04-25T10:04:30.240294+0000","last_clean":"2024-04-25T10:04:30.240294+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T10:04:30.240294+0000","last_undegraded":"2024-04-25T10:04:30.240294+0000","last_fullsized":"2024-04-25T10:04:30.240294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":742,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542270,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33184,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338656,"statfs":{"total":96636764160,"available":96602783744,"internally_reserved":0,"allocated":2052096,"data_stored":1262200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542270,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1445888,"data_stored":671638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542272,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1429504,"data_stored":663889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542269,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32600,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339240,"statfs":{"total":96636764160,"available":96603381760,"internally_reserved":0,"allocated":1454080,"data_stored":672668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574974,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1429504,"data_stored":663889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574974,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1417216,"data_stored":657222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574974,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1429504,"data_stored":663889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574974,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37320,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334520,"statfs":{"total":96636764160,"available":96598548480,"internally_reserved":0,"allocated":2023424,"data_stored":1254257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:04:33.593 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:04:33.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.725+0000 7f59a606b640 1 Processor -- start 2024-04-25T10:04:33.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.725+0000 7f59a606b640 1 -- start start 2024-04-25T10:04:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.725+0000 7f59a606b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59a00b1dd0 0x7f59a015ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.725+0000 7f59a606b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f59a0141ac0 0x7f59a0140a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.725+0000 7f59a606b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a015b360 con 0x7f59a0140f80 2024-04-25T10:04:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.725+0000 7f59a606b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59a01413f0 con 0x7f59a0141ac0 2024-04-25T10:04:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.726+0000 7f59a606b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a00cbc30 con 0x7f59a00b1dd0 2024-04-25T10:04:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.726+0000 7f599f7fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59a00b1dd0 0x7f59a015ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.726+0000 7f599effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f59a0141ac0 0x7f59a0140a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.726+0000 7f599f7fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59a00b1dd0 0x7f59a015ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:59790/0 (socket says 172.21.15.7:59790) 2024-04-25T10:04:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.726+0000 7f599f7fe640 1 -- 172.21.15.7:0/382912812 learned_addr learned my addr 172.21.15.7:0/382912812 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:33.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.726+0000 7f599effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f59a0141ac0 0x7f59a0140a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:33060/0 (socket says 172.21.15.7:33060) 2024-04-25T10:04:33.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.726+0000 7f599effd640 1 -- 172.21.15.7:0/382912812 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59a00b1dd0 msgr2=0x7f59a015ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:33.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.726+0000 7f599effd640 1 --2- 172.21.15.7:0/382912812 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59a00b1dd0 0x7f59a015ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.726+0000 7f599effd640 1 -- 172.21.15.7:0/382912812 >> v1:172.21.15.55:6789/0 conn(0x7f59a0140f80 legacy=0x7f59a006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:33.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.726+0000 7f599effd640 1 -- 172.21.15.7:0/382912812 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a00c4ab0 con 0x7f59a0141ac0 2024-04-25T10:04:33.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.726+0000 7f599f7fe640 1 --2- 172.21.15.7:0/382912812 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59a00b1dd0 0x7f59a015ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:33.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.727+0000 7f599effd640 1 --2- 172.21.15.7:0/382912812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59a0141ac0 0x7f59a0140a40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f59880097a0 tx=0x7f598802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95b34b4305596f77 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:33.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.727+0000 7f599e7fc640 1 -- 172.21.15.7:0/382912812 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5988037070 con 0x7f59a0141ac0 2024-04-25T10:04:33.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.727+0000 7f599e7fc640 1 -- 172.21.15.7:0/382912812 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5988032440 con 0x7f59a0141ac0 2024-04-25T10:04:33.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.727+0000 7f599e7fc640 1 -- 172.21.15.7:0/382912812 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5988032810 con 0x7f59a0141ac0 2024-04-25T10:04:33.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.728+0000 7f59a606b640 1 -- 172.21.15.7:0/382912812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59a0141ac0 msgr2=0x7f59a0140a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:33.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.728+0000 7f59a606b640 1 --2- 172.21.15.7:0/382912812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59a0141ac0 0x7f59a0140a40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f59880097a0 tx=0x7f598802a180 comp rx=0 tx=0).stop 2024-04-25T10:04:33.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.728+0000 7f59a606b640 1 -- 172.21.15.7:0/382912812 shutdown_connections 2024-04-25T10:04:33.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.728+0000 7f59a606b640 1 --2- 172.21.15.7:0/382912812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59a0141ac0 0x7f59a0140a40 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.728+0000 7f59a606b640 1 --2- 172.21.15.7:0/382912812 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59a00b1dd0 0x7f59a015ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.728+0000 7f59a606b640 1 -- 172.21.15.7:0/382912812 >> 172.21.15.7:0/382912812 conn(0x7f59a0071150 msgr2=0x7f59a0071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:33.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.728+0000 7f59a606b640 1 -- 172.21.15.7:0/382912812 shutdown_connections 2024-04-25T10:04:33.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.728+0000 7f59a606b640 1 -- 172.21.15.7:0/382912812 wait complete. 2024-04-25T10:04:33.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.729+0000 7f59a606b640 1 Processor -- start 2024-04-25T10:04:33.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.729+0000 7f59a606b640 1 -- start start 2024-04-25T10:04:33.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.730+0000 7f59a606b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59a00b1dd0 0x7f59a014d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:33.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.730+0000 7f59a606b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59a0140f80 0x7f59a0142c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:33.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.730+0000 7f59a606b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59a0141ac0 0x7f59a0143180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:33.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.730+0000 7f59a606b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a006d430 con 0x7f59a00b1dd0 2024-04-25T10:04:33.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.730+0000 7f59a606b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a00b21b0 con 0x7f59a0140f80 2024-04-25T10:04:33.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.730+0000 7f59a606b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a006d710 con 0x7f59a0141ac0 2024-04-25T10:04:33.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.730+0000 7f599f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59a00b1dd0 0x7f59a014d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:33.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.730+0000 7f599f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59a00b1dd0 0x7f59a014d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47702/0 (socket says 172.21.15.7:47702) 2024-04-25T10:04:33.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.730+0000 7f599f7fe640 1 -- 172.21.15.7:0/322625610 learned_addr learned my addr 172.21.15.7:0/322625610 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:33.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.730+0000 7f599effd640 1 --2- 172.21.15.7:0/322625610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59a0140f80 0x7f59a0142c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:33.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.730+0000 7f599ffff640 1 --2- 172.21.15.7:0/322625610 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59a0141ac0 0x7f59a0143180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:33.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.730+0000 7f599f7fe640 1 -- 172.21.15.7:0/322625610 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59a0141ac0 msgr2=0x7f59a0143180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:33.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.730+0000 7f599f7fe640 1 --2- 172.21.15.7:0/322625610 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59a0141ac0 0x7f59a0143180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.730+0000 7f599f7fe640 1 -- 172.21.15.7:0/322625610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59a0140f80 msgr2=0x7f59a0142c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:33.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.730+0000 7f599f7fe640 1 --2- 172.21.15.7:0/322625610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59a0140f80 0x7f59a0142c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.730+0000 7f599f7fe640 1 -- 172.21.15.7:0/322625610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a0139fb0 con 0x7f59a00b1dd0 2024-04-25T10:04:33.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.730+0000 7f599ffff640 1 --2- 172.21.15.7:0/322625610 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59a0141ac0 0x7f59a0143180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:33.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.730+0000 7f599effd640 1 --2- 172.21.15.7:0/322625610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59a0140f80 0x7f59a0142c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:33.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.731+0000 7f599f7fe640 1 --2- 172.21.15.7:0/322625610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59a00b1dd0 0x7f59a014d3b0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f5990010f10 tx=0x7f599000e730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:33.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.731+0000 7f5997fff640 1 -- 172.21.15.7:0/322625610 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599001e070 con 0x7f59a00b1dd0 2024-04-25T10:04:33.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.731+0000 7f5997fff640 1 -- 172.21.15.7:0/322625610 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5990011860 con 0x7f59a00b1dd0 2024-04-25T10:04:33.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.731+0000 7f5997fff640 1 -- 172.21.15.7:0/322625610 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5990011c10 con 0x7f59a00b1dd0 2024-04-25T10:04:33.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.731+0000 7f59a606b640 1 -- 172.21.15.7:0/322625610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59a014d8f0 con 0x7f59a00b1dd0 2024-04-25T10:04:33.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.731+0000 7f59a606b640 1 -- 172.21.15.7:0/322625610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a0137010 con 0x7f59a00b1dd0 2024-04-25T10:04:33.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.732+0000 7f59a606b640 1 -- 172.21.15.7:0/322625610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59a0068fd0 con 0x7f59a00b1dd0 2024-04-25T10:04:33.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.732+0000 7f5997fff640 1 -- 172.21.15.7:0/322625610 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5990021070 con 0x7f59a00b1dd0 2024-04-25T10:04:33.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.733+0000 7f5997fff640 1 --2- 172.21.15.7:0/322625610 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f598006b4d0 0x7f598006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:33.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.733+0000 7f5997fff640 1 -- 172.21.15.7:0/322625610 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f599008cec0 con 0x7f59a00b1dd0 2024-04-25T10:04:33.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.733+0000 7f599effd640 1 --2- 172.21.15.7:0/322625610 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f598006b4d0 0x7f598006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:33.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.733+0000 7f599effd640 1 --2- 172.21.15.7:0/322625610 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f598006b4d0 0x7f598006d990 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f5988034000 tx=0x7f598802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:33.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.737+0000 7f5997fff640 1 -- 172.21.15.7:0/322625610 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f599005bc40 con 0x7f59a00b1dd0 2024-04-25T10:04:33.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.915+0000 7f59a606b640 1 -- 172.21.15.7:0/322625610 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f59a00cc790 con 0x7f598006b4d0 2024-04-25T10:04:33.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.921+0000 7f5997fff640 1 -- 172.21.15.7:0/322625610 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249510 (secure 0 0 0) 0x7f59a00cc790 con 0x7f598006b4d0 2024-04-25T10:04:33.928 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:33.930 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T10:04:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.923+0000 7f59a606b640 1 -- 172.21.15.7:0/322625610 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f598006b4d0 msgr2=0x7f598006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.923+0000 7f59a606b640 1 --2- 172.21.15.7:0/322625610 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f598006b4d0 0x7f598006d990 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f5988034000 tx=0x7f598802e000 comp rx=0 tx=0).stop 2024-04-25T10:04:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.923+0000 7f59a606b640 1 -- 172.21.15.7:0/322625610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59a00b1dd0 msgr2=0x7f59a014d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.923+0000 7f59a606b640 1 --2- 172.21.15.7:0/322625610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59a00b1dd0 0x7f59a014d3b0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f5990010f10 tx=0x7f599000e730 comp rx=0 tx=0).stop 2024-04-25T10:04:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.924+0000 7f59a606b640 1 -- 172.21.15.7:0/322625610 shutdown_connections 2024-04-25T10:04:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.924+0000 7f59a606b640 1 --2- 172.21.15.7:0/322625610 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f598006b4d0 0x7f598006d990 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.924+0000 7f59a606b640 1 --2- 172.21.15.7:0/322625610 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f59a0141ac0 0x7f59a0143180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.924+0000 7f59a606b640 1 --2- 172.21.15.7:0/322625610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59a0140f80 0x7f59a0142c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.924+0000 7f59a606b640 1 --2- 172.21.15.7:0/322625610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59a00b1dd0 0x7f59a014d3b0 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.924+0000 7f59a606b640 1 -- 172.21.15.7:0/322625610 >> 172.21.15.7:0/322625610 conn(0x7f59a0071150 msgr2=0x7f59a00737a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:33.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.924+0000 7f59a606b640 1 -- 172.21.15.7:0/322625610 shutdown_connections 2024-04-25T10:04:33.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:33.924+0000 7f59a606b640 1 -- 172.21.15.7:0/322625610 wait complete. 2024-04-25T10:04:33.940 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":419,"stamp":"2024-04-25T10:04:31.994706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":265996,"kb_used_data":12384,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754708724,"statfs":{"total":773094113280,"available":772821733376,"internally_reserved":0,"allocated":12681216,"data_stored":6509652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":259575345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":742,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000909"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.242746+0000","last_change":"2024-04-25T10:04:30.240506+0000","last_active":"2024-04-25T10:04:30.242746+0000","last_peered":"2024-04-25T10:04:30.242746+0000","last_clean":"2024-04-25T10:04:30.242746+0000","last_became_active":"2024-04-25T10:04:30.240146+0000","last_became_peered":"2024-04-25T10:04:30.240146+0000","last_unstale":"2024-04-25T10:04:30.242746+0000","last_undegraded":"2024-04-25T10:04:30.242746+0000","last_fullsized":"2024-04-25T10:04:30.242746+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:15.962820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.237330+0000","last_change":"2024-04-25T10:04:29.237330+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.237330+0000","last_undegraded":"2024-04-25T10:04:29.237330+0000","last_fullsized":"2024-04-25T10:04:29.237330+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.236919+0000","last_change":"2024-04-25T10:04:29.236919+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.236919+0000","last_undegraded":"2024-04-25T10:04:29.236919+0000","last_fullsized":"2024-04-25T10:04:29.236919+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.259642+0000","last_change":"2024-04-25T10:04:30.252147+0000","last_active":"2024-04-25T10:04:30.259642+0000","last_peered":"2024-04-25T10:04:30.259642+0000","last_clean":"2024-04-25T10:04:30.259642+0000","last_became_active":"2024-04-25T10:04:30.251836+0000","last_became_peered":"2024-04-25T10:04:30.251836+0000","last_unstale":"2024-04-25T10:04:30.259642+0000","last_undegraded":"2024-04-25T10:04:30.259642+0000","last_fullsized":"2024-04-25T10:04:30.259642+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:27.545334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.255527+0000","last_change":"2024-04-25T10:04:30.252200+0000","last_active":"2024-04-25T10:04:30.255527+0000","last_peered":"2024-04-25T10:04:30.255527+0000","last_clean":"2024-04-25T10:04:30.255527+0000","last_became_active":"2024-04-25T10:04:30.251902+0000","last_became_peered":"2024-04-25T10:04:30.251902+0000","last_unstale":"2024-04-25T10:04:30.255527+0000","last_undegraded":"2024-04-25T10:04:30.255527+0000","last_fullsized":"2024-04-25T10:04:30.255527+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:45.747180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.235067+0000","last_change":"2024-04-25T10:04:29.235067+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.235067+0000","last_undegraded":"2024-04-25T10:04:29.235067+0000","last_fullsized":"2024-04-25T10:04:29.235067+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.234975+0000","last_change":"2024-04-25T10:04:29.234975+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.234975+0000","last_undegraded":"2024-04-25T10:04:29.234975+0000","last_fullsized":"2024-04-25T10:04:29.234975+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.236365+0000","last_change":"2024-04-25T10:04:29.236365+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.236365+0000","last_undegraded":"2024-04-25T10:04:29.236365+0000","last_fullsized":"2024-04-25T10:04:29.236365+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.260091+0000","last_change":"2024-04-25T10:04:30.256927+0000","last_active":"2024-04-25T10:04:30.260091+0000","last_peered":"2024-04-25T10:04:30.260091+0000","last_clean":"2024-04-25T10:04:30.260091+0000","last_became_active":"2024-04-25T10:04:30.255115+0000","last_became_peered":"2024-04-25T10:04:30.255115+0000","last_unstale":"2024-04-25T10:04:30.260091+0000","last_undegraded":"2024-04-25T10:04:30.260091+0000","last_fullsized":"2024-04-25T10:04:30.260091+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:00.553092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.236981+0000","last_change":"2024-04-25T10:04:29.236981+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.236981+0000","last_undegraded":"2024-04-25T10:04:29.236981+0000","last_fullsized":"2024-04-25T10:04:29.236981+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.249732+0000","last_change":"2024-04-25T10:04:30.245678+0000","last_active":"2024-04-25T10:04:30.249732+0000","last_peered":"2024-04-25T10:04:30.249732+0000","last_clean":"2024-04-25T10:04:30.249732+0000","last_became_active":"2024-04-25T10:04:30.245363+0000","last_became_peered":"2024-04-25T10:04:30.245363+0000","last_unstale":"2024-04-25T10:04:30.249732+0000","last_undegraded":"2024-04-25T10:04:30.249732+0000","last_fullsized":"2024-04-25T10:04:30.249732+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:18.944449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.234165+0000","last_change":"2024-04-25T10:04:29.234165+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.234165+0000","last_undegraded":"2024-04-25T10:04:29.234165+0000","last_fullsized":"2024-04-25T10:04:29.234165+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.235212+0000","last_change":"2024-04-25T10:04:29.235212+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.235212+0000","last_undegraded":"2024-04-25T10:04:29.235212+0000","last_fullsized":"2024-04-25T10:04:29.235212+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.236402+0000","last_change":"2024-04-25T10:04:29.236402+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.236402+0000","last_undegraded":"2024-04-25T10:04:29.236402+0000","last_fullsized":"2024-04-25T10:04:29.236402+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.249655+0000","last_change":"2024-04-25T10:04:30.246368+0000","last_active":"2024-04-25T10:04:30.249655+0000","last_peered":"2024-04-25T10:04:30.249655+0000","last_clean":"2024-04-25T10:04:30.249655+0000","last_became_active":"2024-04-25T10:04:30.246100+0000","last_became_peered":"2024-04-25T10:04:30.246100+0000","last_unstale":"2024-04-25T10:04:30.249655+0000","last_undegraded":"2024-04-25T10:04:30.249655+0000","last_fullsized":"2024-04-25T10:04:30.249655+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:42.155245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.234378+0000","last_change":"2024-04-25T10:04:29.234378+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.234378+0000","last_undegraded":"2024-04-25T10:04:29.234378+0000","last_fullsized":"2024-04-25T10:04:29.234378+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.235759+0000","last_change":"2024-04-25T10:04:29.235759+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.235759+0000","last_undegraded":"2024-04-25T10:04:29.235759+0000","last_fullsized":"2024-04-25T10:04:29.235759+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.235878+0000","last_change":"2024-04-25T10:04:29.235878+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.235878+0000","last_undegraded":"2024-04-25T10:04:29.235878+0000","last_fullsized":"2024-04-25T10:04:29.235878+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.258074+0000","last_change":"2024-04-25T10:04:30.254496+0000","last_active":"2024-04-25T10:04:30.258074+0000","last_peered":"2024-04-25T10:04:30.258074+0000","last_clean":"2024-04-25T10:04:30.258074+0000","last_became_active":"2024-04-25T10:04:30.254205+0000","last_became_peered":"2024-04-25T10:04:30.254205+0000","last_unstale":"2024-04-25T10:04:30.258074+0000","last_undegraded":"2024-04-25T10:04:30.258074+0000","last_fullsized":"2024-04-25T10:04:30.258074+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:42.155245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.237396+0000","last_change":"2024-04-25T10:04:29.237396+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.237396+0000","last_undegraded":"2024-04-25T10:04:29.237396+0000","last_fullsized":"2024-04-25T10:04:29.237396+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.260054+0000","last_change":"2024-04-25T10:04:30.256744+0000","last_active":"2024-04-25T10:04:30.260054+0000","last_peered":"2024-04-25T10:04:30.260054+0000","last_clean":"2024-04-25T10:04:30.260054+0000","last_became_active":"2024-04-25T10:04:30.256064+0000","last_became_peered":"2024-04-25T10:04:30.256064+0000","last_unstale":"2024-04-25T10:04:30.260054+0000","last_undegraded":"2024-04-25T10:04:30.260054+0000","last_fullsized":"2024-04-25T10:04:30.260054+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:01.357667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.249612+0000","last_change":"2024-04-25T10:04:30.244355+0000","last_active":"2024-04-25T10:04:30.249612+0000","last_peered":"2024-04-25T10:04:30.249612+0000","last_clean":"2024-04-25T10:04:30.249612+0000","last_became_active":"2024-04-25T10:04:30.244028+0000","last_became_peered":"2024-04-25T10:04:30.244028+0000","last_unstale":"2024-04-25T10:04:30.249612+0000","last_undegraded":"2024-04-25T10:04:30.249612+0000","last_fullsized":"2024-04-25T10:04:30.249612+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:27.281210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.259695+0000","last_change":"2024-04-25T10:04:30.253400+0000","last_active":"2024-04-25T10:04:30.259695+0000","last_peered":"2024-04-25T10:04:30.259695+0000","last_clean":"2024-04-25T10:04:30.259695+0000","last_became_active":"2024-04-25T10:04:30.253118+0000","last_became_peered":"2024-04-25T10:04:30.253118+0000","last_unstale":"2024-04-25T10:04:30.259695+0000","last_undegraded":"2024-04-25T10:04:30.259695+0000","last_fullsized":"2024-04-25T10:04:30.259695+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:24.510668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.259100+0000","last_change":"2024-04-25T10:04:30.258434+0000","last_active":"2024-04-25T10:04:30.259100+0000","last_peered":"2024-04-25T10:04:30.259100+0000","last_clean":"2024-04-25T10:04:30.259100+0000","last_became_active":"2024-04-25T10:04:30.258149+0000","last_became_peered":"2024-04-25T10:04:30.258149+0000","last_unstale":"2024-04-25T10:04:30.259100+0000","last_undegraded":"2024-04-25T10:04:30.259100+0000","last_fullsized":"2024-04-25T10:04:30.259100+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:29.764075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.255118+0000","last_change":"2024-04-25T10:04:30.248070+0000","last_active":"2024-04-25T10:04:30.255118+0000","last_peered":"2024-04-25T10:04:30.255118+0000","last_clean":"2024-04-25T10:04:30.255118+0000","last_became_active":"2024-04-25T10:04:30.247788+0000","last_became_peered":"2024-04-25T10:04:30.247788+0000","last_unstale":"2024-04-25T10:04:30.255118+0000","last_undegraded":"2024-04-25T10:04:30.255118+0000","last_fullsized":"2024-04-25T10:04:30.255118+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:34.725496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.237563+0000","last_change":"2024-04-25T10:04:29.237563+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.237563+0000","last_undegraded":"2024-04-25T10:04:29.237563+0000","last_fullsized":"2024-04-25T10:04:29.237563+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.258051+0000","last_change":"2024-04-25T10:04:30.254462+0000","last_active":"2024-04-25T10:04:30.258051+0000","last_peered":"2024-04-25T10:04:30.258051+0000","last_clean":"2024-04-25T10:04:30.258051+0000","last_became_active":"2024-04-25T10:04:30.253993+0000","last_became_peered":"2024-04-25T10:04:30.253993+0000","last_unstale":"2024-04-25T10:04:30.258051+0000","last_undegraded":"2024-04-25T10:04:30.258051+0000","last_fullsized":"2024-04-25T10:04:30.258051+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:18.944449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.232701+0000","last_change":"2024-04-25T10:04:29.232701+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.232701+0000","last_undegraded":"2024-04-25T10:04:29.232701+0000","last_fullsized":"2024-04-25T10:04:29.232701+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.239225+0000","last_change":"2024-04-25T10:04:29.239225+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.239225+0000","last_undegraded":"2024-04-25T10:04:29.239225+0000","last_fullsized":"2024-04-25T10:04:29.239225+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.234215+0000","last_change":"2024-04-25T10:04:29.234215+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.234215+0000","last_undegraded":"2024-04-25T10:04:29.234215+0000","last_fullsized":"2024-04-25T10:04:29.234215+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.254755+0000","last_change":"2024-04-25T10:04:30.245661+0000","last_active":"2024-04-25T10:04:30.254755+0000","last_peered":"2024-04-25T10:04:30.254755+0000","last_clean":"2024-04-25T10:04:30.254755+0000","last_became_active":"2024-04-25T10:04:30.245371+0000","last_became_peered":"2024-04-25T10:04:30.245371+0000","last_unstale":"2024-04-25T10:04:30.254755+0000","last_undegraded":"2024-04-25T10:04:30.254755+0000","last_fullsized":"2024-04-25T10:04:30.254755+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:25.171859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.259079+0000","last_change":"2024-04-25T10:04:30.258292+0000","last_active":"2024-04-25T10:04:30.259079+0000","last_peered":"2024-04-25T10:04:30.259079+0000","last_clean":"2024-04-25T10:04:30.259079+0000","last_became_active":"2024-04-25T10:04:30.257766+0000","last_became_peered":"2024-04-25T10:04:30.257766+0000","last_unstale":"2024-04-25T10:04:30.259079+0000","last_undegraded":"2024-04-25T10:04:30.259079+0000","last_fullsized":"2024-04-25T10:04:30.259079+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:29.684144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.234675+0000","last_change":"2024-04-25T10:04:29.234675+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.234675+0000","last_undegraded":"2024-04-25T10:04:29.234675+0000","last_fullsized":"2024-04-25T10:04:29.234675+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"116'4","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.261309+0000","last_change":"2024-04-25T10:04:29.246635+0000","last_active":"2024-04-25T10:04:30.261309+0000","last_peered":"2024-04-25T10:04:30.261309+0000","last_clean":"2024-04-25T10:04:30.261309+0000","last_became_active":"2024-04-25T10:04:29.246149+0000","last_became_peered":"2024-04-25T10:04:29.246149+0000","last_unstale":"2024-04-25T10:04:30.261309+0000","last_undegraded":"2024-04-25T10:04:30.261309+0000","last_fullsized":"2024-04-25T10:04:30.261309+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:54.240491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233189+0000","last_change":"2024-04-25T10:04:29.233189+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233189+0000","last_undegraded":"2024-04-25T10:04:29.233189+0000","last_fullsized":"2024-04-25T10:04:29.233189+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.242837+0000","last_change":"2024-04-25T10:04:29.241014+0000","last_active":"2024-04-25T10:04:29.242837+0000","last_peered":"2024-04-25T10:04:29.242837+0000","last_clean":"2024-04-25T10:04:29.242837+0000","last_became_active":"2024-04-25T10:04:29.240747+0000","last_became_peered":"2024-04-25T10:04:29.240747+0000","last_unstale":"2024-04-25T10:04:29.242837+0000","last_undegraded":"2024-04-25T10:04:29.242837+0000","last_fullsized":"2024-04-25T10:04:29.242837+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:05.633007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.259127+0000","last_change":"2024-04-25T10:04:30.258097+0000","last_active":"2024-04-25T10:04:30.259127+0000","last_peered":"2024-04-25T10:04:30.259127+0000","last_clean":"2024-04-25T10:04:30.259127+0000","last_became_active":"2024-04-25T10:04:30.257788+0000","last_became_peered":"2024-04-25T10:04:30.257788+0000","last_unstale":"2024-04-25T10:04:30.259127+0000","last_undegraded":"2024-04-25T10:04:30.259127+0000","last_fullsized":"2024-04-25T10:04:30.259127+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:46:54.349361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"116'2","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.263266+0000","last_change":"2024-04-25T10:04:29.247462+0000","last_active":"2024-04-25T10:04:30.263266+0000","last_peered":"2024-04-25T10:04:30.263266+0000","last_clean":"2024-04-25T10:04:30.263266+0000","last_became_active":"2024-04-25T10:04:29.247192+0000","last_became_peered":"2024-04-25T10:04:29.247192+0000","last_unstale":"2024-04-25T10:04:30.263266+0000","last_undegraded":"2024-04-25T10:04:30.263266+0000","last_fullsized":"2024-04-25T10:04:30.263266+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:17.577585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.263922+0000","last_change":"2024-04-25T10:04:30.263430+0000","last_active":"2024-04-25T10:04:30.263922+0000","last_peered":"2024-04-25T10:04:30.263922+0000","last_clean":"2024-04-25T10:04:30.263922+0000","last_became_active":"2024-04-25T10:04:30.263105+0000","last_became_peered":"2024-04-25T10:04:30.263105+0000","last_unstale":"2024-04-25T10:04:30.263922+0000","last_undegraded":"2024-04-25T10:04:30.263922+0000","last_fullsized":"2024-04-25T10:04:30.263922+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:48.104630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.242829+0000","last_change":"2024-04-25T10:04:29.240963+0000","last_active":"2024-04-25T10:04:29.242829+0000","last_peered":"2024-04-25T10:04:29.242829+0000","last_clean":"2024-04-25T10:04:29.242829+0000","last_became_active":"2024-04-25T10:04:29.240676+0000","last_became_peered":"2024-04-25T10:04:29.240676+0000","last_unstale":"2024-04-25T10:04:29.242829+0000","last_undegraded":"2024-04-25T10:04:29.242829+0000","last_fullsized":"2024-04-25T10:04:29.242829+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:16.035459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233038+0000","last_change":"2024-04-25T10:04:29.233038+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233038+0000","last_undegraded":"2024-04-25T10:04:29.233038+0000","last_fullsized":"2024-04-25T10:04:29.233038+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"116'1","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.258625+0000","last_change":"2024-04-25T10:04:29.245168+0000","last_active":"2024-04-25T10:04:30.258625+0000","last_peered":"2024-04-25T10:04:30.258625+0000","last_clean":"2024-04-25T10:04:30.258625+0000","last_became_active":"2024-04-25T10:04:29.244887+0000","last_became_peered":"2024-04-25T10:04:29.244887+0000","last_unstale":"2024-04-25T10:04:30.258625+0000","last_undegraded":"2024-04-25T10:04:30.258625+0000","last_fullsized":"2024-04-25T10:04:30.258625+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:05.046287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.254402+0000","last_change":"2024-04-25T10:04:30.249301+0000","last_active":"2024-04-25T10:04:30.254402+0000","last_peered":"2024-04-25T10:04:30.254402+0000","last_clean":"2024-04-25T10:04:30.254402+0000","last_became_active":"2024-04-25T10:04:30.249015+0000","last_became_peered":"2024-04-25T10:04:30.249015+0000","last_unstale":"2024-04-25T10:04:30.254402+0000","last_undegraded":"2024-04-25T10:04:30.254402+0000","last_fullsized":"2024-04-25T10:04:30.254402+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:10.060231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.246412+0000","last_change":"2024-04-25T10:04:29.242148+0000","last_active":"2024-04-25T10:04:29.246412+0000","last_peered":"2024-04-25T10:04:29.246412+0000","last_clean":"2024-04-25T10:04:29.246412+0000","last_became_active":"2024-04-25T10:04:29.241863+0000","last_became_peered":"2024-04-25T10:04:29.241863+0000","last_unstale":"2024-04-25T10:04:29.246412+0000","last_undegraded":"2024-04-25T10:04:29.246412+0000","last_fullsized":"2024-04-25T10:04:29.246412+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:17.686544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233732+0000","last_change":"2024-04-25T10:04:29.233732+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233732+0000","last_undegraded":"2024-04-25T10:04:29.233732+0000","last_fullsized":"2024-04-25T10:04:29.233732+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.239530+0000","last_change":"2024-04-25T10:04:29.245895+0000","last_active":"2024-04-25T10:04:30.239530+0000","last_peered":"2024-04-25T10:04:30.239530+0000","last_clean":"2024-04-25T10:04:30.239530+0000","last_became_active":"2024-04-25T10:04:29.245618+0000","last_became_peered":"2024-04-25T10:04:29.245618+0000","last_unstale":"2024-04-25T10:04:30.239530+0000","last_undegraded":"2024-04-25T10:04:30.239530+0000","last_fullsized":"2024-04-25T10:04:30.239530+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:41.138715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.234123+0000","last_change":"2024-04-25T10:04:29.234123+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.234123+0000","last_undegraded":"2024-04-25T10:04:29.234123+0000","last_fullsized":"2024-04-25T10:04:29.234123+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.246459+0000","last_change":"2024-04-25T10:04:29.243321+0000","last_active":"2024-04-25T10:04:29.246459+0000","last_peered":"2024-04-25T10:04:29.246459+0000","last_clean":"2024-04-25T10:04:29.246459+0000","last_became_active":"2024-04-25T10:04:29.242993+0000","last_became_peered":"2024-04-25T10:04:29.242993+0000","last_unstale":"2024-04-25T10:04:29.246459+0000","last_undegraded":"2024-04-25T10:04:29.246459+0000","last_fullsized":"2024-04-25T10:04:29.246459+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:46.144168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.260114+0000","last_change":"2024-04-25T10:04:30.259351+0000","last_active":"2024-04-25T10:04:30.260114+0000","last_peered":"2024-04-25T10:04:30.260114+0000","last_clean":"2024-04-25T10:04:30.260114+0000","last_became_active":"2024-04-25T10:04:30.259032+0000","last_became_peered":"2024-04-25T10:04:30.259032+0000","last_unstale":"2024-04-25T10:04:30.260114+0000","last_undegraded":"2024-04-25T10:04:30.260114+0000","last_fullsized":"2024-04-25T10:04:30.260114+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:10.060231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.245980+0000","last_change":"2024-04-25T10:04:29.249960+0000","last_active":"2024-04-25T10:04:30.245980+0000","last_peered":"2024-04-25T10:04:30.245980+0000","last_clean":"2024-04-25T10:04:30.245980+0000","last_became_active":"2024-04-25T10:04:29.249622+0000","last_became_peered":"2024-04-25T10:04:29.249622+0000","last_unstale":"2024-04-25T10:04:30.245980+0000","last_undegraded":"2024-04-25T10:04:30.245980+0000","last_fullsized":"2024-04-25T10:04:30.245980+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:26.264680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.257314+0000","last_change":"2024-04-25T10:04:30.254839+0000","last_active":"2024-04-25T10:04:30.257314+0000","last_peered":"2024-04-25T10:04:30.257314+0000","last_clean":"2024-04-25T10:04:30.257314+0000","last_became_active":"2024-04-25T10:04:30.252585+0000","last_became_peered":"2024-04-25T10:04:30.252585+0000","last_unstale":"2024-04-25T10:04:30.257314+0000","last_undegraded":"2024-04-25T10:04:30.257314+0000","last_fullsized":"2024-04-25T10:04:30.257314+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:03.353003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.237470+0000","last_change":"2024-04-25T10:04:29.245786+0000","last_active":"2024-04-25T10:04:30.237470+0000","last_peered":"2024-04-25T10:04:30.237470+0000","last_clean":"2024-04-25T10:04:30.237470+0000","last_became_active":"2024-04-25T10:04:29.245467+0000","last_became_peered":"2024-04-25T10:04:29.245467+0000","last_unstale":"2024-04-25T10:04:30.237470+0000","last_undegraded":"2024-04-25T10:04:30.237470+0000","last_fullsized":"2024-04-25T10:04:30.237470+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:17.927919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233329+0000","last_change":"2024-04-25T10:04:29.233329+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233329+0000","last_undegraded":"2024-04-25T10:04:29.233329+0000","last_fullsized":"2024-04-25T10:04:29.233329+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"116'3","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.257027+0000","last_change":"2024-04-25T10:04:29.248775+0000","last_active":"2024-04-25T10:04:30.257027+0000","last_peered":"2024-04-25T10:04:30.257027+0000","last_clean":"2024-04-25T10:04:30.257027+0000","last_became_active":"2024-04-25T10:04:29.248484+0000","last_became_peered":"2024-04-25T10:04:29.248484+0000","last_unstale":"2024-04-25T10:04:30.257027+0000","last_undegraded":"2024-04-25T10:04:30.257027+0000","last_fullsized":"2024-04-25T10:04:30.257027+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:09.043701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.254777+0000","last_change":"2024-04-25T10:04:30.246946+0000","last_active":"2024-04-25T10:04:30.254777+0000","last_peered":"2024-04-25T10:04:30.254777+0000","last_clean":"2024-04-25T10:04:30.254777+0000","last_became_active":"2024-04-25T10:04:30.246636+0000","last_became_peered":"2024-04-25T10:04:30.246636+0000","last_unstale":"2024-04-25T10:04:30.254777+0000","last_undegraded":"2024-04-25T10:04:30.254777+0000","last_fullsized":"2024-04-25T10:04:30.254777+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:13.746169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.249491+0000","last_change":"2024-04-25T10:04:29.248492+0000","last_active":"2024-04-25T10:04:29.249491+0000","last_peered":"2024-04-25T10:04:29.249491+0000","last_clean":"2024-04-25T10:04:29.249491+0000","last_became_active":"2024-04-25T10:04:29.248184+0000","last_became_peered":"2024-04-25T10:04:29.248184+0000","last_unstale":"2024-04-25T10:04:29.249491+0000","last_undegraded":"2024-04-25T10:04:29.249491+0000","last_fullsized":"2024-04-25T10:04:29.249491+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:40.143885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.257574+0000","last_change":"2024-04-25T10:04:30.252044+0000","last_active":"2024-04-25T10:04:30.257574+0000","last_peered":"2024-04-25T10:04:30.257574+0000","last_clean":"2024-04-25T10:04:30.257574+0000","last_became_active":"2024-04-25T10:04:30.251299+0000","last_became_peered":"2024-04-25T10:04:30.251299+0000","last_unstale":"2024-04-25T10:04:30.257574+0000","last_undegraded":"2024-04-25T10:04:30.257574+0000","last_fullsized":"2024-04-25T10:04:30.257574+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:42.340536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.247504+0000","last_change":"2024-04-25T10:04:29.246443+0000","last_active":"2024-04-25T10:04:29.247504+0000","last_peered":"2024-04-25T10:04:29.247504+0000","last_clean":"2024-04-25T10:04:29.247504+0000","last_became_active":"2024-04-25T10:04:29.245766+0000","last_became_peered":"2024-04-25T10:04:29.245766+0000","last_unstale":"2024-04-25T10:04:29.247504+0000","last_undegraded":"2024-04-25T10:04:29.247504+0000","last_fullsized":"2024-04-25T10:04:29.247504+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:20.061436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.231839+0000","last_change":"2024-04-25T10:04:29.231839+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.231839+0000","last_undegraded":"2024-04-25T10:04:29.231839+0000","last_fullsized":"2024-04-25T10:04:29.231839+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.243738+0000","last_change":"2024-04-25T10:04:29.242805+0000","last_active":"2024-04-25T10:04:29.243738+0000","last_peered":"2024-04-25T10:04:29.243738+0000","last_clean":"2024-04-25T10:04:29.243738+0000","last_became_active":"2024-04-25T10:04:29.242435+0000","last_became_peered":"2024-04-25T10:04:29.242435+0000","last_unstale":"2024-04-25T10:04:29.243738+0000","last_undegraded":"2024-04-25T10:04:29.243738+0000","last_fullsized":"2024-04-25T10:04:29.243738+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:41.297407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.237096+0000","last_change":"2024-04-25T10:04:29.237096+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.237096+0000","last_undegraded":"2024-04-25T10:04:29.237096+0000","last_fullsized":"2024-04-25T10:04:29.237096+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.247541+0000","last_change":"2024-04-25T10:04:29.245970+0000","last_active":"2024-04-25T10:04:29.247541+0000","last_peered":"2024-04-25T10:04:29.247541+0000","last_clean":"2024-04-25T10:04:29.247541+0000","last_became_active":"2024-04-25T10:04:29.245667+0000","last_became_peered":"2024-04-25T10:04:29.245667+0000","last_unstale":"2024-04-25T10:04:29.247541+0000","last_undegraded":"2024-04-25T10:04:29.247541+0000","last_fullsized":"2024-04-25T10:04:29.247541+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:05.642908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.255484+0000","last_change":"2024-04-25T10:04:30.251298+0000","last_active":"2024-04-25T10:04:30.255484+0000","last_peered":"2024-04-25T10:04:30.255484+0000","last_clean":"2024-04-25T10:04:30.255484+0000","last_became_active":"2024-04-25T10:04:30.251021+0000","last_became_peered":"2024-04-25T10:04:30.251021+0000","last_unstale":"2024-04-25T10:04:30.255484+0000","last_undegraded":"2024-04-25T10:04:30.255484+0000","last_fullsized":"2024-04-25T10:04:30.255484+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:56:46.072939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.250581+0000","last_change":"2024-04-25T10:04:29.247771+0000","last_active":"2024-04-25T10:04:29.250581+0000","last_peered":"2024-04-25T10:04:29.250581+0000","last_clean":"2024-04-25T10:04:29.250581+0000","last_became_active":"2024-04-25T10:04:29.247178+0000","last_became_peered":"2024-04-25T10:04:29.247178+0000","last_unstale":"2024-04-25T10:04:29.250581+0000","last_undegraded":"2024-04-25T10:04:29.250581+0000","last_fullsized":"2024-04-25T10:04:29.250581+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:11.594481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.249711+0000","last_change":"2024-04-25T10:04:30.244889+0000","last_active":"2024-04-25T10:04:30.249711+0000","last_peered":"2024-04-25T10:04:30.249711+0000","last_clean":"2024-04-25T10:04:30.249711+0000","last_became_active":"2024-04-25T10:04:30.244564+0000","last_became_peered":"2024-04-25T10:04:30.244564+0000","last_unstale":"2024-04-25T10:04:30.249711+0000","last_undegraded":"2024-04-25T10:04:30.249711+0000","last_fullsized":"2024-04-25T10:04:30.249711+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:42.340536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.251342+0000","last_change":"2024-04-25T10:04:29.250738+0000","last_active":"2024-04-25T10:04:29.251342+0000","last_peered":"2024-04-25T10:04:29.251342+0000","last_clean":"2024-04-25T10:04:29.251342+0000","last_became_active":"2024-04-25T10:04:29.250437+0000","last_became_peered":"2024-04-25T10:04:29.250437+0000","last_unstale":"2024-04-25T10:04:29.251342+0000","last_undegraded":"2024-04-25T10:04:29.251342+0000","last_fullsized":"2024-04-25T10:04:29.251342+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:21.563376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233660+0000","last_change":"2024-04-25T10:04:29.233660+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233660+0000","last_undegraded":"2024-04-25T10:04:29.233660+0000","last_fullsized":"2024-04-25T10:04:29.233660+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"116'1","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.259833+0000","last_change":"2024-04-25T10:04:29.246631+0000","last_active":"2024-04-25T10:04:30.259833+0000","last_peered":"2024-04-25T10:04:30.259833+0000","last_clean":"2024-04-25T10:04:30.259833+0000","last_became_active":"2024-04-25T10:04:29.246207+0000","last_became_peered":"2024-04-25T10:04:29.246207+0000","last_unstale":"2024-04-25T10:04:30.259833+0000","last_undegraded":"2024-04-25T10:04:30.259833+0000","last_fullsized":"2024-04-25T10:04:30.259833+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:07.897567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.255141+0000","last_change":"2024-04-25T10:04:30.250282+0000","last_active":"2024-04-25T10:04:30.255141+0000","last_peered":"2024-04-25T10:04:30.255141+0000","last_clean":"2024-04-25T10:04:30.255141+0000","last_became_active":"2024-04-25T10:04:30.250001+0000","last_became_peered":"2024-04-25T10:04:30.250001+0000","last_unstale":"2024-04-25T10:04:30.255141+0000","last_undegraded":"2024-04-25T10:04:30.255141+0000","last_fullsized":"2024-04-25T10:04:30.255141+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:16.033392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.239824+0000","last_change":"2024-04-25T10:04:29.251151+0000","last_active":"2024-04-25T10:04:30.239824+0000","last_peered":"2024-04-25T10:04:30.239824+0000","last_clean":"2024-04-25T10:04:30.239824+0000","last_became_active":"2024-04-25T10:04:29.250830+0000","last_became_peered":"2024-04-25T10:04:29.250830+0000","last_unstale":"2024-04-25T10:04:30.239824+0000","last_undegraded":"2024-04-25T10:04:30.239824+0000","last_fullsized":"2024-04-25T10:04:30.239824+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:05.642908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233970+0000","last_change":"2024-04-25T10:04:29.233970+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233970+0000","last_undegraded":"2024-04-25T10:04:29.233970+0000","last_fullsized":"2024-04-25T10:04:29.233970+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.250438+0000","last_change":"2024-04-25T10:04:29.249278+0000","last_active":"2024-04-25T10:04:29.250438+0000","last_peered":"2024-04-25T10:04:29.250438+0000","last_clean":"2024-04-25T10:04:29.250438+0000","last_became_active":"2024-04-25T10:04:29.248937+0000","last_became_peered":"2024-04-25T10:04:29.248937+0000","last_unstale":"2024-04-25T10:04:29.250438+0000","last_undegraded":"2024-04-25T10:04:29.250438+0000","last_fullsized":"2024-04-25T10:04:29.250438+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:46.692405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.232377+0000","last_change":"2024-04-25T10:04:29.232377+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.232377+0000","last_undegraded":"2024-04-25T10:04:29.232377+0000","last_fullsized":"2024-04-25T10:04:29.232377+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.241267+0000","last_change":"2024-04-25T10:04:29.249318+0000","last_active":"2024-04-25T10:04:30.241267+0000","last_peered":"2024-04-25T10:04:30.241267+0000","last_clean":"2024-04-25T10:04:30.241267+0000","last_became_active":"2024-04-25T10:04:29.249041+0000","last_became_peered":"2024-04-25T10:04:29.249041+0000","last_unstale":"2024-04-25T10:04:30.241267+0000","last_undegraded":"2024-04-25T10:04:30.241267+0000","last_fullsized":"2024-04-25T10:04:30.241267+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:43.133631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.232853+0000","last_change":"2024-04-25T10:04:29.232853+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.232853+0000","last_undegraded":"2024-04-25T10:04:29.232853+0000","last_fullsized":"2024-04-25T10:04:29.232853+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.243702+0000","last_change":"2024-04-25T10:04:29.239923+0000","last_active":"2024-04-25T10:04:29.243702+0000","last_peered":"2024-04-25T10:04:29.243702+0000","last_clean":"2024-04-25T10:04:29.243702+0000","last_became_active":"2024-04-25T10:04:29.239005+0000","last_became_peered":"2024-04-25T10:04:29.239005+0000","last_unstale":"2024-04-25T10:04:29.243702+0000","last_undegraded":"2024-04-25T10:04:29.243702+0000","last_fullsized":"2024-04-25T10:04:29.243702+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:28.667614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.254902+0000","last_change":"2024-04-25T10:04:30.246887+0000","last_active":"2024-04-25T10:04:30.254902+0000","last_peered":"2024-04-25T10:04:30.254902+0000","last_clean":"2024-04-25T10:04:30.254902+0000","last_became_active":"2024-04-25T10:04:30.246594+0000","last_became_peered":"2024-04-25T10:04:30.246594+0000","last_unstale":"2024-04-25T10:04:30.254902+0000","last_undegraded":"2024-04-25T10:04:30.254902+0000","last_fullsized":"2024-04-25T10:04:30.254902+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:36.697245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.240011+0000","last_change":"2024-04-25T10:04:29.246354+0000","last_active":"2024-04-25T10:04:30.240011+0000","last_peered":"2024-04-25T10:04:30.240011+0000","last_clean":"2024-04-25T10:04:30.240011+0000","last_became_active":"2024-04-25T10:04:29.245722+0000","last_became_peered":"2024-04-25T10:04:29.245722+0000","last_unstale":"2024-04-25T10:04:30.240011+0000","last_undegraded":"2024-04-25T10:04:30.240011+0000","last_fullsized":"2024-04-25T10:04:30.240011+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:20.061436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.232192+0000","last_change":"2024-04-25T10:04:29.232192+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.232192+0000","last_undegraded":"2024-04-25T10:04:29.232192+0000","last_fullsized":"2024-04-25T10:04:29.232192+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.250424+0000","last_change":"2024-04-25T10:04:29.249571+0000","last_active":"2024-04-25T10:04:29.250424+0000","last_peered":"2024-04-25T10:04:29.250424+0000","last_clean":"2024-04-25T10:04:29.250424+0000","last_became_active":"2024-04-25T10:04:29.249244+0000","last_became_peered":"2024-04-25T10:04:29.249244+0000","last_unstale":"2024-04-25T10:04:29.250424+0000","last_undegraded":"2024-04-25T10:04:29.250424+0000","last_fullsized":"2024-04-25T10:04:29.250424+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:20.360839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233326+0000","last_change":"2024-04-25T10:04:29.233326+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233326+0000","last_undegraded":"2024-04-25T10:04:29.233326+0000","last_fullsized":"2024-04-25T10:04:29.233326+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.243588+0000","last_change":"2024-04-25T10:04:29.247101+0000","last_active":"2024-04-25T10:04:30.243588+0000","last_peered":"2024-04-25T10:04:30.243588+0000","last_clean":"2024-04-25T10:04:30.243588+0000","last_became_active":"2024-04-25T10:04:29.246778+0000","last_became_peered":"2024-04-25T10:04:29.246778+0000","last_unstale":"2024-04-25T10:04:30.243588+0000","last_undegraded":"2024-04-25T10:04:30.243588+0000","last_fullsized":"2024-04-25T10:04:30.243588+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:48.371611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.259969+0000","last_change":"2024-04-25T10:04:30.255411+0000","last_active":"2024-04-25T10:04:30.259969+0000","last_peered":"2024-04-25T10:04:30.259969+0000","last_clean":"2024-04-25T10:04:30.259969+0000","last_became_active":"2024-04-25T10:04:30.255122+0000","last_became_peered":"2024-04-25T10:04:30.255122+0000","last_unstale":"2024-04-25T10:04:30.259969+0000","last_undegraded":"2024-04-25T10:04:30.259969+0000","last_fullsized":"2024-04-25T10:04:30.259969+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:40.380809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.245904+0000","last_change":"2024-04-25T10:04:29.249960+0000","last_active":"2024-04-25T10:04:30.245904+0000","last_peered":"2024-04-25T10:04:30.245904+0000","last_clean":"2024-04-25T10:04:30.245904+0000","last_became_active":"2024-04-25T10:04:29.249686+0000","last_became_peered":"2024-04-25T10:04:29.249686+0000","last_unstale":"2024-04-25T10:04:30.245904+0000","last_undegraded":"2024-04-25T10:04:30.245904+0000","last_fullsized":"2024-04-25T10:04:30.245904+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:14.946290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.237161+0000","last_change":"2024-04-25T10:04:29.237161+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.237161+0000","last_undegraded":"2024-04-25T10:04:29.237161+0000","last_fullsized":"2024-04-25T10:04:29.237161+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.246678+0000","last_change":"2024-04-25T10:04:29.243398+0000","last_active":"2024-04-25T10:04:29.246678+0000","last_peered":"2024-04-25T10:04:29.246678+0000","last_clean":"2024-04-25T10:04:29.246678+0000","last_became_active":"2024-04-25T10:04:29.243107+0000","last_became_peered":"2024-04-25T10:04:29.243107+0000","last_unstale":"2024-04-25T10:04:29.246678+0000","last_undegraded":"2024-04-25T10:04:29.246678+0000","last_fullsized":"2024-04-25T10:04:29.246678+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:07.262739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233545+0000","last_change":"2024-04-25T10:04:29.233545+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233545+0000","last_undegraded":"2024-04-25T10:04:29.233545+0000","last_fullsized":"2024-04-25T10:04:29.233545+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.234664+0000","last_change":"2024-04-25T10:04:29.248089+0000","last_active":"2024-04-25T10:04:30.234664+0000","last_peered":"2024-04-25T10:04:30.234664+0000","last_clean":"2024-04-25T10:04:30.234664+0000","last_became_active":"2024-04-25T10:04:29.247817+0000","last_became_peered":"2024-04-25T10:04:29.247817+0000","last_unstale":"2024-04-25T10:04:30.234664+0000","last_undegraded":"2024-04-25T10:04:30.234664+0000","last_fullsized":"2024-04-25T10:04:30.234664+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:48.371611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.231831+0000","last_change":"2024-04-25T10:04:29.231831+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.231831+0000","last_undegraded":"2024-04-25T10:04:29.231831+0000","last_fullsized":"2024-04-25T10:04:29.231831+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.234857+0000","last_change":"2024-04-25T10:04:29.247433+0000","last_active":"2024-04-25T10:04:30.234857+0000","last_peered":"2024-04-25T10:04:30.234857+0000","last_clean":"2024-04-25T10:04:30.234857+0000","last_became_active":"2024-04-25T10:04:29.247134+0000","last_became_peered":"2024-04-25T10:04:29.247134+0000","last_unstale":"2024-04-25T10:04:30.234857+0000","last_undegraded":"2024-04-25T10:04:30.234857+0000","last_fullsized":"2024-04-25T10:04:30.234857+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:54.240491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.263266+0000","last_change":"2024-04-25T10:04:30.262379+0000","last_active":"2024-04-25T10:04:30.263266+0000","last_peered":"2024-04-25T10:04:30.263266+0000","last_clean":"2024-04-25T10:04:30.263266+0000","last_became_active":"2024-04-25T10:04:30.262076+0000","last_became_peered":"2024-04-25T10:04:30.262076+0000","last_unstale":"2024-04-25T10:04:30.263266+0000","last_undegraded":"2024-04-25T10:04:30.263266+0000","last_fullsized":"2024-04-25T10:04:30.263266+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:12:17.828765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.249176+0000","last_change":"2024-04-25T10:04:29.244891+0000","last_active":"2024-04-25T10:04:29.249176+0000","last_peered":"2024-04-25T10:04:29.249176+0000","last_clean":"2024-04-25T10:04:29.249176+0000","last_became_active":"2024-04-25T10:04:29.244546+0000","last_became_peered":"2024-04-25T10:04:29.244546+0000","last_unstale":"2024-04-25T10:04:29.249176+0000","last_undegraded":"2024-04-25T10:04:29.249176+0000","last_fullsized":"2024-04-25T10:04:29.249176+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:18.154851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.232227+0000","last_change":"2024-04-25T10:04:29.232227+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.232227+0000","last_undegraded":"2024-04-25T10:04:29.232227+0000","last_fullsized":"2024-04-25T10:04:29.232227+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.240162+0000","last_change":"2024-04-25T10:04:29.246803+0000","last_active":"2024-04-25T10:04:30.240162+0000","last_peered":"2024-04-25T10:04:30.240162+0000","last_clean":"2024-04-25T10:04:30.240162+0000","last_became_active":"2024-04-25T10:04:29.246060+0000","last_became_peered":"2024-04-25T10:04:29.246060+0000","last_unstale":"2024-04-25T10:04:30.240162+0000","last_undegraded":"2024-04-25T10:04:30.240162+0000","last_fullsized":"2024-04-25T10:04:30.240162+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:40.143885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.260029+0000","last_change":"2024-04-25T10:04:30.256368+0000","last_active":"2024-04-25T10:04:30.260029+0000","last_peered":"2024-04-25T10:04:30.260029+0000","last_clean":"2024-04-25T10:04:30.260029+0000","last_became_active":"2024-04-25T10:04:30.255756+0000","last_became_peered":"2024-04-25T10:04:30.255756+0000","last_unstale":"2024-04-25T10:04:30.260029+0000","last_undegraded":"2024-04-25T10:04:30.260029+0000","last_fullsized":"2024-04-25T10:04:30.260029+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:51.787602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.244295+0000","last_change":"2024-04-25T10:04:29.240856+0000","last_active":"2024-04-25T10:04:29.244295+0000","last_peered":"2024-04-25T10:04:29.244295+0000","last_clean":"2024-04-25T10:04:29.244295+0000","last_became_active":"2024-04-25T10:04:29.240561+0000","last_became_peered":"2024-04-25T10:04:29.240561+0000","last_unstale":"2024-04-25T10:04:29.244295+0000","last_undegraded":"2024-04-25T10:04:29.244295+0000","last_fullsized":"2024-04-25T10:04:29.244295+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:28.747545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":347,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.240294+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T10:04:30.240294+0000","last_peered":"2024-04-25T10:04:30.240294+0000","last_clean":"2024-04-25T10:04:30.240294+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T10:04:30.240294+0000","last_undegraded":"2024-04-25T10:04:30.240294+0000","last_fullsized":"2024-04-25T10:04:30.240294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":742,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542270,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33184,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338656,"statfs":{"total":96636764160,"available":96602783744,"internally_reserved":0,"allocated":2052096,"data_stored":1262200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542270,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1445888,"data_stored":671638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542272,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1429504,"data_stored":663889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542269,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32600,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339240,"statfs":{"total":96636764160,"available":96603381760,"internally_reserved":0,"allocated":1454080,"data_stored":672668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574974,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1429504,"data_stored":663889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574974,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1417216,"data_stored":657222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574974,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1429504,"data_stored":663889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574974,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37320,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334520,"statfs":{"total":96636764160,"available":96598548480,"internally_reserved":0,"allocated":2023424,"data_stored":1254257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:04:33.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3e is not active+clean 2024-04-25T10:04:33.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.237330+0000', 'last_change': '2024-04-25T10:04:29.237330+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.237330+0000', 'last_undegraded': '2024-04-25T10:04:29.237330+0000', 'last_fullsized': '2024-04-25T10:04:29.237330+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:04:33.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3d is not active+clean 2024-04-25T10:04:33.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.236919+0000', 'last_change': '2024-04-25T10:04:29.236919+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.236919+0000', 'last_undegraded': '2024-04-25T10:04:29.236919+0000', 'last_fullsized': '2024-04-25T10:04:29.236919+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:04:33.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3a is not active+clean 2024-04-25T10:04:33.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.235067+0000', 'last_change': '2024-04-25T10:04:29.235067+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.235067+0000', 'last_undegraded': '2024-04-25T10:04:29.235067+0000', 'last_fullsized': '2024-04-25T10:04:29.235067+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:04:33.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.39 is not active+clean 2024-04-25T10:04:33.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.234975+0000', 'last_change': '2024-04-25T10:04:29.234975+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.234975+0000', 'last_undegraded': '2024-04-25T10:04:29.234975+0000', 'last_fullsized': '2024-04-25T10:04:29.234975+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:04:33.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.38 is not active+clean 2024-04-25T10:04:33.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.236365+0000', 'last_change': '2024-04-25T10:04:29.236365+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.236365+0000', 'last_undegraded': '2024-04-25T10:04:29.236365+0000', 'last_fullsized': '2024-04-25T10:04:29.236365+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:04:33.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.36 is not active+clean 2024-04-25T10:04:33.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.236981+0000', 'last_change': '2024-04-25T10:04:29.236981+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.236981+0000', 'last_undegraded': '2024-04-25T10:04:29.236981+0000', 'last_fullsized': '2024-04-25T10:04:29.236981+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T10:04:33.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.34 is not active+clean 2024-04-25T10:04:33.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.234165+0000', 'last_change': '2024-04-25T10:04:29.234165+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.234165+0000', 'last_undegraded': '2024-04-25T10:04:29.234165+0000', 'last_fullsized': '2024-04-25T10:04:29.234165+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:04:33.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.33 is not active+clean 2024-04-25T10:04:33.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.235212+0000', 'last_change': '2024-04-25T10:04:29.235212+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.235212+0000', 'last_undegraded': '2024-04-25T10:04:29.235212+0000', 'last_fullsized': '2024-04-25T10:04:29.235212+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T10:04:33.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.32 is not active+clean 2024-04-25T10:04:33.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.236402+0000', 'last_change': '2024-04-25T10:04:29.236402+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.236402+0000', 'last_undegraded': '2024-04-25T10:04:29.236402+0000', 'last_fullsized': '2024-04-25T10:04:29.236402+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:04:33.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.30 is not active+clean 2024-04-25T10:04:33.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.234378+0000', 'last_change': '2024-04-25T10:04:29.234378+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.234378+0000', 'last_undegraded': '2024-04-25T10:04:29.234378+0000', 'last_fullsized': '2024-04-25T10:04:29.234378+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:04:33.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2f is not active+clean 2024-04-25T10:04:33.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.235759+0000', 'last_change': '2024-04-25T10:04:29.235759+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.235759+0000', 'last_undegraded': '2024-04-25T10:04:29.235759+0000', 'last_fullsized': '2024-04-25T10:04:29.235759+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T10:04:33.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2e is not active+clean 2024-04-25T10:04:33.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.235878+0000', 'last_change': '2024-04-25T10:04:29.235878+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.235878+0000', 'last_undegraded': '2024-04-25T10:04:29.235878+0000', 'last_fullsized': '2024-04-25T10:04:29.235878+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:04:33.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2c is not active+clean 2024-04-25T10:04:33.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.237396+0000', 'last_change': '2024-04-25T10:04:29.237396+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.237396+0000', 'last_undegraded': '2024-04-25T10:04:29.237396+0000', 'last_fullsized': '2024-04-25T10:04:29.237396+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T10:04:33.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.26 is not active+clean 2024-04-25T10:04:33.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.237563+0000', 'last_change': '2024-04-25T10:04:29.237563+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.237563+0000', 'last_undegraded': '2024-04-25T10:04:29.237563+0000', 'last_fullsized': '2024-04-25T10:04:29.237563+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T10:04:33.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.24 is not active+clean 2024-04-25T10:04:33.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.232701+0000', 'last_change': '2024-04-25T10:04:29.232701+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.232701+0000', 'last_undegraded': '2024-04-25T10:04:29.232701+0000', 'last_fullsized': '2024-04-25T10:04:29.232701+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:04:33.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.23 is not active+clean 2024-04-25T10:04:33.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.239225+0000', 'last_change': '2024-04-25T10:04:29.239225+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.239225+0000', 'last_undegraded': '2024-04-25T10:04:29.239225+0000', 'last_fullsized': '2024-04-25T10:04:29.239225+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T10:04:33.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.22 is not active+clean 2024-04-25T10:04:33.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.234215+0000', 'last_change': '2024-04-25T10:04:29.234215+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.234215+0000', 'last_undegraded': '2024-04-25T10:04:29.234215+0000', 'last_fullsized': '2024-04-25T10:04:29.234215+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:04:33.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1c is not active+clean 2024-04-25T10:04:33.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.234675+0000', 'last_change': '2024-04-25T10:04:29.234675+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.234675+0000', 'last_undegraded': '2024-04-25T10:04:29.234675+0000', 'last_fullsized': '2024-04-25T10:04:29.234675+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T10:04:33.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1d is not active+clean 2024-04-25T10:04:33.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.233189+0000', 'last_change': '2024-04-25T10:04:29.233189+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.233189+0000', 'last_undegraded': '2024-04-25T10:04:29.233189+0000', 'last_fullsized': '2024-04-25T10:04:29.233189+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:04:33.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.18 is not active+clean 2024-04-25T10:04:33.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.233038+0000', 'last_change': '2024-04-25T10:04:29.233038+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.233038+0000', 'last_undegraded': '2024-04-25T10:04:29.233038+0000', 'last_fullsized': '2024-04-25T10:04:29.233038+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T10:04:33.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1a is not active+clean 2024-04-25T10:04:33.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.233732+0000', 'last_change': '2024-04-25T10:04:29.233732+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.233732+0000', 'last_undegraded': '2024-04-25T10:04:29.233732+0000', 'last_fullsized': '2024-04-25T10:04:29.233732+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:04:33.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1b is not active+clean 2024-04-25T10:04:33.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.234123+0000', 'last_change': '2024-04-25T10:04:29.234123+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.234123+0000', 'last_undegraded': '2024-04-25T10:04:29.234123+0000', 'last_fullsized': '2024-04-25T10:04:29.234123+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T10:04:33.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.16 is not active+clean 2024-04-25T10:04:33.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.233329+0000', 'last_change': '2024-04-25T10:04:29.233329+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.233329+0000', 'last_undegraded': '2024-04-25T10:04:29.233329+0000', 'last_fullsized': '2024-04-25T10:04:29.233329+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:04:33.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.11 is not active+clean 2024-04-25T10:04:33.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.231839+0000', 'last_change': '2024-04-25T10:04:29.231839+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.231839+0000', 'last_undegraded': '2024-04-25T10:04:29.231839+0000', 'last_fullsized': '2024-04-25T10:04:29.231839+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T10:04:33.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.12 is not active+clean 2024-04-25T10:04:33.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.237096+0000', 'last_change': '2024-04-25T10:04:29.237096+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.237096+0000', 'last_undegraded': '2024-04-25T10:04:29.237096+0000', 'last_fullsized': '2024-04-25T10:04:29.237096+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T10:04:33.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.e is not active+clean 2024-04-25T10:04:33.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.233660+0000', 'last_change': '2024-04-25T10:04:29.233660+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.233660+0000', 'last_undegraded': '2024-04-25T10:04:29.233660+0000', 'last_fullsized': '2024-04-25T10:04:29.233660+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:04:33.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.8 is not active+clean 2024-04-25T10:04:33.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.233970+0000', 'last_change': '2024-04-25T10:04:29.233970+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.233970+0000', 'last_undegraded': '2024-04-25T10:04:29.233970+0000', 'last_fullsized': '2024-04-25T10:04:29.233970+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:04:33.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.9 is not active+clean 2024-04-25T10:04:33.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.232377+0000', 'last_change': '2024-04-25T10:04:29.232377+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.232377+0000', 'last_undegraded': '2024-04-25T10:04:29.232377+0000', 'last_fullsized': '2024-04-25T10:04:29.232377+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:04:33.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.a is not active+clean 2024-04-25T10:04:33.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.232853+0000', 'last_change': '2024-04-25T10:04:29.232853+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.232853+0000', 'last_undegraded': '2024-04-25T10:04:29.232853+0000', 'last_fullsized': '2024-04-25T10:04:29.232853+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:04:33.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.4 is not active+clean 2024-04-25T10:04:33.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.232192+0000', 'last_change': '2024-04-25T10:04:29.232192+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.232192+0000', 'last_undegraded': '2024-04-25T10:04:29.232192+0000', 'last_fullsized': '2024-04-25T10:04:29.232192+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:04:33.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.5 is not active+clean 2024-04-25T10:04:33.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.233326+0000', 'last_change': '2024-04-25T10:04:29.233326+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.233326+0000', 'last_undegraded': '2024-04-25T10:04:29.233326+0000', 'last_fullsized': '2024-04-25T10:04:29.233326+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T10:04:33.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.7 is not active+clean 2024-04-25T10:04:33.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.237161+0000', 'last_change': '2024-04-25T10:04:29.237161+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.237161+0000', 'last_undegraded': '2024-04-25T10:04:29.237161+0000', 'last_fullsized': '2024-04-25T10:04:29.237161+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T10:04:33.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.0 is not active+clean 2024-04-25T10:04:33.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.233545+0000', 'last_change': '2024-04-25T10:04:29.233545+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.233545+0000', 'last_undegraded': '2024-04-25T10:04:29.233545+0000', 'last_fullsized': '2024-04-25T10:04:29.233545+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:04:33.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1 is not active+clean 2024-04-25T10:04:33.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.231831+0000', 'last_change': '2024-04-25T10:04:29.231831+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.231831+0000', 'last_undegraded': '2024-04-25T10:04:29.231831+0000', 'last_fullsized': '2024-04-25T10:04:29.231831+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:04:33.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3 is not active+clean 2024-04-25T10:04:33.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 115, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:04:29.232227+0000', 'last_change': '2024-04-25T10:04:29.232227+0000', 'last_active': '2024-04-25T10:04:29.215837+0000', 'last_peered': '2024-04-25T10:04:29.215837+0000', 'last_clean': '2024-04-25T10:04:29.215837+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:04:29.232227+0000', 'last_undegraded': '2024-04-25T10:04:29.232227+0000', 'last_fullsized': '2024-04-25T10:04:29.232227+0000', 'mapping_epoch': 115, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 115, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'last_clean_scrub_stamp': '2024-04-25T10:04:29.215837+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T10:04:33.950 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T10:04:34.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.074+0000 7f07607b0640 1 Processor -- start 2024-04-25T10:04:34.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.075+0000 7f07607b0640 1 -- start start 2024-04-25T10:04:34.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.075+0000 7f07607b0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07580b9580 0x7f07580d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:34.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.075+0000 7f07607b0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f07580d32e0 0x7f07580d0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:34.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.075+0000 7f07607b0640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07580d2240 con 0x7f075815dad0 2024-04-25T10:04:34.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.075+0000 7f07607b0640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07580b7990 con 0x7f07580d32e0 2024-04-25T10:04:34.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.075+0000 7f07607b0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07580d1fe0 con 0x7f07580b9580 2024-04-25T10:04:34.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.076+0000 7f075e54c640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f075815dad0 0x7f07580d18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39428/0 (socket says 172.21.15.7:39428) 2024-04-25T10:04:34.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.076+0000 7f075e54c640 1 -- 172.21.15.7:0/79098498 learned_addr learned my addr 172.21.15.7:0/79098498 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:34.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.076+0000 7f075dd4b640 1 --2- 172.21.15.7:0/79098498 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07580b9580 0x7f07580d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:34.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.076+0000 7f075ed4d640 1 --2- 172.21.15.7:0/79098498 >> v2:172.21.15.55:3300/0 conn(0x7f07580d32e0 0x7f07580d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:34.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.076+0000 7f075d54a640 1 -- 172.21.15.7:0/79098498 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2766426335 0 0) 0x7f07580d2240 con 0x7f075815dad0 2024-04-25T10:04:34.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.076+0000 7f075d54a640 1 -- 172.21.15.7:0/79098498 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0740003520 con 0x7f075815dad0 2024-04-25T10:04:34.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.076+0000 7f075d54a640 1 -- 172.21.15.7:0/79098498 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3656743907 0 0) 0x7f0740003520 con 0x7f075815dad0 2024-04-25T10:04:34.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.076+0000 7f075ed4d640 1 -- 172.21.15.7:0/79098498 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07580b9580 msgr2=0x7f07580d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:34.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.076+0000 7f075ed4d640 1 --2- 172.21.15.7:0/79098498 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07580b9580 0x7f07580d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:34.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.076+0000 7f075ed4d640 1 -- 172.21.15.7:0/79098498 >> v1:172.21.15.7:6789/0 conn(0x7f075815dad0 legacy=0x7f07580d18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:34.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.076+0000 7f075ed4d640 1 -- 172.21.15.7:0/79098498 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07580d2520 con 0x7f07580d32e0 2024-04-25T10:04:34.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.076+0000 7f075dd4b640 1 --2- 172.21.15.7:0/79098498 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07580b9580 0x7f07580d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:34.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.077+0000 7f075ed4d640 1 --2- 172.21.15.7:0/79098498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07580d32e0 0x7f07580d0780 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0748009d90 tx=0x7f074802a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4088d916aea68ccc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:34.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.077+0000 7f075d54a640 1 -- 172.21.15.7:0/79098498 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0750001670 con 0x7f07580d32e0 2024-04-25T10:04:34.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.077+0000 7f075d54a640 1 -- 172.21.15.7:0/79098498 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0748007540 con 0x7f07580d32e0 2024-04-25T10:04:34.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.077+0000 7f075d54a640 1 -- 172.21.15.7:0/79098498 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0748007910 con 0x7f07580d32e0 2024-04-25T10:04:34.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.078+0000 7f07607b0640 1 -- 172.21.15.7:0/79098498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07580d32e0 msgr2=0x7f07580d0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:34.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.078+0000 7f07607b0640 1 --2- 172.21.15.7:0/79098498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07580d32e0 0x7f07580d0780 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0748009d90 tx=0x7f074802a680 comp rx=0 tx=0).stop 2024-04-25T10:04:34.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.078+0000 7f07607b0640 1 -- 172.21.15.7:0/79098498 shutdown_connections 2024-04-25T10:04:34.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.078+0000 7f07607b0640 1 --2- 172.21.15.7:0/79098498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07580d32e0 0x7f07580d0780 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:34.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.078+0000 7f07607b0640 1 --2- 172.21.15.7:0/79098498 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07580b9580 0x7f07580d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:34.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.078+0000 7f07607b0640 1 -- 172.21.15.7:0/79098498 >> 172.21.15.7:0/79098498 conn(0x7f075806bfe0 msgr2=0x7f075806c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:34.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.078+0000 7f07607b0640 1 -- 172.21.15.7:0/79098498 shutdown_connections 2024-04-25T10:04:34.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.078+0000 7f07607b0640 1 -- 172.21.15.7:0/79098498 wait complete. 2024-04-25T10:04:34.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.079+0000 7f07607b0640 1 Processor -- start 2024-04-25T10:04:34.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.079+0000 7f07607b0640 1 -- start start 2024-04-25T10:04:34.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.080+0000 7f07607b0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07580b9580 0x7f075815b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:34.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.080+0000 7f07607b0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07580d32e0 0x7f07581f4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:34.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.080+0000 7f07607b0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f075815dad0 0x7f07581f6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:34.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.080+0000 7f07607b0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07580d2dc0 con 0x7f07580d32e0 2024-04-25T10:04:34.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.080+0000 7f07607b0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07580d2ae0 con 0x7f075815dad0 2024-04-25T10:04:34.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.080+0000 7f07607b0640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075815deb0 con 0x7f07580b9580 2024-04-25T10:04:34.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.080+0000 7f075dd4b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07580d32e0 0x7f07581f4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:34.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.080+0000 7f075dd4b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07580d32e0 0x7f07581f4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47718/0 (socket says 172.21.15.7:47718) 2024-04-25T10:04:34.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.080+0000 7f075dd4b640 1 -- 172.21.15.7:0/1192331350 learned_addr learned my addr 172.21.15.7:0/1192331350 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:34.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.080+0000 7f075e54c640 1 --2- 172.21.15.7:0/1192331350 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07580b9580 0x7f075815b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:34.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.080+0000 7f075ed4d640 1 --2- 172.21.15.7:0/1192331350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f075815dad0 0x7f07581f6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:34.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.080+0000 7f075dd4b640 1 -- 172.21.15.7:0/1192331350 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07580b9580 msgr2=0x7f075815b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:34.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.080+0000 7f075dd4b640 1 --2- 172.21.15.7:0/1192331350 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07580b9580 0x7f075815b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:34.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.080+0000 7f075dd4b640 1 -- 172.21.15.7:0/1192331350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f075815dad0 msgr2=0x7f07581f6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:34.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.080+0000 7f075dd4b640 1 --2- 172.21.15.7:0/1192331350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f075815dad0 0x7f07581f6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:34.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.080+0000 7f075dd4b640 1 -- 172.21.15.7:0/1192331350 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07581f3840 con 0x7f07580d32e0 2024-04-25T10:04:34.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.080+0000 7f075ed4d640 1 --2- 172.21.15.7:0/1192331350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f075815dad0 0x7f07581f6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:34.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.080+0000 7f075e54c640 1 --2- 172.21.15.7:0/1192331350 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07580b9580 0x7f075815b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:34.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.080+0000 7f075dd4b640 1 --2- 172.21.15.7:0/1192331350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07580d32e0 0x7f07581f4020 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f074c00ebe0 tx=0x7f074c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:34.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.081+0000 7f0756ffd640 1 -- 172.21.15.7:0/1192331350 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c017070 con 0x7f07580d32e0 2024-04-25T10:04:34.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.081+0000 7f0756ffd640 1 -- 172.21.15.7:0/1192331350 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074c00cc30 con 0x7f07580d32e0 2024-04-25T10:04:34.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.081+0000 7f07607b0640 1 -- 172.21.15.7:0/1192331350 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07581f7690 con 0x7f07580d32e0 2024-04-25T10:04:34.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.081+0000 7f0756ffd640 1 -- 172.21.15.7:0/1192331350 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c013470 con 0x7f07580d32e0 2024-04-25T10:04:34.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.081+0000 7f07607b0640 1 -- 172.21.15.7:0/1192331350 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07581f4560 con 0x7f07580d32e0 2024-04-25T10:04:34.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.082+0000 7f07607b0640 1 -- 172.21.15.7:0/1192331350 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0758074bb0 con 0x7f07580d32e0 2024-04-25T10:04:34.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.082+0000 7f0756ffd640 1 -- 172.21.15.7:0/1192331350 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f074c01a070 con 0x7f07580d32e0 2024-04-25T10:04:34.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.083+0000 7f0756ffd640 1 --2- 172.21.15.7:0/1192331350 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f074406b500 0x7f074406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:34.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.083+0000 7f0756ffd640 1 -- 172.21.15.7:0/1192331350 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f074c08a2b0 con 0x7f07580d32e0 2024-04-25T10:04:34.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.083+0000 7f075e54c640 1 --2- 172.21.15.7:0/1192331350 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f074406b500 0x7f074406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:34.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.083+0000 7f075e54c640 1 --2- 172.21.15.7:0/1192331350 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f074406b500 0x7f074406d9c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f0750001eb0 tx=0x7f0750009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:34.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.087+0000 7f0756ffd640 1 -- 172.21.15.7:0/1192331350 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f074c058fa0 con 0x7f07580d32e0 2024-04-25T10:04:34.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.337+0000 7f07607b0640 1 -- 172.21.15.7:0/1192331350 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f07581f3620 con 0x7f07580d32e0 2024-04-25T10:04:34.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.338+0000 7f0756ffd640 1 -- 172.21.15.7:0/1192331350 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1099 (secure 0 0 0) 0x7f074c0588a0 con 0x7f07580d32e0 2024-04-25T10:04:34.346 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:34.346 INFO:teuthology.orchestra.run.smithi007.stdout:{"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":630,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":117,"num_osds":8,"num_up_osds":8,"osd_up_since":1714038855,"num_in_osds":8,"osd_in_since":1714038845,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":62},{"state_name":"creating+peering","count":35}],"num_pgs":97,"num_pools":3,"num_objects":8,"data_bytes":591110,"bytes_used":272379904,"bytes_avail":772821733376,"bytes_total":773094113280,"inactive_pgs_ratio":0.36082473397254944,"write_bytes_sec":531,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":88,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"a","status":"up:active","gid":9051}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":35,"modified":"2024-04-25T10:04:15.991694+0000","services":{}},"progress_events":{}} 2024-04-25T10:04:34.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.339+0000 7f07607b0640 1 -- 172.21.15.7:0/1192331350 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f074406b500 msgr2=0x7f074406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:34.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.339+0000 7f07607b0640 1 --2- 172.21.15.7:0/1192331350 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f074406b500 0x7f074406d9c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f0750001eb0 tx=0x7f0750009040 comp rx=0 tx=0).stop 2024-04-25T10:04:34.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.339+0000 7f07607b0640 1 -- 172.21.15.7:0/1192331350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07580d32e0 msgr2=0x7f07581f4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:34.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.339+0000 7f07607b0640 1 --2- 172.21.15.7:0/1192331350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07580d32e0 0x7f07581f4020 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f074c00ebe0 tx=0x7f074c00c520 comp rx=0 tx=0).stop 2024-04-25T10:04:34.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.340+0000 7f07607b0640 1 -- 172.21.15.7:0/1192331350 shutdown_connections 2024-04-25T10:04:34.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.340+0000 7f07607b0640 1 --2- 172.21.15.7:0/1192331350 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f074406b500 0x7f074406d9c0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:34.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.340+0000 7f07607b0640 1 --2- 172.21.15.7:0/1192331350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f075815dad0 0x7f07581f6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:34.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.340+0000 7f07607b0640 1 --2- 172.21.15.7:0/1192331350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07580d32e0 0x7f07581f4020 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:34.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.340+0000 7f07607b0640 1 --2- 172.21.15.7:0/1192331350 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07580b9580 0x7f075815b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:34.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.340+0000 7f07607b0640 1 -- 172.21.15.7:0/1192331350 >> 172.21.15.7:0/1192331350 conn(0x7f075806bfe0 msgr2=0x7f07580b7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:34.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.340+0000 7f07607b0640 1 -- 172.21.15.7:0/1192331350 shutdown_connections 2024-04-25T10:04:34.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.340+0000 7f07607b0640 1 -- 172.21.15.7:0/1192331350 wait complete. 2024-04-25T10:04:34.356 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T10:04:34.356 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:04:34.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.451+0000 7f6e9095c640 1 Processor -- start 2024-04-25T10:04:34.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.451+0000 7f6e9095c640 1 -- start start 2024-04-25T10:04:34.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.452+0000 7f6e9095c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e8c0d0aa0 0x7f6e8c161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:34.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.452+0000 7f6e9095c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6e8c1622b0 0x7f6e8c0ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:34.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.452+0000 7f6e9095c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c15e8a0 con 0x7f6e8c15da60 2024-04-25T10:04:34.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.452+0000 7f6e9095c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c15eb80 con 0x7f6e8c1622b0 2024-04-25T10:04:34.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.452+0000 7f6e9095c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c15ee60 con 0x7f6e8c0d0aa0 2024-04-25T10:04:34.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.452+0000 7f6e8ad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6e8c1622b0 0x7f6e8c0ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:34.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.452+0000 7f6e89d9b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e8c0d0aa0 0x7f6e8c161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:34.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.452+0000 7f6e8a59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6e8c15da60 0x7f6e8c15de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:42852/0 (socket says 172.21.15.7:42852) 2024-04-25T10:04:34.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.452+0000 7f6e8a59c640 1 -- 172.21.15.7:0/3339039257 learned_addr learned my addr 172.21.15.7:0/3339039257 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:34.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.453+0000 7f6e8ad9d640 1 -- 172.21.15.7:0/3339039257 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e8c0d0aa0 msgr2=0x7f6e8c161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:34.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.453+0000 7f6e8ad9d640 1 --2- 172.21.15.7:0/3339039257 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e8c0d0aa0 0x7f6e8c161d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:34.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.453+0000 7f6e8ad9d640 1 -- 172.21.15.7:0/3339039257 >> v1:172.21.15.55:6789/0 conn(0x7f6e8c15da60 legacy=0x7f6e8c15de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:34.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.453+0000 7f6e8ad9d640 1 -- 172.21.15.7:0/3339039257 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8c161850 con 0x7f6e8c1622b0 2024-04-25T10:04:34.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.453+0000 7f6e89d9b640 1 --2- 172.21.15.7:0/3339039257 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e8c0d0aa0 0x7f6e8c161d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:34.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.453+0000 7f6e8ad9d640 1 --2- 172.21.15.7:0/3339039257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e8c1622b0 0x7f6e8c0ce520 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6e84009d90 tx=0x7f6e8402a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fada98ba5f71f9f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:34.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.454+0000 7f6e8959a640 1 -- 172.21.15.7:0/3339039257 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e84031600 con 0x7f6e8c1622b0 2024-04-25T10:04:34.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.454+0000 7f6e8959a640 1 -- 172.21.15.7:0/3339039257 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e840317a0 con 0x7f6e8c1622b0 2024-04-25T10:04:34.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.454+0000 7f6e8959a640 1 -- 172.21.15.7:0/3339039257 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e84031b70 con 0x7f6e8c1622b0 2024-04-25T10:04:34.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.454+0000 7f6e9095c640 1 -- 172.21.15.7:0/3339039257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e8c1622b0 msgr2=0x7f6e8c0ce520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:34.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.454+0000 7f6e9095c640 1 --2- 172.21.15.7:0/3339039257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e8c1622b0 0x7f6e8c0ce520 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6e84009d90 tx=0x7f6e8402a5d0 comp rx=0 tx=0).stop 2024-04-25T10:04:34.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.454+0000 7f6e9095c640 1 -- 172.21.15.7:0/3339039257 shutdown_connections 2024-04-25T10:04:34.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.454+0000 7f6e9095c640 1 --2- 172.21.15.7:0/3339039257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e8c1622b0 0x7f6e8c0ce520 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:34.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.454+0000 7f6e9095c640 1 --2- 172.21.15.7:0/3339039257 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e8c0d0aa0 0x7f6e8c161d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:34.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.454+0000 7f6e9095c640 1 -- 172.21.15.7:0/3339039257 >> 172.21.15.7:0/3339039257 conn(0x7f6e8c06bfe0 msgr2=0x7f6e8c06c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:34.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.454+0000 7f6e9095c640 1 -- 172.21.15.7:0/3339039257 shutdown_connections 2024-04-25T10:04:34.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.454+0000 7f6e9095c640 1 -- 172.21.15.7:0/3339039257 wait complete. 2024-04-25T10:04:34.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.456+0000 7f6e9095c640 1 Processor -- start 2024-04-25T10:04:34.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.456+0000 7f6e9095c640 1 -- start start 2024-04-25T10:04:34.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.456+0000 7f6e9095c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e8c0d0aa0 0x7f6e8c158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:34.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.456+0000 7f6e9095c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e8c15da60 0x7f6e8c15f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:34.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.456+0000 7f6e9095c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e8c1622b0 0x7f6e8c15f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:34.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.456+0000 7f6e9095c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0cebe0 con 0x7f6e8c15da60 2024-04-25T10:04:34.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.456+0000 7f6e9095c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0cea60 con 0x7f6e8c0d0aa0 2024-04-25T10:04:34.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.456+0000 7f6e9095c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0ced60 con 0x7f6e8c1622b0 2024-04-25T10:04:34.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.456+0000 7f6e89d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e8c15da60 0x7f6e8c15f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:34.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.457+0000 7f6e89d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e8c15da60 0x7f6e8c15f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47722/0 (socket says 172.21.15.7:47722) 2024-04-25T10:04:34.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.457+0000 7f6e89d9b640 1 -- 172.21.15.7:0/586841834 learned_addr learned my addr 172.21.15.7:0/586841834 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:34.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.457+0000 7f6e8ad9d640 1 --2- 172.21.15.7:0/586841834 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e8c1622b0 0x7f6e8c15f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:34.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.457+0000 7f6e8a59c640 1 --2- 172.21.15.7:0/586841834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e8c0d0aa0 0x7f6e8c158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:34.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.457+0000 7f6e89d9b640 1 -- 172.21.15.7:0/586841834 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e8c1622b0 msgr2=0x7f6e8c15f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:34.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.457+0000 7f6e89d9b640 1 --2- 172.21.15.7:0/586841834 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e8c1622b0 0x7f6e8c15f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:34.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.457+0000 7f6e89d9b640 1 -- 172.21.15.7:0/586841834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e8c0d0aa0 msgr2=0x7f6e8c158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:34.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.457+0000 7f6e89d9b640 1 --2- 172.21.15.7:0/586841834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e8c0d0aa0 0x7f6e8c158610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:34.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.457+0000 7f6e89d9b640 1 -- 172.21.15.7:0/586841834 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8c1e75b0 con 0x7f6e8c15da60 2024-04-25T10:04:34.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.457+0000 7f6e8a59c640 1 --2- 172.21.15.7:0/586841834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e8c0d0aa0 0x7f6e8c158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:34.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.457+0000 7f6e89d9b640 1 --2- 172.21.15.7:0/586841834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e8c15da60 0x7f6e8c15f1d0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f6e8000e990 tx=0x7f6e8000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:34.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.457+0000 7f6e7affd640 1 -- 172.21.15.7:0/586841834 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e80017070 con 0x7f6e8c15da60 2024-04-25T10:04:34.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.457+0000 7f6e7affd640 1 -- 172.21.15.7:0/586841834 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8000c9e0 con 0x7f6e8c15da60 2024-04-25T10:04:34.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.457+0000 7f6e9095c640 1 -- 172.21.15.7:0/586841834 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e8c1e7890 con 0x7f6e8c15da60 2024-04-25T10:04:34.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.457+0000 7f6e7affd640 1 -- 172.21.15.7:0/586841834 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8000cdb0 con 0x7f6e8c15da60 2024-04-25T10:04:34.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.457+0000 7f6e9095c640 1 -- 172.21.15.7:0/586841834 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e8c1e7e50 con 0x7f6e8c15da60 2024-04-25T10:04:34.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.458+0000 7f6e9095c640 1 -- 172.21.15.7:0/586841834 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e8c0d1560 con 0x7f6e8c15da60 2024-04-25T10:04:34.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.459+0000 7f6e7affd640 1 -- 172.21.15.7:0/586841834 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6e8001a070 con 0x7f6e8c15da60 2024-04-25T10:04:34.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.459+0000 7f6e7affd640 1 --2- 172.21.15.7:0/586841834 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6e6c06b4d0 0x7f6e6c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:34.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.459+0000 7f6e7affd640 1 -- 172.21.15.7:0/586841834 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6e8008a530 con 0x7f6e8c15da60 2024-04-25T10:04:34.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.459+0000 7f6e8a59c640 1 --2- 172.21.15.7:0/586841834 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6e6c06b4d0 0x7f6e6c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:34.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.460+0000 7f6e8a59c640 1 --2- 172.21.15.7:0/586841834 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6e6c06b4d0 0x7f6e6c06d990 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c000f60 tx=0x7f6e7c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.463+0000 7f6e7affd640 1 -- 172.21.15.7:0/586841834 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6e80058be0 con 0x7f6e8c15da60 2024-04-25T10:04:34.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.639+0000 7f6e9095c640 1 -- 172.21.15.7:0/586841834 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6e8c0680c0 con 0x7f6e6c06b4d0 2024-04-25T10:04:34.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.645+0000 7f6e7affd640 1 -- 172.21.15.7:0/586841834 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249510 (secure 0 0 0) 0x7f6e7c005890 con 0x7f6e6c06b4d0 2024-04-25T10:04:34.653 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:34.654 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T10:04:34.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.648+0000 7f6e9095c640 1 -- 172.21.15.7:0/586841834 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6e6c06b4d0 msgr2=0x7f6e6c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:34.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.648+0000 7f6e9095c640 1 --2- 172.21.15.7:0/586841834 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6e6c06b4d0 0x7f6e6c06d990 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c000f60 tx=0x7f6e7c009040 comp rx=0 tx=0).stop 2024-04-25T10:04:34.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.648+0000 7f6e9095c640 1 -- 172.21.15.7:0/586841834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e8c15da60 msgr2=0x7f6e8c15f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:34.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.648+0000 7f6e9095c640 1 --2- 172.21.15.7:0/586841834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e8c15da60 0x7f6e8c15f1d0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f6e8000e990 tx=0x7f6e8000ee50 comp rx=0 tx=0).stop 2024-04-25T10:04:34.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.648+0000 7f6e9095c640 1 -- 172.21.15.7:0/586841834 shutdown_connections 2024-04-25T10:04:34.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.648+0000 7f6e9095c640 1 --2- 172.21.15.7:0/586841834 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6e6c06b4d0 0x7f6e6c06d990 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:34.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.648+0000 7f6e9095c640 1 --2- 172.21.15.7:0/586841834 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6e8c1622b0 0x7f6e8c15f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:34.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.648+0000 7f6e9095c640 1 --2- 172.21.15.7:0/586841834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e8c15da60 0x7f6e8c15f1d0 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:34.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.648+0000 7f6e9095c640 1 --2- 172.21.15.7:0/586841834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e8c0d0aa0 0x7f6e8c158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:34.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.648+0000 7f6e9095c640 1 -- 172.21.15.7:0/586841834 >> 172.21.15.7:0/586841834 conn(0x7f6e8c06bfe0 msgr2=0x7f6e8c06c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:34.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.648+0000 7f6e9095c640 1 -- 172.21.15.7:0/586841834 shutdown_connections 2024-04-25T10:04:34.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:34.648+0000 7f6e9095c640 1 -- 172.21.15.7:0/586841834 wait complete. 2024-04-25T10:04:34.664 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":420,"stamp":"2024-04-25T10:04:33.995065+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":265996,"kb_used_data":12384,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754708724,"statfs":{"total":773094113280,"available":772821733376,"internally_reserved":0,"allocated":12681216,"data_stored":6509652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":259575345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":742,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.779062"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.242746+0000","last_change":"2024-04-25T10:04:30.240506+0000","last_active":"2024-04-25T10:04:30.242746+0000","last_peered":"2024-04-25T10:04:30.242746+0000","last_clean":"2024-04-25T10:04:30.242746+0000","last_became_active":"2024-04-25T10:04:30.240146+0000","last_became_peered":"2024-04-25T10:04:30.240146+0000","last_unstale":"2024-04-25T10:04:30.242746+0000","last_undegraded":"2024-04-25T10:04:30.242746+0000","last_fullsized":"2024-04-25T10:04:30.242746+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:15.962820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.237330+0000","last_change":"2024-04-25T10:04:29.237330+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.237330+0000","last_undegraded":"2024-04-25T10:04:29.237330+0000","last_fullsized":"2024-04-25T10:04:29.237330+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.236919+0000","last_change":"2024-04-25T10:04:29.236919+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.236919+0000","last_undegraded":"2024-04-25T10:04:29.236919+0000","last_fullsized":"2024-04-25T10:04:29.236919+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.259642+0000","last_change":"2024-04-25T10:04:30.252147+0000","last_active":"2024-04-25T10:04:30.259642+0000","last_peered":"2024-04-25T10:04:30.259642+0000","last_clean":"2024-04-25T10:04:30.259642+0000","last_became_active":"2024-04-25T10:04:30.251836+0000","last_became_peered":"2024-04-25T10:04:30.251836+0000","last_unstale":"2024-04-25T10:04:30.259642+0000","last_undegraded":"2024-04-25T10:04:30.259642+0000","last_fullsized":"2024-04-25T10:04:30.259642+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:27.545334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.255527+0000","last_change":"2024-04-25T10:04:30.252200+0000","last_active":"2024-04-25T10:04:30.255527+0000","last_peered":"2024-04-25T10:04:30.255527+0000","last_clean":"2024-04-25T10:04:30.255527+0000","last_became_active":"2024-04-25T10:04:30.251902+0000","last_became_peered":"2024-04-25T10:04:30.251902+0000","last_unstale":"2024-04-25T10:04:30.255527+0000","last_undegraded":"2024-04-25T10:04:30.255527+0000","last_fullsized":"2024-04-25T10:04:30.255527+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:45.747180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.235067+0000","last_change":"2024-04-25T10:04:29.235067+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.235067+0000","last_undegraded":"2024-04-25T10:04:29.235067+0000","last_fullsized":"2024-04-25T10:04:29.235067+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.234975+0000","last_change":"2024-04-25T10:04:29.234975+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.234975+0000","last_undegraded":"2024-04-25T10:04:29.234975+0000","last_fullsized":"2024-04-25T10:04:29.234975+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.236365+0000","last_change":"2024-04-25T10:04:29.236365+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.236365+0000","last_undegraded":"2024-04-25T10:04:29.236365+0000","last_fullsized":"2024-04-25T10:04:29.236365+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.260091+0000","last_change":"2024-04-25T10:04:30.256927+0000","last_active":"2024-04-25T10:04:30.260091+0000","last_peered":"2024-04-25T10:04:30.260091+0000","last_clean":"2024-04-25T10:04:30.260091+0000","last_became_active":"2024-04-25T10:04:30.255115+0000","last_became_peered":"2024-04-25T10:04:30.255115+0000","last_unstale":"2024-04-25T10:04:30.260091+0000","last_undegraded":"2024-04-25T10:04:30.260091+0000","last_fullsized":"2024-04-25T10:04:30.260091+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:26:00.553092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.236981+0000","last_change":"2024-04-25T10:04:29.236981+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.236981+0000","last_undegraded":"2024-04-25T10:04:29.236981+0000","last_fullsized":"2024-04-25T10:04:29.236981+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.249732+0000","last_change":"2024-04-25T10:04:30.245678+0000","last_active":"2024-04-25T10:04:30.249732+0000","last_peered":"2024-04-25T10:04:30.249732+0000","last_clean":"2024-04-25T10:04:30.249732+0000","last_became_active":"2024-04-25T10:04:30.245363+0000","last_became_peered":"2024-04-25T10:04:30.245363+0000","last_unstale":"2024-04-25T10:04:30.249732+0000","last_undegraded":"2024-04-25T10:04:30.249732+0000","last_fullsized":"2024-04-25T10:04:30.249732+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:18.944449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.234165+0000","last_change":"2024-04-25T10:04:29.234165+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.234165+0000","last_undegraded":"2024-04-25T10:04:29.234165+0000","last_fullsized":"2024-04-25T10:04:29.234165+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.235212+0000","last_change":"2024-04-25T10:04:29.235212+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.235212+0000","last_undegraded":"2024-04-25T10:04:29.235212+0000","last_fullsized":"2024-04-25T10:04:29.235212+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.236402+0000","last_change":"2024-04-25T10:04:29.236402+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.236402+0000","last_undegraded":"2024-04-25T10:04:29.236402+0000","last_fullsized":"2024-04-25T10:04:29.236402+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.249655+0000","last_change":"2024-04-25T10:04:30.246368+0000","last_active":"2024-04-25T10:04:30.249655+0000","last_peered":"2024-04-25T10:04:30.249655+0000","last_clean":"2024-04-25T10:04:30.249655+0000","last_became_active":"2024-04-25T10:04:30.246100+0000","last_became_peered":"2024-04-25T10:04:30.246100+0000","last_unstale":"2024-04-25T10:04:30.249655+0000","last_undegraded":"2024-04-25T10:04:30.249655+0000","last_fullsized":"2024-04-25T10:04:30.249655+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:42.155245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.234378+0000","last_change":"2024-04-25T10:04:29.234378+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.234378+0000","last_undegraded":"2024-04-25T10:04:29.234378+0000","last_fullsized":"2024-04-25T10:04:29.234378+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.235759+0000","last_change":"2024-04-25T10:04:29.235759+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.235759+0000","last_undegraded":"2024-04-25T10:04:29.235759+0000","last_fullsized":"2024-04-25T10:04:29.235759+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.235878+0000","last_change":"2024-04-25T10:04:29.235878+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.235878+0000","last_undegraded":"2024-04-25T10:04:29.235878+0000","last_fullsized":"2024-04-25T10:04:29.235878+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.258074+0000","last_change":"2024-04-25T10:04:30.254496+0000","last_active":"2024-04-25T10:04:30.258074+0000","last_peered":"2024-04-25T10:04:30.258074+0000","last_clean":"2024-04-25T10:04:30.258074+0000","last_became_active":"2024-04-25T10:04:30.254205+0000","last_became_peered":"2024-04-25T10:04:30.254205+0000","last_unstale":"2024-04-25T10:04:30.258074+0000","last_undegraded":"2024-04-25T10:04:30.258074+0000","last_fullsized":"2024-04-25T10:04:30.258074+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:42.155245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.237396+0000","last_change":"2024-04-25T10:04:29.237396+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.237396+0000","last_undegraded":"2024-04-25T10:04:29.237396+0000","last_fullsized":"2024-04-25T10:04:29.237396+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.260054+0000","last_change":"2024-04-25T10:04:30.256744+0000","last_active":"2024-04-25T10:04:30.260054+0000","last_peered":"2024-04-25T10:04:30.260054+0000","last_clean":"2024-04-25T10:04:30.260054+0000","last_became_active":"2024-04-25T10:04:30.256064+0000","last_became_peered":"2024-04-25T10:04:30.256064+0000","last_unstale":"2024-04-25T10:04:30.260054+0000","last_undegraded":"2024-04-25T10:04:30.260054+0000","last_fullsized":"2024-04-25T10:04:30.260054+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:01.357667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.249612+0000","last_change":"2024-04-25T10:04:30.244355+0000","last_active":"2024-04-25T10:04:30.249612+0000","last_peered":"2024-04-25T10:04:30.249612+0000","last_clean":"2024-04-25T10:04:30.249612+0000","last_became_active":"2024-04-25T10:04:30.244028+0000","last_became_peered":"2024-04-25T10:04:30.244028+0000","last_unstale":"2024-04-25T10:04:30.249612+0000","last_undegraded":"2024-04-25T10:04:30.249612+0000","last_fullsized":"2024-04-25T10:04:30.249612+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:27.281210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.259695+0000","last_change":"2024-04-25T10:04:30.253400+0000","last_active":"2024-04-25T10:04:30.259695+0000","last_peered":"2024-04-25T10:04:30.259695+0000","last_clean":"2024-04-25T10:04:30.259695+0000","last_became_active":"2024-04-25T10:04:30.253118+0000","last_became_peered":"2024-04-25T10:04:30.253118+0000","last_unstale":"2024-04-25T10:04:30.259695+0000","last_undegraded":"2024-04-25T10:04:30.259695+0000","last_fullsized":"2024-04-25T10:04:30.259695+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:24.510668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.259100+0000","last_change":"2024-04-25T10:04:30.258434+0000","last_active":"2024-04-25T10:04:30.259100+0000","last_peered":"2024-04-25T10:04:30.259100+0000","last_clean":"2024-04-25T10:04:30.259100+0000","last_became_active":"2024-04-25T10:04:30.258149+0000","last_became_peered":"2024-04-25T10:04:30.258149+0000","last_unstale":"2024-04-25T10:04:30.259100+0000","last_undegraded":"2024-04-25T10:04:30.259100+0000","last_fullsized":"2024-04-25T10:04:30.259100+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:29.764075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.255118+0000","last_change":"2024-04-25T10:04:30.248070+0000","last_active":"2024-04-25T10:04:30.255118+0000","last_peered":"2024-04-25T10:04:30.255118+0000","last_clean":"2024-04-25T10:04:30.255118+0000","last_became_active":"2024-04-25T10:04:30.247788+0000","last_became_peered":"2024-04-25T10:04:30.247788+0000","last_unstale":"2024-04-25T10:04:30.255118+0000","last_undegraded":"2024-04-25T10:04:30.255118+0000","last_fullsized":"2024-04-25T10:04:30.255118+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:34.725496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.237563+0000","last_change":"2024-04-25T10:04:29.237563+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.237563+0000","last_undegraded":"2024-04-25T10:04:29.237563+0000","last_fullsized":"2024-04-25T10:04:29.237563+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.258051+0000","last_change":"2024-04-25T10:04:30.254462+0000","last_active":"2024-04-25T10:04:30.258051+0000","last_peered":"2024-04-25T10:04:30.258051+0000","last_clean":"2024-04-25T10:04:30.258051+0000","last_became_active":"2024-04-25T10:04:30.253993+0000","last_became_peered":"2024-04-25T10:04:30.253993+0000","last_unstale":"2024-04-25T10:04:30.258051+0000","last_undegraded":"2024-04-25T10:04:30.258051+0000","last_fullsized":"2024-04-25T10:04:30.258051+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:18.944449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.232701+0000","last_change":"2024-04-25T10:04:29.232701+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.232701+0000","last_undegraded":"2024-04-25T10:04:29.232701+0000","last_fullsized":"2024-04-25T10:04:29.232701+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.239225+0000","last_change":"2024-04-25T10:04:29.239225+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.239225+0000","last_undegraded":"2024-04-25T10:04:29.239225+0000","last_fullsized":"2024-04-25T10:04:29.239225+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.234215+0000","last_change":"2024-04-25T10:04:29.234215+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.234215+0000","last_undegraded":"2024-04-25T10:04:29.234215+0000","last_fullsized":"2024-04-25T10:04:29.234215+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.254755+0000","last_change":"2024-04-25T10:04:30.245661+0000","last_active":"2024-04-25T10:04:30.254755+0000","last_peered":"2024-04-25T10:04:30.254755+0000","last_clean":"2024-04-25T10:04:30.254755+0000","last_became_active":"2024-04-25T10:04:30.245371+0000","last_became_peered":"2024-04-25T10:04:30.245371+0000","last_unstale":"2024-04-25T10:04:30.254755+0000","last_undegraded":"2024-04-25T10:04:30.254755+0000","last_fullsized":"2024-04-25T10:04:30.254755+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:25.171859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.259079+0000","last_change":"2024-04-25T10:04:30.258292+0000","last_active":"2024-04-25T10:04:30.259079+0000","last_peered":"2024-04-25T10:04:30.259079+0000","last_clean":"2024-04-25T10:04:30.259079+0000","last_became_active":"2024-04-25T10:04:30.257766+0000","last_became_peered":"2024-04-25T10:04:30.257766+0000","last_unstale":"2024-04-25T10:04:30.259079+0000","last_undegraded":"2024-04-25T10:04:30.259079+0000","last_fullsized":"2024-04-25T10:04:30.259079+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:29.684144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.234675+0000","last_change":"2024-04-25T10:04:29.234675+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.234675+0000","last_undegraded":"2024-04-25T10:04:29.234675+0000","last_fullsized":"2024-04-25T10:04:29.234675+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"116'4","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.261309+0000","last_change":"2024-04-25T10:04:29.246635+0000","last_active":"2024-04-25T10:04:30.261309+0000","last_peered":"2024-04-25T10:04:30.261309+0000","last_clean":"2024-04-25T10:04:30.261309+0000","last_became_active":"2024-04-25T10:04:29.246149+0000","last_became_peered":"2024-04-25T10:04:29.246149+0000","last_unstale":"2024-04-25T10:04:30.261309+0000","last_undegraded":"2024-04-25T10:04:30.261309+0000","last_fullsized":"2024-04-25T10:04:30.261309+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:54.240491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233189+0000","last_change":"2024-04-25T10:04:29.233189+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233189+0000","last_undegraded":"2024-04-25T10:04:29.233189+0000","last_fullsized":"2024-04-25T10:04:29.233189+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.242837+0000","last_change":"2024-04-25T10:04:29.241014+0000","last_active":"2024-04-25T10:04:29.242837+0000","last_peered":"2024-04-25T10:04:29.242837+0000","last_clean":"2024-04-25T10:04:29.242837+0000","last_became_active":"2024-04-25T10:04:29.240747+0000","last_became_peered":"2024-04-25T10:04:29.240747+0000","last_unstale":"2024-04-25T10:04:29.242837+0000","last_undegraded":"2024-04-25T10:04:29.242837+0000","last_fullsized":"2024-04-25T10:04:29.242837+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:05.633007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.259127+0000","last_change":"2024-04-25T10:04:30.258097+0000","last_active":"2024-04-25T10:04:30.259127+0000","last_peered":"2024-04-25T10:04:30.259127+0000","last_clean":"2024-04-25T10:04:30.259127+0000","last_became_active":"2024-04-25T10:04:30.257788+0000","last_became_peered":"2024-04-25T10:04:30.257788+0000","last_unstale":"2024-04-25T10:04:30.259127+0000","last_undegraded":"2024-04-25T10:04:30.259127+0000","last_fullsized":"2024-04-25T10:04:30.259127+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:46:54.349361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"116'2","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.263266+0000","last_change":"2024-04-25T10:04:29.247462+0000","last_active":"2024-04-25T10:04:30.263266+0000","last_peered":"2024-04-25T10:04:30.263266+0000","last_clean":"2024-04-25T10:04:30.263266+0000","last_became_active":"2024-04-25T10:04:29.247192+0000","last_became_peered":"2024-04-25T10:04:29.247192+0000","last_unstale":"2024-04-25T10:04:30.263266+0000","last_undegraded":"2024-04-25T10:04:30.263266+0000","last_fullsized":"2024-04-25T10:04:30.263266+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:17.577585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.263922+0000","last_change":"2024-04-25T10:04:30.263430+0000","last_active":"2024-04-25T10:04:30.263922+0000","last_peered":"2024-04-25T10:04:30.263922+0000","last_clean":"2024-04-25T10:04:30.263922+0000","last_became_active":"2024-04-25T10:04:30.263105+0000","last_became_peered":"2024-04-25T10:04:30.263105+0000","last_unstale":"2024-04-25T10:04:30.263922+0000","last_undegraded":"2024-04-25T10:04:30.263922+0000","last_fullsized":"2024-04-25T10:04:30.263922+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:48.104630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.242829+0000","last_change":"2024-04-25T10:04:29.240963+0000","last_active":"2024-04-25T10:04:29.242829+0000","last_peered":"2024-04-25T10:04:29.242829+0000","last_clean":"2024-04-25T10:04:29.242829+0000","last_became_active":"2024-04-25T10:04:29.240676+0000","last_became_peered":"2024-04-25T10:04:29.240676+0000","last_unstale":"2024-04-25T10:04:29.242829+0000","last_undegraded":"2024-04-25T10:04:29.242829+0000","last_fullsized":"2024-04-25T10:04:29.242829+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:16.035459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233038+0000","last_change":"2024-04-25T10:04:29.233038+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233038+0000","last_undegraded":"2024-04-25T10:04:29.233038+0000","last_fullsized":"2024-04-25T10:04:29.233038+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"116'1","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.258625+0000","last_change":"2024-04-25T10:04:29.245168+0000","last_active":"2024-04-25T10:04:30.258625+0000","last_peered":"2024-04-25T10:04:30.258625+0000","last_clean":"2024-04-25T10:04:30.258625+0000","last_became_active":"2024-04-25T10:04:29.244887+0000","last_became_peered":"2024-04-25T10:04:29.244887+0000","last_unstale":"2024-04-25T10:04:30.258625+0000","last_undegraded":"2024-04-25T10:04:30.258625+0000","last_fullsized":"2024-04-25T10:04:30.258625+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:05.046287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.254402+0000","last_change":"2024-04-25T10:04:30.249301+0000","last_active":"2024-04-25T10:04:30.254402+0000","last_peered":"2024-04-25T10:04:30.254402+0000","last_clean":"2024-04-25T10:04:30.254402+0000","last_became_active":"2024-04-25T10:04:30.249015+0000","last_became_peered":"2024-04-25T10:04:30.249015+0000","last_unstale":"2024-04-25T10:04:30.254402+0000","last_undegraded":"2024-04-25T10:04:30.254402+0000","last_fullsized":"2024-04-25T10:04:30.254402+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:10.060231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.246412+0000","last_change":"2024-04-25T10:04:29.242148+0000","last_active":"2024-04-25T10:04:29.246412+0000","last_peered":"2024-04-25T10:04:29.246412+0000","last_clean":"2024-04-25T10:04:29.246412+0000","last_became_active":"2024-04-25T10:04:29.241863+0000","last_became_peered":"2024-04-25T10:04:29.241863+0000","last_unstale":"2024-04-25T10:04:29.246412+0000","last_undegraded":"2024-04-25T10:04:29.246412+0000","last_fullsized":"2024-04-25T10:04:29.246412+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:17.686544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233732+0000","last_change":"2024-04-25T10:04:29.233732+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233732+0000","last_undegraded":"2024-04-25T10:04:29.233732+0000","last_fullsized":"2024-04-25T10:04:29.233732+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.239530+0000","last_change":"2024-04-25T10:04:29.245895+0000","last_active":"2024-04-25T10:04:30.239530+0000","last_peered":"2024-04-25T10:04:30.239530+0000","last_clean":"2024-04-25T10:04:30.239530+0000","last_became_active":"2024-04-25T10:04:29.245618+0000","last_became_peered":"2024-04-25T10:04:29.245618+0000","last_unstale":"2024-04-25T10:04:30.239530+0000","last_undegraded":"2024-04-25T10:04:30.239530+0000","last_fullsized":"2024-04-25T10:04:30.239530+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:41.138715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.234123+0000","last_change":"2024-04-25T10:04:29.234123+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.234123+0000","last_undegraded":"2024-04-25T10:04:29.234123+0000","last_fullsized":"2024-04-25T10:04:29.234123+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.246459+0000","last_change":"2024-04-25T10:04:29.243321+0000","last_active":"2024-04-25T10:04:29.246459+0000","last_peered":"2024-04-25T10:04:29.246459+0000","last_clean":"2024-04-25T10:04:29.246459+0000","last_became_active":"2024-04-25T10:04:29.242993+0000","last_became_peered":"2024-04-25T10:04:29.242993+0000","last_unstale":"2024-04-25T10:04:29.246459+0000","last_undegraded":"2024-04-25T10:04:29.246459+0000","last_fullsized":"2024-04-25T10:04:29.246459+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:46.144168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.260114+0000","last_change":"2024-04-25T10:04:30.259351+0000","last_active":"2024-04-25T10:04:30.260114+0000","last_peered":"2024-04-25T10:04:30.260114+0000","last_clean":"2024-04-25T10:04:30.260114+0000","last_became_active":"2024-04-25T10:04:30.259032+0000","last_became_peered":"2024-04-25T10:04:30.259032+0000","last_unstale":"2024-04-25T10:04:30.260114+0000","last_undegraded":"2024-04-25T10:04:30.260114+0000","last_fullsized":"2024-04-25T10:04:30.260114+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:10.060231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.245980+0000","last_change":"2024-04-25T10:04:29.249960+0000","last_active":"2024-04-25T10:04:30.245980+0000","last_peered":"2024-04-25T10:04:30.245980+0000","last_clean":"2024-04-25T10:04:30.245980+0000","last_became_active":"2024-04-25T10:04:29.249622+0000","last_became_peered":"2024-04-25T10:04:29.249622+0000","last_unstale":"2024-04-25T10:04:30.245980+0000","last_undegraded":"2024-04-25T10:04:30.245980+0000","last_fullsized":"2024-04-25T10:04:30.245980+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:26.264680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.257314+0000","last_change":"2024-04-25T10:04:30.254839+0000","last_active":"2024-04-25T10:04:30.257314+0000","last_peered":"2024-04-25T10:04:30.257314+0000","last_clean":"2024-04-25T10:04:30.257314+0000","last_became_active":"2024-04-25T10:04:30.252585+0000","last_became_peered":"2024-04-25T10:04:30.252585+0000","last_unstale":"2024-04-25T10:04:30.257314+0000","last_undegraded":"2024-04-25T10:04:30.257314+0000","last_fullsized":"2024-04-25T10:04:30.257314+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:03.353003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.237470+0000","last_change":"2024-04-25T10:04:29.245786+0000","last_active":"2024-04-25T10:04:30.237470+0000","last_peered":"2024-04-25T10:04:30.237470+0000","last_clean":"2024-04-25T10:04:30.237470+0000","last_became_active":"2024-04-25T10:04:29.245467+0000","last_became_peered":"2024-04-25T10:04:29.245467+0000","last_unstale":"2024-04-25T10:04:30.237470+0000","last_undegraded":"2024-04-25T10:04:30.237470+0000","last_fullsized":"2024-04-25T10:04:30.237470+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:17.927919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233329+0000","last_change":"2024-04-25T10:04:29.233329+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233329+0000","last_undegraded":"2024-04-25T10:04:29.233329+0000","last_fullsized":"2024-04-25T10:04:29.233329+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"116'3","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.257027+0000","last_change":"2024-04-25T10:04:29.248775+0000","last_active":"2024-04-25T10:04:30.257027+0000","last_peered":"2024-04-25T10:04:30.257027+0000","last_clean":"2024-04-25T10:04:30.257027+0000","last_became_active":"2024-04-25T10:04:29.248484+0000","last_became_peered":"2024-04-25T10:04:29.248484+0000","last_unstale":"2024-04-25T10:04:30.257027+0000","last_undegraded":"2024-04-25T10:04:30.257027+0000","last_fullsized":"2024-04-25T10:04:30.257027+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:09.043701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.254777+0000","last_change":"2024-04-25T10:04:30.246946+0000","last_active":"2024-04-25T10:04:30.254777+0000","last_peered":"2024-04-25T10:04:30.254777+0000","last_clean":"2024-04-25T10:04:30.254777+0000","last_became_active":"2024-04-25T10:04:30.246636+0000","last_became_peered":"2024-04-25T10:04:30.246636+0000","last_unstale":"2024-04-25T10:04:30.254777+0000","last_undegraded":"2024-04-25T10:04:30.254777+0000","last_fullsized":"2024-04-25T10:04:30.254777+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:13.746169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.249491+0000","last_change":"2024-04-25T10:04:29.248492+0000","last_active":"2024-04-25T10:04:29.249491+0000","last_peered":"2024-04-25T10:04:29.249491+0000","last_clean":"2024-04-25T10:04:29.249491+0000","last_became_active":"2024-04-25T10:04:29.248184+0000","last_became_peered":"2024-04-25T10:04:29.248184+0000","last_unstale":"2024-04-25T10:04:29.249491+0000","last_undegraded":"2024-04-25T10:04:29.249491+0000","last_fullsized":"2024-04-25T10:04:29.249491+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:40.143885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.257574+0000","last_change":"2024-04-25T10:04:30.252044+0000","last_active":"2024-04-25T10:04:30.257574+0000","last_peered":"2024-04-25T10:04:30.257574+0000","last_clean":"2024-04-25T10:04:30.257574+0000","last_became_active":"2024-04-25T10:04:30.251299+0000","last_became_peered":"2024-04-25T10:04:30.251299+0000","last_unstale":"2024-04-25T10:04:30.257574+0000","last_undegraded":"2024-04-25T10:04:30.257574+0000","last_fullsized":"2024-04-25T10:04:30.257574+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:42.340536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.247504+0000","last_change":"2024-04-25T10:04:29.246443+0000","last_active":"2024-04-25T10:04:29.247504+0000","last_peered":"2024-04-25T10:04:29.247504+0000","last_clean":"2024-04-25T10:04:29.247504+0000","last_became_active":"2024-04-25T10:04:29.245766+0000","last_became_peered":"2024-04-25T10:04:29.245766+0000","last_unstale":"2024-04-25T10:04:29.247504+0000","last_undegraded":"2024-04-25T10:04:29.247504+0000","last_fullsized":"2024-04-25T10:04:29.247504+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:20.061436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.231839+0000","last_change":"2024-04-25T10:04:29.231839+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.231839+0000","last_undegraded":"2024-04-25T10:04:29.231839+0000","last_fullsized":"2024-04-25T10:04:29.231839+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.243738+0000","last_change":"2024-04-25T10:04:29.242805+0000","last_active":"2024-04-25T10:04:29.243738+0000","last_peered":"2024-04-25T10:04:29.243738+0000","last_clean":"2024-04-25T10:04:29.243738+0000","last_became_active":"2024-04-25T10:04:29.242435+0000","last_became_peered":"2024-04-25T10:04:29.242435+0000","last_unstale":"2024-04-25T10:04:29.243738+0000","last_undegraded":"2024-04-25T10:04:29.243738+0000","last_fullsized":"2024-04-25T10:04:29.243738+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:41.297407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.237096+0000","last_change":"2024-04-25T10:04:29.237096+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.237096+0000","last_undegraded":"2024-04-25T10:04:29.237096+0000","last_fullsized":"2024-04-25T10:04:29.237096+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.247541+0000","last_change":"2024-04-25T10:04:29.245970+0000","last_active":"2024-04-25T10:04:29.247541+0000","last_peered":"2024-04-25T10:04:29.247541+0000","last_clean":"2024-04-25T10:04:29.247541+0000","last_became_active":"2024-04-25T10:04:29.245667+0000","last_became_peered":"2024-04-25T10:04:29.245667+0000","last_unstale":"2024-04-25T10:04:29.247541+0000","last_undegraded":"2024-04-25T10:04:29.247541+0000","last_fullsized":"2024-04-25T10:04:29.247541+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:05.642908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.255484+0000","last_change":"2024-04-25T10:04:30.251298+0000","last_active":"2024-04-25T10:04:30.255484+0000","last_peered":"2024-04-25T10:04:30.255484+0000","last_clean":"2024-04-25T10:04:30.255484+0000","last_became_active":"2024-04-25T10:04:30.251021+0000","last_became_peered":"2024-04-25T10:04:30.251021+0000","last_unstale":"2024-04-25T10:04:30.255484+0000","last_undegraded":"2024-04-25T10:04:30.255484+0000","last_fullsized":"2024-04-25T10:04:30.255484+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:56:46.072939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.250581+0000","last_change":"2024-04-25T10:04:29.247771+0000","last_active":"2024-04-25T10:04:29.250581+0000","last_peered":"2024-04-25T10:04:29.250581+0000","last_clean":"2024-04-25T10:04:29.250581+0000","last_became_active":"2024-04-25T10:04:29.247178+0000","last_became_peered":"2024-04-25T10:04:29.247178+0000","last_unstale":"2024-04-25T10:04:29.250581+0000","last_undegraded":"2024-04-25T10:04:29.250581+0000","last_fullsized":"2024-04-25T10:04:29.250581+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:11.594481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.249711+0000","last_change":"2024-04-25T10:04:30.244889+0000","last_active":"2024-04-25T10:04:30.249711+0000","last_peered":"2024-04-25T10:04:30.249711+0000","last_clean":"2024-04-25T10:04:30.249711+0000","last_became_active":"2024-04-25T10:04:30.244564+0000","last_became_peered":"2024-04-25T10:04:30.244564+0000","last_unstale":"2024-04-25T10:04:30.249711+0000","last_undegraded":"2024-04-25T10:04:30.249711+0000","last_fullsized":"2024-04-25T10:04:30.249711+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:42.340536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.251342+0000","last_change":"2024-04-25T10:04:29.250738+0000","last_active":"2024-04-25T10:04:29.251342+0000","last_peered":"2024-04-25T10:04:29.251342+0000","last_clean":"2024-04-25T10:04:29.251342+0000","last_became_active":"2024-04-25T10:04:29.250437+0000","last_became_peered":"2024-04-25T10:04:29.250437+0000","last_unstale":"2024-04-25T10:04:29.251342+0000","last_undegraded":"2024-04-25T10:04:29.251342+0000","last_fullsized":"2024-04-25T10:04:29.251342+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:21.563376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233660+0000","last_change":"2024-04-25T10:04:29.233660+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233660+0000","last_undegraded":"2024-04-25T10:04:29.233660+0000","last_fullsized":"2024-04-25T10:04:29.233660+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"116'1","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.259833+0000","last_change":"2024-04-25T10:04:29.246631+0000","last_active":"2024-04-25T10:04:30.259833+0000","last_peered":"2024-04-25T10:04:30.259833+0000","last_clean":"2024-04-25T10:04:30.259833+0000","last_became_active":"2024-04-25T10:04:29.246207+0000","last_became_peered":"2024-04-25T10:04:29.246207+0000","last_unstale":"2024-04-25T10:04:30.259833+0000","last_undegraded":"2024-04-25T10:04:30.259833+0000","last_fullsized":"2024-04-25T10:04:30.259833+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:07.897567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.255141+0000","last_change":"2024-04-25T10:04:30.250282+0000","last_active":"2024-04-25T10:04:30.255141+0000","last_peered":"2024-04-25T10:04:30.255141+0000","last_clean":"2024-04-25T10:04:30.255141+0000","last_became_active":"2024-04-25T10:04:30.250001+0000","last_became_peered":"2024-04-25T10:04:30.250001+0000","last_unstale":"2024-04-25T10:04:30.255141+0000","last_undegraded":"2024-04-25T10:04:30.255141+0000","last_fullsized":"2024-04-25T10:04:30.255141+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:16.033392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.239824+0000","last_change":"2024-04-25T10:04:29.251151+0000","last_active":"2024-04-25T10:04:30.239824+0000","last_peered":"2024-04-25T10:04:30.239824+0000","last_clean":"2024-04-25T10:04:30.239824+0000","last_became_active":"2024-04-25T10:04:29.250830+0000","last_became_peered":"2024-04-25T10:04:29.250830+0000","last_unstale":"2024-04-25T10:04:30.239824+0000","last_undegraded":"2024-04-25T10:04:30.239824+0000","last_fullsized":"2024-04-25T10:04:30.239824+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:05.642908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233970+0000","last_change":"2024-04-25T10:04:29.233970+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233970+0000","last_undegraded":"2024-04-25T10:04:29.233970+0000","last_fullsized":"2024-04-25T10:04:29.233970+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.250438+0000","last_change":"2024-04-25T10:04:29.249278+0000","last_active":"2024-04-25T10:04:29.250438+0000","last_peered":"2024-04-25T10:04:29.250438+0000","last_clean":"2024-04-25T10:04:29.250438+0000","last_became_active":"2024-04-25T10:04:29.248937+0000","last_became_peered":"2024-04-25T10:04:29.248937+0000","last_unstale":"2024-04-25T10:04:29.250438+0000","last_undegraded":"2024-04-25T10:04:29.250438+0000","last_fullsized":"2024-04-25T10:04:29.250438+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:46.692405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.232377+0000","last_change":"2024-04-25T10:04:29.232377+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.232377+0000","last_undegraded":"2024-04-25T10:04:29.232377+0000","last_fullsized":"2024-04-25T10:04:29.232377+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.241267+0000","last_change":"2024-04-25T10:04:29.249318+0000","last_active":"2024-04-25T10:04:30.241267+0000","last_peered":"2024-04-25T10:04:30.241267+0000","last_clean":"2024-04-25T10:04:30.241267+0000","last_became_active":"2024-04-25T10:04:29.249041+0000","last_became_peered":"2024-04-25T10:04:29.249041+0000","last_unstale":"2024-04-25T10:04:30.241267+0000","last_undegraded":"2024-04-25T10:04:30.241267+0000","last_fullsized":"2024-04-25T10:04:30.241267+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:43.133631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.232853+0000","last_change":"2024-04-25T10:04:29.232853+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.232853+0000","last_undegraded":"2024-04-25T10:04:29.232853+0000","last_fullsized":"2024-04-25T10:04:29.232853+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.243702+0000","last_change":"2024-04-25T10:04:29.239923+0000","last_active":"2024-04-25T10:04:29.243702+0000","last_peered":"2024-04-25T10:04:29.243702+0000","last_clean":"2024-04-25T10:04:29.243702+0000","last_became_active":"2024-04-25T10:04:29.239005+0000","last_became_peered":"2024-04-25T10:04:29.239005+0000","last_unstale":"2024-04-25T10:04:29.243702+0000","last_undegraded":"2024-04-25T10:04:29.243702+0000","last_fullsized":"2024-04-25T10:04:29.243702+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:28.667614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.254902+0000","last_change":"2024-04-25T10:04:30.246887+0000","last_active":"2024-04-25T10:04:30.254902+0000","last_peered":"2024-04-25T10:04:30.254902+0000","last_clean":"2024-04-25T10:04:30.254902+0000","last_became_active":"2024-04-25T10:04:30.246594+0000","last_became_peered":"2024-04-25T10:04:30.246594+0000","last_unstale":"2024-04-25T10:04:30.254902+0000","last_undegraded":"2024-04-25T10:04:30.254902+0000","last_fullsized":"2024-04-25T10:04:30.254902+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:36.697245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.240011+0000","last_change":"2024-04-25T10:04:29.246354+0000","last_active":"2024-04-25T10:04:30.240011+0000","last_peered":"2024-04-25T10:04:30.240011+0000","last_clean":"2024-04-25T10:04:30.240011+0000","last_became_active":"2024-04-25T10:04:29.245722+0000","last_became_peered":"2024-04-25T10:04:29.245722+0000","last_unstale":"2024-04-25T10:04:30.240011+0000","last_undegraded":"2024-04-25T10:04:30.240011+0000","last_fullsized":"2024-04-25T10:04:30.240011+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:20.061436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.232192+0000","last_change":"2024-04-25T10:04:29.232192+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.232192+0000","last_undegraded":"2024-04-25T10:04:29.232192+0000","last_fullsized":"2024-04-25T10:04:29.232192+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.250424+0000","last_change":"2024-04-25T10:04:29.249571+0000","last_active":"2024-04-25T10:04:29.250424+0000","last_peered":"2024-04-25T10:04:29.250424+0000","last_clean":"2024-04-25T10:04:29.250424+0000","last_became_active":"2024-04-25T10:04:29.249244+0000","last_became_peered":"2024-04-25T10:04:29.249244+0000","last_unstale":"2024-04-25T10:04:29.250424+0000","last_undegraded":"2024-04-25T10:04:29.250424+0000","last_fullsized":"2024-04-25T10:04:29.250424+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:20.360839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233326+0000","last_change":"2024-04-25T10:04:29.233326+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233326+0000","last_undegraded":"2024-04-25T10:04:29.233326+0000","last_fullsized":"2024-04-25T10:04:29.233326+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.243588+0000","last_change":"2024-04-25T10:04:29.247101+0000","last_active":"2024-04-25T10:04:30.243588+0000","last_peered":"2024-04-25T10:04:30.243588+0000","last_clean":"2024-04-25T10:04:30.243588+0000","last_became_active":"2024-04-25T10:04:29.246778+0000","last_became_peered":"2024-04-25T10:04:29.246778+0000","last_unstale":"2024-04-25T10:04:30.243588+0000","last_undegraded":"2024-04-25T10:04:30.243588+0000","last_fullsized":"2024-04-25T10:04:30.243588+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:48.371611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.259969+0000","last_change":"2024-04-25T10:04:30.255411+0000","last_active":"2024-04-25T10:04:30.259969+0000","last_peered":"2024-04-25T10:04:30.259969+0000","last_clean":"2024-04-25T10:04:30.259969+0000","last_became_active":"2024-04-25T10:04:30.255122+0000","last_became_peered":"2024-04-25T10:04:30.255122+0000","last_unstale":"2024-04-25T10:04:30.259969+0000","last_undegraded":"2024-04-25T10:04:30.259969+0000","last_fullsized":"2024-04-25T10:04:30.259969+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:40.380809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.245904+0000","last_change":"2024-04-25T10:04:29.249960+0000","last_active":"2024-04-25T10:04:30.245904+0000","last_peered":"2024-04-25T10:04:30.245904+0000","last_clean":"2024-04-25T10:04:30.245904+0000","last_became_active":"2024-04-25T10:04:29.249686+0000","last_became_peered":"2024-04-25T10:04:29.249686+0000","last_unstale":"2024-04-25T10:04:30.245904+0000","last_undegraded":"2024-04-25T10:04:30.245904+0000","last_fullsized":"2024-04-25T10:04:30.245904+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:14.946290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.237161+0000","last_change":"2024-04-25T10:04:29.237161+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.237161+0000","last_undegraded":"2024-04-25T10:04:29.237161+0000","last_fullsized":"2024-04-25T10:04:29.237161+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.246678+0000","last_change":"2024-04-25T10:04:29.243398+0000","last_active":"2024-04-25T10:04:29.246678+0000","last_peered":"2024-04-25T10:04:29.246678+0000","last_clean":"2024-04-25T10:04:29.246678+0000","last_became_active":"2024-04-25T10:04:29.243107+0000","last_became_peered":"2024-04-25T10:04:29.243107+0000","last_unstale":"2024-04-25T10:04:29.246678+0000","last_undegraded":"2024-04-25T10:04:29.246678+0000","last_fullsized":"2024-04-25T10:04:29.246678+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:07.262739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.233545+0000","last_change":"2024-04-25T10:04:29.233545+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.233545+0000","last_undegraded":"2024-04-25T10:04:29.233545+0000","last_fullsized":"2024-04-25T10:04:29.233545+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.234664+0000","last_change":"2024-04-25T10:04:29.248089+0000","last_active":"2024-04-25T10:04:30.234664+0000","last_peered":"2024-04-25T10:04:30.234664+0000","last_clean":"2024-04-25T10:04:30.234664+0000","last_became_active":"2024-04-25T10:04:29.247817+0000","last_became_peered":"2024-04-25T10:04:29.247817+0000","last_unstale":"2024-04-25T10:04:30.234664+0000","last_undegraded":"2024-04-25T10:04:30.234664+0000","last_fullsized":"2024-04-25T10:04:30.234664+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:48.371611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.231831+0000","last_change":"2024-04-25T10:04:29.231831+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.231831+0000","last_undegraded":"2024-04-25T10:04:29.231831+0000","last_fullsized":"2024-04-25T10:04:29.231831+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.234857+0000","last_change":"2024-04-25T10:04:29.247433+0000","last_active":"2024-04-25T10:04:30.234857+0000","last_peered":"2024-04-25T10:04:30.234857+0000","last_clean":"2024-04-25T10:04:30.234857+0000","last_became_active":"2024-04-25T10:04:29.247134+0000","last_became_peered":"2024-04-25T10:04:29.247134+0000","last_unstale":"2024-04-25T10:04:30.234857+0000","last_undegraded":"2024-04-25T10:04:30.234857+0000","last_fullsized":"2024-04-25T10:04:30.234857+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:54.240491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.263266+0000","last_change":"2024-04-25T10:04:30.262379+0000","last_active":"2024-04-25T10:04:30.263266+0000","last_peered":"2024-04-25T10:04:30.263266+0000","last_clean":"2024-04-25T10:04:30.263266+0000","last_became_active":"2024-04-25T10:04:30.262076+0000","last_became_peered":"2024-04-25T10:04:30.262076+0000","last_unstale":"2024-04-25T10:04:30.263266+0000","last_undegraded":"2024-04-25T10:04:30.263266+0000","last_fullsized":"2024-04-25T10:04:30.263266+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:12:17.828765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.249176+0000","last_change":"2024-04-25T10:04:29.244891+0000","last_active":"2024-04-25T10:04:29.249176+0000","last_peered":"2024-04-25T10:04:29.249176+0000","last_clean":"2024-04-25T10:04:29.249176+0000","last_became_active":"2024-04-25T10:04:29.244546+0000","last_became_peered":"2024-04-25T10:04:29.244546+0000","last_unstale":"2024-04-25T10:04:29.249176+0000","last_undegraded":"2024-04-25T10:04:29.249176+0000","last_fullsized":"2024-04-25T10:04:29.249176+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:18.154851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-04-25T10:04:29.232227+0000","last_change":"2024-04-25T10:04:29.232227+0000","last_active":"2024-04-25T10:04:29.215837+0000","last_peered":"2024-04-25T10:04:29.215837+0000","last_clean":"2024-04-25T10:04:29.215837+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:04:29.232227+0000","last_undegraded":"2024-04-25T10:04:29.232227+0000","last_fullsized":"2024-04-25T10:04:29.232227+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.240162+0000","last_change":"2024-04-25T10:04:29.246803+0000","last_active":"2024-04-25T10:04:30.240162+0000","last_peered":"2024-04-25T10:04:30.240162+0000","last_clean":"2024-04-25T10:04:30.240162+0000","last_became_active":"2024-04-25T10:04:29.246060+0000","last_became_peered":"2024-04-25T10:04:29.246060+0000","last_unstale":"2024-04-25T10:04:30.240162+0000","last_undegraded":"2024-04-25T10:04:30.240162+0000","last_fullsized":"2024-04-25T10:04:30.240162+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:40.143885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.260029+0000","last_change":"2024-04-25T10:04:30.256368+0000","last_active":"2024-04-25T10:04:30.260029+0000","last_peered":"2024-04-25T10:04:30.260029+0000","last_clean":"2024-04-25T10:04:30.260029+0000","last_became_active":"2024-04-25T10:04:30.255756+0000","last_became_peered":"2024-04-25T10:04:30.255756+0000","last_unstale":"2024-04-25T10:04:30.260029+0000","last_undegraded":"2024-04-25T10:04:30.260029+0000","last_fullsized":"2024-04-25T10:04:30.260029+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:51.787602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-25T10:04:29.244295+0000","last_change":"2024-04-25T10:04:29.240856+0000","last_active":"2024-04-25T10:04:29.244295+0000","last_peered":"2024-04-25T10:04:29.244295+0000","last_clean":"2024-04-25T10:04:29.244295+0000","last_became_active":"2024-04-25T10:04:29.240561+0000","last_became_peered":"2024-04-25T10:04:29.240561+0000","last_unstale":"2024-04-25T10:04:29.244295+0000","last_undegraded":"2024-04-25T10:04:29.244295+0000","last_fullsized":"2024-04-25T10:04:29.244295+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:28.747545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":347,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T10:04:30.240294+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T10:04:30.240294+0000","last_peered":"2024-04-25T10:04:30.240294+0000","last_clean":"2024-04-25T10:04:30.240294+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T10:04:30.240294+0000","last_undegraded":"2024-04-25T10:04:30.240294+0000","last_fullsized":"2024-04-25T10:04:30.240294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":742,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542270,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33184,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338656,"statfs":{"total":96636764160,"available":96602783744,"internally_reserved":0,"allocated":2052096,"data_stored":1262200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542270,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1445888,"data_stored":671638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542272,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1429504,"data_stored":663889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542269,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32600,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339240,"statfs":{"total":96636764160,"available":96603381760,"internally_reserved":0,"allocated":1454080,"data_stored":672668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574974,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1429504,"data_stored":663889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574974,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1417216,"data_stored":657222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574974,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1429504,"data_stored":663889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574974,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37320,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334520,"statfs":{"total":96636764160,"available":96598548480,"internally_reserved":0,"allocated":2023424,"data_stored":1254257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:04:36.204 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-04-25T10:04:36.199+0000 7f98edb7a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:04:37.669 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:04:37.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.777+0000 7f4c64488640 1 Processor -- start 2024-04-25T10:04:37.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.777+0000 7f4c64488640 1 -- start start 2024-04-25T10:04:37.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.778+0000 7f4c64488640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4c5c15dd00 0x7f4c5c0b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:37.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.778+0000 7f4c64488640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4c5c0b6a40 0x7f4c5c0b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:37.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.778+0000 7f4c64488640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c5c06cd00 con 0x7f4c5c06bfb0 2024-04-25T10:04:37.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.778+0000 7f4c64488640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c5c15e0e0 con 0x7f4c5c0b6a40 2024-04-25T10:04:37.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.778+0000 7f4c64488640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c06cfe0 con 0x7f4c5c15dd00 2024-04-25T10:04:37.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.779+0000 7f4c62224640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4c5c15dd00 0x7f4c5c0b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:37.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.779+0000 7f4c61a23640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4c5c0b6a40 0x7f4c5c0b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:37.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.779+0000 7f4c62224640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4c5c15dd00 0x7f4c5c0b5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:59862/0 (socket says 172.21.15.7:59862) 2024-04-25T10:04:37.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.779+0000 7f4c62224640 1 -- 172.21.15.7:0/2496200844 learned_addr learned my addr 172.21.15.7:0/2496200844 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:37.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.779+0000 7f4c62224640 1 -- 172.21.15.7:0/2496200844 >> v2:172.21.15.55:3300/0 conn(0x7f4c5c0b6a40 msgr2=0x7f4c5c0b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:37.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.779+0000 7f4c62224640 1 --2- 172.21.15.7:0/2496200844 >> v2:172.21.15.55:3300/0 conn(0x7f4c5c0b6a40 0x7f4c5c0b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.779+0000 7f4c62224640 1 -- 172.21.15.7:0/2496200844 >> v1:172.21.15.55:6789/0 conn(0x7f4c5c06bfb0 legacy=0x7f4c5c06c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:37.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.779+0000 7f4c62224640 1 -- 172.21.15.7:0/2496200844 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c5c0d1ca0 con 0x7f4c5c15dd00 2024-04-25T10:04:37.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.780+0000 7f4c62224640 1 --2- 172.21.15.7:0/2496200844 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4c5c15dd00 0x7f4c5c0b5750 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4c58009870 tx=0x7f4c5802a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=866e83efe97848d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:37.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.780+0000 7f4c61222640 1 -- 172.21.15.7:0/2496200844 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c58037070 con 0x7f4c5c15dd00 2024-04-25T10:04:37.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.780+0000 7f4c61222640 1 -- 172.21.15.7:0/2496200844 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5802ae50 con 0x7f4c5c15dd00 2024-04-25T10:04:37.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.780+0000 7f4c61222640 1 -- 172.21.15.7:0/2496200844 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c58032860 con 0x7f4c5c15dd00 2024-04-25T10:04:37.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.781+0000 7f4c64488640 1 -- 172.21.15.7:0/2496200844 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4c5c15dd00 msgr2=0x7f4c5c0b5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:37.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.781+0000 7f4c64488640 1 --2- 172.21.15.7:0/2496200844 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4c5c15dd00 0x7f4c5c0b5750 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4c58009870 tx=0x7f4c5802a300 comp rx=0 tx=0).stop 2024-04-25T10:04:37.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.781+0000 7f4c64488640 1 -- 172.21.15.7:0/2496200844 shutdown_connections 2024-04-25T10:04:37.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.781+0000 7f4c64488640 1 --2- 172.21.15.7:0/2496200844 >> v2:172.21.15.55:3300/0 conn(0x7f4c5c0b6a40 0x7f4c5c0b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.781+0000 7f4c64488640 1 --2- 172.21.15.7:0/2496200844 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4c5c15dd00 0x7f4c5c0b5750 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.781+0000 7f4c64488640 1 -- 172.21.15.7:0/2496200844 >> 172.21.15.7:0/2496200844 conn(0x7f4c5c0d07b0 msgr2=0x7f4c5c0d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:37.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.781+0000 7f4c64488640 1 -- 172.21.15.7:0/2496200844 shutdown_connections 2024-04-25T10:04:37.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.781+0000 7f4c64488640 1 -- 172.21.15.7:0/2496200844 wait complete. 2024-04-25T10:04:37.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.782+0000 7f4c64488640 1 Processor -- start 2024-04-25T10:04:37.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.782+0000 7f4c64488640 1 -- start start 2024-04-25T10:04:37.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.783+0000 7f4c64488640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c5c06bfb0 0x7f4c5c151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:37.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.783+0000 7f4c64488640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4c5c0b6a40 0x7f4c5c14f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:37.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.783+0000 7f4c64488640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c5c15dd00 0x7f4c5c15c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:37.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.783+0000 7f4c64488640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c0d2780 con 0x7f4c5c15dd00 2024-04-25T10:04:37.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.783+0000 7f4c64488640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c0d2260 con 0x7f4c5c06bfb0 2024-04-25T10:04:37.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.783+0000 7f4c64488640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c0d2900 con 0x7f4c5c0b6a40 2024-04-25T10:04:37.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.783+0000 7f4c62a25640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c5c15dd00 0x7f4c5c15c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:37.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.783+0000 7f4c62a25640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c5c15dd00 0x7f4c5c15c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47726/0 (socket says 172.21.15.7:47726) 2024-04-25T10:04:37.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.783+0000 7f4c62a25640 1 -- 172.21.15.7:0/183617309 learned_addr learned my addr 172.21.15.7:0/183617309 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:37.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.783+0000 7f4c62224640 1 --2- 172.21.15.7:0/183617309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c5c06bfb0 0x7f4c5c151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:37.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.783+0000 7f4c61a23640 1 --2- 172.21.15.7:0/183617309 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4c5c0b6a40 0x7f4c5c14f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:37.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.783+0000 7f4c62a25640 1 -- 172.21.15.7:0/183617309 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4c5c0b6a40 msgr2=0x7f4c5c14f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:37.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.783+0000 7f4c62a25640 1 --2- 172.21.15.7:0/183617309 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4c5c0b6a40 0x7f4c5c14f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.783+0000 7f4c62a25640 1 -- 172.21.15.7:0/183617309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c5c06bfb0 msgr2=0x7f4c5c151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:37.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.783+0000 7f4c62a25640 1 --2- 172.21.15.7:0/183617309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c5c06bfb0 0x7f4c5c151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.783+0000 7f4c62a25640 1 -- 172.21.15.7:0/183617309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c5c0ca9e0 con 0x7f4c5c15dd00 2024-04-25T10:04:37.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.783+0000 7f4c61a23640 1 --2- 172.21.15.7:0/183617309 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4c5c0b6a40 0x7f4c5c14f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:37.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.783+0000 7f4c62a25640 1 --2- 172.21.15.7:0/183617309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c5c15dd00 0x7f4c5c15c480 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f4c5400c7a0 tx=0x7f4c5400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:37.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.784+0000 7f4c52ffd640 1 -- 172.21.15.7:0/183617309 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c54003b70 con 0x7f4c5c15dd00 2024-04-25T10:04:37.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.784+0000 7f4c52ffd640 1 -- 172.21.15.7:0/183617309 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c54003d30 con 0x7f4c5c15dd00 2024-04-25T10:04:37.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.784+0000 7f4c64488640 1 -- 172.21.15.7:0/183617309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c5c0cacc0 con 0x7f4c5c15dd00 2024-04-25T10:04:37.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.784+0000 7f4c52ffd640 1 -- 172.21.15.7:0/183617309 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5400aa90 con 0x7f4c5c15dd00 2024-04-25T10:04:37.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.784+0000 7f4c64488640 1 -- 172.21.15.7:0/183617309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c5c0cb280 con 0x7f4c5c15dd00 2024-04-25T10:04:37.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.785+0000 7f4c64488640 1 -- 172.21.15.7:0/183617309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c5c068fd0 con 0x7f4c5c15dd00 2024-04-25T10:04:37.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.785+0000 7f4c52ffd640 1 -- 172.21.15.7:0/183617309 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4c5400ac30 con 0x7f4c5c15dd00 2024-04-25T10:04:37.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.785+0000 7f4c52ffd640 1 --2- 172.21.15.7:0/183617309 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4c4006b500 0x7f4c4006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:37.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.786+0000 7f4c52ffd640 1 -- 172.21.15.7:0/183617309 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4c5408a2c0 con 0x7f4c5c15dd00 2024-04-25T10:04:37.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.786+0000 7f4c62224640 1 --2- 172.21.15.7:0/183617309 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4c4006b500 0x7f4c4006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:37.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.786+0000 7f4c62224640 1 --2- 172.21.15.7:0/183617309 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4c4006b500 0x7f4c4006d9c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f4c58034000 tx=0x7f4c5802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:37.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.790+0000 7f4c52ffd640 1 -- 172.21.15.7:0/183617309 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4c54058fb0 con 0x7f4c5c15dd00 2024-04-25T10:04:37.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.966+0000 7f4c64488640 1 -- 172.21.15.7:0/183617309 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4c5c15c9c0 con 0x7f4c4006b500 2024-04-25T10:04:37.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.972+0000 7f4c52ffd640 1 -- 172.21.15.7:0/183617309 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252440 (secure 0 0 0) 0x7f4c5807fa30 con 0x7f4c4006b500 2024-04-25T10:04:37.980 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:37.982 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T10:04:37.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.975+0000 7f4c64488640 1 -- 172.21.15.7:0/183617309 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4c4006b500 msgr2=0x7f4c4006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:37.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.975+0000 7f4c64488640 1 --2- 172.21.15.7:0/183617309 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4c4006b500 0x7f4c4006d9c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f4c58034000 tx=0x7f4c5802e000 comp rx=0 tx=0).stop 2024-04-25T10:04:37.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.975+0000 7f4c64488640 1 -- 172.21.15.7:0/183617309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c5c15dd00 msgr2=0x7f4c5c15c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:37.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.975+0000 7f4c64488640 1 --2- 172.21.15.7:0/183617309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c5c15dd00 0x7f4c5c15c480 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f4c5400c7a0 tx=0x7f4c5400cc60 comp rx=0 tx=0).stop 2024-04-25T10:04:37.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.975+0000 7f4c64488640 1 -- 172.21.15.7:0/183617309 shutdown_connections 2024-04-25T10:04:37.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.975+0000 7f4c64488640 1 --2- 172.21.15.7:0/183617309 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4c4006b500 0x7f4c4006d9c0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.975+0000 7f4c64488640 1 --2- 172.21.15.7:0/183617309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c5c15dd00 0x7f4c5c15c480 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.975+0000 7f4c64488640 1 --2- 172.21.15.7:0/183617309 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4c5c0b6a40 0x7f4c5c14f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.975+0000 7f4c64488640 1 --2- 172.21.15.7:0/183617309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c5c06bfb0 0x7f4c5c151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.975+0000 7f4c64488640 1 -- 172.21.15.7:0/183617309 >> 172.21.15.7:0/183617309 conn(0x7f4c5c0d07b0 msgr2=0x7f4c5c0d2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:37.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.975+0000 7f4c64488640 1 -- 172.21.15.7:0/183617309 shutdown_connections 2024-04-25T10:04:37.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:37.975+0000 7f4c64488640 1 -- 172.21.15.7:0/183617309 wait complete. 2024-04-25T10:04:37.991 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":421,"stamp":"2024-04-25T10:04:35.995453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":266228,"kb_used_data":12584,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754708492,"statfs":{"total":773094113280,"available":772821495808,"internally_reserved":0,"allocated":12886016,"data_stored":6607540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":259575345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.768339"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.701959+0000","last_change":"2024-04-25T10:04:30.240506+0000","last_active":"2024-04-25T10:04:31.701959+0000","last_peered":"2024-04-25T10:04:31.701959+0000","last_clean":"2024-04-25T10:04:31.701959+0000","last_became_active":"2024-04-25T10:04:30.240146+0000","last_became_peered":"2024-04-25T10:04:30.240146+0000","last_unstale":"2024-04-25T10:04:31.701959+0000","last_undegraded":"2024-04-25T10:04:31.701959+0000","last_fullsized":"2024-04-25T10:04:31.701959+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:46:54.349361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.790754+0000","last_change":"2024-04-25T10:04:30.250573+0000","last_active":"2024-04-25T10:04:31.790754+0000","last_peered":"2024-04-25T10:04:31.790754+0000","last_clean":"2024-04-25T10:04:31.790754+0000","last_became_active":"2024-04-25T10:04:30.250319+0000","last_became_peered":"2024-04-25T10:04:30.250319+0000","last_unstale":"2024-04-25T10:04:31.790754+0000","last_undegraded":"2024-04-25T10:04:31.790754+0000","last_fullsized":"2024-04-25T10:04:31.790754+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:47.160698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.790800+0000","last_change":"2024-04-25T10:04:30.253694+0000","last_active":"2024-04-25T10:04:31.790800+0000","last_peered":"2024-04-25T10:04:31.790800+0000","last_clean":"2024-04-25T10:04:31.790800+0000","last_became_active":"2024-04-25T10:04:30.253398+0000","last_became_peered":"2024-04-25T10:04:30.253398+0000","last_unstale":"2024-04-25T10:04:31.790800+0000","last_undegraded":"2024-04-25T10:04:31.790800+0000","last_fullsized":"2024-04-25T10:04:31.790800+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:08.279268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.791620+0000","last_change":"2024-04-25T10:04:30.252147+0000","last_active":"2024-04-25T10:04:31.791620+0000","last_peered":"2024-04-25T10:04:31.791620+0000","last_clean":"2024-04-25T10:04:31.791620+0000","last_became_active":"2024-04-25T10:04:30.251836+0000","last_became_peered":"2024-04-25T10:04:30.251836+0000","last_unstale":"2024-04-25T10:04:31.791620+0000","last_undegraded":"2024-04-25T10:04:31.791620+0000","last_fullsized":"2024-04-25T10:04:31.791620+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:30.953464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.701554+0000","last_change":"2024-04-25T10:04:30.252200+0000","last_active":"2024-04-25T10:04:31.701554+0000","last_peered":"2024-04-25T10:04:31.701554+0000","last_clean":"2024-04-25T10:04:31.701554+0000","last_became_active":"2024-04-25T10:04:30.251902+0000","last_became_peered":"2024-04-25T10:04:30.251902+0000","last_unstale":"2024-04-25T10:04:31.701554+0000","last_undegraded":"2024-04-25T10:04:31.701554+0000","last_fullsized":"2024-04-25T10:04:31.701554+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:34.725496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.733356+0000","last_change":"2024-04-25T10:04:30.254395+0000","last_active":"2024-04-25T10:04:31.733356+0000","last_peered":"2024-04-25T10:04:31.733356+0000","last_clean":"2024-04-25T10:04:31.733356+0000","last_became_active":"2024-04-25T10:04:30.254123+0000","last_became_peered":"2024-04-25T10:04:30.254123+0000","last_unstale":"2024-04-25T10:04:31.733356+0000","last_undegraded":"2024-04-25T10:04:31.733356+0000","last_fullsized":"2024-04-25T10:04:31.733356+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:32.495454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.733276+0000","last_change":"2024-04-25T10:04:30.256440+0000","last_active":"2024-04-25T10:04:31.733276+0000","last_peered":"2024-04-25T10:04:31.733276+0000","last_clean":"2024-04-25T10:04:31.733276+0000","last_became_active":"2024-04-25T10:04:30.256161+0000","last_became_peered":"2024-04-25T10:04:30.256161+0000","last_unstale":"2024-04-25T10:04:31.733276+0000","last_undegraded":"2024-04-25T10:04:31.733276+0000","last_fullsized":"2024-04-25T10:04:31.733276+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:55.245108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.790417+0000","last_change":"2024-04-25T10:04:30.255114+0000","last_active":"2024-04-25T10:04:31.790417+0000","last_peered":"2024-04-25T10:04:31.790417+0000","last_clean":"2024-04-25T10:04:31.790417+0000","last_became_active":"2024-04-25T10:04:30.254719+0000","last_became_peered":"2024-04-25T10:04:30.254719+0000","last_unstale":"2024-04-25T10:04:31.790417+0000","last_undegraded":"2024-04-25T10:04:31.790417+0000","last_fullsized":"2024-04-25T10:04:31.790417+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:56.328210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.791993+0000","last_change":"2024-04-25T10:04:30.256927+0000","last_active":"2024-04-25T10:04:31.791993+0000","last_peered":"2024-04-25T10:04:31.791993+0000","last_clean":"2024-04-25T10:04:31.791993+0000","last_became_active":"2024-04-25T10:04:30.255115+0000","last_became_peered":"2024-04-25T10:04:30.255115+0000","last_unstale":"2024-04-25T10:04:31.791993+0000","last_undegraded":"2024-04-25T10:04:31.791993+0000","last_fullsized":"2024-04-25T10:04:31.791993+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:54.364584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.240186+0000","last_change":"2024-04-25T10:04:30.245072+0000","last_active":"2024-04-25T10:04:31.240186+0000","last_peered":"2024-04-25T10:04:31.240186+0000","last_clean":"2024-04-25T10:04:31.240186+0000","last_became_active":"2024-04-25T10:04:30.244780+0000","last_became_peered":"2024-04-25T10:04:30.244780+0000","last_unstale":"2024-04-25T10:04:31.240186+0000","last_undegraded":"2024-04-25T10:04:31.240186+0000","last_fullsized":"2024-04-25T10:04:31.240186+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:03.353003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.701807+0000","last_change":"2024-04-25T10:04:30.245678+0000","last_active":"2024-04-25T10:04:31.701807+0000","last_peered":"2024-04-25T10:04:31.701807+0000","last_clean":"2024-04-25T10:04:31.701807+0000","last_became_active":"2024-04-25T10:04:30.245363+0000","last_became_peered":"2024-04-25T10:04:30.245363+0000","last_unstale":"2024-04-25T10:04:31.701807+0000","last_undegraded":"2024-04-25T10:04:31.701807+0000","last_fullsized":"2024-04-25T10:04:31.701807+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:56:46.072939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.733692+0000","last_change":"2024-04-25T10:04:30.248027+0000","last_active":"2024-04-25T10:04:31.733692+0000","last_peered":"2024-04-25T10:04:31.733692+0000","last_clean":"2024-04-25T10:04:31.733692+0000","last_became_active":"2024-04-25T10:04:30.246891+0000","last_became_peered":"2024-04-25T10:04:30.246891+0000","last_unstale":"2024-04-25T10:04:31.733692+0000","last_undegraded":"2024-04-25T10:04:31.733692+0000","last_fullsized":"2024-04-25T10:04:31.733692+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:56.997663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.239860+0000","last_change":"2024-04-25T10:04:30.244657+0000","last_active":"2024-04-25T10:04:31.239860+0000","last_peered":"2024-04-25T10:04:31.239860+0000","last_clean":"2024-04-25T10:04:31.239860+0000","last_became_active":"2024-04-25T10:04:30.244343+0000","last_became_peered":"2024-04-25T10:04:30.244343+0000","last_unstale":"2024-04-25T10:04:31.239860+0000","last_undegraded":"2024-04-25T10:04:31.239860+0000","last_fullsized":"2024-04-25T10:04:31.239860+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:25.171859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.790954+0000","last_change":"2024-04-25T10:04:30.253944+0000","last_active":"2024-04-25T10:04:31.790954+0000","last_peered":"2024-04-25T10:04:31.790954+0000","last_clean":"2024-04-25T10:04:31.790954+0000","last_became_active":"2024-04-25T10:04:30.253661+0000","last_became_peered":"2024-04-25T10:04:30.253661+0000","last_unstale":"2024-04-25T10:04:31.790954+0000","last_undegraded":"2024-04-25T10:04:31.790954+0000","last_fullsized":"2024-04-25T10:04:31.790954+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:56.614981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.701382+0000","last_change":"2024-04-25T10:04:30.246368+0000","last_active":"2024-04-25T10:04:31.701382+0000","last_peered":"2024-04-25T10:04:31.701382+0000","last_clean":"2024-04-25T10:04:31.701382+0000","last_became_active":"2024-04-25T10:04:30.246100+0000","last_became_peered":"2024-04-25T10:04:30.246100+0000","last_unstale":"2024-04-25T10:04:31.701382+0000","last_undegraded":"2024-04-25T10:04:31.701382+0000","last_fullsized":"2024-04-25T10:04:31.701382+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:13.746169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.733231+0000","last_change":"2024-04-25T10:04:30.249688+0000","last_active":"2024-04-25T10:04:31.733231+0000","last_peered":"2024-04-25T10:04:31.733231+0000","last_clean":"2024-04-25T10:04:31.733231+0000","last_became_active":"2024-04-25T10:04:30.248892+0000","last_became_peered":"2024-04-25T10:04:30.248892+0000","last_unstale":"2024-04-25T10:04:31.733231+0000","last_undegraded":"2024-04-25T10:04:31.733231+0000","last_fullsized":"2024-04-25T10:04:31.733231+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:11.991002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.240037+0000","last_change":"2024-04-25T10:04:30.247009+0000","last_active":"2024-04-25T10:04:31.240037+0000","last_peered":"2024-04-25T10:04:31.240037+0000","last_clean":"2024-04-25T10:04:31.240037+0000","last_became_active":"2024-04-25T10:04:30.246744+0000","last_became_peered":"2024-04-25T10:04:30.246744+0000","last_unstale":"2024-04-25T10:04:31.240037+0000","last_undegraded":"2024-04-25T10:04:31.240037+0000","last_fullsized":"2024-04-25T10:04:31.240037+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:16.033392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.790840+0000","last_change":"2024-04-25T10:04:30.249856+0000","last_active":"2024-04-25T10:04:31.790840+0000","last_peered":"2024-04-25T10:04:31.790840+0000","last_clean":"2024-04-25T10:04:31.790840+0000","last_became_active":"2024-04-25T10:04:30.249585+0000","last_became_peered":"2024-04-25T10:04:30.249585+0000","last_unstale":"2024-04-25T10:04:31.790840+0000","last_undegraded":"2024-04-25T10:04:31.790840+0000","last_fullsized":"2024-04-25T10:04:31.790840+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:19.171381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.791289+0000","last_change":"2024-04-25T10:04:30.254496+0000","last_active":"2024-04-25T10:04:31.791289+0000","last_peered":"2024-04-25T10:04:31.791289+0000","last_clean":"2024-04-25T10:04:31.791289+0000","last_became_active":"2024-04-25T10:04:30.254205+0000","last_became_peered":"2024-04-25T10:04:30.254205+0000","last_unstale":"2024-04-25T10:04:31.791289+0000","last_undegraded":"2024-04-25T10:04:31.791289+0000","last_fullsized":"2024-04-25T10:04:31.791289+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:13.746169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.242131+0000","last_change":"2024-04-25T10:04:30.251276+0000","last_active":"2024-04-25T10:04:31.242131+0000","last_peered":"2024-04-25T10:04:31.242131+0000","last_clean":"2024-04-25T10:04:31.242131+0000","last_became_active":"2024-04-25T10:04:30.251005+0000","last_became_peered":"2024-04-25T10:04:30.251005+0000","last_unstale":"2024-04-25T10:04:31.242131+0000","last_undegraded":"2024-04-25T10:04:31.242131+0000","last_fullsized":"2024-04-25T10:04:31.242131+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:13.568812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.791913+0000","last_change":"2024-04-25T10:04:30.256744+0000","last_active":"2024-04-25T10:04:31.791913+0000","last_peered":"2024-04-25T10:04:31.791913+0000","last_clean":"2024-04-25T10:04:31.791913+0000","last_became_active":"2024-04-25T10:04:30.256064+0000","last_became_peered":"2024-04-25T10:04:30.256064+0000","last_unstale":"2024-04-25T10:04:31.791913+0000","last_undegraded":"2024-04-25T10:04:31.791913+0000","last_fullsized":"2024-04-25T10:04:31.791913+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:50:11.797858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.701643+0000","last_change":"2024-04-25T10:04:30.244355+0000","last_active":"2024-04-25T10:04:31.701643+0000","last_peered":"2024-04-25T10:04:31.701643+0000","last_clean":"2024-04-25T10:04:31.701643+0000","last_became_active":"2024-04-25T10:04:30.244028+0000","last_became_peered":"2024-04-25T10:04:30.244028+0000","last_unstale":"2024-04-25T10:04:31.701643+0000","last_undegraded":"2024-04-25T10:04:31.701643+0000","last_fullsized":"2024-04-25T10:04:31.701643+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:16.033392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.791510+0000","last_change":"2024-04-25T10:04:30.253400+0000","last_active":"2024-04-25T10:04:31.791510+0000","last_peered":"2024-04-25T10:04:31.791510+0000","last_clean":"2024-04-25T10:04:31.791510+0000","last_became_active":"2024-04-25T10:04:30.253118+0000","last_became_peered":"2024-04-25T10:04:30.253118+0000","last_unstale":"2024-04-25T10:04:31.791510+0000","last_undegraded":"2024-04-25T10:04:31.791510+0000","last_fullsized":"2024-04-25T10:04:31.791510+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:58.618464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.344824+0000","last_change":"2024-04-25T10:04:30.258434+0000","last_active":"2024-04-25T10:04:31.344824+0000","last_peered":"2024-04-25T10:04:31.344824+0000","last_clean":"2024-04-25T10:04:31.344824+0000","last_became_active":"2024-04-25T10:04:30.258149+0000","last_became_peered":"2024-04-25T10:04:30.258149+0000","last_unstale":"2024-04-25T10:04:31.344824+0000","last_undegraded":"2024-04-25T10:04:31.344824+0000","last_fullsized":"2024-04-25T10:04:31.344824+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:06.659437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.345202+0000","last_change":"2024-04-25T10:04:30.248070+0000","last_active":"2024-04-25T10:04:31.345202+0000","last_peered":"2024-04-25T10:04:31.345202+0000","last_clean":"2024-04-25T10:04:31.345202+0000","last_became_active":"2024-04-25T10:04:30.247788+0000","last_became_peered":"2024-04-25T10:04:30.247788+0000","last_unstale":"2024-04-25T10:04:31.345202+0000","last_undegraded":"2024-04-25T10:04:31.345202+0000","last_fullsized":"2024-04-25T10:04:31.345202+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:18.594115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.242270+0000","last_change":"2024-04-25T10:04:30.243475+0000","last_active":"2024-04-25T10:04:31.242270+0000","last_peered":"2024-04-25T10:04:31.242270+0000","last_clean":"2024-04-25T10:04:31.242270+0000","last_became_active":"2024-04-25T10:04:30.243187+0000","last_became_peered":"2024-04-25T10:04:30.243187+0000","last_unstale":"2024-04-25T10:04:31.242270+0000","last_undegraded":"2024-04-25T10:04:31.242270+0000","last_fullsized":"2024-04-25T10:04:31.242270+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:56:27.601466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.791471+0000","last_change":"2024-04-25T10:04:30.254462+0000","last_active":"2024-04-25T10:04:31.791471+0000","last_peered":"2024-04-25T10:04:31.791471+0000","last_clean":"2024-04-25T10:04:31.791471+0000","last_became_active":"2024-04-25T10:04:30.253993+0000","last_became_peered":"2024-04-25T10:04:30.253993+0000","last_unstale":"2024-04-25T10:04:31.791471+0000","last_undegraded":"2024-04-25T10:04:31.791471+0000","last_fullsized":"2024-04-25T10:04:31.791471+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:36.697245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.733675+0000","last_change":"2024-04-25T10:04:30.247528+0000","last_active":"2024-04-25T10:04:31.733675+0000","last_peered":"2024-04-25T10:04:31.733675+0000","last_clean":"2024-04-25T10:04:31.733675+0000","last_became_active":"2024-04-25T10:04:30.246907+0000","last_became_peered":"2024-04-25T10:04:30.246907+0000","last_unstale":"2024-04-25T10:04:31.733675+0000","last_undegraded":"2024-04-25T10:04:31.733675+0000","last_fullsized":"2024-04-25T10:04:31.733675+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:01.478218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.242271+0000","last_change":"2024-04-25T10:04:30.249228+0000","last_active":"2024-04-25T10:04:31.242271+0000","last_peered":"2024-04-25T10:04:31.242271+0000","last_clean":"2024-04-25T10:04:31.242271+0000","last_became_active":"2024-04-25T10:04:30.248944+0000","last_became_peered":"2024-04-25T10:04:30.248944+0000","last_unstale":"2024-04-25T10:04:31.242271+0000","last_undegraded":"2024-04-25T10:04:31.242271+0000","last_fullsized":"2024-04-25T10:04:31.242271+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:27:50.466246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.790565+0000","last_change":"2024-04-25T10:04:30.241253+0000","last_active":"2024-04-25T10:04:31.790565+0000","last_peered":"2024-04-25T10:04:31.790565+0000","last_clean":"2024-04-25T10:04:31.790565+0000","last_became_active":"2024-04-25T10:04:30.240905+0000","last_became_peered":"2024-04-25T10:04:30.240905+0000","last_unstale":"2024-04-25T10:04:31.790565+0000","last_undegraded":"2024-04-25T10:04:31.790565+0000","last_fullsized":"2024-04-25T10:04:31.790565+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:13.023552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.345005+0000","last_change":"2024-04-25T10:04:30.245661+0000","last_active":"2024-04-25T10:04:31.345005+0000","last_peered":"2024-04-25T10:04:31.345005+0000","last_clean":"2024-04-25T10:04:31.345005+0000","last_became_active":"2024-04-25T10:04:30.245371+0000","last_became_peered":"2024-04-25T10:04:30.245371+0000","last_unstale":"2024-04-25T10:04:31.345005+0000","last_undegraded":"2024-04-25T10:04:31.345005+0000","last_fullsized":"2024-04-25T10:04:31.345005+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:44.150161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.344818+0000","last_change":"2024-04-25T10:04:30.258292+0000","last_active":"2024-04-25T10:04:31.344818+0000","last_peered":"2024-04-25T10:04:31.344818+0000","last_clean":"2024-04-25T10:04:31.344818+0000","last_became_active":"2024-04-25T10:04:30.257766+0000","last_became_peered":"2024-04-25T10:04:30.257766+0000","last_unstale":"2024-04-25T10:04:31.344818+0000","last_undegraded":"2024-04-25T10:04:31.344818+0000","last_fullsized":"2024-04-25T10:04:31.344818+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:21.077965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.240112+0000","last_change":"2024-04-25T10:04:30.245965+0000","last_active":"2024-04-25T10:04:31.240112+0000","last_peered":"2024-04-25T10:04:31.240112+0000","last_clean":"2024-04-25T10:04:31.240112+0000","last_became_active":"2024-04-25T10:04:30.245684+0000","last_became_peered":"2024-04-25T10:04:30.245684+0000","last_unstale":"2024-04-25T10:04:31.240112+0000","last_undegraded":"2024-04-25T10:04:31.240112+0000","last_fullsized":"2024-04-25T10:04:31.240112+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:56:46.072939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"116'4","reported_seq":18,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.791879+0000","last_change":"2024-04-25T10:04:29.246635+0000","last_active":"2024-04-25T10:04:31.791879+0000","last_peered":"2024-04-25T10:04:31.791879+0000","last_clean":"2024-04-25T10:04:31.791879+0000","last_became_active":"2024-04-25T10:04:29.246149+0000","last_became_peered":"2024-04-25T10:04:29.246149+0000","last_unstale":"2024-04-25T10:04:31.791879+0000","last_undegraded":"2024-04-25T10:04:31.791879+0000","last_fullsized":"2024-04-25T10:04:31.791879+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:54.240491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.733619+0000","last_change":"2024-04-25T10:04:30.252112+0000","last_active":"2024-04-25T10:04:31.733619+0000","last_peered":"2024-04-25T10:04:31.733619+0000","last_clean":"2024-04-25T10:04:31.733619+0000","last_became_active":"2024-04-25T10:04:30.251831+0000","last_became_peered":"2024-04-25T10:04:30.251831+0000","last_unstale":"2024-04-25T10:04:31.733619+0000","last_undegraded":"2024-04-25T10:04:31.733619+0000","last_fullsized":"2024-04-25T10:04:31.733619+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:46.425361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"116'1","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.240164+0000","last_change":"2024-04-25T10:04:29.241014+0000","last_active":"2024-04-25T10:04:31.240164+0000","last_peered":"2024-04-25T10:04:31.240164+0000","last_clean":"2024-04-25T10:04:31.240164+0000","last_became_active":"2024-04-25T10:04:29.240747+0000","last_became_peered":"2024-04-25T10:04:29.240747+0000","last_unstale":"2024-04-25T10:04:31.240164+0000","last_undegraded":"2024-04-25T10:04:31.240164+0000","last_fullsized":"2024-04-25T10:04:31.240164+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:49.986002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.345201+0000","last_change":"2024-04-25T10:04:30.258097+0000","last_active":"2024-04-25T10:04:31.345201+0000","last_peered":"2024-04-25T10:04:31.345201+0000","last_clean":"2024-04-25T10:04:31.345201+0000","last_became_active":"2024-04-25T10:04:30.257788+0000","last_became_peered":"2024-04-25T10:04:30.257788+0000","last_unstale":"2024-04-25T10:04:31.345201+0000","last_undegraded":"2024-04-25T10:04:31.345201+0000","last_fullsized":"2024-04-25T10:04:31.345201+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:27.545334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"116'2","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.791925+0000","last_change":"2024-04-25T10:04:29.247462+0000","last_active":"2024-04-25T10:04:31.791925+0000","last_peered":"2024-04-25T10:04:31.791925+0000","last_clean":"2024-04-25T10:04:31.791925+0000","last_became_active":"2024-04-25T10:04:29.247192+0000","last_became_peered":"2024-04-25T10:04:29.247192+0000","last_unstale":"2024-04-25T10:04:31.791925+0000","last_undegraded":"2024-04-25T10:04:31.791925+0000","last_fullsized":"2024-04-25T10:04:31.791925+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:17.577585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.792146+0000","last_change":"2024-04-25T10:04:30.263430+0000","last_active":"2024-04-25T10:04:31.792146+0000","last_peered":"2024-04-25T10:04:31.792146+0000","last_clean":"2024-04-25T10:04:31.792146+0000","last_became_active":"2024-04-25T10:04:30.263105+0000","last_became_peered":"2024-04-25T10:04:30.263105+0000","last_unstale":"2024-04-25T10:04:31.792146+0000","last_undegraded":"2024-04-25T10:04:31.792146+0000","last_fullsized":"2024-04-25T10:04:31.792146+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:56.328210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"116'2","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.240101+0000","last_change":"2024-04-25T10:04:29.240963+0000","last_active":"2024-04-25T10:04:31.240101+0000","last_peered":"2024-04-25T10:04:31.240101+0000","last_clean":"2024-04-25T10:04:31.240101+0000","last_became_active":"2024-04-25T10:04:29.240676+0000","last_became_peered":"2024-04-25T10:04:29.240676+0000","last_unstale":"2024-04-25T10:04:31.240101+0000","last_undegraded":"2024-04-25T10:04:31.240101+0000","last_fullsized":"2024-04-25T10:04:31.240101+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:43.795899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.239845+0000","last_change":"2024-04-25T10:04:30.253635+0000","last_active":"2024-04-25T10:04:31.239845+0000","last_peered":"2024-04-25T10:04:31.239845+0000","last_clean":"2024-04-25T10:04:31.239845+0000","last_became_active":"2024-04-25T10:04:30.253380+0000","last_became_peered":"2024-04-25T10:04:30.253380+0000","last_unstale":"2024-04-25T10:04:31.239845+0000","last_undegraded":"2024-04-25T10:04:31.239845+0000","last_fullsized":"2024-04-25T10:04:31.239845+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:45.747180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"116'1","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.701510+0000","last_change":"2024-04-25T10:04:29.245168+0000","last_active":"2024-04-25T10:04:31.701510+0000","last_peered":"2024-04-25T10:04:31.701510+0000","last_clean":"2024-04-25T10:04:31.701510+0000","last_became_active":"2024-04-25T10:04:29.244887+0000","last_became_peered":"2024-04-25T10:04:29.244887+0000","last_unstale":"2024-04-25T10:04:31.701510+0000","last_undegraded":"2024-04-25T10:04:31.701510+0000","last_fullsized":"2024-04-25T10:04:31.701510+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:05.046287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.701397+0000","last_change":"2024-04-25T10:04:30.249301+0000","last_active":"2024-04-25T10:04:31.701397+0000","last_peered":"2024-04-25T10:04:31.701397+0000","last_clean":"2024-04-25T10:04:31.701397+0000","last_became_active":"2024-04-25T10:04:30.249015+0000","last_became_peered":"2024-04-25T10:04:30.249015+0000","last_unstale":"2024-04-25T10:04:31.701397+0000","last_undegraded":"2024-04-25T10:04:31.701397+0000","last_fullsized":"2024-04-25T10:04:31.701397+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:36.697245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"116'1","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.733397+0000","last_change":"2024-04-25T10:04:29.242148+0000","last_active":"2024-04-25T10:04:31.733397+0000","last_peered":"2024-04-25T10:04:31.733397+0000","last_clean":"2024-04-25T10:04:31.733397+0000","last_became_active":"2024-04-25T10:04:29.241863+0000","last_became_peered":"2024-04-25T10:04:29.241863+0000","last_unstale":"2024-04-25T10:04:31.733397+0000","last_undegraded":"2024-04-25T10:04:31.733397+0000","last_fullsized":"2024-04-25T10:04:31.733397+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:38.554513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.790726+0000","last_change":"2024-04-25T10:04:30.246185+0000","last_active":"2024-04-25T10:04:31.790726+0000","last_peered":"2024-04-25T10:04:31.790726+0000","last_clean":"2024-04-25T10:04:31.790726+0000","last_became_active":"2024-04-25T10:04:30.245829+0000","last_became_peered":"2024-04-25T10:04:30.245829+0000","last_unstale":"2024-04-25T10:04:31.790726+0000","last_undegraded":"2024-04-25T10:04:31.790726+0000","last_fullsized":"2024-04-25T10:04:31.790726+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:18.703074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.345016+0000","last_change":"2024-04-25T10:04:29.245895+0000","last_active":"2024-04-25T10:04:31.345016+0000","last_peered":"2024-04-25T10:04:31.345016+0000","last_clean":"2024-04-25T10:04:31.345016+0000","last_became_active":"2024-04-25T10:04:29.245618+0000","last_became_peered":"2024-04-25T10:04:29.245618+0000","last_unstale":"2024-04-25T10:04:31.345016+0000","last_undegraded":"2024-04-25T10:04:31.345016+0000","last_fullsized":"2024-04-25T10:04:31.345016+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:41.138715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.240017+0000","last_change":"2024-04-25T10:04:30.252609+0000","last_active":"2024-04-25T10:04:31.240017+0000","last_peered":"2024-04-25T10:04:31.240017+0000","last_clean":"2024-04-25T10:04:31.240017+0000","last_became_active":"2024-04-25T10:04:30.252317+0000","last_became_peered":"2024-04-25T10:04:30.252317+0000","last_unstale":"2024-04-25T10:04:31.240017+0000","last_undegraded":"2024-04-25T10:04:31.240017+0000","last_fullsized":"2024-04-25T10:04:31.240017+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:34.725496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.733504+0000","last_change":"2024-04-25T10:04:29.243321+0000","last_active":"2024-04-25T10:04:31.733504+0000","last_peered":"2024-04-25T10:04:31.733504+0000","last_clean":"2024-04-25T10:04:31.733504+0000","last_became_active":"2024-04-25T10:04:29.242993+0000","last_became_peered":"2024-04-25T10:04:29.242993+0000","last_unstale":"2024-04-25T10:04:31.733504+0000","last_undegraded":"2024-04-25T10:04:31.733504+0000","last_fullsized":"2024-04-25T10:04:31.733504+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:05:21.683674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.791129+0000","last_change":"2024-04-25T10:04:30.259351+0000","last_active":"2024-04-25T10:04:31.791129+0000","last_peered":"2024-04-25T10:04:31.791129+0000","last_clean":"2024-04-25T10:04:31.791129+0000","last_became_active":"2024-04-25T10:04:30.259032+0000","last_became_peered":"2024-04-25T10:04:30.259032+0000","last_unstale":"2024-04-25T10:04:31.791129+0000","last_undegraded":"2024-04-25T10:04:31.791129+0000","last_fullsized":"2024-04-25T10:04:31.791129+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:45.747180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.791893+0000","last_change":"2024-04-25T10:04:29.249960+0000","last_active":"2024-04-25T10:04:31.791893+0000","last_peered":"2024-04-25T10:04:31.791893+0000","last_clean":"2024-04-25T10:04:31.791893+0000","last_became_active":"2024-04-25T10:04:29.249622+0000","last_became_peered":"2024-04-25T10:04:29.249622+0000","last_unstale":"2024-04-25T10:04:31.791893+0000","last_undegraded":"2024-04-25T10:04:31.791893+0000","last_fullsized":"2024-04-25T10:04:31.791893+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:26.264680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.345220+0000","last_change":"2024-04-25T10:04:30.254839+0000","last_active":"2024-04-25T10:04:31.345220+0000","last_peered":"2024-04-25T10:04:31.345220+0000","last_clean":"2024-04-25T10:04:31.345220+0000","last_became_active":"2024-04-25T10:04:30.252585+0000","last_became_peered":"2024-04-25T10:04:30.252585+0000","last_unstale":"2024-04-25T10:04:31.345220+0000","last_undegraded":"2024-04-25T10:04:31.345220+0000","last_fullsized":"2024-04-25T10:04:31.345220+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:24.510668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.345013+0000","last_change":"2024-04-25T10:04:29.245786+0000","last_active":"2024-04-25T10:04:31.345013+0000","last_peered":"2024-04-25T10:04:31.345013+0000","last_clean":"2024-04-25T10:04:31.345013+0000","last_became_active":"2024-04-25T10:04:29.245467+0000","last_became_peered":"2024-04-25T10:04:29.245467+0000","last_unstale":"2024-04-25T10:04:31.345013+0000","last_undegraded":"2024-04-25T10:04:31.345013+0000","last_fullsized":"2024-04-25T10:04:31.345013+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:17.927919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.790923+0000","last_change":"2024-04-25T10:04:30.254285+0000","last_active":"2024-04-25T10:04:31.790923+0000","last_peered":"2024-04-25T10:04:31.790923+0000","last_clean":"2024-04-25T10:04:31.790923+0000","last_became_active":"2024-04-25T10:04:30.253998+0000","last_became_peered":"2024-04-25T10:04:30.253998+0000","last_unstale":"2024-04-25T10:04:31.790923+0000","last_undegraded":"2024-04-25T10:04:31.790923+0000","last_fullsized":"2024-04-25T10:04:31.790923+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:21.377368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"116'3","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.345278+0000","last_change":"2024-04-25T10:04:29.248775+0000","last_active":"2024-04-25T10:04:31.345278+0000","last_peered":"2024-04-25T10:04:31.345278+0000","last_clean":"2024-04-25T10:04:31.345278+0000","last_became_active":"2024-04-25T10:04:29.248484+0000","last_became_peered":"2024-04-25T10:04:29.248484+0000","last_unstale":"2024-04-25T10:04:31.345278+0000","last_undegraded":"2024-04-25T10:04:31.345278+0000","last_fullsized":"2024-04-25T10:04:31.345278+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:09.043701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.345192+0000","last_change":"2024-04-25T10:04:30.246946+0000","last_active":"2024-04-25T10:04:31.345192+0000","last_peered":"2024-04-25T10:04:31.345192+0000","last_clean":"2024-04-25T10:04:31.345192+0000","last_became_active":"2024-04-25T10:04:30.246636+0000","last_became_peered":"2024-04-25T10:04:30.246636+0000","last_unstale":"2024-04-25T10:04:31.345192+0000","last_undegraded":"2024-04-25T10:04:31.345192+0000","last_fullsized":"2024-04-25T10:04:31.345192+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:08.914097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"116'6","reported_seq":20,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.790711+0000","last_change":"2024-04-25T10:04:29.248492+0000","last_active":"2024-04-25T10:04:31.790711+0000","last_peered":"2024-04-25T10:04:31.790711+0000","last_clean":"2024-04-25T10:04:31.790711+0000","last_became_active":"2024-04-25T10:04:29.248184+0000","last_became_peered":"2024-04-25T10:04:29.248184+0000","last_unstale":"2024-04-25T10:04:31.790711+0000","last_undegraded":"2024-04-25T10:04:31.790711+0000","last_fullsized":"2024-04-25T10:04:31.790711+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:23.494138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.791282+0000","last_change":"2024-04-25T10:04:30.252044+0000","last_active":"2024-04-25T10:04:31.791282+0000","last_peered":"2024-04-25T10:04:31.791282+0000","last_clean":"2024-04-25T10:04:31.791282+0000","last_became_active":"2024-04-25T10:04:30.251299+0000","last_became_peered":"2024-04-25T10:04:30.251299+0000","last_unstale":"2024-04-25T10:04:31.791282+0000","last_undegraded":"2024-04-25T10:04:31.791282+0000","last_fullsized":"2024-04-25T10:04:31.791282+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:25.171859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"116'2","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.790568+0000","last_change":"2024-04-25T10:04:29.246443+0000","last_active":"2024-04-25T10:04:31.790568+0000","last_peered":"2024-04-25T10:04:31.790568+0000","last_clean":"2024-04-25T10:04:31.790568+0000","last_became_active":"2024-04-25T10:04:29.245766+0000","last_became_peered":"2024-04-25T10:04:29.245766+0000","last_unstale":"2024-04-25T10:04:31.790568+0000","last_undegraded":"2024-04-25T10:04:31.790568+0000","last_fullsized":"2024-04-25T10:04:31.790568+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:43.133631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.239911+0000","last_change":"2024-04-25T10:04:30.256677+0000","last_active":"2024-04-25T10:04:31.239911+0000","last_peered":"2024-04-25T10:04:31.239911+0000","last_clean":"2024-04-25T10:04:31.239911+0000","last_became_active":"2024-04-25T10:04:30.256382+0000","last_became_peered":"2024-04-25T10:04:30.256382+0000","last_unstale":"2024-04-25T10:04:31.239911+0000","last_undegraded":"2024-04-25T10:04:31.239911+0000","last_fullsized":"2024-04-25T10:04:31.239911+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:13.746169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.790973+0000","last_change":"2024-04-25T10:04:29.242805+0000","last_active":"2024-04-25T10:04:31.790973+0000","last_peered":"2024-04-25T10:04:31.790973+0000","last_clean":"2024-04-25T10:04:31.790973+0000","last_became_active":"2024-04-25T10:04:29.242435+0000","last_became_peered":"2024-04-25T10:04:29.242435+0000","last_unstale":"2024-04-25T10:04:31.790973+0000","last_undegraded":"2024-04-25T10:04:31.790973+0000","last_fullsized":"2024-04-25T10:04:31.790973+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:39.364280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.242038+0000","last_change":"2024-04-25T10:04:30.248771+0000","last_active":"2024-04-25T10:04:31.242038+0000","last_peered":"2024-04-25T10:04:31.242038+0000","last_clean":"2024-04-25T10:04:31.242038+0000","last_became_active":"2024-04-25T10:04:30.248499+0000","last_became_peered":"2024-04-25T10:04:30.248499+0000","last_unstale":"2024-04-25T10:04:31.242038+0000","last_undegraded":"2024-04-25T10:04:31.242038+0000","last_fullsized":"2024-04-25T10:04:31.242038+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:56.976297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.790601+0000","last_change":"2024-04-25T10:04:29.245970+0000","last_active":"2024-04-25T10:04:31.790601+0000","last_peered":"2024-04-25T10:04:31.790601+0000","last_clean":"2024-04-25T10:04:31.790601+0000","last_became_active":"2024-04-25T10:04:29.245667+0000","last_became_peered":"2024-04-25T10:04:29.245667+0000","last_unstale":"2024-04-25T10:04:31.790601+0000","last_undegraded":"2024-04-25T10:04:31.790601+0000","last_fullsized":"2024-04-25T10:04:31.790601+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:07.897567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.345264+0000","last_change":"2024-04-25T10:04:30.251298+0000","last_active":"2024-04-25T10:04:31.345264+0000","last_peered":"2024-04-25T10:04:31.345264+0000","last_clean":"2024-04-25T10:04:31.345264+0000","last_became_active":"2024-04-25T10:04:30.251021+0000","last_became_peered":"2024-04-25T10:04:30.251021+0000","last_unstale":"2024-04-25T10:04:31.345264+0000","last_undegraded":"2024-04-25T10:04:31.345264+0000","last_fullsized":"2024-04-25T10:04:31.345264+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:40.380809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"116'1","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.240071+0000","last_change":"2024-04-25T10:04:29.247771+0000","last_active":"2024-04-25T10:04:31.240071+0000","last_peered":"2024-04-25T10:04:31.240071+0000","last_clean":"2024-04-25T10:04:31.240071+0000","last_became_active":"2024-04-25T10:04:29.247178+0000","last_became_peered":"2024-04-25T10:04:29.247178+0000","last_unstale":"2024-04-25T10:04:31.240071+0000","last_undegraded":"2024-04-25T10:04:31.240071+0000","last_fullsized":"2024-04-25T10:04:31.240071+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:52.441555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.701869+0000","last_change":"2024-04-25T10:04:30.244889+0000","last_active":"2024-04-25T10:04:31.701869+0000","last_peered":"2024-04-25T10:04:31.701869+0000","last_clean":"2024-04-25T10:04:31.701869+0000","last_became_active":"2024-04-25T10:04:30.244564+0000","last_became_peered":"2024-04-25T10:04:30.244564+0000","last_unstale":"2024-04-25T10:04:31.701869+0000","last_undegraded":"2024-04-25T10:04:31.701869+0000","last_fullsized":"2024-04-25T10:04:31.701869+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:03.353003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"116'2","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.242222+0000","last_change":"2024-04-25T10:04:29.250738+0000","last_active":"2024-04-25T10:04:31.242222+0000","last_peered":"2024-04-25T10:04:31.242222+0000","last_clean":"2024-04-25T10:04:31.242222+0000","last_became_active":"2024-04-25T10:04:29.250437+0000","last_became_peered":"2024-04-25T10:04:29.250437+0000","last_unstale":"2024-04-25T10:04:31.242222+0000","last_undegraded":"2024-04-25T10:04:31.242222+0000","last_fullsized":"2024-04-25T10:04:31.242222+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:53.102127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.733797+0000","last_change":"2024-04-25T10:04:30.257110+0000","last_active":"2024-04-25T10:04:31.733797+0000","last_peered":"2024-04-25T10:04:31.733797+0000","last_clean":"2024-04-25T10:04:31.733797+0000","last_became_active":"2024-04-25T10:04:30.256840+0000","last_became_peered":"2024-04-25T10:04:30.256840+0000","last_unstale":"2024-04-25T10:04:31.733797+0000","last_undegraded":"2024-04-25T10:04:31.733797+0000","last_fullsized":"2024-04-25T10:04:31.733797+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:25.488772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"116'1","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.791966+0000","last_change":"2024-04-25T10:04:29.246631+0000","last_active":"2024-04-25T10:04:31.791966+0000","last_peered":"2024-04-25T10:04:31.791966+0000","last_clean":"2024-04-25T10:04:31.791966+0000","last_became_active":"2024-04-25T10:04:29.246207+0000","last_became_peered":"2024-04-25T10:04:29.246207+0000","last_unstale":"2024-04-25T10:04:31.791966+0000","last_undegraded":"2024-04-25T10:04:31.791966+0000","last_fullsized":"2024-04-25T10:04:31.791966+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:07.897567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.345335+0000","last_change":"2024-04-25T10:04:30.250282+0000","last_active":"2024-04-25T10:04:31.345335+0000","last_peered":"2024-04-25T10:04:31.345335+0000","last_clean":"2024-04-25T10:04:31.345335+0000","last_became_active":"2024-04-25T10:04:30.250001+0000","last_became_peered":"2024-04-25T10:04:30.250001+0000","last_unstale":"2024-04-25T10:04:31.345335+0000","last_undegraded":"2024-04-25T10:04:31.345335+0000","last_fullsized":"2024-04-25T10:04:31.345335+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:51.787602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.791571+0000","last_change":"2024-04-25T10:04:29.251151+0000","last_active":"2024-04-25T10:04:31.791571+0000","last_peered":"2024-04-25T10:04:31.791571+0000","last_clean":"2024-04-25T10:04:31.791571+0000","last_became_active":"2024-04-25T10:04:29.250830+0000","last_became_peered":"2024-04-25T10:04:29.250830+0000","last_unstale":"2024-04-25T10:04:31.791571+0000","last_undegraded":"2024-04-25T10:04:31.791571+0000","last_fullsized":"2024-04-25T10:04:31.791571+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:05.642908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.733231+0000","last_change":"2024-04-25T10:04:30.259843+0000","last_active":"2024-04-25T10:04:31.733231+0000","last_peered":"2024-04-25T10:04:31.733231+0000","last_clean":"2024-04-25T10:04:31.733231+0000","last_became_active":"2024-04-25T10:04:30.259548+0000","last_became_peered":"2024-04-25T10:04:30.259548+0000","last_unstale":"2024-04-25T10:04:31.733231+0000","last_undegraded":"2024-04-25T10:04:31.733231+0000","last_fullsized":"2024-04-25T10:04:31.733231+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:39.360847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"116'2","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.733281+0000","last_change":"2024-04-25T10:04:29.249278+0000","last_active":"2024-04-25T10:04:31.733281+0000","last_peered":"2024-04-25T10:04:31.733281+0000","last_clean":"2024-04-25T10:04:31.733281+0000","last_became_active":"2024-04-25T10:04:29.248937+0000","last_became_peered":"2024-04-25T10:04:29.248937+0000","last_unstale":"2024-04-25T10:04:31.733281+0000","last_undegraded":"2024-04-25T10:04:31.733281+0000","last_fullsized":"2024-04-25T10:04:31.733281+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:55.598451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.790419+0000","last_change":"2024-04-25T10:04:30.246488+0000","last_active":"2024-04-25T10:04:31.790419+0000","last_peered":"2024-04-25T10:04:31.790419+0000","last_clean":"2024-04-25T10:04:31.790419+0000","last_became_active":"2024-04-25T10:04:30.245511+0000","last_became_peered":"2024-04-25T10:04:30.245511+0000","last_unstale":"2024-04-25T10:04:31.790419+0000","last_undegraded":"2024-04-25T10:04:31.790419+0000","last_fullsized":"2024-04-25T10:04:31.790419+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:01.845972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.791440+0000","last_change":"2024-04-25T10:04:29.249318+0000","last_active":"2024-04-25T10:04:31.791440+0000","last_peered":"2024-04-25T10:04:31.791440+0000","last_clean":"2024-04-25T10:04:31.791440+0000","last_became_active":"2024-04-25T10:04:29.249041+0000","last_became_peered":"2024-04-25T10:04:29.249041+0000","last_unstale":"2024-04-25T10:04:31.791440+0000","last_undegraded":"2024-04-25T10:04:31.791440+0000","last_fullsized":"2024-04-25T10:04:31.791440+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:43.133631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.790908+0000","last_change":"2024-04-25T10:04:30.253516+0000","last_active":"2024-04-25T10:04:31.790908+0000","last_peered":"2024-04-25T10:04:31.790908+0000","last_clean":"2024-04-25T10:04:31.790908+0000","last_became_active":"2024-04-25T10:04:30.253120+0000","last_became_peered":"2024-04-25T10:04:30.253120+0000","last_unstale":"2024-04-25T10:04:31.790908+0000","last_undegraded":"2024-04-25T10:04:31.790908+0000","last_fullsized":"2024-04-25T10:04:31.790908+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:47.708935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.790702+0000","last_change":"2024-04-25T10:04:29.239923+0000","last_active":"2024-04-25T10:04:31.790702+0000","last_peered":"2024-04-25T10:04:31.790702+0000","last_clean":"2024-04-25T10:04:31.790702+0000","last_became_active":"2024-04-25T10:04:29.239005+0000","last_became_peered":"2024-04-25T10:04:29.239005+0000","last_unstale":"2024-04-25T10:04:31.790702+0000","last_undegraded":"2024-04-25T10:04:31.790702+0000","last_fullsized":"2024-04-25T10:04:31.790702+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:17.577585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.344912+0000","last_change":"2024-04-25T10:04:30.246887+0000","last_active":"2024-04-25T10:04:31.344912+0000","last_peered":"2024-04-25T10:04:31.344912+0000","last_clean":"2024-04-25T10:04:31.344912+0000","last_became_active":"2024-04-25T10:04:30.246594+0000","last_became_peered":"2024-04-25T10:04:30.246594+0000","last_unstale":"2024-04-25T10:04:31.344912+0000","last_undegraded":"2024-04-25T10:04:31.344912+0000","last_fullsized":"2024-04-25T10:04:31.344912+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:41.160415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.790978+0000","last_change":"2024-04-25T10:04:29.246354+0000","last_active":"2024-04-25T10:04:31.790978+0000","last_peered":"2024-04-25T10:04:31.790978+0000","last_clean":"2024-04-25T10:04:31.790978+0000","last_became_active":"2024-04-25T10:04:29.245722+0000","last_became_peered":"2024-04-25T10:04:29.245722+0000","last_unstale":"2024-04-25T10:04:31.790978+0000","last_undegraded":"2024-04-25T10:04:31.790978+0000","last_fullsized":"2024-04-25T10:04:31.790978+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:20.061436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.733812+0000","last_change":"2024-04-25T10:04:30.244915+0000","last_active":"2024-04-25T10:04:31.733812+0000","last_peered":"2024-04-25T10:04:31.733812+0000","last_clean":"2024-04-25T10:04:31.733812+0000","last_became_active":"2024-04-25T10:04:30.244537+0000","last_became_peered":"2024-04-25T10:04:30.244537+0000","last_unstale":"2024-04-25T10:04:31.733812+0000","last_undegraded":"2024-04-25T10:04:31.733812+0000","last_fullsized":"2024-04-25T10:04:31.733812+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:51.433762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"116'2","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.733659+0000","last_change":"2024-04-25T10:04:29.249571+0000","last_active":"2024-04-25T10:04:31.733659+0000","last_peered":"2024-04-25T10:04:31.733659+0000","last_clean":"2024-04-25T10:04:31.733659+0000","last_became_active":"2024-04-25T10:04:29.249244+0000","last_became_peered":"2024-04-25T10:04:29.249244+0000","last_unstale":"2024-04-25T10:04:31.733659+0000","last_undegraded":"2024-04-25T10:04:31.733659+0000","last_fullsized":"2024-04-25T10:04:31.733659+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:08:10.532775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.239943+0000","last_change":"2024-04-25T10:04:30.253002+0000","last_active":"2024-04-25T10:04:31.239943+0000","last_peered":"2024-04-25T10:04:31.239943+0000","last_clean":"2024-04-25T10:04:31.239943+0000","last_became_active":"2024-04-25T10:04:30.252690+0000","last_became_peered":"2024-04-25T10:04:30.252690+0000","last_unstale":"2024-04-25T10:04:31.239943+0000","last_undegraded":"2024-04-25T10:04:31.239943+0000","last_fullsized":"2024-04-25T10:04:31.239943+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:36.697245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"117'1","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.792188+0000","last_change":"2024-04-25T10:04:29.247101+0000","last_active":"2024-04-25T10:04:31.792188+0000","last_peered":"2024-04-25T10:04:31.792188+0000","last_clean":"2024-04-25T10:04:31.792188+0000","last_became_active":"2024-04-25T10:04:29.246778+0000","last_became_peered":"2024-04-25T10:04:29.246778+0000","last_unstale":"2024-04-25T10:04:31.792188+0000","last_undegraded":"2024-04-25T10:04:31.792188+0000","last_fullsized":"2024-04-25T10:04:31.792188+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:48.371611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.792154+0000","last_change":"2024-04-25T10:04:30.255411+0000","last_active":"2024-04-25T10:04:31.792154+0000","last_peered":"2024-04-25T10:04:31.792154+0000","last_clean":"2024-04-25T10:04:31.792154+0000","last_became_active":"2024-04-25T10:04:30.255122+0000","last_became_peered":"2024-04-25T10:04:30.255122+0000","last_unstale":"2024-04-25T10:04:31.792154+0000","last_undegraded":"2024-04-25T10:04:31.792154+0000","last_fullsized":"2024-04-25T10:04:31.792154+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:07.513874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.791575+0000","last_change":"2024-04-25T10:04:29.249960+0000","last_active":"2024-04-25T10:04:31.791575+0000","last_peered":"2024-04-25T10:04:31.791575+0000","last_clean":"2024-04-25T10:04:31.791575+0000","last_became_active":"2024-04-25T10:04:29.249686+0000","last_became_peered":"2024-04-25T10:04:29.249686+0000","last_unstale":"2024-04-25T10:04:31.791575+0000","last_undegraded":"2024-04-25T10:04:31.791575+0000","last_fullsized":"2024-04-25T10:04:31.791575+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:14.946290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.242222+0000","last_change":"2024-04-25T10:04:30.249446+0000","last_active":"2024-04-25T10:04:31.242222+0000","last_peered":"2024-04-25T10:04:31.242222+0000","last_clean":"2024-04-25T10:04:31.242222+0000","last_became_active":"2024-04-25T10:04:30.249186+0000","last_became_peered":"2024-04-25T10:04:30.249186+0000","last_unstale":"2024-04-25T10:04:31.242222+0000","last_undegraded":"2024-04-25T10:04:31.242222+0000","last_fullsized":"2024-04-25T10:04:31.242222+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:10.062931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.733792+0000","last_change":"2024-04-25T10:04:29.243398+0000","last_active":"2024-04-25T10:04:31.733792+0000","last_peered":"2024-04-25T10:04:31.733792+0000","last_clean":"2024-04-25T10:04:31.733792+0000","last_became_active":"2024-04-25T10:04:29.243107+0000","last_became_peered":"2024-04-25T10:04:29.243107+0000","last_unstale":"2024-04-25T10:04:31.733792+0000","last_undegraded":"2024-04-25T10:04:31.733792+0000","last_fullsized":"2024-04-25T10:04:31.733792+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:18.252773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.733488+0000","last_change":"2024-04-25T10:04:30.250866+0000","last_active":"2024-04-25T10:04:31.733488+0000","last_peered":"2024-04-25T10:04:31.733488+0000","last_clean":"2024-04-25T10:04:31.733488+0000","last_became_active":"2024-04-25T10:04:30.250611+0000","last_became_peered":"2024-04-25T10:04:30.250611+0000","last_unstale":"2024-04-25T10:04:31.733488+0000","last_undegraded":"2024-04-25T10:04:31.733488+0000","last_fullsized":"2024-04-25T10:04:31.733488+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:39.052803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.701671+0000","last_change":"2024-04-25T10:04:29.248089+0000","last_active":"2024-04-25T10:04:31.701671+0000","last_peered":"2024-04-25T10:04:31.701671+0000","last_clean":"2024-04-25T10:04:31.701671+0000","last_became_active":"2024-04-25T10:04:29.247817+0000","last_became_peered":"2024-04-25T10:04:29.247817+0000","last_unstale":"2024-04-25T10:04:31.701671+0000","last_undegraded":"2024-04-25T10:04:31.701671+0000","last_fullsized":"2024-04-25T10:04:31.701671+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:48.371611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.790512+0000","last_change":"2024-04-25T10:04:30.253696+0000","last_active":"2024-04-25T10:04:31.790512+0000","last_peered":"2024-04-25T10:04:31.790512+0000","last_clean":"2024-04-25T10:04:31.790512+0000","last_became_active":"2024-04-25T10:04:30.253417+0000","last_became_peered":"2024-04-25T10:04:30.253417+0000","last_unstale":"2024-04-25T10:04:31.790512+0000","last_undegraded":"2024-04-25T10:04:31.790512+0000","last_fullsized":"2024-04-25T10:04:31.790512+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:43.145744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.701639+0000","last_change":"2024-04-25T10:04:29.247433+0000","last_active":"2024-04-25T10:04:31.701639+0000","last_peered":"2024-04-25T10:04:31.701639+0000","last_clean":"2024-04-25T10:04:31.701639+0000","last_became_active":"2024-04-25T10:04:29.247134+0000","last_became_peered":"2024-04-25T10:04:29.247134+0000","last_unstale":"2024-04-25T10:04:31.701639+0000","last_undegraded":"2024-04-25T10:04:31.701639+0000","last_fullsized":"2024-04-25T10:04:31.701639+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:54.240491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.791747+0000","last_change":"2024-04-25T10:04:30.262379+0000","last_active":"2024-04-25T10:04:31.791747+0000","last_peered":"2024-04-25T10:04:31.791747+0000","last_clean":"2024-04-25T10:04:31.791747+0000","last_became_active":"2024-04-25T10:04:30.262076+0000","last_became_peered":"2024-04-25T10:04:30.262076+0000","last_unstale":"2024-04-25T10:04:31.791747+0000","last_undegraded":"2024-04-25T10:04:31.791747+0000","last_fullsized":"2024-04-25T10:04:31.791747+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:13:37.833222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.733308+0000","last_change":"2024-04-25T10:04:29.244891+0000","last_active":"2024-04-25T10:04:31.733308+0000","last_peered":"2024-04-25T10:04:31.733308+0000","last_clean":"2024-04-25T10:04:31.733308+0000","last_became_active":"2024-04-25T10:04:29.244546+0000","last_became_peered":"2024-04-25T10:04:29.244546+0000","last_unstale":"2024-04-25T10:04:31.733308+0000","last_undegraded":"2024-04-25T10:04:31.733308+0000","last_fullsized":"2024-04-25T10:04:31.733308+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:32.305416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.240205+0000","last_change":"2024-04-25T10:04:30.256916+0000","last_active":"2024-04-25T10:04:31.240205+0000","last_peered":"2024-04-25T10:04:31.240205+0000","last_clean":"2024-04-25T10:04:31.240205+0000","last_became_active":"2024-04-25T10:04:30.256610+0000","last_became_peered":"2024-04-25T10:04:30.256610+0000","last_unstale":"2024-04-25T10:04:31.240205+0000","last_undegraded":"2024-04-25T10:04:31.240205+0000","last_fullsized":"2024-04-25T10:04:31.240205+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:46:54.349361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.791010+0000","last_change":"2024-04-25T10:04:29.246803+0000","last_active":"2024-04-25T10:04:31.791010+0000","last_peered":"2024-04-25T10:04:31.791010+0000","last_clean":"2024-04-25T10:04:31.791010+0000","last_became_active":"2024-04-25T10:04:29.246060+0000","last_became_peered":"2024-04-25T10:04:29.246060+0000","last_unstale":"2024-04-25T10:04:31.791010+0000","last_undegraded":"2024-04-25T10:04:31.791010+0000","last_fullsized":"2024-04-25T10:04:31.791010+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:03:40.143885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.791849+0000","last_change":"2024-04-25T10:04:30.256368+0000","last_active":"2024-04-25T10:04:31.791849+0000","last_peered":"2024-04-25T10:04:31.791849+0000","last_clean":"2024-04-25T10:04:31.791849+0000","last_became_active":"2024-04-25T10:04:30.255756+0000","last_became_peered":"2024-04-25T10:04:30.255756+0000","last_unstale":"2024-04-25T10:04:31.791849+0000","last_undegraded":"2024-04-25T10:04:31.791849+0000","last_fullsized":"2024-04-25T10:04:31.791849+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:29.215837+0000","last_clean_scrub_stamp":"2024-04-25T10:04:29.215837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:11.557872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"116'8","reported_seq":22,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.790416+0000","last_change":"2024-04-25T10:04:29.240856+0000","last_active":"2024-04-25T10:04:31.790416+0000","last_peered":"2024-04-25T10:04:31.790416+0000","last_clean":"2024-04-25T10:04:31.790416+0000","last_became_active":"2024-04-25T10:04:29.240561+0000","last_became_peered":"2024-04-25T10:04:29.240561+0000","last_unstale":"2024-04-25T10:04:31.790416+0000","last_undegraded":"2024-04-25T10:04:31.790416+0000","last_fullsized":"2024-04-25T10:04:31.790416+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:04:28.199308+0000","last_clean_scrub_stamp":"2024-04-25T10:04:28.199308+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:26.528805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":349,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T10:04:31.791251+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T10:04:31.791251+0000","last_peered":"2024-04-25T10:04:31.791251+0000","last_clean":"2024-04-25T10:04:31.791251+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T10:04:31.791251+0000","last_undegraded":"2024-04-25T10:04:31.791251+0000","last_fullsized":"2024-04-25T10:04:31.791251+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542271,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2064384,"data_stored":1268892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542271,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1458176,"data_stored":678330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542273,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32612,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339228,"statfs":{"total":96636764160,"available":96603369472,"internally_reserved":0,"allocated":1462272,"data_stored":677908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542270,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1466368,"data_stored":679360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574975,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32624,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1470464,"data_stored":679394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574975,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1454080,"data_stored":677748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574975,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32612,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339228,"statfs":{"total":96636764160,"available":96603369472,"internally_reserved":0,"allocated":1458176,"data_stored":677770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574975,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37348,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334492,"statfs":{"total":96636764160,"available":96598519808,"internally_reserved":0,"allocated":2052096,"data_stored":1268138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:04:37.995 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T10:04:37.996 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T10:04:38.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.135+0000 7f63ad66f640 1 Processor -- start 2024-04-25T10:04:38.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.135+0000 7f63ad66f640 1 -- start start 2024-04-25T10:04:38.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.135+0000 7f63ad66f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f63a815dd00 0x7f63a80b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:38.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.135+0000 7f63ad66f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f63a80b6a40 0x7f63a80b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:38.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.135+0000 7f63ad66f640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63a806cd00 con 0x7f63a806bfb0 2024-04-25T10:04:38.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.135+0000 7f63ad66f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a815e0e0 con 0x7f63a80b6a40 2024-04-25T10:04:38.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.135+0000 7f63ad66f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a806cfe0 con 0x7f63a815dd00 2024-04-25T10:04:38.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.135+0000 7f63a77fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f63a806bfb0 0x7f63a806c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39436/0 (socket says 172.21.15.7:39436) 2024-04-25T10:04:38.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.136+0000 7f63a77fe640 1 -- 172.21.15.7:0/950205474 learned_addr learned my addr 172.21.15.7:0/950205474 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:38.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.136+0000 7f63a67fc640 1 --2- 172.21.15.7:0/950205474 >> v2:172.21.15.55:3300/0 conn(0x7f63a80b6a40 0x7f63a80b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:38.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.136+0000 7f63a6ffd640 1 --2- 172.21.15.7:0/950205474 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f63a815dd00 0x7f63a80b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:38.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.136+0000 7f63a5ffb640 1 -- 172.21.15.7:0/950205474 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654888509 0 0) 0x7f63a806cd00 con 0x7f63a806bfb0 2024-04-25T10:04:38.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.136+0000 7f63a5ffb640 1 -- 172.21.15.7:0/950205474 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6390003520 con 0x7f63a806bfb0 2024-04-25T10:04:38.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.136+0000 7f63a5ffb640 1 -- 172.21.15.7:0/950205474 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 304155233 0 0) 0x7f6390003520 con 0x7f63a806bfb0 2024-04-25T10:04:38.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.136+0000 7f63a5ffb640 1 -- 172.21.15.7:0/950205474 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f63a815dd00 msgr2=0x7f63a80b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:38.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.136+0000 7f63a5ffb640 1 --2- 172.21.15.7:0/950205474 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f63a815dd00 0x7f63a80b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.136+0000 7f63a5ffb640 1 -- 172.21.15.7:0/950205474 >> v2:172.21.15.55:3300/0 conn(0x7f63a80b6a40 msgr2=0x7f63a80b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:38.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.136+0000 7f63a5ffb640 1 --2- 172.21.15.7:0/950205474 >> v2:172.21.15.55:3300/0 conn(0x7f63a80b6a40 0x7f63a80b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.136+0000 7f63a5ffb640 1 -- 172.21.15.7:0/950205474 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a80d1ca0 con 0x7f63a806bfb0 2024-04-25T10:04:38.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.136+0000 7f63a5ffb640 1 -- 172.21.15.7:0/950205474 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f63a00019f0 con 0x7f63a806bfb0 2024-04-25T10:04:38.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.136+0000 7f63a5ffb640 1 -- 172.21.15.7:0/950205474 >> v1:172.21.15.7:6789/0 conn(0x7f63a806bfb0 legacy=0x7f63a806c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:38.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.136+0000 7f63a5ffb640 1 --2- 172.21.15.7:0/950205474 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f63a815dd00 0x7f63900039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:38.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.136+0000 7f63a5ffb640 1 --2- 172.21.15.7:0/950205474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6390003f30 0x7f6390004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:38.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.136+0000 7f63a5ffb640 1 --2- 172.21.15.7:0/950205474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6390004d40 0x7f63900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:38.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.136+0000 7f63a5ffb640 1 -- 172.21.15.7:0/950205474 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a815e0e0 con 0x7f6390004d40 2024-04-25T10:04:38.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.136+0000 7f63a5ffb640 1 -- 172.21.15.7:0/950205474 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a806cfe0 con 0x7f6390003f30 2024-04-25T10:04:38.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.136+0000 7f63a5ffb640 1 -- 172.21.15.7:0/950205474 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f639000b9f0 con 0x7f63a815dd00 2024-04-25T10:04:38.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.136+0000 7f63a77fe640 1 --2- 172.21.15.7:0/950205474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6390004d40 0x7f63900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:38.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.136+0000 7f63a67fc640 1 --2- 172.21.15.7:0/950205474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6390003f30 0x7f6390004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:38.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.136+0000 7f63a6ffd640 1 --2- 172.21.15.7:0/950205474 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f63a815dd00 0x7f63900039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:38.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.137+0000 7f63a77fe640 1 -- 172.21.15.7:0/950205474 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f63a815dd00 msgr2=0x7f63900039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:38.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.137+0000 7f63a77fe640 1 --2- 172.21.15.7:0/950205474 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f63a815dd00 0x7f63900039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.137+0000 7f63a77fe640 1 -- 172.21.15.7:0/950205474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6390003f30 msgr2=0x7f6390004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:38.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.137+0000 7f63a77fe640 1 --2- 172.21.15.7:0/950205474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6390003f30 0x7f6390004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.137+0000 7f63a77fe640 1 -- 172.21.15.7:0/950205474 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6390003520 con 0x7f6390004d40 2024-04-25T10:04:38.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.137+0000 7f63a77fe640 1 --2- 172.21.15.7:0/950205474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6390004d40 0x7f63900051c0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f63a00013d0 tx=0x7f6390005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=110c36ae2d83f07 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:38.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.138+0000 7f63a5ffb640 1 -- 172.21.15.7:0/950205474 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a000a4e0 con 0x7f6390004d40 2024-04-25T10:04:38.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.138+0000 7f63a5ffb640 1 -- 172.21.15.7:0/950205474 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a002f070 con 0x7f6390004d40 2024-04-25T10:04:38.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.138+0000 7f63a5ffb640 1 -- 172.21.15.7:0/950205474 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a002bce0 con 0x7f6390004d40 2024-04-25T10:04:38.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.138+0000 7f63ad66f640 1 -- 172.21.15.7:0/950205474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6390004d40 msgr2=0x7f63900051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:38.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.138+0000 7f63ad66f640 1 --2- 172.21.15.7:0/950205474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6390004d40 0x7f63900051c0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f63a00013d0 tx=0x7f6390005830 comp rx=0 tx=0).stop 2024-04-25T10:04:38.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.138+0000 7f63a77fe640 1 -- 172.21.15.7:0/950205474 reap_dead start 2024-04-25T10:04:38.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.138+0000 7f63ad66f640 1 -- 172.21.15.7:0/950205474 shutdown_connections 2024-04-25T10:04:38.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.138+0000 7f63ad66f640 1 -- 172.21.15.7:0/950205474 >> 172.21.15.7:0/950205474 conn(0x7f63a80d07b0 msgr2=0x7f63a80d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:38.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.138+0000 7f63ad66f640 1 -- 172.21.15.7:0/950205474 shutdown_connections 2024-04-25T10:04:38.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.138+0000 7f63ad66f640 1 -- 172.21.15.7:0/950205474 wait complete. 2024-04-25T10:04:38.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.139+0000 7f63ad66f640 1 Processor -- start 2024-04-25T10:04:38.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.140+0000 7f63ad66f640 1 -- start start 2024-04-25T10:04:38.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.140+0000 7f63ad66f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63a8152ec0 0x7f63a81532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:38.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.140+0000 7f63ad66f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63a80cd090 0x7f63a8150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:38.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.140+0000 7f63ad66f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f63a80cba30 0x7f63a8150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:38.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.140+0000 7f63ad66f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a80b5750 con 0x7f63a8152ec0 2024-04-25T10:04:38.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.140+0000 7f63ad66f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a80d2260 con 0x7f63a80cd090 2024-04-25T10:04:38.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.140+0000 7f63ad66f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a80b58d0 con 0x7f63a80cba30 2024-04-25T10:04:38.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.140+0000 7f63a6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63a8152ec0 0x7f63a81532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:38.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.140+0000 7f63a6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63a8152ec0 0x7f63a81532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47756/0 (socket says 172.21.15.7:47756) 2024-04-25T10:04:38.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.140+0000 7f63a6ffd640 1 -- 172.21.15.7:0/1669026551 learned_addr learned my addr 172.21.15.7:0/1669026551 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:38.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.140+0000 7f63a77fe640 1 --2- 172.21.15.7:0/1669026551 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f63a80cba30 0x7f63a8150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:38.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.140+0000 7f63a67fc640 1 --2- 172.21.15.7:0/1669026551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63a80cd090 0x7f63a8150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:38.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.141+0000 7f63a6ffd640 1 -- 172.21.15.7:0/1669026551 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f63a80cba30 msgr2=0x7f63a8150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:38.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.141+0000 7f63a6ffd640 1 --2- 172.21.15.7:0/1669026551 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f63a80cba30 0x7f63a8150a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.141+0000 7f63a6ffd640 1 -- 172.21.15.7:0/1669026551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63a80cd090 msgr2=0x7f63a8150520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:38.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.141+0000 7f63a6ffd640 1 --2- 172.21.15.7:0/1669026551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63a80cd090 0x7f63a8150520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.141+0000 7f63a6ffd640 1 -- 172.21.15.7:0/1669026551 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a80cbff0 con 0x7f63a8152ec0 2024-04-25T10:04:38.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.141+0000 7f63a67fc640 1 --2- 172.21.15.7:0/1669026551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63a80cd090 0x7f63a8150520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:38.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.141+0000 7f63a6ffd640 1 --2- 172.21.15.7:0/1669026551 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63a8152ec0 0x7f63a81532a0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f63980119a0 tx=0x7f6398011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:38.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.141+0000 7f638f7fe640 1 -- 172.21.15.7:0/1669026551 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639800fa90 con 0x7f63a8152ec0 2024-04-25T10:04:38.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.141+0000 7f638f7fe640 1 -- 172.21.15.7:0/1669026551 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639800fc30 con 0x7f63a8152ec0 2024-04-25T10:04:38.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.141+0000 7f63ad66f640 1 -- 172.21.15.7:0/1669026551 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a80cc2d0 con 0x7f63a8152ec0 2024-04-25T10:04:38.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.141+0000 7f638f7fe640 1 -- 172.21.15.7:0/1669026551 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6398014440 con 0x7f63a8152ec0 2024-04-25T10:04:38.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.141+0000 7f63ad66f640 1 -- 172.21.15.7:0/1669026551 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a80cc890 con 0x7f63a8152ec0 2024-04-25T10:04:38.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.142+0000 7f63ad66f640 1 -- 172.21.15.7:0/1669026551 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a8068fd0 con 0x7f63a8152ec0 2024-04-25T10:04:38.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.143+0000 7f638f7fe640 1 -- 172.21.15.7:0/1669026551 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6398012040 con 0x7f63a8152ec0 2024-04-25T10:04:38.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.143+0000 7f638f7fe640 1 --2- 172.21.15.7:0/1669026551 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f639406b500 0x7f639406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:38.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.143+0000 7f638f7fe640 1 -- 172.21.15.7:0/1669026551 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f639808a960 con 0x7f63a8152ec0 2024-04-25T10:04:38.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.143+0000 7f63a67fc640 1 --2- 172.21.15.7:0/1669026551 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f639406b500 0x7f639406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:38.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.143+0000 7f63a67fc640 1 --2- 172.21.15.7:0/1669026551 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f639406b500 0x7f639406d9c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f63a815cdc0 tx=0x7f639c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:38.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.147+0000 7f638f7fe640 1 -- 172.21.15.7:0/1669026551 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6398019030 con 0x7f63a8152ec0 2024-04-25T10:04:38.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.400+0000 7f63ad66f640 1 -- 172.21.15.7:0/1669026551 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f63a8156de0 con 0x7f63a8152ec0 2024-04-25T10:04:38.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.402+0000 7f638f7fe640 1 -- 172.21.15.7:0/1669026551 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+147 (secure 0 0 0) 0x7f63980595c0 con 0x7f63a8152ec0 2024-04-25T10:04:38.407 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2024-04-25T10:04:38.408 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAYKCpmaJKeORAALxC5ZqLLEu0zJFG+SOGukQ== 2024-04-25T10:04:38.408 INFO:teuthology.orchestra.run.smithi007.stdout: caps mds = "allow" 2024-04-25T10:04:38.408 INFO:teuthology.orchestra.run.smithi007.stdout: caps mon = "allow r" 2024-04-25T10:04:38.408 INFO:teuthology.orchestra.run.smithi007.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T10:04:38.408 INFO:teuthology.orchestra.run.smithi007.stderr:updated caps for client.0 2024-04-25T10:04:38.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.404+0000 7f63ad66f640 1 -- 172.21.15.7:0/1669026551 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f639406b500 msgr2=0x7f639406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:38.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.404+0000 7f63ad66f640 1 --2- 172.21.15.7:0/1669026551 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f639406b500 0x7f639406d9c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f63a815cdc0 tx=0x7f639c008040 comp rx=0 tx=0).stop 2024-04-25T10:04:38.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.404+0000 7f63ad66f640 1 -- 172.21.15.7:0/1669026551 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63a8152ec0 msgr2=0x7f63a81532a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:38.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.404+0000 7f63ad66f640 1 --2- 172.21.15.7:0/1669026551 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63a8152ec0 0x7f63a81532a0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f63980119a0 tx=0x7f6398011e60 comp rx=0 tx=0).stop 2024-04-25T10:04:38.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.404+0000 7f63ad66f640 1 -- 172.21.15.7:0/1669026551 shutdown_connections 2024-04-25T10:04:38.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.404+0000 7f63ad66f640 1 --2- 172.21.15.7:0/1669026551 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f639406b500 0x7f639406d9c0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.404+0000 7f63ad66f640 1 --2- 172.21.15.7:0/1669026551 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f63a80cba30 0x7f63a8150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.404+0000 7f63ad66f640 1 --2- 172.21.15.7:0/1669026551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63a80cd090 0x7f63a8150520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.404+0000 7f63ad66f640 1 --2- 172.21.15.7:0/1669026551 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63a8152ec0 0x7f63a81532a0 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.404+0000 7f63ad66f640 1 -- 172.21.15.7:0/1669026551 >> 172.21.15.7:0/1669026551 conn(0x7f63a80d07b0 msgr2=0x7f63a815e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:38.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.405+0000 7f63ad66f640 1 -- 172.21.15.7:0/1669026551 shutdown_connections 2024-04-25T10:04:38.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.405+0000 7f63ad66f640 1 -- 172.21.15.7:0/1669026551 wait complete. 2024-04-25T10:04:38.421 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:04:38.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.516+0000 7f98f3934640 1 Processor -- start 2024-04-25T10:04:38.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.516+0000 7f98f3934640 1 -- start start 2024-04-25T10:04:38.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.517+0000 7f98f3934640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f98ec15eba0 0x7f98ec06fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:38.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.517+0000 7f98f3934640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98ec1618f0 con 0x7f98ec06ab60 2024-04-25T10:04:38.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.517+0000 7f98f3934640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98ec161bd0 con 0x7f98ec15d7b0 2024-04-25T10:04:38.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.517+0000 7f98f3934640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ec161eb0 con 0x7f98ec15eba0 2024-04-25T10:04:38.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.517+0000 7f98f0ecf640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f98ec15eba0 0x7f98ec06fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:38.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.517+0000 7f98f0ecf640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f98ec15eba0 0x7f98ec06fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47760/0 (socket says 172.21.15.7:47760) 2024-04-25T10:04:38.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.517+0000 7f98f0ecf640 1 -- 172.21.15.7:0/811500883 learned_addr learned my addr 172.21.15.7:0/811500883 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:38.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.517+0000 7f98f1ed1640 1 --1- 172.21.15.7:0/811500883 >> v1:172.21.15.7:6789/0 conn(0x7f98ec06ab60 0x7f98ec06af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39444/0 (socket says 172.21.15.7:39444) 2024-04-25T10:04:38.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.517+0000 7f98f0ecf640 1 -- 172.21.15.7:0/811500883 >> v1:172.21.15.55:6789/0 conn(0x7f98ec15d7b0 legacy=0x7f98ec0b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:38.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.517+0000 7f98f0ecf640 1 -- 172.21.15.7:0/811500883 >> v1:172.21.15.7:6789/0 conn(0x7f98ec06ab60 legacy=0x7f98ec06af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:38.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.517+0000 7f98f0ecf640 1 -- 172.21.15.7:0/811500883 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ec162190 con 0x7f98ec15eba0 2024-04-25T10:04:38.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.517+0000 7f98e3fff640 1 -- 172.21.15.7:0/811500883 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1326114686 0 0) 0x7f98ec1618f0 con 0x7f98ec06ab60 2024-04-25T10:04:38.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.518+0000 7f98f0ecf640 1 --2- 172.21.15.7:0/811500883 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98ec15eba0 0x7f98ec06fa00 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0098a0 tx=0x7f98dc02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890a8420fea96ca7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:38.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.518+0000 7f98e3fff640 1 -- 172.21.15.7:0/811500883 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc037070 con 0x7f98ec15eba0 2024-04-25T10:04:38.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.518+0000 7f98e3fff640 1 -- 172.21.15.7:0/811500883 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98dc032440 con 0x7f98ec15eba0 2024-04-25T10:04:38.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.518+0000 7f98e3fff640 1 -- 172.21.15.7:0/811500883 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc032810 con 0x7f98ec15eba0 2024-04-25T10:04:38.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.519+0000 7f98f3934640 1 -- 172.21.15.7:0/811500883 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98ec15eba0 msgr2=0x7f98ec06fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:38.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.519+0000 7f98f3934640 1 --2- 172.21.15.7:0/811500883 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98ec15eba0 0x7f98ec06fa00 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0098a0 tx=0x7f98dc02a250 comp rx=0 tx=0).stop 2024-04-25T10:04:38.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.519+0000 7f98f3934640 1 -- 172.21.15.7:0/811500883 shutdown_connections 2024-04-25T10:04:38.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.519+0000 7f98f3934640 1 --2- 172.21.15.7:0/811500883 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98ec15eba0 0x7f98ec06fa00 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.519+0000 7f98f3934640 1 -- 172.21.15.7:0/811500883 >> 172.21.15.7:0/811500883 conn(0x7f98ec0b2390 msgr2=0x7f98ec0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:38.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.519+0000 7f98f3934640 1 -- 172.21.15.7:0/811500883 shutdown_connections 2024-04-25T10:04:38.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.519+0000 7f98f3934640 1 -- 172.21.15.7:0/811500883 wait complete. 2024-04-25T10:04:38.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.520+0000 7f98f3934640 1 Processor -- start 2024-04-25T10:04:38.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.520+0000 7f98f3934640 1 -- start start 2024-04-25T10:04:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.521+0000 7f98f3934640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98ec06ab60 0x7f98ec145040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.521+0000 7f98f3934640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98ec15d7b0 0x7f98ec1e7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.521+0000 7f98f3934640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98ec15eba0 0x7f98ec1e7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.521+0000 7f98f3934640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec161690 con 0x7f98ec15d7b0 2024-04-25T10:04:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.521+0000 7f98f3934640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec161510 con 0x7f98ec06ab60 2024-04-25T10:04:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.521+0000 7f98f3934640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec0b3a70 con 0x7f98ec15eba0 2024-04-25T10:04:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.521+0000 7f98f0ecf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98ec15d7b0 0x7f98ec1e7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.521+0000 7f98f0ecf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98ec15d7b0 0x7f98ec1e7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47766/0 (socket says 172.21.15.7:47766) 2024-04-25T10:04:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.521+0000 7f98f0ecf640 1 -- 172.21.15.7:0/2873117888 learned_addr learned my addr 172.21.15.7:0/2873117888 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.521+0000 7f98f0ecf640 1 -- 172.21.15.7:0/2873117888 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98ec15eba0 msgr2=0x7f98ec1e7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.521+0000 7f98f0ecf640 1 --2- 172.21.15.7:0/2873117888 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98ec15eba0 0x7f98ec1e7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.521+0000 7f98f0ecf640 1 -- 172.21.15.7:0/2873117888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98ec06ab60 msgr2=0x7f98ec145040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:38.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.521+0000 7f98f0ecf640 1 --2- 172.21.15.7:0/2873117888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98ec06ab60 0x7f98ec145040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.521+0000 7f98f0ecf640 1 -- 172.21.15.7:0/2873117888 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ec160800 con 0x7f98ec15d7b0 2024-04-25T10:04:38.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.521+0000 7f98f0ecf640 1 --2- 172.21.15.7:0/2873117888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98ec15d7b0 0x7f98ec1e7330 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f98dc000c00 tx=0x7f98dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:38.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.521+0000 7f98e1ffb640 1 -- 172.21.15.7:0/2873117888 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc037040 con 0x7f98ec15d7b0 2024-04-25T10:04:38.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.522+0000 7f98e1ffb640 1 -- 172.21.15.7:0/2873117888 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98dc004230 con 0x7f98ec15d7b0 2024-04-25T10:04:38.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.522+0000 7f98f3934640 1 -- 172.21.15.7:0/2873117888 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98ec145b70 con 0x7f98ec15d7b0 2024-04-25T10:04:38.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.522+0000 7f98e1ffb640 1 -- 172.21.15.7:0/2873117888 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc03c670 con 0x7f98ec15d7b0 2024-04-25T10:04:38.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.522+0000 7f98f3934640 1 -- 172.21.15.7:0/2873117888 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ec146130 con 0x7f98ec15d7b0 2024-04-25T10:04:38.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.523+0000 7f98f3934640 1 -- 172.21.15.7:0/2873117888 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98ec145960 con 0x7f98ec15d7b0 2024-04-25T10:04:38.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.523+0000 7f98e1ffb640 1 -- 172.21.15.7:0/2873117888 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f98dc03a070 con 0x7f98ec15d7b0 2024-04-25T10:04:38.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.524+0000 7f98e1ffb640 1 --2- 172.21.15.7:0/2873117888 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f98d006b4d0 0x7f98d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:38.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.524+0000 7f98e1ffb640 1 -- 172.21.15.7:0/2873117888 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f98dc0aac00 con 0x7f98ec15d7b0 2024-04-25T10:04:38.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.524+0000 7f98f16d0640 1 --2- 172.21.15.7:0/2873117888 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f98d006b4d0 0x7f98d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:38.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.524+0000 7f98f16d0640 1 --2- 172.21.15.7:0/2873117888 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f98d006b4d0 0x7f98d006d990 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f98ec160d90 tx=0x7f98e80079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.528+0000 7f98e1ffb640 1 -- 172.21.15.7:0/2873117888 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f98dc0b1080 con 0x7f98ec15d7b0 2024-04-25T10:04:38.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.745+0000 7f98f3934640 1 -- 172.21.15.7:0/2873117888 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98ec068fd0 con 0x7f98ec15d7b0 2024-04-25T10:04:38.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.745+0000 7f98e1ffb640 1 -- 172.21.15.7:0/2873117888 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4934 (secure 0 0 0) 0x7f98dc041020 con 0x7f98ec15d7b0 2024-04-25T10:04:38.751 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:38.751 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":88,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6992,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2679200172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2679200172},{"type":"v1","addr":"172.21.15.7:6837","nonce":2679200172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":7942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/4039147179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":4039147179},{"type":"v1","addr":"172.21.15.55:6833","nonce":4039147179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":7945,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3456170359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3456170359},{"type":"v1","addr":"172.21.15.55:6835","nonce":3456170359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:04:29.599245+0000","modified":"2024-04-25T10:04:31.593324+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9051},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9051":{"gid":9051,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6836/3623521645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3623521645},{"type":"v1","addr":"172.21.15.7:6836","nonce":3623521645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T10:04:38.751 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 88 2024-04-25T10:04:38.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.747+0000 7f98f3934640 1 -- 172.21.15.7:0/2873117888 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f98d006b4d0 msgr2=0x7f98d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:38.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.747+0000 7f98f3934640 1 --2- 172.21.15.7:0/2873117888 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f98d006b4d0 0x7f98d006d990 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f98ec160d90 tx=0x7f98e80079b0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.747+0000 7f98f3934640 1 -- 172.21.15.7:0/2873117888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98ec15d7b0 msgr2=0x7f98ec1e7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:38.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.747+0000 7f98f3934640 1 --2- 172.21.15.7:0/2873117888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98ec15d7b0 0x7f98ec1e7330 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f98dc000c00 tx=0x7f98dc0046c0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.747+0000 7f98f3934640 1 -- 172.21.15.7:0/2873117888 shutdown_connections 2024-04-25T10:04:38.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.747+0000 7f98f3934640 1 --2- 172.21.15.7:0/2873117888 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f98d006b4d0 0x7f98d006d990 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.747+0000 7f98f3934640 1 --2- 172.21.15.7:0/2873117888 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98ec15eba0 0x7f98ec1e7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.747+0000 7f98f3934640 1 --2- 172.21.15.7:0/2873117888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98ec15d7b0 0x7f98ec1e7330 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.747+0000 7f98f3934640 1 --2- 172.21.15.7:0/2873117888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98ec06ab60 0x7f98ec145040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.747+0000 7f98f3934640 1 -- 172.21.15.7:0/2873117888 >> 172.21.15.7:0/2873117888 conn(0x7f98ec0b2390 msgr2=0x7f98ec0cfb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:38.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.747+0000 7f98f3934640 1 -- 172.21.15.7:0/2873117888 shutdown_connections 2024-04-25T10:04:38.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:38.747+0000 7f98f3934640 1 -- 172.21.15.7:0/2873117888 wait complete. 2024-04-25T10:04:39.166 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 88, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:04:29.599245+0000', 'modified': '2024-04-25T10:04:31.593324+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9051}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9051': {'gid': 9051, 'name': 'a', 'rank': 0, 'incarnation': 86, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.7:6836/3623521645', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 3623521645}, {'type': 'v1', 'addr': '172.21.15.7:6836', 'nonce': 3623521645}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:04:39.167 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T10:04:39.167 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T10:04:39.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.269+0000 7faf3aacd640 1 Processor -- start 2024-04-25T10:04:39.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.269+0000 7faf3aacd640 1 -- start start 2024-04-25T10:04:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.270+0000 7faf3aacd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faf340d0a50 0x7faf340d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.270+0000 7faf3aacd640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf340d1e80 con 0x7faf340b53b0 2024-04-25T10:04:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.270+0000 7faf3aacd640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf340b5930 con 0x7faf3415db00 2024-04-25T10:04:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.270+0000 7faf3aacd640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf340b5c10 con 0x7faf340d0a50 2024-04-25T10:04:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.270+0000 7faf3906a640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7faf340b53b0 0x7faf340d2870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39450/0 (socket says 172.21.15.7:39450) 2024-04-25T10:04:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.270+0000 7faf3906a640 1 -- 172.21.15.7:0/4006112382 learned_addr learned my addr 172.21.15.7:0/4006112382 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.270+0000 7faf33fff640 1 --2- 172.21.15.7:0/4006112382 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faf340d0a50 0x7faf340d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.270+0000 7faf337fe640 1 -- 172.21.15.7:0/4006112382 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 91087417 0 0) 0x7faf340d1e80 con 0x7faf340b53b0 2024-04-25T10:04:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.270+0000 7faf337fe640 1 -- 172.21.15.7:0/4006112382 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf1c003520 con 0x7faf340b53b0 2024-04-25T10:04:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.271+0000 7faf337fe640 1 -- 172.21.15.7:0/4006112382 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919184880 0 0) 0x7faf340b5930 con 0x7faf3415db00 2024-04-25T10:04:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.271+0000 7faf337fe640 1 -- 172.21.15.7:0/4006112382 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf340d1e80 con 0x7faf3415db00 2024-04-25T10:04:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.271+0000 7faf337fe640 1 -- 172.21.15.7:0/4006112382 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3979756919 0 0) 0x7faf1c003520 con 0x7faf340b53b0 2024-04-25T10:04:39.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.271+0000 7faf33fff640 1 -- 172.21.15.7:0/4006112382 >> v1:172.21.15.55:6789/0 conn(0x7faf3415db00 legacy=0x7faf340d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.271+0000 7faf33fff640 1 -- 172.21.15.7:0/4006112382 >> v1:172.21.15.7:6789/0 conn(0x7faf340b53b0 legacy=0x7faf340d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.271+0000 7faf33fff640 1 -- 172.21.15.7:0/4006112382 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf340b5ef0 con 0x7faf340d0a50 2024-04-25T10:04:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.271+0000 7faf33fff640 1 --2- 172.21.15.7:0/4006112382 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faf340d0a50 0x7faf340d2330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faf280097d0 tx=0x7faf2802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2c3c0e3984d94f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.272+0000 7faf337fe640 1 -- 172.21.15.7:0/4006112382 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf28037070 con 0x7faf340d0a50 2024-04-25T10:04:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.272+0000 7faf337fe640 1 -- 172.21.15.7:0/4006112382 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2802ac30 con 0x7faf340d0a50 2024-04-25T10:04:39.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.272+0000 7faf337fe640 1 -- 172.21.15.7:0/4006112382 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c0019f0 con 0x7faf340d0a50 2024-04-25T10:04:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.272+0000 7faf3aacd640 1 -- 172.21.15.7:0/4006112382 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faf340d0a50 msgr2=0x7faf340d2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.272+0000 7faf3aacd640 1 --2- 172.21.15.7:0/4006112382 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faf340d0a50 0x7faf340d2330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faf280097d0 tx=0x7faf2802a1a0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.272+0000 7faf3aacd640 1 -- 172.21.15.7:0/4006112382 shutdown_connections 2024-04-25T10:04:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.272+0000 7faf3aacd640 1 --2- 172.21.15.7:0/4006112382 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faf340d0a50 0x7faf340d2330 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.272+0000 7faf3aacd640 1 -- 172.21.15.7:0/4006112382 >> 172.21.15.7:0/4006112382 conn(0x7faf34072290 msgr2=0x7faf340726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.272+0000 7faf3aacd640 1 -- 172.21.15.7:0/4006112382 shutdown_connections 2024-04-25T10:04:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.272+0000 7faf3aacd640 1 -- 172.21.15.7:0/4006112382 wait complete. 2024-04-25T10:04:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.273+0000 7faf3aacd640 1 Processor -- start 2024-04-25T10:04:39.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.273+0000 7faf3aacd640 1 -- start start 2024-04-25T10:04:39.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.274+0000 7faf3aacd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf340b53b0 0x7faf3415f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.274+0000 7faf3aacd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faf340d0a50 0x7faf3414e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.274+0000 7faf3aacd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf3415db00 0x7faf3414ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.274+0000 7faf3aacd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf340d3660 con 0x7faf3415db00 2024-04-25T10:04:39.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.274+0000 7faf3aacd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf340b61d0 con 0x7faf340b53b0 2024-04-25T10:04:39.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.274+0000 7faf3aacd640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf340d2f80 con 0x7faf340d0a50 2024-04-25T10:04:39.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.274+0000 7faf3906a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf3415db00 0x7faf3414ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.274+0000 7faf3906a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf3415db00 0x7faf3414ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47768/0 (socket says 172.21.15.7:47768) 2024-04-25T10:04:39.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.274+0000 7faf3906a640 1 -- 172.21.15.7:0/1801660374 learned_addr learned my addr 172.21.15.7:0/1801660374 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:39.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.275+0000 7faf33fff640 1 --2- 172.21.15.7:0/1801660374 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faf340d0a50 0x7faf3414e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.275+0000 7faf38869640 1 --2- 172.21.15.7:0/1801660374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf340b53b0 0x7faf3415f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.275+0000 7faf3906a640 1 -- 172.21.15.7:0/1801660374 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faf340d0a50 msgr2=0x7faf3414e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.275+0000 7faf3906a640 1 --2- 172.21.15.7:0/1801660374 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faf340d0a50 0x7faf3414e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.275+0000 7faf3906a640 1 -- 172.21.15.7:0/1801660374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf340b53b0 msgr2=0x7faf3415f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.275+0000 7faf3906a640 1 --2- 172.21.15.7:0/1801660374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf340b53b0 0x7faf3415f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.275+0000 7faf3906a640 1 -- 172.21.15.7:0/1801660374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3414f260 con 0x7faf3415db00 2024-04-25T10:04:39.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.275+0000 7faf3906a640 1 --2- 172.21.15.7:0/1801660374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf3415db00 0x7faf3414ed20 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00cc10 tx=0x7faf2c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:39.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.275+0000 7faf317fa640 1 -- 172.21.15.7:0/1801660374 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c017070 con 0x7faf3415db00 2024-04-25T10:04:39.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.275+0000 7faf317fa640 1 -- 172.21.15.7:0/1801660374 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c00ce20 con 0x7faf3415db00 2024-04-25T10:04:39.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.275+0000 7faf317fa640 1 -- 172.21.15.7:0/1801660374 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c012640 con 0x7faf3415db00 2024-04-25T10:04:39.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.275+0000 7faf3aacd640 1 -- 172.21.15.7:0/1801660374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf340c7460 con 0x7faf3415db00 2024-04-25T10:04:39.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.275+0000 7faf3aacd640 1 -- 172.21.15.7:0/1801660374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf340c7a20 con 0x7faf3415db00 2024-04-25T10:04:39.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.277+0000 7faf317fa640 1 -- 172.21.15.7:0/1801660374 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faf2c01a070 con 0x7faf3415db00 2024-04-25T10:04:39.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.278+0000 7faf317fa640 1 --2- 172.21.15.7:0/1801660374 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faf2006b4d0 0x7faf2006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.278+0000 7faf317fa640 1 -- 172.21.15.7:0/1801660374 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6101+0+0 (secure 0 0 0) 0x7faf2c08a350 con 0x7faf3415db00 2024-04-25T10:04:39.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.278+0000 7faf38869640 1 --2- 172.21.15.7:0/1801660374 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faf2006b4d0 0x7faf2006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.278+0000 7faf38869640 1 --2- 172.21.15.7:0/1801660374 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faf2006b4d0 0x7faf2006d990 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7faf240011e0 tx=0x7faf24009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:39.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.278+0000 7faf3d7cc740 1 Processor -- start 2024-04-25T10:04:39.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.278+0000 7faf3d7cc740 1 -- start start 2024-04-25T10:04:39.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.279+0000 7faf3d7cc740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a5bcc65230 0x55a5bcc65610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.279+0000 7faf3d7cc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5bcc82ad0 0x55a5bcc83020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.279+0000 7faf3d7cc740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5bcc3af10 0x55a5bcc81190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.279+0000 7faf3d7cc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5bcb9da10 con 0x55a5bcc82ad0 2024-04-25T10:04:39.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.279+0000 7faf3d7cc740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5bcb46b30 con 0x55a5bcc3af10 2024-04-25T10:04:39.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.279+0000 7faf3d7cc740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5bcb99c50 con 0x55a5bcc65230 2024-04-25T10:04:39.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.279+0000 7faf33fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5bcc82ad0 0x55a5bcc83020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.279+0000 7faf33fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5bcc82ad0 0x55a5bcc83020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47784/0 (socket says 172.21.15.7:47784) 2024-04-25T10:04:39.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.279+0000 7faf33fff640 1 -- 172.21.15.7:0/4192189418 learned_addr learned my addr 172.21.15.7:0/4192189418 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:39.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.279+0000 7faf38869640 1 --2- 172.21.15.7:0/4192189418 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a5bcc65230 0x55a5bcc65610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.279+0000 7faf3906a640 1 --2- 172.21.15.7:0/4192189418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5bcc3af10 0x55a5bcc81190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.279+0000 7faf33fff640 1 -- 172.21.15.7:0/4192189418 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a5bcc65230 msgr2=0x55a5bcc65610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:39.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.279+0000 7faf33fff640 1 --2- 172.21.15.7:0/4192189418 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a5bcc65230 0x55a5bcc65610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.279+0000 7faf33fff640 1 -- 172.21.15.7:0/4192189418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5bcc3af10 msgr2=0x55a5bcc81190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:39.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.279+0000 7faf33fff640 1 --2- 172.21.15.7:0/4192189418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5bcc3af10 0x55a5bcc81190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.279+0000 7faf33fff640 1 -- 172.21.15.7:0/4192189418 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5bcb5be10 con 0x55a5bcc82ad0 2024-04-25T10:04:39.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.279+0000 7faf3906a640 1 --2- 172.21.15.7:0/4192189418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5bcc3af10 0x55a5bcc81190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:39.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.279+0000 7faf38869640 1 --2- 172.21.15.7:0/4192189418 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a5bcc65230 0x55a5bcc65610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:39.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.280+0000 7faf33fff640 1 --2- 172.21.15.7:0/4192189418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5bcc82ad0 0x55a5bcc83020 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7faf2802a1e0 tx=0x7faf2802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ccdce3f6409e51e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:39.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.280+0000 7faf1a7fc640 1 -- 172.21.15.7:0/4192189418 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf28037040 con 0x55a5bcc82ad0 2024-04-25T10:04:39.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.280+0000 7faf1a7fc640 1 -- 172.21.15.7:0/4192189418 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2803e660 con 0x55a5bcc82ad0 2024-04-25T10:04:39.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.280+0000 7faf1a7fc640 1 -- 172.21.15.7:0/4192189418 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2803ea50 con 0x55a5bcc82ad0 2024-04-25T10:04:39.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.280+0000 7faf3d7cc740 1 -- 172.21.15.7:0/4192189418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5bcc82ad0 msgr2=0x55a5bcc83020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.280+0000 7faf3d7cc740 1 --2- 172.21.15.7:0/4192189418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5bcc82ad0 0x55a5bcc83020 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7faf2802a1e0 tx=0x7faf2802c000 comp rx=0 tx=0).stop 2024-04-25T10:04:39.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.280+0000 7faf3d7cc740 1 -- 172.21.15.7:0/4192189418 shutdown_connections 2024-04-25T10:04:39.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.280+0000 7faf3d7cc740 1 --2- 172.21.15.7:0/4192189418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5bcc3af10 0x55a5bcc81190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.280+0000 7faf3d7cc740 1 --2- 172.21.15.7:0/4192189418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5bcc82ad0 0x55a5bcc83020 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.280+0000 7faf3d7cc740 1 --2- 172.21.15.7:0/4192189418 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a5bcc65230 0x55a5bcc65610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.280+0000 7faf3d7cc740 1 -- 172.21.15.7:0/4192189418 >> 172.21.15.7:0/4192189418 conn(0x55a5bcc37840 msgr2=0x55a5bcc80040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:39.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.281+0000 7faf3d7cc740 1 -- 172.21.15.7:0/4192189418 shutdown_connections 2024-04-25T10:04:39.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.281+0000 7faf3d7cc740 1 -- 172.21.15.7:0/4192189418 wait complete. 2024-04-25T10:04:39.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.281+0000 7faf3d7cc740 1 -- start start 2024-04-25T10:04:39.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.281+0000 7faf3d7cc740 1 Processor -- start 2024-04-25T10:04:39.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.282+0000 7faf3d7cc740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a5bcc65230 0x55a5bcc66770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.282+0000 7faf3d7cc740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5bcc82ad0 0x55a5bcc4e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.282+0000 7faf3d7cc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5bcc515f0 0x55a5bcc502b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.282+0000 7faf3d7cc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5bcc3bcb0 con 0x55a5bcc515f0 2024-04-25T10:04:39.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.282+0000 7faf3d7cc740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5bcb5a0c0 con 0x55a5bcc82ad0 2024-04-25T10:04:39.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.282+0000 7faf3d7cc740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5bcc35770 con 0x55a5bcc65230 2024-04-25T10:04:39.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.282+0000 7faf3d7cc740 10 client.0 _ll_register_callbacks cb 0x55a5bcb4dec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:04:39.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.282+0000 7faf3906a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5bcc515f0 0x55a5bcc502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.282+0000 7faf33fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5bcc82ad0 0x55a5bcc4e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.282+0000 7faf38869640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a5bcc65230 0x55a5bcc66770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.282+0000 7faf3906a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5bcc515f0 0x55a5bcc502b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47798/0 (socket says 172.21.15.7:47798) 2024-04-25T10:04:39.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.282+0000 7faf3906a640 1 -- 172.21.15.7:0/3915367271 learned_addr learned my addr 172.21.15.7:0/3915367271 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:39.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.282+0000 7faf33fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5bcc82ad0 0x55a5bcc4e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:33190/0 (socket says 172.21.15.7:33190) 2024-04-25T10:04:39.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.283+0000 7faf3906a640 1 -- 172.21.15.7:0/3915367271 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a5bcc65230 msgr2=0x55a5bcc66770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:39.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.283+0000 7faf3906a640 1 --2- 172.21.15.7:0/3915367271 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a5bcc65230 0x55a5bcc66770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.283+0000 7faf3906a640 1 -- 172.21.15.7:0/3915367271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5bcc82ad0 msgr2=0x55a5bcc4e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:39.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.283+0000 7faf3906a640 1 --2- 172.21.15.7:0/3915367271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5bcc82ad0 0x55a5bcc4e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.283+0000 7faf3906a640 1 -- 172.21.15.7:0/3915367271 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a5bc8b22d0 con 0x55a5bcc515f0 2024-04-25T10:04:39.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.283+0000 7faf3906a640 1 --2- 172.21.15.7:0/3915367271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5bcc515f0 0x55a5bcc502b0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00cfd0 tx=0x7faf2c0589e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c73b0c7cce8852f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:39.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.283+0000 7faf137fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:04:39.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.283+0000 7faf137fe640 1 -- 172.21.15.7:0/3915367271 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c0701b0 con 0x55a5bcc515f0 2024-04-25T10:04:39.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.283+0000 7faf137fe640 1 -- 172.21.15.7:0/3915367271 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 6101+0+0 (secure 0 0 0) 0x7faf2c070350 con 0x55a5bcc515f0 2024-04-25T10:04:39.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.283+0000 7faf3d7cc740 1 -- 172.21.15.7:0/3915367271 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faf2803e660 con 0x55a5bcc515f0 2024-04-25T10:04:39.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.283+0000 7faf137fe640 1 -- 172.21.15.7:0/3915367271 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf2c059bd0 con 0x55a5bcc515f0 2024-04-25T10:04:39.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.283+0000 7faf3d7cc740 10 client.9213 fetch_fsmap learned FSMap version 88 2024-04-25T10:04:39.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.283+0000 7faf3d7cc740 1 -- 172.21.15.7:0/3915367271 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=2+}) v3 -- 0x55a5bc97c6b0 con 0x55a5bcc515f0 2024-04-25T10:04:39.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.283+0000 7faf137fe640 1 -- 172.21.15.7:0/3915367271 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2803e660 con 0x55a5bcc515f0 2024-04-25T10:04:39.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.283+0000 7faf137fe640 1 -- 172.21.15.7:0/3915367271 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 88) v1 ==== 3294+0+0 (secure 0 0 0) 0x7faf2c060b20 con 0x55a5bcc515f0 2024-04-25T10:04:39.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.283+0000 7faf3d7cc740 10 client.9213 fetch_fsmap finished waiting for FSMap version 88 2024-04-25T10:04:39.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.283+0000 7faf3d7cc740 10 client.9213 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:04:39.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.283+0000 7faf3d7cc740 20 client.9213 populate_metadata read hostname 'smithi007' 2024-04-25T10:04:39.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.283+0000 7faf3d7cc740 1 --2- 172.21.15.7:0/3915367271 >> [v2:172.21.15.7:6834/3623521645,v1:172.21.15.7:6836/3623521645] conn(0x55a5bcc348d0 0x55a5bcc34cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.283+0000 7faf3d7cc740 4 client.9213 mds_command: new command op to 9051 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:04:39.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.283+0000 7faf3d7cc740 1 -- 172.21.15.7:0/3915367271 --> [v2:172.21.15.7:6834/3623521645,v1:172.21.15.7:6836/3623521645] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a5bcbfc920 con 0x55a5bcc348d0 2024-04-25T10:04:39.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.283+0000 7faf38869640 1 --2- 172.21.15.7:0/3915367271 >> [v2:172.21.15.7:6834/3623521645,v1:172.21.15.7:6836/3623521645] conn(0x55a5bcc348d0 0x55a5bcc34cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.284+0000 7faf38869640 1 --2- 172.21.15.7:0/3915367271 >> [v2:172.21.15.7:6834/3623521645,v1:172.21.15.7:6836/3623521645] conn(0x55a5bcc348d0 0x55a5bcc34cb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=645f0b92a666ff0c server_cookie=2db04cefec55bf8a in_seq=0 out_seq=0 2024-04-25T10:04:39.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.284+0000 7faf137fe640 10 client.9213 ms_handle_connect on v2:172.21.15.7:6834/3623521645 2024-04-25T10:04:39.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.284+0000 7faf137fe640 1 -- 172.21.15.7:0/3915367271 <== mds.0 v2:172.21.15.7:6834/3623521645 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a5bcbfc920 con 0x55a5bcc348d0 2024-04-25T10:04:39.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.284+0000 7faf137fe640 10 client.9213 handle_command_reply: tid=0 2024-04-25T10:04:39.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.284+0000 7faf3d7cc740 1 client.9213 shutdown 2024-04-25T10:04:39.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.285+0000 7faf3d7cc740 1 -- 172.21.15.7:0/3915367271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5bcc515f0 msgr2=0x55a5bcc502b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.285+0000 7faf3d7cc740 1 --2- 172.21.15.7:0/3915367271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5bcc515f0 0x55a5bcc502b0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00cfd0 tx=0x7faf2c0589e0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.285+0000 7faf3d7cc740 1 -- 172.21.15.7:0/3915367271 shutdown_connections 2024-04-25T10:04:39.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.285+0000 7faf3d7cc740 1 --2- 172.21.15.7:0/3915367271 >> [v2:172.21.15.7:6834/3623521645,v1:172.21.15.7:6836/3623521645] conn(0x55a5bcc348d0 0x55a5bcc34cb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.285+0000 7faf3d7cc740 1 --2- 172.21.15.7:0/3915367271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5bcc515f0 0x55a5bcc502b0 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.285+0000 7faf3d7cc740 1 --2- 172.21.15.7:0/3915367271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5bcc82ad0 0x55a5bcc4e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.285+0000 7faf3d7cc740 1 --2- 172.21.15.7:0/3915367271 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a5bcc65230 0x55a5bcc66770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.285+0000 7faf3d7cc740 1 -- 172.21.15.7:0/3915367271 >> 172.21.15.7:0/3915367271 conn(0x55a5bcc3af10 msgr2=0x55a5bcc7f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:39.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.285+0000 7faf137fe640 0 client.9213 ms_handle_reset on v2:172.21.15.7:6834/3623521645 2024-04-25T10:04:39.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.285+0000 7faf3d7cc740 1 -- 172.21.15.7:0/3915367271 shutdown_connections 2024-04-25T10:04:39.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.285+0000 7faf3d7cc740 1 -- 172.21.15.7:0/3915367271 wait complete. 2024-04-25T10:04:39.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.285+0000 7faf3d7cc740 20 client.9213 trim_cache size 0 max 16384 2024-04-25T10:04:39.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.301+0000 7faf3d7cc740 1 Processor -- start 2024-04-25T10:04:39.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.301+0000 7faf3d7cc740 1 -- start start 2024-04-25T10:04:39.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.301+0000 7faf3d7cc740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a5bcc515f0 0x55a5bcc61760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.301+0000 7faf3d7cc740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5bcc65230 0x55a5bcc3a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.301+0000 7faf3d7cc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5bcc82ad0 0x55a5bcc3a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.301+0000 7faf3d7cc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf341ff350 con 0x55a5bcc82ad0 2024-04-25T10:04:39.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.301+0000 7faf3d7cc740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf340c8d60 con 0x55a5bcc65230 2024-04-25T10:04:39.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.301+0000 7faf3d7cc740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf340c9360 con 0x55a5bcc515f0 2024-04-25T10:04:39.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.301+0000 7faf3906a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5bcc82ad0 0x55a5bcc3a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.301+0000 7faf3906a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5bcc82ad0 0x55a5bcc3a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47814/0 (socket says 172.21.15.7:47814) 2024-04-25T10:04:39.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.301+0000 7faf3906a640 1 -- 172.21.15.7:0/581968934 learned_addr learned my addr 172.21.15.7:0/581968934 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:39.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.302+0000 7faf38869640 1 --2- 172.21.15.7:0/581968934 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a5bcc515f0 0x55a5bcc61760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.302+0000 7faf33fff640 1 --2- 172.21.15.7:0/581968934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5bcc65230 0x55a5bcc3a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.302+0000 7faf3906a640 1 -- 172.21.15.7:0/581968934 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a5bcc515f0 msgr2=0x55a5bcc61760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:39.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.302+0000 7faf3906a640 1 --2- 172.21.15.7:0/581968934 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a5bcc515f0 0x55a5bcc61760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.302+0000 7faf3906a640 1 -- 172.21.15.7:0/581968934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5bcc65230 msgr2=0x55a5bcc3a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:39.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.302+0000 7faf3906a640 1 --2- 172.21.15.7:0/581968934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5bcc65230 0x55a5bcc3a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.302+0000 7faf3906a640 1 -- 172.21.15.7:0/581968934 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5bcc76de0 con 0x55a5bcc82ad0 2024-04-25T10:04:39.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.302+0000 7faf3906a640 1 --2- 172.21.15.7:0/581968934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5bcc82ad0 0x55a5bcc3a800 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7faf2c0585a0 tx=0x7faf2c05a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e641b2f42d9ed87 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:39.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.302+0000 7faf19ffb640 1 -- 172.21.15.7:0/581968934 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c060b20 con 0x55a5bcc82ad0 2024-04-25T10:04:39.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.302+0000 7faf19ffb640 1 -- 172.21.15.7:0/581968934 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c0701b0 con 0x55a5bcc82ad0 2024-04-25T10:04:39.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.302+0000 7faf19ffb640 1 -- 172.21.15.7:0/581968934 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c004da0 con 0x55a5bcc82ad0 2024-04-25T10:04:39.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.303+0000 7faf3d7cc740 1 -- 172.21.15.7:0/581968934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5bcc82ad0 msgr2=0x55a5bcc3a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.303+0000 7faf3d7cc740 1 --2- 172.21.15.7:0/581968934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5bcc82ad0 0x55a5bcc3a800 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7faf2c0585a0 tx=0x7faf2c05a000 comp rx=0 tx=0).stop 2024-04-25T10:04:39.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.303+0000 7faf3d7cc740 1 -- 172.21.15.7:0/581968934 shutdown_connections 2024-04-25T10:04:39.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.303+0000 7faf3d7cc740 1 --2- 172.21.15.7:0/581968934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5bcc82ad0 0x55a5bcc3a800 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.303+0000 7faf3d7cc740 1 --2- 172.21.15.7:0/581968934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5bcc65230 0x55a5bcc3a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.303+0000 7faf3d7cc740 1 --2- 172.21.15.7:0/581968934 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a5bcc515f0 0x55a5bcc61760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.303+0000 7faf3d7cc740 1 -- 172.21.15.7:0/581968934 >> 172.21.15.7:0/581968934 conn(0x55a5bcc3af10 msgr2=0x55a5bcc8fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.303+0000 7faf3d7cc740 1 -- 172.21.15.7:0/581968934 shutdown_connections 2024-04-25T10:04:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.303+0000 7faf3d7cc740 1 -- 172.21.15.7:0/581968934 wait complete. 2024-04-25T10:04:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.303+0000 7faf3d7cc740 1 -- start start 2024-04-25T10:04:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.303+0000 7faf3d7cc740 1 Processor -- start 2024-04-25T10:04:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.304+0000 7faf3d7cc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5bcc515f0 0x55a5bcc3a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.304+0000 7faf3d7cc740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a5bcc65230 0x55a5bcc3a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.304+0000 7faf3d7cc740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5bcc82ad0 0x55a5bcc65ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.304+0000 7faf3d7cc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5bcc66e30 con 0x55a5bcc515f0 2024-04-25T10:04:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.304+0000 7faf3d7cc740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5bcc4eca0 con 0x55a5bcc82ad0 2024-04-25T10:04:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.304+0000 7faf3d7cc740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5bcc63920 con 0x55a5bcc65230 2024-04-25T10:04:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.304+0000 7faf3d7cc740 10 client.0 _ll_register_callbacks cb 0x55a5bcc35c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:04:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.304+0000 7faf38869640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5bcc515f0 0x55a5bcc3a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.304+0000 7faf38869640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5bcc515f0 0x55a5bcc3a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47828/0 (socket says 172.21.15.7:47828) 2024-04-25T10:04:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.304+0000 7faf38869640 1 -- 172.21.15.7:0/2323839588 learned_addr learned my addr 172.21.15.7:0/2323839588 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:39.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.304+0000 7faf33fff640 1 --2- 172.21.15.7:0/2323839588 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a5bcc65230 0x55a5bcc3a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.304+0000 7faf3906a640 1 --2- 172.21.15.7:0/2323839588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5bcc82ad0 0x55a5bcc65ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.305+0000 7faf38869640 1 -- 172.21.15.7:0/2323839588 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a5bcc65230 msgr2=0x55a5bcc3a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:39.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.305+0000 7faf38869640 1 --2- 172.21.15.7:0/2323839588 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a5bcc65230 0x55a5bcc3a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.305+0000 7faf38869640 1 -- 172.21.15.7:0/2323839588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5bcc82ad0 msgr2=0x55a5bcc65ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:39.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.305+0000 7faf38869640 1 --2- 172.21.15.7:0/2323839588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5bcc82ad0 0x55a5bcc65ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.305+0000 7faf38869640 1 -- 172.21.15.7:0/2323839588 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a5bcc76780 con 0x55a5bcc515f0 2024-04-25T10:04:39.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.305+0000 7faf38869640 1 --2- 172.21.15.7:0/2323839588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5bcc515f0 0x55a5bcc3a290 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7faf240036a0 tx=0x7faf24000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c19618edc4281436 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:39.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.305+0000 7faf137fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:04:39.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.305+0000 7faf137fe640 1 -- 172.21.15.7:0/2323839588 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf24025320 con 0x55a5bcc515f0 2024-04-25T10:04:39.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.305+0000 7faf137fe640 1 -- 172.21.15.7:0/2323839588 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 6101+0+0 (secure 0 0 0) 0x7faf240254c0 con 0x55a5bcc515f0 2024-04-25T10:04:39.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.305+0000 7faf3d7cc740 1 -- 172.21.15.7:0/2323839588 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faf2c0701b0 con 0x55a5bcc515f0 2024-04-25T10:04:39.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.305+0000 7faf137fe640 1 -- 172.21.15.7:0/2323839588 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf24034050 con 0x55a5bcc515f0 2024-04-25T10:04:39.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.305+0000 7faf3d7cc740 10 client.9219 fetch_fsmap learned FSMap version 88 2024-04-25T10:04:39.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.305+0000 7faf3d7cc740 1 -- 172.21.15.7:0/2323839588 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=2+}) v3 -- 0x55a5bcc7ef50 con 0x55a5bcc515f0 2024-04-25T10:04:39.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.305+0000 7faf137fe640 1 -- 172.21.15.7:0/2323839588 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c0701b0 con 0x55a5bcc515f0 2024-04-25T10:04:39.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.305+0000 7faf137fe640 1 -- 172.21.15.7:0/2323839588 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 88) v1 ==== 3294+0+0 (secure 0 0 0) 0x7faf24037020 con 0x55a5bcc515f0 2024-04-25T10:04:39.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.305+0000 7faf3d7cc740 10 client.9219 fetch_fsmap finished waiting for FSMap version 88 2024-04-25T10:04:39.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.305+0000 7faf3d7cc740 10 client.9219 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:04:39.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.305+0000 7faf3d7cc740 20 client.9219 populate_metadata read hostname 'smithi007' 2024-04-25T10:04:39.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.305+0000 7faf3d7cc740 1 --2- 172.21.15.7:0/2323839588 >> [v2:172.21.15.7:6834/3623521645,v1:172.21.15.7:6836/3623521645] conn(0x55a5bcc621d0 0x55a5bcc625b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.305+0000 7faf3d7cc740 4 client.9219 mds_command: new command op to 9051 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:04:39.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.305+0000 7faf3d7cc740 1 -- 172.21.15.7:0/2323839588 --> [v2:172.21.15.7:6834/3623521645,v1:172.21.15.7:6836/3623521645] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a5bcbaaf50 con 0x55a5bcc621d0 2024-04-25T10:04:39.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.306+0000 7faf33fff640 1 --2- 172.21.15.7:0/2323839588 >> [v2:172.21.15.7:6834/3623521645,v1:172.21.15.7:6836/3623521645] conn(0x55a5bcc621d0 0x55a5bcc625b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.306+0000 7faf33fff640 1 --2- 172.21.15.7:0/2323839588 >> [v2:172.21.15.7:6834/3623521645,v1:172.21.15.7:6836/3623521645] conn(0x55a5bcc621d0 0x55a5bcc625b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1832784cd22687bb server_cookie=b0efedb8ec032529 in_seq=0 out_seq=0 2024-04-25T10:04:39.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.306+0000 7faf137fe640 10 client.9219 ms_handle_connect on v2:172.21.15.7:6834/3623521645 2024-04-25T10:04:39.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.306+0000 7faf137fe640 1 -- 172.21.15.7:0/2323839588 <== mds.0 v2:172.21.15.7:6834/3623521645 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55a5bcbaaf50 con 0x55a5bcc621d0 2024-04-25T10:04:39.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.306+0000 7faf137fe640 10 client.9219 handle_command_reply: tid=0 2024-04-25T10:04:39.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.306+0000 7faf3d7cc740 1 client.9219 shutdown 2024-04-25T10:04:39.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.306+0000 7faf3d7cc740 1 -- 172.21.15.7:0/2323839588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5bcc515f0 msgr2=0x55a5bcc3a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.306+0000 7faf3d7cc740 1 --2- 172.21.15.7:0/2323839588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5bcc515f0 0x55a5bcc3a290 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7faf240036a0 tx=0x7faf24000ed0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.306+0000 7faf3d7cc740 1 -- 172.21.15.7:0/2323839588 shutdown_connections 2024-04-25T10:04:39.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.306+0000 7faf3d7cc740 1 --2- 172.21.15.7:0/2323839588 >> [v2:172.21.15.7:6834/3623521645,v1:172.21.15.7:6836/3623521645] conn(0x55a5bcc621d0 0x55a5bcc625b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.306+0000 7faf3d7cc740 1 --2- 172.21.15.7:0/2323839588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5bcc82ad0 0x55a5bcc65ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.306+0000 7faf3d7cc740 1 --2- 172.21.15.7:0/2323839588 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55a5bcc65230 0x55a5bcc3a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.306+0000 7faf3d7cc740 1 --2- 172.21.15.7:0/2323839588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5bcc515f0 0x55a5bcc3a290 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.306+0000 7faf137fe640 0 client.9219 ms_handle_reset on v2:172.21.15.7:6834/3623521645 2024-04-25T10:04:39.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.306+0000 7faf3d7cc740 1 -- 172.21.15.7:0/2323839588 >> 172.21.15.7:0/2323839588 conn(0x55a5bcc3af10 msgr2=0x55a5bcc64300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:39.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.306+0000 7faf3d7cc740 1 -- 172.21.15.7:0/2323839588 shutdown_connections 2024-04-25T10:04:39.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.306+0000 7faf3d7cc740 1 -- 172.21.15.7:0/2323839588 wait complete. 2024-04-25T10:04:39.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.307+0000 7faf3d7cc740 20 client.9219 trim_cache size 0 max 16384 2024-04-25T10:04:39.324 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:04:39.324 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "c03d0745-5946-49c3-ad88-1165c5b68b4e", 2024-04-25T10:04:39.324 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-04-25T10:04:39.324 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 9051, 2024-04-25T10:04:39.324 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-04-25T10:04:39.324 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-04-25T10:04:39.324 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-04-25T10:04:39.324 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 9.0786272480000001, 2024-04-25T10:04:39.324 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 88, 2024-04-25T10:04:39.324 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 117, 2024-04-25T10:04:39.324 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 117, 2024-04-25T10:04:39.324 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 14.121981484999999 2024-04-25T10:04:39.324 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:04:39.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.307+0000 7faf3aacd640 1 -- 172.21.15.7:0/1801660374 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faf2006b4d0 msgr2=0x7faf2006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.307+0000 7faf3aacd640 1 --2- 172.21.15.7:0/1801660374 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faf2006b4d0 0x7faf2006d990 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7faf240011e0 tx=0x7faf24009040 comp rx=0 tx=0).stop 2024-04-25T10:04:39.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.307+0000 7faf3aacd640 1 -- 172.21.15.7:0/1801660374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf3415db00 msgr2=0x7faf3414ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.307+0000 7faf3aacd640 1 --2- 172.21.15.7:0/1801660374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf3415db00 0x7faf3414ed20 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00cc10 tx=0x7faf2c00a430 comp rx=0 tx=0).stop 2024-04-25T10:04:39.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.307+0000 7faf3aacd640 1 -- 172.21.15.7:0/1801660374 shutdown_connections 2024-04-25T10:04:39.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.307+0000 7faf3aacd640 1 --2- 172.21.15.7:0/1801660374 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faf2006b4d0 0x7faf2006d990 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.307+0000 7faf3aacd640 1 --2- 172.21.15.7:0/1801660374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf3415db00 0x7faf3414ed20 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.307+0000 7faf3aacd640 1 --2- 172.21.15.7:0/1801660374 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faf340d0a50 0x7faf3414e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.307+0000 7faf3aacd640 1 --2- 172.21.15.7:0/1801660374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf340b53b0 0x7faf3415f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.307+0000 7faf3aacd640 1 -- 172.21.15.7:0/1801660374 >> 172.21.15.7:0/1801660374 conn(0x7faf34072290 msgr2=0x7faf340ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:39.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.307+0000 7faf3aacd640 1 -- 172.21.15.7:0/1801660374 shutdown_connections 2024-04-25T10:04:39.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.307+0000 7faf3aacd640 1 -- 172.21.15.7:0/1801660374 wait complete. 2024-04-25T10:04:39.327 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:04:39.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.423+0000 7effa7458640 1 Processor -- start 2024-04-25T10:04:39.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.423+0000 7effa7458640 1 -- start start 2024-04-25T10:04:39.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.423+0000 7effa7458640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7effa006c250 0x7effa009a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.424+0000 7effa7458640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7effa006bce0 0x7effa006c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.424+0000 7effa7458640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa006cb70 con 0x7effa00d0360 2024-04-25T10:04:39.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.424+0000 7effa7458640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa009ae20 con 0x7effa006c250 2024-04-25T10:04:39.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.424+0000 7effa7458640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa009a450 con 0x7effa006bce0 2024-04-25T10:04:39.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.424+0000 7effa51f4640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7effa006c250 0x7effa009a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.424+0000 7effa59f5640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7effa00d0360 0x7effa00cbd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39456/0 (socket says 172.21.15.7:39456) 2024-04-25T10:04:39.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.424+0000 7effa51f4640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7effa006c250 0x7effa009a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47842/0 (socket says 172.21.15.7:47842) 2024-04-25T10:04:39.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.424+0000 7effa59f5640 1 -- 172.21.15.7:0/3811455523 learned_addr learned my addr 172.21.15.7:0/3811455523 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:39.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.424+0000 7effa49f3640 1 --2- 172.21.15.7:0/3811455523 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7effa006bce0 0x7effa006c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.424+0000 7effa51f4640 1 -- 172.21.15.7:0/3811455523 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7effa006bce0 msgr2=0x7effa006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:39.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.424+0000 7effa51f4640 1 --2- 172.21.15.7:0/3811455523 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7effa006bce0 0x7effa006c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.424+0000 7effa51f4640 1 -- 172.21.15.7:0/3811455523 >> v1:172.21.15.7:6789/0 conn(0x7effa00d0360 legacy=0x7effa00cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.424+0000 7effa51f4640 1 -- 172.21.15.7:0/3811455523 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa0099b20 con 0x7effa006c250 2024-04-25T10:04:39.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.425+0000 7effa51f4640 1 --2- 172.21.15.7:0/3811455523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effa006c250 0x7effa009a8e0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7eff9c0097a0 tx=0x7eff9c02a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b92438280d377ea9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:39.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.425+0000 7eff97fff640 1 -- 172.21.15.7:0/3811455523 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c037070 con 0x7effa006c250 2024-04-25T10:04:39.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.425+0000 7eff97fff640 1 -- 172.21.15.7:0/3811455523 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9c02adb0 con 0x7effa006c250 2024-04-25T10:04:39.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.425+0000 7eff97fff640 1 -- 172.21.15.7:0/3811455523 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c032660 con 0x7effa006c250 2024-04-25T10:04:39.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.425+0000 7effa7458640 1 -- 172.21.15.7:0/3811455523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effa006c250 msgr2=0x7effa009a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.425+0000 7effa7458640 1 --2- 172.21.15.7:0/3811455523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effa006c250 0x7effa009a8e0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7eff9c0097a0 tx=0x7eff9c02a060 comp rx=0 tx=0).stop 2024-04-25T10:04:39.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.425+0000 7effa7458640 1 -- 172.21.15.7:0/3811455523 shutdown_connections 2024-04-25T10:04:39.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.425+0000 7effa7458640 1 --2- 172.21.15.7:0/3811455523 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7effa006bce0 0x7effa006c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.425+0000 7effa7458640 1 --2- 172.21.15.7:0/3811455523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effa006c250 0x7effa009a8e0 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.425+0000 7effa7458640 1 -- 172.21.15.7:0/3811455523 >> 172.21.15.7:0/3811455523 conn(0x7effa00d16e0 msgr2=0x7effa00d1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:39.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.426+0000 7effa7458640 1 -- 172.21.15.7:0/3811455523 shutdown_connections 2024-04-25T10:04:39.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.426+0000 7effa7458640 1 -- 172.21.15.7:0/3811455523 wait complete. 2024-04-25T10:04:39.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.427+0000 7effa7458640 1 Processor -- start 2024-04-25T10:04:39.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.427+0000 7effa7458640 1 -- start start 2024-04-25T10:04:39.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.427+0000 7effa7458640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7effa006bce0 0x7effa00c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.428+0000 7effa7458640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effa006c250 0x7effa015da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.428+0000 7effa7458640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa00d0360 0x7effa00c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.428+0000 7effa7458640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa009a0e0 con 0x7effa006c250 2024-04-25T10:04:39.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.428+0000 7effa7458640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa00d0c60 con 0x7effa00d0360 2024-04-25T10:04:39.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.428+0000 7effa7458640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa015f000 con 0x7effa006bce0 2024-04-25T10:04:39.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.428+0000 7effa49f3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effa006c250 0x7effa015da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.428+0000 7effa49f3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effa006c250 0x7effa015da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47850/0 (socket says 172.21.15.7:47850) 2024-04-25T10:04:39.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.428+0000 7effa49f3640 1 -- 172.21.15.7:0/34039336 learned_addr learned my addr 172.21.15.7:0/34039336 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:39.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.428+0000 7effa51f4640 1 --2- 172.21.15.7:0/34039336 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7effa006bce0 0x7effa00c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.428+0000 7effa59f5640 1 --2- 172.21.15.7:0/34039336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa00d0360 0x7effa00c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.428+0000 7effa49f3640 1 -- 172.21.15.7:0/34039336 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7effa006bce0 msgr2=0x7effa00c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.428+0000 7effa49f3640 1 --2- 172.21.15.7:0/34039336 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7effa006bce0 0x7effa00c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.428+0000 7effa49f3640 1 -- 172.21.15.7:0/34039336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa00d0360 msgr2=0x7effa00c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.428+0000 7effa49f3640 1 --2- 172.21.15.7:0/34039336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa00d0360 0x7effa00c6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.428+0000 7effa49f3640 1 -- 172.21.15.7:0/34039336 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa00c9390 con 0x7effa006c250 2024-04-25T10:04:39.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.428+0000 7effa49f3640 1 --2- 172.21.15.7:0/34039336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effa006c250 0x7effa015da10 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7eff9000c7c0 tx=0x7eff9000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:39.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.428+0000 7eff95ffb640 1 -- 172.21.15.7:0/34039336 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff90015070 con 0x7effa006c250 2024-04-25T10:04:39.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.428+0000 7eff95ffb640 1 -- 172.21.15.7:0/34039336 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff90007820 con 0x7effa006c250 2024-04-25T10:04:39.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.428+0000 7eff95ffb640 1 -- 172.21.15.7:0/34039336 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff90007bd0 con 0x7effa006c250 2024-04-25T10:04:39.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.428+0000 7effa7458640 1 -- 172.21.15.7:0/34039336 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa00c9670 con 0x7effa006c250 2024-04-25T10:04:39.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.429+0000 7effa7458640 1 -- 172.21.15.7:0/34039336 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa00c9c30 con 0x7effa006c250 2024-04-25T10:04:39.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.429+0000 7effa7458640 1 -- 172.21.15.7:0/34039336 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa0068fd0 con 0x7effa006c250 2024-04-25T10:04:39.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.430+0000 7eff95ffb640 1 -- 172.21.15.7:0/34039336 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7eff90018070 con 0x7effa006c250 2024-04-25T10:04:39.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.430+0000 7eff95ffb640 1 --2- 172.21.15.7:0/34039336 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7eff8406b4d0 0x7eff8406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.430+0000 7eff95ffb640 1 -- 172.21.15.7:0/34039336 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6101+0+0 (secure 0 0 0) 0x7eff90089e20 con 0x7effa006c250 2024-04-25T10:04:39.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.430+0000 7effa51f4640 1 --2- 172.21.15.7:0/34039336 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7eff8406b4d0 0x7eff8406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.431+0000 7effa51f4640 1 --2- 172.21.15.7:0/34039336 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7eff8406b4d0 0x7eff8406d990 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7eff9c034000 tx=0x7eff9c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:39.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.434+0000 7eff95ffb640 1 -- 172.21.15.7:0/34039336 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7eff900584c0 con 0x7effa006c250 2024-04-25T10:04:39.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.652+0000 7effa7458640 1 -- 172.21.15.7:0/34039336 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7effa00d1150 con 0x7effa006c250 2024-04-25T10:04:39.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.652+0000 7eff95ffb640 1 -- 172.21.15.7:0/34039336 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v88) v1 ==== 53+0+73 (secure 0 0 0) 0x7eff9005c560 con 0x7effa006c250 2024-04-25T10:04:39.658 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T10:04:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.654+0000 7effa7458640 1 -- 172.21.15.7:0/34039336 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7eff8406b4d0 msgr2=0x7eff8406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.654+0000 7effa7458640 1 --2- 172.21.15.7:0/34039336 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7eff8406b4d0 0x7eff8406d990 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7eff9c034000 tx=0x7eff9c02e000 comp rx=0 tx=0).stop 2024-04-25T10:04:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.654+0000 7effa7458640 1 -- 172.21.15.7:0/34039336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effa006c250 msgr2=0x7effa015da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.654+0000 7effa7458640 1 --2- 172.21.15.7:0/34039336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effa006c250 0x7effa015da10 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7eff9000c7c0 tx=0x7eff9000cc80 comp rx=0 tx=0).stop 2024-04-25T10:04:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.654+0000 7effa7458640 1 -- 172.21.15.7:0/34039336 shutdown_connections 2024-04-25T10:04:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.654+0000 7effa7458640 1 --2- 172.21.15.7:0/34039336 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7eff8406b4d0 0x7eff8406d990 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.654+0000 7effa7458640 1 --2- 172.21.15.7:0/34039336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa00d0360 0x7effa00c6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.654+0000 7effa7458640 1 --2- 172.21.15.7:0/34039336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effa006c250 0x7effa015da10 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.654+0000 7effa7458640 1 --2- 172.21.15.7:0/34039336 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7effa006bce0 0x7effa00c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.654+0000 7effa7458640 1 -- 172.21.15.7:0/34039336 >> 172.21.15.7:0/34039336 conn(0x7effa00d16e0 msgr2=0x7effa00b4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:39.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.654+0000 7effa7458640 1 -- 172.21.15.7:0/34039336 shutdown_connections 2024-04-25T10:04:39.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:39.654+0000 7effa7458640 1 -- 172.21.15.7:0/34039336 wait complete. 2024-04-25T10:04:39.671 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T10:04:39.671 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:04:39.671 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-04-25T10:04:39.671 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T10:04:39.671 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T10:04:39.671 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T10:04:39.671 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T10:04:39.671 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:04:39.671 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:04:39.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:39.672 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-04-25T10:04:39.687 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:04:39.688 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:04:39.688 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:04:39.688 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:39.688 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-04-25T10:04:39.688 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:39.688 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:04:39.688 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:39.688 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-04-25T10:04:39.688 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:04:39.688 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:39.688 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-04-25T10:04:39.688 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:04:39.688 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:39.688 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-04-25T10:04:39.689 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T10:04:39.689 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42120sec preferred_lft 42120sec 2024-04-25T10:04:39.689 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link noprefixroute 2024-04-25T10:04:39.689 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:39.689 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:04:39.689 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:39.689 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-04-25T10:04:39.689 INFO:teuthology.orchestra.run.smithi007.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T10:04:39.689 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 26:0c:99:53:12:e3 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:39.689 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T10:04:39.689 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:39.689 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::50aa:55ff:febc:5f67/64 scope link 2024-04-25T10:04:39.689 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:39.689 INFO:teuthology.orchestra.run.smithi007.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:04:39.690 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 6e:99:f1:00:a9:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:04:39.690 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6c99:f1ff:fe00:a95e/64 scope link 2024-04-25T10:04:39.690 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:39.690 INFO:teuthology.orchestra.run.smithi007.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:04:39.690 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 26:0c:99:53:12:e3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T10:04:39.690 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::240c:99ff:fe53:12e3/64 scope link 2024-04-25T10:04:39.690 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:39.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:39.690 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:04:39.751 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-04-25T10:04:39.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:39.753 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-04-25T10:04:39.809 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-04-25T10:04:39.809 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:04:39.809 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T10:04:39.809 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T10:04:39.809 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:04:39.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:39.810 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-04-25T10:04:39.810 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-25T10:04:39.810 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:04:39.810 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:04:39.810 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:04:39.810 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-25T10:04:39.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:39.895 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-04-25T10:04:39.910 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T10:04:39.910 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T10:04:39.910 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:04:39.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:39.911 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-04-25T10:04:39.975 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:04:39.975 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T10:04:40.030 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:04:40.031 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:04:40.031 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:04:40.086 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T10:04:40.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:40.086 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:04:40.168 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:04:40.169 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T10:04:40.169 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T10:04:40.177 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:04:40.177 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T10:04:40.177 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T10:04:40.177 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T10:04:40.177 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T10:04:40.182 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:04:40.182 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T10:04:40.182 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T10:04:40.182 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T10:04:40.182 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T10:04:40.182 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790" 2024-04-25T10:04:40.182 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790:/ 2024-04-25T10:04:40.182 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c03d0745-5946-49c3-ad88-1165c5b68b4e" will pass to kernel 2024-04-25T10:04:40.183 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T10:04:40.183 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-04-25T10:04:40.183 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T10:04:40.183 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T10:04:40.183 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T10:04:40.184 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T10:04:40.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:40.185 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:04:40.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:40.250 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:04:40.310 INFO:teuthology.orchestra.run.smithi007.stdout:client9231 2024-04-25T10:04:40.311 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:04:40.311 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:40.367 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T10:04:40.367 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T10:04:40.367 DEBUG:teuthology.orchestra.run.smithi007:> mount_point = "/home/ubuntu/cephtest/mnt.0" 2024-04-25T10:04:40.368 DEBUG:teuthology.orchestra.run.smithi007:> parent = os.path.join(mount_point, "parent") 2024-04-25T10:04:40.368 DEBUG:teuthology.orchestra.run.smithi007:> os.mkdir(parent) 2024-04-25T10:04:40.368 DEBUG:teuthology.orchestra.run.smithi007:> flushed = os.path.join(parent, "flushed") 2024-04-25T10:04:40.368 DEBUG:teuthology.orchestra.run.smithi007:> os.mkdir(flushed) 2024-04-25T10:04:40.368 DEBUG:teuthology.orchestra.run.smithi007:> for f in ["alpha", "bravo", "charlie"]: 2024-04-25T10:04:40.368 DEBUG:teuthology.orchestra.run.smithi007:> open(os.path.join(flushed, f), '"'"'w'"'"').write(f) 2024-04-25T10:04:40.368 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T10:04:40.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:04:40.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:40.490 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T10:04:40.550 INFO:teuthology.orchestra.run.smithi007.stdout:./ 2024-04-25T10:04:40.550 INFO:teuthology.orchestra.run.smithi007.stdout:./parent 2024-04-25T10:04:40.551 INFO:teuthology.orchestra.run.smithi007.stdout:./parent/flushed 2024-04-25T10:04:40.551 INFO:teuthology.orchestra.run.smithi007.stdout:./parent/flushed/charlie 2024-04-25T10:04:40.551 INFO:teuthology.orchestra.run.smithi007.stdout:./parent/flushed/alpha 2024-04-25T10:04:40.551 INFO:teuthology.orchestra.run.smithi007.stdout:./parent/flushed/bravo 2024-04-25T10:04:40.551 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T10:04:40.551 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T10:04:40.551 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T10:04:40.552 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T10:04:40.552 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T10:04:40.552 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T10:04:40.657 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-04-25T10:04:40.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:04:40.667 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T10:04:40.667 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T10:04:40.667 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T10:04:40.667 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T10:04:40.667 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-04-25T10:04:40.667 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T10:04:40.774 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627776 2024-04-25T10:04:40.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:04:40.783 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T10:04:40.783 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T10:04:40.784 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T10:04:40.784 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T10:04:40.784 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-04-25T10:04:40.784 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T10:04:40.894 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627777 2024-04-25T10:04:40.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:04:40.900 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T10:04:40.900 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T10:04:40.900 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T10:04:40.900 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T10:04:40.900 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-04-25T10:04:40.900 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T10:04:41.007 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627780 2024-04-25T10:04:41.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:04:41.016 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T10:04:41.016 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T10:04:41.016 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T10:04:41.016 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T10:04:41.016 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-04-25T10:04:41.016 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T10:04:41.123 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627778 2024-04-25T10:04:41.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:04:41.132 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T10:04:41.132 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T10:04:41.132 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T10:04:41.132 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T10:04:41.132 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/bravo").st_ino) 2024-04-25T10:04:41.132 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T10:04:41.238 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627779 2024-04-25T10:04:41.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:04:41.247 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:04:41.247 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:41.306 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:04:41.307 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:41.361 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:41.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.497+0000 7fe6f3ef5640 1 Processor -- start 2024-04-25T10:04:41.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.497+0000 7fe6f3ef5640 1 -- start start 2024-04-25T10:04:41.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.498+0000 7fe6f3ef5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe6ec15da20 0x7fe6ec09a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:41.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.498+0000 7fe6f3ef5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6ec06bc70 0x7fe6ec0d0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:41.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.498+0000 7fe6f3ef5640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe6ec0d10b0 0x7fe6ec06c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:41.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.498+0000 7fe6f3ef5640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6ec0d06e0 con 0x7fe6ec0d10b0 2024-04-25T10:04:41.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.498+0000 7fe6f3ef5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6ec09a940 con 0x7fe6ec15da20 2024-04-25T10:04:41.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.498+0000 7fe6f3ef5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec0cfad0 con 0x7fe6ec06bc70 2024-04-25T10:04:41.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.498+0000 7fe6f2492640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe6ec0d10b0 0x7fe6ec06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:41.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.498+0000 7fe6f2492640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe6ec0d10b0 0x7fe6ec06c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58064/0 (socket says 172.21.15.7:58064) 2024-04-25T10:04:41.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.498+0000 7fe6f2492640 1 -- 172.21.15.7:0/838113432 learned_addr learned my addr 172.21.15.7:0/838113432 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:41.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.498+0000 7fe6f1c91640 1 --2- 172.21.15.7:0/838113432 >> v2:172.21.15.55:3300/0 conn(0x7fe6ec15da20 0x7fe6ec09a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:41.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.498+0000 7fe6f1490640 1 --2- 172.21.15.7:0/838113432 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6ec06bc70 0x7fe6ec0d0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:41.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.498+0000 7fe6f2492640 1 -- 172.21.15.7:0/838113432 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6ec06bc70 msgr2=0x7fe6ec0d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:41.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.498+0000 7fe6f2492640 1 --2- 172.21.15.7:0/838113432 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6ec06bc70 0x7fe6ec0d0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.498+0000 7fe6f2492640 1 -- 172.21.15.7:0/838113432 >> v2:172.21.15.55:3300/0 conn(0x7fe6ec15da20 msgr2=0x7fe6ec09a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:41.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.498+0000 7fe6f2492640 1 --2- 172.21.15.7:0/838113432 >> v2:172.21.15.55:3300/0 conn(0x7fe6ec15da20 0x7fe6ec09a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.498+0000 7fe6f2492640 1 -- 172.21.15.7:0/838113432 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ec0cfdb0 con 0x7fe6ec0d10b0 2024-04-25T10:04:41.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.498+0000 7fe6f1c91640 1 --2- 172.21.15.7:0/838113432 >> v2:172.21.15.55:3300/0 conn(0x7fe6ec15da20 0x7fe6ec09a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:41.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.499+0000 7fe6f2492640 1 --2- 172.21.15.7:0/838113432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6ec0d10b0 0x7fe6ec06c330 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec06dca0 tx=0x7fe6dc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55e16c392db663d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:41.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.499+0000 7fe6f0c8f640 1 -- 172.21.15.7:0/838113432 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc036070 con 0x7fe6ec0d10b0 2024-04-25T10:04:41.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.499+0000 7fe6f0c8f640 1 -- 172.21.15.7:0/838113432 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6dc031600 con 0x7fe6ec0d10b0 2024-04-25T10:04:41.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.499+0000 7fe6f0c8f640 1 -- 172.21.15.7:0/838113432 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc0319d0 con 0x7fe6ec0d10b0 2024-04-25T10:04:41.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.500+0000 7fe6f3ef5640 1 -- 172.21.15.7:0/838113432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6ec0d10b0 msgr2=0x7fe6ec06c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:41.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.500+0000 7fe6f3ef5640 1 --2- 172.21.15.7:0/838113432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6ec0d10b0 0x7fe6ec06c330 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec06dca0 tx=0x7fe6dc02a6a0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.500+0000 7fe6f3ef5640 1 -- 172.21.15.7:0/838113432 shutdown_connections 2024-04-25T10:04:41.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.500+0000 7fe6f3ef5640 1 --2- 172.21.15.7:0/838113432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6ec0d10b0 0x7fe6ec06c330 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.500+0000 7fe6f3ef5640 1 --2- 172.21.15.7:0/838113432 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6ec06bc70 0x7fe6ec0d0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.500+0000 7fe6f3ef5640 1 --2- 172.21.15.7:0/838113432 >> v2:172.21.15.55:3300/0 conn(0x7fe6ec15da20 0x7fe6ec09a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.500+0000 7fe6f3ef5640 1 -- 172.21.15.7:0/838113432 >> 172.21.15.7:0/838113432 conn(0x7fe6ec0d16f0 msgr2=0x7fe6ec0d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:41.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.500+0000 7fe6f3ef5640 1 -- 172.21.15.7:0/838113432 shutdown_connections 2024-04-25T10:04:41.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.500+0000 7fe6f3ef5640 1 -- 172.21.15.7:0/838113432 wait complete. 2024-04-25T10:04:41.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.501+0000 7fe6f3ef5640 1 Processor -- start 2024-04-25T10:04:41.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.501+0000 7fe6f3ef5640 1 -- start start 2024-04-25T10:04:41.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.502+0000 7fe6f3ef5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6ec06bc70 0x7fe6ec152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:41.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.502+0000 7fe6f3ef5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6ec0d10b0 0x7fe6ec0b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:41.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.502+0000 7fe6f3ef5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6ec15da20 0x7fe6ec14f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:41.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.502+0000 7fe6f3ef5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec15de00 con 0x7fe6ec06bc70 2024-04-25T10:04:41.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.502+0000 7fe6f3ef5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec0d0370 con 0x7fe6ec0d10b0 2024-04-25T10:04:41.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.502+0000 7fe6f3ef5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec15df80 con 0x7fe6ec15da20 2024-04-25T10:04:41.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.502+0000 7fe6f1c91640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6ec06bc70 0x7fe6ec152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:41.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.502+0000 7fe6f1c91640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6ec06bc70 0x7fe6ec152090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58076/0 (socket says 172.21.15.7:58076) 2024-04-25T10:04:41.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.502+0000 7fe6f1c91640 1 -- 172.21.15.7:0/47023820 learned_addr learned my addr 172.21.15.7:0/47023820 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:41.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.502+0000 7fe6f1490640 1 --2- 172.21.15.7:0/47023820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6ec0d10b0 0x7fe6ec0b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:41.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.502+0000 7fe6f2492640 1 --2- 172.21.15.7:0/47023820 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6ec15da20 0x7fe6ec14f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:41.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.502+0000 7fe6f1c91640 1 -- 172.21.15.7:0/47023820 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6ec15da20 msgr2=0x7fe6ec14f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:41.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.502+0000 7fe6f1c91640 1 --2- 172.21.15.7:0/47023820 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6ec15da20 0x7fe6ec14f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.502+0000 7fe6f1c91640 1 -- 172.21.15.7:0/47023820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6ec0d10b0 msgr2=0x7fe6ec0b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:41.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.502+0000 7fe6f1c91640 1 --2- 172.21.15.7:0/47023820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6ec0d10b0 0x7fe6ec0b42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.502+0000 7fe6f1c91640 1 -- 172.21.15.7:0/47023820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ec152800 con 0x7fe6ec06bc70 2024-04-25T10:04:41.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.502+0000 7fe6f1490640 1 --2- 172.21.15.7:0/47023820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6ec0d10b0 0x7fe6ec0b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:41.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.503+0000 7fe6f1c91640 1 --2- 172.21.15.7:0/47023820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6ec06bc70 0x7fe6ec152090 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400d800 tx=0x7fe6e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:41.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.503+0000 7fe6ea7fc640 1 -- 172.21.15.7:0/47023820 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4004030 con 0x7fe6ec06bc70 2024-04-25T10:04:41.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.503+0000 7fe6ea7fc640 1 -- 172.21.15.7:0/47023820 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e40041d0 con 0x7fe6ec06bc70 2024-04-25T10:04:41.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.503+0000 7fe6ea7fc640 1 -- 172.21.15.7:0/47023820 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e400b6c0 con 0x7fe6ec06bc70 2024-04-25T10:04:41.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.503+0000 7fe6f3ef5640 1 -- 172.21.15.7:0/47023820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6ec152ae0 con 0x7fe6ec06bc70 2024-04-25T10:04:41.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.503+0000 7fe6f3ef5640 1 -- 172.21.15.7:0/47023820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6ec14fc60 con 0x7fe6ec06bc70 2024-04-25T10:04:41.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.504+0000 7fe6f3ef5640 1 -- 172.21.15.7:0/47023820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6ec068fd0 con 0x7fe6ec06bc70 2024-04-25T10:04:41.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.504+0000 7fe6ea7fc640 1 -- 172.21.15.7:0/47023820 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe6e400b860 con 0x7fe6ec06bc70 2024-04-25T10:04:41.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.505+0000 7fe6ea7fc640 1 --2- 172.21.15.7:0/47023820 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe6d806b4d0 0x7fe6d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:41.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.505+0000 7fe6ea7fc640 1 -- 172.21.15.7:0/47023820 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe6e408a600 con 0x7fe6ec06bc70 2024-04-25T10:04:41.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.505+0000 7fe6f1490640 1 --2- 172.21.15.7:0/47023820 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe6d806b4d0 0x7fe6d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:41.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.505+0000 7fe6f1490640 1 --2- 172.21.15.7:0/47023820 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe6d806b4d0 0x7fe6d806d990 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0006fd0 tx=0x7fe6e0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:41.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.509+0000 7fe6ea7fc640 1 -- 172.21.15.7:0/47023820 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe6e40592f0 con 0x7fe6ec06bc70 2024-04-25T10:04:41.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.691+0000 7fe6f3ef5640 1 -- 172.21.15.7:0/47023820 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6ec0cf020 con 0x7fe6ec06bc70 2024-04-25T10:04:41.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.692+0000 7fe6ea7fc640 1 -- 172.21.15.7:0/47023820 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+16856 (secure 0 0 0) 0x7fe6e4058bf0 con 0x7fe6ec06bc70 2024-04-25T10:04:41.697 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:41.698 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":117,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:04:31.237000+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:04:27.856713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T10:04:28.566676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:41.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.694+0000 7fe6f3ef5640 1 -- 172.21.15.7:0/47023820 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe6d806b4d0 msgr2=0x7fe6d806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:41.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.694+0000 7fe6f3ef5640 1 --2- 172.21.15.7:0/47023820 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe6d806b4d0 0x7fe6d806d990 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0006fd0 tx=0x7fe6e0008040 comp rx=0 tx=0).stop 2024-04-25T10:04:41.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.694+0000 7fe6f3ef5640 1 -- 172.21.15.7:0/47023820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6ec06bc70 msgr2=0x7fe6ec152090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:41.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.694+0000 7fe6f3ef5640 1 --2- 172.21.15.7:0/47023820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6ec06bc70 0x7fe6ec152090 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400d800 tx=0x7fe6e400dcc0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.694+0000 7fe6f3ef5640 1 -- 172.21.15.7:0/47023820 shutdown_connections 2024-04-25T10:04:41.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.694+0000 7fe6f3ef5640 1 --2- 172.21.15.7:0/47023820 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe6d806b4d0 0x7fe6d806d990 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.694+0000 7fe6f3ef5640 1 --2- 172.21.15.7:0/47023820 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6ec15da20 0x7fe6ec14f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.694+0000 7fe6f3ef5640 1 --2- 172.21.15.7:0/47023820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6ec0d10b0 0x7fe6ec0b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.694+0000 7fe6f3ef5640 1 --2- 172.21.15.7:0/47023820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6ec06bc70 0x7fe6ec152090 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.694+0000 7fe6f3ef5640 1 -- 172.21.15.7:0/47023820 >> 172.21.15.7:0/47023820 conn(0x7fe6ec0d16f0 msgr2=0x7fe6ec15c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:41.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.694+0000 7fe6f3ef5640 1 -- 172.21.15.7:0/47023820 shutdown_connections 2024-04-25T10:04:41.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.694+0000 7fe6f3ef5640 1 -- 172.21.15.7:0/47023820 wait complete. 2024-04-25T10:04:41.710 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:04:27.856713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:04:28.566676+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '117', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:04:41.714 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:04:41.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.814+0000 7f82859e2640 1 Processor -- start 2024-04-25T10:04:41.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.814+0000 7f82859e2640 1 -- start start 2024-04-25T10:04:41.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.815+0000 7f82859e2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f82800cda20 0x7f82800cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:41.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.815+0000 7f82859e2640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f828006bf10 0x7f82800999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:41.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.815+0000 7f82859e2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82800d02f0 con 0x7f8280099f30 2024-04-25T10:04:41.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.815+0000 7f82859e2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82800cde00 con 0x7f82800cda20 2024-04-25T10:04:41.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.815+0000 7f82859e2640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82800d05d0 con 0x7f828006bf10 2024-04-25T10:04:41.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.815+0000 7f8277fff640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f828006bf10 0x7f82800999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:41.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.815+0000 7f827effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f82800cda20 0x7f82800cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:41.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.815+0000 7f827f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8280099f30 0x7f828015d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:45550/0 (socket says 172.21.15.7:45550) 2024-04-25T10:04:41.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.815+0000 7f827f7fe640 1 -- 172.21.15.7:0/1846415403 learned_addr learned my addr 172.21.15.7:0/1846415403 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:41.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.815+0000 7f8277fff640 1 -- 172.21.15.7:0/1846415403 >> v2:172.21.15.55:3300/0 conn(0x7f82800cda20 msgr2=0x7f82800cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:41.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.815+0000 7f8277fff640 1 --2- 172.21.15.7:0/1846415403 >> v2:172.21.15.55:3300/0 conn(0x7f82800cda20 0x7f82800cf9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.815+0000 7f8277fff640 1 -- 172.21.15.7:0/1846415403 >> v1:172.21.15.55:6789/0 conn(0x7f8280099f30 legacy=0x7f828015d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:41.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.815+0000 7f8277fff640 1 -- 172.21.15.7:0/1846415403 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82800d08b0 con 0x7f828006bf10 2024-04-25T10:04:41.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.816+0000 7f8277fff640 1 --2- 172.21.15.7:0/1846415403 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f828006bf10 0x7f82800999f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f82680097a0 tx=0x7f826802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ced7c550345a5dc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:41.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.816+0000 7f827e7fc640 1 -- 172.21.15.7:0/1846415403 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8268037070 con 0x7f828006bf10 2024-04-25T10:04:41.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.816+0000 7f827e7fc640 1 -- 172.21.15.7:0/1846415403 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8268032440 con 0x7f828006bf10 2024-04-25T10:04:41.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.816+0000 7f827e7fc640 1 -- 172.21.15.7:0/1846415403 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8268032810 con 0x7f828006bf10 2024-04-25T10:04:41.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.817+0000 7f82859e2640 1 -- 172.21.15.7:0/1846415403 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f828006bf10 msgr2=0x7f82800999f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:41.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.817+0000 7f82859e2640 1 --2- 172.21.15.7:0/1846415403 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f828006bf10 0x7f82800999f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f82680097a0 tx=0x7f826802a180 comp rx=0 tx=0).stop 2024-04-25T10:04:41.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.817+0000 7f82859e2640 1 -- 172.21.15.7:0/1846415403 shutdown_connections 2024-04-25T10:04:41.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.817+0000 7f82859e2640 1 --2- 172.21.15.7:0/1846415403 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f828006bf10 0x7f82800999f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.817+0000 7f82859e2640 1 --2- 172.21.15.7:0/1846415403 >> v2:172.21.15.55:3300/0 conn(0x7f82800cda20 0x7f82800cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.817+0000 7f82859e2640 1 -- 172.21.15.7:0/1846415403 >> 172.21.15.7:0/1846415403 conn(0x7f82800b3110 msgr2=0x7f82800b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:41.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.817+0000 7f82859e2640 1 -- 172.21.15.7:0/1846415403 shutdown_connections 2024-04-25T10:04:41.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.817+0000 7f82859e2640 1 -- 172.21.15.7:0/1846415403 wait complete. 2024-04-25T10:04:41.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.818+0000 7f82859e2640 1 Processor -- start 2024-04-25T10:04:41.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.818+0000 7f82859e2640 1 -- start start 2024-04-25T10:04:41.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.819+0000 7f82859e2640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f828006bf10 0x7f82800b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:41.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.819+0000 7f82859e2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8280099f30 0x7f82800c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:41.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.819+0000 7f82859e2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82800cda20 0x7f8280150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:41.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.819+0000 7f82859e2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82800cff10 con 0x7f8280099f30 2024-04-25T10:04:41.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.819+0000 7f82859e2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82800d0e70 con 0x7f82800cda20 2024-04-25T10:04:41.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.819+0000 7f82859e2640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82800d0090 con 0x7f828006bf10 2024-04-25T10:04:41.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.819+0000 7f8277fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8280099f30 0x7f82800c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:41.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.819+0000 7f8277fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8280099f30 0x7f82800c55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58092/0 (socket says 172.21.15.7:58092) 2024-04-25T10:04:41.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.819+0000 7f8277fff640 1 -- 172.21.15.7:0/2529797115 learned_addr learned my addr 172.21.15.7:0/2529797115 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:41.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.819+0000 7f827effd640 1 --2- 172.21.15.7:0/2529797115 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f828006bf10 0x7f82800b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:41.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.819+0000 7f827f7fe640 1 --2- 172.21.15.7:0/2529797115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82800cda20 0x7f8280150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:41.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.819+0000 7f8277fff640 1 -- 172.21.15.7:0/2529797115 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f828006bf10 msgr2=0x7f82800b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:41.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.819+0000 7f8277fff640 1 --2- 172.21.15.7:0/2529797115 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f828006bf10 0x7f82800b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.819+0000 7f8277fff640 1 -- 172.21.15.7:0/2529797115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82800cda20 msgr2=0x7f8280150ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:41.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.819+0000 7f8277fff640 1 --2- 172.21.15.7:0/2529797115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82800cda20 0x7f8280150ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.819+0000 7f8277fff640 1 -- 172.21.15.7:0/2529797115 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8280150ff0 con 0x7f8280099f30 2024-04-25T10:04:41.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.820+0000 7f8277fff640 1 --2- 172.21.15.7:0/2529797115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8280099f30 0x7f82800c55c0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f8268035040 tx=0x7f82680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:41.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.820+0000 7f827cff9640 1 -- 172.21.15.7:0/2529797115 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8268041020 con 0x7f8280099f30 2024-04-25T10:04:41.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.820+0000 7f827cff9640 1 -- 172.21.15.7:0/2529797115 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8268030700 con 0x7f8280099f30 2024-04-25T10:04:41.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.820+0000 7f82859e2640 1 -- 172.21.15.7:0/2529797115 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82800b48d0 con 0x7f8280099f30 2024-04-25T10:04:41.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.820+0000 7f827cff9640 1 -- 172.21.15.7:0/2529797115 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8268037040 con 0x7f8280099f30 2024-04-25T10:04:41.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.820+0000 7f82859e2640 1 -- 172.21.15.7:0/2529797115 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82800b4e90 con 0x7f8280099f30 2024-04-25T10:04:41.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.821+0000 7f82859e2640 1 -- 172.21.15.7:0/2529797115 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8280068f60 con 0x7f8280099f30 2024-04-25T10:04:41.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.821+0000 7f827cff9640 1 -- 172.21.15.7:0/2529797115 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8268044020 con 0x7f8280099f30 2024-04-25T10:04:41.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.822+0000 7f827cff9640 1 --2- 172.21.15.7:0/2529797115 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f826006b4d0 0x7f826006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:41.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.822+0000 7f827cff9640 1 -- 172.21.15.7:0/2529797115 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f82680aab70 con 0x7f8280099f30 2024-04-25T10:04:41.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.822+0000 7f827effd640 1 --2- 172.21.15.7:0/2529797115 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f826006b4d0 0x7f826006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:41.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.822+0000 7f827effd640 1 --2- 172.21.15.7:0/2529797115 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f826006b4d0 0x7f826006d990 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f8270009ad0 tx=0x7f8270008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:41.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:41.826+0000 7f827cff9640 1 -- 172.21.15.7:0/2529797115 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f826804b030 con 0x7f8280099f30 2024-04-25T10:04:42.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.008+0000 7f82859e2640 1 -- 172.21.15.7:0/2529797115 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82801623f0 con 0x7f8280099f30 2024-04-25T10:04:42.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.008+0000 7f827cff9640 1 -- 172.21.15.7:0/2529797115 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v117) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8280150ff0 con 0x7f8280099f30 2024-04-25T10:04:42.014 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T10:04:42.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.010+0000 7f82859e2640 1 -- 172.21.15.7:0/2529797115 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f826006b4d0 msgr2=0x7f826006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.010+0000 7f82859e2640 1 --2- 172.21.15.7:0/2529797115 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f826006b4d0 0x7f826006d990 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f8270009ad0 tx=0x7f8270008040 comp rx=0 tx=0).stop 2024-04-25T10:04:42.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.010+0000 7f82859e2640 1 -- 172.21.15.7:0/2529797115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8280099f30 msgr2=0x7f82800c55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.010+0000 7f82859e2640 1 --2- 172.21.15.7:0/2529797115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8280099f30 0x7f82800c55c0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f8268035040 tx=0x7f82680046c0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.010+0000 7f82859e2640 1 -- 172.21.15.7:0/2529797115 shutdown_connections 2024-04-25T10:04:42.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.010+0000 7f82859e2640 1 --2- 172.21.15.7:0/2529797115 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f826006b4d0 0x7f826006d990 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.010+0000 7f82859e2640 1 --2- 172.21.15.7:0/2529797115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82800cda20 0x7f8280150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.010+0000 7f82859e2640 1 --2- 172.21.15.7:0/2529797115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8280099f30 0x7f82800c55c0 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.010+0000 7f82859e2640 1 --2- 172.21.15.7:0/2529797115 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f828006bf10 0x7f82800b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.010+0000 7f82859e2640 1 -- 172.21.15.7:0/2529797115 >> 172.21.15.7:0/2529797115 conn(0x7f82800b3110 msgr2=0x7f8280160aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:42.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.010+0000 7f82859e2640 1 -- 172.21.15.7:0/2529797115 shutdown_connections 2024-04-25T10:04:42.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.010+0000 7f82859e2640 1 -- 172.21.15.7:0/2529797115 wait complete. 2024-04-25T10:04:42.027 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:04:42.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.124+0000 7fb5fe46f640 1 Processor -- start 2024-04-25T10:04:42.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.124+0000 7fb5fe46f640 1 -- start start 2024-04-25T10:04:42.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.125+0000 7fb5fe46f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5f80d3760 0x7fb5f815eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.125+0000 7fb5fe46f640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f80ced10 con 0x7fb5f80ce830 2024-04-25T10:04:42.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.125+0000 7fb5fe46f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f80d1b40 con 0x7fb5f815f1c0 2024-04-25T10:04:42.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.125+0000 7fb5fe46f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f80ce380 con 0x7fb5f80d3760 2024-04-25T10:04:42.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.125+0000 7fb5fca0c640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb5f80ce830 0x7fb5f80b2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39344/0 (socket says 172.21.15.7:39344) 2024-04-25T10:04:42.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.125+0000 7fb5fca0c640 1 -- 172.21.15.7:0/2336555010 learned_addr learned my addr 172.21.15.7:0/2336555010 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:42.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.126+0000 7fb5f7fff640 1 --2- 172.21.15.7:0/2336555010 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5f80d3760 0x7fb5f815eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.126+0000 7fb5f6ffd640 1 -- 172.21.15.7:0/2336555010 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980247664 0 0) 0x7fb5f80ced10 con 0x7fb5f80ce830 2024-04-25T10:04:42.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.126+0000 7fb5f6ffd640 1 -- 172.21.15.7:0/2336555010 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5e4003520 con 0x7fb5f80ce830 2024-04-25T10:04:42.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.126+0000 7fb5f6ffd640 1 -- 172.21.15.7:0/2336555010 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3360689229 0 0) 0x7fb5e4003520 con 0x7fb5f80ce830 2024-04-25T10:04:42.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.126+0000 7fb5f6ffd640 1 -- 172.21.15.7:0/2336555010 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5f80d3760 msgr2=0x7fb5f815eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:42.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.126+0000 7fb5f6ffd640 1 --2- 172.21.15.7:0/2336555010 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5f80d3760 0x7fb5f815eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.126+0000 7fb5f6ffd640 1 -- 172.21.15.7:0/2336555010 >> v1:172.21.15.55:6789/0 conn(0x7fb5f815f1c0 legacy=0x7fb5f80d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.126+0000 7fb5f6ffd640 1 -- 172.21.15.7:0/2336555010 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f80d1e20 con 0x7fb5f80ce830 2024-04-25T10:04:42.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.126+0000 7fb5f6ffd640 1 -- 172.21.15.7:0/2336555010 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fb5f00019f0 con 0x7fb5f80ce830 2024-04-25T10:04:42.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.126+0000 7fb5f6ffd640 1 -- 172.21.15.7:0/2336555010 >> v1:172.21.15.7:6789/0 conn(0x7fb5f80ce830 legacy=0x7fb5f80b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.126+0000 7fb5f6ffd640 1 --2- 172.21.15.7:0/2336555010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5e40039e0 0x7fb5e4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.126+0000 7fb5f6ffd640 1 --2- 172.21.15.7:0/2336555010 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5e4004390 0x7fb5e4004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.126+0000 7fb5f6ffd640 1 --2- 172.21.15.7:0/2336555010 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5f80d3760 0x7fb5e40050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.126+0000 7fb5f6ffd640 1 -- 172.21.15.7:0/2336555010 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e400b9c0 con 0x7fb5e40039e0 2024-04-25T10:04:42.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.126+0000 7fb5f6ffd640 1 -- 172.21.15.7:0/2336555010 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e400bb40 con 0x7fb5e4004390 2024-04-25T10:04:42.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.126+0000 7fb5f6ffd640 1 -- 172.21.15.7:0/2336555010 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e400bd40 con 0x7fb5f80d3760 2024-04-25T10:04:42.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.126+0000 7fb5f7fff640 1 --2- 172.21.15.7:0/2336555010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5e40039e0 0x7fb5e4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.126+0000 7fb5f77fe640 1 --2- 172.21.15.7:0/2336555010 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5e4004390 0x7fb5e4004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.126+0000 7fb5fca0c640 1 --2- 172.21.15.7:0/2336555010 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5f80d3760 0x7fb5e40050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.127+0000 7fb5f7fff640 1 -- 172.21.15.7:0/2336555010 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5f80d3760 msgr2=0x7fb5e40050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:42.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.127+0000 7fb5f7fff640 1 --2- 172.21.15.7:0/2336555010 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5f80d3760 0x7fb5e40050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.127+0000 7fb5f7fff640 1 -- 172.21.15.7:0/2336555010 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5e4004390 msgr2=0x7fb5e4004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:42.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.127+0000 7fb5f7fff640 1 --2- 172.21.15.7:0/2336555010 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5e4004390 0x7fb5e4004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.127+0000 7fb5f7fff640 1 -- 172.21.15.7:0/2336555010 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e4003520 con 0x7fb5e40039e0 2024-04-25T10:04:42.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.127+0000 7fb5f77fe640 1 --2- 172.21.15.7:0/2336555010 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5e4004390 0x7fb5e4004860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:42.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.127+0000 7fb5f7fff640 1 --2- 172.21.15.7:0/2336555010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5e40039e0 0x7fb5e4003dc0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0009ac0 tx=0x7fb5e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a707ab8d35091a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:42.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.127+0000 7fb5f6ffd640 1 -- 172.21.15.7:0/2336555010 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0036070 con 0x7fb5e40039e0 2024-04-25T10:04:42.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.127+0000 7fb5f6ffd640 1 -- 172.21.15.7:0/2336555010 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e0031400 con 0x7fb5e40039e0 2024-04-25T10:04:42.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.127+0000 7fb5f6ffd640 1 -- 172.21.15.7:0/2336555010 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0009690 con 0x7fb5e40039e0 2024-04-25T10:04:42.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.128+0000 7fb5fe46f640 1 -- 172.21.15.7:0/2336555010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5e40039e0 msgr2=0x7fb5e4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.128+0000 7fb5fe46f640 1 --2- 172.21.15.7:0/2336555010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5e40039e0 0x7fb5e4003dc0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0009ac0 tx=0x7fb5e4005830 comp rx=0 tx=0).stop 2024-04-25T10:04:42.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.128+0000 7fb5fca0c640 1 -- 172.21.15.7:0/2336555010 reap_dead start 2024-04-25T10:04:42.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.128+0000 7fb5fe46f640 1 -- 172.21.15.7:0/2336555010 shutdown_connections 2024-04-25T10:04:42.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.128+0000 7fb5fe46f640 1 -- 172.21.15.7:0/2336555010 >> 172.21.15.7:0/2336555010 conn(0x7fb5f8072680 msgr2=0x7fb5f8072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:42.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.128+0000 7fb5fe46f640 1 -- 172.21.15.7:0/2336555010 shutdown_connections 2024-04-25T10:04:42.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.128+0000 7fb5fe46f640 1 -- 172.21.15.7:0/2336555010 wait complete. 2024-04-25T10:04:42.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.129+0000 7fb5fe46f640 1 Processor -- start 2024-04-25T10:04:42.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.129+0000 7fb5fe46f640 1 -- start start 2024-04-25T10:04:42.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.130+0000 7fb5fe46f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5e40039e0 0x7fb5f80aabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.130+0000 7fb5fe46f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5f80ccf80 0x7fb5f80b87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.130+0000 7fb5fe46f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5f8150b40 0x7fb5f8150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.130+0000 7fb5fe46f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f815eac0 con 0x7fb5e40039e0 2024-04-25T10:04:42.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.130+0000 7fb5fe46f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f80d2190 con 0x7fb5f80ccf80 2024-04-25T10:04:42.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.130+0000 7fb5fe46f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f815ec40 con 0x7fb5f8150b40 2024-04-25T10:04:42.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.130+0000 7fb5f7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5e40039e0 0x7fb5f80aabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.130+0000 7fb5f7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5e40039e0 0x7fb5f80aabd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58114/0 (socket says 172.21.15.7:58114) 2024-04-25T10:04:42.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.130+0000 7fb5f7fff640 1 -- 172.21.15.7:0/3963847966 learned_addr learned my addr 172.21.15.7:0/3963847966 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:42.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.130+0000 7fb5fca0c640 1 --2- 172.21.15.7:0/3963847966 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5f8150b40 0x7fb5f8150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.130+0000 7fb5f77fe640 1 --2- 172.21.15.7:0/3963847966 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5f80ccf80 0x7fb5f80b87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.130+0000 7fb5f7fff640 1 -- 172.21.15.7:0/3963847966 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5f8150b40 msgr2=0x7fb5f8150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.130+0000 7fb5f7fff640 1 --2- 172.21.15.7:0/3963847966 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5f8150b40 0x7fb5f8150fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.130+0000 7fb5f7fff640 1 -- 172.21.15.7:0/3963847966 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5f80ccf80 msgr2=0x7fb5f80b87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.130+0000 7fb5f7fff640 1 --2- 172.21.15.7:0/3963847966 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5f80ccf80 0x7fb5f80b87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.131+0000 7fb5f7fff640 1 -- 172.21.15.7:0/3963847966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f80ab4d0 con 0x7fb5e40039e0 2024-04-25T10:04:42.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.131+0000 7fb5f77fe640 1 --2- 172.21.15.7:0/3963847966 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5f80ccf80 0x7fb5f80b87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:42.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.131+0000 7fb5f7fff640 1 --2- 172.21.15.7:0/3963847966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5e40039e0 0x7fb5f80aabd0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0009be0 tx=0x7fb5e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:42.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.131+0000 7fb5f4ff9640 1 -- 172.21.15.7:0/3963847966 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0040020 con 0x7fb5e40039e0 2024-04-25T10:04:42.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.131+0000 7fb5f4ff9640 1 -- 172.21.15.7:0/3963847966 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e0003bc0 con 0x7fb5e40039e0 2024-04-25T10:04:42.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.131+0000 7fb5f4ff9640 1 -- 172.21.15.7:0/3963847966 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0036040 con 0x7fb5e40039e0 2024-04-25T10:04:42.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.131+0000 7fb5fe46f640 1 -- 172.21.15.7:0/3963847966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f80ab7b0 con 0x7fb5e40039e0 2024-04-25T10:04:42.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.131+0000 7fb5fe46f640 1 -- 172.21.15.7:0/3963847966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f80abd70 con 0x7fb5e40039e0 2024-04-25T10:04:42.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.132+0000 7fb5fe46f640 1 -- 172.21.15.7:0/3963847966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f8068f60 con 0x7fb5e40039e0 2024-04-25T10:04:42.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.132+0000 7fb5f4ff9640 1 -- 172.21.15.7:0/3963847966 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb5e0043020 con 0x7fb5e40039e0 2024-04-25T10:04:42.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.133+0000 7fb5f4ff9640 1 --2- 172.21.15.7:0/3963847966 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb5d806b500 0x7fb5d806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.133+0000 7fb5f4ff9640 1 -- 172.21.15.7:0/3963847966 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb5e00aa460 con 0x7fb5e40039e0 2024-04-25T10:04:42.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.133+0000 7fb5f77fe640 1 --2- 172.21.15.7:0/3963847966 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb5d806b500 0x7fb5d806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.133+0000 7fb5f77fe640 1 --2- 172.21.15.7:0/3963847966 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb5d806b500 0x7fb5d806d9c0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8159fb0 tx=0x7fb5e8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:42.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.137+0000 7fb5f4ff9640 1 -- 172.21.15.7:0/3963847966 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb5e004a070 con 0x7fb5e40039e0 2024-04-25T10:04:42.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.316+0000 7fb5fe46f640 1 -- 172.21.15.7:0/3963847966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb5f8067c10 con 0x7fb5e40039e0 2024-04-25T10:04:42.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.316+0000 7fb5f4ff9640 1 -- 172.21.15.7:0/3963847966 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v117) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb5e00044e0 con 0x7fb5e40039e0 2024-04-25T10:04:42.322 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T10:04:42.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.318+0000 7fb5fe46f640 1 -- 172.21.15.7:0/3963847966 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb5d806b500 msgr2=0x7fb5d806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.318+0000 7fb5fe46f640 1 --2- 172.21.15.7:0/3963847966 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb5d806b500 0x7fb5d806d9c0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8159fb0 tx=0x7fb5e8009040 comp rx=0 tx=0).stop 2024-04-25T10:04:42.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.318+0000 7fb5fe46f640 1 -- 172.21.15.7:0/3963847966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5e40039e0 msgr2=0x7fb5f80aabd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.318+0000 7fb5fe46f640 1 --2- 172.21.15.7:0/3963847966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5e40039e0 0x7fb5f80aabd0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0009be0 tx=0x7fb5e0004730 comp rx=0 tx=0).stop 2024-04-25T10:04:42.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.318+0000 7fb5fe46f640 1 -- 172.21.15.7:0/3963847966 shutdown_connections 2024-04-25T10:04:42.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.318+0000 7fb5fe46f640 1 --2- 172.21.15.7:0/3963847966 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb5d806b500 0x7fb5d806d9c0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.318+0000 7fb5fe46f640 1 --2- 172.21.15.7:0/3963847966 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb5f8150b40 0x7fb5f8150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.318+0000 7fb5fe46f640 1 --2- 172.21.15.7:0/3963847966 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5f80ccf80 0x7fb5f80b87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.318+0000 7fb5fe46f640 1 --2- 172.21.15.7:0/3963847966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5e40039e0 0x7fb5f80aabd0 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.318+0000 7fb5fe46f640 1 -- 172.21.15.7:0/3963847966 >> 172.21.15.7:0/3963847966 conn(0x7fb5f8072680 msgr2=0x7fb5f815d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:42.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.318+0000 7fb5fe46f640 1 -- 172.21.15.7:0/3963847966 shutdown_connections 2024-04-25T10:04:42.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.318+0000 7fb5fe46f640 1 -- 172.21.15.7:0/3963847966 wait complete. 2024-04-25T10:04:42.334 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:04:42.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.432+0000 7f07dbc38640 1 Processor -- start 2024-04-25T10:04:42.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.432+0000 7f07dbc38640 1 -- start start 2024-04-25T10:04:42.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.433+0000 7f07dbc38640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07d415dc60 0x7f07d40cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.433+0000 7f07dbc38640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f07d40cc760 0x7f07d406ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.433+0000 7f07dbc38640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f07d40ce150 0x7f07d406b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.433+0000 7f07dbc38640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d40caf00 con 0x7f07d40cc760 2024-04-25T10:04:42.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.433+0000 7f07dbc38640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d40cb1e0 con 0x7f07d40ce150 2024-04-25T10:04:42.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.433+0000 7f07dbc38640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d40cb4c0 con 0x7f07d415dc60 2024-04-25T10:04:42.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.433+0000 7f07d91d3640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f07d40cc760 0x7f07d406ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.433+0000 7f07d91d3640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f07d40cc760 0x7f07d406ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58126/0 (socket says 172.21.15.7:58126) 2024-04-25T10:04:42.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.433+0000 7f07d91d3640 1 -- 172.21.15.7:0/3797927803 learned_addr learned my addr 172.21.15.7:0/3797927803 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:42.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.434+0000 7f07d99d4640 1 --2- 172.21.15.7:0/3797927803 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07d415dc60 0x7f07d40cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.434+0000 7f07da1d5640 1 --2- 172.21.15.7:0/3797927803 >> v2:172.21.15.55:3300/0 conn(0x7f07d40ce150 0x7f07d406b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.434+0000 7f07d91d3640 1 -- 172.21.15.7:0/3797927803 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07d415dc60 msgr2=0x7f07d40cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:42.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.434+0000 7f07d91d3640 1 --2- 172.21.15.7:0/3797927803 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07d415dc60 0x7f07d40cbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.434+0000 7f07d91d3640 1 -- 172.21.15.7:0/3797927803 >> v2:172.21.15.55:3300/0 conn(0x7f07d40ce150 msgr2=0x7f07d406b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:42.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.434+0000 7f07d91d3640 1 --2- 172.21.15.7:0/3797927803 >> v2:172.21.15.55:3300/0 conn(0x7f07d40ce150 0x7f07d406b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.434+0000 7f07d91d3640 1 -- 172.21.15.7:0/3797927803 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d40cb7a0 con 0x7f07d40cc760 2024-04-25T10:04:42.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.434+0000 7f07da1d5640 1 --2- 172.21.15.7:0/3797927803 >> v2:172.21.15.55:3300/0 conn(0x7f07d40ce150 0x7f07d406b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:42.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.434+0000 7f07d91d3640 1 --2- 172.21.15.7:0/3797927803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07d40cc760 0x7f07d406ab60 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f07d406b840 tx=0x7f07c802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cbdd085d0942e0d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:42.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.435+0000 7f07d89d2640 1 -- 172.21.15.7:0/3797927803 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c8037070 con 0x7f07d40cc760 2024-04-25T10:04:42.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.435+0000 7f07d89d2640 1 -- 172.21.15.7:0/3797927803 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c8032440 con 0x7f07d40cc760 2024-04-25T10:04:42.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.435+0000 7f07d89d2640 1 -- 172.21.15.7:0/3797927803 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c8032810 con 0x7f07d40cc760 2024-04-25T10:04:42.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.435+0000 7f07dbc38640 1 -- 172.21.15.7:0/3797927803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07d40cc760 msgr2=0x7f07d406ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.435+0000 7f07dbc38640 1 --2- 172.21.15.7:0/3797927803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07d40cc760 0x7f07d406ab60 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f07d406b840 tx=0x7f07c802a1e0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.435+0000 7f07dbc38640 1 -- 172.21.15.7:0/3797927803 shutdown_connections 2024-04-25T10:04:42.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.435+0000 7f07dbc38640 1 --2- 172.21.15.7:0/3797927803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07d40cc760 0x7f07d406ab60 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.435+0000 7f07dbc38640 1 --2- 172.21.15.7:0/3797927803 >> v2:172.21.15.55:3300/0 conn(0x7f07d40ce150 0x7f07d406b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.435+0000 7f07dbc38640 1 --2- 172.21.15.7:0/3797927803 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07d415dc60 0x7f07d40cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.435+0000 7f07dbc38640 1 -- 172.21.15.7:0/3797927803 >> 172.21.15.7:0/3797927803 conn(0x7f07d40725e0 msgr2=0x7f07d40999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:42.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.435+0000 7f07dbc38640 1 -- 172.21.15.7:0/3797927803 shutdown_connections 2024-04-25T10:04:42.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.435+0000 7f07dbc38640 1 -- 172.21.15.7:0/3797927803 wait complete. 2024-04-25T10:04:42.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.436+0000 7f07dbc38640 1 Processor -- start 2024-04-25T10:04:42.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.437+0000 7f07dbc38640 1 -- start start 2024-04-25T10:04:42.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.437+0000 7f07dbc38640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07d40cc760 0x7f07d4148850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.437+0000 7f07dbc38640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07d40ce150 0x7f07d4157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.437+0000 7f07dbc38640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07d415dc60 0x7f07d4158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.437+0000 7f07dbc38640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d4161650 con 0x7f07d415dc60 2024-04-25T10:04:42.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.437+0000 7f07dbc38640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d40cabd0 con 0x7f07d40ce150 2024-04-25T10:04:42.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.437+0000 7f07dbc38640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d41617d0 con 0x7f07d40cc760 2024-04-25T10:04:42.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.437+0000 7f07da1d5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07d415dc60 0x7f07d4158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.437+0000 7f07da1d5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07d415dc60 0x7f07d4158050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58136/0 (socket says 172.21.15.7:58136) 2024-04-25T10:04:42.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.437+0000 7f07da1d5640 1 -- 172.21.15.7:0/4182506022 learned_addr learned my addr 172.21.15.7:0/4182506022 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:42.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.437+0000 7f07d91d3640 1 --2- 172.21.15.7:0/4182506022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07d40ce150 0x7f07d4157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.437+0000 7f07d99d4640 1 --2- 172.21.15.7:0/4182506022 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07d40cc760 0x7f07d4148850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.438+0000 7f07da1d5640 1 -- 172.21.15.7:0/4182506022 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07d40cc760 msgr2=0x7f07d4148850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.438+0000 7f07da1d5640 1 --2- 172.21.15.7:0/4182506022 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07d40cc760 0x7f07d4148850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.438+0000 7f07da1d5640 1 -- 172.21.15.7:0/4182506022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07d40ce150 msgr2=0x7f07d4157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.438+0000 7f07da1d5640 1 --2- 172.21.15.7:0/4182506022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07d40ce150 0x7f07d4157b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.438+0000 7f07da1d5640 1 -- 172.21.15.7:0/4182506022 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d40c66c0 con 0x7f07d415dc60 2024-04-25T10:04:42.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.438+0000 7f07da1d5640 1 --2- 172.21.15.7:0/4182506022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07d415dc60 0x7f07d4158050 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f07c400cef0 tx=0x7f07c400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:42.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.438+0000 7f07d27fc640 1 -- 172.21.15.7:0/4182506022 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c401a070 con 0x7f07d415dc60 2024-04-25T10:04:42.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.438+0000 7f07d27fc640 1 -- 172.21.15.7:0/4182506022 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c400d840 con 0x7f07d415dc60 2024-04-25T10:04:42.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.438+0000 7f07dbc38640 1 -- 172.21.15.7:0/4182506022 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d40c69a0 con 0x7f07d415dc60 2024-04-25T10:04:42.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.438+0000 7f07d27fc640 1 -- 172.21.15.7:0/4182506022 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c400dc30 con 0x7f07d415dc60 2024-04-25T10:04:42.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.438+0000 7f07dbc38640 1 -- 172.21.15.7:0/4182506022 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07d40b3340 con 0x7f07d415dc60 2024-04-25T10:04:42.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.439+0000 7f07dbc38640 1 -- 172.21.15.7:0/4182506022 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07d40c6ec0 con 0x7f07d415dc60 2024-04-25T10:04:42.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.440+0000 7f07d27fc640 1 -- 172.21.15.7:0/4182506022 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f07c401d070 con 0x7f07d415dc60 2024-04-25T10:04:42.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.440+0000 7f07d27fc640 1 --2- 172.21.15.7:0/4182506022 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f07c006b4d0 0x7f07c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.440+0000 7f07d27fc640 1 -- 172.21.15.7:0/4182506022 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f07c408ab90 con 0x7f07d415dc60 2024-04-25T10:04:42.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.440+0000 7f07d99d4640 1 --2- 172.21.15.7:0/4182506022 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f07c006b4d0 0x7f07c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.441+0000 7f07d99d4640 1 --2- 172.21.15.7:0/4182506022 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f07c006b4d0 0x7f07c006d990 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f07d40ca170 tx=0x7f07cc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:42.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.444+0000 7f07d27fc640 1 -- 172.21.15.7:0/4182506022 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f07d40c6ec0 con 0x7f07d415dc60 2024-04-25T10:04:42.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.624+0000 7f07dbc38640 1 -- 172.21.15.7:0/4182506022 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f07d4068f60 con 0x7f07d415dc60 2024-04-25T10:04:42.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.625+0000 7f07d27fc640 1 -- 172.21.15.7:0/4182506022 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v117) v1 ==== 100+0+11 (secure 0 0 0) 0x7f07c4059210 con 0x7f07d415dc60 2024-04-25T10:04:42.630 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T10:04:42.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.626+0000 7f07dbc38640 1 -- 172.21.15.7:0/4182506022 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f07c006b4d0 msgr2=0x7f07c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.626+0000 7f07dbc38640 1 --2- 172.21.15.7:0/4182506022 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f07c006b4d0 0x7f07c006d990 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f07d40ca170 tx=0x7f07cc008040 comp rx=0 tx=0).stop 2024-04-25T10:04:42.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.626+0000 7f07dbc38640 1 -- 172.21.15.7:0/4182506022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07d415dc60 msgr2=0x7f07d4158050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.626+0000 7f07dbc38640 1 --2- 172.21.15.7:0/4182506022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07d415dc60 0x7f07d4158050 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f07c400cef0 tx=0x7f07c400a710 comp rx=0 tx=0).stop 2024-04-25T10:04:42.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.627+0000 7f07dbc38640 1 -- 172.21.15.7:0/4182506022 shutdown_connections 2024-04-25T10:04:42.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.627+0000 7f07dbc38640 1 --2- 172.21.15.7:0/4182506022 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f07c006b4d0 0x7f07c006d990 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.627+0000 7f07dbc38640 1 --2- 172.21.15.7:0/4182506022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07d415dc60 0x7f07d4158050 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.627+0000 7f07dbc38640 1 --2- 172.21.15.7:0/4182506022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07d40ce150 0x7f07d4157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.627+0000 7f07dbc38640 1 --2- 172.21.15.7:0/4182506022 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f07d40cc760 0x7f07d4148850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.627+0000 7f07dbc38640 1 -- 172.21.15.7:0/4182506022 >> 172.21.15.7:0/4182506022 conn(0x7f07d40725e0 msgr2=0x7f07d406ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:42.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.627+0000 7f07dbc38640 1 -- 172.21.15.7:0/4182506022 shutdown_connections 2024-04-25T10:04:42.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.627+0000 7f07dbc38640 1 -- 172.21.15.7:0/4182506022 wait complete. 2024-04-25T10:04:42.643 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:04:42.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.739+0000 7f5d674fc640 1 Processor -- start 2024-04-25T10:04:42.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.740+0000 7f5d674fc640 1 -- start start 2024-04-25T10:04:42.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.740+0000 7f5d674fc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5d6015b8c0 0x7f5d6009a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.740+0000 7f5d674fc640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5d6015bca0 0x7f5d600cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.740+0000 7f5d674fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5d600cf280 0x7f5d600cfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.740+0000 7f5d674fc640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d6009ac50 con 0x7f5d6015bca0 2024-04-25T10:04:42.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.740+0000 7f5d674fc640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d6009af30 con 0x7f5d600cf280 2024-04-25T10:04:42.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.740+0000 7f5d674fc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d600b0bb0 con 0x7f5d6015b8c0 2024-04-25T10:04:42.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.740+0000 7f5d64a97640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5d6015bca0 0x7f5d600cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.741+0000 7f5d64a97640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5d6015bca0 0x7f5d600cf940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58140/0 (socket says 172.21.15.7:58140) 2024-04-25T10:04:42.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.741+0000 7f5d64a97640 1 -- 172.21.15.7:0/3120665450 learned_addr learned my addr 172.21.15.7:0/3120665450 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:42.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.741+0000 7f5d65298640 1 --2- 172.21.15.7:0/3120665450 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5d6015b8c0 0x7f5d6009a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.741+0000 7f5d65a99640 1 --2- 172.21.15.7:0/3120665450 >> v2:172.21.15.55:3300/0 conn(0x7f5d600cf280 0x7f5d600cfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.741+0000 7f5d64a97640 1 -- 172.21.15.7:0/3120665450 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5d6015b8c0 msgr2=0x7f5d6009a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:42.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.741+0000 7f5d64a97640 1 --2- 172.21.15.7:0/3120665450 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5d6015b8c0 0x7f5d6009a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.741+0000 7f5d64a97640 1 -- 172.21.15.7:0/3120665450 >> v2:172.21.15.55:3300/0 conn(0x7f5d600cf280 msgr2=0x7f5d600cfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:42.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.741+0000 7f5d64a97640 1 --2- 172.21.15.7:0/3120665450 >> v2:172.21.15.55:3300/0 conn(0x7f5d600cf280 0x7f5d600cfe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.741+0000 7f5d64a97640 1 -- 172.21.15.7:0/3120665450 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d600b0e90 con 0x7f5d6015bca0 2024-04-25T10:04:42.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.742+0000 7f5d64a97640 1 --2- 172.21.15.7:0/3120665450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d6015bca0 0x7f5d600cf940 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f5d6006ec40 tx=0x7f5d5002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d700a8eb7cb0d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:42.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.742+0000 7f5d57fff640 1 -- 172.21.15.7:0/3120665450 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d50037070 con 0x7f5d6015bca0 2024-04-25T10:04:42.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.742+0000 7f5d57fff640 1 -- 172.21.15.7:0/3120665450 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d50032440 con 0x7f5d6015bca0 2024-04-25T10:04:42.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.742+0000 7f5d57fff640 1 -- 172.21.15.7:0/3120665450 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d50032810 con 0x7f5d6015bca0 2024-04-25T10:04:42.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.742+0000 7f5d674fc640 1 -- 172.21.15.7:0/3120665450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d6015bca0 msgr2=0x7f5d600cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.742+0000 7f5d674fc640 1 --2- 172.21.15.7:0/3120665450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d6015bca0 0x7f5d600cf940 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f5d6006ec40 tx=0x7f5d5002a1e0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.742+0000 7f5d674fc640 1 -- 172.21.15.7:0/3120665450 shutdown_connections 2024-04-25T10:04:42.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.742+0000 7f5d674fc640 1 --2- 172.21.15.7:0/3120665450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d6015bca0 0x7f5d600cf940 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.742+0000 7f5d674fc640 1 --2- 172.21.15.7:0/3120665450 >> v2:172.21.15.55:3300/0 conn(0x7f5d600cf280 0x7f5d600cfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.742+0000 7f5d674fc640 1 --2- 172.21.15.7:0/3120665450 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5d6015b8c0 0x7f5d6009a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.742+0000 7f5d674fc640 1 -- 172.21.15.7:0/3120665450 >> 172.21.15.7:0/3120665450 conn(0x7f5d600b31a0 msgr2=0x7f5d600b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:42.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.742+0000 7f5d674fc640 1 -- 172.21.15.7:0/3120665450 shutdown_connections 2024-04-25T10:04:42.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.742+0000 7f5d674fc640 1 -- 172.21.15.7:0/3120665450 wait complete. 2024-04-25T10:04:42.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.744+0000 7f5d674fc640 1 Processor -- start 2024-04-25T10:04:42.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.744+0000 7f5d674fc640 1 -- start start 2024-04-25T10:04:42.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.744+0000 7f5d674fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d600cf280 0x7f5d600cb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.744+0000 7f5d674fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d6015b8c0 0x7f5d60152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.744+0000 7f5d674fc640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5d6015bca0 0x7f5d600b6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.744+0000 7f5d674fc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d600cc150 con 0x7f5d6015b8c0 2024-04-25T10:04:42.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.744+0000 7f5d674fc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6009a940 con 0x7f5d600cf280 2024-04-25T10:04:42.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.744+0000 7f5d674fc640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d600cc2d0 con 0x7f5d6015bca0 2024-04-25T10:04:42.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.745+0000 7f5d64a97640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d6015b8c0 0x7f5d60152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.745+0000 7f5d64a97640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d6015b8c0 0x7f5d60152c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58156/0 (socket says 172.21.15.7:58156) 2024-04-25T10:04:42.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.745+0000 7f5d64a97640 1 -- 172.21.15.7:0/1487337166 learned_addr learned my addr 172.21.15.7:0/1487337166 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:42.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.745+0000 7f5d64a97640 1 -- 172.21.15.7:0/1487337166 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5d6015bca0 msgr2=0x7f5d600b6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.745+0000 7f5d65298640 1 --2- 172.21.15.7:0/1487337166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d600cf280 0x7f5d600cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.745+0000 7f5d65a99640 1 --2- 172.21.15.7:0/1487337166 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5d6015bca0 0x7f5d600b6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.745+0000 7f5d64a97640 1 --2- 172.21.15.7:0/1487337166 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5d6015bca0 0x7f5d600b6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.745+0000 7f5d64a97640 1 -- 172.21.15.7:0/1487337166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d600cf280 msgr2=0x7f5d600cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.745+0000 7f5d64a97640 1 --2- 172.21.15.7:0/1487337166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d600cf280 0x7f5d600cb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.745+0000 7f5d64a97640 1 -- 172.21.15.7:0/1487337166 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d601531a0 con 0x7f5d6015b8c0 2024-04-25T10:04:42.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.745+0000 7f5d65a99640 1 --2- 172.21.15.7:0/1487337166 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5d6015bca0 0x7f5d600b6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:42.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.745+0000 7f5d65298640 1 --2- 172.21.15.7:0/1487337166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d600cf280 0x7f5d600cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:42.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.745+0000 7f5d64a97640 1 --2- 172.21.15.7:0/1487337166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d6015b8c0 0x7f5d60152c60 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f5d5002a220 tx=0x7f5d500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:42.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.745+0000 7f5d55ffb640 1 -- 172.21.15.7:0/1487337166 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d50041020 con 0x7f5d6015b8c0 2024-04-25T10:04:42.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.745+0000 7f5d55ffb640 1 -- 172.21.15.7:0/1487337166 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5003d620 con 0x7f5d6015b8c0 2024-04-25T10:04:42.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.745+0000 7f5d674fc640 1 -- 172.21.15.7:0/1487337166 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d600ca570 con 0x7f5d6015b8c0 2024-04-25T10:04:42.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.745+0000 7f5d55ffb640 1 -- 172.21.15.7:0/1487337166 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d50037040 con 0x7f5d6015b8c0 2024-04-25T10:04:42.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.745+0000 7f5d674fc640 1 -- 172.21.15.7:0/1487337166 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d600cab30 con 0x7f5d6015b8c0 2024-04-25T10:04:42.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.747+0000 7f5d674fc640 1 -- 172.21.15.7:0/1487337166 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d60068fd0 con 0x7f5d6015b8c0 2024-04-25T10:04:42.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.747+0000 7f5d55ffb640 1 -- 172.21.15.7:0/1487337166 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5d50044020 con 0x7f5d6015b8c0 2024-04-25T10:04:42.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.747+0000 7f5d55ffb640 1 --2- 172.21.15.7:0/1487337166 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5d4406b4d0 0x7f5d4406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.747+0000 7f5d55ffb640 1 -- 172.21.15.7:0/1487337166 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5d500aa950 con 0x7f5d6015b8c0 2024-04-25T10:04:42.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.748+0000 7f5d65298640 1 --2- 172.21.15.7:0/1487337166 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5d4406b4d0 0x7f5d4406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.748+0000 7f5d65298640 1 --2- 172.21.15.7:0/1487337166 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5d4406b4d0 0x7f5d4406d990 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c009a40 tx=0x7f5d5c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:42.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.752+0000 7f5d55ffb640 1 -- 172.21.15.7:0/1487337166 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5d5004b030 con 0x7f5d6015b8c0 2024-04-25T10:04:42.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.944+0000 7f5d674fc640 1 -- 172.21.15.7:0/1487337166 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5d60067c40 con 0x7f5d6015b8c0 2024-04-25T10:04:42.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.945+0000 7f5d55ffb640 1 -- 172.21.15.7:0/1487337166 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v117) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5d500796d0 con 0x7f5d6015b8c0 2024-04-25T10:04:42.950 INFO:teuthology.orchestra.run.smithi007.stderr:listed 0 entries 2024-04-25T10:04:42.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.946+0000 7f5d674fc640 1 -- 172.21.15.7:0/1487337166 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5d4406b4d0 msgr2=0x7f5d4406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.946+0000 7f5d674fc640 1 --2- 172.21.15.7:0/1487337166 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5d4406b4d0 0x7f5d4406d990 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c009a40 tx=0x7f5d5c008040 comp rx=0 tx=0).stop 2024-04-25T10:04:42.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.947+0000 7f5d674fc640 1 -- 172.21.15.7:0/1487337166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d6015b8c0 msgr2=0x7f5d60152c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.947+0000 7f5d674fc640 1 --2- 172.21.15.7:0/1487337166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d6015b8c0 0x7f5d60152c60 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f5d5002a220 tx=0x7f5d500046c0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.947+0000 7f5d674fc640 1 -- 172.21.15.7:0/1487337166 shutdown_connections 2024-04-25T10:04:42.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.947+0000 7f5d674fc640 1 --2- 172.21.15.7:0/1487337166 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5d4406b4d0 0x7f5d4406d990 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.947+0000 7f5d674fc640 1 --2- 172.21.15.7:0/1487337166 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5d6015bca0 0x7f5d600b6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.947+0000 7f5d674fc640 1 --2- 172.21.15.7:0/1487337166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d6015b8c0 0x7f5d60152c60 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.947+0000 7f5d674fc640 1 --2- 172.21.15.7:0/1487337166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d600cf280 0x7f5d600cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.947+0000 7f5d674fc640 1 -- 172.21.15.7:0/1487337166 >> 172.21.15.7:0/1487337166 conn(0x7f5d600b31a0 msgr2=0x7f5d600cc6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:42.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.947+0000 7f5d674fc640 1 -- 172.21.15.7:0/1487337166 shutdown_connections 2024-04-25T10:04:42.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:42.947+0000 7f5d674fc640 1 -- 172.21.15.7:0/1487337166 wait complete. 2024-04-25T10:04:42.963 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T10:04:42.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:42.963 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T10:04:43.011 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-04-25T10:04:43.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:43.011 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T10:04:43.040 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T10:04:43.040 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 flush journal 2024-04-25T10:04:43.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.179+0000 7f730805a640 1 Processor -- start 2024-04-25T10:04:43.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.179+0000 7f730805a640 1 -- start start 2024-04-25T10:04:43.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.180+0000 7f730805a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f730015f1c0 0x7f730015eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.180+0000 7f730805a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f73000ce830 0x7f73000b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.180+0000 7f730805a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73000ced10 con 0x7f73000d3760 2024-04-25T10:04:43.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.180+0000 7f730805a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73000ce380 con 0x7f73000ce830 2024-04-25T10:04:43.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.180+0000 7f730805a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f730015f000 con 0x7f730015f1c0 2024-04-25T10:04:43.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.180+0000 7f73065f7640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f73000ce830 0x7f73000b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.180+0000 7f73065f7640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f73000ce830 0x7f73000b2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58162/0 (socket says 172.21.15.7:58162) 2024-04-25T10:04:43.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.180+0000 7f73065f7640 1 -- 172.21.15.7:0/1769636358 learned_addr learned my addr 172.21.15.7:0/1769636358 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:43.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.180+0000 7f7305df6640 1 --1- 172.21.15.7:0/1769636358 >> v1:172.21.15.7:6789/0 conn(0x7f73000d3760 0x7f73000d3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39360/0 (socket says 172.21.15.7:39360) 2024-04-25T10:04:43.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.180+0000 7f73055f5640 1 --2- 172.21.15.7:0/1769636358 >> v2:172.21.15.55:3300/0 conn(0x7f730015f1c0 0x7f730015eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.180+0000 7f73065f7640 1 -- 172.21.15.7:0/1769636358 >> v2:172.21.15.55:3300/0 conn(0x7f730015f1c0 msgr2=0x7f730015eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:43.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.180+0000 7f73065f7640 1 --2- 172.21.15.7:0/1769636358 >> v2:172.21.15.55:3300/0 conn(0x7f730015f1c0 0x7f730015eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.180+0000 7f73065f7640 1 -- 172.21.15.7:0/1769636358 >> v1:172.21.15.7:6789/0 conn(0x7f73000d3760 legacy=0x7f73000d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:43.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.180+0000 7f7304df4640 1 -- 172.21.15.7:0/1769636358 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017068153 0 0) 0x7f73000ced10 con 0x7f73000d3760 2024-04-25T10:04:43.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.180+0000 7f73065f7640 1 -- 172.21.15.7:0/1769636358 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73000d1b40 con 0x7f73000ce830 2024-04-25T10:04:43.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.181+0000 7f73065f7640 1 --2- 172.21.15.7:0/1769636358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73000ce830 0x7f73000b2240 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f73000b9830 tx=0x7f72f802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c61f9cd9743962 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:43.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.181+0000 7f7304df4640 1 -- 172.21.15.7:0/1769636358 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8036070 con 0x7f73000ce830 2024-04-25T10:04:43.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.181+0000 7f7304df4640 1 -- 172.21.15.7:0/1769636358 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f8031600 con 0x7f73000ce830 2024-04-25T10:04:43.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.181+0000 7f7304df4640 1 -- 172.21.15.7:0/1769636358 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f80319d0 con 0x7f73000ce830 2024-04-25T10:04:43.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.182+0000 7f730805a640 1 -- 172.21.15.7:0/1769636358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73000ce830 msgr2=0x7f73000b2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:43.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.182+0000 7f730805a640 1 --2- 172.21.15.7:0/1769636358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73000ce830 0x7f73000b2240 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f73000b9830 tx=0x7f72f802a730 comp rx=0 tx=0).stop 2024-04-25T10:04:43.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.182+0000 7f730805a640 1 -- 172.21.15.7:0/1769636358 shutdown_connections 2024-04-25T10:04:43.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.182+0000 7f730805a640 1 --2- 172.21.15.7:0/1769636358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73000ce830 0x7f73000b2240 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.182+0000 7f730805a640 1 --2- 172.21.15.7:0/1769636358 >> v2:172.21.15.55:3300/0 conn(0x7f730015f1c0 0x7f730015eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.182+0000 7f730805a640 1 -- 172.21.15.7:0/1769636358 >> 172.21.15.7:0/1769636358 conn(0x7f7300072680 msgr2=0x7f7300072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:43.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.182+0000 7f730805a640 1 -- 172.21.15.7:0/1769636358 shutdown_connections 2024-04-25T10:04:43.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.182+0000 7f730805a640 1 -- 172.21.15.7:0/1769636358 wait complete. 2024-04-25T10:04:43.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.183+0000 7f730805a640 1 Processor -- start 2024-04-25T10:04:43.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.183+0000 7f730805a640 1 -- start start 2024-04-25T10:04:43.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.184+0000 7f730805a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73000ce830 0x7f7300155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.184+0000 7f730805a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f73000d3760 0x7f73001545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.184+0000 7f730805a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f730015f1c0 0x7f73001f6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.184+0000 7f730805a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730015de10 con 0x7f73000ce830 2024-04-25T10:04:43.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.184+0000 7f730805a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73000d2190 con 0x7f730015f1c0 2024-04-25T10:04:43.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.184+0000 7f730805a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73000b2780 con 0x7f73000d3760 2024-04-25T10:04:43.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.184+0000 7f7305df6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73000ce830 0x7f7300155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.184+0000 7f7305df6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73000ce830 0x7f7300155650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58172/0 (socket says 172.21.15.7:58172) 2024-04-25T10:04:43.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.184+0000 7f7305df6640 1 -- 172.21.15.7:0/1453005818 learned_addr learned my addr 172.21.15.7:0/1453005818 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:43.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.184+0000 7f73065f7640 1 --2- 172.21.15.7:0/1453005818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f730015f1c0 0x7f73001f6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.184+0000 7f7305df6640 1 -- 172.21.15.7:0/1453005818 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f73000d3760 msgr2=0x7f73001545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:43.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.184+0000 7f7305df6640 1 --2- 172.21.15.7:0/1453005818 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f73000d3760 0x7f73001545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.184+0000 7f7305df6640 1 -- 172.21.15.7:0/1453005818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f730015f1c0 msgr2=0x7f73001f6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:43.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.184+0000 7f7305df6640 1 --2- 172.21.15.7:0/1453005818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f730015f1c0 0x7f73001f6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.184+0000 7f7305df6640 1 -- 172.21.15.7:0/1453005818 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7300155b90 con 0x7f73000ce830 2024-04-25T10:04:43.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.184+0000 7f73065f7640 1 --2- 172.21.15.7:0/1453005818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f730015f1c0 0x7f73001f6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:43.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.184+0000 7f7305df6640 1 --2- 172.21.15.7:0/1453005818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73000ce830 0x7f7300155650 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f72fc00c4d0 tx=0x7f72fc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:43.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.185+0000 7f72f67fc640 1 -- 172.21.15.7:0/1453005818 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc018070 con 0x7f73000ce830 2024-04-25T10:04:43.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.185+0000 7f72f67fc640 1 -- 172.21.15.7:0/1453005818 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72fc007500 con 0x7f73000ce830 2024-04-25T10:04:43.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.185+0000 7f72f67fc640 1 -- 172.21.15.7:0/1453005818 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc004a20 con 0x7f73000ce830 2024-04-25T10:04:43.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.185+0000 7f730805a640 1 -- 172.21.15.7:0/1453005818 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7300157fa0 con 0x7f73000ce830 2024-04-25T10:04:43.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.185+0000 7f730805a640 1 -- 172.21.15.7:0/1453005818 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7300158560 con 0x7f73000ce830 2024-04-25T10:04:43.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.186+0000 7f72f67fc640 1 -- 172.21.15.7:0/1453005818 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f72fc01b070 con 0x7f73000ce830 2024-04-25T10:04:43.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.187+0000 7f72f67fc640 1 --2- 172.21.15.7:0/1453005818 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f72e406b500 0x7f72e406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.187+0000 7f72f67fc640 1 -- 172.21.15.7:0/1453005818 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f72fc0895c0 con 0x7f73000ce830 2024-04-25T10:04:43.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.187+0000 7f73055f5640 1 --2- 172.21.15.7:0/1453005818 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f72e406b500 0x7f72e406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.187+0000 7f73055f5640 1 --2- 172.21.15.7:0/1453005818 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f72e406b500 0x7f72e406d9c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f72f0006fd0 tx=0x7f72f0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:43.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.188+0000 7f730ae34740 1 Processor -- start 2024-04-25T10:04:43.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.188+0000 7f730ae34740 1 -- start start 2024-04-25T10:04:43.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.188+0000 7f730ae34740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562ac41fdb10 0x562ac4200320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.188+0000 7f730ae34740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562ac41fdef0 0x562ac4200860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.188+0000 7f730ae34740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ac41d0770 0x562ac41d3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.188+0000 7f730ae34740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ac4139da0 con 0x562ac41d0770 2024-04-25T10:04:43.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.188+0000 7f730ae34740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ac40e2b80 con 0x562ac41fdb10 2024-04-25T10:04:43.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.188+0000 7f730ae34740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x562ac4135e40 con 0x562ac41fdef0 2024-04-25T10:04:43.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.188+0000 7f73065f7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ac41d0770 0x562ac41d3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.188+0000 7f73065f7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ac41d0770 0x562ac41d3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58174/0 (socket says 172.21.15.7:58174) 2024-04-25T10:04:43.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.188+0000 7f73065f7640 1 -- 172.21.15.7:0/3853015266 learned_addr learned my addr 172.21.15.7:0/3853015266 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:43.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.188+0000 7f73055f5640 1 --2- 172.21.15.7:0/3853015266 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562ac41fdef0 0x562ac4200860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.189+0000 7f7305df6640 1 --2- 172.21.15.7:0/3853015266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562ac41fdb10 0x562ac4200320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.189+0000 7f73065f7640 1 -- 172.21.15.7:0/3853015266 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562ac41fdef0 msgr2=0x562ac4200860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:43.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.189+0000 7f73065f7640 1 --2- 172.21.15.7:0/3853015266 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562ac41fdef0 0x562ac4200860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.189+0000 7f73065f7640 1 -- 172.21.15.7:0/3853015266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562ac41fdb10 msgr2=0x562ac4200320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:43.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.189+0000 7f73065f7640 1 --2- 172.21.15.7:0/3853015266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562ac41fdb10 0x562ac4200320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.189+0000 7f73065f7640 1 -- 172.21.15.7:0/3853015266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ac40ecf10 con 0x562ac41d0770 2024-04-25T10:04:43.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.189+0000 7f73065f7640 1 --2- 172.21.15.7:0/3853015266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ac41d0770 0x562ac41d3f80 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f72f802a770 tx=0x7f72f802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72cd11af9f55a93b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:43.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.189+0000 7f72e37fe640 1 -- 172.21.15.7:0/3853015266 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8036040 con 0x562ac41d0770 2024-04-25T10:04:43.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.189+0000 7f72e37fe640 1 -- 172.21.15.7:0/3853015266 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f8042070 con 0x562ac41d0770 2024-04-25T10:04:43.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.189+0000 7f72e37fe640 1 -- 172.21.15.7:0/3853015266 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f803c870 con 0x562ac41d0770 2024-04-25T10:04:43.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.190+0000 7f730ae34740 1 -- 172.21.15.7:0/3853015266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ac41d0770 msgr2=0x562ac41d3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:43.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.190+0000 7f730ae34740 1 --2- 172.21.15.7:0/3853015266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ac41d0770 0x562ac41d3f80 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f72f802a770 tx=0x7f72f802e000 comp rx=0 tx=0).stop 2024-04-25T10:04:43.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.190+0000 7f730ae34740 1 -- 172.21.15.7:0/3853015266 shutdown_connections 2024-04-25T10:04:43.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.190+0000 7f730ae34740 1 --2- 172.21.15.7:0/3853015266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ac41d0770 0x562ac41d3f80 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.190+0000 7f730ae34740 1 --2- 172.21.15.7:0/3853015266 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562ac41fdef0 0x562ac4200860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.190+0000 7f730ae34740 1 --2- 172.21.15.7:0/3853015266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562ac41fdb10 0x562ac4200320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.190+0000 7f730ae34740 1 -- 172.21.15.7:0/3853015266 >> 172.21.15.7:0/3853015266 conn(0x562ac41d29e0 msgr2=0x562ac421b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:43.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.190+0000 7f730ae34740 1 -- 172.21.15.7:0/3853015266 shutdown_connections 2024-04-25T10:04:43.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.190+0000 7f730ae34740 1 -- 172.21.15.7:0/3853015266 wait complete. 2024-04-25T10:04:43.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.190+0000 7f730ae34740 1 -- start start 2024-04-25T10:04:43.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.190+0000 7f730ae34740 1 Processor -- start 2024-04-25T10:04:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.191+0000 7f730ae34740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562ac41fdb10 0x562ac41f7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.191+0000 7f730ae34740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ac41fdef0 0x562ac421ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.191+0000 7f730ae34740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562ac41f5210 0x562ac41f92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.191+0000 7f730ae34740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ac41d5b90 con 0x562ac41fdef0 2024-04-25T10:04:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.191+0000 7f730ae34740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ac40d84b0 con 0x562ac41fdb10 2024-04-25T10:04:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.191+0000 7f730ae34740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x562ac41d5e70 con 0x562ac41f5210 2024-04-25T10:04:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.191+0000 7f730ae34740 10 client.0 _ll_register_callbacks cb 0x562ac4118180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:04:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.191+0000 7f73055f5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ac41fdef0 0x562ac421ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.191+0000 7f73055f5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ac41fdef0 0x562ac421ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58186/0 (socket says 172.21.15.7:58186) 2024-04-25T10:04:43.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.191+0000 7f73055f5640 1 -- 172.21.15.7:0/427509021 learned_addr learned my addr 172.21.15.7:0/427509021 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:43.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.192+0000 7f73065f7640 1 --2- 172.21.15.7:0/427509021 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562ac41f5210 0x562ac41f92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.192+0000 7f7305df6640 1 --2- 172.21.15.7:0/427509021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562ac41fdb10 0x562ac41f7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.192+0000 7f73055f5640 1 -- 172.21.15.7:0/427509021 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562ac41f5210 msgr2=0x562ac41f92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:43.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.192+0000 7f73055f5640 1 --2- 172.21.15.7:0/427509021 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562ac41f5210 0x562ac41f92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.192+0000 7f73055f5640 1 -- 172.21.15.7:0/427509021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562ac41fdb10 msgr2=0x562ac41f7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:43.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.192+0000 7f73055f5640 1 --2- 172.21.15.7:0/427509021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562ac41fdb10 0x562ac41f7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.192+0000 7f73055f5640 1 -- 172.21.15.7:0/427509021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562ac3f187d0 con 0x562ac41fdef0 2024-04-25T10:04:43.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.192+0000 7f73055f5640 1 --2- 172.21.15.7:0/427509021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ac41fdef0 0x562ac421ed90 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f730015f5a0 tx=0x7f72f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7636e1214112f9b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:43.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.192+0000 7f72e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:04:43.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.192+0000 7f72e0ff9640 1 -- 172.21.15.7:0/427509021 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f0024020 con 0x562ac41fdef0 2024-04-25T10:04:43.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.192+0000 7f72e0ff9640 1 -- 172.21.15.7:0/427509021 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f72f0020420 con 0x562ac41fdef0 2024-04-25T10:04:43.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.192+0000 7f730ae34740 1 -- 172.21.15.7:0/427509021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f72f8042070 con 0x562ac41fdef0 2024-04-25T10:04:43.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.192+0000 7f72e0ff9640 1 -- 172.21.15.7:0/427509021 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72f002e050 con 0x562ac41fdef0 2024-04-25T10:04:43.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.192+0000 7f730ae34740 10 client.9273 fetch_fsmap learned FSMap version 88 2024-04-25T10:04:43.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.192+0000 7f730ae34740 1 -- 172.21.15.7:0/427509021 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=2+}) v3 -- 0x562ac3e4e3f0 con 0x562ac41fdef0 2024-04-25T10:04:43.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.192+0000 7f72e0ff9640 1 -- 172.21.15.7:0/427509021 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f8042070 con 0x562ac41fdef0 2024-04-25T10:04:43.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.193+0000 7f72e0ff9640 1 -- 172.21.15.7:0/427509021 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 88) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f72f0031020 con 0x562ac41fdef0 2024-04-25T10:04:43.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.193+0000 7f730ae34740 10 client.9273 fetch_fsmap finished waiting for FSMap version 88 2024-04-25T10:04:43.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.193+0000 7f730ae34740 10 client.9273 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-04-25T10:04:43.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.193+0000 7f730ae34740 20 client.9273 populate_metadata read hostname 'smithi007' 2024-04-25T10:04:43.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.193+0000 7f730ae34740 1 --2- 172.21.15.7:0/427509021 >> [v2:172.21.15.7:6834/3623521645,v1:172.21.15.7:6836/3623521645] conn(0x562ac41f6070 0x562ac41ffd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.193+0000 7f730ae34740 4 client.9273 mds_command: new command op to 9051 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:04:43.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.193+0000 7f730ae34740 1 -- 172.21.15.7:0/427509021 --> [v2:172.21.15.7:6834/3623521645,v1:172.21.15.7:6836/3623521645] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562ac41472e0 con 0x562ac41f6070 2024-04-25T10:04:43.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.193+0000 7f7305df6640 1 --2- 172.21.15.7:0/427509021 >> [v2:172.21.15.7:6834/3623521645,v1:172.21.15.7:6836/3623521645] conn(0x562ac41f6070 0x562ac41ffd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.193+0000 7f72e0ff9640 10 client.9273 ms_handle_connect on v2:172.21.15.7:6834/3623521645 2024-04-25T10:04:43.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.193+0000 7f7305df6640 1 --2- 172.21.15.7:0/427509021 >> [v2:172.21.15.7:6834/3623521645,v1:172.21.15.7:6836/3623521645] conn(0x562ac41f6070 0x562ac41ffd90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db875f59baf00fb0 server_cookie=46e8597564f24bcc in_seq=0 out_seq=0 2024-04-25T10:04:43.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.193+0000 7f72e0ff9640 1 -- 172.21.15.7:0/427509021 <== mds.0 v2:172.21.15.7:6834/3623521645 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562ac41472e0 con 0x562ac41f6070 2024-04-25T10:04:43.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.194+0000 7f72e0ff9640 10 client.9273 handle_command_reply: tid=0 2024-04-25T10:04:43.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.194+0000 7f730ae34740 1 client.9273 shutdown 2024-04-25T10:04:43.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.194+0000 7f730ae34740 1 -- 172.21.15.7:0/427509021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ac41fdef0 msgr2=0x562ac421ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:43.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.194+0000 7f730ae34740 1 --2- 172.21.15.7:0/427509021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ac41fdef0 0x562ac421ed90 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f730015f5a0 tx=0x7f72f00046c0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.194+0000 7f730ae34740 1 -- 172.21.15.7:0/427509021 shutdown_connections 2024-04-25T10:04:43.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.194+0000 7f730ae34740 1 --2- 172.21.15.7:0/427509021 >> [v2:172.21.15.7:6834/3623521645,v1:172.21.15.7:6836/3623521645] conn(0x562ac41f6070 0x562ac41ffd90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.194+0000 7f730ae34740 1 --2- 172.21.15.7:0/427509021 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562ac41f5210 0x562ac41f92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.194+0000 7f72e0ff9640 0 client.9273 ms_handle_reset on v2:172.21.15.7:6834/3623521645 2024-04-25T10:04:43.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.194+0000 7f730ae34740 1 --2- 172.21.15.7:0/427509021 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ac41fdef0 0x562ac421ed90 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.194+0000 7f730ae34740 1 --2- 172.21.15.7:0/427509021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562ac41fdb10 0x562ac41f7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.194+0000 7f730ae34740 1 -- 172.21.15.7:0/427509021 >> 172.21.15.7:0/427509021 conn(0x562ac41d0770 msgr2=0x562ac41d1400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:43.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.194+0000 7f730ae34740 1 -- 172.21.15.7:0/427509021 shutdown_connections 2024-04-25T10:04:43.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.194+0000 7f730ae34740 1 -- 172.21.15.7:0/427509021 wait complete. 2024-04-25T10:04:43.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.194+0000 7f730ae34740 20 client.9273 trim_cache size 0 max 16384 2024-04-25T10:04:43.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.207+0000 7f730ae34740 1 Processor -- start 2024-04-25T10:04:43.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.207+0000 7f730ae34740 1 -- start start 2024-04-25T10:04:43.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.208+0000 7f730ae34740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ac41f5210 0x562ac41d5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.208+0000 7f730ae34740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562ac41fdb10 0x562ac41f8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.208+0000 7f730ae34740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562ac41fdef0 0x562ac41f6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.208+0000 7f730ae34740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73001fff80 con 0x562ac41f5210 2024-04-25T10:04:43.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.208+0000 7f730ae34740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73001ff160 con 0x562ac41fdef0 2024-04-25T10:04:43.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.208+0000 7f730ae34740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730015a000 con 0x562ac41fdb10 2024-04-25T10:04:43.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.208+0000 7f7305df6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ac41f5210 0x562ac41d5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.208+0000 7f7305df6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ac41f5210 0x562ac41d5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58190/0 (socket says 172.21.15.7:58190) 2024-04-25T10:04:43.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.208+0000 7f7305df6640 1 -- 172.21.15.7:0/2191198463 learned_addr learned my addr 172.21.15.7:0/2191198463 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:43.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.208+0000 7f73065f7640 1 --2- 172.21.15.7:0/2191198463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562ac41fdef0 0x562ac41f6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.208+0000 7f73055f5640 1 --2- 172.21.15.7:0/2191198463 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562ac41fdb10 0x562ac41f8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.208+0000 7f7305df6640 1 -- 172.21.15.7:0/2191198463 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562ac41fdb10 msgr2=0x562ac41f8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:43.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.208+0000 7f7305df6640 1 --2- 172.21.15.7:0/2191198463 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562ac41fdb10 0x562ac41f8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.208+0000 7f7305df6640 1 -- 172.21.15.7:0/2191198463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562ac41fdef0 msgr2=0x562ac41f6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:43.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.208+0000 7f7305df6640 1 --2- 172.21.15.7:0/2191198463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562ac41fdef0 0x562ac41f6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.208+0000 7f7305df6640 1 -- 172.21.15.7:0/2191198463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ac3e0e0f0 con 0x562ac41f5210 2024-04-25T10:04:43.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.208+0000 7f7305df6640 1 --2- 172.21.15.7:0/2191198463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ac41f5210 0x562ac41d5590 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0540a0 tx=0x7f72fc0878c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d944c6a07f88fb3f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:43.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.209+0000 7f72e2ffd640 1 -- 172.21.15.7:0/2191198463 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc055f40 con 0x562ac41f5210 2024-04-25T10:04:43.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.209+0000 7f72e2ffd640 1 -- 172.21.15.7:0/2191198463 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72fc0542b0 con 0x562ac41f5210 2024-04-25T10:04:43.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.209+0000 7f72e2ffd640 1 -- 172.21.15.7:0/2191198463 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc004dc0 con 0x562ac41f5210 2024-04-25T10:04:43.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.209+0000 7f730ae34740 1 -- 172.21.15.7:0/2191198463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ac41f5210 msgr2=0x562ac41d5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:43.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.209+0000 7f730ae34740 1 --2- 172.21.15.7:0/2191198463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ac41f5210 0x562ac41d5590 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0540a0 tx=0x7f72fc0878c0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.209+0000 7f730ae34740 1 -- 172.21.15.7:0/2191198463 shutdown_connections 2024-04-25T10:04:43.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.209+0000 7f730ae34740 1 --2- 172.21.15.7:0/2191198463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562ac41fdef0 0x562ac41f6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.209+0000 7f730ae34740 1 --2- 172.21.15.7:0/2191198463 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562ac41fdb10 0x562ac41f8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.209+0000 7f730ae34740 1 --2- 172.21.15.7:0/2191198463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ac41f5210 0x562ac41d5590 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.209+0000 7f730ae34740 1 -- 172.21.15.7:0/2191198463 >> 172.21.15.7:0/2191198463 conn(0x562ac41d0770 msgr2=0x562ac4223450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:43.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.209+0000 7f730ae34740 1 -- 172.21.15.7:0/2191198463 shutdown_connections 2024-04-25T10:04:43.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.209+0000 7f730ae34740 1 -- 172.21.15.7:0/2191198463 wait complete. 2024-04-25T10:04:43.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.210+0000 7f730ae34740 1 -- start start 2024-04-25T10:04:43.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.210+0000 7f730ae34740 1 Processor -- start 2024-04-25T10:04:43.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.211+0000 7f730ae34740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ac41f5210 0x562ac4288a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.211+0000 7f730ae34740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562ac41fdb10 0x562ac4210cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.211+0000 7f730ae34740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562ac41fdef0 0x562ac42111f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.211+0000 7f730ae34740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730015a600 con 0x562ac41f5210 2024-04-25T10:04:43.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.211+0000 7f730ae34740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ac41fc180 con 0x562ac41fdef0 2024-04-25T10:04:43.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.211+0000 7f730ae34740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x562ac41ff040 con 0x562ac41fdb10 2024-04-25T10:04:43.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.211+0000 7f730ae34740 10 client.0 _ll_register_callbacks cb 0x7f72f8034070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:04:43.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.211+0000 7f7305df6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ac41f5210 0x562ac4288a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.211+0000 7f7305df6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ac41f5210 0x562ac4288a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58196/0 (socket says 172.21.15.7:58196) 2024-04-25T10:04:43.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.211+0000 7f7305df6640 1 -- 172.21.15.7:0/2302796919 learned_addr learned my addr 172.21.15.7:0/2302796919 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:43.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.211+0000 7f73065f7640 1 --2- 172.21.15.7:0/2302796919 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562ac41fdef0 0x562ac42111f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.211+0000 7f73055f5640 1 --2- 172.21.15.7:0/2302796919 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562ac41fdb10 0x562ac4210cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.211+0000 7f7305df6640 1 -- 172.21.15.7:0/2302796919 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562ac41fdb10 msgr2=0x562ac4210cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:43.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.211+0000 7f7305df6640 1 --2- 172.21.15.7:0/2302796919 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562ac41fdb10 0x562ac4210cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.211+0000 7f7305df6640 1 -- 172.21.15.7:0/2302796919 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562ac41fdef0 msgr2=0x562ac42111f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:43.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.211+0000 7f7305df6640 1 --2- 172.21.15.7:0/2302796919 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562ac41fdef0 0x562ac42111f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.211+0000 7f7305df6640 1 -- 172.21.15.7:0/2302796919 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562ac421ef40 con 0x562ac41f5210 2024-04-25T10:04:43.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.211+0000 7f73055f5640 1 --2- 172.21.15.7:0/2302796919 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562ac41fdb10 0x562ac4210cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:43.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.211+0000 7f7305df6640 1 --2- 172.21.15.7:0/2302796919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ac41f5210 0x562ac4288a80 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f72fc00ce90 tx=0x7f72fc089040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c057ce5007f7e8e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:43.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.211+0000 7f72e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:04:43.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.211+0000 7f72e0ff9640 1 -- 172.21.15.7:0/2302796919 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc07b060 con 0x562ac41f5210 2024-04-25T10:04:43.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.211+0000 7f72e0ff9640 1 -- 172.21.15.7:0/2302796919 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f72fc004dc0 con 0x562ac41f5210 2024-04-25T10:04:43.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.211+0000 7f730ae34740 1 -- 172.21.15.7:0/2302796919 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f72fc0542b0 con 0x562ac41f5210 2024-04-25T10:04:43.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.212+0000 7f72e0ff9640 1 -- 172.21.15.7:0/2302796919 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72fc081050 con 0x562ac41f5210 2024-04-25T10:04:43.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.212+0000 7f730ae34740 10 client.9279 fetch_fsmap learned FSMap version 88 2024-04-25T10:04:43.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.212+0000 7f730ae34740 1 -- 172.21.15.7:0/2302796919 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=2+}) v3 -- 0x562ac4203eb0 con 0x562ac41f5210 2024-04-25T10:04:43.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.212+0000 7f72e0ff9640 1 -- 172.21.15.7:0/2302796919 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72fc0542b0 con 0x562ac41f5210 2024-04-25T10:04:43.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.212+0000 7f72e0ff9640 1 -- 172.21.15.7:0/2302796919 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 88) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f72fc057090 con 0x562ac41f5210 2024-04-25T10:04:43.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.212+0000 7f730ae34740 10 client.9279 fetch_fsmap finished waiting for FSMap version 88 2024-04-25T10:04:43.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.212+0000 7f730ae34740 10 client.9279 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-04-25T10:04:43.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.212+0000 7f730ae34740 20 client.9279 populate_metadata read hostname 'smithi007' 2024-04-25T10:04:43.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.212+0000 7f730ae34740 1 --2- 172.21.15.7:0/2302796919 >> [v2:172.21.15.7:6834/3623521645,v1:172.21.15.7:6836/3623521645] conn(0x562ac4200590 0x562ac41fe2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.212+0000 7f730ae34740 4 client.9279 mds_command: new command op to 9051 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T10:04:43.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.212+0000 7f730ae34740 1 -- 172.21.15.7:0/2302796919 --> [v2:172.21.15.7:6834/3623521645,v1:172.21.15.7:6836/3623521645] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562ac4141630 con 0x562ac4200590 2024-04-25T10:04:43.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.212+0000 7f73055f5640 1 --2- 172.21.15.7:0/2302796919 >> [v2:172.21.15.7:6834/3623521645,v1:172.21.15.7:6836/3623521645] conn(0x562ac4200590 0x562ac41fe2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.212+0000 7f73055f5640 1 --2- 172.21.15.7:0/2302796919 >> [v2:172.21.15.7:6834/3623521645,v1:172.21.15.7:6836/3623521645] conn(0x562ac4200590 0x562ac41fe2d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29ae225f27ed3a83 server_cookie=f110a34eb2642999 in_seq=0 out_seq=0 2024-04-25T10:04:43.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.212+0000 7f72e0ff9640 10 client.9279 ms_handle_connect on v2:172.21.15.7:6834/3623521645 2024-04-25T10:04:43.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.222+0000 7f72e0ff9640 1 -- 172.21.15.7:0/2302796919 <== mds.0 v2:172.21.15.7:6834/3623521645 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562ac4141630 con 0x562ac4200590 2024-04-25T10:04:43.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.222+0000 7f72e0ff9640 10 client.9279 handle_command_reply: tid=0 2024-04-25T10:04:43.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.222+0000 7f730ae34740 1 client.9279 shutdown 2024-04-25T10:04:43.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.222+0000 7f730ae34740 1 -- 172.21.15.7:0/2302796919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ac41f5210 msgr2=0x562ac4288a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:43.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.222+0000 7f730ae34740 1 --2- 172.21.15.7:0/2302796919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ac41f5210 0x562ac4288a80 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f72fc00ce90 tx=0x7f72fc089040 comp rx=0 tx=0).stop 2024-04-25T10:04:43.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.222+0000 7f730ae34740 1 -- 172.21.15.7:0/2302796919 shutdown_connections 2024-04-25T10:04:43.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.222+0000 7f730ae34740 1 --2- 172.21.15.7:0/2302796919 >> [v2:172.21.15.7:6834/3623521645,v1:172.21.15.7:6836/3623521645] conn(0x562ac4200590 0x562ac41fe2d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.223+0000 7f730ae34740 1 --2- 172.21.15.7:0/2302796919 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562ac41fdef0 0x562ac42111f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.223+0000 7f730ae34740 1 --2- 172.21.15.7:0/2302796919 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x562ac41fdb10 0x562ac4210cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.223+0000 7f730ae34740 1 --2- 172.21.15.7:0/2302796919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562ac41f5210 0x562ac4288a80 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.223+0000 7f72e0ff9640 0 client.9279 ms_handle_reset on v2:172.21.15.7:6834/3623521645 2024-04-25T10:04:43.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.223+0000 7f730ae34740 1 -- 172.21.15.7:0/2302796919 >> 172.21.15.7:0/2302796919 conn(0x562ac41d0770 msgr2=0x562ac41cf8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:43.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.223+0000 7f730ae34740 1 -- 172.21.15.7:0/2302796919 shutdown_connections 2024-04-25T10:04:43.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.223+0000 7f730ae34740 1 -- 172.21.15.7:0/2302796919 wait complete. 2024-04-25T10:04:43.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.223+0000 7f730ae34740 20 client.9279 trim_cache size 0 max 16384 2024-04-25T10:04:43.230 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:04:43.230 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "", 2024-04-25T10:04:43.230 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0 2024-04-25T10:04:43.230 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:04:43.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.223+0000 7f730805a640 1 -- 172.21.15.7:0/1453005818 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f72e406b500 msgr2=0x7f72e406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:43.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.223+0000 7f730805a640 1 --2- 172.21.15.7:0/1453005818 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f72e406b500 0x7f72e406d9c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f72f0006fd0 tx=0x7f72f0008040 comp rx=0 tx=0).stop 2024-04-25T10:04:43.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.223+0000 7f730805a640 1 -- 172.21.15.7:0/1453005818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73000ce830 msgr2=0x7f7300155650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:43.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.223+0000 7f730805a640 1 --2- 172.21.15.7:0/1453005818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73000ce830 0x7f7300155650 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f72fc00c4d0 tx=0x7f72fc00c990 comp rx=0 tx=0).stop 2024-04-25T10:04:43.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.223+0000 7f730805a640 1 -- 172.21.15.7:0/1453005818 shutdown_connections 2024-04-25T10:04:43.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.223+0000 7f730805a640 1 --2- 172.21.15.7:0/1453005818 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f72e406b500 0x7f72e406d9c0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.223+0000 7f730805a640 1 --2- 172.21.15.7:0/1453005818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f730015f1c0 0x7f73001f6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.223+0000 7f730805a640 1 --2- 172.21.15.7:0/1453005818 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f73000d3760 0x7f73001545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.223+0000 7f730805a640 1 --2- 172.21.15.7:0/1453005818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f73000ce830 0x7f7300155650 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.223+0000 7f730805a640 1 -- 172.21.15.7:0/1453005818 >> 172.21.15.7:0/1453005818 conn(0x7f7300072680 msgr2=0x7f7300072a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:43.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.224+0000 7f730805a640 1 -- 172.21.15.7:0/1453005818 shutdown_connections 2024-04-25T10:04:43.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.224+0000 7f730805a640 1 -- 172.21.15.7:0/1453005818 wait complete. 2024-04-25T10:04:43.240 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:04:43.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.337+0000 7fca59015640 1 Processor -- start 2024-04-25T10:04:43.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.337+0000 7fca59015640 1 -- start start 2024-04-25T10:04:43.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.338+0000 7fca59015640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fca5415dd00 0x7fca540b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.338+0000 7fca59015640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fca5406c6c0 0x7fca540b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.338+0000 7fca59015640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca5406cd00 con 0x7fca540b6a40 2024-04-25T10:04:43.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.338+0000 7fca59015640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca5415e0e0 con 0x7fca5415dd00 2024-04-25T10:04:43.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.338+0000 7fca59015640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca5406cfe0 con 0x7fca5406c6c0 2024-04-25T10:04:43.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.338+0000 7fca5359e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fca5406c6c0 0x7fca540b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.338+0000 7fca52d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fca5415dd00 0x7fca540b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.338+0000 7fca4bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fca540b6a40 0x7fca5406bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:45576/0 (socket says 172.21.15.7:45576) 2024-04-25T10:04:43.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.338+0000 7fca4bfff640 1 -- 172.21.15.7:0/1066887415 learned_addr learned my addr 172.21.15.7:0/1066887415 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:43.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.338+0000 7fca5359e640 1 -- 172.21.15.7:0/1066887415 >> v2:172.21.15.55:3300/0 conn(0x7fca5415dd00 msgr2=0x7fca540b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:43.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.338+0000 7fca5359e640 1 --2- 172.21.15.7:0/1066887415 >> v2:172.21.15.55:3300/0 conn(0x7fca5415dd00 0x7fca540b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.338+0000 7fca5359e640 1 -- 172.21.15.7:0/1066887415 >> v1:172.21.15.55:6789/0 conn(0x7fca540b6a40 legacy=0x7fca5406bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:43.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.339+0000 7fca5359e640 1 -- 172.21.15.7:0/1066887415 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca540d1ca0 con 0x7fca5406c6c0 2024-04-25T10:04:43.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.339+0000 7fca52d9d640 1 --2- 172.21.15.7:0/1066887415 >> v2:172.21.15.55:3300/0 conn(0x7fca5415dd00 0x7fca540b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:43.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.339+0000 7fca5359e640 1 --2- 172.21.15.7:0/1066887415 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fca5406c6c0 0x7fca540b5c90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fca4c009d90 tx=0x7fca4c02a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50dfe604736e245b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:43.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.340+0000 7fca5259c640 1 -- 172.21.15.7:0/1066887415 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c007740 con 0x7fca5406c6c0 2024-04-25T10:04:43.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.340+0000 7fca5259c640 1 -- 172.21.15.7:0/1066887415 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4c0078e0 con 0x7fca5406c6c0 2024-04-25T10:04:43.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.340+0000 7fca5259c640 1 -- 172.21.15.7:0/1066887415 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c007cb0 con 0x7fca5406c6c0 2024-04-25T10:04:43.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.340+0000 7fca59015640 1 -- 172.21.15.7:0/1066887415 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fca5406c6c0 msgr2=0x7fca540b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:43.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.340+0000 7fca59015640 1 --2- 172.21.15.7:0/1066887415 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fca5406c6c0 0x7fca540b5c90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fca4c009d90 tx=0x7fca4c02a6f0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.340+0000 7fca59015640 1 -- 172.21.15.7:0/1066887415 shutdown_connections 2024-04-25T10:04:43.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.340+0000 7fca59015640 1 --2- 172.21.15.7:0/1066887415 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fca5406c6c0 0x7fca540b5c90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.340+0000 7fca59015640 1 --2- 172.21.15.7:0/1066887415 >> v2:172.21.15.55:3300/0 conn(0x7fca5415dd00 0x7fca540b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.340+0000 7fca59015640 1 -- 172.21.15.7:0/1066887415 >> 172.21.15.7:0/1066887415 conn(0x7fca540d07b0 msgr2=0x7fca540d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:43.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.340+0000 7fca59015640 1 -- 172.21.15.7:0/1066887415 shutdown_connections 2024-04-25T10:04:43.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.340+0000 7fca59015640 1 -- 172.21.15.7:0/1066887415 wait complete. 2024-04-25T10:04:43.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.341+0000 7fca59015640 1 Processor -- start 2024-04-25T10:04:43.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.341+0000 7fca59015640 1 -- start start 2024-04-25T10:04:43.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.342+0000 7fca59015640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca5406c6c0 0x7fca540b9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.342+0000 7fca59015640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fca540b6a40 0x7fca540c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.342+0000 7fca59015640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca5415dd00 0x7fca541605d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.342+0000 7fca59015640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca540d2780 con 0x7fca5406c6c0 2024-04-25T10:04:43.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.342+0000 7fca59015640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca540d2260 con 0x7fca5415dd00 2024-04-25T10:04:43.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.342+0000 7fca59015640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca540d2900 con 0x7fca540b6a40 2024-04-25T10:04:43.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.342+0000 7fca52d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca5406c6c0 0x7fca540b9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.342+0000 7fca52d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca5406c6c0 0x7fca540b9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58206/0 (socket says 172.21.15.7:58206) 2024-04-25T10:04:43.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.342+0000 7fca52d9d640 1 -- 172.21.15.7:0/2707159096 learned_addr learned my addr 172.21.15.7:0/2707159096 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:43.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.342+0000 7fca4bfff640 1 --2- 172.21.15.7:0/2707159096 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fca540b6a40 0x7fca540c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.342+0000 7fca5359e640 1 --2- 172.21.15.7:0/2707159096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca5415dd00 0x7fca541605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.343+0000 7fca52d9d640 1 -- 172.21.15.7:0/2707159096 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fca540b6a40 msgr2=0x7fca540c9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:43.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.343+0000 7fca52d9d640 1 --2- 172.21.15.7:0/2707159096 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fca540b6a40 0x7fca540c9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.343+0000 7fca52d9d640 1 -- 172.21.15.7:0/2707159096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca5415dd00 msgr2=0x7fca541605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:43.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.343+0000 7fca52d9d640 1 --2- 172.21.15.7:0/2707159096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca5415dd00 0x7fca541605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.343+0000 7fca52d9d640 1 -- 172.21.15.7:0/2707159096 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca540c9a40 con 0x7fca5406c6c0 2024-04-25T10:04:43.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.343+0000 7fca52d9d640 1 --2- 172.21.15.7:0/2707159096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca5406c6c0 0x7fca540b9340 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fca4400e960 tx=0x7fca4400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:43.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.343+0000 7fca4b7fe640 1 -- 172.21.15.7:0/2707159096 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca44017070 con 0x7fca5406c6c0 2024-04-25T10:04:43.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.343+0000 7fca4b7fe640 1 -- 172.21.15.7:0/2707159096 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4400ca00 con 0x7fca5406c6c0 2024-04-25T10:04:43.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.343+0000 7fca4b7fe640 1 -- 172.21.15.7:0/2707159096 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4400cdd0 con 0x7fca5406c6c0 2024-04-25T10:04:43.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.343+0000 7fca59015640 1 -- 172.21.15.7:0/2707159096 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca541558a0 con 0x7fca5406c6c0 2024-04-25T10:04:43.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.343+0000 7fca59015640 1 -- 172.21.15.7:0/2707159096 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca54156140 con 0x7fca5406c6c0 2024-04-25T10:04:43.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.344+0000 7fca59015640 1 -- 172.21.15.7:0/2707159096 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca54068fd0 con 0x7fca5406c6c0 2024-04-25T10:04:43.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.345+0000 7fca4b7fe640 1 -- 172.21.15.7:0/2707159096 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fca4401a070 con 0x7fca5406c6c0 2024-04-25T10:04:43.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.345+0000 7fca4b7fe640 1 --2- 172.21.15.7:0/2707159096 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fca3406b4d0 0x7fca3406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.345+0000 7fca4b7fe640 1 -- 172.21.15.7:0/2707159096 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fca4408a1c0 con 0x7fca5406c6c0 2024-04-25T10:04:43.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.345+0000 7fca4bfff640 1 --2- 172.21.15.7:0/2707159096 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fca3406b4d0 0x7fca3406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.346+0000 7fca4bfff640 1 --2- 172.21.15.7:0/2707159096 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fca3406b4d0 0x7fca3406d990 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fca540cfa20 tx=0x7fca3c007e80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:43.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.350+0000 7fca4b7fe640 1 -- 172.21.15.7:0/2707159096 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fca540c9a40 con 0x7fca5406c6c0 2024-04-25T10:04:43.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.573+0000 7fca59015640 1 -- 172.21.15.7:0/2707159096 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fca540d1620 con 0x7fca5406c6c0 2024-04-25T10:04:43.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.573+0000 7fca4b7fe640 1 -- 172.21.15.7:0/2707159096 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v88) v1 ==== 53+0+73 (secure 0 0 0) 0x7fca44058860 con 0x7fca5406c6c0 2024-04-25T10:04:43.579 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T10:04:43.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.575+0000 7fca59015640 1 -- 172.21.15.7:0/2707159096 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fca3406b4d0 msgr2=0x7fca3406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:43.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.575+0000 7fca59015640 1 --2- 172.21.15.7:0/2707159096 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fca3406b4d0 0x7fca3406d990 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fca540cfa20 tx=0x7fca3c007e80 comp rx=0 tx=0).stop 2024-04-25T10:04:43.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.575+0000 7fca59015640 1 -- 172.21.15.7:0/2707159096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca5406c6c0 msgr2=0x7fca540b9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:43.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.575+0000 7fca59015640 1 --2- 172.21.15.7:0/2707159096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca5406c6c0 0x7fca540b9340 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fca4400e960 tx=0x7fca4400ee20 comp rx=0 tx=0).stop 2024-04-25T10:04:43.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.575+0000 7fca59015640 1 -- 172.21.15.7:0/2707159096 shutdown_connections 2024-04-25T10:04:43.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.575+0000 7fca59015640 1 --2- 172.21.15.7:0/2707159096 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fca3406b4d0 0x7fca3406d990 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.575+0000 7fca59015640 1 --2- 172.21.15.7:0/2707159096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca5415dd00 0x7fca541605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.575+0000 7fca59015640 1 --2- 172.21.15.7:0/2707159096 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fca540b6a40 0x7fca540c9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.575+0000 7fca59015640 1 --2- 172.21.15.7:0/2707159096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca5406c6c0 0x7fca540b9340 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.575+0000 7fca59015640 1 -- 172.21.15.7:0/2707159096 >> 172.21.15.7:0/2707159096 conn(0x7fca540d07b0 msgr2=0x7fca5415b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:43.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.576+0000 7fca59015640 1 -- 172.21.15.7:0/2707159096 shutdown_connections 2024-04-25T10:04:43.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:43.576+0000 7fca59015640 1 -- 172.21.15.7:0/2707159096 wait complete. 2024-04-25T10:04:43.591 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T10:04:43.591 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:04:43.592 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-04-25T10:04:43.592 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T10:04:43.592 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T10:04:43.592 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T10:04:43.592 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T10:04:43.593 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:04:43.593 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:04:43.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:43.593 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-04-25T10:04:43.609 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:04:43.609 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:04:43.609 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:04:43.609 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:43.609 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-04-25T10:04:43.609 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:43.609 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:04:43.609 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:43.609 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-04-25T10:04:43.609 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:04:43.609 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:43.610 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-04-25T10:04:43.610 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:04:43.610 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:43.610 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-04-25T10:04:43.610 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T10:04:43.610 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42116sec preferred_lft 42116sec 2024-04-25T10:04:43.610 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link noprefixroute 2024-04-25T10:04:43.610 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:43.610 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:04:43.610 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:43.610 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-04-25T10:04:43.610 INFO:teuthology.orchestra.run.smithi007.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T10:04:43.610 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 26:0c:99:53:12:e3 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:43.610 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T10:04:43.611 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:43.611 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::50aa:55ff:febc:5f67/64 scope link 2024-04-25T10:04:43.611 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:43.611 INFO:teuthology.orchestra.run.smithi007.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:04:43.611 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 6e:99:f1:00:a9:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:04:43.611 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6c99:f1ff:fe00:a95e/64 scope link 2024-04-25T10:04:43.611 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:43.611 INFO:teuthology.orchestra.run.smithi007.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:04:43.611 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 26:0c:99:53:12:e3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T10:04:43.611 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::240c:99ff:fe53:12e3/64 scope link 2024-04-25T10:04:43.611 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:43.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:43.612 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:04:43.672 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-04-25T10:04:43.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:43.674 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-04-25T10:04:43.730 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-04-25T10:04:43.730 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:04:43.730 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T10:04:43.730 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T10:04:43.730 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:04:43.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:43.731 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-04-25T10:04:43.731 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-25T10:04:43.731 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:04:43.731 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:04:43.731 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:04:43.731 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-25T10:04:43.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:43.816 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-04-25T10:04:43.831 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T10:04:43.831 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T10:04:43.831 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:04:43.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:43.832 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-04-25T10:04:43.896 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:04:43.896 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T10:04:43.951 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:04:43.951 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:04:43.952 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:04:44.007 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T10:04:44.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:44.007 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:04:44.089 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:04:44.089 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T10:04:44.089 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T10:04:44.098 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:04:44.098 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T10:04:44.098 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T10:04:44.098 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T10:04:44.098 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T10:04:44.106 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:04:44.106 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T10:04:44.106 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T10:04:44.106 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T10:04:44.106 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T10:04:44.106 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790" 2024-04-25T10:04:44.106 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790:/ 2024-04-25T10:04:44.106 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c03d0745-5946-49c3-ad88-1165c5b68b4e" will pass to kernel 2024-04-25T10:04:44.107 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T10:04:44.107 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-04-25T10:04:44.107 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T10:04:44.107 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T10:04:44.107 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T10:04:44.108 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T10:04:44.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:44.108 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:04:44.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:44.175 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:04:44.231 INFO:teuthology.orchestra.run.smithi007.stdout:client8122 2024-04-25T10:04:44.232 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:04:44.232 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:44.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:44.292 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent/unflushed) 2024-04-25T10:04:44.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:44.353 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=./parent/unflushed/jfile bs=1M count=8) 2024-04-25T10:04:44.431 INFO:teuthology.orchestra.run.smithi007.stderr:8+0 records in 2024-04-25T10:04:44.432 INFO:teuthology.orchestra.run.smithi007.stderr:8+0 records out 2024-04-25T10:04:44.432 INFO:teuthology.orchestra.run.smithi007.stderr:8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.0231879 s, 362 MB/s 2024-04-25T10:04:44.433 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T10:04:44.433 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T10:04:44.433 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T10:04:44.433 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T10:04:44.433 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-04-25T10:04:44.433 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T10:04:44.539 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627781 2024-04-25T10:04:44.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:04:44.548 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T10:04:44.549 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T10:04:44.549 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T10:04:44.549 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T10:04:44.549 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-04-25T10:04:44.549 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T10:04:44.655 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627782 2024-04-25T10:04:44.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:04:44.664 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:04:44.665 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:44.722 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:04:44.722 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:44.778 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:44.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.914+0000 7f2d88a09640 1 Processor -- start 2024-04-25T10:04:44.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.914+0000 7f2d88a09640 1 -- start start 2024-04-25T10:04:44.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.915+0000 7f2d88a09640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2d841529e0 0x7f2d840c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:44.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.915+0000 7f2d88a09640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d840cea60 0x7f2d8406d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:44.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.915+0000 7f2d88a09640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d8415bdc0 con 0x7f2d840c6410 2024-04-25T10:04:44.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.915+0000 7f2d88a09640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d840b2340 con 0x7f2d841529e0 2024-04-25T10:04:44.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.915+0000 7f2d88a09640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8415c060 con 0x7f2d840cea60 2024-04-25T10:04:44.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.915+0000 7f2d8259c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2d841529e0 0x7f2d840c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:44.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.915+0000 7f2d8259c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2d841529e0 0x7f2d840c5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58222/0 (socket says 172.21.15.7:58222) 2024-04-25T10:04:44.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.915+0000 7f2d8259c640 1 -- 172.21.15.7:0/796181646 learned_addr learned my addr 172.21.15.7:0/796181646 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:44.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.915+0000 7f2d8259c640 1 -- 172.21.15.7:0/796181646 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d840cea60 msgr2=0x7f2d8406d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:44.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.915+0000 7f2d82d9d640 1 --2- 172.21.15.7:0/796181646 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d840cea60 0x7f2d8406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:44.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.915+0000 7f2d8259c640 1 --2- 172.21.15.7:0/796181646 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d840cea60 0x7f2d8406d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:44.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.915+0000 7f2d8259c640 1 -- 172.21.15.7:0/796181646 >> v1:172.21.15.55:6789/0 conn(0x7f2d840c6410 legacy=0x7f2d840ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:44.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.915+0000 7f2d8259c640 1 -- 172.21.15.7:0/796181646 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8415c340 con 0x7f2d841529e0 2024-04-25T10:04:44.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.915+0000 7f2d82d9d640 1 --2- 172.21.15.7:0/796181646 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d840cea60 0x7f2d8406d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:44.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.916+0000 7f2d8259c640 1 --2- 172.21.15.7:0/796181646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d841529e0 0x7f2d840c5ed0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f2d84071d60 tx=0x7f2d7402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b46bcf71526aa45 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:44.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.916+0000 7f2d81d9b640 1 -- 172.21.15.7:0/796181646 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d74037070 con 0x7f2d841529e0 2024-04-25T10:04:44.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.916+0000 7f2d81d9b640 1 -- 172.21.15.7:0/796181646 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d74032440 con 0x7f2d841529e0 2024-04-25T10:04:44.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.916+0000 7f2d81d9b640 1 -- 172.21.15.7:0/796181646 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d74032810 con 0x7f2d841529e0 2024-04-25T10:04:44.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.917+0000 7f2d88a09640 1 -- 172.21.15.7:0/796181646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d841529e0 msgr2=0x7f2d840c5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:44.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.917+0000 7f2d88a09640 1 --2- 172.21.15.7:0/796181646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d841529e0 0x7f2d840c5ed0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f2d84071d60 tx=0x7f2d7402a1e0 comp rx=0 tx=0).stop 2024-04-25T10:04:44.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.917+0000 7f2d88a09640 1 -- 172.21.15.7:0/796181646 shutdown_connections 2024-04-25T10:04:44.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.917+0000 7f2d88a09640 1 --2- 172.21.15.7:0/796181646 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d840cea60 0x7f2d8406d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:44.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.917+0000 7f2d88a09640 1 --2- 172.21.15.7:0/796181646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d841529e0 0x7f2d840c5ed0 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:44.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.917+0000 7f2d88a09640 1 -- 172.21.15.7:0/796181646 >> 172.21.15.7:0/796181646 conn(0x7f2d84071150 msgr2=0x7f2d84071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:44.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.917+0000 7f2d88a09640 1 -- 172.21.15.7:0/796181646 shutdown_connections 2024-04-25T10:04:44.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.917+0000 7f2d88a09640 1 -- 172.21.15.7:0/796181646 wait complete. 2024-04-25T10:04:44.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.918+0000 7f2d88a09640 1 Processor -- start 2024-04-25T10:04:44.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.918+0000 7f2d88a09640 1 -- start start 2024-04-25T10:04:44.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.919+0000 7f2d88a09640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d840c6410 0x7f2d84154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:44.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.919+0000 7f2d88a09640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d840cea60 0x7f2d840b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:44.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.919+0000 7f2d88a09640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d841f5550 0x7f2d840b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:44.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.919+0000 7f2d88a09640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d84071ed0 con 0x7f2d841f5550 2024-04-25T10:04:44.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.919+0000 7f2d88a09640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8415c900 con 0x7f2d840cea60 2024-04-25T10:04:44.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.919+0000 7f2d88a09640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d84072050 con 0x7f2d840c6410 2024-04-25T10:04:44.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.919+0000 7f2d82d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d841f5550 0x7f2d840b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:44.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.919+0000 7f2d82d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d841f5550 0x7f2d840b40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58236/0 (socket says 172.21.15.7:58236) 2024-04-25T10:04:44.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.919+0000 7f2d82d9d640 1 -- 172.21.15.7:0/3522713374 learned_addr learned my addr 172.21.15.7:0/3522713374 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:44.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.919+0000 7f2d7bfff640 1 --2- 172.21.15.7:0/3522713374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d840cea60 0x7f2d840b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:44.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.919+0000 7f2d82d9d640 1 -- 172.21.15.7:0/3522713374 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d840c6410 msgr2=0x7f2d84154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:44.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.919+0000 7f2d82d9d640 1 --2- 172.21.15.7:0/3522713374 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d840c6410 0x7f2d84154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:44.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.919+0000 7f2d82d9d640 1 -- 172.21.15.7:0/3522713374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d840cea60 msgr2=0x7f2d840b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:44.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.919+0000 7f2d82d9d640 1 --2- 172.21.15.7:0/3522713374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d840cea60 0x7f2d840b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:44.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.919+0000 7f2d82d9d640 1 -- 172.21.15.7:0/3522713374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d841f1340 con 0x7f2d841f5550 2024-04-25T10:04:44.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.919+0000 7f2d7bfff640 1 --2- 172.21.15.7:0/3522713374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d840cea60 0x7f2d840b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:44.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.919+0000 7f2d82d9d640 1 --2- 172.21.15.7:0/3522713374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d841f5550 0x7f2d840b40e0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c00cd10 tx=0x7f2d7c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:44.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.919+0000 7f2d7affd640 1 -- 172.21.15.7:0/3522713374 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c003b90 con 0x7f2d841f5550 2024-04-25T10:04:44.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.919+0000 7f2d7affd640 1 -- 172.21.15.7:0/3522713374 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7c003d50 con 0x7f2d841f5550 2024-04-25T10:04:44.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.920+0000 7f2d88a09640 1 -- 172.21.15.7:0/3522713374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d840b3170 con 0x7f2d841f5550 2024-04-25T10:04:44.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.920+0000 7f2d7affd640 1 -- 172.21.15.7:0/3522713374 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c004260 con 0x7f2d841f5550 2024-04-25T10:04:44.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.920+0000 7f2d88a09640 1 -- 172.21.15.7:0/3522713374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d84154b80 con 0x7f2d841f5550 2024-04-25T10:04:44.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.920+0000 7f2d88a09640 1 -- 172.21.15.7:0/3522713374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d84068fd0 con 0x7f2d841f5550 2024-04-25T10:04:44.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.921+0000 7f2d7affd640 1 -- 172.21.15.7:0/3522713374 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2d7c004400 con 0x7f2d841f5550 2024-04-25T10:04:44.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.921+0000 7f2d7affd640 1 --2- 172.21.15.7:0/3522713374 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d6406b500 0x7f2d6406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:44.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.921+0000 7f2d7affd640 1 -- 172.21.15.7:0/3522713374 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2d7c08ae30 con 0x7f2d841f5550 2024-04-25T10:04:44.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.921+0000 7f2d8259c640 1 --2- 172.21.15.7:0/3522713374 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d6406b500 0x7f2d6406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:44.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.922+0000 7f2d8259c640 1 --2- 172.21.15.7:0/3522713374 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d6406b500 0x7f2d6406d9c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f2d74034000 tx=0x7f2d7402c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:44.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:44.926+0000 7f2d7affd640 1 -- 172.21.15.7:0/3522713374 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2d7c014030 con 0x7f2d841f5550 2024-04-25T10:04:45.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.107+0000 7f2d88a09640 1 -- 172.21.15.7:0/3522713374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d840ce660 con 0x7f2d841f5550 2024-04-25T10:04:45.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.108+0000 7f2d7affd640 1 -- 172.21.15.7:0/3522713374 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+16856 (secure 0 0 0) 0x7f2d7c059a80 con 0x7f2d841f5550 2024-04-25T10:04:45.114 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:45.114 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":117,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:04:31.237000+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:04:27.856713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T10:04:28.566676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:45.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.110+0000 7f2d88a09640 1 -- 172.21.15.7:0/3522713374 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d6406b500 msgr2=0x7f2d6406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:45.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.110+0000 7f2d88a09640 1 --2- 172.21.15.7:0/3522713374 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d6406b500 0x7f2d6406d9c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f2d74034000 tx=0x7f2d7402c000 comp rx=0 tx=0).stop 2024-04-25T10:04:45.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.110+0000 7f2d88a09640 1 -- 172.21.15.7:0/3522713374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d841f5550 msgr2=0x7f2d840b40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:45.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.110+0000 7f2d88a09640 1 --2- 172.21.15.7:0/3522713374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d841f5550 0x7f2d840b40e0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c00cd10 tx=0x7f2d7c00a650 comp rx=0 tx=0).stop 2024-04-25T10:04:45.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.110+0000 7f2d88a09640 1 -- 172.21.15.7:0/3522713374 shutdown_connections 2024-04-25T10:04:45.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.110+0000 7f2d88a09640 1 --2- 172.21.15.7:0/3522713374 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d6406b500 0x7f2d6406d9c0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.110+0000 7f2d88a09640 1 --2- 172.21.15.7:0/3522713374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d841f5550 0x7f2d840b40e0 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.110+0000 7f2d88a09640 1 --2- 172.21.15.7:0/3522713374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d840cea60 0x7f2d840b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.110+0000 7f2d88a09640 1 --2- 172.21.15.7:0/3522713374 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d840c6410 0x7f2d84154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.110+0000 7f2d88a09640 1 -- 172.21.15.7:0/3522713374 >> 172.21.15.7:0/3522713374 conn(0x7f2d84071150 msgr2=0x7f2d84158bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:45.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.110+0000 7f2d88a09640 1 -- 172.21.15.7:0/3522713374 shutdown_connections 2024-04-25T10:04:45.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.110+0000 7f2d88a09640 1 -- 172.21.15.7:0/3522713374 wait complete. 2024-04-25T10:04:45.127 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:04:27.856713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:04:28.566676+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '117', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:04:45.127 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:04:45.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.225+0000 7f92c3534640 1 Processor -- start 2024-04-25T10:04:45.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.225+0000 7f92c3534640 1 -- start start 2024-04-25T10:04:45.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.226+0000 7f92c3534640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92bc143fb0 0x7f92bc0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.226+0000 7f92c3534640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f92bc0ced20 0x7f92bc06e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.226+0000 7f92c3534640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92bc0b2ee0 con 0x7f92bc06e240 2024-04-25T10:04:45.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.226+0000 7f92c3534640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92bc06ebe0 con 0x7f92bc0ced20 2024-04-25T10:04:45.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.226+0000 7f92c3534640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc0b3150 con 0x7f92bc143fb0 2024-04-25T10:04:45.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.227+0000 7f92c12d0640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92bc143fb0 0x7f92bc0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:45.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.227+0000 7f92c1ad1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f92bc0ced20 0x7f92bc06e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:45.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.227+0000 7f92c0acf640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f92bc06e240 0x7f92bc0ce610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:45588/0 (socket says 172.21.15.7:45588) 2024-04-25T10:04:45.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.227+0000 7f92c0acf640 1 -- 172.21.15.7:0/1688200630 learned_addr learned my addr 172.21.15.7:0/1688200630 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:45.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.227+0000 7f92bbfff640 1 -- 172.21.15.7:0/1688200630 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4006661124 0 0) 0x7f92bc0b2ee0 con 0x7f92bc06e240 2024-04-25T10:04:45.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.227+0000 7f92bbfff640 1 -- 172.21.15.7:0/1688200630 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92a4003520 con 0x7f92bc06e240 2024-04-25T10:04:45.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.227+0000 7f92c12d0640 1 -- 172.21.15.7:0/1688200630 >> v2:172.21.15.55:3300/0 conn(0x7f92bc0ced20 msgr2=0x7f92bc06e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:45.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.227+0000 7f92c12d0640 1 --2- 172.21.15.7:0/1688200630 >> v2:172.21.15.55:3300/0 conn(0x7f92bc0ced20 0x7f92bc06e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.227+0000 7f92c12d0640 1 -- 172.21.15.7:0/1688200630 >> v1:172.21.15.55:6789/0 conn(0x7f92bc06e240 legacy=0x7f92bc0ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:45.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.227+0000 7f92c12d0640 1 -- 172.21.15.7:0/1688200630 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92bc0b3430 con 0x7f92bc143fb0 2024-04-25T10:04:45.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.228+0000 7f92c12d0640 1 --2- 172.21.15.7:0/1688200630 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92bc143fb0 0x7f92bc0b3c30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f92b40097a0 tx=0x7f92b402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=131300c53ce39ecf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:45.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.228+0000 7f92bbfff640 1 -- 172.21.15.7:0/1688200630 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b4037070 con 0x7f92bc143fb0 2024-04-25T10:04:45.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.228+0000 7f92bbfff640 1 -- 172.21.15.7:0/1688200630 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b4032440 con 0x7f92bc143fb0 2024-04-25T10:04:45.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.228+0000 7f92bbfff640 1 -- 172.21.15.7:0/1688200630 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b40327f0 con 0x7f92bc143fb0 2024-04-25T10:04:45.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.228+0000 7f92c3534640 1 -- 172.21.15.7:0/1688200630 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92bc143fb0 msgr2=0x7f92bc0b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:45.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.228+0000 7f92c3534640 1 --2- 172.21.15.7:0/1688200630 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92bc143fb0 0x7f92bc0b3c30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f92b40097a0 tx=0x7f92b402a180 comp rx=0 tx=0).stop 2024-04-25T10:04:45.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.228+0000 7f92c3534640 1 -- 172.21.15.7:0/1688200630 shutdown_connections 2024-04-25T10:04:45.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.228+0000 7f92c3534640 1 --2- 172.21.15.7:0/1688200630 >> v2:172.21.15.55:3300/0 conn(0x7f92bc0ced20 0x7f92bc06e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.228+0000 7f92c3534640 1 --2- 172.21.15.7:0/1688200630 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92bc143fb0 0x7f92bc0b3c30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.229+0000 7f92c3534640 1 -- 172.21.15.7:0/1688200630 >> 172.21.15.7:0/1688200630 conn(0x7f92bc06ab60 msgr2=0x7f92bc06af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:45.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.229+0000 7f92c3534640 1 -- 172.21.15.7:0/1688200630 shutdown_connections 2024-04-25T10:04:45.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.229+0000 7f92c3534640 1 -- 172.21.15.7:0/1688200630 wait complete. 2024-04-25T10:04:45.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.230+0000 7f92c3534640 1 Processor -- start 2024-04-25T10:04:45.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.230+0000 7f92c3534640 1 -- start start 2024-04-25T10:04:45.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.230+0000 7f92c3534640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92bc06e240 0x7f92bc13f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.230+0000 7f92c3534640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92bc0ced20 0x7f92bc13bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.230+0000 7f92c3534640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92bc143fb0 0x7f92bc15c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.230+0000 7f92c3534640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc0cf2f0 con 0x7f92bc143fb0 2024-04-25T10:04:45.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.231+0000 7f92c3534640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc144390 con 0x7f92bc06e240 2024-04-25T10:04:45.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.231+0000 7f92c3534640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc15ac70 con 0x7f92bc0ced20 2024-04-25T10:04:45.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.231+0000 7f92c1ad1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92bc143fb0 0x7f92bc15c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:45.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.231+0000 7f92c1ad1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92bc143fb0 0x7f92bc15c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58246/0 (socket says 172.21.15.7:58246) 2024-04-25T10:04:45.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.231+0000 7f92c1ad1640 1 -- 172.21.15.7:0/821484589 learned_addr learned my addr 172.21.15.7:0/821484589 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:45.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.231+0000 7f92c12d0640 1 --2- 172.21.15.7:0/821484589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92bc06e240 0x7f92bc13f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:45.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.231+0000 7f92c0acf640 1 --2- 172.21.15.7:0/821484589 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92bc0ced20 0x7f92bc13bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:45.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.231+0000 7f92c1ad1640 1 -- 172.21.15.7:0/821484589 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92bc0ced20 msgr2=0x7f92bc13bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:45.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.231+0000 7f92c1ad1640 1 --2- 172.21.15.7:0/821484589 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92bc0ced20 0x7f92bc13bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.231+0000 7f92c1ad1640 1 -- 172.21.15.7:0/821484589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92bc06e240 msgr2=0x7f92bc13f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:45.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.231+0000 7f92c1ad1640 1 --2- 172.21.15.7:0/821484589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92bc06e240 0x7f92bc13f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.231+0000 7f92c1ad1640 1 -- 172.21.15.7:0/821484589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92bc13c9a0 con 0x7f92bc143fb0 2024-04-25T10:04:45.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.231+0000 7f92c12d0640 1 --2- 172.21.15.7:0/821484589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92bc06e240 0x7f92bc13f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:45.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.231+0000 7f92c1ad1640 1 --2- 172.21.15.7:0/821484589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92bc143fb0 0x7f92bc15c6e0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f92ac00efc0 tx=0x7f92ac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:45.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.231+0000 7f92b9ffb640 1 -- 172.21.15.7:0/821484589 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac018020 con 0x7f92bc143fb0 2024-04-25T10:04:45.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.231+0000 7f92b9ffb640 1 -- 172.21.15.7:0/821484589 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ac014480 con 0x7f92bc143fb0 2024-04-25T10:04:45.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.231+0000 7f92c3534640 1 -- 172.21.15.7:0/821484589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92bc13e7f0 con 0x7f92bc143fb0 2024-04-25T10:04:45.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.231+0000 7f92b9ffb640 1 -- 172.21.15.7:0/821484589 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac014870 con 0x7f92bc143fb0 2024-04-25T10:04:45.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.232+0000 7f92c3534640 1 -- 172.21.15.7:0/821484589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92bc13edb0 con 0x7f92bc143fb0 2024-04-25T10:04:45.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.233+0000 7f92c3534640 1 -- 172.21.15.7:0/821484589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92bc13efb0 con 0x7f92bc143fb0 2024-04-25T10:04:45.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.233+0000 7f92b9ffb640 1 -- 172.21.15.7:0/821484589 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f92ac005d10 con 0x7f92bc143fb0 2024-04-25T10:04:45.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.234+0000 7f92b9ffb640 1 --2- 172.21.15.7:0/821484589 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f92a806b4d0 0x7f92a806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.234+0000 7f92b9ffb640 1 -- 172.21.15.7:0/821484589 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f92ac08b0e0 con 0x7f92bc143fb0 2024-04-25T10:04:45.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.234+0000 7f92c12d0640 1 --2- 172.21.15.7:0/821484589 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f92a806b4d0 0x7f92a806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:45.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.234+0000 7f92c12d0640 1 --2- 172.21.15.7:0/821484589 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f92a806b4d0 0x7f92a806d990 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f92b4034000 tx=0x7f92b402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:45.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.238+0000 7f92b9ffb640 1 -- 172.21.15.7:0/821484589 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f92bc13efb0 con 0x7f92bc143fb0 2024-04-25T10:04:45.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.421+0000 7f92c3534640 1 -- 172.21.15.7:0/821484589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f92bc068f60 con 0x7f92bc143fb0 2024-04-25T10:04:45.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.421+0000 7f92b9ffb640 1 -- 172.21.15.7:0/821484589 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v117) v1 ==== 93+0+10 (secure 0 0 0) 0x7f92ac022030 con 0x7f92bc143fb0 2024-04-25T10:04:45.427 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T10:04:45.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.423+0000 7f92c3534640 1 -- 172.21.15.7:0/821484589 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f92a806b4d0 msgr2=0x7f92a806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:45.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.423+0000 7f92c3534640 1 --2- 172.21.15.7:0/821484589 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f92a806b4d0 0x7f92a806d990 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f92b4034000 tx=0x7f92b402e000 comp rx=0 tx=0).stop 2024-04-25T10:04:45.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.423+0000 7f92c3534640 1 -- 172.21.15.7:0/821484589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92bc143fb0 msgr2=0x7f92bc15c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:45.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.423+0000 7f92c3534640 1 --2- 172.21.15.7:0/821484589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92bc143fb0 0x7f92bc15c6e0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f92ac00efc0 tx=0x7f92ac00c490 comp rx=0 tx=0).stop 2024-04-25T10:04:45.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.423+0000 7f92c3534640 1 -- 172.21.15.7:0/821484589 shutdown_connections 2024-04-25T10:04:45.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.423+0000 7f92c3534640 1 --2- 172.21.15.7:0/821484589 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f92a806b4d0 0x7f92a806d990 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.423+0000 7f92c3534640 1 --2- 172.21.15.7:0/821484589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92bc143fb0 0x7f92bc15c6e0 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.423+0000 7f92c3534640 1 --2- 172.21.15.7:0/821484589 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f92bc0ced20 0x7f92bc13bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.423+0000 7f92c3534640 1 --2- 172.21.15.7:0/821484589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92bc06e240 0x7f92bc13f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.423+0000 7f92c3534640 1 -- 172.21.15.7:0/821484589 >> 172.21.15.7:0/821484589 conn(0x7f92bc06ab60 msgr2=0x7f92bc0b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:45.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.423+0000 7f92c3534640 1 -- 172.21.15.7:0/821484589 shutdown_connections 2024-04-25T10:04:45.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.423+0000 7f92c3534640 1 -- 172.21.15.7:0/821484589 wait complete. 2024-04-25T10:04:45.439 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:04:45.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.538+0000 7f3bfde91640 1 Processor -- start 2024-04-25T10:04:45.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.538+0000 7f3bfde91640 1 -- start start 2024-04-25T10:04:45.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.539+0000 7f3bfde91640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3bf80b78c0 0x7f3bf81685d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.539+0000 7f3bfde91640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf80b7ef0 con 0x7f3bf80d0780 2024-04-25T10:04:45.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.539+0000 7f3bfde91640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf80b81d0 con 0x7f3bf80d2c40 2024-04-25T10:04:45.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.539+0000 7f3bfde91640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf80b9840 con 0x7f3bf80b78c0 2024-04-25T10:04:45.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.539+0000 7f3bf77fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3bf80d0780 0x7f3bf80d0b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39364/0 (socket says 172.21.15.7:39364) 2024-04-25T10:04:45.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.539+0000 7f3bf77fe640 1 -- 172.21.15.7:0/2360678006 learned_addr learned my addr 172.21.15.7:0/2360678006 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:45.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.539+0000 7f3bf67fc640 1 -- 172.21.15.7:0/2360678006 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3028593867 0 0) 0x7f3bf80b7ef0 con 0x7f3bf80d0780 2024-04-25T10:04:45.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.539+0000 7f3bf67fc640 1 -- 172.21.15.7:0/2360678006 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3be0003520 con 0x7f3bf80d0780 2024-04-25T10:04:45.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.539+0000 7f3bf7fff640 1 --2- 172.21.15.7:0/2360678006 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3bf80b78c0 0x7f3bf81685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:45.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.539+0000 7f3bf67fc640 1 -- 172.21.15.7:0/2360678006 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2658429624 0 0) 0x7f3be0003520 con 0x7f3bf80d0780 2024-04-25T10:04:45.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.539+0000 7f3bf67fc640 1 -- 172.21.15.7:0/2360678006 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3bf80b78c0 msgr2=0x7f3bf81685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:45.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.539+0000 7f3bf67fc640 1 --2- 172.21.15.7:0/2360678006 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3bf80b78c0 0x7f3bf81685d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.539+0000 7f3bf67fc640 1 -- 172.21.15.7:0/2360678006 >> v1:172.21.15.55:6789/0 conn(0x7f3bf80d2c40 legacy=0x7f3bf80b9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:45.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.539+0000 7f3bf67fc640 1 -- 172.21.15.7:0/2360678006 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf80b84b0 con 0x7f3bf80d0780 2024-04-25T10:04:45.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.539+0000 7f3bf67fc640 1 -- 172.21.15.7:0/2360678006 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f3be8001670 con 0x7f3bf80d0780 2024-04-25T10:04:45.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.539+0000 7f3bf7fff640 1 --2- 172.21.15.7:0/2360678006 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3bf80b78c0 0x7f3bf81685d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:45.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.539+0000 7f3bf67fc640 1 -- 172.21.15.7:0/2360678006 >> v1:172.21.15.7:6789/0 conn(0x7f3bf80d0780 legacy=0x7f3bf80d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:45.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.539+0000 7f3bf67fc640 1 --2- 172.21.15.7:0/2360678006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3be00039e0 0x7f3be0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.539+0000 7f3bf67fc640 1 --2- 172.21.15.7:0/2360678006 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3bf80b78c0 0x7f3be0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.539+0000 7f3bf67fc640 1 --2- 172.21.15.7:0/2360678006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3be0004d40 0x7f3be00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.539+0000 7f3bf67fc640 1 -- 172.21.15.7:0/2360678006 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf80b9840 con 0x7f3be00039e0 2024-04-25T10:04:45.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.539+0000 7f3bf67fc640 1 -- 172.21.15.7:0/2360678006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be000bb00 con 0x7f3be0004d40 2024-04-25T10:04:45.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.539+0000 7f3bf67fc640 1 -- 172.21.15.7:0/2360678006 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be000bd00 con 0x7f3bf80b78c0 2024-04-25T10:04:45.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.540+0000 7f3bf77fe640 1 --2- 172.21.15.7:0/2360678006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3be00039e0 0x7f3be0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:45.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.540+0000 7f3bf7fff640 1 --2- 172.21.15.7:0/2360678006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3be0004d40 0x7f3be00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:45.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.540+0000 7f3bf6ffd640 1 --2- 172.21.15.7:0/2360678006 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3bf80b78c0 0x7f3be0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:45.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.540+0000 7f3bf77fe640 1 -- 172.21.15.7:0/2360678006 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3bf80b78c0 msgr2=0x7f3be0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:45.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.540+0000 7f3bf77fe640 1 --2- 172.21.15.7:0/2360678006 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3bf80b78c0 0x7f3be0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.540+0000 7f3bf77fe640 1 -- 172.21.15.7:0/2360678006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3be0004d40 msgr2=0x7f3be00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:45.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.540+0000 7f3bf77fe640 1 --2- 172.21.15.7:0/2360678006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3be0004d40 0x7f3be00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.540+0000 7f3bf77fe640 1 -- 172.21.15.7:0/2360678006 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be0003520 con 0x7f3be00039e0 2024-04-25T10:04:45.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.541+0000 7f3bf77fe640 1 --2- 172.21.15.7:0/2360678006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3be00039e0 0x7f3be0003e00 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f3be8001eb0 tx=0x7f3be0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaaee586d60630e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:45.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.541+0000 7f3bf67fc640 1 -- 172.21.15.7:0/2360678006 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be8007d30 con 0x7f3be00039e0 2024-04-25T10:04:45.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.541+0000 7f3bf67fc640 1 -- 172.21.15.7:0/2360678006 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be8005af0 con 0x7f3be00039e0 2024-04-25T10:04:45.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.541+0000 7f3bf67fc640 1 -- 172.21.15.7:0/2360678006 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be8007070 con 0x7f3be00039e0 2024-04-25T10:04:45.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.541+0000 7f3bfde91640 1 -- 172.21.15.7:0/2360678006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3be00039e0 msgr2=0x7f3be0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:45.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.541+0000 7f3bfde91640 1 --2- 172.21.15.7:0/2360678006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3be00039e0 0x7f3be0003e00 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f3be8001eb0 tx=0x7f3be0005830 comp rx=0 tx=0).stop 2024-04-25T10:04:45.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.541+0000 7f3bf7fff640 1 -- 172.21.15.7:0/2360678006 reap_dead start 2024-04-25T10:04:45.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.541+0000 7f3bfde91640 1 -- 172.21.15.7:0/2360678006 shutdown_connections 2024-04-25T10:04:45.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.541+0000 7f3bfde91640 1 -- 172.21.15.7:0/2360678006 >> 172.21.15.7:0/2360678006 conn(0x7f3bf80726b0 msgr2=0x7f3bf8072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:45.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.541+0000 7f3bfde91640 1 -- 172.21.15.7:0/2360678006 shutdown_connections 2024-04-25T10:04:45.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.541+0000 7f3bfde91640 1 -- 172.21.15.7:0/2360678006 wait complete. 2024-04-25T10:04:45.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.542+0000 7f3bfde91640 1 Processor -- start 2024-04-25T10:04:45.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.543+0000 7f3bfde91640 1 -- start start 2024-04-25T10:04:45.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.543+0000 7f3bfde91640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3be00039e0 0x7f3bf80cab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.543+0000 7f3bfde91640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bf80ccd00 0x7f3bf815e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.543+0000 7f3bfde91640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3bf80c7da0 0x7f3bf80c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.543+0000 7f3bfde91640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf81611b0 con 0x7f3be00039e0 2024-04-25T10:04:45.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.543+0000 7f3bfde91640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf80b8a70 con 0x7f3bf80ccd00 2024-04-25T10:04:45.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.543+0000 7f3bfde91640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf8161330 con 0x7f3bf80c7da0 2024-04-25T10:04:45.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.543+0000 7f3bf77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3be00039e0 0x7f3bf80cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:45.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.543+0000 7f3bf77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3be00039e0 0x7f3bf80cab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58260/0 (socket says 172.21.15.7:58260) 2024-04-25T10:04:45.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.543+0000 7f3bf77fe640 1 -- 172.21.15.7:0/2122312467 learned_addr learned my addr 172.21.15.7:0/2122312467 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:45.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.544+0000 7f3bf77fe640 1 -- 172.21.15.7:0/2122312467 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3bf80c7da0 msgr2=0x7f3bf80c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:45.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.544+0000 7f3bf77fe640 1 --2- 172.21.15.7:0/2122312467 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3bf80c7da0 0x7f3bf80c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.544+0000 7f3bf77fe640 1 -- 172.21.15.7:0/2122312467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bf80ccd00 msgr2=0x7f3bf815e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:45.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.544+0000 7f3bf77fe640 1 --2- 172.21.15.7:0/2122312467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bf80ccd00 0x7f3bf815e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.544+0000 7f3bf77fe640 1 -- 172.21.15.7:0/2122312467 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf815ea10 con 0x7f3be00039e0 2024-04-25T10:04:45.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.544+0000 7f3bf77fe640 1 --2- 172.21.15.7:0/2122312467 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3be00039e0 0x7f3bf80cab60 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f3be802ad20 tx=0x7f3be8001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:45.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.544+0000 7f3bdffff640 1 -- 172.21.15.7:0/2122312467 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be8001630 con 0x7f3be00039e0 2024-04-25T10:04:45.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.544+0000 7f3bdffff640 1 -- 172.21.15.7:0/2122312467 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be8042070 con 0x7f3be00039e0 2024-04-25T10:04:45.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.544+0000 7f3bfde91640 1 -- 172.21.15.7:0/2122312467 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf815ecf0 con 0x7f3be00039e0 2024-04-25T10:04:45.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.544+0000 7f3bdffff640 1 -- 172.21.15.7:0/2122312467 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be8007270 con 0x7f3be00039e0 2024-04-25T10:04:45.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.544+0000 7f3bfde91640 1 -- 172.21.15.7:0/2122312467 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf815f2b0 con 0x7f3be00039e0 2024-04-25T10:04:45.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.545+0000 7f3bfde91640 1 -- 172.21.15.7:0/2122312467 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf80685d0 con 0x7f3be00039e0 2024-04-25T10:04:45.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.545+0000 7f3bdffff640 1 -- 172.21.15.7:0/2122312467 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3be8007410 con 0x7f3be00039e0 2024-04-25T10:04:45.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.546+0000 7f3bdffff640 1 --2- 172.21.15.7:0/2122312467 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3be406b500 0x7f3be406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.546+0000 7f3bdffff640 1 -- 172.21.15.7:0/2122312467 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3be80aa480 con 0x7f3be00039e0 2024-04-25T10:04:45.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.546+0000 7f3bf6ffd640 1 --2- 172.21.15.7:0/2122312467 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3be406b500 0x7f3be406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:45.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.546+0000 7f3bf6ffd640 1 --2- 172.21.15.7:0/2122312467 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3be406b500 0x7f3be406d9c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80cc8d0 tx=0x7f3bec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:45.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.550+0000 7f3bdffff640 1 -- 172.21.15.7:0/2122312467 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3be8079290 con 0x7f3be00039e0 2024-04-25T10:04:45.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.729+0000 7f3bfde91640 1 -- 172.21.15.7:0/2122312467 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3bf8068f60 con 0x7f3be00039e0 2024-04-25T10:04:45.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.729+0000 7f3bdffff640 1 -- 172.21.15.7:0/2122312467 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v117) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3be8078b90 con 0x7f3be00039e0 2024-04-25T10:04:45.735 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T10:04:45.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.731+0000 7f3bfde91640 1 -- 172.21.15.7:0/2122312467 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3be406b500 msgr2=0x7f3be406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:45.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.731+0000 7f3bfde91640 1 --2- 172.21.15.7:0/2122312467 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3be406b500 0x7f3be406d9c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80cc8d0 tx=0x7f3bec009040 comp rx=0 tx=0).stop 2024-04-25T10:04:45.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.731+0000 7f3bfde91640 1 -- 172.21.15.7:0/2122312467 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3be00039e0 msgr2=0x7f3bf80cab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:45.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.731+0000 7f3bfde91640 1 --2- 172.21.15.7:0/2122312467 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3be00039e0 0x7f3bf80cab60 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f3be802ad20 tx=0x7f3be8001a40 comp rx=0 tx=0).stop 2024-04-25T10:04:45.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.731+0000 7f3bfde91640 1 -- 172.21.15.7:0/2122312467 shutdown_connections 2024-04-25T10:04:45.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.731+0000 7f3bfde91640 1 --2- 172.21.15.7:0/2122312467 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3be406b500 0x7f3be406d9c0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.731+0000 7f3bfde91640 1 --2- 172.21.15.7:0/2122312467 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3bf80c7da0 0x7f3bf80c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.731+0000 7f3bfde91640 1 --2- 172.21.15.7:0/2122312467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bf80ccd00 0x7f3bf815e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.731+0000 7f3bfde91640 1 --2- 172.21.15.7:0/2122312467 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3be00039e0 0x7f3bf80cab60 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.731+0000 7f3bfde91640 1 -- 172.21.15.7:0/2122312467 >> 172.21.15.7:0/2122312467 conn(0x7f3bf80726b0 msgr2=0x7f3bf80ce280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:45.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.731+0000 7f3bfde91640 1 -- 172.21.15.7:0/2122312467 shutdown_connections 2024-04-25T10:04:45.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.731+0000 7f3bfde91640 1 -- 172.21.15.7:0/2122312467 wait complete. 2024-04-25T10:04:45.747 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:04:45.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.846+0000 7fd3563db640 1 Processor -- start 2024-04-25T10:04:45.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.846+0000 7fd3563db640 1 -- start start 2024-04-25T10:04:45.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.847+0000 7fd3563db640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd3500d2c40 0x7fd3500b9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.847+0000 7fd3563db640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd3500b68b0 0x7fd3500b6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.847+0000 7fd3563db640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3500b7ef0 con 0x7fd3500d0780 2024-04-25T10:04:45.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.847+0000 7fd3563db640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3500b81d0 con 0x7fd3500d2c40 2024-04-25T10:04:45.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.847+0000 7fd3563db640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3500b84b0 con 0x7fd3500b68b0 2024-04-25T10:04:45.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.847+0000 7fd34f7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd3500d2c40 0x7fd3500b9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:45.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.847+0000 7fd34f7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd3500d2c40 0x7fd3500b9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58276/0 (socket says 172.21.15.7:58276) 2024-04-25T10:04:45.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.847+0000 7fd34f7fe640 1 -- 172.21.15.7:0/1682818633 learned_addr learned my addr 172.21.15.7:0/1682818633 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:45.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.847+0000 7fd34f7fe640 1 -- 172.21.15.7:0/1682818633 >> v2:172.21.15.55:3300/0 conn(0x7fd3500b68b0 msgr2=0x7fd3500b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:45.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.847+0000 7fd34f7fe640 1 --2- 172.21.15.7:0/1682818633 >> v2:172.21.15.55:3300/0 conn(0x7fd3500b68b0 0x7fd3500b6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.847+0000 7fd34f7fe640 1 -- 172.21.15.7:0/1682818633 >> v1:172.21.15.55:6789/0 conn(0x7fd3500d0780 legacy=0x7fd3500d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:45.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.847+0000 7fd34f7fe640 1 -- 172.21.15.7:0/1682818633 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3500b8790 con 0x7fd3500d2c40 2024-04-25T10:04:45.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.848+0000 7fd34f7fe640 1 --2- 172.21.15.7:0/1682818633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3500d2c40 0x7fd3500b9130 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7fd3500b63f0 tx=0x7fd34402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ecb31e5415c421 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:45.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.848+0000 7fd34effd640 1 -- 172.21.15.7:0/1682818633 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd344037070 con 0x7fd3500d2c40 2024-04-25T10:04:45.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.848+0000 7fd34effd640 1 -- 172.21.15.7:0/1682818633 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd344032440 con 0x7fd3500d2c40 2024-04-25T10:04:45.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.848+0000 7fd34effd640 1 -- 172.21.15.7:0/1682818633 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd344032810 con 0x7fd3500d2c40 2024-04-25T10:04:45.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.848+0000 7fd3563db640 1 -- 172.21.15.7:0/1682818633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3500d2c40 msgr2=0x7fd3500b9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:45.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.848+0000 7fd3563db640 1 --2- 172.21.15.7:0/1682818633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3500d2c40 0x7fd3500b9130 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7fd3500b63f0 tx=0x7fd34402a230 comp rx=0 tx=0).stop 2024-04-25T10:04:45.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.849+0000 7fd3563db640 1 -- 172.21.15.7:0/1682818633 shutdown_connections 2024-04-25T10:04:45.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.849+0000 7fd3563db640 1 --2- 172.21.15.7:0/1682818633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3500d2c40 0x7fd3500b9130 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.849+0000 7fd3563db640 1 --2- 172.21.15.7:0/1682818633 >> v2:172.21.15.55:3300/0 conn(0x7fd3500b68b0 0x7fd3500b6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.849+0000 7fd3563db640 1 -- 172.21.15.7:0/1682818633 >> 172.21.15.7:0/1682818633 conn(0x7fd3500726b0 msgr2=0x7fd350072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:45.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.849+0000 7fd3563db640 1 -- 172.21.15.7:0/1682818633 shutdown_connections 2024-04-25T10:04:45.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.849+0000 7fd3563db640 1 -- 172.21.15.7:0/1682818633 wait complete. 2024-04-25T10:04:45.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.850+0000 7fd3563db640 1 Processor -- start 2024-04-25T10:04:45.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.850+0000 7fd3563db640 1 -- start start 2024-04-25T10:04:45.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.851+0000 7fd3563db640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3500b68b0 0x7fd350150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.851+0000 7fd3563db640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd3500d0780 0x7fd3500cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.851+0000 7fd3563db640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3500d2c40 0x7fd3500c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.851+0000 7fd3563db640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3500b97f0 con 0x7fd3500b68b0 2024-04-25T10:04:45.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.851+0000 7fd3563db640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3500b9670 con 0x7fd3500d2c40 2024-04-25T10:04:45.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.851+0000 7fd3563db640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3501611b0 con 0x7fd3500d0780 2024-04-25T10:04:45.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.851+0000 7fd34ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3500b68b0 0x7fd350150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:45.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.851+0000 7fd34ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3500b68b0 0x7fd350150d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58280/0 (socket says 172.21.15.7:58280) 2024-04-25T10:04:45.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.851+0000 7fd34ffff640 1 -- 172.21.15.7:0/1348974183 learned_addr learned my addr 172.21.15.7:0/1348974183 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:45.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.851+0000 7fd34ffff640 1 -- 172.21.15.7:0/1348974183 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd3500d0780 msgr2=0x7fd3500cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:45.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.851+0000 7fd34ffff640 1 --2- 172.21.15.7:0/1348974183 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd3500d0780 0x7fd3500cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.851+0000 7fd34ffff640 1 -- 172.21.15.7:0/1348974183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3500d2c40 msgr2=0x7fd3500c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:45.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.851+0000 7fd34ffff640 1 --2- 172.21.15.7:0/1348974183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3500d2c40 0x7fd3500c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.851+0000 7fd34ffff640 1 -- 172.21.15.7:0/1348974183 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3501e6bd0 con 0x7fd3500b68b0 2024-04-25T10:04:45.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.851+0000 7fd34ffff640 1 --2- 172.21.15.7:0/1348974183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3500b68b0 0x7fd350150d00 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7fd34000c410 tx=0x7fd34000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:45.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.851+0000 7fd34cff9640 1 -- 172.21.15.7:0/1348974183 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd340017070 con 0x7fd3500b68b0 2024-04-25T10:04:45.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.852+0000 7fd34cff9640 1 -- 172.21.15.7:0/1348974183 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3400035f0 con 0x7fd3500b68b0 2024-04-25T10:04:45.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.852+0000 7fd3563db640 1 -- 172.21.15.7:0/1348974183 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3501e6eb0 con 0x7fd3500b68b0 2024-04-25T10:04:45.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.852+0000 7fd34cff9640 1 -- 172.21.15.7:0/1348974183 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd340003a20 con 0x7fd3500b68b0 2024-04-25T10:04:45.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.852+0000 7fd3563db640 1 -- 172.21.15.7:0/1348974183 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3501e7470 con 0x7fd3500b68b0 2024-04-25T10:04:45.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.853+0000 7fd3563db640 1 -- 172.21.15.7:0/1348974183 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3500685d0 con 0x7fd3500b68b0 2024-04-25T10:04:45.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.853+0000 7fd34cff9640 1 -- 172.21.15.7:0/1348974183 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd34001a070 con 0x7fd3500b68b0 2024-04-25T10:04:45.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.853+0000 7fd34cff9640 1 --2- 172.21.15.7:0/1348974183 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd33c06b4d0 0x7fd33c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.853+0000 7fd34cff9640 1 -- 172.21.15.7:0/1348974183 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd3400898c0 con 0x7fd3500b68b0 2024-04-25T10:04:45.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.853+0000 7fd34f7fe640 1 --2- 172.21.15.7:0/1348974183 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd33c06b4d0 0x7fd33c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:45.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.854+0000 7fd34f7fe640 1 --2- 172.21.15.7:0/1348974183 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd33c06b4d0 0x7fd33c06d990 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fd344034000 tx=0x7fd34402c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:45.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:45.858+0000 7fd34cff9640 1 -- 172.21.15.7:0/1348974183 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd3400585b0 con 0x7fd3500b68b0 2024-04-25T10:04:46.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.037+0000 7fd3563db640 1 -- 172.21.15.7:0/1348974183 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd35015f2a0 con 0x7fd3500b68b0 2024-04-25T10:04:46.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.037+0000 7fd34cff9640 1 -- 172.21.15.7:0/1348974183 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v117) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd340057eb0 con 0x7fd3500b68b0 2024-04-25T10:04:46.043 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T10:04:46.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.039+0000 7fd3563db640 1 -- 172.21.15.7:0/1348974183 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd33c06b4d0 msgr2=0x7fd33c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:46.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.039+0000 7fd3563db640 1 --2- 172.21.15.7:0/1348974183 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd33c06b4d0 0x7fd33c06d990 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fd344034000 tx=0x7fd34402c000 comp rx=0 tx=0).stop 2024-04-25T10:04:46.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.039+0000 7fd3563db640 1 -- 172.21.15.7:0/1348974183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3500b68b0 msgr2=0x7fd350150d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:46.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.039+0000 7fd3563db640 1 --2- 172.21.15.7:0/1348974183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3500b68b0 0x7fd350150d00 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7fd34000c410 tx=0x7fd34000c8d0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.039+0000 7fd3563db640 1 -- 172.21.15.7:0/1348974183 shutdown_connections 2024-04-25T10:04:46.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.039+0000 7fd3563db640 1 --2- 172.21.15.7:0/1348974183 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd33c06b4d0 0x7fd33c06d990 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.039+0000 7fd3563db640 1 --2- 172.21.15.7:0/1348974183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3500d2c40 0x7fd3500c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.039+0000 7fd3563db640 1 --2- 172.21.15.7:0/1348974183 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd3500d0780 0x7fd3500cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.039+0000 7fd3563db640 1 --2- 172.21.15.7:0/1348974183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3500b68b0 0x7fd350150d00 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.039+0000 7fd3563db640 1 -- 172.21.15.7:0/1348974183 >> 172.21.15.7:0/1348974183 conn(0x7fd3500726b0 msgr2=0x7fd3500b7700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:46.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.040+0000 7fd3563db640 1 -- 172.21.15.7:0/1348974183 shutdown_connections 2024-04-25T10:04:46.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.040+0000 7fd3563db640 1 -- 172.21.15.7:0/1348974183 wait complete. 2024-04-25T10:04:46.056 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:04:46.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.152+0000 7ff034e8f640 1 Processor -- start 2024-04-25T10:04:46.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.152+0000 7ff034e8f640 1 -- start start 2024-04-25T10:04:46.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.153+0000 7ff034e8f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff03006e970 0x7ff0300cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:46.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.153+0000 7ff034e8f640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0300cdbf0 con 0x7ff030144100 2024-04-25T10:04:46.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.153+0000 7ff034e8f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0300cded0 con 0x7ff0300ced20 2024-04-25T10:04:46.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.153+0000 7ff034e8f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0301444e0 con 0x7ff03006e970 2024-04-25T10:04:46.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.153+0000 7ff02e59c640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff030144100 0x7ff03006e260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:39374/0 (socket says 172.21.15.7:39374) 2024-04-25T10:04:46.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.153+0000 7ff02e59c640 1 -- 172.21.15.7:0/377589669 learned_addr learned my addr 172.21.15.7:0/377589669 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:46.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.153+0000 7ff02dd9b640 1 --2- 172.21.15.7:0/377589669 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff03006e970 0x7ff0300cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:46.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.153+0000 7ff02d59a640 1 -- 172.21.15.7:0/377589669 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1057990478 0 0) 0x7ff0300cdbf0 con 0x7ff030144100 2024-04-25T10:04:46.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.153+0000 7ff02d59a640 1 -- 172.21.15.7:0/377589669 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff018003520 con 0x7ff030144100 2024-04-25T10:04:46.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.153+0000 7ff02d59a640 1 -- 172.21.15.7:0/377589669 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 266034567 0 0) 0x7ff0300cded0 con 0x7ff0300ced20 2024-04-25T10:04:46.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.153+0000 7ff02d59a640 1 -- 172.21.15.7:0/377589669 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0300cdbf0 con 0x7ff0300ced20 2024-04-25T10:04:46.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.153+0000 7ff02dd9b640 1 -- 172.21.15.7:0/377589669 >> v1:172.21.15.55:6789/0 conn(0x7ff0300ced20 legacy=0x7ff03015b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:46.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.153+0000 7ff02dd9b640 1 -- 172.21.15.7:0/377589669 >> v1:172.21.15.7:6789/0 conn(0x7ff030144100 legacy=0x7ff03006e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:46.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.153+0000 7ff02dd9b640 1 -- 172.21.15.7:0/377589669 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0300ce1b0 con 0x7ff03006e970 2024-04-25T10:04:46.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.154+0000 7ff02dd9b640 1 --2- 172.21.15.7:0/377589669 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff03006e970 0x7ff0300cd610 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff0240097d0 tx=0x7ff02402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1e19d3a5eaf2610 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:46.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.154+0000 7ff02d59a640 1 -- 172.21.15.7:0/377589669 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff024037070 con 0x7ff03006e970 2024-04-25T10:04:46.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.154+0000 7ff02d59a640 1 -- 172.21.15.7:0/377589669 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff024032440 con 0x7ff03006e970 2024-04-25T10:04:46.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.154+0000 7ff02d59a640 1 -- 172.21.15.7:0/377589669 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff024032810 con 0x7ff03006e970 2024-04-25T10:04:46.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.155+0000 7ff034e8f640 1 -- 172.21.15.7:0/377589669 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff03006e970 msgr2=0x7ff0300cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:46.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.155+0000 7ff034e8f640 1 --2- 172.21.15.7:0/377589669 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff03006e970 0x7ff0300cd610 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff0240097d0 tx=0x7ff02402a210 comp rx=0 tx=0).stop 2024-04-25T10:04:46.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.155+0000 7ff034e8f640 1 -- 172.21.15.7:0/377589669 shutdown_connections 2024-04-25T10:04:46.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.155+0000 7ff034e8f640 1 --2- 172.21.15.7:0/377589669 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff03006e970 0x7ff0300cd610 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.155+0000 7ff034e8f640 1 -- 172.21.15.7:0/377589669 >> 172.21.15.7:0/377589669 conn(0x7ff030071150 msgr2=0x7ff030071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:46.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.155+0000 7ff034e8f640 1 -- 172.21.15.7:0/377589669 shutdown_connections 2024-04-25T10:04:46.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.155+0000 7ff034e8f640 1 -- 172.21.15.7:0/377589669 wait complete. 2024-04-25T10:04:46.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.156+0000 7ff034e8f640 1 Processor -- start 2024-04-25T10:04:46.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.156+0000 7ff034e8f640 1 -- start start 2024-04-25T10:04:46.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.157+0000 7ff034e8f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff03006e970 0x7ff03013bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:46.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.157+0000 7ff034e8f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0300ced20 0x7ff03014d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:46.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.157+0000 7ff034e8f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff030144100 0x7ff03014e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:46.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.157+0000 7ff034e8f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0300cea00 con 0x7ff03006e970 2024-04-25T10:04:46.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.157+0000 7ff034e8f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03015ac70 con 0x7ff0300ced20 2024-04-25T10:04:46.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.157+0000 7ff034e8f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff03015b840 con 0x7ff030144100 2024-04-25T10:04:46.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.157+0000 7ff02e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff03006e970 0x7ff03013bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:46.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.157+0000 7ff02e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff03006e970 0x7ff03013bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58282/0 (socket says 172.21.15.7:58282) 2024-04-25T10:04:46.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.157+0000 7ff02e59c640 1 -- 172.21.15.7:0/1938171231 learned_addr learned my addr 172.21.15.7:0/1938171231 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:46.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.157+0000 7ff02dd9b640 1 --2- 172.21.15.7:0/1938171231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0300ced20 0x7ff03014d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:46.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.157+0000 7ff02ed9d640 1 --2- 172.21.15.7:0/1938171231 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff030144100 0x7ff03014e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:46.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.157+0000 7ff02e59c640 1 -- 172.21.15.7:0/1938171231 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff030144100 msgr2=0x7ff03014e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:46.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.157+0000 7ff02e59c640 1 --2- 172.21.15.7:0/1938171231 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff030144100 0x7ff03014e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.157+0000 7ff02e59c640 1 -- 172.21.15.7:0/1938171231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0300ced20 msgr2=0x7ff03014d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:46.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.157+0000 7ff02e59c640 1 --2- 172.21.15.7:0/1938171231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0300ced20 0x7ff03014d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.157+0000 7ff02e59c640 1 -- 172.21.15.7:0/1938171231 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0300cbea0 con 0x7ff03006e970 2024-04-25T10:04:46.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.158+0000 7ff02e59c640 1 --2- 172.21.15.7:0/1938171231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff03006e970 0x7ff03013bcc0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7ff02000c440 tx=0x7ff02000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:46.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.158+0000 7ff01effd640 1 -- 172.21.15.7:0/1938171231 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff020017070 con 0x7ff03006e970 2024-04-25T10:04:46.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.158+0000 7ff01effd640 1 -- 172.21.15.7:0/1938171231 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff020005ce0 con 0x7ff03006e970 2024-04-25T10:04:46.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.158+0000 7ff01effd640 1 -- 172.21.15.7:0/1938171231 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff020007270 con 0x7ff03006e970 2024-04-25T10:04:46.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.158+0000 7ff034e8f640 1 -- 172.21.15.7:0/1938171231 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff03014dbf0 con 0x7ff03006e970 2024-04-25T10:04:46.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.158+0000 7ff034e8f640 1 -- 172.21.15.7:0/1938171231 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff03014b400 con 0x7ff03006e970 2024-04-25T10:04:46.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.159+0000 7ff034e8f640 1 -- 172.21.15.7:0/1938171231 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff030068fd0 con 0x7ff03006e970 2024-04-25T10:04:46.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.159+0000 7ff01effd640 1 -- 172.21.15.7:0/1938171231 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff02001a070 con 0x7ff03006e970 2024-04-25T10:04:46.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.160+0000 7ff01effd640 1 --2- 172.21.15.7:0/1938171231 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff01006b4d0 0x7ff01006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:46.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.160+0000 7ff01effd640 1 -- 172.21.15.7:0/1938171231 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff0200895b0 con 0x7ff03006e970 2024-04-25T10:04:46.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.160+0000 7ff02dd9b640 1 --2- 172.21.15.7:0/1938171231 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff01006b4d0 0x7ff01006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:46.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.160+0000 7ff02dd9b640 1 --2- 172.21.15.7:0/1938171231 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff01006b4d0 0x7ff01006d990 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff024034000 tx=0x7ff02402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:46.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.164+0000 7ff01effd640 1 -- 172.21.15.7:0/1938171231 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff0300cbea0 con 0x7ff03006e970 2024-04-25T10:04:46.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.366+0000 7ff034e8f640 1 -- 172.21.15.7:0/1938171231 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff03014bda0 con 0x7ff03006e970 2024-04-25T10:04:46.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.366+0000 7ff01effd640 1 -- 172.21.15.7:0/1938171231 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v117) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff020057c50 con 0x7ff03006e970 2024-04-25T10:04:46.372 INFO:teuthology.orchestra.run.smithi007.stderr:listed 0 entries 2024-04-25T10:04:46.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.368+0000 7ff034e8f640 1 -- 172.21.15.7:0/1938171231 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff01006b4d0 msgr2=0x7ff01006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:46.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.368+0000 7ff034e8f640 1 --2- 172.21.15.7:0/1938171231 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff01006b4d0 0x7ff01006d990 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff024034000 tx=0x7ff02402e000 comp rx=0 tx=0).stop 2024-04-25T10:04:46.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.368+0000 7ff034e8f640 1 -- 172.21.15.7:0/1938171231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff03006e970 msgr2=0x7ff03013bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:46.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.368+0000 7ff034e8f640 1 --2- 172.21.15.7:0/1938171231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff03006e970 0x7ff03013bcc0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7ff02000c440 tx=0x7ff02000c900 comp rx=0 tx=0).stop 2024-04-25T10:04:46.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.368+0000 7ff034e8f640 1 -- 172.21.15.7:0/1938171231 shutdown_connections 2024-04-25T10:04:46.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.368+0000 7ff034e8f640 1 --2- 172.21.15.7:0/1938171231 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff01006b4d0 0x7ff01006d990 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.368+0000 7ff034e8f640 1 --2- 172.21.15.7:0/1938171231 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff030144100 0x7ff03014e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.368+0000 7ff034e8f640 1 --2- 172.21.15.7:0/1938171231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0300ced20 0x7ff03014d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.368+0000 7ff034e8f640 1 --2- 172.21.15.7:0/1938171231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff03006e970 0x7ff03013bcc0 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.368+0000 7ff034e8f640 1 -- 172.21.15.7:0/1938171231 >> 172.21.15.7:0/1938171231 conn(0x7ff030071150 msgr2=0x7ff03013f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:46.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.368+0000 7ff034e8f640 1 -- 172.21.15.7:0/1938171231 shutdown_connections 2024-04-25T10:04:46.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.369+0000 7ff034e8f640 1 -- 172.21.15.7:0/1938171231 wait complete. 2024-04-25T10:04:46.384 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T10:04:46.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:46.385 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T10:04:46.452 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-04-25T10:04:46.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:46.452 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T10:04:46.482 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:04:46.482 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:46.538 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13704 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:04:46.538 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-04-25T10:04:46.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:46.538 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T10:04:46.592 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:04:46.593 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-25T10:04:46.593 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T10:04:46.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.729+0000 7f1bd477e640 1 Processor -- start 2024-04-25T10:04:46.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.729+0000 7f1bd477e640 1 -- start start 2024-04-25T10:04:46.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.730+0000 7f1bd477e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1bcc0d0aa0 0x7f1bcc161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:46.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.730+0000 7f1bd477e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1bcc1622b0 0x7f1bcc0ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:46.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.730+0000 7f1bd477e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bcc15e8a0 con 0x7f1bcc15da60 2024-04-25T10:04:46.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.730+0000 7f1bd477e640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bcc15eb80 con 0x7f1bcc0d0aa0 2024-04-25T10:04:46.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.730+0000 7f1bd477e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc15ee60 con 0x7f1bcc1622b0 2024-04-25T10:04:46.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.730+0000 7f1bd1d19640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1bcc0d0aa0 0x7f1bcc161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:46.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.730+0000 7f1bd1d19640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1bcc0d0aa0 0x7f1bcc161d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58292/0 (socket says 172.21.15.7:58292) 2024-04-25T10:04:46.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.730+0000 7f1bd1d19640 1 -- 172.21.15.7:0/2506195061 learned_addr learned my addr 172.21.15.7:0/2506195061 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:46.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.730+0000 7f1bd1d19640 1 -- 172.21.15.7:0/2506195061 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1bcc1622b0 msgr2=0x7f1bcc0ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:46.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.730+0000 7f1bd2d1b640 1 --2- 172.21.15.7:0/2506195061 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1bcc1622b0 0x7f1bcc0ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:46.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.730+0000 7f1bd1d19640 1 --2- 172.21.15.7:0/2506195061 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1bcc1622b0 0x7f1bcc0ce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.730+0000 7f1bd1d19640 1 -- 172.21.15.7:0/2506195061 >> v1:172.21.15.55:6789/0 conn(0x7f1bcc15da60 legacy=0x7f1bcc15de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:46.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.730+0000 7f1bd1d19640 1 -- 172.21.15.7:0/2506195061 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bcc161850 con 0x7f1bcc0d0aa0 2024-04-25T10:04:46.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.730+0000 7f1bd2d1b640 1 --2- 172.21.15.7:0/2506195061 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1bcc1622b0 0x7f1bcc0ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:46.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.731+0000 7f1bd1d19640 1 --2- 172.21.15.7:0/2506195061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1bcc0d0aa0 0x7f1bcc161d70 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc009870 tx=0x7f1bbc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89127a1a13d4f1a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:46.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.731+0000 7f1bd1518640 1 -- 172.21.15.7:0/2506195061 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc037070 con 0x7f1bcc0d0aa0 2024-04-25T10:04:46.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.731+0000 7f1bd1518640 1 -- 172.21.15.7:0/2506195061 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bbc032440 con 0x7f1bcc0d0aa0 2024-04-25T10:04:46.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.731+0000 7f1bd1518640 1 -- 172.21.15.7:0/2506195061 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc032810 con 0x7f1bcc0d0aa0 2024-04-25T10:04:46.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.732+0000 7f1bd477e640 1 -- 172.21.15.7:0/2506195061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1bcc0d0aa0 msgr2=0x7f1bcc161d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:46.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.732+0000 7f1bd477e640 1 --2- 172.21.15.7:0/2506195061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1bcc0d0aa0 0x7f1bcc161d70 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc009870 tx=0x7f1bbc02a180 comp rx=0 tx=0).stop 2024-04-25T10:04:46.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.732+0000 7f1bd477e640 1 -- 172.21.15.7:0/2506195061 shutdown_connections 2024-04-25T10:04:46.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.732+0000 7f1bd477e640 1 --2- 172.21.15.7:0/2506195061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1bcc0d0aa0 0x7f1bcc161d70 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.732+0000 7f1bd477e640 1 --2- 172.21.15.7:0/2506195061 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1bcc1622b0 0x7f1bcc0ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.732+0000 7f1bd477e640 1 -- 172.21.15.7:0/2506195061 >> 172.21.15.7:0/2506195061 conn(0x7f1bcc06bfe0 msgr2=0x7f1bcc06c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:46.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.732+0000 7f1bd477e640 1 -- 172.21.15.7:0/2506195061 shutdown_connections 2024-04-25T10:04:46.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.732+0000 7f1bd477e640 1 -- 172.21.15.7:0/2506195061 wait complete. 2024-04-25T10:04:46.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.733+0000 7f1bd477e640 1 Processor -- start 2024-04-25T10:04:46.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.733+0000 7f1bd477e640 1 -- start start 2024-04-25T10:04:46.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.734+0000 7f1bd477e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1bcc0d0aa0 0x7f1bcc1e8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:46.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.734+0000 7f1bd477e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bcc15da60 0x7f1bcc14bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:46.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.734+0000 7f1bd477e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1bcc1622b0 0x7f1bcc0b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:46.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.734+0000 7f1bd477e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc0cebe0 con 0x7f1bcc1622b0 2024-04-25T10:04:46.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.734+0000 7f1bd477e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc0cea60 con 0x7f1bcc15da60 2024-04-25T10:04:46.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.734+0000 7f1bd477e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc0ced60 con 0x7f1bcc0d0aa0 2024-04-25T10:04:46.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.734+0000 7f1bd2d1b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1bcc1622b0 0x7f1bcc0b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:46.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.734+0000 7f1bd2d1b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1bcc1622b0 0x7f1bcc0b4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58304/0 (socket says 172.21.15.7:58304) 2024-04-25T10:04:46.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.734+0000 7f1bd2d1b640 1 -- 172.21.15.7:0/1134053194 learned_addr learned my addr 172.21.15.7:0/1134053194 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:46.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.734+0000 7f1bd1d19640 1 --2- 172.21.15.7:0/1134053194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bcc15da60 0x7f1bcc14bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:46.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.734+0000 7f1bd251a640 1 --2- 172.21.15.7:0/1134053194 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1bcc0d0aa0 0x7f1bcc1e8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:46.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.734+0000 7f1bd2d1b640 1 -- 172.21.15.7:0/1134053194 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1bcc0d0aa0 msgr2=0x7f1bcc1e8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:46.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.734+0000 7f1bd2d1b640 1 --2- 172.21.15.7:0/1134053194 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1bcc0d0aa0 0x7f1bcc1e8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.734+0000 7f1bd2d1b640 1 -- 172.21.15.7:0/1134053194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bcc15da60 msgr2=0x7f1bcc14bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:46.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.734+0000 7f1bd2d1b640 1 --2- 172.21.15.7:0/1134053194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bcc15da60 0x7f1bcc14bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.734+0000 7f1bd2d1b640 1 -- 172.21.15.7:0/1134053194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bcc14c1b0 con 0x7f1bcc1622b0 2024-04-25T10:04:46.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.734+0000 7f1bd2d1b640 1 --2- 172.21.15.7:0/1134053194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1bcc1622b0 0x7f1bcc0b4d10 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f1bc400cef0 tx=0x7f1bc400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:46.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.734+0000 7f1bc2ffd640 1 -- 172.21.15.7:0/1134053194 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc401a070 con 0x7f1bcc1622b0 2024-04-25T10:04:46.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.734+0000 7f1bc2ffd640 1 -- 172.21.15.7:0/1134053194 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc400d860 con 0x7f1bcc1622b0 2024-04-25T10:04:46.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.734+0000 7f1bc2ffd640 1 -- 172.21.15.7:0/1134053194 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc400dc50 con 0x7f1bcc1622b0 2024-04-25T10:04:46.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.734+0000 7f1bd477e640 1 -- 172.21.15.7:0/1134053194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bcc1e7570 con 0x7f1bcc1622b0 2024-04-25T10:04:46.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.734+0000 7f1bd477e640 1 -- 172.21.15.7:0/1134053194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bcc1e7b30 con 0x7f1bcc1622b0 2024-04-25T10:04:46.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.735+0000 7f1bd477e640 1 -- 172.21.15.7:0/1134053194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bcc068fd0 con 0x7f1bcc1622b0 2024-04-25T10:04:46.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.736+0000 7f1bc2ffd640 1 -- 172.21.15.7:0/1134053194 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1bc401d070 con 0x7f1bcc1622b0 2024-04-25T10:04:46.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.736+0000 7f1bc2ffd640 1 --2- 172.21.15.7:0/1134053194 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1bb006b4d0 0x7f1bb006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:46.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.736+0000 7f1bc2ffd640 1 -- 172.21.15.7:0/1134053194 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1bc408ac60 con 0x7f1bcc1622b0 2024-04-25T10:04:46.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.736+0000 7f1bd251a640 1 --2- 172.21.15.7:0/1134053194 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1bb006b4d0 0x7f1bb006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:46.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.737+0000 7f1bd251a640 1 --2- 172.21.15.7:0/1134053194 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1bb006b4d0 0x7f1bb006d990 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800a750 tx=0x7f1bc8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:46.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.740+0000 7f1bc2ffd640 1 -- 172.21.15.7:0/1134053194 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1bcc14c1b0 con 0x7f1bcc1622b0 2024-04-25T10:04:46.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.959+0000 7f1bd477e640 1 -- 172.21.15.7:0/1134053194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1bcc0d1560 con 0x7f1bcc1622b0 2024-04-25T10:04:46.965 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-04-25T10:04:46.960+0000 7f45ad572640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T10:04:46.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.961+0000 7f1bc2ffd640 1 -- 172.21.15.7:0/1134053194 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v89) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1bc4059a10 con 0x7f1bcc1622b0 2024-04-25T10:04:46.966 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T10:04:46.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.965+0000 7f1bd477e640 1 -- 172.21.15.7:0/1134053194 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1bb006b4d0 msgr2=0x7f1bb006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:46.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.965+0000 7f1bd477e640 1 --2- 172.21.15.7:0/1134053194 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1bb006b4d0 0x7f1bb006d990 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800a750 tx=0x7f1bc8008040 comp rx=0 tx=0).stop 2024-04-25T10:04:46.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.965+0000 7f1bd477e640 1 -- 172.21.15.7:0/1134053194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1bcc1622b0 msgr2=0x7f1bcc0b4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:46.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.965+0000 7f1bd477e640 1 --2- 172.21.15.7:0/1134053194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1bcc1622b0 0x7f1bcc0b4d10 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f1bc400cef0 tx=0x7f1bc400a710 comp rx=0 tx=0).stop 2024-04-25T10:04:46.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.965+0000 7f1bd477e640 1 -- 172.21.15.7:0/1134053194 shutdown_connections 2024-04-25T10:04:46.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.965+0000 7f1bd477e640 1 --2- 172.21.15.7:0/1134053194 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1bb006b4d0 0x7f1bb006d990 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.965+0000 7f1bd477e640 1 --2- 172.21.15.7:0/1134053194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1bcc1622b0 0x7f1bcc0b4d10 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.965+0000 7f1bd477e640 1 --2- 172.21.15.7:0/1134053194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bcc15da60 0x7f1bcc14bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.965+0000 7f1bd477e640 1 --2- 172.21.15.7:0/1134053194 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1bcc0d0aa0 0x7f1bcc1e8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.965+0000 7f1bd477e640 1 -- 172.21.15.7:0/1134053194 >> 172.21.15.7:0/1134053194 conn(0x7f1bcc06bfe0 msgr2=0x7f1bcc06c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:46.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.965+0000 7f1bd477e640 1 -- 172.21.15.7:0/1134053194 shutdown_connections 2024-04-25T10:04:46.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:46.965+0000 7f1bd477e640 1 -- 172.21.15.7:0/1134053194 wait complete. 2024-04-25T10:04:46.973 INFO:tasks.ceph.mds.a.smithi007.stderr: -8144> 2024-04-25T10:04:36.199+0000 7f98edb7a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:04:46.982 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T10:04:46.984 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T10:04:47.006 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-04-25T10:04:47.026 INFO:teuthology.orchestra.run.smithi007.stdout:[global] 2024-04-25T10:04:47.026 INFO:teuthology.orchestra.run.smithi007.stdout: chdir = "" 2024-04-25T10:04:47.026 INFO:teuthology.orchestra.run.smithi007.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T10:04:47.026 INFO:teuthology.orchestra.run.smithi007.stdout: auth supported = cephx 2024-04-25T10:04:47.026 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.026 INFO:teuthology.orchestra.run.smithi007.stdout: filestore xattr use omap = true 2024-04-25T10:04:47.029 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.030 INFO:teuthology.orchestra.run.smithi007.stdout: mon clock drift allowed = 1.000 2024-04-25T10:04:47.030 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.030 INFO:teuthology.orchestra.run.smithi007.stdout: osd crush chooseleaf type = 0 2024-04-25T10:04:47.030 INFO:teuthology.orchestra.run.smithi007.stdout: auth debug = true 2024-04-25T10:04:47.030 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.030 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on old message = true 2024-04-25T10:04:47.030 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on bug = true 2024-04-25T10:04:47.030 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.030 INFO:teuthology.orchestra.run.smithi007.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T10:04:47.030 INFO:teuthology.orchestra.run.smithi007.stdout: mon pg warn max object skew = 0 2024-04-25T10:04:47.030 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.030 INFO:teuthology.orchestra.run.smithi007.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T10:04:47.030 INFO:teuthology.orchestra.run.smithi007.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T10:04:47.030 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.031 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default size = 2 2024-04-25T10:04:47.031 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.031 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow primary affinity = true 2024-04-25T10:04:47.031 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow pg remap = true 2024-04-25T10:04:47.031 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on legacy crush tunables = false 2024-04-25T10:04:47.031 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on crush straw calc version zero = false 2024-04-25T10:04:47.031 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on no sortbitwise = false 2024-04-25T10:04:47.031 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on osd down out interval zero = false 2024-04-25T10:04:47.031 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on too few osds = false 2024-04-25T10:04:47.031 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T10:04:47.031 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T10:04:47.031 INFO:teuthology.orchestra.run.smithi007.stdout: mon_allow_pool_size_one = true 2024-04-25T10:04:47.031 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.031 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T10:04:47.031 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.032 INFO:teuthology.orchestra.run.smithi007.stdout: osd default data pool replay window = 5 2024-04-25T10:04:47.032 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.032 INFO:teuthology.orchestra.run.smithi007.stdout: mon allow pool delete = true 2024-04-25T10:04:47.032 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.032 INFO:teuthology.orchestra.run.smithi007.stdout: mon cluster log file level = debug 2024-04-25T10:04:47.032 INFO:teuthology.orchestra.run.smithi007.stdout: debug asserts on shutdown = true 2024-04-25T10:04:47.032 INFO:teuthology.orchestra.run.smithi007.stdout: mon health detail to clog = false 2024-04-25T10:04:47.032 INFO:teuthology.orchestra.run.smithi007.stdout: mon host = "172.21.15.7,172.21.15.55,[v2:172.21.15.55:3301,v1:172.21.15.55:6790]" 2024-04-25T10:04:47.032 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on skipped message = False 2024-04-25T10:04:47.032 INFO:teuthology.orchestra.run.smithi007.stdout: fsid = c03d0745-5946-49c3-ad88-1165c5b68b4e 2024-04-25T10:04:47.032 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.032 INFO:teuthology.orchestra.run.smithi007.stdout:[osd] 2024-04-25T10:04:47.032 INFO:teuthology.orchestra.run.smithi007.stdout: osd journal size = 100 2024-04-25T10:04:47.032 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.032 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub load threshold = 5.0 2024-04-25T10:04:47.033 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub max interval = 600 2024-04-25T10:04:47.033 INFO:teuthology.orchestra.run.smithi007.stdout: osd mclock profile = high_recovery_ops 2024-04-25T10:04:47.033 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.033 INFO:teuthology.orchestra.run.smithi007.stdout: osd recover clone overlap = true 2024-04-25T10:04:47.033 INFO:teuthology.orchestra.run.smithi007.stdout: osd recovery max chunk = 1048576 2024-04-25T10:04:47.033 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.033 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug shutdown = true 2024-04-25T10:04:47.033 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug op order = true 2024-04-25T10:04:47.033 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug verify stray on activate = true 2024-04-25T10:04:47.033 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug trim objects = true 2024-04-25T10:04:47.033 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.033 INFO:teuthology.orchestra.run.smithi007.stdout: osd open classes on start = true 2024-04-25T10:04:47.033 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug pg log writeout = true 2024-04-25T10:04:47.033 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.034 INFO:teuthology.orchestra.run.smithi007.stdout: osd deep scrub update digest min age = 30 2024-04-25T10:04:47.034 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.034 INFO:teuthology.orchestra.run.smithi007.stdout: osd map max advance = 10 2024-04-25T10:04:47.034 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.034 INFO:teuthology.orchestra.run.smithi007.stdout: journal zero on create = true 2024-04-25T10:04:47.034 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.034 INFO:teuthology.orchestra.run.smithi007.stdout: filestore ondisk finisher threads = 3 2024-04-25T10:04:47.034 INFO:teuthology.orchestra.run.smithi007.stdout: filestore apply finisher threads = 3 2024-04-25T10:04:47.034 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.034 INFO:teuthology.orchestra.run.smithi007.stdout: bdev debug aio = true 2024-04-25T10:04:47.034 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug misdirected ops = true 2024-04-25T10:04:47.034 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore block size = 96636764160 2024-04-25T10:04:47.034 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore fsck on mount = True 2024-04-25T10:04:47.034 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluefs = 20 2024-04-25T10:04:47.035 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluestore = 20 2024-04-25T10:04:47.035 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-04-25T10:04:47.035 INFO:teuthology.orchestra.run.smithi007.stdout: debug osd = 20 2024-04-25T10:04:47.035 INFO:teuthology.orchestra.run.smithi007.stdout: debug rocksdb = 10 2024-04-25T10:04:47.035 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T10:04:47.035 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd full ratio = 0.9 2024-04-25T10:04:47.035 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd nearfull ratio = 0.8 2024-04-25T10:04:47.035 INFO:teuthology.orchestra.run.smithi007.stdout: osd failsafe full ratio = 0.95 2024-04-25T10:04:47.035 INFO:teuthology.orchestra.run.smithi007.stdout: osd objectstore = bluestore 2024-04-25T10:04:47.035 INFO:teuthology.orchestra.run.smithi007.stdout: osd op complaint time = 180 2024-04-25T10:04:47.035 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.035 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr] 2024-04-25T10:04:47.035 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-04-25T10:04:47.035 INFO:teuthology.orchestra.run.smithi007.stdout: debug mgr = 20 2024-04-25T10:04:47.035 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2024-04-25T10:04:47.036 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2024-04-25T10:04:47.036 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:04:47.036 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:04:47.036 INFO:teuthology.orchestra.run.smithi007.stdout: mgr/telemetry/nag = false 2024-04-25T10:04:47.036 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.036 INFO:teuthology.orchestra.run.smithi007.stdout:[mon] 2024-04-25T10:04:47.036 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-04-25T10:04:47.036 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2024-04-25T10:04:47.036 INFO:teuthology.orchestra.run.smithi007.stdout: debug paxos = 20 2024-04-25T10:04:47.036 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2024-04-25T10:04:47.036 INFO:teuthology.orchestra.run.smithi007.stdout: mon data avail warn = 5 2024-04-25T10:04:47.036 INFO:teuthology.orchestra.run.smithi007.stdout: mon mgr mkfs grace = 240 2024-04-25T10:04:47.036 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:04:47.036 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd reporter subtree level = osd 2024-04-25T10:04:47.037 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd prime pg temp = true 2024-04-25T10:04:47.037 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:04:47.037 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.037 INFO:teuthology.orchestra.run.smithi007.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T10:04:47.037 INFO:teuthology.orchestra.run.smithi007.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T10:04:47.037 INFO:teuthology.orchestra.run.smithi007.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T10:04:47.037 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.037 INFO:teuthology.orchestra.run.smithi007.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T10:04:47.037 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T10:04:47.037 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T10:04:47.037 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.037 INFO:teuthology.orchestra.run.smithi007.stdout: # 1m isn't quite enough 2024-04-25T10:04:47.037 INFO:teuthology.orchestra.run.smithi007.stdout: mon_down_mkfs_grace = 2m 2024-04-25T10:04:47.037 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.037 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_filestore_osds = false 2024-04-25T10:04:47.038 INFO:teuthology.orchestra.run.smithi007.stdout: mon op complaint time = 120 2024-04-25T10:04:47.038 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.038 INFO:teuthology.orchestra.run.smithi007.stdout:[client] 2024-04-25T10:04:47.038 INFO:teuthology.orchestra.run.smithi007.stdout: rgw cache enabled = true 2024-04-25T10:04:47.038 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable ops log = true 2024-04-25T10:04:47.038 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable usage log = true 2024-04-25T10:04:47.038 INFO:teuthology.orchestra.run.smithi007.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T10:04:47.038 INFO:teuthology.orchestra.run.smithi007.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T10:04:47.038 INFO:teuthology.orchestra.run.smithi007.stdout: client mount timeout = 600 2024-04-25T10:04:47.038 INFO:teuthology.orchestra.run.smithi007.stdout: debug client = 20 2024-04-25T10:04:47.038 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-04-25T10:04:47.038 INFO:teuthology.orchestra.run.smithi007.stdout: pid file = "" 2024-04-25T10:04:47.038 INFO:teuthology.orchestra.run.smithi007.stdout: rados mon op timeout = 900 2024-04-25T10:04:47.038 INFO:teuthology.orchestra.run.smithi007.stdout: rados osd op timeout = 900 2024-04-25T10:04:47.039 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.a] 2024-04-25T10:04:47.039 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.b] 2024-04-25T10:04:47.039 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.c] 2024-04-25T10:04:47.039 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.a] 2024-04-25T10:04:47.039 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.c] 2024-04-25T10:04:47.039 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.b] 2024-04-25T10:04:47.039 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.d] 2024-04-25T10:04:47.039 INFO:teuthology.orchestra.run.smithi007.stdout:[mds] 2024-04-25T10:04:47.039 INFO:teuthology.orchestra.run.smithi007.stdout: debug mds = 20 2024-04-25T10:04:47.039 INFO:teuthology.orchestra.run.smithi007.stdout: debug mds balancer = 20 2024-04-25T10:04:47.039 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-04-25T10:04:47.039 INFO:teuthology.orchestra.run.smithi007.stdout: mds debug frag = True 2024-04-25T10:04:47.039 INFO:teuthology.orchestra.run.smithi007.stdout: mds debug scatterstat = True 2024-04-25T10:04:47.039 INFO:teuthology.orchestra.run.smithi007.stdout: mds op complaint time = 180 2024-04-25T10:04:47.039 INFO:teuthology.orchestra.run.smithi007.stdout: mds verify scatter = False 2024-04-25T10:04:47.040 INFO:teuthology.orchestra.run.smithi007.stdout: osd op complaint time = 180 2024-04-25T10:04:47.040 INFO:teuthology.orchestra.run.smithi007.stdout: rados mon op timeout = 900 2024-04-25T10:04:47.040 INFO:teuthology.orchestra.run.smithi007.stdout: rados osd op timeout = 900 2024-04-25T10:04:47.040 INFO:teuthology.orchestra.run.smithi055.stdout:[global] 2024-04-25T10:04:47.040 INFO:teuthology.orchestra.run.smithi055.stdout: chdir = "" 2024-04-25T10:04:47.040 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T10:04:47.041 INFO:teuthology.orchestra.run.smithi055.stdout: auth supported = cephx 2024-04-25T10:04:47.041 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.041 INFO:teuthology.orchestra.run.smithi055.stdout: filestore xattr use omap = true 2024-04-25T10:04:47.041 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.041 INFO:teuthology.orchestra.run.smithi055.stdout: mon clock drift allowed = 1.000 2024-04-25T10:04:47.041 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.041 INFO:teuthology.orchestra.run.smithi055.stdout: osd crush chooseleaf type = 0 2024-04-25T10:04:47.041 INFO:teuthology.orchestra.run.smithi055.stdout: auth debug = true 2024-04-25T10:04:47.041 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.041 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on old message = true 2024-04-25T10:04:47.041 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on bug = true 2024-04-25T10:04:47.041 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.041 INFO:teuthology.orchestra.run.smithi055.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T10:04:47.041 INFO:teuthology.orchestra.run.smithi055.stdout: mon pg warn max object skew = 0 2024-04-25T10:04:47.041 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.042 INFO:teuthology.orchestra.run.smithi055.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T10:04:47.042 INFO:teuthology.orchestra.run.smithi055.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T10:04:47.042 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.042 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default size = 2 2024-04-25T10:04:47.042 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.042 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow primary affinity = true 2024-04-25T10:04:47.042 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow pg remap = true 2024-04-25T10:04:47.042 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on legacy crush tunables = false 2024-04-25T10:04:47.042 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on crush straw calc version zero = false 2024-04-25T10:04:47.042 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on no sortbitwise = false 2024-04-25T10:04:47.042 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on osd down out interval zero = false 2024-04-25T10:04:47.042 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on too few osds = false 2024-04-25T10:04:47.042 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T10:04:47.042 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T10:04:47.043 INFO:teuthology.orchestra.run.smithi055.stdout: mon_allow_pool_size_one = true 2024-04-25T10:04:47.043 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.043 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T10:04:47.043 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.043 INFO:teuthology.orchestra.run.smithi055.stdout: osd default data pool replay window = 5 2024-04-25T10:04:47.043 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.043 INFO:teuthology.orchestra.run.smithi055.stdout: mon allow pool delete = true 2024-04-25T10:04:47.043 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.043 INFO:teuthology.orchestra.run.smithi055.stdout: mon cluster log file level = debug 2024-04-25T10:04:47.043 INFO:teuthology.orchestra.run.smithi055.stdout: debug asserts on shutdown = true 2024-04-25T10:04:47.043 INFO:teuthology.orchestra.run.smithi055.stdout: mon health detail to clog = false 2024-04-25T10:04:47.043 INFO:teuthology.orchestra.run.smithi055.stdout: mon host = "172.21.15.7,172.21.15.55,[v2:172.21.15.55:3301,v1:172.21.15.55:6790]" 2024-04-25T10:04:47.043 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on skipped message = False 2024-04-25T10:04:47.043 INFO:teuthology.orchestra.run.smithi055.stdout: fsid = c03d0745-5946-49c3-ad88-1165c5b68b4e 2024-04-25T10:04:47.044 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.044 INFO:teuthology.orchestra.run.smithi055.stdout:[osd] 2024-04-25T10:04:47.044 INFO:teuthology.orchestra.run.smithi055.stdout: osd journal size = 100 2024-04-25T10:04:47.044 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.044 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub load threshold = 5.0 2024-04-25T10:04:47.044 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub max interval = 600 2024-04-25T10:04:47.044 INFO:teuthology.orchestra.run.smithi055.stdout: osd mclock profile = high_recovery_ops 2024-04-25T10:04:47.044 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.044 INFO:teuthology.orchestra.run.smithi055.stdout: osd recover clone overlap = true 2024-04-25T10:04:47.044 INFO:teuthology.orchestra.run.smithi055.stdout: osd recovery max chunk = 1048576 2024-04-25T10:04:47.044 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.044 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug shutdown = true 2024-04-25T10:04:47.044 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug op order = true 2024-04-25T10:04:47.044 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug verify stray on activate = true 2024-04-25T10:04:47.044 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug trim objects = true 2024-04-25T10:04:47.045 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.045 INFO:teuthology.orchestra.run.smithi055.stdout: osd open classes on start = true 2024-04-25T10:04:47.045 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug pg log writeout = true 2024-04-25T10:04:47.045 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.045 INFO:teuthology.orchestra.run.smithi055.stdout: osd deep scrub update digest min age = 30 2024-04-25T10:04:47.045 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.045 INFO:teuthology.orchestra.run.smithi055.stdout: osd map max advance = 10 2024-04-25T10:04:47.045 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.045 INFO:teuthology.orchestra.run.smithi055.stdout: journal zero on create = true 2024-04-25T10:04:47.045 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.045 INFO:teuthology.orchestra.run.smithi055.stdout: filestore ondisk finisher threads = 3 2024-04-25T10:04:47.045 INFO:teuthology.orchestra.run.smithi055.stdout: filestore apply finisher threads = 3 2024-04-25T10:04:47.045 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.045 INFO:teuthology.orchestra.run.smithi055.stdout: bdev debug aio = true 2024-04-25T10:04:47.045 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug misdirected ops = true 2024-04-25T10:04:47.046 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore block size = 96636764160 2024-04-25T10:04:47.046 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore fsck on mount = True 2024-04-25T10:04:47.046 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluefs = 20 2024-04-25T10:04:47.046 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluestore = 20 2024-04-25T10:04:47.046 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T10:04:47.046 INFO:teuthology.orchestra.run.smithi055.stdout: debug osd = 20 2024-04-25T10:04:47.046 INFO:teuthology.orchestra.run.smithi055.stdout: debug rocksdb = 10 2024-04-25T10:04:47.046 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T10:04:47.046 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd full ratio = 0.9 2024-04-25T10:04:47.046 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd nearfull ratio = 0.8 2024-04-25T10:04:47.046 INFO:teuthology.orchestra.run.smithi055.stdout: osd failsafe full ratio = 0.95 2024-04-25T10:04:47.046 INFO:teuthology.orchestra.run.smithi055.stdout: osd objectstore = bluestore 2024-04-25T10:04:47.046 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-04-25T10:04:47.046 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.046 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr] 2024-04-25T10:04:47.047 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T10:04:47.047 INFO:teuthology.orchestra.run.smithi055.stdout: debug mgr = 20 2024-04-25T10:04:47.047 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-04-25T10:04:47.047 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-04-25T10:04:47.047 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:04:47.047 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:04:47.047 INFO:teuthology.orchestra.run.smithi055.stdout: mgr/telemetry/nag = false 2024-04-25T10:04:47.047 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.047 INFO:teuthology.orchestra.run.smithi055.stdout:[mon] 2024-04-25T10:04:47.047 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T10:04:47.047 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-04-25T10:04:47.047 INFO:teuthology.orchestra.run.smithi055.stdout: debug paxos = 20 2024-04-25T10:04:47.047 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-04-25T10:04:47.047 INFO:teuthology.orchestra.run.smithi055.stdout: mon data avail warn = 5 2024-04-25T10:04:47.047 INFO:teuthology.orchestra.run.smithi055.stdout: mon mgr mkfs grace = 240 2024-04-25T10:04:47.048 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:04:47.048 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd reporter subtree level = osd 2024-04-25T10:04:47.048 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd prime pg temp = true 2024-04-25T10:04:47.048 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:04:47.048 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.048 INFO:teuthology.orchestra.run.smithi055.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T10:04:47.048 INFO:teuthology.orchestra.run.smithi055.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T10:04:47.048 INFO:teuthology.orchestra.run.smithi055.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T10:04:47.048 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.048 INFO:teuthology.orchestra.run.smithi055.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T10:04:47.048 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T10:04:47.048 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T10:04:47.048 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.048 INFO:teuthology.orchestra.run.smithi055.stdout: # 1m isn't quite enough 2024-04-25T10:04:47.048 INFO:teuthology.orchestra.run.smithi055.stdout: mon_down_mkfs_grace = 2m 2024-04-25T10:04:47.049 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.049 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_filestore_osds = false 2024-04-25T10:04:47.049 INFO:teuthology.orchestra.run.smithi055.stdout: mon op complaint time = 120 2024-04-25T10:04:47.049 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.049 INFO:teuthology.orchestra.run.smithi055.stdout:[client] 2024-04-25T10:04:47.049 INFO:teuthology.orchestra.run.smithi055.stdout: rgw cache enabled = true 2024-04-25T10:04:47.049 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable ops log = true 2024-04-25T10:04:47.049 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable usage log = true 2024-04-25T10:04:47.049 INFO:teuthology.orchestra.run.smithi055.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T10:04:47.049 INFO:teuthology.orchestra.run.smithi055.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T10:04:47.049 INFO:teuthology.orchestra.run.smithi055.stdout: client mount timeout = 600 2024-04-25T10:04:47.049 INFO:teuthology.orchestra.run.smithi055.stdout: debug client = 20 2024-04-25T10:04:47.049 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T10:04:47.049 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = "" 2024-04-25T10:04:47.049 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-04-25T10:04:47.050 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-04-25T10:04:47.050 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.a] 2024-04-25T10:04:47.050 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.b] 2024-04-25T10:04:47.050 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.c] 2024-04-25T10:04:47.050 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2024-04-25T10:04:47.050 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2024-04-25T10:04:47.050 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2024-04-25T10:04:47.050 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2024-04-25T10:04:47.050 INFO:teuthology.orchestra.run.smithi055.stdout:[mds] 2024-04-25T10:04:47.050 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds = 20 2024-04-25T10:04:47.050 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds balancer = 20 2024-04-25T10:04:47.050 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T10:04:47.050 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug frag = True 2024-04-25T10:04:47.050 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug scatterstat = True 2024-04-25T10:04:47.050 INFO:teuthology.orchestra.run.smithi055.stdout: mds op complaint time = 180 2024-04-25T10:04:47.051 INFO:teuthology.orchestra.run.smithi055.stdout: mds verify scatter = False 2024-04-25T10:04:47.051 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-04-25T10:04:47.051 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-04-25T10:04:47.051 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-04-25T10:04:47.053 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T10:04:47.094 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T10:04:47.134 INFO:teuthology.orchestra.run.smithi007.stdout:[global] 2024-04-25T10:04:47.134 INFO:teuthology.orchestra.run.smithi007.stdout: chdir = "" 2024-04-25T10:04:47.134 INFO:teuthology.orchestra.run.smithi007.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T10:04:47.135 INFO:teuthology.orchestra.run.smithi007.stdout: auth supported = cephx 2024-04-25T10:04:47.135 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.135 INFO:teuthology.orchestra.run.smithi007.stdout: filestore xattr use omap = true 2024-04-25T10:04:47.135 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.135 INFO:teuthology.orchestra.run.smithi007.stdout: mon clock drift allowed = 1.000 2024-04-25T10:04:47.135 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.135 INFO:teuthology.orchestra.run.smithi007.stdout: osd crush chooseleaf type = 0 2024-04-25T10:04:47.135 INFO:teuthology.orchestra.run.smithi007.stdout: auth debug = true 2024-04-25T10:04:47.135 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.135 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on old message = true 2024-04-25T10:04:47.135 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on bug = true 2024-04-25T10:04:47.135 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.135 INFO:teuthology.orchestra.run.smithi007.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T10:04:47.135 INFO:teuthology.orchestra.run.smithi007.stdout: mon pg warn max object skew = 0 2024-04-25T10:04:47.135 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.136 INFO:teuthology.orchestra.run.smithi007.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T10:04:47.136 INFO:teuthology.orchestra.run.smithi007.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T10:04:47.136 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.136 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default size = 2 2024-04-25T10:04:47.136 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.136 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow primary affinity = true 2024-04-25T10:04:47.136 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow pg remap = true 2024-04-25T10:04:47.136 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on legacy crush tunables = false 2024-04-25T10:04:47.136 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on crush straw calc version zero = false 2024-04-25T10:04:47.136 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on no sortbitwise = false 2024-04-25T10:04:47.136 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on osd down out interval zero = false 2024-04-25T10:04:47.136 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on too few osds = false 2024-04-25T10:04:47.136 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T10:04:47.136 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T10:04:47.136 INFO:teuthology.orchestra.run.smithi007.stdout: mon_allow_pool_size_one = true 2024-04-25T10:04:47.137 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.137 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T10:04:47.137 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.137 INFO:teuthology.orchestra.run.smithi007.stdout: osd default data pool replay window = 5 2024-04-25T10:04:47.137 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.137 INFO:teuthology.orchestra.run.smithi007.stdout: mon allow pool delete = true 2024-04-25T10:04:47.137 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.137 INFO:teuthology.orchestra.run.smithi007.stdout: mon cluster log file level = debug 2024-04-25T10:04:47.137 INFO:teuthology.orchestra.run.smithi007.stdout: debug asserts on shutdown = true 2024-04-25T10:04:47.137 INFO:teuthology.orchestra.run.smithi007.stdout: mon health detail to clog = false 2024-04-25T10:04:47.137 INFO:teuthology.orchestra.run.smithi007.stdout: mon host = "172.21.15.7,172.21.15.55,[v2:172.21.15.55:3301,v1:172.21.15.55:6790]" 2024-04-25T10:04:47.137 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on skipped message = False 2024-04-25T10:04:47.137 INFO:teuthology.orchestra.run.smithi007.stdout: fsid = c03d0745-5946-49c3-ad88-1165c5b68b4e 2024-04-25T10:04:47.137 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.137 INFO:teuthology.orchestra.run.smithi007.stdout:[osd] 2024-04-25T10:04:47.138 INFO:teuthology.orchestra.run.smithi007.stdout: osd journal size = 100 2024-04-25T10:04:47.138 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.138 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub load threshold = 5.0 2024-04-25T10:04:47.138 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub max interval = 600 2024-04-25T10:04:47.138 INFO:teuthology.orchestra.run.smithi007.stdout: osd mclock profile = high_recovery_ops 2024-04-25T10:04:47.138 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.138 INFO:teuthology.orchestra.run.smithi007.stdout: osd recover clone overlap = true 2024-04-25T10:04:47.138 INFO:teuthology.orchestra.run.smithi007.stdout: osd recovery max chunk = 1048576 2024-04-25T10:04:47.138 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.138 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug shutdown = true 2024-04-25T10:04:47.138 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug op order = true 2024-04-25T10:04:47.138 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug verify stray on activate = true 2024-04-25T10:04:47.138 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug trim objects = true 2024-04-25T10:04:47.138 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.139 INFO:teuthology.orchestra.run.smithi007.stdout: osd open classes on start = true 2024-04-25T10:04:47.139 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug pg log writeout = true 2024-04-25T10:04:47.139 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.139 INFO:teuthology.orchestra.run.smithi007.stdout: osd deep scrub update digest min age = 30 2024-04-25T10:04:47.139 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.139 INFO:teuthology.orchestra.run.smithi007.stdout: osd map max advance = 10 2024-04-25T10:04:47.139 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.139 INFO:teuthology.orchestra.run.smithi007.stdout: journal zero on create = true 2024-04-25T10:04:47.139 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.139 INFO:teuthology.orchestra.run.smithi007.stdout: filestore ondisk finisher threads = 3 2024-04-25T10:04:47.139 INFO:teuthology.orchestra.run.smithi007.stdout: filestore apply finisher threads = 3 2024-04-25T10:04:47.139 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.139 INFO:teuthology.orchestra.run.smithi007.stdout: bdev debug aio = true 2024-04-25T10:04:47.139 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug misdirected ops = true 2024-04-25T10:04:47.139 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore block size = 96636764160 2024-04-25T10:04:47.140 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore fsck on mount = True 2024-04-25T10:04:47.140 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluefs = 20 2024-04-25T10:04:47.140 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluestore = 20 2024-04-25T10:04:47.140 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-04-25T10:04:47.140 INFO:teuthology.orchestra.run.smithi007.stdout: debug osd = 20 2024-04-25T10:04:47.140 INFO:teuthology.orchestra.run.smithi007.stdout: debug rocksdb = 10 2024-04-25T10:04:47.140 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T10:04:47.140 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd full ratio = 0.9 2024-04-25T10:04:47.140 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd nearfull ratio = 0.8 2024-04-25T10:04:47.140 INFO:teuthology.orchestra.run.smithi007.stdout: osd failsafe full ratio = 0.95 2024-04-25T10:04:47.140 INFO:teuthology.orchestra.run.smithi007.stdout: osd objectstore = bluestore 2024-04-25T10:04:47.140 INFO:teuthology.orchestra.run.smithi007.stdout: osd op complaint time = 180 2024-04-25T10:04:47.140 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.140 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr] 2024-04-25T10:04:47.140 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-04-25T10:04:47.141 INFO:teuthology.orchestra.run.smithi007.stdout: debug mgr = 20 2024-04-25T10:04:47.141 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2024-04-25T10:04:47.141 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2024-04-25T10:04:47.141 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:04:47.141 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:04:47.141 INFO:teuthology.orchestra.run.smithi007.stdout: mgr/telemetry/nag = false 2024-04-25T10:04:47.141 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.141 INFO:teuthology.orchestra.run.smithi007.stdout:[mon] 2024-04-25T10:04:47.141 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-04-25T10:04:47.141 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2024-04-25T10:04:47.141 INFO:teuthology.orchestra.run.smithi007.stdout: debug paxos = 20 2024-04-25T10:04:47.141 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2024-04-25T10:04:47.141 INFO:teuthology.orchestra.run.smithi007.stdout: mon data avail warn = 5 2024-04-25T10:04:47.141 INFO:teuthology.orchestra.run.smithi007.stdout: mon mgr mkfs grace = 240 2024-04-25T10:04:47.141 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:04:47.142 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd reporter subtree level = osd 2024-04-25T10:04:47.142 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd prime pg temp = true 2024-04-25T10:04:47.142 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:04:47.142 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.142 INFO:teuthology.orchestra.run.smithi007.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T10:04:47.142 INFO:teuthology.orchestra.run.smithi007.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T10:04:47.142 INFO:teuthology.orchestra.run.smithi007.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T10:04:47.142 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.142 INFO:teuthology.orchestra.run.smithi007.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T10:04:47.142 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T10:04:47.142 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T10:04:47.142 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.142 INFO:teuthology.orchestra.run.smithi007.stdout: # 1m isn't quite enough 2024-04-25T10:04:47.142 INFO:teuthology.orchestra.run.smithi007.stdout: mon_down_mkfs_grace = 2m 2024-04-25T10:04:47.142 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.143 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_filestore_osds = false 2024-04-25T10:04:47.143 INFO:teuthology.orchestra.run.smithi007.stdout: mon op complaint time = 120 2024-04-25T10:04:47.143 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:47.143 INFO:teuthology.orchestra.run.smithi007.stdout:[client] 2024-04-25T10:04:47.143 INFO:teuthology.orchestra.run.smithi007.stdout: rgw cache enabled = true 2024-04-25T10:04:47.143 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable ops log = true 2024-04-25T10:04:47.143 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable usage log = true 2024-04-25T10:04:47.143 INFO:teuthology.orchestra.run.smithi007.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T10:04:47.143 INFO:teuthology.orchestra.run.smithi007.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T10:04:47.143 INFO:teuthology.orchestra.run.smithi007.stdout: client mount timeout = 600 2024-04-25T10:04:47.143 INFO:teuthology.orchestra.run.smithi007.stdout: debug client = 20 2024-04-25T10:04:47.143 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-04-25T10:04:47.143 INFO:teuthology.orchestra.run.smithi007.stdout: pid file = "" 2024-04-25T10:04:47.143 INFO:teuthology.orchestra.run.smithi007.stdout: rados mon op timeout = 900 2024-04-25T10:04:47.144 INFO:teuthology.orchestra.run.smithi007.stdout: rados osd op timeout = 900 2024-04-25T10:04:47.144 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.a] 2024-04-25T10:04:47.144 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.b] 2024-04-25T10:04:47.144 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.c] 2024-04-25T10:04:47.144 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.a] 2024-04-25T10:04:47.144 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.c] 2024-04-25T10:04:47.144 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.b] 2024-04-25T10:04:47.144 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.d] 2024-04-25T10:04:47.144 INFO:teuthology.orchestra.run.smithi007.stdout:[mds] 2024-04-25T10:04:47.144 INFO:teuthology.orchestra.run.smithi007.stdout: debug mds = 20 2024-04-25T10:04:47.144 INFO:teuthology.orchestra.run.smithi007.stdout: debug mds balancer = 20 2024-04-25T10:04:47.144 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-04-25T10:04:47.144 INFO:teuthology.orchestra.run.smithi007.stdout: mds debug frag = True 2024-04-25T10:04:47.144 INFO:teuthology.orchestra.run.smithi007.stdout: mds debug scatterstat = False 2024-04-25T10:04:47.144 INFO:teuthology.orchestra.run.smithi007.stdout: mds op complaint time = 180 2024-04-25T10:04:47.144 INFO:teuthology.orchestra.run.smithi007.stdout: mds verify scatter = False 2024-04-25T10:04:47.145 INFO:teuthology.orchestra.run.smithi007.stdout: osd op complaint time = 180 2024-04-25T10:04:47.145 INFO:teuthology.orchestra.run.smithi007.stdout: rados mon op timeout = 900 2024-04-25T10:04:47.145 INFO:teuthology.orchestra.run.smithi007.stdout: rados osd op timeout = 900 2024-04-25T10:04:47.145 INFO:teuthology.orchestra.run.smithi055.stdout:[global] 2024-04-25T10:04:47.145 INFO:teuthology.orchestra.run.smithi055.stdout: chdir = "" 2024-04-25T10:04:47.145 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T10:04:47.146 INFO:teuthology.orchestra.run.smithi055.stdout: auth supported = cephx 2024-04-25T10:04:47.146 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.146 INFO:teuthology.orchestra.run.smithi055.stdout: filestore xattr use omap = true 2024-04-25T10:04:47.146 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.146 INFO:teuthology.orchestra.run.smithi055.stdout: mon clock drift allowed = 1.000 2024-04-25T10:04:47.146 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.146 INFO:teuthology.orchestra.run.smithi055.stdout: osd crush chooseleaf type = 0 2024-04-25T10:04:47.146 INFO:teuthology.orchestra.run.smithi055.stdout: auth debug = true 2024-04-25T10:04:47.146 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.146 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on old message = true 2024-04-25T10:04:47.146 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on bug = true 2024-04-25T10:04:47.146 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.146 INFO:teuthology.orchestra.run.smithi055.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T10:04:47.146 INFO:teuthology.orchestra.run.smithi055.stdout: mon pg warn max object skew = 0 2024-04-25T10:04:47.147 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.147 INFO:teuthology.orchestra.run.smithi055.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T10:04:47.147 INFO:teuthology.orchestra.run.smithi055.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T10:04:47.147 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.147 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default size = 2 2024-04-25T10:04:47.147 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.147 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow primary affinity = true 2024-04-25T10:04:47.147 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow pg remap = true 2024-04-25T10:04:47.147 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on legacy crush tunables = false 2024-04-25T10:04:47.147 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on crush straw calc version zero = false 2024-04-25T10:04:47.147 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on no sortbitwise = false 2024-04-25T10:04:47.147 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on osd down out interval zero = false 2024-04-25T10:04:47.147 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on too few osds = false 2024-04-25T10:04:47.147 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T10:04:47.147 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T10:04:47.148 INFO:teuthology.orchestra.run.smithi055.stdout: mon_allow_pool_size_one = true 2024-04-25T10:04:47.148 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.148 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T10:04:47.148 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.148 INFO:teuthology.orchestra.run.smithi055.stdout: osd default data pool replay window = 5 2024-04-25T10:04:47.148 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.148 INFO:teuthology.orchestra.run.smithi055.stdout: mon allow pool delete = true 2024-04-25T10:04:47.148 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.148 INFO:teuthology.orchestra.run.smithi055.stdout: mon cluster log file level = debug 2024-04-25T10:04:47.148 INFO:teuthology.orchestra.run.smithi055.stdout: debug asserts on shutdown = true 2024-04-25T10:04:47.148 INFO:teuthology.orchestra.run.smithi055.stdout: mon health detail to clog = false 2024-04-25T10:04:47.148 INFO:teuthology.orchestra.run.smithi055.stdout: mon host = "172.21.15.7,172.21.15.55,[v2:172.21.15.55:3301,v1:172.21.15.55:6790]" 2024-04-25T10:04:47.148 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on skipped message = False 2024-04-25T10:04:47.149 INFO:teuthology.orchestra.run.smithi055.stdout: fsid = c03d0745-5946-49c3-ad88-1165c5b68b4e 2024-04-25T10:04:47.149 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.149 INFO:teuthology.orchestra.run.smithi055.stdout:[osd] 2024-04-25T10:04:47.149 INFO:teuthology.orchestra.run.smithi055.stdout: osd journal size = 100 2024-04-25T10:04:47.149 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.149 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub load threshold = 5.0 2024-04-25T10:04:47.149 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub max interval = 600 2024-04-25T10:04:47.149 INFO:teuthology.orchestra.run.smithi055.stdout: osd mclock profile = high_recovery_ops 2024-04-25T10:04:47.149 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.149 INFO:teuthology.orchestra.run.smithi055.stdout: osd recover clone overlap = true 2024-04-25T10:04:47.149 INFO:teuthology.orchestra.run.smithi055.stdout: osd recovery max chunk = 1048576 2024-04-25T10:04:47.149 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.149 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug shutdown = true 2024-04-25T10:04:47.149 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug op order = true 2024-04-25T10:04:47.149 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug verify stray on activate = true 2024-04-25T10:04:47.150 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug trim objects = true 2024-04-25T10:04:47.150 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.150 INFO:teuthology.orchestra.run.smithi055.stdout: osd open classes on start = true 2024-04-25T10:04:47.150 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug pg log writeout = true 2024-04-25T10:04:47.150 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.150 INFO:teuthology.orchestra.run.smithi055.stdout: osd deep scrub update digest min age = 30 2024-04-25T10:04:47.150 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.150 INFO:teuthology.orchestra.run.smithi055.stdout: osd map max advance = 10 2024-04-25T10:04:47.150 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.150 INFO:teuthology.orchestra.run.smithi055.stdout: journal zero on create = true 2024-04-25T10:04:47.150 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.150 INFO:teuthology.orchestra.run.smithi055.stdout: filestore ondisk finisher threads = 3 2024-04-25T10:04:47.150 INFO:teuthology.orchestra.run.smithi055.stdout: filestore apply finisher threads = 3 2024-04-25T10:04:47.150 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.151 INFO:teuthology.orchestra.run.smithi055.stdout: bdev debug aio = true 2024-04-25T10:04:47.151 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug misdirected ops = true 2024-04-25T10:04:47.151 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore block size = 96636764160 2024-04-25T10:04:47.151 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore fsck on mount = True 2024-04-25T10:04:47.151 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluefs = 20 2024-04-25T10:04:47.151 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluestore = 20 2024-04-25T10:04:47.151 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T10:04:47.151 INFO:teuthology.orchestra.run.smithi055.stdout: debug osd = 20 2024-04-25T10:04:47.151 INFO:teuthology.orchestra.run.smithi055.stdout: debug rocksdb = 10 2024-04-25T10:04:47.151 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T10:04:47.151 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd full ratio = 0.9 2024-04-25T10:04:47.151 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd nearfull ratio = 0.8 2024-04-25T10:04:47.151 INFO:teuthology.orchestra.run.smithi055.stdout: osd failsafe full ratio = 0.95 2024-04-25T10:04:47.151 INFO:teuthology.orchestra.run.smithi055.stdout: osd objectstore = bluestore 2024-04-25T10:04:47.151 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-04-25T10:04:47.152 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.152 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr] 2024-04-25T10:04:47.152 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T10:04:47.152 INFO:teuthology.orchestra.run.smithi055.stdout: debug mgr = 20 2024-04-25T10:04:47.152 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-04-25T10:04:47.152 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-04-25T10:04:47.152 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:04:47.152 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:04:47.152 INFO:teuthology.orchestra.run.smithi055.stdout: mgr/telemetry/nag = false 2024-04-25T10:04:47.152 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.152 INFO:teuthology.orchestra.run.smithi055.stdout:[mon] 2024-04-25T10:04:47.152 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T10:04:47.152 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-04-25T10:04:47.152 INFO:teuthology.orchestra.run.smithi055.stdout: debug paxos = 20 2024-04-25T10:04:47.152 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-04-25T10:04:47.153 INFO:teuthology.orchestra.run.smithi055.stdout: mon data avail warn = 5 2024-04-25T10:04:47.153 INFO:teuthology.orchestra.run.smithi055.stdout: mon mgr mkfs grace = 240 2024-04-25T10:04:47.153 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:04:47.153 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd reporter subtree level = osd 2024-04-25T10:04:47.153 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd prime pg temp = true 2024-04-25T10:04:47.153 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:04:47.153 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.153 INFO:teuthology.orchestra.run.smithi055.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T10:04:47.153 INFO:teuthology.orchestra.run.smithi055.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T10:04:47.153 INFO:teuthology.orchestra.run.smithi055.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T10:04:47.153 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.153 INFO:teuthology.orchestra.run.smithi055.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T10:04:47.153 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T10:04:47.153 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T10:04:47.154 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.154 INFO:teuthology.orchestra.run.smithi055.stdout: # 1m isn't quite enough 2024-04-25T10:04:47.154 INFO:teuthology.orchestra.run.smithi055.stdout: mon_down_mkfs_grace = 2m 2024-04-25T10:04:47.154 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.154 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_filestore_osds = false 2024-04-25T10:04:47.154 INFO:teuthology.orchestra.run.smithi055.stdout: mon op complaint time = 120 2024-04-25T10:04:47.154 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:47.154 INFO:teuthology.orchestra.run.smithi055.stdout:[client] 2024-04-25T10:04:47.154 INFO:teuthology.orchestra.run.smithi055.stdout: rgw cache enabled = true 2024-04-25T10:04:47.154 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable ops log = true 2024-04-25T10:04:47.154 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable usage log = true 2024-04-25T10:04:47.154 INFO:teuthology.orchestra.run.smithi055.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T10:04:47.154 INFO:teuthology.orchestra.run.smithi055.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T10:04:47.154 INFO:teuthology.orchestra.run.smithi055.stdout: client mount timeout = 600 2024-04-25T10:04:47.154 INFO:teuthology.orchestra.run.smithi055.stdout: debug client = 20 2024-04-25T10:04:47.155 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T10:04:47.155 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = "" 2024-04-25T10:04:47.155 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-04-25T10:04:47.155 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-04-25T10:04:47.155 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.a] 2024-04-25T10:04:47.155 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.b] 2024-04-25T10:04:47.155 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.c] 2024-04-25T10:04:47.155 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2024-04-25T10:04:47.155 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2024-04-25T10:04:47.155 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2024-04-25T10:04:47.155 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2024-04-25T10:04:47.155 INFO:teuthology.orchestra.run.smithi055.stdout:[mds] 2024-04-25T10:04:47.155 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds = 20 2024-04-25T10:04:47.155 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds balancer = 20 2024-04-25T10:04:47.155 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T10:04:47.155 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug frag = True 2024-04-25T10:04:47.156 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug scatterstat = False 2024-04-25T10:04:47.156 INFO:teuthology.orchestra.run.smithi055.stdout: mds op complaint time = 180 2024-04-25T10:04:47.156 INFO:teuthology.orchestra.run.smithi055.stdout: mds verify scatter = False 2024-04-25T10:04:47.156 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-04-25T10:04:47.156 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-04-25T10:04:47.156 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-04-25T10:04:47.157 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000001.00000000 bravo_head 2024-04-25T10:04:47.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.234+0000 7fdf0900cf40 1 Processor -- start 2024-04-25T10:04:47.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.234+0000 7fdf0900cf40 1 -- start start 2024-04-25T10:04:47.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.235+0000 7fdf0900cf40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55965eb65ca0 0x55965ec41d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:47.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.235+0000 7fdf0900cf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55965ec23e90 0x55965ec3cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:47.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.235+0000 7fdf0900cf40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55965ec43430 0x55965ec3d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:47.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.235+0000 7fdf0900cf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55965ec24980 con 0x55965ec23e90 2024-04-25T10:04:47.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.235+0000 7fdf0900cf40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55965eb0edf0 con 0x55965eb65ca0 2024-04-25T10:04:47.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.235+0000 7fdf0900cf40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55965eb660b0 con 0x55965ec43430 2024-04-25T10:04:47.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.235+0000 7fdf055a0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55965ec23e90 0x55965ec3cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:47.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.235+0000 7fdf055a0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55965ec23e90 0x55965ec3cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58334/0 (socket says 172.21.15.7:58334) 2024-04-25T10:04:47.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.235+0000 7fdf055a0640 1 -- 172.21.15.7:0/1501659796 learned_addr learned my addr 172.21.15.7:0/1501659796 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:47.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.235+0000 7fdf065a2640 1 --2- 172.21.15.7:0/1501659796 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55965ec43430 0x55965ec3d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:47.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.235+0000 7fdf05da1640 1 --2- 172.21.15.7:0/1501659796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55965eb65ca0 0x55965ec41d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:47.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.235+0000 7fdf055a0640 1 -- 172.21.15.7:0/1501659796 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55965ec43430 msgr2=0x55965ec3d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:47.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.235+0000 7fdf055a0640 1 --2- 172.21.15.7:0/1501659796 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55965ec43430 0x55965ec3d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.235+0000 7fdf055a0640 1 -- 172.21.15.7:0/1501659796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55965eb65ca0 msgr2=0x55965ec41d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:47.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.235+0000 7fdf055a0640 1 --2- 172.21.15.7:0/1501659796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55965eb65ca0 0x55965ec41d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.235+0000 7fdf055a0640 1 -- 172.21.15.7:0/1501659796 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55965ea94c50 con 0x55965ec23e90 2024-04-25T10:04:47.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.236+0000 7fdf055a0640 1 --2- 172.21.15.7:0/1501659796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55965ec23e90 0x55965ec3cfc0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7fdef000a7a0 tx=0x7fdef000a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67646e9647a06ba8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:47.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.236+0000 7fdefffff640 1 -- 172.21.15.7:0/1501659796 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef0019070 con 0x55965ec23e90 2024-04-25T10:04:47.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.236+0000 7fdefffff640 1 -- 172.21.15.7:0/1501659796 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef0007600 con 0x55965ec23e90 2024-04-25T10:04:47.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.236+0000 7fdefffff640 1 -- 172.21.15.7:0/1501659796 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef00079d0 con 0x55965ec23e90 2024-04-25T10:04:47.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.236+0000 7fdf0900cf40 1 -- 172.21.15.7:0/1501659796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55965ec23e90 msgr2=0x55965ec3cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:47.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.236+0000 7fdf0900cf40 1 --2- 172.21.15.7:0/1501659796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55965ec23e90 0x55965ec3cfc0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7fdef000a7a0 tx=0x7fdef000a890 comp rx=0 tx=0).stop 2024-04-25T10:04:47.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.236+0000 7fdf0900cf40 1 -- 172.21.15.7:0/1501659796 shutdown_connections 2024-04-25T10:04:47.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.236+0000 7fdf0900cf40 1 --2- 172.21.15.7:0/1501659796 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55965ec43430 0x55965ec3d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.236+0000 7fdf0900cf40 1 --2- 172.21.15.7:0/1501659796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55965ec23e90 0x55965ec3cfc0 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.236+0000 7fdf0900cf40 1 --2- 172.21.15.7:0/1501659796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55965eb65ca0 0x55965ec41d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.236+0000 7fdf0900cf40 1 -- 172.21.15.7:0/1501659796 >> 172.21.15.7:0/1501659796 conn(0x55965eb66a60 msgr2=0x55965ec24270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:47.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.236+0000 7fdf0900cf40 1 -- 172.21.15.7:0/1501659796 shutdown_connections 2024-04-25T10:04:47.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.236+0000 7fdf0900cf40 1 -- 172.21.15.7:0/1501659796 wait complete. 2024-04-25T10:04:47.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.237+0000 7fdf0900cf40 1 Processor -- start 2024-04-25T10:04:47.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.237+0000 7fdf0900cf40 1 -- start start 2024-04-25T10:04:47.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.237+0000 7fdf0900cf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55965eb65ca0 0x55965ec1e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:47.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.237+0000 7fdf0900cf40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55965ec23e90 0x55965eb924d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:47.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.237+0000 7fdf0900cf40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55965ec43430 0x55965ec1bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:47.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.237+0000 7fdf0900cf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55965ec3f100 con 0x55965eb65ca0 2024-04-25T10:04:47.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.237+0000 7fdf0900cf40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55965ec3ee20 con 0x55965ec23e90 2024-04-25T10:04:47.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.237+0000 7fdf0900cf40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55965ec42be0 con 0x55965ec43430 2024-04-25T10:04:47.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.238+0000 7fdf05da1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55965eb65ca0 0x55965ec1e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:47.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.238+0000 7fdf05da1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55965eb65ca0 0x55965ec1e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58342/0 (socket says 172.21.15.7:58342) 2024-04-25T10:04:47.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.238+0000 7fdf05da1640 1 -- 172.21.15.7:0/3018145163 learned_addr learned my addr 172.21.15.7:0/3018145163 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:47.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.238+0000 7fdf055a0640 1 --2- 172.21.15.7:0/3018145163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55965ec23e90 0x55965eb924d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:47.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.238+0000 7fdf065a2640 1 --2- 172.21.15.7:0/3018145163 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55965ec43430 0x55965ec1bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:47.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.238+0000 7fdf05da1640 1 -- 172.21.15.7:0/3018145163 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55965ec43430 msgr2=0x55965ec1bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:47.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.238+0000 7fdf05da1640 1 --2- 172.21.15.7:0/3018145163 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55965ec43430 0x55965ec1bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.238+0000 7fdf05da1640 1 -- 172.21.15.7:0/3018145163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55965ec23e90 msgr2=0x55965eb924d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:47.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.238+0000 7fdf05da1640 1 --2- 172.21.15.7:0/3018145163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55965ec23e90 0x55965eb924d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.238+0000 7fdf05da1640 1 -- 172.21.15.7:0/3018145163 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55965ec23120 con 0x55965eb65ca0 2024-04-25T10:04:47.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.238+0000 7fdf05da1640 1 --2- 172.21.15.7:0/3018145163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55965eb65ca0 0x55965ec1e090 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fdf0000df50 tx=0x7fdf0000b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:47.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.238+0000 7fdefeffd640 1 -- 172.21.15.7:0/3018145163 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf00014020 con 0x55965eb65ca0 2024-04-25T10:04:47.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.238+0000 7fdefeffd640 1 -- 172.21.15.7:0/3018145163 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf00010410 con 0x55965eb65ca0 2024-04-25T10:04:47.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.238+0000 7fdf0900cf40 1 -- 172.21.15.7:0/3018145163 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55965ec233d0 con 0x55965eb65ca0 2024-04-25T10:04:47.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.238+0000 7fdefeffd640 1 -- 172.21.15.7:0/3018145163 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf00008030 con 0x55965eb65ca0 2024-04-25T10:04:47.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.238+0000 7fdf0900cf40 1 -- 172.21.15.7:0/3018145163 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55965ec1f2d0 con 0x55965eb65ca0 2024-04-25T10:04:47.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.240+0000 7fdefeffd640 1 -- 172.21.15.7:0/3018145163 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdf00017020 con 0x55965eb65ca0 2024-04-25T10:04:47.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.240+0000 7fdefeffd640 1 --2- 172.21.15.7:0/3018145163 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdee8069eb0 0x7fdee806c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:47.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.240+0000 7fdefeffd640 1 -- 172.21.15.7:0/3018145163 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fdf00088ff0 con 0x55965eb65ca0 2024-04-25T10:04:47.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.240+0000 7fdf055a0640 1 --2- 172.21.15.7:0/3018145163 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdee8069eb0 0x7fdee806c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:47.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.240+0000 7fdf0900cf40 1 --2- 172.21.15.7:0/3018145163 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x55965ec1e5d0 0x55965ecd90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:47.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.240+0000 7fdf0900cf40 1 -- 172.21.15.7:0/3018145163 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:1 17.7 17:e2e07930:::10000000001.00000000:head [omap-rm-keys in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118) v9 -- 0x55965eb92a10 con 0x55965ec1e5d0 2024-04-25T10:04:47.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.241+0000 7fdf065a2640 1 --2- 172.21.15.7:0/3018145163 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x55965ec1e5d0 0x55965ecd90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:47.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.241+0000 7fdf055a0640 1 --2- 172.21.15.7:0/3018145163 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdee8069eb0 0x7fdee806c370 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x55965ecd0d60 tx=0x7fdef000c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:47.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.241+0000 7fdf065a2640 1 --2- 172.21.15.7:0/3018145163 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x55965ec1e5d0 0x55965ecd90d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.244+0000 7fdf065a2640 1 -- 172.21.15.7:0/3018145163 <== osd.0 v2:172.21.15.7:6800/4167741236 1 ==== osd_op_reply(1 10000000001.00000000 [omap-rm-keys] v118'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fdef80518f0 con 0x55965ec1e5d0 2024-04-25T10:04:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.244+0000 7fdf0900cf40 1 -- 172.21.15.7:0/3018145163 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x55965ec1e5d0 msgr2=0x55965ecd90d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.244+0000 7fdf0900cf40 1 --2- 172.21.15.7:0/3018145163 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x55965ec1e5d0 0x55965ecd90d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.244+0000 7fdf0900cf40 1 -- 172.21.15.7:0/3018145163 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdee8069eb0 msgr2=0x7fdee806c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.244+0000 7fdf0900cf40 1 --2- 172.21.15.7:0/3018145163 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdee8069eb0 0x7fdee806c370 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x55965ecd0d60 tx=0x7fdef000c000 comp rx=0 tx=0).stop 2024-04-25T10:04:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.244+0000 7fdf0900cf40 1 -- 172.21.15.7:0/3018145163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55965eb65ca0 msgr2=0x55965ec1e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.244+0000 7fdf0900cf40 1 --2- 172.21.15.7:0/3018145163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55965eb65ca0 0x55965ec1e090 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fdf0000df50 tx=0x7fdf0000b6a0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.244+0000 7fdf065a2640 1 -- 172.21.15.7:0/3018145163 reap_dead start 2024-04-25T10:04:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.244+0000 7fdf0900cf40 1 -- 172.21.15.7:0/3018145163 shutdown_connections 2024-04-25T10:04:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.244+0000 7fdf0900cf40 1 -- 172.21.15.7:0/3018145163 >> 172.21.15.7:0/3018145163 conn(0x55965eb66a60 msgr2=0x55965ec24270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.244+0000 7fdf0900cf40 1 -- 172.21.15.7:0/3018145163 shutdown_connections 2024-04-25T10:04:47.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.244+0000 7fdf0900cf40 1 -- 172.21.15.7:0/3018145163 wait complete. 2024-04-25T10:04:47.252 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T10:04:47.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.392+0000 7fa00e8bd640 1 Processor -- start 2024-04-25T10:04:47.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.392+0000 7fa00e8bd640 1 -- start start 2024-04-25T10:04:47.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.392+0000 7fa00e8bd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa0080cda20 0x7fa0080cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:47.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.392+0000 7fa00e8bd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa00809a100 0x7fa00815d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:47.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.392+0000 7fa00e8bd640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0080d02f0 con 0x7fa00806bf10 2024-04-25T10:04:47.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.392+0000 7fa00e8bd640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0080cde00 con 0x7fa0080cda20 2024-04-25T10:04:47.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.392+0000 7fa00e8bd640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0080d05d0 con 0x7fa00809a100 2024-04-25T10:04:47.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.393+0000 7fa007fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa0080cda20 0x7fa0080cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:47.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.393+0000 7fa007fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa0080cda20 0x7fa0080cf9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58358/0 (socket says 172.21.15.7:58358) 2024-04-25T10:04:47.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.393+0000 7fa007fff640 1 -- 172.21.15.7:0/4271931900 learned_addr learned my addr 172.21.15.7:0/4271931900 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:47.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.393+0000 7fa00ce5a640 1 --2- 172.21.15.7:0/4271931900 >> v2:172.21.15.55:3300/0 conn(0x7fa00809a100 0x7fa00815d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:47.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.393+0000 7fa007fff640 1 -- 172.21.15.7:0/4271931900 >> v2:172.21.15.55:3300/0 conn(0x7fa00809a100 msgr2=0x7fa00815d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:47.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.393+0000 7fa007fff640 1 --2- 172.21.15.7:0/4271931900 >> v2:172.21.15.55:3300/0 conn(0x7fa00809a100 0x7fa00815d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.393+0000 7fa007fff640 1 -- 172.21.15.7:0/4271931900 >> v1:172.21.15.55:6789/0 conn(0x7fa00806bf10 legacy=0x7fa0080999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:47.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.393+0000 7fa007fff640 1 -- 172.21.15.7:0/4271931900 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0080d08b0 con 0x7fa0080cda20 2024-04-25T10:04:47.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.394+0000 7fa007fff640 1 --2- 172.21.15.7:0/4271931900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0080cda20 0x7fa0080cf9d0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fa0080cbc00 tx=0x7f9ff802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c92222089b5e472 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:47.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.394+0000 7fa006ffd640 1 -- 172.21.15.7:0/4271931900 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8037070 con 0x7fa0080cda20 2024-04-25T10:04:47.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.394+0000 7fa006ffd640 1 -- 172.21.15.7:0/4271931900 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff8032440 con 0x7fa0080cda20 2024-04-25T10:04:47.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.394+0000 7fa006ffd640 1 -- 172.21.15.7:0/4271931900 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8032810 con 0x7fa0080cda20 2024-04-25T10:04:47.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.394+0000 7fa00e8bd640 1 -- 172.21.15.7:0/4271931900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0080cda20 msgr2=0x7fa0080cf9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:47.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.394+0000 7fa00e8bd640 1 --2- 172.21.15.7:0/4271931900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0080cda20 0x7fa0080cf9d0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fa0080cbc00 tx=0x7f9ff802a270 comp rx=0 tx=0).stop 2024-04-25T10:04:47.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.394+0000 7fa00e8bd640 1 -- 172.21.15.7:0/4271931900 shutdown_connections 2024-04-25T10:04:47.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.394+0000 7fa00e8bd640 1 --2- 172.21.15.7:0/4271931900 >> v2:172.21.15.55:3300/0 conn(0x7fa00809a100 0x7fa00815d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.394+0000 7fa00e8bd640 1 --2- 172.21.15.7:0/4271931900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0080cda20 0x7fa0080cf9d0 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.394+0000 7fa00e8bd640 1 -- 172.21.15.7:0/4271931900 >> 172.21.15.7:0/4271931900 conn(0x7fa0080b3110 msgr2=0x7fa0080b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:47.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.394+0000 7fa00e8bd640 1 -- 172.21.15.7:0/4271931900 shutdown_connections 2024-04-25T10:04:47.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.394+0000 7fa00e8bd640 1 -- 172.21.15.7:0/4271931900 wait complete. 2024-04-25T10:04:47.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.395+0000 7fa00e8bd640 1 Processor -- start 2024-04-25T10:04:47.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.396+0000 7fa00e8bd640 1 -- start start 2024-04-25T10:04:47.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.396+0000 7fa00e8bd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa00806bf10 0x7fa00815b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:47.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.396+0000 7fa00e8bd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa00809a100 0x7fa0080c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:47.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.396+0000 7fa00e8bd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0080cda20 0x7fa0080b5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:47.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.396+0000 7fa00e8bd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0080cff10 con 0x7fa00806bf10 2024-04-25T10:04:47.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.396+0000 7fa00e8bd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0080d0e70 con 0x7fa00809a100 2024-04-25T10:04:47.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.396+0000 7fa00e8bd640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0080d0090 con 0x7fa0080cda20 2024-04-25T10:04:47.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.396+0000 7fa007fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa00806bf10 0x7fa00815b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:47.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.397+0000 7fa007fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa00806bf10 0x7fa00815b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58374/0 (socket says 172.21.15.7:58374) 2024-04-25T10:04:47.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.397+0000 7fa007fff640 1 -- 172.21.15.7:0/2970145811 learned_addr learned my addr 172.21.15.7:0/2970145811 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:47.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.397+0000 7fa00ce5a640 1 --2- 172.21.15.7:0/2970145811 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0080cda20 0x7fa0080b5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:47.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.397+0000 7fa0077fe640 1 --2- 172.21.15.7:0/2970145811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa00809a100 0x7fa0080c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:47.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.397+0000 7fa007fff640 1 -- 172.21.15.7:0/2970145811 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0080cda20 msgr2=0x7fa0080b5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:47.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.397+0000 7fa007fff640 1 --2- 172.21.15.7:0/2970145811 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0080cda20 0x7fa0080b5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.397+0000 7fa007fff640 1 -- 172.21.15.7:0/2970145811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa00809a100 msgr2=0x7fa0080c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:47.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.397+0000 7fa007fff640 1 --2- 172.21.15.7:0/2970145811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa00809a100 0x7fa0080c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.397+0000 7fa007fff640 1 -- 172.21.15.7:0/2970145811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0080b4770 con 0x7fa00806bf10 2024-04-25T10:04:47.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.397+0000 7fa0077fe640 1 --2- 172.21.15.7:0/2970145811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa00809a100 0x7fa0080c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:47.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.397+0000 7fa00ce5a640 1 --2- 172.21.15.7:0/2970145811 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0080cda20 0x7fa0080b5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:47.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.397+0000 7fa007fff640 1 --2- 172.21.15.7:0/2970145811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa00806bf10 0x7fa00815b580 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f9ff802a2b0 tx=0x7f9ff80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:47.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.397+0000 7fa004ff9640 1 -- 172.21.15.7:0/2970145811 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8037040 con 0x7fa00806bf10 2024-04-25T10:04:47.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.397+0000 7fa004ff9640 1 -- 172.21.15.7:0/2970145811 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff8042070 con 0x7fa00806bf10 2024-04-25T10:04:47.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.397+0000 7fa004ff9640 1 -- 172.21.15.7:0/2970145811 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8030880 con 0x7fa00806bf10 2024-04-25T10:04:47.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.397+0000 7fa00e8bd640 1 -- 172.21.15.7:0/2970145811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0080b4a50 con 0x7fa00806bf10 2024-04-25T10:04:47.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.397+0000 7fa00e8bd640 1 -- 172.21.15.7:0/2970145811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0080b5010 con 0x7fa00806bf10 2024-04-25T10:04:47.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.398+0000 7fa00e8bd640 1 -- 172.21.15.7:0/2970145811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa008068f60 con 0x7fa00806bf10 2024-04-25T10:04:47.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.399+0000 7fa004ff9640 1 -- 172.21.15.7:0/2970145811 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9ff8030a20 con 0x7fa00806bf10 2024-04-25T10:04:47.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.399+0000 7fa004ff9640 1 --2- 172.21.15.7:0/2970145811 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9fe806b4d0 0x7f9fe806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:47.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.399+0000 7fa0077fe640 1 --2- 172.21.15.7:0/2970145811 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9fe806b4d0 0x7f9fe806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:47.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.399+0000 7fa004ff9640 1 -- 172.21.15.7:0/2970145811 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f9ff80aace0 con 0x7fa00806bf10 2024-04-25T10:04:47.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.400+0000 7fa0077fe640 1 --2- 172.21.15.7:0/2970145811 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9fe806b4d0 0x7f9fe806d990 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0007fd0 tx=0x7f9ff0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:47.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.404+0000 7fa004ff9640 1 -- 172.21.15.7:0/2970145811 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9ff80798f0 con 0x7fa00806bf10 2024-04-25T10:04:47.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.625+0000 7fa00e8bd640 1 -- 172.21.15.7:0/2970145811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fa0080c6070 con 0x7fa00806bf10 2024-04-25T10:04:47.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.963+0000 7fa004ff9640 1 -- 172.21.15.7:0/2970145811 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v90) v1 ==== 162+0+0 (secure 0 0 0) 0x7f9ff80791f0 con 0x7fa00806bf10 2024-04-25T10:04:47.968 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T10:04:47.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.965+0000 7fa00e8bd640 1 -- 172.21.15.7:0/2970145811 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9fe806b4d0 msgr2=0x7f9fe806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:47.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.965+0000 7fa00e8bd640 1 --2- 172.21.15.7:0/2970145811 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9fe806b4d0 0x7f9fe806d990 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0007fd0 tx=0x7f9ff0009040 comp rx=0 tx=0).stop 2024-04-25T10:04:47.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.965+0000 7fa00e8bd640 1 -- 172.21.15.7:0/2970145811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa00806bf10 msgr2=0x7fa00815b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:47.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.965+0000 7fa00e8bd640 1 --2- 172.21.15.7:0/2970145811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa00806bf10 0x7fa00815b580 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f9ff802a2b0 tx=0x7f9ff80046c0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.965+0000 7fa00e8bd640 1 -- 172.21.15.7:0/2970145811 shutdown_connections 2024-04-25T10:04:47.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.965+0000 7fa00e8bd640 1 --2- 172.21.15.7:0/2970145811 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9fe806b4d0 0x7f9fe806d990 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.965+0000 7fa00e8bd640 1 --2- 172.21.15.7:0/2970145811 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0080cda20 0x7fa0080b5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.965+0000 7fa00e8bd640 1 --2- 172.21.15.7:0/2970145811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa00809a100 0x7fa0080c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.965+0000 7fa00e8bd640 1 --2- 172.21.15.7:0/2970145811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa00806bf10 0x7fa00815b580 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.965+0000 7fa00e8bd640 1 -- 172.21.15.7:0/2970145811 >> 172.21.15.7:0/2970145811 conn(0x7fa0080b3110 msgr2=0x7fa0080701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:47.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.966+0000 7fa00e8bd640 1 -- 172.21.15.7:0/2970145811 shutdown_connections 2024-04-25T10:04:47.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:47.966+0000 7fa00e8bd640 1 -- 172.21.15.7:0/2970145811 wait complete. 2024-04-25T10:04:47.985 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:04:48.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.081+0000 7fa469a9e640 1 Processor -- start 2024-04-25T10:04:48.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.081+0000 7fa469a9e640 1 -- start start 2024-04-25T10:04:48.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.082+0000 7fa469a9e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa46406e970 0x7fa4640cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:48.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.082+0000 7fa469a9e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa4640ced20 0x7fa46415b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:48.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.082+0000 7fa469a9e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4640cdbf0 con 0x7fa464144100 2024-04-25T10:04:48.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.082+0000 7fa469a9e640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4641444e0 con 0x7fa4640ced20 2024-04-25T10:04:48.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.082+0000 7fa469a9e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa46415ac70 con 0x7fa46406e970 2024-04-25T10:04:48.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.082+0000 7fa463fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa4640ced20 0x7fa46415b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:48.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.082+0000 7fa463fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa4640ced20 0x7fa46415b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58388/0 (socket says 172.21.15.7:58388) 2024-04-25T10:04:48.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.082+0000 7fa463fff640 1 -- 172.21.15.7:0/1814833482 learned_addr learned my addr 172.21.15.7:0/1814833482 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:48.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.082+0000 7fa462ffd640 1 --2- 172.21.15.7:0/1814833482 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa46406e970 0x7fa4640cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:48.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.082+0000 7fa463fff640 1 -- 172.21.15.7:0/1814833482 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa46406e970 msgr2=0x7fa4640cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:48.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.082+0000 7fa463fff640 1 --2- 172.21.15.7:0/1814833482 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa46406e970 0x7fa4640cd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.082+0000 7fa463fff640 1 -- 172.21.15.7:0/1814833482 >> v1:172.21.15.55:6789/0 conn(0x7fa464144100 legacy=0x7fa46406e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:48.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.082+0000 7fa463fff640 1 -- 172.21.15.7:0/1814833482 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4640cded0 con 0x7fa4640ced20 2024-04-25T10:04:48.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.083+0000 7fa463fff640 1 --2- 172.21.15.7:0/1814833482 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4640ced20 0x7fa46415b130 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fa45c00d150 tx=0x7fa45c02c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d1dceca8b9a887 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:48.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.083+0000 7fa4627fc640 1 -- 172.21.15.7:0/1814833482 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c009600 con 0x7fa4640ced20 2024-04-25T10:04:48.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.083+0000 7fa4627fc640 1 -- 172.21.15.7:0/1814833482 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45c037070 con 0x7fa4640ced20 2024-04-25T10:04:48.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.083+0000 7fa4627fc640 1 -- 172.21.15.7:0/1814833482 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c0099c0 con 0x7fa4640ced20 2024-04-25T10:04:48.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.084+0000 7fa469a9e640 1 -- 172.21.15.7:0/1814833482 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4640ced20 msgr2=0x7fa46415b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:48.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.084+0000 7fa469a9e640 1 --2- 172.21.15.7:0/1814833482 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4640ced20 0x7fa46415b130 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fa45c00d150 tx=0x7fa45c02c930 comp rx=0 tx=0).stop 2024-04-25T10:04:48.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.084+0000 7fa469a9e640 1 -- 172.21.15.7:0/1814833482 shutdown_connections 2024-04-25T10:04:48.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.084+0000 7fa469a9e640 1 --2- 172.21.15.7:0/1814833482 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4640ced20 0x7fa46415b130 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.084+0000 7fa469a9e640 1 --2- 172.21.15.7:0/1814833482 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa46406e970 0x7fa4640cd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.084+0000 7fa469a9e640 1 -- 172.21.15.7:0/1814833482 >> 172.21.15.7:0/1814833482 conn(0x7fa464071150 msgr2=0x7fa464071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:48.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.084+0000 7fa469a9e640 1 -- 172.21.15.7:0/1814833482 shutdown_connections 2024-04-25T10:04:48.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.084+0000 7fa469a9e640 1 -- 172.21.15.7:0/1814833482 wait complete. 2024-04-25T10:04:48.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.085+0000 7fa469a9e640 1 Processor -- start 2024-04-25T10:04:48.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.085+0000 7fa469a9e640 1 -- start start 2024-04-25T10:04:48.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.086+0000 7fa469a9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa46406e970 0x7fa4641e0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:48.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.086+0000 7fa469a9e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4640ced20 0x7fa464141390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:48.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.086+0000 7fa469a9e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa464144100 0x7fa46413b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:48.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.086+0000 7fa469a9e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4640cea00 con 0x7fa4640ced20 2024-04-25T10:04:48.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.086+0000 7fa469a9e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4640ce490 con 0x7fa46406e970 2024-04-25T10:04:48.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.086+0000 7fa469a9e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa46415b670 con 0x7fa464144100 2024-04-25T10:04:48.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.086+0000 7fa462ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4640ced20 0x7fa464141390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:48.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.086+0000 7fa462ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4640ced20 0x7fa464141390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58392/0 (socket says 172.21.15.7:58392) 2024-04-25T10:04:48.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.086+0000 7fa462ffd640 1 -- 172.21.15.7:0/828356161 learned_addr learned my addr 172.21.15.7:0/828356161 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:48.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.086+0000 7fa4637fe640 1 --2- 172.21.15.7:0/828356161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa46406e970 0x7fa4641e0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:48.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.086+0000 7fa463fff640 1 --2- 172.21.15.7:0/828356161 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa464144100 0x7fa46413b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:48.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.086+0000 7fa462ffd640 1 -- 172.21.15.7:0/828356161 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa464144100 msgr2=0x7fa46413b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:48.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.086+0000 7fa462ffd640 1 --2- 172.21.15.7:0/828356161 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa464144100 0x7fa46413b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.086+0000 7fa462ffd640 1 -- 172.21.15.7:0/828356161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa46406e970 msgr2=0x7fa4641e0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:48.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.086+0000 7fa462ffd640 1 --2- 172.21.15.7:0/828356161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa46406e970 0x7fa4641e0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.086+0000 7fa462ffd640 1 -- 172.21.15.7:0/828356161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4641e0fb0 con 0x7fa4640ced20 2024-04-25T10:04:48.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.086+0000 7fa463fff640 1 --2- 172.21.15.7:0/828356161 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa464144100 0x7fa46413b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:48.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.086+0000 7fa462ffd640 1 --2- 172.21.15.7:0/828356161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4640ced20 0x7fa464141390 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fa45800d800 tx=0x7fa45800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:48.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.087+0000 7fa44bfff640 1 -- 172.21.15.7:0/828356161 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45800b6c0 con 0x7fa4640ced20 2024-04-25T10:04:48.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.087+0000 7fa44bfff640 1 -- 172.21.15.7:0/828356161 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa458019070 con 0x7fa4640ced20 2024-04-25T10:04:48.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.087+0000 7fa469a9e640 1 -- 172.21.15.7:0/828356161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4641e1290 con 0x7fa4640ced20 2024-04-25T10:04:48.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.087+0000 7fa44bfff640 1 -- 172.21.15.7:0/828356161 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45800ba80 con 0x7fa4640ced20 2024-04-25T10:04:48.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.087+0000 7fa469a9e640 1 -- 172.21.15.7:0/828356161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4641e0ca0 con 0x7fa4640ced20 2024-04-25T10:04:48.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.088+0000 7fa469a9e640 1 -- 172.21.15.7:0/828356161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa464068fd0 con 0x7fa4640ced20 2024-04-25T10:04:48.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.088+0000 7fa44bfff640 1 -- 172.21.15.7:0/828356161 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa45800bc20 con 0x7fa4640ced20 2024-04-25T10:04:48.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.088+0000 7fa44bfff640 1 --2- 172.21.15.7:0/828356161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa45006b4d0 0x7fa45006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:48.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.089+0000 7fa44bfff640 1 -- 172.21.15.7:0/828356161 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fa45808a820 con 0x7fa4640ced20 2024-04-25T10:04:48.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.089+0000 7fa4637fe640 1 --2- 172.21.15.7:0/828356161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa45006b4d0 0x7fa45006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:48.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.089+0000 7fa4637fe640 1 --2- 172.21.15.7:0/828356161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa45006b4d0 0x7fa45006d990 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fa4540016e0 tx=0x7fa454009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:48.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.093+0000 7fa44bfff640 1 -- 172.21.15.7:0/828356161 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa4580594c0 con 0x7fa4640ced20 2024-04-25T10:04:48.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.314+0000 7fa469a9e640 1 -- 172.21.15.7:0/828356161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa46406e410 con 0x7fa4640ced20 2024-04-25T10:04:48.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.314+0000 7fa44bfff640 1 -- 172.21.15.7:0/828356161 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4936 (secure 0 0 0) 0x7fa458058dc0 con 0x7fa4640ced20 2024-04-25T10:04:48.324 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:48.324 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":91,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6992,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2679200172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2679200172},{"type":"v1","addr":"172.21.15.7:6837","nonce":2679200172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":7942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/4039147179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":4039147179},{"type":"v1","addr":"172.21.15.55:6833","nonce":4039147179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":7945,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3456170359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3456170359},{"type":"v1","addr":"172.21.15.55:6835","nonce":3456170359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:04:29.599245+0000","modified":"2024-04-25T10:04:47.966416+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":118,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9321":{"gid":9321,"name":"a","rank":0,"incarnation":91,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6836/3781378145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3781378145},{"type":"v1","addr":"172.21.15.7:6836","nonce":3781378145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T10:04:48.325 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 91 2024-04-25T10:04:48.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.316+0000 7fa469a9e640 1 -- 172.21.15.7:0/828356161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa45006b4d0 msgr2=0x7fa45006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:48.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.316+0000 7fa469a9e640 1 --2- 172.21.15.7:0/828356161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa45006b4d0 0x7fa45006d990 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fa4540016e0 tx=0x7fa454009040 comp rx=0 tx=0).stop 2024-04-25T10:04:48.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.316+0000 7fa469a9e640 1 -- 172.21.15.7:0/828356161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4640ced20 msgr2=0x7fa464141390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:48.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.316+0000 7fa469a9e640 1 --2- 172.21.15.7:0/828356161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4640ced20 0x7fa464141390 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fa45800d800 tx=0x7fa45800dcc0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.316+0000 7fa469a9e640 1 -- 172.21.15.7:0/828356161 shutdown_connections 2024-04-25T10:04:48.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.316+0000 7fa469a9e640 1 --2- 172.21.15.7:0/828356161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa45006b4d0 0x7fa45006d990 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.316+0000 7fa469a9e640 1 --2- 172.21.15.7:0/828356161 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa464144100 0x7fa46413b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.316+0000 7fa469a9e640 1 --2- 172.21.15.7:0/828356161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4640ced20 0x7fa464141390 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.316+0000 7fa469a9e640 1 --2- 172.21.15.7:0/828356161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa46406e970 0x7fa4641e0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.316+0000 7fa469a9e640 1 -- 172.21.15.7:0/828356161 >> 172.21.15.7:0/828356161 conn(0x7fa464071150 msgr2=0x7fa464141fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:48.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.316+0000 7fa469a9e640 1 -- 172.21.15.7:0/828356161 shutdown_connections 2024-04-25T10:04:48.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:48.317+0000 7fa469a9e640 1 -- 172.21.15.7:0/828356161 wait complete. 2024-04-25T10:04:48.735 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 91, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:04:29.599245+0000', 'modified': '2024-04-25T10:04:47.966416+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 118, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9321}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9321': {'gid': 9321, 'name': 'a', 'rank': 0, 'incarnation': 91, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.7:6836/3781378145', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 3781378145}, {'type': 'v1', 'addr': '172.21.15.7:6836', 'nonce': 3781378145}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:04:48.736 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9321:up:replay 2024-04-25T10:04:49.737 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:04:49.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.845+0000 7fb86c1c8640 1 Processor -- start 2024-04-25T10:04:49.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.846+0000 7fb86c1c8640 1 -- start start 2024-04-25T10:04:49.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.846+0000 7fb86c1c8640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb86415db00 0x7fb8640d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:49.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.846+0000 7fb86c1c8640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8640ce2b0 0x7fb8640d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:49.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.846+0000 7fb86c1c8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8640d1e80 con 0x7fb8640b53b0 2024-04-25T10:04:49.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.846+0000 7fb86c1c8640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8640b5930 con 0x7fb86415db00 2024-04-25T10:04:49.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.846+0000 7fb86c1c8640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8640b5c10 con 0x7fb8640ce2b0 2024-04-25T10:04:49.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.847+0000 7fb869f64640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb86415db00 0x7fb8640d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:49.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.847+0000 7fb869f64640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb86415db00 0x7fb8640d0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47300/0 (socket says 172.21.15.7:47300) 2024-04-25T10:04:49.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.847+0000 7fb869f64640 1 -- 172.21.15.7:0/3763720006 learned_addr learned my addr 172.21.15.7:0/3763720006 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:49.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.847+0000 7fb86a765640 1 --2- 172.21.15.7:0/3763720006 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8640ce2b0 0x7fb8640d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:49.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.847+0000 7fb869f64640 1 -- 172.21.15.7:0/3763720006 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8640ce2b0 msgr2=0x7fb8640d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:49.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.847+0000 7fb869f64640 1 --2- 172.21.15.7:0/3763720006 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8640ce2b0 0x7fb8640d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.847+0000 7fb869f64640 1 -- 172.21.15.7:0/3763720006 >> v1:172.21.15.55:6789/0 conn(0x7fb8640b53b0 legacy=0x7fb864161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:49.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.847+0000 7fb869f64640 1 -- 172.21.15.7:0/3763720006 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8640b5ef0 con 0x7fb86415db00 2024-04-25T10:04:49.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.848+0000 7fb869f64640 1 --2- 172.21.15.7:0/3763720006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb86415db00 0x7fb8640d0340 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fb860009870 tx=0x7fb86002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a19c9f405cc67b76 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:49.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.848+0000 7fb868f62640 1 -- 172.21.15.7:0/3763720006 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb860037070 con 0x7fb86415db00 2024-04-25T10:04:49.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.848+0000 7fb868f62640 1 -- 172.21.15.7:0/3763720006 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb860032440 con 0x7fb86415db00 2024-04-25T10:04:49.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.848+0000 7fb868f62640 1 -- 172.21.15.7:0/3763720006 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb860032810 con 0x7fb86415db00 2024-04-25T10:04:49.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.848+0000 7fb86c1c8640 1 -- 172.21.15.7:0/3763720006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb86415db00 msgr2=0x7fb8640d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:49.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.848+0000 7fb86c1c8640 1 --2- 172.21.15.7:0/3763720006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb86415db00 0x7fb8640d0340 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fb860009870 tx=0x7fb86002a210 comp rx=0 tx=0).stop 2024-04-25T10:04:49.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.849+0000 7fb86c1c8640 1 -- 172.21.15.7:0/3763720006 shutdown_connections 2024-04-25T10:04:49.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.849+0000 7fb86c1c8640 1 --2- 172.21.15.7:0/3763720006 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb8640ce2b0 0x7fb8640d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.849+0000 7fb86c1c8640 1 --2- 172.21.15.7:0/3763720006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb86415db00 0x7fb8640d0340 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.849+0000 7fb86c1c8640 1 -- 172.21.15.7:0/3763720006 >> 172.21.15.7:0/3763720006 conn(0x7fb864072290 msgr2=0x7fb8640726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:49.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.849+0000 7fb86c1c8640 1 -- 172.21.15.7:0/3763720006 shutdown_connections 2024-04-25T10:04:49.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.849+0000 7fb86c1c8640 1 -- 172.21.15.7:0/3763720006 wait complete. 2024-04-25T10:04:49.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.850+0000 7fb86c1c8640 1 Processor -- start 2024-04-25T10:04:49.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.850+0000 7fb86c1c8640 1 -- start start 2024-04-25T10:04:49.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.851+0000 7fb86c1c8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8640b53b0 0x7fb8640cca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:49.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.851+0000 7fb86c1c8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8640ce2b0 0x7fb8640c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:49.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.851+0000 7fb86c1c8640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb86415db00 0x7fb8640c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:49.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.851+0000 7fb86c1c8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8640d3660 con 0x7fb8640b53b0 2024-04-25T10:04:49.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.851+0000 7fb86c1c8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8640b61d0 con 0x7fb8640ce2b0 2024-04-25T10:04:49.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.851+0000 7fb86c1c8640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8640b6c10 con 0x7fb86415db00 2024-04-25T10:04:49.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.851+0000 7fb869f64640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8640b53b0 0x7fb8640cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:49.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.851+0000 7fb869f64640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8640b53b0 0x7fb8640cca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47306/0 (socket says 172.21.15.7:47306) 2024-04-25T10:04:49.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.851+0000 7fb869f64640 1 -- 172.21.15.7:0/2319109634 learned_addr learned my addr 172.21.15.7:0/2319109634 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:49.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.851+0000 7fb869f64640 1 -- 172.21.15.7:0/2319109634 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb86415db00 msgr2=0x7fb8640c9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:49.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.851+0000 7fb86a765640 1 --2- 172.21.15.7:0/2319109634 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb86415db00 0x7fb8640c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:49.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.851+0000 7fb869763640 1 --2- 172.21.15.7:0/2319109634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8640ce2b0 0x7fb8640c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:49.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.851+0000 7fb869f64640 1 --2- 172.21.15.7:0/2319109634 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb86415db00 0x7fb8640c9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.851+0000 7fb869f64640 1 -- 172.21.15.7:0/2319109634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8640ce2b0 msgr2=0x7fb8640c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:49.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.851+0000 7fb869f64640 1 --2- 172.21.15.7:0/2319109634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8640ce2b0 0x7fb8640c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.851+0000 7fb869f64640 1 -- 172.21.15.7:0/2319109634 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8640cbb00 con 0x7fb8640b53b0 2024-04-25T10:04:49.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.851+0000 7fb86a765640 1 --2- 172.21.15.7:0/2319109634 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb86415db00 0x7fb8640c9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:49.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.851+0000 7fb869763640 1 --2- 172.21.15.7:0/2319109634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8640ce2b0 0x7fb8640c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:49.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.851+0000 7fb869f64640 1 --2- 172.21.15.7:0/2319109634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8640b53b0 0x7fb8640cca80 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fb860009870 tx=0x7fb8600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:49.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.851+0000 7fb85a7fc640 1 -- 172.21.15.7:0/2319109634 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb860041020 con 0x7fb8640b53b0 2024-04-25T10:04:49.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.851+0000 7fb85a7fc640 1 -- 172.21.15.7:0/2319109634 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb860030970 con 0x7fb8640b53b0 2024-04-25T10:04:49.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.851+0000 7fb86c1c8640 1 -- 172.21.15.7:0/2319109634 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8640caaa0 con 0x7fb8640b53b0 2024-04-25T10:04:49.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.851+0000 7fb85a7fc640 1 -- 172.21.15.7:0/2319109634 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb860037040 con 0x7fb8640b53b0 2024-04-25T10:04:49.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.852+0000 7fb86c1c8640 1 -- 172.21.15.7:0/2319109634 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8640cb020 con 0x7fb8640b53b0 2024-04-25T10:04:49.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.852+0000 7fb86c1c8640 1 -- 172.21.15.7:0/2319109634 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb864068fd0 con 0x7fb8640b53b0 2024-04-25T10:04:49.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.853+0000 7fb85a7fc640 1 -- 172.21.15.7:0/2319109634 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb860044020 con 0x7fb8640b53b0 2024-04-25T10:04:49.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.853+0000 7fb85a7fc640 1 --2- 172.21.15.7:0/2319109634 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb84806b4d0 0x7fb84806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:49.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.853+0000 7fb85a7fc640 1 -- 172.21.15.7:0/2319109634 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fb8600aade0 con 0x7fb8640b53b0 2024-04-25T10:04:49.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.853+0000 7fb869763640 1 --2- 172.21.15.7:0/2319109634 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb84806b4d0 0x7fb84806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:49.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.854+0000 7fb869763640 1 --2- 172.21.15.7:0/2319109634 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb84806b4d0 0x7fb84806d990 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fb864067de0 tx=0x7fb854009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:49.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:49.858+0000 7fb85a7fc640 1 -- 172.21.15.7:0/2319109634 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb86004b030 con 0x7fb8640b53b0 2024-04-25T10:04:50.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:50.076+0000 7fb86c1c8640 1 -- 172.21.15.7:0/2319109634 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8640d16b0 con 0x7fb8640b53b0 2024-04-25T10:04:50.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:50.076+0000 7fb85a7fc640 1 -- 172.21.15.7:0/2319109634 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4936 (secure 0 0 0) 0x7fb860079a80 con 0x7fb8640b53b0 2024-04-25T10:04:50.082 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:50.082 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":93,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6992,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2679200172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2679200172},{"type":"v1","addr":"172.21.15.7:6837","nonce":2679200172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":7942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/4039147179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":4039147179},{"type":"v1","addr":"172.21.15.55:6833","nonce":4039147179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":7945,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3456170359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3456170359},{"type":"v1","addr":"172.21.15.55:6835","nonce":3456170359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:04:29.599245+0000","modified":"2024-04-25T10:04:48.984335+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":118,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9321":{"gid":9321,"name":"a","rank":0,"incarnation":91,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.7:6836/3781378145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3781378145},{"type":"v1","addr":"172.21.15.7:6836","nonce":3781378145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T10:04:50.082 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 93 2024-04-25T10:04:50.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:50.078+0000 7fb86c1c8640 1 -- 172.21.15.7:0/2319109634 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb84806b4d0 msgr2=0x7fb84806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:50.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:50.079+0000 7fb86c1c8640 1 --2- 172.21.15.7:0/2319109634 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb84806b4d0 0x7fb84806d990 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fb864067de0 tx=0x7fb854009040 comp rx=0 tx=0).stop 2024-04-25T10:04:50.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:50.079+0000 7fb86c1c8640 1 -- 172.21.15.7:0/2319109634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8640b53b0 msgr2=0x7fb8640cca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:50.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:50.079+0000 7fb86c1c8640 1 --2- 172.21.15.7:0/2319109634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8640b53b0 0x7fb8640cca80 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fb860009870 tx=0x7fb8600046c0 comp rx=0 tx=0).stop 2024-04-25T10:04:50.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:50.079+0000 7fb86c1c8640 1 -- 172.21.15.7:0/2319109634 shutdown_connections 2024-04-25T10:04:50.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:50.079+0000 7fb86c1c8640 1 --2- 172.21.15.7:0/2319109634 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb84806b4d0 0x7fb84806d990 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:50.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:50.079+0000 7fb86c1c8640 1 --2- 172.21.15.7:0/2319109634 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb86415db00 0x7fb8640c9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:50.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:50.079+0000 7fb86c1c8640 1 --2- 172.21.15.7:0/2319109634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8640ce2b0 0x7fb8640c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:50.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:50.079+0000 7fb86c1c8640 1 --2- 172.21.15.7:0/2319109634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8640b53b0 0x7fb8640cca80 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:50.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:50.079+0000 7fb86c1c8640 1 -- 172.21.15.7:0/2319109634 >> 172.21.15.7:0/2319109634 conn(0x7fb864072290 msgr2=0x7fb8640c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:50.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:50.079+0000 7fb86c1c8640 1 -- 172.21.15.7:0/2319109634 shutdown_connections 2024-04-25T10:04:50.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:50.079+0000 7fb86c1c8640 1 -- 172.21.15.7:0/2319109634 wait complete. 2024-04-25T10:04:50.501 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 93, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:04:29.599245+0000', 'modified': '2024-04-25T10:04:48.984335+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 118, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9321}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9321': {'gid': 9321, 'name': 'a', 'rank': 0, 'incarnation': 91, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.7:6836/3781378145', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 3781378145}, {'type': 'v1', 'addr': '172.21.15.7:6836', 'nonce': 3781378145}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:04:50.501 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9321:up:rejoin 2024-04-25T10:04:51.503 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:04:51.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.611+0000 7f6a2c97e640 1 Processor -- start 2024-04-25T10:04:51.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.611+0000 7f6a2c97e640 1 -- start start 2024-04-25T10:04:51.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.612+0000 7f6a2c97e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6a280cea60 0x7f6a280c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:51.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.612+0000 7f6a2c97e640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a2806d1f0 con 0x7f6a2815ced0 2024-04-25T10:04:51.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.612+0000 7f6a2c97e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a2806d4d0 con 0x7f6a2815ee90 2024-04-25T10:04:51.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.612+0000 7f6a2c97e640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a280c6660 con 0x7f6a280cea60 2024-04-25T10:04:51.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.612+0000 7f6a25d9b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6a280cea60 0x7f6a280c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:51.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.612+0000 7f6a26d9d640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f6a2815ced0 0x7f6a280c5f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35700/0 (socket says 172.21.15.7:35700) 2024-04-25T10:04:51.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.612+0000 7f6a26d9d640 1 -- 172.21.15.7:0/1729666311 learned_addr learned my addr 172.21.15.7:0/1729666311 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:51.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.612+0000 7f6a25d9b640 1 --2- 172.21.15.7:0/1729666311 >> v2:172.21.15.7:3300/0 conn(0x7f6a280cea60 0x7f6a280c5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47314/0 (socket says 172.21.15.7:47314) 2024-04-25T10:04:51.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.613+0000 7f6a25d9b640 1 -- 172.21.15.7:0/1729666311 >> v1:172.21.15.55:6789/0 conn(0x7f6a2815ee90 legacy=0x7f6a280ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:51.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.613+0000 7f6a25d9b640 1 -- 172.21.15.7:0/1729666311 >> v1:172.21.15.7:6789/0 conn(0x7f6a2815ced0 legacy=0x7f6a280c5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:51.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.613+0000 7f6a25d9b640 1 -- 172.21.15.7:0/1729666311 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2806d7b0 con 0x7f6a280cea60 2024-04-25T10:04:51.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.613+0000 7f6a2559a640 1 -- 172.21.15.7:0/1729666311 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1475298893 0 0) 0x7f6a2806d1f0 con 0x7f6a2815ced0 2024-04-25T10:04:51.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.613+0000 7f6a25d9b640 1 --2- 172.21.15.7:0/1729666311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a280cea60 0x7f6a280c5a10 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f6a100097a0 tx=0x7f6a1002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1052baf20d943259 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:51.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.613+0000 7f6a2559a640 1 -- 172.21.15.7:0/1729666311 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a10037070 con 0x7f6a280cea60 2024-04-25T10:04:51.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.614+0000 7f6a2559a640 1 -- 172.21.15.7:0/1729666311 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a10032440 con 0x7f6a280cea60 2024-04-25T10:04:51.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.614+0000 7f6a2559a640 1 -- 172.21.15.7:0/1729666311 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a10032810 con 0x7f6a280cea60 2024-04-25T10:04:51.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.614+0000 7f6a2c97e640 1 -- 172.21.15.7:0/1729666311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a280cea60 msgr2=0x7f6a280c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:51.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.614+0000 7f6a2c97e640 1 --2- 172.21.15.7:0/1729666311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a280cea60 0x7f6a280c5a10 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f6a100097a0 tx=0x7f6a1002a1a0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.614+0000 7f6a2c97e640 1 -- 172.21.15.7:0/1729666311 shutdown_connections 2024-04-25T10:04:51.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.614+0000 7f6a2c97e640 1 --2- 172.21.15.7:0/1729666311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a280cea60 0x7f6a280c5a10 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.614+0000 7f6a2c97e640 1 -- 172.21.15.7:0/1729666311 >> 172.21.15.7:0/1729666311 conn(0x7f6a28071150 msgr2=0x7f6a28071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:51.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.614+0000 7f6a2c97e640 1 -- 172.21.15.7:0/1729666311 shutdown_connections 2024-04-25T10:04:51.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.614+0000 7f6a2c97e640 1 -- 172.21.15.7:0/1729666311 wait complete. 2024-04-25T10:04:51.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.616+0000 7f6a2c97e640 1 Processor -- start 2024-04-25T10:04:51.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.616+0000 7f6a2c97e640 1 -- start start 2024-04-25T10:04:51.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.616+0000 7f6a2c97e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a280cea60 0x7f6a28152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:51.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.616+0000 7f6a2c97e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6a2815ced0 0x7f6a2814b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:51.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.616+0000 7f6a2c97e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a2815ee90 0x7f6a28150250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:51.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.616+0000 7f6a2c97e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a281664c0 con 0x7f6a280cea60 2024-04-25T10:04:51.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.616+0000 7f6a2c97e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a28166340 con 0x7f6a2815ee90 2024-04-25T10:04:51.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.616+0000 7f6a2c97e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a28166640 con 0x7f6a2815ced0 2024-04-25T10:04:51.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.616+0000 7f6a2659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a280cea60 0x7f6a28152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:51.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.617+0000 7f6a2659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a280cea60 0x7f6a28152290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47322/0 (socket says 172.21.15.7:47322) 2024-04-25T10:04:51.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.617+0000 7f6a2659c640 1 -- 172.21.15.7:0/3645625362 learned_addr learned my addr 172.21.15.7:0/3645625362 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:51.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.617+0000 7f6a26d9d640 1 --2- 172.21.15.7:0/3645625362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a2815ee90 0x7f6a28150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:51.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.617+0000 7f6a25d9b640 1 --2- 172.21.15.7:0/3645625362 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6a2815ced0 0x7f6a2814b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:51.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.617+0000 7f6a2659c640 1 -- 172.21.15.7:0/3645625362 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6a2815ced0 msgr2=0x7f6a2814b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:51.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.617+0000 7f6a2659c640 1 --2- 172.21.15.7:0/3645625362 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6a2815ced0 0x7f6a2814b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.617+0000 7f6a2659c640 1 -- 172.21.15.7:0/3645625362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a2815ee90 msgr2=0x7f6a28150250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:51.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.617+0000 7f6a2659c640 1 --2- 172.21.15.7:0/3645625362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a2815ee90 0x7f6a28150250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.617+0000 7f6a2659c640 1 -- 172.21.15.7:0/3645625362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2814a560 con 0x7f6a280cea60 2024-04-25T10:04:51.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.617+0000 7f6a2659c640 1 --2- 172.21.15.7:0/3645625362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a280cea60 0x7f6a28152290 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000c400 tx=0x7f6a2000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:51.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.617+0000 7f6a1effd640 1 -- 172.21.15.7:0/3645625362 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a20017070 con 0x7f6a280cea60 2024-04-25T10:04:51.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.617+0000 7f6a1effd640 1 -- 172.21.15.7:0/3645625362 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a200052d0 con 0x7f6a280cea60 2024-04-25T10:04:51.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.617+0000 7f6a2c97e640 1 -- 172.21.15.7:0/3645625362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2814a840 con 0x7f6a280cea60 2024-04-25T10:04:51.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.617+0000 7f6a1effd640 1 -- 172.21.15.7:0/3645625362 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a20003830 con 0x7f6a280cea60 2024-04-25T10:04:51.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.617+0000 7f6a2c97e640 1 -- 172.21.15.7:0/3645625362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a2814ae00 con 0x7f6a280cea60 2024-04-25T10:04:51.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.618+0000 7f6a2c97e640 1 -- 172.21.15.7:0/3645625362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a28068fd0 con 0x7f6a280cea60 2024-04-25T10:04:51.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.619+0000 7f6a1effd640 1 -- 172.21.15.7:0/3645625362 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6a2001a070 con 0x7f6a280cea60 2024-04-25T10:04:51.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.619+0000 7f6a1effd640 1 --2- 172.21.15.7:0/3645625362 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6a0806b4d0 0x7f6a0806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:51.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.619+0000 7f6a1effd640 1 -- 172.21.15.7:0/3645625362 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f6a20089630 con 0x7f6a280cea60 2024-04-25T10:04:51.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.619+0000 7f6a25d9b640 1 --2- 172.21.15.7:0/3645625362 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6a0806b4d0 0x7f6a0806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:51.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.620+0000 7f6a25d9b640 1 --2- 172.21.15.7:0/3645625362 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6a0806b4d0 0x7f6a0806d990 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6a10034000 tx=0x7f6a1002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:51.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.624+0000 7f6a1effd640 1 -- 172.21.15.7:0/3645625362 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6a20057d10 con 0x7f6a280cea60 2024-04-25T10:04:51.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.845+0000 7f6a2c97e640 1 -- 172.21.15.7:0/3645625362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a28159910 con 0x7f6a280cea60 2024-04-25T10:04:51.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.846+0000 7f6a1effd640 1 -- 172.21.15.7:0/3645625362 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4936 (secure 0 0 0) 0x7f6a2005bdb0 con 0x7f6a280cea60 2024-04-25T10:04:51.851 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:51.852 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":94,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6992,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2679200172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2679200172},{"type":"v1","addr":"172.21.15.7:6837","nonce":2679200172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":7942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/4039147179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":4039147179},{"type":"v1","addr":"172.21.15.55:6833","nonce":4039147179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":7945,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3456170359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3456170359},{"type":"v1","addr":"172.21.15.55:6835","nonce":3456170359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:04:29.599245+0000","modified":"2024-04-25T10:04:49.986796+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":118,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9321":{"gid":9321,"name":"a","rank":0,"incarnation":91,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/3781378145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3781378145},{"type":"v1","addr":"172.21.15.7:6836","nonce":3781378145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T10:04:51.852 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 94 2024-04-25T10:04:51.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.848+0000 7f6a2c97e640 1 -- 172.21.15.7:0/3645625362 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6a0806b4d0 msgr2=0x7f6a0806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:51.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.848+0000 7f6a2c97e640 1 --2- 172.21.15.7:0/3645625362 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6a0806b4d0 0x7f6a0806d990 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6a10034000 tx=0x7f6a1002e000 comp rx=0 tx=0).stop 2024-04-25T10:04:51.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.848+0000 7f6a2c97e640 1 -- 172.21.15.7:0/3645625362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a280cea60 msgr2=0x7f6a28152290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:51.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.848+0000 7f6a2c97e640 1 --2- 172.21.15.7:0/3645625362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a280cea60 0x7f6a28152290 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000c400 tx=0x7f6a2000c8c0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.848+0000 7f6a2c97e640 1 -- 172.21.15.7:0/3645625362 shutdown_connections 2024-04-25T10:04:51.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.848+0000 7f6a2c97e640 1 --2- 172.21.15.7:0/3645625362 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6a0806b4d0 0x7f6a0806d990 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.848+0000 7f6a2c97e640 1 --2- 172.21.15.7:0/3645625362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a2815ee90 0x7f6a28150250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.848+0000 7f6a2c97e640 1 --2- 172.21.15.7:0/3645625362 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6a2815ced0 0x7f6a2814b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.848+0000 7f6a2c97e640 1 --2- 172.21.15.7:0/3645625362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a280cea60 0x7f6a28152290 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.849+0000 7f6a2c97e640 1 -- 172.21.15.7:0/3645625362 >> 172.21.15.7:0/3645625362 conn(0x7f6a28071150 msgr2=0x7f6a2815d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:51.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.849+0000 7f6a2c97e640 1 -- 172.21.15.7:0/3645625362 shutdown_connections 2024-04-25T10:04:51.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:51.849+0000 7f6a2c97e640 1 -- 172.21.15.7:0/3645625362 wait complete. 2024-04-25T10:04:52.267 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 94, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:04:29.599245+0000', 'modified': '2024-04-25T10:04:49.986796+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 118, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9321}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9321': {'gid': 9321, 'name': 'a', 'rank': 0, 'incarnation': 91, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.7:6836/3781378145', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 3781378145}, {'type': 'v1', 'addr': '172.21.15.7:6836', 'nonce': 3781378145}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:04:52.268 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T10:04:52.268 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T10:04:52.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.369+0000 7f8bb8e38640 1 Processor -- start 2024-04-25T10:04:52.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.369+0000 7f8bb8e38640 1 -- start start 2024-04-25T10:04:52.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.369+0000 7f8bb8e38640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8bb415d7b0 0x7f8bb406fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.370+0000 7f8bb8e38640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8bb415eba0 0x7f8bb40b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.370+0000 7f8bb8e38640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb41618f0 con 0x7f8bb40b53c0 2024-04-25T10:04:52.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.370+0000 7f8bb8e38640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb4161bd0 con 0x7f8bb415d7b0 2024-04-25T10:04:52.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.370+0000 7f8bb8e38640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb4161eb0 con 0x7f8bb415eba0 2024-04-25T10:04:52.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.370+0000 7f8bb259c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8bb415d7b0 0x7f8bb406fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.370+0000 7f8bb259c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8bb415d7b0 0x7f8bb406fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47326/0 (socket says 172.21.15.7:47326) 2024-04-25T10:04:52.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.370+0000 7f8bb259c640 1 -- 172.21.15.7:0/2811829895 learned_addr learned my addr 172.21.15.7:0/2811829895 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:52.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.370+0000 7f8bb2d9d640 1 --2- 172.21.15.7:0/2811829895 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8bb415eba0 0x7f8bb40b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.370+0000 7f8bb259c640 1 -- 172.21.15.7:0/2811829895 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8bb415eba0 msgr2=0x7f8bb40b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:52.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.370+0000 7f8bb259c640 1 --2- 172.21.15.7:0/2811829895 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8bb415eba0 0x7f8bb40b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.370+0000 7f8bb259c640 1 -- 172.21.15.7:0/2811829895 >> v1:172.21.15.55:6789/0 conn(0x7f8bb40b53c0 legacy=0x7f8bb406ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:52.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.370+0000 7f8bb259c640 1 -- 172.21.15.7:0/2811829895 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb4162190 con 0x7f8bb415d7b0 2024-04-25T10:04:52.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.370+0000 7f8bb2d9d640 1 --2- 172.21.15.7:0/2811829895 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8bb415eba0 0x7f8bb40b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:52.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.371+0000 7f8bb259c640 1 --2- 172.21.15.7:0/2811829895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bb415d7b0 0x7f8bb406fa00 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f8bac009870 tx=0x7f8bac02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b41b99b02fa28475 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:52.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.371+0000 7f8bb159a640 1 -- 172.21.15.7:0/2811829895 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac037070 con 0x7f8bb415d7b0 2024-04-25T10:04:52.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.371+0000 7f8bb159a640 1 -- 172.21.15.7:0/2811829895 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bac032440 con 0x7f8bb415d7b0 2024-04-25T10:04:52.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.371+0000 7f8bb159a640 1 -- 172.21.15.7:0/2811829895 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac032810 con 0x7f8bb415d7b0 2024-04-25T10:04:52.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.371+0000 7f8bb8e38640 1 -- 172.21.15.7:0/2811829895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bb415d7b0 msgr2=0x7f8bb406fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:52.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.371+0000 7f8bb8e38640 1 --2- 172.21.15.7:0/2811829895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bb415d7b0 0x7f8bb406fa00 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f8bac009870 tx=0x7f8bac02a210 comp rx=0 tx=0).stop 2024-04-25T10:04:52.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.372+0000 7f8bb8e38640 1 -- 172.21.15.7:0/2811829895 shutdown_connections 2024-04-25T10:04:52.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.372+0000 7f8bb8e38640 1 --2- 172.21.15.7:0/2811829895 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8bb415eba0 0x7f8bb40b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.372+0000 7f8bb8e38640 1 --2- 172.21.15.7:0/2811829895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bb415d7b0 0x7f8bb406fa00 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.372+0000 7f8bb8e38640 1 -- 172.21.15.7:0/2811829895 >> 172.21.15.7:0/2811829895 conn(0x7f8bb40b2390 msgr2=0x7f8bb40b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:52.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.372+0000 7f8bb8e38640 1 -- 172.21.15.7:0/2811829895 shutdown_connections 2024-04-25T10:04:52.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.372+0000 7f8bb8e38640 1 -- 172.21.15.7:0/2811829895 wait complete. 2024-04-25T10:04:52.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.373+0000 7f8bb8e38640 1 Processor -- start 2024-04-25T10:04:52.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.373+0000 7f8bb8e38640 1 -- start start 2024-04-25T10:04:52.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.374+0000 7f8bb8e38640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bb40b53c0 0x7f8bb40cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.374+0000 7f8bb8e38640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bb415d7b0 0x7f8bb41f7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.374+0000 7f8bb8e38640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8bb415eba0 0x7f8bb4160440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.374+0000 7f8bb8e38640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb406b3f0 con 0x7f8bb40b53c0 2024-04-25T10:04:52.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.374+0000 7f8bb8e38640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb406b270 con 0x7f8bb415d7b0 2024-04-25T10:04:52.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.374+0000 7f8bb8e38640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb40b5850 con 0x7f8bb415eba0 2024-04-25T10:04:52.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.374+0000 7f8bb259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bb40b53c0 0x7f8bb40cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.374+0000 7f8bb259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bb40b53c0 0x7f8bb40cc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47328/0 (socket says 172.21.15.7:47328) 2024-04-25T10:04:52.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.374+0000 7f8bb259c640 1 -- 172.21.15.7:0/3606519042 learned_addr learned my addr 172.21.15.7:0/3606519042 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:52.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.374+0000 7f8bb259c640 1 -- 172.21.15.7:0/3606519042 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8bb415eba0 msgr2=0x7f8bb4160440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:52.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.374+0000 7f8bb259c640 1 --2- 172.21.15.7:0/3606519042 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8bb415eba0 0x7f8bb4160440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.374+0000 7f8bb259c640 1 -- 172.21.15.7:0/3606519042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bb415d7b0 msgr2=0x7f8bb41f7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:52.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.374+0000 7f8bb259c640 1 --2- 172.21.15.7:0/3606519042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bb415d7b0 0x7f8bb41f7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.374+0000 7f8bb259c640 1 -- 172.21.15.7:0/3606519042 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb40a8b40 con 0x7f8bb40b53c0 2024-04-25T10:04:52.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.374+0000 7f8bb259c640 1 --2- 172.21.15.7:0/3606519042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bb40b53c0 0x7f8bb40cc4c0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f8bac009870 tx=0x7f8bac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:52.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.374+0000 7f8baaffd640 1 -- 172.21.15.7:0/3606519042 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac041020 con 0x7f8bb40b53c0 2024-04-25T10:04:52.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.374+0000 7f8baaffd640 1 -- 172.21.15.7:0/3606519042 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bac030970 con 0x7f8bb40b53c0 2024-04-25T10:04:52.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.374+0000 7f8bb8e38640 1 -- 172.21.15.7:0/3606519042 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb40a8580 con 0x7f8bb40b53c0 2024-04-25T10:04:52.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.374+0000 7f8baaffd640 1 -- 172.21.15.7:0/3606519042 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac037040 con 0x7f8bb40b53c0 2024-04-25T10:04:52.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.375+0000 7f8bb8e38640 1 -- 172.21.15.7:0/3606519042 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb40c9d40 con 0x7f8bb40b53c0 2024-04-25T10:04:52.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.376+0000 7f8baaffd640 1 -- 172.21.15.7:0/3606519042 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8bac044020 con 0x7f8bb40b53c0 2024-04-25T10:04:52.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.376+0000 7f8baaffd640 1 --2- 172.21.15.7:0/3606519042 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8b9406b4d0 0x7f8b9406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.377+0000 7f8baaffd640 1 -- 172.21.15.7:0/3606519042 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f8bac0aa9f0 con 0x7f8bb40b53c0 2024-04-25T10:04:52.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.377+0000 7f8bb1d9b640 1 --2- 172.21.15.7:0/3606519042 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8b9406b4d0 0x7f8b9406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.377+0000 7f8bb1d9b640 1 --2- 172.21.15.7:0/3606519042 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8b9406b4d0 0x7f8b9406d990 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c006fd0 tx=0x7f8b9c006bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:52.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.377+0000 7f8bbbc1a740 1 Processor -- start 2024-04-25T10:04:52.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.378+0000 7f8bbbc1a740 1 -- start start 2024-04-25T10:04:52.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.378+0000 7f8bbbc1a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bd9c0e230 0x563bd9c0e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.378+0000 7f8bbbc1a740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563bd9c2bad0 0x563bd9c2c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.378+0000 7f8bbbc1a740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563bd9be3f10 0x563bd9c2a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.378+0000 7f8bbbc1a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bd9b46a10 con 0x563bd9c0e230 2024-04-25T10:04:52.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.378+0000 7f8bbbc1a740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bd9aefb30 con 0x563bd9c2bad0 2024-04-25T10:04:52.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.378+0000 7f8bbbc1a740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x563bd9b42c50 con 0x563bd9be3f10 2024-04-25T10:04:52.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.378+0000 7f8bb259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bd9c0e230 0x563bd9c0e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.378+0000 7f8bb259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bd9c0e230 0x563bd9c0e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47340/0 (socket says 172.21.15.7:47340) 2024-04-25T10:04:52.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.379+0000 7f8bb259c640 1 -- 172.21.15.7:0/1304163599 learned_addr learned my addr 172.21.15.7:0/1304163599 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:52.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.379+0000 7f8bb1d9b640 1 --2- 172.21.15.7:0/1304163599 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563bd9c2bad0 0x563bd9c2c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.379+0000 7f8bb259c640 1 -- 172.21.15.7:0/1304163599 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563bd9be3f10 msgr2=0x563bd9c2a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:52.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.379+0000 7f8bb259c640 1 --2- 172.21.15.7:0/1304163599 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563bd9be3f10 0x563bd9c2a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.379+0000 7f8bb259c640 1 -- 172.21.15.7:0/1304163599 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563bd9c2bad0 msgr2=0x563bd9c2c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:52.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.379+0000 7f8bb259c640 1 --2- 172.21.15.7:0/1304163599 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563bd9c2bad0 0x563bd9c2c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.379+0000 7f8bb259c640 1 -- 172.21.15.7:0/1304163599 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563bd9b04e10 con 0x563bd9c0e230 2024-04-25T10:04:52.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.379+0000 7f8bb1d9b640 1 --2- 172.21.15.7:0/1304163599 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563bd9c2bad0 0x563bd9c2c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:52.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.379+0000 7f8bb259c640 1 --2- 172.21.15.7:0/1304163599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bd9c0e230 0x563bd9c0e610 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f8bac081200 tx=0x7f8bac078c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=381f97e863de9f93 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:52.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.379+0000 7f8b93fff640 1 -- 172.21.15.7:0/1304163599 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac090020 con 0x563bd9c0e230 2024-04-25T10:04:52.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.379+0000 7f8b93fff640 1 -- 172.21.15.7:0/1304163599 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bac079020 con 0x563bd9c0e230 2024-04-25T10:04:52.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.379+0000 7f8b93fff640 1 -- 172.21.15.7:0/1304163599 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac07d170 con 0x563bd9c0e230 2024-04-25T10:04:52.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.380+0000 7f8bbbc1a740 1 -- 172.21.15.7:0/1304163599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bd9c0e230 msgr2=0x563bd9c0e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:52.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.380+0000 7f8bbbc1a740 1 --2- 172.21.15.7:0/1304163599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bd9c0e230 0x563bd9c0e610 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f8bac081200 tx=0x7f8bac078c90 comp rx=0 tx=0).stop 2024-04-25T10:04:52.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.380+0000 7f8bbbc1a740 1 -- 172.21.15.7:0/1304163599 shutdown_connections 2024-04-25T10:04:52.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.380+0000 7f8bbbc1a740 1 --2- 172.21.15.7:0/1304163599 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563bd9be3f10 0x563bd9c2a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.380+0000 7f8bbbc1a740 1 --2- 172.21.15.7:0/1304163599 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563bd9c2bad0 0x563bd9c2c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.380+0000 7f8bbbc1a740 1 --2- 172.21.15.7:0/1304163599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bd9c0e230 0x563bd9c0e610 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.380+0000 7f8bbbc1a740 1 -- 172.21.15.7:0/1304163599 >> 172.21.15.7:0/1304163599 conn(0x563bd9be0840 msgr2=0x563bd9c29040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:52.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.380+0000 7f8bbbc1a740 1 -- 172.21.15.7:0/1304163599 shutdown_connections 2024-04-25T10:04:52.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.380+0000 7f8bbbc1a740 1 -- 172.21.15.7:0/1304163599 wait complete. 2024-04-25T10:04:52.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.380+0000 7f8bbbc1a740 1 -- start start 2024-04-25T10:04:52.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.380+0000 7f8bbbc1a740 1 Processor -- start 2024-04-25T10:04:52.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.381+0000 7f8bbbc1a740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563bd9c0e230 0x563bd9c3bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.381+0000 7f8bbbc1a740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563bd9c2bad0 0x563bd9c3c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.381+0000 7f8bbbc1a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bd9c38d90 0x563bd9bdd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.381+0000 7f8bbbc1a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bd9b46a10 con 0x563bd9c38d90 2024-04-25T10:04:52.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.381+0000 7f8bbbc1a740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bd9b030c0 con 0x563bd9c0e230 2024-04-25T10:04:52.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.381+0000 7f8bbbc1a740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x563bd9be4cb0 con 0x563bd9c2bad0 2024-04-25T10:04:52.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.381+0000 7f8bbbc1a740 10 client.0 _ll_register_callbacks cb 0x563bd9af6ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:04:52.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.381+0000 7f8bb2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bd9c38d90 0x563bd9bdd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.382+0000 7f8bb2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bd9c38d90 0x563bd9bdd4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47350/0 (socket says 172.21.15.7:47350) 2024-04-25T10:04:52.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.382+0000 7f8bb2d9d640 1 -- 172.21.15.7:0/2470922931 learned_addr learned my addr 172.21.15.7:0/2470922931 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:52.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.382+0000 7f8bb259c640 1 --2- 172.21.15.7:0/2470922931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563bd9c0e230 0x563bd9c3bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.382+0000 7f8bb1d9b640 1 --2- 172.21.15.7:0/2470922931 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563bd9c2bad0 0x563bd9c3c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.382+0000 7f8bb2d9d640 1 -- 172.21.15.7:0/2470922931 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563bd9c2bad0 msgr2=0x563bd9c3c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:52.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.382+0000 7f8bb2d9d640 1 --2- 172.21.15.7:0/2470922931 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563bd9c2bad0 0x563bd9c3c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.382+0000 7f8bb2d9d640 1 -- 172.21.15.7:0/2470922931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563bd9c0e230 msgr2=0x563bd9c3bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:52.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.382+0000 7f8bb2d9d640 1 --2- 172.21.15.7:0/2470922931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563bd9c0e230 0x563bd9c3bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.382+0000 7f8bb2d9d640 1 -- 172.21.15.7:0/2470922931 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563bd985b2d0 con 0x563bd9c38d90 2024-04-25T10:04:52.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.382+0000 7f8bb1d9b640 1 --2- 172.21.15.7:0/2470922931 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563bd9c2bad0 0x563bd9c3c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:52.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.382+0000 7f8bb2d9d640 1 --2- 172.21.15.7:0/2470922931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bd9c38d90 0x563bd9bdd4a0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400daa0 tx=0x7f8ba400df60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8f2ac7164675c55 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:52.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.382+0000 7f8b917fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:04:52.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.382+0000 7f8b917fa640 1 -- 172.21.15.7:0/2470922931 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba401b060 con 0x563bd9c38d90 2024-04-25T10:04:52.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.382+0000 7f8b917fa640 1 -- 172.21.15.7:0/2470922931 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(118..118 src has 1..118) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f8ba400bdd0 con 0x563bd9c38d90 2024-04-25T10:04:52.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.382+0000 7f8bbbc1a740 1 -- 172.21.15.7:0/2470922931 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8bac079020 con 0x563bd9c38d90 2024-04-25T10:04:52.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.382+0000 7f8b917fa640 1 -- 172.21.15.7:0/2470922931 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ba4021050 con 0x563bd9c38d90 2024-04-25T10:04:52.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.382+0000 7f8bbbc1a740 10 client.9372 fetch_fsmap learned FSMap version 94 2024-04-25T10:04:52.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.382+0000 7f8bbbc1a740 1 -- 172.21.15.7:0/2470922931 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) v3 -- 0x563bd99256b0 con 0x563bd9c38d90 2024-04-25T10:04:52.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.382+0000 7f8b917fa640 1 -- 172.21.15.7:0/2470922931 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bac079020 con 0x563bd9c38d90 2024-04-25T10:04:52.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.383+0000 7f8b917fa640 1 -- 172.21.15.7:0/2470922931 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 94) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8ba4024020 con 0x563bd9c38d90 2024-04-25T10:04:52.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.383+0000 7f8bbbc1a740 10 client.9372 fetch_fsmap finished waiting for FSMap version 94 2024-04-25T10:04:52.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.383+0000 7f8bbbc1a740 10 client.9372 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:04:52.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.383+0000 7f8bbbc1a740 20 client.9372 populate_metadata read hostname 'smithi007' 2024-04-25T10:04:52.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.383+0000 7f8bbbc1a740 1 --2- 172.21.15.7:0/2470922931 >> [v2:172.21.15.7:6834/3781378145,v1:172.21.15.7:6836/3781378145] conn(0x563bd9c114b0 0x563bd9c2a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.383+0000 7f8bbbc1a740 4 client.9372 mds_command: new command op to 9321 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:04:52.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.383+0000 7f8bbbc1a740 1 -- 172.21.15.7:0/2470922931 --> [v2:172.21.15.7:6834/3781378145,v1:172.21.15.7:6836/3781378145] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563bd9ba5920 con 0x563bd9c114b0 2024-04-25T10:04:52.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.383+0000 7f8bb259c640 1 --2- 172.21.15.7:0/2470922931 >> [v2:172.21.15.7:6834/3781378145,v1:172.21.15.7:6836/3781378145] conn(0x563bd9c114b0 0x563bd9c2a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.383+0000 7f8b917fa640 10 client.9372 ms_handle_connect on v2:172.21.15.7:6834/3781378145 2024-04-25T10:04:52.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.383+0000 7f8bb259c640 1 --2- 172.21.15.7:0/2470922931 >> [v2:172.21.15.7:6834/3781378145,v1:172.21.15.7:6836/3781378145] conn(0x563bd9c114b0 0x563bd9c2a4c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f2b61ccb5989b12 server_cookie=ec2e9e5720840e8c in_seq=0 out_seq=0 2024-04-25T10:04:52.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.384+0000 7f8b917fa640 1 -- 172.21.15.7:0/2470922931 <== mds.0 v2:172.21.15.7:6834/3781378145 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563bd9ba5920 con 0x563bd9c114b0 2024-04-25T10:04:52.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.384+0000 7f8b917fa640 10 client.9372 handle_command_reply: tid=0 2024-04-25T10:04:52.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.384+0000 7f8bbbc1a740 1 client.9372 shutdown 2024-04-25T10:04:52.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.384+0000 7f8bbbc1a740 1 -- 172.21.15.7:0/2470922931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bd9c38d90 msgr2=0x563bd9bdd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:52.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.384+0000 7f8bbbc1a740 1 --2- 172.21.15.7:0/2470922931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bd9c38d90 0x563bd9bdd4a0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400daa0 tx=0x7f8ba400df60 comp rx=0 tx=0).stop 2024-04-25T10:04:52.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.384+0000 7f8bbbc1a740 1 -- 172.21.15.7:0/2470922931 shutdown_connections 2024-04-25T10:04:52.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.384+0000 7f8bbbc1a740 1 --2- 172.21.15.7:0/2470922931 >> [v2:172.21.15.7:6834/3781378145,v1:172.21.15.7:6836/3781378145] conn(0x563bd9c114b0 0x563bd9c2a4c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.384+0000 7f8bbbc1a740 1 --2- 172.21.15.7:0/2470922931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bd9c38d90 0x563bd9bdd4a0 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.384+0000 7f8bbbc1a740 1 --2- 172.21.15.7:0/2470922931 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563bd9c2bad0 0x563bd9c3c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.384+0000 7f8bbbc1a740 1 --2- 172.21.15.7:0/2470922931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563bd9c0e230 0x563bd9c3bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.384+0000 7f8b917fa640 0 client.9372 ms_handle_reset on v2:172.21.15.7:6834/3781378145 2024-04-25T10:04:52.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.384+0000 7f8bbbc1a740 1 -- 172.21.15.7:0/2470922931 >> 172.21.15.7:0/2470922931 conn(0x563bd9be3f10 msgr2=0x563bd9c2ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:52.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.384+0000 7f8bbbc1a740 1 -- 172.21.15.7:0/2470922931 shutdown_connections 2024-04-25T10:04:52.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.384+0000 7f8bbbc1a740 1 -- 172.21.15.7:0/2470922931 wait complete. 2024-04-25T10:04:52.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.384+0000 7f8bbbc1a740 20 client.9372 trim_cache size 0 max 16384 2024-04-25T10:04:52.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.400+0000 7f8bbbc1a740 1 Processor -- start 2024-04-25T10:04:52.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.400+0000 7f8bbbc1a740 1 -- start start 2024-04-25T10:04:52.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.400+0000 7f8bbbc1a740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563bd9c0e230 0x563bd9be44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.400+0000 7f8bbbc1a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bd9c2bad0 0x563bd9c1e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.400+0000 7f8bbbc1a740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563bd9c38d90 0x563bd9c1ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.400+0000 7f8bbbc1a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb41ff870 con 0x563bd9c2bad0 2024-04-25T10:04:52.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.400+0000 7f8bbbc1a740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb40cb3a0 con 0x563bd9c38d90 2024-04-25T10:04:52.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.400+0000 7f8bbbc1a740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb41ff2c0 con 0x563bd9c0e230 2024-04-25T10:04:52.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.401+0000 7f8bb1d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bd9c2bad0 0x563bd9c1e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.401+0000 7f8bb1d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bd9c2bad0 0x563bd9c1e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47354/0 (socket says 172.21.15.7:47354) 2024-04-25T10:04:52.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.401+0000 7f8bb1d9b640 1 -- 172.21.15.7:0/1758523574 learned_addr learned my addr 172.21.15.7:0/1758523574 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:52.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.401+0000 7f8bb2d9d640 1 --2- 172.21.15.7:0/1758523574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563bd9c38d90 0x563bd9c1ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.401+0000 7f8bb259c640 1 --2- 172.21.15.7:0/1758523574 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563bd9c0e230 0x563bd9be44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.401+0000 7f8bb1d9b640 1 -- 172.21.15.7:0/1758523574 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563bd9c0e230 msgr2=0x563bd9be44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:52.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.401+0000 7f8bb1d9b640 1 --2- 172.21.15.7:0/1758523574 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563bd9c0e230 0x563bd9be44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.401+0000 7f8bb1d9b640 1 -- 172.21.15.7:0/1758523574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563bd9c38d90 msgr2=0x563bd9c1ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:52.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.401+0000 7f8bb1d9b640 1 --2- 172.21.15.7:0/1758523574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563bd9c38d90 0x563bd9c1ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.401+0000 7f8bb1d9b640 1 -- 172.21.15.7:0/1758523574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563bd9bdfd00 con 0x563bd9c2bad0 2024-04-25T10:04:52.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.401+0000 7f8bb259c640 1 --2- 172.21.15.7:0/1758523574 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563bd9c0e230 0x563bd9be44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:52.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.401+0000 7f8bb1d9b640 1 --2- 172.21.15.7:0/1758523574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bd9c2bad0 0x563bd9c1e9d0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c013930 tx=0x7f8b9c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a15cb080131f37b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:52.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.401+0000 7f8b937fe640 1 -- 172.21.15.7:0/1758523574 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c012d20 con 0x563bd9c2bad0 2024-04-25T10:04:52.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.401+0000 7f8b937fe640 1 -- 172.21.15.7:0/1758523574 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9c023070 con 0x563bd9c2bad0 2024-04-25T10:04:52.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.401+0000 7f8b937fe640 1 -- 172.21.15.7:0/1758523574 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c01e650 con 0x563bd9c2bad0 2024-04-25T10:04:52.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.402+0000 7f8bbbc1a740 1 -- 172.21.15.7:0/1758523574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bd9c2bad0 msgr2=0x563bd9c1e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:52.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.402+0000 7f8bbbc1a740 1 --2- 172.21.15.7:0/1758523574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bd9c2bad0 0x563bd9c1e9d0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c013930 tx=0x7f8b9c012000 comp rx=0 tx=0).stop 2024-04-25T10:04:52.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.402+0000 7f8bbbc1a740 1 -- 172.21.15.7:0/1758523574 shutdown_connections 2024-04-25T10:04:52.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.402+0000 7f8bbbc1a740 1 --2- 172.21.15.7:0/1758523574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563bd9c38d90 0x563bd9c1ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.402+0000 7f8bbbc1a740 1 --2- 172.21.15.7:0/1758523574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bd9c2bad0 0x563bd9c1e9d0 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.402+0000 7f8bbbc1a740 1 --2- 172.21.15.7:0/1758523574 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563bd9c0e230 0x563bd9be44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.402+0000 7f8bbbc1a740 1 -- 172.21.15.7:0/1758523574 >> 172.21.15.7:0/1758523574 conn(0x563bd9be3f10 msgr2=0x563bd9c0f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:52.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.402+0000 7f8bbbc1a740 1 -- 172.21.15.7:0/1758523574 shutdown_connections 2024-04-25T10:04:52.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.402+0000 7f8bbbc1a740 1 -- 172.21.15.7:0/1758523574 wait complete. 2024-04-25T10:04:52.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.402+0000 7f8bbbc1a740 1 -- start start 2024-04-25T10:04:52.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.402+0000 7f8bbbc1a740 1 Processor -- start 2024-04-25T10:04:52.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.403+0000 7f8bbbc1a740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563bd9c0e230 0x563bd9c7cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.403+0000 7f8bbbc1a740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563bd9c2bad0 0x563bd9c203a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.403+0000 7f8bbbc1a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bd9c38d90 0x563bd9c3bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.403+0000 7f8bbbc1a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bd9c11330 con 0x563bd9c38d90 2024-04-25T10:04:52.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.403+0000 7f8bbbc1a740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bd9c10a10 con 0x563bd9c2bad0 2024-04-25T10:04:52.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.403+0000 7f8bbbc1a740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x563bd9c11930 con 0x563bd9c0e230 2024-04-25T10:04:52.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.403+0000 7f8bbbc1a740 10 client.0 _ll_register_callbacks cb 0x563bd9bdec50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:04:52.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.403+0000 7f8bb2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bd9c38d90 0x563bd9c3bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.403+0000 7f8bb2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bd9c38d90 0x563bd9c3bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47364/0 (socket says 172.21.15.7:47364) 2024-04-25T10:04:52.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.403+0000 7f8bb2d9d640 1 -- 172.21.15.7:0/828395089 learned_addr learned my addr 172.21.15.7:0/828395089 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:52.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.404+0000 7f8bb1d9b640 1 --2- 172.21.15.7:0/828395089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563bd9c2bad0 0x563bd9c203a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.404+0000 7f8bb259c640 1 --2- 172.21.15.7:0/828395089 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563bd9c0e230 0x563bd9c7cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.404+0000 7f8bb2d9d640 1 -- 172.21.15.7:0/828395089 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563bd9c0e230 msgr2=0x563bd9c7cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:52.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.404+0000 7f8bb2d9d640 1 --2- 172.21.15.7:0/828395089 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563bd9c0e230 0x563bd9c7cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.404+0000 7f8bb2d9d640 1 -- 172.21.15.7:0/828395089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563bd9c2bad0 msgr2=0x563bd9c203a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:52.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.404+0000 7f8bb2d9d640 1 --2- 172.21.15.7:0/828395089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563bd9c2bad0 0x563bd9c203a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.404+0000 7f8bb2d9d640 1 -- 172.21.15.7:0/828395089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563bd9c37900 con 0x563bd9c38d90 2024-04-25T10:04:52.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.404+0000 7f8bb259c640 1 --2- 172.21.15.7:0/828395089 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563bd9c0e230 0x563bd9c7cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:52.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.404+0000 7f8bb2d9d640 1 --2- 172.21.15.7:0/828395089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bd9c38d90 0x563bd9c3bae0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400daa0 tx=0x7f8ba4005d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec079d2b1fa433ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:52.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.404+0000 7f8b917fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:04:52.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.404+0000 7f8b917fa640 1 -- 172.21.15.7:0/828395089 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4016740 con 0x563bd9c38d90 2024-04-25T10:04:52.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.404+0000 7f8b917fa640 1 -- 172.21.15.7:0/828395089 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(118..118 src has 1..118) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f8ba40168e0 con 0x563bd9c38d90 2024-04-25T10:04:52.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.404+0000 7f8bbbc1a740 1 -- 172.21.15.7:0/828395089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8b9c023070 con 0x563bd9c38d90 2024-04-25T10:04:52.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.404+0000 7f8b917fa640 1 -- 172.21.15.7:0/828395089 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ba4035050 con 0x563bd9c38d90 2024-04-25T10:04:52.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.404+0000 7f8bbbc1a740 10 client.9378 fetch_fsmap learned FSMap version 94 2024-04-25T10:04:52.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.404+0000 7f8bbbc1a740 1 -- 172.21.15.7:0/828395089 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) v3 -- 0x563bd9c948b0 con 0x563bd9c38d90 2024-04-25T10:04:52.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.404+0000 7f8b917fa640 1 -- 172.21.15.7:0/828395089 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9c023070 con 0x563bd9c38d90 2024-04-25T10:04:52.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.405+0000 7f8b917fa640 1 -- 172.21.15.7:0/828395089 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 94) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8ba4038020 con 0x563bd9c38d90 2024-04-25T10:04:52.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.405+0000 7f8bbbc1a740 10 client.9378 fetch_fsmap finished waiting for FSMap version 94 2024-04-25T10:04:52.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.405+0000 7f8bbbc1a740 10 client.9378 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:04:52.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.405+0000 7f8bbbc1a740 20 client.9378 populate_metadata read hostname 'smithi007' 2024-04-25T10:04:52.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.405+0000 7f8bbbc1a740 1 --2- 172.21.15.7:0/828395089 >> [v2:172.21.15.7:6834/3781378145,v1:172.21.15.7:6836/3781378145] conn(0x563bd9be2790 0x563bd9c93850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.405+0000 7f8bbbc1a740 4 client.9378 mds_command: new command op to 9321 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:04:52.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.405+0000 7f8bbbc1a740 1 -- 172.21.15.7:0/828395089 --> [v2:172.21.15.7:6834/3781378145,v1:172.21.15.7:6836/3781378145] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563bd9b53f50 con 0x563bd9be2790 2024-04-25T10:04:52.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.405+0000 7f8bb259c640 1 --2- 172.21.15.7:0/828395089 >> [v2:172.21.15.7:6834/3781378145,v1:172.21.15.7:6836/3781378145] conn(0x563bd9be2790 0x563bd9c93850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.405+0000 7f8b917fa640 10 client.9378 ms_handle_connect on v2:172.21.15.7:6834/3781378145 2024-04-25T10:04:52.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.405+0000 7f8bb259c640 1 --2- 172.21.15.7:0/828395089 >> [v2:172.21.15.7:6834/3781378145,v1:172.21.15.7:6836/3781378145] conn(0x563bd9be2790 0x563bd9c93850 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65ce700c910479c9 server_cookie=dc7fc2bd9d98f797 in_seq=0 out_seq=0 2024-04-25T10:04:52.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.405+0000 7f8b917fa640 1 -- 172.21.15.7:0/828395089 <== mds.0 v2:172.21.15.7:6834/3781378145 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x563bd9b53f50 con 0x563bd9be2790 2024-04-25T10:04:52.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.405+0000 7f8b917fa640 10 client.9378 handle_command_reply: tid=0 2024-04-25T10:04:52.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.405+0000 7f8bbbc1a740 1 client.9378 shutdown 2024-04-25T10:04:52.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.405+0000 7f8bbbc1a740 1 -- 172.21.15.7:0/828395089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bd9c38d90 msgr2=0x563bd9c3bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:52.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.405+0000 7f8bbbc1a740 1 --2- 172.21.15.7:0/828395089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bd9c38d90 0x563bd9c3bae0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400daa0 tx=0x7f8ba4005d10 comp rx=0 tx=0).stop 2024-04-25T10:04:52.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.405+0000 7f8bbbc1a740 1 -- 172.21.15.7:0/828395089 shutdown_connections 2024-04-25T10:04:52.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.405+0000 7f8bbbc1a740 1 --2- 172.21.15.7:0/828395089 >> [v2:172.21.15.7:6834/3781378145,v1:172.21.15.7:6836/3781378145] conn(0x563bd9be2790 0x563bd9c93850 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.406+0000 7f8bbbc1a740 1 --2- 172.21.15.7:0/828395089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563bd9c38d90 0x563bd9c3bae0 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.406+0000 7f8bbbc1a740 1 --2- 172.21.15.7:0/828395089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563bd9c2bad0 0x563bd9c203a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.406+0000 7f8bbbc1a740 1 --2- 172.21.15.7:0/828395089 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x563bd9c0e230 0x563bd9c7cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.406+0000 7f8b917fa640 0 client.9378 ms_handle_reset on v2:172.21.15.7:6834/3781378145 2024-04-25T10:04:52.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.406+0000 7f8bbbc1a740 1 -- 172.21.15.7:0/828395089 >> 172.21.15.7:0/828395089 conn(0x563bd9be3f10 msgr2=0x563bd9be2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:52.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.406+0000 7f8bbbc1a740 1 -- 172.21.15.7:0/828395089 shutdown_connections 2024-04-25T10:04:52.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.406+0000 7f8bbbc1a740 1 -- 172.21.15.7:0/828395089 wait complete. 2024-04-25T10:04:52.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.406+0000 7f8bbbc1a740 20 client.9378 trim_cache size 0 max 16384 2024-04-25T10:04:52.418 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:04:52.418 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "c03d0745-5946-49c3-ad88-1165c5b68b4e", 2024-04-25T10:04:52.418 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-04-25T10:04:52.418 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 9321, 2024-04-25T10:04:52.418 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-04-25T10:04:52.418 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-04-25T10:04:52.418 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-04-25T10:04:52.418 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 4.436150059, 2024-04-25T10:04:52.418 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 94, 2024-04-25T10:04:52.418 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 118, 2024-04-25T10:04:52.418 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 118, 2024-04-25T10:04:52.418 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 5.402424935 2024-04-25T10:04:52.419 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:04:52.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.406+0000 7f8bb8e38640 1 -- 172.21.15.7:0/3606519042 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8b9406b4d0 msgr2=0x7f8b9406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:52.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.406+0000 7f8bb8e38640 1 --2- 172.21.15.7:0/3606519042 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8b9406b4d0 0x7f8b9406d990 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c006fd0 tx=0x7f8b9c006bc0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.406+0000 7f8bb8e38640 1 -- 172.21.15.7:0/3606519042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bb40b53c0 msgr2=0x7f8bb40cc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:52.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.406+0000 7f8bb8e38640 1 --2- 172.21.15.7:0/3606519042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bb40b53c0 0x7f8bb40cc4c0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f8bac009870 tx=0x7f8bac0046c0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.406+0000 7f8bb8e38640 1 -- 172.21.15.7:0/3606519042 shutdown_connections 2024-04-25T10:04:52.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.406+0000 7f8bb8e38640 1 --2- 172.21.15.7:0/3606519042 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8b9406b4d0 0x7f8b9406d990 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.406+0000 7f8bb8e38640 1 --2- 172.21.15.7:0/3606519042 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8bb415eba0 0x7f8bb4160440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.406+0000 7f8bb8e38640 1 --2- 172.21.15.7:0/3606519042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bb415d7b0 0x7f8bb41f7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.406+0000 7f8bb8e38640 1 --2- 172.21.15.7:0/3606519042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bb40b53c0 0x7f8bb40cc4c0 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.406+0000 7f8bb8e38640 1 -- 172.21.15.7:0/3606519042 >> 172.21.15.7:0/3606519042 conn(0x7f8bb40b2390 msgr2=0x7f8bb415cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:52.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.406+0000 7f8bb8e38640 1 -- 172.21.15.7:0/3606519042 shutdown_connections 2024-04-25T10:04:52.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.406+0000 7f8bb8e38640 1 -- 172.21.15.7:0/3606519042 wait complete. 2024-04-25T10:04:52.422 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:04:52.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.518+0000 7fe627c93640 1 Processor -- start 2024-04-25T10:04:52.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.518+0000 7fe627c93640 1 -- start start 2024-04-25T10:04:52.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.519+0000 7fe627c93640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe6200d0a50 0x7fe6200d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.519+0000 7fe627c93640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6200b53b0 0x7fe6200d2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.519+0000 7fe627c93640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6200d1e80 con 0x7fe62015db00 2024-04-25T10:04:52.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.519+0000 7fe627c93640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6200b5930 con 0x7fe6200d0a50 2024-04-25T10:04:52.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.519+0000 7fe627c93640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6200b5c10 con 0x7fe6200b53b0 2024-04-25T10:04:52.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.519+0000 7fe625a2f640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe62015db00 0x7fe6200d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35716/0 (socket says 172.21.15.7:35716) 2024-04-25T10:04:52.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.519+0000 7fe625a2f640 1 -- 172.21.15.7:0/2690485127 learned_addr learned my addr 172.21.15.7:0/2690485127 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:52.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.519+0000 7fe626230640 1 --2- 172.21.15.7:0/2690485127 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6200b53b0 0x7fe6200d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.519+0000 7fe62522e640 1 --2- 172.21.15.7:0/2690485127 >> v2:172.21.15.55:3300/0 conn(0x7fe6200d0a50 0x7fe6200d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.519+0000 7fe624a2d640 1 -- 172.21.15.7:0/2690485127 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2461791403 0 0) 0x7fe6200d1e80 con 0x7fe62015db00 2024-04-25T10:04:52.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.519+0000 7fe624a2d640 1 -- 172.21.15.7:0/2690485127 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe60c003520 con 0x7fe62015db00 2024-04-25T10:04:52.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.519+0000 7fe624a2d640 1 -- 172.21.15.7:0/2690485127 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4107669339 0 0) 0x7fe60c003520 con 0x7fe62015db00 2024-04-25T10:04:52.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.519+0000 7fe624a2d640 1 -- 172.21.15.7:0/2690485127 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6200b53b0 msgr2=0x7fe6200d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:52.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.519+0000 7fe624a2d640 1 --2- 172.21.15.7:0/2690485127 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6200b53b0 0x7fe6200d2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.519+0000 7fe624a2d640 1 -- 172.21.15.7:0/2690485127 >> v2:172.21.15.55:3300/0 conn(0x7fe6200d0a50 msgr2=0x7fe6200d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:52.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.519+0000 7fe624a2d640 1 --2- 172.21.15.7:0/2690485127 >> v2:172.21.15.55:3300/0 conn(0x7fe6200d0a50 0x7fe6200d2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.519+0000 7fe624a2d640 1 -- 172.21.15.7:0/2690485127 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6200b5ef0 con 0x7fe62015db00 2024-04-25T10:04:52.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.519+0000 7fe624a2d640 1 -- 172.21.15.7:0/2690485127 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fe61c001670 con 0x7fe62015db00 2024-04-25T10:04:52.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.519+0000 7fe624a2d640 1 -- 172.21.15.7:0/2690485127 >> v1:172.21.15.7:6789/0 conn(0x7fe62015db00 legacy=0x7fe6200d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:52.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.519+0000 7fe624a2d640 1 --2- 172.21.15.7:0/2690485127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe60c0039b0 0x7fe60c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.519+0000 7fe624a2d640 1 --2- 172.21.15.7:0/2690485127 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe60c004800 0x7fe60c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.519+0000 7fe624a2d640 1 --2- 172.21.15.7:0/2690485127 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6200b53b0 0x7fe60c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.519+0000 7fe624a2d640 1 -- 172.21.15.7:0/2690485127 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6200b5930 con 0x7fe60c0039b0 2024-04-25T10:04:52.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.519+0000 7fe624a2d640 1 -- 172.21.15.7:0/2690485127 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6200b5c10 con 0x7fe60c004800 2024-04-25T10:04:52.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.519+0000 7fe624a2d640 1 -- 172.21.15.7:0/2690485127 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c00b9c0 con 0x7fe6200b53b0 2024-04-25T10:04:52.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.520+0000 7fe625a2f640 1 --2- 172.21.15.7:0/2690485127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe60c0039b0 0x7fe60c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.520+0000 7fe62522e640 1 --2- 172.21.15.7:0/2690485127 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe60c004800 0x7fe60c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.520+0000 7fe626230640 1 --2- 172.21.15.7:0/2690485127 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6200b53b0 0x7fe60c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.520+0000 7fe625a2f640 1 -- 172.21.15.7:0/2690485127 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6200b53b0 msgr2=0x7fe60c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:52.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.520+0000 7fe625a2f640 1 --2- 172.21.15.7:0/2690485127 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6200b53b0 0x7fe60c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.520+0000 7fe625a2f640 1 -- 172.21.15.7:0/2690485127 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe60c004800 msgr2=0x7fe60c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:52.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.520+0000 7fe625a2f640 1 --2- 172.21.15.7:0/2690485127 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe60c004800 0x7fe60c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.520+0000 7fe625a2f640 1 -- 172.21.15.7:0/2690485127 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60c003520 con 0x7fe60c0039b0 2024-04-25T10:04:52.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.520+0000 7fe626230640 1 --2- 172.21.15.7:0/2690485127 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6200b53b0 0x7fe60c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:52.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.520+0000 7fe625a2f640 1 --2- 172.21.15.7:0/2690485127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe60c0039b0 0x7fe60c003dd0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7fe61c001050 tx=0x7fe60c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01d463f836c2268 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:52.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.521+0000 7fe624a2d640 1 -- 172.21.15.7:0/2690485127 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c02e070 con 0x7fe60c0039b0 2024-04-25T10:04:52.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.521+0000 7fe624a2d640 1 -- 172.21.15.7:0/2690485127 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61c005af0 con 0x7fe60c0039b0 2024-04-25T10:04:52.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.521+0000 7fe624a2d640 1 -- 172.21.15.7:0/2690485127 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c007d70 con 0x7fe60c0039b0 2024-04-25T10:04:52.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.521+0000 7fe627c93640 1 -- 172.21.15.7:0/2690485127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe60c0039b0 msgr2=0x7fe60c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:52.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.521+0000 7fe627c93640 1 --2- 172.21.15.7:0/2690485127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe60c0039b0 0x7fe60c003dd0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7fe61c001050 tx=0x7fe60c005830 comp rx=0 tx=0).stop 2024-04-25T10:04:52.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.521+0000 7fe626230640 1 -- 172.21.15.7:0/2690485127 reap_dead start 2024-04-25T10:04:52.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.521+0000 7fe627c93640 1 -- 172.21.15.7:0/2690485127 shutdown_connections 2024-04-25T10:04:52.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.521+0000 7fe627c93640 1 -- 172.21.15.7:0/2690485127 >> 172.21.15.7:0/2690485127 conn(0x7fe620072290 msgr2=0x7fe6200726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:52.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.521+0000 7fe627c93640 1 -- 172.21.15.7:0/2690485127 shutdown_connections 2024-04-25T10:04:52.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.521+0000 7fe627c93640 1 -- 172.21.15.7:0/2690485127 wait complete. 2024-04-25T10:04:52.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.522+0000 7fe627c93640 1 Processor -- start 2024-04-25T10:04:52.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.522+0000 7fe627c93640 1 -- start start 2024-04-25T10:04:52.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.523+0000 7fe627c93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe60c0039b0 0x7fe6201f68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.523+0000 7fe627c93640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe62014e080 0x7fe62014efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.523+0000 7fe627c93640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe620150c20 0x7fe6201510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.523+0000 7fe627c93640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6200d3660 con 0x7fe62014e080 2024-04-25T10:04:52.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.523+0000 7fe627c93640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6200b61d0 con 0x7fe60c0039b0 2024-04-25T10:04:52.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.523+0000 7fe627c93640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6200ce2b0 con 0x7fe620150c20 2024-04-25T10:04:52.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.523+0000 7fe62522e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe62014e080 0x7fe62014efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.523+0000 7fe62522e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe62014e080 0x7fe62014efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47382/0 (socket says 172.21.15.7:47382) 2024-04-25T10:04:52.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.523+0000 7fe62522e640 1 -- 172.21.15.7:0/1533621062 learned_addr learned my addr 172.21.15.7:0/1533621062 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:52.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.523+0000 7fe625a2f640 1 --2- 172.21.15.7:0/1533621062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe60c0039b0 0x7fe6201f68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.523+0000 7fe626230640 1 --2- 172.21.15.7:0/1533621062 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe620150c20 0x7fe6201510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.524+0000 7fe62522e640 1 -- 172.21.15.7:0/1533621062 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe620150c20 msgr2=0x7fe6201510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:52.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.524+0000 7fe62522e640 1 --2- 172.21.15.7:0/1533621062 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe620150c20 0x7fe6201510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.524+0000 7fe62522e640 1 -- 172.21.15.7:0/1533621062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe60c0039b0 msgr2=0x7fe6201f68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:52.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.524+0000 7fe62522e640 1 --2- 172.21.15.7:0/1533621062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe60c0039b0 0x7fe6201f68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.524+0000 7fe62522e640 1 -- 172.21.15.7:0/1533621062 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6200c90b0 con 0x7fe62014e080 2024-04-25T10:04:52.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.524+0000 7fe62522e640 1 --2- 172.21.15.7:0/1533621062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe62014e080 0x7fe62014efc0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fe610011990 tx=0x7fe610011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:52.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.524+0000 7fe6167fc640 1 -- 172.21.15.7:0/1533621062 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61000fad0 con 0x7fe62014e080 2024-04-25T10:04:52.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.524+0000 7fe6167fc640 1 -- 172.21.15.7:0/1533621062 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61000fc70 con 0x7fe62014e080 2024-04-25T10:04:52.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.524+0000 7fe627c93640 1 -- 172.21.15.7:0/1533621062 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6200c9350 con 0x7fe62014e080 2024-04-25T10:04:52.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.524+0000 7fe6167fc640 1 -- 172.21.15.7:0/1533621062 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe610014440 con 0x7fe62014e080 2024-04-25T10:04:52.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.524+0000 7fe627c93640 1 -- 172.21.15.7:0/1533621062 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6200c9910 con 0x7fe62014e080 2024-04-25T10:04:52.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.525+0000 7fe627c93640 1 -- 172.21.15.7:0/1533621062 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe620068fd0 con 0x7fe62014e080 2024-04-25T10:04:52.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.526+0000 7fe6167fc640 1 -- 172.21.15.7:0/1533621062 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe610012040 con 0x7fe62014e080 2024-04-25T10:04:52.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.526+0000 7fe6167fc640 1 --2- 172.21.15.7:0/1533621062 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe60406b500 0x7fe60406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.526+0000 7fe6167fc640 1 -- 172.21.15.7:0/1533621062 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fe61008a850 con 0x7fe62014e080 2024-04-25T10:04:52.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.526+0000 7fe625a2f640 1 --2- 172.21.15.7:0/1533621062 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe60406b500 0x7fe60406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.527+0000 7fe625a2f640 1 --2- 172.21.15.7:0/1533621062 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe60406b500 0x7fe60406d9c0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fe61c033000 tx=0x7fe61c009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:52.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.530+0000 7fe6167fc640 1 -- 172.21.15.7:0/1533621062 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe610019030 con 0x7fe62014e080 2024-04-25T10:04:52.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.748+0000 7fe627c93640 1 -- 172.21.15.7:0/1533621062 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe6200d16b0 con 0x7fe62014e080 2024-04-25T10:04:52.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.748+0000 7fe6167fc640 1 -- 172.21.15.7:0/1533621062 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v94) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe610058ea0 con 0x7fe62014e080 2024-04-25T10:04:52.753 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T10:04:52.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.750+0000 7fe627c93640 1 -- 172.21.15.7:0/1533621062 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe60406b500 msgr2=0x7fe60406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:52.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.750+0000 7fe627c93640 1 --2- 172.21.15.7:0/1533621062 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe60406b500 0x7fe60406d9c0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fe61c033000 tx=0x7fe61c009030 comp rx=0 tx=0).stop 2024-04-25T10:04:52.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.750+0000 7fe627c93640 1 -- 172.21.15.7:0/1533621062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe62014e080 msgr2=0x7fe62014efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:52.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.750+0000 7fe627c93640 1 --2- 172.21.15.7:0/1533621062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe62014e080 0x7fe62014efc0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fe610011990 tx=0x7fe610011e50 comp rx=0 tx=0).stop 2024-04-25T10:04:52.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.750+0000 7fe627c93640 1 -- 172.21.15.7:0/1533621062 shutdown_connections 2024-04-25T10:04:52.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.750+0000 7fe627c93640 1 --2- 172.21.15.7:0/1533621062 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fe60406b500 0x7fe60406d9c0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.750+0000 7fe627c93640 1 --2- 172.21.15.7:0/1533621062 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe620150c20 0x7fe6201510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.750+0000 7fe627c93640 1 --2- 172.21.15.7:0/1533621062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe62014e080 0x7fe62014efc0 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.750+0000 7fe627c93640 1 --2- 172.21.15.7:0/1533621062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe60c0039b0 0x7fe6201f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.750+0000 7fe627c93640 1 -- 172.21.15.7:0/1533621062 >> 172.21.15.7:0/1533621062 conn(0x7fe620072290 msgr2=0x7fe6200726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:52.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.750+0000 7fe627c93640 1 -- 172.21.15.7:0/1533621062 shutdown_connections 2024-04-25T10:04:52.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:52.750+0000 7fe627c93640 1 -- 172.21.15.7:0/1533621062 wait complete. 2024-04-25T10:04:52.766 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T10:04:52.766 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:04:52.766 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-04-25T10:04:52.766 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T10:04:52.766 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T10:04:52.766 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T10:04:52.766 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T10:04:52.766 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:04:52.767 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:04:52.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:52.767 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-04-25T10:04:52.783 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:04:52.783 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:04:52.783 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:04:52.783 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:52.783 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-04-25T10:04:52.783 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:52.783 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:04:52.783 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:52.783 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-04-25T10:04:52.783 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:04:52.783 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:52.783 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-04-25T10:04:52.784 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:04:52.784 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:52.784 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-04-25T10:04:52.784 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T10:04:52.784 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42107sec preferred_lft 42107sec 2024-04-25T10:04:52.784 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link noprefixroute 2024-04-25T10:04:52.784 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:52.784 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:04:52.784 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:52.784 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-04-25T10:04:52.784 INFO:teuthology.orchestra.run.smithi007.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T10:04:52.784 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 26:0c:99:53:12:e3 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:52.784 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T10:04:52.784 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:52.784 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::50aa:55ff:febc:5f67/64 scope link 2024-04-25T10:04:52.784 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:52.785 INFO:teuthology.orchestra.run.smithi007.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:04:52.785 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 6e:99:f1:00:a9:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:04:52.785 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6c99:f1ff:fe00:a95e/64 scope link 2024-04-25T10:04:52.785 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:52.785 INFO:teuthology.orchestra.run.smithi007.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:04:52.785 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 26:0c:99:53:12:e3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T10:04:52.785 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::240c:99ff:fe53:12e3/64 scope link 2024-04-25T10:04:52.785 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:52.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:52.785 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:04:52.846 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-04-25T10:04:52.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:52.848 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-04-25T10:04:52.904 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-04-25T10:04:52.904 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:04:52.904 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T10:04:52.904 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T10:04:52.904 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:04:52.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:52.905 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-04-25T10:04:52.905 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-25T10:04:52.905 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:04:52.905 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:04:52.905 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:04:52.905 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-25T10:04:52.978 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-04-25T10:04:52.970+0000 7fae8df81640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:04:52.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:52.990 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-04-25T10:04:53.045 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T10:04:53.045 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T10:04:53.046 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:04:53.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:53.046 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-04-25T10:04:53.110 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:04:53.110 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T10:04:53.165 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:04:53.165 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:04:53.165 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:04:53.220 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T10:04:53.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:53.220 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:04:53.302 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:04:53.303 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T10:04:53.303 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T10:04:53.311 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:04:53.311 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T10:04:53.311 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T10:04:53.311 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T10:04:53.311 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T10:04:53.317 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:04:53.317 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T10:04:53.317 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T10:04:53.317 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T10:04:53.317 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T10:04:53.317 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790" 2024-04-25T10:04:53.317 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790:/ 2024-04-25T10:04:53.317 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c03d0745-5946-49c3-ad88-1165c5b68b4e" will pass to kernel 2024-04-25T10:04:53.318 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T10:04:53.318 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-04-25T10:04:53.318 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T10:04:53.318 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T10:04:53.318 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T10:04:53.319 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T10:04:53.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:53.320 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:04:53.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:53.385 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:04:53.442 INFO:teuthology.orchestra.run.smithi007.stdout:client8191 2024-04-25T10:04:53.442 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:04:53.443 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:53.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:53.498 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T10:04:53.558 INFO:teuthology.orchestra.run.smithi007.stdout:./ 2024-04-25T10:04:53.558 INFO:teuthology.orchestra.run.smithi007.stdout:./parent 2024-04-25T10:04:53.558 INFO:teuthology.orchestra.run.smithi007.stdout:./parent/flushed 2024-04-25T10:04:53.558 INFO:teuthology.orchestra.run.smithi007.stdout:./parent/flushed/charlie 2024-04-25T10:04:53.558 INFO:teuthology.orchestra.run.smithi007.stdout:./parent/flushed/alpha 2024-04-25T10:04:53.558 INFO:teuthology.orchestra.run.smithi007.stdout:./parent/unflushed 2024-04-25T10:04:53.558 INFO:teuthology.orchestra.run.smithi007.stdout:./parent/unflushed/jfile 2024-04-25T10:04:53.558 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T10:04:53.559 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T10:04:53.559 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T10:04:53.559 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T10:04:53.559 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T10:04:53.559 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T10:04:53.664 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-04-25T10:04:53.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:04:53.673 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T10:04:53.674 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T10:04:53.674 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T10:04:53.674 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T10:04:53.674 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-04-25T10:04:53.674 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T10:04:53.781 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627776 2024-04-25T10:04:53.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:04:53.790 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T10:04:53.790 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T10:04:53.790 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T10:04:53.790 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T10:04:53.790 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-04-25T10:04:53.790 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T10:04:53.897 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627777 2024-04-25T10:04:53.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:04:53.906 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T10:04:53.906 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T10:04:53.906 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T10:04:53.906 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T10:04:53.906 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-04-25T10:04:53.906 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T10:04:54.013 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627780 2024-04-25T10:04:54.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:04:54.022 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T10:04:54.022 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T10:04:54.022 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T10:04:54.022 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T10:04:54.023 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-04-25T10:04:54.023 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T10:04:54.130 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627778 2024-04-25T10:04:54.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:04:54.139 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T10:04:54.139 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T10:04:54.139 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T10:04:54.139 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T10:04:54.139 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-04-25T10:04:54.139 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T10:04:54.245 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627781 2024-04-25T10:04:54.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:04:54.254 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T10:04:54.254 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T10:04:54.254 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T10:04:54.254 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T10:04:54.254 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-04-25T10:04:54.254 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T10:04:54.361 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627782 2024-04-25T10:04:54.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:04:54.371 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:04:54.371 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:54.427 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:04:54.427 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:54.482 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:54.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.618+0000 7f8c828f5640 1 Processor -- start 2024-04-25T10:04:54.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.618+0000 7f8c828f5640 1 -- start start 2024-04-25T10:04:54.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.618+0000 7f8c828f5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8c7c15db00 0x7f8c7c0d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.618+0000 7f8c828f5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c7c0ce2b0 0x7f8c7c0d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.618+0000 7f8c828f5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7c0d1e80 con 0x7f8c7c0b53b0 2024-04-25T10:04:54.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.618+0000 7f8c828f5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c7c0b5930 con 0x7f8c7c15db00 2024-04-25T10:04:54.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.618+0000 7f8c828f5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c0b5c10 con 0x7f8c7c0ce2b0 2024-04-25T10:04:54.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.619+0000 7f8c80e92640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c7c0ce2b0 0x7f8c7c0d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.619+0000 7f8c7bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8c7c15db00 0x7f8c7c0d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.619+0000 7f8c80e92640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c7c0ce2b0 0x7f8c7c0d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:34772/0 (socket says 172.21.15.7:34772) 2024-04-25T10:04:54.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.619+0000 7f8c80e92640 1 -- 172.21.15.7:0/1021496276 learned_addr learned my addr 172.21.15.7:0/1021496276 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:54.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.619+0000 7f8c7b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8c7c0b53b0 0x7f8c7c161670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:58530/0 (socket says 172.21.15.7:58530) 2024-04-25T10:04:54.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.619+0000 7f8c7bfff640 1 -- 172.21.15.7:0/1021496276 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c7c0ce2b0 msgr2=0x7f8c7c0d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:54.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.619+0000 7f8c7bfff640 1 --2- 172.21.15.7:0/1021496276 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c7c0ce2b0 0x7f8c7c0d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.619+0000 7f8c7bfff640 1 -- 172.21.15.7:0/1021496276 >> v1:172.21.15.55:6789/0 conn(0x7f8c7c0b53b0 legacy=0x7f8c7c161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:54.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.619+0000 7f8c7bfff640 1 -- 172.21.15.7:0/1021496276 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7c0b5ef0 con 0x7f8c7c15db00 2024-04-25T10:04:54.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.620+0000 7f8c7bfff640 1 --2- 172.21.15.7:0/1021496276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c7c15db00 0x7f8c7c0d0340 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c0097a0 tx=0x7f8c6c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8784edc63246ba6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:54.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.620+0000 7f8c7affd640 1 -- 172.21.15.7:0/1021496276 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c037070 con 0x7f8c7c15db00 2024-04-25T10:04:54.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.620+0000 7f8c7affd640 1 -- 172.21.15.7:0/1021496276 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6c032440 con 0x7f8c7c15db00 2024-04-25T10:04:54.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.620+0000 7f8c7affd640 1 -- 172.21.15.7:0/1021496276 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c032810 con 0x7f8c7c15db00 2024-04-25T10:04:54.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.621+0000 7f8c828f5640 1 -- 172.21.15.7:0/1021496276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c7c15db00 msgr2=0x7f8c7c0d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:54.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.621+0000 7f8c828f5640 1 --2- 172.21.15.7:0/1021496276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c7c15db00 0x7f8c7c0d0340 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c0097a0 tx=0x7f8c6c02a180 comp rx=0 tx=0).stop 2024-04-25T10:04:54.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.621+0000 7f8c828f5640 1 -- 172.21.15.7:0/1021496276 shutdown_connections 2024-04-25T10:04:54.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.621+0000 7f8c828f5640 1 --2- 172.21.15.7:0/1021496276 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c7c0ce2b0 0x7f8c7c0d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.621+0000 7f8c828f5640 1 --2- 172.21.15.7:0/1021496276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c7c15db00 0x7f8c7c0d0340 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.621+0000 7f8c828f5640 1 -- 172.21.15.7:0/1021496276 >> 172.21.15.7:0/1021496276 conn(0x7f8c7c072290 msgr2=0x7f8c7c0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:54.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.621+0000 7f8c828f5640 1 -- 172.21.15.7:0/1021496276 shutdown_connections 2024-04-25T10:04:54.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.621+0000 7f8c828f5640 1 -- 172.21.15.7:0/1021496276 wait complete. 2024-04-25T10:04:54.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.622+0000 7f8c828f5640 1 Processor -- start 2024-04-25T10:04:54.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.622+0000 7f8c828f5640 1 -- start start 2024-04-25T10:04:54.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.623+0000 7f8c828f5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c7c0b53b0 0x7f8c7c14bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.623+0000 7f8c828f5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c7c0ce2b0 0x7f8c7c160190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.623+0000 7f8c828f5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c7c15db00 0x7f8c7c0cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.623+0000 7f8c828f5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c0d3660 con 0x7f8c7c0ce2b0 2024-04-25T10:04:54.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.623+0000 7f8c828f5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c0b61d0 con 0x7f8c7c0b53b0 2024-04-25T10:04:54.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.623+0000 7f8c828f5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c0b6c10 con 0x7f8c7c15db00 2024-04-25T10:04:54.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.623+0000 7f8c7b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c7c0ce2b0 0x7f8c7c160190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.623+0000 7f8c7b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c7c0ce2b0 0x7f8c7c160190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47388/0 (socket says 172.21.15.7:47388) 2024-04-25T10:04:54.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.623+0000 7f8c7b7fe640 1 -- 172.21.15.7:0/508515417 learned_addr learned my addr 172.21.15.7:0/508515417 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:54.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.623+0000 7f8c7bfff640 1 --2- 172.21.15.7:0/508515417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c7c0b53b0 0x7f8c7c14bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.623+0000 7f8c80e92640 1 --2- 172.21.15.7:0/508515417 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c7c15db00 0x7f8c7c0cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.623+0000 7f8c7b7fe640 1 -- 172.21.15.7:0/508515417 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c7c15db00 msgr2=0x7f8c7c0cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:54.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.623+0000 7f8c7b7fe640 1 --2- 172.21.15.7:0/508515417 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c7c15db00 0x7f8c7c0cb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.623+0000 7f8c7b7fe640 1 -- 172.21.15.7:0/508515417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c7c0b53b0 msgr2=0x7f8c7c14bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:54.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.623+0000 7f8c7b7fe640 1 --2- 172.21.15.7:0/508515417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c7c0b53b0 0x7f8c7c14bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.623+0000 7f8c7b7fe640 1 -- 172.21.15.7:0/508515417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7c0caa00 con 0x7f8c7c0ce2b0 2024-04-25T10:04:54.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.623+0000 7f8c80e92640 1 --2- 172.21.15.7:0/508515417 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c7c15db00 0x7f8c7c0cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:54.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.624+0000 7f8c7b7fe640 1 --2- 172.21.15.7:0/508515417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c7c0ce2b0 0x7f8c7c160190 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f8c7000c400 tx=0x7f8c7000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:54.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.624+0000 7f8c78ff9640 1 -- 172.21.15.7:0/508515417 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c700074e0 con 0x7f8c7c0ce2b0 2024-04-25T10:04:54.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.624+0000 7f8c78ff9640 1 -- 172.21.15.7:0/508515417 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c70007680 con 0x7f8c7c0ce2b0 2024-04-25T10:04:54.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.624+0000 7f8c828f5640 1 -- 172.21.15.7:0/508515417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c7c14c520 con 0x7f8c7c0ce2b0 2024-04-25T10:04:54.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.624+0000 7f8c78ff9640 1 -- 172.21.15.7:0/508515417 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c70004a00 con 0x7f8c7c0ce2b0 2024-04-25T10:04:54.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.624+0000 7f8c828f5640 1 -- 172.21.15.7:0/508515417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7c160ca0 con 0x7f8c7c0ce2b0 2024-04-25T10:04:54.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.625+0000 7f8c828f5640 1 -- 172.21.15.7:0/508515417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c7c068fd0 con 0x7f8c7c0ce2b0 2024-04-25T10:04:54.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.625+0000 7f8c78ff9640 1 -- 172.21.15.7:0/508515417 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8c7001a020 con 0x7f8c7c0ce2b0 2024-04-25T10:04:54.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.626+0000 7f8c78ff9640 1 --2- 172.21.15.7:0/508515417 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8c6806b4d0 0x7f8c6806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.626+0000 7f8c78ff9640 1 -- 172.21.15.7:0/508515417 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f8c70089c10 con 0x7f8c7c0ce2b0 2024-04-25T10:04:54.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.626+0000 7f8c7bfff640 1 --2- 172.21.15.7:0/508515417 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8c6806b4d0 0x7f8c6806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.626+0000 7f8c7bfff640 1 --2- 172.21.15.7:0/508515417 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8c6806b4d0 0x7f8c6806d990 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c034000 tx=0x7f8c6c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:54.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.630+0000 7f8c78ff9640 1 -- 172.21.15.7:0/508515417 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8c70058820 con 0x7f8c7c0ce2b0 2024-04-25T10:04:54.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.812+0000 7f8c828f5640 1 -- 172.21.15.7:0/508515417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c7c0d16b0 con 0x7f8c7c0ce2b0 2024-04-25T10:04:54.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.813+0000 7f8c78ff9640 1 -- 172.21.15.7:0/508515417 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+16983 (secure 0 0 0) 0x7f8c70058120 con 0x7f8c7c0ce2b0 2024-04-25T10:04:54.820 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:54.820 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":118,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:04:46.961170+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:04:27.856713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T10:04:28.566676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6836/3623521645":"2024-04-26T10:04:46.961147+0000","172.21.15.7:6834/3623521645":"2024-04-26T10:04:46.961147+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:54.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.815+0000 7f8c828f5640 1 -- 172.21.15.7:0/508515417 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8c6806b4d0 msgr2=0x7f8c6806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:54.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.815+0000 7f8c828f5640 1 --2- 172.21.15.7:0/508515417 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8c6806b4d0 0x7f8c6806d990 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c034000 tx=0x7f8c6c02e000 comp rx=0 tx=0).stop 2024-04-25T10:04:54.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.815+0000 7f8c828f5640 1 -- 172.21.15.7:0/508515417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c7c0ce2b0 msgr2=0x7f8c7c160190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:54.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.815+0000 7f8c828f5640 1 --2- 172.21.15.7:0/508515417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c7c0ce2b0 0x7f8c7c160190 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f8c7000c400 tx=0x7f8c7000c8c0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.815+0000 7f8c828f5640 1 -- 172.21.15.7:0/508515417 shutdown_connections 2024-04-25T10:04:54.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.815+0000 7f8c828f5640 1 --2- 172.21.15.7:0/508515417 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8c6806b4d0 0x7f8c6806d990 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.815+0000 7f8c828f5640 1 --2- 172.21.15.7:0/508515417 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c7c15db00 0x7f8c7c0cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.815+0000 7f8c828f5640 1 --2- 172.21.15.7:0/508515417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c7c0ce2b0 0x7f8c7c160190 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.815+0000 7f8c828f5640 1 --2- 172.21.15.7:0/508515417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c7c0b53b0 0x7f8c7c14bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.815+0000 7f8c828f5640 1 -- 172.21.15.7:0/508515417 >> 172.21.15.7:0/508515417 conn(0x7f8c7c072290 msgr2=0x7f8c7c0d37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:54.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.816+0000 7f8c828f5640 1 -- 172.21.15.7:0/508515417 shutdown_connections 2024-04-25T10:04:54.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.816+0000 7f8c828f5640 1 -- 172.21.15.7:0/508515417 wait complete. 2024-04-25T10:04:54.832 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:04:27.856713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:04:28.566676+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '117', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:04:54.832 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:04:54.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.930+0000 7fc3538dd640 1 Processor -- start 2024-04-25T10:04:54.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.930+0000 7fc3538dd640 1 -- start start 2024-04-25T10:04:54.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.931+0000 7fc3538dd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc34c0b2c30 0x7fc34c0ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.931+0000 7fc3538dd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc34c0d3760 0x7fc34c0d3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.931+0000 7fc3538dd640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc34c0d1a40 con 0x7fc34c15deb0 2024-04-25T10:04:54.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.931+0000 7fc3538dd640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc34c0d4110 con 0x7fc34c0d3760 2024-04-25T10:04:54.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.931+0000 7fc3538dd640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc34c0d1d20 con 0x7fc34c0b2c30 2024-04-25T10:04:54.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.931+0000 7fc351e7a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc34c0d3760 0x7fc34c0d3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.931+0000 7fc351e7a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc34c0d3760 0x7fc34c0d3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47404/0 (socket says 172.21.15.7:47404) 2024-04-25T10:04:54.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.931+0000 7fc351e7a640 1 -- 172.21.15.7:0/3231837977 learned_addr learned my addr 172.21.15.7:0/3231837977 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:54.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.931+0000 7fc350e78640 1 --2- 172.21.15.7:0/3231837977 >> v2:172.21.15.55:3300/0 conn(0x7fc34c0b2c30 0x7fc34c0ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.931+0000 7fc351e7a640 1 -- 172.21.15.7:0/3231837977 >> v2:172.21.15.55:3300/0 conn(0x7fc34c0b2c30 msgr2=0x7fc34c0ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:54.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.931+0000 7fc351e7a640 1 --2- 172.21.15.7:0/3231837977 >> v2:172.21.15.55:3300/0 conn(0x7fc34c0b2c30 0x7fc34c0ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.931+0000 7fc351e7a640 1 -- 172.21.15.7:0/3231837977 >> v1:172.21.15.55:6789/0 conn(0x7fc34c15deb0 legacy=0x7fc34c0b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:54.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.931+0000 7fc351e7a640 1 -- 172.21.15.7:0/3231837977 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc34c0d2000 con 0x7fc34c0d3760 2024-04-25T10:04:54.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.932+0000 7fc351e7a640 1 --2- 172.21.15.7:0/3231837977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc34c0d3760 0x7fc34c0d3bd0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7fc34c0d48d0 tx=0x7fc34402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d15665e3b92003e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:54.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.932+0000 7fc343fff640 1 -- 172.21.15.7:0/3231837977 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc344036070 con 0x7fc34c0d3760 2024-04-25T10:04:54.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.932+0000 7fc343fff640 1 -- 172.21.15.7:0/3231837977 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc344031600 con 0x7fc34c0d3760 2024-04-25T10:04:54.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.932+0000 7fc343fff640 1 -- 172.21.15.7:0/3231837977 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3440319d0 con 0x7fc34c0d3760 2024-04-25T10:04:54.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.933+0000 7fc3538dd640 1 -- 172.21.15.7:0/3231837977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc34c0d3760 msgr2=0x7fc34c0d3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:54.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.933+0000 7fc3538dd640 1 --2- 172.21.15.7:0/3231837977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc34c0d3760 0x7fc34c0d3bd0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7fc34c0d48d0 tx=0x7fc34402a730 comp rx=0 tx=0).stop 2024-04-25T10:04:54.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.933+0000 7fc3538dd640 1 -- 172.21.15.7:0/3231837977 shutdown_connections 2024-04-25T10:04:54.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.933+0000 7fc3538dd640 1 --2- 172.21.15.7:0/3231837977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc34c0d3760 0x7fc34c0d3bd0 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.933+0000 7fc3538dd640 1 --2- 172.21.15.7:0/3231837977 >> v2:172.21.15.55:3300/0 conn(0x7fc34c0b2c30 0x7fc34c0ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.933+0000 7fc3538dd640 1 -- 172.21.15.7:0/3231837977 >> 172.21.15.7:0/3231837977 conn(0x7fc34c0726b0 msgr2=0x7fc34c072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:54.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.933+0000 7fc3538dd640 1 -- 172.21.15.7:0/3231837977 shutdown_connections 2024-04-25T10:04:54.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.933+0000 7fc3538dd640 1 -- 172.21.15.7:0/3231837977 wait complete. 2024-04-25T10:04:54.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.934+0000 7fc3538dd640 1 Processor -- start 2024-04-25T10:04:54.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.934+0000 7fc3538dd640 1 -- start start 2024-04-25T10:04:54.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.935+0000 7fc3538dd640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc34c0b2c30 0x7fc34c0b4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.935+0000 7fc3538dd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc34c0d3760 0x7fc34c0b5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.935+0000 7fc3538dd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc34c15deb0 0x7fc34c14da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.935+0000 7fc3538dd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c0b70f0 con 0x7fc34c15deb0 2024-04-25T10:04:54.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.935+0000 7fc3538dd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c0d25c0 con 0x7fc34c0d3760 2024-04-25T10:04:54.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.935+0000 7fc3538dd640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c0d2ae0 con 0x7fc34c0b2c30 2024-04-25T10:04:54.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.935+0000 7fc351e7a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc34c15deb0 0x7fc34c14da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.935+0000 7fc351e7a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc34c15deb0 0x7fc34c14da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47408/0 (socket says 172.21.15.7:47408) 2024-04-25T10:04:54.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.935+0000 7fc351e7a640 1 -- 172.21.15.7:0/1372144868 learned_addr learned my addr 172.21.15.7:0/1372144868 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:54.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.935+0000 7fc350e78640 1 --2- 172.21.15.7:0/1372144868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc34c0d3760 0x7fc34c0b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.935+0000 7fc351679640 1 --2- 172.21.15.7:0/1372144868 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc34c0b2c30 0x7fc34c0b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.935+0000 7fc351e7a640 1 -- 172.21.15.7:0/1372144868 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc34c0b2c30 msgr2=0x7fc34c0b4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:54.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.935+0000 7fc351e7a640 1 --2- 172.21.15.7:0/1372144868 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc34c0b2c30 0x7fc34c0b4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.935+0000 7fc351e7a640 1 -- 172.21.15.7:0/1372144868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc34c0d3760 msgr2=0x7fc34c0b5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:54.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.935+0000 7fc351e7a640 1 --2- 172.21.15.7:0/1372144868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc34c0d3760 0x7fc34c0b5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.935+0000 7fc351e7a640 1 -- 172.21.15.7:0/1372144868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc34c0b3560 con 0x7fc34c15deb0 2024-04-25T10:04:54.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.936+0000 7fc351e7a640 1 --2- 172.21.15.7:0/1372144868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc34c15deb0 0x7fc34c14da10 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7fc34402ad20 tx=0x7fc344004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:54.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.936+0000 7fc341ffb640 1 -- 172.21.15.7:0/1372144868 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34403f020 con 0x7fc34c15deb0 2024-04-25T10:04:54.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.936+0000 7fc341ffb640 1 -- 172.21.15.7:0/1372144868 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc344037040 con 0x7fc34c15deb0 2024-04-25T10:04:54.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.936+0000 7fc3538dd640 1 -- 172.21.15.7:0/1372144868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc34c0b3840 con 0x7fc34c15deb0 2024-04-25T10:04:54.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.936+0000 7fc341ffb640 1 -- 172.21.15.7:0/1372144868 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc344036070 con 0x7fc34c15deb0 2024-04-25T10:04:54.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.936+0000 7fc3538dd640 1 -- 172.21.15.7:0/1372144868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc34c0b40e0 con 0x7fc34c15deb0 2024-04-25T10:04:54.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.937+0000 7fc3538dd640 1 -- 172.21.15.7:0/1372144868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc34c0b3c30 con 0x7fc34c15deb0 2024-04-25T10:04:54.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.937+0000 7fc341ffb640 1 -- 172.21.15.7:0/1372144868 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc344042020 con 0x7fc34c15deb0 2024-04-25T10:04:54.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.938+0000 7fc341ffb640 1 --2- 172.21.15.7:0/1372144868 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc33006b4d0 0x7fc33006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.938+0000 7fc341ffb640 1 -- 172.21.15.7:0/1372144868 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fc3440aa6b0 con 0x7fc34c15deb0 2024-04-25T10:04:54.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.938+0000 7fc351679640 1 --2- 172.21.15.7:0/1372144868 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc33006b4d0 0x7fc33006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.938+0000 7fc351679640 1 --2- 172.21.15.7:0/1372144868 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc33006b4d0 0x7fc33006d990 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc3480016e0 tx=0x7fc348009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:54.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:54.942+0000 7fc341ffb640 1 -- 172.21.15.7:0/1372144868 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc344049030 con 0x7fc34c15deb0 2024-04-25T10:04:55.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.121+0000 7fc3538dd640 1 -- 172.21.15.7:0/1372144868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc34c0b42e0 con 0x7fc34c15deb0 2024-04-25T10:04:55.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.121+0000 7fc341ffb640 1 -- 172.21.15.7:0/1372144868 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v118) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc3440a8e20 con 0x7fc34c15deb0 2024-04-25T10:04:55.127 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T10:04:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.123+0000 7fc3538dd640 1 -- 172.21.15.7:0/1372144868 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc33006b4d0 msgr2=0x7fc33006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.123+0000 7fc3538dd640 1 --2- 172.21.15.7:0/1372144868 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc33006b4d0 0x7fc33006d990 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc3480016e0 tx=0x7fc348009040 comp rx=0 tx=0).stop 2024-04-25T10:04:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.123+0000 7fc3538dd640 1 -- 172.21.15.7:0/1372144868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc34c15deb0 msgr2=0x7fc34c14da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.123+0000 7fc3538dd640 1 --2- 172.21.15.7:0/1372144868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc34c15deb0 0x7fc34c14da10 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7fc34402ad20 tx=0x7fc344004a40 comp rx=0 tx=0).stop 2024-04-25T10:04:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.123+0000 7fc3538dd640 1 -- 172.21.15.7:0/1372144868 shutdown_connections 2024-04-25T10:04:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.123+0000 7fc3538dd640 1 --2- 172.21.15.7:0/1372144868 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc33006b4d0 0x7fc33006d990 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.123+0000 7fc3538dd640 1 --2- 172.21.15.7:0/1372144868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc34c15deb0 0x7fc34c14da10 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.123+0000 7fc3538dd640 1 --2- 172.21.15.7:0/1372144868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc34c0d3760 0x7fc34c0b5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.123+0000 7fc3538dd640 1 --2- 172.21.15.7:0/1372144868 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc34c0b2c30 0x7fc34c0b4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.123+0000 7fc3538dd640 1 -- 172.21.15.7:0/1372144868 >> 172.21.15.7:0/1372144868 conn(0x7fc34c0726b0 msgr2=0x7fc34c0737a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:55.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.123+0000 7fc3538dd640 1 -- 172.21.15.7:0/1372144868 shutdown_connections 2024-04-25T10:04:55.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.123+0000 7fc3538dd640 1 -- 172.21.15.7:0/1372144868 wait complete. 2024-04-25T10:04:55.139 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:04:55.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.237+0000 7f334d21b640 1 Processor -- start 2024-04-25T10:04:55.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.237+0000 7f334d21b640 1 -- start start 2024-04-25T10:04:55.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.238+0000 7f334d21b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f33480d3760 0x7f334815eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.238+0000 7f334d21b640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33480ced10 con 0x7f33480ce830 2024-04-25T10:04:55.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.238+0000 7f334d21b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33480d1b40 con 0x7f334815f1c0 2024-04-25T10:04:55.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.238+0000 7f334d21b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33480ce380 con 0x7f33480d3760 2024-04-25T10:04:55.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.238+0000 7f334759e640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f33480ce830 0x7f33480b2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35724/0 (socket says 172.21.15.7:35724) 2024-04-25T10:04:55.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.238+0000 7f334759e640 1 -- 172.21.15.7:0/2848275300 learned_addr learned my addr 172.21.15.7:0/2848275300 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:55.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.238+0000 7f3346d9d640 1 --2- 172.21.15.7:0/2848275300 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f33480d3760 0x7f334815eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.239+0000 7f3345d9b640 1 -- 172.21.15.7:0/2848275300 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2630240348 0 0) 0x7f33480ced10 con 0x7f33480ce830 2024-04-25T10:04:55.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.239+0000 7f3345d9b640 1 -- 172.21.15.7:0/2848275300 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3330003520 con 0x7f33480ce830 2024-04-25T10:04:55.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.239+0000 7f3345d9b640 1 -- 172.21.15.7:0/2848275300 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1503969507 0 0) 0x7f33480d1b40 con 0x7f334815f1c0 2024-04-25T10:04:55.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.239+0000 7f3345d9b640 1 -- 172.21.15.7:0/2848275300 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33480ced10 con 0x7f334815f1c0 2024-04-25T10:04:55.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.239+0000 7f3346d9d640 1 -- 172.21.15.7:0/2848275300 >> v1:172.21.15.55:6789/0 conn(0x7f334815f1c0 legacy=0x7f33480d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.239+0000 7f3346d9d640 1 -- 172.21.15.7:0/2848275300 >> v1:172.21.15.7:6789/0 conn(0x7f33480ce830 legacy=0x7f33480b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.239+0000 7f3346d9d640 1 -- 172.21.15.7:0/2848275300 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33480d1e20 con 0x7f33480d3760 2024-04-25T10:04:55.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.240+0000 7f3346d9d640 1 --2- 172.21.15.7:0/2848275300 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f33480d3760 0x7f334815eac0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3338009dc0 tx=0x7f333802a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79444cea811bffeb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:55.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.240+0000 7f3345d9b640 1 -- 172.21.15.7:0/2848275300 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338007740 con 0x7f33480d3760 2024-04-25T10:04:55.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.240+0000 7f3345d9b640 1 -- 172.21.15.7:0/2848275300 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33380078e0 con 0x7f33480d3760 2024-04-25T10:04:55.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.240+0000 7f3345d9b640 1 -- 172.21.15.7:0/2848275300 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338007cb0 con 0x7f33480d3760 2024-04-25T10:04:55.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.240+0000 7f334d21b640 1 -- 172.21.15.7:0/2848275300 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f33480d3760 msgr2=0x7f334815eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.240+0000 7f334d21b640 1 --2- 172.21.15.7:0/2848275300 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f33480d3760 0x7f334815eac0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3338009dc0 tx=0x7f333802a6d0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.240+0000 7f334d21b640 1 -- 172.21.15.7:0/2848275300 shutdown_connections 2024-04-25T10:04:55.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.240+0000 7f334d21b640 1 --2- 172.21.15.7:0/2848275300 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f33480d3760 0x7f334815eac0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.240+0000 7f334d21b640 1 -- 172.21.15.7:0/2848275300 >> 172.21.15.7:0/2848275300 conn(0x7f3348072680 msgr2=0x7f3348072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:55.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.240+0000 7f334d21b640 1 -- 172.21.15.7:0/2848275300 shutdown_connections 2024-04-25T10:04:55.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.240+0000 7f334d21b640 1 -- 172.21.15.7:0/2848275300 wait complete. 2024-04-25T10:04:55.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.242+0000 7f334d21b640 1 Processor -- start 2024-04-25T10:04:55.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.242+0000 7f334d21b640 1 -- start start 2024-04-25T10:04:55.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.243+0000 7f334d21b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33480ce830 0x7f334814d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.243+0000 7f334d21b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33480d3760 0x7f3348158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.243+0000 7f334d21b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f334815f1c0 0x7f33480c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.243+0000 7f334d21b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33480d2190 con 0x7f33480ce830 2024-04-25T10:04:55.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.243+0000 7f334d21b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334815f000 con 0x7f33480d3760 2024-04-25T10:04:55.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.243+0000 7f334d21b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33480b2950 con 0x7f334815f1c0 2024-04-25T10:04:55.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.243+0000 7f3346d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33480ce830 0x7f334814d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.243+0000 7f3346d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33480ce830 0x7f334814d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47410/0 (socket says 172.21.15.7:47410) 2024-04-25T10:04:55.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.243+0000 7f3346d9d640 1 -- 172.21.15.7:0/955622463 learned_addr learned my addr 172.21.15.7:0/955622463 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:55.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.243+0000 7f334759e640 1 --2- 172.21.15.7:0/955622463 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f334815f1c0 0x7f33480c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.243+0000 7f3346d9d640 1 -- 172.21.15.7:0/955622463 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f334815f1c0 msgr2=0x7f33480c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.243+0000 7f334659c640 1 --2- 172.21.15.7:0/955622463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33480d3760 0x7f3348158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.243+0000 7f3346d9d640 1 --2- 172.21.15.7:0/955622463 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f334815f1c0 0x7f33480c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.243+0000 7f3346d9d640 1 -- 172.21.15.7:0/955622463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33480d3760 msgr2=0x7f3348158930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.243+0000 7f3346d9d640 1 --2- 172.21.15.7:0/955622463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33480d3760 0x7f3348158930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.243+0000 7f3346d9d640 1 -- 172.21.15.7:0/955622463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f334815a3b0 con 0x7f33480ce830 2024-04-25T10:04:55.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.243+0000 7f334759e640 1 --2- 172.21.15.7:0/955622463 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f334815f1c0 0x7f33480c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:55.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.243+0000 7f334659c640 1 --2- 172.21.15.7:0/955622463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33480d3760 0x7f3348158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:55.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.243+0000 7f3346d9d640 1 --2- 172.21.15.7:0/955622463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33480ce830 0x7f334814d930 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f3338000f80 tx=0x7f3338004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:55.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.244+0000 7f332f7fe640 1 -- 172.21.15.7:0/955622463 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338040070 con 0x7f33480ce830 2024-04-25T10:04:55.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.244+0000 7f332f7fe640 1 -- 172.21.15.7:0/955622463 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3338031bc0 con 0x7f33480ce830 2024-04-25T10:04:55.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.244+0000 7f334d21b640 1 -- 172.21.15.7:0/955622463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3348159310 con 0x7f33480ce830 2024-04-25T10:04:55.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.244+0000 7f332f7fe640 1 -- 172.21.15.7:0/955622463 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338009450 con 0x7f33480ce830 2024-04-25T10:04:55.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.244+0000 7f334d21b640 1 -- 172.21.15.7:0/955622463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33481598d0 con 0x7f33480ce830 2024-04-25T10:04:55.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.245+0000 7f334d21b640 1 -- 172.21.15.7:0/955622463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3348159fe0 con 0x7f33480ce830 2024-04-25T10:04:55.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.245+0000 7f332f7fe640 1 -- 172.21.15.7:0/955622463 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3338039040 con 0x7f33480ce830 2024-04-25T10:04:55.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.245+0000 7f332f7fe640 1 --2- 172.21.15.7:0/955622463 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f333406b500 0x7f333406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.245+0000 7f332f7fe640 1 -- 172.21.15.7:0/955622463 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f33380abbe0 con 0x7f33480ce830 2024-04-25T10:04:55.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.246+0000 7f334659c640 1 --2- 172.21.15.7:0/955622463 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f333406b500 0x7f333406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.246+0000 7f334659c640 1 --2- 172.21.15.7:0/955622463 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f333406b500 0x7f333406d9c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f33480c9050 tx=0x7f333c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:55.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.250+0000 7f332f7fe640 1 -- 172.21.15.7:0/955622463 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f333807a880 con 0x7f33480ce830 2024-04-25T10:04:55.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.428+0000 7f334d21b640 1 -- 172.21.15.7:0/955622463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f33480ce610 con 0x7f33480ce830 2024-04-25T10:04:55.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.429+0000 7f332f7fe640 1 -- 172.21.15.7:0/955622463 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v118) v1 ==== 104+0+11 (secure 0 0 0) 0x7f333807a180 con 0x7f33480ce830 2024-04-25T10:04:55.434 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T10:04:55.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.431+0000 7f334d21b640 1 -- 172.21.15.7:0/955622463 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f333406b500 msgr2=0x7f333406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.431+0000 7f334d21b640 1 --2- 172.21.15.7:0/955622463 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f333406b500 0x7f333406d9c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f33480c9050 tx=0x7f333c009040 comp rx=0 tx=0).stop 2024-04-25T10:04:55.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.431+0000 7f334d21b640 1 -- 172.21.15.7:0/955622463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33480ce830 msgr2=0x7f334814d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.431+0000 7f334d21b640 1 --2- 172.21.15.7:0/955622463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33480ce830 0x7f334814d930 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f3338000f80 tx=0x7f3338004a40 comp rx=0 tx=0).stop 2024-04-25T10:04:55.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.431+0000 7f334d21b640 1 -- 172.21.15.7:0/955622463 shutdown_connections 2024-04-25T10:04:55.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.431+0000 7f334d21b640 1 --2- 172.21.15.7:0/955622463 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f333406b500 0x7f333406d9c0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.431+0000 7f334d21b640 1 --2- 172.21.15.7:0/955622463 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f334815f1c0 0x7f33480c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.431+0000 7f334d21b640 1 --2- 172.21.15.7:0/955622463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33480d3760 0x7f3348158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.431+0000 7f334d21b640 1 --2- 172.21.15.7:0/955622463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33480ce830 0x7f334814d930 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.431+0000 7f334d21b640 1 -- 172.21.15.7:0/955622463 >> 172.21.15.7:0/955622463 conn(0x7f3348072680 msgr2=0x7f3348160cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:55.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.431+0000 7f334d21b640 1 -- 172.21.15.7:0/955622463 shutdown_connections 2024-04-25T10:04:55.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.431+0000 7f334d21b640 1 -- 172.21.15.7:0/955622463 wait complete. 2024-04-25T10:04:55.447 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:04:55.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.546+0000 7f393c932640 1 Processor -- start 2024-04-25T10:04:55.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.546+0000 7f393c932640 1 -- start start 2024-04-25T10:04:55.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.547+0000 7f393c932640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39380d0a00 0x7f393809a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.547+0000 7f393c932640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f393809a7d0 0x7f39380cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.547+0000 7f393c932640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39381615e0 con 0x7f3938161200 2024-04-25T10:04:55.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.547+0000 7f393c932640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f393806c9f0 con 0x7f393809a7d0 2024-04-25T10:04:55.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.547+0000 7f393c932640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393806ccd0 con 0x7f39380d0a00 2024-04-25T10:04:55.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.547+0000 7f3936d9d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f393809a7d0 0x7f39380cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.547+0000 7f393659c640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3938161200 0x7f39380cbd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35734/0 (socket says 172.21.15.7:35734) 2024-04-25T10:04:55.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.547+0000 7f393659c640 1 -- 172.21.15.7:0/2070382763 learned_addr learned my addr 172.21.15.7:0/2070382763 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:55.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.547+0000 7f3935d9b640 1 --2- 172.21.15.7:0/2070382763 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39380d0a00 0x7f393809a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.547+0000 7f3936d9d640 1 -- 172.21.15.7:0/2070382763 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39380d0a00 msgr2=0x7f393809a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:55.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.547+0000 7f3936d9d640 1 --2- 172.21.15.7:0/2070382763 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39380d0a00 0x7f393809a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.547+0000 7f3936d9d640 1 -- 172.21.15.7:0/2070382763 >> v1:172.21.15.7:6789/0 conn(0x7f3938161200 legacy=0x7f39380cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.547+0000 7f3936d9d640 1 -- 172.21.15.7:0/2070382763 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3938099a90 con 0x7f393809a7d0 2024-04-25T10:04:55.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.547+0000 7f393559a640 1 -- 172.21.15.7:0/2070382763 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3137142908 0 0) 0x7f3928001110 con 0x7f3938161200 2024-04-25T10:04:55.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.547+0000 7f3935d9b640 1 --2- 172.21.15.7:0/2070382763 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39380d0a00 0x7f393809a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:55.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.548+0000 7f3936d9d640 1 --2- 172.21.15.7:0/2070382763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f393809a7d0 0x7f39380cf840 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f3930009d90 tx=0x7f393002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4e5690aef1a90a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:55.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.548+0000 7f393559a640 1 -- 172.21.15.7:0/2070382763 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3930007740 con 0x7f393809a7d0 2024-04-25T10:04:55.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.548+0000 7f393559a640 1 -- 172.21.15.7:0/2070382763 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39300078e0 con 0x7f393809a7d0 2024-04-25T10:04:55.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.548+0000 7f393559a640 1 -- 172.21.15.7:0/2070382763 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3930007cb0 con 0x7f393809a7d0 2024-04-25T10:04:55.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.549+0000 7f393c932640 1 -- 172.21.15.7:0/2070382763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f393809a7d0 msgr2=0x7f39380cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.549+0000 7f393c932640 1 --2- 172.21.15.7:0/2070382763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f393809a7d0 0x7f39380cf840 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f3930009d90 tx=0x7f393002a660 comp rx=0 tx=0).stop 2024-04-25T10:04:55.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.549+0000 7f393c932640 1 -- 172.21.15.7:0/2070382763 shutdown_connections 2024-04-25T10:04:55.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.549+0000 7f393c932640 1 --2- 172.21.15.7:0/2070382763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f393809a7d0 0x7f39380cf840 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.549+0000 7f393c932640 1 --2- 172.21.15.7:0/2070382763 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39380d0a00 0x7f393809a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.549+0000 7f393c932640 1 -- 172.21.15.7:0/2070382763 >> 172.21.15.7:0/2070382763 conn(0x7f39380b31a0 msgr2=0x7f39380b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:55.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.549+0000 7f393c932640 1 -- 172.21.15.7:0/2070382763 shutdown_connections 2024-04-25T10:04:55.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.549+0000 7f393c932640 1 -- 172.21.15.7:0/2070382763 wait complete. 2024-04-25T10:04:55.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.550+0000 7f393c932640 1 Processor -- start 2024-04-25T10:04:55.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.550+0000 7f393c932640 1 -- start start 2024-04-25T10:04:55.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.551+0000 7f393c932640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f393809a7d0 0x7f393814fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.551+0000 7f393c932640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39380d0a00 0x7f39381f6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.551+0000 7f393c932640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3938161200 0x7f39381f4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.551+0000 7f393c932640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393806cfb0 con 0x7f393809a7d0 2024-04-25T10:04:55.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.551+0000 7f393c932640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393806c680 con 0x7f39380d0a00 2024-04-25T10:04:55.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.551+0000 7f393c932640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393806d130 con 0x7f3938161200 2024-04-25T10:04:55.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.551+0000 7f393659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f393809a7d0 0x7f393814fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.551+0000 7f393659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f393809a7d0 0x7f393814fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47428/0 (socket says 172.21.15.7:47428) 2024-04-25T10:04:55.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.551+0000 7f393659c640 1 -- 172.21.15.7:0/841812677 learned_addr learned my addr 172.21.15.7:0/841812677 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:55.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.551+0000 7f3935d9b640 1 --2- 172.21.15.7:0/841812677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39380d0a00 0x7f39381f6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.551+0000 7f3936d9d640 1 --2- 172.21.15.7:0/841812677 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3938161200 0x7f39381f4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.551+0000 7f393659c640 1 -- 172.21.15.7:0/841812677 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3938161200 msgr2=0x7f39381f4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.551+0000 7f393659c640 1 --2- 172.21.15.7:0/841812677 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3938161200 0x7f39381f4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.551+0000 7f393659c640 1 -- 172.21.15.7:0/841812677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39380d0a00 msgr2=0x7f39381f6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.551+0000 7f393659c640 1 --2- 172.21.15.7:0/841812677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39380d0a00 0x7f39381f6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.551+0000 7f393659c640 1 -- 172.21.15.7:0/841812677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39381f75c0 con 0x7f393809a7d0 2024-04-25T10:04:55.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.551+0000 7f3935d9b640 1 --2- 172.21.15.7:0/841812677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39380d0a00 0x7f39381f6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:55.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.552+0000 7f393659c640 1 --2- 172.21.15.7:0/841812677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f393809a7d0 0x7f393814fc50 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f392800c430 tx=0x7f392800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:55.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.552+0000 7f3926ffd640 1 -- 172.21.15.7:0/841812677 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39280074e0 con 0x7f393809a7d0 2024-04-25T10:04:55.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.552+0000 7f3926ffd640 1 -- 172.21.15.7:0/841812677 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39280047e0 con 0x7f393809a7d0 2024-04-25T10:04:55.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.552+0000 7f3926ffd640 1 -- 172.21.15.7:0/841812677 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3928004bd0 con 0x7f393809a7d0 2024-04-25T10:04:55.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.552+0000 7f393c932640 1 -- 172.21.15.7:0/841812677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39381f78a0 con 0x7f393809a7d0 2024-04-25T10:04:55.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.552+0000 7f393c932640 1 -- 172.21.15.7:0/841812677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39381f3800 con 0x7f393809a7d0 2024-04-25T10:04:55.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.553+0000 7f393c932640 1 -- 172.21.15.7:0/841812677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3938068f60 con 0x7f393809a7d0 2024-04-25T10:04:55.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.553+0000 7f3926ffd640 1 -- 172.21.15.7:0/841812677 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3928011070 con 0x7f393809a7d0 2024-04-25T10:04:55.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.554+0000 7f3926ffd640 1 --2- 172.21.15.7:0/841812677 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f391806b4d0 0x7f391806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.554+0000 7f3926ffd640 1 -- 172.21.15.7:0/841812677 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f392808a050 con 0x7f393809a7d0 2024-04-25T10:04:55.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.554+0000 7f3935d9b640 1 --2- 172.21.15.7:0/841812677 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f391806b4d0 0x7f391806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.554+0000 7f3935d9b640 1 --2- 172.21.15.7:0/841812677 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f391806b4d0 0x7f391806d990 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f39380b7650 tx=0x7f392c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:55.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.558+0000 7f3926ffd640 1 -- 172.21.15.7:0/841812677 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f39381615e0 con 0x7f393809a7d0 2024-04-25T10:04:55.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.738+0000 7f393c932640 1 -- 172.21.15.7:0/841812677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f39380b4050 con 0x7f393809a7d0 2024-04-25T10:04:55.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.738+0000 7f3926ffd640 1 -- 172.21.15.7:0/841812677 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v118) v1 ==== 100+0+11 (secure 0 0 0) 0x7f392800e280 con 0x7f393809a7d0 2024-04-25T10:04:55.744 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T10:04:55.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.740+0000 7f393c932640 1 -- 172.21.15.7:0/841812677 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f391806b4d0 msgr2=0x7f391806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.740+0000 7f393c932640 1 --2- 172.21.15.7:0/841812677 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f391806b4d0 0x7f391806d990 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f39380b7650 tx=0x7f392c008040 comp rx=0 tx=0).stop 2024-04-25T10:04:55.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.740+0000 7f393c932640 1 -- 172.21.15.7:0/841812677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f393809a7d0 msgr2=0x7f393814fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.740+0000 7f393c932640 1 --2- 172.21.15.7:0/841812677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f393809a7d0 0x7f393814fc50 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f392800c430 tx=0x7f392800c8f0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.740+0000 7f393c932640 1 -- 172.21.15.7:0/841812677 shutdown_connections 2024-04-25T10:04:55.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.740+0000 7f393c932640 1 --2- 172.21.15.7:0/841812677 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f391806b4d0 0x7f391806d990 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.740+0000 7f393c932640 1 --2- 172.21.15.7:0/841812677 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3938161200 0x7f39381f4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.740+0000 7f393c932640 1 --2- 172.21.15.7:0/841812677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39380d0a00 0x7f39381f6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.740+0000 7f393c932640 1 --2- 172.21.15.7:0/841812677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f393809a7d0 0x7f393814fc50 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.740+0000 7f393c932640 1 -- 172.21.15.7:0/841812677 >> 172.21.15.7:0/841812677 conn(0x7f39380b31a0 msgr2=0x7f39380ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:55.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.740+0000 7f393c932640 1 -- 172.21.15.7:0/841812677 shutdown_connections 2024-04-25T10:04:55.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.740+0000 7f393c932640 1 -- 172.21.15.7:0/841812677 wait complete. 2024-04-25T10:04:55.757 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:04:55.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.854+0000 7fd68596a640 1 Processor -- start 2024-04-25T10:04:55.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.854+0000 7fd68596a640 1 -- start start 2024-04-25T10:04:55.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.855+0000 7fd68596a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd68015eba0 0x7fd68006fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.855+0000 7fd68596a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6801618f0 con 0x7fd68006ab60 2024-04-25T10:04:55.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.855+0000 7fd68596a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd680161bd0 con 0x7fd68015d7b0 2024-04-25T10:04:55.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.855+0000 7fd68596a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd680161eb0 con 0x7fd68015eba0 2024-04-25T10:04:55.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.855+0000 7fd677fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd68015eba0 0x7fd68006fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.855+0000 7fd67f7fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd68006ab60 0x7fd68006af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35736/0 (socket says 172.21.15.7:35736) 2024-04-25T10:04:55.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.855+0000 7fd677fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd68015eba0 0x7fd68006fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47436/0 (socket says 172.21.15.7:47436) 2024-04-25T10:04:55.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.855+0000 7fd67f7fe640 1 -- 172.21.15.7:0/3131050055 learned_addr learned my addr 172.21.15.7:0/3131050055 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:55.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.855+0000 7fd677fff640 1 -- 172.21.15.7:0/3131050055 >> v1:172.21.15.55:6789/0 conn(0x7fd68015d7b0 legacy=0x7fd6800b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.855+0000 7fd677fff640 1 -- 172.21.15.7:0/3131050055 >> v1:172.21.15.7:6789/0 conn(0x7fd68006ab60 legacy=0x7fd68006af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.855+0000 7fd677fff640 1 -- 172.21.15.7:0/3131050055 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd680162190 con 0x7fd68015eba0 2024-04-25T10:04:55.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.855+0000 7fd67e7fc640 1 -- 172.21.15.7:0/3131050055 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4064360022 0 0) 0x7fd6801618f0 con 0x7fd68006ab60 2024-04-25T10:04:55.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.856+0000 7fd677fff640 1 --2- 172.21.15.7:0/3131050055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd68015eba0 0x7fd68006fa00 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7fd6680097d0 tx=0x7fd66802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf4462d9e879bb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:55.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.856+0000 7fd67e7fc640 1 -- 172.21.15.7:0/3131050055 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd668037070 con 0x7fd68015eba0 2024-04-25T10:04:55.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.856+0000 7fd67e7fc640 1 -- 172.21.15.7:0/3131050055 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd668032440 con 0x7fd68015eba0 2024-04-25T10:04:55.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.856+0000 7fd67e7fc640 1 -- 172.21.15.7:0/3131050055 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd668032810 con 0x7fd68015eba0 2024-04-25T10:04:55.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.856+0000 7fd68596a640 1 -- 172.21.15.7:0/3131050055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd68015eba0 msgr2=0x7fd68006fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.856+0000 7fd68596a640 1 --2- 172.21.15.7:0/3131050055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd68015eba0 0x7fd68006fa00 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7fd6680097d0 tx=0x7fd66802a1c0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.857+0000 7fd68596a640 1 -- 172.21.15.7:0/3131050055 shutdown_connections 2024-04-25T10:04:55.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.857+0000 7fd68596a640 1 --2- 172.21.15.7:0/3131050055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd68015eba0 0x7fd68006fa00 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.857+0000 7fd68596a640 1 -- 172.21.15.7:0/3131050055 >> 172.21.15.7:0/3131050055 conn(0x7fd6800b2390 msgr2=0x7fd6800b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:55.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.857+0000 7fd68596a640 1 -- 172.21.15.7:0/3131050055 shutdown_connections 2024-04-25T10:04:55.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.857+0000 7fd68596a640 1 -- 172.21.15.7:0/3131050055 wait complete. 2024-04-25T10:04:55.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.858+0000 7fd68596a640 1 Processor -- start 2024-04-25T10:04:55.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.858+0000 7fd68596a640 1 -- start start 2024-04-25T10:04:55.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.858+0000 7fd68596a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd68006ab60 0x7fd6800a8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.858+0000 7fd68596a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd68015d7b0 0x7fd6801f3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.858+0000 7fd68596a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd68015eba0 0x7fd68015a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.858+0000 7fd68596a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd680161690 con 0x7fd68015d7b0 2024-04-25T10:04:55.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.858+0000 7fd68596a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd680161510 con 0x7fd68015eba0 2024-04-25T10:04:55.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.858+0000 7fd68596a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6800b3a70 con 0x7fd68006ab60 2024-04-25T10:04:55.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.859+0000 7fd677fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd68015d7b0 0x7fd6801f3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.859+0000 7fd677fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd68015d7b0 0x7fd6801f3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47448/0 (socket says 172.21.15.7:47448) 2024-04-25T10:04:55.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.859+0000 7fd677fff640 1 -- 172.21.15.7:0/703975750 learned_addr learned my addr 172.21.15.7:0/703975750 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:55.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.859+0000 7fd67f7fe640 1 --2- 172.21.15.7:0/703975750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd68015eba0 0x7fd68015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.859+0000 7fd67effd640 1 --2- 172.21.15.7:0/703975750 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd68006ab60 0x7fd6800a8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.859+0000 7fd677fff640 1 -- 172.21.15.7:0/703975750 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd68006ab60 msgr2=0x7fd6800a8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.859+0000 7fd677fff640 1 --2- 172.21.15.7:0/703975750 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd68006ab60 0x7fd6800a8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.859+0000 7fd677fff640 1 -- 172.21.15.7:0/703975750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd68015eba0 msgr2=0x7fd68015a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.859+0000 7fd677fff640 1 --2- 172.21.15.7:0/703975750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd68015eba0 0x7fd68015a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.859+0000 7fd677fff640 1 -- 172.21.15.7:0/703975750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68015b120 con 0x7fd68015d7b0 2024-04-25T10:04:55.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.859+0000 7fd677fff640 1 --2- 172.21.15.7:0/703975750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd68015d7b0 0x7fd6801f3a70 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7fd6680097d0 tx=0x7fd6680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:55.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.859+0000 7fd67cff9640 1 -- 172.21.15.7:0/703975750 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd668037050 con 0x7fd68015d7b0 2024-04-25T10:04:55.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.859+0000 7fd67cff9640 1 -- 172.21.15.7:0/703975750 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd668038040 con 0x7fd68015d7b0 2024-04-25T10:04:55.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.859+0000 7fd68596a640 1 -- 172.21.15.7:0/703975750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6801e7550 con 0x7fd68015d7b0 2024-04-25T10:04:55.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.859+0000 7fd67cff9640 1 -- 172.21.15.7:0/703975750 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd668004490 con 0x7fd68015d7b0 2024-04-25T10:04:55.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.859+0000 7fd68596a640 1 -- 172.21.15.7:0/703975750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6801e7d90 con 0x7fd68015d7b0 2024-04-25T10:04:55.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.860+0000 7fd68596a640 1 -- 172.21.15.7:0/703975750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd680068fd0 con 0x7fd68015d7b0 2024-04-25T10:04:55.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.861+0000 7fd67cff9640 1 -- 172.21.15.7:0/703975750 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd668030900 con 0x7fd68015d7b0 2024-04-25T10:04:55.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.861+0000 7fd67cff9640 1 --2- 172.21.15.7:0/703975750 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd66006b4d0 0x7fd66006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.861+0000 7fd67cff9640 1 -- 172.21.15.7:0/703975750 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fd6680aaf70 con 0x7fd68015d7b0 2024-04-25T10:04:55.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.861+0000 7fd67effd640 1 --2- 172.21.15.7:0/703975750 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd66006b4d0 0x7fd66006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.862+0000 7fd67effd640 1 --2- 172.21.15.7:0/703975750 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd66006b4d0 0x7fd66006d990 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fd670000f60 tx=0x7fd670009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:55.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:55.866+0000 7fd67cff9640 1 -- 172.21.15.7:0/703975750 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd6801e7550 con 0x7fd68015d7b0 2024-04-25T10:04:56.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.060+0000 7fd68596a640 1 -- 172.21.15.7:0/703975750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd6800b00e0 con 0x7fd68015d7b0 2024-04-25T10:04:56.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.060+0000 7fd67cff9640 1 -- 172.21.15.7:0/703975750 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v118) v1 ==== 80+0+120 (secure 0 0 0) 0x7fd668079d30 con 0x7fd68015d7b0 2024-04-25T10:04:56.066 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3623521645 2024-04-26T10:04:46.961147+0000 2024-04-25T10:04:56.066 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3623521645 2024-04-26T10:04:46.961147+0000 2024-04-25T10:04:56.066 INFO:teuthology.orchestra.run.smithi007.stderr:listed 2 entries 2024-04-25T10:04:56.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.062+0000 7fd68596a640 1 -- 172.21.15.7:0/703975750 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd66006b4d0 msgr2=0x7fd66006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.062+0000 7fd68596a640 1 --2- 172.21.15.7:0/703975750 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd66006b4d0 0x7fd66006d990 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fd670000f60 tx=0x7fd670009040 comp rx=0 tx=0).stop 2024-04-25T10:04:56.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.062+0000 7fd68596a640 1 -- 172.21.15.7:0/703975750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd68015d7b0 msgr2=0x7fd6801f3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.062+0000 7fd68596a640 1 --2- 172.21.15.7:0/703975750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd68015d7b0 0x7fd6801f3a70 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7fd6680097d0 tx=0x7fd6680046c0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.062+0000 7fd68596a640 1 -- 172.21.15.7:0/703975750 shutdown_connections 2024-04-25T10:04:56.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.062+0000 7fd68596a640 1 --2- 172.21.15.7:0/703975750 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd66006b4d0 0x7fd66006d990 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.062+0000 7fd68596a640 1 --2- 172.21.15.7:0/703975750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd68015eba0 0x7fd68015a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.062+0000 7fd68596a640 1 --2- 172.21.15.7:0/703975750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd68015d7b0 0x7fd6801f3a70 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.062+0000 7fd68596a640 1 --2- 172.21.15.7:0/703975750 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd68006ab60 0x7fd6800a8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.062+0000 7fd68596a640 1 -- 172.21.15.7:0/703975750 >> 172.21.15.7:0/703975750 conn(0x7fd6800b2390 msgr2=0x7fd6800b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:56.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.062+0000 7fd68596a640 1 -- 172.21.15.7:0/703975750 shutdown_connections 2024-04-25T10:04:56.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.062+0000 7fd68596a640 1 -- 172.21.15.7:0/703975750 wait complete. 2024-04-25T10:04:56.078 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T10:04:56.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:56.079 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T10:04:56.106 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-04-25T10:04:56.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:56.107 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T10:04:56.162 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:04:56.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.298+0000 7f6767789640 1 Processor -- start 2024-04-25T10:04:56.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.298+0000 7f6767789640 1 -- start start 2024-04-25T10:04:56.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.299+0000 7f6767789640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f67600b6a40 0x7f676006c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.299+0000 7f6767789640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f676006cd00 con 0x7f67600b5e60 2024-04-25T10:04:56.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.299+0000 7f6767789640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67600d1ca0 con 0x7f676015dd00 2024-04-25T10:04:56.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.299+0000 7f6767789640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f676015e0e0 con 0x7f67600b6a40 2024-04-25T10:04:56.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.299+0000 7f6765d26640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f67600b6a40 0x7f676006c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.299+0000 7f6764d24640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f67600b5e60 0x7f676006bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35746/0 (socket says 172.21.15.7:35746) 2024-04-25T10:04:56.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.299+0000 7f6764d24640 1 -- 172.21.15.7:0/2345976031 learned_addr learned my addr 172.21.15.7:0/2345976031 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:56.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.299+0000 7f6765d26640 1 -- 172.21.15.7:0/2345976031 >> v1:172.21.15.55:6789/0 conn(0x7f676015dd00 legacy=0x7f67600b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:56.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.299+0000 7f6765d26640 1 -- 172.21.15.7:0/2345976031 >> v1:172.21.15.7:6789/0 conn(0x7f67600b5e60 legacy=0x7f676006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.299+0000 7f6757fff640 1 -- 172.21.15.7:0/2345976031 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1457180286 0 0) 0x7f676006cd00 con 0x7f67600b5e60 2024-04-25T10:04:56.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.300+0000 7f6765d26640 1 -- 172.21.15.7:0/2345976031 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67600d1f80 con 0x7f67600b6a40 2024-04-25T10:04:56.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.300+0000 7f6765d26640 1 --2- 172.21.15.7:0/2345976031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67600b6a40 0x7f676006c6c0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f6758009d90 tx=0x7f675802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7aca2ed4f4918b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:56.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.300+0000 7f6757fff640 1 -- 172.21.15.7:0/2345976031 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6758007740 con 0x7f67600b6a40 2024-04-25T10:04:56.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.300+0000 7f6757fff640 1 -- 172.21.15.7:0/2345976031 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67580078e0 con 0x7f67600b6a40 2024-04-25T10:04:56.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.300+0000 7f6757fff640 1 -- 172.21.15.7:0/2345976031 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6758007cb0 con 0x7f67600b6a40 2024-04-25T10:04:56.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.301+0000 7f6767789640 1 -- 172.21.15.7:0/2345976031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67600b6a40 msgr2=0x7f676006c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.301+0000 7f6767789640 1 --2- 172.21.15.7:0/2345976031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67600b6a40 0x7f676006c6c0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f6758009d90 tx=0x7f675802a6a0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.301+0000 7f6767789640 1 -- 172.21.15.7:0/2345976031 shutdown_connections 2024-04-25T10:04:56.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.301+0000 7f6767789640 1 --2- 172.21.15.7:0/2345976031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67600b6a40 0x7f676006c6c0 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.301+0000 7f6767789640 1 -- 172.21.15.7:0/2345976031 >> 172.21.15.7:0/2345976031 conn(0x7f67600d07b0 msgr2=0x7f67600d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:56.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.301+0000 7f6767789640 1 -- 172.21.15.7:0/2345976031 shutdown_connections 2024-04-25T10:04:56.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.301+0000 7f6767789640 1 -- 172.21.15.7:0/2345976031 wait complete. 2024-04-25T10:04:56.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.302+0000 7f6767789640 1 Processor -- start 2024-04-25T10:04:56.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.302+0000 7f6767789640 1 -- start start 2024-04-25T10:04:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.303+0000 7f6767789640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67600b5e60 0x7f6760149ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.303+0000 7f6767789640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f67600b6a40 0x7f67600d3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.303+0000 7f6767789640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f676015dd00 0x7f67600d3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.303+0000 7f6767789640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6760168ab0 con 0x7f67600b5e60 2024-04-25T10:04:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.303+0000 7f6767789640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676006cfe0 con 0x7f676015dd00 2024-04-25T10:04:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.303+0000 7f6767789640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6760168c30 con 0x7f67600b6a40 2024-04-25T10:04:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.303+0000 7f6765525640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67600b5e60 0x7f6760149ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.303+0000 7f6765525640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67600b5e60 0x7f6760149ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47452/0 (socket says 172.21.15.7:47452) 2024-04-25T10:04:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.303+0000 7f6765525640 1 -- 172.21.15.7:0/3695256041 learned_addr learned my addr 172.21.15.7:0/3695256041 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.303+0000 7f6765d26640 1 --2- 172.21.15.7:0/3695256041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f676015dd00 0x7f67600d3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.303+0000 7f6764d24640 1 --2- 172.21.15.7:0/3695256041 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f67600b6a40 0x7f67600d3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.303+0000 7f6765525640 1 -- 172.21.15.7:0/3695256041 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f67600b6a40 msgr2=0x7f67600d3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.303+0000 7f6765525640 1 --2- 172.21.15.7:0/3695256041 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f67600b6a40 0x7f67600d3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.303+0000 7f6765525640 1 -- 172.21.15.7:0/3695256041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f676015dd00 msgr2=0x7f67600d3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.303+0000 7f6765525640 1 --2- 172.21.15.7:0/3695256041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f676015dd00 0x7f67600d3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.303+0000 7f6765525640 1 -- 172.21.15.7:0/3695256041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67601589f0 con 0x7f67600b5e60 2024-04-25T10:04:56.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.303+0000 7f6764d24640 1 --2- 172.21.15.7:0/3695256041 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f67600b6a40 0x7f67600d3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:56.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.304+0000 7f6765525640 1 --2- 172.21.15.7:0/3695256041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67600b5e60 0x7f6760149ea0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f675c00b3e0 tx=0x7f675c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:56.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.304+0000 7f6755ffb640 1 -- 172.21.15.7:0/3695256041 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c015020 con 0x7f67600b5e60 2024-04-25T10:04:56.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.304+0000 7f6755ffb640 1 -- 172.21.15.7:0/3695256041 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675c011850 con 0x7f67600b5e60 2024-04-25T10:04:56.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.304+0000 7f6755ffb640 1 -- 172.21.15.7:0/3695256041 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c011c40 con 0x7f67600b5e60 2024-04-25T10:04:56.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.304+0000 7f6767789640 1 -- 172.21.15.7:0/3695256041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6760158cd0 con 0x7f67600b5e60 2024-04-25T10:04:56.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.304+0000 7f6767789640 1 -- 172.21.15.7:0/3695256041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6760159290 con 0x7f67600b5e60 2024-04-25T10:04:56.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.305+0000 7f6767789640 1 -- 172.21.15.7:0/3695256041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6760068fd0 con 0x7f67600b5e60 2024-04-25T10:04:56.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.305+0000 7f6755ffb640 1 -- 172.21.15.7:0/3695256041 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f675c018020 con 0x7f67600b5e60 2024-04-25T10:04:56.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.306+0000 7f6755ffb640 1 --2- 172.21.15.7:0/3695256041 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f674406b4d0 0x7f674406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.306+0000 7f6764d24640 1 --2- 172.21.15.7:0/3695256041 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f674406b4d0 0x7f674406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.306+0000 7f6755ffb640 1 -- 172.21.15.7:0/3695256041 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f675c08a430 con 0x7f67600b5e60 2024-04-25T10:04:56.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.307+0000 7f6764d24640 1 --2- 172.21.15.7:0/3695256041 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f674406b4d0 0x7f674406d990 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f676014dc70 tx=0x7f6750009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:56.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.310+0000 7f6755ffb640 1 -- 172.21.15.7:0/3695256041 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f675c01f020 con 0x7f67600b5e60 2024-04-25T10:04:56.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.526+0000 7f6767789640 1 -- 172.21.15.7:0/3695256041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67600d1620 con 0x7f67600b5e60 2024-04-25T10:04:56.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.527+0000 7f6755ffb640 1 -- 172.21.15.7:0/3695256041 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4936 (secure 0 0 0) 0x7f675c0172c0 con 0x7f67600b5e60 2024-04-25T10:04:56.533 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:56.533 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":94,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6992,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2679200172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2679200172},{"type":"v1","addr":"172.21.15.7:6837","nonce":2679200172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":7942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/4039147179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":4039147179},{"type":"v1","addr":"172.21.15.55:6833","nonce":4039147179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":7945,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3456170359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3456170359},{"type":"v1","addr":"172.21.15.55:6835","nonce":3456170359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:04:29.599245+0000","modified":"2024-04-25T10:04:49.986796+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":118,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9321":{"gid":9321,"name":"a","rank":0,"incarnation":91,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/3781378145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3781378145},{"type":"v1","addr":"172.21.15.7:6836","nonce":3781378145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T10:04:56.533 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 94 2024-04-25T10:04:56.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.529+0000 7f6767789640 1 -- 172.21.15.7:0/3695256041 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f674406b4d0 msgr2=0x7f674406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.529+0000 7f6767789640 1 --2- 172.21.15.7:0/3695256041 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f674406b4d0 0x7f674406d990 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f676014dc70 tx=0x7f6750009040 comp rx=0 tx=0).stop 2024-04-25T10:04:56.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.529+0000 7f6767789640 1 -- 172.21.15.7:0/3695256041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67600b5e60 msgr2=0x7f6760149ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.529+0000 7f6767789640 1 --2- 172.21.15.7:0/3695256041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67600b5e60 0x7f6760149ea0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f675c00b3e0 tx=0x7f675c00b8a0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.529+0000 7f6767789640 1 -- 172.21.15.7:0/3695256041 shutdown_connections 2024-04-25T10:04:56.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.529+0000 7f6767789640 1 --2- 172.21.15.7:0/3695256041 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f674406b4d0 0x7f674406d990 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.529+0000 7f6767789640 1 --2- 172.21.15.7:0/3695256041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f676015dd00 0x7f67600d3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.529+0000 7f6767789640 1 --2- 172.21.15.7:0/3695256041 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f67600b6a40 0x7f67600d3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.529+0000 7f6767789640 1 --2- 172.21.15.7:0/3695256041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67600b5e60 0x7f6760149ea0 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.529+0000 7f6767789640 1 -- 172.21.15.7:0/3695256041 >> 172.21.15.7:0/3695256041 conn(0x7f67600d07b0 msgr2=0x7f676006be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:56.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.529+0000 7f6767789640 1 -- 172.21.15.7:0/3695256041 shutdown_connections 2024-04-25T10:04:56.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.529+0000 7f6767789640 1 -- 172.21.15.7:0/3695256041 wait complete. 2024-04-25T10:04:56.545 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json tag path /parent mytag123 2024-04-25T10:04:56.665 INFO:teuthology.orchestra.run.smithi007.stdout:{"return_code":0,"scrub_tag":"mytag123","mode":"asynchronous"} 2024-04-25T10:04:56.666 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag123" } 2024-04-25T10:04:56.666 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000003.00000000 scrub_tag 2024-04-25T10:04:56.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.704+0000 7f785ca77f40 1 Processor -- start 2024-04-25T10:04:56.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.704+0000 7f785ca77f40 1 -- start start 2024-04-25T10:04:56.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.704+0000 7f785ca77f40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55ab5490e1b0 0x55ab5490d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.704+0000 7f785ca77f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ab5493b850 0x55ab549cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.704+0000 7f785ca77f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab549e0b50 0x55ab5494d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.704+0000 7f785ca77f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab549e1140 con 0x55ab549e0b50 2024-04-25T10:04:56.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.704+0000 7f785ca77f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab548b2df0 con 0x55ab5493b850 2024-04-25T10:04:56.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.704+0000 7f785ca77f40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ab549e12c0 con 0x55ab5490e1b0 2024-04-25T10:04:56.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.705+0000 7f785ad79640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab549e0b50 0x55ab5494d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.705+0000 7f785ad79640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab549e0b50 0x55ab5494d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47474/0 (socket says 172.21.15.7:47474) 2024-04-25T10:04:56.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.705+0000 7f785ad79640 1 -- 172.21.15.7:0/1943749595 learned_addr learned my addr 172.21.15.7:0/1943749595 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:56.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.705+0000 7f7859d77640 1 --2- 172.21.15.7:0/1943749595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ab5493b850 0x55ab549cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.705+0000 7f785a578640 1 --2- 172.21.15.7:0/1943749595 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55ab5490e1b0 0x55ab5490d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.705+0000 7f785ad79640 1 -- 172.21.15.7:0/1943749595 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55ab5490e1b0 msgr2=0x55ab5490d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:56.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.705+0000 7f785ad79640 1 --2- 172.21.15.7:0/1943749595 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55ab5490e1b0 0x55ab5490d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.705+0000 7f785ad79640 1 -- 172.21.15.7:0/1943749595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ab5493b850 msgr2=0x55ab549cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:56.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.705+0000 7f785ad79640 1 --2- 172.21.15.7:0/1943749595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ab5493b850 0x55ab549cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.705+0000 7f785ad79640 1 -- 172.21.15.7:0/1943749595 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab54838c50 con 0x55ab549e0b50 2024-04-25T10:04:56.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.705+0000 7f785a578640 1 --2- 172.21.15.7:0/1943749595 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55ab5490e1b0 0x55ab5490d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:56.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.705+0000 7f785ad79640 1 --2- 172.21.15.7:0/1943749595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab549e0b50 0x55ab5494d340 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f784c002690 tx=0x7f784c002b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b28876a4702b3d5f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:56.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.705+0000 7f7858d75640 1 -- 172.21.15.7:0/1943749595 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c016070 con 0x55ab549e0b50 2024-04-25T10:04:56.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.705+0000 7f7858d75640 1 -- 172.21.15.7:0/1943749595 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784c00d6b0 con 0x55ab549e0b50 2024-04-25T10:04:56.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.705+0000 7f7858d75640 1 -- 172.21.15.7:0/1943749595 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c00daa0 con 0x55ab549e0b50 2024-04-25T10:04:56.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.706+0000 7f785ca77f40 1 -- 172.21.15.7:0/1943749595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab549e0b50 msgr2=0x55ab5494d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.706+0000 7f785ca77f40 1 --2- 172.21.15.7:0/1943749595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab549e0b50 0x55ab5494d340 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f784c002690 tx=0x7f784c002b50 comp rx=0 tx=0).stop 2024-04-25T10:04:56.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.706+0000 7f785ca77f40 1 -- 172.21.15.7:0/1943749595 shutdown_connections 2024-04-25T10:04:56.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.706+0000 7f785ca77f40 1 --2- 172.21.15.7:0/1943749595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab549e0b50 0x55ab5494d340 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.706+0000 7f785ca77f40 1 --2- 172.21.15.7:0/1943749595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ab5493b850 0x55ab549cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.706+0000 7f785ca77f40 1 --2- 172.21.15.7:0/1943749595 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55ab5490e1b0 0x55ab5490d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.706+0000 7f785ca77f40 1 -- 172.21.15.7:0/1943749595 >> 172.21.15.7:0/1943749595 conn(0x55ab549392b0 msgr2=0x55ab5490ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:56.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.706+0000 7f785ca77f40 1 -- 172.21.15.7:0/1943749595 shutdown_connections 2024-04-25T10:04:56.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.706+0000 7f785ca77f40 1 -- 172.21.15.7:0/1943749595 wait complete. 2024-04-25T10:04:56.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.706+0000 7f785ca77f40 1 Processor -- start 2024-04-25T10:04:56.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.706+0000 7f785ca77f40 1 -- start start 2024-04-25T10:04:56.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.707+0000 7f785ca77f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab5490e1b0 0x55ab549cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.707+0000 7f785ca77f40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55ab5493b850 0x55ab549cd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.707+0000 7f785ca77f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ab549e0b50 0x55ab54a79480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.707+0000 7f785ca77f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab5490de10 con 0x55ab5490e1b0 2024-04-25T10:04:56.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.707+0000 7f785ca77f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab549dee70 con 0x55ab549e0b50 2024-04-25T10:04:56.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.707+0000 7f785ca77f40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ab549ce220 con 0x55ab5493b850 2024-04-25T10:04:56.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.707+0000 7f785a578640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab5490e1b0 0x55ab549cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.707+0000 7f785a578640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab5490e1b0 0x55ab549cdce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47482/0 (socket says 172.21.15.7:47482) 2024-04-25T10:04:56.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.707+0000 7f785a578640 1 -- 172.21.15.7:0/3666190732 learned_addr learned my addr 172.21.15.7:0/3666190732 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:56.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.707+0000 7f7859d77640 1 --2- 172.21.15.7:0/3666190732 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55ab5493b850 0x55ab549cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.707+0000 7f785ad79640 1 --2- 172.21.15.7:0/3666190732 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ab549e0b50 0x55ab54a79480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.708+0000 7f785a578640 1 -- 172.21.15.7:0/3666190732 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55ab5493b850 msgr2=0x55ab549cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.708+0000 7f785a578640 1 --2- 172.21.15.7:0/3666190732 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55ab5493b850 0x55ab549cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.708+0000 7f785a578640 1 -- 172.21.15.7:0/3666190732 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ab549e0b50 msgr2=0x55ab54a79480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.708+0000 7f785a578640 1 --2- 172.21.15.7:0/3666190732 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ab549e0b50 0x55ab54a79480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.708+0000 7f785a578640 1 -- 172.21.15.7:0/3666190732 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab54951020 con 0x55ab5490e1b0 2024-04-25T10:04:56.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.708+0000 7f785a578640 1 --2- 172.21.15.7:0/3666190732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab5490e1b0 0x55ab549cdce0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f7854007e30 tx=0x7f7854006750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:56.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.708+0000 7f78537fe640 1 -- 172.21.15.7:0/3666190732 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7854017070 con 0x55ab5490e1b0 2024-04-25T10:04:56.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.708+0000 7f78537fe640 1 -- 172.21.15.7:0/3666190732 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7854010710 con 0x55ab5490e1b0 2024-04-25T10:04:56.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.708+0000 7f78537fe640 1 -- 172.21.15.7:0/3666190732 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7854010ac0 con 0x55ab5490e1b0 2024-04-25T10:04:56.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.708+0000 7f785ca77f40 1 -- 172.21.15.7:0/3666190732 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ab54950d40 con 0x55ab5490e1b0 2024-04-25T10:04:56.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.708+0000 7f785ca77f40 1 -- 172.21.15.7:0/3666190732 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ab54a799c0 con 0x55ab5490e1b0 2024-04-25T10:04:56.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.709+0000 7f78537fe640 1 -- 172.21.15.7:0/3666190732 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f785401a070 con 0x55ab5490e1b0 2024-04-25T10:04:56.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.710+0000 7f78537fe640 1 --2- 172.21.15.7:0/3666190732 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f783c069eb0 0x7f783c06c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.710+0000 7f7859d77640 1 --2- 172.21.15.7:0/3666190732 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f783c069eb0 0x7f783c06c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.710+0000 7f78537fe640 1 -- 172.21.15.7:0/3666190732 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f78540885c0 con 0x55ab5490e1b0 2024-04-25T10:04:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.710+0000 7f785ca77f40 1 --2- 172.21.15.7:0/3666190732 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x55ab549dfd30 0x55ab5490c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.710+0000 7f785ca77f40 1 -- 172.21.15.7:0/3666190732 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:1 18.32 18:4def72d4:::10000000003.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e118) v9 -- 0x55ab5490ce40 con 0x55ab549dfd30 2024-04-25T10:04:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.710+0000 7f785ad79640 1 --2- 172.21.15.7:0/3666190732 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x55ab549dfd30 0x55ab5490c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.710+0000 7f7859d77640 1 --2- 172.21.15.7:0/3666190732 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f783c069eb0 0x7f783c06c370 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f7844057000 tx=0x7f7844052000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.710+0000 7f785ad79640 1 --2- 172.21.15.7:0/3666190732 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x55ab549dfd30 0x55ab5490c900 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.711+0000 7f785ad79640 1 -- 172.21.15.7:0/3666190732 <== osd.3 v2:172.21.15.7:6824/3045538953 1 ==== osd_op_reply(1 10000000003.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f784c00f070 con 0x55ab549dfd30 2024-04-25T10:04:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:error getting xattr cephfs_data/10000000003.00000000/scrub_tag: (61) No data available 2024-04-25T10:04:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.711+0000 7f785ca77f40 1 -- 172.21.15.7:0/3666190732 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x55ab549dfd30 msgr2=0x55ab5490c900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.711+0000 7f785ca77f40 1 --2- 172.21.15.7:0/3666190732 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x55ab549dfd30 0x55ab5490c900 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.711+0000 7f785ca77f40 1 -- 172.21.15.7:0/3666190732 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f783c069eb0 msgr2=0x7f783c06c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.711+0000 7f785ca77f40 1 --2- 172.21.15.7:0/3666190732 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f783c069eb0 0x7f783c06c370 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f7844057000 tx=0x7f7844052000 comp rx=0 tx=0).stop 2024-04-25T10:04:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.711+0000 7f785ca77f40 1 -- 172.21.15.7:0/3666190732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab5490e1b0 msgr2=0x55ab549cdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.711+0000 7f785ca77f40 1 --2- 172.21.15.7:0/3666190732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab5490e1b0 0x55ab549cdce0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f7854007e30 tx=0x7f7854006750 comp rx=0 tx=0).stop 2024-04-25T10:04:56.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.711+0000 7f785ad79640 1 -- 172.21.15.7:0/3666190732 reap_dead start 2024-04-25T10:04:56.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.711+0000 7f785ca77f40 1 -- 172.21.15.7:0/3666190732 shutdown_connections 2024-04-25T10:04:56.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.711+0000 7f785ca77f40 1 -- 172.21.15.7:0/3666190732 >> 172.21.15.7:0/3666190732 conn(0x55ab549392b0 msgr2=0x55ab5490d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:56.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.711+0000 7f785ca77f40 1 -- 172.21.15.7:0/3666190732 shutdown_connections 2024-04-25T10:04:56.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.711+0000 7f785ca77f40 1 -- 172.21.15.7:0/3666190732 wait complete. 2024-04-25T10:04:56.721 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:04:56.722 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2024-04-25T10:04:56.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.800+0000 7fb1e7b06f40 1 Processor -- start 2024-04-25T10:04:56.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.800+0000 7fb1e7b06f40 1 -- start start 2024-04-25T10:04:56.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.801+0000 7fb1e7b06f40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56354f1dfe70 0x56354f22b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.801+0000 7fb1e7b06f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354f29de90 0x56354f2b8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.801+0000 7fb1e7b06f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56354f29e270 0x56354f2b88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.801+0000 7fb1e7b06f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x56354f29ebf0 con 0x56354f29de90 2024-04-25T10:04:56.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.801+0000 7fb1e7b06f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56354f188df0 con 0x56354f29e270 2024-04-25T10:04:56.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.801+0000 7fb1e7b06f40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x56354f29ee90 con 0x56354f1dfe70 2024-04-25T10:04:56.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.801+0000 7fb1e4e06640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354f29de90 0x56354f2b8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.801+0000 7fb1e4e06640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354f29de90 0x56354f2b8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47492/0 (socket says 172.21.15.7:47492) 2024-04-25T10:04:56.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.801+0000 7fb1e4e06640 1 -- 172.21.15.7:0/3634747406 learned_addr learned my addr 172.21.15.7:0/3634747406 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:56.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.801+0000 7fb1e5e08640 1 --2- 172.21.15.7:0/3634747406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56354f29e270 0x56354f2b88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.801+0000 7fb1e5607640 1 --2- 172.21.15.7:0/3634747406 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56354f1dfe70 0x56354f22b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.801+0000 7fb1e4e06640 1 -- 172.21.15.7:0/3634747406 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56354f1dfe70 msgr2=0x56354f22b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:56.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.801+0000 7fb1e4e06640 1 --2- 172.21.15.7:0/3634747406 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56354f1dfe70 0x56354f22b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.801+0000 7fb1e4e06640 1 -- 172.21.15.7:0/3634747406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56354f29e270 msgr2=0x56354f2b88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:56.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.801+0000 7fb1e4e06640 1 --2- 172.21.15.7:0/3634747406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56354f29e270 0x56354f2b88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.801+0000 7fb1e4e06640 1 -- 172.21.15.7:0/3634747406 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56354f10ec50 con 0x56354f29de90 2024-04-25T10:04:56.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.801+0000 7fb1e4e06640 1 --2- 172.21.15.7:0/3634747406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354f29de90 0x56354f2b8370 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7fb1d000b240 tx=0x7fb1d000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad734cbe23b0abf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:56.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.801+0000 7fb1df7fe640 1 -- 172.21.15.7:0/3634747406 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0008070 con 0x56354f29de90 2024-04-25T10:04:56.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.801+0000 7fb1df7fe640 1 -- 172.21.15.7:0/3634747406 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d000d500 con 0x56354f29de90 2024-04-25T10:04:56.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.801+0000 7fb1df7fe640 1 -- 172.21.15.7:0/3634747406 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d000d910 con 0x56354f29de90 2024-04-25T10:04:56.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.802+0000 7fb1e7b06f40 1 -- 172.21.15.7:0/3634747406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354f29de90 msgr2=0x56354f2b8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.802+0000 7fb1e7b06f40 1 --2- 172.21.15.7:0/3634747406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354f29de90 0x56354f2b8370 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7fb1d000b240 tx=0x7fb1d000b700 comp rx=0 tx=0).stop 2024-04-25T10:04:56.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.802+0000 7fb1e7b06f40 1 -- 172.21.15.7:0/3634747406 shutdown_connections 2024-04-25T10:04:56.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.802+0000 7fb1e7b06f40 1 --2- 172.21.15.7:0/3634747406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56354f29e270 0x56354f2b88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.802+0000 7fb1e7b06f40 1 --2- 172.21.15.7:0/3634747406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354f29de90 0x56354f2b8370 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.802+0000 7fb1e7b06f40 1 --2- 172.21.15.7:0/3634747406 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56354f1dfe70 0x56354f22b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.802+0000 7fb1e7b06f40 1 -- 172.21.15.7:0/3634747406 >> 172.21.15.7:0/3634747406 conn(0x56354f1e0a60 msgr2=0x56354f1e31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:56.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.802+0000 7fb1e7b06f40 1 -- 172.21.15.7:0/3634747406 shutdown_connections 2024-04-25T10:04:56.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.802+0000 7fb1e7b06f40 1 -- 172.21.15.7:0/3634747406 wait complete. 2024-04-25T10:04:56.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.802+0000 7fb1e7b06f40 1 Processor -- start 2024-04-25T10:04:56.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.803+0000 7fb1e7b06f40 1 -- start start 2024-04-25T10:04:56.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.803+0000 7fb1e7b06f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354f1dfe70 0x56354f2b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.803+0000 7fb1e7b06f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56354f29de90 0x56354f2b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.803+0000 7fb1e7b06f40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56354f29e270 0x56354f34f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.803+0000 7fb1e7b06f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x56354f1e2e40 con 0x56354f1dfe70 2024-04-25T10:04:56.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.803+0000 7fb1e7b06f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56354f29aec0 con 0x56354f29de90 2024-04-25T10:04:56.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.803+0000 7fb1e7b06f40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x56354f20f020 con 0x56354f29e270 2024-04-25T10:04:56.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.803+0000 7fb1e5607640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354f1dfe70 0x56354f2b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.803+0000 7fb1e5607640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354f1dfe70 0x56354f2b04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47506/0 (socket says 172.21.15.7:47506) 2024-04-25T10:04:56.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.803+0000 7fb1e5607640 1 -- 172.21.15.7:0/3261928876 learned_addr learned my addr 172.21.15.7:0/3261928876 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:56.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.804+0000 7fb1e4e06640 1 --2- 172.21.15.7:0/3261928876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56354f29de90 0x56354f2b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.804+0000 7fb1e5e08640 1 --2- 172.21.15.7:0/3261928876 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56354f29e270 0x56354f34f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.804+0000 7fb1e5607640 1 -- 172.21.15.7:0/3261928876 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56354f29e270 msgr2=0x56354f34f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.804+0000 7fb1e5607640 1 --2- 172.21.15.7:0/3261928876 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56354f29e270 0x56354f34f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.804+0000 7fb1e5607640 1 -- 172.21.15.7:0/3261928876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56354f29de90 msgr2=0x56354f2b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.804+0000 7fb1e5607640 1 --2- 172.21.15.7:0/3261928876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56354f29de90 0x56354f2b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.804+0000 7fb1e5607640 1 -- 172.21.15.7:0/3261928876 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56354f350070 con 0x56354f1dfe70 2024-04-25T10:04:56.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.804+0000 7fb1e5607640 1 --2- 172.21.15.7:0/3261928876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354f1dfe70 0x56354f2b04c0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0025d40 tx=0x7fb1e0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:56.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.804+0000 7fb1de7fc640 1 -- 172.21.15.7:0/3261928876 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0053920 con 0x56354f1dfe70 2024-04-25T10:04:56.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.804+0000 7fb1de7fc640 1 -- 172.21.15.7:0/3261928876 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e0053ac0 con 0x56354f1dfe70 2024-04-25T10:04:56.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.804+0000 7fb1de7fc640 1 -- 172.21.15.7:0/3261928876 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0068440 con 0x56354f1dfe70 2024-04-25T10:04:56.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.804+0000 7fb1e7b06f40 1 -- 172.21.15.7:0/3261928876 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56354f350350 con 0x56354f1dfe70 2024-04-25T10:04:56.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.804+0000 7fb1e7b06f40 1 -- 172.21.15.7:0/3261928876 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56354f2b2520 con 0x56354f1dfe70 2024-04-25T10:04:56.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.806+0000 7fb1de7fc640 1 -- 172.21.15.7:0/3261928876 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb1e0071440 con 0x56354f1dfe70 2024-04-25T10:04:56.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.806+0000 7fb1de7fc640 1 --2- 172.21.15.7:0/3261928876 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb1c8069eb0 0x7fb1c806c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.806+0000 7fb1de7fc640 1 -- 172.21.15.7:0/3261928876 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fb1e00cd620 con 0x56354f1dfe70 2024-04-25T10:04:56.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.806+0000 7fb1e4e06640 1 --2- 172.21.15.7:0/3261928876 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb1c8069eb0 0x7fb1c806c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.806+0000 7fb1e7b06f40 1 --2- 172.21.15.7:0/3261928876 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x56354f29cd20 0x56354f3519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.806+0000 7fb1e7b06f40 1 -- 172.21.15.7:0/3261928876 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:1 18.12 18:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e118) v9 -- 0x56354f211350 con 0x56354f29cd20 2024-04-25T10:04:56.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.806+0000 7fb1e5e08640 1 --2- 172.21.15.7:0/3261928876 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x56354f29cd20 0x56354f3519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.806+0000 7fb1e4e06640 1 --2- 172.21.15.7:0/3261928876 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb1c8069eb0 0x7fb1c806c370 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x56354f2118e0 tx=0x7fb1d0009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:56.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.807+0000 7fb1e5e08640 1 --2- 172.21.15.7:0/3261928876 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x56354f29cd20 0x56354f3519a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:56.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.807+0000 7fb1e5e08640 1 -- 172.21.15.7:0/3261928876 <== osd.2 v2:172.21.15.7:6808/1173474863 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr (12) out=12b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+12 (crc 0 0 0) 0x7fb1d800e980 con 0x56354f29cd20 2024-04-25T10:04:56.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.807+0000 7fb1e7b06f40 1 -- 172.21.15.7:0/3261928876 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x56354f29cd20 msgr2=0x56354f3519a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.807+0000 7fb1e7b06f40 1 --2- 172.21.15.7:0/3261928876 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x56354f29cd20 0x56354f3519a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.807+0000 7fb1e7b06f40 1 -- 172.21.15.7:0/3261928876 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb1c8069eb0 msgr2=0x7fb1c806c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.807+0000 7fb1e7b06f40 1 --2- 172.21.15.7:0/3261928876 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb1c8069eb0 0x7fb1c806c370 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x56354f2118e0 tx=0x7fb1d0009000 comp rx=0 tx=0).stop 2024-04-25T10:04:56.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.807+0000 7fb1e7b06f40 1 -- 172.21.15.7:0/3261928876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354f1dfe70 msgr2=0x56354f2b04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.807+0000 7fb1e7b06f40 1 --2- 172.21.15.7:0/3261928876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56354f1dfe70 0x56354f2b04c0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0025d40 tx=0x7fb1e0002fb0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.807+0000 7fb1e5e08640 1 -- 172.21.15.7:0/3261928876 reap_dead start 2024-04-25T10:04:56.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.807+0000 7fb1e7b06f40 1 -- 172.21.15.7:0/3261928876 shutdown_connections 2024-04-25T10:04:56.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.807+0000 7fb1e7b06f40 1 -- 172.21.15.7:0/3261928876 >> 172.21.15.7:0/3261928876 conn(0x56354f1e0a60 msgr2=0x56354f1e3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:56.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.807+0000 7fb1e7b06f40 1 -- 172.21.15.7:0/3261928876 shutdown_connections 2024-04-25T10:04:56.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.807+0000 7fb1e7b06f40 1 -- 172.21.15.7:0/3261928876 wait complete. 2024-04-25T10:04:56.818 INFO:teuthology.orchestra.run.smithi007.stdout:mytag123 2024-04-25T10:04:56.818 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000004.00000000 scrub_tag 2024-04-25T10:04:56.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.896+0000 7f389623bf40 1 Processor -- start 2024-04-25T10:04:56.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.896+0000 7f389623bf40 1 -- start start 2024-04-25T10:04:56.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.896+0000 7f389623bf40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5577a85cee70 0x5577a86a7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.896+0000 7f389623bf40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5577a869cad0 0x5577a86a81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.896+0000 7f389623bf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577a869ceb0 0x5577a85fe3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.896+0000 7f389623bf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577a86aa7f0 con 0x5577a869ceb0 2024-04-25T10:04:56.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.896+0000 7f389623bf40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577a8577df0 con 0x5577a869cad0 2024-04-25T10:04:56.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.896+0000 7f389623bf40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5577a86aa230 con 0x5577a85cee70 2024-04-25T10:04:56.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.897+0000 7f389453f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577a869ceb0 0x5577a85fe3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.897+0000 7f389453f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577a869ceb0 0x5577a85fe3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47516/0 (socket says 172.21.15.7:47516) 2024-04-25T10:04:56.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.897+0000 7f389453f640 1 -- 172.21.15.7:0/1622507359 learned_addr learned my addr 172.21.15.7:0/1622507359 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:56.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.897+0000 7f3893d3e640 1 --2- 172.21.15.7:0/1622507359 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5577a85cee70 0x5577a86a7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.897+0000 7f389353d640 1 --2- 172.21.15.7:0/1622507359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5577a869cad0 0x5577a86a81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.897+0000 7f389453f640 1 -- 172.21.15.7:0/1622507359 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5577a85cee70 msgr2=0x5577a86a7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:56.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.897+0000 7f389453f640 1 --2- 172.21.15.7:0/1622507359 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5577a85cee70 0x5577a86a7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.897+0000 7f389453f640 1 -- 172.21.15.7:0/1622507359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5577a869cad0 msgr2=0x5577a86a81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:56.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.897+0000 7f389453f640 1 --2- 172.21.15.7:0/1622507359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5577a869cad0 0x5577a86a81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.897+0000 7f389453f640 1 -- 172.21.15.7:0/1622507359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5577a84fdc50 con 0x5577a869ceb0 2024-04-25T10:04:56.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.897+0000 7f389353d640 1 --2- 172.21.15.7:0/1622507359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5577a869cad0 0x5577a86a81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:56.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.897+0000 7f389453f640 1 --2- 172.21.15.7:0/1622507359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577a869ceb0 0x5577a85fe3a0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f388c0094c0 tx=0x7f388c0098c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f51c679b633e5302 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:56.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.897+0000 7f389253b640 1 -- 172.21.15.7:0/1622507359 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c0064a0 con 0x5577a869ceb0 2024-04-25T10:04:56.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.897+0000 7f389253b640 1 -- 172.21.15.7:0/1622507359 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388c006640 con 0x5577a869ceb0 2024-04-25T10:04:56.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.897+0000 7f389253b640 1 -- 172.21.15.7:0/1622507359 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c006a30 con 0x5577a869ceb0 2024-04-25T10:04:56.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.898+0000 7f389623bf40 1 -- 172.21.15.7:0/1622507359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577a869ceb0 msgr2=0x5577a85fe3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.898+0000 7f389623bf40 1 --2- 172.21.15.7:0/1622507359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577a869ceb0 0x5577a85fe3a0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f388c0094c0 tx=0x7f388c0098c0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.898+0000 7f389623bf40 1 -- 172.21.15.7:0/1622507359 shutdown_connections 2024-04-25T10:04:56.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.898+0000 7f389623bf40 1 --2- 172.21.15.7:0/1622507359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577a869ceb0 0x5577a85fe3a0 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.898+0000 7f389623bf40 1 --2- 172.21.15.7:0/1622507359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5577a869cad0 0x5577a86a81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.898+0000 7f389623bf40 1 --2- 172.21.15.7:0/1622507359 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5577a85cee70 0x5577a86a7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.898+0000 7f389623bf40 1 -- 172.21.15.7:0/1622507359 >> 172.21.15.7:0/1622507359 conn(0x5577a85cfa60 msgr2=0x5577a85cfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:56.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.898+0000 7f389623bf40 1 -- 172.21.15.7:0/1622507359 shutdown_connections 2024-04-25T10:04:56.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.898+0000 7f389623bf40 1 -- 172.21.15.7:0/1622507359 wait complete. 2024-04-25T10:04:56.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.898+0000 7f389623bf40 1 Processor -- start 2024-04-25T10:04:56.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.898+0000 7f389623bf40 1 -- start start 2024-04-25T10:04:56.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.899+0000 7f389623bf40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5577a85cee70 0x5577a873df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.899+0000 7f389623bf40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577a869cad0 0x5577a85fe3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.899+0000 7f389623bf40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5577a869ceb0 0x5577a85fe8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.899+0000 7f389623bf40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577a85ff450 con 0x5577a869cad0 2024-04-25T10:04:56.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.899+0000 7f389623bf40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577a869d350 con 0x5577a85cee70 2024-04-25T10:04:56.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.899+0000 7f389623bf40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5577a85ff730 con 0x5577a869ceb0 2024-04-25T10:04:56.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.899+0000 7f389353d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577a869cad0 0x5577a85fe3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.899+0000 7f389353d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577a869cad0 0x5577a85fe3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47528/0 (socket says 172.21.15.7:47528) 2024-04-25T10:04:56.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.899+0000 7f389353d640 1 -- 172.21.15.7:0/440135846 learned_addr learned my addr 172.21.15.7:0/440135846 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:56.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.899+0000 7f3893d3e640 1 --2- 172.21.15.7:0/440135846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5577a85cee70 0x5577a873df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.899+0000 7f389453f640 1 --2- 172.21.15.7:0/440135846 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5577a869ceb0 0x5577a85fe8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.900+0000 7f389353d640 1 -- 172.21.15.7:0/440135846 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5577a869ceb0 msgr2=0x5577a85fe8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.900+0000 7f389353d640 1 --2- 172.21.15.7:0/440135846 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5577a869ceb0 0x5577a85fe8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.900+0000 7f389353d640 1 -- 172.21.15.7:0/440135846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5577a85cee70 msgr2=0x5577a873df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.900+0000 7f389353d640 1 --2- 172.21.15.7:0/440135846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5577a85cee70 0x5577a873df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.900+0000 7f389353d640 1 -- 172.21.15.7:0/440135846 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5577a85d3650 con 0x5577a869cad0 2024-04-25T10:04:56.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.900+0000 7f3893d3e640 1 --2- 172.21.15.7:0/440135846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5577a85cee70 0x5577a873df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:56.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.900+0000 7f389353d640 1 --2- 172.21.15.7:0/440135846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577a869cad0 0x5577a85fe3a0 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f3888045f50 tx=0x7f3888002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:56.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.900+0000 7f3891539640 1 -- 172.21.15.7:0/440135846 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3888053af0 con 0x5577a869cad0 2024-04-25T10:04:56.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.900+0000 7f3891539640 1 -- 172.21.15.7:0/440135846 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3888053c90 con 0x5577a869cad0 2024-04-25T10:04:56.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.900+0000 7f389623bf40 1 -- 172.21.15.7:0/440135846 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5577a85d2a40 con 0x5577a869cad0 2024-04-25T10:04:56.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.900+0000 7f3891539640 1 -- 172.21.15.7:0/440135846 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3888068640 con 0x5577a869cad0 2024-04-25T10:04:56.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.900+0000 7f389623bf40 1 -- 172.21.15.7:0/440135846 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5577a85d3000 con 0x5577a869cad0 2024-04-25T10:04:56.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.901+0000 7f3891539640 1 -- 172.21.15.7:0/440135846 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3888071440 con 0x5577a869cad0 2024-04-25T10:04:56.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.902+0000 7f3891539640 1 --2- 172.21.15.7:0/440135846 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3880069ee0 0x7f388006c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.902+0000 7f3893d3e640 1 --2- 172.21.15.7:0/440135846 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3880069ee0 0x7f388006c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.902+0000 7f3891539640 1 -- 172.21.15.7:0/440135846 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f38880cd880 con 0x5577a869cad0 2024-04-25T10:04:56.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.902+0000 7f389623bf40 1 --2- 172.21.15.7:0/440135846 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x5577a873e970 0x5577a873ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.902+0000 7f389623bf40 1 -- 172.21.15.7:0/440135846 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:1 18.5 18:a367a3e8:::10000000004.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e118) v9 -- 0x5577a873f2c0 con 0x5577a873e970 2024-04-25T10:04:56.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.902+0000 7f389453f640 1 --2- 172.21.15.7:0/440135846 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x5577a873e970 0x5577a873ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.902+0000 7f3893d3e640 1 --2- 172.21.15.7:0/440135846 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3880069ee0 0x7f388006c3a0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f388400c9c0 tx=0x7f3884007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:56.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.903+0000 7f389453f640 1 --2- 172.21.15.7:0/440135846 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x5577a873e970 0x5577a873ed80 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:56.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.903+0000 7f389453f640 1 -- 172.21.15.7:0/440135846 <== osd.1 v2:172.21.15.7:6816/434435857 1 ==== osd_op_reply(1 10000000004.00000000 [getxattr (12) out=12b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+12 (crc 0 0 0) 0x7f388c01b040 con 0x5577a873e970 2024-04-25T10:04:56.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.903+0000 7f389623bf40 1 -- 172.21.15.7:0/440135846 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x5577a873e970 msgr2=0x5577a873ed80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.903+0000 7f389623bf40 1 --2- 172.21.15.7:0/440135846 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x5577a873e970 0x5577a873ed80 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.903+0000 7f389623bf40 1 -- 172.21.15.7:0/440135846 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3880069ee0 msgr2=0x7f388006c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.903+0000 7f389623bf40 1 --2- 172.21.15.7:0/440135846 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3880069ee0 0x7f388006c3a0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f388400c9c0 tx=0x7f3884007040 comp rx=0 tx=0).stop 2024-04-25T10:04:56.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.903+0000 7f389623bf40 1 -- 172.21.15.7:0/440135846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577a869cad0 msgr2=0x5577a85fe3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.903+0000 7f389623bf40 1 --2- 172.21.15.7:0/440135846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5577a869cad0 0x5577a85fe3a0 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f3888045f50 tx=0x7f3888002fb0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.903+0000 7f389453f640 1 -- 172.21.15.7:0/440135846 reap_dead start 2024-04-25T10:04:56.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.903+0000 7f389623bf40 1 -- 172.21.15.7:0/440135846 shutdown_connections 2024-04-25T10:04:56.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.903+0000 7f389623bf40 1 -- 172.21.15.7:0/440135846 >> 172.21.15.7:0/440135846 conn(0x5577a85cfa60 msgr2=0x5577a85cfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:56.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.903+0000 7f389623bf40 1 -- 172.21.15.7:0/440135846 shutdown_connections 2024-04-25T10:04:56.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.903+0000 7f389623bf40 1 -- 172.21.15.7:0/440135846 wait complete. 2024-04-25T10:04:56.915 INFO:teuthology.orchestra.run.smithi007.stdout:mytag123 2024-04-25T10:04:56.915 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000006.00000000 scrub_tag 2024-04-25T10:04:56.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.993+0000 7f18a6614f40 1 Processor -- start 2024-04-25T10:04:56.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.993+0000 7f18a6614f40 1 -- start start 2024-04-25T10:04:57.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.994+0000 7f18a6614f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f188c003630 0x55803f4b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.994+0000 7f18a6614f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55803f4a69d0 0x55803f4a5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.994+0000 7f18a6614f40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55803f4a6f20 0x55803f4a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.994+0000 7f18a6614f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55803f382df0 con 0x7f188c003630 2024-04-25T10:04:57.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.994+0000 7f18a6614f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55803f386d50 con 0x55803f4a69d0 2024-04-25T10:04:57.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.994+0000 7f18a6614f40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55803f4b57f0 con 0x55803f4a6f20 2024-04-25T10:04:57.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.994+0000 7f18a34a6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f188c003630 0x55803f4b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.994+0000 7f18a34a6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f188c003630 0x55803f4b3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47532/0 (socket says 172.21.15.7:47532) 2024-04-25T10:04:57.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.994+0000 7f18a34a6640 1 -- 172.21.15.7:0/1857118461 learned_addr learned my addr 172.21.15.7:0/1857118461 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:57.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.995+0000 7f18a34a6640 1 -- 172.21.15.7:0/1857118461 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55803f4a6f20 msgr2=0x55803f4a5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:57.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.995+0000 7f18a34a6640 1 --2- 172.21.15.7:0/1857118461 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55803f4a6f20 0x55803f4a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.995+0000 7f18a34a6640 1 -- 172.21.15.7:0/1857118461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55803f4a69d0 msgr2=0x55803f4a5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:57.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.995+0000 7f18a34a6640 1 --2- 172.21.15.7:0/1857118461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55803f4a69d0 0x55803f4a5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.995+0000 7f18a34a6640 1 -- 172.21.15.7:0/1857118461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55803f3dda20 con 0x7f188c003630 2024-04-25T10:04:57.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.995+0000 7f18a34a6640 1 --2- 172.21.15.7:0/1857118461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f188c003630 0x55803f4b3c50 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f1894006630 tx=0x7f1894006af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e792cd15111771 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.995+0000 7f18a1ca3640 1 -- 172.21.15.7:0/1857118461 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1894018070 con 0x7f188c003630 2024-04-25T10:04:57.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.995+0000 7f18a1ca3640 1 -- 172.21.15.7:0/1857118461 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1894006320 con 0x7f188c003630 2024-04-25T10:04:57.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.995+0000 7f18a1ca3640 1 -- 172.21.15.7:0/1857118461 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1894013680 con 0x7f188c003630 2024-04-25T10:04:57.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.995+0000 7f18a6614f40 1 -- 172.21.15.7:0/1857118461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f188c003630 msgr2=0x55803f4b3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.995+0000 7f18a6614f40 1 --2- 172.21.15.7:0/1857118461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f188c003630 0x55803f4b3c50 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f1894006630 tx=0x7f1894006af0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.995+0000 7f18a6614f40 1 -- 172.21.15.7:0/1857118461 shutdown_connections 2024-04-25T10:04:57.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.995+0000 7f18a6614f40 1 --2- 172.21.15.7:0/1857118461 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55803f4a6f20 0x55803f4a5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.995+0000 7f18a6614f40 1 --2- 172.21.15.7:0/1857118461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55803f4a69d0 0x55803f4a5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.995+0000 7f18a6614f40 1 --2- 172.21.15.7:0/1857118461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f188c003630 0x55803f4b3c50 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.995+0000 7f18a6614f40 1 -- 172.21.15.7:0/1857118461 >> 172.21.15.7:0/1857118461 conn(0x55803f3daa60 msgr2=0x55803f4255e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:57.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.995+0000 7f18a6614f40 1 -- 172.21.15.7:0/1857118461 shutdown_connections 2024-04-25T10:04:57.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.995+0000 7f18a6614f40 1 -- 172.21.15.7:0/1857118461 wait complete. 2024-04-25T10:04:57.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.996+0000 7f18a6614f40 1 Processor -- start 2024-04-25T10:04:57.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.996+0000 7f18a6614f40 1 -- start start 2024-04-25T10:04:57.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.997+0000 7f18a6614f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55803f4a69d0 0x55803f425b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.997+0000 7f18a6614f40 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55803f4a6f20 0x55803f496b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.997+0000 7f18a6614f40 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f188c003630 0x55803f4b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.997+0000 7f18a6614f40 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55803f3ddd00 con 0x55803f4a6f20 2024-04-25T10:04:57.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.997+0000 7f18a6614f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55803f4a92c0 con 0x55803f4a69d0 2024-04-25T10:04:57.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.997+0000 7f18a6614f40 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55803f4a8c70 con 0x7f188c003630 2024-04-25T10:04:57.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.997+0000 7f18a2ca5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55803f4a6f20 0x55803f496b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.997+0000 7f18a2ca5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55803f4a6f20 0x55803f496b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47544/0 (socket says 172.21.15.7:47544) 2024-04-25T10:04:57.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.997+0000 7f18a2ca5640 1 -- 172.21.15.7:0/1073258083 learned_addr learned my addr 172.21.15.7:0/1073258083 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:57.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.997+0000 7f18a34a6640 1 --2- 172.21.15.7:0/1073258083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55803f4a69d0 0x55803f425b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.997+0000 7f18a3ca7640 1 --2- 172.21.15.7:0/1073258083 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f188c003630 0x55803f4b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.997+0000 7f18a2ca5640 1 -- 172.21.15.7:0/1073258083 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f188c003630 msgr2=0x55803f4b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.997+0000 7f18a2ca5640 1 --2- 172.21.15.7:0/1073258083 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f188c003630 0x55803f4b22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.997+0000 7f18a2ca5640 1 -- 172.21.15.7:0/1073258083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55803f4a69d0 msgr2=0x55803f425b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.997+0000 7f18a2ca5640 1 --2- 172.21.15.7:0/1073258083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55803f4a69d0 0x55803f425b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.997+0000 7f18a2ca5640 1 -- 172.21.15.7:0/1073258083 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55803f54a740 con 0x55803f4a6f20 2024-04-25T10:04:57.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.997+0000 7f18a2ca5640 1 --2- 172.21.15.7:0/1073258083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55803f4a6f20 0x55803f496b60 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f1898001720 tx=0x7f189800e7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.997+0000 7f18a0ca1640 1 -- 172.21.15.7:0/1073258083 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189800f650 con 0x55803f4a6f20 2024-04-25T10:04:57.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.998+0000 7f18a0ca1640 1 -- 172.21.15.7:0/1073258083 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1898013030 con 0x55803f4a6f20 2024-04-25T10:04:57.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.998+0000 7f18a0ca1640 1 -- 172.21.15.7:0/1073258083 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189800fa50 con 0x55803f4a6f20 2024-04-25T10:04:57.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.998+0000 7f18a6614f40 1 -- 172.21.15.7:0/1073258083 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55803f54aa20 con 0x55803f4a6f20 2024-04-25T10:04:57.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.998+0000 7f18a6614f40 1 -- 172.21.15.7:0/1073258083 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55803f54b410 con 0x55803f4a6f20 2024-04-25T10:04:57.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.999+0000 7f18a0ca1640 1 -- 172.21.15.7:0/1073258083 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f189800fbf0 con 0x55803f4a6f20 2024-04-25T10:04:57.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.999+0000 7f18a0ca1640 1 --2- 172.21.15.7:0/1073258083 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1890069eb0 0x7f189006c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.999+0000 7f18a0ca1640 1 -- 172.21.15.7:0/1073258083 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f18980898c0 con 0x55803f4a6f20 2024-04-25T10:04:57.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:56.999+0000 7f18a34a6640 1 --2- 172.21.15.7:0/1073258083 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1890069eb0 0x7f189006c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.000+0000 7f18a6614f40 1 --2- 172.21.15.7:0/1073258083 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x55803f54b930 0x55803f54bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.000+0000 7f18a6614f40 1 -- 172.21.15.7:0/1073258083 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:1 18.25 18:a5feb6f3:::10000000006.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e118) v9 -- 0x55803f54c280 con 0x55803f54b930 2024-04-25T10:04:57.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.000+0000 7f18a3ca7640 1 --2- 172.21.15.7:0/1073258083 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x55803f54b930 0x55803f54bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.000+0000 7f18a34a6640 1 --2- 172.21.15.7:0/1073258083 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1890069eb0 0x7f189006c370 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f1894016040 tx=0x7f1894008070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.000+0000 7f18a3ca7640 1 --2- 172.21.15.7:0/1073258083 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x55803f54b930 0x55803f54bd40 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.001+0000 7f18a3ca7640 1 -- 172.21.15.7:0/1073258083 <== osd.6 v2:172.21.15.55:6824/4293769515 1 ==== osd_op_reply(1 10000000006.00000000 [getxattr (12) out=12b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+12 (crc 0 0 0) 0x7f189c0557f0 con 0x55803f54b930 2024-04-25T10:04:57.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.001+0000 7f18a6614f40 1 -- 172.21.15.7:0/1073258083 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x55803f54b930 msgr2=0x55803f54bd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.001+0000 7f18a6614f40 1 --2- 172.21.15.7:0/1073258083 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x55803f54b930 0x55803f54bd40 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.001+0000 7f18a6614f40 1 -- 172.21.15.7:0/1073258083 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1890069eb0 msgr2=0x7f189006c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.001+0000 7f18a6614f40 1 --2- 172.21.15.7:0/1073258083 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1890069eb0 0x7f189006c370 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f1894016040 tx=0x7f1894008070 comp rx=0 tx=0).stop 2024-04-25T10:04:57.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.001+0000 7f18a6614f40 1 -- 172.21.15.7:0/1073258083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55803f4a6f20 msgr2=0x55803f496b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.001+0000 7f18a6614f40 1 --2- 172.21.15.7:0/1073258083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55803f4a6f20 0x55803f496b60 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f1898001720 tx=0x7f189800e7b0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.001+0000 7f18a3ca7640 1 -- 172.21.15.7:0/1073258083 reap_dead start 2024-04-25T10:04:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.001+0000 7f18a6614f40 1 -- 172.21.15.7:0/1073258083 shutdown_connections 2024-04-25T10:04:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.001+0000 7f18a6614f40 1 -- 172.21.15.7:0/1073258083 >> 172.21.15.7:0/1073258083 conn(0x55803f3daa60 msgr2=0x55803f3d94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.001+0000 7f18a6614f40 1 -- 172.21.15.7:0/1073258083 shutdown_connections 2024-04-25T10:04:57.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.001+0000 7f18a6614f40 1 -- 172.21.15.7:0/1073258083 wait complete. 2024-04-25T10:04:57.011 INFO:teuthology.orchestra.run.smithi007.stdout:mytag123 2024-04-25T10:04:57.011 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T10:04:57.011 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 flush journal 2024-04-25T10:04:57.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.109+0000 7f5e7919e640 1 Processor -- start 2024-04-25T10:04:57.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.109+0000 7f5e7919e640 1 -- start start 2024-04-25T10:04:57.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.110+0000 7f5e7919e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5e740b48c0 0x7f5e7415fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.110+0000 7f5e7919e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5e740d3f90 0x7f5e74161680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.110+0000 7f5e7919e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e74161bc0 0x7f5e740d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.110+0000 7f5e7919e640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e74162030 con 0x7f5e740b48c0 2024-04-25T10:04:57.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.110+0000 7f5e7919e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e741606e0 con 0x7f5e740d3f90 2024-04-25T10:04:57.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.110+0000 7f5e7919e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e741609c0 con 0x7f5e74161bc0 2024-04-25T10:04:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.110+0000 7f5e73fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5e740b48c0 0x7f5e7415fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.110+0000 7f5e73fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5e740b48c0 0x7f5e7415fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47560/0 (socket says 172.21.15.7:47560) 2024-04-25T10:04:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.110+0000 7f5e73fff640 1 -- 172.21.15.7:0/3138368294 learned_addr learned my addr 172.21.15.7:0/3138368294 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.110+0000 7f5e737fe640 1 --2- 172.21.15.7:0/3138368294 >> v2:172.21.15.55:3300/0 conn(0x7f5e740d3f90 0x7f5e74161680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.110+0000 7f5e7899d640 1 --2- 172.21.15.7:0/3138368294 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e74161bc0 0x7f5e740d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.110+0000 7f5e73fff640 1 -- 172.21.15.7:0/3138368294 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e74161bc0 msgr2=0x7f5e740d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.110+0000 7f5e73fff640 1 --2- 172.21.15.7:0/3138368294 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e74161bc0 0x7f5e740d18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.110+0000 7f5e73fff640 1 -- 172.21.15.7:0/3138368294 >> v2:172.21.15.55:3300/0 conn(0x7f5e740d3f90 msgr2=0x7f5e74161680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.110+0000 7f5e73fff640 1 --2- 172.21.15.7:0/3138368294 >> v2:172.21.15.55:3300/0 conn(0x7f5e740d3f90 0x7f5e74161680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.110+0000 7f5e73fff640 1 -- 172.21.15.7:0/3138368294 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e74160ca0 con 0x7f5e740b48c0 2024-04-25T10:04:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.111+0000 7f5e73fff640 1 --2- 172.21.15.7:0/3138368294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e740b48c0 0x7f5e7415fe60 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f5e740b61b0 tx=0x7f5e6802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14837c27b68ab242 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.111+0000 7f5e72ffd640 1 -- 172.21.15.7:0/3138368294 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68037070 con 0x7f5e740b48c0 2024-04-25T10:04:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.111+0000 7f5e72ffd640 1 -- 172.21.15.7:0/3138368294 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e68032440 con 0x7f5e740b48c0 2024-04-25T10:04:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.111+0000 7f5e72ffd640 1 -- 172.21.15.7:0/3138368294 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68032810 con 0x7f5e740b48c0 2024-04-25T10:04:57.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.111+0000 7f5e7919e640 1 -- 172.21.15.7:0/3138368294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e740b48c0 msgr2=0x7f5e7415fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.111+0000 7f5e7919e640 1 --2- 172.21.15.7:0/3138368294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e740b48c0 0x7f5e7415fe60 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f5e740b61b0 tx=0x7f5e6802a140 comp rx=0 tx=0).stop 2024-04-25T10:04:57.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.112+0000 7f5e7919e640 1 -- 172.21.15.7:0/3138368294 shutdown_connections 2024-04-25T10:04:57.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.112+0000 7f5e7919e640 1 --2- 172.21.15.7:0/3138368294 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e74161bc0 0x7f5e740d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.112+0000 7f5e7919e640 1 --2- 172.21.15.7:0/3138368294 >> v2:172.21.15.55:3300/0 conn(0x7f5e740d3f90 0x7f5e74161680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.112+0000 7f5e7919e640 1 --2- 172.21.15.7:0/3138368294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e740b48c0 0x7f5e7415fe60 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.112+0000 7f5e7919e640 1 -- 172.21.15.7:0/3138368294 >> 172.21.15.7:0/3138368294 conn(0x7f5e7408af80 msgr2=0x7f5e740d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:57.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.112+0000 7f5e7919e640 1 -- 172.21.15.7:0/3138368294 shutdown_connections 2024-04-25T10:04:57.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.112+0000 7f5e7919e640 1 -- 172.21.15.7:0/3138368294 wait complete. 2024-04-25T10:04:57.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.113+0000 7f5e7919e640 1 Processor -- start 2024-04-25T10:04:57.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.113+0000 7f5e7919e640 1 -- start start 2024-04-25T10:04:57.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.114+0000 7f5e7919e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e740b48c0 0x7f5e7415e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.114+0000 7f5e7919e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e740d3f90 0x7f5e740cb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.114+0000 7f5e7919e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e74161bc0 0x7f5e7414f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.114+0000 7f5e7919e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e740b4ca0 con 0x7f5e74161bc0 2024-04-25T10:04:57.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.114+0000 7f5e7919e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e74161260 con 0x7f5e740d3f90 2024-04-25T10:04:57.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.114+0000 7f5e7919e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e741603a0 con 0x7f5e740b48c0 2024-04-25T10:04:57.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.114+0000 7f5e7899d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e74161bc0 0x7f5e7414f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.114+0000 7f5e7899d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e74161bc0 0x7f5e7414f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47574/0 (socket says 172.21.15.7:47574) 2024-04-25T10:04:57.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.114+0000 7f5e7899d640 1 -- 172.21.15.7:0/3118246539 learned_addr learned my addr 172.21.15.7:0/3118246539 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:57.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.114+0000 7f5e73fff640 1 --2- 172.21.15.7:0/3118246539 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e740b48c0 0x7f5e7415e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.114+0000 7f5e737fe640 1 --2- 172.21.15.7:0/3118246539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e740d3f90 0x7f5e740cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.114+0000 7f5e7899d640 1 -- 172.21.15.7:0/3118246539 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e740b48c0 msgr2=0x7f5e7415e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.114+0000 7f5e7899d640 1 --2- 172.21.15.7:0/3118246539 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e740b48c0 0x7f5e7415e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.114+0000 7f5e7899d640 1 -- 172.21.15.7:0/3118246539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e740d3f90 msgr2=0x7f5e740cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.114+0000 7f5e7899d640 1 --2- 172.21.15.7:0/3118246539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e740d3f90 0x7f5e740cb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.114+0000 7f5e7899d640 1 -- 172.21.15.7:0/3118246539 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e740cc1e0 con 0x7f5e74161bc0 2024-04-25T10:04:57.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.115+0000 7f5e7899d640 1 --2- 172.21.15.7:0/3118246539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e74161bc0 0x7f5e7414f650 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c007e60 tx=0x7f5e6c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.115+0000 7f5e70ff9640 1 -- 172.21.15.7:0/3118246539 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c014420 con 0x7f5e74161bc0 2024-04-25T10:04:57.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.115+0000 7f5e70ff9640 1 -- 172.21.15.7:0/3118246539 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c019070 con 0x7f5e74161bc0 2024-04-25T10:04:57.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.115+0000 7f5e70ff9640 1 -- 172.21.15.7:0/3118246539 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c014820 con 0x7f5e74161bc0 2024-04-25T10:04:57.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.115+0000 7f5e7919e640 1 -- 172.21.15.7:0/3118246539 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e740cc4c0 con 0x7f5e74161bc0 2024-04-25T10:04:57.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.115+0000 7f5e7919e640 1 -- 172.21.15.7:0/3118246539 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e740cca80 con 0x7f5e74161bc0 2024-04-25T10:04:57.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.116+0000 7f5e70ff9640 1 -- 172.21.15.7:0/3118246539 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5e6c0149c0 con 0x7f5e74161bc0 2024-04-25T10:04:57.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.117+0000 7f5e70ff9640 1 --2- 172.21.15.7:0/3118246539 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5e6006b4d0 0x7f5e6006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.117+0000 7f5e70ff9640 1 -- 172.21.15.7:0/3118246539 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f5e6c08aa80 con 0x7f5e74161bc0 2024-04-25T10:04:57.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.117+0000 7f5e73fff640 1 --2- 172.21.15.7:0/3118246539 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5e6006b4d0 0x7f5e6006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.117+0000 7f5e73fff640 1 --2- 172.21.15.7:0/3118246539 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5e6006b4d0 0x7f5e6006d990 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f5e68034000 tx=0x7f5e6802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.118+0000 7f5e7d1dd740 1 Processor -- start 2024-04-25T10:04:57.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.118+0000 7f5e7d1dd740 1 -- start start 2024-04-25T10:04:57.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.118+0000 7f5e7d1dd740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55cd058bed20 0x55cd058c1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.118+0000 7f5e7d1dd740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cd058bf100 0x55cd058c1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.118+0000 7f5e7d1dd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd05891980 0x55cd05895190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.118+0000 7f5e7d1dd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd057fada0 con 0x55cd05891980 2024-04-25T10:04:57.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.118+0000 7f5e7d1dd740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd057a3b80 con 0x55cd058bf100 2024-04-25T10:04:57.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.118+0000 7f5e7d1dd740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cd057f6e40 con 0x55cd058bed20 2024-04-25T10:04:57.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.118+0000 7f5e7899d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd05891980 0x55cd05895190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.118+0000 7f5e7899d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd05891980 0x55cd05895190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47586/0 (socket says 172.21.15.7:47586) 2024-04-25T10:04:57.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.118+0000 7f5e7899d640 1 -- 172.21.15.7:0/3551943337 learned_addr learned my addr 172.21.15.7:0/3551943337 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:57.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.118+0000 7f5e73fff640 1 --2- 172.21.15.7:0/3551943337 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55cd058bed20 0x55cd058c1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.119+0000 7f5e737fe640 1 --2- 172.21.15.7:0/3551943337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cd058bf100 0x55cd058c1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.119+0000 7f5e7899d640 1 -- 172.21.15.7:0/3551943337 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55cd058bed20 msgr2=0x55cd058c1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:57.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.119+0000 7f5e7899d640 1 --2- 172.21.15.7:0/3551943337 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55cd058bed20 0x55cd058c1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.119+0000 7f5e7899d640 1 -- 172.21.15.7:0/3551943337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cd058bf100 msgr2=0x55cd058c1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:57.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.119+0000 7f5e7899d640 1 --2- 172.21.15.7:0/3551943337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cd058bf100 0x55cd058c1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.119+0000 7f5e7899d640 1 -- 172.21.15.7:0/3551943337 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd057adf10 con 0x55cd05891980 2024-04-25T10:04:57.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.119+0000 7f5e73fff640 1 --2- 172.21.15.7:0/3551943337 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55cd058bed20 0x55cd058c1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:57.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.119+0000 7f5e737fe640 1 --2- 172.21.15.7:0/3551943337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cd058bf100 0x55cd058c1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:57.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.119+0000 7f5e7899d640 1 --2- 172.21.15.7:0/3551943337 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd05891980 0x55cd05895190 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c061200 tx=0x7f5e6c0590d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da17355ceb077414 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.119+0000 7f5e59ffb640 1 -- 172.21.15.7:0/3551943337 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c061730 con 0x55cd05891980 2024-04-25T10:04:57.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.119+0000 7f5e59ffb640 1 -- 172.21.15.7:0/3551943337 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c0573d0 con 0x55cd05891980 2024-04-25T10:04:57.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.119+0000 7f5e59ffb640 1 -- 172.21.15.7:0/3551943337 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c0612a0 con 0x55cd05891980 2024-04-25T10:04:57.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.120+0000 7f5e7d1dd740 1 -- 172.21.15.7:0/3551943337 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd05891980 msgr2=0x55cd05895190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.120+0000 7f5e7d1dd740 1 --2- 172.21.15.7:0/3551943337 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd05891980 0x55cd05895190 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c061200 tx=0x7f5e6c0590d0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.120+0000 7f5e7d1dd740 1 -- 172.21.15.7:0/3551943337 shutdown_connections 2024-04-25T10:04:57.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.120+0000 7f5e7d1dd740 1 --2- 172.21.15.7:0/3551943337 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd05891980 0x55cd05895190 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.120+0000 7f5e7d1dd740 1 --2- 172.21.15.7:0/3551943337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cd058bf100 0x55cd058c1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.120+0000 7f5e7d1dd740 1 --2- 172.21.15.7:0/3551943337 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55cd058bed20 0x55cd058c1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.120+0000 7f5e7d1dd740 1 -- 172.21.15.7:0/3551943337 >> 172.21.15.7:0/3551943337 conn(0x55cd05893bf0 msgr2=0x55cd058dc530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:57.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.120+0000 7f5e7d1dd740 1 -- 172.21.15.7:0/3551943337 shutdown_connections 2024-04-25T10:04:57.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.120+0000 7f5e7d1dd740 1 -- 172.21.15.7:0/3551943337 wait complete. 2024-04-25T10:04:57.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.120+0000 7f5e7d1dd740 1 -- start start 2024-04-25T10:04:57.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.120+0000 7f5e7d1dd740 1 Processor -- start 2024-04-25T10:04:57.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.121+0000 7f5e7d1dd740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cd058bed20 0x55cd058bd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.121+0000 7f5e7d1dd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd058bf100 0x55cd058bb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.121+0000 7f5e7d1dd740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55cd058bb9f0 0x55cd058b9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.121+0000 7f5e7d1dd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd05896da0 con 0x55cd058bf100 2024-04-25T10:04:57.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.121+0000 7f5e7d1dd740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd057994b0 con 0x55cd058bed20 2024-04-25T10:04:57.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.121+0000 7f5e7d1dd740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cd05897080 con 0x55cd058bb9f0 2024-04-25T10:04:57.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.121+0000 7f5e7d1dd740 10 client.0 _ll_register_callbacks cb 0x55cd057d9180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:04:57.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.121+0000 7f5e737fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd058bf100 0x55cd058bb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.121+0000 7f5e737fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd058bf100 0x55cd058bb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47596/0 (socket says 172.21.15.7:47596) 2024-04-25T10:04:57.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.121+0000 7f5e737fe640 1 -- 172.21.15.7:0/2376283060 learned_addr learned my addr 172.21.15.7:0/2376283060 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:57.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.121+0000 7f5e73fff640 1 --2- 172.21.15.7:0/2376283060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cd058bed20 0x55cd058bd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.121+0000 7f5e7899d640 1 --2- 172.21.15.7:0/2376283060 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55cd058bb9f0 0x55cd058b9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.122+0000 7f5e737fe640 1 -- 172.21.15.7:0/2376283060 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55cd058bb9f0 msgr2=0x55cd058b9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:57.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.122+0000 7f5e737fe640 1 --2- 172.21.15.7:0/2376283060 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55cd058bb9f0 0x55cd058b9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.122+0000 7f5e737fe640 1 -- 172.21.15.7:0/2376283060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cd058bed20 msgr2=0x55cd058bd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:57.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.122+0000 7f5e737fe640 1 --2- 172.21.15.7:0/2376283060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cd058bed20 0x55cd058bd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.122+0000 7f5e737fe640 1 -- 172.21.15.7:0/2376283060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cd055d97d0 con 0x55cd058bf100 2024-04-25T10:04:57.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.122+0000 7f5e73fff640 1 --2- 172.21.15.7:0/2376283060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cd058bed20 0x55cd058bd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:57.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.122+0000 7f5e737fe640 1 --2- 172.21.15.7:0/2376283060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd058bf100 0x55cd058bb4b0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f5e64006760 tx=0x7f5e6400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa840421f85b162 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.122+0000 7f5e52ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:04:57.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.122+0000 7f5e52ffd640 1 -- 172.21.15.7:0/2376283060 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e64004030 con 0x55cd058bf100 2024-04-25T10:04:57.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.122+0000 7f5e52ffd640 1 -- 172.21.15.7:0/2376283060 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(118..118 src has 1..118) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f5e640041d0 con 0x55cd058bf100 2024-04-25T10:04:57.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.122+0000 7f5e7d1dd740 1 -- 172.21.15.7:0/2376283060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5e6c0573d0 con 0x55cd058bf100 2024-04-25T10:04:57.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.122+0000 7f5e52ffd640 1 -- 172.21.15.7:0/2376283060 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e64023050 con 0x55cd058bf100 2024-04-25T10:04:57.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.122+0000 7f5e7d1dd740 10 client.9477 fetch_fsmap learned FSMap version 94 2024-04-25T10:04:57.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.122+0000 7f5e7d1dd740 1 -- 172.21.15.7:0/2376283060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) v3 -- 0x55cd0550f3f0 con 0x55cd058bf100 2024-04-25T10:04:57.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.122+0000 7f5e52ffd640 1 -- 172.21.15.7:0/2376283060 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c0573d0 con 0x55cd058bf100 2024-04-25T10:04:57.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.122+0000 7f5e52ffd640 1 -- 172.21.15.7:0/2376283060 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 94) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5e64026020 con 0x55cd058bf100 2024-04-25T10:04:57.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.122+0000 7f5e7d1dd740 10 client.9477 fetch_fsmap finished waiting for FSMap version 94 2024-04-25T10:04:57.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.122+0000 7f5e7d1dd740 10 client.9477 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-04-25T10:04:57.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.122+0000 7f5e7d1dd740 20 client.9477 populate_metadata read hostname 'smithi007' 2024-04-25T10:04:57.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.122+0000 7f5e7d1dd740 1 --2- 172.21.15.7:0/2376283060 >> [v2:172.21.15.7:6834/3781378145,v1:172.21.15.7:6836/3781378145] conn(0x55cd058b9e20 0x55cd058ba280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.122+0000 7f5e7d1dd740 4 client.9477 mds_command: new command op to 9321 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:04:57.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.122+0000 7f5e7d1dd740 1 -- 172.21.15.7:0/2376283060 --> [v2:172.21.15.7:6834/3781378145,v1:172.21.15.7:6836/3781378145] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cd058082e0 con 0x55cd058b9e20 2024-04-25T10:04:57.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.123+0000 7f5e73fff640 1 --2- 172.21.15.7:0/2376283060 >> [v2:172.21.15.7:6834/3781378145,v1:172.21.15.7:6836/3781378145] conn(0x55cd058b9e20 0x55cd058ba280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.123+0000 7f5e73fff640 1 --2- 172.21.15.7:0/2376283060 >> [v2:172.21.15.7:6834/3781378145,v1:172.21.15.7:6836/3781378145] conn(0x55cd058b9e20 0x55cd058ba280 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2fa28eabf42d9b5 server_cookie=bf2855c2e58e64a3 in_seq=0 out_seq=0 2024-04-25T10:04:57.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.123+0000 7f5e52ffd640 10 client.9477 ms_handle_connect on v2:172.21.15.7:6834/3781378145 2024-04-25T10:04:57.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.123+0000 7f5e52ffd640 1 -- 172.21.15.7:0/2376283060 <== mds.0 v2:172.21.15.7:6834/3781378145 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55cd058082e0 con 0x55cd058b9e20 2024-04-25T10:04:57.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.123+0000 7f5e52ffd640 10 client.9477 handle_command_reply: tid=0 2024-04-25T10:04:57.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.123+0000 7f5e7d1dd740 1 client.9477 shutdown 2024-04-25T10:04:57.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.124+0000 7f5e7d1dd740 1 -- 172.21.15.7:0/2376283060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd058bf100 msgr2=0x55cd058bb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.124+0000 7f5e7d1dd740 1 --2- 172.21.15.7:0/2376283060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd058bf100 0x55cd058bb4b0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f5e64006760 tx=0x7f5e6400b8b0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.124+0000 7f5e7d1dd740 1 -- 172.21.15.7:0/2376283060 shutdown_connections 2024-04-25T10:04:57.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.124+0000 7f5e7d1dd740 1 --2- 172.21.15.7:0/2376283060 >> [v2:172.21.15.7:6834/3781378145,v1:172.21.15.7:6836/3781378145] conn(0x55cd058b9e20 0x55cd058ba280 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.124+0000 7f5e7d1dd740 1 --2- 172.21.15.7:0/2376283060 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55cd058bb9f0 0x55cd058b9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.124+0000 7f5e52ffd640 0 client.9477 ms_handle_reset on v2:172.21.15.7:6834/3781378145 2024-04-25T10:04:57.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.124+0000 7f5e7d1dd740 1 --2- 172.21.15.7:0/2376283060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd058bf100 0x55cd058bb4b0 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.124+0000 7f5e7d1dd740 1 --2- 172.21.15.7:0/2376283060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cd058bed20 0x55cd058bd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.124+0000 7f5e7d1dd740 1 -- 172.21.15.7:0/2376283060 >> 172.21.15.7:0/2376283060 conn(0x55cd05891980 msgr2=0x55cd05892630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:57.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.124+0000 7f5e7d1dd740 1 -- 172.21.15.7:0/2376283060 shutdown_connections 2024-04-25T10:04:57.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.124+0000 7f5e7d1dd740 1 -- 172.21.15.7:0/2376283060 wait complete. 2024-04-25T10:04:57.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.124+0000 7f5e7d1dd740 20 client.9477 trim_cache size 0 max 16384 2024-04-25T10:04:57.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.137+0000 7f5e7d1dd740 1 Processor -- start 2024-04-25T10:04:57.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.137+0000 7f5e7d1dd740 1 -- start start 2024-04-25T10:04:57.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.138+0000 7f5e7d1dd740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55cd058bb9f0 0x55cd05890810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.138+0000 7f5e7d1dd740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cd058bed20 0x55cd05890d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.138+0000 7f5e7d1dd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd058bf100 0x55cd05895190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.138+0000 7f5e7d1dd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e74200400 con 0x55cd058bf100 2024-04-25T10:04:57.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.138+0000 7f5e7d1dd740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e741ff630 con 0x55cd058bed20 2024-04-25T10:04:57.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.138+0000 7f5e7d1dd740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e741f56c0 con 0x55cd058bb9f0 2024-04-25T10:04:57.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.138+0000 7f5e7899d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd058bf100 0x55cd05895190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.138+0000 7f5e7899d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd058bf100 0x55cd05895190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47606/0 (socket says 172.21.15.7:47606) 2024-04-25T10:04:57.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.138+0000 7f5e7899d640 1 -- 172.21.15.7:0/1335404659 learned_addr learned my addr 172.21.15.7:0/1335404659 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:57.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.138+0000 7f5e73fff640 1 --2- 172.21.15.7:0/1335404659 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55cd058bb9f0 0x55cd05890810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.138+0000 7f5e737fe640 1 --2- 172.21.15.7:0/1335404659 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cd058bed20 0x55cd05890d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.138+0000 7f5e7899d640 1 -- 172.21.15.7:0/1335404659 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55cd058bb9f0 msgr2=0x55cd05890810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:57.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.138+0000 7f5e7899d640 1 --2- 172.21.15.7:0/1335404659 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55cd058bb9f0 0x55cd05890810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.138+0000 7f5e7899d640 1 -- 172.21.15.7:0/1335404659 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cd058bed20 msgr2=0x55cd05890d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:57.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.138+0000 7f5e7899d640 1 --2- 172.21.15.7:0/1335404659 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cd058bed20 0x55cd05890d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.138+0000 7f5e7899d640 1 -- 172.21.15.7:0/1335404659 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd058990b0 con 0x55cd058bf100 2024-04-25T10:04:57.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.138+0000 7f5e7899d640 1 --2- 172.21.15.7:0/1335404659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd058bf100 0x55cd05895190 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c058dd0 tx=0x7f5e6c05b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da3ea17d22c4295 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.139+0000 7f5e597fa640 1 -- 172.21.15.7:0/1335404659 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c088070 con 0x55cd058bf100 2024-04-25T10:04:57.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.139+0000 7f5e597fa640 1 -- 172.21.15.7:0/1335404659 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c075070 con 0x55cd058bf100 2024-04-25T10:04:57.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.139+0000 7f5e597fa640 1 -- 172.21.15.7:0/1335404659 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c061730 con 0x55cd058bf100 2024-04-25T10:04:57.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.139+0000 7f5e7d1dd740 1 -- 172.21.15.7:0/1335404659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd058bf100 msgr2=0x55cd05895190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.139+0000 7f5e7d1dd740 1 --2- 172.21.15.7:0/1335404659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd058bf100 0x55cd05895190 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c058dd0 tx=0x7f5e6c05b000 comp rx=0 tx=0).stop 2024-04-25T10:04:57.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.139+0000 7f5e7d1dd740 1 -- 172.21.15.7:0/1335404659 shutdown_connections 2024-04-25T10:04:57.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.139+0000 7f5e7d1dd740 1 --2- 172.21.15.7:0/1335404659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd058bf100 0x55cd05895190 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.139+0000 7f5e7d1dd740 1 --2- 172.21.15.7:0/1335404659 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cd058bed20 0x55cd05890d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.139+0000 7f5e7d1dd740 1 --2- 172.21.15.7:0/1335404659 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55cd058bb9f0 0x55cd05890810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.139+0000 7f5e7d1dd740 1 -- 172.21.15.7:0/1335404659 >> 172.21.15.7:0/1335404659 conn(0x55cd05891980 msgr2=0x55cd05896fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:57.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.139+0000 7f5e7d1dd740 1 -- 172.21.15.7:0/1335404659 shutdown_connections 2024-04-25T10:04:57.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.139+0000 7f5e7d1dd740 1 -- 172.21.15.7:0/1335404659 wait complete. 2024-04-25T10:04:57.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.140+0000 7f5e7d1dd740 1 -- start start 2024-04-25T10:04:57.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.140+0000 7f5e7d1dd740 1 Processor -- start 2024-04-25T10:04:57.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.141+0000 7f5e7d1dd740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cd058bb9f0 0x55cd05890c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.141+0000 7f5e7d1dd740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55cd058bed20 0x55cd058dfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.141+0000 7f5e7d1dd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd058bf100 0x55cd05895190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.141+0000 7f5e7d1dd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd058bb600 con 0x55cd058bf100 2024-04-25T10:04:57.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.141+0000 7f5e7d1dd740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e741ff0c0 con 0x55cd058bb9f0 2024-04-25T10:04:57.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.141+0000 7f5e7d1dd740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cd05895cc0 con 0x55cd058bed20 2024-04-25T10:04:57.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.141+0000 7f5e7d1dd740 10 client.0 _ll_register_callbacks cb 0x7f5e6c058ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:04:57.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.141+0000 7f5e7899d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd058bf100 0x55cd05895190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.141+0000 7f5e7899d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd058bf100 0x55cd05895190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47614/0 (socket says 172.21.15.7:47614) 2024-04-25T10:04:57.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.141+0000 7f5e7899d640 1 -- 172.21.15.7:0/243165665 learned_addr learned my addr 172.21.15.7:0/243165665 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:57.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.141+0000 7f5e73fff640 1 --2- 172.21.15.7:0/243165665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cd058bb9f0 0x55cd05890c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.141+0000 7f5e737fe640 1 --2- 172.21.15.7:0/243165665 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55cd058bed20 0x55cd058dfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.141+0000 7f5e7899d640 1 -- 172.21.15.7:0/243165665 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55cd058bed20 msgr2=0x55cd058dfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:57.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.141+0000 7f5e7899d640 1 --2- 172.21.15.7:0/243165665 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55cd058bed20 0x55cd058dfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.141+0000 7f5e7899d640 1 -- 172.21.15.7:0/243165665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cd058bb9f0 msgr2=0x55cd05890c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:57.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.141+0000 7f5e7899d640 1 --2- 172.21.15.7:0/243165665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cd058bb9f0 0x55cd05890c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.141+0000 7f5e7899d640 1 -- 172.21.15.7:0/243165665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cd054cf0f0 con 0x55cd058bf100 2024-04-25T10:04:57.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.141+0000 7f5e7899d640 1 --2- 172.21.15.7:0/243165665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd058bf100 0x55cd05895190 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c058d80 tx=0x7f5e6c016070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=780a2a6566a3f537 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.141+0000 7f5e52ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:04:57.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.141+0000 7f5e52ffd640 1 -- 172.21.15.7:0/243165665 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c088040 con 0x55cd058bf100 2024-04-25T10:04:57.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.141+0000 7f5e52ffd640 1 -- 172.21.15.7:0/243165665 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(118..118 src has 1..118) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f5e6c0612a0 con 0x55cd058bf100 2024-04-25T10:04:57.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.141+0000 7f5e7d1dd740 1 -- 172.21.15.7:0/243165665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5e6c075070 con 0x55cd058bf100 2024-04-25T10:04:57.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.141+0000 7f5e52ffd640 1 -- 172.21.15.7:0/243165665 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e6c061730 con 0x55cd058bf100 2024-04-25T10:04:57.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.141+0000 7f5e7d1dd740 10 client.9483 fetch_fsmap learned FSMap version 94 2024-04-25T10:04:57.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.141+0000 7f5e7d1dd740 1 -- 172.21.15.7:0/243165665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) v3 -- 0x55cd058f6580 con 0x55cd058bf100 2024-04-25T10:04:57.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.142+0000 7f5e52ffd640 1 -- 172.21.15.7:0/243165665 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c075070 con 0x55cd058bf100 2024-04-25T10:04:57.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.142+0000 7f5e52ffd640 1 -- 172.21.15.7:0/243165665 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 94) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5e6c058520 con 0x55cd058bf100 2024-04-25T10:04:57.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.142+0000 7f5e7d1dd740 10 client.9483 fetch_fsmap finished waiting for FSMap version 94 2024-04-25T10:04:57.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.142+0000 7f5e7d1dd740 10 client.9483 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-04-25T10:04:57.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.142+0000 7f5e7d1dd740 20 client.9483 populate_metadata read hostname 'smithi007' 2024-04-25T10:04:57.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.142+0000 7f5e7d1dd740 1 --2- 172.21.15.7:0/243165665 >> [v2:172.21.15.7:6834/3781378145,v1:172.21.15.7:6836/3781378145] conn(0x55cd058deca0 0x55cd05945700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.142+0000 7f5e7d1dd740 4 client.9483 mds_command: new command op to 9321 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T10:04:57.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.142+0000 7f5e7d1dd740 1 -- 172.21.15.7:0/243165665 --> [v2:172.21.15.7:6834/3781378145,v1:172.21.15.7:6836/3781378145] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55cd05802630 con 0x55cd058deca0 2024-04-25T10:04:57.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.142+0000 7f5e73fff640 1 --2- 172.21.15.7:0/243165665 >> [v2:172.21.15.7:6834/3781378145,v1:172.21.15.7:6836/3781378145] conn(0x55cd058deca0 0x55cd05945700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.142+0000 7f5e73fff640 1 --2- 172.21.15.7:0/243165665 >> [v2:172.21.15.7:6834/3781378145,v1:172.21.15.7:6836/3781378145] conn(0x55cd058deca0 0x55cd05945700 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=236db40ce0d918c0 server_cookie=6483f7cf15f63e2f in_seq=0 out_seq=0 2024-04-25T10:04:57.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.142+0000 7f5e52ffd640 10 client.9483 ms_handle_connect on v2:172.21.15.7:6834/3781378145 2024-04-25T10:04:57.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.152+0000 7f5e52ffd640 1 -- 172.21.15.7:0/243165665 <== mds.0 v2:172.21.15.7:6834/3781378145 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55cd05802630 con 0x55cd058deca0 2024-04-25T10:04:57.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.152+0000 7f5e52ffd640 10 client.9483 handle_command_reply: tid=0 2024-04-25T10:04:57.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.152+0000 7f5e7d1dd740 1 client.9483 shutdown 2024-04-25T10:04:57.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.152+0000 7f5e7d1dd740 1 -- 172.21.15.7:0/243165665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd058bf100 msgr2=0x55cd05895190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.152+0000 7f5e7d1dd740 1 --2- 172.21.15.7:0/243165665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd058bf100 0x55cd05895190 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c058d80 tx=0x7f5e6c016070 comp rx=0 tx=0).stop 2024-04-25T10:04:57.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.152+0000 7f5e7d1dd740 1 -- 172.21.15.7:0/243165665 shutdown_connections 2024-04-25T10:04:57.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.152+0000 7f5e7d1dd740 1 --2- 172.21.15.7:0/243165665 >> [v2:172.21.15.7:6834/3781378145,v1:172.21.15.7:6836/3781378145] conn(0x55cd058deca0 0x55cd05945700 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.152+0000 7f5e7d1dd740 1 --2- 172.21.15.7:0/243165665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cd058bf100 0x55cd05895190 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.152+0000 7f5e7d1dd740 1 --2- 172.21.15.7:0/243165665 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55cd058bed20 0x55cd058dfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.152+0000 7f5e7d1dd740 1 --2- 172.21.15.7:0/243165665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cd058bb9f0 0x55cd05890c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.152+0000 7f5e52ffd640 0 client.9483 ms_handle_reset on v2:172.21.15.7:6834/3781378145 2024-04-25T10:04:57.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.152+0000 7f5e7d1dd740 1 -- 172.21.15.7:0/243165665 >> 172.21.15.7:0/243165665 conn(0x55cd05891980 msgr2=0x55cd058fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:57.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.153+0000 7f5e7d1dd740 1 -- 172.21.15.7:0/243165665 shutdown_connections 2024-04-25T10:04:57.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.153+0000 7f5e7d1dd740 1 -- 172.21.15.7:0/243165665 wait complete. 2024-04-25T10:04:57.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.153+0000 7f5e7d1dd740 20 client.9483 trim_cache size 0 max 16384 2024-04-25T10:04:57.159 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:04:57.161 INFO:teuthology.orchestra.run.smithi007.stdout: "message": "", 2024-04-25T10:04:57.161 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0 2024-04-25T10:04:57.161 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:04:57.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.153+0000 7f5e7919e640 1 -- 172.21.15.7:0/3118246539 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5e6006b4d0 msgr2=0x7f5e6006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.153+0000 7f5e7919e640 1 --2- 172.21.15.7:0/3118246539 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5e6006b4d0 0x7f5e6006d990 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f5e68034000 tx=0x7f5e6802e000 comp rx=0 tx=0).stop 2024-04-25T10:04:57.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.153+0000 7f5e7919e640 1 -- 172.21.15.7:0/3118246539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e74161bc0 msgr2=0x7f5e7414f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.153+0000 7f5e7919e640 1 --2- 172.21.15.7:0/3118246539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e74161bc0 0x7f5e7414f650 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c007e60 tx=0x7f5e6c00e4b0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.153+0000 7f5e7919e640 1 -- 172.21.15.7:0/3118246539 shutdown_connections 2024-04-25T10:04:57.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.153+0000 7f5e7919e640 1 --2- 172.21.15.7:0/3118246539 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f5e6006b4d0 0x7f5e6006d990 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.153+0000 7f5e7919e640 1 --2- 172.21.15.7:0/3118246539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e74161bc0 0x7f5e7414f650 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.153+0000 7f5e7919e640 1 --2- 172.21.15.7:0/3118246539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e740d3f90 0x7f5e740cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.153+0000 7f5e7919e640 1 --2- 172.21.15.7:0/3118246539 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5e740b48c0 0x7f5e7415e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.153+0000 7f5e7919e640 1 -- 172.21.15.7:0/3118246539 >> 172.21.15.7:0/3118246539 conn(0x7f5e7408af80 msgr2=0x7f5e7415f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:57.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.153+0000 7f5e7919e640 1 -- 172.21.15.7:0/3118246539 shutdown_connections 2024-04-25T10:04:57.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.153+0000 7f5e7919e640 1 -- 172.21.15.7:0/3118246539 wait complete. 2024-04-25T10:04:57.169 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T10:04:57.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.267+0000 7fd376691640 1 Processor -- start 2024-04-25T10:04:57.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.267+0000 7fd376691640 1 -- start start 2024-04-25T10:04:57.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.267+0000 7fd376691640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd37015da60 0x7fd3700d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.267+0000 7fd376691640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd37015de40 0x7fd37015e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.268+0000 7fd376691640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd37015e8a0 con 0x7fd370161d70 2024-04-25T10:04:57.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.268+0000 7fd376691640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd37015eb80 con 0x7fd37015de40 2024-04-25T10:04:57.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.268+0000 7fd376691640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37015ee60 con 0x7fd37015da60 2024-04-25T10:04:57.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.268+0000 7fd36ffff640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd37015da60 0x7fd3700d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.268+0000 7fd36f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd37015de40 0x7fd37015e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.268+0000 7fd36ffff640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd37015da60 0x7fd3700d0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:35016/0 (socket says 172.21.15.7:35016) 2024-04-25T10:04:57.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.268+0000 7fd374c2e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd370161d70 0x7fd3700ce520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:58610/0 (socket says 172.21.15.7:58610) 2024-04-25T10:04:57.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.268+0000 7fd36f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd37015de40 0x7fd37015e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:43326/0 (socket says 172.21.15.7:43326) 2024-04-25T10:04:57.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.268+0000 7fd36ffff640 1 -- 172.21.15.7:0/2449956320 learned_addr learned my addr 172.21.15.7:0/2449956320 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:57.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.268+0000 7fd36f7fe640 1 -- 172.21.15.7:0/2449956320 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd37015da60 msgr2=0x7fd3700d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:57.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.268+0000 7fd36f7fe640 1 --2- 172.21.15.7:0/2449956320 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd37015da60 0x7fd3700d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.268+0000 7fd36f7fe640 1 -- 172.21.15.7:0/2449956320 >> v1:172.21.15.55:6789/0 conn(0x7fd370161d70 legacy=0x7fd3700ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.268+0000 7fd36f7fe640 1 -- 172.21.15.7:0/2449956320 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd370161850 con 0x7fd37015de40 2024-04-25T10:04:57.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.268+0000 7fd36effd640 1 -- 172.21.15.7:0/2449956320 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4276008683 0 0) 0x7fd37015e8a0 con 0x7fd370161d70 2024-04-25T10:04:57.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.268+0000 7fd36ffff640 1 --2- 172.21.15.7:0/2449956320 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd37015da60 0x7fd3700d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:57.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.269+0000 7fd36f7fe640 1 --2- 172.21.15.7:0/2449956320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd37015de40 0x7fd37015e2a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd3600097a0 tx=0x7fd36002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1599e709ffb73eb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.269+0000 7fd36effd640 1 -- 172.21.15.7:0/2449956320 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd360037070 con 0x7fd37015de40 2024-04-25T10:04:57.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.269+0000 7fd36effd640 1 -- 172.21.15.7:0/2449956320 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36002ae50 con 0x7fd37015de40 2024-04-25T10:04:57.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.269+0000 7fd36effd640 1 -- 172.21.15.7:0/2449956320 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd360032660 con 0x7fd37015de40 2024-04-25T10:04:57.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.270+0000 7fd376691640 1 -- 172.21.15.7:0/2449956320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd37015de40 msgr2=0x7fd37015e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.270+0000 7fd376691640 1 --2- 172.21.15.7:0/2449956320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd37015de40 0x7fd37015e2a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd3600097a0 tx=0x7fd36002a100 comp rx=0 tx=0).stop 2024-04-25T10:04:57.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.270+0000 7fd376691640 1 -- 172.21.15.7:0/2449956320 shutdown_connections 2024-04-25T10:04:57.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.270+0000 7fd376691640 1 --2- 172.21.15.7:0/2449956320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd37015de40 0x7fd37015e2a0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.270+0000 7fd376691640 1 --2- 172.21.15.7:0/2449956320 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd37015da60 0x7fd3700d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.270+0000 7fd376691640 1 -- 172.21.15.7:0/2449956320 >> 172.21.15.7:0/2449956320 conn(0x7fd37006bfe0 msgr2=0x7fd37006c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:57.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.270+0000 7fd376691640 1 -- 172.21.15.7:0/2449956320 shutdown_connections 2024-04-25T10:04:57.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.270+0000 7fd376691640 1 -- 172.21.15.7:0/2449956320 wait complete. 2024-04-25T10:04:57.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.271+0000 7fd376691640 1 Processor -- start 2024-04-25T10:04:57.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.271+0000 7fd376691640 1 -- start start 2024-04-25T10:04:57.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.272+0000 7fd376691640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd37015da60 0x7fd3700b3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.272+0000 7fd376691640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd37015de40 0x7fd3700b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.272+0000 7fd376691640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd370161d70 0x7fd3700b57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.272+0000 7fd376691640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3701621e0 con 0x7fd370161d70 2024-04-25T10:04:57.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.272+0000 7fd376691640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd370162360 con 0x7fd37015da60 2024-04-25T10:04:57.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.272+0000 7fd376691640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3701624e0 con 0x7fd37015de40 2024-04-25T10:04:57.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.272+0000 7fd374c2e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd370161d70 0x7fd3700b57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.272+0000 7fd374c2e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd370161d70 0x7fd3700b57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47618/0 (socket says 172.21.15.7:47618) 2024-04-25T10:04:57.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.272+0000 7fd374c2e640 1 -- 172.21.15.7:0/1993172143 learned_addr learned my addr 172.21.15.7:0/1993172143 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:57.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.272+0000 7fd36ffff640 1 --2- 172.21.15.7:0/1993172143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd37015da60 0x7fd3700b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.272+0000 7fd36f7fe640 1 --2- 172.21.15.7:0/1993172143 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd37015de40 0x7fd3700b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.272+0000 7fd374c2e640 1 -- 172.21.15.7:0/1993172143 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd37015de40 msgr2=0x7fd3700b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.273+0000 7fd374c2e640 1 --2- 172.21.15.7:0/1993172143 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd37015de40 0x7fd3700b52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.273+0000 7fd374c2e640 1 -- 172.21.15.7:0/1993172143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd37015da60 msgr2=0x7fd3700b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.273+0000 7fd374c2e640 1 --2- 172.21.15.7:0/1993172143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd37015da60 0x7fd3700b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.273+0000 7fd374c2e640 1 -- 172.21.15.7:0/1993172143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3700b6090 con 0x7fd370161d70 2024-04-25T10:04:57.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.273+0000 7fd374c2e640 1 --2- 172.21.15.7:0/1993172143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd370161d70 0x7fd3700b57e0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7fd36800c730 tx=0x7fd36800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.273+0000 7fd36cff9640 1 -- 172.21.15.7:0/1993172143 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd368018070 con 0x7fd370161d70 2024-04-25T10:04:57.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.273+0000 7fd36cff9640 1 -- 172.21.15.7:0/1993172143 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36800ce40 con 0x7fd370161d70 2024-04-25T10:04:57.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.273+0000 7fd376691640 1 -- 172.21.15.7:0/1993172143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3700cafb0 con 0x7fd370161d70 2024-04-25T10:04:57.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.273+0000 7fd36cff9640 1 -- 172.21.15.7:0/1993172143 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36800a800 con 0x7fd370161d70 2024-04-25T10:04:57.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.273+0000 7fd376691640 1 -- 172.21.15.7:0/1993172143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3700cb570 con 0x7fd370161d70 2024-04-25T10:04:57.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.274+0000 7fd376691640 1 -- 172.21.15.7:0/1993172143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd370068fd0 con 0x7fd370161d70 2024-04-25T10:04:57.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.274+0000 7fd36cff9640 1 -- 172.21.15.7:0/1993172143 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd36800a9a0 con 0x7fd370161d70 2024-04-25T10:04:57.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.275+0000 7fd36cff9640 1 --2- 172.21.15.7:0/1993172143 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd35c06b4d0 0x7fd35c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.275+0000 7fd36ffff640 1 --2- 172.21.15.7:0/1993172143 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd35c06b4d0 0x7fd35c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.275+0000 7fd36cff9640 1 -- 172.21.15.7:0/1993172143 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fd368089b80 con 0x7fd370161d70 2024-04-25T10:04:57.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.275+0000 7fd36ffff640 1 --2- 172.21.15.7:0/1993172143 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd35c06b4d0 0x7fd35c06d990 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fd364009ac0 tx=0x7fd364008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.279+0000 7fd36cff9640 1 -- 172.21.15.7:0/1993172143 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd368058670 con 0x7fd370161d70 2024-04-25T10:04:57.469 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:04:57.471 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:04:57.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.497+0000 7fd376691640 1 -- 172.21.15.7:0/1993172143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd3700d1560 con 0x7fd370161d70 2024-04-25T10:04:57.503 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-04-25T10:04:57.498+0000 7f45ad572640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T10:04:57.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.499+0000 7fd36cff9640 1 -- 172.21.15.7:0/1993172143 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v95) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd368057f70 con 0x7fd370161d70 2024-04-25T10:04:57.504 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T10:04:57.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.502+0000 7fd376691640 1 -- 172.21.15.7:0/1993172143 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd35c06b4d0 msgr2=0x7fd35c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.502+0000 7fd376691640 1 --2- 172.21.15.7:0/1993172143 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd35c06b4d0 0x7fd35c06d990 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fd364009ac0 tx=0x7fd364008040 comp rx=0 tx=0).stop 2024-04-25T10:04:57.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.502+0000 7fd376691640 1 -- 172.21.15.7:0/1993172143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd370161d70 msgr2=0x7fd3700b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.502+0000 7fd376691640 1 --2- 172.21.15.7:0/1993172143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd370161d70 0x7fd3700b57e0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7fd36800c730 tx=0x7fd36800cbf0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.502+0000 7fd376691640 1 -- 172.21.15.7:0/1993172143 shutdown_connections 2024-04-25T10:04:57.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.502+0000 7fd376691640 1 --2- 172.21.15.7:0/1993172143 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fd35c06b4d0 0x7fd35c06d990 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.502+0000 7fd376691640 1 --2- 172.21.15.7:0/1993172143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd370161d70 0x7fd3700b57e0 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.502+0000 7fd376691640 1 --2- 172.21.15.7:0/1993172143 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd37015de40 0x7fd3700b52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.502+0000 7fd376691640 1 --2- 172.21.15.7:0/1993172143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd37015da60 0x7fd3700b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.502+0000 7fd376691640 1 -- 172.21.15.7:0/1993172143 >> 172.21.15.7:0/1993172143 conn(0x7fd37006bfe0 msgr2=0x7fd37015c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:57.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.503+0000 7fd376691640 1 -- 172.21.15.7:0/1993172143 shutdown_connections 2024-04-25T10:04:57.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.503+0000 7fd376691640 1 -- 172.21.15.7:0/1993172143 wait complete. 2024-04-25T10:04:57.510 INFO:tasks.ceph.mds.a.smithi007.stderr: -1742> 2024-04-25T10:04:52.970+0000 7fae8df81640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:04:57.520 DEBUG:teuthology.orchestra.run.smithi007:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset --force 2024-04-25T10:04:57.536 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-04-25T10:04:57.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.612+0000 7fd45e611280 1 -- start start 2024-04-25T10:04:57.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.612+0000 7fd45e611280 1 Processor -- start 2024-04-25T10:04:57.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.613+0000 7fd45e611280 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56160a848c00 0x56160a8b8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.613+0000 7fd45e611280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56160a849800 0x56160a8b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.613+0000 7fd45e611280 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56160a849c00 0x56160a8b9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.613+0000 7fd45e611280 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x56160b61a600 con 0x56160a848c00 2024-04-25T10:04:57.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.613+0000 7fd45e611280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56160b61a480 con 0x56160a849800 2024-04-25T10:04:57.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.613+0000 7fd45e611280 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x56160b61a300 con 0x56160a849c00 2024-04-25T10:04:57.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.613+0000 7fd45c05c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56160a848c00 0x56160a8b8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.613+0000 7fd45c05c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56160a848c00 0x56160a8b8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47658/0 (socket says 172.21.15.7:47658) 2024-04-25T10:04:57.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.613+0000 7fd45c05c640 1 -- 172.21.15.7:0/2736712639 learned_addr learned my addr 172.21.15.7:0/2736712639 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:57.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.613+0000 7fd45c05c640 1 -- 172.21.15.7:0/2736712639 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56160a849c00 msgr2=0x56160a8b9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:57.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.613+0000 7fd45c05c640 1 --2- 172.21.15.7:0/2736712639 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56160a849c00 0x56160a8b9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.613+0000 7fd45c05c640 1 -- 172.21.15.7:0/2736712639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56160a849800 msgr2=0x56160a8b8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:57.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.613+0000 7fd45c05c640 1 --2- 172.21.15.7:0/2736712639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56160a849800 0x56160a8b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.613+0000 7fd45c05c640 1 -- 172.21.15.7:0/2736712639 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56160a87e780 con 0x56160a848c00 2024-04-25T10:04:57.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.613+0000 7fd45c05c640 1 --2- 172.21.15.7:0/2736712639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56160a848c00 0x56160a8b8580 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x56160b6653b0 tx=0x56160b5db140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a88528beda5dd56 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.613+0000 7fd459857640 1 -- 172.21.15.7:0/2736712639 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56160a86e680 con 0x56160a848c00 2024-04-25T10:04:57.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.613+0000 7fd459857640 1 -- 172.21.15.7:0/2736712639 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56160a874e00 con 0x56160a848c00 2024-04-25T10:04:57.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.613+0000 7fd459857640 1 -- 172.21.15.7:0/2736712639 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56160a86eb60 con 0x56160a848c00 2024-04-25T10:04:57.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.613+0000 7fd45e611280 1 -- 172.21.15.7:0/2736712639 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56160a87e3c0 con 0x56160a848c00 2024-04-25T10:04:57.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.613+0000 7fd45e611280 1 -- 172.21.15.7:0/2736712639 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x56160a87f680 con 0x56160a848c00 2024-04-25T10:04:57.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.613+0000 7fd45e611280 4 waiting for MDS map... 2024-04-25T10:04:57.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.614+0000 7fd459857640 1 -- 172.21.15.7:0/2736712639 <== mon.0 v2:172.21.15.7:3300/0 4 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x56160b70c600 con 0x56160a848c00 2024-04-25T10:04:57.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.614+0000 7fd459857640 1 -- 172.21.15.7:0/2736712639 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 95) v1 ==== 2723+0+0 (secure 0 0 0) 0x56160a8a3180 con 0x56160a848c00 2024-04-25T10:04:57.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.614+0000 7fd45e611280 4 Got MDS map 95 2024-04-25T10:04:57.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.614+0000 7fd45e611280 10 main: JournalTool::main 2024-04-25T10:04:57.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.614+0000 7fd45e611280 4 main: JournalTool: connecting to RADOS... 2024-04-25T10:04:57.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.614+0000 7fd45e611280 1 Processor -- start 2024-04-25T10:04:57.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.614+0000 7fd45e611280 1 -- start start 2024-04-25T10:04:57.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.615+0000 7fd45e611280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56160b70f000 0x56160a8b9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.615+0000 7fd45e611280 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56160b70f400 0x56160a8b9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.615+0000 7fd45e611280 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56160b70f800 0x56160a8ba100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.615+0000 7fd45e611280 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x56160b61a180 con 0x56160b70f400 2024-04-25T10:04:57.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.615+0000 7fd45e611280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56160a8aa480 con 0x56160b70f000 2024-04-25T10:04:57.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.615+0000 7fd45e611280 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x56160a8aa900 con 0x56160b70f800 2024-04-25T10:04:57.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.615+0000 7fd45c05c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56160b70f400 0x56160a8b9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.615+0000 7fd45c05c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56160b70f400 0x56160a8b9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47674/0 (socket says 172.21.15.7:47674) 2024-04-25T10:04:57.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.615+0000 7fd45c05c640 1 -- 172.21.15.7:0/2271130188 learned_addr learned my addr 172.21.15.7:0/2271130188 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:57.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.615+0000 7fd45c85d640 1 --2- 172.21.15.7:0/2271130188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56160b70f000 0x56160a8b9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.615+0000 7fd45b85b640 1 --2- 172.21.15.7:0/2271130188 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56160b70f800 0x56160a8ba100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.615+0000 7fd45c05c640 1 -- 172.21.15.7:0/2271130188 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56160b70f800 msgr2=0x56160a8ba100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.615+0000 7fd45c05c640 1 --2- 172.21.15.7:0/2271130188 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56160b70f800 0x56160a8ba100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.615+0000 7fd45c05c640 1 -- 172.21.15.7:0/2271130188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56160b70f000 msgr2=0x56160a8b9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.615+0000 7fd45c05c640 1 --2- 172.21.15.7:0/2271130188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56160b70f000 0x56160a8b9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.615+0000 7fd45c05c640 1 -- 172.21.15.7:0/2271130188 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56160a87f4a0 con 0x56160b70f400 2024-04-25T10:04:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.615+0000 7fd45b85b640 1 --2- 172.21.15.7:0/2271130188 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56160b70f800 0x56160a8ba100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.615+0000 7fd45c05c640 1 --2- 172.21.15.7:0/2271130188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56160b70f400 0x56160a8b9b80 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x56160b726660 tx=0x56160a90c5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e6608d4401be79 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.615+0000 7fd457853640 1 -- 172.21.15.7:0/2271130188 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56160a86e820 con 0x56160b70f400 2024-04-25T10:04:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.615+0000 7fd457853640 1 -- 172.21.15.7:0/2271130188 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56160a874c40 con 0x56160b70f400 2024-04-25T10:04:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.616+0000 7fd457853640 1 -- 172.21.15.7:0/2271130188 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56160a86e680 con 0x56160b70f400 2024-04-25T10:04:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.616+0000 7fd45e611280 1 -- 172.21.15.7:0/2271130188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56160b70f400 msgr2=0x56160a8b9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.616+0000 7fd45e611280 1 --2- 172.21.15.7:0/2271130188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56160b70f400 0x56160a8b9b80 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x56160b726660 tx=0x56160a90c5a0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.616+0000 7fd45e611280 1 -- 172.21.15.7:0/2271130188 shutdown_connections 2024-04-25T10:04:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.616+0000 7fd45e611280 1 --2- 172.21.15.7:0/2271130188 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56160b70f800 0x56160a8ba100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.616+0000 7fd45e611280 1 --2- 172.21.15.7:0/2271130188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56160b70f400 0x56160a8b9b80 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.616+0000 7fd45e611280 1 --2- 172.21.15.7:0/2271130188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56160b70f000 0x56160a8b9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.616+0000 7fd45e611280 1 -- 172.21.15.7:0/2271130188 >> 172.21.15.7:0/2271130188 conn(0x56160b70ec00 msgr2=0x56160a940800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:57.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.616+0000 7fd45e611280 1 -- 172.21.15.7:0/2271130188 shutdown_connections 2024-04-25T10:04:57.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.616+0000 7fd45e611280 1 -- 172.21.15.7:0/2271130188 wait complete. 2024-04-25T10:04:57.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.617+0000 7fd45e611280 1 Processor -- start 2024-04-25T10:04:57.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.617+0000 7fd45e611280 1 -- start start 2024-04-25T10:04:57.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.617+0000 7fd45e611280 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56160b70f000 0x56160a8bb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.617+0000 7fd45e611280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56160b70f400 0x56160a8bac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.617+0000 7fd45e611280 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56160b70f800 0x56160a8ba680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.617+0000 7fd45e611280 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x56160b61b380 con 0x56160b70f800 2024-04-25T10:04:57.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.617+0000 7fd45e611280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56160b61b500 con 0x56160b70f400 2024-04-25T10:04:57.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.617+0000 7fd45e611280 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x56160b61a180 con 0x56160b70f000 2024-04-25T10:04:57.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.617+0000 7fd45b85b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56160b70f800 0x56160a8ba680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.617+0000 7fd45c85d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56160b70f000 0x56160a8bb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.617+0000 7fd45b85b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56160b70f800 0x56160a8ba680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47680/0 (socket says 172.21.15.7:47680) 2024-04-25T10:04:57.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.617+0000 7fd45b85b640 1 -- 172.21.15.7:0/2397722525 learned_addr learned my addr 172.21.15.7:0/2397722525 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:57.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.617+0000 7fd45c05c640 1 --2- 172.21.15.7:0/2397722525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56160b70f400 0x56160a8bac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.618+0000 7fd45b85b640 1 -- 172.21.15.7:0/2397722525 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56160b70f000 msgr2=0x56160a8bb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.618+0000 7fd45b85b640 1 --2- 172.21.15.7:0/2397722525 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56160b70f000 0x56160a8bb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.618+0000 7fd45b85b640 1 -- 172.21.15.7:0/2397722525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56160b70f400 msgr2=0x56160a8bac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.618+0000 7fd45b85b640 1 --2- 172.21.15.7:0/2397722525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56160b70f400 0x56160a8bac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.618+0000 7fd45b85b640 1 -- 172.21.15.7:0/2397722525 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56160a87e780 con 0x56160b70f800 2024-04-25T10:04:57.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.618+0000 7fd45b85b640 1 --2- 172.21.15.7:0/2397722525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56160b70f800 0x56160a8ba680 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x56160b664a80 tx=0x56160b786180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.618+0000 7fd456050640 1 -- 172.21.15.7:0/2397722525 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56160a86e9c0 con 0x56160b70f800 2024-04-25T10:04:57.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.618+0000 7fd456050640 1 -- 172.21.15.7:0/2397722525 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56160a874c40 con 0x56160b70f800 2024-04-25T10:04:57.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.618+0000 7fd45e611280 1 -- 172.21.15.7:0/2397722525 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56160a87e3c0 con 0x56160b70f800 2024-04-25T10:04:57.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.618+0000 7fd456050640 1 -- 172.21.15.7:0/2397722525 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56160a86e820 con 0x56160b70f800 2024-04-25T10:04:57.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.618+0000 7fd45e611280 1 -- 172.21.15.7:0/2397722525 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56160a87e000 con 0x56160b70f800 2024-04-25T10:04:57.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.618+0000 7fd45e611280 4 main: JournalTool: resolving pool 17 2024-04-25T10:04:57.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.619+0000 7fd456050640 1 -- 172.21.15.7:0/2397722525 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x56160b704c00 con 0x56160b70f800 2024-04-25T10:04:57.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.620+0000 7fd456050640 1 --2- 172.21.15.7:0/2397722525 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x56160b70fc00 0x56160a8bb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.620+0000 7fd456050640 1 -- 172.21.15.7:0/2397722525 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x56160b78c400 con 0x56160b70f800 2024-04-25T10:04:57.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.620+0000 7fd45e611280 4 main: JournalTool: creating IoCtx.. 2024-04-25T10:04:57.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.620+0000 7fd45c85d640 1 --2- 172.21.15.7:0/2397722525 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x56160b70fc00 0x56160a8bb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.620+0000 7fd45e611280 4 main: Executing for rank 0 2024-04-25T10:04:57.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.620+0000 7fd45c85d640 1 --2- 172.21.15.7:0/2397722525 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x56160b70fc00 0x56160a8bb700 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x56160a936840 tx=0x56160b7879e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.620+0000 7fd45e611280 1 -- start start 2024-04-25T10:04:57.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.620+0000 7fd45e611280 1 Processor -- start 2024-04-25T10:04:57.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.621+0000 7fd45e611280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56160abc3000 0x56160a8ba100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.621+0000 7fd45e611280 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56160abc3400 0x56160a8b9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.621+0000 7fd45e611280 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56160abc3800 0x56160a8b9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.621+0000 7fd45e611280 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x56160b61b800 con 0x56160abc3800 2024-04-25T10:04:57.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.621+0000 7fd45e611280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56160b61b980 con 0x56160abc3000 2024-04-25T10:04:57.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.621+0000 7fd45e611280 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x56160a8aa900 con 0x56160abc3400 2024-04-25T10:04:57.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.621+0000 7fd45b85b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56160abc3800 0x56160a8b9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.621+0000 7fd45b85b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56160abc3800 0x56160a8b9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47686/0 (socket says 172.21.15.7:47686) 2024-04-25T10:04:57.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.621+0000 7fd45b85b640 1 -- 172.21.15.7:0/3704957060 learned_addr learned my addr 172.21.15.7:0/3704957060 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:57.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.621+0000 7fd45c05c640 1 --2- 172.21.15.7:0/3704957060 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56160abc3400 0x56160a8b9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.621+0000 7fd45c85d640 1 --2- 172.21.15.7:0/3704957060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56160abc3000 0x56160a8ba100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.621+0000 7fd45b85b640 1 -- 172.21.15.7:0/3704957060 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56160abc3400 msgr2=0x56160a8b9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:57.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.621+0000 7fd45b85b640 1 --2- 172.21.15.7:0/3704957060 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56160abc3400 0x56160a8b9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.621+0000 7fd45b85b640 1 -- 172.21.15.7:0/3704957060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56160abc3000 msgr2=0x56160a8ba100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:57.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.621+0000 7fd45b85b640 1 --2- 172.21.15.7:0/3704957060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56160abc3000 0x56160a8ba100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.621+0000 7fd45b85b640 1 -- 172.21.15.7:0/3704957060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56160a87e960 con 0x56160abc3800 2024-04-25T10:04:57.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.622+0000 7fd45b85b640 1 --2- 172.21.15.7:0/3704957060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56160abc3800 0x56160a8b9600 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x56160b7c32f0 tx=0x56160b786de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f253d3aaf195611 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.622+0000 7fd45304a640 1 -- 172.21.15.7:0/3704957060 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56160ab3c680 con 0x56160abc3800 2024-04-25T10:04:57.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.622+0000 7fd45304a640 1 -- 172.21.15.7:0/3704957060 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56160a8748c0 con 0x56160abc3800 2024-04-25T10:04:57.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.622+0000 7fd45e611280 1 -- 172.21.15.7:0/3704957060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56160a87f860 con 0x56160abc3800 2024-04-25T10:04:57.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.622+0000 7fd45e611280 1 -- 172.21.15.7:0/3704957060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x56160a87fa40 con 0x56160abc3800 2024-04-25T10:04:57.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.622+0000 7fd45e611280 4 waiting for MDS map... 2024-04-25T10:04:57.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.622+0000 7fd45304a640 1 -- 172.21.15.7:0/3704957060 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56160ab3c820 con 0x56160abc3800 2024-04-25T10:04:57.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.622+0000 7fd45304a640 1 -- 172.21.15.7:0/3704957060 <== mon.0 v2:172.21.15.7:3300/0 4 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x56160ac18600 con 0x56160abc3800 2024-04-25T10:04:57.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.622+0000 7fd45304a640 1 -- 172.21.15.7:0/3704957060 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 95) v1 ==== 2723+0+0 (secure 0 0 0) 0x56160ac24000 con 0x56160abc3800 2024-04-25T10:04:57.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.622+0000 7fd45e611280 4 Got MDS map 95 2024-04-25T10:04:57.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.622+0000 7fd45e611280 1 --2- 172.21.15.7:0/3704957060 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x56160abc3c00 0x56160ac34000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.622+0000 7fd45e611280 1 -- 172.21.15.7:0/3704957060 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:1 17.f 17:f1f69726:::400.00000000:head [writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v9 -- 0x56160ac1b400 con 0x56160abc3c00 2024-04-25T10:04:57.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.622+0000 7fd45c85d640 1 --2- 172.21.15.7:0/3704957060 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x56160abc3c00 0x56160ac34000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.622+0000 7fd45c85d640 1 --2- 172.21.15.7:0/3704957060 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x56160abc3c00 0x56160ac34000 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=830b6a3438a7a0fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.625+0000 7fd45c85d640 1 -- 172.21.15.7:0/3704957060 <== osd.1 v2:172.21.15.7:6816/434435857 1 ==== osd_op_reply(1 400.00000000 [writefull 0~22] v119'2 uv2 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x56160b5c8000 con 0x56160abc3c00 2024-04-25T10:04:57.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.625+0000 7fd45e611280 1 --2- 172.21.15.7:0/3704957060 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x56160ac1b800 0x56160ac34580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.625+0000 7fd45e611280 1 -- 172.21.15.7:0/3704957060 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:2 17.14 17:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v9 -- 0x56160ac1bc00 con 0x56160ac1b800 2024-04-25T10:04:57.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.626+0000 7fd45c05c640 1 --2- 172.21.15.7:0/3704957060 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x56160ac1b800 0x56160ac34580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.626+0000 7fd45c05c640 1 --2- 172.21.15.7:0/3704957060 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x56160ac1b800 0x56160ac34580 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=5127e4b45f91d385 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.628+0000 7fd45c05c640 1 -- 172.21.15.7:0/3704957060 <== osd.3 v2:172.21.15.7:6824/3045538953 1 ==== osd_op_reply(2 200.00000000 [writefull 0~90] v119'39 uv39 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x56160b5c8500 con 0x56160ac1b800 2024-04-25T10:04:57.639 INFO:teuthology.orchestra.run.smithi007.stdout:writing EResetJournal entry 2024-04-25T10:04:57.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.628+0000 7fd45e611280 1 -- 172.21.15.7:0/3704957060 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:3 17.14 17:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v9 -- 0x56160ac44000 con 0x56160ac1b800 2024-04-25T10:04:57.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.628+0000 7fd45e611280 1 --2- 172.21.15.7:0/3704957060 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x56160ac44400 0x56160ac34b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.628+0000 7fd45e611280 1 -- 172.21.15.7:0/3704957060 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:4 17.1b 17:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v9 -- 0x56160ac44800 con 0x56160ac44400 2024-04-25T10:04:57.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.628+0000 7fd45e611280 1 --2- 172.21.15.7:0/3704957060 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x56160ac44c00 0x56160ac35080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.628+0000 7fd45e611280 1 -- 172.21.15.7:0/3704957060 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:5 17.b 17:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v9 -- 0x56160ac45000 con 0x56160ac44c00 2024-04-25T10:04:57.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.628+0000 7fd45e611280 1 --2- 172.21.15.7:0/3704957060 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x56160ac45400 0x56160ac35600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.628+0000 7fd45e611280 1 -- 172.21.15.7:0/3704957060 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:6 17.1f 17:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v9 -- 0x56160ac45800 con 0x56160ac45400 2024-04-25T10:04:57.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.628+0000 7fd45e611280 1 -- 172.21.15.7:0/3704957060 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:7 17.1a 17:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v9 -- 0x56160ac45c00 con 0x56160ac44c00 2024-04-25T10:04:57.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.628+0000 7fd45e611280 1 -- 172.21.15.7:0/3704957060 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:8 17.1e 17:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v9 -- 0x56160ac4a000 con 0x56160abc3c00 2024-04-25T10:04:57.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.628+0000 7fd45c05c640 1 --2- 172.21.15.7:0/3704957060 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x56160ac44c00 0x56160ac35080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.628+0000 7fd45c85d640 1 --2- 172.21.15.7:0/3704957060 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x56160ac44400 0x56160ac34b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.628+0000 7fd45b85b640 1 --2- 172.21.15.7:0/3704957060 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x56160ac45400 0x56160ac35600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.628+0000 7fd45c05c640 1 --2- 172.21.15.7:0/3704957060 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x56160ac44c00 0x56160ac35080 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=44435cd9b3fd6ffd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.629+0000 7fd45b85b640 1 --2- 172.21.15.7:0/3704957060 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x56160ac45400 0x56160ac35600 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=6f303913d1277614 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.629+0000 7fd45c85d640 1 --2- 172.21.15.7:0/3704957060 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x56160ac44400 0x56160ac34b00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=20bb6dfc5f7663b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.630+0000 7fd45c05c640 1 -- 172.21.15.7:0/3704957060 <== osd.3 v2:172.21.15.7:6824/3045538953 2 ==== osd_op_reply(3 200.00000001 [delete] v119'40 uv40 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x56160b5c8500 con 0x56160ac1b800 2024-04-25T10:04:57.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.630+0000 7fd45c05c640 1 -- 172.21.15.7:0/3704957060 <== osd.0 v2:172.21.15.7:6800/4167741236 1 ==== osd_op_reply(5 200.00000003 [delete] v119'6 uv5 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x56160b5c8500 con 0x56160ac44c00 2024-04-25T10:04:57.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.630+0000 7fd45c85d640 1 -- 172.21.15.7:0/3704957060 <== osd.1 v2:172.21.15.7:6816/434435857 2 ==== osd_op_reply(8 200.00000006 [delete] v119'3 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x56160b5c8000 con 0x56160abc3c00 2024-04-25T10:04:57.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.630+0000 7fd45c05c640 1 -- 172.21.15.7:0/3704957060 <== osd.0 v2:172.21.15.7:6800/4167741236 2 ==== osd_op_reply(7 200.00000005 [delete] v119'3 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x56160b5c8500 con 0x56160ac44c00 2024-04-25T10:04:57.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.631+0000 7fd45c85d640 1 -- 172.21.15.7:0/3704957060 <== osd.4 v2:172.21.15.55:6808/2248155105 1 ==== osd_op_reply(4 200.00000002 [delete] v119'3 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x56160b5c8000 con 0x56160ac44400 2024-04-25T10:04:57.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.631+0000 7fd451847640 1 -- 172.21.15.7:0/3704957060 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:9 17.14 17:2e2fa760:::200.00000001:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v9 -- 0x56160abc2800 con 0x56160ac1b800 2024-04-25T10:04:57.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.631+0000 7fd45b85b640 1 -- 172.21.15.7:0/3704957060 <== osd.6 v2:172.21.15.55:6824/4293769515 1 ==== osd_op_reply(6 200.00000004 [delete] v119'9 uv8 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x56160b5c8780 con 0x56160ac45400 2024-04-25T10:04:57.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.632+0000 7fd45c05c640 1 -- 172.21.15.7:0/3704957060 <== osd.3 v2:172.21.15.7:6824/3045538953 3 ==== osd_op_reply(9 200.00000001 [write 0~48] v119'41 uv41 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x56160b5c8500 con 0x56160ac1b800 2024-04-25T10:04:57.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.632+0000 7fd45e611280 4 Successfully wrote new journal pointer and header for rank 8:0 2024-04-25T10:04:57.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.632+0000 7fd45e611280 1 -- 172.21.15.7:0/3704957060 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x56160ac44c00 msgr2=0x56160ac35080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.632+0000 7fd45e611280 1 --2- 172.21.15.7:0/3704957060 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x56160ac44c00 0x56160ac35080 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.632+0000 7fd45e611280 1 -- 172.21.15.7:0/3704957060 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x56160abc3c00 msgr2=0x56160ac34000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.632+0000 7fd45e611280 1 --2- 172.21.15.7:0/3704957060 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x56160abc3c00 0x56160ac34000 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.632+0000 7fd45e611280 1 -- 172.21.15.7:0/3704957060 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x56160ac1b800 msgr2=0x56160ac34580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.632+0000 7fd45e611280 1 --2- 172.21.15.7:0/3704957060 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x56160ac1b800 0x56160ac34580 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.632+0000 7fd45e611280 1 -- 172.21.15.7:0/3704957060 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x56160ac44400 msgr2=0x56160ac34b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.632+0000 7fd45e611280 1 --2- 172.21.15.7:0/3704957060 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x56160ac44400 0x56160ac34b00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.632+0000 7fd45c05c640 1 -- 172.21.15.7:0/3704957060 reap_dead start 2024-04-25T10:04:57.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.632+0000 7fd45e611280 1 -- 172.21.15.7:0/3704957060 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x56160ac45400 msgr2=0x56160ac35600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.632+0000 7fd45e611280 1 --2- 172.21.15.7:0/3704957060 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x56160ac45400 0x56160ac35600 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.632+0000 7fd45e611280 1 -- 172.21.15.7:0/3704957060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56160abc3800 msgr2=0x56160a8b9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.632+0000 7fd45c05c640 1 -- 172.21.15.7:0/3704957060 reap_dead start 2024-04-25T10:04:57.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.632+0000 7fd45e611280 1 --2- 172.21.15.7:0/3704957060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56160abc3800 0x56160a8b9600 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x56160b7c32f0 tx=0x56160b786de0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.632+0000 7fd45e611280 1 -- 172.21.15.7:0/3704957060 shutdown_connections 2024-04-25T10:04:57.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.632+0000 7fd45e611280 1 --2- 172.21.15.7:0/3704957060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56160abc3800 0x56160a8b9600 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.632+0000 7fd45e611280 1 -- 172.21.15.7:0/3704957060 >> 172.21.15.7:0/3704957060 conn(0x56160abc2c00 msgr2=0x56160a940000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:57.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.632+0000 7fd45e611280 1 -- 172.21.15.7:0/3704957060 shutdown_connections 2024-04-25T10:04:57.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.632+0000 7fd45e611280 1 -- 172.21.15.7:0/3704957060 wait complete. 2024-04-25T10:04:57.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.633+0000 7fd45e611280 1 -- 172.21.15.7:0/2397722525 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x56160b70fc00 msgr2=0x56160a8bb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.633+0000 7fd45e611280 1 --2- 172.21.15.7:0/2397722525 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x56160b70fc00 0x56160a8bb700 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x56160a936840 tx=0x56160b7879e0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.633+0000 7fd45e611280 1 -- 172.21.15.7:0/2397722525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56160b70f800 msgr2=0x56160a8ba680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.633+0000 7fd45e611280 1 --2- 172.21.15.7:0/2397722525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56160b70f800 0x56160a8ba680 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x56160b664a80 tx=0x56160b786180 comp rx=0 tx=0).stop 2024-04-25T10:04:57.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.633+0000 7fd45e611280 1 -- 172.21.15.7:0/2397722525 shutdown_connections 2024-04-25T10:04:57.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.633+0000 7fd45e611280 1 --2- 172.21.15.7:0/2397722525 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x56160b70fc00 0x56160a8bb700 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.633+0000 7fd45e611280 1 --2- 172.21.15.7:0/2397722525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56160b70f800 0x56160a8ba680 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.633+0000 7fd45e611280 1 --2- 172.21.15.7:0/2397722525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56160b70f400 0x56160a8bac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.633+0000 7fd45e611280 1 --2- 172.21.15.7:0/2397722525 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56160b70f000 0x56160a8bb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.633+0000 7fd45e611280 1 -- 172.21.15.7:0/2397722525 >> 172.21.15.7:0/2397722525 conn(0x56160b70ec00 msgr2=0x56160a940800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:57.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.633+0000 7fd45e611280 1 -- 172.21.15.7:0/2397722525 shutdown_connections 2024-04-25T10:04:57.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.633+0000 7fd45e611280 1 -- 172.21.15.7:0/2397722525 wait complete. 2024-04-25T10:04:57.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.633+0000 7fd45e611280 1 -- 172.21.15.7:0/2736712639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56160a848c00 msgr2=0x56160a8b8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.633+0000 7fd45e611280 1 --2- 172.21.15.7:0/2736712639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56160a848c00 0x56160a8b8580 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x56160b6653b0 tx=0x56160b5db140 comp rx=0 tx=0).stop 2024-04-25T10:04:57.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.633+0000 7fd45e611280 1 -- 172.21.15.7:0/2736712639 shutdown_connections 2024-04-25T10:04:57.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.633+0000 7fd45e611280 1 --2- 172.21.15.7:0/2736712639 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x56160a849c00 0x56160a8b9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.633+0000 7fd45e611280 1 --2- 172.21.15.7:0/2736712639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56160a849800 0x56160a8b8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.633+0000 7fd45e611280 1 --2- 172.21.15.7:0/2736712639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56160a848c00 0x56160a8b8580 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.633+0000 7fd45e611280 1 -- 172.21.15.7:0/2736712639 >> 172.21.15.7:0/2736712639 conn(0x56160a849000 msgr2=0x56160a941000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:57.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.633+0000 7fd45e611280 1 -- 172.21.15.7:0/2736712639 shutdown_connections 2024-04-25T10:04:57.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.633+0000 7fd45e611280 1 -- 172.21.15.7:0/2736712639 wait complete. 2024-04-25T10:04:57.650 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset', '--force'] in time 0:00:00.130034, result: writing EResetJournal entry 2024-04-25T10:04:57.650 DEBUG:teuthology.orchestra.run.smithi007:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents cephfs_data 2024-04-25T10:04:57.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.719+0000 7fccb33a8740 1 -- start start 2024-04-25T10:04:57.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.719+0000 7fccb33a8740 1 Processor -- start 2024-04-25T10:04:57.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.720+0000 7fccb33a8740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55641e96a800 0x55641dc4bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.720+0000 7fccb33a8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55641dbdbc00 0x55641dc4ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.720+0000 7fccb33a8740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55641e96bc00 0x55641dc4b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.720+0000 7fccb33a8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55641e9a4000 con 0x55641dbdbc00 2024-04-25T10:04:57.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.720+0000 7fccb33a8740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55641e9a4180 con 0x55641e96bc00 2024-04-25T10:04:57.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.720+0000 7fccb33a8740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55641e9a4300 con 0x55641e96a800 2024-04-25T10:04:57.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.720+0000 7fccaf997640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55641dbdbc00 0x55641dc4ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.720+0000 7fccaf997640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55641dbdbc00 0x55641dc4ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47696/0 (socket says 172.21.15.7:47696) 2024-04-25T10:04:57.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.720+0000 7fccaf997640 1 -- 172.21.15.7:0/551973318 learned_addr learned my addr 172.21.15.7:0/551973318 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:57.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.720+0000 7fccb0198640 1 --2- 172.21.15.7:0/551973318 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55641e96a800 0x55641dc4bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.720+0000 7fccb0999640 1 --2- 172.21.15.7:0/551973318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55641e96bc00 0x55641dc4b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.720+0000 7fccaf997640 1 -- 172.21.15.7:0/551973318 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55641e96a800 msgr2=0x55641dc4bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:57.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.720+0000 7fccaf997640 1 --2- 172.21.15.7:0/551973318 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55641e96a800 0x55641dc4bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.720+0000 7fccaf997640 1 -- 172.21.15.7:0/551973318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55641e96bc00 msgr2=0x55641dc4b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:57.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.720+0000 7fccaf997640 1 --2- 172.21.15.7:0/551973318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55641e96bc00 0x55641dc4b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.720+0000 7fccaf997640 1 -- 172.21.15.7:0/551973318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55641dc07680 con 0x55641dbdbc00 2024-04-25T10:04:57.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.720+0000 7fccb0198640 1 --2- 172.21.15.7:0/551973318 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55641e96a800 0x55641dc4bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:57.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.720+0000 7fccb0999640 1 --2- 172.21.15.7:0/551973318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55641e96bc00 0x55641dc4b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:57.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.721+0000 7fccaf997640 1 --2- 172.21.15.7:0/551973318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55641dbdbc00 0x55641dc4ab00 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x55641ea01aa0 tx=0x55641dd4e120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f0d5b6fafa8db02 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.721+0000 7fccad993640 1 -- 172.21.15.7:0/551973318 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55641dc00d00 con 0x55641dbdbc00 2024-04-25T10:04:57.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.721+0000 7fccad993640 1 -- 172.21.15.7:0/551973318 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55641dc24c40 con 0x55641dbdbc00 2024-04-25T10:04:57.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.721+0000 7fccad993640 1 -- 172.21.15.7:0/551973318 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55641dc009c0 con 0x55641dbdbc00 2024-04-25T10:04:57.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.721+0000 7fccb33a8740 1 -- 172.21.15.7:0/551973318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55641dc070e0 con 0x55641dbdbc00 2024-04-25T10:04:57.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.721+0000 7fccb33a8740 1 -- 172.21.15.7:0/551973318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55641dc074a0 con 0x55641dbdbc00 2024-04-25T10:04:57.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.721+0000 7fccb33a8740 4 waiting for MDS map... 2024-04-25T10:04:57.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.721+0000 7fccad993640 1 -- 172.21.15.7:0/551973318 <== mon.0 v2:172.21.15.7:3300/0 4 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x55641eaaa400 con 0x55641dbdbc00 2024-04-25T10:04:57.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.721+0000 7fccad993640 1 -- 172.21.15.7:0/551973318 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 95) v1 ==== 2723+0+0 (secure 0 0 0) 0x55641dc33180 con 0x55641dbdbc00 2024-04-25T10:04:57.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.721+0000 7fccb33a8740 4 Got MDS map 95 2024-04-25T10:04:57.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.721+0000 7fccb33a8740 4 datascan.main: Using metadata pool output 2024-04-25T10:04:57.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.721+0000 7fccb33a8740 4 datascan.main: connecting to RADOS... 2024-04-25T10:04:57.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.722+0000 7fccb33a8740 1 Processor -- start 2024-04-25T10:04:57.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.722+0000 7fccb33a8740 1 -- start start 2024-04-25T10:04:57.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.722+0000 7fccb33a8740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55641e96a000 0x55641dc4b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.722+0000 7fccb33a8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55641eaac800 0x55641dc4c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.722+0000 7fccb33a8740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55641eaacc00 0x55641dc4c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.722+0000 7fccb33a8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55641e9a4480 con 0x55641eaac800 2024-04-25T10:04:57.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.722+0000 7fccb33a8740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55641e9a4600 con 0x55641e96a000 2024-04-25T10:04:57.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.722+0000 7fccb33a8740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55641e9a4780 con 0x55641eaacc00 2024-04-25T10:04:57.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.722+0000 7fccb0198640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55641eaac800 0x55641dc4c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.722+0000 7fccb0198640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55641eaac800 0x55641dc4c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47708/0 (socket says 172.21.15.7:47708) 2024-04-25T10:04:57.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.722+0000 7fccb0198640 1 -- 172.21.15.7:0/599665257 learned_addr learned my addr 172.21.15.7:0/599665257 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:57.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.723+0000 7fccaf997640 1 --2- 172.21.15.7:0/599665257 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55641eaacc00 0x55641dc4c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.723+0000 7fccb0999640 1 --2- 172.21.15.7:0/599665257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55641e96a000 0x55641dc4b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.723+0000 7fccb0198640 1 -- 172.21.15.7:0/599665257 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55641eaacc00 msgr2=0x55641dc4c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:57.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.723+0000 7fccb0198640 1 --2- 172.21.15.7:0/599665257 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55641eaacc00 0x55641dc4c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.723+0000 7fccb0198640 1 -- 172.21.15.7:0/599665257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55641e96a000 msgr2=0x55641dc4b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:57.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.723+0000 7fccb0198640 1 --2- 172.21.15.7:0/599665257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55641e96a000 0x55641dc4b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.723+0000 7fccb0198640 1 -- 172.21.15.7:0/599665257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55641dc072c0 con 0x55641eaac800 2024-04-25T10:04:57.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.723+0000 7fccb0198640 1 --2- 172.21.15.7:0/599665257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55641eaac800 0x55641dc4c100 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x55641eac8f60 tx=0x55641eacec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8a69a110101f619 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.723+0000 7fccab98f640 1 -- 172.21.15.7:0/599665257 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55641dc00d00 con 0x55641eaac800 2024-04-25T10:04:57.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.723+0000 7fccab98f640 1 -- 172.21.15.7:0/599665257 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55641dc24a80 con 0x55641eaac800 2024-04-25T10:04:57.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.723+0000 7fccab98f640 1 -- 172.21.15.7:0/599665257 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55641dc009c0 con 0x55641eaac800 2024-04-25T10:04:57.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.723+0000 7fccb33a8740 1 -- 172.21.15.7:0/599665257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55641eaac800 msgr2=0x55641dc4c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.723+0000 7fccb33a8740 1 --2- 172.21.15.7:0/599665257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55641eaac800 0x55641dc4c100 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x55641eac8f60 tx=0x55641eacec00 comp rx=0 tx=0).stop 2024-04-25T10:04:57.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.723+0000 7fccb33a8740 1 -- 172.21.15.7:0/599665257 shutdown_connections 2024-04-25T10:04:57.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.723+0000 7fccb33a8740 1 --2- 172.21.15.7:0/599665257 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55641eaacc00 0x55641dc4c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.723+0000 7fccb33a8740 1 --2- 172.21.15.7:0/599665257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55641eaac800 0x55641dc4c100 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.723+0000 7fccb33a8740 1 --2- 172.21.15.7:0/599665257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55641e96a000 0x55641dc4b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.723+0000 7fccb33a8740 1 -- 172.21.15.7:0/599665257 >> 172.21.15.7:0/599665257 conn(0x55641e96a400 msgr2=0x55641dcd5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.724+0000 7fccb33a8740 1 -- 172.21.15.7:0/599665257 shutdown_connections 2024-04-25T10:04:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.724+0000 7fccb33a8740 1 -- 172.21.15.7:0/599665257 wait complete. 2024-04-25T10:04:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.724+0000 7fccb33a8740 1 Processor -- start 2024-04-25T10:04:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.724+0000 7fccb33a8740 1 -- start start 2024-04-25T10:04:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.725+0000 7fccb33a8740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55641e96a400 0x55641dc4d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.725+0000 7fccb33a8740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55641eaad800 0x55641dc4d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.725+0000 7fccb33a8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55641eaad400 0x55641dc4cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.725+0000 7fccb33a8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55641e9a5e00 con 0x55641eaad400 2024-04-25T10:04:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.725+0000 7fccb33a8740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55641e9a5c80 con 0x55641eaad800 2024-04-25T10:04:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.725+0000 7fccb33a8740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x55641e9a5b00 con 0x55641e96a400 2024-04-25T10:04:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.725+0000 7fccaf997640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55641eaad400 0x55641dc4cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.725+0000 7fccaf997640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55641eaad400 0x55641dc4cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47712/0 (socket says 172.21.15.7:47712) 2024-04-25T10:04:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.725+0000 7fccaf997640 1 -- 172.21.15.7:0/2461398294 learned_addr learned my addr 172.21.15.7:0/2461398294 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.725+0000 7fccb0198640 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55641eaad800 0x55641dc4d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.725+0000 7fccb0999640 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55641e96a400 0x55641dc4d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.725+0000 7fccaf997640 1 -- 172.21.15.7:0/2461398294 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55641e96a400 msgr2=0x55641dc4d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.725+0000 7fccaf997640 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55641e96a400 0x55641dc4d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.725+0000 7fccaf997640 1 -- 172.21.15.7:0/2461398294 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55641eaad800 msgr2=0x55641dc4d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.725+0000 7fccaf997640 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55641eaad800 0x55641dc4d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.725+0000 7fccaf997640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55641dc07680 con 0x55641eaad400 2024-04-25T10:04:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.725+0000 7fccaf997640 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55641eaad400 0x55641dc4cc00 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x55641eac9ce0 tx=0x55641e95f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.725+0000 7fccaa18c640 1 -- 172.21.15.7:0/2461398294 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55641dc004e0 con 0x55641eaad400 2024-04-25T10:04:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.725+0000 7fccaa18c640 1 -- 172.21.15.7:0/2461398294 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55641dc25500 con 0x55641eaad400 2024-04-25T10:04:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.725+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55641dc070e0 con 0x55641eaad400 2024-04-25T10:04:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.725+0000 7fccaa18c640 1 -- 172.21.15.7:0/2461398294 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55641dc00d00 con 0x55641eaad400 2024-04-25T10:04:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.726+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55641dc063c0 con 0x55641eaad400 2024-04-25T10:04:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.726+0000 7fccb33a8740 4 datascan.init: resolving metadata pool 17 2024-04-25T10:04:57.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.727+0000 7fccaa18c640 1 -- 172.21.15.7:0/2461398294 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x55641eb18c00 con 0x55641eaad400 2024-04-25T10:04:57.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.727+0000 7fccaa18c640 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x55641eb11400 0x55641df44000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.727+0000 7fccaa18c640 1 -- 172.21.15.7:0/2461398294 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x55641eb12e00 con 0x55641eaad400 2024-04-25T10:04:57.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.727+0000 7fccb0999640 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x55641eb11400 0x55641df44000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.727+0000 7fccb33a8740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T10:04:57.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.727+0000 7fccb33a8740 4 datascan.main: data pool 'cephfs_data' has ID 18 2024-04-25T10:04:57.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.727+0000 7fccb33a8740 4 datascan.main: opening data pool 'cephfs_data' 2024-04-25T10:04:57.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.727+0000 7fccb33a8740 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x55641eaad000 0x55641dc4c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.727+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:1 18.0 18:00000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641eaacc00 con 0x55641eaad000 2024-04-25T10:04:57.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.727+0000 7fccb0198640 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x55641eaad000 0x55641dc4c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.727+0000 7fccb0999640 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x55641eb11400 0x55641df44000 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x55641e96f1d0 tx=0x55641e96cf00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.728+0000 7fccb0198640 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x55641eaad000 0x55641dc4c680 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.728+0000 7fccb0198640 1 -- 172.21.15.7:0/2461398294 <== osd.0 v2:172.21.15.7:6800/4167741236 1 ==== osd_op_reply(1 [pgnls start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a000 con 0x55641eaad000 2024-04-25T10:04:57.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.728+0000 7fccab18e640 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x55641eaadc00 0x55641df44580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.728+0000 7fccab18e640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:2 18.20 18:04000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641eb10400 con 0x55641eaadc00 2024-04-25T10:04:57.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.728+0000 7fccb0999640 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x55641eaadc00 0x55641df44580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.729+0000 7fccb0999640 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x55641eaadc00 0x55641df44580 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.731+0000 7fccb0999640 1 -- 172.21.15.7:0/2461398294 <== osd.5 v2:172.21.15.55:6800/2514169616 1 ==== osd_op_reply(2 [pgnls start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a500 con 0x55641eaadc00 2024-04-25T10:04:57.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.731+0000 7fccab98f640 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x55641eb10000 0x55641df44b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.731+0000 7fccab98f640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:3 18.10 18:08000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641eb11800 con 0x55641eb10000 2024-04-25T10:04:57.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.731+0000 7fccb0198640 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x55641eb10000 0x55641df44b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.731+0000 7fccb0198640 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x55641eb10000 0x55641df44b00 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.732+0000 7fccb0198640 1 -- 172.21.15.7:0/2461398294 <== osd.6 v2:172.21.15.55:6824/4293769515 1 ==== osd_op_reply(3 [pgnls start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a000 con 0x55641eb10000 2024-04-25T10:04:57.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.732+0000 7fccab18e640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:4 18.30 18:0c000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641eaacc00 con 0x55641eaad000 2024-04-25T10:04:57.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.732+0000 7fccb0198640 1 -- 172.21.15.7:0/2461398294 <== osd.0 v2:172.21.15.7:6800/4167741236 2 ==== osd_op_reply(4 [pgnls start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a000 con 0x55641eaad000 2024-04-25T10:04:57.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.732+0000 7fccab98f640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:5 18.8 18:10000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641eb11c00 con 0x55641eaad000 2024-04-25T10:04:57.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.732+0000 7fccb0198640 1 -- 172.21.15.7:0/2461398294 <== osd.0 v2:172.21.15.7:6800/4167741236 3 ==== osd_op_reply(5 [pgnls start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a000 con 0x55641eaad000 2024-04-25T10:04:57.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.732+0000 7fccab18e640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:6 18.28 18:14000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df62000 con 0x55641eaadc00 2024-04-25T10:04:57.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.733+0000 7fccb0999640 1 -- 172.21.15.7:0/2461398294 <== osd.5 v2:172.21.15.55:6800/2514169616 2 ==== osd_op_reply(6 [pgnls start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a500 con 0x55641eaadc00 2024-04-25T10:04:57.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.733+0000 7fccab98f640 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x55641df62c00 0x55641df45080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.733+0000 7fccab98f640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:7 18.18 18:18000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df63000 con 0x55641df62c00 2024-04-25T10:04:57.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.733+0000 7fccaf997640 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x55641df62c00 0x55641df45080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.733+0000 7fccaf997640 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x55641df62c00 0x55641df45080 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.733+0000 7fccaf997640 1 -- 172.21.15.7:0/2461398294 <== osd.1 v2:172.21.15.7:6816/434435857 1 ==== osd_op_reply(7 [pgnls start_epoch 119 out=81b] v117'17 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55641e95a780 con 0x55641df62c00 2024-04-25T10:04:57.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.733+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:8 18.18 18:1ad8d55b:::10000000006.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641eaac800 con 0x55641df62c00 2024-04-25T10:04:57.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.734+0000 7fccaf997640 1 -- 172.21.15.7:0/2461398294 <== osd.1 v2:172.21.15.7:6816/434435857 2 ==== osd_op_reply(8 10000000006.00000001 [stat out=16b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55641e95a780 con 0x55641df62c00 2024-04-25T10:04:57.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.734+0000 7fccb33a8740 10 datascan.operator(): handling object 1099511627782.1 2024-04-25T10:04:57.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.734+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:9 18.25 18:a5feb6f3:::10000000006.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df63800 con 0x55641eb10000 2024-04-25T10:04:57.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.735+0000 7fccb0198640 1 -- 172.21.15.7:0/2461398294 <== osd.6 v2:172.21.15.55:6824/4293769515 2 ==== osd_op_reply(9 10000000006.00000000 [call] v119'16 uv16 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55641e95a000 con 0x55641eb10000 2024-04-25T10:04:57.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.735+0000 7fccb33a8740 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x55641df63c00 0x55641dc4c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.735+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:10 18.38 18:1c000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df70000 con 0x55641df63c00 2024-04-25T10:04:57.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.735+0000 7fccb0999640 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x55641df63c00 0x55641dc4c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.736+0000 7fccb0999640 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x55641df63c00 0x55641dc4c100 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.736+0000 7fccb0999640 1 -- 172.21.15.7:0/2461398294 <== osd.3 v2:172.21.15.7:6824/3045538953 1 ==== osd_op_reply(10 [pgnls start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a500 con 0x55641df63c00 2024-04-25T10:04:57.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.736+0000 7fccab98f640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:11 18.4 18:20000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df63400 con 0x55641eaad000 2024-04-25T10:04:57.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.736+0000 7fccb0198640 1 -- 172.21.15.7:0/2461398294 <== osd.0 v2:172.21.15.7:6800/4167741236 4 ==== osd_op_reply(11 [pgnls start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a000 con 0x55641eaad000 2024-04-25T10:04:57.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.736+0000 7fccab18e640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:12 18.24 18:24000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df62400 con 0x55641eaad000 2024-04-25T10:04:57.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.736+0000 7fccb0198640 1 -- 172.21.15.7:0/2461398294 <== osd.0 v2:172.21.15.7:6800/4167741236 5 ==== osd_op_reply(12 [pgnls start_epoch 119 out=49b] v117'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a000 con 0x55641eaad000 2024-04-25T10:04:57.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.736+0000 7fccab98f640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:13 18.14 18:28000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df63800 con 0x55641eb10000 2024-04-25T10:04:57.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.737+0000 7fccb0198640 1 -- 172.21.15.7:0/2461398294 <== osd.6 v2:172.21.15.55:6824/4293769515 3 ==== osd_op_reply(13 [pgnls start_epoch 119 out=49b] v117'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a000 con 0x55641eb10000 2024-04-25T10:04:57.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.737+0000 7fccab18e640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:14 18.34 18:2c000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df62800 con 0x55641eaad000 2024-04-25T10:04:57.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.737+0000 7fccb0198640 1 -- 172.21.15.7:0/2461398294 <== osd.0 v2:172.21.15.7:6800/4167741236 6 ==== osd_op_reply(14 [pgnls start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a000 con 0x55641eaad000 2024-04-25T10:04:57.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.737+0000 7fccab98f640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:15 18.c 18:30000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641eb11800 con 0x55641eaadc00 2024-04-25T10:04:57.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.737+0000 7fccb0999640 1 -- 172.21.15.7:0/2461398294 <== osd.5 v2:172.21.15.55:6800/2514169616 3 ==== osd_op_reply(15 [pgnls start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a500 con 0x55641eaadc00 2024-04-25T10:04:57.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.737+0000 7fccab18e640 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x55641df63400 0x55641df45b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.737+0000 7fccab18e640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:16 18.2c 18:34000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df7c000 con 0x55641df63400 2024-04-25T10:04:57.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.738+0000 7fccb0198640 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x55641df63400 0x55641df45b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.738+0000 7fccb0198640 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x55641df63400 0x55641df45b80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.738+0000 7fccb0198640 1 -- 172.21.15.7:0/2461398294 <== osd.2 v2:172.21.15.7:6808/1173474863 1 ==== osd_op_reply(16 [pgnls start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a000 con 0x55641df63400 2024-04-25T10:04:57.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.738+0000 7fccab98f640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:17 18.1c 18:38000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641eb11c00 con 0x55641df62c00 2024-04-25T10:04:57.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.738+0000 7fccaf997640 1 -- 172.21.15.7:0/2461398294 <== osd.1 v2:172.21.15.7:6816/434435857 3 ==== osd_op_reply(17 [pgnls start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a780 con 0x55641df62c00 2024-04-25T10:04:57.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.738+0000 7fccab18e640 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x55641df7c400 0x55641df46100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.738+0000 7fccab18e640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:18 18.3c 18:3c000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df7c800 con 0x55641df7c400 2024-04-25T10:04:57.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.739+0000 7fccaf997640 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x55641df7c400 0x55641df46100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.739+0000 7fccaf997640 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x55641df7c400 0x55641df46100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.739+0000 7fccaf997640 1 -- 172.21.15.7:0/2461398294 <== osd.7 v2:172.21.15.55:6816/2960381217 1 ==== osd_op_reply(18 [pgnls start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a780 con 0x55641df7c400 2024-04-25T10:04:57.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.739+0000 7fccab98f640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:19 18.2 18:40000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641eaacc00 con 0x55641df7c400 2024-04-25T10:04:57.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.740+0000 7fccaf997640 1 -- 172.21.15.7:0/2461398294 <== osd.7 v2:172.21.15.55:6816/2960381217 2 ==== osd_op_reply(19 [pgnls start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a780 con 0x55641df7c400 2024-04-25T10:04:57.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.740+0000 7fccab18e640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:20 18.22 18:44000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df7cc00 con 0x55641df63c00 2024-04-25T10:04:57.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.740+0000 7fccb0999640 1 -- 172.21.15.7:0/2461398294 <== osd.3 v2:172.21.15.7:6824/3045538953 2 ==== osd_op_reply(20 [pgnls start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a500 con 0x55641df63c00 2024-04-25T10:04:57.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.740+0000 7fccab98f640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:21 18.12 18:48000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641eb10400 con 0x55641df63400 2024-04-25T10:04:57.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.740+0000 7fccb0198640 1 -- 172.21.15.7:0/2461398294 <== osd.2 v2:172.21.15.7:6808/1173474863 2 ==== osd_op_reply(21 [pgnls start_epoch 119 out=81b] v118'22 uv22 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55641e95a000 con 0x55641df63400 2024-04-25T10:04:57.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.740+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:22 18.12 18:4bec3886:::10000000002.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df70400 con 0x55641df63400 2024-04-25T10:04:57.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.740+0000 7fccb0198640 1 -- 172.21.15.7:0/2461398294 <== osd.2 v2:172.21.15.7:6808/1173474863 3 ==== osd_op_reply(22 10000000002.00000000 [stat out=16b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55641e95a000 con 0x55641df63400 2024-04-25T10:04:57.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.740+0000 7fccb33a8740 10 datascan.operator(): handling object 1099511627778.0 2024-04-25T10:04:57.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.741+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:23 18.12 18:4bec3886:::10000000002.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df70800 con 0x55641df63400 2024-04-25T10:04:57.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.742+0000 7fccb0198640 1 -- 172.21.15.7:0/2461398294 <== osd.2 v2:172.21.15.7:6808/1173474863 4 ==== osd_op_reply(23 10000000002.00000000 [call] v119'23 uv23 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55641e95a000 con 0x55641df63400 2024-04-25T10:04:57.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.742+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:24 18.32 18:4c000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df70c00 con 0x55641df63c00 2024-04-25T10:04:57.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.742+0000 7fccb0999640 1 -- 172.21.15.7:0/2461398294 <== osd.3 v2:172.21.15.7:6824/3045538953 3 ==== osd_op_reply(24 [pgnls start_epoch 119 out=81b] v117'16 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55641e95a500 con 0x55641df63c00 2024-04-25T10:04:57.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.742+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:25 18.32 18:4def72d4:::10000000003.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df71000 con 0x55641df63c00 2024-04-25T10:04:57.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.743+0000 7fccb0999640 1 -- 172.21.15.7:0/2461398294 <== osd.3 v2:172.21.15.7:6824/3045538953 4 ==== osd_op_reply(25 10000000003.00000000 [stat out=16b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55641e95a500 con 0x55641df63c00 2024-04-25T10:04:57.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.743+0000 7fccb33a8740 10 datascan.operator(): handling object 1099511627779.0 2024-04-25T10:04:57.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.743+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:26 18.32 18:4def72d4:::10000000003.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df71400 con 0x55641df63c00 2024-04-25T10:04:57.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.744+0000 7fccb0999640 1 -- 172.21.15.7:0/2461398294 <== osd.3 v2:172.21.15.7:6824/3045538953 5 ==== osd_op_reply(26 10000000003.00000000 [call] v119'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55641e95a500 con 0x55641df63c00 2024-04-25T10:04:57.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.744+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:27 18.a 18:50000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df71800 con 0x55641df63c00 2024-04-25T10:04:57.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.744+0000 7fccb0999640 1 -- 172.21.15.7:0/2461398294 <== osd.3 v2:172.21.15.7:6824/3045538953 6 ==== osd_op_reply(27 [pgnls start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a500 con 0x55641df63c00 2024-04-25T10:04:57.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.744+0000 7fccab18e640 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x55641df7d000 0x55641df46680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.744+0000 7fccab18e640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:28 18.2a 18:54000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641eb10400 con 0x55641df7d000 2024-04-25T10:04:57.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.744+0000 7fccb0999640 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x55641df7d000 0x55641df46680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.745+0000 7fccb0999640 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x55641df7d000 0x55641df46680 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.745+0000 7fccb0999640 1 -- 172.21.15.7:0/2461398294 <== osd.4 v2:172.21.15.55:6808/2248155105 1 ==== osd_op_reply(28 [pgnls start_epoch 119 out=49b] v117'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a500 con 0x55641df7d000 2024-04-25T10:04:57.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.745+0000 7fccab98f640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:29 18.1a 18:58000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df62000 con 0x55641df63c00 2024-04-25T10:04:57.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.745+0000 7fccb0999640 1 -- 172.21.15.7:0/2461398294 <== osd.3 v2:172.21.15.7:6824/3045538953 7 ==== osd_op_reply(29 [pgnls start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a500 con 0x55641df63c00 2024-04-25T10:04:57.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.745+0000 7fccab18e640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:30 18.3a 18:5c000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641eb11800 con 0x55641eaad000 2024-04-25T10:04:57.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.746+0000 7fccb0198640 1 -- 172.21.15.7:0/2461398294 <== osd.0 v2:172.21.15.7:6800/4167741236 7 ==== osd_op_reply(30 [pgnls start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a000 con 0x55641eaad000 2024-04-25T10:04:57.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.746+0000 7fccab98f640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:31 18.6 18:60000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df63000 con 0x55641df7c400 2024-04-25T10:04:57.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.746+0000 7fccaf997640 1 -- 172.21.15.7:0/2461398294 <== osd.7 v2:172.21.15.55:6816/2960381217 3 ==== osd_op_reply(31 [pgnls start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a780 con 0x55641df7c400 2024-04-25T10:04:57.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.746+0000 7fccab18e640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:32 18.26 18:64000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df70400 con 0x55641df63400 2024-04-25T10:04:57.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.746+0000 7fccb0198640 1 -- 172.21.15.7:0/2461398294 <== osd.2 v2:172.21.15.7:6808/1173474863 5 ==== osd_op_reply(32 [pgnls start_epoch 119 out=49b] v117'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a000 con 0x55641df63400 2024-04-25T10:04:57.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.746+0000 7fccab98f640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:33 18.16 18:68000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df70000 con 0x55641df63c00 2024-04-25T10:04:57.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.747+0000 7fccb0999640 1 -- 172.21.15.7:0/2461398294 <== osd.3 v2:172.21.15.7:6824/3045538953 8 ==== osd_op_reply(33 [pgnls start_epoch 119 out=49b] v117'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a500 con 0x55641df63c00 2024-04-25T10:04:57.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.747+0000 7fccab18e640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:34 18.36 18:6c000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df62400 con 0x55641df62c00 2024-04-25T10:04:57.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.747+0000 7fccaf997640 1 -- 172.21.15.7:0/2461398294 <== osd.1 v2:172.21.15.7:6816/434435857 4 ==== osd_op_reply(34 [pgnls start_epoch 119 out=49b] v117'32 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a780 con 0x55641df62c00 2024-04-25T10:04:57.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.747+0000 7fccab98f640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:35 18.e 18:70000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641dbdac00 con 0x55641eaad000 2024-04-25T10:04:57.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.747+0000 7fccb0198640 1 -- 172.21.15.7:0/2461398294 <== osd.0 v2:172.21.15.7:6800/4167741236 8 ==== osd_op_reply(35 [pgnls start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a000 con 0x55641eaad000 2024-04-25T10:04:57.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.747+0000 7fccab18e640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:36 18.2e 18:74000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df63800 con 0x55641df63c00 2024-04-25T10:04:57.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.747+0000 7fccb0999640 1 -- 172.21.15.7:0/2461398294 <== osd.3 v2:172.21.15.7:6824/3045538953 9 ==== osd_op_reply(36 [pgnls start_epoch 119 out=49b] v117'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a500 con 0x55641df63c00 2024-04-25T10:04:57.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.747+0000 7fccab98f640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:37 18.1e 18:78000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df70c00 con 0x55641eaadc00 2024-04-25T10:04:57.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.748+0000 7fccb0999640 1 -- 172.21.15.7:0/2461398294 <== osd.5 v2:172.21.15.55:6800/2514169616 4 ==== osd_op_reply(37 [pgnls start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a500 con 0x55641eaadc00 2024-04-25T10:04:57.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.748+0000 7fccab18e640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:38 18.3e 18:7c000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df62800 con 0x55641df63c00 2024-04-25T10:04:57.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.748+0000 7fccb0999640 1 -- 172.21.15.7:0/2461398294 <== osd.3 v2:172.21.15.7:6824/3045538953 10 ==== osd_op_reply(38 [pgnls start_epoch 119 out=49b] v117'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a500 con 0x55641df63c00 2024-04-25T10:04:57.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.748+0000 7fccab98f640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:39 18.1 18:80000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df71000 con 0x55641df63c00 2024-04-25T10:04:57.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.748+0000 7fccb0999640 1 -- 172.21.15.7:0/2461398294 <== osd.3 v2:172.21.15.7:6824/3045538953 11 ==== osd_op_reply(39 [pgnls start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a500 con 0x55641df63c00 2024-04-25T10:04:57.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.748+0000 7fccab18e640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:40 18.21 18:84000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df7c000 con 0x55641eaadc00 2024-04-25T10:04:57.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.749+0000 7fccb0999640 1 -- 172.21.15.7:0/2461398294 <== osd.5 v2:172.21.15.55:6800/2514169616 5 ==== osd_op_reply(40 [pgnls start_epoch 119 out=49b] v117'24 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a500 con 0x55641eaadc00 2024-04-25T10:04:57.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.749+0000 7fccab98f640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:41 18.11 18:88000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df71400 con 0x55641df62c00 2024-04-25T10:04:57.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.749+0000 7fccaf997640 1 -- 172.21.15.7:0/2461398294 <== osd.1 v2:172.21.15.7:6816/434435857 5 ==== osd_op_reply(41 [pgnls start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a780 con 0x55641df62c00 2024-04-25T10:04:57.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.749+0000 7fccab18e640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:42 18.31 18:8c000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df7cc00 con 0x55641df7d000 2024-04-25T10:04:57.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.749+0000 7fccb0999640 1 -- 172.21.15.7:0/2461398294 <== osd.4 v2:172.21.15.55:6808/2248155105 2 ==== osd_op_reply(42 [pgnls start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a500 con 0x55641df7d000 2024-04-25T10:04:57.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.750+0000 7fccab98f640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:43 18.9 18:90000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df71800 con 0x55641df63c00 2024-04-25T10:04:57.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.750+0000 7fccb0999640 1 -- 172.21.15.7:0/2461398294 <== osd.3 v2:172.21.15.7:6824/3045538953 12 ==== osd_op_reply(43 [pgnls start_epoch 119 out=49b] v117'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a500 con 0x55641df63c00 2024-04-25T10:04:57.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.750+0000 7fccab18e640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:44 18.29 18:94000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df7c800 con 0x55641df7c400 2024-04-25T10:04:57.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.751+0000 7fccaf997640 1 -- 172.21.15.7:0/2461398294 <== osd.7 v2:172.21.15.55:6816/2960381217 4 ==== osd_op_reply(44 [pgnls start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a780 con 0x55641df7c400 2024-04-25T10:04:57.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.751+0000 7fccab98f640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:45 18.19 18:98000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df70000 con 0x55641df7d000 2024-04-25T10:04:57.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.751+0000 7fccb0999640 1 -- 172.21.15.7:0/2461398294 <== osd.4 v2:172.21.15.55:6808/2248155105 3 ==== osd_op_reply(45 [pgnls start_epoch 119 out=49b] v117'21 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a500 con 0x55641df7d000 2024-04-25T10:04:57.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.751+0000 7fccab18e640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:46 18.39 18:9c000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641eaac800 con 0x55641eaad000 2024-04-25T10:04:57.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.751+0000 7fccb0198640 1 -- 172.21.15.7:0/2461398294 <== osd.0 v2:172.21.15.7:6800/4167741236 9 ==== osd_op_reply(46 [pgnls start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a000 con 0x55641eaad000 2024-04-25T10:04:57.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.751+0000 7fccab98f640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:47 18.5 18:a0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df62000 con 0x55641df62c00 2024-04-25T10:04:57.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.751+0000 7fccaf997640 1 -- 172.21.15.7:0/2461398294 <== osd.1 v2:172.21.15.7:6816/434435857 6 ==== osd_op_reply(47 [pgnls start_epoch 119 out=81b] v118'11 uv11 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55641e95a780 con 0x55641df62c00 2024-04-25T10:04:57.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.751+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:48 18.5 18:a367a3e8:::10000000004.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df71c00 con 0x55641df62c00 2024-04-25T10:04:57.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.752+0000 7fccaf997640 1 -- 172.21.15.7:0/2461398294 <== osd.1 v2:172.21.15.7:6816/434435857 7 ==== osd_op_reply(48 10000000004.00000000 [stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55641e95a780 con 0x55641df62c00 2024-04-25T10:04:57.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.752+0000 7fccb33a8740 10 datascan.operator(): handling object 1099511627780.0 2024-04-25T10:04:57.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.752+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:49 18.5 18:a367a3e8:::10000000004.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df71400 con 0x55641df62c00 2024-04-25T10:04:57.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.753+0000 7fccaf997640 1 -- 172.21.15.7:0/2461398294 <== osd.1 v2:172.21.15.7:6816/434435857 8 ==== osd_op_reply(49 10000000004.00000000 [call] v119'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55641e95a780 con 0x55641df62c00 2024-04-25T10:04:57.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.753+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:50 18.25 18:a4000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df71c00 con 0x55641eb10000 2024-04-25T10:04:57.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.753+0000 7fccb0198640 1 -- 172.21.15.7:0/2461398294 <== osd.6 v2:172.21.15.55:6824/4293769515 4 ==== osd_op_reply(50 [pgnls start_epoch 119 out=81b] v119'16 uv16 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55641e95a000 con 0x55641eb10000 2024-04-25T10:04:57.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.753+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:51 18.25 18:a5feb6f3:::10000000006.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df70c00 con 0x55641eb10000 2024-04-25T10:04:57.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.754+0000 7fccb0198640 1 -- 172.21.15.7:0/2461398294 <== osd.6 v2:172.21.15.55:6824/4293769515 5 ==== osd_op_reply(51 10000000006.00000000 [stat out=16b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55641e95a000 con 0x55641eb10000 2024-04-25T10:04:57.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.754+0000 7fccb33a8740 10 datascan.operator(): handling object 1099511627782.0 2024-04-25T10:04:57.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.754+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:52 18.25 18:a5feb6f3:::10000000006.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df71000 con 0x55641eb10000 2024-04-25T10:04:57.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.755+0000 7fccb0198640 1 -- 172.21.15.7:0/2461398294 <== osd.6 v2:172.21.15.55:6824/4293769515 6 ==== osd_op_reply(52 10000000006.00000000 [call] v119'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55641e95a000 con 0x55641eb10000 2024-04-25T10:04:57.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.755+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:53 18.15 18:a8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df71800 con 0x55641eaadc00 2024-04-25T10:04:57.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.755+0000 7fccb0999640 1 -- 172.21.15.7:0/2461398294 <== osd.5 v2:172.21.15.55:6800/2514169616 6 ==== osd_op_reply(53 [pgnls start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a500 con 0x55641eaadc00 2024-04-25T10:04:57.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.755+0000 7fccab18e640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:54 18.35 18:ac000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641eaacc00 con 0x55641df7d000 2024-04-25T10:04:57.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.756+0000 7fccb0999640 1 -- 172.21.15.7:0/2461398294 <== osd.4 v2:172.21.15.55:6808/2248155105 4 ==== osd_op_reply(54 [pgnls start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a500 con 0x55641df7d000 2024-04-25T10:04:57.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.756+0000 7fccab98f640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:55 18.d 18:b0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df70800 con 0x55641df7d000 2024-04-25T10:04:57.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.756+0000 7fccb0999640 1 -- 172.21.15.7:0/2461398294 <== osd.4 v2:172.21.15.55:6808/2248155105 5 ==== osd_op_reply(55 [pgnls start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a500 con 0x55641df7d000 2024-04-25T10:04:57.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.756+0000 7fccab18e640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:56 18.2d 18:b4000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641eb10400 con 0x55641eb10000 2024-04-25T10:04:57.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.756+0000 7fccb0198640 1 -- 172.21.15.7:0/2461398294 <== osd.6 v2:172.21.15.55:6824/4293769515 7 ==== osd_op_reply(56 [pgnls start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a000 con 0x55641eb10000 2024-04-25T10:04:57.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.756+0000 7fccab98f640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:57 18.1d 18:b8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df70400 con 0x55641eaad000 2024-04-25T10:04:57.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.757+0000 7fccb0198640 1 -- 172.21.15.7:0/2461398294 <== osd.0 v2:172.21.15.7:6800/4167741236 10 ==== osd_op_reply(57 [pgnls start_epoch 119 out=49b] v117'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a000 con 0x55641eaad000 2024-04-25T10:04:57.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.757+0000 7fccab18e640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:58 18.3d 18:bc000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641eb11c00 con 0x55641df63c00 2024-04-25T10:04:57.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.757+0000 7fccb0999640 1 -- 172.21.15.7:0/2461398294 <== osd.3 v2:172.21.15.7:6824/3045538953 13 ==== osd_op_reply(58 [pgnls start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a500 con 0x55641df63c00 2024-04-25T10:04:57.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.757+0000 7fccab98f640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:59 18.3 18:c0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df71c00 con 0x55641df62c00 2024-04-25T10:04:57.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.757+0000 7fccaf997640 1 -- 172.21.15.7:0/2461398294 <== osd.1 v2:172.21.15.7:6816/434435857 9 ==== osd_op_reply(59 [pgnls start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a780 con 0x55641df62c00 2024-04-25T10:04:57.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.757+0000 7fccab18e640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:60 18.23 18:c4000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df7c800 con 0x55641df63400 2024-04-25T10:04:57.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.758+0000 7fccb0198640 1 -- 172.21.15.7:0/2461398294 <== osd.2 v2:172.21.15.7:6808/1173474863 6 ==== osd_op_reply(60 [pgnls start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a000 con 0x55641df63400 2024-04-25T10:04:57.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.758+0000 7fccab98f640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:61 18.13 18:c8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df70c00 con 0x55641df7c400 2024-04-25T10:04:57.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.758+0000 7fccaf997640 1 -- 172.21.15.7:0/2461398294 <== osd.7 v2:172.21.15.55:6816/2960381217 5 ==== osd_op_reply(61 [pgnls start_epoch 119 out=49b] v117'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a780 con 0x55641df7c400 2024-04-25T10:04:57.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.758+0000 7fccab18e640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:62 18.33 18:cc000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df7c000 con 0x55641df62c00 2024-04-25T10:04:57.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.758+0000 7fccaf997640 1 -- 172.21.15.7:0/2461398294 <== osd.1 v2:172.21.15.7:6816/434435857 10 ==== osd_op_reply(62 [pgnls start_epoch 119 out=49b] v117'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a780 con 0x55641df62c00 2024-04-25T10:04:57.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.758+0000 7fccab98f640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:63 18.b 18:d0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641eaac800 con 0x55641eaadc00 2024-04-25T10:04:57.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.758+0000 7fccb0999640 1 -- 172.21.15.7:0/2461398294 <== osd.5 v2:172.21.15.55:6800/2514169616 7 ==== osd_op_reply(63 [pgnls start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a500 con 0x55641eaadc00 2024-04-25T10:04:57.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.759+0000 7fccab18e640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:64 18.2b 18:d4000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df7cc00 con 0x55641df7c400 2024-04-25T10:04:57.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.759+0000 7fccaf997640 1 -- 172.21.15.7:0/2461398294 <== osd.7 v2:172.21.15.55:6816/2960381217 6 ==== osd_op_reply(64 [pgnls start_epoch 119 out=49b] v117'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a780 con 0x55641df7c400 2024-04-25T10:04:57.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.759+0000 7fccab98f640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:65 18.1b 18:d8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641dbdac00 con 0x55641df62c00 2024-04-25T10:04:57.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.759+0000 7fccaf997640 1 -- 172.21.15.7:0/2461398294 <== osd.1 v2:172.21.15.7:6816/434435857 11 ==== osd_op_reply(65 [pgnls start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a780 con 0x55641df62c00 2024-04-25T10:04:57.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.759+0000 7fccab18e640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:66 18.3b 18:dc000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df7d400 con 0x55641df7d000 2024-04-25T10:04:57.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.759+0000 7fccb0999640 1 -- 172.21.15.7:0/2461398294 <== osd.4 v2:172.21.15.55:6808/2248155105 6 ==== osd_op_reply(66 [pgnls start_epoch 119 out=49b] v117'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a500 con 0x55641df7d000 2024-04-25T10:04:57.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.759+0000 7fccab98f640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:67 18.7 18:e0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641eb11800 con 0x55641df63400 2024-04-25T10:04:57.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.760+0000 7fccb0198640 1 -- 172.21.15.7:0/2461398294 <== osd.2 v2:172.21.15.7:6808/1173474863 7 ==== osd_op_reply(67 [pgnls start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a000 con 0x55641df63400 2024-04-25T10:04:57.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.760+0000 7fccab18e640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:68 18.27 18:e4000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df7d800 con 0x55641eaadc00 2024-04-25T10:04:57.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.760+0000 7fccb0999640 1 -- 172.21.15.7:0/2461398294 <== osd.5 v2:172.21.15.55:6800/2514169616 8 ==== osd_op_reply(68 [pgnls start_epoch 119 out=49b] v117'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a500 con 0x55641eaadc00 2024-04-25T10:04:57.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.760+0000 7fccab98f640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:69 18.17 18:e8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df92000 con 0x55641eaadc00 2024-04-25T10:04:57.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.760+0000 7fccb0999640 1 -- 172.21.15.7:0/2461398294 <== osd.5 v2:172.21.15.55:6800/2514169616 9 ==== osd_op_reply(69 [pgnls start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a500 con 0x55641eaadc00 2024-04-25T10:04:57.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.760+0000 7fccab18e640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:70 18.37 18:ec000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df7dc00 con 0x55641df7c400 2024-04-25T10:04:57.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.761+0000 7fccaf997640 1 -- 172.21.15.7:0/2461398294 <== osd.7 v2:172.21.15.55:6816/2960381217 7 ==== osd_op_reply(70 [pgnls start_epoch 119 out=49b] v117'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a780 con 0x55641df7c400 2024-04-25T10:04:57.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.761+0000 7fccab98f640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:71 18.f 18:f0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df92400 con 0x55641eaadc00 2024-04-25T10:04:57.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.761+0000 7fccb0999640 1 -- 172.21.15.7:0/2461398294 <== osd.5 v2:172.21.15.55:6800/2514169616 10 ==== osd_op_reply(71 [pgnls start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a500 con 0x55641eaadc00 2024-04-25T10:04:57.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.761+0000 7fccab18e640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:72 18.2f 18:f4000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df70000 con 0x55641df62c00 2024-04-25T10:04:57.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.761+0000 7fccaf997640 1 -- 172.21.15.7:0/2461398294 <== osd.1 v2:172.21.15.7:6816/434435857 12 ==== osd_op_reply(72 [pgnls start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a780 con 0x55641df62c00 2024-04-25T10:04:57.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.761+0000 7fccab98f640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:73 18.1f 18:f8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df92800 con 0x55641df7c400 2024-04-25T10:04:57.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.762+0000 7fccaf997640 1 -- 172.21.15.7:0/2461398294 <== osd.7 v2:172.21.15.55:6816/2960381217 8 ==== osd_op_reply(73 [pgnls start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a780 con 0x55641df7c400 2024-04-25T10:04:57.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.762+0000 7fccab18e640 1 -- 172.21.15.7:0/2461398294 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:74 18.3f 18:fc000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x55641df71800 con 0x55641df7d000 2024-04-25T10:04:57.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.762+0000 7fccb0999640 1 -- 172.21.15.7:0/2461398294 <== osd.4 v2:172.21.15.55:6808/2248155105 7 ==== osd_op_reply(74 [pgnls start_epoch 119 out=49b] v117'17 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55641e95a500 con 0x55641df7d000 2024-04-25T10:04:57.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.762+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x55641eaad000 msgr2=0x55641dc4c680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.762+0000 7fccb33a8740 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x55641eaad000 0x55641dc4c680 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.762+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x55641df62c00 msgr2=0x55641df45080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.762+0000 7fccb33a8740 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x55641df62c00 0x55641df45080 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.762+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x55641df63400 msgr2=0x55641df45b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.762+0000 7fccb33a8740 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x55641df63400 0x55641df45b80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.762+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x55641df63c00 msgr2=0x55641dc4c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.762+0000 7fccb33a8740 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x55641df63c00 0x55641dc4c100 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.762+0000 7fccb0198640 1 -- 172.21.15.7:0/2461398294 reap_dead start 2024-04-25T10:04:57.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.762+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x55641df7d000 msgr2=0x55641df46680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.762+0000 7fccb33a8740 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x55641df7d000 0x55641df46680 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.762+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x55641eaadc00 msgr2=0x55641df44580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.762+0000 7fccb33a8740 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x55641eaadc00 0x55641df44580 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.762+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x55641eb10000 msgr2=0x55641df44b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.762+0000 7fccb33a8740 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x55641eb10000 0x55641df44b00 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.762+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x55641df7c400 msgr2=0x55641df46100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.762+0000 7fccb33a8740 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x55641df7c400 0x55641df46100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.762+0000 7fccb0198640 1 -- 172.21.15.7:0/2461398294 reap_dead start 2024-04-25T10:04:57.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.762+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x55641eb11400 msgr2=0x55641df44000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.762+0000 7fccb33a8740 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x55641eb11400 0x55641df44000 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x55641e96f1d0 tx=0x55641e96cf00 comp rx=0 tx=0).stop 2024-04-25T10:04:57.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.762+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55641eaad400 msgr2=0x55641dc4cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.762+0000 7fccb33a8740 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55641eaad400 0x55641dc4cc00 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x55641eac9ce0 tx=0x55641e95f4a0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.762+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 shutdown_connections 2024-04-25T10:04:57.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.762+0000 7fccb33a8740 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x55641eb11400 0x55641df44000 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.762+0000 7fccb33a8740 1 --2- 172.21.15.7:0/2461398294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55641eaad400 0x55641dc4cc00 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.762+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 >> 172.21.15.7:0/2461398294 conn(0x55641e96a000 msgr2=0x55641dcd5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:57.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.762+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 shutdown_connections 2024-04-25T10:04:57.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.762+0000 7fccb33a8740 1 -- 172.21.15.7:0/2461398294 wait complete. 2024-04-25T10:04:57.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.763+0000 7fccb33a8740 1 -- 172.21.15.7:0/551973318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55641dbdbc00 msgr2=0x55641dc4ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.763+0000 7fccb33a8740 1 --2- 172.21.15.7:0/551973318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55641dbdbc00 0x55641dc4ab00 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x55641ea01aa0 tx=0x55641dd4e120 comp rx=0 tx=0).stop 2024-04-25T10:04:57.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.763+0000 7fccb33a8740 1 -- 172.21.15.7:0/551973318 shutdown_connections 2024-04-25T10:04:57.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.763+0000 7fccb33a8740 1 --2- 172.21.15.7:0/551973318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55641e96bc00 0x55641dc4b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.763+0000 7fccb33a8740 1 --2- 172.21.15.7:0/551973318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55641dbdbc00 0x55641dc4ab00 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.763+0000 7fccb33a8740 1 --2- 172.21.15.7:0/551973318 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x55641e96a800 0x55641dc4bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.763+0000 7fccb33a8740 1 -- 172.21.15.7:0/551973318 >> 172.21.15.7:0/551973318 conn(0x55641dbdb000 msgr2=0x55641dcd4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:57.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.763+0000 7fccb33a8740 1 -- 172.21.15.7:0/551973318 shutdown_connections 2024-04-25T10:04:57.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.763+0000 7fccb33a8740 1 -- 172.21.15.7:0/551973318 wait complete. 2024-04-25T10:04:57.779 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', 'cephfs_data'] in time 0:00:00.129151, result: 2024-04-25T10:04:57.779 DEBUG:teuthology.orchestra.run.smithi007:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes --filter-tag mytag123 cephfs_data 2024-04-25T10:04:57.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.851+0000 7f850222d740 1 -- start start 2024-04-25T10:04:57.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.851+0000 7f850222d740 1 Processor -- start 2024-04-25T10:04:57.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.851+0000 7f850222d740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555c81a40c00 0x555c81ab0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.851+0000 7f850222d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c81a41800 0x555c81ab0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.851+0000 7f850222d740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555c81a41c00 0x555c81ab1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.851+0000 7f850222d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c82908180 con 0x555c81a41800 2024-04-25T10:04:57.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.851+0000 7f850222d740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c82908300 con 0x555c81a41c00 2024-04-25T10:04:57.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.851+0000 7f850222d740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x555c82908480 con 0x555c81a40c00 2024-04-25T10:04:57.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.852+0000 7f84ff2e2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c81a41800 0x555c81ab0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.852+0000 7f84ff2e2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c81a41800 0x555c81ab0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47728/0 (socket says 172.21.15.7:47728) 2024-04-25T10:04:57.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.852+0000 7f84ff2e2640 1 -- 172.21.15.7:0/1924324313 learned_addr learned my addr 172.21.15.7:0/1924324313 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:57.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.852+0000 7f85002e4640 1 --2- 172.21.15.7:0/1924324313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555c81a41c00 0x555c81ab1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.852+0000 7f84ffae3640 1 --2- 172.21.15.7:0/1924324313 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555c81a40c00 0x555c81ab0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.852+0000 7f84ff2e2640 1 -- 172.21.15.7:0/1924324313 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555c81a40c00 msgr2=0x555c81ab0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:57.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.852+0000 7f84ff2e2640 1 --2- 172.21.15.7:0/1924324313 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555c81a40c00 0x555c81ab0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.852+0000 7f84ff2e2640 1 -- 172.21.15.7:0/1924324313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555c81a41c00 msgr2=0x555c81ab1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:57.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.852+0000 7f84ff2e2640 1 --2- 172.21.15.7:0/1924324313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555c81a41c00 0x555c81ab1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.852+0000 7f84ff2e2640 1 -- 172.21.15.7:0/1924324313 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c81a6d680 con 0x555c81a41800 2024-04-25T10:04:57.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.852+0000 7f85002e4640 1 --2- 172.21.15.7:0/1924324313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555c81a41c00 0x555c81ab1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:57.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.852+0000 7f84ff2e2640 1 --2- 172.21.15.7:0/1924324313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c81a41800 0x555c81ab0b00 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x555c82861200 tx=0x555c827c4900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e48114fa1b2586f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.852+0000 7f84fd2de640 1 -- 172.21.15.7:0/1924324313 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555c81a669c0 con 0x555c81a41800 2024-04-25T10:04:57.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.852+0000 7f84fd2de640 1 -- 172.21.15.7:0/1924324313 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555c81a8ae00 con 0x555c81a41800 2024-04-25T10:04:57.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.852+0000 7f850222d740 1 -- 172.21.15.7:0/1924324313 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555c81a6d860 con 0x555c81a41800 2024-04-25T10:04:57.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.852+0000 7f850222d740 1 -- 172.21.15.7:0/1924324313 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x555c81a6d2c0 con 0x555c81a41800 2024-04-25T10:04:57.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.852+0000 7f850222d740 4 waiting for MDS map... 2024-04-25T10:04:57.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.852+0000 7f84fd2de640 1 -- 172.21.15.7:0/1924324313 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555c81a66680 con 0x555c81a41800 2024-04-25T10:04:57.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.852+0000 7f84fd2de640 1 -- 172.21.15.7:0/1924324313 <== mon.0 v2:172.21.15.7:3300/0 4 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x555c8281e000 con 0x555c81a41800 2024-04-25T10:04:57.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.853+0000 7f84fd2de640 1 -- 172.21.15.7:0/1924324313 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 95) v1 ==== 2723+0+0 (secure 0 0 0) 0x555c81a99180 con 0x555c81a41800 2024-04-25T10:04:57.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.853+0000 7f850222d740 4 Got MDS map 95 2024-04-25T10:04:57.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.853+0000 7f850222d740 10 datascan.parse_kwarg: Applying tag filter: 'mytag123' 2024-04-25T10:04:57.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.853+0000 7f850222d740 4 datascan.main: Using metadata pool output 2024-04-25T10:04:57.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.853+0000 7f850222d740 4 datascan.main: connecting to RADOS... 2024-04-25T10:04:57.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.853+0000 7f850222d740 1 Processor -- start 2024-04-25T10:04:57.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.853+0000 7f850222d740 1 -- start start 2024-04-25T10:04:57.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.854+0000 7f850222d740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555c82829c00 0x555c81ab1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.854+0000 7f850222d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c82966000 0x555c81ab1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.854+0000 7f850222d740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555c82966400 0x555c81ab2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.854+0000 7f850222d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c82908600 con 0x555c82966000 2024-04-25T10:04:57.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.854+0000 7f850222d740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c82908780 con 0x555c82829c00 2024-04-25T10:04:57.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.854+0000 7f850222d740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x555c82908900 con 0x555c82966400 2024-04-25T10:04:57.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.854+0000 7f84ffae3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c82966000 0x555c81ab1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.854+0000 7f84ffae3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c82966000 0x555c81ab1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47744/0 (socket says 172.21.15.7:47744) 2024-04-25T10:04:57.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.854+0000 7f84ffae3640 1 -- 172.21.15.7:0/2717178850 learned_addr learned my addr 172.21.15.7:0/2717178850 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:57.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.854+0000 7f84ff2e2640 1 --2- 172.21.15.7:0/2717178850 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555c82966400 0x555c81ab2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.854+0000 7f85002e4640 1 --2- 172.21.15.7:0/2717178850 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555c82829c00 0x555c81ab1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.854+0000 7f84ffae3640 1 -- 172.21.15.7:0/2717178850 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555c82966400 msgr2=0x555c81ab2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:57.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.854+0000 7f84ffae3640 1 --2- 172.21.15.7:0/2717178850 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555c82966400 0x555c81ab2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.854+0000 7f84ffae3640 1 -- 172.21.15.7:0/2717178850 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555c82829c00 msgr2=0x555c81ab1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:57.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.854+0000 7f84ffae3640 1 --2- 172.21.15.7:0/2717178850 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555c82829c00 0x555c81ab1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.854+0000 7f84ffae3640 1 -- 172.21.15.7:0/2717178850 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c81a6d4a0 con 0x555c82966000 2024-04-25T10:04:57.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.854+0000 7f84ffae3640 1 --2- 172.21.15.7:0/2717178850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c82966000 0x555c81ab1b80 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x555c8291a810 tx=0x555c827d0300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f7081f68909136e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.855+0000 7f84fb2da640 1 -- 172.21.15.7:0/2717178850 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555c81a669c0 con 0x555c82966000 2024-04-25T10:04:57.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.855+0000 7f84fb2da640 1 -- 172.21.15.7:0/2717178850 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555c81a8a540 con 0x555c82966000 2024-04-25T10:04:57.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.855+0000 7f84fb2da640 1 -- 172.21.15.7:0/2717178850 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555c81a66680 con 0x555c82966000 2024-04-25T10:04:57.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.855+0000 7f850222d740 1 -- 172.21.15.7:0/2717178850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c82966000 msgr2=0x555c81ab1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.855+0000 7f850222d740 1 --2- 172.21.15.7:0/2717178850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c82966000 0x555c81ab1b80 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x555c8291a810 tx=0x555c827d0300 comp rx=0 tx=0).stop 2024-04-25T10:04:57.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.855+0000 7f850222d740 1 -- 172.21.15.7:0/2717178850 shutdown_connections 2024-04-25T10:04:57.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.855+0000 7f850222d740 1 --2- 172.21.15.7:0/2717178850 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555c82966400 0x555c81ab2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.855+0000 7f850222d740 1 --2- 172.21.15.7:0/2717178850 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c82966000 0x555c81ab1b80 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.855+0000 7f850222d740 1 --2- 172.21.15.7:0/2717178850 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555c82829c00 0x555c81ab1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.855+0000 7f850222d740 1 -- 172.21.15.7:0/2717178850 >> 172.21.15.7:0/2717178850 conn(0x555c82829800 msgr2=0x555c81b3b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:57.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.855+0000 7f850222d740 1 -- 172.21.15.7:0/2717178850 shutdown_connections 2024-04-25T10:04:57.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.855+0000 7f850222d740 1 -- 172.21.15.7:0/2717178850 wait complete. 2024-04-25T10:04:57.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.856+0000 7f850222d740 1 Processor -- start 2024-04-25T10:04:57.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.856+0000 7f850222d740 1 -- start start 2024-04-25T10:04:57.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.856+0000 7f850222d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c82829800 0x555c81ab3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.856+0000 7f850222d740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555c82967000 0x555c81ab2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.856+0000 7f850222d740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555c82966c00 0x555c81ab2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.856+0000 7f850222d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c82909c80 con 0x555c82829800 2024-04-25T10:04:57.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.856+0000 7f850222d740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c82909b00 con 0x555c82967000 2024-04-25T10:04:57.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.856+0000 7f850222d740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x555c82909980 con 0x555c82966c00 2024-04-25T10:04:57.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.856+0000 7f85002e4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c82829800 0x555c81ab3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.856+0000 7f85002e4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c82829800 0x555c81ab3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47746/0 (socket says 172.21.15.7:47746) 2024-04-25T10:04:57.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.856+0000 7f85002e4640 1 -- 172.21.15.7:0/319897527 learned_addr learned my addr 172.21.15.7:0/319897527 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:57.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.857+0000 7f84ffae3640 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555c82967000 0x555c81ab2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.857+0000 7f84ff2e2640 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555c82966c00 0x555c81ab2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.857+0000 7f85002e4640 1 -- 172.21.15.7:0/319897527 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555c82966c00 msgr2=0x555c81ab2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.857+0000 7f85002e4640 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555c82966c00 0x555c81ab2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.857+0000 7f85002e4640 1 -- 172.21.15.7:0/319897527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555c82967000 msgr2=0x555c81ab2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.857+0000 7f85002e4640 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555c82967000 0x555c81ab2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.857+0000 7f85002e4640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c81a6d0e0 con 0x555c82829800 2024-04-25T10:04:57.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.857+0000 7f84ff2e2640 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555c82966c00 0x555c81ab2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:57.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.857+0000 7f85002e4640 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c82829800 0x555c81ab3180 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x555c8291bad0 tx=0x555c827d0420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.857+0000 7f84f9ad7640 1 -- 172.21.15.7:0/319897527 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555c81a669c0 con 0x555c82829800 2024-04-25T10:04:57.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.857+0000 7f84f9ad7640 1 -- 172.21.15.7:0/319897527 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555c81a8aa80 con 0x555c82829800 2024-04-25T10:04:57.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.857+0000 7f850222d740 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555c81a6da40 con 0x555c82829800 2024-04-25T10:04:57.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.857+0000 7f84f9ad7640 1 -- 172.21.15.7:0/319897527 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555c81a66680 con 0x555c82829800 2024-04-25T10:04:57.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.857+0000 7f850222d740 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555c81a6c3c0 con 0x555c82829800 2024-04-25T10:04:57.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.857+0000 7f850222d740 4 datascan.init: resolving metadata pool 17 2024-04-25T10:04:57.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.858+0000 7f84f9ad7640 1 -- 172.21.15.7:0/319897527 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x555c82986c00 con 0x555c82829800 2024-04-25T10:04:57.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.859+0000 7f84f9ad7640 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x555c82988c00 0x555c81ab3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.859+0000 7f84f9ad7640 1 -- 172.21.15.7:0/319897527 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x555c82981000 con 0x555c82829800 2024-04-25T10:04:57.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.859+0000 7f84ffae3640 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x555c82988c00 0x555c81ab3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.859+0000 7f850222d740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T10:04:57.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.859+0000 7f850222d740 4 datascan.main: data pool 'cephfs_data' has ID 18 2024-04-25T10:04:57.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.859+0000 7f850222d740 4 datascan.main: opening data pool 'cephfs_data' 2024-04-25T10:04:57.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.859+0000 7f850222d740 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x555c82966800 0x555c81ab2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.859+0000 7f850222d740 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:1 17.14 17:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c82966400 con 0x555c82966800 2024-04-25T10:04:57.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.859+0000 7f84ff2e2640 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x555c82966800 0x555c81ab2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.859+0000 7f84ffae3640 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x555c82988c00 0x555c81ab3700 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x555c8291a810 tx=0x555c81b02f00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.859+0000 7f84ff2e2640 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x555c82966800 0x555c81ab2100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.859+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.3 v2:172.21.15.7:6824/3045538953 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv34 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x555c827c0000 con 0x555c82966800 2024-04-25T10:04:57.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.860+0000 7f850222d740 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x555c82966000 0x555c81ab1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.860+0000 7f850222d740 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:2 17.1f 17:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c82989000 con 0x555c82966000 2024-04-25T10:04:57.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.860+0000 7f85002e4640 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x555c82966000 0x555c81ab1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.860+0000 7f85002e4640 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x555c82966000 0x555c81ab1b80 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.861+0000 7f85002e4640 1 -- 172.21.15.7:0/319897527 <== osd.6 v2:172.21.15.55:6824/4293769515 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+16 (crc 0 0 0) 0x555c827c0500 con 0x555c82966000 2024-04-25T10:04:57.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.861+0000 7f850222d740 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x555c82989400 0x555c81ab1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.861+0000 7f850222d740 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:3 18.0 18:00000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c82989800 con 0x555c82989400 2024-04-25T10:04:57.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.861+0000 7f84ffae3640 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x555c82989400 0x555c81ab1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.861+0000 7f84ffae3640 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x555c82989400 0x555c81ab1600 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.861+0000 7f84ffae3640 1 -- 172.21.15.7:0/319897527 <== osd.0 v2:172.21.15.7:6800/4167741236 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0780 con 0x555c82989400 2024-04-25T10:04:57.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.861+0000 7f84faad9640 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x555c81dca000 0x555c81dd0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.861+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:4 18.20 18:04000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81dca400 con 0x555c81dca000 2024-04-25T10:04:57.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.862+0000 7f84ff2e2640 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x555c81dca000 0x555c81dd0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.862+0000 7f84ff2e2640 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x555c81dca000 0x555c81dd0000 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.862+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.5 v2:172.21.15.55:6800/2514169616 1 ==== osd_op_reply(4 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c81dca000 2024-04-25T10:04:57.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.862+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:5 18.10 18:08000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81dcac00 con 0x555c82966000 2024-04-25T10:04:57.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.863+0000 7f85002e4640 1 -- 172.21.15.7:0/319897527 <== osd.6 v2:172.21.15.55:6824/4293769515 2 ==== osd_op_reply(5 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0500 con 0x555c82966000 2024-04-25T10:04:57.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.863+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:6 18.30 18:0c000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81dca800 con 0x555c82989400 2024-04-25T10:04:57.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.863+0000 7f84ffae3640 1 -- 172.21.15.7:0/319897527 <== osd.0 v2:172.21.15.7:6800/4167741236 2 ==== osd_op_reply(6 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0780 con 0x555c82989400 2024-04-25T10:04:57.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.863+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:7 18.8 18:10000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81dcb000 con 0x555c82989400 2024-04-25T10:04:57.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.863+0000 7f84ffae3640 1 -- 172.21.15.7:0/319897527 <== osd.0 v2:172.21.15.7:6800/4167741236 3 ==== osd_op_reply(7 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0780 con 0x555c82989400 2024-04-25T10:04:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.863+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:8 18.28 18:14000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81dca800 con 0x555c81dca000 2024-04-25T10:04:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.863+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.5 v2:172.21.15.55:6800/2514169616 2 ==== osd_op_reply(8 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c81dca000 2024-04-25T10:04:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.864+0000 7f84fb2da640 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x555c81dcb400 0x555c81dd0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.864+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:9 18.18 18:18000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81dcb000 con 0x555c81dcb400 2024-04-25T10:04:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.864+0000 7f85002e4640 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x555c81dcb400 0x555c81dd0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.864+0000 7f85002e4640 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x555c81dcb400 0x555c81dd0580 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.864+0000 7f85002e4640 1 -- 172.21.15.7:0/319897527 <== osd.1 v2:172.21.15.7:6816/434435857 1 ==== osd_op_reply(9 [pgnls-filter start_epoch 119 out=49b] v117'17 uv9 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0500 con 0x555c81dcb400 2024-04-25T10:04:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.864+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:10 18.38 18:1c000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c82989800 con 0x555c82966800 2024-04-25T10:04:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.864+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.3 v2:172.21.15.7:6824/3045538953 2 ==== osd_op_reply(10 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c82966800 2024-04-25T10:04:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.864+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:11 18.4 18:20000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81dcb800 con 0x555c82989400 2024-04-25T10:04:57.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.865+0000 7f84ffae3640 1 -- 172.21.15.7:0/319897527 <== osd.0 v2:172.21.15.7:6800/4167741236 4 ==== osd_op_reply(11 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0780 con 0x555c82989400 2024-04-25T10:04:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.865+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:12 18.24 18:24000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c82967c00 con 0x555c82989400 2024-04-25T10:04:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.865+0000 7f84ffae3640 1 -- 172.21.15.7:0/319897527 <== osd.0 v2:172.21.15.7:6800/4167741236 5 ==== osd_op_reply(12 [pgnls-filter start_epoch 119 out=49b] v117'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0780 con 0x555c82989400 2024-04-25T10:04:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.865+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:13 18.14 18:28000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81dcbc00 con 0x555c82966000 2024-04-25T10:04:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.865+0000 7f85002e4640 1 -- 172.21.15.7:0/319897527 <== osd.6 v2:172.21.15.55:6824/4293769515 3 ==== osd_op_reply(13 [pgnls-filter start_epoch 119 out=49b] v117'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0500 con 0x555c82966000 2024-04-25T10:04:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.865+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:14 18.34 18:2c000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81dcac00 con 0x555c82989400 2024-04-25T10:04:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.866+0000 7f84ffae3640 1 -- 172.21.15.7:0/319897527 <== osd.0 v2:172.21.15.7:6800/4167741236 6 ==== osd_op_reply(14 [pgnls-filter start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0780 con 0x555c82989400 2024-04-25T10:04:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.866+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:15 18.c 18:30000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c82989000 con 0x555c81dca000 2024-04-25T10:04:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.866+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.5 v2:172.21.15.55:6800/2514169616 3 ==== osd_op_reply(15 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c81dca000 2024-04-25T10:04:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.866+0000 7f84faad9640 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x555c81dcb000 0x555c81dd0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.866+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:16 18.2c 18:34000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c82966400 con 0x555c81dcb000 2024-04-25T10:04:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.866+0000 7f84ffae3640 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x555c81dcb000 0x555c81dd0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.867+0000 7f84ffae3640 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x555c81dcb000 0x555c81dd0b00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.867+0000 7f84ffae3640 1 -- 172.21.15.7:0/319897527 <== osd.2 v2:172.21.15.7:6808/1173474863 1 ==== osd_op_reply(16 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0780 con 0x555c81dcb000 2024-04-25T10:04:57.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.867+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:17 18.1c 18:38000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81dcbc00 con 0x555c81dcb400 2024-04-25T10:04:57.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.867+0000 7f85002e4640 1 -- 172.21.15.7:0/319897527 <== osd.1 v2:172.21.15.7:6816/434435857 2 ==== osd_op_reply(17 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0500 con 0x555c81dcb400 2024-04-25T10:04:57.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.867+0000 7f84faad9640 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x555c82829400 0x555c81dd1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.867+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:18 18.3c 18:3c000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c82989800 con 0x555c82829400 2024-04-25T10:04:57.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.867+0000 7f84ff2e2640 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x555c82829400 0x555c81dd1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.868+0000 7f84ff2e2640 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x555c82829400 0x555c81dd1080 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.868+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.7 v2:172.21.15.55:6816/2960381217 1 ==== osd_op_reply(18 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c82829400 2024-04-25T10:04:57.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.868+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:19 18.2 18:40000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81dca400 con 0x555c82829400 2024-04-25T10:04:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.868+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.7 v2:172.21.15.55:6816/2960381217 2 ==== osd_op_reply(19 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c82829400 2024-04-25T10:04:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.868+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:20 18.22 18:44000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81de8000 con 0x555c82966800 2024-04-25T10:04:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.869+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.3 v2:172.21.15.7:6824/3045538953 3 ==== osd_op_reply(20 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c82966800 2024-04-25T10:04:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.869+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:21 18.12 18:48000000::::head [pgnls-filter start_epoch 119 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81dca800 con 0x555c81dcb000 2024-04-25T10:04:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.869+0000 7f84ffae3640 1 -- 172.21.15.7:0/319897527 <== osd.2 v2:172.21.15.7:6808/1173474863 2 ==== osd_op_reply(21 [pgnls-filter start_epoch 119 out=81b] v119'23 uv23 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x555c827c0780 con 0x555c81dcb000 2024-04-25T10:04:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.869+0000 7f850222d740 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:22 18.0 18:00000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c82989c00 con 0x555c82989400 2024-04-25T10:04:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.869+0000 7f84ffae3640 1 -- 172.21.15.7:0/319897527 <== osd.0 v2:172.21.15.7:6800/4167741236 7 ==== osd_op_reply(22 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0780 con 0x555c82989400 2024-04-25T10:04:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.869+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:23 18.20 18:04000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81dcb800 con 0x555c81dca000 2024-04-25T10:04:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.870+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.5 v2:172.21.15.55:6800/2514169616 4 ==== osd_op_reply(23 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c81dca000 2024-04-25T10:04:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.870+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:24 18.10 18:08000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81de8400 con 0x555c82966000 2024-04-25T10:04:57.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.870+0000 7f85002e4640 1 -- 172.21.15.7:0/319897527 <== osd.6 v2:172.21.15.55:6824/4293769515 4 ==== osd_op_reply(24 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0500 con 0x555c82966000 2024-04-25T10:04:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.870+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:25 18.30 18:0c000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81dcac00 con 0x555c82989400 2024-04-25T10:04:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.870+0000 7f84ffae3640 1 -- 172.21.15.7:0/319897527 <== osd.0 v2:172.21.15.7:6800/4167741236 8 ==== osd_op_reply(25 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0780 con 0x555c82989400 2024-04-25T10:04:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.870+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:26 18.8 18:10000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81de8800 con 0x555c82989400 2024-04-25T10:04:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.870+0000 7f84ffae3640 1 -- 172.21.15.7:0/319897527 <== osd.0 v2:172.21.15.7:6800/4167741236 9 ==== osd_op_reply(26 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0780 con 0x555c82989400 2024-04-25T10:04:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.870+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:27 18.28 18:14000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81dca800 con 0x555c81dca000 2024-04-25T10:04:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.871+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.5 v2:172.21.15.55:6800/2514169616 5 ==== osd_op_reply(27 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c81dca000 2024-04-25T10:04:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.871+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:28 18.18 18:18000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81de8c00 con 0x555c81dcb400 2024-04-25T10:04:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.871+0000 7f85002e4640 1 -- 172.21.15.7:0/319897527 <== osd.1 v2:172.21.15.7:6816/434435857 3 ==== osd_op_reply(28 [pgnls-filter start_epoch 119 out=49b] v117'17 uv9 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0500 con 0x555c81dcb400 2024-04-25T10:04:57.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.871+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:29 18.38 18:1c000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c82967c00 con 0x555c82966800 2024-04-25T10:04:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.872+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.3 v2:172.21.15.7:6824/3045538953 4 ==== osd_op_reply(29 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c82966800 2024-04-25T10:04:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.872+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:30 18.4 18:20000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81de9000 con 0x555c82989400 2024-04-25T10:04:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.872+0000 7f84ffae3640 1 -- 172.21.15.7:0/319897527 <== osd.0 v2:172.21.15.7:6800/4167741236 10 ==== osd_op_reply(30 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0780 con 0x555c82989400 2024-04-25T10:04:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.872+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:31 18.24 18:24000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c82966400 con 0x555c82989400 2024-04-25T10:04:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.872+0000 7f84ffae3640 1 -- 172.21.15.7:0/319897527 <== osd.0 v2:172.21.15.7:6800/4167741236 11 ==== osd_op_reply(31 [pgnls-filter start_epoch 119 out=49b] v117'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0780 con 0x555c82989400 2024-04-25T10:04:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.872+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:32 18.14 18:28000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81de9400 con 0x555c82966000 2024-04-25T10:04:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.872+0000 7f85002e4640 1 -- 172.21.15.7:0/319897527 <== osd.6 v2:172.21.15.55:6824/4293769515 5 ==== osd_op_reply(32 [pgnls-filter start_epoch 119 out=49b] v117'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0500 con 0x555c82966000 2024-04-25T10:04:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.872+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:33 18.34 18:2c000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81de8000 con 0x555c82989400 2024-04-25T10:04:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.873+0000 7f84ffae3640 1 -- 172.21.15.7:0/319897527 <== osd.0 v2:172.21.15.7:6800/4167741236 12 ==== osd_op_reply(33 [pgnls-filter start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0780 con 0x555c82989400 2024-04-25T10:04:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.873+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:34 18.c 18:30000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81de8800 con 0x555c81dca000 2024-04-25T10:04:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.873+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.5 v2:172.21.15.55:6800/2514169616 6 ==== osd_op_reply(34 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c81dca000 2024-04-25T10:04:57.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.873+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:35 18.2c 18:34000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81dca400 con 0x555c81dcb000 2024-04-25T10:04:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.874+0000 7f84ffae3640 1 -- 172.21.15.7:0/319897527 <== osd.2 v2:172.21.15.7:6808/1173474863 3 ==== osd_op_reply(35 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0780 con 0x555c81dcb000 2024-04-25T10:04:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.874+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:36 18.1c 18:38000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81de9000 con 0x555c81dcb400 2024-04-25T10:04:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.874+0000 7f85002e4640 1 -- 172.21.15.7:0/319897527 <== osd.1 v2:172.21.15.7:6816/434435857 4 ==== osd_op_reply(36 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0500 con 0x555c81dcb400 2024-04-25T10:04:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.874+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:37 18.3c 18:3c000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81dcb800 con 0x555c82829400 2024-04-25T10:04:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.874+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.7 v2:172.21.15.55:6816/2960381217 3 ==== osd_op_reply(37 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c82829400 2024-04-25T10:04:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.874+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:38 18.2 18:40000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81de8000 con 0x555c82829400 2024-04-25T10:04:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.875+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.7 v2:172.21.15.55:6816/2960381217 4 ==== osd_op_reply(38 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c82829400 2024-04-25T10:04:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.875+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:39 18.22 18:44000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81dca800 con 0x555c82966800 2024-04-25T10:04:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.875+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.3 v2:172.21.15.7:6824/3045538953 5 ==== osd_op_reply(39 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c82966800 2024-04-25T10:04:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.875+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:40 18.12 18:48000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81de9800 con 0x555c81dcb000 2024-04-25T10:04:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.875+0000 7f84ffae3640 1 -- 172.21.15.7:0/319897527 <== osd.2 v2:172.21.15.7:6808/1173474863 4 ==== osd_op_reply(40 [pgnls-filter start_epoch 119 out=49b] v119'23 uv23 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0780 con 0x555c81dcb000 2024-04-25T10:04:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.875+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:41 18.32 18:4c000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c82989000 con 0x555c82966800 2024-04-25T10:04:57.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.876+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.3 v2:172.21.15.7:6824/3045538953 6 ==== osd_op_reply(41 [pgnls-filter start_epoch 119 out=81b] v119'17 uv17 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x555c827c0000 con 0x555c82966800 2024-04-25T10:04:57.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.876+0000 7f850222d740 20 datascan.forall_objects: OSD matched oid 10000000003.00000000 2024-04-25T10:04:57.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.876+0000 7f850222d740 10 datascan.operator(): handling object 10000000003.0 2024-04-25T10:04:57.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.876+0000 7f850222d740 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:42 18.32 18:4def72d4:::10000000003.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81de8c00 con 0x555c82966800 2024-04-25T10:04:57.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.876+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.3 v2:172.21.15.7:6824/3045538953 7 ==== osd_op_reply(42 10000000003.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (126) out=126b,getxattr (30) out=30b,getxattr] v0'0 uv17 ondisk = 0) v8 ==== 416+0+194 (crc 0 0 0) 0x555c827c0000 con 0x555c82966800 2024-04-25T10:04:57.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.876+0000 7f850222d740 10 datascan.inject_with_backtrace: inode: 0x0x10000000003 2024-04-25T10:04:57.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.876+0000 7f850222d740 10 datascan.inject_with_backtrace: backptr: 0x0x10000000001/bravo 2024-04-25T10:04:57.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.876+0000 7f850222d740 20 datascan.get_frag_of: dirino=0x10000000001 target_dname=bravo 2024-04-25T10:04:57.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.876+0000 7f850222d740 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:43 17.7 17:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81de9400 con 0x555c82989400 2024-04-25T10:04:57.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.876+0000 7f84ffae3640 1 -- 172.21.15.7:0/319897527 <== osd.0 v2:172.21.15.7:6800/4167741236 13 ==== osd_op_reply(43 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x555c827c0780 con 0x555c82989400 2024-04-25T10:04:57.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.876+0000 7f850222d740 20 datascan.get_frag_of: got backtrace parent 0x10000000000/flushed 2024-04-25T10:04:57.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.876+0000 7f850222d740 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:44 17.10 17:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81de9000 con 0x555c82966800 2024-04-25T10:04:57.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.876+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.3 v2:172.21.15.7:6824/3045538953 8 ==== osd_op_reply(44 10000000000.00000000 [omap-get-vals-by-keys out=585b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+585 (crc 0 0 0) 0x555c827c0000 con 0x555c82966800 2024-04-25T10:04:57.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.876+0000 7f850222d740 20 datascan.read_dentry: oid=10000000000.00000000 dname=flushed frag=*, r=0 2024-04-25T10:04:57.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.877+0000 7f850222d740 20 datascan.get_frag_of: fast path, fragtree is fragtree_t() 2024-04-25T10:04:57.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.877+0000 7f850222d740 20 datascan.get_frag_of: frag is * 2024-04-25T10:04:57.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.877+0000 7f850222d740 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:45 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81de9c00 con 0x555c82989400 2024-04-25T10:04:57.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.877+0000 7f84ffae3640 1 -- 172.21.15.7:0/319897527 <== osd.0 v2:172.21.15.7:6800/4167741236 14 ==== osd_op_reply(45 10000000001.00000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x555c827c0780 con 0x555c82989400 2024-04-25T10:04:57.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.877+0000 7f850222d740 10 datascan.find_or_create_dirfrag: read_version = 8 2024-04-25T10:04:57.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.877+0000 7f850222d740 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000001 * 2024-04-25T10:04:57.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.877+0000 7f850222d740 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:46 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81dcbc00 con 0x555c82989400 2024-04-25T10:04:57.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.877+0000 7f84ffae3640 1 -- 172.21.15.7:0/319897527 <== osd.0 v2:172.21.15.7:6800/4167741236 15 ==== osd_op_reply(46 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x555c827c0780 con 0x555c82989400 2024-04-25T10:04:57.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.877+0000 7f850222d740 20 datascan.read_dentry: oid=10000000001.00000000 dname=bravo frag=*, r=0 2024-04-25T10:04:57.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.877+0000 7f850222d740 20 datascan.read_dentry: bravo_head not found in result 2024-04-25T10:04:57.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.877+0000 7f850222d740 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000003 at 0x0x10000000001/bravo with size=5 bytes 2024-04-25T10:04:57.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.877+0000 7f850222d740 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:47 17.7 17:e2e07930:::10000000001.00000000:head [omap-set-vals in=506b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81de8800 con 0x555c82989400 2024-04-25T10:04:57.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.879+0000 7f84ffae3640 1 -- 172.21.15.7:0/319897527 <== osd.0 v2:172.21.15.7:6800/4167741236 16 ==== osd_op_reply(47 10000000001.00000000 [omap-set-vals] v119'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x555c827c0780 con 0x555c82989400 2024-04-25T10:04:57.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.879+0000 7f850222d740 20 datascan.inject_linkage: Injected dentry 0x0x10000000001/bravo pointing to 0x0x10000000003 2024-04-25T10:04:57.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.879+0000 7f850222d740 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:48 18.a 18:50000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81de8000 con 0x555c82966800 2024-04-25T10:04:57.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.879+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.3 v2:172.21.15.7:6824/3045538953 9 ==== osd_op_reply(48 [pgnls-filter start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c82966800 2024-04-25T10:04:57.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.879+0000 7f84fb2da640 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x555c82989800 0x555c81dd1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.879+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:49 18.2a 18:54000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81df2000 con 0x555c82989800 2024-04-25T10:04:57.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.879+0000 7f85002e4640 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x555c82989800 0x555c81dd1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.880+0000 7f85002e4640 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x555c82989800 0x555c81dd1600 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.880+0000 7f85002e4640 1 -- 172.21.15.7:0/319897527 <== osd.4 v2:172.21.15.55:6808/2248155105 1 ==== osd_op_reply(49 [pgnls-filter start_epoch 119 out=49b] v117'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0500 con 0x555c82989800 2024-04-25T10:04:57.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.880+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:50 18.1a 18:58000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c82966400 con 0x555c82966800 2024-04-25T10:04:57.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.880+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.3 v2:172.21.15.7:6824/3045538953 10 ==== osd_op_reply(50 [pgnls-filter start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c82966800 2024-04-25T10:04:57.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.880+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:51 18.3a 18:5c000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81df2400 con 0x555c82989400 2024-04-25T10:04:57.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.880+0000 7f84ffae3640 1 -- 172.21.15.7:0/319897527 <== osd.0 v2:172.21.15.7:6800/4167741236 17 ==== osd_op_reply(51 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0780 con 0x555c82989400 2024-04-25T10:04:57.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.880+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:52 18.6 18:60000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81dcac00 con 0x555c82829400 2024-04-25T10:04:57.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.881+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.7 v2:172.21.15.55:6816/2960381217 5 ==== osd_op_reply(52 [pgnls-filter start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c82829400 2024-04-25T10:04:57.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.881+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:53 18.26 18:64000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81df2800 con 0x555c81dcb000 2024-04-25T10:04:57.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.881+0000 7f84ffae3640 1 -- 172.21.15.7:0/319897527 <== osd.2 v2:172.21.15.7:6808/1173474863 5 ==== osd_op_reply(53 [pgnls-filter start_epoch 119 out=49b] v117'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0780 con 0x555c81dcb000 2024-04-25T10:04:57.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.881+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:54 18.16 18:68000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c82989c00 con 0x555c82966800 2024-04-25T10:04:57.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.881+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.3 v2:172.21.15.7:6824/3045538953 11 ==== osd_op_reply(54 [pgnls-filter start_epoch 119 out=49b] v117'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c82966800 2024-04-25T10:04:57.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.881+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:55 18.36 18:6c000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81df2c00 con 0x555c81dcb400 2024-04-25T10:04:57.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.882+0000 7f85002e4640 1 -- 172.21.15.7:0/319897527 <== osd.1 v2:172.21.15.7:6816/434435857 5 ==== osd_op_reply(55 [pgnls-filter start_epoch 119 out=49b] v117'32 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0500 con 0x555c81dcb400 2024-04-25T10:04:57.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.882+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:56 18.e 18:70000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81df2400 con 0x555c82989400 2024-04-25T10:04:57.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.882+0000 7f84ffae3640 1 -- 172.21.15.7:0/319897527 <== osd.0 v2:172.21.15.7:6800/4167741236 18 ==== osd_op_reply(56 [pgnls-filter start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0780 con 0x555c82989400 2024-04-25T10:04:57.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.882+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:57 18.2e 18:74000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81df3000 con 0x555c82966800 2024-04-25T10:04:57.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.882+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.3 v2:172.21.15.7:6824/3045538953 12 ==== osd_op_reply(57 [pgnls-filter start_epoch 119 out=49b] v117'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c82966800 2024-04-25T10:04:57.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.882+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:58 18.1e 18:78000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81df3c00 con 0x555c81dca000 2024-04-25T10:04:57.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.882+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.5 v2:172.21.15.55:6800/2514169616 7 ==== osd_op_reply(58 [pgnls-filter start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c81dca000 2024-04-25T10:04:57.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.882+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:59 18.3e 18:7c000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81df3400 con 0x555c82966800 2024-04-25T10:04:57.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.883+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.3 v2:172.21.15.7:6824/3045538953 13 ==== osd_op_reply(59 [pgnls-filter start_epoch 119 out=49b] v117'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c82966800 2024-04-25T10:04:57.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.883+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:60 18.1 18:80000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81de9800 con 0x555c82966800 2024-04-25T10:04:57.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.883+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.3 v2:172.21.15.7:6824/3045538953 14 ==== osd_op_reply(60 [pgnls-filter start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c82966800 2024-04-25T10:04:57.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.883+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:61 18.21 18:84000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81df3800 con 0x555c81dca000 2024-04-25T10:04:57.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.883+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.5 v2:172.21.15.55:6800/2514169616 8 ==== osd_op_reply(61 [pgnls-filter start_epoch 119 out=49b] v117'24 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c81dca000 2024-04-25T10:04:57.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.883+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:62 18.11 18:88000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81de9400 con 0x555c81dcb400 2024-04-25T10:04:57.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.884+0000 7f85002e4640 1 -- 172.21.15.7:0/319897527 <== osd.1 v2:172.21.15.7:6816/434435857 6 ==== osd_op_reply(62 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0500 con 0x555c81dcb400 2024-04-25T10:04:57.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.884+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:63 18.31 18:8c000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81df3000 con 0x555c82989800 2024-04-25T10:04:57.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.884+0000 7f85002e4640 1 -- 172.21.15.7:0/319897527 <== osd.4 v2:172.21.15.55:6808/2248155105 2 ==== osd_op_reply(63 [pgnls-filter start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0500 con 0x555c82989800 2024-04-25T10:04:57.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.884+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:64 18.9 18:90000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81de9c00 con 0x555c82966800 2024-04-25T10:04:57.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.884+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.3 v2:172.21.15.7:6824/3045538953 15 ==== osd_op_reply(64 [pgnls-filter start_epoch 119 out=49b] v117'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c82966800 2024-04-25T10:04:57.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.884+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:65 18.29 18:94000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81df3c00 con 0x555c82829400 2024-04-25T10:04:57.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.885+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.7 v2:172.21.15.55:6816/2960381217 6 ==== osd_op_reply(65 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c82829400 2024-04-25T10:04:57.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.885+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:66 18.19 18:98000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81de8800 con 0x555c82989800 2024-04-25T10:04:57.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.885+0000 7f85002e4640 1 -- 172.21.15.7:0/319897527 <== osd.4 v2:172.21.15.55:6808/2248155105 3 ==== osd_op_reply(66 [pgnls-filter start_epoch 119 out=49b] v117'21 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0500 con 0x555c82989800 2024-04-25T10:04:57.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.885+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:67 18.39 18:9c000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c82989c00 con 0x555c82989400 2024-04-25T10:04:57.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.886+0000 7f84ffae3640 1 -- 172.21.15.7:0/319897527 <== osd.0 v2:172.21.15.7:6800/4167741236 19 ==== osd_op_reply(67 [pgnls-filter start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0780 con 0x555c82989400 2024-04-25T10:04:57.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.886+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:68 18.5 18:a0000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81dca400 con 0x555c81dcb400 2024-04-25T10:04:57.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.886+0000 7f85002e4640 1 -- 172.21.15.7:0/319897527 <== osd.1 v2:172.21.15.7:6816/434435857 7 ==== osd_op_reply(68 [pgnls-filter start_epoch 119 out=49b] v119'12 uv12 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0500 con 0x555c81dcb400 2024-04-25T10:04:57.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.886+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:69 18.25 18:a4000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81dcac00 con 0x555c82966000 2024-04-25T10:04:57.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.886+0000 7f85002e4640 1 -- 172.21.15.7:0/319897527 <== osd.6 v2:172.21.15.55:6824/4293769515 6 ==== osd_op_reply(69 [pgnls-filter start_epoch 119 out=49b] v119'17 uv17 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0500 con 0x555c82966000 2024-04-25T10:04:57.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.886+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:70 18.15 18:a8000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81dcbc00 con 0x555c81dca000 2024-04-25T10:04:57.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.887+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.5 v2:172.21.15.55:6800/2514169616 9 ==== osd_op_reply(70 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c81dca000 2024-04-25T10:04:57.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.887+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:71 18.35 18:ac000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c82966400 con 0x555c82989800 2024-04-25T10:04:57.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.887+0000 7f85002e4640 1 -- 172.21.15.7:0/319897527 <== osd.4 v2:172.21.15.55:6808/2248155105 4 ==== osd_op_reply(71 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0500 con 0x555c82989800 2024-04-25T10:04:57.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.887+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:72 18.d 18:b0000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81dca400 con 0x555c82989800 2024-04-25T10:04:57.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.887+0000 7f85002e4640 1 -- 172.21.15.7:0/319897527 <== osd.4 v2:172.21.15.55:6808/2248155105 5 ==== osd_op_reply(72 [pgnls-filter start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0500 con 0x555c82989800 2024-04-25T10:04:57.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.887+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:73 18.2d 18:b4000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81de8400 con 0x555c82966000 2024-04-25T10:04:57.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.888+0000 7f85002e4640 1 -- 172.21.15.7:0/319897527 <== osd.6 v2:172.21.15.55:6824/4293769515 7 ==== osd_op_reply(73 [pgnls-filter start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0500 con 0x555c82966000 2024-04-25T10:04:57.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.888+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:74 18.1d 18:b8000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81de9400 con 0x555c82989400 2024-04-25T10:04:57.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.888+0000 7f84ffae3640 1 -- 172.21.15.7:0/319897527 <== osd.0 v2:172.21.15.7:6800/4167741236 20 ==== osd_op_reply(74 [pgnls-filter start_epoch 119 out=49b] v117'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0780 con 0x555c82989400 2024-04-25T10:04:57.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.888+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:75 18.3d 18:bc000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81de9000 con 0x555c82966800 2024-04-25T10:04:57.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.888+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.3 v2:172.21.15.7:6824/3045538953 16 ==== osd_op_reply(75 [pgnls-filter start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c82966800 2024-04-25T10:04:57.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.888+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:76 18.3 18:c0000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81de8800 con 0x555c81dcb400 2024-04-25T10:04:57.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.888+0000 7f85002e4640 1 -- 172.21.15.7:0/319897527 <== osd.1 v2:172.21.15.7:6816/434435857 8 ==== osd_op_reply(76 [pgnls-filter start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0500 con 0x555c81dcb400 2024-04-25T10:04:57.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.888+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:77 18.23 18:c4000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81de8000 con 0x555c81dcb000 2024-04-25T10:04:57.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.889+0000 7f84ffae3640 1 -- 172.21.15.7:0/319897527 <== osd.2 v2:172.21.15.7:6808/1173474863 6 ==== osd_op_reply(77 [pgnls-filter start_epoch 119 out=49b] v117'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0780 con 0x555c81dcb000 2024-04-25T10:04:57.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.889+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:78 18.13 18:c8000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81df2000 con 0x555c82829400 2024-04-25T10:04:57.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.889+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.7 v2:172.21.15.55:6816/2960381217 7 ==== osd_op_reply(78 [pgnls-filter start_epoch 119 out=49b] v117'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c82829400 2024-04-25T10:04:57.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.889+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:79 18.33 18:cc000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81e02000 con 0x555c81dcb400 2024-04-25T10:04:57.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.889+0000 7f85002e4640 1 -- 172.21.15.7:0/319897527 <== osd.1 v2:172.21.15.7:6816/434435857 9 ==== osd_op_reply(79 [pgnls-filter start_epoch 119 out=49b] v117'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0500 con 0x555c81dcb400 2024-04-25T10:04:57.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.889+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:80 18.b 18:d0000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81df2c00 con 0x555c81dca000 2024-04-25T10:04:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.890+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.5 v2:172.21.15.55:6800/2514169616 10 ==== osd_op_reply(80 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c81dca000 2024-04-25T10:04:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.890+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:81 18.2b 18:d4000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81e02400 con 0x555c82829400 2024-04-25T10:04:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.890+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.7 v2:172.21.15.55:6816/2960381217 8 ==== osd_op_reply(81 [pgnls-filter start_epoch 119 out=49b] v117'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c82829400 2024-04-25T10:04:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.890+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:82 18.1b 18:d8000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81df3000 con 0x555c81dcb400 2024-04-25T10:04:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.890+0000 7f85002e4640 1 -- 172.21.15.7:0/319897527 <== osd.1 v2:172.21.15.7:6816/434435857 10 ==== osd_op_reply(82 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0500 con 0x555c81dcb400 2024-04-25T10:04:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.890+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:83 18.3b 18:dc000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81e02800 con 0x555c82989800 2024-04-25T10:04:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.891+0000 7f85002e4640 1 -- 172.21.15.7:0/319897527 <== osd.4 v2:172.21.15.55:6808/2248155105 6 ==== osd_op_reply(83 [pgnls-filter start_epoch 119 out=49b] v117'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0500 con 0x555c82989800 2024-04-25T10:04:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.891+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:84 18.7 18:e0000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81de8400 con 0x555c81dcb000 2024-04-25T10:04:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.891+0000 7f84ffae3640 1 -- 172.21.15.7:0/319897527 <== osd.2 v2:172.21.15.7:6808/1173474863 7 ==== osd_op_reply(84 [pgnls-filter start_epoch 119 out=49b] v117'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0780 con 0x555c81dcb000 2024-04-25T10:04:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.891+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:85 18.27 18:e4000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81e02c00 con 0x555c81dca000 2024-04-25T10:04:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.892+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.5 v2:172.21.15.55:6800/2514169616 11 ==== osd_op_reply(85 [pgnls-filter start_epoch 119 out=49b] v117'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c81dca000 2024-04-25T10:04:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.892+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:86 18.17 18:e8000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81de8800 con 0x555c81dca000 2024-04-25T10:04:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.892+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.5 v2:172.21.15.55:6800/2514169616 12 ==== osd_op_reply(86 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c81dca000 2024-04-25T10:04:57.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.892+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:87 18.37 18:ec000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81e03000 con 0x555c82829400 2024-04-25T10:04:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.892+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.7 v2:172.21.15.55:6816/2960381217 9 ==== osd_op_reply(87 [pgnls-filter start_epoch 119 out=49b] v117'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c82829400 2024-04-25T10:04:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.892+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:88 18.f 18:f0000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81de9800 con 0x555c81dca000 2024-04-25T10:04:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.893+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.5 v2:172.21.15.55:6800/2514169616 13 ==== osd_op_reply(88 [pgnls-filter start_epoch 119 out=49b] v117'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c81dca000 2024-04-25T10:04:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.893+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:89 18.2f 18:f4000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81e03400 con 0x555c81dcb400 2024-04-25T10:04:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.893+0000 7f85002e4640 1 -- 172.21.15.7:0/319897527 <== osd.1 v2:172.21.15.7:6816/434435857 11 ==== osd_op_reply(89 [pgnls-filter start_epoch 119 out=49b] v117'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0500 con 0x555c81dcb400 2024-04-25T10:04:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.893+0000 7f84faad9640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:90 18.1f 18:f8000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81de9c00 con 0x555c82829400 2024-04-25T10:04:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.894+0000 7f84ff2e2640 1 -- 172.21.15.7:0/319897527 <== osd.7 v2:172.21.15.55:6816/2960381217 10 ==== osd_op_reply(90 [pgnls-filter start_epoch 119 out=49b] v117'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0000 con 0x555c82829400 2024-04-25T10:04:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.894+0000 7f84fb2da640 1 -- 172.21.15.7:0/319897527 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:91 18.3f 18:fc000000::::head [pgnls-filter start_epoch 119 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x555c81e03800 con 0x555c82989800 2024-04-25T10:04:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.894+0000 7f85002e4640 1 -- 172.21.15.7:0/319897527 <== osd.4 v2:172.21.15.55:6808/2248155105 7 ==== osd_op_reply(91 [pgnls-filter start_epoch 119 out=49b] v117'17 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c827c0500 con 0x555c82989800 2024-04-25T10:04:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.894+0000 7f850222d740 1 -- 172.21.15.7:0/319897527 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x555c82989400 msgr2=0x555c81ab1600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.894+0000 7f850222d740 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x555c82989400 0x555c81ab1600 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.894+0000 7f850222d740 1 -- 172.21.15.7:0/319897527 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x555c81dcb400 msgr2=0x555c81dd0580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.894+0000 7f850222d740 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x555c81dcb400 0x555c81dd0580 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.894+0000 7f850222d740 1 -- 172.21.15.7:0/319897527 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x555c81dcb000 msgr2=0x555c81dd0b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.894+0000 7f850222d740 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x555c81dcb000 0x555c81dd0b00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.894+0000 7f850222d740 1 -- 172.21.15.7:0/319897527 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x555c82966800 msgr2=0x555c81ab2100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.894+0000 7f850222d740 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x555c82966800 0x555c81ab2100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.894+0000 7f850222d740 1 -- 172.21.15.7:0/319897527 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x555c82989800 msgr2=0x555c81dd1600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.894+0000 7f850222d740 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x555c82989800 0x555c81dd1600 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.894+0000 7f84ffae3640 1 -- 172.21.15.7:0/319897527 reap_dead start 2024-04-25T10:04:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.894+0000 7f850222d740 1 -- 172.21.15.7:0/319897527 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x555c81dca000 msgr2=0x555c81dd0000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.894+0000 7f850222d740 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x555c81dca000 0x555c81dd0000 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.894+0000 7f850222d740 1 -- 172.21.15.7:0/319897527 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x555c82966000 msgr2=0x555c81ab1b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.894+0000 7f850222d740 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x555c82966000 0x555c81ab1b80 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.894+0000 7f84ffae3640 1 -- 172.21.15.7:0/319897527 reap_dead start 2024-04-25T10:04:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.894+0000 7f850222d740 1 -- 172.21.15.7:0/319897527 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x555c82829400 msgr2=0x555c81dd1080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.894+0000 7f850222d740 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x555c82829400 0x555c81dd1080 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.894+0000 7f84ffae3640 1 -- 172.21.15.7:0/319897527 reap_dead start 2024-04-25T10:04:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.894+0000 7f850222d740 1 -- 172.21.15.7:0/319897527 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x555c82988c00 msgr2=0x555c81ab3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.894+0000 7f850222d740 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x555c82988c00 0x555c81ab3700 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x555c8291a810 tx=0x555c81b02f00 comp rx=0 tx=0).stop 2024-04-25T10:04:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.894+0000 7f850222d740 1 -- 172.21.15.7:0/319897527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c82829800 msgr2=0x555c81ab3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.894+0000 7f850222d740 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c82829800 0x555c81ab3180 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x555c8291bad0 tx=0x555c827d0420 comp rx=0 tx=0).stop 2024-04-25T10:04:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.894+0000 7f850222d740 1 -- 172.21.15.7:0/319897527 shutdown_connections 2024-04-25T10:04:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.894+0000 7f850222d740 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x555c82988c00 0x555c81ab3700 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.894+0000 7f850222d740 1 --2- 172.21.15.7:0/319897527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c82829800 0x555c81ab3180 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.894+0000 7f850222d740 1 -- 172.21.15.7:0/319897527 >> 172.21.15.7:0/319897527 conn(0x555c82829c00 msgr2=0x555c81b3b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.895+0000 7f850222d740 1 -- 172.21.15.7:0/319897527 shutdown_connections 2024-04-25T10:04:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.895+0000 7f850222d740 1 -- 172.21.15.7:0/319897527 wait complete. 2024-04-25T10:04:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.895+0000 7f850222d740 1 -- 172.21.15.7:0/1924324313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c81a41800 msgr2=0x555c81ab0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.895+0000 7f850222d740 1 --2- 172.21.15.7:0/1924324313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c81a41800 0x555c81ab0b00 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x555c82861200 tx=0x555c827c4900 comp rx=0 tx=0).stop 2024-04-25T10:04:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.895+0000 7f850222d740 1 -- 172.21.15.7:0/1924324313 shutdown_connections 2024-04-25T10:04:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.895+0000 7f850222d740 1 --2- 172.21.15.7:0/1924324313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555c81a41c00 0x555c81ab1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.895+0000 7f850222d740 1 --2- 172.21.15.7:0/1924324313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c81a41800 0x555c81ab0b00 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.895+0000 7f850222d740 1 --2- 172.21.15.7:0/1924324313 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555c81a40c00 0x555c81ab0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.895+0000 7f850222d740 1 -- 172.21.15.7:0/1924324313 >> 172.21.15.7:0/1924324313 conn(0x555c81a41000 msgr2=0x555c81b3a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:57.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.895+0000 7f850222d740 1 -- 172.21.15.7:0/1924324313 shutdown_connections 2024-04-25T10:04:57.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.895+0000 7f850222d740 1 -- 172.21.15.7:0/1924324313 wait complete. 2024-04-25T10:04:57.919 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', '--filter-tag', 'mytag123', 'cephfs_data'] in time 0:00:00.139751, result: 2024-04-25T10:04:57.919 DEBUG:teuthology.orchestra.run.smithi007:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2024-04-25T10:04:57.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.987+0000 7f4cb2920740 1 -- start start 2024-04-25T10:04:57.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.987+0000 7f4cb2920740 1 Processor -- start 2024-04-25T10:04:58.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.987+0000 7f4cb2920740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ed95cc00 0x5629ed9cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.987+0000 7f4cb2920740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5629ed95d800 0x5629ed9ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.987+0000 7f4cb2920740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5629ed95dc00 0x5629ed9cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.987+0000 7f4cb2920740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629ee734600 con 0x5629ed95cc00 2024-04-25T10:04:58.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.987+0000 7f4cb2920740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629ee734480 con 0x5629ed95dc00 2024-04-25T10:04:58.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.987+0000 7f4cb2920740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5629ee734300 con 0x5629ed95d800 2024-04-25T10:04:58.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.988+0000 7f4cb07b2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ed95cc00 0x5629ed9cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.988+0000 7f4cb07b2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ed95cc00 0x5629ed9cc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47748/0 (socket says 172.21.15.7:47748) 2024-04-25T10:04:58.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.988+0000 7f4cb07b2640 1 -- 172.21.15.7:0/747128734 learned_addr learned my addr 172.21.15.7:0/747128734 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:58.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.988+0000 7f4caffb1640 1 --2- 172.21.15.7:0/747128734 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5629ed95d800 0x5629ed9ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.988+0000 7f4cb0fb3640 1 --2- 172.21.15.7:0/747128734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5629ed95dc00 0x5629ed9cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.988+0000 7f4cb07b2640 1 -- 172.21.15.7:0/747128734 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5629ed95d800 msgr2=0x5629ed9ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:58.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.988+0000 7f4cb07b2640 1 --2- 172.21.15.7:0/747128734 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5629ed95d800 0x5629ed9ccb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.988+0000 7f4cb07b2640 1 -- 172.21.15.7:0/747128734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5629ed95dc00 msgr2=0x5629ed9cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:58.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.988+0000 7f4cb07b2640 1 --2- 172.21.15.7:0/747128734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5629ed95dc00 0x5629ed9cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.988+0000 7f4cb07b2640 1 -- 172.21.15.7:0/747128734 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629ed989680 con 0x5629ed95cc00 2024-04-25T10:04:58.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.988+0000 7f4caffb1640 1 --2- 172.21.15.7:0/747128734 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5629ed95d800 0x5629ed9ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:58.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.988+0000 7f4cb0fb3640 1 --2- 172.21.15.7:0/747128734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5629ed95dc00 0x5629ed9cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:58.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.988+0000 7f4cb07b2640 1 --2- 172.21.15.7:0/747128734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ed95cc00 0x5629ed9cc580 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x5629ee76fcb0 tx=0x5629ee6ec4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=705e5fd8c6557b3c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:58.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.988+0000 7f4cadfad640 1 -- 172.21.15.7:0/747128734 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5629ed982680 con 0x5629ed95cc00 2024-04-25T10:04:58.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.988+0000 7f4cadfad640 1 -- 172.21.15.7:0/747128734 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5629ed9a6540 con 0x5629ed95cc00 2024-04-25T10:04:58.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.988+0000 7f4cadfad640 1 -- 172.21.15.7:0/747128734 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5629ed982b60 con 0x5629ed95cc00 2024-04-25T10:04:58.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.988+0000 7f4cb2920740 1 -- 172.21.15.7:0/747128734 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5629ed989860 con 0x5629ed95cc00 2024-04-25T10:04:58.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.988+0000 7f4cb2920740 1 -- 172.21.15.7:0/747128734 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5629ed9892c0 con 0x5629ed95cc00 2024-04-25T10:04:58.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.988+0000 7f4cb2920740 4 waiting for MDS map... 2024-04-25T10:04:58.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.988+0000 7f4cadfad640 1 -- 172.21.15.7:0/747128734 <== mon.0 v2:172.21.15.7:3300/0 4 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x5629ee82c600 con 0x5629ed95cc00 2024-04-25T10:04:58.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.989+0000 7f4cadfad640 1 -- 172.21.15.7:0/747128734 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 95) v1 ==== 2723+0+0 (secure 0 0 0) 0x5629ed9b5180 con 0x5629ed95cc00 2024-04-25T10:04:58.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.989+0000 7f4cb2920740 4 Got MDS map 95 2024-04-25T10:04:58.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.989+0000 7f4cb2920740 4 datascan.main: Using metadata pool output 2024-04-25T10:04:58.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.989+0000 7f4cb2920740 4 datascan.main: connecting to RADOS... 2024-04-25T10:04:58.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.989+0000 7f4cb2920740 1 Processor -- start 2024-04-25T10:04:58.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.989+0000 7f4cb2920740 1 -- start start 2024-04-25T10:04:58.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.990+0000 7f4cb2920740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5629ee830c00 0x5629ed9cd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.990+0000 7f4cb2920740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ee831000 0x5629ed9cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.990+0000 7f4cb2920740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5629ee831400 0x5629ed9ce100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.990+0000 7f4cb2920740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629ee734180 con 0x5629ee831000 2024-04-25T10:04:58.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.990+0000 7f4cb2920740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629ee734900 con 0x5629ee831400 2024-04-25T10:04:58.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.990+0000 7f4cb2920740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5629ed9bc900 con 0x5629ee830c00 2024-04-25T10:04:58.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.990+0000 7f4cb07b2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ee831000 0x5629ed9cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.990+0000 7f4cb07b2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ee831000 0x5629ed9cdb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47762/0 (socket says 172.21.15.7:47762) 2024-04-25T10:04:58.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.990+0000 7f4cb07b2640 1 -- 172.21.15.7:0/422544831 learned_addr learned my addr 172.21.15.7:0/422544831 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:58.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.990+0000 7f4caffb1640 1 --2- 172.21.15.7:0/422544831 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5629ee831400 0x5629ed9ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.990+0000 7f4cb0fb3640 1 --2- 172.21.15.7:0/422544831 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5629ee830c00 0x5629ed9cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.990+0000 7f4cb07b2640 1 -- 172.21.15.7:0/422544831 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5629ee830c00 msgr2=0x5629ed9cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:58.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.990+0000 7f4cb07b2640 1 --2- 172.21.15.7:0/422544831 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5629ee830c00 0x5629ed9cd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.990+0000 7f4cb07b2640 1 -- 172.21.15.7:0/422544831 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5629ee831400 msgr2=0x5629ed9ce100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:58.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.990+0000 7f4cb07b2640 1 --2- 172.21.15.7:0/422544831 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5629ee831400 0x5629ed9ce100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.990+0000 7f4cb07b2640 1 -- 172.21.15.7:0/422544831 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629ed9894a0 con 0x5629ee831000 2024-04-25T10:04:58.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.990+0000 7f4cb07b2640 1 --2- 172.21.15.7:0/422544831 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ee831000 0x5629ed9cdb80 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x5629ee81cb40 tx=0x5629ee6ef320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c11b77eae050ffda server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:58.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.990+0000 7f4cabfa9640 1 -- 172.21.15.7:0/422544831 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5629ed982820 con 0x5629ee831000 2024-04-25T10:04:58.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.990+0000 7f4cabfa9640 1 -- 172.21.15.7:0/422544831 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5629ed9a6e00 con 0x5629ee831000 2024-04-25T10:04:58.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.990+0000 7f4cabfa9640 1 -- 172.21.15.7:0/422544831 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5629ed982680 con 0x5629ee831000 2024-04-25T10:04:58.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.991+0000 7f4cb2920740 1 -- 172.21.15.7:0/422544831 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ee831000 msgr2=0x5629ed9cdb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.991+0000 7f4cb2920740 1 --2- 172.21.15.7:0/422544831 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ee831000 0x5629ed9cdb80 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x5629ee81cb40 tx=0x5629ee6ef320 comp rx=0 tx=0).stop 2024-04-25T10:04:58.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.991+0000 7f4cb2920740 1 -- 172.21.15.7:0/422544831 shutdown_connections 2024-04-25T10:04:58.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.991+0000 7f4cb2920740 1 --2- 172.21.15.7:0/422544831 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5629ee831400 0x5629ed9ce100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.991+0000 7f4cb2920740 1 --2- 172.21.15.7:0/422544831 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ee831000 0x5629ed9cdb80 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.991+0000 7f4cb2920740 1 --2- 172.21.15.7:0/422544831 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5629ee830c00 0x5629ed9cd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.991+0000 7f4cb2920740 1 -- 172.21.15.7:0/422544831 >> 172.21.15.7:0/422544831 conn(0x5629ee830800 msgr2=0x5629eda57000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:58.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.991+0000 7f4cb2920740 1 -- 172.21.15.7:0/422544831 shutdown_connections 2024-04-25T10:04:58.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.991+0000 7f4cb2920740 1 -- 172.21.15.7:0/422544831 wait complete. 2024-04-25T10:04:58.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.991+0000 7f4cb2920740 1 Processor -- start 2024-04-25T10:04:58.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.991+0000 7f4cb2920740 1 -- start start 2024-04-25T10:04:58.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.992+0000 7f4cb2920740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5629ee830c00 0x5629ed9cf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.992+0000 7f4cb2920740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ee831000 0x5629ed9cec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.992+0000 7f4cb2920740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5629ee831400 0x5629ed9ce680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.992+0000 7f4cb2920740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629ee735500 con 0x5629ee831000 2024-04-25T10:04:58.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.992+0000 7f4cb2920740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629ee735680 con 0x5629ee830c00 2024-04-25T10:04:58.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.992+0000 7f4cb2920740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x5629ee734900 con 0x5629ee831400 2024-04-25T10:04:58.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.992+0000 7f4cb07b2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ee831000 0x5629ed9cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.992+0000 7f4cb07b2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ee831000 0x5629ed9cec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47770/0 (socket says 172.21.15.7:47770) 2024-04-25T10:04:58.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.992+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 learned_addr learned my addr 172.21.15.7:0/1317583534 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:58.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.992+0000 7f4cb0fb3640 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5629ee830c00 0x5629ed9cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.992+0000 7f4caffb1640 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5629ee831400 0x5629ed9ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.992+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5629ee831400 msgr2=0x5629ed9ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.992+0000 7f4cb07b2640 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5629ee831400 0x5629ed9ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.992+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5629ee830c00 msgr2=0x5629ed9cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.992+0000 7f4cb07b2640 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5629ee830c00 0x5629ed9cf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.992+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629ed989680 con 0x5629ee831000 2024-04-25T10:04:58.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.993+0000 7f4cb07b2640 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ee831000 0x5629ed9cec00 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x5629ee81cde0 tx=0x5629ee83ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:58.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.993+0000 7f4caa7a6640 1 -- 172.21.15.7:0/1317583534 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5629ed982b60 con 0x5629ee831000 2024-04-25T10:04:58.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.993+0000 7f4caa7a6640 1 -- 172.21.15.7:0/1317583534 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5629ed9a6c40 con 0x5629ee831000 2024-04-25T10:04:58.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.993+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5629ed989860 con 0x5629ee831000 2024-04-25T10:04:58.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.993+0000 7f4caa7a6640 1 -- 172.21.15.7:0/1317583534 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5629ed9824e0 con 0x5629ee831000 2024-04-25T10:04:58.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.993+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5629ed9890e0 con 0x5629ee831000 2024-04-25T10:04:58.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.993+0000 7f4cb2920740 4 datascan.init: resolving metadata pool 17 2024-04-25T10:04:58.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.994+0000 7f4caa7a6640 1 -- 172.21.15.7:0/1317583534 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x5629ee752c00 con 0x5629ee831000 2024-04-25T10:04:58.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.994+0000 7f4caa7a6640 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x5629ee8a9000 0x5629ed9cf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.994+0000 7f4caa7a6640 1 -- 172.21.15.7:0/1317583534 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x5629ee756600 con 0x5629ee831000 2024-04-25T10:04:58.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.994+0000 7f4cb2920740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T10:04:58.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.994+0000 7f4cb2920740 4 datascan.main: resolving metadata pool 17 2024-04-25T10:04:58.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.994+0000 7f4cb0fb3640 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x5629ee8a9000 0x5629ed9cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.994+0000 7f4cb2920740 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x5629ee8a9400 0x5629ed9ce100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.994+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:1 17.0 17:00000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629ee8a9800 con 0x5629ee8a9400 2024-04-25T10:04:58.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.995+0000 7f4caffb1640 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x5629ee8a9400 0x5629ed9ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.995+0000 7f4cb0fb3640 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x5629ee8a9000 0x5629ed9cf700 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x5629ee6f0e40 tx=0x5629ee83fec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:58.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.995+0000 7f4caffb1640 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x5629ee8a9400 0x5629ed9ce100 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:58.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.995+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 <== osd.7 v2:172.21.15.55:6816/2960381217 1 ==== osd_op_reply(1 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc000 con 0x5629ee8a9400 2024-04-25T10:04:58.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.995+0000 7f4caffb1640 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x5629ee8a9800 0x5629edcdc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.995+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:2 17.10 17:08000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629ee736800 con 0x5629ee8a9800 2024-04-25T10:04:58.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.996+0000 7f4cb0fb3640 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x5629ee8a9800 0x5629edcdc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.996+0000 7f4cb0fb3640 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x5629ee8a9800 0x5629edcdc000 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:58.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.996+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.3 v2:172.21.15.7:6824/3045538953 1 ==== osd_op_reply(2 [pgnls start_epoch 119 out=177b] v118'16 uv16 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a9800 2024-04-25T10:04:58.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.996+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:3 17.8 17:10000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629ee736800 con 0x5629ee8a9400 2024-04-25T10:04:58.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.996+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 <== osd.7 v2:172.21.15.55:6816/2960381217 2 ==== osd_op_reply(3 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc000 con 0x5629ee8a9400 2024-04-25T10:04:58.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.997+0000 7f4caffb1640 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x5629ee736800 0x5629edcdc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.997+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:4 17.18 17:18000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629ee737000 con 0x5629ee736800 2024-04-25T10:04:58.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.997+0000 7f4cb07b2640 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x5629ee736800 0x5629edcdc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.997+0000 7f4cb07b2640 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x5629ee736800 0x5629edcdc580 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:58.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.997+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 <== osd.0 v2:172.21.15.7:6800/4167741236 1 ==== osd_op_reply(4 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc780 con 0x5629ee736800 2024-04-25T10:04:58.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.997+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:5 17.4 17:20000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629ee737000 con 0x5629ee736800 2024-04-25T10:04:58.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.997+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 <== osd.0 v2:172.21.15.7:6800/4167741236 2 ==== osd_op_reply(5 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc780 con 0x5629ee736800 2024-04-25T10:04:58.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.997+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:6 17.14 17:28000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629ee737000 con 0x5629ee8a9800 2024-04-25T10:04:58.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.998+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.3 v2:172.21.15.7:6824/3045538953 2 ==== osd_op_reply(6 [pgnls start_epoch 119 out=149b] v119'41 uv41 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a9800 2024-04-25T10:04:58.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.998+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:7 17.c 17:30000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629ee737000 con 0x5629ee8a9400 2024-04-25T10:04:58.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.998+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 <== osd.7 v2:172.21.15.55:6816/2960381217 3 ==== osd_op_reply(7 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc000 con 0x5629ee8a9400 2024-04-25T10:04:58.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.998+0000 7f4caffb1640 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x5629ee737000 0x5629edcdcb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.998+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:8 17.1c 17:38000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629ee737400 con 0x5629ee737000 2024-04-25T10:04:58.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.998+0000 7f4caffb1640 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x5629ee737000 0x5629edcdcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.999+0000 7f4caffb1640 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x5629ee737000 0x5629edcdcb00 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:58.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.999+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 <== osd.1 v2:172.21.15.7:6816/434435857 1 ==== osd_op_reply(8 [pgnls start_epoch 119 out=73b] v118'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5629ee6dc000 con 0x5629ee737000 2024-04-25T10:04:58.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.999+0000 7f4caffb1640 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x5629ee737400 0x5629edcdd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.999+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:9 17.2 17:40000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edcda800 con 0x5629ee737400 2024-04-25T10:04:58.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:57.999+0000 7f4cb0fb3640 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x5629ee737400 0x5629edcdd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.000+0000 7f4cb0fb3640 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x5629ee737400 0x5629edcdd080 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:58.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.000+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.4 v2:172.21.15.55:6808/2248155105 1 ==== osd_op_reply(9 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee737400 2024-04-25T10:04:58.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.000+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:10 17.12 17:48000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edcda800 con 0x5629ee8a9800 2024-04-25T10:04:58.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.000+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.3 v2:172.21.15.7:6824/3045538953 3 ==== osd_op_reply(10 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a9800 2024-04-25T10:04:58.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.000+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:11 17.a 17:50000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edcda800 con 0x5629ee8a9400 2024-04-25T10:04:58.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.000+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 <== osd.7 v2:172.21.15.55:6816/2960381217 4 ==== osd_op_reply(11 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc000 con 0x5629ee8a9400 2024-04-25T10:04:58.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.000+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:12 17.1a 17:58000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edcda800 con 0x5629ee736800 2024-04-25T10:04:58.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.001+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 <== osd.0 v2:172.21.15.7:6800/4167741236 3 ==== osd_op_reply(12 [pgnls start_epoch 119 out=49b] v119'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc780 con 0x5629ee736800 2024-04-25T10:04:58.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.001+0000 7f4cb07b2640 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x5629edcda800 0x5629edcde100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.001+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:13 17.6 17:60000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629ee8a8400 con 0x5629edcda800 2024-04-25T10:04:58.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.001+0000 7f4cb07b2640 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x5629edcda800 0x5629edcde100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.001+0000 7f4cb07b2640 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x5629edcda800 0x5629edcde100 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:58.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.002+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 <== osd.6 v2:172.21.15.55:6824/4293769515 1 ==== osd_op_reply(13 [pgnls start_epoch 119 out=77b] v118'8 uv8 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x5629ee6dc780 con 0x5629edcda800 2024-04-25T10:04:58.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.002+0000 7f4cb07b2640 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x5629ee8a8400 0x5629edcde680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.002+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:14 17.16 17:68000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629ee8a8800 con 0x5629ee8a8400 2024-04-25T10:04:58.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.002+0000 7f4caffb1640 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x5629ee8a8400 0x5629edcde680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.002+0000 7f4caffb1640 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x5629ee8a8400 0x5629edcde680 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:58.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.002+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 <== osd.5 v2:172.21.15.55:6800/2514169616 1 ==== osd_op_reply(14 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc000 con 0x5629ee8a8400 2024-04-25T10:04:58.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.002+0000 7f4caffb1640 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x5629ee8a8800 0x5629edcdd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.002+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:15 17.e 17:70000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edcdac00 con 0x5629ee8a8800 2024-04-25T10:04:58.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.003+0000 7f4cb0fb3640 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x5629ee8a8800 0x5629edcdd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.003+0000 7f4cb0fb3640 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x5629ee8a8800 0x5629edcdd600 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:58.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.003+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.2 v2:172.21.15.7:6808/1173474863 1 ==== osd_op_reply(15 [pgnls start_epoch 119 out=73b] v118'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a8800 2024-04-25T10:04:58.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.003+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:16 17.1e 17:78000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edcdac00 con 0x5629ee737000 2024-04-25T10:04:58.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.003+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 <== osd.1 v2:172.21.15.7:6816/434435857 2 ==== osd_op_reply(16 [pgnls start_epoch 119 out=49b] v119'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc000 con 0x5629ee737000 2024-04-25T10:04:58.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.003+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:17 17.1 17:80000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edcdac00 con 0x5629ee736800 2024-04-25T10:04:58.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.004+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 <== osd.0 v2:172.21.15.7:6800/4167741236 4 ==== osd_op_reply(17 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc780 con 0x5629ee736800 2024-04-25T10:04:58.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.004+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:18 17.11 17:88000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edcdac00 con 0x5629ee8a9800 2024-04-25T10:04:58.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.004+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.3 v2:172.21.15.7:6824/3045538953 4 ==== osd_op_reply(18 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a9800 2024-04-25T10:04:58.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.004+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:19 17.9 17:90000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edcdac00 con 0x5629ee8a9800 2024-04-25T10:04:58.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.004+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.3 v2:172.21.15.7:6824/3045538953 5 ==== osd_op_reply(19 [pgnls start_epoch 119 out=81b] v118'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a9800 2024-04-25T10:04:58.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.004+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:20 17.19 17:98000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edcdac00 con 0x5629ee8a8400 2024-04-25T10:04:58.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.004+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 <== osd.5 v2:172.21.15.55:6800/2514169616 2 ==== osd_op_reply(20 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc000 con 0x5629ee8a8400 2024-04-25T10:04:58.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.004+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:21 17.5 17:a0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edcdac00 con 0x5629edcda800 2024-04-25T10:04:58.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.005+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 <== osd.6 v2:172.21.15.55:6824/4293769515 2 ==== osd_op_reply(21 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc780 con 0x5629edcda800 2024-04-25T10:04:58.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.005+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:22 17.15 17:a8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edcdac00 con 0x5629ee8a8400 2024-04-25T10:04:58.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.005+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 <== osd.5 v2:172.21.15.55:6800/2514169616 3 ==== osd_op_reply(22 [pgnls start_epoch 119 out=97b] v118'4 uv4 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x5629ee6dc000 con 0x5629ee8a8400 2024-04-25T10:04:58.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.005+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:23 17.d 17:b0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edcdac00 con 0x5629ee8a9400 2024-04-25T10:04:58.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.005+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 <== osd.7 v2:172.21.15.55:6816/2960381217 5 ==== osd_op_reply(23 [pgnls start_epoch 119 out=74b] v116'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x5629ee6dc000 con 0x5629ee8a9400 2024-04-25T10:04:58.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.006+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:24 17.1d 17:b8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edcdac00 con 0x5629ee8a9400 2024-04-25T10:04:58.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.006+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 <== osd.7 v2:172.21.15.55:6816/2960381217 6 ==== osd_op_reply(24 [pgnls start_epoch 119 out=73b] v118'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5629ee6dc000 con 0x5629ee8a9400 2024-04-25T10:04:58.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.006+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:25 17.3 17:c0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edcdac00 con 0x5629ee737400 2024-04-25T10:04:58.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.006+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.4 v2:172.21.15.55:6808/2248155105 2 ==== osd_op_reply(25 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee737400 2024-04-25T10:04:58.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.006+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:26 17.13 17:c8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edcdac00 con 0x5629ee8a9800 2024-04-25T10:04:58.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.006+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.3 v2:172.21.15.7:6824/3045538953 6 ==== osd_op_reply(26 [pgnls start_epoch 119 out=98b] v118'5 uv5 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a9800 2024-04-25T10:04:58.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.006+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:27 17.b 17:d0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edcdac00 con 0x5629ee736800 2024-04-25T10:04:58.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.007+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 <== osd.0 v2:172.21.15.7:6800/4167741236 5 ==== osd_op_reply(27 [pgnls start_epoch 119 out=76b] v119'6 uv5 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x5629ee6dc780 con 0x5629ee736800 2024-04-25T10:04:58.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.007+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:28 17.1b 17:d8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edcdac00 con 0x5629ee737400 2024-04-25T10:04:58.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.007+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.4 v2:172.21.15.55:6808/2248155105 3 ==== osd_op_reply(28 [pgnls start_epoch 119 out=49b] v119'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee737400 2024-04-25T10:04:58.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.007+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:29 17.7 17:e0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edcdac00 con 0x5629ee736800 2024-04-25T10:04:58.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.007+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 <== osd.0 v2:172.21.15.7:6800/4167741236 6 ==== osd_op_reply(29 [pgnls start_epoch 119 out=105b] v119'9 uv9 ondisk = 1) v8 ==== 144+0+105 (crc 0 0 0) 0x5629ee6dc780 con 0x5629ee736800 2024-04-25T10:04:58.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.007+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:30 17.17 17:e8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edcdac00 con 0x5629edcda800 2024-04-25T10:04:58.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.008+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 <== osd.6 v2:172.21.15.55:6824/4293769515 3 ==== osd_op_reply(30 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc780 con 0x5629edcda800 2024-04-25T10:04:58.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.008+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:31 17.f 17:f0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edcdac00 con 0x5629ee737000 2024-04-25T10:04:58.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.008+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 <== osd.1 v2:172.21.15.7:6816/434435857 3 ==== osd_op_reply(31 [pgnls start_epoch 119 out=73b] v119'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5629ee6dc000 con 0x5629ee737000 2024-04-25T10:04:58.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.008+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:32 17.1f 17:f8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edcdac00 con 0x5629edcda800 2024-04-25T10:04:58.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.008+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 <== osd.6 v2:172.21.15.55:6824/4293769515 4 ==== osd_op_reply(32 [pgnls start_epoch 119 out=101b] v119'9 uv8 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x5629ee6dc780 con 0x5629edcda800 2024-04-25T10:04:58.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.008+0000 7f4cb2920740 10 datascan.scan_links: step 1: handling object 601.00000000 2024-04-25T10:04:58.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.008+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:33 17.10 17:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629ee8a9c00 con 0x5629ee8a9800 2024-04-25T10:04:58.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.009+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.3 v2:172.21.15.7:6824/3045538953 7 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a9800 2024-04-25T10:04:58.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.009+0000 7f4cb2920740 10 datascan.scan_links: step 1: handling object 602.00000000 2024-04-25T10:04:58.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.009+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:34 17.10 17:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edcdb800 con 0x5629ee8a9800 2024-04-25T10:04:58.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.009+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.3 v2:172.21.15.7:6824/3045538953 8 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a9800 2024-04-25T10:04:58.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.009+0000 7f4cb2920740 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2024-04-25T10:04:58.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.009+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:35 17.10 17:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edcdbc00 con 0x5629ee8a9800 2024-04-25T10:04:58.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.009+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.3 v2:172.21.15.7:6824/3045538953 9 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=1169b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+1169 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a9800 2024-04-25T10:04:58.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.009+0000 7f4cb2920740 10 datascan.scan_links: step 1: handling object 600.00000000 2024-04-25T10:04:58.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.009+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:36 17.10 17:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02000 con 0x5629ee8a9800 2024-04-25T10:04:58.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.009+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.3 v2:172.21.15.7:6824/3045538953 10 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a9800 2024-04-25T10:04:58.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.010+0000 7f4cb2920740 10 datascan.scan_links: step 1: handling object 603.00000000 2024-04-25T10:04:58.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.010+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:37 17.10 17:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02400 con 0x5629ee8a9800 2024-04-25T10:04:58.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.010+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.3 v2:172.21.15.7:6824/3045538953 11 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a9800 2024-04-25T10:04:58.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.010+0000 7f4cb2920740 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2024-04-25T10:04:58.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.010+0000 7f4cb2920740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-25T10:04:58.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.010+0000 7f4cb2920740 10 datascan.scan_links: step 1: handling object 200.00000000 2024-04-25T10:04:58.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.010+0000 7f4cb2920740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-25T10:04:58.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.010+0000 7f4cb2920740 10 datascan.scan_links: step 1: handling object 200.00000001 2024-04-25T10:04:58.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.010+0000 7f4cb2920740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-25T10:04:58.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.010+0000 7f4cb2920740 10 datascan.scan_links: step 1: handling object 606.00000000 2024-04-25T10:04:58.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.010+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:38 17.14 17:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02800 con 0x5629ee8a9800 2024-04-25T10:04:58.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.010+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.3 v2:172.21.15.7:6824/3045538953 12 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv36 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a9800 2024-04-25T10:04:58.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.010+0000 7f4cb2920740 10 datascan.scan_links: step 1: handling object 607.00000000 2024-04-25T10:04:58.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.010+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:39 17.1c 17:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629ee737000 2024-04-25T10:04:58.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.010+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 <== osd.1 v2:172.21.15.7:6816/434435857 4 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5629ee6dc000 con 0x5629ee737000 2024-04-25T10:04:58.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.010+0000 7f4cb2920740 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2024-04-25T10:04:58.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.010+0000 7f4cb2920740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-25T10:04:58.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.010+0000 7f4cb2920740 10 datascan.scan_links: step 1: handling object 608.00000000 2024-04-25T10:04:58.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.010+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:40 17.e 17:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd03000 con 0x5629ee8a8800 2024-04-25T10:04:58.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.011+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.2 v2:172.21.15.7:6808/1173474863 2 ==== osd_op_reply(40 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a8800 2024-04-25T10:04:58.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.011+0000 7f4cb2920740 10 datascan.scan_links: step 1: handling object 10000000005.00000000 2024-04-25T10:04:58.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.011+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:41 17.9 17:9258b67d:::10000000005.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd03400 con 0x5629ee8a9800 2024-04-25T10:04:58.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.011+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.3 v2:172.21.15.7:6824/3045538953 13 ==== osd_op_reply(41 10000000005.00000000 [omap-get-vals out=584b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+584 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a9800 2024-04-25T10:04:58.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.011+0000 7f4cb2920740 10 datascan.scan_links: step 1: handling object 604.00000000 2024-04-25T10:04:58.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.011+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:42 17.15 17:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd03800 con 0x5629ee8a8400 2024-04-25T10:04:58.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.011+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 <== osd.5 v2:172.21.15.55:6800/2514169616 4 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5629ee6dc000 con 0x5629ee8a8400 2024-04-25T10:04:58.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.011+0000 7f4cb2920740 10 datascan.scan_links: step 1: handling object 500.00000000 2024-04-25T10:04:58.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.011+0000 7f4cb2920740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-25T10:04:58.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.011+0000 7f4cb2920740 10 datascan.scan_links: step 1: handling object mds_snaptable 2024-04-25T10:04:58.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.011+0000 7f4cb2920740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-25T10:04:58.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.011+0000 7f4cb2920740 10 datascan.scan_links: step 1: handling object 605.00000000 2024-04-25T10:04:58.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.011+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:43 17.1d 17:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02000 con 0x5629ee8a9400 2024-04-25T10:04:58.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.012+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 <== osd.7 v2:172.21.15.55:6816/2960381217 7 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5629ee6dc000 con 0x5629ee8a9400 2024-04-25T10:04:58.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.012+0000 7f4cb2920740 10 datascan.scan_links: step 1: handling object mds0_inotable 2024-04-25T10:04:58.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.012+0000 7f4cb2920740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-25T10:04:58.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.012+0000 7f4cb2920740 10 datascan.scan_links: step 1: handling object 100.00000000 2024-04-25T10:04:58.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.012+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:44 17.13 17:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd03c00 con 0x5629ee8a9800 2024-04-25T10:04:58.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.012+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.3 v2:172.21.15.7:6824/3045538953 14 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5195b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a9800 2024-04-25T10:04:58.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.012+0000 7f4cb2920740 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2024-04-25T10:04:58.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.012+0000 7f4cb2920740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-25T10:04:58.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.012+0000 7f4cb2920740 10 datascan.scan_links: step 1: handling object 609.00000000 2024-04-25T10:04:58.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.012+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:45 17.7 17:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edcdb800 con 0x5629ee736800 2024-04-25T10:04:58.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.012+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 <== osd.0 v2:172.21.15.7:6800/4167741236 7 ==== osd_op_reply(45 609.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5629ee6dc780 con 0x5629ee736800 2024-04-25T10:04:58.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.012+0000 7f4cb2920740 10 datascan.scan_links: step 1: handling object 10000000001.00000000 2024-04-25T10:04:58.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.012+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:46 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edcdbc00 con 0x5629ee736800 2024-04-25T10:04:58.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.013+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 <== osd.0 v2:172.21.15.7:6800/4167741236 8 ==== osd_op_reply(46 10000000001.00000000 [omap-get-vals out=1667b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+1667 (crc 0 0 0) 0x5629ee6dc780 con 0x5629ee736800 2024-04-25T10:04:58.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.013+0000 7f4cb2920740 20 datascan.scan_links: injected ino detected 2024-04-25T10:04:58.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.013+0000 7f4cb2920740 10 datascan.scan_links: step 1: handling object 400.00000000 2024-04-25T10:04:58.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.013+0000 7f4cb2920740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-25T10:04:58.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.013+0000 7f4cb2920740 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2024-04-25T10:04:58.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.013+0000 7f4cb2920740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-25T10:04:58.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.013+0000 7f4cb2920740 10 datascan.scan_links: step 1: handling object 1.00000000 2024-04-25T10:04:58.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.013+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:47 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629ee8a9c00 con 0x5629edcda800 2024-04-25T10:04:58.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.013+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 <== osd.6 v2:172.21.15.55:6824/4293769515 5 ==== osd_op_reply(47 1.00000000 [omap-get-vals out=585b] v0'0 uv8 ondisk = 0) v8 ==== 154+0+585 (crc 0 0 0) 0x5629ee6dc780 con 0x5629edcda800 2024-04-25T10:04:58.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.013+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:48 17.0 17:00000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02400 con 0x5629ee8a9400 2024-04-25T10:04:58.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.014+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 <== osd.7 v2:172.21.15.55:6816/2960381217 8 ==== osd_op_reply(48 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc000 con 0x5629ee8a9400 2024-04-25T10:04:58.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.014+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:49 17.10 17:08000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629ee8a9800 2024-04-25T10:04:58.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.014+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.3 v2:172.21.15.7:6824/3045538953 15 ==== osd_op_reply(49 [pgnls start_epoch 119 out=177b] v118'16 uv16 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a9800 2024-04-25T10:04:58.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.014+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:50 17.8 17:10000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629ee8a9400 2024-04-25T10:04:58.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.014+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 <== osd.7 v2:172.21.15.55:6816/2960381217 9 ==== osd_op_reply(50 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc000 con 0x5629ee8a9400 2024-04-25T10:04:58.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.014+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:51 17.18 17:18000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629ee736800 2024-04-25T10:04:58.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.015+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 <== osd.0 v2:172.21.15.7:6800/4167741236 9 ==== osd_op_reply(51 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc780 con 0x5629ee736800 2024-04-25T10:04:58.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.015+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:52 17.4 17:20000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629ee736800 2024-04-25T10:04:58.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.015+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 <== osd.0 v2:172.21.15.7:6800/4167741236 10 ==== osd_op_reply(52 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc780 con 0x5629ee736800 2024-04-25T10:04:58.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.015+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:53 17.14 17:28000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629ee8a9800 2024-04-25T10:04:58.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.015+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.3 v2:172.21.15.7:6824/3045538953 16 ==== osd_op_reply(53 [pgnls start_epoch 119 out=149b] v119'41 uv41 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a9800 2024-04-25T10:04:58.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.015+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:54 17.c 17:30000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629ee8a9400 2024-04-25T10:04:58.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.015+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 <== osd.7 v2:172.21.15.55:6816/2960381217 10 ==== osd_op_reply(54 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc000 con 0x5629ee8a9400 2024-04-25T10:04:58.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.015+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:55 17.1c 17:38000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629ee737000 2024-04-25T10:04:58.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.016+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 <== osd.1 v2:172.21.15.7:6816/434435857 5 ==== osd_op_reply(55 [pgnls start_epoch 119 out=73b] v118'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5629ee6dc000 con 0x5629ee737000 2024-04-25T10:04:58.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.016+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:56 17.2 17:40000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629ee737400 2024-04-25T10:04:58.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.016+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.4 v2:172.21.15.55:6808/2248155105 4 ==== osd_op_reply(56 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee737400 2024-04-25T10:04:58.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.016+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:57 17.12 17:48000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629ee8a9800 2024-04-25T10:04:58.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.017+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.3 v2:172.21.15.7:6824/3045538953 17 ==== osd_op_reply(57 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a9800 2024-04-25T10:04:58.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.017+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:58 17.a 17:50000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629ee8a9400 2024-04-25T10:04:58.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.017+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 <== osd.7 v2:172.21.15.55:6816/2960381217 11 ==== osd_op_reply(58 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc000 con 0x5629ee8a9400 2024-04-25T10:04:58.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.017+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:59 17.1a 17:58000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629ee736800 2024-04-25T10:04:58.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.017+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 <== osd.0 v2:172.21.15.7:6800/4167741236 11 ==== osd_op_reply(59 [pgnls start_epoch 119 out=49b] v119'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc780 con 0x5629ee736800 2024-04-25T10:04:58.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.017+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:60 17.6 17:60000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629edcda800 2024-04-25T10:04:58.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.018+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 <== osd.6 v2:172.21.15.55:6824/4293769515 6 ==== osd_op_reply(60 [pgnls start_epoch 119 out=77b] v118'8 uv8 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x5629ee6dc780 con 0x5629edcda800 2024-04-25T10:04:58.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.018+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:61 17.16 17:68000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629ee8a8400 2024-04-25T10:04:58.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.018+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 <== osd.5 v2:172.21.15.55:6800/2514169616 5 ==== osd_op_reply(61 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc000 con 0x5629ee8a8400 2024-04-25T10:04:58.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.018+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:62 17.e 17:70000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629ee8a8800 2024-04-25T10:04:58.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.018+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.2 v2:172.21.15.7:6808/1173474863 3 ==== osd_op_reply(62 [pgnls start_epoch 119 out=73b] v118'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a8800 2024-04-25T10:04:58.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.018+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:63 17.1e 17:78000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629ee737000 2024-04-25T10:04:58.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.019+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 <== osd.1 v2:172.21.15.7:6816/434435857 6 ==== osd_op_reply(63 [pgnls start_epoch 119 out=49b] v119'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc000 con 0x5629ee737000 2024-04-25T10:04:58.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.019+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:64 17.1 17:80000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629ee736800 2024-04-25T10:04:58.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.019+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 <== osd.0 v2:172.21.15.7:6800/4167741236 12 ==== osd_op_reply(64 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc780 con 0x5629ee736800 2024-04-25T10:04:58.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.019+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:65 17.11 17:88000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629ee8a9800 2024-04-25T10:04:58.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.019+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.3 v2:172.21.15.7:6824/3045538953 18 ==== osd_op_reply(65 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a9800 2024-04-25T10:04:58.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.019+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:66 17.9 17:90000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629ee8a9800 2024-04-25T10:04:58.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.019+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.3 v2:172.21.15.7:6824/3045538953 19 ==== osd_op_reply(66 [pgnls start_epoch 119 out=81b] v118'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a9800 2024-04-25T10:04:58.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.019+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:67 17.19 17:98000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629ee8a8400 2024-04-25T10:04:58.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.020+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 <== osd.5 v2:172.21.15.55:6800/2514169616 6 ==== osd_op_reply(67 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc000 con 0x5629ee8a8400 2024-04-25T10:04:58.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.020+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:68 17.5 17:a0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629edcda800 2024-04-25T10:04:58.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.020+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 <== osd.6 v2:172.21.15.55:6824/4293769515 7 ==== osd_op_reply(68 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc780 con 0x5629edcda800 2024-04-25T10:04:58.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.020+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:69 17.15 17:a8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629ee8a8400 2024-04-25T10:04:58.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.020+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 <== osd.5 v2:172.21.15.55:6800/2514169616 7 ==== osd_op_reply(69 [pgnls start_epoch 119 out=97b] v118'4 uv4 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x5629ee6dc000 con 0x5629ee8a8400 2024-04-25T10:04:58.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.020+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:70 17.d 17:b0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629ee8a9400 2024-04-25T10:04:58.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.021+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 <== osd.7 v2:172.21.15.55:6816/2960381217 12 ==== osd_op_reply(70 [pgnls start_epoch 119 out=74b] v116'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x5629ee6dc000 con 0x5629ee8a9400 2024-04-25T10:04:58.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.021+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:71 17.1d 17:b8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629ee8a9400 2024-04-25T10:04:58.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.021+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 <== osd.7 v2:172.21.15.55:6816/2960381217 13 ==== osd_op_reply(71 [pgnls start_epoch 119 out=73b] v118'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5629ee6dc000 con 0x5629ee8a9400 2024-04-25T10:04:58.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.021+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:72 17.3 17:c0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629ee737400 2024-04-25T10:04:58.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.021+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.4 v2:172.21.15.55:6808/2248155105 5 ==== osd_op_reply(72 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee737400 2024-04-25T10:04:58.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.021+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:73 17.13 17:c8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629ee8a9800 2024-04-25T10:04:58.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.022+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.3 v2:172.21.15.7:6824/3045538953 20 ==== osd_op_reply(73 [pgnls start_epoch 119 out=98b] v118'5 uv5 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a9800 2024-04-25T10:04:58.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.022+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:74 17.b 17:d0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629ee736800 2024-04-25T10:04:58.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.022+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 <== osd.0 v2:172.21.15.7:6800/4167741236 13 ==== osd_op_reply(74 [pgnls start_epoch 119 out=76b] v119'6 uv5 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x5629ee6dc780 con 0x5629ee736800 2024-04-25T10:04:58.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.022+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- osd_op(unknown.0.0:75 17.1b 17:d8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629ee737400 2024-04-25T10:04:58.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.022+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.4 v2:172.21.15.55:6808/2248155105 6 ==== osd_op_reply(75 [pgnls start_epoch 119 out=49b] v119'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee737400 2024-04-25T10:04:58.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.022+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:76 17.7 17:e0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629ee736800 2024-04-25T10:04:58.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.023+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 <== osd.0 v2:172.21.15.7:6800/4167741236 14 ==== osd_op_reply(76 [pgnls start_epoch 119 out=105b] v119'9 uv9 ondisk = 1) v8 ==== 144+0+105 (crc 0 0 0) 0x5629ee6dc780 con 0x5629ee736800 2024-04-25T10:04:58.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.023+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:77 17.17 17:e8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629edcda800 2024-04-25T10:04:58.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.023+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 <== osd.6 v2:172.21.15.55:6824/4293769515 8 ==== osd_op_reply(77 [pgnls start_epoch 119 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ee6dc780 con 0x5629edcda800 2024-04-25T10:04:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.023+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:78 17.f 17:f0000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629ee737000 2024-04-25T10:04:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.023+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 <== osd.1 v2:172.21.15.7:6816/434435857 7 ==== osd_op_reply(78 [pgnls start_epoch 119 out=73b] v119'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5629ee6dc000 con 0x5629ee737000 2024-04-25T10:04:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.023+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:79 17.1f 17:f8000000::::head [pgnls start_epoch 119 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02c00 con 0x5629edcda800 2024-04-25T10:04:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.024+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 <== osd.6 v2:172.21.15.55:6824/4293769515 9 ==== osd_op_reply(79 [pgnls start_epoch 119 out=101b] v119'9 uv8 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x5629ee6dc780 con 0x5629edcda800 2024-04-25T10:04:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.024+0000 7f4cb2920740 10 datascan.scan_links: step 2: handling object 601.00000000 2024-04-25T10:04:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.024+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:80 17.10 17:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02800 con 0x5629ee8a9800 2024-04-25T10:04:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.024+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.3 v2:172.21.15.7:6824/3045538953 21 ==== osd_op_reply(80 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a9800 2024-04-25T10:04:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.024+0000 7f4cb2920740 10 datascan.scan_links: step 2: handling object 602.00000000 2024-04-25T10:04:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.024+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:81 17.10 17:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd03000 con 0x5629ee8a9800 2024-04-25T10:04:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.024+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.3 v2:172.21.15.7:6824/3045538953 22 ==== osd_op_reply(81 602.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a9800 2024-04-25T10:04:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.024+0000 7f4cb2920740 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2024-04-25T10:04:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.024+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:82 17.10 17:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd03400 con 0x5629ee8a9800 2024-04-25T10:04:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.024+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.3 v2:172.21.15.7:6824/3045538953 23 ==== osd_op_reply(82 10000000000.00000000 [omap-get-vals out=1169b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+1169 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a9800 2024-04-25T10:04:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.024+0000 7f4cb2920740 10 datascan.scan_links: step 2: handling object 600.00000000 2024-04-25T10:04:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.024+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:83 17.10 17:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd03c00 con 0x5629ee8a9800 2024-04-25T10:04:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.025+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.3 v2:172.21.15.7:6824/3045538953 24 ==== osd_op_reply(83 600.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a9800 2024-04-25T10:04:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.025+0000 7f4cb2920740 10 datascan.scan_links: step 2: handling object 603.00000000 2024-04-25T10:04:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.025+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:84 17.10 17:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd08000 con 0x5629ee8a9800 2024-04-25T10:04:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.025+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.3 v2:172.21.15.7:6824/3045538953 25 ==== osd_op_reply(84 603.00000000 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a9800 2024-04-25T10:04:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.025+0000 7f4cb2920740 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2024-04-25T10:04:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.025+0000 7f4cb2920740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-25T10:04:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.025+0000 7f4cb2920740 10 datascan.scan_links: step 2: handling object 200.00000000 2024-04-25T10:04:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.025+0000 7f4cb2920740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-25T10:04:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.025+0000 7f4cb2920740 10 datascan.scan_links: step 2: handling object 200.00000001 2024-04-25T10:04:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.025+0000 7f4cb2920740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-25T10:04:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.025+0000 7f4cb2920740 10 datascan.scan_links: step 2: handling object 606.00000000 2024-04-25T10:04:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.025+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:85 17.14 17:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd08400 con 0x5629ee8a9800 2024-04-25T10:04:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.025+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.3 v2:172.21.15.7:6824/3045538953 26 ==== osd_op_reply(85 606.00000000 [omap-get-vals out=5b] v0'0 uv36 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a9800 2024-04-25T10:04:58.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.025+0000 7f4cb2920740 10 datascan.scan_links: step 2: handling object 607.00000000 2024-04-25T10:04:58.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.025+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- osd_op(unknown.0.0:86 17.1c 17:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd08800 con 0x5629ee737000 2024-04-25T10:04:58.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.025+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 <== osd.1 v2:172.21.15.7:6816/434435857 8 ==== osd_op_reply(86 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5629ee6dc000 con 0x5629ee737000 2024-04-25T10:04:58.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.025+0000 7f4cb2920740 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2024-04-25T10:04:58.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.025+0000 7f4cb2920740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-25T10:04:58.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.025+0000 7f4cb2920740 10 datascan.scan_links: step 2: handling object 608.00000000 2024-04-25T10:04:58.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.025+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- osd_op(unknown.0.0:87 17.e 17:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd08c00 con 0x5629ee8a8800 2024-04-25T10:04:58.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.026+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.2 v2:172.21.15.7:6808/1173474863 4 ==== osd_op_reply(87 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a8800 2024-04-25T10:04:58.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.026+0000 7f4cb2920740 10 datascan.scan_links: step 2: handling object 10000000005.00000000 2024-04-25T10:04:58.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.026+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:88 17.9 17:9258b67d:::10000000005.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd09000 con 0x5629ee8a9800 2024-04-25T10:04:58.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.026+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.3 v2:172.21.15.7:6824/3045538953 27 ==== osd_op_reply(88 10000000005.00000000 [omap-get-vals out=584b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+584 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a9800 2024-04-25T10:04:58.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.026+0000 7f4cb2920740 10 datascan.scan_links: step 2: handling object 604.00000000 2024-04-25T10:04:58.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.026+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- osd_op(unknown.0.0:89 17.15 17:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd09400 con 0x5629ee8a8400 2024-04-25T10:04:58.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.026+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 <== osd.5 v2:172.21.15.55:6800/2514169616 8 ==== osd_op_reply(89 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5629ee6dc000 con 0x5629ee8a8400 2024-04-25T10:04:58.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.026+0000 7f4cb2920740 10 datascan.scan_links: step 2: handling object 500.00000000 2024-04-25T10:04:58.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.026+0000 7f4cb2920740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-25T10:04:58.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.026+0000 7f4cb2920740 10 datascan.scan_links: step 2: handling object mds_snaptable 2024-04-25T10:04:58.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.026+0000 7f4cb2920740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-25T10:04:58.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.026+0000 7f4cb2920740 10 datascan.scan_links: step 2: handling object 605.00000000 2024-04-25T10:04:58.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.027+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:90 17.1d 17:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd09800 con 0x5629ee8a9400 2024-04-25T10:04:58.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.027+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 <== osd.7 v2:172.21.15.55:6816/2960381217 14 ==== osd_op_reply(90 605.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5629ee6dc000 con 0x5629ee8a9400 2024-04-25T10:04:58.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.027+0000 7f4cb2920740 10 datascan.scan_links: step 2: handling object mds0_inotable 2024-04-25T10:04:58.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.027+0000 7f4cb2920740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-25T10:04:58.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.027+0000 7f4cb2920740 10 datascan.scan_links: step 2: handling object 100.00000000 2024-04-25T10:04:58.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.027+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:91 17.13 17:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd09c00 con 0x5629ee8a9800 2024-04-25T10:04:58.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.027+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.3 v2:172.21.15.7:6824/3045538953 28 ==== osd_op_reply(91 100.00000000 [omap-get-vals out=5195b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a9800 2024-04-25T10:04:58.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.027+0000 7f4cb2920740 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2024-04-25T10:04:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.027+0000 7f4cb2920740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-25T10:04:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.027+0000 7f4cb2920740 10 datascan.scan_links: step 2: handling object 609.00000000 2024-04-25T10:04:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.027+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:92 17.7 17:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd08800 con 0x5629ee736800 2024-04-25T10:04:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.027+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 <== osd.0 v2:172.21.15.7:6800/4167741236 15 ==== osd_op_reply(92 609.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5629ee6dc780 con 0x5629ee736800 2024-04-25T10:04:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.027+0000 7f4cb2920740 10 datascan.scan_links: step 2: handling object 10000000001.00000000 2024-04-25T10:04:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.027+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:93 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd09400 con 0x5629ee736800 2024-04-25T10:04:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.028+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 <== osd.0 v2:172.21.15.7:6800/4167741236 16 ==== osd_op_reply(93 10000000001.00000000 [omap-get-vals out=1667b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+1667 (crc 0 0 0) 0x5629ee6dc780 con 0x5629ee736800 2024-04-25T10:04:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.028+0000 7f4cb2920740 20 datascan.scan_links: injected ino detected 2024-04-25T10:04:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.028+0000 7f4cb2920740 20 datascan.scan_links: adding 0x10000000003 for future processing to fix dnfirst 2024-04-25T10:04:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.028+0000 7f4cb2920740 10 datascan.scan_links: step 2: handling object 400.00000000 2024-04-25T10:04:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.028+0000 7f4cb2920740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-25T10:04:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.028+0000 7f4cb2920740 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2024-04-25T10:04:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.028+0000 7f4cb2920740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-25T10:04:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.028+0000 7f4cb2920740 10 datascan.scan_links: step 2: handling object 1.00000000 2024-04-25T10:04:58.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.028+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- osd_op(unknown.0.0:94 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02400 con 0x5629edcda800 2024-04-25T10:04:58.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.028+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 <== osd.6 v2:172.21.15.55:6824/4293769515 10 ==== osd_op_reply(94 1.00000000 [omap-get-vals out=585b] v0'0 uv8 ondisk = 0) v8 ==== 154+0+585 (crc 0 0 0) 0x5629ee6dc780 con 0x5629edcda800 2024-04-25T10:04:58.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.028+0000 7f4cb2920740 10 datascan.scan_links: processing 0 dup_primaries, 0 remote_links 2024-04-25T10:04:58.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.028+0000 7f4cb2920740 10 datascan.scan_links: removing dup dentries from 0 objects 2024-04-25T10:04:58.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.028+0000 7f4cb2920740 10 datascan.scan_links: processing 0 bad_nlink_inos 2024-04-25T10:04:58.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.028+0000 7f4cb2920740 10 datascan.scan_links: processing 1 injected_inos 2024-04-25T10:04:58.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.028+0000 7f4cb2920740 10 datascan.scan_links: handling injected_ino 0x10000000003 2024-04-25T10:04:58.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.028+0000 7f4cb2920740 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000001:bravo 2024-04-25T10:04:58.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.028+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:95 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02000 con 0x5629ee736800 2024-04-25T10:04:58.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.029+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 <== osd.0 v2:172.21.15.7:6800/4167741236 17 ==== osd_op_reply(95 10000000001.00000000 [omap-get-vals-by-keys out=506b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+506 (crc 0 0 0) 0x5629ee6dc780 con 0x5629ee736800 2024-04-25T10:04:58.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.029+0000 7f4cb2920740 20 datascan.read_dentry: oid=10000000001.00000000 dname=bravo frag=*, r=0 2024-04-25T10:04:58.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.029+0000 7f4cb2920740 20 datascan.scan_links: first is now 2 2024-04-25T10:04:58.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.029+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- osd_op(unknown.0.0:96 17.7 17:e2e07930:::10000000001.00000000:head [omap-set-vals in=506b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd03800 con 0x5629ee736800 2024-04-25T10:04:58.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.030+0000 7f4cb07b2640 1 -- 172.21.15.7:0/1317583534 <== osd.0 v2:172.21.15.7:6800/4167741236 18 ==== osd_op_reply(96 10000000001.00000000 [omap-set-vals] v119'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5629ee6dc780 con 0x5629ee736800 2024-04-25T10:04:58.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.030+0000 7f4cb2920740 20 datascan.inject_linkage: Injected dentry 0x0x10000000001/bravo pointing to 0x0x10000000003 2024-04-25T10:04:58.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.030+0000 7f4cb2920740 10 datascan.scan_links: updating inotable 2024-04-25T10:04:58.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.030+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- osd_op(unknown.0.0:97 17.13 17:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd02800 con 0x5629ee8a9800 2024-04-25T10:04:58.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.030+0000 7f4cb0fb3640 1 -- 172.21.15.7:0/1317583534 <== osd.3 v2:172.21.15.7:6824/3045538953 29 ==== osd_op_reply(97 mds0_inotable [read 0~34 out=34b] v0'0 uv4 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x5629ee6dc500 con 0x5629ee8a9800 2024-04-25T10:04:58.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.030+0000 7f4cb2920740 10 datascan.scan_links: updating snaptable 2024-04-25T10:04:58.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.030+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- osd_op(unknown.0.0:98 17.d 17:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v9 -- 0x5629edd03000 con 0x5629ee8a9400 2024-04-25T10:04:58.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.031+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 <== osd.7 v2:172.21.15.55:6816/2960381217 15 ==== osd_op_reply(98 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) v8 ==== 157+0+70 (crc 0 0 0) 0x5629ee6dc000 con 0x5629ee8a9400 2024-04-25T10:04:58.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.031+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x5629ee736800 msgr2=0x5629edcdc580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.031+0000 7f4cb2920740 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x5629ee736800 0x5629edcdc580 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.031+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x5629ee737000 msgr2=0x5629edcdcb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.031+0000 7f4cb2920740 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x5629ee737000 0x5629edcdcb00 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.031+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x5629ee8a8800 msgr2=0x5629edcdd600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.031+0000 7f4cb2920740 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x5629ee8a8800 0x5629edcdd600 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.031+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x5629ee8a9800 msgr2=0x5629edcdc000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.031+0000 7f4cb2920740 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x5629ee8a9800 0x5629edcdc000 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.031+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x5629ee737400 msgr2=0x5629edcdd080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.031+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 reap_dead start 2024-04-25T10:04:58.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.031+0000 7f4cb2920740 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x5629ee737400 0x5629edcdd080 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.031+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x5629ee8a8400 msgr2=0x5629edcde680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.031+0000 7f4cb2920740 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x5629ee8a8400 0x5629edcde680 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.031+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x5629edcda800 msgr2=0x5629edcde100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.031+0000 7f4cb2920740 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x5629edcda800 0x5629edcde100 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.031+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x5629ee8a9400 msgr2=0x5629ed9ce100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.031+0000 7f4cb2920740 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x5629ee8a9400 0x5629ed9ce100 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.031+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x5629ee8a9000 msgr2=0x5629ed9cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.031+0000 7f4cb2920740 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x5629ee8a9000 0x5629ed9cf700 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x5629ee6f0e40 tx=0x5629ee83fec0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.031+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ee831000 msgr2=0x5629ed9cec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.031+0000 7f4cb2920740 1 --2- 172.21.15.7:0/1317583534 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ee831000 0x5629ed9cec00 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x5629ee81cde0 tx=0x5629ee83ec00 comp rx=0 tx=0).stop 2024-04-25T10:04:58.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.031+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 reap_dead start 2024-04-25T10:04:58.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.031+0000 7f4caffb1640 1 -- 172.21.15.7:0/1317583534 reap_dead start 2024-04-25T10:04:58.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.031+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 shutdown_connections 2024-04-25T10:04:58.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.031+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 >> 172.21.15.7:0/1317583534 conn(0x5629ee830800 msgr2=0x5629eda57000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:58.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.031+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 shutdown_connections 2024-04-25T10:04:58.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.031+0000 7f4cb2920740 1 -- 172.21.15.7:0/1317583534 wait complete. 2024-04-25T10:04:58.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.031+0000 7f4cb2920740 1 -- 172.21.15.7:0/747128734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ed95cc00 msgr2=0x5629ed9cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.031+0000 7f4cb2920740 1 --2- 172.21.15.7:0/747128734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ed95cc00 0x5629ed9cc580 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x5629ee76fcb0 tx=0x5629ee6ec4e0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.032+0000 7f4cb2920740 1 -- 172.21.15.7:0/747128734 shutdown_connections 2024-04-25T10:04:58.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.032+0000 7f4cb2920740 1 --2- 172.21.15.7:0/747128734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5629ed95dc00 0x5629ed9cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.032+0000 7f4cb2920740 1 --2- 172.21.15.7:0/747128734 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x5629ed95d800 0x5629ed9ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.032+0000 7f4cb2920740 1 --2- 172.21.15.7:0/747128734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ed95cc00 0x5629ed9cc580 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.032+0000 7f4cb2920740 1 -- 172.21.15.7:0/747128734 >> 172.21.15.7:0/747128734 conn(0x5629ed95d000 msgr2=0x5629eda56800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:58.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.032+0000 7f4cb2920740 1 -- 172.21.15.7:0/747128734 shutdown_connections 2024-04-25T10:04:58.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.032+0000 7f4cb2920740 1 -- 172.21.15.7:0/747128734 wait complete. 2024-04-25T10:04:58.064 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.145033, result: 2024-04-25T10:04:58.065 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T10:04:58.102 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T10:04:58.143 INFO:teuthology.orchestra.run.smithi007.stdout:[global] 2024-04-25T10:04:58.143 INFO:teuthology.orchestra.run.smithi007.stdout: chdir = "" 2024-04-25T10:04:58.143 INFO:teuthology.orchestra.run.smithi007.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T10:04:58.143 INFO:teuthology.orchestra.run.smithi007.stdout: auth supported = cephx 2024-04-25T10:04:58.143 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.143 INFO:teuthology.orchestra.run.smithi007.stdout: filestore xattr use omap = true 2024-04-25T10:04:58.143 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.143 INFO:teuthology.orchestra.run.smithi007.stdout: mon clock drift allowed = 1.000 2024-04-25T10:04:58.143 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.143 INFO:teuthology.orchestra.run.smithi007.stdout: osd crush chooseleaf type = 0 2024-04-25T10:04:58.143 INFO:teuthology.orchestra.run.smithi007.stdout: auth debug = true 2024-04-25T10:04:58.144 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.144 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on old message = true 2024-04-25T10:04:58.144 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on bug = true 2024-04-25T10:04:58.144 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.144 INFO:teuthology.orchestra.run.smithi007.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T10:04:58.144 INFO:teuthology.orchestra.run.smithi007.stdout: mon pg warn max object skew = 0 2024-04-25T10:04:58.144 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.144 INFO:teuthology.orchestra.run.smithi007.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T10:04:58.144 INFO:teuthology.orchestra.run.smithi007.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T10:04:58.144 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.144 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default size = 2 2024-04-25T10:04:58.144 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.144 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow primary affinity = true 2024-04-25T10:04:58.144 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow pg remap = true 2024-04-25T10:04:58.144 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on legacy crush tunables = false 2024-04-25T10:04:58.145 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on crush straw calc version zero = false 2024-04-25T10:04:58.145 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on no sortbitwise = false 2024-04-25T10:04:58.145 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on osd down out interval zero = false 2024-04-25T10:04:58.145 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on too few osds = false 2024-04-25T10:04:58.145 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T10:04:58.145 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T10:04:58.145 INFO:teuthology.orchestra.run.smithi007.stdout: mon_allow_pool_size_one = true 2024-04-25T10:04:58.145 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.145 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T10:04:58.145 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.145 INFO:teuthology.orchestra.run.smithi007.stdout: osd default data pool replay window = 5 2024-04-25T10:04:58.145 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.145 INFO:teuthology.orchestra.run.smithi007.stdout: mon allow pool delete = true 2024-04-25T10:04:58.145 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.145 INFO:teuthology.orchestra.run.smithi007.stdout: mon cluster log file level = debug 2024-04-25T10:04:58.146 INFO:teuthology.orchestra.run.smithi007.stdout: debug asserts on shutdown = true 2024-04-25T10:04:58.146 INFO:teuthology.orchestra.run.smithi007.stdout: mon health detail to clog = false 2024-04-25T10:04:58.146 INFO:teuthology.orchestra.run.smithi007.stdout: mon host = "172.21.15.7,172.21.15.55,[v2:172.21.15.55:3301,v1:172.21.15.55:6790]" 2024-04-25T10:04:58.146 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on skipped message = False 2024-04-25T10:04:58.146 INFO:teuthology.orchestra.run.smithi007.stdout: fsid = c03d0745-5946-49c3-ad88-1165c5b68b4e 2024-04-25T10:04:58.146 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.146 INFO:teuthology.orchestra.run.smithi007.stdout:[osd] 2024-04-25T10:04:58.146 INFO:teuthology.orchestra.run.smithi007.stdout: osd journal size = 100 2024-04-25T10:04:58.146 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.147 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub load threshold = 5.0 2024-04-25T10:04:58.147 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub max interval = 600 2024-04-25T10:04:58.147 INFO:teuthology.orchestra.run.smithi007.stdout: osd mclock profile = high_recovery_ops 2024-04-25T10:04:58.147 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.147 INFO:teuthology.orchestra.run.smithi007.stdout: osd recover clone overlap = true 2024-04-25T10:04:58.147 INFO:teuthology.orchestra.run.smithi007.stdout: osd recovery max chunk = 1048576 2024-04-25T10:04:58.147 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.147 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug shutdown = true 2024-04-25T10:04:58.147 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug op order = true 2024-04-25T10:04:58.147 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug verify stray on activate = true 2024-04-25T10:04:58.147 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug trim objects = true 2024-04-25T10:04:58.147 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.147 INFO:teuthology.orchestra.run.smithi007.stdout: osd open classes on start = true 2024-04-25T10:04:58.147 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug pg log writeout = true 2024-04-25T10:04:58.147 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.148 INFO:teuthology.orchestra.run.smithi007.stdout: osd deep scrub update digest min age = 30 2024-04-25T10:04:58.148 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.148 INFO:teuthology.orchestra.run.smithi007.stdout: osd map max advance = 10 2024-04-25T10:04:58.148 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.148 INFO:teuthology.orchestra.run.smithi007.stdout: journal zero on create = true 2024-04-25T10:04:58.148 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.148 INFO:teuthology.orchestra.run.smithi007.stdout: filestore ondisk finisher threads = 3 2024-04-25T10:04:58.148 INFO:teuthology.orchestra.run.smithi007.stdout: filestore apply finisher threads = 3 2024-04-25T10:04:58.148 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.148 INFO:teuthology.orchestra.run.smithi007.stdout: bdev debug aio = true 2024-04-25T10:04:58.148 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug misdirected ops = true 2024-04-25T10:04:58.148 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore block size = 96636764160 2024-04-25T10:04:58.148 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore fsck on mount = True 2024-04-25T10:04:58.148 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluefs = 20 2024-04-25T10:04:58.148 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluestore = 20 2024-04-25T10:04:58.149 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-04-25T10:04:58.149 INFO:teuthology.orchestra.run.smithi007.stdout: debug osd = 20 2024-04-25T10:04:58.149 INFO:teuthology.orchestra.run.smithi007.stdout: debug rocksdb = 10 2024-04-25T10:04:58.149 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T10:04:58.149 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd full ratio = 0.9 2024-04-25T10:04:58.149 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd nearfull ratio = 0.8 2024-04-25T10:04:58.149 INFO:teuthology.orchestra.run.smithi007.stdout: osd failsafe full ratio = 0.95 2024-04-25T10:04:58.149 INFO:teuthology.orchestra.run.smithi007.stdout: osd objectstore = bluestore 2024-04-25T10:04:58.149 INFO:teuthology.orchestra.run.smithi007.stdout: osd op complaint time = 180 2024-04-25T10:04:58.149 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.149 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr] 2024-04-25T10:04:58.149 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-04-25T10:04:58.149 INFO:teuthology.orchestra.run.smithi007.stdout: debug mgr = 20 2024-04-25T10:04:58.149 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2024-04-25T10:04:58.150 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2024-04-25T10:04:58.150 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:04:58.150 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:04:58.150 INFO:teuthology.orchestra.run.smithi007.stdout: mgr/telemetry/nag = false 2024-04-25T10:04:58.150 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.150 INFO:teuthology.orchestra.run.smithi007.stdout:[mon] 2024-04-25T10:04:58.150 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-04-25T10:04:58.150 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2024-04-25T10:04:58.150 INFO:teuthology.orchestra.run.smithi007.stdout: debug paxos = 20 2024-04-25T10:04:58.150 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2024-04-25T10:04:58.150 INFO:teuthology.orchestra.run.smithi007.stdout: mon data avail warn = 5 2024-04-25T10:04:58.150 INFO:teuthology.orchestra.run.smithi007.stdout: mon mgr mkfs grace = 240 2024-04-25T10:04:58.150 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:04:58.150 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd reporter subtree level = osd 2024-04-25T10:04:58.151 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd prime pg temp = true 2024-04-25T10:04:58.151 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:04:58.151 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.151 INFO:teuthology.orchestra.run.smithi007.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T10:04:58.151 INFO:teuthology.orchestra.run.smithi007.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T10:04:58.151 INFO:teuthology.orchestra.run.smithi007.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T10:04:58.151 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.151 INFO:teuthology.orchestra.run.smithi007.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T10:04:58.151 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T10:04:58.151 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T10:04:58.151 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.151 INFO:teuthology.orchestra.run.smithi007.stdout: # 1m isn't quite enough 2024-04-25T10:04:58.151 INFO:teuthology.orchestra.run.smithi007.stdout: mon_down_mkfs_grace = 2m 2024-04-25T10:04:58.151 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.151 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_filestore_osds = false 2024-04-25T10:04:58.152 INFO:teuthology.orchestra.run.smithi007.stdout: mon op complaint time = 120 2024-04-25T10:04:58.152 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.152 INFO:teuthology.orchestra.run.smithi007.stdout:[client] 2024-04-25T10:04:58.152 INFO:teuthology.orchestra.run.smithi007.stdout: rgw cache enabled = true 2024-04-25T10:04:58.152 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable ops log = true 2024-04-25T10:04:58.152 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable usage log = true 2024-04-25T10:04:58.152 INFO:teuthology.orchestra.run.smithi007.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T10:04:58.152 INFO:teuthology.orchestra.run.smithi007.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T10:04:58.152 INFO:teuthology.orchestra.run.smithi007.stdout: client mount timeout = 600 2024-04-25T10:04:58.152 INFO:teuthology.orchestra.run.smithi007.stdout: debug client = 20 2024-04-25T10:04:58.152 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-04-25T10:04:58.152 INFO:teuthology.orchestra.run.smithi007.stdout: pid file = "" 2024-04-25T10:04:58.152 INFO:teuthology.orchestra.run.smithi007.stdout: rados mon op timeout = 900 2024-04-25T10:04:58.152 INFO:teuthology.orchestra.run.smithi007.stdout: rados osd op timeout = 900 2024-04-25T10:04:58.152 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.a] 2024-04-25T10:04:58.153 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.b] 2024-04-25T10:04:58.153 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.c] 2024-04-25T10:04:58.153 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.a] 2024-04-25T10:04:58.153 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.c] 2024-04-25T10:04:58.153 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.b] 2024-04-25T10:04:58.153 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.d] 2024-04-25T10:04:58.153 INFO:teuthology.orchestra.run.smithi007.stdout:[mds] 2024-04-25T10:04:58.153 INFO:teuthology.orchestra.run.smithi007.stdout: debug mds = 20 2024-04-25T10:04:58.153 INFO:teuthology.orchestra.run.smithi007.stdout: debug mds balancer = 20 2024-04-25T10:04:58.153 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-04-25T10:04:58.153 INFO:teuthology.orchestra.run.smithi007.stdout: mds debug frag = True 2024-04-25T10:04:58.153 INFO:teuthology.orchestra.run.smithi007.stdout: mds debug scatterstat = False 2024-04-25T10:04:58.153 INFO:teuthology.orchestra.run.smithi007.stdout: mds op complaint time = 180 2024-04-25T10:04:58.153 INFO:teuthology.orchestra.run.smithi007.stdout: mds verify scatter = True 2024-04-25T10:04:58.153 INFO:teuthology.orchestra.run.smithi007.stdout: osd op complaint time = 180 2024-04-25T10:04:58.154 INFO:teuthology.orchestra.run.smithi007.stdout: rados mon op timeout = 900 2024-04-25T10:04:58.154 INFO:teuthology.orchestra.run.smithi007.stdout: rados osd op timeout = 900 2024-04-25T10:04:58.154 INFO:teuthology.orchestra.run.smithi055.stdout:[global] 2024-04-25T10:04:58.154 INFO:teuthology.orchestra.run.smithi055.stdout: chdir = "" 2024-04-25T10:04:58.154 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T10:04:58.154 INFO:teuthology.orchestra.run.smithi055.stdout: auth supported = cephx 2024-04-25T10:04:58.154 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.155 INFO:teuthology.orchestra.run.smithi055.stdout: filestore xattr use omap = true 2024-04-25T10:04:58.155 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.155 INFO:teuthology.orchestra.run.smithi055.stdout: mon clock drift allowed = 1.000 2024-04-25T10:04:58.155 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.155 INFO:teuthology.orchestra.run.smithi055.stdout: osd crush chooseleaf type = 0 2024-04-25T10:04:58.155 INFO:teuthology.orchestra.run.smithi055.stdout: auth debug = true 2024-04-25T10:04:58.155 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.155 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on old message = true 2024-04-25T10:04:58.155 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on bug = true 2024-04-25T10:04:58.155 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.155 INFO:teuthology.orchestra.run.smithi055.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T10:04:58.155 INFO:teuthology.orchestra.run.smithi055.stdout: mon pg warn max object skew = 0 2024-04-25T10:04:58.155 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.155 INFO:teuthology.orchestra.run.smithi055.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T10:04:58.156 INFO:teuthology.orchestra.run.smithi055.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T10:04:58.156 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.156 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default size = 2 2024-04-25T10:04:58.156 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.156 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow primary affinity = true 2024-04-25T10:04:58.156 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow pg remap = true 2024-04-25T10:04:58.156 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on legacy crush tunables = false 2024-04-25T10:04:58.156 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on crush straw calc version zero = false 2024-04-25T10:04:58.156 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on no sortbitwise = false 2024-04-25T10:04:58.156 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on osd down out interval zero = false 2024-04-25T10:04:58.156 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on too few osds = false 2024-04-25T10:04:58.156 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T10:04:58.156 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T10:04:58.156 INFO:teuthology.orchestra.run.smithi055.stdout: mon_allow_pool_size_one = true 2024-04-25T10:04:58.156 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.157 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T10:04:58.157 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.157 INFO:teuthology.orchestra.run.smithi055.stdout: osd default data pool replay window = 5 2024-04-25T10:04:58.157 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.157 INFO:teuthology.orchestra.run.smithi055.stdout: mon allow pool delete = true 2024-04-25T10:04:58.157 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.157 INFO:teuthology.orchestra.run.smithi055.stdout: mon cluster log file level = debug 2024-04-25T10:04:58.157 INFO:teuthology.orchestra.run.smithi055.stdout: debug asserts on shutdown = true 2024-04-25T10:04:58.157 INFO:teuthology.orchestra.run.smithi055.stdout: mon health detail to clog = false 2024-04-25T10:04:58.157 INFO:teuthology.orchestra.run.smithi055.stdout: mon host = "172.21.15.7,172.21.15.55,[v2:172.21.15.55:3301,v1:172.21.15.55:6790]" 2024-04-25T10:04:58.157 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on skipped message = False 2024-04-25T10:04:58.157 INFO:teuthology.orchestra.run.smithi055.stdout: fsid = c03d0745-5946-49c3-ad88-1165c5b68b4e 2024-04-25T10:04:58.157 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.157 INFO:teuthology.orchestra.run.smithi055.stdout:[osd] 2024-04-25T10:04:58.157 INFO:teuthology.orchestra.run.smithi055.stdout: osd journal size = 100 2024-04-25T10:04:58.158 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.158 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub load threshold = 5.0 2024-04-25T10:04:58.158 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub max interval = 600 2024-04-25T10:04:58.158 INFO:teuthology.orchestra.run.smithi055.stdout: osd mclock profile = high_recovery_ops 2024-04-25T10:04:58.158 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.158 INFO:teuthology.orchestra.run.smithi055.stdout: osd recover clone overlap = true 2024-04-25T10:04:58.158 INFO:teuthology.orchestra.run.smithi055.stdout: osd recovery max chunk = 1048576 2024-04-25T10:04:58.158 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.158 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug shutdown = true 2024-04-25T10:04:58.158 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug op order = true 2024-04-25T10:04:58.158 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug verify stray on activate = true 2024-04-25T10:04:58.158 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug trim objects = true 2024-04-25T10:04:58.158 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.158 INFO:teuthology.orchestra.run.smithi055.stdout: osd open classes on start = true 2024-04-25T10:04:58.159 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug pg log writeout = true 2024-04-25T10:04:58.159 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.159 INFO:teuthology.orchestra.run.smithi055.stdout: osd deep scrub update digest min age = 30 2024-04-25T10:04:58.159 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.159 INFO:teuthology.orchestra.run.smithi055.stdout: osd map max advance = 10 2024-04-25T10:04:58.159 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.159 INFO:teuthology.orchestra.run.smithi055.stdout: journal zero on create = true 2024-04-25T10:04:58.159 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.159 INFO:teuthology.orchestra.run.smithi055.stdout: filestore ondisk finisher threads = 3 2024-04-25T10:04:58.159 INFO:teuthology.orchestra.run.smithi055.stdout: filestore apply finisher threads = 3 2024-04-25T10:04:58.159 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.159 INFO:teuthology.orchestra.run.smithi055.stdout: bdev debug aio = true 2024-04-25T10:04:58.159 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug misdirected ops = true 2024-04-25T10:04:58.159 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore block size = 96636764160 2024-04-25T10:04:58.159 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore fsck on mount = True 2024-04-25T10:04:58.160 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluefs = 20 2024-04-25T10:04:58.160 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluestore = 20 2024-04-25T10:04:58.160 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T10:04:58.160 INFO:teuthology.orchestra.run.smithi055.stdout: debug osd = 20 2024-04-25T10:04:58.160 INFO:teuthology.orchestra.run.smithi055.stdout: debug rocksdb = 10 2024-04-25T10:04:58.160 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T10:04:58.160 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd full ratio = 0.9 2024-04-25T10:04:58.160 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd nearfull ratio = 0.8 2024-04-25T10:04:58.160 INFO:teuthology.orchestra.run.smithi055.stdout: osd failsafe full ratio = 0.95 2024-04-25T10:04:58.160 INFO:teuthology.orchestra.run.smithi055.stdout: osd objectstore = bluestore 2024-04-25T10:04:58.160 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-04-25T10:04:58.160 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.160 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr] 2024-04-25T10:04:58.160 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T10:04:58.161 INFO:teuthology.orchestra.run.smithi055.stdout: debug mgr = 20 2024-04-25T10:04:58.161 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-04-25T10:04:58.161 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-04-25T10:04:58.161 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:04:58.161 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:04:58.162 INFO:teuthology.orchestra.run.smithi055.stdout: mgr/telemetry/nag = false 2024-04-25T10:04:58.162 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.162 INFO:teuthology.orchestra.run.smithi055.stdout:[mon] 2024-04-25T10:04:58.162 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T10:04:58.162 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-04-25T10:04:58.162 INFO:teuthology.orchestra.run.smithi055.stdout: debug paxos = 20 2024-04-25T10:04:58.162 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-04-25T10:04:58.162 INFO:teuthology.orchestra.run.smithi055.stdout: mon data avail warn = 5 2024-04-25T10:04:58.162 INFO:teuthology.orchestra.run.smithi055.stdout: mon mgr mkfs grace = 240 2024-04-25T10:04:58.162 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:04:58.162 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd reporter subtree level = osd 2024-04-25T10:04:58.162 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd prime pg temp = true 2024-04-25T10:04:58.162 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:04:58.162 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.163 INFO:teuthology.orchestra.run.smithi055.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T10:04:58.163 INFO:teuthology.orchestra.run.smithi055.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T10:04:58.163 INFO:teuthology.orchestra.run.smithi055.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T10:04:58.163 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.163 INFO:teuthology.orchestra.run.smithi055.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T10:04:58.163 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T10:04:58.163 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T10:04:58.163 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.163 INFO:teuthology.orchestra.run.smithi055.stdout: # 1m isn't quite enough 2024-04-25T10:04:58.163 INFO:teuthology.orchestra.run.smithi055.stdout: mon_down_mkfs_grace = 2m 2024-04-25T10:04:58.163 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.163 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_filestore_osds = false 2024-04-25T10:04:58.163 INFO:teuthology.orchestra.run.smithi055.stdout: mon op complaint time = 120 2024-04-25T10:04:58.163 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.164 INFO:teuthology.orchestra.run.smithi055.stdout:[client] 2024-04-25T10:04:58.164 INFO:teuthology.orchestra.run.smithi055.stdout: rgw cache enabled = true 2024-04-25T10:04:58.164 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable ops log = true 2024-04-25T10:04:58.164 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable usage log = true 2024-04-25T10:04:58.164 INFO:teuthology.orchestra.run.smithi055.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T10:04:58.164 INFO:teuthology.orchestra.run.smithi055.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T10:04:58.164 INFO:teuthology.orchestra.run.smithi055.stdout: client mount timeout = 600 2024-04-25T10:04:58.164 INFO:teuthology.orchestra.run.smithi055.stdout: debug client = 20 2024-04-25T10:04:58.164 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T10:04:58.164 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = "" 2024-04-25T10:04:58.164 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-04-25T10:04:58.164 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-04-25T10:04:58.164 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.a] 2024-04-25T10:04:58.164 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.b] 2024-04-25T10:04:58.164 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.c] 2024-04-25T10:04:58.164 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2024-04-25T10:04:58.165 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2024-04-25T10:04:58.165 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2024-04-25T10:04:58.165 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2024-04-25T10:04:58.165 INFO:teuthology.orchestra.run.smithi055.stdout:[mds] 2024-04-25T10:04:58.165 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds = 20 2024-04-25T10:04:58.165 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds balancer = 20 2024-04-25T10:04:58.165 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T10:04:58.165 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug frag = True 2024-04-25T10:04:58.165 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug scatterstat = False 2024-04-25T10:04:58.165 INFO:teuthology.orchestra.run.smithi055.stdout: mds op complaint time = 180 2024-04-25T10:04:58.165 INFO:teuthology.orchestra.run.smithi055.stdout: mds verify scatter = True 2024-04-25T10:04:58.165 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-04-25T10:04:58.165 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-04-25T10:04:58.165 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-04-25T10:04:58.167 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T10:04:58.209 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T10:04:58.249 INFO:teuthology.orchestra.run.smithi007.stdout:[global] 2024-04-25T10:04:58.249 INFO:teuthology.orchestra.run.smithi007.stdout: chdir = "" 2024-04-25T10:04:58.249 INFO:teuthology.orchestra.run.smithi007.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T10:04:58.249 INFO:teuthology.orchestra.run.smithi007.stdout: auth supported = cephx 2024-04-25T10:04:58.249 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.249 INFO:teuthology.orchestra.run.smithi007.stdout: filestore xattr use omap = true 2024-04-25T10:04:58.249 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.249 INFO:teuthology.orchestra.run.smithi007.stdout: mon clock drift allowed = 1.000 2024-04-25T10:04:58.250 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.250 INFO:teuthology.orchestra.run.smithi007.stdout: osd crush chooseleaf type = 0 2024-04-25T10:04:58.250 INFO:teuthology.orchestra.run.smithi007.stdout: auth debug = true 2024-04-25T10:04:58.250 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.250 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on old message = true 2024-04-25T10:04:58.250 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on bug = true 2024-04-25T10:04:58.250 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.250 INFO:teuthology.orchestra.run.smithi007.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T10:04:58.250 INFO:teuthology.orchestra.run.smithi007.stdout: mon pg warn max object skew = 0 2024-04-25T10:04:58.250 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.250 INFO:teuthology.orchestra.run.smithi007.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T10:04:58.250 INFO:teuthology.orchestra.run.smithi007.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T10:04:58.250 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.250 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default size = 2 2024-04-25T10:04:58.250 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.251 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow primary affinity = true 2024-04-25T10:04:58.251 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow pg remap = true 2024-04-25T10:04:58.251 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on legacy crush tunables = false 2024-04-25T10:04:58.251 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on crush straw calc version zero = false 2024-04-25T10:04:58.251 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on no sortbitwise = false 2024-04-25T10:04:58.251 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on osd down out interval zero = false 2024-04-25T10:04:58.251 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on too few osds = false 2024-04-25T10:04:58.251 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T10:04:58.251 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T10:04:58.251 INFO:teuthology.orchestra.run.smithi007.stdout: mon_allow_pool_size_one = true 2024-04-25T10:04:58.251 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.251 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T10:04:58.251 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.251 INFO:teuthology.orchestra.run.smithi007.stdout: osd default data pool replay window = 5 2024-04-25T10:04:58.252 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.252 INFO:teuthology.orchestra.run.smithi007.stdout: mon allow pool delete = true 2024-04-25T10:04:58.252 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.252 INFO:teuthology.orchestra.run.smithi007.stdout: mon cluster log file level = debug 2024-04-25T10:04:58.252 INFO:teuthology.orchestra.run.smithi007.stdout: debug asserts on shutdown = true 2024-04-25T10:04:58.252 INFO:teuthology.orchestra.run.smithi007.stdout: mon health detail to clog = false 2024-04-25T10:04:58.252 INFO:teuthology.orchestra.run.smithi007.stdout: mon host = "172.21.15.7,172.21.15.55,[v2:172.21.15.55:3301,v1:172.21.15.55:6790]" 2024-04-25T10:04:58.252 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on skipped message = False 2024-04-25T10:04:58.252 INFO:teuthology.orchestra.run.smithi007.stdout: fsid = c03d0745-5946-49c3-ad88-1165c5b68b4e 2024-04-25T10:04:58.252 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.252 INFO:teuthology.orchestra.run.smithi007.stdout:[osd] 2024-04-25T10:04:58.252 INFO:teuthology.orchestra.run.smithi007.stdout: osd journal size = 100 2024-04-25T10:04:58.252 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.252 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub load threshold = 5.0 2024-04-25T10:04:58.252 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub max interval = 600 2024-04-25T10:04:58.253 INFO:teuthology.orchestra.run.smithi007.stdout: osd mclock profile = high_recovery_ops 2024-04-25T10:04:58.253 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.253 INFO:teuthology.orchestra.run.smithi007.stdout: osd recover clone overlap = true 2024-04-25T10:04:58.253 INFO:teuthology.orchestra.run.smithi007.stdout: osd recovery max chunk = 1048576 2024-04-25T10:04:58.253 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.253 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug shutdown = true 2024-04-25T10:04:58.253 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug op order = true 2024-04-25T10:04:58.253 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug verify stray on activate = true 2024-04-25T10:04:58.253 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug trim objects = true 2024-04-25T10:04:58.253 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.253 INFO:teuthology.orchestra.run.smithi007.stdout: osd open classes on start = true 2024-04-25T10:04:58.253 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug pg log writeout = true 2024-04-25T10:04:58.253 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.253 INFO:teuthology.orchestra.run.smithi007.stdout: osd deep scrub update digest min age = 30 2024-04-25T10:04:58.253 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.254 INFO:teuthology.orchestra.run.smithi007.stdout: osd map max advance = 10 2024-04-25T10:04:58.254 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.254 INFO:teuthology.orchestra.run.smithi007.stdout: journal zero on create = true 2024-04-25T10:04:58.254 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.254 INFO:teuthology.orchestra.run.smithi007.stdout: filestore ondisk finisher threads = 3 2024-04-25T10:04:58.254 INFO:teuthology.orchestra.run.smithi007.stdout: filestore apply finisher threads = 3 2024-04-25T10:04:58.254 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.254 INFO:teuthology.orchestra.run.smithi007.stdout: bdev debug aio = true 2024-04-25T10:04:58.255 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug misdirected ops = true 2024-04-25T10:04:58.255 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore block size = 96636764160 2024-04-25T10:04:58.255 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore fsck on mount = True 2024-04-25T10:04:58.255 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluefs = 20 2024-04-25T10:04:58.255 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluestore = 20 2024-04-25T10:04:58.255 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-04-25T10:04:58.255 INFO:teuthology.orchestra.run.smithi007.stdout: debug osd = 20 2024-04-25T10:04:58.255 INFO:teuthology.orchestra.run.smithi007.stdout: debug rocksdb = 10 2024-04-25T10:04:58.255 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T10:04:58.256 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd full ratio = 0.9 2024-04-25T10:04:58.256 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd nearfull ratio = 0.8 2024-04-25T10:04:58.256 INFO:teuthology.orchestra.run.smithi007.stdout: osd failsafe full ratio = 0.95 2024-04-25T10:04:58.256 INFO:teuthology.orchestra.run.smithi007.stdout: osd objectstore = bluestore 2024-04-25T10:04:58.256 INFO:teuthology.orchestra.run.smithi007.stdout: osd op complaint time = 180 2024-04-25T10:04:58.256 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.256 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr] 2024-04-25T10:04:58.256 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-04-25T10:04:58.256 INFO:teuthology.orchestra.run.smithi007.stdout: debug mgr = 20 2024-04-25T10:04:58.256 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2024-04-25T10:04:58.256 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2024-04-25T10:04:58.256 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:04:58.256 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:04:58.256 INFO:teuthology.orchestra.run.smithi007.stdout: mgr/telemetry/nag = false 2024-04-25T10:04:58.256 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.256 INFO:teuthology.orchestra.run.smithi007.stdout:[mon] 2024-04-25T10:04:58.257 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-04-25T10:04:58.257 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2024-04-25T10:04:58.257 INFO:teuthology.orchestra.run.smithi007.stdout: debug paxos = 20 2024-04-25T10:04:58.257 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2024-04-25T10:04:58.257 INFO:teuthology.orchestra.run.smithi007.stdout: mon data avail warn = 5 2024-04-25T10:04:58.257 INFO:teuthology.orchestra.run.smithi007.stdout: mon mgr mkfs grace = 240 2024-04-25T10:04:58.257 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:04:58.257 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd reporter subtree level = osd 2024-04-25T10:04:58.257 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd prime pg temp = true 2024-04-25T10:04:58.257 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:04:58.257 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.257 INFO:teuthology.orchestra.run.smithi007.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T10:04:58.257 INFO:teuthology.orchestra.run.smithi007.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T10:04:58.257 INFO:teuthology.orchestra.run.smithi007.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T10:04:58.257 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.258 INFO:teuthology.orchestra.run.smithi007.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T10:04:58.258 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T10:04:58.258 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T10:04:58.258 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.258 INFO:teuthology.orchestra.run.smithi007.stdout: # 1m isn't quite enough 2024-04-25T10:04:58.258 INFO:teuthology.orchestra.run.smithi007.stdout: mon_down_mkfs_grace = 2m 2024-04-25T10:04:58.258 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.258 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_filestore_osds = false 2024-04-25T10:04:58.258 INFO:teuthology.orchestra.run.smithi007.stdout: mon op complaint time = 120 2024-04-25T10:04:58.258 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:58.258 INFO:teuthology.orchestra.run.smithi007.stdout:[client] 2024-04-25T10:04:58.258 INFO:teuthology.orchestra.run.smithi007.stdout: rgw cache enabled = true 2024-04-25T10:04:58.258 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable ops log = true 2024-04-25T10:04:58.258 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable usage log = true 2024-04-25T10:04:58.259 INFO:teuthology.orchestra.run.smithi007.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T10:04:58.259 INFO:teuthology.orchestra.run.smithi007.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T10:04:58.259 INFO:teuthology.orchestra.run.smithi007.stdout: client mount timeout = 600 2024-04-25T10:04:58.259 INFO:teuthology.orchestra.run.smithi007.stdout: debug client = 20 2024-04-25T10:04:58.259 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-04-25T10:04:58.259 INFO:teuthology.orchestra.run.smithi007.stdout: pid file = "" 2024-04-25T10:04:58.259 INFO:teuthology.orchestra.run.smithi007.stdout: rados mon op timeout = 900 2024-04-25T10:04:58.259 INFO:teuthology.orchestra.run.smithi007.stdout: rados osd op timeout = 900 2024-04-25T10:04:58.259 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.a] 2024-04-25T10:04:58.259 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.b] 2024-04-25T10:04:58.259 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.c] 2024-04-25T10:04:58.259 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.a] 2024-04-25T10:04:58.259 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.c] 2024-04-25T10:04:58.259 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.b] 2024-04-25T10:04:58.259 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.d] 2024-04-25T10:04:58.260 INFO:teuthology.orchestra.run.smithi007.stdout:[mds] 2024-04-25T10:04:58.260 INFO:teuthology.orchestra.run.smithi007.stdout: debug mds = 20 2024-04-25T10:04:58.260 INFO:teuthology.orchestra.run.smithi007.stdout: debug mds balancer = 20 2024-04-25T10:04:58.260 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-04-25T10:04:58.260 INFO:teuthology.orchestra.run.smithi007.stdout: mds debug frag = True 2024-04-25T10:04:58.260 INFO:teuthology.orchestra.run.smithi007.stdout: mds debug scatterstat = True 2024-04-25T10:04:58.260 INFO:teuthology.orchestra.run.smithi007.stdout: mds op complaint time = 180 2024-04-25T10:04:58.260 INFO:teuthology.orchestra.run.smithi007.stdout: mds verify scatter = True 2024-04-25T10:04:58.260 INFO:teuthology.orchestra.run.smithi007.stdout: osd op complaint time = 180 2024-04-25T10:04:58.260 INFO:teuthology.orchestra.run.smithi007.stdout: rados mon op timeout = 900 2024-04-25T10:04:58.260 INFO:teuthology.orchestra.run.smithi007.stdout: rados osd op timeout = 900 2024-04-25T10:04:58.261 INFO:teuthology.orchestra.run.smithi055.stdout:[global] 2024-04-25T10:04:58.261 INFO:teuthology.orchestra.run.smithi055.stdout: chdir = "" 2024-04-25T10:04:58.261 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T10:04:58.261 INFO:teuthology.orchestra.run.smithi055.stdout: auth supported = cephx 2024-04-25T10:04:58.261 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.261 INFO:teuthology.orchestra.run.smithi055.stdout: filestore xattr use omap = true 2024-04-25T10:04:58.261 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.261 INFO:teuthology.orchestra.run.smithi055.stdout: mon clock drift allowed = 1.000 2024-04-25T10:04:58.261 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.262 INFO:teuthology.orchestra.run.smithi055.stdout: osd crush chooseleaf type = 0 2024-04-25T10:04:58.262 INFO:teuthology.orchestra.run.smithi055.stdout: auth debug = true 2024-04-25T10:04:58.262 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.262 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on old message = true 2024-04-25T10:04:58.262 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on bug = true 2024-04-25T10:04:58.262 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.262 INFO:teuthology.orchestra.run.smithi055.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T10:04:58.262 INFO:teuthology.orchestra.run.smithi055.stdout: mon pg warn max object skew = 0 2024-04-25T10:04:58.262 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.262 INFO:teuthology.orchestra.run.smithi055.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T10:04:58.262 INFO:teuthology.orchestra.run.smithi055.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T10:04:58.262 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.262 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default size = 2 2024-04-25T10:04:58.262 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.262 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow primary affinity = true 2024-04-25T10:04:58.263 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow pg remap = true 2024-04-25T10:04:58.263 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on legacy crush tunables = false 2024-04-25T10:04:58.263 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on crush straw calc version zero = false 2024-04-25T10:04:58.263 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on no sortbitwise = false 2024-04-25T10:04:58.263 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on osd down out interval zero = false 2024-04-25T10:04:58.263 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on too few osds = false 2024-04-25T10:04:58.263 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T10:04:58.263 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T10:04:58.263 INFO:teuthology.orchestra.run.smithi055.stdout: mon_allow_pool_size_one = true 2024-04-25T10:04:58.263 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.263 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T10:04:58.263 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.263 INFO:teuthology.orchestra.run.smithi055.stdout: osd default data pool replay window = 5 2024-04-25T10:04:58.263 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.264 INFO:teuthology.orchestra.run.smithi055.stdout: mon allow pool delete = true 2024-04-25T10:04:58.264 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.264 INFO:teuthology.orchestra.run.smithi055.stdout: mon cluster log file level = debug 2024-04-25T10:04:58.264 INFO:teuthology.orchestra.run.smithi055.stdout: debug asserts on shutdown = true 2024-04-25T10:04:58.264 INFO:teuthology.orchestra.run.smithi055.stdout: mon health detail to clog = false 2024-04-25T10:04:58.264 INFO:teuthology.orchestra.run.smithi055.stdout: mon host = "172.21.15.7,172.21.15.55,[v2:172.21.15.55:3301,v1:172.21.15.55:6790]" 2024-04-25T10:04:58.264 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on skipped message = False 2024-04-25T10:04:58.264 INFO:teuthology.orchestra.run.smithi055.stdout: fsid = c03d0745-5946-49c3-ad88-1165c5b68b4e 2024-04-25T10:04:58.264 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.264 INFO:teuthology.orchestra.run.smithi055.stdout:[osd] 2024-04-25T10:04:58.264 INFO:teuthology.orchestra.run.smithi055.stdout: osd journal size = 100 2024-04-25T10:04:58.264 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.264 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub load threshold = 5.0 2024-04-25T10:04:58.264 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub max interval = 600 2024-04-25T10:04:58.264 INFO:teuthology.orchestra.run.smithi055.stdout: osd mclock profile = high_recovery_ops 2024-04-25T10:04:58.265 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.265 INFO:teuthology.orchestra.run.smithi055.stdout: osd recover clone overlap = true 2024-04-25T10:04:58.265 INFO:teuthology.orchestra.run.smithi055.stdout: osd recovery max chunk = 1048576 2024-04-25T10:04:58.265 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.265 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug shutdown = true 2024-04-25T10:04:58.265 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug op order = true 2024-04-25T10:04:58.265 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug verify stray on activate = true 2024-04-25T10:04:58.265 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug trim objects = true 2024-04-25T10:04:58.265 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.265 INFO:teuthology.orchestra.run.smithi055.stdout: osd open classes on start = true 2024-04-25T10:04:58.265 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug pg log writeout = true 2024-04-25T10:04:58.265 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.265 INFO:teuthology.orchestra.run.smithi055.stdout: osd deep scrub update digest min age = 30 2024-04-25T10:04:58.265 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.265 INFO:teuthology.orchestra.run.smithi055.stdout: osd map max advance = 10 2024-04-25T10:04:58.265 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.266 INFO:teuthology.orchestra.run.smithi055.stdout: journal zero on create = true 2024-04-25T10:04:58.266 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.266 INFO:teuthology.orchestra.run.smithi055.stdout: filestore ondisk finisher threads = 3 2024-04-25T10:04:58.266 INFO:teuthology.orchestra.run.smithi055.stdout: filestore apply finisher threads = 3 2024-04-25T10:04:58.266 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.266 INFO:teuthology.orchestra.run.smithi055.stdout: bdev debug aio = true 2024-04-25T10:04:58.266 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug misdirected ops = true 2024-04-25T10:04:58.266 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore block size = 96636764160 2024-04-25T10:04:58.266 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore fsck on mount = True 2024-04-25T10:04:58.266 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluefs = 20 2024-04-25T10:04:58.266 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluestore = 20 2024-04-25T10:04:58.266 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T10:04:58.266 INFO:teuthology.orchestra.run.smithi055.stdout: debug osd = 20 2024-04-25T10:04:58.266 INFO:teuthology.orchestra.run.smithi055.stdout: debug rocksdb = 10 2024-04-25T10:04:58.266 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T10:04:58.267 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd full ratio = 0.9 2024-04-25T10:04:58.267 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd nearfull ratio = 0.8 2024-04-25T10:04:58.267 INFO:teuthology.orchestra.run.smithi055.stdout: osd failsafe full ratio = 0.95 2024-04-25T10:04:58.267 INFO:teuthology.orchestra.run.smithi055.stdout: osd objectstore = bluestore 2024-04-25T10:04:58.267 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-04-25T10:04:58.267 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.267 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr] 2024-04-25T10:04:58.267 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T10:04:58.267 INFO:teuthology.orchestra.run.smithi055.stdout: debug mgr = 20 2024-04-25T10:04:58.267 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-04-25T10:04:58.267 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-04-25T10:04:58.267 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:04:58.267 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:04:58.267 INFO:teuthology.orchestra.run.smithi055.stdout: mgr/telemetry/nag = false 2024-04-25T10:04:58.267 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.268 INFO:teuthology.orchestra.run.smithi055.stdout:[mon] 2024-04-25T10:04:58.268 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T10:04:58.268 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-04-25T10:04:58.268 INFO:teuthology.orchestra.run.smithi055.stdout: debug paxos = 20 2024-04-25T10:04:58.268 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-04-25T10:04:58.268 INFO:teuthology.orchestra.run.smithi055.stdout: mon data avail warn = 5 2024-04-25T10:04:58.268 INFO:teuthology.orchestra.run.smithi055.stdout: mon mgr mkfs grace = 240 2024-04-25T10:04:58.268 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:04:58.268 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd reporter subtree level = osd 2024-04-25T10:04:58.268 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd prime pg temp = true 2024-04-25T10:04:58.268 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:04:58.268 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.268 INFO:teuthology.orchestra.run.smithi055.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T10:04:58.268 INFO:teuthology.orchestra.run.smithi055.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T10:04:58.268 INFO:teuthology.orchestra.run.smithi055.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T10:04:58.268 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.269 INFO:teuthology.orchestra.run.smithi055.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T10:04:58.269 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T10:04:58.269 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T10:04:58.269 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.269 INFO:teuthology.orchestra.run.smithi055.stdout: # 1m isn't quite enough 2024-04-25T10:04:58.269 INFO:teuthology.orchestra.run.smithi055.stdout: mon_down_mkfs_grace = 2m 2024-04-25T10:04:58.269 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.269 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_filestore_osds = false 2024-04-25T10:04:58.269 INFO:teuthology.orchestra.run.smithi055.stdout: mon op complaint time = 120 2024-04-25T10:04:58.269 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-25T10:04:58.269 INFO:teuthology.orchestra.run.smithi055.stdout:[client] 2024-04-25T10:04:58.269 INFO:teuthology.orchestra.run.smithi055.stdout: rgw cache enabled = true 2024-04-25T10:04:58.269 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable ops log = true 2024-04-25T10:04:58.269 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable usage log = true 2024-04-25T10:04:58.269 INFO:teuthology.orchestra.run.smithi055.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T10:04:58.270 INFO:teuthology.orchestra.run.smithi055.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T10:04:58.270 INFO:teuthology.orchestra.run.smithi055.stdout: client mount timeout = 600 2024-04-25T10:04:58.270 INFO:teuthology.orchestra.run.smithi055.stdout: debug client = 20 2024-04-25T10:04:58.270 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T10:04:58.270 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = "" 2024-04-25T10:04:58.270 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-04-25T10:04:58.270 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-04-25T10:04:58.270 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.a] 2024-04-25T10:04:58.270 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.b] 2024-04-25T10:04:58.270 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.c] 2024-04-25T10:04:58.270 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2024-04-25T10:04:58.270 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2024-04-25T10:04:58.270 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2024-04-25T10:04:58.270 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2024-04-25T10:04:58.271 INFO:teuthology.orchestra.run.smithi055.stdout:[mds] 2024-04-25T10:04:58.271 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds = 20 2024-04-25T10:04:58.271 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds balancer = 20 2024-04-25T10:04:58.271 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-25T10:04:58.271 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug frag = True 2024-04-25T10:04:58.271 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug scatterstat = True 2024-04-25T10:04:58.271 INFO:teuthology.orchestra.run.smithi055.stdout: mds op complaint time = 180 2024-04-25T10:04:58.271 INFO:teuthology.orchestra.run.smithi055.stdout: mds verify scatter = True 2024-04-25T10:04:58.271 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-04-25T10:04:58.271 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-04-25T10:04:58.271 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-04-25T10:04:58.273 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T10:04:58.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.410+0000 7f3d5d5e2640 1 Processor -- start 2024-04-25T10:04:58.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.410+0000 7f3d5d5e2640 1 -- start start 2024-04-25T10:04:58.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.411+0000 7f3d5d5e2640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3d5815deb0 0x7f3d580b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.411+0000 7f3d5d5e2640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3d580d3760 0x7f3d580d3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.411+0000 7f3d5d5e2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d580d1a40 con 0x7f3d580ce030 2024-04-25T10:04:58.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.411+0000 7f3d5d5e2640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d580d1d20 con 0x7f3d580d3760 2024-04-25T10:04:58.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.411+0000 7f3d5d5e2640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d580d2000 con 0x7f3d5815deb0 2024-04-25T10:04:58.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.411+0000 7f3d577fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3d580d3760 0x7f3d580d3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.411+0000 7f3d577fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3d580d3760 0x7f3d580d3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47780/0 (socket says 172.21.15.7:47780) 2024-04-25T10:04:58.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.411+0000 7f3d577fe640 1 -- 172.21.15.7:0/2956209951 learned_addr learned my addr 172.21.15.7:0/2956209951 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:58.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.411+0000 7f3d577fe640 1 -- 172.21.15.7:0/2956209951 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3d5815deb0 msgr2=0x7f3d580b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:58.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.411+0000 7f3d577fe640 1 --2- 172.21.15.7:0/2956209951 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3d5815deb0 0x7f3d580b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.411+0000 7f3d577fe640 1 -- 172.21.15.7:0/2956209951 >> v1:172.21.15.55:6789/0 conn(0x7f3d580ce030 legacy=0x7f3d580b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:58.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.411+0000 7f3d577fe640 1 -- 172.21.15.7:0/2956209951 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d580d22e0 con 0x7f3d580d3760 2024-04-25T10:04:58.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.412+0000 7f3d577fe640 1 --2- 172.21.15.7:0/2956209951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d580d3760 0x7f3d580d3bf0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f3d50009e50 tx=0x7f3d5002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=193bb9ce5b58bcba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.412+0000 7f3d567fc640 1 -- 172.21.15.7:0/2956209951 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50036070 con 0x7f3d580d3760 2024-04-25T10:04:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.412+0000 7f3d567fc640 1 -- 172.21.15.7:0/2956209951 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d50031600 con 0x7f3d580d3760 2024-04-25T10:04:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.412+0000 7f3d567fc640 1 -- 172.21.15.7:0/2956209951 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d500319d0 con 0x7f3d580d3760 2024-04-25T10:04:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.412+0000 7f3d5d5e2640 1 -- 172.21.15.7:0/2956209951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d580d3760 msgr2=0x7f3d580d3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.413+0000 7f3d5d5e2640 1 --2- 172.21.15.7:0/2956209951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d580d3760 0x7f3d580d3bf0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f3d50009e50 tx=0x7f3d5002a6c0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.413+0000 7f3d5d5e2640 1 -- 172.21.15.7:0/2956209951 shutdown_connections 2024-04-25T10:04:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.413+0000 7f3d5d5e2640 1 --2- 172.21.15.7:0/2956209951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d580d3760 0x7f3d580d3bf0 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.413+0000 7f3d5d5e2640 1 --2- 172.21.15.7:0/2956209951 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3d5815deb0 0x7f3d580b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.413+0000 7f3d5d5e2640 1 -- 172.21.15.7:0/2956209951 >> 172.21.15.7:0/2956209951 conn(0x7f3d580726b0 msgr2=0x7f3d58072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.413+0000 7f3d5d5e2640 1 -- 172.21.15.7:0/2956209951 shutdown_connections 2024-04-25T10:04:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.413+0000 7f3d5d5e2640 1 -- 172.21.15.7:0/2956209951 wait complete. 2024-04-25T10:04:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.414+0000 7f3d5d5e2640 1 Processor -- start 2024-04-25T10:04:58.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.414+0000 7f3d5d5e2640 1 -- start start 2024-04-25T10:04:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.415+0000 7f3d5d5e2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d580ce030 0x7f3d5814fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.415+0000 7f3d5d5e2640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3d580d3760 0x7f3d5815f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.415+0000 7f3d5d5e2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d5815deb0 0x7f3d580c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.415+0000 7f3d5d5e2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d580b70f0 con 0x7f3d580ce030 2024-04-25T10:04:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.415+0000 7f3d5d5e2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d580ce490 con 0x7f3d5815deb0 2024-04-25T10:04:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.415+0000 7f3d5d5e2640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d580d2ae0 con 0x7f3d580d3760 2024-04-25T10:04:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.415+0000 7f3d56ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d580ce030 0x7f3d5814fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.415+0000 7f3d56ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d580ce030 0x7f3d5814fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47786/0 (socket says 172.21.15.7:47786) 2024-04-25T10:04:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.415+0000 7f3d56ffd640 1 -- 172.21.15.7:0/3312485460 learned_addr learned my addr 172.21.15.7:0/3312485460 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.415+0000 7f3d4e7fc640 1 --2- 172.21.15.7:0/3312485460 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3d580d3760 0x7f3d5815f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.415+0000 7f3d56ffd640 1 -- 172.21.15.7:0/3312485460 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3d580d3760 msgr2=0x7f3d5815f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.415+0000 7f3d577fe640 1 --2- 172.21.15.7:0/3312485460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d5815deb0 0x7f3d580c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.415+0000 7f3d56ffd640 1 --2- 172.21.15.7:0/3312485460 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3d580d3760 0x7f3d5815f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.415+0000 7f3d56ffd640 1 -- 172.21.15.7:0/3312485460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d5815deb0 msgr2=0x7f3d580c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.415+0000 7f3d56ffd640 1 --2- 172.21.15.7:0/3312485460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d5815deb0 0x7f3d580c9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.415+0000 7f3d56ffd640 1 -- 172.21.15.7:0/3312485460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5815ff20 con 0x7f3d580ce030 2024-04-25T10:04:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.415+0000 7f3d56ffd640 1 --2- 172.21.15.7:0/3312485460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d580ce030 0x7f3d5814fd10 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f3d4800b440 tx=0x7f3d4800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.415+0000 7f3d4ffff640 1 -- 172.21.15.7:0/3312485460 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d48015020 con 0x7f3d580ce030 2024-04-25T10:04:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.416+0000 7f3d4ffff640 1 -- 172.21.15.7:0/3312485460 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d48011890 con 0x7f3d580ce030 2024-04-25T10:04:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.416+0000 7f3d4ffff640 1 -- 172.21.15.7:0/3312485460 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d48011c80 con 0x7f3d580ce030 2024-04-25T10:04:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.416+0000 7f3d5d5e2640 1 -- 172.21.15.7:0/3312485460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d58160200 con 0x7f3d580ce030 2024-04-25T10:04:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.416+0000 7f3d5d5e2640 1 -- 172.21.15.7:0/3312485460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d581607c0 con 0x7f3d580ce030 2024-04-25T10:04:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.417+0000 7f3d5d5e2640 1 -- 172.21.15.7:0/3312485460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d58068f60 con 0x7f3d580ce030 2024-04-25T10:04:58.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.417+0000 7f3d4ffff640 1 -- 172.21.15.7:0/3312485460 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3d48018020 con 0x7f3d580ce030 2024-04-25T10:04:58.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.417+0000 7f3d4ffff640 1 --2- 172.21.15.7:0/3312485460 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3d3806b4d0 0x7f3d3806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.417+0000 7f3d4ffff640 1 -- 172.21.15.7:0/3312485460 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f3d4808a590 con 0x7f3d580ce030 2024-04-25T10:04:58.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.418+0000 7f3d4e7fc640 1 --2- 172.21.15.7:0/3312485460 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3d3806b4d0 0x7f3d3806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.418+0000 7f3d4e7fc640 1 --2- 172.21.15.7:0/3312485460 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3d3806b4d0 0x7f3d3806d990 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f3d580b2590 tx=0x7f3d40009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.422+0000 7f3d4ffff640 1 -- 172.21.15.7:0/3312485460 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3d4801f020 con 0x7f3d580ce030 2024-04-25T10:04:58.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:58.642+0000 7f3d5d5e2640 1 -- 172.21.15.7:0/3312485460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f3d580d2fb0 con 0x7f3d580ce030 2024-04-25T10:04:59.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.521+0000 7f3d4ffff640 1 -- 172.21.15.7:0/3312485460 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v97) v1 ==== 162+0+0 (secure 0 0 0) 0x7f3d4800d040 con 0x7f3d580ce030 2024-04-25T10:04:59.527 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T10:04:59.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.524+0000 7f3d5d5e2640 1 -- 172.21.15.7:0/3312485460 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3d3806b4d0 msgr2=0x7f3d3806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:59.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.524+0000 7f3d5d5e2640 1 --2- 172.21.15.7:0/3312485460 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3d3806b4d0 0x7f3d3806d990 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f3d580b2590 tx=0x7f3d40009040 comp rx=0 tx=0).stop 2024-04-25T10:04:59.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.524+0000 7f3d5d5e2640 1 -- 172.21.15.7:0/3312485460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d580ce030 msgr2=0x7f3d5814fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:59.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.524+0000 7f3d5d5e2640 1 --2- 172.21.15.7:0/3312485460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d580ce030 0x7f3d5814fd10 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f3d4800b440 tx=0x7f3d4800b900 comp rx=0 tx=0).stop 2024-04-25T10:04:59.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.524+0000 7f3d5d5e2640 1 -- 172.21.15.7:0/3312485460 shutdown_connections 2024-04-25T10:04:59.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.524+0000 7f3d5d5e2640 1 --2- 172.21.15.7:0/3312485460 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f3d3806b4d0 0x7f3d3806d990 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:59.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.524+0000 7f3d5d5e2640 1 --2- 172.21.15.7:0/3312485460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d5815deb0 0x7f3d580c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:59.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.524+0000 7f3d5d5e2640 1 --2- 172.21.15.7:0/3312485460 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3d580d3760 0x7f3d5815f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:59.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.524+0000 7f3d5d5e2640 1 --2- 172.21.15.7:0/3312485460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d580ce030 0x7f3d5814fd10 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:59.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.524+0000 7f3d5d5e2640 1 -- 172.21.15.7:0/3312485460 >> 172.21.15.7:0/3312485460 conn(0x7f3d580726b0 msgr2=0x7f3d580c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:59.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.524+0000 7f3d5d5e2640 1 -- 172.21.15.7:0/3312485460 shutdown_connections 2024-04-25T10:04:59.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.524+0000 7f3d5d5e2640 1 -- 172.21.15.7:0/3312485460 wait complete. 2024-04-25T10:04:59.543 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:04:59.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.645+0000 7f1c4ae6f640 1 Processor -- start 2024-04-25T10:04:59.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.645+0000 7f1c4ae6f640 1 -- start start 2024-04-25T10:04:59.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.646+0000 7f1c4ae6f640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1c4406c680 0x7f1c4406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:59.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.646+0000 7f1c4ae6f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c440cbc90 0x7f1c440cc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:59.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.646+0000 7f1c4ae6f640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c44099b90 con 0x7f1c440cd740 2024-04-25T10:04:59.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.646+0000 7f1c4ae6f640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c440cdb20 con 0x7f1c4406c680 2024-04-25T10:04:59.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.646+0000 7f1c4ae6f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c44099e70 con 0x7f1c440cbc90 2024-04-25T10:04:59.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.646+0000 7f1c43fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1c4406c680 0x7f1c4406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:59.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.646+0000 7f1c48c0b640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1c440cd740 0x7f1c440d0390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:35812/0 (socket says 172.21.15.7:35812) 2024-04-25T10:04:59.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.646+0000 7f1c43fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1c4406c680 0x7f1c4406cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47792/0 (socket says 172.21.15.7:47792) 2024-04-25T10:04:59.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.646+0000 7f1c48c0b640 1 -- 172.21.15.7:0/3293126185 learned_addr learned my addr 172.21.15.7:0/3293126185 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:04:59.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.647+0000 7f1c4940c640 1 --2- 172.21.15.7:0/3293126185 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c440cbc90 0x7f1c440cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:59.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.647+0000 7f1c43fff640 1 -- 172.21.15.7:0/3293126185 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c440cbc90 msgr2=0x7f1c440cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:59.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.647+0000 7f1c43fff640 1 --2- 172.21.15.7:0/3293126185 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c440cbc90 0x7f1c440cc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:59.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.647+0000 7f1c43fff640 1 -- 172.21.15.7:0/3293126185 >> v1:172.21.15.7:6789/0 conn(0x7f1c440cd740 legacy=0x7f1c440d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:59.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.647+0000 7f1c437fe640 1 -- 172.21.15.7:0/3293126185 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 413385226 0 0) 0x7f1c44099b90 con 0x7f1c440cd740 2024-04-25T10:04:59.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.647+0000 7f1c43fff640 1 -- 172.21.15.7:0/3293126185 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4409a150 con 0x7f1c4406c680 2024-04-25T10:04:59.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.647+0000 7f1c4940c640 1 --2- 172.21.15.7:0/3293126185 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c440cbc90 0x7f1c440cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:59.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.647+0000 7f1c43fff640 1 --2- 172.21.15.7:0/3293126185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c4406c680 0x7f1c4406cb10 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c0097a0 tx=0x7f1c2c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ac2a273b57c779 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:59.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.648+0000 7f1c437fe640 1 -- 172.21.15.7:0/3293126185 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c037070 con 0x7f1c4406c680 2024-04-25T10:04:59.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.648+0000 7f1c437fe640 1 -- 172.21.15.7:0/3293126185 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2c032440 con 0x7f1c4406c680 2024-04-25T10:04:59.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.648+0000 7f1c437fe640 1 -- 172.21.15.7:0/3293126185 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c032810 con 0x7f1c4406c680 2024-04-25T10:04:59.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.648+0000 7f1c4ae6f640 1 -- 172.21.15.7:0/3293126185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c4406c680 msgr2=0x7f1c4406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:59.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.648+0000 7f1c4ae6f640 1 --2- 172.21.15.7:0/3293126185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c4406c680 0x7f1c4406cb10 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c0097a0 tx=0x7f1c2c02a180 comp rx=0 tx=0).stop 2024-04-25T10:04:59.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.648+0000 7f1c4ae6f640 1 -- 172.21.15.7:0/3293126185 shutdown_connections 2024-04-25T10:04:59.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.648+0000 7f1c4ae6f640 1 --2- 172.21.15.7:0/3293126185 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c440cbc90 0x7f1c440cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:59.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.648+0000 7f1c4ae6f640 1 --2- 172.21.15.7:0/3293126185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c4406c680 0x7f1c4406cb10 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:59.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.648+0000 7f1c4ae6f640 1 -- 172.21.15.7:0/3293126185 >> 172.21.15.7:0/3293126185 conn(0x7f1c440b3130 msgr2=0x7f1c440b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:59.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.648+0000 7f1c4ae6f640 1 -- 172.21.15.7:0/3293126185 shutdown_connections 2024-04-25T10:04:59.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.648+0000 7f1c4ae6f640 1 -- 172.21.15.7:0/3293126185 wait complete. 2024-04-25T10:04:59.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.649+0000 7f1c4ae6f640 1 Processor -- start 2024-04-25T10:04:59.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.649+0000 7f1c4ae6f640 1 -- start start 2024-04-25T10:04:59.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.650+0000 7f1c4ae6f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c4406c680 0x7f1c440cb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:59.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.650+0000 7f1c4ae6f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c440cbc90 0x7f1c441574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:59.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.650+0000 7f1c4ae6f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c440cd740 0x7f1c440c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.650+0000 7f1c4ae6f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4409ac30 con 0x7f1c4406c680 2024-04-25T10:04:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.650+0000 7f1c4ae6f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4409a710 con 0x7f1c440cbc90 2024-04-25T10:04:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.650+0000 7f1c4ae6f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4409adb0 con 0x7f1c440cd740 2024-04-25T10:04:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.650+0000 7f1c48c0b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c4406c680 0x7f1c440cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.650+0000 7f1c48c0b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c4406c680 0x7f1c440cb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47806/0 (socket says 172.21.15.7:47806) 2024-04-25T10:04:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.650+0000 7f1c48c0b640 1 -- 172.21.15.7:0/931630780 learned_addr learned my addr 172.21.15.7:0/931630780 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:04:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.651+0000 7f1c4940c640 1 --2- 172.21.15.7:0/931630780 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c440cd740 0x7f1c440c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.651+0000 7f1c43fff640 1 --2- 172.21.15.7:0/931630780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c440cbc90 0x7f1c441574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.651+0000 7f1c48c0b640 1 -- 172.21.15.7:0/931630780 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c440cd740 msgr2=0x7f1c440c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.651+0000 7f1c48c0b640 1 --2- 172.21.15.7:0/931630780 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c440cd740 0x7f1c440c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.651+0000 7f1c48c0b640 1 -- 172.21.15.7:0/931630780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c440cbc90 msgr2=0x7f1c441574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.651+0000 7f1c48c0b640 1 --2- 172.21.15.7:0/931630780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c440cbc90 0x7f1c441574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:59.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.651+0000 7f1c48c0b640 1 -- 172.21.15.7:0/931630780 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c440c92c0 con 0x7f1c4406c680 2024-04-25T10:04:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.651+0000 7f1c4940c640 1 --2- 172.21.15.7:0/931630780 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c440cd740 0x7f1c440c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.651+0000 7f1c43fff640 1 --2- 172.21.15.7:0/931630780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c440cbc90 0x7f1c441574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.651+0000 7f1c48c0b640 1 --2- 172.21.15.7:0/931630780 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c4406c680 0x7f1c440cb230 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00c890 tx=0x7f1c3c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.651+0000 7f1c417fa640 1 -- 172.21.15.7:0/931630780 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c018070 con 0x7f1c4406c680 2024-04-25T10:04:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.651+0000 7f1c417fa640 1 -- 172.21.15.7:0/931630780 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3c00a640 con 0x7f1c4406c680 2024-04-25T10:04:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.651+0000 7f1c4ae6f640 1 -- 172.21.15.7:0/931630780 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c4415dbd0 con 0x7f1c4406c680 2024-04-25T10:04:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.651+0000 7f1c417fa640 1 -- 172.21.15.7:0/931630780 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c00aa30 con 0x7f1c4406c680 2024-04-25T10:04:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.651+0000 7f1c4ae6f640 1 -- 172.21.15.7:0/931630780 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c440afb90 con 0x7f1c4406c680 2024-04-25T10:04:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.652+0000 7f1c4ae6f640 1 -- 172.21.15.7:0/931630780 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c44068fd0 con 0x7f1c4406c680 2024-04-25T10:04:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.653+0000 7f1c417fa640 1 -- 172.21.15.7:0/931630780 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1c3c01b070 con 0x7f1c4406c680 2024-04-25T10:04:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.653+0000 7f1c417fa640 1 --2- 172.21.15.7:0/931630780 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1c2406b4d0 0x7f1c2406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.653+0000 7f1c417fa640 1 -- 172.21.15.7:0/931630780 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f1c3c089ae0 con 0x7f1c4406c680 2024-04-25T10:04:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.653+0000 7f1c43fff640 1 --2- 172.21.15.7:0/931630780 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1c2406b4d0 0x7f1c2406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:59.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.654+0000 7f1c43fff640 1 --2- 172.21.15.7:0/931630780 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1c2406b4d0 0x7f1c2406d990 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c034000 tx=0x7f1c2c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:59.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.657+0000 7f1c417fa640 1 -- 172.21.15.7:0/931630780 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1c3c058720 con 0x7f1c4406c680 2024-04-25T10:04:59.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.876+0000 7f1c4ae6f640 1 -- 172.21.15.7:0/931630780 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c440afdd0 con 0x7f1c4406c680 2024-04-25T10:04:59.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.876+0000 7f1c417fa640 1 -- 172.21.15.7:0/931630780 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4936 (secure 0 0 0) 0x7f1c3c058020 con 0x7f1c4406c680 2024-04-25T10:04:59.882 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:04:59.882 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":98,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6992,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2679200172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2679200172},{"type":"v1","addr":"172.21.15.7:6837","nonce":2679200172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":7942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/4039147179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":4039147179},{"type":"v1","addr":"172.21.15.55:6833","nonce":4039147179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":7945,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3456170359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3456170359},{"type":"v1","addr":"172.21.15.55:6835","nonce":3456170359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:04:29.599245+0000","modified":"2024-04-25T10:04:59.524894+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9492":{"gid":9492,"name":"a","rank":0,"incarnation":98,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6836/1326211296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1326211296},{"type":"v1","addr":"172.21.15.7:6836","nonce":1326211296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T10:04:59.882 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 98 2024-04-25T10:04:59.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.878+0000 7f1c4ae6f640 1 -- 172.21.15.7:0/931630780 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1c2406b4d0 msgr2=0x7f1c2406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:59.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.878+0000 7f1c4ae6f640 1 --2- 172.21.15.7:0/931630780 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1c2406b4d0 0x7f1c2406d990 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c034000 tx=0x7f1c2c02e000 comp rx=0 tx=0).stop 2024-04-25T10:04:59.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.878+0000 7f1c4ae6f640 1 -- 172.21.15.7:0/931630780 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c4406c680 msgr2=0x7f1c440cb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:59.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.878+0000 7f1c4ae6f640 1 --2- 172.21.15.7:0/931630780 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c4406c680 0x7f1c440cb230 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00c890 tx=0x7f1c3c00cd50 comp rx=0 tx=0).stop 2024-04-25T10:04:59.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.878+0000 7f1c4ae6f640 1 -- 172.21.15.7:0/931630780 shutdown_connections 2024-04-25T10:04:59.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.878+0000 7f1c4ae6f640 1 --2- 172.21.15.7:0/931630780 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1c2406b4d0 0x7f1c2406d990 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:59.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.878+0000 7f1c4ae6f640 1 --2- 172.21.15.7:0/931630780 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c440cd740 0x7f1c440c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:59.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.878+0000 7f1c4ae6f640 1 --2- 172.21.15.7:0/931630780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c440cbc90 0x7f1c441574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:59.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.878+0000 7f1c4ae6f640 1 --2- 172.21.15.7:0/931630780 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c4406c680 0x7f1c440cb230 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:59.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.878+0000 7f1c4ae6f640 1 -- 172.21.15.7:0/931630780 >> 172.21.15.7:0/931630780 conn(0x7f1c440b3130 msgr2=0x7f1c4406cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:59.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.878+0000 7f1c4ae6f640 1 -- 172.21.15.7:0/931630780 shutdown_connections 2024-04-25T10:04:59.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:04:59.878+0000 7f1c4ae6f640 1 -- 172.21.15.7:0/931630780 wait complete. 2024-04-25T10:05:00.297 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 98, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:04:29.599245+0000', 'modified': '2024-04-25T10:04:59.524894+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 119, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9492}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9492': {'gid': 9492, 'name': 'a', 'rank': 0, 'incarnation': 98, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.7:6836/1326211296', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 1326211296}, {'type': 'v1', 'addr': '172.21.15.7:6836', 'nonce': 1326211296}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:05:00.297 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9492:up:replay 2024-04-25T10:05:01.297 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:05:01.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.405+0000 7fc0f7d22640 1 Processor -- start 2024-04-25T10:05:01.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.406+0000 7fc0f7d22640 1 -- start start 2024-04-25T10:05:01.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.406+0000 7fc0f7d22640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc0f00d0aa0 0x7fc0f0161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:01.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.406+0000 7fc0f7d22640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f015e8a0 con 0x7fc0f015da60 2024-04-25T10:05:01.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.406+0000 7fc0f7d22640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f015eb80 con 0x7fc0f01622b0 2024-04-25T10:05:01.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.406+0000 7fc0f7d22640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0f015ee60 con 0x7fc0f00d0aa0 2024-04-25T10:05:01.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.406+0000 7fc0f52bd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc0f00d0aa0 0x7fc0f0161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:01.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.407+0000 7fc0f52bd640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc0f00d0aa0 0x7fc0f0161d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38096/0 (socket says 172.21.15.7:38096) 2024-04-25T10:05:01.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.407+0000 7fc0f52bd640 1 -- 172.21.15.7:0/1088998640 learned_addr learned my addr 172.21.15.7:0/1088998640 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:01.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.407+0000 7fc0f5abe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc0f015da60 0x7fc0f015de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37628/0 (socket says 172.21.15.7:37628) 2024-04-25T10:05:01.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.407+0000 7fc0f52bd640 1 -- 172.21.15.7:0/1088998640 >> v1:172.21.15.55:6789/0 conn(0x7fc0f01622b0 legacy=0x7fc0f00ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:01.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.407+0000 7fc0f52bd640 1 -- 172.21.15.7:0/1088998640 >> v1:172.21.15.7:6789/0 conn(0x7fc0f015da60 legacy=0x7fc0f015de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:01.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.407+0000 7fc0f52bd640 1 -- 172.21.15.7:0/1088998640 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f0161850 con 0x7fc0f00d0aa0 2024-04-25T10:05:01.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.407+0000 7fc0f4abc640 1 -- 172.21.15.7:0/1088998640 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271965096 0 0) 0x7fc0f015e8a0 con 0x7fc0f015da60 2024-04-25T10:05:01.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.408+0000 7fc0f52bd640 1 --2- 172.21.15.7:0/1088998640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0f00d0aa0 0x7fc0f0161d70 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4009870 tx=0x7fc0e402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb27c3acf2a3eac4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:01.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.408+0000 7fc0f4abc640 1 -- 172.21.15.7:0/1088998640 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e4037070 con 0x7fc0f00d0aa0 2024-04-25T10:05:01.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.408+0000 7fc0f4abc640 1 -- 172.21.15.7:0/1088998640 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e4032440 con 0x7fc0f00d0aa0 2024-04-25T10:05:01.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.408+0000 7fc0f4abc640 1 -- 172.21.15.7:0/1088998640 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e4032810 con 0x7fc0f00d0aa0 2024-04-25T10:05:01.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.408+0000 7fc0f7d22640 1 -- 172.21.15.7:0/1088998640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0f00d0aa0 msgr2=0x7fc0f0161d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:01.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.408+0000 7fc0f7d22640 1 --2- 172.21.15.7:0/1088998640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0f00d0aa0 0x7fc0f0161d70 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4009870 tx=0x7fc0e402a210 comp rx=0 tx=0).stop 2024-04-25T10:05:01.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.408+0000 7fc0f7d22640 1 -- 172.21.15.7:0/1088998640 shutdown_connections 2024-04-25T10:05:01.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.408+0000 7fc0f7d22640 1 --2- 172.21.15.7:0/1088998640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0f00d0aa0 0x7fc0f0161d70 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:01.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.408+0000 7fc0f7d22640 1 -- 172.21.15.7:0/1088998640 >> 172.21.15.7:0/1088998640 conn(0x7fc0f006bfe0 msgr2=0x7fc0f006c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:01.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.408+0000 7fc0f7d22640 1 -- 172.21.15.7:0/1088998640 shutdown_connections 2024-04-25T10:05:01.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.409+0000 7fc0f7d22640 1 -- 172.21.15.7:0/1088998640 wait complete. 2024-04-25T10:05:01.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.410+0000 7fc0f7d22640 1 Processor -- start 2024-04-25T10:05:01.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.410+0000 7fc0f7d22640 1 -- start start 2024-04-25T10:05:01.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.410+0000 7fc0f7d22640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0f00d0aa0 0x7fc0f00ab3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:01.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.410+0000 7fc0f7d22640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0f015da60 0x7fc0f0150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:01.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.410+0000 7fc0f7d22640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc0f01622b0 0x7fc0f00cc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:01.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.410+0000 7fc0f7d22640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f00cedb0 con 0x7fc0f015da60 2024-04-25T10:05:01.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.410+0000 7fc0f7d22640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f00cec30 con 0x7fc0f00d0aa0 2024-04-25T10:05:01.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.410+0000 7fc0f7d22640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f00d2ca0 con 0x7fc0f01622b0 2024-04-25T10:05:01.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.411+0000 7fc0f52bd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0f015da60 0x7fc0f0150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:01.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.411+0000 7fc0f52bd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0f015da60 0x7fc0f0150dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38104/0 (socket says 172.21.15.7:38104) 2024-04-25T10:05:01.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.411+0000 7fc0f52bd640 1 -- 172.21.15.7:0/3727907834 learned_addr learned my addr 172.21.15.7:0/3727907834 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:01.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.411+0000 7fc0f5abe640 1 --2- 172.21.15.7:0/3727907834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0f00d0aa0 0x7fc0f00ab3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:01.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.411+0000 7fc0f62bf640 1 --2- 172.21.15.7:0/3727907834 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc0f01622b0 0x7fc0f00cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:01.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.411+0000 7fc0f52bd640 1 -- 172.21.15.7:0/3727907834 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc0f01622b0 msgr2=0x7fc0f00cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:01.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.411+0000 7fc0f52bd640 1 --2- 172.21.15.7:0/3727907834 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc0f01622b0 0x7fc0f00cc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:01.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.411+0000 7fc0f52bd640 1 -- 172.21.15.7:0/3727907834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0f00d0aa0 msgr2=0x7fc0f00ab3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:01.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.411+0000 7fc0f52bd640 1 --2- 172.21.15.7:0/3727907834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0f00d0aa0 0x7fc0f00ab3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:01.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.411+0000 7fc0f52bd640 1 -- 172.21.15.7:0/3727907834 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f00ccc90 con 0x7fc0f015da60 2024-04-25T10:05:01.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.411+0000 7fc0f52bd640 1 --2- 172.21.15.7:0/3727907834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0f015da60 0x7fc0f0150dc0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4009870 tx=0x7fc0e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:01.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.411+0000 7fc0ee7fc640 1 -- 172.21.15.7:0/3727907834 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e4037040 con 0x7fc0f015da60 2024-04-25T10:05:01.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.411+0000 7fc0ee7fc640 1 -- 172.21.15.7:0/3727907834 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e4004250 con 0x7fc0f015da60 2024-04-25T10:05:01.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.411+0000 7fc0f7d22640 1 -- 172.21.15.7:0/3727907834 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f00ccf10 con 0x7fc0f015da60 2024-04-25T10:05:01.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.411+0000 7fc0ee7fc640 1 -- 172.21.15.7:0/3727907834 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e403c670 con 0x7fc0f015da60 2024-04-25T10:05:01.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.411+0000 7fc0f7d22640 1 -- 172.21.15.7:0/3727907834 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f00cd4d0 con 0x7fc0f015da60 2024-04-25T10:05:01.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.412+0000 7fc0f7d22640 1 -- 172.21.15.7:0/3727907834 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f0068fd0 con 0x7fc0f015da60 2024-04-25T10:05:01.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.413+0000 7fc0ee7fc640 1 -- 172.21.15.7:0/3727907834 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc0e403a070 con 0x7fc0f015da60 2024-04-25T10:05:01.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.413+0000 7fc0ee7fc640 1 --2- 172.21.15.7:0/3727907834 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc0dc06b4d0 0x7fc0dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:01.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.413+0000 7fc0ee7fc640 1 -- 172.21.15.7:0/3727907834 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fc0e40aaca0 con 0x7fc0f015da60 2024-04-25T10:05:01.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.413+0000 7fc0f5abe640 1 --2- 172.21.15.7:0/3727907834 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc0dc06b4d0 0x7fc0dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:01.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.414+0000 7fc0f5abe640 1 --2- 172.21.15.7:0/3727907834 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc0dc06b4d0 0x7fc0dc06d990 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8000f60 tx=0x7fc0e8007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:01.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.418+0000 7fc0ee7fc640 1 -- 172.21.15.7:0/3727907834 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc0f00ccc90 con 0x7fc0f015da60 2024-04-25T10:05:01.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.638+0000 7fc0f7d22640 1 -- 172.21.15.7:0/3727907834 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0f00d1560 con 0x7fc0f015da60 2024-04-25T10:05:01.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.638+0000 7fc0ee7fc640 1 -- 172.21.15.7:0/3727907834 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+4938 (secure 0 0 0) 0x7fc0e4041020 con 0x7fc0f015da60 2024-04-25T10:05:01.644 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:05:01.644 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":100,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6992,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2679200172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2679200172},{"type":"v1","addr":"172.21.15.7:6837","nonce":2679200172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":7942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/4039147179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":4039147179},{"type":"v1","addr":"172.21.15.55:6833","nonce":4039147179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":7945,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3456170359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3456170359},{"type":"v1","addr":"172.21.15.55:6835","nonce":3456170359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:04:29.599245+0000","modified":"2024-04-25T10:05:00.547479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9492":{"gid":9492,"name":"a","rank":0,"incarnation":98,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.7:6836/1326211296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1326211296},{"type":"v1","addr":"172.21.15.7:6836","nonce":1326211296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T10:05:01.644 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 100 2024-04-25T10:05:01.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.640+0000 7fc0f7d22640 1 -- 172.21.15.7:0/3727907834 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc0dc06b4d0 msgr2=0x7fc0dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:01.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.640+0000 7fc0f7d22640 1 --2- 172.21.15.7:0/3727907834 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc0dc06b4d0 0x7fc0dc06d990 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8000f60 tx=0x7fc0e8007d50 comp rx=0 tx=0).stop 2024-04-25T10:05:01.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.640+0000 7fc0f7d22640 1 -- 172.21.15.7:0/3727907834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0f015da60 msgr2=0x7fc0f0150dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:01.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.640+0000 7fc0f7d22640 1 --2- 172.21.15.7:0/3727907834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0f015da60 0x7fc0f0150dc0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4009870 tx=0x7fc0e40046c0 comp rx=0 tx=0).stop 2024-04-25T10:05:01.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.640+0000 7fc0f7d22640 1 -- 172.21.15.7:0/3727907834 shutdown_connections 2024-04-25T10:05:01.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.640+0000 7fc0f7d22640 1 --2- 172.21.15.7:0/3727907834 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fc0dc06b4d0 0x7fc0dc06d990 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:01.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.640+0000 7fc0f7d22640 1 --2- 172.21.15.7:0/3727907834 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc0f01622b0 0x7fc0f00cc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:01.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.640+0000 7fc0f7d22640 1 --2- 172.21.15.7:0/3727907834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0f015da60 0x7fc0f0150dc0 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:01.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.640+0000 7fc0f7d22640 1 --2- 172.21.15.7:0/3727907834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0f00d0aa0 0x7fc0f00ab3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:01.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.640+0000 7fc0f7d22640 1 -- 172.21.15.7:0/3727907834 >> 172.21.15.7:0/3727907834 conn(0x7fc0f006bfe0 msgr2=0x7fc0f006c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:01.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.640+0000 7fc0f7d22640 1 -- 172.21.15.7:0/3727907834 shutdown_connections 2024-04-25T10:05:01.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:01.640+0000 7fc0f7d22640 1 -- 172.21.15.7:0/3727907834 wait complete. 2024-04-25T10:05:02.059 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 100, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:04:29.599245+0000', 'modified': '2024-04-25T10:05:00.547479+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 119, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9492}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9492': {'gid': 9492, 'name': 'a', 'rank': 0, 'incarnation': 98, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.7:6836/1326211296', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 1326211296}, {'type': 'v1', 'addr': '172.21.15.7:6836', 'nonce': 1326211296}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:05:02.059 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9492:up:rejoin 2024-04-25T10:05:03.060 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:05:03.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.168+0000 7f4c8e770640 1 Processor -- start 2024-04-25T10:05:03.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.168+0000 7f4c8e770640 1 -- start start 2024-04-25T10:05:03.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.169+0000 7f4c8e770640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4c8806c680 0x7f4c8806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.169+0000 7f4c8e770640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c88099b90 con 0x7f4c880cd740 2024-04-25T10:05:03.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.169+0000 7f4c8e770640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c88099e70 con 0x7f4c880cbc90 2024-04-25T10:05:03.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.169+0000 7f4c8e770640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c880cdb20 con 0x7f4c8806c680 2024-04-25T10:05:03.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.169+0000 7f4c87fff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f4c880cd740 0x7f4c880d0390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37644/0 (socket says 172.21.15.7:37644) 2024-04-25T10:05:03.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.169+0000 7f4c87fff640 1 -- 172.21.15.7:0/2327889380 learned_addr learned my addr 172.21.15.7:0/2327889380 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:05:03.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.170+0000 7f4c877fe640 1 --2- 172.21.15.7:0/2327889380 >> v2:172.21.15.55:3300/0 conn(0x7f4c8806c680 0x7f4c8806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.170+0000 7f4c86ffd640 1 -- 172.21.15.7:0/2327889380 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215191184 0 0) 0x7f4c88099b90 con 0x7f4c880cd740 2024-04-25T10:05:03.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.170+0000 7f4c86ffd640 1 -- 172.21.15.7:0/2327889380 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c70003520 con 0x7f4c880cd740 2024-04-25T10:05:03.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.170+0000 7f4c86ffd640 1 -- 172.21.15.7:0/2327889380 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278142922 0 0) 0x7f4c88099e70 con 0x7f4c880cbc90 2024-04-25T10:05:03.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.170+0000 7f4c86ffd640 1 -- 172.21.15.7:0/2327889380 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c88099b90 con 0x7f4c880cbc90 2024-04-25T10:05:03.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.170+0000 7f4c86ffd640 1 -- 172.21.15.7:0/2327889380 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2766546528 0 0) 0x7f4c70003520 con 0x7f4c880cd740 2024-04-25T10:05:03.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.170+0000 7f4c86ffd640 1 -- 172.21.15.7:0/2327889380 >> v2:172.21.15.55:3300/0 conn(0x7f4c8806c680 msgr2=0x7f4c8806cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:03.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.170+0000 7f4c86ffd640 1 --2- 172.21.15.7:0/2327889380 >> v2:172.21.15.55:3300/0 conn(0x7f4c8806c680 0x7f4c8806cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.170+0000 7f4c86ffd640 1 -- 172.21.15.7:0/2327889380 >> v1:172.21.15.55:6789/0 conn(0x7f4c880cbc90 legacy=0x7f4c880cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:03.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.170+0000 7f4c86ffd640 1 -- 172.21.15.7:0/2327889380 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8809a150 con 0x7f4c880cd740 2024-04-25T10:05:03.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.170+0000 7f4c86ffd640 1 -- 172.21.15.7:0/2327889380 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f4c78001670 con 0x7f4c880cd740 2024-04-25T10:05:03.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.170+0000 7f4c86ffd640 1 -- 172.21.15.7:0/2327889380 >> v1:172.21.15.7:6789/0 conn(0x7f4c880cd740 legacy=0x7f4c880d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:03.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.170+0000 7f4c86ffd640 1 --2- 172.21.15.7:0/2327889380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c70003b40 0x7f4c70003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.170+0000 7f4c86ffd640 1 --2- 172.21.15.7:0/2327889380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c70004800 0x7f4c70004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.170+0000 7f4c86ffd640 1 --2- 172.21.15.7:0/2327889380 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4c700051c0 0x7f4c7000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.170+0000 7f4c86ffd640 1 -- 172.21.15.7:0/2327889380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7000c010 con 0x7f4c70003b40 2024-04-25T10:05:03.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.170+0000 7f4c86ffd640 1 -- 172.21.15.7:0/2327889380 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7000c1c0 con 0x7f4c70004800 2024-04-25T10:05:03.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.170+0000 7f4c86ffd640 1 -- 172.21.15.7:0/2327889380 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7000c3c0 con 0x7f4c700051c0 2024-04-25T10:05:03.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.170+0000 7f4c877fe640 1 --2- 172.21.15.7:0/2327889380 >> v2:172.21.15.55:3300/0 conn(0x7f4c8806c680 0x7f4c8806cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:05:03.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.170+0000 7f4c87fff640 1 --2- 172.21.15.7:0/2327889380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c70003b40 0x7f4c70003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.170+0000 7f4c8cd0d640 1 --2- 172.21.15.7:0/2327889380 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4c700051c0 0x7f4c7000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.170+0000 7f4c877fe640 1 --2- 172.21.15.7:0/2327889380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c70004800 0x7f4c70004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.171+0000 7f4c87fff640 1 -- 172.21.15.7:0/2327889380 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4c700051c0 msgr2=0x7f4c7000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:03.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.171+0000 7f4c87fff640 1 --2- 172.21.15.7:0/2327889380 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4c700051c0 0x7f4c7000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.171+0000 7f4c87fff640 1 -- 172.21.15.7:0/2327889380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c70004800 msgr2=0x7f4c70004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:03.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.171+0000 7f4c87fff640 1 --2- 172.21.15.7:0/2327889380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c70004800 0x7f4c70004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.171+0000 7f4c87fff640 1 -- 172.21.15.7:0/2327889380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c70003520 con 0x7f4c70003b40 2024-04-25T10:05:03.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.171+0000 7f4c8cd0d640 1 --2- 172.21.15.7:0/2327889380 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4c700051c0 0x7f4c7000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:03.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.171+0000 7f4c877fe640 1 --2- 172.21.15.7:0/2327889380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c70004800 0x7f4c70004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:03.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.171+0000 7f4c8cd0d640 1 -- 172.21.15.7:0/2327889380 reap_dead start 2024-04-25T10:05:03.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.171+0000 7f4c87fff640 1 --2- 172.21.15.7:0/2327889380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c70003b40 0x7f4c70003f40 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f4c7800c190 tx=0x7f4c70005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55ef1cfe332d1e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:03.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.172+0000 7f4c86ffd640 1 -- 172.21.15.7:0/2327889380 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c78007ce0 con 0x7f4c70003b40 2024-04-25T10:05:03.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.172+0000 7f4c86ffd640 1 -- 172.21.15.7:0/2327889380 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c78005ad0 con 0x7f4c70003b40 2024-04-25T10:05:03.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.172+0000 7f4c86ffd640 1 -- 172.21.15.7:0/2327889380 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c78007070 con 0x7f4c70003b40 2024-04-25T10:05:03.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.172+0000 7f4c8e770640 1 -- 172.21.15.7:0/2327889380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c70003b40 msgr2=0x7f4c70003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:03.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.172+0000 7f4c8e770640 1 --2- 172.21.15.7:0/2327889380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c70003b40 0x7f4c70003f40 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f4c7800c190 tx=0x7f4c70005830 comp rx=0 tx=0).stop 2024-04-25T10:05:03.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.172+0000 7f4c8e770640 1 -- 172.21.15.7:0/2327889380 shutdown_connections 2024-04-25T10:05:03.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.172+0000 7f4c8e770640 1 --2- 172.21.15.7:0/2327889380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c70003b40 0x7f4c70003f40 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.172+0000 7f4c8e770640 1 -- 172.21.15.7:0/2327889380 >> 172.21.15.7:0/2327889380 conn(0x7f4c880b3130 msgr2=0x7f4c880b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:03.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.172+0000 7f4c8e770640 1 -- 172.21.15.7:0/2327889380 shutdown_connections 2024-04-25T10:05:03.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.172+0000 7f4c8e770640 1 -- 172.21.15.7:0/2327889380 wait complete. 2024-04-25T10:05:03.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.173+0000 7f4c8e770640 1 Processor -- start 2024-04-25T10:05:03.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.174+0000 7f4c8e770640 1 -- start start 2024-04-25T10:05:03.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.174+0000 7f4c8e770640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c70003b40 0x7f4c88153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.174+0000 7f4c8e770640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c880c8780 0x7f4c880c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.174+0000 7f4c8e770640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4c8809d8c0 0x7f4c8809dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.174+0000 7f4c8e770640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8809ac30 con 0x7f4c880c8780 2024-04-25T10:05:03.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.174+0000 7f4c8e770640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8809a710 con 0x7f4c70003b40 2024-04-25T10:05:03.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.174+0000 7f4c8e770640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8809adb0 con 0x7f4c8809d8c0 2024-04-25T10:05:03.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.174+0000 7f4c877fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c880c8780 0x7f4c880c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.175+0000 7f4c877fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c880c8780 0x7f4c880c9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38130/0 (socket says 172.21.15.7:38130) 2024-04-25T10:05:03.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.175+0000 7f4c877fe640 1 -- 172.21.15.7:0/306157612 learned_addr learned my addr 172.21.15.7:0/306157612 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:03.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.175+0000 7f4c87fff640 1 --2- 172.21.15.7:0/306157612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c70003b40 0x7f4c88153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.175+0000 7f4c8cd0d640 1 --2- 172.21.15.7:0/306157612 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4c8809d8c0 0x7f4c8809dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.175+0000 7f4c877fe640 1 -- 172.21.15.7:0/306157612 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4c8809d8c0 msgr2=0x7f4c8809dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:03.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.175+0000 7f4c877fe640 1 --2- 172.21.15.7:0/306157612 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4c8809d8c0 0x7f4c8809dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.175+0000 7f4c877fe640 1 -- 172.21.15.7:0/306157612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c70003b40 msgr2=0x7f4c88153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:03.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.175+0000 7f4c877fe640 1 --2- 172.21.15.7:0/306157612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c70003b40 0x7f4c88153c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.175+0000 7f4c877fe640 1 -- 172.21.15.7:0/306157612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8809b440 con 0x7f4c880c8780 2024-04-25T10:05:03.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.175+0000 7f4c877fe640 1 --2- 172.21.15.7:0/306157612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c880c8780 0x7f4c880c9600 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c0118d0 tx=0x7f4c7c011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:03.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.175+0000 7f4c84ff9640 1 -- 172.21.15.7:0/306157612 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c00fbd0 con 0x7f4c880c8780 2024-04-25T10:05:03.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.175+0000 7f4c84ff9640 1 -- 172.21.15.7:0/306157612 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7c00fd70 con 0x7f4c880c8780 2024-04-25T10:05:03.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.175+0000 7f4c84ff9640 1 -- 172.21.15.7:0/306157612 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c015680 con 0x7f4c880c8780 2024-04-25T10:05:03.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.175+0000 7f4c8e770640 1 -- 172.21.15.7:0/306157612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c880c9f30 con 0x7f4c880c8780 2024-04-25T10:05:03.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.175+0000 7f4c8e770640 1 -- 172.21.15.7:0/306157612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c8809b9c0 con 0x7f4c880c8780 2024-04-25T10:05:03.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.176+0000 7f4c8e770640 1 -- 172.21.15.7:0/306157612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c88068fd0 con 0x7f4c880c8780 2024-04-25T10:05:03.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.177+0000 7f4c84ff9640 1 -- 172.21.15.7:0/306157612 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4c7c015820 con 0x7f4c880c8780 2024-04-25T10:05:03.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.177+0000 7f4c84ff9640 1 --2- 172.21.15.7:0/306157612 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4c7406b4d0 0x7f4c7406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.177+0000 7f4c84ff9640 1 -- 172.21.15.7:0/306157612 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f4c7c08aff0 con 0x7f4c880c8780 2024-04-25T10:05:03.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.177+0000 7f4c87fff640 1 --2- 172.21.15.7:0/306157612 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4c7406b4d0 0x7f4c7406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.178+0000 7f4c87fff640 1 --2- 172.21.15.7:0/306157612 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4c7406b4d0 0x7f4c7406d990 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f4c78032000 tx=0x7f4c78009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:03.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.181+0000 7f4c84ff9640 1 -- 172.21.15.7:0/306157612 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4c7c019030 con 0x7f4c880c8780 2024-04-25T10:05:03.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.402+0000 7f4c8e770640 1 -- 172.21.15.7:0/306157612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c880b4040 con 0x7f4c880c8780 2024-04-25T10:05:03.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.402+0000 7f4c84ff9640 1 -- 172.21.15.7:0/306157612 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4938 (secure 0 0 0) 0x7f4c7c059cf0 con 0x7f4c880c8780 2024-04-25T10:05:03.408 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:05:03.408 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":101,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6992,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2679200172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2679200172},{"type":"v1","addr":"172.21.15.7:6837","nonce":2679200172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":7942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/4039147179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":4039147179},{"type":"v1","addr":"172.21.15.55:6833","nonce":4039147179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":7945,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3456170359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3456170359},{"type":"v1","addr":"172.21.15.55:6835","nonce":3456170359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:04:29.599245+0000","modified":"2024-04-25T10:05:01.558283+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9492":{"gid":9492,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/1326211296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1326211296},{"type":"v1","addr":"172.21.15.7:6836","nonce":1326211296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T10:05:03.408 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 101 2024-04-25T10:05:03.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.404+0000 7f4c8e770640 1 -- 172.21.15.7:0/306157612 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4c7406b4d0 msgr2=0x7f4c7406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:03.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.404+0000 7f4c8e770640 1 --2- 172.21.15.7:0/306157612 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4c7406b4d0 0x7f4c7406d990 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f4c78032000 tx=0x7f4c78009030 comp rx=0 tx=0).stop 2024-04-25T10:05:03.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.404+0000 7f4c8e770640 1 -- 172.21.15.7:0/306157612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c880c8780 msgr2=0x7f4c880c9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:03.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.404+0000 7f4c8e770640 1 --2- 172.21.15.7:0/306157612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c880c8780 0x7f4c880c9600 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c0118d0 tx=0x7f4c7c011d90 comp rx=0 tx=0).stop 2024-04-25T10:05:03.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.404+0000 7f4c8e770640 1 -- 172.21.15.7:0/306157612 shutdown_connections 2024-04-25T10:05:03.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.404+0000 7f4c8e770640 1 --2- 172.21.15.7:0/306157612 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4c7406b4d0 0x7f4c7406d990 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.404+0000 7f4c8e770640 1 --2- 172.21.15.7:0/306157612 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4c8809d8c0 0x7f4c8809dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.404+0000 7f4c8e770640 1 --2- 172.21.15.7:0/306157612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c880c8780 0x7f4c880c9600 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.404+0000 7f4c8e770640 1 --2- 172.21.15.7:0/306157612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c70003b40 0x7f4c88153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.404+0000 7f4c8e770640 1 -- 172.21.15.7:0/306157612 >> 172.21.15.7:0/306157612 conn(0x7f4c880b3130 msgr2=0x7f4c880cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:03.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.404+0000 7f4c8e770640 1 -- 172.21.15.7:0/306157612 shutdown_connections 2024-04-25T10:05:03.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.404+0000 7f4c8e770640 1 -- 172.21.15.7:0/306157612 wait complete. 2024-04-25T10:05:03.514 INFO:tasks.ceph.mds.a.smithi007.stderr:2024-04-25T10:05:03.509+0000 7f32de560640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:05:03.824 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 101, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:04:29.599245+0000', 'modified': '2024-04-25T10:05:01.558283+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 119, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9492}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9492': {'gid': 9492, 'name': 'a', 'rank': 0, 'incarnation': 98, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.7:6836/1326211296', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 1326211296}, {'type': 'v1', 'addr': '172.21.15.7:6836', 'nonce': 1326211296}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:05:03.825 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T10:05:03.825 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T10:05:03.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.926+0000 7f1cfcb63640 1 Processor -- start 2024-04-25T10:05:03.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.926+0000 7f1cfcb63640 1 -- start start 2024-04-25T10:05:03.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.927+0000 7f1cfcb63640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1cf80b6a40 0x7f1cf806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.927+0000 7f1cfcb63640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf806cd00 con 0x7f1cf80b5e60 2024-04-25T10:05:03.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.927+0000 7f1cfcb63640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf80d1ca0 con 0x7f1cf815dd00 2024-04-25T10:05:03.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.927+0000 7f1cfcb63640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf815e0e0 con 0x7f1cf80b6a40 2024-04-25T10:05:03.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.927+0000 7f1cf5d9b640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1cf80b5e60 0x7f1cf806bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37658/0 (socket says 172.21.15.7:37658) 2024-04-25T10:05:03.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.927+0000 7f1cf5d9b640 1 -- 172.21.15.7:0/144129634 learned_addr learned my addr 172.21.15.7:0/144129634 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:05:03.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.927+0000 7f1cf6d9d640 1 --2- 172.21.15.7:0/144129634 >> v2:172.21.15.55:3300/0 conn(0x7f1cf80b6a40 0x7f1cf806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.927+0000 7f1cf559a640 1 -- 172.21.15.7:0/144129634 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4281682942 0 0) 0x7f1cf806cd00 con 0x7f1cf80b5e60 2024-04-25T10:05:03.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.927+0000 7f1cf559a640 1 -- 172.21.15.7:0/144129634 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ce4003520 con 0x7f1cf80b5e60 2024-04-25T10:05:03.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.928+0000 7f1cf559a640 1 -- 172.21.15.7:0/144129634 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3368032744 0 0) 0x7f1ce4003520 con 0x7f1cf80b5e60 2024-04-25T10:05:03.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.928+0000 7f1cf559a640 1 -- 172.21.15.7:0/144129634 >> v2:172.21.15.55:3300/0 conn(0x7f1cf80b6a40 msgr2=0x7f1cf806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:03.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.928+0000 7f1cf559a640 1 --2- 172.21.15.7:0/144129634 >> v2:172.21.15.55:3300/0 conn(0x7f1cf80b6a40 0x7f1cf806c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.928+0000 7f1cf559a640 1 -- 172.21.15.7:0/144129634 >> v1:172.21.15.55:6789/0 conn(0x7f1cf815dd00 legacy=0x7f1cf80b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:03.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.928+0000 7f1cf559a640 1 -- 172.21.15.7:0/144129634 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf80d1f80 con 0x7f1cf80b5e60 2024-04-25T10:05:03.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.928+0000 7f1cf559a640 1 -- 172.21.15.7:0/144129634 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f1ce0001670 con 0x7f1cf80b5e60 2024-04-25T10:05:03.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.928+0000 7f1cf559a640 1 -- 172.21.15.7:0/144129634 >> v1:172.21.15.7:6789/0 conn(0x7f1cf80b5e60 legacy=0x7f1cf806bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:03.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.928+0000 7f1cf559a640 1 --2- 172.21.15.7:0/144129634 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ce40039b0 0x7f1ce4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.928+0000 7f1cf559a640 1 --2- 172.21.15.7:0/144129634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ce40043b0 0x7f1ce4004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.928+0000 7f1cf559a640 1 --2- 172.21.15.7:0/144129634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ce4005080 0x7f1ce400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.928+0000 7f1cf559a640 1 -- 172.21.15.7:0/144129634 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf815e0e0 con 0x7f1ce40043b0 2024-04-25T10:05:03.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.928+0000 7f1cf559a640 1 -- 172.21.15.7:0/144129634 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce400bfe0 con 0x7f1ce4005080 2024-04-25T10:05:03.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.928+0000 7f1cf559a640 1 -- 172.21.15.7:0/144129634 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce400c1e0 con 0x7f1ce40039b0 2024-04-25T10:05:03.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.928+0000 7f1cf5d9b640 1 --2- 172.21.15.7:0/144129634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ce40043b0 0x7f1ce4004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.928+0000 7f1cf659c640 1 --2- 172.21.15.7:0/144129634 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ce40039b0 0x7f1ce4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.928+0000 7f1cf6d9d640 1 --2- 172.21.15.7:0/144129634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ce4005080 0x7f1ce400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.928+0000 7f1cf5d9b640 1 -- 172.21.15.7:0/144129634 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ce40039b0 msgr2=0x7f1ce4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:03.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.928+0000 7f1cf5d9b640 1 --2- 172.21.15.7:0/144129634 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ce40039b0 0x7f1ce4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.928+0000 7f1cf5d9b640 1 -- 172.21.15.7:0/144129634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ce4005080 msgr2=0x7f1ce400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:03.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.928+0000 7f1cf5d9b640 1 --2- 172.21.15.7:0/144129634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ce4005080 0x7f1ce400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.928+0000 7f1cf6d9d640 1 -- 172.21.15.7:0/144129634 reap_dead start 2024-04-25T10:05:03.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.928+0000 7f1cf5d9b640 1 -- 172.21.15.7:0/144129634 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce4003520 con 0x7f1ce40043b0 2024-04-25T10:05:03.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.929+0000 7f1cf5d9b640 1 --2- 172.21.15.7:0/144129634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ce40043b0 0x7f1ce4004880 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000c190 tx=0x7f1ce4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dda43b7f1bf6d85 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:03.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.929+0000 7f1cf559a640 1 -- 172.21.15.7:0/144129634 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0007cc0 con 0x7f1ce40043b0 2024-04-25T10:05:03.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.929+0000 7f1cf559a640 1 -- 172.21.15.7:0/144129634 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce0005ad0 con 0x7f1ce40043b0 2024-04-25T10:05:03.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.929+0000 7f1cf559a640 1 -- 172.21.15.7:0/144129634 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0007070 con 0x7f1ce40043b0 2024-04-25T10:05:03.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.930+0000 7f1cfcb63640 1 -- 172.21.15.7:0/144129634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ce40043b0 msgr2=0x7f1ce4004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:03.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.930+0000 7f1cfcb63640 1 --2- 172.21.15.7:0/144129634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ce40043b0 0x7f1ce4004880 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000c190 tx=0x7f1ce4005830 comp rx=0 tx=0).stop 2024-04-25T10:05:03.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.930+0000 7f1cfcb63640 1 -- 172.21.15.7:0/144129634 shutdown_connections 2024-04-25T10:05:03.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.930+0000 7f1cfcb63640 1 --2- 172.21.15.7:0/144129634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ce40043b0 0x7f1ce4004880 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.930+0000 7f1cfcb63640 1 -- 172.21.15.7:0/144129634 >> 172.21.15.7:0/144129634 conn(0x7f1cf80d07b0 msgr2=0x7f1cf80d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:03.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.930+0000 7f1cfcb63640 1 -- 172.21.15.7:0/144129634 shutdown_connections 2024-04-25T10:05:03.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.930+0000 7f1cfcb63640 1 -- 172.21.15.7:0/144129634 wait complete. 2024-04-25T10:05:03.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.931+0000 7f1cfcb63640 1 Processor -- start 2024-04-25T10:05:03.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.931+0000 7f1cfcb63640 1 -- start start 2024-04-25T10:05:03.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.932+0000 7f1cfcb63640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ce40043b0 0x7f1cf80ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.932+0000 7f1cfcb63640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cf81f3a40 0x7f1cf8152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.932+0000 7f1cfcb63640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1cf81f3ea0 0x7f1cf81528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.932+0000 7f1cfcb63640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf80b5750 con 0x7f1cf81f3a40 2024-04-25T10:05:03.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.932+0000 7f1cfcb63640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf806cfe0 con 0x7f1ce40043b0 2024-04-25T10:05:03.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.932+0000 7f1cfcb63640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf80b58d0 con 0x7f1cf81f3ea0 2024-04-25T10:05:03.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.932+0000 7f1cf5d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cf81f3a40 0x7f1cf8152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.932+0000 7f1cf5d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cf81f3a40 0x7f1cf8152380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38148/0 (socket says 172.21.15.7:38148) 2024-04-25T10:05:03.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.932+0000 7f1cf5d9b640 1 -- 172.21.15.7:0/5992088 learned_addr learned my addr 172.21.15.7:0/5992088 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:03.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.932+0000 7f1cf6d9d640 1 --2- 172.21.15.7:0/5992088 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1cf81f3ea0 0x7f1cf81528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.932+0000 7f1cf659c640 1 --2- 172.21.15.7:0/5992088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ce40043b0 0x7f1cf80ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.932+0000 7f1cf5d9b640 1 -- 172.21.15.7:0/5992088 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1cf81f3ea0 msgr2=0x7f1cf81528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:03.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.932+0000 7f1cf5d9b640 1 --2- 172.21.15.7:0/5992088 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1cf81f3ea0 0x7f1cf81528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.932+0000 7f1cf5d9b640 1 -- 172.21.15.7:0/5992088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ce40043b0 msgr2=0x7f1cf80ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:03.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.932+0000 7f1cf5d9b640 1 --2- 172.21.15.7:0/5992088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ce40043b0 0x7f1cf80ccc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.932+0000 7f1cf5d9b640 1 -- 172.21.15.7:0/5992088 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf815ef70 con 0x7f1cf81f3a40 2024-04-25T10:05:03.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.932+0000 7f1cf5d9b640 1 --2- 172.21.15.7:0/5992088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cf81f3a40 0x7f1cf8152380 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f1ce00018f0 tx=0x7f1ce00019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:03.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.933+0000 7f1ceeffd640 1 -- 172.21.15.7:0/5992088 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0040030 con 0x7f1cf81f3a40 2024-04-25T10:05:03.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.933+0000 7f1ceeffd640 1 -- 172.21.15.7:0/5992088 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce0001530 con 0x7f1cf81f3a40 2024-04-25T10:05:03.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.933+0000 7f1cfcb63640 1 -- 172.21.15.7:0/5992088 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf80cc1a0 con 0x7f1cf81f3a40 2024-04-25T10:05:03.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.933+0000 7f1ceeffd640 1 -- 172.21.15.7:0/5992088 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0037040 con 0x7f1cf81f3a40 2024-04-25T10:05:03.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.933+0000 7f1cfcb63640 1 -- 172.21.15.7:0/5992088 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf80cc760 con 0x7f1cf81f3a40 2024-04-25T10:05:03.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.934+0000 7f1ceeffd640 1 -- 172.21.15.7:0/5992088 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1ce0043070 con 0x7f1cf81f3a40 2024-04-25T10:05:03.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.935+0000 7f1ceeffd640 1 --2- 172.21.15.7:0/5992088 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1cd806b500 0x7f1cd806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.935+0000 7f1ceeffd640 1 -- 172.21.15.7:0/5992088 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f1ce00a99b0 con 0x7f1cf81f3a40 2024-04-25T10:05:03.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.935+0000 7f1cf659c640 1 --2- 172.21.15.7:0/5992088 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1cd806b500 0x7f1cd806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.935+0000 7f1cf659c640 1 --2- 172.21.15.7:0/5992088 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1cd806b500 0x7f1cd806d9c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f1cf00018c0 tx=0x7f1cf0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:03.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.935+0000 7f1cff86b740 1 Processor -- start 2024-04-25T10:05:03.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.936+0000 7f1cff86b740 1 -- start start 2024-04-25T10:05:03.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.936+0000 7f1cff86b740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555dd9ffb230 0x555dd9ffb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.936+0000 7f1cff86b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dda018ad0 0x555dda019020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.936+0000 7f1cff86b740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555dd9fd0f10 0x555dda017190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.936+0000 7f1cff86b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dd9f33a10 con 0x555dda018ad0 2024-04-25T10:05:03.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.936+0000 7f1cff86b740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dd9edcb30 con 0x555dd9fd0f10 2024-04-25T10:05:03.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.936+0000 7f1cff86b740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x555dd9f2fc50 con 0x555dd9ffb230 2024-04-25T10:05:03.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.936+0000 7f1cf5d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dda018ad0 0x555dda019020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.937+0000 7f1cf5d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dda018ad0 0x555dda019020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38154/0 (socket says 172.21.15.7:38154) 2024-04-25T10:05:03.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.937+0000 7f1cf5d9b640 1 -- 172.21.15.7:0/1335988326 learned_addr learned my addr 172.21.15.7:0/1335988326 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:03.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.937+0000 7f1cf659c640 1 --2- 172.21.15.7:0/1335988326 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555dd9ffb230 0x555dd9ffb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.937+0000 7f1cf6d9d640 1 --2- 172.21.15.7:0/1335988326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555dd9fd0f10 0x555dda017190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.937+0000 7f1cf5d9b640 1 -- 172.21.15.7:0/1335988326 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555dd9ffb230 msgr2=0x555dd9ffb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:03.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.937+0000 7f1cf5d9b640 1 --2- 172.21.15.7:0/1335988326 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555dd9ffb230 0x555dd9ffb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.937+0000 7f1cf5d9b640 1 -- 172.21.15.7:0/1335988326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555dd9fd0f10 msgr2=0x555dda017190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:03.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.937+0000 7f1cf5d9b640 1 --2- 172.21.15.7:0/1335988326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555dd9fd0f10 0x555dda017190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.937+0000 7f1cf5d9b640 1 -- 172.21.15.7:0/1335988326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555dd9ef1e10 con 0x555dda018ad0 2024-04-25T10:05:03.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.937+0000 7f1cf5d9b640 1 --2- 172.21.15.7:0/1335988326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dda018ad0 0x555dda019020 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000c1f0 tx=0x7f1ce0077860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204f7334feec10c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:03.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.937+0000 7f1cd7fff640 1 -- 172.21.15.7:0/1335988326 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0080560 con 0x555dda018ad0 2024-04-25T10:05:03.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.937+0000 7f1cd7fff640 1 -- 172.21.15.7:0/1335988326 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce007a030 con 0x555dda018ad0 2024-04-25T10:05:03.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.937+0000 7f1cd7fff640 1 -- 172.21.15.7:0/1335988326 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0076200 con 0x555dda018ad0 2024-04-25T10:05:03.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.938+0000 7f1cff86b740 1 -- 172.21.15.7:0/1335988326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dda018ad0 msgr2=0x555dda019020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:03.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.938+0000 7f1cff86b740 1 --2- 172.21.15.7:0/1335988326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dda018ad0 0x555dda019020 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000c1f0 tx=0x7f1ce0077860 comp rx=0 tx=0).stop 2024-04-25T10:05:03.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.938+0000 7f1cff86b740 1 -- 172.21.15.7:0/1335988326 shutdown_connections 2024-04-25T10:05:03.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.938+0000 7f1cff86b740 1 --2- 172.21.15.7:0/1335988326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555dd9fd0f10 0x555dda017190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.938+0000 7f1cff86b740 1 --2- 172.21.15.7:0/1335988326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dda018ad0 0x555dda019020 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.938+0000 7f1cff86b740 1 --2- 172.21.15.7:0/1335988326 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555dd9ffb230 0x555dd9ffb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.938+0000 7f1cff86b740 1 -- 172.21.15.7:0/1335988326 >> 172.21.15.7:0/1335988326 conn(0x555dd9fcd840 msgr2=0x555dda016040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:03.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.938+0000 7f1cff86b740 1 -- 172.21.15.7:0/1335988326 shutdown_connections 2024-04-25T10:05:03.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.938+0000 7f1cff86b740 1 -- 172.21.15.7:0/1335988326 wait complete. 2024-04-25T10:05:03.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.938+0000 7f1cff86b740 1 -- start start 2024-04-25T10:05:03.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.938+0000 7f1cff86b740 1 Processor -- start 2024-04-25T10:05:03.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.939+0000 7f1cff86b740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555dd9ffb230 0x555dda0199c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.939+0000 7f1cff86b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dda018ad0 0x555dd9ffee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.939+0000 7f1cff86b740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555dd9ff76c0 0x555dd9ff7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.939+0000 7f1cff86b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dd9edcb30 con 0x555dda018ad0 2024-04-25T10:05:03.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.939+0000 7f1cff86b740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dd9ef00c0 con 0x555dd9ff76c0 2024-04-25T10:05:03.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.939+0000 7f1cff86b740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x555dd9f33a10 con 0x555dd9ffb230 2024-04-25T10:05:03.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.939+0000 7f1cff86b740 10 client.0 _ll_register_callbacks cb 0x555dd9ee3ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:05:03.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.939+0000 7f1cf5d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dda018ad0 0x555dd9ffee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.940+0000 7f1cf5d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dda018ad0 0x555dd9ffee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38158/0 (socket says 172.21.15.7:38158) 2024-04-25T10:05:03.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.940+0000 7f1cf5d9b640 1 -- 172.21.15.7:0/2157839773 learned_addr learned my addr 172.21.15.7:0/2157839773 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:03.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.940+0000 7f1cf659c640 1 --2- 172.21.15.7:0/2157839773 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555dd9ffb230 0x555dda0199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.940+0000 7f1cf6d9d640 1 --2- 172.21.15.7:0/2157839773 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555dd9ff76c0 0x555dd9ff7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.940+0000 7f1cf5d9b640 1 -- 172.21.15.7:0/2157839773 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555dd9ffb230 msgr2=0x555dda0199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:03.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.940+0000 7f1cf5d9b640 1 --2- 172.21.15.7:0/2157839773 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555dd9ffb230 0x555dda0199c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.940+0000 7f1cf5d9b640 1 -- 172.21.15.7:0/2157839773 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555dd9ff76c0 msgr2=0x555dd9ff7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:03.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.940+0000 7f1cf5d9b640 1 --2- 172.21.15.7:0/2157839773 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555dd9ff76c0 0x555dd9ff7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.940+0000 7f1cf5d9b640 1 -- 172.21.15.7:0/2157839773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555dd9c482d0 con 0x555dda018ad0 2024-04-25T10:05:03.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.940+0000 7f1cf5d9b640 1 --2- 172.21.15.7:0/2157839773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dda018ad0 0x555dd9ffee20 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0077e90 tx=0x7f1ce0046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8851a5092f42af1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:03.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.940+0000 7f1cd57fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:05:03.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.940+0000 7f1cd57fa640 1 -- 172.21.15.7:0/2157839773 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0074570 con 0x555dda018ad0 2024-04-25T10:05:03.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.940+0000 7f1cd57fa640 1 -- 172.21.15.7:0/2157839773 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f1ce007e0b0 con 0x555dda018ad0 2024-04-25T10:05:03.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.940+0000 7f1cff86b740 1 -- 172.21.15.7:0/2157839773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1ce007a030 con 0x555dda018ad0 2024-04-25T10:05:03.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.940+0000 7f1cd57fa640 1 -- 172.21.15.7:0/2157839773 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ce0074710 con 0x555dda018ad0 2024-04-25T10:05:03.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.940+0000 7f1cff86b740 10 client.9582 fetch_fsmap learned FSMap version 101 2024-04-25T10:05:03.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.940+0000 7f1cff86b740 1 -- 172.21.15.7:0/2157839773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) v3 -- 0x555dd9d126b0 con 0x555dda018ad0 2024-04-25T10:05:03.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.940+0000 7f1cd57fa640 1 -- 172.21.15.7:0/2157839773 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce007a030 con 0x555dda018ad0 2024-04-25T10:05:03.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.941+0000 7f1cd57fa640 1 -- 172.21.15.7:0/2157839773 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 101) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1ce008fbe0 con 0x555dda018ad0 2024-04-25T10:05:03.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.941+0000 7f1cff86b740 10 client.9582 fetch_fsmap finished waiting for FSMap version 101 2024-04-25T10:05:03.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.941+0000 7f1cff86b740 10 client.9582 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:05:03.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.941+0000 7f1cff86b740 20 client.9582 populate_metadata read hostname 'smithi007' 2024-04-25T10:05:03.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.941+0000 7f1cff86b740 1 --2- 172.21.15.7:0/2157839773 >> [v2:172.21.15.7:6834/1326211296,v1:172.21.15.7:6836/1326211296] conn(0x555dda00de80 0x555dda0290b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.941+0000 7f1cff86b740 4 client.9582 mds_command: new command op to 9492 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:05:03.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.941+0000 7f1cff86b740 1 -- 172.21.15.7:0/2157839773 --> [v2:172.21.15.7:6834/1326211296,v1:172.21.15.7:6836/1326211296] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555dd9f92920 con 0x555dda00de80 2024-04-25T10:05:03.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.941+0000 7f1cf659c640 1 --2- 172.21.15.7:0/2157839773 >> [v2:172.21.15.7:6834/1326211296,v1:172.21.15.7:6836/1326211296] conn(0x555dda00de80 0x555dda0290b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.941+0000 7f1cd57fa640 10 client.9582 ms_handle_connect on v2:172.21.15.7:6834/1326211296 2024-04-25T10:05:03.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.941+0000 7f1cf659c640 1 --2- 172.21.15.7:0/2157839773 >> [v2:172.21.15.7:6834/1326211296,v1:172.21.15.7:6836/1326211296] conn(0x555dda00de80 0x555dda0290b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90fc15e768162bae server_cookie=9df798315c75c063 in_seq=0 out_seq=0 2024-04-25T10:05:03.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.942+0000 7f1cd57fa640 1 -- 172.21.15.7:0/2157839773 <== mds.0 v2:172.21.15.7:6834/1326211296 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555dd9f92920 con 0x555dda00de80 2024-04-25T10:05:03.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.942+0000 7f1cd57fa640 10 client.9582 handle_command_reply: tid=0 2024-04-25T10:05:03.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.942+0000 7f1cff86b740 1 client.9582 shutdown 2024-04-25T10:05:03.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.942+0000 7f1cff86b740 1 -- 172.21.15.7:0/2157839773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dda018ad0 msgr2=0x555dd9ffee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:03.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.942+0000 7f1cff86b740 1 --2- 172.21.15.7:0/2157839773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dda018ad0 0x555dd9ffee20 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0077e90 tx=0x7f1ce0046000 comp rx=0 tx=0).stop 2024-04-25T10:05:03.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.942+0000 7f1cff86b740 1 -- 172.21.15.7:0/2157839773 shutdown_connections 2024-04-25T10:05:03.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.942+0000 7f1cff86b740 1 --2- 172.21.15.7:0/2157839773 >> [v2:172.21.15.7:6834/1326211296,v1:172.21.15.7:6836/1326211296] conn(0x555dda00de80 0x555dda0290b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.942+0000 7f1cff86b740 1 --2- 172.21.15.7:0/2157839773 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555dd9ff76c0 0x555dd9ff7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.942+0000 7f1cff86b740 1 --2- 172.21.15.7:0/2157839773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dda018ad0 0x555dd9ffee20 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.942+0000 7f1cd57fa640 0 client.9582 ms_handle_reset on v2:172.21.15.7:6834/1326211296 2024-04-25T10:05:03.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.942+0000 7f1cff86b740 1 --2- 172.21.15.7:0/2157839773 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555dd9ffb230 0x555dda0199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.942+0000 7f1cff86b740 1 -- 172.21.15.7:0/2157839773 >> 172.21.15.7:0/2157839773 conn(0x555dd9fd0f10 msgr2=0x555dd9fcad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:03.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.942+0000 7f1cff86b740 1 -- 172.21.15.7:0/2157839773 shutdown_connections 2024-04-25T10:05:03.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.942+0000 7f1cff86b740 1 -- 172.21.15.7:0/2157839773 wait complete. 2024-04-25T10:05:03.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.942+0000 7f1cff86b740 20 client.9582 trim_cache size 0 max 16384 2024-04-25T10:05:03.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.958+0000 7f1cff86b740 1 Processor -- start 2024-04-25T10:05:03.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.958+0000 7f1cff86b740 1 -- start start 2024-04-25T10:05:03.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.959+0000 7f1cff86b740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555dd9ff76c0 0x555dda017e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.959+0000 7f1cff86b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd9ffb230 0x555dda00e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.959+0000 7f1cff86b740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555dda018ad0 0x555dda00e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.959+0000 7f1cff86b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf8200b40 con 0x555dd9ffb230 2024-04-25T10:05:03.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.959+0000 7f1cff86b740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf81ffd70 con 0x555dd9ff76c0 2024-04-25T10:05:03.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.959+0000 7f1cff86b740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf814da40 con 0x555dda018ad0 2024-04-25T10:05:03.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.959+0000 7f1cf5d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd9ffb230 0x555dda00e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.959+0000 7f1cf5d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd9ffb230 0x555dda00e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38172/0 (socket says 172.21.15.7:38172) 2024-04-25T10:05:03.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.959+0000 7f1cf5d9b640 1 -- 172.21.15.7:0/787845478 learned_addr learned my addr 172.21.15.7:0/787845478 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:03.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.959+0000 7f1cf659c640 1 --2- 172.21.15.7:0/787845478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555dd9ff76c0 0x555dda017e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.959+0000 7f1cf6d9d640 1 --2- 172.21.15.7:0/787845478 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555dda018ad0 0x555dda00e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.959+0000 7f1cf5d9b640 1 -- 172.21.15.7:0/787845478 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555dda018ad0 msgr2=0x555dda00e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:03.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.959+0000 7f1cf5d9b640 1 --2- 172.21.15.7:0/787845478 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555dda018ad0 0x555dda00e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.959+0000 7f1cf5d9b640 1 -- 172.21.15.7:0/787845478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555dd9ff76c0 msgr2=0x555dda017e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:03.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.959+0000 7f1cf5d9b640 1 --2- 172.21.15.7:0/787845478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555dd9ff76c0 0x555dda017e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.959+0000 7f1cf5d9b640 1 -- 172.21.15.7:0/787845478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555dd9fff160 con 0x555dd9ffb230 2024-04-25T10:05:03.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.959+0000 7f1cf5d9b640 1 --2- 172.21.15.7:0/787845478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd9ffb230 0x555dda00e260 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0076450 tx=0x7f1ce00a3040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4523c8314bf3c9c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:03.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.959+0000 7f1cd77fe640 1 -- 172.21.15.7:0/787845478 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0077660 con 0x555dd9ffb230 2024-04-25T10:05:03.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.960+0000 7f1cd77fe640 1 -- 172.21.15.7:0/787845478 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce009b020 con 0x555dd9ffb230 2024-04-25T10:05:03.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.960+0000 7f1cd77fe640 1 -- 172.21.15.7:0/787845478 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0077f00 con 0x555dd9ffb230 2024-04-25T10:05:03.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.960+0000 7f1cff86b740 1 -- 172.21.15.7:0/787845478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd9ffb230 msgr2=0x555dda00e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:03.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.960+0000 7f1cff86b740 1 --2- 172.21.15.7:0/787845478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd9ffb230 0x555dda00e260 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0076450 tx=0x7f1ce00a3040 comp rx=0 tx=0).stop 2024-04-25T10:05:03.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.960+0000 7f1cff86b740 1 -- 172.21.15.7:0/787845478 shutdown_connections 2024-04-25T10:05:03.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.960+0000 7f1cff86b740 1 --2- 172.21.15.7:0/787845478 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555dda018ad0 0x555dda00e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.960+0000 7f1cff86b740 1 --2- 172.21.15.7:0/787845478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dd9ffb230 0x555dda00e260 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.960+0000 7f1cff86b740 1 --2- 172.21.15.7:0/787845478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555dd9ff76c0 0x555dda017e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.960+0000 7f1cff86b740 1 -- 172.21.15.7:0/787845478 >> 172.21.15.7:0/787845478 conn(0x555dd9fd0f10 msgr2=0x555dda00ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:03.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.960+0000 7f1cff86b740 1 -- 172.21.15.7:0/787845478 shutdown_connections 2024-04-25T10:05:03.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.960+0000 7f1cff86b740 1 -- 172.21.15.7:0/787845478 wait complete. 2024-04-25T10:05:03.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.961+0000 7f1cff86b740 1 -- start start 2024-04-25T10:05:03.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.961+0000 7f1cff86b740 1 Processor -- start 2024-04-25T10:05:03.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.962+0000 7f1cff86b740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555dd9ff76c0 0x555dda076820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.962+0000 7f1cff86b740 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555dd9ffb230 0x555dda0806f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.962+0000 7f1cff86b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dda018ad0 0x555dd9fca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.962+0000 7f1cff86b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dd9f33a10 con 0x555dda018ad0 2024-04-25T10:05:03.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.962+0000 7f1cff86b740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf80cb750 con 0x555dd9ff76c0 2024-04-25T10:05:03.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.962+0000 7f1cff86b740 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x555dd9edcb30 con 0x555dd9ffb230 2024-04-25T10:05:03.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.962+0000 7f1cff86b740 10 client.0 _ll_register_callbacks cb 0x555dd9fcbc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:05:03.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.962+0000 7f1cf6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dda018ad0 0x555dd9fca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.962+0000 7f1cf6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dda018ad0 0x555dd9fca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38176/0 (socket says 172.21.15.7:38176) 2024-04-25T10:05:03.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.962+0000 7f1cf6d9d640 1 -- 172.21.15.7:0/3721330003 learned_addr learned my addr 172.21.15.7:0/3721330003 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:03.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.962+0000 7f1cf659c640 1 --2- 172.21.15.7:0/3721330003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555dd9ff76c0 0x555dda076820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.962+0000 7f1cf5d9b640 1 --2- 172.21.15.7:0/3721330003 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555dd9ffb230 0x555dda0806f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.962+0000 7f1cf6d9d640 1 -- 172.21.15.7:0/3721330003 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555dd9ffb230 msgr2=0x555dda0806f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:03.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.962+0000 7f1cf6d9d640 1 --2- 172.21.15.7:0/3721330003 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555dd9ffb230 0x555dda0806f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.962+0000 7f1cf6d9d640 1 -- 172.21.15.7:0/3721330003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555dd9ff76c0 msgr2=0x555dda076820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:03.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.962+0000 7f1cf6d9d640 1 --2- 172.21.15.7:0/3721330003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555dd9ff76c0 0x555dda076820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.962+0000 7f1cf6d9d640 1 -- 172.21.15.7:0/3721330003 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555dda080c30 con 0x555dda018ad0 2024-04-25T10:05:03.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.962+0000 7f1cf6d9d640 1 --2- 172.21.15.7:0/3721330003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dda018ad0 0x555dd9fca6b0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80b3320 tx=0x7f1ce8004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8544a736a7a70bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:03.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.962+0000 7f1cd57fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-04-25T10:05:03.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.962+0000 7f1cd57fa640 1 -- 172.21.15.7:0/3721330003 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce8026060 con 0x555dda018ad0 2024-04-25T10:05:03.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.962+0000 7f1cd57fa640 1 -- 172.21.15.7:0/3721330003 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f1ce8017940 con 0x555dda018ad0 2024-04-25T10:05:03.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.962+0000 7f1cff86b740 1 -- 172.21.15.7:0/3721330003 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1ce009b020 con 0x555dda018ad0 2024-04-25T10:05:03.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.963+0000 7f1cd57fa640 1 -- 172.21.15.7:0/3721330003 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ce802c050 con 0x555dda018ad0 2024-04-25T10:05:03.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.963+0000 7f1cff86b740 10 client.9588 fetch_fsmap learned FSMap version 101 2024-04-25T10:05:03.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.963+0000 7f1cff86b740 1 -- 172.21.15.7:0/3721330003 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) v3 -- 0x555dd9fcc980 con 0x555dda018ad0 2024-04-25T10:05:03.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.963+0000 7f1cd57fa640 1 -- 172.21.15.7:0/3721330003 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce009b020 con 0x555dda018ad0 2024-04-25T10:05:03.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.963+0000 7f1cd57fa640 1 -- 172.21.15.7:0/3721330003 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 101) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1ce802f020 con 0x555dda018ad0 2024-04-25T10:05:03.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.963+0000 7f1cff86b740 10 client.9588 fetch_fsmap finished waiting for FSMap version 101 2024-04-25T10:05:03.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.963+0000 7f1cff86b740 10 client.9588 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:05:03.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.963+0000 7f1cff86b740 20 client.9588 populate_metadata read hostname 'smithi007' 2024-04-25T10:05:03.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.963+0000 7f1cff86b740 1 --2- 172.21.15.7:0/3721330003 >> [v2:172.21.15.7:6834/1326211296,v1:172.21.15.7:6836/1326211296] conn(0x555dda00c040 0x555dda00e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.963+0000 7f1cff86b740 4 client.9588 mds_command: new command op to 9492 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:05:03.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.963+0000 7f1cff86b740 1 -- 172.21.15.7:0/3721330003 --> [v2:172.21.15.7:6834/1326211296,v1:172.21.15.7:6836/1326211296] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555dd9f40f50 con 0x555dda00c040 2024-04-25T10:05:03.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.963+0000 7f1cf659c640 1 --2- 172.21.15.7:0/3721330003 >> [v2:172.21.15.7:6834/1326211296,v1:172.21.15.7:6836/1326211296] conn(0x555dda00c040 0x555dda00e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.963+0000 7f1cf659c640 1 --2- 172.21.15.7:0/3721330003 >> [v2:172.21.15.7:6834/1326211296,v1:172.21.15.7:6836/1326211296] conn(0x555dda00c040 0x555dda00e260 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=977ca41311ff8d6c server_cookie=e663005ac1d0281d in_seq=0 out_seq=0 2024-04-25T10:05:03.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.963+0000 7f1cd57fa640 10 client.9588 ms_handle_connect on v2:172.21.15.7:6834/1326211296 2024-04-25T10:05:03.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.964+0000 7f1cd57fa640 1 -- 172.21.15.7:0/3721330003 <== mds.0 v2:172.21.15.7:6834/1326211296 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x555dd9f40f50 con 0x555dda00c040 2024-04-25T10:05:03.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.964+0000 7f1cd57fa640 10 client.9588 handle_command_reply: tid=0 2024-04-25T10:05:03.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.964+0000 7f1cff86b740 1 client.9588 shutdown 2024-04-25T10:05:03.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.964+0000 7f1cff86b740 1 -- 172.21.15.7:0/3721330003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dda018ad0 msgr2=0x555dd9fca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:03.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.964+0000 7f1cff86b740 1 --2- 172.21.15.7:0/3721330003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dda018ad0 0x555dd9fca6b0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80b3320 tx=0x7f1ce8004470 comp rx=0 tx=0).stop 2024-04-25T10:05:03.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.964+0000 7f1cff86b740 1 -- 172.21.15.7:0/3721330003 shutdown_connections 2024-04-25T10:05:03.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.964+0000 7f1cff86b740 1 --2- 172.21.15.7:0/3721330003 >> [v2:172.21.15.7:6834/1326211296,v1:172.21.15.7:6836/1326211296] conn(0x555dda00c040 0x555dda00e260 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.964+0000 7f1cff86b740 1 --2- 172.21.15.7:0/3721330003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555dda018ad0 0x555dd9fca6b0 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.964+0000 7f1cff86b740 1 --2- 172.21.15.7:0/3721330003 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x555dd9ffb230 0x555dda0806f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.964+0000 7f1cd57fa640 0 client.9588 ms_handle_reset on v2:172.21.15.7:6834/1326211296 2024-04-25T10:05:03.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.964+0000 7f1cff86b740 1 --2- 172.21.15.7:0/3721330003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555dd9ff76c0 0x555dda076820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.964+0000 7f1cff86b740 1 -- 172.21.15.7:0/3721330003 >> 172.21.15.7:0/3721330003 conn(0x555dd9fd0f10 msgr2=0x555dd9fd12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:03.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.964+0000 7f1cff86b740 1 -- 172.21.15.7:0/3721330003 shutdown_connections 2024-04-25T10:05:03.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.964+0000 7f1cff86b740 1 -- 172.21.15.7:0/3721330003 wait complete. 2024-04-25T10:05:03.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.964+0000 7f1cff86b740 20 client.9588 trim_cache size 0 max 16384 2024-04-25T10:05:03.975 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:05:03.975 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "c03d0745-5946-49c3-ad88-1165c5b68b4e", 2024-04-25T10:05:03.975 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-04-25T10:05:03.976 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 9492, 2024-04-25T10:05:03.976 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-04-25T10:05:03.976 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-04-25T10:05:03.976 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-04-25T10:05:03.976 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 4.430141924, 2024-04-25T10:05:03.976 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 101, 2024-04-25T10:05:03.976 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 119, 2024-04-25T10:05:03.976 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 119, 2024-04-25T10:05:03.976 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 6.4309711509999996 2024-04-25T10:05:03.976 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:05:03.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.964+0000 7f1cfcb63640 1 -- 172.21.15.7:0/5992088 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1cd806b500 msgr2=0x7f1cd806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:03.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.964+0000 7f1cfcb63640 1 --2- 172.21.15.7:0/5992088 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1cd806b500 0x7f1cd806d9c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f1cf00018c0 tx=0x7f1cf0009040 comp rx=0 tx=0).stop 2024-04-25T10:05:03.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.964+0000 7f1cfcb63640 1 -- 172.21.15.7:0/5992088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cf81f3a40 msgr2=0x7f1cf8152380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:03.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.964+0000 7f1cfcb63640 1 --2- 172.21.15.7:0/5992088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cf81f3a40 0x7f1cf8152380 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f1ce00018f0 tx=0x7f1ce00019c0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.964+0000 7f1cfcb63640 1 -- 172.21.15.7:0/5992088 shutdown_connections 2024-04-25T10:05:03.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.964+0000 7f1cfcb63640 1 --2- 172.21.15.7:0/5992088 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f1cd806b500 0x7f1cd806d9c0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.964+0000 7f1cfcb63640 1 --2- 172.21.15.7:0/5992088 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1cf81f3ea0 0x7f1cf81528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.964+0000 7f1cfcb63640 1 --2- 172.21.15.7:0/5992088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cf81f3a40 0x7f1cf8152380 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.964+0000 7f1cfcb63640 1 --2- 172.21.15.7:0/5992088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ce40043b0 0x7f1cf80ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.964+0000 7f1cfcb63640 1 -- 172.21.15.7:0/5992088 >> 172.21.15.7:0/5992088 conn(0x7f1cf80d07b0 msgr2=0x7f1cf80b45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:03.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.965+0000 7f1cfcb63640 1 -- 172.21.15.7:0/5992088 shutdown_connections 2024-04-25T10:05:03.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:03.965+0000 7f1cfcb63640 1 -- 172.21.15.7:0/5992088 wait complete. 2024-04-25T10:05:03.981 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:05:04.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.076+0000 7fa195b0a640 1 Processor -- start 2024-04-25T10:05:04.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.076+0000 7fa195b0a640 1 -- start start 2024-04-25T10:05:04.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.077+0000 7fa195b0a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa19015b990 0x7fa19009a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:04.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.077+0000 7fa195b0a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa1900c5950 0x7fa19015f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:04.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.077+0000 7fa195b0a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1900c5de0 con 0x7fa1900ccd10 2024-04-25T10:05:04.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.077+0000 7fa195b0a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa19009ad90 con 0x7fa1900c5950 2024-04-25T10:05:04.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.077+0000 7fa195b0a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1900cd560 con 0x7fa19015b990 2024-04-25T10:05:04.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.077+0000 7fa18f7fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa19015b990 0x7fa19009a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:04.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.078+0000 7fa18f7fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa19015b990 0x7fa19009a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:34442/0 (socket says 172.21.15.7:34442) 2024-04-25T10:05:04.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.078+0000 7fa18f7fe640 1 -- 172.21.15.7:0/3047261820 learned_addr learned my addr 172.21.15.7:0/3047261820 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:04.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.078+0000 7fa18ffff640 1 --2- 172.21.15.7:0/3047261820 >> v2:172.21.15.55:3300/0 conn(0x7fa1900c5950 0x7fa19015f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:04.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.078+0000 7fa18f7fe640 1 -- 172.21.15.7:0/3047261820 >> v2:172.21.15.55:3300/0 conn(0x7fa1900c5950 msgr2=0x7fa19015f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:04.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.078+0000 7fa18f7fe640 1 --2- 172.21.15.7:0/3047261820 >> v2:172.21.15.55:3300/0 conn(0x7fa1900c5950 0x7fa19015f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.078+0000 7fa18f7fe640 1 -- 172.21.15.7:0/3047261820 >> v1:172.21.15.55:6789/0 conn(0x7fa1900ccd10 legacy=0x7fa1900c5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:04.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.078+0000 7fa18f7fe640 1 -- 172.21.15.7:0/3047261820 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa190099a90 con 0x7fa19015b990 2024-04-25T10:05:04.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.079+0000 7fa18f7fe640 1 --2- 172.21.15.7:0/3047261820 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa19015b990 0x7fa19009a850 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa180009870 tx=0x7fa18002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3595b18b17223ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:04.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.079+0000 7fa18e7fc640 1 -- 172.21.15.7:0/3047261820 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa180037070 con 0x7fa19015b990 2024-04-25T10:05:04.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.079+0000 7fa18e7fc640 1 -- 172.21.15.7:0/3047261820 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa180032440 con 0x7fa19015b990 2024-04-25T10:05:04.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.079+0000 7fa18e7fc640 1 -- 172.21.15.7:0/3047261820 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa180032810 con 0x7fa19015b990 2024-04-25T10:05:04.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.079+0000 7fa195b0a640 1 -- 172.21.15.7:0/3047261820 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa19015b990 msgr2=0x7fa19009a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:04.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.079+0000 7fa195b0a640 1 --2- 172.21.15.7:0/3047261820 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa19015b990 0x7fa19009a850 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa180009870 tx=0x7fa18002a1c0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.079+0000 7fa195b0a640 1 -- 172.21.15.7:0/3047261820 shutdown_connections 2024-04-25T10:05:04.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.079+0000 7fa195b0a640 1 --2- 172.21.15.7:0/3047261820 >> v2:172.21.15.55:3300/0 conn(0x7fa1900c5950 0x7fa19015f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.079+0000 7fa195b0a640 1 --2- 172.21.15.7:0/3047261820 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa19015b990 0x7fa19009a850 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.079+0000 7fa195b0a640 1 -- 172.21.15.7:0/3047261820 >> 172.21.15.7:0/3047261820 conn(0x7fa1900d16f0 msgr2=0x7fa1900d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:04.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.079+0000 7fa195b0a640 1 -- 172.21.15.7:0/3047261820 shutdown_connections 2024-04-25T10:05:04.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.079+0000 7fa195b0a640 1 -- 172.21.15.7:0/3047261820 wait complete. 2024-04-25T10:05:04.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.081+0000 7fa195b0a640 1 Processor -- start 2024-04-25T10:05:04.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.081+0000 7fa195b0a640 1 -- start start 2024-04-25T10:05:04.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.081+0000 7fa195b0a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa1900c5950 0x7fa190155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:04.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.081+0000 7fa195b0a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1900ccd10 0x7fa1901561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:04.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.081+0000 7fa195b0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa19015b990 0x7fa19009b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:04.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.081+0000 7fa195b0a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19009a330 con 0x7fa1900ccd10 2024-04-25T10:05:04.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.081+0000 7fa195b0a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19009a050 con 0x7fa19015b990 2024-04-25T10:05:04.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.081+0000 7fa195b0a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19015bd70 con 0x7fa1900c5950 2024-04-25T10:05:04.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.082+0000 7fa18effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1900ccd10 0x7fa1901561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:04.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.082+0000 7fa18effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1900ccd10 0x7fa1901561c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38188/0 (socket says 172.21.15.7:38188) 2024-04-25T10:05:04.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.082+0000 7fa18effd640 1 -- 172.21.15.7:0/4251252077 learned_addr learned my addr 172.21.15.7:0/4251252077 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:04.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.082+0000 7fa18ffff640 1 --2- 172.21.15.7:0/4251252077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa19015b990 0x7fa19009b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:04.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.082+0000 7fa18f7fe640 1 --2- 172.21.15.7:0/4251252077 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa1900c5950 0x7fa190155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:04.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.082+0000 7fa18effd640 1 -- 172.21.15.7:0/4251252077 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa1900c5950 msgr2=0x7fa190155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:04.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.082+0000 7fa18effd640 1 --2- 172.21.15.7:0/4251252077 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa1900c5950 0x7fa190155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.082+0000 7fa18effd640 1 -- 172.21.15.7:0/4251252077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa19015b990 msgr2=0x7fa19009b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:04.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.082+0000 7fa18effd640 1 --2- 172.21.15.7:0/4251252077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa19015b990 0x7fa19009b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.082+0000 7fa18effd640 1 -- 172.21.15.7:0/4251252077 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19009f2a0 con 0x7fa1900ccd10 2024-04-25T10:05:04.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.082+0000 7fa18effd640 1 --2- 172.21.15.7:0/4251252077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1900ccd10 0x7fa1901561c0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7fa18400c3c0 tx=0x7fa18400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:04.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.082+0000 7fa177fff640 1 -- 172.21.15.7:0/4251252077 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1840052d0 con 0x7fa1900ccd10 2024-04-25T10:05:04.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.082+0000 7fa177fff640 1 -- 172.21.15.7:0/4251252077 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa184005490 con 0x7fa1900ccd10 2024-04-25T10:05:04.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.082+0000 7fa195b0a640 1 -- 172.21.15.7:0/4251252077 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa19009e720 con 0x7fa1900ccd10 2024-04-25T10:05:04.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.082+0000 7fa177fff640 1 -- 172.21.15.7:0/4251252077 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa184007260 con 0x7fa1900ccd10 2024-04-25T10:05:04.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.082+0000 7fa195b0a640 1 -- 172.21.15.7:0/4251252077 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19009ece0 con 0x7fa1900ccd10 2024-04-25T10:05:04.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.083+0000 7fa195b0a640 1 -- 172.21.15.7:0/4251252077 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa190068fd0 con 0x7fa1900ccd10 2024-04-25T10:05:04.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.084+0000 7fa177fff640 1 -- 172.21.15.7:0/4251252077 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa184007400 con 0x7fa1900ccd10 2024-04-25T10:05:04.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.084+0000 7fa177fff640 1 --2- 172.21.15.7:0/4251252077 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa17c06b4d0 0x7fa17c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:04.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.084+0000 7fa177fff640 1 -- 172.21.15.7:0/4251252077 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fa1840897e0 con 0x7fa1900ccd10 2024-04-25T10:05:04.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.084+0000 7fa18f7fe640 1 --2- 172.21.15.7:0/4251252077 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa17c06b4d0 0x7fa17c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:04.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.085+0000 7fa18f7fe640 1 --2- 172.21.15.7:0/4251252077 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa17c06b4d0 0x7fa17c06d990 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fa180034000 tx=0x7fa18002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:04.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.089+0000 7fa177fff640 1 -- 172.21.15.7:0/4251252077 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa184057e60 con 0x7fa1900ccd10 2024-04-25T10:05:04.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.308+0000 7fa195b0a640 1 -- 172.21.15.7:0/4251252077 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa1900d2500 con 0x7fa1900ccd10 2024-04-25T10:05:04.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.308+0000 7fa177fff640 1 -- 172.21.15.7:0/4251252077 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v101) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa18405ce20 con 0x7fa1900ccd10 2024-04-25T10:05:04.313 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T10:05:04.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.310+0000 7fa195b0a640 1 -- 172.21.15.7:0/4251252077 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa17c06b4d0 msgr2=0x7fa17c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:04.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.310+0000 7fa195b0a640 1 --2- 172.21.15.7:0/4251252077 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa17c06b4d0 0x7fa17c06d990 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fa180034000 tx=0x7fa18002e000 comp rx=0 tx=0).stop 2024-04-25T10:05:04.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.310+0000 7fa195b0a640 1 -- 172.21.15.7:0/4251252077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1900ccd10 msgr2=0x7fa1901561c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:04.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.310+0000 7fa195b0a640 1 --2- 172.21.15.7:0/4251252077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1900ccd10 0x7fa1901561c0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7fa18400c3c0 tx=0x7fa18400c880 comp rx=0 tx=0).stop 2024-04-25T10:05:04.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.310+0000 7fa195b0a640 1 -- 172.21.15.7:0/4251252077 shutdown_connections 2024-04-25T10:05:04.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.310+0000 7fa195b0a640 1 --2- 172.21.15.7:0/4251252077 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa17c06b4d0 0x7fa17c06d990 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.310+0000 7fa195b0a640 1 --2- 172.21.15.7:0/4251252077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa19015b990 0x7fa19009b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.310+0000 7fa195b0a640 1 --2- 172.21.15.7:0/4251252077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1900ccd10 0x7fa1901561c0 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.310+0000 7fa195b0a640 1 --2- 172.21.15.7:0/4251252077 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa1900c5950 0x7fa190155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.310+0000 7fa195b0a640 1 -- 172.21.15.7:0/4251252077 >> 172.21.15.7:0/4251252077 conn(0x7fa1900d16f0 msgr2=0x7fa19006fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:04.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.310+0000 7fa195b0a640 1 -- 172.21.15.7:0/4251252077 shutdown_connections 2024-04-25T10:05:04.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:04.310+0000 7fa195b0a640 1 -- 172.21.15.7:0/4251252077 wait complete. 2024-04-25T10:05:04.326 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T10:05:04.326 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:05:04.327 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-04-25T10:05:04.327 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T10:05:04.327 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T10:05:04.327 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T10:05:04.327 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T10:05:04.327 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:05:04.327 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:05:04.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:04.327 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-04-25T10:05:04.343 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:05:04.343 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:05:04.343 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:05:04.343 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:05:04.343 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-04-25T10:05:04.343 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:05:04.343 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:05:04.343 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-04-25T10:05:04.344 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-04-25T10:05:04.344 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:05:04.344 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-04-25T10:05:04.344 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-04-25T10:05:04.344 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:05:04.344 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-04-25T10:05:04.344 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-04-25T10:05:04.344 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T10:05:04.344 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42095sec preferred_lft 42095sec 2024-04-25T10:05:04.344 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link noprefixroute 2024-04-25T10:05:04.344 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:05:04.344 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T10:05:04.344 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-04-25T10:05:04.344 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-04-25T10:05:04.344 INFO:teuthology.orchestra.run.smithi007.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T10:05:04.344 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 26:0c:99:53:12:e3 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:05:04.345 INFO:teuthology.orchestra.run.smithi007.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T10:05:04.345 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:05:04.345 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::50aa:55ff:febc:5f67/64 scope link 2024-04-25T10:05:04.345 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:05:04.345 INFO:teuthology.orchestra.run.smithi007.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:05:04.345 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 6e:99:f1:00:a9:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:05:04.345 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::6c99:f1ff:fe00:a95e/64 scope link 2024-04-25T10:05:04.345 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:05:04.345 INFO:teuthology.orchestra.run.smithi007.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:05:04.345 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 26:0c:99:53:12:e3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T10:05:04.345 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::240c:99ff:fe53:12e3/64 scope link 2024-04-25T10:05:04.345 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:05:04.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:04.346 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:05:04.406 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-04-25T10:05:04.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:04.407 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-04-25T10:05:04.465 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-04-25T10:05:04.465 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:05:04.465 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T10:05:04.465 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T10:05:04.465 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:05:04.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:04.466 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-04-25T10:05:04.466 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-04-25T10:05:04.466 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:05:04.466 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:05:04.466 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:05:04.466 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-04-25T10:05:04.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:04.551 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-04-25T10:05:04.566 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T10:05:04.566 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T10:05:04.566 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:05:04.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:04.566 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-04-25T10:05:04.630 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:05:04.631 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T10:05:04.686 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:05:04.687 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:05:04.687 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:05:04.742 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T10:05:04.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:04.742 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:05:04.825 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:05:04.825 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T10:05:04.825 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T10:05:04.833 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:05:04.833 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T10:05:04.833 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T10:05:04.834 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T10:05:04.834 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T10:05:04.839 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T10:05:04.839 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T10:05:04.839 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-04-25T10:05:04.839 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.55:3300,172.21.15.55:3301" 2024-04-25T10:05:04.839 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T10:05:04.839 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790" 2024-04-25T10:05:04.839 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.55:6789,172.21.15.55:6790:/ 2024-04-25T10:05:04.839 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c03d0745-5946-49c3-ad88-1165c5b68b4e" will pass to kernel 2024-04-25T10:05:04.842 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T10:05:04.842 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-04-25T10:05:04.842 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T10:05:04.842 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T10:05:04.842 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T10:05:04.843 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T10:05:04.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:04.843 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:05:04.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:04.912 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:05:04.968 INFO:teuthology.orchestra.run.smithi007.stdout:client9594 2024-04-25T10:05:04.969 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:05:04.969 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:05:05.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:05.025 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T10:05:05.084 INFO:teuthology.orchestra.run.smithi007.stdout:./ 2024-04-25T10:05:05.084 INFO:teuthology.orchestra.run.smithi007.stdout:./parent 2024-04-25T10:05:05.084 INFO:teuthology.orchestra.run.smithi007.stdout:./parent/flushed 2024-04-25T10:05:05.084 INFO:teuthology.orchestra.run.smithi007.stdout:./parent/flushed/charlie 2024-04-25T10:05:05.084 INFO:teuthology.orchestra.run.smithi007.stdout:./parent/flushed/alpha 2024-04-25T10:05:05.084 INFO:teuthology.orchestra.run.smithi007.stdout:./parent/flushed/bravo 2024-04-25T10:05:05.084 INFO:teuthology.orchestra.run.smithi007.stdout:./parent/unflushed 2024-04-25T10:05:05.084 INFO:teuthology.orchestra.run.smithi007.stdout:./parent/unflushed/jfile 2024-04-25T10:05:05.085 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T10:05:05.085 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T10:05:05.085 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T10:05:05.085 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T10:05:05.085 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T10:05:05.085 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T10:05:05.191 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-04-25T10:05:05.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:05:05.199 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T10:05:05.199 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T10:05:05.199 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T10:05:05.200 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T10:05:05.200 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-04-25T10:05:05.200 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T10:05:05.306 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627776 2024-04-25T10:05:05.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:05:05.315 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T10:05:05.315 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T10:05:05.315 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T10:05:05.315 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T10:05:05.315 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-04-25T10:05:05.315 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T10:05:05.422 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627777 2024-04-25T10:05:05.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:05:05.430 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T10:05:05.430 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T10:05:05.430 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T10:05:05.430 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T10:05:05.430 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-04-25T10:05:05.430 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T10:05:05.536 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627780 2024-04-25T10:05:05.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:05:05.546 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T10:05:05.546 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T10:05:05.546 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T10:05:05.546 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T10:05:05.546 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-04-25T10:05:05.546 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T10:05:05.652 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627778 2024-04-25T10:05:05.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:05:05.661 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T10:05:05.661 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T10:05:05.662 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T10:05:05.662 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T10:05:05.662 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/bravo").st_ino) 2024-04-25T10:05:05.662 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T10:05:05.768 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627779 2024-04-25T10:05:05.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:05:05.779 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T10:05:05.779 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T10:05:05.779 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T10:05:05.780 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T10:05:05.780 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-04-25T10:05:05.780 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T10:05:05.886 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627781 2024-04-25T10:05:05.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:05:05.894 DEBUG:teuthology.orchestra.run.smithi007:> stdin-killer -- python3 -c ' 2024-04-25T10:05:05.895 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-04-25T10:05:05.895 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2024-04-25T10:05:05.895 DEBUG:teuthology.orchestra.run.smithi007:> 2024-04-25T10:05:05.895 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-04-25T10:05:05.895 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-04-25T10:05:06.002 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627782 2024-04-25T10:05:06.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:05:06.011 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T10:05:06.011 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:05:06.096 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:05:06.138 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T10:05:06.138 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:05:06.138 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:05:06.153 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:05:06.154 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:05:06.210 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:05:06.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.346+0000 7f2d3ba3f640 1 Processor -- start 2024-04-25T10:05:06.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.346+0000 7f2d3ba3f640 1 -- start start 2024-04-25T10:05:06.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.347+0000 7f2d3ba3f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d3415d7b0 0x7f2d3406fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:06.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.347+0000 7f2d3ba3f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2d340b53c0 0x7f2d340b5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:06.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.347+0000 7f2d3ba3f640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2d3406ab60 0x7f2d3406b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:06.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.347+0000 7f2d3ba3f640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d341618f0 con 0x7f2d3406ab60 2024-04-25T10:05:06.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.347+0000 7f2d3ba3f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d34161bd0 con 0x7f2d340b53c0 2024-04-25T10:05:06.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.347+0000 7f2d3ba3f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d34161eb0 con 0x7f2d3415d7b0 2024-04-25T10:05:06.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.347+0000 7f2d39fdc640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2d3406ab60 0x7f2d3406b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:06.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.347+0000 7f2d39fdc640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2d3406ab60 0x7f2d3406b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38202/0 (socket says 172.21.15.7:38202) 2024-04-25T10:05:06.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.347+0000 7f2d39fdc640 1 -- 172.21.15.7:0/1185182952 learned_addr learned my addr 172.21.15.7:0/1185182952 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:06.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.347+0000 7f2d39fdc640 1 -- 172.21.15.7:0/1185182952 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d3415d7b0 msgr2=0x7f2d3406fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:06.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.347+0000 7f2d39fdc640 1 --2- 172.21.15.7:0/1185182952 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d3415d7b0 0x7f2d3406fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.347+0000 7f2d38fda640 1 --2- 172.21.15.7:0/1185182952 >> v2:172.21.15.55:3300/0 conn(0x7f2d340b53c0 0x7f2d340b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:06.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.347+0000 7f2d39fdc640 1 -- 172.21.15.7:0/1185182952 >> v2:172.21.15.55:3300/0 conn(0x7f2d340b53c0 msgr2=0x7f2d340b5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:06.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.347+0000 7f2d39fdc640 1 --2- 172.21.15.7:0/1185182952 >> v2:172.21.15.55:3300/0 conn(0x7f2d340b53c0 0x7f2d340b5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.347+0000 7f2d39fdc640 1 -- 172.21.15.7:0/1185182952 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d34162190 con 0x7f2d3406ab60 2024-04-25T10:05:06.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.348+0000 7f2d39fdc640 1 --2- 172.21.15.7:0/1185182952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d3406ab60 0x7f2d3406b010 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f2d3406f7c0 tx=0x7f2d2c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88218af303ceda6c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:06.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.348+0000 7f2d2bfff640 1 -- 172.21.15.7:0/1185182952 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c036070 con 0x7f2d3406ab60 2024-04-25T10:05:06.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.348+0000 7f2d2bfff640 1 -- 172.21.15.7:0/1185182952 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2c031600 con 0x7f2d3406ab60 2024-04-25T10:05:06.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.348+0000 7f2d2bfff640 1 -- 172.21.15.7:0/1185182952 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c0319d0 con 0x7f2d3406ab60 2024-04-25T10:05:06.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.349+0000 7f2d3ba3f640 1 -- 172.21.15.7:0/1185182952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d3406ab60 msgr2=0x7f2d3406b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:06.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.349+0000 7f2d3ba3f640 1 --2- 172.21.15.7:0/1185182952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d3406ab60 0x7f2d3406b010 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f2d3406f7c0 tx=0x7f2d2c02a6a0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.349+0000 7f2d3ba3f640 1 -- 172.21.15.7:0/1185182952 shutdown_connections 2024-04-25T10:05:06.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.349+0000 7f2d3ba3f640 1 --2- 172.21.15.7:0/1185182952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d3406ab60 0x7f2d3406b010 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.349+0000 7f2d3ba3f640 1 --2- 172.21.15.7:0/1185182952 >> v2:172.21.15.55:3300/0 conn(0x7f2d340b53c0 0x7f2d340b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.349+0000 7f2d3ba3f640 1 --2- 172.21.15.7:0/1185182952 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d3415d7b0 0x7f2d3406fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.349+0000 7f2d3ba3f640 1 -- 172.21.15.7:0/1185182952 >> 172.21.15.7:0/1185182952 conn(0x7f2d340b2390 msgr2=0x7f2d340b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:06.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.349+0000 7f2d3ba3f640 1 -- 172.21.15.7:0/1185182952 shutdown_connections 2024-04-25T10:05:06.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.349+0000 7f2d3ba3f640 1 -- 172.21.15.7:0/1185182952 wait complete. 2024-04-25T10:05:06.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.350+0000 7f2d3ba3f640 1 Processor -- start 2024-04-25T10:05:06.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.350+0000 7f2d3ba3f640 1 -- start start 2024-04-25T10:05:06.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.351+0000 7f2d3ba3f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d3406ab60 0x7f2d34151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:06.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.351+0000 7f2d3ba3f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d340b53c0 0x7f2d340cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:06.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.351+0000 7f2d3ba3f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d3415d7b0 0x7f2d3415c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:06.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.351+0000 7f2d3ba3f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d340b3bf0 con 0x7f2d340b53c0 2024-04-25T10:05:06.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.351+0000 7f2d3ba3f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d340b3a70 con 0x7f2d3406ab60 2024-04-25T10:05:06.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.351+0000 7f2d3ba3f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d340b3d70 con 0x7f2d3415d7b0 2024-04-25T10:05:06.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.351+0000 7f2d38fda640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d340b53c0 0x7f2d340cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:06.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.351+0000 7f2d38fda640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d340b53c0 0x7f2d340cc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38214/0 (socket says 172.21.15.7:38214) 2024-04-25T10:05:06.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.351+0000 7f2d38fda640 1 -- 172.21.15.7:0/3758026341 learned_addr learned my addr 172.21.15.7:0/3758026341 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:06.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.351+0000 7f2d39fdc640 1 --2- 172.21.15.7:0/3758026341 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d3415d7b0 0x7f2d3415c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.351+0000 7f2d38fda640 1 -- 172.21.15.7:0/3758026341 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d3415d7b0 msgr2=0x7f2d3415c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.351+0000 7f2d38fda640 1 --2- 172.21.15.7:0/3758026341 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d3415d7b0 0x7f2d3415c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.351+0000 7f2d38fda640 1 -- 172.21.15.7:0/3758026341 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d3406ab60 msgr2=0x7f2d34151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.351+0000 7f2d38fda640 1 --2- 172.21.15.7:0/3758026341 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d3406ab60 0x7f2d34151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.351+0000 7f2d38fda640 1 -- 172.21.15.7:0/3758026341 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d34152410 con 0x7f2d340b53c0 2024-04-25T10:05:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.351+0000 7f2d38fda640 1 --2- 172.21.15.7:0/3758026341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d340b53c0 0x7f2d340cc2c0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f2d2400c7f0 tx=0x7f2d2400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.351+0000 7f2d29ffb640 1 -- 172.21.15.7:0/3758026341 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d24015070 con 0x7f2d340b53c0 2024-04-25T10:05:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.351+0000 7f2d29ffb640 1 -- 172.21.15.7:0/3758026341 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d24004240 con 0x7f2d340b53c0 2024-04-25T10:05:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.351+0000 7f2d29ffb640 1 -- 172.21.15.7:0/3758026341 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d24007620 con 0x7f2d340b53c0 2024-04-25T10:05:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.351+0000 7f2d3ba3f640 1 -- 172.21.15.7:0/3758026341 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d340cb500 con 0x7f2d340b53c0 2024-04-25T10:05:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.352+0000 7f2d3ba3f640 1 -- 172.21.15.7:0/3758026341 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d340cbac0 con 0x7f2d340b53c0 2024-04-25T10:05:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.353+0000 7f2d3ba3f640 1 -- 172.21.15.7:0/3758026341 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d34068fd0 con 0x7f2d340b53c0 2024-04-25T10:05:06.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.353+0000 7f2d29ffb640 1 -- 172.21.15.7:0/3758026341 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2d240079d0 con 0x7f2d340b53c0 2024-04-25T10:05:06.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.353+0000 7f2d29ffb640 1 --2- 172.21.15.7:0/3758026341 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d1806b4d0 0x7f2d1806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:06.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.353+0000 7f2d29ffb640 1 -- 172.21.15.7:0/3758026341 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f2d2408a7c0 con 0x7f2d340b53c0 2024-04-25T10:05:06.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.353+0000 7f2d397db640 1 --2- 172.21.15.7:0/3758026341 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d1806b4d0 0x7f2d1806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:06.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.354+0000 7f2d397db640 1 --2- 172.21.15.7:0/3758026341 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d1806b4d0 0x7f2d1806d990 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f2d3415d080 tx=0x7f2d30006c90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:06.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.357+0000 7f2d29ffb640 1 -- 172.21.15.7:0/3758026341 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2d24059490 con 0x7f2d340b53c0 2024-04-25T10:05:06.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.538+0000 7f2d3ba3f640 1 -- 172.21.15.7:0/3758026341 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d340b00e0 con 0x7f2d340b53c0 2024-04-25T10:05:06.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.539+0000 7f2d29ffb640 1 -- 172.21.15.7:0/3758026341 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+17111 (secure 0 0 0) 0x7f2d24058d90 con 0x7f2d340b53c0 2024-04-25T10:05:06.544 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:05:06.545 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":119,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:04:57.499369+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:04:27.856713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T10:04:28.566676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6836/3781378145":"2024-04-26T10:04:57.499347+0000","172.21.15.7:6834/3781378145":"2024-04-26T10:04:57.499347+0000","172.21.15.7:6836/3623521645":"2024-04-26T10:04:46.961147+0000","172.21.15.7:6834/3623521645":"2024-04-26T10:04:46.961147+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:05:06.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.541+0000 7f2d3ba3f640 1 -- 172.21.15.7:0/3758026341 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d1806b4d0 msgr2=0x7f2d1806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:06.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.541+0000 7f2d3ba3f640 1 --2- 172.21.15.7:0/3758026341 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d1806b4d0 0x7f2d1806d990 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f2d3415d080 tx=0x7f2d30006c90 comp rx=0 tx=0).stop 2024-04-25T10:05:06.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.541+0000 7f2d3ba3f640 1 -- 172.21.15.7:0/3758026341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d340b53c0 msgr2=0x7f2d340cc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:06.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.541+0000 7f2d3ba3f640 1 --2- 172.21.15.7:0/3758026341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d340b53c0 0x7f2d340cc2c0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f2d2400c7f0 tx=0x7f2d2400ccb0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.541+0000 7f2d3ba3f640 1 -- 172.21.15.7:0/3758026341 shutdown_connections 2024-04-25T10:05:06.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.541+0000 7f2d3ba3f640 1 --2- 172.21.15.7:0/3758026341 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2d1806b4d0 0x7f2d1806d990 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.541+0000 7f2d3ba3f640 1 --2- 172.21.15.7:0/3758026341 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2d3415d7b0 0x7f2d3415c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.541+0000 7f2d3ba3f640 1 --2- 172.21.15.7:0/3758026341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d340b53c0 0x7f2d340cc2c0 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.541+0000 7f2d3ba3f640 1 --2- 172.21.15.7:0/3758026341 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d3406ab60 0x7f2d34151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.541+0000 7f2d3ba3f640 1 -- 172.21.15.7:0/3758026341 >> 172.21.15.7:0/3758026341 conn(0x7f2d340b2390 msgr2=0x7f2d3415bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:06.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.541+0000 7f2d3ba3f640 1 -- 172.21.15.7:0/3758026341 shutdown_connections 2024-04-25T10:05:06.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.541+0000 7f2d3ba3f640 1 -- 172.21.15.7:0/3758026341 wait complete. 2024-04-25T10:05:06.559 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:04:27.856713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:04:28.566676+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '117', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:05:06.559 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:05:06.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.658+0000 7fcbe32ab640 1 Processor -- start 2024-04-25T10:05:06.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.658+0000 7fcbe32ab640 1 -- start start 2024-04-25T10:05:06.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.659+0000 7fcbe32ab640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcbdc06d130 0x7fcbdc071130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:06.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.659+0000 7fcbe32ab640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcbdc071670 0x7fcbdc15c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:06.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.659+0000 7fcbe32ab640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbdc1453c0 con 0x7fcbdc144fe0 2024-04-25T10:05:06.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.659+0000 7fcbe32ab640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbdc0a8560 con 0x7fcbdc06d130 2024-04-25T10:05:06.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.659+0000 7fcbe32ab640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc06d6a0 con 0x7fcbdc071670 2024-04-25T10:05:06.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.659+0000 7fcbe0846640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcbdc06d130 0x7fcbdc071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:06.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.659+0000 7fcbe1047640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fcbdc144fe0 0x7fcbdc06e560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37668/0 (socket says 172.21.15.7:37668) 2024-04-25T10:05:06.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.659+0000 7fcbe1047640 1 -- 172.21.15.7:0/2605653929 learned_addr learned my addr 172.21.15.7:0/2605653929 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:05:06.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.659+0000 7fcbe1848640 1 --2- 172.21.15.7:0/2605653929 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcbdc071670 0x7fcbdc15c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:06.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.659+0000 7fcbe0846640 1 -- 172.21.15.7:0/2605653929 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcbdc071670 msgr2=0x7fcbdc15c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:06.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.659+0000 7fcbe0846640 1 --2- 172.21.15.7:0/2605653929 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcbdc071670 0x7fcbdc15c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.659+0000 7fcbd3fff640 1 -- 172.21.15.7:0/2605653929 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316862761 0 0) 0x7fcbdc1453c0 con 0x7fcbdc144fe0 2024-04-25T10:05:06.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.659+0000 7fcbe0846640 1 -- 172.21.15.7:0/2605653929 >> v1:172.21.15.7:6789/0 conn(0x7fcbdc144fe0 legacy=0x7fcbdc06e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:06.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.659+0000 7fcbe0846640 1 -- 172.21.15.7:0/2605653929 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc06d980 con 0x7fcbdc06d130 2024-04-25T10:05:06.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.659+0000 7fcbe1848640 1 --2- 172.21.15.7:0/2605653929 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcbdc071670 0x7fcbdc15c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:06.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.660+0000 7fcbe0846640 1 --2- 172.21.15.7:0/2605653929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbdc06d130 0x7fcbdc071130 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc0097a0 tx=0x7fcbcc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d612bb237756613 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:06.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.660+0000 7fcbd3fff640 1 -- 172.21.15.7:0/2605653929 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc037070 con 0x7fcbdc06d130 2024-04-25T10:05:06.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.660+0000 7fcbd3fff640 1 -- 172.21.15.7:0/2605653929 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbcc032440 con 0x7fcbdc06d130 2024-04-25T10:05:06.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.660+0000 7fcbd3fff640 1 -- 172.21.15.7:0/2605653929 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc032810 con 0x7fcbdc06d130 2024-04-25T10:05:06.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.661+0000 7fcbe32ab640 1 -- 172.21.15.7:0/2605653929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbdc06d130 msgr2=0x7fcbdc071130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:06.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.661+0000 7fcbe32ab640 1 --2- 172.21.15.7:0/2605653929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbdc06d130 0x7fcbdc071130 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc0097a0 tx=0x7fcbcc02a180 comp rx=0 tx=0).stop 2024-04-25T10:05:06.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.661+0000 7fcbe32ab640 1 -- 172.21.15.7:0/2605653929 shutdown_connections 2024-04-25T10:05:06.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.661+0000 7fcbe32ab640 1 --2- 172.21.15.7:0/2605653929 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcbdc071670 0x7fcbdc15c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.661+0000 7fcbe32ab640 1 --2- 172.21.15.7:0/2605653929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbdc06d130 0x7fcbdc071130 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.661+0000 7fcbe32ab640 1 -- 172.21.15.7:0/2605653929 >> 172.21.15.7:0/2605653929 conn(0x7fcbdc06ab60 msgr2=0x7fcbdc06af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:06.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.661+0000 7fcbe32ab640 1 -- 172.21.15.7:0/2605653929 shutdown_connections 2024-04-25T10:05:06.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.661+0000 7fcbe32ab640 1 -- 172.21.15.7:0/2605653929 wait complete. 2024-04-25T10:05:06.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.662+0000 7fcbe32ab640 1 Processor -- start 2024-04-25T10:05:06.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.662+0000 7fcbe32ab640 1 -- start start 2024-04-25T10:05:06.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.663+0000 7fcbe32ab640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbdc06d130 0x7fcbdc13d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:06.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.663+0000 7fcbe32ab640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbdc071670 0x7fcbdc153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:06.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.663+0000 7fcbe32ab640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcbdc144fe0 0x7fcbdc0b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:06.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.663+0000 7fcbe32ab640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc15be50 con 0x7fcbdc071670 2024-04-25T10:05:06.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.663+0000 7fcbe32ab640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc06df40 con 0x7fcbdc06d130 2024-04-25T10:05:06.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.663+0000 7fcbe32ab640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc15c8b0 con 0x7fcbdc144fe0 2024-04-25T10:05:06.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.663+0000 7fcbe0846640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbdc071670 0x7fcbdc153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:06.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.663+0000 7fcbe0846640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbdc071670 0x7fcbdc153970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38244/0 (socket says 172.21.15.7:38244) 2024-04-25T10:05:06.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.663+0000 7fcbe0846640 1 -- 172.21.15.7:0/3753734019 learned_addr learned my addr 172.21.15.7:0/3753734019 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:06.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.663+0000 7fcbe1848640 1 --2- 172.21.15.7:0/3753734019 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcbdc144fe0 0x7fcbdc0b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:06.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.663+0000 7fcbe0846640 1 -- 172.21.15.7:0/3753734019 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcbdc144fe0 msgr2=0x7fcbdc0b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:06.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.663+0000 7fcbe0846640 1 --2- 172.21.15.7:0/3753734019 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcbdc144fe0 0x7fcbdc0b40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.663+0000 7fcbe0846640 1 -- 172.21.15.7:0/3753734019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbdc06d130 msgr2=0x7fcbdc13d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:06.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.663+0000 7fcbe0846640 1 --2- 172.21.15.7:0/3753734019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbdc06d130 0x7fcbdc13d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.663+0000 7fcbe0846640 1 -- 172.21.15.7:0/3753734019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc13e660 con 0x7fcbdc071670 2024-04-25T10:05:06.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.663+0000 7fcbe0846640 1 --2- 172.21.15.7:0/3753734019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbdc071670 0x7fcbdc153970 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc035040 tx=0x7fcbcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:06.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.663+0000 7fcbd1ffb640 1 -- 172.21.15.7:0/3753734019 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc037040 con 0x7fcbdc071670 2024-04-25T10:05:06.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.663+0000 7fcbd1ffb640 1 -- 172.21.15.7:0/3753734019 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbcc030770 con 0x7fcbdc071670 2024-04-25T10:05:06.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.663+0000 7fcbe32ab640 1 -- 172.21.15.7:0/3753734019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbdc0b3300 con 0x7fcbdc071670 2024-04-25T10:05:06.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.663+0000 7fcbd1ffb640 1 -- 172.21.15.7:0/3753734019 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc030b80 con 0x7fcbdc071670 2024-04-25T10:05:06.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.664+0000 7fcbe32ab640 1 -- 172.21.15.7:0/3753734019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbdc0b38c0 con 0x7fcbdc071670 2024-04-25T10:05:06.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.665+0000 7fcbe32ab640 1 -- 172.21.15.7:0/3753734019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbdc068f60 con 0x7fcbdc071670 2024-04-25T10:05:06.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.665+0000 7fcbd1ffb640 1 -- 172.21.15.7:0/3753734019 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcbcc044020 con 0x7fcbdc071670 2024-04-25T10:05:06.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.665+0000 7fcbd1ffb640 1 --2- 172.21.15.7:0/3753734019 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcbc006b4d0 0x7fcbc006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:06.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.666+0000 7fcbd1ffb640 1 -- 172.21.15.7:0/3753734019 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fcbcc0aaa30 con 0x7fcbdc071670 2024-04-25T10:05:06.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.666+0000 7fcbe1047640 1 --2- 172.21.15.7:0/3753734019 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcbc006b4d0 0x7fcbc006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:06.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.666+0000 7fcbe1047640 1 --2- 172.21.15.7:0/3753734019 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcbc006b4d0 0x7fcbc006d990 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4007fd0 tx=0x7fcbd4007960 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:06.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.670+0000 7fcbd1ffb640 1 -- 172.21.15.7:0/3753734019 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcbdc13e660 con 0x7fcbdc071670 2024-04-25T10:05:06.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.849+0000 7fcbe32ab640 1 -- 172.21.15.7:0/3753734019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcbdc15c310 con 0x7fcbdc071670 2024-04-25T10:05:06.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.850+0000 7fcbd1ffb640 1 -- 172.21.15.7:0/3753734019 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v119) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcbcc032e20 con 0x7fcbdc071670 2024-04-25T10:05:06.855 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T10:05:06.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.852+0000 7fcbe32ab640 1 -- 172.21.15.7:0/3753734019 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcbc006b4d0 msgr2=0x7fcbc006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:06.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.852+0000 7fcbe32ab640 1 --2- 172.21.15.7:0/3753734019 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcbc006b4d0 0x7fcbc006d990 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4007fd0 tx=0x7fcbd4007960 comp rx=0 tx=0).stop 2024-04-25T10:05:06.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.852+0000 7fcbe32ab640 1 -- 172.21.15.7:0/3753734019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbdc071670 msgr2=0x7fcbdc153970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:06.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.852+0000 7fcbe32ab640 1 --2- 172.21.15.7:0/3753734019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbdc071670 0x7fcbdc153970 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc035040 tx=0x7fcbcc0046c0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.852+0000 7fcbe32ab640 1 -- 172.21.15.7:0/3753734019 shutdown_connections 2024-04-25T10:05:06.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.852+0000 7fcbe32ab640 1 --2- 172.21.15.7:0/3753734019 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcbc006b4d0 0x7fcbc006d990 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.852+0000 7fcbe32ab640 1 --2- 172.21.15.7:0/3753734019 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcbdc144fe0 0x7fcbdc0b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.852+0000 7fcbe32ab640 1 --2- 172.21.15.7:0/3753734019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbdc071670 0x7fcbdc153970 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.852+0000 7fcbe32ab640 1 --2- 172.21.15.7:0/3753734019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbdc06d130 0x7fcbdc13d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.852+0000 7fcbe32ab640 1 -- 172.21.15.7:0/3753734019 >> 172.21.15.7:0/3753734019 conn(0x7fcbdc06ab60 msgr2=0x7fcbdc0cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:06.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.852+0000 7fcbe32ab640 1 -- 172.21.15.7:0/3753734019 shutdown_connections 2024-04-25T10:05:06.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.852+0000 7fcbe32ab640 1 -- 172.21.15.7:0/3753734019 wait complete. 2024-04-25T10:05:06.868 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:05:06.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.968+0000 7fea5705a640 1 Processor -- start 2024-04-25T10:05:06.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.968+0000 7fea5705a640 1 -- start start 2024-04-25T10:05:06.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.969+0000 7fea5705a640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fea5015deb0 0x7fea500b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:06.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.969+0000 7fea5705a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fea500d3760 0x7fea500d3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:06.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.969+0000 7fea5705a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea500ce4c0 con 0x7fea500ce030 2024-04-25T10:05:06.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.969+0000 7fea5705a640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea500d4110 con 0x7fea5015deb0 2024-04-25T10:05:06.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.969+0000 7fea5705a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea500d1a40 con 0x7fea500d3760 2024-04-25T10:05:06.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.969+0000 7fea54df6640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fea5015deb0 0x7fea500b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:06.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.969+0000 7fea54df6640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fea5015deb0 0x7fea500b2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38254/0 (socket says 172.21.15.7:38254) 2024-04-25T10:05:06.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.969+0000 7fea54df6640 1 -- 172.21.15.7:0/3381005889 learned_addr learned my addr 172.21.15.7:0/3381005889 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:06.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.969+0000 7fea555f7640 1 --2- 172.21.15.7:0/3381005889 >> v2:172.21.15.55:3300/0 conn(0x7fea500d3760 0x7fea500d3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:06.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.969+0000 7fea54df6640 1 -- 172.21.15.7:0/3381005889 >> v2:172.21.15.55:3300/0 conn(0x7fea500d3760 msgr2=0x7fea500d3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:06.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.969+0000 7fea54df6640 1 --2- 172.21.15.7:0/3381005889 >> v2:172.21.15.55:3300/0 conn(0x7fea500d3760 0x7fea500d3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.969+0000 7fea54df6640 1 -- 172.21.15.7:0/3381005889 >> v1:172.21.15.55:6789/0 conn(0x7fea500ce030 legacy=0x7fea500b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:06.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.969+0000 7fea54df6640 1 -- 172.21.15.7:0/3381005889 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea500d1d20 con 0x7fea5015deb0 2024-04-25T10:05:06.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.969+0000 7fea555f7640 1 --2- 172.21.15.7:0/3381005889 >> v2:172.21.15.55:3300/0 conn(0x7fea500d3760 0x7fea500d3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:06.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.970+0000 7fea54df6640 1 --2- 172.21.15.7:0/3381005889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea5015deb0 0x7fea500b2c30 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fea500b67b0 tx=0x7fea4402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda6336dbe5fac0e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:06.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.970+0000 7fea4f7fe640 1 -- 172.21.15.7:0/3381005889 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea44037070 con 0x7fea5015deb0 2024-04-25T10:05:06.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.970+0000 7fea4f7fe640 1 -- 172.21.15.7:0/3381005889 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea44032440 con 0x7fea5015deb0 2024-04-25T10:05:06.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.970+0000 7fea4f7fe640 1 -- 172.21.15.7:0/3381005889 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea44032810 con 0x7fea5015deb0 2024-04-25T10:05:06.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.971+0000 7fea5705a640 1 -- 172.21.15.7:0/3381005889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea5015deb0 msgr2=0x7fea500b2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:06.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.971+0000 7fea5705a640 1 --2- 172.21.15.7:0/3381005889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea5015deb0 0x7fea500b2c30 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fea500b67b0 tx=0x7fea4402a230 comp rx=0 tx=0).stop 2024-04-25T10:05:06.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.971+0000 7fea5705a640 1 -- 172.21.15.7:0/3381005889 shutdown_connections 2024-04-25T10:05:06.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.971+0000 7fea5705a640 1 --2- 172.21.15.7:0/3381005889 >> v2:172.21.15.55:3300/0 conn(0x7fea500d3760 0x7fea500d3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.971+0000 7fea5705a640 1 --2- 172.21.15.7:0/3381005889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea5015deb0 0x7fea500b2c30 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.971+0000 7fea5705a640 1 -- 172.21.15.7:0/3381005889 >> 172.21.15.7:0/3381005889 conn(0x7fea500726b0 msgr2=0x7fea50072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:06.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.971+0000 7fea5705a640 1 -- 172.21.15.7:0/3381005889 shutdown_connections 2024-04-25T10:05:06.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.971+0000 7fea5705a640 1 -- 172.21.15.7:0/3381005889 wait complete. 2024-04-25T10:05:06.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.972+0000 7fea5705a640 1 Processor -- start 2024-04-25T10:05:06.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.972+0000 7fea5705a640 1 -- start start 2024-04-25T10:05:06.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.973+0000 7fea5705a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fea500ce030 0x7fea500b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:06.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.973+0000 7fea5705a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea500d3760 0x7fea500cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:06.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.973+0000 7fea5705a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea5015deb0 0x7fea500cc300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:06.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.973+0000 7fea5705a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea500d25c0 con 0x7fea500d3760 2024-04-25T10:05:06.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.973+0000 7fea5705a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea500d22e0 con 0x7fea5015deb0 2024-04-25T10:05:06.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.973+0000 7fea5705a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea500b70f0 con 0x7fea500ce030 2024-04-25T10:05:06.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.973+0000 7fea4ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea500d3760 0x7fea500cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:06.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.973+0000 7fea4ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea500d3760 0x7fea500cd0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38266/0 (socket says 172.21.15.7:38266) 2024-04-25T10:05:06.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.973+0000 7fea4ffff640 1 -- 172.21.15.7:0/1743568810 learned_addr learned my addr 172.21.15.7:0/1743568810 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:06.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.973+0000 7fea4ffff640 1 -- 172.21.15.7:0/1743568810 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fea500ce030 msgr2=0x7fea500b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:06.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.973+0000 7fea4ffff640 1 --2- 172.21.15.7:0/1743568810 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fea500ce030 0x7fea500b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.973+0000 7fea4ffff640 1 -- 172.21.15.7:0/1743568810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea5015deb0 msgr2=0x7fea500cc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:06.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.973+0000 7fea4ffff640 1 --2- 172.21.15.7:0/1743568810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea5015deb0 0x7fea500cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.973+0000 7fea4ffff640 1 -- 172.21.15.7:0/1743568810 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea500b4e20 con 0x7fea500d3760 2024-04-25T10:05:06.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.973+0000 7fea4ffff640 1 --2- 172.21.15.7:0/1743568810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea500d3760 0x7fea500cd0d0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00c430 tx=0x7fea3c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:06.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.973+0000 7fea4d7fa640 1 -- 172.21.15.7:0/1743568810 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c011790 con 0x7fea500d3760 2024-04-25T10:05:06.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.974+0000 7fea4d7fa640 1 -- 172.21.15.7:0/1743568810 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3c017070 con 0x7fea500d3760 2024-04-25T10:05:06.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.974+0000 7fea5705a640 1 -- 172.21.15.7:0/1743568810 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea500b5100 con 0x7fea500d3760 2024-04-25T10:05:06.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.974+0000 7fea4d7fa640 1 -- 172.21.15.7:0/1743568810 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c011bb0 con 0x7fea500d3760 2024-04-25T10:05:06.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.974+0000 7fea5705a640 1 -- 172.21.15.7:0/1743568810 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea500b56c0 con 0x7fea500d3760 2024-04-25T10:05:06.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.975+0000 7fea5705a640 1 -- 172.21.15.7:0/1743568810 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea50068f60 con 0x7fea500d3760 2024-04-25T10:05:06.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.975+0000 7fea4d7fa640 1 -- 172.21.15.7:0/1743568810 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fea3c01c460 con 0x7fea500d3760 2024-04-25T10:05:06.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.975+0000 7fea4d7fa640 1 --2- 172.21.15.7:0/1743568810 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fea3406b500 0x7fea3406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:06.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.976+0000 7fea4d7fa640 1 -- 172.21.15.7:0/1743568810 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fea3c08a2d0 con 0x7fea500d3760 2024-04-25T10:05:06.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.976+0000 7fea54df6640 1 --2- 172.21.15.7:0/1743568810 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fea3406b500 0x7fea3406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:06.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.976+0000 7fea54df6640 1 --2- 172.21.15.7:0/1743568810 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fea3406b500 0x7fea3406d9c0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fea44034000 tx=0x7fea4402c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:06.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:06.980+0000 7fea4d7fa640 1 -- 172.21.15.7:0/1743568810 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fea3c058f10 con 0x7fea500d3760 2024-04-25T10:05:07.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.158+0000 7fea5705a640 1 -- 172.21.15.7:0/1743568810 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fea5015a5e0 con 0x7fea500d3760 2024-04-25T10:05:07.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.158+0000 7fea4d7fa640 1 -- 172.21.15.7:0/1743568810 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v119) v1 ==== 104+0+11 (secure 0 0 0) 0x7fea3c08a0f0 con 0x7fea500d3760 2024-04-25T10:05:07.164 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T10:05:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.160+0000 7fea5705a640 1 -- 172.21.15.7:0/1743568810 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fea3406b500 msgr2=0x7fea3406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.160+0000 7fea5705a640 1 --2- 172.21.15.7:0/1743568810 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fea3406b500 0x7fea3406d9c0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fea44034000 tx=0x7fea4402c000 comp rx=0 tx=0).stop 2024-04-25T10:05:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.160+0000 7fea5705a640 1 -- 172.21.15.7:0/1743568810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea500d3760 msgr2=0x7fea500cd0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.160+0000 7fea5705a640 1 --2- 172.21.15.7:0/1743568810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea500d3760 0x7fea500cd0d0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00c430 tx=0x7fea3c00c8f0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.160+0000 7fea5705a640 1 -- 172.21.15.7:0/1743568810 shutdown_connections 2024-04-25T10:05:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.161+0000 7fea5705a640 1 --2- 172.21.15.7:0/1743568810 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fea3406b500 0x7fea3406d9c0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.161+0000 7fea5705a640 1 --2- 172.21.15.7:0/1743568810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea5015deb0 0x7fea500cc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.161+0000 7fea5705a640 1 --2- 172.21.15.7:0/1743568810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea500d3760 0x7fea500cd0d0 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.161+0000 7fea5705a640 1 --2- 172.21.15.7:0/1743568810 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fea500ce030 0x7fea500b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.161+0000 7fea5705a640 1 -- 172.21.15.7:0/1743568810 >> 172.21.15.7:0/1743568810 conn(0x7fea500726b0 msgr2=0x7fea500b7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:07.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.161+0000 7fea5705a640 1 -- 172.21.15.7:0/1743568810 shutdown_connections 2024-04-25T10:05:07.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.161+0000 7fea5705a640 1 -- 172.21.15.7:0/1743568810 wait complete. 2024-04-25T10:05:07.177 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:05:07.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.275+0000 7f225f488640 1 Processor -- start 2024-04-25T10:05:07.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.275+0000 7f225f488640 1 -- start start 2024-04-25T10:05:07.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.276+0000 7f225f488640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f225806e950 0x7f22580b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.276+0000 7f225f488640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f22580ce610 0x7f22580cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.276+0000 7f225f488640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22580b2ee0 con 0x7f2258143fb0 2024-04-25T10:05:07.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.276+0000 7f225f488640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22580b3150 con 0x7f22580ce610 2024-04-25T10:05:07.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.276+0000 7f225f488640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22580b3430 con 0x7f225806e950 2024-04-25T10:05:07.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.276+0000 7f225da25640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f22580ce610 0x7f22580cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:07.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.276+0000 7f225d224640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2258143fb0 0x7f225806e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37672/0 (socket says 172.21.15.7:37672) 2024-04-25T10:05:07.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.276+0000 7f225d224640 1 -- 172.21.15.7:0/2082305393 learned_addr learned my addr 172.21.15.7:0/2082305393 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:05:07.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.276+0000 7f225da25640 1 -- 172.21.15.7:0/2082305393 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f225806e950 msgr2=0x7f22580b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:07.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.276+0000 7f225da25640 1 --2- 172.21.15.7:0/2082305393 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f225806e950 0x7f22580b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.276+0000 7f225da25640 1 -- 172.21.15.7:0/2082305393 >> v1:172.21.15.7:6789/0 conn(0x7f2258143fb0 legacy=0x7f225806e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.276+0000 7f224ffff640 1 -- 172.21.15.7:0/2082305393 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463234461 0 0) 0x7f22580b2ee0 con 0x7f2258143fb0 2024-04-25T10:05:07.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.276+0000 7f225da25640 1 -- 172.21.15.7:0/2082305393 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22580b3710 con 0x7f22580ce610 2024-04-25T10:05:07.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.277+0000 7f225da25640 1 --2- 172.21.15.7:0/2082305393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22580ce610 0x7f22580cea60 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f2250009d90 tx=0x7f225002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b1da415a1891e3d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:07.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.277+0000 7f224ffff640 1 -- 172.21.15.7:0/2082305393 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2250007740 con 0x7f22580ce610 2024-04-25T10:05:07.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.277+0000 7f224ffff640 1 -- 172.21.15.7:0/2082305393 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22500078e0 con 0x7f22580ce610 2024-04-25T10:05:07.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.277+0000 7f224ffff640 1 -- 172.21.15.7:0/2082305393 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2250007cb0 con 0x7f22580ce610 2024-04-25T10:05:07.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.278+0000 7f225f488640 1 -- 172.21.15.7:0/2082305393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22580ce610 msgr2=0x7f22580cea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.278+0000 7f225f488640 1 --2- 172.21.15.7:0/2082305393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22580ce610 0x7f22580cea60 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f2250009d90 tx=0x7f225002a660 comp rx=0 tx=0).stop 2024-04-25T10:05:07.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.278+0000 7f225f488640 1 -- 172.21.15.7:0/2082305393 shutdown_connections 2024-04-25T10:05:07.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.278+0000 7f225f488640 1 --2- 172.21.15.7:0/2082305393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22580ce610 0x7f22580cea60 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.278+0000 7f225f488640 1 --2- 172.21.15.7:0/2082305393 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f225806e950 0x7f22580b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.278+0000 7f225f488640 1 -- 172.21.15.7:0/2082305393 >> 172.21.15.7:0/2082305393 conn(0x7f225806ab60 msgr2=0x7f225806af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:07.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.278+0000 7f225f488640 1 -- 172.21.15.7:0/2082305393 shutdown_connections 2024-04-25T10:05:07.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.278+0000 7f225f488640 1 -- 172.21.15.7:0/2082305393 wait complete. 2024-04-25T10:05:07.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.279+0000 7f225f488640 1 Processor -- start 2024-04-25T10:05:07.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.279+0000 7f225f488640 1 -- start start 2024-04-25T10:05:07.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.280+0000 7f225f488640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f225806e950 0x7f22580aa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.280+0000 7f225f488640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f22580ce610 0x7f2258159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.280+0000 7f225f488640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2258143fb0 0x7f22581e6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.280+0000 7f225f488640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22580cefa0 con 0x7f225806e950 2024-04-25T10:05:07.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.280+0000 7f225f488640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22580cf2f0 con 0x7f2258143fb0 2024-04-25T10:05:07.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.280+0000 7f225f488640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225815ac70 con 0x7f22580ce610 2024-04-25T10:05:07.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.280+0000 7f225d224640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f225806e950 0x7f22580aa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:07.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.280+0000 7f225d224640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f225806e950 0x7f22580aa5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38286/0 (socket says 172.21.15.7:38286) 2024-04-25T10:05:07.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.280+0000 7f225d224640 1 -- 172.21.15.7:0/2259454421 learned_addr learned my addr 172.21.15.7:0/2259454421 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:07.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.280+0000 7f225d224640 1 -- 172.21.15.7:0/2259454421 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f22580ce610 msgr2=0x7f2258159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.280+0000 7f225d224640 1 --2- 172.21.15.7:0/2259454421 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f22580ce610 0x7f2258159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.280+0000 7f225d224640 1 -- 172.21.15.7:0/2259454421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2258143fb0 msgr2=0x7f22581e6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.280+0000 7f225d224640 1 --2- 172.21.15.7:0/2259454421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2258143fb0 0x7f22581e6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.280+0000 7f225d224640 1 -- 172.21.15.7:0/2259454421 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22580a89f0 con 0x7f225806e950 2024-04-25T10:05:07.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.280+0000 7f225d224640 1 --2- 172.21.15.7:0/2259454421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f225806e950 0x7f22580aa5d0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f225400c430 tx=0x7f225400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:07.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.280+0000 7f224dffb640 1 -- 172.21.15.7:0/2259454421 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22540074e0 con 0x7f225806e950 2024-04-25T10:05:07.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.280+0000 7f224dffb640 1 -- 172.21.15.7:0/2259454421 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22540047e0 con 0x7f225806e950 2024-04-25T10:05:07.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.280+0000 7f225f488640 1 -- 172.21.15.7:0/2259454421 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22580a8cd0 con 0x7f225806e950 2024-04-25T10:05:07.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.280+0000 7f224dffb640 1 -- 172.21.15.7:0/2259454421 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2254004bd0 con 0x7f225806e950 2024-04-25T10:05:07.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.281+0000 7f225f488640 1 -- 172.21.15.7:0/2259454421 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22580a9290 con 0x7f225806e950 2024-04-25T10:05:07.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.282+0000 7f225f488640 1 -- 172.21.15.7:0/2259454421 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2258068f60 con 0x7f225806e950 2024-04-25T10:05:07.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.282+0000 7f224dffb640 1 -- 172.21.15.7:0/2259454421 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2254011070 con 0x7f225806e950 2024-04-25T10:05:07.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.282+0000 7f224dffb640 1 --2- 172.21.15.7:0/2259454421 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f223c06b4d0 0x7f223c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.282+0000 7f224dffb640 1 -- 172.21.15.7:0/2259454421 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f225408a100 con 0x7f225806e950 2024-04-25T10:05:07.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.282+0000 7f225ca23640 1 --2- 172.21.15.7:0/2259454421 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f223c06b4d0 0x7f223c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:07.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.283+0000 7f225ca23640 1 --2- 172.21.15.7:0/2259454421 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f223c06b4d0 0x7f223c06d990 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f22580b30a0 tx=0x7f2248006c90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:07.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.286+0000 7f224dffb640 1 -- 172.21.15.7:0/2259454421 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2254058d40 con 0x7f225806e950 2024-04-25T10:05:07.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.468+0000 7f225f488640 1 -- 172.21.15.7:0/2259454421 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2258143190 con 0x7f225806e950 2024-04-25T10:05:07.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.468+0000 7f224dffb640 1 -- 172.21.15.7:0/2259454421 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v119) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2254058640 con 0x7f225806e950 2024-04-25T10:05:07.474 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T10:05:07.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.470+0000 7f225f488640 1 -- 172.21.15.7:0/2259454421 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f223c06b4d0 msgr2=0x7f223c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.470+0000 7f225f488640 1 --2- 172.21.15.7:0/2259454421 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f223c06b4d0 0x7f223c06d990 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f22580b30a0 tx=0x7f2248006c90 comp rx=0 tx=0).stop 2024-04-25T10:05:07.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.470+0000 7f225f488640 1 -- 172.21.15.7:0/2259454421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f225806e950 msgr2=0x7f22580aa5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.470+0000 7f225f488640 1 --2- 172.21.15.7:0/2259454421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f225806e950 0x7f22580aa5d0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f225400c430 tx=0x7f225400c8f0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.470+0000 7f225f488640 1 -- 172.21.15.7:0/2259454421 shutdown_connections 2024-04-25T10:05:07.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.470+0000 7f225f488640 1 --2- 172.21.15.7:0/2259454421 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f223c06b4d0 0x7f223c06d990 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.470+0000 7f225f488640 1 --2- 172.21.15.7:0/2259454421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2258143fb0 0x7f22581e6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.470+0000 7f225f488640 1 --2- 172.21.15.7:0/2259454421 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f22580ce610 0x7f2258159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.470+0000 7f225f488640 1 --2- 172.21.15.7:0/2259454421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f225806e950 0x7f22580aa5d0 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.470+0000 7f225f488640 1 -- 172.21.15.7:0/2259454421 >> 172.21.15.7:0/2259454421 conn(0x7f225806ab60 msgr2=0x7f22580af7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:07.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.470+0000 7f225f488640 1 -- 172.21.15.7:0/2259454421 shutdown_connections 2024-04-25T10:05:07.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.470+0000 7f225f488640 1 -- 172.21.15.7:0/2259454421 wait complete. 2024-04-25T10:05:07.487 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:05:07.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.582+0000 7f7f346cb640 1 Processor -- start 2024-04-25T10:05:07.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.582+0000 7f7f346cb640 1 -- start start 2024-04-25T10:05:07.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.583+0000 7f7f346cb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7f2c0d0aa0 0x7f7f2c161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.583+0000 7f7f346cb640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7f2c1622b0 0x7f7f2c0ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.583+0000 7f7f346cb640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f2c15e8a0 con 0x7f7f2c15da60 2024-04-25T10:05:07.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.583+0000 7f7f346cb640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f2c15eb80 con 0x7f7f2c1622b0 2024-04-25T10:05:07.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.583+0000 7f7f346cb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f2c15ee60 con 0x7f7f2c0d0aa0 2024-04-25T10:05:07.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.583+0000 7f7f32c68640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7f2c1622b0 0x7f7f2c0ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:07.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.583+0000 7f7f32467640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7f2c15da60 0x7f7f2c15de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37676/0 (socket says 172.21.15.7:37676) 2024-04-25T10:05:07.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.584+0000 7f7f32467640 1 -- 172.21.15.7:0/3506513968 learned_addr learned my addr 172.21.15.7:0/3506513968 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:05:07.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.584+0000 7f7f31c66640 1 --2- 172.21.15.7:0/3506513968 >> v2:172.21.15.55:3300/0 conn(0x7f7f2c0d0aa0 0x7f7f2c161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:07.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.584+0000 7f7f32c68640 1 -- 172.21.15.7:0/3506513968 >> v2:172.21.15.55:3300/0 conn(0x7f7f2c0d0aa0 msgr2=0x7f7f2c161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:07.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.584+0000 7f7f32c68640 1 --2- 172.21.15.7:0/3506513968 >> v2:172.21.15.55:3300/0 conn(0x7f7f2c0d0aa0 0x7f7f2c161d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.584+0000 7f7f32c68640 1 -- 172.21.15.7:0/3506513968 >> v1:172.21.15.7:6789/0 conn(0x7f7f2c15da60 legacy=0x7f7f2c15de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.584+0000 7f7f32c68640 1 -- 172.21.15.7:0/3506513968 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2c161850 con 0x7f7f2c1622b0 2024-04-25T10:05:07.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.584+0000 7f7f32c68640 1 --2- 172.21.15.7:0/3506513968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f2c1622b0 0x7f7f2c0ce520 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c0b3260 tx=0x7f7f2402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=555c851184d7c9b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:07.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.585+0000 7f7f31465640 1 -- 172.21.15.7:0/3506513968 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f24007740 con 0x7f7f2c1622b0 2024-04-25T10:05:07.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.585+0000 7f7f31465640 1 -- 172.21.15.7:0/3506513968 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f240078e0 con 0x7f7f2c1622b0 2024-04-25T10:05:07.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.585+0000 7f7f31465640 1 -- 172.21.15.7:0/3506513968 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f24007cb0 con 0x7f7f2c1622b0 2024-04-25T10:05:07.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.585+0000 7f7f346cb640 1 -- 172.21.15.7:0/3506513968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f2c1622b0 msgr2=0x7f7f2c0ce520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.585+0000 7f7f346cb640 1 --2- 172.21.15.7:0/3506513968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f2c1622b0 0x7f7f2c0ce520 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c0b3260 tx=0x7f7f2402a5f0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.585+0000 7f7f346cb640 1 -- 172.21.15.7:0/3506513968 shutdown_connections 2024-04-25T10:05:07.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.585+0000 7f7f346cb640 1 --2- 172.21.15.7:0/3506513968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f2c1622b0 0x7f7f2c0ce520 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.585+0000 7f7f346cb640 1 --2- 172.21.15.7:0/3506513968 >> v2:172.21.15.55:3300/0 conn(0x7f7f2c0d0aa0 0x7f7f2c161d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.585+0000 7f7f346cb640 1 -- 172.21.15.7:0/3506513968 >> 172.21.15.7:0/3506513968 conn(0x7f7f2c06bfe0 msgr2=0x7f7f2c06c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:07.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.585+0000 7f7f346cb640 1 -- 172.21.15.7:0/3506513968 shutdown_connections 2024-04-25T10:05:07.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.585+0000 7f7f346cb640 1 -- 172.21.15.7:0/3506513968 wait complete. 2024-04-25T10:05:07.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.587+0000 7f7f346cb640 1 Processor -- start 2024-04-25T10:05:07.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.587+0000 7f7f346cb640 1 -- start start 2024-04-25T10:05:07.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.587+0000 7f7f346cb640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7f2c0d0aa0 0x7f7f2c0b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.587+0000 7f7f346cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f2c15da60 0x7f7f2c1f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.587+0000 7f7f346cb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f2c1622b0 0x7f7f2c0b5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.587+0000 7f7f346cb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c0cebe0 con 0x7f7f2c1622b0 2024-04-25T10:05:07.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.587+0000 7f7f346cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c0cea60 con 0x7f7f2c15da60 2024-04-25T10:05:07.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.587+0000 7f7f346cb640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c0ced60 con 0x7f7f2c0d0aa0 2024-04-25T10:05:07.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.588+0000 7f7f32c68640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f2c1622b0 0x7f7f2c0b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:07.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.588+0000 7f7f32c68640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f2c1622b0 0x7f7f2c0b5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38312/0 (socket says 172.21.15.7:38312) 2024-04-25T10:05:07.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.588+0000 7f7f32c68640 1 -- 172.21.15.7:0/2229930920 learned_addr learned my addr 172.21.15.7:0/2229930920 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:07.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.588+0000 7f7f31c66640 1 --2- 172.21.15.7:0/2229930920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f2c15da60 0x7f7f2c1f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:07.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.588+0000 7f7f32467640 1 --2- 172.21.15.7:0/2229930920 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7f2c0d0aa0 0x7f7f2c0b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:07.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.588+0000 7f7f32c68640 1 -- 172.21.15.7:0/2229930920 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7f2c0d0aa0 msgr2=0x7f7f2c0b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.588+0000 7f7f32c68640 1 --2- 172.21.15.7:0/2229930920 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7f2c0d0aa0 0x7f7f2c0b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.588+0000 7f7f32c68640 1 -- 172.21.15.7:0/2229930920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f2c15da60 msgr2=0x7f7f2c1f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.588+0000 7f7f32c68640 1 --2- 172.21.15.7:0/2229930920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f2c15da60 0x7f7f2c1f64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.588+0000 7f7f32c68640 1 -- 172.21.15.7:0/2229930920 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2c1f3ba0 con 0x7f7f2c1622b0 2024-04-25T10:05:07.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.588+0000 7f7f32c68640 1 --2- 172.21.15.7:0/2229930920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f2c1622b0 0x7f7f2c0b5470 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f7f2402abe0 tx=0x7f7f24004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:07.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.589+0000 7f7f22ffd640 1 -- 172.21.15.7:0/2229930920 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2403f070 con 0x7f7f2c1622b0 2024-04-25T10:05:07.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.589+0000 7f7f22ffd640 1 -- 172.21.15.7:0/2229930920 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f24031c60 con 0x7f7f2c1622b0 2024-04-25T10:05:07.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.590+0000 7f7f346cb640 1 -- 172.21.15.7:0/2229930920 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f2c1f3e80 con 0x7f7f2c1622b0 2024-04-25T10:05:07.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.590+0000 7f7f22ffd640 1 -- 172.21.15.7:0/2229930920 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f24043650 con 0x7f7f2c1622b0 2024-04-25T10:05:07.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.590+0000 7f7f346cb640 1 -- 172.21.15.7:0/2229930920 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f2c1f4720 con 0x7f7f2c1622b0 2024-04-25T10:05:07.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.591+0000 7f7f346cb640 1 -- 172.21.15.7:0/2229930920 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f2c1f4920 con 0x7f7f2c1622b0 2024-04-25T10:05:07.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.591+0000 7f7f22ffd640 1 -- 172.21.15.7:0/2229930920 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7f2403b410 con 0x7f7f2c1622b0 2024-04-25T10:05:07.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.591+0000 7f7f22ffd640 1 --2- 172.21.15.7:0/2229930920 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7f1006b4d0 0x7f7f1006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.591+0000 7f7f22ffd640 1 -- 172.21.15.7:0/2229930920 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f7f240ab770 con 0x7f7f2c1622b0 2024-04-25T10:05:07.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.592+0000 7f7f32467640 1 --2- 172.21.15.7:0/2229930920 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7f1006b4d0 0x7f7f1006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:07.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.592+0000 7f7f32467640 1 --2- 172.21.15.7:0/2229930920 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7f1006b4d0 0x7f7f1006d990 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f7f28007fd0 tx=0x7f7f28007e80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:07.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.596+0000 7f7f22ffd640 1 -- 172.21.15.7:0/2229930920 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7f2c1f4920 con 0x7f7f2c1622b0 2024-04-25T10:05:07.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.789+0000 7f7f346cb640 1 -- 172.21.15.7:0/2229930920 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7f2c1f4050 con 0x7f7f2c1622b0 2024-04-25T10:05:07.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.789+0000 7f7f22ffd640 1 -- 172.21.15.7:0/2229930920 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v119) v1 ==== 80+0+240 (secure 0 0 0) 0x7f7f24079d60 con 0x7f7f2c1622b0 2024-04-25T10:05:07.795 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3781378145 2024-04-26T10:04:57.499347+0000 2024-04-25T10:05:07.795 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3781378145 2024-04-26T10:04:57.499347+0000 2024-04-25T10:05:07.795 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/3623521645 2024-04-26T10:04:46.961147+0000 2024-04-25T10:05:07.795 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/3623521645 2024-04-26T10:04:46.961147+0000 2024-04-25T10:05:07.796 INFO:teuthology.orchestra.run.smithi007.stderr:listed 4 entries 2024-04-25T10:05:07.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.791+0000 7f7f346cb640 1 -- 172.21.15.7:0/2229930920 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7f1006b4d0 msgr2=0x7f7f1006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.791+0000 7f7f346cb640 1 --2- 172.21.15.7:0/2229930920 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7f1006b4d0 0x7f7f1006d990 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f7f28007fd0 tx=0x7f7f28007e80 comp rx=0 tx=0).stop 2024-04-25T10:05:07.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.791+0000 7f7f346cb640 1 -- 172.21.15.7:0/2229930920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f2c1622b0 msgr2=0x7f7f2c0b5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.791+0000 7f7f346cb640 1 --2- 172.21.15.7:0/2229930920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f2c1622b0 0x7f7f2c0b5470 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f7f2402abe0 tx=0x7f7f24004a40 comp rx=0 tx=0).stop 2024-04-25T10:05:07.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.791+0000 7f7f346cb640 1 -- 172.21.15.7:0/2229930920 shutdown_connections 2024-04-25T10:05:07.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.791+0000 7f7f346cb640 1 --2- 172.21.15.7:0/2229930920 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f7f1006b4d0 0x7f7f1006d990 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.791+0000 7f7f346cb640 1 --2- 172.21.15.7:0/2229930920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f2c1622b0 0x7f7f2c0b5470 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.791+0000 7f7f346cb640 1 --2- 172.21.15.7:0/2229930920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f2c15da60 0x7f7f2c1f64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.791+0000 7f7f346cb640 1 --2- 172.21.15.7:0/2229930920 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7f2c0d0aa0 0x7f7f2c0b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.791+0000 7f7f346cb640 1 -- 172.21.15.7:0/2229930920 >> 172.21.15.7:0/2229930920 conn(0x7f7f2c06bfe0 msgr2=0x7f7f2c0d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:07.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.791+0000 7f7f346cb640 1 -- 172.21.15.7:0/2229930920 shutdown_connections 2024-04-25T10:05:07.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:07.791+0000 7f7f346cb640 1 -- 172.21.15.7:0/2229930920 wait complete. 2024-04-25T10:05:07.807 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T10:05:07.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:07.808 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T10:05:07.835 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-04-25T10:05:07.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:07.836 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T10:05:07.892 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T10:05:07.892 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:05:07.911 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19023 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:05:07.912 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:05:07.912 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:05:07.948 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13704 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:05:07.948 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T10:05:07.949 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:05:07.970 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19023 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:05:07.971 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:05:08.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.085+0000 7f2f5046f640 1 Processor -- start 2024-04-25T10:05:08.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.085+0000 7f2f5046f640 1 -- start start 2024-04-25T10:05:08.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.086+0000 7f2f5046f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f4806ee10 0x7f2f4806f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:08.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.086+0000 7f2f5046f640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f480b4f80 con 0x7f2f4806ab60 2024-04-25T10:05:08.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.086+0000 7f2f5046f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f4806fec0 con 0x7f2f480afae0 2024-04-25T10:05:08.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.086+0000 7f2f5046f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f480b5590 con 0x7f2f4806ee10 2024-04-25T10:05:08.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.086+0000 7f2f4e20b640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2f4806ab60 0x7f2f4806af40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37682/0 (socket says 172.21.15.7:37682) 2024-04-25T10:05:08.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.086+0000 7f2f4e20b640 1 -- 172.21.15.7:0/2991796876 learned_addr learned my addr 172.21.15.7:0/2991796876 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:05:08.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.086+0000 7f2f4d209640 1 -- 172.21.15.7:0/2991796876 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3555017987 0 0) 0x7f2f480b4f80 con 0x7f2f4806ab60 2024-04-25T10:05:08.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.086+0000 7f2f4d209640 1 -- 172.21.15.7:0/2991796876 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f34003520 con 0x7f2f4806ab60 2024-04-25T10:05:08.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.086+0000 7f2f4ea0c640 1 --2- 172.21.15.7:0/2991796876 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f4806ee10 0x7f2f4806f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:08.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.086+0000 7f2f4d209640 1 -- 172.21.15.7:0/2991796876 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 269298029 0 0) 0x7f2f34003520 con 0x7f2f4806ab60 2024-04-25T10:05:08.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.086+0000 7f2f4d209640 1 -- 172.21.15.7:0/2991796876 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f4806ee10 msgr2=0x7f2f4806f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:08.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.086+0000 7f2f4d209640 1 --2- 172.21.15.7:0/2991796876 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f4806ee10 0x7f2f4806f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:08.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.086+0000 7f2f4d209640 1 -- 172.21.15.7:0/2991796876 >> v1:172.21.15.55:6789/0 conn(0x7f2f480afae0 legacy=0x7f2f480b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:08.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.086+0000 7f2f4d209640 1 -- 172.21.15.7:0/2991796876 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f480701a0 con 0x7f2f4806ab60 2024-04-25T10:05:08.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.086+0000 7f2f4d209640 1 -- 172.21.15.7:0/2991796876 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f2f44001670 con 0x7f2f4806ab60 2024-04-25T10:05:08.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.086+0000 7f2f4d209640 1 -- 172.21.15.7:0/2991796876 >> v1:172.21.15.7:6789/0 conn(0x7f2f4806ab60 legacy=0x7f2f4806af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:08.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.086+0000 7f2f4d209640 1 --2- 172.21.15.7:0/2991796876 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f4806ee10 0x7f2f340039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:08.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.086+0000 7f2f4d209640 1 --2- 172.21.15.7:0/2991796876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f34004010 0x7f2f34004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:08.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.086+0000 7f2f4d209640 1 --2- 172.21.15.7:0/2991796876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f34004d40 0x7f2f340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:08.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.086+0000 7f2f4d209640 1 -- 172.21.15.7:0/2991796876 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f480b5590 con 0x7f2f34004d40 2024-04-25T10:05:08.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.086+0000 7f2f4d209640 1 -- 172.21.15.7:0/2991796876 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3400bb80 con 0x7f2f34004010 2024-04-25T10:05:08.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.086+0000 7f2f4d209640 1 -- 172.21.15.7:0/2991796876 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3400bd80 con 0x7f2f4806ee10 2024-04-25T10:05:08.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.087+0000 7f2f4ea0c640 1 --2- 172.21.15.7:0/2991796876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f34004d40 0x7f2f340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:08.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.087+0000 7f2f4da0a640 1 --2- 172.21.15.7:0/2991796876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f34004010 0x7f2f34004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:08.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.087+0000 7f2f4e20b640 1 --2- 172.21.15.7:0/2991796876 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f4806ee10 0x7f2f340039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:08.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.087+0000 7f2f4ea0c640 1 -- 172.21.15.7:0/2991796876 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f4806ee10 msgr2=0x7f2f340039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:08.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.087+0000 7f2f4ea0c640 1 --2- 172.21.15.7:0/2991796876 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f4806ee10 0x7f2f340039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:08.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.087+0000 7f2f4ea0c640 1 -- 172.21.15.7:0/2991796876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f34004010 msgr2=0x7f2f34004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:08.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.087+0000 7f2f4ea0c640 1 --2- 172.21.15.7:0/2991796876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f34004010 0x7f2f34004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:08.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.087+0000 7f2f4ea0c640 1 -- 172.21.15.7:0/2991796876 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f34003520 con 0x7f2f34004d40 2024-04-25T10:05:08.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.088+0000 7f2f4ea0c640 1 --2- 172.21.15.7:0/2991796876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f34004d40 0x7f2f340051c0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f2f40007360 tx=0x7f2f34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ad440b1beb04c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:08.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.088+0000 7f2f4d209640 1 -- 172.21.15.7:0/2991796876 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f40009be0 con 0x7f2f34004d40 2024-04-25T10:05:08.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.088+0000 7f2f4d209640 1 -- 172.21.15.7:0/2991796876 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f40036600 con 0x7f2f34004d40 2024-04-25T10:05:08.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.088+0000 7f2f4d209640 1 -- 172.21.15.7:0/2991796876 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f400369d0 con 0x7f2f34004d40 2024-04-25T10:05:08.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.088+0000 7f2f5046f640 1 -- 172.21.15.7:0/2991796876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f34004d40 msgr2=0x7f2f340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:08.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.088+0000 7f2f5046f640 1 --2- 172.21.15.7:0/2991796876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f34004d40 0x7f2f340051c0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f2f40007360 tx=0x7f2f34005830 comp rx=0 tx=0).stop 2024-04-25T10:05:08.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.088+0000 7f2f4ea0c640 1 -- 172.21.15.7:0/2991796876 reap_dead start 2024-04-25T10:05:08.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.088+0000 7f2f5046f640 1 -- 172.21.15.7:0/2991796876 shutdown_connections 2024-04-25T10:05:08.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.088+0000 7f2f5046f640 1 -- 172.21.15.7:0/2991796876 >> 172.21.15.7:0/2991796876 conn(0x7f2f480b59f0 msgr2=0x7f2f480b5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:08.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.088+0000 7f2f5046f640 1 -- 172.21.15.7:0/2991796876 shutdown_connections 2024-04-25T10:05:08.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.088+0000 7f2f5046f640 1 -- 172.21.15.7:0/2991796876 wait complete. 2024-04-25T10:05:08.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.090+0000 7f2f5046f640 1 Processor -- start 2024-04-25T10:05:08.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.090+0000 7f2f5046f640 1 -- start start 2024-04-25T10:05:08.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.090+0000 7f2f5046f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f34004d40 0x7f2f48149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:08.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.090+0000 7f2f5046f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f4814b860 0x7f2f4814bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:08.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.090+0000 7f2f5046f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f480b21c0 0x7f2f480b2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:08.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.090+0000 7f2f5046f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4806f420 con 0x7f2f480b21c0 2024-04-25T10:05:08.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.090+0000 7f2f5046f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4806f2a0 con 0x7f2f34004d40 2024-04-25T10:05:08.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.090+0000 7f2f5046f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4806f5a0 con 0x7f2f4814b860 2024-04-25T10:05:08.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.090+0000 7f2f4ea0c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f480b21c0 0x7f2f480b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:08.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.090+0000 7f2f4ea0c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f480b21c0 0x7f2f480b2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38330/0 (socket says 172.21.15.7:38330) 2024-04-25T10:05:08.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.090+0000 7f2f4ea0c640 1 -- 172.21.15.7:0/986433146 learned_addr learned my addr 172.21.15.7:0/986433146 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:08.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.090+0000 7f2f4e20b640 1 --2- 172.21.15.7:0/986433146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f34004d40 0x7f2f48149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:08.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.090+0000 7f2f4da0a640 1 --2- 172.21.15.7:0/986433146 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f4814b860 0x7f2f4814bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:08.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.091+0000 7f2f4ea0c640 1 -- 172.21.15.7:0/986433146 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f4814b860 msgr2=0x7f2f4814bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:08.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.091+0000 7f2f4ea0c640 1 --2- 172.21.15.7:0/986433146 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f4814b860 0x7f2f4814bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:08.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.091+0000 7f2f4ea0c640 1 -- 172.21.15.7:0/986433146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f34004d40 msgr2=0x7f2f48149190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:08.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.091+0000 7f2f4ea0c640 1 --2- 172.21.15.7:0/986433146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f34004d40 0x7f2f48149190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:08.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.091+0000 7f2f4ea0c640 1 -- 172.21.15.7:0/986433146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4814c320 con 0x7f2f480b21c0 2024-04-25T10:05:08.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.091+0000 7f2f4ea0c640 1 --2- 172.21.15.7:0/986433146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f480b21c0 0x7f2f480b2640 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f2f40007450 tx=0x7f2f40004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:08.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.091+0000 7f2f3effd640 1 -- 172.21.15.7:0/986433146 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f40009be0 con 0x7f2f480b21c0 2024-04-25T10:05:08.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.091+0000 7f2f3effd640 1 -- 172.21.15.7:0/986433146 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f40036400 con 0x7f2f480b21c0 2024-04-25T10:05:08.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.091+0000 7f2f3effd640 1 -- 172.21.15.7:0/986433146 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f40038520 con 0x7f2f480b21c0 2024-04-25T10:05:08.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.091+0000 7f2f5046f640 1 -- 172.21.15.7:0/986433146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f4814c600 con 0x7f2f480b21c0 2024-04-25T10:05:08.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.091+0000 7f2f5046f640 1 -- 172.21.15.7:0/986433146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f48149ce0 con 0x7f2f480b21c0 2024-04-25T10:05:08.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.092+0000 7f2f5046f640 1 -- 172.21.15.7:0/986433146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f48149ee0 con 0x7f2f480b21c0 2024-04-25T10:05:08.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.093+0000 7f2f3effd640 1 -- 172.21.15.7:0/986433146 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2f4002e650 con 0x7f2f480b21c0 2024-04-25T10:05:08.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.093+0000 7f2f3effd640 1 --2- 172.21.15.7:0/986433146 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2f2c06b500 0x7f2f2c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:08.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.093+0000 7f2f3effd640 1 -- 172.21.15.7:0/986433146 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f2f400aa4b0 con 0x7f2f480b21c0 2024-04-25T10:05:08.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.093+0000 7f2f4e20b640 1 --2- 172.21.15.7:0/986433146 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2f2c06b500 0x7f2f2c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:08.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.093+0000 7f2f4e20b640 1 --2- 172.21.15.7:0/986433146 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2f2c06b500 0x7f2f2c06d9c0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f2f44001200 tx=0x7f2f44001190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:08.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.097+0000 7f2f3effd640 1 -- 172.21.15.7:0/986433146 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2f48149ee0 con 0x7f2f480b21c0 2024-04-25T10:05:08.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.318+0000 7f2f5046f640 1 -- 172.21.15.7:0/986433146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f48068fd0 con 0x7f2f480b21c0 2024-04-25T10:05:08.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.318+0000 7f2f3effd640 1 -- 172.21.15.7:0/986433146 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4938 (secure 0 0 0) 0x7f2f40032030 con 0x7f2f480b21c0 2024-04-25T10:05:08.324 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:05:08.324 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":101,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6992,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2679200172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2679200172},{"type":"v1","addr":"172.21.15.7:6837","nonce":2679200172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":7942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/4039147179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":4039147179},{"type":"v1","addr":"172.21.15.55:6833","nonce":4039147179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":7945,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3456170359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3456170359},{"type":"v1","addr":"172.21.15.55:6835","nonce":3456170359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:04:29.599245+0000","modified":"2024-04-25T10:05:01.558283+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9492":{"gid":9492,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/1326211296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1326211296},{"type":"v1","addr":"172.21.15.7:6836","nonce":1326211296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T10:05:08.324 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 101 2024-04-25T10:05:08.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.320+0000 7f2f5046f640 1 -- 172.21.15.7:0/986433146 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2f2c06b500 msgr2=0x7f2f2c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:08.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.320+0000 7f2f5046f640 1 --2- 172.21.15.7:0/986433146 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2f2c06b500 0x7f2f2c06d9c0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f2f44001200 tx=0x7f2f44001190 comp rx=0 tx=0).stop 2024-04-25T10:05:08.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.320+0000 7f2f5046f640 1 -- 172.21.15.7:0/986433146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f480b21c0 msgr2=0x7f2f480b2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:08.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.320+0000 7f2f5046f640 1 --2- 172.21.15.7:0/986433146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f480b21c0 0x7f2f480b2640 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f2f40007450 tx=0x7f2f40004ab0 comp rx=0 tx=0).stop 2024-04-25T10:05:08.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.320+0000 7f2f5046f640 1 -- 172.21.15.7:0/986433146 shutdown_connections 2024-04-25T10:05:08.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.320+0000 7f2f5046f640 1 --2- 172.21.15.7:0/986433146 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2f2c06b500 0x7f2f2c06d9c0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:08.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.320+0000 7f2f5046f640 1 --2- 172.21.15.7:0/986433146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f480b21c0 0x7f2f480b2640 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:08.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.320+0000 7f2f5046f640 1 --2- 172.21.15.7:0/986433146 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f4814b860 0x7f2f4814bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:08.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.320+0000 7f2f5046f640 1 --2- 172.21.15.7:0/986433146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f34004d40 0x7f2f48149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:08.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.320+0000 7f2f5046f640 1 -- 172.21.15.7:0/986433146 >> 172.21.15.7:0/986433146 conn(0x7f2f480b59f0 msgr2=0x7f2f4815fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:08.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.320+0000 7f2f5046f640 1 -- 172.21.15.7:0/986433146 shutdown_connections 2024-04-25T10:05:08.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.320+0000 7f2f5046f640 1 -- 172.21.15.7:0/986433146 wait complete. 2024-04-25T10:05:08.337 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:05:08.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.432+0000 7f2670f30640 1 Processor -- start 2024-04-25T10:05:08.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.432+0000 7f2670f30640 1 -- start start 2024-04-25T10:05:08.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.433+0000 7f2670f30640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f266c06c250 0x7f266c09a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:08.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.433+0000 7f2670f30640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f266c06bce0 0x7f266c06c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:08.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.433+0000 7f2670f30640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f266c06cb70 con 0x7f266c0d0360 2024-04-25T10:05:08.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.433+0000 7f2670f30640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f266c09ae20 con 0x7f266c06bce0 2024-04-25T10:05:08.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.433+0000 7f2670f30640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f266c09a450 con 0x7f266c06c250 2024-04-25T10:05:08.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.433+0000 7f2663fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f266c06bce0 0x7f266c06c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:08.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.433+0000 7f2663fff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f266c06bce0 0x7f266c06c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38346/0 (socket says 172.21.15.7:38346) 2024-04-25T10:05:08.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.433+0000 7f2663fff640 1 -- 172.21.15.7:0/1632500434 learned_addr learned my addr 172.21.15.7:0/1632500434 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:08.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.433+0000 7f266a59c640 1 --2- 172.21.15.7:0/1632500434 >> v2:172.21.15.55:3300/0 conn(0x7f266c06c250 0x7f266c09a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:08.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.433+0000 7f2663fff640 1 -- 172.21.15.7:0/1632500434 >> v2:172.21.15.55:3300/0 conn(0x7f266c06c250 msgr2=0x7f266c09a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:08.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.433+0000 7f2663fff640 1 --2- 172.21.15.7:0/1632500434 >> v2:172.21.15.55:3300/0 conn(0x7f266c06c250 0x7f266c09a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:08.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.433+0000 7f2663fff640 1 -- 172.21.15.7:0/1632500434 >> v1:172.21.15.55:6789/0 conn(0x7f266c0d0360 legacy=0x7f266c0cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:08.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.433+0000 7f2663fff640 1 -- 172.21.15.7:0/1632500434 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266c099b20 con 0x7f266c06bce0 2024-04-25T10:05:08.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.433+0000 7f266a59c640 1 --2- 172.21.15.7:0/1632500434 >> v2:172.21.15.55:3300/0 conn(0x7f266c06c250 0x7f266c09a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:08.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.434+0000 7f2663fff640 1 --2- 172.21.15.7:0/1632500434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f266c06bce0 0x7f266c06c630 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f266c0d27e0 tx=0x7f265402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f77d5252ac2e0e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:08.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.434+0000 7f2669d9b640 1 -- 172.21.15.7:0/1632500434 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2654037070 con 0x7f266c06bce0 2024-04-25T10:05:08.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.434+0000 7f2669d9b640 1 -- 172.21.15.7:0/1632500434 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265402ae20 con 0x7f266c06bce0 2024-04-25T10:05:08.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.434+0000 7f2669d9b640 1 -- 172.21.15.7:0/1632500434 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2654032660 con 0x7f266c06bce0 2024-04-25T10:05:08.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.434+0000 7f2670f30640 1 -- 172.21.15.7:0/1632500434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f266c06bce0 msgr2=0x7f266c06c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:08.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.434+0000 7f2670f30640 1 --2- 172.21.15.7:0/1632500434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f266c06bce0 0x7f266c06c630 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f266c0d27e0 tx=0x7f265402a110 comp rx=0 tx=0).stop 2024-04-25T10:05:08.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.434+0000 7f2670f30640 1 -- 172.21.15.7:0/1632500434 shutdown_connections 2024-04-25T10:05:08.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.434+0000 7f2670f30640 1 --2- 172.21.15.7:0/1632500434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f266c06bce0 0x7f266c06c630 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:08.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.434+0000 7f2670f30640 1 --2- 172.21.15.7:0/1632500434 >> v2:172.21.15.55:3300/0 conn(0x7f266c06c250 0x7f266c09a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:08.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.435+0000 7f2670f30640 1 -- 172.21.15.7:0/1632500434 >> 172.21.15.7:0/1632500434 conn(0x7f266c0d16e0 msgr2=0x7f266c0d1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:08.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.435+0000 7f2670f30640 1 -- 172.21.15.7:0/1632500434 shutdown_connections 2024-04-25T10:05:08.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.435+0000 7f2670f30640 1 -- 172.21.15.7:0/1632500434 wait complete. 2024-04-25T10:05:08.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.436+0000 7f2670f30640 1 Processor -- start 2024-04-25T10:05:08.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.436+0000 7f2670f30640 1 -- start start 2024-04-25T10:05:08.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.437+0000 7f2670f30640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f266c06bce0 0x7f266c15e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:08.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.437+0000 7f2670f30640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f266c06c250 0x7f266c15cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:08.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.437+0000 7f2670f30640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f266c0d0360 0x7f266c1f8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:08.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.437+0000 7f2670f30640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266c09a0e0 con 0x7f266c0d0360 2024-04-25T10:05:08.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.437+0000 7f2670f30640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266c0d0c60 con 0x7f266c06bce0 2024-04-25T10:05:08.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.437+0000 7f2670f30640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266c15f000 con 0x7f266c06c250 2024-04-25T10:05:08.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.437+0000 7f266ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f266c0d0360 0x7f266c1f8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:08.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.437+0000 7f266ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f266c0d0360 0x7f266c1f8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38354/0 (socket says 172.21.15.7:38354) 2024-04-25T10:05:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.437+0000 7f266ad9d640 1 -- 172.21.15.7:0/2468072063 learned_addr learned my addr 172.21.15.7:0/2468072063 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.437+0000 7f266a59c640 1 --2- 172.21.15.7:0/2468072063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f266c06bce0 0x7f266c15e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.437+0000 7f2663fff640 1 --2- 172.21.15.7:0/2468072063 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f266c06c250 0x7f266c15cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.437+0000 7f266ad9d640 1 -- 172.21.15.7:0/2468072063 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f266c06c250 msgr2=0x7f266c15cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.437+0000 7f266ad9d640 1 --2- 172.21.15.7:0/2468072063 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f266c06c250 0x7f266c15cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.437+0000 7f266ad9d640 1 -- 172.21.15.7:0/2468072063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f266c06bce0 msgr2=0x7f266c15e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.437+0000 7f266ad9d640 1 --2- 172.21.15.7:0/2468072063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f266c06bce0 0x7f266c15e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.437+0000 7f266ad9d640 1 -- 172.21.15.7:0/2468072063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266c15d310 con 0x7f266c0d0360 2024-04-25T10:05:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.437+0000 7f2663fff640 1 --2- 172.21.15.7:0/2468072063 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f266c06c250 0x7f266c15cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.437+0000 7f266ad9d640 1 --2- 172.21.15.7:0/2468072063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f266c0d0360 0x7f266c1f8160 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f266400c7b0 tx=0x7f266400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.437+0000 7f2662ffd640 1 -- 172.21.15.7:0/2468072063 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2664004b60 con 0x7f266c0d0360 2024-04-25T10:05:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.437+0000 7f2662ffd640 1 -- 172.21.15.7:0/2468072063 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2664004d00 con 0x7f266c0d0360 2024-04-25T10:05:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.437+0000 7f2670f30640 1 -- 172.21.15.7:0/2468072063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f266c15d5f0 con 0x7f266c0d0360 2024-04-25T10:05:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.437+0000 7f2662ffd640 1 -- 172.21.15.7:0/2468072063 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266400aa90 con 0x7f266c0d0360 2024-04-25T10:05:08.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.437+0000 7f2670f30640 1 -- 172.21.15.7:0/2468072063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f266c15dbb0 con 0x7f266c0d0360 2024-04-25T10:05:08.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.438+0000 7f2670f30640 1 -- 172.21.15.7:0/2468072063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f266c068fd0 con 0x7f266c0d0360 2024-04-25T10:05:08.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.439+0000 7f2662ffd640 1 -- 172.21.15.7:0/2468072063 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f266400ac30 con 0x7f266c0d0360 2024-04-25T10:05:08.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.439+0000 7f2662ffd640 1 --2- 172.21.15.7:0/2468072063 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f264c06b4d0 0x7f264c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:08.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.439+0000 7f2662ffd640 1 -- 172.21.15.7:0/2468072063 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f266408a6d0 con 0x7f266c0d0360 2024-04-25T10:05:08.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.440+0000 7f266a59c640 1 --2- 172.21.15.7:0/2468072063 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f264c06b4d0 0x7f264c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:08.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.440+0000 7f266a59c640 1 --2- 172.21.15.7:0/2468072063 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f264c06b4d0 0x7f264c06d990 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f265c00aac0 tx=0x7f265c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:08.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.444+0000 7f2662ffd640 1 -- 172.21.15.7:0/2468072063 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2664020070 con 0x7f266c0d0360 2024-04-25T10:05:08.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.627+0000 7f2670f30640 1 -- 172.21.15.7:0/2468072063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f266c0d1150 con 0x7f266c0d0360 2024-04-25T10:05:08.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.628+0000 7f2662ffd640 1 -- 172.21.15.7:0/2468072063 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+17111 (secure 0 0 0) 0x7f2664059270 con 0x7f266c0d0360 2024-04-25T10:05:08.634 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:05:08.634 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":119,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:04:57.499369+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:04:27.856713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T10:04:28.566676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6836/3781378145":"2024-04-26T10:04:57.499347+0000","172.21.15.7:6834/3781378145":"2024-04-26T10:04:57.499347+0000","172.21.15.7:6836/3623521645":"2024-04-26T10:04:46.961147+0000","172.21.15.7:6834/3623521645":"2024-04-26T10:04:46.961147+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:05:08.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.630+0000 7f2670f30640 1 -- 172.21.15.7:0/2468072063 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f264c06b4d0 msgr2=0x7f264c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:08.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.630+0000 7f2670f30640 1 --2- 172.21.15.7:0/2468072063 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f264c06b4d0 0x7f264c06d990 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f265c00aac0 tx=0x7f265c008040 comp rx=0 tx=0).stop 2024-04-25T10:05:08.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.630+0000 7f2670f30640 1 -- 172.21.15.7:0/2468072063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f266c0d0360 msgr2=0x7f266c1f8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:08.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.630+0000 7f2670f30640 1 --2- 172.21.15.7:0/2468072063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f266c0d0360 0x7f266c1f8160 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f266400c7b0 tx=0x7f266400cc70 comp rx=0 tx=0).stop 2024-04-25T10:05:08.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.630+0000 7f2670f30640 1 -- 172.21.15.7:0/2468072063 shutdown_connections 2024-04-25T10:05:08.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.630+0000 7f2670f30640 1 --2- 172.21.15.7:0/2468072063 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f264c06b4d0 0x7f264c06d990 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:08.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.630+0000 7f2670f30640 1 --2- 172.21.15.7:0/2468072063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f266c0d0360 0x7f266c1f8160 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:08.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.630+0000 7f2670f30640 1 --2- 172.21.15.7:0/2468072063 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f266c06c250 0x7f266c15cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:08.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.630+0000 7f2670f30640 1 --2- 172.21.15.7:0/2468072063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f266c06bce0 0x7f266c15e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:08.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.630+0000 7f2670f30640 1 -- 172.21.15.7:0/2468072063 >> 172.21.15.7:0/2468072063 conn(0x7f266c0d16e0 msgr2=0x7f266c0b6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:08.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.630+0000 7f2670f30640 1 -- 172.21.15.7:0/2468072063 shutdown_connections 2024-04-25T10:05:08.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.631+0000 7f2670f30640 1 -- 172.21.15.7:0/2468072063 wait complete. 2024-04-25T10:05:08.647 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:54:15.897490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:04:27.856713+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:04:28.566676+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '117', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:05:08.647 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:05:08.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.746+0000 7ff93b67c640 1 Processor -- start 2024-04-25T10:05:08.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.746+0000 7ff93b67c640 1 -- start start 2024-04-25T10:05:08.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.747+0000 7ff93b67c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9340d0780 0x7ff9340d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:08.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.747+0000 7ff93b67c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff9340b9590 0x7ff9340b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:08.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.747+0000 7ff93b67c640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9340d10a0 con 0x7ff9340b9130 2024-04-25T10:05:08.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.747+0000 7ff93b67c640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9340b7ef0 con 0x7ff9340b9590 2024-04-25T10:05:08.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.747+0000 7ff93b67c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9340b81d0 con 0x7ff9340d0780 2024-04-25T10:05:08.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.747+0000 7ff939c19640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff9340b9590 0x7ff9340b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:08.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.747+0000 7ff938c17640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff9340b9130 0x7ff9340d1c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37684/0 (socket says 172.21.15.7:37684) 2024-04-25T10:05:08.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.747+0000 7ff938c17640 1 -- 172.21.15.7:0/3871052539 learned_addr learned my addr 172.21.15.7:0/3871052539 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:05:08.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.747+0000 7ff939418640 1 --2- 172.21.15.7:0/3871052539 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9340d0780 0x7ff9340d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:08.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.747+0000 7ff939c19640 1 -- 172.21.15.7:0/3871052539 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9340d0780 msgr2=0x7ff9340d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:08.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.747+0000 7ff939c19640 1 --2- 172.21.15.7:0/3871052539 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9340d0780 0x7ff9340d0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:08.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.747+0000 7ff939c19640 1 -- 172.21.15.7:0/3871052539 >> v1:172.21.15.7:6789/0 conn(0x7ff9340b9130 legacy=0x7ff9340d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:08.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.747+0000 7ff939c19640 1 -- 172.21.15.7:0/3871052539 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9340b84b0 con 0x7ff9340b9590 2024-04-25T10:05:08.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.747+0000 7ff92bfff640 1 -- 172.21.15.7:0/3871052539 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3212701239 0 0) 0x7ff9340d10a0 con 0x7ff9340b9130 2024-04-25T10:05:08.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.748+0000 7ff939c19640 1 --2- 172.21.15.7:0/3871052539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9340b9590 0x7ff9340b78c0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7ff930009d90 tx=0x7ff93002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be477484914a8dd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:08.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.748+0000 7ff92bfff640 1 -- 172.21.15.7:0/3871052539 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff930007740 con 0x7ff9340b9590 2024-04-25T10:05:08.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.748+0000 7ff92bfff640 1 -- 172.21.15.7:0/3871052539 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9300078e0 con 0x7ff9340b9590 2024-04-25T10:05:08.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.748+0000 7ff92bfff640 1 -- 172.21.15.7:0/3871052539 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff930007cb0 con 0x7ff9340b9590 2024-04-25T10:05:08.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.749+0000 7ff93b67c640 1 -- 172.21.15.7:0/3871052539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9340b9590 msgr2=0x7ff9340b78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:08.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.749+0000 7ff93b67c640 1 --2- 172.21.15.7:0/3871052539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9340b9590 0x7ff9340b78c0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7ff930009d90 tx=0x7ff93002a660 comp rx=0 tx=0).stop 2024-04-25T10:05:08.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.749+0000 7ff93b67c640 1 -- 172.21.15.7:0/3871052539 shutdown_connections 2024-04-25T10:05:08.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.749+0000 7ff93b67c640 1 --2- 172.21.15.7:0/3871052539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9340b9590 0x7ff9340b78c0 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:08.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.749+0000 7ff93b67c640 1 --2- 172.21.15.7:0/3871052539 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9340d0780 0x7ff9340d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:08.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.749+0000 7ff93b67c640 1 -- 172.21.15.7:0/3871052539 >> 172.21.15.7:0/3871052539 conn(0x7ff9340726b0 msgr2=0x7ff934072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:08.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.749+0000 7ff93b67c640 1 -- 172.21.15.7:0/3871052539 shutdown_connections 2024-04-25T10:05:08.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.749+0000 7ff93b67c640 1 -- 172.21.15.7:0/3871052539 wait complete. 2024-04-25T10:05:08.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.750+0000 7ff93b67c640 1 Processor -- start 2024-04-25T10:05:08.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.750+0000 7ff93b67c640 1 -- start start 2024-04-25T10:05:08.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.751+0000 7ff93b67c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9340b9130 0x7ff934153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:08.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.751+0000 7ff93b67c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9340b9590 0x7ff9340c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:08.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.751+0000 7ff93b67c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9340d0780 0x7ff9340c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:08.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.751+0000 7ff93b67c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9341611b0 con 0x7ff9340d0780 2024-04-25T10:05:08.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.751+0000 7ff93b67c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9340b8a70 con 0x7ff9340b9590 2024-04-25T10:05:08.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.751+0000 7ff93b67c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff934161330 con 0x7ff9340b9130 2024-04-25T10:05:08.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.751+0000 7ff939c19640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9340d0780 0x7ff9340c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:08.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.751+0000 7ff939c19640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9340d0780 0x7ff9340c88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38368/0 (socket says 172.21.15.7:38368) 2024-04-25T10:05:08.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.751+0000 7ff939c19640 1 -- 172.21.15.7:0/1354883083 learned_addr learned my addr 172.21.15.7:0/1354883083 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:08.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.751+0000 7ff939418640 1 --2- 172.21.15.7:0/1354883083 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9340b9130 0x7ff934153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:08.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.751+0000 7ff938c17640 1 --2- 172.21.15.7:0/1354883083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9340b9590 0x7ff9340c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:08.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.751+0000 7ff939c19640 1 -- 172.21.15.7:0/1354883083 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9340b9130 msgr2=0x7ff934153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:08.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.751+0000 7ff939c19640 1 --2- 172.21.15.7:0/1354883083 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9340b9130 0x7ff934153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:08.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.751+0000 7ff939c19640 1 -- 172.21.15.7:0/1354883083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9340b9590 msgr2=0x7ff9340c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:08.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.751+0000 7ff939c19640 1 --2- 172.21.15.7:0/1354883083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9340b9590 0x7ff9340c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:08.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.751+0000 7ff939c19640 1 -- 172.21.15.7:0/1354883083 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9340ab000 con 0x7ff9340d0780 2024-04-25T10:05:08.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.751+0000 7ff939c19640 1 --2- 172.21.15.7:0/1354883083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9340d0780 0x7ff9340c88e0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7ff930009eb0 tx=0x7ff930004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:08.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.751+0000 7ff929ffb640 1 -- 172.21.15.7:0/1354883083 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff930040070 con 0x7ff9340d0780 2024-04-25T10:05:08.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.752+0000 7ff929ffb640 1 -- 172.21.15.7:0/1354883083 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff930031bc0 con 0x7ff9340d0780 2024-04-25T10:05:08.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.752+0000 7ff93b67c640 1 -- 172.21.15.7:0/1354883083 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9340cb720 con 0x7ff9340d0780 2024-04-25T10:05:08.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.752+0000 7ff929ffb640 1 -- 172.21.15.7:0/1354883083 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff930045460 con 0x7ff9340d0780 2024-04-25T10:05:08.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.752+0000 7ff93b67c640 1 -- 172.21.15.7:0/1354883083 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9340cbce0 con 0x7ff9340d0780 2024-04-25T10:05:08.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.753+0000 7ff93b67c640 1 -- 172.21.15.7:0/1354883083 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9340685d0 con 0x7ff9340d0780 2024-04-25T10:05:08.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.753+0000 7ff929ffb640 1 -- 172.21.15.7:0/1354883083 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff930039040 con 0x7ff9340d0780 2024-04-25T10:05:08.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.754+0000 7ff929ffb640 1 --2- 172.21.15.7:0/1354883083 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff91806b4d0 0x7ff91806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:08.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.754+0000 7ff929ffb640 1 -- 172.21.15.7:0/1354883083 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x7ff9300abda0 con 0x7ff9340d0780 2024-04-25T10:05:08.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.754+0000 7ff939418640 1 --2- 172.21.15.7:0/1354883083 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff91806b4d0 0x7ff91806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:08.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.754+0000 7ff939418640 1 --2- 172.21.15.7:0/1354883083 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff91806b4d0 0x7ff91806d990 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7ff92c006fd0 tx=0x7ff92c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:08.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.758+0000 7ff929ffb640 1 -- 172.21.15.7:0/1354883083 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff93007a9e0 con 0x7ff9340d0780 2024-04-25T10:05:08.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.937+0000 7ff93b67c640 1 -- 172.21.15.7:0/1354883083 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff934068f60 con 0x7ff9340d0780 2024-04-25T10:05:08.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.938+0000 7ff929ffb640 1 -- 172.21.15.7:0/1354883083 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v119) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff93007a2e0 con 0x7ff9340d0780 2024-04-25T10:05:08.943 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-04-25T10:05:08.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.940+0000 7ff93b67c640 1 -- 172.21.15.7:0/1354883083 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff91806b4d0 msgr2=0x7ff91806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:08.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.940+0000 7ff93b67c640 1 --2- 172.21.15.7:0/1354883083 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff91806b4d0 0x7ff91806d990 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7ff92c006fd0 tx=0x7ff92c008040 comp rx=0 tx=0).stop 2024-04-25T10:05:08.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.940+0000 7ff93b67c640 1 -- 172.21.15.7:0/1354883083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9340d0780 msgr2=0x7ff9340c88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:08.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.940+0000 7ff93b67c640 1 --2- 172.21.15.7:0/1354883083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9340d0780 0x7ff9340c88e0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7ff930009eb0 tx=0x7ff930004a40 comp rx=0 tx=0).stop 2024-04-25T10:05:08.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.940+0000 7ff93b67c640 1 -- 172.21.15.7:0/1354883083 shutdown_connections 2024-04-25T10:05:08.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.940+0000 7ff93b67c640 1 --2- 172.21.15.7:0/1354883083 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff91806b4d0 0x7ff91806d990 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:08.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.940+0000 7ff93b67c640 1 --2- 172.21.15.7:0/1354883083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9340d0780 0x7ff9340c88e0 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:08.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.940+0000 7ff93b67c640 1 --2- 172.21.15.7:0/1354883083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9340b9590 0x7ff9340c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:08.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.940+0000 7ff93b67c640 1 --2- 172.21.15.7:0/1354883083 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9340b9130 0x7ff934153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:08.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.940+0000 7ff93b67c640 1 -- 172.21.15.7:0/1354883083 >> 172.21.15.7:0/1354883083 conn(0x7ff9340726b0 msgr2=0x7ff9340b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:08.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.940+0000 7ff93b67c640 1 -- 172.21.15.7:0/1354883083 shutdown_connections 2024-04-25T10:05:08.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:08.940+0000 7ff93b67c640 1 -- 172.21.15.7:0/1354883083 wait complete. 2024-04-25T10:05:08.956 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:05:09.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.054+0000 7f56cf4db640 1 Processor -- start 2024-04-25T10:05:09.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.055+0000 7f56cf4db640 1 -- start start 2024-04-25T10:05:09.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.055+0000 7f56cf4db640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f56c80cda20 0x7f56c80cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:09.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.055+0000 7f56cf4db640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f56c809a100 0x7f56c815d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:09.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.055+0000 7f56cf4db640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56c80d02f0 con 0x7f56c806bf10 2024-04-25T10:05:09.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.055+0000 7f56cf4db640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56c80cde00 con 0x7f56c80cda20 2024-04-25T10:05:09.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.055+0000 7f56cf4db640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56c80d05d0 con 0x7f56c809a100 2024-04-25T10:05:09.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.056+0000 7f56cda78640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f56c809a100 0x7f56c815d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:09.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.056+0000 7f56cd277640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f56c80cda20 0x7f56c80cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:09.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.056+0000 7f56cca76640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f56c806bf10 0x7f56c80999f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:46040/0 (socket says 172.21.15.7:46040) 2024-04-25T10:05:09.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.056+0000 7f56cca76640 1 -- 172.21.15.7:0/4005505170 learned_addr learned my addr 172.21.15.7:0/4005505170 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:05:09.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.056+0000 7f56bffff640 1 -- 172.21.15.7:0/4005505170 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1613555597 0 0) 0x7f56c80d02f0 con 0x7f56c806bf10 2024-04-25T10:05:09.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.056+0000 7f56bffff640 1 -- 172.21.15.7:0/4005505170 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56b4003520 con 0x7f56c806bf10 2024-04-25T10:05:09.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.056+0000 7f56cda78640 1 -- 172.21.15.7:0/4005505170 >> v2:172.21.15.55:3300/0 conn(0x7f56c80cda20 msgr2=0x7f56c80cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:09.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.056+0000 7f56cda78640 1 --2- 172.21.15.7:0/4005505170 >> v2:172.21.15.55:3300/0 conn(0x7f56c80cda20 0x7f56c80cf9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.056+0000 7f56cda78640 1 -- 172.21.15.7:0/4005505170 >> v1:172.21.15.55:6789/0 conn(0x7f56c806bf10 legacy=0x7f56c80999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:09.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.056+0000 7f56cda78640 1 -- 172.21.15.7:0/4005505170 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c80d08b0 con 0x7f56c809a100 2024-04-25T10:05:09.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.056+0000 7f56cd277640 1 --2- 172.21.15.7:0/4005505170 >> v2:172.21.15.55:3300/0 conn(0x7f56c80cda20 0x7f56c80cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:05:09.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.057+0000 7f56cda78640 1 --2- 172.21.15.7:0/4005505170 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f56c809a100 0x7f56c815d290 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f56c0009d90 tx=0x7f56c002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91f9a8357340613e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:09.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.057+0000 7f56bffff640 1 -- 172.21.15.7:0/4005505170 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c0007740 con 0x7f56c809a100 2024-04-25T10:05:09.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.057+0000 7f56bffff640 1 -- 172.21.15.7:0/4005505170 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c00078e0 con 0x7f56c809a100 2024-04-25T10:05:09.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.057+0000 7f56bffff640 1 -- 172.21.15.7:0/4005505170 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c0007cb0 con 0x7f56c809a100 2024-04-25T10:05:09.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.058+0000 7f56cf4db640 1 -- 172.21.15.7:0/4005505170 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f56c809a100 msgr2=0x7f56c815d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:09.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.058+0000 7f56cf4db640 1 --2- 172.21.15.7:0/4005505170 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f56c809a100 0x7f56c815d290 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f56c0009d90 tx=0x7f56c002a660 comp rx=0 tx=0).stop 2024-04-25T10:05:09.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.058+0000 7f56cf4db640 1 -- 172.21.15.7:0/4005505170 shutdown_connections 2024-04-25T10:05:09.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.058+0000 7f56cf4db640 1 --2- 172.21.15.7:0/4005505170 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f56c809a100 0x7f56c815d290 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.058+0000 7f56cf4db640 1 --2- 172.21.15.7:0/4005505170 >> v2:172.21.15.55:3300/0 conn(0x7f56c80cda20 0x7f56c80cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.058+0000 7f56cf4db640 1 -- 172.21.15.7:0/4005505170 >> 172.21.15.7:0/4005505170 conn(0x7f56c80b3110 msgr2=0x7f56c80b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:09.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.058+0000 7f56cf4db640 1 -- 172.21.15.7:0/4005505170 shutdown_connections 2024-04-25T10:05:09.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.058+0000 7f56cf4db640 1 -- 172.21.15.7:0/4005505170 wait complete. 2024-04-25T10:05:09.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.059+0000 7f56cf4db640 1 Processor -- start 2024-04-25T10:05:09.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.059+0000 7f56cf4db640 1 -- start start 2024-04-25T10:05:09.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.060+0000 7f56cf4db640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56c806bf10 0x7f56c8155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:09.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.060+0000 7f56cf4db640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f56c809a100 0x7f56c81583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:09.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.060+0000 7f56cf4db640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56c80cda20 0x7f56c8158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:09.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.060+0000 7f56cf4db640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c80cff10 con 0x7f56c806bf10 2024-04-25T10:05:09.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.060+0000 7f56cf4db640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c80d0e70 con 0x7f56c80cda20 2024-04-25T10:05:09.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.060+0000 7f56cf4db640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56c80d0090 con 0x7f56c809a100 2024-04-25T10:05:09.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.060+0000 7f56cd277640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56c806bf10 0x7f56c8155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:09.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.060+0000 7f56cd277640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56c806bf10 0x7f56c8155a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38384/0 (socket says 172.21.15.7:38384) 2024-04-25T10:05:09.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.060+0000 7f56cd277640 1 -- 172.21.15.7:0/3144898480 learned_addr learned my addr 172.21.15.7:0/3144898480 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:09.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.060+0000 7f56cca76640 1 --2- 172.21.15.7:0/3144898480 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f56c809a100 0x7f56c81583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:09.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.060+0000 7f56cda78640 1 --2- 172.21.15.7:0/3144898480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56c80cda20 0x7f56c8158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:09.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.060+0000 7f56cd277640 1 -- 172.21.15.7:0/3144898480 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f56c809a100 msgr2=0x7f56c81583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:09.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.060+0000 7f56cd277640 1 --2- 172.21.15.7:0/3144898480 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f56c809a100 0x7f56c81583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.060+0000 7f56cd277640 1 -- 172.21.15.7:0/3144898480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56c80cda20 msgr2=0x7f56c8158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:09.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.060+0000 7f56cd277640 1 --2- 172.21.15.7:0/3144898480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56c80cda20 0x7f56c8158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.060+0000 7f56cd277640 1 -- 172.21.15.7:0/3144898480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c8155fd0 con 0x7f56c806bf10 2024-04-25T10:05:09.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.060+0000 7f56cd277640 1 --2- 172.21.15.7:0/3144898480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56c806bf10 0x7f56c8155a90 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f56c400ec10 tx=0x7f56c400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:09.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.060+0000 7f56bdffb640 1 -- 172.21.15.7:0/3144898480 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c4017070 con 0x7f56c806bf10 2024-04-25T10:05:09.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.061+0000 7f56bdffb640 1 -- 172.21.15.7:0/3144898480 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c400cc30 con 0x7f56c806bf10 2024-04-25T10:05:09.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.061+0000 7f56cf4db640 1 -- 172.21.15.7:0/3144898480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56c8158f60 con 0x7f56c806bf10 2024-04-25T10:05:09.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.061+0000 7f56bdffb640 1 -- 172.21.15.7:0/3144898480 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c4013470 con 0x7f56c806bf10 2024-04-25T10:05:09.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.061+0000 7f56cf4db640 1 -- 172.21.15.7:0/3144898480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c8159520 con 0x7f56c806bf10 2024-04-25T10:05:09.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.062+0000 7f56cf4db640 1 -- 172.21.15.7:0/3144898480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c8159760 con 0x7f56c806bf10 2024-04-25T10:05:09.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.062+0000 7f56bdffb640 1 -- 172.21.15.7:0/3144898480 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f56c401a070 con 0x7f56c806bf10 2024-04-25T10:05:09.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.063+0000 7f56bdffb640 1 --2- 172.21.15.7:0/3144898480 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f56ac06b4d0 0x7f56ac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:09.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.063+0000 7f56bdffb640 1 -- 172.21.15.7:0/3144898480 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f56c408a340 con 0x7f56c806bf10 2024-04-25T10:05:09.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.063+0000 7f56cca76640 1 --2- 172.21.15.7:0/3144898480 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f56ac06b4d0 0x7f56ac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:09.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.063+0000 7f56cca76640 1 --2- 172.21.15.7:0/3144898480 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f56ac06b4d0 0x7f56ac06d990 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f56c81581b0 tx=0x7f56b8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:09.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.067+0000 7f56bdffb640 1 -- 172.21.15.7:0/3144898480 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f56c8159760 con 0x7f56c806bf10 2024-04-25T10:05:09.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.246+0000 7f56cf4db640 1 -- 172.21.15.7:0/3144898480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f56c806ffc0 con 0x7f56c806bf10 2024-04-25T10:05:09.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.246+0000 7f56bdffb640 1 -- 172.21.15.7:0/3144898480 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v119) v1 ==== 104+0+11 (secure 0 0 0) 0x7f56c4059010 con 0x7f56c806bf10 2024-04-25T10:05:09.251 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-04-25T10:05:09.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.248+0000 7f56cf4db640 1 -- 172.21.15.7:0/3144898480 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f56ac06b4d0 msgr2=0x7f56ac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:09.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.248+0000 7f56cf4db640 1 --2- 172.21.15.7:0/3144898480 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f56ac06b4d0 0x7f56ac06d990 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f56c81581b0 tx=0x7f56b8009040 comp rx=0 tx=0).stop 2024-04-25T10:05:09.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.248+0000 7f56cf4db640 1 -- 172.21.15.7:0/3144898480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56c806bf10 msgr2=0x7f56c8155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:09.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.248+0000 7f56cf4db640 1 --2- 172.21.15.7:0/3144898480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56c806bf10 0x7f56c8155a90 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f56c400ec10 tx=0x7f56c400c520 comp rx=0 tx=0).stop 2024-04-25T10:05:09.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.248+0000 7f56cf4db640 1 -- 172.21.15.7:0/3144898480 shutdown_connections 2024-04-25T10:05:09.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.248+0000 7f56cf4db640 1 --2- 172.21.15.7:0/3144898480 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f56ac06b4d0 0x7f56ac06d990 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.248+0000 7f56cf4db640 1 --2- 172.21.15.7:0/3144898480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56c80cda20 0x7f56c8158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.248+0000 7f56cf4db640 1 --2- 172.21.15.7:0/3144898480 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f56c809a100 0x7f56c81583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.248+0000 7f56cf4db640 1 --2- 172.21.15.7:0/3144898480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f56c806bf10 0x7f56c8155a90 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.248+0000 7f56cf4db640 1 -- 172.21.15.7:0/3144898480 >> 172.21.15.7:0/3144898480 conn(0x7f56c80b3110 msgr2=0x7f56c80b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:09.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.248+0000 7f56cf4db640 1 -- 172.21.15.7:0/3144898480 shutdown_connections 2024-04-25T10:05:09.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.248+0000 7f56cf4db640 1 -- 172.21.15.7:0/3144898480 wait complete. 2024-04-25T10:05:09.265 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:05:09.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.363+0000 7fa0f989e640 1 Processor -- start 2024-04-25T10:05:09.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.363+0000 7fa0f989e640 1 -- start start 2024-04-25T10:05:09.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.364+0000 7fa0f989e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa0f40d2c40 0x7fa0f40b9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:09.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.364+0000 7fa0f989e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0f40b68b0 0x7fa0f40b6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:09.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.364+0000 7fa0f989e640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f40b7ef0 con 0x7fa0f40d0780 2024-04-25T10:05:09.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.364+0000 7fa0f989e640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f40b81d0 con 0x7fa0f40d2c40 2024-04-25T10:05:09.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.364+0000 7fa0f989e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f40b84b0 con 0x7fa0f40b68b0 2024-04-25T10:05:09.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.364+0000 7fa0f27fc640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa0f40d2c40 0x7fa0f40b9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:09.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.364+0000 7fa0f27fc640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa0f40d2c40 0x7fa0f40b9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38398/0 (socket says 172.21.15.7:38398) 2024-04-25T10:05:09.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.364+0000 7fa0f2ffd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa0f40d0780 0x7fa0f40d0b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37694/0 (socket says 172.21.15.7:37694) 2024-04-25T10:05:09.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.364+0000 7fa0f27fc640 1 -- 172.21.15.7:0/2233143008 learned_addr learned my addr 172.21.15.7:0/2233143008 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:09.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.364+0000 7fa0f37fe640 1 --2- 172.21.15.7:0/2233143008 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0f40b68b0 0x7fa0f40b6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:09.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.364+0000 7fa0f27fc640 1 -- 172.21.15.7:0/2233143008 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0f40b68b0 msgr2=0x7fa0f40b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:09.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.364+0000 7fa0f27fc640 1 --2- 172.21.15.7:0/2233143008 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0f40b68b0 0x7fa0f40b6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.364+0000 7fa0f1ffb640 1 -- 172.21.15.7:0/2233143008 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1680090810 0 0) 0x7fa0f40b7ef0 con 0x7fa0f40d0780 2024-04-25T10:05:09.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.364+0000 7fa0f27fc640 1 -- 172.21.15.7:0/2233143008 >> v1:172.21.15.7:6789/0 conn(0x7fa0f40d0780 legacy=0x7fa0f40d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:09.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.364+0000 7fa0f27fc640 1 -- 172.21.15.7:0/2233143008 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f40b8790 con 0x7fa0f40d2c40 2024-04-25T10:05:09.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.364+0000 7fa0f37fe640 1 --2- 172.21.15.7:0/2233143008 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0f40b68b0 0x7fa0f40b6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:09.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.365+0000 7fa0f27fc640 1 --2- 172.21.15.7:0/2233143008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0f40d2c40 0x7fa0f40b9130 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8009870 tx=0x7fa0e802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4c35dacd971165 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:09.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.365+0000 7fa0f1ffb640 1 -- 172.21.15.7:0/2233143008 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8037070 con 0x7fa0f40d2c40 2024-04-25T10:05:09.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.365+0000 7fa0f1ffb640 1 -- 172.21.15.7:0/2233143008 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e8032440 con 0x7fa0f40d2c40 2024-04-25T10:05:09.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.365+0000 7fa0f1ffb640 1 -- 172.21.15.7:0/2233143008 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8032810 con 0x7fa0f40d2c40 2024-04-25T10:05:09.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.366+0000 7fa0f989e640 1 -- 172.21.15.7:0/2233143008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0f40d2c40 msgr2=0x7fa0f40b9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:09.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.366+0000 7fa0f989e640 1 --2- 172.21.15.7:0/2233143008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0f40d2c40 0x7fa0f40b9130 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8009870 tx=0x7fa0e802a270 comp rx=0 tx=0).stop 2024-04-25T10:05:09.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.366+0000 7fa0f989e640 1 -- 172.21.15.7:0/2233143008 shutdown_connections 2024-04-25T10:05:09.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.366+0000 7fa0f989e640 1 --2- 172.21.15.7:0/2233143008 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0f40b68b0 0x7fa0f40b6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.366+0000 7fa0f989e640 1 --2- 172.21.15.7:0/2233143008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0f40d2c40 0x7fa0f40b9130 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.366+0000 7fa0f989e640 1 -- 172.21.15.7:0/2233143008 >> 172.21.15.7:0/2233143008 conn(0x7fa0f40726b0 msgr2=0x7fa0f4072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:09.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.366+0000 7fa0f989e640 1 -- 172.21.15.7:0/2233143008 shutdown_connections 2024-04-25T10:05:09.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.366+0000 7fa0f989e640 1 -- 172.21.15.7:0/2233143008 wait complete. 2024-04-25T10:05:09.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.367+0000 7fa0f989e640 1 Processor -- start 2024-04-25T10:05:09.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.367+0000 7fa0f989e640 1 -- start start 2024-04-25T10:05:09.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.368+0000 7fa0f989e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0f40b68b0 0x7fa0f40c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:09.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.368+0000 7fa0f989e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0f40d0780 0x7fa0f40aad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:09.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.368+0000 7fa0f989e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0f40d2c40 0x7fa0f41538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:09.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.368+0000 7fa0f989e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f40b97f0 con 0x7fa0f40d0780 2024-04-25T10:05:09.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.368+0000 7fa0f989e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f40b9670 con 0x7fa0f40b68b0 2024-04-25T10:05:09.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.368+0000 7fa0f989e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f41611b0 con 0x7fa0f40d2c40 2024-04-25T10:05:09.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.368+0000 7fa0f27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0f40d0780 0x7fa0f40aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:09.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.368+0000 7fa0f27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0f40d0780 0x7fa0f40aad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38414/0 (socket says 172.21.15.7:38414) 2024-04-25T10:05:09.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.368+0000 7fa0f27fc640 1 -- 172.21.15.7:0/1146313321 learned_addr learned my addr 172.21.15.7:0/1146313321 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:09.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.368+0000 7fa0f37fe640 1 --2- 172.21.15.7:0/1146313321 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0f40d2c40 0x7fa0f41538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:09.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.368+0000 7fa0f2ffd640 1 --2- 172.21.15.7:0/1146313321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0f40b68b0 0x7fa0f40c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:09.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.368+0000 7fa0f27fc640 1 -- 172.21.15.7:0/1146313321 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0f40d2c40 msgr2=0x7fa0f41538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:09.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.368+0000 7fa0f27fc640 1 --2- 172.21.15.7:0/1146313321 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0f40d2c40 0x7fa0f41538b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.368+0000 7fa0f27fc640 1 -- 172.21.15.7:0/1146313321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0f40b68b0 msgr2=0x7fa0f40c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:09.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.368+0000 7fa0f27fc640 1 --2- 172.21.15.7:0/1146313321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0f40b68b0 0x7fa0f40c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.368+0000 7fa0f27fc640 1 -- 172.21.15.7:0/1146313321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f40c9700 con 0x7fa0f40d0780 2024-04-25T10:05:09.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.368+0000 7fa0f2ffd640 1 --2- 172.21.15.7:0/1146313321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0f40b68b0 0x7fa0f40c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:09.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.368+0000 7fa0f27fc640 1 --2- 172.21.15.7:0/1146313321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0f40d0780 0x7fa0f40aad00 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8000c00 tx=0x7fa0e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:09.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.368+0000 7fa0dbfff640 1 -- 172.21.15.7:0/1146313321 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8041020 con 0x7fa0f40d0780 2024-04-25T10:05:09.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.369+0000 7fa0dbfff640 1 -- 172.21.15.7:0/1146313321 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e80306c0 con 0x7fa0f40d0780 2024-04-25T10:05:09.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.369+0000 7fa0f989e640 1 -- 172.21.15.7:0/1146313321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f40c99e0 con 0x7fa0f40d0780 2024-04-25T10:05:09.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.369+0000 7fa0dbfff640 1 -- 172.21.15.7:0/1146313321 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8037040 con 0x7fa0f40d0780 2024-04-25T10:05:09.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.369+0000 7fa0f989e640 1 -- 172.21.15.7:0/1146313321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f40c9fa0 con 0x7fa0f40d0780 2024-04-25T10:05:09.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.370+0000 7fa0f989e640 1 -- 172.21.15.7:0/1146313321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f40685d0 con 0x7fa0f40d0780 2024-04-25T10:05:09.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.370+0000 7fa0dbfff640 1 -- 172.21.15.7:0/1146313321 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa0e8044020 con 0x7fa0f40d0780 2024-04-25T10:05:09.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.370+0000 7fa0dbfff640 1 --2- 172.21.15.7:0/1146313321 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa0e006b4d0 0x7fa0e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:09.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.371+0000 7fa0dbfff640 1 -- 172.21.15.7:0/1146313321 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fa0e80aab50 con 0x7fa0f40d0780 2024-04-25T10:05:09.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.371+0000 7fa0f2ffd640 1 --2- 172.21.15.7:0/1146313321 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa0e006b4d0 0x7fa0e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:09.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.371+0000 7fa0f2ffd640 1 --2- 172.21.15.7:0/1146313321 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa0e006b4d0 0x7fa0e006d990 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4000f60 tx=0x7fa0e4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:09.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.375+0000 7fa0dbfff640 1 -- 172.21.15.7:0/1146313321 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa0e804b030 con 0x7fa0f40d0780 2024-04-25T10:05:09.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.554+0000 7fa0f989e640 1 -- 172.21.15.7:0/1146313321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa0f4068f60 con 0x7fa0f40d0780 2024-04-25T10:05:09.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.555+0000 7fa0dbfff640 1 -- 172.21.15.7:0/1146313321 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v119) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa0e8079820 con 0x7fa0f40d0780 2024-04-25T10:05:09.561 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-04-25T10:05:09.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.557+0000 7fa0f989e640 1 -- 172.21.15.7:0/1146313321 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa0e006b4d0 msgr2=0x7fa0e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:09.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.557+0000 7fa0f989e640 1 --2- 172.21.15.7:0/1146313321 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa0e006b4d0 0x7fa0e006d990 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4000f60 tx=0x7fa0e4009040 comp rx=0 tx=0).stop 2024-04-25T10:05:09.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.557+0000 7fa0f989e640 1 -- 172.21.15.7:0/1146313321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0f40d0780 msgr2=0x7fa0f40aad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:09.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.557+0000 7fa0f989e640 1 --2- 172.21.15.7:0/1146313321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0f40d0780 0x7fa0f40aad00 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8000c00 tx=0x7fa0e80046c0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.557+0000 7fa0f989e640 1 -- 172.21.15.7:0/1146313321 shutdown_connections 2024-04-25T10:05:09.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.557+0000 7fa0f989e640 1 --2- 172.21.15.7:0/1146313321 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fa0e006b4d0 0x7fa0e006d990 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.557+0000 7fa0f989e640 1 --2- 172.21.15.7:0/1146313321 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa0f40d2c40 0x7fa0f41538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.557+0000 7fa0f989e640 1 --2- 172.21.15.7:0/1146313321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa0f40d0780 0x7fa0f40aad00 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.557+0000 7fa0f989e640 1 --2- 172.21.15.7:0/1146313321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0f40b68b0 0x7fa0f40c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.557+0000 7fa0f989e640 1 -- 172.21.15.7:0/1146313321 >> 172.21.15.7:0/1146313321 conn(0x7fa0f40726b0 msgr2=0x7fa0f40737a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:09.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.557+0000 7fa0f989e640 1 -- 172.21.15.7:0/1146313321 shutdown_connections 2024-04-25T10:05:09.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.557+0000 7fa0f989e640 1 -- 172.21.15.7:0/1146313321 wait complete. 2024-04-25T10:05:09.573 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:05:09.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.670+0000 7f4eadb4c640 1 Processor -- start 2024-04-25T10:05:09.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.670+0000 7f4eadb4c640 1 -- start start 2024-04-25T10:05:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.671+0000 7f4eadb4c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4ea815db00 0x7f4ea80d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.671+0000 7f4eadb4c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4ea80b53b0 0x7f4ea80d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:09.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.671+0000 7f4eadb4c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ea80d1e80 con 0x7f4ea80ce2b0 2024-04-25T10:05:09.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.671+0000 7f4eadb4c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea80b5930 con 0x7f4ea80b53b0 2024-04-25T10:05:09.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.671+0000 7f4eadb4c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea80b5c10 con 0x7f4ea815db00 2024-04-25T10:05:09.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.671+0000 7f4ea77fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4ea815db00 0x7f4ea80d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:09.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.671+0000 7f4ea6ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4ea80b53b0 0x7f4ea80d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:09.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.671+0000 7f4ea7fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4ea80ce2b0 0x7f4ea8161670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:46056/0 (socket says 172.21.15.7:46056) 2024-04-25T10:05:09.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.671+0000 7f4ea7fff640 1 -- 172.21.15.7:0/4121688002 learned_addr learned my addr 172.21.15.7:0/4121688002 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:05:09.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.672+0000 7f4ea77fe640 1 -- 172.21.15.7:0/4121688002 >> v2:172.21.15.55:3300/0 conn(0x7f4ea80b53b0 msgr2=0x7f4ea80d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:09.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.672+0000 7f4ea77fe640 1 --2- 172.21.15.7:0/4121688002 >> v2:172.21.15.55:3300/0 conn(0x7f4ea80b53b0 0x7f4ea80d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.672+0000 7f4ea67fc640 1 -- 172.21.15.7:0/4121688002 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4152270461 0 0) 0x7f4ea80d1e80 con 0x7f4ea80ce2b0 2024-04-25T10:05:09.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.672+0000 7f4ea77fe640 1 -- 172.21.15.7:0/4121688002 >> v1:172.21.15.55:6789/0 conn(0x7f4ea80ce2b0 legacy=0x7f4ea8161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:09.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.672+0000 7f4ea77fe640 1 -- 172.21.15.7:0/4121688002 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea80b5ef0 con 0x7f4ea815db00 2024-04-25T10:05:09.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.672+0000 7f4ea77fe640 1 --2- 172.21.15.7:0/4121688002 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4ea815db00 0x7f4ea80d0340 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4e980097a0 tx=0x7f4e9802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e9d0ad195efac4b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:09.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.673+0000 7f4ea67fc640 1 -- 172.21.15.7:0/4121688002 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e98037070 con 0x7f4ea815db00 2024-04-25T10:05:09.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.673+0000 7f4ea67fc640 1 -- 172.21.15.7:0/4121688002 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e98032440 con 0x7f4ea815db00 2024-04-25T10:05:09.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.673+0000 7f4ea67fc640 1 -- 172.21.15.7:0/4121688002 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e98032810 con 0x7f4ea815db00 2024-04-25T10:05:09.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.673+0000 7f4eadb4c640 1 -- 172.21.15.7:0/4121688002 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4ea815db00 msgr2=0x7f4ea80d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:09.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.673+0000 7f4eadb4c640 1 --2- 172.21.15.7:0/4121688002 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4ea815db00 0x7f4ea80d0340 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4e980097a0 tx=0x7f4e9802a180 comp rx=0 tx=0).stop 2024-04-25T10:05:09.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.673+0000 7f4eadb4c640 1 -- 172.21.15.7:0/4121688002 shutdown_connections 2024-04-25T10:05:09.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.673+0000 7f4eadb4c640 1 --2- 172.21.15.7:0/4121688002 >> v2:172.21.15.55:3300/0 conn(0x7f4ea80b53b0 0x7f4ea80d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.673+0000 7f4eadb4c640 1 --2- 172.21.15.7:0/4121688002 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4ea815db00 0x7f4ea80d0340 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.673+0000 7f4eadb4c640 1 -- 172.21.15.7:0/4121688002 >> 172.21.15.7:0/4121688002 conn(0x7f4ea8072290 msgr2=0x7f4ea80726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:09.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.673+0000 7f4eadb4c640 1 -- 172.21.15.7:0/4121688002 shutdown_connections 2024-04-25T10:05:09.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.673+0000 7f4eadb4c640 1 -- 172.21.15.7:0/4121688002 wait complete. 2024-04-25T10:05:09.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.674+0000 7f4eadb4c640 1 Processor -- start 2024-04-25T10:05:09.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.674+0000 7f4eadb4c640 1 -- start start 2024-04-25T10:05:09.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.675+0000 7f4eadb4c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ea80b53b0 0x7f4ea814ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:09.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.675+0000 7f4eadb4c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4ea80ce2b0 0x7f4ea80c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:09.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.675+0000 7f4eadb4c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ea815db00 0x7f4ea81f3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:09.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.675+0000 7f4eadb4c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea80d3660 con 0x7f4ea815db00 2024-04-25T10:05:09.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.675+0000 7f4eadb4c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea80b61d0 con 0x7f4ea80b53b0 2024-04-25T10:05:09.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.675+0000 7f4eadb4c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea80b6c10 con 0x7f4ea80ce2b0 2024-04-25T10:05:09.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.675+0000 7f4ea7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ea815db00 0x7f4ea81f3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:09.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.675+0000 7f4ea7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ea815db00 0x7f4ea81f3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38416/0 (socket says 172.21.15.7:38416) 2024-04-25T10:05:09.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.675+0000 7f4ea7fff640 1 -- 172.21.15.7:0/3637343772 learned_addr learned my addr 172.21.15.7:0/3637343772 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:09.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.675+0000 7f4ea77fe640 1 --2- 172.21.15.7:0/3637343772 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ea80b53b0 0x7f4ea814ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:09.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.675+0000 7f4ea6ffd640 1 --2- 172.21.15.7:0/3637343772 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4ea80ce2b0 0x7f4ea80c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:09.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.676+0000 7f4ea7fff640 1 -- 172.21.15.7:0/3637343772 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4ea80ce2b0 msgr2=0x7f4ea80c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:09.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.676+0000 7f4ea7fff640 1 --2- 172.21.15.7:0/3637343772 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4ea80ce2b0 0x7f4ea80c8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.676+0000 7f4ea7fff640 1 -- 172.21.15.7:0/3637343772 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ea80b53b0 msgr2=0x7f4ea814ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:09.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.676+0000 7f4ea7fff640 1 --2- 172.21.15.7:0/3637343772 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ea80b53b0 0x7f4ea814ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.676+0000 7f4ea7fff640 1 -- 172.21.15.7:0/3637343772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea814e670 con 0x7f4ea815db00 2024-04-25T10:05:09.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.676+0000 7f4ea7fff640 1 --2- 172.21.15.7:0/3637343772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ea815db00 0x7f4ea81f3000 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000c7a0 tx=0x7f4ea000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:09.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.676+0000 7f4e8ffff640 1 -- 172.21.15.7:0/3637343772 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea0018070 con 0x7f4ea815db00 2024-04-25T10:05:09.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.676+0000 7f4eadb4c640 1 -- 172.21.15.7:0/3637343772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea814f760 con 0x7f4ea815db00 2024-04-25T10:05:09.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.676+0000 7f4e8ffff640 1 -- 172.21.15.7:0/3637343772 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea000a640 con 0x7f4ea815db00 2024-04-25T10:05:09.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.676+0000 7f4e8ffff640 1 -- 172.21.15.7:0/3637343772 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea000aab0 con 0x7f4ea815db00 2024-04-25T10:05:09.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.676+0000 7f4eadb4c640 1 -- 172.21.15.7:0/3637343772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea80cbe70 con 0x7f4ea815db00 2024-04-25T10:05:09.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.677+0000 7f4eadb4c640 1 -- 172.21.15.7:0/3637343772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ea8068fd0 con 0x7f4ea815db00 2024-04-25T10:05:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.678+0000 7f4e8ffff640 1 -- 172.21.15.7:0/3637343772 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4ea000ac50 con 0x7f4ea815db00 2024-04-25T10:05:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.678+0000 7f4e8ffff640 1 --2- 172.21.15.7:0/3637343772 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4e9406b4d0 0x7f4e9406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.678+0000 7f4e8ffff640 1 -- 172.21.15.7:0/3637343772 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f4ea0089a00 con 0x7f4ea815db00 2024-04-25T10:05:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.678+0000 7f4ea77fe640 1 --2- 172.21.15.7:0/3637343772 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4e9406b4d0 0x7f4e9406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.679+0000 7f4ea77fe640 1 --2- 172.21.15.7:0/3637343772 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4e9406b4d0 0x7f4e9406d990 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f4e98034000 tx=0x7f4e9802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:09.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.682+0000 7f4e8ffff640 1 -- 172.21.15.7:0/3637343772 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4ea0058000 con 0x7f4ea815db00 2024-04-25T10:05:09.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.903+0000 7f4eadb4c640 1 -- 172.21.15.7:0/3637343772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ea80d16b0 con 0x7f4ea815db00 2024-04-25T10:05:09.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.903+0000 7f4e8ffff640 1 -- 172.21.15.7:0/3637343772 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4938 (secure 0 0 0) 0x7f4ea005c0a0 con 0x7f4ea815db00 2024-04-25T10:05:09.909 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:05:09.910 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":101,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6992,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2679200172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2679200172},{"type":"v1","addr":"172.21.15.7:6837","nonce":2679200172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":7942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/4039147179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":4039147179},{"type":"v1","addr":"172.21.15.55:6833","nonce":4039147179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":7945,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3456170359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3456170359},{"type":"v1","addr":"172.21.15.55:6835","nonce":3456170359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:04:29.599245+0000","modified":"2024-04-25T10:05:01.558283+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9492":{"gid":9492,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/1326211296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1326211296},{"type":"v1","addr":"172.21.15.7:6836","nonce":1326211296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T10:05:09.910 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 101 2024-04-25T10:05:09.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.905+0000 7f4eadb4c640 1 -- 172.21.15.7:0/3637343772 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4e9406b4d0 msgr2=0x7f4e9406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:09.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.905+0000 7f4eadb4c640 1 --2- 172.21.15.7:0/3637343772 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4e9406b4d0 0x7f4e9406d990 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f4e98034000 tx=0x7f4e9802e000 comp rx=0 tx=0).stop 2024-04-25T10:05:09.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.905+0000 7f4eadb4c640 1 -- 172.21.15.7:0/3637343772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ea815db00 msgr2=0x7f4ea81f3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:09.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.905+0000 7f4eadb4c640 1 --2- 172.21.15.7:0/3637343772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ea815db00 0x7f4ea81f3000 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000c7a0 tx=0x7f4ea000cc60 comp rx=0 tx=0).stop 2024-04-25T10:05:09.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.906+0000 7f4eadb4c640 1 -- 172.21.15.7:0/3637343772 shutdown_connections 2024-04-25T10:05:09.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.906+0000 7f4eadb4c640 1 --2- 172.21.15.7:0/3637343772 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f4e9406b4d0 0x7f4e9406d990 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.906+0000 7f4eadb4c640 1 --2- 172.21.15.7:0/3637343772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ea815db00 0x7f4ea81f3000 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.906+0000 7f4eadb4c640 1 --2- 172.21.15.7:0/3637343772 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4ea80ce2b0 0x7f4ea80c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.906+0000 7f4eadb4c640 1 --2- 172.21.15.7:0/3637343772 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ea80b53b0 0x7f4ea814ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.906+0000 7f4eadb4c640 1 -- 172.21.15.7:0/3637343772 >> 172.21.15.7:0/3637343772 conn(0x7f4ea8072290 msgr2=0x7f4ea80cf350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:09.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.906+0000 7f4eadb4c640 1 -- 172.21.15.7:0/3637343772 shutdown_connections 2024-04-25T10:05:09.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:09.906+0000 7f4eadb4c640 1 -- 172.21.15.7:0/3637343772 wait complete. 2024-04-25T10:05:09.922 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:05:10.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.018+0000 7ff9a749e640 1 Processor -- start 2024-04-25T10:05:10.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.018+0000 7ff9a749e640 1 -- start start 2024-04-25T10:05:10.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.019+0000 7ff9a749e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff9a015dd00 0x7ff9a00b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:10.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.019+0000 7ff9a749e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff9a006c6c0 0x7ff9a00b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:10.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.019+0000 7ff9a749e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a006cd00 con 0x7ff9a00b6a40 2024-04-25T10:05:10.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.019+0000 7ff9a749e640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a015e0e0 con 0x7ff9a006c6c0 2024-04-25T10:05:10.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.019+0000 7ff9a749e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a006cfe0 con 0x7ff9a015dd00 2024-04-25T10:05:10.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.019+0000 7ff9a5a3b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff9a006c6c0 0x7ff9a00b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:10.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.019+0000 7ff9a5a3b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff9a006c6c0 0x7ff9a00b5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44946/0 (socket says 172.21.15.7:44946) 2024-04-25T10:05:10.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.019+0000 7ff9a5a3b640 1 -- 172.21.15.7:0/1500331297 learned_addr learned my addr 172.21.15.7:0/1500331297 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:10.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.019+0000 7ff9a523a640 1 --2- 172.21.15.7:0/1500331297 >> v2:172.21.15.55:3300/0 conn(0x7ff9a015dd00 0x7ff9a00b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:10.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.019+0000 7ff9a5a3b640 1 -- 172.21.15.7:0/1500331297 >> v2:172.21.15.55:3300/0 conn(0x7ff9a015dd00 msgr2=0x7ff9a00b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:10.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.019+0000 7ff9a5a3b640 1 --2- 172.21.15.7:0/1500331297 >> v2:172.21.15.55:3300/0 conn(0x7ff9a015dd00 0x7ff9a00b5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.019+0000 7ff9a5a3b640 1 -- 172.21.15.7:0/1500331297 >> v1:172.21.15.55:6789/0 conn(0x7ff9a00b6a40 legacy=0x7ff9a006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:10.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.019+0000 7ff9a5a3b640 1 -- 172.21.15.7:0/1500331297 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a00d1ca0 con 0x7ff9a006c6c0 2024-04-25T10:05:10.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.020+0000 7ff9a5a3b640 1 --2- 172.21.15.7:0/1500331297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9a006c6c0 0x7ff9a00b5c90 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00d4920 tx=0x7ff99802a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb28a4cee6185e01 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:10.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.020+0000 7ff997fff640 1 -- 172.21.15.7:0/1500331297 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff998036070 con 0x7ff9a006c6c0 2024-04-25T10:05:10.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.020+0000 7ff997fff640 1 -- 172.21.15.7:0/1500331297 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff998031600 con 0x7ff9a006c6c0 2024-04-25T10:05:10.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.020+0000 7ff997fff640 1 -- 172.21.15.7:0/1500331297 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9980319d0 con 0x7ff9a006c6c0 2024-04-25T10:05:10.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.020+0000 7ff9a749e640 1 -- 172.21.15.7:0/1500331297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9a006c6c0 msgr2=0x7ff9a00b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:10.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.020+0000 7ff9a749e640 1 --2- 172.21.15.7:0/1500331297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9a006c6c0 0x7ff9a00b5c90 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00d4920 tx=0x7ff99802a780 comp rx=0 tx=0).stop 2024-04-25T10:05:10.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.020+0000 7ff9a749e640 1 -- 172.21.15.7:0/1500331297 shutdown_connections 2024-04-25T10:05:10.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.020+0000 7ff9a749e640 1 --2- 172.21.15.7:0/1500331297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9a006c6c0 0x7ff9a00b5c90 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.020+0000 7ff9a749e640 1 --2- 172.21.15.7:0/1500331297 >> v2:172.21.15.55:3300/0 conn(0x7ff9a015dd00 0x7ff9a00b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.020+0000 7ff9a749e640 1 -- 172.21.15.7:0/1500331297 >> 172.21.15.7:0/1500331297 conn(0x7ff9a00d07b0 msgr2=0x7ff9a00d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:10.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.021+0000 7ff9a749e640 1 -- 172.21.15.7:0/1500331297 shutdown_connections 2024-04-25T10:05:10.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.021+0000 7ff9a749e640 1 -- 172.21.15.7:0/1500331297 wait complete. 2024-04-25T10:05:10.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.022+0000 7ff9a749e640 1 Processor -- start 2024-04-25T10:05:10.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.022+0000 7ff9a749e640 1 -- start start 2024-04-25T10:05:10.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.022+0000 7ff9a749e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9a006c6c0 0x7ff9a0153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:10.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.022+0000 7ff9a749e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9a00b6a40 0x7ff9a00ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:10.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.022+0000 7ff9a749e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9a015dd00 0x7ff9a00cd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:10.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.022+0000 7ff9a749e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a00d2780 con 0x7ff9a00b6a40 2024-04-25T10:05:10.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.022+0000 7ff9a749e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a00d2260 con 0x7ff9a015dd00 2024-04-25T10:05:10.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.022+0000 7ff9a749e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a00d2900 con 0x7ff9a006c6c0 2024-04-25T10:05:10.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.023+0000 7ff9a4a39640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9a00b6a40 0x7ff9a00ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:10.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.023+0000 7ff9a4a39640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9a00b6a40 0x7ff9a00ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44952/0 (socket says 172.21.15.7:44952) 2024-04-25T10:05:10.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.023+0000 7ff9a4a39640 1 -- 172.21.15.7:0/3248979278 learned_addr learned my addr 172.21.15.7:0/3248979278 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:10.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.023+0000 7ff9a523a640 1 --2- 172.21.15.7:0/3248979278 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9a006c6c0 0x7ff9a0153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:10.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.023+0000 7ff9a5a3b640 1 --2- 172.21.15.7:0/3248979278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9a015dd00 0x7ff9a00cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:10.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.023+0000 7ff9a4a39640 1 -- 172.21.15.7:0/3248979278 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9a006c6c0 msgr2=0x7ff9a0153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:10.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.023+0000 7ff9a4a39640 1 --2- 172.21.15.7:0/3248979278 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9a006c6c0 0x7ff9a0153a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.023+0000 7ff9a4a39640 1 -- 172.21.15.7:0/3248979278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9a015dd00 msgr2=0x7ff9a00cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:10.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.023+0000 7ff9a4a39640 1 --2- 172.21.15.7:0/3248979278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9a015dd00 0x7ff9a00cd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.023+0000 7ff9a4a39640 1 -- 172.21.15.7:0/3248979278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a01f7be0 con 0x7ff9a00b6a40 2024-04-25T10:05:10.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.023+0000 7ff9a5a3b640 1 --2- 172.21.15.7:0/3248979278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9a015dd00 0x7ff9a00cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:10.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.023+0000 7ff9a4a39640 1 --2- 172.21.15.7:0/3248979278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9a00b6a40 0x7ff9a00ccd10 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7ff99000c460 tx=0x7ff99000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:10.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.023+0000 7ff995ffb640 1 -- 172.21.15.7:0/3248979278 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff990016020 con 0x7ff9a00b6a40 2024-04-25T10:05:10.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.023+0000 7ff995ffb640 1 -- 172.21.15.7:0/3248979278 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff990012870 con 0x7ff9a00b6a40 2024-04-25T10:05:10.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.023+0000 7ff9a749e640 1 -- 172.21.15.7:0/3248979278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a01f3840 con 0x7ff9a00b6a40 2024-04-25T10:05:10.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.023+0000 7ff995ffb640 1 -- 172.21.15.7:0/3248979278 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff990012c60 con 0x7ff9a00b6a40 2024-04-25T10:05:10.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.023+0000 7ff9a749e640 1 -- 172.21.15.7:0/3248979278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a01f3e00 con 0x7ff9a00b6a40 2024-04-25T10:05:10.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.024+0000 7ff9a749e640 1 -- 172.21.15.7:0/3248979278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a0068fd0 con 0x7ff9a00b6a40 2024-04-25T10:05:10.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.025+0000 7ff995ffb640 1 -- 172.21.15.7:0/3248979278 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff990019020 con 0x7ff9a00b6a40 2024-04-25T10:05:10.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.025+0000 7ff995ffb640 1 --2- 172.21.15.7:0/3248979278 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff98406b4d0 0x7ff98406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:10.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.025+0000 7ff995ffb640 1 -- 172.21.15.7:0/3248979278 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x7ff99008a200 con 0x7ff9a00b6a40 2024-04-25T10:05:10.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.025+0000 7ff9a523a640 1 --2- 172.21.15.7:0/3248979278 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff98406b4d0 0x7ff98406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:10.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.026+0000 7ff9a523a640 1 --2- 172.21.15.7:0/3248979278 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff98406b4d0 0x7ff98406d990 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0160a00 tx=0x7ff99c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:10.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.029+0000 7ff995ffb640 1 -- 172.21.15.7:0/3248979278 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff990020030 con 0x7ff9a00b6a40 2024-04-25T10:05:10.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.210+0000 7ff9a749e640 1 -- 172.21.15.7:0/3248979278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9a00d1620 con 0x7ff9a00b6a40 2024-04-25T10:05:10.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.211+0000 7ff995ffb640 1 -- 172.21.15.7:0/3248979278 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+17111 (secure 0 0 0) 0x7ff990058da0 con 0x7ff9a00b6a40 2024-04-25T10:05:10.217 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:05:10.217 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":119,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:04:57.499369+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:04:27.856713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T10:04:28.566676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6836/3781378145":"2024-04-26T10:04:57.499347+0000","172.21.15.7:6834/3781378145":"2024-04-26T10:04:57.499347+0000","172.21.15.7:6836/3623521645":"2024-04-26T10:04:46.961147+0000","172.21.15.7:6834/3623521645":"2024-04-26T10:04:46.961147+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:05:10.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.213+0000 7ff9a749e640 1 -- 172.21.15.7:0/3248979278 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff98406b4d0 msgr2=0x7ff98406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:10.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.213+0000 7ff9a749e640 1 --2- 172.21.15.7:0/3248979278 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff98406b4d0 0x7ff98406d990 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0160a00 tx=0x7ff99c008040 comp rx=0 tx=0).stop 2024-04-25T10:05:10.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.213+0000 7ff9a749e640 1 -- 172.21.15.7:0/3248979278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9a00b6a40 msgr2=0x7ff9a00ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:10.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.213+0000 7ff9a749e640 1 --2- 172.21.15.7:0/3248979278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9a00b6a40 0x7ff9a00ccd10 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7ff99000c460 tx=0x7ff99000c920 comp rx=0 tx=0).stop 2024-04-25T10:05:10.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.213+0000 7ff9a749e640 1 -- 172.21.15.7:0/3248979278 shutdown_connections 2024-04-25T10:05:10.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.213+0000 7ff9a749e640 1 --2- 172.21.15.7:0/3248979278 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7ff98406b4d0 0x7ff98406d990 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.213+0000 7ff9a749e640 1 --2- 172.21.15.7:0/3248979278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9a015dd00 0x7ff9a00cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.213+0000 7ff9a749e640 1 --2- 172.21.15.7:0/3248979278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff9a00b6a40 0x7ff9a00ccd10 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.213+0000 7ff9a749e640 1 --2- 172.21.15.7:0/3248979278 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff9a006c6c0 0x7ff9a0153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.213+0000 7ff9a749e640 1 -- 172.21.15.7:0/3248979278 >> 172.21.15.7:0/3248979278 conn(0x7ff9a00d07b0 msgr2=0x7ff9a015b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:10.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.213+0000 7ff9a749e640 1 -- 172.21.15.7:0/3248979278 shutdown_connections 2024-04-25T10:05:10.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.213+0000 7ff9a749e640 1 -- 172.21.15.7:0/3248979278 wait complete. 2024-04-25T10:05:10.230 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T10:05:10.230 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:05:10.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.328+0000 7fcdd653b640 1 Processor -- start 2024-04-25T10:05:10.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.328+0000 7fcdd653b640 1 -- start start 2024-04-25T10:05:10.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.329+0000 7fcdd653b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcdd009a8e0 0x7fcdd00cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:10.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.329+0000 7fcdd653b640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd0099b20 con 0x7fcdd006c250 2024-04-25T10:05:10.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.329+0000 7fcdd653b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd0099e00 con 0x7fcdd006bce0 2024-04-25T10:05:10.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.329+0000 7fcdd653b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd009a450 con 0x7fcdd009a8e0 2024-04-25T10:05:10.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.329+0000 7fcdcffff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fcdd006c250 0x7fcdd006c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45916/0 (socket says 172.21.15.7:45916) 2024-04-25T10:05:10.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.329+0000 7fcdcffff640 1 -- 172.21.15.7:0/2776979337 learned_addr learned my addr 172.21.15.7:0/2776979337 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:05:10.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.329+0000 7fcdd4ad8640 1 --2- 172.21.15.7:0/2776979337 >> v2:172.21.15.55:3300/0 conn(0x7fcdd009a8e0 0x7fcdd00cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:10.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.329+0000 7fcdceffd640 1 -- 172.21.15.7:0/2776979337 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 470685100 0 0) 0x7fcdd0099b20 con 0x7fcdd006c250 2024-04-25T10:05:10.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.329+0000 7fcdceffd640 1 -- 172.21.15.7:0/2776979337 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdb8003520 con 0x7fcdd006c250 2024-04-25T10:05:10.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.329+0000 7fcdceffd640 1 -- 172.21.15.7:0/2776979337 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1341924834 0 0) 0x7fcdd0099e00 con 0x7fcdd006bce0 2024-04-25T10:05:10.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.329+0000 7fcdceffd640 1 -- 172.21.15.7:0/2776979337 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdd0099b20 con 0x7fcdd006bce0 2024-04-25T10:05:10.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.329+0000 7fcdd4ad8640 1 -- 172.21.15.7:0/2776979337 >> v1:172.21.15.55:6789/0 conn(0x7fcdd006bce0 legacy=0x7fcdd00d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:10.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.329+0000 7fcdd4ad8640 1 -- 172.21.15.7:0/2776979337 >> v1:172.21.15.7:6789/0 conn(0x7fcdd006c250 legacy=0x7fcdd006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:10.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.329+0000 7fcdceffd640 1 -- 172.21.15.7:0/2776979337 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2086985906 0 0) 0x7fcdb8003520 con 0x7fcdd006c250 2024-04-25T10:05:10.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.329+0000 7fcdd4ad8640 1 -- 172.21.15.7:0/2776979337 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd009a0e0 con 0x7fcdd009a8e0 2024-04-25T10:05:10.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.330+0000 7fcdd4ad8640 1 --2- 172.21.15.7:0/2776979337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdd009a8e0 0x7fcdd00cbd30 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8009d90 tx=0x7fcdc802a560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd26ef8099d41419 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:10.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.330+0000 7fcdceffd640 1 -- 172.21.15.7:0/2776979337 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4001670 con 0x7fcdd009a8e0 2024-04-25T10:05:10.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.330+0000 7fcdceffd640 1 -- 172.21.15.7:0/2776979337 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc8007540 con 0x7fcdd009a8e0 2024-04-25T10:05:10.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.330+0000 7fcdceffd640 1 -- 172.21.15.7:0/2776979337 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc80078f0 con 0x7fcdd009a8e0 2024-04-25T10:05:10.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.331+0000 7fcdd653b640 1 -- 172.21.15.7:0/2776979337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdd009a8e0 msgr2=0x7fcdd00cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:10.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.331+0000 7fcdd653b640 1 --2- 172.21.15.7:0/2776979337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdd009a8e0 0x7fcdd00cbd30 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8009d90 tx=0x7fcdc802a560 comp rx=0 tx=0).stop 2024-04-25T10:05:10.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.331+0000 7fcdd653b640 1 -- 172.21.15.7:0/2776979337 shutdown_connections 2024-04-25T10:05:10.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.331+0000 7fcdd653b640 1 --2- 172.21.15.7:0/2776979337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdd009a8e0 0x7fcdd00cbd30 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.331+0000 7fcdd653b640 1 -- 172.21.15.7:0/2776979337 >> 172.21.15.7:0/2776979337 conn(0x7fcdd00d16e0 msgr2=0x7fcdd00d1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:10.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.331+0000 7fcdd653b640 1 -- 172.21.15.7:0/2776979337 shutdown_connections 2024-04-25T10:05:10.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.331+0000 7fcdd653b640 1 -- 172.21.15.7:0/2776979337 wait complete. 2024-04-25T10:05:10.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.332+0000 7fcdd653b640 1 Processor -- start 2024-04-25T10:05:10.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.332+0000 7fcdd653b640 1 -- start start 2024-04-25T10:05:10.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.333+0000 7fcdd653b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdd006bce0 0x7fcdd00c7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:10.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.333+0000 7fcdd653b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdd006c250 0x7fcdd00c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:10.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.333+0000 7fcdd653b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdd009a8e0 0x7fcdd00c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:10.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.333+0000 7fcdd653b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd015f000 con 0x7fcdd009a8e0 2024-04-25T10:05:10.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.333+0000 7fcdd653b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd00d0c60 con 0x7fcdd006bce0 2024-04-25T10:05:10.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.333+0000 7fcdd653b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd015f180 con 0x7fcdd006c250 2024-04-25T10:05:10.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.333+0000 7fcdd4ad8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdd009a8e0 0x7fcdd00c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:10.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.333+0000 7fcdd4ad8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdd009a8e0 0x7fcdd00c5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44958/0 (socket says 172.21.15.7:44958) 2024-04-25T10:05:10.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.333+0000 7fcdd4ad8640 1 -- 172.21.15.7:0/2424944611 learned_addr learned my addr 172.21.15.7:0/2424944611 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:10.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.333+0000 7fcdcffff640 1 --2- 172.21.15.7:0/2424944611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdd006bce0 0x7fcdd00c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:10.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.333+0000 7fcdcf7fe640 1 --2- 172.21.15.7:0/2424944611 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdd006c250 0x7fcdd00c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:10.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.333+0000 7fcdd4ad8640 1 -- 172.21.15.7:0/2424944611 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdd006c250 msgr2=0x7fcdd00c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:10.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.334+0000 7fcdd4ad8640 1 --2- 172.21.15.7:0/2424944611 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdd006c250 0x7fcdd00c5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.334+0000 7fcdd4ad8640 1 -- 172.21.15.7:0/2424944611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdd006bce0 msgr2=0x7fcdd00c7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:10.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.334+0000 7fcdd4ad8640 1 --2- 172.21.15.7:0/2424944611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdd006bce0 0x7fcdd00c7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.334+0000 7fcdd4ad8640 1 -- 172.21.15.7:0/2424944611 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd00c7d90 con 0x7fcdd009a8e0 2024-04-25T10:05:10.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.334+0000 7fcdd4ad8640 1 --2- 172.21.15.7:0/2424944611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdd009a8e0 0x7fcdd00c5750 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7fcdc802ab50 tx=0x7fcdc8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:10.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.334+0000 7fcdccff9640 1 -- 172.21.15.7:0/2424944611 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc8009450 con 0x7fcdd009a8e0 2024-04-25T10:05:10.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.334+0000 7fcdccff9640 1 -- 172.21.15.7:0/2424944611 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc8004240 con 0x7fcdd009a8e0 2024-04-25T10:05:10.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.334+0000 7fcdd653b640 1 -- 172.21.15.7:0/2424944611 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd00c8070 con 0x7fcdd009a8e0 2024-04-25T10:05:10.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.334+0000 7fcdccff9640 1 -- 172.21.15.7:0/2424944611 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc80045f0 con 0x7fcdd009a8e0 2024-04-25T10:05:10.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.334+0000 7fcdd653b640 1 -- 172.21.15.7:0/2424944611 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd00c7860 con 0x7fcdd009a8e0 2024-04-25T10:05:10.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.335+0000 7fcdd653b640 1 -- 172.21.15.7:0/2424944611 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd0068fd0 con 0x7fcdd009a8e0 2024-04-25T10:05:10.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.335+0000 7fcdccff9640 1 -- 172.21.15.7:0/2424944611 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcdc8039040 con 0x7fcdd009a8e0 2024-04-25T10:05:10.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.336+0000 7fcdccff9640 1 --2- 172.21.15.7:0/2424944611 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcdbc06b500 0x7fcdbc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:10.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.336+0000 7fcdccff9640 1 -- 172.21.15.7:0/2424944611 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fcdc80ab790 con 0x7fcdd009a8e0 2024-04-25T10:05:10.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.336+0000 7fcdcffff640 1 --2- 172.21.15.7:0/2424944611 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcdbc06b500 0x7fcdbc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:10.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.336+0000 7fcdcffff640 1 --2- 172.21.15.7:0/2424944611 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcdbc06b500 0x7fcdbc06d9c0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40011e0 tx=0x7fcdc4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:10.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.340+0000 7fcdccff9640 1 -- 172.21.15.7:0/2424944611 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcdc8040030 con 0x7fcdd009a8e0 2024-04-25T10:05:10.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.559+0000 7fcdd653b640 1 -- 172.21.15.7:0/2424944611 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcdd0160380 con 0x7fcdd009a8e0 2024-04-25T10:05:10.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.560+0000 7fcdccff9640 1 -- 172.21.15.7:0/2424944611 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4938 (secure 0 0 0) 0x7fcdc807a330 con 0x7fcdd009a8e0 2024-04-25T10:05:10.566 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:05:10.566 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":101,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6992,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2679200172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2679200172},{"type":"v1","addr":"172.21.15.7:6837","nonce":2679200172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":7942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/4039147179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":4039147179},{"type":"v1","addr":"172.21.15.55:6833","nonce":4039147179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":7945,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3456170359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3456170359},{"type":"v1","addr":"172.21.15.55:6835","nonce":3456170359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:04:29.599245+0000","modified":"2024-04-25T10:05:01.558283+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9492":{"gid":9492,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/1326211296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1326211296},{"type":"v1","addr":"172.21.15.7:6836","nonce":1326211296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T10:05:10.566 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 101 2024-04-25T10:05:10.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.562+0000 7fcdd653b640 1 -- 172.21.15.7:0/2424944611 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcdbc06b500 msgr2=0x7fcdbc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:10.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.562+0000 7fcdd653b640 1 --2- 172.21.15.7:0/2424944611 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcdbc06b500 0x7fcdbc06d9c0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40011e0 tx=0x7fcdc4009040 comp rx=0 tx=0).stop 2024-04-25T10:05:10.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.562+0000 7fcdd653b640 1 -- 172.21.15.7:0/2424944611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdd009a8e0 msgr2=0x7fcdd00c5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:10.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.562+0000 7fcdd653b640 1 --2- 172.21.15.7:0/2424944611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdd009a8e0 0x7fcdd00c5750 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7fcdc802ab50 tx=0x7fcdc8004a40 comp rx=0 tx=0).stop 2024-04-25T10:05:10.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.562+0000 7fcdd653b640 1 -- 172.21.15.7:0/2424944611 shutdown_connections 2024-04-25T10:05:10.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.562+0000 7fcdd653b640 1 --2- 172.21.15.7:0/2424944611 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcdbc06b500 0x7fcdbc06d9c0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.562+0000 7fcdd653b640 1 --2- 172.21.15.7:0/2424944611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdd009a8e0 0x7fcdd00c5750 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.562+0000 7fcdd653b640 1 --2- 172.21.15.7:0/2424944611 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdd006c250 0x7fcdd00c5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.562+0000 7fcdd653b640 1 --2- 172.21.15.7:0/2424944611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdd006bce0 0x7fcdd00c7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.562+0000 7fcdd653b640 1 -- 172.21.15.7:0/2424944611 >> 172.21.15.7:0/2424944611 conn(0x7fcdd00d16e0 msgr2=0x7fcdd0070d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:10.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.562+0000 7fcdd653b640 1 -- 172.21.15.7:0/2424944611 shutdown_connections 2024-04-25T10:05:10.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.562+0000 7fcdd653b640 1 -- 172.21.15.7:0/2424944611 wait complete. 2024-04-25T10:05:10.579 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:05:10.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.675+0000 7f2e3599e640 1 Processor -- start 2024-04-25T10:05:10.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.676+0000 7f2e3599e640 1 -- start start 2024-04-25T10:05:10.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.676+0000 7f2e3599e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e300b0d00 0x7f2e30161e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:10.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.676+0000 7f2e3599e640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2e3006ab60 0x7f2e3006aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:10.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.676+0000 7f2e3599e640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e300b10e0 con 0x7f2e3015dec0 2024-04-25T10:05:10.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.676+0000 7f2e3599e640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e301623a0 con 0x7f2e3006ab60 2024-04-25T10:05:10.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.676+0000 7f2e3599e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e300b1ad0 con 0x7f2e300b0d00 2024-04-25T10:05:10.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.677+0000 7f2e2ffff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2e3006ab60 0x7f2e3006aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:10.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.677+0000 7f2e2ffff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2e3006ab60 0x7f2e3006aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44972/0 (socket says 172.21.15.7:44972) 2024-04-25T10:05:10.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.677+0000 7f2e2ffff640 1 -- 172.21.15.7:0/1377696575 learned_addr learned my addr 172.21.15.7:0/1377696575 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:10.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.677+0000 7f2e3519d640 1 --1- 172.21.15.7:0/1377696575 >> v1:172.21.15.7:6789/0 conn(0x7f2e3015dec0 0x7f2e3015e2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45928/0 (socket says 172.21.15.7:45928) 2024-04-25T10:05:10.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.677+0000 7f2e3499c640 1 --2- 172.21.15.7:0/1377696575 >> v2:172.21.15.55:3300/0 conn(0x7f2e300b0d00 0x7f2e30161e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:10.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.677+0000 7f2e2ffff640 1 -- 172.21.15.7:0/1377696575 >> v2:172.21.15.55:3300/0 conn(0x7f2e300b0d00 msgr2=0x7f2e30161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:10.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.677+0000 7f2e2ffff640 1 --2- 172.21.15.7:0/1377696575 >> v2:172.21.15.55:3300/0 conn(0x7f2e300b0d00 0x7f2e30161e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.677+0000 7f2e2ffff640 1 -- 172.21.15.7:0/1377696575 >> v1:172.21.15.7:6789/0 conn(0x7f2e3015dec0 legacy=0x7f2e3015e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:10.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.677+0000 7f2e2ffff640 1 -- 172.21.15.7:0/1377696575 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e300b4f70 con 0x7f2e3006ab60 2024-04-25T10:05:10.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.677+0000 7f2e3499c640 1 --2- 172.21.15.7:0/1377696575 >> v2:172.21.15.55:3300/0 conn(0x7f2e300b0d00 0x7f2e30161e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:10.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.678+0000 7f2e2ffff640 1 --2- 172.21.15.7:0/1377696575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e3006ab60 0x7f2e3006aff0 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f2e300b3130 tx=0x7f2e1802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25836c0e18490fd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:10.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.678+0000 7f2e2f7fe640 1 -- 172.21.15.7:0/1377696575 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e18037070 con 0x7f2e3006ab60 2024-04-25T10:05:10.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.678+0000 7f2e2f7fe640 1 -- 172.21.15.7:0/1377696575 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e18032440 con 0x7f2e3006ab60 2024-04-25T10:05:10.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.678+0000 7f2e2f7fe640 1 -- 172.21.15.7:0/1377696575 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e18032810 con 0x7f2e3006ab60 2024-04-25T10:05:10.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.678+0000 7f2e3599e640 1 -- 172.21.15.7:0/1377696575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e3006ab60 msgr2=0x7f2e3006aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:10.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.678+0000 7f2e3599e640 1 --2- 172.21.15.7:0/1377696575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e3006ab60 0x7f2e3006aff0 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f2e300b3130 tx=0x7f2e1802a270 comp rx=0 tx=0).stop 2024-04-25T10:05:10.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.678+0000 7f2e3599e640 1 -- 172.21.15.7:0/1377696575 shutdown_connections 2024-04-25T10:05:10.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.678+0000 7f2e3599e640 1 --2- 172.21.15.7:0/1377696575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e3006ab60 0x7f2e3006aff0 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.678+0000 7f2e3599e640 1 --2- 172.21.15.7:0/1377696575 >> v2:172.21.15.55:3300/0 conn(0x7f2e300b0d00 0x7f2e30161e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.678+0000 7f2e3599e640 1 -- 172.21.15.7:0/1377696575 >> 172.21.15.7:0/1377696575 conn(0x7f2e300999f0 msgr2=0x7f2e300b5890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:10.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.678+0000 7f2e3599e640 1 -- 172.21.15.7:0/1377696575 shutdown_connections 2024-04-25T10:05:10.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.678+0000 7f2e3599e640 1 -- 172.21.15.7:0/1377696575 wait complete. 2024-04-25T10:05:10.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.680+0000 7f2e3599e640 1 Processor -- start 2024-04-25T10:05:10.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.680+0000 7f2e3599e640 1 -- start start 2024-04-25T10:05:10.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.681+0000 7f2e3599e640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e3006ab60 0x7f2e3014bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:10.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.681+0000 7f2e3599e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e300b0d00 0x7f2e3009ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:10.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.681+0000 7f2e3599e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e3015dec0 0x7f2e300ae3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:10.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.681+0000 7f2e3599e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e300b6230 con 0x7f2e300b0d00 2024-04-25T10:05:10.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.681+0000 7f2e3599e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e300b5530 con 0x7f2e3015dec0 2024-04-25T10:05:10.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.681+0000 7f2e3599e640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e300b1db0 con 0x7f2e3006ab60 2024-04-25T10:05:10.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.681+0000 7f2e2ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e300b0d00 0x7f2e3009ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:10.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.681+0000 7f2e2ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e300b0d00 0x7f2e3009ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44986/0 (socket says 172.21.15.7:44986) 2024-04-25T10:05:10.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.681+0000 7f2e2ffff640 1 -- 172.21.15.7:0/1269423142 learned_addr learned my addr 172.21.15.7:0/1269423142 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:10.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.681+0000 7f2e3519d640 1 --2- 172.21.15.7:0/1269423142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e3015dec0 0x7f2e300ae3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:10.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.681+0000 7f2e3499c640 1 --2- 172.21.15.7:0/1269423142 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e3006ab60 0x7f2e3014bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:10.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.681+0000 7f2e2ffff640 1 -- 172.21.15.7:0/1269423142 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e3006ab60 msgr2=0x7f2e3014bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:10.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.681+0000 7f2e2ffff640 1 --2- 172.21.15.7:0/1269423142 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e3006ab60 0x7f2e3014bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.681+0000 7f2e2ffff640 1 -- 172.21.15.7:0/1269423142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e3015dec0 msgr2=0x7f2e300ae3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:10.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.681+0000 7f2e2ffff640 1 --2- 172.21.15.7:0/1269423142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e3015dec0 0x7f2e300ae3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.681+0000 7f2e2ffff640 1 -- 172.21.15.7:0/1269423142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3009d4e0 con 0x7f2e300b0d00 2024-04-25T10:05:10.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.681+0000 7f2e2ffff640 1 --2- 172.21.15.7:0/1269423142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e300b0d00 0x7f2e3009ad50 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f2e1802a2b0 tx=0x7f2e180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:10.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.681+0000 7f2e2d7fa640 1 -- 172.21.15.7:0/1269423142 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e18041020 con 0x7f2e300b0d00 2024-04-25T10:05:10.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.681+0000 7f2e2d7fa640 1 -- 172.21.15.7:0/1269423142 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e180306c0 con 0x7f2e300b0d00 2024-04-25T10:05:10.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.682+0000 7f2e2d7fa640 1 -- 172.21.15.7:0/1269423142 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e18037040 con 0x7f2e300b0d00 2024-04-25T10:05:10.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.682+0000 7f2e3599e640 1 -- 172.21.15.7:0/1269423142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e3009d7c0 con 0x7f2e300b0d00 2024-04-25T10:05:10.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.682+0000 7f2e3599e640 1 -- 172.21.15.7:0/1269423142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e3009dd80 con 0x7f2e300b0d00 2024-04-25T10:05:10.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.682+0000 7f2e3599e640 1 -- 172.21.15.7:0/1269423142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e3009e440 con 0x7f2e300b0d00 2024-04-25T10:05:10.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.683+0000 7f2e2d7fa640 1 -- 172.21.15.7:0/1269423142 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2e18044020 con 0x7f2e300b0d00 2024-04-25T10:05:10.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.683+0000 7f2e2d7fa640 1 --2- 172.21.15.7:0/1269423142 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2e1006b4d0 0x7f2e1006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:10.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.683+0000 7f2e2d7fa640 1 -- 172.21.15.7:0/1269423142 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f2e180aac50 con 0x7f2e300b0d00 2024-04-25T10:05:10.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.684+0000 7f2e3499c640 1 --2- 172.21.15.7:0/1269423142 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2e1006b4d0 0x7f2e1006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:10.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.684+0000 7f2e3499c640 1 --2- 172.21.15.7:0/1269423142 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2e1006b4d0 0x7f2e1006d990 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f2e28003fd0 tx=0x7f2e280039f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:10.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.688+0000 7f2e2d7fa640 1 -- 172.21.15.7:0/1269423142 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2e3009e440 con 0x7f2e300b0d00 2024-04-25T10:05:10.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.906+0000 7f2e3599e640 1 -- 172.21.15.7:0/1269423142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e30068f60 con 0x7f2e300b0d00 2024-04-25T10:05:10.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.906+0000 7f2e2d7fa640 1 -- 172.21.15.7:0/1269423142 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4938 (secure 0 0 0) 0x7f2e180b0020 con 0x7f2e300b0d00 2024-04-25T10:05:10.912 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:05:10.912 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":101,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6992,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2679200172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2679200172},{"type":"v1","addr":"172.21.15.7:6837","nonce":2679200172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":7942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/4039147179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":4039147179},{"type":"v1","addr":"172.21.15.55:6833","nonce":4039147179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":7945,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3456170359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3456170359},{"type":"v1","addr":"172.21.15.55:6835","nonce":3456170359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:04:29.599245+0000","modified":"2024-04-25T10:05:01.558283+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9492":{"gid":9492,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/1326211296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":1326211296},{"type":"v1","addr":"172.21.15.7:6836","nonce":1326211296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T10:05:10.912 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 101 2024-04-25T10:05:10.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.908+0000 7f2e3599e640 1 -- 172.21.15.7:0/1269423142 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2e1006b4d0 msgr2=0x7f2e1006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:10.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.908+0000 7f2e3599e640 1 --2- 172.21.15.7:0/1269423142 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2e1006b4d0 0x7f2e1006d990 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f2e28003fd0 tx=0x7f2e280039f0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.908+0000 7f2e3599e640 1 -- 172.21.15.7:0/1269423142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e300b0d00 msgr2=0x7f2e3009ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:10.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.908+0000 7f2e3599e640 1 --2- 172.21.15.7:0/1269423142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e300b0d00 0x7f2e3009ad50 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f2e1802a2b0 tx=0x7f2e180046c0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.908+0000 7f2e3599e640 1 -- 172.21.15.7:0/1269423142 shutdown_connections 2024-04-25T10:05:10.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.908+0000 7f2e3599e640 1 --2- 172.21.15.7:0/1269423142 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2e1006b4d0 0x7f2e1006d990 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.908+0000 7f2e3599e640 1 --2- 172.21.15.7:0/1269423142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e3015dec0 0x7f2e300ae3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.908+0000 7f2e3599e640 1 --2- 172.21.15.7:0/1269423142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2e300b0d00 0x7f2e3009ad50 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.908+0000 7f2e3599e640 1 --2- 172.21.15.7:0/1269423142 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e3006ab60 0x7f2e3014bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.908+0000 7f2e3599e640 1 -- 172.21.15.7:0/1269423142 >> 172.21.15.7:0/1269423142 conn(0x7f2e300999f0 msgr2=0x7f2e3015e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:10.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.908+0000 7f2e3599e640 1 -- 172.21.15.7:0/1269423142 shutdown_connections 2024-04-25T10:05:10.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:10.908+0000 7f2e3599e640 1 -- 172.21.15.7:0/1269423142 wait complete. 2024-04-25T10:05:10.925 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:05:11.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.020+0000 7f2f390db640 1 Processor -- start 2024-04-25T10:05:11.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.020+0000 7f2f390db640 1 -- start start 2024-04-25T10:05:11.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.021+0000 7f2f390db640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2f3406bc70 0x7f2f3409a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.021+0000 7f2f390db640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2f3406c330 0x7f2f3406c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.021+0000 7f2f390db640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f340cfad0 con 0x7f2f3415da20 2024-04-25T10:05:11.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.021+0000 7f2f390db640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f340d06e0 con 0x7f2f3406bc70 2024-04-25T10:05:11.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.021+0000 7f2f390db640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f3409a940 con 0x7f2f3406c330 2024-04-25T10:05:11.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.021+0000 7f2f3259c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2f3406bc70 0x7f2f3409a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.021+0000 7f2f32d9d640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2f3415da20 0x7f2f340d0b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45932/0 (socket says 172.21.15.7:45932) 2024-04-25T10:05:11.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.021+0000 7f2f3259c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2f3406bc70 0x7f2f3409a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45000/0 (socket says 172.21.15.7:45000) 2024-04-25T10:05:11.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.021+0000 7f2f32d9d640 1 -- 172.21.15.7:0/3316445215 learned_addr learned my addr 172.21.15.7:0/3316445215 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:05:11.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.022+0000 7f2f3359e640 1 --2- 172.21.15.7:0/3316445215 >> v2:172.21.15.55:3300/0 conn(0x7f2f3406c330 0x7f2f3406c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.022+0000 7f2f3259c640 1 -- 172.21.15.7:0/3316445215 >> v2:172.21.15.55:3300/0 conn(0x7f2f3406c330 msgr2=0x7f2f3406c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:11.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.022+0000 7f2f3259c640 1 --2- 172.21.15.7:0/3316445215 >> v2:172.21.15.55:3300/0 conn(0x7f2f3406c330 0x7f2f3406c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.022+0000 7f2f3259c640 1 -- 172.21.15.7:0/3316445215 >> v1:172.21.15.7:6789/0 conn(0x7f2f3415da20 legacy=0x7f2f340d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.022+0000 7f2f3259c640 1 -- 172.21.15.7:0/3316445215 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f340cfdb0 con 0x7f2f3406bc70 2024-04-25T10:05:11.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.022+0000 7f2f31d9b640 1 -- 172.21.15.7:0/3316445215 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3028927297 0 0) 0x7f2f340cfad0 con 0x7f2f3415da20 2024-04-25T10:05:11.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.022+0000 7f2f3259c640 1 --2- 172.21.15.7:0/3316445215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f3406bc70 0x7f2f3409a400 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f2f3406f320 tx=0x7f2f2802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66fc3fe0d9cfd75 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:11.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.023+0000 7f2f31d9b640 1 -- 172.21.15.7:0/3316445215 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f28037070 con 0x7f2f3406bc70 2024-04-25T10:05:11.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.023+0000 7f2f31d9b640 1 -- 172.21.15.7:0/3316445215 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f28032440 con 0x7f2f3406bc70 2024-04-25T10:05:11.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.023+0000 7f2f31d9b640 1 -- 172.21.15.7:0/3316445215 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f28032810 con 0x7f2f3406bc70 2024-04-25T10:05:11.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.023+0000 7f2f390db640 1 -- 172.21.15.7:0/3316445215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f3406bc70 msgr2=0x7f2f3409a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.023+0000 7f2f390db640 1 --2- 172.21.15.7:0/3316445215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f3406bc70 0x7f2f3409a400 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f2f3406f320 tx=0x7f2f2802a1a0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.023+0000 7f2f390db640 1 -- 172.21.15.7:0/3316445215 shutdown_connections 2024-04-25T10:05:11.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.023+0000 7f2f390db640 1 --2- 172.21.15.7:0/3316445215 >> v2:172.21.15.55:3300/0 conn(0x7f2f3406c330 0x7f2f3406c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.023+0000 7f2f390db640 1 --2- 172.21.15.7:0/3316445215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f3406bc70 0x7f2f3409a400 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.023+0000 7f2f390db640 1 -- 172.21.15.7:0/3316445215 >> 172.21.15.7:0/3316445215 conn(0x7f2f340d16f0 msgr2=0x7f2f340d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:11.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.023+0000 7f2f390db640 1 -- 172.21.15.7:0/3316445215 shutdown_connections 2024-04-25T10:05:11.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.023+0000 7f2f390db640 1 -- 172.21.15.7:0/3316445215 wait complete. 2024-04-25T10:05:11.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.025+0000 7f2f390db640 1 Processor -- start 2024-04-25T10:05:11.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.025+0000 7f2f390db640 1 -- start start 2024-04-25T10:05:11.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.025+0000 7f2f390db640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f3406bc70 0x7f2f3409ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.025+0000 7f2f390db640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f3406c330 0x7f2f3409b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.025+0000 7f2f390db640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f3415da20 0x7f2f3409bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.025+0000 7f2f390db640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f340d1280 con 0x7f2f3415da20 2024-04-25T10:05:11.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.025+0000 7f2f390db640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f340d0370 con 0x7f2f3406c330 2024-04-25T10:05:11.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.025+0000 7f2f390db640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3415de00 con 0x7f2f3406bc70 2024-04-25T10:05:11.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.026+0000 7f2f3359e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f3415da20 0x7f2f3409bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.026+0000 7f2f3359e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f3415da20 0x7f2f3409bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45004/0 (socket says 172.21.15.7:45004) 2024-04-25T10:05:11.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.026+0000 7f2f3359e640 1 -- 172.21.15.7:0/4102966591 learned_addr learned my addr 172.21.15.7:0/4102966591 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:11.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.026+0000 7f2f32d9d640 1 --2- 172.21.15.7:0/4102966591 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f3406bc70 0x7f2f3409ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.026+0000 7f2f3259c640 1 --2- 172.21.15.7:0/4102966591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f3406c330 0x7f2f3409b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.026+0000 7f2f3359e640 1 -- 172.21.15.7:0/4102966591 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f3406bc70 msgr2=0x7f2f3409ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.026+0000 7f2f3359e640 1 --2- 172.21.15.7:0/4102966591 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f3406bc70 0x7f2f3409ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.026+0000 7f2f3359e640 1 -- 172.21.15.7:0/4102966591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f3406c330 msgr2=0x7f2f3409b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.026+0000 7f2f3359e640 1 --2- 172.21.15.7:0/4102966591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f3406c330 0x7f2f3409b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.026+0000 7f2f3359e640 1 -- 172.21.15.7:0/4102966591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f34158f60 con 0x7f2f3415da20 2024-04-25T10:05:11.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.026+0000 7f2f3359e640 1 --2- 172.21.15.7:0/4102966591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f3415da20 0x7f2f3409bb90 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c007e40 tx=0x7f2f2c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:11.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.026+0000 7f2f1b7fe640 1 -- 172.21.15.7:0/4102966591 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c014620 con 0x7f2f3415da20 2024-04-25T10:05:11.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.026+0000 7f2f1b7fe640 1 -- 172.21.15.7:0/4102966591 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2c019070 con 0x7f2f3415da20 2024-04-25T10:05:11.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.026+0000 7f2f390db640 1 -- 172.21.15.7:0/4102966591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f34159240 con 0x7f2f3415da20 2024-04-25T10:05:11.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.026+0000 7f2f1b7fe640 1 -- 172.21.15.7:0/4102966591 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c014a20 con 0x7f2f3415da20 2024-04-25T10:05:11.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.026+0000 7f2f390db640 1 -- 172.21.15.7:0/4102966591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f34159800 con 0x7f2f3415da20 2024-04-25T10:05:11.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.028+0000 7f2f390db640 1 -- 172.21.15.7:0/4102966591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f34068fd0 con 0x7f2f3415da20 2024-04-25T10:05:11.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.028+0000 7f2f1b7fe640 1 -- 172.21.15.7:0/4102966591 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2f2c014bc0 con 0x7f2f3415da20 2024-04-25T10:05:11.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.028+0000 7f2f1b7fe640 1 --2- 172.21.15.7:0/4102966591 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2f2006b500 0x7f2f2006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.028+0000 7f2f1b7fe640 1 -- 172.21.15.7:0/4102966591 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f2f2c08abc0 con 0x7f2f3415da20 2024-04-25T10:05:11.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.029+0000 7f2f32d9d640 1 --2- 172.21.15.7:0/4102966591 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2f2006b500 0x7f2f2006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.029+0000 7f2f32d9d640 1 --2- 172.21.15.7:0/4102966591 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2f2006b500 0x7f2f2006d9c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2f24000f60 tx=0x7f2f24007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:11.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.033+0000 7f2f1b7fe640 1 -- 172.21.15.7:0/4102966591 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2f2c0591b0 con 0x7f2f3415da20 2024-04-25T10:05:11.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.215+0000 7f2f390db640 1 -- 172.21.15.7:0/4102966591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f340d2500 con 0x7f2f3415da20 2024-04-25T10:05:11.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.216+0000 7f2f1b7fe640 1 -- 172.21.15.7:0/4102966591 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+17111 (secure 0 0 0) 0x7f2f2c05d250 con 0x7f2f3415da20 2024-04-25T10:05:11.222 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:05:11.222 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":119,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:04:57.499369+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:04:27.856713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T10:04:28.566676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6836/3781378145":"2024-04-26T10:04:57.499347+0000","172.21.15.7:6834/3781378145":"2024-04-26T10:04:57.499347+0000","172.21.15.7:6836/3623521645":"2024-04-26T10:04:46.961147+0000","172.21.15.7:6834/3623521645":"2024-04-26T10:04:46.961147+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:05:11.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.218+0000 7f2f390db640 1 -- 172.21.15.7:0/4102966591 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2f2006b500 msgr2=0x7f2f2006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.218+0000 7f2f390db640 1 --2- 172.21.15.7:0/4102966591 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2f2006b500 0x7f2f2006d9c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2f24000f60 tx=0x7f2f24007d50 comp rx=0 tx=0).stop 2024-04-25T10:05:11.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.218+0000 7f2f390db640 1 -- 172.21.15.7:0/4102966591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f3415da20 msgr2=0x7f2f3409bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.218+0000 7f2f390db640 1 --2- 172.21.15.7:0/4102966591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f3415da20 0x7f2f3409bb90 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c007e40 tx=0x7f2f2c00e4b0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.218+0000 7f2f390db640 1 -- 172.21.15.7:0/4102966591 shutdown_connections 2024-04-25T10:05:11.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.218+0000 7f2f390db640 1 --2- 172.21.15.7:0/4102966591 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f2f2006b500 0x7f2f2006d9c0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.218+0000 7f2f390db640 1 --2- 172.21.15.7:0/4102966591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f3415da20 0x7f2f3409bb90 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.218+0000 7f2f390db640 1 --2- 172.21.15.7:0/4102966591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f3406c330 0x7f2f3409b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.218+0000 7f2f390db640 1 --2- 172.21.15.7:0/4102966591 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f3406bc70 0x7f2f3409ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.218+0000 7f2f390db640 1 -- 172.21.15.7:0/4102966591 >> 172.21.15.7:0/4102966591 conn(0x7f2f340d16f0 msgr2=0x7f2f340d0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:11.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.218+0000 7f2f390db640 1 -- 172.21.15.7:0/4102966591 shutdown_connections 2024-04-25T10:05:11.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.218+0000 7f2f390db640 1 -- 172.21.15.7:0/4102966591 wait complete. 2024-04-25T10:05:11.235 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T10:05:11.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.331+0000 7fcb4286f640 1 Processor -- start 2024-04-25T10:05:11.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.331+0000 7fcb4286f640 1 -- start start 2024-04-25T10:05:11.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.332+0000 7fcb4286f640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcb3c0b5e60 0x7fcb3c06bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.332+0000 7fcb4286f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcb3c0b6a40 0x7fcb3c06c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.332+0000 7fcb4286f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb3c06ca30 con 0x7fcb3c15dd00 2024-04-25T10:05:11.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.332+0000 7fcb4286f640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb3c15e0e0 con 0x7fcb3c0b5e60 2024-04-25T10:05:11.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.332+0000 7fcb4286f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c06cfe0 con 0x7fcb3c0b6a40 2024-04-25T10:05:11.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.332+0000 7fcb3b7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcb3c0b5e60 0x7fcb3c06bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.332+0000 7fcb3b7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcb3c0b5e60 0x7fcb3c06bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45010/0 (socket says 172.21.15.7:45010) 2024-04-25T10:05:11.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.332+0000 7fcb3b7fe640 1 -- 172.21.15.7:0/731767520 learned_addr learned my addr 172.21.15.7:0/731767520 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:11.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.332+0000 7fcb40e0c640 1 --2- 172.21.15.7:0/731767520 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcb3c0b6a40 0x7fcb3c06c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.332+0000 7fcb3b7fe640 1 -- 172.21.15.7:0/731767520 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcb3c0b6a40 msgr2=0x7fcb3c06c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:11.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.332+0000 7fcb3b7fe640 1 --2- 172.21.15.7:0/731767520 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcb3c0b6a40 0x7fcb3c06c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.332+0000 7fcb3b7fe640 1 -- 172.21.15.7:0/731767520 >> v1:172.21.15.55:6789/0 conn(0x7fcb3c15dd00 legacy=0x7fcb3c0b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.332+0000 7fcb3b7fe640 1 -- 172.21.15.7:0/731767520 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3c06cd00 con 0x7fcb3c0b5e60 2024-04-25T10:05:11.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.333+0000 7fcb3b7fe640 1 --2- 172.21.15.7:0/731767520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb3c0b5e60 0x7fcb3c06bfb0 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c009870 tx=0x7fcb2c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34478cf139cf0b3c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:11.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.333+0000 7fcb3affd640 1 -- 172.21.15.7:0/731767520 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c037070 con 0x7fcb3c0b5e60 2024-04-25T10:05:11.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.333+0000 7fcb3affd640 1 -- 172.21.15.7:0/731767520 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb2c02ae50 con 0x7fcb3c0b5e60 2024-04-25T10:05:11.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.333+0000 7fcb3affd640 1 -- 172.21.15.7:0/731767520 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c032860 con 0x7fcb3c0b5e60 2024-04-25T10:05:11.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.334+0000 7fcb4286f640 1 -- 172.21.15.7:0/731767520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb3c0b5e60 msgr2=0x7fcb3c06bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.334+0000 7fcb4286f640 1 --2- 172.21.15.7:0/731767520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb3c0b5e60 0x7fcb3c06bfb0 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c009870 tx=0x7fcb2c02a300 comp rx=0 tx=0).stop 2024-04-25T10:05:11.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.334+0000 7fcb4286f640 1 -- 172.21.15.7:0/731767520 shutdown_connections 2024-04-25T10:05:11.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.334+0000 7fcb4286f640 1 --2- 172.21.15.7:0/731767520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb3c0b5e60 0x7fcb3c06bfb0 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.334+0000 7fcb4286f640 1 --2- 172.21.15.7:0/731767520 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcb3c0b6a40 0x7fcb3c06c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.334+0000 7fcb4286f640 1 -- 172.21.15.7:0/731767520 >> 172.21.15.7:0/731767520 conn(0x7fcb3c0d07b0 msgr2=0x7fcb3c0d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:11.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.334+0000 7fcb4286f640 1 -- 172.21.15.7:0/731767520 shutdown_connections 2024-04-25T10:05:11.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.334+0000 7fcb4286f640 1 -- 172.21.15.7:0/731767520 wait complete. 2024-04-25T10:05:11.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.335+0000 7fcb4286f640 1 Processor -- start 2024-04-25T10:05:11.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.335+0000 7fcb4286f640 1 -- start start 2024-04-25T10:05:11.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.336+0000 7fcb4286f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb3c0b5e60 0x7fcb3c1509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.336+0000 7fcb4286f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb3c0b6a40 0x7fcb3c0ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.336+0000 7fcb4286f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcb3c15dd00 0x7fcb3c1561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.336+0000 7fcb4286f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c0d2260 con 0x7fcb3c0b6a40 2024-04-25T10:05:11.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.336+0000 7fcb4286f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c0d1f80 con 0x7fcb3c0b5e60 2024-04-25T10:05:11.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.336+0000 7fcb4286f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c0d2780 con 0x7fcb3c15dd00 2024-04-25T10:05:11.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.336+0000 7fcb3b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb3c0b6a40 0x7fcb3c0ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.336+0000 7fcb3b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb3c0b6a40 0x7fcb3c0ca9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45012/0 (socket says 172.21.15.7:45012) 2024-04-25T10:05:11.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.336+0000 7fcb3b7fe640 1 -- 172.21.15.7:0/1977859339 learned_addr learned my addr 172.21.15.7:0/1977859339 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:11.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.336+0000 7fcb40e0c640 1 --2- 172.21.15.7:0/1977859339 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcb3c15dd00 0x7fcb3c1561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.336+0000 7fcb3bfff640 1 --2- 172.21.15.7:0/1977859339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb3c0b5e60 0x7fcb3c1509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.336+0000 7fcb3b7fe640 1 -- 172.21.15.7:0/1977859339 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcb3c15dd00 msgr2=0x7fcb3c1561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.336+0000 7fcb3b7fe640 1 --2- 172.21.15.7:0/1977859339 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcb3c15dd00 0x7fcb3c1561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.336+0000 7fcb3b7fe640 1 -- 172.21.15.7:0/1977859339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb3c0b5e60 msgr2=0x7fcb3c1509a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.336+0000 7fcb3b7fe640 1 --2- 172.21.15.7:0/1977859339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb3c0b5e60 0x7fcb3c1509a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.336+0000 7fcb3b7fe640 1 -- 172.21.15.7:0/1977859339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3c150ee0 con 0x7fcb3c0b6a40 2024-04-25T10:05:11.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.337+0000 7fcb3b7fe640 1 --2- 172.21.15.7:0/1977859339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb3c0b6a40 0x7fcb3c0ca9e0 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c000c00 tx=0x7fcb2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:11.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.337+0000 7fcb38ff9640 1 -- 172.21.15.7:0/1977859339 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c041070 con 0x7fcb3c0b6a40 2024-04-25T10:05:11.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.337+0000 7fcb38ff9640 1 -- 172.21.15.7:0/1977859339 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb2c03c660 con 0x7fcb3c0b6a40 2024-04-25T10:05:11.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.337+0000 7fcb38ff9640 1 -- 172.21.15.7:0/1977859339 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c037040 con 0x7fcb3c0b6a40 2024-04-25T10:05:11.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.337+0000 7fcb4286f640 1 -- 172.21.15.7:0/1977859339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb3c1f48f0 con 0x7fcb3c0b6a40 2024-04-25T10:05:11.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.337+0000 7fcb4286f640 1 -- 172.21.15.7:0/1977859339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb3c1559d0 con 0x7fcb3c0b6a40 2024-04-25T10:05:11.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.338+0000 7fcb4286f640 1 -- 172.21.15.7:0/1977859339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb3c0d0bf0 con 0x7fcb3c0b6a40 2024-04-25T10:05:11.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.338+0000 7fcb38ff9640 1 -- 172.21.15.7:0/1977859339 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcb2c044070 con 0x7fcb3c0b6a40 2024-04-25T10:05:11.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.339+0000 7fcb38ff9640 1 --2- 172.21.15.7:0/1977859339 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcb2806b500 0x7fcb2806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.339+0000 7fcb38ff9640 1 -- 172.21.15.7:0/1977859339 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fcb2c0aae30 con 0x7fcb3c0b6a40 2024-04-25T10:05:11.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.339+0000 7fcb3bfff640 1 --2- 172.21.15.7:0/1977859339 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcb2806b500 0x7fcb2806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.339+0000 7fcb3bfff640 1 --2- 172.21.15.7:0/1977859339 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcb2806b500 0x7fcb2806d9c0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fcb30001500 tx=0x7fcb30009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:11.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.343+0000 7fcb38ff9640 1 -- 172.21.15.7:0/1977859339 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcb3c0d0bf0 con 0x7fcb3c0b6a40 2024-04-25T10:05:11.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.560+0000 7fcb4286f640 1 -- 172.21.15.7:0/1977859339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fcb3c068fd0 con 0x7fcb3c0b6a40 2024-04-25T10:05:11.566 INFO:tasks.ceph.mon.a.smithi007.stderr:2024-04-25T10:05:11.560+0000 7f45ad572640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T10:05:11.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.562+0000 7fcb38ff9640 1 -- 172.21.15.7:0/1977859339 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v102) v1 ==== 161+0+0 (secure 0 0 0) 0x7fcb2c079b90 con 0x7fcb3c0b6a40 2024-04-25T10:05:11.567 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T10:05:11.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.565+0000 7fcb4286f640 1 -- 172.21.15.7:0/1977859339 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcb2806b500 msgr2=0x7fcb2806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.565+0000 7fcb4286f640 1 --2- 172.21.15.7:0/1977859339 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcb2806b500 0x7fcb2806d9c0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fcb30001500 tx=0x7fcb30009040 comp rx=0 tx=0).stop 2024-04-25T10:05:11.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.565+0000 7fcb4286f640 1 -- 172.21.15.7:0/1977859339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb3c0b6a40 msgr2=0x7fcb3c0ca9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.565+0000 7fcb4286f640 1 --2- 172.21.15.7:0/1977859339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb3c0b6a40 0x7fcb3c0ca9e0 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c000c00 tx=0x7fcb2c0046c0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.565+0000 7fcb4286f640 1 -- 172.21.15.7:0/1977859339 shutdown_connections 2024-04-25T10:05:11.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.565+0000 7fcb4286f640 1 --2- 172.21.15.7:0/1977859339 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcb2806b500 0x7fcb2806d9c0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.565+0000 7fcb4286f640 1 --2- 172.21.15.7:0/1977859339 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcb3c15dd00 0x7fcb3c1561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.565+0000 7fcb4286f640 1 --2- 172.21.15.7:0/1977859339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb3c0b6a40 0x7fcb3c0ca9e0 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.565+0000 7fcb4286f640 1 --2- 172.21.15.7:0/1977859339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb3c0b5e60 0x7fcb3c1509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.565+0000 7fcb4286f640 1 -- 172.21.15.7:0/1977859339 >> 172.21.15.7:0/1977859339 conn(0x7fcb3c0d07b0 msgr2=0x7fcb3c0b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:11.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.565+0000 7fcb4286f640 1 -- 172.21.15.7:0/1977859339 shutdown_connections 2024-04-25T10:05:11.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.565+0000 7fcb4286f640 1 -- 172.21.15.7:0/1977859339 wait complete. 2024-04-25T10:05:11.572 INFO:tasks.ceph.mds.a.smithi007.stderr: -1208> 2024-04-25T10:05:03.509+0000 7f32de560640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:05:11.582 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T10:05:11.596 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-04-25T10:05:11.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.680+0000 7f345d06b640 1 Processor -- start 2024-04-25T10:05:11.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.680+0000 7f345d06b640 1 -- start start 2024-04-25T10:05:11.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.681+0000 7f345d06b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f34580d0780 0x7f34580d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.681+0000 7f345d06b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f34580b9590 0x7f34580b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.681+0000 7f345d06b640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34580d10a0 con 0x7f34580b9130 2024-04-25T10:05:11.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.681+0000 7f345d06b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34580b7ef0 con 0x7f34580d0780 2024-04-25T10:05:11.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.681+0000 7f345d06b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34580b81d0 con 0x7f34580b9590 2024-04-25T10:05:11.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.681+0000 7f345659c640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f34580b9130 0x7f34580d1c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45944/0 (socket says 172.21.15.7:45944) 2024-04-25T10:05:11.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.681+0000 7f345659c640 1 -- 172.21.15.7:0/4024853384 learned_addr learned my addr 172.21.15.7:0/4024853384 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:05:11.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.681+0000 7f3455d9b640 1 -- 172.21.15.7:0/4024853384 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3772371998 0 0) 0x7f34580d10a0 con 0x7f34580b9130 2024-04-25T10:05:11.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.681+0000 7f345759e640 1 --2- 172.21.15.7:0/4024853384 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f34580b9590 0x7f34580b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.681+0000 7f3456d9d640 1 --2- 172.21.15.7:0/4024853384 >> v2:172.21.15.55:3300/0 conn(0x7f34580d0780 0x7f34580d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.681+0000 7f3455d9b640 1 -- 172.21.15.7:0/4024853384 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3440003520 con 0x7f34580b9130 2024-04-25T10:05:11.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.681+0000 7f3455d9b640 1 -- 172.21.15.7:0/4024853384 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3449647114 0 0) 0x7f3440003520 con 0x7f34580b9130 2024-04-25T10:05:11.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.681+0000 7f3455d9b640 1 -- 172.21.15.7:0/4024853384 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f34580b9590 msgr2=0x7f34580b78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:11.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.681+0000 7f3455d9b640 1 --2- 172.21.15.7:0/4024853384 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f34580b9590 0x7f34580b78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.681+0000 7f3455d9b640 1 -- 172.21.15.7:0/4024853384 >> v2:172.21.15.55:3300/0 conn(0x7f34580d0780 msgr2=0x7f34580d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:11.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.682+0000 7f3455d9b640 1 --2- 172.21.15.7:0/4024853384 >> v2:172.21.15.55:3300/0 conn(0x7f34580d0780 0x7f34580d0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.682+0000 7f3455d9b640 1 -- 172.21.15.7:0/4024853384 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34580b84b0 con 0x7f34580b9130 2024-04-25T10:05:11.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.682+0000 7f3455d9b640 1 -- 172.21.15.7:0/4024853384 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f344c001670 con 0x7f34580b9130 2024-04-25T10:05:11.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.682+0000 7f3455d9b640 1 -- 172.21.15.7:0/4024853384 >> v1:172.21.15.7:6789/0 conn(0x7f34580b9130 legacy=0x7f34580d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.682+0000 7f3455d9b640 1 --2- 172.21.15.7:0/4024853384 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f34580b9590 0x7f34400039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.682+0000 7f3455d9b640 1 --2- 172.21.15.7:0/4024853384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3440003f30 0x7f3440004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.682+0000 7f3455d9b640 1 --2- 172.21.15.7:0/4024853384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3440004d40 0x7f34400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.682+0000 7f3455d9b640 1 -- 172.21.15.7:0/4024853384 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34580b7ef0 con 0x7f3440003f30 2024-04-25T10:05:11.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.682+0000 7f3455d9b640 1 -- 172.21.15.7:0/4024853384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34580b81d0 con 0x7f3440004d40 2024-04-25T10:05:11.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.682+0000 7f3455d9b640 1 -- 172.21.15.7:0/4024853384 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f344000b9c0 con 0x7f34580b9590 2024-04-25T10:05:11.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.682+0000 7f345659c640 1 --2- 172.21.15.7:0/4024853384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3440003f30 0x7f3440004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.682+0000 7f3456d9d640 1 --2- 172.21.15.7:0/4024853384 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f34580b9590 0x7f34400039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.682+0000 7f345759e640 1 --2- 172.21.15.7:0/4024853384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3440004d40 0x7f34400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.682+0000 7f345659c640 1 -- 172.21.15.7:0/4024853384 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f34580b9590 msgr2=0x7f34400039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:11.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.682+0000 7f345659c640 1 --2- 172.21.15.7:0/4024853384 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f34580b9590 0x7f34400039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.682+0000 7f345659c640 1 -- 172.21.15.7:0/4024853384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3440004d40 msgr2=0x7f34400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:11.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.682+0000 7f345659c640 1 --2- 172.21.15.7:0/4024853384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3440004d40 0x7f34400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.682+0000 7f345659c640 1 -- 172.21.15.7:0/4024853384 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3440003520 con 0x7f3440003f30 2024-04-25T10:05:11.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.683+0000 7f345659c640 1 --2- 172.21.15.7:0/4024853384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3440003f30 0x7f3440004800 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f344c00c210 tx=0x7f3440005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2cb279da42c20a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:11.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.683+0000 7f3455d9b640 1 -- 172.21.15.7:0/4024853384 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c007d50 con 0x7f3440003f30 2024-04-25T10:05:11.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.683+0000 7f3455d9b640 1 -- 172.21.15.7:0/4024853384 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344c02e070 con 0x7f3440003f30 2024-04-25T10:05:11.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.683+0000 7f3455d9b640 1 -- 172.21.15.7:0/4024853384 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c005d70 con 0x7f3440003f30 2024-04-25T10:05:11.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.683+0000 7f345d06b640 1 -- 172.21.15.7:0/4024853384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3440003f30 msgr2=0x7f3440004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.683+0000 7f345d06b640 1 --2- 172.21.15.7:0/4024853384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3440003f30 0x7f3440004800 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f344c00c210 tx=0x7f3440005830 comp rx=0 tx=0).stop 2024-04-25T10:05:11.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.683+0000 7f345759e640 1 -- 172.21.15.7:0/4024853384 reap_dead start 2024-04-25T10:05:11.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.684+0000 7f345d06b640 1 -- 172.21.15.7:0/4024853384 shutdown_connections 2024-04-25T10:05:11.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.684+0000 7f345d06b640 1 -- 172.21.15.7:0/4024853384 >> 172.21.15.7:0/4024853384 conn(0x7f34580726b0 msgr2=0x7f3458072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:11.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.684+0000 7f345d06b640 1 -- 172.21.15.7:0/4024853384 shutdown_connections 2024-04-25T10:05:11.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.684+0000 7f345d06b640 1 -- 172.21.15.7:0/4024853384 wait complete. 2024-04-25T10:05:11.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.685+0000 7f345d06b640 1 Processor -- start 2024-04-25T10:05:11.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.685+0000 7f345d06b640 1 -- start start 2024-04-25T10:05:11.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.686+0000 7f345d06b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3440003f30 0x7f34581e7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.686+0000 7f345d06b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34580c9190 0x7f345815ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.686+0000 7f345d06b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f34580d2260 0x7f34580d26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.686+0000 7f345d06b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34581611b0 con 0x7f34580c9190 2024-04-25T10:05:11.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.686+0000 7f345d06b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34580b8a70 con 0x7f3440003f30 2024-04-25T10:05:11.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.686+0000 7f345d06b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3458161330 con 0x7f34580d2260 2024-04-25T10:05:11.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.686+0000 7f345659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34580c9190 0x7f345815ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.686+0000 7f345659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34580c9190 0x7f345815ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45046/0 (socket says 172.21.15.7:45046) 2024-04-25T10:05:11.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.686+0000 7f345659c640 1 -- 172.21.15.7:0/2110264552 learned_addr learned my addr 172.21.15.7:0/2110264552 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:11.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.686+0000 7f3456d9d640 1 --2- 172.21.15.7:0/2110264552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3440003f30 0x7f34581e7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.686+0000 7f345759e640 1 --2- 172.21.15.7:0/2110264552 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f34580d2260 0x7f34580d26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.686+0000 7f345659c640 1 -- 172.21.15.7:0/2110264552 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f34580d2260 msgr2=0x7f34580d26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.686+0000 7f345659c640 1 --2- 172.21.15.7:0/2110264552 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f34580d2260 0x7f34580d26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.686+0000 7f345659c640 1 -- 172.21.15.7:0/2110264552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3440003f30 msgr2=0x7f34581e7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.686+0000 7f345659c640 1 --2- 172.21.15.7:0/2110264552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3440003f30 0x7f34581e7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.686+0000 7f345659c640 1 -- 172.21.15.7:0/2110264552 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f345815d390 con 0x7f34580c9190 2024-04-25T10:05:11.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.686+0000 7f345659c640 1 --2- 172.21.15.7:0/2110264552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34580c9190 0x7f345815ce50 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f344c00c210 tx=0x7f344c001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:11.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.687+0000 7f343f7fe640 1 -- 172.21.15.7:0/2110264552 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c001c90 con 0x7f34580c9190 2024-04-25T10:05:11.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.687+0000 7f343f7fe640 1 -- 172.21.15.7:0/2110264552 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344c043070 con 0x7f34580c9190 2024-04-25T10:05:11.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.687+0000 7f345d06b640 1 -- 172.21.15.7:0/2110264552 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34580ca180 con 0x7f34580c9190 2024-04-25T10:05:11.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.687+0000 7f343f7fe640 1 -- 172.21.15.7:0/2110264552 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c0074d0 con 0x7f34580c9190 2024-04-25T10:05:11.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.687+0000 7f345d06b640 1 -- 172.21.15.7:0/2110264552 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34580c9bc0 con 0x7f34580c9190 2024-04-25T10:05:11.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.688+0000 7f345d06b640 1 -- 172.21.15.7:0/2110264552 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34580685d0 con 0x7f34580c9190 2024-04-25T10:05:11.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.688+0000 7f343f7fe640 1 -- 172.21.15.7:0/2110264552 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f344c030030 con 0x7f34580c9190 2024-04-25T10:05:11.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.689+0000 7f343f7fe640 1 --2- 172.21.15.7:0/2110264552 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f344406b500 0x7f344406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.689+0000 7f343f7fe640 1 -- 172.21.15.7:0/2110264552 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f344c0aa450 con 0x7f34580c9190 2024-04-25T10:05:11.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.689+0000 7f3456d9d640 1 --2- 172.21.15.7:0/2110264552 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f344406b500 0x7f344406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.689+0000 7f3456d9d640 1 --2- 172.21.15.7:0/2110264552 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f344406b500 0x7f344406d9c0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f3448009bc0 tx=0x7f3448009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:11.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.693+0000 7f343f7fe640 1 -- 172.21.15.7:0/2110264552 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f345815d390 con 0x7f34580c9190 2024-04-25T10:05:11.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:11.911+0000 7f345d06b640 1 -- 172.21.15.7:0/2110264552 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f34580b3340 con 0x7f34580c9190 2024-04-25T10:05:12.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.564+0000 7f343f7fe640 1 -- 172.21.15.7:0/2110264552 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v103) v1 ==== 104+0+0 (secure 0 0 0) 0x7f344c004e20 con 0x7f34580c9190 2024-04-25T10:05:12.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.568+0000 7f345d06b640 1 -- 172.21.15.7:0/2110264552 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f344406b500 msgr2=0x7f344406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:12.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.568+0000 7f345d06b640 1 --2- 172.21.15.7:0/2110264552 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f344406b500 0x7f344406d9c0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f3448009bc0 tx=0x7f3448009190 comp rx=0 tx=0).stop 2024-04-25T10:05:12.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.568+0000 7f345d06b640 1 -- 172.21.15.7:0/2110264552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34580c9190 msgr2=0x7f345815ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:12.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.568+0000 7f345d06b640 1 --2- 172.21.15.7:0/2110264552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34580c9190 0x7f345815ce50 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f344c00c210 tx=0x7f344c001a40 comp rx=0 tx=0).stop 2024-04-25T10:05:12.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.568+0000 7f345d06b640 1 -- 172.21.15.7:0/2110264552 shutdown_connections 2024-04-25T10:05:12.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.568+0000 7f345d06b640 1 --2- 172.21.15.7:0/2110264552 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f344406b500 0x7f344406d9c0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:12.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.568+0000 7f345d06b640 1 --2- 172.21.15.7:0/2110264552 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f34580d2260 0x7f34580d26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:12.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.568+0000 7f345d06b640 1 --2- 172.21.15.7:0/2110264552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34580c9190 0x7f345815ce50 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:12.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.568+0000 7f345d06b640 1 --2- 172.21.15.7:0/2110264552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3440003f30 0x7f34581e7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:12.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.568+0000 7f345d06b640 1 -- 172.21.15.7:0/2110264552 >> 172.21.15.7:0/2110264552 conn(0x7f34580726b0 msgr2=0x7f34580ce280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:12.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.568+0000 7f345d06b640 1 -- 172.21.15.7:0/2110264552 shutdown_connections 2024-04-25T10:05:12.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.568+0000 7f345d06b640 1 -- 172.21.15.7:0/2110264552 wait complete. 2024-04-25T10:05:12.588 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T10:05:12.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.734+0000 7f969b5f4640 1 Processor -- start 2024-04-25T10:05:12.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.735+0000 7f969b5f4640 1 -- start start 2024-04-25T10:05:12.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.735+0000 7f969b5f4640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9694161520 0x7f96940d1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:12.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.736+0000 7f969b5f4640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96940d1f80 0x7f969415e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:12.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.736+0000 7f969b5f4640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9694162450 con 0x7f969415d980 2024-04-25T10:05:12.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.736+0000 7f969b5f4640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9694161bb0 con 0x7f9694161520 2024-04-25T10:05:12.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.736+0000 7f969b5f4640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9694161e90 con 0x7f96940d1f80 2024-04-25T10:05:12.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.736+0000 7f9698b8f640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9694161520 0x7f96940d1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:12.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.736+0000 7f9698b8f640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9694161520 0x7f96940d1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45052/0 (socket says 172.21.15.7:45052) 2024-04-25T10:05:12.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.736+0000 7f9698b8f640 1 -- 172.21.15.7:0/3315289771 learned_addr learned my addr 172.21.15.7:0/3315289771 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:12.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.736+0000 7f9699b91640 1 --2- 172.21.15.7:0/3315289771 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96940d1f80 0x7f969415e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:12.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.736+0000 7f9698b8f640 1 -- 172.21.15.7:0/3315289771 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96940d1f80 msgr2=0x7f969415e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:12.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.736+0000 7f9698b8f640 1 --2- 172.21.15.7:0/3315289771 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96940d1f80 0x7f969415e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:12.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.736+0000 7f9698b8f640 1 -- 172.21.15.7:0/3315289771 >> v1:172.21.15.55:6789/0 conn(0x7f969415d980 legacy=0x7f96940b9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:12.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.736+0000 7f9698b8f640 1 -- 172.21.15.7:0/3315289771 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9694162170 con 0x7f9694161520 2024-04-25T10:05:12.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.737+0000 7f9698b8f640 1 --2- 172.21.15.7:0/3315289771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9694161520 0x7f96940d1a40 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f9684009870 tx=0x7f968402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2765750c4e6c6ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:12.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.737+0000 7f968bfff640 1 -- 172.21.15.7:0/3315289771 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9684037070 con 0x7f9694161520 2024-04-25T10:05:12.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.737+0000 7f968bfff640 1 -- 172.21.15.7:0/3315289771 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9684032440 con 0x7f9694161520 2024-04-25T10:05:12.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.737+0000 7f968bfff640 1 -- 172.21.15.7:0/3315289771 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9684032810 con 0x7f9694161520 2024-04-25T10:05:12.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.737+0000 7f969b5f4640 1 -- 172.21.15.7:0/3315289771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9694161520 msgr2=0x7f96940d1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:12.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.737+0000 7f969b5f4640 1 --2- 172.21.15.7:0/3315289771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9694161520 0x7f96940d1a40 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f9684009870 tx=0x7f968402a210 comp rx=0 tx=0).stop 2024-04-25T10:05:12.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.737+0000 7f969b5f4640 1 -- 172.21.15.7:0/3315289771 shutdown_connections 2024-04-25T10:05:12.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.737+0000 7f969b5f4640 1 --2- 172.21.15.7:0/3315289771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9694161520 0x7f96940d1a40 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:12.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.737+0000 7f969b5f4640 1 --2- 172.21.15.7:0/3315289771 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96940d1f80 0x7f969415e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:12.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.737+0000 7f969b5f4640 1 -- 172.21.15.7:0/3315289771 >> 172.21.15.7:0/3315289771 conn(0x7f969406c3d0 msgr2=0x7f969406c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:12.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.738+0000 7f969b5f4640 1 -- 172.21.15.7:0/3315289771 shutdown_connections 2024-04-25T10:05:12.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.738+0000 7f969b5f4640 1 -- 172.21.15.7:0/3315289771 wait complete. 2024-04-25T10:05:12.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.739+0000 7f969b5f4640 1 Processor -- start 2024-04-25T10:05:12.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.739+0000 7f969b5f4640 1 -- start start 2024-04-25T10:05:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.739+0000 7f969b5f4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96940d1f80 0x7f9694151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.739+0000 7f969b5f4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f969415d980 0x7f969414c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.740+0000 7f969b5f4640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9694161520 0x7f9694150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.740+0000 7f969b5f4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969415eb30 con 0x7f969415d980 2024-04-25T10:05:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.740+0000 7f969b5f4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969415dd60 con 0x7f96940d1f80 2024-04-25T10:05:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.740+0000 7f969b5f4640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969415ecb0 con 0x7f9694161520 2024-04-25T10:05:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.740+0000 7f9698b8f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f969415d980 0x7f969414c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.740+0000 7f9698b8f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f969415d980 0x7f969414c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45064/0 (socket says 172.21.15.7:45064) 2024-04-25T10:05:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.740+0000 7f9698b8f640 1 -- 172.21.15.7:0/686200407 learned_addr learned my addr 172.21.15.7:0/686200407 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.740+0000 7f9698b8f640 1 -- 172.21.15.7:0/686200407 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9694161520 msgr2=0x7f9694150110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.740+0000 7f9698b8f640 1 --2- 172.21.15.7:0/686200407 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9694161520 0x7f9694150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.740+0000 7f9698b8f640 1 -- 172.21.15.7:0/686200407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96940d1f80 msgr2=0x7f9694151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.740+0000 7f9699390640 1 --2- 172.21.15.7:0/686200407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96940d1f80 0x7f9694151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.740+0000 7f9698b8f640 1 --2- 172.21.15.7:0/686200407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96940d1f80 0x7f9694151ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.740+0000 7f9698b8f640 1 -- 172.21.15.7:0/686200407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969414c540 con 0x7f969415d980 2024-04-25T10:05:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.740+0000 7f9698b8f640 1 --2- 172.21.15.7:0/686200407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f969415d980 0x7f969414c000 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f96840090b0 tx=0x7f96840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.740+0000 7f9689ffb640 1 -- 172.21.15.7:0/686200407 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9684037040 con 0x7f969415d980 2024-04-25T10:05:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.740+0000 7f9689ffb640 1 -- 172.21.15.7:0/686200407 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9684042070 con 0x7f969415d980 2024-04-25T10:05:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.740+0000 7f969b5f4640 1 -- 172.21.15.7:0/686200407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9694150a40 con 0x7f969415d980 2024-04-25T10:05:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.740+0000 7f9689ffb640 1 -- 172.21.15.7:0/686200407 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9684030bd0 con 0x7f969415d980 2024-04-25T10:05:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.741+0000 7f969b5f4640 1 -- 172.21.15.7:0/686200407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9694151000 con 0x7f969415d980 2024-04-25T10:05:12.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.742+0000 7f969b5f4640 1 -- 172.21.15.7:0/686200407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9694069040 con 0x7f969415d980 2024-04-25T10:05:12.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.742+0000 7f9689ffb640 1 -- 172.21.15.7:0/686200407 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9684047460 con 0x7f969415d980 2024-04-25T10:05:12.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.743+0000 7f9689ffb640 1 --2- 172.21.15.7:0/686200407 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f967806b4d0 0x7f967806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:12.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.743+0000 7f9699390640 1 --2- 172.21.15.7:0/686200407 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f967806b4d0 0x7f967806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:12.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.743+0000 7f9689ffb640 1 -- 172.21.15.7:0/686200407 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f96840ab130 con 0x7f969415d980 2024-04-25T10:05:12.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.743+0000 7f9699390640 1 --2- 172.21.15.7:0/686200407 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f967806b4d0 0x7f967806d990 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f9690003d90 tx=0x7f9690009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:12.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.747+0000 7f9689ffb640 1 -- 172.21.15.7:0/686200407 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9684045360 con 0x7f969415d980 2024-04-25T10:05:12.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:12.931+0000 7f969b5f4640 1 -- 172.21.15.7:0/686200407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9694155ef0 con 0x7f969415d980 2024-04-25T10:05:13.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.618+0000 7f9689ffb640 1 -- 172.21.15.7:0/686200407 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v121) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9684079d20 con 0x7f969415d980 2024-04-25T10:05:13.623 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2024-04-25T10:05:13.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.621+0000 7f969b5f4640 1 -- 172.21.15.7:0/686200407 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f967806b4d0 msgr2=0x7f967806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:13.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.621+0000 7f969b5f4640 1 --2- 172.21.15.7:0/686200407 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f967806b4d0 0x7f967806d990 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f9690003d90 tx=0x7f9690009040 comp rx=0 tx=0).stop 2024-04-25T10:05:13.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.621+0000 7f969b5f4640 1 -- 172.21.15.7:0/686200407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f969415d980 msgr2=0x7f969414c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:13.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.621+0000 7f969b5f4640 1 --2- 172.21.15.7:0/686200407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f969415d980 0x7f969414c000 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f96840090b0 tx=0x7f96840046c0 comp rx=0 tx=0).stop 2024-04-25T10:05:13.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.621+0000 7f969b5f4640 1 -- 172.21.15.7:0/686200407 shutdown_connections 2024-04-25T10:05:13.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.621+0000 7f969b5f4640 1 --2- 172.21.15.7:0/686200407 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f967806b4d0 0x7f967806d990 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:13.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.621+0000 7f969b5f4640 1 --2- 172.21.15.7:0/686200407 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9694161520 0x7f9694150110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:13.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.621+0000 7f969b5f4640 1 --2- 172.21.15.7:0/686200407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f969415d980 0x7f969414c000 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:13.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.621+0000 7f969b5f4640 1 --2- 172.21.15.7:0/686200407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96940d1f80 0x7f9694151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:13.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.621+0000 7f969b5f4640 1 -- 172.21.15.7:0/686200407 >> 172.21.15.7:0/686200407 conn(0x7f969406c3d0 msgr2=0x7f96940d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:13.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.623+0000 7f969b5f4640 1 -- 172.21.15.7:0/686200407 shutdown_connections 2024-04-25T10:05:13.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.623+0000 7f969b5f4640 1 -- 172.21.15.7:0/686200407 wait complete. 2024-04-25T10:05:13.643 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T10:05:13.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.753+0000 7f89fd1fe640 1 Processor -- start 2024-04-25T10:05:13.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.753+0000 7f89fd1fe640 1 -- start start 2024-04-25T10:05:13.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.754+0000 7f89fd1fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89f815dba0 0x7f89f80ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:13.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.754+0000 7f89fd1fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f89f80cd460 0x7f89f80999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:13.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.754+0000 7f89fd1fe640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f80cd9a0 con 0x7f89f8099f30 2024-04-25T10:05:13.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.754+0000 7f89fd1fe640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f806c180 con 0x7f89f80cd460 2024-04-25T10:05:13.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.754+0000 7f89fd1fe640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f80cdc80 con 0x7f89f815dba0 2024-04-25T10:05:13.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.754+0000 7f89effff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f89f80cd460 0x7f89f80999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:13.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.754+0000 7f89effff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f89f80cd460 0x7f89f80999f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45078/0 (socket says 172.21.15.7:45078) 2024-04-25T10:05:13.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.754+0000 7f89effff640 1 -- 172.21.15.7:0/2785339436 learned_addr learned my addr 172.21.15.7:0/2785339436 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:13.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.754+0000 7f89effff640 1 -- 172.21.15.7:0/2785339436 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89f815dba0 msgr2=0x7f89f80ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:13.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.754+0000 7f89effff640 1 --2- 172.21.15.7:0/2785339436 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89f815dba0 0x7f89f80ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:13.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.754+0000 7f89effff640 1 -- 172.21.15.7:0/2785339436 >> v1:172.21.15.55:6789/0 conn(0x7f89f8099f30 legacy=0x7f89f80cfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:13.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.754+0000 7f89effff640 1 -- 172.21.15.7:0/2785339436 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f806be10 con 0x7f89f80cd460 2024-04-25T10:05:13.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.755+0000 7f89effff640 1 --2- 172.21.15.7:0/2785339436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89f80cd460 0x7f89f80999f0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f89e0009870 tx=0x7f89e002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386d709bd0431e46 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:13.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.755+0000 7f89f659c640 1 -- 172.21.15.7:0/2785339436 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e0037070 con 0x7f89f80cd460 2024-04-25T10:05:13.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.755+0000 7f89f659c640 1 -- 172.21.15.7:0/2785339436 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e0032440 con 0x7f89f80cd460 2024-04-25T10:05:13.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.755+0000 7f89f659c640 1 -- 172.21.15.7:0/2785339436 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e0032810 con 0x7f89f80cd460 2024-04-25T10:05:13.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.755+0000 7f89fd1fe640 1 -- 172.21.15.7:0/2785339436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89f80cd460 msgr2=0x7f89f80999f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:13.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.755+0000 7f89fd1fe640 1 --2- 172.21.15.7:0/2785339436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89f80cd460 0x7f89f80999f0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f89e0009870 tx=0x7f89e002a210 comp rx=0 tx=0).stop 2024-04-25T10:05:13.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.756+0000 7f89fd1fe640 1 -- 172.21.15.7:0/2785339436 shutdown_connections 2024-04-25T10:05:13.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.756+0000 7f89fd1fe640 1 --2- 172.21.15.7:0/2785339436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89f80cd460 0x7f89f80999f0 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:13.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.756+0000 7f89fd1fe640 1 --2- 172.21.15.7:0/2785339436 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89f815dba0 0x7f89f80ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:13.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.756+0000 7f89fd1fe640 1 -- 172.21.15.7:0/2785339436 >> 172.21.15.7:0/2785339436 conn(0x7f89f80b3130 msgr2=0x7f89f80b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:13.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.756+0000 7f89fd1fe640 1 -- 172.21.15.7:0/2785339436 shutdown_connections 2024-04-25T10:05:13.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.756+0000 7f89fd1fe640 1 -- 172.21.15.7:0/2785339436 wait complete. 2024-04-25T10:05:13.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.757+0000 7f89fd1fe640 1 Processor -- start 2024-04-25T10:05:13.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.757+0000 7f89fd1fe640 1 -- start start 2024-04-25T10:05:13.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.758+0000 7f89fd1fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89f8099f30 0x7f89f81e6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:13.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.758+0000 7f89fd1fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89f80cd460 0x7f89f80c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:13.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.758+0000 7f89fd1fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89f815dba0 0x7f89f81e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:13.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.758+0000 7f89fd1fe640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f806d7a0 con 0x7f89f8099f30 2024-04-25T10:05:13.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.758+0000 7f89fd1fe640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f806d620 con 0x7f89f815dba0 2024-04-25T10:05:13.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.758+0000 7f89fd1fe640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f806d920 con 0x7f89f80cd460 2024-04-25T10:05:13.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.758+0000 7f89f6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89f8099f30 0x7f89f81e6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:13.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.758+0000 7f89f6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89f8099f30 0x7f89f81e6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45094/0 (socket says 172.21.15.7:45094) 2024-04-25T10:05:13.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.758+0000 7f89f6d9d640 1 -- 172.21.15.7:0/822137540 learned_addr learned my addr 172.21.15.7:0/822137540 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:13.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.758+0000 7f89effff640 1 --2- 172.21.15.7:0/822137540 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89f80cd460 0x7f89f80c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:13.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.758+0000 7f89f759e640 1 --2- 172.21.15.7:0/822137540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89f815dba0 0x7f89f81e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:13.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.758+0000 7f89f6d9d640 1 -- 172.21.15.7:0/822137540 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89f80cd460 msgr2=0x7f89f80c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:13.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.758+0000 7f89f6d9d640 1 --2- 172.21.15.7:0/822137540 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89f80cd460 0x7f89f80c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:13.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.758+0000 7f89f6d9d640 1 -- 172.21.15.7:0/822137540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89f815dba0 msgr2=0x7f89f81e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:13.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.758+0000 7f89f6d9d640 1 --2- 172.21.15.7:0/822137540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89f815dba0 0x7f89f81e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:13.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.758+0000 7f89f6d9d640 1 -- 172.21.15.7:0/822137540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f80c5670 con 0x7f89f8099f30 2024-04-25T10:05:13.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.758+0000 7f89f759e640 1 --2- 172.21.15.7:0/822137540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89f815dba0 0x7f89f81e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:13.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.758+0000 7f89f6d9d640 1 --2- 172.21.15.7:0/822137540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89f8099f30 0x7f89f81e6e20 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f89e800b4a0 tx=0x7f89e800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:13.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.759+0000 7f89ef7fe640 1 -- 172.21.15.7:0/822137540 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e8014070 con 0x7f89f8099f30 2024-04-25T10:05:13.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.759+0000 7f89ef7fe640 1 -- 172.21.15.7:0/822137540 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e8010610 con 0x7f89f8099f30 2024-04-25T10:05:13.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.759+0000 7f89fd1fe640 1 -- 172.21.15.7:0/822137540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f80c5950 con 0x7f89f8099f30 2024-04-25T10:05:13.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.759+0000 7f89ef7fe640 1 -- 172.21.15.7:0/822137540 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e8010a00 con 0x7f89f8099f30 2024-04-25T10:05:13.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.759+0000 7f89fd1fe640 1 -- 172.21.15.7:0/822137540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f80c5f10 con 0x7f89f8099f30 2024-04-25T10:05:13.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.760+0000 7f89fd1fe640 1 -- 172.21.15.7:0/822137540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f8069040 con 0x7f89f8099f30 2024-04-25T10:05:13.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.760+0000 7f89ef7fe640 1 -- 172.21.15.7:0/822137540 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f89e8017070 con 0x7f89f8099f30 2024-04-25T10:05:13.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.760+0000 7f89ef7fe640 1 --2- 172.21.15.7:0/822137540 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f89d806b500 0x7f89d806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:13.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.761+0000 7f89ef7fe640 1 -- 172.21.15.7:0/822137540 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5921+0+0 (secure 0 0 0) 0x7f89e8089c80 con 0x7f89f8099f30 2024-04-25T10:05:13.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.761+0000 7f89effff640 1 --2- 172.21.15.7:0/822137540 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f89d806b500 0x7f89d806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:13.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.761+0000 7f89effff640 1 --2- 172.21.15.7:0/822137540 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f89d806b500 0x7f89d806d9c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f89e0034000 tx=0x7f89e002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:13.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.765+0000 7f89ef7fe640 1 -- 172.21.15.7:0/822137540 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f89e80583e0 con 0x7f89f8099f30 2024-04-25T10:05:13.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:13.946+0000 7f89fd1fe640 1 -- 172.21.15.7:0/822137540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f89f809a870 con 0x7f89f8099f30 2024-04-25T10:05:14.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.630+0000 7f89ef7fe640 1 -- 172.21.15.7:0/822137540 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v122) v1 ==== 169+0+0 (secure 0 0 0) 0x7f89e805c480 con 0x7f89f8099f30 2024-04-25T10:05:14.636 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2024-04-25T10:05:14.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.634+0000 7f89fd1fe640 1 -- 172.21.15.7:0/822137540 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f89d806b500 msgr2=0x7f89d806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:14.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.634+0000 7f89fd1fe640 1 --2- 172.21.15.7:0/822137540 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f89d806b500 0x7f89d806d9c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f89e0034000 tx=0x7f89e002e000 comp rx=0 tx=0).stop 2024-04-25T10:05:14.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.634+0000 7f89fd1fe640 1 -- 172.21.15.7:0/822137540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89f8099f30 msgr2=0x7f89f81e6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:14.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.634+0000 7f89fd1fe640 1 --2- 172.21.15.7:0/822137540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89f8099f30 0x7f89f81e6e20 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f89e800b4a0 tx=0x7f89e800b960 comp rx=0 tx=0).stop 2024-04-25T10:05:14.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.634+0000 7f89fd1fe640 1 -- 172.21.15.7:0/822137540 shutdown_connections 2024-04-25T10:05:14.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.634+0000 7f89fd1fe640 1 --2- 172.21.15.7:0/822137540 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f89d806b500 0x7f89d806d9c0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.634+0000 7f89fd1fe640 1 --2- 172.21.15.7:0/822137540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89f815dba0 0x7f89f81e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.634+0000 7f89fd1fe640 1 --2- 172.21.15.7:0/822137540 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89f80cd460 0x7f89f80c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.634+0000 7f89fd1fe640 1 --2- 172.21.15.7:0/822137540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89f8099f30 0x7f89f81e6e20 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.634+0000 7f89fd1fe640 1 -- 172.21.15.7:0/822137540 >> 172.21.15.7:0/822137540 conn(0x7f89f80b3130 msgr2=0x7f89f80cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:14.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.634+0000 7f89fd1fe640 1 -- 172.21.15.7:0/822137540 shutdown_connections 2024-04-25T10:05:14.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.635+0000 7f89fd1fe640 1 -- 172.21.15.7:0/822137540 wait complete. 2024-04-25T10:05:14.655 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T10:05:14.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.759+0000 7fb9164ac640 1 Processor -- start 2024-04-25T10:05:14.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.759+0000 7fb9164ac640 1 -- start start 2024-04-25T10:05:14.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.760+0000 7fb9164ac640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb910161200 0x7fb9100cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:14.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.760+0000 7fb9164ac640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9101615e0 con 0x7fb91009a9a0 2024-04-25T10:05:14.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.760+0000 7fb9164ac640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb91009add0 con 0x7fb9100d0a00 2024-04-25T10:05:14.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.760+0000 7fb9164ac640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb91006c9f0 con 0x7fb910161200 2024-04-25T10:05:14.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.760+0000 7fb90ffff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb910161200 0x7fb9100cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:14.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.760+0000 7fb914a49640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb91009a9a0 0x7fb9100cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45948/0 (socket says 172.21.15.7:45948) 2024-04-25T10:05:14.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.760+0000 7fb914a49640 1 -- 172.21.15.7:0/4289828992 learned_addr learned my addr 172.21.15.7:0/4289828992 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:05:14.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.760+0000 7fb90ffff640 1 -- 172.21.15.7:0/4289828992 >> v1:172.21.15.55:6789/0 conn(0x7fb9100d0a00 legacy=0x7fb91009a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:14.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.760+0000 7fb90ffff640 1 -- 172.21.15.7:0/4289828992 >> v1:172.21.15.7:6789/0 conn(0x7fb91009a9a0 legacy=0x7fb9100cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:14.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.760+0000 7fb90ffff640 1 -- 172.21.15.7:0/4289828992 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91006ccd0 con 0x7fb910161200 2024-04-25T10:05:14.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.760+0000 7fb90effd640 1 -- 172.21.15.7:0/4289828992 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1314671892 0 0) 0x7fb908001490 con 0x7fb91009a9a0 2024-04-25T10:05:14.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.761+0000 7fb90ffff640 1 --2- 172.21.15.7:0/4289828992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb910161200 0x7fb9100cbd00 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7fb9040097a0 tx=0x7fb90402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e04167964aed6b86 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:14.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.761+0000 7fb90effd640 1 -- 172.21.15.7:0/4289828992 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb904037070 con 0x7fb910161200 2024-04-25T10:05:14.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.761+0000 7fb90effd640 1 -- 172.21.15.7:0/4289828992 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb904032440 con 0x7fb910161200 2024-04-25T10:05:14.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.761+0000 7fb90effd640 1 -- 172.21.15.7:0/4289828992 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb904032810 con 0x7fb910161200 2024-04-25T10:05:14.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.762+0000 7fb9164ac640 1 -- 172.21.15.7:0/4289828992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb910161200 msgr2=0x7fb9100cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:14.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.762+0000 7fb9164ac640 1 --2- 172.21.15.7:0/4289828992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb910161200 0x7fb9100cbd00 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7fb9040097a0 tx=0x7fb90402a1e0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.762+0000 7fb9164ac640 1 -- 172.21.15.7:0/4289828992 shutdown_connections 2024-04-25T10:05:14.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.762+0000 7fb9164ac640 1 --2- 172.21.15.7:0/4289828992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb910161200 0x7fb9100cbd00 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.762+0000 7fb9164ac640 1 -- 172.21.15.7:0/4289828992 >> 172.21.15.7:0/4289828992 conn(0x7fb9100b31a0 msgr2=0x7fb9100b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:14.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.762+0000 7fb9164ac640 1 -- 172.21.15.7:0/4289828992 shutdown_connections 2024-04-25T10:05:14.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.762+0000 7fb9164ac640 1 -- 172.21.15.7:0/4289828992 wait complete. 2024-04-25T10:05:14.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.763+0000 7fb9164ac640 1 Processor -- start 2024-04-25T10:05:14.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.763+0000 7fb9164ac640 1 -- start start 2024-04-25T10:05:14.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.764+0000 7fb9164ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb91009a9a0 0x7fb9100c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:14.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.764+0000 7fb9164ac640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb9100d0a00 0x7fb9100c51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:14.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.764+0000 7fb9164ac640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb910161200 0x7fb9100b66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:14.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.764+0000 7fb9164ac640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9100cc240 con 0x7fb910161200 2024-04-25T10:05:14.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.764+0000 7fb9164ac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb910099d70 con 0x7fb91009a9a0 2024-04-25T10:05:14.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.764+0000 7fb9164ac640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91006c680 con 0x7fb9100d0a00 2024-04-25T10:05:14.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.764+0000 7fb914a49640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb910161200 0x7fb9100b66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:14.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.764+0000 7fb914a49640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb910161200 0x7fb9100b66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45102/0 (socket says 172.21.15.7:45102) 2024-04-25T10:05:14.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.764+0000 7fb914a49640 1 -- 172.21.15.7:0/2899309244 learned_addr learned my addr 172.21.15.7:0/2899309244 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:14.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.764+0000 7fb90ffff640 1 --2- 172.21.15.7:0/2899309244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb91009a9a0 0x7fb9100c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:14.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.764+0000 7fb914a49640 1 -- 172.21.15.7:0/2899309244 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb9100d0a00 msgr2=0x7fb9100c51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:14.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.764+0000 7fb90f7fe640 1 --2- 172.21.15.7:0/2899309244 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb9100d0a00 0x7fb9100c51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:14.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.764+0000 7fb914a49640 1 --2- 172.21.15.7:0/2899309244 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb9100d0a00 0x7fb9100c51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.764+0000 7fb914a49640 1 -- 172.21.15.7:0/2899309244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb91009a9a0 msgr2=0x7fb9100c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:14.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.764+0000 7fb914a49640 1 --2- 172.21.15.7:0/2899309244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb91009a9a0 0x7fb9100c77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.764+0000 7fb914a49640 1 -- 172.21.15.7:0/2899309244 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9100c7e90 con 0x7fb910161200 2024-04-25T10:05:14.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.765+0000 7fb914a49640 1 --2- 172.21.15.7:0/2899309244 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb910161200 0x7fb9100b66b0 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7fb90800c730 tx=0x7fb90800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:14.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.765+0000 7fb90cff9640 1 -- 172.21.15.7:0/2899309244 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb908018070 con 0x7fb910161200 2024-04-25T10:05:14.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.765+0000 7fb90cff9640 1 -- 172.21.15.7:0/2899309244 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90800ce40 con 0x7fb910161200 2024-04-25T10:05:14.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.765+0000 7fb9164ac640 1 -- 172.21.15.7:0/2899309244 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9100c8170 con 0x7fb910161200 2024-04-25T10:05:14.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.765+0000 7fb90cff9640 1 -- 172.21.15.7:0/2899309244 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90800a800 con 0x7fb910161200 2024-04-25T10:05:14.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.765+0000 7fb9164ac640 1 -- 172.21.15.7:0/2899309244 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb91014da80 con 0x7fb910161200 2024-04-25T10:05:14.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.766+0000 7fb9164ac640 1 -- 172.21.15.7:0/2899309244 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb910068f60 con 0x7fb910161200 2024-04-25T10:05:14.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.766+0000 7fb90cff9640 1 -- 172.21.15.7:0/2899309244 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb90801b070 con 0x7fb910161200 2024-04-25T10:05:14.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.767+0000 7fb90cff9640 1 --2- 172.21.15.7:0/2899309244 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb8fc06b4d0 0x7fb8fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:14.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.767+0000 7fb90cff9640 1 -- 172.21.15.7:0/2899309244 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fb908089620 con 0x7fb910161200 2024-04-25T10:05:14.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.767+0000 7fb90ffff640 1 --2- 172.21.15.7:0/2899309244 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb8fc06b4d0 0x7fb8fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:14.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.767+0000 7fb90ffff640 1 --2- 172.21.15.7:0/2899309244 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb8fc06b4d0 0x7fb8fc06d990 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb904034000 tx=0x7fb90402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:14.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.771+0000 7fb90cff9640 1 -- 172.21.15.7:0/2899309244 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb9101615e0 con 0x7fb910161200 2024-04-25T10:05:14.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.951+0000 7fb9164ac640 1 -- 172.21.15.7:0/2899309244 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb9100c8340 con 0x7fb910161200 2024-04-25T10:05:14.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.954+0000 7fb90cff9640 1 -- 172.21.15.7:0/2899309244 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb908058560 con 0x7fb910161200 2024-04-25T10:05:14.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.956+0000 7fb9164ac640 1 -- 172.21.15.7:0/2899309244 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb8fc06b4d0 msgr2=0x7fb8fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:14.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.956+0000 7fb9164ac640 1 --2- 172.21.15.7:0/2899309244 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb8fc06b4d0 0x7fb8fc06d990 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb904034000 tx=0x7fb90402e000 comp rx=0 tx=0).stop 2024-04-25T10:05:14.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.956+0000 7fb9164ac640 1 -- 172.21.15.7:0/2899309244 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb910161200 msgr2=0x7fb9100b66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:14.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.956+0000 7fb9164ac640 1 --2- 172.21.15.7:0/2899309244 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb910161200 0x7fb9100b66b0 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7fb90800c730 tx=0x7fb90800cbf0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.956+0000 7fb9164ac640 1 -- 172.21.15.7:0/2899309244 shutdown_connections 2024-04-25T10:05:14.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.956+0000 7fb9164ac640 1 --2- 172.21.15.7:0/2899309244 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb8fc06b4d0 0x7fb8fc06d990 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.956+0000 7fb9164ac640 1 --2- 172.21.15.7:0/2899309244 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb910161200 0x7fb9100b66b0 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.956+0000 7fb9164ac640 1 --2- 172.21.15.7:0/2899309244 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb9100d0a00 0x7fb9100c51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.956+0000 7fb9164ac640 1 --2- 172.21.15.7:0/2899309244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb91009a9a0 0x7fb9100c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.956+0000 7fb9164ac640 1 -- 172.21.15.7:0/2899309244 >> 172.21.15.7:0/2899309244 conn(0x7fb9100b31a0 msgr2=0x7fb9100cd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:14.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.956+0000 7fb9164ac640 1 -- 172.21.15.7:0/2899309244 shutdown_connections 2024-04-25T10:05:14.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:14.956+0000 7fb9164ac640 1 -- 172.21.15.7:0/2899309244 wait complete. 2024-04-25T10:05:14.972 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan' 2024-04-25T10:05:15.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.067+0000 7fbdd166f640 1 Processor -- start 2024-04-25T10:05:15.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.068+0000 7fbdd166f640 1 -- start start 2024-04-25T10:05:15.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.068+0000 7fbdd166f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbdcc0b3d30 0x7fbdcc0b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:15.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.068+0000 7fbdd166f640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdcc0b4d70 con 0x7fbdcc0b4960 2024-04-25T10:05:15.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.068+0000 7fbdd166f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdcc0b2c90 con 0x7fbdcc1474f0 2024-04-25T10:05:15.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.068+0000 7fbdd166f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdcc0b2a40 con 0x7fbdcc0b3d30 2024-04-25T10:05:15.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.069+0000 7fbdcb7fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbdcc0b4960 0x7fbdcc06d620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45952/0 (socket says 172.21.15.7:45952) 2024-04-25T10:05:15.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.069+0000 7fbdcb7fe640 1 -- 172.21.15.7:0/1873840649 learned_addr learned my addr 172.21.15.7:0/1873840649 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:05:15.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.069+0000 7fbdca7fc640 1 --2- 172.21.15.7:0/1873840649 >> v2:172.21.15.55:3300/0 conn(0x7fbdcc0b3d30 0x7fbdcc0b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:15.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.069+0000 7fbdc9ffb640 1 -- 172.21.15.7:0/1873840649 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3209790211 0 0) 0x7fbdcc0b4d70 con 0x7fbdcc0b4960 2024-04-25T10:05:15.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.069+0000 7fbdc9ffb640 1 -- 172.21.15.7:0/1873840649 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdb4003520 con 0x7fbdcc0b4960 2024-04-25T10:05:15.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.069+0000 7fbdca7fc640 1 -- 172.21.15.7:0/1873840649 >> v1:172.21.15.55:6789/0 conn(0x7fbdcc1474f0 legacy=0x7fbdcc0ae820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:15.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.069+0000 7fbdca7fc640 1 -- 172.21.15.7:0/1873840649 >> v1:172.21.15.7:6789/0 conn(0x7fbdcc0b4960 legacy=0x7fbdcc06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:15.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.069+0000 7fbdc9ffb640 1 -- 172.21.15.7:0/1873840649 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 620697518 0 0) 0x7fbdb4003520 con 0x7fbdcc0b4960 2024-04-25T10:05:15.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.069+0000 7fbdca7fc640 1 -- 172.21.15.7:0/1873840649 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdcc0b2f70 con 0x7fbdcc0b3d30 2024-04-25T10:05:15.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.070+0000 7fbdca7fc640 1 --2- 172.21.15.7:0/1873840649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdcc0b3d30 0x7fbdcc0b4420 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fbdc00097a0 tx=0x7fbdc002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f73415e09c440419 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:15.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.070+0000 7fbdc9ffb640 1 -- 172.21.15.7:0/1873840649 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0037070 con 0x7fbdcc0b3d30 2024-04-25T10:05:15.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.070+0000 7fbdc9ffb640 1 -- 172.21.15.7:0/1873840649 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc002ac50 con 0x7fbdcc0b3d30 2024-04-25T10:05:15.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.070+0000 7fbdc9ffb640 1 -- 172.21.15.7:0/1873840649 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc40019f0 con 0x7fbdcc0b3d30 2024-04-25T10:05:15.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.071+0000 7fbdd166f640 1 -- 172.21.15.7:0/1873840649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdcc0b3d30 msgr2=0x7fbdcc0b4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:15.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.071+0000 7fbdd166f640 1 --2- 172.21.15.7:0/1873840649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdcc0b3d30 0x7fbdcc0b4420 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fbdc00097a0 tx=0x7fbdc002a1c0 comp rx=0 tx=0).stop 2024-04-25T10:05:15.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.071+0000 7fbdd166f640 1 -- 172.21.15.7:0/1873840649 shutdown_connections 2024-04-25T10:05:15.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.071+0000 7fbdd166f640 1 --2- 172.21.15.7:0/1873840649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdcc0b3d30 0x7fbdcc0b4420 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:15.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.071+0000 7fbdd166f640 1 -- 172.21.15.7:0/1873840649 >> 172.21.15.7:0/1873840649 conn(0x7fbdcc0b1740 msgr2=0x7fbdcc0b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:15.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.071+0000 7fbdd166f640 1 -- 172.21.15.7:0/1873840649 shutdown_connections 2024-04-25T10:05:15.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.071+0000 7fbdd166f640 1 -- 172.21.15.7:0/1873840649 wait complete. 2024-04-25T10:05:15.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.072+0000 7fbdd166f640 1 Processor -- start 2024-04-25T10:05:15.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.072+0000 7fbdd166f640 1 -- start start 2024-04-25T10:05:15.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.073+0000 7fbdd166f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdcc0b3d30 0x7fbdcc1434d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:15.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.073+0000 7fbdd166f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdcc0b4960 0x7fbdcc146170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:15.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.073+0000 7fbdd166f640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbdcc1474f0 0x7fbdcc13c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:15.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.073+0000 7fbdd166f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc0b3530 con 0x7fbdcc0b4960 2024-04-25T10:05:15.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.073+0000 7fbdd166f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc0b38a0 con 0x7fbdcc0b3d30 2024-04-25T10:05:15.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.073+0000 7fbdd166f640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc0aef30 con 0x7fbdcc1474f0 2024-04-25T10:05:15.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.073+0000 7fbdca7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdcc0b4960 0x7fbdcc146170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:15.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.073+0000 7fbdca7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdcc0b4960 0x7fbdcc146170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45104/0 (socket says 172.21.15.7:45104) 2024-04-25T10:05:15.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.073+0000 7fbdca7fc640 1 -- 172.21.15.7:0/87097466 learned_addr learned my addr 172.21.15.7:0/87097466 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:15.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.073+0000 7fbdcb7fe640 1 --2- 172.21.15.7:0/87097466 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbdcc1474f0 0x7fbdcc13c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:15.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.073+0000 7fbdcaffd640 1 --2- 172.21.15.7:0/87097466 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdcc0b3d30 0x7fbdcc1434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:15.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.073+0000 7fbdca7fc640 1 -- 172.21.15.7:0/87097466 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbdcc1474f0 msgr2=0x7fbdcc13c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:15.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.073+0000 7fbdca7fc640 1 --2- 172.21.15.7:0/87097466 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbdcc1474f0 0x7fbdcc13c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:15.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.073+0000 7fbdca7fc640 1 -- 172.21.15.7:0/87097466 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdcc0b3d30 msgr2=0x7fbdcc1434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:15.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.073+0000 7fbdca7fc640 1 --2- 172.21.15.7:0/87097466 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdcc0b3d30 0x7fbdcc1434d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:15.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.073+0000 7fbdca7fc640 1 -- 172.21.15.7:0/87097466 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdcc143bb0 con 0x7fbdcc0b4960 2024-04-25T10:05:15.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.073+0000 7fbdcb7fe640 1 --2- 172.21.15.7:0/87097466 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbdcc1474f0 0x7fbdcc13c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:15.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.073+0000 7fbdcaffd640 1 --2- 172.21.15.7:0/87097466 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdcc0b3d30 0x7fbdcc1434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:15.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.073+0000 7fbdca7fc640 1 --2- 172.21.15.7:0/87097466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdcc0b4960 0x7fbdcc146170 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0035040 tx=0x7fbdc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:15.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.074+0000 7fbdb37fe640 1 -- 172.21.15.7:0/87097466 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0041070 con 0x7fbdcc0b4960 2024-04-25T10:05:15.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.074+0000 7fbdb37fe640 1 -- 172.21.15.7:0/87097466 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc003c460 con 0x7fbdcc0b4960 2024-04-25T10:05:15.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.074+0000 7fbdd166f640 1 -- 172.21.15.7:0/87097466 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdcc143e90 con 0x7fbdcc0b4960 2024-04-25T10:05:15.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.074+0000 7fbdb37fe640 1 -- 172.21.15.7:0/87097466 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0037040 con 0x7fbdcc0b4960 2024-04-25T10:05:15.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.074+0000 7fbdd166f640 1 -- 172.21.15.7:0/87097466 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdcc144450 con 0x7fbdcc0b4960 2024-04-25T10:05:15.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.075+0000 7fbdd166f640 1 -- 172.21.15.7:0/87097466 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdcc068fd0 con 0x7fbdcc0b4960 2024-04-25T10:05:15.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.075+0000 7fbdb37fe640 1 -- 172.21.15.7:0/87097466 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbdc0044070 con 0x7fbdcc0b4960 2024-04-25T10:05:15.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.076+0000 7fbdb37fe640 1 --2- 172.21.15.7:0/87097466 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbdb806b4d0 0x7fbdb806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:15.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.076+0000 7fbdcaffd640 1 --2- 172.21.15.7:0/87097466 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbdb806b4d0 0x7fbdb806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:15.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.076+0000 7fbdb37fe640 1 -- 172.21.15.7:0/87097466 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fbdc00aa7a0 con 0x7fbdcc0b4960 2024-04-25T10:05:15.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.076+0000 7fbdcaffd640 1 --2- 172.21.15.7:0/87097466 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbdb806b4d0 0x7fbdb806d990 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc1f6f00 tx=0x7fbdbc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:15.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.080+0000 7fbdb37fe640 1 -- 172.21.15.7:0/87097466 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbdc00796e0 con 0x7fbdcc0b4960 2024-04-25T10:05:15.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.336+0000 7fbdd166f640 1 -- 172.21.15.7:0/87097466 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]} v 0) v1 -- 0x7fbdcc0af2b0 con 0x7fbdcc0b4960 2024-04-25T10:05:15.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.631+0000 7fbdb37fe640 1 -- 172.21.15.7:0/87097466 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]}]=0 v515) v1 ==== 144+0+0 (secure 0 0 0) 0x7fbdc00aa070 con 0x7fbdcc0b4960 2024-04-25T10:05:15.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.634+0000 7fbdd166f640 1 -- 172.21.15.7:0/87097466 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbdb806b4d0 msgr2=0x7fbdb806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:15.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.634+0000 7fbdd166f640 1 --2- 172.21.15.7:0/87097466 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbdb806b4d0 0x7fbdb806d990 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc1f6f00 tx=0x7fbdbc009040 comp rx=0 tx=0).stop 2024-04-25T10:05:15.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.634+0000 7fbdd166f640 1 -- 172.21.15.7:0/87097466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdcc0b4960 msgr2=0x7fbdcc146170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:15.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.634+0000 7fbdd166f640 1 --2- 172.21.15.7:0/87097466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdcc0b4960 0x7fbdcc146170 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0035040 tx=0x7fbdc00046c0 comp rx=0 tx=0).stop 2024-04-25T10:05:15.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.634+0000 7fbdd166f640 1 -- 172.21.15.7:0/87097466 shutdown_connections 2024-04-25T10:05:15.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.634+0000 7fbdd166f640 1 --2- 172.21.15.7:0/87097466 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbdb806b4d0 0x7fbdb806d990 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:15.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.634+0000 7fbdd166f640 1 --2- 172.21.15.7:0/87097466 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbdcc1474f0 0x7fbdcc13c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:15.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.634+0000 7fbdd166f640 1 --2- 172.21.15.7:0/87097466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdcc0b4960 0x7fbdcc146170 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:15.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.634+0000 7fbdd166f640 1 --2- 172.21.15.7:0/87097466 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdcc0b3d30 0x7fbdcc1434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:15.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.634+0000 7fbdd166f640 1 -- 172.21.15.7:0/87097466 >> 172.21.15.7:0/87097466 conn(0x7fbdcc0b1740 msgr2=0x7fbdcc146820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:15.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.634+0000 7fbdd166f640 1 -- 172.21.15.7:0/87097466 shutdown_connections 2024-04-25T10:05:15.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:15.634+0000 7fbdd166f640 1 -- 172.21.15.7:0/87097466 wait complete. 2024-04-25T10:05:15.651 INFO:tasks.cephfs_test_runner:test_orphan_scan (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-04-25T10:05:15.651 INFO:tasks.cephfs_test_runner: 2024-04-25T10:05:15.651 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-25T10:05:15.651 INFO:tasks.cephfs_test_runner:Ran 7 tests in 606.710s 2024-04-25T10:05:15.651 INFO:tasks.cephfs_test_runner: 2024-04-25T10:05:15.651 INFO:tasks.cephfs_test_runner:OK 2024-04-25T10:05:15.652 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-25T10:05:15.661 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-25T10:05:15.706 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-25T10:05:15.706 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:05:15.706 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:05:15.723 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13704 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:05:15.723 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-04-25T10:05:15.723 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:05:15.779 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13704 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:05:15.779 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T10:05:15.779 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:05:15.798 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19023 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:05:15.799 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-25T10:05:15.799 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:05:15.857 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056882,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19023 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:05:15.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:15.858 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-04-25T10:05:15.873 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T10:05:15.873 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T10:05:15.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:15.874 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T10:05:15.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:15.940 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:05:16.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:16.006 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link delete ceph-brx 2024-04-25T10:05:16.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:16.105 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-04-25T10:05:16.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:16.120 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link delete ceph-brx 2024-04-25T10:05:16.188 INFO:teuthology.orchestra.run.smithi007.stderr:Cannot find device "ceph-brx" 2024-04-25T10:05:16.190 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:05:16.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:16.190 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-25T10:05:16.209 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-25T10:05:16.209 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T10:05:16.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:16.210 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T10:05:16.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:16.279 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T10:05:16.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:16.348 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link delete ceph-brx 2024-04-25T10:05:16.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:16.442 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-25T10:05:16.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:16.458 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link delete ceph-brx 2024-04-25T10:05:16.527 INFO:teuthology.orchestra.run.smithi055.stderr:Cannot find device "ceph-brx" 2024-04-25T10:05:16.528 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:05:16.529 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T10:05:16.538 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T10:05:16.538 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:05:16.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.641+0000 7f1455841640 1 Processor -- start 2024-04-25T10:05:16.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.641+0000 7f1455841640 1 -- start start 2024-04-25T10:05:16.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.642+0000 7f1455841640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f145006e970 0x7f145015be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.642+0000 7f1455841640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f14500c4900 0x7f14500c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.642+0000 7f1455841640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14500cd510 con 0x7f1450151720 2024-04-25T10:05:16.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.642+0000 7f1455841640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14500cd7f0 con 0x7f145006e970 2024-04-25T10:05:16.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.642+0000 7f1455841640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14500cdad0 con 0x7f14500c4900 2024-04-25T10:05:16.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.642+0000 7f144f7fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f14500c4900 0x7f14500c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.642+0000 7f144e7fc640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f145006e970 0x7f145015be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.642+0000 7f144f7fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f14500c4900 0x7f14500c4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:39662/0 (socket says 172.21.15.7:39662) 2024-04-25T10:05:16.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.642+0000 7f144f7fe640 1 -- 172.21.15.7:0/2768800691 learned_addr learned my addr 172.21.15.7:0/2768800691 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:16.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.643+0000 7f144e7fc640 1 -- 172.21.15.7:0/2768800691 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f14500c4900 msgr2=0x7f14500c4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:16.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.643+0000 7f144e7fc640 1 --2- 172.21.15.7:0/2768800691 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f14500c4900 0x7f14500c4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.643+0000 7f144e7fc640 1 -- 172.21.15.7:0/2768800691 >> v1:172.21.15.7:6789/0 conn(0x7f1450151720 legacy=0x7f145006e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:16.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.643+0000 7f144e7fc640 1 -- 172.21.15.7:0/2768800691 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14500cddb0 con 0x7f145006e970 2024-04-25T10:05:16.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.644+0000 7f144e7fc640 1 --2- 172.21.15.7:0/2768800691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f145006e970 0x7f145015be70 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f14440097a0 tx=0x7f144402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed901405660bc37 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:16.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.645+0000 7f144dffb640 1 -- 172.21.15.7:0/2768800691 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1444037070 con 0x7f145006e970 2024-04-25T10:05:16.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.645+0000 7f144dffb640 1 -- 172.21.15.7:0/2768800691 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1444032440 con 0x7f145006e970 2024-04-25T10:05:16.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.645+0000 7f144dffb640 1 -- 172.21.15.7:0/2768800691 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1444032810 con 0x7f145006e970 2024-04-25T10:05:16.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.646+0000 7f1455841640 1 -- 172.21.15.7:0/2768800691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f145006e970 msgr2=0x7f145015be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:16.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.646+0000 7f1455841640 1 --2- 172.21.15.7:0/2768800691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f145006e970 0x7f145015be70 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f14440097a0 tx=0x7f144402a180 comp rx=0 tx=0).stop 2024-04-25T10:05:16.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.646+0000 7f1455841640 1 -- 172.21.15.7:0/2768800691 shutdown_connections 2024-04-25T10:05:16.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.646+0000 7f1455841640 1 --2- 172.21.15.7:0/2768800691 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f14500c4900 0x7f14500c4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.646+0000 7f1455841640 1 --2- 172.21.15.7:0/2768800691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f145006e970 0x7f145015be70 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.646+0000 7f1455841640 1 -- 172.21.15.7:0/2768800691 >> 172.21.15.7:0/2768800691 conn(0x7f1450071150 msgr2=0x7f1450071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:16.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.646+0000 7f1455841640 1 -- 172.21.15.7:0/2768800691 shutdown_connections 2024-04-25T10:05:16.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.646+0000 7f1455841640 1 -- 172.21.15.7:0/2768800691 wait complete. 2024-04-25T10:05:16.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.647+0000 7f1455841640 1 Processor -- start 2024-04-25T10:05:16.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.648+0000 7f1455841640 1 -- start start 2024-04-25T10:05:16.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.648+0000 7f1455841640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f145006e970 0x7f14501449a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.648+0000 7f1455841640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14500c4900 0x7f145013ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.648+0000 7f1455841640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1450151720 0x7f1450159320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.648+0000 7f1455841640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14500c5290 con 0x7f14500c4900 2024-04-25T10:05:16.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.648+0000 7f1455841640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1450151b00 con 0x7f1450151720 2024-04-25T10:05:16.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.648+0000 7f1455841640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14500c5410 con 0x7f145006e970 2024-04-25T10:05:16.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.648+0000 7f144e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14500c4900 0x7f145013ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.649+0000 7f144e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14500c4900 0x7f145013ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45110/0 (socket says 172.21.15.7:45110) 2024-04-25T10:05:16.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.649+0000 7f144e7fc640 1 -- 172.21.15.7:0/4139593390 learned_addr learned my addr 172.21.15.7:0/4139593390 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:16.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.649+0000 7f144effd640 1 --2- 172.21.15.7:0/4139593390 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f145006e970 0x7f14501449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.649+0000 7f144f7fe640 1 --2- 172.21.15.7:0/4139593390 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1450151720 0x7f1450159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.649+0000 7f144e7fc640 1 -- 172.21.15.7:0/4139593390 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f145006e970 msgr2=0x7f14501449a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:16.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.649+0000 7f144e7fc640 1 --2- 172.21.15.7:0/4139593390 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f145006e970 0x7f14501449a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.649+0000 7f144e7fc640 1 -- 172.21.15.7:0/4139593390 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1450151720 msgr2=0x7f1450159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:16.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.649+0000 7f144e7fc640 1 --2- 172.21.15.7:0/4139593390 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1450151720 0x7f1450159320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.649+0000 7f144e7fc640 1 -- 172.21.15.7:0/4139593390 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1450144ee0 con 0x7f14500c4900 2024-04-25T10:05:16.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.649+0000 7f144e7fc640 1 --2- 172.21.15.7:0/4139593390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14500c4900 0x7f145013ef90 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f14440098c0 tx=0x7f14440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:16.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.649+0000 7f1437fff640 1 -- 172.21.15.7:0/4139593390 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1444037040 con 0x7f14500c4900 2024-04-25T10:05:16.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.649+0000 7f1437fff640 1 -- 172.21.15.7:0/4139593390 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1444030500 con 0x7f14500c4900 2024-04-25T10:05:16.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.649+0000 7f1437fff640 1 -- 172.21.15.7:0/4139593390 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14440308d0 con 0x7f14500c4900 2024-04-25T10:05:16.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.649+0000 7f1455841640 1 -- 172.21.15.7:0/4139593390 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1450143900 con 0x7f14500c4900 2024-04-25T10:05:16.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.649+0000 7f1455841640 1 -- 172.21.15.7:0/4139593390 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1450143ec0 con 0x7f14500c4900 2024-04-25T10:05:16.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.650+0000 7f1455841640 1 -- 172.21.15.7:0/4139593390 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1450068fd0 con 0x7f14500c4900 2024-04-25T10:05:16.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.651+0000 7f1437fff640 1 -- 172.21.15.7:0/4139593390 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1444044020 con 0x7f14500c4900 2024-04-25T10:05:16.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.651+0000 7f1437fff640 1 --2- 172.21.15.7:0/4139593390 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f143c06b4d0 0x7f143c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.651+0000 7f1437fff640 1 -- 172.21.15.7:0/4139593390 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f14440aa230 con 0x7f14500c4900 2024-04-25T10:05:16.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.651+0000 7f144effd640 1 --2- 172.21.15.7:0/4139593390 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f143c06b4d0 0x7f143c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.652+0000 7f144effd640 1 --2- 172.21.15.7:0/4139593390 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f143c06b4d0 0x7f143c06d990 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f14500b16e0 tx=0x7f1440009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:16.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.656+0000 7f1437fff640 1 -- 172.21.15.7:0/4139593390 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1444078bb0 con 0x7f14500c4900 2024-04-25T10:05:16.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.833+0000 7f1455841640 1 -- 172.21.15.7:0/4139593390 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f145006c1a0 con 0x7f143c06b4d0 2024-04-25T10:05:16.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.833+0000 7f1437fff640 1 -- 172.21.15.7:0/4139593390 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13510 (secure 0 0 0) 0x7f145006c1a0 con 0x7f143c06b4d0 2024-04-25T10:05:16.839 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:05:16.839 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T10:05:16.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.835+0000 7f1455841640 1 -- 172.21.15.7:0/4139593390 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f143c06b4d0 msgr2=0x7f143c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:16.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.835+0000 7f1455841640 1 --2- 172.21.15.7:0/4139593390 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f143c06b4d0 0x7f143c06d990 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f14500b16e0 tx=0x7f1440009040 comp rx=0 tx=0).stop 2024-04-25T10:05:16.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.835+0000 7f1455841640 1 -- 172.21.15.7:0/4139593390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14500c4900 msgr2=0x7f145013ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:16.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.835+0000 7f1455841640 1 --2- 172.21.15.7:0/4139593390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14500c4900 0x7f145013ef90 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f14440098c0 tx=0x7f14440046c0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.835+0000 7f1455841640 1 -- 172.21.15.7:0/4139593390 shutdown_connections 2024-04-25T10:05:16.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.835+0000 7f1455841640 1 --2- 172.21.15.7:0/4139593390 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f143c06b4d0 0x7f143c06d990 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.835+0000 7f1455841640 1 --2- 172.21.15.7:0/4139593390 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1450151720 0x7f1450159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.835+0000 7f1455841640 1 --2- 172.21.15.7:0/4139593390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14500c4900 0x7f145013ef90 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.835+0000 7f1455841640 1 --2- 172.21.15.7:0/4139593390 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f145006e970 0x7f14501449a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.835+0000 7f1455841640 1 -- 172.21.15.7:0/4139593390 >> 172.21.15.7:0/4139593390 conn(0x7f1450071150 msgr2=0x7f145006e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:16.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.835+0000 7f1455841640 1 -- 172.21.15.7:0/4139593390 shutdown_connections 2024-04-25T10:05:16.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.835+0000 7f1455841640 1 -- 172.21.15.7:0/4139593390 wait complete. 2024-04-25T10:05:16.851 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":446,"stamp":"2024-04-25T10:05:16.003765+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":283088,"kb_used_data":25292,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754691632,"statfs":{"total":773094113280,"available":772804231168,"internally_reserved":0,"allocated":25899008,"data_stored":19414000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":263835185},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390540,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-268,"num_write":-171,"num_write_kb":-8302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001126"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":359,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:05:14.726960+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T10:05:14.726960+0000","last_peered":"2024-04-25T10:05:14.726960+0000","last_clean":"2024-04-25T10:05:14.726960+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T10:05:14.726960+0000","last_undegraded":"2024-04-25T10:05:14.726960+0000","last_fullsized":"2024-04-25T10:05:14.726960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542279,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33256,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338584,"statfs":{"total":96636764160,"available":96602710016,"internally_reserved":0,"allocated":2117632,"data_stored":1300489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542279,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40856,"kb_used_data":9672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94330984,"statfs":{"total":96636764160,"available":96594927616,"internally_reserved":0,"allocated":9904128,"data_stored":9092612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542281,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32668,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1523712,"data_stored":710121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542278,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32676,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339164,"statfs":{"total":96636764160,"available":96603303936,"internally_reserved":0,"allocated":1523712,"data_stored":710121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574983,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36820,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335020,"statfs":{"total":96636764160,"available":96599060480,"internally_reserved":0,"allocated":1511424,"data_stored":703997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574983,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32660,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339180,"statfs":{"total":96636764160,"available":96603320320,"internally_reserved":0,"allocated":1511424,"data_stored":703997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574983,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36756,"kb_used_data":5572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335084,"statfs":{"total":96636764160,"available":96599126016,"internally_reserved":0,"allocated":5705728,"data_stored":4898303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574983,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37396,"kb_used_data":2052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334444,"statfs":{"total":96636764160,"available":96598470656,"internally_reserved":0,"allocated":2101248,"data_stored":1294360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:05:16.852 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:05:16.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.948+0000 7f9f90e31640 1 Processor -- start 2024-04-25T10:05:16.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.948+0000 7f9f90e31640 1 -- start start 2024-04-25T10:05:16.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.949+0000 7f9f90e31640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9f8c15db00 0x7f9f8c0d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.949+0000 7f9f90e31640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9f8c0b53b0 0x7f9f8c0d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.949+0000 7f9f90e31640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f8c0d1e80 con 0x7f9f8c0ce2b0 2024-04-25T10:05:16.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.949+0000 7f9f90e31640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f8c0b5930 con 0x7f9f8c15db00 2024-04-25T10:05:16.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.949+0000 7f9f90e31640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f8c0b5c10 con 0x7f9f8c0b53b0 2024-04-25T10:05:16.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.949+0000 7f9f8a59c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9f8c15db00 0x7f9f8c0d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.950+0000 7f9f8a59c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9f8c15db00 0x7f9f8c0d0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45116/0 (socket says 172.21.15.7:45116) 2024-04-25T10:05:16.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.950+0000 7f9f8a59c640 1 -- 172.21.15.7:0/1889086922 learned_addr learned my addr 172.21.15.7:0/1889086922 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:16.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.950+0000 7f9f89d9b640 1 --2- 172.21.15.7:0/1889086922 >> v2:172.21.15.55:3300/0 conn(0x7f9f8c0b53b0 0x7f9f8c0d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.950+0000 7f9f8a59c640 1 -- 172.21.15.7:0/1889086922 >> v2:172.21.15.55:3300/0 conn(0x7f9f8c0b53b0 msgr2=0x7f9f8c0d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:16.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.950+0000 7f9f8a59c640 1 --2- 172.21.15.7:0/1889086922 >> v2:172.21.15.55:3300/0 conn(0x7f9f8c0b53b0 0x7f9f8c0d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.950+0000 7f9f8a59c640 1 -- 172.21.15.7:0/1889086922 >> v1:172.21.15.55:6789/0 conn(0x7f9f8c0ce2b0 legacy=0x7f9f8c161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:16.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.950+0000 7f9f8a59c640 1 -- 172.21.15.7:0/1889086922 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8c0b5ef0 con 0x7f9f8c15db00 2024-04-25T10:05:16.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.950+0000 7f9f8a59c640 1 --2- 172.21.15.7:0/1889086922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f8c15db00 0x7f9f8c0d0340 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c0d4a00 tx=0x7f9f8402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398beec7bda41c24 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:16.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.951+0000 7f9f8959a640 1 -- 172.21.15.7:0/1889086922 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f84036070 con 0x7f9f8c15db00 2024-04-25T10:05:16.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.951+0000 7f9f8959a640 1 -- 172.21.15.7:0/1889086922 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f84031600 con 0x7f9f8c15db00 2024-04-25T10:05:16.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.951+0000 7f9f8959a640 1 -- 172.21.15.7:0/1889086922 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f840319d0 con 0x7f9f8c15db00 2024-04-25T10:05:16.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.951+0000 7f9f90e31640 1 -- 172.21.15.7:0/1889086922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f8c15db00 msgr2=0x7f9f8c0d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:16.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.951+0000 7f9f90e31640 1 --2- 172.21.15.7:0/1889086922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f8c15db00 0x7f9f8c0d0340 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c0d4a00 tx=0x7f9f8402a730 comp rx=0 tx=0).stop 2024-04-25T10:05:16.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.951+0000 7f9f90e31640 1 -- 172.21.15.7:0/1889086922 shutdown_connections 2024-04-25T10:05:16.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.951+0000 7f9f90e31640 1 --2- 172.21.15.7:0/1889086922 >> v2:172.21.15.55:3300/0 conn(0x7f9f8c0b53b0 0x7f9f8c0d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.951+0000 7f9f90e31640 1 --2- 172.21.15.7:0/1889086922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f8c15db00 0x7f9f8c0d0340 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.951+0000 7f9f90e31640 1 -- 172.21.15.7:0/1889086922 >> 172.21.15.7:0/1889086922 conn(0x7f9f8c072290 msgr2=0x7f9f8c0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:16.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.951+0000 7f9f90e31640 1 -- 172.21.15.7:0/1889086922 shutdown_connections 2024-04-25T10:05:16.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.951+0000 7f9f90e31640 1 -- 172.21.15.7:0/1889086922 wait complete. 2024-04-25T10:05:16.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.953+0000 7f9f90e31640 1 Processor -- start 2024-04-25T10:05:16.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.953+0000 7f9f90e31640 1 -- start start 2024-04-25T10:05:16.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.953+0000 7f9f90e31640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9f8c0b53b0 0x7f9f8c1517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.953+0000 7f9f90e31640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f8c0ce2b0 0x7f9f8c152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.953+0000 7f9f90e31640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f8c15db00 0x7f9f8c14fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.953+0000 7f9f90e31640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c0d3660 con 0x7f9f8c15db00 2024-04-25T10:05:16.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.953+0000 7f9f90e31640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c0b61d0 con 0x7f9f8c0ce2b0 2024-04-25T10:05:16.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.953+0000 7f9f90e31640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c0b6c10 con 0x7f9f8c0b53b0 2024-04-25T10:05:16.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.953+0000 7f9f8ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f8c15db00 0x7f9f8c14fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.954+0000 7f9f8ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f8c15db00 0x7f9f8c14fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45122/0 (socket says 172.21.15.7:45122) 2024-04-25T10:05:16.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.954+0000 7f9f8ad9d640 1 -- 172.21.15.7:0/3905417357 learned_addr learned my addr 172.21.15.7:0/3905417357 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:16.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.954+0000 7f9f8a59c640 1 --2- 172.21.15.7:0/3905417357 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9f8c0b53b0 0x7f9f8c1517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.954+0000 7f9f89d9b640 1 --2- 172.21.15.7:0/3905417357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f8c0ce2b0 0x7f9f8c152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.954+0000 7f9f8ad9d640 1 -- 172.21.15.7:0/3905417357 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9f8c0b53b0 msgr2=0x7f9f8c1517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:16.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.954+0000 7f9f8ad9d640 1 --2- 172.21.15.7:0/3905417357 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9f8c0b53b0 0x7f9f8c1517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.954+0000 7f9f8ad9d640 1 -- 172.21.15.7:0/3905417357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f8c0ce2b0 msgr2=0x7f9f8c152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:16.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.954+0000 7f9f8ad9d640 1 --2- 172.21.15.7:0/3905417357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f8c0ce2b0 0x7f9f8c152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.954+0000 7f9f8ad9d640 1 -- 172.21.15.7:0/3905417357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8c0b7ee0 con 0x7f9f8c15db00 2024-04-25T10:05:16.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.954+0000 7f9f8ad9d640 1 --2- 172.21.15.7:0/3905417357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f8c15db00 0x7f9f8c14fad0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c001eb0 tx=0x7f9f7c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:16.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.954+0000 7f9f7affd640 1 -- 172.21.15.7:0/3905417357 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c017070 con 0x7f9f8c15db00 2024-04-25T10:05:16.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.954+0000 7f9f7affd640 1 -- 172.21.15.7:0/3905417357 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7c0052d0 con 0x7f9f8c15db00 2024-04-25T10:05:16.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.954+0000 7f9f90e31640 1 -- 172.21.15.7:0/3905417357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f8c0cd320 con 0x7f9f8c15db00 2024-04-25T10:05:16.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.954+0000 7f9f7affd640 1 -- 172.21.15.7:0/3905417357 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c003810 con 0x7f9f8c15db00 2024-04-25T10:05:16.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.954+0000 7f9f90e31640 1 -- 172.21.15.7:0/3905417357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8c0cd8e0 con 0x7f9f8c15db00 2024-04-25T10:05:16.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.955+0000 7f9f90e31640 1 -- 172.21.15.7:0/3905417357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f8c068fd0 con 0x7f9f8c15db00 2024-04-25T10:05:16.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.956+0000 7f9f7affd640 1 -- 172.21.15.7:0/3905417357 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9f7c01a070 con 0x7f9f8c15db00 2024-04-25T10:05:16.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.956+0000 7f9f7affd640 1 --2- 172.21.15.7:0/3905417357 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9f6c06b4d0 0x7f9f6c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.956+0000 7f9f8a59c640 1 --2- 172.21.15.7:0/3905417357 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9f6c06b4d0 0x7f9f6c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.956+0000 7f9f7affd640 1 -- 172.21.15.7:0/3905417357 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f9f7c089430 con 0x7f9f8c15db00 2024-04-25T10:05:16.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.957+0000 7f9f8a59c640 1 --2- 172.21.15.7:0/3905417357 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9f6c06b4d0 0x7f9f6c06d990 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f9f84033000 tx=0x7f9f84009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:16.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:16.961+0000 7f9f7affd640 1 -- 172.21.15.7:0/3905417357 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9f7c057d20 con 0x7f9f8c15db00 2024-04-25T10:05:17.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.136+0000 7f9f90e31640 1 -- 172.21.15.7:0/3905417357 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9f8c0d16b0 con 0x7f9f6c06b4d0 2024-04-25T10:05:17.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.137+0000 7f9f7affd640 1 -- 172.21.15.7:0/3905417357 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13510 (secure 0 0 0) 0x7f9f8c0d16b0 con 0x7f9f6c06b4d0 2024-04-25T10:05:17.142 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:05:17.142 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T10:05:17.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.138+0000 7f9f90e31640 1 -- 172.21.15.7:0/3905417357 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9f6c06b4d0 msgr2=0x7f9f6c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:17.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.138+0000 7f9f90e31640 1 --2- 172.21.15.7:0/3905417357 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9f6c06b4d0 0x7f9f6c06d990 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f9f84033000 tx=0x7f9f84009000 comp rx=0 tx=0).stop 2024-04-25T10:05:17.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.138+0000 7f9f90e31640 1 -- 172.21.15.7:0/3905417357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f8c15db00 msgr2=0x7f9f8c14fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:17.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.138+0000 7f9f90e31640 1 --2- 172.21.15.7:0/3905417357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f8c15db00 0x7f9f8c14fad0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c001eb0 tx=0x7f9f7c00c890 comp rx=0 tx=0).stop 2024-04-25T10:05:17.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.138+0000 7f9f90e31640 1 -- 172.21.15.7:0/3905417357 shutdown_connections 2024-04-25T10:05:17.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.138+0000 7f9f90e31640 1 --2- 172.21.15.7:0/3905417357 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f9f6c06b4d0 0x7f9f6c06d990 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.138+0000 7f9f90e31640 1 --2- 172.21.15.7:0/3905417357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f8c15db00 0x7f9f8c14fad0 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.138+0000 7f9f90e31640 1 --2- 172.21.15.7:0/3905417357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f8c0ce2b0 0x7f9f8c152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.138+0000 7f9f90e31640 1 --2- 172.21.15.7:0/3905417357 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9f8c0b53b0 0x7f9f8c1517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.139+0000 7f9f90e31640 1 -- 172.21.15.7:0/3905417357 >> 172.21.15.7:0/3905417357 conn(0x7f9f8c072290 msgr2=0x7f9f8c0b6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:17.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.139+0000 7f9f90e31640 1 -- 172.21.15.7:0/3905417357 shutdown_connections 2024-04-25T10:05:17.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.139+0000 7f9f90e31640 1 -- 172.21.15.7:0/3905417357 wait complete. 2024-04-25T10:05:17.155 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":446,"stamp":"2024-04-25T10:05:16.003765+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":283088,"kb_used_data":25292,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754691632,"statfs":{"total":773094113280,"available":772804231168,"internally_reserved":0,"allocated":25899008,"data_stored":19414000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":263835185},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390540,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-268,"num_write":-171,"num_write_kb":-8302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001126"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":359,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:05:14.726960+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T10:05:14.726960+0000","last_peered":"2024-04-25T10:05:14.726960+0000","last_clean":"2024-04-25T10:05:14.726960+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T10:05:14.726960+0000","last_undegraded":"2024-04-25T10:05:14.726960+0000","last_fullsized":"2024-04-25T10:05:14.726960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542279,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33256,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338584,"statfs":{"total":96636764160,"available":96602710016,"internally_reserved":0,"allocated":2117632,"data_stored":1300489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542279,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40856,"kb_used_data":9672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94330984,"statfs":{"total":96636764160,"available":96594927616,"internally_reserved":0,"allocated":9904128,"data_stored":9092612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542281,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32668,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1523712,"data_stored":710121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542278,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32676,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339164,"statfs":{"total":96636764160,"available":96603303936,"internally_reserved":0,"allocated":1523712,"data_stored":710121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574983,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36820,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335020,"statfs":{"total":96636764160,"available":96599060480,"internally_reserved":0,"allocated":1511424,"data_stored":703997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574983,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32660,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339180,"statfs":{"total":96636764160,"available":96603320320,"internally_reserved":0,"allocated":1511424,"data_stored":703997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574983,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36756,"kb_used_data":5572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335084,"statfs":{"total":96636764160,"available":96599126016,"internally_reserved":0,"allocated":5705728,"data_stored":4898303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574983,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37396,"kb_used_data":2052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334444,"statfs":{"total":96636764160,"available":96598470656,"internally_reserved":0,"allocated":2101248,"data_stored":1294360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:05:17.155 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T10:05:17.155 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:05:17.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.252+0000 7f6c35be2640 1 Processor -- start 2024-04-25T10:05:17.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.252+0000 7f6c35be2640 1 -- start start 2024-04-25T10:05:17.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.252+0000 7f6c35be2640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6c3006e970 0x7f6c300cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:17.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.252+0000 7f6c35be2640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c300cdbf0 con 0x7f6c30144100 2024-04-25T10:05:17.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.252+0000 7f6c35be2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c300cded0 con 0x7f6c300ced20 2024-04-25T10:05:17.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.252+0000 7f6c35be2640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c301444e0 con 0x7f6c3006e970 2024-04-25T10:05:17.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.253+0000 7f6c2f7fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f6c30144100 0x7f6c3006e260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45968/0 (socket says 172.21.15.7:45968) 2024-04-25T10:05:17.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.253+0000 7f6c2f7fe640 1 -- 172.21.15.7:0/153585182 learned_addr learned my addr 172.21.15.7:0/153585182 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:05:17.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.253+0000 7f6c2effd640 1 --2- 172.21.15.7:0/153585182 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6c3006e970 0x7f6c300cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:17.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.253+0000 7f6c2e7fc640 1 -- 172.21.15.7:0/153585182 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015557723 0 0) 0x7f6c300cdbf0 con 0x7f6c30144100 2024-04-25T10:05:17.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.253+0000 7f6c2e7fc640 1 -- 172.21.15.7:0/153585182 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c18003520 con 0x7f6c30144100 2024-04-25T10:05:17.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.253+0000 7f6c2e7fc640 1 -- 172.21.15.7:0/153585182 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1999782347 0 0) 0x7f6c18003520 con 0x7f6c30144100 2024-04-25T10:05:17.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.253+0000 7f6c2e7fc640 1 -- 172.21.15.7:0/153585182 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6c3006e970 msgr2=0x7f6c300cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:17.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.253+0000 7f6c2e7fc640 1 --2- 172.21.15.7:0/153585182 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6c3006e970 0x7f6c300cd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.253+0000 7f6c2e7fc640 1 -- 172.21.15.7:0/153585182 >> v1:172.21.15.55:6789/0 conn(0x7f6c300ced20 legacy=0x7f6c3015b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:17.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.253+0000 7f6c2e7fc640 1 -- 172.21.15.7:0/153585182 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c300ce1b0 con 0x7f6c30144100 2024-04-25T10:05:17.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.253+0000 7f6c2e7fc640 1 -- 172.21.15.7:0/153585182 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f6c20001670 con 0x7f6c30144100 2024-04-25T10:05:17.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.253+0000 7f6c2e7fc640 1 -- 172.21.15.7:0/153585182 >> v1:172.21.15.7:6789/0 conn(0x7f6c30144100 legacy=0x7f6c3006e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:17.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.253+0000 7f6c2e7fc640 1 --2- 172.21.15.7:0/153585182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c180039e0 0x7f6c18003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:17.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.253+0000 7f6c2e7fc640 1 --2- 172.21.15.7:0/153585182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c18004800 0x7f6c18004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:17.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.253+0000 7f6c2e7fc640 1 --2- 172.21.15.7:0/153585182 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6c3006e970 0x7f6c180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:17.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.253+0000 7f6c2e7fc640 1 -- 172.21.15.7:0/153585182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c301444e0 con 0x7f6c18004800 2024-04-25T10:05:17.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.253+0000 7f6c2e7fc640 1 -- 172.21.15.7:0/153585182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1800ba70 con 0x7f6c180039e0 2024-04-25T10:05:17.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.253+0000 7f6c2e7fc640 1 -- 172.21.15.7:0/153585182 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1800de80 con 0x7f6c3006e970 2024-04-25T10:05:17.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.253+0000 7f6c2effd640 1 --2- 172.21.15.7:0/153585182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c18004800 0x7f6c18004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:17.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.253+0000 7f6c2f7fe640 1 --2- 172.21.15.7:0/153585182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c180039e0 0x7f6c18003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:17.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.253+0000 7f6c2ffff640 1 --2- 172.21.15.7:0/153585182 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6c3006e970 0x7f6c180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:17.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.254+0000 7f6c2effd640 1 -- 172.21.15.7:0/153585182 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6c3006e970 msgr2=0x7f6c180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:17.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.254+0000 7f6c2effd640 1 --2- 172.21.15.7:0/153585182 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6c3006e970 0x7f6c180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.254+0000 7f6c2effd640 1 -- 172.21.15.7:0/153585182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c180039e0 msgr2=0x7f6c18003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:17.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.254+0000 7f6c2effd640 1 --2- 172.21.15.7:0/153585182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c180039e0 0x7f6c18003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.254+0000 7f6c2effd640 1 -- 172.21.15.7:0/153585182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c18003520 con 0x7f6c18004800 2024-04-25T10:05:17.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.254+0000 7f6c2effd640 1 --2- 172.21.15.7:0/153585182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c18004800 0x7f6c18004c80 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7f6c24009a90 tx=0x7f6c18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec483aa943215d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:17.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.254+0000 7f6c2e7fc640 1 -- 172.21.15.7:0/153585182 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24036070 con 0x7f6c18004800 2024-04-25T10:05:17.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.254+0000 7f6c2e7fc640 1 -- 172.21.15.7:0/153585182 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c24031400 con 0x7f6c18004800 2024-04-25T10:05:17.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.255+0000 7f6c2e7fc640 1 -- 172.21.15.7:0/153585182 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24009690 con 0x7f6c18004800 2024-04-25T10:05:17.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.255+0000 7f6c35be2640 1 -- 172.21.15.7:0/153585182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c18004800 msgr2=0x7f6c18004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:17.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.255+0000 7f6c35be2640 1 --2- 172.21.15.7:0/153585182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c18004800 0x7f6c18004c80 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7f6c24009a90 tx=0x7f6c18005830 comp rx=0 tx=0).stop 2024-04-25T10:05:17.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.255+0000 7f6c2ffff640 1 -- 172.21.15.7:0/153585182 reap_dead start 2024-04-25T10:05:17.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.255+0000 7f6c35be2640 1 -- 172.21.15.7:0/153585182 shutdown_connections 2024-04-25T10:05:17.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.255+0000 7f6c35be2640 1 -- 172.21.15.7:0/153585182 >> 172.21.15.7:0/153585182 conn(0x7f6c30071150 msgr2=0x7f6c30071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:17.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.255+0000 7f6c35be2640 1 -- 172.21.15.7:0/153585182 shutdown_connections 2024-04-25T10:05:17.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.255+0000 7f6c35be2640 1 -- 172.21.15.7:0/153585182 wait complete. 2024-04-25T10:05:17.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.256+0000 7f6c35be2640 1 Processor -- start 2024-04-25T10:05:17.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.256+0000 7f6c35be2640 1 -- start start 2024-04-25T10:05:17.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.257+0000 7f6c35be2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c18004800 0x7f6c30159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:17.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.257+0000 7f6c35be2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c300cbcb0 0x7f6c30139940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:17.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.257+0000 7f6c35be2640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6c300cad90 0x7f6c300b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:17.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.257+0000 7f6c35be2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c300cea00 con 0x7f6c300cbcb0 2024-04-25T10:05:17.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.257+0000 7f6c35be2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3015ac70 con 0x7f6c18004800 2024-04-25T10:05:17.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.257+0000 7f6c35be2640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c300cd610 con 0x7f6c300cad90 2024-04-25T10:05:17.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.257+0000 7f6c2effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c300cbcb0 0x7f6c30139940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:17.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.257+0000 7f6c2effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c300cbcb0 0x7f6c30139940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45132/0 (socket says 172.21.15.7:45132) 2024-04-25T10:05:17.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.257+0000 7f6c2effd640 1 -- 172.21.15.7:0/850104778 learned_addr learned my addr 172.21.15.7:0/850104778 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:17.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.257+0000 7f6c2ffff640 1 --2- 172.21.15.7:0/850104778 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6c300cad90 0x7f6c300b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:17.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.257+0000 7f6c2f7fe640 1 --2- 172.21.15.7:0/850104778 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c18004800 0x7f6c30159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:17.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.258+0000 7f6c2effd640 1 -- 172.21.15.7:0/850104778 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6c300cad90 msgr2=0x7f6c300b49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:17.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.258+0000 7f6c2effd640 1 --2- 172.21.15.7:0/850104778 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6c300cad90 0x7f6c300b49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.258+0000 7f6c2effd640 1 -- 172.21.15.7:0/850104778 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c18004800 msgr2=0x7f6c30159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:17.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.258+0000 7f6c2effd640 1 --2- 172.21.15.7:0/850104778 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c18004800 0x7f6c30159df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.258+0000 7f6c2effd640 1 -- 172.21.15.7:0/850104778 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3013d4c0 con 0x7f6c300cbcb0 2024-04-25T10:05:17.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.258+0000 7f6c2effd640 1 --2- 172.21.15.7:0/850104778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c300cbcb0 0x7f6c30139940 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f6c24034040 tx=0x7f6c24004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:17.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.258+0000 7f6c17fff640 1 -- 172.21.15.7:0/850104778 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24040020 con 0x7f6c300cbcb0 2024-04-25T10:05:17.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.258+0000 7f6c17fff640 1 -- 172.21.15.7:0/850104778 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c24003bc0 con 0x7f6c300cbcb0 2024-04-25T10:05:17.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.258+0000 7f6c35be2640 1 -- 172.21.15.7:0/850104778 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c3013d740 con 0x7f6c300cbcb0 2024-04-25T10:05:17.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.258+0000 7f6c17fff640 1 -- 172.21.15.7:0/850104778 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24036040 con 0x7f6c300cbcb0 2024-04-25T10:05:17.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.258+0000 7f6c35be2640 1 -- 172.21.15.7:0/850104778 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c3013dd00 con 0x7f6c300cbcb0 2024-04-25T10:05:17.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.259+0000 7f6c35be2640 1 -- 172.21.15.7:0/850104778 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c30068fd0 con 0x7f6c300cbcb0 2024-04-25T10:05:17.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.260+0000 7f6c17fff640 1 -- 172.21.15.7:0/850104778 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6c24043020 con 0x7f6c300cbcb0 2024-04-25T10:05:17.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.260+0000 7f6c17fff640 1 --2- 172.21.15.7:0/850104778 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6c1c06b4d0 0x7f6c1c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:17.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.260+0000 7f6c17fff640 1 -- 172.21.15.7:0/850104778 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f6c240aa210 con 0x7f6c300cbcb0 2024-04-25T10:05:17.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.260+0000 7f6c2f7fe640 1 --2- 172.21.15.7:0/850104778 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6c1c06b4d0 0x7f6c1c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:17.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.260+0000 7f6c2f7fe640 1 --2- 172.21.15.7:0/850104778 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6c1c06b4d0 0x7f6c1c06d990 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f6c20001eb0 tx=0x7f6c20001c30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:17.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.264+0000 7f6c17fff640 1 -- 172.21.15.7:0/850104778 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6c2404a070 con 0x7f6c300cbcb0 2024-04-25T10:05:17.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.440+0000 7f6c35be2640 1 -- 172.21.15.7:0/850104778 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6c300cc780 con 0x7f6c1c06b4d0 2024-04-25T10:05:17.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.441+0000 7f6c17fff640 1 -- 172.21.15.7:0/850104778 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13510 (secure 0 0 0) 0x7f6c300cc780 con 0x7f6c1c06b4d0 2024-04-25T10:05:17.446 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:05:17.447 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T10:05:17.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.443+0000 7f6c35be2640 1 -- 172.21.15.7:0/850104778 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6c1c06b4d0 msgr2=0x7f6c1c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:17.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.443+0000 7f6c35be2640 1 --2- 172.21.15.7:0/850104778 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6c1c06b4d0 0x7f6c1c06d990 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f6c20001eb0 tx=0x7f6c20001c30 comp rx=0 tx=0).stop 2024-04-25T10:05:17.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.443+0000 7f6c35be2640 1 -- 172.21.15.7:0/850104778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c300cbcb0 msgr2=0x7f6c30139940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:17.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.443+0000 7f6c35be2640 1 --2- 172.21.15.7:0/850104778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c300cbcb0 0x7f6c30139940 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f6c24034040 tx=0x7f6c24004730 comp rx=0 tx=0).stop 2024-04-25T10:05:17.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.443+0000 7f6c35be2640 1 -- 172.21.15.7:0/850104778 shutdown_connections 2024-04-25T10:05:17.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.443+0000 7f6c35be2640 1 --2- 172.21.15.7:0/850104778 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f6c1c06b4d0 0x7f6c1c06d990 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.443+0000 7f6c35be2640 1 --2- 172.21.15.7:0/850104778 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6c300cad90 0x7f6c300b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.443+0000 7f6c35be2640 1 --2- 172.21.15.7:0/850104778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c300cbcb0 0x7f6c30139940 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.443+0000 7f6c35be2640 1 --2- 172.21.15.7:0/850104778 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c18004800 0x7f6c30159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.443+0000 7f6c35be2640 1 -- 172.21.15.7:0/850104778 >> 172.21.15.7:0/850104778 conn(0x7f6c30071150 msgr2=0x7f6c3015dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:17.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.443+0000 7f6c35be2640 1 -- 172.21.15.7:0/850104778 shutdown_connections 2024-04-25T10:05:17.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.443+0000 7f6c35be2640 1 -- 172.21.15.7:0/850104778 wait complete. 2024-04-25T10:05:17.459 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":446,"stamp":"2024-04-25T10:05:16.003765+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":283088,"kb_used_data":25292,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754691632,"statfs":{"total":773094113280,"available":772804231168,"internally_reserved":0,"allocated":25899008,"data_stored":19414000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":263835185},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390540,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-268,"num_write":-171,"num_write_kb":-8302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001126"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":359,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:05:14.726960+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T10:05:14.726960+0000","last_peered":"2024-04-25T10:05:14.726960+0000","last_clean":"2024-04-25T10:05:14.726960+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T10:05:14.726960+0000","last_undegraded":"2024-04-25T10:05:14.726960+0000","last_fullsized":"2024-04-25T10:05:14.726960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542279,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33256,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338584,"statfs":{"total":96636764160,"available":96602710016,"internally_reserved":0,"allocated":2117632,"data_stored":1300489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542279,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40856,"kb_used_data":9672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94330984,"statfs":{"total":96636764160,"available":96594927616,"internally_reserved":0,"allocated":9904128,"data_stored":9092612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542281,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32668,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1523712,"data_stored":710121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542278,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32676,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339164,"statfs":{"total":96636764160,"available":96603303936,"internally_reserved":0,"allocated":1523712,"data_stored":710121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574983,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36820,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335020,"statfs":{"total":96636764160,"available":96599060480,"internally_reserved":0,"allocated":1511424,"data_stored":703997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574983,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32660,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339180,"statfs":{"total":96636764160,"available":96603320320,"internally_reserved":0,"allocated":1511424,"data_stored":703997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574983,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36756,"kb_used_data":5572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335084,"statfs":{"total":96636764160,"available":96599126016,"internally_reserved":0,"allocated":5705728,"data_stored":4898303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574983,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37396,"kb_used_data":2052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334444,"statfs":{"total":96636764160,"available":96598470656,"internally_reserved":0,"allocated":2101248,"data_stored":1294360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:05:17.460 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:05:17.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.554+0000 7f31737c8640 1 Processor -- start 2024-04-25T10:05:17.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.555+0000 7f31737c8640 1 -- start start 2024-04-25T10:05:17.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.555+0000 7f31737c8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f316c15db00 0x7f316c0d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:17.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.555+0000 7f31737c8640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f316c0b53b0 0x7f316c0d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:17.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.555+0000 7f31737c8640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f316c0ce2b0 0x7f316c161670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:17.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.555+0000 7f31737c8640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f316c0d1e80 con 0x7f316c0b53b0 2024-04-25T10:05:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.555+0000 7f31737c8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f316c0b5930 con 0x7f316c15db00 2024-04-25T10:05:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.555+0000 7f31737c8640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f316c0b5c10 con 0x7f316c0ce2b0 2024-04-25T10:05:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.555+0000 7f3170d63640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f316c0b53b0 0x7f316c0d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.556+0000 7f3170d63640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f316c0b53b0 0x7f316c0d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45148/0 (socket says 172.21.15.7:45148) 2024-04-25T10:05:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.556+0000 7f3170d63640 1 -- 172.21.15.7:0/2930437374 learned_addr learned my addr 172.21.15.7:0/2930437374 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.556+0000 7f3171564640 1 --2- 172.21.15.7:0/2930437374 >> v2:172.21.15.55:3300/0 conn(0x7f316c15db00 0x7f316c0d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.556+0000 7f3171d65640 1 --2- 172.21.15.7:0/2930437374 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f316c0ce2b0 0x7f316c161670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.556+0000 7f3170d63640 1 -- 172.21.15.7:0/2930437374 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f316c0ce2b0 msgr2=0x7f316c161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.556+0000 7f3170d63640 1 --2- 172.21.15.7:0/2930437374 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f316c0ce2b0 0x7f316c161670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.556+0000 7f3170d63640 1 -- 172.21.15.7:0/2930437374 >> v2:172.21.15.55:3300/0 conn(0x7f316c15db00 msgr2=0x7f316c0d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.556+0000 7f3170d63640 1 --2- 172.21.15.7:0/2930437374 >> v2:172.21.15.55:3300/0 conn(0x7f316c15db00 0x7f316c0d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.556+0000 7f3170d63640 1 -- 172.21.15.7:0/2930437374 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316c0b5ef0 con 0x7f316c0b53b0 2024-04-25T10:05:17.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.557+0000 7f3170d63640 1 --2- 172.21.15.7:0/2930437374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f316c0b53b0 0x7f316c0d0880 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f316c0d4940 tx=0x7f316002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b657c883a11f1d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:17.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.557+0000 7f316bfff640 1 -- 172.21.15.7:0/2930437374 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3160037070 con 0x7f316c0b53b0 2024-04-25T10:05:17.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.557+0000 7f316bfff640 1 -- 172.21.15.7:0/2930437374 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3160032440 con 0x7f316c0b53b0 2024-04-25T10:05:17.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.557+0000 7f316bfff640 1 -- 172.21.15.7:0/2930437374 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3160032810 con 0x7f316c0b53b0 2024-04-25T10:05:17.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.557+0000 7f31737c8640 1 -- 172.21.15.7:0/2930437374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f316c0b53b0 msgr2=0x7f316c0d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:17.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.557+0000 7f31737c8640 1 --2- 172.21.15.7:0/2930437374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f316c0b53b0 0x7f316c0d0880 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f316c0d4940 tx=0x7f316002a1e0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.557+0000 7f31737c8640 1 -- 172.21.15.7:0/2930437374 shutdown_connections 2024-04-25T10:05:17.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.557+0000 7f31737c8640 1 --2- 172.21.15.7:0/2930437374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f316c0b53b0 0x7f316c0d0880 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.557+0000 7f31737c8640 1 --2- 172.21.15.7:0/2930437374 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f316c0ce2b0 0x7f316c161670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.557+0000 7f31737c8640 1 --2- 172.21.15.7:0/2930437374 >> v2:172.21.15.55:3300/0 conn(0x7f316c15db00 0x7f316c0d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.557+0000 7f31737c8640 1 -- 172.21.15.7:0/2930437374 >> 172.21.15.7:0/2930437374 conn(0x7f316c072290 msgr2=0x7f316c0726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:17.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.557+0000 7f31737c8640 1 -- 172.21.15.7:0/2930437374 shutdown_connections 2024-04-25T10:05:17.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.557+0000 7f31737c8640 1 -- 172.21.15.7:0/2930437374 wait complete. 2024-04-25T10:05:17.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.558+0000 7f31737c8640 1 Processor -- start 2024-04-25T10:05:17.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.558+0000 7f31737c8640 1 -- start start 2024-04-25T10:05:17.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.559+0000 7f31737c8640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f316c0b53b0 0x7f316c160b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:17.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.559+0000 7f31737c8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f316c0ce2b0 0x7f316c0cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:17.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.559+0000 7f31737c8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f316c15db00 0x7f316c1f6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:17.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.559+0000 7f31737c8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316c0d3660 con 0x7f316c0ce2b0 2024-04-25T10:05:17.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.559+0000 7f31737c8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316c0b61d0 con 0x7f316c15db00 2024-04-25T10:05:17.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.559+0000 7f31737c8640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f316c0b6c10 con 0x7f316c0b53b0 2024-04-25T10:05:17.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.559+0000 7f3170d63640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f316c0ce2b0 0x7f316c0cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:17.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.559+0000 7f3170d63640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f316c0ce2b0 0x7f316c0cc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45164/0 (socket says 172.21.15.7:45164) 2024-04-25T10:05:17.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.559+0000 7f3170d63640 1 -- 172.21.15.7:0/1808135152 learned_addr learned my addr 172.21.15.7:0/1808135152 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:17.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.559+0000 7f3171d65640 1 --2- 172.21.15.7:0/1808135152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f316c15db00 0x7f316c1f6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:17.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.559+0000 7f3171564640 1 --2- 172.21.15.7:0/1808135152 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f316c0b53b0 0x7f316c160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:17.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.560+0000 7f3170d63640 1 -- 172.21.15.7:0/1808135152 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f316c0b53b0 msgr2=0x7f316c160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:17.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.560+0000 7f3170d63640 1 --2- 172.21.15.7:0/1808135152 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f316c0b53b0 0x7f316c160b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.560+0000 7f3170d63640 1 -- 172.21.15.7:0/1808135152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f316c15db00 msgr2=0x7f316c1f6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:17.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.560+0000 7f3170d63640 1 --2- 172.21.15.7:0/1808135152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f316c15db00 0x7f316c1f6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.560+0000 7f3170d63640 1 -- 172.21.15.7:0/1808135152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316c0cd1b0 con 0x7f316c0ce2b0 2024-04-25T10:05:17.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.560+0000 7f3170d63640 1 --2- 172.21.15.7:0/1808135152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f316c0ce2b0 0x7f316c0cc8c0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f316002a220 tx=0x7f31600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:17.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.560+0000 7f3169ffb640 1 -- 172.21.15.7:0/1808135152 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3160041020 con 0x7f316c0ce2b0 2024-04-25T10:05:17.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.560+0000 7f3169ffb640 1 -- 172.21.15.7:0/1808135152 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31600306c0 con 0x7f316c0ce2b0 2024-04-25T10:05:17.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.560+0000 7f31737c8640 1 -- 172.21.15.7:0/1808135152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f316c1f78f0 con 0x7f316c0ce2b0 2024-04-25T10:05:17.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.560+0000 7f3169ffb640 1 -- 172.21.15.7:0/1808135152 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3160037040 con 0x7f316c0ce2b0 2024-04-25T10:05:17.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.560+0000 7f31737c8640 1 -- 172.21.15.7:0/1808135152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f316c15e190 con 0x7f316c0ce2b0 2024-04-25T10:05:17.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.561+0000 7f31737c8640 1 -- 172.21.15.7:0/1808135152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f316c068fd0 con 0x7f316c0ce2b0 2024-04-25T10:05:17.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.562+0000 7f3169ffb640 1 -- 172.21.15.7:0/1808135152 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3160044020 con 0x7f316c0ce2b0 2024-04-25T10:05:17.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.562+0000 7f3169ffb640 1 --2- 172.21.15.7:0/1808135152 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f315806b4d0 0x7f315806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:17.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.562+0000 7f3169ffb640 1 -- 172.21.15.7:0/1808135152 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f31600aa760 con 0x7f316c0ce2b0 2024-04-25T10:05:17.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.562+0000 7f3171564640 1 --2- 172.21.15.7:0/1808135152 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f315806b4d0 0x7f315806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:17.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.563+0000 7f3171564640 1 --2- 172.21.15.7:0/1808135152 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f315806b4d0 0x7f315806d990 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3164007920 tx=0x7f3164008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:17.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.566+0000 7f3169ffb640 1 -- 172.21.15.7:0/1808135152 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f316004b030 con 0x7f316c0ce2b0 2024-04-25T10:05:17.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.748+0000 7f31737c8640 1 -- 172.21.15.7:0/1808135152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f316c1577e0 con 0x7f316c0ce2b0 2024-04-25T10:05:17.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.748+0000 7f3169ffb640 1 -- 172.21.15.7:0/1808135152 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+13461 (secure 0 0 0) 0x7f31600790e0 con 0x7f316c0ce2b0 2024-04-25T10:05:17.754 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:05:17.754 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":122,"fsid":"c03d0745-5946-49c3-ad88-1165c5b68b4e","created":"2024-04-25T09:54:03.577823+0000","modified":"2024-04-25T10:05:14.619494+0000","last_up_change":"2024-04-25T09:54:15.042422+0000","last_in_change":"2024-04-25T09:54:05.957440+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:54:15.897490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdf742e0-3579-40a3-a004-584c4b36507a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6801","nonce":4167741236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6803","nonce":4167741236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6807","nonce":4167741236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":4167741236},{"type":"v1","addr":"172.21.15.7:6805","nonce":4167741236}]},"public_addr":"172.21.15.7:6801/4167741236","cluster_addr":"172.21.15.7:6803/4167741236","heartbeat_back_addr":"172.21.15.7:6807/4167741236","heartbeat_front_addr":"172.21.15.7:6805/4167741236","state":["exists","up"]},{"osd":1,"uuid":"35cae772-31a0-46e7-a4e1-934bb9fdedf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6817","nonce":434435857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6819","nonce":434435857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6823","nonce":434435857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":434435857},{"type":"v1","addr":"172.21.15.7:6821","nonce":434435857}]},"public_addr":"172.21.15.7:6817/434435857","cluster_addr":"172.21.15.7:6819/434435857","heartbeat_back_addr":"172.21.15.7:6823/434435857","heartbeat_front_addr":"172.21.15.7:6821/434435857","state":["exists","up"]},{"osd":2,"uuid":"4f289501-a92d-4eb1-9796-d367603ab9fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6809","nonce":1173474863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6811","nonce":1173474863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6815","nonce":1173474863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1173474863},{"type":"v1","addr":"172.21.15.7:6813","nonce":1173474863}]},"public_addr":"172.21.15.7:6809/1173474863","cluster_addr":"172.21.15.7:6811/1173474863","heartbeat_back_addr":"172.21.15.7:6815/1173474863","heartbeat_front_addr":"172.21.15.7:6813/1173474863","state":["exists","up"]},{"osd":3,"uuid":"f4e81a25-c57b-4ebd-a6ef-94a584380d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6825","nonce":3045538953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6827","nonce":3045538953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6831","nonce":3045538953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3045538953},{"type":"v1","addr":"172.21.15.7:6829","nonce":3045538953}]},"public_addr":"172.21.15.7:6825/3045538953","cluster_addr":"172.21.15.7:6827/3045538953","heartbeat_back_addr":"172.21.15.7:6831/3045538953","heartbeat_front_addr":"172.21.15.7:6829/3045538953","state":["exists","up"]},{"osd":4,"uuid":"bce9c9a3-5a5a-47c0-a81e-58811b026611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6809","nonce":2248155105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6811","nonce":2248155105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6815","nonce":2248155105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2248155105},{"type":"v1","addr":"172.21.15.55:6813","nonce":2248155105}]},"public_addr":"172.21.15.55:6809/2248155105","cluster_addr":"172.21.15.55:6811/2248155105","heartbeat_back_addr":"172.21.15.55:6815/2248155105","heartbeat_front_addr":"172.21.15.55:6813/2248155105","state":["exists","up"]},{"osd":5,"uuid":"7b87d9ae-bb40-43b3-b3ff-c992fd97fc8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6801","nonce":2514169616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6803","nonce":2514169616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6807","nonce":2514169616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2514169616},{"type":"v1","addr":"172.21.15.55:6805","nonce":2514169616}]},"public_addr":"172.21.15.55:6801/2514169616","cluster_addr":"172.21.15.55:6803/2514169616","heartbeat_back_addr":"172.21.15.55:6807/2514169616","heartbeat_front_addr":"172.21.15.55:6805/2514169616","state":["exists","up"]},{"osd":6,"uuid":"ffe46b85-843e-45bb-a3d8-01ac64d7e3ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6825","nonce":4293769515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6827","nonce":4293769515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6831","nonce":4293769515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":4293769515},{"type":"v1","addr":"172.21.15.55:6829","nonce":4293769515}]},"public_addr":"172.21.15.55:6825/4293769515","cluster_addr":"172.21.15.55:6827/4293769515","heartbeat_back_addr":"172.21.15.55:6831/4293769515","heartbeat_front_addr":"172.21.15.55:6829/4293769515","state":["exists","up"]},{"osd":7,"uuid":"bdb33bf1-7862-49d3-8cfd-1a74417fb8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6817","nonce":2960381217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6819","nonce":2960381217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6823","nonce":2960381217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2960381217},{"type":"v1","addr":"172.21.15.55:6821","nonce":2960381217}]},"public_addr":"172.21.15.55:6817/2960381217","cluster_addr":"172.21.15.55:6819/2960381217","heartbeat_back_addr":"172.21.15.55:6823/2960381217","heartbeat_front_addr":"172.21.15.55:6821/2960381217","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.077027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.128674+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.138222+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.107360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.125701+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.067277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.061568+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:54:11.075844+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6836/1326211296":"2024-04-26T10:05:11.561659+0000","172.21.15.7:6834/1326211296":"2024-04-26T10:05:11.561659+0000","172.21.15.7:6836/3781378145":"2024-04-26T10:04:57.499347+0000","172.21.15.7:6834/3781378145":"2024-04-26T10:04:57.499347+0000","172.21.15.7:6836/3623521645":"2024-04-26T10:04:46.961147+0000","172.21.15.7:6834/3623521645":"2024-04-26T10:04:46.961147+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:05:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.751+0000 7f31737c8640 1 -- 172.21.15.7:0/1808135152 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f315806b4d0 msgr2=0x7f315806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.751+0000 7f31737c8640 1 --2- 172.21.15.7:0/1808135152 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f315806b4d0 0x7f315806d990 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3164007920 tx=0x7f3164008040 comp rx=0 tx=0).stop 2024-04-25T10:05:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.751+0000 7f31737c8640 1 -- 172.21.15.7:0/1808135152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f316c0ce2b0 msgr2=0x7f316c0cc8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.751+0000 7f31737c8640 1 --2- 172.21.15.7:0/1808135152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f316c0ce2b0 0x7f316c0cc8c0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f316002a220 tx=0x7f31600046c0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.751+0000 7f31737c8640 1 -- 172.21.15.7:0/1808135152 shutdown_connections 2024-04-25T10:05:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.751+0000 7f31737c8640 1 --2- 172.21.15.7:0/1808135152 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f315806b4d0 0x7f315806d990 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.751+0000 7f31737c8640 1 --2- 172.21.15.7:0/1808135152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f316c15db00 0x7f316c1f6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.751+0000 7f31737c8640 1 --2- 172.21.15.7:0/1808135152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f316c0ce2b0 0x7f316c0cc8c0 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.751+0000 7f31737c8640 1 --2- 172.21.15.7:0/1808135152 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f316c0b53b0 0x7f316c160b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.751+0000 7f31737c8640 1 -- 172.21.15.7:0/1808135152 >> 172.21.15.7:0/1808135152 conn(0x7f316c072290 msgr2=0x7f316c157f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.751+0000 7f31737c8640 1 -- 172.21.15.7:0/1808135152 shutdown_connections 2024-04-25T10:05:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:17.751+0000 7f31737c8640 1 -- 172.21.15.7:0/1808135152 wait complete. 2024-04-25T10:05:18.768 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T10:05:18.769 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:05:18.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.881+0000 7fdf8eaf5640 1 Processor -- start 2024-04-25T10:05:18.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.881+0000 7fdf8eaf5640 1 -- start start 2024-04-25T10:05:18.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.882+0000 7fdf8eaf5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdf88161520 0x7fdf880d1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:18.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.882+0000 7fdf8eaf5640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf88162450 con 0x7fdf880d1f80 2024-04-25T10:05:18.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.882+0000 7fdf8eaf5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf88161bb0 con 0x7fdf8815d980 2024-04-25T10:05:18.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.882+0000 7fdf8eaf5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf88161e90 con 0x7fdf88161520 2024-04-25T10:05:18.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.882+0000 7fdf8d092640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fdf880d1f80 0x7fdf8815e5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45982/0 (socket says 172.21.15.7:45982) 2024-04-25T10:05:18.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.882+0000 7fdf8d092640 1 -- 172.21.15.7:0/2896675115 learned_addr learned my addr 172.21.15.7:0/2896675115 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:05:18.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.882+0000 7fdf87fff640 1 --2- 172.21.15.7:0/2896675115 >> v2:172.21.15.55:3300/0 conn(0x7fdf88161520 0x7fdf880d1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:18.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.882+0000 7fdf877fe640 1 -- 172.21.15.7:0/2896675115 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2318518147 0 0) 0x7fdf88162450 con 0x7fdf880d1f80 2024-04-25T10:05:18.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.882+0000 7fdf877fe640 1 -- 172.21.15.7:0/2896675115 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf78003520 con 0x7fdf880d1f80 2024-04-25T10:05:18.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.882+0000 7fdf877fe640 1 -- 172.21.15.7:0/2896675115 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 917237895 0 0) 0x7fdf78003520 con 0x7fdf880d1f80 2024-04-25T10:05:18.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.882+0000 7fdf877fe640 1 -- 172.21.15.7:0/2896675115 >> v2:172.21.15.55:3300/0 conn(0x7fdf88161520 msgr2=0x7fdf880d1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:18.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.882+0000 7fdf877fe640 1 --2- 172.21.15.7:0/2896675115 >> v2:172.21.15.55:3300/0 conn(0x7fdf88161520 0x7fdf880d1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:18.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.882+0000 7fdf877fe640 1 -- 172.21.15.7:0/2896675115 >> v1:172.21.15.55:6789/0 conn(0x7fdf8815d980 legacy=0x7fdf880b9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:18.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.882+0000 7fdf877fe640 1 -- 172.21.15.7:0/2896675115 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf88162170 con 0x7fdf880d1f80 2024-04-25T10:05:18.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.882+0000 7fdf877fe640 1 -- 172.21.15.7:0/2896675115 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fdf800019f0 con 0x7fdf880d1f80 2024-04-25T10:05:18.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.882+0000 7fdf877fe640 1 -- 172.21.15.7:0/2896675115 >> v1:172.21.15.7:6789/0 conn(0x7fdf880d1f80 legacy=0x7fdf8815e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:18.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.882+0000 7fdf877fe640 1 --2- 172.21.15.7:0/2896675115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf780039b0 0x7fdf78003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:18.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.883+0000 7fdf877fe640 1 --2- 172.21.15.7:0/2896675115 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf780043b0 0x7fdf78004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:18.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.883+0000 7fdf877fe640 1 --2- 172.21.15.7:0/2896675115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf78005080 0x7fdf7800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:18.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.883+0000 7fdf877fe640 1 -- 172.21.15.7:0/2896675115 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf88161e90 con 0x7fdf78005080 2024-04-25T10:05:18.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.883+0000 7fdf877fe640 1 -- 172.21.15.7:0/2896675115 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7800bfe0 con 0x7fdf780039b0 2024-04-25T10:05:18.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.883+0000 7fdf877fe640 1 -- 172.21.15.7:0/2896675115 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7800c1e0 con 0x7fdf780043b0 2024-04-25T10:05:18.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.883+0000 7fdf8d092640 1 --2- 172.21.15.7:0/2896675115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf78005080 0x7fdf7800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:18.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.883+0000 7fdf8c891640 1 --2- 172.21.15.7:0/2896675115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf780039b0 0x7fdf78003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:18.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.883+0000 7fdf87fff640 1 --2- 172.21.15.7:0/2896675115 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf780043b0 0x7fdf78004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.883+0000 7fdf8d092640 1 -- 172.21.15.7:0/2896675115 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf780043b0 msgr2=0x7fdf78004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.883+0000 7fdf8d092640 1 --2- 172.21.15.7:0/2896675115 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf780043b0 0x7fdf78004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.883+0000 7fdf8d092640 1 -- 172.21.15.7:0/2896675115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf780039b0 msgr2=0x7fdf78003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.883+0000 7fdf8d092640 1 --2- 172.21.15.7:0/2896675115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf780039b0 0x7fdf78003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.883+0000 7fdf8d092640 1 -- 172.21.15.7:0/2896675115 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf78003520 con 0x7fdf78005080 2024-04-25T10:05:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.884+0000 7fdf8d092640 1 -- 172.21.15.7:0/2896675115 reap_dead start 2024-04-25T10:05:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.884+0000 7fdf8d092640 1 --2- 172.21.15.7:0/2896675115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf78005080 0x7fdf7800b9c0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7fdf8000a860 tx=0x7fdf78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104624bf9914f033 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.884+0000 7fdf877fe640 1 -- 172.21.15.7:0/2896675115 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8000a480 con 0x7fdf78005080 2024-04-25T10:05:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.884+0000 7fdf877fe640 1 -- 172.21.15.7:0/2896675115 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8002f070 con 0x7fdf78005080 2024-04-25T10:05:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.884+0000 7fdf877fe640 1 -- 172.21.15.7:0/2896675115 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8002bc70 con 0x7fdf78005080 2024-04-25T10:05:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.884+0000 7fdf8eaf5640 1 -- 172.21.15.7:0/2896675115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf78005080 msgr2=0x7fdf7800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.884+0000 7fdf8eaf5640 1 --2- 172.21.15.7:0/2896675115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf78005080 0x7fdf7800b9c0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7fdf8000a860 tx=0x7fdf78005830 comp rx=0 tx=0).stop 2024-04-25T10:05:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.884+0000 7fdf8eaf5640 1 -- 172.21.15.7:0/2896675115 shutdown_connections 2024-04-25T10:05:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.884+0000 7fdf8eaf5640 1 --2- 172.21.15.7:0/2896675115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf78005080 0x7fdf7800b9c0 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:18.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.884+0000 7fdf8eaf5640 1 -- 172.21.15.7:0/2896675115 >> 172.21.15.7:0/2896675115 conn(0x7fdf8806c3d0 msgr2=0x7fdf8806c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:18.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.885+0000 7fdf8eaf5640 1 -- 172.21.15.7:0/2896675115 shutdown_connections 2024-04-25T10:05:18.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.885+0000 7fdf8eaf5640 1 -- 172.21.15.7:0/2896675115 wait complete. 2024-04-25T10:05:18.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.886+0000 7fdf8eaf5640 1 Processor -- start 2024-04-25T10:05:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.886+0000 7fdf8eaf5640 1 -- start start 2024-04-25T10:05:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.887+0000 7fdf8eaf5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf78005080 0x7fdf880c9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.887+0000 7fdf8eaf5640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf88154890 0x7fdf880cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.887+0000 7fdf8eaf5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf880cb9e0 0x7fdf88156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.887+0000 7fdf8eaf5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf880d1a40 con 0x7fdf78005080 2024-04-25T10:05:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.887+0000 7fdf8eaf5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8815dd60 con 0x7fdf880cb9e0 2024-04-25T10:05:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.887+0000 7fdf8eaf5640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf880d1bc0 con 0x7fdf88154890 2024-04-25T10:05:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.887+0000 7fdf8c891640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf78005080 0x7fdf880c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.887+0000 7fdf8c891640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf78005080 0x7fdf880c9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45182/0 (socket says 172.21.15.7:45182) 2024-04-25T10:05:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.887+0000 7fdf8c891640 1 -- 172.21.15.7:0/541705726 learned_addr learned my addr 172.21.15.7:0/541705726 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.887+0000 7fdf87fff640 1 --2- 172.21.15.7:0/541705726 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf88154890 0x7fdf880cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.887+0000 7fdf8d092640 1 --2- 172.21.15.7:0/541705726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf880cb9e0 0x7fdf88156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.887+0000 7fdf8c891640 1 -- 172.21.15.7:0/541705726 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf88154890 msgr2=0x7fdf880cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.887+0000 7fdf8c891640 1 --2- 172.21.15.7:0/541705726 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf88154890 0x7fdf880cb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.887+0000 7fdf8c891640 1 -- 172.21.15.7:0/541705726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf880cb9e0 msgr2=0x7fdf88156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:18.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.887+0000 7fdf8c891640 1 --2- 172.21.15.7:0/541705726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf880cb9e0 0x7fdf88156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:18.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.887+0000 7fdf8c891640 1 -- 172.21.15.7:0/541705726 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf88157680 con 0x7fdf78005080 2024-04-25T10:05:18.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.887+0000 7fdf8c891640 1 --2- 172.21.15.7:0/541705726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf78005080 0x7fdf880c9430 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c00f7f0 tx=0x7fdf7c00fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:18.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.888+0000 7fdf857fa640 1 -- 172.21.15.7:0/541705726 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c00fea0 con 0x7fdf78005080 2024-04-25T10:05:18.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.888+0000 7fdf857fa640 1 -- 172.21.15.7:0/541705726 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7c018070 con 0x7fdf78005080 2024-04-25T10:05:18.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.888+0000 7fdf8eaf5640 1 -- 172.21.15.7:0/541705726 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf880c86b0 con 0x7fdf78005080 2024-04-25T10:05:18.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.888+0000 7fdf857fa640 1 -- 172.21.15.7:0/541705726 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c00d730 con 0x7fdf78005080 2024-04-25T10:05:18.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.888+0000 7fdf8eaf5640 1 -- 172.21.15.7:0/541705726 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf880c8c30 con 0x7fdf78005080 2024-04-25T10:05:18.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.888+0000 7fdf8eaf5640 1 -- 172.21.15.7:0/541705726 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdf88069040 con 0x7fdf78005080 2024-04-25T10:05:18.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.889+0000 7fdf857fa640 1 -- 172.21.15.7:0/541705726 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdf7c00d8d0 con 0x7fdf78005080 2024-04-25T10:05:18.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.890+0000 7fdf857fa640 1 --2- 172.21.15.7:0/541705726 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdf6c06b500 0x7fdf6c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:18.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.890+0000 7fdf857fa640 1 -- 172.21.15.7:0/541705726 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fdf7c08aa50 con 0x7fdf78005080 2024-04-25T10:05:18.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.890+0000 7fdf87fff640 1 --2- 172.21.15.7:0/541705726 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdf6c06b500 0x7fdf6c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:18.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.890+0000 7fdf857fa640 1 --2- 172.21.15.7:0/541705726 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x7fdf6c071ae0 0x7fdf6c073f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:18.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.890+0000 7fdf857fa640 1 -- 172.21.15.7:0/541705726 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdf7c01ee50 con 0x7fdf6c071ae0 2024-04-25T10:05:18.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.890+0000 7fdf857fa640 1 -- 172.21.15.7:0/541705726 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=122) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf7c08aee0 con 0x7fdf78005080 2024-04-25T10:05:18.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.890+0000 7fdf8d092640 1 --2- 172.21.15.7:0/541705726 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x7fdf6c071ae0 0x7fdf6c073f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:18.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.890+0000 7fdf87fff640 1 --2- 172.21.15.7:0/541705726 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdf6c06b500 0x7fdf6c06d9c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fdf8815cbd0 tx=0x7fdf74008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:18.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.890+0000 7fdf8d092640 1 --2- 172.21.15.7:0/541705726 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x7fdf6c071ae0 0x7fdf6c073f20 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:18.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.891+0000 7fdf857fa640 1 -- 172.21.15.7:0/541705726 <== osd.0 v2:172.21.15.7:6800/4167741236 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fdf7c01ee50 con 0x7fdf6c071ae0 2024-04-25T10:05:18.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.904+0000 7fdf8eaf5640 1 -- 172.21.15.7:0/541705726 --> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdf880d1240 con 0x7fdf6c071ae0 2024-04-25T10:05:18.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.905+0000 7fdf857fa640 1 -- 172.21.15.7:0/541705726 <== osd.0 v2:172.21.15.7:6800/4167741236 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fdf880d1240 con 0x7fdf6c071ae0 2024-04-25T10:05:18.910 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:05:18.910 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:05:18.910 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:05:18.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.905+0000 7fdf8eaf5640 1 -- 172.21.15.7:0/541705726 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x7fdf6c071ae0 msgr2=0x7fdf6c073f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:18.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.905+0000 7fdf8eaf5640 1 --2- 172.21.15.7:0/541705726 >> [v2:172.21.15.7:6800/4167741236,v1:172.21.15.7:6801/4167741236] conn(0x7fdf6c071ae0 0x7fdf6c073f20 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:18.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.905+0000 7fdf8eaf5640 1 -- 172.21.15.7:0/541705726 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdf6c06b500 msgr2=0x7fdf6c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:18.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.905+0000 7fdf8eaf5640 1 --2- 172.21.15.7:0/541705726 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fdf6c06b500 0x7fdf6c06d9c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fdf8815cbd0 tx=0x7fdf74008040 comp rx=0 tx=0).stop 2024-04-25T10:05:18.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.905+0000 7fdf8eaf5640 1 -- 172.21.15.7:0/541705726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf78005080 msgr2=0x7fdf880c9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:18.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.905+0000 7fdf8eaf5640 1 --2- 172.21.15.7:0/541705726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf78005080 0x7fdf880c9430 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c00f7f0 tx=0x7fdf7c00fcb0 comp rx=0 tx=0).stop 2024-04-25T10:05:18.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.905+0000 7fdf8d092640 1 -- 172.21.15.7:0/541705726 reap_dead start 2024-04-25T10:05:18.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.905+0000 7fdf8eaf5640 1 -- 172.21.15.7:0/541705726 shutdown_connections 2024-04-25T10:05:18.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.905+0000 7fdf8eaf5640 1 -- 172.21.15.7:0/541705726 >> 172.21.15.7:0/541705726 conn(0x7fdf8806c3d0 msgr2=0x7fdf8815b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:18.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.905+0000 7fdf8eaf5640 1 -- 172.21.15.7:0/541705726 shutdown_connections 2024-04-25T10:05:18.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:18.905+0000 7fdf8eaf5640 1 -- 172.21.15.7:0/541705726 wait complete. 2024-04-25T10:05:18.921 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T10:05:19.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.018+0000 7fb19d04a640 1 Processor -- start 2024-04-25T10:05:19.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.018+0000 7fb19d04a640 1 -- start start 2024-04-25T10:05:19.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.019+0000 7fb19d04a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb19815dd00 0x7fb1980b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.019+0000 7fb19d04a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb19806c6c0 0x7fb1980b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.019+0000 7fb19d04a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb19806cd00 con 0x7fb1980b6a40 2024-04-25T10:05:19.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.019+0000 7fb19d04a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb19815e0e0 con 0x7fb19806c6c0 2024-04-25T10:05:19.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.019+0000 7fb19d04a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19806cfe0 con 0x7fb19815dd00 2024-04-25T10:05:19.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.019+0000 7fb19759e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb19806c6c0 0x7fb1980b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.019+0000 7fb196d9d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb19815dd00 0x7fb1980b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.019+0000 7fb196d9d640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb19815dd00 0x7fb1980b5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.7:39752/0 (socket says 172.21.15.7:39752) 2024-04-25T10:05:19.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.019+0000 7fb19759e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb19806c6c0 0x7fb1980b5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.7:46638/0 (socket says 172.21.15.7:46638) 2024-04-25T10:05:19.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.019+0000 7fb19659c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb1980b6a40 0x7fb19806bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.7:52574/0 (socket says 172.21.15.7:52574) 2024-04-25T10:05:19.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.019+0000 7fb19759e640 1 -- 172.21.15.7:0/151595690 learned_addr learned my addr 172.21.15.7:0/151595690 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:19.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.020+0000 7fb19759e640 1 -- 172.21.15.7:0/151595690 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb19815dd00 msgr2=0x7fb1980b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:19.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.020+0000 7fb19759e640 1 --2- 172.21.15.7:0/151595690 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb19815dd00 0x7fb1980b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.020+0000 7fb19759e640 1 -- 172.21.15.7:0/151595690 >> v1:172.21.15.55:6789/0 conn(0x7fb1980b6a40 legacy=0x7fb19806bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.020+0000 7fb19759e640 1 -- 172.21.15.7:0/151595690 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1980d1ca0 con 0x7fb19806c6c0 2024-04-25T10:05:19.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.020+0000 7fb19759e640 1 --2- 172.21.15.7:0/151595690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb19806c6c0 0x7fb1980b5c90 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb190009870 tx=0x7fb19002a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98271c607ed5fd02 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:19.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.021+0000 7fb195d9b640 1 -- 172.21.15.7:0/151595690 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb190037070 con 0x7fb19806c6c0 2024-04-25T10:05:19.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.021+0000 7fb195d9b640 1 -- 172.21.15.7:0/151595690 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19002ae50 con 0x7fb19806c6c0 2024-04-25T10:05:19.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.021+0000 7fb195d9b640 1 -- 172.21.15.7:0/151595690 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb190032860 con 0x7fb19806c6c0 2024-04-25T10:05:19.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.021+0000 7fb19d04a640 1 -- 172.21.15.7:0/151595690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb19806c6c0 msgr2=0x7fb1980b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.021+0000 7fb19d04a640 1 --2- 172.21.15.7:0/151595690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb19806c6c0 0x7fb1980b5c90 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb190009870 tx=0x7fb19002a300 comp rx=0 tx=0).stop 2024-04-25T10:05:19.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.021+0000 7fb19d04a640 1 -- 172.21.15.7:0/151595690 shutdown_connections 2024-04-25T10:05:19.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.021+0000 7fb19d04a640 1 --2- 172.21.15.7:0/151595690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb19806c6c0 0x7fb1980b5c90 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.021+0000 7fb19d04a640 1 --2- 172.21.15.7:0/151595690 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb19815dd00 0x7fb1980b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.021+0000 7fb19d04a640 1 -- 172.21.15.7:0/151595690 >> 172.21.15.7:0/151595690 conn(0x7fb1980d07b0 msgr2=0x7fb1980d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:19.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.021+0000 7fb19d04a640 1 -- 172.21.15.7:0/151595690 shutdown_connections 2024-04-25T10:05:19.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.021+0000 7fb19d04a640 1 -- 172.21.15.7:0/151595690 wait complete. 2024-04-25T10:05:19.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.023+0000 7fb19d04a640 1 Processor -- start 2024-04-25T10:05:19.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.023+0000 7fb19d04a640 1 -- start start 2024-04-25T10:05:19.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.023+0000 7fb19d04a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb19806c6c0 0x7fb19815e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.023+0000 7fb19d04a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1980b6a40 0x7fb1980cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.023+0000 7fb19d04a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb19815dd00 0x7fb1980c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.023+0000 7fb19d04a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1980d2780 con 0x7fb19806c6c0 2024-04-25T10:05:19.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.023+0000 7fb19d04a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1980d2260 con 0x7fb1980b6a40 2024-04-25T10:05:19.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.023+0000 7fb19d04a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1980d2900 con 0x7fb19815dd00 2024-04-25T10:05:19.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.023+0000 7fb196d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb19806c6c0 0x7fb19815e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.023+0000 7fb196d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb19806c6c0 0x7fb19815e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45192/0 (socket says 172.21.15.7:45192) 2024-04-25T10:05:19.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.023+0000 7fb196d9d640 1 -- 172.21.15.7:0/1304282498 learned_addr learned my addr 172.21.15.7:0/1304282498 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:19.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.024+0000 7fb19659c640 1 --2- 172.21.15.7:0/1304282498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1980b6a40 0x7fb1980cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.024+0000 7fb19759e640 1 --2- 172.21.15.7:0/1304282498 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb19815dd00 0x7fb1980c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.024+0000 7fb196d9d640 1 -- 172.21.15.7:0/1304282498 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb19815dd00 msgr2=0x7fb1980c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.024+0000 7fb196d9d640 1 --2- 172.21.15.7:0/1304282498 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb19815dd00 0x7fb1980c9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.024+0000 7fb196d9d640 1 -- 172.21.15.7:0/1304282498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1980b6a40 msgr2=0x7fb1980cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.024+0000 7fb196d9d640 1 --2- 172.21.15.7:0/1304282498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1980b6a40 0x7fb1980cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.024+0000 7fb196d9d640 1 -- 172.21.15.7:0/1304282498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19815eab0 con 0x7fb19806c6c0 2024-04-25T10:05:19.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.024+0000 7fb196d9d640 1 --2- 172.21.15.7:0/1304282498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb19806c6c0 0x7fb19815e260 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7fb18800efc0 tx=0x7fb18800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:19.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.024+0000 7fb18f7fe640 1 -- 172.21.15.7:0/1304282498 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb188018020 con 0x7fb19806c6c0 2024-04-25T10:05:19.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.024+0000 7fb18f7fe640 1 -- 172.21.15.7:0/1304282498 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb188014480 con 0x7fb19806c6c0 2024-04-25T10:05:19.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.024+0000 7fb19d04a640 1 -- 172.21.15.7:0/1304282498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb19815ed90 con 0x7fb19806c6c0 2024-04-25T10:05:19.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.024+0000 7fb18f7fe640 1 -- 172.21.15.7:0/1304282498 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb188014850 con 0x7fb19806c6c0 2024-04-25T10:05:19.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.024+0000 7fb19d04a640 1 -- 172.21.15.7:0/1304282498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb19815f350 con 0x7fb19806c6c0 2024-04-25T10:05:19.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.025+0000 7fb19d04a640 1 -- 172.21.15.7:0/1304282498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb198068fd0 con 0x7fb19806c6c0 2024-04-25T10:05:19.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.026+0000 7fb18f7fe640 1 -- 172.21.15.7:0/1304282498 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb188005d10 con 0x7fb19806c6c0 2024-04-25T10:05:19.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.026+0000 7fb18f7fe640 1 --2- 172.21.15.7:0/1304282498 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb17806b4d0 0x7fb17806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.026+0000 7fb18f7fe640 1 -- 172.21.15.7:0/1304282498 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fb18808abb0 con 0x7fb19806c6c0 2024-04-25T10:05:19.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.026+0000 7fb19659c640 1 --2- 172.21.15.7:0/1304282498 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb17806b4d0 0x7fb17806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.026+0000 7fb19659c640 1 --2- 172.21.15.7:0/1304282498 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb17806b4d0 0x7fb17806d990 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb1981f70a0 tx=0x7fb180007cc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:19.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.030+0000 7fb18f7fe640 1 -- 172.21.15.7:0/1304282498 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb188022070 con 0x7fb19806c6c0 2024-04-25T10:05:19.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.211+0000 7fb19d04a640 1 -- 172.21.15.7:0/1304282498 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1980d1620 con 0x7fb17806b4d0 2024-04-25T10:05:19.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.211+0000 7fb18f7fe640 1 -- 172.21.15.7:0/1304282498 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb1980d1620 con 0x7fb17806b4d0 2024-04-25T10:05:19.217 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T10:05:19.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.213+0000 7fb19d04a640 1 -- 172.21.15.7:0/1304282498 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb17806b4d0 msgr2=0x7fb17806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.213+0000 7fb19d04a640 1 --2- 172.21.15.7:0/1304282498 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb17806b4d0 0x7fb17806d990 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb1981f70a0 tx=0x7fb180007cc0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.213+0000 7fb19d04a640 1 -- 172.21.15.7:0/1304282498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb19806c6c0 msgr2=0x7fb19815e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.213+0000 7fb19d04a640 1 --2- 172.21.15.7:0/1304282498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb19806c6c0 0x7fb19815e260 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7fb18800efc0 tx=0x7fb18800c490 comp rx=0 tx=0).stop 2024-04-25T10:05:19.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.213+0000 7fb19d04a640 1 -- 172.21.15.7:0/1304282498 shutdown_connections 2024-04-25T10:05:19.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.213+0000 7fb19d04a640 1 --2- 172.21.15.7:0/1304282498 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb17806b4d0 0x7fb17806d990 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.213+0000 7fb19d04a640 1 --2- 172.21.15.7:0/1304282498 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb19815dd00 0x7fb1980c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.213+0000 7fb19d04a640 1 --2- 172.21.15.7:0/1304282498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1980b6a40 0x7fb1980cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.213+0000 7fb19d04a640 1 --2- 172.21.15.7:0/1304282498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb19806c6c0 0x7fb19815e260 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.213+0000 7fb19d04a640 1 -- 172.21.15.7:0/1304282498 >> 172.21.15.7:0/1304282498 conn(0x7fb1980d07b0 msgr2=0x7fb1980ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:19.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.213+0000 7fb19d04a640 1 -- 172.21.15.7:0/1304282498 shutdown_connections 2024-04-25T10:05:19.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.213+0000 7fb19d04a640 1 -- 172.21.15.7:0/1304282498 wait complete. 2024-04-25T10:05:19.229 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T10:05:19.230 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:05:19.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.330+0000 7f607d730640 1 Processor -- start 2024-04-25T10:05:19.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.330+0000 7f607d730640 1 -- start start 2024-04-25T10:05:19.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.330+0000 7f607d730640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f607806da00 0x7f60780b3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.330+0000 7f607d730640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6078161600 0x7f60780b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.330+0000 7f607d730640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f607806adb0 con 0x7f607815da20 2024-04-25T10:05:19.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.330+0000 7f607d730640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f607806ab60 con 0x7f607806da00 2024-04-25T10:05:19.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.330+0000 7f607d730640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607806c560 con 0x7f6078161600 2024-04-25T10:05:19.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.331+0000 7f60767fc640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f607806da00 0x7f60780b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.331+0000 7f6076ffd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f607815da20 0x7f607806be50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45992/0 (socket says 172.21.15.7:45992) 2024-04-25T10:05:19.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.331+0000 7f6076ffd640 1 -- 172.21.15.7:0/662956755 learned_addr learned my addr 172.21.15.7:0/662956755 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:05:19.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.331+0000 7f60777fe640 1 --2- 172.21.15.7:0/662956755 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6078161600 0x7f60780b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.331+0000 7f60767fc640 1 -- 172.21.15.7:0/662956755 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6078161600 msgr2=0x7f60780b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:19.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.331+0000 7f60767fc640 1 --2- 172.21.15.7:0/662956755 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6078161600 0x7f60780b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.331+0000 7f60767fc640 1 -- 172.21.15.7:0/662956755 >> v1:172.21.15.7:6789/0 conn(0x7f607815da20 legacy=0x7f607806be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.331+0000 7f60767fc640 1 -- 172.21.15.7:0/662956755 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607806b090 con 0x7f607806da00 2024-04-25T10:05:19.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.331+0000 7f6075ffb640 1 -- 172.21.15.7:0/662956755 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582407558 0 0) 0x7f607806adb0 con 0x7f607815da20 2024-04-25T10:05:19.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.331+0000 7f60777fe640 1 --2- 172.21.15.7:0/662956755 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6078161600 0x7f60780b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:19.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.332+0000 7f60767fc640 1 --2- 172.21.15.7:0/662956755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f607806da00 0x7f60780b3060 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f606c0097a0 tx=0x7f606c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579406b29038a787 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:19.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.332+0000 7f6075ffb640 1 -- 172.21.15.7:0/662956755 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c037070 con 0x7f607806da00 2024-04-25T10:05:19.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.332+0000 7f6075ffb640 1 -- 172.21.15.7:0/662956755 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606c02ae50 con 0x7f607806da00 2024-04-25T10:05:19.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.332+0000 7f6075ffb640 1 -- 172.21.15.7:0/662956755 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c032660 con 0x7f607806da00 2024-04-25T10:05:19.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.333+0000 7f607d730640 1 -- 172.21.15.7:0/662956755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f607806da00 msgr2=0x7f60780b3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.333+0000 7f607d730640 1 --2- 172.21.15.7:0/662956755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f607806da00 0x7f60780b3060 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f606c0097a0 tx=0x7f606c02a100 comp rx=0 tx=0).stop 2024-04-25T10:05:19.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.333+0000 7f607d730640 1 -- 172.21.15.7:0/662956755 shutdown_connections 2024-04-25T10:05:19.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.333+0000 7f607d730640 1 --2- 172.21.15.7:0/662956755 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6078161600 0x7f60780b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.333+0000 7f607d730640 1 --2- 172.21.15.7:0/662956755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f607806da00 0x7f60780b3060 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.333+0000 7f607d730640 1 -- 172.21.15.7:0/662956755 >> 172.21.15.7:0/662956755 conn(0x7f60780b2300 msgr2=0x7f60780cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:19.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.333+0000 7f607d730640 1 -- 172.21.15.7:0/662956755 shutdown_connections 2024-04-25T10:05:19.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.333+0000 7f607d730640 1 -- 172.21.15.7:0/662956755 wait complete. 2024-04-25T10:05:19.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.334+0000 7f607d730640 1 Processor -- start 2024-04-25T10:05:19.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.334+0000 7f607d730640 1 -- start start 2024-04-25T10:05:19.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.335+0000 7f607d730640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f607806da00 0x7f6078150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.335+0000 7f607d730640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f607815da20 0x7f60780cf140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.335+0000 7f607d730640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6078161600 0x7f6078152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.335+0000 7f607d730640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607806b930 con 0x7f6078161600 2024-04-25T10:05:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.335+0000 7f607d730640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607806b650 con 0x7f607815da20 2024-04-25T10:05:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.335+0000 7f607d730640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607815de00 con 0x7f607806da00 2024-04-25T10:05:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.335+0000 7f60777fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6078161600 0x7f6078152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.335+0000 7f60777fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6078161600 0x7f6078152a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45208/0 (socket says 172.21.15.7:45208) 2024-04-25T10:05:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.335+0000 7f60777fe640 1 -- 172.21.15.7:0/277173307 learned_addr learned my addr 172.21.15.7:0/277173307 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.335+0000 7f6076ffd640 1 --2- 172.21.15.7:0/277173307 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f607806da00 0x7f6078150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.335+0000 7f60767fc640 1 --2- 172.21.15.7:0/277173307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f607815da20 0x7f60780cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.335+0000 7f60777fe640 1 -- 172.21.15.7:0/277173307 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f607806da00 msgr2=0x7f6078150f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.335+0000 7f60777fe640 1 --2- 172.21.15.7:0/277173307 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f607806da00 0x7f6078150f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.335+0000 7f60777fe640 1 -- 172.21.15.7:0/277173307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f607815da20 msgr2=0x7f60780cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.335+0000 7f60777fe640 1 --2- 172.21.15.7:0/277173307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f607815da20 0x7f60780cf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.335+0000 7f60777fe640 1 -- 172.21.15.7:0/277173307 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6078151670 con 0x7f6078161600 2024-04-25T10:05:19.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.335+0000 7f60767fc640 1 --2- 172.21.15.7:0/277173307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f607815da20 0x7f60780cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:19.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.335+0000 7f6076ffd640 1 --2- 172.21.15.7:0/277173307 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f607806da00 0x7f6078150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:19.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.335+0000 7f60777fe640 1 --2- 172.21.15.7:0/277173307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6078161600 0x7f6078152a90 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f607000cf20 tx=0x7f607000a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:19.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.335+0000 7f605f7fe640 1 -- 172.21.15.7:0/277173307 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607001a070 con 0x7f6078161600 2024-04-25T10:05:19.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.335+0000 7f605f7fe640 1 -- 172.21.15.7:0/277173307 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607000d840 con 0x7f6078161600 2024-04-25T10:05:19.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.335+0000 7f607d730640 1 -- 172.21.15.7:0/277173307 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6078151950 con 0x7f6078161600 2024-04-25T10:05:19.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.335+0000 7f605f7fe640 1 -- 172.21.15.7:0/277173307 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607000dc30 con 0x7f6078161600 2024-04-25T10:05:19.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.336+0000 7f607d730640 1 -- 172.21.15.7:0/277173307 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6078151f10 con 0x7f6078161600 2024-04-25T10:05:19.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.336+0000 7f607d730640 1 -- 172.21.15.7:0/277173307 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f60780cc7a0 con 0x7f6078161600 2024-04-25T10:05:19.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.337+0000 7f605f7fe640 1 -- 172.21.15.7:0/277173307 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f607001d070 con 0x7f6078161600 2024-04-25T10:05:19.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.337+0000 7f605f7fe640 1 --2- 172.21.15.7:0/277173307 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f606406b4d0 0x7f606406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.337+0000 7f605f7fe640 1 -- 172.21.15.7:0/277173307 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f607008a9e0 con 0x7f6078161600 2024-04-25T10:05:19.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.337+0000 7f6076ffd640 1 --2- 172.21.15.7:0/277173307 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f606406b4d0 0x7f606406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.338+0000 7f605f7fe640 1 --2- 172.21.15.7:0/277173307 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x7f6064071ab0 0x7f6064073ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.338+0000 7f605f7fe640 1 -- 172.21.15.7:0/277173307 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f60640745c0 con 0x7f6064071ab0 2024-04-25T10:05:19.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.338+0000 7f605f7fe640 1 -- 172.21.15.7:0/277173307 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=122) v2 ==== 24+0+0 (secure 0 0 0) 0x7f607008f2c0 con 0x7f6078161600 2024-04-25T10:05:19.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.338+0000 7f60767fc640 1 --2- 172.21.15.7:0/277173307 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x7f6064071ab0 0x7f6064073ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.338+0000 7f6076ffd640 1 --2- 172.21.15.7:0/277173307 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f606406b4d0 0x7f606406d990 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f6068000f60 tx=0x7f6068007c10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:19.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.338+0000 7f60767fc640 1 --2- 172.21.15.7:0/277173307 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x7f6064071ab0 0x7f6064073ef0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:19.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.339+0000 7f605f7fe640 1 -- 172.21.15.7:0/277173307 <== osd.1 v2:172.21.15.7:6816/434435857 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f60640745c0 con 0x7f6064071ab0 2024-04-25T10:05:19.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.352+0000 7f607d730640 1 -- 172.21.15.7:0/277173307 --> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6078069040 con 0x7f6064071ab0 2024-04-25T10:05:19.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.352+0000 7f605f7fe640 1 -- 172.21.15.7:0/277173307 <== osd.1 v2:172.21.15.7:6816/434435857 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6078069040 con 0x7f6064071ab0 2024-04-25T10:05:19.357 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:05:19.358 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:05:19.358 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:05:19.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.352+0000 7f607d730640 1 -- 172.21.15.7:0/277173307 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x7f6064071ab0 msgr2=0x7f6064073ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.352+0000 7f607d730640 1 --2- 172.21.15.7:0/277173307 >> [v2:172.21.15.7:6816/434435857,v1:172.21.15.7:6817/434435857] conn(0x7f6064071ab0 0x7f6064073ef0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.352+0000 7f607d730640 1 -- 172.21.15.7:0/277173307 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f606406b4d0 msgr2=0x7f606406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.352+0000 7f607d730640 1 --2- 172.21.15.7:0/277173307 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f606406b4d0 0x7f606406d990 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f6068000f60 tx=0x7f6068007c10 comp rx=0 tx=0).stop 2024-04-25T10:05:19.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.352+0000 7f607d730640 1 -- 172.21.15.7:0/277173307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6078161600 msgr2=0x7f6078152a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.352+0000 7f607d730640 1 --2- 172.21.15.7:0/277173307 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6078161600 0x7f6078152a90 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f607000cf20 tx=0x7f607000a7d0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.352+0000 7f60777fe640 1 -- 172.21.15.7:0/277173307 reap_dead start 2024-04-25T10:05:19.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.352+0000 7f607d730640 1 -- 172.21.15.7:0/277173307 shutdown_connections 2024-04-25T10:05:19.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.352+0000 7f607d730640 1 -- 172.21.15.7:0/277173307 >> 172.21.15.7:0/277173307 conn(0x7f60780b2300 msgr2=0x7f607815c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:19.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.353+0000 7f607d730640 1 -- 172.21.15.7:0/277173307 shutdown_connections 2024-04-25T10:05:19.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.353+0000 7f607d730640 1 -- 172.21.15.7:0/277173307 wait complete. 2024-04-25T10:05:19.368 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T10:05:19.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.464+0000 7f74f3de7640 1 Processor -- start 2024-04-25T10:05:19.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.464+0000 7f74f3de7640 1 -- start start 2024-04-25T10:05:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.465+0000 7f74f3de7640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f74ec15da60 0x7f74ec0d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.465+0000 7f74f3de7640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74ec15e2d0 0x7f74ec0ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.465+0000 7f74f3de7640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74ec15e8a0 con 0x7f74ec15de40 2024-04-25T10:05:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.465+0000 7f74f3de7640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74ec15eb80 con 0x7f74ec15da60 2024-04-25T10:05:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.465+0000 7f74f3de7640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec15ee60 con 0x7f74ec15e2d0 2024-04-25T10:05:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.465+0000 7f74f1b83640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f74ec15da60 0x7f74ec0d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.465+0000 7f74f1b83640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f74ec15da60 0x7f74ec0d0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45216/0 (socket says 172.21.15.7:45216) 2024-04-25T10:05:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.465+0000 7f74f1b83640 1 -- 172.21.15.7:0/100961653 learned_addr learned my addr 172.21.15.7:0/100961653 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.465+0000 7f74f1382640 1 --1- 172.21.15.7:0/100961653 >> v1:172.21.15.7:6789/0 conn(0x7f74ec15de40 0x7f74ec161d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:46000/0 (socket says 172.21.15.7:46000) 2024-04-25T10:05:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.465+0000 7f74f2384640 1 --2- 172.21.15.7:0/100961653 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74ec15e2d0 0x7f74ec0ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.465+0000 7f74f1b83640 1 -- 172.21.15.7:0/100961653 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74ec15e2d0 msgr2=0x7f74ec0ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.465+0000 7f74f1b83640 1 --2- 172.21.15.7:0/100961653 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74ec15e2d0 0x7f74ec0ce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.465+0000 7f74f1b83640 1 -- 172.21.15.7:0/100961653 >> v1:172.21.15.7:6789/0 conn(0x7f74ec15de40 legacy=0x7f74ec161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.465+0000 7f74f1b83640 1 -- 172.21.15.7:0/100961653 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ec161850 con 0x7f74ec15da60 2024-04-25T10:05:19.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.466+0000 7f74f1b83640 1 --2- 172.21.15.7:0/100961653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74ec15da60 0x7f74ec0d0aa0 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f74e8009870 tx=0x7f74e802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=101db1905a729774 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:19.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.466+0000 7f74f0b81640 1 -- 172.21.15.7:0/100961653 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e8037070 con 0x7f74ec15da60 2024-04-25T10:05:19.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.466+0000 7f74f0b81640 1 -- 172.21.15.7:0/100961653 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e8032440 con 0x7f74ec15da60 2024-04-25T10:05:19.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.466+0000 7f74f0b81640 1 -- 172.21.15.7:0/100961653 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e8032810 con 0x7f74ec15da60 2024-04-25T10:05:19.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.467+0000 7f74f3de7640 1 -- 172.21.15.7:0/100961653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74ec15da60 msgr2=0x7f74ec0d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.467+0000 7f74f3de7640 1 --2- 172.21.15.7:0/100961653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74ec15da60 0x7f74ec0d0aa0 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f74e8009870 tx=0x7f74e802a1c0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.467+0000 7f74f3de7640 1 -- 172.21.15.7:0/100961653 shutdown_connections 2024-04-25T10:05:19.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.467+0000 7f74f3de7640 1 --2- 172.21.15.7:0/100961653 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74ec15e2d0 0x7f74ec0ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.467+0000 7f74f3de7640 1 --2- 172.21.15.7:0/100961653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74ec15da60 0x7f74ec0d0aa0 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.467+0000 7f74f3de7640 1 -- 172.21.15.7:0/100961653 >> 172.21.15.7:0/100961653 conn(0x7f74ec06bfe0 msgr2=0x7f74ec06c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:19.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.467+0000 7f74f3de7640 1 -- 172.21.15.7:0/100961653 shutdown_connections 2024-04-25T10:05:19.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.467+0000 7f74f3de7640 1 -- 172.21.15.7:0/100961653 wait complete. 2024-04-25T10:05:19.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.468+0000 7f74f3de7640 1 Processor -- start 2024-04-25T10:05:19.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.468+0000 7f74f3de7640 1 -- start start 2024-04-25T10:05:19.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.469+0000 7f74f3de7640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74ec15da60 0x7f74ec156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.469+0000 7f74f3de7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74ec15de40 0x7f74ec1595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.469+0000 7f74f3de7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74ec15e2d0 0x7f74ec0b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.469+0000 7f74f3de7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec0cebe0 con 0x7f74ec15e2d0 2024-04-25T10:05:19.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.469+0000 7f74f3de7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec0cea60 con 0x7f74ec15de40 2024-04-25T10:05:19.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.469+0000 7f74f3de7640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec0ced60 con 0x7f74ec15da60 2024-04-25T10:05:19.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.469+0000 7f74f2384640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74ec15e2d0 0x7f74ec0b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.469+0000 7f74f2384640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74ec15e2d0 0x7f74ec0b5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45220/0 (socket says 172.21.15.7:45220) 2024-04-25T10:05:19.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.469+0000 7f74f2384640 1 -- 172.21.15.7:0/3792313603 learned_addr learned my addr 172.21.15.7:0/3792313603 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:19.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.469+0000 7f74f1382640 1 --2- 172.21.15.7:0/3792313603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74ec15de40 0x7f74ec1595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.469+0000 7f74f1b83640 1 --2- 172.21.15.7:0/3792313603 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74ec15da60 0x7f74ec156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.469+0000 7f74f2384640 1 -- 172.21.15.7:0/3792313603 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74ec15da60 msgr2=0x7f74ec156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.469+0000 7f74f2384640 1 --2- 172.21.15.7:0/3792313603 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74ec15da60 0x7f74ec156d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.469+0000 7f74f2384640 1 -- 172.21.15.7:0/3792313603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74ec15de40 msgr2=0x7f74ec1595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.469+0000 7f74f2384640 1 --2- 172.21.15.7:0/3792313603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74ec15de40 0x7f74ec1595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.469+0000 7f74f2384640 1 -- 172.21.15.7:0/3792313603 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ec15a920 con 0x7f74ec15e2d0 2024-04-25T10:05:19.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.469+0000 7f74f2384640 1 --2- 172.21.15.7:0/3792313603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74ec15e2d0 0x7f74ec0b5460 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f74e4007e40 tx=0x7f74e400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:19.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.469+0000 7f74e27fc640 1 -- 172.21.15.7:0/3792313603 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e4014620 con 0x7f74ec15e2d0 2024-04-25T10:05:19.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.469+0000 7f74e27fc640 1 -- 172.21.15.7:0/3792313603 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e4019070 con 0x7f74ec15e2d0 2024-04-25T10:05:19.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.469+0000 7f74f3de7640 1 -- 172.21.15.7:0/3792313603 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74ec15a080 con 0x7f74ec15e2d0 2024-04-25T10:05:19.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.469+0000 7f74e27fc640 1 -- 172.21.15.7:0/3792313603 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e4014a20 con 0x7f74ec15e2d0 2024-04-25T10:05:19.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.470+0000 7f74f3de7640 1 -- 172.21.15.7:0/3792313603 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74ec15a640 con 0x7f74ec15e2d0 2024-04-25T10:05:19.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.471+0000 7f74f3de7640 1 -- 172.21.15.7:0/3792313603 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74ec068fd0 con 0x7f74ec15e2d0 2024-04-25T10:05:19.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.471+0000 7f74e27fc640 1 -- 172.21.15.7:0/3792313603 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f74e4014bc0 con 0x7f74ec15e2d0 2024-04-25T10:05:19.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.471+0000 7f74e27fc640 1 --2- 172.21.15.7:0/3792313603 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f74d006b500 0x7f74d006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.472+0000 7f74f1b83640 1 --2- 172.21.15.7:0/3792313603 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f74d006b500 0x7f74d006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.472+0000 7f74e27fc640 1 -- 172.21.15.7:0/3792313603 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f74e408a980 con 0x7f74ec15e2d0 2024-04-25T10:05:19.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.472+0000 7f74f1b83640 1 --2- 172.21.15.7:0/3792313603 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f74d006b500 0x7f74d006d9c0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f74e8034000 tx=0x7f74e802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:19.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.476+0000 7f74e27fc640 1 -- 172.21.15.7:0/3792313603 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f74e4059950 con 0x7f74ec15e2d0 2024-04-25T10:05:19.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.655+0000 7f74f3de7640 1 -- 172.21.15.7:0/3792313603 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f74ec0d1560 con 0x7f74d006b500 2024-04-25T10:05:19.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.655+0000 7f74e27fc640 1 -- 172.21.15.7:0/3792313603 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f74ec0d1560 con 0x7f74d006b500 2024-04-25T10:05:19.661 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T10:05:19.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.657+0000 7f74f3de7640 1 -- 172.21.15.7:0/3792313603 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f74d006b500 msgr2=0x7f74d006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.657+0000 7f74f3de7640 1 --2- 172.21.15.7:0/3792313603 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f74d006b500 0x7f74d006d9c0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f74e8034000 tx=0x7f74e802e000 comp rx=0 tx=0).stop 2024-04-25T10:05:19.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.657+0000 7f74f3de7640 1 -- 172.21.15.7:0/3792313603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74ec15e2d0 msgr2=0x7f74ec0b5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.657+0000 7f74f3de7640 1 --2- 172.21.15.7:0/3792313603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74ec15e2d0 0x7f74ec0b5460 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f74e4007e40 tx=0x7f74e400e4b0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.657+0000 7f74f3de7640 1 -- 172.21.15.7:0/3792313603 shutdown_connections 2024-04-25T10:05:19.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.657+0000 7f74f3de7640 1 --2- 172.21.15.7:0/3792313603 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f74d006b500 0x7f74d006d9c0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.657+0000 7f74f3de7640 1 --2- 172.21.15.7:0/3792313603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74ec15e2d0 0x7f74ec0b5460 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.657+0000 7f74f3de7640 1 --2- 172.21.15.7:0/3792313603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74ec15de40 0x7f74ec1595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.657+0000 7f74f3de7640 1 --2- 172.21.15.7:0/3792313603 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74ec15da60 0x7f74ec156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.657+0000 7f74f3de7640 1 -- 172.21.15.7:0/3792313603 >> 172.21.15.7:0/3792313603 conn(0x7f74ec06bfe0 msgr2=0x7f74ec160d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:19.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.657+0000 7f74f3de7640 1 -- 172.21.15.7:0/3792313603 shutdown_connections 2024-04-25T10:05:19.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.657+0000 7f74f3de7640 1 -- 172.21.15.7:0/3792313603 wait complete. 2024-04-25T10:05:19.674 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T10:05:19.674 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:05:19.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.774+0000 7f4a0c30a640 1 Processor -- start 2024-04-25T10:05:19.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.774+0000 7f4a0c30a640 1 -- start start 2024-04-25T10:05:19.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.775+0000 7f4a0c30a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4a040cc8f0 0x7f4a040ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.775+0000 7f4a0c30a640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a0406d780 con 0x7f4a041426a0 2024-04-25T10:05:19.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.775+0000 7f4a0c30a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a0406da60 con 0x7f4a04142010 2024-04-25T10:05:19.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.775+0000 7f4a0c30a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a041423f0 con 0x7f4a040cc8f0 2024-04-25T10:05:19.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.775+0000 7f4a0a8a7640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f4a041426a0 0x7f4a04142af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48796/0 (socket says 172.21.15.7:48796) 2024-04-25T10:05:19.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.775+0000 7f4a0a8a7640 1 -- 172.21.15.7:0/765479469 learned_addr learned my addr 172.21.15.7:0/765479469 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:05:19.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.775+0000 7f4a090a4640 1 -- 172.21.15.7:0/765479469 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3510147565 0 0) 0x7f4a0406d780 con 0x7f4a041426a0 2024-04-25T10:05:19.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.775+0000 7f4a090a4640 1 -- 172.21.15.7:0/765479469 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49ec003520 con 0x7f4a041426a0 2024-04-25T10:05:19.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.775+0000 7f4a098a5640 1 --2- 172.21.15.7:0/765479469 >> v2:172.21.15.55:3300/0 conn(0x7f4a040cc8f0 0x7f4a040ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.775+0000 7f4a090a4640 1 -- 172.21.15.7:0/765479469 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4192679870 0 0) 0x7f49ec003520 con 0x7f4a041426a0 2024-04-25T10:05:19.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.776+0000 7f4a090a4640 1 -- 172.21.15.7:0/765479469 >> v2:172.21.15.55:3300/0 conn(0x7f4a040cc8f0 msgr2=0x7f4a040ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:19.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.776+0000 7f4a090a4640 1 --2- 172.21.15.7:0/765479469 >> v2:172.21.15.55:3300/0 conn(0x7f4a040cc8f0 0x7f4a040ccd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.776+0000 7f4a090a4640 1 -- 172.21.15.7:0/765479469 >> v1:172.21.15.55:6789/0 conn(0x7f4a04142010 legacy=0x7f4a0406e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.776+0000 7f4a090a4640 1 -- 172.21.15.7:0/765479469 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a0406dd40 con 0x7f4a041426a0 2024-04-25T10:05:19.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.776+0000 7f4a090a4640 1 -- 172.21.15.7:0/765479469 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f49f40019f0 con 0x7f4a041426a0 2024-04-25T10:05:19.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.776+0000 7f4a090a4640 1 -- 172.21.15.7:0/765479469 >> v1:172.21.15.7:6789/0 conn(0x7f4a041426a0 legacy=0x7f4a04142af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.776+0000 7f4a090a4640 1 --2- 172.21.15.7:0/765479469 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f49ec0039b0 0x7f49ec003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.776+0000 7f4a090a4640 1 --2- 172.21.15.7:0/765479469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49ec004800 0x7f49ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.776+0000 7f4a090a4640 1 --2- 172.21.15.7:0/765479469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49ec0051c0 0x7f49ec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.776+0000 7f4a090a4640 1 -- 172.21.15.7:0/765479469 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a041423f0 con 0x7f49ec0051c0 2024-04-25T10:05:19.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.776+0000 7f4a090a4640 1 -- 172.21.15.7:0/765479469 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec00c090 con 0x7f49ec004800 2024-04-25T10:05:19.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.776+0000 7f4a090a4640 1 -- 172.21.15.7:0/765479469 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec00c290 con 0x7f49ec0039b0 2024-04-25T10:05:19.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.776+0000 7f4a0a8a7640 1 --2- 172.21.15.7:0/765479469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49ec0051c0 0x7f49ec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.776+0000 7f4a0a0a6640 1 --2- 172.21.15.7:0/765479469 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f49ec0039b0 0x7f49ec003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.776+0000 7f4a098a5640 1 --2- 172.21.15.7:0/765479469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49ec004800 0x7f49ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.776+0000 7f4a0a8a7640 1 -- 172.21.15.7:0/765479469 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f49ec0039b0 msgr2=0x7f49ec003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:19.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.776+0000 7f4a0a8a7640 1 --2- 172.21.15.7:0/765479469 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f49ec0039b0 0x7f49ec003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.776+0000 7f4a0a8a7640 1 -- 172.21.15.7:0/765479469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49ec004800 msgr2=0x7f49ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:19.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.776+0000 7f4a0a8a7640 1 --2- 172.21.15.7:0/765479469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49ec004800 0x7f49ec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.776+0000 7f4a0a8a7640 1 -- 172.21.15.7:0/765479469 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ec003520 con 0x7f49ec0051c0 2024-04-25T10:05:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.776+0000 7f4a098a5640 1 --2- 172.21.15.7:0/765479469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49ec004800 0x7f49ec004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.777+0000 7f4a0a8a7640 1 -- 172.21.15.7:0/765479469 reap_dead start 2024-04-25T10:05:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.777+0000 7f4a0a8a7640 1 --2- 172.21.15.7:0/765479469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49ec0051c0 0x7f49ec00b9c0 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f49f400a840 tx=0x7f49ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2470d99e47fb6a59 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.777+0000 7f4a090a4640 1 -- 172.21.15.7:0/765479469 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f400a460 con 0x7f49ec0051c0 2024-04-25T10:05:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.777+0000 7f4a090a4640 1 -- 172.21.15.7:0/765479469 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f402f070 con 0x7f49ec0051c0 2024-04-25T10:05:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.777+0000 7f4a090a4640 1 -- 172.21.15.7:0/765479469 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f402bcb0 con 0x7f49ec0051c0 2024-04-25T10:05:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.777+0000 7f4a0c30a640 1 -- 172.21.15.7:0/765479469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49ec0051c0 msgr2=0x7f49ec00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.777+0000 7f4a0c30a640 1 --2- 172.21.15.7:0/765479469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49ec0051c0 0x7f49ec00b9c0 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f49f400a840 tx=0x7f49ec005830 comp rx=0 tx=0).stop 2024-04-25T10:05:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.778+0000 7f4a0c30a640 1 -- 172.21.15.7:0/765479469 shutdown_connections 2024-04-25T10:05:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.778+0000 7f4a0c30a640 1 --2- 172.21.15.7:0/765479469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49ec0051c0 0x7f49ec00b9c0 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.778+0000 7f4a0c30a640 1 -- 172.21.15.7:0/765479469 >> 172.21.15.7:0/765479469 conn(0x7f4a04066f80 msgr2=0x7f4a0406ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.778+0000 7f4a0c30a640 1 -- 172.21.15.7:0/765479469 shutdown_connections 2024-04-25T10:05:19.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.778+0000 7f4a0c30a640 1 -- 172.21.15.7:0/765479469 wait complete. 2024-04-25T10:05:19.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.779+0000 7f4a0c30a640 1 Processor -- start 2024-04-25T10:05:19.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.779+0000 7f4a0c30a640 1 -- start start 2024-04-25T10:05:19.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.779+0000 7f4a0c30a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49ec0051c0 0x7f4a040c4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.779+0000 7f4a0c30a640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4a0415a630 0x7f4a041f4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.780+0000 7f4a0c30a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a041f5150 0x7f4a041f55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.780+0000 7f4a0c30a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0406e300 con 0x7f4a041f5150 2024-04-25T10:05:19.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.780+0000 7f4a0c30a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a040cc210 con 0x7f49ec0051c0 2024-04-25T10:05:19.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.780+0000 7f4a0c30a640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a040ccd80 con 0x7f4a0415a630 2024-04-25T10:05:19.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.780+0000 7f4a0a8a7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a041f5150 0x7f4a041f55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.780+0000 7f4a0a8a7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a041f5150 0x7f4a041f55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43444/0 (socket says 172.21.15.7:43444) 2024-04-25T10:05:19.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.780+0000 7f4a0a8a7640 1 -- 172.21.15.7:0/791836220 learned_addr learned my addr 172.21.15.7:0/791836220 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:19.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.780+0000 7f4a0a8a7640 1 -- 172.21.15.7:0/791836220 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4a0415a630 msgr2=0x7f4a041f4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.780+0000 7f4a0a8a7640 1 --2- 172.21.15.7:0/791836220 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4a0415a630 0x7f4a041f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.780+0000 7f4a0a8a7640 1 -- 172.21.15.7:0/791836220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49ec0051c0 msgr2=0x7f4a040c4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.780+0000 7f4a0a8a7640 1 --2- 172.21.15.7:0/791836220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49ec0051c0 0x7f4a040c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.780+0000 7f4a0a8a7640 1 -- 172.21.15.7:0/791836220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a040c4f80 con 0x7f4a041f5150 2024-04-25T10:05:19.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.780+0000 7f4a0a8a7640 1 --2- 172.21.15.7:0/791836220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a041f5150 0x7f4a041f55d0 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f49f400a930 tx=0x7f4a0406dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:19.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.780+0000 7f4a02ffd640 1 -- 172.21.15.7:0/791836220 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f400a460 con 0x7f4a041f5150 2024-04-25T10:05:19.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.780+0000 7f4a02ffd640 1 -- 172.21.15.7:0/791836220 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f4001250 con 0x7f4a041f5150 2024-04-25T10:05:19.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.780+0000 7f4a02ffd640 1 -- 172.21.15.7:0/791836220 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f4001fb0 con 0x7f4a041f5150 2024-04-25T10:05:19.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.780+0000 7f4a0c30a640 1 -- 172.21.15.7:0/791836220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a040c5260 con 0x7f4a041f5150 2024-04-25T10:05:19.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.780+0000 7f4a0c30a640 1 -- 172.21.15.7:0/791836220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a040ac180 con 0x7f4a041f5150 2024-04-25T10:05:19.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.781+0000 7f4a0c30a640 1 -- 172.21.15.7:0/791836220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4a040b54f0 con 0x7f4a041f5150 2024-04-25T10:05:19.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.782+0000 7f4a02ffd640 1 -- 172.21.15.7:0/791836220 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f49f40348b0 con 0x7f4a041f5150 2024-04-25T10:05:19.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.782+0000 7f4a02ffd640 1 --2- 172.21.15.7:0/791836220 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f49f006b500 0x7f49f006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.782+0000 7f4a02ffd640 1 -- 172.21.15.7:0/791836220 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f49f40aa3e0 con 0x7f4a041f5150 2024-04-25T10:05:19.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.782+0000 7f4a0a0a6640 1 --2- 172.21.15.7:0/791836220 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f49f006b500 0x7f49f006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.782+0000 7f4a02ffd640 1 --2- 172.21.15.7:0/791836220 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x7f49f0071ae0 0x7f49f0073f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.782+0000 7f4a02ffd640 1 -- 172.21.15.7:0/791836220 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f49f00745f0 con 0x7f49f0071ae0 2024-04-25T10:05:19.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.782+0000 7f4a02ffd640 1 -- 172.21.15.7:0/791836220 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=122) v2 ==== 24+0+0 (secure 0 0 0) 0x7f49f40b1050 con 0x7f4a041f5150 2024-04-25T10:05:19.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.783+0000 7f4a098a5640 1 --2- 172.21.15.7:0/791836220 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x7f49f0071ae0 0x7f49f0073f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.783+0000 7f4a0a0a6640 1 --2- 172.21.15.7:0/791836220 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f49f006b500 0x7f49f006d9c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f49fc000c00 tx=0x7f49fc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:19.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.783+0000 7f4a098a5640 1 --2- 172.21.15.7:0/791836220 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x7f49f0071ae0 0x7f49f0073f20 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:19.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.783+0000 7f4a02ffd640 1 -- 172.21.15.7:0/791836220 <== osd.2 v2:172.21.15.7:6808/1173474863 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f49f00745f0 con 0x7f49f0071ae0 2024-04-25T10:05:19.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.797+0000 7f4a0c30a640 1 -- 172.21.15.7:0/791836220 --> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4a04069040 con 0x7f49f0071ae0 2024-04-25T10:05:19.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.797+0000 7f4a02ffd640 1 -- 172.21.15.7:0/791836220 <== osd.2 v2:172.21.15.7:6808/1173474863 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f4a04069040 con 0x7f49f0071ae0 2024-04-25T10:05:19.802 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:05:19.805 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:05:19.806 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:05:19.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.797+0000 7f4a0c30a640 1 -- 172.21.15.7:0/791836220 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x7f49f0071ae0 msgr2=0x7f49f0073f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.797+0000 7f4a0c30a640 1 --2- 172.21.15.7:0/791836220 >> [v2:172.21.15.7:6808/1173474863,v1:172.21.15.7:6809/1173474863] conn(0x7f49f0071ae0 0x7f49f0073f20 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.797+0000 7f4a0c30a640 1 -- 172.21.15.7:0/791836220 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f49f006b500 msgr2=0x7f49f006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.797+0000 7f4a0c30a640 1 --2- 172.21.15.7:0/791836220 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f49f006b500 0x7f49f006d9c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f49fc000c00 tx=0x7f49fc009040 comp rx=0 tx=0).stop 2024-04-25T10:05:19.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.797+0000 7f4a0c30a640 1 -- 172.21.15.7:0/791836220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a041f5150 msgr2=0x7f4a041f55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.797+0000 7f4a0c30a640 1 --2- 172.21.15.7:0/791836220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a041f5150 0x7f4a041f55d0 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f49f400a930 tx=0x7f4a0406dc30 comp rx=0 tx=0).stop 2024-04-25T10:05:19.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.797+0000 7f4a0a8a7640 1 -- 172.21.15.7:0/791836220 reap_dead start 2024-04-25T10:05:19.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.797+0000 7f4a0c30a640 1 -- 172.21.15.7:0/791836220 shutdown_connections 2024-04-25T10:05:19.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.797+0000 7f4a0c30a640 1 -- 172.21.15.7:0/791836220 >> 172.21.15.7:0/791836220 conn(0x7f4a04066f80 msgr2=0x7f4a040aee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:19.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.797+0000 7f4a0c30a640 1 -- 172.21.15.7:0/791836220 shutdown_connections 2024-04-25T10:05:19.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.797+0000 7f4a0c30a640 1 -- 172.21.15.7:0/791836220 wait complete. 2024-04-25T10:05:19.813 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T10:05:19.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.909+0000 7f447233b640 1 Processor -- start 2024-04-25T10:05:19.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.910+0000 7f447233b640 1 -- start start 2024-04-25T10:05:19.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.910+0000 7f447233b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f446c15da60 0x7f446c0d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.910+0000 7f447233b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f446c15de40 0x7f446c15e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.910+0000 7f447233b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f446c161d70 0x7f446c1621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.910+0000 7f447233b640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f446c15e8a0 con 0x7f446c161d70 2024-04-25T10:05:19.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.910+0000 7f447233b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f446c15eb80 con 0x7f446c15de40 2024-04-25T10:05:19.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.910+0000 7f447233b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446c15ee60 con 0x7f446c15da60 2024-04-25T10:05:19.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.911+0000 7f44708d8640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f446c161d70 0x7f446c1621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.911+0000 7f44708d8640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f446c161d70 0x7f446c1621e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43452/0 (socket says 172.21.15.7:43452) 2024-04-25T10:05:19.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.911+0000 7f44708d8640 1 -- 172.21.15.7:0/2857730613 learned_addr learned my addr 172.21.15.7:0/2857730613 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:19.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.911+0000 7f446bfff640 1 --2- 172.21.15.7:0/2857730613 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f446c15da60 0x7f446c0d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.911+0000 7f446b7fe640 1 --2- 172.21.15.7:0/2857730613 >> v2:172.21.15.55:3300/0 conn(0x7f446c15de40 0x7f446c15e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.911+0000 7f44708d8640 1 -- 172.21.15.7:0/2857730613 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f446c15da60 msgr2=0x7f446c0d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:19.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.911+0000 7f44708d8640 1 --2- 172.21.15.7:0/2857730613 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f446c15da60 0x7f446c0d0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.911+0000 7f44708d8640 1 -- 172.21.15.7:0/2857730613 >> v2:172.21.15.55:3300/0 conn(0x7f446c15de40 msgr2=0x7f446c15e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:19.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.911+0000 7f44708d8640 1 --2- 172.21.15.7:0/2857730613 >> v2:172.21.15.55:3300/0 conn(0x7f446c15de40 0x7f446c15e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.911+0000 7f44708d8640 1 -- 172.21.15.7:0/2857730613 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c161850 con 0x7f446c161d70 2024-04-25T10:05:19.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.912+0000 7f44708d8640 1 --2- 172.21.15.7:0/2857730613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f446c161d70 0x7f446c1621e0 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f446c0b6440 tx=0x7f446402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09a97a8684e76ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:19.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.912+0000 7f446affd640 1 -- 172.21.15.7:0/2857730613 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4464036070 con 0x7f446c161d70 2024-04-25T10:05:19.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.912+0000 7f446affd640 1 -- 172.21.15.7:0/2857730613 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4464031600 con 0x7f446c161d70 2024-04-25T10:05:19.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.912+0000 7f446affd640 1 -- 172.21.15.7:0/2857730613 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44640319d0 con 0x7f446c161d70 2024-04-25T10:05:19.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.912+0000 7f447233b640 1 -- 172.21.15.7:0/2857730613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f446c161d70 msgr2=0x7f446c1621e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.912+0000 7f447233b640 1 --2- 172.21.15.7:0/2857730613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f446c161d70 0x7f446c1621e0 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f446c0b6440 tx=0x7f446402a610 comp rx=0 tx=0).stop 2024-04-25T10:05:19.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.912+0000 7f447233b640 1 -- 172.21.15.7:0/2857730613 shutdown_connections 2024-04-25T10:05:19.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.912+0000 7f447233b640 1 --2- 172.21.15.7:0/2857730613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f446c161d70 0x7f446c1621e0 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.912+0000 7f447233b640 1 --2- 172.21.15.7:0/2857730613 >> v2:172.21.15.55:3300/0 conn(0x7f446c15de40 0x7f446c15e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.912+0000 7f447233b640 1 --2- 172.21.15.7:0/2857730613 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f446c15da60 0x7f446c0d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.912+0000 7f447233b640 1 -- 172.21.15.7:0/2857730613 >> 172.21.15.7:0/2857730613 conn(0x7f446c06bfe0 msgr2=0x7f446c06c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:19.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.912+0000 7f447233b640 1 -- 172.21.15.7:0/2857730613 shutdown_connections 2024-04-25T10:05:19.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.912+0000 7f447233b640 1 -- 172.21.15.7:0/2857730613 wait complete. 2024-04-25T10:05:19.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.914+0000 7f447233b640 1 Processor -- start 2024-04-25T10:05:19.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.914+0000 7f447233b640 1 -- start start 2024-04-25T10:05:19.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.914+0000 7f447233b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f446c15da60 0x7f446c149d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.914+0000 7f447233b640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f446c15de40 0x7f446c0aa220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.914+0000 7f447233b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f446c161d70 0x7f446c14b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.914+0000 7f447233b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0ce8f0 con 0x7f446c161d70 2024-04-25T10:05:19.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.914+0000 7f447233b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0ce770 con 0x7f446c15da60 2024-04-25T10:05:19.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.914+0000 7f447233b640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0cea70 con 0x7f446c15de40 2024-04-25T10:05:19.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.915+0000 7f44708d8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f446c161d70 0x7f446c14b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.915+0000 7f44708d8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f446c161d70 0x7f446c14b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43458/0 (socket says 172.21.15.7:43458) 2024-04-25T10:05:19.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.915+0000 7f44708d8640 1 -- 172.21.15.7:0/533424161 learned_addr learned my addr 172.21.15.7:0/533424161 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:19.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.915+0000 7f446bfff640 1 --2- 172.21.15.7:0/533424161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f446c15da60 0x7f446c149d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.915+0000 7f446b7fe640 1 --2- 172.21.15.7:0/533424161 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f446c15de40 0x7f446c0aa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.915+0000 7f44708d8640 1 -- 172.21.15.7:0/533424161 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f446c15de40 msgr2=0x7f446c0aa220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.915+0000 7f44708d8640 1 --2- 172.21.15.7:0/533424161 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f446c15de40 0x7f446c0aa220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.915+0000 7f44708d8640 1 -- 172.21.15.7:0/533424161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f446c15da60 msgr2=0x7f446c149d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.915+0000 7f44708d8640 1 --2- 172.21.15.7:0/533424161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f446c15da60 0x7f446c149d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.915+0000 7f44708d8640 1 -- 172.21.15.7:0/533424161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c14a390 con 0x7f446c161d70 2024-04-25T10:05:19.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.915+0000 7f44708d8640 1 --2- 172.21.15.7:0/533424161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f446c161d70 0x7f446c14b430 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f4464034040 tx=0x7f4464004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:19.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.915+0000 7f4468ff9640 1 -- 172.21.15.7:0/533424161 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4464036050 con 0x7f446c161d70 2024-04-25T10:05:19.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.915+0000 7f4468ff9640 1 -- 172.21.15.7:0/533424161 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4464042070 con 0x7f446c161d70 2024-04-25T10:05:19.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.915+0000 7f447233b640 1 -- 172.21.15.7:0/533424161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f446c14a670 con 0x7f446c161d70 2024-04-25T10:05:19.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.915+0000 7f4468ff9640 1 -- 172.21.15.7:0/533424161 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4464009510 con 0x7f446c161d70 2024-04-25T10:05:19.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.915+0000 7f447233b640 1 -- 172.21.15.7:0/533424161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f446c14ac30 con 0x7f446c161d70 2024-04-25T10:05:19.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.916+0000 7f447233b640 1 -- 172.21.15.7:0/533424161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f446c068fd0 con 0x7f446c161d70 2024-04-25T10:05:19.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.917+0000 7f4468ff9640 1 -- 172.21.15.7:0/533424161 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4464007bd0 con 0x7f446c161d70 2024-04-25T10:05:19.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.917+0000 7f4468ff9640 1 --2- 172.21.15.7:0/533424161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f445806b4d0 0x7f445806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.917+0000 7f4468ff9640 1 -- 172.21.15.7:0/533424161 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f44640aafe0 con 0x7f446c161d70 2024-04-25T10:05:19.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.917+0000 7f446bfff640 1 --2- 172.21.15.7:0/533424161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f445806b4d0 0x7f445806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.918+0000 7f446bfff640 1 --2- 172.21.15.7:0/533424161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f445806b4d0 0x7f445806d990 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f445c006fd0 tx=0x7f445c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:19.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:19.921+0000 7f4468ff9640 1 -- 172.21.15.7:0/533424161 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f44640798d0 con 0x7f446c161d70 2024-04-25T10:05:20.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.101+0000 7f447233b640 1 -- 172.21.15.7:0/533424161 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f446c15d150 con 0x7f445806b4d0 2024-04-25T10:05:20.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.102+0000 7f4468ff9640 1 -- 172.21.15.7:0/533424161 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f445c004020 con 0x7f445806b4d0 2024-04-25T10:05:20.107 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T10:05:20.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.104+0000 7f447233b640 1 -- 172.21.15.7:0/533424161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f445806b4d0 msgr2=0x7f445806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.104+0000 7f447233b640 1 --2- 172.21.15.7:0/533424161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f445806b4d0 0x7f445806d990 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f445c006fd0 tx=0x7f445c008040 comp rx=0 tx=0).stop 2024-04-25T10:05:20.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.104+0000 7f447233b640 1 -- 172.21.15.7:0/533424161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f446c161d70 msgr2=0x7f446c14b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.104+0000 7f447233b640 1 --2- 172.21.15.7:0/533424161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f446c161d70 0x7f446c14b430 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f4464034040 tx=0x7f4464004a40 comp rx=0 tx=0).stop 2024-04-25T10:05:20.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.104+0000 7f447233b640 1 -- 172.21.15.7:0/533424161 shutdown_connections 2024-04-25T10:05:20.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.104+0000 7f447233b640 1 --2- 172.21.15.7:0/533424161 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f445806b4d0 0x7f445806d990 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.104+0000 7f447233b640 1 --2- 172.21.15.7:0/533424161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f446c161d70 0x7f446c14b430 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.104+0000 7f447233b640 1 --2- 172.21.15.7:0/533424161 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f446c15de40 0x7f446c0aa220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.104+0000 7f447233b640 1 --2- 172.21.15.7:0/533424161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f446c15da60 0x7f446c149d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.104+0000 7f447233b640 1 -- 172.21.15.7:0/533424161 >> 172.21.15.7:0/533424161 conn(0x7f446c06bfe0 msgr2=0x7f446c0cc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:20.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.104+0000 7f447233b640 1 -- 172.21.15.7:0/533424161 shutdown_connections 2024-04-25T10:05:20.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.104+0000 7f447233b640 1 -- 172.21.15.7:0/533424161 wait complete. 2024-04-25T10:05:20.120 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T10:05:20.120 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:05:20.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.219+0000 7fab0d876640 1 Processor -- start 2024-04-25T10:05:20.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.219+0000 7fab0d876640 1 -- start start 2024-04-25T10:05:20.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.220+0000 7fab0d876640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab080d0f20 0x7fab080b8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.220+0000 7fab0d876640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab080cee00 con 0x7fab080ce900 2024-04-25T10:05:20.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.220+0000 7fab0d876640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab080b7750 con 0x7fab0815d9b0 2024-04-25T10:05:20.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.220+0000 7fab0d876640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab080b7500 con 0x7fab080d0f20 2024-04-25T10:05:20.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.220+0000 7fab077fe640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fab080ce900 0x7fab080b8770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48802/0 (socket says 172.21.15.7:48802) 2024-04-25T10:05:20.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.220+0000 7fab077fe640 1 -- 172.21.15.7:0/4151729630 learned_addr learned my addr 172.21.15.7:0/4151729630 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:05:20.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.220+0000 7fab067fc640 1 --2- 172.21.15.7:0/4151729630 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab080d0f20 0x7fab080b8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.220+0000 7fab05ffb640 1 -- 172.21.15.7:0/4151729630 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 467944726 0 0) 0x7fab080cee00 con 0x7fab080ce900 2024-04-25T10:05:20.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.220+0000 7fab05ffb640 1 -- 172.21.15.7:0/4151729630 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaf4003520 con 0x7fab080ce900 2024-04-25T10:05:20.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.220+0000 7fab05ffb640 1 -- 172.21.15.7:0/4151729630 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1137517067 0 0) 0x7fab080b7750 con 0x7fab0815d9b0 2024-04-25T10:05:20.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.220+0000 7fab05ffb640 1 -- 172.21.15.7:0/4151729630 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab080cee00 con 0x7fab0815d9b0 2024-04-25T10:05:20.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.221+0000 7fab067fc640 1 -- 172.21.15.7:0/4151729630 >> v1:172.21.15.55:6789/0 conn(0x7fab0815d9b0 legacy=0x7fab080d0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.221+0000 7fab067fc640 1 -- 172.21.15.7:0/4151729630 >> v1:172.21.15.7:6789/0 conn(0x7fab080ce900 legacy=0x7fab080b8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.221+0000 7fab067fc640 1 -- 172.21.15.7:0/4151729630 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab080b7a30 con 0x7fab080d0f20 2024-04-25T10:05:20.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.221+0000 7fab067fc640 1 --2- 172.21.15.7:0/4151729630 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab080d0f20 0x7fab080b8230 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7faaf00097d0 tx=0x7faaf002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93c9240325945500 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:20.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.222+0000 7fab05ffb640 1 -- 172.21.15.7:0/4151729630 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf0037070 con 0x7fab080d0f20 2024-04-25T10:05:20.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.222+0000 7fab05ffb640 1 -- 172.21.15.7:0/4151729630 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf0032440 con 0x7fab080d0f20 2024-04-25T10:05:20.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.222+0000 7fab05ffb640 1 -- 172.21.15.7:0/4151729630 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf00327f0 con 0x7fab080d0f20 2024-04-25T10:05:20.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.222+0000 7fab0d876640 1 -- 172.21.15.7:0/4151729630 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab080d0f20 msgr2=0x7fab080b8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.222+0000 7fab0d876640 1 --2- 172.21.15.7:0/4151729630 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab080d0f20 0x7fab080b8230 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7faaf00097d0 tx=0x7faaf002a210 comp rx=0 tx=0).stop 2024-04-25T10:05:20.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.222+0000 7fab0d876640 1 -- 172.21.15.7:0/4151729630 shutdown_connections 2024-04-25T10:05:20.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.222+0000 7fab0d876640 1 --2- 172.21.15.7:0/4151729630 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab080d0f20 0x7fab080b8230 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.222+0000 7fab0d876640 1 -- 172.21.15.7:0/4151729630 >> 172.21.15.7:0/4151729630 conn(0x7fab080726b0 msgr2=0x7fab08072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:20.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.222+0000 7fab0d876640 1 -- 172.21.15.7:0/4151729630 shutdown_connections 2024-04-25T10:05:20.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.222+0000 7fab0d876640 1 -- 172.21.15.7:0/4151729630 wait complete. 2024-04-25T10:05:20.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.223+0000 7fab0d876640 1 Processor -- start 2024-04-25T10:05:20.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.223+0000 7fab0d876640 1 -- start start 2024-04-25T10:05:20.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.224+0000 7fab0d876640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab080ce900 0x7fab08160990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.224+0000 7fab0d876640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab080d0f20 0x7fab0815f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.224+0000 7fab0d876640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab0815d9b0 0x7fab08154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.224+0000 7fab0d876640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab080b2bc0 con 0x7fab080ce900 2024-04-25T10:05:20.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.224+0000 7fab0d876640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0815dd90 con 0x7fab080d0f20 2024-04-25T10:05:20.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.224+0000 7fab0d876640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab080b2d40 con 0x7fab0815d9b0 2024-04-25T10:05:20.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.224+0000 7fab06ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab080ce900 0x7fab08160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.224+0000 7fab06ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab080ce900 0x7fab08160990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43466/0 (socket says 172.21.15.7:43466) 2024-04-25T10:05:20.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.224+0000 7fab06ffd640 1 -- 172.21.15.7:0/3646370363 learned_addr learned my addr 172.21.15.7:0/3646370363 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:20.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.224+0000 7fab077fe640 1 --2- 172.21.15.7:0/3646370363 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab0815d9b0 0x7fab08154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.224+0000 7fab067fc640 1 --2- 172.21.15.7:0/3646370363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab080d0f20 0x7fab0815f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.225+0000 7fab06ffd640 1 -- 172.21.15.7:0/3646370363 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab0815d9b0 msgr2=0x7fab08154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.225+0000 7fab06ffd640 1 --2- 172.21.15.7:0/3646370363 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab0815d9b0 0x7fab08154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.225+0000 7fab06ffd640 1 -- 172.21.15.7:0/3646370363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab080d0f20 msgr2=0x7fab0815f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.225+0000 7fab06ffd640 1 --2- 172.21.15.7:0/3646370363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab080d0f20 0x7fab0815f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.225+0000 7fab06ffd640 1 -- 172.21.15.7:0/3646370363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab0815e3a0 con 0x7fab080ce900 2024-04-25T10:05:20.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.225+0000 7fab06ffd640 1 --2- 172.21.15.7:0/3646370363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab080ce900 0x7fab08160990 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7faaf800c870 tx=0x7faaf800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:20.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.225+0000 7faafffff640 1 -- 172.21.15.7:0/3646370363 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf8003b70 con 0x7fab080ce900 2024-04-25T10:05:20.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.225+0000 7faafffff640 1 -- 172.21.15.7:0/3646370363 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf8003d30 con 0x7fab080ce900 2024-04-25T10:05:20.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.225+0000 7fab0d876640 1 -- 172.21.15.7:0/3646370363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab0815e680 con 0x7fab080ce900 2024-04-25T10:05:20.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.225+0000 7faafffff640 1 -- 172.21.15.7:0/3646370363 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf800aa90 con 0x7fab080ce900 2024-04-25T10:05:20.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.225+0000 7fab0d876640 1 -- 172.21.15.7:0/3646370363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab0815ec40 con 0x7fab080ce900 2024-04-25T10:05:20.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.226+0000 7fab0d876640 1 -- 172.21.15.7:0/3646370363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fab0815f980 con 0x7fab080ce900 2024-04-25T10:05:20.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.226+0000 7faafffff640 1 -- 172.21.15.7:0/3646370363 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faaf800ac30 con 0x7fab080ce900 2024-04-25T10:05:20.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.227+0000 7faafffff640 1 --2- 172.21.15.7:0/3646370363 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faae806b500 0x7faae806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.227+0000 7faafffff640 1 -- 172.21.15.7:0/3646370363 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5507+0+0 (secure 0 0 0) 0x7faaf8089f90 con 0x7fab080ce900 2024-04-25T10:05:20.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.227+0000 7fab067fc640 1 --2- 172.21.15.7:0/3646370363 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faae806b500 0x7faae806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.227+0000 7faafffff640 1 --2- 172.21.15.7:0/3646370363 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x7faae8071ae0 0x7faae8073f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.227+0000 7faafffff640 1 -- 172.21.15.7:0/3646370363 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faae80745f0 con 0x7faae8071ae0 2024-04-25T10:05:20.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.227+0000 7faafffff640 1 -- 172.21.15.7:0/3646370363 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=122) v2 ==== 24+0+0 (secure 0 0 0) 0x7faaf8091050 con 0x7fab080ce900 2024-04-25T10:05:20.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.227+0000 7fab077fe640 1 --2- 172.21.15.7:0/3646370363 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x7faae8071ae0 0x7faae8073f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.228+0000 7fab077fe640 1 --2- 172.21.15.7:0/3646370363 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x7faae8071ae0 0x7faae8073f20 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:20.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.228+0000 7fab067fc640 1 --2- 172.21.15.7:0/3646370363 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faae806b500 0x7faae806d9c0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7faaf0034000 tx=0x7faaf002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:20.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.228+0000 7faafffff640 1 -- 172.21.15.7:0/3646370363 <== osd.3 v2:172.21.15.7:6824/3045538953 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7faae80745f0 con 0x7faae8071ae0 2024-04-25T10:05:20.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.241+0000 7fab0d876640 1 -- 172.21.15.7:0/3646370363 --> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fab08069040 con 0x7faae8071ae0 2024-04-25T10:05:20.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.242+0000 7faafffff640 1 -- 172.21.15.7:0/3646370363 <== osd.3 v2:172.21.15.7:6824/3045538953 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fab08069040 con 0x7faae8071ae0 2024-04-25T10:05:20.247 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:05:20.247 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:05:20.247 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:05:20.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.242+0000 7fab0d876640 1 -- 172.21.15.7:0/3646370363 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x7faae8071ae0 msgr2=0x7faae8073f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.242+0000 7fab0d876640 1 --2- 172.21.15.7:0/3646370363 >> [v2:172.21.15.7:6824/3045538953,v1:172.21.15.7:6825/3045538953] conn(0x7faae8071ae0 0x7faae8073f20 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.242+0000 7fab0d876640 1 -- 172.21.15.7:0/3646370363 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faae806b500 msgr2=0x7faae806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.242+0000 7fab0d876640 1 --2- 172.21.15.7:0/3646370363 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7faae806b500 0x7faae806d9c0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7faaf0034000 tx=0x7faaf002e000 comp rx=0 tx=0).stop 2024-04-25T10:05:20.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.242+0000 7fab0d876640 1 -- 172.21.15.7:0/3646370363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab080ce900 msgr2=0x7fab08160990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.242+0000 7fab0d876640 1 --2- 172.21.15.7:0/3646370363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab080ce900 0x7fab08160990 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7faaf800c870 tx=0x7faaf800cd30 comp rx=0 tx=0).stop 2024-04-25T10:05:20.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.242+0000 7fab077fe640 1 -- 172.21.15.7:0/3646370363 reap_dead start 2024-04-25T10:05:20.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.242+0000 7fab0d876640 1 -- 172.21.15.7:0/3646370363 shutdown_connections 2024-04-25T10:05:20.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.242+0000 7fab0d876640 1 -- 172.21.15.7:0/3646370363 >> 172.21.15.7:0/3646370363 conn(0x7fab080726b0 msgr2=0x7fab080b4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:20.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.242+0000 7fab0d876640 1 -- 172.21.15.7:0/3646370363 shutdown_connections 2024-04-25T10:05:20.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.242+0000 7fab0d876640 1 -- 172.21.15.7:0/3646370363 wait complete. 2024-04-25T10:05:20.258 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T10:05:20.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.354+0000 7f8db615c640 1 Processor -- start 2024-04-25T10:05:20.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.354+0000 7f8db615c640 1 -- start start 2024-04-25T10:05:20.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.355+0000 7f8db615c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8db015dd00 0x7f8db00b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.355+0000 7f8db615c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8db006c6c0 0x7f8db00b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.355+0000 7f8db615c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8db006cd00 con 0x7f8db00b6a40 2024-04-25T10:05:20.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.355+0000 7f8db615c640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8db015e0e0 con 0x7f8db006c6c0 2024-04-25T10:05:20.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.355+0000 7f8db615c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8db006cfe0 con 0x7f8db015dd00 2024-04-25T10:05:20.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.355+0000 7f8daffff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8db006c6c0 0x7f8db00b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.355+0000 7f8daffff640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8db006c6c0 0x7f8db00b5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43476/0 (socket says 172.21.15.7:43476) 2024-04-25T10:05:20.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.355+0000 7f8daffff640 1 -- 172.21.15.7:0/2760162607 learned_addr learned my addr 172.21.15.7:0/2760162607 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:20.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.355+0000 7f8daf7fe640 1 --2- 172.21.15.7:0/2760162607 >> v2:172.21.15.55:3300/0 conn(0x7f8db015dd00 0x7f8db00b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.356+0000 7f8daffff640 1 -- 172.21.15.7:0/2760162607 >> v2:172.21.15.55:3300/0 conn(0x7f8db015dd00 msgr2=0x7f8db00b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:20.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.356+0000 7f8daffff640 1 --2- 172.21.15.7:0/2760162607 >> v2:172.21.15.55:3300/0 conn(0x7f8db015dd00 0x7f8db00b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.356+0000 7f8daffff640 1 -- 172.21.15.7:0/2760162607 >> v1:172.21.15.55:6789/0 conn(0x7f8db00b6a40 legacy=0x7f8db006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.356+0000 7f8daffff640 1 -- 172.21.15.7:0/2760162607 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db00d1ca0 con 0x7f8db006c6c0 2024-04-25T10:05:20.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.356+0000 7f8daffff640 1 --2- 172.21.15.7:0/2760162607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8db006c6c0 0x7f8db00b5c90 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f8db00d4920 tx=0x7f8da802a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f495b16c4d139be2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:20.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.356+0000 7f8dae7fc640 1 -- 172.21.15.7:0/2760162607 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da8036070 con 0x7f8db006c6c0 2024-04-25T10:05:20.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.356+0000 7f8dae7fc640 1 -- 172.21.15.7:0/2760162607 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da8031600 con 0x7f8db006c6c0 2024-04-25T10:05:20.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.356+0000 7f8dae7fc640 1 -- 172.21.15.7:0/2760162607 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da80319f0 con 0x7f8db006c6c0 2024-04-25T10:05:20.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.357+0000 7f8db615c640 1 -- 172.21.15.7:0/2760162607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8db006c6c0 msgr2=0x7f8db00b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.357+0000 7f8db615c640 1 --2- 172.21.15.7:0/2760162607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8db006c6c0 0x7f8db00b5c90 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f8db00d4920 tx=0x7f8da802a7c0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.357+0000 7f8db615c640 1 -- 172.21.15.7:0/2760162607 shutdown_connections 2024-04-25T10:05:20.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.357+0000 7f8db615c640 1 --2- 172.21.15.7:0/2760162607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8db006c6c0 0x7f8db00b5c90 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.357+0000 7f8db615c640 1 --2- 172.21.15.7:0/2760162607 >> v2:172.21.15.55:3300/0 conn(0x7f8db015dd00 0x7f8db00b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.357+0000 7f8db615c640 1 -- 172.21.15.7:0/2760162607 >> 172.21.15.7:0/2760162607 conn(0x7f8db00d07b0 msgr2=0x7f8db00d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:20.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.357+0000 7f8db615c640 1 -- 172.21.15.7:0/2760162607 shutdown_connections 2024-04-25T10:05:20.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.357+0000 7f8db615c640 1 -- 172.21.15.7:0/2760162607 wait complete. 2024-04-25T10:05:20.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.358+0000 7f8db615c640 1 Processor -- start 2024-04-25T10:05:20.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.358+0000 7f8db615c640 1 -- start start 2024-04-25T10:05:20.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.359+0000 7f8db615c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8db006c6c0 0x7f8db00cab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.359+0000 7f8db615c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db00b6a40 0x7f8db00c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.359+0000 7f8db615c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8db015dd00 0x7f8db00b6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.359+0000 7f8db615c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db00d2780 con 0x7f8db006c6c0 2024-04-25T10:05:20.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.359+0000 7f8db615c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db00d2260 con 0x7f8db00b6a40 2024-04-25T10:05:20.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.359+0000 7f8db615c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db00d2900 con 0x7f8db015dd00 2024-04-25T10:05:20.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.359+0000 7f8daf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8db006c6c0 0x7f8db00cab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.359+0000 7f8daf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8db006c6c0 0x7f8db00cab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43480/0 (socket says 172.21.15.7:43480) 2024-04-25T10:05:20.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.359+0000 7f8daf7fe640 1 -- 172.21.15.7:0/3663825960 learned_addr learned my addr 172.21.15.7:0/3663825960 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:20.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.359+0000 7f8daeffd640 1 --2- 172.21.15.7:0/3663825960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db00b6a40 0x7f8db00c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.359+0000 7f8daffff640 1 --2- 172.21.15.7:0/3663825960 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8db015dd00 0x7f8db00b6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.359+0000 7f8daf7fe640 1 -- 172.21.15.7:0/3663825960 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8db015dd00 msgr2=0x7f8db00b6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.359+0000 7f8daf7fe640 1 --2- 172.21.15.7:0/3663825960 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8db015dd00 0x7f8db00b6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.359+0000 7f8daf7fe640 1 -- 172.21.15.7:0/3663825960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db00b6a40 msgr2=0x7f8db00c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.359+0000 7f8daf7fe640 1 --2- 172.21.15.7:0/3663825960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db00b6a40 0x7f8db00c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.359+0000 7f8daf7fe640 1 -- 172.21.15.7:0/3663825960 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db00cd7c0 con 0x7f8db006c6c0 2024-04-25T10:05:20.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.360+0000 7f8daf7fe640 1 --2- 172.21.15.7:0/3663825960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8db006c6c0 0x7f8db00cab30 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7f8da000e870 tx=0x7f8da000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:20.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.360+0000 7f8d97fff640 1 -- 172.21.15.7:0/3663825960 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da0017070 con 0x7f8db006c6c0 2024-04-25T10:05:20.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.360+0000 7f8d97fff640 1 -- 172.21.15.7:0/3663825960 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da000c940 con 0x7f8db006c6c0 2024-04-25T10:05:20.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.360+0000 7f8db615c640 1 -- 172.21.15.7:0/3663825960 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8db015e3f0 con 0x7f8db006c6c0 2024-04-25T10:05:20.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.360+0000 7f8d97fff640 1 -- 172.21.15.7:0/3663825960 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da000cd30 con 0x7f8db006c6c0 2024-04-25T10:05:20.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.360+0000 7f8db615c640 1 -- 172.21.15.7:0/3663825960 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8db015e9b0 con 0x7f8db006c6c0 2024-04-25T10:05:20.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.361+0000 7f8db615c640 1 -- 172.21.15.7:0/3663825960 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8db0068fd0 con 0x7f8db006c6c0 2024-04-25T10:05:20.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.361+0000 7f8d97fff640 1 -- 172.21.15.7:0/3663825960 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8da001a070 con 0x7f8db006c6c0 2024-04-25T10:05:20.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.362+0000 7f8d97fff640 1 --2- 172.21.15.7:0/3663825960 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8d9c06b4d0 0x7f8d9c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.362+0000 7f8d97fff640 1 -- 172.21.15.7:0/3663825960 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f8da008a3d0 con 0x7f8db006c6c0 2024-04-25T10:05:20.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.362+0000 7f8daeffd640 1 --2- 172.21.15.7:0/3663825960 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8d9c06b4d0 0x7f8d9c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.362+0000 7f8daeffd640 1 --2- 172.21.15.7:0/3663825960 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8d9c06b4d0 0x7f8d9c06d990 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f8db0155e80 tx=0x7f8da4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:20.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.366+0000 7f8d97fff640 1 -- 172.21.15.7:0/3663825960 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8da0059300 con 0x7f8db006c6c0 2024-04-25T10:05:20.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.546+0000 7f8db615c640 1 -- 172.21.15.7:0/3663825960 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f8db00680c0 con 0x7f8d9c06b4d0 2024-04-25T10:05:20.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.546+0000 7f8d97fff640 1 -- 172.21.15.7:0/3663825960 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8da40050d0 con 0x7f8d9c06b4d0 2024-04-25T10:05:20.552 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T10:05:20.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.548+0000 7f8db615c640 1 -- 172.21.15.7:0/3663825960 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8d9c06b4d0 msgr2=0x7f8d9c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.548+0000 7f8db615c640 1 --2- 172.21.15.7:0/3663825960 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8d9c06b4d0 0x7f8d9c06d990 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f8db0155e80 tx=0x7f8da4009040 comp rx=0 tx=0).stop 2024-04-25T10:05:20.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.548+0000 7f8db615c640 1 -- 172.21.15.7:0/3663825960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8db006c6c0 msgr2=0x7f8db00cab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.548+0000 7f8db615c640 1 --2- 172.21.15.7:0/3663825960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8db006c6c0 0x7f8db00cab30 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7f8da000e870 tx=0x7f8da000ed30 comp rx=0 tx=0).stop 2024-04-25T10:05:20.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.548+0000 7f8db615c640 1 -- 172.21.15.7:0/3663825960 shutdown_connections 2024-04-25T10:05:20.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.548+0000 7f8db615c640 1 --2- 172.21.15.7:0/3663825960 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f8d9c06b4d0 0x7f8d9c06d990 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.548+0000 7f8db615c640 1 --2- 172.21.15.7:0/3663825960 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8db015dd00 0x7f8db00b6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.548+0000 7f8db615c640 1 --2- 172.21.15.7:0/3663825960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db00b6a40 0x7f8db00c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.548+0000 7f8db615c640 1 --2- 172.21.15.7:0/3663825960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8db006c6c0 0x7f8db00cab30 unknown :-1 s=CLOSED pgs=2000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.548+0000 7f8db615c640 1 -- 172.21.15.7:0/3663825960 >> 172.21.15.7:0/3663825960 conn(0x7f8db00d07b0 msgr2=0x7f8db00c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:20.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.548+0000 7f8db615c640 1 -- 172.21.15.7:0/3663825960 shutdown_connections 2024-04-25T10:05:20.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.549+0000 7f8db615c640 1 -- 172.21.15.7:0/3663825960 wait complete. 2024-04-25T10:05:20.564 INFO:tasks.ceph:Scrubbing osd.4 2024-04-25T10:05:20.565 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:05:20.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.664+0000 7f624715c640 1 Processor -- start 2024-04-25T10:05:20.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.664+0000 7f624715c640 1 -- start start 2024-04-25T10:05:20.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.665+0000 7f624715c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f624015de70 0x7f62400d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.665+0000 7f624715c640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62400d2290 con 0x7f62400d3f10 2024-04-25T10:05:20.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.665+0000 7f624715c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62400d2570 con 0x7f62400d3330 2024-04-25T10:05:20.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.665+0000 7f624715c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62400d2850 con 0x7f624015de70 2024-04-25T10:05:20.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.665+0000 7f62456f9640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f62400d3f10 0x7f62400b6a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48816/0 (socket says 172.21.15.7:48816) 2024-04-25T10:05:20.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.665+0000 7f62456f9640 1 -- 172.21.15.7:0/1147715274 learned_addr learned my addr 172.21.15.7:0/1147715274 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:05:20.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.665+0000 7f6244ef8640 1 --2- 172.21.15.7:0/1147715274 >> v2:172.21.15.55:3300/0 conn(0x7f624015de70 0x7f62400d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.666+0000 7f62377fe640 1 -- 172.21.15.7:0/1147715274 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 777711854 0 0) 0x7f62400d2290 con 0x7f62400d3f10 2024-04-25T10:05:20.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.666+0000 7f62377fe640 1 -- 172.21.15.7:0/1147715274 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6228003520 con 0x7f62400d3f10 2024-04-25T10:05:20.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.666+0000 7f62377fe640 1 -- 172.21.15.7:0/1147715274 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4159135199 0 0) 0x7f6228003520 con 0x7f62400d3f10 2024-04-25T10:05:20.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.666+0000 7f6244ef8640 1 -- 172.21.15.7:0/1147715274 >> v1:172.21.15.55:6789/0 conn(0x7f62400d3330 legacy=0x7f62400d3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.666+0000 7f6244ef8640 1 -- 172.21.15.7:0/1147715274 >> v1:172.21.15.7:6789/0 conn(0x7f62400d3f10 legacy=0x7f62400b6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.666+0000 7f6244ef8640 1 -- 172.21.15.7:0/1147715274 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62400d2b30 con 0x7f624015de70 2024-04-25T10:05:20.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.667+0000 7f6244ef8640 1 --2- 172.21.15.7:0/1147715274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f624015de70 0x7f62400d1920 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f623c0097a0 tx=0x7f623c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9199ca2fc916ac3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:20.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.676+0000 7f62377fe640 1 -- 172.21.15.7:0/1147715274 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c037070 con 0x7f624015de70 2024-04-25T10:05:20.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.676+0000 7f62377fe640 1 -- 172.21.15.7:0/1147715274 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623c02ac50 con 0x7f624015de70 2024-04-25T10:05:20.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.676+0000 7f62377fe640 1 -- 172.21.15.7:0/1147715274 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62380019f0 con 0x7f624015de70 2024-04-25T10:05:20.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.676+0000 7f624715c640 1 -- 172.21.15.7:0/1147715274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f624015de70 msgr2=0x7f62400d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.676+0000 7f624715c640 1 --2- 172.21.15.7:0/1147715274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f624015de70 0x7f62400d1920 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f623c0097a0 tx=0x7f623c02a1c0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.676+0000 7f624715c640 1 -- 172.21.15.7:0/1147715274 shutdown_connections 2024-04-25T10:05:20.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.676+0000 7f624715c640 1 --2- 172.21.15.7:0/1147715274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f624015de70 0x7f62400d1920 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.676+0000 7f624715c640 1 -- 172.21.15.7:0/1147715274 >> 172.21.15.7:0/1147715274 conn(0x7f62400726b0 msgr2=0x7f6240072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:20.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.677+0000 7f624715c640 1 -- 172.21.15.7:0/1147715274 shutdown_connections 2024-04-25T10:05:20.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.677+0000 7f624715c640 1 -- 172.21.15.7:0/1147715274 wait complete. 2024-04-25T10:05:20.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.678+0000 7f624715c640 1 Processor -- start 2024-04-25T10:05:20.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.678+0000 7f624715c640 1 -- start start 2024-04-25T10:05:20.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.679+0000 7f624715c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62400d3330 0x7f6240151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.679+0000 7f624715c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62400d3f10 0x7f62400cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.679+0000 7f624715c640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f624015de70 0x7f62400cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.679+0000 7f624715c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62400d1fe0 con 0x7f62400d3f10 2024-04-25T10:05:20.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.679+0000 7f624715c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62400d1e60 con 0x7f62400d3330 2024-04-25T10:05:20.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.679+0000 7f624715c640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62400b9290 con 0x7f624015de70 2024-04-25T10:05:20.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.679+0000 7f6237fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62400d3f10 0x7f62400cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.679+0000 7f6237fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62400d3f10 0x7f62400cbf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43496/0 (socket says 172.21.15.7:43496) 2024-04-25T10:05:20.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.679+0000 7f6237fff640 1 -- 172.21.15.7:0/4053848265 learned_addr learned my addr 172.21.15.7:0/4053848265 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:20.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.679+0000 7f6244ef8640 1 --2- 172.21.15.7:0/4053848265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62400d3330 0x7f6240151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.679+0000 7f62456f9640 1 --2- 172.21.15.7:0/4053848265 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f624015de70 0x7f62400cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.679+0000 7f6237fff640 1 -- 172.21.15.7:0/4053848265 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f624015de70 msgr2=0x7f62400cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.679+0000 7f6237fff640 1 --2- 172.21.15.7:0/4053848265 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f624015de70 0x7f62400cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.679+0000 7f6237fff640 1 -- 172.21.15.7:0/4053848265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62400d3330 msgr2=0x7f6240151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.679+0000 7f6237fff640 1 --2- 172.21.15.7:0/4053848265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62400d3330 0x7f6240151d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.679+0000 7f6237fff640 1 -- 172.21.15.7:0/4053848265 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624015e3d0 con 0x7f62400d3f10 2024-04-25T10:05:20.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.679+0000 7f6237fff640 1 --2- 172.21.15.7:0/4053848265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62400d3f10 0x7f62400cbf30 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f623000c400 tx=0x7f623000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:20.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.679+0000 7f62357fa640 1 -- 172.21.15.7:0/4053848265 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6230017070 con 0x7f62400d3f10 2024-04-25T10:05:20.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.679+0000 7f62357fa640 1 -- 172.21.15.7:0/4053848265 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62300052d0 con 0x7f62400d3f10 2024-04-25T10:05:20.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.679+0000 7f624715c640 1 -- 172.21.15.7:0/4053848265 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f624015e6b0 con 0x7f62400d3f10 2024-04-25T10:05:20.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.679+0000 7f62357fa640 1 -- 172.21.15.7:0/4053848265 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6230003830 con 0x7f62400d3f10 2024-04-25T10:05:20.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.680+0000 7f624715c640 1 -- 172.21.15.7:0/4053848265 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62400cc9b0 con 0x7f62400d3f10 2024-04-25T10:05:20.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.680+0000 7f624715c640 1 -- 172.21.15.7:0/4053848265 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6240069040 con 0x7f62400d3f10 2024-04-25T10:05:20.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.681+0000 7f62357fa640 1 -- 172.21.15.7:0/4053848265 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f623001a070 con 0x7f62400d3f10 2024-04-25T10:05:20.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.681+0000 7f62357fa640 1 --2- 172.21.15.7:0/4053848265 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f622c06b4d0 0x7f622c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.682+0000 7f62357fa640 1 -- 172.21.15.7:0/4053848265 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f6230089490 con 0x7f62400d3f10 2024-04-25T10:05:20.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.682+0000 7f6244ef8640 1 --2- 172.21.15.7:0/4053848265 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f622c06b4d0 0x7f622c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.682+0000 7f62357fa640 1 --2- 172.21.15.7:0/4053848265 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x7f622c071ab0 0x7f622c073ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.682+0000 7f62357fa640 1 -- 172.21.15.7:0/4053848265 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f622c0745c0 con 0x7f622c071ab0 2024-04-25T10:05:20.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.682+0000 7f62357fa640 1 -- 172.21.15.7:0/4053848265 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=122) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6230090050 con 0x7f62400d3f10 2024-04-25T10:05:20.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.682+0000 7f62456f9640 1 --2- 172.21.15.7:0/4053848265 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x7f622c071ab0 0x7f622c073ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.682+0000 7f6244ef8640 1 --2- 172.21.15.7:0/4053848265 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f622c06b4d0 0x7f622c06d990 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f623c034000 tx=0x7f623c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:20.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.682+0000 7f62456f9640 1 --2- 172.21.15.7:0/4053848265 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x7f622c071ab0 0x7f622c073ef0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:20.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.683+0000 7f62357fa640 1 -- 172.21.15.7:0/4053848265 <== osd.4 v2:172.21.15.55:6808/2248155105 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f622c0745c0 con 0x7f622c071ab0 2024-04-25T10:05:20.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.697+0000 7f624715c640 1 -- 172.21.15.7:0/4053848265 --> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6240068030 con 0x7f622c071ab0 2024-04-25T10:05:20.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.697+0000 7f62357fa640 1 -- 172.21.15.7:0/4053848265 <== osd.4 v2:172.21.15.55:6808/2248155105 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6240068030 con 0x7f622c071ab0 2024-04-25T10:05:20.703 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:05:20.703 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:05:20.703 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:05:20.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.698+0000 7f624715c640 1 -- 172.21.15.7:0/4053848265 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x7f622c071ab0 msgr2=0x7f622c073ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.698+0000 7f624715c640 1 --2- 172.21.15.7:0/4053848265 >> [v2:172.21.15.55:6808/2248155105,v1:172.21.15.55:6809/2248155105] conn(0x7f622c071ab0 0x7f622c073ef0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.698+0000 7f624715c640 1 -- 172.21.15.7:0/4053848265 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f622c06b4d0 msgr2=0x7f622c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.698+0000 7f624715c640 1 --2- 172.21.15.7:0/4053848265 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f622c06b4d0 0x7f622c06d990 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f623c034000 tx=0x7f623c02e000 comp rx=0 tx=0).stop 2024-04-25T10:05:20.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.698+0000 7f624715c640 1 -- 172.21.15.7:0/4053848265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62400d3f10 msgr2=0x7f62400cbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.698+0000 7f624715c640 1 --2- 172.21.15.7:0/4053848265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62400d3f10 0x7f62400cbf30 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f623000c400 tx=0x7f623000c8c0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.698+0000 7f62456f9640 1 -- 172.21.15.7:0/4053848265 reap_dead start 2024-04-25T10:05:20.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.698+0000 7f624715c640 1 -- 172.21.15.7:0/4053848265 shutdown_connections 2024-04-25T10:05:20.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.698+0000 7f624715c640 1 -- 172.21.15.7:0/4053848265 >> 172.21.15.7:0/4053848265 conn(0x7f62400726b0 msgr2=0x7f624015c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:20.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.698+0000 7f624715c640 1 -- 172.21.15.7:0/4053848265 shutdown_connections 2024-04-25T10:05:20.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.698+0000 7f624715c640 1 -- 172.21.15.7:0/4053848265 wait complete. 2024-04-25T10:05:20.714 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-25T10:05:20.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.811+0000 7f243ab89640 1 Processor -- start 2024-04-25T10:05:20.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.811+0000 7f243ab89640 1 -- start start 2024-04-25T10:05:20.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.812+0000 7f243ab89640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f243415dd00 0x7f24340b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.812+0000 7f243ab89640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f243406c6c0 0x7f24340b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.812+0000 7f243ab89640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f243406cd00 con 0x7f24340b6a40 2024-04-25T10:05:20.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.812+0000 7f243ab89640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f243415e0e0 con 0x7f243415dd00 2024-04-25T10:05:20.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.812+0000 7f243ab89640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f243406cfe0 con 0x7f243406c6c0 2024-04-25T10:05:20.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.812+0000 7f2438925640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f243415dd00 0x7f24340b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.812+0000 7f2438925640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f243415dd00 0x7f24340b5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43506/0 (socket says 172.21.15.7:43506) 2024-04-25T10:05:20.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.812+0000 7f2438925640 1 -- 172.21.15.7:0/1457217685 learned_addr learned my addr 172.21.15.7:0/1457217685 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:20.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.812+0000 7f2439126640 1 --2- 172.21.15.7:0/1457217685 >> v2:172.21.15.55:3300/0 conn(0x7f243406c6c0 0x7f24340b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.812+0000 7f2438925640 1 -- 172.21.15.7:0/1457217685 >> v2:172.21.15.55:3300/0 conn(0x7f243406c6c0 msgr2=0x7f24340b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:20.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.812+0000 7f2438925640 1 --2- 172.21.15.7:0/1457217685 >> v2:172.21.15.55:3300/0 conn(0x7f243406c6c0 0x7f24340b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.812+0000 7f2438925640 1 -- 172.21.15.7:0/1457217685 >> v1:172.21.15.55:6789/0 conn(0x7f24340b6a40 legacy=0x7f243406bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:20.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.812+0000 7f2438925640 1 -- 172.21.15.7:0/1457217685 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24340d1ca0 con 0x7f243415dd00 2024-04-25T10:05:20.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.812+0000 7f2439126640 1 --2- 172.21.15.7:0/1457217685 >> v2:172.21.15.55:3300/0 conn(0x7f243406c6c0 0x7f24340b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:20.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.813+0000 7f2438925640 1 --2- 172.21.15.7:0/1457217685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f243415dd00 0x7f24340b5750 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f24340d0270 tx=0x7f242802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebfe5e6c61dc9512 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:20.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.813+0000 7f24337fe640 1 -- 172.21.15.7:0/1457217685 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2428037070 con 0x7f243415dd00 2024-04-25T10:05:20.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.813+0000 7f24337fe640 1 -- 172.21.15.7:0/1457217685 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242802ae50 con 0x7f243415dd00 2024-04-25T10:05:20.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.813+0000 7f24337fe640 1 -- 172.21.15.7:0/1457217685 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2428032860 con 0x7f243415dd00 2024-04-25T10:05:20.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.814+0000 7f243ab89640 1 -- 172.21.15.7:0/1457217685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f243415dd00 msgr2=0x7f24340b5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.814+0000 7f243ab89640 1 --2- 172.21.15.7:0/1457217685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f243415dd00 0x7f24340b5750 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f24340d0270 tx=0x7f242802a300 comp rx=0 tx=0).stop 2024-04-25T10:05:20.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.814+0000 7f243ab89640 1 -- 172.21.15.7:0/1457217685 shutdown_connections 2024-04-25T10:05:20.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.814+0000 7f243ab89640 1 --2- 172.21.15.7:0/1457217685 >> v2:172.21.15.55:3300/0 conn(0x7f243406c6c0 0x7f24340b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.814+0000 7f243ab89640 1 --2- 172.21.15.7:0/1457217685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f243415dd00 0x7f24340b5750 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.814+0000 7f243ab89640 1 -- 172.21.15.7:0/1457217685 >> 172.21.15.7:0/1457217685 conn(0x7f24340d07b0 msgr2=0x7f24340d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:20.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.814+0000 7f243ab89640 1 -- 172.21.15.7:0/1457217685 shutdown_connections 2024-04-25T10:05:20.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.814+0000 7f243ab89640 1 -- 172.21.15.7:0/1457217685 wait complete. 2024-04-25T10:05:20.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.815+0000 7f243ab89640 1 Processor -- start 2024-04-25T10:05:20.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.815+0000 7f243ab89640 1 -- start start 2024-04-25T10:05:20.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.816+0000 7f243ab89640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f243406c6c0 0x7f24340c9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.816+0000 7f243ab89640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f24340b6a40 0x7f243414d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.816+0000 7f243ab89640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f243415dd00 0x7f243414f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.816+0000 7f243ab89640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24340d2780 con 0x7f243415dd00 2024-04-25T10:05:20.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.816+0000 7f243ab89640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24340d2260 con 0x7f243406c6c0 2024-04-25T10:05:20.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.816+0000 7f243ab89640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24340d2900 con 0x7f24340b6a40 2024-04-25T10:05:20.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.816+0000 7f2439126640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f243415dd00 0x7f243414f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.816+0000 7f2439126640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f243415dd00 0x7f243414f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43520/0 (socket says 172.21.15.7:43520) 2024-04-25T10:05:20.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.816+0000 7f2439126640 1 -- 172.21.15.7:0/1346730207 learned_addr learned my addr 172.21.15.7:0/1346730207 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:20.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.816+0000 7f2438925640 1 --2- 172.21.15.7:0/1346730207 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f243406c6c0 0x7f24340c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.816+0000 7f2433fff640 1 --2- 172.21.15.7:0/1346730207 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f24340b6a40 0x7f243414d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.816+0000 7f2439126640 1 -- 172.21.15.7:0/1346730207 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f24340b6a40 msgr2=0x7f243414d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.816+0000 7f2439126640 1 --2- 172.21.15.7:0/1346730207 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f24340b6a40 0x7f243414d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.816+0000 7f2439126640 1 -- 172.21.15.7:0/1346730207 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f243406c6c0 msgr2=0x7f24340c9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.816+0000 7f2439126640 1 --2- 172.21.15.7:0/1346730207 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f243406c6c0 0x7f24340c9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.816+0000 7f2439126640 1 -- 172.21.15.7:0/1346730207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243414fcf0 con 0x7f243415dd00 2024-04-25T10:05:20.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.816+0000 7f2439126640 1 --2- 172.21.15.7:0/1346730207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f243415dd00 0x7f243414f560 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f242c007ef0 tx=0x7f242c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:20.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.816+0000 7f24317fa640 1 -- 172.21.15.7:0/1346730207 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c01a070 con 0x7f243415dd00 2024-04-25T10:05:20.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.816+0000 7f24317fa640 1 -- 172.21.15.7:0/1346730207 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242c003b90 con 0x7f243415dd00 2024-04-25T10:05:20.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.816+0000 7f243ab89640 1 -- 172.21.15.7:0/1346730207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f243414ffd0 con 0x7f243415dd00 2024-04-25T10:05:20.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.816+0000 7f24317fa640 1 -- 172.21.15.7:0/1346730207 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c004030 con 0x7f243415dd00 2024-04-25T10:05:20.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.817+0000 7f243ab89640 1 -- 172.21.15.7:0/1346730207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2434150590 con 0x7f243415dd00 2024-04-25T10:05:20.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.818+0000 7f243ab89640 1 -- 172.21.15.7:0/1346730207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2434068fd0 con 0x7f243415dd00 2024-04-25T10:05:20.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.818+0000 7f24317fa640 1 -- 172.21.15.7:0/1346730207 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f242c01d070 con 0x7f243415dd00 2024-04-25T10:05:20.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.819+0000 7f24317fa640 1 --2- 172.21.15.7:0/1346730207 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f241806b4d0 0x7f241806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.819+0000 7f2438925640 1 --2- 172.21.15.7:0/1346730207 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f241806b4d0 0x7f241806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.819+0000 7f24317fa640 1 -- 172.21.15.7:0/1346730207 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f242c08a380 con 0x7f243415dd00 2024-04-25T10:05:20.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.819+0000 7f2438925640 1 --2- 172.21.15.7:0/1346730207 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f241806b4d0 0x7f241806d990 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f2428034000 tx=0x7f242802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:20.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:20.823+0000 7f24317fa640 1 -- 172.21.15.7:0/1346730207 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f242c010070 con 0x7f243415dd00 2024-04-25T10:05:21.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.006+0000 7f243ab89640 1 -- 172.21.15.7:0/1346730207 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f243414faa0 con 0x7f241806b4d0 2024-04-25T10:05:21.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.006+0000 7f24317fa640 1 -- 172.21.15.7:0/1346730207 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f243414faa0 con 0x7f241806b4d0 2024-04-25T10:05:21.012 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 4 to deep-scrub 2024-04-25T10:05:21.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.008+0000 7f243ab89640 1 -- 172.21.15.7:0/1346730207 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f241806b4d0 msgr2=0x7f241806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.008+0000 7f243ab89640 1 --2- 172.21.15.7:0/1346730207 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f241806b4d0 0x7f241806d990 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f2428034000 tx=0x7f242802e000 comp rx=0 tx=0).stop 2024-04-25T10:05:21.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.008+0000 7f243ab89640 1 -- 172.21.15.7:0/1346730207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f243415dd00 msgr2=0x7f243414f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.008+0000 7f243ab89640 1 --2- 172.21.15.7:0/1346730207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f243415dd00 0x7f243414f560 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f242c007ef0 tx=0x7f242c00d4a0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.008+0000 7f243ab89640 1 -- 172.21.15.7:0/1346730207 shutdown_connections 2024-04-25T10:05:21.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.008+0000 7f243ab89640 1 --2- 172.21.15.7:0/1346730207 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f241806b4d0 0x7f241806d990 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.008+0000 7f243ab89640 1 --2- 172.21.15.7:0/1346730207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f243415dd00 0x7f243414f560 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.008+0000 7f243ab89640 1 --2- 172.21.15.7:0/1346730207 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f24340b6a40 0x7f243414d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.008+0000 7f243ab89640 1 --2- 172.21.15.7:0/1346730207 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f243406c6c0 0x7f24340c9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.008+0000 7f243ab89640 1 -- 172.21.15.7:0/1346730207 >> 172.21.15.7:0/1346730207 conn(0x7f24340d07b0 msgr2=0x7f24340d2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:21.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.008+0000 7f243ab89640 1 -- 172.21.15.7:0/1346730207 shutdown_connections 2024-04-25T10:05:21.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.008+0000 7f243ab89640 1 -- 172.21.15.7:0/1346730207 wait complete. 2024-04-25T10:05:21.024 INFO:tasks.ceph:Scrubbing osd.5 2024-04-25T10:05:21.024 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:05:21.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.124+0000 7fcc6b209640 1 Processor -- start 2024-04-25T10:05:21.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.124+0000 7fcc6b209640 1 -- start start 2024-04-25T10:05:21.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.125+0000 7fcc6b209640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcc6415df80 0x7fcc640b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.125+0000 7fcc6b209640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcc640b6a40 0x7fcc640d0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.125+0000 7fcc6b209640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc640d1a10 con 0x7fcc6415dba0 2024-04-25T10:05:21.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.125+0000 7fcc6b209640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc640d1cb0 con 0x7fcc640b6a40 2024-04-25T10:05:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.125+0000 7fcc6b209640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc640d1f90 con 0x7fcc6415df80 2024-04-25T10:05:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.125+0000 7fcc697a6640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcc640b6a40 0x7fcc640d0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.125+0000 7fcc68fa5640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fcc6415dba0 0x7fcc640cea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48824/0 (socket says 172.21.15.7:48824) 2024-04-25T10:05:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.125+0000 7fcc68fa5640 1 -- 172.21.15.7:0/1870120403 learned_addr learned my addr 172.21.15.7:0/1870120403 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:05:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.125+0000 7fcc63fff640 1 --2- 172.21.15.7:0/1870120403 >> v2:172.21.15.55:3300/0 conn(0x7fcc6415df80 0x7fcc640b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.125+0000 7fcc697a6640 1 -- 172.21.15.7:0/1870120403 >> v2:172.21.15.55:3300/0 conn(0x7fcc6415df80 msgr2=0x7fcc640b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.125+0000 7fcc697a6640 1 --2- 172.21.15.7:0/1870120403 >> v2:172.21.15.55:3300/0 conn(0x7fcc6415df80 0x7fcc640b2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.125+0000 7fcc697a6640 1 -- 172.21.15.7:0/1870120403 >> v1:172.21.15.7:6789/0 conn(0x7fcc6415dba0 legacy=0x7fcc640cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.125+0000 7fcc637fe640 1 -- 172.21.15.7:0/1870120403 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1993220457 0 0) 0x7fcc640d1a10 con 0x7fcc6415dba0 2024-04-25T10:05:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.125+0000 7fcc697a6640 1 -- 172.21.15.7:0/1870120403 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc640d2270 con 0x7fcc640b6a40 2024-04-25T10:05:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.126+0000 7fcc697a6640 1 --2- 172.21.15.7:0/1870120403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc640b6a40 0x7fcc640d0220 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7fcc640b2b70 tx=0x7fcc5c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c955d835235eaa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.126+0000 7fcc637fe640 1 -- 172.21.15.7:0/1870120403 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c007740 con 0x7fcc640b6a40 2024-04-25T10:05:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.126+0000 7fcc637fe640 1 -- 172.21.15.7:0/1870120403 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc5c0078e0 con 0x7fcc640b6a40 2024-04-25T10:05:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.126+0000 7fcc637fe640 1 -- 172.21.15.7:0/1870120403 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c007cb0 con 0x7fcc640b6a40 2024-04-25T10:05:21.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.127+0000 7fcc6b209640 1 -- 172.21.15.7:0/1870120403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc640b6a40 msgr2=0x7fcc640d0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.127+0000 7fcc6b209640 1 --2- 172.21.15.7:0/1870120403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc640b6a40 0x7fcc640d0220 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7fcc640b2b70 tx=0x7fcc5c02a5f0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.127+0000 7fcc6b209640 1 -- 172.21.15.7:0/1870120403 shutdown_connections 2024-04-25T10:05:21.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.127+0000 7fcc6b209640 1 --2- 172.21.15.7:0/1870120403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc640b6a40 0x7fcc640d0220 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.127+0000 7fcc6b209640 1 --2- 172.21.15.7:0/1870120403 >> v2:172.21.15.55:3300/0 conn(0x7fcc6415df80 0x7fcc640b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.127+0000 7fcc6b209640 1 -- 172.21.15.7:0/1870120403 >> 172.21.15.7:0/1870120403 conn(0x7fcc6406c530 msgr2=0x7fcc64072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:21.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.127+0000 7fcc6b209640 1 -- 172.21.15.7:0/1870120403 shutdown_connections 2024-04-25T10:05:21.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.127+0000 7fcc6b209640 1 -- 172.21.15.7:0/1870120403 wait complete. 2024-04-25T10:05:21.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.128+0000 7fcc6b209640 1 Processor -- start 2024-04-25T10:05:21.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.128+0000 7fcc6b209640 1 -- start start 2024-04-25T10:05:21.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.129+0000 7fcc6b209640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcc640b6a40 0x7fcc641f32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.129+0000 7fcc6b209640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc6415dba0 0x7fcc6415b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.129+0000 7fcc6b209640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc6415df80 0x7fcc640b7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.129+0000 7fcc6b209640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc640b7030 con 0x7fcc6415df80 2024-04-25T10:05:21.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.129+0000 7fcc6b209640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc640b6eb0 con 0x7fcc6415dba0 2024-04-25T10:05:21.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.129+0000 7fcc6b209640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc640b71b0 con 0x7fcc640b6a40 2024-04-25T10:05:21.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.129+0000 7fcc697a6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc6415df80 0x7fcc640b7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.129+0000 7fcc697a6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc6415df80 0x7fcc640b7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43542/0 (socket says 172.21.15.7:43542) 2024-04-25T10:05:21.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.129+0000 7fcc697a6640 1 -- 172.21.15.7:0/2975348085 learned_addr learned my addr 172.21.15.7:0/2975348085 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:21.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.129+0000 7fcc68fa5640 1 --2- 172.21.15.7:0/2975348085 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcc640b6a40 0x7fcc641f32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.129+0000 7fcc63fff640 1 --2- 172.21.15.7:0/2975348085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc6415dba0 0x7fcc6415b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.129+0000 7fcc697a6640 1 -- 172.21.15.7:0/2975348085 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcc640b6a40 msgr2=0x7fcc641f32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.129+0000 7fcc697a6640 1 --2- 172.21.15.7:0/2975348085 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcc640b6a40 0x7fcc641f32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.129+0000 7fcc697a6640 1 -- 172.21.15.7:0/2975348085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc6415dba0 msgr2=0x7fcc6415b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.129+0000 7fcc697a6640 1 --2- 172.21.15.7:0/2975348085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc6415dba0 0x7fcc6415b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.129+0000 7fcc697a6640 1 -- 172.21.15.7:0/2975348085 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc641f6a90 con 0x7fcc6415df80 2024-04-25T10:05:21.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.129+0000 7fcc63fff640 1 --2- 172.21.15.7:0/2975348085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc6415dba0 0x7fcc6415b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:21.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.129+0000 7fcc697a6640 1 --2- 172.21.15.7:0/2975348085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc6415df80 0x7fcc640b7840 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c02abe0 tx=0x7fcc5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:21.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.130+0000 7fcc617fa640 1 -- 172.21.15.7:0/2975348085 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c040070 con 0x7fcc6415df80 2024-04-25T10:05:21.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.130+0000 7fcc617fa640 1 -- 172.21.15.7:0/2975348085 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc5c031c40 con 0x7fcc6415df80 2024-04-25T10:05:21.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.130+0000 7fcc6b209640 1 -- 172.21.15.7:0/2975348085 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc641f6d30 con 0x7fcc6415df80 2024-04-25T10:05:21.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.130+0000 7fcc617fa640 1 -- 172.21.15.7:0/2975348085 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c003990 con 0x7fcc6415df80 2024-04-25T10:05:21.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.130+0000 7fcc6b209640 1 -- 172.21.15.7:0/2975348085 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc641f72f0 con 0x7fcc6415df80 2024-04-25T10:05:21.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.130+0000 7fcc6b209640 1 -- 172.21.15.7:0/2975348085 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcc64069040 con 0x7fcc6415df80 2024-04-25T10:05:21.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.131+0000 7fcc617fa640 1 -- 172.21.15.7:0/2975348085 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcc5c039040 con 0x7fcc6415df80 2024-04-25T10:05:21.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.131+0000 7fcc617fa640 1 --2- 172.21.15.7:0/2975348085 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcc4806b4d0 0x7fcc4806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.132+0000 7fcc617fa640 1 -- 172.21.15.7:0/2975348085 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fcc5c0ab190 con 0x7fcc6415df80 2024-04-25T10:05:21.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.132+0000 7fcc68fa5640 1 --2- 172.21.15.7:0/2975348085 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcc4806b4d0 0x7fcc4806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.132+0000 7fcc617fa640 1 --2- 172.21.15.7:0/2975348085 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x7fcc48071ab0 0x7fcc48073ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.132+0000 7fcc617fa640 1 -- 172.21.15.7:0/2975348085 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcc5c0091a0 con 0x7fcc48071ab0 2024-04-25T10:05:21.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.132+0000 7fcc617fa640 1 -- 172.21.15.7:0/2975348085 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=122) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc5c0b2050 con 0x7fcc6415df80 2024-04-25T10:05:21.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.132+0000 7fcc63fff640 1 --2- 172.21.15.7:0/2975348085 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x7fcc48071ab0 0x7fcc48073ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.132+0000 7fcc68fa5640 1 --2- 172.21.15.7:0/2975348085 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcc4806b4d0 0x7fcc4806d990 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fcc58007fd0 tx=0x7fcc58009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:21.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.132+0000 7fcc63fff640 1 --2- 172.21.15.7:0/2975348085 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x7fcc48071ab0 0x7fcc48073ef0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:21.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.133+0000 7fcc617fa640 1 -- 172.21.15.7:0/2975348085 <== osd.5 v2:172.21.15.55:6800/2514169616 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fcc5c0091a0 con 0x7fcc48071ab0 2024-04-25T10:05:21.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.146+0000 7fcc6b209640 1 -- 172.21.15.7:0/2975348085 --> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcc6415bb90 con 0x7fcc48071ab0 2024-04-25T10:05:21.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.147+0000 7fcc617fa640 1 -- 172.21.15.7:0/2975348085 <== osd.5 v2:172.21.15.55:6800/2514169616 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fcc6415bb90 con 0x7fcc48071ab0 2024-04-25T10:05:21.152 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:05:21.152 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:05:21.153 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:05:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.147+0000 7fcc6b209640 1 -- 172.21.15.7:0/2975348085 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x7fcc48071ab0 msgr2=0x7fcc48073ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.147+0000 7fcc6b209640 1 --2- 172.21.15.7:0/2975348085 >> [v2:172.21.15.55:6800/2514169616,v1:172.21.15.55:6801/2514169616] conn(0x7fcc48071ab0 0x7fcc48073ef0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.147+0000 7fcc6b209640 1 -- 172.21.15.7:0/2975348085 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcc4806b4d0 msgr2=0x7fcc4806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.147+0000 7fcc6b209640 1 --2- 172.21.15.7:0/2975348085 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fcc4806b4d0 0x7fcc4806d990 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fcc58007fd0 tx=0x7fcc58009040 comp rx=0 tx=0).stop 2024-04-25T10:05:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.147+0000 7fcc6b209640 1 -- 172.21.15.7:0/2975348085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc6415df80 msgr2=0x7fcc640b7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.147+0000 7fcc6b209640 1 --2- 172.21.15.7:0/2975348085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc6415df80 0x7fcc640b7840 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c02abe0 tx=0x7fcc5c004a40 comp rx=0 tx=0).stop 2024-04-25T10:05:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.147+0000 7fcc697a6640 1 -- 172.21.15.7:0/2975348085 reap_dead start 2024-04-25T10:05:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.147+0000 7fcc6b209640 1 -- 172.21.15.7:0/2975348085 shutdown_connections 2024-04-25T10:05:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.147+0000 7fcc6b209640 1 -- 172.21.15.7:0/2975348085 >> 172.21.15.7:0/2975348085 conn(0x7fcc6406c530 msgr2=0x7fcc64072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.148+0000 7fcc6b209640 1 -- 172.21.15.7:0/2975348085 shutdown_connections 2024-04-25T10:05:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.148+0000 7fcc6b209640 1 -- 172.21.15.7:0/2975348085 wait complete. 2024-04-25T10:05:21.163 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-25T10:05:21.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.260+0000 7f5382d41640 1 Processor -- start 2024-04-25T10:05:21.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.260+0000 7f5382d41640 1 -- start start 2024-04-25T10:05:21.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.261+0000 7f5382d41640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f537c06ca40 0x7f537c09a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.261+0000 7f5382d41640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f537c0cfad0 con 0x7f537c15da20 2024-04-25T10:05:21.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.261+0000 7f5382d41640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f537c0cfdb0 con 0x7f537c06bc70 2024-04-25T10:05:21.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.261+0000 7f5382d41640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f537c0d06e0 con 0x7f537c06ca40 2024-04-25T10:05:21.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.261+0000 7f5380add640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f537c15da20 0x7f537c0d0b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48834/0 (socket says 172.21.15.7:48834) 2024-04-25T10:05:21.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.261+0000 7f5380add640 1 -- 172.21.15.7:0/2717634120 learned_addr learned my addr 172.21.15.7:0/2717634120 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:05:21.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.261+0000 7f53812de640 1 --2- 172.21.15.7:0/2717634120 >> v2:172.21.15.55:3300/0 conn(0x7f537c06ca40 0x7f537c09a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.261+0000 7f537b7fe640 1 -- 172.21.15.7:0/2717634120 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471348208 0 0) 0x7f537c0cfad0 con 0x7f537c15da20 2024-04-25T10:05:21.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.261+0000 7f537b7fe640 1 -- 172.21.15.7:0/2717634120 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5368003520 con 0x7f537c15da20 2024-04-25T10:05:21.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.262+0000 7f537b7fe640 1 -- 172.21.15.7:0/2717634120 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3882471587 0 0) 0x7f5368003520 con 0x7f537c15da20 2024-04-25T10:05:21.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.262+0000 7f537b7fe640 1 -- 172.21.15.7:0/2717634120 >> v2:172.21.15.55:3300/0 conn(0x7f537c06ca40 msgr2=0x7f537c09a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:21.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.262+0000 7f537b7fe640 1 --2- 172.21.15.7:0/2717634120 >> v2:172.21.15.55:3300/0 conn(0x7f537c06ca40 0x7f537c09a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.262+0000 7f537b7fe640 1 -- 172.21.15.7:0/2717634120 >> v1:172.21.15.55:6789/0 conn(0x7f537c06bc70 legacy=0x7f537c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.262+0000 7f537b7fe640 1 -- 172.21.15.7:0/2717634120 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537c0d0090 con 0x7f537c15da20 2024-04-25T10:05:21.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.262+0000 7f537b7fe640 1 -- 172.21.15.7:0/2717634120 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f53740019f0 con 0x7f537c15da20 2024-04-25T10:05:21.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.262+0000 7f537b7fe640 1 -- 172.21.15.7:0/2717634120 >> v1:172.21.15.7:6789/0 conn(0x7f537c15da20 legacy=0x7f537c0d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.262+0000 7f537b7fe640 1 --2- 172.21.15.7:0/2717634120 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f53680039b0 0x7f5368003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.262+0000 7f537b7fe640 1 --2- 172.21.15.7:0/2717634120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5368004800 0x7f5368004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.262+0000 7f537b7fe640 1 --2- 172.21.15.7:0/2717634120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53680051c0 0x7f536800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.262+0000 7f537b7fe640 1 -- 172.21.15.7:0/2717634120 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537c0d06e0 con 0x7f5368004800 2024-04-25T10:05:21.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.262+0000 7f537b7fe640 1 -- 172.21.15.7:0/2717634120 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536800c060 con 0x7f53680051c0 2024-04-25T10:05:21.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.262+0000 7f537b7fe640 1 -- 172.21.15.7:0/2717634120 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f536800c260 con 0x7f53680039b0 2024-04-25T10:05:21.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.262+0000 7f537bfff640 1 --2- 172.21.15.7:0/2717634120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5368004800 0x7f5368004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.262+0000 7f53812de640 1 --2- 172.21.15.7:0/2717634120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53680051c0 0x7f536800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.262+0000 7f5380add640 1 --2- 172.21.15.7:0/2717634120 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f53680039b0 0x7f5368003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.262+0000 7f537bfff640 1 -- 172.21.15.7:0/2717634120 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f53680039b0 msgr2=0x7f5368003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:21.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.262+0000 7f537bfff640 1 --2- 172.21.15.7:0/2717634120 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f53680039b0 0x7f5368003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.262+0000 7f537bfff640 1 -- 172.21.15.7:0/2717634120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53680051c0 msgr2=0x7f536800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:21.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.262+0000 7f537bfff640 1 --2- 172.21.15.7:0/2717634120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53680051c0 0x7f536800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.262+0000 7f53812de640 1 -- 172.21.15.7:0/2717634120 reap_dead start 2024-04-25T10:05:21.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.262+0000 7f537bfff640 1 -- 172.21.15.7:0/2717634120 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5368003520 con 0x7f5368004800 2024-04-25T10:05:21.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.262+0000 7f5380add640 1 --2- 172.21.15.7:0/2717634120 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f53680039b0 0x7f5368003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:21.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.263+0000 7f537bfff640 1 --2- 172.21.15.7:0/2717634120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5368004800 0x7f5368004c80 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f536c001720 tx=0x7f5368005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ce9210a474d62d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:21.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.263+0000 7f537b7fe640 1 -- 172.21.15.7:0/2717634120 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536c001370 con 0x7f5368004800 2024-04-25T10:05:21.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.263+0000 7f537b7fe640 1 -- 172.21.15.7:0/2717634120 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536c0052d0 con 0x7f5368004800 2024-04-25T10:05:21.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.263+0000 7f537b7fe640 1 -- 172.21.15.7:0/2717634120 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536c02ab90 con 0x7f5368004800 2024-04-25T10:05:21.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.264+0000 7f5382d41640 1 -- 172.21.15.7:0/2717634120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5368004800 msgr2=0x7f5368004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.264+0000 7f5382d41640 1 --2- 172.21.15.7:0/2717634120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5368004800 0x7f5368004c80 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f536c001720 tx=0x7f5368005830 comp rx=0 tx=0).stop 2024-04-25T10:05:21.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.264+0000 7f5382d41640 1 -- 172.21.15.7:0/2717634120 shutdown_connections 2024-04-25T10:05:21.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.264+0000 7f5382d41640 1 --2- 172.21.15.7:0/2717634120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5368004800 0x7f5368004c80 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.264+0000 7f5382d41640 1 -- 172.21.15.7:0/2717634120 >> 172.21.15.7:0/2717634120 conn(0x7f537c0d16f0 msgr2=0x7f537c0d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:21.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.264+0000 7f5382d41640 1 -- 172.21.15.7:0/2717634120 shutdown_connections 2024-04-25T10:05:21.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.264+0000 7f5382d41640 1 -- 172.21.15.7:0/2717634120 wait complete. 2024-04-25T10:05:21.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.265+0000 7f5382d41640 1 Processor -- start 2024-04-25T10:05:21.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.265+0000 7f5382d41640 1 -- start start 2024-04-25T10:05:21.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.266+0000 7f5382d41640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5368004800 0x7f537c0c6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.266+0000 7f5382d41640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f537c0c6770 0x7f537c1f7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.266+0000 7f5382d41640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f537c1f76a0 0x7f537c0b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.266+0000 7f5382d41640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537c15df80 con 0x7f537c1f76a0 2024-04-25T10:05:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.266+0000 7f5382d41640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537c15de00 con 0x7f5368004800 2024-04-25T10:05:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.266+0000 7f5382d41640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537c09a400 con 0x7f537c0c6770 2024-04-25T10:05:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.266+0000 7f53812de640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f537c1f76a0 0x7f537c0b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.266+0000 7f53812de640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f537c1f76a0 0x7f537c0b5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43560/0 (socket says 172.21.15.7:43560) 2024-04-25T10:05:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.266+0000 7f53812de640 1 -- 172.21.15.7:0/1254129650 learned_addr learned my addr 172.21.15.7:0/1254129650 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.266+0000 7f5380add640 1 --2- 172.21.15.7:0/1254129650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5368004800 0x7f537c0c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.266+0000 7f537bfff640 1 --2- 172.21.15.7:0/1254129650 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f537c0c6770 0x7f537c1f7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.266+0000 7f53812de640 1 -- 172.21.15.7:0/1254129650 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f537c0c6770 msgr2=0x7f537c1f7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.266+0000 7f53812de640 1 --2- 172.21.15.7:0/1254129650 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f537c0c6770 0x7f537c1f7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.266+0000 7f53812de640 1 -- 172.21.15.7:0/1254129650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5368004800 msgr2=0x7f537c0c6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.266+0000 7f53812de640 1 --2- 172.21.15.7:0/1254129650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5368004800 0x7f537c0c6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.266+0000 7f53812de640 1 -- 172.21.15.7:0/1254129650 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537c0b4b50 con 0x7f537c1f76a0 2024-04-25T10:05:21.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.266+0000 7f5380add640 1 --2- 172.21.15.7:0/1254129650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5368004800 0x7f537c0c6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:21.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.266+0000 7f537bfff640 1 --2- 172.21.15.7:0/1254129650 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f537c0c6770 0x7f537c1f7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:21.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.266+0000 7f53812de640 1 --2- 172.21.15.7:0/1254129650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f537c1f76a0 0x7f537c0b5cb0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f537c0cbcf0 tx=0x7f5364011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:21.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.267+0000 7f53797fa640 1 -- 172.21.15.7:0/1254129650 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5364019020 con 0x7f537c1f76a0 2024-04-25T10:05:21.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.267+0000 7f53797fa640 1 -- 172.21.15.7:0/1254129650 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5364004030 con 0x7f537c1f76a0 2024-04-25T10:05:21.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.267+0000 7f5382d41640 1 -- 172.21.15.7:0/1254129650 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f537c0c7ec0 con 0x7f537c1f76a0 2024-04-25T10:05:21.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.267+0000 7f53797fa640 1 -- 172.21.15.7:0/1254129650 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5364004400 con 0x7f537c1f76a0 2024-04-25T10:05:21.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.267+0000 7f5382d41640 1 -- 172.21.15.7:0/1254129650 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f537c0b50a0 con 0x7f537c1f76a0 2024-04-25T10:05:21.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.268+0000 7f5382d41640 1 -- 172.21.15.7:0/1254129650 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f537c0c9a40 con 0x7f537c1f76a0 2024-04-25T10:05:21.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.268+0000 7f53797fa640 1 -- 172.21.15.7:0/1254129650 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f536401c020 con 0x7f537c1f76a0 2024-04-25T10:05:21.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.269+0000 7f53797fa640 1 --2- 172.21.15.7:0/1254129650 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f535c06b4d0 0x7f535c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.269+0000 7f5380add640 1 --2- 172.21.15.7:0/1254129650 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f535c06b4d0 0x7f535c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.269+0000 7f53797fa640 1 -- 172.21.15.7:0/1254129650 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f536408a710 con 0x7f537c1f76a0 2024-04-25T10:05:21.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.269+0000 7f5380add640 1 --2- 172.21.15.7:0/1254129650 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f535c06b4d0 0x7f535c06d990 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f5374002230 tx=0x7f53740021c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:21.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.273+0000 7f53797fa640 1 -- 172.21.15.7:0/1254129650 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5364023020 con 0x7f537c1f76a0 2024-04-25T10:05:21.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.451+0000 7f5382d41640 1 -- 172.21.15.7:0/1254129650 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f537c0c6b50 con 0x7f535c06b4d0 2024-04-25T10:05:21.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.452+0000 7f53797fa640 1 -- 172.21.15.7:0/1254129650 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f537c0c6b50 con 0x7f535c06b4d0 2024-04-25T10:05:21.457 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 5 to deep-scrub 2024-04-25T10:05:21.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.453+0000 7f5382d41640 1 -- 172.21.15.7:0/1254129650 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f535c06b4d0 msgr2=0x7f535c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.453+0000 7f5382d41640 1 --2- 172.21.15.7:0/1254129650 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f535c06b4d0 0x7f535c06d990 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f5374002230 tx=0x7f53740021c0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.453+0000 7f5382d41640 1 -- 172.21.15.7:0/1254129650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f537c1f76a0 msgr2=0x7f537c0b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.453+0000 7f5382d41640 1 --2- 172.21.15.7:0/1254129650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f537c1f76a0 0x7f537c0b5cb0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f537c0cbcf0 tx=0x7f5364011cf0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.454+0000 7f5382d41640 1 -- 172.21.15.7:0/1254129650 shutdown_connections 2024-04-25T10:05:21.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.454+0000 7f5382d41640 1 --2- 172.21.15.7:0/1254129650 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f535c06b4d0 0x7f535c06d990 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.454+0000 7f5382d41640 1 --2- 172.21.15.7:0/1254129650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f537c1f76a0 0x7f537c0b5cb0 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.454+0000 7f5382d41640 1 --2- 172.21.15.7:0/1254129650 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f537c0c6770 0x7f537c1f7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.454+0000 7f5382d41640 1 --2- 172.21.15.7:0/1254129650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5368004800 0x7f537c0c6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.454+0000 7f5382d41640 1 -- 172.21.15.7:0/1254129650 >> 172.21.15.7:0/1254129650 conn(0x7f537c0d16f0 msgr2=0x7f537c0cd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:21.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.454+0000 7f5382d41640 1 -- 172.21.15.7:0/1254129650 shutdown_connections 2024-04-25T10:05:21.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.454+0000 7f5382d41640 1 -- 172.21.15.7:0/1254129650 wait complete. 2024-04-25T10:05:21.470 INFO:tasks.ceph:Scrubbing osd.6 2024-04-25T10:05:21.470 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:05:21.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.569+0000 7fbe0e0e1640 1 Processor -- start 2024-04-25T10:05:21.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.569+0000 7fbe0e0e1640 1 -- start start 2024-04-25T10:05:21.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.570+0000 7fbe0e0e1640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbe081549b0 0x7fbe080ce990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.570+0000 7fbe0e0e1640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe080d0ff0 0x7fbe080b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.570+0000 7fbe0e0e1640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe08162420 con 0x7fbe080ceed0 2024-04-25T10:05:21.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.570+0000 7fbe0e0e1640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe081618a0 con 0x7fbe081549b0 2024-04-25T10:05:21.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.570+0000 7fbe0e0e1640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe08161b80 con 0x7fbe080d0ff0 2024-04-25T10:05:21.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.570+0000 7fbe077fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbe081549b0 0x7fbe080ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.570+0000 7fbe06ffd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbe080ceed0 0x7fbe080d08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48846/0 (socket says 172.21.15.7:48846) 2024-04-25T10:05:21.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.570+0000 7fbe06ffd640 1 -- 172.21.15.7:0/3849484127 learned_addr learned my addr 172.21.15.7:0/3849484127 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:05:21.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.570+0000 7fbe07fff640 1 --2- 172.21.15.7:0/3849484127 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe080d0ff0 0x7fbe080b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.570+0000 7fbe077fe640 1 -- 172.21.15.7:0/3849484127 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe080d0ff0 msgr2=0x7fbe080b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:21.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.570+0000 7fbe077fe640 1 --2- 172.21.15.7:0/3849484127 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe080d0ff0 0x7fbe080b8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.570+0000 7fbe077fe640 1 -- 172.21.15.7:0/3849484127 >> v1:172.21.15.7:6789/0 conn(0x7fbe080ceed0 legacy=0x7fbe080d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.571+0000 7fbe077fe640 1 -- 172.21.15.7:0/3849484127 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe08161e60 con 0x7fbe081549b0 2024-04-25T10:05:21.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.571+0000 7fbe067fc640 1 -- 172.21.15.7:0/3849484127 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 290958456 0 0) 0x7fbe08162420 con 0x7fbe080ceed0 2024-04-25T10:05:21.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.571+0000 7fbe077fe640 1 --2- 172.21.15.7:0/3849484127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe081549b0 0x7fbe080ce990 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7fbdf80097a0 tx=0x7fbdf802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=421e774633d896a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:21.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.571+0000 7fbe067fc640 1 -- 172.21.15.7:0/3849484127 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8037070 con 0x7fbe081549b0 2024-04-25T10:05:21.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.571+0000 7fbe067fc640 1 -- 172.21.15.7:0/3849484127 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf802ae50 con 0x7fbe081549b0 2024-04-25T10:05:21.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.571+0000 7fbe067fc640 1 -- 172.21.15.7:0/3849484127 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8032660 con 0x7fbe081549b0 2024-04-25T10:05:21.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.572+0000 7fbe0e0e1640 1 -- 172.21.15.7:0/3849484127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe081549b0 msgr2=0x7fbe080ce990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.572+0000 7fbe0e0e1640 1 --2- 172.21.15.7:0/3849484127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe081549b0 0x7fbe080ce990 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7fbdf80097a0 tx=0x7fbdf802a100 comp rx=0 tx=0).stop 2024-04-25T10:05:21.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.572+0000 7fbe0e0e1640 1 -- 172.21.15.7:0/3849484127 shutdown_connections 2024-04-25T10:05:21.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.572+0000 7fbe0e0e1640 1 --2- 172.21.15.7:0/3849484127 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe080d0ff0 0x7fbe080b8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.572+0000 7fbe0e0e1640 1 --2- 172.21.15.7:0/3849484127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe081549b0 0x7fbe080ce990 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.572+0000 7fbe0e0e1640 1 -- 172.21.15.7:0/3849484127 >> 172.21.15.7:0/3849484127 conn(0x7fbe0806c3d0 msgr2=0x7fbe0806c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:21.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.572+0000 7fbe0e0e1640 1 -- 172.21.15.7:0/3849484127 shutdown_connections 2024-04-25T10:05:21.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.572+0000 7fbe0e0e1640 1 -- 172.21.15.7:0/3849484127 wait complete. 2024-04-25T10:05:21.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.573+0000 7fbe0e0e1640 1 Processor -- start 2024-04-25T10:05:21.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.573+0000 7fbe0e0e1640 1 -- start start 2024-04-25T10:05:21.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.574+0000 7fbe0e0e1640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe080ceed0 0x7fbe0814f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.574+0000 7fbe0e0e1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe080d0ff0 0x7fbe0814d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.574+0000 7fbe0e0e1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe081549b0 0x7fbe081f68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.574+0000 7fbe0e0e1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0815edb0 con 0x7fbe080d0ff0 2024-04-25T10:05:21.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.574+0000 7fbe0e0e1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe08161570 con 0x7fbe081549b0 2024-04-25T10:05:21.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.574+0000 7fbe0e0e1640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0815ef30 con 0x7fbe080ceed0 2024-04-25T10:05:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.574+0000 7fbe06ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe080d0ff0 0x7fbe0814d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.574+0000 7fbe06ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe080d0ff0 0x7fbe0814d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43586/0 (socket says 172.21.15.7:43586) 2024-04-25T10:05:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.574+0000 7fbe06ffd640 1 -- 172.21.15.7:0/2193995201 learned_addr learned my addr 172.21.15.7:0/2193995201 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.574+0000 7fbe077fe640 1 --2- 172.21.15.7:0/2193995201 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe080ceed0 0x7fbe0814f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.574+0000 7fbe07fff640 1 --2- 172.21.15.7:0/2193995201 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe081549b0 0x7fbe081f68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.574+0000 7fbe06ffd640 1 -- 172.21.15.7:0/2193995201 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe080ceed0 msgr2=0x7fbe0814f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.574+0000 7fbe06ffd640 1 --2- 172.21.15.7:0/2193995201 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe080ceed0 0x7fbe0814f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.575+0000 7fbe06ffd640 1 -- 172.21.15.7:0/2193995201 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe081549b0 msgr2=0x7fbe081f68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.575+0000 7fbe06ffd640 1 --2- 172.21.15.7:0/2193995201 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe081549b0 0x7fbe081f68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.575+0000 7fbe06ffd640 1 -- 172.21.15.7:0/2193995201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0814f7c0 con 0x7fbe080d0ff0 2024-04-25T10:05:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.575+0000 7fbe06ffd640 1 --2- 172.21.15.7:0/2193995201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe080d0ff0 0x7fbe0814d260 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00c4b0 tx=0x7fbdfc00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.575+0000 7fbdeffff640 1 -- 172.21.15.7:0/2193995201 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc018070 con 0x7fbe080d0ff0 2024-04-25T10:05:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.575+0000 7fbdeffff640 1 -- 172.21.15.7:0/2193995201 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdfc007500 con 0x7fbe080d0ff0 2024-04-25T10:05:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.575+0000 7fbe0e0e1640 1 -- 172.21.15.7:0/2193995201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe0814fa40 con 0x7fbe080d0ff0 2024-04-25T10:05:21.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.575+0000 7fbdeffff640 1 -- 172.21.15.7:0/2193995201 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc004a20 con 0x7fbe080d0ff0 2024-04-25T10:05:21.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.575+0000 7fbe0e0e1640 1 -- 172.21.15.7:0/2193995201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe08150000 con 0x7fbe080d0ff0 2024-04-25T10:05:21.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.576+0000 7fbe0e0e1640 1 -- 172.21.15.7:0/2193995201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbe08069040 con 0x7fbe080d0ff0 2024-04-25T10:05:21.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.576+0000 7fbdeffff640 1 -- 172.21.15.7:0/2193995201 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbdfc01b070 con 0x7fbe080d0ff0 2024-04-25T10:05:21.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.577+0000 7fbdeffff640 1 --2- 172.21.15.7:0/2193995201 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbdf406b4d0 0x7fbdf406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.577+0000 7fbdeffff640 1 -- 172.21.15.7:0/2193995201 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fbdfc089460 con 0x7fbe080d0ff0 2024-04-25T10:05:21.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.577+0000 7fbe077fe640 1 --2- 172.21.15.7:0/2193995201 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbdf406b4d0 0x7fbdf406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.577+0000 7fbdeffff640 1 --2- 172.21.15.7:0/2193995201 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x7fbdf4071ab0 0x7fbdf4073ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.577+0000 7fbdeffff640 1 -- 172.21.15.7:0/2193995201 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbdf40745c0 con 0x7fbdf4071ab0 2024-04-25T10:05:21.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.577+0000 7fbdeffff640 1 -- 172.21.15.7:0/2193995201 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=122) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbdfc090050 con 0x7fbe080d0ff0 2024-04-25T10:05:21.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.577+0000 7fbe07fff640 1 --2- 172.21.15.7:0/2193995201 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x7fbdf4071ab0 0x7fbdf4073ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.577+0000 7fbe077fe640 1 --2- 172.21.15.7:0/2193995201 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbdf406b4d0 0x7fbdf406d990 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8034000 tx=0x7fbdf802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:21.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.578+0000 7fbe07fff640 1 --2- 172.21.15.7:0/2193995201 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x7fbdf4071ab0 0x7fbdf4073ef0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:21.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.579+0000 7fbdeffff640 1 -- 172.21.15.7:0/2193995201 <== osd.6 v2:172.21.15.55:6824/4293769515 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fbdf40745c0 con 0x7fbdf4071ab0 2024-04-25T10:05:21.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.592+0000 7fbe0e0e1640 1 -- 172.21.15.7:0/2193995201 --> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbe080d15f0 con 0x7fbdf4071ab0 2024-04-25T10:05:21.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.592+0000 7fbdeffff640 1 -- 172.21.15.7:0/2193995201 <== osd.6 v2:172.21.15.55:6824/4293769515 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fbe080d15f0 con 0x7fbdf4071ab0 2024-04-25T10:05:21.597 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:05:21.598 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:05:21.598 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:05:21.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.592+0000 7fbe0e0e1640 1 -- 172.21.15.7:0/2193995201 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x7fbdf4071ab0 msgr2=0x7fbdf4073ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.592+0000 7fbe0e0e1640 1 --2- 172.21.15.7:0/2193995201 >> [v2:172.21.15.55:6824/4293769515,v1:172.21.15.55:6825/4293769515] conn(0x7fbdf4071ab0 0x7fbdf4073ef0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.592+0000 7fbe0e0e1640 1 -- 172.21.15.7:0/2193995201 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbdf406b4d0 msgr2=0x7fbdf406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.592+0000 7fbe0e0e1640 1 --2- 172.21.15.7:0/2193995201 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fbdf406b4d0 0x7fbdf406d990 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8034000 tx=0x7fbdf802e000 comp rx=0 tx=0).stop 2024-04-25T10:05:21.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.592+0000 7fbe0e0e1640 1 -- 172.21.15.7:0/2193995201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe080d0ff0 msgr2=0x7fbe0814d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.592+0000 7fbe0e0e1640 1 --2- 172.21.15.7:0/2193995201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe080d0ff0 0x7fbe0814d260 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00c4b0 tx=0x7fbdfc00c970 comp rx=0 tx=0).stop 2024-04-25T10:05:21.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.592+0000 7fbe07fff640 1 -- 172.21.15.7:0/2193995201 reap_dead start 2024-04-25T10:05:21.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.592+0000 7fbe0e0e1640 1 -- 172.21.15.7:0/2193995201 shutdown_connections 2024-04-25T10:05:21.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.592+0000 7fbe0e0e1640 1 -- 172.21.15.7:0/2193995201 >> 172.21.15.7:0/2193995201 conn(0x7fbe0806c3d0 msgr2=0x7fbe0815df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:21.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.593+0000 7fbe0e0e1640 1 -- 172.21.15.7:0/2193995201 shutdown_connections 2024-04-25T10:05:21.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.593+0000 7fbe0e0e1640 1 -- 172.21.15.7:0/2193995201 wait complete. 2024-04-25T10:05:21.609 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-25T10:05:21.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.706+0000 7fefd29fe640 1 Processor -- start 2024-04-25T10:05:21.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.707+0000 7fefd29fe640 1 -- start start 2024-04-25T10:05:21.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.707+0000 7fefd29fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fefcc0d0330 0x7fefcc0999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.707+0000 7fefd29fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fefcc099f30 0x7fefcc0b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.707+0000 7fefd29fe640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefcc0d0790 con 0x7fefcc15b8e0 2024-04-25T10:05:21.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.707+0000 7fefd29fe640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefcc0cd7d0 con 0x7fefcc099f30 2024-04-25T10:05:21.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.707+0000 7fefd29fe640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc09a340 con 0x7fefcc0d0330 2024-04-25T10:05:21.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.707+0000 7fefd0f9b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fefcc099f30 0x7fefcc0b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.707+0000 7fefd0f9b640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fefcc099f30 0x7fefcc0b0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43596/0 (socket says 172.21.15.7:43596) 2024-04-25T10:05:21.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.707+0000 7fefd0f9b640 1 -- 172.21.15.7:0/3408582925 learned_addr learned my addr 172.21.15.7:0/3408582925 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:21.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.708+0000 7fefcb7fe640 1 --2- 172.21.15.7:0/3408582925 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fefcc0d0330 0x7fefcc0999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.708+0000 7fefd0f9b640 1 -- 172.21.15.7:0/3408582925 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fefcc0d0330 msgr2=0x7fefcc0999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:21.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.708+0000 7fefd0f9b640 1 --2- 172.21.15.7:0/3408582925 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fefcc0d0330 0x7fefcc0999f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.708+0000 7fefd0f9b640 1 -- 172.21.15.7:0/3408582925 >> v1:172.21.15.55:6789/0 conn(0x7fefcc15b8e0 legacy=0x7fefcc0cc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:21.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.708+0000 7fefd0f9b640 1 -- 172.21.15.7:0/3408582925 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefcc0ccbc0 con 0x7fefcc099f30 2024-04-25T10:05:21.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.708+0000 7fefd0f9b640 1 --2- 172.21.15.7:0/3408582925 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefcc099f30 0x7fefcc0b0a50 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7fefc4009e50 tx=0x7fefc402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=621c539c5afaabf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:21.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.709+0000 7fefcaffd640 1 -- 172.21.15.7:0/3408582925 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc4036070 con 0x7fefcc099f30 2024-04-25T10:05:21.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.709+0000 7fefcaffd640 1 -- 172.21.15.7:0/3408582925 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc4031600 con 0x7fefcc099f30 2024-04-25T10:05:21.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.709+0000 7fefcaffd640 1 -- 172.21.15.7:0/3408582925 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc40319d0 con 0x7fefcc099f30 2024-04-25T10:05:21.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.709+0000 7fefd29fe640 1 -- 172.21.15.7:0/3408582925 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefcc099f30 msgr2=0x7fefcc0b0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.709+0000 7fefd29fe640 1 --2- 172.21.15.7:0/3408582925 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefcc099f30 0x7fefcc0b0a50 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7fefc4009e50 tx=0x7fefc402a6c0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.709+0000 7fefd29fe640 1 -- 172.21.15.7:0/3408582925 shutdown_connections 2024-04-25T10:05:21.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.709+0000 7fefd29fe640 1 --2- 172.21.15.7:0/3408582925 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefcc099f30 0x7fefcc0b0a50 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.709+0000 7fefd29fe640 1 --2- 172.21.15.7:0/3408582925 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fefcc0d0330 0x7fefcc0999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.709+0000 7fefd29fe640 1 -- 172.21.15.7:0/3408582925 >> 172.21.15.7:0/3408582925 conn(0x7fefcc0b3130 msgr2=0x7fefcc0b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:21.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.709+0000 7fefd29fe640 1 -- 172.21.15.7:0/3408582925 shutdown_connections 2024-04-25T10:05:21.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.709+0000 7fefd29fe640 1 -- 172.21.15.7:0/3408582925 wait complete. 2024-04-25T10:05:21.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.710+0000 7fefd29fe640 1 Processor -- start 2024-04-25T10:05:21.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.711+0000 7fefd29fe640 1 -- start start 2024-04-25T10:05:21.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.711+0000 7fefd29fe640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fefcc099f30 0x7fefcc0b6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.711+0000 7fefd29fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefcc0d0330 0x7fefcc1f6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.711+0000 7fefd29fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefcc15b8e0 0x7fefcc1f3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.711+0000 7fefd29fe640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc0cd460 con 0x7fefcc0d0330 2024-04-25T10:05:21.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.711+0000 7fefd29fe640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc0cd180 con 0x7fefcc15b8e0 2024-04-25T10:05:21.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.711+0000 7fefd29fe640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc15bcc0 con 0x7fefcc099f30 2024-04-25T10:05:21.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.711+0000 7fefcb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefcc0d0330 0x7fefcc1f6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.712+0000 7fefcb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefcc0d0330 0x7fefcc1f6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43608/0 (socket says 172.21.15.7:43608) 2024-04-25T10:05:21.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.712+0000 7fefcb7fe640 1 -- 172.21.15.7:0/3639210116 learned_addr learned my addr 172.21.15.7:0/3639210116 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:21.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.712+0000 7fefd0f9b640 1 --2- 172.21.15.7:0/3639210116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefcc15b8e0 0x7fefcc1f3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.712+0000 7fefcbfff640 1 --2- 172.21.15.7:0/3639210116 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fefcc099f30 0x7fefcc0b6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.712+0000 7fefcb7fe640 1 -- 172.21.15.7:0/3639210116 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fefcc099f30 msgr2=0x7fefcc0b6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.712+0000 7fefcb7fe640 1 --2- 172.21.15.7:0/3639210116 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fefcc099f30 0x7fefcc0b6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.712+0000 7fefcb7fe640 1 -- 172.21.15.7:0/3639210116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefcc15b8e0 msgr2=0x7fefcc1f3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.712+0000 7fefcb7fe640 1 --2- 172.21.15.7:0/3639210116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefcc15b8e0 0x7fefcc1f3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.712+0000 7fefcb7fe640 1 -- 172.21.15.7:0/3639210116 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefcc06d5e0 con 0x7fefcc0d0330 2024-04-25T10:05:21.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.712+0000 7fefd0f9b640 1 --2- 172.21.15.7:0/3639210116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefcc15b8e0 0x7fefcc1f3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:21.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.712+0000 7fefcb7fe640 1 --2- 172.21.15.7:0/3639210116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefcc0d0330 0x7fefcc1f6c90 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7fefc000c820 tx=0x7fefc000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:21.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.712+0000 7fefc8ff9640 1 -- 172.21.15.7:0/3639210116 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc0015070 con 0x7fefcc0d0330 2024-04-25T10:05:21.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.712+0000 7fefc8ff9640 1 -- 172.21.15.7:0/3639210116 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc0004240 con 0x7fefcc0d0330 2024-04-25T10:05:21.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.712+0000 7fefd29fe640 1 -- 172.21.15.7:0/3639210116 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefcc06ca60 con 0x7fefcc0d0330 2024-04-25T10:05:21.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.712+0000 7fefc8ff9640 1 -- 172.21.15.7:0/3639210116 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc000ce10 con 0x7fefcc0d0330 2024-04-25T10:05:21.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.712+0000 7fefd29fe640 1 -- 172.21.15.7:0/3639210116 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefcc06d020 con 0x7fefcc0d0330 2024-04-25T10:05:21.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.713+0000 7fefd29fe640 1 -- 172.21.15.7:0/3639210116 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefcc068fd0 con 0x7fefcc0d0330 2024-04-25T10:05:21.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.714+0000 7fefc8ff9640 1 -- 172.21.15.7:0/3639210116 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fefc0007830 con 0x7fefcc0d0330 2024-04-25T10:05:21.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.714+0000 7fefc8ff9640 1 --2- 172.21.15.7:0/3639210116 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fefb806b4d0 0x7fefb806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.714+0000 7fefc8ff9640 1 -- 172.21.15.7:0/3639210116 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fefc0089ff0 con 0x7fefcc0d0330 2024-04-25T10:05:21.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.714+0000 7fefcbfff640 1 --2- 172.21.15.7:0/3639210116 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fefb806b4d0 0x7fefb806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.715+0000 7fefcbfff640 1 --2- 172.21.15.7:0/3639210116 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fefb806b4d0 0x7fefb806d990 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fefbc006fd0 tx=0x7fefbc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:21.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.719+0000 7fefc8ff9640 1 -- 172.21.15.7:0/3639210116 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fefc0058f60 con 0x7fefcc0d0330 2024-04-25T10:05:21.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.898+0000 7fefd29fe640 1 -- 172.21.15.7:0/3639210116 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fefcc0cfbe0 con 0x7fefb806b4d0 2024-04-25T10:05:21.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.898+0000 7fefc8ff9640 1 -- 172.21.15.7:0/3639210116 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fefcc0cfbe0 con 0x7fefb806b4d0 2024-04-25T10:05:21.904 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 6 to deep-scrub 2024-04-25T10:05:21.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.900+0000 7fefd29fe640 1 -- 172.21.15.7:0/3639210116 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fefb806b4d0 msgr2=0x7fefb806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.900+0000 7fefd29fe640 1 --2- 172.21.15.7:0/3639210116 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fefb806b4d0 0x7fefb806d990 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fefbc006fd0 tx=0x7fefbc008040 comp rx=0 tx=0).stop 2024-04-25T10:05:21.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.900+0000 7fefd29fe640 1 -- 172.21.15.7:0/3639210116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefcc0d0330 msgr2=0x7fefcc1f6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.900+0000 7fefd29fe640 1 --2- 172.21.15.7:0/3639210116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefcc0d0330 0x7fefcc1f6c90 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7fefc000c820 tx=0x7fefc000cce0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.900+0000 7fefd29fe640 1 -- 172.21.15.7:0/3639210116 shutdown_connections 2024-04-25T10:05:21.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.900+0000 7fefd29fe640 1 --2- 172.21.15.7:0/3639210116 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fefb806b4d0 0x7fefb806d990 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.900+0000 7fefd29fe640 1 --2- 172.21.15.7:0/3639210116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefcc15b8e0 0x7fefcc1f3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.900+0000 7fefd29fe640 1 --2- 172.21.15.7:0/3639210116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefcc0d0330 0x7fefcc1f6c90 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.900+0000 7fefd29fe640 1 --2- 172.21.15.7:0/3639210116 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fefcc099f30 0x7fefcc0b6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.900+0000 7fefd29fe640 1 -- 172.21.15.7:0/3639210116 >> 172.21.15.7:0/3639210116 conn(0x7fefcc0b3130 msgr2=0x7fefcc0ce050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:21.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.900+0000 7fefd29fe640 1 -- 172.21.15.7:0/3639210116 shutdown_connections 2024-04-25T10:05:21.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:21.900+0000 7fefd29fe640 1 -- 172.21.15.7:0/3639210116 wait complete. 2024-04-25T10:05:21.916 INFO:tasks.ceph:Scrubbing osd.7 2024-04-25T10:05:21.916 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:05:22.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.016+0000 7f83f85e2640 1 Processor -- start 2024-04-25T10:05:22.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.016+0000 7f83f85e2640 1 -- start start 2024-04-25T10:05:22.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.017+0000 7f83f85e2640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f83f00d3330 0x7f83f00d3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:22.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.017+0000 7f83f85e2640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f00d2290 con 0x7f83f015de70 2024-04-25T10:05:22.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.017+0000 7f83f85e2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f00d2570 con 0x7f83f00b9290 2024-04-25T10:05:22.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.017+0000 7f83f85e2640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f00d2030 con 0x7f83f00d3330 2024-04-25T10:05:22.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.017+0000 7f83f5b7d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f83f00d3330 0x7f83f00d3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:22.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.017+0000 7f83f637e640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f83f015de70 0x7f83f00d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48858/0 (socket says 172.21.15.7:48858) 2024-04-25T10:05:22.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.017+0000 7f83f637e640 1 -- 172.21.15.7:0/1299581569 learned_addr learned my addr 172.21.15.7:0/1299581569 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:05:22.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.018+0000 7f83f5b7d640 1 -- 172.21.15.7:0/1299581569 >> v1:172.21.15.55:6789/0 conn(0x7f83f00b9290 legacy=0x7f83f00b6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:22.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.018+0000 7f83f5b7d640 1 -- 172.21.15.7:0/1299581569 >> v1:172.21.15.7:6789/0 conn(0x7f83f015de70 legacy=0x7f83f00d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:22.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.018+0000 7f83f5b7d640 1 -- 172.21.15.7:0/1299581569 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f00d2850 con 0x7f83f00d3330 2024-04-25T10:05:22.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.018+0000 7f83f537c640 1 -- 172.21.15.7:0/1299581569 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2129195467 0 0) 0x7f83f00d2290 con 0x7f83f015de70 2024-04-25T10:05:22.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.018+0000 7f83f5b7d640 1 --2- 172.21.15.7:0/1299581569 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83f00d3330 0x7f83f00d3800 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f83e40097a0 tx=0x7f83e402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7698ba3e6f759376 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:22.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.018+0000 7f83f537c640 1 -- 172.21.15.7:0/1299581569 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e4037070 con 0x7f83f00d3330 2024-04-25T10:05:22.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.019+0000 7f83f537c640 1 -- 172.21.15.7:0/1299581569 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e4032440 con 0x7f83f00d3330 2024-04-25T10:05:22.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.019+0000 7f83f537c640 1 -- 172.21.15.7:0/1299581569 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e4032810 con 0x7f83f00d3330 2024-04-25T10:05:22.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.019+0000 7f83f85e2640 1 -- 172.21.15.7:0/1299581569 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83f00d3330 msgr2=0x7f83f00d3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:22.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.019+0000 7f83f85e2640 1 --2- 172.21.15.7:0/1299581569 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83f00d3330 0x7f83f00d3800 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f83e40097a0 tx=0x7f83e402a1e0 comp rx=0 tx=0).stop 2024-04-25T10:05:22.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.019+0000 7f83f85e2640 1 -- 172.21.15.7:0/1299581569 shutdown_connections 2024-04-25T10:05:22.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.019+0000 7f83f85e2640 1 --2- 172.21.15.7:0/1299581569 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83f00d3330 0x7f83f00d3800 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:22.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.019+0000 7f83f85e2640 1 -- 172.21.15.7:0/1299581569 >> 172.21.15.7:0/1299581569 conn(0x7f83f00726b0 msgr2=0x7f83f0072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:22.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.019+0000 7f83f85e2640 1 -- 172.21.15.7:0/1299581569 shutdown_connections 2024-04-25T10:05:22.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.019+0000 7f83f85e2640 1 -- 172.21.15.7:0/1299581569 wait complete. 2024-04-25T10:05:22.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.020+0000 7f83f85e2640 1 Processor -- start 2024-04-25T10:05:22.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.020+0000 7f83f85e2640 1 -- start start 2024-04-25T10:05:22.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.021+0000 7f83f85e2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83f00b9290 0x7f83f01f3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:22.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.021+0000 7f83f85e2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83f00d3330 0x7f83f00c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:22.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.021+0000 7f83f85e2640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f83f015de70 0x7f83f00c9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:22.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.021+0000 7f83f85e2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f00d3d40 con 0x7f83f00b9290 2024-04-25T10:05:22.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.021+0000 7f83f85e2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f00d2e10 con 0x7f83f00d3330 2024-04-25T10:05:22.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.021+0000 7f83f85e2640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f00d3ec0 con 0x7f83f015de70 2024-04-25T10:05:22.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.021+0000 7f83f637e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83f00b9290 0x7f83f01f3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:22.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.021+0000 7f83f637e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83f00b9290 0x7f83f01f3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43626/0 (socket says 172.21.15.7:43626) 2024-04-25T10:05:22.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.021+0000 7f83f637e640 1 -- 172.21.15.7:0/1351497098 learned_addr learned my addr 172.21.15.7:0/1351497098 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:22.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.021+0000 7f83f637e640 1 -- 172.21.15.7:0/1351497098 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f83f015de70 msgr2=0x7f83f00c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:22.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.021+0000 7f83f637e640 1 --2- 172.21.15.7:0/1351497098 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f83f015de70 0x7f83f00c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:22.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.021+0000 7f83f637e640 1 -- 172.21.15.7:0/1351497098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83f00d3330 msgr2=0x7f83f00c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:22.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.021+0000 7f83f637e640 1 --2- 172.21.15.7:0/1351497098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83f00d3330 0x7f83f00c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:22.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.021+0000 7f83f637e640 1 -- 172.21.15.7:0/1351497098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f01f3c70 con 0x7f83f00b9290 2024-04-25T10:05:22.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.021+0000 7f83f637e640 1 --2- 172.21.15.7:0/1351497098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83f00b9290 0x7f83f01f3730 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f83e800c430 tx=0x7f83e800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:22.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.022+0000 7f83eeffd640 1 -- 172.21.15.7:0/1351497098 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e80074e0 con 0x7f83f00b9290 2024-04-25T10:05:22.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.022+0000 7f83eeffd640 1 -- 172.21.15.7:0/1351497098 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e80047e0 con 0x7f83f00b9290 2024-04-25T10:05:22.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.022+0000 7f83eeffd640 1 -- 172.21.15.7:0/1351497098 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e8004bd0 con 0x7f83f00b9290 2024-04-25T10:05:22.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.022+0000 7f83f85e2640 1 -- 172.21.15.7:0/1351497098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f015e4a0 con 0x7f83f00b9290 2024-04-25T10:05:22.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.022+0000 7f83f85e2640 1 -- 172.21.15.7:0/1351497098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f015ea60 con 0x7f83f00b9290 2024-04-25T10:05:22.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.022+0000 7f83f85e2640 1 -- 172.21.15.7:0/1351497098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f83f015e250 con 0x7f83f00b9290 2024-04-25T10:05:22.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.023+0000 7f83eeffd640 1 -- 172.21.15.7:0/1351497098 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f83e8011070 con 0x7f83f00b9290 2024-04-25T10:05:22.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.023+0000 7f83eeffd640 1 --2- 172.21.15.7:0/1351497098 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f83dc06b4d0 0x7f83dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:22.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.024+0000 7f83eeffd640 1 -- 172.21.15.7:0/1351497098 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f83e8089ea0 con 0x7f83f00b9290 2024-04-25T10:05:22.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.024+0000 7f83f5b7d640 1 --2- 172.21.15.7:0/1351497098 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f83dc06b4d0 0x7f83dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:22.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.024+0000 7f83eeffd640 1 --2- 172.21.15.7:0/1351497098 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x7f83dc071ab0 0x7f83dc073ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:22.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.024+0000 7f83eeffd640 1 -- 172.21.15.7:0/1351497098 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f83e801ce80 con 0x7f83dc071ab0 2024-04-25T10:05:22.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.024+0000 7f83eeffd640 1 -- 172.21.15.7:0/1351497098 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=122) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83e808c4c0 con 0x7f83f00b9290 2024-04-25T10:05:22.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.024+0000 7f83f5b7d640 1 --2- 172.21.15.7:0/1351497098 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f83dc06b4d0 0x7f83dc06d990 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f83e4034000 tx=0x7f83e402c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:22.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.024+0000 7f83f6b7f640 1 --2- 172.21.15.7:0/1351497098 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x7f83dc071ab0 0x7f83dc073ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:22.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.025+0000 7f83f6b7f640 1 --2- 172.21.15.7:0/1351497098 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x7f83dc071ab0 0x7f83dc073ef0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:22.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.025+0000 7f83eeffd640 1 -- 172.21.15.7:0/1351497098 <== osd.7 v2:172.21.15.55:6816/2960381217 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f83e801ce80 con 0x7f83dc071ab0 2024-04-25T10:05:22.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.039+0000 7f83f85e2640 1 -- 172.21.15.7:0/1351497098 --> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f83f00b70e0 con 0x7f83dc071ab0 2024-04-25T10:05:22.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.039+0000 7f83eeffd640 1 -- 172.21.15.7:0/1351497098 <== osd.7 v2:172.21.15.55:6816/2960381217 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f83f00b70e0 con 0x7f83dc071ab0 2024-04-25T10:05:22.045 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-04-25T10:05:22.045 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:05:22.045 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-04-25T10:05:22.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.039+0000 7f83f85e2640 1 -- 172.21.15.7:0/1351497098 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x7f83dc071ab0 msgr2=0x7f83dc073ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:22.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.039+0000 7f83f85e2640 1 --2- 172.21.15.7:0/1351497098 >> [v2:172.21.15.55:6816/2960381217,v1:172.21.15.55:6817/2960381217] conn(0x7f83dc071ab0 0x7f83dc073ef0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:22.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.040+0000 7f83f85e2640 1 -- 172.21.15.7:0/1351497098 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f83dc06b4d0 msgr2=0x7f83dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:22.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.040+0000 7f83f85e2640 1 --2- 172.21.15.7:0/1351497098 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f83dc06b4d0 0x7f83dc06d990 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f83e4034000 tx=0x7f83e402c000 comp rx=0 tx=0).stop 2024-04-25T10:05:22.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.040+0000 7f83f85e2640 1 -- 172.21.15.7:0/1351497098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83f00b9290 msgr2=0x7f83f01f3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:22.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.040+0000 7f83f85e2640 1 --2- 172.21.15.7:0/1351497098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83f00b9290 0x7f83f01f3730 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f83e800c430 tx=0x7f83e800c8f0 comp rx=0 tx=0).stop 2024-04-25T10:05:22.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.040+0000 7f83f6b7f640 1 -- 172.21.15.7:0/1351497098 reap_dead start 2024-04-25T10:05:22.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.040+0000 7f83f85e2640 1 -- 172.21.15.7:0/1351497098 shutdown_connections 2024-04-25T10:05:22.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.040+0000 7f83f85e2640 1 -- 172.21.15.7:0/1351497098 >> 172.21.15.7:0/1351497098 conn(0x7f83f00726b0 msgr2=0x7f83f00b69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:22.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.040+0000 7f83f85e2640 1 -- 172.21.15.7:0/1351497098 shutdown_connections 2024-04-25T10:05:22.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.040+0000 7f83f85e2640 1 -- 172.21.15.7:0/1351497098 wait complete. 2024-04-25T10:05:22.055 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-25T10:05:22.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.151+0000 7f3151110640 1 Processor -- start 2024-04-25T10:05:22.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.151+0000 7f3151110640 1 -- start start 2024-04-25T10:05:22.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.152+0000 7f3151110640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f314c15dd00 0x7f314c0b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:22.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.152+0000 7f3151110640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f314c06cd00 con 0x7f314c0b6a40 2024-04-25T10:05:22.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.152+0000 7f3151110640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f314c0d1ca0 con 0x7f314c06c6c0 2024-04-25T10:05:22.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.152+0000 7f3151110640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f314c15e0e0 con 0x7f314c15dd00 2024-04-25T10:05:22.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.152+0000 7f314ad9d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f314c15dd00 0x7f314c0b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:22.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.152+0000 7f3143fff640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f314c0b6a40 0x7f314c06bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48860/0 (socket says 172.21.15.7:48860) 2024-04-25T10:05:22.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.152+0000 7f3143fff640 1 -- 172.21.15.7:0/553702760 learned_addr learned my addr 172.21.15.7:0/553702760 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:05:22.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.152+0000 7f314ad9d640 1 -- 172.21.15.7:0/553702760 >> v1:172.21.15.55:6789/0 conn(0x7f314c06c6c0 legacy=0x7f314c0d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:22.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.152+0000 7f314ad9d640 1 -- 172.21.15.7:0/553702760 >> v1:172.21.15.7:6789/0 conn(0x7f314c0b6a40 legacy=0x7f314c06bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:22.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.152+0000 7f314a59c640 1 -- 172.21.15.7:0/553702760 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2537824519 0 0) 0x7f314c06cd00 con 0x7f314c0b6a40 2024-04-25T10:05:22.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.152+0000 7f314ad9d640 1 -- 172.21.15.7:0/553702760 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314c0d1f80 con 0x7f314c15dd00 2024-04-25T10:05:22.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.153+0000 7f314ad9d640 1 --2- 172.21.15.7:0/553702760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f314c15dd00 0x7f314c0b5750 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f313c0097a0 tx=0x7f313c02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b1872d557d5d65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:22.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.153+0000 7f314a59c640 1 -- 172.21.15.7:0/553702760 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c037070 con 0x7f314c15dd00 2024-04-25T10:05:22.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.153+0000 7f314a59c640 1 -- 172.21.15.7:0/553702760 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313c032640 con 0x7f314c15dd00 2024-04-25T10:05:22.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.153+0000 7f314a59c640 1 -- 172.21.15.7:0/553702760 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c032a10 con 0x7f314c15dd00 2024-04-25T10:05:22.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.154+0000 7f3151110640 1 -- 172.21.15.7:0/553702760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f314c15dd00 msgr2=0x7f314c0b5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:22.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.154+0000 7f3151110640 1 --2- 172.21.15.7:0/553702760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f314c15dd00 0x7f314c0b5750 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f313c0097a0 tx=0x7f313c02a2c0 comp rx=0 tx=0).stop 2024-04-25T10:05:22.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.154+0000 7f3151110640 1 -- 172.21.15.7:0/553702760 shutdown_connections 2024-04-25T10:05:22.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.154+0000 7f3151110640 1 --2- 172.21.15.7:0/553702760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f314c15dd00 0x7f314c0b5750 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:22.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.154+0000 7f3151110640 1 -- 172.21.15.7:0/553702760 >> 172.21.15.7:0/553702760 conn(0x7f314c0d07b0 msgr2=0x7f314c0d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:22.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.154+0000 7f3151110640 1 -- 172.21.15.7:0/553702760 shutdown_connections 2024-04-25T10:05:22.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.154+0000 7f3151110640 1 -- 172.21.15.7:0/553702760 wait complete. 2024-04-25T10:05:22.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.155+0000 7f3151110640 1 Processor -- start 2024-04-25T10:05:22.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.155+0000 7f3151110640 1 -- start start 2024-04-25T10:05:22.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.156+0000 7f3151110640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f314c06c6c0 0x7f314c0c9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:22.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.156+0000 7f3151110640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f314c0b6a40 0x7f314c15a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:22.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.156+0000 7f3151110640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f314c15dd00 0x7f314c15ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:22.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.156+0000 7f3151110640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314c0b5c90 con 0x7f314c15dd00 2024-04-25T10:05:22.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.156+0000 7f3151110640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314c06cfe0 con 0x7f314c06c6c0 2024-04-25T10:05:22.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.156+0000 7f3151110640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314c0b5e10 con 0x7f314c0b6a40 2024-04-25T10:05:22.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.156+0000 7f314b59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f314c15dd00 0x7f314c15ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:22.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.156+0000 7f314b59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f314c15dd00 0x7f314c15ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43644/0 (socket says 172.21.15.7:43644) 2024-04-25T10:05:22.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.156+0000 7f314b59e640 1 -- 172.21.15.7:0/1175124467 learned_addr learned my addr 172.21.15.7:0/1175124467 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:22.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.156+0000 7f314ad9d640 1 --2- 172.21.15.7:0/1175124467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f314c06c6c0 0x7f314c0c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:22.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.156+0000 7f3143fff640 1 --2- 172.21.15.7:0/1175124467 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f314c0b6a40 0x7f314c15a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:22.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.156+0000 7f314b59e640 1 -- 172.21.15.7:0/1175124467 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f314c0b6a40 msgr2=0x7f314c15a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:22.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.156+0000 7f314b59e640 1 --2- 172.21.15.7:0/1175124467 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f314c0b6a40 0x7f314c15a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:22.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.156+0000 7f314b59e640 1 -- 172.21.15.7:0/1175124467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f314c06c6c0 msgr2=0x7f314c0c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:22.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.156+0000 7f314b59e640 1 --2- 172.21.15.7:0/1175124467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f314c06c6c0 0x7f314c0c9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:22.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.156+0000 7f314b59e640 1 -- 172.21.15.7:0/1175124467 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314c15d3f0 con 0x7f314c15dd00 2024-04-25T10:05:22.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.156+0000 7f314b59e640 1 --2- 172.21.15.7:0/1175124467 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f314c15dd00 0x7f314c15ad10 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f314400c7a0 tx=0x7f314400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:22.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.157+0000 7f31437fe640 1 -- 172.21.15.7:0/1175124467 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3144003b70 con 0x7f314c15dd00 2024-04-25T10:05:22.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.157+0000 7f31437fe640 1 -- 172.21.15.7:0/1175124467 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3144003d30 con 0x7f314c15dd00 2024-04-25T10:05:22.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.157+0000 7f3151110640 1 -- 172.21.15.7:0/1175124467 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f314c1415b0 con 0x7f314c15dd00 2024-04-25T10:05:22.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.157+0000 7f31437fe640 1 -- 172.21.15.7:0/1175124467 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314400aa90 con 0x7f314c15dd00 2024-04-25T10:05:22.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.157+0000 7f3151110640 1 -- 172.21.15.7:0/1175124467 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f314c141b70 con 0x7f314c15dd00 2024-04-25T10:05:22.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.158+0000 7f3151110640 1 -- 172.21.15.7:0/1175124467 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f314c068fd0 con 0x7f314c15dd00 2024-04-25T10:05:22.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.158+0000 7f31437fe640 1 -- 172.21.15.7:0/1175124467 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f314400ac30 con 0x7f314c15dd00 2024-04-25T10:05:22.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.158+0000 7f31437fe640 1 --2- 172.21.15.7:0/1175124467 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f312c06b4d0 0x7f312c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:22.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.158+0000 7f31437fe640 1 -- 172.21.15.7:0/1175124467 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f3144089f60 con 0x7f314c15dd00 2024-04-25T10:05:22.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.159+0000 7f314ad9d640 1 --2- 172.21.15.7:0/1175124467 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f312c06b4d0 0x7f312c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:22.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.159+0000 7f314ad9d640 1 --2- 172.21.15.7:0/1175124467 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f312c06b4d0 0x7f312c06d990 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f313c034000 tx=0x7f313c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:22.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.163+0000 7f31437fe640 1 -- 172.21.15.7:0/1175124467 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3144058f30 con 0x7f314c15dd00 2024-04-25T10:05:22.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.345+0000 7f3151110640 1 -- 172.21.15.7:0/1175124467 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f314c0680c0 con 0x7f312c06b4d0 2024-04-25T10:05:22.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.345+0000 7f31437fe640 1 -- 172.21.15.7:0/1175124467 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f313c038040 con 0x7f312c06b4d0 2024-04-25T10:05:22.351 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 7 to deep-scrub 2024-04-25T10:05:22.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.347+0000 7f3151110640 1 -- 172.21.15.7:0/1175124467 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f312c06b4d0 msgr2=0x7f312c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:22.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.347+0000 7f3151110640 1 --2- 172.21.15.7:0/1175124467 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f312c06b4d0 0x7f312c06d990 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f313c034000 tx=0x7f313c02e000 comp rx=0 tx=0).stop 2024-04-25T10:05:22.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.347+0000 7f3151110640 1 -- 172.21.15.7:0/1175124467 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f314c15dd00 msgr2=0x7f314c15ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:22.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.347+0000 7f3151110640 1 --2- 172.21.15.7:0/1175124467 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f314c15dd00 0x7f314c15ad10 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f314400c7a0 tx=0x7f314400cc60 comp rx=0 tx=0).stop 2024-04-25T10:05:22.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.347+0000 7f3151110640 1 -- 172.21.15.7:0/1175124467 shutdown_connections 2024-04-25T10:05:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.347+0000 7f3151110640 1 --2- 172.21.15.7:0/1175124467 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f312c06b4d0 0x7f312c06d990 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.347+0000 7f3151110640 1 --2- 172.21.15.7:0/1175124467 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f314c15dd00 0x7f314c15ad10 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.347+0000 7f3151110640 1 --2- 172.21.15.7:0/1175124467 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f314c0b6a40 0x7f314c15a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.348+0000 7f3151110640 1 --2- 172.21.15.7:0/1175124467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f314c06c6c0 0x7f314c0c9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.348+0000 7f3151110640 1 -- 172.21.15.7:0/1175124467 >> 172.21.15.7:0/1175124467 conn(0x7f314c0d07b0 msgr2=0x7f314c0c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.348+0000 7f3151110640 1 -- 172.21.15.7:0/1175124467 shutdown_connections 2024-04-25T10:05:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.348+0000 7f3151110640 1 -- 172.21.15.7:0/1175124467 wait complete. 2024-04-25T10:05:22.364 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:05:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.459+0000 7f47682e1640 1 Processor -- start 2024-04-25T10:05:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.459+0000 7f47682e1640 1 -- start start 2024-04-25T10:05:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.460+0000 7f47682e1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f47600b5e60 0x7f476006bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.460+0000 7f47682e1640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47600b6a40 0x7f476006c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.460+0000 7f47682e1640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f476006ca30 con 0x7f476015dd00 2024-04-25T10:05:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.460+0000 7f47682e1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f476015e0e0 con 0x7f47600b5e60 2024-04-25T10:05:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.460+0000 7f47682e1640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476006cfe0 con 0x7f47600b6a40 2024-04-25T10:05:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.460+0000 7f476607d640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f476015dd00 0x7f47600b5750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48862/0 (socket says 172.21.15.7:48862) 2024-04-25T10:05:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.460+0000 7f476607d640 1 -- 172.21.15.7:0/1117132756 learned_addr learned my addr 172.21.15.7:0/1117132756 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:05:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.460+0000 7f476507b640 1 -- 172.21.15.7:0/1117132756 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1787903454 0 0) 0x7f476006ca30 con 0x7f476015dd00 2024-04-25T10:05:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.460+0000 7f476687e640 1 --2- 172.21.15.7:0/1117132756 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47600b6a40 0x7f476006c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.460+0000 7f476507b640 1 -- 172.21.15.7:0/1117132756 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4748003520 con 0x7f476015dd00 2024-04-25T10:05:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.460+0000 7f476587c640 1 --2- 172.21.15.7:0/1117132756 >> v2:172.21.15.55:3300/0 conn(0x7f47600b5e60 0x7f476006bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.461+0000 7f476507b640 1 -- 172.21.15.7:0/1117132756 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 438615197 0 0) 0x7f4748003520 con 0x7f476015dd00 2024-04-25T10:05:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.461+0000 7f476507b640 1 -- 172.21.15.7:0/1117132756 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47600b6a40 msgr2=0x7f476006c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.461+0000 7f476507b640 1 --2- 172.21.15.7:0/1117132756 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47600b6a40 0x7f476006c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.461+0000 7f476507b640 1 -- 172.21.15.7:0/1117132756 >> v2:172.21.15.55:3300/0 conn(0x7f47600b5e60 msgr2=0x7f476006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.461+0000 7f476507b640 1 --2- 172.21.15.7:0/1117132756 >> v2:172.21.15.55:3300/0 conn(0x7f47600b5e60 0x7f476006bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.461+0000 7f476507b640 1 -- 172.21.15.7:0/1117132756 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476006cd00 con 0x7f476015dd00 2024-04-25T10:05:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.461+0000 7f476507b640 1 -- 172.21.15.7:0/1117132756 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7f4758001670 con 0x7f476015dd00 2024-04-25T10:05:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.461+0000 7f476507b640 1 -- 172.21.15.7:0/1117132756 >> v1:172.21.15.7:6789/0 conn(0x7f476015dd00 legacy=0x7f47600b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.461+0000 7f476507b640 1 --2- 172.21.15.7:0/1117132756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47480039b0 0x7f4748003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.461+0000 7f476507b640 1 --2- 172.21.15.7:0/1117132756 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47600b6a40 0x7f4748004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.461+0000 7f476507b640 1 --2- 172.21.15.7:0/1117132756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4748004d40 0x7f47480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.461+0000 7f476507b640 1 -- 172.21.15.7:0/1117132756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476015e0e0 con 0x7f4748004d40 2024-04-25T10:05:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.461+0000 7f476507b640 1 -- 172.21.15.7:0/1117132756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476006cfe0 con 0x7f47480039b0 2024-04-25T10:05:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.461+0000 7f476507b640 1 -- 172.21.15.7:0/1117132756 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f474800b9c0 con 0x7f47600b6a40 2024-04-25T10:05:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.461+0000 7f476687e640 1 --2- 172.21.15.7:0/1117132756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4748004d40 0x7f47480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.461+0000 7f476607d640 1 --2- 172.21.15.7:0/1117132756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47480039b0 0x7f4748003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.461+0000 7f476587c640 1 --2- 172.21.15.7:0/1117132756 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47600b6a40 0x7f4748004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.461+0000 7f476687e640 1 -- 172.21.15.7:0/1117132756 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47600b6a40 msgr2=0x7f4748004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.461+0000 7f476687e640 1 --2- 172.21.15.7:0/1117132756 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47600b6a40 0x7f4748004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.461+0000 7f476687e640 1 -- 172.21.15.7:0/1117132756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47480039b0 msgr2=0x7f4748003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.461+0000 7f476687e640 1 --2- 172.21.15.7:0/1117132756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47480039b0 0x7f4748003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.461+0000 7f476687e640 1 -- 172.21.15.7:0/1117132756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4748003520 con 0x7f4748004d40 2024-04-25T10:05:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.461+0000 7f476607d640 1 --2- 172.21.15.7:0/1117132756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47480039b0 0x7f4748003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.461+0000 7f476587c640 1 --2- 172.21.15.7:0/1117132756 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47600b6a40 0x7f4748004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.462+0000 7f476687e640 1 --2- 172.21.15.7:0/1117132756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4748004d40 0x7f47480051c0 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f4750009fc0 tx=0x7f4748005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a96e12ac4d82f7c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.462+0000 7f476507b640 1 -- 172.21.15.7:0/1117132756 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4750009c10 con 0x7f4748004d40 2024-04-25T10:05:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.462+0000 7f476507b640 1 -- 172.21.15.7:0/1117132756 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4750036070 con 0x7f4748004d40 2024-04-25T10:05:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.462+0000 7f476507b640 1 -- 172.21.15.7:0/1117132756 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4750031880 con 0x7f4748004d40 2024-04-25T10:05:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.463+0000 7f47682e1640 1 -- 172.21.15.7:0/1117132756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4748004d40 msgr2=0x7f47480051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.463+0000 7f47682e1640 1 --2- 172.21.15.7:0/1117132756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4748004d40 0x7f47480051c0 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f4750009fc0 tx=0x7f4748005830 comp rx=0 tx=0).stop 2024-04-25T10:05:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.463+0000 7f476687e640 1 -- 172.21.15.7:0/1117132756 reap_dead start 2024-04-25T10:05:22.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.463+0000 7f47682e1640 1 -- 172.21.15.7:0/1117132756 shutdown_connections 2024-04-25T10:05:22.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.463+0000 7f47682e1640 1 -- 172.21.15.7:0/1117132756 >> 172.21.15.7:0/1117132756 conn(0x7f47600d07b0 msgr2=0x7f47600d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:22.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.463+0000 7f47682e1640 1 -- 172.21.15.7:0/1117132756 shutdown_connections 2024-04-25T10:05:22.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.463+0000 7f47682e1640 1 -- 172.21.15.7:0/1117132756 wait complete. 2024-04-25T10:05:22.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.464+0000 7f47682e1640 1 Processor -- start 2024-04-25T10:05:22.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.464+0000 7f47682e1640 1 -- start start 2024-04-25T10:05:22.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.465+0000 7f47682e1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4748004d40 0x7f4760144070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:22.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.465+0000 7f47682e1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47600c9360 0x7f47600d2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:22.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.465+0000 7f47682e1640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47600d2bc0 0x7f476015b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:22.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.465+0000 7f47682e1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47600d2260 con 0x7f47600c9360 2024-04-25T10:05:22.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.465+0000 7f47682e1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47600d1f80 con 0x7f4748004d40 2024-04-25T10:05:22.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.465+0000 7f47682e1640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476006c4f0 con 0x7f47600d2bc0 2024-04-25T10:05:22.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.465+0000 7f476587c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47600c9360 0x7f47600d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:22.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.465+0000 7f476587c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47600c9360 0x7f47600d2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43658/0 (socket says 172.21.15.7:43658) 2024-04-25T10:05:22.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.465+0000 7f476587c640 1 -- 172.21.15.7:0/1022099617 learned_addr learned my addr 172.21.15.7:0/1022099617 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:22.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.465+0000 7f476687e640 1 --2- 172.21.15.7:0/1022099617 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47600d2bc0 0x7f476015b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:22.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.465+0000 7f476607d640 1 --2- 172.21.15.7:0/1022099617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4748004d40 0x7f4760144070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:22.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.465+0000 7f476587c640 1 -- 172.21.15.7:0/1022099617 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47600d2bc0 msgr2=0x7f476015b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:22.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.465+0000 7f476587c640 1 --2- 172.21.15.7:0/1022099617 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47600d2bc0 0x7f476015b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:22.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.465+0000 7f476587c640 1 -- 172.21.15.7:0/1022099617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4748004d40 msgr2=0x7f4760144070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:22.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.465+0000 7f476587c640 1 --2- 172.21.15.7:0/1022099617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4748004d40 0x7f4760144070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:22.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.465+0000 7f476587c640 1 -- 172.21.15.7:0/1022099617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47601445b0 con 0x7f47600c9360 2024-04-25T10:05:22.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.465+0000 7f476587c640 1 --2- 172.21.15.7:0/1022099617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47600c9360 0x7f47600d2680 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f47540116d0 tx=0x7f4754011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:22.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.465+0000 7f475effd640 1 -- 172.21.15.7:0/1022099617 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475400f9c0 con 0x7f47600c9360 2024-04-25T10:05:22.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.465+0000 7f475effd640 1 -- 172.21.15.7:0/1022099617 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475400fb60 con 0x7f47600c9360 2024-04-25T10:05:22.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.465+0000 7f47682e1640 1 -- 172.21.15.7:0/1022099617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47600cae30 con 0x7f47600c9360 2024-04-25T10:05:22.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.465+0000 7f475effd640 1 -- 172.21.15.7:0/1022099617 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4754015460 con 0x7f47600c9360 2024-04-25T10:05:22.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.465+0000 7f47682e1640 1 -- 172.21.15.7:0/1022099617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47600cb3f0 con 0x7f47600c9360 2024-04-25T10:05:22.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.466+0000 7f47682e1640 1 -- 172.21.15.7:0/1022099617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47600d2fd0 con 0x7f47600c9360 2024-04-25T10:05:22.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.467+0000 7f475effd640 1 -- 172.21.15.7:0/1022099617 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4754015600 con 0x7f47600c9360 2024-04-25T10:05:22.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.467+0000 7f475effd640 1 --2- 172.21.15.7:0/1022099617 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f474c06b4d0 0x7f474c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:22.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.467+0000 7f475effd640 1 -- 172.21.15.7:0/1022099617 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f475408aa60 con 0x7f47600c9360 2024-04-25T10:05:22.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.467+0000 7f476607d640 1 --2- 172.21.15.7:0/1022099617 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f474c06b4d0 0x7f474c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:22.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.468+0000 7f476607d640 1 --2- 172.21.15.7:0/1022099617 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f474c06b4d0 0x7f474c06d990 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f4758005a70 tx=0x7f4758009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:22.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.471+0000 7f475effd640 1 -- 172.21.15.7:0/1022099617 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f47600d2fd0 con 0x7f47600c9360 2024-04-25T10:05:22.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.653+0000 7f47682e1640 1 -- 172.21.15.7:0/1022099617 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4760068fd0 con 0x7f474c06b4d0 2024-04-25T10:05:22.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.653+0000 7f475effd640 1 -- 172.21.15.7:0/1022099617 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13417 (secure 0 0 0) 0x7f4760068fd0 con 0x7f474c06b4d0 2024-04-25T10:05:22.662 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:05:22.663 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T10:05:22.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.655+0000 7f47682e1640 1 -- 172.21.15.7:0/1022099617 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f474c06b4d0 msgr2=0x7f474c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:22.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.655+0000 7f47682e1640 1 --2- 172.21.15.7:0/1022099617 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f474c06b4d0 0x7f474c06d990 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f4758005a70 tx=0x7f4758009040 comp rx=0 tx=0).stop 2024-04-25T10:05:22.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.655+0000 7f47682e1640 1 -- 172.21.15.7:0/1022099617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47600c9360 msgr2=0x7f47600d2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:22.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.655+0000 7f47682e1640 1 --2- 172.21.15.7:0/1022099617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47600c9360 0x7f47600d2680 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f47540116d0 tx=0x7f4754011b90 comp rx=0 tx=0).stop 2024-04-25T10:05:22.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.655+0000 7f47682e1640 1 -- 172.21.15.7:0/1022099617 shutdown_connections 2024-04-25T10:05:22.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.655+0000 7f47682e1640 1 --2- 172.21.15.7:0/1022099617 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f474c06b4d0 0x7f474c06d990 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:22.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.655+0000 7f47682e1640 1 --2- 172.21.15.7:0/1022099617 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47600d2bc0 0x7f476015b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:22.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.655+0000 7f47682e1640 1 --2- 172.21.15.7:0/1022099617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47600c9360 0x7f47600d2680 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:22.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.655+0000 7f47682e1640 1 --2- 172.21.15.7:0/1022099617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4748004d40 0x7f4760144070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:22.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.656+0000 7f47682e1640 1 -- 172.21.15.7:0/1022099617 >> 172.21.15.7:0/1022099617 conn(0x7f47600d07b0 msgr2=0x7f47600ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:22.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.656+0000 7f47682e1640 1 -- 172.21.15.7:0/1022099617 shutdown_connections 2024-04-25T10:05:22.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:22.656+0000 7f47682e1640 1 -- 172.21.15.7:0/1022099617 wait complete. 2024-04-25T10:05:22.671 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":449,"stamp":"2024-04-25T10:05:22.004904+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":270848,"kb_used_data":13064,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754703872,"statfs":{"total":773094113280,"available":772816764928,"internally_reserved":0,"allocated":13377536,"data_stored":6861704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":263835185},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8388625,"num_objects":-5,"num_object_clones":0,"num_object_copies":-10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-5,"num_whiteouts":0,"num_read":-32,"num_read_kb":-13,"num_write":-29,"num_write_kb":-8195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.385239"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":359,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:05:14.726960+0000","last_change":"2024-04-25T09:54:17.127419+0000","last_active":"2024-04-25T10:05:14.726960+0000","last_peered":"2024-04-25T10:05:14.726960+0000","last_clean":"2024-04-25T10:05:14.726960+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T10:05:14.726960+0000","last_undegraded":"2024-04-25T10:05:14.726960+0000","last_fullsized":"2024-04-25T10:05:14.726960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:54:16.049632+0000","last_clean_scrub_stamp":"2024-04-25T09:54:16.049632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:06.868772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542280,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33256,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338584,"statfs":{"total":96636764160,"available":96602710016,"internally_reserved":0,"allocated":2117632,"data_stored":1300489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542280,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32668,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1523712,"data_stored":710121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542282,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32668,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1523712,"data_stored":710121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542279,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32676,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339164,"statfs":{"total":96636764160,"available":96603303936,"internally_reserved":0,"allocated":1523712,"data_stored":710121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574984,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36828,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335012,"statfs":{"total":96636764160,"available":96599052288,"internally_reserved":0,"allocated":1523712,"data_stored":710121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574984,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32668,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1523712,"data_stored":710121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574984,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32668,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1523712,"data_stored":710121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574984,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37416,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334424,"statfs":{"total":96636764160,"available":96598450176,"internally_reserved":0,"allocated":2117632,"data_stored":1300489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:05:22.675 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T09:54:16.049632+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=54, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=5, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:05:22.675 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T10:05:27.560 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:05:27.564 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:05:42.677 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:05:42.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.786+0000 7f5309fab640 1 Processor -- start 2024-04-25T10:05:42.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.786+0000 7f5309fab640 1 -- start start 2024-04-25T10:05:42.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.787+0000 7f5309fab640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f530415dd00 0x7f53040b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:42.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.787+0000 7f5309fab640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f530406c6c0 0x7f53040b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.787+0000 7f5309fab640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f530406cd00 con 0x7f53040b6a40 2024-04-25T10:05:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.787+0000 7f5309fab640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f530415e0e0 con 0x7f530415dd00 2024-04-25T10:05:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.787+0000 7f5309fab640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530406cfe0 con 0x7f530406c6c0 2024-04-25T10:05:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.787+0000 7f53037fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f530415dd00 0x7f53040b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.787+0000 7f5302ffd640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f53040b6a40 0x7f530406bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:57722/0 (socket says 172.21.15.7:57722) 2024-04-25T10:05:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.787+0000 7f5302ffd640 1 -- 172.21.15.7:0/3904666285 learned_addr learned my addr 172.21.15.7:0/3904666285 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:05:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.787+0000 7f5303fff640 1 --2- 172.21.15.7:0/3904666285 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f530406c6c0 0x7f53040b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.787+0000 7f53037fe640 1 -- 172.21.15.7:0/3904666285 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f530406c6c0 msgr2=0x7f53040b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.787+0000 7f53037fe640 1 --2- 172.21.15.7:0/3904666285 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f530406c6c0 0x7f53040b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.787+0000 7f53037fe640 1 -- 172.21.15.7:0/3904666285 >> v1:172.21.15.7:6789/0 conn(0x7f53040b6a40 legacy=0x7f530406bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.787+0000 7f53027fc640 1 -- 172.21.15.7:0/3904666285 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 549443200 0 0) 0x7f530406cd00 con 0x7f53040b6a40 2024-04-25T10:05:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.787+0000 7f53037fe640 1 -- 172.21.15.7:0/3904666285 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53040d1ca0 con 0x7f530415dd00 2024-04-25T10:05:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.788+0000 7f53037fe640 1 --2- 172.21.15.7:0/3904666285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f530415dd00 0x7f53040b5750 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f52f40097a0 tx=0x7f52f402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1aa0ce5dfdf1d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.788+0000 7f53027fc640 1 -- 172.21.15.7:0/3904666285 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f4037070 con 0x7f530415dd00 2024-04-25T10:05:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.788+0000 7f53027fc640 1 -- 172.21.15.7:0/3904666285 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f4032440 con 0x7f530415dd00 2024-04-25T10:05:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.788+0000 7f53027fc640 1 -- 172.21.15.7:0/3904666285 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f4032810 con 0x7f530415dd00 2024-04-25T10:05:42.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.789+0000 7f5309fab640 1 -- 172.21.15.7:0/3904666285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f530415dd00 msgr2=0x7f53040b5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:42.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.789+0000 7f5309fab640 1 --2- 172.21.15.7:0/3904666285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f530415dd00 0x7f53040b5750 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f52f40097a0 tx=0x7f52f402a210 comp rx=0 tx=0).stop 2024-04-25T10:05:42.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.789+0000 7f5309fab640 1 -- 172.21.15.7:0/3904666285 shutdown_connections 2024-04-25T10:05:42.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.789+0000 7f5309fab640 1 --2- 172.21.15.7:0/3904666285 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f530406c6c0 0x7f53040b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:42.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.789+0000 7f5309fab640 1 --2- 172.21.15.7:0/3904666285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f530415dd00 0x7f53040b5750 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:42.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.789+0000 7f5309fab640 1 -- 172.21.15.7:0/3904666285 >> 172.21.15.7:0/3904666285 conn(0x7f53040d07b0 msgr2=0x7f53040d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:42.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.789+0000 7f5309fab640 1 -- 172.21.15.7:0/3904666285 shutdown_connections 2024-04-25T10:05:42.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.789+0000 7f5309fab640 1 -- 172.21.15.7:0/3904666285 wait complete. 2024-04-25T10:05:42.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.790+0000 7f5309fab640 1 Processor -- start 2024-04-25T10:05:42.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.790+0000 7f5309fab640 1 -- start start 2024-04-25T10:05:42.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.791+0000 7f5309fab640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f530406c6c0 0x7f53041f3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:42.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.791+0000 7f5309fab640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53040b6a40 0x7f530415fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:42.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.791+0000 7f5309fab640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f530415dd00 0x7f53040cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:42.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.791+0000 7f5309fab640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53040d2780 con 0x7f53040b6a40 2024-04-25T10:05:42.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.791+0000 7f5309fab640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53040d2260 con 0x7f530415dd00 2024-04-25T10:05:42.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.791+0000 7f5309fab640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53040d2900 con 0x7f530406c6c0 2024-04-25T10:05:42.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.791+0000 7f5302ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53040b6a40 0x7f530415fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:42.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.791+0000 7f5302ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53040b6a40 0x7f530415fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41770/0 (socket says 172.21.15.7:41770) 2024-04-25T10:05:42.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.791+0000 7f5302ffd640 1 -- 172.21.15.7:0/637085083 learned_addr learned my addr 172.21.15.7:0/637085083 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:42.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.791+0000 7f53037fe640 1 --2- 172.21.15.7:0/637085083 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f530406c6c0 0x7f53041f3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:42.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.791+0000 7f5303fff640 1 --2- 172.21.15.7:0/637085083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f530415dd00 0x7f53040cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:42.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.791+0000 7f5302ffd640 1 -- 172.21.15.7:0/637085083 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f530406c6c0 msgr2=0x7f53041f3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:42.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.791+0000 7f5302ffd640 1 --2- 172.21.15.7:0/637085083 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f530406c6c0 0x7f53041f3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:42.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.792+0000 7f5302ffd640 1 -- 172.21.15.7:0/637085083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f530415dd00 msgr2=0x7f53040cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:42.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.792+0000 7f5302ffd640 1 --2- 172.21.15.7:0/637085083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f530415dd00 0x7f53040cc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:42.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.792+0000 7f5302ffd640 1 -- 172.21.15.7:0/637085083 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53040caec0 con 0x7f53040b6a40 2024-04-25T10:05:42.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.792+0000 7f53037fe640 1 --2- 172.21.15.7:0/637085083 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f530406c6c0 0x7f53041f3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:42.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.792+0000 7f5302ffd640 1 --2- 172.21.15.7:0/637085083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53040b6a40 0x7f530415fdf0 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f52f800c4d0 tx=0x7f52f800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:42.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.792+0000 7f52ebfff640 1 -- 172.21.15.7:0/637085083 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f8018070 con 0x7f53040b6a40 2024-04-25T10:05:42.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.792+0000 7f52ebfff640 1 -- 172.21.15.7:0/637085083 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f8007500 con 0x7f53040b6a40 2024-04-25T10:05:42.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.792+0000 7f5309fab640 1 -- 172.21.15.7:0/637085083 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53040cb1a0 con 0x7f53040b6a40 2024-04-25T10:05:42.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.792+0000 7f52ebfff640 1 -- 172.21.15.7:0/637085083 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f8004a20 con 0x7f53040b6a40 2024-04-25T10:05:42.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.792+0000 7f5309fab640 1 -- 172.21.15.7:0/637085083 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53040cb760 con 0x7f53040b6a40 2024-04-25T10:05:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.793+0000 7f5309fab640 1 -- 172.21.15.7:0/637085083 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5304068fd0 con 0x7f53040b6a40 2024-04-25T10:05:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.794+0000 7f52ebfff640 1 -- 172.21.15.7:0/637085083 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f52f801b070 con 0x7f53040b6a40 2024-04-25T10:05:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.794+0000 7f52ebfff640 1 --2- 172.21.15.7:0/637085083 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f52f006b500 0x7f52f006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.794+0000 7f52ebfff640 1 -- 172.21.15.7:0/637085083 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f52f8089420 con 0x7f53040b6a40 2024-04-25T10:05:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.794+0000 7f53037fe640 1 --2- 172.21.15.7:0/637085083 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f52f006b500 0x7f52f006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.795+0000 7f53037fe640 1 --2- 172.21.15.7:0/637085083 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f52f006b500 0x7f52f006d9c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f52f4034000 tx=0x7f52f402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:42.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.799+0000 7f52ebfff640 1 -- 172.21.15.7:0/637085083 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f52f8058360 con 0x7f53040b6a40 2024-04-25T10:05:42.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.975+0000 7f5309fab640 1 -- 172.21.15.7:0/637085083 --> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f53040d1620 con 0x7f52f006b500 2024-04-25T10:05:42.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.975+0000 7f52ebfff640 1 -- 172.21.15.7:0/637085083 <== mgr.4110 v2:172.21.15.7:6832/457172722 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13379 (secure 0 0 0) 0x7f53040d1620 con 0x7f52f006b500 2024-04-25T10:05:42.981 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:05:42.981 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-04-25T10:05:42.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.977+0000 7f5309fab640 1 -- 172.21.15.7:0/637085083 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f52f006b500 msgr2=0x7f52f006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:42.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.977+0000 7f5309fab640 1 --2- 172.21.15.7:0/637085083 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f52f006b500 0x7f52f006d9c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f52f4034000 tx=0x7f52f402e000 comp rx=0 tx=0).stop 2024-04-25T10:05:42.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.977+0000 7f5309fab640 1 -- 172.21.15.7:0/637085083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53040b6a40 msgr2=0x7f530415fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:42.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.977+0000 7f5309fab640 1 --2- 172.21.15.7:0/637085083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53040b6a40 0x7f530415fdf0 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f52f800c4d0 tx=0x7f52f800c990 comp rx=0 tx=0).stop 2024-04-25T10:05:42.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.977+0000 7f5309fab640 1 -- 172.21.15.7:0/637085083 shutdown_connections 2024-04-25T10:05:42.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.977+0000 7f5309fab640 1 --2- 172.21.15.7:0/637085083 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f52f006b500 0x7f52f006d9c0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:42.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.977+0000 7f5309fab640 1 --2- 172.21.15.7:0/637085083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f530415dd00 0x7f53040cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:42.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.977+0000 7f5309fab640 1 --2- 172.21.15.7:0/637085083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f53040b6a40 0x7f530415fdf0 unknown :-1 s=CLOSED pgs=2027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:42.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.977+0000 7f5309fab640 1 --2- 172.21.15.7:0/637085083 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f530406c6c0 0x7f53041f3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:42.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.977+0000 7f5309fab640 1 -- 172.21.15.7:0/637085083 >> 172.21.15.7:0/637085083 conn(0x7f53040d07b0 msgr2=0x7f53040b8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:42.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.977+0000 7f5309fab640 1 -- 172.21.15.7:0/637085083 shutdown_connections 2024-04-25T10:05:42.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:42.978+0000 7f5309fab640 1 -- 172.21.15.7:0/637085083 wait complete. 2024-04-25T10:05:42.993 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":459,"stamp":"2024-04-25T10:05:42.009044+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":270824,"kb_used_data":13064,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754703896,"statfs":{"total":773094113280,"available":772816789504,"internally_reserved":0,"allocated":13377536,"data_stored":6861704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":263835185},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002636"},"pg_stats":[{"pgid":"1.0","version":"122'119","reported_seq":370,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:05:22.899022+0000","last_change":"2024-04-25T10:05:22.899059+0000","last_active":"2024-04-25T10:05:22.899022+0000","last_peered":"2024-04-25T10:05:22.899022+0000","last_clean":"2024-04-25T10:05:22.899022+0000","last_became_active":"2024-04-25T09:54:17.126477+0000","last_became_peered":"2024-04-25T09:54:17.126477+0000","last_unstale":"2024-04-25T10:05:22.899022+0000","last_undegraded":"2024-04-25T10:05:22.899022+0000","last_fullsized":"2024-04-25T10:05:22.899022+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"122'119","last_scrub_stamp":"2024-04-25T10:05:22.898930+0000","last_deep_scrub":"122'119","last_deep_scrub_stamp":"2024-04-25T10:05:22.898930+0000","last_clean_scrub_stamp":"2024-04-25T10:05:22.898930+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:40:40.389057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542284,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33244,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338596,"statfs":{"total":96636764160,"available":96602722304,"internally_reserved":0,"allocated":2117632,"data_stored":1300489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542284,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32668,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1523712,"data_stored":710121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542286,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32668,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1523712,"data_stored":710121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542283,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32676,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339164,"statfs":{"total":96636764160,"available":96603303936,"internally_reserved":0,"allocated":1523712,"data_stored":710121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574988,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36828,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335012,"statfs":{"total":96636764160,"available":96599052288,"internally_reserved":0,"allocated":1523712,"data_stored":710121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574988,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32668,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1523712,"data_stored":710121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574988,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32668,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1523712,"data_stored":710121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574988,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37404,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334436,"statfs":{"total":96636764160,"available":96598462464,"internally_reserved":0,"allocated":2117632,"data_stored":1300489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:05:42.994 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T10:05:43.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.089+0000 7fb830b32640 1 Processor -- start 2024-04-25T10:05:43.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.089+0000 7fb830b32640 1 -- start start 2024-04-25T10:05:43.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.090+0000 7fb830b32640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb82c0d3760 0x7fb82c15eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:43.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.090+0000 7fb830b32640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb82c0ced10 con 0x7fb82c15f1c0 2024-04-25T10:05:43.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.090+0000 7fb830b32640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb82c0d1b40 con 0x7fb82c0ce830 2024-04-25T10:05:43.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.090+0000 7fb830b32640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb82c0ce380 con 0x7fb82c0d3760 2024-04-25T10:05:43.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.090+0000 7fb829d9b640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb82c15f1c0 0x7fb82c0d3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:57732/0 (socket says 172.21.15.7:57732) 2024-04-25T10:05:43.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.090+0000 7fb829d9b640 1 -- 172.21.15.7:0/1978827722 learned_addr learned my addr 172.21.15.7:0/1978827722 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-04-25T10:05:43.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.091+0000 7fb82a59c640 1 --2- 172.21.15.7:0/1978827722 >> v2:172.21.15.55:3300/0 conn(0x7fb82c0d3760 0x7fb82c15eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:43.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.091+0000 7fb82959a640 1 -- 172.21.15.7:0/1978827722 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 472628586 0 0) 0x7fb82c0ced10 con 0x7fb82c15f1c0 2024-04-25T10:05:43.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.091+0000 7fb82959a640 1 -- 172.21.15.7:0/1978827722 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb818003520 con 0x7fb82c15f1c0 2024-04-25T10:05:43.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.091+0000 7fb82959a640 1 -- 172.21.15.7:0/1978827722 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 869844562 0 0) 0x7fb818003520 con 0x7fb82c15f1c0 2024-04-25T10:05:43.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.091+0000 7fb82959a640 1 -- 172.21.15.7:0/1978827722 >> v2:172.21.15.55:3300/0 conn(0x7fb82c0d3760 msgr2=0x7fb82c15eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:43.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.091+0000 7fb82959a640 1 --2- 172.21.15.7:0/1978827722 >> v2:172.21.15.55:3300/0 conn(0x7fb82c0d3760 0x7fb82c15eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.091+0000 7fb82959a640 1 -- 172.21.15.7:0/1978827722 >> v1:172.21.15.55:6789/0 conn(0x7fb82c0ce830 legacy=0x7fb82c0b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:43.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.091+0000 7fb82959a640 1 -- 172.21.15.7:0/1978827722 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82c0d1e20 con 0x7fb82c15f1c0 2024-04-25T10:05:43.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.091+0000 7fb82959a640 1 -- 172.21.15.7:0/1978827722 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1133635264 0 0) 0x7fb814001670 con 0x7fb82c15f1c0 2024-04-25T10:05:43.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.091+0000 7fb82959a640 1 -- 172.21.15.7:0/1978827722 >> v1:172.21.15.7:6789/0 conn(0x7fb82c15f1c0 legacy=0x7fb82c0d3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:43.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.091+0000 7fb82959a640 1 --2- 172.21.15.7:0/1978827722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8180039b0 0x7fb818003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:43.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.091+0000 7fb82959a640 1 --2- 172.21.15.7:0/1978827722 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb818004800 0x7fb818004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:43.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.091+0000 7fb82959a640 1 --2- 172.21.15.7:0/1978827722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8180051c0 0x7fb81800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:43.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.091+0000 7fb82959a640 1 -- 172.21.15.7:0/1978827722 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81800c030 con 0x7fb8180051c0 2024-04-25T10:05:43.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.091+0000 7fb82959a640 1 -- 172.21.15.7:0/1978827722 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81800c1e0 con 0x7fb8180039b0 2024-04-25T10:05:43.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.091+0000 7fb82959a640 1 -- 172.21.15.7:0/1978827722 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb81800c3e0 con 0x7fb818004800 2024-04-25T10:05:43.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.091+0000 7fb82ad9d640 1 --2- 172.21.15.7:0/1978827722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8180051c0 0x7fb81800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:43.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.091+0000 7fb82a59c640 1 --2- 172.21.15.7:0/1978827722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8180039b0 0x7fb818003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:43.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.091+0000 7fb829d9b640 1 --2- 172.21.15.7:0/1978827722 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb818004800 0x7fb818004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:43.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.091+0000 7fb82ad9d640 1 -- 172.21.15.7:0/1978827722 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb818004800 msgr2=0x7fb818004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:43.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.091+0000 7fb82ad9d640 1 --2- 172.21.15.7:0/1978827722 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb818004800 0x7fb818004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.091+0000 7fb82ad9d640 1 -- 172.21.15.7:0/1978827722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8180039b0 msgr2=0x7fb818003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:43.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.091+0000 7fb82ad9d640 1 --2- 172.21.15.7:0/1978827722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8180039b0 0x7fb818003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.091+0000 7fb82ad9d640 1 -- 172.21.15.7:0/1978827722 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb818003520 con 0x7fb8180051c0 2024-04-25T10:05:43.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.091+0000 7fb829d9b640 1 --2- 172.21.15.7:0/1978827722 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb818004800 0x7fb818004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:43.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.092+0000 7fb82ad9d640 1 -- 172.21.15.7:0/1978827722 reap_dead start 2024-04-25T10:05:43.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.092+0000 7fb82ad9d640 1 --2- 172.21.15.7:0/1978827722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8180051c0 0x7fb81800b9c0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7fb82c0cec40 tx=0x7fb818005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e731b70d45af1a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:43.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.092+0000 7fb82959a640 1 -- 172.21.15.7:0/1978827722 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c001a70 con 0x7fb8180051c0 2024-04-25T10:05:43.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.092+0000 7fb82959a640 1 -- 172.21.15.7:0/1978827722 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81c02ae10 con 0x7fb8180051c0 2024-04-25T10:05:43.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.092+0000 7fb82959a640 1 -- 172.21.15.7:0/1978827722 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c003bb0 con 0x7fb8180051c0 2024-04-25T10:05:43.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.093+0000 7fb830b32640 1 -- 172.21.15.7:0/1978827722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8180051c0 msgr2=0x7fb81800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:43.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.093+0000 7fb830b32640 1 --2- 172.21.15.7:0/1978827722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8180051c0 0x7fb81800b9c0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7fb82c0cec40 tx=0x7fb818005830 comp rx=0 tx=0).stop 2024-04-25T10:05:43.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.093+0000 7fb830b32640 1 -- 172.21.15.7:0/1978827722 shutdown_connections 2024-04-25T10:05:43.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.093+0000 7fb830b32640 1 --2- 172.21.15.7:0/1978827722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8180051c0 0x7fb81800b9c0 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.093+0000 7fb830b32640 1 -- 172.21.15.7:0/1978827722 >> 172.21.15.7:0/1978827722 conn(0x7fb82c072680 msgr2=0x7fb82c072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:43.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.093+0000 7fb830b32640 1 -- 172.21.15.7:0/1978827722 shutdown_connections 2024-04-25T10:05:43.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.093+0000 7fb830b32640 1 -- 172.21.15.7:0/1978827722 wait complete. 2024-04-25T10:05:43.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.094+0000 7fb830b32640 1 Processor -- start 2024-04-25T10:05:43.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.094+0000 7fb830b32640 1 -- start start 2024-04-25T10:05:43.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.095+0000 7fb830b32640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8180051c0 0x7fb82c1f3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:43.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.095+0000 7fb830b32640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb82c0cd280 0x7fb82c1f08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:43.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.095+0000 7fb830b32640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb82c0b8680 0x7fb82c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:43.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.095+0000 7fb830b32640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c15eac0 con 0x7fb8180051c0 2024-04-25T10:05:43.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.095+0000 7fb830b32640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c0d2190 con 0x7fb82c0cd280 2024-04-25T10:05:43.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.095+0000 7fb830b32640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c15ec40 con 0x7fb82c0b8680 2024-04-25T10:05:43.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.095+0000 7fb82a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8180051c0 0x7fb82c1f3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:43.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.095+0000 7fb82a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8180051c0 0x7fb82c1f3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41782/0 (socket says 172.21.15.7:41782) 2024-04-25T10:05:43.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.095+0000 7fb82a59c640 1 -- 172.21.15.7:0/345823017 learned_addr learned my addr 172.21.15.7:0/345823017 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:43.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.095+0000 7fb82ad9d640 1 --2- 172.21.15.7:0/345823017 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb82c0b8680 0x7fb82c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:43.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.096+0000 7fb82a59c640 1 -- 172.21.15.7:0/345823017 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb82c0b8680 msgr2=0x7fb82c0b8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:43.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.096+0000 7fb82a59c640 1 --2- 172.21.15.7:0/345823017 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb82c0b8680 0x7fb82c0b8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.096+0000 7fb829d9b640 1 --2- 172.21.15.7:0/345823017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb82c0cd280 0x7fb82c1f08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:43.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.096+0000 7fb82a59c640 1 -- 172.21.15.7:0/345823017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb82c0cd280 msgr2=0x7fb82c1f08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:43.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.096+0000 7fb82a59c640 1 --2- 172.21.15.7:0/345823017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb82c0cd280 0x7fb82c1f08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.096+0000 7fb82a59c640 1 -- 172.21.15.7:0/345823017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82c1f4410 con 0x7fb8180051c0 2024-04-25T10:05:43.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.096+0000 7fb829d9b640 1 --2- 172.21.15.7:0/345823017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb82c0cd280 0x7fb82c1f08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:43.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.096+0000 7fb82a59c640 1 --2- 172.21.15.7:0/345823017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8180051c0 0x7fb82c1f3ed0 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7fb8240118e0 tx=0x7fb824011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:43.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.096+0000 7fb822ffd640 1 -- 172.21.15.7:0/345823017 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82400faf0 con 0x7fb8180051c0 2024-04-25T10:05:43.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.096+0000 7fb822ffd640 1 -- 172.21.15.7:0/345823017 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82400fc90 con 0x7fb8180051c0 2024-04-25T10:05:43.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.096+0000 7fb830b32640 1 -- 172.21.15.7:0/345823017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb82c0c8580 con 0x7fb8180051c0 2024-04-25T10:05:43.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.096+0000 7fb822ffd640 1 -- 172.21.15.7:0/345823017 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb824014440 con 0x7fb8180051c0 2024-04-25T10:05:43.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.096+0000 7fb830b32640 1 -- 172.21.15.7:0/345823017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82c0c8b40 con 0x7fb8180051c0 2024-04-25T10:05:43.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.097+0000 7fb830b32640 1 -- 172.21.15.7:0/345823017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb82c068f60 con 0x7fb8180051c0 2024-04-25T10:05:43.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.097+0000 7fb822ffd640 1 -- 172.21.15.7:0/345823017 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb824012040 con 0x7fb8180051c0 2024-04-25T10:05:43.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.098+0000 7fb822ffd640 1 --2- 172.21.15.7:0/345823017 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb80c06b4d0 0x7fb80c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:43.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.098+0000 7fb829d9b640 1 --2- 172.21.15.7:0/345823017 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb80c06b4d0 0x7fb80c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:43.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.098+0000 7fb822ffd640 1 -- 172.21.15.7:0/345823017 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fb82408a870 con 0x7fb8180051c0 2024-04-25T10:05:43.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.098+0000 7fb829d9b640 1 --2- 172.21.15.7:0/345823017 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb80c06b4d0 0x7fb80c06d990 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fb82c0d2fb0 tx=0x7fb814000ef0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:43.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.102+0000 7fb822ffd640 1 -- 172.21.15.7:0/345823017 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb82c1f4410 con 0x7fb8180051c0 2024-04-25T10:05:43.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.283+0000 7fb830b32640 1 -- 172.21.15.7:0/345823017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fb82c0ce610 con 0x7fb8180051c0 2024-04-25T10:05:43.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.287+0000 7fb822ffd640 1 -- 172.21.15.7:0/345823017 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v24)=0 v24) v1 ==== 123+0+0 (secure 0 0 0) 0x7fb824019030 con 0x7fb8180051c0 2024-04-25T10:05:43.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.288+0000 7fb822ffd640 1 -- 172.21.15.7:0/345823017 <== mon.0 v2:172.21.15.7:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb8240597b0 con 0x7fb8180051c0 2024-04-25T10:05:43.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.289+0000 7fb830b32640 1 -- 172.21.15.7:0/345823017 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb80c06b4d0 msgr2=0x7fb80c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:43.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.289+0000 7fb830b32640 1 --2- 172.21.15.7:0/345823017 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb80c06b4d0 0x7fb80c06d990 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fb82c0d2fb0 tx=0x7fb814000ef0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.289+0000 7fb830b32640 1 -- 172.21.15.7:0/345823017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8180051c0 msgr2=0x7fb82c1f3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:43.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.289+0000 7fb830b32640 1 --2- 172.21.15.7:0/345823017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8180051c0 0x7fb82c1f3ed0 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7fb8240118e0 tx=0x7fb824011da0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.290+0000 7fb830b32640 1 -- 172.21.15.7:0/345823017 shutdown_connections 2024-04-25T10:05:43.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.290+0000 7fb830b32640 1 --2- 172.21.15.7:0/345823017 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7fb80c06b4d0 0x7fb80c06d990 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.290+0000 7fb830b32640 1 --2- 172.21.15.7:0/345823017 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb82c0b8680 0x7fb82c0b8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.290+0000 7fb830b32640 1 --2- 172.21.15.7:0/345823017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb82c0cd280 0x7fb82c1f08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.290+0000 7fb830b32640 1 --2- 172.21.15.7:0/345823017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8180051c0 0x7fb82c1f3ed0 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.290+0000 7fb830b32640 1 -- 172.21.15.7:0/345823017 >> 172.21.15.7:0/345823017 conn(0x7fb82c072680 msgr2=0x7fb82c160670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:43.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.290+0000 7fb830b32640 1 -- 172.21.15.7:0/345823017 shutdown_connections 2024-04-25T10:05:43.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.290+0000 7fb830b32640 1 -- 172.21.15.7:0/345823017 wait complete. 2024-04-25T10:05:43.306 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T10:05:43.306 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:05:43.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.401+0000 7f08e5e88640 1 Processor -- start 2024-04-25T10:05:43.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.401+0000 7f08e5e88640 1 -- start start 2024-04-25T10:05:43.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.402+0000 7f08e5e88640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f08e015dd00 0x7f08e00b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:43.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.402+0000 7f08e5e88640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f08e00b6a40 0x7f08e00b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:43.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.402+0000 7f08e5e88640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f08e006bfb0 0x7f08e006c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:43.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.402+0000 7f08e5e88640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e015e0e0 con 0x7f08e015dd00 2024-04-25T10:05:43.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.402+0000 7f08e5e88640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e006cfe0 con 0x7f08e006bfb0 2024-04-25T10:05:43.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.402+0000 7f08e5e88640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e006cd00 con 0x7f08e00b6a40 2024-04-25T10:05:43.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.402+0000 7f08df7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f08e015dd00 0x7f08e00b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:43.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.402+0000 7f08df7fe640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f08e015dd00 0x7f08e00b5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41784/0 (socket says 172.21.15.7:41784) 2024-04-25T10:05:43.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.402+0000 7f08df7fe640 1 -- 172.21.15.7:0/497178249 learned_addr learned my addr 172.21.15.7:0/497178249 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:43.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.402+0000 7f08deffd640 1 --2- 172.21.15.7:0/497178249 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f08e00b6a40 0x7f08e00b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:43.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.402+0000 7f08dffff640 1 --2- 172.21.15.7:0/497178249 >> v2:172.21.15.55:3300/0 conn(0x7f08e006bfb0 0x7f08e006c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:43.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.402+0000 7f08df7fe640 1 -- 172.21.15.7:0/497178249 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f08e00b6a40 msgr2=0x7f08e00b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:43.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.402+0000 7f08df7fe640 1 --2- 172.21.15.7:0/497178249 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f08e00b6a40 0x7f08e00b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.402+0000 7f08df7fe640 1 -- 172.21.15.7:0/497178249 >> v2:172.21.15.55:3300/0 conn(0x7f08e006bfb0 msgr2=0x7f08e006c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:43.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.402+0000 7f08df7fe640 1 --2- 172.21.15.7:0/497178249 >> v2:172.21.15.55:3300/0 conn(0x7f08e006bfb0 0x7f08e006c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.402+0000 7f08df7fe640 1 -- 172.21.15.7:0/497178249 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e00d1ca0 con 0x7f08e015dd00 2024-04-25T10:05:43.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.402+0000 7f08dffff640 1 --2- 172.21.15.7:0/497178249 >> v2:172.21.15.55:3300/0 conn(0x7f08e006bfb0 0x7f08e006c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:43.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.403+0000 7f08df7fe640 1 --2- 172.21.15.7:0/497178249 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08e015dd00 0x7f08e00b5750 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f08e008cd40 tx=0x7f08d002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb944a281ad2f6cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:43.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.403+0000 7f08de7fc640 1 -- 172.21.15.7:0/497178249 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d0037070 con 0x7f08e015dd00 2024-04-25T10:05:43.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.403+0000 7f08de7fc640 1 -- 172.21.15.7:0/497178249 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f08d0032440 con 0x7f08e015dd00 2024-04-25T10:05:43.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.403+0000 7f08de7fc640 1 -- 172.21.15.7:0/497178249 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d0032830 con 0x7f08e015dd00 2024-04-25T10:05:43.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.404+0000 7f08e5e88640 1 -- 172.21.15.7:0/497178249 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08e015dd00 msgr2=0x7f08e00b5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:43.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.404+0000 7f08e5e88640 1 --2- 172.21.15.7:0/497178249 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08e015dd00 0x7f08e00b5750 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f08e008cd40 tx=0x7f08d002a270 comp rx=0 tx=0).stop 2024-04-25T10:05:43.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.404+0000 7f08e5e88640 1 -- 172.21.15.7:0/497178249 shutdown_connections 2024-04-25T10:05:43.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.404+0000 7f08e5e88640 1 --2- 172.21.15.7:0/497178249 >> v2:172.21.15.55:3300/0 conn(0x7f08e006bfb0 0x7f08e006c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.404+0000 7f08e5e88640 1 --2- 172.21.15.7:0/497178249 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f08e00b6a40 0x7f08e00b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.404+0000 7f08e5e88640 1 --2- 172.21.15.7:0/497178249 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08e015dd00 0x7f08e00b5750 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.404+0000 7f08e5e88640 1 -- 172.21.15.7:0/497178249 >> 172.21.15.7:0/497178249 conn(0x7f08e00d07b0 msgr2=0x7f08e00d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:43.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.404+0000 7f08e5e88640 1 -- 172.21.15.7:0/497178249 shutdown_connections 2024-04-25T10:05:43.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.404+0000 7f08e5e88640 1 -- 172.21.15.7:0/497178249 wait complete. 2024-04-25T10:05:43.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.405+0000 7f08e5e88640 1 Processor -- start 2024-04-25T10:05:43.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.405+0000 7f08e5e88640 1 -- start start 2024-04-25T10:05:43.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.406+0000 7f08e5e88640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08e006bfb0 0x7f08e00cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:43.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.406+0000 7f08e5e88640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08e00b6a40 0x7f08e0152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:43.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.406+0000 7f08e5e88640 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f08e015dd00 0x7f08e015ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:43.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.406+0000 7f08e5e88640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e006c980 con 0x7f08e006bfb0 2024-04-25T10:05:43.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.406+0000 7f08e5e88640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e00d2260 con 0x7f08e00b6a40 2024-04-25T10:05:43.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.406+0000 7f08e5e88640 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e0161780 con 0x7f08e015dd00 2024-04-25T10:05:43.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.406+0000 7f08df7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08e006bfb0 0x7f08e00cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:43.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.406+0000 7f08df7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08e006bfb0 0x7f08e00cd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41792/0 (socket says 172.21.15.7:41792) 2024-04-25T10:05:43.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.406+0000 7f08df7fe640 1 -- 172.21.15.7:0/1637259286 learned_addr learned my addr 172.21.15.7:0/1637259286 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-04-25T10:05:43.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.406+0000 7f08dffff640 1 --2- 172.21.15.7:0/1637259286 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f08e015dd00 0x7f08e015ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:43.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.406+0000 7f08deffd640 1 --2- 172.21.15.7:0/1637259286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08e00b6a40 0x7f08e0152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:43.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.406+0000 7f08df7fe640 1 -- 172.21.15.7:0/1637259286 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f08e015dd00 msgr2=0x7f08e015ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:43.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.406+0000 7f08df7fe640 1 --2- 172.21.15.7:0/1637259286 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f08e015dd00 0x7f08e015ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.406+0000 7f08df7fe640 1 -- 172.21.15.7:0/1637259286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08e00b6a40 msgr2=0x7f08e0152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:43.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.406+0000 7f08df7fe640 1 --2- 172.21.15.7:0/1637259286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08e00b6a40 0x7f08e0152de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.406+0000 7f08df7fe640 1 -- 172.21.15.7:0/1637259286 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e00cce60 con 0x7f08e006bfb0 2024-04-25T10:05:43.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.407+0000 7f08df7fe640 1 --2- 172.21.15.7:0/1637259286 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08e006bfb0 0x7f08e00cd1b0 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f08d0000c00 tx=0x7f08d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:43.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.407+0000 7f08c7fff640 1 -- 172.21.15.7:0/1637259286 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d0041020 con 0x7f08e006bfb0 2024-04-25T10:05:43.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.407+0000 7f08c7fff640 1 -- 172.21.15.7:0/1637259286 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f08d0030970 con 0x7f08e006bfb0 2024-04-25T10:05:43.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.407+0000 7f08c7fff640 1 -- 172.21.15.7:0/1637259286 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d0037040 con 0x7f08e006bfb0 2024-04-25T10:05:43.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.407+0000 7f08e5e88640 1 -- 172.21.15.7:0/1637259286 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e015a230 con 0x7f08e006bfb0 2024-04-25T10:05:43.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.407+0000 7f08e5e88640 1 -- 172.21.15.7:0/1637259286 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e015a7f0 con 0x7f08e006bfb0 2024-04-25T10:05:43.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.408+0000 7f08e5e88640 1 -- 172.21.15.7:0/1637259286 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e00cfe70 con 0x7f08e006bfb0 2024-04-25T10:05:43.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.408+0000 7f08c7fff640 1 -- 172.21.15.7:0/1637259286 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f08d0044020 con 0x7f08e006bfb0 2024-04-25T10:05:43.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.409+0000 7f08c7fff640 1 --2- 172.21.15.7:0/1637259286 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f08cc06b4d0 0x7f08cc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:43.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.409+0000 7f08c7fff640 1 -- 172.21.15.7:0/1637259286 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f08d00aabf0 con 0x7f08e006bfb0 2024-04-25T10:05:43.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.409+0000 7f08deffd640 1 --2- 172.21.15.7:0/1637259286 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f08cc06b4d0 0x7f08cc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:43.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.409+0000 7f08deffd640 1 --2- 172.21.15.7:0/1637259286 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f08cc06b4d0 0x7f08cc06d990 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f08e0153f30 tx=0x7f08d4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:43.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.413+0000 7f08c7fff640 1 -- 172.21.15.7:0/1637259286 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f08e00cfe70 con 0x7f08e006bfb0 2024-04-25T10:05:43.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.628+0000 7f08e5e88640 1 -- 172.21.15.7:0/1637259286 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08e0068fd0 con 0x7f08e006bfb0 2024-04-25T10:05:43.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.629+0000 7f08c7fff640 1 -- 172.21.15.7:0/1637259286 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) v1 ==== 95+0+3695 (secure 0 0 0) 0x7f08d004b030 con 0x7f08e006bfb0 2024-04-25T10:05:43.634 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-04-25T10:05:43.635 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":103,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6992,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2679200172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":2679200172},{"type":"v1","addr":"172.21.15.7:6837","nonce":2679200172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":7942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/4039147179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":4039147179},{"type":"v1","addr":"172.21.15.55:6833","nonce":4039147179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":7945,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3456170359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3456170359},{"type":"v1","addr":"172.21.15.55:6835","nonce":3456170359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":9711,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/3626776528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":3626776528},{"type":"v1","addr":"172.21.15.7:6836","nonce":3626776528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":103}],"filesystems":[]} 2024-04-25T10:05:43.635 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 103 2024-04-25T10:05:43.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.630+0000 7f08e5e88640 1 -- 172.21.15.7:0/1637259286 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f08cc06b4d0 msgr2=0x7f08cc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:43.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.630+0000 7f08e5e88640 1 --2- 172.21.15.7:0/1637259286 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f08cc06b4d0 0x7f08cc06d990 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f08e0153f30 tx=0x7f08d4008040 comp rx=0 tx=0).stop 2024-04-25T10:05:43.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.630+0000 7f08e5e88640 1 -- 172.21.15.7:0/1637259286 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08e006bfb0 msgr2=0x7f08e00cd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:43.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.630+0000 7f08e5e88640 1 --2- 172.21.15.7:0/1637259286 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08e006bfb0 0x7f08e00cd1b0 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f08d0000c00 tx=0x7f08d00046c0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.631+0000 7f08e5e88640 1 -- 172.21.15.7:0/1637259286 shutdown_connections 2024-04-25T10:05:43.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.631+0000 7f08e5e88640 1 --2- 172.21.15.7:0/1637259286 >> [v2:172.21.15.7:6832/457172722,v1:172.21.15.7:6833/457172722] conn(0x7f08cc06b4d0 0x7f08cc06d990 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.631+0000 7f08e5e88640 1 --2- 172.21.15.7:0/1637259286 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f08e015dd00 0x7f08e015ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.631+0000 7f08e5e88640 1 --2- 172.21.15.7:0/1637259286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08e00b6a40 0x7f08e0152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.631+0000 7f08e5e88640 1 --2- 172.21.15.7:0/1637259286 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08e006bfb0 0x7f08e00cd1b0 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.631+0000 7f08e5e88640 1 -- 172.21.15.7:0/1637259286 >> 172.21.15.7:0/1637259286 conn(0x7f08e00d07b0 msgr2=0x7f08e0160a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:43.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.631+0000 7f08e5e88640 1 -- 172.21.15.7:0/1637259286 shutdown_connections 2024-04-25T10:05:43.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-04-25T10:05:43.631+0000 7f08e5e88640 1 -- 172.21.15.7:0/1637259286 wait complete. 2024-04-25T10:05:43.647 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-25T10:05:43.647 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T10:05:43.647 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T10:05:43.648 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:05:43.656 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T10:05:43.656 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T10:05:43.656 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:05:43.705 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T10:05:43.706 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T10:05:43.706 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:05:43.718 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T10:05:43.718 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T10:05:43.718 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:05:43.770 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T10:05:43.771 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T10:05:43.771 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T10:05:43.771 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:05:43.801 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T10:05:43.801 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T10:05:43.801 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:05:43.880 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T10:05:43.880 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T10:05:43.880 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:05:43.947 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T10:05:43.947 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T10:05:43.947 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:05:44.015 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T10:05:44.015 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-25T10:05:44.015 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:05:44.054 INFO:tasks.ceph.osd.4:Stopped 2024-04-25T10:05:44.054 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-25T10:05:44.054 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:05:44.126 INFO:tasks.ceph.osd.5:Stopped 2024-04-25T10:05:44.126 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-25T10:05:44.126 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:05:44.196 INFO:tasks.ceph.osd.6:Stopped 2024-04-25T10:05:44.196 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-25T10:05:44.196 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:05:44.267 INFO:tasks.ceph.osd.7:Stopped 2024-04-25T10:05:44.267 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T10:05:44.267 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T10:05:44.268 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:05:44.294 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T10:05:44.295 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T10:05:44.295 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:05:44.335 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T10:05:44.335 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T10:05:44.335 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T10:05:44.335 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:05:44.347 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T10:05:44.347 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T10:05:44.347 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:05:44.388 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T10:05:44.388 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T10:05:44.389 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:05:44.442 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-04-25T10:05:44.442 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-04-25T10:05:44.442 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-04-25T10:05:44.442 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T10:05:44.443 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T10:05:44.443 DEBUG:teuthology.orchestra.run.smithi007:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2024-04-25T10:05:44.480 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi007.front.sepia.ceph.com 2024-04-25T10:05:44.480 DEBUG:teuthology.orchestra.run.smithi007:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T10:05:44.660 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi007.front.sepia.ceph.com 2024-04-25T10:05:44.661 DEBUG:teuthology.orchestra.run.smithi007:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T10:05:44.725 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi007.front.sepia.ceph.com 2024-04-25T10:05:44.725 DEBUG:teuthology.orchestra.run.smithi007:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T10:05:44.784 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi007.front.sepia.ceph.com 2024-04-25T10:05:44.784 DEBUG:teuthology.orchestra.run.smithi007:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T10:05:44.824 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T10:05:44.824 DEBUG:teuthology.orchestra.run.smithi055:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-25T10:05:44.965 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T10:05:44.965 DEBUG:teuthology.orchestra.run.smithi055:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-25T10:05:45.032 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T10:05:45.033 DEBUG:teuthology.orchestra.run.smithi055:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-25T10:05:45.084 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T10:05:45.084 DEBUG:teuthology.orchestra.run.smithi055:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-25T10:05:45.129 INFO:tasks.ceph:Archiving mon data... 2024-04-25T10:05:45.130 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673038/data/mon.a.tgz 2024-04-25T10:05:45.130 DEBUG:teuthology.orchestra.run.smithi007:> mktemp 2024-04-25T10:05:45.146 INFO:teuthology.orchestra.run.smithi007.stdout:/tmp/tmp.t8bXwJH5HI 2024-04-25T10:05:45.147 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.t8bXwJH5HI 2024-04-25T10:05:45.297 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0666 /tmp/tmp.t8bXwJH5HI 2024-04-25T10:05:45.381 DEBUG:teuthology.orchestra.remote:smithi007:/tmp/tmp.t8bXwJH5HI is 414KB 2024-04-25T10:05:45.479 DEBUG:teuthology.orchestra.run.smithi007:> rm -fr /tmp/tmp.t8bXwJH5HI 2024-04-25T10:05:45.494 DEBUG:teuthology.misc:Transferring archived files from smithi055:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673038/data/mon.b.tgz 2024-04-25T10:05:45.494 DEBUG:teuthology.orchestra.run.smithi055:> mktemp 2024-04-25T10:05:45.512 INFO:teuthology.orchestra.run.smithi055.stdout:/tmp/tmp.yVgCqL1Mr8 2024-04-25T10:05:45.512 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.yVgCqL1Mr8 2024-04-25T10:05:45.671 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0666 /tmp/tmp.yVgCqL1Mr8 2024-04-25T10:05:45.757 DEBUG:teuthology.orchestra.remote:smithi055:/tmp/tmp.yVgCqL1Mr8 is 421KB 2024-04-25T10:05:45.854 DEBUG:teuthology.orchestra.run.smithi055:> rm -fr /tmp/tmp.yVgCqL1Mr8 2024-04-25T10:05:45.869 DEBUG:teuthology.misc:Transferring archived files from smithi055:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673038/data/mon.c.tgz 2024-04-25T10:05:45.869 DEBUG:teuthology.orchestra.run.smithi055:> mktemp 2024-04-25T10:05:45.924 INFO:teuthology.orchestra.run.smithi055.stdout:/tmp/tmp.wQvbLyD7Vi 2024-04-25T10:05:45.924 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.wQvbLyD7Vi 2024-04-25T10:05:46.068 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0666 /tmp/tmp.wQvbLyD7Vi 2024-04-25T10:05:46.151 DEBUG:teuthology.orchestra.remote:smithi055:/tmp/tmp.wQvbLyD7Vi is 421KB 2024-04-25T10:05:46.249 DEBUG:teuthology.orchestra.run.smithi055:> rm -fr /tmp/tmp.wQvbLyD7Vi 2024-04-25T10:05:46.264 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T10:05:46.264 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T10:05:46.267 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T10:05:46.351 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T10:05:46.384 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T10:05:46.384 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T10:05:46.386 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673038/remote/smithi007/crash 2024-04-25T10:05:46.387 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T10:05:46.420 DEBUG:teuthology.misc:Transferring archived files from smithi055:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673038/remote/smithi055/crash 2024-04-25T10:05:46.421 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T10:05:46.448 INFO:tasks.ceph:Shutting down logrotate 2024-04-25T10:05:46.448 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:05:46.466 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:05:46.544 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T10:05:46.571 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T10:05:46.595 INFO:tasks.ceph:Compressing logs... 2024-04-25T10:05:46.595 DEBUG:teuthology.orchestra.run.smithi007:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T10:05:46.613 DEBUG:teuthology.orchestra.run.smithi055:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T10:05:46.690 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T10:05:46.691 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41062.log 2024-04-25T10:05:46.691 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.40675.log 2024-04-25T10:05:46.691 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.3.41062.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T10:05:46.691 INFO:teuthology.orchestra.run.smithi055.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.41062.log.gz 2024-04-25T10:05:46.691 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.1.40675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34706.log 2024-04-25T10:05:46.691 INFO:teuthology.orchestra.run.smithi055.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.40675.log.gz 2024-04-25T10:05:46.691 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34575.log 2024-04-25T10:05:46.691 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.34706.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-25T10:05:46.691 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.34575.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34706.log.gz 2024-04-25T10:05:46.691 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-25T10:05:46.691 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34575.log.gz 2024-04-25T10:05:46.691 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41066.log 2024-04-25T10:05:46.691 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-25T10:05:46.692 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-client.3.41066.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.3.41066.log.gz -- 2024-04-25T10:05:46.692 INFO:teuthology.orchestra.run.smithi055.stderr: /var/log/ceph/ceph-osd.4.log 2024-04-25T10:05:46.692 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T10:05:46.692 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34666.log 2024-04-25T10:05:46.692 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T10:05:46.692 INFO:teuthology.orchestra.run.smithi055.stderr: 92.4%/var/log/ceph/ceph-client.admin.34666.log: -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T10:05:46.692 INFO:teuthology.orchestra.run.smithi055.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.34666.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.1.40670.log 2024-04-25T10:05:46.692 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T10:05:46.692 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-25T10:05:46.692 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.1.40670.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T10:05:46.692 INFO:teuthology.orchestra.run.smithi055.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.40670.log.gz 2024-04-25T10:05:46.692 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34746.log 2024-04-25T10:05:46.692 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34626.log 2024-04-25T10:05:46.692 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.34746.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.34746.log.gz 2024-04-25T10:05:46.693 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34535.log 2024-04-25T10:05:46.693 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.34626.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34626.log.gz 2024-04-25T10:05:46.693 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-25T10:05:46.693 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.34535.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.34535.log.gz 2024-04-25T10:05:46.693 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T10:05:46.693 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-mds.d.log: 94.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T10:05:46.693 INFO:teuthology.orchestra.run.smithi055.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-25T10:05:46.693 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34495.log 2024-04-25T10:05:46.693 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34786.log 2024-04-25T10:05:46.693 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.34495.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34495.log.gz 2024-04-25T10:05:46.693 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.34786.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34786.log.gz 2024-04-25T10:05:46.803 INFO:teuthology.orchestra.run.smithi055.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-25T10:05:46.938 INFO:teuthology.orchestra.run.smithi055.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T10:05:47.037 INFO:teuthology.orchestra.run.smithi055.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T10:05:47.049 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63035.log 2024-04-25T10:05:47.050 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53956.log 2024-04-25T10:05:47.050 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61244.log 2024-04-25T10:05:47.050 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73599.log 2024-04-25T10:05:47.050 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63035.log.gz 2024-04-25T10:05:47.050 INFO:teuthology.orchestra.run.smithi007.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53956.log.gz 2024-04-25T10:05:47.050 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55515.log 2024-04-25T10:05:47.050 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35125.log 2024-04-25T10:05:47.050 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55515.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.61244.log.gz 2024-04-25T10:05:47.050 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.73599.log.gz 2024-04-25T10:05:47.050 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75728.log 2024-04-25T10:05:47.050 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55515.log.gz 2024-04-25T10:05:47.050 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51235.log 2024-04-25T10:05:47.050 INFO:teuthology.orchestra.run.smithi007.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.35125.log.gz 2024-04-25T10:05:47.051 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.75728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49660.log 2024-04-25T10:05:47.051 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46095.log 2024-04-25T10:05:47.051 INFO:teuthology.orchestra.run.smithi007.stderr: 90.8%/var/log/ceph/ceph-client.admin.49660.log: -- replaced with /var/log/ceph/ceph-client.admin.75728.log.gz 2024-04-25T10:05:47.051 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52599.log 2024-04-25T10:05:47.051 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51235.log.gz 2024-04-25T10:05:47.051 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49660.log.gz 2024-04-25T10:05:47.051 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57665.log 2024-04-25T10:05:47.051 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44772.log 2024-04-25T10:05:47.051 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46095.log.gz 2024-04-25T10:05:47.051 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52599.log.gz 2024-04-25T10:05:47.051 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58953.log 2024-04-25T10:05:47.051 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57665.log.gz 2024-04-25T10:05:47.051 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.44772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47340.log 2024-04-25T10:05:47.052 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44772.log.gz 2024-04-25T10:05:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72705.log 2024-04-25T10:05:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58953.log: /var/log/ceph/ceph-client.admin.47340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47628.log 2024-04-25T10:05:47.052 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58953.log.gz 2024-04-25T10:05:47.052 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47340.log.gz 2024-04-25T10:05:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45507.log 2024-04-25T10:05:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75651.log 2024-04-25T10:05:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45507.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47628.log.gz 2024-04-25T10:05:47.052 INFO:teuthology.orchestra.run.smithi007.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.72705.log.gz 2024-04-25T10:05:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57266.log 2024-04-25T10:05:47.052 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45507.log.gz 2024-04-25T10:05:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.75651.log: /var/log/ceph/ceph-client.admin.45843.log 2024-04-25T10:05:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64503.log 2024-04-25T10:05:47.052 INFO:teuthology.orchestra.run.smithi007.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.75651.log.gz 2024-04-25T10:05:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45843.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57266.log.gz 2024-04-25T10:05:47.053 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70738.log 2024-04-25T10:05:47.053 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45843.log.gz 2024-04-25T10:05:47.053 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.64503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62825.log 2024-04-25T10:05:47.053 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.70738.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64503.log.gz 2024-04-25T10:05:47.053 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52809.log 2024-04-25T10:05:47.053 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.70738.log.gz 2024-04-25T10:05:47.053 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73904.log 2024-04-25T10:05:47.053 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62825.log.gz 2024-04-25T10:05:47.053 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52168.log 2024-04-25T10:05:47.053 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52809.log: /var/log/ceph/ceph-client.admin.73904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59836.log 2024-04-25T10:05:47.053 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52168.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.73904.log.gz 2024-04-25T10:05:47.053 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67388.log 2024-04-25T10:05:47.053 INFO:teuthology.orchestra.run.smithi007.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.52809.log.gz 2024-04-25T10:05:47.053 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52168.log.gz 2024-04-25T10:05:47.054 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80265.log 2024-04-25T10:05:47.054 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.59836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.59836.log.gz 2024-04-25T10:05:47.054 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.67388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74065.log 2024-04-25T10:05:47.054 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67388.log.gz 2024-04-25T10:05:47.054 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.80265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57092.log 2024-04-25T10:05:47.054 INFO:teuthology.orchestra.run.smithi007.stderr:gzip 88.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.80265.log.gz --verbose 2024-04-25T10:05:47.054 INFO:teuthology.orchestra.run.smithi007.stderr: -- /var/log/ceph/ceph-client.admin.65436.log 2024-04-25T10:05:47.054 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.74065.log: /var/log/ceph/ceph-client.admin.57092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45210.log 2024-04-25T10:05:47.054 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.74065.log.gz 2024-04-25T10:05:47.054 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.65436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62951.log 2024-04-25T10:05:47.054 INFO:teuthology.orchestra.run.smithi007.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.57092.log.gz 2024-04-25T10:05:47.054 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.2.45210.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65436.log.gz 2024-04-25T10:05:47.054 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66530.log 2024-04-25T10:05:47.054 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45210.log.gz 2024-04-25T10:05:47.055 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45885.log 2024-04-25T10:05:47.055 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62951.log: /var/log/ceph/ceph-client.admin.66530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74192.log 2024-04-25T10:05:47.055 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62951.log.gz 2024-04-25T10:05:47.055 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62166.log 2024-04-25T10:05:47.055 INFO:teuthology.orchestra.run.smithi007.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.66530.log.gz 2024-04-25T10:05:47.055 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45885.log.gz 2024-04-25T10:05:47.055 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.74192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68644.log 2024-04-25T10:05:47.055 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.62166.log: gzip -5 88.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.74192.log.gz 2024-04-25T10:05:47.055 INFO:teuthology.orchestra.run.smithi007.stderr: /var/log/ceph/ceph-client.admin.56834.log 2024-04-25T10:05:47.055 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.62166.log.gz 2024-04-25T10:05:47.055 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58043.log 2024-04-25T10:05:47.055 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.68644.log.gz 2024-04-25T10:05:47.055 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77031.log 2024-04-25T10:05:47.055 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60119.log 2024-04-25T10:05:47.055 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.77031.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.58043.log.gz 2024-04-25T10:05:47.056 INFO:teuthology.orchestra.run.smithi007.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.56834.log.gz 2024-04-25T10:05:47.056 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.0.77031.log.gz /var/log/ceph/ceph-client.admin.59583.log 2024-04-25T10:05:47.056 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-04-25T10:05:47.056 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79340.log 2024-04-25T10:05:47.056 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65133.log 2024-04-25T10:05:47.056 INFO:teuthology.orchestra.run.smithi007.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.60119.log.gz 2024-04-25T10:05:47.056 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.79340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43021.log 2024-04-25T10:05:47.056 INFO:teuthology.orchestra.run.smithi007.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.59583.log.gz 2024-04-25T10:05:47.056 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.65133.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.79340.log.gz 2024-04-25T10:05:47.056 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67656.log 2024-04-25T10:05:47.056 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43730.log 2024-04-25T10:05:47.056 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65133.log.gz 2024-04-25T10:05:47.056 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.67656.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43021.log.gz 2024-04-25T10:05:47.057 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40695.log 2024-04-25T10:05:47.057 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62741.log 2024-04-25T10:05:47.057 INFO:teuthology.orchestra.run.smithi007.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.67656.log.gz 2024-04-25T10:05:47.057 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57707.log 2024-04-25T10:05:47.057 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40695.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43730.log.gz 2024-04-25T10:05:47.057 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49324.log 2024-04-25T10:05:47.057 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40695.log.gz 2024-04-25T10:05:47.057 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57707.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62741.log.gz 2024-04-25T10:05:47.057 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78159.log 2024-04-25T10:05:47.057 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.57707.log.gz 2024-04-25T10:05:47.057 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52219.log 2024-04-25T10:05:47.057 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49324.log.gz 2024-04-25T10:05:47.057 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70780.log 2024-04-25T10:05:47.057 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.78159.log: /var/log/ceph/ceph-client.admin.52219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67575.log 2024-04-25T10:05:47.058 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.78159.log.gz 2024-04-25T10:05:47.058 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.70780.log: gzip -5 --verbose 88.6% -- -- replaced with /var/log/ceph/ceph-client.admin.52219.log.gz /var/log/ceph/ceph-client.0.56274.log 2024-04-25T10:05:47.058 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-04-25T10:05:47.058 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.67575.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.70780.log.gz 2024-04-25T10:05:47.058 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47214.log 2024-04-25T10:05:47.058 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.67575.log.gz 2024-04-25T10:05:47.058 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.56274.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.56274.log.gz 2024-04-25T10:05:47.058 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53383.log 2024-04-25T10:05:47.058 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74149.log 2024-04-25T10:05:47.058 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47214.log.gz 2024-04-25T10:05:47.058 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48174.log 2024-04-25T10:05:47.058 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.74149.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53383.log.gz 2024-04-25T10:05:47.058 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42302.log 2024-04-25T10:05:47.058 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.74149.log.gz 2024-04-25T10:05:47.059 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49768.log 2024-04-25T10:05:47.059 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48174.log.gz 2024-04-25T10:05:47.059 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43026.log 2024-04-25T10:05:47.059 INFO:teuthology.orchestra.run.smithi007.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42302.log.gz 2024-04-25T10:05:47.059 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79382.log 2024-04-25T10:05:47.059 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49768.log.gz 2024-04-25T10:05:47.059 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79611.log 2024-04-25T10:05:47.059 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43026.log.gz 2024-04-25T10:05:47.059 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.79382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58865.log 2024-04-25T10:05:47.059 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.79382.log.gz 2024-04-25T10:05:47.059 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.79611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42134.log 2024-04-25T10:05:47.059 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.79611.log.gz 2024-04-25T10:05:47.059 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63708.log 2024-04-25T10:05:47.059 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58865.log.gz 2024-04-25T10:05:47.059 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48090.log 2024-04-25T10:05:47.060 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42134.log.gz 2024-04-25T10:05:47.060 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61394.log 2024-04-25T10:05:47.060 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48090.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63708.log.gz 2024-04-25T10:05:47.060 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68957.log 2024-04-25T10:05:47.060 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48090.log.gz 2024-04-25T10:05:47.060 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73094.log 2024-04-25T10:05:47.060 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45339.log 2024-04-25T10:05:47.060 INFO:teuthology.orchestra.run.smithi007.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.61394.log.gz 2024-04-25T10:05:47.060 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68957.log.gz 2024-04-25T10:05:47.060 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57917.log 2024-04-25T10:05:47.060 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.73094.log.gz 2024-04-25T10:05:47.060 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68256.log 2024-04-25T10:05:47.060 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51996.log 2024-04-25T10:05:47.061 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45339.log.gz 2024-04-25T10:05:47.061 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57917.log.gz 2024-04-25T10:05:47.061 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66040.log 2024-04-25T10:05:47.061 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.68256.log.gz 2024-04-25T10:05:47.061 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45465.log 2024-04-25T10:05:47.061 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.66040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43361.log 2024-04-25T10:05:47.061 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51996.log.gz 2024-04-25T10:05:47.061 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56406.log 2024-04-25T10:05:47.061 INFO:teuthology.orchestra.run.smithi007.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.66040.log.gz 2024-04-25T10:05:47.061 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45465.log.gz 2024-04-25T10:05:47.061 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62522.log 2024-04-25T10:05:47.061 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56406.log: 89.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.43361.log.gz -5 2024-04-25T10:05:47.061 INFO:teuthology.orchestra.run.smithi007.stderr: --verbose -- /var/log/ceph/ceph-client.admin.70111.log 2024-04-25T10:05:47.061 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56406.log.gz 2024-04-25T10:05:47.061 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46836.log 2024-04-25T10:05:47.062 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62522.log.gz 2024-04-25T10:05:47.062 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.70111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40611.log 2024-04-25T10:05:47.062 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70111.log.gz 2024-04-25T10:05:47.062 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66936.log 2024-04-25T10:05:47.062 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46836.log: /var/log/ceph/ceph-client.admin.40611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60203.log 2024-04-25T10:05:47.062 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46836.log.gz 2024-04-25T10:05:47.062 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.66936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55559.log 88.2% 2024-04-25T10:05:47.062 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40611.log.gz 2024-04-25T10:05:47.062 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.66936.log.gz 2024-04-25T10:05:47.062 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67322.log 2024-04-25T10:05:47.062 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74645.log 2024-04-25T10:05:47.062 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60203.log.gz 2024-04-25T10:05:47.062 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.67322.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55559.log.gzgzip 2024-04-25T10:05:47.062 INFO:teuthology.orchestra.run.smithi007.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46179.log 2024-04-25T10:05:47.062 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.74645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73389.log 2024-04-25T10:05:47.063 INFO:teuthology.orchestra.run.smithi007.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.67322.log.gz 2024-04-25T10:05:47.063 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.74645.log.gz 2024-04-25T10:05:47.063 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79653.log 2024-04-25T10:05:47.063 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46794.log 88.9% 2024-04-25T10:05:47.063 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46179.log.gz 2024-04-25T10:05:47.063 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.79653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62657.log 2024-04-25T10:05:47.063 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.73389.log.gz 2024-04-25T10:05:47.063 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.79653.log.gz 2024-04-25T10:05:47.063 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60077.log 2024-04-25T10:05:47.063 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46794.log.gz 2024-04-25T10:05:47.063 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78869.log 2024-04-25T10:05:47.063 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62657.log: /var/log/ceph/ceph-client.admin.60077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50983.log 2024-04-25T10:05:47.063 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.62657.log.gz 2024-04-25T10:05:47.064 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.78869.log: gzip 88.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.60077.log.gz 2024-04-25T10:05:47.064 INFO:teuthology.orchestra.run.smithi007.stderr: --verbose -- /var/log/ceph/ceph-client.admin.63964.log 2024-04-25T10:05:47.064 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.78869.log.gz 2024-04-25T10:05:47.064 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58272.log 2024-04-25T10:05:47.064 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63964.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.50983.log.gz 2024-04-25T10:05:47.064 INFO:teuthology.orchestra.run.smithi007.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.73010.log 2024-04-25T10:05:47.064 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58272.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.63964.log.gz 2024-04-25T10:05:47.064 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75047.log 2024-04-25T10:05:47.064 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73010.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58272.log.gz 2024-04-25T10:05:47.064 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74771.log 2024-04-25T10:05:47.064 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.75047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46011.log 2024-04-25T10:05:47.064 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.73010.log.gz 2024-04-25T10:05:47.064 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.75047.log.gz 2024-04-25T10:05:47.064 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.74771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48900.log 2024-04-25T10:05:47.065 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46011.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.74771.log.gz 2024-04-25T10:05:47.065 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50600.log 2024-04-25T10:05:47.065 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48900.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46011.log.gz 2024-04-25T10:05:47.065 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68686.log 2024-04-25T10:05:47.065 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48900.log.gz 2024-04-25T10:05:47.065 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50600.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T10:05:47.065 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80433.log 2024-04-25T10:05:47.065 INFO:teuthology.orchestra.run.smithi007.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.50600.log.gz 2024-04-25T10:05:47.065 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7%/var/log/ceph/ceph.log: -- replaced with /var/log/ceph/ceph-client.admin.68686.log.gz 2024-04-25T10:05:47.065 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55336.log 2024-04-25T10:05:47.065 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.80433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79298.log 2024-04-25T10:05:47.065 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55336.log: gzip -5 87.3% --verbose -- replaced with /var/log/ceph/ceph-client.admin.80433.log.gz -- 2024-04-25T10:05:47.065 INFO:teuthology.orchestra.run.smithi007.stderr: /var/log/ceph/ceph-client.admin.77797.log 2024-04-25T10:05:47.065 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55336.log.gz 2024-04-25T10:05:47.065 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.79298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80601.log 2024-04-25T10:05:47.066 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.79298.log.gz 2024-04-25T10:05:47.066 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.77797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58696.log 2024-04-25T10:05:47.066 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.80601.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.77797.log.gz 2024-04-25T10:05:47.066 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78995.log 2024-04-25T10:05:47.066 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.80601.log.gz 2024-04-25T10:05:47.066 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53914.log 2024-04-25T10:05:47.066 INFO:teuthology.orchestra.run.smithi007.stderr: 86.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T10:05:47.066 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.78995.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58696.log.gz 2024-04-25T10:05:47.066 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75238.log 2024-04-25T10:05:47.066 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53914.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.78995.log.gz 2024-04-25T10:05:47.066 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45717.log 2024-04-25T10:05:47.066 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.75238.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53914.log.gz 2024-04-25T10:05:47.066 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65480.log 2024-04-25T10:05:47.067 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.75238.log.gz 2024-04-25T10:05:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70339.log 2024-04-25T10:05:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.65480.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45717.log.gz 2024-04-25T10:05:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56467.log 2024-04-25T10:05:47.067 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65480.log.gz 2024-04-25T10:05:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51750.log 2024-04-25T10:05:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.70339.log: /var/log/ceph/ceph-client.admin.56467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69041.log 2024-04-25T10:05:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43363.log 2024-04-25T10:05:47.067 INFO:teuthology.orchestra.run.smithi007.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.56467.log.gz 2024-04-25T10:05:47.067 INFO:teuthology.orchestra.run.smithi007.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.70339.log.gz 2024-04-25T10:05:47.067 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51750.log.gz 2024-04-25T10:05:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80911.log 2024-04-25T10:05:47.067 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42512.log 2024-04-25T10:05:47.067 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.69041.log.gz 2024-04-25T10:05:47.068 INFO:teuthology.orchestra.run.smithi007.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43363.log.gz/var/log/ceph/ceph-client.admin.80911.log: 2024-04-25T10:05:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60322.log 2024-04-25T10:05:47.068 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.80911.log.gz 2024-04-25T10:05:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.42512.log: /var/log/ceph/ceph-client.admin.55292.log 2024-04-25T10:05:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67176.log 2024-04-25T10:05:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60322.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42512.log.gz 2024-04-25T10:05:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60648.log 2024-04-25T10:05:47.068 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60322.log.gz 2024-04-25T10:05:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.67176.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55292.log.gz 2024-04-25T10:05:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47298.log 2024-04-25T10:05:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60648.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67176.log.gz 2024-04-25T10:05:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43562.log 2024-04-25T10:05:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47298.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60648.log.gz 2024-04-25T10:05:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63180.log 2024-04-25T10:05:47.069 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47298.log.gz 2024-04-25T10:05:47.069 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48132.log 2024-04-25T10:05:47.069 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43562.log: /var/log/ceph/ceph-client.admin.63180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43772.log 2024-04-25T10:05:47.069 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43562.log.gz 2024-04-25T10:05:47.069 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48132.log: gzip 88.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.63180.log.gz --verbose 2024-04-25T10:05:47.069 INFO:teuthology.orchestra.run.smithi007.stderr: -- /var/log/ceph/ceph-osd.2.log 2024-04-25T10:05:47.069 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43772.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48132.log.gz 2024-04-25T10:05:47.069 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71742.log 2024-04-25T10:05:47.069 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-osd.2.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.43772.log.gz 2024-04-25T10:05:47.069 INFO:teuthology.orchestra.run.smithi007.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40124.log 2024-04-25T10:05:47.069 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.71742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54428.log 2024-04-25T10:05:47.069 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.71742.log.gz 2024-04-25T10:05:47.069 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54344.log 2024-04-25T10:05:47.069 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40124.log.gz 2024-04-25T10:05:47.070 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71574.log 2024-04-25T10:05:47.070 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79256.log 2024-04-25T10:05:47.070 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54428.log.gz 2024-04-25T10:05:47.070 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.71574.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54344.log.gz 2024-04-25T10:05:47.070 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46431.log 2024-04-25T10:05:47.070 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.71574.log.gz 2024-04-25T10:05:47.070 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.79256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52683.log 2024-04-25T10:05:47.070 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40001.log 2024-04-25T10:05:47.070 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.79256.log.gz 2024-04-25T10:05:47.070 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46431.log.gz 2024-04-25T10:05:47.070 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57833.log 2024-04-25T10:05:47.070 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52683.log.gz 2024-04-25T10:05:47.071 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55937.log 2024-04-25T10:05:47.071 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57833.log: gzip 87.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.40001.log.gz 2024-04-25T10:05:47.071 INFO:teuthology.orchestra.run.smithi007.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51151.log 2024-04-25T10:05:47.071 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55937.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.57833.log.gz 2024-04-25T10:05:47.071 INFO:teuthology.orchestra.run.smithi007.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46668.log 2024-04-25T10:05:47.071 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43814.log 2024-04-25T10:05:47.071 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55937.log.gz 2024-04-25T10:05:47.071 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46668.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.51151.log.gz 2024-04-25T10:05:47.071 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71658.log 2024-04-25T10:05:47.071 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46668.log.gz 2024-04-25T10:05:47.071 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67280.log 2024-04-25T10:05:47.071 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43814.log.gz 2024-04-25T10:05:47.071 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.71658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71045.log 2024-04-25T10:05:47.071 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.67280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58146.log 2024-04-25T10:05:47.071 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.71658.log.gz 2024-04-25T10:05:47.072 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67280.log.gz 2024-04-25T10:05:47.072 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.71045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40335.log 2024-04-25T10:05:47.072 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58146.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.71045.log.gz 2024-04-25T10:05:47.072 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61979.log 2024-04-25T10:05:47.072 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64694.log 2024-04-25T10:05:47.072 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58146.log.gz 2024-04-25T10:05:47.072 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61979.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40335.log.gz 2024-04-25T10:05:47.072 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53620.log 2024-04-25T10:05:47.072 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61979.log.gz 2024-04-25T10:05:47.072 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.64694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49492.log 2024-04-25T10:05:47.072 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.64694.log.gz 2024-04-25T10:05:47.072 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49240.log 2024-04-25T10:05:47.072 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49492.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53620.log.gz 2024-04-25T10:05:47.072 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72405.log 2024-04-25T10:05:47.072 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49492.log.gz 2024-04-25T10:05:47.073 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62699.log 2024-04-25T10:05:47.073 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72405.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49240.log.gzgzip 2024-04-25T10:05:47.073 INFO:teuthology.orchestra.run.smithi007.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.73137.log 2024-04-25T10:05:47.073 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.72405.log.gz 2024-04-25T10:05:47.073 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54176.log 2024-04-25T10:05:47.073 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62699.log.gz 2024-04-25T10:05:47.073 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50559.log 2024-04-25T10:05:47.073 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54218.log 87.8% 2024-04-25T10:05:47.073 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.73137.log.gz 2024-04-25T10:05:47.073 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50559.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54176.log.gz 2024-04-25T10:05:47.073 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47124.log 2024-04-25T10:05:47.073 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50559.log.gz 2024-04-25T10:05:47.073 INFO:teuthology.orchestra.run.smithi007.stderr:gzip/var/log/ceph/ceph-client.admin.54218.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.59541.log 2024-04-25T10:05:47.073 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42693.log 2024-04-25T10:05:47.073 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54218.log.gz 2024-04-25T10:05:47.074 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47124.log.gz 2024-04-25T10:05:47.074 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49282.log 2024-04-25T10:05:47.074 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59541.log.gz 2024-04-25T10:05:47.074 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54573.log 2024-04-25T10:05:47.074 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49282.log: gzip -5 --verbose 88.3% -- /var/log/ceph/ceph-client.admin.57403.log -- replaced with /var/log/ceph/ceph-client.admin.42693.log.gz 2024-04-25T10:05:47.074 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-04-25T10:05:47.074 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54573.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49282.log.gz 2024-04-25T10:05:47.074 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44108.log 2024-04-25T10:05:47.074 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54573.log.gz 2024-04-25T10:05:47.074 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65218.log 2024-04-25T10:05:47.074 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57403.log: /var/log/ceph/ceph-client.admin.44108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77856.log 2024-04-25T10:05:47.074 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57403.log.gz 2024-04-25T10:05:47.074 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.65218.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44108.log.gz 2024-04-25T10:05:47.074 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69592.log 2024-04-25T10:05:47.075 INFO:teuthology.orchestra.run.smithi007.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.65218.log.gz 2024-04-25T10:05:47.075 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.77856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59247.log 2024-04-25T10:05:47.075 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57008.log 2024-04-25T10:05:47.075 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59247.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.69592.log.gz 2024-04-25T10:05:47.075 INFO:teuthology.orchestra.run.smithi007.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.77856.log.gz 2024-04-25T10:05:47.075 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64353.log 2024-04-25T10:05:47.075 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80055.log 2024-04-25T10:05:47.075 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59247.log.gz 2024-04-25T10:05:47.075 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44234.log 2024-04-25T10:05:47.075 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.64353.log: /var/log/ceph/ceph-client.admin.80055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73683.log 2024-04-25T10:05:47.075 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.64353.log.gz 2024-04-25T10:05:47.075 INFO:teuthology.orchestra.run.smithi007.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.57008.log.gz 2024-04-25T10:05:47.075 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.80055.log.gz 2024-04-25T10:05:47.075 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48006.log 2024-04-25T10:05:47.075 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.44234.log: /var/log/ceph/ceph-client.admin.73683.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T10:05:47.076 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44234.log.gz 2024-04-25T10:05:47.076 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.73683.log.gz 2024-04-25T10:05:47.076 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70153.log 2024-04-25T10:05:47.076 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48006.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63834.log 2024-04-25T10:05:47.076 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48006.log.gz 2024-04-25T10:05:47.076 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.70153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62867.log 2024-04-25T10:05:47.076 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63834.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.70153.log.gz 2024-04-25T10:05:47.076 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67019.log 2024-04-25T10:05:47.076 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62867.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63834.log.gz 2024-04-25T10:05:47.076 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69636.log 2024-04-25T10:05:47.076 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62867.log.gz 2024-04-25T10:05:47.076 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65056.log 2024-04-25T10:05:47.076 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.67019.log: /var/log/ceph/ceph-client.admin.69636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56278.log 2024-04-25T10:05:47.077 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.65056.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.69636.log.gz 2024-04-25T10:05:47.077 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76536.log 2024-04-25T10:05:47.077 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41704.log 2024-04-25T10:05:47.077 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0%/var/log/ceph/ceph-client.0.56278.log: -- replaced with /var/log/ceph/ceph-client.admin.65056.log.gz 2024-04-25T10:05:47.077 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.56278.log.gz 2024-04-25T10:05:47.077 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.76536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76203.log 2024-04-25T10:05:47.077 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T10:05:47.077 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.41704.log: 89.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.76536.log.gz -5 2024-04-25T10:05:47.077 INFO:teuthology.orchestra.run.smithi007.stderr: --verbose -- /var/log/ceph/ceph-client.admin.52431.log 2024-04-25T10:05:47.077 INFO:teuthology.orchestra.run.smithi007.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.67019.log.gz 2024-04-25T10:05:47.077 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41704.log.gz 2024-04-25T10:05:47.077 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.76203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46221.log 2024-04-25T10:05:47.077 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.76203.log.gz 2024-04-25T10:05:47.078 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68915.log 2024-04-25T10:05:47.078 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46221.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52431.log.gz 2024-04-25T10:05:47.078 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67993.log 2024-04-25T10:05:47.078 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46221.log.gz 2024-04-25T10:05:47.078 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44440.log 2024-04-25T10:05:47.078 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.67993.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.68915.log.gz 2024-04-25T10:05:47.078 INFO:teuthology.orchestra.run.smithi007.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.80829.log 2024-04-25T10:05:47.078 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.67993.log.gz 2024-04-25T10:05:47.078 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.44440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68088.log 2024-04-25T10:05:47.078 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.80829.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44440.log.gz 2024-04-25T10:05:47.078 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48816.log 2024-04-25T10:05:47.078 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.80829.log.gz 2024-04-25T10:05:47.078 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77601.log 2024-04-25T10:05:47.079 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70213.log 2024-04-25T10:05:47.079 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.68088.log.gz 2024-04-25T10:05:47.079 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.77601.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48816.log.gz 2024-04-25T10:05:47.079 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67061.log 2024-04-25T10:05:47.079 INFO:teuthology.orchestra.run.smithi007.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.77601.log.gz 2024-04-25T10:05:47.079 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.70213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63306.log 2024-04-25T10:05:47.079 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.67061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54615.log 2024-04-25T10:05:47.079 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.70213.log.gz 2024-04-25T10:05:47.079 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65873.log 2024-04-25T10:05:47.079 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.63306.log.gz 2024-04-25T10:05:47.079 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40082.log 2024-04-25T10:05:47.079 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54615.log.gz 2024-04-25T10:05:47.079 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71124.log 2024-04-25T10:05:47.079 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.65873.log: /var/log/ceph/ceph-client.admin.40082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39813.log 2024-04-25T10:05:47.080 INFO:teuthology.orchestra.run.smithi007.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.67061.log.gz 2024-04-25T10:05:47.080 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.71124.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40082.log.gz 2024-04-25T10:05:47.080 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54867.log 2024-04-25T10:05:47.080 INFO:teuthology.orchestra.run.smithi007.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.65873.log.gz 2024-04-25T10:05:47.080 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.39813.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.71124.log.gz 2024-04-25T10:05:47.080 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49450.log 2024-04-25T10:05:47.080 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39813.log.gz 2024-04-25T10:05:47.080 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72618.log 2024-04-25T10:05:47.080 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54867.log.gz 2024-04-25T10:05:47.080 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49072.log 2024-04-25T10:05:47.080 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49450.log.gz 2024-04-25T10:05:47.080 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79466.log 2024-04-25T10:05:47.080 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49072.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.72618.log.gzgzip 2024-04-25T10:05:47.081 INFO:teuthology.orchestra.run.smithi007.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.74981.log 2024-04-25T10:05:47.081 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.79466.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49072.log.gz 2024-04-25T10:05:47.081 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49959.log 2024-04-25T10:05:47.081 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.79466.log.gz 2024-04-25T10:05:47.081 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.74981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47754.log 2024-04-25T10:05:47.081 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.49959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53194.log 2024-04-25T10:05:47.081 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49959.log.gz 2024-04-25T10:05:47.081 INFO:teuthology.orchestra.run.smithi007.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.74981.log.gz 2024-04-25T10:05:47.081 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76646.log 2024-04-25T10:05:47.081 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47754.log.gz 2024-04-25T10:05:47.081 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66874.log 2024-04-25T10:05:47.081 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.76646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69550.log 2024-04-25T10:05:47.081 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53194.log.gz 2024-04-25T10:05:47.082 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.76646.log.gz 2024-04-25T10:05:47.082 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.66874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35228.log 2024-04-25T10:05:47.082 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.66874.log.gz 2024-04-25T10:05:47.082 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50711.log 2024-04-25T10:05:47.082 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.35228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51912.log 2024-04-25T10:05:47.082 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.69550.log.gz 2024-04-25T10:05:47.082 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35228.log.gz 2024-04-25T10:05:47.082 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55473.log 2024-04-25T10:05:47.082 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79568.log 2024-04-25T10:05:47.082 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51912.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.50711.log.gz 2024-04-25T10:05:47.082 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72447.log 2024-04-25T10:05:47.082 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51912.log.gz 2024-04-25T10:05:47.082 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.79568.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55473.log.gz 2024-04-25T10:05:47.082 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67579.log 2024-04-25T10:05:47.082 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72447.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.79568.log.gz 2024-04-25T10:05:47.083 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63750.log 2024-04-25T10:05:47.083 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.72447.log.gz 2024-04-25T10:05:47.083 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.67579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44066.log 2024-04-25T10:05:47.083 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.67579.log.gz 2024-04-25T10:05:47.083 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40441.log 2024-04-25T10:05:47.083 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63750.log.gz 2024-04-25T10:05:47.083 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.44066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52389.log 2024-04-25T10:05:47.083 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44066.log.gz 2024-04-25T10:05:47.083 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48647.log 2024-04-25T10:05:47.083 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64437.log 2024-04-25T10:05:47.083 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40441.log.gz 2024-04-25T10:05:47.083 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48647.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52389.log.gz 2024-04-25T10:05:47.083 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72878.log 2024-04-25T10:05:47.083 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48647.log.gz 2024-04-25T10:05:47.084 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.64437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70864.log 2024-04-25T10:05:47.084 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72878.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T10:05:47.084 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.70864.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.64437.log.gz 2024-04-25T10:05:47.084 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57791.log 2024-04-25T10:05:47.084 INFO:teuthology.orchestra.run.smithi007.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.72878.log.gz 2024-04-25T10:05:47.084 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.70864.log.gz 2024-04-25T10:05:47.084 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50857.log 2024-04-25T10:05:47.084 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.57791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57959.log 2024-04-25T10:05:47.084 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50857.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57791.log.gz 2024-04-25T10:05:47.084 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77988.log 2024-04-25T10:05:47.084 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49702.log 2024-04-25T10:05:47.084 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50857.log.gz 2024-04-25T10:05:47.084 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57959.log: /var/log/ceph/ceph-client.admin.77988.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57959.log.gz 2024-04-25T10:05:47.084 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42092.log 2024-04-25T10:05:47.085 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5/var/log/ceph/ceph-client.admin.49702.log: --verbose -- /var/log/ceph/ceph-client.admin.69465.log 2024-04-25T10:05:47.085 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45591.log 2024-04-25T10:05:47.085 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7%/var/log/ceph/ceph-client.admin.69465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51361.log 2024-04-25T10:05:47.085 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42092.log.gz 2024-04-25T10:05:47.085 INFO:teuthology.orchestra.run.smithi007.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49702.log.gz 92.3% -- replaced with /var/log/ceph/ceph-client.admin.77988.log.gz 2024-04-25T10:05:47.085 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-04-25T10:05:47.085 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45591.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.69465.log.gz 2024-04-25T10:05:47.085 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68999.log 2024-04-25T10:05:47.085 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65340.log 2024-04-25T10:05:47.085 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45591.log.gz 2024-04-25T10:05:47.085 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46053.log 2024-04-25T10:05:47.085 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51361.log.gz 2024-04-25T10:05:47.085 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.68999.log.gz 2024-04-25T10:05:47.085 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.65340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62245.log 2024-04-25T10:05:47.086 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.65340.log.gz 2024-04-25T10:05:47.086 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52303.log 2024-04-25T10:05:47.086 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46053.log.gz 2024-04-25T10:05:47.086 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42690.log 2024-04-25T10:05:47.086 INFO:teuthology.orchestra.run.smithi007.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.62245.log.gz 2024-04-25T10:05:47.086 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80643.log 2024-04-25T10:05:47.086 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50899.log 2024-04-25T10:05:47.086 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42690.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52303.log.gz 2024-04-25T10:05:47.086 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.80643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66670.log 2024-04-25T10:05:47.086 INFO:teuthology.orchestra.run.smithi007.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.42690.log.gz 2024-04-25T10:05:47.086 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50899.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.80643.log.gz 2024-04-25T10:05:47.086 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42685.log 2024-04-25T10:05:47.086 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50899.log.gz 2024-04-25T10:05:47.087 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.66670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42688.log 2024-04-25T10:05:47.087 INFO:teuthology.orchestra.run.smithi007.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.66670.log.gz 2024-04-25T10:05:47.087 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51830.log 2024-04-25T10:05:47.087 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42685.log: /var/log/ceph/ceph-client.admin.42688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79214.log 2024-04-25T10:05:47.087 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42685.log.gz 2024-04-25T10:05:47.087 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64143.log 2024-04-25T10:05:47.087 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42688.log.gz 2024-04-25T10:05:47.087 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51830.log.gz 2024-04-25T10:05:47.087 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.79214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68560.log 2024-04-25T10:05:47.087 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.79214.log.gz 2024-04-25T10:05:47.087 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53382.log 2024-04-25T10:05:47.087 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.64143.log: /var/log/ceph/ceph-client.admin.68560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61502.log 2024-04-25T10:05:47.087 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64143.log.gz 2024-04-25T10:05:47.087 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53830.log 2024-04-25T10:05:47.088 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.68560.log.gz 2024-04-25T10:05:47.088 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43898.log 2024-04-25T10:05:47.088 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53830.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.53382.log.gz 2024-04-25T10:05:47.088 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59373.log 2024-04-25T10:05:47.088 INFO:teuthology.orchestra.run.smithi007.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.61502.log.gz 2024-04-25T10:05:47.088 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43898.log: gzip 89.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.53830.log.gz --verbose 2024-04-25T10:05:47.088 INFO:teuthology.orchestra.run.smithi007.stderr: -- /var/log/ceph/ceph-client.admin.80013.log 2024-04-25T10:05:47.088 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43898.log.gz 2024-04-25T10:05:47.088 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51529.log 2024-04-25T10:05:47.088 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68518.log 2024-04-25T10:05:47.088 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59373.log.gz 2024-04-25T10:05:47.088 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.80013.log: /var/log/ceph/ceph-client.admin.51529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42344.log 2024-04-25T10:05:47.088 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.80013.log.gz 2024-04-25T10:05:47.089 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51529.log.gz 2024-04-25T10:05:47.089 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41930.log 2024-04-25T10:05:47.089 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68518.log: /var/log/ceph/ceph-client.admin.42344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77946.log 2024-04-25T10:05:47.089 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.68518.log.gz 2024-04-25T10:05:47.089 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42344.log.gz 2024-04-25T10:05:47.089 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.41930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55895.log 2024-04-25T10:05:47.089 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49955.log 2024-04-25T10:05:47.089 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.77946.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41930.log.gz 2024-04-25T10:05:47.089 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50314.log 2024-04-25T10:05:47.089 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55895.log.gz 2024-04-25T10:05:47.089 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.49955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52124.log 2024-04-25T10:05:47.089 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49955.log.gz 2024-04-25T10:05:47.089 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50674.log 2024-04-25T10:05:47.090 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50314.log.gz 2024-04-25T10:05:47.090 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65394.log 2024-04-25T10:05:47.090 INFO:teuthology.orchestra.run.smithi007.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.77946.log.gz 2024-04-25T10:05:47.090 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59840.log 2024-04-25T10:05:47.090 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50674.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52124.log.gz 2024-04-25T10:05:47.090 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.65394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58535.log 2024-04-25T10:05:47.090 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50674.log.gz 2024-04-25T10:05:47.090 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.59840.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.65394.log.gz 2024-04-25T10:05:47.090 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-25T10:05:47.090 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.59840.log.gz 2024-04-25T10:05:47.090 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.58535.log: -- /var/log/ceph/ceph-client.admin.72533.log 2024-04-25T10:05:47.090 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-mds.c.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58535.log.gz 2024-04-25T10:05:47.091 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54386.log 2024-04-25T10:05:47.091 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62354.log 2024-04-25T10:05:47.091 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72533.log: /var/log/ceph/ceph-client.admin.54386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58314.log 2024-04-25T10:05:47.091 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54386.log.gz 2024-04-25T10:05:47.091 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75567.log 2024-04-25T10:05:47.091 INFO:teuthology.orchestra.run.smithi007.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.72533.log.gz 2024-04-25T10:05:47.091 INFO:teuthology.orchestra.run.smithi007.stderr:gzip/var/log/ceph/ceph-client.admin.58314.log: -5 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62354.log.gz 2024-04-25T10:05:47.091 INFO:teuthology.orchestra.run.smithi007.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51655.log 2024-04-25T10:05:47.091 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.75567.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58314.log.gz 2024-04-25T10:05:47.091 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- 89.0% -- replaced with /var/log/ceph/ceph-client.admin.75567.log.gz 2024-04-25T10:05:47.091 INFO:teuthology.orchestra.run.smithi007.stderr: /var/log/ceph/ceph-client.admin.76329.log 2024-04-25T10:05:47.091 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40779.log 2024-04-25T10:05:47.091 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51655.log.gz 2024-04-25T10:05:47.091 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.76329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69731.log 2024-04-25T10:05:47.091 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.76329.log.gz 2024-04-25T10:05:47.092 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80559.log 2024-04-25T10:05:47.092 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.69731.log: /var/log/ceph/ceph-client.0.65779.log 2024-04-25T10:05:47.092 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40779.log.gz 2024-04-25T10:05:47.092 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.80559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40929.log 2024-04-25T10:05:47.092 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.69731.log.gz 2024-04-25T10:05:47.092 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.80559.log.gz 2024-04-25T10:05:47.092 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.65779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68130.log 2024-04-25T10:05:47.092 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.65779.log.gz 2024-04-25T10:05:47.092 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57200.log 2024-04-25T10:05:47.092 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40929.log: /var/log/ceph/ceph-client.admin.68130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80097.log 2024-04-25T10:05:47.092 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40929.log.gz 2024-04-25T10:05:47.092 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.68130.log.gz 2024-04-25T10:05:47.092 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76161.log 2024-04-25T10:05:47.092 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41363.log 2024-04-25T10:05:47.092 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.80097.log: /var/log/ceph/ceph-client.admin.76161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73052.log 2024-04-25T10:05:47.092 INFO:teuthology.orchestra.run.smithi007.stderr: 91.4% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.80097.log.gz 2024-04-25T10:05:47.093 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57200.log.gz 2024-04-25T10:05:47.093 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77521.log 2024-04-25T10:05:47.093 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.76161.log.gz 2024-04-25T10:05:47.093 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.41363.log: /var/log/ceph/ceph-client.admin.73052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54050.log 2024-04-25T10:05:47.093 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.73052.log.gz 2024-04-25T10:05:47.093 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.77521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60345.log 2024-04-25T10:05:47.093 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73557.log 2024-04-25T10:05:47.093 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77521.log.gz 2024-04-25T10:05:47.093 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69943.log 2024-04-25T10:05:47.093 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54050.log.gz 2024-04-25T10:05:47.093 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80307.log 2024-04-25T10:05:47.093 INFO:teuthology.orchestra.run.smithi007.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.60345.log.gz 2024-04-25T10:05:47.093 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77638.log 2024-04-25T10:05:47.093 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.73557.log.gz 2024-04-25T10:05:47.093 INFO:teuthology.orchestra.run.smithi007.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.41363.log.gz 2024-04-25T10:05:47.094 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69943.log: /var/log/ceph/ceph-client.admin.80307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62438.log 2024-04-25T10:05:47.094 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.69943.log.gz 2024-04-25T10:05:47.094 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.77638.log: gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.80307.log.gz 2024-04-25T10:05:47.094 INFO:teuthology.orchestra.run.smithi007.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.59415.log 2024-04-25T10:05:47.094 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62438.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.77638.log.gz 2024-04-25T10:05:47.094 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77564.log 2024-04-25T10:05:47.094 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62438.log.gz 2024-04-25T10:05:47.094 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46389.log 2024-04-25T10:05:47.095 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59415.log: /var/log/ceph/ceph-client.admin.77564.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T10:05:47.095 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59415.log.gz 2024-04-25T10:05:47.095 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46389.log: 89.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74340.log 2024-04-25T10:05:47.095 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.77564.log.gz 2024-04-25T10:05:47.095 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-osd.1.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46389.log.gz 2024-04-25T10:05:47.095 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66323.log 2024-04-25T10:05:47.095 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.74340.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T10:05:47.095 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.66323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53062.log 2024-04-25T10:05:47.095 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.74340.log.gz 2024-04-25T10:05:47.095 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41620.log 2024-04-25T10:05:47.095 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54783.log 2024-04-25T10:05:47.095 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.53062.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.66323.log.gz 2024-04-25T10:05:47.095 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.41620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53062.log.gz 2024-04-25T10:05:47.095 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41620.log.gz 2024-04-25T10:05:47.095 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46305.log 2024-04-25T10:05:47.096 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61610.log 2024-04-25T10:05:47.096 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54783.log: gzip/var/log/ceph/ceph-client.admin.46305.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.58230.log 2024-04-25T10:05:47.096 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61610.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46305.log.gz 2024-04-25T10:05:47.096 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54783.log.gz 2024-04-25T10:05:47.096 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60401.log 2024-04-25T10:05:47.096 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58230.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.61610.log.gz 2024-04-25T10:05:47.096 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63348.log 2024-04-25T10:05:47.096 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58230.log.gz 2024-04-25T10:05:47.096 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39905.log 2024-04-25T10:05:47.096 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60401.log: /var/log/ceph/ceph-client.admin.63348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75794.log 2024-04-25T10:05:47.096 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.39905.log: 88.0% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63348.log.gz 2024-04-25T10:05:47.096 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60401.log.gz 2024-04-25T10:05:47.097 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39905.log.gz 2024-04-25T10:05:47.097 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51571.log 2024-04-25T10:05:47.097 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.75794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59649.log 88.2% -- replaced with /var/log/ceph/ceph-client.admin.75794.log.gz 2024-04-25T10:05:47.097 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-04-25T10:05:47.097 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80869.log 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51571.log.gz 2024-04-25T10:05:47.097 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-04-25T10:05:47.097 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59649.log: gzip -5 --verbose -- 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59649.log.gz 2024-04-25T10:05:47.097 INFO:teuthology.orchestra.run.smithi007.stderr: /var/log/ceph/ceph-client.admin.74603.log 2024-04-25T10:05:47.097 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.80869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77904.log 2024-04-25T10:05:47.097 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.80869.log.gz 2024-04-25T10:05:47.097 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68476.log 2024-04-25T10:05:47.097 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.74603.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T10:05:47.097 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.77904.log: 88.0%/var/log/ceph/ceph-client.admin.68476.log: -- replaced with /var/log/ceph/ceph-client.admin.74603.log.gz 2024-04-25T10:05:47.098 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68476.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64015.log 2024-04-25T10:05:47.098 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-04-25T10:05:47.098 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54825.log 2024-04-25T10:05:47.098 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.64015.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.77904.log.gz 2024-04-25T10:05:47.098 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.64015.log.gz 2024-04-25T10:05:47.098 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42692.log 2024-04-25T10:05:47.098 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79088.log 2024-04-25T10:05:47.098 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54825.log.gz 2024-04-25T10:05:47.098 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60454.log 2024-04-25T10:05:47.098 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.79088.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42692.log.gz 2024-04-25T10:05:47.098 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.79088.log.gz 2024-04-25T10:05:47.098 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63528.log 2024-04-25T10:05:47.098 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60454.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.60454.log.gz 2024-04-25T10:05:47.099 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74475.log 2024-04-25T10:05:47.099 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55685.log 2024-04-25T10:05:47.099 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63528.log: /var/log/ceph/ceph-client.admin.74475.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63528.log.gz 2024-04-25T10:05:47.099 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.74475.log.gz 2024-04-25T10:05:47.099 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43028.log 2024-04-25T10:05:47.099 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55685.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55685.log.gz 2024-04-25T10:05:47.099 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79695.log 2024-04-25T10:05:47.099 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41578.log 2024-04-25T10:05:47.099 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43028.log: /var/log/ceph/ceph-client.admin.79695.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43028.log.gz 2024-04-25T10:05:47.099 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.79695.log.gzgzip 2024-04-25T10:05:47.099 INFO:teuthology.orchestra.run.smithi007.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46914.log 2024-04-25T10:05:47.099 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.41578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55380.log 2024-04-25T10:05:47.099 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41578.log.gz 2024-04-25T10:05:47.100 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77444.log 2024-04-25T10:05:47.100 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46914.log.gz 2024-04-25T10:05:47.100 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64395.log 2024-04-25T10:05:47.100 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.77444.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55380.log.gz 2024-04-25T10:05:47.100 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63646.log 2024-04-25T10:05:47.100 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.77444.log.gz 2024-04-25T10:05:47.100 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.64395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72020.log 2024-04-25T10:05:47.100 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63646.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.64395.log.gz 2024-04-25T10:05:47.100 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63646.log.gz 2024-04-25T10:05:47.100 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71932.log 2024-04-25T10:05:47.100 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47586.log 2024-04-25T10:05:47.100 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72020.log: /var/log/ceph/ceph-client.admin.71932.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.72020.log.gz 2024-04-25T10:05:47.100 INFO:teuthology.orchestra.run.smithi007.stderr: 90.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48774.log 2024-04-25T10:05:47.101 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.71932.log.gz 2024-04-25T10:05:47.101 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51193.log 2024-04-25T10:05:47.101 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48774.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47586.log.gz 2024-04-25T10:05:47.101 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48774.log.gz 2024-04-25T10:05:47.101 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49576.log 2024-04-25T10:05:47.101 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52557.log 2024-04-25T10:05:47.101 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51193.log: /var/log/ceph/ceph-client.admin.49576.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51193.log.gz 2024-04-25T10:05:47.101 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40821.log 2024-04-25T10:05:47.101 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49576.log.gz 2024-04-25T10:05:47.101 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74391.log 2024-04-25T10:05:47.101 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40821.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52557.log.gz 2024-04-25T10:05:47.101 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40821.log.gz 2024-04-25T10:05:47.102 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40251.log 2024-04-25T10:05:47.102 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73473.log 2024-04-25T10:05:47.102 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.74391.log: /var/log/ceph/ceph-client.admin.40251.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.74391.log.gz 2024-04-25T10:05:47.102 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40251.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56900.log 2024-04-25T10:05:47.102 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-04-25T10:05:47.102 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63876.log 2024-04-25T10:05:47.102 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73473.log: /var/log/ceph/ceph-client.admin.56900.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56900.log.gz 2024-04-25T10:05:47.102 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.73473.log.gz 2024-04-25T10:05:47.102 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46998.log 2024-04-25T10:05:47.102 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58188.log 2024-04-25T10:05:47.102 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63876.log.gz 2024-04-25T10:05:47.102 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70592.log 2024-04-25T10:05:47.102 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58188.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46998.log.gz 2024-04-25T10:05:47.102 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50398.log 2024-04-25T10:05:47.103 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58188.log.gz 2024-04-25T10:05:47.103 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.70592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53663.log 2024-04-25T10:05:47.103 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.70592.log.gz 2024-04-25T10:05:47.103 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50398.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50398.log.gz 2024-04-25T10:05:47.103 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56021.log 2024-04-25T10:05:47.103 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65273.log 2024-04-25T10:05:47.103 INFO:teuthology.orchestra.run.smithi007.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.53663.log.gz/var/log/ceph/ceph-client.admin.56021.log: 2024-04-25T10:05:47.103 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41888.log 2024-04-25T10:05:47.103 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.65273.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.56021.log.gz 2024-04-25T10:05:47.103 INFO:teuthology.orchestra.run.smithi007.stderr: 91.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77276.log 2024-04-25T10:05:47.103 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65273.log.gz 2024-04-25T10:05:47.103 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.41888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41972.log 2024-04-25T10:05:47.103 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.77276.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41888.log.gz 2024-04-25T10:05:47.103 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.77276.log.gz 2024-04-25T10:05:47.103 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58909.log 2024-04-25T10:05:47.104 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48605.log 2024-04-25T10:05:47.104 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.41972.log: /var/log/ceph/ceph-client.admin.58909.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41972.log.gz 2024-04-25T10:05:47.104 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58909.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49618.log 2024-04-25T10:05:47.104 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-04-25T10:05:47.104 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48605.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48605.log.gz 2024-04-25T10:05:47.104 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43982.log 2024-04-25T10:05:47.104 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62615.log 2024-04-25T10:05:47.104 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49618.log: /var/log/ceph/ceph-client.admin.43982.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49618.log.gz 2024-04-25T10:05:47.104 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72491.log 2024-04-25T10:05:47.104 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43982.log.gz 2024-04-25T10:05:47.104 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62615.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62615.log.gz 2024-04-25T10:05:47.104 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66959.log 2024-04-25T10:05:47.104 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41746.log 2024-04-25T10:05:47.104 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72491.log: /var/log/ceph/ceph-client.admin.66959.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.72491.log.gz 2024-04-25T10:05:47.105 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42691.log 2024-04-25T10:05:47.105 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.41746.log: 92.0% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41746.log.gz 2024-04-25T10:05:47.105 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66959.log.gz 2024-04-25T10:05:47.105 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70069.log 2024-04-25T10:05:47.105 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45927.log 2024-04-25T10:05:47.105 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42691.log: /var/log/ceph/ceph-client.admin.70069.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42691.log.gz 2024-04-25T10:05:47.105 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76592.log 2024-04-25T10:05:47.105 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70069.log.gz 2024-04-25T10:05:47.105 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45927.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45927.log.gz 2024-04-25T10:05:47.105 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48048.log 2024-04-25T10:05:47.105 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70906.log 2024-04-25T10:05:47.105 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.76592.log: /var/log/ceph/ceph-client.admin.48048.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.76592.log.gz 2024-04-25T10:05:47.105 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42260.log 2024-04-25T10:05:47.105 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48048.log.gz 2024-04-25T10:05:47.106 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.70906.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.70906.log.gz 2024-04-25T10:05:47.106 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79929.log 2024-04-25T10:05:47.106 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77675.log 2024-04-25T10:05:47.106 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42260.log: /var/log/ceph/ceph-client.admin.79929.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42260.log.gz 2024-04-25T10:05:47.106 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.79929.log.gz 2024-04-25T10:05:47.106 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47796.log 2024-04-25T10:05:47.106 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61310.log 2024-04-25T10:05:47.106 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.77675.log: /var/log/ceph/ceph-client.admin.47796.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.77675.log.gz 2024-04-25T10:05:47.106 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47796.log.gz 2024-04-25T10:05:47.106 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50356.log 2024-04-25T10:05:47.106 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67927.log 2024-04-25T10:05:47.106 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61310.log: /var/log/ceph/ceph-client.admin.50356.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50356.log.gz 2024-04-25T10:05:47.106 INFO:teuthology.orchestra.run.smithi007.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.61310.log.gz 2024-04-25T10:05:47.106 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52473.log 2024-04-25T10:05:47.107 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69985.log 2024-04-25T10:05:47.107 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.67927.log: /var/log/ceph/ceph-client.admin.52473.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52473.log.gz 2024-04-25T10:05:47.107 INFO:teuthology.orchestra.run.smithi007.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.67927.log.gz 2024-04-25T10:05:47.107 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78827.log 2024-04-25T10:05:47.107 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80685.log 2024-04-25T10:05:47.107 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69985.log: /var/log/ceph/ceph-client.admin.78827.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.69985.log.gz 2024-04-25T10:05:47.107 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.78827.log.gz 2024-04-25T10:05:47.107 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49198.log 2024-04-25T10:05:47.107 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43029.log 2024-04-25T10:05:47.107 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.80685.log: /var/log/ceph/ceph-client.admin.49198.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.80685.log.gz 2024-04-25T10:05:47.107 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49198.log.gz 2024-04-25T10:05:47.107 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60540.log 2024-04-25T10:05:47.107 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43029.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43029.log.gz 2024-04-25T10:05:47.108 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43020.log 2024-04-25T10:05:47.108 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59121.log 2024-04-25T10:05:47.108 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60540.log: /var/log/ceph/ceph-client.admin.43020.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60540.log.gz 2024-04-25T10:05:47.108 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43020.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54962.log 2024-04-25T10:05:47.108 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-04-25T10:05:47.108 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59121.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59121.log.gz 2024-04-25T10:05:47.108 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64099.log 2024-04-25T10:05:47.108 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70596.log 2024-04-25T10:05:47.108 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54962.log: /var/log/ceph/ceph-client.admin.64099.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54962.log.gz 2024-04-25T10:05:47.108 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71616.log 2024-04-25T10:05:47.108 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.64099.log.gz 2024-04-25T10:05:47.108 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.70596.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.70596.log.gz 2024-04-25T10:05:47.108 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43688.log 2024-04-25T10:05:47.109 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64690.log 2024-04-25T10:05:47.109 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.71616.log: /var/log/ceph/ceph-client.admin.43688.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.71616.log.gz 2024-04-25T10:05:47.109 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50748.log 2024-04-25T10:05:47.109 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43688.log.gz 2024-04-25T10:05:47.109 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.64690.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.64690.log.gz 2024-04-25T10:05:47.109 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T10:05:47.109 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75483.log 2024-04-25T10:05:47.109 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50748.log: /var/log/ceph/ceph-mon.a.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.50748.log.gz 2024-04-25T10:05:47.109 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70297.log 2024-04-25T10:05:47.109 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.75483.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.75483.log.gz 2024-04-25T10:05:47.109 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77402.log 2024-04-25T10:05:47.109 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.70297.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.70297.log.gz 2024-04-25T10:05:47.109 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74729.log 2024-04-25T10:05:47.109 INFO:teuthology.orchestra.run.smithi007.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-25T10:05:47.109 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.77402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68728.log 2024-04-25T10:05:47.110 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.74729.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.77402.log.gz 2024-04-25T10:05:47.110 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.74729.log.gz 2024-04-25T10:05:47.110 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80475.log 2024-04-25T10:05:47.110 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56726.log 2024-04-25T10:05:47.110 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68728.log.gz 2024-04-25T10:05:47.110 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.80475.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28832.log 2024-04-25T10:05:47.110 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56726.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.80475.log.gz 2024-04-25T10:05:47.110 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57623.log 2024-04-25T10:05:47.110 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph.tmp-client.admin.28832.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28832.log.gz 2024-04-25T10:05:47.110 INFO:teuthology.orchestra.run.smithi007.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.56726.log.gz 2024-04-25T10:05:47.110 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69423.log 2024-04-25T10:05:47.110 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47922.log 2024-04-25T10:05:47.111 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57623.log.gz 2024-04-25T10:05:47.111 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42470.log 2024-04-25T10:05:47.111 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47922.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.69423.log.gz 2024-04-25T10:05:47.111 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74561.log 2024-04-25T10:05:47.111 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47922.log.gz 2024-04-25T10:05:47.111 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64269.log 2024-04-25T10:05:47.111 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.74561.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42470.log.gz 2024-04-25T10:05:47.111 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.74561.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.71311.log 2024-04-25T10:05:47.111 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-04-25T10:05:47.111 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50517.log 2024-04-25T10:05:47.111 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.64269.log: /var/log/ceph/ceph-client.0.71311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.71311.log.gz 2024-04-25T10:05:47.111 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58001.log 2024-04-25T10:05:47.111 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50517.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64269.log.gz 2024-04-25T10:05:47.111 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56642.log 2024-04-25T10:05:47.111 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50517.log.gz 2024-04-25T10:05:47.112 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40569.log 2024-04-25T10:05:47.112 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56642.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58001.log.gz 2024-04-25T10:05:47.112 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52725.log 2024-04-25T10:05:47.112 INFO:teuthology.orchestra.run.smithi007.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.56642.log.gz 2024-04-25T10:05:47.112 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68873.log 2024-04-25T10:05:47.112 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52725.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40569.log.gz 2024-04-25T10:05:47.112 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57749.log 2024-04-25T10:05:47.112 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52725.log.gz 2024-04-25T10:05:47.112 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44276.log 2024-04-25T10:05:47.112 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57749.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68873.log.gz 2024-04-25T10:05:47.112 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80223.log 2024-04-25T10:05:47.112 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57749.log.gz 2024-04-25T10:05:47.112 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72789.log 2024-04-25T10:05:47.113 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.44276.log: /var/log/ceph/ceph-client.admin.80223.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.80223.log.gz 91.3% -- replaced with /var/log/ceph/ceph-client.admin.44276.log.gz 2024-04-25T10:05:47.113 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-04-25T10:05:47.113 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73221.log 2024-04-25T10:05:47.113 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57361.log 2024-04-25T10:05:47.113 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73221.log: 91.0% 87.6% -- replaced with /var/log/ceph/ceph-client.admin.73221.log.gz 2024-04-25T10:05:47.113 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.72789.log.gz 2024-04-25T10:05:47.113 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61829.log 2024-04-25T10:05:47.113 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59163.log 2024-04-25T10:05:47.113 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57361.log.gz 2024-04-25T10:05:47.113 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68830.log 2024-04-25T10:05:47.113 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.61829.log.gz 2024-04-25T10:05:47.113 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74855.log 2024-04-25T10:05:47.113 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5%/var/log/ceph/ceph-client.admin.68830.log: -- replaced with /var/log/ceph/ceph-client.admin.59163.log.gz 2024-04-25T10:05:47.113 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79172.log 2024-04-25T10:05:47.113 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.74855.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.68830.log.gz 2024-04-25T10:05:47.113 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58095.log 2024-04-25T10:05:47.114 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.74855.log.gz 2024-04-25T10:05:47.114 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.79172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42687.log 2024-04-25T10:05:47.114 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58095.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.79172.log.gz 2024-04-25T10:05:47.114 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58095.log.gz 2024-04-25T10:05:47.114 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73515.log 2024-04-25T10:05:47.114 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73263.log 2024-04-25T10:05:47.114 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73515.log: /var/log/ceph/ceph-client.admin.42687.log: 88.2% 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42687.log.gz 2024-04-25T10:05:47.114 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.73515.log.gz 2024-04-25T10:05:47.114 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44192.log 2024-04-25T10:05:47.114 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51445.log 2024-04-25T10:05:47.114 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0%/var/log/ceph/ceph-client.admin.44192.log: -- replaced with /var/log/ceph/ceph-client.admin.73263.log.gz 2024-04-25T10:05:47.114 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44192.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44906.log 2024-04-25T10:05:47.114 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-04-25T10:05:47.114 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51445.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51445.log.gz 2024-04-25T10:05:47.114 INFO:teuthology.orchestra.run.smithi007.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55207.log 2024-04-25T10:05:47.115 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.44906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43365.log 2024-04-25T10:05:47.115 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55207.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44906.log.gz 2024-04-25T10:05:47.115 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55207.log.gz 2024-04-25T10:05:47.115 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64972.log 2024-04-25T10:05:47.115 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50272.log 2024-04-25T10:05:47.115 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43365.log.gz 2024-04-25T10:05:47.115 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.64972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42014.log 2024-04-25T10:05:47.115 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50272.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64972.log.gz 2024-04-25T10:05:47.115 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50272.log.gz 2024-04-25T10:05:47.115 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75609.log 2024-04-25T10:05:47.115 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.42014.log: -- /var/log/ceph/ceph-client.0.44777.log 2024-04-25T10:05:47.115 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42014.log.gz 2024-04-25T10:05:47.115 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.75609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50440.log 2024-04-25T10:05:47.115 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.44777.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.75609.log.gz 2024-04-25T10:05:47.116 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44777.log.gz 2024-04-25T10:05:47.116 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43940.log 2024-04-25T10:05:47.116 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46347.log 2024-04-25T10:05:47.116 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43940.log: /var/log/ceph/ceph-client.admin.50440.log: 87.5% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50440.log.gz 2024-04-25T10:05:47.116 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43940.log.gz 2024-04-25T10:05:47.116 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72193.log 2024-04-25T10:05:47.116 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41804.log 2024-04-25T10:05:47.116 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46347.log.gz 2024-04-25T10:05:47.116 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53308.log 2024-04-25T10:05:47.116 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.41804.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.72193.log.gz 2024-04-25T10:05:47.116 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61125.log 2024-04-25T10:05:47.116 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41804.log.gz 2024-04-25T10:05:47.116 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51319.log 2024-04-25T10:05:47.116 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61125.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53308.log.gz 2024-04-25T10:05:47.117 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61125.log.gz 2024-04-25T10:05:47.117 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58738.log 2024-04-25T10:05:47.117 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74813.log 2024-04-25T10:05:47.117 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51319.log.gz 2024-04-25T10:05:47.117 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73809.log 2024-04-25T10:05:47.117 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.74813.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58738.log.gz 2024-04-25T10:05:47.117 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70405.log 2024-04-25T10:05:47.117 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.74813.log.gz 2024-04-25T10:05:47.117 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45206.log 2024-04-25T10:05:47.117 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.70405.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.73809.log.gz 2024-04-25T10:05:47.117 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.70405.log.gz 2024-04-25T10:05:47.117 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65522.log 2024-04-25T10:05:47.117 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69167.log 2024-04-25T10:05:47.117 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.2.45206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45206.log.gz 2024-04-25T10:05:47.118 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.65522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70983.log 2024-04-25T10:05:47.118 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69167.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.65522.log.gz 88.0% -- replaced with /var/log/ceph/ceph-client.admin.69167.log.gz 2024-04-25T10:05:47.118 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-04-25T10:05:47.118 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80139.log 2024-04-25T10:05:47.118 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.70983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43364.log 2024-04-25T10:05:47.118 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.70983.log.gz 2024-04-25T10:05:47.118 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.80139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78540.log 2024-04-25T10:05:47.118 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43364.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.80139.log.gz 2024-04-25T10:05:47.118 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76732.log 2024-04-25T10:05:47.118 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43364.log.gz 2024-04-25T10:05:47.118 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.78540.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56520.log 2024-04-25T10:05:47.118 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.0.78540.log.gz/var/log/ceph/ceph-client.admin.76732.log: 2024-04-25T10:05:47.118 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63792.log 2024-04-25T10:05:47.118 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.76732.log.gz 2024-04-25T10:05:47.119 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57445.log 2024-04-25T10:05:47.119 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63792.log: 88.5% 89.7% -- replaced with /var/log/ceph/ceph-client.admin.56520.log.gz 2024-04-25T10:05:47.119 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63792.log.gz 2024-04-25T10:05:47.119 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63138.log 2024-04-25T10:05:47.119 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70255.log 2024-04-25T10:05:47.119 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57445.log.gz 2024-04-25T10:05:47.119 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76774.log 2024-04-25T10:05:47.119 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.70255.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63138.log.gz 2024-04-25T10:05:47.119 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43362.log 2024-04-25T10:05:47.119 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.70255.log.gz 2024-04-25T10:05:47.119 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.76774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76439.log 2024-04-25T10:05:47.119 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43362.log: 87.5% 91.1% -- replaced with /var/log/ceph/ceph-client.admin.43362.log.gz 2024-04-25T10:05:47.119 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.76774.log.gz 2024-04-25T10:05:47.119 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73984.log 2024-04-25T10:05:47.120 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.76439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69815.log 2024-04-25T10:05:47.120 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.76439.log.gz 2024-04-25T10:05:47.120 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63920.log 2024-04-25T10:05:47.120 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69815.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.73984.log.gz 2024-04-25T10:05:47.120 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60839.log 2024-04-25T10:05:47.120 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.69815.log.gz 2024-04-25T10:05:47.120 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59205.log 2024-04-25T10:05:47.120 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.60839.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.60839.log.gz 2024-04-25T10:05:47.120 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63920.log.gz 2024-04-25T10:05:47.120 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78201.log 2024-04-25T10:05:47.120 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57158.log 2024-04-25T10:05:47.120 INFO:teuthology.orchestra.run.smithi007.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.59205.log.gz 2024-04-25T10:05:47.120 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.78201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57487.log 2024-04-25T10:05:47.120 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57158.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.78201.log.gz 2024-04-25T10:05:47.121 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40737.log 2024-04-25T10:05:47.121 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57158.log.gz 2024-04-25T10:05:47.121 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.57487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48258.log 2024-04-25T10:05:47.121 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40737.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57487.log.gz 2024-04-25T10:05:47.121 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40737.log.gz 2024-04-25T10:05:47.121 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67722.log 2024-04-25T10:05:47.121 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5/var/log/ceph/ceph-client.admin.48258.log: --verbose -- /var/log/ceph/ceph-client.admin.55601.log 2024-04-25T10:05:47.121 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48258.log.gz 2024-04-25T10:05:47.121 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.67722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66628.log 2024-04-25T10:05:47.121 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55601.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.67722.log.gz 2024-04-25T10:05:47.121 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55601.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57875.log 2024-04-25T10:05:47.121 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-04-25T10:05:47.121 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52875.log 2024-04-25T10:05:47.121 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.66628.log: gzip/var/log/ceph/ceph-client.admin.57875.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.64311.log 2024-04-25T10:05:47.121 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57875.log.gz 2024-04-25T10:05:47.122 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52875.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.66628.log.gz 2024-04-25T10:05:47.122 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52875.log.gz 2024-04-25T10:05:47.122 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60280.log 2024-04-25T10:05:47.122 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.64311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69680.log 2024-04-25T10:05:47.122 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64311.log.gz 2024-04-25T10:05:47.122 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55123.log 2024-04-25T10:05:47.122 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60280.log.gz 2024-04-25T10:05:47.122 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78105.log 2024-04-25T10:05:47.122 INFO:teuthology.orchestra.run.smithi007.stderr: 87.3%/var/log/ceph/ceph-client.admin.55123.log: -- replaced with /var/log/ceph/ceph-client.admin.69680.log.gz 2024-04-25T10:05:47.122 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66215.log 2024-04-25T10:05:47.122 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.78105.log: -- replaced with /var/log/ceph/ceph-client.admin.55123.log.gz 2024-04-25T10:05:47.122 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58398.log 2024-04-25T10:05:47.122 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.78105.log.gz 2024-04-25T10:05:47.122 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.66215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74939.log 2024-04-25T10:05:47.123 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.66215.log.gz/var/log/ceph/ceph-client.admin.58398.log: 2024-04-25T10:05:47.123 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45381.log 2024-04-25T10:05:47.123 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.74939.log: -- replaced with /var/log/ceph/ceph-client.admin.58398.log.gz 2024-04-25T10:05:47.123 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61167.log 2024-04-25T10:05:47.123 INFO:teuthology.orchestra.run.smithi007.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.74939.log.gz 2024-04-25T10:05:47.123 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45549.log 2024-04-25T10:05:47.123 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61167.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45381.log.gz 2024-04-25T10:05:47.123 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61167.log.gz 2024-04-25T10:05:47.123 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66754.log 2024-04-25T10:05:47.123 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63264.log 2024-04-25T10:05:47.123 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.66754.log: /var/log/ceph/ceph-client.admin.45549.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45549.log.gz 2024-04-25T10:05:47.123 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66754.log.gz 2024-04-25T10:05:47.123 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43366.log 2024-04-25T10:05:47.123 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66488.log 2024-04-25T10:05:47.124 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.63264.log.gz 2024-04-25T10:05:47.124 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72617.log 2024-04-25T10:05:47.124 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.66488.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43366.log.gz 2024-04-25T10:05:47.124 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64227.log 2024-04-25T10:05:47.124 INFO:teuthology.orchestra.run.smithi007.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.66488.log.gz 2024-04-25T10:05:47.124 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53788.log 2024-04-25T10:05:47.124 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.64227.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.64227.log.gz 2024-04-25T10:05:47.124 INFO:teuthology.orchestra.run.smithi007.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.72617.log.gz 2024-04-25T10:05:47.124 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40209.log 2024-04-25T10:05:47.124 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60582.log 2024-04-25T10:05:47.124 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53788.log.gz 2024-04-25T10:05:47.124 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74897.log 2024-04-25T10:05:47.124 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60582.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40209.log.gz 2024-04-25T10:05:47.124 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47502.log 2024-04-25T10:05:47.125 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.74897.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.60582.log.gz 2024-04-25T10:05:47.125 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.74897.log.gz 2024-04-25T10:05:47.125 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68770.log 2024-04-25T10:05:47.125 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41536.log 2024-04-25T10:05:47.125 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47502.log.gz 2024-04-25T10:05:47.125 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68770.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68770.log.gz 2024-04-25T10:05:47.125 INFO:teuthology.orchestra.run.smithi007.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49114.log 2024-04-25T10:05:47.125 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.41536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66796.log 2024-04-25T10:05:47.125 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3%/var/log/ceph/ceph-client.admin.49114.log: -- replaced with /var/log/ceph/ceph-client.admin.41536.log.gz 2024-04-25T10:05:47.125 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76840.log 2024-04-25T10:05:47.125 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0%/var/log/ceph/ceph-client.admin.66796.log: -- replaced with /var/log/ceph/ceph-client.admin.49114.log.gz 2024-04-25T10:05:47.125 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66796.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55250.log 2024-04-25T10:05:47.125 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-04-25T10:05:47.125 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47082.log 2024-04-25T10:05:47.126 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.76840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48732.log 2024-04-25T10:05:47.126 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.76840.log.gz 2024-04-25T10:05:47.126 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55250.log: /var/log/ceph/ceph-client.admin.47082.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55250.log.gz 2024-04-25T10:05:47.126 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47082.log.gz 2024-04-25T10:05:47.126 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49366.log 2024-04-25T10:05:47.126 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54528.log 2024-04-25T10:05:47.126 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48732.log.gz 2024-04-25T10:05:47.126 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47382.log 2024-04-25T10:05:47.126 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54528.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49366.log.gz 2024-04-25T10:05:47.126 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68350.log 2024-04-25T10:05:47.126 INFO:teuthology.orchestra.run.smithi007.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54528.log.gz 2024-04-25T10:05:47.126 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43856.log 2024-04-25T10:05:47.127 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68350.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47382.log.gz 2024-04-25T10:05:47.127 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.68350.log.gz 2024-04-25T10:05:47.127 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59457.log 2024-04-25T10:05:47.127 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.43856.log: -- /var/log/ceph/ceph-client.admin.48942.log 2024-04-25T10:05:47.127 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43856.log.gz 2024-04-25T10:05:47.127 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59457.log: gzip -5 --verbose -- 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59457.log.gz 2024-04-25T10:05:47.127 INFO:teuthology.orchestra.run.smithi007.stderr: /var/log/ceph/ceph-client.0.75981.log 2024-04-25T10:05:47.127 INFO:teuthology.orchestra.run.smithi007.stderr:gzip/var/log/ceph/ceph-client.admin.48942.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47838.log 2024-04-25T10:05:47.127 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48942.log.gz 2024-04-25T10:05:47.127 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.75981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.75981.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41662.log 2024-04-25T10:05:47.127 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-04-25T10:05:47.127 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47838.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47838.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47040.log 2024-04-25T10:05:47.127 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-04-25T10:05:47.127 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51403.log 2024-04-25T10:05:47.128 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.41662.log: gzip -5 --verbose -- 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41662.log.gz 2024-04-25T10:05:47.128 INFO:teuthology.orchestra.run.smithi007.stderr: /var/log/ceph/ceph-client.admin.80517.log 2024-04-25T10:05:47.128 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47040.log: /var/log/ceph/ceph-client.admin.51403.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47040.log.gz 2024-04-25T10:05:47.128 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51403.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.65775.log 2024-04-25T10:05:47.128 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-04-25T10:05:47.128 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.80517.log: gzip 87.9% -5 --verbose -- /var/log/ceph/ceph-client.admin.43015.log 2024-04-25T10:05:47.128 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.80517.log.gz 2024-04-25T10:05:47.128 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.65775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42176.log 2024-04-25T10:05:47.128 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.65775.log.gz 2024-04-25T10:05:47.128 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52767.log 2024-04-25T10:05:47.128 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43015.log.gz 2024-04-25T10:05:47.128 INFO:teuthology.orchestra.run.smithi007.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T10:05:47.128 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56942.log 2024-04-25T10:05:47.128 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52767.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42176.log.gz 2024-04-25T10:05:47.128 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52767.log.gz 2024-04-25T10:05:47.128 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74252.log 2024-04-25T10:05:47.129 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46263.log 2024-04-25T10:05:47.129 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.74252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55643.log 2024-04-25T10:05:47.129 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46263.log: 87.5% 90.8% -- replaced with /var/log/ceph/ceph-client.admin.56942.log.gz 2024-04-25T10:05:47.129 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.74252.log.gz 2024-04-25T10:05:47.129 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78953.log 2024-04-25T10:05:47.129 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46263.log.gz 2024-04-25T10:05:47.129 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42218.log 2024-04-25T10:05:47.129 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.78953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46515.log 2024-04-25T10:05:47.129 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55643.log.gz 2024-04-25T10:05:47.129 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7%/var/log/ceph/ceph-client.admin.42218.log: -- replaced with /var/log/ceph/ceph-client.admin.78953.log.gz 2024-04-25T10:05:47.129 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76245.log 2024-04-25T10:05:47.129 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54134.log 2024-04-25T10:05:47.129 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42218.log.gz 2024-04-25T10:05:47.129 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.76245.log: gzip 88.7% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.46515.log.gz -- 2024-04-25T10:05:47.129 INFO:teuthology.orchestra.run.smithi007.stderr: /var/log/ceph/ceph-client.admin.50941.log 2024-04-25T10:05:47.130 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.76245.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64185.log 2024-04-25T10:05:47.130 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-04-25T10:05:47.130 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54134.log: /var/log/ceph/ceph-client.admin.50941.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54134.log.gz 2024-04-25T10:05:47.130 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55165.log 2024-04-25T10:05:47.130 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50941.log.gz 2024-04-25T10:05:47.130 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.64185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40293.log 2024-04-25T10:05:47.130 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55165.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64185.log.gz -5 2024-04-25T10:05:47.130 INFO:teuthology.orchestra.run.smithi007.stderr: --verbose -- /var/log/ceph/ceph-client.admin.59331.log 2024-04-25T10:05:47.130 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56792.log 2024-04-25T10:05:47.130 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55165.log.gz/var/log/ceph/ceph-client.admin.40293.log: 2024-04-25T10:05:47.130 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59331.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40293.log.gz 2024-04-25T10:05:47.130 INFO:teuthology.orchestra.run.smithi007.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59331.log.gz 2024-04-25T10:05:47.130 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67885.log 2024-04-25T10:05:47.130 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.56792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54741.log 2024-04-25T10:05:47.131 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.67885.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56792.log.gz 2024-04-25T10:05:47.131 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63390.log 2024-04-25T10:05:47.131 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.67885.log.gz 2024-04-25T10:05:47.131 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54741.log: gzip -5 --verbose -- 88.5% /var/log/ceph/ceph-client.admin.66257.log 2024-04-25T10:05:47.131 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54741.log.gz 2024-04-25T10:05:47.131 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71700.log 2024-04-25T10:05:47.131 INFO:teuthology.orchestra.run.smithi007.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.63390.log.gz/var/log/ceph/ceph-client.admin.66257.log: 2024-04-25T10:05:47.131 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71819.log 2024-04-25T10:05:47.131 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.71700.log: /var/log/ceph/ceph-client.admin.61937.log 2024-04-25T10:05:47.131 INFO:teuthology.orchestra.run.smithi007.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.66257.log.gz 2024-04-25T10:05:47.131 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.71819.log: gzip 89.2% -- replaced with /var/log/ceph/ceph-client.admin.71700.log.gz 2024-04-25T10:05:47.131 INFO:teuthology.orchestra.run.smithi007.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.79508.log 2024-04-25T10:05:47.131 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53554.log 2024-04-25T10:05:47.131 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.71819.log.gz 2024-04-25T10:05:47.131 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61937.log.gz 2024-04-25T10:05:47.131 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.79508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51487.log 2024-04-25T10:05:47.132 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.79508.log.gz 2024-04-25T10:05:47.132 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69083.log 2024-04-25T10:05:47.132 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53872.log 2024-04-25T10:05:47.132 INFO:teuthology.orchestra.run.smithi007.stderr: 91.0% 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51487.log.gz 2024-04-25T10:05:47.132 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53554.log.gz 2024-04-25T10:05:47.132 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69083.log: gzip -5 --verbose 87.9% -- replaced with /var/log/ceph/ceph-client.admin.69083.log.gz 2024-04-25T10:05:47.132 INFO:teuthology.orchestra.run.smithi007.stderr: -- /var/log/ceph/ceph-client.admin.54302.log 2024-04-25T10:05:47.132 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56576.log 2024-04-25T10:05:47.132 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53872.log.gz 2024-04-25T10:05:47.132 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51277.log 2024-04-25T10:05:47.132 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1%/var/log/ceph/ceph-client.admin.56576.log: -- replaced with /var/log/ceph/ceph-client.admin.54302.log.gz 2024-04-25T10:05:47.132 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55853.log 2024-04-25T10:05:47.132 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59499.log 2024-04-25T10:05:47.132 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51277.log: /var/log/ceph/ceph-client.admin.55853.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.56576.log.gz 2024-04-25T10:05:47.132 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51277.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48216.log 89.0% 2024-04-25T10:05:47.132 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55853.log.gz 2024-04-25T10:05:47.133 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-04-25T10:05:47.133 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73179.log 2024-04-25T10:05:47.133 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59499.log.gz 2024-04-25T10:05:47.133 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69507.log 2024-04-25T10:05:47.133 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48216.log.gz 2024-04-25T10:05:47.133 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78353.log 2024-04-25T10:05:47.133 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73179.log: /var/log/ceph/ceph-client.admin.69507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65939.log 2024-04-25T10:05:47.133 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.78353.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.73179.log.gz 2024-04-25T10:05:47.133 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.69507.log.gz 2024-04-25T10:05:47.133 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.78353.log.gz 2024-04-25T10:05:47.133 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46752.log 2024-04-25T10:05:47.133 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.65939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64930.log 2024-04-25T10:05:47.134 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72104.log 2024-04-25T10:05:47.134 INFO:teuthology.orchestra.run.smithi007.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.65939.log.gz 2024-04-25T10:05:47.134 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0%/var/log/ceph/ceph-client.admin.64930.log: -- replaced with /var/log/ceph/ceph-client.admin.46752.log.gz 2024-04-25T10:05:47.134 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50637.log 2024-04-25T10:05:47.134 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65014.log 2024-04-25T10:05:47.134 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64930.log.gz 2024-04-25T10:05:47.134 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.50637.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.50637.log.gz 2024-04-25T10:05:47.134 INFO:teuthology.orchestra.run.smithi007.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.72104.log.gz 2024-04-25T10:05:47.134 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71933.log 2024-04-25T10:05:47.134 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.65014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80349.log 2024-04-25T10:05:47.134 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.71933.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.65014.log.gz 2024-04-25T10:05:47.134 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72351.log 2024-04-25T10:05:47.134 INFO:teuthology.orchestra.run.smithi007.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.71933.log.gz 2024-04-25T10:05:47.135 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70027.log 2024-04-25T10:05:47.135 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.80349.log: /var/log/ceph/ceph-client.admin.72351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61762.log 2024-04-25T10:05:47.135 INFO:teuthology.orchestra.run.smithi007.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.80349.log.gz/var/log/ceph/ceph-client.admin.70027.log: 2024-04-25T10:05:47.135 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.72351.log.gz 2024-04-25T10:05:47.135 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70027.log.gz 2024-04-25T10:05:47.135 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77027.log 2024-04-25T10:05:47.135 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69342.log 2024-04-25T10:05:47.135 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.77027.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59079.log 2024-04-25T10:05:47.135 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.0.77027.log.gz 90.9% -- replaced with /var/log/ceph/ceph-client.admin.61762.log.gz 2024-04-25T10:05:47.135 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-04-25T10:05:47.135 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40653.log 2024-04-25T10:05:47.135 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69342.log: /var/log/ceph/ceph-client.admin.59079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43226.log 2024-04-25T10:05:47.135 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.69342.log.gz 2024-04-25T10:05:47.135 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40653.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.59079.log.gz 2024-04-25T10:05:47.135 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58823.log 2024-04-25T10:05:47.135 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40653.log.gz 2024-04-25T10:05:47.135 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45759.log 2024-04-25T10:05:47.136 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58823.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43226.log.gz 2024-04-25T10:05:47.136 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41846.log 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58823.log.gz 2024-04-25T10:05:47.136 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-04-25T10:05:47.136 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62480.log 2024-04-25T10:05:47.136 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45759.log.gz 2024-04-25T10:05:47.136 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.41846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48402.log 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41846.log.gz 2024-04-25T10:05:47.136 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-04-25T10:05:47.136 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62480.log: gzip -5 --verbose -- 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62480.log.gz 2024-04-25T10:05:47.136 INFO:teuthology.orchestra.run.smithi007.stderr: /var/log/ceph/ceph-client.admin.42386.log 2024-04-25T10:05:47.136 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69125.log 2024-04-25T10:05:47.136 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48402.log.gz 2024-04-25T10:05:47.136 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42694.log 2024-04-25T10:05:47.136 INFO:teuthology.orchestra.run.smithi007.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42386.log.gz/var/log/ceph/ceph-client.admin.69125.log: 2024-04-25T10:05:47.137 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66149.log 2024-04-25T10:05:47.137 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.69125.log.gz 2024-04-25T10:05:47.137 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72855.log 2024-04-25T10:05:47.137 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42694.log: /var/log/ceph/ceph-client.admin.66149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73347.log 2024-04-25T10:05:47.137 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72855.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42694.log.gz 2024-04-25T10:05:47.137 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.72855.log.gz 2024-04-25T10:05:47.137 INFO:teuthology.orchestra.run.smithi007.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.66149.log.gz 2024-04-25T10:05:47.137 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55727.log 2024-04-25T10:05:47.137 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73347.log: gzip -5 --verbose -- 89.3% /var/log/ceph/ceph-client.0.62170.log 2024-04-25T10:05:47.137 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.73347.log.gz 2024-04-25T10:05:47.137 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46137.log 2024-04-25T10:05:47.137 INFO:teuthology.orchestra.run.smithi007.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55727.log.gz 2024-04-25T10:05:47.138 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60035.log 2024-04-25T10:05:47.138 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.62170.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.62170.log.gz 2024-04-25T10:05:47.138 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46956.log 2024-04-25T10:05:47.138 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46137.log: /var/log/ceph/ceph-client.admin.60035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77318.log 2024-04-25T10:05:47.138 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46956.log: 88.6% 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60035.log.gz 2024-04-25T10:05:47.138 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46137.log.gz 2024-04-25T10:05:47.138 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69901.log 2024-04-25T10:05:47.138 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46956.log.gz 2024-04-25T10:05:47.138 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.77318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52641.log 2024-04-25T10:05:47.138 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63432.log 2024-04-25T10:05:47.138 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.77318.log.gz 2024-04-25T10:05:47.138 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69901.log: /var/log/ceph/ceph-client.admin.52641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67236.log 2024-04-25T10:05:47.138 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.69901.log.gz 2024-04-25T10:05:47.139 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52641.log.gz 2024-04-25T10:05:47.139 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49534.log 2024-04-25T10:05:47.139 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2%/var/log/ceph/ceph-client.admin.67236.log: -- replaced with /var/log/ceph/ceph-client.admin.63432.log.gz 2024-04-25T10:05:47.139 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74107.log 2024-04-25T10:05:47.139 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.67236.log.gz 2024-04-25T10:05:47.139 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62909.log 2024-04-25T10:05:47.139 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49534.log: /var/log/ceph/ceph-client.admin.74107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55431.log 2024-04-25T10:05:47.139 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5%/var/log/ceph/ceph-client.admin.62909.log: -- replaced with /var/log/ceph/ceph-client.admin.49534.log.gz 2024-04-25T10:05:47.139 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.74107.log.gz 2024-04-25T10:05:47.139 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62909.log.gz 2024-04-25T10:05:47.139 INFO:teuthology.orchestra.run.smithi007.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49156.log 2024-04-25T10:05:47.139 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40525.log 2024-04-25T10:05:47.139 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55431.log.gz 2024-04-25T10:05:47.139 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47256.log 2024-04-25T10:05:47.140 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49156.log.gz 2024-04-25T10:05:47.140 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78245.log 2024-04-25T10:05:47.140 INFO:teuthology.orchestra.run.smithi007.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40525.log.gz 2024-04-25T10:05:47.140 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55979.log 2024-04-25T10:05:47.140 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66712.log 2024-04-25T10:05:47.140 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.78245.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47256.log.gz/var/log/ceph/ceph-client.admin.55979.log: 2024-04-25T10:05:47.140 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.78245.log.gz 2024-04-25T10:05:47.140 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55979.log.gz 2024-04-25T10:05:47.140 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54699.log 2024-04-25T10:05:47.140 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.66712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62396.log 2024-04-25T10:05:47.140 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54699.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.66712.log.gz 2024-04-25T10:05:47.140 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51613.log 2024-04-25T10:05:47.141 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54699.log.gz 2024-04-25T10:05:47.141 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45969.log 2024-04-25T10:05:47.141 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62396.log.gz 2024-04-25T10:05:47.141 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51109.log/var/log/ceph/ceph-client.admin.51613.log: 2024-04-25T10:05:47.141 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45969.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51613.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64057.log 2024-04-25T10:05:47.141 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-04-25T10:05:47.141 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45969.log.gz 2024-04-25T10:05:47.141 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68602.log 2024-04-25T10:05:47.141 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51109.log: /var/log/ceph/ceph-client.admin.64057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53066.log 2024-04-25T10:05:47.141 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51109.log.gz 2024-04-25T10:05:47.141 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68602.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64057.log.gz 2024-04-25T10:05:47.141 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69262.log 2024-04-25T10:05:47.141 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.53066.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53066.log.gz 2024-04-25T10:05:47.141 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.68602.log.gz 2024-04-25T10:05:47.141 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78287.log 2024-04-25T10:05:47.142 INFO:teuthology.orchestra.run.smithi007.stderr:gzip/var/log/ceph/ceph-client.admin.69262.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.77731.log 2024-04-25T10:05:47.142 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.78287.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.69262.log.gz 2024-04-25T10:05:47.142 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49028.log 2024-04-25T10:05:47.142 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77360.log 2024-04-25T10:05:47.142 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.77731.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.78287.log.gz 2024-04-25T10:05:47.142 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49028.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49028.log.gz 2024-04-25T10:05:47.142 INFO:teuthology.orchestra.run.smithi007.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.77731.log.gz 2024-04-25T10:05:47.142 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54470.log 2024-04-25T10:05:47.142 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.77360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48858.log 2024-04-25T10:05:47.142 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54470.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.77360.log.gz 2024-04-25T10:05:47.142 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48482.log 2024-04-25T10:05:47.142 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54470.log.gz 2024-04-25T10:05:47.142 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78911.log 2024-04-25T10:05:47.142 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48858.log: /var/log/ceph/ceph-client.admin.48482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75234.log 2024-04-25T10:05:47.143 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.78911.log: 88.2% 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48482.log.gz -- replaced with /var/log/ceph/ceph-client.admin.48858.log.gz 2024-04-25T10:05:47.143 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-04-25T10:05:47.143 INFO:teuthology.orchestra.run.smithi007.stderr:gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.78911.log.gz 2024-04-25T10:05:47.143 INFO:teuthology.orchestra.run.smithi007.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.61676.log 2024-04-25T10:05:47.143 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.75234.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.75234.log.gz 2024-04-25T10:05:47.143 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47424.log 2024-04-25T10:05:47.143 INFO:teuthology.orchestra.run.smithi007.stderr:gzip/var/log/ceph/ceph-client.admin.61676.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.61041.log 2024-04-25T10:05:47.143 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57529.log 2024-04-25T10:05:47.143 INFO:teuthology.orchestra.run.smithi007.stderr: 89.4% 91.0% -- replaced with /var/log/ceph/ceph-client.admin.61676.log.gz 2024-04-25T10:05:47.143 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47424.log.gz 2024-04-25T10:05:47.143 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72170.log 2024-04-25T10:05:47.143 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7%/var/log/ceph/ceph-client.admin.57529.log: -- replaced with /var/log/ceph/ceph-client.admin.61041.log.gz 2024-04-25T10:05:47.144 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43646.log 2024-04-25T10:05:47.144 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57529.log.gz 2024-04-25T10:05:47.144 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72170.log: gzip -5 --verbose 88.1% -- replaced with /var/log/ceph/ceph-client.admin.72170.log.gz 2024-04-25T10:05:47.144 INFO:teuthology.orchestra.run.smithi007.stderr: -- /var/log/ceph/ceph-client.admin.43030.log 2024-04-25T10:05:47.144 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52038.log 2024-04-25T10:05:47.144 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43646.log.gz 2024-04-25T10:05:47.144 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74687.log 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43030.log.gz 2024-04-25T10:05:47.144 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-04-25T10:05:47.144 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52038.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T10:05:47.144 INFO:teuthology.orchestra.run.smithi007.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52038.log.gz 2024-04-25T10:05:47.144 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.74687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59037.log 2024-04-25T10:05:47.144 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.74687.log.gz 2024-04-25T10:05:47.144 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80727.log 2024-04-25T10:05:47.144 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43360.log 2024-04-25T10:05:47.145 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59037.log: /var/log/ceph/ceph-client.admin.80727.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59037.log.gz 2024-04-25T10:05:47.145 INFO:teuthology.orchestra.run.smithi007.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.80727.log.gz 2024-04-25T10:05:47.145 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64888.log 2024-04-25T10:05:47.145 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47712.log 2024-04-25T10:05:47.145 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43360.log.gz 2024-04-25T10:05:47.145 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.64888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58356.log 2024-04-25T10:05:47.145 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47712.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64888.log.gz 2024-04-25T10:05:47.145 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47712.log.gz 2024-04-25T10:05:47.145 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34861.log 2024-04-25T10:05:47.145 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53237.log 2024-04-25T10:05:47.145 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58356.log: /var/log/ceph/ceph-client.admin.34861.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58356.log.gz 2024-04-25T10:05:47.145 INFO:teuthology.orchestra.run.smithi007.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34861.log.gz 2024-04-25T10:05:47.145 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47670.log 2024-04-25T10:05:47.146 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47880.log 2024-04-25T10:05:47.146 INFO:teuthology.orchestra.run.smithi007.stderr: 90.0%/var/log/ceph/ceph-client.admin.47670.log: -- replaced with /var/log/ceph/ceph-client.admin.53237.log.gz 2024-04-25T10:05:47.146 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47670.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43022.log 2024-04-25T10:05:47.146 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-04-25T10:05:47.146 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47880.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47880.log.gz 2024-04-25T10:05:47.146 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52080.log 2024-04-25T10:05:47.146 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46710.log 2024-04-25T10:05:47.146 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43022.log.gz 2024-04-25T10:05:47.146 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51025.log 2024-04-25T10:05:47.146 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46710.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52080.log.gz 2024-04-25T10:05:47.146 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46710.log.gz 2024-04-25T10:05:47.146 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80181.log 2024-04-25T10:05:47.147 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40863.log 2024-04-25T10:05:47.147 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51025.log: /var/log/ceph/ceph-client.admin.80181.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51025.log.gz 2024-04-25T10:05:47.147 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.80181.log.gz 2024-04-25T10:05:47.147 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61568.log 2024-04-25T10:05:47.147 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71315.log 2024-04-25T10:05:47.147 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61568.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.40863.log.gz 2024-04-25T10:05:47.147 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61568.log.gz 2024-04-25T10:05:47.147 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63222.log 2024-04-25T10:05:47.147 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.71315.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.0.71315.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.48984.log 2024-04-25T10:05:47.147 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-04-25T10:05:47.147 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74519.log 2024-04-25T10:05:47.147 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63222.log: /var/log/ceph/ceph-client.admin.48984.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48984.log.gz 2024-04-25T10:05:47.147 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63222.log.gz 2024-04-25T10:05:47.148 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49408.log 2024-04-25T10:05:47.148 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.74519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71068.log 2024-04-25T10:05:47.148 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.74519.log.gz 2024-04-25T10:05:47.148 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.49408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73305.log 2024-04-25T10:05:47.148 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.71068.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49408.log.gz 2024-04-25T10:05:47.148 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.71068.log.gz 2024-04-25T10:05:47.148 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45675.log 2024-04-25T10:05:47.148 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73431.log 2024-04-25T10:05:47.148 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.73305.log.gz/var/log/ceph/ceph-client.admin.45675.log: 2024-04-25T10:05:47.148 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40397.log 2024-04-25T10:05:47.148 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45675.log.gz 2024-04-25T10:05:47.148 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73431.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.73431.log.gz 2024-04-25T10:05:47.148 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52515.log 2024-04-25T10:05:47.149 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65195.log 2024-04-25T10:05:47.149 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40397.log.gz 2024-04-25T10:05:47.149 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46473.log 2024-04-25T10:05:47.149 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.65195.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52515.log.gz 2024-04-25T10:05:47.149 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.65195.log.gz 2024-04-25T10:05:47.149 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79737.log 2024-04-25T10:05:47.149 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79130.log 2024-04-25T10:05:47.149 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46473.log.gz 2024-04-25T10:05:47.149 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.79737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45423.log 2024-04-25T10:05:47.149 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.79130.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.79737.log.gz 2024-04-25T10:05:47.149 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.79130.log.gz 2024-04-25T10:05:47.149 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59289.log 2024-04-25T10:05:47.149 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58995.log 2024-04-25T10:05:47.149 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45423.log.gz 2024-04-25T10:05:47.150 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.59289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62783.log 2024-04-25T10:05:47.150 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58995.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59289.log.gz 2024-04-25T10:05:47.150 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58995.log.gz 2024-04-25T10:05:47.150 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72295.log 2024-04-25T10:05:47.150 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79424.log 2024-04-25T10:05:47.150 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62783.log.gz 2024-04-25T10:05:47.150 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43604.log 2024-04-25T10:05:47.150 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.79424.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.72295.log.gz 2024-04-25T10:05:47.150 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.79424.log.gz 2024-04-25T10:05:47.150 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48300.log 2024-04-25T10:05:47.150 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.43604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55769.log 2024-04-25T10:05:47.150 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43604.log.gz 2024-04-25T10:05:47.150 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48300.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45801.log 2024-04-25T10:05:47.151 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48300.log.gz 2024-04-25T10:05:47.151 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55769.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55769.log.gz 2024-04-25T10:05:47.151 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51954.log 2024-04-25T10:05:47.151 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60496.log 2024-04-25T10:05:47.151 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45801.log.gz 2024-04-25T10:05:47.151 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54092.log 2024-04-25T10:05:47.151 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60496.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51954.log.gz 2024-04-25T10:05:47.151 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60496.log.gz 2024-04-25T10:05:47.151 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54657.log 2024-04-25T10:05:47.151 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61460.log 2024-04-25T10:05:47.151 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54092.log.gz 2024-04-25T10:05:47.151 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52261.log 2024-04-25T10:05:47.151 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61460.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54657.log.gz 2024-04-25T10:05:47.151 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61460.log.gz 2024-04-25T10:05:47.152 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51067.log 2024-04-25T10:05:47.152 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.52261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56087.log 2024-04-25T10:05:47.152 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52261.log.gz 2024-04-25T10:05:47.152 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.51067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79971.log 2024-04-25T10:05:47.152 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7%/var/log/ceph/ceph-client.admin.56087.log: -- replaced with /var/log/ceph/ceph-client.admin.51067.log.gz 2024-04-25T10:05:47.152 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56087.log.gz 2024-04-25T10:05:47.152 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58440.log 2024-04-25T10:05:47.152 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.79971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80391.log 2024-04-25T10:05:47.152 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.79971.log.gz 2024-04-25T10:05:47.152 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45633.log 2024-04-25T10:05:47.152 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.80391.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58440.log.gz 2024-04-25T10:05:47.152 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.80391.log.gz 2024-04-25T10:05:47.152 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60161.log 2024-04-25T10:05:47.153 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.45633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80769.log 2024-04-25T10:05:47.153 INFO:teuthology.orchestra.run.smithi007.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45633.log.gz 2024-04-25T10:05:47.153 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67122.log 2024-04-25T10:05:47.153 INFO:teuthology.orchestra.run.smithi007.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60161.log.gz 2024-04-25T10:05:47.153 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.80769.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.80769.log.gz 2024-04-25T10:05:47.153 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73767.log 2024-04-25T10:05:47.153 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.67122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61083.log 2024-04-25T10:05:47.153 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.67122.log.gz 2024-04-25T10:05:47.153 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66422.log 2024-04-25T10:05:47.153 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61083.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.73767.log.gz 2024-04-25T10:05:47.153 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61083.log.gz 2024-04-25T10:05:47.153 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48563.log 2024-04-25T10:05:47.153 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.66422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58615.log 2024-04-25T10:05:47.153 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48563.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.66422.log.gz 2024-04-25T10:05:47.154 INFO:teuthology.orchestra.run.smithi007.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48563.log.gz 2024-04-25T10:05:47.154 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53470.log 2024-04-25T10:05:47.154 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75985.log 2024-04-25T10:05:47.154 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58615.log.gz 2024-04-25T10:05:47.154 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.53470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74433.log 2024-04-25T10:05:47.154 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.75985.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.75985.log.gz 2024-04-25T10:05:47.154 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69859.log 2024-04-25T10:05:47.154 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.74433.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.53470.log.gz 2024-04-25T10:05:47.154 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.74433.log.gz 2024-04-25T10:05:47.154 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68172.log 2024-04-25T10:05:47.154 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46626.log 2024-04-25T10:05:47.154 INFO:teuthology.orchestra.run.smithi007.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.69859.log.gz 2024-04-25T10:05:47.154 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78544.log 2024-04-25T10:05:47.154 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.46626.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.68172.log.gz 2024-04-25T10:05:47.155 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46626.log.gz 2024-04-25T10:05:47.155 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48360.log 2024-04-25T10:05:47.155 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.78544.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52347.log 2024-04-25T10:05:47.155 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.0.78544.log.gz 2024-04-25T10:05:47.155 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61871.log 2024-04-25T10:05:47.155 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48360.log: /var/log/ceph/ceph-client.admin.52347.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48360.log.gz 2024-04-25T10:05:47.155 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52347.log.gz 2024-04-25T10:05:47.155 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48690.log 2024-04-25T10:05:47.155 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.61871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76287.log 2024-04-25T10:05:47.155 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.48690.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.61871.log.gz 2024-04-25T10:05:47.155 INFO:teuthology.orchestra.run.smithi007.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48690.log.gz 2024-04-25T10:05:47.155 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44024.log 2024-04-25T10:05:47.155 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.76287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69773.log 2024-04-25T10:05:47.155 INFO:teuthology.orchestra.run.smithi007.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.76287.log.gz 2024-04-25T10:05:47.155 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.44024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63095.log 2024-04-25T10:05:47.156 INFO:teuthology.orchestra.run.smithi007.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44024.log.gz 2024-04-25T10:05:47.156 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.69773.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.69773.log.gz 2024-04-25T10:05:47.156 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60999.log 2024-04-25T10:05:47.156 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.63095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42428.log 2024-04-25T10:05:47.156 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63095.log.gz 2024-04-25T10:05:47.156 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.60999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75525.log 2024-04-25T10:05:47.156 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.42428.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60999.log.gz 2024-04-25T10:05:47.156 INFO:teuthology.orchestra.run.smithi007.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42428.log.gz 2024-04-25T10:05:47.156 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55042.log 2024-04-25T10:05:47.156 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.75525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40167.log 2024-04-25T10:05:47.156 INFO:teuthology.orchestra.run.smithi007.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.75525.log.gz 2024-04-25T10:05:47.156 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58780.log 2024-04-25T10:05:47.156 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40167.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55042.log.gz 2024-04-25T10:05:47.156 INFO:teuthology.orchestra.run.smithi007.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40167.log.gz 2024-04-25T10:05:47.157 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60835.log 2024-04-25T10:05:47.157 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.58780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47544.log 2024-04-25T10:05:47.157 INFO:teuthology.orchestra.run.smithi007.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58780.log.gz 2024-04-25T10:05:47.157 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.60835.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.60835.log.gz 2024-04-25T10:05:47.157 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66107.log 2024-04-25T10:05:47.157 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47544.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47544.log.gz 2024-04-25T10:05:47.157 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76688.log 2024-04-25T10:05:47.157 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.66107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54260.log 2024-04-25T10:05:47.157 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66107.log.gz 2024-04-25T10:05:47.157 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.76688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40483.log 2024-04-25T10:05:47.157 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.54260.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.76688.log.gz 2024-04-25T10:05:47.157 INFO:teuthology.orchestra.run.smithi007.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54260.log.gz 2024-04-25T10:05:47.157 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55811.log 2024-04-25T10:05:47.157 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.40483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65588.log 2024-04-25T10:05:47.158 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40483.log.gz 2024-04-25T10:05:47.158 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.55811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73641.log 2024-04-25T10:05:47.158 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.65588.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55811.log.gz 2024-04-25T10:05:47.158 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.65588.log.gz 2024-04-25T10:05:47.158 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73725.log 2024-04-25T10:05:47.158 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62993.log 2024-04-25T10:05:47.158 INFO:teuthology.orchestra.run.smithi007.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.73641.log.gz 2024-04-25T10:05:47.158 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.73725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44150.log 2024-04-25T10:05:47.158 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.62993.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.73725.log.gz 2024-04-25T10:05:47.158 INFO:teuthology.orchestra.run.smithi007.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62993.log.gz 2024-04-25T10:05:47.158 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70822.log 2024-04-25T10:05:47.158 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.44150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68392.log 2024-04-25T10:05:47.158 INFO:teuthology.orchestra.run.smithi007.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44150.log.gz 2024-04-25T10:05:47.158 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.70822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68214.log 2024-04-25T10:05:47.159 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68392.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70822.log.gz 2024-04-25T10:05:47.159 INFO:teuthology.orchestra.run.smithi007.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68392.log.gz 2024-04-25T10:05:47.159 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47964.log 2024-04-25T10:05:47.159 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74296.log 2024-04-25T10:05:47.159 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.68214.log.gz 2024-04-25T10:05:47.159 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.47964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72253.log 2024-04-25T10:05:47.159 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.74296.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47964.log.gz 2024-04-25T10:05:47.159 INFO:teuthology.orchestra.run.smithi007.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.74296.log.gz 2024-04-25T10:05:47.159 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68434.log 2024-04-25T10:05:47.159 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.72253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67819.log 2024-04-25T10:05:47.159 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.68434.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.72253.log.gz 2024-04-25T10:05:47.159 INFO:teuthology.orchestra.run.smithi007.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.68434.log.gz 2024-04-25T10:05:47.159 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.67819.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.67819.log.gz 2024-04-25T10:05:47.184 INFO:teuthology.orchestra.run.smithi007.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T10:05:47.594 INFO:teuthology.orchestra.run.smithi007.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T10:05:47.949 INFO:teuthology.orchestra.run.smithi055.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-25T10:05:47.985 INFO:teuthology.orchestra.run.smithi055.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-25T10:05:48.038 INFO:teuthology.orchestra.run.smithi055.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-25T10:05:48.072 INFO:teuthology.orchestra.run.smithi055.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-25T10:05:48.074 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-25T10:05:48.074 INFO:teuthology.orchestra.run.smithi055.stderr:real 0m1.419s 2024-04-25T10:05:48.074 INFO:teuthology.orchestra.run.smithi055.stderr:user 0m5.963s 2024-04-25T10:05:48.074 INFO:teuthology.orchestra.run.smithi055.stderr:sys 0m0.205s 2024-04-25T10:05:48.127 INFO:teuthology.orchestra.run.smithi007.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T10:05:48.174 INFO:teuthology.orchestra.run.smithi007.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T10:05:48.189 INFO:teuthology.orchestra.run.smithi007.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T10:05:48.433 INFO:teuthology.orchestra.run.smithi007.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T10:05:48.435 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-04-25T10:05:48.435 INFO:teuthology.orchestra.run.smithi007.stderr:real 0m1.809s 2024-04-25T10:05:48.435 INFO:teuthology.orchestra.run.smithi007.stderr:user 0m7.514s 2024-04-25T10:05:48.436 INFO:teuthology.orchestra.run.smithi007.stderr:sys 0m0.653s 2024-04-25T10:05:48.436 INFO:tasks.ceph:Archiving logs... 2024-04-25T10:05:48.436 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/log/ceph to /home/teuthworker/archive/neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673038/remote/smithi007/log 2024-04-25T10:05:48.437 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T10:05:49.444 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-04-25T10:05:49.444 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-04-25T10:05:49.444 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-04-25T10:05:50.181 DEBUG:teuthology.misc:Transferring archived files from smithi055:/var/log/ceph to /home/teuthworker/archive/neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673038/remote/smithi055/log 2024-04-25T10:05:50.182 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T10:05:51.045 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T10:05:51.055 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T10:05:51.055 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T10:05:51.058 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T10:05:51.141 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T10:05:51.150 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T10:05:51.151 DEBUG:teuthology.orchestra.run.smithi007:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T10:05:51.153 DEBUG:teuthology.orchestra.run.smithi055:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T10:05:51.168 INFO:teuthology.orchestra.run.smithi007.stderr:bash: line 1: ntpq: command not found 2024-04-25T10:05:51.169 INFO:teuthology.orchestra.run.smithi055.stderr:bash: line 1: ntpq: command not found 2024-04-25T10:05:51.172 INFO:teuthology.orchestra.run.smithi007.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T10:05:51.172 INFO:teuthology.orchestra.run.smithi007.stdout:=============================================================================== 2024-04-25T10:05:51.173 INFO:teuthology.orchestra.run.smithi007.stdout:^* hv01.front.sepia.ceph.com 3 6 377 18 +1389us[+1403us] +/- 65ms 2024-04-25T10:05:51.173 INFO:teuthology.orchestra.run.smithi007.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 15 -1174us[-1174us] +/- 60ms 2024-04-25T10:05:51.173 INFO:teuthology.orchestra.run.smithi007.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 -159us[ -159us] +/- 81ms 2024-04-25T10:05:51.173 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T10:05:51.175 INFO:teuthology.orchestra.run.smithi055.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T10:05:51.175 INFO:teuthology.orchestra.run.smithi055.stdout:=============================================================================== 2024-04-25T10:05:51.175 INFO:teuthology.orchestra.run.smithi055.stdout:^* hv01.front.sepia.ceph.com 3 6 377 19 +1400us[+1432us] +/- 65ms 2024-04-25T10:05:51.175 INFO:teuthology.orchestra.run.smithi055.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 15 -1142us[-1142us] +/- 60ms 2024-04-25T10:05:51.175 INFO:teuthology.orchestra.run.smithi055.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 -140us[ -140us] +/- 81ms 2024-04-25T10:05:51.175 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T10:05:51.175 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T10:05:51.185 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T10:05:51.186 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T10:05:51.210 DEBUG:teuthology.orchestra.run.smithi007:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T10:05:51.306 DEBUG:teuthology.orchestra.run.smithi055:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T10:05:51.376 DEBUG:teuthology.orchestra.run.smithi007:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-25T10:05:51.406 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:05:51.407 DEBUG:teuthology.orchestra.run.smithi055:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-25T10:05:51.436 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:05:51.436 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T10:05:51.445 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T10:05:51.477 INFO:teuthology.task.internal:Duration was 1080.184270 seconds 2024-04-25T10:05:51.478 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T10:05:51.510 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T10:05:51.510 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T10:05:51.513 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T10:05:51.551 INFO:teuthology.orchestra.run.smithi007.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T10:05:51.553 INFO:teuthology.orchestra.run.smithi055.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T10:05:51.792 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T10:05:51.792 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi007.front.sepia.ceph.com 2024-04-25T10:05:51.792 DEBUG:teuthology.orchestra.run.smithi007:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T10:05:51.855 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi055.front.sepia.ceph.com 2024-04-25T10:05:51.855 DEBUG:teuthology.orchestra.run.smithi055:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T10:05:51.883 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T10:05:51.883 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T10:05:51.898 DEBUG:teuthology.orchestra.run.smithi055:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T10:05:51.950 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T10:05:51.950 DEBUG:teuthology.orchestra.run.smithi007:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T10:05:51.965 DEBUG:teuthology.orchestra.run.smithi055:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T10:05:52.097 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T10:05:52.108 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T10:05:52.108 DEBUG:teuthology.orchestra.run.smithi007:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T10:05:52.132 DEBUG:teuthology.orchestra.run.smithi055:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T10:05:52.157 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T10:05:52.167 DEBUG:teuthology.orchestra.run.smithi007:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T10:05:52.174 DEBUG:teuthology.orchestra.run.smithi055:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T10:05:52.195 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = core 2024-04-25T10:05:52.219 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern = core 2024-04-25T10:05:52.232 DEBUG:teuthology.orchestra.run.smithi007:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T10:05:52.257 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:05:52.258 DEBUG:teuthology.orchestra.run.smithi055:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T10:05:52.292 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:05:52.292 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T10:05:52.302 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T10:05:52.303 DEBUG:teuthology.misc:Transferring archived files from smithi007:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673038/remote/smithi007 2024-04-25T10:05:52.303 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T10:05:52.340 DEBUG:teuthology.misc:Transferring archived files from smithi055:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673038/remote/smithi055 2024-04-25T10:05:52.340 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T10:05:52.373 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T10:05:52.373 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T10:05:52.377 DEBUG:teuthology.orchestra.run.smithi055:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T10:05:52.423 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T10:05:52.434 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T10:05:52.435 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T10:05:52.512 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T10:05:52.512 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T10:05:52.514 DEBUG:teuthology.orchestra.run.smithi055:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T10:05:52.527 INFO:teuthology.orchestra.run.smithi007.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 10:05 /home/ubuntu/cephtest 2024-04-25T10:05:52.530 INFO:teuthology.orchestra.run.smithi055.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 10:05 /home/ubuntu/cephtest 2024-04-25T10:05:52.531 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T10:05:52.545 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T10:05:52.614 INFO:teuthology.run:Summary data: description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/forward-scrub} duration: 1080.184270143509 flavor: default owner: scheduled_neesingh@teuthology success: true 2024-04-25T10:05:52.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T10:05:52.692 INFO:teuthology.run:pass